2024-03-30T12:03:43.233 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-30T12:03:43.233 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --name yuriw-2024-03-30_00:41:04-rados-wip-ceph_test_rados-partial-reads-distro-default-smithi --description rados/upgrade/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} --archive /home/teuthworker/archive/yuriw-2024-03-30_00:41:04-rados-wip-ceph_test_rados-partial-reads-distro-default-smithi/7630653 --verbose -- /home/teuthworker/archive/yuriw-2024-03-30_00:41:04-rados-wip-ceph_test_rados-partial-reads-distro-default-smithi/7630653/orig.config.yaml 2024-03-30T12:03:43.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T12:03:43.371 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-03-30_00:41:04-rados-wip-ceph_test_rados-partial-reads-distro-default-smithi/7630653 branch: wip-ceph_test_rados-partial-reads description: rados/upgrade/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} email: yweinste@redhat.com first_in_suite: false job_id: '7630653' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'run run randomized correctness test for rados operations on an erasure-coded pool ' - desc: 'object class functional tests ' - desc: 'generate read/write load with rados objects ranging from 1MB to 25MB ' - desc: 'run basic import/export cli tests for rbd ' - desc: 'librbd C and C++ api tests ' - desc: 'librbd python api tests ' name: yuriw-2024-03-30_00:41:04-rados-wip-ceph_test_rados-partial-reads-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-ceph_test_rados-partial-reads ceph: conf: global: mon election default strategy: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 osd shutdown pgref assert: true create_rbd_pool: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: extra_system_packages: - python3-pytest flavor: default sha1: 5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-ceph_test_rados-partial-reads sha1: 5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc owner: scheduled_yuriw@teuthology priority: 99 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - alertmanager.a - - mon.b - mds.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b seed: 9805 sha1: 5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-ceph_test_rados-partial-reads suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc targets: smithi084.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEIugBWdrP3T2RUWloFGQbMi8/5P42qD6z3vdLDF2OIEtGBkBLy+EAQE3Z5Vw3PfOu5qRM62r1lyJ1L70LvQdBo= smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEpiQC+FKBOtIuEegw3sZZs1yM/SelTMCr7pZdUg3ibhZyycMQJMMp97y7/jwtRpFt3N5v9t81qXqLHXNgw1FbE= tasks: - install: branch: reef exclude_packages: - ceph-volume - print: '**** done install task...' - print: '**** done start installing reef cephadm ...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:reef - print: '**** done end installing reef cephadm ...' - print: '**** done start cephadm.shell ceph config set mgr...' - cephadm.shell: mon.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - print: '**** done start telemetry reef...' - workunit: clients: client.0: - test_telemetry_reef.sh - print: '**** done end telemetry reef...' - print: '**** done start parallel' - parallel: - workload - upgrade-sequence - print: '**** done end parallel' - print: '**** done start telemetry x...' - workunit: clients: client.0: - test_telemetry_reef_x.sh - print: '**** done end telemetry x...' teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-30_00:41:04 tube: smithi upgrade-sequence: sequential: - print: '**** done start upgrade, wait' - cephadm.shell: env: - sha1 mon.a: - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - while ceph orch upgrade status | jq '.in_progress' | grep true ; do ceph orch ps ; ceph versions ; sleep 30 ; done - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 - print: '**** done end upgrade, wait...' user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload: full_sequential: - print: '**** done start ec-rados-default.yaml' - rados: clients: - client.0 ec_pool: true objects: 50 op_weights: append: 100 copy_from: 50 delete: 50 read: 100 rmattr: 25 rollback: 50 setattr: 25 snap_create: 50 snap_remove: 50 write: 0 ops: 4000 write_append_excl: false - print: '**** done end ec-rados-default.yaml' - print: '**** done start rados_api.yaml' - workunit: branch: reef clients: client.0: - cls - print: '**** done end rados_api.yaml' - print: '**** done start rados_loadgenbig.yaml' - workunit: branch: reef clients: client.0: - rados/load-gen-big.sh - print: '**** done end rados_loadgenbig.yaml' - print: '**** done start rbd_import_export.yaml' - workunit: branch: reef clients: client.1: - rbd/import_export.sh env: RBD_CREATE_ARGS: --new-format - print: '**** done end rbd_import_export.yaml' - print: '**** done start test_rbd_api.yaml' - workunit: branch: reef clients: client.0: - rbd/test_librbd.sh env: RBD_FEATURES: '61' - print: '**** done end test_rbd_api.yaml' - print: '**** done start test_rbd_python.yaml' - workunit: branch: reef clients: client.0: - rbd/test_librbd_python.sh env: RBD_FEATURES: '61' - print: '**** done end test_rbd_python.yaml' 2024-03-30T12:03:43.371 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc/qa; will attempt to use it 2024-03-30T12:03:43.372 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc/qa/tasks 2024-03-30T12:03:43.372 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-30T12:03:43.374 INFO:teuthology.task.internal:Checking packages... 2024-03-30T12:03:43.396 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc' 2024-03-30T12:03:43.396 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-30T12:03:43.396 INFO:teuthology.packaging:ref: None 2024-03-30T12:03:43.396 INFO:teuthology.packaging:tag: None 2024-03-30T12:03:43.396 INFO:teuthology.packaging:branch: wip-ceph_test_rados-partial-reads 2024-03-30T12:03:43.396 INFO:teuthology.packaging:sha1: 5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc 2024-03-30T12:03:43.397 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-ceph_test_rados-partial-reads 2024-03-30T12:03:43.612 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1864.g5dc2ea30 2024-03-30T12:03:43.613 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-30T12:03:43.620 INFO:teuthology.task.internal:no buildpackages task found 2024-03-30T12:03:43.620 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-30T12:03:43.625 INFO:teuthology.task.internal:Saving configuration 2024-03-30T12:03:43.643 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-30T12:03:43.649 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-30T12:03:43.674 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-03-30_00:41:04-rados-wip-ceph_test_rados-partial-reads-distro-default-smithi/7630653', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 11:58:35.080767', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEIugBWdrP3T2RUWloFGQbMi8/5P42qD6z3vdLDF2OIEtGBkBLy+EAQE3Z5Vw3PfOu5qRM62r1lyJ1L70LvQdBo='} 2024-03-30T12:03:43.697 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-03-30_00:41:04-rados-wip-ceph_test_rados-partial-reads-distro-default-smithi/7630653', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 11:58:35.079059', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEpiQC+FKBOtIuEegw3sZZs1yM/SelTMCr7pZdUg3ibhZyycMQJMMp97y7/jwtRpFt3N5v9t81qXqLHXNgw1FbE='} 2024-03-30T12:03:43.698 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-30T12:03:43.704 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2024-03-30T12:03:43.704 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.b', 'mds.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2024-03-30T12:03:43.704 INFO:teuthology.run_tasks:Running task console_log... 2024-03-30T12:03:43.776 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f74bb69c160>, signals=[15]) 2024-03-30T12:03:43.776 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-30T12:03:43.783 INFO:teuthology.task.internal:Opening connections... 2024-03-30T12:03:43.783 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2024-03-30T12:03:43.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:03:43.877 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2024-03-30T12:03:43.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:03:43.966 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-30T12:03:43.973 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-03-30T12:03:43.991 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-03-30T12:03:43.991 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-03-30T12:03:44.048 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-03-30T12:03:44.048 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2024-03-30T12:03:44.048 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-03-30T12:03:44.048 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-03-30T12:03:44.048 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2024-03-30T12:03:44.048 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2024-03-30T12:03:44.048 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-30T12:03:44.048 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-03-30T12:03:44.049 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2024-03-30T12:03:44.049 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-30T12:03:44.049 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-03-30T12:03:44.049 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-30T12:03:44.049 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-30T12:03:44.049 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-30T12:03:44.050 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-03-30T12:03:44.076 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-03-30T12:03:44.094 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-03-30T12:03:44.094 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-03-30T12:03:44.151 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-03-30T12:03:44.151 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-03-30T12:03:44.151 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-03-30T12:03:44.151 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-03-30T12:03:44.151 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-03-30T12:03:44.151 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-03-30T12:03:44.151 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-30T12:03:44.151 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-03-30T12:03:44.151 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-03-30T12:03:44.152 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-30T12:03:44.152 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-03-30T12:03:44.152 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-30T12:03:44.152 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-30T12:03:44.152 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-30T12:03:44.152 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-03-30T12:03:44.176 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-30T12:03:44.185 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-30T12:03:44.190 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-30T12:03:44.191 DEBUG:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2024-03-30T12:03:44.193 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2024-03-30T12:03:44.209 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-30T12:03:44.215 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-30T12:03:44.215 DEBUG:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2024-03-30T12:03:44.250 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2024-03-30T12:03:44.292 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-30T12:03:44.349 INFO:teuthology.run_tasks:Running task kernel... 2024-03-30T12:03:44.364 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-30T12:03:44.364 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-30T12:03:44.365 DEBUG:teuthology.orchestra.run.smithi084:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-30T12:03:44.365 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-30T12:03:44.381 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T12:03:44.381 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2024-03-30T12:03:44.382 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T12:03:44.383 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-03-30T12:03:44.438 INFO:teuthology.orchestra.run.smithi084.stdout:5.14.0-361.el9.x86_64 2024-03-30T12:03:44.438 INFO:teuthology.task.kernel:Running kernel on smithi084: 5.14.0-361.el9.x86_64 2024-03-30T12:03:44.438 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum install -y kernel 2024-03-30T12:03:44.440 INFO:teuthology.orchestra.run.smithi162.stdout:5.14.0-361.el9.x86_64 2024-03-30T12:03:44.440 INFO:teuthology.task.kernel:Running kernel on smithi162: 5.14.0-361.el9.x86_64 2024-03-30T12:03:44.440 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum install -y kernel 2024-03-30T12:03:46.477 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS-9 - AppStream 15 MB/s | 6.7 MB 00:00 2024-03-30T12:03:46.528 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS-9 - AppStream 15 MB/s | 6.7 MB 00:00 2024-03-30T12:03:47.910 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS-9 - BaseOS 6.7 MB/s | 2.0 MB 00:00 2024-03-30T12:03:47.995 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS-9 - BaseOS 6.1 MB/s | 2.0 MB 00:00 2024-03-30T12:03:49.110 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-03-30T12:03:51.506 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 14 MB/s | 19 MB 00:01 2024-03-30T12:03:58.078 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 2.0 MB/s | 6.1 MB 00:03 2024-03-30T12:03:58.190 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - BaseOS 827 kB/s | 8.0 MB 00:09 2024-03-30T12:03:59.428 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 74 kB/s | 16 kB 00:00 2024-03-30T12:04:00.377 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - AppStream 17 MB/s | 19 MB 00:01 2024-03-30T12:04:00.923 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-03-30T12:04:04.350 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.1 MB 00:00 2024-03-30T12:04:05.934 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 16 kB 00:00 2024-03-30T12:04:06.046 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-03-30T12:04:08.269 INFO:teuthology.orchestra.run.smithi162.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-30T12:04:08.269 INFO:teuthology.orchestra.run.smithi162.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-30T12:04:08.370 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-03-30T12:04:08.382 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-03-30T12:04:08.382 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-03-30T12:04:08.383 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-03-30T12:04:08.383 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-03-30T12:04:08.383 INFO:teuthology.orchestra.run.smithi162.stdout: kernel x86_64 5.14.0-434.el9 CentOS-BaseOS 192 k 2024-03-30T12:04:08.383 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-03-30T12:04:08.383 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-core x86_64 5.14.0-434.el9 CentOS-BaseOS 15 M 2024-03-30T12:04:08.383 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules x86_64 5.14.0-434.el9 CentOS-BaseOS 34 M 2024-03-30T12:04:08.383 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-core x86_64 5.14.0-434.el9 CentOS-BaseOS 28 M 2024-03-30T12:04:08.383 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-03-30T12:04:08.383 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-03-30T12:04:08.383 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-03-30T12:04:08.383 INFO:teuthology.orchestra.run.smithi162.stdout:Install 4 Packages 2024-03-30T12:04:08.383 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-03-30T12:04:08.384 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 76 M 2024-03-30T12:04:08.384 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 123 M 2024-03-30T12:04:08.384 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-03-30T12:04:08.564 INFO:teuthology.orchestra.run.smithi162.stdout:(1/4): kernel-5.14.0-434.el9.x86_64.rpm 1.0 MB/s | 192 kB 00:00 2024-03-30T12:04:09.256 INFO:teuthology.orchestra.run.smithi162.stdout:(2/4): kernel-core-5.14.0-434.el9.x86_64.rpm 17 MB/s | 15 MB 00:00 2024-03-30T12:04:09.897 INFO:teuthology.orchestra.run.smithi162.stdout:(3/4): kernel-modules-5.14.0-434.el9.x86_64.rpm 22 MB/s | 34 MB 00:01 2024-03-30T12:04:10.406 INFO:teuthology.orchestra.run.smithi162.stdout:(4/4): kernel-modules-core-5.14.0-434.el9.x86_6 15 MB/s | 28 MB 00:01 2024-03-30T12:04:10.409 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-03-30T12:04:10.409 INFO:teuthology.orchestra.run.smithi162.stdout:Total 38 MB/s | 76 MB 00:02 2024-03-30T12:04:10.409 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-03-30T12:04:10.551 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 4.6 MB/s | 21 MB 00:04 2024-03-30T12:04:10.771 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-03-30T12:04:10.771 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-03-30T12:04:11.642 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-03-30T12:04:11.642 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-03-30T12:04:13.944 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-03-30T12:04:14.547 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-modules-core-5.14.0-434.el9.x86_64 1/4 2024-03-30T12:04:14.630 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-30T12:04:15.667 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2024-03-30T12:04:17.417 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-30T12:04:17.587 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-30T12:04:17.865 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-30T12:04:17.865 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-30T12:04:17.961 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-03-30T12:04:17.972 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-03-30T12:04:17.972 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-03-30T12:04:17.972 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-03-30T12:04:17.972 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-03-30T12:04:17.972 INFO:teuthology.orchestra.run.smithi084.stdout: kernel x86_64 5.14.0-434.el9 CentOS-BaseOS 192 k 2024-03-30T12:04:17.972 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-03-30T12:04:17.972 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-core x86_64 5.14.0-434.el9 CentOS-BaseOS 15 M 2024-03-30T12:04:17.973 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-modules x86_64 5.14.0-434.el9 CentOS-BaseOS 34 M 2024-03-30T12:04:17.973 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-modules-core x86_64 5.14.0-434.el9 CentOS-BaseOS 28 M 2024-03-30T12:04:17.973 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:04:17.973 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-03-30T12:04:17.973 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-03-30T12:04:17.973 INFO:teuthology.orchestra.run.smithi084.stdout:Install 4 Packages 2024-03-30T12:04:17.973 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:04:17.973 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 76 M 2024-03-30T12:04:17.974 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 123 M 2024-03-30T12:04:17.974 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-03-30T12:04:18.193 INFO:teuthology.orchestra.run.smithi084.stdout:(1/4): kernel-5.14.0-434.el9.x86_64.rpm 873 kB/s | 192 kB 00:00 2024-03-30T12:04:18.952 INFO:teuthology.orchestra.run.smithi084.stdout:(2/4): kernel-core-5.14.0-434.el9.x86_64.rpm 15 MB/s | 15 MB 00:00 2024-03-30T12:04:19.727 INFO:teuthology.orchestra.run.smithi084.stdout:(3/4): kernel-modules-5.14.0-434.el9.x86_64.rpm 19 MB/s | 34 MB 00:01 2024-03-30T12:04:20.077 INFO:teuthology.orchestra.run.smithi084.stdout:(4/4): kernel-modules-core-5.14.0-434.el9.x86_6 15 MB/s | 28 MB 00:01 2024-03-30T12:04:20.080 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-03-30T12:04:20.080 INFO:teuthology.orchestra.run.smithi084.stdout:Total 36 MB/s | 76 MB 00:02 2024-03-30T12:04:20.081 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-03-30T12:04:20.508 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-03-30T12:04:20.508 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-03-30T12:04:21.350 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-03-30T12:04:21.351 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-03-30T12:04:22.312 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-30T12:04:22.529 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-5.14.0-434.el9.x86_64 4/4 2024-03-30T12:04:23.643 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-03-30T12:04:24.259 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : kernel-modules-core-5.14.0-434.el9.x86_64 1/4 2024-03-30T12:04:24.344 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-30T12:04:27.132 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-30T12:04:27.259 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-core-5.14.0-434.el9.x86_64 4/4 2024-03-30T12:04:27.272 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-30T12:04:31.973 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-30T12:04:32.020 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : kernel-5.14.0-434.el9.x86_64 4/4 2024-03-30T12:04:36.748 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-modules-core-5.14.0-434.el9.x86_64 4/4 2024-03-30T12:04:56.385 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-core-5.14.0-434.el9.x86_64 4/4 2024-03-30T12:04:56.386 INFO:teuthology.orchestra.run.smithi162.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-30T12:04:56.386 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-03-30T12:04:56.429 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-5.14.0-434.el9.x86_64 4/4 2024-03-30T12:04:56.789 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-5.14.0-434.el9.x86_64 4/4 2024-03-30T12:04:56.789 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-5.14.0-434.el9.x86_64 1/4 2024-03-30T12:04:56.789 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-30T12:04:56.789 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-30T12:04:57.179 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-modules-core-5.14.0-434.el9.x86_64 4/4 2024-03-30T12:04:57.179 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-03-30T12:04:57.179 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-03-30T12:04:57.179 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-5.14.0-434.el9.x86_64 2024-03-30T12:04:57.179 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-core-5.14.0-434.el9.x86_64 2024-03-30T12:04:57.179 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-5.14.0-434.el9.x86_64 2024-03-30T12:04:57.179 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-core-5.14.0-434.el9.x86_64 2024-03-30T12:04:57.179 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-03-30T12:04:57.179 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-03-30T12:04:57.519 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q kernel | sort -rV | head -n 1 2024-03-30T12:04:57.619 INFO:teuthology.orchestra.run.smithi162.stdout:kernel-5.14.0-434.el9.x86_64 2024-03-30T12:04:57.619 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-434.el9.x86_64 2024-03-30T12:04:57.620 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-434.el9.x86_64 2024-03-30T12:04:57.620 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-30T12:04:57.620 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-30T12:04:57.620 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-03-30T12:04:57.620 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi162.front.sepia.ceph.com, path=None, version=distro) 2024-03-30T12:04:57.620 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q kernel | sort -rV | head -n 1 2024-03-30T12:04:57.700 INFO:teuthology.orchestra.run.smithi162.stdout:kernel-5.14.0-434.el9.x86_64 2024-03-30T12:04:57.701 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-434.el9.x86_64 2024-03-30T12:04:57.701 DEBUG:teuthology.orchestra.run.smithi162:> sudo rpm -qi grub2-tools 2024-03-30T12:04:57.737 INFO:teuthology.orchestra.run.smithi162.stdout:Name : grub2-tools 2024-03-30T12:04:57.738 INFO:teuthology.orchestra.run.smithi162.stdout:Epoch : 1 2024-03-30T12:04:57.738 INFO:teuthology.orchestra.run.smithi162.stdout:Version : 2.06 2024-03-30T12:04:57.738 INFO:teuthology.orchestra.run.smithi162.stdout:Release : 68.el9 2024-03-30T12:04:57.738 INFO:teuthology.orchestra.run.smithi162.stdout:Architecture: x86_64 2024-03-30T12:04:57.738 INFO:teuthology.orchestra.run.smithi162.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-30T12:04:57.738 INFO:teuthology.orchestra.run.smithi162.stdout:Group : Unspecified 2024-03-30T12:04:57.738 INFO:teuthology.orchestra.run.smithi162.stdout:Size : 8264254 2024-03-30T12:04:57.738 INFO:teuthology.orchestra.run.smithi162.stdout:License : GPLv3+ 2024-03-30T12:04:57.738 INFO:teuthology.orchestra.run.smithi162.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-30T12:04:57.738 INFO:teuthology.orchestra.run.smithi162.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-30T12:04:57.738 INFO:teuthology.orchestra.run.smithi162.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-30T12:04:57.738 INFO:teuthology.orchestra.run.smithi162.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-30T12:04:57.738 INFO:teuthology.orchestra.run.smithi162.stdout:Packager : builder@centos.org 2024-03-30T12:04:57.739 INFO:teuthology.orchestra.run.smithi162.stdout:Vendor : CentOS 2024-03-30T12:04:57.739 INFO:teuthology.orchestra.run.smithi162.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-30T12:04:57.739 INFO:teuthology.orchestra.run.smithi162.stdout:Summary : Support tools for GRUB. 2024-03-30T12:04:57.739 INFO:teuthology.orchestra.run.smithi162.stdout:Description : 2024-03-30T12:04:57.739 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-03-30T12:04:57.739 INFO:teuthology.orchestra.run.smithi162.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-30T12:04:57.739 INFO:teuthology.orchestra.run.smithi162.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-30T12:04:57.739 INFO:teuthology.orchestra.run.smithi162.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-30T12:04:57.739 INFO:teuthology.orchestra.run.smithi162.stdout:hardware devices. 2024-03-30T12:04:57.739 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-03-30T12:04:57.739 INFO:teuthology.orchestra.run.smithi162.stdout:This subpackage provides tools for support of all platforms. 2024-03-30T12:04:57.740 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-30T12:04:57.740 INFO:teuthology.task.kernel:Updating grub on smithi162 to boot 5.14.0-434.el9.x86_64 2024-03-30T12:04:57.740 DEBUG:teuthology.orchestra.run.smithi162:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-30T12:04:58.311 INFO:teuthology.orchestra.run.smithi162.stderr:Generating grub configuration file ... 2024-03-30T12:04:59.806 INFO:teuthology.orchestra.run.smithi162.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-30T12:04:59.832 INFO:teuthology.orchestra.run.smithi162.stderr:done 2024-03-30T12:04:59.834 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-03-30T12:04:59.852 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.izRIn8Y1o6 2024-03-30T12:04:59.852 DEBUG:teuthology.orchestra.run.smithi162:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.izRIn8Y1o6 2024-03-30T12:04:59.920 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.izRIn8Y1o6 2024-03-30T12:05:00.058 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.izRIn8Y1o6 is 6KB 2024-03-30T12:05:00.110 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.izRIn8Y1o6 2024-03-30T12:05:00.124 DEBUG:teuthology.orchestra.run.smithi162:> sudo /bin/ls /boot/loader/entries || true 2024-03-30T12:05:00.189 INFO:teuthology.orchestra.run.smithi162.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-30T12:05:00.189 INFO:teuthology.orchestra.run.smithi162.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-30T12:05:00.189 INFO:teuthology.orchestra.run.smithi162.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-30T12:05:00.190 INFO:teuthology.orchestra.run.smithi162.stdout:15949e3c88704300882482eddfd7baae-5.14.0-434.el9.x86_64.conf 2024-03-30T12:05:00.191 DEBUG:teuthology.orchestra.run.smithi162:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-434.el9.x86_64 2024-03-30T12:05:00.334 DEBUG:teuthology.orchestra.run.smithi162:> sudo shutdown -r now 2024-03-30T12:05:05.890 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-core-5.14.0-434.el9.x86_64 4/4 2024-03-30T12:05:05.890 INFO:teuthology.orchestra.run.smithi084.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-30T12:05:05.890 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:05:05.933 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-modules-5.14.0-434.el9.x86_64 4/4 2024-03-30T12:05:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-5.14.0-434.el9.x86_64 4/4 2024-03-30T12:05:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-5.14.0-434.el9.x86_64 1/4 2024-03-30T12:05:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-30T12:05:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-30T12:05:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-modules-core-5.14.0-434.el9.x86_64 4/4 2024-03-30T12:05:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:05:06.712 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-03-30T12:05:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-5.14.0-434.el9.x86_64 2024-03-30T12:05:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-core-5.14.0-434.el9.x86_64 2024-03-30T12:05:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-modules-5.14.0-434.el9.x86_64 2024-03-30T12:05:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-modules-core-5.14.0-434.el9.x86_64 2024-03-30T12:05:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:05:06.713 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-03-30T12:05:07.048 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q kernel | sort -rV | head -n 1 2024-03-30T12:05:07.147 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-5.14.0-434.el9.x86_64 2024-03-30T12:05:07.148 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-434.el9.x86_64 2024-03-30T12:05:07.148 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-434.el9.x86_64 2024-03-30T12:05:07.148 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-30T12:05:07.148 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-30T12:05:07.148 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-03-30T12:05:07.148 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi084.front.sepia.ceph.com, path=None, version=distro) 2024-03-30T12:05:07.148 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q kernel | sort -rV | head -n 1 2024-03-30T12:05:07.227 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-5.14.0-434.el9.x86_64 2024-03-30T12:05:07.227 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-434.el9.x86_64 2024-03-30T12:05:07.227 DEBUG:teuthology.orchestra.run.smithi084:> sudo rpm -qi grub2-tools 2024-03-30T12:05:07.270 INFO:teuthology.orchestra.run.smithi084.stdout:Name : grub2-tools 2024-03-30T12:05:07.271 INFO:teuthology.orchestra.run.smithi084.stdout:Epoch : 1 2024-03-30T12:05:07.271 INFO:teuthology.orchestra.run.smithi084.stdout:Version : 2.06 2024-03-30T12:05:07.271 INFO:teuthology.orchestra.run.smithi084.stdout:Release : 68.el9 2024-03-30T12:05:07.271 INFO:teuthology.orchestra.run.smithi084.stdout:Architecture: x86_64 2024-03-30T12:05:07.271 INFO:teuthology.orchestra.run.smithi084.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-30T12:05:07.271 INFO:teuthology.orchestra.run.smithi084.stdout:Group : Unspecified 2024-03-30T12:05:07.271 INFO:teuthology.orchestra.run.smithi084.stdout:Size : 8264254 2024-03-30T12:05:07.271 INFO:teuthology.orchestra.run.smithi084.stdout:License : GPLv3+ 2024-03-30T12:05:07.271 INFO:teuthology.orchestra.run.smithi084.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-30T12:05:07.271 INFO:teuthology.orchestra.run.smithi084.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-30T12:05:07.271 INFO:teuthology.orchestra.run.smithi084.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-30T12:05:07.271 INFO:teuthology.orchestra.run.smithi084.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-30T12:05:07.271 INFO:teuthology.orchestra.run.smithi084.stdout:Packager : builder@centos.org 2024-03-30T12:05:07.272 INFO:teuthology.orchestra.run.smithi084.stdout:Vendor : CentOS 2024-03-30T12:05:07.272 INFO:teuthology.orchestra.run.smithi084.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-30T12:05:07.272 INFO:teuthology.orchestra.run.smithi084.stdout:Summary : Support tools for GRUB. 2024-03-30T12:05:07.272 INFO:teuthology.orchestra.run.smithi084.stdout:Description : 2024-03-30T12:05:07.272 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:05:07.272 INFO:teuthology.orchestra.run.smithi084.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-30T12:05:07.272 INFO:teuthology.orchestra.run.smithi084.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-30T12:05:07.272 INFO:teuthology.orchestra.run.smithi084.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-30T12:05:07.272 INFO:teuthology.orchestra.run.smithi084.stdout:hardware devices. 2024-03-30T12:05:07.272 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:05:07.272 INFO:teuthology.orchestra.run.smithi084.stdout:This subpackage provides tools for support of all platforms. 2024-03-30T12:05:07.273 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-30T12:05:07.273 INFO:teuthology.task.kernel:Updating grub on smithi084 to boot 5.14.0-434.el9.x86_64 2024-03-30T12:05:07.273 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-30T12:05:07.916 INFO:teuthology.orchestra.run.smithi084.stderr:Generating grub configuration file ... 2024-03-30T12:05:09.389 INFO:teuthology.orchestra.run.smithi084.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-30T12:05:09.433 INFO:teuthology.orchestra.run.smithi084.stderr:done 2024-03-30T12:05:09.435 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2024-03-30T12:05:09.451 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.4FBaihRMgK 2024-03-30T12:05:09.452 DEBUG:teuthology.orchestra.run.smithi084:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4FBaihRMgK 2024-03-30T12:05:09.521 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.4FBaihRMgK 2024-03-30T12:05:09.660 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.4FBaihRMgK is 6KB 2024-03-30T12:05:09.708 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.4FBaihRMgK 2024-03-30T12:05:09.723 DEBUG:teuthology.orchestra.run.smithi084:> sudo /bin/ls /boot/loader/entries || true 2024-03-30T12:05:09.787 INFO:teuthology.orchestra.run.smithi084.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-30T12:05:09.787 INFO:teuthology.orchestra.run.smithi084.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-30T12:05:09.787 INFO:teuthology.orchestra.run.smithi084.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-30T12:05:09.788 INFO:teuthology.orchestra.run.smithi084.stdout:15949e3c88704300882482eddfd7baae-5.14.0-434.el9.x86_64.conf 2024-03-30T12:05:09.788 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-434.el9.x86_64 2024-03-30T12:05:09.941 DEBUG:teuthology.orchestra.run.smithi084:> sudo shutdown -r now 2024-03-30T12:05:30.354 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-03-30T12:05:30.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-03-30T12:05:30.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:05:39.950 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-30T12:05:39.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-03-30T12:05:39.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:06:04.830 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-03-30T12:06:13.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-03-30T12:06:13.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:06:14.558 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-03-30T12:06:23.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-03-30T12:06:23.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:06:32.222 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-03-30T12:06:41.950 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-03-30T12:06:44.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-03-30T12:06:44.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:06:47.451 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-03-30T12:06:47.935 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-03-30T12:06:47.935 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-434.el9.x86_64"... 2024-03-30T12:06:47.935 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-03-30T12:06:47.949 INFO:teuthology.orchestra.run.smithi162.stdout:5.14.0-434.el9.x86_64 2024-03-30T12:06:47.950 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-434.el9.x86_64 vs 5.14.0-434.el9.x86_64 2024-03-30T12:06:47.950 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-30T12:06:47.950 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-30T12:06:48.951 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-03-30T12:06:48.952 DEBUG:teuthology.orchestra.run.smithi162:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-30T12:06:49.053 INFO:teuthology.orchestra.run.smithi162.stdout:ttyS1 2024-03-30T12:06:49.103 DEBUG:teuthology.parallel:result is None 2024-03-30T12:06:53.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-03-30T12:06:53.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:06:54.531 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-03-30T12:06:54.959 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-03-30T12:06:54.959 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-434.el9.x86_64"... 2024-03-30T12:06:54.959 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2024-03-30T12:06:54.974 INFO:teuthology.orchestra.run.smithi084.stdout:5.14.0-434.el9.x86_64 2024-03-30T12:06:54.975 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-434.el9.x86_64 vs 5.14.0-434.el9.x86_64 2024-03-30T12:06:54.975 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-30T12:06:54.975 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-30T12:06:55.976 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-30T12:06:55.976 DEBUG:teuthology.orchestra.run.smithi084:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-30T12:06:56.063 INFO:teuthology.orchestra.run.smithi084.stdout:ttyS1 2024-03-30T12:06:56.099 DEBUG:teuthology.parallel:result is None 2024-03-30T12:06:56.100 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-30T12:06:56.107 INFO:teuthology.task.internal:Creating test directory... 2024-03-30T12:06:56.107 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-30T12:06:56.109 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-30T12:06:56.124 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-30T12:06:56.131 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-30T12:06:56.140 INFO:teuthology.task.internal:Creating archive directory... 2024-03-30T12:06:56.141 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-30T12:06:56.165 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-30T12:06:56.194 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-30T12:06:56.203 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-30T12:06:56.204 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-30T12:06:56.223 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-30T12:06:56.251 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T12:06:56.257 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T12:06:56.264 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T12:06:56.270 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T12:06:56.272 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-30T12:06:56.279 INFO:teuthology.task.internal:Configuring sudo... 2024-03-30T12:06:56.279 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-30T12:06:56.308 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-30T12:06:56.339 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-30T12:06:56.349 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-30T12:06:56.349 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-30T12:06:56.375 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-30T12:06:56.393 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-30T12:06:56.467 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-30T12:06:56.518 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-30T12:06:56.599 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-30T12:06:56.642 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-30T12:06:56.642 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-30T12:06:56.709 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-30T12:06:56.777 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-30T12:06:56.823 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-30T12:06:56.866 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-30T12:06:56.907 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-03-30T12:06:56.907 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-30T12:06:56.974 DEBUG:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2024-03-30T12:06:56.976 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2024-03-30T12:06:57.026 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-30T12:06:57.072 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-30T12:06:57.287 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-30T12:06:57.296 INFO:teuthology.task.internal:Starting timer... 2024-03-30T12:06:57.296 INFO:teuthology.run_tasks:Running task pcp... 2024-03-30T12:06:57.356 INFO:teuthology.run_tasks:Running task selinux... 2024-03-30T12:06:57.365 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-03-30T12:06:57.366 DEBUG:teuthology.orchestra.run.smithi084:> sudo service auditd rotate 2024-03-30T12:06:57.403 INFO:teuthology.orchestra.run.smithi084.stdout:Rotating logs: 2024-03-30T12:06:57.405 DEBUG:teuthology.orchestra.run.smithi162:> sudo service auditd rotate 2024-03-30T12:06:57.455 INFO:teuthology.orchestra.run.smithi162.stdout:Rotating logs: 2024-03-30T12:06:57.457 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-30T12:06:57.457 DEBUG:teuthology.orchestra.run.smithi084:> /usr/sbin/getenforce 2024-03-30T12:06:57.478 INFO:teuthology.orchestra.run.smithi084.stdout:Permissive 2024-03-30T12:06:57.478 DEBUG:teuthology.orchestra.run.smithi162:> /usr/sbin/getenforce 2024-03-30T12:06:57.522 INFO:teuthology.orchestra.run.smithi162.stdout:Permissive 2024-03-30T12:06:57.522 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi084.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi162.front.sepia.ceph.com': 'permissive'} 2024-03-30T12:06:57.522 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-30T12:06:57.550 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T12:06:57.550 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-30T12:06:57.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T12:06:57.590 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-30T12:06:57.590 DEBUG:teuthology.orchestra.run.smithi084:> sudo /usr/sbin/setenforce permissive 2024-03-30T12:06:57.631 DEBUG:teuthology.orchestra.run.smithi162:> sudo /usr/sbin/setenforce permissive 2024-03-30T12:06:57.665 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-30T12:06:57.675 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-30T12:06:57.692 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-30T12:06:57.693 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi084.front.sepia.ceph.com,smithi162.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-30T12:11:15.991 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi084.front.sepia.ceph.com'), Remote(name='ubuntu@smithi162.front.sepia.ceph.com')] 2024-03-30T12:11:15.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-03-30T12:11:15.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:11:16.087 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-03-30T12:11:16.165 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-03-30T12:11:16.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-03-30T12:11:16.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:11:16.257 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-03-30T12:11:16.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-03-30T12:11:16.292 INFO:teuthology.run_tasks:Running task clock... 2024-03-30T12:11:16.303 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-30T12:11:16.304 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-30T12:11:16.304 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T12:11:16.306 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-30T12:11:16.306 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T12:11:16.335 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-30T12:11:16.352 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-30T12:11:16.365 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-30T12:11:16.380 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-30T12:11:16.381 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: ntpd: command not found 2024-03-30T12:11:16.394 INFO:teuthology.orchestra.run.smithi084.stdout:506 Cannot talk to daemon 2024-03-30T12:11:16.409 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: ntpd: command not found 2024-03-30T12:11:16.410 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-30T12:11:16.423 INFO:teuthology.orchestra.run.smithi162.stdout:506 Cannot talk to daemon 2024-03-30T12:11:16.427 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-30T12:11:16.441 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-30T12:11:16.456 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-30T12:11:16.482 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: ntpq: command not found 2024-03-30T12:11:16.487 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-30T12:11:16.487 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-03-30T12:11:16.487 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T12:11:16.487 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T12:11:16.487 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T12:11:16.487 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T12:11:16.509 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-03-30T12:11:16.513 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-30T12:11:16.513 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-03-30T12:11:16.513 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T12:11:16.514 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T12:11:16.514 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T12:11:16.514 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T12:11:16.515 INFO:teuthology.run_tasks:Running task install... 2024-03-30T12:11:16.527 DEBUG:teuthology.task.install:project ceph 2024-03-30T12:11:16.528 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'extra_system_packages': ['python3-pytest'], 'flavor': 'default', 'sha1': '5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc'}} 2024-03-30T12:11:16.528 DEBUG:teuthology.task.install:config {'branch': 'reef', 'exclude_packages': ['ceph-volume'], 'extra_system_packages': ['python3-pytest'], 'flavor': 'default', 'sha1': '5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc'} 2024-03-30T12:11:16.528 INFO:teuthology.task.install:Using flavor: default 2024-03-30T12:11:16.534 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-30T12:11:16.534 INFO:teuthology.task.install:extra packages: [] 2024-03-30T12:11:16.534 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': ['python3-pytest'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc', 'tag': None, 'wait_for_package': False} 2024-03-30T12:11:16.535 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-30T12:11:16.535 INFO:teuthology.packaging:ref: None 2024-03-30T12:11:16.535 INFO:teuthology.packaging:tag: None 2024-03-30T12:11:16.535 INFO:teuthology.packaging:branch: reef 2024-03-30T12:11:16.535 INFO:teuthology.packaging:sha1: 5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc 2024-03-30T12:11:16.535 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-03-30T12:11:16.537 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': ['python3-pytest'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc', 'tag': None, 'wait_for_package': False} 2024-03-30T12:11:16.537 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-30T12:11:16.537 INFO:teuthology.packaging:ref: None 2024-03-30T12:11:16.537 INFO:teuthology.packaging:tag: None 2024-03-30T12:11:16.537 INFO:teuthology.packaging:branch: reef 2024-03-30T12:11:16.537 INFO:teuthology.packaging:sha1: 5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc 2024-03-30T12:11:16.538 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-03-30T12:11:16.793 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/reef/f14b5682ac4f2d91bddebd76ffe4e49b8122e149/centos/9/flavors/default/ 2024-03-30T12:11:16.794 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1051.gf14b5682 2024-03-30T12:11:16.934 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/reef/f14b5682ac4f2d91bddebd76ffe4e49b8122e149/centos/9/flavors/default/ 2024-03-30T12:11:16.934 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1051.gf14b5682 2024-03-30T12:11:16.984 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/reef/f14b5682ac4f2d91bddebd76ffe4e49b8122e149/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/f14b5682ac4f2d91bddebd76ffe4e49b8122e149/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/f14b5682ac4f2d91bddebd76ffe4e49b8122e149/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-30T12:11:16.984 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-03-30T12:11:16.984 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-30T12:11:17.013 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-pytest, python3-pytest, python3-pytest on remote rpm x86_64 2024-03-30T12:11:17.013 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-30T12:11:17.013 INFO:teuthology.packaging:ref: None 2024-03-30T12:11:17.013 INFO:teuthology.packaging:tag: None 2024-03-30T12:11:17.013 INFO:teuthology.packaging:branch: reef 2024-03-30T12:11:17.013 INFO:teuthology.packaging:sha1: 5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc 2024-03-30T12:11:17.014 DEBUG:teuthology.orchestra.run.smithi162:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-30T12:11:17.081 DEBUG:teuthology.orchestra.run.smithi162:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-30T12:11:17.105 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/reef/f14b5682ac4f2d91bddebd76ffe4e49b8122e149/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/f14b5682ac4f2d91bddebd76ffe4e49b8122e149/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/f14b5682ac4f2d91bddebd76ffe4e49b8122e149/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-30T12:11:17.105 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-30T12:11:17.105 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-30T12:11:17.133 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-pytest, python3-pytest, python3-pytest, python3-pytest on remote rpm x86_64 2024-03-30T12:11:17.133 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-30T12:11:17.134 INFO:teuthology.packaging:ref: None 2024-03-30T12:11:17.134 INFO:teuthology.packaging:tag: None 2024-03-30T12:11:17.134 INFO:teuthology.packaging:branch: reef 2024-03-30T12:11:17.134 INFO:teuthology.packaging:sha1: 5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc 2024-03-30T12:11:17.134 DEBUG:teuthology.orchestra.run.smithi084:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-30T12:11:17.161 DEBUG:teuthology.orchestra.run.smithi162:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-30T12:11:17.205 DEBUG:teuthology.orchestra.run.smithi084:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-30T12:11:17.227 INFO:teuthology.orchestra.run.smithi162.stdout:check_obsoletes = 1 2024-03-30T12:11:17.230 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum clean all 2024-03-30T12:11:17.286 DEBUG:teuthology.orchestra.run.smithi084:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-30T12:11:17.353 INFO:teuthology.orchestra.run.smithi084.stdout:check_obsoletes = 1 2024-03-30T12:11:17.354 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum clean all 2024-03-30T12:11:17.494 INFO:teuthology.orchestra.run.smithi162.stdout:74 files removed 2024-03-30T12:11:17.521 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-pytest python3-pytest python3-pytest python3-pytest 2024-03-30T12:11:17.607 INFO:teuthology.orchestra.run.smithi084.stdout:74 files removed 2024-03-30T12:11:17.635 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-pytest python3-pytest python3-pytest python3-pytest 2024-03-30T12:11:18.235 INFO:teuthology.orchestra.run.smithi162.stdout:ceph packages for x86_64 187 kB/s | 77 kB 00:00 2024-03-30T12:11:18.279 INFO:teuthology.orchestra.run.smithi084.stdout:ceph packages for x86_64 223 kB/s | 77 kB 00:00 2024-03-30T12:11:18.694 INFO:teuthology.orchestra.run.smithi162.stdout:ceph noarch packages 24 kB/s | 9.9 kB 00:00 2024-03-30T12:11:18.696 INFO:teuthology.orchestra.run.smithi084.stdout:ceph noarch packages 27 kB/s | 9.9 kB 00:00 2024-03-30T12:11:19.003 INFO:teuthology.orchestra.run.smithi162.stdout:ceph source packages 6.9 kB/s | 1.9 kB 00:00 2024-03-30T12:11:19.096 INFO:teuthology.orchestra.run.smithi084.stdout:ceph source packages 5.2 kB/s | 1.9 kB 00:00 2024-03-30T12:11:19.481 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS-9 - AppStream 15 MB/s | 6.7 MB 00:00 2024-03-30T12:11:19.557 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS-9 - AppStream 16 MB/s | 6.7 MB 00:00 2024-03-30T12:11:20.932 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS-9 - BaseOS 7.4 MB/s | 2.0 MB 00:00 2024-03-30T12:11:20.947 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS-9 - BaseOS 5.6 MB/s | 2.0 MB 00:00 2024-03-30T12:11:22.556 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 8.0 MB 00:01 2024-03-30T12:11:23.454 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 3.7 MB/s | 8.0 MB 00:02 2024-03-30T12:11:25.397 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-03-30T12:11:26.806 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - AppStream 6.0 MB/s | 19 MB 00:03 2024-03-30T12:11:32.224 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.1 MB 00:01 2024-03-30T12:11:33.883 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 16 kB 00:00 2024-03-30T12:11:35.559 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-03-30T12:11:37.637 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 716 kB/s | 6.1 MB 00:08 2024-03-30T12:11:39.647 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 16 kB 00:00 2024-03-30T12:11:40.650 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-03-30T12:11:43.158 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 6.1 MB/s | 21 MB 00:03 2024-03-30T12:11:43.178 INFO:teuthology.orchestra.run.smithi084.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-30T12:11:43.178 INFO:teuthology.orchestra.run.smithi084.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-30T12:11:43.248 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-03-30T12:11:43.257 INFO:teuthology.orchestra.run.smithi084.stdout:============================================================================================ 2024-03-30T12:11:43.257 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-03-30T12:11:43.257 INFO:teuthology.orchestra.run.smithi084.stdout:============================================================================================ 2024-03-30T12:11:43.257 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-03-30T12:11:43.257 INFO:teuthology.orchestra.run.smithi084.stdout: ceph x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 6.5 k 2024-03-30T12:11:43.257 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 5.1 M 2024-03-30T12:11:43.257 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 849 k 2024-03-30T12:11:43.257 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 143 k 2024-03-30T12:11:43.258 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 1.5 M 2024-03-30T12:11:43.258 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1051.gf14b5682.el9 ceph-noarch 138 k 2024-03-30T12:11:43.258 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1051.gf14b5682.el9 ceph-noarch 1.8 M 2024-03-30T12:11:43.258 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1051.gf14b5682.el9 ceph-noarch 7.4 M 2024-03-30T12:11:43.258 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook noarch 2:18.2.2-1051.gf14b5682.el9 ceph-noarch 49 k 2024-03-30T12:11:43.258 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 7.7 M 2024-03-30T12:11:43.258 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 40 M 2024-03-30T12:11:43.258 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm noarch 2:18.2.2-1051.gf14b5682.el9 ceph-noarch 224 k 2024-03-30T12:11:43.258 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 31 k 2024-03-30T12:11:43.258 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2 x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 708 k 2024-03-30T12:11:43.258 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 127 k 2024-03-30T12:11:43.258 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 162 k 2024-03-30T12:11:43.258 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytest noarch 6.2.2-7.el9 CentOS-AppStream 473 k 2024-03-30T12:11:43.258 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 320 k 2024-03-30T12:11:43.259 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 298 k 2024-03-30T12:11:43.259 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 99 k 2024-03-30T12:11:43.259 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 87 k 2024-03-30T12:11:43.259 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 3.0 M 2024-03-30T12:11:43.259 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 172 k 2024-03-30T12:11:43.259 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2024-03-30T12:11:43.259 INFO:teuthology.orchestra.run.smithi084.stdout: librados2 x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 3.3 M 2024-03-30T12:11:43.259 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1 x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 3.0 M 2024-03-30T12:11:43.259 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-03-30T12:11:43.259 INFO:teuthology.orchestra.run.smithi084.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-30T12:11:43.259 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 18 M 2024-03-30T12:11:43.259 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1051.gf14b5682.el9 ceph-noarch 23 k 2024-03-30T12:11:43.260 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 2.1 M 2024-03-30T12:11:43.260 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1051.gf14b5682.el9 ceph-noarch 245 k 2024-03-30T12:11:43.260 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 4.7 M 2024-03-30T12:11:43.260 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 17 M 2024-03-30T12:11:43.260 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1051.gf14b5682.el9 ceph-noarch 15 k 2024-03-30T12:11:43.260 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 25 k 2024-03-30T12:11:43.260 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-30T12:11:43.260 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-30T12:11:43.260 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-30T12:11:43.260 INFO:teuthology.orchestra.run.smithi084.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-03-30T12:11:43.260 INFO:teuthology.orchestra.run.smithi084.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-30T12:11:43.260 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-30T12:11:43.260 INFO:teuthology.orchestra.run.smithi084.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-30T12:11:43.260 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-30T12:11:43.261 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-30T12:11:43.261 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 166 k 2024-03-30T12:11:43.261 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-30T12:11:43.261 INFO:teuthology.orchestra.run.smithi084.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-30T12:11:43.261 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-30T12:11:43.261 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-30T12:11:43.261 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-30T12:11:43.261 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1 x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 474 k 2024-03-30T12:11:43.261 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-30T12:11:43.261 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2 x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 4.5 M 2024-03-30T12:11:43.261 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-30T12:11:43.261 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-30T12:11:43.261 INFO:teuthology.orchestra.run.smithi084.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-30T12:11:43.261 INFO:teuthology.orchestra.run.smithi084.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-30T12:11:43.262 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-30T12:11:43.262 INFO:teuthology.orchestra.run.smithi084.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-30T12:11:43.262 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-30T12:11:43.262 INFO:teuthology.orchestra.run.smithi084.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-30T12:11:43.262 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-30T12:11:43.262 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-30T12:11:43.262 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-30T12:11:43.262 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 45 k 2024-03-30T12:11:43.262 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 129 k 2024-03-30T12:11:43.262 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-30T12:11:43.262 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-30T12:11:43.262 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-30T12:11:43.262 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-30T12:11:43.263 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-30T12:11:43.263 INFO:teuthology.orchestra.run.smithi084.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-30T12:11:43.263 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-30T12:11:43.263 INFO:teuthology.orchestra.run.smithi084.stdout: python3-iniconfig noarch 1.1.1-7.el9 CentOS-AppStream 16 k 2024-03-30T12:11:43.263 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-30T12:11:43.263 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-30T12:11:43.263 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-30T12:11:43.263 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-30T12:11:43.263 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-30T12:11:43.263 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-30T12:11:43.263 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-30T12:11:43.263 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-30T12:11:43.263 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-30T12:11:43.263 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-30T12:11:43.263 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-30T12:11:43.264 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-30T12:11:43.264 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-30T12:11:43.264 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-30T12:11:43.264 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-30T12:11:43.264 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-30T12:11:43.264 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-30T12:11:43.264 INFO:teuthology.orchestra.run.smithi084.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-30T12:11:43.264 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-30T12:11:43.264 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pluggy noarch 0.13.1-7.el9 CentOS-AppStream 38 k 2024-03-30T12:11:43.264 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-30T12:11:43.264 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-30T12:11:43.264 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-30T12:11:43.264 INFO:teuthology.orchestra.run.smithi084.stdout: python3-py noarch 1.10.0-6.el9 CentOS-AppStream 427 k 2024-03-30T12:11:43.264 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-30T12:11:43.265 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-30T12:11:43.265 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-30T12:11:43.265 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-30T12:11:43.265 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-30T12:11:43.265 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-30T12:11:43.265 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-30T12:11:43.265 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-30T12:11:43.265 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-30T12:11:43.265 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-30T12:11:43.265 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-30T12:11:43.265 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-30T12:11:43.265 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-30T12:11:43.265 INFO:teuthology.orchestra.run.smithi084.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-30T12:11:43.265 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-30T12:11:43.266 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-30T12:11:43.266 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-30T12:11:43.266 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-30T12:11:43.266 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-30T12:11:43.266 INFO:teuthology.orchestra.run.smithi084.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-30T12:11:43.266 INFO:teuthology.orchestra.run.smithi084.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-30T12:11:43.266 INFO:teuthology.orchestra.run.smithi084.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-30T12:11:43.266 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-30T12:11:43.266 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:11:43.266 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-03-30T12:11:43.266 INFO:teuthology.orchestra.run.smithi084.stdout:============================================================================================ 2024-03-30T12:11:43.266 INFO:teuthology.orchestra.run.smithi084.stdout:Install 118 Packages 2024-03-30T12:11:43.266 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 2 Packages 2024-03-30T12:11:43.266 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:11:43.267 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 176 M 2024-03-30T12:11:43.267 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-03-30T12:11:44.051 INFO:teuthology.orchestra.run.smithi084.stdout:(1/120): ceph-18.2.2-1051.gf14b5682.el9.x86_64. 37 kB/s | 6.5 kB 00:00 2024-03-30T12:11:44.317 INFO:teuthology.orchestra.run.smithi084.stdout:(2/120): ceph-fuse-18.2.2-1051.gf14b5682.el9.x8 3.1 MB/s | 849 kB 00:00 2024-03-30T12:11:44.393 INFO:teuthology.orchestra.run.smithi084.stdout:(3/120): ceph-immutable-object-cache-18.2.2-105 1.9 MB/s | 143 kB 00:00 2024-03-30T12:11:44.595 INFO:teuthology.orchestra.run.smithi084.stdout:(4/120): ceph-mds-18.2.2-1051.gf14b5682.el9.x86 10 MB/s | 2.1 MB 00:00 2024-03-30T12:11:44.768 INFO:teuthology.orchestra.run.smithi084.stdout:(5/120): ceph-mgr-18.2.2-1051.gf14b5682.el9.x86 8.3 MB/s | 1.5 MB 00:00 2024-03-30T12:11:44.844 INFO:teuthology.orchestra.run.smithi084.stdout:(6/120): ceph-base-18.2.2-1051.gf14b5682.el9.x8 5.2 MB/s | 5.1 MB 00:00 2024-03-30T12:11:45.202 INFO:teuthology.orchestra.run.smithi084.stdout:(7/120): ceph-mon-18.2.2-1051.gf14b5682.el9.x86 11 MB/s | 4.7 MB 00:00 2024-03-30T12:11:45.994 INFO:teuthology.orchestra.run.smithi084.stdout:(8/120): ceph-radosgw-18.2.2-1051.gf14b5682.el9 9.7 MB/s | 7.7 MB 00:00 2024-03-30T12:11:46.061 INFO:teuthology.orchestra.run.smithi084.stdout:(9/120): ceph-selinux-18.2.2-1051.gf14b5682.el9 378 kB/s | 25 kB 00:00 2024-03-30T12:11:46.270 INFO:teuthology.orchestra.run.smithi084.stdout:(10/120): ceph-common-18.2.2-1051.gf14b5682.el9 7.6 MB/s | 18 MB 00:02 2024-03-30T12:11:46.353 INFO:teuthology.orchestra.run.smithi084.stdout:(11/120): libcephfs-devel-18.2.2-1051.gf14b5682 374 kB/s | 31 kB 00:00 2024-03-30T12:11:46.503 INFO:teuthology.orchestra.run.smithi084.stdout:(12/120): libcephfs2-18.2.2-1051.gf14b5682.el9. 4.6 MB/s | 708 kB 00:00 2024-03-30T12:11:46.946 INFO:teuthology.orchestra.run.smithi084.stdout:(13/120): ceph-osd-18.2.2-1051.gf14b5682.el9.x8 7.9 MB/s | 17 MB 00:02 2024-03-30T12:11:46.971 INFO:teuthology.orchestra.run.smithi084.stdout:(14/120): libcephsqlite-18.2.2-1051.gf14b5682.e 355 kB/s | 166 kB 00:00 2024-03-30T12:11:47.579 INFO:teuthology.orchestra.run.smithi084.stdout:(15/120): librados-devel-18.2.2-1051.gf14b5682. 200 kB/s | 127 kB 00:00 2024-03-30T12:11:47.696 INFO:teuthology.orchestra.run.smithi084.stdout:(16/120): libradosstriper1-18.2.2-1051.gf14b568 654 kB/s | 474 kB 00:00 2024-03-30T12:11:47.780 INFO:teuthology.orchestra.run.smithi084.stdout:(17/120): python3-ceph-argparse-18.2.2-1051.gf1 540 kB/s | 45 kB 00:00 2024-03-30T12:11:47.913 INFO:teuthology.orchestra.run.smithi084.stdout:(18/120): python3-ceph-common-18.2.2-1051.gf14b 970 kB/s | 129 kB 00:00 2024-03-30T12:11:48.022 INFO:teuthology.orchestra.run.smithi084.stdout:(19/120): python3-cephfs-18.2.2-1051.gf14b5682. 1.5 MB/s | 162 kB 00:00 2024-03-30T12:11:48.074 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-03-30T12:11:48.114 INFO:teuthology.orchestra.run.smithi084.stdout:(20/120): librgw2-18.2.2-1051.gf14b5682.el9.x86 8.4 MB/s | 4.5 MB 00:00 2024-03-30T12:11:48.139 INFO:teuthology.orchestra.run.smithi084.stdout:(21/120): python3-rados-18.2.2-1051.gf14b5682.e 2.7 MB/s | 320 kB 00:00 2024-03-30T12:11:48.201 INFO:teuthology.orchestra.run.smithi084.stdout:(22/120): python3-rbd-18.2.2-1051.gf14b5682.el9 3.5 MB/s | 298 kB 00:00 2024-03-30T12:11:48.240 INFO:teuthology.orchestra.run.smithi084.stdout:(23/120): python3-rgw-18.2.2-1051.gf14b5682.el9 994 kB/s | 99 kB 00:00 2024-03-30T12:11:48.290 INFO:teuthology.orchestra.run.smithi084.stdout:(24/120): rbd-fuse-18.2.2-1051.gf14b5682.el9.x8 941 kB/s | 87 kB 00:00 2024-03-30T12:11:48.424 INFO:teuthology.orchestra.run.smithi084.stdout:(25/120): rbd-nbd-18.2.2-1051.gf14b5682.el9.x86 1.3 MB/s | 172 kB 00:00 2024-03-30T12:11:48.532 INFO:teuthology.orchestra.run.smithi084.stdout:(26/120): ceph-grafana-dashboards-18.2.2-1051.g 216 kB/s | 23 kB 00:00 2024-03-30T12:11:48.583 INFO:teuthology.orchestra.run.smithi084.stdout:(27/120): rbd-mirror-18.2.2-1051.gf14b5682.el9. 8.7 MB/s | 3.0 MB 00:00 2024-03-30T12:11:48.608 INFO:teuthology.orchestra.run.smithi084.stdout:(28/120): ceph-mgr-cephadm-18.2.2-1051.gf14b568 1.8 MB/s | 138 kB 00:00 2024-03-30T12:11:48.841 INFO:teuthology.orchestra.run.smithi084.stdout:(29/120): ceph-mgr-dashboard-18.2.2-1051.gf14b5 6.9 MB/s | 1.8 MB 00:00 2024-03-30T12:11:48.975 INFO:teuthology.orchestra.run.smithi084.stdout:(30/120): ceph-mgr-modules-core-18.2.2-1051.gf1 1.8 MB/s | 245 kB 00:00 2024-03-30T12:11:49.334 INFO:teuthology.orchestra.run.smithi084.stdout:(31/120): ceph-test-18.2.2-1051.gf14b5682.el9.x 12 MB/s | 40 MB 00:03 2024-03-30T12:11:49.359 INFO:teuthology.orchestra.run.smithi084.stdout:(32/120): ceph-mgr-rook-18.2.2-1051.gf14b5682.e 129 kB/s | 49 kB 00:00 2024-03-30T12:11:49.384 INFO:teuthology.orchestra.run.smithi084.stdout:(33/120): ceph-prometheus-alerts-18.2.2-1051.gf 298 kB/s | 15 kB 00:00 2024-03-30T12:11:49.451 INFO:teuthology.orchestra.run.smithi084.stdout:(34/120): cephadm-18.2.2-1051.gf14b5682.el9.noa 2.4 MB/s | 224 kB 00:00 2024-03-30T12:11:49.493 INFO:teuthology.orchestra.run.smithi084.stdout:(35/120): flexiblas-3.0.4-8.el9.x86_64.rpm 787 kB/s | 32 kB 00:00 2024-03-30T12:11:49.518 INFO:teuthology.orchestra.run.smithi084.stdout:(36/120): boost-program-options-1.75.0-8.el9.x8 792 kB/s | 106 kB 00:00 2024-03-30T12:11:49.627 INFO:teuthology.orchestra.run.smithi084.stdout:(37/120): ceph-mgr-diskprediction-local-18.2.2- 7.2 MB/s | 7.4 MB 00:01 2024-03-30T12:11:49.735 INFO:teuthology.orchestra.run.smithi084.stdout:(38/120): flexiblas-openblas-openmp-3.0.4-8.el9 79 kB/s | 17 kB 00:00 2024-03-30T12:11:49.802 INFO:teuthology.orchestra.run.smithi084.stdout:(39/120): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.7 MB/s | 3.0 MB 00:00 2024-03-30T12:11:49.828 INFO:teuthology.orchestra.run.smithi084.stdout:(40/120): libpmemobj-1.12.1-1.el9.x86_64.rpm 798 kB/s | 159 kB 00:00 2024-03-30T12:11:49.853 INFO:teuthology.orchestra.run.smithi084.stdout:(41/120): librabbitmq-0.11.0-7.el9.x86_64.rpm 379 kB/s | 44 kB 00:00 2024-03-30T12:11:49.878 INFO:teuthology.orchestra.run.smithi084.stdout:(42/120): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2024-03-30T12:11:49.904 INFO:teuthology.orchestra.run.smithi084.stdout:(43/120): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.6 MB/s | 282 kB 00:00 2024-03-30T12:11:49.929 INFO:teuthology.orchestra.run.smithi084.stdout:(44/120): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.9 MB/s | 217 kB 00:00 2024-03-30T12:11:49.945 INFO:teuthology.orchestra.run.smithi084.stdout:(45/120): openblas-0.3.21-2.el9.x86_64.rpm 509 kB/s | 34 kB 00:00 2024-03-30T12:11:50.112 INFO:teuthology.orchestra.run.smithi084.stdout:(46/120): openblas-openmp-0.3.21-2.el9.x86_64.r 23 MB/s | 4.7 MB 00:00 2024-03-30T12:11:50.146 INFO:teuthology.orchestra.run.smithi084.stdout:(47/120): python3-attrs-20.3.0-7.el9.noarch.rpm 391 kB/s | 78 kB 00:00 2024-03-30T12:11:50.238 INFO:teuthology.orchestra.run.smithi084.stdout:(48/120): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 5.8 MB 00:00 2024-03-30T12:11:50.263 INFO:teuthology.orchestra.run.smithi084.stdout:(49/120): python3-iniconfig-1.1.1-7.el9.noarch. 111 kB/s | 16 kB 00:00 2024-03-30T12:11:50.288 INFO:teuthology.orchestra.run.smithi084.stdout:(50/120): python3-jsonpatch-1.21-16.el9.noarch. 172 kB/s | 24 kB 00:00 2024-03-30T12:11:50.314 INFO:teuthology.orchestra.run.smithi084.stdout:(51/120): python3-jsonpointer-2.0-4.el9.noarch. 241 kB/s | 18 kB 00:00 2024-03-30T12:11:50.339 INFO:teuthology.orchestra.run.smithi084.stdout:(52/120): python3-markupsafe-1.1.1-12.el9.x86_6 631 kB/s | 32 kB 00:00 2024-03-30T12:11:50.356 INFO:teuthology.orchestra.run.smithi084.stdout:(53/120): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 144 kB 00:00 2024-03-30T12:11:50.464 INFO:teuthology.orchestra.run.smithi084.stdout:(54/120): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2024-03-30T12:11:50.490 INFO:teuthology.orchestra.run.smithi084.stdout:(55/120): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2024-03-30T12:11:50.523 INFO:teuthology.orchestra.run.smithi084.stdout:(56/120): python3-oauthlib-3.1.1-5.el9.noarch.r 1.0 MB/s | 174 kB 00:00 2024-03-30T12:11:50.548 INFO:teuthology.orchestra.run.smithi084.stdout:(57/120): python3-packaging-20.9-5.el9.noarch.r 827 kB/s | 69 kB 00:00 2024-03-30T12:11:50.574 INFO:teuthology.orchestra.run.smithi084.stdout:(58/120): python3-prettytable-0.7.2-27.el9.noar 831 kB/s | 41 kB 00:00 2024-03-30T12:11:50.599 INFO:teuthology.orchestra.run.smithi084.stdout:(59/120): python3-pluggy-0.13.1-7.el9.noarch.rp 503 kB/s | 38 kB 00:00 2024-03-30T12:11:50.624 INFO:teuthology.orchestra.run.smithi084.stdout:(60/120): python3-py-1.10.0-6.el9.noarch.rpm 5.5 MB/s | 427 kB 00:00 2024-03-30T12:11:50.650 INFO:teuthology.orchestra.run.smithi084.stdout:(61/120): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-03-30T12:11:50.675 INFO:teuthology.orchestra.run.smithi084.stdout:(62/120): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-03-30T12:11:50.691 INFO:teuthology.orchestra.run.smithi162.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-30T12:11:50.691 INFO:teuthology.orchestra.run.smithi162.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-30T12:11:50.700 INFO:teuthology.orchestra.run.smithi084.stdout:(63/120): python3-pytest-6.2.2-7.el9.noarch.rpm 6.2 MB/s | 473 kB 00:00 2024-03-30T12:11:50.725 INFO:teuthology.orchestra.run.smithi084.stdout:(64/120): python3-pytz-2021.1-5.el9.noarch.rpm 640 kB/s | 47 kB 00:00 2024-03-30T12:11:50.750 INFO:teuthology.orchestra.run.smithi084.stdout:(65/120): python3-requests-oauthlib-1.3.0-12.el 857 kB/s | 43 kB 00:00 2024-03-30T12:11:50.762 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-03-30T12:11:50.781 INFO:teuthology.orchestra.run.smithi162.stdout:============================================================================================ 2024-03-30T12:11:50.781 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-03-30T12:11:50.781 INFO:teuthology.orchestra.run.smithi162.stdout:============================================================================================ 2024-03-30T12:11:50.781 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-03-30T12:11:50.781 INFO:teuthology.orchestra.run.smithi162.stdout: ceph x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 6.5 k 2024-03-30T12:11:50.781 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 5.1 M 2024-03-30T12:11:50.781 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 849 k 2024-03-30T12:11:50.781 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 143 k 2024-03-30T12:11:50.781 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 1.5 M 2024-03-30T12:11:50.781 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1051.gf14b5682.el9 ceph-noarch 138 k 2024-03-30T12:11:50.782 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1051.gf14b5682.el9 ceph-noarch 1.8 M 2024-03-30T12:11:50.782 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1051.gf14b5682.el9 ceph-noarch 7.4 M 2024-03-30T12:11:50.782 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook noarch 2:18.2.2-1051.gf14b5682.el9 ceph-noarch 49 k 2024-03-30T12:11:50.782 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 7.7 M 2024-03-30T12:11:50.782 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 40 M 2024-03-30T12:11:50.782 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm noarch 2:18.2.2-1051.gf14b5682.el9 ceph-noarch 224 k 2024-03-30T12:11:50.782 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 31 k 2024-03-30T12:11:50.782 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2 x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 708 k 2024-03-30T12:11:50.782 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 127 k 2024-03-30T12:11:50.782 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 162 k 2024-03-30T12:11:50.782 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytest noarch 6.2.2-7.el9 CentOS-AppStream 473 k 2024-03-30T12:11:50.782 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 320 k 2024-03-30T12:11:50.782 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 298 k 2024-03-30T12:11:50.783 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 99 k 2024-03-30T12:11:50.783 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 87 k 2024-03-30T12:11:50.783 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 3.0 M 2024-03-30T12:11:50.783 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 172 k 2024-03-30T12:11:50.783 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrading: 2024-03-30T12:11:50.783 INFO:teuthology.orchestra.run.smithi162.stdout: librados2 x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 3.3 M 2024-03-30T12:11:50.783 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1 x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 3.0 M 2024-03-30T12:11:50.783 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-03-30T12:11:50.783 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-30T12:11:50.783 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 18 M 2024-03-30T12:11:50.783 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1051.gf14b5682.el9 ceph-noarch 23 k 2024-03-30T12:11:50.783 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 2.1 M 2024-03-30T12:11:50.783 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1051.gf14b5682.el9 ceph-noarch 245 k 2024-03-30T12:11:50.783 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 4.7 M 2024-03-30T12:11:50.784 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 17 M 2024-03-30T12:11:50.784 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1051.gf14b5682.el9 ceph-noarch 15 k 2024-03-30T12:11:50.784 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 25 k 2024-03-30T12:11:50.784 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-30T12:11:50.784 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-30T12:11:50.784 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-30T12:11:50.784 INFO:teuthology.orchestra.run.smithi162.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-03-30T12:11:50.784 INFO:teuthology.orchestra.run.smithi162.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-30T12:11:50.784 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-30T12:11:50.784 INFO:teuthology.orchestra.run.smithi162.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-30T12:11:50.784 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-30T12:11:50.784 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-30T12:11:50.784 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 166 k 2024-03-30T12:11:50.784 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-30T12:11:50.784 INFO:teuthology.orchestra.run.smithi162.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-30T12:11:50.785 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-30T12:11:50.785 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-30T12:11:50.785 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-30T12:11:50.785 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 474 k 2024-03-30T12:11:50.785 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-30T12:11:50.785 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2 x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 4.5 M 2024-03-30T12:11:50.785 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-30T12:11:50.785 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-30T12:11:50.785 INFO:teuthology.orchestra.run.smithi162.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-30T12:11:50.785 INFO:teuthology.orchestra.run.smithi162.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-30T12:11:50.785 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-30T12:11:50.785 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-30T12:11:50.785 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-30T12:11:50.785 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-30T12:11:50.786 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-30T12:11:50.786 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-30T12:11:50.786 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-30T12:11:50.786 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 45 k 2024-03-30T12:11:50.786 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common x86_64 2:18.2.2-1051.gf14b5682.el9 ceph 129 k 2024-03-30T12:11:50.786 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-30T12:11:50.786 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-30T12:11:50.786 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-30T12:11:50.787 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-30T12:11:50.787 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-30T12:11:50.787 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-30T12:11:50.787 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-30T12:11:50.787 INFO:teuthology.orchestra.run.smithi162.stdout: python3-iniconfig noarch 1.1.1-7.el9 CentOS-AppStream 16 k 2024-03-30T12:11:50.787 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-30T12:11:50.787 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-30T12:11:50.787 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-30T12:11:50.787 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-30T12:11:50.787 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-30T12:11:50.788 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-30T12:11:50.788 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-30T12:11:50.788 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-30T12:11:50.788 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-30T12:11:50.788 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-30T12:11:50.788 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-30T12:11:50.788 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-30T12:11:50.788 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-30T12:11:50.789 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-30T12:11:50.789 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-30T12:11:50.789 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-30T12:11:50.789 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-30T12:11:50.789 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-30T12:11:50.789 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-30T12:11:50.789 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pluggy noarch 0.13.1-7.el9 CentOS-AppStream 38 k 2024-03-30T12:11:50.789 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-30T12:11:50.789 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-30T12:11:50.789 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-30T12:11:50.789 INFO:teuthology.orchestra.run.smithi162.stdout: python3-py noarch 1.10.0-6.el9 CentOS-AppStream 427 k 2024-03-30T12:11:50.789 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-30T12:11:50.789 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-30T12:11:50.789 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-30T12:11:50.790 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-30T12:11:50.790 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-30T12:11:50.790 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-30T12:11:50.790 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-30T12:11:50.790 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-30T12:11:50.790 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-30T12:11:50.790 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-30T12:11:50.790 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-30T12:11:50.790 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-30T12:11:50.790 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-30T12:11:50.790 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-30T12:11:50.790 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-30T12:11:50.790 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-30T12:11:50.791 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-30T12:11:50.791 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-30T12:11:50.791 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-30T12:11:50.791 INFO:teuthology.orchestra.run.smithi162.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-30T12:11:50.791 INFO:teuthology.orchestra.run.smithi162.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-30T12:11:50.791 INFO:teuthology.orchestra.run.smithi162.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-30T12:11:50.791 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-30T12:11:50.791 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-03-30T12:11:50.791 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-03-30T12:11:50.791 INFO:teuthology.orchestra.run.smithi162.stdout:============================================================================================ 2024-03-30T12:11:50.791 INFO:teuthology.orchestra.run.smithi162.stdout:Install 118 Packages 2024-03-30T12:11:50.791 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrade 2 Packages 2024-03-30T12:11:50.791 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-03-30T12:11:50.792 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 176 M 2024-03-30T12:11:50.792 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-03-30T12:11:50.884 INFO:teuthology.orchestra.run.smithi084.stdout:(66/120): python3-toml-0.10.2-6.el9.noarch.rpm 248 kB/s | 39 kB 00:00 2024-03-30T12:11:51.042 INFO:teuthology.orchestra.run.smithi084.stdout:(67/120): python3-scipy-1.6.2-8.el9.x86_64.rpm 46 MB/s | 16 MB 00:00 2024-03-30T12:11:51.067 INFO:teuthology.orchestra.run.smithi084.stdout:(68/120): socat-1.7.4.1-5.el9.x86_64.rpm 954 kB/s | 300 kB 00:00 2024-03-30T12:11:51.093 INFO:teuthology.orchestra.run.smithi084.stdout:(69/120): xmlstarlet-1.6.1-20.el9.x86_64.rpm 303 kB/s | 63 kB 00:00 2024-03-30T12:11:51.118 INFO:teuthology.orchestra.run.smithi084.stdout:(70/120): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-03-30T12:11:51.143 INFO:teuthology.orchestra.run.smithi084.stdout:(71/120): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2024-03-30T12:11:51.177 INFO:teuthology.orchestra.run.smithi084.stdout:(72/120): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-03-30T12:11:51.198 INFO:teuthology.orchestra.run.smithi084.stdout:(73/120): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 103 kB 00:00 2024-03-30T12:11:51.219 INFO:teuthology.orchestra.run.smithi084.stdout:(74/120): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 124 kB 00:00 2024-03-30T12:11:51.244 INFO:teuthology.orchestra.run.smithi084.stdout:(75/120): python3-urllib3-1.26.5-5.el9.noarch.r 2.7 MB/s | 187 kB 00:00 2024-03-30T12:11:51.707 INFO:teuthology.orchestra.run.smithi162.stdout:(1/120): ceph-18.2.2-1051.gf14b5682.el9.x86_64. 28 kB/s | 6.5 kB 00:00 2024-03-30T12:11:52.008 INFO:teuthology.orchestra.run.smithi162.stdout:(2/120): ceph-base-18.2.2-1051.gf14b5682.el9.x8 9.5 MB/s | 5.1 MB 00:00 2024-03-30T12:11:52.058 INFO:teuthology.orchestra.run.smithi162.stdout:(3/120): ceph-immutable-object-cache-18.2.2-105 2.8 MB/s | 143 kB 00:00 2024-03-30T12:11:52.095 INFO:teuthology.orchestra.run.smithi084.stdout:(76/120): libquadmath-11.4.1-3.el9.x86_64.rpm 230 kB/s | 195 kB 00:00 2024-03-30T12:11:52.153 INFO:teuthology.orchestra.run.smithi084.stdout:(77/120): jq-1.6-16.el9.x86_64.rpm 201 kB/s | 187 kB 00:00 2024-03-30T12:11:52.217 INFO:teuthology.orchestra.run.smithi162.stdout:(4/120): ceph-mds-18.2.2-1051.gf14b5682.el9.x86 13 MB/s | 2.1 MB 00:00 2024-03-30T12:11:52.262 INFO:teuthology.orchestra.run.smithi084.stdout:(78/120): python3-devel-3.9.17-2.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-03-30T12:11:52.283 INFO:teuthology.orchestra.run.smithi162.stdout:(5/120): ceph-fuse-18.2.2-1051.gf14b5682.el9.x8 1.4 MB/s | 849 kB 00:00 2024-03-30T12:11:52.337 INFO:teuthology.orchestra.run.smithi084.stdout:(79/120): python3-jinja2-2.11.3-5.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-03-30T12:11:52.342 INFO:teuthology.orchestra.run.smithi162.stdout:(6/120): ceph-mgr-18.2.2-1051.gf14b5682.el9.x86 12 MB/s | 1.5 MB 00:00 2024-03-30T12:11:52.763 INFO:teuthology.orchestra.run.smithi084.stdout:(80/120): fmt-8.1.1-5.el9.x86_64.rpm 278 kB/s | 111 kB 00:00 2024-03-30T12:11:52.829 INFO:teuthology.orchestra.run.smithi084.stdout:(81/120): libgfortran-11.4.1-3.el9.x86_64.rpm 499 kB/s | 803 kB 00:01 2024-03-30T12:11:52.880 INFO:teuthology.orchestra.run.smithi084.stdout:(82/120): python3-requests-2.25.1-8.el9.noarch. 159 kB/s | 125 kB 00:00 2024-03-30T12:11:52.922 INFO:teuthology.orchestra.run.smithi084.stdout:(83/120): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.9 MB/s | 309 kB 00:00 2024-03-30T12:11:53.005 INFO:teuthology.orchestra.run.smithi084.stdout:(84/120): libarrow-doc-9.0.0-10.el9.noarch.rpm 208 kB/s | 26 kB 00:00 2024-03-30T12:11:53.047 INFO:teuthology.orchestra.run.smithi084.stdout:(85/120): liboath-2.6.7-2.el9.x86_64.rpm 389 kB/s | 49 kB 00:00 2024-03-30T12:11:53.139 INFO:teuthology.orchestra.run.smithi084.stdout:(86/120): libarrow-9.0.0-10.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-03-30T12:11:53.164 INFO:teuthology.orchestra.run.smithi084.stdout:(87/120): libunwind-1.6.2-1.el9.x86_64.rpm 427 kB/s | 67 kB 00:00 2024-03-30T12:11:53.190 INFO:teuthology.orchestra.run.smithi084.stdout:(88/120): parquet-libs-9.0.0-10.el9.x86_64.rpm 5.8 MB/s | 838 kB 00:00 2024-03-30T12:11:53.248 INFO:teuthology.orchestra.run.smithi084.stdout:(89/120): python3-asyncssh-2.13.2-5.el9.noarch. 5.0 MB/s | 548 kB 00:00 2024-03-30T12:11:53.348 INFO:teuthology.orchestra.run.smithi084.stdout:(90/120): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 275 kB/s | 43 kB 00:00 2024-03-30T12:11:53.359 INFO:teuthology.orchestra.run.smithi162.stdout:(7/120): ceph-osd-18.2.2-1051.gf14b5682.el9.x86 16 MB/s | 17 MB 00:01 2024-03-30T12:11:53.423 INFO:teuthology.orchestra.run.smithi084.stdout:(91/120): python3-cachetools-4.2.4-1.el9.noarch 138 kB/s | 32 kB 00:00 2024-03-30T12:11:53.440 INFO:teuthology.orchestra.run.smithi084.stdout:(92/120): python3-certifi-2021.10.8-2.el9.noarc 78 kB/s | 15 kB 00:00 2024-03-30T12:11:53.491 INFO:teuthology.orchestra.run.smithi084.stdout:(93/120): python3-cheroot-8.6.0-4.el9.noarch.rp 2.5 MB/s | 172 kB 00:00 2024-03-30T12:11:53.517 INFO:teuthology.orchestra.run.smithi084.stdout:(94/120): python3-cherrypy-18.6.1-2.el9.noarch. 3.8 MB/s | 358 kB 00:00 2024-03-30T12:11:53.541 INFO:teuthology.orchestra.run.smithi084.stdout:(95/120): python3-google-auth-2.28.2-1.el9.noar 2.0 MB/s | 203 kB 00:00 2024-03-30T12:11:53.566 INFO:teuthology.orchestra.run.smithi084.stdout:(96/120): python3-jaraco-8.2.1-3.el9.noarch.rpm 144 kB/s | 11 kB 00:00 2024-03-30T12:11:53.608 INFO:teuthology.orchestra.run.smithi084.stdout:(97/120): python3-jaraco-classes-3.2.1-5.el9.no 265 kB/s | 18 kB 00:00 2024-03-30T12:11:53.633 INFO:teuthology.orchestra.run.smithi084.stdout:(98/120): python3-jaraco-collections-3.0.0-8.el 252 kB/s | 23 kB 00:00 2024-03-30T12:11:53.659 INFO:teuthology.orchestra.run.smithi084.stdout:(99/120): python3-jaraco-functools-3.5.0-2.el9. 211 kB/s | 19 kB 00:00 2024-03-30T12:11:53.700 INFO:teuthology.orchestra.run.smithi084.stdout:(100/120): python3-jaraco-text-3.2.0-6.el9.noar 295 kB/s | 20 kB 00:00 2024-03-30T12:11:53.734 INFO:teuthology.orchestra.run.smithi084.stdout:(101/120): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-03-30T12:11:53.759 INFO:teuthology.orchestra.run.smithi084.stdout:(102/120): python3-logutils-0.3.5-21.el9.noarch 462 kB/s | 46 kB 00:00 2024-03-30T12:11:53.784 INFO:teuthology.orchestra.run.smithi084.stdout:(103/120): python3-more-itertools-8.12.0-2.el9. 967 kB/s | 79 kB 00:00 2024-03-30T12:11:53.827 INFO:teuthology.orchestra.run.smithi084.stdout:(104/120): python3-natsort-7.1.1-5.el9.noarch.r 866 kB/s | 58 kB 00:00 2024-03-30T12:11:53.852 INFO:teuthology.orchestra.run.smithi084.stdout:(105/120): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-03-30T12:11:53.886 INFO:teuthology.orchestra.run.smithi084.stdout:(106/120): python3-portend-3.1.0-2.el9.noarch.r 163 kB/s | 16 kB 00:00 2024-03-30T12:11:53.911 INFO:teuthology.orchestra.run.smithi084.stdout:(107/120): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2024-03-30T12:11:53.953 INFO:teuthology.orchestra.run.smithi084.stdout:(108/120): python3-repoze-lru-0.7-16.el9.noarch 463 kB/s | 31 kB 00:00 2024-03-30T12:11:53.978 INFO:teuthology.orchestra.run.smithi084.stdout:(109/120): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-03-30T12:11:54.003 INFO:teuthology.orchestra.run.smithi084.stdout:(110/120): python3-rsa-4.9-2.el9.noarch.rpm 642 kB/s | 59 kB 00:00 2024-03-30T12:11:54.026 INFO:teuthology.orchestra.run.smithi162.stdout:(8/120): ceph-common-18.2.2-1051.gf14b5682.el9. 7.2 MB/s | 18 MB 00:02 2024-03-30T12:11:54.028 INFO:teuthology.orchestra.run.smithi084.stdout:(111/120): python3-tempora-5.0.0-2.el9.noarch.r 477 kB/s | 36 kB 00:00 2024-03-30T12:11:54.054 INFO:teuthology.orchestra.run.smithi084.stdout:(112/120): python3-typing-extensions-4.4.0-2.el 677 kB/s | 51 kB 00:00 2024-03-30T12:11:54.079 INFO:teuthology.orchestra.run.smithi084.stdout:(113/120): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-03-30T12:11:54.096 INFO:teuthology.orchestra.run.smithi084.stdout:(114/120): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-03-30T12:11:54.135 INFO:teuthology.orchestra.run.smithi162.stdout:(9/120): ceph-radosgw-18.2.2-1051.gf14b5682.el9 10 MB/s | 7.7 MB 00:00 2024-03-30T12:11:54.138 INFO:teuthology.orchestra.run.smithi084.stdout:(115/120): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-03-30T12:11:54.160 INFO:teuthology.orchestra.run.smithi162.stdout:(10/120): ceph-selinux-18.2.2-1051.gf14b5682.el 189 kB/s | 25 kB 00:00 2024-03-30T12:11:54.163 INFO:teuthology.orchestra.run.smithi084.stdout:(116/120): python3-zc-lockfile-2.0-10.el9.noarc 239 kB/s | 20 kB 00:00 2024-03-30T12:11:54.188 INFO:teuthology.orchestra.run.smithi084.stdout:(117/120): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-03-30T12:11:54.227 INFO:teuthology.orchestra.run.smithi162.stdout:(11/120): ceph-mon-18.2.2-1051.gf14b5682.el9.x8 2.4 MB/s | 4.7 MB 00:01 2024-03-30T12:11:54.247 INFO:teuthology.orchestra.run.smithi084.stdout:(118/120): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-03-30T12:11:54.252 INFO:teuthology.orchestra.run.smithi162.stdout:(12/120): libcephfs-devel-18.2.2-1051.gf14b5682 338 kB/s | 31 kB 00:00 2024-03-30T12:11:54.344 INFO:teuthology.orchestra.run.smithi162.stdout:(13/120): libcephsqlite-18.2.2-1051.gf14b5682.e 1.8 MB/s | 166 kB 00:00 2024-03-30T12:11:54.411 INFO:teuthology.orchestra.run.smithi162.stdout:(14/120): libcephfs2-18.2.2-1051.gf14b5682.el9. 3.8 MB/s | 708 kB 00:00 2024-03-30T12:11:54.445 INFO:teuthology.orchestra.run.smithi162.stdout:(15/120): librados-devel-18.2.2-1051.gf14b5682. 1.2 MB/s | 127 kB 00:00 2024-03-30T12:11:54.603 INFO:teuthology.orchestra.run.smithi162.stdout:(16/120): libradosstriper1-18.2.2-1051.gf14b568 2.4 MB/s | 474 kB 00:00 2024-03-30T12:11:54.672 INFO:teuthology.orchestra.run.smithi084.stdout:(119/120): librados2-18.2.2-1051.gf14b5682.el9. 6.5 MB/s | 3.3 MB 00:00 2024-03-30T12:11:54.678 INFO:teuthology.orchestra.run.smithi162.stdout:(17/120): python3-ceph-argparse-18.2.2-1051.gf1 600 kB/s | 45 kB 00:00 2024-03-30T12:11:54.762 INFO:teuthology.orchestra.run.smithi162.stdout:(18/120): python3-ceph-common-18.2.2-1051.gf14b 1.5 MB/s | 129 kB 00:00 2024-03-30T12:11:54.879 INFO:teuthology.orchestra.run.smithi162.stdout:(19/120): python3-cephfs-18.2.2-1051.gf14b5682. 1.4 MB/s | 162 kB 00:00 2024-03-30T12:11:54.979 INFO:teuthology.orchestra.run.smithi162.stdout:(20/120): python3-rados-18.2.2-1051.gf14b5682.e 3.1 MB/s | 320 kB 00:00 2024-03-30T12:11:55.046 INFO:teuthology.orchestra.run.smithi162.stdout:(21/120): librgw2-18.2.2-1051.gf14b5682.el9.x86 7.4 MB/s | 4.5 MB 00:00 2024-03-30T12:11:55.071 INFO:teuthology.orchestra.run.smithi162.stdout:(22/120): python3-rbd-18.2.2-1051.gf14b5682.el9 3.2 MB/s | 298 kB 00:00 2024-03-30T12:11:55.122 INFO:teuthology.orchestra.run.smithi162.stdout:(23/120): python3-rgw-18.2.2-1051.gf14b5682.el9 1.3 MB/s | 99 kB 00:00 2024-03-30T12:11:55.147 INFO:teuthology.orchestra.run.smithi162.stdout:(24/120): rbd-fuse-18.2.2-1051.gf14b5682.el9.x8 1.1 MB/s | 87 kB 00:00 2024-03-30T12:11:55.247 INFO:teuthology.orchestra.run.smithi084.stdout:(120/120): librbd1-18.2.2-1051.gf14b5682.el9.x8 2.8 MB/s | 3.0 MB 00:01 2024-03-30T12:11:55.252 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-03-30T12:11:55.252 INFO:teuthology.orchestra.run.smithi084.stdout:Total 15 MB/s | 176 MB 00:11 2024-03-30T12:11:55.256 INFO:teuthology.orchestra.run.smithi162.stdout:(25/120): rbd-nbd-18.2.2-1051.gf14b5682.el9.x86 1.6 MB/s | 172 kB 00:00 2024-03-30T12:11:55.327 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-03-30T12:11:55.357 INFO:teuthology.orchestra.run.smithi162.stdout:(26/120): ceph-grafana-dashboards-18.2.2-1051.g 234 kB/s | 23 kB 00:00 2024-03-30T12:11:55.415 INFO:teuthology.orchestra.run.smithi162.stdout:(27/120): rbd-mirror-18.2.2-1051.gf14b5682.el9. 10 MB/s | 3.0 MB 00:00 2024-03-30T12:11:55.420 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-03-30T12:11:55.420 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-03-30T12:11:55.440 INFO:teuthology.orchestra.run.smithi162.stdout:(28/120): ceph-mgr-cephadm-18.2.2-1051.gf14b568 1.6 MB/s | 138 kB 00:00 2024-03-30T12:11:55.640 INFO:teuthology.orchestra.run.smithi162.stdout:(29/120): ceph-mgr-dashboard-18.2.2-1051.gf14b5 7.9 MB/s | 1.8 MB 00:00 2024-03-30T12:11:55.723 INFO:teuthology.orchestra.run.smithi162.stdout:(30/120): ceph-mgr-modules-core-18.2.2-1051.gf1 2.9 MB/s | 245 kB 00:00 2024-03-30T12:11:55.807 INFO:teuthology.orchestra.run.smithi162.stdout:(31/120): ceph-mgr-rook-18.2.2-1051.gf14b5682.e 592 kB/s | 49 kB 00:00 2024-03-30T12:11:55.874 INFO:teuthology.orchestra.run.smithi162.stdout:(32/120): ceph-prometheus-alerts-18.2.2-1051.gf 223 kB/s | 15 kB 00:00 2024-03-30T12:11:55.958 INFO:teuthology.orchestra.run.smithi162.stdout:(33/120): cephadm-18.2.2-1051.gf14b5682.el9.noa 2.6 MB/s | 224 kB 00:00 2024-03-30T12:11:56.066 INFO:teuthology.orchestra.run.smithi162.stdout:(34/120): boost-program-options-1.75.0-8.el9.x8 980 kB/s | 106 kB 00:00 2024-03-30T12:11:56.092 INFO:teuthology.orchestra.run.smithi162.stdout:(35/120): flexiblas-3.0.4-8.el9.x86_64.rpm 1.2 MB/s | 32 kB 00:00 2024-03-30T12:11:56.200 INFO:teuthology.orchestra.run.smithi162.stdout:(36/120): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2024-03-30T12:11:56.234 INFO:teuthology.orchestra.run.smithi162.stdout:(37/120): flexiblas-openblas-openmp-3.0.4-8.el9 516 kB/s | 17 kB 00:00 2024-03-30T12:11:56.276 INFO:teuthology.orchestra.run.smithi162.stdout:(38/120): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2024-03-30T12:11:56.384 INFO:teuthology.orchestra.run.smithi162.stdout:(39/120): ceph-mgr-diskprediction-local-18.2.2- 7.8 MB/s | 7.4 MB 00:00 2024-03-30T12:11:56.410 INFO:teuthology.orchestra.run.smithi162.stdout:(40/120): librabbitmq-0.11.0-7.el9.x86_64.rpm 330 kB/s | 44 kB 00:00 2024-03-30T12:11:56.460 INFO:teuthology.orchestra.run.smithi162.stdout:(41/120): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2024-03-30T12:11:56.485 INFO:teuthology.orchestra.run.smithi162.stdout:(42/120): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2024-03-30T12:11:56.519 INFO:teuthology.orchestra.run.smithi162.stdout:(43/120): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.7 MB/s | 217 kB 00:00 2024-03-30T12:11:56.544 INFO:teuthology.orchestra.run.smithi162.stdout:(44/120): openblas-0.3.21-2.el9.x86_64.rpm 583 kB/s | 34 kB 00:00 2024-03-30T12:11:56.924 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-03-30T12:11:56.925 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-03-30T12:11:56.953 INFO:teuthology.orchestra.run.smithi162.stdout:(45/120): ceph-test-18.2.2-1051.gf14b5682.el9.x 14 MB/s | 40 MB 00:02 2024-03-30T12:11:56.978 INFO:teuthology.orchestra.run.smithi162.stdout:(46/120): python3-attrs-20.3.0-7.el9.noarch.rpm 179 kB/s | 78 kB 00:00 2024-03-30T12:11:57.062 INFO:teuthology.orchestra.run.smithi162.stdout:(47/120): openblas-openmp-0.3.21-2.el9.x86_64.r 8.7 MB/s | 4.7 MB 00:00 2024-03-30T12:11:57.146 INFO:teuthology.orchestra.run.smithi162.stdout:(48/120): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 5.8 MB 00:00 2024-03-30T12:11:57.171 INFO:teuthology.orchestra.run.smithi162.stdout:(49/120): python3-iniconfig-1.1.1-7.el9.noarch. 85 kB/s | 16 kB 00:00 2024-03-30T12:11:57.197 INFO:teuthology.orchestra.run.smithi162.stdout:(50/120): python3-jsonpatch-1.21-16.el9.noarch. 186 kB/s | 24 kB 00:00 2024-03-30T12:11:57.221 INFO:teuthology.orchestra.run.smithi162.stdout:(51/120): python3-jsonpointer-2.0-4.el9.noarch. 241 kB/s | 18 kB 00:00 2024-03-30T12:11:57.246 INFO:teuthology.orchestra.run.smithi162.stdout:(52/120): python3-markupsafe-1.1.1-12.el9.x86_6 633 kB/s | 32 kB 00:00 2024-03-30T12:11:57.272 INFO:teuthology.orchestra.run.smithi162.stdout:(53/120): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2024-03-30T12:11:57.372 INFO:teuthology.orchestra.run.smithi162.stdout:(54/120): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2024-03-30T12:11:57.397 INFO:teuthology.orchestra.run.smithi162.stdout:(55/120): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2024-03-30T12:11:57.422 INFO:teuthology.orchestra.run.smithi162.stdout:(56/120): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 174 kB 00:00 2024-03-30T12:11:57.448 INFO:teuthology.orchestra.run.smithi162.stdout:(57/120): python3-packaging-20.9-5.el9.noarch.r 921 kB/s | 69 kB 00:00 2024-03-30T12:11:57.490 INFO:teuthology.orchestra.run.smithi162.stdout:(58/120): python3-pluggy-0.13.1-7.el9.noarch.rp 568 kB/s | 38 kB 00:00 2024-03-30T12:11:57.515 INFO:teuthology.orchestra.run.smithi162.stdout:(59/120): python3-prettytable-0.7.2-27.el9.noar 449 kB/s | 41 kB 00:00 2024-03-30T12:11:57.542 INFO:teuthology.orchestra.run.smithi162.stdout:(60/120): python3-py-1.10.0-6.el9.noarch.rpm 4.6 MB/s | 427 kB 00:00 2024-03-30T12:11:57.565 INFO:teuthology.orchestra.run.smithi162.stdout:(61/120): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-03-30T12:11:57.674 INFO:teuthology.orchestra.run.smithi162.stdout:(62/120): python3-pyasn1-modules-0.4.8-6.el9.no 1.3 MB/s | 211 kB 00:00 2024-03-30T12:11:57.699 INFO:teuthology.orchestra.run.smithi162.stdout:(63/120): python3-pytest-6.2.2-7.el9.noarch.rpm 2.9 MB/s | 473 kB 00:00 2024-03-30T12:11:57.724 INFO:teuthology.orchestra.run.smithi162.stdout:(64/120): python3-requests-oauthlib-1.3.0-12.el 870 kB/s | 43 kB 00:00 2024-03-30T12:11:57.750 INFO:teuthology.orchestra.run.smithi162.stdout:(65/120): python3-pytz-2021.1-5.el9.noarch.rpm 634 kB/s | 47 kB 00:00 2024-03-30T12:11:58.050 INFO:teuthology.orchestra.run.smithi162.stdout:(66/120): python3-toml-0.10.2-6.el9.noarch.rpm 119 kB/s | 39 kB 00:00 2024-03-30T12:11:58.075 INFO:teuthology.orchestra.run.smithi162.stdout:(67/120): socat-1.7.4.1-5.el9.x86_64.rpm 931 kB/s | 300 kB 00:00 2024-03-30T12:11:58.226 INFO:teuthology.orchestra.run.smithi162.stdout:(68/120): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-03-30T12:11:58.251 INFO:teuthology.orchestra.run.smithi162.stdout:(69/120): xmlstarlet-1.6.1-20.el9.x86_64.rpm 313 kB/s | 63 kB 00:00 2024-03-30T12:11:58.276 INFO:teuthology.orchestra.run.smithi162.stdout:(70/120): fuse-2.9.9-15.el9.x86_64.rpm 396 kB/s | 79 kB 00:00 2024-03-30T12:11:58.319 INFO:teuthology.orchestra.run.smithi162.stdout:(71/120): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.5 MB/s | 241 kB 00:00 2024-03-30T12:11:58.360 INFO:teuthology.orchestra.run.smithi162.stdout:(72/120): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2024-03-30T12:11:58.385 INFO:teuthology.orchestra.run.smithi162.stdout:(73/120): python3-ply-3.11-14.el9.noarch.rpm 945 kB/s | 103 kB 00:00 2024-03-30T12:11:58.410 INFO:teuthology.orchestra.run.smithi162.stdout:(74/120): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 124 kB 00:00 2024-03-30T12:11:58.436 INFO:teuthology.orchestra.run.smithi162.stdout:(75/120): python3-urllib3-1.26.5-5.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2024-03-30T12:11:58.969 INFO:teuthology.orchestra.run.smithi162.stdout:(76/120): jq-1.6-16.el9.x86_64.rpm 321 kB/s | 187 kB 00:00 2024-03-30T12:11:58.994 INFO:teuthology.orchestra.run.smithi162.stdout:(77/120): libquadmath-11.4.1-3.el9.x86_64.rpm 350 kB/s | 195 kB 00:00 2024-03-30T12:11:59.078 INFO:teuthology.orchestra.run.smithi162.stdout:(78/120): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-03-30T12:11:59.136 INFO:teuthology.orchestra.run.smithi162.stdout:(79/120): libgfortran-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 803 kB 00:00 2024-03-30T12:11:59.204 INFO:teuthology.orchestra.run.smithi162.stdout:(80/120): python3-devel-3.9.17-2.el9.x86_64.rpm 1.1 MB/s | 245 kB 00:00 2024-03-30T12:11:59.312 INFO:teuthology.orchestra.run.smithi162.stdout:(81/120): python3-jinja2-2.11.3-5.el9.noarch.rp 1.0 MB/s | 248 kB 00:00 2024-03-30T12:11:59.537 INFO:teuthology.orchestra.run.smithi162.stdout:(82/120): fmt-8.1.1-5.el9.x86_64.rpm 276 kB/s | 111 kB 00:00 2024-03-30T12:11:59.654 INFO:teuthology.orchestra.run.smithi162.stdout:(83/120): libarrow-doc-9.0.0-10.el9.noarch.rpm 223 kB/s | 26 kB 00:00 2024-03-30T12:11:59.713 INFO:teuthology.orchestra.run.smithi162.stdout:(84/120): gperftools-libs-2.9.1-2.el9.x86_64.rp 607 kB/s | 309 kB 00:00 2024-03-30T12:11:59.771 INFO:teuthology.orchestra.run.smithi162.stdout:(85/120): liboath-2.6.7-2.el9.x86_64.rpm 415 kB/s | 49 kB 00:00 2024-03-30T12:11:59.813 INFO:teuthology.orchestra.run.smithi162.stdout:(86/120): libunwind-1.6.2-1.el9.x86_64.rpm 672 kB/s | 67 kB 00:00 2024-03-30T12:12:00.005 INFO:teuthology.orchestra.run.smithi162.stdout:(87/120): python3-asyncssh-2.13.2-5.el9.noarch. 2.8 MB/s | 548 kB 00:00 2024-03-30T12:12:00.106 INFO:teuthology.orchestra.run.smithi162.stdout:(88/120): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.5 MB/s | 838 kB 00:00 2024-03-30T12:12:00.131 INFO:teuthology.orchestra.run.smithi162.stdout:(89/120): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 346 kB/s | 43 kB 00:00 2024-03-30T12:12:00.189 INFO:teuthology.orchestra.run.smithi162.stdout:(90/120): libarrow-9.0.0-10.el9.x86_64.rpm 5.0 MB/s | 4.4 MB 00:00 2024-03-30T12:12:00.215 INFO:teuthology.orchestra.run.smithi162.stdout:(91/120): python3-cachetools-4.2.4-1.el9.noarch 296 kB/s | 32 kB 00:00 2024-03-30T12:12:00.240 INFO:teuthology.orchestra.run.smithi162.stdout:(92/120): python3-certifi-2021.10.8-2.el9.noarc 138 kB/s | 15 kB 00:00 2024-03-30T12:12:00.282 INFO:teuthology.orchestra.run.smithi162.stdout:(93/120): python3-cheroot-8.6.0-4.el9.noarch.rp 1.8 MB/s | 172 kB 00:00 2024-03-30T12:12:00.340 INFO:teuthology.orchestra.run.smithi162.stdout:(94/120): python3-cherrypy-18.6.1-2.el9.noarch. 2.8 MB/s | 358 kB 00:00 2024-03-30T12:12:00.366 INFO:teuthology.orchestra.run.smithi162.stdout:(95/120): python3-google-auth-2.28.2-1.el9.noar 1.6 MB/s | 203 kB 00:00 2024-03-30T12:12:00.391 INFO:teuthology.orchestra.run.smithi162.stdout:(96/120): python3-jaraco-8.2.1-3.el9.noarch.rpm 98 kB/s | 11 kB 00:00 2024-03-30T12:12:00.433 INFO:teuthology.orchestra.run.smithi162.stdout:(97/120): python3-jaraco-classes-3.2.1-5.el9.no 192 kB/s | 18 kB 00:00 2024-03-30T12:12:00.458 INFO:teuthology.orchestra.run.smithi162.stdout:(98/120): python3-jaraco-collections-3.0.0-8.el 251 kB/s | 23 kB 00:00 2024-03-30T12:12:00.484 INFO:teuthology.orchestra.run.smithi162.stdout:(99/120): python3-jaraco-functools-3.5.0-2.el9. 210 kB/s | 19 kB 00:00 2024-03-30T12:12:00.542 INFO:teuthology.orchestra.run.smithi162.stdout:(100/120): python3-jaraco-text-3.2.0-6.el9.noar 181 kB/s | 20 kB 00:00 2024-03-30T12:12:00.576 INFO:teuthology.orchestra.run.smithi162.stdout:(101/120): python3-logutils-0.3.5-21.el9.noarch 504 kB/s | 46 kB 00:00 2024-03-30T12:12:00.626 INFO:teuthology.orchestra.run.smithi162.stdout:(102/120): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-03-30T12:12:00.651 INFO:teuthology.orchestra.run.smithi162.stdout:(103/120): python3-more-itertools-8.12.0-2.el9. 724 kB/s | 79 kB 00:00 2024-03-30T12:12:00.676 INFO:teuthology.orchestra.run.smithi162.stdout:(104/120): python3-natsort-7.1.1-5.el9.noarch.r 575 kB/s | 58 kB 00:00 2024-03-30T12:12:00.727 INFO:teuthology.orchestra.run.smithi162.stdout:(105/120): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-03-30T12:12:00.753 INFO:teuthology.orchestra.run.smithi162.stdout:(106/120): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2024-03-30T12:12:00.777 INFO:teuthology.orchestra.run.smithi162.stdout:(107/120): python3-pyOpenSSL-21.0.0-1.el9.noarc 895 kB/s | 90 kB 00:00 2024-03-30T12:12:00.811 INFO:teuthology.orchestra.run.smithi162.stdout:(108/120): python3-repoze-lru-0.7-16.el9.noarch 366 kB/s | 31 kB 00:00 2024-03-30T12:12:00.853 INFO:teuthology.orchestra.run.smithi162.stdout:(109/120): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-03-30T12:12:00.870 INFO:teuthology.orchestra.run.smithi162.stdout:(110/120): python3-rsa-4.9-2.el9.noarch.rpm 639 kB/s | 59 kB 00:00 2024-03-30T12:12:00.895 INFO:teuthology.orchestra.run.smithi162.stdout:(111/120): python3-tempora-5.0.0-2.el9.noarch.r 425 kB/s | 36 kB 00:00 2024-03-30T12:12:00.937 INFO:teuthology.orchestra.run.smithi162.stdout:(112/120): python3-typing-extensions-4.4.0-2.el 606 kB/s | 51 kB 00:00 2024-03-30T12:12:00.971 INFO:teuthology.orchestra.run.smithi162.stdout:(113/120): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-03-30T12:12:00.996 INFO:teuthology.orchestra.run.smithi162.stdout:(114/120): python3-websocket-client-1.2.3-2.el9 893 kB/s | 90 kB 00:00 2024-03-30T12:12:01.055 INFO:teuthology.orchestra.run.smithi162.stdout:(115/120): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-03-30T12:12:01.071 INFO:teuthology.orchestra.run.smithi162.stdout:(116/120): python3-zc-lockfile-2.0-10.el9.noarc 199 kB/s | 20 kB 00:00 2024-03-30T12:12:01.097 INFO:teuthology.orchestra.run.smithi162.stdout:(117/120): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-03-30T12:12:01.272 INFO:teuthology.orchestra.run.smithi162.stdout:(118/120): thrift-0.15.0-2.el9.x86_64.rpm 7.3 MB/s | 1.6 MB 00:00 2024-03-30T12:12:01.439 INFO:teuthology.orchestra.run.smithi162.stdout:(119/120): librbd1-18.2.2-1051.gf14b5682.el9.x8 8.8 MB/s | 3.0 MB 00:00 2024-03-30T12:12:01.564 INFO:teuthology.orchestra.run.smithi162.stdout:(120/120): librados2-18.2.2-1051.gf14b5682.el9. 6.7 MB/s | 3.3 MB 00:00 2024-03-30T12:12:01.567 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-03-30T12:12:01.568 INFO:teuthology.orchestra.run.smithi162.stdout:Total 16 MB/s | 176 MB 00:10 2024-03-30T12:12:01.646 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-03-30T12:12:01.698 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-03-30T12:12:01.738 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-03-30T12:12:01.738 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-03-30T12:12:01.758 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/122 2024-03-30T12:12:01.783 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/122 2024-03-30T12:12:01.835 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/122 2024-03-30T12:12:02.155 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/122 2024-03-30T12:12:02.225 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librados2-2:18.2.2-1051.gf14b5682.el9.x86_64 5/122 2024-03-30T12:12:02.337 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:18.2.2-1051.gf14b5682.el9.x86_64 5/122 2024-03-30T12:12:03.074 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs2-2:18.2.2-1051.gf14b5682.el9.x86_64 6/122 2024-03-30T12:12:03.074 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs2-2:18.2.2-1051.gf14b5682.el9.x86_64 6/122 2024-03-30T12:12:03.074 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rados-2:18.2.2-1051.gf14b5682.el9.x86_64 7/122 2024-03-30T12:12:03.074 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/122 2024-03-30T12:12:03.074 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/122 2024-03-30T12:12:03.074 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephsqlite-2:18.2.2-1051.gf14b5682.el9.x86_64 10/122 2024-03-30T12:12:03.074 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1051.gf14b5682.el9.x86_64 10/122 2024-03-30T12:12:03.074 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libradosstriper1-2:18.2.2-1051.gf14b5682.el9.x86 11/122 2024-03-30T12:12:03.075 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1051.gf14b5682.el9.x86 11/122 2024-03-30T12:12:03.075 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 12/122 2024-03-30T12:12:03.075 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : liboath-2.6.7-2.el9.x86_64 13/122 2024-03-30T12:12:03.075 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 14/122 2024-03-30T12:12:03.075 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 15/122 2024-03-30T12:12:03.075 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 16/122 2024-03-30T12:12:03.076 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 17/122 2024-03-30T12:12:03.107 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 18/122 2024-03-30T12:12:03.146 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 19/122 2024-03-30T12:12:03.212 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/122 2024-03-30T12:12:03.238 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-03-30T12:12:03.239 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-03-30T12:12:03.246 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/122 2024-03-30T12:12:03.273 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/122 2024-03-30T12:12:03.302 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/122 2024-03-30T12:12:03.337 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-argparse-2:18.2.2-1051.gf14b5682.el 24/122 2024-03-30T12:12:03.411 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cephfs-2:18.2.2-1051.gf14b5682.el9.x86_6 25/122 2024-03-30T12:12:03.547 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/122 2024-03-30T12:12:03.598 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 27/122 2024-03-30T12:12:04.127 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rsa-4.9-2.el9.noarch 28/122 2024-03-30T12:12:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 29/122 2024-03-30T12:12:04.265 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 30/122 2024-03-30T12:12:04.299 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 31/122 2024-03-30T12:12:04.334 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 32/122 2024-03-30T12:12:04.375 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 33/122 2024-03-30T12:12:04.413 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librados-devel-2:18.2.2-1051.gf14b5682.el9.x86_6 34/122 2024-03-30T12:12:04.443 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 35/122 2024-03-30T12:12:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 36/122 2024-03-30T12:12:04.591 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : re2-1:20211101-3.el9.x86_64 37/122 2024-03-30T12:12:04.628 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 38/122 2024-03-30T12:12:04.683 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 39/122 2024-03-30T12:12:04.757 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 40/122 2024-03-30T12:12:04.787 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 41/122 2024-03-30T12:12:04.824 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 42/122 2024-03-30T12:12:04.871 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 43/122 2024-03-30T12:12:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 44/122 2024-03-30T12:12:04.959 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 45/122 2024-03-30T12:12:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 46/122 2024-03-30T12:12:05.152 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 47/122 2024-03-30T12:12:05.193 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 48/122 2024-03-30T12:12:05.290 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 49/122 2024-03-30T12:12:05.327 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 50/122 2024-03-30T12:12:05.369 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 51/122 2024-03-30T12:12:05.401 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 52/122 2024-03-30T12:12:05.428 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 53/122 2024-03-30T12:12:05.534 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fmt-8.1.1-5.el9.x86_64 54/122 2024-03-30T12:12:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 55/122 2024-03-30T12:12:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ply-3.11-14.el9.noarch 56/122 2024-03-30T12:12:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 57/122 2024-03-30T12:12:05.886 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 58/122 2024-03-30T12:12:05.928 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 59/122 2024-03-30T12:12:05.998 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 60/122 2024-03-30T12:12:06.086 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 61/122 2024-03-30T12:12:06.226 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 62/122 2024-03-30T12:12:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 63/122 2024-03-30T12:12:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 64/122 2024-03-30T12:12:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fuse-2.9.9-15.el9.x86_64 65/122 2024-03-30T12:12:06.371 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 66/122 2024-03-30T12:12:06.496 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 67/122 2024-03-30T12:12:06.537 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-py-1.10.0-6.el9.noarch 68/122 2024-03-30T12:12:06.568 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 69/122 2024-03-30T12:12:06.610 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pluggy-0.13.1-7.el9.noarch 70/122 2024-03-30T12:12:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/122 2024-03-30T12:12:06.756 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 72/122 2024-03-30T12:12:07.488 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 73/122 2024-03-30T12:12:07.535 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 74/122 2024-03-30T12:12:07.570 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 75/122 2024-03-30T12:12:07.604 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 76/122 2024-03-30T12:12:07.736 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-iniconfig-1.1.1-7.el9.noarch 77/122 2024-03-30T12:12:07.770 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 78/122 2024-03-30T12:12:07.881 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-03-30T12:12:07.941 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/122 2024-03-30T12:12:07.966 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/122 2024-03-30T12:12:07.972 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-0.3.21-2.el9.x86_64 79/122 2024-03-30T12:12:08.010 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 80/122 2024-03-30T12:12:08.030 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/122 2024-03-30T12:12:08.087 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 81/122 2024-03-30T12:12:08.357 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/122 2024-03-30T12:12:08.417 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librados2-2:18.2.2-1051.gf14b5682.el9.x86_64 5/122 2024-03-30T12:12:08.518 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:18.2.2-1051.gf14b5682.el9.x86_64 5/122 2024-03-30T12:12:08.551 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs2-2:18.2.2-1051.gf14b5682.el9.x86_64 6/122 2024-03-30T12:12:08.625 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephfs2-2:18.2.2-1051.gf14b5682.el9.x86_64 6/122 2024-03-30T12:12:08.668 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rados-2:18.2.2-1051.gf14b5682.el9.x86_64 7/122 2024-03-30T12:12:08.697 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/122 2024-03-30T12:12:08.742 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/122 2024-03-30T12:12:08.765 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 82/122 2024-03-30T12:12:08.771 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephsqlite-2:18.2.2-1051.gf14b5682.el9.x86_64 10/122 2024-03-30T12:12:08.855 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1051.gf14b5682.el9.x86_64 10/122 2024-03-30T12:12:08.873 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 83/122 2024-03-30T12:12:08.880 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libradosstriper1-2:18.2.2-1051.gf14b5682.el9.x86 11/122 2024-03-30T12:12:09.005 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1051.gf14b5682.el9.x86 11/122 2024-03-30T12:12:09.034 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 12/122 2024-03-30T12:12:09.065 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : liboath-2.6.7-2.el9.x86_64 13/122 2024-03-30T12:12:09.104 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 14/122 2024-03-30T12:12:09.179 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 15/122 2024-03-30T12:12:09.232 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 16/122 2024-03-30T12:12:09.268 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 17/122 2024-03-30T12:12:09.298 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 18/122 2024-03-30T12:12:09.339 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 19/122 2024-03-30T12:12:09.403 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/122 2024-03-30T12:12:09.438 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/122 2024-03-30T12:12:09.466 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/122 2024-03-30T12:12:09.495 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/122 2024-03-30T12:12:09.530 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-argparse-2:18.2.2-1051.gf14b5682.el 24/122 2024-03-30T12:12:09.605 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cephfs-2:18.2.2-1051.gf14b5682.el9.x86_6 25/122 2024-03-30T12:12:09.739 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/122 2024-03-30T12:12:09.798 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 27/122 2024-03-30T12:12:10.155 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/122 2024-03-30T12:12:10.335 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rsa-4.9-2.el9.noarch 28/122 2024-03-30T12:12:10.420 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 29/122 2024-03-30T12:12:10.457 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 30/122 2024-03-30T12:12:10.476 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 85/122 2024-03-30T12:12:10.489 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 31/122 2024-03-30T12:12:10.508 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 86/122 2024-03-30T12:12:10.524 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 32/122 2024-03-30T12:12:10.541 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : jq-1.6-16.el9.x86_64 87/122 2024-03-30T12:12:10.566 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 33/122 2024-03-30T12:12:10.604 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librados-devel-2:18.2.2-1051.gf14b5682.el9.x86_6 34/122 2024-03-30T12:12:10.635 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 35/122 2024-03-30T12:12:10.670 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 36/122 2024-03-30T12:12:10.775 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : re2-1:20211101-3.el9.x86_64 37/122 2024-03-30T12:12:10.814 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 38/122 2024-03-30T12:12:10.839 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 88/122 2024-03-30T12:12:10.869 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 39/122 2024-03-30T12:12:10.870 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librbd1-2:18.2.2-1051.gf14b5682.el9.x86_64 89/122 2024-03-30T12:12:10.942 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 40/122 2024-03-30T12:12:10.944 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:18.2.2-1051.gf14b5682.el9.x86_64 89/122 2024-03-30T12:12:10.973 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 41/122 2024-03-30T12:12:10.974 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rbd-2:18.2.2-1051.gf14b5682.el9.x86_64 90/122 2024-03-30T12:12:11.009 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 42/122 2024-03-30T12:12:11.011 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 91/122 2024-03-30T12:12:11.056 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 43/122 2024-03-30T12:12:11.101 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 44/122 2024-03-30T12:12:11.154 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 45/122 2024-03-30T12:12:11.292 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 46/122 2024-03-30T12:12:11.339 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 47/122 2024-03-30T12:12:11.381 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 48/122 2024-03-30T12:12:11.433 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 92/122 2024-03-30T12:12:11.479 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 49/122 2024-03-30T12:12:11.482 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librgw2-2:18.2.2-1051.gf14b5682.el9.x86_64 93/122 2024-03-30T12:12:11.514 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 50/122 2024-03-30T12:12:11.536 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librgw2-2:18.2.2-1051.gf14b5682.el9.x86_64 93/122 2024-03-30T12:12:11.557 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 51/122 2024-03-30T12:12:11.575 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rgw-2:18.2.2-1051.gf14b5682.el9.x86_64 94/122 2024-03-30T12:12:11.589 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 52/122 2024-03-30T12:12:11.616 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 53/122 2024-03-30T12:12:11.722 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : fmt-8.1.1-5.el9.x86_64 54/122 2024-03-30T12:12:11.768 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 55/122 2024-03-30T12:12:11.825 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ply-3.11-14.el9.noarch 56/122 2024-03-30T12:12:11.881 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 57/122 2024-03-30T12:12:12.023 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephadm-2:18.2.2-1051.gf14b5682.el9.noarch 95/122 2024-03-30T12:12:12.047 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephadm-2:18.2.2-1051.gf14b5682.el9.noarch 95/122 2024-03-30T12:12:12.077 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1051.gf14b5682.e 96/122 2024-03-30T12:12:12.083 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 58/122 2024-03-30T12:12:12.130 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 59/122 2024-03-30T12:12:12.150 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1051.gf14b5682. 97/122 2024-03-30T12:12:12.188 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-common-2:18.2.2-1051.gf14b5682.el9. 98/122 2024-03-30T12:12:12.209 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 60/122 2024-03-30T12:12:12.300 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 61/122 2024-03-30T12:12:12.450 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 62/122 2024-03-30T12:12:12.489 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 63/122 2024-03-30T12:12:12.521 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 64/122 2024-03-30T12:12:12.553 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : fuse-2.9.9-15.el9.x86_64 65/122 2024-03-30T12:12:12.598 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 66/122 2024-03-30T12:12:12.726 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 67/122 2024-03-30T12:12:12.765 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-py-1.10.0-6.el9.noarch 68/122 2024-03-30T12:12:12.804 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 69/122 2024-03-30T12:12:12.846 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pluggy-0.13.1-7.el9.noarch 70/122 2024-03-30T12:12:12.946 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/122 2024-03-30T12:12:13.001 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 72/122 2024-03-30T12:12:13.762 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 73/122 2024-03-30T12:12:13.806 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 74/122 2024-03-30T12:12:13.840 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 75/122 2024-03-30T12:12:13.873 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 76/122 2024-03-30T12:12:13.923 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-iniconfig-1.1.1-7.el9.noarch 77/122 2024-03-30T12:12:13.956 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 78/122 2024-03-30T12:12:14.134 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-0.3.21-2.el9.x86_64 79/122 2024-03-30T12:12:14.180 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 80/122 2024-03-30T12:12:14.231 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:18.2.2-1051.gf14b5682.el9.x86_64 99/122 2024-03-30T12:12:14.258 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 81/122 2024-03-30T12:12:14.259 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-common-2:18.2.2-1051.gf14b5682.el9.x86_64 99/122 2024-03-30T12:12:14.789 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:18.2.2-1051.gf14b5682.el9.x86_64 99/122 2024-03-30T12:12:14.829 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-base-2:18.2.2-1051.gf14b5682.el9.x86_64 100/122 2024-03-30T12:12:14.920 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-base-2:18.2.2-1051.gf14b5682.el9.x86_64 100/122 2024-03-30T12:12:14.920 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-30T12:12:14.920 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-30T12:12:14.921 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:12:14.939 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 82/122 2024-03-30T12:12:14.963 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-selinux-2:18.2.2-1051.gf14b5682.el9.x86_64 101/122 2024-03-30T12:12:15.045 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 83/122 2024-03-30T12:12:16.334 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/122 2024-03-30T12:12:16.421 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 85/122 2024-03-30T12:12:16.454 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 86/122 2024-03-30T12:12:16.486 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : jq-1.6-16.el9.x86_64 87/122 2024-03-30T12:12:16.787 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 88/122 2024-03-30T12:12:16.818 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librbd1-2:18.2.2-1051.gf14b5682.el9.x86_64 89/122 2024-03-30T12:12:16.900 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:18.2.2-1051.gf14b5682.el9.x86_64 89/122 2024-03-30T12:12:16.931 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rbd-2:18.2.2-1051.gf14b5682.el9.x86_64 90/122 2024-03-30T12:12:16.967 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 91/122 2024-03-30T12:12:17.379 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 92/122 2024-03-30T12:12:17.404 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librgw2-2:18.2.2-1051.gf14b5682.el9.x86_64 93/122 2024-03-30T12:12:17.458 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librgw2-2:18.2.2-1051.gf14b5682.el9.x86_64 93/122 2024-03-30T12:12:17.481 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rgw-2:18.2.2-1051.gf14b5682.el9.x86_64 94/122 2024-03-30T12:12:17.861 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephadm-2:18.2.2-1051.gf14b5682.el9.noarch 95/122 2024-03-30T12:12:17.886 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephadm-2:18.2.2-1051.gf14b5682.el9.noarch 95/122 2024-03-30T12:12:17.916 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1051.gf14b5682.e 96/122 2024-03-30T12:12:17.991 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1051.gf14b5682. 97/122 2024-03-30T12:12:18.020 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-common-2:18.2.2-1051.gf14b5682.el9. 98/122 2024-03-30T12:12:20.073 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:18.2.2-1051.gf14b5682.el9.x86_64 99/122 2024-03-30T12:12:20.122 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-common-2:18.2.2-1051.gf14b5682.el9.x86_64 99/122 2024-03-30T12:12:20.657 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:18.2.2-1051.gf14b5682.el9.x86_64 99/122 2024-03-30T12:12:20.695 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-base-2:18.2.2-1051.gf14b5682.el9.x86_64 100/122 2024-03-30T12:12:20.768 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-base-2:18.2.2-1051.gf14b5682.el9.x86_64 100/122 2024-03-30T12:12:20.768 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-30T12:12:20.768 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-30T12:12:20.769 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-03-30T12:12:20.813 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-selinux-2:18.2.2-1051.gf14b5682.el9.x86_64 101/122 2024-03-30T12:12:26.393 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1051.gf14b5682.el9.x86_64 101/122 2024-03-30T12:12:26.393 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /sys 2024-03-30T12:12:26.393 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /proc 2024-03-30T12:12:26.393 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /mnt 2024-03-30T12:12:26.393 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /var/tmp 2024-03-30T12:12:26.393 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /home 2024-03-30T12:12:26.393 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /root 2024-03-30T12:12:26.393 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /tmp 2024-03-30T12:12:26.393 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:12:26.478 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1051.gf14b5682.el9.noa 102/122 2024-03-30T12:12:26.713 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1051.gf14b5682.el9.noa 102/122 2024-03-30T12:12:26.753 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1051.gf14b5682.el9.n 103/122 2024-03-30T12:12:27.744 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1051.gf14b5682.el9.n 103/122 2024-03-30T12:12:27.772 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1051.gf14 104/122 2024-03-30T12:12:27.872 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1051.gf14 104/122 2024-03-30T12:12:28.031 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1051.gf14b5682.el 105/122 2024-03-30T12:12:28.058 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-2:18.2.2-1051.gf14b5682.el9.x86_64 106/122 2024-03-30T12:12:28.082 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1051.gf14b5682.el9.x86_64 106/122 2024-03-30T12:12:28.082 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T12:12:28.082 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-30T12:12:28.082 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-30T12:12:28.083 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-30T12:12:28.083 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:12:28.134 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-rook-2:18.2.2-1051.gf14b5682.el9.noarch 107/122 2024-03-30T12:12:28.324 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1051.gf14b5682.el9.noarch 107/122 2024-03-30T12:12:28.351 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mds-2:18.2.2-1051.gf14b5682.el9.x86_64 108/122 2024-03-30T12:12:28.374 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mds-2:18.2.2-1051.gf14b5682.el9.x86_64 108/122 2024-03-30T12:12:28.374 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T12:12:28.374 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-30T12:12:28.374 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-30T12:12:28.374 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-30T12:12:28.374 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:12:28.810 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mon-2:18.2.2-1051.gf14b5682.el9.x86_64 109/122 2024-03-30T12:12:28.832 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mon-2:18.2.2-1051.gf14b5682.el9.x86_64 109/122 2024-03-30T12:12:28.832 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T12:12:28.832 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-30T12:12:28.833 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-30T12:12:28.833 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-30T12:12:28.833 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:12:30.244 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-osd-2:18.2.2-1051.gf14b5682.el9.x86_64 110/122 2024-03-30T12:12:30.269 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-osd-2:18.2.2-1051.gf14b5682.el9.x86_64 110/122 2024-03-30T12:12:30.269 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T12:12:30.269 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-30T12:12:30.269 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-30T12:12:30.269 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-30T12:12:30.269 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:12:30.978 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-2:18.2.2-1051.gf14b5682.el9.x86_64 111/122 2024-03-30T12:12:31.004 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-radosgw-2:18.2.2-1051.gf14b5682.el9.x86_64 112/122 2024-03-30T12:12:31.026 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1051.gf14b5682.el9.x86_64 112/122 2024-03-30T12:12:31.026 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T12:12:31.026 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-30T12:12:31.026 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-30T12:12:31.026 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-30T12:12:31.026 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:12:31.071 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1051.gf14b5 113/122 2024-03-30T12:12:31.092 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1051.gf14b5 113/122 2024-03-30T12:12:31.093 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T12:12:31.093 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-30T12:12:31.093 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:12:31.380 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-mirror-2:18.2.2-1051.gf14b5682.el9.x86_64 114/122 2024-03-30T12:12:31.402 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1051.gf14b5682.el9.x86_64 114/122 2024-03-30T12:12:31.402 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T12:12:31.403 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-30T12:12:31.403 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-30T12:12:31.403 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-30T12:12:31.403 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:12:31.851 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1051.gf14b5682.el9.x86_64 101/122 2024-03-30T12:12:31.851 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /sys 2024-03-30T12:12:31.851 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /proc 2024-03-30T12:12:31.851 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /mnt 2024-03-30T12:12:31.852 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /var/tmp 2024-03-30T12:12:31.852 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /home 2024-03-30T12:12:31.852 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /root 2024-03-30T12:12:31.852 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /tmp 2024-03-30T12:12:31.852 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-03-30T12:12:31.936 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1051.gf14b5682.el9.noa 102/122 2024-03-30T12:12:32.172 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1051.gf14b5682.el9.noa 102/122 2024-03-30T12:12:32.208 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1051.gf14b5682.el9.n 103/122 2024-03-30T12:12:33.200 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1051.gf14b5682.el9.n 103/122 2024-03-30T12:12:33.237 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1051.gf14 104/122 2024-03-30T12:12:33.338 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1051.gf14 104/122 2024-03-30T12:12:33.495 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1051.gf14b5682.el 105/122 2024-03-30T12:12:33.944 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-2:18.2.2-1051.gf14b5682.el9.x86_64 106/122 2024-03-30T12:12:33.945 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1051.gf14b5682.el9.x86_64 106/122 2024-03-30T12:12:33.945 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T12:12:33.945 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-30T12:12:33.945 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-30T12:12:33.945 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-30T12:12:33.946 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-03-30T12:12:33.946 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-rook-2:18.2.2-1051.gf14b5682.el9.noarch 107/122 2024-03-30T12:12:33.946 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1051.gf14b5682.el9.noarch 107/122 2024-03-30T12:12:33.946 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mds-2:18.2.2-1051.gf14b5682.el9.x86_64 108/122 2024-03-30T12:12:33.946 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mds-2:18.2.2-1051.gf14b5682.el9.x86_64 108/122 2024-03-30T12:12:33.947 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T12:12:33.947 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-30T12:12:33.947 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-30T12:12:33.947 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-30T12:12:33.947 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-03-30T12:12:34.291 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mon-2:18.2.2-1051.gf14b5682.el9.x86_64 109/122 2024-03-30T12:12:34.314 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mon-2:18.2.2-1051.gf14b5682.el9.x86_64 109/122 2024-03-30T12:12:34.314 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T12:12:34.314 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-30T12:12:34.314 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-30T12:12:34.314 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-30T12:12:34.314 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-03-30T12:12:35.049 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-test-2:18.2.2-1051.gf14b5682.el9.x86_64 115/122 2024-03-30T12:12:35.106 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-fuse-2:18.2.2-1051.gf14b5682.el9.x86_64 116/122 2024-03-30T12:12:35.222 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-nbd-2:18.2.2-1051.gf14b5682.el9.x86_64 117/122 2024-03-30T12:12:35.322 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pytest-6.2.2-7.el9.noarch 118/122 2024-03-30T12:12:35.365 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-fuse-2:18.2.2-1051.gf14b5682.el9.x86_64 119/122 2024-03-30T12:12:35.387 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs-devel-2:18.2.2-1051.gf14b5682.el9.x86_ 120/122 2024-03-30T12:12:35.387 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 121/122 2024-03-30T12:12:35.471 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 121/122 2024-03-30T12:12:35.471 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 122/122 2024-03-30T12:12:35.708 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-osd-2:18.2.2-1051.gf14b5682.el9.x86_64 110/122 2024-03-30T12:12:35.734 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-osd-2:18.2.2-1051.gf14b5682.el9.x86_64 110/122 2024-03-30T12:12:35.734 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T12:12:35.734 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-30T12:12:35.735 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-30T12:12:35.735 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-30T12:12:35.735 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-03-30T12:12:36.445 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-2:18.2.2-1051.gf14b5682.el9.x86_64 111/122 2024-03-30T12:12:36.476 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-radosgw-2:18.2.2-1051.gf14b5682.el9.x86_64 112/122 2024-03-30T12:12:36.500 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1051.gf14b5682.el9.x86_64 112/122 2024-03-30T12:12:36.500 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T12:12:36.500 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-30T12:12:36.500 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-30T12:12:36.500 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-30T12:12:36.501 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-03-30T12:12:36.544 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1051.gf14b5 113/122 2024-03-30T12:12:36.566 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1051.gf14b5 113/122 2024-03-30T12:12:36.566 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T12:12:36.566 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-30T12:12:36.567 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-03-30T12:12:36.861 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-mirror-2:18.2.2-1051.gf14b5682.el9.x86_64 114/122 2024-03-30T12:12:36.884 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1051.gf14b5682.el9.x86_64 114/122 2024-03-30T12:12:36.884 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T12:12:36.884 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-30T12:12:36.885 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-30T12:12:36.885 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-30T12:12:36.885 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-03-30T12:12:39.596 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 122/122 2024-03-30T12:12:39.596 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-2:18.2.2-1051.gf14b5682.el9.x86_64 1/122 2024-03-30T12:12:39.596 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-base-2:18.2.2-1051.gf14b5682.el9.x86_64 2/122 2024-03-30T12:12:39.596 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-common-2:18.2.2-1051.gf14b5682.el9.x86_64 3/122 2024-03-30T12:12:39.596 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-fuse-2:18.2.2-1051.gf14b5682.el9.x86_64 4/122 2024-03-30T12:12:39.596 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1051.gf14b5 5/122 2024-03-30T12:12:39.596 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mds-2:18.2.2-1051.gf14b5682.el9.x86_64 6/122 2024-03-30T12:12:39.596 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-2:18.2.2-1051.gf14b5682.el9.x86_64 7/122 2024-03-30T12:12:39.596 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mon-2:18.2.2-1051.gf14b5682.el9.x86_64 8/122 2024-03-30T12:12:39.596 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-osd-2:18.2.2-1051.gf14b5682.el9.x86_64 9/122 2024-03-30T12:12:39.597 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-radosgw-2:18.2.2-1051.gf14b5682.el9.x86_64 10/122 2024-03-30T12:12:39.597 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-selinux-2:18.2.2-1051.gf14b5682.el9.x86_64 11/122 2024-03-30T12:12:39.597 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-test-2:18.2.2-1051.gf14b5682.el9.x86_64 12/122 2024-03-30T12:12:39.597 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs-devel-2:18.2.2-1051.gf14b5682.el9.x86_ 13/122 2024-03-30T12:12:39.597 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs2-2:18.2.2-1051.gf14b5682.el9.x86_64 14/122 2024-03-30T12:12:39.597 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephsqlite-2:18.2.2-1051.gf14b5682.el9.x86_64 15/122 2024-03-30T12:12:39.597 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados-devel-2:18.2.2-1051.gf14b5682.el9.x86_6 16/122 2024-03-30T12:12:39.597 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libradosstriper1-2:18.2.2-1051.gf14b5682.el9.x86 17/122 2024-03-30T12:12:39.597 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librgw2-2:18.2.2-1051.gf14b5682.el9.x86_64 18/122 2024-03-30T12:12:39.597 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1051.gf14b5682.el 19/122 2024-03-30T12:12:39.597 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-common-2:18.2.2-1051.gf14b5682.el9. 20/122 2024-03-30T12:12:39.597 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cephfs-2:18.2.2-1051.gf14b5682.el9.x86_6 21/122 2024-03-30T12:12:39.597 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rados-2:18.2.2-1051.gf14b5682.el9.x86_64 22/122 2024-03-30T12:12:39.597 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rbd-2:18.2.2-1051.gf14b5682.el9.x86_64 23/122 2024-03-30T12:12:39.598 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rgw-2:18.2.2-1051.gf14b5682.el9.x86_64 24/122 2024-03-30T12:12:39.598 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-fuse-2:18.2.2-1051.gf14b5682.el9.x86_64 25/122 2024-03-30T12:12:39.598 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-mirror-2:18.2.2-1051.gf14b5682.el9.x86_64 26/122 2024-03-30T12:12:39.598 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-nbd-2:18.2.2-1051.gf14b5682.el9.x86_64 27/122 2024-03-30T12:12:39.598 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1051.gf14b5682. 28/122 2024-03-30T12:12:39.598 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1051.gf14b5682.el9.noa 29/122 2024-03-30T12:12:39.598 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1051.gf14b5682.el9.n 30/122 2024-03-30T12:12:39.608 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1051.gf14 31/122 2024-03-30T12:12:39.608 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1051.gf14b5682.el 32/122 2024-03-30T12:12:39.608 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1051.gf14b5682.el9.noarch 33/122 2024-03-30T12:12:39.608 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1051.gf14b5682.e 34/122 2024-03-30T12:12:39.608 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephadm-2:18.2.2-1051.gf14b5682.el9.noarch 35/122 2024-03-30T12:12:39.609 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 36/122 2024-03-30T12:12:39.609 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 37/122 2024-03-30T12:12:39.609 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 38/122 2024-03-30T12:12:39.609 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 39/122 2024-03-30T12:12:39.609 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 40/122 2024-03-30T12:12:39.609 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 41/122 2024-03-30T12:12:39.609 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 42/122 2024-03-30T12:12:39.609 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 43/122 2024-03-30T12:12:39.609 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 44/122 2024-03-30T12:12:39.609 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 45/122 2024-03-30T12:12:39.609 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 46/122 2024-03-30T12:12:39.609 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 47/122 2024-03-30T12:12:39.609 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 48/122 2024-03-30T12:12:39.610 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-iniconfig-1.1.1-7.el9.noarch 49/122 2024-03-30T12:12:39.610 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 50/122 2024-03-30T12:12:39.610 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 51/122 2024-03-30T12:12:39.610 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 52/122 2024-03-30T12:12:39.610 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 53/122 2024-03-30T12:12:39.610 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 54/122 2024-03-30T12:12:39.610 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 55/122 2024-03-30T12:12:39.610 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 56/122 2024-03-30T12:12:39.610 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 57/122 2024-03-30T12:12:39.610 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pluggy-0.13.1-7.el9.noarch 58/122 2024-03-30T12:12:39.610 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 59/122 2024-03-30T12:12:39.610 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-py-1.10.0-6.el9.noarch 60/122 2024-03-30T12:12:39.610 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 61/122 2024-03-30T12:12:39.611 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 62/122 2024-03-30T12:12:39.611 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pytest-6.2.2-7.el9.noarch 63/122 2024-03-30T12:12:39.611 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 64/122 2024-03-30T12:12:39.611 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 65/122 2024-03-30T12:12:39.611 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 66/122 2024-03-30T12:12:39.611 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 67/122 2024-03-30T12:12:39.611 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 68/122 2024-03-30T12:12:39.611 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 69/122 2024-03-30T12:12:39.611 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 70/122 2024-03-30T12:12:39.611 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 71/122 2024-03-30T12:12:39.611 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 72/122 2024-03-30T12:12:39.611 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ply-3.11-14.el9.noarch 73/122 2024-03-30T12:12:39.611 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 74/122 2024-03-30T12:12:39.612 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 75/122 2024-03-30T12:12:39.612 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : jq-1.6-16.el9.x86_64 76/122 2024-03-30T12:12:39.612 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 77/122 2024-03-30T12:12:39.612 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 78/122 2024-03-30T12:12:39.612 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 79/122 2024-03-30T12:12:39.612 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 80/122 2024-03-30T12:12:39.612 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 81/122 2024-03-30T12:12:39.612 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 82/122 2024-03-30T12:12:39.612 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 83/122 2024-03-30T12:12:39.612 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 84/122 2024-03-30T12:12:39.612 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 85/122 2024-03-30T12:12:39.612 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 86/122 2024-03-30T12:12:39.612 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 87/122 2024-03-30T12:12:39.613 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 88/122 2024-03-30T12:12:39.613 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 89/122 2024-03-30T12:12:39.613 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 90/122 2024-03-30T12:12:39.613 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 91/122 2024-03-30T12:12:39.613 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 92/122 2024-03-30T12:12:39.613 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 93/122 2024-03-30T12:12:39.613 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 94/122 2024-03-30T12:12:39.613 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 95/122 2024-03-30T12:12:39.613 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 96/122 2024-03-30T12:12:39.613 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 97/122 2024-03-30T12:12:39.613 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 98/122 2024-03-30T12:12:39.613 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 99/122 2024-03-30T12:12:39.613 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 100/122 2024-03-30T12:12:39.613 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 101/122 2024-03-30T12:12:39.614 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 102/122 2024-03-30T12:12:39.614 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 103/122 2024-03-30T12:12:39.614 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 104/122 2024-03-30T12:12:39.614 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 105/122 2024-03-30T12:12:39.614 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 106/122 2024-03-30T12:12:39.614 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 107/122 2024-03-30T12:12:39.614 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 108/122 2024-03-30T12:12:39.614 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 109/122 2024-03-30T12:12:39.614 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 110/122 2024-03-30T12:12:39.614 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 111/122 2024-03-30T12:12:39.614 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 112/122 2024-03-30T12:12:39.614 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 113/122 2024-03-30T12:12:39.615 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 114/122 2024-03-30T12:12:39.615 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 115/122 2024-03-30T12:12:39.615 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 116/122 2024-03-30T12:12:39.615 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : re2-1:20211101-3.el9.x86_64 117/122 2024-03-30T12:12:39.615 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 118/122 2024-03-30T12:12:39.615 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:18.2.2-1051.gf14b5682.el9.x86_64 119/122 2024-03-30T12:12:39.615 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 120/122 2024-03-30T12:12:39.615 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:18.2.2-1051.gf14b5682.el9.x86_64 121/122 2024-03-30T12:12:40.564 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-test-2:18.2.2-1051.gf14b5682.el9.x86_64 115/122 2024-03-30T12:12:40.605 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-fuse-2:18.2.2-1051.gf14b5682.el9.x86_64 116/122 2024-03-30T12:12:40.724 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-nbd-2:18.2.2-1051.gf14b5682.el9.x86_64 117/122 2024-03-30T12:12:40.831 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pytest-6.2.2-7.el9.noarch 118/122 2024-03-30T12:12:40.864 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-fuse-2:18.2.2-1051.gf14b5682.el9.x86_64 119/122 2024-03-30T12:12:40.895 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs-devel-2:18.2.2-1051.gf14b5682.el9.x86_ 120/122 2024-03-30T12:12:40.895 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 121/122 2024-03-30T12:12:40.979 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 121/122 2024-03-30T12:12:40.979 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 122/122 2024-03-30T12:12:41.643 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 122/122 2024-03-30T12:12:41.644 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:12:41.644 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2024-03-30T12:12:41.644 INFO:teuthology.orchestra.run.smithi084.stdout: librados2-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.644 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.644 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-03-30T12:12:41.644 INFO:teuthology.orchestra.run.smithi084.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-30T12:12:41.644 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.644 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.644 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.645 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.645 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards-2:18.2.2-1051.gf14b5682.el9.noarch 2024-03-30T12:12:41.645 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.645 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.645 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.645 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm-2:18.2.2-1051.gf14b5682.el9.noarch 2024-03-30T12:12:41.645 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard-2:18.2.2-1051.gf14b5682.el9.noarch 2024-03-30T12:12:41.645 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1051.gf14b5682.el9.noarch 2024-03-30T12:12:41.645 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core-2:18.2.2-1051.gf14b5682.el9.noarch 2024-03-30T12:12:41.645 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook-2:18.2.2-1051.gf14b5682.el9.noarch 2024-03-30T12:12:41.646 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.646 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.646 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts-2:18.2.2-1051.gf14b5682.el9.noarch 2024-03-30T12:12:41.646 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.646 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.646 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.646 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm-2:18.2.2-1051.gf14b5682.el9.noarch 2024-03-30T12:12:41.646 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-30T12:12:41.646 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-30T12:12:41.646 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-30T12:12:41.647 INFO:teuthology.orchestra.run.smithi084.stdout: fmt-8.1.1-5.el9.x86_64 2024-03-30T12:12:41.647 INFO:teuthology.orchestra.run.smithi084.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-30T12:12:41.647 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-30T12:12:41.647 INFO:teuthology.orchestra.run.smithi084.stdout: jq-1.6-16.el9.x86_64 2024-03-30T12:12:41.647 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-30T12:12:41.647 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-30T12:12:41.647 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.647 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.647 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.647 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-30T12:12:41.648 INFO:teuthology.orchestra.run.smithi084.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-30T12:12:41.648 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-30T12:12:41.648 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-30T12:12:41.648 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-30T12:12:41.648 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.648 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.648 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-30T12:12:41.648 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.648 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-30T12:12:41.648 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-30T12:12:41.649 INFO:teuthology.orchestra.run.smithi084.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-30T12:12:41.649 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-30T12:12:41.649 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-30T12:12:41.649 INFO:teuthology.orchestra.run.smithi084.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-30T12:12:41.649 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-30T12:12:41.649 INFO:teuthology.orchestra.run.smithi084.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-30T12:12:41.649 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-30T12:12:41.649 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-30T12:12:41.649 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-30T12:12:41.650 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.650 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.650 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.650 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-30T12:12:41.650 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-30T12:12:41.650 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-30T12:12:41.650 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-30T12:12:41.650 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-30T12:12:41.650 INFO:teuthology.orchestra.run.smithi084.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-30T12:12:41.650 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-30T12:12:41.651 INFO:teuthology.orchestra.run.smithi084.stdout: python3-iniconfig-1.1.1-7.el9.noarch 2024-03-30T12:12:41.651 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-30T12:12:41.651 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-30T12:12:41.651 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-30T12:12:41.651 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-30T12:12:41.651 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-30T12:12:41.651 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-30T12:12:41.651 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-30T12:12:41.651 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-30T12:12:41.651 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-30T12:12:41.652 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-30T12:12:41.652 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-30T12:12:41.652 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-30T12:12:41.652 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-30T12:12:41.652 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-30T12:12:41.652 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-30T12:12:41.652 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-30T12:12:41.652 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-30T12:12:41.652 INFO:teuthology.orchestra.run.smithi084.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-30T12:12:41.652 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-30T12:12:41.653 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pluggy-0.13.1-7.el9.noarch 2024-03-30T12:12:41.653 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ply-3.11-14.el9.noarch 2024-03-30T12:12:41.653 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-30T12:12:41.653 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-30T12:12:41.653 INFO:teuthology.orchestra.run.smithi084.stdout: python3-py-1.10.0-6.el9.noarch 2024-03-30T12:12:41.653 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-30T12:12:41.653 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-30T12:12:41.653 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-30T12:12:41.653 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-30T12:12:41.653 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytest-6.2.2-7.el9.noarch 2024-03-30T12:12:41.654 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-30T12:12:41.654 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.654 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.654 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-30T12:12:41.654 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-30T12:12:41.654 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-30T12:12:41.654 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.654 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-30T12:12:41.654 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-30T12:12:41.654 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-30T12:12:41.655 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-30T12:12:41.655 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-30T12:12:41.655 INFO:teuthology.orchestra.run.smithi084.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-30T12:12:41.655 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-30T12:12:41.655 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-30T12:12:41.655 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-30T12:12:41.655 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-30T12:12:41.655 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-30T12:12:41.655 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.655 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.656 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:41.656 INFO:teuthology.orchestra.run.smithi084.stdout: re2-1:20211101-3.el9.x86_64 2024-03-30T12:12:41.656 INFO:teuthology.orchestra.run.smithi084.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-30T12:12:41.656 INFO:teuthology.orchestra.run.smithi084.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-30T12:12:41.656 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-30T12:12:41.657 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:12:41.657 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-03-30T12:12:41.978 DEBUG:teuthology.parallel:result is None 2024-03-30T12:12:45.310 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 122/122 2024-03-30T12:12:45.310 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-2:18.2.2-1051.gf14b5682.el9.x86_64 1/122 2024-03-30T12:12:45.310 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-base-2:18.2.2-1051.gf14b5682.el9.x86_64 2/122 2024-03-30T12:12:45.310 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-common-2:18.2.2-1051.gf14b5682.el9.x86_64 3/122 2024-03-30T12:12:45.310 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-fuse-2:18.2.2-1051.gf14b5682.el9.x86_64 4/122 2024-03-30T12:12:45.311 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1051.gf14b5 5/122 2024-03-30T12:12:45.311 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mds-2:18.2.2-1051.gf14b5682.el9.x86_64 6/122 2024-03-30T12:12:45.311 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-2:18.2.2-1051.gf14b5682.el9.x86_64 7/122 2024-03-30T12:12:45.311 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mon-2:18.2.2-1051.gf14b5682.el9.x86_64 8/122 2024-03-30T12:12:45.311 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-osd-2:18.2.2-1051.gf14b5682.el9.x86_64 9/122 2024-03-30T12:12:45.311 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-radosgw-2:18.2.2-1051.gf14b5682.el9.x86_64 10/122 2024-03-30T12:12:45.311 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-selinux-2:18.2.2-1051.gf14b5682.el9.x86_64 11/122 2024-03-30T12:12:45.311 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-test-2:18.2.2-1051.gf14b5682.el9.x86_64 12/122 2024-03-30T12:12:45.311 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs-devel-2:18.2.2-1051.gf14b5682.el9.x86_ 13/122 2024-03-30T12:12:45.311 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs2-2:18.2.2-1051.gf14b5682.el9.x86_64 14/122 2024-03-30T12:12:45.311 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephsqlite-2:18.2.2-1051.gf14b5682.el9.x86_64 15/122 2024-03-30T12:12:45.311 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados-devel-2:18.2.2-1051.gf14b5682.el9.x86_6 16/122 2024-03-30T12:12:45.311 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libradosstriper1-2:18.2.2-1051.gf14b5682.el9.x86 17/122 2024-03-30T12:12:45.311 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librgw2-2:18.2.2-1051.gf14b5682.el9.x86_64 18/122 2024-03-30T12:12:45.311 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1051.gf14b5682.el 19/122 2024-03-30T12:12:45.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-common-2:18.2.2-1051.gf14b5682.el9. 20/122 2024-03-30T12:12:45.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cephfs-2:18.2.2-1051.gf14b5682.el9.x86_6 21/122 2024-03-30T12:12:45.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rados-2:18.2.2-1051.gf14b5682.el9.x86_64 22/122 2024-03-30T12:12:45.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rbd-2:18.2.2-1051.gf14b5682.el9.x86_64 23/122 2024-03-30T12:12:45.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rgw-2:18.2.2-1051.gf14b5682.el9.x86_64 24/122 2024-03-30T12:12:45.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-fuse-2:18.2.2-1051.gf14b5682.el9.x86_64 25/122 2024-03-30T12:12:45.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-mirror-2:18.2.2-1051.gf14b5682.el9.x86_64 26/122 2024-03-30T12:12:45.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-nbd-2:18.2.2-1051.gf14b5682.el9.x86_64 27/122 2024-03-30T12:12:45.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1051.gf14b5682. 28/122 2024-03-30T12:12:45.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1051.gf14b5682.el9.noa 29/122 2024-03-30T12:12:45.321 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1051.gf14b5682.el9.n 30/122 2024-03-30T12:12:45.321 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1051.gf14 31/122 2024-03-30T12:12:45.321 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1051.gf14b5682.el 32/122 2024-03-30T12:12:45.321 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1051.gf14b5682.el9.noarch 33/122 2024-03-30T12:12:45.321 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1051.gf14b5682.e 34/122 2024-03-30T12:12:45.321 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephadm-2:18.2.2-1051.gf14b5682.el9.noarch 35/122 2024-03-30T12:12:45.321 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 36/122 2024-03-30T12:12:45.321 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 37/122 2024-03-30T12:12:45.321 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 38/122 2024-03-30T12:12:45.321 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 39/122 2024-03-30T12:12:45.321 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 40/122 2024-03-30T12:12:45.321 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 41/122 2024-03-30T12:12:45.321 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 42/122 2024-03-30T12:12:45.322 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 43/122 2024-03-30T12:12:45.322 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 44/122 2024-03-30T12:12:45.322 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 45/122 2024-03-30T12:12:45.322 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 46/122 2024-03-30T12:12:45.322 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 47/122 2024-03-30T12:12:45.322 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 48/122 2024-03-30T12:12:45.322 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-iniconfig-1.1.1-7.el9.noarch 49/122 2024-03-30T12:12:45.322 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 50/122 2024-03-30T12:12:45.322 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 51/122 2024-03-30T12:12:45.322 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 52/122 2024-03-30T12:12:45.322 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 53/122 2024-03-30T12:12:45.322 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 54/122 2024-03-30T12:12:45.322 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 55/122 2024-03-30T12:12:45.323 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 56/122 2024-03-30T12:12:45.323 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 57/122 2024-03-30T12:12:45.323 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pluggy-0.13.1-7.el9.noarch 58/122 2024-03-30T12:12:45.323 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 59/122 2024-03-30T12:12:45.323 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-py-1.10.0-6.el9.noarch 60/122 2024-03-30T12:12:45.323 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 61/122 2024-03-30T12:12:45.323 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 62/122 2024-03-30T12:12:45.323 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pytest-6.2.2-7.el9.noarch 63/122 2024-03-30T12:12:45.323 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 64/122 2024-03-30T12:12:45.323 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 65/122 2024-03-30T12:12:45.323 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 66/122 2024-03-30T12:12:45.323 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 67/122 2024-03-30T12:12:45.323 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 68/122 2024-03-30T12:12:45.323 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 69/122 2024-03-30T12:12:45.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 70/122 2024-03-30T12:12:45.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 71/122 2024-03-30T12:12:45.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 72/122 2024-03-30T12:12:45.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ply-3.11-14.el9.noarch 73/122 2024-03-30T12:12:45.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 74/122 2024-03-30T12:12:45.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 75/122 2024-03-30T12:12:45.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : jq-1.6-16.el9.x86_64 76/122 2024-03-30T12:12:45.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 77/122 2024-03-30T12:12:45.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 78/122 2024-03-30T12:12:45.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 79/122 2024-03-30T12:12:45.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 80/122 2024-03-30T12:12:45.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 81/122 2024-03-30T12:12:45.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 82/122 2024-03-30T12:12:45.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 83/122 2024-03-30T12:12:45.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 84/122 2024-03-30T12:12:45.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 85/122 2024-03-30T12:12:45.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 86/122 2024-03-30T12:12:45.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 87/122 2024-03-30T12:12:45.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 88/122 2024-03-30T12:12:45.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 89/122 2024-03-30T12:12:45.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 90/122 2024-03-30T12:12:45.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 91/122 2024-03-30T12:12:45.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 92/122 2024-03-30T12:12:45.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 93/122 2024-03-30T12:12:45.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 94/122 2024-03-30T12:12:45.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 95/122 2024-03-30T12:12:45.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 96/122 2024-03-30T12:12:45.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 97/122 2024-03-30T12:12:45.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 98/122 2024-03-30T12:12:45.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 99/122 2024-03-30T12:12:45.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 100/122 2024-03-30T12:12:45.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 101/122 2024-03-30T12:12:45.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 102/122 2024-03-30T12:12:45.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 103/122 2024-03-30T12:12:45.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 104/122 2024-03-30T12:12:45.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 105/122 2024-03-30T12:12:45.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 106/122 2024-03-30T12:12:45.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 107/122 2024-03-30T12:12:45.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 108/122 2024-03-30T12:12:45.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 109/122 2024-03-30T12:12:45.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 110/122 2024-03-30T12:12:45.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 111/122 2024-03-30T12:12:45.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 112/122 2024-03-30T12:12:45.327 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 113/122 2024-03-30T12:12:45.327 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 114/122 2024-03-30T12:12:45.327 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 115/122 2024-03-30T12:12:45.327 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 116/122 2024-03-30T12:12:45.327 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : re2-1:20211101-3.el9.x86_64 117/122 2024-03-30T12:12:45.327 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 118/122 2024-03-30T12:12:45.327 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:18.2.2-1051.gf14b5682.el9.x86_64 119/122 2024-03-30T12:12:45.327 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 120/122 2024-03-30T12:12:45.327 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:18.2.2-1051.gf14b5682.el9.x86_64 121/122 2024-03-30T12:12:47.135 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 122/122 2024-03-30T12:12:47.135 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-03-30T12:12:47.135 INFO:teuthology.orchestra.run.smithi162.stdout:Upgraded: 2024-03-30T12:12:47.135 INFO:teuthology.orchestra.run.smithi162.stdout: librados2-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.135 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.135 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-03-30T12:12:47.135 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-30T12:12:47.136 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.136 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.136 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.136 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.136 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards-2:18.2.2-1051.gf14b5682.el9.noarch 2024-03-30T12:12:47.136 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.136 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.136 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.136 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm-2:18.2.2-1051.gf14b5682.el9.noarch 2024-03-30T12:12:47.136 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard-2:18.2.2-1051.gf14b5682.el9.noarch 2024-03-30T12:12:47.136 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1051.gf14b5682.el9.noarch 2024-03-30T12:12:47.136 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core-2:18.2.2-1051.gf14b5682.el9.noarch 2024-03-30T12:12:47.136 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook-2:18.2.2-1051.gf14b5682.el9.noarch 2024-03-30T12:12:47.136 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.137 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.137 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts-2:18.2.2-1051.gf14b5682.el9.noarch 2024-03-30T12:12:47.137 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.137 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.137 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.137 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm-2:18.2.2-1051.gf14b5682.el9.noarch 2024-03-30T12:12:47.137 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-30T12:12:47.137 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-30T12:12:47.137 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-30T12:12:47.137 INFO:teuthology.orchestra.run.smithi162.stdout: fmt-8.1.1-5.el9.x86_64 2024-03-30T12:12:47.137 INFO:teuthology.orchestra.run.smithi162.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-30T12:12:47.137 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-30T12:12:47.137 INFO:teuthology.orchestra.run.smithi162.stdout: jq-1.6-16.el9.x86_64 2024-03-30T12:12:47.137 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-30T12:12:47.138 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-30T12:12:47.138 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.138 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.138 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.138 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-30T12:12:47.138 INFO:teuthology.orchestra.run.smithi162.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-30T12:12:47.138 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-30T12:12:47.138 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-30T12:12:47.138 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-30T12:12:47.138 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.138 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.138 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-30T12:12:47.138 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.138 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-30T12:12:47.139 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-30T12:12:47.139 INFO:teuthology.orchestra.run.smithi162.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-30T12:12:47.139 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-30T12:12:47.139 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-30T12:12:47.139 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-30T12:12:47.139 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-30T12:12:47.139 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-30T12:12:47.139 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-30T12:12:47.139 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-30T12:12:47.139 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-30T12:12:47.139 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.139 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.139 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.139 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-30T12:12:47.140 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-30T12:12:47.140 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-30T12:12:47.140 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-30T12:12:47.140 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-30T12:12:47.140 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-30T12:12:47.140 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-30T12:12:47.140 INFO:teuthology.orchestra.run.smithi162.stdout: python3-iniconfig-1.1.1-7.el9.noarch 2024-03-30T12:12:47.140 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-30T12:12:47.140 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-30T12:12:47.140 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-30T12:12:47.140 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-30T12:12:47.140 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-30T12:12:47.140 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-30T12:12:47.140 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-30T12:12:47.141 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-30T12:12:47.141 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-30T12:12:47.141 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-30T12:12:47.141 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-30T12:12:47.141 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-30T12:12:47.141 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-30T12:12:47.141 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-30T12:12:47.141 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-30T12:12:47.141 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-30T12:12:47.141 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-30T12:12:47.141 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-30T12:12:47.141 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-30T12:12:47.141 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pluggy-0.13.1-7.el9.noarch 2024-03-30T12:12:47.141 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply-3.11-14.el9.noarch 2024-03-30T12:12:47.142 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-30T12:12:47.142 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-30T12:12:47.142 INFO:teuthology.orchestra.run.smithi162.stdout: python3-py-1.10.0-6.el9.noarch 2024-03-30T12:12:47.142 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-30T12:12:47.142 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-30T12:12:47.142 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-30T12:12:47.142 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-30T12:12:47.142 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytest-6.2.2-7.el9.noarch 2024-03-30T12:12:47.142 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-30T12:12:47.142 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.142 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.142 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-30T12:12:47.142 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-30T12:12:47.142 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-30T12:12:47.143 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.143 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-30T12:12:47.143 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-30T12:12:47.143 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-30T12:12:47.143 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-30T12:12:47.143 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-30T12:12:47.143 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-30T12:12:47.143 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-30T12:12:47.143 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-30T12:12:47.143 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-30T12:12:47.143 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-30T12:12:47.143 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-30T12:12:47.143 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.143 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.143 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd-2:18.2.2-1051.gf14b5682.el9.x86_64 2024-03-30T12:12:47.144 INFO:teuthology.orchestra.run.smithi162.stdout: re2-1:20211101-3.el9.x86_64 2024-03-30T12:12:47.144 INFO:teuthology.orchestra.run.smithi162.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-30T12:12:47.144 INFO:teuthology.orchestra.run.smithi162.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-30T12:12:47.144 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-30T12:12:47.144 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-03-30T12:12:47.144 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-03-30T12:12:47.456 DEBUG:teuthology.parallel:result is None 2024-03-30T12:12:47.456 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-30T12:12:47.457 INFO:teuthology.packaging:ref: None 2024-03-30T12:12:47.457 INFO:teuthology.packaging:tag: None 2024-03-30T12:12:47.457 INFO:teuthology.packaging:branch: reef 2024-03-30T12:12:47.457 INFO:teuthology.packaging:sha1: 5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc 2024-03-30T12:12:47.457 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-03-30T12:12:47.818 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-30T12:12:47.844 INFO:teuthology.orchestra.run.smithi084.stdout:18.2.2-1051.gf14b5682.el9 2024-03-30T12:12:47.845 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1051.gf14b5682.el9 2024-03-30T12:12:47.845 INFO:teuthology.task.install:The correct ceph version 18.2.2-1051.gf14b5682 is installed. 2024-03-30T12:12:47.847 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-30T12:12:47.847 INFO:teuthology.packaging:ref: None 2024-03-30T12:12:47.847 INFO:teuthology.packaging:tag: None 2024-03-30T12:12:47.847 INFO:teuthology.packaging:branch: reef 2024-03-30T12:12:47.847 INFO:teuthology.packaging:sha1: 5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc 2024-03-30T12:12:47.847 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-03-30T12:12:48.208 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-30T12:12:48.234 INFO:teuthology.orchestra.run.smithi162.stdout:18.2.2-1051.gf14b5682.el9 2024-03-30T12:12:48.234 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1051.gf14b5682.el9 2024-03-30T12:12:48.234 INFO:teuthology.task.install:The correct ceph version 18.2.2-1051.gf14b5682 is installed. 2024-03-30T12:12:48.236 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-30T12:12:48.236 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-30T12:12:48.236 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-30T12:12:48.271 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-03-30T12:12:48.271 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-30T12:12:48.306 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-30T12:12:48.307 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-30T12:12:48.307 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/daemon-helper 2024-03-30T12:12:48.341 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-30T12:12:48.410 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-03-30T12:12:48.410 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2024-03-30T12:12:48.439 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-30T12:12:48.508 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-30T12:12:48.508 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-30T12:12:48.508 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-30T12:12:48.537 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-30T12:12:48.606 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-03-30T12:12:48.606 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-30T12:12:48.634 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-30T12:12:48.702 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-30T12:12:48.703 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-30T12:12:48.703 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/stdin-killer 2024-03-30T12:12:48.731 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-30T12:12:48.799 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-03-30T12:12:48.800 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2024-03-30T12:12:48.828 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-30T12:12:48.895 INFO:teuthology.run_tasks:Running task print... 2024-03-30T12:12:48.913 INFO:teuthology.task.print:**** done install task... 2024-03-30T12:12:48.913 INFO:teuthology.run_tasks:Running task print... 2024-03-30T12:12:49.039 INFO:teuthology.task.print:**** done start installing reef cephadm ... 2024-03-30T12:12:49.039 INFO:teuthology.run_tasks:Running task cephadm... 2024-03-30T12:12:49.234 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'debug ms': 1, 'debug osd': 20, 'osd shutdown pgref assert': True}, 'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'image': 'quay.ceph.io/ceph-ci/ceph:reef', 'create_rbd_pool': True, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc'} 2024-03-30T12:12:49.234 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:reef 2024-03-30T12:12:49.234 INFO:tasks.cephadm:Cluster fsid is d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:12:49.234 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-03-30T12:12:49.235 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.84', 'mon.c': '[v2:172.21.15.84:3301,v1:172.21.15.84:6790]', 'mon.b': '172.21.15.162'} 2024-03-30T12:12:49.235 INFO:tasks.cephadm:First mon is mon.a on smithi084 2024-03-30T12:12:49.235 INFO:tasks.cephadm:First mgr is y 2024-03-30T12:12:49.235 INFO:tasks.cephadm:Normalizing hostnames... 2024-03-30T12:12:49.235 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname $(hostname -s) 2024-03-30T12:12:49.267 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname $(hostname -s) 2024-03-30T12:12:49.295 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-03-30T12:12:49.296 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc 2024-03-30T12:12:49.437 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/78094/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-1864-g5dc2ea30', 'node_name': '172.21.5.34+adami04', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-1864.g5dc2ea30'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-ceph_test_rados-partial-reads/5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-03-29 22:30:20.970294', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-ceph_test_rados-partial-reads', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-ceph_test_rados-partial-reads/5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-03-30T12:12:49.811 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref reef, sha1 f14b5682ac4f2d91bddebd76ffe4e49b8122e149 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-03-30T12:12:49.812 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/reef/f14b5682ac4f2d91bddebd76ffe4e49b8122e149/centos/9/x86_64/flavors/default/cephadm 2024-03-30T12:12:49.812 DEBUG:teuthology.orchestra.run.smithi084:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/reef/f14b5682ac4f2d91bddebd76ffe4e49b8122e149/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-30T12:12:50.243 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r--. 1 ubuntu ubuntu 215334 Mar 30 12:12 /home/ubuntu/cephtest/cephadm 2024-03-30T12:12:50.243 DEBUG:teuthology.orchestra.run.smithi162:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/reef/f14b5682ac4f2d91bddebd76ffe4e49b8122e149/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-30T12:12:50.648 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r--. 1 ubuntu ubuntu 215334 Mar 30 12:12 /home/ubuntu/cephtest/cephadm 2024-03-30T12:12:50.649 DEBUG:teuthology.orchestra.run.smithi084:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-30T12:12:50.668 DEBUG:teuthology.orchestra.run.smithi162:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-30T12:12:50.701 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:reef on all hosts... 2024-03-30T12:12:50.701 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-03-30T12:12:50.711 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-03-30T12:12:51.523 INFO:teuthology.orchestra.run.smithi084.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-03-30T12:12:51.612 INFO:teuthology.orchestra.run.smithi162.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-03-30T12:13:17.321 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-30T12:13:17.322 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)", 2024-03-30T12:13:17.322 INFO:teuthology.orchestra.run.smithi084.stdout: "image_id": "c8fb09e16a7d204ddf8070b46841183d802f7121fa7d3b7679ce8e4cb9cfc075", 2024-03-30T12:13:17.322 INFO:teuthology.orchestra.run.smithi084.stdout: "repo_digests": [ 2024-03-30T12:13:17.322 INFO:teuthology.orchestra.run.smithi084.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2" 2024-03-30T12:13:17.322 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-03-30T12:13:17.322 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-30T12:13:20.835 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-03-30T12:13:20.836 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_version": "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)", 2024-03-30T12:13:20.836 INFO:teuthology.orchestra.run.smithi162.stdout: "image_id": "c8fb09e16a7d204ddf8070b46841183d802f7121fa7d3b7679ce8e4cb9cfc075", 2024-03-30T12:13:20.836 INFO:teuthology.orchestra.run.smithi162.stdout: "repo_digests": [ 2024-03-30T12:13:20.836 INFO:teuthology.orchestra.run.smithi162.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2" 2024-03-30T12:13:20.836 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-03-30T12:13:20.836 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-03-30T12:13:20.854 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph 2024-03-30T12:13:20.892 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph 2024-03-30T12:13:20.922 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 777 /etc/ceph 2024-03-30T12:13:20.968 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /etc/ceph 2024-03-30T12:13:20.997 INFO:tasks.cephadm:Writing seed config... 2024-03-30T12:13:20.999 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-03-30T12:13:20.999 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-03-30T12:13:20.999 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-03-30T12:13:20.999 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-03-30T12:13:21.000 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-03-30T12:13:21.000 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2024-03-30T12:13:21.000 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-03-30T12:13:21.000 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-03-30T12:13:21.000 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-03-30T12:13:21.000 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-03-30T12:13:21.000 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-03-30T12:13:21.001 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-30T12:13:21.002 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-03-30T12:13:21.031 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = d3450b00-ee8e-11ee-b647-cb9ed24678a4 mon election default strategy = 3 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-03-30T12:13:21.031 DEBUG:teuthology.orchestra.run.smithi084:mon.a> sudo journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mon.a.service 2024-03-30T12:13:21.082 DEBUG:teuthology.orchestra.run.smithi084:mgr.y> sudo journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mgr.y.service 2024-03-30T12:13:21.129 INFO:tasks.cephadm:Bootstrapping... 2024-03-30T12:13:21.129 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef -v bootstrap --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.84 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-03-30T12:13:21.296 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-03-30T12:13:21.296 INFO:teuthology.orchestra.run.smithi084.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:reef', '-v', 'bootstrap', '--fsid', 'd3450b00-ee8e-11ee-b647-cb9ed24678a4', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.84', '--skip-admin-label'] 2024-03-30T12:13:21.319 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stdout 4.9.4-dev 2024-03-30T12:13:21.319 INFO:teuthology.orchestra.run.smithi084.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-03-30T12:13:21.320 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying podman|docker is present... 2024-03-30T12:13:21.343 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stdout 4.9.4-dev 2024-03-30T12:13:21.345 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying lvm2 is present... 2024-03-30T12:13:21.345 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying time synchronization is in place... 2024-03-30T12:13:21.351 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-30T12:13:21.351 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-30T12:13:21.356 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-30T12:13:21.357 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-03-30T12:13:21.362 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout enabled 2024-03-30T12:13:21.368 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout active 2024-03-30T12:13:21.369 INFO:teuthology.orchestra.run.smithi084.stdout:Unit chronyd.service is enabled and running 2024-03-30T12:13:21.369 INFO:teuthology.orchestra.run.smithi084.stdout:Repeating the final host check... 2024-03-30T12:13:21.391 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stdout 4.9.4-dev 2024-03-30T12:13:21.392 INFO:teuthology.orchestra.run.smithi084.stdout:podman (/bin/podman) version 4.9.4 is present 2024-03-30T12:13:21.392 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl is present 2024-03-30T12:13:21.392 INFO:teuthology.orchestra.run.smithi084.stdout:lvcreate is present 2024-03-30T12:13:21.397 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-30T12:13:21.398 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-30T12:13:21.403 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-30T12:13:21.403 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-03-30T12:13:21.409 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout enabled 2024-03-30T12:13:21.415 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout active 2024-03-30T12:13:21.415 INFO:teuthology.orchestra.run.smithi084.stdout:Unit chronyd.service is enabled and running 2024-03-30T12:13:21.415 INFO:teuthology.orchestra.run.smithi084.stdout:Host looks OK 2024-03-30T12:13:21.416 INFO:teuthology.orchestra.run.smithi084.stdout:Cluster fsid: d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:13:21.416 INFO:teuthology.orchestra.run.smithi084.stdout:Acquiring lock 139627316623008 on /run/cephadm/d3450b00-ee8e-11ee-b647-cb9ed24678a4.lock 2024-03-30T12:13:21.416 INFO:teuthology.orchestra.run.smithi084.stdout:Lock 139627316623008 acquired on /run/cephadm/d3450b00-ee8e-11ee-b647-cb9ed24678a4.lock 2024-03-30T12:13:21.416 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying IP 172.21.15.84 port 3300 ... 2024-03-30T12:13:21.416 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying IP 172.21.15.84 port 6789 ... 2024-03-30T12:13:21.416 INFO:teuthology.orchestra.run.smithi084.stdout:Base mon IP(s) is [172.21.15.84:3300, 172.21.15.84:6789], mon addrv is [v2:172.21.15.84:3300,v1:172.21.15.84:6789] 2024-03-30T12:13:21.419 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.84 metric 100 2024-03-30T12:13:21.419 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.84 metric 100 2024-03-30T12:13:21.422 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-03-30T12:13:21.422 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-03-30T12:13:21.422 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1716sec hoplimit 64 pref medium 2024-03-30T12:13:21.424 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-03-30T12:13:21.424 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-03-30T12:13:21.424 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-30T12:13:21.424 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-03-30T12:13:21.424 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2024-03-30T12:13:21.424 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-30T12:13:21.425 INFO:teuthology.orchestra.run.smithi084.stdout:Mon IP `172.21.15.84` is in CIDR network `172.21.0.0/20` 2024-03-30T12:13:21.425 INFO:teuthology.orchestra.run.smithi084.stdout:Mon IP `172.21.15.84` is in CIDR network `172.21.0.0/20` 2024-03-30T12:13:21.425 INFO:teuthology.orchestra.run.smithi084.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-03-30T12:13:21.425 INFO:teuthology.orchestra.run.smithi084.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-03-30T12:13:21.426 INFO:teuthology.orchestra.run.smithi084.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-03-30T12:13:21.889 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stdout c8fb09e16a7d204ddf8070b46841183d802f7121fa7d3b7679ce8e4cb9cfc075 2024-03-30T12:13:21.890 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:reef... 2024-03-30T12:13:21.890 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Getting image source signatures 2024-03-30T12:13:21.890 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Copying blob sha256:228c1fe291c58f08797b1ee4e58f50fae6b85456a61679ed6baca81a75880b6f 2024-03-30T12:13:21.890 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Copying blob sha256:11da15500eca1f826c328eb3265caa30b0a3730510e2a32023084d6fe9cee20c 2024-03-30T12:13:21.890 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Copying config sha256:c8fb09e16a7d204ddf8070b46841183d802f7121fa7d3b7679ce8e4cb9cfc075 2024-03-30T12:13:21.890 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Writing manifest to image destination 2024-03-30T12:13:22.819 INFO:teuthology.orchestra.run.smithi084.stdout:ceph: stdout ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable) 2024-03-30T12:13:22.820 INFO:teuthology.orchestra.run.smithi084.stdout:Ceph version: ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable) 2024-03-30T12:13:22.820 INFO:teuthology.orchestra.run.smithi084.stdout:Extracting ceph user uid/gid from container image... 2024-03-30T12:13:23.799 INFO:teuthology.orchestra.run.smithi084.stdout:stat: stdout 167 167 2024-03-30T12:13:23.799 INFO:teuthology.orchestra.run.smithi084.stdout:Creating initial keys... 2024-03-30T12:13:24.721 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph-authtool: stdout AQDkAQhm78j2CBAA12FGo74/0b37Dz8WyWigEQ== 2024-03-30T12:13:25.593 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph-authtool: stdout AQDlAQhm8M7cAxAA9nv1rkOWWHUyE5MMj2xS/A== 2024-03-30T12:13:26.457 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph-authtool: stdout AQDlAQhmxONBOBAAiUvo4eadpXIYAHykjUALJw== 2024-03-30T12:13:26.457 INFO:teuthology.orchestra.run.smithi084.stdout:Creating initial monmap... 2024-03-30T12:13:27.380 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-30T12:13:27.380 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-03-30T12:13:27.380 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:13:27.380 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-30T12:13:27.380 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool for a [v2:172.21.15.84:3300,v1:172.21.15.84:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-30T12:13:27.380 INFO:teuthology.orchestra.run.smithi084.stdout:setting min_mon_release = pacific 2024-03-30T12:13:27.380 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: set fsid to d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:13:27.380 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-30T12:13:27.380 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:13:27.380 INFO:teuthology.orchestra.run.smithi084.stdout:Creating mon... 2024-03-30T12:13:36.024 INFO:teuthology.orchestra.run.smithi084.stdout:create mon.a on 2024-03-30T12:13:36.527 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-03-30T12:13:36.865 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-03-30T12:13:37.055 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4.target → /etc/systemd/system/ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4.target. 2024-03-30T12:13:37.057 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4.target → /etc/systemd/system/ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4.target. 2024-03-30T12:13:37.280 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mon.a 2024-03-30T12:13:37.280 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mon.a.service: Unit ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mon.a.service not loaded. 2024-03-30T12:13:37.434 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4.target.wants/ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mon.a.service → /etc/systemd/system/ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@.service. 2024-03-30T12:13:38.034 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-30T12:13:38.035 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout disabled 2024-03-30T12:13:38.041 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-30T12:13:38.041 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-03-30T12:13:38.041 INFO:teuthology.orchestra.run.smithi084.stdout:firewalld.service is not enabled 2024-03-30T12:13:38.041 INFO:teuthology.orchestra.run.smithi084.stdout:Not possible to enable service . firewalld.service is not available 2024-03-30T12:13:38.042 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mon to start... 2024-03-30T12:13:38.042 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mon... 2024-03-30T12:13:39.127 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:38 smithi084 ceph-mon[26628]: from='client.? 172.21.15.84:0/1558462190' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-30T12:13:39.131 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout cluster: 2024-03-30T12:13:39.131 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout id: d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:13:39.131 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-03-30T12:13:39.131 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-03-30T12:13:39.131 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout services: 2024-03-30T12:13:39.131 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.592238s) 2024-03-30T12:13:39.131 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-03-30T12:13:39.132 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-03-30T12:13:39.132 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-03-30T12:13:39.132 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout data: 2024-03-30T12:13:39.132 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-03-30T12:13:39.132 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-03-30T12:13:39.132 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-03-30T12:13:39.132 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout pgs: 2024-03-30T12:13:39.132 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-03-30T12:13:39.132 INFO:teuthology.orchestra.run.smithi084.stdout:mon is available 2024-03-30T12:13:39.132 INFO:teuthology.orchestra.run.smithi084.stdout:Assimilating anything we can from ceph.conf... 2024-03-30T12:13:40.127 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-03-30T12:13:40.129 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [global] 2024-03-30T12:13:40.129 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout fsid = d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:13:40.129 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.84:3300,v1:172.21.15.84:6789] 2024-03-30T12:13:40.129 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-30T12:13:40.129 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-30T12:13:40.129 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-30T12:13:40.129 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-30T12:13:40.129 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-03-30T12:13:40.129 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-30T12:13:40.129 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-30T12:13:40.129 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-03-30T12:13:40.129 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [osd] 2024-03-30T12:13:40.130 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-30T12:13:40.130 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-30T12:13:40.130 INFO:teuthology.orchestra.run.smithi084.stdout:Generating new minimal ceph.conf... 2024-03-30T12:13:40.249 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:39 smithi084 ceph-mon[26628]: from='client.? 172.21.15.84:0/2846694434' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-30T12:13:40.249 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:39 smithi084 ceph-mon[26628]: from='client.? 172.21.15.84:0/2846694434' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-03-30T12:13:41.172 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:40 smithi084 ceph-mon[26628]: from='client.? 172.21.15.84:0/1197141377' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:13:41.175 INFO:teuthology.orchestra.run.smithi084.stdout:Restarting the monitor... 2024-03-30T12:13:41.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:41 smithi084 systemd[1]: Stopping Ceph mon.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:13:41.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[26624]: 2024-03-30T12:13:41.433+0000 7f8a05a45700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:13:41.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[26624]: 2024-03-30T12:13:41.433+0000 7f8a05a45700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-03-30T12:13:41.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:41 smithi084 podman[26871]: 2024-03-30 12:13:41.64846654 +0000 UTC m=+0.307920071 container died 851d7ff264650747ee4302d02c2ac4e2d8dd88359bf09244006977370dca6f0b (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=reef-f14b568, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326) 2024-03-30T12:13:43.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:43 smithi084 podman[26871]: 2024-03-30 12:13:43.283589909 +0000 UTC m=+1.943043438 container cleanup 851d7ff264650747ee4302d02c2ac4e2d8dd88359bf09244006977370dca6f0b (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240326, RELEASE=reef-f14b568, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:13:43.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:43 smithi084 bash[26871]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a 2024-03-30T12:13:44.462 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 podman[26886]: 2024-03-30 12:13:44.058737278 +0000 UTC m=+2.410796149 container remove 851d7ff264650747ee4302d02c2ac4e2d8dd88359bf09244006977370dca6f0b (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=reef-f14b568, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T12:13:44.463 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mon.a.service: Deactivated successfully. 2024-03-30T12:13:44.463 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 systemd[1]: Stopped Ceph mon.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:13:44.463 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 systemd[1]: Starting Ceph mon.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:13:44.737 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 podman[26981]: 2024-03-30 12:13:44.373852381 +0000 UTC m=+0.018336815 image pull c8fb09e16a7d204ddf8070b46841183d802f7121fa7d3b7679ce8e4cb9cfc075 quay.ceph.io/ceph-ci/ceph:reef 2024-03-30T12:13:44.737 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 podman[26981]: 2024-03-30 12:13:44.501020319 +0000 UTC m=+0.145504740 container create 915abc0d6de7e577785ce0af684cbd8c35fe1ef5e1b6b6f947de7f77b234e687 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_CLEAN=True, RELEASE=reef-f14b568, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-03-30T12:13:44.737 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 podman[26981]: 2024-03-30 12:13:44.745571736 +0000 UTC m=+0.390056160 container init 915abc0d6de7e577785ce0af684cbd8c35fe1ef5e1b6b6f947de7f77b234e687 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-f14b568, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-03-30T12:13:44.807 INFO:teuthology.orchestra.run.smithi084.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-03-30T12:13:44.997 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 podman[26981]: 2024-03-30 12:13:44.74842746 +0000 UTC m=+0.392911884 container start 915abc0d6de7e577785ce0af684cbd8c35fe1ef5e1b6b6f947de7f77b234e687 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-f14b568, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-03-30T12:13:44.997 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: set uid:gid to 167:167 (ceph:ceph) 2024-03-30T12:13:44.997 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable), process ceph-mon, pid 2 2024-03-30T12:13:44.997 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: pidfile_write: ignore empty --pid-file 2024-03-30T12:13:44.997 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: load: jerasure load: lrc 2024-03-30T12:13:44.997 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: RocksDB version: 7.9.2 2024-03-30T12:13:44.997 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Git sha 0 2024-03-30T12:13:44.998 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Compile date 2024-03-29 20:23:56 2024-03-30T12:13:44.998 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: DB SUMMARY 2024-03-30T12:13:44.998 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: DB Session ID: 4O543MFE67YQLM3S6E3V 2024-03-30T12:13:44.998 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: CURRENT file: CURRENT 2024-03-30T12:13:44.998 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: IDENTITY file: IDENTITY 2024-03-30T12:13:44.998 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-03-30T12:13:44.998 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-03-30T12:13:44.998 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 84536 ; 2024-03-30T12:13:44.998 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.error_if_exists: 0 2024-03-30T12:13:44.998 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.create_if_missing: 0 2024-03-30T12:13:44.998 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.paranoid_checks: 1 2024-03-30T12:13:44.999 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-30T12:13:44.999 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-30T12:13:44.999 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-30T12:13:44.999 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.env: 0x55cc01ce6720 2024-03-30T12:13:44.999 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.fs: PosixFileSystem 2024-03-30T12:13:44.999 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.info_log: 0x55cc03d654e0 2024-03-30T12:13:44.999 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_file_opening_threads: 16 2024-03-30T12:13:44.999 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.statistics: (nil) 2024-03-30T12:13:44.999 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.use_fsync: 0 2024-03-30T12:13:44.999 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_log_file_size: 0 2024-03-30T12:13:44.999 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-30T12:13:44.999 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-30T12:13:44.999 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.keep_log_file_num: 1000 2024-03-30T12:13:44.999 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.recycle_log_file_num: 0 2024-03-30T12:13:45.000 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.allow_fallocate: 1 2024-03-30T12:13:45.000 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.allow_mmap_reads: 0 2024-03-30T12:13:45.001 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.allow_mmap_writes: 0 2024-03-30T12:13:45.001 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.use_direct_reads: 0 2024-03-30T12:13:45.001 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-30T12:13:45.001 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.create_missing_column_families: 0 2024-03-30T12:13:45.001 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.db_log_dir: 2024-03-30T12:13:45.001 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.wal_dir: 2024-03-30T12:13:45.002 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-30T12:13:45.002 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-30T12:13:45.002 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-30T12:13:45.002 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-30T12:13:45.002 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-30T12:13:45.002 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-30T12:13:45.002 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.advise_random_on_open: 1 2024-03-30T12:13:45.002 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.db_write_buffer_size: 0 2024-03-30T12:13:45.002 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.write_buffer_manager: 0x55cc02fdc140 2024-03-30T12:13:45.002 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-30T12:13:45.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-30T12:13:45.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-30T12:13:45.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.rate_limiter: (nil) 2024-03-30T12:13:45.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-30T12:13:45.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.wal_recovery_mode: 2 2024-03-30T12:13:45.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.enable_thread_tracking: 0 2024-03-30T12:13:45.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.enable_pipelined_write: 0 2024-03-30T12:13:45.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.unordered_write: 0 2024-03-30T12:13:45.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-30T12:13:45.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-30T12:13:45.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-30T12:13:45.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-30T12:13:45.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.row_cache: None 2024-03-30T12:13:45.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.wal_filter: None 2024-03-30T12:13:45.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-30T12:13:45.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.allow_ingest_behind: 0 2024-03-30T12:13:45.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.two_write_queues: 0 2024-03-30T12:13:45.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.manual_wal_flush: 0 2024-03-30T12:13:45.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.wal_compression: 0 2024-03-30T12:13:45.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.atomic_flush: 0 2024-03-30T12:13:45.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-30T12:13:45.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-30T12:13:45.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-30T12:13:45.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.log_readahead_size: 0 2024-03-30T12:13:45.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-30T12:13:45.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.best_efforts_recovery: 0 2024-03-30T12:13:45.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-30T12:13:45.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-30T12:13:45.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.allow_data_in_errors: 0 2024-03-30T12:13:45.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.db_host_id: __hostname__ 2024-03-30T12:13:45.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-30T12:13:45.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_background_jobs: 2 2024-03-30T12:13:45.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_background_compactions: -1 2024-03-30T12:13:45.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_subcompactions: 1 2024-03-30T12:13:45.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-30T12:13:45.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-30T12:13:45.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-30T12:13:45.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_total_wal_size: 0 2024-03-30T12:13:45.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-30T12:13:45.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-30T12:13:45.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-30T12:13:45.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-30T12:13:45.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_open_files: -1 2024-03-30T12:13:45.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.bytes_per_sync: 0 2024-03-30T12:13:45.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-30T12:13:45.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-30T12:13:45.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.compaction_readahead_size: 0 2024-03-30T12:13:45.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_background_flushes: -1 2024-03-30T12:13:45.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Compression algorithms supported: 2024-03-30T12:13:45.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-30T12:13:45.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: kZSTD supported: 0 2024-03-30T12:13:45.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: kXpressCompression supported: 0 2024-03-30T12:13:45.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: kLZ4HCCompression supported: 1 2024-03-30T12:13:45.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: kZlibCompression supported: 1 2024-03-30T12:13:45.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: kSnappyCompression supported: 1 2024-03-30T12:13:45.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: kLZ4Compression supported: 1 2024-03-30T12:13:45.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: kBZip2Compression supported: 0 2024-03-30T12:13:45.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-30T12:13:45.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-30T12:13:45.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-03-30T12:13:45.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-30T12:13:45.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-30T12:13:45.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.merge_operator: 2024-03-30T12:13:45.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.compaction_filter: None 2024-03-30T12:13:45.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.compaction_filter_factory: None 2024-03-30T12:13:45.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.sst_partitioner_factory: None 2024-03-30T12:13:45.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-30T12:13:45.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-30T12:13:45.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55cc03d655e0) 2024-03-30T12:13:45.008 INFO:journalctl@ceph.mon.a.smithi084.stdout: cache_index_and_filter_blocks: 1 2024-03-30T12:13:45.008 INFO:journalctl@ceph.mon.a.smithi084.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-30T12:13:45.008 INFO:journalctl@ceph.mon.a.smithi084.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-30T12:13:45.008 INFO:journalctl@ceph.mon.a.smithi084.stdout: pin_top_level_index_and_filter: 1 2024-03-30T12:13:45.008 INFO:journalctl@ceph.mon.a.smithi084.stdout: index_type: 0 2024-03-30T12:13:45.008 INFO:journalctl@ceph.mon.a.smithi084.stdout: data_block_index_type: 0 2024-03-30T12:13:45.009 INFO:journalctl@ceph.mon.a.smithi084.stdout: index_shortening: 1 2024-03-30T12:13:45.009 INFO:journalctl@ceph.mon.a.smithi084.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-30T12:13:45.009 INFO:journalctl@ceph.mon.a.smithi084.stdout: checksum: 4 2024-03-30T12:13:45.009 INFO:journalctl@ceph.mon.a.smithi084.stdout: no_block_cache: 0 2024-03-30T12:13:45.009 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache: 0x55cc0307d1f0 2024-03-30T12:13:45.009 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache_name: BinnedLRUCache 2024-03-30T12:13:45.009 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache_options: 2024-03-30T12:13:45.009 INFO:journalctl@ceph.mon.a.smithi084.stdout: capacity : 536870912 2024-03-30T12:13:45.009 INFO:journalctl@ceph.mon.a.smithi084.stdout: num_shard_bits : 4 2024-03-30T12:13:45.009 INFO:journalctl@ceph.mon.a.smithi084.stdout: strict_capacity_limit : 0 2024-03-30T12:13:45.009 INFO:journalctl@ceph.mon.a.smithi084.stdout: high_pri_pool_ratio: 0.000 2024-03-30T12:13:45.009 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache_compressed: (nil) 2024-03-30T12:13:45.009 INFO:journalctl@ceph.mon.a.smithi084.stdout: persistent_cache: (nil) 2024-03-30T12:13:45.009 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_size: 4096 2024-03-30T12:13:45.009 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_size_deviation: 10 2024-03-30T12:13:45.010 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_restart_interval: 16 2024-03-30T12:13:45.010 INFO:journalctl@ceph.mon.a.smithi084.stdout: index_block_restart_interval: 1 2024-03-30T12:13:45.010 INFO:journalctl@ceph.mon.a.smithi084.stdout: metadata_block_size: 4096 2024-03-30T12:13:45.010 INFO:journalctl@ceph.mon.a.smithi084.stdout: partition_filters: 0 2024-03-30T12:13:45.010 INFO:journalctl@ceph.mon.a.smithi084.stdout: use_delta_encoding: 1 2024-03-30T12:13:45.010 INFO:journalctl@ceph.mon.a.smithi084.stdout: filter_policy: bloomfilter 2024-03-30T12:13:45.010 INFO:journalctl@ceph.mon.a.smithi084.stdout: whole_key_filtering: 1 2024-03-30T12:13:45.010 INFO:journalctl@ceph.mon.a.smithi084.stdout: verify_compression: 0 2024-03-30T12:13:45.010 INFO:journalctl@ceph.mon.a.smithi084.stdout: read_amp_bytes_per_bit: 0 2024-03-30T12:13:45.010 INFO:journalctl@ceph.mon.a.smithi084.stdout: format_version: 5 2024-03-30T12:13:45.010 INFO:journalctl@ceph.mon.a.smithi084.stdout: enable_index_compression: 1 2024-03-30T12:13:45.010 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_align: 0 2024-03-30T12:13:45.010 INFO:journalctl@ceph.mon.a.smithi084.stdout: max_auto_readahead_size: 262144 2024-03-30T12:13:45.010 INFO:journalctl@ceph.mon.a.smithi084.stdout: prepopulate_block_cache: 0 2024-03-30T12:13:45.011 INFO:journalctl@ceph.mon.a.smithi084.stdout: initial_auto_readahead_size: 8192 2024-03-30T12:13:45.011 INFO:journalctl@ceph.mon.a.smithi084.stdout: num_file_reads_for_auto_readahead: 2 2024-03-30T12:13:45.011 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.write_buffer_size: 33554432 2024-03-30T12:13:45.011 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_write_buffer_number: 2 2024-03-30T12:13:45.011 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.compression: NoCompression 2024-03-30T12:13:45.011 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.bottommost_compression: Disabled 2024-03-30T12:13:45.011 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.prefix_extractor: nullptr 2024-03-30T12:13:45.011 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-30T12:13:45.011 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.num_levels: 7 2024-03-30T12:13:45.011 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-30T12:13:45.011 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-30T12:13:45.011 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-30T12:13:45.011 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-30T12:13:45.011 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-30T12:13:45.011 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-30T12:13:45.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-30T12:13:45.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-30T12:13:45.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-30T12:13:45.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-30T12:13:45.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-30T12:13:45.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-30T12:13:45.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-30T12:13:45.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.compression_opts.level: 32767 2024-03-30T12:13:45.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.compression_opts.strategy: 0 2024-03-30T12:13:45.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-30T12:13:45.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-30T12:13:45.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-30T12:13:45.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-30T12:13:45.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.compression_opts.enabled: false 2024-03-30T12:13:45.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-30T12:13:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-30T12:13:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-30T12:13:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-30T12:13:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.target_file_size_base: 67108864 2024-03-30T12:13:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-30T12:13:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-30T12:13:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-30T12:13:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-30T12:13:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-30T12:13:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-30T12:13:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-30T12:13:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-30T12:13:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-30T12:13:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-30T12:13:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-30T12:13:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-30T12:13:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-30T12:13:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-30T12:13:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.arena_block_size: 1048576 2024-03-30T12:13:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-30T12:13:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-30T12:13:45.015 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.disable_auto_compactions: 0 2024-03-30T12:13:45.015 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-30T12:13:45.015 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-30T12:13:45.015 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-30T12:13:45.015 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-30T12:13:45.015 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-30T12:13:45.015 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-30T12:13:45.015 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-30T12:13:45.015 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-30T12:13:45.015 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-30T12:13:45.015 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-30T12:13:45.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.table_properties_collectors: 2024-03-30T12:13:45.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.inplace_update_support: 0 2024-03-30T12:13:45.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-30T12:13:45.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-30T12:13:45.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-30T12:13:45.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-30T12:13:45.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.bloom_locality: 0 2024-03-30T12:13:45.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.max_successive_merges: 0 2024-03-30T12:13:45.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-30T12:13:45.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.paranoid_file_checks: 0 2024-03-30T12:13:45.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.force_consistency_checks: 1 2024-03-30T12:13:45.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.report_bg_io_stats: 0 2024-03-30T12:13:45.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.ttl: 2592000 2024-03-30T12:13:45.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-30T12:13:45.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-30T12:13:45.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-30T12:13:45.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.enable_blob_files: false 2024-03-30T12:13:45.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.min_blob_size: 0 2024-03-30T12:13:45.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.blob_file_size: 268435456 2024-03-30T12:13:45.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-30T12:13:45.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-30T12:13:45.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-30T12:13:45.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-30T12:13:45.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-30T12:13:45.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.blob_file_starting_level: 0 2024-03-30T12:13:45.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-30T12:13:45.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-03-30T12:13:45.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-03-30T12:13:45.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: fe707cb2-6db3-42ad-9851-ba2c5cd8c227 2024-03-30T12:13:45.018 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711800824777531, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-03-30T12:13:45.018 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-03-30T12:13:45.018 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711800824778387, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 81060, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 256, "table_properties": {"data_size": 79236, "index_size": 234, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10267, "raw_average_key_size": 47, "raw_value_size": 73437, "raw_average_value_size": 341, "num_data_blocks": 10, "num_entries": 215, "num_filter_entries": 215, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711800824, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "fe707cb2-6db3-42ad-9851-ba2c5cd8c227", "db_session_id": "4O543MFE67YQLM3S6E3V", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-03-30T12:13:45.018 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711800824778467, "job": 1, "event": "recovery_finished"} 2024-03-30T12:13:45.018 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-03-30T12:13:45.018 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-30T12:13:45.018 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55cc0311a000 2024-03-30T12:13:45.018 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: DB pointer 0x55cc03108000 2024-03-30T12:13:45.018 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-30T12:13:45.018 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-30T12:13:45.018 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** DB Stats ** 2024-03-30T12:13:45.018 INFO:journalctl@ceph.mon.a.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T12:13:45.019 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-30T12:13:45.019 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T12:13:45.019 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T12:13:45.020 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-30T12:13:45.020 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T12:13:45.020 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T12:13:45.020 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-03-30T12:13:45.020 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** Compaction Stats [default] ** 2024-03-30T12:13:45.020 INFO:journalctl@ceph.mon.a.smithi084.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T12:13:45.020 INFO:journalctl@ceph.mon.a.smithi084.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-30T12:13:45.020 INFO:journalctl@ceph.mon.a.smithi084.stdout: L0 2/0 81.00 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-30T12:13:45.020 INFO:journalctl@ceph.mon.a.smithi084.stdout: Sum 2/0 81.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-30T12:13:45.020 INFO:journalctl@ceph.mon.a.smithi084.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-30T12:13:45.020 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-03-30T12:13:45.020 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** Compaction Stats [default] ** 2024-03-30T12:13:45.020 INFO:journalctl@ceph.mon.a.smithi084.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T12:13:45.020 INFO:journalctl@ceph.mon.a.smithi084.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-30T12:13:45.021 INFO:journalctl@ceph.mon.a.smithi084.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 144.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-30T12:13:45.021 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-03-30T12:13:45.021 INFO:journalctl@ceph.mon.a.smithi084.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-30T12:13:45.021 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-03-30T12:13:45.021 INFO:journalctl@ceph.mon.a.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T12:13:45.021 INFO:journalctl@ceph.mon.a.smithi084.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-30T12:13:45.021 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-30T12:13:45.021 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-30T12:13:45.021 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-30T12:13:45.021 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-30T12:13:45.021 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative compaction: 0.00 GB write, 27.16 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T12:13:45.021 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval compaction: 0.00 GB write, 27.16 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T12:13:45.021 INFO:journalctl@ceph.mon.a.smithi084.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-30T12:13:45.021 INFO:journalctl@ceph.mon.a.smithi084.stdout: Block cache BinnedLRUCache@0x55cc0307d1f0#2 capacity: 512.00 MB usage: 1.19 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-03-30T12:13:45.022 INFO:journalctl@ceph.mon.a.smithi084.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.42 KB,8.04663e-05%) Misc(1,0.00 KB,0%) 2024-03-30T12:13:45.022 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-03-30T12:13:45.022 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-30T12:13:45.022 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: starting mon.a rank 0 at public addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] at bind addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:13:45.022 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: mon.a@-1(???) e1 preinit fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:13:45.022 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: mon.a@-1(???).mds e1 new map 2024-03-30T12:13:45.022 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: mon.a@-1(???).mds e1 print_map 2024-03-30T12:13:45.022 INFO:journalctl@ceph.mon.a.smithi084.stdout: e1 2024-03-30T12:13:45.022 INFO:journalctl@ceph.mon.a.smithi084.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-30T12:13:45.022 INFO:journalctl@ceph.mon.a.smithi084.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-30T12:13:45.022 INFO:journalctl@ceph.mon.a.smithi084.stdout: legacy client fscid: -1 2024-03-30T12:13:45.022 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-03-30T12:13:45.022 INFO:journalctl@ceph.mon.a.smithi084.stdout: No filesystems configured 2024-03-30T12:13:45.022 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-30T12:13:45.023 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-30T12:13:45.023 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-30T12:13:45.023 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-30T12:13:45.023 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-03-30T12:13:45.023 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 bash[26981]: 915abc0d6de7e577785ce0af684cbd8c35fe1ef5e1b6b6f947de7f77b234e687 2024-03-30T12:13:45.023 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 systemd[1]: Started Ceph mon.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:13:45.023 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: mon.a is new leader, mons a in quorum (ranks 0) 2024-03-30T12:13:45.023 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: monmap e1: 1 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-30T12:13:45.023 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: fsmap 2024-03-30T12:13:45.023 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: osdmap e1: 0 total, 0 up, 0 in 2024-03-30T12:13:45.023 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:44 smithi084 ceph-mon[27000]: mgrmap e1: no daemons active 2024-03-30T12:13:45.786 INFO:teuthology.orchestra.run.smithi084.stdout:Wrote config to /etc/ceph/ceph.conf 2024-03-30T12:13:45.808 INFO:teuthology.orchestra.run.smithi084.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-03-30T12:13:45.809 INFO:teuthology.orchestra.run.smithi084.stdout:Creating mgr... 2024-03-30T12:13:45.809 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying port 0.0.0.0:9283 ... 2024-03-30T12:13:45.809 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying port 0.0.0.0:8765 ... 2024-03-30T12:13:46.039 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mgr.y 2024-03-30T12:13:46.039 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mgr.y.service: Unit ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mgr.y.service not loaded. 2024-03-30T12:13:46.182 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4.target.wants/ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mgr.y.service → /etc/systemd/system/ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@.service. 2024-03-30T12:13:46.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:46 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/1912469464' entity='client.admin' 2024-03-30T12:13:46.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:46 smithi084 podman[27215]: 2024-03-30 12:13:46.326862343 +0000 UTC m=+0.017398622 image pull c8fb09e16a7d204ddf8070b46841183d802f7121fa7d3b7679ce8e4cb9cfc075 quay.ceph.io/ceph-ci/ceph:reef 2024-03-30T12:13:46.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:46 smithi084 podman[27215]: 2024-03-30 12:13:46.511158491 +0000 UTC m=+0.201694750 container create 000810f2a0de0642a92a7b94ddbccd245d88a009173afdd4d28ed4fabc073112 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=reef-f14b568, GIT_CLEAN=True, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-03-30T12:13:47.096 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-30T12:13:47.096 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout disabled 2024-03-30T12:13:47.104 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-30T12:13:47.104 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-03-30T12:13:47.104 INFO:teuthology.orchestra.run.smithi084.stdout:firewalld.service is not enabled 2024-03-30T12:13:47.104 INFO:teuthology.orchestra.run.smithi084.stdout:Not possible to enable service . firewalld.service is not available 2024-03-30T12:13:47.112 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-30T12:13:47.112 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout disabled 2024-03-30T12:13:47.119 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-30T12:13:47.119 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-03-30T12:13:47.119 INFO:teuthology.orchestra.run.smithi084.stdout:firewalld.service is not enabled 2024-03-30T12:13:47.119 INFO:teuthology.orchestra.run.smithi084.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-03-30T12:13:47.119 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mgr to start... 2024-03-30T12:13:47.119 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mgr... 2024-03-30T12:13:47.239 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:47 smithi084 podman[27215]: 2024-03-30 12:13:47.005392924 +0000 UTC m=+0.695929193 container init 000810f2a0de0642a92a7b94ddbccd245d88a009173afdd4d28ed4fabc073112 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=reef-f14b568, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-03-30T12:13:47.239 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:47 smithi084 podman[27215]: 2024-03-30 12:13:47.008093082 +0000 UTC m=+0.698629339 container start 000810f2a0de0642a92a7b94ddbccd245d88a009173afdd4d28ed4fabc073112 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, RELEASE=reef-f14b568, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-03-30T12:13:47.240 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:47 smithi084 bash[27215]: 000810f2a0de0642a92a7b94ddbccd245d88a009173afdd4d28ed4fabc073112 2024-03-30T12:13:47.240 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:47 smithi084 systemd[1]: Started Ceph mgr.y for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:13:47.952 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:47 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/412055594' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-30T12:13:47.952 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:13:47.562+0000 7f16b25db200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T12:13:47.952 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:13:47.659+0000 7f16b25db200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T12:13:48.263 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-03-30T12:13:48.266 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-03-30T12:13:48.266 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsid": "d3450b00-ee8e-11ee-b647-cb9ed24678a4", 2024-03-30T12:13:48.266 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "health": { 2024-03-30T12:13:48.266 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-30T12:13:48.266 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-30T12:13:48.266 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-30T12:13:48.266 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:48.266 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-30T12:13:48.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-30T12:13:48.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 0 2024-03-30T12:13:48.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-03-30T12:13:48.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-30T12:13:48.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "a" 2024-03-30T12:13:48.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-03-30T12:13:48.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-03-30T12:13:48.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-30T12:13:48.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T12:13:48.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-03-30T12:13:48.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-30T12:13:48.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:48.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-30T12:13:48.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T12:13:48.267 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-30T12:13:48.268 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-30T12:13:48.268 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-30T12:13:48.268 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-30T12:13:48.271 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-30T12:13:48.272 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-30T12:13:48.272 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:48.272 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-30T12:13:48.272 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-30T12:13:48.272 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-30T12:13:48.272 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-30T12:13:48.272 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-30T12:13:48.272 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-30T12:13:48.272 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-30T12:13:48.272 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-30T12:13:48.272 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-30T12:13:48.272 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:48.272 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-30T12:13:48.272 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T12:13:48.273 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-30T12:13:48.273 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-30T12:13:48.273 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:48.273 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-30T12:13:48.273 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-30T12:13:48.273 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-30T12:13:48.273 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-30T12:13:48.273 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-30T12:13:48.273 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-30T12:13:48.274 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "restful" 2024-03-30T12:13:48.274 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-03-30T12:13:48.274 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-30T12:13:48.274 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:48.274 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-30T12:13:48.274 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T12:13:48.274 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modified": "2024-03-30T12:13:37.957250+0000", 2024-03-30T12:13:48.274 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-30T12:13:48.274 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:48.274 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-30T12:13:48.275 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-03-30T12:13:48.275 INFO:teuthology.orchestra.run.smithi084.stdout:mgr not available, waiting (1/15)... 2024-03-30T12:13:48.527 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:13:48.304+0000 7f16b25db200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T12:13:48.527 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:13:48.395+0000 7f16b25db200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T12:13:48.527 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:13:48.534+0000 7f16b25db200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T12:13:48.942 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:13:48.627+0000 7f16b25db200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T12:13:48.942 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:13:48.710+0000 7f16b25db200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T12:13:49.254 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:13:48.981+0000 7f16b25db200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T12:13:49.254 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:13:49.096+0000 7f16b25db200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T12:13:49.254 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:13:49.185+0000 7f16b25db200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T12:13:49.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:13:49.281+0000 7f16b25db200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T12:13:49.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:13:49.462+0000 7f16b25db200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T12:13:50.708 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:13:50.436+0000 7f16b25db200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T12:13:50.708 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:13:50.572+0000 7f16b25db200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T12:13:50.995 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:50 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3359655339' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-30T12:13:50.996 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:13:50.912+0000 7f16b25db200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T12:13:50.996 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:13:51.003+0000 7f16b25db200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T12:13:51.254 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:13:51.197+0000 7f16b25db200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:13:51.288 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-03-30T12:13:51.288 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-03-30T12:13:51.288 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsid": "d3450b00-ee8e-11ee-b647-cb9ed24678a4", 2024-03-30T12:13:51.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "health": { 2024-03-30T12:13:51.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-30T12:13:51.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-30T12:13:51.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-30T12:13:51.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:51.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-30T12:13:51.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-30T12:13:51.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 0 2024-03-30T12:13:51.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-03-30T12:13:51.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-30T12:13:51.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "a" 2024-03-30T12:13:51.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-03-30T12:13:51.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-03-30T12:13:51.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-30T12:13:51.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T12:13:51.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-03-30T12:13:51.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-30T12:13:51.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:51.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-30T12:13:51.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T12:13:51.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-30T12:13:51.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-30T12:13:51.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-30T12:13:51.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-30T12:13:51.294 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-30T12:13:51.294 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-30T12:13:51.294 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:51.294 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-30T12:13:51.294 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-30T12:13:51.294 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-30T12:13:51.294 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-30T12:13:51.295 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-30T12:13:51.295 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-30T12:13:51.295 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-30T12:13:51.295 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-30T12:13:51.295 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-30T12:13:51.295 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:51.295 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-30T12:13:51.295 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T12:13:51.295 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-30T12:13:51.295 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-30T12:13:51.295 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:51.295 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-30T12:13:51.295 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-30T12:13:51.295 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-30T12:13:51.296 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-30T12:13:51.296 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-30T12:13:51.296 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-30T12:13:51.296 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "restful" 2024-03-30T12:13:51.296 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-03-30T12:13:51.296 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-30T12:13:51.296 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:51.296 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-30T12:13:51.296 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T12:13:51.296 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modified": "2024-03-30T12:13:37.957250+0000", 2024-03-30T12:13:51.296 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-30T12:13:51.296 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:51.296 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-30T12:13:51.296 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-03-30T12:13:51.296 INFO:teuthology.orchestra.run.smithi084.stdout:mgr not available, waiting (2/15)... 2024-03-30T12:13:51.653 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:13:51.381+0000 7f16b25db200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T12:13:51.908 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:13:51.660+0000 7f16b25db200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:13:51.909 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:13:51.916+0000 7f16b25db200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T12:13:52.254 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:13:52.146+0000 7f16b25db200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T12:13:53.254 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:13:52.936+0000 7f16b25db200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T12:13:53.714 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:13:53.510+0000 7f16b25db200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T12:13:53.714 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:13:53.607+0000 7f16b25db200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T12:13:54.004 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:13:53.830+0000 7f16b25db200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T12:13:54.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:53 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/2329133386' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-30T12:13:54.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:53 smithi084 ceph-mon[27000]: Activating manager daemon y 2024-03-30T12:13:54.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:53 smithi084 ceph-mon[27000]: mgrmap e2: y(active, starting, since 0.00326968s) 2024-03-30T12:13:54.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:53 smithi084 ceph-mon[27000]: from='mgr.14100 172.21.15.84:0/120073004' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T12:13:54.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:53 smithi084 ceph-mon[27000]: from='mgr.14100 172.21.15.84:0/120073004' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T12:13:54.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:53 smithi084 ceph-mon[27000]: from='mgr.14100 172.21.15.84:0/120073004' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T12:13:54.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:53 smithi084 ceph-mon[27000]: from='mgr.14100 172.21.15.84:0/120073004' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:13:54.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:53 smithi084 ceph-mon[27000]: from='mgr.14100 172.21.15.84:0/120073004' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T12:13:54.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:53 smithi084 ceph-mon[27000]: Manager daemon y is now available 2024-03-30T12:13:54.269 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-03-30T12:13:54.269 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-03-30T12:13:54.269 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsid": "d3450b00-ee8e-11ee-b647-cb9ed24678a4", 2024-03-30T12:13:54.269 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "health": { 2024-03-30T12:13:54.269 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-30T12:13:54.269 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-30T12:13:54.269 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-30T12:13:54.269 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:54.269 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-30T12:13:54.269 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-30T12:13:54.269 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 0 2024-03-30T12:13:54.270 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-03-30T12:13:54.270 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-30T12:13:54.270 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "a" 2024-03-30T12:13:54.270 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-03-30T12:13:54.270 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-03-30T12:13:54.270 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-30T12:13:54.270 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T12:13:54.270 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-03-30T12:13:54.270 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-30T12:13:54.270 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:54.270 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-30T12:13:54.270 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T12:13:54.270 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-30T12:13:54.270 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-30T12:13:54.271 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-30T12:13:54.274 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-30T12:13:54.274 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-30T12:13:54.274 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-30T12:13:54.274 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:54.274 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-30T12:13:54.275 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-30T12:13:54.275 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-30T12:13:54.275 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-30T12:13:54.275 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-30T12:13:54.275 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-30T12:13:54.275 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-30T12:13:54.275 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-30T12:13:54.275 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-30T12:13:54.275 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:54.275 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-30T12:13:54.275 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T12:13:54.275 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-30T12:13:54.275 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-30T12:13:54.275 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:54.275 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-30T12:13:54.276 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-30T12:13:54.276 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-30T12:13:54.276 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-30T12:13:54.276 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-30T12:13:54.276 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-30T12:13:54.276 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "restful" 2024-03-30T12:13:54.276 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-03-30T12:13:54.276 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-30T12:13:54.276 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:54.276 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-30T12:13:54.276 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T12:13:54.276 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modified": "2024-03-30T12:13:37.957250+0000", 2024-03-30T12:13:54.276 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-30T12:13:54.276 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:54.276 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-30T12:13:54.277 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-03-30T12:13:54.277 INFO:teuthology.orchestra.run.smithi084.stdout:mgr not available, waiting (3/15)... 2024-03-30T12:13:55.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:54 smithi084 ceph-mon[27000]: from='mgr.14100 172.21.15.84:0/120073004' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T12:13:55.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:54 smithi084 ceph-mon[27000]: from='mgr.14100 172.21.15.84:0/120073004' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T12:13:55.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:54 smithi084 ceph-mon[27000]: from='mgr.14100 172.21.15.84:0/120073004' entity='mgr.y' 2024-03-30T12:13:55.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:54 smithi084 ceph-mon[27000]: from='mgr.14100 172.21.15.84:0/120073004' entity='mgr.y' 2024-03-30T12:13:55.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:54 smithi084 ceph-mon[27000]: from='mgr.14100 172.21.15.84:0/120073004' entity='mgr.y' 2024-03-30T12:13:55.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:54 smithi084 ceph-mon[27000]: mgrmap e3: y(active, since 1.00821s) 2024-03-30T12:13:56.983 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:56 smithi084 ceph-mon[27000]: mgrmap e4: y(active, since 2s) 2024-03-30T12:13:57.583 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-03-30T12:13:57.583 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-03-30T12:13:57.583 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsid": "d3450b00-ee8e-11ee-b647-cb9ed24678a4", 2024-03-30T12:13:57.583 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "health": { 2024-03-30T12:13:57.583 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-30T12:13:57.583 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-30T12:13:57.583 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-30T12:13:57.584 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:57.584 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-30T12:13:57.584 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-30T12:13:57.584 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 0 2024-03-30T12:13:57.584 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-03-30T12:13:57.584 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-30T12:13:57.584 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "a" 2024-03-30T12:13:57.584 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-03-30T12:13:57.584 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-03-30T12:13:57.584 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-30T12:13:57.584 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T12:13:57.584 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-03-30T12:13:57.584 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-30T12:13:57.584 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:57.584 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-30T12:13:57.585 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T12:13:57.585 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-30T12:13:57.585 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-30T12:13:57.585 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-30T12:13:57.588 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-30T12:13:57.588 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-30T12:13:57.588 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-30T12:13:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-30T12:13:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-30T12:13:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-30T12:13:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-30T12:13:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-30T12:13:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-30T12:13:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-30T12:13:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-30T12:13:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-30T12:13:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:57.589 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-30T12:13:57.590 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T12:13:57.590 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-30T12:13:57.590 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-30T12:13:57.590 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:57.590 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-30T12:13:57.590 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-30T12:13:57.590 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-30T12:13:57.590 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-30T12:13:57.590 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-30T12:13:57.590 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-30T12:13:57.590 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "restful" 2024-03-30T12:13:57.590 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-03-30T12:13:57.590 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-30T12:13:57.590 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:57.591 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-30T12:13:57.591 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T12:13:57.591 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modified": "2024-03-30T12:13:37.957250+0000", 2024-03-30T12:13:57.591 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-30T12:13:57.591 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-03-30T12:13:57.591 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-30T12:13:57.591 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-03-30T12:13:57.591 INFO:teuthology.orchestra.run.smithi084.stdout:mgr is available 2024-03-30T12:13:58.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:57 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3919869100' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-30T12:13:58.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-03-30T12:13:58.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [global] 2024-03-30T12:13:58.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout fsid = d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:13:58.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-30T12:13:58.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-30T12:13:58.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-30T12:13:58.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-30T12:13:58.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-03-30T12:13:58.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-30T12:13:58.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-30T12:13:58.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-03-30T12:13:58.771 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [osd] 2024-03-30T12:13:58.772 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-30T12:13:58.772 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-30T12:13:58.772 INFO:teuthology.orchestra.run.smithi084.stdout:Enabling cephadm module... 2024-03-30T12:13:59.086 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:58 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/610430411' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-30T12:14:00.147 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:13:59 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/275270578' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-03-30T12:14:00.147 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ignoring --setuser ceph since I am not root 2024-03-30T12:14:00.147 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:13:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ignoring --setgroup ceph since I am not root 2024-03-30T12:14:00.667 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:00.421+0000 7f79b760f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T12:14:00.667 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:00.520+0000 7f79b760f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T12:14:01.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:00 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/275270578' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-03-30T12:14:01.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:00 smithi084 ceph-mon[27000]: mgrmap e5: y(active, since 6s) 2024-03-30T12:14:01.405 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:01.177+0000 7f79b760f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T12:14:01.406 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:01.269+0000 7f79b760f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T12:14:01.406 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:01.412+0000 7f79b760f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T12:14:01.680 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:01.509+0000 7f79b760f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T12:14:01.681 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:01.594+0000 7f79b760f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T12:14:01.684 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-03-30T12:14:01.684 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-03-30T12:14:01.684 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-30T12:14:01.684 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-03-30T12:14:01.684 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-30T12:14:01.685 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-03-30T12:14:01.685 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for the mgr to restart... 2024-03-30T12:14:01.685 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mgr epoch 5... 2024-03-30T12:14:01.968 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:01 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/1076742869' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-30T12:14:01.968 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:01.864+0000 7f79b760f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T12:14:02.254 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:01.975+0000 7f79b760f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T12:14:02.254 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:02.065+0000 7f79b760f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T12:14:02.254 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:02.161+0000 7f79b760f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T12:14:02.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:02.336+0000 7f79b760f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T12:14:03.744 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:03.291+0000 7f79b760f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T12:14:03.744 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:03.421+0000 7f79b760f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T12:14:03.744 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:03.751+0000 7f79b760f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T12:14:04.004 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:03.840+0000 7f79b760f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T12:14:04.492 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:04.034+0000 7f79b760f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:14:04.492 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:04.217+0000 7f79b760f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T12:14:04.748 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:04.499+0000 7f79b760f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:14:04.748 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:04.755+0000 7f79b760f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T12:14:05.004 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:04.992+0000 7f79b760f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T12:14:06.254 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:05.796+0000 7f79b760f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T12:14:06.668 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:06.360+0000 7f79b760f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T12:14:06.668 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:06.458+0000 7f79b760f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T12:14:06.668 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:06.675+0000 7f79b760f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T12:14:07.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:06 smithi084 ceph-mon[27000]: Active manager daemon y restarted 2024-03-30T12:14:07.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:06 smithi084 ceph-mon[27000]: Activating manager daemon y 2024-03-30T12:14:07.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:06 smithi084 ceph-mon[27000]: osdmap e2: 0 total, 0 up, 0 in 2024-03-30T12:14:07.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:06 smithi084 ceph-mon[27000]: mgrmap e6: y(active, starting, since 0.00333236s) 2024-03-30T12:14:07.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:06 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:14:07.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:06 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T12:14:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:06 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T12:14:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:06 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T12:14:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:06 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T12:14:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:06 smithi084 ceph-mon[27000]: Manager daemon y is now available 2024-03-30T12:14:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:06 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' 2024-03-30T12:14:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:06 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' 2024-03-30T12:14:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:06 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:14:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:06 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:14:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:06 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T12:14:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:06 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T12:14:07.985 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:07 smithi084 ceph-mon[27000]: Found migration_current of "None". Setting to last migration. 2024-03-30T12:14:07.986 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:07 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' 2024-03-30T12:14:07.986 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:07 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' 2024-03-30T12:14:07.986 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:07 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:14:07.986 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:07 smithi084 ceph-mon[27000]: mgrmap e7: y(active, since 1.00517s) 2024-03-30T12:14:08.180 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-03-30T12:14:08.181 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-03-30T12:14:08.181 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-30T12:14:08.181 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-03-30T12:14:08.181 INFO:teuthology.orchestra.run.smithi084.stdout:mgr epoch 5 is available 2024-03-30T12:14:08.181 INFO:teuthology.orchestra.run.smithi084.stdout:Setting orchestrator backend to cephadm... 2024-03-30T12:14:08.877 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:08 smithi084 ceph-mon[27000]: [30/Mar/2024:12:14:07] ENGINE Bus STARTING 2024-03-30T12:14:08.877 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:08 smithi084 ceph-mon[27000]: [30/Mar/2024:12:14:07] ENGINE Serving on http://172.21.15.84:8765 2024-03-30T12:14:08.877 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:08 smithi084 ceph-mon[27000]: [30/Mar/2024:12:14:07] ENGINE Serving on https://172.21.15.84:7150 2024-03-30T12:14:08.877 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:08 smithi084 ceph-mon[27000]: [30/Mar/2024:12:14:07] ENGINE Bus STARTED 2024-03-30T12:14:08.877 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:08 smithi084 ceph-mon[27000]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-30T12:14:08.877 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:08 smithi084 ceph-mon[27000]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-30T12:14:09.803 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:09 smithi084 ceph-mon[27000]: mgrmap e8: y(active, since 2s) 2024-03-30T12:14:09.803 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:09 smithi084 ceph-mon[27000]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:14:09.803 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:09 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' 2024-03-30T12:14:09.803 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:09 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:14:10.601 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout value unchanged 2024-03-30T12:14:10.601 INFO:teuthology.orchestra.run.smithi084.stdout:Generating ssh key... 2024-03-30T12:14:11.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:10 smithi084 ceph-mon[27000]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:14:11.596 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: Generating public/private rsa key pair. 2024-03-30T12:14:11.596 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: Your identification has been saved in /tmp/tmp0ue4q14k/key. 2024-03-30T12:14:11.596 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: Your public key has been saved in /tmp/tmp0ue4q14k/key.pub. 2024-03-30T12:14:11.596 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: The key fingerprint is: 2024-03-30T12:14:11.596 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: SHA256:8ffZIEakLaht2wOKXgrKbXV4A6locNgQquXv/neCvxQ ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:14:11.596 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: The key's randomart image is: 2024-03-30T12:14:11.596 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: +---[RSA 3072]----+ 2024-03-30T12:14:11.596 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: |.. . | 2024-03-30T12:14:11.596 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: |o . + | 2024-03-30T12:14:11.596 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: |.+. . o o o | 2024-03-30T12:14:11.596 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: |+oo o o o o | 2024-03-30T12:14:11.597 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: |o.o . + E . + . | 2024-03-30T12:14:11.597 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: | o o + * = o o + | 2024-03-30T12:14:11.597 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: |. . + =.+ o o .| 2024-03-30T12:14:11.597 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: |...= o..o .. | 2024-03-30T12:14:11.597 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: |...o=..oo+ | 2024-03-30T12:14:11.597 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: +----[SHA256]-----+ 2024-03-30T12:14:12.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:12 smithi084 ceph-mon[27000]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:14:12.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:12 smithi084 ceph-mon[27000]: Generating ssh key... 2024-03-30T12:14:12.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:12 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' 2024-03-30T12:14:12.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:12 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' 2024-03-30T12:14:13.080 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDG6XYOUyWboi2s8kfmx3GXD9gx4DyZeRHnl4NZjYXF6n4+UeFc0fXzEjZTOH3cNrHet3onS55cOZDfvzoUzoTflLYo+OR3Od9NF3Yhkn472EL1vThH8WnBR0EPXDfMIXAGzWgkPk0qopaIgH44qYlkcfK4lcNk4Cu9w/JAnsCGpw4o4RK5tuCJKSmsKXbFsdMYTbtRIBD8yw9wXQt0wU6HXZuASkfZT70JyC0JJtHyDe+nfsQcr4BRgDZANbwwN1OOV5BDmcmTS2mg8stGXqaXgObJvXLdZN41eGbRA+3H9BfDKRhBGLTEC6rC9zX4bGsIvQ8EmAd03lOkY4jTfRCHwIla4gLnL5VXlTIwdn8wUHFH4+StEhfGGo2mFubeiemWEKARC5yvrXB1Z6sW0jjl6T9fhoZsWk42QfYSdGdx3XzkM37YVYobru9A2jMdzVzZhPcuDz0MmOqyfq7kj+YpKCDcppzqrD+a30sXw0RoaAQGs1PFCODdlsa//K18hh8= ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:14:13.081 INFO:teuthology.orchestra.run.smithi084.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-03-30T12:14:13.081 INFO:teuthology.orchestra.run.smithi084.stdout:Adding key to root@localhost authorized_keys... 2024-03-30T12:14:13.081 INFO:teuthology.orchestra.run.smithi084.stdout:Adding host smithi084... 2024-03-30T12:14:13.729 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:13 smithi084 ceph-mon[27000]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:14:14.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:14 smithi084 ceph-mon[27000]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi084", "addr": "172.21.15.84", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:14:16.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:15 smithi084 ceph-mon[27000]: Deploying cephadm binary to smithi084 2024-03-30T12:14:16.879 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Added host 'smithi084' with addr '172.21.15.84' 2024-03-30T12:14:16.879 INFO:teuthology.orchestra.run.smithi084.stdout:Deploying unmanaged mon service... 2024-03-30T12:14:17.496 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:17 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' 2024-03-30T12:14:17.496 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:17 smithi084 ceph-mon[27000]: Added host smithi084 2024-03-30T12:14:17.496 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:17 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:14:18.497 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-03-30T12:14:18.497 INFO:teuthology.orchestra.run.smithi084.stdout:Deploying unmanaged mgr service... 2024-03-30T12:14:18.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:18 smithi084 ceph-mon[27000]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:14:18.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:18 smithi084 ceph-mon[27000]: Saving service mon spec with placement count:5 2024-03-30T12:14:18.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:18 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' 2024-03-30T12:14:19.925 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-03-30T12:14:20.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:20 smithi084 ceph-mon[27000]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:14:20.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:20 smithi084 ceph-mon[27000]: Saving service mgr spec with placement count:2 2024-03-30T12:14:20.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:20 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' 2024-03-30T12:14:20.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:20 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' 2024-03-30T12:14:21.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:21 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' 2024-03-30T12:14:21.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:21 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/2703138624' entity='client.admin' 2024-03-30T12:14:22.763 INFO:teuthology.orchestra.run.smithi084.stdout:Enabling the dashboard module... 2024-03-30T12:14:23.097 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:22 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3796744878' entity='client.admin' 2024-03-30T12:14:23.097 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:22 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' 2024-03-30T12:14:24.393 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:24 smithi084 ceph-mon[27000]: from='mgr.14120 172.21.15.84:0/592157526' entity='mgr.y' 2024-03-30T12:14:24.393 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:24 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/2836607214' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-03-30T12:14:24.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ignoring --setuser ceph since I am not root 2024-03-30T12:14:24.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ignoring --setgroup ceph since I am not root 2024-03-30T12:14:25.113 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:24.932+0000 7ffbd2955200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T12:14:25.113 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:25.029+0000 7ffbd2955200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T12:14:25.654 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:25 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/2836607214' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-03-30T12:14:25.678 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:25 smithi084 ceph-mon[27000]: mgrmap e9: y(active, since 17s) 2024-03-30T12:14:25.985 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:25.662+0000 7ffbd2955200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T12:14:25.985 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:25.752+0000 7ffbd2955200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T12:14:25.985 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:25.896+0000 7ffbd2955200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T12:14:25.985 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:25.993+0000 7ffbd2955200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T12:14:26.254 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:26.076+0000 7ffbd2955200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T12:14:26.624 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:26 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/2197337752' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-30T12:14:26.624 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:26.342+0000 7ffbd2955200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T12:14:26.624 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:26.452+0000 7ffbd2955200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T12:14:26.624 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:26.539+0000 7ffbd2955200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T12:14:26.624 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:26.632+0000 7ffbd2955200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T12:14:26.767 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-03-30T12:14:26.767 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-03-30T12:14:26.767 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-30T12:14:26.767 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-03-30T12:14:26.767 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-30T12:14:26.767 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-03-30T12:14:26.767 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for the mgr to restart... 2024-03-30T12:14:26.767 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mgr epoch 9... 2024-03-30T12:14:26.894 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:26.822+0000 7ffbd2955200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T12:14:28.235 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:27.790+0000 7ffbd2955200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T12:14:28.235 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:27.918+0000 7ffbd2955200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T12:14:28.235 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:28.243+0000 7ffbd2955200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T12:14:28.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:28.331+0000 7ffbd2955200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T12:14:28.976 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:28.523+0000 7ffbd2955200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:14:28.976 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:28.705+0000 7ffbd2955200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T12:14:29.231 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:28.984+0000 7ffbd2955200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:14:29.231 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:29.239+0000 7ffbd2955200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T12:14:29.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:29.471+0000 7ffbd2955200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T12:14:30.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:30.258+0000 7ffbd2955200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T12:14:31.115 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:30.815+0000 7ffbd2955200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T12:14:31.115 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:30.911+0000 7ffbd2955200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T12:14:31.115 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:14:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:14:31.124+0000 7ffbd2955200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T12:14:31.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:31 smithi084 ceph-mon[27000]: Active manager daemon y restarted 2024-03-30T12:14:31.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:31 smithi084 ceph-mon[27000]: Activating manager daemon y 2024-03-30T12:14:31.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:31 smithi084 ceph-mon[27000]: osdmap e3: 0 total, 0 up, 0 in 2024-03-30T12:14:31.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:31 smithi084 ceph-mon[27000]: mgrmap e10: y(active, starting, since 0.00320595s) 2024-03-30T12:14:31.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:31 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:14:31.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:31 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T12:14:31.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:31 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T12:14:31.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:31 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T12:14:31.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:31 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T12:14:31.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:31 smithi084 ceph-mon[27000]: Manager daemon y is now available 2024-03-30T12:14:31.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:31 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:14:31.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:31 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T12:14:31.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:31 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T12:14:32.783 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-03-30T12:14:32.783 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-03-30T12:14:32.783 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-30T12:14:32.783 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-03-30T12:14:32.783 INFO:teuthology.orchestra.run.smithi084.stdout:mgr epoch 9 is available 2024-03-30T12:14:32.783 INFO:teuthology.orchestra.run.smithi084.stdout:Generating a dashboard self-signed certificate... 2024-03-30T12:14:33.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:33 smithi084 ceph-mon[27000]: [30/Mar/2024:12:14:31] ENGINE Bus STARTING 2024-03-30T12:14:33.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:33 smithi084 ceph-mon[27000]: [30/Mar/2024:12:14:31] ENGINE Serving on http://172.21.15.84:8765 2024-03-30T12:14:33.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:33 smithi084 ceph-mon[27000]: [30/Mar/2024:12:14:32] ENGINE Serving on https://172.21.15.84:7150 2024-03-30T12:14:33.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:33 smithi084 ceph-mon[27000]: [30/Mar/2024:12:14:32] ENGINE Bus STARTED 2024-03-30T12:14:33.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:33 smithi084 ceph-mon[27000]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-30T12:14:33.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:33 smithi084 ceph-mon[27000]: mgrmap e11: y(active, since 1.00561s) 2024-03-30T12:14:33.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:33 smithi084 ceph-mon[27000]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-30T12:14:34.030 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-03-30T12:14:34.030 INFO:teuthology.orchestra.run.smithi084.stdout:Creating initial admin user... 2024-03-30T12:14:34.152 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:34 smithi084 ceph-mon[27000]: mgrmap e12: y(active, since 2s) 2024-03-30T12:14:34.152 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:34 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:14:34.152 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:34 smithi084 ceph-mon[27000]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:14:34.152 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:34 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:14:34.152 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:34 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:14:35.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:35 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:14:35.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:35 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:14:35.858 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$G5SPJ9xf6IUjV9HEnqHTD.h6gpQp34op6pLrbrxrJXKyZuImP0AzO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1711800874, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-03-30T12:14:35.858 INFO:teuthology.orchestra.run.smithi084.stdout:Fetching dashboard port number... 2024-03-30T12:14:36.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:36 smithi084 ceph-mon[27000]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:14:37.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:37 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3430864265' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-03-30T12:14:37.450 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 8443 2024-03-30T12:14:37.459 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-30T12:14:37.459 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout disabled 2024-03-30T12:14:37.466 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-30T12:14:37.466 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-03-30T12:14:37.466 INFO:teuthology.orchestra.run.smithi084.stdout:firewalld.service is not enabled 2024-03-30T12:14:37.466 INFO:teuthology.orchestra.run.smithi084.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-03-30T12:14:37.468 INFO:teuthology.orchestra.run.smithi084.stdout:Ceph Dashboard is now available at: 2024-03-30T12:14:37.468 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:14:37.468 INFO:teuthology.orchestra.run.smithi084.stdout: URL: https://smithi084.front.sepia.ceph.com:8443/ 2024-03-30T12:14:37.468 INFO:teuthology.orchestra.run.smithi084.stdout: User: admin 2024-03-30T12:14:37.468 INFO:teuthology.orchestra.run.smithi084.stdout: Password: 1xegcb1sa9 2024-03-30T12:14:37.468 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:14:37.469 INFO:teuthology.orchestra.run.smithi084.stdout:Saving cluster configuration to /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config directory 2024-03-30T12:14:37.469 INFO:teuthology.orchestra.run.smithi084.stdout:Enabling autotune for osd_memory_target 2024-03-30T12:14:38.628 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:38 smithi084 ceph-mon[27000]: mgrmap e13: y(active, since 6s) 2024-03-30T12:14:39.929 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-03-30T12:14:39.929 INFO:teuthology.orchestra.run.smithi084.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-03-30T12:14:39.929 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:14:39.929 INFO:teuthology.orchestra.run.smithi084.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-03-30T12:14:39.929 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:14:39.930 INFO:teuthology.orchestra.run.smithi084.stdout:Or, if you are only running a single cluster on this host: 2024-03-30T12:14:39.930 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:14:39.930 INFO:teuthology.orchestra.run.smithi084.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-03-30T12:14:39.930 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:14:39.930 INFO:teuthology.orchestra.run.smithi084.stdout:Please consider enabling telemetry to help improve Ceph: 2024-03-30T12:14:39.930 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:14:39.930 INFO:teuthology.orchestra.run.smithi084.stdout: ceph telemetry on 2024-03-30T12:14:39.930 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:14:39.930 INFO:teuthology.orchestra.run.smithi084.stdout:For more information see: 2024-03-30T12:14:39.930 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:14:39.930 INFO:teuthology.orchestra.run.smithi084.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-03-30T12:14:39.930 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:14:39.930 INFO:teuthology.orchestra.run.smithi084.stdout:Bootstrap complete. 2024-03-30T12:14:39.964 INFO:tasks.cephadm:Fetching config... 2024-03-30T12:14:39.965 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-30T12:14:39.965 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-03-30T12:14:39.981 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-03-30T12:14:39.981 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-30T12:14:39.981 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-03-30T12:14:40.035 INFO:tasks.cephadm:Fetching mon keyring... 2024-03-30T12:14:40.035 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-30T12:14:40.035 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/keyring of=/dev/stdout 2024-03-30T12:14:40.102 INFO:tasks.cephadm:Fetching pub ssh key... 2024-03-30T12:14:40.103 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-30T12:14:40.103 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-03-30T12:14:40.158 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-03-30T12:14:40.158 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDG6XYOUyWboi2s8kfmx3GXD9gx4DyZeRHnl4NZjYXF6n4+UeFc0fXzEjZTOH3cNrHet3onS55cOZDfvzoUzoTflLYo+OR3Od9NF3Yhkn472EL1vThH8WnBR0EPXDfMIXAGzWgkPk0qopaIgH44qYlkcfK4lcNk4Cu9w/JAnsCGpw4o4RK5tuCJKSmsKXbFsdMYTbtRIBD8yw9wXQt0wU6HXZuASkfZT70JyC0JJtHyDe+nfsQcr4BRgDZANbwwN1OOV5BDmcmTS2mg8stGXqaXgObJvXLdZN41eGbRA+3H9BfDKRhBGLTEC6rC9zX4bGsIvQ8EmAd03lOkY4jTfRCHwIla4gLnL5VXlTIwdn8wUHFH4+StEhfGGo2mFubeiemWEKARC5yvrXB1Z6sW0jjl6T9fhoZsWk42QfYSdGdx3XzkM37YVYobru9A2jMdzVzZhPcuDz0MmOqyfq7kj+YpKCDcppzqrD+a30sXw0RoaAQGs1PFCODdlsa//K18hh8= ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-30T12:14:40.239 INFO:teuthology.orchestra.run.smithi084.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDG6XYOUyWboi2s8kfmx3GXD9gx4DyZeRHnl4NZjYXF6n4+UeFc0fXzEjZTOH3cNrHet3onS55cOZDfvzoUzoTflLYo+OR3Od9NF3Yhkn472EL1vThH8WnBR0EPXDfMIXAGzWgkPk0qopaIgH44qYlkcfK4lcNk4Cu9w/JAnsCGpw4o4RK5tuCJKSmsKXbFsdMYTbtRIBD8yw9wXQt0wU6HXZuASkfZT70JyC0JJtHyDe+nfsQcr4BRgDZANbwwN1OOV5BDmcmTS2mg8stGXqaXgObJvXLdZN41eGbRA+3H9BfDKRhBGLTEC6rC9zX4bGsIvQ8EmAd03lOkY4jTfRCHwIla4gLnL5VXlTIwdn8wUHFH4+StEhfGGo2mFubeiemWEKARC5yvrXB1Z6sW0jjl6T9fhoZsWk42QfYSdGdx3XzkM37YVYobru9A2jMdzVzZhPcuDz0MmOqyfq7kj+YpKCDcppzqrD+a30sXw0RoaAQGs1PFCODdlsa//K18hh8= ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:14:40.253 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDG6XYOUyWboi2s8kfmx3GXD9gx4DyZeRHnl4NZjYXF6n4+UeFc0fXzEjZTOH3cNrHet3onS55cOZDfvzoUzoTflLYo+OR3Od9NF3Yhkn472EL1vThH8WnBR0EPXDfMIXAGzWgkPk0qopaIgH44qYlkcfK4lcNk4Cu9w/JAnsCGpw4o4RK5tuCJKSmsKXbFsdMYTbtRIBD8yw9wXQt0wU6HXZuASkfZT70JyC0JJtHyDe+nfsQcr4BRgDZANbwwN1OOV5BDmcmTS2mg8stGXqaXgObJvXLdZN41eGbRA+3H9BfDKRhBGLTEC6rC9zX4bGsIvQ8EmAd03lOkY4jTfRCHwIla4gLnL5VXlTIwdn8wUHFH4+StEhfGGo2mFubeiemWEKARC5yvrXB1Z6sW0jjl6T9fhoZsWk42QfYSdGdx3XzkM37YVYobru9A2jMdzVzZhPcuDz0MmOqyfq7kj+YpKCDcppzqrD+a30sXw0RoaAQGs1PFCODdlsa//K18hh8= ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-30T12:14:40.299 INFO:teuthology.orchestra.run.smithi162.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDG6XYOUyWboi2s8kfmx3GXD9gx4DyZeRHnl4NZjYXF6n4+UeFc0fXzEjZTOH3cNrHet3onS55cOZDfvzoUzoTflLYo+OR3Od9NF3Yhkn472EL1vThH8WnBR0EPXDfMIXAGzWgkPk0qopaIgH44qYlkcfK4lcNk4Cu9w/JAnsCGpw4o4RK5tuCJKSmsKXbFsdMYTbtRIBD8yw9wXQt0wU6HXZuASkfZT70JyC0JJtHyDe+nfsQcr4BRgDZANbwwN1OOV5BDmcmTS2mg8stGXqaXgObJvXLdZN41eGbRA+3H9BfDKRhBGLTEC6rC9zX4bGsIvQ8EmAd03lOkY4jTfRCHwIla4gLnL5VXlTIwdn8wUHFH4+StEhfGGo2mFubeiemWEKARC5yvrXB1Z6sW0jjl6T9fhoZsWk42QfYSdGdx3XzkM37YVYobru9A2jMdzVzZhPcuDz0MmOqyfq7kj+YpKCDcppzqrD+a30sXw0RoaAQGs1PFCODdlsa//K18hh8= ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:14:40.314 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-03-30T12:14:40.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:40 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/1000438394' entity='client.admin' 2024-03-30T12:14:40.520 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:14:42.897 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:42 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:14:42.897 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:42 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:14:42.898 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:42 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi084", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:14:42.898 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:42 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:14:42.898 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:42 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:14:42.898 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:42 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:14:44.494 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:44 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/451206363' entity='client.admin' 2024-03-30T12:14:44.494 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:14:44.494 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:14:44.610 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-03-30T12:14:44.611 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-03-30T12:14:44.814 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:14:47.258 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi162 2024-03-30T12:14:47.258 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-03-30T12:14:47.259 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/etc/ceph/ceph.conf 2024-03-30T12:14:47.277 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-03-30T12:14:47.278 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:14:47.335 INFO:tasks.cephadm:Adding host smithi162 to orchestrator... 2024-03-30T12:14:47.335 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph orch host add smithi162 2024-03-30T12:14:47.535 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:14:47.881 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:47 smithi084 ceph-mon[27000]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:14:47.881 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:47 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:14:47.881 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:47 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:14:47.881 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:47 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:14:47.881 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:47 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:14:47.882 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:47 smithi084 ceph-mon[27000]: Updating smithi084:/etc/ceph/ceph.conf 2024-03-30T12:14:47.882 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:47 smithi084 ceph-mon[27000]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:14:47.882 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:47 smithi084 ceph-mon[27000]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:14:47.882 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:47 smithi084 ceph-mon[27000]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:14:47.882 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:47 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:14:47.882 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:47 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:14:47.882 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:47 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:14:49.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:49 smithi084 ceph-mon[27000]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi162", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:14:51.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:50 smithi084 ceph-mon[27000]: Deploying cephadm binary to smithi162 2024-03-30T12:14:51.760 INFO:teuthology.orchestra.run.smithi084.stdout:Added host 'smithi162' with addr '172.21.15.162' 2024-03-30T12:14:52.373 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:52 smithi084 ceph-mon[27000]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:14:52.373 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:52 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:14:52.373 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:52 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:14:52.395 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph orch host ls --format=json 2024-03-30T12:14:52.596 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:14:53.338 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:53 smithi084 ceph-mon[27000]: Added host smithi162 2024-03-30T12:14:53.338 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:53 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:14:53.338 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:53 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:14:54.236 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:14:54.236 INFO:teuthology.orchestra.run.smithi084.stdout:[{"addr": "172.21.15.84", "hostname": "smithi084", "labels": [], "status": ""}, {"addr": "172.21.15.162", "hostname": "smithi162", "labels": [], "status": ""}] 2024-03-30T12:14:54.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:54 smithi084 ceph-mon[27000]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:14:54.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:54 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:14:54.772 INFO:tasks.cephadm:Setting crush tunables to default 2024-03-30T12:14:54.772 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph osd crush tunables default 2024-03-30T12:14:54.970 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:14:55.371 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:55 smithi084 ceph-mon[27000]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:14:56.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:56 smithi084 ceph-mon[27000]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:14:56.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:56 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:14:56.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:56 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:14:56.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:56 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:14:56.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:56 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:14:56.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:56 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:14:56.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:56 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:14:56.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:56 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:14:57.313 INFO:teuthology.orchestra.run.smithi084.stderr:adjusted tunables profile to default 2024-03-30T12:14:57.622 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:57 smithi084 ceph-mon[27000]: Updating smithi162:/etc/ceph/ceph.conf 2024-03-30T12:14:57.622 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:57 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/97957316' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-30T12:14:57.622 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:57 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:14:57.622 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:57 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:14:57.622 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:57 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:14:57.870 INFO:tasks.cephadm:Adding mon.a on smithi084 2024-03-30T12:14:57.870 INFO:tasks.cephadm:Adding mon.c on smithi084 2024-03-30T12:14:57.870 INFO:tasks.cephadm:Adding mon.b on smithi162 2024-03-30T12:14:57.871 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph orch apply mon '3;smithi084:172.21.15.84=a;smithi084:[v2:172.21.15.84:3301,v1:172.21.15.84:6790]=c;smithi162:172.21.15.162=b' 2024-03-30T12:14:58.066 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:14:58.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:58 smithi084 ceph-mon[27000]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:14:58.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:58 smithi084 ceph-mon[27000]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:14:58.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:58 smithi084 ceph-mon[27000]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:14:58.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:58 smithi084 ceph-mon[27000]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:14:58.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:58 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/97957316' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-30T12:14:58.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:14:58 smithi084 ceph-mon[27000]: osdmap e4: 0 total, 0 up, 0 in 2024-03-30T12:14:59.657 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled mon update... 2024-03-30T12:15:00.246 DEBUG:teuthology.orchestra.run.smithi084:mon.c> sudo journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mon.c.service 2024-03-30T12:15:00.249 DEBUG:teuthology.orchestra.run.smithi162:mon.b> sudo journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mon.b.service 2024-03-30T12:15:00.251 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-30T12:15:00.251 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph mon dump -f json 2024-03-30T12:15:00.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:00 smithi084 ceph-mon[27000]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:00.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:00 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:00.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:00 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:15:00.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:00 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:00.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:00 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:15:00.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:00 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:00.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:00 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:15:00.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:00 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:01.025 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:15:01.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:01 smithi084 ceph-mon[27000]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi084:172.21.15.84=a;smithi084:[v2:172.21.15.84:3301,v1:172.21.15.84:6790]=c;smithi162:172.21.15.162=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:15:01.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:01 smithi084 ceph-mon[27000]: Saving service mon spec with placement smithi084:172.21.15.84=a;smithi084:[v2:172.21.15.84:3301,v1:172.21.15.84:6790]=c;smithi162:172.21.15.162=b;count:3 2024-03-30T12:15:01.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:01 smithi084 ceph-mon[27000]: Deploying daemon mon.b on smithi162 2024-03-30T12:15:02.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:02 smithi084 ceph-mon[27000]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:04.346 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:04 smithi162 ceph-mon[30421]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-03-30T12:15:04.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:04 smithi162 bash[30377]: 5bf04eacfc81296cc2545bdedfd39b17cd887cd14614db12d94e99e0c6a81711 2024-03-30T12:15:04.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:04 smithi162 systemd[1]: Started Ceph mon.b for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:15:04.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:04 smithi084 ceph-mon[27000]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:09.338 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-03-30T12:15:09.338 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":2,"fsid":"d3450b00-ee8e-11ee-b647-cb9ed24678a4","modified":"2024-03-30T12:15:04.334261Z","created":"2024-03-30T12:13:26.814055Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-30T12:15:09.340 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 2 2024-03-30T12:15:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:09 smithi162 ceph-mon[30421]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:09 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:15:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:09 smithi162 ceph-mon[30421]: mon.a calling monitor election 2024-03-30T12:15:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:09 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:15:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:09 smithi162 ceph-mon[30421]: from='client.? 172.21.15.162:0/3063390056' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-30T12:15:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:09 smithi162 ceph-mon[30421]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:09 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:15:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:09 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:15:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:09 smithi162 ceph-mon[30421]: mon.b calling monitor election 2024-03-30T12:15:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:09 smithi162 ceph-mon[30421]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:09 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:15:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:09 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:15:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:09 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:15:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:09 smithi162 ceph-mon[30421]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-03-30T12:15:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:09 smithi162 ceph-mon[30421]: monmap e2: 2 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-30T12:15:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:09 smithi162 ceph-mon[30421]: fsmap 2024-03-30T12:15:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:09 smithi162 ceph-mon[30421]: osdmap e4: 0 total, 0 up, 0 in 2024-03-30T12:15:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:09 smithi162 ceph-mon[30421]: mgrmap e13: y(active, since 38s) 2024-03-30T12:15:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:09 smithi162 ceph-mon[30421]: overall HEALTH_OK 2024-03-30T12:15:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:09 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:09 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:09 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:09 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:15:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:09 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:09.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:09 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:15:09.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:09 smithi084 ceph-mon[27000]: mon.a calling monitor election 2024-03-30T12:15:09.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:09 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:15:09.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:09 smithi084 ceph-mon[27000]: from='client.? 172.21.15.162:0/3063390056' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-30T12:15:09.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:09 smithi084 ceph-mon[27000]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:09.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:09 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:15:09.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:09 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:15:09.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:09 smithi084 ceph-mon[27000]: mon.b calling monitor election 2024-03-30T12:15:09.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:09 smithi084 ceph-mon[27000]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:09.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:09 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:15:09.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:09 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:15:09.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:09 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:15:09.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:09 smithi084 ceph-mon[27000]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-03-30T12:15:09.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:09 smithi084 ceph-mon[27000]: monmap e2: 2 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-30T12:15:09.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:09 smithi084 ceph-mon[27000]: fsmap 2024-03-30T12:15:09.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:09 smithi084 ceph-mon[27000]: osdmap e4: 0 total, 0 up, 0 in 2024-03-30T12:15:09.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:09 smithi084 ceph-mon[27000]: mgrmap e13: y(active, since 38s) 2024-03-30T12:15:09.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:09 smithi084 ceph-mon[27000]: overall HEALTH_OK 2024-03-30T12:15:09.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:09 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:09.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:09 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:09.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:09 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:09.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:09 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:15:09.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:09 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:10.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:10 smithi084 ceph-mon[27000]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:10.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:10 smithi084 ceph-mon[27000]: Deploying daemon mon.c on smithi084 2024-03-30T12:15:10.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:10 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:15:10.852 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-30T12:15:10.852 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph mon dump -f json 2024-03-30T12:15:10.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:10 smithi162 ceph-mon[30421]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:10.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:10 smithi162 ceph-mon[30421]: Deploying daemon mon.c on smithi084 2024-03-30T12:15:10.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:10 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:15:11.063 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T12:15:12.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 systemd[1]: Starting Ceph mon.c for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:15:12.610 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[27000]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:12.611 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 podman[37538]: 2024-03-30 12:15:12.266961963 +0000 UTC m=+0.023426432 image pull c8fb09e16a7d204ddf8070b46841183d802f7121fa7d3b7679ce8e4cb9cfc075 quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2 2024-03-30T12:15:12.611 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 podman[37538]: 2024-03-30 12:15:12.368981576 +0000 UTC m=+0.125446028 container create 7db3fd996ae688acf3db1e40e93db4a79bc2e21885a0eb4427790cc2900fd312 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-f14b568, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-03-30T12:15:12.611 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 podman[37538]: 2024-03-30 12:15:12.57142512 +0000 UTC m=+0.327889570 container init 7db3fd996ae688acf3db1e40e93db4a79bc2e21885a0eb4427790cc2900fd312 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, RELEASE=reef-f14b568, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:15:12.611 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 podman[37538]: 2024-03-30 12:15:12.574419439 +0000 UTC m=+0.330883890 container start 7db3fd996ae688acf3db1e40e93db4a79bc2e21885a0eb4427790cc2900fd312 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-c, RELEASE=reef-f14b568, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T12:15:12.611 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: set uid:gid to 167:167 (ceph:ceph) 2024-03-30T12:15:12.611 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable), process ceph-mon, pid 2 2024-03-30T12:15:12.611 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: pidfile_write: ignore empty --pid-file 2024-03-30T12:15:12.611 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: load: jerasure load: lrc 2024-03-30T12:15:12.611 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: RocksDB version: 7.9.2 2024-03-30T12:15:12.611 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Git sha 0 2024-03-30T12:15:12.611 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Compile date 2024-03-29 20:23:56 2024-03-30T12:15:12.611 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: DB SUMMARY 2024-03-30T12:15:12.612 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: DB Session ID: 1IUBJ4BHDI1GWYBM4UKL 2024-03-30T12:15:12.612 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: CURRENT file: CURRENT 2024-03-30T12:15:12.612 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: IDENTITY file: IDENTITY 2024-03-30T12:15:12.612 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-03-30T12:15:12.612 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-03-30T12:15:12.612 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 636 ; 2024-03-30T12:15:12.612 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.error_if_exists: 0 2024-03-30T12:15:12.613 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.create_if_missing: 0 2024-03-30T12:15:12.614 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.paranoid_checks: 1 2024-03-30T12:15:12.614 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-30T12:15:12.614 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-30T12:15:12.614 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-30T12:15:12.614 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.env: 0x560d96368720 2024-03-30T12:15:12.614 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.fs: PosixFileSystem 2024-03-30T12:15:12.614 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.info_log: 0x560d994c14e0 2024-03-30T12:15:12.614 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_file_opening_threads: 16 2024-03-30T12:15:12.614 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.statistics: (nil) 2024-03-30T12:15:12.614 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.use_fsync: 0 2024-03-30T12:15:12.614 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_log_file_size: 0 2024-03-30T12:15:12.614 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-30T12:15:12.614 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-30T12:15:12.615 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.keep_log_file_num: 1000 2024-03-30T12:15:12.615 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.recycle_log_file_num: 0 2024-03-30T12:15:12.615 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.allow_fallocate: 1 2024-03-30T12:15:12.615 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.allow_mmap_reads: 0 2024-03-30T12:15:12.615 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.allow_mmap_writes: 0 2024-03-30T12:15:12.615 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.use_direct_reads: 0 2024-03-30T12:15:12.615 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-30T12:15:12.615 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.create_missing_column_families: 0 2024-03-30T12:15:12.615 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.db_log_dir: 2024-03-30T12:15:12.615 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.wal_dir: 2024-03-30T12:15:12.615 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-30T12:15:12.615 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-30T12:15:12.615 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-30T12:15:12.615 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-30T12:15:12.616 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-30T12:15:12.616 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-30T12:15:12.616 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.advise_random_on_open: 1 2024-03-30T12:15:12.616 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.db_write_buffer_size: 0 2024-03-30T12:15:12.616 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.write_buffer_manager: 0x560d98738140 2024-03-30T12:15:12.616 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-30T12:15:12.616 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-30T12:15:12.616 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-30T12:15:12.616 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.rate_limiter: (nil) 2024-03-30T12:15:12.616 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-30T12:15:12.616 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.wal_recovery_mode: 2 2024-03-30T12:15:12.616 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.enable_thread_tracking: 0 2024-03-30T12:15:12.616 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.enable_pipelined_write: 0 2024-03-30T12:15:12.616 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.unordered_write: 0 2024-03-30T12:15:12.617 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-30T12:15:12.617 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-30T12:15:12.617 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-30T12:15:12.617 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-30T12:15:12.617 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.row_cache: None 2024-03-30T12:15:12.617 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.wal_filter: None 2024-03-30T12:15:12.617 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-30T12:15:12.617 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.allow_ingest_behind: 0 2024-03-30T12:15:12.617 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.two_write_queues: 0 2024-03-30T12:15:12.617 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.manual_wal_flush: 0 2024-03-30T12:15:12.617 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.wal_compression: 0 2024-03-30T12:15:12.617 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.atomic_flush: 0 2024-03-30T12:15:12.617 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-30T12:15:12.617 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-30T12:15:12.617 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-30T12:15:12.618 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.log_readahead_size: 0 2024-03-30T12:15:12.618 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-30T12:15:12.618 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.best_efforts_recovery: 0 2024-03-30T12:15:12.618 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-30T12:15:12.618 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-30T12:15:12.618 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.allow_data_in_errors: 0 2024-03-30T12:15:12.618 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.db_host_id: __hostname__ 2024-03-30T12:15:12.618 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-30T12:15:12.618 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_background_jobs: 2 2024-03-30T12:15:12.618 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_background_compactions: -1 2024-03-30T12:15:12.618 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_subcompactions: 1 2024-03-30T12:15:12.618 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-30T12:15:12.618 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-30T12:15:12.618 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-30T12:15:12.619 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_total_wal_size: 0 2024-03-30T12:15:12.619 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-30T12:15:12.619 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-30T12:15:12.619 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-30T12:15:12.619 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-30T12:15:12.619 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_open_files: -1 2024-03-30T12:15:12.619 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.bytes_per_sync: 0 2024-03-30T12:15:12.619 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-30T12:15:12.619 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-30T12:15:12.619 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.compaction_readahead_size: 0 2024-03-30T12:15:12.619 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_background_flushes: -1 2024-03-30T12:15:12.619 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Compression algorithms supported: 2024-03-30T12:15:12.619 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-30T12:15:12.619 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: kZSTD supported: 0 2024-03-30T12:15:12.620 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: kXpressCompression supported: 0 2024-03-30T12:15:12.620 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: kLZ4HCCompression supported: 1 2024-03-30T12:15:12.620 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: kZlibCompression supported: 1 2024-03-30T12:15:12.620 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: kSnappyCompression supported: 1 2024-03-30T12:15:12.620 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: kLZ4Compression supported: 1 2024-03-30T12:15:12.620 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: kBZip2Compression supported: 0 2024-03-30T12:15:12.620 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-30T12:15:12.620 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-30T12:15:12.620 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-03-30T12:15:12.620 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-30T12:15:12.620 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-30T12:15:12.620 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.merge_operator: 2024-03-30T12:15:12.620 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.compaction_filter: None 2024-03-30T12:15:12.620 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.compaction_filter_factory: None 2024-03-30T12:15:12.621 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.sst_partitioner_factory: None 2024-03-30T12:15:12.621 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-30T12:15:12.621 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-30T12:15:12.621 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560d994c15e0) 2024-03-30T12:15:12.621 INFO:journalctl@ceph.mon.c.smithi084.stdout: cache_index_and_filter_blocks: 1 2024-03-30T12:15:12.621 INFO:journalctl@ceph.mon.c.smithi084.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-30T12:15:12.621 INFO:journalctl@ceph.mon.c.smithi084.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-30T12:15:12.621 INFO:journalctl@ceph.mon.c.smithi084.stdout: pin_top_level_index_and_filter: 1 2024-03-30T12:15:12.621 INFO:journalctl@ceph.mon.c.smithi084.stdout: index_type: 0 2024-03-30T12:15:12.621 INFO:journalctl@ceph.mon.c.smithi084.stdout: data_block_index_type: 0 2024-03-30T12:15:12.621 INFO:journalctl@ceph.mon.c.smithi084.stdout: index_shortening: 1 2024-03-30T12:15:12.621 INFO:journalctl@ceph.mon.c.smithi084.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-30T12:15:12.621 INFO:journalctl@ceph.mon.c.smithi084.stdout: checksum: 4 2024-03-30T12:15:12.622 INFO:journalctl@ceph.mon.c.smithi084.stdout: no_block_cache: 0 2024-03-30T12:15:12.622 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_cache: 0x560d987d91f0 2024-03-30T12:15:12.622 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_cache_name: BinnedLRUCache 2024-03-30T12:15:12.622 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_cache_options: 2024-03-30T12:15:12.622 INFO:journalctl@ceph.mon.c.smithi084.stdout: capacity : 536870912 2024-03-30T12:15:12.622 INFO:journalctl@ceph.mon.c.smithi084.stdout: num_shard_bits : 4 2024-03-30T12:15:12.622 INFO:journalctl@ceph.mon.c.smithi084.stdout: strict_capacity_limit : 0 2024-03-30T12:15:12.622 INFO:journalctl@ceph.mon.c.smithi084.stdout: high_pri_pool_ratio: 0.000 2024-03-30T12:15:12.622 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_cache_compressed: (nil) 2024-03-30T12:15:12.622 INFO:journalctl@ceph.mon.c.smithi084.stdout: persistent_cache: (nil) 2024-03-30T12:15:12.622 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_size: 4096 2024-03-30T12:15:12.622 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_size_deviation: 10 2024-03-30T12:15:12.622 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_restart_interval: 16 2024-03-30T12:15:12.622 INFO:journalctl@ceph.mon.c.smithi084.stdout: index_block_restart_interval: 1 2024-03-30T12:15:12.622 INFO:journalctl@ceph.mon.c.smithi084.stdout: metadata_block_size: 4096 2024-03-30T12:15:12.623 INFO:journalctl@ceph.mon.c.smithi084.stdout: partition_filters: 0 2024-03-30T12:15:12.623 INFO:journalctl@ceph.mon.c.smithi084.stdout: use_delta_encoding: 1 2024-03-30T12:15:12.623 INFO:journalctl@ceph.mon.c.smithi084.stdout: filter_policy: bloomfilter 2024-03-30T12:15:12.623 INFO:journalctl@ceph.mon.c.smithi084.stdout: whole_key_filtering: 1 2024-03-30T12:15:12.623 INFO:journalctl@ceph.mon.c.smithi084.stdout: verify_compression: 0 2024-03-30T12:15:12.623 INFO:journalctl@ceph.mon.c.smithi084.stdout: read_amp_bytes_per_bit: 0 2024-03-30T12:15:12.623 INFO:journalctl@ceph.mon.c.smithi084.stdout: format_version: 5 2024-03-30T12:15:12.623 INFO:journalctl@ceph.mon.c.smithi084.stdout: enable_index_compression: 1 2024-03-30T12:15:12.623 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_align: 0 2024-03-30T12:15:12.623 INFO:journalctl@ceph.mon.c.smithi084.stdout: max_auto_readahead_size: 262144 2024-03-30T12:15:12.623 INFO:journalctl@ceph.mon.c.smithi084.stdout: prepopulate_block_cache: 0 2024-03-30T12:15:12.623 INFO:journalctl@ceph.mon.c.smithi084.stdout: initial_auto_readahead_size: 8192 2024-03-30T12:15:12.623 INFO:journalctl@ceph.mon.c.smithi084.stdout: num_file_reads_for_auto_readahead: 2 2024-03-30T12:15:12.623 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.write_buffer_size: 33554432 2024-03-30T12:15:12.624 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_write_buffer_number: 2 2024-03-30T12:15:12.624 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.compression: NoCompression 2024-03-30T12:15:12.624 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.bottommost_compression: Disabled 2024-03-30T12:15:12.624 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.prefix_extractor: nullptr 2024-03-30T12:15:12.624 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-30T12:15:12.624 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.num_levels: 7 2024-03-30T12:15:12.624 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-30T12:15:12.624 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-30T12:15:12.624 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-30T12:15:12.624 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-30T12:15:12.624 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-30T12:15:12.624 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-30T12:15:12.624 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-30T12:15:12.624 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-30T12:15:12.624 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-30T12:15:12.625 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-30T12:15:12.625 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-30T12:15:12.625 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-30T12:15:12.625 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-30T12:15:12.625 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.compression_opts.level: 32767 2024-03-30T12:15:12.625 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.compression_opts.strategy: 0 2024-03-30T12:15:12.625 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-30T12:15:12.625 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-30T12:15:12.625 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-30T12:15:12.625 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-30T12:15:12.625 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.compression_opts.enabled: false 2024-03-30T12:15:12.625 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-30T12:15:12.625 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-30T12:15:12.625 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-30T12:15:12.625 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-30T12:15:12.626 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.target_file_size_base: 67108864 2024-03-30T12:15:12.626 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-30T12:15:12.626 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-30T12:15:12.626 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-30T12:15:12.626 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-30T12:15:12.626 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-30T12:15:12.626 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-30T12:15:12.626 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-30T12:15:12.626 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-30T12:15:12.626 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-30T12:15:12.626 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-30T12:15:12.626 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-30T12:15:12.626 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-30T12:15:12.627 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-30T12:15:12.627 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-30T12:15:12.627 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.arena_block_size: 1048576 2024-03-30T12:15:12.627 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-30T12:15:12.627 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-30T12:15:12.627 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.disable_auto_compactions: 0 2024-03-30T12:15:12.627 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-30T12:15:12.627 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-30T12:15:12.627 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-30T12:15:12.627 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-30T12:15:12.627 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-30T12:15:12.627 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-30T12:15:12.627 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-30T12:15:12.627 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-30T12:15:12.627 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-30T12:15:12.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-30T12:15:12.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.table_properties_collectors: 2024-03-30T12:15:12.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.inplace_update_support: 0 2024-03-30T12:15:12.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-30T12:15:12.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-30T12:15:12.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-30T12:15:12.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-30T12:15:12.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.bloom_locality: 0 2024-03-30T12:15:12.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.max_successive_merges: 0 2024-03-30T12:15:12.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-30T12:15:12.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.paranoid_file_checks: 0 2024-03-30T12:15:12.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.force_consistency_checks: 1 2024-03-30T12:15:12.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.report_bg_io_stats: 0 2024-03-30T12:15:12.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.ttl: 2592000 2024-03-30T12:15:12.629 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-30T12:15:12.629 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-30T12:15:12.629 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-30T12:15:12.629 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.enable_blob_files: false 2024-03-30T12:15:12.629 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.min_blob_size: 0 2024-03-30T12:15:12.629 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.blob_file_size: 268435456 2024-03-30T12:15:12.629 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-30T12:15:12.629 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-30T12:15:12.629 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-30T12:15:12.629 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-30T12:15:12.629 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-30T12:15:12.629 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.blob_file_starting_level: 0 2024-03-30T12:15:12.629 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-30T12:15:12.629 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-30T12:15:12.630 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-03-30T12:15:12.630 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a5921325-f35f-436a-af47-e87239de7656 2024-03-30T12:15:12.630 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711800912603653, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-03-30T12:15:12.630 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-03-30T12:15:12.630 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711800912604050, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711800912, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a5921325-f35f-436a-af47-e87239de7656", "db_session_id": "1IUBJ4BHDI1GWYBM4UKL", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-03-30T12:15:12.630 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711800912604128, "job": 1, "event": "recovery_finished"} 2024-03-30T12:15:12.630 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-03-30T12:15:12.630 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-30T12:15:12.630 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x560d98876000 2024-03-30T12:15:12.630 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: DB pointer 0x560d98864000 2024-03-30T12:15:12.630 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-30T12:15:12.630 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-30T12:15:12.630 INFO:journalctl@ceph.mon.c.smithi084.stdout: ** DB Stats ** 2024-03-30T12:15:12.630 INFO:journalctl@ceph.mon.c.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T12:15:12.631 INFO:journalctl@ceph.mon.c.smithi084.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-30T12:15:12.631 INFO:journalctl@ceph.mon.c.smithi084.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T12:15:12.631 INFO:journalctl@ceph.mon.c.smithi084.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T12:15:12.631 INFO:journalctl@ceph.mon.c.smithi084.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-30T12:15:12.631 INFO:journalctl@ceph.mon.c.smithi084.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T12:15:12.631 INFO:journalctl@ceph.mon.c.smithi084.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T12:15:12.631 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-03-30T12:15:12.631 INFO:journalctl@ceph.mon.c.smithi084.stdout: ** Compaction Stats [default] ** 2024-03-30T12:15:12.631 INFO:journalctl@ceph.mon.c.smithi084.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T12:15:12.631 INFO:journalctl@ceph.mon.c.smithi084.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-30T12:15:12.631 INFO:journalctl@ceph.mon.c.smithi084.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-30T12:15:12.631 INFO:journalctl@ceph.mon.c.smithi084.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-30T12:15:12.631 INFO:journalctl@ceph.mon.c.smithi084.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-30T12:15:12.631 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-03-30T12:15:12.632 INFO:journalctl@ceph.mon.c.smithi084.stdout: ** Compaction Stats [default] ** 2024-03-30T12:15:12.632 INFO:journalctl@ceph.mon.c.smithi084.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T12:15:12.632 INFO:journalctl@ceph.mon.c.smithi084.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-30T12:15:12.632 INFO:journalctl@ceph.mon.c.smithi084.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-30T12:15:12.632 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-03-30T12:15:12.632 INFO:journalctl@ceph.mon.c.smithi084.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-30T12:15:12.632 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-03-30T12:15:12.632 INFO:journalctl@ceph.mon.c.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T12:15:12.632 INFO:journalctl@ceph.mon.c.smithi084.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-30T12:15:12.632 INFO:journalctl@ceph.mon.c.smithi084.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-30T12:15:12.632 INFO:journalctl@ceph.mon.c.smithi084.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-30T12:15:12.632 INFO:journalctl@ceph.mon.c.smithi084.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-30T12:15:12.632 INFO:journalctl@ceph.mon.c.smithi084.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-30T12:15:12.632 INFO:journalctl@ceph.mon.c.smithi084.stdout: Cumulative compaction: 0.00 GB write, 0.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T12:15:12.633 INFO:journalctl@ceph.mon.c.smithi084.stdout: Interval compaction: 0.00 GB write, 0.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T12:15:12.633 INFO:journalctl@ceph.mon.c.smithi084.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-30T12:15:12.633 INFO:journalctl@ceph.mon.c.smithi084.stdout: Block cache BinnedLRUCache@0x560d987d91f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-03-30T12:15:12.633 INFO:journalctl@ceph.mon.c.smithi084.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-03-30T12:15:12.633 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-03-30T12:15:12.633 INFO:journalctl@ceph.mon.c.smithi084.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-30T12:15:12.633 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-03-30T12:15:12.633 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: using public_addrv [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] 2024-03-30T12:15:12.633 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: starting mon.c rank -1 at public addrs [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] at bind addrs [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:15:12.633 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: mon.c@-1(???) e0 preinit fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:15:12.633 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: mon.c@-1(synchronizing).mds e1 new map 2024-03-30T12:15:12.633 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: mon.c@-1(synchronizing).mds e1 print_map 2024-03-30T12:15:12.633 INFO:journalctl@ceph.mon.c.smithi084.stdout: e1 2024-03-30T12:15:12.633 INFO:journalctl@ceph.mon.c.smithi084.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-30T12:15:12.633 INFO:journalctl@ceph.mon.c.smithi084.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-30T12:15:12.634 INFO:journalctl@ceph.mon.c.smithi084.stdout: legacy client fscid: -1 2024-03-30T12:15:12.634 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-03-30T12:15:12.634 INFO:journalctl@ceph.mon.c.smithi084.stdout: No filesystems configured 2024-03-30T12:15:12.634 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-03-30T12:15:12.634 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-03-30T12:15:12.634 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-03-30T12:15:12.634 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-03-30T12:15:12.634 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-03-30T12:15:12.634 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-03-30T12:15:12.635 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-30T12:15:12.635 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-30T12:15:12.635 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-30T12:15:12.635 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-30T12:15:12.635 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:12.635 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:12.635 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:12.635 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:12.635 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:12.635 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:15:12.635 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:12.636 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:15:12.636 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: Updating smithi162:/etc/ceph/ceph.conf 2024-03-30T12:15:12.636 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/97957316' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-30T12:15:12.636 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:12.636 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:12.636 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:12.636 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:15:12.636 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:15:12.636 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:15:12.636 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:12.636 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/97957316' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-30T12:15:12.636 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: osdmap e4: 0 total, 0 up, 0 in 2024-03-30T12:15:12.636 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:12.636 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:12.637 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:15:12.637 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:12.637 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:15:12.637 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:12.637 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:15:12.637 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:12.637 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi084:172.21.15.84=a;smithi084:[v2:172.21.15.84:3301,v1:172.21.15.84:6790]=c;smithi162:172.21.15.162=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:15:12.637 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: Saving service mon spec with placement smithi084:172.21.15.84=a;smithi084:[v2:172.21.15.84:3301,v1:172.21.15.84:6790]=c;smithi162:172.21.15.162=b;count:3 2024-03-30T12:15:12.637 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: Deploying daemon mon.b on smithi162 2024-03-30T12:15:12.637 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:12.637 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:12.637 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:15:12.637 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: mon.a calling monitor election 2024-03-30T12:15:12.637 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:15:12.638 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='client.? 172.21.15.162:0/3063390056' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-30T12:15:12.638 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:12.638 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:15:12.638 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:15:12.638 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: mon.b calling monitor election 2024-03-30T12:15:12.638 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:12.638 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:15:12.638 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:15:12.638 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:15:12.638 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-03-30T12:15:12.638 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: monmap e2: 2 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-30T12:15:12.638 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: fsmap 2024-03-30T12:15:12.638 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: osdmap e4: 0 total, 0 up, 0 in 2024-03-30T12:15:12.638 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: mgrmap e13: y(active, since 38s) 2024-03-30T12:15:12.638 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: overall HEALTH_OK 2024-03-30T12:15:12.639 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:12.639 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:12.639 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:12.639 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:15:12.639 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:12.639 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:12.639 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: Deploying daemon mon.c on smithi084 2024-03-30T12:15:12.639 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:15:12.639 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:12.639 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 ceph-mon[37565]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-03-30T12:15:12.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:12 smithi162 ceph-mon[30421]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:13.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 bash[37538]: 7db3fd996ae688acf3db1e40e93db4a79bc2e21885a0eb4427790cc2900fd312 2024-03-30T12:15:13.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:12 smithi084 systemd[1]: Started Ceph mon.c for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:15:17.627 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-03-30T12:15:17.627 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":3,"fsid":"d3450b00-ee8e-11ee-b647-cb9ed24678a4","modified":"2024-03-30T12:15:12.624596Z","created":"2024-03-30T12:13:26.814055Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3301","nonce":0},{"type":"v1","addr":"172.21.15.84:6790","nonce":0}]},"addr":"172.21.15.84:6790/0","public_addr":"172.21.15.84:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-03-30T12:15:17.630 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 3 2024-03-30T12:15:17.946 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:17 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:15:17.946 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:17 smithi162 ceph-mon[30421]: mon.a calling monitor election 2024-03-30T12:15:17.946 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:17 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:15:17.947 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:17 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:15:17.947 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:17 smithi162 ceph-mon[30421]: mon.b calling monitor election 2024-03-30T12:15:17.947 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:17 smithi162 ceph-mon[30421]: from='client.? 172.21.15.162:0/285844989' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-30T12:15:17.947 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:17 smithi162 ceph-mon[30421]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:17.947 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:17 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:15:17.947 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:17 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:15:17.947 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:17 smithi162 ceph-mon[30421]: mon.c calling monitor election 2024-03-30T12:15:17.947 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:17 smithi162 ceph-mon[30421]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:17.947 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:17 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:15:17.947 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:17 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:15:17.947 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:17 smithi162 ceph-mon[30421]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:17.947 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:17 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:15:17.947 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:17 smithi162 ceph-mon[30421]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-30T12:15:17.947 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:17 smithi162 ceph-mon[30421]: monmap e3: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-30T12:15:17.947 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:17 smithi162 ceph-mon[30421]: fsmap 2024-03-30T12:15:17.948 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:17 smithi162 ceph-mon[30421]: osdmap e4: 0 total, 0 up, 0 in 2024-03-30T12:15:17.948 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:17 smithi162 ceph-mon[30421]: mgrmap e13: y(active, since 46s) 2024-03-30T12:15:17.948 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:17 smithi162 ceph-mon[30421]: overall HEALTH_OK 2024-03-30T12:15:17.948 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:17 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:17.948 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:17 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:18.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:15:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[27000]: mon.a calling monitor election 2024-03-30T12:15:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:15:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:15:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[27000]: mon.b calling monitor election 2024-03-30T12:15:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[27000]: from='client.? 172.21.15.162:0/285844989' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-30T12:15:18.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[27000]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:18.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:15:18.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:15:18.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[27000]: mon.c calling monitor election 2024-03-30T12:15:18.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[27000]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:18.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:15:18.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:15:18.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[27000]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:18.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:15:18.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[27000]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-30T12:15:18.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[27000]: monmap e3: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-30T12:15:18.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[27000]: fsmap 2024-03-30T12:15:18.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[27000]: osdmap e4: 0 total, 0 up, 0 in 2024-03-30T12:15:18.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[27000]: mgrmap e13: y(active, since 46s) 2024-03-30T12:15:18.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[27000]: overall HEALTH_OK 2024-03-30T12:15:18.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:18.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:18.009 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:15:18.009 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[37565]: mon.a calling monitor election 2024-03-30T12:15:18.009 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:15:18.009 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:15:18.009 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[37565]: mon.b calling monitor election 2024-03-30T12:15:18.009 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[37565]: from='client.? 172.21.15.162:0/285844989' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-30T12:15:18.009 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[37565]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:18.009 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:15:18.009 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:15:18.009 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[37565]: mon.c calling monitor election 2024-03-30T12:15:18.009 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[37565]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:18.009 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:15:18.009 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:15:18.010 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[37565]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:18.010 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:15:18.010 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[37565]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-30T12:15:18.010 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[37565]: monmap e3: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-30T12:15:18.010 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[37565]: fsmap 2024-03-30T12:15:18.010 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[37565]: osdmap e4: 0 total, 0 up, 0 in 2024-03-30T12:15:18.010 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[37565]: mgrmap e13: y(active, since 46s) 2024-03-30T12:15:18.010 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[37565]: overall HEALTH_OK 2024-03-30T12:15:18.010 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:18.010 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:17 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:18.233 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-03-30T12:15:18.233 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph config generate-minimal-conf 2024-03-30T12:15:18.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:18 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:18.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:18 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:18.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:18 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:15:18.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:18 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:15:18.925 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:15:19.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:18 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:19.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:18 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:19.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:18 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:15:19.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:18 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:15:19.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:18 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:19.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:18 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:19.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:18 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:15:19.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:18 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:15:20.048 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.048 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.048 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.048 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.048 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:20.048 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:15:20.048 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[27000]: Updating smithi084:/etc/ceph/ceph.conf 2024-03-30T12:15:20.048 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[27000]: Updating smithi162:/etc/ceph/ceph.conf 2024-03-30T12:15:20.049 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[27000]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:20.049 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[27000]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:15:20.049 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[27000]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:15:20.049 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.049 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.049 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.049 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.049 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.049 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.049 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.049 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.049 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.049 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:15:20.049 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:15:20.049 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:20.050 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.050 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.050 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.050 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.050 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:20.050 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:15:20.050 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[37565]: Updating smithi084:/etc/ceph/ceph.conf 2024-03-30T12:15:20.050 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[37565]: Updating smithi162:/etc/ceph/ceph.conf 2024-03-30T12:15:20.050 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[37565]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:20.050 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[37565]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:15:20.050 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[37565]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:15:20.050 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.050 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.051 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.051 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.051 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.051 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.051 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.051 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.051 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.051 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:15:20.051 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:15:20.051 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:19 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:20.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:19 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:19 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:19 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:19 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:19 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:19 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:15:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:19 smithi162 ceph-mon[30421]: Updating smithi084:/etc/ceph/ceph.conf 2024-03-30T12:15:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:19 smithi162 ceph-mon[30421]: Updating smithi162:/etc/ceph/ceph.conf 2024-03-30T12:15:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:19 smithi162 ceph-mon[30421]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:19 smithi162 ceph-mon[30421]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:15:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:19 smithi162 ceph-mon[30421]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:15:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:19 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:19 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:19 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:19 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:19 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:19 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:19 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:19 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:19 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:19 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:15:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:19 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:15:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:19 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:20.744 INFO:teuthology.orchestra.run.smithi084.stdout:# minimal ceph.conf for d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:15:20.744 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2024-03-30T12:15:20.744 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:15:20.744 INFO:teuthology.orchestra.run.smithi084.stdout: mon_host = [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] 2024-03-30T12:15:21.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:20 smithi084 ceph-mon[27000]: Reconfiguring mon.a (unknown last config time)... 2024-03-30T12:15:21.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:20 smithi084 ceph-mon[27000]: Reconfiguring daemon mon.a on smithi084 2024-03-30T12:15:21.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:20 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/674518740' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:21.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:20 smithi084 ceph-mon[37565]: Reconfiguring mon.a (unknown last config time)... 2024-03-30T12:15:21.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:20 smithi084 ceph-mon[37565]: Reconfiguring daemon mon.a on smithi084 2024-03-30T12:15:21.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:20 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/674518740' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:21.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:20 smithi162 ceph-mon[30421]: Reconfiguring mon.a (unknown last config time)... 2024-03-30T12:15:21.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:20 smithi162 ceph-mon[30421]: Reconfiguring daemon mon.a on smithi084 2024-03-30T12:15:21.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:20 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/674518740' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:21.379 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-03-30T12:15:21.379 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-30T12:15:21.379 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.conf 2024-03-30T12:15:21.410 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-30T12:15:21.410 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:15:21.479 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-03-30T12:15:21.479 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.conf 2024-03-30T12:15:21.513 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-03-30T12:15:21.513 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:15:21.581 INFO:tasks.cephadm:Adding mgr.y on smithi084 2024-03-30T12:15:21.581 INFO:tasks.cephadm:Adding mgr.x on smithi162 2024-03-30T12:15:21.582 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph orch apply mgr '2;smithi084=y;smithi162=x' 2024-03-30T12:15:21.815 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T12:15:22.230 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:22 smithi084 ceph-mon[27000]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:22.230 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:22 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:22.230 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:22 smithi084 ceph-mon[37565]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:22.230 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:22 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:22.244 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:22 smithi162 ceph-mon[30421]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:22.245 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:22 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:23.489 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled mgr update... 2024-03-30T12:15:23.489 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:23 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:23.489 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:23 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:23.490 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:23 smithi162 ceph-mon[30421]: Reconfiguring mon.c (monmap changed)... 2024-03-30T12:15:23.490 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:23 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:15:23.490 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:23 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:15:23.490 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:23 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:23.490 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:23 smithi162 ceph-mon[30421]: Reconfiguring daemon mon.c on smithi084 2024-03-30T12:15:23.618 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:23 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:23.618 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:23 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:23.618 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:23 smithi084 ceph-mon[27000]: Reconfiguring mon.c (monmap changed)... 2024-03-30T12:15:23.618 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:23 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:15:23.618 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:23 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:15:23.618 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:23 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:23.618 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:23 smithi084 ceph-mon[27000]: Reconfiguring daemon mon.c on smithi084 2024-03-30T12:15:23.619 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:23 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:23.619 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:23 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:23.619 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:23 smithi084 ceph-mon[37565]: Reconfiguring mon.c (monmap changed)... 2024-03-30T12:15:23.619 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:23 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:15:23.619 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:23 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:15:23.619 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:23 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:23.619 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:23 smithi084 ceph-mon[37565]: Reconfiguring daemon mon.c on smithi084 2024-03-30T12:15:24.054 DEBUG:teuthology.orchestra.run.smithi162:mgr.x> sudo journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mgr.x.service 2024-03-30T12:15:24.056 INFO:tasks.cephadm:Deploying OSDs... 2024-03-30T12:15:24.057 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-30T12:15:24.057 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/scratch_devs of=/dev/stdout 2024-03-30T12:15:24.075 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-30T12:15:24.076 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 2024-03-30T12:15:24.133 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-30T12:15:24.133 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T12:15:24.133 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-03-30T12:15:24.133 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T12:15:24.133 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T12:15:24.133 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-03-30 12:15:12.073425040 +0000 2024-03-30T12:15:24.134 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-03-30 12:10:54.215435773 +0000 2024-03-30T12:15:24.134 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-03-30 12:10:54.215435773 +0000 2024-03-30T12:15:24.134 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-03-30 12:10:54.215435773 +0000 2024-03-30T12:15:24.134 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-30T12:15:24.204 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-03-30T12:15:24.204 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-03-30T12:15:24.204 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000279806 s, 1.8 MB/s 2024-03-30T12:15:24.206 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-30T12:15:24.264 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 2024-03-30T12:15:24.321 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-30T12:15:24.321 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T12:15:24.321 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-03-30T12:15:24.321 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T12:15:24.321 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T12:15:24.321 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-03-30 12:15:12.073425040 +0000 2024-03-30T12:15:24.321 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-03-30 12:10:54.550429577 +0000 2024-03-30T12:15:24.322 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-03-30 12:10:54.550429577 +0000 2024-03-30T12:15:24.322 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-03-30 12:10:54.550429577 +0000 2024-03-30T12:15:24.322 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-30T12:15:24.389 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-03-30T12:15:24.389 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-03-30T12:15:24.389 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000241828 s, 2.1 MB/s 2024-03-30T12:15:24.390 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-30T12:15:24.447 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 2024-03-30T12:15:24.503 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-30T12:15:24.503 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T12:15:24.503 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-03-30T12:15:24.504 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T12:15:24.504 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T12:15:24.504 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-03-30 12:15:12.073425040 +0000 2024-03-30T12:15:24.504 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-03-30 12:10:54.920422733 +0000 2024-03-30T12:15:24.504 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-03-30 12:10:54.920422733 +0000 2024-03-30T12:15:24.504 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-03-30 12:10:54.920422733 +0000 2024-03-30T12:15:24.504 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-30T12:15:24.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:24 smithi084 ceph-mon[27000]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:24.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:24 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:24.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:24 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:24.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:24 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:24.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:24 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:15:24.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:24 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:15:24.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:24 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:24.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:24 smithi084 ceph-mon[37565]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:24.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:24 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:24.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:24 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:24.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:24 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:24.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:24 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:15:24.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:24 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:15:24.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:24 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:24.532 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-03-30T12:15:24.532 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-03-30T12:15:24.532 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000209123 s, 2.4 MB/s 2024-03-30T12:15:24.533 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-30T12:15:24.589 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 2024-03-30T12:15:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:24 smithi162 ceph-mon[30421]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:24 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:24 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:24 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:24 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:15:24.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:24 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:15:24.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:24 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:24.644 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-30T12:15:24.645 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T12:15:24.645 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-03-30T12:15:24.645 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T12:15:24.645 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T12:15:24.645 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-03-30 12:15:12.074425022 +0000 2024-03-30T12:15:24.645 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-03-30 12:10:55.266416332 +0000 2024-03-30T12:15:24.645 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-03-30 12:10:55.266416332 +0000 2024-03-30T12:15:24.645 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-03-30 12:10:55.266416332 +0000 2024-03-30T12:15:24.645 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-30T12:15:24.711 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-03-30T12:15:24.711 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-03-30T12:15:24.711 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000189939 s, 2.7 MB/s 2024-03-30T12:15:24.713 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-30T12:15:24.770 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-03-30T12:15:24.770 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2024-03-30T12:15:24.787 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-30T12:15:24.787 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 2024-03-30T12:15:24.843 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-30T12:15:24.843 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T12:15:24.843 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-03-30T12:15:24.843 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T12:15:24.843 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T12:15:24.844 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-03-30 12:15:03.309844909 +0000 2024-03-30T12:15:24.844 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-03-30 12:10:49.314113319 +0000 2024-03-30T12:15:24.844 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-03-30 12:10:49.314113319 +0000 2024-03-30T12:15:24.844 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-03-30 12:10:49.314113319 +0000 2024-03-30T12:15:24.844 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-30T12:15:24.912 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-03-30T12:15:24.913 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-03-30T12:15:24.913 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000210308 s, 2.4 MB/s 2024-03-30T12:15:24.914 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-30T12:15:24.971 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 2024-03-30T12:15:25.027 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-30T12:15:25.027 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T12:15:25.027 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-03-30T12:15:25.028 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T12:15:25.028 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T12:15:25.028 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-03-30 12:15:03.310844889 +0000 2024-03-30T12:15:25.028 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-03-30 12:10:49.661106221 +0000 2024-03-30T12:15:25.028 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-03-30 12:10:49.661106221 +0000 2024-03-30T12:15:25.028 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-03-30 12:10:49.661106221 +0000 2024-03-30T12:15:25.028 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-30T12:15:25.094 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-03-30T12:15:25.094 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-03-30T12:15:25.094 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000263864 s, 1.9 MB/s 2024-03-30T12:15:25.095 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-30T12:15:25.153 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 2024-03-30T12:15:25.208 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-30T12:15:25.209 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T12:15:25.209 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-03-30T12:15:25.209 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T12:15:25.209 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T12:15:25.209 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-03-30 12:15:03.310844889 +0000 2024-03-30T12:15:25.209 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-03-30 12:10:50.019098898 +0000 2024-03-30T12:15:25.209 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-03-30 12:10:50.019098898 +0000 2024-03-30T12:15:25.209 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-03-30 12:10:50.019098898 +0000 2024-03-30T12:15:25.209 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-30T12:15:25.275 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-03-30T12:15:25.275 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-03-30T12:15:25.275 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000189793 s, 2.7 MB/s 2024-03-30T12:15:25.276 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-30T12:15:25.334 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 2024-03-30T12:15:25.390 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-30T12:15:25.390 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T12:15:25.390 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-03-30T12:15:25.390 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T12:15:25.390 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T12:15:25.390 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-03-30 12:15:03.310844889 +0000 2024-03-30T12:15:25.390 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-03-30 12:10:50.358091963 +0000 2024-03-30T12:15:25.391 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-03-30 12:10:50.358091963 +0000 2024-03-30T12:15:25.391 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-03-30 12:10:50.358091963 +0000 2024-03-30T12:15:25.391 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-30T12:15:25.456 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-03-30T12:15:25.456 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-03-30T12:15:25.457 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000245988 s, 2.1 MB/s 2024-03-30T12:15:25.458 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-30T12:15:25.514 INFO:tasks.cephadm:Deploying osd.0 on smithi084 with /dev/vg_nvme/lv_4... 2024-03-30T12:15:25.514 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-30T12:15:25.541 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[37565]: from='client.24104 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi084=y;smithi162=x", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:15:25.541 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[37565]: Saving service mgr spec with placement smithi084=y;smithi162=x;count:2 2024-03-30T12:15:25.541 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[37565]: Reconfiguring mon.b (monmap changed)... 2024-03-30T12:15:25.541 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[37565]: Reconfiguring daemon mon.b on smithi162 2024-03-30T12:15:25.541 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:25.541 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:25.542 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:15:25.542 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:25.542 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:15:25.542 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:25.542 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:15:25.542 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-30T12:15:25.542 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T12:15:25.542 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:25.542 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[27000]: from='client.24104 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi084=y;smithi162=x", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:15:25.543 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[27000]: Saving service mgr spec with placement smithi084=y;smithi162=x;count:2 2024-03-30T12:15:25.543 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[27000]: Reconfiguring mon.b (monmap changed)... 2024-03-30T12:15:25.543 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[27000]: Reconfiguring daemon mon.b on smithi162 2024-03-30T12:15:25.543 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:25.543 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:25.543 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:15:25.543 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:25.543 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:15:25.543 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:25.543 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:15:25.543 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-30T12:15:25.543 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T12:15:25.544 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:25 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:25 smithi162 ceph-mon[30421]: from='client.24104 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi084=y;smithi162=x", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:15:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:25 smithi162 ceph-mon[30421]: Saving service mgr spec with placement smithi084=y;smithi162=x;count:2 2024-03-30T12:15:25.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:25 smithi162 ceph-mon[30421]: Reconfiguring mon.b (monmap changed)... 2024-03-30T12:15:25.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:25 smithi162 ceph-mon[30421]: Reconfiguring daemon mon.b on smithi162 2024-03-30T12:15:25.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:25 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:25.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:25 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:25.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:25 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:15:25.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:25 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:25.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:25 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:15:25.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:25 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:25.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:25 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:15:25.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:25 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-30T12:15:25.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:25 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T12:15:25.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:25 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:25.714 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:15:26.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:26 smithi084 ceph-mon[27000]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:26.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:26 smithi084 ceph-mon[27000]: Deploying daemon mgr.x on smithi162 2024-03-30T12:15:26.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:26 smithi084 ceph-mon[37565]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:26.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:26 smithi084 ceph-mon[37565]: Deploying daemon mgr.x on smithi162 2024-03-30T12:15:26.561 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:26 smithi162 ceph-mon[30421]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:26.561 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:26 smithi162 ceph-mon[30421]: Deploying daemon mgr.x on smithi162 2024-03-30T12:15:27.120 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:27 smithi162 systemd[1]: Starting Ceph mgr.x for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:15:27.499 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:27 smithi162 podman[32130]: 2024-03-30 12:15:27.230202411 +0000 UTC m=+0.108194662 container create d0e0c63b20de6a4549772fff6c7096a2a94c58bc282710d00d3c418c6553c1d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , RELEASE=reef-f14b568, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-03-30T12:15:27.499 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:27 smithi162 podman[32130]: 2024-03-30 12:15:27.13979714 +0000 UTC m=+0.017789412 image pull c8fb09e16a7d204ddf8070b46841183d802f7121fa7d3b7679ce8e4cb9cfc075 quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2 2024-03-30T12:15:27.499 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:27 smithi162 podman[32130]: 2024-03-30 12:15:27.416031209 +0000 UTC m=+0.294023458 container init d0e0c63b20de6a4549772fff6c7096a2a94c58bc282710d00d3c418c6553c1d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=reef-f14b568, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True) 2024-03-30T12:15:27.499 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:27 smithi162 podman[32130]: 2024-03-30 12:15:27.418805339 +0000 UTC m=+0.296797593 container start d0e0c63b20de6a4549772fff6c7096a2a94c58bc282710d00d3c418c6553c1d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x, RELEASE=reef-f14b568, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-03-30T12:15:27.499 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:27 smithi162 ceph-mgr[32149]: -- 172.21.15.162:0/3005665078 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55dab1b361a0 con 0x55dab1b0c800 2024-03-30T12:15:27.499 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:27 smithi162 bash[32130]: d0e0c63b20de6a4549772fff6c7096a2a94c58bc282710d00d3c418c6553c1d5 2024-03-30T12:15:27.541 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-30T12:15:27.542 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-30T12:15:27.542 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10+0 records in 2024-03-30T12:15:27.542 INFO:teuthology.orchestra.run.smithi084.stderr:10+0 records out 2024-03-30T12:15:27.542 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113315 s, 925 MB/s 2024-03-30T12:15:27.542 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping successful for: 2024-03-30T12:15:27.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:27 smithi162 systemd[1]: Started Ceph mgr.x for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:15:28.167 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi084:vg_nvme/lv_4 2024-03-30T12:15:28.290 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:15:27.974+0000 7f084b311200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T12:15:28.291 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:15:28.086+0000 7f084b311200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T12:15:28.408 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:15:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:28 smithi084 ceph-mon[27000]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:28 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:28 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:28 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:28 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:28 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:15:28.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:28 smithi084 ceph-mon[37565]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:28.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:28 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:28.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:28 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:28.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:28 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:28.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:28 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:28.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:28 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:15:28.618 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:28 smithi162 ceph-mon[30421]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:28.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:28 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:28.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:28 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:28.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:28 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:28.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:28 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:28.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:28 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:15:28.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:15:28.758+0000 7f084b311200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T12:15:28.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:15:28.854+0000 7f084b311200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T12:15:29.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:15:28.999+0000 7f084b311200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T12:15:29.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:15:29.091+0000 7f084b311200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T12:15:29.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:15:29.172+0000 7f084b311200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T12:15:29.715 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:15:29.436+0000 7f084b311200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T12:15:29.715 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:15:29.546+0000 7f084b311200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T12:15:29.715 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:15:29.630+0000 7f084b311200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T12:15:29.715 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:15:29.723+0000 7f084b311200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T12:15:30.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:29 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:30.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:29 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:30.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:29 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:29 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:15:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:29 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:29 smithi084 ceph-mon[27000]: Reconfiguring mgr.y (unknown last config time)... 2024-03-30T12:15:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:29 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:15:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:29 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T12:15:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:29 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:29 smithi084 ceph-mon[27000]: Reconfiguring daemon mgr.y on smithi084 2024-03-30T12:15:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:29 smithi084 ceph-mon[27000]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:30.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:29 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:30.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:29 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:30.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:29 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:30.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:29 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:15:30.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:29 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:30.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:29 smithi084 ceph-mon[37565]: Reconfiguring mgr.y (unknown last config time)... 2024-03-30T12:15:30.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:29 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:15:30.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:29 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T12:15:30.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:29 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:30.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:29 smithi084 ceph-mon[37565]: Reconfiguring daemon mgr.y on smithi084 2024-03-30T12:15:30.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:29 smithi084 ceph-mon[37565]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:30.120 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:15:29.898+0000 7f084b311200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T12:15:30.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:29 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:30.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:29 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:30.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:29 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:30.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:29 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:15:30.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:29 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:30.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:29 smithi162 ceph-mon[30421]: Reconfiguring mgr.y (unknown last config time)... 2024-03-30T12:15:30.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:29 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:15:30.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:29 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T12:15:30.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:29 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:30.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:29 smithi162 ceph-mon[30421]: Reconfiguring daemon mgr.y on smithi084 2024-03-30T12:15:30.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:29 smithi162 ceph-mon[30421]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:31.120 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:15:30.873+0000 7f084b311200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T12:15:31.120 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:15:31.004+0000 7f084b311200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T12:15:31.620 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:15:31.347+0000 7f084b311200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T12:15:31.620 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:15:31.436+0000 7f084b311200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T12:15:31.838 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:31 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:31.839 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:31 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:31.839 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:31 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:15:31.839 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:31 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:31.839 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:31 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:15:31.839 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:31 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:31.839 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:31 smithi084 ceph-mon[27000]: from='client.24116 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:15:31.839 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:31 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T12:15:31.839 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:31 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T12:15:31.839 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:31 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:31.839 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:31 smithi084 ceph-mon[27000]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:31.839 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:31 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:31.839 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:31 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:31.840 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:31 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:31.840 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:31 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:15:31.840 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:31 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:31.840 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:31 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:15:31.840 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:31 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:31.840 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:31 smithi084 ceph-mon[37565]: from='client.24116 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:15:31.840 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:31 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T12:15:31.840 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:31 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T12:15:31.840 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:31 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:31.840 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:31 smithi084 ceph-mon[37565]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:31.840 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:31 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:32.090 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:15:31.630+0000 7f084b311200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:15:32.090 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:15:31.816+0000 7f084b311200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T12:15:32.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:31 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:32.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:31 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:32.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:31 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:15:32.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:31 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:32.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:31 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:15:32.091 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:31 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:32.091 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:31 smithi162 ceph-mon[30421]: from='client.24116 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:15:32.091 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:31 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T12:15:32.091 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:31 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T12:15:32.091 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:31 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:32.091 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:31 smithi162 ceph-mon[30421]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:32.091 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:31 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:32.351 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:15:32.097+0000 7f084b311200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:15:32.351 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:15:32.358+0000 7f084b311200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T12:15:32.620 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:15:32.590+0000 7f084b311200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T12:15:33.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:15:33.396+0000 7f084b311200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T12:15:34.272 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:34 smithi162 ceph-mon[30421]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:34.273 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:34 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/3203343579' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a5734fa-c269-449c-805f-0a42d3d90120"}]: dispatch 2024-03-30T12:15:34.273 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:34 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/3203343579' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a5734fa-c269-449c-805f-0a42d3d90120"}]': finished 2024-03-30T12:15:34.273 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:34 smithi162 ceph-mon[30421]: osdmap e5: 1 total, 0 up, 1 in 2024-03-30T12:15:34.273 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:34 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:15:34.273 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:15:33.966+0000 7f084b311200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T12:15:34.273 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:15:34.063+0000 7f084b311200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T12:15:34.273 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:15:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:15:34.280+0000 7f084b311200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T12:15:34.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:34 smithi084 ceph-mon[37565]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:34.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:34 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/3203343579' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a5734fa-c269-449c-805f-0a42d3d90120"}]: dispatch 2024-03-30T12:15:34.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:34 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/3203343579' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a5734fa-c269-449c-805f-0a42d3d90120"}]': finished 2024-03-30T12:15:34.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:34 smithi084 ceph-mon[37565]: osdmap e5: 1 total, 0 up, 1 in 2024-03-30T12:15:34.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:34 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:15:34.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:34 smithi084 ceph-mon[27000]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:34.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:34 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3203343579' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a5734fa-c269-449c-805f-0a42d3d90120"}]: dispatch 2024-03-30T12:15:34.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:34 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3203343579' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a5734fa-c269-449c-805f-0a42d3d90120"}]': finished 2024-03-30T12:15:34.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:34 smithi084 ceph-mon[27000]: osdmap e5: 1 total, 0 up, 1 in 2024-03-30T12:15:34.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:34 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:15:35.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:35 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/2802517975' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T12:15:35.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:35 smithi084 ceph-mon[27000]: Standby manager daemon x started 2024-03-30T12:15:35.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:35 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.162:0/346472945' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T12:15:35.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:35 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.162:0/346472945' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T12:15:35.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:35 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.162:0/346472945' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T12:15:35.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:35 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.162:0/346472945' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T12:15:35.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:35 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/2802517975' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T12:15:35.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:35 smithi084 ceph-mon[37565]: Standby manager daemon x started 2024-03-30T12:15:35.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:35 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.162:0/346472945' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T12:15:35.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:35 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.162:0/346472945' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T12:15:35.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:35 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.162:0/346472945' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T12:15:35.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:35 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.162:0/346472945' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T12:15:35.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:35 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/2802517975' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T12:15:35.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:35 smithi162 ceph-mon[30421]: Standby manager daemon x started 2024-03-30T12:15:35.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:35 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.162:0/346472945' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T12:15:35.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:35 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.162:0/346472945' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T12:15:35.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:35 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.162:0/346472945' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T12:15:35.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:35 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.162:0/346472945' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T12:15:36.478 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:36 smithi084 ceph-mon[27000]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:36.478 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:36 smithi084 ceph-mon[27000]: mgrmap e14: y(active, since 64s), standbys: x 2024-03-30T12:15:36.479 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:36 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T12:15:36.479 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:36 smithi084 ceph-mon[37565]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:36.479 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:36 smithi084 ceph-mon[37565]: mgrmap e14: y(active, since 64s), standbys: x 2024-03-30T12:15:36.479 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:36 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T12:15:36.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:36 smithi162 ceph-mon[30421]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:36.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:36 smithi162 ceph-mon[30421]: mgrmap e14: y(active, since 64s), standbys: x 2024-03-30T12:15:36.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:36 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T12:15:38.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:38 smithi084 ceph-mon[27000]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:38.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:38 smithi084 ceph-mon[37565]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:38.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:38 smithi162 ceph-mon[30421]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:40.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:40 smithi084 ceph-mon[27000]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:40.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:40 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-30T12:15:40.462 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:40 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:40.462 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:40 smithi084 ceph-mon[37565]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:40.462 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:40 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-30T12:15:40.462 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:40 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:40.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:40 smithi162 ceph-mon[30421]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:40.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:40 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-30T12:15:40.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:40 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:41.497 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:41 smithi084 ceph-mon[27000]: Deploying daemon osd.0 on smithi084 2024-03-30T12:15:41.498 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:41 smithi084 ceph-mon[37565]: Deploying daemon osd.0 on smithi084 2024-03-30T12:15:41.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:41 smithi162 ceph-mon[30421]: Deploying daemon osd.0 on smithi084 2024-03-30T12:15:42.480 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:42 smithi084 ceph-mon[27000]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:42.481 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:42 smithi084 ceph-mon[37565]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:42.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:42 smithi162 ceph-mon[30421]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:44.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:44 smithi084 ceph-mon[27000]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:44.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:44 smithi084 ceph-mon[37565]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:44.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:44 smithi162 ceph-mon[30421]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:46.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:46 smithi084 ceph-mon[27000]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:46.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:46 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:46.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:46 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:46.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:46 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:15:46.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:46 smithi084 ceph-mon[37565]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:46.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:46 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:46.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:46 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:46.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:46 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:15:46.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:46 smithi162 ceph-mon[30421]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:46.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:46 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:46.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:46 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:46.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:46 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:15:48.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:48 smithi084 ceph-mon[27000]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:48.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:48 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:48.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:48 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:48.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:48 smithi084 ceph-mon[37565]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:48.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:48 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:48.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:48 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:48.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:48 smithi162 ceph-mon[30421]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:48.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:48 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:48.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:48 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:48.620 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 0 on host 'smithi084' 2024-03-30T12:15:49.169 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:49 smithi084 ceph-mon[27000]: from='osd.0 [v2:172.21.15.84:6802/2597011613,v1:172.21.15.84:6803/2597011613]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T12:15:49.169 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:49 smithi084 ceph-mon[27000]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T12:15:49.169 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:49 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:49.169 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:49 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:15:49.169 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:49 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:49.169 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:49 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:49.169 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:49 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:49.169 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:49 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:15:49.169 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:49 smithi084 ceph-mon[37565]: from='osd.0 [v2:172.21.15.84:6802/2597011613,v1:172.21.15.84:6803/2597011613]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T12:15:49.170 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:49 smithi084 ceph-mon[37565]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T12:15:49.170 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:49 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:49.170 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:49 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:15:49.170 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:49 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:49.170 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:49 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:49.170 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:49 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:49.170 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:49 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:15:49.189 DEBUG:teuthology.orchestra.run.smithi084:osd.0> sudo journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.0.service 2024-03-30T12:15:49.192 INFO:tasks.cephadm:Deploying osd.1 on smithi084 with /dev/vg_nvme/lv_3... 2024-03-30T12:15:49.192 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-30T12:15:49.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:49 smithi162 ceph-mon[30421]: from='osd.0 [v2:172.21.15.84:6802/2597011613,v1:172.21.15.84:6803/2597011613]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T12:15:49.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:49 smithi162 ceph-mon[30421]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T12:15:49.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:49 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:49.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:49 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:15:49.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:49 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:49.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:49 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:49.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:49 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:49.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:49 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:15:50.358 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:50 smithi084 ceph-mon[37565]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:50.358 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:50 smithi084 ceph-mon[37565]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-30T12:15:50.358 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:50 smithi084 ceph-mon[37565]: osdmap e6: 1 total, 0 up, 1 in 2024-03-30T12:15:50.358 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:50 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:15:50.358 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:50 smithi084 ceph-mon[37565]: from='osd.0 [v2:172.21.15.84:6802/2597011613,v1:172.21.15.84:6803/2597011613]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:15:50.358 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:50 smithi084 ceph-mon[37565]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:15:50.359 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:50 smithi084 ceph-mon[27000]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:50.359 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:50 smithi084 ceph-mon[27000]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-30T12:15:50.359 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:50 smithi084 ceph-mon[27000]: osdmap e6: 1 total, 0 up, 1 in 2024-03-30T12:15:50.359 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:50 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:15:50.359 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:50 smithi084 ceph-mon[27000]: from='osd.0 [v2:172.21.15.84:6802/2597011613,v1:172.21.15.84:6803/2597011613]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:15:50.359 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:50 smithi084 ceph-mon[27000]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:15:50.618 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:15:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[41482]: 2024-03-30T12:15:50.580+0000 7f16ce7ed700 -1 osd.0 0 waiting for initial osdmap 2024-03-30T12:15:50.618 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:15:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[41482]: 2024-03-30T12:15:50.583+0000 7f16c65da700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T12:15:50.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:50 smithi162 ceph-mon[30421]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:50.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:50 smithi162 ceph-mon[30421]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-30T12:15:50.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:50 smithi162 ceph-mon[30421]: osdmap e6: 1 total, 0 up, 1 in 2024-03-30T12:15:50.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:50 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:15:50.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:50 smithi162 ceph-mon[30421]: from='osd.0 [v2:172.21.15.84:6802/2597011613,v1:172.21.15.84:6803/2597011613]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:15:50.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:50 smithi162 ceph-mon[30421]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:15:50.882 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:15:51.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:51 smithi084 ceph-mon[37565]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-03-30T12:15:51.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:51 smithi084 ceph-mon[37565]: osdmap e7: 1 total, 0 up, 1 in 2024-03-30T12:15:51.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:51 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:15:51.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:51 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:15:51.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:51 smithi084 ceph-mon[37565]: from='osd.0 ' entity='osd.0' 2024-03-30T12:15:51.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:51 smithi084 ceph-mon[27000]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-03-30T12:15:51.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:51 smithi084 ceph-mon[27000]: osdmap e7: 1 total, 0 up, 1 in 2024-03-30T12:15:51.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:51 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:15:51.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:51 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:15:51.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:51 smithi084 ceph-mon[27000]: from='osd.0 ' entity='osd.0' 2024-03-30T12:15:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:51 smithi162 ceph-mon[30421]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-03-30T12:15:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:51 smithi162 ceph-mon[30421]: osdmap e7: 1 total, 0 up, 1 in 2024-03-30T12:15:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:51 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:15:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:51 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:15:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:51 smithi162 ceph-mon[30421]: from='osd.0 ' entity='osd.0' 2024-03-30T12:15:52.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:52 smithi084 ceph-mon[27000]: purged_snaps scrub starts 2024-03-30T12:15:52.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:52 smithi084 ceph-mon[27000]: purged_snaps scrub ok 2024-03-30T12:15:52.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:52 smithi084 ceph-mon[27000]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:52 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:15:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:52 smithi084 ceph-mon[27000]: osd.0 [v2:172.21.15.84:6802/2597011613,v1:172.21.15.84:6803/2597011613] boot 2024-03-30T12:15:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:52 smithi084 ceph-mon[27000]: osdmap e8: 1 total, 1 up, 1 in 2024-03-30T12:15:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:52 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:15:52.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:52 smithi084 ceph-mon[37565]: purged_snaps scrub starts 2024-03-30T12:15:52.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:52 smithi084 ceph-mon[37565]: purged_snaps scrub ok 2024-03-30T12:15:52.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:52 smithi084 ceph-mon[37565]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:52.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:52 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:15:52.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:52 smithi084 ceph-mon[37565]: osd.0 [v2:172.21.15.84:6802/2597011613,v1:172.21.15.84:6803/2597011613] boot 2024-03-30T12:15:52.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:52 smithi084 ceph-mon[37565]: osdmap e8: 1 total, 1 up, 1 in 2024-03-30T12:15:52.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:52 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:15:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:52 smithi162 ceph-mon[30421]: purged_snaps scrub starts 2024-03-30T12:15:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:52 smithi162 ceph-mon[30421]: purged_snaps scrub ok 2024-03-30T12:15:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:52 smithi162 ceph-mon[30421]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T12:15:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:52 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:15:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:52 smithi162 ceph-mon[30421]: osd.0 [v2:172.21.15.84:6802/2597011613,v1:172.21.15.84:6803/2597011613] boot 2024-03-30T12:15:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:52 smithi162 ceph-mon[30421]: osdmap e8: 1 total, 1 up, 1 in 2024-03-30T12:15:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:52 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:15:53.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:53 smithi084 ceph-mon[27000]: Detected new or changed devices on smithi084 2024-03-30T12:15:53.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:53 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:53.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:53 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:53.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:53 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:15:53.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:53 smithi084 ceph-mon[27000]: Adjusting osd_memory_target on smithi084 to 16064M 2024-03-30T12:15:53.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:53 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:53.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:53 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:53.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:53 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:15:53.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:53 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:53.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:53 smithi084 ceph-mon[37565]: Detected new or changed devices on smithi084 2024-03-30T12:15:53.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:53 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:53.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:53 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:53.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:53 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:15:53.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:53 smithi084 ceph-mon[37565]: Adjusting osd_memory_target on smithi084 to 16064M 2024-03-30T12:15:53.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:53 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:53.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:53 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:53.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:53 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:15:53.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:53 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:53.512 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-30T12:15:53.512 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-30T12:15:53.512 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10+0 records in 2024-03-30T12:15:53.512 INFO:teuthology.orchestra.run.smithi084.stderr:10+0 records out 2024-03-30T12:15:53.512 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0134301 s, 781 MB/s 2024-03-30T12:15:53.512 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping successful for: 2024-03-30T12:15:53.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:53 smithi162 ceph-mon[30421]: Detected new or changed devices on smithi084 2024-03-30T12:15:53.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:53 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:53.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:53 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:53.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:53 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:15:53.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:53 smithi162 ceph-mon[30421]: Adjusting osd_memory_target on smithi084 to 16064M 2024-03-30T12:15:53.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:53 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:53.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:53 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:53.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:53 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:15:53.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:53 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:15:54.114 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi084:vg_nvme/lv_3 2024-03-30T12:15:54.317 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:15:54.438 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:54 smithi084 ceph-mon[27000]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:15:54.439 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:54 smithi084 ceph-mon[27000]: osdmap e9: 1 total, 1 up, 1 in 2024-03-30T12:15:54.439 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:54 smithi084 ceph-mon[37565]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:15:54.439 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:54 smithi084 ceph-mon[37565]: osdmap e9: 1 total, 1 up, 1 in 2024-03-30T12:15:54.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:54 smithi162 ceph-mon[30421]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:15:54.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:54 smithi162 ceph-mon[30421]: osdmap e9: 1 total, 1 up, 1 in 2024-03-30T12:15:56.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:55 smithi084 ceph-mon[27000]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:15:56.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:55 smithi084 ceph-mon[37565]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:15:56.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:55 smithi162 ceph-mon[30421]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:15:57.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:56 smithi162 ceph-mon[30421]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:15:57.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:56 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T12:15:57.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:56 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T12:15:57.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:56 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:56 smithi084 ceph-mon[27000]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:15:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:56 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T12:15:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:56 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T12:15:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:56 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:57.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:56 smithi084 ceph-mon[37565]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:15:57.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:56 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T12:15:57.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:56 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T12:15:57.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:56 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:15:58.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:57 smithi084 ceph-mon[27000]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:15:58.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:57 smithi084 ceph-mon[37565]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:15:58.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:57 smithi162 ceph-mon[30421]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:15:59.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:58 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/1289776359' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ffe676e-9055-44f7-8b04-87974b854b97"}]: dispatch 2024-03-30T12:15:59.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:58 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/1289776359' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ffe676e-9055-44f7-8b04-87974b854b97"}]': finished 2024-03-30T12:15:59.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:58 smithi162 ceph-mon[30421]: osdmap e10: 2 total, 1 up, 2 in 2024-03-30T12:15:59.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:58 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:15:59.232 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:58 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/1289776359' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ffe676e-9055-44f7-8b04-87974b854b97"}]: dispatch 2024-03-30T12:15:59.232 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:58 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/1289776359' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ffe676e-9055-44f7-8b04-87974b854b97"}]': finished 2024-03-30T12:15:59.233 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:58 smithi084 ceph-mon[27000]: osdmap e10: 2 total, 1 up, 2 in 2024-03-30T12:15:59.233 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:58 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:15:59.233 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:58 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/1289776359' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ffe676e-9055-44f7-8b04-87974b854b97"}]: dispatch 2024-03-30T12:15:59.233 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:58 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/1289776359' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ffe676e-9055-44f7-8b04-87974b854b97"}]': finished 2024-03-30T12:15:59.233 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:58 smithi084 ceph-mon[37565]: osdmap e10: 2 total, 1 up, 2 in 2024-03-30T12:15:59.233 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:58 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:16:00.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:59 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/2726723271' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T12:16:00.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:15:59 smithi162 ceph-mon[30421]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:59 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/2726723271' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T12:16:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:15:59 smithi084 ceph-mon[27000]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:00.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:59 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/2726723271' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T12:16:00.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:15:59 smithi084 ceph-mon[37565]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:02.441 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:02 smithi084 ceph-mon[27000]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:02.442 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:02 smithi084 ceph-mon[37565]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:02.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:02 smithi162 ceph-mon[30421]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:04.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:04 smithi084 ceph-mon[27000]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:04.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:04 smithi084 ceph-mon[37565]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:04.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:04 smithi162 ceph-mon[30421]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:05.805 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:05 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-30T12:16:05.805 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:05 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:05.805 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:05 smithi084 ceph-mon[27000]: Deploying daemon osd.1 on smithi084 2024-03-30T12:16:05.805 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:05 smithi084 ceph-mon[27000]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:06.091 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:05 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-30T12:16:06.091 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:05 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:06.091 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:05 smithi084 ceph-mon[37565]: Deploying daemon osd.1 on smithi084 2024-03-30T12:16:06.091 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:05 smithi084 ceph-mon[37565]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:06.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:05 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-30T12:16:06.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:05 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:06.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:05 smithi162 ceph-mon[30421]: Deploying daemon osd.1 on smithi084 2024-03-30T12:16:06.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:05 smithi162 ceph-mon[30421]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:08.360 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:08 smithi084 ceph-mon[27000]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:08.360 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:08 smithi084 ceph-mon[37565]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:08.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:08 smithi162 ceph-mon[30421]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:10.480 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:10 smithi084 ceph-mon[27000]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:10.480 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:10 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:10.480 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:10 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:10.480 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:10 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:16:10.480 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:10 smithi084 ceph-mon[37565]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:10.480 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:10 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:10.480 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:10 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:10.480 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:10 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:16:10.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:10 smithi162 ceph-mon[30421]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:10.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:10 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:10.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:10 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:10 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:16:12.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:12 smithi084 ceph-mon[37565]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:12.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:12 smithi084 ceph-mon[27000]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:12.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:12 smithi162 ceph-mon[30421]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:13.688 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 1 on host 'smithi084' 2024-03-30T12:16:13.990 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:13 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:13.990 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:13 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:13.990 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:13 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:13.991 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:13 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:16:13.991 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:13 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:13.991 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:13 smithi084 ceph-mon[37565]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:13.991 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:13 smithi084 ceph-mon[37565]: from='osd.1 [v2:172.21.15.84:6810/6106221,v1:172.21.15.84:6811/6106221]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T12:16:13.991 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:13 smithi084 ceph-mon[37565]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T12:16:13.991 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:13 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:13.992 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:13 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:13.992 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:13 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:16:13.992 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:13 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:13.992 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:13 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:13.993 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:13 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:13.993 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:13 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:16:13.993 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:13 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:13.993 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:13 smithi084 ceph-mon[27000]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:13.993 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:13 smithi084 ceph-mon[27000]: from='osd.1 [v2:172.21.15.84:6810/6106221,v1:172.21.15.84:6811/6106221]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T12:16:13.993 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:13 smithi084 ceph-mon[27000]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T12:16:13.993 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:13 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:13.994 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:13 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:13.994 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:13 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:16:14.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:13 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:13 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:13 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:13 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:16:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:13 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:14.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:13 smithi162 ceph-mon[30421]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:14.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:13 smithi162 ceph-mon[30421]: from='osd.1 [v2:172.21.15.84:6810/6106221,v1:172.21.15.84:6811/6106221]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T12:16:14.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:13 smithi162 ceph-mon[30421]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T12:16:14.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:13 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:14.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:13 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:14.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:13 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:16:14.389 DEBUG:teuthology.orchestra.run.smithi084:osd.1> sudo journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.1.service 2024-03-30T12:16:14.391 INFO:tasks.cephadm:Deploying osd.2 on smithi084 with /dev/vg_nvme/lv_2... 2024-03-30T12:16:14.391 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-30T12:16:15.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:14 smithi084 ceph-mon[37565]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-30T12:16:15.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:14 smithi084 ceph-mon[37565]: osdmap e11: 2 total, 1 up, 2 in 2024-03-30T12:16:15.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:14 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:16:15.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:14 smithi084 ceph-mon[37565]: from='osd.1 [v2:172.21.15.84:6810/6106221,v1:172.21.15.84:6811/6106221]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:16:15.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:14 smithi084 ceph-mon[37565]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:16:15.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:14 smithi084 ceph-mon[27000]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-30T12:16:15.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:14 smithi084 ceph-mon[27000]: osdmap e11: 2 total, 1 up, 2 in 2024-03-30T12:16:15.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:14 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:16:15.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:14 smithi084 ceph-mon[27000]: from='osd.1 [v2:172.21.15.84:6810/6106221,v1:172.21.15.84:6811/6106221]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:16:15.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:14 smithi084 ceph-mon[27000]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:16:15.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:14 smithi162 ceph-mon[30421]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-30T12:16:15.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:14 smithi162 ceph-mon[30421]: osdmap e11: 2 total, 1 up, 2 in 2024-03-30T12:16:15.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:14 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:16:15.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:14 smithi162 ceph-mon[30421]: from='osd.1 [v2:172.21.15.84:6810/6106221,v1:172.21.15.84:6811/6106221]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:16:15.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:14 smithi162 ceph-mon[30421]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:16:15.148 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:16:15.504 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:16:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1[47593]: 2024-03-30T12:16:15.213+0000 7f175c680700 -1 osd.1 0 waiting for initial osdmap 2024-03-30T12:16:15.504 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:16:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1[47593]: 2024-03-30T12:16:15.216+0000 7f1753c6c700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T12:16:16.095 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:15 smithi084 ceph-mon[37565]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-03-30T12:16:16.095 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:15 smithi084 ceph-mon[37565]: osdmap e12: 2 total, 1 up, 2 in 2024-03-30T12:16:16.095 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:15 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:16:16.095 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:15 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:16:16.095 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:15 smithi084 ceph-mon[37565]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:16.095 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:15 smithi084 ceph-mon[37565]: from='osd.1 ' entity='osd.1' 2024-03-30T12:16:16.095 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:15 smithi084 ceph-mon[27000]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-03-30T12:16:16.095 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:15 smithi084 ceph-mon[27000]: osdmap e12: 2 total, 1 up, 2 in 2024-03-30T12:16:16.095 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:15 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:16:16.096 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:15 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:16:16.096 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:15 smithi084 ceph-mon[27000]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:16.096 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:15 smithi084 ceph-mon[27000]: from='osd.1 ' entity='osd.1' 2024-03-30T12:16:16.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:15 smithi162 ceph-mon[30421]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-03-30T12:16:16.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:15 smithi162 ceph-mon[30421]: osdmap e12: 2 total, 1 up, 2 in 2024-03-30T12:16:16.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:15 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:16:16.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:15 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:16:16.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:15 smithi162 ceph-mon[30421]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-30T12:16:16.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:15 smithi162 ceph-mon[30421]: from='osd.1 ' entity='osd.1' 2024-03-30T12:16:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:16 smithi162 ceph-mon[30421]: purged_snaps scrub starts 2024-03-30T12:16:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:16 smithi162 ceph-mon[30421]: purged_snaps scrub ok 2024-03-30T12:16:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:16 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:16:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:16 smithi162 ceph-mon[30421]: osd.1 [v2:172.21.15.84:6810/6106221,v1:172.21.15.84:6811/6106221] boot 2024-03-30T12:16:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:16 smithi162 ceph-mon[30421]: osdmap e13: 2 total, 2 up, 2 in 2024-03-30T12:16:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:16 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:16:17.193 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:16 smithi084 ceph-mon[37565]: purged_snaps scrub starts 2024-03-30T12:16:17.193 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:16 smithi084 ceph-mon[37565]: purged_snaps scrub ok 2024-03-30T12:16:17.193 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:16 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:16:17.193 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:16 smithi084 ceph-mon[37565]: osd.1 [v2:172.21.15.84:6810/6106221,v1:172.21.15.84:6811/6106221] boot 2024-03-30T12:16:17.193 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:16 smithi084 ceph-mon[37565]: osdmap e13: 2 total, 2 up, 2 in 2024-03-30T12:16:17.193 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:16 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:16:17.193 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:16 smithi084 ceph-mon[27000]: purged_snaps scrub starts 2024-03-30T12:16:17.193 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:16 smithi084 ceph-mon[27000]: purged_snaps scrub ok 2024-03-30T12:16:17.193 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:16 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:16:17.194 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:16 smithi084 ceph-mon[27000]: osd.1 [v2:172.21.15.84:6810/6106221,v1:172.21.15.84:6811/6106221] boot 2024-03-30T12:16:17.194 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:16 smithi084 ceph-mon[27000]: osdmap e13: 2 total, 2 up, 2 in 2024-03-30T12:16:17.194 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:16 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:16:18.040 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:17 smithi084 ceph-mon[37565]: pgmap v56: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:18.040 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:17 smithi084 ceph-mon[27000]: pgmap v56: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:18.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:17 smithi162 ceph-mon[30421]: pgmap v56: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:18.505 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-30T12:16:18.505 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-30T12:16:18.505 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10+0 records in 2024-03-30T12:16:18.505 INFO:teuthology.orchestra.run.smithi084.stderr:10+0 records out 2024-03-30T12:16:18.505 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115444 s, 908 MB/s 2024-03-30T12:16:18.505 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping successful for: 2024-03-30T12:16:18.782 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:18 smithi084 ceph-mon[27000]: osdmap e14: 2 total, 2 up, 2 in 2024-03-30T12:16:18.783 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:18 smithi084 ceph-mon[27000]: Detected new or changed devices on smithi084 2024-03-30T12:16:19.093 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:18 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:19.093 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:18 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:19.093 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:18 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:16:19.093 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:18 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:16:19.093 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:18 smithi084 ceph-mon[27000]: Adjusting osd_memory_target on smithi084 to 8032M 2024-03-30T12:16:19.093 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:18 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:19.093 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:18 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:19.093 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:18 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:16:19.093 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:18 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:19.094 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:18 smithi084 ceph-mon[37565]: osdmap e14: 2 total, 2 up, 2 in 2024-03-30T12:16:19.094 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:18 smithi084 ceph-mon[37565]: Detected new or changed devices on smithi084 2024-03-30T12:16:19.094 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:18 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:19.094 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:18 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:19.094 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:18 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:16:19.094 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:18 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:16:19.094 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:18 smithi084 ceph-mon[37565]: Adjusting osd_memory_target on smithi084 to 8032M 2024-03-30T12:16:19.094 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:18 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:19.094 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:18 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:19.094 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:18 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:16:19.094 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:18 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:19.115 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi084:vg_nvme/lv_2 2024-03-30T12:16:19.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:18 smithi162 ceph-mon[30421]: osdmap e14: 2 total, 2 up, 2 in 2024-03-30T12:16:19.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:18 smithi162 ceph-mon[30421]: Detected new or changed devices on smithi084 2024-03-30T12:16:19.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:18 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:19.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:18 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:19.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:18 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:16:19.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:18 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:16:19.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:18 smithi162 ceph-mon[30421]: Adjusting osd_memory_target on smithi084 to 8032M 2024-03-30T12:16:19.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:18 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:19.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:18 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:19.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:18 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:16:19.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:18 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:19.317 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:16:20.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:19 smithi084 ceph-mon[27000]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:20.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:19 smithi084 ceph-mon[37565]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:20.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:19 smithi162 ceph-mon[30421]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:21.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:21 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T12:16:21.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:21 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T12:16:21.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:21 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:21.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:21 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T12:16:21.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:21 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T12:16:21.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:21 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:21.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:21 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T12:16:21.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:21 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T12:16:21.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:21 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:22.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:22 smithi162 ceph-mon[30421]: from='client.24170 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:16:22.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:22 smithi162 ceph-mon[30421]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:22.447 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:22 smithi084 ceph-mon[37565]: from='client.24170 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:16:22.447 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:22 smithi084 ceph-mon[37565]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:22.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:22 smithi084 ceph-mon[27000]: from='client.24170 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:16:22.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:22 smithi084 ceph-mon[27000]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:24.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:24 smithi084 ceph-mon[27000]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:24.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:24 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/25706866' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c21b4cb6-9ade-44d2-a7ba-33fe9b5dd3fa"}]: dispatch 2024-03-30T12:16:24.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:24 smithi084 ceph-mon[27000]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c21b4cb6-9ade-44d2-a7ba-33fe9b5dd3fa"}]: dispatch 2024-03-30T12:16:24.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:24 smithi084 ceph-mon[27000]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c21b4cb6-9ade-44d2-a7ba-33fe9b5dd3fa"}]': finished 2024-03-30T12:16:24.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:24 smithi084 ceph-mon[27000]: osdmap e15: 3 total, 2 up, 3 in 2024-03-30T12:16:24.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:24 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:16:24.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:24 smithi084 ceph-mon[37565]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:24.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:24 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/25706866' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c21b4cb6-9ade-44d2-a7ba-33fe9b5dd3fa"}]: dispatch 2024-03-30T12:16:24.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:24 smithi084 ceph-mon[37565]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c21b4cb6-9ade-44d2-a7ba-33fe9b5dd3fa"}]: dispatch 2024-03-30T12:16:24.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:24 smithi084 ceph-mon[37565]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c21b4cb6-9ade-44d2-a7ba-33fe9b5dd3fa"}]': finished 2024-03-30T12:16:24.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:24 smithi084 ceph-mon[37565]: osdmap e15: 3 total, 2 up, 3 in 2024-03-30T12:16:24.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:24 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:16:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:24 smithi162 ceph-mon[30421]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:24 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/25706866' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c21b4cb6-9ade-44d2-a7ba-33fe9b5dd3fa"}]: dispatch 2024-03-30T12:16:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:24 smithi162 ceph-mon[30421]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c21b4cb6-9ade-44d2-a7ba-33fe9b5dd3fa"}]: dispatch 2024-03-30T12:16:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:24 smithi162 ceph-mon[30421]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c21b4cb6-9ade-44d2-a7ba-33fe9b5dd3fa"}]': finished 2024-03-30T12:16:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:24 smithi162 ceph-mon[30421]: osdmap e15: 3 total, 2 up, 3 in 2024-03-30T12:16:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:24 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:16:25.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:25 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3856543525' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T12:16:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:25 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/3856543525' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T12:16:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:25 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/3856543525' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T12:16:26.464 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:26 smithi084 ceph-mon[37565]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:26.464 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:26 smithi084 ceph-mon[27000]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:26.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:26 smithi162 ceph-mon[30421]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:28.422 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:28 smithi084 ceph-mon[37565]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:28.423 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:28 smithi084 ceph-mon[27000]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:28.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:28 smithi162 ceph-mon[30421]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:30.468 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:30 smithi084 ceph-mon[37565]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:30.468 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:30 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-30T12:16:30.469 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:30 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:30.469 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:30 smithi084 ceph-mon[27000]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:30.469 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:30 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-30T12:16:30.469 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:30 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:30.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:30 smithi162 ceph-mon[30421]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:30.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:30 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-30T12:16:30.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:30 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:31.494 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:31 smithi084 ceph-mon[27000]: Deploying daemon osd.2 on smithi084 2024-03-30T12:16:31.494 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:31 smithi084 ceph-mon[37565]: Deploying daemon osd.2 on smithi084 2024-03-30T12:16:31.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:31 smithi162 ceph-mon[30421]: Deploying daemon osd.2 on smithi084 2024-03-30T12:16:32.205 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:32 smithi084 ceph-mon[37565]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:32.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:32 smithi084 ceph-mon[27000]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:32.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:32 smithi162 ceph-mon[30421]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:34.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:34 smithi084 ceph-mon[27000]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:34.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:34 smithi084 ceph-mon[37565]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:34.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:34 smithi162 ceph-mon[30421]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:36.525 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:36 smithi084 ceph-mon[27000]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:36.525 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:36 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:36.525 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:36 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:36.525 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:36 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:16:36.526 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:36 smithi084 ceph-mon[37565]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:36.526 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:36 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:36.526 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:36 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:36.526 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:36 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:16:36.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:36 smithi162 ceph-mon[30421]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:36.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:36 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:36.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:36 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:36.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:36 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:16:38.367 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:38 smithi084 ceph-mon[37565]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:38.367 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:38 smithi084 ceph-mon[27000]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:38.457 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 2 on host 'smithi084' 2024-03-30T12:16:38.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:38 smithi162 ceph-mon[30421]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:38.968 DEBUG:teuthology.orchestra.run.smithi084:osd.2> sudo journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.2.service 2024-03-30T12:16:38.970 INFO:tasks.cephadm:Deploying osd.3 on smithi084 with /dev/vg_nvme/lv_1... 2024-03-30T12:16:38.970 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-30T12:16:39.222 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:16:39.615 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:39 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:39.615 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:39 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:39.615 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:39 smithi084 ceph-mon[37565]: from='osd.2 [v2:172.21.15.84:6818/3627018831,v1:172.21.15.84:6819/3627018831]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-30T12:16:39.615 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:39 smithi084 ceph-mon[37565]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-30T12:16:39.615 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:39 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:39.615 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:39 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:39.616 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:39 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:39.616 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:39 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:39.616 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:39 smithi084 ceph-mon[27000]: from='osd.2 [v2:172.21.15.84:6818/3627018831,v1:172.21.15.84:6819/3627018831]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-30T12:16:39.616 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:39 smithi084 ceph-mon[27000]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-30T12:16:39.616 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:39 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:39.616 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:39 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:39.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:39 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:39.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:39 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:39.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:39 smithi162 ceph-mon[30421]: from='osd.2 [v2:172.21.15.84:6818/3627018831,v1:172.21.15.84:6819/3627018831]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-30T12:16:39.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:39 smithi162 ceph-mon[30421]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-30T12:16:39.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:39 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:39.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:39 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:40.646 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:40 smithi084 ceph-mon[27000]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:40.646 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:40 smithi084 ceph-mon[27000]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-30T12:16:40.646 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:40 smithi084 ceph-mon[27000]: osdmap e16: 3 total, 2 up, 3 in 2024-03-30T12:16:40.646 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:40 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:16:40.647 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:40 smithi084 ceph-mon[27000]: from='osd.2 [v2:172.21.15.84:6818/3627018831,v1:172.21.15.84:6819/3627018831]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:16:40.647 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:40 smithi084 ceph-mon[27000]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:16:40.647 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:40 smithi084 ceph-mon[37565]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:40.647 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:40 smithi084 ceph-mon[37565]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-30T12:16:40.647 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:40 smithi084 ceph-mon[37565]: osdmap e16: 3 total, 2 up, 3 in 2024-03-30T12:16:40.647 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:40 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:16:40.647 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:40 smithi084 ceph-mon[37565]: from='osd.2 [v2:172.21.15.84:6818/3627018831,v1:172.21.15.84:6819/3627018831]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:16:40.647 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:40 smithi084 ceph-mon[37565]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:16:40.771 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:40 smithi162 ceph-mon[30421]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:40.771 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:40 smithi162 ceph-mon[30421]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-30T12:16:40.771 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:40 smithi162 ceph-mon[30421]: osdmap e16: 3 total, 2 up, 3 in 2024-03-30T12:16:40.771 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:40 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:16:40.771 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:40 smithi162 ceph-mon[30421]: from='osd.2 [v2:172.21.15.84:6818/3627018831,v1:172.21.15.84:6819/3627018831]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:16:40.771 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:40 smithi162 ceph-mon[30421]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:16:40.955 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:16:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[53674]: 2024-03-30T12:16:40.849+0000 7fb1f81b4700 -1 osd.2 0 waiting for initial osdmap 2024-03-30T12:16:40.955 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:16:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[53674]: 2024-03-30T12:16:40.854+0000 7fb1effa1700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T12:16:41.644 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:41 smithi084 ceph-mon[37565]: purged_snaps scrub starts 2024-03-30T12:16:41.644 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:41 smithi084 ceph-mon[37565]: purged_snaps scrub ok 2024-03-30T12:16:41.644 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:41 smithi084 ceph-mon[37565]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-03-30T12:16:41.644 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:41 smithi084 ceph-mon[37565]: osdmap e17: 3 total, 2 up, 3 in 2024-03-30T12:16:41.644 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:41 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:16:41.644 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:41 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:16:41.644 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:41 smithi084 ceph-mon[37565]: from='osd.2 ' entity='osd.2' 2024-03-30T12:16:41.644 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:41 smithi084 ceph-mon[27000]: purged_snaps scrub starts 2024-03-30T12:16:41.644 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:41 smithi084 ceph-mon[27000]: purged_snaps scrub ok 2024-03-30T12:16:41.644 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:41 smithi084 ceph-mon[27000]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-03-30T12:16:41.645 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:41 smithi084 ceph-mon[27000]: osdmap e17: 3 total, 2 up, 3 in 2024-03-30T12:16:41.645 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:41 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:16:41.645 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:41 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:16:41.645 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:41 smithi084 ceph-mon[27000]: from='osd.2 ' entity='osd.2' 2024-03-30T12:16:41.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:41 smithi162 ceph-mon[30421]: purged_snaps scrub starts 2024-03-30T12:16:41.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:41 smithi162 ceph-mon[30421]: purged_snaps scrub ok 2024-03-30T12:16:41.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:41 smithi162 ceph-mon[30421]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-03-30T12:16:41.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:41 smithi162 ceph-mon[30421]: osdmap e17: 3 total, 2 up, 3 in 2024-03-30T12:16:41.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:41 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:16:41.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:41 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:16:41.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:41 smithi162 ceph-mon[30421]: from='osd.2 ' entity='osd.2' 2024-03-30T12:16:42.403 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-30T12:16:42.403 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-30T12:16:42.403 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10+0 records in 2024-03-30T12:16:42.403 INFO:teuthology.orchestra.run.smithi084.stderr:10+0 records out 2024-03-30T12:16:42.403 INFO:teuthology.orchestra.run.smithi084.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0122651 s, 855 MB/s 2024-03-30T12:16:42.403 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping successful for: 2024-03-30T12:16:42.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:42 smithi084 ceph-mon[27000]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:42.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:42 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:16:42.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:42 smithi084 ceph-mon[27000]: osd.2 [v2:172.21.15.84:6818/3627018831,v1:172.21.15.84:6819/3627018831] boot 2024-03-30T12:16:42.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:42 smithi084 ceph-mon[27000]: osdmap e18: 3 total, 3 up, 3 in 2024-03-30T12:16:42.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:42 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:16:42.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:42 smithi084 ceph-mon[37565]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:42.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:42 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:16:42.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:42 smithi084 ceph-mon[37565]: osd.2 [v2:172.21.15.84:6818/3627018831,v1:172.21.15.84:6819/3627018831] boot 2024-03-30T12:16:42.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:42 smithi084 ceph-mon[37565]: osdmap e18: 3 total, 3 up, 3 in 2024-03-30T12:16:42.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:42 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:16:42.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:42 smithi162 ceph-mon[30421]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-30T12:16:42.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:42 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:16:42.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:42 smithi162 ceph-mon[30421]: osd.2 [v2:172.21.15.84:6818/3627018831,v1:172.21.15.84:6819/3627018831] boot 2024-03-30T12:16:42.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:42 smithi162 ceph-mon[30421]: osdmap e18: 3 total, 3 up, 3 in 2024-03-30T12:16:42.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:42 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:16:43.106 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi084:vg_nvme/lv_1 2024-03-30T12:16:43.669 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:16:43.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:43 smithi084 ceph-mon[27000]: pgmap v74: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-30T12:16:43.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:43 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-30T12:16:43.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:43 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-30T12:16:43.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:43 smithi084 ceph-mon[27000]: osdmap e19: 3 total, 3 up, 3 in 2024-03-30T12:16:43.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:43 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T12:16:43.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:43 smithi084 ceph-mon[37565]: pgmap v74: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-30T12:16:43.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:43 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-30T12:16:43.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:43 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-30T12:16:43.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:43 smithi084 ceph-mon[37565]: osdmap e19: 3 total, 3 up, 3 in 2024-03-30T12:16:43.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:43 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T12:16:43.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:43 smithi162 ceph-mon[30421]: pgmap v74: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-30T12:16:43.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:43 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-30T12:16:43.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:43 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-30T12:16:43.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:43 smithi162 ceph-mon[30421]: osdmap e19: 3 total, 3 up, 3 in 2024-03-30T12:16:43.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:43 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T12:16:44.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[27000]: Detected new or changed devices on smithi084 2024-03-30T12:16:44.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:44.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:44.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:16:44.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:16:44.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:16:44.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[27000]: Adjusting osd_memory_target on smithi084 to 5354M 2024-03-30T12:16:44.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:44.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:44.916 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:16:44.916 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:44.916 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:16:44.916 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:44.916 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:16:44.916 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:44.916 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-30T12:16:44.916 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[27000]: osdmap e20: 3 total, 3 up, 3 in 2024-03-30T12:16:44.916 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[37565]: Detected new or changed devices on smithi084 2024-03-30T12:16:44.916 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:44.916 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:44.916 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:16:44.916 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:16:44.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:16:44.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[37565]: Adjusting osd_memory_target on smithi084 to 5354M 2024-03-30T12:16:44.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:44.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:44.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:16:44.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:44.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:16:44.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:44.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:16:44.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:44.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-30T12:16:44.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:44 smithi084 ceph-mon[37565]: osdmap e20: 3 total, 3 up, 3 in 2024-03-30T12:16:45.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:44 smithi162 ceph-mon[30421]: Detected new or changed devices on smithi084 2024-03-30T12:16:45.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:44 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:45.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:44 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:45.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:44 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:16:45.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:44 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:16:45.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:44 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:16:45.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:44 smithi162 ceph-mon[30421]: Adjusting osd_memory_target on smithi084 to 5354M 2024-03-30T12:16:45.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:44 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:45.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:44 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:45.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:44 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:16:45.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:44 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:45.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:44 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:16:45.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:44 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:45.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:44 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:16:45.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:44 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:45.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:44 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-30T12:16:45.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:44 smithi162 ceph-mon[30421]: osdmap e20: 3 total, 3 up, 3 in 2024-03-30T12:16:45.916 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:16:45 smithi084 sudo[57702]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-30T12:16:45.917 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:16:45 smithi084 sudo[57702]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-30T12:16:45.917 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:16:45 smithi084 sudo[57702]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-30T12:16:45.917 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:16:45 smithi084 sudo[57702]: pam_unix(sudo:session): session closed for user root 2024-03-30T12:16:45.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:45 smithi084 ceph-mon[37565]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-30T12:16:45.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:45 smithi084 ceph-mon[37565]: from='client.24197 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:16:45.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:45 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T12:16:45.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:45 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T12:16:45.917 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:45 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:45.917 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:45 smithi084 ceph-mon[27000]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-30T12:16:45.918 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:45 smithi084 ceph-mon[27000]: from='client.24197 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:16:45.918 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:45 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T12:16:45.918 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:45 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T12:16:45.918 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:45 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:45 smithi162 ceph-mon[30421]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-30T12:16:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:45 smithi162 ceph-mon[30421]: from='client.24197 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:16:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:45 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T12:16:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:45 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T12:16:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:45 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:46.193 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:16:45 smithi084 sudo[57761]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-30T12:16:46.193 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:16:45 smithi084 sudo[57761]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-30T12:16:46.194 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:16:45 smithi084 sudo[57761]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-30T12:16:46.194 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:16:45 smithi084 sudo[57761]: pam_unix(sudo:session): session closed for user root 2024-03-30T12:16:46.458 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:16:46 smithi084 sudo[57781]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-30T12:16:46.458 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:16:46 smithi084 sudo[57781]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-30T12:16:46.458 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:16:46 smithi084 sudo[57781]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-30T12:16:46.458 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:16:46 smithi084 sudo[57781]: pam_unix(sudo:session): session closed for user root 2024-03-30T12:16:46.713 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:16:46 smithi084 sudo[57787]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-30T12:16:46.713 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:16:46 smithi084 sudo[57787]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-30T12:16:46.713 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:16:46 smithi084 sudo[57787]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-30T12:16:46.713 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:16:46 smithi084 sudo[57787]: pam_unix(sudo:session): session closed for user root 2024-03-30T12:16:46.985 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:46 smithi084 ceph-mon[37565]: osdmap e21: 3 total, 3 up, 3 in 2024-03-30T12:16:46.985 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:46 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:46.986 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:16:46 smithi084 sudo[57798]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-30T12:16:46.986 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:16:46 smithi084 sudo[57798]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-30T12:16:46.986 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:16:46 smithi084 sudo[57798]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-30T12:16:46.986 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:16:46 smithi084 sudo[57798]: pam_unix(sudo:session): session closed for user root 2024-03-30T12:16:46.986 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:46 smithi084 ceph-mon[27000]: osdmap e21: 3 total, 3 up, 3 in 2024-03-30T12:16:46.986 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:46 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:47.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:46 smithi162 ceph-mon[30421]: osdmap e21: 3 total, 3 up, 3 in 2024-03-30T12:16:47.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:46 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:47.244 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:16:46 smithi084 sudo[57826]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-30T12:16:47.244 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:16:46 smithi084 sudo[57826]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-30T12:16:47.244 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:16:46 smithi084 sudo[57826]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-30T12:16:47.244 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:16:47 smithi084 sudo[57826]: pam_unix(sudo:session): session closed for user root 2024-03-30T12:16:47.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:47 smithi084 sudo[57833]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-30T12:16:47.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:47 smithi084 sudo[57833]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-30T12:16:47.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:47 smithi084 sudo[57833]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-30T12:16:47.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:47 smithi084 sudo[57833]: pam_unix(sudo:session): session closed for user root 2024-03-30T12:16:48.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:47 smithi084 sudo[57845]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-30T12:16:48.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:47 smithi084 sudo[57845]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-30T12:16:48.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:47 smithi084 sudo[57845]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-30T12:16:48.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:47 smithi084 sudo[57845]: pam_unix(sudo:session): session closed for user root 2024-03-30T12:16:48.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:47 smithi162 sudo[32846]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-30T12:16:48.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:47 smithi162 sudo[32846]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-30T12:16:48.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:47 smithi162 sudo[32846]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-30T12:16:48.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:47 smithi162 sudo[32846]: pam_unix(sudo:session): session closed for user root 2024-03-30T12:16:48.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:48 smithi162 sudo[32849]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-30T12:16:48.283 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:48 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T12:16:48.283 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:48 smithi084 ceph-mon[37565]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-30T12:16:48.283 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:48 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T12:16:48.283 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:48 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:16:48.283 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:48 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:16:48.283 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:48 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:16:48.283 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:48 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:16:48.283 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:48 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:16:48.283 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:48 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:16:48.283 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:48 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T12:16:48.283 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:48 smithi084 ceph-mon[27000]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-30T12:16:48.284 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:48 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T12:16:48.284 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:48 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:16:48.284 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:48 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:16:48.284 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:48 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:16:48.284 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:48 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:16:48.284 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:48 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:16:48.284 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:48 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:16:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:48 smithi162 sudo[32849]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-30T12:16:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:48 smithi162 sudo[32849]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-30T12:16:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:48 smithi162 sudo[32849]: pam_unix(sudo:session): session closed for user root 2024-03-30T12:16:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:48 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T12:16:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:48 smithi162 ceph-mon[30421]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-30T12:16:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:48 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T12:16:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:48 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:16:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:48 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:16:48.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:48 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:16:48.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:48 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:16:48.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:48 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:16:48.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:48 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:16:48.540 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:48 smithi084 sudo[57892]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-30T12:16:48.540 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:48 smithi084 sudo[57892]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-30T12:16:48.540 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:48 smithi084 sudo[57892]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-30T12:16:48.540 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:48 smithi084 sudo[57892]: pam_unix(sudo:session): session closed for user root 2024-03-30T12:16:49.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:48 smithi084 sudo[57923]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-30T12:16:49.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:48 smithi084 sudo[57923]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-30T12:16:49.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:48 smithi084 sudo[57923]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-30T12:16:49.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:48 smithi084 sudo[57923]: pam_unix(sudo:session): session closed for user root 2024-03-30T12:16:49.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:49 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T12:16:49.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:49 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/1400249983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d60cb7da-fc49-4cbf-855a-2957dcbf66b9"}]: dispatch 2024-03-30T12:16:49.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:49 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T12:16:49.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:49 smithi162 ceph-mon[30421]: mgrmap e15: y(active, since 2m), standbys: x 2024-03-30T12:16:49.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:49 smithi162 ceph-mon[30421]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d60cb7da-fc49-4cbf-855a-2957dcbf66b9"}]: dispatch 2024-03-30T12:16:49.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:49 smithi162 ceph-mon[30421]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d60cb7da-fc49-4cbf-855a-2957dcbf66b9"}]': finished 2024-03-30T12:16:49.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:49 smithi162 ceph-mon[30421]: osdmap e22: 4 total, 3 up, 4 in 2024-03-30T12:16:49.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:49 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:16:49.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:49 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:49.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:49 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T12:16:49.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:49 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:16:49.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:49 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:16:49.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:49 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:16:49.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:49 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T12:16:49.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:49 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/3990175227' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T12:16:49.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T12:16:49.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/1400249983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d60cb7da-fc49-4cbf-855a-2957dcbf66b9"}]: dispatch 2024-03-30T12:16:49.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T12:16:49.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[27000]: mgrmap e15: y(active, since 2m), standbys: x 2024-03-30T12:16:49.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[27000]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d60cb7da-fc49-4cbf-855a-2957dcbf66b9"}]: dispatch 2024-03-30T12:16:49.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[27000]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d60cb7da-fc49-4cbf-855a-2957dcbf66b9"}]': finished 2024-03-30T12:16:49.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[27000]: osdmap e22: 4 total, 3 up, 4 in 2024-03-30T12:16:49.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:16:49.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:49.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T12:16:49.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:16:49.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:16:49.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:16:49.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T12:16:49.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3990175227' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T12:16:49.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T12:16:49.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/1400249983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d60cb7da-fc49-4cbf-855a-2957dcbf66b9"}]: dispatch 2024-03-30T12:16:49.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T12:16:49.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[37565]: mgrmap e15: y(active, since 2m), standbys: x 2024-03-30T12:16:49.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[37565]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d60cb7da-fc49-4cbf-855a-2957dcbf66b9"}]: dispatch 2024-03-30T12:16:49.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[37565]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d60cb7da-fc49-4cbf-855a-2957dcbf66b9"}]': finished 2024-03-30T12:16:49.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[37565]: osdmap e22: 4 total, 3 up, 4 in 2024-03-30T12:16:49.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:16:49.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:16:49.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T12:16:49.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:16:49.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:16:49.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:16:49.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T12:16:49.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:49 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/3990175227' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T12:16:50.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:50 smithi162 ceph-mon[30421]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-30T12:16:50.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:50 smithi084 ceph-mon[27000]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-30T12:16:50.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:50 smithi084 ceph-mon[37565]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-30T12:16:52.398 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:52 smithi084 ceph-mon[27000]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-30T12:16:52.399 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:52 smithi084 ceph-mon[37565]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-30T12:16:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:52 smithi162 ceph-mon[30421]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-30T12:16:54.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:54 smithi084 ceph-mon[37565]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-03-30T12:16:54.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:54 smithi084 ceph-mon[27000]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-03-30T12:16:54.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:54 smithi162 ceph-mon[30421]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-03-30T12:16:55.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:55 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-30T12:16:55.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:55 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:55.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:55 smithi084 ceph-mon[27000]: Deploying daemon osd.3 on smithi084 2024-03-30T12:16:55.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:55 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-30T12:16:55.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:55 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:55.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:55 smithi084 ceph-mon[37565]: Deploying daemon osd.3 on smithi084 2024-03-30T12:16:55.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:55 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-30T12:16:55.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:55 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:16:55.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:55 smithi162 ceph-mon[30421]: Deploying daemon osd.3 on smithi084 2024-03-30T12:16:56.450 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:56 smithi084 ceph-mon[37565]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-03-30T12:16:56.451 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:56 smithi084 ceph-mon[27000]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-03-30T12:16:56.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:56 smithi162 ceph-mon[30421]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-03-30T12:16:58.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:16:58 smithi084 ceph-mon[27000]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-03-30T12:16:58.420 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:16:58 smithi084 ceph-mon[37565]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-03-30T12:16:58.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:16:58 smithi162 ceph-mon[30421]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-03-30T12:17:00.342 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:00 smithi084 ceph-mon[37565]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 71 KiB/s wr, 5 op/s 2024-03-30T12:17:00.342 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:00 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:00.342 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:00 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:00.342 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:00 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:17:00.342 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:00 smithi084 ceph-mon[27000]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 71 KiB/s wr, 5 op/s 2024-03-30T12:17:00.343 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:00 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:00.343 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:00 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:00.343 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:00 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:17:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:00 smithi162 ceph-mon[30421]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 71 KiB/s wr, 5 op/s 2024-03-30T12:17:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:00 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:00 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:00 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:17:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:02 smithi084 ceph-mon[37565]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-30T12:17:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:02 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:02 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:02.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:02 smithi084 ceph-mon[27000]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-30T12:17:02.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:02 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:02.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:02 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:02.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:02 smithi162 ceph-mon[30421]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-30T12:17:02.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:02 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:02.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:02 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:02.992 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 3 on host 'smithi084' 2024-03-30T12:17:03.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:03 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:03.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:03 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:17:03.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:03 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:03.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:03 smithi084 ceph-mon[27000]: from='osd.3 [v2:172.21.15.84:6826/46835826,v1:172.21.15.84:6827/46835826]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-30T12:17:03.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:03 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:03.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:03 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:03.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:03 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:17:03.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:03 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:03.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:03 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:17:03.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:03 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:03.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:03 smithi084 ceph-mon[37565]: from='osd.3 [v2:172.21.15.84:6826/46835826,v1:172.21.15.84:6827/46835826]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-30T12:17:03.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:03 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:03.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:03 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:03.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:03 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:17:03.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:03 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:03.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:03 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:17:03.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:03 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:03.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:03 smithi162 ceph-mon[30421]: from='osd.3 [v2:172.21.15.84:6826/46835826,v1:172.21.15.84:6827/46835826]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-30T12:17:03.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:03 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:03.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:03 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:03.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:03 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:17:03.641 DEBUG:teuthology.orchestra.run.smithi084:osd.3> sudo journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.3.service 2024-03-30T12:17:03.643 INFO:tasks.cephadm:Deploying osd.4 on smithi162 with /dev/vg_nvme/lv_4... 2024-03-30T12:17:03.643 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-30T12:17:03.854 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T12:17:04.251 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:04 smithi162 ceph-mon[30421]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-30T12:17:04.251 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:04 smithi162 ceph-mon[30421]: from='osd.3 [v2:172.21.15.84:6826/46835826,v1:172.21.15.84:6827/46835826]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-30T12:17:04.251 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:04 smithi162 ceph-mon[30421]: osdmap e23: 4 total, 3 up, 4 in 2024-03-30T12:17:04.251 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:04 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:17:04.251 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:04 smithi162 ceph-mon[30421]: from='osd.3 [v2:172.21.15.84:6826/46835826,v1:172.21.15.84:6827/46835826]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:17:04.472 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:04 smithi084 ceph-mon[27000]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-30T12:17:04.472 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:04 smithi084 ceph-mon[27000]: from='osd.3 [v2:172.21.15.84:6826/46835826,v1:172.21.15.84:6827/46835826]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-30T12:17:04.472 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:04 smithi084 ceph-mon[27000]: osdmap e23: 4 total, 3 up, 4 in 2024-03-30T12:17:04.472 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:04 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:17:04.472 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:04 smithi084 ceph-mon[27000]: from='osd.3 [v2:172.21.15.84:6826/46835826,v1:172.21.15.84:6827/46835826]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:17:04.473 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:04 smithi084 ceph-mon[37565]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-30T12:17:04.473 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:04 smithi084 ceph-mon[37565]: from='osd.3 [v2:172.21.15.84:6826/46835826,v1:172.21.15.84:6827/46835826]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-30T12:17:04.473 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:04 smithi084 ceph-mon[37565]: osdmap e23: 4 total, 3 up, 4 in 2024-03-30T12:17:04.473 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:04 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:17:04.473 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:04 smithi084 ceph-mon[37565]: from='osd.3 [v2:172.21.15.84:6826/46835826,v1:172.21.15.84:6827/46835826]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:17:05.001 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:17:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3[59573]: 2024-03-30T12:17:04.728+0000 7fa2c46bc700 -1 osd.3 0 waiting for initial osdmap 2024-03-30T12:17:05.001 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:17:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3[59573]: 2024-03-30T12:17:04.732+0000 7fa2c04b1700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T12:17:05.698 INFO:teuthology.orchestra.run.smithi162.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-30T12:17:05.698 INFO:teuthology.orchestra.run.smithi162.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-30T12:17:05.699 INFO:teuthology.orchestra.run.smithi162.stderr: stderr: 10+0 records in 2024-03-30T12:17:05.699 INFO:teuthology.orchestra.run.smithi162.stderr:10+0 records out 2024-03-30T12:17:05.699 INFO:teuthology.orchestra.run.smithi162.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112924 s, 929 MB/s 2024-03-30T12:17:05.699 INFO:teuthology.orchestra.run.smithi162.stderr:--> Zapping successful for: 2024-03-30T12:17:05.993 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:05 smithi162 ceph-mon[30421]: from='osd.3 [v2:172.21.15.84:6826/46835826,v1:172.21.15.84:6827/46835826]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-03-30T12:17:05.994 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:05 smithi162 ceph-mon[30421]: osdmap e24: 4 total, 3 up, 4 in 2024-03-30T12:17:05.994 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:05 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:17:05.994 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:05 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:17:05.994 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:05 smithi162 ceph-mon[30421]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-30T12:17:06.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:05 smithi084 ceph-mon[27000]: from='osd.3 [v2:172.21.15.84:6826/46835826,v1:172.21.15.84:6827/46835826]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-03-30T12:17:06.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:05 smithi084 ceph-mon[27000]: osdmap e24: 4 total, 3 up, 4 in 2024-03-30T12:17:06.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:05 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:17:06.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:05 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:17:06.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:05 smithi084 ceph-mon[27000]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-30T12:17:06.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:05 smithi084 ceph-mon[37565]: from='osd.3 [v2:172.21.15.84:6826/46835826,v1:172.21.15.84:6827/46835826]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-03-30T12:17:06.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:05 smithi084 ceph-mon[37565]: osdmap e24: 4 total, 3 up, 4 in 2024-03-30T12:17:06.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:05 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:17:06.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:05 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:17:06.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:05 smithi084 ceph-mon[37565]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-30T12:17:06.293 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi162:vg_nvme/lv_4 2024-03-30T12:17:06.499 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T12:17:06.832 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:06 smithi162 ceph-mon[30421]: purged_snaps scrub starts 2024-03-30T12:17:06.832 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:06 smithi162 ceph-mon[30421]: purged_snaps scrub ok 2024-03-30T12:17:06.832 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:06 smithi162 ceph-mon[30421]: osd.3 [v2:172.21.15.84:6826/46835826,v1:172.21.15.84:6827/46835826] boot 2024-03-30T12:17:06.832 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:06 smithi162 ceph-mon[30421]: osdmap e25: 4 total, 4 up, 4 in 2024-03-30T12:17:06.832 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:06 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:17:06.832 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:06 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:06.832 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:06 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:06.832 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:06 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:17:06.832 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:06 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:17:06.832 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:06 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:17:06.832 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:06 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:17:06.832 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:06 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:06.833 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:06 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:06.833 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:06 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:17:06.833 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:06 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:07.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[27000]: purged_snaps scrub starts 2024-03-30T12:17:07.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[27000]: purged_snaps scrub ok 2024-03-30T12:17:07.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[27000]: osd.3 [v2:172.21.15.84:6826/46835826,v1:172.21.15.84:6827/46835826] boot 2024-03-30T12:17:07.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[27000]: osdmap e25: 4 total, 4 up, 4 in 2024-03-30T12:17:07.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:17:07.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:07.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:17:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:17:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:17:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:17:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:17:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:07.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[37565]: purged_snaps scrub starts 2024-03-30T12:17:07.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[37565]: purged_snaps scrub ok 2024-03-30T12:17:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[37565]: osd.3 [v2:172.21.15.84:6826/46835826,v1:172.21.15.84:6827/46835826] boot 2024-03-30T12:17:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[37565]: osdmap e25: 4 total, 4 up, 4 in 2024-03-30T12:17:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:17:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:17:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:17:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:17:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:17:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:17:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:06 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:07.988 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:07 smithi162 ceph-mon[30421]: Detected new or changed devices on smithi084 2024-03-30T12:17:07.988 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:07 smithi162 ceph-mon[30421]: Adjusting osd_memory_target on smithi084 to 4016M 2024-03-30T12:17:07.988 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:07 smithi162 ceph-mon[30421]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:08.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:07 smithi084 ceph-mon[27000]: Detected new or changed devices on smithi084 2024-03-30T12:17:08.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:07 smithi084 ceph-mon[27000]: Adjusting osd_memory_target on smithi084 to 4016M 2024-03-30T12:17:08.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:07 smithi084 ceph-mon[27000]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:08.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:07 smithi084 ceph-mon[37565]: Detected new or changed devices on smithi084 2024-03-30T12:17:08.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:07 smithi084 ceph-mon[37565]: Adjusting osd_memory_target on smithi084 to 4016M 2024-03-30T12:17:08.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:07 smithi084 ceph-mon[37565]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:08.966 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:08 smithi162 ceph-mon[30421]: osdmap e26: 4 total, 4 up, 4 in 2024-03-30T12:17:08.966 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:08 smithi162 ceph-mon[30421]: from='client.24193 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:17:08.966 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:08 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T12:17:08.966 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:08 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T12:17:08.966 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:08 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:09.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:08 smithi084 ceph-mon[27000]: osdmap e26: 4 total, 4 up, 4 in 2024-03-30T12:17:09.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:08 smithi084 ceph-mon[27000]: from='client.24193 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:17:09.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:08 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T12:17:09.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:08 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T12:17:09.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:08 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:09.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:08 smithi084 ceph-mon[37565]: osdmap e26: 4 total, 4 up, 4 in 2024-03-30T12:17:09.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:08 smithi084 ceph-mon[37565]: from='client.24193 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:17:09.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:08 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T12:17:09.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:08 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T12:17:09.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:08 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:09.973 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:09 smithi162 ceph-mon[30421]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:10.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:09 smithi084 ceph-mon[27000]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:10.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:09 smithi084 ceph-mon[37565]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:11.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:10 smithi084 ceph-mon[27000]: from='client.? 172.21.15.162:0/4019205268' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46a5087f-cf7c-4bb2-bace-6e04d57496ac"}]: dispatch 2024-03-30T12:17:11.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:10 smithi084 ceph-mon[27000]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46a5087f-cf7c-4bb2-bace-6e04d57496ac"}]: dispatch 2024-03-30T12:17:11.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:10 smithi084 ceph-mon[27000]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46a5087f-cf7c-4bb2-bace-6e04d57496ac"}]': finished 2024-03-30T12:17:11.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:10 smithi084 ceph-mon[27000]: osdmap e27: 5 total, 4 up, 5 in 2024-03-30T12:17:11.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:10 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:17:11.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:10 smithi084 ceph-mon[37565]: from='client.? 172.21.15.162:0/4019205268' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46a5087f-cf7c-4bb2-bace-6e04d57496ac"}]: dispatch 2024-03-30T12:17:11.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:10 smithi084 ceph-mon[37565]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46a5087f-cf7c-4bb2-bace-6e04d57496ac"}]: dispatch 2024-03-30T12:17:11.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:10 smithi084 ceph-mon[37565]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46a5087f-cf7c-4bb2-bace-6e04d57496ac"}]': finished 2024-03-30T12:17:11.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:10 smithi084 ceph-mon[37565]: osdmap e27: 5 total, 4 up, 5 in 2024-03-30T12:17:11.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:10 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:17:11.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:10 smithi162 ceph-mon[30421]: from='client.? 172.21.15.162:0/4019205268' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46a5087f-cf7c-4bb2-bace-6e04d57496ac"}]: dispatch 2024-03-30T12:17:11.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:10 smithi162 ceph-mon[30421]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46a5087f-cf7c-4bb2-bace-6e04d57496ac"}]: dispatch 2024-03-30T12:17:11.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:10 smithi162 ceph-mon[30421]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46a5087f-cf7c-4bb2-bace-6e04d57496ac"}]': finished 2024-03-30T12:17:11.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:10 smithi162 ceph-mon[30421]: osdmap e27: 5 total, 4 up, 5 in 2024-03-30T12:17:11.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:10 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:17:12.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:11 smithi084 ceph-mon[27000]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:12.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:11 smithi084 ceph-mon[27000]: from='client.? 172.21.15.162:0/1273754476' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T12:17:12.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:11 smithi084 ceph-mon[37565]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:12.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:11 smithi084 ceph-mon[37565]: from='client.? 172.21.15.162:0/1273754476' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T12:17:12.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:11 smithi162 ceph-mon[30421]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:12.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:11 smithi162 ceph-mon[30421]: from='client.? 172.21.15.162:0/1273754476' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T12:17:14.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:14 smithi084 ceph-mon[37565]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:14 smithi084 ceph-mon[27000]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:14.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:14 smithi162 ceph-mon[30421]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:16.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:15 smithi162 ceph-mon[30421]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:16.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:15 smithi084 ceph-mon[37565]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:16.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:15 smithi084 ceph-mon[27000]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:16 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-30T12:17:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:16 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:17.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:16 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-30T12:17:17.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:16 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:17.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:16 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-30T12:17:17.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:16 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:18.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:17 smithi084 ceph-mon[27000]: Deploying daemon osd.4 on smithi162 2024-03-30T12:17:18.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:17 smithi084 ceph-mon[27000]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:18.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:17 smithi084 ceph-mon[37565]: Deploying daemon osd.4 on smithi162 2024-03-30T12:17:18.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:17 smithi084 ceph-mon[37565]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:18.281 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:17 smithi162 ceph-mon[30421]: Deploying daemon osd.4 on smithi162 2024-03-30T12:17:18.281 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:17 smithi162 ceph-mon[30421]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:20.452 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:20 smithi162 ceph-mon[30421]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:20.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:20 smithi084 ceph-mon[27000]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:20 smithi084 ceph-mon[37565]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:22.503 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:22 smithi162 ceph-mon[30421]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:22.503 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:22 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:22.503 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:22 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:22.503 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:22 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:17:22.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:22 smithi084 ceph-mon[27000]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:22.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:22 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:22.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:22 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:22.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:22 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:17:22.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:22 smithi084 ceph-mon[37565]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:22.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:22 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:22.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:22 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:22.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:22 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:17:24.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:24 smithi084 ceph-mon[27000]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:24.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:24 smithi084 ceph-mon[37565]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:24.617 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:24 smithi162 ceph-mon[30421]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:25.319 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 4 on host 'smithi162' 2024-03-30T12:17:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:25 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:25 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:25 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:25 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:17:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:25 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:25 smithi162 ceph-mon[30421]: from='osd.4 [v2:172.21.15.162:6800/592935958,v1:172.21.15.162:6801/592935958]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T12:17:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:25 smithi162 ceph-mon[30421]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T12:17:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:25 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:25 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:25 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:17:25.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:25 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:25.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:25 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:25.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:25 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:25.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:25 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:17:25.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:25 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:25.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:25 smithi084 ceph-mon[27000]: from='osd.4 [v2:172.21.15.162:6800/592935958,v1:172.21.15.162:6801/592935958]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T12:17:25.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:25 smithi084 ceph-mon[27000]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T12:17:25.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:25 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:25.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:25 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:25.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:25 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:17:25.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:25 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:25.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:25 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:25.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:25 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:25.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:25 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:17:25.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:25 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:25.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:25 smithi084 ceph-mon[37565]: from='osd.4 [v2:172.21.15.162:6800/592935958,v1:172.21.15.162:6801/592935958]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T12:17:25.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:25 smithi084 ceph-mon[37565]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T12:17:25.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:25 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:25.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:25 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:25.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:25 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:17:25.929 DEBUG:teuthology.orchestra.run.smithi162:osd.4> sudo journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.4.service 2024-03-30T12:17:25.931 INFO:tasks.cephadm:Deploying osd.5 on smithi162 with /dev/vg_nvme/lv_3... 2024-03-30T12:17:25.931 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-30T12:17:26.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:26 smithi162 ceph-mon[30421]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:26.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:26 smithi162 ceph-mon[30421]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-30T12:17:26.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:26 smithi162 ceph-mon[30421]: osdmap e28: 5 total, 4 up, 5 in 2024-03-30T12:17:26.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:26 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:17:26.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:26 smithi162 ceph-mon[30421]: from='osd.4 [v2:172.21.15.162:6800/592935958,v1:172.21.15.162:6801/592935958]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:17:26.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:26 smithi162 ceph-mon[30421]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:17:26.739 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T12:17:26.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:26 smithi084 ceph-mon[27000]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:26.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:26 smithi084 ceph-mon[27000]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-30T12:17:26.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:26 smithi084 ceph-mon[27000]: osdmap e28: 5 total, 4 up, 5 in 2024-03-30T12:17:26.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:26 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:17:26.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:26 smithi084 ceph-mon[27000]: from='osd.4 [v2:172.21.15.162:6800/592935958,v1:172.21.15.162:6801/592935958]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:17:26.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:26 smithi084 ceph-mon[27000]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:17:26.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:26 smithi084 ceph-mon[37565]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:26.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:26 smithi084 ceph-mon[37565]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-30T12:17:26.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:26 smithi084 ceph-mon[37565]: osdmap e28: 5 total, 4 up, 5 in 2024-03-30T12:17:26.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:26 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:17:26.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:26 smithi084 ceph-mon[37565]: from='osd.4 [v2:172.21.15.162:6800/592935958,v1:172.21.15.162:6801/592935958]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:17:26.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:26 smithi084 ceph-mon[37565]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:17:27.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:17:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[35199]: 2024-03-30T12:17:27.466+0000 7fee98754700 -1 osd.4 0 waiting for initial osdmap 2024-03-30T12:17:27.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:17:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[35199]: 2024-03-30T12:17:27.470+0000 7fee8fd40700 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T12:17:28.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:28 smithi162 ceph-mon[30421]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-03-30T12:17:28.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:28 smithi162 ceph-mon[30421]: osdmap e29: 5 total, 4 up, 5 in 2024-03-30T12:17:28.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:28 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:17:28.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:28 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:17:28.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:28 smithi162 ceph-mon[30421]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:28.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:28 smithi162 ceph-mon[30421]: from='osd.4 ' entity='osd.4' 2024-03-30T12:17:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:28 smithi084 ceph-mon[27000]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-03-30T12:17:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:28 smithi084 ceph-mon[27000]: osdmap e29: 5 total, 4 up, 5 in 2024-03-30T12:17:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:28 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:17:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:28 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:17:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:28 smithi084 ceph-mon[27000]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:28 smithi084 ceph-mon[27000]: from='osd.4 ' entity='osd.4' 2024-03-30T12:17:28.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:28 smithi084 ceph-mon[37565]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-03-30T12:17:28.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:28 smithi084 ceph-mon[37565]: osdmap e29: 5 total, 4 up, 5 in 2024-03-30T12:17:28.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:28 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:17:28.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:28 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:17:28.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:28 smithi084 ceph-mon[37565]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-30T12:17:28.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:28 smithi084 ceph-mon[37565]: from='osd.4 ' entity='osd.4' 2024-03-30T12:17:29.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:29 smithi162 ceph-mon[30421]: purged_snaps scrub starts 2024-03-30T12:17:29.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:29 smithi162 ceph-mon[30421]: purged_snaps scrub ok 2024-03-30T12:17:29.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:29 smithi162 ceph-mon[30421]: osd.4 [v2:172.21.15.162:6800/592935958,v1:172.21.15.162:6801/592935958] boot 2024-03-30T12:17:29.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:29 smithi162 ceph-mon[30421]: osdmap e30: 5 total, 5 up, 5 in 2024-03-30T12:17:29.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:29 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:17:29.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:29 smithi084 ceph-mon[27000]: purged_snaps scrub starts 2024-03-30T12:17:29.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:29 smithi084 ceph-mon[27000]: purged_snaps scrub ok 2024-03-30T12:17:29.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:29 smithi084 ceph-mon[27000]: osd.4 [v2:172.21.15.162:6800/592935958,v1:172.21.15.162:6801/592935958] boot 2024-03-30T12:17:29.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:29 smithi084 ceph-mon[27000]: osdmap e30: 5 total, 5 up, 5 in 2024-03-30T12:17:29.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:29 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:17:29.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:29 smithi084 ceph-mon[37565]: purged_snaps scrub starts 2024-03-30T12:17:29.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:29 smithi084 ceph-mon[37565]: purged_snaps scrub ok 2024-03-30T12:17:29.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:29 smithi084 ceph-mon[37565]: osd.4 [v2:172.21.15.162:6800/592935958,v1:172.21.15.162:6801/592935958] boot 2024-03-30T12:17:29.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:29 smithi084 ceph-mon[37565]: osdmap e30: 5 total, 5 up, 5 in 2024-03-30T12:17:29.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:29 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:17:30.066 INFO:teuthology.orchestra.run.smithi162.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-30T12:17:30.066 INFO:teuthology.orchestra.run.smithi162.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-30T12:17:30.066 INFO:teuthology.orchestra.run.smithi162.stderr: stderr: 10+0 records in 2024-03-30T12:17:30.066 INFO:teuthology.orchestra.run.smithi162.stderr:10+0 records out 2024-03-30T12:17:30.066 INFO:teuthology.orchestra.run.smithi162.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0133298 s, 787 MB/s 2024-03-30T12:17:30.066 INFO:teuthology.orchestra.run.smithi162.stderr:--> Zapping successful for: 2024-03-30T12:17:30.365 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:30 smithi162 ceph-mon[30421]: osdmap e31: 5 total, 5 up, 5 in 2024-03-30T12:17:30.365 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:30 smithi162 ceph-mon[30421]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-30T12:17:30.365 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:30 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:30.365 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:30 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:30.365 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:30 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:17:30.365 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:30 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:30.365 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:30 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:30.366 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:30 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:17:30.366 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:30 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:30.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:30 smithi084 ceph-mon[27000]: osdmap e31: 5 total, 5 up, 5 in 2024-03-30T12:17:30.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:30 smithi084 ceph-mon[27000]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-30T12:17:30.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:30 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:30.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:30 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:30.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:30 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:17:30.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:30 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:30.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:30 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:30.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:30 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:17:30.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:30 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:30.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:30 smithi084 ceph-mon[37565]: osdmap e31: 5 total, 5 up, 5 in 2024-03-30T12:17:30.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:30 smithi084 ceph-mon[37565]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-30T12:17:30.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:30 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:30.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:30 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:30.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:30 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:17:30.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:30 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:30.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:30 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:30.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:30 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:17:30.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:30 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:30.646 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi162:vg_nvme/lv_3 2024-03-30T12:17:30.849 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T12:17:31.268 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:31 smithi162 ceph-mon[30421]: Detected new or changed devices on smithi162 2024-03-30T12:17:31.268 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:31 smithi162 ceph-mon[30421]: Adjusting osd_memory_target on smithi162 to 17088M 2024-03-30T12:17:31.268 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:31 smithi162 ceph-mon[30421]: osdmap e32: 5 total, 5 up, 5 in 2024-03-30T12:17:31.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:31 smithi084 ceph-mon[27000]: Detected new or changed devices on smithi162 2024-03-30T12:17:31.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:31 smithi084 ceph-mon[27000]: Adjusting osd_memory_target on smithi162 to 17088M 2024-03-30T12:17:31.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:31 smithi084 ceph-mon[27000]: osdmap e32: 5 total, 5 up, 5 in 2024-03-30T12:17:31.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:31 smithi084 ceph-mon[37565]: Detected new or changed devices on smithi162 2024-03-30T12:17:31.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:31 smithi084 ceph-mon[37565]: Adjusting osd_memory_target on smithi162 to 17088M 2024-03-30T12:17:31.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:31 smithi084 ceph-mon[37565]: osdmap e32: 5 total, 5 up, 5 in 2024-03-30T12:17:32.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:32 smithi162 ceph-mon[30421]: osdmap e33: 5 total, 5 up, 5 in 2024-03-30T12:17:32.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:32 smithi162 ceph-mon[30421]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-30T12:17:32.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:32 smithi084 ceph-mon[27000]: osdmap e33: 5 total, 5 up, 5 in 2024-03-30T12:17:32.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:32 smithi084 ceph-mon[27000]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-30T12:17:32.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:32 smithi084 ceph-mon[37565]: osdmap e33: 5 total, 5 up, 5 in 2024-03-30T12:17:32.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:32 smithi084 ceph-mon[37565]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-30T12:17:33.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:33 smithi162 ceph-mon[30421]: osdmap e34: 5 total, 5 up, 5 in 2024-03-30T12:17:33.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:33 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T12:17:33.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:33 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T12:17:33.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:33 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:33.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:33 smithi084 ceph-mon[27000]: osdmap e34: 5 total, 5 up, 5 in 2024-03-30T12:17:33.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:33 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T12:17:33.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:33 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T12:17:33.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:33 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:33.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:33 smithi084 ceph-mon[37565]: osdmap e34: 5 total, 5 up, 5 in 2024-03-30T12:17:33.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:33 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T12:17:33.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:33 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T12:17:33.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:33 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:34.169 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:34 smithi162 ceph-mon[30421]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:17:34.169 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:34 smithi162 ceph-mon[30421]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-03-30T12:17:34.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:34 smithi084 ceph-mon[27000]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:17:34.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:34 smithi084 ceph-mon[27000]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-03-30T12:17:34.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:34 smithi084 ceph-mon[37565]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:17:34.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:34 smithi084 ceph-mon[37565]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-03-30T12:17:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:35 smithi084 ceph-mon[37565]: from='client.? 172.21.15.162:0/3867123102' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2408494e-0472-4cde-aac6-e87d919b6d2b"}]: dispatch 2024-03-30T12:17:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:35 smithi084 ceph-mon[37565]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2408494e-0472-4cde-aac6-e87d919b6d2b"}]: dispatch 2024-03-30T12:17:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:35 smithi084 ceph-mon[37565]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2408494e-0472-4cde-aac6-e87d919b6d2b"}]': finished 2024-03-30T12:17:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:35 smithi084 ceph-mon[37565]: osdmap e35: 6 total, 5 up, 6 in 2024-03-30T12:17:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:35 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:17:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:35 smithi084 ceph-mon[37565]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 136 MiB used, 447 GiB / 447 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-03-30T12:17:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:35 smithi084 ceph-mon[37565]: from='client.? 172.21.15.162:0/2958434461' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T12:17:36.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:35 smithi084 ceph-mon[27000]: from='client.? 172.21.15.162:0/3867123102' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2408494e-0472-4cde-aac6-e87d919b6d2b"}]: dispatch 2024-03-30T12:17:36.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:35 smithi084 ceph-mon[27000]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2408494e-0472-4cde-aac6-e87d919b6d2b"}]: dispatch 2024-03-30T12:17:36.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:35 smithi084 ceph-mon[27000]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2408494e-0472-4cde-aac6-e87d919b6d2b"}]': finished 2024-03-30T12:17:36.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:35 smithi084 ceph-mon[27000]: osdmap e35: 6 total, 5 up, 6 in 2024-03-30T12:17:36.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:35 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:17:36.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:35 smithi084 ceph-mon[27000]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 136 MiB used, 447 GiB / 447 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-03-30T12:17:36.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:35 smithi084 ceph-mon[27000]: from='client.? 172.21.15.162:0/2958434461' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T12:17:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:35 smithi162 ceph-mon[30421]: from='client.? 172.21.15.162:0/3867123102' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2408494e-0472-4cde-aac6-e87d919b6d2b"}]: dispatch 2024-03-30T12:17:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:35 smithi162 ceph-mon[30421]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2408494e-0472-4cde-aac6-e87d919b6d2b"}]: dispatch 2024-03-30T12:17:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:35 smithi162 ceph-mon[30421]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2408494e-0472-4cde-aac6-e87d919b6d2b"}]': finished 2024-03-30T12:17:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:35 smithi162 ceph-mon[30421]: osdmap e35: 6 total, 5 up, 6 in 2024-03-30T12:17:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:35 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:17:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:35 smithi162 ceph-mon[30421]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 136 MiB used, 447 GiB / 447 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-03-30T12:17:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:35 smithi162 ceph-mon[30421]: from='client.? 172.21.15.162:0/2958434461' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T12:17:38.488 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:38 smithi162 ceph-mon[30421]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 136 MiB used, 447 GiB / 447 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-03-30T12:17:38.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:38 smithi084 ceph-mon[27000]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 136 MiB used, 447 GiB / 447 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-03-30T12:17:38.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:38 smithi084 ceph-mon[37565]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 136 MiB used, 447 GiB / 447 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-03-30T12:17:40.322 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:40 smithi162 ceph-mon[30421]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-30T12:17:40.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:40 smithi084 ceph-mon[27000]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-30T12:17:40.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:40 smithi084 ceph-mon[37565]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-30T12:17:41.425 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:41 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-30T12:17:41.425 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:41 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:41.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:41 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-30T12:17:41.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:41 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:41.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:41 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-30T12:17:41.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:41 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:42.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:42 smithi084 ceph-mon[27000]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-30T12:17:42.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:42 smithi084 ceph-mon[27000]: Deploying daemon osd.5 on smithi162 2024-03-30T12:17:42.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:42 smithi084 ceph-mon[37565]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-30T12:17:42.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:42 smithi084 ceph-mon[37565]: Deploying daemon osd.5 on smithi162 2024-03-30T12:17:42.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:42 smithi162 ceph-mon[30421]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-30T12:17:42.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:42 smithi162 ceph-mon[30421]: Deploying daemon osd.5 on smithi162 2024-03-30T12:17:44.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:44 smithi162 ceph-mon[30421]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-30T12:17:44.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:44 smithi084 ceph-mon[27000]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-30T12:17:44.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:44 smithi084 ceph-mon[37565]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-30T12:17:46.069 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:45 smithi162 ceph-mon[30421]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-30T12:17:46.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:45 smithi084 ceph-mon[27000]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-30T12:17:46.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:45 smithi084 ceph-mon[37565]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-30T12:17:47.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:47 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:47.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:47 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:47.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:47 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:17:47.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:47 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:47.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:47 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:47.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:47 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:17:47.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:47 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:47.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:47 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:47.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:47 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:17:48.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:48 smithi162 ceph-mon[30421]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-30T12:17:48.656 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:48 smithi084 ceph-mon[27000]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-30T12:17:48.656 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:48 smithi084 ceph-mon[37565]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-30T12:17:49.582 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 5 on host 'smithi162' 2024-03-30T12:17:50.196 DEBUG:teuthology.orchestra.run.smithi162:osd.5> sudo journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.5.service 2024-03-30T12:17:50.198 INFO:tasks.cephadm:Deploying osd.6 on smithi162 with /dev/vg_nvme/lv_2... 2024-03-30T12:17:50.198 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-30T12:17:50.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:50 smithi162 ceph-mon[30421]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-30T12:17:50.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:50 smithi162 ceph-mon[30421]: from='osd.5 [v2:172.21.15.162:6808/2786846638,v1:172.21.15.162:6809/2786846638]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T12:17:50.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:50 smithi162 ceph-mon[30421]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T12:17:50.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:50 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:50.521 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:50 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:50.521 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:50 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:50.521 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:50 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:50.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:50 smithi084 ceph-mon[37565]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-30T12:17:50.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:50 smithi084 ceph-mon[37565]: from='osd.5 [v2:172.21.15.162:6808/2786846638,v1:172.21.15.162:6809/2786846638]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T12:17:50.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:50 smithi084 ceph-mon[37565]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T12:17:50.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:50 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:50.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:50 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:50.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:50 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:50.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:50 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:50.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:50 smithi084 ceph-mon[27000]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-30T12:17:50.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:50 smithi084 ceph-mon[27000]: from='osd.5 [v2:172.21.15.162:6808/2786846638,v1:172.21.15.162:6809/2786846638]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T12:17:50.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:50 smithi084 ceph-mon[27000]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T12:17:50.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:50 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:50.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:50 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:50.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:50 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:50.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:50 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:50.948 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T12:17:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:51 smithi162 ceph-mon[30421]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-30T12:17:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:51 smithi162 ceph-mon[30421]: osdmap e36: 6 total, 5 up, 6 in 2024-03-30T12:17:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:51 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:17:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:51 smithi162 ceph-mon[30421]: from='osd.5 [v2:172.21.15.162:6808/2786846638,v1:172.21.15.162:6809/2786846638]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:17:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:51 smithi162 ceph-mon[30421]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:17:51.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:51 smithi084 ceph-mon[37565]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-30T12:17:51.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:51 smithi084 ceph-mon[37565]: osdmap e36: 6 total, 5 up, 6 in 2024-03-30T12:17:51.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:51 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:17:51.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:51 smithi084 ceph-mon[37565]: from='osd.5 [v2:172.21.15.162:6808/2786846638,v1:172.21.15.162:6809/2786846638]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:17:51.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:51 smithi084 ceph-mon[37565]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:17:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:51 smithi084 ceph-mon[27000]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-30T12:17:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:51 smithi084 ceph-mon[27000]: osdmap e36: 6 total, 5 up, 6 in 2024-03-30T12:17:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:51 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:17:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:51 smithi084 ceph-mon[27000]: from='osd.5 [v2:172.21.15.162:6808/2786846638,v1:172.21.15.162:6809/2786846638]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:17:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:51 smithi084 ceph-mon[27000]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:17:51.982 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:17:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[40835]: 2024-03-30T12:17:51.775+0000 7fadba846700 -1 osd.5 0 waiting for initial osdmap 2024-03-30T12:17:51.982 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:17:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[40835]: 2024-03-30T12:17:51.779+0000 7fadb2633700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T12:17:52.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:52 smithi162 ceph-mon[30421]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-30T12:17:52.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:52 smithi162 ceph-mon[30421]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-03-30T12:17:52.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:52 smithi162 ceph-mon[30421]: osdmap e37: 6 total, 5 up, 6 in 2024-03-30T12:17:52.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:52 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:17:52.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:52 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:17:52.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:52 smithi162 ceph-mon[30421]: from='osd.5 ' entity='osd.5' 2024-03-30T12:17:52.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:52 smithi084 ceph-mon[27000]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-30T12:17:52.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:52 smithi084 ceph-mon[27000]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-03-30T12:17:52.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:52 smithi084 ceph-mon[27000]: osdmap e37: 6 total, 5 up, 6 in 2024-03-30T12:17:52.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:52 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:17:52.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:52 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:17:52.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:52 smithi084 ceph-mon[27000]: from='osd.5 ' entity='osd.5' 2024-03-30T12:17:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:52 smithi084 ceph-mon[37565]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-30T12:17:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:52 smithi084 ceph-mon[37565]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-03-30T12:17:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:52 smithi084 ceph-mon[37565]: osdmap e37: 6 total, 5 up, 6 in 2024-03-30T12:17:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:52 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:17:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:52 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:17:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:52 smithi084 ceph-mon[37565]: from='osd.5 ' entity='osd.5' 2024-03-30T12:17:53.467 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:53 smithi162 ceph-mon[30421]: purged_snaps scrub starts 2024-03-30T12:17:53.467 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:53 smithi162 ceph-mon[30421]: purged_snaps scrub ok 2024-03-30T12:17:53.467 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:53 smithi162 ceph-mon[30421]: osd.5 [v2:172.21.15.162:6808/2786846638,v1:172.21.15.162:6809/2786846638] boot 2024-03-30T12:17:53.468 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:53 smithi162 ceph-mon[30421]: osdmap e38: 6 total, 6 up, 6 in 2024-03-30T12:17:53.468 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:53 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:17:53.468 INFO:teuthology.orchestra.run.smithi162.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-30T12:17:53.468 INFO:teuthology.orchestra.run.smithi162.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-30T12:17:53.468 INFO:teuthology.orchestra.run.smithi162.stderr: stderr: 10+0 records in 2024-03-30T12:17:53.468 INFO:teuthology.orchestra.run.smithi162.stderr:10+0 records out 2024-03-30T12:17:53.468 INFO:teuthology.orchestra.run.smithi162.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0122972 s, 853 MB/s 2024-03-30T12:17:53.468 INFO:teuthology.orchestra.run.smithi162.stderr:--> Zapping successful for: 2024-03-30T12:17:53.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:53 smithi084 ceph-mon[27000]: purged_snaps scrub starts 2024-03-30T12:17:53.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:53 smithi084 ceph-mon[27000]: purged_snaps scrub ok 2024-03-30T12:17:53.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:53 smithi084 ceph-mon[27000]: osd.5 [v2:172.21.15.162:6808/2786846638,v1:172.21.15.162:6809/2786846638] boot 2024-03-30T12:17:53.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:53 smithi084 ceph-mon[27000]: osdmap e38: 6 total, 6 up, 6 in 2024-03-30T12:17:53.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:53 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:17:53.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:53 smithi084 ceph-mon[37565]: purged_snaps scrub starts 2024-03-30T12:17:53.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:53 smithi084 ceph-mon[37565]: purged_snaps scrub ok 2024-03-30T12:17:53.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:53 smithi084 ceph-mon[37565]: osd.5 [v2:172.21.15.162:6808/2786846638,v1:172.21.15.162:6809/2786846638] boot 2024-03-30T12:17:53.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:53 smithi084 ceph-mon[37565]: osdmap e38: 6 total, 6 up, 6 in 2024-03-30T12:17:53.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:53 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:17:54.178 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi162:vg_nvme/lv_2 2024-03-30T12:17:54.548 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:54 smithi162 ceph-mon[30421]: pgmap v129: 1 pgs: 1 unknown; 577 KiB data, 269 MiB used, 536 GiB / 536 GiB avail 2024-03-30T12:17:54.548 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:54 smithi162 ceph-mon[30421]: osdmap e39: 6 total, 6 up, 6 in 2024-03-30T12:17:54.548 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:54 smithi162 ceph-mon[30421]: osdmap e40: 6 total, 6 up, 6 in 2024-03-30T12:17:54.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:54 smithi084 ceph-mon[27000]: pgmap v129: 1 pgs: 1 unknown; 577 KiB data, 269 MiB used, 536 GiB / 536 GiB avail 2024-03-30T12:17:54.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:54 smithi084 ceph-mon[27000]: osdmap e39: 6 total, 6 up, 6 in 2024-03-30T12:17:54.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:54 smithi084 ceph-mon[27000]: osdmap e40: 6 total, 6 up, 6 in 2024-03-30T12:17:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:54 smithi084 ceph-mon[37565]: pgmap v129: 1 pgs: 1 unknown; 577 KiB data, 269 MiB used, 536 GiB / 536 GiB avail 2024-03-30T12:17:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:54 smithi084 ceph-mon[37565]: osdmap e39: 6 total, 6 up, 6 in 2024-03-30T12:17:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:54 smithi084 ceph-mon[37565]: osdmap e40: 6 total, 6 up, 6 in 2024-03-30T12:17:54.914 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T12:17:55.963 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:55 smithi162 ceph-mon[30421]: Detected new or changed devices on smithi162 2024-03-30T12:17:55.963 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:55 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:55.963 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:55 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:55.963 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:55 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:17:55.963 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:55 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:17:55.963 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:55 smithi162 ceph-mon[30421]: Adjusting osd_memory_target on smithi162 to 8544M 2024-03-30T12:17:55.963 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:55 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:55.964 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:55 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:55.964 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:55 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:17:55.964 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:55 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:55.964 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:55 smithi162 ceph-mon[30421]: osdmap e41: 6 total, 6 up, 6 in 2024-03-30T12:17:55.964 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:55 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:17:55.964 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:55 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:55.964 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:55 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:17:55.964 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:55 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:55.964 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:55 smithi162 ceph-mon[30421]: pgmap v133: 1 pgs: 1 unknown; 577 KiB data, 270 MiB used, 536 GiB / 536 GiB avail 2024-03-30T12:17:56.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[37565]: Detected new or changed devices on smithi162 2024-03-30T12:17:56.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:56.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:56.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:17:56.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:17:56.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[37565]: Adjusting osd_memory_target on smithi162 to 8544M 2024-03-30T12:17:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:17:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[37565]: osdmap e41: 6 total, 6 up, 6 in 2024-03-30T12:17:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:17:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:17:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[37565]: pgmap v133: 1 pgs: 1 unknown; 577 KiB data, 270 MiB used, 536 GiB / 536 GiB avail 2024-03-30T12:17:56.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[27000]: Detected new or changed devices on smithi162 2024-03-30T12:17:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:17:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:17:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[27000]: Adjusting osd_memory_target on smithi162 to 8544M 2024-03-30T12:17:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:17:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[27000]: osdmap e41: 6 total, 6 up, 6 in 2024-03-30T12:17:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:17:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:17:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:17:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:55 smithi084 ceph-mon[27000]: pgmap v133: 1 pgs: 1 unknown; 577 KiB data, 270 MiB used, 536 GiB / 536 GiB avail 2024-03-30T12:17:57.137 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:56 smithi162 ceph-mon[30421]: osdmap e42: 6 total, 6 up, 6 in 2024-03-30T12:17:57.137 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:56 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T12:17:57.137 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:56 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T12:17:57.137 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:56 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:57.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:56 smithi084 ceph-mon[37565]: osdmap e42: 6 total, 6 up, 6 in 2024-03-30T12:17:57.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:56 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T12:17:57.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:56 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T12:17:57.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:56 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:56 smithi084 ceph-mon[27000]: osdmap e42: 6 total, 6 up, 6 in 2024-03-30T12:17:57.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:56 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T12:17:57.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:56 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T12:17:57.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:56 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:17:58.072 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:57 smithi162 ceph-mon[30421]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:17:58.073 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:57 smithi162 ceph-mon[30421]: pgmap v135: 1 pgs: 1 unknown; 577 KiB data, 270 MiB used, 536 GiB / 536 GiB avail 2024-03-30T12:17:58.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:57 smithi084 ceph-mon[37565]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:17:58.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:57 smithi084 ceph-mon[37565]: pgmap v135: 1 pgs: 1 unknown; 577 KiB data, 270 MiB used, 536 GiB / 536 GiB avail 2024-03-30T12:17:58.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:57 smithi084 ceph-mon[27000]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:17:58.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:57 smithi084 ceph-mon[27000]: pgmap v135: 1 pgs: 1 unknown; 577 KiB data, 270 MiB used, 536 GiB / 536 GiB avail 2024-03-30T12:17:59.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:59 smithi084 ceph-mon[37565]: from='client.? 172.21.15.162:0/298868271' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f86781fa-6cb4-4abd-b759-84ff6d7b36d3"}]: dispatch 2024-03-30T12:17:59.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:59 smithi084 ceph-mon[37565]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f86781fa-6cb4-4abd-b759-84ff6d7b36d3"}]: dispatch 2024-03-30T12:17:59.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:59 smithi084 ceph-mon[37565]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f86781fa-6cb4-4abd-b759-84ff6d7b36d3"}]': finished 2024-03-30T12:17:59.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:59 smithi084 ceph-mon[37565]: osdmap e43: 7 total, 6 up, 7 in 2024-03-30T12:17:59.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:17:59 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:17:59.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:59 smithi084 ceph-mon[27000]: from='client.? 172.21.15.162:0/298868271' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f86781fa-6cb4-4abd-b759-84ff6d7b36d3"}]: dispatch 2024-03-30T12:17:59.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:59 smithi084 ceph-mon[27000]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f86781fa-6cb4-4abd-b759-84ff6d7b36d3"}]: dispatch 2024-03-30T12:17:59.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:59 smithi084 ceph-mon[27000]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f86781fa-6cb4-4abd-b759-84ff6d7b36d3"}]': finished 2024-03-30T12:17:59.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:59 smithi084 ceph-mon[27000]: osdmap e43: 7 total, 6 up, 7 in 2024-03-30T12:17:59.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:17:59 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:17:59.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:59 smithi162 ceph-mon[30421]: from='client.? 172.21.15.162:0/298868271' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f86781fa-6cb4-4abd-b759-84ff6d7b36d3"}]: dispatch 2024-03-30T12:17:59.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:59 smithi162 ceph-mon[30421]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f86781fa-6cb4-4abd-b759-84ff6d7b36d3"}]: dispatch 2024-03-30T12:17:59.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:59 smithi162 ceph-mon[30421]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f86781fa-6cb4-4abd-b759-84ff6d7b36d3"}]': finished 2024-03-30T12:17:59.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:59 smithi162 ceph-mon[30421]: osdmap e43: 7 total, 6 up, 7 in 2024-03-30T12:17:59.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:17:59 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:18:00.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:00 smithi084 ceph-mon[37565]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-03-30T12:18:00.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:00 smithi084 ceph-mon[37565]: from='client.? 172.21.15.162:0/2933197191' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T12:18:00.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:00 smithi084 ceph-mon[27000]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-03-30T12:18:00.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:00 smithi084 ceph-mon[27000]: from='client.? 172.21.15.162:0/2933197191' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T12:18:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:00 smithi162 ceph-mon[30421]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-03-30T12:18:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:00 smithi162 ceph-mon[30421]: from='client.? 172.21.15.162:0/2933197191' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T12:18:02.364 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:02 smithi162 ceph-mon[30421]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-03-30T12:18:02.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:02 smithi084 ceph-mon[37565]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-03-30T12:18:02.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:02 smithi084 ceph-mon[27000]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-03-30T12:18:04.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:04 smithi084 ceph-mon[37565]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-30T12:18:04.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:04 smithi084 ceph-mon[27000]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-30T12:18:04.524 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:04 smithi162 ceph-mon[30421]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-30T12:18:06.206 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:05 smithi162 ceph-mon[30421]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-03-30T12:18:06.206 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:05 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-30T12:18:06.206 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:05 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:06.206 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:05 smithi162 ceph-mon[30421]: Deploying daemon osd.6 on smithi162 2024-03-30T12:18:06.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:05 smithi084 ceph-mon[37565]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-03-30T12:18:06.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:05 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-30T12:18:06.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:05 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:06.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:05 smithi084 ceph-mon[37565]: Deploying daemon osd.6 on smithi162 2024-03-30T12:18:06.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:05 smithi084 ceph-mon[27000]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-03-30T12:18:06.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:05 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-30T12:18:06.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:05 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:06.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:05 smithi084 ceph-mon[27000]: Deploying daemon osd.6 on smithi162 2024-03-30T12:18:08.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:08 smithi162 ceph-mon[30421]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-30T12:18:08.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:08 smithi084 ceph-mon[27000]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-30T12:18:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:08 smithi084 ceph-mon[37565]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-30T12:18:10.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:10 smithi084 ceph-mon[27000]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-30T12:18:10.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:10 smithi084 ceph-mon[37565]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-30T12:18:10.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:10 smithi162 ceph-mon[30421]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-30T12:18:12.067 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:11 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:12.067 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:11 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:12.067 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:11 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:18:12.067 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:11 smithi162 ceph-mon[30421]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-30T12:18:12.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:11 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:12.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:11 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:12.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:11 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:18:12.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:11 smithi084 ceph-mon[27000]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-30T12:18:12.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:11 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:12.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:11 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:12.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:11 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:18:12.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:11 smithi084 ceph-mon[37565]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-30T12:18:14.426 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:14 smithi162 ceph-mon[30421]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-30T12:18:14.427 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:14 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:14.427 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:14 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:14.427 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:14 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:14.427 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:14 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:18:14.427 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:14 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:14.427 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:14 smithi162 ceph-mon[30421]: from='osd.6 [v2:172.21.15.162:6816/2493067564,v1:172.21.15.162:6817/2493067564]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T12:18:14.427 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:14 smithi162 ceph-mon[30421]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T12:18:14.478 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 6 on host 'smithi162' 2024-03-30T12:18:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:14 smithi084 ceph-mon[27000]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-30T12:18:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:14 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:14 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:14 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:14 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:18:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:14 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:14 smithi084 ceph-mon[27000]: from='osd.6 [v2:172.21.15.162:6816/2493067564,v1:172.21.15.162:6817/2493067564]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T12:18:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:14 smithi084 ceph-mon[27000]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T12:18:14.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:14 smithi084 ceph-mon[37565]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-30T12:18:14.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:14 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:14.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:14 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:14.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:14 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:14.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:14 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:18:14.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:14 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:14.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:14 smithi084 ceph-mon[37565]: from='osd.6 [v2:172.21.15.162:6816/2493067564,v1:172.21.15.162:6817/2493067564]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T12:18:14.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:14 smithi084 ceph-mon[37565]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T12:18:15.160 DEBUG:teuthology.orchestra.run.smithi162:osd.6> sudo journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.6.service 2024-03-30T12:18:15.162 INFO:tasks.cephadm:Deploying osd.7 on smithi162 with /dev/vg_nvme/lv_1... 2024-03-30T12:18:15.163 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-30T12:18:15.708 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:15 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:15.708 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:15 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:15.708 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:15 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:18:15.708 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:15 smithi162 ceph-mon[30421]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-30T12:18:15.708 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:15 smithi162 ceph-mon[30421]: osdmap e44: 7 total, 6 up, 7 in 2024-03-30T12:18:15.708 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:15 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:18:15.709 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:15 smithi162 ceph-mon[30421]: from='osd.6 [v2:172.21.15.162:6816/2493067564,v1:172.21.15.162:6817/2493067564]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:18:15.709 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:15 smithi162 ceph-mon[30421]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:18:15.709 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:18:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[46849]: 2024-03-30T12:18:15.557+0000 7f2cc41c3700 -1 osd.6 0 waiting for initial osdmap 2024-03-30T12:18:15.709 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:18:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[46849]: 2024-03-30T12:18:15.564+0000 7f2cbffb8700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T12:18:15.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:15 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:15.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:15 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:15.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:15 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:18:15.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:15 smithi084 ceph-mon[27000]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-30T12:18:15.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:15 smithi084 ceph-mon[27000]: osdmap e44: 7 total, 6 up, 7 in 2024-03-30T12:18:15.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:15 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:18:15.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:15 smithi084 ceph-mon[27000]: from='osd.6 [v2:172.21.15.162:6816/2493067564,v1:172.21.15.162:6817/2493067564]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:18:15.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:15 smithi084 ceph-mon[27000]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:18:15.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:15 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:15.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:15 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:15.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:15 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:18:15.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:15 smithi084 ceph-mon[37565]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-30T12:18:15.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:15 smithi084 ceph-mon[37565]: osdmap e44: 7 total, 6 up, 7 in 2024-03-30T12:18:15.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:15 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:18:15.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:15 smithi084 ceph-mon[37565]: from='osd.6 [v2:172.21.15.162:6816/2493067564,v1:172.21.15.162:6817/2493067564]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:18:15.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:15 smithi084 ceph-mon[37565]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:18:16.411 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T12:18:16.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:16 smithi162 ceph-mon[30421]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-30T12:18:16.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:16 smithi162 ceph-mon[30421]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-03-30T12:18:16.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:16 smithi162 ceph-mon[30421]: osdmap e45: 7 total, 6 up, 7 in 2024-03-30T12:18:16.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:16 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:18:16.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:16 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:18:16.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:16 smithi084 ceph-mon[27000]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-30T12:18:16.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:16 smithi084 ceph-mon[27000]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-03-30T12:18:16.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:16 smithi084 ceph-mon[27000]: osdmap e45: 7 total, 6 up, 7 in 2024-03-30T12:18:16.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:16 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:18:16.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:16 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:18:16.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:16 smithi084 ceph-mon[37565]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-30T12:18:16.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:16 smithi084 ceph-mon[37565]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-03-30T12:18:16.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:16 smithi084 ceph-mon[37565]: osdmap e45: 7 total, 6 up, 7 in 2024-03-30T12:18:16.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:16 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:18:16.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:16 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:18:17.865 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:17 smithi162 ceph-mon[30421]: purged_snaps scrub starts 2024-03-30T12:18:17.865 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:17 smithi162 ceph-mon[30421]: purged_snaps scrub ok 2024-03-30T12:18:17.865 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:17 smithi162 ceph-mon[30421]: osd.6 [v2:172.21.15.162:6816/2493067564,v1:172.21.15.162:6817/2493067564] boot 2024-03-30T12:18:17.865 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:17 smithi162 ceph-mon[30421]: osdmap e46: 7 total, 7 up, 7 in 2024-03-30T12:18:17.865 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:17 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:18:17.865 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:17 smithi162 ceph-mon[30421]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:18.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:17 smithi084 ceph-mon[27000]: purged_snaps scrub starts 2024-03-30T12:18:18.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:17 smithi084 ceph-mon[27000]: purged_snaps scrub ok 2024-03-30T12:18:18.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:17 smithi084 ceph-mon[27000]: osd.6 [v2:172.21.15.162:6816/2493067564,v1:172.21.15.162:6817/2493067564] boot 2024-03-30T12:18:18.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:17 smithi084 ceph-mon[27000]: osdmap e46: 7 total, 7 up, 7 in 2024-03-30T12:18:18.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:17 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:18:18.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:17 smithi084 ceph-mon[27000]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:17 smithi084 ceph-mon[37565]: purged_snaps scrub starts 2024-03-30T12:18:18.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:17 smithi084 ceph-mon[37565]: purged_snaps scrub ok 2024-03-30T12:18:18.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:17 smithi084 ceph-mon[37565]: osd.6 [v2:172.21.15.162:6816/2493067564,v1:172.21.15.162:6817/2493067564] boot 2024-03-30T12:18:18.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:17 smithi084 ceph-mon[37565]: osdmap e46: 7 total, 7 up, 7 in 2024-03-30T12:18:18.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:17 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:18:18.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:17 smithi084 ceph-mon[37565]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:18.854 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:18 smithi162 ceph-mon[30421]: osdmap e47: 7 total, 7 up, 7 in 2024-03-30T12:18:18.855 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:18 smithi162 ceph-mon[30421]: Detected new or changed devices on smithi162 2024-03-30T12:18:18.855 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:18 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:18.855 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:18 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:18.855 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:18 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:18:18.855 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:18 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:18:18.855 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:18 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:18:18.855 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:18 smithi162 ceph-mon[30421]: Adjusting osd_memory_target on smithi162 to 5696M 2024-03-30T12:18:18.855 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:18 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:18.855 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:18 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:18.855 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:18 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:18:18.855 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:18 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:18.905 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:18 smithi084 ceph-mon[37565]: osdmap e47: 7 total, 7 up, 7 in 2024-03-30T12:18:18.905 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:18 smithi084 ceph-mon[37565]: Detected new or changed devices on smithi162 2024-03-30T12:18:18.906 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:18 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:18.906 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:18 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:18.906 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:18 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:18:18.906 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:18 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:18:18.906 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:18 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:18:18.906 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:18 smithi084 ceph-mon[37565]: Adjusting osd_memory_target on smithi162 to 5696M 2024-03-30T12:18:18.906 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:18 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:18.906 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:18 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:18.906 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:18 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:18:18.906 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:18 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:18.906 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:18 smithi084 ceph-mon[27000]: osdmap e47: 7 total, 7 up, 7 in 2024-03-30T12:18:18.906 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:18 smithi084 ceph-mon[27000]: Detected new or changed devices on smithi162 2024-03-30T12:18:18.907 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:18 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:18.907 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:18 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:18.907 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:18 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:18:18.907 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:18 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:18:18.907 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:18 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:18:18.907 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:18 smithi084 ceph-mon[27000]: Adjusting osd_memory_target on smithi162 to 5696M 2024-03-30T12:18:18.907 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:18 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:18.907 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:18 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:18.907 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:18 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:18:18.907 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:18 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:19.526 INFO:teuthology.orchestra.run.smithi162.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-30T12:18:19.527 INFO:teuthology.orchestra.run.smithi162.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-30T12:18:19.527 INFO:teuthology.orchestra.run.smithi162.stderr: stderr: 10+0 records in 2024-03-30T12:18:19.527 INFO:teuthology.orchestra.run.smithi162.stderr:10+0 records out 2024-03-30T12:18:19.527 INFO:teuthology.orchestra.run.smithi162.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114371 s, 917 MB/s 2024-03-30T12:18:19.527 INFO:teuthology.orchestra.run.smithi162.stderr:--> Zapping successful for: 2024-03-30T12:18:19.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:19 smithi162 ceph-mon[30421]: osdmap e48: 7 total, 7 up, 7 in 2024-03-30T12:18:19.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:19 smithi162 ceph-mon[30421]: pgmap v152: 1 pgs: 1 remapped+peering; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:20.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:19 smithi084 ceph-mon[27000]: osdmap e48: 7 total, 7 up, 7 in 2024-03-30T12:18:20.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:19 smithi084 ceph-mon[27000]: pgmap v152: 1 pgs: 1 remapped+peering; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:20.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:19 smithi084 ceph-mon[37565]: osdmap e48: 7 total, 7 up, 7 in 2024-03-30T12:18:20.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:19 smithi084 ceph-mon[37565]: pgmap v152: 1 pgs: 1 remapped+peering; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:20.189 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi162:vg_nvme/lv_1 2024-03-30T12:18:20.392 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T12:18:20.820 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:20 smithi162 ceph-mon[30421]: osdmap e49: 7 total, 7 up, 7 in 2024-03-30T12:18:21.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:20 smithi084 ceph-mon[37565]: osdmap e49: 7 total, 7 up, 7 in 2024-03-30T12:18:21.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:20 smithi084 ceph-mon[27000]: osdmap e49: 7 total, 7 up, 7 in 2024-03-30T12:18:21.701 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:21 smithi162 ceph-mon[30421]: osdmap e50: 7 total, 7 up, 7 in 2024-03-30T12:18:21.701 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:21 smithi162 ceph-mon[30421]: pgmap v155: 1 pgs: 1 remapped+peering; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:22.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:21 smithi084 ceph-mon[37565]: osdmap e50: 7 total, 7 up, 7 in 2024-03-30T12:18:22.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:21 smithi084 ceph-mon[37565]: pgmap v155: 1 pgs: 1 remapped+peering; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:22.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:21 smithi084 ceph-mon[27000]: osdmap e50: 7 total, 7 up, 7 in 2024-03-30T12:18:22.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:21 smithi084 ceph-mon[27000]: pgmap v155: 1 pgs: 1 remapped+peering; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:22.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:22 smithi162 ceph-mon[30421]: from='client.24274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:18:22.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:22 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T12:18:22.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:22 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T12:18:22.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:22 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:23.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:22 smithi084 ceph-mon[37565]: from='client.24274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:18:23.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:22 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T12:18:23.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:22 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T12:18:23.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:22 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:23.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:22 smithi084 ceph-mon[27000]: from='client.24274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:18:23.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:22 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T12:18:23.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:22 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T12:18:23.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:22 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:23.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:23 smithi162 ceph-mon[30421]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-03-30T12:18:24.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:23 smithi084 ceph-mon[37565]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-03-30T12:18:24.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:23 smithi084 ceph-mon[27000]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-03-30T12:18:25.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:24 smithi084 ceph-mon[27000]: from='client.? 172.21.15.162:0/2141952781' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49a38087-ec6c-4ae8-b932-9c59ff7d4321"}]: dispatch 2024-03-30T12:18:25.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:24 smithi084 ceph-mon[27000]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49a38087-ec6c-4ae8-b932-9c59ff7d4321"}]: dispatch 2024-03-30T12:18:25.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:24 smithi084 ceph-mon[27000]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49a38087-ec6c-4ae8-b932-9c59ff7d4321"}]': finished 2024-03-30T12:18:25.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:24 smithi084 ceph-mon[27000]: osdmap e51: 8 total, 7 up, 8 in 2024-03-30T12:18:25.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:24 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:18:25.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:24 smithi084 ceph-mon[37565]: from='client.? 172.21.15.162:0/2141952781' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49a38087-ec6c-4ae8-b932-9c59ff7d4321"}]: dispatch 2024-03-30T12:18:25.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:24 smithi084 ceph-mon[37565]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49a38087-ec6c-4ae8-b932-9c59ff7d4321"}]: dispatch 2024-03-30T12:18:25.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:24 smithi084 ceph-mon[37565]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49a38087-ec6c-4ae8-b932-9c59ff7d4321"}]': finished 2024-03-30T12:18:25.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:24 smithi084 ceph-mon[37565]: osdmap e51: 8 total, 7 up, 8 in 2024-03-30T12:18:25.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:24 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:18:25.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:24 smithi162 ceph-mon[30421]: from='client.? 172.21.15.162:0/2141952781' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49a38087-ec6c-4ae8-b932-9c59ff7d4321"}]: dispatch 2024-03-30T12:18:25.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:24 smithi162 ceph-mon[30421]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49a38087-ec6c-4ae8-b932-9c59ff7d4321"}]: dispatch 2024-03-30T12:18:25.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:24 smithi162 ceph-mon[30421]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49a38087-ec6c-4ae8-b932-9c59ff7d4321"}]': finished 2024-03-30T12:18:25.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:24 smithi162 ceph-mon[30421]: osdmap e51: 8 total, 7 up, 8 in 2024-03-30T12:18:25.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:24 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:18:26.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:25 smithi084 ceph-mon[27000]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-30T12:18:26.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:25 smithi084 ceph-mon[27000]: from='client.? 172.21.15.162:0/2248979611' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T12:18:26.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:25 smithi084 ceph-mon[37565]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-30T12:18:26.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:25 smithi084 ceph-mon[37565]: from='client.? 172.21.15.162:0/2248979611' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T12:18:26.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:25 smithi162 ceph-mon[30421]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-30T12:18:26.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:25 smithi162 ceph-mon[30421]: from='client.? 172.21.15.162:0/2248979611' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T12:18:28.308 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:28 smithi162 ceph-mon[30421]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-03-30T12:18:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:28 smithi084 ceph-mon[27000]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-03-30T12:18:28.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:28 smithi084 ceph-mon[37565]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-03-30T12:18:30.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:30 smithi162 ceph-mon[30421]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-03-30T12:18:30.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:30 smithi084 ceph-mon[27000]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-03-30T12:18:30.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:30 smithi084 ceph-mon[37565]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-03-30T12:18:31.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:31 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-30T12:18:31.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:31 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:31.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:31 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-30T12:18:31.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:31 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:31.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:31 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-30T12:18:31.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:31 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:32.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:32 smithi162 ceph-mon[30421]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-30T12:18:32.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:32 smithi162 ceph-mon[30421]: Deploying daemon osd.7 on smithi162 2024-03-30T12:18:32.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:32 smithi084 ceph-mon[27000]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-30T12:18:32.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:32 smithi084 ceph-mon[27000]: Deploying daemon osd.7 on smithi162 2024-03-30T12:18:32.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:32 smithi084 ceph-mon[37565]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-30T12:18:32.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:32 smithi084 ceph-mon[37565]: Deploying daemon osd.7 on smithi162 2024-03-30T12:18:34.495 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:34 smithi162 ceph-mon[30421]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:34.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:34 smithi084 ceph-mon[27000]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:34.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:34 smithi084 ceph-mon[37565]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:36.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:35 smithi162 ceph-mon[30421]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:36.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:35 smithi084 ceph-mon[27000]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:35 smithi084 ceph-mon[37565]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:37.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:37 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:37.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:37 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:37.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:37 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:18:37.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:37 smithi162 ceph-mon[30421]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:38.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:37 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:38.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:37 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:38.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:37 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:18:38.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:37 smithi084 ceph-mon[27000]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:38.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:37 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:38.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:37 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:38.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:37 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:18:38.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:37 smithi084 ceph-mon[37565]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:40.364 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 7 on host 'smithi162' 2024-03-30T12:18:40.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:40 smithi162 ceph-mon[30421]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:40.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:40 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:40.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:40 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:40.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:40 smithi162 ceph-mon[30421]: from='osd.7 [v2:172.21.15.162:6824/158814135,v1:172.21.15.162:6825/158814135]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T12:18:40.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:40 smithi162 ceph-mon[30421]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T12:18:40.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:40 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:40.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:40 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:18:40.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:40 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:40.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:40 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:40.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:40 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:40.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:40 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:18:40.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:40 smithi084 ceph-mon[37565]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:40.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:40 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:40.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:40 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:40.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:40 smithi084 ceph-mon[37565]: from='osd.7 [v2:172.21.15.162:6824/158814135,v1:172.21.15.162:6825/158814135]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T12:18:40.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:40 smithi084 ceph-mon[37565]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T12:18:40.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:40 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:40.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:40 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:18:40.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:40 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:40.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:40 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:40.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:40 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:40.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:40 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:18:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:40 smithi084 ceph-mon[27000]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:40 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:40 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:40 smithi084 ceph-mon[27000]: from='osd.7 [v2:172.21.15.162:6824/158814135,v1:172.21.15.162:6825/158814135]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T12:18:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:40 smithi084 ceph-mon[27000]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T12:18:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:40 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:40 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:18:40.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:40 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:40.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:40 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:40.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:40 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:40.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:40 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:18:41.125 DEBUG:teuthology.orchestra.run.smithi162:osd.7> sudo journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.7.service 2024-03-30T12:18:41.127 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-03-30T12:18:41.127 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph osd stat -f json 2024-03-30T12:18:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:18:41.665 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:41 smithi084 ceph-mon[37565]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-30T12:18:41.665 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:41 smithi084 ceph-mon[37565]: osdmap e52: 8 total, 7 up, 8 in 2024-03-30T12:18:41.665 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:41 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:18:41.665 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:41 smithi084 ceph-mon[37565]: from='osd.7 [v2:172.21.15.162:6824/158814135,v1:172.21.15.162:6825/158814135]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:18:41.665 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:41 smithi084 ceph-mon[37565]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:18:41.666 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:41 smithi084 ceph-mon[27000]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-30T12:18:41.666 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:41 smithi084 ceph-mon[27000]: osdmap e52: 8 total, 7 up, 8 in 2024-03-30T12:18:41.666 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:41 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:18:41.666 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:41 smithi084 ceph-mon[27000]: from='osd.7 [v2:172.21.15.162:6824/158814135,v1:172.21.15.162:6825/158814135]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:18:41.666 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:41 smithi084 ceph-mon[27000]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:18:41.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:41 smithi162 ceph-mon[30421]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-30T12:18:41.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:41 smithi162 ceph-mon[30421]: osdmap e52: 8 total, 7 up, 8 in 2024-03-30T12:18:41.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:41 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:18:41.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:41 smithi162 ceph-mon[30421]: from='osd.7 [v2:172.21.15.162:6824/158814135,v1:172.21.15.162:6825/158814135]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:18:41.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:41 smithi162 ceph-mon[30421]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:18:42.252 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:18:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[52743]: 2024-03-30T12:18:41.894+0000 7f7a69ab9700 -1 osd.7 0 waiting for initial osdmap 2024-03-30T12:18:42.253 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:18:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[52743]: 2024-03-30T12:18:41.903+0000 7f7a610a5700 -1 osd.7 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T12:18:42.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:42 smithi162 ceph-mon[30421]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:42.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:42 smithi162 ceph-mon[30421]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-03-30T12:18:42.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:42 smithi162 ceph-mon[30421]: osdmap e53: 8 total, 7 up, 8 in 2024-03-30T12:18:42.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:42 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:18:42.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:42 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:18:42.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:42 smithi162 ceph-mon[30421]: from='osd.7 ' entity='osd.7' 2024-03-30T12:18:42.729 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:42 smithi084 ceph-mon[27000]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:42.729 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:42 smithi084 ceph-mon[27000]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-03-30T12:18:42.729 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:42 smithi084 ceph-mon[27000]: osdmap e53: 8 total, 7 up, 8 in 2024-03-30T12:18:42.729 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:42 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:18:42.729 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:42 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:18:42.729 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:42 smithi084 ceph-mon[27000]: from='osd.7 ' entity='osd.7' 2024-03-30T12:18:42.729 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:42 smithi084 ceph-mon[37565]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:42.730 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:42 smithi084 ceph-mon[37565]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-03-30T12:18:42.730 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:42 smithi084 ceph-mon[37565]: osdmap e53: 8 total, 7 up, 8 in 2024-03-30T12:18:42.730 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:42 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:18:42.730 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:42 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:18:42.730 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:42 smithi084 ceph-mon[37565]: from='osd.7 ' entity='osd.7' 2024-03-30T12:18:43.161 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:18:43.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:43 smithi084 ceph-mon[27000]: purged_snaps scrub starts 2024-03-30T12:18:43.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:43 smithi084 ceph-mon[27000]: purged_snaps scrub ok 2024-03-30T12:18:43.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:43 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:18:43.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:43 smithi084 ceph-mon[27000]: osd.7 [v2:172.21.15.162:6824/158814135,v1:172.21.15.162:6825/158814135] boot 2024-03-30T12:18:43.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:43 smithi084 ceph-mon[27000]: osdmap e54: 8 total, 8 up, 8 in 2024-03-30T12:18:43.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:43 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:18:43.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:43 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/2542813522' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-30T12:18:43.570 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:43 smithi084 ceph-mon[37565]: purged_snaps scrub starts 2024-03-30T12:18:43.570 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:43 smithi084 ceph-mon[37565]: purged_snaps scrub ok 2024-03-30T12:18:43.570 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:43 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:18:43.570 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:43 smithi084 ceph-mon[37565]: osd.7 [v2:172.21.15.162:6824/158814135,v1:172.21.15.162:6825/158814135] boot 2024-03-30T12:18:43.570 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:43 smithi084 ceph-mon[37565]: osdmap e54: 8 total, 8 up, 8 in 2024-03-30T12:18:43.570 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:43 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:18:43.570 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:43 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/2542813522' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-30T12:18:43.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:43 smithi162 ceph-mon[30421]: purged_snaps scrub starts 2024-03-30T12:18:43.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:43 smithi162 ceph-mon[30421]: purged_snaps scrub ok 2024-03-30T12:18:43.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:43 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:18:43.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:43 smithi162 ceph-mon[30421]: osd.7 [v2:172.21.15.162:6824/158814135,v1:172.21.15.162:6825/158814135] boot 2024-03-30T12:18:43.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:43 smithi162 ceph-mon[30421]: osdmap e54: 8 total, 8 up, 8 in 2024-03-30T12:18:43.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:43 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:18:43.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:43 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/2542813522' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-30T12:18:43.862 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":54,"num_osds":8,"num_up_osds":8,"osd_up_since":1711801122,"num_in_osds":8,"osd_in_since":1711801104,"num_remapped_pgs":1} 2024-03-30T12:18:43.863 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-03-30T12:18:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:18:44.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:44 smithi084 ceph-mon[27000]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:44.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:44 smithi084 ceph-mon[27000]: osdmap e55: 8 total, 8 up, 8 in 2024-03-30T12:18:44.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:44.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:44.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:18:44.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:18:44.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:18:44.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:18:44.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:44.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:44.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:18:44.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:44 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:44.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:44 smithi084 ceph-mon[37565]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:44.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:44 smithi084 ceph-mon[37565]: osdmap e55: 8 total, 8 up, 8 in 2024-03-30T12:18:44.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:44 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:44.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:44 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:44.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:44 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:18:44.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:44 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:18:44.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:44 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:18:44.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:44 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:18:44.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:44 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:44.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:44 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:44.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:44 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:18:44.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:44 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:44.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:44 smithi162 ceph-mon[30421]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2024-03-30T12:18:44.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:44 smithi162 ceph-mon[30421]: osdmap e55: 8 total, 8 up, 8 in 2024-03-30T12:18:44.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:44 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:44.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:44 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:44 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:18:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:44 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:18:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:44 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:18:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:44 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:18:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:44 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:44 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:44 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:18:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:44 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:45.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:45 smithi084 ceph-mon[27000]: Detected new or changed devices on smithi162 2024-03-30T12:18:45.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:45 smithi084 ceph-mon[27000]: Adjusting osd_memory_target on smithi162 to 4272M 2024-03-30T12:18:45.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:45 smithi084 ceph-mon[27000]: osdmap e56: 8 total, 8 up, 8 in 2024-03-30T12:18:45.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:45 smithi084 ceph-mon[27000]: osdmap e57: 8 total, 8 up, 8 in 2024-03-30T12:18:45.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:45 smithi084 ceph-mon[37565]: Detected new or changed devices on smithi162 2024-03-30T12:18:45.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:45 smithi084 ceph-mon[37565]: Adjusting osd_memory_target on smithi162 to 4272M 2024-03-30T12:18:45.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:45 smithi084 ceph-mon[37565]: osdmap e56: 8 total, 8 up, 8 in 2024-03-30T12:18:45.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:45 smithi084 ceph-mon[37565]: osdmap e57: 8 total, 8 up, 8 in 2024-03-30T12:18:45.828 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:18:45.828 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":57,"fsid":"d3450b00-ee8e-11ee-b647-cb9ed24678a4","created":"2024-03-30T12:13:37.956825+0000","modified":"2024-03-30T12:18:44.893358+0000","last_up_change":"2024-03-30T12:18:42.422684+0000","last_in_change":"2024-03-30T12:18:24.854304+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T12:16:43.434051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a5734fa-c269-449c-805f-0a42d3d90120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6803","nonce":2597011613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6805","nonce":2597011613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6809","nonce":2597011613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6807","nonce":2597011613}]},"public_addr":"172.21.15.84:6803/2597011613","cluster_addr":"172.21.15.84:6805/2597011613","heartbeat_back_addr":"172.21.15.84:6809/2597011613","heartbeat_front_addr":"172.21.15.84:6807/2597011613","state":["exists","up"]},{"osd":1,"uuid":"3ffe676e-9055-44f7-8b04-87974b854b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6811","nonce":6106221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6813","nonce":6106221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6817","nonce":6106221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6815","nonce":6106221}]},"public_addr":"172.21.15.84:6811/6106221","cluster_addr":"172.21.15.84:6813/6106221","heartbeat_back_addr":"172.21.15.84:6817/6106221","heartbeat_front_addr":"172.21.15.84:6815/6106221","state":["exists","up"]},{"osd":2,"uuid":"c21b4cb6-9ade-44d2-a7ba-33fe9b5dd3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6819","nonce":3627018831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6821","nonce":3627018831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6825","nonce":3627018831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6823","nonce":3627018831}]},"public_addr":"172.21.15.84:6819/3627018831","cluster_addr":"172.21.15.84:6821/3627018831","heartbeat_back_addr":"172.21.15.84:6825/3627018831","heartbeat_front_addr":"172.21.15.84:6823/3627018831","state":["exists","up"]},{"osd":3,"uuid":"d60cb7da-fc49-4cbf-855a-2957dcbf66b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6827","nonce":46835826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6829","nonce":46835826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6833","nonce":46835826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6831","nonce":46835826}]},"public_addr":"172.21.15.84:6827/46835826","cluster_addr":"172.21.15.84:6829/46835826","heartbeat_back_addr":"172.21.15.84:6833/46835826","heartbeat_front_addr":"172.21.15.84:6831/46835826","state":["exists","up"]},{"osd":4,"uuid":"46a5087f-cf7c-4bb2-bace-6e04d57496ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6801","nonce":592935958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6803","nonce":592935958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6807","nonce":592935958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6805","nonce":592935958}]},"public_addr":"172.21.15.162:6801/592935958","cluster_addr":"172.21.15.162:6803/592935958","heartbeat_back_addr":"172.21.15.162:6807/592935958","heartbeat_front_addr":"172.21.15.162:6805/592935958","state":["exists","up"]},{"osd":5,"uuid":"2408494e-0472-4cde-aac6-e87d919b6d2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6809","nonce":2786846638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6811","nonce":2786846638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6815","nonce":2786846638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6813","nonce":2786846638}]},"public_addr":"172.21.15.162:6809/2786846638","cluster_addr":"172.21.15.162:6811/2786846638","heartbeat_back_addr":"172.21.15.162:6815/2786846638","heartbeat_front_addr":"172.21.15.162:6813/2786846638","state":["exists","up"]},{"osd":6,"uuid":"f86781fa-6cb4-4abd-b759-84ff6d7b36d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6817","nonce":2493067564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6819","nonce":2493067564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6823","nonce":2493067564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6821","nonce":2493067564}]},"public_addr":"172.21.15.162:6817/2493067564","cluster_addr":"172.21.15.162:6819/2493067564","heartbeat_back_addr":"172.21.15.162:6823/2493067564","heartbeat_front_addr":"172.21.15.162:6821/2493067564","state":["exists","up"]},{"osd":7,"uuid":"49a38087-ec6c-4ae8-b932-9c59ff7d4321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6825","nonce":158814135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6827","nonce":158814135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6831","nonce":158814135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6829","nonce":158814135}]},"public_addr":"172.21.15.162:6825/158814135","cluster_addr":"172.21.15.162:6827/158814135","heartbeat_back_addr":"172.21.15.162:6831/158814135","heartbeat_front_addr":"172.21.15.162:6829/158814135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:15:49.285912+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:14.234967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:39.383506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:03.790574+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:26.131317+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:50.385373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:14.909835+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:40.707128+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/1374515169":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6800/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6800/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/4071895056":"2024-03-31T12:14:06.678373+0000","172.21.15.84:6801/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6801/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3191408930":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/1433254333":"2024-03-31T12:14:31.125768+0000","172.21.15.84:0/1390761199":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3135527830":"2024-03-31T12:14:31.125768+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T12:18:45.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:45 smithi162 ceph-mon[30421]: Detected new or changed devices on smithi162 2024-03-30T12:18:45.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:45 smithi162 ceph-mon[30421]: Adjusting osd_memory_target on smithi162 to 4272M 2024-03-30T12:18:45.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:45 smithi162 ceph-mon[30421]: osdmap e56: 8 total, 8 up, 8 in 2024-03-30T12:18:45.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:45 smithi162 ceph-mon[30421]: osdmap e57: 8 total, 8 up, 8 in 2024-03-30T12:18:46.563 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T12:16:43.434051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T12:18:46.564 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph osd pool get .mgr pg_num 2024-03-30T12:18:46.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:46 smithi084 ceph-mon[27000]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:18:46.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:46 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3963806861' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:18:46.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:46 smithi084 ceph-mon[27000]: osdmap e58: 8 total, 8 up, 8 in 2024-03-30T12:18:46.760 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:46 smithi084 ceph-mon[37565]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:18:46.760 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:46 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/3963806861' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:18:46.760 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:46 smithi084 ceph-mon[37565]: osdmap e58: 8 total, 8 up, 8 in 2024-03-30T12:18:46.765 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:18:46.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:46 smithi162 ceph-mon[30421]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:18:46.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:46 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/3963806861' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:18:46.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:46 smithi162 ceph-mon[30421]: osdmap e58: 8 total, 8 up, 8 in 2024-03-30T12:18:48.561 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-03-30T12:18:48.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:48 smithi084 ceph-mon[27000]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:18:48.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:48 smithi084 ceph-mon[37565]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:18:48.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:48 smithi162 ceph-mon[30421]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:18:49.166 INFO:tasks.cephadm:Adding mds.a on smithi084 2024-03-30T12:18:49.166 INFO:tasks.cephadm:Adding mds.b on smithi162 2024-03-30T12:18:49.166 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph orch apply mds all '2;smithi084=a;smithi162=b' 2024-03-30T12:18:49.382 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T12:18:49.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:49 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3584949976' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-30T12:18:49.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:49 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/3584949976' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-30T12:18:49.778 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:49 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/3584949976' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-30T12:18:50.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:50 smithi084 ceph-mon[27000]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-03-30T12:18:50.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:50 smithi084 ceph-mon[37565]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-03-30T12:18:50.754 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:50 smithi162 ceph-mon[30421]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-03-30T12:18:51.189 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled mds.all update... 2024-03-30T12:18:51.811 DEBUG:teuthology.orchestra.run.smithi084:mds.a> sudo journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mds.a.service 2024-03-30T12:18:51.814 DEBUG:teuthology.orchestra.run.smithi162:mds.b> sudo journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mds.b.service 2024-03-30T12:18:51.816 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-03-30T12:18:51.817 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T12:18:52.177 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:18:52.177 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":58,"fsid":"d3450b00-ee8e-11ee-b647-cb9ed24678a4","created":"2024-03-30T12:13:37.956825+0000","modified":"2024-03-30T12:18:45.903428+0000","last_up_change":"2024-03-30T12:18:42.422684+0000","last_in_change":"2024-03-30T12:18:24.854304+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T12:16:43.434051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a5734fa-c269-449c-805f-0a42d3d90120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6803","nonce":2597011613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6805","nonce":2597011613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6809","nonce":2597011613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6807","nonce":2597011613}]},"public_addr":"172.21.15.84:6803/2597011613","cluster_addr":"172.21.15.84:6805/2597011613","heartbeat_back_addr":"172.21.15.84:6809/2597011613","heartbeat_front_addr":"172.21.15.84:6807/2597011613","state":["exists","up"]},{"osd":1,"uuid":"3ffe676e-9055-44f7-8b04-87974b854b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6811","nonce":6106221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6813","nonce":6106221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6817","nonce":6106221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6815","nonce":6106221}]},"public_addr":"172.21.15.84:6811/6106221","cluster_addr":"172.21.15.84:6813/6106221","heartbeat_back_addr":"172.21.15.84:6817/6106221","heartbeat_front_addr":"172.21.15.84:6815/6106221","state":["exists","up"]},{"osd":2,"uuid":"c21b4cb6-9ade-44d2-a7ba-33fe9b5dd3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6819","nonce":3627018831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6821","nonce":3627018831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6825","nonce":3627018831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6823","nonce":3627018831}]},"public_addr":"172.21.15.84:6819/3627018831","cluster_addr":"172.21.15.84:6821/3627018831","heartbeat_back_addr":"172.21.15.84:6825/3627018831","heartbeat_front_addr":"172.21.15.84:6823/3627018831","state":["exists","up"]},{"osd":3,"uuid":"d60cb7da-fc49-4cbf-855a-2957dcbf66b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6827","nonce":46835826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6829","nonce":46835826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6833","nonce":46835826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6831","nonce":46835826}]},"public_addr":"172.21.15.84:6827/46835826","cluster_addr":"172.21.15.84:6829/46835826","heartbeat_back_addr":"172.21.15.84:6833/46835826","heartbeat_front_addr":"172.21.15.84:6831/46835826","state":["exists","up"]},{"osd":4,"uuid":"46a5087f-cf7c-4bb2-bace-6e04d57496ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6801","nonce":592935958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6803","nonce":592935958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6807","nonce":592935958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6805","nonce":592935958}]},"public_addr":"172.21.15.162:6801/592935958","cluster_addr":"172.21.15.162:6803/592935958","heartbeat_back_addr":"172.21.15.162:6807/592935958","heartbeat_front_addr":"172.21.15.162:6805/592935958","state":["exists","up"]},{"osd":5,"uuid":"2408494e-0472-4cde-aac6-e87d919b6d2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6809","nonce":2786846638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6811","nonce":2786846638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6815","nonce":2786846638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6813","nonce":2786846638}]},"public_addr":"172.21.15.162:6809/2786846638","cluster_addr":"172.21.15.162:6811/2786846638","heartbeat_back_addr":"172.21.15.162:6815/2786846638","heartbeat_front_addr":"172.21.15.162:6813/2786846638","state":["exists","up"]},{"osd":6,"uuid":"f86781fa-6cb4-4abd-b759-84ff6d7b36d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6817","nonce":2493067564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6819","nonce":2493067564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6823","nonce":2493067564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6821","nonce":2493067564}]},"public_addr":"172.21.15.162:6817/2493067564","cluster_addr":"172.21.15.162:6819/2493067564","heartbeat_back_addr":"172.21.15.162:6823/2493067564","heartbeat_front_addr":"172.21.15.162:6821/2493067564","state":["exists","up"]},{"osd":7,"uuid":"49a38087-ec6c-4ae8-b932-9c59ff7d4321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6825","nonce":158814135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6827","nonce":158814135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6831","nonce":158814135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6829","nonce":158814135}]},"public_addr":"172.21.15.162:6825/158814135","cluster_addr":"172.21.15.162:6827/158814135","heartbeat_back_addr":"172.21.15.162:6831/158814135","heartbeat_front_addr":"172.21.15.162:6829/158814135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:15:49.285912+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:14.234967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:39.383506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:03.790574+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:26.131317+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:50.385373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:14.909835+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:40.707128+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/1374515169":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6800/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6800/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/4071895056":"2024-03-31T12:14:06.678373+0000","172.21.15.84:6801/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6801/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3191408930":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/1433254333":"2024-03-31T12:14:31.125768+0000","172.21.15.84:0/1390761199":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3135527830":"2024-03-31T12:14:31.125768+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T12:18:52.190 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T12:16:43.434051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T12:18:52.190 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T12:18:52.479 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-03-30T12:18:52.490 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[37565]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-03-30T12:18:52.490 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[37565]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "2;smithi084=a;smithi162=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:18:52.491 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[37565]: Saving service mds.all spec with placement smithi084=a;smithi162=b;count:2 2024-03-30T12:18:52.491 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:52.491 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:18:52.491 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:52.491 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:18:52.491 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:52.491 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-30T12:18:52.491 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-30T12:18:52.491 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:52.491 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[37565]: Deploying daemon mds.a on smithi084 2024-03-30T12:18:52.491 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/4173187924' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:18:52.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[27000]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-03-30T12:18:52.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[27000]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "2;smithi084=a;smithi162=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:18:52.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[27000]: Saving service mds.all spec with placement smithi084=a;smithi162=b;count:2 2024-03-30T12:18:52.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:52.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:18:52.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:52.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:18:52.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:52.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-30T12:18:52.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-30T12:18:52.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:52.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[27000]: Deploying daemon mds.a on smithi084 2024-03-30T12:18:52.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:52 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/4173187924' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:18:52.493 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T12:18:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:52 smithi162 ceph-mon[30421]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-03-30T12:18:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:52 smithi162 ceph-mon[30421]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "2;smithi084=a;smithi162=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:18:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:52 smithi162 ceph-mon[30421]: Saving service mds.all spec with placement smithi084=a;smithi162=b;count:2 2024-03-30T12:18:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:52 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:52 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:18:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:52 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:52 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:18:52.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:52 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:52.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:52 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-30T12:18:52.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:52 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-30T12:18:52.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:52 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:52.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:52 smithi162 ceph-mon[30421]: Deploying daemon mds.a on smithi084 2024-03-30T12:18:52.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:52 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/4173187924' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:18:52.817 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:18:52.817 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-03-30T12:18:52.818 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 1 2024-03-30T12:18:53.187 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:18:53 smithi084 systemd[1]: Starting Ceph mds.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:18:53.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:53 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/3772896971' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-30T12:18:53.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:53 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/348177851' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:18:53.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:53 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3772896971' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-30T12:18:53.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:53 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/348177851' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:18:53.505 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:18:53 smithi084 podman[64796]: 2024-03-30 12:18:53.315690374 +0000 UTC m=+0.017371308 image pull c8fb09e16a7d204ddf8070b46841183d802f7121fa7d3b7679ce8e4cb9cfc075 quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2 2024-03-30T12:18:53.505 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:18:53 smithi084 podman[64796]: 2024-03-30 12:18:53.421405072 +0000 UTC m=+0.123085995 container create a9c2e74ca2a3f661bdc4efff076b09b658b3124284317c40769bf98a3fefb221 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-a, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=reef-f14b568, GIT_BRANCH=HEAD) 2024-03-30T12:18:53.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:53 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/3772896971' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-30T12:18:53.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:53 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/348177851' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:18:54.004 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:18:53 smithi084 podman[64796]: 2024-03-30 12:18:53.632159298 +0000 UTC m=+0.333840221 container init a9c2e74ca2a3f661bdc4efff076b09b658b3124284317c40769bf98a3fefb221 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-a, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=reef-f14b568) 2024-03-30T12:18:54.004 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:18:53 smithi084 podman[64796]: 2024-03-30 12:18:53.634929365 +0000 UTC m=+0.336610289 container start a9c2e74ca2a3f661bdc4efff076b09b658b3124284317c40769bf98a3fefb221 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-a, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=reef-f14b568, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:18:54.004 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:18:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-a[64811]: starting mds.a at 2024-03-30T12:18:54.004 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:18:53 smithi084 bash[64796]: a9c2e74ca2a3f661bdc4efff076b09b658b3124284317c40769bf98a3fefb221 2024-03-30T12:18:54.004 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:18:53 smithi084 systemd[1]: Started Ceph mds.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:18:54.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:54 smithi084 ceph-mon[37565]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-03-30T12:18:54.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:54 smithi084 ceph-mon[37565]: mds.? [v2:172.21.15.84:6834/420740305,v1:172.21.15.84:6835/420740305] up:boot 2024-03-30T12:18:54.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:54 smithi084 ceph-mon[37565]: fsmap 1 up:standby 2024-03-30T12:18:54.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:54 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-30T12:18:54.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:54 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:54.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:54 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:54.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:54 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:54.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:54 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-30T12:18:54.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:54 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-30T12:18:54.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:54 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:54.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:54 smithi084 ceph-mon[27000]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-03-30T12:18:54.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:54 smithi084 ceph-mon[27000]: mds.? [v2:172.21.15.84:6834/420740305,v1:172.21.15.84:6835/420740305] up:boot 2024-03-30T12:18:54.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:54 smithi084 ceph-mon[27000]: fsmap 1 up:standby 2024-03-30T12:18:54.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:54 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-30T12:18:54.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:54 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:54.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:54 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:54.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:54 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:54.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:54 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-30T12:18:54.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:54 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-30T12:18:54.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:54 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:54.506 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:54 smithi162 ceph-mon[30421]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-03-30T12:18:54.506 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:54 smithi162 ceph-mon[30421]: mds.? [v2:172.21.15.84:6834/420740305,v1:172.21.15.84:6835/420740305] up:boot 2024-03-30T12:18:54.506 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:54 smithi162 ceph-mon[30421]: fsmap 1 up:standby 2024-03-30T12:18:54.506 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:54 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-30T12:18:54.506 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:54 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:54.507 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:54 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:54.507 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:54 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:54.507 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:54 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-30T12:18:54.507 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:54 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-30T12:18:54.507 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:54 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:54.831 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T12:18:55.165 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:18:55.166 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/420740305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":420740305},{"type":"v1","addr":"172.21.15.84:6835","nonce":420740305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-03-30T12:18:55.166 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 2 2024-03-30T12:18:55.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:55 smithi084 ceph-mon[27000]: Deploying daemon mds.b on smithi162 2024-03-30T12:18:55.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:55 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/1852494798' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:18:55.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:55 smithi084 ceph-mon[37565]: Deploying daemon mds.b on smithi162 2024-03-30T12:18:55.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:55 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/1852494798' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:18:55.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:55 smithi162 ceph-mon[30421]: Deploying daemon mds.b on smithi162 2024-03-30T12:18:55.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:55 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/1852494798' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:18:55.870 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:18:55 smithi162 systemd[1]: Starting Ceph mds.b for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:18:56.242 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:56 smithi162 ceph-mon[30421]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-30T12:18:56.242 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:18:55 smithi162 podman[56685]: 2024-03-30 12:18:55.886216309 +0000 UTC m=+0.018196619 image pull c8fb09e16a7d204ddf8070b46841183d802f7121fa7d3b7679ce8e4cb9cfc075 quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2 2024-03-30T12:18:56.242 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:18:56 smithi162 podman[56685]: 2024-03-30 12:18:56.005075114 +0000 UTC m=+0.137055419 container create ee1770ef5eddfa99fcac5ef41bfc0e611b834f3930501dff2aca63b285c6675b (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-b, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=reef-f14b568, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-03-30T12:18:56.242 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:18:56 smithi162 podman[56685]: 2024-03-30 12:18:56.224177545 +0000 UTC m=+0.356157841 container init ee1770ef5eddfa99fcac5ef41bfc0e611b834f3930501dff2aca63b285c6675b (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=reef-f14b568, GIT_CLEAN=True) 2024-03-30T12:18:56.242 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:18:56 smithi162 podman[56685]: 2024-03-30 12:18:56.226941434 +0000 UTC m=+0.358921730 container start ee1770ef5eddfa99fcac5ef41bfc0e611b834f3930501dff2aca63b285c6675b (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, ceph=True, GIT_CLEAN=True, RELEASE=reef-f14b568, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-03-30T12:18:56.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:56 smithi084 ceph-mon[37565]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-30T12:18:56.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:56 smithi084 ceph-mon[27000]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-30T12:18:56.619 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:18:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-b[56700]: starting mds.b at 2024-03-30T12:18:56.620 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:18:56 smithi162 bash[56685]: ee1770ef5eddfa99fcac5ef41bfc0e611b834f3930501dff2aca63b285c6675b 2024-03-30T12:18:56.620 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:18:56 smithi162 systemd[1]: Started Ceph mds.b for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:18:57.179 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T12:18:57.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:57 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:57.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:57 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:57.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:57 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:57.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:57 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:57.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:57 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:57.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:57 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:18:57.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:57 smithi084 ceph-mon[27000]: mds.? [v2:172.21.15.162:6832/1272121665,v1:172.21.15.162:6833/1272121665] up:boot 2024-03-30T12:18:57.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:57 smithi084 ceph-mon[27000]: fsmap 2 up:standby 2024-03-30T12:18:57.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:57 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-30T12:18:57.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:57 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:57.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:57 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:57.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:57 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:57.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:57 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:57.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:57 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:57.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:57 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:18:57.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:57 smithi084 ceph-mon[37565]: mds.? [v2:172.21.15.162:6832/1272121665,v1:172.21.15.162:6833/1272121665] up:boot 2024-03-30T12:18:57.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:57 smithi084 ceph-mon[37565]: fsmap 2 up:standby 2024-03-30T12:18:57.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:57 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-30T12:18:57.511 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:18:57.511 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/420740305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":420740305},{"type":"v1","addr":"172.21.15.84:6835","nonce":420740305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1272121665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1272121665},{"type":"v1","addr":"172.21.15.162:6833","nonce":1272121665}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-03-30T12:18:57.511 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 3 2024-03-30T12:18:57.524 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T12:18:57.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:57 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:57.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:57 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:57.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:57 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:57.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:57 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:57.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:57 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:57.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:57 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:18:57.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:57 smithi162 ceph-mon[30421]: mds.? [v2:172.21.15.162:6832/1272121665,v1:172.21.15.162:6833/1272121665] up:boot 2024-03-30T12:18:57.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:57 smithi162 ceph-mon[30421]: fsmap 2 up:standby 2024-03-30T12:18:57.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:57 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-30T12:18:57.864 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:18:57.865 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":58,"fsid":"d3450b00-ee8e-11ee-b647-cb9ed24678a4","created":"2024-03-30T12:13:37.956825+0000","modified":"2024-03-30T12:18:45.903428+0000","last_up_change":"2024-03-30T12:18:42.422684+0000","last_in_change":"2024-03-30T12:18:24.854304+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T12:16:43.434051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a5734fa-c269-449c-805f-0a42d3d90120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6803","nonce":2597011613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6805","nonce":2597011613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6809","nonce":2597011613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6807","nonce":2597011613}]},"public_addr":"172.21.15.84:6803/2597011613","cluster_addr":"172.21.15.84:6805/2597011613","heartbeat_back_addr":"172.21.15.84:6809/2597011613","heartbeat_front_addr":"172.21.15.84:6807/2597011613","state":["exists","up"]},{"osd":1,"uuid":"3ffe676e-9055-44f7-8b04-87974b854b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6811","nonce":6106221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6813","nonce":6106221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6817","nonce":6106221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6815","nonce":6106221}]},"public_addr":"172.21.15.84:6811/6106221","cluster_addr":"172.21.15.84:6813/6106221","heartbeat_back_addr":"172.21.15.84:6817/6106221","heartbeat_front_addr":"172.21.15.84:6815/6106221","state":["exists","up"]},{"osd":2,"uuid":"c21b4cb6-9ade-44d2-a7ba-33fe9b5dd3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6819","nonce":3627018831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6821","nonce":3627018831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6825","nonce":3627018831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6823","nonce":3627018831}]},"public_addr":"172.21.15.84:6819/3627018831","cluster_addr":"172.21.15.84:6821/3627018831","heartbeat_back_addr":"172.21.15.84:6825/3627018831","heartbeat_front_addr":"172.21.15.84:6823/3627018831","state":["exists","up"]},{"osd":3,"uuid":"d60cb7da-fc49-4cbf-855a-2957dcbf66b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6827","nonce":46835826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6829","nonce":46835826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6833","nonce":46835826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6831","nonce":46835826}]},"public_addr":"172.21.15.84:6827/46835826","cluster_addr":"172.21.15.84:6829/46835826","heartbeat_back_addr":"172.21.15.84:6833/46835826","heartbeat_front_addr":"172.21.15.84:6831/46835826","state":["exists","up"]},{"osd":4,"uuid":"46a5087f-cf7c-4bb2-bace-6e04d57496ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6801","nonce":592935958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6803","nonce":592935958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6807","nonce":592935958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6805","nonce":592935958}]},"public_addr":"172.21.15.162:6801/592935958","cluster_addr":"172.21.15.162:6803/592935958","heartbeat_back_addr":"172.21.15.162:6807/592935958","heartbeat_front_addr":"172.21.15.162:6805/592935958","state":["exists","up"]},{"osd":5,"uuid":"2408494e-0472-4cde-aac6-e87d919b6d2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6809","nonce":2786846638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6811","nonce":2786846638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6815","nonce":2786846638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6813","nonce":2786846638}]},"public_addr":"172.21.15.162:6809/2786846638","cluster_addr":"172.21.15.162:6811/2786846638","heartbeat_back_addr":"172.21.15.162:6815/2786846638","heartbeat_front_addr":"172.21.15.162:6813/2786846638","state":["exists","up"]},{"osd":6,"uuid":"f86781fa-6cb4-4abd-b759-84ff6d7b36d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6817","nonce":2493067564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6819","nonce":2493067564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6823","nonce":2493067564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6821","nonce":2493067564}]},"public_addr":"172.21.15.162:6817/2493067564","cluster_addr":"172.21.15.162:6819/2493067564","heartbeat_back_addr":"172.21.15.162:6823/2493067564","heartbeat_front_addr":"172.21.15.162:6821/2493067564","state":["exists","up"]},{"osd":7,"uuid":"49a38087-ec6c-4ae8-b932-9c59ff7d4321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6825","nonce":158814135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6827","nonce":158814135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6831","nonce":158814135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6829","nonce":158814135}]},"public_addr":"172.21.15.162:6825/158814135","cluster_addr":"172.21.15.162:6827/158814135","heartbeat_back_addr":"172.21.15.162:6831/158814135","heartbeat_front_addr":"172.21.15.162:6829/158814135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:15:49.285912+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:14.234967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:39.383506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:03.790574+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:26.131317+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:50.385373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:14.909835+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:40.707128+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/1374515169":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6800/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6800/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/4071895056":"2024-03-31T12:14:06.678373+0000","172.21.15.84:6801/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6801/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3191408930":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/1433254333":"2024-03-31T12:14:31.125768+0000","172.21.15.84:0/1390761199":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3135527830":"2024-03-31T12:14:31.125768+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T12:18:57.878 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T12:16:43.434051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T12:18:57.878 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T12:18:58.173 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-03-30T12:18:58.186 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-30T12:18:58.470 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:18:58.470 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2024-03-30T12:18:58.470 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-03-30T12:18:58.470 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2024-03-30T12:18:58.470 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2024-03-30T12:18:58.470 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-30T12:18:58.470 INFO:teuthology.orchestra.run.smithi084.stdout:] 2024-03-30T12:18:58.481 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[37565]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-03-30T12:18:58.482 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/1027591263' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:18:58.482 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/2943695929' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:18:58.482 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:58.482 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:58.482 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:58.482 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:58.482 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:58.482 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:18:58.482 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:58.482 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:18:58.482 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:58.483 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:18:58.483 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:58.483 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/1614187205' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-30T12:18:58.483 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[27000]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-03-30T12:18:58.483 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/1027591263' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:18:58.483 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/2943695929' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:18:58.483 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:58.483 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:58.483 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:58.483 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:58.483 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:58.483 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:18:58.484 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:58.484 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:18:58.484 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:58.484 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:18:58.484 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:58.484 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:58 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/1614187205' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-30T12:18:58.485 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-30T12:18:58.485 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-30T12:18:58.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:58 smithi162 ceph-mon[30421]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-03-30T12:18:58.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:58 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/1027591263' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:18:58.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:58 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/2943695929' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:18:58.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:58 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:58.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:58 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:58.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:58 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:58.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:58 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:58.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:58 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:58.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:58 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:18:58.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:58 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:58.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:58 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:18:58.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:58 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:18:58.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:58 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:18:58.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:58 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:18:58.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:58 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/1614187205' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-30T12:18:59.435 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2024-03-30T12:18:59.449 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-30T12:18:59.472 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:59 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/223755275' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-30T12:18:59.472 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:59 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/444088473' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-30T12:18:59.472 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:18:59 smithi084 ceph-mon[37565]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-30T12:18:59.472 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:59 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/223755275' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-30T12:18:59.473 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:59 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/444088473' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-30T12:18:59.473 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:18:59 smithi084 ceph-mon[27000]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-30T12:18:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:59 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/223755275' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-30T12:18:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:59 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/444088473' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-30T12:18:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:18:59 smithi162 ceph-mon[30421]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-30T12:19:00.435 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2024-03-30T12:19:00.460 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-30T12:19:00.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:00 smithi084 ceph-mon[37565]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-03-30T12:19:00.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:00 smithi084 ceph-mon[37565]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-30T12:19:00.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:00 smithi084 ceph-mon[37565]: osdmap e59: 8 total, 8 up, 8 in 2024-03-30T12:19:00.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:00 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/2646521243' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-30T12:19:00.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:00 smithi084 ceph-mon[37565]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-30T12:19:00.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:00 smithi084 ceph-mon[27000]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-03-30T12:19:00.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:00 smithi084 ceph-mon[27000]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-30T12:19:00.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:00 smithi084 ceph-mon[27000]: osdmap e59: 8 total, 8 up, 8 in 2024-03-30T12:19:00.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:00 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/2646521243' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-30T12:19:00.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:00 smithi084 ceph-mon[27000]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-30T12:19:00.833 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 2 and data pool 3 2024-03-30T12:19:00.856 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T12:19:00.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:00 smithi162 ceph-mon[30421]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-03-30T12:19:00.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:00 smithi162 ceph-mon[30421]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-30T12:19:00.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:00 smithi162 ceph-mon[30421]: osdmap e59: 8 total, 8 up, 8 in 2024-03-30T12:19:00.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:00 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/2646521243' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-30T12:19:00.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:00 smithi162 ceph-mon[30421]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-30T12:19:01.141 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:19:01.141 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":61,"fsid":"d3450b00-ee8e-11ee-b647-cb9ed24678a4","created":"2024-03-30T12:13:37.956825+0000","modified":"2024-03-30T12:19:00.832052+0000","last_up_change":"2024-03-30T12:18:42.422684+0000","last_in_change":"2024-03-30T12:18:24.854304+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T12:16:43.434051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T12:18:59.012249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T12:18:59.975381+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a5734fa-c269-449c-805f-0a42d3d90120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6803","nonce":2597011613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6805","nonce":2597011613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6809","nonce":2597011613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6807","nonce":2597011613}]},"public_addr":"172.21.15.84:6803/2597011613","cluster_addr":"172.21.15.84:6805/2597011613","heartbeat_back_addr":"172.21.15.84:6809/2597011613","heartbeat_front_addr":"172.21.15.84:6807/2597011613","state":["exists","up"]},{"osd":1,"uuid":"3ffe676e-9055-44f7-8b04-87974b854b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6811","nonce":6106221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6813","nonce":6106221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6817","nonce":6106221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6815","nonce":6106221}]},"public_addr":"172.21.15.84:6811/6106221","cluster_addr":"172.21.15.84:6813/6106221","heartbeat_back_addr":"172.21.15.84:6817/6106221","heartbeat_front_addr":"172.21.15.84:6815/6106221","state":["exists","up"]},{"osd":2,"uuid":"c21b4cb6-9ade-44d2-a7ba-33fe9b5dd3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6819","nonce":3627018831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6821","nonce":3627018831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6825","nonce":3627018831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6823","nonce":3627018831}]},"public_addr":"172.21.15.84:6819/3627018831","cluster_addr":"172.21.15.84:6821/3627018831","heartbeat_back_addr":"172.21.15.84:6825/3627018831","heartbeat_front_addr":"172.21.15.84:6823/3627018831","state":["exists","up"]},{"osd":3,"uuid":"d60cb7da-fc49-4cbf-855a-2957dcbf66b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6827","nonce":46835826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6829","nonce":46835826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6833","nonce":46835826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6831","nonce":46835826}]},"public_addr":"172.21.15.84:6827/46835826","cluster_addr":"172.21.15.84:6829/46835826","heartbeat_back_addr":"172.21.15.84:6833/46835826","heartbeat_front_addr":"172.21.15.84:6831/46835826","state":["exists","up"]},{"osd":4,"uuid":"46a5087f-cf7c-4bb2-bace-6e04d57496ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6801","nonce":592935958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6803","nonce":592935958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6807","nonce":592935958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6805","nonce":592935958}]},"public_addr":"172.21.15.162:6801/592935958","cluster_addr":"172.21.15.162:6803/592935958","heartbeat_back_addr":"172.21.15.162:6807/592935958","heartbeat_front_addr":"172.21.15.162:6805/592935958","state":["exists","up"]},{"osd":5,"uuid":"2408494e-0472-4cde-aac6-e87d919b6d2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6809","nonce":2786846638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6811","nonce":2786846638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6815","nonce":2786846638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6813","nonce":2786846638}]},"public_addr":"172.21.15.162:6809/2786846638","cluster_addr":"172.21.15.162:6811/2786846638","heartbeat_back_addr":"172.21.15.162:6815/2786846638","heartbeat_front_addr":"172.21.15.162:6813/2786846638","state":["exists","up"]},{"osd":6,"uuid":"f86781fa-6cb4-4abd-b759-84ff6d7b36d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6817","nonce":2493067564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6819","nonce":2493067564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6823","nonce":2493067564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6821","nonce":2493067564}]},"public_addr":"172.21.15.162:6817/2493067564","cluster_addr":"172.21.15.162:6819/2493067564","heartbeat_back_addr":"172.21.15.162:6823/2493067564","heartbeat_front_addr":"172.21.15.162:6821/2493067564","state":["exists","up"]},{"osd":7,"uuid":"49a38087-ec6c-4ae8-b932-9c59ff7d4321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6825","nonce":158814135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6827","nonce":158814135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6831","nonce":158814135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6829","nonce":158814135}]},"public_addr":"172.21.15.162:6825/158814135","cluster_addr":"172.21.15.162:6827/158814135","heartbeat_back_addr":"172.21.15.162:6831/158814135","heartbeat_front_addr":"172.21.15.162:6829/158814135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:15:49.285912+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:14.234967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:39.383506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:03.790574+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:26.131317+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:50.385373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:14.909835+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:40.707128+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/1374515169":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6800/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6800/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/4071895056":"2024-03-31T12:14:06.678373+0000","172.21.15.84:6801/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6801/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3191408930":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/1433254333":"2024-03-31T12:14:31.125768+0000","172.21.15.84:0/1390761199":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3135527830":"2024-03-31T12:14:31.125768+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T12:19:01.154 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T12:19:01.439 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:19:01.439 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":61,"fsid":"d3450b00-ee8e-11ee-b647-cb9ed24678a4","created":"2024-03-30T12:13:37.956825+0000","modified":"2024-03-30T12:19:00.832052+0000","last_up_change":"2024-03-30T12:18:42.422684+0000","last_in_change":"2024-03-30T12:18:24.854304+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T12:16:43.434051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T12:18:59.012249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T12:18:59.975381+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a5734fa-c269-449c-805f-0a42d3d90120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6803","nonce":2597011613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6805","nonce":2597011613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6809","nonce":2597011613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6807","nonce":2597011613}]},"public_addr":"172.21.15.84:6803/2597011613","cluster_addr":"172.21.15.84:6805/2597011613","heartbeat_back_addr":"172.21.15.84:6809/2597011613","heartbeat_front_addr":"172.21.15.84:6807/2597011613","state":["exists","up"]},{"osd":1,"uuid":"3ffe676e-9055-44f7-8b04-87974b854b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6811","nonce":6106221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6813","nonce":6106221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6817","nonce":6106221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6815","nonce":6106221}]},"public_addr":"172.21.15.84:6811/6106221","cluster_addr":"172.21.15.84:6813/6106221","heartbeat_back_addr":"172.21.15.84:6817/6106221","heartbeat_front_addr":"172.21.15.84:6815/6106221","state":["exists","up"]},{"osd":2,"uuid":"c21b4cb6-9ade-44d2-a7ba-33fe9b5dd3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6819","nonce":3627018831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6821","nonce":3627018831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6825","nonce":3627018831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6823","nonce":3627018831}]},"public_addr":"172.21.15.84:6819/3627018831","cluster_addr":"172.21.15.84:6821/3627018831","heartbeat_back_addr":"172.21.15.84:6825/3627018831","heartbeat_front_addr":"172.21.15.84:6823/3627018831","state":["exists","up"]},{"osd":3,"uuid":"d60cb7da-fc49-4cbf-855a-2957dcbf66b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6827","nonce":46835826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6829","nonce":46835826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6833","nonce":46835826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6831","nonce":46835826}]},"public_addr":"172.21.15.84:6827/46835826","cluster_addr":"172.21.15.84:6829/46835826","heartbeat_back_addr":"172.21.15.84:6833/46835826","heartbeat_front_addr":"172.21.15.84:6831/46835826","state":["exists","up"]},{"osd":4,"uuid":"46a5087f-cf7c-4bb2-bace-6e04d57496ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6801","nonce":592935958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6803","nonce":592935958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6807","nonce":592935958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6805","nonce":592935958}]},"public_addr":"172.21.15.162:6801/592935958","cluster_addr":"172.21.15.162:6803/592935958","heartbeat_back_addr":"172.21.15.162:6807/592935958","heartbeat_front_addr":"172.21.15.162:6805/592935958","state":["exists","up"]},{"osd":5,"uuid":"2408494e-0472-4cde-aac6-e87d919b6d2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6809","nonce":2786846638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6811","nonce":2786846638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6815","nonce":2786846638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6813","nonce":2786846638}]},"public_addr":"172.21.15.162:6809/2786846638","cluster_addr":"172.21.15.162:6811/2786846638","heartbeat_back_addr":"172.21.15.162:6815/2786846638","heartbeat_front_addr":"172.21.15.162:6813/2786846638","state":["exists","up"]},{"osd":6,"uuid":"f86781fa-6cb4-4abd-b759-84ff6d7b36d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6817","nonce":2493067564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6819","nonce":2493067564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6823","nonce":2493067564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6821","nonce":2493067564}]},"public_addr":"172.21.15.162:6817/2493067564","cluster_addr":"172.21.15.162:6819/2493067564","heartbeat_back_addr":"172.21.15.162:6823/2493067564","heartbeat_front_addr":"172.21.15.162:6821/2493067564","state":["exists","up"]},{"osd":7,"uuid":"49a38087-ec6c-4ae8-b932-9c59ff7d4321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6825","nonce":158814135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6827","nonce":158814135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6831","nonce":158814135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6829","nonce":158814135}]},"public_addr":"172.21.15.162:6825/158814135","cluster_addr":"172.21.15.162:6827/158814135","heartbeat_back_addr":"172.21.15.162:6831/158814135","heartbeat_front_addr":"172.21.15.162:6829/158814135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:15:49.285912+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:14.234967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:39.383506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:03.790574+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:26.131317+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:50.385373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:14.909835+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:40.707128+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/1374515169":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6800/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6800/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/4071895056":"2024-03-31T12:14:06.678373+0000","172.21.15.84:6801/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6801/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3191408930":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/1433254333":"2024-03-31T12:14:31.125768+0000","172.21.15.84:0/1390761199":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3135527830":"2024-03-31T12:14:31.125768+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T12:19:01.453 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-30T12:19:01.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:01 smithi084 ceph-mon[27000]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-30T12:19:01.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:01 smithi084 ceph-mon[27000]: osdmap e60: 8 total, 8 up, 8 in 2024-03-30T12:19:01.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:01 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/712749297' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-30T12:19:01.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:01 smithi084 ceph-mon[27000]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-30T12:19:01.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:01 smithi084 ceph-mon[27000]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-30T12:19:01.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:01 smithi084 ceph-mon[27000]: osdmap e61: 8 total, 8 up, 8 in 2024-03-30T12:19:01.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:01 smithi084 ceph-mon[27000]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-30T12:19:01.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:01 smithi084 ceph-mon[27000]: fsmap cephfs:1 {0=b=up:creating} 1 up:standby 2024-03-30T12:19:01.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:01 smithi084 ceph-mon[27000]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-30T12:19:01.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:01 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/623728448' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:19:01.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:01 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:01.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:01 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/937549203' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:19:01.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:01 smithi084 ceph-mon[37565]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-30T12:19:01.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:01 smithi084 ceph-mon[37565]: osdmap e60: 8 total, 8 up, 8 in 2024-03-30T12:19:01.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:01 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/712749297' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-30T12:19:01.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:01 smithi084 ceph-mon[37565]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-30T12:19:01.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:01 smithi084 ceph-mon[37565]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-30T12:19:01.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:01 smithi084 ceph-mon[37565]: osdmap e61: 8 total, 8 up, 8 in 2024-03-30T12:19:01.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:01 smithi084 ceph-mon[37565]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-30T12:19:01.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:01 smithi084 ceph-mon[37565]: fsmap cephfs:1 {0=b=up:creating} 1 up:standby 2024-03-30T12:19:01.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:01 smithi084 ceph-mon[37565]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-30T12:19:01.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:01 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/623728448' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:19:01.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:01 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:01.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:01 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/937549203' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:19:01.852 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-30T12:19:01.852 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-30T12:19:01.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:01 smithi162 ceph-mon[30421]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-30T12:19:01.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:01 smithi162 ceph-mon[30421]: osdmap e60: 8 total, 8 up, 8 in 2024-03-30T12:19:01.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:01 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/712749297' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-30T12:19:01.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:01 smithi162 ceph-mon[30421]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-30T12:19:01.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:01 smithi162 ceph-mon[30421]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-30T12:19:01.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:01 smithi162 ceph-mon[30421]: osdmap e61: 8 total, 8 up, 8 in 2024-03-30T12:19:01.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:01 smithi162 ceph-mon[30421]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-30T12:19:01.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:01 smithi162 ceph-mon[30421]: fsmap cephfs:1 {0=b=up:creating} 1 up:standby 2024-03-30T12:19:01.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:01 smithi162 ceph-mon[30421]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-30T12:19:01.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:01 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/623728448' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:19:01.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:01 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:01.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:01 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/937549203' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:19:02.620 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:19:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-b[56700]: 2024-03-30T12:19:02.216+0000 7f4c52f6e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-30T12:19:02.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:02 smithi162 ceph-mon[30421]: pgmap v186: 97 pgs: 11 creating+peering, 4 active+clean, 82 unknown; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:02.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:02 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/256505460' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-30T12:19:02.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:02 smithi162 ceph-mon[30421]: osdmap e62: 8 total, 8 up, 8 in 2024-03-30T12:19:02.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:02 smithi162 ceph-mon[30421]: mds.? [v2:172.21.15.162:6832/1272121665,v1:172.21.15.162:6833/1272121665] up:active 2024-03-30T12:19:02.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:02 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/256505460' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-30T12:19:02.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:02 smithi162 ceph-mon[30421]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-30T12:19:02.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:02 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/2198322153' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-03-30T12:19:02.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:02 smithi084 ceph-mon[27000]: pgmap v186: 97 pgs: 11 creating+peering, 4 active+clean, 82 unknown; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:02.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:02 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/256505460' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-30T12:19:02.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:02 smithi084 ceph-mon[27000]: osdmap e62: 8 total, 8 up, 8 in 2024-03-30T12:19:02.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:02 smithi084 ceph-mon[27000]: mds.? [v2:172.21.15.162:6832/1272121665,v1:172.21.15.162:6833/1272121665] up:active 2024-03-30T12:19:02.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:02 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/256505460' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-30T12:19:02.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:02 smithi084 ceph-mon[27000]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-30T12:19:02.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:02 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/2198322153' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-03-30T12:19:02.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:02 smithi084 ceph-mon[37565]: pgmap v186: 97 pgs: 11 creating+peering, 4 active+clean, 82 unknown; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:02.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:02 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/256505460' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-30T12:19:02.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:02 smithi084 ceph-mon[37565]: osdmap e62: 8 total, 8 up, 8 in 2024-03-30T12:19:02.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:02 smithi084 ceph-mon[37565]: mds.? [v2:172.21.15.162:6832/1272121665,v1:172.21.15.162:6833/1272121665] up:active 2024-03-30T12:19:02.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:02 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/256505460' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-30T12:19:02.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:02 smithi084 ceph-mon[37565]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-30T12:19:02.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:02 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/2198322153' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-03-30T12:19:02.853 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-30T12:19:02.853 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T12:19:03.177 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:19:03.177 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/420740305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":420740305},{"type":"v1","addr":"172.21.15.84:6835","nonce":420740305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T12:19:00.832494+0000","modified":"2024-03-30T12:19:02.842890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24331":{"gid":24331,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6833/1272121665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1272121665},{"type":"v1","addr":"172.21.15.162:6833","nonce":1272121665}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-30T12:19:03.178 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 6 2024-03-30T12:19:03.190 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T12:19:03.473 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:19:03.473 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":62,"fsid":"d3450b00-ee8e-11ee-b647-cb9ed24678a4","created":"2024-03-30T12:13:37.956825+0000","modified":"2024-03-30T12:19:01.836116+0000","last_up_change":"2024-03-30T12:18:42.422684+0000","last_in_change":"2024-03-30T12:18:24.854304+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T12:16:43.434051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T12:18:59.012249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T12:18:59.975381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a5734fa-c269-449c-805f-0a42d3d90120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6803","nonce":2597011613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6805","nonce":2597011613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6809","nonce":2597011613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6807","nonce":2597011613}]},"public_addr":"172.21.15.84:6803/2597011613","cluster_addr":"172.21.15.84:6805/2597011613","heartbeat_back_addr":"172.21.15.84:6809/2597011613","heartbeat_front_addr":"172.21.15.84:6807/2597011613","state":["exists","up"]},{"osd":1,"uuid":"3ffe676e-9055-44f7-8b04-87974b854b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6811","nonce":6106221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6813","nonce":6106221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6817","nonce":6106221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6815","nonce":6106221}]},"public_addr":"172.21.15.84:6811/6106221","cluster_addr":"172.21.15.84:6813/6106221","heartbeat_back_addr":"172.21.15.84:6817/6106221","heartbeat_front_addr":"172.21.15.84:6815/6106221","state":["exists","up"]},{"osd":2,"uuid":"c21b4cb6-9ade-44d2-a7ba-33fe9b5dd3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6819","nonce":3627018831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6821","nonce":3627018831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6825","nonce":3627018831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6823","nonce":3627018831}]},"public_addr":"172.21.15.84:6819/3627018831","cluster_addr":"172.21.15.84:6821/3627018831","heartbeat_back_addr":"172.21.15.84:6825/3627018831","heartbeat_front_addr":"172.21.15.84:6823/3627018831","state":["exists","up"]},{"osd":3,"uuid":"d60cb7da-fc49-4cbf-855a-2957dcbf66b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6827","nonce":46835826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6829","nonce":46835826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6833","nonce":46835826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6831","nonce":46835826}]},"public_addr":"172.21.15.84:6827/46835826","cluster_addr":"172.21.15.84:6829/46835826","heartbeat_back_addr":"172.21.15.84:6833/46835826","heartbeat_front_addr":"172.21.15.84:6831/46835826","state":["exists","up"]},{"osd":4,"uuid":"46a5087f-cf7c-4bb2-bace-6e04d57496ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6801","nonce":592935958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6803","nonce":592935958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6807","nonce":592935958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6805","nonce":592935958}]},"public_addr":"172.21.15.162:6801/592935958","cluster_addr":"172.21.15.162:6803/592935958","heartbeat_back_addr":"172.21.15.162:6807/592935958","heartbeat_front_addr":"172.21.15.162:6805/592935958","state":["exists","up"]},{"osd":5,"uuid":"2408494e-0472-4cde-aac6-e87d919b6d2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6809","nonce":2786846638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6811","nonce":2786846638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6815","nonce":2786846638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6813","nonce":2786846638}]},"public_addr":"172.21.15.162:6809/2786846638","cluster_addr":"172.21.15.162:6811/2786846638","heartbeat_back_addr":"172.21.15.162:6815/2786846638","heartbeat_front_addr":"172.21.15.162:6813/2786846638","state":["exists","up"]},{"osd":6,"uuid":"f86781fa-6cb4-4abd-b759-84ff6d7b36d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6817","nonce":2493067564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6819","nonce":2493067564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6823","nonce":2493067564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6821","nonce":2493067564}]},"public_addr":"172.21.15.162:6817/2493067564","cluster_addr":"172.21.15.162:6819/2493067564","heartbeat_back_addr":"172.21.15.162:6823/2493067564","heartbeat_front_addr":"172.21.15.162:6821/2493067564","state":["exists","up"]},{"osd":7,"uuid":"49a38087-ec6c-4ae8-b932-9c59ff7d4321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6825","nonce":158814135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6827","nonce":158814135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6831","nonce":158814135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6829","nonce":158814135}]},"public_addr":"172.21.15.162:6825/158814135","cluster_addr":"172.21.15.162:6827/158814135","heartbeat_back_addr":"172.21.15.162:6831/158814135","heartbeat_front_addr":"172.21.15.162:6829/158814135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:15:49.285912+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:14.234967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:39.383506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:03.790574+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:26.131317+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:50.385373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:14.909835+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:40.707128+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/1374515169":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6800/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6800/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/4071895056":"2024-03-31T12:14:06.678373+0000","172.21.15.84:6801/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6801/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3191408930":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/1433254333":"2024-03-31T12:14:31.125768+0000","172.21.15.84:0/1390761199":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3135527830":"2024-03-31T12:14:31.125768+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T12:19:03.485 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-30T12:19:03.485 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T12:19:03.776 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:19:03.778 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:19:03.786 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2024-03-30T12:19:03.174977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592708,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":195,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":222,"acting":222,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":749961216,"kb_used":234936,"kb_used_data":6436,"kb_used_omap":12,"kb_used_meta":228339,"kb_avail":749726280,"statfs":{"total":767960285184,"available":767719710720,"internally_reserved":0,"allocated":6590464,"data_stored":3740705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":233819704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000640"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.869843+0000","last_change":"2024-03-30T12:19:00.867897+0000","last_active":"2024-03-30T12:19:00.869843+0000","last_peered":"2024-03-30T12:19:00.869843+0000","last_clean":"2024-03-30T12:19:00.869843+0000","last_became_active":"2024-03-30T12:19:00.867457+0000","last_became_peered":"2024-03-30T12:19:00.867457+0000","last_unstale":"2024-03-30T12:19:00.869843+0000","last_undegraded":"2024-03-30T12:19:00.869843+0000","last_fullsized":"2024-03-30T12:19:00.869843+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:06:41.382626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847399+0000","last_change":"2024-03-30T12:19:00.853843+0000","last_active":"2024-03-30T12:19:01.847399+0000","last_peered":"2024-03-30T12:19:01.847399+0000","last_clean":"2024-03-30T12:19:01.847399+0000","last_became_active":"2024-03-30T12:19:00.853543+0000","last_became_peered":"2024-03-30T12:19:00.853543+0000","last_unstale":"2024-03-30T12:19:01.847399+0000","last_undegraded":"2024-03-30T12:19:01.847399+0000","last_fullsized":"2024-03-30T12:19:01.847399+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:52.339142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.860870+0000","last_change":"2024-03-30T12:19:00.859974+0000","last_active":"2024-03-30T12:19:00.860870+0000","last_peered":"2024-03-30T12:19:00.860870+0000","last_clean":"2024-03-30T12:19:00.860870+0000","last_became_active":"2024-03-30T12:19:00.859615+0000","last_became_peered":"2024-03-30T12:19:00.859615+0000","last_unstale":"2024-03-30T12:19:00.860870+0000","last_undegraded":"2024-03-30T12:19:00.860870+0000","last_fullsized":"2024-03-30T12:19:00.860870+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:26.933772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.858738+0000","last_change":"2024-03-30T12:19:00.858029+0000","last_active":"2024-03-30T12:19:00.858738+0000","last_peered":"2024-03-30T12:19:00.858738+0000","last_clean":"2024-03-30T12:19:00.858738+0000","last_became_active":"2024-03-30T12:19:00.857668+0000","last_became_peered":"2024-03-30T12:19:00.857668+0000","last_unstale":"2024-03-30T12:19:00.858738+0000","last_undegraded":"2024-03-30T12:19:00.858738+0000","last_fullsized":"2024-03-30T12:19:00.858738+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:17:33.313541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.450731+0000","last_change":"2024-03-30T12:19:00.450731+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.450731+0000","last_undegraded":"2024-03-30T12:19:00.450731+0000","last_fullsized":"2024-03-30T12:19:00.450731+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:59:30.409530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.872246+0000","last_change":"2024-03-30T12:19:00.869363+0000","last_active":"2024-03-30T12:19:00.872246+0000","last_peered":"2024-03-30T12:19:00.872246+0000","last_clean":"2024-03-30T12:19:00.872246+0000","last_became_active":"2024-03-30T12:19:00.868887+0000","last_became_peered":"2024-03-30T12:19:00.868887+0000","last_unstale":"2024-03-30T12:19:00.872246+0000","last_undegraded":"2024-03-30T12:19:00.872246+0000","last_fullsized":"2024-03-30T12:19:00.872246+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:40:49.543161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865134+0000","last_change":"2024-03-30T12:19:00.863992+0000","last_active":"2024-03-30T12:19:00.865134+0000","last_peered":"2024-03-30T12:19:00.865134+0000","last_clean":"2024-03-30T12:19:00.865134+0000","last_became_active":"2024-03-30T12:19:00.863683+0000","last_became_peered":"2024-03-30T12:19:00.863683+0000","last_unstale":"2024-03-30T12:19:00.865134+0000","last_undegraded":"2024-03-30T12:19:00.865134+0000","last_fullsized":"2024-03-30T12:19:00.865134+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:40:36.734391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.449868+0000","last_change":"2024-03-30T12:19:00.449868+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.449868+0000","last_undegraded":"2024-03-30T12:19:00.449868+0000","last_fullsized":"2024-03-30T12:19:00.449868+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:55:56.657057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847752+0000","last_change":"2024-03-30T12:19:00.865479+0000","last_active":"2024-03-30T12:19:01.847752+0000","last_peered":"2024-03-30T12:19:01.847752+0000","last_clean":"2024-03-30T12:19:01.847752+0000","last_became_active":"2024-03-30T12:19:00.864441+0000","last_became_peered":"2024-03-30T12:19:00.864441+0000","last_unstale":"2024-03-30T12:19:01.847752+0000","last_undegraded":"2024-03-30T12:19:01.847752+0000","last_fullsized":"2024-03-30T12:19:01.847752+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:45:55.344815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.867919+0000","last_change":"2024-03-30T12:19:00.866672+0000","last_active":"2024-03-30T12:19:00.867919+0000","last_peered":"2024-03-30T12:19:00.867919+0000","last_clean":"2024-03-30T12:19:00.867919+0000","last_became_active":"2024-03-30T12:19:00.866276+0000","last_became_peered":"2024-03-30T12:19:00.866276+0000","last_unstale":"2024-03-30T12:19:00.867919+0000","last_undegraded":"2024-03-30T12:19:00.867919+0000","last_fullsized":"2024-03-30T12:19:00.867919+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:23:49.856597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865488+0000","last_change":"2024-03-30T12:19:00.864760+0000","last_active":"2024-03-30T12:19:00.865488+0000","last_peered":"2024-03-30T12:19:00.865488+0000","last_clean":"2024-03-30T12:19:00.865488+0000","last_became_active":"2024-03-30T12:19:00.864447+0000","last_became_peered":"2024-03-30T12:19:00.864447+0000","last_unstale":"2024-03-30T12:19:00.865488+0000","last_undegraded":"2024-03-30T12:19:00.865488+0000","last_fullsized":"2024-03-30T12:19:00.865488+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:26:47.024806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865455+0000","last_change":"2024-03-30T12:19:00.863453+0000","last_active":"2024-03-30T12:19:00.865455+0000","last_peered":"2024-03-30T12:19:00.865455+0000","last_clean":"2024-03-30T12:19:00.865455+0000","last_became_active":"2024-03-30T12:19:00.863129+0000","last_became_peered":"2024-03-30T12:19:00.863129+0000","last_unstale":"2024-03-30T12:19:00.865455+0000","last_undegraded":"2024-03-30T12:19:00.865455+0000","last_fullsized":"2024-03-30T12:19:00.865455+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:19:33.658159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.854778+0000","last_change":"2024-03-30T12:19:00.854527+0000","last_active":"2024-03-30T12:19:00.854778+0000","last_peered":"2024-03-30T12:19:00.854778+0000","last_clean":"2024-03-30T12:19:00.854778+0000","last_became_active":"2024-03-30T12:19:00.854238+0000","last_became_peered":"2024-03-30T12:19:00.854238+0000","last_unstale":"2024-03-30T12:19:00.854778+0000","last_undegraded":"2024-03-30T12:19:00.854778+0000","last_fullsized":"2024-03-30T12:19:00.854778+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:50:54.069856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"61'4","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847950+0000","last_change":"2024-03-30T12:19:00.466957+0000","last_active":"2024-03-30T12:19:01.847950+0000","last_peered":"2024-03-30T12:19:01.847950+0000","last_clean":"2024-03-30T12:19:01.847950+0000","last_became_active":"2024-03-30T12:19:00.466689+0000","last_became_peered":"2024-03-30T12:19:00.466689+0000","last_unstale":"2024-03-30T12:19:01.847950+0000","last_undegraded":"2024-03-30T12:19:01.847950+0000","last_fullsized":"2024-03-30T12:19:01.847950+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:08.774258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.449236+0000","last_change":"2024-03-30T12:19:00.449236+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.449236+0000","last_undegraded":"2024-03-30T12:19:00.449236+0000","last_fullsized":"2024-03-30T12:19:00.449236+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:31.953173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.459977+0000","last_change":"2024-03-30T12:19:00.459693+0000","last_active":"2024-03-30T12:19:00.459977+0000","last_peered":"2024-03-30T12:19:00.459977+0000","last_clean":"2024-03-30T12:19:00.459977+0000","last_became_active":"2024-03-30T12:19:00.459409+0000","last_became_peered":"2024-03-30T12:19:00.459409+0000","last_unstale":"2024-03-30T12:19:00.459977+0000","last_undegraded":"2024-03-30T12:19:00.459977+0000","last_fullsized":"2024-03-30T12:19:00.459977+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:27.891375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847768+0000","last_change":"2024-03-30T12:19:00.864952+0000","last_active":"2024-03-30T12:19:01.847768+0000","last_peered":"2024-03-30T12:19:01.847768+0000","last_clean":"2024-03-30T12:19:01.847768+0000","last_became_active":"2024-03-30T12:19:00.864274+0000","last_became_peered":"2024-03-30T12:19:00.864274+0000","last_unstale":"2024-03-30T12:19:01.847768+0000","last_undegraded":"2024-03-30T12:19:01.847768+0000","last_fullsized":"2024-03-30T12:19:01.847768+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:45:00.775246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.860852+0000","last_change":"2024-03-30T12:19:00.859422+0000","last_active":"2024-03-30T12:19:00.860852+0000","last_peered":"2024-03-30T12:19:00.860852+0000","last_clean":"2024-03-30T12:19:00.860852+0000","last_became_active":"2024-03-30T12:19:00.858880+0000","last_became_peered":"2024-03-30T12:19:00.858880+0000","last_unstale":"2024-03-30T12:19:00.860852+0000","last_undegraded":"2024-03-30T12:19:00.860852+0000","last_fullsized":"2024-03-30T12:19:00.860852+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:09.612172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.860824+0000","last_change":"2024-03-30T12:19:00.859307+0000","last_active":"2024-03-30T12:19:00.860824+0000","last_peered":"2024-03-30T12:19:00.860824+0000","last_clean":"2024-03-30T12:19:00.860824+0000","last_became_active":"2024-03-30T12:19:00.858775+0000","last_became_peered":"2024-03-30T12:19:00.858775+0000","last_unstale":"2024-03-30T12:19:00.860824+0000","last_undegraded":"2024-03-30T12:19:00.860824+0000","last_fullsized":"2024-03-30T12:19:00.860824+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:30:39.349902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.455248+0000","last_change":"2024-03-30T12:19:00.454521+0000","last_active":"2024-03-30T12:19:00.455248+0000","last_peered":"2024-03-30T12:19:00.455248+0000","last_clean":"2024-03-30T12:19:00.455248+0000","last_became_active":"2024-03-30T12:19:00.454213+0000","last_became_peered":"2024-03-30T12:19:00.454213+0000","last_unstale":"2024-03-30T12:19:00.455248+0000","last_undegraded":"2024-03-30T12:19:00.455248+0000","last_fullsized":"2024-03-30T12:19:00.455248+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:27:47.198072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.872985+0000","last_change":"2024-03-30T12:19:00.460150+0000","last_active":"2024-03-30T12:19:00.872985+0000","last_peered":"2024-03-30T12:19:00.872985+0000","last_clean":"2024-03-30T12:19:00.872985+0000","last_became_active":"2024-03-30T12:19:00.459740+0000","last_became_peered":"2024-03-30T12:19:00.459740+0000","last_unstale":"2024-03-30T12:19:00.872985+0000","last_undegraded":"2024-03-30T12:19:00.872985+0000","last_fullsized":"2024-03-30T12:19:00.872985+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:52:40.523467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847884+0000","last_change":"2024-03-30T12:19:00.857403+0000","last_active":"2024-03-30T12:19:01.847884+0000","last_peered":"2024-03-30T12:19:01.847884+0000","last_clean":"2024-03-30T12:19:01.847884+0000","last_became_active":"2024-03-30T12:19:00.856652+0000","last_became_peered":"2024-03-30T12:19:00.856652+0000","last_unstale":"2024-03-30T12:19:01.847884+0000","last_undegraded":"2024-03-30T12:19:01.847884+0000","last_fullsized":"2024-03-30T12:19:01.847884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:51.932935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.458535+0000","last_change":"2024-03-30T12:19:00.458253+0000","last_active":"2024-03-30T12:19:00.458535+0000","last_peered":"2024-03-30T12:19:00.458535+0000","last_clean":"2024-03-30T12:19:00.458535+0000","last_became_active":"2024-03-30T12:19:00.457947+0000","last_became_peered":"2024-03-30T12:19:00.457947+0000","last_unstale":"2024-03-30T12:19:00.458535+0000","last_undegraded":"2024-03-30T12:19:00.458535+0000","last_fullsized":"2024-03-30T12:19:00.458535+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:13:18.864198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.448413+0000","last_change":"2024-03-30T12:19:00.448413+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.448413+0000","last_undegraded":"2024-03-30T12:19:00.448413+0000","last_fullsized":"2024-03-30T12:19:00.448413+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:56:16.965191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.841184+0000","last_change":"2024-03-30T12:19:00.466729+0000","last_active":"2024-03-30T12:19:00.841184+0000","last_peered":"2024-03-30T12:19:00.841184+0000","last_clean":"2024-03-30T12:19:00.841184+0000","last_became_active":"2024-03-30T12:19:00.466086+0000","last_became_peered":"2024-03-30T12:19:00.466086+0000","last_unstale":"2024-03-30T12:19:00.841184+0000","last_undegraded":"2024-03-30T12:19:00.841184+0000","last_fullsized":"2024-03-30T12:19:00.841184+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:46:14.144417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.867245+0000","last_change":"2024-03-30T12:19:00.863262+0000","last_active":"2024-03-30T12:19:00.867245+0000","last_peered":"2024-03-30T12:19:00.867245+0000","last_clean":"2024-03-30T12:19:00.867245+0000","last_became_active":"2024-03-30T12:19:00.861328+0000","last_became_peered":"2024-03-30T12:19:00.861328+0000","last_unstale":"2024-03-30T12:19:00.867245+0000","last_undegraded":"2024-03-30T12:19:00.867245+0000","last_fullsized":"2024-03-30T12:19:00.867245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:20:19.049967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.859367+0000","last_change":"2024-03-30T12:19:00.459929+0000","last_active":"2024-03-30T12:19:00.859367+0000","last_peered":"2024-03-30T12:19:00.859367+0000","last_clean":"2024-03-30T12:19:00.859367+0000","last_became_active":"2024-03-30T12:19:00.459518+0000","last_became_peered":"2024-03-30T12:19:00.459518+0000","last_unstale":"2024-03-30T12:19:00.859367+0000","last_undegraded":"2024-03-30T12:19:00.859367+0000","last_fullsized":"2024-03-30T12:19:00.859367+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:09:03.990119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865447+0000","last_change":"2024-03-30T12:19:00.862112+0000","last_active":"2024-03-30T12:19:00.865447+0000","last_peered":"2024-03-30T12:19:00.865447+0000","last_clean":"2024-03-30T12:19:00.865447+0000","last_became_active":"2024-03-30T12:19:00.861782+0000","last_became_peered":"2024-03-30T12:19:00.861782+0000","last_unstale":"2024-03-30T12:19:00.865447+0000","last_undegraded":"2024-03-30T12:19:00.865447+0000","last_fullsized":"2024-03-30T12:19:00.865447+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:01:42.946530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.840300+0000","last_change":"2024-03-30T12:19:00.463745+0000","last_active":"2024-03-30T12:19:00.840300+0000","last_peered":"2024-03-30T12:19:00.840300+0000","last_clean":"2024-03-30T12:19:00.840300+0000","last_became_active":"2024-03-30T12:19:00.462698+0000","last_became_peered":"2024-03-30T12:19:00.462698+0000","last_unstale":"2024-03-30T12:19:00.840300+0000","last_undegraded":"2024-03-30T12:19:00.840300+0000","last_fullsized":"2024-03-30T12:19:00.840300+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:09:33.196928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847685+0000","last_change":"2024-03-30T12:19:00.865197+0000","last_active":"2024-03-30T12:19:01.847685+0000","last_peered":"2024-03-30T12:19:01.847685+0000","last_clean":"2024-03-30T12:19:01.847685+0000","last_became_active":"2024-03-30T12:19:00.864718+0000","last_became_peered":"2024-03-30T12:19:00.864718+0000","last_unstale":"2024-03-30T12:19:01.847685+0000","last_undegraded":"2024-03-30T12:19:01.847685+0000","last_fullsized":"2024-03-30T12:19:01.847685+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:33:34.137353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.873460+0000","last_change":"2024-03-30T12:19:00.463581+0000","last_active":"2024-03-30T12:19:00.873460+0000","last_peered":"2024-03-30T12:19:00.873460+0000","last_clean":"2024-03-30T12:19:00.873460+0000","last_became_active":"2024-03-30T12:19:00.463280+0000","last_became_peered":"2024-03-30T12:19:00.463280+0000","last_unstale":"2024-03-30T12:19:00.873460+0000","last_undegraded":"2024-03-30T12:19:00.873460+0000","last_fullsized":"2024-03-30T12:19:00.873460+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:38:07.390655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"61'6","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.877488+0000","last_change":"2024-03-30T12:19:00.458102+0000","last_active":"2024-03-30T12:19:00.877488+0000","last_peered":"2024-03-30T12:19:00.877488+0000","last_clean":"2024-03-30T12:19:00.877488+0000","last_became_active":"2024-03-30T12:19:00.457759+0000","last_became_peered":"2024-03-30T12:19:00.457759+0000","last_unstale":"2024-03-30T12:19:00.877488+0000","last_undegraded":"2024-03-30T12:19:00.877488+0000","last_fullsized":"2024-03-30T12:19:00.877488+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:31.713303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847868+0000","last_change":"2024-03-30T12:19:00.462939+0000","last_active":"2024-03-30T12:19:01.847868+0000","last_peered":"2024-03-30T12:19:01.847868+0000","last_clean":"2024-03-30T12:19:01.847868+0000","last_became_active":"2024-03-30T12:19:00.462637+0000","last_became_peered":"2024-03-30T12:19:00.462637+0000","last_unstale":"2024-03-30T12:19:01.847868+0000","last_undegraded":"2024-03-30T12:19:01.847868+0000","last_fullsized":"2024-03-30T12:19:01.847868+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:48:59.027106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847660+0000","last_change":"2024-03-30T12:19:00.856865+0000","last_active":"2024-03-30T12:19:01.847660+0000","last_peered":"2024-03-30T12:19:01.847660+0000","last_clean":"2024-03-30T12:19:01.847660+0000","last_became_active":"2024-03-30T12:19:00.856544+0000","last_became_peered":"2024-03-30T12:19:00.856544+0000","last_unstale":"2024-03-30T12:19:01.847660+0000","last_undegraded":"2024-03-30T12:19:01.847660+0000","last_fullsized":"2024-03-30T12:19:01.847660+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:37:39.901012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.841547+0000","last_change":"2024-03-30T12:19:00.465931+0000","last_active":"2024-03-30T12:19:00.841547+0000","last_peered":"2024-03-30T12:19:00.841547+0000","last_clean":"2024-03-30T12:19:00.841547+0000","last_became_active":"2024-03-30T12:19:00.465589+0000","last_became_peered":"2024-03-30T12:19:00.465589+0000","last_unstale":"2024-03-30T12:19:00.841547+0000","last_undegraded":"2024-03-30T12:19:00.841547+0000","last_fullsized":"2024-03-30T12:19:00.841547+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:02:38.614924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.855845+0000","last_change":"2024-03-30T12:19:00.454678+0000","last_active":"2024-03-30T12:19:00.855845+0000","last_peered":"2024-03-30T12:19:00.855845+0000","last_clean":"2024-03-30T12:19:00.855845+0000","last_became_active":"2024-03-30T12:19:00.454380+0000","last_became_peered":"2024-03-30T12:19:00.454380+0000","last_unstale":"2024-03-30T12:19:00.855845+0000","last_undegraded":"2024-03-30T12:19:00.855845+0000","last_fullsized":"2024-03-30T12:19:00.855845+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:08:24.640327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.862926+0000","last_change":"2024-03-30T12:19:00.861547+0000","last_active":"2024-03-30T12:19:00.862926+0000","last_peered":"2024-03-30T12:19:00.862926+0000","last_clean":"2024-03-30T12:19:00.862926+0000","last_became_active":"2024-03-30T12:19:00.861268+0000","last_became_peered":"2024-03-30T12:19:00.861268+0000","last_unstale":"2024-03-30T12:19:00.862926+0000","last_undegraded":"2024-03-30T12:19:00.862926+0000","last_fullsized":"2024-03-30T12:19:00.862926+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:28:37.342309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.873715+0000","last_change":"2024-03-30T12:19:00.460090+0000","last_active":"2024-03-30T12:19:00.873715+0000","last_peered":"2024-03-30T12:19:00.873715+0000","last_clean":"2024-03-30T12:19:00.873715+0000","last_became_active":"2024-03-30T12:19:00.459790+0000","last_became_peered":"2024-03-30T12:19:00.459790+0000","last_unstale":"2024-03-30T12:19:00.873715+0000","last_undegraded":"2024-03-30T12:19:00.873715+0000","last_fullsized":"2024-03-30T12:19:00.873715+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:38.860631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.843884+0000","last_change":"2024-03-30T12:19:00.462709+0000","last_active":"2024-03-30T12:19:00.843884+0000","last_peered":"2024-03-30T12:19:00.843884+0000","last_clean":"2024-03-30T12:19:00.843884+0000","last_became_active":"2024-03-30T12:19:00.462429+0000","last_became_peered":"2024-03-30T12:19:00.462429+0000","last_unstale":"2024-03-30T12:19:00.843884+0000","last_undegraded":"2024-03-30T12:19:00.843884+0000","last_fullsized":"2024-03-30T12:19:00.843884+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:29.579526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.855986+0000","last_change":"2024-03-30T12:19:00.854025+0000","last_active":"2024-03-30T12:19:00.855986+0000","last_peered":"2024-03-30T12:19:00.855986+0000","last_clean":"2024-03-30T12:19:00.855986+0000","last_became_active":"2024-03-30T12:19:00.853714+0000","last_became_peered":"2024-03-30T12:19:00.853714+0000","last_unstale":"2024-03-30T12:19:00.855986+0000","last_undegraded":"2024-03-30T12:19:00.855986+0000","last_fullsized":"2024-03-30T12:19:00.855986+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:27:34.498087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.840118+0000","last_change":"2024-03-30T12:19:00.457612+0000","last_active":"2024-03-30T12:19:00.840118+0000","last_peered":"2024-03-30T12:19:00.840118+0000","last_clean":"2024-03-30T12:19:00.840118+0000","last_became_active":"2024-03-30T12:19:00.457289+0000","last_became_peered":"2024-03-30T12:19:00.457289+0000","last_unstale":"2024-03-30T12:19:00.840118+0000","last_undegraded":"2024-03-30T12:19:00.840118+0000","last_fullsized":"2024-03-30T12:19:00.840118+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:23.011997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.863066+0000","last_change":"2024-03-30T12:19:00.861917+0000","last_active":"2024-03-30T12:19:00.863066+0000","last_peered":"2024-03-30T12:19:00.863066+0000","last_clean":"2024-03-30T12:19:00.863066+0000","last_became_active":"2024-03-30T12:19:00.860645+0000","last_became_peered":"2024-03-30T12:19:00.860645+0000","last_unstale":"2024-03-30T12:19:00.863066+0000","last_undegraded":"2024-03-30T12:19:00.863066+0000","last_fullsized":"2024-03-30T12:19:00.863066+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:30:51.438018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.842009+0000","last_change":"2024-03-30T12:19:00.459145+0000","last_active":"2024-03-30T12:19:00.842009+0000","last_peered":"2024-03-30T12:19:00.842009+0000","last_clean":"2024-03-30T12:19:00.842009+0000","last_became_active":"2024-03-30T12:19:00.457819+0000","last_became_peered":"2024-03-30T12:19:00.457819+0000","last_unstale":"2024-03-30T12:19:00.842009+0000","last_undegraded":"2024-03-30T12:19:00.842009+0000","last_fullsized":"2024-03-30T12:19:00.842009+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:44:38.245366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.447233+0000","last_change":"2024-03-30T12:19:00.447233+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.447233+0000","last_undegraded":"2024-03-30T12:19:00.447233+0000","last_fullsized":"2024-03-30T12:19:00.447233+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:13:39.199499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.841612+0000","last_change":"2024-03-30T12:19:00.465946+0000","last_active":"2024-03-30T12:19:00.841612+0000","last_peered":"2024-03-30T12:19:00.841612+0000","last_clean":"2024-03-30T12:19:00.841612+0000","last_became_active":"2024-03-30T12:19:00.465618+0000","last_became_peered":"2024-03-30T12:19:00.465618+0000","last_unstale":"2024-03-30T12:19:00.841612+0000","last_undegraded":"2024-03-30T12:19:00.841612+0000","last_fullsized":"2024-03-30T12:19:00.841612+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:58:42.109572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"22'117","reported_seq":216,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-03-30T12:18:45.913180+0000","last_change":"2024-03-30T12:18:45.912869+0000","last_active":"2024-03-30T12:18:45.913180+0000","last_peered":"2024-03-30T12:18:45.913180+0000","last_clean":"2024-03-30T12:18:45.913180+0000","last_became_active":"2024-03-30T12:18:45.912395+0000","last_became_peered":"2024-03-30T12:18:45.912395+0000","last_unstale":"2024-03-30T12:18:45.913180+0000","last_undegraded":"2024-03-30T12:18:45.913180+0000","last_fullsized":"2024-03-30T12:18:45.913180+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:34.485283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847236+0000","last_change":"2024-03-30T12:19:00.852506+0000","last_active":"2024-03-30T12:19:01.847236+0000","last_peered":"2024-03-30T12:19:01.847236+0000","last_clean":"2024-03-30T12:19:01.847236+0000","last_became_active":"2024-03-30T12:19:00.852216+0000","last_became_peered":"2024-03-30T12:19:00.852216+0000","last_unstale":"2024-03-30T12:19:01.847236+0000","last_undegraded":"2024-03-30T12:19:01.847236+0000","last_fullsized":"2024-03-30T12:19:01.847236+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:41:21.462303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.868254+0000","last_change":"2024-03-30T12:19:00.865798+0000","last_active":"2024-03-30T12:19:00.868254+0000","last_peered":"2024-03-30T12:19:00.868254+0000","last_clean":"2024-03-30T12:19:00.868254+0000","last_became_active":"2024-03-30T12:19:00.865518+0000","last_became_peered":"2024-03-30T12:19:00.865518+0000","last_unstale":"2024-03-30T12:19:00.868254+0000","last_undegraded":"2024-03-30T12:19:00.868254+0000","last_fullsized":"2024-03-30T12:19:00.868254+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:47:41.818140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.846497+0000","last_change":"2024-03-30T12:19:00.454554+0000","last_active":"2024-03-30T12:19:00.846497+0000","last_peered":"2024-03-30T12:19:00.846497+0000","last_clean":"2024-03-30T12:19:00.846497+0000","last_became_active":"2024-03-30T12:19:00.454233+0000","last_became_peered":"2024-03-30T12:19:00.454233+0000","last_unstale":"2024-03-30T12:19:00.846497+0000","last_undegraded":"2024-03-30T12:19:00.846497+0000","last_fullsized":"2024-03-30T12:19:00.846497+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:05:09.010127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.447774+0000","last_change":"2024-03-30T12:19:00.447774+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.447774+0000","last_undegraded":"2024-03-30T12:19:00.447774+0000","last_fullsized":"2024-03-30T12:19:00.447774+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:36:10.741436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.874220+0000","last_change":"2024-03-30T12:19:00.460279+0000","last_active":"2024-03-30T12:19:00.874220+0000","last_peered":"2024-03-30T12:19:00.874220+0000","last_clean":"2024-03-30T12:19:00.874220+0000","last_became_active":"2024-03-30T12:19:00.459948+0000","last_became_peered":"2024-03-30T12:19:00.459948+0000","last_unstale":"2024-03-30T12:19:00.874220+0000","last_undegraded":"2024-03-30T12:19:00.874220+0000","last_fullsized":"2024-03-30T12:19:00.874220+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:06.870147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847496+0000","last_change":"2024-03-30T12:19:00.853029+0000","last_active":"2024-03-30T12:19:01.847496+0000","last_peered":"2024-03-30T12:19:01.847496+0000","last_clean":"2024-03-30T12:19:01.847496+0000","last_became_active":"2024-03-30T12:19:00.852755+0000","last_became_peered":"2024-03-30T12:19:00.852755+0000","last_unstale":"2024-03-30T12:19:01.847496+0000","last_undegraded":"2024-03-30T12:19:01.847496+0000","last_fullsized":"2024-03-30T12:19:01.847496+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:03:44.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.844116+0000","last_change":"2024-03-30T12:19:00.459528+0000","last_active":"2024-03-30T12:19:00.844116+0000","last_peered":"2024-03-30T12:19:00.844116+0000","last_clean":"2024-03-30T12:19:00.844116+0000","last_became_active":"2024-03-30T12:19:00.459223+0000","last_became_peered":"2024-03-30T12:19:00.459223+0000","last_unstale":"2024-03-30T12:19:00.844116+0000","last_undegraded":"2024-03-30T12:19:00.844116+0000","last_fullsized":"2024-03-30T12:19:00.844116+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:44.399783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.447356+0000","last_change":"2024-03-30T12:19:00.447356+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.447356+0000","last_undegraded":"2024-03-30T12:19:00.447356+0000","last_fullsized":"2024-03-30T12:19:00.447356+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:52:32.869322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.844802+0000","last_change":"2024-03-30T12:19:00.460526+0000","last_active":"2024-03-30T12:19:00.844802+0000","last_peered":"2024-03-30T12:19:00.844802+0000","last_clean":"2024-03-30T12:19:00.844802+0000","last_became_active":"2024-03-30T12:19:00.460018+0000","last_became_peered":"2024-03-30T12:19:00.460018+0000","last_unstale":"2024-03-30T12:19:00.844802+0000","last_undegraded":"2024-03-30T12:19:00.844802+0000","last_fullsized":"2024-03-30T12:19:00.844802+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:33:30.671209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.447901+0000","last_change":"2024-03-30T12:19:00.447901+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.447901+0000","last_undegraded":"2024-03-30T12:19:00.447901+0000","last_fullsized":"2024-03-30T12:19:00.447901+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:43.731796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.871217+0000","last_change":"2024-03-30T12:19:00.869001+0000","last_active":"2024-03-30T12:19:00.871217+0000","last_peered":"2024-03-30T12:19:00.871217+0000","last_clean":"2024-03-30T12:19:00.871217+0000","last_became_active":"2024-03-30T12:19:00.868645+0000","last_became_peered":"2024-03-30T12:19:00.868645+0000","last_unstale":"2024-03-30T12:19:00.871217+0000","last_undegraded":"2024-03-30T12:19:00.871217+0000","last_fullsized":"2024-03-30T12:19:00.871217+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:54:10.778279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.842782+0000","last_change":"2024-03-30T12:19:00.459171+0000","last_active":"2024-03-30T12:19:00.842782+0000","last_peered":"2024-03-30T12:19:00.842782+0000","last_clean":"2024-03-30T12:19:00.842782+0000","last_became_active":"2024-03-30T12:19:00.458925+0000","last_became_peered":"2024-03-30T12:19:00.458925+0000","last_unstale":"2024-03-30T12:19:00.842782+0000","last_undegraded":"2024-03-30T12:19:00.842782+0000","last_fullsized":"2024-03-30T12:19:00.842782+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:26:20.974369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.873975+0000","last_change":"2024-03-30T12:19:00.459545+0000","last_active":"2024-03-30T12:19:00.873975+0000","last_peered":"2024-03-30T12:19:00.873975+0000","last_clean":"2024-03-30T12:19:00.873975+0000","last_became_active":"2024-03-30T12:19:00.459250+0000","last_became_peered":"2024-03-30T12:19:00.459250+0000","last_unstale":"2024-03-30T12:19:00.873975+0000","last_undegraded":"2024-03-30T12:19:00.873975+0000","last_fullsized":"2024-03-30T12:19:00.873975+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:38.112815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.853251+0000","last_change":"2024-03-30T12:19:00.852558+0000","last_active":"2024-03-30T12:19:00.853251+0000","last_peered":"2024-03-30T12:19:00.853251+0000","last_clean":"2024-03-30T12:19:00.853251+0000","last_became_active":"2024-03-30T12:19:00.852250+0000","last_became_peered":"2024-03-30T12:19:00.852250+0000","last_unstale":"2024-03-30T12:19:00.853251+0000","last_undegraded":"2024-03-30T12:19:00.853251+0000","last_fullsized":"2024-03-30T12:19:00.853251+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:57:15.989801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.879619+0000","last_change":"2024-03-30T12:19:00.464968+0000","last_active":"2024-03-30T12:19:00.879619+0000","last_peered":"2024-03-30T12:19:00.879619+0000","last_clean":"2024-03-30T12:19:00.879619+0000","last_became_active":"2024-03-30T12:19:00.464021+0000","last_became_peered":"2024-03-30T12:19:00.464021+0000","last_unstale":"2024-03-30T12:19:00.879619+0000","last_undegraded":"2024-03-30T12:19:00.879619+0000","last_fullsized":"2024-03-30T12:19:00.879619+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:20.224884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.863796+0000","last_change":"2024-03-30T12:19:00.862859+0000","last_active":"2024-03-30T12:19:00.863796+0000","last_peered":"2024-03-30T12:19:00.863796+0000","last_clean":"2024-03-30T12:19:00.863796+0000","last_became_active":"2024-03-30T12:19:00.862535+0000","last_became_peered":"2024-03-30T12:19:00.862535+0000","last_unstale":"2024-03-30T12:19:00.863796+0000","last_undegraded":"2024-03-30T12:19:00.863796+0000","last_fullsized":"2024-03-30T12:19:00.863796+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:17:31.462763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865528+0000","last_change":"2024-03-30T12:19:00.862947+0000","last_active":"2024-03-30T12:19:00.865528+0000","last_peered":"2024-03-30T12:19:00.865528+0000","last_clean":"2024-03-30T12:19:00.865528+0000","last_became_active":"2024-03-30T12:19:00.862567+0000","last_became_peered":"2024-03-30T12:19:00.862567+0000","last_unstale":"2024-03-30T12:19:00.865528+0000","last_undegraded":"2024-03-30T12:19:00.865528+0000","last_fullsized":"2024-03-30T12:19:00.865528+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:55:05.422370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.857994+0000","last_change":"2024-03-30T12:19:00.856869+0000","last_active":"2024-03-30T12:19:00.857994+0000","last_peered":"2024-03-30T12:19:00.857994+0000","last_clean":"2024-03-30T12:19:00.857994+0000","last_became_active":"2024-03-30T12:19:00.856525+0000","last_became_peered":"2024-03-30T12:19:00.856525+0000","last_unstale":"2024-03-30T12:19:00.857994+0000","last_undegraded":"2024-03-30T12:19:00.857994+0000","last_fullsized":"2024-03-30T12:19:00.857994+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:01:47.443294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847804+0000","last_change":"2024-03-30T12:19:00.859724+0000","last_active":"2024-03-30T12:19:01.847804+0000","last_peered":"2024-03-30T12:19:01.847804+0000","last_clean":"2024-03-30T12:19:01.847804+0000","last_became_active":"2024-03-30T12:19:00.859327+0000","last_became_peered":"2024-03-30T12:19:00.859327+0000","last_unstale":"2024-03-30T12:19:01.847804+0000","last_undegraded":"2024-03-30T12:19:01.847804+0000","last_fullsized":"2024-03-30T12:19:01.847804+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:53:15.692683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.449139+0000","last_change":"2024-03-30T12:19:00.449139+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.449139+0000","last_undegraded":"2024-03-30T12:19:00.449139+0000","last_fullsized":"2024-03-30T12:19:00.449139+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:42.644771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.848520+0000","last_change":"2024-03-30T12:19:00.848297+0000","last_active":"2024-03-30T12:19:00.848520+0000","last_peered":"2024-03-30T12:19:00.848520+0000","last_clean":"2024-03-30T12:19:00.848520+0000","last_became_active":"2024-03-30T12:19:00.848029+0000","last_became_peered":"2024-03-30T12:19:00.848029+0000","last_unstale":"2024-03-30T12:19:00.848520+0000","last_undegraded":"2024-03-30T12:19:00.848520+0000","last_fullsized":"2024-03-30T12:19:00.848520+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:38.617413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.872267+0000","last_change":"2024-03-30T12:19:00.869414+0000","last_active":"2024-03-30T12:19:00.872267+0000","last_peered":"2024-03-30T12:19:00.872267+0000","last_clean":"2024-03-30T12:19:00.872267+0000","last_became_active":"2024-03-30T12:19:00.869115+0000","last_became_peered":"2024-03-30T12:19:00.869115+0000","last_unstale":"2024-03-30T12:19:00.872267+0000","last_undegraded":"2024-03-30T12:19:00.872267+0000","last_fullsized":"2024-03-30T12:19:00.872267+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:01:12.173692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.450476+0000","last_change":"2024-03-30T12:19:00.450476+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.450476+0000","last_undegraded":"2024-03-30T12:19:00.450476+0000","last_fullsized":"2024-03-30T12:19:00.450476+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:21:16.961559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.856024+0000","last_change":"2024-03-30T12:19:00.854668+0000","last_active":"2024-03-30T12:19:00.856024+0000","last_peered":"2024-03-30T12:19:00.856024+0000","last_clean":"2024-03-30T12:19:00.856024+0000","last_became_active":"2024-03-30T12:19:00.854390+0000","last_became_peered":"2024-03-30T12:19:00.854390+0000","last_unstale":"2024-03-30T12:19:00.856024+0000","last_undegraded":"2024-03-30T12:19:00.856024+0000","last_fullsized":"2024-03-30T12:19:00.856024+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:39:22.128098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.449719+0000","last_change":"2024-03-30T12:19:00.449719+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.449719+0000","last_undegraded":"2024-03-30T12:19:00.449719+0000","last_fullsized":"2024-03-30T12:19:00.449719+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:46:50.526568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865165+0000","last_change":"2024-03-30T12:19:00.860406+0000","last_active":"2024-03-30T12:19:00.865165+0000","last_peered":"2024-03-30T12:19:00.865165+0000","last_clean":"2024-03-30T12:19:00.865165+0000","last_became_active":"2024-03-30T12:19:00.860085+0000","last_became_peered":"2024-03-30T12:19:00.860085+0000","last_unstale":"2024-03-30T12:19:00.865165+0000","last_undegraded":"2024-03-30T12:19:00.865165+0000","last_fullsized":"2024-03-30T12:19:00.865165+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:32.201939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847724+0000","last_change":"2024-03-30T12:19:00.856917+0000","last_active":"2024-03-30T12:19:01.847724+0000","last_peered":"2024-03-30T12:19:01.847724+0000","last_clean":"2024-03-30T12:19:01.847724+0000","last_became_active":"2024-03-30T12:19:00.856643+0000","last_became_peered":"2024-03-30T12:19:00.856643+0000","last_unstale":"2024-03-30T12:19:01.847724+0000","last_undegraded":"2024-03-30T12:19:01.847724+0000","last_fullsized":"2024-03-30T12:19:01.847724+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:51:53.996045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.871097+0000","last_change":"2024-03-30T12:19:00.867176+0000","last_active":"2024-03-30T12:19:00.871097+0000","last_peered":"2024-03-30T12:19:00.871097+0000","last_clean":"2024-03-30T12:19:00.871097+0000","last_became_active":"2024-03-30T12:19:00.866801+0000","last_became_peered":"2024-03-30T12:19:00.866801+0000","last_unstale":"2024-03-30T12:19:00.871097+0000","last_undegraded":"2024-03-30T12:19:00.871097+0000","last_fullsized":"2024-03-30T12:19:00.871097+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:31:22.909206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":144,"acting":144,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2340,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":75,"acting":75,"num_store_stats":6}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928233990,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28160,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716992,"statfs":{"total":95995035648,"available":95966199808,"internally_reserved":0,"allocated":1163264,"data_stored":822591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]}]},{"osd":6,"up_from":46,"seq":197568495627,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28212,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716940,"statfs":{"total":95995035648,"available":95966146560,"internally_reserved":0,"allocated":1212416,"data_stored":844370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31720,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713432,"statfs":{"total":95995035648,"available":95962554368,"internally_reserved":0,"allocated":610304,"data_stored":252325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.32500000000000001,"15min":0.307},"min":{"1min":0.23000000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.32000000000000001},"min":{"1min":0.23599999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.33000000000000002}]},{"osd":2,"last update":"Sat Mar 30 12:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.38200000000000001,"15min":0.375},"min":{"1min":0.254,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.39500000000000002,"15min":0.38900000000000001},"min":{"1min":0.32200000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.26300000000000001}]},{"osd":3,"last update":"Sat Mar 30 12:18:08 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.48499999999999999}]},{"osd":4,"last update":"Sat Mar 30 12:18:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.46300000000000002}]},{"osd":5,"last update":"Sat Mar 30 12:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738408,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32316,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712836,"statfs":{"total":95995035648,"available":95961944064,"internally_reserved":0,"allocated":1220608,"data_stored":843807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 30 12:18:17 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.307,"15min":0.29499999999999998},"min":{"1min":0.27500000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.317,"15min":0.30299999999999999},"min":{"1min":0.28199999999999997,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.36799999999999999}]},{"osd":2,"last update":"Sat Mar 30 12:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.42799999999999999,"15min":0.42099999999999999},"min":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.437,"5min":0.40899999999999997,"15min":0.40500000000000003},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.378}]},{"osd":3,"last update":"Sat Mar 30 12:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.32500000000000001}]},{"osd":4,"last update":"Sat Mar 30 12:18:29 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.61799999999999999}]},{"osd":5,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411358,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31716,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713436,"statfs":{"total":95995035648,"available":95962558464,"internally_reserved":0,"allocated":606208,"data_stored":252438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:18:49 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34200000000000003},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38100000000000001,"15min":0.38},"min":{"1min":0.26900000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.56499999999999995,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.435}]},{"osd":1,"last update":"Sat Mar 30 12:18:49 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40200000000000002,"15min":0.40100000000000002},"min":{"1min":0.27800000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.38200000000000001},"min":{"1min":0.25600000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59899999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.44700000000000001}]},{"osd":3,"last update":"Sat Mar 30 12:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.48699999999999999}]},{"osd":4,"last update":"Sat Mar 30 12:18:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.91500000000000004}]},{"osd":5,"last update":"Sat Mar 30 12:18:57 2024","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.542,"15min":1.542},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":19.606999999999999,"5min":19.606999999999999,"15min":19.606999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.746}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182425,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717560,"statfs":{"total":95995035648,"available":95966781440,"internally_reserved":0,"allocated":585728,"data_stored":238801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.30299999999999999}]},{"osd":1,"last update":"Sat Mar 30 12:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.36599999999999999}]},{"osd":2,"last update":"Sat Mar 30 12:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.35199999999999998}]},{"osd":4,"last update":"Sat Mar 30 12:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":4.8639999999999999,"5min":4.8639999999999999,"15min":4.8639999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.625}]},{"osd":5,"last update":"Sat Mar 30 12:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":4,"up_from":30,"seq":128849018900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27580,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717572,"statfs":{"total":95995035648,"available":95966793728,"internally_reserved":0,"allocated":565248,"data_stored":232008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.53600000000000003}]},{"osd":1,"last update":"Sat Mar 30 12:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.59799999999999998}]},{"osd":2,"last update":"Sat Mar 30 12:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.61599999999999999}]},{"osd":3,"last update":"Sat Mar 30 12:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.50600000000000001}]},{"osd":5,"last update":"Sat Mar 30 12:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.35399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]}]},{"osd":5,"up_from":38,"seq":163208757264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27640,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717512,"statfs":{"total":95995035648,"available":95966732288,"internally_reserved":0,"allocated":626688,"data_stored":254365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.41499999999999998}]},{"osd":1,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.44500000000000001}]},{"osd":2,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.46100000000000002}]},{"osd":3,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.436}]},{"osd":4,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.35099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:19:03.792 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T12:19:04.115 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:19:04.116 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:19:04.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:03 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/2198322153' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-03-30T12:19:04.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:03 smithi162 ceph-mon[30421]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-30T12:19:04.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:03 smithi162 ceph-mon[30421]: pgmap v188: 97 pgs: 11 creating+peering, 63 active+clean, 23 unknown; 579 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s wr, 8 op/s 2024-03-30T12:19:04.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:03 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/3657744614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:19:04.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:03 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/1706849287' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:19:04.124 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:03 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/2198322153' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-03-30T12:19:04.124 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:03 smithi084 ceph-mon[27000]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-30T12:19:04.124 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:03 smithi084 ceph-mon[27000]: pgmap v188: 97 pgs: 11 creating+peering, 63 active+clean, 23 unknown; 579 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s wr, 8 op/s 2024-03-30T12:19:04.124 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:03 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3657744614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:19:04.125 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:03 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/1706849287' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:19:04.125 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:03 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/2198322153' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-03-30T12:19:04.125 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:03 smithi084 ceph-mon[37565]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-30T12:19:04.125 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:03 smithi084 ceph-mon[37565]: pgmap v188: 97 pgs: 11 creating+peering, 63 active+clean, 23 unknown; 579 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s wr, 8 op/s 2024-03-30T12:19:04.125 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:03 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/3657744614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:19:04.125 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:03 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/1706849287' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:19:04.126 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2024-03-30T12:19:03.174977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592708,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":195,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":222,"acting":222,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":749961216,"kb_used":234936,"kb_used_data":6436,"kb_used_omap":12,"kb_used_meta":228339,"kb_avail":749726280,"statfs":{"total":767960285184,"available":767719710720,"internally_reserved":0,"allocated":6590464,"data_stored":3740705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":233819704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000640"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.869843+0000","last_change":"2024-03-30T12:19:00.867897+0000","last_active":"2024-03-30T12:19:00.869843+0000","last_peered":"2024-03-30T12:19:00.869843+0000","last_clean":"2024-03-30T12:19:00.869843+0000","last_became_active":"2024-03-30T12:19:00.867457+0000","last_became_peered":"2024-03-30T12:19:00.867457+0000","last_unstale":"2024-03-30T12:19:00.869843+0000","last_undegraded":"2024-03-30T12:19:00.869843+0000","last_fullsized":"2024-03-30T12:19:00.869843+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:06:41.382626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847399+0000","last_change":"2024-03-30T12:19:00.853843+0000","last_active":"2024-03-30T12:19:01.847399+0000","last_peered":"2024-03-30T12:19:01.847399+0000","last_clean":"2024-03-30T12:19:01.847399+0000","last_became_active":"2024-03-30T12:19:00.853543+0000","last_became_peered":"2024-03-30T12:19:00.853543+0000","last_unstale":"2024-03-30T12:19:01.847399+0000","last_undegraded":"2024-03-30T12:19:01.847399+0000","last_fullsized":"2024-03-30T12:19:01.847399+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:52.339142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.860870+0000","last_change":"2024-03-30T12:19:00.859974+0000","last_active":"2024-03-30T12:19:00.860870+0000","last_peered":"2024-03-30T12:19:00.860870+0000","last_clean":"2024-03-30T12:19:00.860870+0000","last_became_active":"2024-03-30T12:19:00.859615+0000","last_became_peered":"2024-03-30T12:19:00.859615+0000","last_unstale":"2024-03-30T12:19:00.860870+0000","last_undegraded":"2024-03-30T12:19:00.860870+0000","last_fullsized":"2024-03-30T12:19:00.860870+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:26.933772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.858738+0000","last_change":"2024-03-30T12:19:00.858029+0000","last_active":"2024-03-30T12:19:00.858738+0000","last_peered":"2024-03-30T12:19:00.858738+0000","last_clean":"2024-03-30T12:19:00.858738+0000","last_became_active":"2024-03-30T12:19:00.857668+0000","last_became_peered":"2024-03-30T12:19:00.857668+0000","last_unstale":"2024-03-30T12:19:00.858738+0000","last_undegraded":"2024-03-30T12:19:00.858738+0000","last_fullsized":"2024-03-30T12:19:00.858738+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:17:33.313541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.450731+0000","last_change":"2024-03-30T12:19:00.450731+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.450731+0000","last_undegraded":"2024-03-30T12:19:00.450731+0000","last_fullsized":"2024-03-30T12:19:00.450731+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:59:30.409530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.872246+0000","last_change":"2024-03-30T12:19:00.869363+0000","last_active":"2024-03-30T12:19:00.872246+0000","last_peered":"2024-03-30T12:19:00.872246+0000","last_clean":"2024-03-30T12:19:00.872246+0000","last_became_active":"2024-03-30T12:19:00.868887+0000","last_became_peered":"2024-03-30T12:19:00.868887+0000","last_unstale":"2024-03-30T12:19:00.872246+0000","last_undegraded":"2024-03-30T12:19:00.872246+0000","last_fullsized":"2024-03-30T12:19:00.872246+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:40:49.543161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865134+0000","last_change":"2024-03-30T12:19:00.863992+0000","last_active":"2024-03-30T12:19:00.865134+0000","last_peered":"2024-03-30T12:19:00.865134+0000","last_clean":"2024-03-30T12:19:00.865134+0000","last_became_active":"2024-03-30T12:19:00.863683+0000","last_became_peered":"2024-03-30T12:19:00.863683+0000","last_unstale":"2024-03-30T12:19:00.865134+0000","last_undegraded":"2024-03-30T12:19:00.865134+0000","last_fullsized":"2024-03-30T12:19:00.865134+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:40:36.734391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.449868+0000","last_change":"2024-03-30T12:19:00.449868+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.449868+0000","last_undegraded":"2024-03-30T12:19:00.449868+0000","last_fullsized":"2024-03-30T12:19:00.449868+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:55:56.657057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847752+0000","last_change":"2024-03-30T12:19:00.865479+0000","last_active":"2024-03-30T12:19:01.847752+0000","last_peered":"2024-03-30T12:19:01.847752+0000","last_clean":"2024-03-30T12:19:01.847752+0000","last_became_active":"2024-03-30T12:19:00.864441+0000","last_became_peered":"2024-03-30T12:19:00.864441+0000","last_unstale":"2024-03-30T12:19:01.847752+0000","last_undegraded":"2024-03-30T12:19:01.847752+0000","last_fullsized":"2024-03-30T12:19:01.847752+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:45:55.344815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.867919+0000","last_change":"2024-03-30T12:19:00.866672+0000","last_active":"2024-03-30T12:19:00.867919+0000","last_peered":"2024-03-30T12:19:00.867919+0000","last_clean":"2024-03-30T12:19:00.867919+0000","last_became_active":"2024-03-30T12:19:00.866276+0000","last_became_peered":"2024-03-30T12:19:00.866276+0000","last_unstale":"2024-03-30T12:19:00.867919+0000","last_undegraded":"2024-03-30T12:19:00.867919+0000","last_fullsized":"2024-03-30T12:19:00.867919+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:23:49.856597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865488+0000","last_change":"2024-03-30T12:19:00.864760+0000","last_active":"2024-03-30T12:19:00.865488+0000","last_peered":"2024-03-30T12:19:00.865488+0000","last_clean":"2024-03-30T12:19:00.865488+0000","last_became_active":"2024-03-30T12:19:00.864447+0000","last_became_peered":"2024-03-30T12:19:00.864447+0000","last_unstale":"2024-03-30T12:19:00.865488+0000","last_undegraded":"2024-03-30T12:19:00.865488+0000","last_fullsized":"2024-03-30T12:19:00.865488+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:26:47.024806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865455+0000","last_change":"2024-03-30T12:19:00.863453+0000","last_active":"2024-03-30T12:19:00.865455+0000","last_peered":"2024-03-30T12:19:00.865455+0000","last_clean":"2024-03-30T12:19:00.865455+0000","last_became_active":"2024-03-30T12:19:00.863129+0000","last_became_peered":"2024-03-30T12:19:00.863129+0000","last_unstale":"2024-03-30T12:19:00.865455+0000","last_undegraded":"2024-03-30T12:19:00.865455+0000","last_fullsized":"2024-03-30T12:19:00.865455+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:19:33.658159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.854778+0000","last_change":"2024-03-30T12:19:00.854527+0000","last_active":"2024-03-30T12:19:00.854778+0000","last_peered":"2024-03-30T12:19:00.854778+0000","last_clean":"2024-03-30T12:19:00.854778+0000","last_became_active":"2024-03-30T12:19:00.854238+0000","last_became_peered":"2024-03-30T12:19:00.854238+0000","last_unstale":"2024-03-30T12:19:00.854778+0000","last_undegraded":"2024-03-30T12:19:00.854778+0000","last_fullsized":"2024-03-30T12:19:00.854778+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:50:54.069856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"61'4","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847950+0000","last_change":"2024-03-30T12:19:00.466957+0000","last_active":"2024-03-30T12:19:01.847950+0000","last_peered":"2024-03-30T12:19:01.847950+0000","last_clean":"2024-03-30T12:19:01.847950+0000","last_became_active":"2024-03-30T12:19:00.466689+0000","last_became_peered":"2024-03-30T12:19:00.466689+0000","last_unstale":"2024-03-30T12:19:01.847950+0000","last_undegraded":"2024-03-30T12:19:01.847950+0000","last_fullsized":"2024-03-30T12:19:01.847950+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:08.774258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.449236+0000","last_change":"2024-03-30T12:19:00.449236+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.449236+0000","last_undegraded":"2024-03-30T12:19:00.449236+0000","last_fullsized":"2024-03-30T12:19:00.449236+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:31.953173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.459977+0000","last_change":"2024-03-30T12:19:00.459693+0000","last_active":"2024-03-30T12:19:00.459977+0000","last_peered":"2024-03-30T12:19:00.459977+0000","last_clean":"2024-03-30T12:19:00.459977+0000","last_became_active":"2024-03-30T12:19:00.459409+0000","last_became_peered":"2024-03-30T12:19:00.459409+0000","last_unstale":"2024-03-30T12:19:00.459977+0000","last_undegraded":"2024-03-30T12:19:00.459977+0000","last_fullsized":"2024-03-30T12:19:00.459977+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:27.891375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847768+0000","last_change":"2024-03-30T12:19:00.864952+0000","last_active":"2024-03-30T12:19:01.847768+0000","last_peered":"2024-03-30T12:19:01.847768+0000","last_clean":"2024-03-30T12:19:01.847768+0000","last_became_active":"2024-03-30T12:19:00.864274+0000","last_became_peered":"2024-03-30T12:19:00.864274+0000","last_unstale":"2024-03-30T12:19:01.847768+0000","last_undegraded":"2024-03-30T12:19:01.847768+0000","last_fullsized":"2024-03-30T12:19:01.847768+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:45:00.775246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.860852+0000","last_change":"2024-03-30T12:19:00.859422+0000","last_active":"2024-03-30T12:19:00.860852+0000","last_peered":"2024-03-30T12:19:00.860852+0000","last_clean":"2024-03-30T12:19:00.860852+0000","last_became_active":"2024-03-30T12:19:00.858880+0000","last_became_peered":"2024-03-30T12:19:00.858880+0000","last_unstale":"2024-03-30T12:19:00.860852+0000","last_undegraded":"2024-03-30T12:19:00.860852+0000","last_fullsized":"2024-03-30T12:19:00.860852+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:09.612172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.860824+0000","last_change":"2024-03-30T12:19:00.859307+0000","last_active":"2024-03-30T12:19:00.860824+0000","last_peered":"2024-03-30T12:19:00.860824+0000","last_clean":"2024-03-30T12:19:00.860824+0000","last_became_active":"2024-03-30T12:19:00.858775+0000","last_became_peered":"2024-03-30T12:19:00.858775+0000","last_unstale":"2024-03-30T12:19:00.860824+0000","last_undegraded":"2024-03-30T12:19:00.860824+0000","last_fullsized":"2024-03-30T12:19:00.860824+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:30:39.349902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.455248+0000","last_change":"2024-03-30T12:19:00.454521+0000","last_active":"2024-03-30T12:19:00.455248+0000","last_peered":"2024-03-30T12:19:00.455248+0000","last_clean":"2024-03-30T12:19:00.455248+0000","last_became_active":"2024-03-30T12:19:00.454213+0000","last_became_peered":"2024-03-30T12:19:00.454213+0000","last_unstale":"2024-03-30T12:19:00.455248+0000","last_undegraded":"2024-03-30T12:19:00.455248+0000","last_fullsized":"2024-03-30T12:19:00.455248+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:27:47.198072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.872985+0000","last_change":"2024-03-30T12:19:00.460150+0000","last_active":"2024-03-30T12:19:00.872985+0000","last_peered":"2024-03-30T12:19:00.872985+0000","last_clean":"2024-03-30T12:19:00.872985+0000","last_became_active":"2024-03-30T12:19:00.459740+0000","last_became_peered":"2024-03-30T12:19:00.459740+0000","last_unstale":"2024-03-30T12:19:00.872985+0000","last_undegraded":"2024-03-30T12:19:00.872985+0000","last_fullsized":"2024-03-30T12:19:00.872985+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:52:40.523467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847884+0000","last_change":"2024-03-30T12:19:00.857403+0000","last_active":"2024-03-30T12:19:01.847884+0000","last_peered":"2024-03-30T12:19:01.847884+0000","last_clean":"2024-03-30T12:19:01.847884+0000","last_became_active":"2024-03-30T12:19:00.856652+0000","last_became_peered":"2024-03-30T12:19:00.856652+0000","last_unstale":"2024-03-30T12:19:01.847884+0000","last_undegraded":"2024-03-30T12:19:01.847884+0000","last_fullsized":"2024-03-30T12:19:01.847884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:51.932935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.458535+0000","last_change":"2024-03-30T12:19:00.458253+0000","last_active":"2024-03-30T12:19:00.458535+0000","last_peered":"2024-03-30T12:19:00.458535+0000","last_clean":"2024-03-30T12:19:00.458535+0000","last_became_active":"2024-03-30T12:19:00.457947+0000","last_became_peered":"2024-03-30T12:19:00.457947+0000","last_unstale":"2024-03-30T12:19:00.458535+0000","last_undegraded":"2024-03-30T12:19:00.458535+0000","last_fullsized":"2024-03-30T12:19:00.458535+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:13:18.864198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.448413+0000","last_change":"2024-03-30T12:19:00.448413+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.448413+0000","last_undegraded":"2024-03-30T12:19:00.448413+0000","last_fullsized":"2024-03-30T12:19:00.448413+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:56:16.965191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.841184+0000","last_change":"2024-03-30T12:19:00.466729+0000","last_active":"2024-03-30T12:19:00.841184+0000","last_peered":"2024-03-30T12:19:00.841184+0000","last_clean":"2024-03-30T12:19:00.841184+0000","last_became_active":"2024-03-30T12:19:00.466086+0000","last_became_peered":"2024-03-30T12:19:00.466086+0000","last_unstale":"2024-03-30T12:19:00.841184+0000","last_undegraded":"2024-03-30T12:19:00.841184+0000","last_fullsized":"2024-03-30T12:19:00.841184+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:46:14.144417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.867245+0000","last_change":"2024-03-30T12:19:00.863262+0000","last_active":"2024-03-30T12:19:00.867245+0000","last_peered":"2024-03-30T12:19:00.867245+0000","last_clean":"2024-03-30T12:19:00.867245+0000","last_became_active":"2024-03-30T12:19:00.861328+0000","last_became_peered":"2024-03-30T12:19:00.861328+0000","last_unstale":"2024-03-30T12:19:00.867245+0000","last_undegraded":"2024-03-30T12:19:00.867245+0000","last_fullsized":"2024-03-30T12:19:00.867245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:20:19.049967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.859367+0000","last_change":"2024-03-30T12:19:00.459929+0000","last_active":"2024-03-30T12:19:00.859367+0000","last_peered":"2024-03-30T12:19:00.859367+0000","last_clean":"2024-03-30T12:19:00.859367+0000","last_became_active":"2024-03-30T12:19:00.459518+0000","last_became_peered":"2024-03-30T12:19:00.459518+0000","last_unstale":"2024-03-30T12:19:00.859367+0000","last_undegraded":"2024-03-30T12:19:00.859367+0000","last_fullsized":"2024-03-30T12:19:00.859367+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:09:03.990119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865447+0000","last_change":"2024-03-30T12:19:00.862112+0000","last_active":"2024-03-30T12:19:00.865447+0000","last_peered":"2024-03-30T12:19:00.865447+0000","last_clean":"2024-03-30T12:19:00.865447+0000","last_became_active":"2024-03-30T12:19:00.861782+0000","last_became_peered":"2024-03-30T12:19:00.861782+0000","last_unstale":"2024-03-30T12:19:00.865447+0000","last_undegraded":"2024-03-30T12:19:00.865447+0000","last_fullsized":"2024-03-30T12:19:00.865447+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:01:42.946530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.840300+0000","last_change":"2024-03-30T12:19:00.463745+0000","last_active":"2024-03-30T12:19:00.840300+0000","last_peered":"2024-03-30T12:19:00.840300+0000","last_clean":"2024-03-30T12:19:00.840300+0000","last_became_active":"2024-03-30T12:19:00.462698+0000","last_became_peered":"2024-03-30T12:19:00.462698+0000","last_unstale":"2024-03-30T12:19:00.840300+0000","last_undegraded":"2024-03-30T12:19:00.840300+0000","last_fullsized":"2024-03-30T12:19:00.840300+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:09:33.196928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847685+0000","last_change":"2024-03-30T12:19:00.865197+0000","last_active":"2024-03-30T12:19:01.847685+0000","last_peered":"2024-03-30T12:19:01.847685+0000","last_clean":"2024-03-30T12:19:01.847685+0000","last_became_active":"2024-03-30T12:19:00.864718+0000","last_became_peered":"2024-03-30T12:19:00.864718+0000","last_unstale":"2024-03-30T12:19:01.847685+0000","last_undegraded":"2024-03-30T12:19:01.847685+0000","last_fullsized":"2024-03-30T12:19:01.847685+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:33:34.137353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.873460+0000","last_change":"2024-03-30T12:19:00.463581+0000","last_active":"2024-03-30T12:19:00.873460+0000","last_peered":"2024-03-30T12:19:00.873460+0000","last_clean":"2024-03-30T12:19:00.873460+0000","last_became_active":"2024-03-30T12:19:00.463280+0000","last_became_peered":"2024-03-30T12:19:00.463280+0000","last_unstale":"2024-03-30T12:19:00.873460+0000","last_undegraded":"2024-03-30T12:19:00.873460+0000","last_fullsized":"2024-03-30T12:19:00.873460+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:38:07.390655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"61'6","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.877488+0000","last_change":"2024-03-30T12:19:00.458102+0000","last_active":"2024-03-30T12:19:00.877488+0000","last_peered":"2024-03-30T12:19:00.877488+0000","last_clean":"2024-03-30T12:19:00.877488+0000","last_became_active":"2024-03-30T12:19:00.457759+0000","last_became_peered":"2024-03-30T12:19:00.457759+0000","last_unstale":"2024-03-30T12:19:00.877488+0000","last_undegraded":"2024-03-30T12:19:00.877488+0000","last_fullsized":"2024-03-30T12:19:00.877488+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:31.713303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847868+0000","last_change":"2024-03-30T12:19:00.462939+0000","last_active":"2024-03-30T12:19:01.847868+0000","last_peered":"2024-03-30T12:19:01.847868+0000","last_clean":"2024-03-30T12:19:01.847868+0000","last_became_active":"2024-03-30T12:19:00.462637+0000","last_became_peered":"2024-03-30T12:19:00.462637+0000","last_unstale":"2024-03-30T12:19:01.847868+0000","last_undegraded":"2024-03-30T12:19:01.847868+0000","last_fullsized":"2024-03-30T12:19:01.847868+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:48:59.027106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847660+0000","last_change":"2024-03-30T12:19:00.856865+0000","last_active":"2024-03-30T12:19:01.847660+0000","last_peered":"2024-03-30T12:19:01.847660+0000","last_clean":"2024-03-30T12:19:01.847660+0000","last_became_active":"2024-03-30T12:19:00.856544+0000","last_became_peered":"2024-03-30T12:19:00.856544+0000","last_unstale":"2024-03-30T12:19:01.847660+0000","last_undegraded":"2024-03-30T12:19:01.847660+0000","last_fullsized":"2024-03-30T12:19:01.847660+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:37:39.901012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.841547+0000","last_change":"2024-03-30T12:19:00.465931+0000","last_active":"2024-03-30T12:19:00.841547+0000","last_peered":"2024-03-30T12:19:00.841547+0000","last_clean":"2024-03-30T12:19:00.841547+0000","last_became_active":"2024-03-30T12:19:00.465589+0000","last_became_peered":"2024-03-30T12:19:00.465589+0000","last_unstale":"2024-03-30T12:19:00.841547+0000","last_undegraded":"2024-03-30T12:19:00.841547+0000","last_fullsized":"2024-03-30T12:19:00.841547+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:02:38.614924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.855845+0000","last_change":"2024-03-30T12:19:00.454678+0000","last_active":"2024-03-30T12:19:00.855845+0000","last_peered":"2024-03-30T12:19:00.855845+0000","last_clean":"2024-03-30T12:19:00.855845+0000","last_became_active":"2024-03-30T12:19:00.454380+0000","last_became_peered":"2024-03-30T12:19:00.454380+0000","last_unstale":"2024-03-30T12:19:00.855845+0000","last_undegraded":"2024-03-30T12:19:00.855845+0000","last_fullsized":"2024-03-30T12:19:00.855845+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:08:24.640327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.862926+0000","last_change":"2024-03-30T12:19:00.861547+0000","last_active":"2024-03-30T12:19:00.862926+0000","last_peered":"2024-03-30T12:19:00.862926+0000","last_clean":"2024-03-30T12:19:00.862926+0000","last_became_active":"2024-03-30T12:19:00.861268+0000","last_became_peered":"2024-03-30T12:19:00.861268+0000","last_unstale":"2024-03-30T12:19:00.862926+0000","last_undegraded":"2024-03-30T12:19:00.862926+0000","last_fullsized":"2024-03-30T12:19:00.862926+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:28:37.342309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.873715+0000","last_change":"2024-03-30T12:19:00.460090+0000","last_active":"2024-03-30T12:19:00.873715+0000","last_peered":"2024-03-30T12:19:00.873715+0000","last_clean":"2024-03-30T12:19:00.873715+0000","last_became_active":"2024-03-30T12:19:00.459790+0000","last_became_peered":"2024-03-30T12:19:00.459790+0000","last_unstale":"2024-03-30T12:19:00.873715+0000","last_undegraded":"2024-03-30T12:19:00.873715+0000","last_fullsized":"2024-03-30T12:19:00.873715+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:38.860631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.843884+0000","last_change":"2024-03-30T12:19:00.462709+0000","last_active":"2024-03-30T12:19:00.843884+0000","last_peered":"2024-03-30T12:19:00.843884+0000","last_clean":"2024-03-30T12:19:00.843884+0000","last_became_active":"2024-03-30T12:19:00.462429+0000","last_became_peered":"2024-03-30T12:19:00.462429+0000","last_unstale":"2024-03-30T12:19:00.843884+0000","last_undegraded":"2024-03-30T12:19:00.843884+0000","last_fullsized":"2024-03-30T12:19:00.843884+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:29.579526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.855986+0000","last_change":"2024-03-30T12:19:00.854025+0000","last_active":"2024-03-30T12:19:00.855986+0000","last_peered":"2024-03-30T12:19:00.855986+0000","last_clean":"2024-03-30T12:19:00.855986+0000","last_became_active":"2024-03-30T12:19:00.853714+0000","last_became_peered":"2024-03-30T12:19:00.853714+0000","last_unstale":"2024-03-30T12:19:00.855986+0000","last_undegraded":"2024-03-30T12:19:00.855986+0000","last_fullsized":"2024-03-30T12:19:00.855986+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:27:34.498087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.840118+0000","last_change":"2024-03-30T12:19:00.457612+0000","last_active":"2024-03-30T12:19:00.840118+0000","last_peered":"2024-03-30T12:19:00.840118+0000","last_clean":"2024-03-30T12:19:00.840118+0000","last_became_active":"2024-03-30T12:19:00.457289+0000","last_became_peered":"2024-03-30T12:19:00.457289+0000","last_unstale":"2024-03-30T12:19:00.840118+0000","last_undegraded":"2024-03-30T12:19:00.840118+0000","last_fullsized":"2024-03-30T12:19:00.840118+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:23.011997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.863066+0000","last_change":"2024-03-30T12:19:00.861917+0000","last_active":"2024-03-30T12:19:00.863066+0000","last_peered":"2024-03-30T12:19:00.863066+0000","last_clean":"2024-03-30T12:19:00.863066+0000","last_became_active":"2024-03-30T12:19:00.860645+0000","last_became_peered":"2024-03-30T12:19:00.860645+0000","last_unstale":"2024-03-30T12:19:00.863066+0000","last_undegraded":"2024-03-30T12:19:00.863066+0000","last_fullsized":"2024-03-30T12:19:00.863066+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:30:51.438018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.842009+0000","last_change":"2024-03-30T12:19:00.459145+0000","last_active":"2024-03-30T12:19:00.842009+0000","last_peered":"2024-03-30T12:19:00.842009+0000","last_clean":"2024-03-30T12:19:00.842009+0000","last_became_active":"2024-03-30T12:19:00.457819+0000","last_became_peered":"2024-03-30T12:19:00.457819+0000","last_unstale":"2024-03-30T12:19:00.842009+0000","last_undegraded":"2024-03-30T12:19:00.842009+0000","last_fullsized":"2024-03-30T12:19:00.842009+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:44:38.245366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.447233+0000","last_change":"2024-03-30T12:19:00.447233+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.447233+0000","last_undegraded":"2024-03-30T12:19:00.447233+0000","last_fullsized":"2024-03-30T12:19:00.447233+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:13:39.199499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.841612+0000","last_change":"2024-03-30T12:19:00.465946+0000","last_active":"2024-03-30T12:19:00.841612+0000","last_peered":"2024-03-30T12:19:00.841612+0000","last_clean":"2024-03-30T12:19:00.841612+0000","last_became_active":"2024-03-30T12:19:00.465618+0000","last_became_peered":"2024-03-30T12:19:00.465618+0000","last_unstale":"2024-03-30T12:19:00.841612+0000","last_undegraded":"2024-03-30T12:19:00.841612+0000","last_fullsized":"2024-03-30T12:19:00.841612+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:58:42.109572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"22'117","reported_seq":216,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-03-30T12:18:45.913180+0000","last_change":"2024-03-30T12:18:45.912869+0000","last_active":"2024-03-30T12:18:45.913180+0000","last_peered":"2024-03-30T12:18:45.913180+0000","last_clean":"2024-03-30T12:18:45.913180+0000","last_became_active":"2024-03-30T12:18:45.912395+0000","last_became_peered":"2024-03-30T12:18:45.912395+0000","last_unstale":"2024-03-30T12:18:45.913180+0000","last_undegraded":"2024-03-30T12:18:45.913180+0000","last_fullsized":"2024-03-30T12:18:45.913180+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:34.485283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847236+0000","last_change":"2024-03-30T12:19:00.852506+0000","last_active":"2024-03-30T12:19:01.847236+0000","last_peered":"2024-03-30T12:19:01.847236+0000","last_clean":"2024-03-30T12:19:01.847236+0000","last_became_active":"2024-03-30T12:19:00.852216+0000","last_became_peered":"2024-03-30T12:19:00.852216+0000","last_unstale":"2024-03-30T12:19:01.847236+0000","last_undegraded":"2024-03-30T12:19:01.847236+0000","last_fullsized":"2024-03-30T12:19:01.847236+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:41:21.462303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.868254+0000","last_change":"2024-03-30T12:19:00.865798+0000","last_active":"2024-03-30T12:19:00.868254+0000","last_peered":"2024-03-30T12:19:00.868254+0000","last_clean":"2024-03-30T12:19:00.868254+0000","last_became_active":"2024-03-30T12:19:00.865518+0000","last_became_peered":"2024-03-30T12:19:00.865518+0000","last_unstale":"2024-03-30T12:19:00.868254+0000","last_undegraded":"2024-03-30T12:19:00.868254+0000","last_fullsized":"2024-03-30T12:19:00.868254+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:47:41.818140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.846497+0000","last_change":"2024-03-30T12:19:00.454554+0000","last_active":"2024-03-30T12:19:00.846497+0000","last_peered":"2024-03-30T12:19:00.846497+0000","last_clean":"2024-03-30T12:19:00.846497+0000","last_became_active":"2024-03-30T12:19:00.454233+0000","last_became_peered":"2024-03-30T12:19:00.454233+0000","last_unstale":"2024-03-30T12:19:00.846497+0000","last_undegraded":"2024-03-30T12:19:00.846497+0000","last_fullsized":"2024-03-30T12:19:00.846497+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:05:09.010127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.447774+0000","last_change":"2024-03-30T12:19:00.447774+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.447774+0000","last_undegraded":"2024-03-30T12:19:00.447774+0000","last_fullsized":"2024-03-30T12:19:00.447774+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:36:10.741436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.874220+0000","last_change":"2024-03-30T12:19:00.460279+0000","last_active":"2024-03-30T12:19:00.874220+0000","last_peered":"2024-03-30T12:19:00.874220+0000","last_clean":"2024-03-30T12:19:00.874220+0000","last_became_active":"2024-03-30T12:19:00.459948+0000","last_became_peered":"2024-03-30T12:19:00.459948+0000","last_unstale":"2024-03-30T12:19:00.874220+0000","last_undegraded":"2024-03-30T12:19:00.874220+0000","last_fullsized":"2024-03-30T12:19:00.874220+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:06.870147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847496+0000","last_change":"2024-03-30T12:19:00.853029+0000","last_active":"2024-03-30T12:19:01.847496+0000","last_peered":"2024-03-30T12:19:01.847496+0000","last_clean":"2024-03-30T12:19:01.847496+0000","last_became_active":"2024-03-30T12:19:00.852755+0000","last_became_peered":"2024-03-30T12:19:00.852755+0000","last_unstale":"2024-03-30T12:19:01.847496+0000","last_undegraded":"2024-03-30T12:19:01.847496+0000","last_fullsized":"2024-03-30T12:19:01.847496+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:03:44.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.844116+0000","last_change":"2024-03-30T12:19:00.459528+0000","last_active":"2024-03-30T12:19:00.844116+0000","last_peered":"2024-03-30T12:19:00.844116+0000","last_clean":"2024-03-30T12:19:00.844116+0000","last_became_active":"2024-03-30T12:19:00.459223+0000","last_became_peered":"2024-03-30T12:19:00.459223+0000","last_unstale":"2024-03-30T12:19:00.844116+0000","last_undegraded":"2024-03-30T12:19:00.844116+0000","last_fullsized":"2024-03-30T12:19:00.844116+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:44.399783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.447356+0000","last_change":"2024-03-30T12:19:00.447356+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.447356+0000","last_undegraded":"2024-03-30T12:19:00.447356+0000","last_fullsized":"2024-03-30T12:19:00.447356+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:52:32.869322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.844802+0000","last_change":"2024-03-30T12:19:00.460526+0000","last_active":"2024-03-30T12:19:00.844802+0000","last_peered":"2024-03-30T12:19:00.844802+0000","last_clean":"2024-03-30T12:19:00.844802+0000","last_became_active":"2024-03-30T12:19:00.460018+0000","last_became_peered":"2024-03-30T12:19:00.460018+0000","last_unstale":"2024-03-30T12:19:00.844802+0000","last_undegraded":"2024-03-30T12:19:00.844802+0000","last_fullsized":"2024-03-30T12:19:00.844802+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:33:30.671209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.447901+0000","last_change":"2024-03-30T12:19:00.447901+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.447901+0000","last_undegraded":"2024-03-30T12:19:00.447901+0000","last_fullsized":"2024-03-30T12:19:00.447901+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:43.731796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.871217+0000","last_change":"2024-03-30T12:19:00.869001+0000","last_active":"2024-03-30T12:19:00.871217+0000","last_peered":"2024-03-30T12:19:00.871217+0000","last_clean":"2024-03-30T12:19:00.871217+0000","last_became_active":"2024-03-30T12:19:00.868645+0000","last_became_peered":"2024-03-30T12:19:00.868645+0000","last_unstale":"2024-03-30T12:19:00.871217+0000","last_undegraded":"2024-03-30T12:19:00.871217+0000","last_fullsized":"2024-03-30T12:19:00.871217+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:54:10.778279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.842782+0000","last_change":"2024-03-30T12:19:00.459171+0000","last_active":"2024-03-30T12:19:00.842782+0000","last_peered":"2024-03-30T12:19:00.842782+0000","last_clean":"2024-03-30T12:19:00.842782+0000","last_became_active":"2024-03-30T12:19:00.458925+0000","last_became_peered":"2024-03-30T12:19:00.458925+0000","last_unstale":"2024-03-30T12:19:00.842782+0000","last_undegraded":"2024-03-30T12:19:00.842782+0000","last_fullsized":"2024-03-30T12:19:00.842782+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:26:20.974369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.873975+0000","last_change":"2024-03-30T12:19:00.459545+0000","last_active":"2024-03-30T12:19:00.873975+0000","last_peered":"2024-03-30T12:19:00.873975+0000","last_clean":"2024-03-30T12:19:00.873975+0000","last_became_active":"2024-03-30T12:19:00.459250+0000","last_became_peered":"2024-03-30T12:19:00.459250+0000","last_unstale":"2024-03-30T12:19:00.873975+0000","last_undegraded":"2024-03-30T12:19:00.873975+0000","last_fullsized":"2024-03-30T12:19:00.873975+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:38.112815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.853251+0000","last_change":"2024-03-30T12:19:00.852558+0000","last_active":"2024-03-30T12:19:00.853251+0000","last_peered":"2024-03-30T12:19:00.853251+0000","last_clean":"2024-03-30T12:19:00.853251+0000","last_became_active":"2024-03-30T12:19:00.852250+0000","last_became_peered":"2024-03-30T12:19:00.852250+0000","last_unstale":"2024-03-30T12:19:00.853251+0000","last_undegraded":"2024-03-30T12:19:00.853251+0000","last_fullsized":"2024-03-30T12:19:00.853251+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:57:15.989801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.879619+0000","last_change":"2024-03-30T12:19:00.464968+0000","last_active":"2024-03-30T12:19:00.879619+0000","last_peered":"2024-03-30T12:19:00.879619+0000","last_clean":"2024-03-30T12:19:00.879619+0000","last_became_active":"2024-03-30T12:19:00.464021+0000","last_became_peered":"2024-03-30T12:19:00.464021+0000","last_unstale":"2024-03-30T12:19:00.879619+0000","last_undegraded":"2024-03-30T12:19:00.879619+0000","last_fullsized":"2024-03-30T12:19:00.879619+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:20.224884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.863796+0000","last_change":"2024-03-30T12:19:00.862859+0000","last_active":"2024-03-30T12:19:00.863796+0000","last_peered":"2024-03-30T12:19:00.863796+0000","last_clean":"2024-03-30T12:19:00.863796+0000","last_became_active":"2024-03-30T12:19:00.862535+0000","last_became_peered":"2024-03-30T12:19:00.862535+0000","last_unstale":"2024-03-30T12:19:00.863796+0000","last_undegraded":"2024-03-30T12:19:00.863796+0000","last_fullsized":"2024-03-30T12:19:00.863796+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:17:31.462763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865528+0000","last_change":"2024-03-30T12:19:00.862947+0000","last_active":"2024-03-30T12:19:00.865528+0000","last_peered":"2024-03-30T12:19:00.865528+0000","last_clean":"2024-03-30T12:19:00.865528+0000","last_became_active":"2024-03-30T12:19:00.862567+0000","last_became_peered":"2024-03-30T12:19:00.862567+0000","last_unstale":"2024-03-30T12:19:00.865528+0000","last_undegraded":"2024-03-30T12:19:00.865528+0000","last_fullsized":"2024-03-30T12:19:00.865528+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:55:05.422370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.857994+0000","last_change":"2024-03-30T12:19:00.856869+0000","last_active":"2024-03-30T12:19:00.857994+0000","last_peered":"2024-03-30T12:19:00.857994+0000","last_clean":"2024-03-30T12:19:00.857994+0000","last_became_active":"2024-03-30T12:19:00.856525+0000","last_became_peered":"2024-03-30T12:19:00.856525+0000","last_unstale":"2024-03-30T12:19:00.857994+0000","last_undegraded":"2024-03-30T12:19:00.857994+0000","last_fullsized":"2024-03-30T12:19:00.857994+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:01:47.443294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847804+0000","last_change":"2024-03-30T12:19:00.859724+0000","last_active":"2024-03-30T12:19:01.847804+0000","last_peered":"2024-03-30T12:19:01.847804+0000","last_clean":"2024-03-30T12:19:01.847804+0000","last_became_active":"2024-03-30T12:19:00.859327+0000","last_became_peered":"2024-03-30T12:19:00.859327+0000","last_unstale":"2024-03-30T12:19:01.847804+0000","last_undegraded":"2024-03-30T12:19:01.847804+0000","last_fullsized":"2024-03-30T12:19:01.847804+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:53:15.692683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.449139+0000","last_change":"2024-03-30T12:19:00.449139+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.449139+0000","last_undegraded":"2024-03-30T12:19:00.449139+0000","last_fullsized":"2024-03-30T12:19:00.449139+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:42.644771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.848520+0000","last_change":"2024-03-30T12:19:00.848297+0000","last_active":"2024-03-30T12:19:00.848520+0000","last_peered":"2024-03-30T12:19:00.848520+0000","last_clean":"2024-03-30T12:19:00.848520+0000","last_became_active":"2024-03-30T12:19:00.848029+0000","last_became_peered":"2024-03-30T12:19:00.848029+0000","last_unstale":"2024-03-30T12:19:00.848520+0000","last_undegraded":"2024-03-30T12:19:00.848520+0000","last_fullsized":"2024-03-30T12:19:00.848520+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:38.617413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.872267+0000","last_change":"2024-03-30T12:19:00.869414+0000","last_active":"2024-03-30T12:19:00.872267+0000","last_peered":"2024-03-30T12:19:00.872267+0000","last_clean":"2024-03-30T12:19:00.872267+0000","last_became_active":"2024-03-30T12:19:00.869115+0000","last_became_peered":"2024-03-30T12:19:00.869115+0000","last_unstale":"2024-03-30T12:19:00.872267+0000","last_undegraded":"2024-03-30T12:19:00.872267+0000","last_fullsized":"2024-03-30T12:19:00.872267+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:01:12.173692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.450476+0000","last_change":"2024-03-30T12:19:00.450476+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.450476+0000","last_undegraded":"2024-03-30T12:19:00.450476+0000","last_fullsized":"2024-03-30T12:19:00.450476+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:21:16.961559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.856024+0000","last_change":"2024-03-30T12:19:00.854668+0000","last_active":"2024-03-30T12:19:00.856024+0000","last_peered":"2024-03-30T12:19:00.856024+0000","last_clean":"2024-03-30T12:19:00.856024+0000","last_became_active":"2024-03-30T12:19:00.854390+0000","last_became_peered":"2024-03-30T12:19:00.854390+0000","last_unstale":"2024-03-30T12:19:00.856024+0000","last_undegraded":"2024-03-30T12:19:00.856024+0000","last_fullsized":"2024-03-30T12:19:00.856024+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:39:22.128098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.449719+0000","last_change":"2024-03-30T12:19:00.449719+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.449719+0000","last_undegraded":"2024-03-30T12:19:00.449719+0000","last_fullsized":"2024-03-30T12:19:00.449719+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:46:50.526568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865165+0000","last_change":"2024-03-30T12:19:00.860406+0000","last_active":"2024-03-30T12:19:00.865165+0000","last_peered":"2024-03-30T12:19:00.865165+0000","last_clean":"2024-03-30T12:19:00.865165+0000","last_became_active":"2024-03-30T12:19:00.860085+0000","last_became_peered":"2024-03-30T12:19:00.860085+0000","last_unstale":"2024-03-30T12:19:00.865165+0000","last_undegraded":"2024-03-30T12:19:00.865165+0000","last_fullsized":"2024-03-30T12:19:00.865165+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:32.201939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847724+0000","last_change":"2024-03-30T12:19:00.856917+0000","last_active":"2024-03-30T12:19:01.847724+0000","last_peered":"2024-03-30T12:19:01.847724+0000","last_clean":"2024-03-30T12:19:01.847724+0000","last_became_active":"2024-03-30T12:19:00.856643+0000","last_became_peered":"2024-03-30T12:19:00.856643+0000","last_unstale":"2024-03-30T12:19:01.847724+0000","last_undegraded":"2024-03-30T12:19:01.847724+0000","last_fullsized":"2024-03-30T12:19:01.847724+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:51:53.996045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.871097+0000","last_change":"2024-03-30T12:19:00.867176+0000","last_active":"2024-03-30T12:19:00.871097+0000","last_peered":"2024-03-30T12:19:00.871097+0000","last_clean":"2024-03-30T12:19:00.871097+0000","last_became_active":"2024-03-30T12:19:00.866801+0000","last_became_peered":"2024-03-30T12:19:00.866801+0000","last_unstale":"2024-03-30T12:19:00.871097+0000","last_undegraded":"2024-03-30T12:19:00.871097+0000","last_fullsized":"2024-03-30T12:19:00.871097+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:31:22.909206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":144,"acting":144,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2340,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":75,"acting":75,"num_store_stats":6}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928233990,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28160,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716992,"statfs":{"total":95995035648,"available":95966199808,"internally_reserved":0,"allocated":1163264,"data_stored":822591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]}]},{"osd":6,"up_from":46,"seq":197568495627,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28212,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716940,"statfs":{"total":95995035648,"available":95966146560,"internally_reserved":0,"allocated":1212416,"data_stored":844370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31720,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713432,"statfs":{"total":95995035648,"available":95962554368,"internally_reserved":0,"allocated":610304,"data_stored":252325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.32500000000000001,"15min":0.307},"min":{"1min":0.23000000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.32000000000000001},"min":{"1min":0.23599999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.33000000000000002}]},{"osd":2,"last update":"Sat Mar 30 12:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.38200000000000001,"15min":0.375},"min":{"1min":0.254,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.39500000000000002,"15min":0.38900000000000001},"min":{"1min":0.32200000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.26300000000000001}]},{"osd":3,"last update":"Sat Mar 30 12:18:08 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.48499999999999999}]},{"osd":4,"last update":"Sat Mar 30 12:18:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.46300000000000002}]},{"osd":5,"last update":"Sat Mar 30 12:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738408,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32316,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712836,"statfs":{"total":95995035648,"available":95961944064,"internally_reserved":0,"allocated":1220608,"data_stored":843807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 30 12:18:17 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.307,"15min":0.29499999999999998},"min":{"1min":0.27500000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.317,"15min":0.30299999999999999},"min":{"1min":0.28199999999999997,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.36799999999999999}]},{"osd":2,"last update":"Sat Mar 30 12:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.42799999999999999,"15min":0.42099999999999999},"min":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.437,"5min":0.40899999999999997,"15min":0.40500000000000003},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.378}]},{"osd":3,"last update":"Sat Mar 30 12:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.32500000000000001}]},{"osd":4,"last update":"Sat Mar 30 12:18:29 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.61799999999999999}]},{"osd":5,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411358,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31716,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713436,"statfs":{"total":95995035648,"available":95962558464,"internally_reserved":0,"allocated":606208,"data_stored":252438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:18:49 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34200000000000003},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38100000000000001,"15min":0.38},"min":{"1min":0.26900000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.56499999999999995,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.435}]},{"osd":1,"last update":"Sat Mar 30 12:18:49 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40200000000000002,"15min":0.40100000000000002},"min":{"1min":0.27800000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.38200000000000001},"min":{"1min":0.25600000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59899999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.44700000000000001}]},{"osd":3,"last update":"Sat Mar 30 12:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.48699999999999999}]},{"osd":4,"last update":"Sat Mar 30 12:18:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.91500000000000004}]},{"osd":5,"last update":"Sat Mar 30 12:18:57 2024","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.542,"15min":1.542},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":19.606999999999999,"5min":19.606999999999999,"15min":19.606999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.746}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182425,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717560,"statfs":{"total":95995035648,"available":95966781440,"internally_reserved":0,"allocated":585728,"data_stored":238801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.30299999999999999}]},{"osd":1,"last update":"Sat Mar 30 12:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.36599999999999999}]},{"osd":2,"last update":"Sat Mar 30 12:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.35199999999999998}]},{"osd":4,"last update":"Sat Mar 30 12:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":4.8639999999999999,"5min":4.8639999999999999,"15min":4.8639999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.625}]},{"osd":5,"last update":"Sat Mar 30 12:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":4,"up_from":30,"seq":128849018900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27580,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717572,"statfs":{"total":95995035648,"available":95966793728,"internally_reserved":0,"allocated":565248,"data_stored":232008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.53600000000000003}]},{"osd":1,"last update":"Sat Mar 30 12:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.59799999999999998}]},{"osd":2,"last update":"Sat Mar 30 12:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.61599999999999999}]},{"osd":3,"last update":"Sat Mar 30 12:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.50600000000000001}]},{"osd":5,"last update":"Sat Mar 30 12:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.35399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]}]},{"osd":5,"up_from":38,"seq":163208757264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27640,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717512,"statfs":{"total":95995035648,"available":95966732288,"internally_reserved":0,"allocated":626688,"data_stored":254365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.41499999999999998}]},{"osd":1,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.44500000000000001}]},{"osd":2,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.46100000000000002}]},{"osd":3,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.436}]},{"osd":4,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.35099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:19:04.130 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T12:19:04.453 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:19:04.455 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:19:04.464 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2024-03-30T12:19:03.174977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592708,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":195,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":222,"acting":222,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":749961216,"kb_used":234936,"kb_used_data":6436,"kb_used_omap":12,"kb_used_meta":228339,"kb_avail":749726280,"statfs":{"total":767960285184,"available":767719710720,"internally_reserved":0,"allocated":6590464,"data_stored":3740705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":233819704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000640"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.869843+0000","last_change":"2024-03-30T12:19:00.867897+0000","last_active":"2024-03-30T12:19:00.869843+0000","last_peered":"2024-03-30T12:19:00.869843+0000","last_clean":"2024-03-30T12:19:00.869843+0000","last_became_active":"2024-03-30T12:19:00.867457+0000","last_became_peered":"2024-03-30T12:19:00.867457+0000","last_unstale":"2024-03-30T12:19:00.869843+0000","last_undegraded":"2024-03-30T12:19:00.869843+0000","last_fullsized":"2024-03-30T12:19:00.869843+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:06:41.382626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847399+0000","last_change":"2024-03-30T12:19:00.853843+0000","last_active":"2024-03-30T12:19:01.847399+0000","last_peered":"2024-03-30T12:19:01.847399+0000","last_clean":"2024-03-30T12:19:01.847399+0000","last_became_active":"2024-03-30T12:19:00.853543+0000","last_became_peered":"2024-03-30T12:19:00.853543+0000","last_unstale":"2024-03-30T12:19:01.847399+0000","last_undegraded":"2024-03-30T12:19:01.847399+0000","last_fullsized":"2024-03-30T12:19:01.847399+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:52.339142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.860870+0000","last_change":"2024-03-30T12:19:00.859974+0000","last_active":"2024-03-30T12:19:00.860870+0000","last_peered":"2024-03-30T12:19:00.860870+0000","last_clean":"2024-03-30T12:19:00.860870+0000","last_became_active":"2024-03-30T12:19:00.859615+0000","last_became_peered":"2024-03-30T12:19:00.859615+0000","last_unstale":"2024-03-30T12:19:00.860870+0000","last_undegraded":"2024-03-30T12:19:00.860870+0000","last_fullsized":"2024-03-30T12:19:00.860870+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:26.933772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.858738+0000","last_change":"2024-03-30T12:19:00.858029+0000","last_active":"2024-03-30T12:19:00.858738+0000","last_peered":"2024-03-30T12:19:00.858738+0000","last_clean":"2024-03-30T12:19:00.858738+0000","last_became_active":"2024-03-30T12:19:00.857668+0000","last_became_peered":"2024-03-30T12:19:00.857668+0000","last_unstale":"2024-03-30T12:19:00.858738+0000","last_undegraded":"2024-03-30T12:19:00.858738+0000","last_fullsized":"2024-03-30T12:19:00.858738+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:17:33.313541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.450731+0000","last_change":"2024-03-30T12:19:00.450731+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.450731+0000","last_undegraded":"2024-03-30T12:19:00.450731+0000","last_fullsized":"2024-03-30T12:19:00.450731+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:59:30.409530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.872246+0000","last_change":"2024-03-30T12:19:00.869363+0000","last_active":"2024-03-30T12:19:00.872246+0000","last_peered":"2024-03-30T12:19:00.872246+0000","last_clean":"2024-03-30T12:19:00.872246+0000","last_became_active":"2024-03-30T12:19:00.868887+0000","last_became_peered":"2024-03-30T12:19:00.868887+0000","last_unstale":"2024-03-30T12:19:00.872246+0000","last_undegraded":"2024-03-30T12:19:00.872246+0000","last_fullsized":"2024-03-30T12:19:00.872246+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:40:49.543161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865134+0000","last_change":"2024-03-30T12:19:00.863992+0000","last_active":"2024-03-30T12:19:00.865134+0000","last_peered":"2024-03-30T12:19:00.865134+0000","last_clean":"2024-03-30T12:19:00.865134+0000","last_became_active":"2024-03-30T12:19:00.863683+0000","last_became_peered":"2024-03-30T12:19:00.863683+0000","last_unstale":"2024-03-30T12:19:00.865134+0000","last_undegraded":"2024-03-30T12:19:00.865134+0000","last_fullsized":"2024-03-30T12:19:00.865134+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:40:36.734391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.449868+0000","last_change":"2024-03-30T12:19:00.449868+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.449868+0000","last_undegraded":"2024-03-30T12:19:00.449868+0000","last_fullsized":"2024-03-30T12:19:00.449868+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:55:56.657057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847752+0000","last_change":"2024-03-30T12:19:00.865479+0000","last_active":"2024-03-30T12:19:01.847752+0000","last_peered":"2024-03-30T12:19:01.847752+0000","last_clean":"2024-03-30T12:19:01.847752+0000","last_became_active":"2024-03-30T12:19:00.864441+0000","last_became_peered":"2024-03-30T12:19:00.864441+0000","last_unstale":"2024-03-30T12:19:01.847752+0000","last_undegraded":"2024-03-30T12:19:01.847752+0000","last_fullsized":"2024-03-30T12:19:01.847752+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:45:55.344815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.867919+0000","last_change":"2024-03-30T12:19:00.866672+0000","last_active":"2024-03-30T12:19:00.867919+0000","last_peered":"2024-03-30T12:19:00.867919+0000","last_clean":"2024-03-30T12:19:00.867919+0000","last_became_active":"2024-03-30T12:19:00.866276+0000","last_became_peered":"2024-03-30T12:19:00.866276+0000","last_unstale":"2024-03-30T12:19:00.867919+0000","last_undegraded":"2024-03-30T12:19:00.867919+0000","last_fullsized":"2024-03-30T12:19:00.867919+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:23:49.856597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865488+0000","last_change":"2024-03-30T12:19:00.864760+0000","last_active":"2024-03-30T12:19:00.865488+0000","last_peered":"2024-03-30T12:19:00.865488+0000","last_clean":"2024-03-30T12:19:00.865488+0000","last_became_active":"2024-03-30T12:19:00.864447+0000","last_became_peered":"2024-03-30T12:19:00.864447+0000","last_unstale":"2024-03-30T12:19:00.865488+0000","last_undegraded":"2024-03-30T12:19:00.865488+0000","last_fullsized":"2024-03-30T12:19:00.865488+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:26:47.024806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865455+0000","last_change":"2024-03-30T12:19:00.863453+0000","last_active":"2024-03-30T12:19:00.865455+0000","last_peered":"2024-03-30T12:19:00.865455+0000","last_clean":"2024-03-30T12:19:00.865455+0000","last_became_active":"2024-03-30T12:19:00.863129+0000","last_became_peered":"2024-03-30T12:19:00.863129+0000","last_unstale":"2024-03-30T12:19:00.865455+0000","last_undegraded":"2024-03-30T12:19:00.865455+0000","last_fullsized":"2024-03-30T12:19:00.865455+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:19:33.658159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.854778+0000","last_change":"2024-03-30T12:19:00.854527+0000","last_active":"2024-03-30T12:19:00.854778+0000","last_peered":"2024-03-30T12:19:00.854778+0000","last_clean":"2024-03-30T12:19:00.854778+0000","last_became_active":"2024-03-30T12:19:00.854238+0000","last_became_peered":"2024-03-30T12:19:00.854238+0000","last_unstale":"2024-03-30T12:19:00.854778+0000","last_undegraded":"2024-03-30T12:19:00.854778+0000","last_fullsized":"2024-03-30T12:19:00.854778+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:50:54.069856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"61'4","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847950+0000","last_change":"2024-03-30T12:19:00.466957+0000","last_active":"2024-03-30T12:19:01.847950+0000","last_peered":"2024-03-30T12:19:01.847950+0000","last_clean":"2024-03-30T12:19:01.847950+0000","last_became_active":"2024-03-30T12:19:00.466689+0000","last_became_peered":"2024-03-30T12:19:00.466689+0000","last_unstale":"2024-03-30T12:19:01.847950+0000","last_undegraded":"2024-03-30T12:19:01.847950+0000","last_fullsized":"2024-03-30T12:19:01.847950+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:08.774258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.449236+0000","last_change":"2024-03-30T12:19:00.449236+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.449236+0000","last_undegraded":"2024-03-30T12:19:00.449236+0000","last_fullsized":"2024-03-30T12:19:00.449236+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:31.953173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.459977+0000","last_change":"2024-03-30T12:19:00.459693+0000","last_active":"2024-03-30T12:19:00.459977+0000","last_peered":"2024-03-30T12:19:00.459977+0000","last_clean":"2024-03-30T12:19:00.459977+0000","last_became_active":"2024-03-30T12:19:00.459409+0000","last_became_peered":"2024-03-30T12:19:00.459409+0000","last_unstale":"2024-03-30T12:19:00.459977+0000","last_undegraded":"2024-03-30T12:19:00.459977+0000","last_fullsized":"2024-03-30T12:19:00.459977+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:27.891375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847768+0000","last_change":"2024-03-30T12:19:00.864952+0000","last_active":"2024-03-30T12:19:01.847768+0000","last_peered":"2024-03-30T12:19:01.847768+0000","last_clean":"2024-03-30T12:19:01.847768+0000","last_became_active":"2024-03-30T12:19:00.864274+0000","last_became_peered":"2024-03-30T12:19:00.864274+0000","last_unstale":"2024-03-30T12:19:01.847768+0000","last_undegraded":"2024-03-30T12:19:01.847768+0000","last_fullsized":"2024-03-30T12:19:01.847768+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:45:00.775246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.860852+0000","last_change":"2024-03-30T12:19:00.859422+0000","last_active":"2024-03-30T12:19:00.860852+0000","last_peered":"2024-03-30T12:19:00.860852+0000","last_clean":"2024-03-30T12:19:00.860852+0000","last_became_active":"2024-03-30T12:19:00.858880+0000","last_became_peered":"2024-03-30T12:19:00.858880+0000","last_unstale":"2024-03-30T12:19:00.860852+0000","last_undegraded":"2024-03-30T12:19:00.860852+0000","last_fullsized":"2024-03-30T12:19:00.860852+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:09.612172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.860824+0000","last_change":"2024-03-30T12:19:00.859307+0000","last_active":"2024-03-30T12:19:00.860824+0000","last_peered":"2024-03-30T12:19:00.860824+0000","last_clean":"2024-03-30T12:19:00.860824+0000","last_became_active":"2024-03-30T12:19:00.858775+0000","last_became_peered":"2024-03-30T12:19:00.858775+0000","last_unstale":"2024-03-30T12:19:00.860824+0000","last_undegraded":"2024-03-30T12:19:00.860824+0000","last_fullsized":"2024-03-30T12:19:00.860824+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:30:39.349902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.455248+0000","last_change":"2024-03-30T12:19:00.454521+0000","last_active":"2024-03-30T12:19:00.455248+0000","last_peered":"2024-03-30T12:19:00.455248+0000","last_clean":"2024-03-30T12:19:00.455248+0000","last_became_active":"2024-03-30T12:19:00.454213+0000","last_became_peered":"2024-03-30T12:19:00.454213+0000","last_unstale":"2024-03-30T12:19:00.455248+0000","last_undegraded":"2024-03-30T12:19:00.455248+0000","last_fullsized":"2024-03-30T12:19:00.455248+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:27:47.198072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.872985+0000","last_change":"2024-03-30T12:19:00.460150+0000","last_active":"2024-03-30T12:19:00.872985+0000","last_peered":"2024-03-30T12:19:00.872985+0000","last_clean":"2024-03-30T12:19:00.872985+0000","last_became_active":"2024-03-30T12:19:00.459740+0000","last_became_peered":"2024-03-30T12:19:00.459740+0000","last_unstale":"2024-03-30T12:19:00.872985+0000","last_undegraded":"2024-03-30T12:19:00.872985+0000","last_fullsized":"2024-03-30T12:19:00.872985+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:52:40.523467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847884+0000","last_change":"2024-03-30T12:19:00.857403+0000","last_active":"2024-03-30T12:19:01.847884+0000","last_peered":"2024-03-30T12:19:01.847884+0000","last_clean":"2024-03-30T12:19:01.847884+0000","last_became_active":"2024-03-30T12:19:00.856652+0000","last_became_peered":"2024-03-30T12:19:00.856652+0000","last_unstale":"2024-03-30T12:19:01.847884+0000","last_undegraded":"2024-03-30T12:19:01.847884+0000","last_fullsized":"2024-03-30T12:19:01.847884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:51.932935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.458535+0000","last_change":"2024-03-30T12:19:00.458253+0000","last_active":"2024-03-30T12:19:00.458535+0000","last_peered":"2024-03-30T12:19:00.458535+0000","last_clean":"2024-03-30T12:19:00.458535+0000","last_became_active":"2024-03-30T12:19:00.457947+0000","last_became_peered":"2024-03-30T12:19:00.457947+0000","last_unstale":"2024-03-30T12:19:00.458535+0000","last_undegraded":"2024-03-30T12:19:00.458535+0000","last_fullsized":"2024-03-30T12:19:00.458535+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:13:18.864198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.448413+0000","last_change":"2024-03-30T12:19:00.448413+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.448413+0000","last_undegraded":"2024-03-30T12:19:00.448413+0000","last_fullsized":"2024-03-30T12:19:00.448413+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:56:16.965191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.841184+0000","last_change":"2024-03-30T12:19:00.466729+0000","last_active":"2024-03-30T12:19:00.841184+0000","last_peered":"2024-03-30T12:19:00.841184+0000","last_clean":"2024-03-30T12:19:00.841184+0000","last_became_active":"2024-03-30T12:19:00.466086+0000","last_became_peered":"2024-03-30T12:19:00.466086+0000","last_unstale":"2024-03-30T12:19:00.841184+0000","last_undegraded":"2024-03-30T12:19:00.841184+0000","last_fullsized":"2024-03-30T12:19:00.841184+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:46:14.144417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.867245+0000","last_change":"2024-03-30T12:19:00.863262+0000","last_active":"2024-03-30T12:19:00.867245+0000","last_peered":"2024-03-30T12:19:00.867245+0000","last_clean":"2024-03-30T12:19:00.867245+0000","last_became_active":"2024-03-30T12:19:00.861328+0000","last_became_peered":"2024-03-30T12:19:00.861328+0000","last_unstale":"2024-03-30T12:19:00.867245+0000","last_undegraded":"2024-03-30T12:19:00.867245+0000","last_fullsized":"2024-03-30T12:19:00.867245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:20:19.049967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.859367+0000","last_change":"2024-03-30T12:19:00.459929+0000","last_active":"2024-03-30T12:19:00.859367+0000","last_peered":"2024-03-30T12:19:00.859367+0000","last_clean":"2024-03-30T12:19:00.859367+0000","last_became_active":"2024-03-30T12:19:00.459518+0000","last_became_peered":"2024-03-30T12:19:00.459518+0000","last_unstale":"2024-03-30T12:19:00.859367+0000","last_undegraded":"2024-03-30T12:19:00.859367+0000","last_fullsized":"2024-03-30T12:19:00.859367+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:09:03.990119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865447+0000","last_change":"2024-03-30T12:19:00.862112+0000","last_active":"2024-03-30T12:19:00.865447+0000","last_peered":"2024-03-30T12:19:00.865447+0000","last_clean":"2024-03-30T12:19:00.865447+0000","last_became_active":"2024-03-30T12:19:00.861782+0000","last_became_peered":"2024-03-30T12:19:00.861782+0000","last_unstale":"2024-03-30T12:19:00.865447+0000","last_undegraded":"2024-03-30T12:19:00.865447+0000","last_fullsized":"2024-03-30T12:19:00.865447+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:01:42.946530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.840300+0000","last_change":"2024-03-30T12:19:00.463745+0000","last_active":"2024-03-30T12:19:00.840300+0000","last_peered":"2024-03-30T12:19:00.840300+0000","last_clean":"2024-03-30T12:19:00.840300+0000","last_became_active":"2024-03-30T12:19:00.462698+0000","last_became_peered":"2024-03-30T12:19:00.462698+0000","last_unstale":"2024-03-30T12:19:00.840300+0000","last_undegraded":"2024-03-30T12:19:00.840300+0000","last_fullsized":"2024-03-30T12:19:00.840300+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:09:33.196928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847685+0000","last_change":"2024-03-30T12:19:00.865197+0000","last_active":"2024-03-30T12:19:01.847685+0000","last_peered":"2024-03-30T12:19:01.847685+0000","last_clean":"2024-03-30T12:19:01.847685+0000","last_became_active":"2024-03-30T12:19:00.864718+0000","last_became_peered":"2024-03-30T12:19:00.864718+0000","last_unstale":"2024-03-30T12:19:01.847685+0000","last_undegraded":"2024-03-30T12:19:01.847685+0000","last_fullsized":"2024-03-30T12:19:01.847685+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:33:34.137353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.873460+0000","last_change":"2024-03-30T12:19:00.463581+0000","last_active":"2024-03-30T12:19:00.873460+0000","last_peered":"2024-03-30T12:19:00.873460+0000","last_clean":"2024-03-30T12:19:00.873460+0000","last_became_active":"2024-03-30T12:19:00.463280+0000","last_became_peered":"2024-03-30T12:19:00.463280+0000","last_unstale":"2024-03-30T12:19:00.873460+0000","last_undegraded":"2024-03-30T12:19:00.873460+0000","last_fullsized":"2024-03-30T12:19:00.873460+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:38:07.390655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"61'6","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.877488+0000","last_change":"2024-03-30T12:19:00.458102+0000","last_active":"2024-03-30T12:19:00.877488+0000","last_peered":"2024-03-30T12:19:00.877488+0000","last_clean":"2024-03-30T12:19:00.877488+0000","last_became_active":"2024-03-30T12:19:00.457759+0000","last_became_peered":"2024-03-30T12:19:00.457759+0000","last_unstale":"2024-03-30T12:19:00.877488+0000","last_undegraded":"2024-03-30T12:19:00.877488+0000","last_fullsized":"2024-03-30T12:19:00.877488+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:31.713303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847868+0000","last_change":"2024-03-30T12:19:00.462939+0000","last_active":"2024-03-30T12:19:01.847868+0000","last_peered":"2024-03-30T12:19:01.847868+0000","last_clean":"2024-03-30T12:19:01.847868+0000","last_became_active":"2024-03-30T12:19:00.462637+0000","last_became_peered":"2024-03-30T12:19:00.462637+0000","last_unstale":"2024-03-30T12:19:01.847868+0000","last_undegraded":"2024-03-30T12:19:01.847868+0000","last_fullsized":"2024-03-30T12:19:01.847868+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:48:59.027106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847660+0000","last_change":"2024-03-30T12:19:00.856865+0000","last_active":"2024-03-30T12:19:01.847660+0000","last_peered":"2024-03-30T12:19:01.847660+0000","last_clean":"2024-03-30T12:19:01.847660+0000","last_became_active":"2024-03-30T12:19:00.856544+0000","last_became_peered":"2024-03-30T12:19:00.856544+0000","last_unstale":"2024-03-30T12:19:01.847660+0000","last_undegraded":"2024-03-30T12:19:01.847660+0000","last_fullsized":"2024-03-30T12:19:01.847660+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:37:39.901012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.841547+0000","last_change":"2024-03-30T12:19:00.465931+0000","last_active":"2024-03-30T12:19:00.841547+0000","last_peered":"2024-03-30T12:19:00.841547+0000","last_clean":"2024-03-30T12:19:00.841547+0000","last_became_active":"2024-03-30T12:19:00.465589+0000","last_became_peered":"2024-03-30T12:19:00.465589+0000","last_unstale":"2024-03-30T12:19:00.841547+0000","last_undegraded":"2024-03-30T12:19:00.841547+0000","last_fullsized":"2024-03-30T12:19:00.841547+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:02:38.614924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.855845+0000","last_change":"2024-03-30T12:19:00.454678+0000","last_active":"2024-03-30T12:19:00.855845+0000","last_peered":"2024-03-30T12:19:00.855845+0000","last_clean":"2024-03-30T12:19:00.855845+0000","last_became_active":"2024-03-30T12:19:00.454380+0000","last_became_peered":"2024-03-30T12:19:00.454380+0000","last_unstale":"2024-03-30T12:19:00.855845+0000","last_undegraded":"2024-03-30T12:19:00.855845+0000","last_fullsized":"2024-03-30T12:19:00.855845+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:08:24.640327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.862926+0000","last_change":"2024-03-30T12:19:00.861547+0000","last_active":"2024-03-30T12:19:00.862926+0000","last_peered":"2024-03-30T12:19:00.862926+0000","last_clean":"2024-03-30T12:19:00.862926+0000","last_became_active":"2024-03-30T12:19:00.861268+0000","last_became_peered":"2024-03-30T12:19:00.861268+0000","last_unstale":"2024-03-30T12:19:00.862926+0000","last_undegraded":"2024-03-30T12:19:00.862926+0000","last_fullsized":"2024-03-30T12:19:00.862926+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:28:37.342309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.873715+0000","last_change":"2024-03-30T12:19:00.460090+0000","last_active":"2024-03-30T12:19:00.873715+0000","last_peered":"2024-03-30T12:19:00.873715+0000","last_clean":"2024-03-30T12:19:00.873715+0000","last_became_active":"2024-03-30T12:19:00.459790+0000","last_became_peered":"2024-03-30T12:19:00.459790+0000","last_unstale":"2024-03-30T12:19:00.873715+0000","last_undegraded":"2024-03-30T12:19:00.873715+0000","last_fullsized":"2024-03-30T12:19:00.873715+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:38.860631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.843884+0000","last_change":"2024-03-30T12:19:00.462709+0000","last_active":"2024-03-30T12:19:00.843884+0000","last_peered":"2024-03-30T12:19:00.843884+0000","last_clean":"2024-03-30T12:19:00.843884+0000","last_became_active":"2024-03-30T12:19:00.462429+0000","last_became_peered":"2024-03-30T12:19:00.462429+0000","last_unstale":"2024-03-30T12:19:00.843884+0000","last_undegraded":"2024-03-30T12:19:00.843884+0000","last_fullsized":"2024-03-30T12:19:00.843884+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:29.579526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.855986+0000","last_change":"2024-03-30T12:19:00.854025+0000","last_active":"2024-03-30T12:19:00.855986+0000","last_peered":"2024-03-30T12:19:00.855986+0000","last_clean":"2024-03-30T12:19:00.855986+0000","last_became_active":"2024-03-30T12:19:00.853714+0000","last_became_peered":"2024-03-30T12:19:00.853714+0000","last_unstale":"2024-03-30T12:19:00.855986+0000","last_undegraded":"2024-03-30T12:19:00.855986+0000","last_fullsized":"2024-03-30T12:19:00.855986+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:27:34.498087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.840118+0000","last_change":"2024-03-30T12:19:00.457612+0000","last_active":"2024-03-30T12:19:00.840118+0000","last_peered":"2024-03-30T12:19:00.840118+0000","last_clean":"2024-03-30T12:19:00.840118+0000","last_became_active":"2024-03-30T12:19:00.457289+0000","last_became_peered":"2024-03-30T12:19:00.457289+0000","last_unstale":"2024-03-30T12:19:00.840118+0000","last_undegraded":"2024-03-30T12:19:00.840118+0000","last_fullsized":"2024-03-30T12:19:00.840118+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:23.011997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.863066+0000","last_change":"2024-03-30T12:19:00.861917+0000","last_active":"2024-03-30T12:19:00.863066+0000","last_peered":"2024-03-30T12:19:00.863066+0000","last_clean":"2024-03-30T12:19:00.863066+0000","last_became_active":"2024-03-30T12:19:00.860645+0000","last_became_peered":"2024-03-30T12:19:00.860645+0000","last_unstale":"2024-03-30T12:19:00.863066+0000","last_undegraded":"2024-03-30T12:19:00.863066+0000","last_fullsized":"2024-03-30T12:19:00.863066+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:30:51.438018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.842009+0000","last_change":"2024-03-30T12:19:00.459145+0000","last_active":"2024-03-30T12:19:00.842009+0000","last_peered":"2024-03-30T12:19:00.842009+0000","last_clean":"2024-03-30T12:19:00.842009+0000","last_became_active":"2024-03-30T12:19:00.457819+0000","last_became_peered":"2024-03-30T12:19:00.457819+0000","last_unstale":"2024-03-30T12:19:00.842009+0000","last_undegraded":"2024-03-30T12:19:00.842009+0000","last_fullsized":"2024-03-30T12:19:00.842009+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:44:38.245366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.447233+0000","last_change":"2024-03-30T12:19:00.447233+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.447233+0000","last_undegraded":"2024-03-30T12:19:00.447233+0000","last_fullsized":"2024-03-30T12:19:00.447233+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:13:39.199499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.841612+0000","last_change":"2024-03-30T12:19:00.465946+0000","last_active":"2024-03-30T12:19:00.841612+0000","last_peered":"2024-03-30T12:19:00.841612+0000","last_clean":"2024-03-30T12:19:00.841612+0000","last_became_active":"2024-03-30T12:19:00.465618+0000","last_became_peered":"2024-03-30T12:19:00.465618+0000","last_unstale":"2024-03-30T12:19:00.841612+0000","last_undegraded":"2024-03-30T12:19:00.841612+0000","last_fullsized":"2024-03-30T12:19:00.841612+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:58:42.109572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"22'117","reported_seq":216,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-03-30T12:18:45.913180+0000","last_change":"2024-03-30T12:18:45.912869+0000","last_active":"2024-03-30T12:18:45.913180+0000","last_peered":"2024-03-30T12:18:45.913180+0000","last_clean":"2024-03-30T12:18:45.913180+0000","last_became_active":"2024-03-30T12:18:45.912395+0000","last_became_peered":"2024-03-30T12:18:45.912395+0000","last_unstale":"2024-03-30T12:18:45.913180+0000","last_undegraded":"2024-03-30T12:18:45.913180+0000","last_fullsized":"2024-03-30T12:18:45.913180+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:34.485283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847236+0000","last_change":"2024-03-30T12:19:00.852506+0000","last_active":"2024-03-30T12:19:01.847236+0000","last_peered":"2024-03-30T12:19:01.847236+0000","last_clean":"2024-03-30T12:19:01.847236+0000","last_became_active":"2024-03-30T12:19:00.852216+0000","last_became_peered":"2024-03-30T12:19:00.852216+0000","last_unstale":"2024-03-30T12:19:01.847236+0000","last_undegraded":"2024-03-30T12:19:01.847236+0000","last_fullsized":"2024-03-30T12:19:01.847236+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:41:21.462303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.868254+0000","last_change":"2024-03-30T12:19:00.865798+0000","last_active":"2024-03-30T12:19:00.868254+0000","last_peered":"2024-03-30T12:19:00.868254+0000","last_clean":"2024-03-30T12:19:00.868254+0000","last_became_active":"2024-03-30T12:19:00.865518+0000","last_became_peered":"2024-03-30T12:19:00.865518+0000","last_unstale":"2024-03-30T12:19:00.868254+0000","last_undegraded":"2024-03-30T12:19:00.868254+0000","last_fullsized":"2024-03-30T12:19:00.868254+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:47:41.818140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.846497+0000","last_change":"2024-03-30T12:19:00.454554+0000","last_active":"2024-03-30T12:19:00.846497+0000","last_peered":"2024-03-30T12:19:00.846497+0000","last_clean":"2024-03-30T12:19:00.846497+0000","last_became_active":"2024-03-30T12:19:00.454233+0000","last_became_peered":"2024-03-30T12:19:00.454233+0000","last_unstale":"2024-03-30T12:19:00.846497+0000","last_undegraded":"2024-03-30T12:19:00.846497+0000","last_fullsized":"2024-03-30T12:19:00.846497+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:05:09.010127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.447774+0000","last_change":"2024-03-30T12:19:00.447774+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.447774+0000","last_undegraded":"2024-03-30T12:19:00.447774+0000","last_fullsized":"2024-03-30T12:19:00.447774+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:36:10.741436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.874220+0000","last_change":"2024-03-30T12:19:00.460279+0000","last_active":"2024-03-30T12:19:00.874220+0000","last_peered":"2024-03-30T12:19:00.874220+0000","last_clean":"2024-03-30T12:19:00.874220+0000","last_became_active":"2024-03-30T12:19:00.459948+0000","last_became_peered":"2024-03-30T12:19:00.459948+0000","last_unstale":"2024-03-30T12:19:00.874220+0000","last_undegraded":"2024-03-30T12:19:00.874220+0000","last_fullsized":"2024-03-30T12:19:00.874220+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:06.870147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847496+0000","last_change":"2024-03-30T12:19:00.853029+0000","last_active":"2024-03-30T12:19:01.847496+0000","last_peered":"2024-03-30T12:19:01.847496+0000","last_clean":"2024-03-30T12:19:01.847496+0000","last_became_active":"2024-03-30T12:19:00.852755+0000","last_became_peered":"2024-03-30T12:19:00.852755+0000","last_unstale":"2024-03-30T12:19:01.847496+0000","last_undegraded":"2024-03-30T12:19:01.847496+0000","last_fullsized":"2024-03-30T12:19:01.847496+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:03:44.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.844116+0000","last_change":"2024-03-30T12:19:00.459528+0000","last_active":"2024-03-30T12:19:00.844116+0000","last_peered":"2024-03-30T12:19:00.844116+0000","last_clean":"2024-03-30T12:19:00.844116+0000","last_became_active":"2024-03-30T12:19:00.459223+0000","last_became_peered":"2024-03-30T12:19:00.459223+0000","last_unstale":"2024-03-30T12:19:00.844116+0000","last_undegraded":"2024-03-30T12:19:00.844116+0000","last_fullsized":"2024-03-30T12:19:00.844116+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:44.399783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.447356+0000","last_change":"2024-03-30T12:19:00.447356+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.447356+0000","last_undegraded":"2024-03-30T12:19:00.447356+0000","last_fullsized":"2024-03-30T12:19:00.447356+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:52:32.869322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.844802+0000","last_change":"2024-03-30T12:19:00.460526+0000","last_active":"2024-03-30T12:19:00.844802+0000","last_peered":"2024-03-30T12:19:00.844802+0000","last_clean":"2024-03-30T12:19:00.844802+0000","last_became_active":"2024-03-30T12:19:00.460018+0000","last_became_peered":"2024-03-30T12:19:00.460018+0000","last_unstale":"2024-03-30T12:19:00.844802+0000","last_undegraded":"2024-03-30T12:19:00.844802+0000","last_fullsized":"2024-03-30T12:19:00.844802+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:33:30.671209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.447901+0000","last_change":"2024-03-30T12:19:00.447901+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.447901+0000","last_undegraded":"2024-03-30T12:19:00.447901+0000","last_fullsized":"2024-03-30T12:19:00.447901+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:43.731796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.871217+0000","last_change":"2024-03-30T12:19:00.869001+0000","last_active":"2024-03-30T12:19:00.871217+0000","last_peered":"2024-03-30T12:19:00.871217+0000","last_clean":"2024-03-30T12:19:00.871217+0000","last_became_active":"2024-03-30T12:19:00.868645+0000","last_became_peered":"2024-03-30T12:19:00.868645+0000","last_unstale":"2024-03-30T12:19:00.871217+0000","last_undegraded":"2024-03-30T12:19:00.871217+0000","last_fullsized":"2024-03-30T12:19:00.871217+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:54:10.778279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.842782+0000","last_change":"2024-03-30T12:19:00.459171+0000","last_active":"2024-03-30T12:19:00.842782+0000","last_peered":"2024-03-30T12:19:00.842782+0000","last_clean":"2024-03-30T12:19:00.842782+0000","last_became_active":"2024-03-30T12:19:00.458925+0000","last_became_peered":"2024-03-30T12:19:00.458925+0000","last_unstale":"2024-03-30T12:19:00.842782+0000","last_undegraded":"2024-03-30T12:19:00.842782+0000","last_fullsized":"2024-03-30T12:19:00.842782+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:26:20.974369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.873975+0000","last_change":"2024-03-30T12:19:00.459545+0000","last_active":"2024-03-30T12:19:00.873975+0000","last_peered":"2024-03-30T12:19:00.873975+0000","last_clean":"2024-03-30T12:19:00.873975+0000","last_became_active":"2024-03-30T12:19:00.459250+0000","last_became_peered":"2024-03-30T12:19:00.459250+0000","last_unstale":"2024-03-30T12:19:00.873975+0000","last_undegraded":"2024-03-30T12:19:00.873975+0000","last_fullsized":"2024-03-30T12:19:00.873975+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:38.112815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.853251+0000","last_change":"2024-03-30T12:19:00.852558+0000","last_active":"2024-03-30T12:19:00.853251+0000","last_peered":"2024-03-30T12:19:00.853251+0000","last_clean":"2024-03-30T12:19:00.853251+0000","last_became_active":"2024-03-30T12:19:00.852250+0000","last_became_peered":"2024-03-30T12:19:00.852250+0000","last_unstale":"2024-03-30T12:19:00.853251+0000","last_undegraded":"2024-03-30T12:19:00.853251+0000","last_fullsized":"2024-03-30T12:19:00.853251+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:57:15.989801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.879619+0000","last_change":"2024-03-30T12:19:00.464968+0000","last_active":"2024-03-30T12:19:00.879619+0000","last_peered":"2024-03-30T12:19:00.879619+0000","last_clean":"2024-03-30T12:19:00.879619+0000","last_became_active":"2024-03-30T12:19:00.464021+0000","last_became_peered":"2024-03-30T12:19:00.464021+0000","last_unstale":"2024-03-30T12:19:00.879619+0000","last_undegraded":"2024-03-30T12:19:00.879619+0000","last_fullsized":"2024-03-30T12:19:00.879619+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:20.224884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.863796+0000","last_change":"2024-03-30T12:19:00.862859+0000","last_active":"2024-03-30T12:19:00.863796+0000","last_peered":"2024-03-30T12:19:00.863796+0000","last_clean":"2024-03-30T12:19:00.863796+0000","last_became_active":"2024-03-30T12:19:00.862535+0000","last_became_peered":"2024-03-30T12:19:00.862535+0000","last_unstale":"2024-03-30T12:19:00.863796+0000","last_undegraded":"2024-03-30T12:19:00.863796+0000","last_fullsized":"2024-03-30T12:19:00.863796+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:17:31.462763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865528+0000","last_change":"2024-03-30T12:19:00.862947+0000","last_active":"2024-03-30T12:19:00.865528+0000","last_peered":"2024-03-30T12:19:00.865528+0000","last_clean":"2024-03-30T12:19:00.865528+0000","last_became_active":"2024-03-30T12:19:00.862567+0000","last_became_peered":"2024-03-30T12:19:00.862567+0000","last_unstale":"2024-03-30T12:19:00.865528+0000","last_undegraded":"2024-03-30T12:19:00.865528+0000","last_fullsized":"2024-03-30T12:19:00.865528+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:55:05.422370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.857994+0000","last_change":"2024-03-30T12:19:00.856869+0000","last_active":"2024-03-30T12:19:00.857994+0000","last_peered":"2024-03-30T12:19:00.857994+0000","last_clean":"2024-03-30T12:19:00.857994+0000","last_became_active":"2024-03-30T12:19:00.856525+0000","last_became_peered":"2024-03-30T12:19:00.856525+0000","last_unstale":"2024-03-30T12:19:00.857994+0000","last_undegraded":"2024-03-30T12:19:00.857994+0000","last_fullsized":"2024-03-30T12:19:00.857994+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:01:47.443294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847804+0000","last_change":"2024-03-30T12:19:00.859724+0000","last_active":"2024-03-30T12:19:01.847804+0000","last_peered":"2024-03-30T12:19:01.847804+0000","last_clean":"2024-03-30T12:19:01.847804+0000","last_became_active":"2024-03-30T12:19:00.859327+0000","last_became_peered":"2024-03-30T12:19:00.859327+0000","last_unstale":"2024-03-30T12:19:01.847804+0000","last_undegraded":"2024-03-30T12:19:01.847804+0000","last_fullsized":"2024-03-30T12:19:01.847804+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:53:15.692683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.449139+0000","last_change":"2024-03-30T12:19:00.449139+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.449139+0000","last_undegraded":"2024-03-30T12:19:00.449139+0000","last_fullsized":"2024-03-30T12:19:00.449139+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:42.644771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.848520+0000","last_change":"2024-03-30T12:19:00.848297+0000","last_active":"2024-03-30T12:19:00.848520+0000","last_peered":"2024-03-30T12:19:00.848520+0000","last_clean":"2024-03-30T12:19:00.848520+0000","last_became_active":"2024-03-30T12:19:00.848029+0000","last_became_peered":"2024-03-30T12:19:00.848029+0000","last_unstale":"2024-03-30T12:19:00.848520+0000","last_undegraded":"2024-03-30T12:19:00.848520+0000","last_fullsized":"2024-03-30T12:19:00.848520+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:38.617413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.872267+0000","last_change":"2024-03-30T12:19:00.869414+0000","last_active":"2024-03-30T12:19:00.872267+0000","last_peered":"2024-03-30T12:19:00.872267+0000","last_clean":"2024-03-30T12:19:00.872267+0000","last_became_active":"2024-03-30T12:19:00.869115+0000","last_became_peered":"2024-03-30T12:19:00.869115+0000","last_unstale":"2024-03-30T12:19:00.872267+0000","last_undegraded":"2024-03-30T12:19:00.872267+0000","last_fullsized":"2024-03-30T12:19:00.872267+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:01:12.173692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.450476+0000","last_change":"2024-03-30T12:19:00.450476+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.450476+0000","last_undegraded":"2024-03-30T12:19:00.450476+0000","last_fullsized":"2024-03-30T12:19:00.450476+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:21:16.961559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.856024+0000","last_change":"2024-03-30T12:19:00.854668+0000","last_active":"2024-03-30T12:19:00.856024+0000","last_peered":"2024-03-30T12:19:00.856024+0000","last_clean":"2024-03-30T12:19:00.856024+0000","last_became_active":"2024-03-30T12:19:00.854390+0000","last_became_peered":"2024-03-30T12:19:00.854390+0000","last_unstale":"2024-03-30T12:19:00.856024+0000","last_undegraded":"2024-03-30T12:19:00.856024+0000","last_fullsized":"2024-03-30T12:19:00.856024+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:39:22.128098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.449719+0000","last_change":"2024-03-30T12:19:00.449719+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.449719+0000","last_undegraded":"2024-03-30T12:19:00.449719+0000","last_fullsized":"2024-03-30T12:19:00.449719+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:46:50.526568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865165+0000","last_change":"2024-03-30T12:19:00.860406+0000","last_active":"2024-03-30T12:19:00.865165+0000","last_peered":"2024-03-30T12:19:00.865165+0000","last_clean":"2024-03-30T12:19:00.865165+0000","last_became_active":"2024-03-30T12:19:00.860085+0000","last_became_peered":"2024-03-30T12:19:00.860085+0000","last_unstale":"2024-03-30T12:19:00.865165+0000","last_undegraded":"2024-03-30T12:19:00.865165+0000","last_fullsized":"2024-03-30T12:19:00.865165+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:32.201939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847724+0000","last_change":"2024-03-30T12:19:00.856917+0000","last_active":"2024-03-30T12:19:01.847724+0000","last_peered":"2024-03-30T12:19:01.847724+0000","last_clean":"2024-03-30T12:19:01.847724+0000","last_became_active":"2024-03-30T12:19:00.856643+0000","last_became_peered":"2024-03-30T12:19:00.856643+0000","last_unstale":"2024-03-30T12:19:01.847724+0000","last_undegraded":"2024-03-30T12:19:01.847724+0000","last_fullsized":"2024-03-30T12:19:01.847724+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:51:53.996045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.871097+0000","last_change":"2024-03-30T12:19:00.867176+0000","last_active":"2024-03-30T12:19:00.871097+0000","last_peered":"2024-03-30T12:19:00.871097+0000","last_clean":"2024-03-30T12:19:00.871097+0000","last_became_active":"2024-03-30T12:19:00.866801+0000","last_became_peered":"2024-03-30T12:19:00.866801+0000","last_unstale":"2024-03-30T12:19:00.871097+0000","last_undegraded":"2024-03-30T12:19:00.871097+0000","last_fullsized":"2024-03-30T12:19:00.871097+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:31:22.909206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":144,"acting":144,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2340,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":75,"acting":75,"num_store_stats":6}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928233990,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28160,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716992,"statfs":{"total":95995035648,"available":95966199808,"internally_reserved":0,"allocated":1163264,"data_stored":822591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]}]},{"osd":6,"up_from":46,"seq":197568495627,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28212,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716940,"statfs":{"total":95995035648,"available":95966146560,"internally_reserved":0,"allocated":1212416,"data_stored":844370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31720,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713432,"statfs":{"total":95995035648,"available":95962554368,"internally_reserved":0,"allocated":610304,"data_stored":252325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.32500000000000001,"15min":0.307},"min":{"1min":0.23000000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.32000000000000001},"min":{"1min":0.23599999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.33000000000000002}]},{"osd":2,"last update":"Sat Mar 30 12:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.38200000000000001,"15min":0.375},"min":{"1min":0.254,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.39500000000000002,"15min":0.38900000000000001},"min":{"1min":0.32200000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.26300000000000001}]},{"osd":3,"last update":"Sat Mar 30 12:18:08 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.48499999999999999}]},{"osd":4,"last update":"Sat Mar 30 12:18:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.46300000000000002}]},{"osd":5,"last update":"Sat Mar 30 12:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738408,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32316,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712836,"statfs":{"total":95995035648,"available":95961944064,"internally_reserved":0,"allocated":1220608,"data_stored":843807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 30 12:18:17 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.307,"15min":0.29499999999999998},"min":{"1min":0.27500000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.317,"15min":0.30299999999999999},"min":{"1min":0.28199999999999997,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.36799999999999999}]},{"osd":2,"last update":"Sat Mar 30 12:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.42799999999999999,"15min":0.42099999999999999},"min":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.437,"5min":0.40899999999999997,"15min":0.40500000000000003},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.378}]},{"osd":3,"last update":"Sat Mar 30 12:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.32500000000000001}]},{"osd":4,"last update":"Sat Mar 30 12:18:29 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.61799999999999999}]},{"osd":5,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411358,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31716,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713436,"statfs":{"total":95995035648,"available":95962558464,"internally_reserved":0,"allocated":606208,"data_stored":252438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:18:49 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34200000000000003},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38100000000000001,"15min":0.38},"min":{"1min":0.26900000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.56499999999999995,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.435}]},{"osd":1,"last update":"Sat Mar 30 12:18:49 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40200000000000002,"15min":0.40100000000000002},"min":{"1min":0.27800000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.38200000000000001},"min":{"1min":0.25600000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59899999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.44700000000000001}]},{"osd":3,"last update":"Sat Mar 30 12:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.48699999999999999}]},{"osd":4,"last update":"Sat Mar 30 12:18:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.91500000000000004}]},{"osd":5,"last update":"Sat Mar 30 12:18:57 2024","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.542,"15min":1.542},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":19.606999999999999,"5min":19.606999999999999,"15min":19.606999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.746}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182425,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717560,"statfs":{"total":95995035648,"available":95966781440,"internally_reserved":0,"allocated":585728,"data_stored":238801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.30299999999999999}]},{"osd":1,"last update":"Sat Mar 30 12:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.36599999999999999}]},{"osd":2,"last update":"Sat Mar 30 12:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.35199999999999998}]},{"osd":4,"last update":"Sat Mar 30 12:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":4.8639999999999999,"5min":4.8639999999999999,"15min":4.8639999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.625}]},{"osd":5,"last update":"Sat Mar 30 12:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":4,"up_from":30,"seq":128849018900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27580,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717572,"statfs":{"total":95995035648,"available":95966793728,"internally_reserved":0,"allocated":565248,"data_stored":232008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.53600000000000003}]},{"osd":1,"last update":"Sat Mar 30 12:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.59799999999999998}]},{"osd":2,"last update":"Sat Mar 30 12:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.61599999999999999}]},{"osd":3,"last update":"Sat Mar 30 12:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.50600000000000001}]},{"osd":5,"last update":"Sat Mar 30 12:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.35399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]}]},{"osd":5,"up_from":38,"seq":163208757264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27640,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717512,"statfs":{"total":95995035648,"available":95966732288,"internally_reserved":0,"allocated":626688,"data_stored":254365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.41499999999999998}]},{"osd":1,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.44500000000000001}]},{"osd":2,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.46100000000000002}]},{"osd":3,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.436}]},{"osd":4,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.35099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:19:04.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2024-03-30T12:19:04.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T12:19:00.437665+0000', 'last_change': '2024-03-30T12:19:00.437665+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.437665+0000', 'last_undegraded': '2024-03-30T12:19:00.437665+0000', 'last_fullsized': '2024-03-30T12:19:00.437665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T12:19:04.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2024-03-30T12:19:04.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T12:19:00.437665+0000', 'last_change': '2024-03-30T12:19:00.437665+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.437665+0000', 'last_undegraded': '2024-03-30T12:19:00.437665+0000', 'last_fullsized': '2024-03-30T12:19:00.437665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T12:19:04.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2024-03-30T12:19:04.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T12:19:00.437665+0000', 'last_change': '2024-03-30T12:19:00.437665+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.437665+0000', 'last_undegraded': '2024-03-30T12:19:00.437665+0000', 'last_fullsized': '2024-03-30T12:19:00.437665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T12:19:04.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2024-03-30T12:19:04.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-03-30T12:19:00.450731+0000', 'last_change': '2024-03-30T12:19:00.450731+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.450731+0000', 'last_undegraded': '2024-03-30T12:19:00.450731+0000', 'last_fullsized': '2024-03-30T12:19:00.450731+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-31T23:59:30.409530+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5, 6], 'acting': [3, 5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-30T12:19:04.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2024-03-30T12:19:04.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T12:19:00.437665+0000', 'last_change': '2024-03-30T12:19:00.437665+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.437665+0000', 'last_undegraded': '2024-03-30T12:19:00.437665+0000', 'last_fullsized': '2024-03-30T12:19:00.437665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T12:19:04.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2024-03-30T12:19:04.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T12:19:00.437665+0000', 'last_change': '2024-03-30T12:19:00.437665+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.437665+0000', 'last_undegraded': '2024-03-30T12:19:00.437665+0000', 'last_fullsized': '2024-03-30T12:19:00.437665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T12:19:04.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2024-03-30T12:19:04.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-03-30T12:19:00.449868+0000', 'last_change': '2024-03-30T12:19:00.449868+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.449868+0000', 'last_undegraded': '2024-03-30T12:19:00.449868+0000', 'last_fullsized': '2024-03-30T12:19:00.449868+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-31T18:55:56.657057+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6, 1], 'acting': [3, 6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-30T12:19:04.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2024-03-30T12:19:04.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T12:19:00.437665+0000', 'last_change': '2024-03-30T12:19:00.437665+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.437665+0000', 'last_undegraded': '2024-03-30T12:19:00.437665+0000', 'last_fullsized': '2024-03-30T12:19:00.437665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T12:19:04.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-03-30T12:19:04.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-03-30T12:19:00.449236+0000', 'last_change': '2024-03-30T12:19:00.449236+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.449236+0000', 'last_undegraded': '2024-03-30T12:19:00.449236+0000', 'last_fullsized': '2024-03-30T12:19:00.449236+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-31T19:56:31.953173+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6, 2], 'acting': [3, 6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-30T12:19:04.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1d is not active+clean 2024-03-30T12:19:04.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T12:18:59.433312+0000', 'last_change': '2024-03-30T12:18:59.433312+0000', 'last_active': '2024-03-30T12:18:59.433312+0000', 'last_peered': '2024-03-30T12:18:59.433312+0000', 'last_clean': '2024-03-30T12:18:59.433312+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:18:59.433312+0000', 'last_undegraded': '2024-03-30T12:18:59.433312+0000', 'last_fullsized': '2024-03-30T12:18:59.433312+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:18:59.433312+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:18:59.433312+0000', 'last_clean_scrub_stamp': '2024-03-30T12:18:59.433312+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T12:19:04.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1c is not active+clean 2024-03-30T12:19:04.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T12:18:59.433312+0000', 'last_change': '2024-03-30T12:18:59.433312+0000', 'last_active': '2024-03-30T12:18:59.433312+0000', 'last_peered': '2024-03-30T12:18:59.433312+0000', 'last_clean': '2024-03-30T12:18:59.433312+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:18:59.433312+0000', 'last_undegraded': '2024-03-30T12:18:59.433312+0000', 'last_fullsized': '2024-03-30T12:18:59.433312+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:18:59.433312+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:18:59.433312+0000', 'last_clean_scrub_stamp': '2024-03-30T12:18:59.433312+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T12:19:04.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-03-30T12:19:04.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T12:19:00.437665+0000', 'last_change': '2024-03-30T12:19:00.437665+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.437665+0000', 'last_undegraded': '2024-03-30T12:19:00.437665+0000', 'last_fullsized': '2024-03-30T12:19:00.437665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T12:19:04.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-03-30T12:19:04.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-03-30T12:19:00.448413+0000', 'last_change': '2024-03-30T12:19:00.448413+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.448413+0000', 'last_undegraded': '2024-03-30T12:19:00.448413+0000', 'last_fullsized': '2024-03-30T12:19:00.448413+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-31T20:56:16.965191+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0, 1], 'acting': [3, 0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-30T12:19:04.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-03-30T12:19:04.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T12:19:00.437665+0000', 'last_change': '2024-03-30T12:19:00.437665+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.437665+0000', 'last_undegraded': '2024-03-30T12:19:00.437665+0000', 'last_fullsized': '2024-03-30T12:19:00.437665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T12:19:04.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-03-30T12:19:04.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T12:19:00.437665+0000', 'last_change': '2024-03-30T12:19:00.437665+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.437665+0000', 'last_undegraded': '2024-03-30T12:19:00.437665+0000', 'last_fullsized': '2024-03-30T12:19:00.437665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T12:19:04.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-03-30T12:19:04.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T12:19:00.437665+0000', 'last_change': '2024-03-30T12:19:00.437665+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.437665+0000', 'last_undegraded': '2024-03-30T12:19:00.437665+0000', 'last_fullsized': '2024-03-30T12:19:00.437665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T12:19:04.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-03-30T12:19:04.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T12:19:00.437665+0000', 'last_change': '2024-03-30T12:19:00.437665+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.437665+0000', 'last_undegraded': '2024-03-30T12:19:00.437665+0000', 'last_fullsized': '2024-03-30T12:19:00.437665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T12:19:04.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.f is not active+clean 2024-03-30T12:19:04.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T12:18:59.433312+0000', 'last_change': '2024-03-30T12:18:59.433312+0000', 'last_active': '2024-03-30T12:18:59.433312+0000', 'last_peered': '2024-03-30T12:18:59.433312+0000', 'last_clean': '2024-03-30T12:18:59.433312+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:18:59.433312+0000', 'last_undegraded': '2024-03-30T12:18:59.433312+0000', 'last_fullsized': '2024-03-30T12:18:59.433312+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:18:59.433312+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:18:59.433312+0000', 'last_clean_scrub_stamp': '2024-03-30T12:18:59.433312+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T12:19:04.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-03-30T12:19:04.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T12:19:00.437665+0000', 'last_change': '2024-03-30T12:19:00.437665+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.437665+0000', 'last_undegraded': '2024-03-30T12:19:00.437665+0000', 'last_fullsized': '2024-03-30T12:19:00.437665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T12:19:04.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-03-30T12:19:04.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T12:19:00.437665+0000', 'last_change': '2024-03-30T12:19:00.437665+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.437665+0000', 'last_undegraded': '2024-03-30T12:19:00.437665+0000', 'last_fullsized': '2024-03-30T12:19:00.437665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T12:19:04.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-03-30T12:19:04.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-03-30T12:19:00.447233+0000', 'last_change': '2024-03-30T12:19:00.447233+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.447233+0000', 'last_undegraded': '2024-03-30T12:19:00.447233+0000', 'last_fullsized': '2024-03-30T12:19:00.447233+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-31T22:13:39.199499+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5, 6], 'acting': [3, 5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-30T12:19:04.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.0 is not active+clean 2024-03-30T12:19:04.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T12:18:59.433312+0000', 'last_change': '2024-03-30T12:18:59.433312+0000', 'last_active': '2024-03-30T12:18:59.433312+0000', 'last_peered': '2024-03-30T12:18:59.433312+0000', 'last_clean': '2024-03-30T12:18:59.433312+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:18:59.433312+0000', 'last_undegraded': '2024-03-30T12:18:59.433312+0000', 'last_fullsized': '2024-03-30T12:18:59.433312+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:18:59.433312+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:18:59.433312+0000', 'last_clean_scrub_stamp': '2024-03-30T12:18:59.433312+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T12:19:04.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.5 is not active+clean 2024-03-30T12:19:04.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T12:18:59.433312+0000', 'last_change': '2024-03-30T12:18:59.433312+0000', 'last_active': '2024-03-30T12:18:59.433312+0000', 'last_peered': '2024-03-30T12:18:59.433312+0000', 'last_clean': '2024-03-30T12:18:59.433312+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:18:59.433312+0000', 'last_undegraded': '2024-03-30T12:18:59.433312+0000', 'last_fullsized': '2024-03-30T12:18:59.433312+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:18:59.433312+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:18:59.433312+0000', 'last_clean_scrub_stamp': '2024-03-30T12:18:59.433312+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T12:19:04.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-03-30T12:19:04.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-03-30T12:19:00.447774+0000', 'last_change': '2024-03-30T12:19:00.447774+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.447774+0000', 'last_undegraded': '2024-03-30T12:19:00.447774+0000', 'last_fullsized': '2024-03-30T12:19:00.447774+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-31T15:36:10.741436+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7, 0], 'acting': [3, 7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-30T12:19:04.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.8 is not active+clean 2024-03-30T12:19:04.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T12:18:59.433312+0000', 'last_change': '2024-03-30T12:18:59.433312+0000', 'last_active': '2024-03-30T12:18:59.433312+0000', 'last_peered': '2024-03-30T12:18:59.433312+0000', 'last_clean': '2024-03-30T12:18:59.433312+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:18:59.433312+0000', 'last_undegraded': '2024-03-30T12:18:59.433312+0000', 'last_fullsized': '2024-03-30T12:18:59.433312+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:18:59.433312+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:18:59.433312+0000', 'last_clean_scrub_stamp': '2024-03-30T12:18:59.433312+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T12:19:04.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-03-30T12:19:04.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T12:19:00.437665+0000', 'last_change': '2024-03-30T12:19:00.437665+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.437665+0000', 'last_undegraded': '2024-03-30T12:19:00.437665+0000', 'last_fullsized': '2024-03-30T12:19:00.437665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T12:19:04.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-03-30T12:19:04.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-03-30T12:19:00.447356+0000', 'last_change': '2024-03-30T12:19:00.447356+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.447356+0000', 'last_undegraded': '2024-03-30T12:19:00.447356+0000', 'last_fullsized': '2024-03-30T12:19:00.447356+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-31T15:52:32.869322+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1, 7], 'acting': [3, 1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-30T12:19:04.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-03-30T12:19:04.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-03-30T12:19:00.447901+0000', 'last_change': '2024-03-30T12:19:00.447901+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.447901+0000', 'last_undegraded': '2024-03-30T12:19:00.447901+0000', 'last_fullsized': '2024-03-30T12:19:00.447901+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-31T20:27:43.731796+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0, 4], 'acting': [3, 0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-30T12:19:04.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.b is not active+clean 2024-03-30T12:19:04.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T12:18:59.433312+0000', 'last_change': '2024-03-30T12:18:59.433312+0000', 'last_active': '2024-03-30T12:18:59.433312+0000', 'last_peered': '2024-03-30T12:18:59.433312+0000', 'last_clean': '2024-03-30T12:18:59.433312+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:18:59.433312+0000', 'last_undegraded': '2024-03-30T12:18:59.433312+0000', 'last_fullsized': '2024-03-30T12:18:59.433312+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:18:59.433312+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:18:59.433312+0000', 'last_clean_scrub_stamp': '2024-03-30T12:18:59.433312+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T12:19:04.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-03-30T12:19:04.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T12:19:00.437665+0000', 'last_change': '2024-03-30T12:19:00.437665+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.437665+0000', 'last_undegraded': '2024-03-30T12:19:00.437665+0000', 'last_fullsized': '2024-03-30T12:19:00.437665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T12:19:04.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-03-30T12:19:04.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-30T12:19:00.437665+0000', 'last_change': '2024-03-30T12:19:00.437665+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.437665+0000', 'last_undegraded': '2024-03-30T12:19:00.437665+0000', 'last_fullsized': '2024-03-30T12:19:00.437665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-30T12:19:04.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2024-03-30T12:19:04.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-03-30T12:19:00.449139+0000', 'last_change': '2024-03-30T12:19:00.449139+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.449139+0000', 'last_undegraded': '2024-03-30T12:19:00.449139+0000', 'last_fullsized': '2024-03-30T12:19:00.449139+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-31T17:50:42.644771+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4, 0], 'acting': [3, 4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-30T12:19:04.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2024-03-30T12:19:04.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-03-30T12:19:00.450476+0000', 'last_change': '2024-03-30T12:19:00.450476+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.450476+0000', 'last_undegraded': '2024-03-30T12:19:00.450476+0000', 'last_fullsized': '2024-03-30T12:19:00.450476+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-31T23:21:16.961559+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4, 2], 'acting': [3, 4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-30T12:19:04.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2024-03-30T12:19:04.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-03-30T12:19:00.449719+0000', 'last_change': '2024-03-30T12:19:00.449719+0000', 'last_active': '2024-03-30T12:19:00.437665+0000', 'last_peered': '2024-03-30T12:19:00.437665+0000', 'last_clean': '2024-03-30T12:19:00.437665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-30T12:19:00.449719+0000', 'last_undegraded': '2024-03-30T12:19:00.449719+0000', 'last_fullsized': '2024-03-30T12:19:00.449719+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'last_clean_scrub_stamp': '2024-03-30T12:19:00.437665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-31T16:46:50.526568+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4, 1], 'acting': [3, 4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-30T12:19:04.476 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-30T12:19:04.856 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:19:04.856 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"d3450b00-ee8e-11ee-b647-cb9ed24678a4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":227,"monmap":{"epoch":3,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":62,"num_osds":8,"num_up_osds":8,"osd_up_since":1711801122,"num_in_osds":8,"osd_in_since":1711801104,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":63},{"state_name":"unknown","count":23},{"state_name":"creating+peering","count":11}],"num_pgs":97,"num_pools":3,"num_objects":19,"data_bytes":592708,"bytes_used":240574464,"bytes_avail":767719710720,"bytes_total":767960285184,"unknown_pgs_ratio":0.23711340129375458,"inactive_pgs_ratio":0.11340206116437912,"write_bytes_sec":3327,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":24331}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["cephadm","dashboard","iostat","nfs","restful"],"services":{"dashboard":"https://172.21.15.84:8443/"}},"servicemap":{"epoch":11,"modified":"2024-03-30T12:18:53.173452+0000","services":{"osd":{"daemons":{"summary":"","6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-03-30T12:19:04.869 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-30T12:19:04.869 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T12:19:05.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:04 smithi162 ceph-mon[30421]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:19:05.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:04 smithi162 ceph-mon[30421]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:19:05.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:04 smithi162 ceph-mon[30421]: from='client.24446 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:19:05.156 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:19:05.157 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:19:05.166 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:04 smithi084 ceph-mon[37565]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:19:05.166 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:04 smithi084 ceph-mon[37565]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:19:05.166 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:04 smithi084 ceph-mon[37565]: from='client.24446 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:19:05.167 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:04 smithi084 ceph-mon[27000]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:19:05.167 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:04 smithi084 ceph-mon[27000]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:19:05.167 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:04 smithi084 ceph-mon[27000]: from='client.24446 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:19:05.167 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2024-03-30T12:19:03.174977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592708,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":195,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":222,"acting":222,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":749961216,"kb_used":234936,"kb_used_data":6436,"kb_used_omap":12,"kb_used_meta":228339,"kb_avail":749726280,"statfs":{"total":767960285184,"available":767719710720,"internally_reserved":0,"allocated":6590464,"data_stored":3740705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":233819704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000640"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.869843+0000","last_change":"2024-03-30T12:19:00.867897+0000","last_active":"2024-03-30T12:19:00.869843+0000","last_peered":"2024-03-30T12:19:00.869843+0000","last_clean":"2024-03-30T12:19:00.869843+0000","last_became_active":"2024-03-30T12:19:00.867457+0000","last_became_peered":"2024-03-30T12:19:00.867457+0000","last_unstale":"2024-03-30T12:19:00.869843+0000","last_undegraded":"2024-03-30T12:19:00.869843+0000","last_fullsized":"2024-03-30T12:19:00.869843+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:06:41.382626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847399+0000","last_change":"2024-03-30T12:19:00.853843+0000","last_active":"2024-03-30T12:19:01.847399+0000","last_peered":"2024-03-30T12:19:01.847399+0000","last_clean":"2024-03-30T12:19:01.847399+0000","last_became_active":"2024-03-30T12:19:00.853543+0000","last_became_peered":"2024-03-30T12:19:00.853543+0000","last_unstale":"2024-03-30T12:19:01.847399+0000","last_undegraded":"2024-03-30T12:19:01.847399+0000","last_fullsized":"2024-03-30T12:19:01.847399+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:52.339142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.860870+0000","last_change":"2024-03-30T12:19:00.859974+0000","last_active":"2024-03-30T12:19:00.860870+0000","last_peered":"2024-03-30T12:19:00.860870+0000","last_clean":"2024-03-30T12:19:00.860870+0000","last_became_active":"2024-03-30T12:19:00.859615+0000","last_became_peered":"2024-03-30T12:19:00.859615+0000","last_unstale":"2024-03-30T12:19:00.860870+0000","last_undegraded":"2024-03-30T12:19:00.860870+0000","last_fullsized":"2024-03-30T12:19:00.860870+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:26.933772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.858738+0000","last_change":"2024-03-30T12:19:00.858029+0000","last_active":"2024-03-30T12:19:00.858738+0000","last_peered":"2024-03-30T12:19:00.858738+0000","last_clean":"2024-03-30T12:19:00.858738+0000","last_became_active":"2024-03-30T12:19:00.857668+0000","last_became_peered":"2024-03-30T12:19:00.857668+0000","last_unstale":"2024-03-30T12:19:00.858738+0000","last_undegraded":"2024-03-30T12:19:00.858738+0000","last_fullsized":"2024-03-30T12:19:00.858738+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:17:33.313541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.450731+0000","last_change":"2024-03-30T12:19:00.450731+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.450731+0000","last_undegraded":"2024-03-30T12:19:00.450731+0000","last_fullsized":"2024-03-30T12:19:00.450731+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:59:30.409530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.872246+0000","last_change":"2024-03-30T12:19:00.869363+0000","last_active":"2024-03-30T12:19:00.872246+0000","last_peered":"2024-03-30T12:19:00.872246+0000","last_clean":"2024-03-30T12:19:00.872246+0000","last_became_active":"2024-03-30T12:19:00.868887+0000","last_became_peered":"2024-03-30T12:19:00.868887+0000","last_unstale":"2024-03-30T12:19:00.872246+0000","last_undegraded":"2024-03-30T12:19:00.872246+0000","last_fullsized":"2024-03-30T12:19:00.872246+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:40:49.543161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865134+0000","last_change":"2024-03-30T12:19:00.863992+0000","last_active":"2024-03-30T12:19:00.865134+0000","last_peered":"2024-03-30T12:19:00.865134+0000","last_clean":"2024-03-30T12:19:00.865134+0000","last_became_active":"2024-03-30T12:19:00.863683+0000","last_became_peered":"2024-03-30T12:19:00.863683+0000","last_unstale":"2024-03-30T12:19:00.865134+0000","last_undegraded":"2024-03-30T12:19:00.865134+0000","last_fullsized":"2024-03-30T12:19:00.865134+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:40:36.734391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.449868+0000","last_change":"2024-03-30T12:19:00.449868+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.449868+0000","last_undegraded":"2024-03-30T12:19:00.449868+0000","last_fullsized":"2024-03-30T12:19:00.449868+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:55:56.657057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847752+0000","last_change":"2024-03-30T12:19:00.865479+0000","last_active":"2024-03-30T12:19:01.847752+0000","last_peered":"2024-03-30T12:19:01.847752+0000","last_clean":"2024-03-30T12:19:01.847752+0000","last_became_active":"2024-03-30T12:19:00.864441+0000","last_became_peered":"2024-03-30T12:19:00.864441+0000","last_unstale":"2024-03-30T12:19:01.847752+0000","last_undegraded":"2024-03-30T12:19:01.847752+0000","last_fullsized":"2024-03-30T12:19:01.847752+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:45:55.344815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.867919+0000","last_change":"2024-03-30T12:19:00.866672+0000","last_active":"2024-03-30T12:19:00.867919+0000","last_peered":"2024-03-30T12:19:00.867919+0000","last_clean":"2024-03-30T12:19:00.867919+0000","last_became_active":"2024-03-30T12:19:00.866276+0000","last_became_peered":"2024-03-30T12:19:00.866276+0000","last_unstale":"2024-03-30T12:19:00.867919+0000","last_undegraded":"2024-03-30T12:19:00.867919+0000","last_fullsized":"2024-03-30T12:19:00.867919+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:23:49.856597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865488+0000","last_change":"2024-03-30T12:19:00.864760+0000","last_active":"2024-03-30T12:19:00.865488+0000","last_peered":"2024-03-30T12:19:00.865488+0000","last_clean":"2024-03-30T12:19:00.865488+0000","last_became_active":"2024-03-30T12:19:00.864447+0000","last_became_peered":"2024-03-30T12:19:00.864447+0000","last_unstale":"2024-03-30T12:19:00.865488+0000","last_undegraded":"2024-03-30T12:19:00.865488+0000","last_fullsized":"2024-03-30T12:19:00.865488+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:26:47.024806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865455+0000","last_change":"2024-03-30T12:19:00.863453+0000","last_active":"2024-03-30T12:19:00.865455+0000","last_peered":"2024-03-30T12:19:00.865455+0000","last_clean":"2024-03-30T12:19:00.865455+0000","last_became_active":"2024-03-30T12:19:00.863129+0000","last_became_peered":"2024-03-30T12:19:00.863129+0000","last_unstale":"2024-03-30T12:19:00.865455+0000","last_undegraded":"2024-03-30T12:19:00.865455+0000","last_fullsized":"2024-03-30T12:19:00.865455+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:19:33.658159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.854778+0000","last_change":"2024-03-30T12:19:00.854527+0000","last_active":"2024-03-30T12:19:00.854778+0000","last_peered":"2024-03-30T12:19:00.854778+0000","last_clean":"2024-03-30T12:19:00.854778+0000","last_became_active":"2024-03-30T12:19:00.854238+0000","last_became_peered":"2024-03-30T12:19:00.854238+0000","last_unstale":"2024-03-30T12:19:00.854778+0000","last_undegraded":"2024-03-30T12:19:00.854778+0000","last_fullsized":"2024-03-30T12:19:00.854778+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:50:54.069856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"61'4","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847950+0000","last_change":"2024-03-30T12:19:00.466957+0000","last_active":"2024-03-30T12:19:01.847950+0000","last_peered":"2024-03-30T12:19:01.847950+0000","last_clean":"2024-03-30T12:19:01.847950+0000","last_became_active":"2024-03-30T12:19:00.466689+0000","last_became_peered":"2024-03-30T12:19:00.466689+0000","last_unstale":"2024-03-30T12:19:01.847950+0000","last_undegraded":"2024-03-30T12:19:01.847950+0000","last_fullsized":"2024-03-30T12:19:01.847950+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:08.774258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.449236+0000","last_change":"2024-03-30T12:19:00.449236+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.449236+0000","last_undegraded":"2024-03-30T12:19:00.449236+0000","last_fullsized":"2024-03-30T12:19:00.449236+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:31.953173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.459977+0000","last_change":"2024-03-30T12:19:00.459693+0000","last_active":"2024-03-30T12:19:00.459977+0000","last_peered":"2024-03-30T12:19:00.459977+0000","last_clean":"2024-03-30T12:19:00.459977+0000","last_became_active":"2024-03-30T12:19:00.459409+0000","last_became_peered":"2024-03-30T12:19:00.459409+0000","last_unstale":"2024-03-30T12:19:00.459977+0000","last_undegraded":"2024-03-30T12:19:00.459977+0000","last_fullsized":"2024-03-30T12:19:00.459977+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:27.891375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847768+0000","last_change":"2024-03-30T12:19:00.864952+0000","last_active":"2024-03-30T12:19:01.847768+0000","last_peered":"2024-03-30T12:19:01.847768+0000","last_clean":"2024-03-30T12:19:01.847768+0000","last_became_active":"2024-03-30T12:19:00.864274+0000","last_became_peered":"2024-03-30T12:19:00.864274+0000","last_unstale":"2024-03-30T12:19:01.847768+0000","last_undegraded":"2024-03-30T12:19:01.847768+0000","last_fullsized":"2024-03-30T12:19:01.847768+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:45:00.775246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.860852+0000","last_change":"2024-03-30T12:19:00.859422+0000","last_active":"2024-03-30T12:19:00.860852+0000","last_peered":"2024-03-30T12:19:00.860852+0000","last_clean":"2024-03-30T12:19:00.860852+0000","last_became_active":"2024-03-30T12:19:00.858880+0000","last_became_peered":"2024-03-30T12:19:00.858880+0000","last_unstale":"2024-03-30T12:19:00.860852+0000","last_undegraded":"2024-03-30T12:19:00.860852+0000","last_fullsized":"2024-03-30T12:19:00.860852+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:09.612172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.860824+0000","last_change":"2024-03-30T12:19:00.859307+0000","last_active":"2024-03-30T12:19:00.860824+0000","last_peered":"2024-03-30T12:19:00.860824+0000","last_clean":"2024-03-30T12:19:00.860824+0000","last_became_active":"2024-03-30T12:19:00.858775+0000","last_became_peered":"2024-03-30T12:19:00.858775+0000","last_unstale":"2024-03-30T12:19:00.860824+0000","last_undegraded":"2024-03-30T12:19:00.860824+0000","last_fullsized":"2024-03-30T12:19:00.860824+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:30:39.349902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.455248+0000","last_change":"2024-03-30T12:19:00.454521+0000","last_active":"2024-03-30T12:19:00.455248+0000","last_peered":"2024-03-30T12:19:00.455248+0000","last_clean":"2024-03-30T12:19:00.455248+0000","last_became_active":"2024-03-30T12:19:00.454213+0000","last_became_peered":"2024-03-30T12:19:00.454213+0000","last_unstale":"2024-03-30T12:19:00.455248+0000","last_undegraded":"2024-03-30T12:19:00.455248+0000","last_fullsized":"2024-03-30T12:19:00.455248+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:27:47.198072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.872985+0000","last_change":"2024-03-30T12:19:00.460150+0000","last_active":"2024-03-30T12:19:00.872985+0000","last_peered":"2024-03-30T12:19:00.872985+0000","last_clean":"2024-03-30T12:19:00.872985+0000","last_became_active":"2024-03-30T12:19:00.459740+0000","last_became_peered":"2024-03-30T12:19:00.459740+0000","last_unstale":"2024-03-30T12:19:00.872985+0000","last_undegraded":"2024-03-30T12:19:00.872985+0000","last_fullsized":"2024-03-30T12:19:00.872985+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:52:40.523467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847884+0000","last_change":"2024-03-30T12:19:00.857403+0000","last_active":"2024-03-30T12:19:01.847884+0000","last_peered":"2024-03-30T12:19:01.847884+0000","last_clean":"2024-03-30T12:19:01.847884+0000","last_became_active":"2024-03-30T12:19:00.856652+0000","last_became_peered":"2024-03-30T12:19:00.856652+0000","last_unstale":"2024-03-30T12:19:01.847884+0000","last_undegraded":"2024-03-30T12:19:01.847884+0000","last_fullsized":"2024-03-30T12:19:01.847884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:51.932935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.458535+0000","last_change":"2024-03-30T12:19:00.458253+0000","last_active":"2024-03-30T12:19:00.458535+0000","last_peered":"2024-03-30T12:19:00.458535+0000","last_clean":"2024-03-30T12:19:00.458535+0000","last_became_active":"2024-03-30T12:19:00.457947+0000","last_became_peered":"2024-03-30T12:19:00.457947+0000","last_unstale":"2024-03-30T12:19:00.458535+0000","last_undegraded":"2024-03-30T12:19:00.458535+0000","last_fullsized":"2024-03-30T12:19:00.458535+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:13:18.864198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.448413+0000","last_change":"2024-03-30T12:19:00.448413+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.448413+0000","last_undegraded":"2024-03-30T12:19:00.448413+0000","last_fullsized":"2024-03-30T12:19:00.448413+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:56:16.965191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.841184+0000","last_change":"2024-03-30T12:19:00.466729+0000","last_active":"2024-03-30T12:19:00.841184+0000","last_peered":"2024-03-30T12:19:00.841184+0000","last_clean":"2024-03-30T12:19:00.841184+0000","last_became_active":"2024-03-30T12:19:00.466086+0000","last_became_peered":"2024-03-30T12:19:00.466086+0000","last_unstale":"2024-03-30T12:19:00.841184+0000","last_undegraded":"2024-03-30T12:19:00.841184+0000","last_fullsized":"2024-03-30T12:19:00.841184+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:46:14.144417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.867245+0000","last_change":"2024-03-30T12:19:00.863262+0000","last_active":"2024-03-30T12:19:00.867245+0000","last_peered":"2024-03-30T12:19:00.867245+0000","last_clean":"2024-03-30T12:19:00.867245+0000","last_became_active":"2024-03-30T12:19:00.861328+0000","last_became_peered":"2024-03-30T12:19:00.861328+0000","last_unstale":"2024-03-30T12:19:00.867245+0000","last_undegraded":"2024-03-30T12:19:00.867245+0000","last_fullsized":"2024-03-30T12:19:00.867245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:20:19.049967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.859367+0000","last_change":"2024-03-30T12:19:00.459929+0000","last_active":"2024-03-30T12:19:00.859367+0000","last_peered":"2024-03-30T12:19:00.859367+0000","last_clean":"2024-03-30T12:19:00.859367+0000","last_became_active":"2024-03-30T12:19:00.459518+0000","last_became_peered":"2024-03-30T12:19:00.459518+0000","last_unstale":"2024-03-30T12:19:00.859367+0000","last_undegraded":"2024-03-30T12:19:00.859367+0000","last_fullsized":"2024-03-30T12:19:00.859367+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:09:03.990119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865447+0000","last_change":"2024-03-30T12:19:00.862112+0000","last_active":"2024-03-30T12:19:00.865447+0000","last_peered":"2024-03-30T12:19:00.865447+0000","last_clean":"2024-03-30T12:19:00.865447+0000","last_became_active":"2024-03-30T12:19:00.861782+0000","last_became_peered":"2024-03-30T12:19:00.861782+0000","last_unstale":"2024-03-30T12:19:00.865447+0000","last_undegraded":"2024-03-30T12:19:00.865447+0000","last_fullsized":"2024-03-30T12:19:00.865447+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:01:42.946530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.840300+0000","last_change":"2024-03-30T12:19:00.463745+0000","last_active":"2024-03-30T12:19:00.840300+0000","last_peered":"2024-03-30T12:19:00.840300+0000","last_clean":"2024-03-30T12:19:00.840300+0000","last_became_active":"2024-03-30T12:19:00.462698+0000","last_became_peered":"2024-03-30T12:19:00.462698+0000","last_unstale":"2024-03-30T12:19:00.840300+0000","last_undegraded":"2024-03-30T12:19:00.840300+0000","last_fullsized":"2024-03-30T12:19:00.840300+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:09:33.196928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847685+0000","last_change":"2024-03-30T12:19:00.865197+0000","last_active":"2024-03-30T12:19:01.847685+0000","last_peered":"2024-03-30T12:19:01.847685+0000","last_clean":"2024-03-30T12:19:01.847685+0000","last_became_active":"2024-03-30T12:19:00.864718+0000","last_became_peered":"2024-03-30T12:19:00.864718+0000","last_unstale":"2024-03-30T12:19:01.847685+0000","last_undegraded":"2024-03-30T12:19:01.847685+0000","last_fullsized":"2024-03-30T12:19:01.847685+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:33:34.137353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.873460+0000","last_change":"2024-03-30T12:19:00.463581+0000","last_active":"2024-03-30T12:19:00.873460+0000","last_peered":"2024-03-30T12:19:00.873460+0000","last_clean":"2024-03-30T12:19:00.873460+0000","last_became_active":"2024-03-30T12:19:00.463280+0000","last_became_peered":"2024-03-30T12:19:00.463280+0000","last_unstale":"2024-03-30T12:19:00.873460+0000","last_undegraded":"2024-03-30T12:19:00.873460+0000","last_fullsized":"2024-03-30T12:19:00.873460+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:38:07.390655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"61'6","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.877488+0000","last_change":"2024-03-30T12:19:00.458102+0000","last_active":"2024-03-30T12:19:00.877488+0000","last_peered":"2024-03-30T12:19:00.877488+0000","last_clean":"2024-03-30T12:19:00.877488+0000","last_became_active":"2024-03-30T12:19:00.457759+0000","last_became_peered":"2024-03-30T12:19:00.457759+0000","last_unstale":"2024-03-30T12:19:00.877488+0000","last_undegraded":"2024-03-30T12:19:00.877488+0000","last_fullsized":"2024-03-30T12:19:00.877488+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:31.713303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847868+0000","last_change":"2024-03-30T12:19:00.462939+0000","last_active":"2024-03-30T12:19:01.847868+0000","last_peered":"2024-03-30T12:19:01.847868+0000","last_clean":"2024-03-30T12:19:01.847868+0000","last_became_active":"2024-03-30T12:19:00.462637+0000","last_became_peered":"2024-03-30T12:19:00.462637+0000","last_unstale":"2024-03-30T12:19:01.847868+0000","last_undegraded":"2024-03-30T12:19:01.847868+0000","last_fullsized":"2024-03-30T12:19:01.847868+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:48:59.027106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847660+0000","last_change":"2024-03-30T12:19:00.856865+0000","last_active":"2024-03-30T12:19:01.847660+0000","last_peered":"2024-03-30T12:19:01.847660+0000","last_clean":"2024-03-30T12:19:01.847660+0000","last_became_active":"2024-03-30T12:19:00.856544+0000","last_became_peered":"2024-03-30T12:19:00.856544+0000","last_unstale":"2024-03-30T12:19:01.847660+0000","last_undegraded":"2024-03-30T12:19:01.847660+0000","last_fullsized":"2024-03-30T12:19:01.847660+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:37:39.901012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.841547+0000","last_change":"2024-03-30T12:19:00.465931+0000","last_active":"2024-03-30T12:19:00.841547+0000","last_peered":"2024-03-30T12:19:00.841547+0000","last_clean":"2024-03-30T12:19:00.841547+0000","last_became_active":"2024-03-30T12:19:00.465589+0000","last_became_peered":"2024-03-30T12:19:00.465589+0000","last_unstale":"2024-03-30T12:19:00.841547+0000","last_undegraded":"2024-03-30T12:19:00.841547+0000","last_fullsized":"2024-03-30T12:19:00.841547+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:02:38.614924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.855845+0000","last_change":"2024-03-30T12:19:00.454678+0000","last_active":"2024-03-30T12:19:00.855845+0000","last_peered":"2024-03-30T12:19:00.855845+0000","last_clean":"2024-03-30T12:19:00.855845+0000","last_became_active":"2024-03-30T12:19:00.454380+0000","last_became_peered":"2024-03-30T12:19:00.454380+0000","last_unstale":"2024-03-30T12:19:00.855845+0000","last_undegraded":"2024-03-30T12:19:00.855845+0000","last_fullsized":"2024-03-30T12:19:00.855845+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:08:24.640327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.862926+0000","last_change":"2024-03-30T12:19:00.861547+0000","last_active":"2024-03-30T12:19:00.862926+0000","last_peered":"2024-03-30T12:19:00.862926+0000","last_clean":"2024-03-30T12:19:00.862926+0000","last_became_active":"2024-03-30T12:19:00.861268+0000","last_became_peered":"2024-03-30T12:19:00.861268+0000","last_unstale":"2024-03-30T12:19:00.862926+0000","last_undegraded":"2024-03-30T12:19:00.862926+0000","last_fullsized":"2024-03-30T12:19:00.862926+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:28:37.342309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.873715+0000","last_change":"2024-03-30T12:19:00.460090+0000","last_active":"2024-03-30T12:19:00.873715+0000","last_peered":"2024-03-30T12:19:00.873715+0000","last_clean":"2024-03-30T12:19:00.873715+0000","last_became_active":"2024-03-30T12:19:00.459790+0000","last_became_peered":"2024-03-30T12:19:00.459790+0000","last_unstale":"2024-03-30T12:19:00.873715+0000","last_undegraded":"2024-03-30T12:19:00.873715+0000","last_fullsized":"2024-03-30T12:19:00.873715+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:38.860631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.843884+0000","last_change":"2024-03-30T12:19:00.462709+0000","last_active":"2024-03-30T12:19:00.843884+0000","last_peered":"2024-03-30T12:19:00.843884+0000","last_clean":"2024-03-30T12:19:00.843884+0000","last_became_active":"2024-03-30T12:19:00.462429+0000","last_became_peered":"2024-03-30T12:19:00.462429+0000","last_unstale":"2024-03-30T12:19:00.843884+0000","last_undegraded":"2024-03-30T12:19:00.843884+0000","last_fullsized":"2024-03-30T12:19:00.843884+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:29.579526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.855986+0000","last_change":"2024-03-30T12:19:00.854025+0000","last_active":"2024-03-30T12:19:00.855986+0000","last_peered":"2024-03-30T12:19:00.855986+0000","last_clean":"2024-03-30T12:19:00.855986+0000","last_became_active":"2024-03-30T12:19:00.853714+0000","last_became_peered":"2024-03-30T12:19:00.853714+0000","last_unstale":"2024-03-30T12:19:00.855986+0000","last_undegraded":"2024-03-30T12:19:00.855986+0000","last_fullsized":"2024-03-30T12:19:00.855986+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:27:34.498087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.840118+0000","last_change":"2024-03-30T12:19:00.457612+0000","last_active":"2024-03-30T12:19:00.840118+0000","last_peered":"2024-03-30T12:19:00.840118+0000","last_clean":"2024-03-30T12:19:00.840118+0000","last_became_active":"2024-03-30T12:19:00.457289+0000","last_became_peered":"2024-03-30T12:19:00.457289+0000","last_unstale":"2024-03-30T12:19:00.840118+0000","last_undegraded":"2024-03-30T12:19:00.840118+0000","last_fullsized":"2024-03-30T12:19:00.840118+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:23.011997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.863066+0000","last_change":"2024-03-30T12:19:00.861917+0000","last_active":"2024-03-30T12:19:00.863066+0000","last_peered":"2024-03-30T12:19:00.863066+0000","last_clean":"2024-03-30T12:19:00.863066+0000","last_became_active":"2024-03-30T12:19:00.860645+0000","last_became_peered":"2024-03-30T12:19:00.860645+0000","last_unstale":"2024-03-30T12:19:00.863066+0000","last_undegraded":"2024-03-30T12:19:00.863066+0000","last_fullsized":"2024-03-30T12:19:00.863066+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:30:51.438018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.842009+0000","last_change":"2024-03-30T12:19:00.459145+0000","last_active":"2024-03-30T12:19:00.842009+0000","last_peered":"2024-03-30T12:19:00.842009+0000","last_clean":"2024-03-30T12:19:00.842009+0000","last_became_active":"2024-03-30T12:19:00.457819+0000","last_became_peered":"2024-03-30T12:19:00.457819+0000","last_unstale":"2024-03-30T12:19:00.842009+0000","last_undegraded":"2024-03-30T12:19:00.842009+0000","last_fullsized":"2024-03-30T12:19:00.842009+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:44:38.245366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.447233+0000","last_change":"2024-03-30T12:19:00.447233+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.447233+0000","last_undegraded":"2024-03-30T12:19:00.447233+0000","last_fullsized":"2024-03-30T12:19:00.447233+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:13:39.199499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.841612+0000","last_change":"2024-03-30T12:19:00.465946+0000","last_active":"2024-03-30T12:19:00.841612+0000","last_peered":"2024-03-30T12:19:00.841612+0000","last_clean":"2024-03-30T12:19:00.841612+0000","last_became_active":"2024-03-30T12:19:00.465618+0000","last_became_peered":"2024-03-30T12:19:00.465618+0000","last_unstale":"2024-03-30T12:19:00.841612+0000","last_undegraded":"2024-03-30T12:19:00.841612+0000","last_fullsized":"2024-03-30T12:19:00.841612+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:58:42.109572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"22'117","reported_seq":216,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-03-30T12:18:45.913180+0000","last_change":"2024-03-30T12:18:45.912869+0000","last_active":"2024-03-30T12:18:45.913180+0000","last_peered":"2024-03-30T12:18:45.913180+0000","last_clean":"2024-03-30T12:18:45.913180+0000","last_became_active":"2024-03-30T12:18:45.912395+0000","last_became_peered":"2024-03-30T12:18:45.912395+0000","last_unstale":"2024-03-30T12:18:45.913180+0000","last_undegraded":"2024-03-30T12:18:45.913180+0000","last_fullsized":"2024-03-30T12:18:45.913180+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:34.485283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847236+0000","last_change":"2024-03-30T12:19:00.852506+0000","last_active":"2024-03-30T12:19:01.847236+0000","last_peered":"2024-03-30T12:19:01.847236+0000","last_clean":"2024-03-30T12:19:01.847236+0000","last_became_active":"2024-03-30T12:19:00.852216+0000","last_became_peered":"2024-03-30T12:19:00.852216+0000","last_unstale":"2024-03-30T12:19:01.847236+0000","last_undegraded":"2024-03-30T12:19:01.847236+0000","last_fullsized":"2024-03-30T12:19:01.847236+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:41:21.462303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.868254+0000","last_change":"2024-03-30T12:19:00.865798+0000","last_active":"2024-03-30T12:19:00.868254+0000","last_peered":"2024-03-30T12:19:00.868254+0000","last_clean":"2024-03-30T12:19:00.868254+0000","last_became_active":"2024-03-30T12:19:00.865518+0000","last_became_peered":"2024-03-30T12:19:00.865518+0000","last_unstale":"2024-03-30T12:19:00.868254+0000","last_undegraded":"2024-03-30T12:19:00.868254+0000","last_fullsized":"2024-03-30T12:19:00.868254+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:47:41.818140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.846497+0000","last_change":"2024-03-30T12:19:00.454554+0000","last_active":"2024-03-30T12:19:00.846497+0000","last_peered":"2024-03-30T12:19:00.846497+0000","last_clean":"2024-03-30T12:19:00.846497+0000","last_became_active":"2024-03-30T12:19:00.454233+0000","last_became_peered":"2024-03-30T12:19:00.454233+0000","last_unstale":"2024-03-30T12:19:00.846497+0000","last_undegraded":"2024-03-30T12:19:00.846497+0000","last_fullsized":"2024-03-30T12:19:00.846497+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:05:09.010127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.447774+0000","last_change":"2024-03-30T12:19:00.447774+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.447774+0000","last_undegraded":"2024-03-30T12:19:00.447774+0000","last_fullsized":"2024-03-30T12:19:00.447774+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:36:10.741436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.874220+0000","last_change":"2024-03-30T12:19:00.460279+0000","last_active":"2024-03-30T12:19:00.874220+0000","last_peered":"2024-03-30T12:19:00.874220+0000","last_clean":"2024-03-30T12:19:00.874220+0000","last_became_active":"2024-03-30T12:19:00.459948+0000","last_became_peered":"2024-03-30T12:19:00.459948+0000","last_unstale":"2024-03-30T12:19:00.874220+0000","last_undegraded":"2024-03-30T12:19:00.874220+0000","last_fullsized":"2024-03-30T12:19:00.874220+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:06.870147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847496+0000","last_change":"2024-03-30T12:19:00.853029+0000","last_active":"2024-03-30T12:19:01.847496+0000","last_peered":"2024-03-30T12:19:01.847496+0000","last_clean":"2024-03-30T12:19:01.847496+0000","last_became_active":"2024-03-30T12:19:00.852755+0000","last_became_peered":"2024-03-30T12:19:00.852755+0000","last_unstale":"2024-03-30T12:19:01.847496+0000","last_undegraded":"2024-03-30T12:19:01.847496+0000","last_fullsized":"2024-03-30T12:19:01.847496+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:03:44.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.844116+0000","last_change":"2024-03-30T12:19:00.459528+0000","last_active":"2024-03-30T12:19:00.844116+0000","last_peered":"2024-03-30T12:19:00.844116+0000","last_clean":"2024-03-30T12:19:00.844116+0000","last_became_active":"2024-03-30T12:19:00.459223+0000","last_became_peered":"2024-03-30T12:19:00.459223+0000","last_unstale":"2024-03-30T12:19:00.844116+0000","last_undegraded":"2024-03-30T12:19:00.844116+0000","last_fullsized":"2024-03-30T12:19:00.844116+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:44.399783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.447356+0000","last_change":"2024-03-30T12:19:00.447356+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.447356+0000","last_undegraded":"2024-03-30T12:19:00.447356+0000","last_fullsized":"2024-03-30T12:19:00.447356+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:52:32.869322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.844802+0000","last_change":"2024-03-30T12:19:00.460526+0000","last_active":"2024-03-30T12:19:00.844802+0000","last_peered":"2024-03-30T12:19:00.844802+0000","last_clean":"2024-03-30T12:19:00.844802+0000","last_became_active":"2024-03-30T12:19:00.460018+0000","last_became_peered":"2024-03-30T12:19:00.460018+0000","last_unstale":"2024-03-30T12:19:00.844802+0000","last_undegraded":"2024-03-30T12:19:00.844802+0000","last_fullsized":"2024-03-30T12:19:00.844802+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:33:30.671209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.447901+0000","last_change":"2024-03-30T12:19:00.447901+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.447901+0000","last_undegraded":"2024-03-30T12:19:00.447901+0000","last_fullsized":"2024-03-30T12:19:00.447901+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:43.731796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:18:59.433312+0000","last_change":"2024-03-30T12:18:59.433312+0000","last_active":"2024-03-30T12:18:59.433312+0000","last_peered":"2024-03-30T12:18:59.433312+0000","last_clean":"2024-03-30T12:18:59.433312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:18:59.433312+0000","last_undegraded":"2024-03-30T12:18:59.433312+0000","last_fullsized":"2024-03-30T12:18:59.433312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.871217+0000","last_change":"2024-03-30T12:19:00.869001+0000","last_active":"2024-03-30T12:19:00.871217+0000","last_peered":"2024-03-30T12:19:00.871217+0000","last_clean":"2024-03-30T12:19:00.871217+0000","last_became_active":"2024-03-30T12:19:00.868645+0000","last_became_peered":"2024-03-30T12:19:00.868645+0000","last_unstale":"2024-03-30T12:19:00.871217+0000","last_undegraded":"2024-03-30T12:19:00.871217+0000","last_fullsized":"2024-03-30T12:19:00.871217+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:54:10.778279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.842782+0000","last_change":"2024-03-30T12:19:00.459171+0000","last_active":"2024-03-30T12:19:00.842782+0000","last_peered":"2024-03-30T12:19:00.842782+0000","last_clean":"2024-03-30T12:19:00.842782+0000","last_became_active":"2024-03-30T12:19:00.458925+0000","last_became_peered":"2024-03-30T12:19:00.458925+0000","last_unstale":"2024-03-30T12:19:00.842782+0000","last_undegraded":"2024-03-30T12:19:00.842782+0000","last_fullsized":"2024-03-30T12:19:00.842782+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:26:20.974369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"61'1","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.873975+0000","last_change":"2024-03-30T12:19:00.459545+0000","last_active":"2024-03-30T12:19:00.873975+0000","last_peered":"2024-03-30T12:19:00.873975+0000","last_clean":"2024-03-30T12:19:00.873975+0000","last_became_active":"2024-03-30T12:19:00.459250+0000","last_became_peered":"2024-03-30T12:19:00.459250+0000","last_unstale":"2024-03-30T12:19:00.873975+0000","last_undegraded":"2024-03-30T12:19:00.873975+0000","last_fullsized":"2024-03-30T12:19:00.873975+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:38.112815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.853251+0000","last_change":"2024-03-30T12:19:00.852558+0000","last_active":"2024-03-30T12:19:00.853251+0000","last_peered":"2024-03-30T12:19:00.853251+0000","last_clean":"2024-03-30T12:19:00.853251+0000","last_became_active":"2024-03-30T12:19:00.852250+0000","last_became_peered":"2024-03-30T12:19:00.852250+0000","last_unstale":"2024-03-30T12:19:00.853251+0000","last_undegraded":"2024-03-30T12:19:00.853251+0000","last_fullsized":"2024-03-30T12:19:00.853251+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:57:15.989801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.879619+0000","last_change":"2024-03-30T12:19:00.464968+0000","last_active":"2024-03-30T12:19:00.879619+0000","last_peered":"2024-03-30T12:19:00.879619+0000","last_clean":"2024-03-30T12:19:00.879619+0000","last_became_active":"2024-03-30T12:19:00.464021+0000","last_became_peered":"2024-03-30T12:19:00.464021+0000","last_unstale":"2024-03-30T12:19:00.879619+0000","last_undegraded":"2024-03-30T12:19:00.879619+0000","last_fullsized":"2024-03-30T12:19:00.879619+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:20.224884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T12:19:00.437665+0000","last_change":"2024-03-30T12:19:00.437665+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.437665+0000","last_undegraded":"2024-03-30T12:19:00.437665+0000","last_fullsized":"2024-03-30T12:19:00.437665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.863796+0000","last_change":"2024-03-30T12:19:00.862859+0000","last_active":"2024-03-30T12:19:00.863796+0000","last_peered":"2024-03-30T12:19:00.863796+0000","last_clean":"2024-03-30T12:19:00.863796+0000","last_became_active":"2024-03-30T12:19:00.862535+0000","last_became_peered":"2024-03-30T12:19:00.862535+0000","last_unstale":"2024-03-30T12:19:00.863796+0000","last_undegraded":"2024-03-30T12:19:00.863796+0000","last_fullsized":"2024-03-30T12:19:00.863796+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:17:31.462763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865528+0000","last_change":"2024-03-30T12:19:00.862947+0000","last_active":"2024-03-30T12:19:00.865528+0000","last_peered":"2024-03-30T12:19:00.865528+0000","last_clean":"2024-03-30T12:19:00.865528+0000","last_became_active":"2024-03-30T12:19:00.862567+0000","last_became_peered":"2024-03-30T12:19:00.862567+0000","last_unstale":"2024-03-30T12:19:00.865528+0000","last_undegraded":"2024-03-30T12:19:00.865528+0000","last_fullsized":"2024-03-30T12:19:00.865528+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:55:05.422370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.857994+0000","last_change":"2024-03-30T12:19:00.856869+0000","last_active":"2024-03-30T12:19:00.857994+0000","last_peered":"2024-03-30T12:19:00.857994+0000","last_clean":"2024-03-30T12:19:00.857994+0000","last_became_active":"2024-03-30T12:19:00.856525+0000","last_became_peered":"2024-03-30T12:19:00.856525+0000","last_unstale":"2024-03-30T12:19:00.857994+0000","last_undegraded":"2024-03-30T12:19:00.857994+0000","last_fullsized":"2024-03-30T12:19:00.857994+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:01:47.443294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847804+0000","last_change":"2024-03-30T12:19:00.859724+0000","last_active":"2024-03-30T12:19:01.847804+0000","last_peered":"2024-03-30T12:19:01.847804+0000","last_clean":"2024-03-30T12:19:01.847804+0000","last_became_active":"2024-03-30T12:19:00.859327+0000","last_became_peered":"2024-03-30T12:19:00.859327+0000","last_unstale":"2024-03-30T12:19:01.847804+0000","last_undegraded":"2024-03-30T12:19:01.847804+0000","last_fullsized":"2024-03-30T12:19:01.847804+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:53:15.692683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.449139+0000","last_change":"2024-03-30T12:19:00.449139+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.449139+0000","last_undegraded":"2024-03-30T12:19:00.449139+0000","last_fullsized":"2024-03-30T12:19:00.449139+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:42.644771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.848520+0000","last_change":"2024-03-30T12:19:00.848297+0000","last_active":"2024-03-30T12:19:00.848520+0000","last_peered":"2024-03-30T12:19:00.848520+0000","last_clean":"2024-03-30T12:19:00.848520+0000","last_became_active":"2024-03-30T12:19:00.848029+0000","last_became_peered":"2024-03-30T12:19:00.848029+0000","last_unstale":"2024-03-30T12:19:00.848520+0000","last_undegraded":"2024-03-30T12:19:00.848520+0000","last_fullsized":"2024-03-30T12:19:00.848520+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:38.617413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.872267+0000","last_change":"2024-03-30T12:19:00.869414+0000","last_active":"2024-03-30T12:19:00.872267+0000","last_peered":"2024-03-30T12:19:00.872267+0000","last_clean":"2024-03-30T12:19:00.872267+0000","last_became_active":"2024-03-30T12:19:00.869115+0000","last_became_peered":"2024-03-30T12:19:00.869115+0000","last_unstale":"2024-03-30T12:19:00.872267+0000","last_undegraded":"2024-03-30T12:19:00.872267+0000","last_fullsized":"2024-03-30T12:19:00.872267+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:01:12.173692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.450476+0000","last_change":"2024-03-30T12:19:00.450476+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.450476+0000","last_undegraded":"2024-03-30T12:19:00.450476+0000","last_fullsized":"2024-03-30T12:19:00.450476+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:21:16.961559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.856024+0000","last_change":"2024-03-30T12:19:00.854668+0000","last_active":"2024-03-30T12:19:00.856024+0000","last_peered":"2024-03-30T12:19:00.856024+0000","last_clean":"2024-03-30T12:19:00.856024+0000","last_became_active":"2024-03-30T12:19:00.854390+0000","last_became_peered":"2024-03-30T12:19:00.854390+0000","last_unstale":"2024-03-30T12:19:00.856024+0000","last_undegraded":"2024-03-30T12:19:00.856024+0000","last_fullsized":"2024-03-30T12:19:00.856024+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:39:22.128098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-03-30T12:19:00.449719+0000","last_change":"2024-03-30T12:19:00.449719+0000","last_active":"2024-03-30T12:19:00.437665+0000","last_peered":"2024-03-30T12:19:00.437665+0000","last_clean":"2024-03-30T12:19:00.437665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T12:19:00.449719+0000","last_undegraded":"2024-03-30T12:19:00.449719+0000","last_fullsized":"2024-03-30T12:19:00.449719+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:46:50.526568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865165+0000","last_change":"2024-03-30T12:19:00.860406+0000","last_active":"2024-03-30T12:19:00.865165+0000","last_peered":"2024-03-30T12:19:00.865165+0000","last_clean":"2024-03-30T12:19:00.865165+0000","last_became_active":"2024-03-30T12:19:00.860085+0000","last_became_peered":"2024-03-30T12:19:00.860085+0000","last_unstale":"2024-03-30T12:19:00.865165+0000","last_undegraded":"2024-03-30T12:19:00.865165+0000","last_fullsized":"2024-03-30T12:19:00.865165+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:32.201939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847724+0000","last_change":"2024-03-30T12:19:00.856917+0000","last_active":"2024-03-30T12:19:01.847724+0000","last_peered":"2024-03-30T12:19:01.847724+0000","last_clean":"2024-03-30T12:19:01.847724+0000","last_became_active":"2024-03-30T12:19:00.856643+0000","last_became_peered":"2024-03-30T12:19:00.856643+0000","last_unstale":"2024-03-30T12:19:01.847724+0000","last_undegraded":"2024-03-30T12:19:01.847724+0000","last_fullsized":"2024-03-30T12:19:01.847724+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:51:53.996045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.871097+0000","last_change":"2024-03-30T12:19:00.867176+0000","last_active":"2024-03-30T12:19:00.871097+0000","last_peered":"2024-03-30T12:19:00.871097+0000","last_clean":"2024-03-30T12:19:00.871097+0000","last_became_active":"2024-03-30T12:19:00.866801+0000","last_became_peered":"2024-03-30T12:19:00.866801+0000","last_unstale":"2024-03-30T12:19:00.871097+0000","last_undegraded":"2024-03-30T12:19:00.871097+0000","last_fullsized":"2024-03-30T12:19:00.871097+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:31:22.909206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":144,"acting":144,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2340,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":75,"acting":75,"num_store_stats":6}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928233990,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28160,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716992,"statfs":{"total":95995035648,"available":95966199808,"internally_reserved":0,"allocated":1163264,"data_stored":822591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]}]},{"osd":6,"up_from":46,"seq":197568495627,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28212,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716940,"statfs":{"total":95995035648,"available":95966146560,"internally_reserved":0,"allocated":1212416,"data_stored":844370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31720,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713432,"statfs":{"total":95995035648,"available":95962554368,"internally_reserved":0,"allocated":610304,"data_stored":252325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.32500000000000001,"15min":0.307},"min":{"1min":0.23000000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.32000000000000001},"min":{"1min":0.23599999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.33000000000000002}]},{"osd":2,"last update":"Sat Mar 30 12:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.38200000000000001,"15min":0.375},"min":{"1min":0.254,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.39500000000000002,"15min":0.38900000000000001},"min":{"1min":0.32200000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.26300000000000001}]},{"osd":3,"last update":"Sat Mar 30 12:18:08 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.48499999999999999}]},{"osd":4,"last update":"Sat Mar 30 12:18:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.46300000000000002}]},{"osd":5,"last update":"Sat Mar 30 12:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738408,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32316,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712836,"statfs":{"total":95995035648,"available":95961944064,"internally_reserved":0,"allocated":1220608,"data_stored":843807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 30 12:18:17 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.307,"15min":0.29499999999999998},"min":{"1min":0.27500000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.317,"15min":0.30299999999999999},"min":{"1min":0.28199999999999997,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.36799999999999999}]},{"osd":2,"last update":"Sat Mar 30 12:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.42799999999999999,"15min":0.42099999999999999},"min":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.437,"5min":0.40899999999999997,"15min":0.40500000000000003},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.378}]},{"osd":3,"last update":"Sat Mar 30 12:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.32500000000000001}]},{"osd":4,"last update":"Sat Mar 30 12:18:29 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.61799999999999999}]},{"osd":5,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411358,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31716,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713436,"statfs":{"total":95995035648,"available":95962558464,"internally_reserved":0,"allocated":606208,"data_stored":252438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:18:49 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34200000000000003},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38100000000000001,"15min":0.38},"min":{"1min":0.26900000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.56499999999999995,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.435}]},{"osd":1,"last update":"Sat Mar 30 12:18:49 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40200000000000002,"15min":0.40100000000000002},"min":{"1min":0.27800000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.38200000000000001},"min":{"1min":0.25600000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59899999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.44700000000000001}]},{"osd":3,"last update":"Sat Mar 30 12:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.48699999999999999}]},{"osd":4,"last update":"Sat Mar 30 12:18:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.91500000000000004}]},{"osd":5,"last update":"Sat Mar 30 12:18:57 2024","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.542,"15min":1.542},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":19.606999999999999,"5min":19.606999999999999,"15min":19.606999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.746}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182425,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717560,"statfs":{"total":95995035648,"available":95966781440,"internally_reserved":0,"allocated":585728,"data_stored":238801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.30299999999999999}]},{"osd":1,"last update":"Sat Mar 30 12:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.36599999999999999}]},{"osd":2,"last update":"Sat Mar 30 12:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.35199999999999998}]},{"osd":4,"last update":"Sat Mar 30 12:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":4.8639999999999999,"5min":4.8639999999999999,"15min":4.8639999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.625}]},{"osd":5,"last update":"Sat Mar 30 12:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":4,"up_from":30,"seq":128849018900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27580,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717572,"statfs":{"total":95995035648,"available":95966793728,"internally_reserved":0,"allocated":565248,"data_stored":232008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.53600000000000003}]},{"osd":1,"last update":"Sat Mar 30 12:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.59799999999999998}]},{"osd":2,"last update":"Sat Mar 30 12:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.61599999999999999}]},{"osd":3,"last update":"Sat Mar 30 12:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.50600000000000001}]},{"osd":5,"last update":"Sat Mar 30 12:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.35399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]}]},{"osd":5,"up_from":38,"seq":163208757264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27640,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717512,"statfs":{"total":95995035648,"available":95966732288,"internally_reserved":0,"allocated":626688,"data_stored":254365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.41499999999999998}]},{"osd":1,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.44500000000000001}]},{"osd":2,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.46100000000000002}]},{"osd":3,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.436}]},{"osd":4,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.35099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:19:06.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:05 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/2775853151' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-03-30T12:19:06.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:05 smithi162 ceph-mon[30421]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:19:06.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:05 smithi162 ceph-mon[30421]: pgmap v189: 97 pgs: 11 creating+peering, 86 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s wr, 7 op/s 2024-03-30T12:19:06.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:05 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/2775853151' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-03-30T12:19:06.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:05 smithi084 ceph-mon[27000]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:19:06.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:05 smithi084 ceph-mon[27000]: pgmap v189: 97 pgs: 11 creating+peering, 86 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s wr, 7 op/s 2024-03-30T12:19:06.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:05 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/2775853151' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-03-30T12:19:06.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:05 smithi084 ceph-mon[37565]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:19:06.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:05 smithi084 ceph-mon[37565]: pgmap v189: 97 pgs: 11 creating+peering, 86 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s wr, 7 op/s 2024-03-30T12:19:08.173 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T12:19:08.476 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:19:08.477 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:19:08.486 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:08 smithi084 ceph-mon[27000]: pgmap v190: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s wr, 6 op/s 2024-03-30T12:19:08.486 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:08 smithi084 ceph-mon[37565]: pgmap v190: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s wr, 6 op/s 2024-03-30T12:19:08.487 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2024-03-30T12:19:07.175818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":239220,"kb_used_data":6636,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":749721996,"statfs":{"total":767960285184,"available":767715323904,"internally_reserved":0,"allocated":6795264,"data_stored":3831559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.735246"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.850680+0000","last_change":"2024-03-30T12:19:00.863340+0000","last_active":"2024-03-30T12:19:01.850680+0000","last_peered":"2024-03-30T12:19:01.850680+0000","last_clean":"2024-03-30T12:19:01.850680+0000","last_became_active":"2024-03-30T12:19:00.863041+0000","last_became_peered":"2024-03-30T12:19:00.863041+0000","last_unstale":"2024-03-30T12:19:01.850680+0000","last_undegraded":"2024-03-30T12:19:01.850680+0000","last_fullsized":"2024-03-30T12:19:01.850680+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:21.728523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.792521+0000","last_change":"2024-03-30T12:19:00.867897+0000","last_active":"2024-03-30T12:19:01.792521+0000","last_peered":"2024-03-30T12:19:01.792521+0000","last_clean":"2024-03-30T12:19:01.792521+0000","last_became_active":"2024-03-30T12:19:00.867457+0000","last_became_peered":"2024-03-30T12:19:00.867457+0000","last_unstale":"2024-03-30T12:19:01.792521+0000","last_undegraded":"2024-03-30T12:19:01.792521+0000","last_fullsized":"2024-03-30T12:19:01.792521+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:06:41.382626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847399+0000","last_change":"2024-03-30T12:19:00.853843+0000","last_active":"2024-03-30T12:19:01.847399+0000","last_peered":"2024-03-30T12:19:01.847399+0000","last_clean":"2024-03-30T12:19:01.847399+0000","last_became_active":"2024-03-30T12:19:00.853543+0000","last_became_peered":"2024-03-30T12:19:00.853543+0000","last_unstale":"2024-03-30T12:19:01.847399+0000","last_undegraded":"2024-03-30T12:19:01.847399+0000","last_fullsized":"2024-03-30T12:19:01.847399+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:52.339142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.860870+0000","last_change":"2024-03-30T12:19:00.859974+0000","last_active":"2024-03-30T12:19:00.860870+0000","last_peered":"2024-03-30T12:19:00.860870+0000","last_clean":"2024-03-30T12:19:00.860870+0000","last_became_active":"2024-03-30T12:19:00.859615+0000","last_became_peered":"2024-03-30T12:19:00.859615+0000","last_unstale":"2024-03-30T12:19:00.860870+0000","last_undegraded":"2024-03-30T12:19:00.860870+0000","last_fullsized":"2024-03-30T12:19:00.860870+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:26.933772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.850220+0000","last_change":"2024-03-30T12:19:00.872400+0000","last_active":"2024-03-30T12:19:01.850220+0000","last_peered":"2024-03-30T12:19:01.850220+0000","last_clean":"2024-03-30T12:19:01.850220+0000","last_became_active":"2024-03-30T12:19:00.872098+0000","last_became_peered":"2024-03-30T12:19:00.872098+0000","last_unstale":"2024-03-30T12:19:01.850220+0000","last_undegraded":"2024-03-30T12:19:01.850220+0000","last_fullsized":"2024-03-30T12:19:01.850220+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:21.152462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.858738+0000","last_change":"2024-03-30T12:19:00.858029+0000","last_active":"2024-03-30T12:19:00.858738+0000","last_peered":"2024-03-30T12:19:00.858738+0000","last_clean":"2024-03-30T12:19:00.858738+0000","last_became_active":"2024-03-30T12:19:00.857668+0000","last_became_peered":"2024-03-30T12:19:00.857668+0000","last_unstale":"2024-03-30T12:19:00.858738+0000","last_undegraded":"2024-03-30T12:19:00.858738+0000","last_fullsized":"2024-03-30T12:19:00.858738+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:17:33.313541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.849885+0000","last_change":"2024-03-30T12:19:00.869258+0000","last_active":"2024-03-30T12:19:01.849885+0000","last_peered":"2024-03-30T12:19:01.849885+0000","last_clean":"2024-03-30T12:19:01.849885+0000","last_became_active":"2024-03-30T12:19:00.868799+0000","last_became_peered":"2024-03-30T12:19:00.868799+0000","last_unstale":"2024-03-30T12:19:01.849885+0000","last_undegraded":"2024-03-30T12:19:01.849885+0000","last_fullsized":"2024-03-30T12:19:01.849885+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:00:11.265094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.864698+0000","last_change":"2024-03-30T12:19:00.864240+0000","last_active":"2024-03-30T12:19:00.864698+0000","last_peered":"2024-03-30T12:19:00.864698+0000","last_clean":"2024-03-30T12:19:00.864698+0000","last_became_active":"2024-03-30T12:19:00.863991+0000","last_became_peered":"2024-03-30T12:19:00.863991+0000","last_unstale":"2024-03-30T12:19:00.864698+0000","last_undegraded":"2024-03-30T12:19:00.864698+0000","last_fullsized":"2024-03-30T12:19:00.864698+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:59:30.409530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.850642+0000","last_change":"2024-03-30T12:19:00.875226+0000","last_active":"2024-03-30T12:19:01.850642+0000","last_peered":"2024-03-30T12:19:01.850642+0000","last_clean":"2024-03-30T12:19:01.850642+0000","last_became_active":"2024-03-30T12:19:00.874620+0000","last_became_peered":"2024-03-30T12:19:00.874620+0000","last_unstale":"2024-03-30T12:19:01.850642+0000","last_undegraded":"2024-03-30T12:19:01.850642+0000","last_fullsized":"2024-03-30T12:19:01.850642+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:58:40.881840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.567011+0000","last_change":"2024-03-30T12:19:00.869363+0000","last_active":"2024-03-30T12:19:01.567011+0000","last_peered":"2024-03-30T12:19:01.567011+0000","last_clean":"2024-03-30T12:19:01.567011+0000","last_became_active":"2024-03-30T12:19:00.868887+0000","last_became_peered":"2024-03-30T12:19:00.868887+0000","last_unstale":"2024-03-30T12:19:01.567011+0000","last_undegraded":"2024-03-30T12:19:01.567011+0000","last_fullsized":"2024-03-30T12:19:01.567011+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:40:49.543161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.566999+0000","last_change":"2024-03-30T12:19:00.863992+0000","last_active":"2024-03-30T12:19:01.566999+0000","last_peered":"2024-03-30T12:19:01.566999+0000","last_clean":"2024-03-30T12:19:01.566999+0000","last_became_active":"2024-03-30T12:19:00.863683+0000","last_became_peered":"2024-03-30T12:19:00.863683+0000","last_unstale":"2024-03-30T12:19:01.566999+0000","last_undegraded":"2024-03-30T12:19:01.566999+0000","last_fullsized":"2024-03-30T12:19:01.566999+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:40:36.734391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:02.423234+0000","last_change":"2024-03-30T12:19:00.862541+0000","last_active":"2024-03-30T12:19:02.423234+0000","last_peered":"2024-03-30T12:19:02.423234+0000","last_clean":"2024-03-30T12:19:02.423234+0000","last_became_active":"2024-03-30T12:19:00.862084+0000","last_became_peered":"2024-03-30T12:19:00.862084+0000","last_unstale":"2024-03-30T12:19:02.423234+0000","last_undegraded":"2024-03-30T12:19:02.423234+0000","last_fullsized":"2024-03-30T12:19:02.423234+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:36.445232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.851016+0000","last_change":"2024-03-30T12:19:00.850148+0000","last_active":"2024-03-30T12:19:00.851016+0000","last_peered":"2024-03-30T12:19:00.851016+0000","last_clean":"2024-03-30T12:19:00.851016+0000","last_became_active":"2024-03-30T12:19:00.849849+0000","last_became_peered":"2024-03-30T12:19:00.849849+0000","last_unstale":"2024-03-30T12:19:00.851016+0000","last_undegraded":"2024-03-30T12:19:00.851016+0000","last_fullsized":"2024-03-30T12:19:00.851016+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:55:56.657057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847752+0000","last_change":"2024-03-30T12:19:00.865479+0000","last_active":"2024-03-30T12:19:01.847752+0000","last_peered":"2024-03-30T12:19:01.847752+0000","last_clean":"2024-03-30T12:19:01.847752+0000","last_became_active":"2024-03-30T12:19:00.864441+0000","last_became_peered":"2024-03-30T12:19:00.864441+0000","last_unstale":"2024-03-30T12:19:01.847752+0000","last_undegraded":"2024-03-30T12:19:01.847752+0000","last_fullsized":"2024-03-30T12:19:01.847752+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:45:55.344815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.792378+0000","last_change":"2024-03-30T12:19:00.866672+0000","last_active":"2024-03-30T12:19:01.792378+0000","last_peered":"2024-03-30T12:19:01.792378+0000","last_clean":"2024-03-30T12:19:01.792378+0000","last_became_active":"2024-03-30T12:19:00.866276+0000","last_became_peered":"2024-03-30T12:19:00.866276+0000","last_unstale":"2024-03-30T12:19:01.792378+0000","last_undegraded":"2024-03-30T12:19:01.792378+0000","last_fullsized":"2024-03-30T12:19:01.792378+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:23:49.856597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865488+0000","last_change":"2024-03-30T12:19:00.864760+0000","last_active":"2024-03-30T12:19:00.865488+0000","last_peered":"2024-03-30T12:19:00.865488+0000","last_clean":"2024-03-30T12:19:00.865488+0000","last_became_active":"2024-03-30T12:19:00.864447+0000","last_became_peered":"2024-03-30T12:19:00.864447+0000","last_unstale":"2024-03-30T12:19:00.865488+0000","last_undegraded":"2024-03-30T12:19:00.865488+0000","last_fullsized":"2024-03-30T12:19:00.865488+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:26:47.024806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865455+0000","last_change":"2024-03-30T12:19:00.863453+0000","last_active":"2024-03-30T12:19:00.865455+0000","last_peered":"2024-03-30T12:19:00.865455+0000","last_clean":"2024-03-30T12:19:00.865455+0000","last_became_active":"2024-03-30T12:19:00.863129+0000","last_became_peered":"2024-03-30T12:19:00.863129+0000","last_unstale":"2024-03-30T12:19:00.865455+0000","last_undegraded":"2024-03-30T12:19:00.865455+0000","last_fullsized":"2024-03-30T12:19:00.865455+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:19:33.658159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.854778+0000","last_change":"2024-03-30T12:19:00.854527+0000","last_active":"2024-03-30T12:19:00.854778+0000","last_peered":"2024-03-30T12:19:00.854778+0000","last_clean":"2024-03-30T12:19:00.854778+0000","last_became_active":"2024-03-30T12:19:00.854238+0000","last_became_peered":"2024-03-30T12:19:00.854238+0000","last_unstale":"2024-03-30T12:19:00.854778+0000","last_undegraded":"2024-03-30T12:19:00.854778+0000","last_fullsized":"2024-03-30T12:19:00.854778+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:50:54.069856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.850104+0000","last_change":"2024-03-30T12:19:00.854461+0000","last_active":"2024-03-30T12:19:01.850104+0000","last_peered":"2024-03-30T12:19:01.850104+0000","last_clean":"2024-03-30T12:19:01.850104+0000","last_became_active":"2024-03-30T12:19:00.854077+0000","last_became_peered":"2024-03-30T12:19:00.854077+0000","last_unstale":"2024-03-30T12:19:01.850104+0000","last_undegraded":"2024-03-30T12:19:01.850104+0000","last_fullsized":"2024-03-30T12:19:01.850104+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:24:10.940443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"61'4","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847950+0000","last_change":"2024-03-30T12:19:00.466957+0000","last_active":"2024-03-30T12:19:01.847950+0000","last_peered":"2024-03-30T12:19:01.847950+0000","last_clean":"2024-03-30T12:19:01.847950+0000","last_became_active":"2024-03-30T12:19:00.466689+0000","last_became_peered":"2024-03-30T12:19:00.466689+0000","last_unstale":"2024-03-30T12:19:01.847950+0000","last_undegraded":"2024-03-30T12:19:01.847950+0000","last_fullsized":"2024-03-30T12:19:01.847950+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:08.774258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.864660+0000","last_change":"2024-03-30T12:19:00.863714+0000","last_active":"2024-03-30T12:19:00.864660+0000","last_peered":"2024-03-30T12:19:00.864660+0000","last_clean":"2024-03-30T12:19:00.864660+0000","last_became_active":"2024-03-30T12:19:00.863429+0000","last_became_peered":"2024-03-30T12:19:00.863429+0000","last_unstale":"2024-03-30T12:19:00.864660+0000","last_undegraded":"2024-03-30T12:19:00.864660+0000","last_fullsized":"2024-03-30T12:19:00.864660+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:31.953173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.875165+0000","last_change":"2024-03-30T12:19:00.459693+0000","last_active":"2024-03-30T12:19:00.875165+0000","last_peered":"2024-03-30T12:19:00.875165+0000","last_clean":"2024-03-30T12:19:00.875165+0000","last_became_active":"2024-03-30T12:19:00.459409+0000","last_became_peered":"2024-03-30T12:19:00.459409+0000","last_unstale":"2024-03-30T12:19:00.875165+0000","last_undegraded":"2024-03-30T12:19:00.875165+0000","last_fullsized":"2024-03-30T12:19:00.875165+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:27.891375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847768+0000","last_change":"2024-03-30T12:19:00.864952+0000","last_active":"2024-03-30T12:19:01.847768+0000","last_peered":"2024-03-30T12:19:01.847768+0000","last_clean":"2024-03-30T12:19:01.847768+0000","last_became_active":"2024-03-30T12:19:00.864274+0000","last_became_peered":"2024-03-30T12:19:00.864274+0000","last_unstale":"2024-03-30T12:19:01.847768+0000","last_undegraded":"2024-03-30T12:19:01.847768+0000","last_fullsized":"2024-03-30T12:19:01.847768+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:45:00.775246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.850451+0000","last_change":"2024-03-30T12:19:00.469695+0000","last_active":"2024-03-30T12:19:01.850451+0000","last_peered":"2024-03-30T12:19:01.850451+0000","last_clean":"2024-03-30T12:19:01.850451+0000","last_became_active":"2024-03-30T12:19:00.469261+0000","last_became_peered":"2024-03-30T12:19:00.469261+0000","last_unstale":"2024-03-30T12:19:01.850451+0000","last_undegraded":"2024-03-30T12:19:01.850451+0000","last_fullsized":"2024-03-30T12:19:01.850451+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:02:43.407908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.860852+0000","last_change":"2024-03-30T12:19:00.859422+0000","last_active":"2024-03-30T12:19:00.860852+0000","last_peered":"2024-03-30T12:19:00.860852+0000","last_clean":"2024-03-30T12:19:00.860852+0000","last_became_active":"2024-03-30T12:19:00.858880+0000","last_became_peered":"2024-03-30T12:19:00.858880+0000","last_unstale":"2024-03-30T12:19:00.860852+0000","last_undegraded":"2024-03-30T12:19:00.860852+0000","last_fullsized":"2024-03-30T12:19:00.860852+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:09.612172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.850413+0000","last_change":"2024-03-30T12:19:00.467935+0000","last_active":"2024-03-30T12:19:01.850413+0000","last_peered":"2024-03-30T12:19:01.850413+0000","last_clean":"2024-03-30T12:19:01.850413+0000","last_became_active":"2024-03-30T12:19:00.467636+0000","last_became_peered":"2024-03-30T12:19:00.467636+0000","last_unstale":"2024-03-30T12:19:01.850413+0000","last_undegraded":"2024-03-30T12:19:01.850413+0000","last_fullsized":"2024-03-30T12:19:01.850413+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:49.599855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.860824+0000","last_change":"2024-03-30T12:19:00.859307+0000","last_active":"2024-03-30T12:19:00.860824+0000","last_peered":"2024-03-30T12:19:00.860824+0000","last_clean":"2024-03-30T12:19:00.860824+0000","last_became_active":"2024-03-30T12:19:00.858775+0000","last_became_peered":"2024-03-30T12:19:00.858775+0000","last_unstale":"2024-03-30T12:19:00.860824+0000","last_undegraded":"2024-03-30T12:19:00.860824+0000","last_fullsized":"2024-03-30T12:19:00.860824+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:30:39.349902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.874717+0000","last_change":"2024-03-30T12:19:00.454521+0000","last_active":"2024-03-30T12:19:00.874717+0000","last_peered":"2024-03-30T12:19:00.874717+0000","last_clean":"2024-03-30T12:19:00.874717+0000","last_became_active":"2024-03-30T12:19:00.454213+0000","last_became_peered":"2024-03-30T12:19:00.454213+0000","last_unstale":"2024-03-30T12:19:00.874717+0000","last_undegraded":"2024-03-30T12:19:00.874717+0000","last_fullsized":"2024-03-30T12:19:00.874717+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:27:47.198072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:02.422773+0000","last_change":"2024-03-30T12:19:00.860724+0000","last_active":"2024-03-30T12:19:02.422773+0000","last_peered":"2024-03-30T12:19:02.422773+0000","last_clean":"2024-03-30T12:19:02.422773+0000","last_became_active":"2024-03-30T12:19:00.860427+0000","last_became_peered":"2024-03-30T12:19:00.860427+0000","last_unstale":"2024-03-30T12:19:02.422773+0000","last_undegraded":"2024-03-30T12:19:02.422773+0000","last_fullsized":"2024-03-30T12:19:02.422773+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:55:54.757770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.566936+0000","last_change":"2024-03-30T12:19:00.460150+0000","last_active":"2024-03-30T12:19:01.566936+0000","last_peered":"2024-03-30T12:19:01.566936+0000","last_clean":"2024-03-30T12:19:01.566936+0000","last_became_active":"2024-03-30T12:19:00.459740+0000","last_became_peered":"2024-03-30T12:19:00.459740+0000","last_unstale":"2024-03-30T12:19:01.566936+0000","last_undegraded":"2024-03-30T12:19:01.566936+0000","last_fullsized":"2024-03-30T12:19:01.566936+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:52:40.523467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847884+0000","last_change":"2024-03-30T12:19:00.857403+0000","last_active":"2024-03-30T12:19:01.847884+0000","last_peered":"2024-03-30T12:19:01.847884+0000","last_clean":"2024-03-30T12:19:01.847884+0000","last_became_active":"2024-03-30T12:19:00.856652+0000","last_became_peered":"2024-03-30T12:19:00.856652+0000","last_unstale":"2024-03-30T12:19:01.847884+0000","last_undegraded":"2024-03-30T12:19:01.847884+0000","last_fullsized":"2024-03-30T12:19:01.847884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:51.932935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.839587+0000","last_change":"2024-03-30T12:19:00.458253+0000","last_active":"2024-03-30T12:19:00.839587+0000","last_peered":"2024-03-30T12:19:00.839587+0000","last_clean":"2024-03-30T12:19:00.839587+0000","last_became_active":"2024-03-30T12:19:00.457947+0000","last_became_peered":"2024-03-30T12:19:00.457947+0000","last_unstale":"2024-03-30T12:19:00.839587+0000","last_undegraded":"2024-03-30T12:19:00.839587+0000","last_fullsized":"2024-03-30T12:19:00.839587+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:13:18.864198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.859674+0000","last_change":"2024-03-30T12:19:00.859188+0000","last_active":"2024-03-30T12:19:00.859674+0000","last_peered":"2024-03-30T12:19:00.859674+0000","last_clean":"2024-03-30T12:19:00.859674+0000","last_became_active":"2024-03-30T12:19:00.858922+0000","last_became_peered":"2024-03-30T12:19:00.858922+0000","last_unstale":"2024-03-30T12:19:00.859674+0000","last_undegraded":"2024-03-30T12:19:00.859674+0000","last_fullsized":"2024-03-30T12:19:00.859674+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:56:16.965191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.841184+0000","last_change":"2024-03-30T12:19:00.466729+0000","last_active":"2024-03-30T12:19:00.841184+0000","last_peered":"2024-03-30T12:19:00.841184+0000","last_clean":"2024-03-30T12:19:00.841184+0000","last_became_active":"2024-03-30T12:19:00.466086+0000","last_became_peered":"2024-03-30T12:19:00.466086+0000","last_unstale":"2024-03-30T12:19:00.841184+0000","last_undegraded":"2024-03-30T12:19:00.841184+0000","last_fullsized":"2024-03-30T12:19:00.841184+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:46:14.144417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.792424+0000","last_change":"2024-03-30T12:19:00.863262+0000","last_active":"2024-03-30T12:19:01.792424+0000","last_peered":"2024-03-30T12:19:01.792424+0000","last_clean":"2024-03-30T12:19:01.792424+0000","last_became_active":"2024-03-30T12:19:00.861328+0000","last_became_peered":"2024-03-30T12:19:00.861328+0000","last_unstale":"2024-03-30T12:19:01.792424+0000","last_undegraded":"2024-03-30T12:19:01.792424+0000","last_fullsized":"2024-03-30T12:19:01.792424+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:20:19.049967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.567045+0000","last_change":"2024-03-30T12:19:00.459929+0000","last_active":"2024-03-30T12:19:01.567045+0000","last_peered":"2024-03-30T12:19:01.567045+0000","last_clean":"2024-03-30T12:19:01.567045+0000","last_became_active":"2024-03-30T12:19:00.459518+0000","last_became_peered":"2024-03-30T12:19:00.459518+0000","last_unstale":"2024-03-30T12:19:01.567045+0000","last_undegraded":"2024-03-30T12:19:01.567045+0000","last_fullsized":"2024-03-30T12:19:01.567045+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:09:03.990119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865447+0000","last_change":"2024-03-30T12:19:00.862112+0000","last_active":"2024-03-30T12:19:00.865447+0000","last_peered":"2024-03-30T12:19:00.865447+0000","last_clean":"2024-03-30T12:19:00.865447+0000","last_became_active":"2024-03-30T12:19:00.861782+0000","last_became_peered":"2024-03-30T12:19:00.861782+0000","last_unstale":"2024-03-30T12:19:00.865447+0000","last_undegraded":"2024-03-30T12:19:00.865447+0000","last_fullsized":"2024-03-30T12:19:00.865447+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:01:42.946530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.840300+0000","last_change":"2024-03-30T12:19:00.463745+0000","last_active":"2024-03-30T12:19:00.840300+0000","last_peered":"2024-03-30T12:19:00.840300+0000","last_clean":"2024-03-30T12:19:00.840300+0000","last_became_active":"2024-03-30T12:19:00.462698+0000","last_became_peered":"2024-03-30T12:19:00.462698+0000","last_unstale":"2024-03-30T12:19:00.840300+0000","last_undegraded":"2024-03-30T12:19:00.840300+0000","last_fullsized":"2024-03-30T12:19:00.840300+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:09:33.196928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847685+0000","last_change":"2024-03-30T12:19:00.865197+0000","last_active":"2024-03-30T12:19:01.847685+0000","last_peered":"2024-03-30T12:19:01.847685+0000","last_clean":"2024-03-30T12:19:01.847685+0000","last_became_active":"2024-03-30T12:19:00.864718+0000","last_became_peered":"2024-03-30T12:19:00.864718+0000","last_unstale":"2024-03-30T12:19:01.847685+0000","last_undegraded":"2024-03-30T12:19:01.847685+0000","last_fullsized":"2024-03-30T12:19:01.847685+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:33:34.137353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.792493+0000","last_change":"2024-03-30T12:19:00.463581+0000","last_active":"2024-03-30T12:19:01.792493+0000","last_peered":"2024-03-30T12:19:01.792493+0000","last_clean":"2024-03-30T12:19:01.792493+0000","last_became_active":"2024-03-30T12:19:00.463280+0000","last_became_peered":"2024-03-30T12:19:00.463280+0000","last_unstale":"2024-03-30T12:19:01.792493+0000","last_undegraded":"2024-03-30T12:19:01.792493+0000","last_fullsized":"2024-03-30T12:19:01.792493+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:38:07.390655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:02.423086+0000","last_change":"2024-03-30T12:19:00.878541+0000","last_active":"2024-03-30T12:19:02.423086+0000","last_peered":"2024-03-30T12:19:02.423086+0000","last_clean":"2024-03-30T12:19:02.423086+0000","last_became_active":"2024-03-30T12:19:00.878229+0000","last_became_peered":"2024-03-30T12:19:00.878229+0000","last_unstale":"2024-03-30T12:19:02.423086+0000","last_undegraded":"2024-03-30T12:19:02.423086+0000","last_fullsized":"2024-03-30T12:19:02.423086+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:03:18.020146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"61'6","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.566952+0000","last_change":"2024-03-30T12:19:00.458102+0000","last_active":"2024-03-30T12:19:01.566952+0000","last_peered":"2024-03-30T12:19:01.566952+0000","last_clean":"2024-03-30T12:19:01.566952+0000","last_became_active":"2024-03-30T12:19:00.457759+0000","last_became_peered":"2024-03-30T12:19:00.457759+0000","last_unstale":"2024-03-30T12:19:01.566952+0000","last_undegraded":"2024-03-30T12:19:01.566952+0000","last_fullsized":"2024-03-30T12:19:01.566952+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:31.713303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.850384+0000","last_change":"2024-03-30T12:19:00.872384+0000","last_active":"2024-03-30T12:19:01.850384+0000","last_peered":"2024-03-30T12:19:01.850384+0000","last_clean":"2024-03-30T12:19:01.850384+0000","last_became_active":"2024-03-30T12:19:00.872085+0000","last_became_peered":"2024-03-30T12:19:00.872085+0000","last_unstale":"2024-03-30T12:19:01.850384+0000","last_undegraded":"2024-03-30T12:19:01.850384+0000","last_fullsized":"2024-03-30T12:19:01.850384+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:47:42.278500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847868+0000","last_change":"2024-03-30T12:19:00.462939+0000","last_active":"2024-03-30T12:19:01.847868+0000","last_peered":"2024-03-30T12:19:01.847868+0000","last_clean":"2024-03-30T12:19:01.847868+0000","last_became_active":"2024-03-30T12:19:00.462637+0000","last_became_peered":"2024-03-30T12:19:00.462637+0000","last_unstale":"2024-03-30T12:19:01.847868+0000","last_undegraded":"2024-03-30T12:19:01.847868+0000","last_fullsized":"2024-03-30T12:19:01.847868+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:48:59.027106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847660+0000","last_change":"2024-03-30T12:19:00.856865+0000","last_active":"2024-03-30T12:19:01.847660+0000","last_peered":"2024-03-30T12:19:01.847660+0000","last_clean":"2024-03-30T12:19:01.847660+0000","last_became_active":"2024-03-30T12:19:00.856544+0000","last_became_peered":"2024-03-30T12:19:00.856544+0000","last_unstale":"2024-03-30T12:19:01.847660+0000","last_undegraded":"2024-03-30T12:19:01.847660+0000","last_fullsized":"2024-03-30T12:19:01.847660+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:37:39.901012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.841547+0000","last_change":"2024-03-30T12:19:00.465931+0000","last_active":"2024-03-30T12:19:00.841547+0000","last_peered":"2024-03-30T12:19:00.841547+0000","last_clean":"2024-03-30T12:19:00.841547+0000","last_became_active":"2024-03-30T12:19:00.465589+0000","last_became_peered":"2024-03-30T12:19:00.465589+0000","last_unstale":"2024-03-30T12:19:00.841547+0000","last_undegraded":"2024-03-30T12:19:00.841547+0000","last_fullsized":"2024-03-30T12:19:00.841547+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:02:38.614924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.850173+0000","last_change":"2024-03-30T12:19:00.870798+0000","last_active":"2024-03-30T12:19:01.850173+0000","last_peered":"2024-03-30T12:19:01.850173+0000","last_clean":"2024-03-30T12:19:01.850173+0000","last_became_active":"2024-03-30T12:19:00.870507+0000","last_became_peered":"2024-03-30T12:19:00.870507+0000","last_unstale":"2024-03-30T12:19:01.850173+0000","last_undegraded":"2024-03-30T12:19:01.850173+0000","last_fullsized":"2024-03-30T12:19:01.850173+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:25:30.259298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.566910+0000","last_change":"2024-03-30T12:19:00.454678+0000","last_active":"2024-03-30T12:19:01.566910+0000","last_peered":"2024-03-30T12:19:01.566910+0000","last_clean":"2024-03-30T12:19:01.566910+0000","last_became_active":"2024-03-30T12:19:00.454380+0000","last_became_peered":"2024-03-30T12:19:00.454380+0000","last_unstale":"2024-03-30T12:19:01.566910+0000","last_undegraded":"2024-03-30T12:19:01.566910+0000","last_fullsized":"2024-03-30T12:19:01.566910+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:08:24.640327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.566896+0000","last_change":"2024-03-30T12:19:00.861547+0000","last_active":"2024-03-30T12:19:01.566896+0000","last_peered":"2024-03-30T12:19:01.566896+0000","last_clean":"2024-03-30T12:19:01.566896+0000","last_became_active":"2024-03-30T12:19:00.861268+0000","last_became_peered":"2024-03-30T12:19:00.861268+0000","last_unstale":"2024-03-30T12:19:01.566896+0000","last_undegraded":"2024-03-30T12:19:01.566896+0000","last_fullsized":"2024-03-30T12:19:01.566896+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:28:37.342309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.873715+0000","last_change":"2024-03-30T12:19:00.460090+0000","last_active":"2024-03-30T12:19:00.873715+0000","last_peered":"2024-03-30T12:19:00.873715+0000","last_clean":"2024-03-30T12:19:00.873715+0000","last_became_active":"2024-03-30T12:19:00.459790+0000","last_became_peered":"2024-03-30T12:19:00.459790+0000","last_unstale":"2024-03-30T12:19:00.873715+0000","last_undegraded":"2024-03-30T12:19:00.873715+0000","last_fullsized":"2024-03-30T12:19:00.873715+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:38.860631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.850041+0000","last_change":"2024-03-30T12:19:00.870061+0000","last_active":"2024-03-30T12:19:01.850041+0000","last_peered":"2024-03-30T12:19:01.850041+0000","last_clean":"2024-03-30T12:19:01.850041+0000","last_became_active":"2024-03-30T12:19:00.869750+0000","last_became_peered":"2024-03-30T12:19:00.869750+0000","last_unstale":"2024-03-30T12:19:01.850041+0000","last_undegraded":"2024-03-30T12:19:01.850041+0000","last_fullsized":"2024-03-30T12:19:01.850041+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:03:02.790151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"61'1","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:02.423313+0000","last_change":"2024-03-30T12:19:00.461178+0000","last_active":"2024-03-30T12:19:02.423313+0000","last_peered":"2024-03-30T12:19:02.423313+0000","last_clean":"2024-03-30T12:19:02.423313+0000","last_became_active":"2024-03-30T12:19:00.460817+0000","last_became_peered":"2024-03-30T12:19:00.460817+0000","last_unstale":"2024-03-30T12:19:02.423313+0000","last_undegraded":"2024-03-30T12:19:02.423313+0000","last_fullsized":"2024-03-30T12:19:02.423313+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:30:59.255694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.850472+0000","last_change":"2024-03-30T12:19:00.871828+0000","last_active":"2024-03-30T12:19:01.850472+0000","last_peered":"2024-03-30T12:19:01.850472+0000","last_clean":"2024-03-30T12:19:01.850472+0000","last_became_active":"2024-03-30T12:19:00.871555+0000","last_became_peered":"2024-03-30T12:19:00.871555+0000","last_unstale":"2024-03-30T12:19:01.850472+0000","last_undegraded":"2024-03-30T12:19:01.850472+0000","last_fullsized":"2024-03-30T12:19:01.850472+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:02:53.212521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.792450+0000","last_change":"2024-03-30T12:19:00.462709+0000","last_active":"2024-03-30T12:19:01.792450+0000","last_peered":"2024-03-30T12:19:01.792450+0000","last_clean":"2024-03-30T12:19:01.792450+0000","last_became_active":"2024-03-30T12:19:00.462429+0000","last_became_peered":"2024-03-30T12:19:00.462429+0000","last_unstale":"2024-03-30T12:19:01.792450+0000","last_undegraded":"2024-03-30T12:19:01.792450+0000","last_fullsized":"2024-03-30T12:19:01.792450+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:29.579526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.855986+0000","last_change":"2024-03-30T12:19:00.854025+0000","last_active":"2024-03-30T12:19:00.855986+0000","last_peered":"2024-03-30T12:19:00.855986+0000","last_clean":"2024-03-30T12:19:00.855986+0000","last_became_active":"2024-03-30T12:19:00.853714+0000","last_became_peered":"2024-03-30T12:19:00.853714+0000","last_unstale":"2024-03-30T12:19:00.855986+0000","last_undegraded":"2024-03-30T12:19:00.855986+0000","last_fullsized":"2024-03-30T12:19:00.855986+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:27:34.498087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.840118+0000","last_change":"2024-03-30T12:19:00.457612+0000","last_active":"2024-03-30T12:19:00.840118+0000","last_peered":"2024-03-30T12:19:00.840118+0000","last_clean":"2024-03-30T12:19:00.840118+0000","last_became_active":"2024-03-30T12:19:00.457289+0000","last_became_peered":"2024-03-30T12:19:00.457289+0000","last_unstale":"2024-03-30T12:19:00.840118+0000","last_undegraded":"2024-03-30T12:19:00.840118+0000","last_fullsized":"2024-03-30T12:19:00.840118+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:23.011997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:02.423303+0000","last_change":"2024-03-30T12:19:00.866070+0000","last_active":"2024-03-30T12:19:02.423303+0000","last_peered":"2024-03-30T12:19:02.423303+0000","last_clean":"2024-03-30T12:19:02.423303+0000","last_became_active":"2024-03-30T12:19:00.865706+0000","last_became_peered":"2024-03-30T12:19:00.865706+0000","last_unstale":"2024-03-30T12:19:02.423303+0000","last_undegraded":"2024-03-30T12:19:02.423303+0000","last_fullsized":"2024-03-30T12:19:02.423303+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:56:01.599580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.792356+0000","last_change":"2024-03-30T12:19:00.861917+0000","last_active":"2024-03-30T12:19:01.792356+0000","last_peered":"2024-03-30T12:19:01.792356+0000","last_clean":"2024-03-30T12:19:01.792356+0000","last_became_active":"2024-03-30T12:19:00.860645+0000","last_became_peered":"2024-03-30T12:19:00.860645+0000","last_unstale":"2024-03-30T12:19:01.792356+0000","last_undegraded":"2024-03-30T12:19:01.792356+0000","last_fullsized":"2024-03-30T12:19:01.792356+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:30:51.438018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.842009+0000","last_change":"2024-03-30T12:19:00.459145+0000","last_active":"2024-03-30T12:19:00.842009+0000","last_peered":"2024-03-30T12:19:00.842009+0000","last_clean":"2024-03-30T12:19:00.842009+0000","last_became_active":"2024-03-30T12:19:00.457819+0000","last_became_peered":"2024-03-30T12:19:00.457819+0000","last_unstale":"2024-03-30T12:19:00.842009+0000","last_undegraded":"2024-03-30T12:19:00.842009+0000","last_fullsized":"2024-03-30T12:19:00.842009+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:44:38.245366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.862978+0000","last_change":"2024-03-30T12:19:00.862340+0000","last_active":"2024-03-30T12:19:00.862978+0000","last_peered":"2024-03-30T12:19:00.862978+0000","last_clean":"2024-03-30T12:19:00.862978+0000","last_became_active":"2024-03-30T12:19:00.861413+0000","last_became_peered":"2024-03-30T12:19:00.861413+0000","last_unstale":"2024-03-30T12:19:00.862978+0000","last_undegraded":"2024-03-30T12:19:00.862978+0000","last_fullsized":"2024-03-30T12:19:00.862978+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:13:39.199499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.841612+0000","last_change":"2024-03-30T12:19:00.465946+0000","last_active":"2024-03-30T12:19:00.841612+0000","last_peered":"2024-03-30T12:19:00.841612+0000","last_clean":"2024-03-30T12:19:00.841612+0000","last_became_active":"2024-03-30T12:19:00.465618+0000","last_became_peered":"2024-03-30T12:19:00.465618+0000","last_unstale":"2024-03-30T12:19:00.841612+0000","last_undegraded":"2024-03-30T12:19:00.841612+0000","last_fullsized":"2024-03-30T12:19:00.841612+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:58:42.109572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"22'117","reported_seq":220,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.846876+0000","last_change":"2024-03-30T12:18:45.912869+0000","last_active":"2024-03-30T12:19:00.846876+0000","last_peered":"2024-03-30T12:19:00.846876+0000","last_clean":"2024-03-30T12:19:00.846876+0000","last_became_active":"2024-03-30T12:18:45.912395+0000","last_became_peered":"2024-03-30T12:18:45.912395+0000","last_unstale":"2024-03-30T12:19:00.846876+0000","last_undegraded":"2024-03-30T12:19:00.846876+0000","last_fullsized":"2024-03-30T12:19:00.846876+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:34.485283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847236+0000","last_change":"2024-03-30T12:19:00.852506+0000","last_active":"2024-03-30T12:19:01.847236+0000","last_peered":"2024-03-30T12:19:01.847236+0000","last_clean":"2024-03-30T12:19:01.847236+0000","last_became_active":"2024-03-30T12:19:00.852216+0000","last_became_peered":"2024-03-30T12:19:00.852216+0000","last_unstale":"2024-03-30T12:19:01.847236+0000","last_undegraded":"2024-03-30T12:19:01.847236+0000","last_fullsized":"2024-03-30T12:19:01.847236+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:41:21.462303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.849939+0000","last_change":"2024-03-30T12:19:00.470266+0000","last_active":"2024-03-30T12:19:01.849939+0000","last_peered":"2024-03-30T12:19:01.849939+0000","last_clean":"2024-03-30T12:19:01.849939+0000","last_became_active":"2024-03-30T12:19:00.469541+0000","last_became_peered":"2024-03-30T12:19:00.469541+0000","last_unstale":"2024-03-30T12:19:01.849939+0000","last_undegraded":"2024-03-30T12:19:01.849939+0000","last_fullsized":"2024-03-30T12:19:01.849939+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:57.244620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.850348+0000","last_change":"2024-03-30T12:19:00.469567+0000","last_active":"2024-03-30T12:19:01.850348+0000","last_peered":"2024-03-30T12:19:01.850348+0000","last_clean":"2024-03-30T12:19:01.850348+0000","last_became_active":"2024-03-30T12:19:00.469218+0000","last_became_peered":"2024-03-30T12:19:00.469218+0000","last_unstale":"2024-03-30T12:19:01.850348+0000","last_undegraded":"2024-03-30T12:19:01.850348+0000","last_fullsized":"2024-03-30T12:19:01.850348+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:16:05.609865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.792461+0000","last_change":"2024-03-30T12:19:00.865798+0000","last_active":"2024-03-30T12:19:01.792461+0000","last_peered":"2024-03-30T12:19:01.792461+0000","last_clean":"2024-03-30T12:19:01.792461+0000","last_became_active":"2024-03-30T12:19:00.865518+0000","last_became_peered":"2024-03-30T12:19:00.865518+0000","last_unstale":"2024-03-30T12:19:01.792461+0000","last_undegraded":"2024-03-30T12:19:01.792461+0000","last_fullsized":"2024-03-30T12:19:01.792461+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:47:41.818140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"62'1","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:03.666520+0000","last_change":"2024-03-30T12:19:00.454554+0000","last_active":"2024-03-30T12:19:03.666520+0000","last_peered":"2024-03-30T12:19:03.666520+0000","last_clean":"2024-03-30T12:19:03.666520+0000","last_became_active":"2024-03-30T12:19:00.454233+0000","last_became_peered":"2024-03-30T12:19:00.454233+0000","last_unstale":"2024-03-30T12:19:03.666520+0000","last_undegraded":"2024-03-30T12:19:03.666520+0000","last_fullsized":"2024-03-30T12:19:03.666520+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:05:09.010127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.856179+0000","last_change":"2024-03-30T12:19:00.853806+0000","last_active":"2024-03-30T12:19:00.856179+0000","last_peered":"2024-03-30T12:19:00.856179+0000","last_clean":"2024-03-30T12:19:00.856179+0000","last_became_active":"2024-03-30T12:19:00.853538+0000","last_became_peered":"2024-03-30T12:19:00.853538+0000","last_unstale":"2024-03-30T12:19:00.856179+0000","last_undegraded":"2024-03-30T12:19:00.856179+0000","last_fullsized":"2024-03-30T12:19:00.856179+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:36:10.741436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.567034+0000","last_change":"2024-03-30T12:19:00.460279+0000","last_active":"2024-03-30T12:19:01.567034+0000","last_peered":"2024-03-30T12:19:01.567034+0000","last_clean":"2024-03-30T12:19:01.567034+0000","last_became_active":"2024-03-30T12:19:00.459948+0000","last_became_peered":"2024-03-30T12:19:00.459948+0000","last_unstale":"2024-03-30T12:19:01.567034+0000","last_undegraded":"2024-03-30T12:19:01.567034+0000","last_fullsized":"2024-03-30T12:19:01.567034+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:06.870147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847496+0000","last_change":"2024-03-30T12:19:00.853029+0000","last_active":"2024-03-30T12:19:01.847496+0000","last_peered":"2024-03-30T12:19:01.847496+0000","last_clean":"2024-03-30T12:19:01.847496+0000","last_became_active":"2024-03-30T12:19:00.852755+0000","last_became_peered":"2024-03-30T12:19:00.852755+0000","last_unstale":"2024-03-30T12:19:01.847496+0000","last_undegraded":"2024-03-30T12:19:01.847496+0000","last_fullsized":"2024-03-30T12:19:01.847496+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:03:44.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.849764+0000","last_change":"2024-03-30T12:19:00.470521+0000","last_active":"2024-03-30T12:19:01.849764+0000","last_peered":"2024-03-30T12:19:01.849764+0000","last_clean":"2024-03-30T12:19:01.849764+0000","last_became_active":"2024-03-30T12:19:00.469910+0000","last_became_peered":"2024-03-30T12:19:00.469910+0000","last_unstale":"2024-03-30T12:19:01.849764+0000","last_undegraded":"2024-03-30T12:19:01.849764+0000","last_fullsized":"2024-03-30T12:19:01.849764+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:12:52.044394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:02.422885+0000","last_change":"2024-03-30T12:19:00.877240+0000","last_active":"2024-03-30T12:19:02.422885+0000","last_peered":"2024-03-30T12:19:02.422885+0000","last_clean":"2024-03-30T12:19:02.422885+0000","last_became_active":"2024-03-30T12:19:00.876739+0000","last_became_peered":"2024-03-30T12:19:00.876739+0000","last_unstale":"2024-03-30T12:19:02.422885+0000","last_undegraded":"2024-03-30T12:19:02.422885+0000","last_fullsized":"2024-03-30T12:19:02.422885+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:25.328486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.792407+0000","last_change":"2024-03-30T12:19:00.459528+0000","last_active":"2024-03-30T12:19:01.792407+0000","last_peered":"2024-03-30T12:19:01.792407+0000","last_clean":"2024-03-30T12:19:01.792407+0000","last_became_active":"2024-03-30T12:19:00.459223+0000","last_became_peered":"2024-03-30T12:19:00.459223+0000","last_unstale":"2024-03-30T12:19:01.792407+0000","last_undegraded":"2024-03-30T12:19:01.792407+0000","last_fullsized":"2024-03-30T12:19:01.792407+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:44.399783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.851137+0000","last_change":"2024-03-30T12:19:00.850810+0000","last_active":"2024-03-30T12:19:00.851137+0000","last_peered":"2024-03-30T12:19:00.851137+0000","last_clean":"2024-03-30T12:19:00.851137+0000","last_became_active":"2024-03-30T12:19:00.850530+0000","last_became_peered":"2024-03-30T12:19:00.850530+0000","last_unstale":"2024-03-30T12:19:00.851137+0000","last_undegraded":"2024-03-30T12:19:00.851137+0000","last_fullsized":"2024-03-30T12:19:00.851137+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:52:32.869322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.792440+0000","last_change":"2024-03-30T12:19:00.460526+0000","last_active":"2024-03-30T12:19:01.792440+0000","last_peered":"2024-03-30T12:19:01.792440+0000","last_clean":"2024-03-30T12:19:01.792440+0000","last_became_active":"2024-03-30T12:19:00.460018+0000","last_became_peered":"2024-03-30T12:19:00.460018+0000","last_unstale":"2024-03-30T12:19:01.792440+0000","last_undegraded":"2024-03-30T12:19:01.792440+0000","last_fullsized":"2024-03-30T12:19:01.792440+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:33:30.671209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.859086+0000","last_change":"2024-03-30T12:19:00.858733+0000","last_active":"2024-03-30T12:19:00.859086+0000","last_peered":"2024-03-30T12:19:00.859086+0000","last_clean":"2024-03-30T12:19:00.859086+0000","last_became_active":"2024-03-30T12:19:00.858419+0000","last_became_peered":"2024-03-30T12:19:00.858419+0000","last_unstale":"2024-03-30T12:19:00.859086+0000","last_undegraded":"2024-03-30T12:19:00.859086+0000","last_fullsized":"2024-03-30T12:19:00.859086+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:43.731796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"61'2","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.850075+0000","last_change":"2024-03-30T12:19:00.468017+0000","last_active":"2024-03-30T12:19:01.850075+0000","last_peered":"2024-03-30T12:19:01.850075+0000","last_clean":"2024-03-30T12:19:01.850075+0000","last_became_active":"2024-03-30T12:19:00.466979+0000","last_became_peered":"2024-03-30T12:19:00.466979+0000","last_unstale":"2024-03-30T12:19:01.850075+0000","last_undegraded":"2024-03-30T12:19:01.850075+0000","last_fullsized":"2024-03-30T12:19:01.850075+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:41:36.480109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.566924+0000","last_change":"2024-03-30T12:19:00.869001+0000","last_active":"2024-03-30T12:19:01.566924+0000","last_peered":"2024-03-30T12:19:01.566924+0000","last_clean":"2024-03-30T12:19:01.566924+0000","last_became_active":"2024-03-30T12:19:00.868645+0000","last_became_peered":"2024-03-30T12:19:00.868645+0000","last_unstale":"2024-03-30T12:19:01.566924+0000","last_undegraded":"2024-03-30T12:19:01.566924+0000","last_fullsized":"2024-03-30T12:19:01.566924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:54:10.778279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.842782+0000","last_change":"2024-03-30T12:19:00.459171+0000","last_active":"2024-03-30T12:19:00.842782+0000","last_peered":"2024-03-30T12:19:00.842782+0000","last_clean":"2024-03-30T12:19:00.842782+0000","last_became_active":"2024-03-30T12:19:00.458925+0000","last_became_peered":"2024-03-30T12:19:00.458925+0000","last_unstale":"2024-03-30T12:19:00.842782+0000","last_undegraded":"2024-03-30T12:19:00.842782+0000","last_fullsized":"2024-03-30T12:19:00.842782+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:26:20.974369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.850248+0000","last_change":"2024-03-30T12:19:00.875558+0000","last_active":"2024-03-30T12:19:01.850248+0000","last_peered":"2024-03-30T12:19:01.850248+0000","last_clean":"2024-03-30T12:19:01.850248+0000","last_became_active":"2024-03-30T12:19:00.875216+0000","last_became_peered":"2024-03-30T12:19:00.875216+0000","last_unstale":"2024-03-30T12:19:01.850248+0000","last_undegraded":"2024-03-30T12:19:01.850248+0000","last_fullsized":"2024-03-30T12:19:01.850248+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:27:04.763910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.792481+0000","last_change":"2024-03-30T12:19:00.459545+0000","last_active":"2024-03-30T12:19:01.792481+0000","last_peered":"2024-03-30T12:19:01.792481+0000","last_clean":"2024-03-30T12:19:01.792481+0000","last_became_active":"2024-03-30T12:19:00.459250+0000","last_became_peered":"2024-03-30T12:19:00.459250+0000","last_unstale":"2024-03-30T12:19:01.792481+0000","last_undegraded":"2024-03-30T12:19:01.792481+0000","last_fullsized":"2024-03-30T12:19:01.792481+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:38.112815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.853251+0000","last_change":"2024-03-30T12:19:00.852558+0000","last_active":"2024-03-30T12:19:00.853251+0000","last_peered":"2024-03-30T12:19:00.853251+0000","last_clean":"2024-03-30T12:19:00.853251+0000","last_became_active":"2024-03-30T12:19:00.852250+0000","last_became_peered":"2024-03-30T12:19:00.852250+0000","last_unstale":"2024-03-30T12:19:00.853251+0000","last_undegraded":"2024-03-30T12:19:00.853251+0000","last_fullsized":"2024-03-30T12:19:00.853251+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:57:15.989801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"61'2","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.879619+0000","last_change":"2024-03-30T12:19:00.464968+0000","last_active":"2024-03-30T12:19:00.879619+0000","last_peered":"2024-03-30T12:19:00.879619+0000","last_clean":"2024-03-30T12:19:00.879619+0000","last_became_active":"2024-03-30T12:19:00.464021+0000","last_became_peered":"2024-03-30T12:19:00.464021+0000","last_unstale":"2024-03-30T12:19:00.879619+0000","last_undegraded":"2024-03-30T12:19:00.879619+0000","last_fullsized":"2024-03-30T12:19:00.879619+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:20.224884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.850568+0000","last_change":"2024-03-30T12:19:00.871645+0000","last_active":"2024-03-30T12:19:01.850568+0000","last_peered":"2024-03-30T12:19:01.850568+0000","last_clean":"2024-03-30T12:19:01.850568+0000","last_became_active":"2024-03-30T12:19:00.871376+0000","last_became_peered":"2024-03-30T12:19:00.871376+0000","last_unstale":"2024-03-30T12:19:01.850568+0000","last_undegraded":"2024-03-30T12:19:01.850568+0000","last_fullsized":"2024-03-30T12:19:01.850568+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:54:57.281972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.566878+0000","last_change":"2024-03-30T12:19:00.862859+0000","last_active":"2024-03-30T12:19:01.566878+0000","last_peered":"2024-03-30T12:19:01.566878+0000","last_clean":"2024-03-30T12:19:01.566878+0000","last_became_active":"2024-03-30T12:19:00.862535+0000","last_became_peered":"2024-03-30T12:19:00.862535+0000","last_unstale":"2024-03-30T12:19:01.566878+0000","last_undegraded":"2024-03-30T12:19:01.566878+0000","last_fullsized":"2024-03-30T12:19:01.566878+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:17:31.462763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865528+0000","last_change":"2024-03-30T12:19:00.862947+0000","last_active":"2024-03-30T12:19:00.865528+0000","last_peered":"2024-03-30T12:19:00.865528+0000","last_clean":"2024-03-30T12:19:00.865528+0000","last_became_active":"2024-03-30T12:19:00.862567+0000","last_became_peered":"2024-03-30T12:19:00.862567+0000","last_unstale":"2024-03-30T12:19:00.865528+0000","last_undegraded":"2024-03-30T12:19:00.865528+0000","last_fullsized":"2024-03-30T12:19:00.865528+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:55:05.422370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.857994+0000","last_change":"2024-03-30T12:19:00.856869+0000","last_active":"2024-03-30T12:19:00.857994+0000","last_peered":"2024-03-30T12:19:00.857994+0000","last_clean":"2024-03-30T12:19:00.857994+0000","last_became_active":"2024-03-30T12:19:00.856525+0000","last_became_peered":"2024-03-30T12:19:00.856525+0000","last_unstale":"2024-03-30T12:19:00.857994+0000","last_undegraded":"2024-03-30T12:19:00.857994+0000","last_fullsized":"2024-03-30T12:19:00.857994+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:01:47.443294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847804+0000","last_change":"2024-03-30T12:19:00.859724+0000","last_active":"2024-03-30T12:19:01.847804+0000","last_peered":"2024-03-30T12:19:01.847804+0000","last_clean":"2024-03-30T12:19:01.847804+0000","last_became_active":"2024-03-30T12:19:00.859327+0000","last_became_peered":"2024-03-30T12:19:00.859327+0000","last_unstale":"2024-03-30T12:19:01.847804+0000","last_undegraded":"2024-03-30T12:19:01.847804+0000","last_fullsized":"2024-03-30T12:19:01.847804+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:53:15.692683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.858522+0000","last_change":"2024-03-30T12:19:00.857483+0000","last_active":"2024-03-30T12:19:00.858522+0000","last_peered":"2024-03-30T12:19:00.858522+0000","last_clean":"2024-03-30T12:19:00.858522+0000","last_became_active":"2024-03-30T12:19:00.857117+0000","last_became_peered":"2024-03-30T12:19:00.857117+0000","last_unstale":"2024-03-30T12:19:00.858522+0000","last_undegraded":"2024-03-30T12:19:00.858522+0000","last_fullsized":"2024-03-30T12:19:00.858522+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:42.644771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.792471+0000","last_change":"2024-03-30T12:19:00.848297+0000","last_active":"2024-03-30T12:19:01.792471+0000","last_peered":"2024-03-30T12:19:01.792471+0000","last_clean":"2024-03-30T12:19:01.792471+0000","last_became_active":"2024-03-30T12:19:00.848029+0000","last_became_peered":"2024-03-30T12:19:00.848029+0000","last_unstale":"2024-03-30T12:19:01.792471+0000","last_undegraded":"2024-03-30T12:19:01.792471+0000","last_fullsized":"2024-03-30T12:19:01.792471+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:38.617413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.567024+0000","last_change":"2024-03-30T12:19:00.869414+0000","last_active":"2024-03-30T12:19:01.567024+0000","last_peered":"2024-03-30T12:19:01.567024+0000","last_clean":"2024-03-30T12:19:01.567024+0000","last_became_active":"2024-03-30T12:19:00.869115+0000","last_became_peered":"2024-03-30T12:19:00.869115+0000","last_unstale":"2024-03-30T12:19:01.567024+0000","last_undegraded":"2024-03-30T12:19:01.567024+0000","last_fullsized":"2024-03-30T12:19:01.567024+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:01:12.173692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.856417+0000","last_change":"2024-03-30T12:19:00.856088+0000","last_active":"2024-03-30T12:19:00.856417+0000","last_peered":"2024-03-30T12:19:00.856417+0000","last_clean":"2024-03-30T12:19:00.856417+0000","last_became_active":"2024-03-30T12:19:00.855480+0000","last_became_peered":"2024-03-30T12:19:00.855480+0000","last_unstale":"2024-03-30T12:19:00.856417+0000","last_undegraded":"2024-03-30T12:19:00.856417+0000","last_fullsized":"2024-03-30T12:19:00.856417+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:21:16.961559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.856024+0000","last_change":"2024-03-30T12:19:00.854668+0000","last_active":"2024-03-30T12:19:00.856024+0000","last_peered":"2024-03-30T12:19:00.856024+0000","last_clean":"2024-03-30T12:19:00.856024+0000","last_became_active":"2024-03-30T12:19:00.854390+0000","last_became_peered":"2024-03-30T12:19:00.854390+0000","last_unstale":"2024-03-30T12:19:00.856024+0000","last_undegraded":"2024-03-30T12:19:00.856024+0000","last_fullsized":"2024-03-30T12:19:00.856024+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:39:22.128098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.851786+0000","last_change":"2024-03-30T12:19:00.851282+0000","last_active":"2024-03-30T12:19:00.851786+0000","last_peered":"2024-03-30T12:19:00.851786+0000","last_clean":"2024-03-30T12:19:00.851786+0000","last_became_active":"2024-03-30T12:19:00.850915+0000","last_became_peered":"2024-03-30T12:19:00.850915+0000","last_unstale":"2024-03-30T12:19:00.851786+0000","last_undegraded":"2024-03-30T12:19:00.851786+0000","last_fullsized":"2024-03-30T12:19:00.851786+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:46:50.526568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:00.865165+0000","last_change":"2024-03-30T12:19:00.860406+0000","last_active":"2024-03-30T12:19:00.865165+0000","last_peered":"2024-03-30T12:19:00.865165+0000","last_clean":"2024-03-30T12:19:00.865165+0000","last_became_active":"2024-03-30T12:19:00.860085+0000","last_became_peered":"2024-03-30T12:19:00.860085+0000","last_unstale":"2024-03-30T12:19:00.865165+0000","last_undegraded":"2024-03-30T12:19:00.865165+0000","last_fullsized":"2024-03-30T12:19:00.865165+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:32.201939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.847724+0000","last_change":"2024-03-30T12:19:00.856917+0000","last_active":"2024-03-30T12:19:01.847724+0000","last_peered":"2024-03-30T12:19:01.847724+0000","last_clean":"2024-03-30T12:19:01.847724+0000","last_became_active":"2024-03-30T12:19:00.856643+0000","last_became_peered":"2024-03-30T12:19:00.856643+0000","last_unstale":"2024-03-30T12:19:01.847724+0000","last_undegraded":"2024-03-30T12:19:01.847724+0000","last_fullsized":"2024-03-30T12:19:01.847724+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:51:53.996045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-03-30T12:19:01.566974+0000","last_change":"2024-03-30T12:19:00.867176+0000","last_active":"2024-03-30T12:19:01.566974+0000","last_peered":"2024-03-30T12:19:01.566974+0000","last_clean":"2024-03-30T12:19:01.566974+0000","last_became_active":"2024-03-30T12:19:00.866801+0000","last_became_peered":"2024-03-30T12:19:00.866801+0000","last_unstale":"2024-03-30T12:19:01.566974+0000","last_undegraded":"2024-03-30T12:19:01.566974+0000","last_fullsized":"2024-03-30T12:19:01.566974+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:31:22.909206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":7086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928233991,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32316,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712836,"statfs":{"total":95995035648,"available":95961944064,"internally_reserved":0,"allocated":1220608,"data_stored":850082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":6,"up_from":46,"seq":197568495628,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28216,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716936,"statfs":{"total":95995035648,"available":95966142464,"internally_reserved":0,"allocated":1224704,"data_stored":851100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31724,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713428,"statfs":{"total":95995035648,"available":95962550272,"internally_reserved":0,"allocated":622592,"data_stored":259055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.32500000000000001,"15min":0.307},"min":{"1min":0.23000000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.32000000000000001},"min":{"1min":0.23599999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.33000000000000002}]},{"osd":2,"last update":"Sat Mar 30 12:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.38200000000000001,"15min":0.375},"min":{"1min":0.254,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.39500000000000002,"15min":0.38900000000000001},"min":{"1min":0.32200000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.26300000000000001}]},{"osd":3,"last update":"Sat Mar 30 12:18:08 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.48499999999999999}]},{"osd":4,"last update":"Sat Mar 30 12:18:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.46300000000000002}]},{"osd":5,"last update":"Sat Mar 30 12:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738408,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32316,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712836,"statfs":{"total":95995035648,"available":95961944064,"internally_reserved":0,"allocated":1220608,"data_stored":843807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 30 12:18:17 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.307,"15min":0.29499999999999998},"min":{"1min":0.27500000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.317,"15min":0.30299999999999999},"min":{"1min":0.28199999999999997,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.36799999999999999}]},{"osd":2,"last update":"Sat Mar 30 12:18:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.42799999999999999,"15min":0.42099999999999999},"min":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.437,"5min":0.40899999999999997,"15min":0.40500000000000003},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.378}]},{"osd":3,"last update":"Sat Mar 30 12:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.32500000000000001}]},{"osd":4,"last update":"Sat Mar 30 12:18:29 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.61799999999999999}]},{"osd":5,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411358,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31716,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713436,"statfs":{"total":95995035648,"available":95962558464,"internally_reserved":0,"allocated":606208,"data_stored":252438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:18:49 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34200000000000003},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38100000000000001,"15min":0.38},"min":{"1min":0.26900000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.56499999999999995,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.435}]},{"osd":1,"last update":"Sat Mar 30 12:18:49 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40200000000000002,"15min":0.40100000000000002},"min":{"1min":0.27800000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.38200000000000001},"min":{"1min":0.25600000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59899999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.44700000000000001}]},{"osd":3,"last update":"Sat Mar 30 12:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.48699999999999999}]},{"osd":4,"last update":"Sat Mar 30 12:18:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.91500000000000004}]},{"osd":5,"last update":"Sat Mar 30 12:18:57 2024","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.542,"15min":1.542},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":19.606999999999999,"5min":19.606999999999999,"15min":19.606999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.746}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182426,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27656,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717496,"statfs":{"total":95995035648,"available":95966715904,"internally_reserved":0,"allocated":643072,"data_stored":261109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.312}]},{"osd":1,"last update":"Sat Mar 30 12:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.25700000000000001}]},{"osd":2,"last update":"Sat Mar 30 12:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.34300000000000003}]},{"osd":4,"last update":"Sat Mar 30 12:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":4.8639999999999999,"5min":4.8639999999999999,"15min":4.8639999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.48799999999999999}]},{"osd":5,"last update":"Sat Mar 30 12:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]}]},{"osd":4,"up_from":30,"seq":128849018901,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27636,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717516,"statfs":{"total":95995035648,"available":95966736384,"internally_reserved":0,"allocated":630784,"data_stored":259603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.45400000000000001}]},{"osd":1,"last update":"Sat Mar 30 12:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.38400000000000001}]},{"osd":2,"last update":"Sat Mar 30 12:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.439},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.61299999999999999}]},{"osd":3,"last update":"Sat Mar 30 12:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.41999999999999998}]},{"osd":5,"last update":"Sat Mar 30 12:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":5,"up_from":38,"seq":163208757264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27640,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717512,"statfs":{"total":95995035648,"available":95966732288,"internally_reserved":0,"allocated":626688,"data_stored":254365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.41499999999999998}]},{"osd":1,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.44500000000000001}]},{"osd":2,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.46100000000000002}]},{"osd":3,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.436}]},{"osd":4,"last update":"Sat Mar 30 12:18:55 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.35099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:19:08.491 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-30T12:19:08.491 INFO:tasks.cephadm:Adding prometheus.a on smithi162 2024-03-30T12:19:08.491 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph orch apply prometheus '1;smithi162=a' 2024-03-30T12:19:08.522 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:08 smithi162 ceph-mon[30421]: pgmap v190: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s wr, 6 op/s 2024-03-30T12:19:08.705 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T12:19:10.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:10 smithi162 ceph-mon[30421]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:19:10.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:10 smithi162 ceph-mon[30421]: pgmap v191: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-03-30T12:19:10.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:10 smithi084 ceph-mon[27000]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:19:10.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:10 smithi084 ceph-mon[27000]: pgmap v191: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-03-30T12:19:10.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:10 smithi084 ceph-mon[37565]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:19:10.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:10 smithi084 ceph-mon[37565]: pgmap v191: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-03-30T12:19:10.525 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled prometheus update... 2024-03-30T12:19:11.217 DEBUG:teuthology.orchestra.run.smithi162:prometheus.a> sudo journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@prometheus.a.service 2024-03-30T12:19:11.260 INFO:tasks.cephadm:Adding node-exporter.a on smithi084 2024-03-30T12:19:11.260 INFO:tasks.cephadm:Adding node-exporter.b on smithi162 2024-03-30T12:19:11.260 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph orch apply node-exporter '2;smithi084=a;smithi162=b' 2024-03-30T12:19:11.513 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T12:19:11.775 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:11 smithi162 ceph-mon[30421]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:19:11.775 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:11 smithi162 ceph-mon[30421]: Saving service prometheus spec with placement smithi162=a;count:1 2024-03-30T12:19:11.775 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:11 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:11.775 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:11 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:19:11.775 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:11 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:19:11.775 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:11 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:19:11.775 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:11 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:11.775 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:11 smithi162 ceph-mon[30421]: Deploying daemon prometheus.a on smithi162 2024-03-30T12:19:11.776 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:11 smithi162 ceph-mon[30421]: pgmap v192: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-03-30T12:19:12.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:11 smithi084 ceph-mon[27000]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:19:12.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:11 smithi084 ceph-mon[27000]: Saving service prometheus spec with placement smithi162=a;count:1 2024-03-30T12:19:12.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:11 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:12.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:11 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:19:12.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:11 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:19:12.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:11 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:19:12.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:11 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:12.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:11 smithi084 ceph-mon[27000]: Deploying daemon prometheus.a on smithi162 2024-03-30T12:19:12.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:11 smithi084 ceph-mon[27000]: pgmap v192: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-03-30T12:19:12.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:11 smithi084 ceph-mon[37565]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:19:12.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:11 smithi084 ceph-mon[37565]: Saving service prometheus spec with placement smithi162=a;count:1 2024-03-30T12:19:12.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:11 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:12.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:11 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:19:12.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:11 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:19:12.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:11 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:19:12.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:11 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:12.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:11 smithi084 ceph-mon[37565]: Deploying daemon prometheus.a on smithi162 2024-03-30T12:19:12.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:11 smithi084 ceph-mon[37565]: pgmap v192: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-03-30T12:19:13.909 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled node-exporter update... 2024-03-30T12:19:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:14 smithi084 ceph-mon[27000]: pgmap v193: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 813 B/s wr, 2 op/s 2024-03-30T12:19:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:14 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:14.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:14 smithi084 ceph-mon[37565]: pgmap v193: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 813 B/s wr, 2 op/s 2024-03-30T12:19:14.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:14 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:14.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:14 smithi162 ceph-mon[30421]: pgmap v193: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 813 B/s wr, 2 op/s 2024-03-30T12:19:14.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:14 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:14.858 DEBUG:teuthology.orchestra.run.smithi084:node-exporter.a> sudo journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@node-exporter.a.service 2024-03-30T12:19:14.862 DEBUG:teuthology.orchestra.run.smithi162:node-exporter.b> sudo journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@node-exporter.b.service 2024-03-30T12:19:14.864 INFO:tasks.cephadm:Adding alertmanager.a on smithi084 2024-03-30T12:19:14.864 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph orch apply alertmanager '1;smithi084=a' 2024-03-30T12:19:15.115 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T12:19:15.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:15 smithi162 ceph-mon[30421]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi084=a;smithi162=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:19:15.477 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:15 smithi162 ceph-mon[30421]: Saving service node-exporter spec with placement smithi084=a;smithi162=b;count:2 2024-03-30T12:19:15.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:15 smithi084 ceph-mon[27000]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi084=a;smithi162=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:19:15.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:15 smithi084 ceph-mon[27000]: Saving service node-exporter spec with placement smithi084=a;smithi162=b;count:2 2024-03-30T12:19:15.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:15 smithi084 ceph-mon[37565]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi084=a;smithi162=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:19:15.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:15 smithi084 ceph-mon[37565]: Saving service node-exporter spec with placement smithi084=a;smithi162=b;count:2 2024-03-30T12:19:16.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:16 smithi084 ceph-mon[27000]: pgmap v194: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 85 B/s wr, 0 op/s 2024-03-30T12:19:16.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:16 smithi084 ceph-mon[37565]: pgmap v194: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 85 B/s wr, 0 op/s 2024-03-30T12:19:16.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:16 smithi162 ceph-mon[30421]: pgmap v194: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 85 B/s wr, 0 op/s 2024-03-30T12:19:18.062 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled alertmanager update... 2024-03-30T12:19:18.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:18 smithi162 ceph-mon[30421]: pgmap v195: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-03-30T12:19:18.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:18 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:18.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:18 smithi084 ceph-mon[27000]: pgmap v195: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-03-30T12:19:18.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:18 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:18.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:18 smithi084 ceph-mon[37565]: pgmap v195: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-03-30T12:19:18.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:18 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:19.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:19 smithi084 ceph-mon[27000]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi084=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:19:19.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:19 smithi084 ceph-mon[27000]: Saving service alertmanager spec with placement smithi084=a;count:1 2024-03-30T12:19:19.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:19 smithi084 ceph-mon[37565]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi084=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:19:19.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:19 smithi084 ceph-mon[37565]: Saving service alertmanager spec with placement smithi084=a;count:1 2024-03-30T12:19:19.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:19 smithi162 ceph-mon[30421]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi084=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:19:19.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:19 smithi162 ceph-mon[30421]: Saving service alertmanager spec with placement smithi084=a;count:1 2024-03-30T12:19:19.755 DEBUG:teuthology.orchestra.run.smithi084:alertmanager.a> sudo journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@alertmanager.a.service 2024-03-30T12:19:19.758 INFO:tasks.cephadm:Adding grafana.a on smithi162 2024-03-30T12:19:19.758 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph orch apply grafana '1;smithi162=a' 2024-03-30T12:19:20.192 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T12:19:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:20 smithi084 ceph-mon[37565]: pgmap v196: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:20.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:20 smithi084 ceph-mon[27000]: pgmap v196: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:20.522 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:20 smithi162 ceph-mon[30421]: pgmap v196: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:22.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:22 smithi162 ceph-mon[30421]: pgmap v197: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:22.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:22 smithi084 ceph-mon[37565]: pgmap v197: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:22.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:22 smithi084 ceph-mon[27000]: pgmap v197: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:23.115 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled grafana update... 2024-03-30T12:19:24.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:24 smithi084 ceph-mon[37565]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:19:24.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:24 smithi084 ceph-mon[37565]: Saving service grafana spec with placement smithi162=a;count:1 2024-03-30T12:19:24.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:24 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:24.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:24 smithi084 ceph-mon[37565]: pgmap v198: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:24.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:24 smithi084 ceph-mon[27000]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:19:24.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:24 smithi084 ceph-mon[27000]: Saving service grafana spec with placement smithi162=a;count:1 2024-03-30T12:19:24.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:24 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:24.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:24 smithi084 ceph-mon[27000]: pgmap v198: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:24 smithi162 ceph-mon[30421]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:19:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:24 smithi162 ceph-mon[30421]: Saving service grafana spec with placement smithi162=a;count:1 2024-03-30T12:19:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:24 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:24 smithi162 ceph-mon[30421]: pgmap v198: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:25.349 DEBUG:teuthology.orchestra.run.smithi162:grafana.a> sudo journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@grafana.a.service 2024-03-30T12:19:25.352 INFO:tasks.cephadm:Setting up client nodes... 2024-03-30T12:19:25.352 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-30T12:19:25.564 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:19:26.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:25 smithi162 ceph-mon[30421]: pgmap v199: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:26.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:25 smithi084 ceph-mon[37565]: pgmap v199: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:26.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:25 smithi084 ceph-mon[27000]: pgmap v199: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:27.370 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 systemd[1]: Starting Ceph prometheus.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:19:27.565 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2024-03-30T12:19:27.565 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBPAwhmwUjiIRAA+P85EZvsbYIa90opnTnTtg== 2024-03-30T12:19:27.727 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 podman[58257]: 2024-03-30 12:19:27.384578373 +0000 UTC m=+0.019020162 image pull a07b618ecd1dce142bce4c52f0e80982eaf1f14265a2415c2d35978ccaa0a464 quay.io/prometheus/prometheus:v2.43.0 2024-03-30T12:19:27.727 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 podman[58257]: 2024-03-30 12:19:27.499633329 +0000 UTC m=+0.134075107 container create 5ba89e412a837cac1bcadbd69d50e33f8c50b846e62b47efb30d3a32d3b2e230 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:19:27.727 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 podman[58257]: 2024-03-30 12:19:27.709995113 +0000 UTC m=+0.344436892 container init 5ba89e412a837cac1bcadbd69d50e33f8c50b846e62b47efb30d3a32d3b2e230 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:19:27.727 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 podman[58257]: 2024-03-30 12:19:27.71238062 +0000 UTC m=+0.346822406 container start 5ba89e412a837cac1bcadbd69d50e33f8c50b846e62b47efb30d3a32d3b2e230 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:19:28.120 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:19:27.735Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-03-30T12:19:28.121 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:19:27.735Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-03-30T12:19:28.121 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:19:27.735Z caller=main.go:570 level=info host_details="(Linux 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 x86_64 smithi162 (none))" 2024-03-30T12:19:28.121 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:19:27.735Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-03-30T12:19:28.121 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:19:27.735Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-03-30T12:19:28.121 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:19:27.737Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-03-30T12:19:28.121 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:19:27.737Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-03-30T12:19:28.121 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:19:27.738Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-03-30T12:19:28.121 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:19:27.738Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-03-30T12:19:28.121 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:19:27.739Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-03-30T12:19:28.121 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:19:27.739Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.457µs 2024-03-30T12:19:28.122 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:19:27.739Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-03-30T12:19:28.122 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:19:27.739Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-03-30T12:19:28.122 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:19:27.739Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=16.736µs wal_replay_duration=177.371µs wbl_replay_duration=113ns total_replay_duration=211.221µs 2024-03-30T12:19:28.122 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:19:27.740Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-03-30T12:19:28.122 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:19:27.740Z caller=main.go:1029 level=info msg="TSDB started" 2024-03-30T12:19:28.122 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:19:27.740Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-03-30T12:19:28.122 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:19:27.757Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=16.837259ms db_storage=782ns remote_storage=944ns web_handler=250ns query_engine=491ns scrape=383.711µs scrape_sd=89.469µs notify=881ns notify_sd=2.329µs rules=16.160787ms tracing=5.332µs 2024-03-30T12:19:28.122 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:19:27.757Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-03-30T12:19:28.122 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:19:27.757Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-03-30T12:19:28.122 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 bash[58257]: 5ba89e412a837cac1bcadbd69d50e33f8c50b846e62b47efb30d3a32d3b2e230 2024-03-30T12:19:28.122 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:19:27 smithi162 systemd[1]: Started Ceph prometheus.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:19:28.257 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-30T12:19:28.257 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-03-30T12:19:28.257 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-30T12:19:28.300 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-30T12:19:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:28 smithi084 ceph-mon[27000]: pgmap v200: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:28 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3007278462' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T12:19:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:28 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3007278462' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-30T12:19:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:28 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:28 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:28 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:28 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-30T12:19:28.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:28 smithi084 ceph-mon[37565]: pgmap v200: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:28.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:28 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/3007278462' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T12:19:28.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:28 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/3007278462' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-30T12:19:28.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:28 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:28.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:28 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:28.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:28 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:28.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:28 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-30T12:19:28.510 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T12:19:28.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:28 smithi162 ceph-mon[30421]: pgmap v200: 97 pgs: 97 active+clean; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:28.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:28 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/3007278462' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T12:19:28.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:28 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/3007278462' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-30T12:19:28.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:28 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:28.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:28 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:28.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:28 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' 2024-03-30T12:19:28.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:28 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-30T12:19:29.254 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ignoring --setuser ceph since I am not root 2024-03-30T12:19:29.254 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ignoring --setgroup ceph since I am not root 2024-03-30T12:19:29.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: ignoring --setuser ceph since I am not root 2024-03-30T12:19:29.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: ignoring --setgroup ceph since I am not root 2024-03-30T12:19:29.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:28 smithi162 ceph-mgr[32149]: -- 172.21.15.162:0/1579385900 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5645879b61a0 con 0x56458798cc00 2024-03-30T12:19:29.717 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:29.463+0000 7f9d9b277200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T12:19:29.717 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:29.557+0000 7f9d9b277200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T12:19:29.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:29.451+0000 7f6cb9826200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T12:19:29.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:29.542+0000 7f6cb9826200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T12:19:29.998 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:29 smithi162 ceph-mon[30421]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-03-30T12:19:29.998 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:29 smithi162 ceph-mon[30421]: mgrmap e16: y(active, since 4m), standbys: x 2024-03-30T12:19:30.166 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:29 smithi084 ceph-mon[27000]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-03-30T12:19:30.167 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:29 smithi084 ceph-mon[27000]: mgrmap e16: y(active, since 4m), standbys: x 2024-03-30T12:19:30.167 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:29 smithi084 ceph-mon[37565]: from='mgr.14152 172.21.15.84:0/1182515946' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-03-30T12:19:30.167 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:29 smithi084 ceph-mon[37565]: mgrmap e16: y(active, since 4m), standbys: x 2024-03-30T12:19:30.305 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:30.214+0000 7f9d9b277200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T12:19:30.305 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:30.313+0000 7f9d9b277200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T12:19:30.491 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:30.174+0000 7f6cb9826200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T12:19:30.491 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:30.265+0000 7f6cb9826200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T12:19:30.491 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:30.404+0000 7f6cb9826200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T12:19:30.491 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:30.498+0000 7f6cb9826200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T12:19:30.515 INFO:teuthology.orchestra.run.smithi162.stdout:[client.1] 2024-03-30T12:19:30.515 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBSAwhmFgruHhAAcTplJ65gpSfgIyUdIH9LLQ== 2024-03-30T12:19:30.620 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:30.457+0000 7f9d9b277200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T12:19:30.620 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:30.557+0000 7f9d9b277200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T12:19:30.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:30.582+0000 7f6cb9826200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T12:19:30.895 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:30.640+0000 7f9d9b277200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T12:19:30.895 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:30.903+0000 7f9d9b277200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T12:19:31.123 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:30 smithi084 ceph-mon[37565]: from='client.? 172.21.15.162:0/3152011758' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T12:19:31.123 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:30 smithi084 ceph-mon[37565]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T12:19:31.123 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:30 smithi084 ceph-mon[37565]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-30T12:19:31.123 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:30 smithi084 ceph-mon[27000]: from='client.? 172.21.15.162:0/3152011758' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T12:19:31.123 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:30 smithi084 ceph-mon[27000]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T12:19:31.123 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:30 smithi084 ceph-mon[27000]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-30T12:19:31.124 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:30.842+0000 7f6cb9826200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T12:19:31.124 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:30.950+0000 7f6cb9826200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T12:19:31.124 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:31.037+0000 7f6cb9826200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T12:19:31.124 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:31.130+0000 7f6cb9826200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T12:19:31.184 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:31.013+0000 7f9d9b277200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T12:19:31.184 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:31.101+0000 7f9d9b277200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T12:19:31.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:30 smithi162 ceph-mon[30421]: from='client.? 172.21.15.162:0/3152011758' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T12:19:31.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:30 smithi162 ceph-mon[30421]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T12:19:31.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:30 smithi162 ceph-mon[30421]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-30T12:19:31.207 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-03-30T12:19:31.207 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-03-30T12:19:31.207 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-30T12:19:31.251 INFO:tasks.cephadm:Waiting for OSDs to come up 2024-03-30T12:19:31.252 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-30T12:19:31.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:31.308+0000 7f6cb9826200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T12:19:31.536 INFO:teuthology.misc.health.smithi084.stdout: 2024-03-30T12:19:31.536 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":62,"fsid":"d3450b00-ee8e-11ee-b647-cb9ed24678a4","created":"2024-03-30T12:13:37.956825+0000","modified":"2024-03-30T12:19:01.836116+0000","last_up_change":"2024-03-30T12:18:42.422684+0000","last_in_change":"2024-03-30T12:18:24.854304+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T12:16:43.434051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T12:18:59.012249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T12:18:59.975381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a5734fa-c269-449c-805f-0a42d3d90120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6803","nonce":2597011613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6805","nonce":2597011613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6809","nonce":2597011613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6807","nonce":2597011613}]},"public_addr":"172.21.15.84:6803/2597011613","cluster_addr":"172.21.15.84:6805/2597011613","heartbeat_back_addr":"172.21.15.84:6809/2597011613","heartbeat_front_addr":"172.21.15.84:6807/2597011613","state":["exists","up"]},{"osd":1,"uuid":"3ffe676e-9055-44f7-8b04-87974b854b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6811","nonce":6106221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6813","nonce":6106221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6817","nonce":6106221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6815","nonce":6106221}]},"public_addr":"172.21.15.84:6811/6106221","cluster_addr":"172.21.15.84:6813/6106221","heartbeat_back_addr":"172.21.15.84:6817/6106221","heartbeat_front_addr":"172.21.15.84:6815/6106221","state":["exists","up"]},{"osd":2,"uuid":"c21b4cb6-9ade-44d2-a7ba-33fe9b5dd3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6819","nonce":3627018831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6821","nonce":3627018831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6825","nonce":3627018831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6823","nonce":3627018831}]},"public_addr":"172.21.15.84:6819/3627018831","cluster_addr":"172.21.15.84:6821/3627018831","heartbeat_back_addr":"172.21.15.84:6825/3627018831","heartbeat_front_addr":"172.21.15.84:6823/3627018831","state":["exists","up"]},{"osd":3,"uuid":"d60cb7da-fc49-4cbf-855a-2957dcbf66b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6827","nonce":46835826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6829","nonce":46835826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6833","nonce":46835826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6831","nonce":46835826}]},"public_addr":"172.21.15.84:6827/46835826","cluster_addr":"172.21.15.84:6829/46835826","heartbeat_back_addr":"172.21.15.84:6833/46835826","heartbeat_front_addr":"172.21.15.84:6831/46835826","state":["exists","up"]},{"osd":4,"uuid":"46a5087f-cf7c-4bb2-bace-6e04d57496ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6801","nonce":592935958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6803","nonce":592935958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6807","nonce":592935958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6805","nonce":592935958}]},"public_addr":"172.21.15.162:6801/592935958","cluster_addr":"172.21.15.162:6803/592935958","heartbeat_back_addr":"172.21.15.162:6807/592935958","heartbeat_front_addr":"172.21.15.162:6805/592935958","state":["exists","up"]},{"osd":5,"uuid":"2408494e-0472-4cde-aac6-e87d919b6d2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6809","nonce":2786846638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6811","nonce":2786846638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6815","nonce":2786846638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6813","nonce":2786846638}]},"public_addr":"172.21.15.162:6809/2786846638","cluster_addr":"172.21.15.162:6811/2786846638","heartbeat_back_addr":"172.21.15.162:6815/2786846638","heartbeat_front_addr":"172.21.15.162:6813/2786846638","state":["exists","up"]},{"osd":6,"uuid":"f86781fa-6cb4-4abd-b759-84ff6d7b36d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6817","nonce":2493067564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6819","nonce":2493067564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6823","nonce":2493067564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6821","nonce":2493067564}]},"public_addr":"172.21.15.162:6817/2493067564","cluster_addr":"172.21.15.162:6819/2493067564","heartbeat_back_addr":"172.21.15.162:6823/2493067564","heartbeat_front_addr":"172.21.15.162:6821/2493067564","state":["exists","up"]},{"osd":7,"uuid":"49a38087-ec6c-4ae8-b932-9c59ff7d4321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6825","nonce":158814135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6827","nonce":158814135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6831","nonce":158814135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6829","nonce":158814135}]},"public_addr":"172.21.15.162:6825/158814135","cluster_addr":"172.21.15.162:6827/158814135","heartbeat_back_addr":"172.21.15.162:6831/158814135","heartbeat_front_addr":"172.21.15.162:6829/158814135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:15:49.285912+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:14.234967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:39.383506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:03.790574+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:26.131317+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:50.385373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:14.909835+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:40.707128+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/1374515169":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6800/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6800/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/4071895056":"2024-03-31T12:14:06.678373+0000","172.21.15.84:6801/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6801/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3191408930":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/1433254333":"2024-03-31T12:14:31.125768+0000","172.21.15.84:0/1390761199":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3135527830":"2024-03-31T12:14:31.125768+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T12:19:31.548 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-30T12:19:31.548 INFO:tasks.cephadm:Creating RBD pool 2024-03-30T12:19:31.548 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- sudo ceph --cluster ceph osd pool create rbd 8 2024-03-30T12:19:31.620 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:31.197+0000 7f9d9b277200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T12:19:31.620 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:31.381+0000 7f9d9b277200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T12:19:31.785 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:19:32.197 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:31 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/142922841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:19:32.197 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:31 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/142922841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:19:32.341 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:31 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/142922841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:19:32.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:32.309+0000 7f6cb9826200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T12:19:32.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:32.440+0000 7f6cb9826200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T12:19:32.620 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:32.349+0000 7f9d9b277200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T12:19:32.620 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:32.483+0000 7f9d9b277200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T12:19:33.072 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:32.777+0000 7f6cb9826200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T12:19:33.073 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:32.870+0000 7f6cb9826200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T12:19:33.073 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:33.080+0000 7f6cb9826200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:19:33.102 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:32.818+0000 7f9d9b277200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T12:19:33.103 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:32.914+0000 7f9d9b277200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T12:19:33.103 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:33.111+0000 7f9d9b277200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:19:33.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:33.299+0000 7f9d9b277200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T12:19:33.420 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:33.268+0000 7f6cb9826200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T12:19:33.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:33.567+0000 7f6cb9826200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:19:33.838 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:33.586+0000 7f9d9b277200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:19:34.043 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'rbd' created 2024-03-30T12:19:34.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:34 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/2230543890' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]: dispatch 2024-03-30T12:19:34.120 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:33.846+0000 7f9d9b277200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T12:19:34.120 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:34.088+0000 7f9d9b277200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T12:19:34.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:34 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/2230543890' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]: dispatch 2024-03-30T12:19:34.254 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:33.832+0000 7f6cb9826200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T12:19:34.254 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:34.080+0000 7f6cb9826200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T12:19:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:34 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/2230543890' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]: dispatch 2024-03-30T12:19:34.787 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-03-30T12:19:34.995 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:19:35.041 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:34.890+0000 7f6cb9826200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T12:19:35.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:35 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/2230543890' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]': finished 2024-03-30T12:19:35.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:35 smithi162 ceph-mon[30421]: osdmap e63: 8 total, 8 up, 8 in 2024-03-30T12:19:35.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:35 smithi162 ceph-mon[30421]: osdmap e64: 8 total, 8 up, 8 in 2024-03-30T12:19:35.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:34.898+0000 7f9d9b277200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T12:19:35.377 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:35 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/2230543890' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]': finished 2024-03-30T12:19:35.377 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:35 smithi084 ceph-mon[27000]: osdmap e63: 8 total, 8 up, 8 in 2024-03-30T12:19:35.377 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:35 smithi084 ceph-mon[27000]: osdmap e64: 8 total, 8 up, 8 in 2024-03-30T12:19:35.377 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:35 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/2230543890' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]': finished 2024-03-30T12:19:35.377 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:35 smithi084 ceph-mon[37565]: osdmap e63: 8 total, 8 up, 8 in 2024-03-30T12:19:35.377 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:35 smithi084 ceph-mon[37565]: osdmap e64: 8 total, 8 up, 8 in 2024-03-30T12:19:35.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:35.488+0000 7f6cb9826200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T12:19:35.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:35.587+0000 7f6cb9826200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T12:19:35.789 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:35.480+0000 7f9d9b277200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T12:19:35.789 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:35.579+0000 7f9d9b277200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T12:19:35.789 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:35.797+0000 7f9d9b277200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T12:19:36.045 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: [30/Mar/2024:12:19:35] ENGINE Bus STARTING 2024-03-30T12:19:36.045 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: CherryPy Checker: 2024-03-30T12:19:36.045 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: The Application mounted at '' has an empty config. 2024-03-30T12:19:36.045 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: 2024-03-30T12:19:36.045 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: [30/Mar/2024:12:19:35] ENGINE Serving on http://:::9283 2024-03-30T12:19:36.046 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:19:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[32145]: [30/Mar/2024:12:19:35] ENGINE Bus STARTED 2024-03-30T12:19:36.146 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: Standby manager daemon x restarted 2024-03-30T12:19:36.146 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: Standby manager daemon x started 2024-03-30T12:19:36.146 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.162:0/1134159099' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T12:19:36.146 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.162:0/1134159099' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T12:19:36.146 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.162:0/1134159099' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T12:19:36.146 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.162:0/1134159099' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T12:19:36.146 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: Active manager daemon y restarted 2024-03-30T12:19:36.146 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: Activating manager daemon y 2024-03-30T12:19:36.147 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: osdmap e65: 8 total, 8 up, 8 in 2024-03-30T12:19:36.147 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: mgrmap e17: y(active, starting, since 0.00732487s), standbys: x 2024-03-30T12:19:36.147 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:19:36.147 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:19:36.147 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:19:36.147 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-30T12:19:36.147 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-30T12:19:36.147 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T12:19:36.147 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T12:19:36.147 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:19:36.147 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:19:36.147 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:19:36.147 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:19:36.147 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:19:36.148 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:19:36.148 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:19:36.148 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:19:36.148 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T12:19:36.148 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T12:19:36.148 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T12:19:36.148 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: Manager daemon y is now available 2024-03-30T12:19:36.148 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:35.806+0000 7f6cb9826200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T12:19:36.148 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:19:35] ENGINE Bus STARTING 2024-03-30T12:19:36.148 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:35.922+0000 7f6c1a5f6700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:19:36.148 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:35.922+0000 7f6c1a5f6700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:19:36.149 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:35.922+0000 7f6c1a5f6700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:19:36.149 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:35.922+0000 7f6c1a5f6700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:19:36.149 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:35.922+0000 7f6c1a5f6700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:19:36.149 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:35.922+0000 7f6c17df1700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:19:36.149 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:35.922+0000 7f6c17df1700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:19:36.149 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:35.922+0000 7f6c17df1700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:19:36.149 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:35.922+0000 7f6c17df1700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:19:36.149 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:35.922+0000 7f6c17df1700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:19:36.149 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: CherryPy Checker: 2024-03-30T12:19:36.149 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: The Application mounted at '' has an empty config. 2024-03-30T12:19:36.149 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:19:36.149 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:19:36] ENGINE Serving on http://:::9283 2024-03-30T12:19:36.149 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:19:36] ENGINE Bus STARTED 2024-03-30T12:19:36.150 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:19:36.150 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:36.150 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:19:36.150 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T12:19:36.150 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T12:19:36.150 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T12:19:36.150 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T12:19:36.151 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: Standby manager daemon x restarted 2024-03-30T12:19:36.151 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: Standby manager daemon x started 2024-03-30T12:19:36.151 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.162:0/1134159099' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T12:19:36.151 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.162:0/1134159099' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T12:19:36.151 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.162:0/1134159099' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T12:19:36.151 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.162:0/1134159099' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T12:19:36.151 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: Active manager daemon y restarted 2024-03-30T12:19:36.151 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: Activating manager daemon y 2024-03-30T12:19:36.151 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: osdmap e65: 8 total, 8 up, 8 in 2024-03-30T12:19:36.151 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: mgrmap e17: y(active, starting, since 0.00732487s), standbys: x 2024-03-30T12:19:36.151 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:19:36.151 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:19:36.151 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:19:36.151 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-30T12:19:36.152 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-30T12:19:36.152 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T12:19:36.152 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T12:19:36.152 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:19:36.152 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:19:36.152 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:19:36.152 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:19:36.152 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:19:36.152 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:19:36.152 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:19:36.152 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:19:36.152 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T12:19:36.152 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T12:19:36.152 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T12:19:36.152 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: Manager daemon y is now available 2024-03-30T12:19:36.153 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:19:36.153 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:36.153 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:19:36.153 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T12:19:36.153 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T12:19:36.153 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T12:19:36.153 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:36 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T12:19:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: Standby manager daemon x restarted 2024-03-30T12:19:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: Standby manager daemon x started 2024-03-30T12:19:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.162:0/1134159099' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T12:19:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.162:0/1134159099' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T12:19:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.162:0/1134159099' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T12:19:36.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.162:0/1134159099' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T12:19:36.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: Active manager daemon y restarted 2024-03-30T12:19:36.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: Activating manager daemon y 2024-03-30T12:19:36.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: osdmap e65: 8 total, 8 up, 8 in 2024-03-30T12:19:36.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: mgrmap e17: y(active, starting, since 0.00732487s), standbys: x 2024-03-30T12:19:36.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:19:36.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:19:36.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:19:36.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-30T12:19:36.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-30T12:19:36.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T12:19:36.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T12:19:36.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:19:36.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:19:36.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:19:36.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:19:36.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:19:36.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:19:36.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:19:36.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:19:36.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T12:19:36.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T12:19:36.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T12:19:36.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: Manager daemon y is now available 2024-03-30T12:19:36.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:19:36.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:36.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:19:36.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T12:19:36.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T12:19:36.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T12:19:36.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:36 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T12:19:37.833 INFO:teuthology.orchestra.run.smithi084.stderr:enabled application 'rbd' on pool 'rbd' 2024-03-30T12:19:38.064 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:37 smithi162 ceph-mon[30421]: [30/Mar/2024:12:19:36] ENGINE Bus STARTING 2024-03-30T12:19:38.065 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:37 smithi162 ceph-mon[30421]: [30/Mar/2024:12:19:36] ENGINE Serving on http://172.21.15.84:8765 2024-03-30T12:19:38.065 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:37 smithi162 ceph-mon[30421]: [30/Mar/2024:12:19:36] ENGINE Serving on https://172.21.15.84:7150 2024-03-30T12:19:38.065 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:37 smithi162 ceph-mon[30421]: [30/Mar/2024:12:19:36] ENGINE Bus STARTED 2024-03-30T12:19:38.065 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:37 smithi162 ceph-mon[30421]: mgrmap e18: y(active, since 1.0167s), standbys: x 2024-03-30T12:19:38.065 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:37 smithi162 ceph-mon[30421]: pgmap v3: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:38.065 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:37 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/3198116355' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T12:19:38.065 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:37 smithi162 ceph-mon[30421]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T12:19:38.201 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:37 smithi084 ceph-mon[37565]: [30/Mar/2024:12:19:36] ENGINE Bus STARTING 2024-03-30T12:19:38.201 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:37 smithi084 ceph-mon[37565]: [30/Mar/2024:12:19:36] ENGINE Serving on http://172.21.15.84:8765 2024-03-30T12:19:38.201 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:37 smithi084 ceph-mon[37565]: [30/Mar/2024:12:19:36] ENGINE Serving on https://172.21.15.84:7150 2024-03-30T12:19:38.201 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:37 smithi084 ceph-mon[37565]: [30/Mar/2024:12:19:36] ENGINE Bus STARTED 2024-03-30T12:19:38.201 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:37 smithi084 ceph-mon[37565]: mgrmap e18: y(active, since 1.0167s), standbys: x 2024-03-30T12:19:38.202 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:37 smithi084 ceph-mon[37565]: pgmap v3: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:38.202 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:37 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/3198116355' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T12:19:38.202 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:37 smithi084 ceph-mon[37565]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T12:19:38.202 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:37 smithi084 ceph-mon[27000]: [30/Mar/2024:12:19:36] ENGINE Bus STARTING 2024-03-30T12:19:38.202 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:37 smithi084 ceph-mon[27000]: [30/Mar/2024:12:19:36] ENGINE Serving on http://172.21.15.84:8765 2024-03-30T12:19:38.202 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:37 smithi084 ceph-mon[27000]: [30/Mar/2024:12:19:36] ENGINE Serving on https://172.21.15.84:7150 2024-03-30T12:19:38.202 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:37 smithi084 ceph-mon[27000]: [30/Mar/2024:12:19:36] ENGINE Bus STARTED 2024-03-30T12:19:38.202 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:37 smithi084 ceph-mon[27000]: mgrmap e18: y(active, since 1.0167s), standbys: x 2024-03-30T12:19:38.202 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:37 smithi084 ceph-mon[27000]: pgmap v3: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:38.202 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:37 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3198116355' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T12:19:38.203 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:37 smithi084 ceph-mon[27000]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T12:19:38.655 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-30T12:19:38.656 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-03-30T12:19:38.656 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph mgr dump --format=json 2024-03-30T12:19:38.881 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:19:39.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:38 smithi084 ceph-mon[37565]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T12:19:39.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:38 smithi084 ceph-mon[37565]: pgmap v4: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:39.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:38 smithi084 ceph-mon[37565]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]': finished 2024-03-30T12:19:39.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:38 smithi084 ceph-mon[37565]: osdmap e66: 8 total, 8 up, 8 in 2024-03-30T12:19:39.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:38 smithi084 ceph-mon[37565]: mgrmap e19: y(active, since 2s), standbys: x 2024-03-30T12:19:39.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:38 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:39.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:38 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:39.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:38 smithi084 ceph-mon[27000]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T12:19:39.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:38 smithi084 ceph-mon[27000]: pgmap v4: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:39.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:38 smithi084 ceph-mon[27000]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]': finished 2024-03-30T12:19:39.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:38 smithi084 ceph-mon[27000]: osdmap e66: 8 total, 8 up, 8 in 2024-03-30T12:19:39.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:38 smithi084 ceph-mon[27000]: mgrmap e19: y(active, since 2s), standbys: x 2024-03-30T12:19:39.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:38 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:39.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:38 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:39.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:38 smithi162 ceph-mon[30421]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T12:19:39.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:38 smithi162 ceph-mon[30421]: pgmap v4: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:39.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:38 smithi162 ceph-mon[30421]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]': finished 2024-03-30T12:19:39.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:38 smithi162 ceph-mon[30421]: osdmap e66: 8 total, 8 up, 8 in 2024-03-30T12:19:39.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:38 smithi162 ceph-mon[30421]: mgrmap e19: y(active, since 2s), standbys: x 2024-03-30T12:19:39.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:38 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:39.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:38 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:39.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:19:39] "GET /metrics HTTP/1.1" 200 31026 "" "Prometheus/2.43.0" 2024-03-30T12:19:40.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:40.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:40.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:40.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:40.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:40.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:19:40.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:39 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:19:40.202 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:40.203 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:40.203 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:40.203 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:40.203 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.203 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.203 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.203 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.203 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.203 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.203 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.203 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.203 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:40.203 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:40.204 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:40.204 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.204 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.204 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.204 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.204 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.204 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.204 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.204 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.204 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:40.204 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:19:40.204 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:19:40.205 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:40.205 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:40.205 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:40.205 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:40.205 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.205 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.205 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.205 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.205 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.205 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.205 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.205 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.205 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:40.205 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:40.205 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:40.206 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.206 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.206 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.206 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.206 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.206 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.206 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.206 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:19:40.206 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:40.206 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:19:40.206 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:39 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:19:41.114 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:19:41.115 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[37565]: Adjusting osd_memory_target on smithi162 to 2992M 2024-03-30T12:19:41.115 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[37565]: Adjusting osd_memory_target on smithi084 to 2992M 2024-03-30T12:19:41.115 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[37565]: Updating smithi084:/etc/ceph/ceph.conf 2024-03-30T12:19:41.115 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[37565]: Updating smithi162:/etc/ceph/ceph.conf 2024-03-30T12:19:41.115 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[37565]: pgmap v6: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:41.115 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[37565]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:19:41.115 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[37565]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:19:41.115 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:41.115 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:41.115 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:41.115 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:41.115 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:41.116 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[37565]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-30T12:19:41.116 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[37565]: Cluster is now healthy 2024-03-30T12:19:41.116 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[37565]: mgrmap e20: y(active, since 4s), standbys: x 2024-03-30T12:19:41.116 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[27000]: Adjusting osd_memory_target on smithi162 to 2992M 2024-03-30T12:19:41.116 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[27000]: Adjusting osd_memory_target on smithi084 to 2992M 2024-03-30T12:19:41.116 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[27000]: Updating smithi084:/etc/ceph/ceph.conf 2024-03-30T12:19:41.116 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[27000]: Updating smithi162:/etc/ceph/ceph.conf 2024-03-30T12:19:41.117 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[27000]: pgmap v6: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:41.117 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[27000]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:19:41.117 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[27000]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:19:41.117 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:41.117 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:41.117 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:41.117 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:41.117 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:41.117 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[27000]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-30T12:19:41.117 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[27000]: Cluster is now healthy 2024-03-30T12:19:41.117 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:40 smithi084 ceph-mon[27000]: mgrmap e20: y(active, since 4s), standbys: x 2024-03-30T12:19:41.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:40 smithi162 ceph-mon[30421]: Adjusting osd_memory_target on smithi162 to 2992M 2024-03-30T12:19:41.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:40 smithi162 ceph-mon[30421]: Adjusting osd_memory_target on smithi084 to 2992M 2024-03-30T12:19:41.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:40 smithi162 ceph-mon[30421]: Updating smithi084:/etc/ceph/ceph.conf 2024-03-30T12:19:41.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:40 smithi162 ceph-mon[30421]: Updating smithi162:/etc/ceph/ceph.conf 2024-03-30T12:19:41.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:40 smithi162 ceph-mon[30421]: pgmap v6: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:41.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:40 smithi162 ceph-mon[30421]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:19:41.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:40 smithi162 ceph-mon[30421]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:19:41.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:40 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:41.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:40 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:41.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:40 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:41.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:40 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:41.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:40 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:41.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:40 smithi162 ceph-mon[30421]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-30T12:19:41.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:40 smithi162 ceph-mon[30421]: Cluster is now healthy 2024-03-30T12:19:41.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:40 smithi162 ceph-mon[30421]: mgrmap e20: y(active, since 4s), standbys: x 2024-03-30T12:19:41.957 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":20,"active_gid":14601,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1623350439},{"type":"v1","addr":"172.21.15.84:6801","nonce":1623350439}]},"active_addr":"172.21.15.84:6801/1623350439","active_change":"2024-03-30T12:19:35.809013+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24439,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.84:8443/","prometheus":"http://172.21.15.84:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":65,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2856311587}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":1700950603}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":707854941}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":681092589}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":3812729234}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2672501061}]}]} 2024-03-30T12:19:41.961 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-03-30T12:19:41.961 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-03-30T12:19:41.961 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-03-30T12:19:42.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:41 smithi162 ceph-mon[30421]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:19:42.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:41 smithi162 ceph-mon[30421]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:19:42.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:41 smithi162 ceph-mon[30421]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:19:42.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:41 smithi162 ceph-mon[30421]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:19:42.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:41 smithi162 ceph-mon[30421]: Deploying daemon alertmanager.a on smithi084 2024-03-30T12:19:42.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:41 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/1373087256' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-30T12:19:42.169 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:19:42.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:41 smithi084 ceph-mon[27000]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:19:42.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:41 smithi084 ceph-mon[27000]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:19:42.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:41 smithi084 ceph-mon[27000]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:19:42.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:41 smithi084 ceph-mon[27000]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:19:42.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:41 smithi084 ceph-mon[27000]: Deploying daemon alertmanager.a on smithi084 2024-03-30T12:19:42.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:41 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/1373087256' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-30T12:19:42.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:41 smithi084 ceph-mon[37565]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:19:42.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:41 smithi084 ceph-mon[37565]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:19:42.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:41 smithi084 ceph-mon[37565]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:19:42.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:41 smithi084 ceph-mon[37565]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:19:42.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:41 smithi084 ceph-mon[37565]: Deploying daemon alertmanager.a on smithi084 2024-03-30T12:19:42.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:41 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/1373087256' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-30T12:19:43.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:42 smithi162 ceph-mon[30421]: pgmap v7: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:43.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:42 smithi084 ceph-mon[37565]: pgmap v7: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:43.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:42 smithi084 ceph-mon[27000]: pgmap v7: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:45.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:44 smithi162 ceph-mon[30421]: pgmap v8: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-03-30T12:19:45.163 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:44 smithi084 ceph-mon[37565]: pgmap v8: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-03-30T12:19:45.163 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:44 smithi084 ceph-mon[27000]: pgmap v8: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-03-30T12:19:45.849 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:19:45.850 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":66,"fsid":"d3450b00-ee8e-11ee-b647-cb9ed24678a4","created":"2024-03-30T12:13:37.956825+0000","modified":"2024-03-30T12:19:37.818678+0000","last_up_change":"2024-03-30T12:18:42.422684+0000","last_in_change":"2024-03-30T12:18:24.854304+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T12:16:43.434051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T12:18:59.012249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T12:18:59.975381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"rbd","create_time":"2024-03-30T12:19:33.989566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a5734fa-c269-449c-805f-0a42d3d90120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6803","nonce":2597011613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6805","nonce":2597011613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6809","nonce":2597011613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6807","nonce":2597011613}]},"public_addr":"172.21.15.84:6803/2597011613","cluster_addr":"172.21.15.84:6805/2597011613","heartbeat_back_addr":"172.21.15.84:6809/2597011613","heartbeat_front_addr":"172.21.15.84:6807/2597011613","state":["exists","up"]},{"osd":1,"uuid":"3ffe676e-9055-44f7-8b04-87974b854b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6811","nonce":6106221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6813","nonce":6106221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6817","nonce":6106221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6815","nonce":6106221}]},"public_addr":"172.21.15.84:6811/6106221","cluster_addr":"172.21.15.84:6813/6106221","heartbeat_back_addr":"172.21.15.84:6817/6106221","heartbeat_front_addr":"172.21.15.84:6815/6106221","state":["exists","up"]},{"osd":2,"uuid":"c21b4cb6-9ade-44d2-a7ba-33fe9b5dd3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6819","nonce":3627018831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6821","nonce":3627018831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6825","nonce":3627018831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6823","nonce":3627018831}]},"public_addr":"172.21.15.84:6819/3627018831","cluster_addr":"172.21.15.84:6821/3627018831","heartbeat_back_addr":"172.21.15.84:6825/3627018831","heartbeat_front_addr":"172.21.15.84:6823/3627018831","state":["exists","up"]},{"osd":3,"uuid":"d60cb7da-fc49-4cbf-855a-2957dcbf66b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6827","nonce":46835826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6829","nonce":46835826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6833","nonce":46835826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6831","nonce":46835826}]},"public_addr":"172.21.15.84:6827/46835826","cluster_addr":"172.21.15.84:6829/46835826","heartbeat_back_addr":"172.21.15.84:6833/46835826","heartbeat_front_addr":"172.21.15.84:6831/46835826","state":["exists","up"]},{"osd":4,"uuid":"46a5087f-cf7c-4bb2-bace-6e04d57496ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6801","nonce":592935958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6803","nonce":592935958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6807","nonce":592935958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6805","nonce":592935958}]},"public_addr":"172.21.15.162:6801/592935958","cluster_addr":"172.21.15.162:6803/592935958","heartbeat_back_addr":"172.21.15.162:6807/592935958","heartbeat_front_addr":"172.21.15.162:6805/592935958","state":["exists","up"]},{"osd":5,"uuid":"2408494e-0472-4cde-aac6-e87d919b6d2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6809","nonce":2786846638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6811","nonce":2786846638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6815","nonce":2786846638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6813","nonce":2786846638}]},"public_addr":"172.21.15.162:6809/2786846638","cluster_addr":"172.21.15.162:6811/2786846638","heartbeat_back_addr":"172.21.15.162:6815/2786846638","heartbeat_front_addr":"172.21.15.162:6813/2786846638","state":["exists","up"]},{"osd":6,"uuid":"f86781fa-6cb4-4abd-b759-84ff6d7b36d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6817","nonce":2493067564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6819","nonce":2493067564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6823","nonce":2493067564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6821","nonce":2493067564}]},"public_addr":"172.21.15.162:6817/2493067564","cluster_addr":"172.21.15.162:6819/2493067564","heartbeat_back_addr":"172.21.15.162:6823/2493067564","heartbeat_front_addr":"172.21.15.162:6821/2493067564","state":["exists","up"]},{"osd":7,"uuid":"49a38087-ec6c-4ae8-b932-9c59ff7d4321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6825","nonce":158814135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6827","nonce":158814135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6831","nonce":158814135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6829","nonce":158814135}]},"public_addr":"172.21.15.162:6825/158814135","cluster_addr":"172.21.15.162:6827/158814135","heartbeat_back_addr":"172.21.15.162:6831/158814135","heartbeat_front_addr":"172.21.15.162:6829/158814135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:15:49.285912+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:14.234967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:39.383506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:03.790574+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:26.131317+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:50.385373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:14.909835+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:40.707128+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6800/2648486638":"2024-03-31T12:19:35.808765+0000","172.21.15.84:0/1692747755":"2024-03-31T12:19:35.808765+0000","172.21.15.84:0/2147212239":"2024-03-31T12:19:35.808765+0000","172.21.15.84:0/1374515169":"2024-03-31T12:14:31.125768+0000","172.21.15.84:0/2743767955":"2024-03-31T12:19:35.808765+0000","172.21.15.84:6800/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6800/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/4071895056":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3672833890":"2024-03-31T12:19:35.808765+0000","172.21.15.84:6801/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6801/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3191408930":"2024-03-31T12:14:06.678373+0000","172.21.15.84:6801/2648486638":"2024-03-31T12:19:35.808765+0000","172.21.15.84:0/1433254333":"2024-03-31T12:14:31.125768+0000","172.21.15.84:0/1390761199":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3135527830":"2024-03-31T12:14:31.125768+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T12:19:46.192 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:45 smithi084 ceph-mon[37565]: pgmap v9: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-03-30T12:19:46.192 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:45 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/1271015222' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:19:46.192 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:45 smithi084 ceph-mon[27000]: pgmap v9: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-03-30T12:19:46.192 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:45 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/1271015222' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:19:46.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:45 smithi162 ceph-mon[30421]: pgmap v9: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-03-30T12:19:46.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:45 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/1271015222' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:19:46.842 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-03-30T12:19:46.843 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-03-30T12:19:47.283 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:19:49.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:48 smithi084 ceph-mon[37565]: pgmap v10: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 11 op/s 2024-03-30T12:19:49.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:48 smithi084 ceph-mon[27000]: pgmap v10: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 11 op/s 2024-03-30T12:19:49.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:48 smithi162 ceph-mon[30421]: pgmap v10: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 11 op/s 2024-03-30T12:19:49.400 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:19:49] "GET /metrics HTTP/1.1" 200 31026 "" "Prometheus/2.43.0" 2024-03-30T12:19:50.004 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:19:49 smithi084 systemd[1]: Starting Ceph alertmanager.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:19:50.820 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:19:50 smithi084 podman[69050]: 2024-03-30 12:19:50.426114357 +0000 UTC m=+0.019028341 image pull c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19 quay.io/prometheus/alertmanager:v0.25.0 2024-03-30T12:19:50.820 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:19:50 smithi084 podman[69050]: 2024-03-30 12:19:50.532739116 +0000 UTC m=+0.125653073 volume create dd4b693003cf9e114eb8678a4b5fd4f9c181fb8a410ce6a0157c8be9c73c2f21 2024-03-30T12:19:50.820 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:19:50 smithi084 podman[69050]: 2024-03-30 12:19:50.641410299 +0000 UTC m=+0.234324258 container create afc02392307017e6996d665e9355a9f0ffebaa52bd873f800446c886cd93d035 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T12:19:51.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:50 smithi162 ceph-mon[30421]: pgmap v11: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-30T12:19:51.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:50 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:19:51.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:50 smithi084 ceph-mon[37565]: pgmap v11: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-30T12:19:51.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:50 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:19:51.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:50 smithi084 ceph-mon[27000]: pgmap v11: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-30T12:19:51.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:50 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:19:51.178 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:19:50 smithi084 podman[69050]: 2024-03-30 12:19:50.952271554 +0000 UTC m=+0.545185520 container init afc02392307017e6996d665e9355a9f0ffebaa52bd873f800446c886cd93d035 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T12:19:51.178 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:19:50 smithi084 podman[69050]: 2024-03-30 12:19:50.955013202 +0000 UTC m=+0.547927165 container start afc02392307017e6996d665e9355a9f0ffebaa52bd873f800446c886cd93d035 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T12:19:51.178 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:19:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[69081]: ts=2024-03-30T12:19:50.967Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-03-30T12:19:51.178 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:19:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[69081]: ts=2024-03-30T12:19:50.967Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-03-30T12:19:51.178 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:19:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[69081]: ts=2024-03-30T12:19:50.968Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.84 port=9094 2024-03-30T12:19:51.178 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:19:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[69081]: ts=2024-03-30T12:19:50.969Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-03-30T12:19:51.179 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:19:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[69081]: ts=2024-03-30T12:19:50.992Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-30T12:19:51.179 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:19:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[69081]: ts=2024-03-30T12:19:50.992Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-30T12:19:51.179 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:19:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[69081]: ts=2024-03-30T12:19:50.995Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-03-30T12:19:51.179 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:19:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[69081]: ts=2024-03-30T12:19:50.995Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-03-30T12:19:51.179 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:19:51 smithi084 bash[69050]: afc02392307017e6996d665e9355a9f0ffebaa52bd873f800446c886cd93d035 2024-03-30T12:19:51.179 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:19:51 smithi084 systemd[1]: Started Ceph alertmanager.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:19:51.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:19:51] ENGINE Bus STOPPING 2024-03-30T12:19:51.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:19:51] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T12:19:51.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:19:51] ENGINE Bus STOPPED 2024-03-30T12:19:51.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:19:51] ENGINE Bus STARTING 2024-03-30T12:19:51.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:19:51] ENGINE Serving on http://:::9283 2024-03-30T12:19:51.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:19:51] ENGINE Bus STARTED 2024-03-30T12:19:51.726 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:19:51.726 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":66,"fsid":"d3450b00-ee8e-11ee-b647-cb9ed24678a4","created":"2024-03-30T12:13:37.956825+0000","modified":"2024-03-30T12:19:37.818678+0000","last_up_change":"2024-03-30T12:18:42.422684+0000","last_in_change":"2024-03-30T12:18:24.854304+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T12:16:43.434051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T12:18:59.012249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T12:18:59.975381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"rbd","create_time":"2024-03-30T12:19:33.989566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a5734fa-c269-449c-805f-0a42d3d90120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6803","nonce":2597011613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6805","nonce":2597011613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6809","nonce":2597011613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6807","nonce":2597011613}]},"public_addr":"172.21.15.84:6803/2597011613","cluster_addr":"172.21.15.84:6805/2597011613","heartbeat_back_addr":"172.21.15.84:6809/2597011613","heartbeat_front_addr":"172.21.15.84:6807/2597011613","state":["exists","up"]},{"osd":1,"uuid":"3ffe676e-9055-44f7-8b04-87974b854b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6811","nonce":6106221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6813","nonce":6106221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6817","nonce":6106221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6815","nonce":6106221}]},"public_addr":"172.21.15.84:6811/6106221","cluster_addr":"172.21.15.84:6813/6106221","heartbeat_back_addr":"172.21.15.84:6817/6106221","heartbeat_front_addr":"172.21.15.84:6815/6106221","state":["exists","up"]},{"osd":2,"uuid":"c21b4cb6-9ade-44d2-a7ba-33fe9b5dd3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6819","nonce":3627018831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6821","nonce":3627018831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6825","nonce":3627018831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6823","nonce":3627018831}]},"public_addr":"172.21.15.84:6819/3627018831","cluster_addr":"172.21.15.84:6821/3627018831","heartbeat_back_addr":"172.21.15.84:6825/3627018831","heartbeat_front_addr":"172.21.15.84:6823/3627018831","state":["exists","up"]},{"osd":3,"uuid":"d60cb7da-fc49-4cbf-855a-2957dcbf66b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6827","nonce":46835826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6829","nonce":46835826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6833","nonce":46835826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6831","nonce":46835826}]},"public_addr":"172.21.15.84:6827/46835826","cluster_addr":"172.21.15.84:6829/46835826","heartbeat_back_addr":"172.21.15.84:6833/46835826","heartbeat_front_addr":"172.21.15.84:6831/46835826","state":["exists","up"]},{"osd":4,"uuid":"46a5087f-cf7c-4bb2-bace-6e04d57496ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6801","nonce":592935958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6803","nonce":592935958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6807","nonce":592935958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6805","nonce":592935958}]},"public_addr":"172.21.15.162:6801/592935958","cluster_addr":"172.21.15.162:6803/592935958","heartbeat_back_addr":"172.21.15.162:6807/592935958","heartbeat_front_addr":"172.21.15.162:6805/592935958","state":["exists","up"]},{"osd":5,"uuid":"2408494e-0472-4cde-aac6-e87d919b6d2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6809","nonce":2786846638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6811","nonce":2786846638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6815","nonce":2786846638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6813","nonce":2786846638}]},"public_addr":"172.21.15.162:6809/2786846638","cluster_addr":"172.21.15.162:6811/2786846638","heartbeat_back_addr":"172.21.15.162:6815/2786846638","heartbeat_front_addr":"172.21.15.162:6813/2786846638","state":["exists","up"]},{"osd":6,"uuid":"f86781fa-6cb4-4abd-b759-84ff6d7b36d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6817","nonce":2493067564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6819","nonce":2493067564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6823","nonce":2493067564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6821","nonce":2493067564}]},"public_addr":"172.21.15.162:6817/2493067564","cluster_addr":"172.21.15.162:6819/2493067564","heartbeat_back_addr":"172.21.15.162:6823/2493067564","heartbeat_front_addr":"172.21.15.162:6821/2493067564","state":["exists","up"]},{"osd":7,"uuid":"49a38087-ec6c-4ae8-b932-9c59ff7d4321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6825","nonce":158814135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6827","nonce":158814135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6831","nonce":158814135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6829","nonce":158814135}]},"public_addr":"172.21.15.162:6825/158814135","cluster_addr":"172.21.15.162:6827/158814135","heartbeat_back_addr":"172.21.15.162:6831/158814135","heartbeat_front_addr":"172.21.15.162:6829/158814135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:15:49.285912+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:14.234967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:39.383506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:03.790574+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:26.131317+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:50.385373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:14.909835+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:40.707128+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6800/2648486638":"2024-03-31T12:19:35.808765+0000","172.21.15.84:0/1692747755":"2024-03-31T12:19:35.808765+0000","172.21.15.84:0/2147212239":"2024-03-31T12:19:35.808765+0000","172.21.15.84:0/1374515169":"2024-03-31T12:14:31.125768+0000","172.21.15.84:0/2743767955":"2024-03-31T12:19:35.808765+0000","172.21.15.84:6800/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6800/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/4071895056":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3672833890":"2024-03-31T12:19:35.808765+0000","172.21.15.84:6801/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6801/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3191408930":"2024-03-31T12:14:06.678373+0000","172.21.15.84:6801/2648486638":"2024-03-31T12:19:35.808765+0000","172.21.15.84:0/1433254333":"2024-03-31T12:14:31.125768+0000","172.21.15.84:0/1390761199":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3135527830":"2024-03-31T12:14:31.125768+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T12:19:52.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:52 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:52.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:52 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:52.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:52 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:52.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:52 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:52.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:52 smithi162 ceph-mon[30421]: Regenerating cephadm self-signed grafana TLS certificates 2024-03-30T12:19:52.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:52 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:52.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:52 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:52.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:52 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-30T12:19:52.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:52 smithi162 ceph-mon[30421]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-30T12:19:52.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:52 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:52.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:52 smithi162 ceph-mon[30421]: Deploying daemon grafana.a on smithi162 2024-03-30T12:19:52.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:52 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/4094545946' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:19:52.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:52 smithi162 ceph-mon[30421]: pgmap v12: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-30T12:19:52.417 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:52.418 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:52.418 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:52.418 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:52.418 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[27000]: Regenerating cephadm self-signed grafana TLS certificates 2024-03-30T12:19:52.418 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:52.418 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:52.418 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-30T12:19:52.418 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[27000]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-30T12:19:52.418 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:52.418 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[27000]: Deploying daemon grafana.a on smithi162 2024-03-30T12:19:52.418 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/4094545946' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:19:52.418 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[27000]: pgmap v12: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-30T12:19:52.419 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:52.419 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:52.419 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:52.419 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:52.419 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[37565]: Regenerating cephadm self-signed grafana TLS certificates 2024-03-30T12:19:52.419 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:52.419 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:52.419 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-30T12:19:52.419 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[37565]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-30T12:19:52.419 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:52.419 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[37565]: Deploying daemon grafana.a on smithi162 2024-03-30T12:19:52.419 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/4094545946' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:19:52.419 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-mon[37565]: pgmap v12: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-30T12:19:52.442 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph tell osd.0 flush_pg_stats 2024-03-30T12:19:52.442 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph tell osd.1 flush_pg_stats 2024-03-30T12:19:52.443 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph tell osd.2 flush_pg_stats 2024-03-30T12:19:52.443 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph tell osd.3 flush_pg_stats 2024-03-30T12:19:52.444 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph tell osd.4 flush_pg_stats 2024-03-30T12:19:52.444 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph tell osd.5 flush_pg_stats 2024-03-30T12:19:52.444 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph tell osd.6 flush_pg_stats 2024-03-30T12:19:52.445 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph tell osd.7 flush_pg_stats 2024-03-30T12:19:52.836 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:19:52.836 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:19:52.855 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:19:52.856 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:19:52.864 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:19:52.865 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:19:52.866 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:19:52.888 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:19:53.228 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:19:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[69081]: ts=2024-03-30T12:19:52.970Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.001054574s 2024-03-30T12:19:55.167 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:54 smithi084 ceph-mon[37565]: pgmap v13: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-30T12:19:55.167 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:54 smithi084 ceph-mon[27000]: pgmap v13: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-30T12:19:55.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:54 smithi162 ceph-mon[30421]: pgmap v13: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-30T12:19:57.117 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:56 smithi084 ceph-mon[27000]: pgmap v14: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:57.117 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:56 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:57.117 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:56 smithi084 ceph-mon[37565]: pgmap v14: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:57.117 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:56 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:57.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:56 smithi162 ceph-mon[30421]: pgmap v14: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:57.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:56 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:19:59.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:19:58 smithi162 ceph-mon[30421]: pgmap v15: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:59.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:19:58 smithi084 ceph-mon[37565]: pgmap v15: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:59.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:19:58 smithi084 ceph-mon[27000]: pgmap v15: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:19:59.526 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:19:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:19:59] "GET /metrics HTTP/1.1" 200 33651 "" "Prometheus/2.43.0" 2024-03-30T12:20:01.144 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:00 smithi084 ceph-mon[37565]: pgmap v16: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:01.144 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:00 smithi084 ceph-mon[37565]: overall HEALTH_OK 2024-03-30T12:20:01.144 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:00 smithi084 ceph-mon[27000]: pgmap v16: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:01.144 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:00 smithi084 ceph-mon[27000]: overall HEALTH_OK 2024-03-30T12:20:01.144 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[69081]: ts=2024-03-30T12:20:00.972Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.002838374s 2024-03-30T12:20:01.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:00 smithi162 ceph-mon[30421]: pgmap v16: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:01.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:00 smithi162 ceph-mon[30421]: overall HEALTH_OK 2024-03-30T12:20:02.312 INFO:teuthology.orchestra.run.smithi084.stdout:55834574895 2024-03-30T12:20:02.313 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.1 2024-03-30T12:20:03.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:02 smithi084 ceph-mon[37565]: pgmap v17: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:03.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:02 smithi084 ceph-mon[27000]: pgmap v17: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:03.338 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:02 smithi162 ceph-mon[30421]: pgmap v17: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:04.319 INFO:teuthology.orchestra.run.smithi084.stdout:231928234003 2024-03-30T12:20:04.319 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.7 2024-03-30T12:20:05.035 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:04 smithi162 ceph-mon[30421]: pgmap v18: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:05.116 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:04 smithi084 ceph-mon[27000]: pgmap v18: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:05.116 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:04 smithi084 ceph-mon[37565]: pgmap v18: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:05.620 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 systemd[1]: Started Ceph grafana.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:20:05.890 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=settings t=2024-03-30T12:20:05.646407166Z level=info msg="Starting Grafana" version=9.4.7 commit=4add91f03d branch=HEAD compiled=2023-03-16T23:56:52Z 2024-03-30T12:20:05.890 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=settings t=2024-03-30T12:20:05.646594723Z level=warn msg="\"sentry\" frontend logging provider is deprecated and will be removed in the next major version. Use \"grafana\" provider instead." 2024-03-30T12:20:05.890 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=settings t=2024-03-30T12:20:05.6466132Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-03-30T12:20:05.890 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=settings t=2024-03-30T12:20:05.646620902Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-03-30T12:20:05.890 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=settings t=2024-03-30T12:20:05.646627525Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-03-30T12:20:05.890 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=settings t=2024-03-30T12:20:05.646633576Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-03-30T12:20:05.890 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=settings t=2024-03-30T12:20:05.646639317Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-03-30T12:20:05.890 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=settings t=2024-03-30T12:20:05.646645226Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-03-30T12:20:05.890 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=settings t=2024-03-30T12:20:05.646651192Z level=info msg="Path Home" path=/usr/share/grafana 2024-03-30T12:20:05.891 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=settings t=2024-03-30T12:20:05.64665696Z level=info msg="Path Data" path=/var/lib/grafana 2024-03-30T12:20:05.891 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=settings t=2024-03-30T12:20:05.646662428Z level=info msg="Path Logs" path=/var/log/grafana 2024-03-30T12:20:05.891 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=settings t=2024-03-30T12:20:05.646667808Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-03-30T12:20:05.891 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=settings t=2024-03-30T12:20:05.646674006Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-03-30T12:20:05.891 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=settings t=2024-03-30T12:20:05.646680835Z level=info msg="App mode production" 2024-03-30T12:20:05.891 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=sqlstore t=2024-03-30T12:20:05.646725394Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-03-30T12:20:05.891 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=sqlstore t=2024-03-30T12:20:05.646740976Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-03-30T12:20:05.891 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.647588521Z level=info msg="Starting DB migrations" 2024-03-30T12:20:05.891 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.6476605Z level=info msg="Executing migration" id="create migration_log table" 2024-03-30T12:20:05.891 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.648183802Z level=info msg="Executing migration" id="create user table" 2024-03-30T12:20:05.891 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.648649378Z level=info msg="Executing migration" id="add unique index user.login" 2024-03-30T12:20:05.891 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.649153421Z level=info msg="Executing migration" id="add unique index user.email" 2024-03-30T12:20:05.891 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.64962388Z level=info msg="Executing migration" id="drop index UQE_user_login - v1" 2024-03-30T12:20:05.891 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.650235843Z level=info msg="Executing migration" id="drop index UQE_user_email - v1" 2024-03-30T12:20:05.892 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.650641525Z level=info msg="Executing migration" id="Rename table user to user_v1 - v1" 2024-03-30T12:20:05.892 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.65133378Z level=info msg="Executing migration" id="create user table v2" 2024-03-30T12:20:05.892 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.651727114Z level=info msg="Executing migration" id="create index UQE_user_login - v2" 2024-03-30T12:20:05.892 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.65214752Z level=info msg="Executing migration" id="create index UQE_user_email - v2" 2024-03-30T12:20:05.892 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.652571843Z level=info msg="Executing migration" id="copy data_source v1 to v2" 2024-03-30T12:20:05.892 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.652919786Z level=info msg="Executing migration" id="Drop old table user_v1" 2024-03-30T12:20:05.892 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.653312179Z level=info msg="Executing migration" id="Add column help_flags1 to user table" 2024-03-30T12:20:05.892 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.653723219Z level=info msg="Executing migration" id="Update user table charset" 2024-03-30T12:20:05.892 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.654020048Z level=info msg="Executing migration" id="Add last_seen_at column to user" 2024-03-30T12:20:05.892 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.654457791Z level=info msg="Executing migration" id="Add missing user data" 2024-03-30T12:20:05.892 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.654799381Z level=info msg="Executing migration" id="Add is_disabled column to user" 2024-03-30T12:20:05.892 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.655249697Z level=info msg="Executing migration" id="Add index user.login/user.email" 2024-03-30T12:20:05.892 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.655672148Z level=info msg="Executing migration" id="Add is_service_account column to user" 2024-03-30T12:20:05.892 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.656127645Z level=info msg="Executing migration" id="Update is_service_account column to nullable" 2024-03-30T12:20:05.893 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.657268365Z level=info msg="Executing migration" id="create temp user table v1-7" 2024-03-30T12:20:05.894 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.657747507Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v1-7" 2024-03-30T12:20:05.894 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.658207996Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v1-7" 2024-03-30T12:20:05.894 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.658604442Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v1-7" 2024-03-30T12:20:05.894 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.658996026Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v1-7" 2024-03-30T12:20:05.894 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.659384798Z level=info msg="Executing migration" id="Update temp_user table charset" 2024-03-30T12:20:05.894 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.659650116Z level=info msg="Executing migration" id="drop index IDX_temp_user_email - v1" 2024-03-30T12:20:05.894 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.660000815Z level=info msg="Executing migration" id="drop index IDX_temp_user_org_id - v1" 2024-03-30T12:20:05.894 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.660380898Z level=info msg="Executing migration" id="drop index IDX_temp_user_code - v1" 2024-03-30T12:20:05.894 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.660771606Z level=info msg="Executing migration" id="drop index IDX_temp_user_status - v1" 2024-03-30T12:20:05.895 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.661161904Z level=info msg="Executing migration" id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-03-30T12:20:05.895 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.661814611Z level=info msg="Executing migration" id="create temp_user v2" 2024-03-30T12:20:05.895 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.66221633Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v2" 2024-03-30T12:20:05.895 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.662607616Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v2" 2024-03-30T12:20:05.895 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.662981295Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v2" 2024-03-30T12:20:05.895 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.663364519Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v2" 2024-03-30T12:20:05.895 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.663751819Z level=info msg="Executing migration" id="copy temp_user v1 to v2" 2024-03-30T12:20:05.895 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.664077976Z level=info msg="Executing migration" id="drop temp_user_tmp_qwerty" 2024-03-30T12:20:05.895 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.664418237Z level=info msg="Executing migration" id="Set created for temp users that will otherwise prematurely expire" 2024-03-30T12:20:05.895 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.664718412Z level=info msg="Executing migration" id="create star table" 2024-03-30T12:20:05.895 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.665065716Z level=info msg="Executing migration" id="add unique index star.user_id_dashboard_id" 2024-03-30T12:20:05.895 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.665466221Z level=info msg="Executing migration" id="create org table v1" 2024-03-30T12:20:05.895 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.665841239Z level=info msg="Executing migration" id="create index UQE_org_name - v1" 2024-03-30T12:20:05.895 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.66623821Z level=info msg="Executing migration" id="create org_user table v1" 2024-03-30T12:20:05.895 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.666606747Z level=info msg="Executing migration" id="create index IDX_org_user_org_id - v1" 2024-03-30T12:20:05.895 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.667011975Z level=info msg="Executing migration" id="create index UQE_org_user_org_id_user_id - v1" 2024-03-30T12:20:05.896 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.66741187Z level=info msg="Executing migration" id="create index IDX_org_user_user_id - v1" 2024-03-30T12:20:05.896 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.667791992Z level=info msg="Executing migration" id="Update org table charset" 2024-03-30T12:20:05.896 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.668649211Z level=info msg="Executing migration" id="Update org_user table charset" 2024-03-30T12:20:05.896 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.669046778Z level=info msg="Executing migration" id="Migrate all Read Only Viewers to Viewers" 2024-03-30T12:20:05.896 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.669451606Z level=info msg="Executing migration" id="create dashboard table" 2024-03-30T12:20:05.896 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.670259963Z level=info msg="Executing migration" id="add index dashboard.account_id" 2024-03-30T12:20:05.896 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.671160428Z level=info msg="Executing migration" id="add unique index dashboard_account_id_slug" 2024-03-30T12:20:05.896 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.671602374Z level=info msg="Executing migration" id="create dashboard_tag table" 2024-03-30T12:20:05.896 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.672462511Z level=info msg="Executing migration" id="add unique index dashboard_tag.dasboard_id_term" 2024-03-30T12:20:05.896 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.673300966Z level=info msg="Executing migration" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-03-30T12:20:05.896 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.67413312Z level=info msg="Executing migration" id="Rename table dashboard to dashboard_v1 - v1" 2024-03-30T12:20:05.896 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.675029203Z level=info msg="Executing migration" id="create dashboard v2" 2024-03-30T12:20:05.896 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.675902472Z level=info msg="Executing migration" id="create index IDX_dashboard_org_id - v2" 2024-03-30T12:20:05.897 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.676762685Z level=info msg="Executing migration" id="create index UQE_dashboard_org_id_slug - v2" 2024-03-30T12:20:05.897 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.677594663Z level=info msg="Executing migration" id="copy dashboard v1 to v2" 2024-03-30T12:20:05.897 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.678413688Z level=info msg="Executing migration" id="drop table dashboard_v1" 2024-03-30T12:20:05.897 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.679298163Z level=info msg="Executing migration" id="alter dashboard.data to mediumtext v1" 2024-03-30T12:20:05.897 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.680146404Z level=info msg="Executing migration" id="Add column updated_by in dashboard - v2" 2024-03-30T12:20:05.897 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.681012674Z level=info msg="Executing migration" id="Add column created_by in dashboard - v2" 2024-03-30T12:20:05.897 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.681861073Z level=info msg="Executing migration" id="Add column gnetId in dashboard" 2024-03-30T12:20:05.897 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.68470351Z level=info msg="Executing migration" id="Add index for gnetId in dashboard" 2024-03-30T12:20:05.897 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.687355636Z level=info msg="Executing migration" id="Add column plugin_id in dashboard" 2024-03-30T12:20:05.897 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.690243323Z level=info msg="Executing migration" id="Add index for plugin_id in dashboard" 2024-03-30T12:20:05.897 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.693097837Z level=info msg="Executing migration" id="Add index for dashboard_id in dashboard_tag" 2024-03-30T12:20:05.897 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.695718533Z level=info msg="Executing migration" id="Update dashboard table charset" 2024-03-30T12:20:05.897 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.698461489Z level=info msg="Executing migration" id="Update dashboard_tag table charset" 2024-03-30T12:20:05.898 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.701066966Z level=info msg="Executing migration" id="Add column folder_id in dashboard" 2024-03-30T12:20:05.898 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.701568184Z level=info msg="Executing migration" id="Add column isFolder in dashboard" 2024-03-30T12:20:05.898 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.703757699Z level=info msg="Executing migration" id="Add column has_acl in dashboard" 2024-03-30T12:20:05.898 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.70647129Z level=info msg="Executing migration" id="Add column uid in dashboard" 2024-03-30T12:20:05.898 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.709106887Z level=info msg="Executing migration" id="Update uid column values in dashboard" 2024-03-30T12:20:05.898 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.712034134Z level=info msg="Executing migration" id="Add unique index dashboard_org_id_uid" 2024-03-30T12:20:05.898 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.714727605Z level=info msg="Executing migration" id="Remove unique index org_id_slug" 2024-03-30T12:20:05.898 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.717438579Z level=info msg="Executing migration" id="Update dashboard title length" 2024-03-30T12:20:05.898 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.720132176Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_title_folder_id" 2024-03-30T12:20:05.898 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.723108664Z level=info msg="Executing migration" id="create dashboard_provisioning" 2024-03-30T12:20:05.898 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.725781941Z level=info msg="Executing migration" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-03-30T12:20:05.898 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.728573902Z level=info msg="Executing migration" id="create dashboard_provisioning v2" 2024-03-30T12:20:05.898 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.731470617Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-03-30T12:20:05.898 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.734213766Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-03-30T12:20:05.899 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.737017253Z level=info msg="Executing migration" id="copy dashboard_provisioning v1 to v2" 2024-03-30T12:20:05.899 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.739637699Z level=info msg="Executing migration" id="drop dashboard_provisioning_tmp_qwerty" 2024-03-30T12:20:05.899 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.742483989Z level=info msg="Executing migration" id="Add check_sum column" 2024-03-30T12:20:05.899 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.744993776Z level=info msg="Executing migration" id="Add index for dashboard_title" 2024-03-30T12:20:05.899 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.747615544Z level=info msg="Executing migration" id="delete tags for deleted dashboards" 2024-03-30T12:20:05.899 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.750370722Z level=info msg="Executing migration" id="delete stars for deleted dashboards" 2024-03-30T12:20:05.899 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.753041644Z level=info msg="Executing migration" id="Add index for dashboard_is_folder" 2024-03-30T12:20:05.899 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.75557597Z level=info msg="Executing migration" id="Add isPublic for dashboard" 2024-03-30T12:20:05.899 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.758256584Z level=info msg="Executing migration" id="create data_source table" 2024-03-30T12:20:05.899 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.760823511Z level=info msg="Executing migration" id="add index data_source.account_id" 2024-03-30T12:20:05.899 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.763467978Z level=info msg="Executing migration" id="add unique index data_source.account_id_name" 2024-03-30T12:20:05.899 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.764015426Z level=info msg="Executing migration" id="drop index IDX_data_source_account_id - v1" 2024-03-30T12:20:05.899 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.766710519Z level=info msg="Executing migration" id="drop index UQE_data_source_account_id_name - v1" 2024-03-30T12:20:05.899 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.769316926Z level=info msg="Executing migration" id="Rename table data_source to data_source_v1 - v1" 2024-03-30T12:20:05.899 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.772125789Z level=info msg="Executing migration" id="create data_source table v2" 2024-03-30T12:20:05.900 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.774540536Z level=info msg="Executing migration" id="create index IDX_data_source_org_id - v2" 2024-03-30T12:20:05.900 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.777292135Z level=info msg="Executing migration" id="create index UQE_data_source_org_id_name - v2" 2024-03-30T12:20:05.900 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.778091495Z level=info msg="Executing migration" id="Drop old table data_source_v1 #2" 2024-03-30T12:20:05.900 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.778832627Z level=info msg="Executing migration" id="Add column with_credentials" 2024-03-30T12:20:05.900 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.77973655Z level=info msg="Executing migration" id="Add secure json data column" 2024-03-30T12:20:05.900 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.780546136Z level=info msg="Executing migration" id="Update data_source table charset" 2024-03-30T12:20:05.900 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.781325298Z level=info msg="Executing migration" id="Update initial version to 1" 2024-03-30T12:20:05.900 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.782071616Z level=info msg="Executing migration" id="Add read_only data column" 2024-03-30T12:20:05.900 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.782869711Z level=info msg="Executing migration" id="Migrate logging ds to loki ds" 2024-03-30T12:20:05.900 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.78366202Z level=info msg="Executing migration" id="Update json_data with nulls" 2024-03-30T12:20:05.900 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.784559211Z level=info msg="Executing migration" id="Add uid column" 2024-03-30T12:20:05.900 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.785315576Z level=info msg="Executing migration" id="Update uid value" 2024-03-30T12:20:05.900 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.786170522Z level=info msg="Executing migration" id="Add unique index datasource_org_id_uid" 2024-03-30T12:20:05.900 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.786611624Z level=info msg="Executing migration" id="add unique index datasource_org_id_is_default" 2024-03-30T12:20:05.900 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.789429308Z level=info msg="Executing migration" id="create api_key table" 2024-03-30T12:20:05.901 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.792258643Z level=info msg="Executing migration" id="add index api_key.account_id" 2024-03-30T12:20:05.901 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.795211168Z level=info msg="Executing migration" id="add index api_key.key" 2024-03-30T12:20:05.901 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.79818369Z level=info msg="Executing migration" id="add index api_key.account_id_name" 2024-03-30T12:20:05.901 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.800854189Z level=info msg="Executing migration" id="drop index IDX_api_key_account_id - v1" 2024-03-30T12:20:05.901 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.803471777Z level=info msg="Executing migration" id="drop index UQE_api_key_key - v1" 2024-03-30T12:20:05.901 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.80388382Z level=info msg="Executing migration" id="drop index UQE_api_key_account_id_name - v1" 2024-03-30T12:20:05.901 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.806819295Z level=info msg="Executing migration" id="Rename table api_key to api_key_v1 - v1" 2024-03-30T12:20:05.901 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.809721831Z level=info msg="Executing migration" id="create api_key table v2" 2024-03-30T12:20:05.901 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.812424065Z level=info msg="Executing migration" id="create index IDX_api_key_org_id - v2" 2024-03-30T12:20:05.901 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.815133595Z level=info msg="Executing migration" id="create index UQE_api_key_key - v2" 2024-03-30T12:20:05.901 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.817866633Z level=info msg="Executing migration" id="create index UQE_api_key_org_id_name - v2" 2024-03-30T12:20:05.901 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.820765597Z level=info msg="Executing migration" id="copy api_key v1 to v2" 2024-03-30T12:20:05.902 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.823494708Z level=info msg="Executing migration" id="Drop old table api_key_v1" 2024-03-30T12:20:05.902 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.82388482Z level=info msg="Executing migration" id="Update api_key table charset" 2024-03-30T12:20:05.902 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.82661186Z level=info msg="Executing migration" id="Add expires to api_key table" 2024-03-30T12:20:05.902 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.829505025Z level=info msg="Executing migration" id="Add service account foreign key" 2024-03-30T12:20:05.902 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.832438922Z level=info msg="Executing migration" id="set service account foreign key to nil if 0" 2024-03-30T12:20:05.902 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.832854699Z level=info msg="Executing migration" id="Add last_used_at to api_key table" 2024-03-30T12:20:05.902 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.835648231Z level=info msg="Executing migration" id="Add is_revoked column to api_key table" 2024-03-30T12:20:05.902 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.838433101Z level=info msg="Executing migration" id="create dashboard_snapshot table v4" 2024-03-30T12:20:05.902 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.840949055Z level=info msg="Executing migration" id="drop table dashboard_snapshot_v4 #1" 2024-03-30T12:20:05.902 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.841370412Z level=info msg="Executing migration" id="create dashboard_snapshot table v5 #2" 2024-03-30T12:20:05.902 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.843818758Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_key - v5" 2024-03-30T12:20:05.902 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.844306669Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-03-30T12:20:05.902 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.846610134Z level=info msg="Executing migration" id="create index IDX_dashboard_snapshot_user_id - v5" 2024-03-30T12:20:05.903 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.849295194Z level=info msg="Executing migration" id="alter dashboard_snapshot to mediumtext v2" 2024-03-30T12:20:05.903 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.849614413Z level=info msg="Executing migration" id="Update dashboard_snapshot table charset" 2024-03-30T12:20:05.903 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.85219284Z level=info msg="Executing migration" id="Add column external_delete_url to dashboard_snapshots table" 2024-03-30T12:20:05.903 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.852822966Z level=info msg="Executing migration" id="Add encrypted dashboard json column" 2024-03-30T12:20:05.903 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.854796188Z level=info msg="Executing migration" id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-03-30T12:20:05.903 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.857422146Z level=info msg="Executing migration" id="create quota table v1" 2024-03-30T12:20:05.903 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.857857355Z level=info msg="Executing migration" id="create index UQE_quota_org_id_user_id_target - v1" 2024-03-30T12:20:05.903 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.86053412Z level=info msg="Executing migration" id="Update quota table charset" 2024-03-30T12:20:05.903 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.863230417Z level=info msg="Executing migration" id="create plugin_setting table" 2024-03-30T12:20:05.903 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.863948033Z level=info msg="Executing migration" id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-03-30T12:20:05.903 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.864416984Z level=info msg="Executing migration" id="Add column plugin_version to plugin_settings" 2024-03-30T12:20:05.903 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.865236768Z level=info msg="Executing migration" id="Update plugin_setting table charset" 2024-03-30T12:20:05.903 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.865568384Z level=info msg="Executing migration" id="create session table" 2024-03-30T12:20:05.903 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.866111198Z level=info msg="Executing migration" id="Drop old table playlist table" 2024-03-30T12:20:05.903 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.866935959Z level=info msg="Executing migration" id="Drop old table playlist_item table" 2024-03-30T12:20:05.903 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.867308349Z level=info msg="Executing migration" id="create playlist table v2" 2024-03-30T12:20:05.904 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.868119866Z level=info msg="Executing migration" id="create playlist item table v2" 2024-03-30T12:20:05.904 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.869111181Z level=info msg="Executing migration" id="Update playlist table charset" 2024-03-30T12:20:05.904 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.869749345Z level=info msg="Executing migration" id="Update playlist_item table charset" 2024-03-30T12:20:05.904 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.870640352Z level=info msg="Executing migration" id="drop preferences table v2" 2024-03-30T12:20:05.904 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.871119025Z level=info msg="Executing migration" id="drop preferences table v3" 2024-03-30T12:20:05.904 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.87147332Z level=info msg="Executing migration" id="create preferences table v3" 2024-03-30T12:20:05.904 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.872394474Z level=info msg="Executing migration" id="Update preferences table charset" 2024-03-30T12:20:05.904 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.873097957Z level=info msg="Executing migration" id="Add column team_id in preferences" 2024-03-30T12:20:05.904 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.873753424Z level=info msg="Executing migration" id="Update team_id column values in preferences" 2024-03-30T12:20:05.904 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.874526818Z level=info msg="Executing migration" id="Add column week_start in preferences" 2024-03-30T12:20:05.904 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.8751906Z level=info msg="Executing migration" id="Add column preferences.json_data" 2024-03-30T12:20:05.904 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.875850032Z level=info msg="Executing migration" id="alter preferences.json_data to mediumtext v1" 2024-03-30T12:20:05.904 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.876781627Z level=info msg="Executing migration" id="Add preferences index org_id" 2024-03-30T12:20:05.904 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.877375937Z level=info msg="Executing migration" id="Add preferences index user_id" 2024-03-30T12:20:05.904 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.878435699Z level=info msg="Executing migration" id="create alert table v1" 2024-03-30T12:20:05.904 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.879113956Z level=info msg="Executing migration" id="add index alert org_id & id " 2024-03-30T12:20:05.905 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.879973246Z level=info msg="Executing migration" id="add index alert state" 2024-03-30T12:20:05.905 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.880822689Z level=info msg="Executing migration" id="add index alert dashboard_id" 2024-03-30T12:20:05.905 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.88170046Z level=info msg="Executing migration" id="Create alert_rule_tag table v1" 2024-03-30T12:20:05.905 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.882640921Z level=info msg="Executing migration" id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-03-30T12:20:05.905 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.883568544Z level=info msg="Executing migration" id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-03-30T12:20:05.905 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.884293736Z level=info msg="Executing migration" id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-03-30T12:20:05.905 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.885752452Z level=info msg="Executing migration" id="Create alert_rule_tag table v2" 2024-03-30T12:20:05.905 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.886656476Z level=info msg="Executing migration" id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-03-30T12:20:05.905 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.887453982Z level=info msg="Executing migration" id="copy alert_rule_tag v1 to v2" 2024-03-30T12:20:05.905 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.888294129Z level=info msg="Executing migration" id="drop table alert_rule_tag_v1" 2024-03-30T12:20:05.905 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.889296425Z level=info msg="Executing migration" id="create alert_notification table v1" 2024-03-30T12:20:05.905 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.890074863Z level=info msg="Executing migration" id="Add column is_default" 2024-03-30T12:20:05.905 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.892900885Z level=info msg="Executing migration" id="Add column frequency" 2024-03-30T12:20:05.905 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.895602834Z level=info msg="Executing migration" id="Add column send_reminder" 2024-03-30T12:20:05.905 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.89858589Z level=info msg="Executing migration" id="Add column disable_resolve_message" 2024-03-30T12:20:05.905 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.901318249Z level=info msg="Executing migration" id="add index alert_notification org_id & name" 2024-03-30T12:20:06.140 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.903916616Z level=info msg="Executing migration" id="Update alert table charset" 2024-03-30T12:20:06.141 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.906712616Z level=info msg="Executing migration" id="Update alert_notification table charset" 2024-03-30T12:20:06.141 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.909652346Z level=info msg="Executing migration" id="create notification_journal table v1" 2024-03-30T12:20:06.141 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.912421905Z level=info msg="Executing migration" id="add index notification_journal org_id & alert_id & notifier_id" 2024-03-30T12:20:06.141 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.915329381Z level=info msg="Executing migration" id="drop alert_notification_journal" 2024-03-30T12:20:06.141 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.91804213Z level=info msg="Executing migration" id="create alert_notification_state table v1" 2024-03-30T12:20:06.141 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.92078635Z level=info msg="Executing migration" id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-03-30T12:20:06.141 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.923782515Z level=info msg="Executing migration" id="Add for to alert table" 2024-03-30T12:20:06.141 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.926680711Z level=info msg="Executing migration" id="Add column uid in alert_notification" 2024-03-30T12:20:06.141 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.929325023Z level=info msg="Executing migration" id="Update uid column values in alert_notification" 2024-03-30T12:20:06.141 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.932307398Z level=info msg="Executing migration" id="Add unique index alert_notification_org_id_uid" 2024-03-30T12:20:06.141 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.935143048Z level=info msg="Executing migration" id="Remove unique index org_id_name" 2024-03-30T12:20:06.141 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.938126857Z level=info msg="Executing migration" id="Add column secure_settings in alert_notification" 2024-03-30T12:20:06.142 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.940478761Z level=info msg="Executing migration" id="alter alert.settings to mediumtext" 2024-03-30T12:20:06.142 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.943346204Z level=info msg="Executing migration" id="Add non-unique index alert_notification_state_alert_id" 2024-03-30T12:20:06.142 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.946258905Z level=info msg="Executing migration" id="Add non-unique index alert_rule_tag_alert_id" 2024-03-30T12:20:06.142 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.948916281Z level=info msg="Executing migration" id="Drop old annotation table v4" 2024-03-30T12:20:06.142 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.951601306Z level=info msg="Executing migration" id="create annotation table v5" 2024-03-30T12:20:06.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.954277608Z level=info msg="Executing migration" id="add index annotation 0 v3" 2024-03-30T12:20:06.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.956846679Z level=info msg="Executing migration" id="add index annotation 1 v3" 2024-03-30T12:20:06.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.959574391Z level=info msg="Executing migration" id="add index annotation 2 v3" 2024-03-30T12:20:06.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.962187711Z level=info msg="Executing migration" id="add index annotation 3 v3" 2024-03-30T12:20:06.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.965015036Z level=info msg="Executing migration" id="add index annotation 4 v3" 2024-03-30T12:20:06.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.967651628Z level=info msg="Executing migration" id="Update annotation table charset" 2024-03-30T12:20:06.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.970161638Z level=info msg="Executing migration" id="Add column region_id to annotation table" 2024-03-30T12:20:06.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.972838788Z level=info msg="Executing migration" id="Drop category_id index" 2024-03-30T12:20:06.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.9756469Z level=info msg="Executing migration" id="Add column tags to annotation table" 2024-03-30T12:20:06.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.978184431Z level=info msg="Executing migration" id="Create annotation_tag table v2" 2024-03-30T12:20:06.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.980932579Z level=info msg="Executing migration" id="Add unique index annotation_tag.annotation_id_tag_id" 2024-03-30T12:20:06.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.983512733Z level=info msg="Executing migration" id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-03-30T12:20:06.143 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.986047701Z level=info msg="Executing migration" id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-03-30T12:20:06.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.987622507Z level=info msg="Executing migration" id="Create annotation_tag table v3" 2024-03-30T12:20:06.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.988510894Z level=info msg="Executing migration" id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-03-30T12:20:06.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.989342336Z level=info msg="Executing migration" id="copy annotation_tag v2 to v3" 2024-03-30T12:20:06.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.990159176Z level=info msg="Executing migration" id="drop table annotation_tag_v2" 2024-03-30T12:20:06.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.991030689Z level=info msg="Executing migration" id="Update alert annotations and set TEXT to empty" 2024-03-30T12:20:06.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.99178976Z level=info msg="Executing migration" id="Add created time to annotation table" 2024-03-30T12:20:06.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.992562425Z level=info msg="Executing migration" id="Add updated time to annotation table" 2024-03-30T12:20:06.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.993400908Z level=info msg="Executing migration" id="Add index for created in annotation table" 2024-03-30T12:20:06.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.994277725Z level=info msg="Executing migration" id="Add index for updated in annotation table" 2024-03-30T12:20:06.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.995053353Z level=info msg="Executing migration" id="Convert existing annotations from seconds to milliseconds" 2024-03-30T12:20:06.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.996078405Z level=info msg="Executing migration" id="Add epoch_end column" 2024-03-30T12:20:06.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.996772921Z level=info msg="Executing migration" id="Add index for epoch_end" 2024-03-30T12:20:06.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.997651279Z level=info msg="Executing migration" id="Make epoch_end the same as epoch" 2024-03-30T12:20:06.144 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.998614614Z level=info msg="Executing migration" id="Move region to single row" 2024-03-30T12:20:06.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:05.999264003Z level=info msg="Executing migration" id="Remove index org_id_epoch from annotation table" 2024-03-30T12:20:06.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.00006569Z level=info msg="Executing migration" id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-03-30T12:20:06.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.000920534Z level=info msg="Executing migration" id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-03-30T12:20:06.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.00174845Z level=info msg="Executing migration" id="Add index for org_id_epoch_end_epoch on annotation table" 2024-03-30T12:20:06.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.002708319Z level=info msg="Executing migration" id="Remove index org_id_epoch_epoch_end from annotation table" 2024-03-30T12:20:06.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.003450561Z level=info msg="Executing migration" id="Add index for alert_id on annotation table" 2024-03-30T12:20:06.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.004251319Z level=info msg="Executing migration" id="Increase tags column to length 4096" 2024-03-30T12:20:06.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.005109042Z level=info msg="Executing migration" id="create test_data table" 2024-03-30T12:20:06.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.006096927Z level=info msg="Executing migration" id="create dashboard_version table v1" 2024-03-30T12:20:06.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.006840612Z level=info msg="Executing migration" id="add index dashboard_version.dashboard_id" 2024-03-30T12:20:06.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.007383903Z level=info msg="Executing migration" id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-03-30T12:20:06.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.008351428Z level=info msg="Executing migration" id="Set dashboard version to 1 where 0" 2024-03-30T12:20:06.145 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.009056566Z level=info msg="Executing migration" id="save existing dashboard data in dashboard_version table v1" 2024-03-30T12:20:06.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.009888748Z level=info msg="Executing migration" id="alter dashboard_version.data to mediumtext v1" 2024-03-30T12:20:06.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.010681596Z level=info msg="Executing migration" id="create team table" 2024-03-30T12:20:06.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.011544021Z level=info msg="Executing migration" id="add index team.org_id" 2024-03-30T12:20:06.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.012445946Z level=info msg="Executing migration" id="add unique index team_org_id_name" 2024-03-30T12:20:06.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.013449613Z level=info msg="Executing migration" id="create team member table" 2024-03-30T12:20:06.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.014136757Z level=info msg="Executing migration" id="add index team_member.org_id" 2024-03-30T12:20:06.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.015031366Z level=info msg="Executing migration" id="add unique index team_member_org_id_team_id_user_id" 2024-03-30T12:20:06.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.015888574Z level=info msg="Executing migration" id="add index team_member.team_id" 2024-03-30T12:20:06.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.016691442Z level=info msg="Executing migration" id="Add column email to team table" 2024-03-30T12:20:06.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.017500369Z level=info msg="Executing migration" id="Add column external to team_member table" 2024-03-30T12:20:06.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.01833207Z level=info msg="Executing migration" id="Add column permission to team_member table" 2024-03-30T12:20:06.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.021045268Z level=info msg="Executing migration" id="create dashboard acl table" 2024-03-30T12:20:06.146 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.023829672Z level=info msg="Executing migration" id="add index dashboard_acl_dashboard_id" 2024-03-30T12:20:06.150 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.026655508Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_user_id" 2024-03-30T12:20:06.150 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.0293305Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_team_id" 2024-03-30T12:20:06.150 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.029848109Z level=info msg="Executing migration" id="add index dashboard_acl_user_id" 2024-03-30T12:20:06.151 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.032644329Z level=info msg="Executing migration" id="add index dashboard_acl_team_id" 2024-03-30T12:20:06.152 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.035519988Z level=info msg="Executing migration" id="add index dashboard_acl_org_id_role" 2024-03-30T12:20:06.152 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.038135221Z level=info msg="Executing migration" id="add index dashboard_permission" 2024-03-30T12:20:06.152 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.040734669Z level=info msg="Executing migration" id="save default acl rules in dashboard_acl table" 2024-03-30T12:20:06.152 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.04121401Z level=info msg="Executing migration" id="delete acl rules for deleted dashboards and folders" 2024-03-30T12:20:06.152 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.044110438Z level=info msg="Executing migration" id="create tag table" 2024-03-30T12:20:06.152 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.04693717Z level=info msg="Executing migration" id="add index tag.key_value" 2024-03-30T12:20:06.152 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.049637768Z level=info msg="Executing migration" id="create login attempt table" 2024-03-30T12:20:06.152 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.050059843Z level=info msg="Executing migration" id="add index login_attempt.username" 2024-03-30T12:20:06.152 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.052995305Z level=info msg="Executing migration" id="drop index IDX_login_attempt_username - v1" 2024-03-30T12:20:06.152 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.055660376Z level=info msg="Executing migration" id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-03-30T12:20:06.152 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.058420396Z level=info msg="Executing migration" id="create login_attempt v2" 2024-03-30T12:20:06.153 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.058830415Z level=info msg="Executing migration" id="create index IDX_login_attempt_username - v2" 2024-03-30T12:20:06.153 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.061713109Z level=info msg="Executing migration" id="copy login_attempt v1 to v2" 2024-03-30T12:20:06.153 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.064360538Z level=info msg="Executing migration" id="drop login_attempt_tmp_qwerty" 2024-03-30T12:20:06.153 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.067082747Z level=info msg="Executing migration" id="create user auth table" 2024-03-30T12:20:06.153 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.067471078Z level=info msg="Executing migration" id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-03-30T12:20:06.153 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.070235291Z level=info msg="Executing migration" id="alter user_auth.auth_id to length 190" 2024-03-30T12:20:06.153 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.07287608Z level=info msg="Executing migration" id="Add OAuth access token to user_auth" 2024-03-30T12:20:06.153 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.075565622Z level=info msg="Executing migration" id="Add OAuth refresh token to user_auth" 2024-03-30T12:20:06.153 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.076447272Z level=info msg="Executing migration" id="Add OAuth token type to user_auth" 2024-03-30T12:20:06.153 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.079188829Z level=info msg="Executing migration" id="Add OAuth expiry to user_auth" 2024-03-30T12:20:06.153 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.081806718Z level=info msg="Executing migration" id="Add index to user_id column in user_auth" 2024-03-30T12:20:06.153 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.084547005Z level=info msg="Executing migration" id="Add OAuth ID token to user_auth" 2024-03-30T12:20:06.153 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.085301272Z level=info msg="Executing migration" id="create server_lock table" 2024-03-30T12:20:06.153 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.08794023Z level=info msg="Executing migration" id="add index server_lock.operation_uid" 2024-03-30T12:20:06.154 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.090757865Z level=info msg="Executing migration" id="create user auth token table" 2024-03-30T12:20:06.154 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.093195568Z level=info msg="Executing migration" id="add unique index user_auth_token.auth_token" 2024-03-30T12:20:06.154 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.09373269Z level=info msg="Executing migration" id="add unique index user_auth_token.prev_auth_token" 2024-03-30T12:20:06.154 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.096526395Z level=info msg="Executing migration" id="add index user_auth_token.user_id" 2024-03-30T12:20:06.154 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.099103381Z level=info msg="Executing migration" id="Add revoked_at to the user auth token" 2024-03-30T12:20:06.154 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.099899527Z level=info msg="Executing migration" id="create cache_data table" 2024-03-30T12:20:06.154 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.10031662Z level=info msg="Executing migration" id="add unique index cache_data.cache_key" 2024-03-30T12:20:06.154 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.101244531Z level=info msg="Executing migration" id="create short_url table v1" 2024-03-30T12:20:06.154 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.101913991Z level=info msg="Executing migration" id="add index short_url.org_id-uid" 2024-03-30T12:20:06.155 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.102815821Z level=info msg="Executing migration" id="alter table short_url alter column created_by type to bigint" 2024-03-30T12:20:06.155 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.103230829Z level=info msg="Executing migration" id="delete alert_definition table" 2024-03-30T12:20:06.155 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.103508539Z level=info msg="Executing migration" id="recreate alert_definition table" 2024-03-30T12:20:06.155 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.104011115Z level=info msg="Executing migration" id="add index in alert_definition on org_id and title columns" 2024-03-30T12:20:06.155 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.10470119Z level=info msg="Executing migration" id="add index in alert_definition on org_id and uid columns" 2024-03-30T12:20:06.155 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.105134462Z level=info msg="Executing migration" id="alter alert_definition table data column to mediumtext in mysql" 2024-03-30T12:20:06.155 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.105424812Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and title columns" 2024-03-30T12:20:06.155 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.105802465Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and uid columns" 2024-03-30T12:20:06.155 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.106223711Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and title columns" 2024-03-30T12:20:06.155 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.106639658Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and uid columns" 2024-03-30T12:20:06.155 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.107053717Z level=info msg="Executing migration" id="Add column paused in alert_definition" 2024-03-30T12:20:06.155 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.107821611Z level=info msg="Executing migration" id="drop alert_definition table" 2024-03-30T12:20:06.155 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.108223723Z level=info msg="Executing migration" id="delete alert_definition_version table" 2024-03-30T12:20:06.155 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.108514984Z level=info msg="Executing migration" id="recreate alert_definition_version table" 2024-03-30T12:20:06.155 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.108905548Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-03-30T12:20:06.156 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.10933117Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-03-30T12:20:06.156 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.109742838Z level=info msg="Executing migration" id="alter alert_definition_version table data column to mediumtext in mysql" 2024-03-30T12:20:06.156 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.110005134Z level=info msg="Executing migration" id="drop alert_definition_version table" 2024-03-30T12:20:06.156 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.11042479Z level=info msg="Executing migration" id="create alert_instance table" 2024-03-30T12:20:06.156 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.110801891Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-03-30T12:20:06.156 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.111224193Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, current_state columns" 2024-03-30T12:20:06.156 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.111634696Z level=info msg="Executing migration" id="add column current_state_end to alert_instance" 2024-03-30T12:20:06.156 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.112403792Z level=info msg="Executing migration" id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-03-30T12:20:06.156 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.112807603Z level=info msg="Executing migration" id="remove index def_org_id, current_state on alert_instance" 2024-03-30T12:20:06.156 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.113218393Z level=info msg="Executing migration" id="rename def_org_id to rule_org_id in alert_instance" 2024-03-30T12:20:06.156 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.116716921Z level=info msg="Executing migration" id="rename def_uid to rule_uid in alert_instance" 2024-03-30T12:20:06.156 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.120050261Z level=info msg="Executing migration" id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-03-30T12:20:06.156 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.120505493Z level=info msg="Executing migration" id="add index rule_org_id, current_state on alert_instance" 2024-03-30T12:20:06.156 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.120901869Z level=info msg="Executing migration" id="add current_reason column related to current_state" 2024-03-30T12:20:06.157 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.121738409Z level=info msg="Executing migration" id="create alert_rule table" 2024-03-30T12:20:06.157 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.122154331Z level=info msg="Executing migration" id="add index in alert_rule on org_id and title columns" 2024-03-30T12:20:06.157 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.122597935Z level=info msg="Executing migration" id="add index in alert_rule on org_id and uid columns" 2024-03-30T12:20:06.157 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.123036674Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-03-30T12:20:06.157 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.123496782Z level=info msg="Executing migration" id="alter alert_rule table data column to mediumtext in mysql" 2024-03-30T12:20:06.157 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.123762551Z level=info msg="Executing migration" id="add column for to alert_rule" 2024-03-30T12:20:06.157 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.124575599Z level=info msg="Executing migration" id="add column annotations to alert_rule" 2024-03-30T12:20:06.157 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.125407775Z level=info msg="Executing migration" id="add column labels to alert_rule" 2024-03-30T12:20:06.157 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.12620309Z level=info msg="Executing migration" id="remove unique index from alert_rule on org_id, title columns" 2024-03-30T12:20:06.157 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.12661124Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-03-30T12:20:06.157 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.127008283Z level=info msg="Executing migration" id="add dashboard_uid column to alert_rule" 2024-03-30T12:20:06.157 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.127818413Z level=info msg="Executing migration" id="add panel_id column to alert_rule" 2024-03-30T12:20:06.157 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.128634709Z level=info msg="Executing migration" id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-03-30T12:20:06.157 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.12906073Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule" 2024-03-30T12:20:06.158 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.129866203Z level=info msg="Executing migration" id="add is_paused column to alert_rule table" 2024-03-30T12:20:06.158 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.130656979Z level=info msg="Executing migration" id="fix is_paused column for alert_rule table" 2024-03-30T12:20:06.158 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.130971227Z level=info msg="Executing migration" id="create alert_rule_version table" 2024-03-30T12:20:06.158 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.131407281Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-03-30T12:20:06.158 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.13213861Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-03-30T12:20:06.158 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.132560652Z level=info msg="Executing migration" id="alter alert_rule_version table data column to mediumtext in mysql" 2024-03-30T12:20:06.158 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.132822671Z level=info msg="Executing migration" id="add column for to alert_rule_version" 2024-03-30T12:20:06.158 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.133726655Z level=info msg="Executing migration" id="add column annotations to alert_rule_version" 2024-03-30T12:20:06.158 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.134620417Z level=info msg="Executing migration" id="add column labels to alert_rule_version" 2024-03-30T12:20:06.158 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.135548797Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule_version" 2024-03-30T12:20:06.158 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.136509236Z level=info msg="Executing migration" id="add is_paused column to alert_rule_versions table" 2024-03-30T12:20:06.158 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.137391796Z level=info msg="Executing migration" id="fix is_paused column for alert_rule_version table" 2024-03-30T12:20:06.158 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.13823006Z level=info msg="Executing migration" id=create_alert_configuration_table 2024-03-30T12:20:06.159 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.139159116Z level=info msg="Executing migration" id="Add column default in alert_configuration" 2024-03-30T12:20:06.159 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.140063533Z level=info msg="Executing migration" id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-03-30T12:20:06.159 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.140375806Z level=info msg="Executing migration" id="add column org_id in alert_configuration" 2024-03-30T12:20:06.159 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.141272815Z level=info msg="Executing migration" id="add index in alert_configuration table on org_id column" 2024-03-30T12:20:06.159 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.14224022Z level=info msg="Executing migration" id="add configuration_hash column to alert_configuration" 2024-03-30T12:20:06.159 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.143251531Z level=info msg="Executing migration" id=create_ngalert_configuration_table 2024-03-30T12:20:06.159 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.143646645Z level=info msg="Executing migration" id="add index in ngalert_configuration on org_id column" 2024-03-30T12:20:06.159 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.144657561Z level=info msg="Executing migration" id="add column send_alerts_to in ngalert_configuration" 2024-03-30T12:20:06.159 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.145548585Z level=info msg="Executing migration" id="create provenance_type table" 2024-03-30T12:20:06.159 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.146417181Z level=info msg="Executing migration" id="add index to uniquify (record_key, record_type, org_id) columns" 2024-03-30T12:20:06.159 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.146871543Z level=info msg="Executing migration" id="create alert_image table" 2024-03-30T12:20:06.159 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.147750845Z level=info msg="Executing migration" id="add unique index on token to alert_image table" 2024-03-30T12:20:06.159 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.148629225Z level=info msg="Executing migration" id="support longer URLs in alert_image table" 2024-03-30T12:20:06.159 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.149357725Z level=info msg="Executing migration" id=create_alert_configuration_history_table 2024-03-30T12:20:06.159 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.149778649Z level=info msg="Executing migration" id="drop non-unique orgID index on alert_configuration" 2024-03-30T12:20:06.159 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.150196661Z level=info msg="Executing migration" id="drop unique orgID index on alert_configuration if exists" 2024-03-30T12:20:06.160 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.150280889Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop unique orgID index on alert_configuration if exists" 2024-03-30T12:20:06.160 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.15103661Z level=info msg="Executing migration" id="extract alertmanager configuration history to separate table" 2024-03-30T12:20:06.160 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.151889746Z level=info msg="Executing migration" id="add unique index on orgID to alert_configuration" 2024-03-30T12:20:06.160 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.152347649Z level=info msg="Executing migration" id="clear migration entry \"remove unified alerting data\"" 2024-03-30T12:20:06.160 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.152487046Z level=info msg="Executing migration" id="move dashboard alerts to unified alerting" 2024-03-30T12:20:06.160 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.152624234Z level=info msg="alerts found to migrate" alerts=0 2024-03-30T12:20:06.160 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.153206201Z level=info msg="Executing migration" id="create library_element table v1" 2024-03-30T12:20:06.160 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.154092832Z level=info msg="Executing migration" id="add index library_element org_id-folder_id-name-kind" 2024-03-30T12:20:06.160 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.15494286Z level=info msg="Executing migration" id="create library_element_connection table v1" 2024-03-30T12:20:06.160 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.155362302Z level=info msg="Executing migration" id="add index library_element_connection element_id-kind-connection_id" 2024-03-30T12:20:06.345 INFO:teuthology.orchestra.run.smithi084.stdout:197568495639 2024-03-30T12:20:06.345 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.6 2024-03-30T12:20:06.397 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.15801355Z level=info msg="Executing migration" id="add unique index library_element org_id_uid" 2024-03-30T12:20:06.397 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.160847947Z level=info msg="Executing migration" id="increase max description length to 2048" 2024-03-30T12:20:06.397 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.163444245Z level=info msg="Executing migration" id="clone move dashboard alerts to unified alerting" 2024-03-30T12:20:06.397 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.163848134Z level=info msg="Executing migration" id="create data_keys table" 2024-03-30T12:20:06.397 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.16469424Z level=info msg="Executing migration" id="create secrets table" 2024-03-30T12:20:06.397 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.165537182Z level=info msg="Executing migration" id="rename data_keys name column to id" 2024-03-30T12:20:06.397 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.169805546Z level=info msg="Executing migration" id="add name column into data_keys" 2024-03-30T12:20:06.397 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.170723659Z level=info msg="Executing migration" id="copy data_keys id column values into name" 2024-03-30T12:20:06.398 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.171726463Z level=info msg="Executing migration" id="rename data_keys name column to label" 2024-03-30T12:20:06.398 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.176028043Z level=info msg="Executing migration" id="rename data_keys id column back to name" 2024-03-30T12:20:06.398 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.180252437Z level=info msg="Executing migration" id="create kv_store table v1" 2024-03-30T12:20:06.398 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.180692016Z level=info msg="Executing migration" id="add index kv_store.org_id-namespace-key" 2024-03-30T12:20:06.398 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.181536408Z level=info msg="Executing migration" id="update dashboard_uid and panel_id from existing annotations" 2024-03-30T12:20:06.398 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.182423434Z level=info msg="Executing migration" id="create permission table" 2024-03-30T12:20:06.398 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.183274005Z level=info msg="Executing migration" id="add unique index permission.role_id" 2024-03-30T12:20:06.398 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.183793537Z level=info msg="Executing migration" id="add unique index role_id_action_scope" 2024-03-30T12:20:06.398 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.184812233Z level=info msg="Executing migration" id="create role table" 2024-03-30T12:20:06.398 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.185527614Z level=info msg="Executing migration" id="add column display_name" 2024-03-30T12:20:06.398 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.18828268Z level=info msg="Executing migration" id="add column group_name" 2024-03-30T12:20:06.399 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.189223035Z level=info msg="Executing migration" id="add index role.org_id" 2024-03-30T12:20:06.399 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.192129599Z level=info msg="Executing migration" id="add unique index role_org_id_name" 2024-03-30T12:20:06.399 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.195145502Z level=info msg="Executing migration" id="add index role_org_id_uid" 2024-03-30T12:20:06.399 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.197792826Z level=info msg="Executing migration" id="create team role table" 2024-03-30T12:20:06.399 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.198240193Z level=info msg="Executing migration" id="add index team_role.org_id" 2024-03-30T12:20:06.399 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.201030194Z level=info msg="Executing migration" id="add unique index team_role_org_id_team_id_role_id" 2024-03-30T12:20:06.400 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.20383009Z level=info msg="Executing migration" id="add index team_role.team_id" 2024-03-30T12:20:06.400 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.206820132Z level=info msg="Executing migration" id="create user role table" 2024-03-30T12:20:06.400 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.207426964Z level=info msg="Executing migration" id="add index user_role.org_id" 2024-03-30T12:20:06.400 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.210157145Z level=info msg="Executing migration" id="add unique index user_role_org_id_user_id_role_id" 2024-03-30T12:20:06.400 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.213130858Z level=info msg="Executing migration" id="add index user_role.user_id" 2024-03-30T12:20:06.400 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.215924624Z level=info msg="Executing migration" id="create builtin role table" 2024-03-30T12:20:06.400 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.216525901Z level=info msg="Executing migration" id="add index builtin_role.role_id" 2024-03-30T12:20:06.400 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.21955141Z level=info msg="Executing migration" id="add index builtin_role.name" 2024-03-30T12:20:06.400 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.222353945Z level=info msg="Executing migration" id="Add column org_id to builtin_role table" 2024-03-30T12:20:06.400 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.225197644Z level=info msg="Executing migration" id="add index builtin_role.org_id" 2024-03-30T12:20:06.400 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.225774789Z level=info msg="Executing migration" id="add unique index builtin_role_org_id_role_id_role" 2024-03-30T12:20:06.400 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.22853374Z level=info msg="Executing migration" id="Remove unique index role_org_id_uid" 2024-03-30T12:20:06.400 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.231389292Z level=info msg="Executing migration" id="add unique index role.uid" 2024-03-30T12:20:06.400 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.234051186Z level=info msg="Executing migration" id="create seed assignment table" 2024-03-30T12:20:06.401 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.234474884Z level=info msg="Executing migration" id="add unique index builtin_role_role_name" 2024-03-30T12:20:06.401 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.237242497Z level=info msg="Executing migration" id="add column hidden to role table" 2024-03-30T12:20:06.401 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.239677167Z level=info msg="Executing migration" id="create query_history table v1" 2024-03-30T12:20:06.401 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.242567162Z level=info msg="Executing migration" id="add index query_history.org_id-created_by-datasource_uid" 2024-03-30T12:20:06.401 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.243123633Z level=info msg="Executing migration" id="alter table query_history alter column created_by type to bigint" 2024-03-30T12:20:06.401 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.245812278Z level=info msg="Executing migration" id="teams permissions migration" 2024-03-30T12:20:06.401 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.248494881Z level=info msg="Executing migration" id="dashboard permissions" 2024-03-30T12:20:06.401 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.251179Z level=info msg="Executing migration" id="dashboard permissions uid scopes" 2024-03-30T12:20:06.401 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.251681821Z level=info msg="Executing migration" id="drop managed folder create actions" 2024-03-30T12:20:06.401 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.254437122Z level=info msg="Executing migration" id="alerting notification permissions" 2024-03-30T12:20:06.401 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.255237595Z level=info msg="Executing migration" id="create query_history_star table v1" 2024-03-30T12:20:06.401 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.257073887Z level=info msg="Executing migration" id="add index query_history.user_id-query_uid" 2024-03-30T12:20:06.401 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.259718724Z level=info msg="Executing migration" id="add column org_id in query_history_star" 2024-03-30T12:20:06.401 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.260778442Z level=info msg="Executing migration" id="alter table query_history_star_mig column user_id type to bigint" 2024-03-30T12:20:06.402 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.261522275Z level=info msg="Executing migration" id="create correlation table v1" 2024-03-30T12:20:06.402 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.262377263Z level=info msg="Executing migration" id="add index correlations.uid" 2024-03-30T12:20:06.402 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.263196923Z level=info msg="Executing migration" id="add index correlations.source_uid" 2024-03-30T12:20:06.402 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.26367049Z level=info msg="Executing migration" id="add correlation config column" 2024-03-30T12:20:06.402 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.264701445Z level=info msg="Executing migration" id="create entity_events table" 2024-03-30T12:20:06.402 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.265697949Z level=info msg="Executing migration" id="create dashboard public config v1" 2024-03-30T12:20:06.402 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.266384885Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v1" 2024-03-30T12:20:06.402 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.266484212Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index UQE_dashboard_public_config_uid - v1" 2024-03-30T12:20:06.402 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.266820087Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-03-30T12:20:06.402 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.266913697Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-03-30T12:20:06.402 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.267695984Z level=info msg="Executing migration" id="Drop old dashboard public config table" 2024-03-30T12:20:06.402 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.268474273Z level=info msg="Executing migration" id="recreate dashboard public config v1" 2024-03-30T12:20:06.402 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.269264932Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v1" 2024-03-30T12:20:06.402 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.269731133Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-03-30T12:20:06.403 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.2707026Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v2" 2024-03-30T12:20:06.403 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.271411117Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-03-30T12:20:06.403 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.272236516Z level=info msg="Executing migration" id="Drop public config table" 2024-03-30T12:20:06.403 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.272643165Z level=info msg="Executing migration" id="Recreate dashboard public config v2" 2024-03-30T12:20:06.403 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.273443769Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v2" 2024-03-30T12:20:06.403 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.273918172Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-03-30T12:20:06.403 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.274414168Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_access_token - v2" 2024-03-30T12:20:06.403 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.275438936Z level=info msg="Executing migration" id="Rename table dashboard_public_config to dashboard_public - v2" 2024-03-30T12:20:06.403 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.278530241Z level=info msg="Executing migration" id="add annotations_enabled column" 2024-03-30T12:20:06.403 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.279592226Z level=info msg="Executing migration" id="add time_selection_enabled column" 2024-03-30T12:20:06.403 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.280635242Z level=info msg="Executing migration" id="delete orphaned public dashboards" 2024-03-30T12:20:06.403 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.281501398Z level=info msg="Executing migration" id="add share column" 2024-03-30T12:20:06.403 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.282534675Z level=info msg="Executing migration" id="create default alerting folders" 2024-03-30T12:20:06.403 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.283378684Z level=info msg="Executing migration" id="create file table" 2024-03-30T12:20:06.404 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.284241508Z level=info msg="Executing migration" id="file table idx: path natural pk" 2024-03-30T12:20:06.404 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.285079907Z level=info msg="Executing migration" id="file table idx: parent_folder_path_hash fast folder retrieval" 2024-03-30T12:20:06.404 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.285581189Z level=info msg="Executing migration" id="create file_meta table" 2024-03-30T12:20:06.404 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.286472039Z level=info msg="Executing migration" id="file table idx: path key" 2024-03-30T12:20:06.404 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.287327044Z level=info msg="Executing migration" id="set path collation in file table" 2024-03-30T12:20:06.404 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.288135603Z level=info msg="Executing migration" id="managed permissions migration" 2024-03-30T12:20:06.404 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.288623701Z level=info msg="Executing migration" id="managed folder permissions alert actions migration" 2024-03-30T12:20:06.404 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.289418845Z level=info msg="Executing migration" id="RBAC action name migrator" 2024-03-30T12:20:06.404 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.290364824Z level=info msg="Executing migration" id="Add UID column to playlist" 2024-03-30T12:20:06.404 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.293107367Z level=info msg="Executing migration" id="Update uid column values in playlist" 2024-03-30T12:20:06.404 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.293442335Z level=info msg="Executing migration" id="Add index for uid in playlist" 2024-03-30T12:20:06.404 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.296399443Z level=info msg="Executing migration" id="update group index for alert rules" 2024-03-30T12:20:06.404 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.299231061Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated migration" 2024-03-30T12:20:06.404 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.302002671Z level=info msg="Executing migration" id="admin only folder/dashboard permission" 2024-03-30T12:20:06.405 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.302392726Z level=info msg="Executing migration" id="add action column to seed_assignment" 2024-03-30T12:20:06.405 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.305099122Z level=info msg="Executing migration" id="add scope column to seed_assignment" 2024-03-30T12:20:06.405 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.308069319Z level=info msg="Executing migration" id="remove unique index builtin_role_role_name before nullable update" 2024-03-30T12:20:06.405 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.310955371Z level=info msg="Executing migration" id="update seed_assignment role_name column to nullable" 2024-03-30T12:20:06.405 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.320702225Z level=info msg="Executing migration" id="add unique index builtin_role_name back" 2024-03-30T12:20:06.405 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.323454922Z level=info msg="Executing migration" id="add unique index builtin_role_action_scope" 2024-03-30T12:20:06.405 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.326130475Z level=info msg="Executing migration" id="add primary key to seed_assigment" 2024-03-30T12:20:06.405 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.329532327Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated fixed migration" 2024-03-30T12:20:06.405 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.332342652Z level=info msg="Executing migration" id="migrate external alertmanagers to datsourcse" 2024-03-30T12:20:06.405 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.335148983Z level=info msg="Executing migration" id="create folder table" 2024-03-30T12:20:06.405 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.337906969Z level=info msg="Executing migration" id="Add index for parent_uid" 2024-03-30T12:20:06.406 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.340638806Z level=info msg="Executing migration" id="Add unique index for folder.uid and folder.org_id" 2024-03-30T12:20:06.406 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.341116668Z level=info msg="Executing migration" id="Update folder title length" 2024-03-30T12:20:06.406 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.343848825Z level=info msg="Executing migration" id="Add unique index for folder.title and folder.parent_uid" 2024-03-30T12:20:06.406 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=migrator t=2024-03-30T12:20:06.346483557Z level=info msg="migrations completed" performed=485 skipped=0 duration=698.838289ms 2024-03-30T12:20:06.406 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=sqlstore t=2024-03-30T12:20:06.346993304Z level=info msg="Created default organization" 2024-03-30T12:20:06.406 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=plugin.loader t=2024-03-30T12:20:06.405607561Z level=info msg="Plugin registered" pluginID=input 2024-03-30T12:20:06.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:06 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:06.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:06 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:06.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:06 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:06.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:06 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:06.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:06 smithi084 ceph-mon[27000]: Deploying daemon node-exporter.a on smithi084 2024-03-30T12:20:06.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:06 smithi084 ceph-mon[27000]: pgmap v19: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:06.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:06 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:20:06.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:06 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:06.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:06 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:06.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:06 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:06.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:06 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:06.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:06 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:06.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:06 smithi084 ceph-mon[37565]: Deploying daemon node-exporter.a on smithi084 2024-03-30T12:20:06.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:06 smithi084 ceph-mon[37565]: pgmap v19: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:06.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:06 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:20:06.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:06 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:06.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:06.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:06.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:06.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:06.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-mon[30421]: Deploying daemon node-exporter.a on smithi084 2024-03-30T12:20:06.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-mon[30421]: pgmap v19: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:06.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:20:06.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:06.871 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=plugin.loader t=2024-03-30T12:20:06.43363038Z level=info msg="Plugin registered" pluginID=grafana-piechart-panel 2024-03-30T12:20:06.871 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=plugin.loader t=2024-03-30T12:20:06.433654278Z level=info msg="Plugin registered" pluginID=vonage-status-panel 2024-03-30T12:20:06.871 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=secrets t=2024-03-30T12:20:06.433720287Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-03-30T12:20:06.871 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=query_data t=2024-03-30T12:20:06.435416888Z level=info msg="Query Service initialization" 2024-03-30T12:20:06.871 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=live.push_http t=2024-03-30T12:20:06.437703641Z level=info msg="Live Push Gateway initialization" 2024-03-30T12:20:07.575 INFO:teuthology.orchestra.run.smithi084.stdout:128849018912 2024-03-30T12:20:07.575 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.4 2024-03-30T12:20:07.617 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=infra.usagestats.collector t=2024-03-30T12:20:07.175247882Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-03-30T12:20:07.617 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=provisioning.datasources t=2024-03-30T12:20:07.230878013Z level=info msg="inserting datasource from configuration " name=Dashboard1 uid=P43CA22E17D0F9596 2024-03-30T12:20:07.617 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=provisioning.datasources t=2024-03-30T12:20:07.262807869Z level=info msg="inserting datasource from configuration " name=Loki uid=P8E80F9AEF21F6940 2024-03-30T12:20:07.617 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=provisioning.alerting t=2024-03-30T12:20:07.284238701Z level=info msg="starting to provision alerting" 2024-03-30T12:20:07.617 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=provisioning.alerting t=2024-03-30T12:20:07.284293209Z level=info msg="finished to provision alerting" 2024-03-30T12:20:07.617 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=ngalert.state.manager t=2024-03-30T12:20:07.28441904Z level=info msg="Warming state cache for startup" 2024-03-30T12:20:07.617 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=grafanaStorageLogger t=2024-03-30T12:20:07.284454596Z level=info msg="storage starting" 2024-03-30T12:20:07.617 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=http.server t=2024-03-30T12:20:07.285917165Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-03-30T12:20:07.617 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=ngalert.state.manager t=2024-03-30T12:20:07.294678249Z level=info msg="State cache has been initialized" states=0 duration=10.257805ms 2024-03-30T12:20:07.618 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=ticker t=2024-03-30T12:20:07.294732316Z level=info msg=starting first_tick=2024-03-30T12:20:10Z 2024-03-30T12:20:07.618 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=ngalert.multiorg.alertmanager t=2024-03-30T12:20:07.294731432Z level=info msg="starting MultiOrg Alertmanager" 2024-03-30T12:20:07.618 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=sqlstore.transactions t=2024-03-30T12:20:07.29474744Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-03-30T12:20:07.618 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:20:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=sqlstore.transactions t=2024-03-30T12:20:07.340063616Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-03-30T12:20:08.191 INFO:teuthology.orchestra.run.smithi084.stdout:107374182437 2024-03-30T12:20:08.191 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.3 2024-03-30T12:20:09.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:08 smithi162 ceph-mon[30421]: pgmap v20: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:09.230 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:08 smithi084 ceph-mon[37565]: pgmap v20: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:09.230 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:08 smithi084 ceph-mon[27000]: pgmap v20: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:09.505 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:20:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:20:09] "GET /metrics HTTP/1.1" 200 33655 "" "Prometheus/2.43.0" 2024-03-30T12:20:09.553 INFO:teuthology.orchestra.run.smithi084.stdout:77309411370 2024-03-30T12:20:09.554 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.2 2024-03-30T12:20:09.952 INFO:teuthology.orchestra.run.smithi084.stdout:163208757277 2024-03-30T12:20:09.952 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.5 2024-03-30T12:20:10.225 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:20:10.226 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:20:10.732 INFO:teuthology.orchestra.run.smithi084.stdout:34359738421 2024-03-30T12:20:10.733 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.0 2024-03-30T12:20:10.941 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:10 smithi084 ceph-mon[37565]: pgmap v21: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:10.942 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:10 smithi084 ceph-mon[27000]: pgmap v21: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:11.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:10 smithi162 ceph-mon[30421]: pgmap v21: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:11.622 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:20:12.570 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:20:12.824 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:20:12.824 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:20:12.824 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:20:13.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:12 smithi084 ceph-mon[37565]: pgmap v22: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:13.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:12 smithi084 ceph-mon[27000]: pgmap v22: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:13.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:12 smithi162 ceph-mon[30421]: pgmap v22: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:15.197 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:14 smithi084 ceph-mon[27000]: pgmap v23: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:15.197 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:14 smithi084 ceph-mon[37565]: pgmap v23: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:14 smithi162 ceph-mon[30421]: pgmap v23: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:16.231 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:15 smithi084 ceph-mon[37565]: pgmap v24: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:16.231 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:15 smithi084 ceph-mon[27000]: pgmap v24: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:16.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:15 smithi162 ceph-mon[30421]: pgmap v24: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:16.857 INFO:teuthology.orchestra.run.smithi084.stdout:231928234005 2024-03-30T12:20:16.858 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:16 smithi084 podman[71076]: 2024-03-30 12:20:16.762410859 +0000 UTC m=+5.126147591 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-03-30T12:20:17.120 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:17 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/3500705196' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-30T12:20:17.120 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:16 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3500705196' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-30T12:20:17.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:16 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/3500705196' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-30T12:20:18.119 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:18 smithi084 ceph-mon[37565]: pgmap v25: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:18.119 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:18 smithi084 ceph-mon[27000]: pgmap v25: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:18.324 INFO:teuthology.orchestra.run.smithi084.stdout:55834574899 2024-03-30T12:20:18.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:18 smithi162 ceph-mon[30421]: pgmap v25: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:19.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:19 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/3208920968' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-30T12:20:19.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:19 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3208920968' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-30T12:20:19.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:19 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/3208920968' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-30T12:20:19.554 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:20:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:20:19] "GET /metrics HTTP/1.1" 200 33655 "" "Prometheus/2.43.0" 2024-03-30T12:20:20.233 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-mon[37565]: pgmap v26: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:20.233 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/1518826869' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-30T12:20:20.233 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-mon[27000]: pgmap v26: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:20.233 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/1518826869' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-30T12:20:20.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:20 smithi162 ceph-mon[30421]: pgmap v26: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:20.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:20 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/1518826869' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-30T12:20:20.503 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 podman[71076]: 2024-03-30 12:20:20.476021445 +0000 UTC m=+8.839758171 container create 66844bed39e89e9176df3b27326031a73b452252863843e518998a2bcaadc294 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T12:20:20.780 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 podman[71076]: 2024-03-30 12:20:20.780142548 +0000 UTC m=+9.143879284 container init 66844bed39e89e9176df3b27326031a73b452252863843e518998a2bcaadc294 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T12:20:20.781 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 podman[71076]: 2024-03-30 12:20:20.783079545 +0000 UTC m=+9.146816272 container start 66844bed39e89e9176df3b27326031a73b452252863843e518998a2bcaadc294 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T12:20:20.781 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.786Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-03-30T12:20:20.781 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.786Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-03-30T12:20:20.781 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.787Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-03-30T12:20:20.781 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.787Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-03-30T12:20:20.781 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.787Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-03-30T12:20:20.781 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.787Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-03-30T12:20:20.781 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-03-30T12:20:20.781 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=arp 2024-03-30T12:20:20.781 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=bcache 2024-03-30T12:20:20.782 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=bonding 2024-03-30T12:20:20.782 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=btrfs 2024-03-30T12:20:20.782 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=conntrack 2024-03-30T12:20:20.782 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=cpu 2024-03-30T12:20:20.782 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-03-30T12:20:20.782 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=diskstats 2024-03-30T12:20:20.782 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=dmi 2024-03-30T12:20:20.783 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=edac 2024-03-30T12:20:20.783 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=entropy 2024-03-30T12:20:20.783 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-03-30T12:20:20.783 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=filefd 2024-03-30T12:20:20.783 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=filesystem 2024-03-30T12:20:20.783 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=hwmon 2024-03-30T12:20:20.783 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=infiniband 2024-03-30T12:20:20.783 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=ipvs 2024-03-30T12:20:20.783 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=loadavg 2024-03-30T12:20:20.783 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=mdadm 2024-03-30T12:20:20.783 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=meminfo 2024-03-30T12:20:20.783 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=netclass 2024-03-30T12:20:20.784 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=netdev 2024-03-30T12:20:20.784 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=netstat 2024-03-30T12:20:20.784 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=nfs 2024-03-30T12:20:20.784 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=nfsd 2024-03-30T12:20:20.784 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=nvme 2024-03-30T12:20:20.784 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=os 2024-03-30T12:20:20.784 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-03-30T12:20:20.784 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=pressure 2024-03-30T12:20:20.784 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=rapl 2024-03-30T12:20:20.784 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=schedstat 2024-03-30T12:20:20.785 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=selinux 2024-03-30T12:20:20.785 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=sockstat 2024-03-30T12:20:20.785 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=softnet 2024-03-30T12:20:20.785 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=stat 2024-03-30T12:20:20.785 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=tapestats 2024-03-30T12:20:20.785 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=textfile 2024-03-30T12:20:20.785 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-03-30T12:20:20.785 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=time 2024-03-30T12:20:20.785 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-03-30T12:20:20.785 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=uname 2024-03-30T12:20:20.786 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=vmstat 2024-03-30T12:20:20.786 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=xfs 2024-03-30T12:20:20.786 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=node_exporter.go:117 level=info collector=zfs 2024-03-30T12:20:20.786 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-03-30T12:20:20.786 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[71619]: ts=2024-03-30T12:20:20.788Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-03-30T12:20:21.223 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 bash[71076]: 66844bed39e89e9176df3b27326031a73b452252863843e518998a2bcaadc294 2024-03-30T12:20:21.223 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:20:20 smithi084 systemd[1]: Started Ceph node-exporter.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:20:21.224 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:21 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:20:21.224 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:21 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:21.224 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:21 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:21.224 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:21 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:20:21.224 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:21 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:21.225 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:21 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:21.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:21 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:20:21.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:21 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:21.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:21 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:21.530 INFO:teuthology.orchestra.run.smithi084.stdout:128849018915 2024-03-30T12:20:21.888 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234003 got 231928234005 for osd.7 2024-03-30T12:20:21.889 DEBUG:teuthology.parallel:result is None 2024-03-30T12:20:22.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:22 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:22.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:22 smithi084 ceph-mon[37565]: Deploying daemon node-exporter.b on smithi162 2024-03-30T12:20:22.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:22 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/3359985859' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-30T12:20:22.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:22 smithi084 ceph-mon[37565]: pgmap v27: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:22.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:22 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:22.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:22 smithi084 ceph-mon[27000]: Deploying daemon node-exporter.b on smithi162 2024-03-30T12:20:22.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:22 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3359985859' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-30T12:20:22.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:22 smithi084 ceph-mon[27000]: pgmap v27: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:22.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:22 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:22.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:22 smithi162 ceph-mon[30421]: Deploying daemon node-exporter.b on smithi162 2024-03-30T12:20:22.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:22 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/3359985859' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-30T12:20:22.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:22 smithi162 ceph-mon[30421]: pgmap v27: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:22.371 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:22 smithi162 bash[60589]: Trying to pull quay.io/prometheus/node-exporter:v1.5.0... 2024-03-30T12:20:22.487 INFO:teuthology.orchestra.run.smithi084.stdout:107374182440 2024-03-30T12:20:22.870 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:22 smithi162 bash[60589]: Getting image source signatures 2024-03-30T12:20:22.870 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:22 smithi162 bash[60589]: Copying blob sha256:5c12815fee558b157dee7f7509dedbaba0a8379098858a65ec869e1f1526ea0c 2024-03-30T12:20:22.870 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:22 smithi162 bash[60589]: Copying blob sha256:c0e87333d3805a7b7e1c25783dd25f27da0fe70a8e262eee7ed190c8dc843fa7 2024-03-30T12:20:22.870 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:22 smithi162 bash[60589]: Copying blob sha256:22b70bddd3acadc892fca4c2af4260629bfda5dfd11ebc106a93ce24e752b5ed 2024-03-30T12:20:23.032 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182437 got 107374182440 for osd.3 2024-03-30T12:20:23.032 DEBUG:teuthology.parallel:result is None 2024-03-30T12:20:24.046 INFO:teuthology.orchestra.run.smithi084.stdout:77309411374 2024-03-30T12:20:24.370 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 bash[60589]: Copying config sha256:0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 2024-03-30T12:20:24.370 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 bash[60589]: Writing manifest to image destination 2024-03-30T12:20:24.613 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574895 got 55834574899 for osd.1 2024-03-30T12:20:24.614 DEBUG:teuthology.parallel:result is None 2024-03-30T12:20:24.758 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 podman[60589]: 2024-03-30 12:20:24.425900915 +0000 UTC m=+2.358315539 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-03-30T12:20:24.759 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 podman[60589]: 2024-03-30 12:20:24.541045389 +0000 UTC m=+2.473460006 container create 3d6e28b2348dea044954c4ea7f5fece91782c7d42e327b71674f8464b4f57f67 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T12:20:25.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:24 smithi084 ceph-mon[37565]: pgmap v28: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:24 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/2869624238' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-30T12:20:25.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:24 smithi084 ceph-mon[27000]: pgmap v28: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:25.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:24 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/2869624238' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-30T12:20:25.033 INFO:teuthology.orchestra.run.smithi084.stdout:197568495643 2024-03-30T12:20:25.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-mon[30421]: pgmap v28: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:25.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/2869624238' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-30T12:20:25.120 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 podman[60589]: 2024-03-30 12:20:24.767945642 +0000 UTC m=+2.700360275 container init 3d6e28b2348dea044954c4ea7f5fece91782c7d42e327b71674f8464b4f57f67 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T12:20:25.120 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 podman[60589]: 2024-03-30 12:20:24.770673157 +0000 UTC m=+2.703087784 container start 3d6e28b2348dea044954c4ea7f5fece91782c7d42e327b71674f8464b4f57f67 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T12:20:25.120 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.774Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-03-30T12:20:25.120 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.774Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-03-30T12:20:25.120 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.774Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-03-30T12:20:25.121 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.774Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-03-30T12:20:25.121 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-03-30T12:20:25.121 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-03-30T12:20:25.121 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-03-30T12:20:25.121 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=arp 2024-03-30T12:20:25.121 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=bcache 2024-03-30T12:20:25.121 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=bonding 2024-03-30T12:20:25.121 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=btrfs 2024-03-30T12:20:25.121 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=conntrack 2024-03-30T12:20:25.121 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=cpu 2024-03-30T12:20:25.121 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-03-30T12:20:25.122 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=diskstats 2024-03-30T12:20:25.122 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=dmi 2024-03-30T12:20:25.122 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=edac 2024-03-30T12:20:25.122 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=entropy 2024-03-30T12:20:25.122 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-03-30T12:20:25.122 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=filefd 2024-03-30T12:20:25.122 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=filesystem 2024-03-30T12:20:25.122 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=hwmon 2024-03-30T12:20:25.122 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=infiniband 2024-03-30T12:20:25.123 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=ipvs 2024-03-30T12:20:25.123 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=loadavg 2024-03-30T12:20:25.123 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=mdadm 2024-03-30T12:20:25.123 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=meminfo 2024-03-30T12:20:25.123 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=netclass 2024-03-30T12:20:25.123 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=netdev 2024-03-30T12:20:25.123 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=netstat 2024-03-30T12:20:25.123 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=nfs 2024-03-30T12:20:25.123 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=nfsd 2024-03-30T12:20:25.123 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=nvme 2024-03-30T12:20:25.123 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=os 2024-03-30T12:20:25.123 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-03-30T12:20:25.123 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=pressure 2024-03-30T12:20:25.123 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=rapl 2024-03-30T12:20:25.123 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=schedstat 2024-03-30T12:20:25.124 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=selinux 2024-03-30T12:20:25.124 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=sockstat 2024-03-30T12:20:25.124 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=softnet 2024-03-30T12:20:25.124 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=stat 2024-03-30T12:20:25.124 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=tapestats 2024-03-30T12:20:25.124 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=textfile 2024-03-30T12:20:25.124 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-03-30T12:20:25.124 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.775Z caller=node_exporter.go:117 level=info collector=time 2024-03-30T12:20:25.124 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.776Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-03-30T12:20:25.124 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.776Z caller=node_exporter.go:117 level=info collector=uname 2024-03-30T12:20:25.124 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.776Z caller=node_exporter.go:117 level=info collector=vmstat 2024-03-30T12:20:25.124 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.776Z caller=node_exporter.go:117 level=info collector=xfs 2024-03-30T12:20:25.124 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.776Z caller=node_exporter.go:117 level=info collector=zfs 2024-03-30T12:20:25.124 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.776Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-03-30T12:20:25.124 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[60640]: ts=2024-03-30T12:20:24.776Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-03-30T12:20:25.125 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 bash[60589]: 3d6e28b2348dea044954c4ea7f5fece91782c7d42e327b71674f8464b4f57f67 2024-03-30T12:20:25.125 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:20:24 smithi162 systemd[1]: Started Ceph node-exporter.b for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:20:25.425 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411370 got 77309411374 for osd.2 2024-03-30T12:20:25.425 DEBUG:teuthology.parallel:result is None 2024-03-30T12:20:25.824 INFO:teuthology.orchestra.run.smithi084.stdout:163208757280 2024-03-30T12:20:25.890 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:20:25.962 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:25 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:25.962 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:25 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:25.963 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:25 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:25.963 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:25 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:25.963 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:25 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:25.963 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:25 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:20:25.963 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:25 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/4209476908' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-30T12:20:25.963 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:25 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/1015399804' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-30T12:20:25.963 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:25 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:26.185 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:25 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:26.185 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:25 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:26.185 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:25 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:26.185 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:25 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:26.185 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:25 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:26.185 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:25 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:20:26.186 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:25 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/4209476908' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-30T12:20:26.186 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:25 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/1015399804' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-30T12:20:26.186 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:25 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:26.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:25 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:26.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:25 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:26.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:25 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:26.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:25 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:26.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:25 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:26.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:25 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:20:26.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:25 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/4209476908' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-30T12:20:26.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:25 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/1015399804' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-30T12:20:26.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:25 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:27.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:26 smithi162 ceph-mon[30421]: pgmap v29: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:27.140 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:26 smithi084 ceph-mon[27000]: pgmap v29: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:27.140 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:26 smithi084 ceph-mon[37565]: pgmap v29: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:27.643 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495639 got 197568495643 for osd.6 2024-03-30T12:20:27.644 DEBUG:teuthology.parallel:result is None 2024-03-30T12:20:28.087 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757277 got 163208757280 for osd.5 2024-03-30T12:20:28.087 DEBUG:teuthology.parallel:result is None 2024-03-30T12:20:28.498 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018912 got 128849018915 for osd.4 2024-03-30T12:20:28.499 DEBUG:teuthology.parallel:result is None 2024-03-30T12:20:29.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:28 smithi084 ceph-mon[27000]: pgmap v30: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:29.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:28 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:29.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:28 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:28 smithi084 ceph-mon[37565]: pgmap v30: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:28 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:28 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:29.285 INFO:teuthology.orchestra.run.smithi084.stdout:34359738425 2024-03-30T12:20:29.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:28 smithi162 ceph-mon[30421]: pgmap v30: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:29.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:28 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:29.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:28 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:29.627 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:20:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:20:29] "GET /metrics HTTP/1.1" 200 33649 "" "Prometheus/2.43.0" 2024-03-30T12:20:30.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:29 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3446409979' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-30T12:20:30.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:29 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/3446409979' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-30T12:20:30.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:29 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/3446409979' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-30T12:20:30.404 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738421 got 34359738425 for osd.0 2024-03-30T12:20:30.404 DEBUG:teuthology.parallel:result is None 2024-03-30T12:20:30.404 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-03-30T12:20:30.404 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:20:30.731 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:20:30.989 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:30 smithi084 ceph-mon[27000]: pgmap v31: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:30.990 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:30 smithi084 ceph-mon[37565]: pgmap v31: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:31.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:30 smithi162 ceph-mon[30421]: pgmap v31: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:32.620 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:20:32.622 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:20:33.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:32 smithi084 ceph-mon[37565]: pgmap v32: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:33.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:32 smithi084 ceph-mon[27000]: pgmap v32: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:33.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:32 smithi162 ceph-mon[30421]: pgmap v32: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:33.779 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-03-30T12:20:31.836113+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593516,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":227,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":315,"acting":315,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":315,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":239608,"kb_used_data":7056,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":749721608,"statfs":{"total":767960285184,"available":767714926592,"internally_reserved":0,"allocated":7225344,"data_stored":4082715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002644"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.028139+0000","last_change":"2024-03-30T12:19:00.863340+0000","last_active":"2024-03-30T12:19:36.028139+0000","last_peered":"2024-03-30T12:19:36.028139+0000","last_clean":"2024-03-30T12:19:36.028139+0000","last_became_active":"2024-03-30T12:19:00.863041+0000","last_became_peered":"2024-03-30T12:19:00.863041+0000","last_unstale":"2024-03-30T12:19:36.028139+0000","last_undegraded":"2024-03-30T12:19:36.028139+0000","last_fullsized":"2024-03-30T12:19:36.028139+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:21.728523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.818140+0000","last_change":"2024-03-30T12:19:00.867897+0000","last_active":"2024-03-30T12:19:35.818140+0000","last_peered":"2024-03-30T12:19:35.818140+0000","last_clean":"2024-03-30T12:19:35.818140+0000","last_became_active":"2024-03-30T12:19:00.867457+0000","last_became_peered":"2024-03-30T12:19:00.867457+0000","last_unstale":"2024-03-30T12:19:35.818140+0000","last_undegraded":"2024-03-30T12:19:35.818140+0000","last_fullsized":"2024-03-30T12:19:35.818140+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:06:41.382626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.029024+0000","last_change":"2024-03-30T12:19:00.853843+0000","last_active":"2024-03-30T12:19:36.029024+0000","last_peered":"2024-03-30T12:19:36.029024+0000","last_clean":"2024-03-30T12:19:36.029024+0000","last_became_active":"2024-03-30T12:19:00.853543+0000","last_became_peered":"2024-03-30T12:19:00.853543+0000","last_unstale":"2024-03-30T12:19:36.029024+0000","last_undegraded":"2024-03-30T12:19:36.029024+0000","last_fullsized":"2024-03-30T12:19:36.029024+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:52.339142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.930216+0000","last_change":"2024-03-30T12:19:00.859974+0000","last_active":"2024-03-30T12:19:35.930216+0000","last_peered":"2024-03-30T12:19:35.930216+0000","last_clean":"2024-03-30T12:19:35.930216+0000","last_became_active":"2024-03-30T12:19:00.859615+0000","last_became_peered":"2024-03-30T12:19:00.859615+0000","last_unstale":"2024-03-30T12:19:35.930216+0000","last_undegraded":"2024-03-30T12:19:35.930216+0000","last_fullsized":"2024-03-30T12:19:35.930216+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:26.933772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.027721+0000","last_change":"2024-03-30T12:19:00.872400+0000","last_active":"2024-03-30T12:19:36.027721+0000","last_peered":"2024-03-30T12:19:36.027721+0000","last_clean":"2024-03-30T12:19:36.027721+0000","last_became_active":"2024-03-30T12:19:00.872098+0000","last_became_peered":"2024-03-30T12:19:00.872098+0000","last_unstale":"2024-03-30T12:19:36.027721+0000","last_undegraded":"2024-03-30T12:19:36.027721+0000","last_fullsized":"2024-03-30T12:19:36.027721+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:21.152462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.930288+0000","last_change":"2024-03-30T12:19:00.858029+0000","last_active":"2024-03-30T12:19:35.930288+0000","last_peered":"2024-03-30T12:19:35.930288+0000","last_clean":"2024-03-30T12:19:35.930288+0000","last_became_active":"2024-03-30T12:19:00.857668+0000","last_became_peered":"2024-03-30T12:19:00.857668+0000","last_unstale":"2024-03-30T12:19:35.930288+0000","last_undegraded":"2024-03-30T12:19:35.930288+0000","last_fullsized":"2024-03-30T12:19:35.930288+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:17:33.313541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.027365+0000","last_change":"2024-03-30T12:19:00.869258+0000","last_active":"2024-03-30T12:19:36.027365+0000","last_peered":"2024-03-30T12:19:36.027365+0000","last_clean":"2024-03-30T12:19:36.027365+0000","last_became_active":"2024-03-30T12:19:00.868799+0000","last_became_peered":"2024-03-30T12:19:00.868799+0000","last_unstale":"2024-03-30T12:19:36.027365+0000","last_undegraded":"2024-03-30T12:19:36.027365+0000","last_fullsized":"2024-03-30T12:19:36.027365+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:00:11.265094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.814078+0000","last_change":"2024-03-30T12:19:00.864240+0000","last_active":"2024-03-30T12:19:35.814078+0000","last_peered":"2024-03-30T12:19:35.814078+0000","last_clean":"2024-03-30T12:19:35.814078+0000","last_became_active":"2024-03-30T12:19:00.863991+0000","last_became_peered":"2024-03-30T12:19:00.863991+0000","last_unstale":"2024-03-30T12:19:35.814078+0000","last_undegraded":"2024-03-30T12:19:35.814078+0000","last_fullsized":"2024-03-30T12:19:35.814078+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:59:30.409530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.028094+0000","last_change":"2024-03-30T12:19:00.875226+0000","last_active":"2024-03-30T12:19:36.028094+0000","last_peered":"2024-03-30T12:19:36.028094+0000","last_clean":"2024-03-30T12:19:36.028094+0000","last_became_active":"2024-03-30T12:19:00.874620+0000","last_became_peered":"2024-03-30T12:19:00.874620+0000","last_unstale":"2024-03-30T12:19:36.028094+0000","last_undegraded":"2024-03-30T12:19:36.028094+0000","last_fullsized":"2024-03-30T12:19:36.028094+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:58:40.881840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.928007+0000","last_change":"2024-03-30T12:19:00.869363+0000","last_active":"2024-03-30T12:19:35.928007+0000","last_peered":"2024-03-30T12:19:35.928007+0000","last_clean":"2024-03-30T12:19:35.928007+0000","last_became_active":"2024-03-30T12:19:00.868887+0000","last_became_peered":"2024-03-30T12:19:00.868887+0000","last_unstale":"2024-03-30T12:19:35.928007+0000","last_undegraded":"2024-03-30T12:19:35.928007+0000","last_fullsized":"2024-03-30T12:19:35.928007+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:40:49.543161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.928171+0000","last_change":"2024-03-30T12:19:00.863992+0000","last_active":"2024-03-30T12:19:35.928171+0000","last_peered":"2024-03-30T12:19:35.928171+0000","last_clean":"2024-03-30T12:19:35.928171+0000","last_became_active":"2024-03-30T12:19:00.863683+0000","last_became_peered":"2024-03-30T12:19:00.863683+0000","last_unstale":"2024-03-30T12:19:35.928171+0000","last_undegraded":"2024-03-30T12:19:35.928171+0000","last_fullsized":"2024-03-30T12:19:35.928171+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:40:36.734391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.814910+0000","last_change":"2024-03-30T12:19:00.862541+0000","last_active":"2024-03-30T12:19:35.814910+0000","last_peered":"2024-03-30T12:19:35.814910+0000","last_clean":"2024-03-30T12:19:35.814910+0000","last_became_active":"2024-03-30T12:19:00.862084+0000","last_became_peered":"2024-03-30T12:19:00.862084+0000","last_unstale":"2024-03-30T12:19:35.814910+0000","last_undegraded":"2024-03-30T12:19:35.814910+0000","last_fullsized":"2024-03-30T12:19:35.814910+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:36.445232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.814610+0000","last_change":"2024-03-30T12:19:00.850148+0000","last_active":"2024-03-30T12:19:35.814610+0000","last_peered":"2024-03-30T12:19:35.814610+0000","last_clean":"2024-03-30T12:19:35.814610+0000","last_became_active":"2024-03-30T12:19:00.849849+0000","last_became_peered":"2024-03-30T12:19:00.849849+0000","last_unstale":"2024-03-30T12:19:35.814610+0000","last_undegraded":"2024-03-30T12:19:35.814610+0000","last_fullsized":"2024-03-30T12:19:35.814610+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:55:56.657057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.028074+0000","last_change":"2024-03-30T12:19:00.865479+0000","last_active":"2024-03-30T12:19:36.028074+0000","last_peered":"2024-03-30T12:19:36.028074+0000","last_clean":"2024-03-30T12:19:36.028074+0000","last_became_active":"2024-03-30T12:19:00.864441+0000","last_became_peered":"2024-03-30T12:19:00.864441+0000","last_unstale":"2024-03-30T12:19:36.028074+0000","last_undegraded":"2024-03-30T12:19:36.028074+0000","last_fullsized":"2024-03-30T12:19:36.028074+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:45:55.344815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.817689+0000","last_change":"2024-03-30T12:19:00.866672+0000","last_active":"2024-03-30T12:19:35.817689+0000","last_peered":"2024-03-30T12:19:35.817689+0000","last_clean":"2024-03-30T12:19:35.817689+0000","last_became_active":"2024-03-30T12:19:00.866276+0000","last_became_peered":"2024-03-30T12:19:00.866276+0000","last_unstale":"2024-03-30T12:19:35.817689+0000","last_undegraded":"2024-03-30T12:19:35.817689+0000","last_fullsized":"2024-03-30T12:19:35.817689+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:23:49.856597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.929646+0000","last_change":"2024-03-30T12:19:00.864760+0000","last_active":"2024-03-30T12:19:35.929646+0000","last_peered":"2024-03-30T12:19:35.929646+0000","last_clean":"2024-03-30T12:19:35.929646+0000","last_became_active":"2024-03-30T12:19:00.864447+0000","last_became_peered":"2024-03-30T12:19:00.864447+0000","last_unstale":"2024-03-30T12:19:35.929646+0000","last_undegraded":"2024-03-30T12:19:35.929646+0000","last_fullsized":"2024-03-30T12:19:35.929646+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:26:47.024806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.930806+0000","last_change":"2024-03-30T12:19:00.863453+0000","last_active":"2024-03-30T12:19:35.930806+0000","last_peered":"2024-03-30T12:19:35.930806+0000","last_clean":"2024-03-30T12:19:35.930806+0000","last_became_active":"2024-03-30T12:19:00.863129+0000","last_became_peered":"2024-03-30T12:19:00.863129+0000","last_unstale":"2024-03-30T12:19:35.930806+0000","last_undegraded":"2024-03-30T12:19:35.930806+0000","last_fullsized":"2024-03-30T12:19:35.930806+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:19:33.658159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.028851+0000","last_change":"2024-03-30T12:19:00.854527+0000","last_active":"2024-03-30T12:19:36.028851+0000","last_peered":"2024-03-30T12:19:36.028851+0000","last_clean":"2024-03-30T12:19:36.028851+0000","last_became_active":"2024-03-30T12:19:00.854238+0000","last_became_peered":"2024-03-30T12:19:00.854238+0000","last_unstale":"2024-03-30T12:19:36.028851+0000","last_undegraded":"2024-03-30T12:19:36.028851+0000","last_fullsized":"2024-03-30T12:19:36.028851+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:50:54.069856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.027697+0000","last_change":"2024-03-30T12:19:00.854461+0000","last_active":"2024-03-30T12:19:36.027697+0000","last_peered":"2024-03-30T12:19:36.027697+0000","last_clean":"2024-03-30T12:19:36.027697+0000","last_became_active":"2024-03-30T12:19:00.854077+0000","last_became_peered":"2024-03-30T12:19:00.854077+0000","last_unstale":"2024-03-30T12:19:36.027697+0000","last_undegraded":"2024-03-30T12:19:36.027697+0000","last_fullsized":"2024-03-30T12:19:36.027697+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:24:10.940443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"61'4","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.029211+0000","last_change":"2024-03-30T12:19:00.466957+0000","last_active":"2024-03-30T12:19:36.029211+0000","last_peered":"2024-03-30T12:19:36.029211+0000","last_clean":"2024-03-30T12:19:36.029211+0000","last_became_active":"2024-03-30T12:19:00.466689+0000","last_became_peered":"2024-03-30T12:19:00.466689+0000","last_unstale":"2024-03-30T12:19:36.029211+0000","last_undegraded":"2024-03-30T12:19:36.029211+0000","last_fullsized":"2024-03-30T12:19:36.029211+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:08.774258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.814916+0000","last_change":"2024-03-30T12:19:00.863714+0000","last_active":"2024-03-30T12:19:35.814916+0000","last_peered":"2024-03-30T12:19:35.814916+0000","last_clean":"2024-03-30T12:19:35.814916+0000","last_became_active":"2024-03-30T12:19:00.863429+0000","last_became_peered":"2024-03-30T12:19:00.863429+0000","last_unstale":"2024-03-30T12:19:35.814916+0000","last_undegraded":"2024-03-30T12:19:35.814916+0000","last_fullsized":"2024-03-30T12:19:35.814916+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:31.953173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"61'1","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.814938+0000","last_change":"2024-03-30T12:19:00.459693+0000","last_active":"2024-03-30T12:19:35.814938+0000","last_peered":"2024-03-30T12:19:35.814938+0000","last_clean":"2024-03-30T12:19:35.814938+0000","last_became_active":"2024-03-30T12:19:00.459409+0000","last_became_peered":"2024-03-30T12:19:00.459409+0000","last_unstale":"2024-03-30T12:19:35.814938+0000","last_undegraded":"2024-03-30T12:19:35.814938+0000","last_fullsized":"2024-03-30T12:19:35.814938+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:27.891375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.029087+0000","last_change":"2024-03-30T12:19:00.864952+0000","last_active":"2024-03-30T12:19:36.029087+0000","last_peered":"2024-03-30T12:19:36.029087+0000","last_clean":"2024-03-30T12:19:36.029087+0000","last_became_active":"2024-03-30T12:19:00.864274+0000","last_became_peered":"2024-03-30T12:19:00.864274+0000","last_unstale":"2024-03-30T12:19:36.029087+0000","last_undegraded":"2024-03-30T12:19:36.029087+0000","last_fullsized":"2024-03-30T12:19:36.029087+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:45:00.775246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.027909+0000","last_change":"2024-03-30T12:19:00.469695+0000","last_active":"2024-03-30T12:19:36.027909+0000","last_peered":"2024-03-30T12:19:36.027909+0000","last_clean":"2024-03-30T12:19:36.027909+0000","last_became_active":"2024-03-30T12:19:00.469261+0000","last_became_peered":"2024-03-30T12:19:00.469261+0000","last_unstale":"2024-03-30T12:19:36.027909+0000","last_undegraded":"2024-03-30T12:19:36.027909+0000","last_fullsized":"2024-03-30T12:19:36.027909+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:02:43.407908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.930549+0000","last_change":"2024-03-30T12:19:00.859422+0000","last_active":"2024-03-30T12:19:35.930549+0000","last_peered":"2024-03-30T12:19:35.930549+0000","last_clean":"2024-03-30T12:19:35.930549+0000","last_became_active":"2024-03-30T12:19:00.858880+0000","last_became_peered":"2024-03-30T12:19:00.858880+0000","last_unstale":"2024-03-30T12:19:35.930549+0000","last_undegraded":"2024-03-30T12:19:35.930549+0000","last_fullsized":"2024-03-30T12:19:35.930549+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:09.612172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.027753+0000","last_change":"2024-03-30T12:19:00.467935+0000","last_active":"2024-03-30T12:19:36.027753+0000","last_peered":"2024-03-30T12:19:36.027753+0000","last_clean":"2024-03-30T12:19:36.027753+0000","last_became_active":"2024-03-30T12:19:00.467636+0000","last_became_peered":"2024-03-30T12:19:00.467636+0000","last_unstale":"2024-03-30T12:19:36.027753+0000","last_undegraded":"2024-03-30T12:19:36.027753+0000","last_fullsized":"2024-03-30T12:19:36.027753+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:49.599855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.930412+0000","last_change":"2024-03-30T12:19:00.859307+0000","last_active":"2024-03-30T12:19:35.930412+0000","last_peered":"2024-03-30T12:19:35.930412+0000","last_clean":"2024-03-30T12:19:35.930412+0000","last_became_active":"2024-03-30T12:19:00.858775+0000","last_became_peered":"2024-03-30T12:19:00.858775+0000","last_unstale":"2024-03-30T12:19:35.930412+0000","last_undegraded":"2024-03-30T12:19:35.930412+0000","last_fullsized":"2024-03-30T12:19:35.930412+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:30:39.349902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"61'1","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.814750+0000","last_change":"2024-03-30T12:19:00.454521+0000","last_active":"2024-03-30T12:19:35.814750+0000","last_peered":"2024-03-30T12:19:35.814750+0000","last_clean":"2024-03-30T12:19:35.814750+0000","last_became_active":"2024-03-30T12:19:00.454213+0000","last_became_peered":"2024-03-30T12:19:00.454213+0000","last_unstale":"2024-03-30T12:19:35.814750+0000","last_undegraded":"2024-03-30T12:19:35.814750+0000","last_fullsized":"2024-03-30T12:19:35.814750+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:27:47.198072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.814359+0000","last_change":"2024-03-30T12:19:00.860724+0000","last_active":"2024-03-30T12:19:35.814359+0000","last_peered":"2024-03-30T12:19:35.814359+0000","last_clean":"2024-03-30T12:19:35.814359+0000","last_became_active":"2024-03-30T12:19:00.860427+0000","last_became_peered":"2024-03-30T12:19:00.860427+0000","last_unstale":"2024-03-30T12:19:35.814359+0000","last_undegraded":"2024-03-30T12:19:35.814359+0000","last_fullsized":"2024-03-30T12:19:35.814359+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:55:54.757770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"61'1","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.928185+0000","last_change":"2024-03-30T12:19:00.460150+0000","last_active":"2024-03-30T12:19:35.928185+0000","last_peered":"2024-03-30T12:19:35.928185+0000","last_clean":"2024-03-30T12:19:35.928185+0000","last_became_active":"2024-03-30T12:19:00.459740+0000","last_became_peered":"2024-03-30T12:19:00.459740+0000","last_unstale":"2024-03-30T12:19:35.928185+0000","last_undegraded":"2024-03-30T12:19:35.928185+0000","last_fullsized":"2024-03-30T12:19:35.928185+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:52:40.523467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.028256+0000","last_change":"2024-03-30T12:19:00.857403+0000","last_active":"2024-03-30T12:19:36.028256+0000","last_peered":"2024-03-30T12:19:36.028256+0000","last_clean":"2024-03-30T12:19:36.028256+0000","last_became_active":"2024-03-30T12:19:00.856652+0000","last_became_peered":"2024-03-30T12:19:00.856652+0000","last_unstale":"2024-03-30T12:19:36.028256+0000","last_undegraded":"2024-03-30T12:19:36.028256+0000","last_fullsized":"2024-03-30T12:19:36.028256+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:51.932935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.814541+0000","last_change":"2024-03-30T12:19:00.458253+0000","last_active":"2024-03-30T12:19:35.814541+0000","last_peered":"2024-03-30T12:19:35.814541+0000","last_clean":"2024-03-30T12:19:35.814541+0000","last_became_active":"2024-03-30T12:19:00.457947+0000","last_became_peered":"2024-03-30T12:19:00.457947+0000","last_unstale":"2024-03-30T12:19:35.814541+0000","last_undegraded":"2024-03-30T12:19:35.814541+0000","last_fullsized":"2024-03-30T12:19:35.814541+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:13:18.864198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.814308+0000","last_change":"2024-03-30T12:19:00.859188+0000","last_active":"2024-03-30T12:19:35.814308+0000","last_peered":"2024-03-30T12:19:35.814308+0000","last_clean":"2024-03-30T12:19:35.814308+0000","last_became_active":"2024-03-30T12:19:00.858922+0000","last_became_peered":"2024-03-30T12:19:00.858922+0000","last_unstale":"2024-03-30T12:19:35.814308+0000","last_undegraded":"2024-03-30T12:19:35.814308+0000","last_fullsized":"2024-03-30T12:19:35.814308+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:56:16.965191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.929747+0000","last_change":"2024-03-30T12:19:00.466729+0000","last_active":"2024-03-30T12:19:35.929747+0000","last_peered":"2024-03-30T12:19:35.929747+0000","last_clean":"2024-03-30T12:19:35.929747+0000","last_became_active":"2024-03-30T12:19:00.466086+0000","last_became_peered":"2024-03-30T12:19:00.466086+0000","last_unstale":"2024-03-30T12:19:35.929747+0000","last_undegraded":"2024-03-30T12:19:35.929747+0000","last_fullsized":"2024-03-30T12:19:35.929747+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:46:14.144417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.817849+0000","last_change":"2024-03-30T12:19:00.863262+0000","last_active":"2024-03-30T12:19:35.817849+0000","last_peered":"2024-03-30T12:19:35.817849+0000","last_clean":"2024-03-30T12:19:35.817849+0000","last_became_active":"2024-03-30T12:19:00.861328+0000","last_became_peered":"2024-03-30T12:19:00.861328+0000","last_unstale":"2024-03-30T12:19:35.817849+0000","last_undegraded":"2024-03-30T12:19:35.817849+0000","last_fullsized":"2024-03-30T12:19:35.817849+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:20:19.049967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.928060+0000","last_change":"2024-03-30T12:19:00.459929+0000","last_active":"2024-03-30T12:19:35.928060+0000","last_peered":"2024-03-30T12:19:35.928060+0000","last_clean":"2024-03-30T12:19:35.928060+0000","last_became_active":"2024-03-30T12:19:00.459518+0000","last_became_peered":"2024-03-30T12:19:00.459518+0000","last_unstale":"2024-03-30T12:19:35.928060+0000","last_undegraded":"2024-03-30T12:19:35.928060+0000","last_fullsized":"2024-03-30T12:19:35.928060+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:09:03.990119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.930656+0000","last_change":"2024-03-30T12:19:00.862112+0000","last_active":"2024-03-30T12:19:35.930656+0000","last_peered":"2024-03-30T12:19:35.930656+0000","last_clean":"2024-03-30T12:19:35.930656+0000","last_became_active":"2024-03-30T12:19:00.861782+0000","last_became_peered":"2024-03-30T12:19:00.861782+0000","last_unstale":"2024-03-30T12:19:35.930656+0000","last_undegraded":"2024-03-30T12:19:35.930656+0000","last_fullsized":"2024-03-30T12:19:35.930656+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:01:42.946530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.930243+0000","last_change":"2024-03-30T12:19:00.463745+0000","last_active":"2024-03-30T12:19:35.930243+0000","last_peered":"2024-03-30T12:19:35.930243+0000","last_clean":"2024-03-30T12:19:35.930243+0000","last_became_active":"2024-03-30T12:19:00.462698+0000","last_became_peered":"2024-03-30T12:19:00.462698+0000","last_unstale":"2024-03-30T12:19:35.930243+0000","last_undegraded":"2024-03-30T12:19:35.930243+0000","last_fullsized":"2024-03-30T12:19:35.930243+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:09:33.196928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.029063+0000","last_change":"2024-03-30T12:19:00.865197+0000","last_active":"2024-03-30T12:19:36.029063+0000","last_peered":"2024-03-30T12:19:36.029063+0000","last_clean":"2024-03-30T12:19:36.029063+0000","last_became_active":"2024-03-30T12:19:00.864718+0000","last_became_peered":"2024-03-30T12:19:00.864718+0000","last_unstale":"2024-03-30T12:19:36.029063+0000","last_undegraded":"2024-03-30T12:19:36.029063+0000","last_fullsized":"2024-03-30T12:19:36.029063+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:33:34.137353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.818088+0000","last_change":"2024-03-30T12:19:00.463581+0000","last_active":"2024-03-30T12:19:35.818088+0000","last_peered":"2024-03-30T12:19:35.818088+0000","last_clean":"2024-03-30T12:19:35.818088+0000","last_became_active":"2024-03-30T12:19:00.463280+0000","last_became_peered":"2024-03-30T12:19:00.463280+0000","last_unstale":"2024-03-30T12:19:35.818088+0000","last_undegraded":"2024-03-30T12:19:35.818088+0000","last_fullsized":"2024-03-30T12:19:35.818088+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:38:07.390655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.814860+0000","last_change":"2024-03-30T12:19:00.878541+0000","last_active":"2024-03-30T12:19:35.814860+0000","last_peered":"2024-03-30T12:19:35.814860+0000","last_clean":"2024-03-30T12:19:35.814860+0000","last_became_active":"2024-03-30T12:19:00.878229+0000","last_became_peered":"2024-03-30T12:19:00.878229+0000","last_unstale":"2024-03-30T12:19:35.814860+0000","last_undegraded":"2024-03-30T12:19:35.814860+0000","last_fullsized":"2024-03-30T12:19:35.814860+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:03:18.020146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"65'9","reported_seq":25,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.930498+0000","last_change":"2024-03-30T12:19:00.458102+0000","last_active":"2024-03-30T12:19:35.930498+0000","last_peered":"2024-03-30T12:19:35.930498+0000","last_clean":"2024-03-30T12:19:35.930498+0000","last_became_active":"2024-03-30T12:19:00.457759+0000","last_became_peered":"2024-03-30T12:19:00.457759+0000","last_unstale":"2024-03-30T12:19:35.930498+0000","last_undegraded":"2024-03-30T12:19:35.930498+0000","last_fullsized":"2024-03-30T12:19:35.930498+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:31.713303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2350,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.027783+0000","last_change":"2024-03-30T12:19:00.872384+0000","last_active":"2024-03-30T12:19:36.027783+0000","last_peered":"2024-03-30T12:19:36.027783+0000","last_clean":"2024-03-30T12:19:36.027783+0000","last_became_active":"2024-03-30T12:19:00.872085+0000","last_became_peered":"2024-03-30T12:19:00.872085+0000","last_unstale":"2024-03-30T12:19:36.027783+0000","last_undegraded":"2024-03-30T12:19:36.027783+0000","last_fullsized":"2024-03-30T12:19:36.027783+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:47:42.278500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.028555+0000","last_change":"2024-03-30T12:19:00.462939+0000","last_active":"2024-03-30T12:19:36.028555+0000","last_peered":"2024-03-30T12:19:36.028555+0000","last_clean":"2024-03-30T12:19:36.028555+0000","last_became_active":"2024-03-30T12:19:00.462637+0000","last_became_peered":"2024-03-30T12:19:00.462637+0000","last_unstale":"2024-03-30T12:19:36.028555+0000","last_undegraded":"2024-03-30T12:19:36.028555+0000","last_fullsized":"2024-03-30T12:19:36.028555+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:48:59.027106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.027992+0000","last_change":"2024-03-30T12:19:00.856865+0000","last_active":"2024-03-30T12:19:36.027992+0000","last_peered":"2024-03-30T12:19:36.027992+0000","last_clean":"2024-03-30T12:19:36.027992+0000","last_became_active":"2024-03-30T12:19:00.856544+0000","last_became_peered":"2024-03-30T12:19:00.856544+0000","last_unstale":"2024-03-30T12:19:36.027992+0000","last_undegraded":"2024-03-30T12:19:36.027992+0000","last_fullsized":"2024-03-30T12:19:36.027992+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:37:39.901012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.930037+0000","last_change":"2024-03-30T12:19:00.465931+0000","last_active":"2024-03-30T12:19:35.930037+0000","last_peered":"2024-03-30T12:19:35.930037+0000","last_clean":"2024-03-30T12:19:35.930037+0000","last_became_active":"2024-03-30T12:19:00.465589+0000","last_became_peered":"2024-03-30T12:19:00.465589+0000","last_unstale":"2024-03-30T12:19:35.930037+0000","last_undegraded":"2024-03-30T12:19:35.930037+0000","last_fullsized":"2024-03-30T12:19:35.930037+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:02:38.614924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.027702+0000","last_change":"2024-03-30T12:19:00.870798+0000","last_active":"2024-03-30T12:19:36.027702+0000","last_peered":"2024-03-30T12:19:36.027702+0000","last_clean":"2024-03-30T12:19:36.027702+0000","last_became_active":"2024-03-30T12:19:00.870507+0000","last_became_peered":"2024-03-30T12:19:00.870507+0000","last_unstale":"2024-03-30T12:19:36.027702+0000","last_undegraded":"2024-03-30T12:19:36.027702+0000","last_fullsized":"2024-03-30T12:19:36.027702+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:25:30.259298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.927750+0000","last_change":"2024-03-30T12:19:00.454678+0000","last_active":"2024-03-30T12:19:35.927750+0000","last_peered":"2024-03-30T12:19:35.927750+0000","last_clean":"2024-03-30T12:19:35.927750+0000","last_became_active":"2024-03-30T12:19:00.454380+0000","last_became_peered":"2024-03-30T12:19:00.454380+0000","last_unstale":"2024-03-30T12:19:35.927750+0000","last_undegraded":"2024-03-30T12:19:35.927750+0000","last_fullsized":"2024-03-30T12:19:35.927750+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:08:24.640327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.927698+0000","last_change":"2024-03-30T12:19:00.861547+0000","last_active":"2024-03-30T12:19:35.927698+0000","last_peered":"2024-03-30T12:19:35.927698+0000","last_clean":"2024-03-30T12:19:35.927698+0000","last_became_active":"2024-03-30T12:19:00.861268+0000","last_became_peered":"2024-03-30T12:19:00.861268+0000","last_unstale":"2024-03-30T12:19:35.927698+0000","last_undegraded":"2024-03-30T12:19:35.927698+0000","last_fullsized":"2024-03-30T12:19:35.927698+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:28:37.342309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":24,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.027523+0000","last_change":"2024-03-30T12:19:00.460090+0000","last_active":"2024-03-30T12:19:36.027523+0000","last_peered":"2024-03-30T12:19:36.027523+0000","last_clean":"2024-03-30T12:19:36.027523+0000","last_became_active":"2024-03-30T12:19:00.459790+0000","last_became_peered":"2024-03-30T12:19:00.459790+0000","last_unstale":"2024-03-30T12:19:36.027523+0000","last_undegraded":"2024-03-30T12:19:36.027523+0000","last_fullsized":"2024-03-30T12:19:36.027523+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:38.860631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.027500+0000","last_change":"2024-03-30T12:19:00.870061+0000","last_active":"2024-03-30T12:19:36.027500+0000","last_peered":"2024-03-30T12:19:36.027500+0000","last_clean":"2024-03-30T12:19:36.027500+0000","last_became_active":"2024-03-30T12:19:00.869750+0000","last_became_peered":"2024-03-30T12:19:00.869750+0000","last_unstale":"2024-03-30T12:19:36.027500+0000","last_undegraded":"2024-03-30T12:19:36.027500+0000","last_fullsized":"2024-03-30T12:19:36.027500+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:03:02.790151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"61'1","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.814775+0000","last_change":"2024-03-30T12:19:00.461178+0000","last_active":"2024-03-30T12:19:35.814775+0000","last_peered":"2024-03-30T12:19:35.814775+0000","last_clean":"2024-03-30T12:19:35.814775+0000","last_became_active":"2024-03-30T12:19:00.460817+0000","last_became_peered":"2024-03-30T12:19:00.460817+0000","last_unstale":"2024-03-30T12:19:35.814775+0000","last_undegraded":"2024-03-30T12:19:35.814775+0000","last_fullsized":"2024-03-30T12:19:35.814775+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:30:59.255694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.027926+0000","last_change":"2024-03-30T12:19:00.871828+0000","last_active":"2024-03-30T12:19:36.027926+0000","last_peered":"2024-03-30T12:19:36.027926+0000","last_clean":"2024-03-30T12:19:36.027926+0000","last_became_active":"2024-03-30T12:19:00.871555+0000","last_became_peered":"2024-03-30T12:19:00.871555+0000","last_unstale":"2024-03-30T12:19:36.027926+0000","last_undegraded":"2024-03-30T12:19:36.027926+0000","last_fullsized":"2024-03-30T12:19:36.027926+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:02:53.212521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.828457+0000","last_change":"2024-03-30T12:19:35.161648+0000","last_active":"2024-03-30T12:19:36.828457+0000","last_peered":"2024-03-30T12:19:36.828457+0000","last_clean":"2024-03-30T12:19:36.828457+0000","last_became_active":"2024-03-30T12:19:35.161426+0000","last_became_peered":"2024-03-30T12:19:35.161426+0000","last_unstale":"2024-03-30T12:19:36.828457+0000","last_undegraded":"2024-03-30T12:19:36.828457+0000","last_fullsized":"2024-03-30T12:19:36.828457+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:05:56.726860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.817983+0000","last_change":"2024-03-30T12:19:00.462709+0000","last_active":"2024-03-30T12:19:35.817983+0000","last_peered":"2024-03-30T12:19:35.817983+0000","last_clean":"2024-03-30T12:19:35.817983+0000","last_became_active":"2024-03-30T12:19:00.462429+0000","last_became_peered":"2024-03-30T12:19:00.462429+0000","last_unstale":"2024-03-30T12:19:35.817983+0000","last_undegraded":"2024-03-30T12:19:35.817983+0000","last_fullsized":"2024-03-30T12:19:35.817983+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:29.579526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.930472+0000","last_change":"2024-03-30T12:19:00.854025+0000","last_active":"2024-03-30T12:19:35.930472+0000","last_peered":"2024-03-30T12:19:35.930472+0000","last_clean":"2024-03-30T12:19:35.930472+0000","last_became_active":"2024-03-30T12:19:00.853714+0000","last_became_peered":"2024-03-30T12:19:00.853714+0000","last_unstale":"2024-03-30T12:19:35.930472+0000","last_undegraded":"2024-03-30T12:19:35.930472+0000","last_fullsized":"2024-03-30T12:19:35.930472+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:27:34.498087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.828503+0000","last_change":"2024-03-30T12:19:35.051431+0000","last_active":"2024-03-30T12:19:36.828503+0000","last_peered":"2024-03-30T12:19:36.828503+0000","last_clean":"2024-03-30T12:19:36.828503+0000","last_became_active":"2024-03-30T12:19:35.050880+0000","last_became_peered":"2024-03-30T12:19:35.050880+0000","last_unstale":"2024-03-30T12:19:36.828503+0000","last_undegraded":"2024-03-30T12:19:36.828503+0000","last_fullsized":"2024-03-30T12:19:36.828503+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:57:58.075785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.930017+0000","last_change":"2024-03-30T12:19:00.457612+0000","last_active":"2024-03-30T12:19:35.930017+0000","last_peered":"2024-03-30T12:19:35.930017+0000","last_clean":"2024-03-30T12:19:35.930017+0000","last_became_active":"2024-03-30T12:19:00.457289+0000","last_became_peered":"2024-03-30T12:19:00.457289+0000","last_unstale":"2024-03-30T12:19:35.930017+0000","last_undegraded":"2024-03-30T12:19:35.930017+0000","last_fullsized":"2024-03-30T12:19:35.930017+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:23.011997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.814439+0000","last_change":"2024-03-30T12:19:00.866070+0000","last_active":"2024-03-30T12:19:35.814439+0000","last_peered":"2024-03-30T12:19:35.814439+0000","last_clean":"2024-03-30T12:19:35.814439+0000","last_became_active":"2024-03-30T12:19:00.865706+0000","last_became_peered":"2024-03-30T12:19:00.865706+0000","last_unstale":"2024-03-30T12:19:35.814439+0000","last_undegraded":"2024-03-30T12:19:35.814439+0000","last_fullsized":"2024-03-30T12:19:35.814439+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:56:01.599580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.828596+0000","last_change":"2024-03-30T12:19:35.162695+0000","last_active":"2024-03-30T12:19:36.828596+0000","last_peered":"2024-03-30T12:19:36.828596+0000","last_clean":"2024-03-30T12:19:36.828596+0000","last_became_active":"2024-03-30T12:19:35.162389+0000","last_became_peered":"2024-03-30T12:19:35.162389+0000","last_unstale":"2024-03-30T12:19:36.828596+0000","last_undegraded":"2024-03-30T12:19:36.828596+0000","last_fullsized":"2024-03-30T12:19:36.828596+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:20:43.739417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.817690+0000","last_change":"2024-03-30T12:19:00.861917+0000","last_active":"2024-03-30T12:19:35.817690+0000","last_peered":"2024-03-30T12:19:35.817690+0000","last_clean":"2024-03-30T12:19:35.817690+0000","last_became_active":"2024-03-30T12:19:00.860645+0000","last_became_peered":"2024-03-30T12:19:00.860645+0000","last_unstale":"2024-03-30T12:19:35.817690+0000","last_undegraded":"2024-03-30T12:19:35.817690+0000","last_fullsized":"2024-03-30T12:19:35.817690+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:30:51.438018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.028134+0000","last_change":"2024-03-30T12:19:00.459145+0000","last_active":"2024-03-30T12:19:36.028134+0000","last_peered":"2024-03-30T12:19:36.028134+0000","last_clean":"2024-03-30T12:19:36.028134+0000","last_became_active":"2024-03-30T12:19:00.457819+0000","last_became_peered":"2024-03-30T12:19:00.457819+0000","last_unstale":"2024-03-30T12:19:36.028134+0000","last_undegraded":"2024-03-30T12:19:36.028134+0000","last_fullsized":"2024-03-30T12:19:36.028134+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:44:38.245366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.827210+0000","last_change":"2024-03-30T12:19:35.161274+0000","last_active":"2024-03-30T12:19:36.827210+0000","last_peered":"2024-03-30T12:19:36.827210+0000","last_clean":"2024-03-30T12:19:36.827210+0000","last_became_active":"2024-03-30T12:19:35.160985+0000","last_became_peered":"2024-03-30T12:19:35.160985+0000","last_unstale":"2024-03-30T12:19:36.827210+0000","last_undegraded":"2024-03-30T12:19:36.827210+0000","last_fullsized":"2024-03-30T12:19:36.827210+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:07.499529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.814736+0000","last_change":"2024-03-30T12:19:00.862340+0000","last_active":"2024-03-30T12:19:35.814736+0000","last_peered":"2024-03-30T12:19:35.814736+0000","last_clean":"2024-03-30T12:19:35.814736+0000","last_became_active":"2024-03-30T12:19:00.861413+0000","last_became_peered":"2024-03-30T12:19:00.861413+0000","last_unstale":"2024-03-30T12:19:35.814736+0000","last_undegraded":"2024-03-30T12:19:35.814736+0000","last_fullsized":"2024-03-30T12:19:35.814736+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:13:39.199499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.929869+0000","last_change":"2024-03-30T12:19:00.465946+0000","last_active":"2024-03-30T12:19:35.929869+0000","last_peered":"2024-03-30T12:19:35.929869+0000","last_clean":"2024-03-30T12:19:35.929869+0000","last_became_active":"2024-03-30T12:19:00.465618+0000","last_became_peered":"2024-03-30T12:19:00.465618+0000","last_unstale":"2024-03-30T12:19:35.929869+0000","last_undegraded":"2024-03-30T12:19:35.929869+0000","last_fullsized":"2024-03-30T12:19:35.929869+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:58:42.109572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"66'128","reported_seq":263,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.888859+0000","last_change":"2024-03-30T12:18:45.912869+0000","last_active":"2024-03-30T12:19:37.888859+0000","last_peered":"2024-03-30T12:19:37.888859+0000","last_clean":"2024-03-30T12:19:37.888859+0000","last_became_active":"2024-03-30T12:18:45.912395+0000","last_became_peered":"2024-03-30T12:18:45.912395+0000","last_unstale":"2024-03-30T12:19:37.888859+0000","last_undegraded":"2024-03-30T12:19:37.888859+0000","last_fullsized":"2024-03-30T12:19:37.888859+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:34.485283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.825720+0000","last_change":"2024-03-30T12:19:35.052180+0000","last_active":"2024-03-30T12:19:36.825720+0000","last_peered":"2024-03-30T12:19:36.825720+0000","last_clean":"2024-03-30T12:19:36.825720+0000","last_became_active":"2024-03-30T12:19:35.051577+0000","last_became_peered":"2024-03-30T12:19:35.051577+0000","last_unstale":"2024-03-30T12:19:36.825720+0000","last_undegraded":"2024-03-30T12:19:36.825720+0000","last_fullsized":"2024-03-30T12:19:36.825720+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:26:43.695424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.027664+0000","last_change":"2024-03-30T12:19:00.852506+0000","last_active":"2024-03-30T12:19:36.027664+0000","last_peered":"2024-03-30T12:19:36.027664+0000","last_clean":"2024-03-30T12:19:36.027664+0000","last_became_active":"2024-03-30T12:19:00.852216+0000","last_became_peered":"2024-03-30T12:19:00.852216+0000","last_unstale":"2024-03-30T12:19:36.027664+0000","last_undegraded":"2024-03-30T12:19:36.027664+0000","last_fullsized":"2024-03-30T12:19:36.027664+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:41:21.462303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.027304+0000","last_change":"2024-03-30T12:19:00.470266+0000","last_active":"2024-03-30T12:19:36.027304+0000","last_peered":"2024-03-30T12:19:36.027304+0000","last_clean":"2024-03-30T12:19:36.027304+0000","last_became_active":"2024-03-30T12:19:00.469541+0000","last_became_peered":"2024-03-30T12:19:00.469541+0000","last_unstale":"2024-03-30T12:19:36.027304+0000","last_undegraded":"2024-03-30T12:19:36.027304+0000","last_fullsized":"2024-03-30T12:19:36.027304+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:57.244620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.825649+0000","last_change":"2024-03-30T12:19:35.162977+0000","last_active":"2024-03-30T12:19:36.825649+0000","last_peered":"2024-03-30T12:19:36.825649+0000","last_clean":"2024-03-30T12:19:36.825649+0000","last_became_active":"2024-03-30T12:19:35.162514+0000","last_became_peered":"2024-03-30T12:19:35.162514+0000","last_unstale":"2024-03-30T12:19:36.825649+0000","last_undegraded":"2024-03-30T12:19:36.825649+0000","last_fullsized":"2024-03-30T12:19:36.825649+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:39:43.550849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.027844+0000","last_change":"2024-03-30T12:19:00.469567+0000","last_active":"2024-03-30T12:19:36.027844+0000","last_peered":"2024-03-30T12:19:36.027844+0000","last_clean":"2024-03-30T12:19:36.027844+0000","last_became_active":"2024-03-30T12:19:00.469218+0000","last_became_peered":"2024-03-30T12:19:00.469218+0000","last_unstale":"2024-03-30T12:19:36.027844+0000","last_undegraded":"2024-03-30T12:19:36.027844+0000","last_fullsized":"2024-03-30T12:19:36.027844+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:16:05.609865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.818113+0000","last_change":"2024-03-30T12:19:00.865798+0000","last_active":"2024-03-30T12:19:35.818113+0000","last_peered":"2024-03-30T12:19:35.818113+0000","last_clean":"2024-03-30T12:19:35.818113+0000","last_became_active":"2024-03-30T12:19:00.865518+0000","last_became_peered":"2024-03-30T12:19:00.865518+0000","last_unstale":"2024-03-30T12:19:35.818113+0000","last_undegraded":"2024-03-30T12:19:35.818113+0000","last_fullsized":"2024-03-30T12:19:35.818113+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:47:41.818140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.825808+0000","last_change":"2024-03-30T12:19:35.162768+0000","last_active":"2024-03-30T12:19:36.825808+0000","last_peered":"2024-03-30T12:19:36.825808+0000","last_clean":"2024-03-30T12:19:36.825808+0000","last_became_active":"2024-03-30T12:19:35.162480+0000","last_became_peered":"2024-03-30T12:19:35.162480+0000","last_unstale":"2024-03-30T12:19:36.825808+0000","last_undegraded":"2024-03-30T12:19:36.825808+0000","last_fullsized":"2024-03-30T12:19:36.825808+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:17:01.235481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"62'1","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.818339+0000","last_change":"2024-03-30T12:19:00.454554+0000","last_active":"2024-03-30T12:19:35.818339+0000","last_peered":"2024-03-30T12:19:35.818339+0000","last_clean":"2024-03-30T12:19:35.818339+0000","last_became_active":"2024-03-30T12:19:00.454233+0000","last_became_peered":"2024-03-30T12:19:00.454233+0000","last_unstale":"2024-03-30T12:19:35.818339+0000","last_undegraded":"2024-03-30T12:19:35.818339+0000","last_fullsized":"2024-03-30T12:19:35.818339+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:05:09.010127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.815006+0000","last_change":"2024-03-30T12:19:00.853806+0000","last_active":"2024-03-30T12:19:35.815006+0000","last_peered":"2024-03-30T12:19:35.815006+0000","last_clean":"2024-03-30T12:19:35.815006+0000","last_became_active":"2024-03-30T12:19:00.853538+0000","last_became_peered":"2024-03-30T12:19:00.853538+0000","last_unstale":"2024-03-30T12:19:35.815006+0000","last_undegraded":"2024-03-30T12:19:35.815006+0000","last_fullsized":"2024-03-30T12:19:35.815006+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:36:10.741436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.827108+0000","last_change":"2024-03-30T12:19:35.162679+0000","last_active":"2024-03-30T12:19:36.827108+0000","last_peered":"2024-03-30T12:19:36.827108+0000","last_clean":"2024-03-30T12:19:36.827108+0000","last_became_active":"2024-03-30T12:19:35.162347+0000","last_became_peered":"2024-03-30T12:19:35.162347+0000","last_unstale":"2024-03-30T12:19:36.827108+0000","last_undegraded":"2024-03-30T12:19:36.827108+0000","last_fullsized":"2024-03-30T12:19:36.827108+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:24:16.565563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.928063+0000","last_change":"2024-03-30T12:19:00.460279+0000","last_active":"2024-03-30T12:19:35.928063+0000","last_peered":"2024-03-30T12:19:35.928063+0000","last_clean":"2024-03-30T12:19:35.928063+0000","last_became_active":"2024-03-30T12:19:00.459948+0000","last_became_peered":"2024-03-30T12:19:00.459948+0000","last_unstale":"2024-03-30T12:19:35.928063+0000","last_undegraded":"2024-03-30T12:19:35.928063+0000","last_fullsized":"2024-03-30T12:19:35.928063+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:06.870147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.029237+0000","last_change":"2024-03-30T12:19:00.853029+0000","last_active":"2024-03-30T12:19:36.029237+0000","last_peered":"2024-03-30T12:19:36.029237+0000","last_clean":"2024-03-30T12:19:36.029237+0000","last_became_active":"2024-03-30T12:19:00.852755+0000","last_became_peered":"2024-03-30T12:19:00.852755+0000","last_unstale":"2024-03-30T12:19:36.029237+0000","last_undegraded":"2024-03-30T12:19:36.029237+0000","last_fullsized":"2024-03-30T12:19:36.029237+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:03:44.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.027467+0000","last_change":"2024-03-30T12:19:00.470521+0000","last_active":"2024-03-30T12:19:36.027467+0000","last_peered":"2024-03-30T12:19:36.027467+0000","last_clean":"2024-03-30T12:19:36.027467+0000","last_became_active":"2024-03-30T12:19:00.469910+0000","last_became_peered":"2024-03-30T12:19:00.469910+0000","last_unstale":"2024-03-30T12:19:36.027467+0000","last_undegraded":"2024-03-30T12:19:36.027467+0000","last_fullsized":"2024-03-30T12:19:36.027467+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:12:52.044394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.814557+0000","last_change":"2024-03-30T12:19:00.877240+0000","last_active":"2024-03-30T12:19:35.814557+0000","last_peered":"2024-03-30T12:19:35.814557+0000","last_clean":"2024-03-30T12:19:35.814557+0000","last_became_active":"2024-03-30T12:19:00.876739+0000","last_became_peered":"2024-03-30T12:19:00.876739+0000","last_unstale":"2024-03-30T12:19:35.814557+0000","last_undegraded":"2024-03-30T12:19:35.814557+0000","last_fullsized":"2024-03-30T12:19:35.814557+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:25.328486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.817741+0000","last_change":"2024-03-30T12:19:00.459528+0000","last_active":"2024-03-30T12:19:35.817741+0000","last_peered":"2024-03-30T12:19:35.817741+0000","last_clean":"2024-03-30T12:19:35.817741+0000","last_became_active":"2024-03-30T12:19:00.459223+0000","last_became_peered":"2024-03-30T12:19:00.459223+0000","last_unstale":"2024-03-30T12:19:35.817741+0000","last_undegraded":"2024-03-30T12:19:35.817741+0000","last_fullsized":"2024-03-30T12:19:35.817741+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:44.399783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.814289+0000","last_change":"2024-03-30T12:19:00.850810+0000","last_active":"2024-03-30T12:19:35.814289+0000","last_peered":"2024-03-30T12:19:35.814289+0000","last_clean":"2024-03-30T12:19:35.814289+0000","last_became_active":"2024-03-30T12:19:00.850530+0000","last_became_peered":"2024-03-30T12:19:00.850530+0000","last_unstale":"2024-03-30T12:19:35.814289+0000","last_undegraded":"2024-03-30T12:19:35.814289+0000","last_fullsized":"2024-03-30T12:19:35.814289+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:52:32.869322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.818014+0000","last_change":"2024-03-30T12:19:00.460526+0000","last_active":"2024-03-30T12:19:35.818014+0000","last_peered":"2024-03-30T12:19:35.818014+0000","last_clean":"2024-03-30T12:19:35.818014+0000","last_became_active":"2024-03-30T12:19:00.460018+0000","last_became_peered":"2024-03-30T12:19:00.460018+0000","last_unstale":"2024-03-30T12:19:35.818014+0000","last_undegraded":"2024-03-30T12:19:35.818014+0000","last_fullsized":"2024-03-30T12:19:35.818014+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:33:30.671209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.814800+0000","last_change":"2024-03-30T12:19:00.858733+0000","last_active":"2024-03-30T12:19:35.814800+0000","last_peered":"2024-03-30T12:19:35.814800+0000","last_clean":"2024-03-30T12:19:35.814800+0000","last_became_active":"2024-03-30T12:19:00.858419+0000","last_became_peered":"2024-03-30T12:19:00.858419+0000","last_unstale":"2024-03-30T12:19:35.814800+0000","last_undegraded":"2024-03-30T12:19:35.814800+0000","last_fullsized":"2024-03-30T12:19:35.814800+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:43.731796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"61'2","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.027623+0000","last_change":"2024-03-30T12:19:00.468017+0000","last_active":"2024-03-30T12:19:36.027623+0000","last_peered":"2024-03-30T12:19:36.027623+0000","last_clean":"2024-03-30T12:19:36.027623+0000","last_became_active":"2024-03-30T12:19:00.466979+0000","last_became_peered":"2024-03-30T12:19:00.466979+0000","last_unstale":"2024-03-30T12:19:36.027623+0000","last_undegraded":"2024-03-30T12:19:36.027623+0000","last_fullsized":"2024-03-30T12:19:36.027623+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:41:36.480109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.927897+0000","last_change":"2024-03-30T12:19:00.869001+0000","last_active":"2024-03-30T12:19:35.927897+0000","last_peered":"2024-03-30T12:19:35.927897+0000","last_clean":"2024-03-30T12:19:35.927897+0000","last_became_active":"2024-03-30T12:19:00.868645+0000","last_became_peered":"2024-03-30T12:19:00.868645+0000","last_unstale":"2024-03-30T12:19:35.927897+0000","last_undegraded":"2024-03-30T12:19:35.927897+0000","last_fullsized":"2024-03-30T12:19:35.927897+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:54:10.778279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.028468+0000","last_change":"2024-03-30T12:19:00.459171+0000","last_active":"2024-03-30T12:19:36.028468+0000","last_peered":"2024-03-30T12:19:36.028468+0000","last_clean":"2024-03-30T12:19:36.028468+0000","last_became_active":"2024-03-30T12:19:00.458925+0000","last_became_peered":"2024-03-30T12:19:00.458925+0000","last_unstale":"2024-03-30T12:19:36.028468+0000","last_undegraded":"2024-03-30T12:19:36.028468+0000","last_fullsized":"2024-03-30T12:19:36.028468+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:26:20.974369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.027805+0000","last_change":"2024-03-30T12:19:00.875558+0000","last_active":"2024-03-30T12:19:36.027805+0000","last_peered":"2024-03-30T12:19:36.027805+0000","last_clean":"2024-03-30T12:19:36.027805+0000","last_became_active":"2024-03-30T12:19:00.875216+0000","last_became_peered":"2024-03-30T12:19:00.875216+0000","last_unstale":"2024-03-30T12:19:36.027805+0000","last_undegraded":"2024-03-30T12:19:36.027805+0000","last_fullsized":"2024-03-30T12:19:36.027805+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:27:04.763910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"61'1","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.818030+0000","last_change":"2024-03-30T12:19:00.459545+0000","last_active":"2024-03-30T12:19:35.818030+0000","last_peered":"2024-03-30T12:19:35.818030+0000","last_clean":"2024-03-30T12:19:35.818030+0000","last_became_active":"2024-03-30T12:19:00.459250+0000","last_became_peered":"2024-03-30T12:19:00.459250+0000","last_unstale":"2024-03-30T12:19:35.818030+0000","last_undegraded":"2024-03-30T12:19:35.818030+0000","last_fullsized":"2024-03-30T12:19:35.818030+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:38.112815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.930403+0000","last_change":"2024-03-30T12:19:00.852558+0000","last_active":"2024-03-30T12:19:35.930403+0000","last_peered":"2024-03-30T12:19:35.930403+0000","last_clean":"2024-03-30T12:19:35.930403+0000","last_became_active":"2024-03-30T12:19:00.852250+0000","last_became_peered":"2024-03-30T12:19:00.852250+0000","last_unstale":"2024-03-30T12:19:35.930403+0000","last_undegraded":"2024-03-30T12:19:35.930403+0000","last_fullsized":"2024-03-30T12:19:35.930403+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:57:15.989801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"61'2","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.028810+0000","last_change":"2024-03-30T12:19:00.464968+0000","last_active":"2024-03-30T12:19:36.028810+0000","last_peered":"2024-03-30T12:19:36.028810+0000","last_clean":"2024-03-30T12:19:36.028810+0000","last_became_active":"2024-03-30T12:19:00.464021+0000","last_became_peered":"2024-03-30T12:19:00.464021+0000","last_unstale":"2024-03-30T12:19:36.028810+0000","last_undegraded":"2024-03-30T12:19:36.028810+0000","last_fullsized":"2024-03-30T12:19:36.028810+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:20.224884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.028023+0000","last_change":"2024-03-30T12:19:00.871645+0000","last_active":"2024-03-30T12:19:36.028023+0000","last_peered":"2024-03-30T12:19:36.028023+0000","last_clean":"2024-03-30T12:19:36.028023+0000","last_became_active":"2024-03-30T12:19:00.871376+0000","last_became_peered":"2024-03-30T12:19:00.871376+0000","last_unstale":"2024-03-30T12:19:36.028023+0000","last_undegraded":"2024-03-30T12:19:36.028023+0000","last_fullsized":"2024-03-30T12:19:36.028023+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:54:57.281972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.927608+0000","last_change":"2024-03-30T12:19:00.862859+0000","last_active":"2024-03-30T12:19:35.927608+0000","last_peered":"2024-03-30T12:19:35.927608+0000","last_clean":"2024-03-30T12:19:35.927608+0000","last_became_active":"2024-03-30T12:19:00.862535+0000","last_became_peered":"2024-03-30T12:19:00.862535+0000","last_unstale":"2024-03-30T12:19:35.927608+0000","last_undegraded":"2024-03-30T12:19:35.927608+0000","last_fullsized":"2024-03-30T12:19:35.927608+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:17:31.462763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.027465+0000","last_change":"2024-03-30T12:19:00.862947+0000","last_active":"2024-03-30T12:19:36.027465+0000","last_peered":"2024-03-30T12:19:36.027465+0000","last_clean":"2024-03-30T12:19:36.027465+0000","last_became_active":"2024-03-30T12:19:00.862567+0000","last_became_peered":"2024-03-30T12:19:00.862567+0000","last_unstale":"2024-03-30T12:19:36.027465+0000","last_undegraded":"2024-03-30T12:19:36.027465+0000","last_fullsized":"2024-03-30T12:19:36.027465+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:55:05.422370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.930366+0000","last_change":"2024-03-30T12:19:00.856869+0000","last_active":"2024-03-30T12:19:35.930366+0000","last_peered":"2024-03-30T12:19:35.930366+0000","last_clean":"2024-03-30T12:19:35.930366+0000","last_became_active":"2024-03-30T12:19:00.856525+0000","last_became_peered":"2024-03-30T12:19:00.856525+0000","last_unstale":"2024-03-30T12:19:35.930366+0000","last_undegraded":"2024-03-30T12:19:35.930366+0000","last_fullsized":"2024-03-30T12:19:35.930366+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:01:47.443294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.028331+0000","last_change":"2024-03-30T12:19:00.859724+0000","last_active":"2024-03-30T12:19:36.028331+0000","last_peered":"2024-03-30T12:19:36.028331+0000","last_clean":"2024-03-30T12:19:36.028331+0000","last_became_active":"2024-03-30T12:19:00.859327+0000","last_became_peered":"2024-03-30T12:19:00.859327+0000","last_unstale":"2024-03-30T12:19:36.028331+0000","last_undegraded":"2024-03-30T12:19:36.028331+0000","last_fullsized":"2024-03-30T12:19:36.028331+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:53:15.692683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.814833+0000","last_change":"2024-03-30T12:19:00.857483+0000","last_active":"2024-03-30T12:19:35.814833+0000","last_peered":"2024-03-30T12:19:35.814833+0000","last_clean":"2024-03-30T12:19:35.814833+0000","last_became_active":"2024-03-30T12:19:00.857117+0000","last_became_peered":"2024-03-30T12:19:00.857117+0000","last_unstale":"2024-03-30T12:19:35.814833+0000","last_undegraded":"2024-03-30T12:19:35.814833+0000","last_fullsized":"2024-03-30T12:19:35.814833+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:42.644771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.817930+0000","last_change":"2024-03-30T12:19:00.848297+0000","last_active":"2024-03-30T12:19:35.817930+0000","last_peered":"2024-03-30T12:19:35.817930+0000","last_clean":"2024-03-30T12:19:35.817930+0000","last_became_active":"2024-03-30T12:19:00.848029+0000","last_became_peered":"2024-03-30T12:19:00.848029+0000","last_unstale":"2024-03-30T12:19:35.817930+0000","last_undegraded":"2024-03-30T12:19:35.817930+0000","last_fullsized":"2024-03-30T12:19:35.817930+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:38.617413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.928255+0000","last_change":"2024-03-30T12:19:00.869414+0000","last_active":"2024-03-30T12:19:35.928255+0000","last_peered":"2024-03-30T12:19:35.928255+0000","last_clean":"2024-03-30T12:19:35.928255+0000","last_became_active":"2024-03-30T12:19:00.869115+0000","last_became_peered":"2024-03-30T12:19:00.869115+0000","last_unstale":"2024-03-30T12:19:35.928255+0000","last_undegraded":"2024-03-30T12:19:35.928255+0000","last_fullsized":"2024-03-30T12:19:35.928255+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:01:12.173692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.815046+0000","last_change":"2024-03-30T12:19:00.856088+0000","last_active":"2024-03-30T12:19:35.815046+0000","last_peered":"2024-03-30T12:19:35.815046+0000","last_clean":"2024-03-30T12:19:35.815046+0000","last_became_active":"2024-03-30T12:19:00.855480+0000","last_became_peered":"2024-03-30T12:19:00.855480+0000","last_unstale":"2024-03-30T12:19:35.815046+0000","last_undegraded":"2024-03-30T12:19:35.815046+0000","last_fullsized":"2024-03-30T12:19:35.815046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:21:16.961559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.929754+0000","last_change":"2024-03-30T12:19:00.854668+0000","last_active":"2024-03-30T12:19:35.929754+0000","last_peered":"2024-03-30T12:19:35.929754+0000","last_clean":"2024-03-30T12:19:35.929754+0000","last_became_active":"2024-03-30T12:19:00.854390+0000","last_became_peered":"2024-03-30T12:19:00.854390+0000","last_unstale":"2024-03-30T12:19:35.929754+0000","last_undegraded":"2024-03-30T12:19:35.929754+0000","last_fullsized":"2024-03-30T12:19:35.929754+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:39:22.128098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.814459+0000","last_change":"2024-03-30T12:19:00.851282+0000","last_active":"2024-03-30T12:19:35.814459+0000","last_peered":"2024-03-30T12:19:35.814459+0000","last_clean":"2024-03-30T12:19:35.814459+0000","last_became_active":"2024-03-30T12:19:00.850915+0000","last_became_peered":"2024-03-30T12:19:00.850915+0000","last_unstale":"2024-03-30T12:19:35.814459+0000","last_undegraded":"2024-03-30T12:19:35.814459+0000","last_fullsized":"2024-03-30T12:19:35.814459+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:46:50.526568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.930137+0000","last_change":"2024-03-30T12:19:00.860406+0000","last_active":"2024-03-30T12:19:35.930137+0000","last_peered":"2024-03-30T12:19:35.930137+0000","last_clean":"2024-03-30T12:19:35.930137+0000","last_became_active":"2024-03-30T12:19:00.860085+0000","last_became_peered":"2024-03-30T12:19:00.860085+0000","last_unstale":"2024-03-30T12:19:35.930137+0000","last_undegraded":"2024-03-30T12:19:35.930137+0000","last_fullsized":"2024-03-30T12:19:35.930137+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:32.201939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:36.028413+0000","last_change":"2024-03-30T12:19:00.856917+0000","last_active":"2024-03-30T12:19:36.028413+0000","last_peered":"2024-03-30T12:19:36.028413+0000","last_clean":"2024-03-30T12:19:36.028413+0000","last_became_active":"2024-03-30T12:19:00.856643+0000","last_became_peered":"2024-03-30T12:19:00.856643+0000","last_unstale":"2024-03-30T12:19:36.028413+0000","last_undegraded":"2024-03-30T12:19:36.028413+0000","last_fullsized":"2024-03-30T12:19:36.028413+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:51:53.996045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-03-30T12:19:35.928113+0000","last_change":"2024-03-30T12:19:00.867176+0000","last_active":"2024-03-30T12:19:35.928113+0000","last_peered":"2024-03-30T12:19:35.928113+0000","last_clean":"2024-03-30T12:19:35.928113+0000","last_became_active":"2024-03-30T12:19:00.866801+0000","last_became_peered":"2024-03-30T12:19:00.866801+0000","last_unstale":"2024-03-30T12:19:35.928113+0000","last_undegraded":"2024-03-30T12:19:35.928113+0000","last_fullsized":"2024-03-30T12:19:35.928113+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:31:22.909206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3148,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":9444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234009,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32360,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712792,"statfs":{"total":95995035648,"available":95961899008,"internally_reserved":0,"allocated":1269760,"data_stored":878658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.52600000000000002}]},{"osd":1,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.505},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.497}]},{"osd":2,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.47899999999999998}]},{"osd":3,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.53600000000000003}]},{"osd":4,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.45400000000000001}]},{"osd":5,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.40899999999999997}]},{"osd":6,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.39800000000000002}]}]},{"osd":6,"up_from":46,"seq":197568495645,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28268,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716884,"statfs":{"total":95995035648,"available":95966089216,"internally_reserved":0,"allocated":1273856,"data_stored":880462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.52500000000000002,"15min":0.53200000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.73599999999999999,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.50800000000000001}]},{"osd":1,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77900000000000003,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.35499999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.67900000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.52500000000000002}]},{"osd":2,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53800000000000003,"15min":0.54300000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.67100000000000004,"5min":1.044,"15min":1.044},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70399999999999996,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.48099999999999998}]},{"osd":3,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73399999999999999,"5min":0.754,"15min":0.754},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.38900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.72199999999999998,"5min":1.006,"15min":1.006},"last":0.40300000000000002}]},{"osd":4,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.41999999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.49399999999999999}]},{"osd":5,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.42799999999999999,"15min":0.42199999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.498,"5min":0.45800000000000002,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.378}]},{"osd":7,"last update":"Sat Mar 30 12:19:44 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.57999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31772,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713380,"statfs":{"total":95995035648,"available":95962501120,"internally_reserved":0,"allocated":671744,"data_stored":287631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:20:24 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34200000000000003,"15min":0.313},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.44700000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.316},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.37,"15min":0.33000000000000002},"min":{"1min":0.23100000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.46100000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.255}]},{"osd":2,"last update":"Sat Mar 30 12:19:46 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38,"15min":0.374},"min":{"1min":0.247,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.54300000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39600000000000002,"15min":0.38900000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56399999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.27300000000000002}]},{"osd":3,"last update":"Sat Mar 30 12:20:13 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.27400000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55300000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.46500000000000002,"15min":0.47699999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58499999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.36399999999999999}]},{"osd":4,"last update":"Sat Mar 30 12:20:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.68300000000000005}]},{"osd":5,"last update":"Sat Mar 30 12:19:54 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59199999999999997,"15min":0.58899999999999997},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.65200000000000002}]},{"osd":6,"last update":"Sat Mar 30 12:20:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.59399999999999997,"15min":0.59999999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60299999999999998,"15min":0.60599999999999998},"min":{"1min":0.46100000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.66600000000000004}]},{"osd":7,"last update":"Sat Mar 30 12:19:45 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.52700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738426,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32368,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712784,"statfs":{"total":95995035648,"available":95961890816,"internally_reserved":0,"allocated":1282048,"data_stored":879113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 30 12:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.32800000000000001,"15min":0.30199999999999999},"min":{"1min":0.191,"5min":0.183,"15min":0.183},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.36199999999999999,"15min":0.318},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.58199999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.26800000000000002}]},{"osd":2,"last update":"Sat Mar 30 12:19:48 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.41999999999999998,"15min":0.41799999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.57199999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.40799999999999997,"15min":0.40400000000000003},"min":{"1min":0.23699999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56299999999999994,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.28799999999999998}]},{"osd":3,"last update":"Sat Mar 30 12:20:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.27500000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.45400000000000001,"15min":0.45800000000000002},"min":{"1min":0.314,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68600000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.39100000000000001}]},{"osd":4,"last update":"Sat Mar 30 12:19:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57499999999999996,"15min":0.56999999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.432}]},{"osd":5,"last update":"Sat Mar 30 12:19:59 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.41099999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.76400000000000001,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.48099999999999998}]},{"osd":6,"last update":"Sat Mar 30 12:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76000000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.44600000000000001}]},{"osd":7,"last update":"Sat Mar 30 12:19:45 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.502},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.55600000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411376,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31768,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713384,"statfs":{"total":95995035648,"available":95962505216,"internally_reserved":0,"allocated":667648,"data_stored":287744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:19:50 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.34999999999999998,"15min":0.34300000000000003},"min":{"1min":0.254,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.377,"15min":0.379},"min":{"1min":0.27500000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.46899999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.36199999999999999}]},{"osd":1,"last update":"Sat Mar 30 12:19:50 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26100000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.47799999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.38900000000000001,"15min":0.38300000000000001},"min":{"1min":0.246,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59799999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.498}]},{"osd":3,"last update":"Sat Mar 30 12:20:13 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45200000000000001,"15min":0.44800000000000001},"min":{"1min":0.32300000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.44500000000000001,"15min":0.45300000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.57999999999999996}]},{"osd":4,"last update":"Sat Mar 30 12:19:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56100000000000005,"15min":0.55600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.52400000000000002}]},{"osd":5,"last update":"Sat Mar 30 12:20:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":1.3400000000000001,"15min":1.474},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86799999999999999,"5min":19.606999999999999,"15min":19.606999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.42299999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.746,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.56599999999999995}]},{"osd":6,"last update":"Sat Mar 30 12:20:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.40799999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.87,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.60999999999999999}]},{"osd":7,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.621}]}]},{"osd":3,"up_from":25,"seq":107374182443,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717456,"statfs":{"total":95995035648,"available":95966674944,"internally_reserved":0,"allocated":692224,"data_stored":290471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:20:13 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39500000000000002,"15min":0.40300000000000002},"min":{"1min":0.25700000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.41299999999999998,"15min":0.41999999999999998},"min":{"1min":0.26200000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.50600000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.30399999999999999}]},{"osd":1,"last update":"Sat Mar 30 12:20:13 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.61799999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.438,"15min":0.443},"min":{"1min":0.33100000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57199999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.34899999999999998}]},{"osd":2,"last update":"Sat Mar 30 12:20:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.45500000000000002,"15min":0.46200000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.379},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.42799999999999999,"15min":0.434},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.629,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.33800000000000002}]},{"osd":4,"last update":"Sat Mar 30 12:19:33 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67800000000000005,"15min":0.69499999999999995},"min":{"1min":0.40200000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80200000000000005,"5min":4.8639999999999999,"15min":4.8639999999999999},"last":0.496},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.48299999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.42799999999999999}]},{"osd":5,"last update":"Sat Mar 30 12:19:56 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.622,"15min":0.628},"min":{"1min":0.41299999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.39600000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.48499999999999999}]},{"osd":6,"last update":"Sat Mar 30 12:20:20 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.435,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82599999999999996,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.74399999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.52000000000000002}]},{"osd":7,"last update":"Sat Mar 30 12:19:44 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.434},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.54300000000000004}]}]},{"osd":4,"up_from":30,"seq":128849018918,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27684,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717468,"statfs":{"total":95995035648,"available":95966687232,"internally_reserved":0,"allocated":679936,"data_stored":288179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:19:33 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.64400000000000002,"15min":0.58199999999999996},"min":{"1min":0.40300000000000002,"5min":0.377,"15min":0.377},"max":{"1min":9.5069999999999997,"5min":9.5069999999999997,"15min":9.5069999999999997},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51100000000000001,"15min":0.50700000000000001},"min":{"1min":0.39100000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.68100000000000005,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.54800000000000004}]},{"osd":1,"last update":"Sat Mar 30 12:19:33 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.51700000000000002,"15min":0.51400000000000001},"min":{"1min":0.41599999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.121,"5min":0.61499999999999999,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":11.534000000000001,"5min":11.534000000000001,"15min":11.534000000000001},"last":0.56100000000000005}]},{"osd":2,"last update":"Sat Mar 30 12:19:33 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.371,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72899999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.45500000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.751}]},{"osd":3,"last update":"Sat Mar 30 12:19:33 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.52900000000000003,"15min":0.52200000000000002},"min":{"1min":0.45700000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.40200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.66600000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.58799999999999997}]},{"osd":5,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.434,"15min":0.436},"min":{"1min":0.311,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.64900000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.498},{"interface":"front","average":{"1min":0.437,"5min":0.42999999999999999,"15min":0.42899999999999999},"min":{"1min":0.32700000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70999999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.46500000000000002}]},{"osd":6,"last update":"Sat Mar 30 12:20:23 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.45300000000000001,"15min":0.45100000000000001},"min":{"1min":0.316,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69799999999999995,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68700000000000006,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.436}]},{"osd":7,"last update":"Sat Mar 30 12:19:42 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.47999999999999998}]}]},{"osd":5,"up_from":38,"seq":163208757282,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27692,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717460,"statfs":{"total":95995035648,"available":95966679040,"internally_reserved":0,"allocated":688128,"data_stored":290457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.36699999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51900000000000002,"15min":0.52100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70799999999999996,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.54400000000000004}]},{"osd":1,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72599999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.40200000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63800000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.59299999999999997}]},{"osd":2,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51500000000000001,"15min":0.51600000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70899999999999996,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.502},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52500000000000002,"15min":0.52800000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.64200000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.623}]},{"osd":3,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.73599999999999999,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53600000000000003,"15min":0.54000000000000004},"min":{"1min":0.41599999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.59399999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.48699999999999999}]},{"osd":4,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39400000000000002,"15min":0.39000000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.40200000000000002,"15min":0.39300000000000002},"min":{"1min":0.28399999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.34200000000000003}]},{"osd":6,"last update":"Sat Mar 30 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.434,"15min":0.42999999999999999},"min":{"1min":0.32200000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.443,"15min":0.438},"min":{"1min":0.36299999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.38300000000000001}]},{"osd":7,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.373}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:20:33.785 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:20:34.089 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:33 smithi084 ceph-mon[37565]: from='client.24671 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:20:34.089 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:33 smithi084 ceph-mon[27000]: from='client.24671 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:20:34.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:33 smithi162 ceph-mon[30421]: from='client.24671 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:20:34.426 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:20:35.207 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:34 smithi084 ceph-mon[27000]: pgmap v33: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:35.207 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:34 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:35.207 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:34 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:35.207 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:34 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:20:35.207 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:34 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:20:35.207 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:34 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:35.208 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:34 smithi084 ceph-mon[37565]: pgmap v33: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:35.208 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:34 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:35.208 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:34 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:35.208 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:34 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:20:35.208 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:34 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:20:35.208 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:34 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:35.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:34 smithi162 ceph-mon[30421]: pgmap v33: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:35.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:34 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:35.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:34 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:35.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:34 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:20:35.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:34 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:20:35.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:34 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:36.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[27000]: Reconfiguring alertmanager.a (dependencies changed)... 2024-03-30T12:20:36.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[27000]: Reconfiguring daemon alertmanager.a on smithi084 2024-03-30T12:20:36.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-03-30T12:20:36.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [0, 2]}]: dispatch 2024-03-30T12:20:36.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-03-30T12:20:36.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 1]}]: dispatch 2024-03-30T12:20:36.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 2]}]: dispatch 2024-03-30T12:20:36.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3e", "id": [0, 2]}]: dispatch 2024-03-30T12:20:36.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [0, 2]}]: dispatch 2024-03-30T12:20:36.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 1]}]: dispatch 2024-03-30T12:20:36.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 2]}]: dispatch 2024-03-30T12:20:36.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3e", "id": [0, 2]}]: dispatch 2024-03-30T12:20:36.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:20:36.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[37565]: Reconfiguring alertmanager.a (dependencies changed)... 2024-03-30T12:20:36.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[37565]: Reconfiguring daemon alertmanager.a on smithi084 2024-03-30T12:20:36.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-03-30T12:20:36.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [0, 2]}]: dispatch 2024-03-30T12:20:36.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-03-30T12:20:36.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 1]}]: dispatch 2024-03-30T12:20:36.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 2]}]: dispatch 2024-03-30T12:20:36.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3e", "id": [0, 2]}]: dispatch 2024-03-30T12:20:36.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [0, 2]}]: dispatch 2024-03-30T12:20:36.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 1]}]: dispatch 2024-03-30T12:20:36.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 2]}]: dispatch 2024-03-30T12:20:36.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3e", "id": [0, 2]}]: dispatch 2024-03-30T12:20:36.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:35 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:20:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:35 smithi162 ceph-mon[30421]: Reconfiguring alertmanager.a (dependencies changed)... 2024-03-30T12:20:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:35 smithi162 ceph-mon[30421]: Reconfiguring daemon alertmanager.a on smithi084 2024-03-30T12:20:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:35 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-03-30T12:20:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:35 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [0, 2]}]: dispatch 2024-03-30T12:20:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:35 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-03-30T12:20:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:35 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 1]}]: dispatch 2024-03-30T12:20:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:35 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 2]}]: dispatch 2024-03-30T12:20:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:35 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3e", "id": [0, 2]}]: dispatch 2024-03-30T12:20:36.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:35 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [0, 2]}]: dispatch 2024-03-30T12:20:36.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:35 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 1]}]: dispatch 2024-03-30T12:20:36.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:35 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 2]}]: dispatch 2024-03-30T12:20:36.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:35 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3e", "id": [0, 2]}]: dispatch 2024-03-30T12:20:36.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:35 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:20:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:36 smithi084 ceph-mon[27000]: pgmap v34: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:36 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]': finished 2024-03-30T12:20:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:36 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [0, 2]}]': finished 2024-03-30T12:20:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:36 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 1]}]': finished 2024-03-30T12:20:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:36 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 2]}]': finished 2024-03-30T12:20:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:36 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3e", "id": [0, 2]}]': finished 2024-03-30T12:20:37.176 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:36 smithi084 ceph-mon[27000]: osdmap e67: 8 total, 8 up, 8 in 2024-03-30T12:20:37.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:36 smithi084 ceph-mon[37565]: pgmap v34: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:37.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:36 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]': finished 2024-03-30T12:20:37.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:36 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [0, 2]}]': finished 2024-03-30T12:20:37.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:36 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 1]}]': finished 2024-03-30T12:20:37.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:36 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 2]}]': finished 2024-03-30T12:20:37.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:36 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3e", "id": [0, 2]}]': finished 2024-03-30T12:20:37.177 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:36 smithi084 ceph-mon[37565]: osdmap e67: 8 total, 8 up, 8 in 2024-03-30T12:20:37.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:36 smithi162 ceph-mon[30421]: pgmap v34: 105 pgs: 105 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:37.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:36 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]': finished 2024-03-30T12:20:37.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:36 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [0, 2]}]': finished 2024-03-30T12:20:37.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:36 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 1]}]': finished 2024-03-30T12:20:37.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:36 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 2]}]': finished 2024-03-30T12:20:37.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:36 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3e", "id": [0, 2]}]': finished 2024-03-30T12:20:37.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:36 smithi162 ceph-mon[30421]: osdmap e67: 8 total, 8 up, 8 in 2024-03-30T12:20:38.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:38 smithi084 ceph-mon[27000]: osdmap e68: 8 total, 8 up, 8 in 2024-03-30T12:20:38.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:38 smithi084 ceph-mon[27000]: pgmap v37: 105 pgs: 5 peering, 100 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:38.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:38 smithi084 ceph-mon[37565]: osdmap e68: 8 total, 8 up, 8 in 2024-03-30T12:20:38.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:38 smithi084 ceph-mon[37565]: pgmap v37: 105 pgs: 5 peering, 100 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:38.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:38 smithi162 ceph-mon[30421]: osdmap e68: 8 total, 8 up, 8 in 2024-03-30T12:20:38.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:38 smithi162 ceph-mon[30421]: pgmap v37: 105 pgs: 5 peering, 100 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:38.636 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:38 smithi084 systemd[1]: Stopping Ceph alertmanager.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:20:39.109 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:20:39.111 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:20:39.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:39 smithi084 ceph-mon[27000]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-03-30T12:20:39.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:39 smithi084 ceph-mon[37565]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-03-30T12:20:39.254 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[69081]: ts=2024-03-30T12:20:39.066Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-03-30T12:20:39.254 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:39 smithi084 podman[72956]: 2024-03-30 12:20:39.087186051 +0000 UTC m=+0.136841511 container died afc02392307017e6996d665e9355a9f0ffebaa52bd873f800446c886cd93d035 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T12:20:39.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:39 smithi162 ceph-mon[30421]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-03-30T12:20:39.532 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:20:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:20:39] "GET /metrics HTTP/1.1" 200 33652 "" "Prometheus/2.43.0" 2024-03-30T12:20:39.848 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:39 smithi084 podman[72956]: 2024-03-30 12:20:39.541783565 +0000 UTC m=+0.591439025 container cleanup afc02392307017e6996d665e9355a9f0ffebaa52bd873f800446c886cd93d035 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T12:20:39.848 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:39 smithi084 bash[72956]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a 2024-03-30T12:20:40.214 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:40 smithi084 ceph-mon[27000]: from='client.24677 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:20:40.214 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:40 smithi084 ceph-mon[27000]: pgmap v38: 105 pgs: 5 peering, 100 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:40.215 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:40 smithi084 ceph-mon[37565]: from='client.24677 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:20:40.215 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:40 smithi084 ceph-mon[37565]: pgmap v38: 105 pgs: 5 peering, 100 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:40.237 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-03-30T12:20:37.837260+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593516,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":227,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":315,"acting":315,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":316,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":239672,"kb_used_data":7128,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":749721544,"statfs":{"total":767960285184,"available":767714861056,"internally_reserved":0,"allocated":7299072,"data_stored":4126155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001547"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.885644+0000","last_change":"2024-03-30T12:19:00.863340+0000","last_active":"2024-03-30T12:19:37.885644+0000","last_peered":"2024-03-30T12:19:37.885644+0000","last_clean":"2024-03-30T12:19:37.885644+0000","last_became_active":"2024-03-30T12:19:00.863041+0000","last_became_peered":"2024-03-30T12:19:00.863041+0000","last_unstale":"2024-03-30T12:19:37.885644+0000","last_undegraded":"2024-03-30T12:19:37.885644+0000","last_fullsized":"2024-03-30T12:19:37.885644+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:21.728523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"peering","last_fresh":"2024-03-30T12:20:36.005770+0000","last_change":"2024-03-30T12:20:36.006111+0000","last_active":"2024-03-30T12:20:36.005770+0000","last_peered":"2024-03-30T12:19:37.833933+0000","last_clean":"2024-03-30T12:19:37.833933+0000","last_became_active":"2024-03-30T12:19:00.867457+0000","last_became_peered":"2024-03-30T12:19:00.867457+0000","last_unstale":"2024-03-30T12:20:36.005770+0000","last_undegraded":"2024-03-30T12:20:36.005770+0000","last_fullsized":"2024-03-30T12:20:36.005770+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:15:38.958066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2,6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.887554+0000","last_change":"2024-03-30T12:19:00.853843+0000","last_active":"2024-03-30T12:19:37.887554+0000","last_peered":"2024-03-30T12:19:37.887554+0000","last_clean":"2024-03-30T12:19:37.887554+0000","last_became_active":"2024-03-30T12:19:00.853543+0000","last_became_peered":"2024-03-30T12:19:00.853543+0000","last_unstale":"2024-03-30T12:19:37.887554+0000","last_undegraded":"2024-03-30T12:19:37.887554+0000","last_fullsized":"2024-03-30T12:19:37.887554+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:52.339142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:38.263461+0000","last_change":"2024-03-30T12:19:00.859974+0000","last_active":"2024-03-30T12:19:38.263461+0000","last_peered":"2024-03-30T12:19:38.263461+0000","last_clean":"2024-03-30T12:19:38.263461+0000","last_became_active":"2024-03-30T12:19:00.859615+0000","last_became_peered":"2024-03-30T12:19:00.859615+0000","last_unstale":"2024-03-30T12:19:38.263461+0000","last_undegraded":"2024-03-30T12:19:38.263461+0000","last_fullsized":"2024-03-30T12:19:38.263461+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:26.933772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.885306+0000","last_change":"2024-03-30T12:19:00.872400+0000","last_active":"2024-03-30T12:19:37.885306+0000","last_peered":"2024-03-30T12:19:37.885306+0000","last_clean":"2024-03-30T12:19:37.885306+0000","last_became_active":"2024-03-30T12:19:00.872098+0000","last_became_peered":"2024-03-30T12:19:00.872098+0000","last_unstale":"2024-03-30T12:19:37.885306+0000","last_undegraded":"2024-03-30T12:19:37.885306+0000","last_fullsized":"2024-03-30T12:19:37.885306+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:21.152462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:38.263551+0000","last_change":"2024-03-30T12:19:00.858029+0000","last_active":"2024-03-30T12:19:38.263551+0000","last_peered":"2024-03-30T12:19:38.263551+0000","last_clean":"2024-03-30T12:19:38.263551+0000","last_became_active":"2024-03-30T12:19:00.857668+0000","last_became_peered":"2024-03-30T12:19:00.857668+0000","last_unstale":"2024-03-30T12:19:38.263551+0000","last_undegraded":"2024-03-30T12:19:38.263551+0000","last_fullsized":"2024-03-30T12:19:38.263551+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:17:33.313541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.884951+0000","last_change":"2024-03-30T12:19:00.869258+0000","last_active":"2024-03-30T12:19:37.884951+0000","last_peered":"2024-03-30T12:19:37.884951+0000","last_clean":"2024-03-30T12:19:37.884951+0000","last_became_active":"2024-03-30T12:19:00.868799+0000","last_became_peered":"2024-03-30T12:19:00.868799+0000","last_unstale":"2024-03-30T12:19:37.884951+0000","last_undegraded":"2024-03-30T12:19:37.884951+0000","last_fullsized":"2024-03-30T12:19:37.884951+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:00:11.265094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.831736+0000","last_change":"2024-03-30T12:19:00.864240+0000","last_active":"2024-03-30T12:19:37.831736+0000","last_peered":"2024-03-30T12:19:37.831736+0000","last_clean":"2024-03-30T12:19:37.831736+0000","last_became_active":"2024-03-30T12:19:00.863991+0000","last_became_peered":"2024-03-30T12:19:00.863991+0000","last_unstale":"2024-03-30T12:19:37.831736+0000","last_undegraded":"2024-03-30T12:19:37.831736+0000","last_fullsized":"2024-03-30T12:19:37.831736+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:59:30.409530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.885589+0000","last_change":"2024-03-30T12:19:00.875226+0000","last_active":"2024-03-30T12:19:37.885589+0000","last_peered":"2024-03-30T12:19:37.885589+0000","last_clean":"2024-03-30T12:19:37.885589+0000","last_became_active":"2024-03-30T12:19:00.874620+0000","last_became_peered":"2024-03-30T12:19:00.874620+0000","last_unstale":"2024-03-30T12:19:37.885589+0000","last_undegraded":"2024-03-30T12:19:37.885589+0000","last_fullsized":"2024-03-30T12:19:37.885589+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:58:40.881840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.887495+0000","last_change":"2024-03-30T12:19:00.869363+0000","last_active":"2024-03-30T12:19:37.887495+0000","last_peered":"2024-03-30T12:19:37.887495+0000","last_clean":"2024-03-30T12:19:37.887495+0000","last_became_active":"2024-03-30T12:19:00.868887+0000","last_became_peered":"2024-03-30T12:19:00.868887+0000","last_unstale":"2024-03-30T12:19:37.887495+0000","last_undegraded":"2024-03-30T12:19:37.887495+0000","last_fullsized":"2024-03-30T12:19:37.887495+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:40:49.543161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.887384+0000","last_change":"2024-03-30T12:19:00.863992+0000","last_active":"2024-03-30T12:19:37.887384+0000","last_peered":"2024-03-30T12:19:37.887384+0000","last_clean":"2024-03-30T12:19:37.887384+0000","last_became_active":"2024-03-30T12:19:00.863683+0000","last_became_peered":"2024-03-30T12:19:00.863683+0000","last_unstale":"2024-03-30T12:19:37.887384+0000","last_undegraded":"2024-03-30T12:19:37.887384+0000","last_fullsized":"2024-03-30T12:19:37.887384+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:40:36.734391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.828360+0000","last_change":"2024-03-30T12:19:00.862541+0000","last_active":"2024-03-30T12:19:37.828360+0000","last_peered":"2024-03-30T12:19:37.828360+0000","last_clean":"2024-03-30T12:19:37.828360+0000","last_became_active":"2024-03-30T12:19:00.862084+0000","last_became_peered":"2024-03-30T12:19:00.862084+0000","last_unstale":"2024-03-30T12:19:37.828360+0000","last_undegraded":"2024-03-30T12:19:37.828360+0000","last_fullsized":"2024-03-30T12:19:37.828360+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:36.445232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.832489+0000","last_change":"2024-03-30T12:19:00.850148+0000","last_active":"2024-03-30T12:19:37.832489+0000","last_peered":"2024-03-30T12:19:37.832489+0000","last_clean":"2024-03-30T12:19:37.832489+0000","last_became_active":"2024-03-30T12:19:00.849849+0000","last_became_peered":"2024-03-30T12:19:00.849849+0000","last_unstale":"2024-03-30T12:19:37.832489+0000","last_undegraded":"2024-03-30T12:19:37.832489+0000","last_fullsized":"2024-03-30T12:19:37.832489+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:55:56.657057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.887305+0000","last_change":"2024-03-30T12:19:00.865479+0000","last_active":"2024-03-30T12:19:37.887305+0000","last_peered":"2024-03-30T12:19:37.887305+0000","last_clean":"2024-03-30T12:19:37.887305+0000","last_became_active":"2024-03-30T12:19:00.864441+0000","last_became_peered":"2024-03-30T12:19:00.864441+0000","last_unstale":"2024-03-30T12:19:37.887305+0000","last_undegraded":"2024-03-30T12:19:37.887305+0000","last_fullsized":"2024-03-30T12:19:37.887305+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:45:55.344815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.832935+0000","last_change":"2024-03-30T12:19:00.866672+0000","last_active":"2024-03-30T12:19:37.832935+0000","last_peered":"2024-03-30T12:19:37.832935+0000","last_clean":"2024-03-30T12:19:37.832935+0000","last_became_active":"2024-03-30T12:19:00.866276+0000","last_became_peered":"2024-03-30T12:19:00.866276+0000","last_unstale":"2024-03-30T12:19:37.832935+0000","last_undegraded":"2024-03-30T12:19:37.832935+0000","last_fullsized":"2024-03-30T12:19:37.832935+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:23:49.856597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:38.263135+0000","last_change":"2024-03-30T12:19:00.864760+0000","last_active":"2024-03-30T12:19:38.263135+0000","last_peered":"2024-03-30T12:19:38.263135+0000","last_clean":"2024-03-30T12:19:38.263135+0000","last_became_active":"2024-03-30T12:19:00.864447+0000","last_became_peered":"2024-03-30T12:19:00.864447+0000","last_unstale":"2024-03-30T12:19:38.263135+0000","last_undegraded":"2024-03-30T12:19:38.263135+0000","last_fullsized":"2024-03-30T12:19:38.263135+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:26:47.024806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:38.263768+0000","last_change":"2024-03-30T12:19:00.863453+0000","last_active":"2024-03-30T12:19:38.263768+0000","last_peered":"2024-03-30T12:19:38.263768+0000","last_clean":"2024-03-30T12:19:38.263768+0000","last_became_active":"2024-03-30T12:19:00.863129+0000","last_became_peered":"2024-03-30T12:19:00.863129+0000","last_unstale":"2024-03-30T12:19:38.263768+0000","last_undegraded":"2024-03-30T12:19:38.263768+0000","last_fullsized":"2024-03-30T12:19:38.263768+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:19:33.658159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:38.263320+0000","last_change":"2024-03-30T12:19:00.854527+0000","last_active":"2024-03-30T12:19:38.263320+0000","last_peered":"2024-03-30T12:19:38.263320+0000","last_clean":"2024-03-30T12:19:38.263320+0000","last_became_active":"2024-03-30T12:19:00.854238+0000","last_became_peered":"2024-03-30T12:19:00.854238+0000","last_unstale":"2024-03-30T12:19:38.263320+0000","last_undegraded":"2024-03-30T12:19:38.263320+0000","last_fullsized":"2024-03-30T12:19:38.263320+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:50:54.069856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.885417+0000","last_change":"2024-03-30T12:19:00.854461+0000","last_active":"2024-03-30T12:19:37.885417+0000","last_peered":"2024-03-30T12:19:37.885417+0000","last_clean":"2024-03-30T12:19:37.885417+0000","last_became_active":"2024-03-30T12:19:00.854077+0000","last_became_peered":"2024-03-30T12:19:00.854077+0000","last_unstale":"2024-03-30T12:19:37.885417+0000","last_undegraded":"2024-03-30T12:19:37.885417+0000","last_fullsized":"2024-03-30T12:19:37.885417+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:24:10.940443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"61'4","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.887765+0000","last_change":"2024-03-30T12:19:00.466957+0000","last_active":"2024-03-30T12:19:37.887765+0000","last_peered":"2024-03-30T12:19:37.887765+0000","last_clean":"2024-03-30T12:19:37.887765+0000","last_became_active":"2024-03-30T12:19:00.466689+0000","last_became_peered":"2024-03-30T12:19:00.466689+0000","last_unstale":"2024-03-30T12:19:37.887765+0000","last_undegraded":"2024-03-30T12:19:37.887765+0000","last_fullsized":"2024-03-30T12:19:37.887765+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:08.774258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.832332+0000","last_change":"2024-03-30T12:19:00.863714+0000","last_active":"2024-03-30T12:19:37.832332+0000","last_peered":"2024-03-30T12:19:37.832332+0000","last_clean":"2024-03-30T12:19:37.832332+0000","last_became_active":"2024-03-30T12:19:00.863429+0000","last_became_peered":"2024-03-30T12:19:00.863429+0000","last_unstale":"2024-03-30T12:19:37.832332+0000","last_undegraded":"2024-03-30T12:19:37.832332+0000","last_fullsized":"2024-03-30T12:19:37.832332+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:31.953173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"61'1","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.832419+0000","last_change":"2024-03-30T12:19:00.459693+0000","last_active":"2024-03-30T12:19:37.832419+0000","last_peered":"2024-03-30T12:19:37.832419+0000","last_clean":"2024-03-30T12:19:37.832419+0000","last_became_active":"2024-03-30T12:19:00.459409+0000","last_became_peered":"2024-03-30T12:19:00.459409+0000","last_unstale":"2024-03-30T12:19:37.832419+0000","last_undegraded":"2024-03-30T12:19:37.832419+0000","last_fullsized":"2024-03-30T12:19:37.832419+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:27.891375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.887687+0000","last_change":"2024-03-30T12:19:00.864952+0000","last_active":"2024-03-30T12:19:37.887687+0000","last_peered":"2024-03-30T12:19:37.887687+0000","last_clean":"2024-03-30T12:19:37.887687+0000","last_became_active":"2024-03-30T12:19:00.864274+0000","last_became_peered":"2024-03-30T12:19:00.864274+0000","last_unstale":"2024-03-30T12:19:37.887687+0000","last_undegraded":"2024-03-30T12:19:37.887687+0000","last_fullsized":"2024-03-30T12:19:37.887687+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:45:00.775246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.885657+0000","last_change":"2024-03-30T12:19:00.469695+0000","last_active":"2024-03-30T12:19:37.885657+0000","last_peered":"2024-03-30T12:19:37.885657+0000","last_clean":"2024-03-30T12:19:37.885657+0000","last_became_active":"2024-03-30T12:19:00.469261+0000","last_became_peered":"2024-03-30T12:19:00.469261+0000","last_unstale":"2024-03-30T12:19:37.885657+0000","last_undegraded":"2024-03-30T12:19:37.885657+0000","last_fullsized":"2024-03-30T12:19:37.885657+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:02:43.407908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:38.263722+0000","last_change":"2024-03-30T12:19:00.859422+0000","last_active":"2024-03-30T12:19:38.263722+0000","last_peered":"2024-03-30T12:19:38.263722+0000","last_clean":"2024-03-30T12:19:38.263722+0000","last_became_active":"2024-03-30T12:19:00.858880+0000","last_became_peered":"2024-03-30T12:19:00.858880+0000","last_unstale":"2024-03-30T12:19:38.263722+0000","last_undegraded":"2024-03-30T12:19:38.263722+0000","last_fullsized":"2024-03-30T12:19:38.263722+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:09.612172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.885412+0000","last_change":"2024-03-30T12:19:00.467935+0000","last_active":"2024-03-30T12:19:37.885412+0000","last_peered":"2024-03-30T12:19:37.885412+0000","last_clean":"2024-03-30T12:19:37.885412+0000","last_became_active":"2024-03-30T12:19:00.467636+0000","last_became_peered":"2024-03-30T12:19:00.467636+0000","last_unstale":"2024-03-30T12:19:37.885412+0000","last_undegraded":"2024-03-30T12:19:37.885412+0000","last_fullsized":"2024-03-30T12:19:37.885412+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:49.599855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"peering","last_fresh":"2024-03-30T12:20:36.004078+0000","last_change":"2024-03-30T12:20:36.004246+0000","last_active":"2024-03-30T12:20:36.004078+0000","last_peered":"2024-03-30T12:19:38.263621+0000","last_clean":"2024-03-30T12:19:38.263621+0000","last_became_active":"2024-03-30T12:19:00.858775+0000","last_became_peered":"2024-03-30T12:19:00.858775+0000","last_unstale":"2024-03-30T12:20:36.004078+0000","last_undegraded":"2024-03-30T12:20:36.004078+0000","last_fullsized":"2024-03-30T12:20:36.004078+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:48:36.757626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,4,6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"61'1","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.832613+0000","last_change":"2024-03-30T12:19:00.454521+0000","last_active":"2024-03-30T12:19:37.832613+0000","last_peered":"2024-03-30T12:19:37.832613+0000","last_clean":"2024-03-30T12:19:37.832613+0000","last_became_active":"2024-03-30T12:19:00.454213+0000","last_became_peered":"2024-03-30T12:19:00.454213+0000","last_unstale":"2024-03-30T12:19:37.832613+0000","last_undegraded":"2024-03-30T12:19:37.832613+0000","last_fullsized":"2024-03-30T12:19:37.832613+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:27:47.198072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.828257+0000","last_change":"2024-03-30T12:19:00.860724+0000","last_active":"2024-03-30T12:19:37.828257+0000","last_peered":"2024-03-30T12:19:37.828257+0000","last_clean":"2024-03-30T12:19:37.828257+0000","last_became_active":"2024-03-30T12:19:00.860427+0000","last_became_peered":"2024-03-30T12:19:00.860427+0000","last_unstale":"2024-03-30T12:19:37.828257+0000","last_undegraded":"2024-03-30T12:19:37.828257+0000","last_fullsized":"2024-03-30T12:19:37.828257+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:55:54.757770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"61'1","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.887197+0000","last_change":"2024-03-30T12:19:00.460150+0000","last_active":"2024-03-30T12:19:37.887197+0000","last_peered":"2024-03-30T12:19:37.887197+0000","last_clean":"2024-03-30T12:19:37.887197+0000","last_became_active":"2024-03-30T12:19:00.459740+0000","last_became_peered":"2024-03-30T12:19:00.459740+0000","last_unstale":"2024-03-30T12:19:37.887197+0000","last_undegraded":"2024-03-30T12:19:37.887197+0000","last_fullsized":"2024-03-30T12:19:37.887197+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:52:40.523467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.887264+0000","last_change":"2024-03-30T12:19:00.857403+0000","last_active":"2024-03-30T12:19:37.887264+0000","last_peered":"2024-03-30T12:19:37.887264+0000","last_clean":"2024-03-30T12:19:37.887264+0000","last_became_active":"2024-03-30T12:19:00.856652+0000","last_became_peered":"2024-03-30T12:19:00.856652+0000","last_unstale":"2024-03-30T12:19:37.887264+0000","last_undegraded":"2024-03-30T12:19:37.887264+0000","last_fullsized":"2024-03-30T12:19:37.887264+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:51.932935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.832327+0000","last_change":"2024-03-30T12:19:00.458253+0000","last_active":"2024-03-30T12:19:37.832327+0000","last_peered":"2024-03-30T12:19:37.832327+0000","last_clean":"2024-03-30T12:19:37.832327+0000","last_became_active":"2024-03-30T12:19:00.457947+0000","last_became_peered":"2024-03-30T12:19:00.457947+0000","last_unstale":"2024-03-30T12:19:37.832327+0000","last_undegraded":"2024-03-30T12:19:37.832327+0000","last_fullsized":"2024-03-30T12:19:37.832327+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:13:18.864198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.831963+0000","last_change":"2024-03-30T12:19:00.859188+0000","last_active":"2024-03-30T12:19:37.831963+0000","last_peered":"2024-03-30T12:19:37.831963+0000","last_clean":"2024-03-30T12:19:37.831963+0000","last_became_active":"2024-03-30T12:19:00.858922+0000","last_became_peered":"2024-03-30T12:19:00.858922+0000","last_unstale":"2024-03-30T12:19:37.831963+0000","last_undegraded":"2024-03-30T12:19:37.831963+0000","last_fullsized":"2024-03-30T12:19:37.831963+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:56:16.965191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:38.263233+0000","last_change":"2024-03-30T12:19:00.466729+0000","last_active":"2024-03-30T12:19:38.263233+0000","last_peered":"2024-03-30T12:19:38.263233+0000","last_clean":"2024-03-30T12:19:38.263233+0000","last_became_active":"2024-03-30T12:19:00.466086+0000","last_became_peered":"2024-03-30T12:19:00.466086+0000","last_unstale":"2024-03-30T12:19:38.263233+0000","last_undegraded":"2024-03-30T12:19:38.263233+0000","last_fullsized":"2024-03-30T12:19:38.263233+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:46:14.144417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.833159+0000","last_change":"2024-03-30T12:19:00.863262+0000","last_active":"2024-03-30T12:19:37.833159+0000","last_peered":"2024-03-30T12:19:37.833159+0000","last_clean":"2024-03-30T12:19:37.833159+0000","last_became_active":"2024-03-30T12:19:00.861328+0000","last_became_peered":"2024-03-30T12:19:00.861328+0000","last_unstale":"2024-03-30T12:19:37.833159+0000","last_undegraded":"2024-03-30T12:19:37.833159+0000","last_fullsized":"2024-03-30T12:19:37.833159+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:20:19.049967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.887688+0000","last_change":"2024-03-30T12:19:00.459929+0000","last_active":"2024-03-30T12:19:37.887688+0000","last_peered":"2024-03-30T12:19:37.887688+0000","last_clean":"2024-03-30T12:19:37.887688+0000","last_became_active":"2024-03-30T12:19:00.459518+0000","last_became_peered":"2024-03-30T12:19:00.459518+0000","last_unstale":"2024-03-30T12:19:37.887688+0000","last_undegraded":"2024-03-30T12:19:37.887688+0000","last_fullsized":"2024-03-30T12:19:37.887688+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:09:03.990119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:38.263752+0000","last_change":"2024-03-30T12:19:00.862112+0000","last_active":"2024-03-30T12:19:38.263752+0000","last_peered":"2024-03-30T12:19:38.263752+0000","last_clean":"2024-03-30T12:19:38.263752+0000","last_became_active":"2024-03-30T12:19:00.861782+0000","last_became_peered":"2024-03-30T12:19:00.861782+0000","last_unstale":"2024-03-30T12:19:38.263752+0000","last_undegraded":"2024-03-30T12:19:38.263752+0000","last_fullsized":"2024-03-30T12:19:38.263752+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:01:42.946530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:38.263663+0000","last_change":"2024-03-30T12:19:00.463745+0000","last_active":"2024-03-30T12:19:38.263663+0000","last_peered":"2024-03-30T12:19:38.263663+0000","last_clean":"2024-03-30T12:19:38.263663+0000","last_became_active":"2024-03-30T12:19:00.462698+0000","last_became_peered":"2024-03-30T12:19:00.462698+0000","last_unstale":"2024-03-30T12:19:38.263663+0000","last_undegraded":"2024-03-30T12:19:38.263663+0000","last_fullsized":"2024-03-30T12:19:38.263663+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:09:33.196928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":2,"reported_epoch":67,"state":"peering","last_fresh":"2024-03-30T12:19:37.887676+0000","last_change":"2024-03-30T12:20:36.833748+0000","last_active":"2024-03-30T12:20:36.833748+0000","last_peered":"2024-03-30T12:19:37.887676+0000","last_clean":"2024-03-30T12:19:37.887676+0000","last_became_active":"2024-03-30T12:19:00.864718+0000","last_became_peered":"2024-03-30T12:19:00.864718+0000","last_unstale":"2024-03-30T12:19:37.887676+0000","last_undegraded":"2024-03-30T12:19:37.887676+0000","last_fullsized":"2024-03-30T12:19:37.887676+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:01.772821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":20,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.833738+0000","last_change":"2024-03-30T12:19:00.463581+0000","last_active":"2024-03-30T12:19:37.833738+0000","last_peered":"2024-03-30T12:19:37.833738+0000","last_clean":"2024-03-30T12:19:37.833738+0000","last_became_active":"2024-03-30T12:19:00.463280+0000","last_became_peered":"2024-03-30T12:19:00.463280+0000","last_unstale":"2024-03-30T12:19:37.833738+0000","last_undegraded":"2024-03-30T12:19:37.833738+0000","last_fullsized":"2024-03-30T12:19:37.833738+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:38:07.390655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.828420+0000","last_change":"2024-03-30T12:19:00.878541+0000","last_active":"2024-03-30T12:19:37.828420+0000","last_peered":"2024-03-30T12:19:37.828420+0000","last_clean":"2024-03-30T12:19:37.828420+0000","last_became_active":"2024-03-30T12:19:00.878229+0000","last_became_peered":"2024-03-30T12:19:00.878229+0000","last_unstale":"2024-03-30T12:19:37.828420+0000","last_undegraded":"2024-03-30T12:19:37.828420+0000","last_fullsized":"2024-03-30T12:19:37.828420+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:03:18.020146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"65'9","reported_seq":26,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.887282+0000","last_change":"2024-03-30T12:19:00.458102+0000","last_active":"2024-03-30T12:19:37.887282+0000","last_peered":"2024-03-30T12:19:37.887282+0000","last_clean":"2024-03-30T12:19:37.887282+0000","last_became_active":"2024-03-30T12:19:00.457759+0000","last_became_peered":"2024-03-30T12:19:00.457759+0000","last_unstale":"2024-03-30T12:19:37.887282+0000","last_undegraded":"2024-03-30T12:19:37.887282+0000","last_fullsized":"2024-03-30T12:19:37.887282+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:31.713303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2350,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.885499+0000","last_change":"2024-03-30T12:19:00.872384+0000","last_active":"2024-03-30T12:19:37.885499+0000","last_peered":"2024-03-30T12:19:37.885499+0000","last_clean":"2024-03-30T12:19:37.885499+0000","last_became_active":"2024-03-30T12:19:00.872085+0000","last_became_peered":"2024-03-30T12:19:00.872085+0000","last_unstale":"2024-03-30T12:19:37.885499+0000","last_undegraded":"2024-03-30T12:19:37.885499+0000","last_fullsized":"2024-03-30T12:19:37.885499+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:47:42.278500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.887510+0000","last_change":"2024-03-30T12:19:00.462939+0000","last_active":"2024-03-30T12:19:37.887510+0000","last_peered":"2024-03-30T12:19:37.887510+0000","last_clean":"2024-03-30T12:19:37.887510+0000","last_became_active":"2024-03-30T12:19:00.462637+0000","last_became_peered":"2024-03-30T12:19:00.462637+0000","last_unstale":"2024-03-30T12:19:37.887510+0000","last_undegraded":"2024-03-30T12:19:37.887510+0000","last_fullsized":"2024-03-30T12:19:37.887510+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:48:59.027106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.887248+0000","last_change":"2024-03-30T12:19:00.856865+0000","last_active":"2024-03-30T12:19:37.887248+0000","last_peered":"2024-03-30T12:19:37.887248+0000","last_clean":"2024-03-30T12:19:37.887248+0000","last_became_active":"2024-03-30T12:19:00.856544+0000","last_became_peered":"2024-03-30T12:19:00.856544+0000","last_unstale":"2024-03-30T12:19:37.887248+0000","last_undegraded":"2024-03-30T12:19:37.887248+0000","last_fullsized":"2024-03-30T12:19:37.887248+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:37:39.901012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:38.263331+0000","last_change":"2024-03-30T12:19:00.465931+0000","last_active":"2024-03-30T12:19:38.263331+0000","last_peered":"2024-03-30T12:19:38.263331+0000","last_clean":"2024-03-30T12:19:38.263331+0000","last_became_active":"2024-03-30T12:19:00.465589+0000","last_became_peered":"2024-03-30T12:19:00.465589+0000","last_unstale":"2024-03-30T12:19:38.263331+0000","last_undegraded":"2024-03-30T12:19:38.263331+0000","last_fullsized":"2024-03-30T12:19:38.263331+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:02:38.614924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.885304+0000","last_change":"2024-03-30T12:19:00.870798+0000","last_active":"2024-03-30T12:19:37.885304+0000","last_peered":"2024-03-30T12:19:37.885304+0000","last_clean":"2024-03-30T12:19:37.885304+0000","last_became_active":"2024-03-30T12:19:00.870507+0000","last_became_peered":"2024-03-30T12:19:00.870507+0000","last_unstale":"2024-03-30T12:19:37.885304+0000","last_undegraded":"2024-03-30T12:19:37.885304+0000","last_fullsized":"2024-03-30T12:19:37.885304+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:25:30.259298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.887448+0000","last_change":"2024-03-30T12:19:00.454678+0000","last_active":"2024-03-30T12:19:37.887448+0000","last_peered":"2024-03-30T12:19:37.887448+0000","last_clean":"2024-03-30T12:19:37.887448+0000","last_became_active":"2024-03-30T12:19:00.454380+0000","last_became_peered":"2024-03-30T12:19:00.454380+0000","last_unstale":"2024-03-30T12:19:37.887448+0000","last_undegraded":"2024-03-30T12:19:37.887448+0000","last_fullsized":"2024-03-30T12:19:37.887448+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:08:24.640327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.887104+0000","last_change":"2024-03-30T12:19:00.861547+0000","last_active":"2024-03-30T12:19:37.887104+0000","last_peered":"2024-03-30T12:19:37.887104+0000","last_clean":"2024-03-30T12:19:37.887104+0000","last_became_active":"2024-03-30T12:19:00.861268+0000","last_became_peered":"2024-03-30T12:19:00.861268+0000","last_unstale":"2024-03-30T12:19:37.887104+0000","last_undegraded":"2024-03-30T12:19:37.887104+0000","last_fullsized":"2024-03-30T12:19:37.887104+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:28:37.342309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":25,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:38.263042+0000","last_change":"2024-03-30T12:19:00.460090+0000","last_active":"2024-03-30T12:19:38.263042+0000","last_peered":"2024-03-30T12:19:38.263042+0000","last_clean":"2024-03-30T12:19:38.263042+0000","last_became_active":"2024-03-30T12:19:00.459790+0000","last_became_peered":"2024-03-30T12:19:00.459790+0000","last_unstale":"2024-03-30T12:19:38.263042+0000","last_undegraded":"2024-03-30T12:19:38.263042+0000","last_fullsized":"2024-03-30T12:19:38.263042+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:38.860631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.885052+0000","last_change":"2024-03-30T12:19:00.870061+0000","last_active":"2024-03-30T12:19:37.885052+0000","last_peered":"2024-03-30T12:19:37.885052+0000","last_clean":"2024-03-30T12:19:37.885052+0000","last_became_active":"2024-03-30T12:19:00.869750+0000","last_became_peered":"2024-03-30T12:19:00.869750+0000","last_unstale":"2024-03-30T12:19:37.885052+0000","last_undegraded":"2024-03-30T12:19:37.885052+0000","last_fullsized":"2024-03-30T12:19:37.885052+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:03:02.790151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"61'1","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.828457+0000","last_change":"2024-03-30T12:19:00.461178+0000","last_active":"2024-03-30T12:19:37.828457+0000","last_peered":"2024-03-30T12:19:37.828457+0000","last_clean":"2024-03-30T12:19:37.828457+0000","last_became_active":"2024-03-30T12:19:00.460817+0000","last_became_peered":"2024-03-30T12:19:00.460817+0000","last_unstale":"2024-03-30T12:19:37.828457+0000","last_undegraded":"2024-03-30T12:19:37.828457+0000","last_fullsized":"2024-03-30T12:19:37.828457+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:30:59.255694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.885517+0000","last_change":"2024-03-30T12:19:00.871828+0000","last_active":"2024-03-30T12:19:37.885517+0000","last_peered":"2024-03-30T12:19:37.885517+0000","last_clean":"2024-03-30T12:19:37.885517+0000","last_became_active":"2024-03-30T12:19:00.871555+0000","last_became_peered":"2024-03-30T12:19:00.871555+0000","last_unstale":"2024-03-30T12:19:37.885517+0000","last_undegraded":"2024-03-30T12:19:37.885517+0000","last_fullsized":"2024-03-30T12:19:37.885517+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:02:53.212521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.833110+0000","last_change":"2024-03-30T12:19:35.161648+0000","last_active":"2024-03-30T12:19:37.833110+0000","last_peered":"2024-03-30T12:19:37.833110+0000","last_clean":"2024-03-30T12:19:37.833110+0000","last_became_active":"2024-03-30T12:19:35.161426+0000","last_became_peered":"2024-03-30T12:19:35.161426+0000","last_unstale":"2024-03-30T12:19:37.833110+0000","last_undegraded":"2024-03-30T12:19:37.833110+0000","last_fullsized":"2024-03-30T12:19:37.833110+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:05:56.726860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.833548+0000","last_change":"2024-03-30T12:19:00.462709+0000","last_active":"2024-03-30T12:19:37.833548+0000","last_peered":"2024-03-30T12:19:37.833548+0000","last_clean":"2024-03-30T12:19:37.833548+0000","last_became_active":"2024-03-30T12:19:00.462429+0000","last_became_peered":"2024-03-30T12:19:00.462429+0000","last_unstale":"2024-03-30T12:19:37.833548+0000","last_undegraded":"2024-03-30T12:19:37.833548+0000","last_fullsized":"2024-03-30T12:19:37.833548+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:29.579526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:38.263629+0000","last_change":"2024-03-30T12:19:00.854025+0000","last_active":"2024-03-30T12:19:38.263629+0000","last_peered":"2024-03-30T12:19:38.263629+0000","last_clean":"2024-03-30T12:19:38.263629+0000","last_became_active":"2024-03-30T12:19:00.853714+0000","last_became_peered":"2024-03-30T12:19:00.853714+0000","last_unstale":"2024-03-30T12:19:38.263629+0000","last_undegraded":"2024-03-30T12:19:38.263629+0000","last_fullsized":"2024-03-30T12:19:38.263629+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:27:34.498087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.833628+0000","last_change":"2024-03-30T12:19:35.051431+0000","last_active":"2024-03-30T12:19:37.833628+0000","last_peered":"2024-03-30T12:19:37.833628+0000","last_clean":"2024-03-30T12:19:37.833628+0000","last_became_active":"2024-03-30T12:19:35.050880+0000","last_became_peered":"2024-03-30T12:19:35.050880+0000","last_unstale":"2024-03-30T12:19:37.833628+0000","last_undegraded":"2024-03-30T12:19:37.833628+0000","last_fullsized":"2024-03-30T12:19:37.833628+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:57:58.075785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:38.263272+0000","last_change":"2024-03-30T12:19:00.457612+0000","last_active":"2024-03-30T12:19:38.263272+0000","last_peered":"2024-03-30T12:19:38.263272+0000","last_clean":"2024-03-30T12:19:38.263272+0000","last_became_active":"2024-03-30T12:19:00.457289+0000","last_became_peered":"2024-03-30T12:19:00.457289+0000","last_unstale":"2024-03-30T12:19:38.263272+0000","last_undegraded":"2024-03-30T12:19:38.263272+0000","last_fullsized":"2024-03-30T12:19:38.263272+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:23.011997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.828509+0000","last_change":"2024-03-30T12:19:00.866070+0000","last_active":"2024-03-30T12:19:37.828509+0000","last_peered":"2024-03-30T12:19:37.828509+0000","last_clean":"2024-03-30T12:19:37.828509+0000","last_became_active":"2024-03-30T12:19:00.865706+0000","last_became_peered":"2024-03-30T12:19:00.865706+0000","last_unstale":"2024-03-30T12:19:37.828509+0000","last_undegraded":"2024-03-30T12:19:37.828509+0000","last_fullsized":"2024-03-30T12:19:37.828509+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:56:01.599580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.833846+0000","last_change":"2024-03-30T12:19:35.162695+0000","last_active":"2024-03-30T12:19:37.833846+0000","last_peered":"2024-03-30T12:19:37.833846+0000","last_clean":"2024-03-30T12:19:37.833846+0000","last_became_active":"2024-03-30T12:19:35.162389+0000","last_became_peered":"2024-03-30T12:19:35.162389+0000","last_unstale":"2024-03-30T12:19:37.833846+0000","last_undegraded":"2024-03-30T12:19:37.833846+0000","last_fullsized":"2024-03-30T12:19:37.833846+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:20:43.739417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.832889+0000","last_change":"2024-03-30T12:19:00.861917+0000","last_active":"2024-03-30T12:19:37.832889+0000","last_peered":"2024-03-30T12:19:37.832889+0000","last_clean":"2024-03-30T12:19:37.832889+0000","last_became_active":"2024-03-30T12:19:00.860645+0000","last_became_peered":"2024-03-30T12:19:00.860645+0000","last_unstale":"2024-03-30T12:19:37.832889+0000","last_undegraded":"2024-03-30T12:19:37.832889+0000","last_fullsized":"2024-03-30T12:19:37.832889+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:30:51.438018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:38.263078+0000","last_change":"2024-03-30T12:19:00.459145+0000","last_active":"2024-03-30T12:19:38.263078+0000","last_peered":"2024-03-30T12:19:38.263078+0000","last_clean":"2024-03-30T12:19:38.263078+0000","last_became_active":"2024-03-30T12:19:00.457819+0000","last_became_peered":"2024-03-30T12:19:00.457819+0000","last_unstale":"2024-03-30T12:19:38.263078+0000","last_undegraded":"2024-03-30T12:19:38.263078+0000","last_fullsized":"2024-03-30T12:19:38.263078+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:44:38.245366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.887214+0000","last_change":"2024-03-30T12:19:35.161274+0000","last_active":"2024-03-30T12:19:37.887214+0000","last_peered":"2024-03-30T12:19:37.887214+0000","last_clean":"2024-03-30T12:19:37.887214+0000","last_became_active":"2024-03-30T12:19:35.160985+0000","last_became_peered":"2024-03-30T12:19:35.160985+0000","last_unstale":"2024-03-30T12:19:37.887214+0000","last_undegraded":"2024-03-30T12:19:37.887214+0000","last_fullsized":"2024-03-30T12:19:37.887214+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:07.499529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.831969+0000","last_change":"2024-03-30T12:19:00.862340+0000","last_active":"2024-03-30T12:19:37.831969+0000","last_peered":"2024-03-30T12:19:37.831969+0000","last_clean":"2024-03-30T12:19:37.831969+0000","last_became_active":"2024-03-30T12:19:00.861413+0000","last_became_peered":"2024-03-30T12:19:00.861413+0000","last_unstale":"2024-03-30T12:19:37.831969+0000","last_undegraded":"2024-03-30T12:19:37.831969+0000","last_fullsized":"2024-03-30T12:19:37.831969+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:13:39.199499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:38.263353+0000","last_change":"2024-03-30T12:19:00.465946+0000","last_active":"2024-03-30T12:19:38.263353+0000","last_peered":"2024-03-30T12:19:38.263353+0000","last_clean":"2024-03-30T12:19:38.263353+0000","last_became_active":"2024-03-30T12:19:00.465618+0000","last_became_peered":"2024-03-30T12:19:00.465618+0000","last_unstale":"2024-03-30T12:19:38.263353+0000","last_undegraded":"2024-03-30T12:19:38.263353+0000","last_fullsized":"2024-03-30T12:19:38.263353+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:58:42.109572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"66'128","reported_seq":264,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.890040+0000","last_change":"2024-03-30T12:18:45.912869+0000","last_active":"2024-03-30T12:19:37.890040+0000","last_peered":"2024-03-30T12:19:37.890040+0000","last_clean":"2024-03-30T12:19:37.890040+0000","last_became_active":"2024-03-30T12:18:45.912395+0000","last_became_peered":"2024-03-30T12:18:45.912395+0000","last_unstale":"2024-03-30T12:19:37.890040+0000","last_undegraded":"2024-03-30T12:19:37.890040+0000","last_fullsized":"2024-03-30T12:19:37.890040+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:34.485283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.887510+0000","last_change":"2024-03-30T12:19:35.052180+0000","last_active":"2024-03-30T12:19:37.887510+0000","last_peered":"2024-03-30T12:19:37.887510+0000","last_clean":"2024-03-30T12:19:37.887510+0000","last_became_active":"2024-03-30T12:19:35.051577+0000","last_became_peered":"2024-03-30T12:19:35.051577+0000","last_unstale":"2024-03-30T12:19:37.887510+0000","last_undegraded":"2024-03-30T12:19:37.887510+0000","last_fullsized":"2024-03-30T12:19:37.887510+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:26:43.695424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.887158+0000","last_change":"2024-03-30T12:19:00.852506+0000","last_active":"2024-03-30T12:19:37.887158+0000","last_peered":"2024-03-30T12:19:37.887158+0000","last_clean":"2024-03-30T12:19:37.887158+0000","last_became_active":"2024-03-30T12:19:00.852216+0000","last_became_peered":"2024-03-30T12:19:00.852216+0000","last_unstale":"2024-03-30T12:19:37.887158+0000","last_undegraded":"2024-03-30T12:19:37.887158+0000","last_fullsized":"2024-03-30T12:19:37.887158+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:41:21.462303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.884901+0000","last_change":"2024-03-30T12:19:00.470266+0000","last_active":"2024-03-30T12:19:37.884901+0000","last_peered":"2024-03-30T12:19:37.884901+0000","last_clean":"2024-03-30T12:19:37.884901+0000","last_became_active":"2024-03-30T12:19:00.469541+0000","last_became_peered":"2024-03-30T12:19:00.469541+0000","last_unstale":"2024-03-30T12:19:37.884901+0000","last_undegraded":"2024-03-30T12:19:37.884901+0000","last_fullsized":"2024-03-30T12:19:37.884901+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:57.244620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.887228+0000","last_change":"2024-03-30T12:19:35.162977+0000","last_active":"2024-03-30T12:19:37.887228+0000","last_peered":"2024-03-30T12:19:37.887228+0000","last_clean":"2024-03-30T12:19:37.887228+0000","last_became_active":"2024-03-30T12:19:35.162514+0000","last_became_peered":"2024-03-30T12:19:35.162514+0000","last_unstale":"2024-03-30T12:19:37.887228+0000","last_undegraded":"2024-03-30T12:19:37.887228+0000","last_fullsized":"2024-03-30T12:19:37.887228+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:39:43.550849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.885624+0000","last_change":"2024-03-30T12:19:00.469567+0000","last_active":"2024-03-30T12:19:37.885624+0000","last_peered":"2024-03-30T12:19:37.885624+0000","last_clean":"2024-03-30T12:19:37.885624+0000","last_became_active":"2024-03-30T12:19:00.469218+0000","last_became_peered":"2024-03-30T12:19:00.469218+0000","last_unstale":"2024-03-30T12:19:37.885624+0000","last_undegraded":"2024-03-30T12:19:37.885624+0000","last_fullsized":"2024-03-30T12:19:37.885624+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:16:05.609865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.833699+0000","last_change":"2024-03-30T12:19:00.865798+0000","last_active":"2024-03-30T12:19:37.833699+0000","last_peered":"2024-03-30T12:19:37.833699+0000","last_clean":"2024-03-30T12:19:37.833699+0000","last_became_active":"2024-03-30T12:19:00.865518+0000","last_became_peered":"2024-03-30T12:19:00.865518+0000","last_unstale":"2024-03-30T12:19:37.833699+0000","last_undegraded":"2024-03-30T12:19:37.833699+0000","last_fullsized":"2024-03-30T12:19:37.833699+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:47:41.818140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.831824+0000","last_change":"2024-03-30T12:19:35.162768+0000","last_active":"2024-03-30T12:19:37.831824+0000","last_peered":"2024-03-30T12:19:37.831824+0000","last_clean":"2024-03-30T12:19:37.831824+0000","last_became_active":"2024-03-30T12:19:35.162480+0000","last_became_peered":"2024-03-30T12:19:35.162480+0000","last_unstale":"2024-03-30T12:19:37.831824+0000","last_undegraded":"2024-03-30T12:19:37.831824+0000","last_fullsized":"2024-03-30T12:19:37.831824+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:17:01.235481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"62'1","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.834173+0000","last_change":"2024-03-30T12:19:00.454554+0000","last_active":"2024-03-30T12:19:37.834173+0000","last_peered":"2024-03-30T12:19:37.834173+0000","last_clean":"2024-03-30T12:19:37.834173+0000","last_became_active":"2024-03-30T12:19:00.454233+0000","last_became_peered":"2024-03-30T12:19:00.454233+0000","last_unstale":"2024-03-30T12:19:37.834173+0000","last_undegraded":"2024-03-30T12:19:37.834173+0000","last_fullsized":"2024-03-30T12:19:37.834173+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:05:09.010127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.832613+0000","last_change":"2024-03-30T12:19:00.853806+0000","last_active":"2024-03-30T12:19:37.832613+0000","last_peered":"2024-03-30T12:19:37.832613+0000","last_clean":"2024-03-30T12:19:37.832613+0000","last_became_active":"2024-03-30T12:19:00.853538+0000","last_became_peered":"2024-03-30T12:19:00.853538+0000","last_unstale":"2024-03-30T12:19:37.832613+0000","last_undegraded":"2024-03-30T12:19:37.832613+0000","last_fullsized":"2024-03-30T12:19:37.832613+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:36:10.741436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.828010+0000","last_change":"2024-03-30T12:19:35.162679+0000","last_active":"2024-03-30T12:19:37.828010+0000","last_peered":"2024-03-30T12:19:37.828010+0000","last_clean":"2024-03-30T12:19:37.828010+0000","last_became_active":"2024-03-30T12:19:35.162347+0000","last_became_peered":"2024-03-30T12:19:35.162347+0000","last_unstale":"2024-03-30T12:19:37.828010+0000","last_undegraded":"2024-03-30T12:19:37.828010+0000","last_fullsized":"2024-03-30T12:19:37.828010+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:24:16.565563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.887646+0000","last_change":"2024-03-30T12:19:00.460279+0000","last_active":"2024-03-30T12:19:37.887646+0000","last_peered":"2024-03-30T12:19:37.887646+0000","last_clean":"2024-03-30T12:19:37.887646+0000","last_became_active":"2024-03-30T12:19:00.459948+0000","last_became_peered":"2024-03-30T12:19:00.459948+0000","last_unstale":"2024-03-30T12:19:37.887646+0000","last_undegraded":"2024-03-30T12:19:37.887646+0000","last_fullsized":"2024-03-30T12:19:37.887646+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:06.870147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.887680+0000","last_change":"2024-03-30T12:19:00.853029+0000","last_active":"2024-03-30T12:19:37.887680+0000","last_peered":"2024-03-30T12:19:37.887680+0000","last_clean":"2024-03-30T12:19:37.887680+0000","last_became_active":"2024-03-30T12:19:00.852755+0000","last_became_peered":"2024-03-30T12:19:00.852755+0000","last_unstale":"2024-03-30T12:19:37.887680+0000","last_undegraded":"2024-03-30T12:19:37.887680+0000","last_fullsized":"2024-03-30T12:19:37.887680+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:03:44.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.885110+0000","last_change":"2024-03-30T12:19:00.470521+0000","last_active":"2024-03-30T12:19:37.885110+0000","last_peered":"2024-03-30T12:19:37.885110+0000","last_clean":"2024-03-30T12:19:37.885110+0000","last_became_active":"2024-03-30T12:19:00.469910+0000","last_became_peered":"2024-03-30T12:19:00.469910+0000","last_unstale":"2024-03-30T12:19:37.885110+0000","last_undegraded":"2024-03-30T12:19:37.885110+0000","last_fullsized":"2024-03-30T12:19:37.885110+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:12:52.044394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.828596+0000","last_change":"2024-03-30T12:19:00.877240+0000","last_active":"2024-03-30T12:19:37.828596+0000","last_peered":"2024-03-30T12:19:37.828596+0000","last_clean":"2024-03-30T12:19:37.828596+0000","last_became_active":"2024-03-30T12:19:00.876739+0000","last_became_peered":"2024-03-30T12:19:00.876739+0000","last_unstale":"2024-03-30T12:19:37.828596+0000","last_undegraded":"2024-03-30T12:19:37.828596+0000","last_fullsized":"2024-03-30T12:19:37.828596+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:25.328486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.833023+0000","last_change":"2024-03-30T12:19:00.459528+0000","last_active":"2024-03-30T12:19:37.833023+0000","last_peered":"2024-03-30T12:19:37.833023+0000","last_clean":"2024-03-30T12:19:37.833023+0000","last_became_active":"2024-03-30T12:19:00.459223+0000","last_became_peered":"2024-03-30T12:19:00.459223+0000","last_unstale":"2024-03-30T12:19:37.833023+0000","last_undegraded":"2024-03-30T12:19:37.833023+0000","last_fullsized":"2024-03-30T12:19:37.833023+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:44.399783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.831894+0000","last_change":"2024-03-30T12:19:00.850810+0000","last_active":"2024-03-30T12:19:37.831894+0000","last_peered":"2024-03-30T12:19:37.831894+0000","last_clean":"2024-03-30T12:19:37.831894+0000","last_became_active":"2024-03-30T12:19:00.850530+0000","last_became_peered":"2024-03-30T12:19:00.850530+0000","last_unstale":"2024-03-30T12:19:37.831894+0000","last_undegraded":"2024-03-30T12:19:37.831894+0000","last_fullsized":"2024-03-30T12:19:37.831894+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:52:32.869322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"peering","last_fresh":"2024-03-30T12:20:36.007572+0000","last_change":"2024-03-30T12:20:36.007787+0000","last_active":"2024-03-30T12:20:36.007572+0000","last_peered":"2024-03-30T12:19:37.833303+0000","last_clean":"2024-03-30T12:19:37.833303+0000","last_became_active":"2024-03-30T12:19:00.460018+0000","last_became_peered":"2024-03-30T12:19:00.460018+0000","last_unstale":"2024-03-30T12:20:36.007572+0000","last_undegraded":"2024-03-30T12:20:36.007572+0000","last_fullsized":"2024-03-30T12:20:36.007572+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.770918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3,7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.834455+0000","last_change":"2024-03-30T12:19:00.858733+0000","last_active":"2024-03-30T12:19:37.834455+0000","last_peered":"2024-03-30T12:19:37.834455+0000","last_clean":"2024-03-30T12:19:37.834455+0000","last_became_active":"2024-03-30T12:19:00.858419+0000","last_became_peered":"2024-03-30T12:19:00.858419+0000","last_unstale":"2024-03-30T12:19:37.834455+0000","last_undegraded":"2024-03-30T12:19:37.834455+0000","last_fullsized":"2024-03-30T12:19:37.834455+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:43.731796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"61'2","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.885227+0000","last_change":"2024-03-30T12:19:00.468017+0000","last_active":"2024-03-30T12:19:37.885227+0000","last_peered":"2024-03-30T12:19:37.885227+0000","last_clean":"2024-03-30T12:19:37.885227+0000","last_became_active":"2024-03-30T12:19:00.466979+0000","last_became_peered":"2024-03-30T12:19:00.466979+0000","last_unstale":"2024-03-30T12:19:37.885227+0000","last_undegraded":"2024-03-30T12:19:37.885227+0000","last_fullsized":"2024-03-30T12:19:37.885227+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:41:36.480109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.887108+0000","last_change":"2024-03-30T12:19:00.869001+0000","last_active":"2024-03-30T12:19:37.887108+0000","last_peered":"2024-03-30T12:19:37.887108+0000","last_clean":"2024-03-30T12:19:37.887108+0000","last_became_active":"2024-03-30T12:19:00.868645+0000","last_became_peered":"2024-03-30T12:19:00.868645+0000","last_unstale":"2024-03-30T12:19:37.887108+0000","last_undegraded":"2024-03-30T12:19:37.887108+0000","last_fullsized":"2024-03-30T12:19:37.887108+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:54:10.778279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:38.263242+0000","last_change":"2024-03-30T12:19:00.459171+0000","last_active":"2024-03-30T12:19:38.263242+0000","last_peered":"2024-03-30T12:19:38.263242+0000","last_clean":"2024-03-30T12:19:38.263242+0000","last_became_active":"2024-03-30T12:19:00.458925+0000","last_became_peered":"2024-03-30T12:19:00.458925+0000","last_unstale":"2024-03-30T12:19:38.263242+0000","last_undegraded":"2024-03-30T12:19:38.263242+0000","last_fullsized":"2024-03-30T12:19:38.263242+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:26:20.974369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.885573+0000","last_change":"2024-03-30T12:19:00.875558+0000","last_active":"2024-03-30T12:19:37.885573+0000","last_peered":"2024-03-30T12:19:37.885573+0000","last_clean":"2024-03-30T12:19:37.885573+0000","last_became_active":"2024-03-30T12:19:00.875216+0000","last_became_peered":"2024-03-30T12:19:00.875216+0000","last_unstale":"2024-03-30T12:19:37.885573+0000","last_undegraded":"2024-03-30T12:19:37.885573+0000","last_fullsized":"2024-03-30T12:19:37.885573+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:27:04.763910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"61'1","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.833654+0000","last_change":"2024-03-30T12:19:00.459545+0000","last_active":"2024-03-30T12:19:37.833654+0000","last_peered":"2024-03-30T12:19:37.833654+0000","last_clean":"2024-03-30T12:19:37.833654+0000","last_became_active":"2024-03-30T12:19:00.459250+0000","last_became_peered":"2024-03-30T12:19:00.459250+0000","last_unstale":"2024-03-30T12:19:37.833654+0000","last_undegraded":"2024-03-30T12:19:37.833654+0000","last_fullsized":"2024-03-30T12:19:37.833654+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:38.112815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:38.263563+0000","last_change":"2024-03-30T12:19:00.852558+0000","last_active":"2024-03-30T12:19:38.263563+0000","last_peered":"2024-03-30T12:19:38.263563+0000","last_clean":"2024-03-30T12:19:38.263563+0000","last_became_active":"2024-03-30T12:19:00.852250+0000","last_became_peered":"2024-03-30T12:19:00.852250+0000","last_unstale":"2024-03-30T12:19:38.263563+0000","last_undegraded":"2024-03-30T12:19:38.263563+0000","last_fullsized":"2024-03-30T12:19:38.263563+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:57:15.989801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"61'2","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:38.263293+0000","last_change":"2024-03-30T12:19:00.464968+0000","last_active":"2024-03-30T12:19:38.263293+0000","last_peered":"2024-03-30T12:19:38.263293+0000","last_clean":"2024-03-30T12:19:38.263293+0000","last_became_active":"2024-03-30T12:19:00.464021+0000","last_became_peered":"2024-03-30T12:19:00.464021+0000","last_unstale":"2024-03-30T12:19:38.263293+0000","last_undegraded":"2024-03-30T12:19:38.263293+0000","last_fullsized":"2024-03-30T12:19:38.263293+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:20.224884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.885539+0000","last_change":"2024-03-30T12:19:00.871645+0000","last_active":"2024-03-30T12:19:37.885539+0000","last_peered":"2024-03-30T12:19:37.885539+0000","last_clean":"2024-03-30T12:19:37.885539+0000","last_became_active":"2024-03-30T12:19:00.871376+0000","last_became_peered":"2024-03-30T12:19:00.871376+0000","last_unstale":"2024-03-30T12:19:37.885539+0000","last_undegraded":"2024-03-30T12:19:37.885539+0000","last_fullsized":"2024-03-30T12:19:37.885539+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:54:57.281972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.886927+0000","last_change":"2024-03-30T12:19:00.862859+0000","last_active":"2024-03-30T12:19:37.886927+0000","last_peered":"2024-03-30T12:19:37.886927+0000","last_clean":"2024-03-30T12:19:37.886927+0000","last_became_active":"2024-03-30T12:19:00.862535+0000","last_became_peered":"2024-03-30T12:19:00.862535+0000","last_unstale":"2024-03-30T12:19:37.886927+0000","last_undegraded":"2024-03-30T12:19:37.886927+0000","last_fullsized":"2024-03-30T12:19:37.886927+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:17:31.462763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:38.262992+0000","last_change":"2024-03-30T12:19:00.862947+0000","last_active":"2024-03-30T12:19:38.262992+0000","last_peered":"2024-03-30T12:19:38.262992+0000","last_clean":"2024-03-30T12:19:38.262992+0000","last_became_active":"2024-03-30T12:19:00.862567+0000","last_became_peered":"2024-03-30T12:19:00.862567+0000","last_unstale":"2024-03-30T12:19:38.262992+0000","last_undegraded":"2024-03-30T12:19:38.262992+0000","last_fullsized":"2024-03-30T12:19:38.262992+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:55:05.422370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:38.263362+0000","last_change":"2024-03-30T12:19:00.856869+0000","last_active":"2024-03-30T12:19:38.263362+0000","last_peered":"2024-03-30T12:19:38.263362+0000","last_clean":"2024-03-30T12:19:38.263362+0000","last_became_active":"2024-03-30T12:19:00.856525+0000","last_became_peered":"2024-03-30T12:19:00.856525+0000","last_unstale":"2024-03-30T12:19:38.263362+0000","last_undegraded":"2024-03-30T12:19:38.263362+0000","last_fullsized":"2024-03-30T12:19:38.263362+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:01:47.443294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.887431+0000","last_change":"2024-03-30T12:19:00.859724+0000","last_active":"2024-03-30T12:19:37.887431+0000","last_peered":"2024-03-30T12:19:37.887431+0000","last_clean":"2024-03-30T12:19:37.887431+0000","last_became_active":"2024-03-30T12:19:00.859327+0000","last_became_peered":"2024-03-30T12:19:00.859327+0000","last_unstale":"2024-03-30T12:19:37.887431+0000","last_undegraded":"2024-03-30T12:19:37.887431+0000","last_fullsized":"2024-03-30T12:19:37.887431+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:53:15.692683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"peering","last_fresh":"2024-03-30T12:20:36.003551+0000","last_change":"2024-03-30T12:20:36.003704+0000","last_active":"2024-03-30T12:20:36.003551+0000","last_peered":"2024-03-30T12:19:37.832900+0000","last_clean":"2024-03-30T12:19:37.832900+0000","last_became_active":"2024-03-30T12:19:00.857117+0000","last_became_peered":"2024-03-30T12:19:00.857117+0000","last_unstale":"2024-03-30T12:20:36.003551+0000","last_undegraded":"2024-03-30T12:20:36.003551+0000","last_fullsized":"2024-03-30T12:20:36.003551+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:11.253649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2,4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.833570+0000","last_change":"2024-03-30T12:19:00.848297+0000","last_active":"2024-03-30T12:19:37.833570+0000","last_peered":"2024-03-30T12:19:37.833570+0000","last_clean":"2024-03-30T12:19:37.833570+0000","last_became_active":"2024-03-30T12:19:00.848029+0000","last_became_peered":"2024-03-30T12:19:00.848029+0000","last_unstale":"2024-03-30T12:19:37.833570+0000","last_undegraded":"2024-03-30T12:19:37.833570+0000","last_fullsized":"2024-03-30T12:19:37.833570+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:38.617413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.887564+0000","last_change":"2024-03-30T12:19:00.869414+0000","last_active":"2024-03-30T12:19:37.887564+0000","last_peered":"2024-03-30T12:19:37.887564+0000","last_clean":"2024-03-30T12:19:37.887564+0000","last_became_active":"2024-03-30T12:19:00.869115+0000","last_became_peered":"2024-03-30T12:19:00.869115+0000","last_unstale":"2024-03-30T12:19:37.887564+0000","last_undegraded":"2024-03-30T12:19:37.887564+0000","last_fullsized":"2024-03-30T12:19:37.887564+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:01:12.173692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.832688+0000","last_change":"2024-03-30T12:19:00.856088+0000","last_active":"2024-03-30T12:19:37.832688+0000","last_peered":"2024-03-30T12:19:37.832688+0000","last_clean":"2024-03-30T12:19:37.832688+0000","last_became_active":"2024-03-30T12:19:00.855480+0000","last_became_peered":"2024-03-30T12:19:00.855480+0000","last_unstale":"2024-03-30T12:19:37.832688+0000","last_undegraded":"2024-03-30T12:19:37.832688+0000","last_fullsized":"2024-03-30T12:19:37.832688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:21:16.961559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:38.263215+0000","last_change":"2024-03-30T12:19:00.854668+0000","last_active":"2024-03-30T12:19:38.263215+0000","last_peered":"2024-03-30T12:19:38.263215+0000","last_clean":"2024-03-30T12:19:38.263215+0000","last_became_active":"2024-03-30T12:19:00.854390+0000","last_became_peered":"2024-03-30T12:19:00.854390+0000","last_unstale":"2024-03-30T12:19:38.263215+0000","last_undegraded":"2024-03-30T12:19:38.263215+0000","last_fullsized":"2024-03-30T12:19:38.263215+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:39:22.128098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.832207+0000","last_change":"2024-03-30T12:19:00.851282+0000","last_active":"2024-03-30T12:19:37.832207+0000","last_peered":"2024-03-30T12:19:37.832207+0000","last_clean":"2024-03-30T12:19:37.832207+0000","last_became_active":"2024-03-30T12:19:00.850915+0000","last_became_peered":"2024-03-30T12:19:00.850915+0000","last_unstale":"2024-03-30T12:19:37.832207+0000","last_undegraded":"2024-03-30T12:19:37.832207+0000","last_fullsized":"2024-03-30T12:19:37.832207+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:46:50.526568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:38.263513+0000","last_change":"2024-03-30T12:19:00.860406+0000","last_active":"2024-03-30T12:19:38.263513+0000","last_peered":"2024-03-30T12:19:38.263513+0000","last_clean":"2024-03-30T12:19:38.263513+0000","last_became_active":"2024-03-30T12:19:00.860085+0000","last_became_peered":"2024-03-30T12:19:00.860085+0000","last_unstale":"2024-03-30T12:19:38.263513+0000","last_undegraded":"2024-03-30T12:19:38.263513+0000","last_fullsized":"2024-03-30T12:19:38.263513+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:32.201939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.887431+0000","last_change":"2024-03-30T12:19:00.856917+0000","last_active":"2024-03-30T12:19:37.887431+0000","last_peered":"2024-03-30T12:19:37.887431+0000","last_clean":"2024-03-30T12:19:37.887431+0000","last_became_active":"2024-03-30T12:19:00.856643+0000","last_became_peered":"2024-03-30T12:19:00.856643+0000","last_unstale":"2024-03-30T12:19:37.887431+0000","last_undegraded":"2024-03-30T12:19:37.887431+0000","last_fullsized":"2024-03-30T12:19:37.887431+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:51:53.996045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-03-30T12:19:37.887364+0000","last_change":"2024-03-30T12:19:00.867176+0000","last_active":"2024-03-30T12:19:37.887364+0000","last_peered":"2024-03-30T12:19:37.887364+0000","last_clean":"2024-03-30T12:19:37.887364+0000","last_became_active":"2024-03-30T12:19:00.866801+0000","last_became_peered":"2024-03-30T12:19:00.866801+0000","last_unstale":"2024-03-30T12:19:37.887364+0000","last_undegraded":"2024-03-30T12:19:37.887364+0000","last_fullsized":"2024-03-30T12:19:37.887364+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:31:22.909206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3148,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":9444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234010,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32368,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712784,"statfs":{"total":95995035648,"available":95961890816,"internally_reserved":0,"allocated":1282048,"data_stored":885898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.32700000000000001}]},{"osd":1,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.375}]},{"osd":2,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.42699999999999999}]},{"osd":3,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.48199999999999998}]},{"osd":4,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.58699999999999997}]},{"osd":5,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.57599999999999996}]},{"osd":6,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.60999999999999999}]}]},{"osd":6,"up_from":46,"seq":197568495646,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28276,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716876,"statfs":{"total":95995035648,"available":95966081024,"internally_reserved":0,"allocated":1286144,"data_stored":887702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.52500000000000002,"15min":0.53200000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.505,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.73599999999999999,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.54900000000000004}]},{"osd":1,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77900000000000003,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.505,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.35499999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.67900000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.57699999999999996}]},{"osd":2,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53800000000000003,"15min":0.54300000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.67100000000000004,"5min":1.044,"15min":1.044},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70399999999999996,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.48799999999999999}]},{"osd":3,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73399999999999999,"5min":0.754,"15min":0.754},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.38900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.72199999999999998,"5min":1.006,"15min":1.006},"last":0.629}]},{"osd":4,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.41999999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.51300000000000001}]},{"osd":5,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.42799999999999999,"15min":0.42199999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.435},{"interface":"front","average":{"1min":0.498,"5min":0.45800000000000002,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.60599999999999998}]},{"osd":7,"last update":"Sat Mar 30 12:19:44 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.65600000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31772,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713380,"statfs":{"total":95995035648,"available":95962501120,"internally_reserved":0,"allocated":671744,"data_stored":287631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:20:24 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34200000000000003,"15min":0.313},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.44700000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.37,"15min":0.33000000000000002},"min":{"1min":0.23100000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.46100000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.29199999999999998}]},{"osd":2,"last update":"Sat Mar 30 12:19:46 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38,"15min":0.374},"min":{"1min":0.247,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.54300000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.307},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39600000000000002,"15min":0.38900000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56399999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.443}]},{"osd":3,"last update":"Sat Mar 30 12:20:13 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.27400000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55300000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.46500000000000002,"15min":0.47699999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58499999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.34499999999999997}]},{"osd":4,"last update":"Sat Mar 30 12:20:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.54100000000000004}]},{"osd":5,"last update":"Sat Mar 30 12:19:54 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.501},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59199999999999997,"15min":0.58899999999999997},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.51200000000000001}]},{"osd":6,"last update":"Sat Mar 30 12:20:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.59399999999999997,"15min":0.59999999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60299999999999998,"15min":0.60599999999999998},"min":{"1min":0.46100000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.55400000000000005}]},{"osd":7,"last update":"Sat Mar 30 12:19:45 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.48899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738427,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32380,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712772,"statfs":{"total":95995035648,"available":95961878528,"internally_reserved":0,"allocated":1294336,"data_stored":886353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 30 12:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.32800000000000001,"15min":0.30199999999999999},"min":{"1min":0.191,"5min":0.183,"15min":0.183},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.36199999999999999,"15min":0.318},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.58199999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.23699999999999999}]},{"osd":2,"last update":"Sat Mar 30 12:19:48 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.41999999999999998,"15min":0.41799999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.57199999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.40799999999999997,"15min":0.40400000000000003},"min":{"1min":0.23699999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56299999999999994,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.26800000000000002}]},{"osd":3,"last update":"Sat Mar 30 12:20:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.27500000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.45400000000000001,"15min":0.45800000000000002},"min":{"1min":0.314,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68600000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.34300000000000003}]},{"osd":4,"last update":"Sat Mar 30 12:20:31 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73399999999999999,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.38200000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.753,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.76600000000000001}]},{"osd":5,"last update":"Sat Mar 30 12:19:59 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.41099999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.746},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.76400000000000001,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.73499999999999999}]},{"osd":6,"last update":"Sat Mar 30 12:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76000000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.66300000000000003}]},{"osd":7,"last update":"Sat Mar 30 12:19:45 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.58699999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411377,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31768,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713384,"statfs":{"total":95995035648,"available":95962505216,"internally_reserved":0,"allocated":667648,"data_stored":287744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:19:50 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.34999999999999998,"15min":0.34300000000000003},"min":{"1min":0.254,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.377,"15min":0.379},"min":{"1min":0.27500000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.46899999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.27800000000000002}]},{"osd":1,"last update":"Sat Mar 30 12:19:50 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26100000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.47799999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.38900000000000001,"15min":0.38300000000000001},"min":{"1min":0.246,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59799999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.376}]},{"osd":3,"last update":"Sat Mar 30 12:20:13 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45200000000000001,"15min":0.44800000000000001},"min":{"1min":0.32300000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.44500000000000001,"15min":0.45300000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.32100000000000001}]},{"osd":4,"last update":"Sat Mar 30 12:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54100000000000004,"15min":0.54300000000000004},"min":{"1min":0.378,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.39100000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.51700000000000002}]},{"osd":5,"last update":"Sat Mar 30 12:20:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":1.3400000000000001,"15min":1.474},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86799999999999999,"5min":19.606999999999999,"15min":19.606999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.42299999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.746,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.46500000000000002}]},{"osd":6,"last update":"Sat Mar 30 12:20:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.40799999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.87,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.47699999999999998}]},{"osd":7,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.52500000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182444,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717444,"statfs":{"total":95995035648,"available":95966662656,"internally_reserved":0,"allocated":704512,"data_stored":297711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:20:13 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39500000000000002,"15min":0.40300000000000002},"min":{"1min":0.25700000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.41299999999999998,"15min":0.41999999999999998},"min":{"1min":0.26200000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.50600000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.41499999999999998}]},{"osd":1,"last update":"Sat Mar 30 12:20:13 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.61799999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.438,"15min":0.443},"min":{"1min":0.33100000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57199999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.36399999999999999}]},{"osd":2,"last update":"Sat Mar 30 12:20:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.45500000000000002,"15min":0.46200000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.42799999999999999,"15min":0.434},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.629,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.34599999999999997}]},{"osd":4,"last update":"Sat Mar 30 12:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.64600000000000002,"15min":0.68400000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.753,"5min":4.8639999999999999,"15min":4.8639999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57199999999999995,"15min":0.56000000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81299999999999994,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.497}]},{"osd":5,"last update":"Sat Mar 30 12:19:56 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.622,"15min":0.628},"min":{"1min":0.41299999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.39600000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.57599999999999996}]},{"osd":6,"last update":"Sat Mar 30 12:20:20 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.435,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82599999999999996,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.74399999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.52700000000000002}]},{"osd":7,"last update":"Sat Mar 30 12:19:44 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.60299999999999998}]}]},{"osd":4,"up_from":30,"seq":128849018919,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717456,"statfs":{"total":95995035648,"available":95966674944,"internally_reserved":0,"allocated":692224,"data_stored":295419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:20:34 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.63600000000000001,"15min":0.57999999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.73599999999999999,"5min":9.5069999999999997,"15min":9.5069999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51300000000000001,"15min":0.50800000000000001},"min":{"1min":0.29699999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.58999999999999997}]},{"osd":1,"last update":"Sat Mar 30 12:20:34 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51700000000000002,"15min":0.51400000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.61899999999999999,"15min":0.53200000000000003},"min":{"1min":0.38400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.98499999999999999,"5min":11.534000000000001,"15min":11.534000000000001},"last":0.40300000000000002}]},{"osd":2,"last update":"Sat Mar 30 12:20:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.41199999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.36799999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.67600000000000005}]},{"osd":3,"last update":"Sat Mar 30 12:20:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53300000000000003,"15min":0.52300000000000002},"min":{"1min":0.40300000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.748,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.56799999999999995}]},{"osd":5,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.434,"15min":0.436},"min":{"1min":0.311,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.64900000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.437,"5min":0.42999999999999999,"15min":0.42899999999999999},"min":{"1min":0.32700000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70999999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.49099999999999999}]},{"osd":6,"last update":"Sat Mar 30 12:20:23 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.45300000000000001,"15min":0.45100000000000001},"min":{"1min":0.316,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69799999999999995,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68700000000000006,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.64300000000000002}]},{"osd":7,"last update":"Sat Mar 30 12:19:42 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.628},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.65700000000000003}]}]},{"osd":5,"up_from":38,"seq":163208757283,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717448,"statfs":{"total":95995035648,"available":95966666752,"internally_reserved":0,"allocated":700416,"data_stored":297697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.36699999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51900000000000002,"15min":0.52100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70799999999999996,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.61899999999999999}]},{"osd":1,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72599999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.40200000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63800000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.52900000000000003}]},{"osd":2,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51500000000000001,"15min":0.51600000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70899999999999996,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52500000000000002,"15min":0.52800000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.64200000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.55900000000000005}]},{"osd":3,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.73599999999999999,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.499},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53600000000000003,"15min":0.54000000000000004},"min":{"1min":0.41599999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.59399999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.47799999999999998}]},{"osd":4,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39400000000000002,"15min":0.39000000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.37},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.40200000000000002,"15min":0.39300000000000002},"min":{"1min":0.28399999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.39800000000000002}]},{"osd":6,"last update":"Sat Mar 30 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.434,"15min":0.42999999999999999},"min":{"1min":0.32200000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.443,"15min":0.438},"min":{"1min":0.36299999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.58899999999999997}]},{"osd":7,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.435},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.63700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:20:40.242 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:20:40.271 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:40 smithi162 ceph-mon[30421]: from='client.24677 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:20:40.271 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:40 smithi162 ceph-mon[30421]: pgmap v38: 105 pgs: 5 peering, 100 active+clean; 580 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:40.784 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:20:40.909 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:40 smithi084 podman[72970]: 2024-03-30 12:20:40.580304086 +0000 UTC m=+1.491777727 container remove afc02392307017e6996d665e9355a9f0ffebaa52bd873f800446c886cd93d035 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T12:20:40.909 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:40 smithi084 podman[72970]: 2024-03-30 12:20:40.680938388 +0000 UTC m=+1.592411980 volume remove dd4b693003cf9e114eb8678a4b5fd4f9c181fb8a410ce6a0157c8be9c73c2f21 2024-03-30T12:20:41.224 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:41 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@alertmanager.a.service: Deactivated successfully. 2024-03-30T12:20:41.225 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:41 smithi084 systemd[1]: Stopped Ceph alertmanager.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:20:41.225 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:41 smithi084 systemd[1]: Starting Ceph alertmanager.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:20:42.245 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:41 smithi084 ceph-mon[37565]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs peering) 2024-03-30T12:20:42.245 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:41 smithi084 ceph-mon[37565]: Cluster is now healthy 2024-03-30T12:20:42.246 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:41 smithi084 ceph-mon[27000]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs peering) 2024-03-30T12:20:42.246 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:41 smithi084 ceph-mon[27000]: Cluster is now healthy 2024-03-30T12:20:42.246 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:42 smithi084 podman[73180]: 2024-03-30 12:20:42.025567038 +0000 UTC m=+0.548334454 image pull c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19 quay.io/prometheus/alertmanager:v0.25.0 2024-03-30T12:20:42.246 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:42 smithi084 podman[73180]: 2024-03-30 12:20:42.137937158 +0000 UTC m=+0.660704591 volume create 6477db064958914da150e6d24f901e90f5de3259639eb4a41d8395880a60e69f 2024-03-30T12:20:42.246 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:42 smithi084 podman[73180]: 2024-03-30 12:20:42.254863951 +0000 UTC m=+0.777631341 container create 6765ce007f39388c4f91fccbe653cef958819434171420ca39a2fbb3767904ee (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T12:20:42.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:41 smithi162 ceph-mon[30421]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs peering) 2024-03-30T12:20:42.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:41 smithi162 ceph-mon[30421]: Cluster is now healthy 2024-03-30T12:20:42.846 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:42 smithi084 podman[73180]: 2024-03-30 12:20:42.540456138 +0000 UTC m=+1.063223529 container init 6765ce007f39388c4f91fccbe653cef958819434171420ca39a2fbb3767904ee (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T12:20:42.846 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:42 smithi084 podman[73180]: 2024-03-30 12:20:42.543116765 +0000 UTC m=+1.065884157 container start 6765ce007f39388c4f91fccbe653cef958819434171420ca39a2fbb3767904ee (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T12:20:42.846 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[73215]: ts=2024-03-30T12:20:42.555Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-03-30T12:20:42.846 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[73215]: ts=2024-03-30T12:20:42.555Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-03-30T12:20:42.846 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[73215]: ts=2024-03-30T12:20:42.556Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.84 port=9094 2024-03-30T12:20:42.846 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[73215]: ts=2024-03-30T12:20:42.557Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-03-30T12:20:42.846 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[73215]: ts=2024-03-30T12:20:42.580Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-30T12:20:42.846 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[73215]: ts=2024-03-30T12:20:42.580Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-30T12:20:42.846 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[73215]: ts=2024-03-30T12:20:42.583Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-03-30T12:20:42.846 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[73215]: ts=2024-03-30T12:20:42.583Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-03-30T12:20:42.846 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:42 smithi084 bash[73180]: 6765ce007f39388c4f91fccbe653cef958819434171420ca39a2fbb3767904ee 2024-03-30T12:20:42.847 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:42 smithi084 systemd[1]: Started Ceph alertmanager.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:20:43.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:42 smithi084 ceph-mon[37565]: pgmap v39: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:43.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:42 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:43.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:42 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:43.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:42 smithi084 ceph-mon[27000]: pgmap v39: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:43.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:42 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:43.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:42 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:43.308 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:42 smithi162 ceph-mon[30421]: pgmap v39: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:43.309 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:42 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:43.309 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:42 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:43.313 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:20:43.315 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:20:44.147 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-03-30T12:20:41.837986+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593516,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":227,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":315,"acting":315,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":316,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":243912,"kb_used_data":7248,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":749717304,"statfs":{"total":767960285184,"available":767710519296,"internally_reserved":0,"allocated":7421952,"data_stored":4197651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":242208312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001379"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010417+0000","last_change":"2024-03-30T12:19:00.863340+0000","last_active":"2024-03-30T12:20:36.010417+0000","last_peered":"2024-03-30T12:20:36.010417+0000","last_clean":"2024-03-30T12:20:36.010417+0000","last_became_active":"2024-03-30T12:19:00.863041+0000","last_became_peered":"2024-03-30T12:19:00.863041+0000","last_unstale":"2024-03-30T12:20:36.010417+0000","last_undegraded":"2024-03-30T12:20:36.010417+0000","last_fullsized":"2024-03-30T12:20:36.010417+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:21.728523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-30T12:20:37.241613+0000","last_change":"2024-03-30T12:20:37.241613+0000","last_active":"2024-03-30T12:20:37.241613+0000","last_peered":"2024-03-30T12:20:37.241613+0000","last_clean":"2024-03-30T12:20:37.241613+0000","last_became_active":"2024-03-30T12:20:37.241258+0000","last_became_peered":"2024-03-30T12:20:37.241258+0000","last_unstale":"2024-03-30T12:20:37.241613+0000","last_undegraded":"2024-03-30T12:20:37.241613+0000","last_fullsized":"2024-03-30T12:20:37.241613+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:23:14.775585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006611+0000","last_change":"2024-03-30T12:19:00.853843+0000","last_active":"2024-03-30T12:20:36.006611+0000","last_peered":"2024-03-30T12:20:36.006611+0000","last_clean":"2024-03-30T12:20:36.006611+0000","last_became_active":"2024-03-30T12:19:00.853543+0000","last_became_peered":"2024-03-30T12:19:00.853543+0000","last_unstale":"2024-03-30T12:20:36.006611+0000","last_undegraded":"2024-03-30T12:20:36.006611+0000","last_fullsized":"2024-03-30T12:20:36.006611+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:52.339142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003242+0000","last_change":"2024-03-30T12:19:00.859974+0000","last_active":"2024-03-30T12:20:36.003242+0000","last_peered":"2024-03-30T12:20:36.003242+0000","last_clean":"2024-03-30T12:20:36.003242+0000","last_became_active":"2024-03-30T12:19:00.859615+0000","last_became_peered":"2024-03-30T12:19:00.859615+0000","last_unstale":"2024-03-30T12:20:36.003242+0000","last_undegraded":"2024-03-30T12:20:36.003242+0000","last_fullsized":"2024-03-30T12:20:36.003242+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:26.933772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010028+0000","last_change":"2024-03-30T12:19:00.872400+0000","last_active":"2024-03-30T12:20:36.010028+0000","last_peered":"2024-03-30T12:20:36.010028+0000","last_clean":"2024-03-30T12:20:36.010028+0000","last_became_active":"2024-03-30T12:19:00.872098+0000","last_became_peered":"2024-03-30T12:19:00.872098+0000","last_unstale":"2024-03-30T12:20:36.010028+0000","last_undegraded":"2024-03-30T12:20:36.010028+0000","last_fullsized":"2024-03-30T12:20:36.010028+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:21.152462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003182+0000","last_change":"2024-03-30T12:19:00.858029+0000","last_active":"2024-03-30T12:20:36.003182+0000","last_peered":"2024-03-30T12:20:36.003182+0000","last_clean":"2024-03-30T12:20:36.003182+0000","last_became_active":"2024-03-30T12:19:00.857668+0000","last_became_peered":"2024-03-30T12:19:00.857668+0000","last_unstale":"2024-03-30T12:20:36.003182+0000","last_undegraded":"2024-03-30T12:20:36.003182+0000","last_fullsized":"2024-03-30T12:20:36.003182+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:17:33.313541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.009440+0000","last_change":"2024-03-30T12:19:00.869258+0000","last_active":"2024-03-30T12:20:36.009440+0000","last_peered":"2024-03-30T12:20:36.009440+0000","last_clean":"2024-03-30T12:20:36.009440+0000","last_became_active":"2024-03-30T12:19:00.868799+0000","last_became_peered":"2024-03-30T12:19:00.868799+0000","last_unstale":"2024-03-30T12:20:36.009440+0000","last_undegraded":"2024-03-30T12:20:36.009440+0000","last_fullsized":"2024-03-30T12:20:36.009440+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:00:11.265094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002183+0000","last_change":"2024-03-30T12:19:00.864240+0000","last_active":"2024-03-30T12:20:36.002183+0000","last_peered":"2024-03-30T12:20:36.002183+0000","last_clean":"2024-03-30T12:20:36.002183+0000","last_became_active":"2024-03-30T12:19:00.863991+0000","last_became_peered":"2024-03-30T12:19:00.863991+0000","last_unstale":"2024-03-30T12:20:36.002183+0000","last_undegraded":"2024-03-30T12:20:36.002183+0000","last_fullsized":"2024-03-30T12:20:36.002183+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:59:30.409530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010374+0000","last_change":"2024-03-30T12:19:00.875226+0000","last_active":"2024-03-30T12:20:36.010374+0000","last_peered":"2024-03-30T12:20:36.010374+0000","last_clean":"2024-03-30T12:20:36.010374+0000","last_became_active":"2024-03-30T12:19:00.874620+0000","last_became_peered":"2024-03-30T12:19:00.874620+0000","last_unstale":"2024-03-30T12:20:36.010374+0000","last_undegraded":"2024-03-30T12:20:36.010374+0000","last_fullsized":"2024-03-30T12:20:36.010374+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:58:40.881840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007746+0000","last_change":"2024-03-30T12:19:00.869363+0000","last_active":"2024-03-30T12:20:36.007746+0000","last_peered":"2024-03-30T12:20:36.007746+0000","last_clean":"2024-03-30T12:20:36.007746+0000","last_became_active":"2024-03-30T12:19:00.868887+0000","last_became_peered":"2024-03-30T12:19:00.868887+0000","last_unstale":"2024-03-30T12:20:36.007746+0000","last_undegraded":"2024-03-30T12:20:36.007746+0000","last_fullsized":"2024-03-30T12:20:36.007746+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:40:49.543161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007751+0000","last_change":"2024-03-30T12:19:00.863992+0000","last_active":"2024-03-30T12:20:36.007751+0000","last_peered":"2024-03-30T12:20:36.007751+0000","last_clean":"2024-03-30T12:20:36.007751+0000","last_became_active":"2024-03-30T12:19:00.863683+0000","last_became_peered":"2024-03-30T12:19:00.863683+0000","last_unstale":"2024-03-30T12:20:36.007751+0000","last_undegraded":"2024-03-30T12:20:36.007751+0000","last_fullsized":"2024-03-30T12:20:36.007751+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:40:36.734391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006652+0000","last_change":"2024-03-30T12:19:00.862541+0000","last_active":"2024-03-30T12:20:36.006652+0000","last_peered":"2024-03-30T12:20:36.006652+0000","last_clean":"2024-03-30T12:20:36.006652+0000","last_became_active":"2024-03-30T12:19:00.862084+0000","last_became_peered":"2024-03-30T12:19:00.862084+0000","last_unstale":"2024-03-30T12:20:36.006652+0000","last_undegraded":"2024-03-30T12:20:36.006652+0000","last_fullsized":"2024-03-30T12:20:36.006652+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:36.445232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003202+0000","last_change":"2024-03-30T12:19:00.850148+0000","last_active":"2024-03-30T12:20:36.003202+0000","last_peered":"2024-03-30T12:20:36.003202+0000","last_clean":"2024-03-30T12:20:36.003202+0000","last_became_active":"2024-03-30T12:19:00.849849+0000","last_became_peered":"2024-03-30T12:19:00.849849+0000","last_unstale":"2024-03-30T12:20:36.003202+0000","last_undegraded":"2024-03-30T12:20:36.003202+0000","last_fullsized":"2024-03-30T12:20:36.003202+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:55:56.657057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005013+0000","last_change":"2024-03-30T12:19:00.865479+0000","last_active":"2024-03-30T12:20:36.005013+0000","last_peered":"2024-03-30T12:20:36.005013+0000","last_clean":"2024-03-30T12:20:36.005013+0000","last_became_active":"2024-03-30T12:19:00.864441+0000","last_became_peered":"2024-03-30T12:19:00.864441+0000","last_unstale":"2024-03-30T12:20:36.005013+0000","last_undegraded":"2024-03-30T12:20:36.005013+0000","last_fullsized":"2024-03-30T12:20:36.005013+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:45:55.344815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004635+0000","last_change":"2024-03-30T12:19:00.866672+0000","last_active":"2024-03-30T12:20:36.004635+0000","last_peered":"2024-03-30T12:20:36.004635+0000","last_clean":"2024-03-30T12:20:36.004635+0000","last_became_active":"2024-03-30T12:19:00.866276+0000","last_became_peered":"2024-03-30T12:19:00.866276+0000","last_unstale":"2024-03-30T12:20:36.004635+0000","last_undegraded":"2024-03-30T12:20:36.004635+0000","last_fullsized":"2024-03-30T12:20:36.004635+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:23:49.856597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002869+0000","last_change":"2024-03-30T12:19:00.864760+0000","last_active":"2024-03-30T12:20:36.002869+0000","last_peered":"2024-03-30T12:20:36.002869+0000","last_clean":"2024-03-30T12:20:36.002869+0000","last_became_active":"2024-03-30T12:19:00.864447+0000","last_became_peered":"2024-03-30T12:19:00.864447+0000","last_unstale":"2024-03-30T12:20:36.002869+0000","last_undegraded":"2024-03-30T12:20:36.002869+0000","last_fullsized":"2024-03-30T12:20:36.002869+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:26:47.024806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003577+0000","last_change":"2024-03-30T12:19:00.863453+0000","last_active":"2024-03-30T12:20:36.003577+0000","last_peered":"2024-03-30T12:20:36.003577+0000","last_clean":"2024-03-30T12:20:36.003577+0000","last_became_active":"2024-03-30T12:19:00.863129+0000","last_became_peered":"2024-03-30T12:19:00.863129+0000","last_unstale":"2024-03-30T12:20:36.003577+0000","last_undegraded":"2024-03-30T12:20:36.003577+0000","last_fullsized":"2024-03-30T12:20:36.003577+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:19:33.658159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006652+0000","last_change":"2024-03-30T12:19:00.854527+0000","last_active":"2024-03-30T12:20:36.006652+0000","last_peered":"2024-03-30T12:20:36.006652+0000","last_clean":"2024-03-30T12:20:36.006652+0000","last_became_active":"2024-03-30T12:19:00.854238+0000","last_became_peered":"2024-03-30T12:19:00.854238+0000","last_unstale":"2024-03-30T12:20:36.006652+0000","last_undegraded":"2024-03-30T12:20:36.006652+0000","last_fullsized":"2024-03-30T12:20:36.006652+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:50:54.069856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.009897+0000","last_change":"2024-03-30T12:19:00.854461+0000","last_active":"2024-03-30T12:20:36.009897+0000","last_peered":"2024-03-30T12:20:36.009897+0000","last_clean":"2024-03-30T12:20:36.009897+0000","last_became_active":"2024-03-30T12:19:00.854077+0000","last_became_peered":"2024-03-30T12:19:00.854077+0000","last_unstale":"2024-03-30T12:20:36.009897+0000","last_undegraded":"2024-03-30T12:20:36.009897+0000","last_fullsized":"2024-03-30T12:20:36.009897+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:24:10.940443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"61'4","reported_seq":22,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006480+0000","last_change":"2024-03-30T12:19:00.466957+0000","last_active":"2024-03-30T12:20:36.006480+0000","last_peered":"2024-03-30T12:20:36.006480+0000","last_clean":"2024-03-30T12:20:36.006480+0000","last_became_active":"2024-03-30T12:19:00.466689+0000","last_became_peered":"2024-03-30T12:19:00.466689+0000","last_unstale":"2024-03-30T12:20:36.006480+0000","last_undegraded":"2024-03-30T12:20:36.006480+0000","last_fullsized":"2024-03-30T12:20:36.006480+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:08.774258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003497+0000","last_change":"2024-03-30T12:19:00.863714+0000","last_active":"2024-03-30T12:20:36.003497+0000","last_peered":"2024-03-30T12:20:36.003497+0000","last_clean":"2024-03-30T12:20:36.003497+0000","last_became_active":"2024-03-30T12:19:00.863429+0000","last_became_peered":"2024-03-30T12:19:00.863429+0000","last_unstale":"2024-03-30T12:20:36.003497+0000","last_undegraded":"2024-03-30T12:20:36.003497+0000","last_fullsized":"2024-03-30T12:20:36.003497+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:31.953173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"61'1","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003579+0000","last_change":"2024-03-30T12:19:00.459693+0000","last_active":"2024-03-30T12:20:36.003579+0000","last_peered":"2024-03-30T12:20:36.003579+0000","last_clean":"2024-03-30T12:20:36.003579+0000","last_became_active":"2024-03-30T12:19:00.459409+0000","last_became_peered":"2024-03-30T12:19:00.459409+0000","last_unstale":"2024-03-30T12:20:36.003579+0000","last_undegraded":"2024-03-30T12:20:36.003579+0000","last_fullsized":"2024-03-30T12:20:36.003579+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:27.891375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006265+0000","last_change":"2024-03-30T12:19:00.864952+0000","last_active":"2024-03-30T12:20:36.006265+0000","last_peered":"2024-03-30T12:20:36.006265+0000","last_clean":"2024-03-30T12:20:36.006265+0000","last_became_active":"2024-03-30T12:19:00.864274+0000","last_became_peered":"2024-03-30T12:19:00.864274+0000","last_unstale":"2024-03-30T12:20:36.006265+0000","last_undegraded":"2024-03-30T12:20:36.006265+0000","last_fullsized":"2024-03-30T12:20:36.006265+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:45:00.775246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010307+0000","last_change":"2024-03-30T12:19:00.469695+0000","last_active":"2024-03-30T12:20:36.010307+0000","last_peered":"2024-03-30T12:20:36.010307+0000","last_clean":"2024-03-30T12:20:36.010307+0000","last_became_active":"2024-03-30T12:19:00.469261+0000","last_became_peered":"2024-03-30T12:19:00.469261+0000","last_unstale":"2024-03-30T12:20:36.010307+0000","last_undegraded":"2024-03-30T12:20:36.010307+0000","last_fullsized":"2024-03-30T12:20:36.010307+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:02:43.407908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003603+0000","last_change":"2024-03-30T12:19:00.859422+0000","last_active":"2024-03-30T12:20:36.003603+0000","last_peered":"2024-03-30T12:20:36.003603+0000","last_clean":"2024-03-30T12:20:36.003603+0000","last_became_active":"2024-03-30T12:19:00.858880+0000","last_became_peered":"2024-03-30T12:19:00.858880+0000","last_unstale":"2024-03-30T12:20:36.003603+0000","last_undegraded":"2024-03-30T12:20:36.003603+0000","last_fullsized":"2024-03-30T12:20:36.003603+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:09.612172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010008+0000","last_change":"2024-03-30T12:19:00.467935+0000","last_active":"2024-03-30T12:20:36.010008+0000","last_peered":"2024-03-30T12:20:36.010008+0000","last_clean":"2024-03-30T12:20:36.010008+0000","last_became_active":"2024-03-30T12:19:00.467636+0000","last_became_peered":"2024-03-30T12:19:00.467636+0000","last_unstale":"2024-03-30T12:20:36.010008+0000","last_undegraded":"2024-03-30T12:20:36.010008+0000","last_fullsized":"2024-03-30T12:20:36.010008+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:49.599855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-30T12:20:37.241472+0000","last_change":"2024-03-30T12:20:37.241472+0000","last_active":"2024-03-30T12:20:37.241472+0000","last_peered":"2024-03-30T12:20:37.241472+0000","last_clean":"2024-03-30T12:20:37.241472+0000","last_became_active":"2024-03-30T12:20:37.241084+0000","last_became_peered":"2024-03-30T12:20:37.241084+0000","last_unstale":"2024-03-30T12:20:37.241472+0000","last_undegraded":"2024-03-30T12:20:37.241472+0000","last_fullsized":"2024-03-30T12:20:37.241472+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:40:48.055427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"61'1","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003349+0000","last_change":"2024-03-30T12:19:00.454521+0000","last_active":"2024-03-30T12:20:36.003349+0000","last_peered":"2024-03-30T12:20:36.003349+0000","last_clean":"2024-03-30T12:20:36.003349+0000","last_became_active":"2024-03-30T12:19:00.454213+0000","last_became_peered":"2024-03-30T12:19:00.454213+0000","last_unstale":"2024-03-30T12:20:36.003349+0000","last_undegraded":"2024-03-30T12:20:36.003349+0000","last_fullsized":"2024-03-30T12:20:36.003349+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:27:47.198072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006453+0000","last_change":"2024-03-30T12:19:00.860724+0000","last_active":"2024-03-30T12:20:36.006453+0000","last_peered":"2024-03-30T12:20:36.006453+0000","last_clean":"2024-03-30T12:20:36.006453+0000","last_became_active":"2024-03-30T12:19:00.860427+0000","last_became_peered":"2024-03-30T12:19:00.860427+0000","last_unstale":"2024-03-30T12:20:36.006453+0000","last_undegraded":"2024-03-30T12:20:36.006453+0000","last_fullsized":"2024-03-30T12:20:36.006453+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:55:54.757770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"61'1","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007243+0000","last_change":"2024-03-30T12:19:00.460150+0000","last_active":"2024-03-30T12:20:36.007243+0000","last_peered":"2024-03-30T12:20:36.007243+0000","last_clean":"2024-03-30T12:20:36.007243+0000","last_became_active":"2024-03-30T12:19:00.459740+0000","last_became_peered":"2024-03-30T12:19:00.459740+0000","last_unstale":"2024-03-30T12:20:36.007243+0000","last_undegraded":"2024-03-30T12:20:36.007243+0000","last_fullsized":"2024-03-30T12:20:36.007243+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:52:40.523467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005105+0000","last_change":"2024-03-30T12:19:00.857403+0000","last_active":"2024-03-30T12:20:36.005105+0000","last_peered":"2024-03-30T12:20:36.005105+0000","last_clean":"2024-03-30T12:20:36.005105+0000","last_became_active":"2024-03-30T12:19:00.856652+0000","last_became_peered":"2024-03-30T12:19:00.856652+0000","last_unstale":"2024-03-30T12:20:36.005105+0000","last_undegraded":"2024-03-30T12:20:36.005105+0000","last_fullsized":"2024-03-30T12:20:36.005105+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:51.932935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002446+0000","last_change":"2024-03-30T12:19:00.458253+0000","last_active":"2024-03-30T12:20:36.002446+0000","last_peered":"2024-03-30T12:20:36.002446+0000","last_clean":"2024-03-30T12:20:36.002446+0000","last_became_active":"2024-03-30T12:19:00.457947+0000","last_became_peered":"2024-03-30T12:19:00.457947+0000","last_unstale":"2024-03-30T12:20:36.002446+0000","last_undegraded":"2024-03-30T12:20:36.002446+0000","last_fullsized":"2024-03-30T12:20:36.002446+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:13:18.864198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002317+0000","last_change":"2024-03-30T12:19:00.859188+0000","last_active":"2024-03-30T12:20:36.002317+0000","last_peered":"2024-03-30T12:20:36.002317+0000","last_clean":"2024-03-30T12:20:36.002317+0000","last_became_active":"2024-03-30T12:19:00.858922+0000","last_became_peered":"2024-03-30T12:19:00.858922+0000","last_unstale":"2024-03-30T12:20:36.002317+0000","last_undegraded":"2024-03-30T12:20:36.002317+0000","last_fullsized":"2024-03-30T12:20:36.002317+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:56:16.965191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002925+0000","last_change":"2024-03-30T12:19:00.466729+0000","last_active":"2024-03-30T12:20:36.002925+0000","last_peered":"2024-03-30T12:20:36.002925+0000","last_clean":"2024-03-30T12:20:36.002925+0000","last_became_active":"2024-03-30T12:19:00.466086+0000","last_became_peered":"2024-03-30T12:19:00.466086+0000","last_unstale":"2024-03-30T12:20:36.002925+0000","last_undegraded":"2024-03-30T12:20:36.002925+0000","last_fullsized":"2024-03-30T12:20:36.002925+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:46:14.144417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004830+0000","last_change":"2024-03-30T12:19:00.863262+0000","last_active":"2024-03-30T12:20:36.004830+0000","last_peered":"2024-03-30T12:20:36.004830+0000","last_clean":"2024-03-30T12:20:36.004830+0000","last_became_active":"2024-03-30T12:19:00.861328+0000","last_became_peered":"2024-03-30T12:19:00.861328+0000","last_unstale":"2024-03-30T12:20:36.004830+0000","last_undegraded":"2024-03-30T12:20:36.004830+0000","last_fullsized":"2024-03-30T12:20:36.004830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:20:19.049967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007946+0000","last_change":"2024-03-30T12:19:00.459929+0000","last_active":"2024-03-30T12:20:36.007946+0000","last_peered":"2024-03-30T12:20:36.007946+0000","last_clean":"2024-03-30T12:20:36.007946+0000","last_became_active":"2024-03-30T12:19:00.459518+0000","last_became_peered":"2024-03-30T12:19:00.459518+0000","last_unstale":"2024-03-30T12:20:36.007946+0000","last_undegraded":"2024-03-30T12:20:36.007946+0000","last_fullsized":"2024-03-30T12:20:36.007946+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:09:03.990119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003517+0000","last_change":"2024-03-30T12:19:00.862112+0000","last_active":"2024-03-30T12:20:36.003517+0000","last_peered":"2024-03-30T12:20:36.003517+0000","last_clean":"2024-03-30T12:20:36.003517+0000","last_became_active":"2024-03-30T12:19:00.861782+0000","last_became_peered":"2024-03-30T12:19:00.861782+0000","last_unstale":"2024-03-30T12:20:36.003517+0000","last_undegraded":"2024-03-30T12:20:36.003517+0000","last_fullsized":"2024-03-30T12:20:36.003517+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:01:42.946530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003471+0000","last_change":"2024-03-30T12:19:00.463745+0000","last_active":"2024-03-30T12:20:36.003471+0000","last_peered":"2024-03-30T12:20:36.003471+0000","last_clean":"2024-03-30T12:20:36.003471+0000","last_became_active":"2024-03-30T12:19:00.462698+0000","last_became_peered":"2024-03-30T12:19:00.462698+0000","last_unstale":"2024-03-30T12:20:36.003471+0000","last_undegraded":"2024-03-30T12:20:36.003471+0000","last_fullsized":"2024-03-30T12:20:36.003471+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:09:33.196928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-30T12:20:37.009497+0000","last_change":"2024-03-30T12:20:37.009497+0000","last_active":"2024-03-30T12:20:37.009497+0000","last_peered":"2024-03-30T12:20:37.009497+0000","last_clean":"2024-03-30T12:20:37.009497+0000","last_became_active":"2024-03-30T12:20:37.009140+0000","last_became_peered":"2024-03-30T12:20:37.009140+0000","last_unstale":"2024-03-30T12:20:37.009497+0000","last_undegraded":"2024-03-30T12:20:37.009497+0000","last_fullsized":"2024-03-30T12:20:37.009497+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:01.772821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":21,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005122+0000","last_change":"2024-03-30T12:19:00.463581+0000","last_active":"2024-03-30T12:20:36.005122+0000","last_peered":"2024-03-30T12:20:36.005122+0000","last_clean":"2024-03-30T12:20:36.005122+0000","last_became_active":"2024-03-30T12:19:00.463280+0000","last_became_peered":"2024-03-30T12:19:00.463280+0000","last_unstale":"2024-03-30T12:20:36.005122+0000","last_undegraded":"2024-03-30T12:20:36.005122+0000","last_fullsized":"2024-03-30T12:20:36.005122+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:38:07.390655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006530+0000","last_change":"2024-03-30T12:19:00.878541+0000","last_active":"2024-03-30T12:20:36.006530+0000","last_peered":"2024-03-30T12:20:36.006530+0000","last_clean":"2024-03-30T12:20:36.006530+0000","last_became_active":"2024-03-30T12:19:00.878229+0000","last_became_peered":"2024-03-30T12:19:00.878229+0000","last_unstale":"2024-03-30T12:20:36.006530+0000","last_undegraded":"2024-03-30T12:20:36.006530+0000","last_fullsized":"2024-03-30T12:20:36.006530+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:03:18.020146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"65'9","reported_seq":27,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007527+0000","last_change":"2024-03-30T12:19:00.458102+0000","last_active":"2024-03-30T12:20:36.007527+0000","last_peered":"2024-03-30T12:20:36.007527+0000","last_clean":"2024-03-30T12:20:36.007527+0000","last_became_active":"2024-03-30T12:19:00.457759+0000","last_became_peered":"2024-03-30T12:19:00.457759+0000","last_unstale":"2024-03-30T12:20:36.007527+0000","last_undegraded":"2024-03-30T12:20:36.007527+0000","last_fullsized":"2024-03-30T12:20:36.007527+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:31.713303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2350,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010066+0000","last_change":"2024-03-30T12:19:00.872384+0000","last_active":"2024-03-30T12:20:36.010066+0000","last_peered":"2024-03-30T12:20:36.010066+0000","last_clean":"2024-03-30T12:20:36.010066+0000","last_became_active":"2024-03-30T12:19:00.872085+0000","last_became_peered":"2024-03-30T12:19:00.872085+0000","last_unstale":"2024-03-30T12:20:36.010066+0000","last_undegraded":"2024-03-30T12:20:36.010066+0000","last_fullsized":"2024-03-30T12:20:36.010066+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:47:42.278500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005329+0000","last_change":"2024-03-30T12:19:00.462939+0000","last_active":"2024-03-30T12:20:36.005329+0000","last_peered":"2024-03-30T12:20:36.005329+0000","last_clean":"2024-03-30T12:20:36.005329+0000","last_became_active":"2024-03-30T12:19:00.462637+0000","last_became_peered":"2024-03-30T12:19:00.462637+0000","last_unstale":"2024-03-30T12:20:36.005329+0000","last_undegraded":"2024-03-30T12:20:36.005329+0000","last_fullsized":"2024-03-30T12:20:36.005329+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:48:59.027106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004952+0000","last_change":"2024-03-30T12:19:00.856865+0000","last_active":"2024-03-30T12:20:36.004952+0000","last_peered":"2024-03-30T12:20:36.004952+0000","last_clean":"2024-03-30T12:20:36.004952+0000","last_became_active":"2024-03-30T12:19:00.856544+0000","last_became_peered":"2024-03-30T12:19:00.856544+0000","last_unstale":"2024-03-30T12:20:36.004952+0000","last_undegraded":"2024-03-30T12:20:36.004952+0000","last_fullsized":"2024-03-30T12:20:36.004952+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:37:39.901012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002977+0000","last_change":"2024-03-30T12:19:00.465931+0000","last_active":"2024-03-30T12:20:36.002977+0000","last_peered":"2024-03-30T12:20:36.002977+0000","last_clean":"2024-03-30T12:20:36.002977+0000","last_became_active":"2024-03-30T12:19:00.465589+0000","last_became_peered":"2024-03-30T12:19:00.465589+0000","last_unstale":"2024-03-30T12:20:36.002977+0000","last_undegraded":"2024-03-30T12:20:36.002977+0000","last_fullsized":"2024-03-30T12:20:36.002977+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:02:38.614924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.009910+0000","last_change":"2024-03-30T12:19:00.870798+0000","last_active":"2024-03-30T12:20:36.009910+0000","last_peered":"2024-03-30T12:20:36.009910+0000","last_clean":"2024-03-30T12:20:36.009910+0000","last_became_active":"2024-03-30T12:19:00.870507+0000","last_became_peered":"2024-03-30T12:19:00.870507+0000","last_unstale":"2024-03-30T12:20:36.009910+0000","last_undegraded":"2024-03-30T12:20:36.009910+0000","last_fullsized":"2024-03-30T12:20:36.009910+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:25:30.259298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006948+0000","last_change":"2024-03-30T12:19:00.454678+0000","last_active":"2024-03-30T12:20:36.006948+0000","last_peered":"2024-03-30T12:20:36.006948+0000","last_clean":"2024-03-30T12:20:36.006948+0000","last_became_active":"2024-03-30T12:19:00.454380+0000","last_became_peered":"2024-03-30T12:19:00.454380+0000","last_unstale":"2024-03-30T12:20:36.006948+0000","last_undegraded":"2024-03-30T12:20:36.006948+0000","last_fullsized":"2024-03-30T12:20:36.006948+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:08:24.640327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005827+0000","last_change":"2024-03-30T12:19:00.861547+0000","last_active":"2024-03-30T12:20:36.005827+0000","last_peered":"2024-03-30T12:20:36.005827+0000","last_clean":"2024-03-30T12:20:36.005827+0000","last_became_active":"2024-03-30T12:19:00.861268+0000","last_became_peered":"2024-03-30T12:19:00.861268+0000","last_unstale":"2024-03-30T12:20:36.005827+0000","last_undegraded":"2024-03-30T12:20:36.005827+0000","last_fullsized":"2024-03-30T12:20:36.005827+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:28:37.342309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":26,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005972+0000","last_change":"2024-03-30T12:19:00.460090+0000","last_active":"2024-03-30T12:20:36.005972+0000","last_peered":"2024-03-30T12:20:36.005972+0000","last_clean":"2024-03-30T12:20:36.005972+0000","last_became_active":"2024-03-30T12:19:00.459790+0000","last_became_peered":"2024-03-30T12:19:00.459790+0000","last_unstale":"2024-03-30T12:20:36.005972+0000","last_undegraded":"2024-03-30T12:20:36.005972+0000","last_fullsized":"2024-03-30T12:20:36.005972+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:38.860631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.009575+0000","last_change":"2024-03-30T12:19:00.870061+0000","last_active":"2024-03-30T12:20:36.009575+0000","last_peered":"2024-03-30T12:20:36.009575+0000","last_clean":"2024-03-30T12:20:36.009575+0000","last_became_active":"2024-03-30T12:19:00.869750+0000","last_became_peered":"2024-03-30T12:19:00.869750+0000","last_unstale":"2024-03-30T12:20:36.009575+0000","last_undegraded":"2024-03-30T12:20:36.009575+0000","last_fullsized":"2024-03-30T12:20:36.009575+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:03:02.790151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"61'1","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006238+0000","last_change":"2024-03-30T12:19:00.461178+0000","last_active":"2024-03-30T12:20:36.006238+0000","last_peered":"2024-03-30T12:20:36.006238+0000","last_clean":"2024-03-30T12:20:36.006238+0000","last_became_active":"2024-03-30T12:19:00.460817+0000","last_became_peered":"2024-03-30T12:19:00.460817+0000","last_unstale":"2024-03-30T12:20:36.006238+0000","last_undegraded":"2024-03-30T12:20:36.006238+0000","last_fullsized":"2024-03-30T12:20:36.006238+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:30:59.255694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010218+0000","last_change":"2024-03-30T12:19:00.871828+0000","last_active":"2024-03-30T12:20:36.010218+0000","last_peered":"2024-03-30T12:20:36.010218+0000","last_clean":"2024-03-30T12:20:36.010218+0000","last_became_active":"2024-03-30T12:19:00.871555+0000","last_became_peered":"2024-03-30T12:19:00.871555+0000","last_unstale":"2024-03-30T12:20:36.010218+0000","last_undegraded":"2024-03-30T12:20:36.010218+0000","last_fullsized":"2024-03-30T12:20:36.010218+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:02:53.212521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.008100+0000","last_change":"2024-03-30T12:19:35.161648+0000","last_active":"2024-03-30T12:20:36.008100+0000","last_peered":"2024-03-30T12:20:36.008100+0000","last_clean":"2024-03-30T12:20:36.008100+0000","last_became_active":"2024-03-30T12:19:35.161426+0000","last_became_peered":"2024-03-30T12:19:35.161426+0000","last_unstale":"2024-03-30T12:20:36.008100+0000","last_undegraded":"2024-03-30T12:20:36.008100+0000","last_fullsized":"2024-03-30T12:20:36.008100+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:05:56.726860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004909+0000","last_change":"2024-03-30T12:19:00.462709+0000","last_active":"2024-03-30T12:20:36.004909+0000","last_peered":"2024-03-30T12:20:36.004909+0000","last_clean":"2024-03-30T12:20:36.004909+0000","last_became_active":"2024-03-30T12:19:00.462429+0000","last_became_peered":"2024-03-30T12:19:00.462429+0000","last_unstale":"2024-03-30T12:20:36.004909+0000","last_undegraded":"2024-03-30T12:20:36.004909+0000","last_fullsized":"2024-03-30T12:20:36.004909+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:29.579526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003518+0000","last_change":"2024-03-30T12:19:00.854025+0000","last_active":"2024-03-30T12:20:36.003518+0000","last_peered":"2024-03-30T12:20:36.003518+0000","last_clean":"2024-03-30T12:20:36.003518+0000","last_became_active":"2024-03-30T12:19:00.853714+0000","last_became_peered":"2024-03-30T12:19:00.853714+0000","last_unstale":"2024-03-30T12:20:36.003518+0000","last_undegraded":"2024-03-30T12:20:36.003518+0000","last_fullsized":"2024-03-30T12:20:36.003518+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:27:34.498087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004908+0000","last_change":"2024-03-30T12:19:35.051431+0000","last_active":"2024-03-30T12:20:36.004908+0000","last_peered":"2024-03-30T12:20:36.004908+0000","last_clean":"2024-03-30T12:20:36.004908+0000","last_became_active":"2024-03-30T12:19:35.050880+0000","last_became_peered":"2024-03-30T12:19:35.050880+0000","last_unstale":"2024-03-30T12:20:36.004908+0000","last_undegraded":"2024-03-30T12:20:36.004908+0000","last_fullsized":"2024-03-30T12:20:36.004908+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:57:58.075785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002920+0000","last_change":"2024-03-30T12:19:00.457612+0000","last_active":"2024-03-30T12:20:36.002920+0000","last_peered":"2024-03-30T12:20:36.002920+0000","last_clean":"2024-03-30T12:20:36.002920+0000","last_became_active":"2024-03-30T12:19:00.457289+0000","last_became_peered":"2024-03-30T12:19:00.457289+0000","last_unstale":"2024-03-30T12:20:36.002920+0000","last_undegraded":"2024-03-30T12:20:36.002920+0000","last_fullsized":"2024-03-30T12:20:36.002920+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:23.011997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006358+0000","last_change":"2024-03-30T12:19:00.866070+0000","last_active":"2024-03-30T12:20:36.006358+0000","last_peered":"2024-03-30T12:20:36.006358+0000","last_clean":"2024-03-30T12:20:36.006358+0000","last_became_active":"2024-03-30T12:19:00.865706+0000","last_became_peered":"2024-03-30T12:19:00.865706+0000","last_unstale":"2024-03-30T12:20:36.006358+0000","last_undegraded":"2024-03-30T12:20:36.006358+0000","last_fullsized":"2024-03-30T12:20:36.006358+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:56:01.599580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006959+0000","last_change":"2024-03-30T12:19:35.162695+0000","last_active":"2024-03-30T12:20:36.006959+0000","last_peered":"2024-03-30T12:20:36.006959+0000","last_clean":"2024-03-30T12:20:36.006959+0000","last_became_active":"2024-03-30T12:19:35.162389+0000","last_became_peered":"2024-03-30T12:19:35.162389+0000","last_unstale":"2024-03-30T12:20:36.006959+0000","last_undegraded":"2024-03-30T12:20:36.006959+0000","last_fullsized":"2024-03-30T12:20:36.006959+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:20:43.739417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004567+0000","last_change":"2024-03-30T12:19:00.861917+0000","last_active":"2024-03-30T12:20:36.004567+0000","last_peered":"2024-03-30T12:20:36.004567+0000","last_clean":"2024-03-30T12:20:36.004567+0000","last_became_active":"2024-03-30T12:19:00.860645+0000","last_became_peered":"2024-03-30T12:19:00.860645+0000","last_unstale":"2024-03-30T12:20:36.004567+0000","last_undegraded":"2024-03-30T12:20:36.004567+0000","last_fullsized":"2024-03-30T12:20:36.004567+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:30:51.438018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005814+0000","last_change":"2024-03-30T12:19:00.459145+0000","last_active":"2024-03-30T12:20:36.005814+0000","last_peered":"2024-03-30T12:20:36.005814+0000","last_clean":"2024-03-30T12:20:36.005814+0000","last_became_active":"2024-03-30T12:19:00.457819+0000","last_became_peered":"2024-03-30T12:19:00.457819+0000","last_unstale":"2024-03-30T12:20:36.005814+0000","last_undegraded":"2024-03-30T12:20:36.005814+0000","last_fullsized":"2024-03-30T12:20:36.005814+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:44:38.245366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007538+0000","last_change":"2024-03-30T12:19:35.161274+0000","last_active":"2024-03-30T12:20:36.007538+0000","last_peered":"2024-03-30T12:20:36.007538+0000","last_clean":"2024-03-30T12:20:36.007538+0000","last_became_active":"2024-03-30T12:19:35.160985+0000","last_became_peered":"2024-03-30T12:19:35.160985+0000","last_unstale":"2024-03-30T12:20:36.007538+0000","last_undegraded":"2024-03-30T12:20:36.007538+0000","last_fullsized":"2024-03-30T12:20:36.007538+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:07.499529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002517+0000","last_change":"2024-03-30T12:19:00.862340+0000","last_active":"2024-03-30T12:20:36.002517+0000","last_peered":"2024-03-30T12:20:36.002517+0000","last_clean":"2024-03-30T12:20:36.002517+0000","last_became_active":"2024-03-30T12:19:00.861413+0000","last_became_peered":"2024-03-30T12:19:00.861413+0000","last_unstale":"2024-03-30T12:20:36.002517+0000","last_undegraded":"2024-03-30T12:20:36.002517+0000","last_fullsized":"2024-03-30T12:20:36.002517+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:13:39.199499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003089+0000","last_change":"2024-03-30T12:19:00.465946+0000","last_active":"2024-03-30T12:20:36.003089+0000","last_peered":"2024-03-30T12:20:36.003089+0000","last_clean":"2024-03-30T12:20:36.003089+0000","last_became_active":"2024-03-30T12:19:00.465618+0000","last_became_peered":"2024-03-30T12:19:00.465618+0000","last_unstale":"2024-03-30T12:20:36.003089+0000","last_undegraded":"2024-03-30T12:20:36.003089+0000","last_fullsized":"2024-03-30T12:20:36.003089+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:58:42.109572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"66'128","reported_seq":265,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.009454+0000","last_change":"2024-03-30T12:18:45.912869+0000","last_active":"2024-03-30T12:20:36.009454+0000","last_peered":"2024-03-30T12:20:36.009454+0000","last_clean":"2024-03-30T12:20:36.009454+0000","last_became_active":"2024-03-30T12:18:45.912395+0000","last_became_peered":"2024-03-30T12:18:45.912395+0000","last_unstale":"2024-03-30T12:20:36.009454+0000","last_undegraded":"2024-03-30T12:20:36.009454+0000","last_fullsized":"2024-03-30T12:20:36.009454+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:34.485283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006349+0000","last_change":"2024-03-30T12:19:35.052180+0000","last_active":"2024-03-30T12:20:36.006349+0000","last_peered":"2024-03-30T12:20:36.006349+0000","last_clean":"2024-03-30T12:20:36.006349+0000","last_became_active":"2024-03-30T12:19:35.051577+0000","last_became_peered":"2024-03-30T12:19:35.051577+0000","last_unstale":"2024-03-30T12:20:36.006349+0000","last_undegraded":"2024-03-30T12:20:36.006349+0000","last_fullsized":"2024-03-30T12:20:36.006349+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:26:43.695424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004800+0000","last_change":"2024-03-30T12:19:00.852506+0000","last_active":"2024-03-30T12:20:36.004800+0000","last_peered":"2024-03-30T12:20:36.004800+0000","last_clean":"2024-03-30T12:20:36.004800+0000","last_became_active":"2024-03-30T12:19:00.852216+0000","last_became_peered":"2024-03-30T12:19:00.852216+0000","last_unstale":"2024-03-30T12:20:36.004800+0000","last_undegraded":"2024-03-30T12:20:36.004800+0000","last_fullsized":"2024-03-30T12:20:36.004800+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:41:21.462303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.009325+0000","last_change":"2024-03-30T12:19:00.470266+0000","last_active":"2024-03-30T12:20:36.009325+0000","last_peered":"2024-03-30T12:20:36.009325+0000","last_clean":"2024-03-30T12:20:36.009325+0000","last_became_active":"2024-03-30T12:19:00.469541+0000","last_became_peered":"2024-03-30T12:19:00.469541+0000","last_unstale":"2024-03-30T12:20:36.009325+0000","last_undegraded":"2024-03-30T12:20:36.009325+0000","last_fullsized":"2024-03-30T12:20:36.009325+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:57.244620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005044+0000","last_change":"2024-03-30T12:19:35.162977+0000","last_active":"2024-03-30T12:20:36.005044+0000","last_peered":"2024-03-30T12:20:36.005044+0000","last_clean":"2024-03-30T12:20:36.005044+0000","last_became_active":"2024-03-30T12:19:35.162514+0000","last_became_peered":"2024-03-30T12:19:35.162514+0000","last_unstale":"2024-03-30T12:20:36.005044+0000","last_undegraded":"2024-03-30T12:20:36.005044+0000","last_fullsized":"2024-03-30T12:20:36.005044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:39:43.550849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010313+0000","last_change":"2024-03-30T12:19:00.469567+0000","last_active":"2024-03-30T12:20:36.010313+0000","last_peered":"2024-03-30T12:20:36.010313+0000","last_clean":"2024-03-30T12:20:36.010313+0000","last_became_active":"2024-03-30T12:19:00.469218+0000","last_became_peered":"2024-03-30T12:19:00.469218+0000","last_unstale":"2024-03-30T12:20:36.010313+0000","last_undegraded":"2024-03-30T12:20:36.010313+0000","last_fullsized":"2024-03-30T12:20:36.010313+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:16:05.609865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004993+0000","last_change":"2024-03-30T12:19:00.865798+0000","last_active":"2024-03-30T12:20:36.004993+0000","last_peered":"2024-03-30T12:20:36.004993+0000","last_clean":"2024-03-30T12:20:36.004993+0000","last_became_active":"2024-03-30T12:19:00.865518+0000","last_became_peered":"2024-03-30T12:19:00.865518+0000","last_unstale":"2024-03-30T12:20:36.004993+0000","last_undegraded":"2024-03-30T12:20:36.004993+0000","last_fullsized":"2024-03-30T12:20:36.004993+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:47:41.818140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002238+0000","last_change":"2024-03-30T12:19:35.162768+0000","last_active":"2024-03-30T12:20:36.002238+0000","last_peered":"2024-03-30T12:20:36.002238+0000","last_clean":"2024-03-30T12:20:36.002238+0000","last_became_active":"2024-03-30T12:19:35.162480+0000","last_became_peered":"2024-03-30T12:19:35.162480+0000","last_unstale":"2024-03-30T12:20:36.002238+0000","last_undegraded":"2024-03-30T12:20:36.002238+0000","last_fullsized":"2024-03-30T12:20:36.002238+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:17:01.235481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"62'1","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005424+0000","last_change":"2024-03-30T12:19:00.454554+0000","last_active":"2024-03-30T12:20:36.005424+0000","last_peered":"2024-03-30T12:20:36.005424+0000","last_clean":"2024-03-30T12:20:36.005424+0000","last_became_active":"2024-03-30T12:19:00.454233+0000","last_became_peered":"2024-03-30T12:19:00.454233+0000","last_unstale":"2024-03-30T12:20:36.005424+0000","last_undegraded":"2024-03-30T12:20:36.005424+0000","last_fullsized":"2024-03-30T12:20:36.005424+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:05:09.010127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003621+0000","last_change":"2024-03-30T12:19:00.853806+0000","last_active":"2024-03-30T12:20:36.003621+0000","last_peered":"2024-03-30T12:20:36.003621+0000","last_clean":"2024-03-30T12:20:36.003621+0000","last_became_active":"2024-03-30T12:19:00.853538+0000","last_became_peered":"2024-03-30T12:19:00.853538+0000","last_unstale":"2024-03-30T12:20:36.003621+0000","last_undegraded":"2024-03-30T12:20:36.003621+0000","last_fullsized":"2024-03-30T12:20:36.003621+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:36:10.741436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006059+0000","last_change":"2024-03-30T12:19:35.162679+0000","last_active":"2024-03-30T12:20:36.006059+0000","last_peered":"2024-03-30T12:20:36.006059+0000","last_clean":"2024-03-30T12:20:36.006059+0000","last_became_active":"2024-03-30T12:19:35.162347+0000","last_became_peered":"2024-03-30T12:19:35.162347+0000","last_unstale":"2024-03-30T12:20:36.006059+0000","last_undegraded":"2024-03-30T12:20:36.006059+0000","last_fullsized":"2024-03-30T12:20:36.006059+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:24:16.565563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007662+0000","last_change":"2024-03-30T12:19:00.460279+0000","last_active":"2024-03-30T12:20:36.007662+0000","last_peered":"2024-03-30T12:20:36.007662+0000","last_clean":"2024-03-30T12:20:36.007662+0000","last_became_active":"2024-03-30T12:19:00.459948+0000","last_became_peered":"2024-03-30T12:19:00.459948+0000","last_unstale":"2024-03-30T12:20:36.007662+0000","last_undegraded":"2024-03-30T12:20:36.007662+0000","last_fullsized":"2024-03-30T12:20:36.007662+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:06.870147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006440+0000","last_change":"2024-03-30T12:19:00.853029+0000","last_active":"2024-03-30T12:20:36.006440+0000","last_peered":"2024-03-30T12:20:36.006440+0000","last_clean":"2024-03-30T12:20:36.006440+0000","last_became_active":"2024-03-30T12:19:00.852755+0000","last_became_peered":"2024-03-30T12:19:00.852755+0000","last_unstale":"2024-03-30T12:20:36.006440+0000","last_undegraded":"2024-03-30T12:20:36.006440+0000","last_fullsized":"2024-03-30T12:20:36.006440+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:03:44.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.009471+0000","last_change":"2024-03-30T12:19:00.470521+0000","last_active":"2024-03-30T12:20:36.009471+0000","last_peered":"2024-03-30T12:20:36.009471+0000","last_clean":"2024-03-30T12:20:36.009471+0000","last_became_active":"2024-03-30T12:19:00.469910+0000","last_became_peered":"2024-03-30T12:19:00.469910+0000","last_unstale":"2024-03-30T12:20:36.009471+0000","last_undegraded":"2024-03-30T12:20:36.009471+0000","last_fullsized":"2024-03-30T12:20:36.009471+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:12:52.044394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006007+0000","last_change":"2024-03-30T12:19:00.877240+0000","last_active":"2024-03-30T12:20:36.006007+0000","last_peered":"2024-03-30T12:20:36.006007+0000","last_clean":"2024-03-30T12:20:36.006007+0000","last_became_active":"2024-03-30T12:19:00.876739+0000","last_became_peered":"2024-03-30T12:19:00.876739+0000","last_unstale":"2024-03-30T12:20:36.006007+0000","last_undegraded":"2024-03-30T12:20:36.006007+0000","last_fullsized":"2024-03-30T12:20:36.006007+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:25.328486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004711+0000","last_change":"2024-03-30T12:19:00.459528+0000","last_active":"2024-03-30T12:20:36.004711+0000","last_peered":"2024-03-30T12:20:36.004711+0000","last_clean":"2024-03-30T12:20:36.004711+0000","last_became_active":"2024-03-30T12:19:00.459223+0000","last_became_peered":"2024-03-30T12:19:00.459223+0000","last_unstale":"2024-03-30T12:20:36.004711+0000","last_undegraded":"2024-03-30T12:20:36.004711+0000","last_fullsized":"2024-03-30T12:20:36.004711+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:44.399783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002268+0000","last_change":"2024-03-30T12:19:00.850810+0000","last_active":"2024-03-30T12:20:36.002268+0000","last_peered":"2024-03-30T12:20:36.002268+0000","last_clean":"2024-03-30T12:20:36.002268+0000","last_became_active":"2024-03-30T12:19:00.850530+0000","last_became_peered":"2024-03-30T12:19:00.850530+0000","last_unstale":"2024-03-30T12:20:36.002268+0000","last_undegraded":"2024-03-30T12:20:36.002268+0000","last_fullsized":"2024-03-30T12:20:36.002268+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:52:32.869322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":27,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-30T12:20:37.009330+0000","last_change":"2024-03-30T12:20:37.009330+0000","last_active":"2024-03-30T12:20:37.009330+0000","last_peered":"2024-03-30T12:20:37.009330+0000","last_clean":"2024-03-30T12:20:37.009330+0000","last_became_active":"2024-03-30T12:20:37.008926+0000","last_became_peered":"2024-03-30T12:20:37.008926+0000","last_unstale":"2024-03-30T12:20:37.009330+0000","last_undegraded":"2024-03-30T12:20:37.009330+0000","last_fullsized":"2024-03-30T12:20:37.009330+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:39.113599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003395+0000","last_change":"2024-03-30T12:19:00.858733+0000","last_active":"2024-03-30T12:20:36.003395+0000","last_peered":"2024-03-30T12:20:36.003395+0000","last_clean":"2024-03-30T12:20:36.003395+0000","last_became_active":"2024-03-30T12:19:00.858419+0000","last_became_peered":"2024-03-30T12:19:00.858419+0000","last_unstale":"2024-03-30T12:20:36.003395+0000","last_undegraded":"2024-03-30T12:20:36.003395+0000","last_fullsized":"2024-03-30T12:20:36.003395+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:43.731796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"61'2","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.009844+0000","last_change":"2024-03-30T12:19:00.468017+0000","last_active":"2024-03-30T12:20:36.009844+0000","last_peered":"2024-03-30T12:20:36.009844+0000","last_clean":"2024-03-30T12:20:36.009844+0000","last_became_active":"2024-03-30T12:19:00.466979+0000","last_became_peered":"2024-03-30T12:19:00.466979+0000","last_unstale":"2024-03-30T12:20:36.009844+0000","last_undegraded":"2024-03-30T12:20:36.009844+0000","last_fullsized":"2024-03-30T12:20:36.009844+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:41:36.480109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007191+0000","last_change":"2024-03-30T12:19:00.869001+0000","last_active":"2024-03-30T12:20:36.007191+0000","last_peered":"2024-03-30T12:20:36.007191+0000","last_clean":"2024-03-30T12:20:36.007191+0000","last_became_active":"2024-03-30T12:19:00.868645+0000","last_became_peered":"2024-03-30T12:19:00.868645+0000","last_unstale":"2024-03-30T12:20:36.007191+0000","last_undegraded":"2024-03-30T12:20:36.007191+0000","last_fullsized":"2024-03-30T12:20:36.007191+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:54:10.778279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006475+0000","last_change":"2024-03-30T12:19:00.459171+0000","last_active":"2024-03-30T12:20:36.006475+0000","last_peered":"2024-03-30T12:20:36.006475+0000","last_clean":"2024-03-30T12:20:36.006475+0000","last_became_active":"2024-03-30T12:19:00.458925+0000","last_became_peered":"2024-03-30T12:19:00.458925+0000","last_unstale":"2024-03-30T12:20:36.006475+0000","last_undegraded":"2024-03-30T12:20:36.006475+0000","last_fullsized":"2024-03-30T12:20:36.006475+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:26:20.974369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010188+0000","last_change":"2024-03-30T12:19:00.875558+0000","last_active":"2024-03-30T12:20:36.010188+0000","last_peered":"2024-03-30T12:20:36.010188+0000","last_clean":"2024-03-30T12:20:36.010188+0000","last_became_active":"2024-03-30T12:19:00.875216+0000","last_became_peered":"2024-03-30T12:19:00.875216+0000","last_unstale":"2024-03-30T12:20:36.010188+0000","last_undegraded":"2024-03-30T12:20:36.010188+0000","last_fullsized":"2024-03-30T12:20:36.010188+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:27:04.763910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"61'1","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005078+0000","last_change":"2024-03-30T12:19:00.459545+0000","last_active":"2024-03-30T12:20:36.005078+0000","last_peered":"2024-03-30T12:20:36.005078+0000","last_clean":"2024-03-30T12:20:36.005078+0000","last_became_active":"2024-03-30T12:19:00.459250+0000","last_became_peered":"2024-03-30T12:19:00.459250+0000","last_unstale":"2024-03-30T12:20:36.005078+0000","last_undegraded":"2024-03-30T12:20:36.005078+0000","last_fullsized":"2024-03-30T12:20:36.005078+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:38.112815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003319+0000","last_change":"2024-03-30T12:19:00.852558+0000","last_active":"2024-03-30T12:20:36.003319+0000","last_peered":"2024-03-30T12:20:36.003319+0000","last_clean":"2024-03-30T12:20:36.003319+0000","last_became_active":"2024-03-30T12:19:00.852250+0000","last_became_peered":"2024-03-30T12:19:00.852250+0000","last_unstale":"2024-03-30T12:20:36.003319+0000","last_undegraded":"2024-03-30T12:20:36.003319+0000","last_fullsized":"2024-03-30T12:20:36.003319+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:57:15.989801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"61'2","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006568+0000","last_change":"2024-03-30T12:19:00.464968+0000","last_active":"2024-03-30T12:20:36.006568+0000","last_peered":"2024-03-30T12:20:36.006568+0000","last_clean":"2024-03-30T12:20:36.006568+0000","last_became_active":"2024-03-30T12:19:00.464021+0000","last_became_peered":"2024-03-30T12:19:00.464021+0000","last_unstale":"2024-03-30T12:20:36.006568+0000","last_undegraded":"2024-03-30T12:20:36.006568+0000","last_fullsized":"2024-03-30T12:20:36.006568+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:20.224884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010284+0000","last_change":"2024-03-30T12:19:00.871645+0000","last_active":"2024-03-30T12:20:36.010284+0000","last_peered":"2024-03-30T12:20:36.010284+0000","last_clean":"2024-03-30T12:20:36.010284+0000","last_became_active":"2024-03-30T12:19:00.871376+0000","last_became_peered":"2024-03-30T12:19:00.871376+0000","last_unstale":"2024-03-30T12:20:36.010284+0000","last_undegraded":"2024-03-30T12:20:36.010284+0000","last_fullsized":"2024-03-30T12:20:36.010284+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:54:57.281972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005731+0000","last_change":"2024-03-30T12:19:00.862859+0000","last_active":"2024-03-30T12:20:36.005731+0000","last_peered":"2024-03-30T12:20:36.005731+0000","last_clean":"2024-03-30T12:20:36.005731+0000","last_became_active":"2024-03-30T12:19:00.862535+0000","last_became_peered":"2024-03-30T12:19:00.862535+0000","last_unstale":"2024-03-30T12:20:36.005731+0000","last_undegraded":"2024-03-30T12:20:36.005731+0000","last_fullsized":"2024-03-30T12:20:36.005731+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:17:31.462763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005669+0000","last_change":"2024-03-30T12:19:00.862947+0000","last_active":"2024-03-30T12:20:36.005669+0000","last_peered":"2024-03-30T12:20:36.005669+0000","last_clean":"2024-03-30T12:20:36.005669+0000","last_became_active":"2024-03-30T12:19:00.862567+0000","last_became_peered":"2024-03-30T12:19:00.862567+0000","last_unstale":"2024-03-30T12:20:36.005669+0000","last_undegraded":"2024-03-30T12:20:36.005669+0000","last_fullsized":"2024-03-30T12:20:36.005669+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:55:05.422370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003048+0000","last_change":"2024-03-30T12:19:00.856869+0000","last_active":"2024-03-30T12:20:36.003048+0000","last_peered":"2024-03-30T12:20:36.003048+0000","last_clean":"2024-03-30T12:20:36.003048+0000","last_became_active":"2024-03-30T12:19:00.856525+0000","last_became_peered":"2024-03-30T12:19:00.856525+0000","last_unstale":"2024-03-30T12:20:36.003048+0000","last_undegraded":"2024-03-30T12:20:36.003048+0000","last_fullsized":"2024-03-30T12:20:36.003048+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:01:47.443294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005121+0000","last_change":"2024-03-30T12:19:00.859724+0000","last_active":"2024-03-30T12:20:36.005121+0000","last_peered":"2024-03-30T12:20:36.005121+0000","last_clean":"2024-03-30T12:20:36.005121+0000","last_became_active":"2024-03-30T12:19:00.859327+0000","last_became_peered":"2024-03-30T12:19:00.859327+0000","last_unstale":"2024-03-30T12:20:36.005121+0000","last_undegraded":"2024-03-30T12:20:36.005121+0000","last_fullsized":"2024-03-30T12:20:36.005121+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:53:15.692683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-30T12:20:37.009224+0000","last_change":"2024-03-30T12:20:37.009224+0000","last_active":"2024-03-30T12:20:37.009224+0000","last_peered":"2024-03-30T12:20:37.009224+0000","last_clean":"2024-03-30T12:20:37.009224+0000","last_became_active":"2024-03-30T12:20:37.008947+0000","last_became_peered":"2024-03-30T12:20:37.008947+0000","last_unstale":"2024-03-30T12:20:37.009224+0000","last_undegraded":"2024-03-30T12:20:37.009224+0000","last_fullsized":"2024-03-30T12:20:37.009224+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:42:16.251343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005045+0000","last_change":"2024-03-30T12:19:00.848297+0000","last_active":"2024-03-30T12:20:36.005045+0000","last_peered":"2024-03-30T12:20:36.005045+0000","last_clean":"2024-03-30T12:20:36.005045+0000","last_became_active":"2024-03-30T12:19:00.848029+0000","last_became_peered":"2024-03-30T12:19:00.848029+0000","last_unstale":"2024-03-30T12:20:36.005045+0000","last_undegraded":"2024-03-30T12:20:36.005045+0000","last_fullsized":"2024-03-30T12:20:36.005045+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:38.617413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007908+0000","last_change":"2024-03-30T12:19:00.869414+0000","last_active":"2024-03-30T12:20:36.007908+0000","last_peered":"2024-03-30T12:20:36.007908+0000","last_clean":"2024-03-30T12:20:36.007908+0000","last_became_active":"2024-03-30T12:19:00.869115+0000","last_became_peered":"2024-03-30T12:19:00.869115+0000","last_unstale":"2024-03-30T12:20:36.007908+0000","last_undegraded":"2024-03-30T12:20:36.007908+0000","last_fullsized":"2024-03-30T12:20:36.007908+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:01:12.173692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004112+0000","last_change":"2024-03-30T12:19:00.856088+0000","last_active":"2024-03-30T12:20:36.004112+0000","last_peered":"2024-03-30T12:20:36.004112+0000","last_clean":"2024-03-30T12:20:36.004112+0000","last_became_active":"2024-03-30T12:19:00.855480+0000","last_became_peered":"2024-03-30T12:19:00.855480+0000","last_unstale":"2024-03-30T12:20:36.004112+0000","last_undegraded":"2024-03-30T12:20:36.004112+0000","last_fullsized":"2024-03-30T12:20:36.004112+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:21:16.961559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002998+0000","last_change":"2024-03-30T12:19:00.854668+0000","last_active":"2024-03-30T12:20:36.002998+0000","last_peered":"2024-03-30T12:20:36.002998+0000","last_clean":"2024-03-30T12:20:36.002998+0000","last_became_active":"2024-03-30T12:19:00.854390+0000","last_became_peered":"2024-03-30T12:19:00.854390+0000","last_unstale":"2024-03-30T12:20:36.002998+0000","last_undegraded":"2024-03-30T12:20:36.002998+0000","last_fullsized":"2024-03-30T12:20:36.002998+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:39:22.128098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002372+0000","last_change":"2024-03-30T12:19:00.851282+0000","last_active":"2024-03-30T12:20:36.002372+0000","last_peered":"2024-03-30T12:20:36.002372+0000","last_clean":"2024-03-30T12:20:36.002372+0000","last_became_active":"2024-03-30T12:19:00.850915+0000","last_became_peered":"2024-03-30T12:19:00.850915+0000","last_unstale":"2024-03-30T12:20:36.002372+0000","last_undegraded":"2024-03-30T12:20:36.002372+0000","last_fullsized":"2024-03-30T12:20:36.002372+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:46:50.526568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003102+0000","last_change":"2024-03-30T12:19:00.860406+0000","last_active":"2024-03-30T12:20:36.003102+0000","last_peered":"2024-03-30T12:20:36.003102+0000","last_clean":"2024-03-30T12:20:36.003102+0000","last_became_active":"2024-03-30T12:19:00.860085+0000","last_became_peered":"2024-03-30T12:19:00.860085+0000","last_unstale":"2024-03-30T12:20:36.003102+0000","last_undegraded":"2024-03-30T12:20:36.003102+0000","last_fullsized":"2024-03-30T12:20:36.003102+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:32.201939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005496+0000","last_change":"2024-03-30T12:19:00.856917+0000","last_active":"2024-03-30T12:20:36.005496+0000","last_peered":"2024-03-30T12:20:36.005496+0000","last_clean":"2024-03-30T12:20:36.005496+0000","last_became_active":"2024-03-30T12:19:00.856643+0000","last_became_peered":"2024-03-30T12:19:00.856643+0000","last_unstale":"2024-03-30T12:20:36.005496+0000","last_undegraded":"2024-03-30T12:20:36.005496+0000","last_fullsized":"2024-03-30T12:20:36.005496+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:51:53.996045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007615+0000","last_change":"2024-03-30T12:19:00.867176+0000","last_active":"2024-03-30T12:20:36.007615+0000","last_peered":"2024-03-30T12:20:36.007615+0000","last_clean":"2024-03-30T12:20:36.007615+0000","last_became_active":"2024-03-30T12:19:00.866801+0000","last_became_peered":"2024-03-30T12:19:00.866801+0000","last_unstale":"2024-03-30T12:20:36.007615+0000","last_undegraded":"2024-03-30T12:20:36.007615+0000","last_fullsized":"2024-03-30T12:20:36.007615+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:31:22.909206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3148,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":9444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234011,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32384,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712768,"statfs":{"total":95995035648,"available":95961874432,"internally_reserved":0,"allocated":1294336,"data_stored":893025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.65500000000000003}]},{"osd":1,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.70999999999999996}]},{"osd":2,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.61099999999999999}]},{"osd":3,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.629},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.56699999999999995}]},{"osd":4,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.41999999999999998}]},{"osd":5,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.39000000000000001}]},{"osd":6,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.47799999999999998}]}]},{"osd":6,"up_from":46,"seq":197568495647,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28292,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716860,"statfs":{"total":95995035648,"available":95966064640,"internally_reserved":0,"allocated":1298432,"data_stored":894829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.52500000000000002,"15min":0.53200000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.73599999999999999,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.51200000000000001}]},{"osd":1,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77900000000000003,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.505,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.35499999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.67900000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.55300000000000005}]},{"osd":2,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53800000000000003,"15min":0.54300000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.67100000000000004,"5min":1.044,"15min":1.044},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70399999999999996,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.46000000000000002}]},{"osd":3,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73399999999999999,"5min":0.754,"15min":0.754},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.38900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.72199999999999998,"5min":1.006,"15min":1.006},"last":0.57199999999999995}]},{"osd":4,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.41999999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.497}]},{"osd":5,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.42799999999999999,"15min":0.42199999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.38},{"interface":"front","average":{"1min":0.498,"5min":0.45800000000000002,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.40100000000000002}]},{"osd":7,"last update":"Sat Mar 30 12:19:44 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.44400000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31800,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713352,"statfs":{"total":95995035648,"available":95962472448,"internally_reserved":0,"allocated":696320,"data_stored":301998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:20:24 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34200000000000003,"15min":0.313},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.44700000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.37,"15min":0.33000000000000002},"min":{"1min":0.23100000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.46100000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.379}]},{"osd":2,"last update":"Sat Mar 30 12:19:46 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38,"15min":0.374},"min":{"1min":0.247,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.54300000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39600000000000002,"15min":0.38900000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56399999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.307}]},{"osd":3,"last update":"Sat Mar 30 12:20:13 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.27400000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55300000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.46500000000000002,"15min":0.47699999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58499999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.36299999999999999}]},{"osd":4,"last update":"Sat Mar 30 12:20:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.54500000000000004}]},{"osd":5,"last update":"Sat Mar 30 12:19:54 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59199999999999997,"15min":0.58899999999999997},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Mar 30 12:20:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.59399999999999997,"15min":0.59999999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.63},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60299999999999998,"15min":0.60599999999999998},"min":{"1min":0.46100000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.504}]},{"osd":7,"last update":"Sat Mar 30 12:19:45 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60099999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738428,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32396,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712756,"statfs":{"total":95995035648,"available":95961862144,"internally_reserved":0,"allocated":1306624,"data_stored":893480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 30 12:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.32800000000000001,"15min":0.30199999999999999},"min":{"1min":0.191,"5min":0.183,"15min":0.183},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.36199999999999999,"15min":0.318},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.58199999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.36099999999999999}]},{"osd":2,"last update":"Sat Mar 30 12:19:48 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.41999999999999998,"15min":0.41799999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.57199999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.40799999999999997,"15min":0.40400000000000003},"min":{"1min":0.23699999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56299999999999994,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.31900000000000001}]},{"osd":3,"last update":"Sat Mar 30 12:20:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.27500000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.45400000000000001,"15min":0.45800000000000002},"min":{"1min":0.314,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68600000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.28399999999999997}]},{"osd":4,"last update":"Sat Mar 30 12:20:31 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73399999999999999,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.38200000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.753,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59199999999999997}]},{"osd":5,"last update":"Sat Mar 30 12:19:59 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.41099999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.76400000000000001,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.70299999999999996}]},{"osd":6,"last update":"Sat Mar 30 12:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76000000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.69099999999999995}]},{"osd":7,"last update":"Sat Mar 30 12:19:45 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.73299999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411378,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31796,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713356,"statfs":{"total":95995035648,"available":95962476544,"internally_reserved":0,"allocated":692224,"data_stored":302111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:19:50 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.34999999999999998,"15min":0.34300000000000003},"min":{"1min":0.254,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.377,"15min":0.379},"min":{"1min":0.27500000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.46899999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.32700000000000001}]},{"osd":1,"last update":"Sat Mar 30 12:19:50 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26100000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.47799999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.38900000000000001,"15min":0.38300000000000001},"min":{"1min":0.246,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59799999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.26900000000000002}]},{"osd":3,"last update":"Sat Mar 30 12:20:13 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45200000000000001,"15min":0.44800000000000001},"min":{"1min":0.32300000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.44500000000000001,"15min":0.45300000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.313}]},{"osd":4,"last update":"Sat Mar 30 12:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54100000000000004,"15min":0.54300000000000004},"min":{"1min":0.378,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.39100000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.78100000000000003}]},{"osd":5,"last update":"Sat Mar 30 12:20:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":1.3400000000000001,"15min":1.474},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86799999999999999,"5min":19.606999999999999,"15min":19.606999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.42299999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.746,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Mar 30 12:20:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.40799999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.87,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.59899999999999998}]},{"osd":7,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.61099999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182445,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717432,"statfs":{"total":95995035648,"available":95966650368,"internally_reserved":0,"allocated":716800,"data_stored":304838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:20:13 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39500000000000002,"15min":0.40300000000000002},"min":{"1min":0.25700000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.313},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.41299999999999998,"15min":0.41999999999999998},"min":{"1min":0.26200000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.50600000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.34200000000000003}]},{"osd":1,"last update":"Sat Mar 30 12:20:13 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.61799999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.438,"15min":0.443},"min":{"1min":0.33100000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57199999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.377}]},{"osd":2,"last update":"Sat Mar 30 12:20:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.45500000000000002,"15min":0.46200000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.42799999999999999,"15min":0.434},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.629,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.38400000000000001}]},{"osd":4,"last update":"Sat Mar 30 12:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.64600000000000002,"15min":0.68400000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.753,"5min":4.8639999999999999,"15min":4.8639999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57199999999999995,"15min":0.56000000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81299999999999994,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.69399999999999995}]},{"osd":5,"last update":"Sat Mar 30 12:19:56 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.622,"15min":0.628},"min":{"1min":0.41299999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.39600000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.75900000000000001}]},{"osd":6,"last update":"Sat Mar 30 12:20:20 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.435,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82599999999999996,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.74399999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.67700000000000005}]},{"osd":7,"last update":"Sat Mar 30 12:19:44 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.75}]}]},{"osd":4,"up_from":30,"seq":128849018920,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717444,"statfs":{"total":95995035648,"available":95966662656,"internally_reserved":0,"allocated":704512,"data_stored":302546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:20:34 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.63600000000000001,"15min":0.57999999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.73599999999999999,"5min":9.5069999999999997,"15min":9.5069999999999997},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51300000000000001,"15min":0.50800000000000001},"min":{"1min":0.29699999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41699999999999998}]},{"osd":1,"last update":"Sat Mar 30 12:20:34 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51700000000000002,"15min":0.51400000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.61899999999999999,"15min":0.53200000000000003},"min":{"1min":0.38400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.98499999999999999,"5min":11.534000000000001,"15min":11.534000000000001},"last":0.443}]},{"osd":2,"last update":"Sat Mar 30 12:20:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.41199999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.36799999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.60899999999999999}]},{"osd":3,"last update":"Sat Mar 30 12:20:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53300000000000003,"15min":0.52300000000000002},"min":{"1min":0.40300000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.748,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.56899999999999995}]},{"osd":5,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.434,"15min":0.436},"min":{"1min":0.311,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.64900000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.437,"5min":0.42999999999999999,"15min":0.42899999999999999},"min":{"1min":0.32700000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70999999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.373}]},{"osd":6,"last update":"Sat Mar 30 12:20:23 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.45300000000000001,"15min":0.45100000000000001},"min":{"1min":0.316,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69799999999999995,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68700000000000006,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.67500000000000004}]},{"osd":7,"last update":"Sat Mar 30 12:19:42 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.63}]}]},{"osd":5,"up_from":38,"seq":163208757284,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31816,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713336,"statfs":{"total":95995035648,"available":95962456064,"internally_reserved":0,"allocated":712704,"data_stored":304824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.36699999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51900000000000002,"15min":0.52100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70799999999999996,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.61899999999999999}]},{"osd":1,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72599999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.40200000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63800000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.52900000000000003}]},{"osd":2,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51500000000000001,"15min":0.51600000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70899999999999996,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52500000000000002,"15min":0.52800000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.64200000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.55900000000000005}]},{"osd":3,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.73599999999999999,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.499},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53600000000000003,"15min":0.54000000000000004},"min":{"1min":0.41599999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.59399999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.47799999999999998}]},{"osd":4,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39400000000000002,"15min":0.39000000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.37},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.40200000000000002,"15min":0.39300000000000002},"min":{"1min":0.28399999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.39800000000000002}]},{"osd":6,"last update":"Sat Mar 30 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.434,"15min":0.42999999999999999},"min":{"1min":0.32200000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.443,"15min":0.438},"min":{"1min":0.36299999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.58899999999999997}]},{"osd":7,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.435},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.63700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:20:44.153 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph status --format=json 2024-03-30T12:20:44.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:43 smithi084 ceph-mon[37565]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T12:20:44.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:43 smithi084 ceph-mon[37565]: Reconfiguring daemon prometheus.a on smithi162 2024-03-30T12:20:44.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:43 smithi084 ceph-mon[27000]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T12:20:44.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:43 smithi084 ceph-mon[27000]: Reconfiguring daemon prometheus.a on smithi162 2024-03-30T12:20:44.364 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:20:44.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:43 smithi162 ceph-mon[30421]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T12:20:44.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:43 smithi162 ceph-mon[30421]: Reconfiguring daemon prometheus.a on smithi162 2024-03-30T12:20:44.674 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[73215]: ts=2024-03-30T12:20:44.557Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000201424s 2024-03-30T12:20:45.101 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:44 smithi162 ceph-mon[30421]: from='client.24683 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:20:45.101 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:44 smithi162 ceph-mon[30421]: pgmap v40: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:45.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:44 smithi084 ceph-mon[27000]: from='client.24683 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:20:45.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:44 smithi084 ceph-mon[27000]: pgmap v40: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:45.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:44 smithi084 ceph-mon[37565]: from='client.24683 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:20:45.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:44 smithi084 ceph-mon[37565]: pgmap v40: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:46.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:46 smithi162 ceph-mon[30421]: pgmap v41: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:46.120 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:45 smithi162 systemd[1]: Stopping Ceph prometheus.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:20:46.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:46 smithi084 ceph-mon[27000]: pgmap v41: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:46.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:46 smithi084 ceph-mon[37565]: pgmap v41: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:46.312 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:20:46.312 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"d3450b00-ee8e-11ee-b647-cb9ed24678a4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":328,"monmap":{"epoch":3,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":68,"num_osds":8,"num_up_osds":8,"osd_up_since":1711801122,"num_in_osds":8,"osd_in_since":1711801104,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":593516,"bytes_used":249765888,"bytes_avail":767710519296,"bytes_total":767960285184},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":24331}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"services":{"dashboard":"https://172.21.15.84:8443/","prometheus":"http://172.21.15.84:9283/"}},"servicemap":{"epoch":13,"modified":"2024-03-30T12:20:37.837316+0000","services":{}},"progress_events":{}} 2024-03-30T12:20:46.557 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:20:46.225Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-03-30T12:20:46.558 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:20:46.225Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-03-30T12:20:46.558 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:20:46.225Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-03-30T12:20:46.558 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:20:46.225Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-03-30T12:20:46.558 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:20:46.225Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-03-30T12:20:46.558 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:20:46.225Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-03-30T12:20:46.558 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:20:46.225Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-03-30T12:20:46.558 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:20:46.225Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-03-30T12:20:46.558 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:20:46.225Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-03-30T12:20:46.558 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:20:46.226Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-03-30T12:20:46.558 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:20:46.226Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-03-30T12:20:46.558 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[58271]: ts=2024-03-30T12:20:46.226Z caller=main.go:1147 level=info msg="See you next time!" 2024-03-30T12:20:46.559 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:46 smithi162 podman[61436]: 2024-03-30 12:20:46.235758845 +0000 UTC m=+0.121550389 container died 5ba89e412a837cac1bcadbd69d50e33f8c50b846e62b47efb30d3a32d3b2e230 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:20:46.559 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:46 smithi162 podman[61436]: 2024-03-30 12:20:46.566788822 +0000 UTC m=+0.452580374 container cleanup 5ba89e412a837cac1bcadbd69d50e33f8c50b846e62b47efb30d3a32d3b2e230 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:20:46.559 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:46 smithi162 bash[61436]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a 2024-03-30T12:20:46.869 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:46 smithi162 podman[61451]: 2024-03-30 12:20:46.776125494 +0000 UTC m=+0.542413516 container remove 5ba89e412a837cac1bcadbd69d50e33f8c50b846e62b47efb30d3a32d3b2e230 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:20:46.998 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-03-30T12:20:46.998 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:20:47.202 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:20:47.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:47 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/409964003' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-03-30T12:20:47.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:47 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/409964003' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-03-30T12:20:47.287 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:47 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/409964003' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-03-30T12:20:47.288 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:46 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@prometheus.a.service: Deactivated successfully. 2024-03-30T12:20:47.288 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:46 smithi162 systemd[1]: Stopped Ceph prometheus.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:20:47.288 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:46 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@prometheus.a.service: Consumed 1.053s CPU time. 2024-03-30T12:20:47.288 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:46 smithi162 systemd[1]: Starting Ceph prometheus.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:20:47.288 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 podman[61548]: 2024-03-30 12:20:47.102225602 +0000 UTC m=+0.019457689 image pull a07b618ecd1dce142bce4c52f0e80982eaf1f14265a2415c2d35978ccaa0a464 quay.io/prometheus/prometheus:v2.43.0 2024-03-30T12:20:47.288 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 podman[61548]: 2024-03-30 12:20:47.21892358 +0000 UTC m=+0.136155684 container create 9858cdf4e1f20dacd68520d7cba3179eecbae754358bf16b15ccb0a2523377c0 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:20:47.600 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:20:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:20:47] ENGINE Bus STOPPING 2024-03-30T12:20:47.601 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:20:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:20:47] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T12:20:47.620 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 podman[61548]: 2024-03-30 12:20:47.420899288 +0000 UTC m=+0.338131350 container init 9858cdf4e1f20dacd68520d7cba3179eecbae754358bf16b15ccb0a2523377c0 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:20:47.620 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 podman[61548]: 2024-03-30 12:20:47.423532739 +0000 UTC m=+0.340764797 container start 9858cdf4e1f20dacd68520d7cba3179eecbae754358bf16b15ccb0a2523377c0 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:20:47.620 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:20:47.447Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-03-30T12:20:47.620 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:20:47.447Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-03-30T12:20:47.620 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:20:47.447Z caller=main.go:570 level=info host_details="(Linux 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 x86_64 smithi162 (none))" 2024-03-30T12:20:47.620 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:20:47.447Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-03-30T12:20:47.620 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:20:47.447Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-03-30T12:20:47.621 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:20:47.448Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-03-30T12:20:47.621 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:20:47.449Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-03-30T12:20:47.621 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:20:47.449Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-03-30T12:20:47.621 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:20:47.449Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-03-30T12:20:47.621 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:20:47.451Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-03-30T12:20:47.621 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:20:47.451Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=4.755µs 2024-03-30T12:20:47.621 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:20:47.451Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-03-30T12:20:47.621 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:20:47.453Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-03-30T12:20:47.621 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:20:47.453Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-03-30T12:20:47.621 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:20:47.453Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=125.34µs wal_replay_duration=1.860284ms wbl_replay_duration=110ns total_replay_duration=2.060811ms 2024-03-30T12:20:47.621 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:20:47.454Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-03-30T12:20:47.621 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:20:47.454Z caller=main.go:1029 level=info msg="TSDB started" 2024-03-30T12:20:47.621 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:20:47.454Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-03-30T12:20:47.622 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:20:47.471Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=16.189737ms db_storage=785ns remote_storage=1.58µs web_handler=357ns query_engine=542ns scrape=446.842µs scrape_sd=78.803µs notify=17.622µs notify_sd=23.417µs rules=15.39917ms tracing=5.733µs 2024-03-30T12:20:47.622 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:20:47.471Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-03-30T12:20:47.622 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:20:47.471Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-03-30T12:20:47.622 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 bash[61548]: 9858cdf4e1f20dacd68520d7cba3179eecbae754358bf16b15ccb0a2523377c0 2024-03-30T12:20:47.622 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:20:47 smithi162 systemd[1]: Started Ceph prometheus.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:20:47.929 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:20:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:20:47] ENGINE Bus STOPPED 2024-03-30T12:20:47.930 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:20:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:20:47] ENGINE Bus STARTING 2024-03-30T12:20:47.930 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:20:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:20:47] ENGINE Serving on http://:::9283 2024-03-30T12:20:47.930 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:20:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:20:47] ENGINE Bus STARTED 2024-03-30T12:20:47.930 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:20:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:20:47] ENGINE Bus STOPPING 2024-03-30T12:20:47.930 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:20:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:20:47] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T12:20:47.930 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:20:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:20:47] ENGINE Bus STOPPED 2024-03-30T12:20:47.930 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:20:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:20:47] ENGINE Bus STARTING 2024-03-30T12:20:47.930 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:20:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:20:47] ENGINE Serving on http://:::9283 2024-03-30T12:20:47.930 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:20:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:20:47] ENGINE Bus STARTED 2024-03-30T12:20:47.930 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:20:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:20:47] ENGINE Bus STOPPING 2024-03-30T12:20:47.930 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:20:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:20:47] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T12:20:47.930 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:20:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:20:47] ENGINE Bus STOPPED 2024-03-30T12:20:47.930 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:20:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:20:47] ENGINE Bus STARTING 2024-03-30T12:20:47.930 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:20:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:20:47] ENGINE Serving on http://:::9283 2024-03-30T12:20:47.931 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:20:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:20:47] ENGINE Bus STARTED 2024-03-30T12:20:48.778 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:48.778 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:48.778 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T12:20:48.778 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[37565]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T12:20:48.778 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi084.front.sepia.ceph.com:9093"}]: dispatch 2024-03-30T12:20:48.778 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[37565]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi084.front.sepia.ceph.com:9093"}]: dispatch 2024-03-30T12:20:48.778 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:48.779 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T12:20:48.779 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[37565]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T12:20:48.779 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi162.front.sepia.ceph.com:9095"}]: dispatch 2024-03-30T12:20:48.779 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[37565]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi162.front.sepia.ceph.com:9095"}]: dispatch 2024-03-30T12:20:48.779 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:48.779 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T12:20:48.779 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[37565]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T12:20:48.779 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi162.front.sepia.ceph.com:3000"}]: dispatch 2024-03-30T12:20:48.779 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[37565]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi162.front.sepia.ceph.com:3000"}]: dispatch 2024-03-30T12:20:48.779 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:48.779 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:20:48.779 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[37565]: pgmap v42: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:48.780 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:48.780 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:48.780 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T12:20:48.780 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[27000]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T12:20:48.780 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi084.front.sepia.ceph.com:9093"}]: dispatch 2024-03-30T12:20:48.780 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[27000]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi084.front.sepia.ceph.com:9093"}]: dispatch 2024-03-30T12:20:48.780 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:48.780 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T12:20:48.780 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[27000]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T12:20:48.780 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi162.front.sepia.ceph.com:9095"}]: dispatch 2024-03-30T12:20:48.780 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[27000]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi162.front.sepia.ceph.com:9095"}]: dispatch 2024-03-30T12:20:48.780 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:48.780 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T12:20:48.781 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[27000]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T12:20:48.781 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi162.front.sepia.ceph.com:3000"}]: dispatch 2024-03-30T12:20:48.781 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[27000]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi162.front.sepia.ceph.com:3000"}]: dispatch 2024-03-30T12:20:48.781 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:48.781 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:20:48.781 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:48 smithi084 ceph-mon[27000]: pgmap v42: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:48.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:48 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:48.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:48 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:48.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:48 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T12:20:48.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:48 smithi162 ceph-mon[30421]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T12:20:48.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:48 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi084.front.sepia.ceph.com:9093"}]: dispatch 2024-03-30T12:20:48.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:48 smithi162 ceph-mon[30421]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi084.front.sepia.ceph.com:9093"}]: dispatch 2024-03-30T12:20:48.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:48 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:48.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:48 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T12:20:48.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:48 smithi162 ceph-mon[30421]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T12:20:48.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:48 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi162.front.sepia.ceph.com:9095"}]: dispatch 2024-03-30T12:20:48.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:48 smithi162 ceph-mon[30421]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi162.front.sepia.ceph.com:9095"}]: dispatch 2024-03-30T12:20:48.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:48 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:48.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:48 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T12:20:48.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:48 smithi162 ceph-mon[30421]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T12:20:48.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:48 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi162.front.sepia.ceph.com:3000"}]: dispatch 2024-03-30T12:20:48.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:48 smithi162 ceph-mon[30421]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi162.front.sepia.ceph.com:3000"}]: dispatch 2024-03-30T12:20:48.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:48 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:48.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:48 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:20:48.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:48 smithi162 ceph-mon[30421]: pgmap v42: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:49.246 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:20:49.249 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:20:50.049 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-03-30T12:20:47.839002+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593516,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":227,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":315,"acting":315,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":315,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":243912,"kb_used_data":7248,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":749717304,"statfs":{"total":767960285184,"available":767710519296,"internally_reserved":0,"allocated":7421952,"data_stored":4197651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":242208312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.835794"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010417+0000","last_change":"2024-03-30T12:19:00.863340+0000","last_active":"2024-03-30T12:20:36.010417+0000","last_peered":"2024-03-30T12:20:36.010417+0000","last_clean":"2024-03-30T12:20:36.010417+0000","last_became_active":"2024-03-30T12:19:00.863041+0000","last_became_peered":"2024-03-30T12:19:00.863041+0000","last_unstale":"2024-03-30T12:20:36.010417+0000","last_undegraded":"2024-03-30T12:20:36.010417+0000","last_fullsized":"2024-03-30T12:20:36.010417+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:21.728523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-30T12:20:37.241613+0000","last_change":"2024-03-30T12:20:37.241613+0000","last_active":"2024-03-30T12:20:37.241613+0000","last_peered":"2024-03-30T12:20:37.241613+0000","last_clean":"2024-03-30T12:20:37.241613+0000","last_became_active":"2024-03-30T12:20:37.241258+0000","last_became_peered":"2024-03-30T12:20:37.241258+0000","last_unstale":"2024-03-30T12:20:37.241613+0000","last_undegraded":"2024-03-30T12:20:37.241613+0000","last_fullsized":"2024-03-30T12:20:37.241613+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:23:14.775585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006611+0000","last_change":"2024-03-30T12:19:00.853843+0000","last_active":"2024-03-30T12:20:36.006611+0000","last_peered":"2024-03-30T12:20:36.006611+0000","last_clean":"2024-03-30T12:20:36.006611+0000","last_became_active":"2024-03-30T12:19:00.853543+0000","last_became_peered":"2024-03-30T12:19:00.853543+0000","last_unstale":"2024-03-30T12:20:36.006611+0000","last_undegraded":"2024-03-30T12:20:36.006611+0000","last_fullsized":"2024-03-30T12:20:36.006611+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:52.339142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003242+0000","last_change":"2024-03-30T12:19:00.859974+0000","last_active":"2024-03-30T12:20:36.003242+0000","last_peered":"2024-03-30T12:20:36.003242+0000","last_clean":"2024-03-30T12:20:36.003242+0000","last_became_active":"2024-03-30T12:19:00.859615+0000","last_became_peered":"2024-03-30T12:19:00.859615+0000","last_unstale":"2024-03-30T12:20:36.003242+0000","last_undegraded":"2024-03-30T12:20:36.003242+0000","last_fullsized":"2024-03-30T12:20:36.003242+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:26.933772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010028+0000","last_change":"2024-03-30T12:19:00.872400+0000","last_active":"2024-03-30T12:20:36.010028+0000","last_peered":"2024-03-30T12:20:36.010028+0000","last_clean":"2024-03-30T12:20:36.010028+0000","last_became_active":"2024-03-30T12:19:00.872098+0000","last_became_peered":"2024-03-30T12:19:00.872098+0000","last_unstale":"2024-03-30T12:20:36.010028+0000","last_undegraded":"2024-03-30T12:20:36.010028+0000","last_fullsized":"2024-03-30T12:20:36.010028+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:21.152462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003182+0000","last_change":"2024-03-30T12:19:00.858029+0000","last_active":"2024-03-30T12:20:36.003182+0000","last_peered":"2024-03-30T12:20:36.003182+0000","last_clean":"2024-03-30T12:20:36.003182+0000","last_became_active":"2024-03-30T12:19:00.857668+0000","last_became_peered":"2024-03-30T12:19:00.857668+0000","last_unstale":"2024-03-30T12:20:36.003182+0000","last_undegraded":"2024-03-30T12:20:36.003182+0000","last_fullsized":"2024-03-30T12:20:36.003182+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:17:33.313541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.009440+0000","last_change":"2024-03-30T12:19:00.869258+0000","last_active":"2024-03-30T12:20:36.009440+0000","last_peered":"2024-03-30T12:20:36.009440+0000","last_clean":"2024-03-30T12:20:36.009440+0000","last_became_active":"2024-03-30T12:19:00.868799+0000","last_became_peered":"2024-03-30T12:19:00.868799+0000","last_unstale":"2024-03-30T12:20:36.009440+0000","last_undegraded":"2024-03-30T12:20:36.009440+0000","last_fullsized":"2024-03-30T12:20:36.009440+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:00:11.265094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002183+0000","last_change":"2024-03-30T12:19:00.864240+0000","last_active":"2024-03-30T12:20:36.002183+0000","last_peered":"2024-03-30T12:20:36.002183+0000","last_clean":"2024-03-30T12:20:36.002183+0000","last_became_active":"2024-03-30T12:19:00.863991+0000","last_became_peered":"2024-03-30T12:19:00.863991+0000","last_unstale":"2024-03-30T12:20:36.002183+0000","last_undegraded":"2024-03-30T12:20:36.002183+0000","last_fullsized":"2024-03-30T12:20:36.002183+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:59:30.409530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010374+0000","last_change":"2024-03-30T12:19:00.875226+0000","last_active":"2024-03-30T12:20:36.010374+0000","last_peered":"2024-03-30T12:20:36.010374+0000","last_clean":"2024-03-30T12:20:36.010374+0000","last_became_active":"2024-03-30T12:19:00.874620+0000","last_became_peered":"2024-03-30T12:19:00.874620+0000","last_unstale":"2024-03-30T12:20:36.010374+0000","last_undegraded":"2024-03-30T12:20:36.010374+0000","last_fullsized":"2024-03-30T12:20:36.010374+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:58:40.881840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007746+0000","last_change":"2024-03-30T12:19:00.869363+0000","last_active":"2024-03-30T12:20:36.007746+0000","last_peered":"2024-03-30T12:20:36.007746+0000","last_clean":"2024-03-30T12:20:36.007746+0000","last_became_active":"2024-03-30T12:19:00.868887+0000","last_became_peered":"2024-03-30T12:19:00.868887+0000","last_unstale":"2024-03-30T12:20:36.007746+0000","last_undegraded":"2024-03-30T12:20:36.007746+0000","last_fullsized":"2024-03-30T12:20:36.007746+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:40:49.543161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007751+0000","last_change":"2024-03-30T12:19:00.863992+0000","last_active":"2024-03-30T12:20:36.007751+0000","last_peered":"2024-03-30T12:20:36.007751+0000","last_clean":"2024-03-30T12:20:36.007751+0000","last_became_active":"2024-03-30T12:19:00.863683+0000","last_became_peered":"2024-03-30T12:19:00.863683+0000","last_unstale":"2024-03-30T12:20:36.007751+0000","last_undegraded":"2024-03-30T12:20:36.007751+0000","last_fullsized":"2024-03-30T12:20:36.007751+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:40:36.734391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006652+0000","last_change":"2024-03-30T12:19:00.862541+0000","last_active":"2024-03-30T12:20:36.006652+0000","last_peered":"2024-03-30T12:20:36.006652+0000","last_clean":"2024-03-30T12:20:36.006652+0000","last_became_active":"2024-03-30T12:19:00.862084+0000","last_became_peered":"2024-03-30T12:19:00.862084+0000","last_unstale":"2024-03-30T12:20:36.006652+0000","last_undegraded":"2024-03-30T12:20:36.006652+0000","last_fullsized":"2024-03-30T12:20:36.006652+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:36.445232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003202+0000","last_change":"2024-03-30T12:19:00.850148+0000","last_active":"2024-03-30T12:20:36.003202+0000","last_peered":"2024-03-30T12:20:36.003202+0000","last_clean":"2024-03-30T12:20:36.003202+0000","last_became_active":"2024-03-30T12:19:00.849849+0000","last_became_peered":"2024-03-30T12:19:00.849849+0000","last_unstale":"2024-03-30T12:20:36.003202+0000","last_undegraded":"2024-03-30T12:20:36.003202+0000","last_fullsized":"2024-03-30T12:20:36.003202+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:55:56.657057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005013+0000","last_change":"2024-03-30T12:19:00.865479+0000","last_active":"2024-03-30T12:20:36.005013+0000","last_peered":"2024-03-30T12:20:36.005013+0000","last_clean":"2024-03-30T12:20:36.005013+0000","last_became_active":"2024-03-30T12:19:00.864441+0000","last_became_peered":"2024-03-30T12:19:00.864441+0000","last_unstale":"2024-03-30T12:20:36.005013+0000","last_undegraded":"2024-03-30T12:20:36.005013+0000","last_fullsized":"2024-03-30T12:20:36.005013+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:45:55.344815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004635+0000","last_change":"2024-03-30T12:19:00.866672+0000","last_active":"2024-03-30T12:20:36.004635+0000","last_peered":"2024-03-30T12:20:36.004635+0000","last_clean":"2024-03-30T12:20:36.004635+0000","last_became_active":"2024-03-30T12:19:00.866276+0000","last_became_peered":"2024-03-30T12:19:00.866276+0000","last_unstale":"2024-03-30T12:20:36.004635+0000","last_undegraded":"2024-03-30T12:20:36.004635+0000","last_fullsized":"2024-03-30T12:20:36.004635+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:23:49.856597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002869+0000","last_change":"2024-03-30T12:19:00.864760+0000","last_active":"2024-03-30T12:20:36.002869+0000","last_peered":"2024-03-30T12:20:36.002869+0000","last_clean":"2024-03-30T12:20:36.002869+0000","last_became_active":"2024-03-30T12:19:00.864447+0000","last_became_peered":"2024-03-30T12:19:00.864447+0000","last_unstale":"2024-03-30T12:20:36.002869+0000","last_undegraded":"2024-03-30T12:20:36.002869+0000","last_fullsized":"2024-03-30T12:20:36.002869+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:26:47.024806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003577+0000","last_change":"2024-03-30T12:19:00.863453+0000","last_active":"2024-03-30T12:20:36.003577+0000","last_peered":"2024-03-30T12:20:36.003577+0000","last_clean":"2024-03-30T12:20:36.003577+0000","last_became_active":"2024-03-30T12:19:00.863129+0000","last_became_peered":"2024-03-30T12:19:00.863129+0000","last_unstale":"2024-03-30T12:20:36.003577+0000","last_undegraded":"2024-03-30T12:20:36.003577+0000","last_fullsized":"2024-03-30T12:20:36.003577+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:19:33.658159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006652+0000","last_change":"2024-03-30T12:19:00.854527+0000","last_active":"2024-03-30T12:20:36.006652+0000","last_peered":"2024-03-30T12:20:36.006652+0000","last_clean":"2024-03-30T12:20:36.006652+0000","last_became_active":"2024-03-30T12:19:00.854238+0000","last_became_peered":"2024-03-30T12:19:00.854238+0000","last_unstale":"2024-03-30T12:20:36.006652+0000","last_undegraded":"2024-03-30T12:20:36.006652+0000","last_fullsized":"2024-03-30T12:20:36.006652+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:50:54.069856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.009897+0000","last_change":"2024-03-30T12:19:00.854461+0000","last_active":"2024-03-30T12:20:36.009897+0000","last_peered":"2024-03-30T12:20:36.009897+0000","last_clean":"2024-03-30T12:20:36.009897+0000","last_became_active":"2024-03-30T12:19:00.854077+0000","last_became_peered":"2024-03-30T12:19:00.854077+0000","last_unstale":"2024-03-30T12:20:36.009897+0000","last_undegraded":"2024-03-30T12:20:36.009897+0000","last_fullsized":"2024-03-30T12:20:36.009897+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:24:10.940443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"61'4","reported_seq":22,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006480+0000","last_change":"2024-03-30T12:19:00.466957+0000","last_active":"2024-03-30T12:20:36.006480+0000","last_peered":"2024-03-30T12:20:36.006480+0000","last_clean":"2024-03-30T12:20:36.006480+0000","last_became_active":"2024-03-30T12:19:00.466689+0000","last_became_peered":"2024-03-30T12:19:00.466689+0000","last_unstale":"2024-03-30T12:20:36.006480+0000","last_undegraded":"2024-03-30T12:20:36.006480+0000","last_fullsized":"2024-03-30T12:20:36.006480+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:08.774258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003497+0000","last_change":"2024-03-30T12:19:00.863714+0000","last_active":"2024-03-30T12:20:36.003497+0000","last_peered":"2024-03-30T12:20:36.003497+0000","last_clean":"2024-03-30T12:20:36.003497+0000","last_became_active":"2024-03-30T12:19:00.863429+0000","last_became_peered":"2024-03-30T12:19:00.863429+0000","last_unstale":"2024-03-30T12:20:36.003497+0000","last_undegraded":"2024-03-30T12:20:36.003497+0000","last_fullsized":"2024-03-30T12:20:36.003497+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:31.953173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"61'1","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003579+0000","last_change":"2024-03-30T12:19:00.459693+0000","last_active":"2024-03-30T12:20:36.003579+0000","last_peered":"2024-03-30T12:20:36.003579+0000","last_clean":"2024-03-30T12:20:36.003579+0000","last_became_active":"2024-03-30T12:19:00.459409+0000","last_became_peered":"2024-03-30T12:19:00.459409+0000","last_unstale":"2024-03-30T12:20:36.003579+0000","last_undegraded":"2024-03-30T12:20:36.003579+0000","last_fullsized":"2024-03-30T12:20:36.003579+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:27.891375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006265+0000","last_change":"2024-03-30T12:19:00.864952+0000","last_active":"2024-03-30T12:20:36.006265+0000","last_peered":"2024-03-30T12:20:36.006265+0000","last_clean":"2024-03-30T12:20:36.006265+0000","last_became_active":"2024-03-30T12:19:00.864274+0000","last_became_peered":"2024-03-30T12:19:00.864274+0000","last_unstale":"2024-03-30T12:20:36.006265+0000","last_undegraded":"2024-03-30T12:20:36.006265+0000","last_fullsized":"2024-03-30T12:20:36.006265+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:45:00.775246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010307+0000","last_change":"2024-03-30T12:19:00.469695+0000","last_active":"2024-03-30T12:20:36.010307+0000","last_peered":"2024-03-30T12:20:36.010307+0000","last_clean":"2024-03-30T12:20:36.010307+0000","last_became_active":"2024-03-30T12:19:00.469261+0000","last_became_peered":"2024-03-30T12:19:00.469261+0000","last_unstale":"2024-03-30T12:20:36.010307+0000","last_undegraded":"2024-03-30T12:20:36.010307+0000","last_fullsized":"2024-03-30T12:20:36.010307+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:02:43.407908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003603+0000","last_change":"2024-03-30T12:19:00.859422+0000","last_active":"2024-03-30T12:20:36.003603+0000","last_peered":"2024-03-30T12:20:36.003603+0000","last_clean":"2024-03-30T12:20:36.003603+0000","last_became_active":"2024-03-30T12:19:00.858880+0000","last_became_peered":"2024-03-30T12:19:00.858880+0000","last_unstale":"2024-03-30T12:20:36.003603+0000","last_undegraded":"2024-03-30T12:20:36.003603+0000","last_fullsized":"2024-03-30T12:20:36.003603+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:09.612172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010008+0000","last_change":"2024-03-30T12:19:00.467935+0000","last_active":"2024-03-30T12:20:36.010008+0000","last_peered":"2024-03-30T12:20:36.010008+0000","last_clean":"2024-03-30T12:20:36.010008+0000","last_became_active":"2024-03-30T12:19:00.467636+0000","last_became_peered":"2024-03-30T12:19:00.467636+0000","last_unstale":"2024-03-30T12:20:36.010008+0000","last_undegraded":"2024-03-30T12:20:36.010008+0000","last_fullsized":"2024-03-30T12:20:36.010008+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:49.599855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-30T12:20:37.241472+0000","last_change":"2024-03-30T12:20:37.241472+0000","last_active":"2024-03-30T12:20:37.241472+0000","last_peered":"2024-03-30T12:20:37.241472+0000","last_clean":"2024-03-30T12:20:37.241472+0000","last_became_active":"2024-03-30T12:20:37.241084+0000","last_became_peered":"2024-03-30T12:20:37.241084+0000","last_unstale":"2024-03-30T12:20:37.241472+0000","last_undegraded":"2024-03-30T12:20:37.241472+0000","last_fullsized":"2024-03-30T12:20:37.241472+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:40:48.055427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"61'1","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003349+0000","last_change":"2024-03-30T12:19:00.454521+0000","last_active":"2024-03-30T12:20:36.003349+0000","last_peered":"2024-03-30T12:20:36.003349+0000","last_clean":"2024-03-30T12:20:36.003349+0000","last_became_active":"2024-03-30T12:19:00.454213+0000","last_became_peered":"2024-03-30T12:19:00.454213+0000","last_unstale":"2024-03-30T12:20:36.003349+0000","last_undegraded":"2024-03-30T12:20:36.003349+0000","last_fullsized":"2024-03-30T12:20:36.003349+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:27:47.198072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006453+0000","last_change":"2024-03-30T12:19:00.860724+0000","last_active":"2024-03-30T12:20:36.006453+0000","last_peered":"2024-03-30T12:20:36.006453+0000","last_clean":"2024-03-30T12:20:36.006453+0000","last_became_active":"2024-03-30T12:19:00.860427+0000","last_became_peered":"2024-03-30T12:19:00.860427+0000","last_unstale":"2024-03-30T12:20:36.006453+0000","last_undegraded":"2024-03-30T12:20:36.006453+0000","last_fullsized":"2024-03-30T12:20:36.006453+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:55:54.757770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"61'1","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007243+0000","last_change":"2024-03-30T12:19:00.460150+0000","last_active":"2024-03-30T12:20:36.007243+0000","last_peered":"2024-03-30T12:20:36.007243+0000","last_clean":"2024-03-30T12:20:36.007243+0000","last_became_active":"2024-03-30T12:19:00.459740+0000","last_became_peered":"2024-03-30T12:19:00.459740+0000","last_unstale":"2024-03-30T12:20:36.007243+0000","last_undegraded":"2024-03-30T12:20:36.007243+0000","last_fullsized":"2024-03-30T12:20:36.007243+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:52:40.523467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005105+0000","last_change":"2024-03-30T12:19:00.857403+0000","last_active":"2024-03-30T12:20:36.005105+0000","last_peered":"2024-03-30T12:20:36.005105+0000","last_clean":"2024-03-30T12:20:36.005105+0000","last_became_active":"2024-03-30T12:19:00.856652+0000","last_became_peered":"2024-03-30T12:19:00.856652+0000","last_unstale":"2024-03-30T12:20:36.005105+0000","last_undegraded":"2024-03-30T12:20:36.005105+0000","last_fullsized":"2024-03-30T12:20:36.005105+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:51.932935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002446+0000","last_change":"2024-03-30T12:19:00.458253+0000","last_active":"2024-03-30T12:20:36.002446+0000","last_peered":"2024-03-30T12:20:36.002446+0000","last_clean":"2024-03-30T12:20:36.002446+0000","last_became_active":"2024-03-30T12:19:00.457947+0000","last_became_peered":"2024-03-30T12:19:00.457947+0000","last_unstale":"2024-03-30T12:20:36.002446+0000","last_undegraded":"2024-03-30T12:20:36.002446+0000","last_fullsized":"2024-03-30T12:20:36.002446+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:13:18.864198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002317+0000","last_change":"2024-03-30T12:19:00.859188+0000","last_active":"2024-03-30T12:20:36.002317+0000","last_peered":"2024-03-30T12:20:36.002317+0000","last_clean":"2024-03-30T12:20:36.002317+0000","last_became_active":"2024-03-30T12:19:00.858922+0000","last_became_peered":"2024-03-30T12:19:00.858922+0000","last_unstale":"2024-03-30T12:20:36.002317+0000","last_undegraded":"2024-03-30T12:20:36.002317+0000","last_fullsized":"2024-03-30T12:20:36.002317+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:56:16.965191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002925+0000","last_change":"2024-03-30T12:19:00.466729+0000","last_active":"2024-03-30T12:20:36.002925+0000","last_peered":"2024-03-30T12:20:36.002925+0000","last_clean":"2024-03-30T12:20:36.002925+0000","last_became_active":"2024-03-30T12:19:00.466086+0000","last_became_peered":"2024-03-30T12:19:00.466086+0000","last_unstale":"2024-03-30T12:20:36.002925+0000","last_undegraded":"2024-03-30T12:20:36.002925+0000","last_fullsized":"2024-03-30T12:20:36.002925+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:46:14.144417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004830+0000","last_change":"2024-03-30T12:19:00.863262+0000","last_active":"2024-03-30T12:20:36.004830+0000","last_peered":"2024-03-30T12:20:36.004830+0000","last_clean":"2024-03-30T12:20:36.004830+0000","last_became_active":"2024-03-30T12:19:00.861328+0000","last_became_peered":"2024-03-30T12:19:00.861328+0000","last_unstale":"2024-03-30T12:20:36.004830+0000","last_undegraded":"2024-03-30T12:20:36.004830+0000","last_fullsized":"2024-03-30T12:20:36.004830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:20:19.049967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007946+0000","last_change":"2024-03-30T12:19:00.459929+0000","last_active":"2024-03-30T12:20:36.007946+0000","last_peered":"2024-03-30T12:20:36.007946+0000","last_clean":"2024-03-30T12:20:36.007946+0000","last_became_active":"2024-03-30T12:19:00.459518+0000","last_became_peered":"2024-03-30T12:19:00.459518+0000","last_unstale":"2024-03-30T12:20:36.007946+0000","last_undegraded":"2024-03-30T12:20:36.007946+0000","last_fullsized":"2024-03-30T12:20:36.007946+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:09:03.990119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003517+0000","last_change":"2024-03-30T12:19:00.862112+0000","last_active":"2024-03-30T12:20:36.003517+0000","last_peered":"2024-03-30T12:20:36.003517+0000","last_clean":"2024-03-30T12:20:36.003517+0000","last_became_active":"2024-03-30T12:19:00.861782+0000","last_became_peered":"2024-03-30T12:19:00.861782+0000","last_unstale":"2024-03-30T12:20:36.003517+0000","last_undegraded":"2024-03-30T12:20:36.003517+0000","last_fullsized":"2024-03-30T12:20:36.003517+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:01:42.946530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003471+0000","last_change":"2024-03-30T12:19:00.463745+0000","last_active":"2024-03-30T12:20:36.003471+0000","last_peered":"2024-03-30T12:20:36.003471+0000","last_clean":"2024-03-30T12:20:36.003471+0000","last_became_active":"2024-03-30T12:19:00.462698+0000","last_became_peered":"2024-03-30T12:19:00.462698+0000","last_unstale":"2024-03-30T12:20:36.003471+0000","last_undegraded":"2024-03-30T12:20:36.003471+0000","last_fullsized":"2024-03-30T12:20:36.003471+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:09:33.196928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-30T12:20:37.009497+0000","last_change":"2024-03-30T12:20:37.009497+0000","last_active":"2024-03-30T12:20:37.009497+0000","last_peered":"2024-03-30T12:20:37.009497+0000","last_clean":"2024-03-30T12:20:37.009497+0000","last_became_active":"2024-03-30T12:20:37.009140+0000","last_became_peered":"2024-03-30T12:20:37.009140+0000","last_unstale":"2024-03-30T12:20:37.009497+0000","last_undegraded":"2024-03-30T12:20:37.009497+0000","last_fullsized":"2024-03-30T12:20:37.009497+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:01.772821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":21,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005122+0000","last_change":"2024-03-30T12:19:00.463581+0000","last_active":"2024-03-30T12:20:36.005122+0000","last_peered":"2024-03-30T12:20:36.005122+0000","last_clean":"2024-03-30T12:20:36.005122+0000","last_became_active":"2024-03-30T12:19:00.463280+0000","last_became_peered":"2024-03-30T12:19:00.463280+0000","last_unstale":"2024-03-30T12:20:36.005122+0000","last_undegraded":"2024-03-30T12:20:36.005122+0000","last_fullsized":"2024-03-30T12:20:36.005122+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:38:07.390655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006530+0000","last_change":"2024-03-30T12:19:00.878541+0000","last_active":"2024-03-30T12:20:36.006530+0000","last_peered":"2024-03-30T12:20:36.006530+0000","last_clean":"2024-03-30T12:20:36.006530+0000","last_became_active":"2024-03-30T12:19:00.878229+0000","last_became_peered":"2024-03-30T12:19:00.878229+0000","last_unstale":"2024-03-30T12:20:36.006530+0000","last_undegraded":"2024-03-30T12:20:36.006530+0000","last_fullsized":"2024-03-30T12:20:36.006530+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:03:18.020146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"65'9","reported_seq":27,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007527+0000","last_change":"2024-03-30T12:19:00.458102+0000","last_active":"2024-03-30T12:20:36.007527+0000","last_peered":"2024-03-30T12:20:36.007527+0000","last_clean":"2024-03-30T12:20:36.007527+0000","last_became_active":"2024-03-30T12:19:00.457759+0000","last_became_peered":"2024-03-30T12:19:00.457759+0000","last_unstale":"2024-03-30T12:20:36.007527+0000","last_undegraded":"2024-03-30T12:20:36.007527+0000","last_fullsized":"2024-03-30T12:20:36.007527+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:31.713303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2350,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010066+0000","last_change":"2024-03-30T12:19:00.872384+0000","last_active":"2024-03-30T12:20:36.010066+0000","last_peered":"2024-03-30T12:20:36.010066+0000","last_clean":"2024-03-30T12:20:36.010066+0000","last_became_active":"2024-03-30T12:19:00.872085+0000","last_became_peered":"2024-03-30T12:19:00.872085+0000","last_unstale":"2024-03-30T12:20:36.010066+0000","last_undegraded":"2024-03-30T12:20:36.010066+0000","last_fullsized":"2024-03-30T12:20:36.010066+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:47:42.278500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005329+0000","last_change":"2024-03-30T12:19:00.462939+0000","last_active":"2024-03-30T12:20:36.005329+0000","last_peered":"2024-03-30T12:20:36.005329+0000","last_clean":"2024-03-30T12:20:36.005329+0000","last_became_active":"2024-03-30T12:19:00.462637+0000","last_became_peered":"2024-03-30T12:19:00.462637+0000","last_unstale":"2024-03-30T12:20:36.005329+0000","last_undegraded":"2024-03-30T12:20:36.005329+0000","last_fullsized":"2024-03-30T12:20:36.005329+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:48:59.027106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004952+0000","last_change":"2024-03-30T12:19:00.856865+0000","last_active":"2024-03-30T12:20:36.004952+0000","last_peered":"2024-03-30T12:20:36.004952+0000","last_clean":"2024-03-30T12:20:36.004952+0000","last_became_active":"2024-03-30T12:19:00.856544+0000","last_became_peered":"2024-03-30T12:19:00.856544+0000","last_unstale":"2024-03-30T12:20:36.004952+0000","last_undegraded":"2024-03-30T12:20:36.004952+0000","last_fullsized":"2024-03-30T12:20:36.004952+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:37:39.901012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002977+0000","last_change":"2024-03-30T12:19:00.465931+0000","last_active":"2024-03-30T12:20:36.002977+0000","last_peered":"2024-03-30T12:20:36.002977+0000","last_clean":"2024-03-30T12:20:36.002977+0000","last_became_active":"2024-03-30T12:19:00.465589+0000","last_became_peered":"2024-03-30T12:19:00.465589+0000","last_unstale":"2024-03-30T12:20:36.002977+0000","last_undegraded":"2024-03-30T12:20:36.002977+0000","last_fullsized":"2024-03-30T12:20:36.002977+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:02:38.614924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.009910+0000","last_change":"2024-03-30T12:19:00.870798+0000","last_active":"2024-03-30T12:20:36.009910+0000","last_peered":"2024-03-30T12:20:36.009910+0000","last_clean":"2024-03-30T12:20:36.009910+0000","last_became_active":"2024-03-30T12:19:00.870507+0000","last_became_peered":"2024-03-30T12:19:00.870507+0000","last_unstale":"2024-03-30T12:20:36.009910+0000","last_undegraded":"2024-03-30T12:20:36.009910+0000","last_fullsized":"2024-03-30T12:20:36.009910+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:25:30.259298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006948+0000","last_change":"2024-03-30T12:19:00.454678+0000","last_active":"2024-03-30T12:20:36.006948+0000","last_peered":"2024-03-30T12:20:36.006948+0000","last_clean":"2024-03-30T12:20:36.006948+0000","last_became_active":"2024-03-30T12:19:00.454380+0000","last_became_peered":"2024-03-30T12:19:00.454380+0000","last_unstale":"2024-03-30T12:20:36.006948+0000","last_undegraded":"2024-03-30T12:20:36.006948+0000","last_fullsized":"2024-03-30T12:20:36.006948+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:08:24.640327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005827+0000","last_change":"2024-03-30T12:19:00.861547+0000","last_active":"2024-03-30T12:20:36.005827+0000","last_peered":"2024-03-30T12:20:36.005827+0000","last_clean":"2024-03-30T12:20:36.005827+0000","last_became_active":"2024-03-30T12:19:00.861268+0000","last_became_peered":"2024-03-30T12:19:00.861268+0000","last_unstale":"2024-03-30T12:20:36.005827+0000","last_undegraded":"2024-03-30T12:20:36.005827+0000","last_fullsized":"2024-03-30T12:20:36.005827+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:28:37.342309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":26,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005972+0000","last_change":"2024-03-30T12:19:00.460090+0000","last_active":"2024-03-30T12:20:36.005972+0000","last_peered":"2024-03-30T12:20:36.005972+0000","last_clean":"2024-03-30T12:20:36.005972+0000","last_became_active":"2024-03-30T12:19:00.459790+0000","last_became_peered":"2024-03-30T12:19:00.459790+0000","last_unstale":"2024-03-30T12:20:36.005972+0000","last_undegraded":"2024-03-30T12:20:36.005972+0000","last_fullsized":"2024-03-30T12:20:36.005972+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:38.860631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.009575+0000","last_change":"2024-03-30T12:19:00.870061+0000","last_active":"2024-03-30T12:20:36.009575+0000","last_peered":"2024-03-30T12:20:36.009575+0000","last_clean":"2024-03-30T12:20:36.009575+0000","last_became_active":"2024-03-30T12:19:00.869750+0000","last_became_peered":"2024-03-30T12:19:00.869750+0000","last_unstale":"2024-03-30T12:20:36.009575+0000","last_undegraded":"2024-03-30T12:20:36.009575+0000","last_fullsized":"2024-03-30T12:20:36.009575+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:03:02.790151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"61'1","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006238+0000","last_change":"2024-03-30T12:19:00.461178+0000","last_active":"2024-03-30T12:20:36.006238+0000","last_peered":"2024-03-30T12:20:36.006238+0000","last_clean":"2024-03-30T12:20:36.006238+0000","last_became_active":"2024-03-30T12:19:00.460817+0000","last_became_peered":"2024-03-30T12:19:00.460817+0000","last_unstale":"2024-03-30T12:20:36.006238+0000","last_undegraded":"2024-03-30T12:20:36.006238+0000","last_fullsized":"2024-03-30T12:20:36.006238+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:30:59.255694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010218+0000","last_change":"2024-03-30T12:19:00.871828+0000","last_active":"2024-03-30T12:20:36.010218+0000","last_peered":"2024-03-30T12:20:36.010218+0000","last_clean":"2024-03-30T12:20:36.010218+0000","last_became_active":"2024-03-30T12:19:00.871555+0000","last_became_peered":"2024-03-30T12:19:00.871555+0000","last_unstale":"2024-03-30T12:20:36.010218+0000","last_undegraded":"2024-03-30T12:20:36.010218+0000","last_fullsized":"2024-03-30T12:20:36.010218+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:02:53.212521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.008100+0000","last_change":"2024-03-30T12:19:35.161648+0000","last_active":"2024-03-30T12:20:36.008100+0000","last_peered":"2024-03-30T12:20:36.008100+0000","last_clean":"2024-03-30T12:20:36.008100+0000","last_became_active":"2024-03-30T12:19:35.161426+0000","last_became_peered":"2024-03-30T12:19:35.161426+0000","last_unstale":"2024-03-30T12:20:36.008100+0000","last_undegraded":"2024-03-30T12:20:36.008100+0000","last_fullsized":"2024-03-30T12:20:36.008100+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:05:56.726860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004909+0000","last_change":"2024-03-30T12:19:00.462709+0000","last_active":"2024-03-30T12:20:36.004909+0000","last_peered":"2024-03-30T12:20:36.004909+0000","last_clean":"2024-03-30T12:20:36.004909+0000","last_became_active":"2024-03-30T12:19:00.462429+0000","last_became_peered":"2024-03-30T12:19:00.462429+0000","last_unstale":"2024-03-30T12:20:36.004909+0000","last_undegraded":"2024-03-30T12:20:36.004909+0000","last_fullsized":"2024-03-30T12:20:36.004909+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:29.579526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003518+0000","last_change":"2024-03-30T12:19:00.854025+0000","last_active":"2024-03-30T12:20:36.003518+0000","last_peered":"2024-03-30T12:20:36.003518+0000","last_clean":"2024-03-30T12:20:36.003518+0000","last_became_active":"2024-03-30T12:19:00.853714+0000","last_became_peered":"2024-03-30T12:19:00.853714+0000","last_unstale":"2024-03-30T12:20:36.003518+0000","last_undegraded":"2024-03-30T12:20:36.003518+0000","last_fullsized":"2024-03-30T12:20:36.003518+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:27:34.498087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004908+0000","last_change":"2024-03-30T12:19:35.051431+0000","last_active":"2024-03-30T12:20:36.004908+0000","last_peered":"2024-03-30T12:20:36.004908+0000","last_clean":"2024-03-30T12:20:36.004908+0000","last_became_active":"2024-03-30T12:19:35.050880+0000","last_became_peered":"2024-03-30T12:19:35.050880+0000","last_unstale":"2024-03-30T12:20:36.004908+0000","last_undegraded":"2024-03-30T12:20:36.004908+0000","last_fullsized":"2024-03-30T12:20:36.004908+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:57:58.075785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002920+0000","last_change":"2024-03-30T12:19:00.457612+0000","last_active":"2024-03-30T12:20:36.002920+0000","last_peered":"2024-03-30T12:20:36.002920+0000","last_clean":"2024-03-30T12:20:36.002920+0000","last_became_active":"2024-03-30T12:19:00.457289+0000","last_became_peered":"2024-03-30T12:19:00.457289+0000","last_unstale":"2024-03-30T12:20:36.002920+0000","last_undegraded":"2024-03-30T12:20:36.002920+0000","last_fullsized":"2024-03-30T12:20:36.002920+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:23.011997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006358+0000","last_change":"2024-03-30T12:19:00.866070+0000","last_active":"2024-03-30T12:20:36.006358+0000","last_peered":"2024-03-30T12:20:36.006358+0000","last_clean":"2024-03-30T12:20:36.006358+0000","last_became_active":"2024-03-30T12:19:00.865706+0000","last_became_peered":"2024-03-30T12:19:00.865706+0000","last_unstale":"2024-03-30T12:20:36.006358+0000","last_undegraded":"2024-03-30T12:20:36.006358+0000","last_fullsized":"2024-03-30T12:20:36.006358+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:56:01.599580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006959+0000","last_change":"2024-03-30T12:19:35.162695+0000","last_active":"2024-03-30T12:20:36.006959+0000","last_peered":"2024-03-30T12:20:36.006959+0000","last_clean":"2024-03-30T12:20:36.006959+0000","last_became_active":"2024-03-30T12:19:35.162389+0000","last_became_peered":"2024-03-30T12:19:35.162389+0000","last_unstale":"2024-03-30T12:20:36.006959+0000","last_undegraded":"2024-03-30T12:20:36.006959+0000","last_fullsized":"2024-03-30T12:20:36.006959+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:20:43.739417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004567+0000","last_change":"2024-03-30T12:19:00.861917+0000","last_active":"2024-03-30T12:20:36.004567+0000","last_peered":"2024-03-30T12:20:36.004567+0000","last_clean":"2024-03-30T12:20:36.004567+0000","last_became_active":"2024-03-30T12:19:00.860645+0000","last_became_peered":"2024-03-30T12:19:00.860645+0000","last_unstale":"2024-03-30T12:20:36.004567+0000","last_undegraded":"2024-03-30T12:20:36.004567+0000","last_fullsized":"2024-03-30T12:20:36.004567+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:30:51.438018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005814+0000","last_change":"2024-03-30T12:19:00.459145+0000","last_active":"2024-03-30T12:20:36.005814+0000","last_peered":"2024-03-30T12:20:36.005814+0000","last_clean":"2024-03-30T12:20:36.005814+0000","last_became_active":"2024-03-30T12:19:00.457819+0000","last_became_peered":"2024-03-30T12:19:00.457819+0000","last_unstale":"2024-03-30T12:20:36.005814+0000","last_undegraded":"2024-03-30T12:20:36.005814+0000","last_fullsized":"2024-03-30T12:20:36.005814+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:44:38.245366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007538+0000","last_change":"2024-03-30T12:19:35.161274+0000","last_active":"2024-03-30T12:20:36.007538+0000","last_peered":"2024-03-30T12:20:36.007538+0000","last_clean":"2024-03-30T12:20:36.007538+0000","last_became_active":"2024-03-30T12:19:35.160985+0000","last_became_peered":"2024-03-30T12:19:35.160985+0000","last_unstale":"2024-03-30T12:20:36.007538+0000","last_undegraded":"2024-03-30T12:20:36.007538+0000","last_fullsized":"2024-03-30T12:20:36.007538+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:07.499529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002517+0000","last_change":"2024-03-30T12:19:00.862340+0000","last_active":"2024-03-30T12:20:36.002517+0000","last_peered":"2024-03-30T12:20:36.002517+0000","last_clean":"2024-03-30T12:20:36.002517+0000","last_became_active":"2024-03-30T12:19:00.861413+0000","last_became_peered":"2024-03-30T12:19:00.861413+0000","last_unstale":"2024-03-30T12:20:36.002517+0000","last_undegraded":"2024-03-30T12:20:36.002517+0000","last_fullsized":"2024-03-30T12:20:36.002517+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:13:39.199499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003089+0000","last_change":"2024-03-30T12:19:00.465946+0000","last_active":"2024-03-30T12:20:36.003089+0000","last_peered":"2024-03-30T12:20:36.003089+0000","last_clean":"2024-03-30T12:20:36.003089+0000","last_became_active":"2024-03-30T12:19:00.465618+0000","last_became_peered":"2024-03-30T12:19:00.465618+0000","last_unstale":"2024-03-30T12:20:36.003089+0000","last_undegraded":"2024-03-30T12:20:36.003089+0000","last_fullsized":"2024-03-30T12:20:36.003089+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:58:42.109572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"66'128","reported_seq":265,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.009454+0000","last_change":"2024-03-30T12:18:45.912869+0000","last_active":"2024-03-30T12:20:36.009454+0000","last_peered":"2024-03-30T12:20:36.009454+0000","last_clean":"2024-03-30T12:20:36.009454+0000","last_became_active":"2024-03-30T12:18:45.912395+0000","last_became_peered":"2024-03-30T12:18:45.912395+0000","last_unstale":"2024-03-30T12:20:36.009454+0000","last_undegraded":"2024-03-30T12:20:36.009454+0000","last_fullsized":"2024-03-30T12:20:36.009454+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:34.485283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006349+0000","last_change":"2024-03-30T12:19:35.052180+0000","last_active":"2024-03-30T12:20:36.006349+0000","last_peered":"2024-03-30T12:20:36.006349+0000","last_clean":"2024-03-30T12:20:36.006349+0000","last_became_active":"2024-03-30T12:19:35.051577+0000","last_became_peered":"2024-03-30T12:19:35.051577+0000","last_unstale":"2024-03-30T12:20:36.006349+0000","last_undegraded":"2024-03-30T12:20:36.006349+0000","last_fullsized":"2024-03-30T12:20:36.006349+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:26:43.695424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004800+0000","last_change":"2024-03-30T12:19:00.852506+0000","last_active":"2024-03-30T12:20:36.004800+0000","last_peered":"2024-03-30T12:20:36.004800+0000","last_clean":"2024-03-30T12:20:36.004800+0000","last_became_active":"2024-03-30T12:19:00.852216+0000","last_became_peered":"2024-03-30T12:19:00.852216+0000","last_unstale":"2024-03-30T12:20:36.004800+0000","last_undegraded":"2024-03-30T12:20:36.004800+0000","last_fullsized":"2024-03-30T12:20:36.004800+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:41:21.462303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.009325+0000","last_change":"2024-03-30T12:19:00.470266+0000","last_active":"2024-03-30T12:20:36.009325+0000","last_peered":"2024-03-30T12:20:36.009325+0000","last_clean":"2024-03-30T12:20:36.009325+0000","last_became_active":"2024-03-30T12:19:00.469541+0000","last_became_peered":"2024-03-30T12:19:00.469541+0000","last_unstale":"2024-03-30T12:20:36.009325+0000","last_undegraded":"2024-03-30T12:20:36.009325+0000","last_fullsized":"2024-03-30T12:20:36.009325+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:57.244620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005044+0000","last_change":"2024-03-30T12:19:35.162977+0000","last_active":"2024-03-30T12:20:36.005044+0000","last_peered":"2024-03-30T12:20:36.005044+0000","last_clean":"2024-03-30T12:20:36.005044+0000","last_became_active":"2024-03-30T12:19:35.162514+0000","last_became_peered":"2024-03-30T12:19:35.162514+0000","last_unstale":"2024-03-30T12:20:36.005044+0000","last_undegraded":"2024-03-30T12:20:36.005044+0000","last_fullsized":"2024-03-30T12:20:36.005044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:39:43.550849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010313+0000","last_change":"2024-03-30T12:19:00.469567+0000","last_active":"2024-03-30T12:20:36.010313+0000","last_peered":"2024-03-30T12:20:36.010313+0000","last_clean":"2024-03-30T12:20:36.010313+0000","last_became_active":"2024-03-30T12:19:00.469218+0000","last_became_peered":"2024-03-30T12:19:00.469218+0000","last_unstale":"2024-03-30T12:20:36.010313+0000","last_undegraded":"2024-03-30T12:20:36.010313+0000","last_fullsized":"2024-03-30T12:20:36.010313+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:16:05.609865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004993+0000","last_change":"2024-03-30T12:19:00.865798+0000","last_active":"2024-03-30T12:20:36.004993+0000","last_peered":"2024-03-30T12:20:36.004993+0000","last_clean":"2024-03-30T12:20:36.004993+0000","last_became_active":"2024-03-30T12:19:00.865518+0000","last_became_peered":"2024-03-30T12:19:00.865518+0000","last_unstale":"2024-03-30T12:20:36.004993+0000","last_undegraded":"2024-03-30T12:20:36.004993+0000","last_fullsized":"2024-03-30T12:20:36.004993+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:47:41.818140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002238+0000","last_change":"2024-03-30T12:19:35.162768+0000","last_active":"2024-03-30T12:20:36.002238+0000","last_peered":"2024-03-30T12:20:36.002238+0000","last_clean":"2024-03-30T12:20:36.002238+0000","last_became_active":"2024-03-30T12:19:35.162480+0000","last_became_peered":"2024-03-30T12:19:35.162480+0000","last_unstale":"2024-03-30T12:20:36.002238+0000","last_undegraded":"2024-03-30T12:20:36.002238+0000","last_fullsized":"2024-03-30T12:20:36.002238+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:17:01.235481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"62'1","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005424+0000","last_change":"2024-03-30T12:19:00.454554+0000","last_active":"2024-03-30T12:20:36.005424+0000","last_peered":"2024-03-30T12:20:36.005424+0000","last_clean":"2024-03-30T12:20:36.005424+0000","last_became_active":"2024-03-30T12:19:00.454233+0000","last_became_peered":"2024-03-30T12:19:00.454233+0000","last_unstale":"2024-03-30T12:20:36.005424+0000","last_undegraded":"2024-03-30T12:20:36.005424+0000","last_fullsized":"2024-03-30T12:20:36.005424+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:05:09.010127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003621+0000","last_change":"2024-03-30T12:19:00.853806+0000","last_active":"2024-03-30T12:20:36.003621+0000","last_peered":"2024-03-30T12:20:36.003621+0000","last_clean":"2024-03-30T12:20:36.003621+0000","last_became_active":"2024-03-30T12:19:00.853538+0000","last_became_peered":"2024-03-30T12:19:00.853538+0000","last_unstale":"2024-03-30T12:20:36.003621+0000","last_undegraded":"2024-03-30T12:20:36.003621+0000","last_fullsized":"2024-03-30T12:20:36.003621+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:36:10.741436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006059+0000","last_change":"2024-03-30T12:19:35.162679+0000","last_active":"2024-03-30T12:20:36.006059+0000","last_peered":"2024-03-30T12:20:36.006059+0000","last_clean":"2024-03-30T12:20:36.006059+0000","last_became_active":"2024-03-30T12:19:35.162347+0000","last_became_peered":"2024-03-30T12:19:35.162347+0000","last_unstale":"2024-03-30T12:20:36.006059+0000","last_undegraded":"2024-03-30T12:20:36.006059+0000","last_fullsized":"2024-03-30T12:20:36.006059+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:24:16.565563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007662+0000","last_change":"2024-03-30T12:19:00.460279+0000","last_active":"2024-03-30T12:20:36.007662+0000","last_peered":"2024-03-30T12:20:36.007662+0000","last_clean":"2024-03-30T12:20:36.007662+0000","last_became_active":"2024-03-30T12:19:00.459948+0000","last_became_peered":"2024-03-30T12:19:00.459948+0000","last_unstale":"2024-03-30T12:20:36.007662+0000","last_undegraded":"2024-03-30T12:20:36.007662+0000","last_fullsized":"2024-03-30T12:20:36.007662+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:06.870147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006440+0000","last_change":"2024-03-30T12:19:00.853029+0000","last_active":"2024-03-30T12:20:36.006440+0000","last_peered":"2024-03-30T12:20:36.006440+0000","last_clean":"2024-03-30T12:20:36.006440+0000","last_became_active":"2024-03-30T12:19:00.852755+0000","last_became_peered":"2024-03-30T12:19:00.852755+0000","last_unstale":"2024-03-30T12:20:36.006440+0000","last_undegraded":"2024-03-30T12:20:36.006440+0000","last_fullsized":"2024-03-30T12:20:36.006440+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:03:44.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.009471+0000","last_change":"2024-03-30T12:19:00.470521+0000","last_active":"2024-03-30T12:20:36.009471+0000","last_peered":"2024-03-30T12:20:36.009471+0000","last_clean":"2024-03-30T12:20:36.009471+0000","last_became_active":"2024-03-30T12:19:00.469910+0000","last_became_peered":"2024-03-30T12:19:00.469910+0000","last_unstale":"2024-03-30T12:20:36.009471+0000","last_undegraded":"2024-03-30T12:20:36.009471+0000","last_fullsized":"2024-03-30T12:20:36.009471+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:12:52.044394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006007+0000","last_change":"2024-03-30T12:19:00.877240+0000","last_active":"2024-03-30T12:20:36.006007+0000","last_peered":"2024-03-30T12:20:36.006007+0000","last_clean":"2024-03-30T12:20:36.006007+0000","last_became_active":"2024-03-30T12:19:00.876739+0000","last_became_peered":"2024-03-30T12:19:00.876739+0000","last_unstale":"2024-03-30T12:20:36.006007+0000","last_undegraded":"2024-03-30T12:20:36.006007+0000","last_fullsized":"2024-03-30T12:20:36.006007+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:25.328486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004711+0000","last_change":"2024-03-30T12:19:00.459528+0000","last_active":"2024-03-30T12:20:36.004711+0000","last_peered":"2024-03-30T12:20:36.004711+0000","last_clean":"2024-03-30T12:20:36.004711+0000","last_became_active":"2024-03-30T12:19:00.459223+0000","last_became_peered":"2024-03-30T12:19:00.459223+0000","last_unstale":"2024-03-30T12:20:36.004711+0000","last_undegraded":"2024-03-30T12:20:36.004711+0000","last_fullsized":"2024-03-30T12:20:36.004711+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:44.399783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002268+0000","last_change":"2024-03-30T12:19:00.850810+0000","last_active":"2024-03-30T12:20:36.002268+0000","last_peered":"2024-03-30T12:20:36.002268+0000","last_clean":"2024-03-30T12:20:36.002268+0000","last_became_active":"2024-03-30T12:19:00.850530+0000","last_became_peered":"2024-03-30T12:19:00.850530+0000","last_unstale":"2024-03-30T12:20:36.002268+0000","last_undegraded":"2024-03-30T12:20:36.002268+0000","last_fullsized":"2024-03-30T12:20:36.002268+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:52:32.869322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":27,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-30T12:20:37.009330+0000","last_change":"2024-03-30T12:20:37.009330+0000","last_active":"2024-03-30T12:20:37.009330+0000","last_peered":"2024-03-30T12:20:37.009330+0000","last_clean":"2024-03-30T12:20:37.009330+0000","last_became_active":"2024-03-30T12:20:37.008926+0000","last_became_peered":"2024-03-30T12:20:37.008926+0000","last_unstale":"2024-03-30T12:20:37.009330+0000","last_undegraded":"2024-03-30T12:20:37.009330+0000","last_fullsized":"2024-03-30T12:20:37.009330+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:39.113599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003395+0000","last_change":"2024-03-30T12:19:00.858733+0000","last_active":"2024-03-30T12:20:36.003395+0000","last_peered":"2024-03-30T12:20:36.003395+0000","last_clean":"2024-03-30T12:20:36.003395+0000","last_became_active":"2024-03-30T12:19:00.858419+0000","last_became_peered":"2024-03-30T12:19:00.858419+0000","last_unstale":"2024-03-30T12:20:36.003395+0000","last_undegraded":"2024-03-30T12:20:36.003395+0000","last_fullsized":"2024-03-30T12:20:36.003395+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:43.731796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"61'2","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.009844+0000","last_change":"2024-03-30T12:19:00.468017+0000","last_active":"2024-03-30T12:20:36.009844+0000","last_peered":"2024-03-30T12:20:36.009844+0000","last_clean":"2024-03-30T12:20:36.009844+0000","last_became_active":"2024-03-30T12:19:00.466979+0000","last_became_peered":"2024-03-30T12:19:00.466979+0000","last_unstale":"2024-03-30T12:20:36.009844+0000","last_undegraded":"2024-03-30T12:20:36.009844+0000","last_fullsized":"2024-03-30T12:20:36.009844+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:41:36.480109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007191+0000","last_change":"2024-03-30T12:19:00.869001+0000","last_active":"2024-03-30T12:20:36.007191+0000","last_peered":"2024-03-30T12:20:36.007191+0000","last_clean":"2024-03-30T12:20:36.007191+0000","last_became_active":"2024-03-30T12:19:00.868645+0000","last_became_peered":"2024-03-30T12:19:00.868645+0000","last_unstale":"2024-03-30T12:20:36.007191+0000","last_undegraded":"2024-03-30T12:20:36.007191+0000","last_fullsized":"2024-03-30T12:20:36.007191+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:54:10.778279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006475+0000","last_change":"2024-03-30T12:19:00.459171+0000","last_active":"2024-03-30T12:20:36.006475+0000","last_peered":"2024-03-30T12:20:36.006475+0000","last_clean":"2024-03-30T12:20:36.006475+0000","last_became_active":"2024-03-30T12:19:00.458925+0000","last_became_peered":"2024-03-30T12:19:00.458925+0000","last_unstale":"2024-03-30T12:20:36.006475+0000","last_undegraded":"2024-03-30T12:20:36.006475+0000","last_fullsized":"2024-03-30T12:20:36.006475+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:26:20.974369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010188+0000","last_change":"2024-03-30T12:19:00.875558+0000","last_active":"2024-03-30T12:20:36.010188+0000","last_peered":"2024-03-30T12:20:36.010188+0000","last_clean":"2024-03-30T12:20:36.010188+0000","last_became_active":"2024-03-30T12:19:00.875216+0000","last_became_peered":"2024-03-30T12:19:00.875216+0000","last_unstale":"2024-03-30T12:20:36.010188+0000","last_undegraded":"2024-03-30T12:20:36.010188+0000","last_fullsized":"2024-03-30T12:20:36.010188+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:27:04.763910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"61'1","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005078+0000","last_change":"2024-03-30T12:19:00.459545+0000","last_active":"2024-03-30T12:20:36.005078+0000","last_peered":"2024-03-30T12:20:36.005078+0000","last_clean":"2024-03-30T12:20:36.005078+0000","last_became_active":"2024-03-30T12:19:00.459250+0000","last_became_peered":"2024-03-30T12:19:00.459250+0000","last_unstale":"2024-03-30T12:20:36.005078+0000","last_undegraded":"2024-03-30T12:20:36.005078+0000","last_fullsized":"2024-03-30T12:20:36.005078+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:38.112815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003319+0000","last_change":"2024-03-30T12:19:00.852558+0000","last_active":"2024-03-30T12:20:36.003319+0000","last_peered":"2024-03-30T12:20:36.003319+0000","last_clean":"2024-03-30T12:20:36.003319+0000","last_became_active":"2024-03-30T12:19:00.852250+0000","last_became_peered":"2024-03-30T12:19:00.852250+0000","last_unstale":"2024-03-30T12:20:36.003319+0000","last_undegraded":"2024-03-30T12:20:36.003319+0000","last_fullsized":"2024-03-30T12:20:36.003319+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:57:15.989801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"61'2","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006568+0000","last_change":"2024-03-30T12:19:00.464968+0000","last_active":"2024-03-30T12:20:36.006568+0000","last_peered":"2024-03-30T12:20:36.006568+0000","last_clean":"2024-03-30T12:20:36.006568+0000","last_became_active":"2024-03-30T12:19:00.464021+0000","last_became_peered":"2024-03-30T12:19:00.464021+0000","last_unstale":"2024-03-30T12:20:36.006568+0000","last_undegraded":"2024-03-30T12:20:36.006568+0000","last_fullsized":"2024-03-30T12:20:36.006568+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:20.224884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010284+0000","last_change":"2024-03-30T12:19:00.871645+0000","last_active":"2024-03-30T12:20:36.010284+0000","last_peered":"2024-03-30T12:20:36.010284+0000","last_clean":"2024-03-30T12:20:36.010284+0000","last_became_active":"2024-03-30T12:19:00.871376+0000","last_became_peered":"2024-03-30T12:19:00.871376+0000","last_unstale":"2024-03-30T12:20:36.010284+0000","last_undegraded":"2024-03-30T12:20:36.010284+0000","last_fullsized":"2024-03-30T12:20:36.010284+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:54:57.281972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005731+0000","last_change":"2024-03-30T12:19:00.862859+0000","last_active":"2024-03-30T12:20:36.005731+0000","last_peered":"2024-03-30T12:20:36.005731+0000","last_clean":"2024-03-30T12:20:36.005731+0000","last_became_active":"2024-03-30T12:19:00.862535+0000","last_became_peered":"2024-03-30T12:19:00.862535+0000","last_unstale":"2024-03-30T12:20:36.005731+0000","last_undegraded":"2024-03-30T12:20:36.005731+0000","last_fullsized":"2024-03-30T12:20:36.005731+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:17:31.462763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005669+0000","last_change":"2024-03-30T12:19:00.862947+0000","last_active":"2024-03-30T12:20:36.005669+0000","last_peered":"2024-03-30T12:20:36.005669+0000","last_clean":"2024-03-30T12:20:36.005669+0000","last_became_active":"2024-03-30T12:19:00.862567+0000","last_became_peered":"2024-03-30T12:19:00.862567+0000","last_unstale":"2024-03-30T12:20:36.005669+0000","last_undegraded":"2024-03-30T12:20:36.005669+0000","last_fullsized":"2024-03-30T12:20:36.005669+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:55:05.422370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003048+0000","last_change":"2024-03-30T12:19:00.856869+0000","last_active":"2024-03-30T12:20:36.003048+0000","last_peered":"2024-03-30T12:20:36.003048+0000","last_clean":"2024-03-30T12:20:36.003048+0000","last_became_active":"2024-03-30T12:19:00.856525+0000","last_became_peered":"2024-03-30T12:19:00.856525+0000","last_unstale":"2024-03-30T12:20:36.003048+0000","last_undegraded":"2024-03-30T12:20:36.003048+0000","last_fullsized":"2024-03-30T12:20:36.003048+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:01:47.443294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005121+0000","last_change":"2024-03-30T12:19:00.859724+0000","last_active":"2024-03-30T12:20:36.005121+0000","last_peered":"2024-03-30T12:20:36.005121+0000","last_clean":"2024-03-30T12:20:36.005121+0000","last_became_active":"2024-03-30T12:19:00.859327+0000","last_became_peered":"2024-03-30T12:19:00.859327+0000","last_unstale":"2024-03-30T12:20:36.005121+0000","last_undegraded":"2024-03-30T12:20:36.005121+0000","last_fullsized":"2024-03-30T12:20:36.005121+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:53:15.692683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-30T12:20:37.009224+0000","last_change":"2024-03-30T12:20:37.009224+0000","last_active":"2024-03-30T12:20:37.009224+0000","last_peered":"2024-03-30T12:20:37.009224+0000","last_clean":"2024-03-30T12:20:37.009224+0000","last_became_active":"2024-03-30T12:20:37.008947+0000","last_became_peered":"2024-03-30T12:20:37.008947+0000","last_unstale":"2024-03-30T12:20:37.009224+0000","last_undegraded":"2024-03-30T12:20:37.009224+0000","last_fullsized":"2024-03-30T12:20:37.009224+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:42:16.251343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005045+0000","last_change":"2024-03-30T12:19:00.848297+0000","last_active":"2024-03-30T12:20:36.005045+0000","last_peered":"2024-03-30T12:20:36.005045+0000","last_clean":"2024-03-30T12:20:36.005045+0000","last_became_active":"2024-03-30T12:19:00.848029+0000","last_became_peered":"2024-03-30T12:19:00.848029+0000","last_unstale":"2024-03-30T12:20:36.005045+0000","last_undegraded":"2024-03-30T12:20:36.005045+0000","last_fullsized":"2024-03-30T12:20:36.005045+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:38.617413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007908+0000","last_change":"2024-03-30T12:19:00.869414+0000","last_active":"2024-03-30T12:20:36.007908+0000","last_peered":"2024-03-30T12:20:36.007908+0000","last_clean":"2024-03-30T12:20:36.007908+0000","last_became_active":"2024-03-30T12:19:00.869115+0000","last_became_peered":"2024-03-30T12:19:00.869115+0000","last_unstale":"2024-03-30T12:20:36.007908+0000","last_undegraded":"2024-03-30T12:20:36.007908+0000","last_fullsized":"2024-03-30T12:20:36.007908+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:01:12.173692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004112+0000","last_change":"2024-03-30T12:19:00.856088+0000","last_active":"2024-03-30T12:20:36.004112+0000","last_peered":"2024-03-30T12:20:36.004112+0000","last_clean":"2024-03-30T12:20:36.004112+0000","last_became_active":"2024-03-30T12:19:00.855480+0000","last_became_peered":"2024-03-30T12:19:00.855480+0000","last_unstale":"2024-03-30T12:20:36.004112+0000","last_undegraded":"2024-03-30T12:20:36.004112+0000","last_fullsized":"2024-03-30T12:20:36.004112+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:21:16.961559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002998+0000","last_change":"2024-03-30T12:19:00.854668+0000","last_active":"2024-03-30T12:20:36.002998+0000","last_peered":"2024-03-30T12:20:36.002998+0000","last_clean":"2024-03-30T12:20:36.002998+0000","last_became_active":"2024-03-30T12:19:00.854390+0000","last_became_peered":"2024-03-30T12:19:00.854390+0000","last_unstale":"2024-03-30T12:20:36.002998+0000","last_undegraded":"2024-03-30T12:20:36.002998+0000","last_fullsized":"2024-03-30T12:20:36.002998+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:39:22.128098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002372+0000","last_change":"2024-03-30T12:19:00.851282+0000","last_active":"2024-03-30T12:20:36.002372+0000","last_peered":"2024-03-30T12:20:36.002372+0000","last_clean":"2024-03-30T12:20:36.002372+0000","last_became_active":"2024-03-30T12:19:00.850915+0000","last_became_peered":"2024-03-30T12:19:00.850915+0000","last_unstale":"2024-03-30T12:20:36.002372+0000","last_undegraded":"2024-03-30T12:20:36.002372+0000","last_fullsized":"2024-03-30T12:20:36.002372+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:46:50.526568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003102+0000","last_change":"2024-03-30T12:19:00.860406+0000","last_active":"2024-03-30T12:20:36.003102+0000","last_peered":"2024-03-30T12:20:36.003102+0000","last_clean":"2024-03-30T12:20:36.003102+0000","last_became_active":"2024-03-30T12:19:00.860085+0000","last_became_peered":"2024-03-30T12:19:00.860085+0000","last_unstale":"2024-03-30T12:20:36.003102+0000","last_undegraded":"2024-03-30T12:20:36.003102+0000","last_fullsized":"2024-03-30T12:20:36.003102+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:32.201939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005496+0000","last_change":"2024-03-30T12:19:00.856917+0000","last_active":"2024-03-30T12:20:36.005496+0000","last_peered":"2024-03-30T12:20:36.005496+0000","last_clean":"2024-03-30T12:20:36.005496+0000","last_became_active":"2024-03-30T12:19:00.856643+0000","last_became_peered":"2024-03-30T12:19:00.856643+0000","last_unstale":"2024-03-30T12:20:36.005496+0000","last_undegraded":"2024-03-30T12:20:36.005496+0000","last_fullsized":"2024-03-30T12:20:36.005496+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:51:53.996045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007615+0000","last_change":"2024-03-30T12:19:00.867176+0000","last_active":"2024-03-30T12:20:36.007615+0000","last_peered":"2024-03-30T12:20:36.007615+0000","last_clean":"2024-03-30T12:20:36.007615+0000","last_became_active":"2024-03-30T12:19:00.866801+0000","last_became_peered":"2024-03-30T12:19:00.866801+0000","last_unstale":"2024-03-30T12:20:36.007615+0000","last_undegraded":"2024-03-30T12:20:36.007615+0000","last_fullsized":"2024-03-30T12:20:36.007615+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:31:22.909206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3148,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":9444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234012,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32384,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712768,"statfs":{"total":95995035648,"available":95961874432,"internally_reserved":0,"allocated":1294336,"data_stored":893025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.47299999999999998}]},{"osd":1,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.5}]},{"osd":2,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.40799999999999997}]},{"osd":3,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.45000000000000001}]},{"osd":4,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.31}]},{"osd":5,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.43099999999999999}]},{"osd":6,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.35099999999999998}]}]},{"osd":6,"up_from":46,"seq":197568495648,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28292,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716860,"statfs":{"total":95995035648,"available":95966064640,"internally_reserved":0,"allocated":1298432,"data_stored":894829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.52500000000000002,"15min":0.53200000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.73599999999999999,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.41399999999999998}]},{"osd":1,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77900000000000003,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.434},{"interface":"front","average":{"1min":0.505,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.35499999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.67900000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.45200000000000001}]},{"osd":2,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53800000000000003,"15min":0.54300000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.67100000000000004,"5min":1.044,"15min":1.044},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70399999999999996,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.442}]},{"osd":3,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73399999999999999,"5min":0.754,"15min":0.754},"last":0.373},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.38900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.72199999999999998,"5min":1.006,"15min":1.006},"last":0.34899999999999998}]},{"osd":4,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.41999999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.33000000000000002}]},{"osd":5,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.42799999999999999,"15min":0.42199999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.45800000000000002,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.40500000000000003}]},{"osd":7,"last update":"Sat Mar 30 12:20:46 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.5,"15min":0.501},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.497,"15min":0.49299999999999999},"min":{"1min":0.35299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.46300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31800,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713352,"statfs":{"total":95995035648,"available":95962472448,"internally_reserved":0,"allocated":696320,"data_stored":301998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:20:24 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34200000000000003,"15min":0.313},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.44700000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.37,"15min":0.33000000000000002},"min":{"1min":0.23100000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.46100000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.376}]},{"osd":2,"last update":"Sat Mar 30 12:19:46 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38,"15min":0.374},"min":{"1min":0.247,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.54300000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39600000000000002,"15min":0.38900000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56399999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.29099999999999998}]},{"osd":3,"last update":"Sat Mar 30 12:20:13 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.27400000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55300000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.46500000000000002,"15min":0.47699999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58499999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.39900000000000002}]},{"osd":4,"last update":"Sat Mar 30 12:20:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.751}]},{"osd":5,"last update":"Sat Mar 30 12:19:54 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59199999999999997,"15min":0.58899999999999997},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.80000000000000004}]},{"osd":6,"last update":"Sat Mar 30 12:20:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.59399999999999997,"15min":0.59999999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60299999999999998,"15min":0.60599999999999998},"min":{"1min":0.46100000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.77600000000000002}]},{"osd":7,"last update":"Sat Mar 30 12:19:45 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.78500000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32396,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712756,"statfs":{"total":95995035648,"available":95961862144,"internally_reserved":0,"allocated":1306624,"data_stored":893480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 30 12:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.32800000000000001,"15min":0.30199999999999999},"min":{"1min":0.191,"5min":0.183,"15min":0.183},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.36199999999999999,"15min":0.318},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.58199999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.32600000000000001}]},{"osd":2,"last update":"Sat Mar 30 12:19:48 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.41999999999999998,"15min":0.41799999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.57199999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.40799999999999997,"15min":0.40400000000000003},"min":{"1min":0.23699999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56299999999999994,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.26100000000000001}]},{"osd":3,"last update":"Sat Mar 30 12:20:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.27500000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.45400000000000001,"15min":0.45800000000000002},"min":{"1min":0.314,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68600000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.30499999999999999}]},{"osd":4,"last update":"Sat Mar 30 12:20:31 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73399999999999999,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.38200000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.753,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.55800000000000005}]},{"osd":5,"last update":"Sat Mar 30 12:19:59 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.41099999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.76400000000000001,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.56899999999999995}]},{"osd":6,"last update":"Sat Mar 30 12:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76000000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54300000000000004}]},{"osd":7,"last update":"Sat Mar 30 12:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.48299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79100000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59899999999999998,"15min":0.59799999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.746,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.48499999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411379,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31796,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713356,"statfs":{"total":95995035648,"available":95962476544,"internally_reserved":0,"allocated":692224,"data_stored":302111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:19:50 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.34999999999999998,"15min":0.34300000000000003},"min":{"1min":0.254,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.251},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.377,"15min":0.379},"min":{"1min":0.27500000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.46899999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.31}]},{"osd":1,"last update":"Sat Mar 30 12:19:50 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26100000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.47799999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.38900000000000001,"15min":0.38300000000000001},"min":{"1min":0.246,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59799999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.35299999999999998}]},{"osd":3,"last update":"Sat Mar 30 12:20:13 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45200000000000001,"15min":0.44800000000000001},"min":{"1min":0.32300000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.44500000000000001,"15min":0.45300000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.38600000000000001}]},{"osd":4,"last update":"Sat Mar 30 12:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54100000000000004,"15min":0.54300000000000004},"min":{"1min":0.378,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.39100000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.498}]},{"osd":5,"last update":"Sat Mar 30 12:20:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":1.3400000000000001,"15min":1.474},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86799999999999999,"5min":19.606999999999999,"15min":19.606999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.42299999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.746,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.434}]},{"osd":6,"last update":"Sat Mar 30 12:20:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.40799999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.87,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.54500000000000004}]},{"osd":7,"last update":"Sat Mar 30 12:20:46 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.44500000000000001,"5min":0.438,"15min":0.438},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.58999999999999997}]}]},{"osd":3,"up_from":25,"seq":107374182446,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717432,"statfs":{"total":95995035648,"available":95966650368,"internally_reserved":0,"allocated":716800,"data_stored":304838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:20:13 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39500000000000002,"15min":0.40300000000000002},"min":{"1min":0.25700000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.41299999999999998,"15min":0.41999999999999998},"min":{"1min":0.26200000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.50600000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.33300000000000002}]},{"osd":1,"last update":"Sat Mar 30 12:20:13 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.61799999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.438,"15min":0.443},"min":{"1min":0.33100000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57199999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.38900000000000001}]},{"osd":2,"last update":"Sat Mar 30 12:20:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.45500000000000002,"15min":0.46200000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.42799999999999999,"15min":0.434},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.629,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.36699999999999999}]},{"osd":4,"last update":"Sat Mar 30 12:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.64600000000000002,"15min":0.68400000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.753,"5min":4.8639999999999999,"15min":4.8639999999999999},"last":0.62},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57199999999999995,"15min":0.56000000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81299999999999994,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.751}]},{"osd":5,"last update":"Sat Mar 30 12:19:56 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.622,"15min":0.628},"min":{"1min":0.41299999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.39600000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.71999999999999997}]},{"osd":6,"last update":"Sat Mar 30 12:20:20 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.435,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82599999999999996,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.74399999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.73599999999999999}]},{"osd":7,"last update":"Sat Mar 30 12:20:46 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60499999999999998,"15min":0.60899999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81000000000000005,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.629,"15min":0.629},"min":{"1min":0.44800000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.77400000000000002}]}]},{"osd":4,"up_from":30,"seq":128849018921,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717444,"statfs":{"total":95995035648,"available":95966662656,"internally_reserved":0,"allocated":704512,"data_stored":302546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:20:34 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.63600000000000001,"15min":0.57999999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.73599999999999999,"5min":9.5069999999999997,"15min":9.5069999999999997},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51300000000000001,"15min":0.50800000000000001},"min":{"1min":0.29699999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.55100000000000005}]},{"osd":1,"last update":"Sat Mar 30 12:20:34 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51700000000000002,"15min":0.51400000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.61899999999999999,"15min":0.53200000000000003},"min":{"1min":0.38400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.98499999999999999,"5min":11.534000000000001,"15min":11.534000000000001},"last":0.437}]},{"osd":2,"last update":"Sat Mar 30 12:20:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.41199999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.36799999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.49199999999999999}]},{"osd":3,"last update":"Sat Mar 30 12:20:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53300000000000003,"15min":0.52300000000000002},"min":{"1min":0.40300000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.748,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.41299999999999998}]},{"osd":5,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.434,"15min":0.436},"min":{"1min":0.311,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.64900000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.437,"5min":0.42999999999999999,"15min":0.42899999999999999},"min":{"1min":0.32700000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70999999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.50900000000000001}]},{"osd":6,"last update":"Sat Mar 30 12:20:23 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.45300000000000001,"15min":0.45100000000000001},"min":{"1min":0.316,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69799999999999995,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68700000000000006,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.61799999999999999}]},{"osd":7,"last update":"Sat Mar 30 12:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70399999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.502,"15min":0.501},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71299999999999997,"5min":0.751,"15min":0.751},"last":0.56799999999999995}]}]},{"osd":5,"up_from":38,"seq":163208757285,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31816,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713336,"statfs":{"total":95995035648,"available":95962456064,"internally_reserved":0,"allocated":712704,"data_stored":304824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.36699999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51900000000000002,"15min":0.52100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70799999999999996,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.66100000000000003}]},{"osd":1,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72599999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.40200000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63800000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.68799999999999994}]},{"osd":2,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51500000000000001,"15min":0.51600000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70899999999999996,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52500000000000002,"15min":0.52800000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.64200000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.52300000000000002}]},{"osd":3,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.73599999999999999,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53600000000000003,"15min":0.54000000000000004},"min":{"1min":0.41599999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.59399999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.69499999999999995}]},{"osd":4,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39400000000000002,"15min":0.39000000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.40200000000000002,"15min":0.39300000000000002},"min":{"1min":0.28399999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.46300000000000002}]},{"osd":6,"last update":"Sat Mar 30 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.434,"15min":0.42999999999999999},"min":{"1min":0.32200000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.443,"15min":0.438},"min":{"1min":0.36299999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.42299999999999999}]},{"osd":7,"last update":"Sat Mar 30 12:19:43 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.47499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:20:51.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:50 smithi162 ceph-mon[30421]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:20:51.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:50 smithi162 ceph-mon[30421]: pgmap v43: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:51.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:50 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:20:51.160 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:50 smithi084 ceph-mon[27000]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:20:51.160 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:50 smithi084 ceph-mon[27000]: pgmap v43: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:51.161 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:50 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:20:51.161 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:50 smithi084 ceph-mon[37565]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:20:51.161 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:50 smithi084 ceph-mon[37565]: pgmap v43: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:51.161 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:50 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:20:52.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:52 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:52.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:52 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:52.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:52 smithi162 ceph-mon[30421]: pgmap v44: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:52.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:52 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:52.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:52 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:52.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:52 smithi084 ceph-mon[27000]: pgmap v44: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:52.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:52 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:52.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:52 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:52.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:52 smithi084 ceph-mon[37565]: pgmap v44: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:53.004 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:20:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[73215]: ts=2024-03-30T12:20:52.560Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.002745518s 2024-03-30T12:20:53.055 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:20:53.264 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:20:53.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:53 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:53.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:53 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:53.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:53 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:20:53.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:53 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:20:53.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:53 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:53.374 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:53 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:53.374 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:53 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:53.375 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:53 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:20:53.375 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:53 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:20:53.375 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:53 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:53.375 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:53 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:53.375 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:53 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:53.375 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:53 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:20:53.375 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:53 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:20:53.375 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:53 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:20:54.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:54 smithi162 ceph-mon[30421]: pgmap v45: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:54.378 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:54 smithi084 ceph-mon[37565]: pgmap v45: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:54.378 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:54 smithi084 ceph-mon[27000]: pgmap v45: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:55.127 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:20:55.129 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:20:55.766 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-03-30T12:20:53.840348+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593516,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":227,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":315,"acting":315,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":315,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":243912,"kb_used_data":7248,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":749717304,"statfs":{"total":767960285184,"available":767710519296,"internally_reserved":0,"allocated":7421952,"data_stored":4197651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":242208312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002361"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010417+0000","last_change":"2024-03-30T12:19:00.863340+0000","last_active":"2024-03-30T12:20:36.010417+0000","last_peered":"2024-03-30T12:20:36.010417+0000","last_clean":"2024-03-30T12:20:36.010417+0000","last_became_active":"2024-03-30T12:19:00.863041+0000","last_became_peered":"2024-03-30T12:19:00.863041+0000","last_unstale":"2024-03-30T12:20:36.010417+0000","last_undegraded":"2024-03-30T12:20:36.010417+0000","last_fullsized":"2024-03-30T12:20:36.010417+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:21.728523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-30T12:20:37.241613+0000","last_change":"2024-03-30T12:20:37.241613+0000","last_active":"2024-03-30T12:20:37.241613+0000","last_peered":"2024-03-30T12:20:37.241613+0000","last_clean":"2024-03-30T12:20:37.241613+0000","last_became_active":"2024-03-30T12:20:37.241258+0000","last_became_peered":"2024-03-30T12:20:37.241258+0000","last_unstale":"2024-03-30T12:20:37.241613+0000","last_undegraded":"2024-03-30T12:20:37.241613+0000","last_fullsized":"2024-03-30T12:20:37.241613+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:23:14.775585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006611+0000","last_change":"2024-03-30T12:19:00.853843+0000","last_active":"2024-03-30T12:20:36.006611+0000","last_peered":"2024-03-30T12:20:36.006611+0000","last_clean":"2024-03-30T12:20:36.006611+0000","last_became_active":"2024-03-30T12:19:00.853543+0000","last_became_peered":"2024-03-30T12:19:00.853543+0000","last_unstale":"2024-03-30T12:20:36.006611+0000","last_undegraded":"2024-03-30T12:20:36.006611+0000","last_fullsized":"2024-03-30T12:20:36.006611+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:52.339142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003242+0000","last_change":"2024-03-30T12:19:00.859974+0000","last_active":"2024-03-30T12:20:36.003242+0000","last_peered":"2024-03-30T12:20:36.003242+0000","last_clean":"2024-03-30T12:20:36.003242+0000","last_became_active":"2024-03-30T12:19:00.859615+0000","last_became_peered":"2024-03-30T12:19:00.859615+0000","last_unstale":"2024-03-30T12:20:36.003242+0000","last_undegraded":"2024-03-30T12:20:36.003242+0000","last_fullsized":"2024-03-30T12:20:36.003242+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:50:26.933772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010028+0000","last_change":"2024-03-30T12:19:00.872400+0000","last_active":"2024-03-30T12:20:36.010028+0000","last_peered":"2024-03-30T12:20:36.010028+0000","last_clean":"2024-03-30T12:20:36.010028+0000","last_became_active":"2024-03-30T12:19:00.872098+0000","last_became_peered":"2024-03-30T12:19:00.872098+0000","last_unstale":"2024-03-30T12:20:36.010028+0000","last_undegraded":"2024-03-30T12:20:36.010028+0000","last_fullsized":"2024-03-30T12:20:36.010028+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:21.152462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003182+0000","last_change":"2024-03-30T12:19:00.858029+0000","last_active":"2024-03-30T12:20:36.003182+0000","last_peered":"2024-03-30T12:20:36.003182+0000","last_clean":"2024-03-30T12:20:36.003182+0000","last_became_active":"2024-03-30T12:19:00.857668+0000","last_became_peered":"2024-03-30T12:19:00.857668+0000","last_unstale":"2024-03-30T12:20:36.003182+0000","last_undegraded":"2024-03-30T12:20:36.003182+0000","last_fullsized":"2024-03-30T12:20:36.003182+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:17:33.313541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.009440+0000","last_change":"2024-03-30T12:19:00.869258+0000","last_active":"2024-03-30T12:20:36.009440+0000","last_peered":"2024-03-30T12:20:36.009440+0000","last_clean":"2024-03-30T12:20:36.009440+0000","last_became_active":"2024-03-30T12:19:00.868799+0000","last_became_peered":"2024-03-30T12:19:00.868799+0000","last_unstale":"2024-03-30T12:20:36.009440+0000","last_undegraded":"2024-03-30T12:20:36.009440+0000","last_fullsized":"2024-03-30T12:20:36.009440+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:00:11.265094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002183+0000","last_change":"2024-03-30T12:19:00.864240+0000","last_active":"2024-03-30T12:20:36.002183+0000","last_peered":"2024-03-30T12:20:36.002183+0000","last_clean":"2024-03-30T12:20:36.002183+0000","last_became_active":"2024-03-30T12:19:00.863991+0000","last_became_peered":"2024-03-30T12:19:00.863991+0000","last_unstale":"2024-03-30T12:20:36.002183+0000","last_undegraded":"2024-03-30T12:20:36.002183+0000","last_fullsized":"2024-03-30T12:20:36.002183+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:59:30.409530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010374+0000","last_change":"2024-03-30T12:19:00.875226+0000","last_active":"2024-03-30T12:20:36.010374+0000","last_peered":"2024-03-30T12:20:36.010374+0000","last_clean":"2024-03-30T12:20:36.010374+0000","last_became_active":"2024-03-30T12:19:00.874620+0000","last_became_peered":"2024-03-30T12:19:00.874620+0000","last_unstale":"2024-03-30T12:20:36.010374+0000","last_undegraded":"2024-03-30T12:20:36.010374+0000","last_fullsized":"2024-03-30T12:20:36.010374+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:58:40.881840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007746+0000","last_change":"2024-03-30T12:19:00.869363+0000","last_active":"2024-03-30T12:20:36.007746+0000","last_peered":"2024-03-30T12:20:36.007746+0000","last_clean":"2024-03-30T12:20:36.007746+0000","last_became_active":"2024-03-30T12:19:00.868887+0000","last_became_peered":"2024-03-30T12:19:00.868887+0000","last_unstale":"2024-03-30T12:20:36.007746+0000","last_undegraded":"2024-03-30T12:20:36.007746+0000","last_fullsized":"2024-03-30T12:20:36.007746+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:40:49.543161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007751+0000","last_change":"2024-03-30T12:19:00.863992+0000","last_active":"2024-03-30T12:20:36.007751+0000","last_peered":"2024-03-30T12:20:36.007751+0000","last_clean":"2024-03-30T12:20:36.007751+0000","last_became_active":"2024-03-30T12:19:00.863683+0000","last_became_peered":"2024-03-30T12:19:00.863683+0000","last_unstale":"2024-03-30T12:20:36.007751+0000","last_undegraded":"2024-03-30T12:20:36.007751+0000","last_fullsized":"2024-03-30T12:20:36.007751+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:40:36.734391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006652+0000","last_change":"2024-03-30T12:19:00.862541+0000","last_active":"2024-03-30T12:20:36.006652+0000","last_peered":"2024-03-30T12:20:36.006652+0000","last_clean":"2024-03-30T12:20:36.006652+0000","last_became_active":"2024-03-30T12:19:00.862084+0000","last_became_peered":"2024-03-30T12:19:00.862084+0000","last_unstale":"2024-03-30T12:20:36.006652+0000","last_undegraded":"2024-03-30T12:20:36.006652+0000","last_fullsized":"2024-03-30T12:20:36.006652+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:40:36.445232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003202+0000","last_change":"2024-03-30T12:19:00.850148+0000","last_active":"2024-03-30T12:20:36.003202+0000","last_peered":"2024-03-30T12:20:36.003202+0000","last_clean":"2024-03-30T12:20:36.003202+0000","last_became_active":"2024-03-30T12:19:00.849849+0000","last_became_peered":"2024-03-30T12:19:00.849849+0000","last_unstale":"2024-03-30T12:20:36.003202+0000","last_undegraded":"2024-03-30T12:20:36.003202+0000","last_fullsized":"2024-03-30T12:20:36.003202+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:55:56.657057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005013+0000","last_change":"2024-03-30T12:19:00.865479+0000","last_active":"2024-03-30T12:20:36.005013+0000","last_peered":"2024-03-30T12:20:36.005013+0000","last_clean":"2024-03-30T12:20:36.005013+0000","last_became_active":"2024-03-30T12:19:00.864441+0000","last_became_peered":"2024-03-30T12:19:00.864441+0000","last_unstale":"2024-03-30T12:20:36.005013+0000","last_undegraded":"2024-03-30T12:20:36.005013+0000","last_fullsized":"2024-03-30T12:20:36.005013+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:45:55.344815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004635+0000","last_change":"2024-03-30T12:19:00.866672+0000","last_active":"2024-03-30T12:20:36.004635+0000","last_peered":"2024-03-30T12:20:36.004635+0000","last_clean":"2024-03-30T12:20:36.004635+0000","last_became_active":"2024-03-30T12:19:00.866276+0000","last_became_peered":"2024-03-30T12:19:00.866276+0000","last_unstale":"2024-03-30T12:20:36.004635+0000","last_undegraded":"2024-03-30T12:20:36.004635+0000","last_fullsized":"2024-03-30T12:20:36.004635+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:23:49.856597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002869+0000","last_change":"2024-03-30T12:19:00.864760+0000","last_active":"2024-03-30T12:20:36.002869+0000","last_peered":"2024-03-30T12:20:36.002869+0000","last_clean":"2024-03-30T12:20:36.002869+0000","last_became_active":"2024-03-30T12:19:00.864447+0000","last_became_peered":"2024-03-30T12:19:00.864447+0000","last_unstale":"2024-03-30T12:20:36.002869+0000","last_undegraded":"2024-03-30T12:20:36.002869+0000","last_fullsized":"2024-03-30T12:20:36.002869+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:26:47.024806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003577+0000","last_change":"2024-03-30T12:19:00.863453+0000","last_active":"2024-03-30T12:20:36.003577+0000","last_peered":"2024-03-30T12:20:36.003577+0000","last_clean":"2024-03-30T12:20:36.003577+0000","last_became_active":"2024-03-30T12:19:00.863129+0000","last_became_peered":"2024-03-30T12:19:00.863129+0000","last_unstale":"2024-03-30T12:20:36.003577+0000","last_undegraded":"2024-03-30T12:20:36.003577+0000","last_fullsized":"2024-03-30T12:20:36.003577+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:19:33.658159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006652+0000","last_change":"2024-03-30T12:19:00.854527+0000","last_active":"2024-03-30T12:20:36.006652+0000","last_peered":"2024-03-30T12:20:36.006652+0000","last_clean":"2024-03-30T12:20:36.006652+0000","last_became_active":"2024-03-30T12:19:00.854238+0000","last_became_peered":"2024-03-30T12:19:00.854238+0000","last_unstale":"2024-03-30T12:20:36.006652+0000","last_undegraded":"2024-03-30T12:20:36.006652+0000","last_fullsized":"2024-03-30T12:20:36.006652+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:50:54.069856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.009897+0000","last_change":"2024-03-30T12:19:00.854461+0000","last_active":"2024-03-30T12:20:36.009897+0000","last_peered":"2024-03-30T12:20:36.009897+0000","last_clean":"2024-03-30T12:20:36.009897+0000","last_became_active":"2024-03-30T12:19:00.854077+0000","last_became_peered":"2024-03-30T12:19:00.854077+0000","last_unstale":"2024-03-30T12:20:36.009897+0000","last_undegraded":"2024-03-30T12:20:36.009897+0000","last_fullsized":"2024-03-30T12:20:36.009897+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:24:10.940443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"61'4","reported_seq":22,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006480+0000","last_change":"2024-03-30T12:19:00.466957+0000","last_active":"2024-03-30T12:20:36.006480+0000","last_peered":"2024-03-30T12:20:36.006480+0000","last_clean":"2024-03-30T12:20:36.006480+0000","last_became_active":"2024-03-30T12:19:00.466689+0000","last_became_peered":"2024-03-30T12:19:00.466689+0000","last_unstale":"2024-03-30T12:20:36.006480+0000","last_undegraded":"2024-03-30T12:20:36.006480+0000","last_fullsized":"2024-03-30T12:20:36.006480+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:07:08.774258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003497+0000","last_change":"2024-03-30T12:19:00.863714+0000","last_active":"2024-03-30T12:20:36.003497+0000","last_peered":"2024-03-30T12:20:36.003497+0000","last_clean":"2024-03-30T12:20:36.003497+0000","last_became_active":"2024-03-30T12:19:00.863429+0000","last_became_peered":"2024-03-30T12:19:00.863429+0000","last_unstale":"2024-03-30T12:20:36.003497+0000","last_undegraded":"2024-03-30T12:20:36.003497+0000","last_fullsized":"2024-03-30T12:20:36.003497+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:31.953173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"61'1","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003579+0000","last_change":"2024-03-30T12:19:00.459693+0000","last_active":"2024-03-30T12:20:36.003579+0000","last_peered":"2024-03-30T12:20:36.003579+0000","last_clean":"2024-03-30T12:20:36.003579+0000","last_became_active":"2024-03-30T12:19:00.459409+0000","last_became_peered":"2024-03-30T12:19:00.459409+0000","last_unstale":"2024-03-30T12:20:36.003579+0000","last_undegraded":"2024-03-30T12:20:36.003579+0000","last_fullsized":"2024-03-30T12:20:36.003579+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:56:27.891375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006265+0000","last_change":"2024-03-30T12:19:00.864952+0000","last_active":"2024-03-30T12:20:36.006265+0000","last_peered":"2024-03-30T12:20:36.006265+0000","last_clean":"2024-03-30T12:20:36.006265+0000","last_became_active":"2024-03-30T12:19:00.864274+0000","last_became_peered":"2024-03-30T12:19:00.864274+0000","last_unstale":"2024-03-30T12:20:36.006265+0000","last_undegraded":"2024-03-30T12:20:36.006265+0000","last_fullsized":"2024-03-30T12:20:36.006265+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:45:00.775246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010307+0000","last_change":"2024-03-30T12:19:00.469695+0000","last_active":"2024-03-30T12:20:36.010307+0000","last_peered":"2024-03-30T12:20:36.010307+0000","last_clean":"2024-03-30T12:20:36.010307+0000","last_became_active":"2024-03-30T12:19:00.469261+0000","last_became_peered":"2024-03-30T12:19:00.469261+0000","last_unstale":"2024-03-30T12:20:36.010307+0000","last_undegraded":"2024-03-30T12:20:36.010307+0000","last_fullsized":"2024-03-30T12:20:36.010307+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:02:43.407908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003603+0000","last_change":"2024-03-30T12:19:00.859422+0000","last_active":"2024-03-30T12:20:36.003603+0000","last_peered":"2024-03-30T12:20:36.003603+0000","last_clean":"2024-03-30T12:20:36.003603+0000","last_became_active":"2024-03-30T12:19:00.858880+0000","last_became_peered":"2024-03-30T12:19:00.858880+0000","last_unstale":"2024-03-30T12:20:36.003603+0000","last_undegraded":"2024-03-30T12:20:36.003603+0000","last_fullsized":"2024-03-30T12:20:36.003603+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:09.612172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010008+0000","last_change":"2024-03-30T12:19:00.467935+0000","last_active":"2024-03-30T12:20:36.010008+0000","last_peered":"2024-03-30T12:20:36.010008+0000","last_clean":"2024-03-30T12:20:36.010008+0000","last_became_active":"2024-03-30T12:19:00.467636+0000","last_became_peered":"2024-03-30T12:19:00.467636+0000","last_unstale":"2024-03-30T12:20:36.010008+0000","last_undegraded":"2024-03-30T12:20:36.010008+0000","last_fullsized":"2024-03-30T12:20:36.010008+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:49.599855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-30T12:20:37.241472+0000","last_change":"2024-03-30T12:20:37.241472+0000","last_active":"2024-03-30T12:20:37.241472+0000","last_peered":"2024-03-30T12:20:37.241472+0000","last_clean":"2024-03-30T12:20:37.241472+0000","last_became_active":"2024-03-30T12:20:37.241084+0000","last_became_peered":"2024-03-30T12:20:37.241084+0000","last_unstale":"2024-03-30T12:20:37.241472+0000","last_undegraded":"2024-03-30T12:20:37.241472+0000","last_fullsized":"2024-03-30T12:20:37.241472+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:40:48.055427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"61'1","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003349+0000","last_change":"2024-03-30T12:19:00.454521+0000","last_active":"2024-03-30T12:20:36.003349+0000","last_peered":"2024-03-30T12:20:36.003349+0000","last_clean":"2024-03-30T12:20:36.003349+0000","last_became_active":"2024-03-30T12:19:00.454213+0000","last_became_peered":"2024-03-30T12:19:00.454213+0000","last_unstale":"2024-03-30T12:20:36.003349+0000","last_undegraded":"2024-03-30T12:20:36.003349+0000","last_fullsized":"2024-03-30T12:20:36.003349+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:27:47.198072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006453+0000","last_change":"2024-03-30T12:19:00.860724+0000","last_active":"2024-03-30T12:20:36.006453+0000","last_peered":"2024-03-30T12:20:36.006453+0000","last_clean":"2024-03-30T12:20:36.006453+0000","last_became_active":"2024-03-30T12:19:00.860427+0000","last_became_peered":"2024-03-30T12:19:00.860427+0000","last_unstale":"2024-03-30T12:20:36.006453+0000","last_undegraded":"2024-03-30T12:20:36.006453+0000","last_fullsized":"2024-03-30T12:20:36.006453+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:55:54.757770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"61'1","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007243+0000","last_change":"2024-03-30T12:19:00.460150+0000","last_active":"2024-03-30T12:20:36.007243+0000","last_peered":"2024-03-30T12:20:36.007243+0000","last_clean":"2024-03-30T12:20:36.007243+0000","last_became_active":"2024-03-30T12:19:00.459740+0000","last_became_peered":"2024-03-30T12:19:00.459740+0000","last_unstale":"2024-03-30T12:20:36.007243+0000","last_undegraded":"2024-03-30T12:20:36.007243+0000","last_fullsized":"2024-03-30T12:20:36.007243+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:52:40.523467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005105+0000","last_change":"2024-03-30T12:19:00.857403+0000","last_active":"2024-03-30T12:20:36.005105+0000","last_peered":"2024-03-30T12:20:36.005105+0000","last_clean":"2024-03-30T12:20:36.005105+0000","last_became_active":"2024-03-30T12:19:00.856652+0000","last_became_peered":"2024-03-30T12:19:00.856652+0000","last_unstale":"2024-03-30T12:20:36.005105+0000","last_undegraded":"2024-03-30T12:20:36.005105+0000","last_fullsized":"2024-03-30T12:20:36.005105+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:51.932935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002446+0000","last_change":"2024-03-30T12:19:00.458253+0000","last_active":"2024-03-30T12:20:36.002446+0000","last_peered":"2024-03-30T12:20:36.002446+0000","last_clean":"2024-03-30T12:20:36.002446+0000","last_became_active":"2024-03-30T12:19:00.457947+0000","last_became_peered":"2024-03-30T12:19:00.457947+0000","last_unstale":"2024-03-30T12:20:36.002446+0000","last_undegraded":"2024-03-30T12:20:36.002446+0000","last_fullsized":"2024-03-30T12:20:36.002446+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:13:18.864198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002317+0000","last_change":"2024-03-30T12:19:00.859188+0000","last_active":"2024-03-30T12:20:36.002317+0000","last_peered":"2024-03-30T12:20:36.002317+0000","last_clean":"2024-03-30T12:20:36.002317+0000","last_became_active":"2024-03-30T12:19:00.858922+0000","last_became_peered":"2024-03-30T12:19:00.858922+0000","last_unstale":"2024-03-30T12:20:36.002317+0000","last_undegraded":"2024-03-30T12:20:36.002317+0000","last_fullsized":"2024-03-30T12:20:36.002317+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:56:16.965191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002925+0000","last_change":"2024-03-30T12:19:00.466729+0000","last_active":"2024-03-30T12:20:36.002925+0000","last_peered":"2024-03-30T12:20:36.002925+0000","last_clean":"2024-03-30T12:20:36.002925+0000","last_became_active":"2024-03-30T12:19:00.466086+0000","last_became_peered":"2024-03-30T12:19:00.466086+0000","last_unstale":"2024-03-30T12:20:36.002925+0000","last_undegraded":"2024-03-30T12:20:36.002925+0000","last_fullsized":"2024-03-30T12:20:36.002925+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:46:14.144417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004830+0000","last_change":"2024-03-30T12:19:00.863262+0000","last_active":"2024-03-30T12:20:36.004830+0000","last_peered":"2024-03-30T12:20:36.004830+0000","last_clean":"2024-03-30T12:20:36.004830+0000","last_became_active":"2024-03-30T12:19:00.861328+0000","last_became_peered":"2024-03-30T12:19:00.861328+0000","last_unstale":"2024-03-30T12:20:36.004830+0000","last_undegraded":"2024-03-30T12:20:36.004830+0000","last_fullsized":"2024-03-30T12:20:36.004830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:20:19.049967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007946+0000","last_change":"2024-03-30T12:19:00.459929+0000","last_active":"2024-03-30T12:20:36.007946+0000","last_peered":"2024-03-30T12:20:36.007946+0000","last_clean":"2024-03-30T12:20:36.007946+0000","last_became_active":"2024-03-30T12:19:00.459518+0000","last_became_peered":"2024-03-30T12:19:00.459518+0000","last_unstale":"2024-03-30T12:20:36.007946+0000","last_undegraded":"2024-03-30T12:20:36.007946+0000","last_fullsized":"2024-03-30T12:20:36.007946+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:09:03.990119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003517+0000","last_change":"2024-03-30T12:19:00.862112+0000","last_active":"2024-03-30T12:20:36.003517+0000","last_peered":"2024-03-30T12:20:36.003517+0000","last_clean":"2024-03-30T12:20:36.003517+0000","last_became_active":"2024-03-30T12:19:00.861782+0000","last_became_peered":"2024-03-30T12:19:00.861782+0000","last_unstale":"2024-03-30T12:20:36.003517+0000","last_undegraded":"2024-03-30T12:20:36.003517+0000","last_fullsized":"2024-03-30T12:20:36.003517+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:01:42.946530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003471+0000","last_change":"2024-03-30T12:19:00.463745+0000","last_active":"2024-03-30T12:20:36.003471+0000","last_peered":"2024-03-30T12:20:36.003471+0000","last_clean":"2024-03-30T12:20:36.003471+0000","last_became_active":"2024-03-30T12:19:00.462698+0000","last_became_peered":"2024-03-30T12:19:00.462698+0000","last_unstale":"2024-03-30T12:20:36.003471+0000","last_undegraded":"2024-03-30T12:20:36.003471+0000","last_fullsized":"2024-03-30T12:20:36.003471+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:09:33.196928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-30T12:20:37.009497+0000","last_change":"2024-03-30T12:20:37.009497+0000","last_active":"2024-03-30T12:20:37.009497+0000","last_peered":"2024-03-30T12:20:37.009497+0000","last_clean":"2024-03-30T12:20:37.009497+0000","last_became_active":"2024-03-30T12:20:37.009140+0000","last_became_peered":"2024-03-30T12:20:37.009140+0000","last_unstale":"2024-03-30T12:20:37.009497+0000","last_undegraded":"2024-03-30T12:20:37.009497+0000","last_fullsized":"2024-03-30T12:20:37.009497+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:01.772821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":21,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005122+0000","last_change":"2024-03-30T12:19:00.463581+0000","last_active":"2024-03-30T12:20:36.005122+0000","last_peered":"2024-03-30T12:20:36.005122+0000","last_clean":"2024-03-30T12:20:36.005122+0000","last_became_active":"2024-03-30T12:19:00.463280+0000","last_became_peered":"2024-03-30T12:19:00.463280+0000","last_unstale":"2024-03-30T12:20:36.005122+0000","last_undegraded":"2024-03-30T12:20:36.005122+0000","last_fullsized":"2024-03-30T12:20:36.005122+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:38:07.390655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006530+0000","last_change":"2024-03-30T12:19:00.878541+0000","last_active":"2024-03-30T12:20:36.006530+0000","last_peered":"2024-03-30T12:20:36.006530+0000","last_clean":"2024-03-30T12:20:36.006530+0000","last_became_active":"2024-03-30T12:19:00.878229+0000","last_became_peered":"2024-03-30T12:19:00.878229+0000","last_unstale":"2024-03-30T12:20:36.006530+0000","last_undegraded":"2024-03-30T12:20:36.006530+0000","last_fullsized":"2024-03-30T12:20:36.006530+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:03:18.020146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"65'9","reported_seq":27,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007527+0000","last_change":"2024-03-30T12:19:00.458102+0000","last_active":"2024-03-30T12:20:36.007527+0000","last_peered":"2024-03-30T12:20:36.007527+0000","last_clean":"2024-03-30T12:20:36.007527+0000","last_became_active":"2024-03-30T12:19:00.457759+0000","last_became_peered":"2024-03-30T12:19:00.457759+0000","last_unstale":"2024-03-30T12:20:36.007527+0000","last_undegraded":"2024-03-30T12:20:36.007527+0000","last_fullsized":"2024-03-30T12:20:36.007527+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:31.713303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2350,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010066+0000","last_change":"2024-03-30T12:19:00.872384+0000","last_active":"2024-03-30T12:20:36.010066+0000","last_peered":"2024-03-30T12:20:36.010066+0000","last_clean":"2024-03-30T12:20:36.010066+0000","last_became_active":"2024-03-30T12:19:00.872085+0000","last_became_peered":"2024-03-30T12:19:00.872085+0000","last_unstale":"2024-03-30T12:20:36.010066+0000","last_undegraded":"2024-03-30T12:20:36.010066+0000","last_fullsized":"2024-03-30T12:20:36.010066+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:47:42.278500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005329+0000","last_change":"2024-03-30T12:19:00.462939+0000","last_active":"2024-03-30T12:20:36.005329+0000","last_peered":"2024-03-30T12:20:36.005329+0000","last_clean":"2024-03-30T12:20:36.005329+0000","last_became_active":"2024-03-30T12:19:00.462637+0000","last_became_peered":"2024-03-30T12:19:00.462637+0000","last_unstale":"2024-03-30T12:20:36.005329+0000","last_undegraded":"2024-03-30T12:20:36.005329+0000","last_fullsized":"2024-03-30T12:20:36.005329+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:48:59.027106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004952+0000","last_change":"2024-03-30T12:19:00.856865+0000","last_active":"2024-03-30T12:20:36.004952+0000","last_peered":"2024-03-30T12:20:36.004952+0000","last_clean":"2024-03-30T12:20:36.004952+0000","last_became_active":"2024-03-30T12:19:00.856544+0000","last_became_peered":"2024-03-30T12:19:00.856544+0000","last_unstale":"2024-03-30T12:20:36.004952+0000","last_undegraded":"2024-03-30T12:20:36.004952+0000","last_fullsized":"2024-03-30T12:20:36.004952+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:37:39.901012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002977+0000","last_change":"2024-03-30T12:19:00.465931+0000","last_active":"2024-03-30T12:20:36.002977+0000","last_peered":"2024-03-30T12:20:36.002977+0000","last_clean":"2024-03-30T12:20:36.002977+0000","last_became_active":"2024-03-30T12:19:00.465589+0000","last_became_peered":"2024-03-30T12:19:00.465589+0000","last_unstale":"2024-03-30T12:20:36.002977+0000","last_undegraded":"2024-03-30T12:20:36.002977+0000","last_fullsized":"2024-03-30T12:20:36.002977+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:02:38.614924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.009910+0000","last_change":"2024-03-30T12:19:00.870798+0000","last_active":"2024-03-30T12:20:36.009910+0000","last_peered":"2024-03-30T12:20:36.009910+0000","last_clean":"2024-03-30T12:20:36.009910+0000","last_became_active":"2024-03-30T12:19:00.870507+0000","last_became_peered":"2024-03-30T12:19:00.870507+0000","last_unstale":"2024-03-30T12:20:36.009910+0000","last_undegraded":"2024-03-30T12:20:36.009910+0000","last_fullsized":"2024-03-30T12:20:36.009910+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:25:30.259298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006948+0000","last_change":"2024-03-30T12:19:00.454678+0000","last_active":"2024-03-30T12:20:36.006948+0000","last_peered":"2024-03-30T12:20:36.006948+0000","last_clean":"2024-03-30T12:20:36.006948+0000","last_became_active":"2024-03-30T12:19:00.454380+0000","last_became_peered":"2024-03-30T12:19:00.454380+0000","last_unstale":"2024-03-30T12:20:36.006948+0000","last_undegraded":"2024-03-30T12:20:36.006948+0000","last_fullsized":"2024-03-30T12:20:36.006948+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:08:24.640327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005827+0000","last_change":"2024-03-30T12:19:00.861547+0000","last_active":"2024-03-30T12:20:36.005827+0000","last_peered":"2024-03-30T12:20:36.005827+0000","last_clean":"2024-03-30T12:20:36.005827+0000","last_became_active":"2024-03-30T12:19:00.861268+0000","last_became_peered":"2024-03-30T12:19:00.861268+0000","last_unstale":"2024-03-30T12:20:36.005827+0000","last_undegraded":"2024-03-30T12:20:36.005827+0000","last_fullsized":"2024-03-30T12:20:36.005827+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:28:37.342309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":26,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005972+0000","last_change":"2024-03-30T12:19:00.460090+0000","last_active":"2024-03-30T12:20:36.005972+0000","last_peered":"2024-03-30T12:20:36.005972+0000","last_clean":"2024-03-30T12:20:36.005972+0000","last_became_active":"2024-03-30T12:19:00.459790+0000","last_became_peered":"2024-03-30T12:19:00.459790+0000","last_unstale":"2024-03-30T12:20:36.005972+0000","last_undegraded":"2024-03-30T12:20:36.005972+0000","last_fullsized":"2024-03-30T12:20:36.005972+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:38.860631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.009575+0000","last_change":"2024-03-30T12:19:00.870061+0000","last_active":"2024-03-30T12:20:36.009575+0000","last_peered":"2024-03-30T12:20:36.009575+0000","last_clean":"2024-03-30T12:20:36.009575+0000","last_became_active":"2024-03-30T12:19:00.869750+0000","last_became_peered":"2024-03-30T12:19:00.869750+0000","last_unstale":"2024-03-30T12:20:36.009575+0000","last_undegraded":"2024-03-30T12:20:36.009575+0000","last_fullsized":"2024-03-30T12:20:36.009575+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:03:02.790151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"61'1","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006238+0000","last_change":"2024-03-30T12:19:00.461178+0000","last_active":"2024-03-30T12:20:36.006238+0000","last_peered":"2024-03-30T12:20:36.006238+0000","last_clean":"2024-03-30T12:20:36.006238+0000","last_became_active":"2024-03-30T12:19:00.460817+0000","last_became_peered":"2024-03-30T12:19:00.460817+0000","last_unstale":"2024-03-30T12:20:36.006238+0000","last_undegraded":"2024-03-30T12:20:36.006238+0000","last_fullsized":"2024-03-30T12:20:36.006238+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:30:59.255694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010218+0000","last_change":"2024-03-30T12:19:00.871828+0000","last_active":"2024-03-30T12:20:36.010218+0000","last_peered":"2024-03-30T12:20:36.010218+0000","last_clean":"2024-03-30T12:20:36.010218+0000","last_became_active":"2024-03-30T12:19:00.871555+0000","last_became_peered":"2024-03-30T12:19:00.871555+0000","last_unstale":"2024-03-30T12:20:36.010218+0000","last_undegraded":"2024-03-30T12:20:36.010218+0000","last_fullsized":"2024-03-30T12:20:36.010218+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:02:53.212521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.008100+0000","last_change":"2024-03-30T12:19:35.161648+0000","last_active":"2024-03-30T12:20:36.008100+0000","last_peered":"2024-03-30T12:20:36.008100+0000","last_clean":"2024-03-30T12:20:36.008100+0000","last_became_active":"2024-03-30T12:19:35.161426+0000","last_became_peered":"2024-03-30T12:19:35.161426+0000","last_unstale":"2024-03-30T12:20:36.008100+0000","last_undegraded":"2024-03-30T12:20:36.008100+0000","last_fullsized":"2024-03-30T12:20:36.008100+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:05:56.726860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004909+0000","last_change":"2024-03-30T12:19:00.462709+0000","last_active":"2024-03-30T12:20:36.004909+0000","last_peered":"2024-03-30T12:20:36.004909+0000","last_clean":"2024-03-30T12:20:36.004909+0000","last_became_active":"2024-03-30T12:19:00.462429+0000","last_became_peered":"2024-03-30T12:19:00.462429+0000","last_unstale":"2024-03-30T12:20:36.004909+0000","last_undegraded":"2024-03-30T12:20:36.004909+0000","last_fullsized":"2024-03-30T12:20:36.004909+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:29.579526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003518+0000","last_change":"2024-03-30T12:19:00.854025+0000","last_active":"2024-03-30T12:20:36.003518+0000","last_peered":"2024-03-30T12:20:36.003518+0000","last_clean":"2024-03-30T12:20:36.003518+0000","last_became_active":"2024-03-30T12:19:00.853714+0000","last_became_peered":"2024-03-30T12:19:00.853714+0000","last_unstale":"2024-03-30T12:20:36.003518+0000","last_undegraded":"2024-03-30T12:20:36.003518+0000","last_fullsized":"2024-03-30T12:20:36.003518+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:27:34.498087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004908+0000","last_change":"2024-03-30T12:19:35.051431+0000","last_active":"2024-03-30T12:20:36.004908+0000","last_peered":"2024-03-30T12:20:36.004908+0000","last_clean":"2024-03-30T12:20:36.004908+0000","last_became_active":"2024-03-30T12:19:35.050880+0000","last_became_peered":"2024-03-30T12:19:35.050880+0000","last_unstale":"2024-03-30T12:20:36.004908+0000","last_undegraded":"2024-03-30T12:20:36.004908+0000","last_fullsized":"2024-03-30T12:20:36.004908+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:57:58.075785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002920+0000","last_change":"2024-03-30T12:19:00.457612+0000","last_active":"2024-03-30T12:20:36.002920+0000","last_peered":"2024-03-30T12:20:36.002920+0000","last_clean":"2024-03-30T12:20:36.002920+0000","last_became_active":"2024-03-30T12:19:00.457289+0000","last_became_peered":"2024-03-30T12:19:00.457289+0000","last_unstale":"2024-03-30T12:20:36.002920+0000","last_undegraded":"2024-03-30T12:20:36.002920+0000","last_fullsized":"2024-03-30T12:20:36.002920+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:16:23.011997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006358+0000","last_change":"2024-03-30T12:19:00.866070+0000","last_active":"2024-03-30T12:20:36.006358+0000","last_peered":"2024-03-30T12:20:36.006358+0000","last_clean":"2024-03-30T12:20:36.006358+0000","last_became_active":"2024-03-30T12:19:00.865706+0000","last_became_peered":"2024-03-30T12:19:00.865706+0000","last_unstale":"2024-03-30T12:20:36.006358+0000","last_undegraded":"2024-03-30T12:20:36.006358+0000","last_fullsized":"2024-03-30T12:20:36.006358+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:56:01.599580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006959+0000","last_change":"2024-03-30T12:19:35.162695+0000","last_active":"2024-03-30T12:20:36.006959+0000","last_peered":"2024-03-30T12:20:36.006959+0000","last_clean":"2024-03-30T12:20:36.006959+0000","last_became_active":"2024-03-30T12:19:35.162389+0000","last_became_peered":"2024-03-30T12:19:35.162389+0000","last_unstale":"2024-03-30T12:20:36.006959+0000","last_undegraded":"2024-03-30T12:20:36.006959+0000","last_fullsized":"2024-03-30T12:20:36.006959+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:20:43.739417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004567+0000","last_change":"2024-03-30T12:19:00.861917+0000","last_active":"2024-03-30T12:20:36.004567+0000","last_peered":"2024-03-30T12:20:36.004567+0000","last_clean":"2024-03-30T12:20:36.004567+0000","last_became_active":"2024-03-30T12:19:00.860645+0000","last_became_peered":"2024-03-30T12:19:00.860645+0000","last_unstale":"2024-03-30T12:20:36.004567+0000","last_undegraded":"2024-03-30T12:20:36.004567+0000","last_fullsized":"2024-03-30T12:20:36.004567+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:30:51.438018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005814+0000","last_change":"2024-03-30T12:19:00.459145+0000","last_active":"2024-03-30T12:20:36.005814+0000","last_peered":"2024-03-30T12:20:36.005814+0000","last_clean":"2024-03-30T12:20:36.005814+0000","last_became_active":"2024-03-30T12:19:00.457819+0000","last_became_peered":"2024-03-30T12:19:00.457819+0000","last_unstale":"2024-03-30T12:20:36.005814+0000","last_undegraded":"2024-03-30T12:20:36.005814+0000","last_fullsized":"2024-03-30T12:20:36.005814+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:44:38.245366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007538+0000","last_change":"2024-03-30T12:19:35.161274+0000","last_active":"2024-03-30T12:20:36.007538+0000","last_peered":"2024-03-30T12:20:36.007538+0000","last_clean":"2024-03-30T12:20:36.007538+0000","last_became_active":"2024-03-30T12:19:35.160985+0000","last_became_peered":"2024-03-30T12:19:35.160985+0000","last_unstale":"2024-03-30T12:20:36.007538+0000","last_undegraded":"2024-03-30T12:20:36.007538+0000","last_fullsized":"2024-03-30T12:20:36.007538+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:07.499529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002517+0000","last_change":"2024-03-30T12:19:00.862340+0000","last_active":"2024-03-30T12:20:36.002517+0000","last_peered":"2024-03-30T12:20:36.002517+0000","last_clean":"2024-03-30T12:20:36.002517+0000","last_became_active":"2024-03-30T12:19:00.861413+0000","last_became_peered":"2024-03-30T12:19:00.861413+0000","last_unstale":"2024-03-30T12:20:36.002517+0000","last_undegraded":"2024-03-30T12:20:36.002517+0000","last_fullsized":"2024-03-30T12:20:36.002517+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:13:39.199499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003089+0000","last_change":"2024-03-30T12:19:00.465946+0000","last_active":"2024-03-30T12:20:36.003089+0000","last_peered":"2024-03-30T12:20:36.003089+0000","last_clean":"2024-03-30T12:20:36.003089+0000","last_became_active":"2024-03-30T12:19:00.465618+0000","last_became_peered":"2024-03-30T12:19:00.465618+0000","last_unstale":"2024-03-30T12:20:36.003089+0000","last_undegraded":"2024-03-30T12:20:36.003089+0000","last_fullsized":"2024-03-30T12:20:36.003089+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:58:42.109572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"66'128","reported_seq":266,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-30T12:20:37.472019+0000","last_change":"2024-03-30T12:18:45.912869+0000","last_active":"2024-03-30T12:20:37.472019+0000","last_peered":"2024-03-30T12:20:37.472019+0000","last_clean":"2024-03-30T12:20:37.472019+0000","last_became_active":"2024-03-30T12:18:45.912395+0000","last_became_peered":"2024-03-30T12:18:45.912395+0000","last_unstale":"2024-03-30T12:20:37.472019+0000","last_undegraded":"2024-03-30T12:20:37.472019+0000","last_fullsized":"2024-03-30T12:20:37.472019+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:34.485283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006349+0000","last_change":"2024-03-30T12:19:35.052180+0000","last_active":"2024-03-30T12:20:36.006349+0000","last_peered":"2024-03-30T12:20:36.006349+0000","last_clean":"2024-03-30T12:20:36.006349+0000","last_became_active":"2024-03-30T12:19:35.051577+0000","last_became_peered":"2024-03-30T12:19:35.051577+0000","last_unstale":"2024-03-30T12:20:36.006349+0000","last_undegraded":"2024-03-30T12:20:36.006349+0000","last_fullsized":"2024-03-30T12:20:36.006349+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:26:43.695424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004800+0000","last_change":"2024-03-30T12:19:00.852506+0000","last_active":"2024-03-30T12:20:36.004800+0000","last_peered":"2024-03-30T12:20:36.004800+0000","last_clean":"2024-03-30T12:20:36.004800+0000","last_became_active":"2024-03-30T12:19:00.852216+0000","last_became_peered":"2024-03-30T12:19:00.852216+0000","last_unstale":"2024-03-30T12:20:36.004800+0000","last_undegraded":"2024-03-30T12:20:36.004800+0000","last_fullsized":"2024-03-30T12:20:36.004800+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:41:21.462303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.009325+0000","last_change":"2024-03-30T12:19:00.470266+0000","last_active":"2024-03-30T12:20:36.009325+0000","last_peered":"2024-03-30T12:20:36.009325+0000","last_clean":"2024-03-30T12:20:36.009325+0000","last_became_active":"2024-03-30T12:19:00.469541+0000","last_became_peered":"2024-03-30T12:19:00.469541+0000","last_unstale":"2024-03-30T12:20:36.009325+0000","last_undegraded":"2024-03-30T12:20:36.009325+0000","last_fullsized":"2024-03-30T12:20:36.009325+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:57.244620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005044+0000","last_change":"2024-03-30T12:19:35.162977+0000","last_active":"2024-03-30T12:20:36.005044+0000","last_peered":"2024-03-30T12:20:36.005044+0000","last_clean":"2024-03-30T12:20:36.005044+0000","last_became_active":"2024-03-30T12:19:35.162514+0000","last_became_peered":"2024-03-30T12:19:35.162514+0000","last_unstale":"2024-03-30T12:20:36.005044+0000","last_undegraded":"2024-03-30T12:20:36.005044+0000","last_fullsized":"2024-03-30T12:20:36.005044+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:39:43.550849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010313+0000","last_change":"2024-03-30T12:19:00.469567+0000","last_active":"2024-03-30T12:20:36.010313+0000","last_peered":"2024-03-30T12:20:36.010313+0000","last_clean":"2024-03-30T12:20:36.010313+0000","last_became_active":"2024-03-30T12:19:00.469218+0000","last_became_peered":"2024-03-30T12:19:00.469218+0000","last_unstale":"2024-03-30T12:20:36.010313+0000","last_undegraded":"2024-03-30T12:20:36.010313+0000","last_fullsized":"2024-03-30T12:20:36.010313+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:16:05.609865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004993+0000","last_change":"2024-03-30T12:19:00.865798+0000","last_active":"2024-03-30T12:20:36.004993+0000","last_peered":"2024-03-30T12:20:36.004993+0000","last_clean":"2024-03-30T12:20:36.004993+0000","last_became_active":"2024-03-30T12:19:00.865518+0000","last_became_peered":"2024-03-30T12:19:00.865518+0000","last_unstale":"2024-03-30T12:20:36.004993+0000","last_undegraded":"2024-03-30T12:20:36.004993+0000","last_fullsized":"2024-03-30T12:20:36.004993+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:47:41.818140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002238+0000","last_change":"2024-03-30T12:19:35.162768+0000","last_active":"2024-03-30T12:20:36.002238+0000","last_peered":"2024-03-30T12:20:36.002238+0000","last_clean":"2024-03-30T12:20:36.002238+0000","last_became_active":"2024-03-30T12:19:35.162480+0000","last_became_peered":"2024-03-30T12:19:35.162480+0000","last_unstale":"2024-03-30T12:20:36.002238+0000","last_undegraded":"2024-03-30T12:20:36.002238+0000","last_fullsized":"2024-03-30T12:20:36.002238+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:17:01.235481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"62'1","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005424+0000","last_change":"2024-03-30T12:19:00.454554+0000","last_active":"2024-03-30T12:20:36.005424+0000","last_peered":"2024-03-30T12:20:36.005424+0000","last_clean":"2024-03-30T12:20:36.005424+0000","last_became_active":"2024-03-30T12:19:00.454233+0000","last_became_peered":"2024-03-30T12:19:00.454233+0000","last_unstale":"2024-03-30T12:20:36.005424+0000","last_undegraded":"2024-03-30T12:20:36.005424+0000","last_fullsized":"2024-03-30T12:20:36.005424+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:05:09.010127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003621+0000","last_change":"2024-03-30T12:19:00.853806+0000","last_active":"2024-03-30T12:20:36.003621+0000","last_peered":"2024-03-30T12:20:36.003621+0000","last_clean":"2024-03-30T12:20:36.003621+0000","last_became_active":"2024-03-30T12:19:00.853538+0000","last_became_peered":"2024-03-30T12:19:00.853538+0000","last_unstale":"2024-03-30T12:20:36.003621+0000","last_undegraded":"2024-03-30T12:20:36.003621+0000","last_fullsized":"2024-03-30T12:20:36.003621+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:36:10.741436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006059+0000","last_change":"2024-03-30T12:19:35.162679+0000","last_active":"2024-03-30T12:20:36.006059+0000","last_peered":"2024-03-30T12:20:36.006059+0000","last_clean":"2024-03-30T12:20:36.006059+0000","last_became_active":"2024-03-30T12:19:35.162347+0000","last_became_peered":"2024-03-30T12:19:35.162347+0000","last_unstale":"2024-03-30T12:20:36.006059+0000","last_undegraded":"2024-03-30T12:20:36.006059+0000","last_fullsized":"2024-03-30T12:20:36.006059+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:24:16.565563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007662+0000","last_change":"2024-03-30T12:19:00.460279+0000","last_active":"2024-03-30T12:20:36.007662+0000","last_peered":"2024-03-30T12:20:36.007662+0000","last_clean":"2024-03-30T12:20:36.007662+0000","last_became_active":"2024-03-30T12:19:00.459948+0000","last_became_peered":"2024-03-30T12:19:00.459948+0000","last_unstale":"2024-03-30T12:20:36.007662+0000","last_undegraded":"2024-03-30T12:20:36.007662+0000","last_fullsized":"2024-03-30T12:20:36.007662+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:06.870147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006440+0000","last_change":"2024-03-30T12:19:00.853029+0000","last_active":"2024-03-30T12:20:36.006440+0000","last_peered":"2024-03-30T12:20:36.006440+0000","last_clean":"2024-03-30T12:20:36.006440+0000","last_became_active":"2024-03-30T12:19:00.852755+0000","last_became_peered":"2024-03-30T12:19:00.852755+0000","last_unstale":"2024-03-30T12:20:36.006440+0000","last_undegraded":"2024-03-30T12:20:36.006440+0000","last_fullsized":"2024-03-30T12:20:36.006440+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:03:44.655099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.009471+0000","last_change":"2024-03-30T12:19:00.470521+0000","last_active":"2024-03-30T12:20:36.009471+0000","last_peered":"2024-03-30T12:20:36.009471+0000","last_clean":"2024-03-30T12:20:36.009471+0000","last_became_active":"2024-03-30T12:19:00.469910+0000","last_became_peered":"2024-03-30T12:19:00.469910+0000","last_unstale":"2024-03-30T12:20:36.009471+0000","last_undegraded":"2024-03-30T12:20:36.009471+0000","last_fullsized":"2024-03-30T12:20:36.009471+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:12:52.044394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006007+0000","last_change":"2024-03-30T12:19:00.877240+0000","last_active":"2024-03-30T12:20:36.006007+0000","last_peered":"2024-03-30T12:20:36.006007+0000","last_clean":"2024-03-30T12:20:36.006007+0000","last_became_active":"2024-03-30T12:19:00.876739+0000","last_became_peered":"2024-03-30T12:19:00.876739+0000","last_unstale":"2024-03-30T12:20:36.006007+0000","last_undegraded":"2024-03-30T12:20:36.006007+0000","last_fullsized":"2024-03-30T12:20:36.006007+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:25.328486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004711+0000","last_change":"2024-03-30T12:19:00.459528+0000","last_active":"2024-03-30T12:20:36.004711+0000","last_peered":"2024-03-30T12:20:36.004711+0000","last_clean":"2024-03-30T12:20:36.004711+0000","last_became_active":"2024-03-30T12:19:00.459223+0000","last_became_peered":"2024-03-30T12:19:00.459223+0000","last_unstale":"2024-03-30T12:20:36.004711+0000","last_undegraded":"2024-03-30T12:20:36.004711+0000","last_fullsized":"2024-03-30T12:20:36.004711+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:44.399783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002268+0000","last_change":"2024-03-30T12:19:00.850810+0000","last_active":"2024-03-30T12:20:36.002268+0000","last_peered":"2024-03-30T12:20:36.002268+0000","last_clean":"2024-03-30T12:20:36.002268+0000","last_became_active":"2024-03-30T12:19:00.850530+0000","last_became_peered":"2024-03-30T12:19:00.850530+0000","last_unstale":"2024-03-30T12:20:36.002268+0000","last_undegraded":"2024-03-30T12:20:36.002268+0000","last_fullsized":"2024-03-30T12:20:36.002268+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:52:32.869322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":27,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-30T12:20:37.009330+0000","last_change":"2024-03-30T12:20:37.009330+0000","last_active":"2024-03-30T12:20:37.009330+0000","last_peered":"2024-03-30T12:20:37.009330+0000","last_clean":"2024-03-30T12:20:37.009330+0000","last_became_active":"2024-03-30T12:20:37.008926+0000","last_became_peered":"2024-03-30T12:20:37.008926+0000","last_unstale":"2024-03-30T12:20:37.009330+0000","last_undegraded":"2024-03-30T12:20:37.009330+0000","last_fullsized":"2024-03-30T12:20:37.009330+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:39.113599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003395+0000","last_change":"2024-03-30T12:19:00.858733+0000","last_active":"2024-03-30T12:20:36.003395+0000","last_peered":"2024-03-30T12:20:36.003395+0000","last_clean":"2024-03-30T12:20:36.003395+0000","last_became_active":"2024-03-30T12:19:00.858419+0000","last_became_peered":"2024-03-30T12:19:00.858419+0000","last_unstale":"2024-03-30T12:20:36.003395+0000","last_undegraded":"2024-03-30T12:20:36.003395+0000","last_fullsized":"2024-03-30T12:20:36.003395+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:27:43.731796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"61'2","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.009844+0000","last_change":"2024-03-30T12:19:00.468017+0000","last_active":"2024-03-30T12:20:36.009844+0000","last_peered":"2024-03-30T12:20:36.009844+0000","last_clean":"2024-03-30T12:20:36.009844+0000","last_became_active":"2024-03-30T12:19:00.466979+0000","last_became_peered":"2024-03-30T12:19:00.466979+0000","last_unstale":"2024-03-30T12:20:36.009844+0000","last_undegraded":"2024-03-30T12:20:36.009844+0000","last_fullsized":"2024-03-30T12:20:36.009844+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:41:36.480109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007191+0000","last_change":"2024-03-30T12:19:00.869001+0000","last_active":"2024-03-30T12:20:36.007191+0000","last_peered":"2024-03-30T12:20:36.007191+0000","last_clean":"2024-03-30T12:20:36.007191+0000","last_became_active":"2024-03-30T12:19:00.868645+0000","last_became_peered":"2024-03-30T12:19:00.868645+0000","last_unstale":"2024-03-30T12:20:36.007191+0000","last_undegraded":"2024-03-30T12:20:36.007191+0000","last_fullsized":"2024-03-30T12:20:36.007191+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:54:10.778279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006475+0000","last_change":"2024-03-30T12:19:00.459171+0000","last_active":"2024-03-30T12:20:36.006475+0000","last_peered":"2024-03-30T12:20:36.006475+0000","last_clean":"2024-03-30T12:20:36.006475+0000","last_became_active":"2024-03-30T12:19:00.458925+0000","last_became_peered":"2024-03-30T12:19:00.458925+0000","last_unstale":"2024-03-30T12:20:36.006475+0000","last_undegraded":"2024-03-30T12:20:36.006475+0000","last_fullsized":"2024-03-30T12:20:36.006475+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:26:20.974369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010188+0000","last_change":"2024-03-30T12:19:00.875558+0000","last_active":"2024-03-30T12:20:36.010188+0000","last_peered":"2024-03-30T12:20:36.010188+0000","last_clean":"2024-03-30T12:20:36.010188+0000","last_became_active":"2024-03-30T12:19:00.875216+0000","last_became_peered":"2024-03-30T12:19:00.875216+0000","last_unstale":"2024-03-30T12:20:36.010188+0000","last_undegraded":"2024-03-30T12:20:36.010188+0000","last_fullsized":"2024-03-30T12:20:36.010188+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:27:04.763910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"61'1","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005078+0000","last_change":"2024-03-30T12:19:00.459545+0000","last_active":"2024-03-30T12:20:36.005078+0000","last_peered":"2024-03-30T12:20:36.005078+0000","last_clean":"2024-03-30T12:20:36.005078+0000","last_became_active":"2024-03-30T12:19:00.459250+0000","last_became_peered":"2024-03-30T12:19:00.459250+0000","last_unstale":"2024-03-30T12:20:36.005078+0000","last_undegraded":"2024-03-30T12:20:36.005078+0000","last_fullsized":"2024-03-30T12:20:36.005078+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:38.112815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003319+0000","last_change":"2024-03-30T12:19:00.852558+0000","last_active":"2024-03-30T12:20:36.003319+0000","last_peered":"2024-03-30T12:20:36.003319+0000","last_clean":"2024-03-30T12:20:36.003319+0000","last_became_active":"2024-03-30T12:19:00.852250+0000","last_became_peered":"2024-03-30T12:19:00.852250+0000","last_unstale":"2024-03-30T12:20:36.003319+0000","last_undegraded":"2024-03-30T12:20:36.003319+0000","last_fullsized":"2024-03-30T12:20:36.003319+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:57:15.989801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"61'2","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.006568+0000","last_change":"2024-03-30T12:19:00.464968+0000","last_active":"2024-03-30T12:20:36.006568+0000","last_peered":"2024-03-30T12:20:36.006568+0000","last_clean":"2024-03-30T12:20:36.006568+0000","last_became_active":"2024-03-30T12:19:00.464021+0000","last_became_peered":"2024-03-30T12:19:00.464021+0000","last_unstale":"2024-03-30T12:20:36.006568+0000","last_undegraded":"2024-03-30T12:20:36.006568+0000","last_fullsized":"2024-03-30T12:20:36.006568+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:20.224884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.010284+0000","last_change":"2024-03-30T12:19:00.871645+0000","last_active":"2024-03-30T12:20:36.010284+0000","last_peered":"2024-03-30T12:20:36.010284+0000","last_clean":"2024-03-30T12:20:36.010284+0000","last_became_active":"2024-03-30T12:19:00.871376+0000","last_became_peered":"2024-03-30T12:19:00.871376+0000","last_unstale":"2024-03-30T12:20:36.010284+0000","last_undegraded":"2024-03-30T12:20:36.010284+0000","last_fullsized":"2024-03-30T12:20:36.010284+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:54:57.281972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005731+0000","last_change":"2024-03-30T12:19:00.862859+0000","last_active":"2024-03-30T12:20:36.005731+0000","last_peered":"2024-03-30T12:20:36.005731+0000","last_clean":"2024-03-30T12:20:36.005731+0000","last_became_active":"2024-03-30T12:19:00.862535+0000","last_became_peered":"2024-03-30T12:19:00.862535+0000","last_unstale":"2024-03-30T12:20:36.005731+0000","last_undegraded":"2024-03-30T12:20:36.005731+0000","last_fullsized":"2024-03-30T12:20:36.005731+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:17:31.462763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005669+0000","last_change":"2024-03-30T12:19:00.862947+0000","last_active":"2024-03-30T12:20:36.005669+0000","last_peered":"2024-03-30T12:20:36.005669+0000","last_clean":"2024-03-30T12:20:36.005669+0000","last_became_active":"2024-03-30T12:19:00.862567+0000","last_became_peered":"2024-03-30T12:19:00.862567+0000","last_unstale":"2024-03-30T12:20:36.005669+0000","last_undegraded":"2024-03-30T12:20:36.005669+0000","last_fullsized":"2024-03-30T12:20:36.005669+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:55:05.422370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003048+0000","last_change":"2024-03-30T12:19:00.856869+0000","last_active":"2024-03-30T12:20:36.003048+0000","last_peered":"2024-03-30T12:20:36.003048+0000","last_clean":"2024-03-30T12:20:36.003048+0000","last_became_active":"2024-03-30T12:19:00.856525+0000","last_became_peered":"2024-03-30T12:19:00.856525+0000","last_unstale":"2024-03-30T12:20:36.003048+0000","last_undegraded":"2024-03-30T12:20:36.003048+0000","last_fullsized":"2024-03-30T12:20:36.003048+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:01:47.443294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005121+0000","last_change":"2024-03-30T12:19:00.859724+0000","last_active":"2024-03-30T12:20:36.005121+0000","last_peered":"2024-03-30T12:20:36.005121+0000","last_clean":"2024-03-30T12:20:36.005121+0000","last_became_active":"2024-03-30T12:19:00.859327+0000","last_became_peered":"2024-03-30T12:19:00.859327+0000","last_unstale":"2024-03-30T12:20:36.005121+0000","last_undegraded":"2024-03-30T12:20:36.005121+0000","last_fullsized":"2024-03-30T12:20:36.005121+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:53:15.692683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-03-30T12:20:37.009224+0000","last_change":"2024-03-30T12:20:37.009224+0000","last_active":"2024-03-30T12:20:37.009224+0000","last_peered":"2024-03-30T12:20:37.009224+0000","last_clean":"2024-03-30T12:20:37.009224+0000","last_became_active":"2024-03-30T12:20:37.008947+0000","last_became_peered":"2024-03-30T12:20:37.008947+0000","last_unstale":"2024-03-30T12:20:37.009224+0000","last_undegraded":"2024-03-30T12:20:37.009224+0000","last_fullsized":"2024-03-30T12:20:37.009224+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:42:16.251343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005045+0000","last_change":"2024-03-30T12:19:00.848297+0000","last_active":"2024-03-30T12:20:36.005045+0000","last_peered":"2024-03-30T12:20:36.005045+0000","last_clean":"2024-03-30T12:20:36.005045+0000","last_became_active":"2024-03-30T12:19:00.848029+0000","last_became_peered":"2024-03-30T12:19:00.848029+0000","last_unstale":"2024-03-30T12:20:36.005045+0000","last_undegraded":"2024-03-30T12:20:36.005045+0000","last_fullsized":"2024-03-30T12:20:36.005045+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:38.617413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007908+0000","last_change":"2024-03-30T12:19:00.869414+0000","last_active":"2024-03-30T12:20:36.007908+0000","last_peered":"2024-03-30T12:20:36.007908+0000","last_clean":"2024-03-30T12:20:36.007908+0000","last_became_active":"2024-03-30T12:19:00.869115+0000","last_became_peered":"2024-03-30T12:19:00.869115+0000","last_unstale":"2024-03-30T12:20:36.007908+0000","last_undegraded":"2024-03-30T12:20:36.007908+0000","last_fullsized":"2024-03-30T12:20:36.007908+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:01:12.173692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.004112+0000","last_change":"2024-03-30T12:19:00.856088+0000","last_active":"2024-03-30T12:20:36.004112+0000","last_peered":"2024-03-30T12:20:36.004112+0000","last_clean":"2024-03-30T12:20:36.004112+0000","last_became_active":"2024-03-30T12:19:00.855480+0000","last_became_peered":"2024-03-30T12:19:00.855480+0000","last_unstale":"2024-03-30T12:20:36.004112+0000","last_undegraded":"2024-03-30T12:20:36.004112+0000","last_fullsized":"2024-03-30T12:20:36.004112+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:21:16.961559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002998+0000","last_change":"2024-03-30T12:19:00.854668+0000","last_active":"2024-03-30T12:20:36.002998+0000","last_peered":"2024-03-30T12:20:36.002998+0000","last_clean":"2024-03-30T12:20:36.002998+0000","last_became_active":"2024-03-30T12:19:00.854390+0000","last_became_peered":"2024-03-30T12:19:00.854390+0000","last_unstale":"2024-03-30T12:20:36.002998+0000","last_undegraded":"2024-03-30T12:20:36.002998+0000","last_fullsized":"2024-03-30T12:20:36.002998+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:39:22.128098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.002372+0000","last_change":"2024-03-30T12:19:00.851282+0000","last_active":"2024-03-30T12:20:36.002372+0000","last_peered":"2024-03-30T12:20:36.002372+0000","last_clean":"2024-03-30T12:20:36.002372+0000","last_became_active":"2024-03-30T12:19:00.850915+0000","last_became_peered":"2024-03-30T12:19:00.850915+0000","last_unstale":"2024-03-30T12:20:36.002372+0000","last_undegraded":"2024-03-30T12:20:36.002372+0000","last_fullsized":"2024-03-30T12:20:36.002372+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:46:50.526568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.003102+0000","last_change":"2024-03-30T12:19:00.860406+0000","last_active":"2024-03-30T12:20:36.003102+0000","last_peered":"2024-03-30T12:20:36.003102+0000","last_clean":"2024-03-30T12:20:36.003102+0000","last_became_active":"2024-03-30T12:19:00.860085+0000","last_became_peered":"2024-03-30T12:19:00.860085+0000","last_unstale":"2024-03-30T12:20:36.003102+0000","last_undegraded":"2024-03-30T12:20:36.003102+0000","last_fullsized":"2024-03-30T12:20:36.003102+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:32.201939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.005496+0000","last_change":"2024-03-30T12:19:00.856917+0000","last_active":"2024-03-30T12:20:36.005496+0000","last_peered":"2024-03-30T12:20:36.005496+0000","last_clean":"2024-03-30T12:20:36.005496+0000","last_became_active":"2024-03-30T12:19:00.856643+0000","last_became_peered":"2024-03-30T12:19:00.856643+0000","last_unstale":"2024-03-30T12:20:36.005496+0000","last_undegraded":"2024-03-30T12:20:36.005496+0000","last_fullsized":"2024-03-30T12:20:36.005496+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:51:53.996045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-03-30T12:20:36.007615+0000","last_change":"2024-03-30T12:19:00.867176+0000","last_active":"2024-03-30T12:20:36.007615+0000","last_peered":"2024-03-30T12:20:36.007615+0000","last_clean":"2024-03-30T12:20:36.007615+0000","last_became_active":"2024-03-30T12:19:00.866801+0000","last_became_peered":"2024-03-30T12:19:00.866801+0000","last_unstale":"2024-03-30T12:20:36.007615+0000","last_undegraded":"2024-03-30T12:20:36.007615+0000","last_fullsized":"2024-03-30T12:20:36.007615+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:31:22.909206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3148,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":9444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234013,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32384,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712768,"statfs":{"total":95995035648,"available":95961874432,"internally_reserved":0,"allocated":1294336,"data_stored":893025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:20:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.377},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.52200000000000002,"15min":0.52700000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.68500000000000005,"5min":0.748,"15min":0.748},"last":0.45200000000000001}]},{"osd":1,"last update":"Sat Mar 30 12:20:46 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.442},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52900000000000003,"15min":0.53100000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70999999999999996,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.41599999999999998}]},{"osd":2,"last update":"Sat Mar 30 12:20:46 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51400000000000001,"15min":0.51800000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.67300000000000004,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.5},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.40899999999999997}]},{"osd":3,"last update":"Sat Mar 30 12:20:46 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51900000000000002,"15min":0.52100000000000002},"min":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.66100000000000003,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.42599999999999999}]},{"osd":4,"last update":"Sat Mar 30 12:20:46 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.30199999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71099999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.52200000000000002,"15min":0.53300000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.71699999999999997,"5min":1.143,"15min":1.143},"last":0.36199999999999999}]},{"osd":5,"last update":"Sat Mar 30 12:20:46 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.53100000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56899999999999995,"15min":0.57499999999999996},"min":{"1min":0.36299999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.016,"5min":1.246,"15min":1.246},"last":0.38500000000000001}]},{"osd":6,"last update":"Sat Mar 30 12:20:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.58099999999999996,"15min":0.59199999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.046,"5min":1.375,"15min":1.375},"last":0.435},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.54700000000000004,"15min":0.55800000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.69399999999999995,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.40000000000000002}]}]},{"osd":6,"up_from":46,"seq":197568495649,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28292,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716860,"statfs":{"total":95995035648,"available":95966064640,"internally_reserved":0,"allocated":1298432,"data_stored":894829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.52500000000000002,"15min":0.53200000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.73599999999999999,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.53800000000000003}]},{"osd":1,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77900000000000003,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.495},{"interface":"front","average":{"1min":0.505,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.35499999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.67900000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.55800000000000005}]},{"osd":2,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53800000000000003,"15min":0.54300000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.67100000000000004,"5min":1.044,"15min":1.044},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70399999999999996,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.57299999999999995}]},{"osd":3,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73399999999999999,"5min":0.754,"15min":0.754},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.38900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.72199999999999998,"5min":1.006,"15min":1.006},"last":0.59399999999999997}]},{"osd":4,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.41999999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.36499999999999999}]},{"osd":5,"last update":"Sat Mar 30 12:20:21 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.42799999999999999,"15min":0.42199999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.45800000000000002,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.32800000000000001}]},{"osd":7,"last update":"Sat Mar 30 12:20:46 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.5,"15min":0.501},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.377},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.497,"15min":0.49299999999999999},"min":{"1min":0.35299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.39200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31800,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713352,"statfs":{"total":95995035648,"available":95962472448,"internally_reserved":0,"allocated":696320,"data_stored":301998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:20:24 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34200000000000003,"15min":0.313},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.44700000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.37,"15min":0.33000000000000002},"min":{"1min":0.23100000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.46100000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.33500000000000002}]},{"osd":2,"last update":"Sat Mar 30 12:20:47 2024","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.37,"15min":0.371},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.50800000000000001,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.39100000000000001,"15min":0.38700000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.52500000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.35699999999999998}]},{"osd":3,"last update":"Sat Mar 30 12:20:13 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.27400000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55300000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.46500000000000002,"15min":0.47699999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58499999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.34399999999999997}]},{"osd":4,"last update":"Sat Mar 30 12:20:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59999999999999998}]},{"osd":5,"last update":"Sat Mar 30 12:19:54 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59199999999999997,"15min":0.58899999999999997},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.71799999999999997}]},{"osd":6,"last update":"Sat Mar 30 12:20:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.59399999999999997,"15min":0.59999999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60299999999999998,"15min":0.60599999999999998},"min":{"1min":0.46100000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.752}]},{"osd":7,"last update":"Sat Mar 30 12:20:47 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.38100000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59899999999999998,"15min":0.59699999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.59099999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32396,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712756,"statfs":{"total":95995035648,"available":95961862144,"internally_reserved":0,"allocated":1306624,"data_stored":893480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 30 12:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.32800000000000001,"15min":0.30199999999999999},"min":{"1min":0.191,"5min":0.183,"15min":0.183},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.36199999999999999,"15min":0.318},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.58199999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.29999999999999999}]},{"osd":2,"last update":"Sat Mar 30 12:20:49 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.40999999999999998,"15min":0.41499999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.47699999999999998,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.39800000000000002,"15min":0.40100000000000002},"min":{"1min":0.254,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.52900000000000003,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.35499999999999998}]},{"osd":3,"last update":"Sat Mar 30 12:20:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.27500000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.45400000000000001,"15min":0.45800000000000002},"min":{"1min":0.314,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68600000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.39800000000000002}]},{"osd":4,"last update":"Sat Mar 30 12:20:31 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73399999999999999,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.38200000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.753,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.434}]},{"osd":5,"last update":"Sat Mar 30 12:19:59 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.41099999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.76400000000000001,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.441}]},{"osd":6,"last update":"Sat Mar 30 12:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76000000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.42099999999999999}]},{"osd":7,"last update":"Sat Mar 30 12:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.48299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79100000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59899999999999998,"15min":0.59799999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.746,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.49299999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411380,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31796,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713356,"statfs":{"total":95995035648,"available":95962476544,"internally_reserved":0,"allocated":692224,"data_stored":302111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:20:50 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35799999999999998,"15min":0.34599999999999997},"min":{"1min":0.22900000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.37,"15min":0.376},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.58299999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.376}]},{"osd":1,"last update":"Sat Mar 30 12:20:50 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40200000000000002,"15min":0.40100000000000002},"min":{"1min":0.252,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.252},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39200000000000002,"15min":0.38400000000000001},"min":{"1min":0.26200000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.42999999999999999}]},{"osd":3,"last update":"Sat Mar 30 12:20:13 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45200000000000001,"15min":0.44800000000000001},"min":{"1min":0.32300000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.44500000000000001,"15min":0.45300000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.32900000000000001}]},{"osd":4,"last update":"Sat Mar 30 12:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54100000000000004,"15min":0.54300000000000004},"min":{"1min":0.378,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.39100000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.41299999999999998}]},{"osd":5,"last update":"Sat Mar 30 12:20:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":1.3400000000000001,"15min":1.474},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86799999999999999,"5min":19.606999999999999,"15min":19.606999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.42299999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.746,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.44}]},{"osd":6,"last update":"Sat Mar 30 12:20:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.40799999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.87,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.48799999999999999}]},{"osd":7,"last update":"Sat Mar 30 12:20:46 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.44500000000000001,"5min":0.438,"15min":0.438},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.505}]}]},{"osd":3,"up_from":25,"seq":107374182447,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717432,"statfs":{"total":95995035648,"available":95966650368,"internally_reserved":0,"allocated":716800,"data_stored":304838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:20:13 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39500000000000002,"15min":0.40300000000000002},"min":{"1min":0.25700000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.41299999999999998,"15min":0.41999999999999998},"min":{"1min":0.26200000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.50600000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.26700000000000002}]},{"osd":1,"last update":"Sat Mar 30 12:20:13 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.61799999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.438,"15min":0.443},"min":{"1min":0.33100000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57199999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.31}]},{"osd":2,"last update":"Sat Mar 30 12:20:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.45500000000000002,"15min":0.46200000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.42799999999999999,"15min":0.434},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.629,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.32800000000000001}]},{"osd":4,"last update":"Sat Mar 30 12:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.64600000000000002,"15min":0.68400000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.753,"5min":4.8639999999999999,"15min":4.8639999999999999},"last":0.5},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57199999999999995,"15min":0.56000000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81299999999999994,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.47399999999999998}]},{"osd":5,"last update":"Sat Mar 30 12:19:56 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.622,"15min":0.628},"min":{"1min":0.41299999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.39600000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.55000000000000004}]},{"osd":6,"last update":"Sat Mar 30 12:20:20 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.435,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82599999999999996,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.495},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.74399999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53000000000000003}]},{"osd":7,"last update":"Sat Mar 30 12:20:46 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60499999999999998,"15min":0.60899999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81000000000000005,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.629,"15min":0.629},"min":{"1min":0.44800000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54200000000000004}]}]},{"osd":4,"up_from":30,"seq":128849018922,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717444,"statfs":{"total":95995035648,"available":95966662656,"internally_reserved":0,"allocated":704512,"data_stored":302546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:20:34 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.63600000000000001,"15min":0.57999999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.73599999999999999,"5min":9.5069999999999997,"15min":9.5069999999999997},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51300000000000001,"15min":0.50800000000000001},"min":{"1min":0.29699999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.438}]},{"osd":1,"last update":"Sat Mar 30 12:20:34 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51700000000000002,"15min":0.51400000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.61899999999999999,"15min":0.53200000000000003},"min":{"1min":0.38400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.98499999999999999,"5min":11.534000000000001,"15min":11.534000000000001},"last":0.39700000000000002}]},{"osd":2,"last update":"Sat Mar 30 12:20:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.41199999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.36799999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.38600000000000001}]},{"osd":3,"last update":"Sat Mar 30 12:20:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53300000000000003,"15min":0.52300000000000002},"min":{"1min":0.40300000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.748,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.42899999999999999}]},{"osd":5,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.434,"15min":0.436},"min":{"1min":0.311,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.64900000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.437,"5min":0.42999999999999999,"15min":0.42899999999999999},"min":{"1min":0.32700000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70999999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.34000000000000002}]},{"osd":6,"last update":"Sat Mar 30 12:20:23 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.45300000000000001,"15min":0.45100000000000001},"min":{"1min":0.316,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69799999999999995,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68700000000000006,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.35699999999999998}]},{"osd":7,"last update":"Sat Mar 30 12:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70399999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.374},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.502,"15min":0.501},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71299999999999997,"5min":0.751,"15min":0.751},"last":0.49099999999999999}]}]},{"osd":5,"up_from":38,"seq":163208757286,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31816,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713336,"statfs":{"total":95995035648,"available":95962456064,"internally_reserved":0,"allocated":712704,"data_stored":304824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.36699999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51900000000000002,"15min":0.52100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70799999999999996,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.437}]},{"osd":1,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72599999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.40200000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63800000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.48199999999999998}]},{"osd":2,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51500000000000001,"15min":0.51600000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70899999999999996,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52500000000000002,"15min":0.52800000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.64200000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.46899999999999997}]},{"osd":3,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.73599999999999999,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53600000000000003,"15min":0.54000000000000004},"min":{"1min":0.41599999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.59399999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.502}]},{"osd":4,"last update":"Sat Mar 30 12:19:57 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39400000000000002,"15min":0.39000000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.40200000000000002,"15min":0.39300000000000002},"min":{"1min":0.28399999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.36899999999999999}]},{"osd":6,"last update":"Sat Mar 30 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.434,"15min":0.42999999999999999},"min":{"1min":0.32200000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.443,"15min":0.438},"min":{"1min":0.36299999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.42599999999999999}]},{"osd":7,"last update":"Sat Mar 30 12:20:49 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48899999999999999,"15min":0.48999999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.315,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.53000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:20:55.771 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-03-30T12:20:55.772 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-30T12:20:55.772 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-03-30T12:20:55.772 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph health --format=json 2024-03-30T12:20:55.976 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:20:56.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:56 smithi084 ceph-mon[37565]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:20:56.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:56 smithi084 ceph-mon[37565]: pgmap v46: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:56.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:56 smithi084 ceph-mon[27000]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:20:56.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:56 smithi084 ceph-mon[27000]: pgmap v46: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:56.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:56 smithi162 ceph-mon[30421]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:20:56.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:56 smithi162 ceph-mon[30421]: pgmap v46: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:57.917 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:20:57.918 INFO:teuthology.orchestra.run.smithi084.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-30T12:20:58.535 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-03-30T12:20:58.536 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T12:20:58.823 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:20:58.823 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":68,"fsid":"d3450b00-ee8e-11ee-b647-cb9ed24678a4","created":"2024-03-30T12:13:37.956825+0000","modified":"2024-03-30T12:20:37.000660+0000","last_up_change":"2024-03-30T12:18:42.422684+0000","last_in_change":"2024-03-30T12:18:24.854304+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T12:16:43.434051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T12:18:59.012249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T12:18:59.975381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"rbd","create_time":"2024-03-30T12:19:33.989566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a5734fa-c269-449c-805f-0a42d3d90120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6803","nonce":2597011613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6805","nonce":2597011613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6809","nonce":2597011613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6807","nonce":2597011613}]},"public_addr":"172.21.15.84:6803/2597011613","cluster_addr":"172.21.15.84:6805/2597011613","heartbeat_back_addr":"172.21.15.84:6809/2597011613","heartbeat_front_addr":"172.21.15.84:6807/2597011613","state":["exists","up"]},{"osd":1,"uuid":"3ffe676e-9055-44f7-8b04-87974b854b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6811","nonce":6106221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6813","nonce":6106221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6817","nonce":6106221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6815","nonce":6106221}]},"public_addr":"172.21.15.84:6811/6106221","cluster_addr":"172.21.15.84:6813/6106221","heartbeat_back_addr":"172.21.15.84:6817/6106221","heartbeat_front_addr":"172.21.15.84:6815/6106221","state":["exists","up"]},{"osd":2,"uuid":"c21b4cb6-9ade-44d2-a7ba-33fe9b5dd3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6819","nonce":3627018831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6821","nonce":3627018831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6825","nonce":3627018831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6823","nonce":3627018831}]},"public_addr":"172.21.15.84:6819/3627018831","cluster_addr":"172.21.15.84:6821/3627018831","heartbeat_back_addr":"172.21.15.84:6825/3627018831","heartbeat_front_addr":"172.21.15.84:6823/3627018831","state":["exists","up"]},{"osd":3,"uuid":"d60cb7da-fc49-4cbf-855a-2957dcbf66b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6827","nonce":46835826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6829","nonce":46835826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6833","nonce":46835826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6831","nonce":46835826}]},"public_addr":"172.21.15.84:6827/46835826","cluster_addr":"172.21.15.84:6829/46835826","heartbeat_back_addr":"172.21.15.84:6833/46835826","heartbeat_front_addr":"172.21.15.84:6831/46835826","state":["exists","up"]},{"osd":4,"uuid":"46a5087f-cf7c-4bb2-bace-6e04d57496ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6801","nonce":592935958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6803","nonce":592935958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6807","nonce":592935958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6805","nonce":592935958}]},"public_addr":"172.21.15.162:6801/592935958","cluster_addr":"172.21.15.162:6803/592935958","heartbeat_back_addr":"172.21.15.162:6807/592935958","heartbeat_front_addr":"172.21.15.162:6805/592935958","state":["exists","up"]},{"osd":5,"uuid":"2408494e-0472-4cde-aac6-e87d919b6d2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6809","nonce":2786846638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6811","nonce":2786846638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6815","nonce":2786846638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6813","nonce":2786846638}]},"public_addr":"172.21.15.162:6809/2786846638","cluster_addr":"172.21.15.162:6811/2786846638","heartbeat_back_addr":"172.21.15.162:6815/2786846638","heartbeat_front_addr":"172.21.15.162:6813/2786846638","state":["exists","up"]},{"osd":6,"uuid":"f86781fa-6cb4-4abd-b759-84ff6d7b36d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6817","nonce":2493067564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6819","nonce":2493067564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6823","nonce":2493067564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6821","nonce":2493067564}]},"public_addr":"172.21.15.162:6817/2493067564","cluster_addr":"172.21.15.162:6819/2493067564","heartbeat_back_addr":"172.21.15.162:6823/2493067564","heartbeat_front_addr":"172.21.15.162:6821/2493067564","state":["exists","up"]},{"osd":7,"uuid":"49a38087-ec6c-4ae8-b932-9c59ff7d4321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6825","nonce":158814135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6827","nonce":158814135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6831","nonce":158814135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6829","nonce":158814135}]},"public_addr":"172.21.15.162:6825/158814135","cluster_addr":"172.21.15.162:6827/158814135","heartbeat_back_addr":"172.21.15.162:6831/158814135","heartbeat_front_addr":"172.21.15.162:6829/158814135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:15:49.285912+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:14.234967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:39.383506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:03.790574+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:26.131317+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:50.385373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:14.909835+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:40.707128+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.1d","mappings":[{"from":4,"to":1}]},{"pgid":"3.24","mappings":[{"from":4,"to":2}]},{"pgid":"3.3e","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6800/2648486638":"2024-03-31T12:19:35.808765+0000","172.21.15.84:0/1692747755":"2024-03-31T12:19:35.808765+0000","172.21.15.84:0/2147212239":"2024-03-31T12:19:35.808765+0000","172.21.15.84:0/1374515169":"2024-03-31T12:14:31.125768+0000","172.21.15.84:0/2743767955":"2024-03-31T12:19:35.808765+0000","172.21.15.84:6800/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6800/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/4071895056":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3672833890":"2024-03-31T12:19:35.808765+0000","172.21.15.84:6801/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6801/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3191408930":"2024-03-31T12:14:06.678373+0000","172.21.15.84:6801/2648486638":"2024-03-31T12:19:35.808765+0000","172.21.15.84:0/1433254333":"2024-03-31T12:14:31.125768+0000","172.21.15.84:0/1390761199":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3135527830":"2024-03-31T12:14:31.125768+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T12:20:58.836 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T12:16:43.434051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T12:18:59.012249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T12:18:59.975381+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'rbd', 'create_time': '2024-03-30T12:19:33.989566+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 3, 'score_stable': 3, 'optimal_score': 1, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T12:20:58.836 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T12:20:59.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:58 smithi162 ceph-mon[30421]: pgmap v47: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:59.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:58 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/2282978984' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-30T12:20:59.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:58 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/1234456948' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:20:59.121 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-03-30T12:20:59.133 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:58 smithi084 ceph-mon[27000]: pgmap v47: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:59.134 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:58 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/2282978984' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-30T12:20:59.134 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:58 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/1234456948' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:20:59.134 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:58 smithi084 ceph-mon[37565]: pgmap v47: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:20:59.134 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:58 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/2282978984' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-30T12:20:59.134 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:58 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/1234456948' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:20:59.135 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T12:20:59.419 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-03-30T12:20:59.430 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:20:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:20:59] "GET /metrics HTTP/1.1" 200 33651 "" "Prometheus/2.43.0" 2024-03-30T12:20:59.432 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T12:20:59.718 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-03-30T12:20:59.732 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-30T12:21:00.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:59 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3340510434' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-30T12:21:00.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:59 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/1801939102' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-30T12:21:00.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:20:59 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/1488675188' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-30T12:21:00.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:59 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/3340510434' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-30T12:21:00.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:59 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/1801939102' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-30T12:21:00.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:20:59 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/1488675188' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-30T12:21:00.022 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2024-03-30T12:21:00.035 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T12:21:00.353 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:21:00.353 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/420740305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":420740305},{"type":"v1","addr":"172.21.15.84:6835","nonce":420740305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T12:19:00.832494+0000","modified":"2024-03-30T12:19:02.842890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24331":{"gid":24331,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6833/1272121665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1272121665},{"type":"v1","addr":"172.21.15.162:6833","nonce":1272121665}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-30T12:21:00.353 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 6 2024-03-30T12:21:00.367 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T12:21:00.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:59 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/3340510434' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-30T12:21:00.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:59 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/1801939102' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-30T12:21:00.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:20:59 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/1488675188' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-30T12:21:00.655 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:21:00.655 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":68,"fsid":"d3450b00-ee8e-11ee-b647-cb9ed24678a4","created":"2024-03-30T12:13:37.956825+0000","modified":"2024-03-30T12:20:37.000660+0000","last_up_change":"2024-03-30T12:18:42.422684+0000","last_in_change":"2024-03-30T12:18:24.854304+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T12:16:43.434051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T12:18:59.012249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T12:18:59.975381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"rbd","create_time":"2024-03-30T12:19:33.989566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a5734fa-c269-449c-805f-0a42d3d90120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6803","nonce":2597011613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6805","nonce":2597011613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6809","nonce":2597011613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6807","nonce":2597011613}]},"public_addr":"172.21.15.84:6803/2597011613","cluster_addr":"172.21.15.84:6805/2597011613","heartbeat_back_addr":"172.21.15.84:6809/2597011613","heartbeat_front_addr":"172.21.15.84:6807/2597011613","state":["exists","up"]},{"osd":1,"uuid":"3ffe676e-9055-44f7-8b04-87974b854b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6811","nonce":6106221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6813","nonce":6106221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6817","nonce":6106221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6815","nonce":6106221}]},"public_addr":"172.21.15.84:6811/6106221","cluster_addr":"172.21.15.84:6813/6106221","heartbeat_back_addr":"172.21.15.84:6817/6106221","heartbeat_front_addr":"172.21.15.84:6815/6106221","state":["exists","up"]},{"osd":2,"uuid":"c21b4cb6-9ade-44d2-a7ba-33fe9b5dd3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6819","nonce":3627018831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6821","nonce":3627018831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6825","nonce":3627018831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6823","nonce":3627018831}]},"public_addr":"172.21.15.84:6819/3627018831","cluster_addr":"172.21.15.84:6821/3627018831","heartbeat_back_addr":"172.21.15.84:6825/3627018831","heartbeat_front_addr":"172.21.15.84:6823/3627018831","state":["exists","up"]},{"osd":3,"uuid":"d60cb7da-fc49-4cbf-855a-2957dcbf66b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6827","nonce":46835826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6829","nonce":46835826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6833","nonce":46835826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6831","nonce":46835826}]},"public_addr":"172.21.15.84:6827/46835826","cluster_addr":"172.21.15.84:6829/46835826","heartbeat_back_addr":"172.21.15.84:6833/46835826","heartbeat_front_addr":"172.21.15.84:6831/46835826","state":["exists","up"]},{"osd":4,"uuid":"46a5087f-cf7c-4bb2-bace-6e04d57496ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6801","nonce":592935958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6803","nonce":592935958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6807","nonce":592935958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6805","nonce":592935958}]},"public_addr":"172.21.15.162:6801/592935958","cluster_addr":"172.21.15.162:6803/592935958","heartbeat_back_addr":"172.21.15.162:6807/592935958","heartbeat_front_addr":"172.21.15.162:6805/592935958","state":["exists","up"]},{"osd":5,"uuid":"2408494e-0472-4cde-aac6-e87d919b6d2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6809","nonce":2786846638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6811","nonce":2786846638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6815","nonce":2786846638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6813","nonce":2786846638}]},"public_addr":"172.21.15.162:6809/2786846638","cluster_addr":"172.21.15.162:6811/2786846638","heartbeat_back_addr":"172.21.15.162:6815/2786846638","heartbeat_front_addr":"172.21.15.162:6813/2786846638","state":["exists","up"]},{"osd":6,"uuid":"f86781fa-6cb4-4abd-b759-84ff6d7b36d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6817","nonce":2493067564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6819","nonce":2493067564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6823","nonce":2493067564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6821","nonce":2493067564}]},"public_addr":"172.21.15.162:6817/2493067564","cluster_addr":"172.21.15.162:6819/2493067564","heartbeat_back_addr":"172.21.15.162:6823/2493067564","heartbeat_front_addr":"172.21.15.162:6821/2493067564","state":["exists","up"]},{"osd":7,"uuid":"49a38087-ec6c-4ae8-b932-9c59ff7d4321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6825","nonce":158814135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6827","nonce":158814135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6831","nonce":158814135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6829","nonce":158814135}]},"public_addr":"172.21.15.162:6825/158814135","cluster_addr":"172.21.15.162:6827/158814135","heartbeat_back_addr":"172.21.15.162:6831/158814135","heartbeat_front_addr":"172.21.15.162:6829/158814135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:15:49.285912+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:14.234967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:39.383506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:03.790574+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:26.131317+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:50.385373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:14.909835+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:40.707128+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.1d","mappings":[{"from":4,"to":1}]},{"pgid":"3.24","mappings":[{"from":4,"to":2}]},{"pgid":"3.3e","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6800/2648486638":"2024-03-31T12:19:35.808765+0000","172.21.15.84:0/1692747755":"2024-03-31T12:19:35.808765+0000","172.21.15.84:0/2147212239":"2024-03-31T12:19:35.808765+0000","172.21.15.84:0/1374515169":"2024-03-31T12:14:31.125768+0000","172.21.15.84:0/2743767955":"2024-03-31T12:19:35.808765+0000","172.21.15.84:6800/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6800/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/4071895056":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3672833890":"2024-03-31T12:19:35.808765+0000","172.21.15.84:6801/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6801/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3191408930":"2024-03-31T12:14:06.678373+0000","172.21.15.84:6801/2648486638":"2024-03-31T12:19:35.808765+0000","172.21.15.84:0/1433254333":"2024-03-31T12:14:31.125768+0000","172.21.15.84:0/1390761199":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3135527830":"2024-03-31T12:14:31.125768+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T12:21:00.667 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T12:16:43.434051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T12:18:59.012249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T12:18:59.975381+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'rbd', 'create_time': '2024-03-30T12:19:33.989566+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 3, 'score_stable': 3, 'optimal_score': 1, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T12:21:00.668 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T12:21:00.956 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-03-30T12:21:00.968 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:00 smithi084 ceph-mon[37565]: pgmap v48: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:00.968 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:00 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/1779825272' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]: dispatch 2024-03-30T12:21:00.968 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:00 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/4171318642' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:21:00.969 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:00 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/4099473578' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:21:00.969 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:00 smithi084 ceph-mon[27000]: pgmap v48: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:00.969 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:00 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/1779825272' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]: dispatch 2024-03-30T12:21:00.969 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:00 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/4171318642' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:21:00.969 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:00 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/4099473578' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:21:00.970 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T12:21:01.254 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-03-30T12:21:01.267 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T12:21:01.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:00 smithi162 ceph-mon[30421]: pgmap v48: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:01.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:00 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/1779825272' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]: dispatch 2024-03-30T12:21:01.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:00 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/4171318642' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:21:01.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:00 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/4099473578' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:21:01.550 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-03-30T12:21:01.564 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-30T12:21:01.848 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2024-03-30T12:21:01.862 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T12:21:02.182 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:21:02.182 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/420740305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":420740305},{"type":"v1","addr":"172.21.15.84:6835","nonce":420740305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T12:19:00.832494+0000","modified":"2024-03-30T12:19:02.842890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24331":{"gid":24331,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6833/1272121665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1272121665},{"type":"v1","addr":"172.21.15.162:6833","nonce":1272121665}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-30T12:21:02.183 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 6 2024-03-30T12:21:02.194 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:01 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/3601823321' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-30T12:21:02.194 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:01 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/688488050' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-30T12:21:02.194 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:01 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/494608330' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-30T12:21:02.194 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:01 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/514853739' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]: dispatch 2024-03-30T12:21:02.194 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:01 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3601823321' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-30T12:21:02.194 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:01 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/688488050' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-30T12:21:02.195 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:01 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/494608330' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-30T12:21:02.195 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:01 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/514853739' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]: dispatch 2024-03-30T12:21:02.195 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T12:21:02.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:01 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/3601823321' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-30T12:21:02.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:01 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/688488050' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-30T12:21:02.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:01 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/494608330' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-30T12:21:02.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:01 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/514853739' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]: dispatch 2024-03-30T12:21:02.477 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:21:02.477 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":68,"fsid":"d3450b00-ee8e-11ee-b647-cb9ed24678a4","created":"2024-03-30T12:13:37.956825+0000","modified":"2024-03-30T12:20:37.000660+0000","last_up_change":"2024-03-30T12:18:42.422684+0000","last_in_change":"2024-03-30T12:18:24.854304+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T12:16:43.434051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T12:18:59.012249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T12:18:59.975381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"rbd","create_time":"2024-03-30T12:19:33.989566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0a5734fa-c269-449c-805f-0a42d3d90120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6803","nonce":2597011613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6805","nonce":2597011613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6809","nonce":2597011613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2597011613},{"type":"v1","addr":"172.21.15.84:6807","nonce":2597011613}]},"public_addr":"172.21.15.84:6803/2597011613","cluster_addr":"172.21.15.84:6805/2597011613","heartbeat_back_addr":"172.21.15.84:6809/2597011613","heartbeat_front_addr":"172.21.15.84:6807/2597011613","state":["exists","up"]},{"osd":1,"uuid":"3ffe676e-9055-44f7-8b04-87974b854b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6811","nonce":6106221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6813","nonce":6106221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6817","nonce":6106221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":6106221},{"type":"v1","addr":"172.21.15.84:6815","nonce":6106221}]},"public_addr":"172.21.15.84:6811/6106221","cluster_addr":"172.21.15.84:6813/6106221","heartbeat_back_addr":"172.21.15.84:6817/6106221","heartbeat_front_addr":"172.21.15.84:6815/6106221","state":["exists","up"]},{"osd":2,"uuid":"c21b4cb6-9ade-44d2-a7ba-33fe9b5dd3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6819","nonce":3627018831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6821","nonce":3627018831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6825","nonce":3627018831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3627018831},{"type":"v1","addr":"172.21.15.84:6823","nonce":3627018831}]},"public_addr":"172.21.15.84:6819/3627018831","cluster_addr":"172.21.15.84:6821/3627018831","heartbeat_back_addr":"172.21.15.84:6825/3627018831","heartbeat_front_addr":"172.21.15.84:6823/3627018831","state":["exists","up"]},{"osd":3,"uuid":"d60cb7da-fc49-4cbf-855a-2957dcbf66b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6827","nonce":46835826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6829","nonce":46835826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6833","nonce":46835826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":46835826},{"type":"v1","addr":"172.21.15.84:6831","nonce":46835826}]},"public_addr":"172.21.15.84:6827/46835826","cluster_addr":"172.21.15.84:6829/46835826","heartbeat_back_addr":"172.21.15.84:6833/46835826","heartbeat_front_addr":"172.21.15.84:6831/46835826","state":["exists","up"]},{"osd":4,"uuid":"46a5087f-cf7c-4bb2-bace-6e04d57496ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6801","nonce":592935958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6803","nonce":592935958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6807","nonce":592935958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":592935958},{"type":"v1","addr":"172.21.15.162:6805","nonce":592935958}]},"public_addr":"172.21.15.162:6801/592935958","cluster_addr":"172.21.15.162:6803/592935958","heartbeat_back_addr":"172.21.15.162:6807/592935958","heartbeat_front_addr":"172.21.15.162:6805/592935958","state":["exists","up"]},{"osd":5,"uuid":"2408494e-0472-4cde-aac6-e87d919b6d2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6809","nonce":2786846638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6811","nonce":2786846638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6815","nonce":2786846638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2786846638},{"type":"v1","addr":"172.21.15.162:6813","nonce":2786846638}]},"public_addr":"172.21.15.162:6809/2786846638","cluster_addr":"172.21.15.162:6811/2786846638","heartbeat_back_addr":"172.21.15.162:6815/2786846638","heartbeat_front_addr":"172.21.15.162:6813/2786846638","state":["exists","up"]},{"osd":6,"uuid":"f86781fa-6cb4-4abd-b759-84ff6d7b36d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6817","nonce":2493067564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6819","nonce":2493067564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6823","nonce":2493067564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2493067564},{"type":"v1","addr":"172.21.15.162:6821","nonce":2493067564}]},"public_addr":"172.21.15.162:6817/2493067564","cluster_addr":"172.21.15.162:6819/2493067564","heartbeat_back_addr":"172.21.15.162:6823/2493067564","heartbeat_front_addr":"172.21.15.162:6821/2493067564","state":["exists","up"]},{"osd":7,"uuid":"49a38087-ec6c-4ae8-b932-9c59ff7d4321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6825","nonce":158814135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6827","nonce":158814135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6831","nonce":158814135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":158814135},{"type":"v1","addr":"172.21.15.162:6829","nonce":158814135}]},"public_addr":"172.21.15.162:6825/158814135","cluster_addr":"172.21.15.162:6827/158814135","heartbeat_back_addr":"172.21.15.162:6831/158814135","heartbeat_front_addr":"172.21.15.162:6829/158814135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:15:49.285912+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:14.234967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:39.383506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:03.790574+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:26.131317+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:50.385373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:14.909835+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:40.707128+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.1d","mappings":[{"from":4,"to":1}]},{"pgid":"3.24","mappings":[{"from":4,"to":2}]},{"pgid":"3.3e","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6800/2648486638":"2024-03-31T12:19:35.808765+0000","172.21.15.84:0/1692747755":"2024-03-31T12:19:35.808765+0000","172.21.15.84:0/2147212239":"2024-03-31T12:19:35.808765+0000","172.21.15.84:0/1374515169":"2024-03-31T12:14:31.125768+0000","172.21.15.84:0/2743767955":"2024-03-31T12:19:35.808765+0000","172.21.15.84:6800/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6800/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/4071895056":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3672833890":"2024-03-31T12:19:35.808765+0000","172.21.15.84:6801/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6801/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3191408930":"2024-03-31T12:14:06.678373+0000","172.21.15.84:6801/2648486638":"2024-03-31T12:19:35.808765+0000","172.21.15.84:0/1433254333":"2024-03-31T12:14:31.125768+0000","172.21.15.84:0/1390761199":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3135527830":"2024-03-31T12:14:31.125768+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T12:21:02.491 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T12:21:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:21:02.810 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/420740305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":420740305},{"type":"v1","addr":"172.21.15.84:6835","nonce":420740305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T12:19:00.832494+0000","modified":"2024-03-30T12:19:02.842890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24331":{"gid":24331,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6833/1272121665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1272121665},{"type":"v1","addr":"172.21.15.162:6833","nonce":1272121665}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-30T12:21:02.810 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 6 2024-03-30T12:21:02.822 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-30T12:19:00.832494+0000', 'modified': '2024-03-30T12:19:02.842890+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24331}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24331': {'gid': 24331, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.162:6833/1272121665', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6832', 'nonce': 1272121665}, {'type': 'v1', 'addr': '172.21.15.162:6833', 'nonce': 1272121665}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-03-30T12:21:02.822 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-30T12:21:02.822 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-30T12:21:02.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-30T12:21:02.943+0000 7fb6277fe640 0 client.24803 ms_handle_reset on v2:172.21.15.162:6832/1272121665 2024-03-30T12:21:02.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-03-30T12:21:02.962+0000 7fb6277fe640 0 client.24809 ms_handle_reset on v2:172.21.15.162:6832/1272121665 2024-03-30T12:21:02.953 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-30T12:21:02.953 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "d3450b00-ee8e-11ee-b647-cb9ed24678a4", 2024-03-30T12:21:02.954 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2024-03-30T12:21:02.954 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24331, 2024-03-30T12:21:02.954 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-03-30T12:21:02.954 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-03-30T12:21:02.954 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-03-30T12:21:02.954 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 122.124830355, 2024-03-30T12:21:02.954 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 6, 2024-03-30T12:21:02.954 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 68, 2024-03-30T12:21:02.954 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 62, 2024-03-30T12:21:02.954 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 126.710523378 2024-03-30T12:21:02.954 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-30T12:21:02.964 INFO:tasks.cephadm:Setup complete, yielding 2024-03-30T12:21:02.965 INFO:teuthology.run_tasks:Running task print... 2024-03-30T12:21:02.974 INFO:teuthology.task.print:**** done end installing reef cephadm ... 2024-03-30T12:21:02.974 INFO:teuthology.run_tasks:Running task print... 2024-03-30T12:21:03.098 INFO:teuthology.task.print:**** done start cephadm.shell ceph config set mgr... 2024-03-30T12:21:03.098 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-30T12:21:03.112 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi084.front.sepia.ceph.com 2024-03-30T12:21:03.112 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-03-30T12:21:03.137 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:02 smithi084 ceph-mon[37565]: pgmap v49: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:03.137 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:02 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/3369352821' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:21:03.137 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:02 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/3367032854' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:21:03.137 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:02 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/2148694798' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:21:03.137 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:02 smithi084 ceph-mon[27000]: pgmap v49: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:03.137 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:02 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3369352821' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:21:03.137 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:02 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3367032854' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:21:03.137 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:02 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/2148694798' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:21:03.314 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:21:03.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:02 smithi162 ceph-mon[30421]: pgmap v49: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:03.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:02 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/3369352821' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:21:03.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:02 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/3367032854' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:21:03.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:02 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/2148694798' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:21:05.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:04 smithi084 ceph-mon[37565]: pgmap v50: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:05.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:04 smithi084 ceph-mon[27000]: pgmap v50: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:05.278 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:05] ENGINE Bus STOPPING 2024-03-30T12:21:05.278 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:05] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T12:21:05.279 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:05] ENGINE Bus STOPPED 2024-03-30T12:21:05.279 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:05] ENGINE Bus STARTING 2024-03-30T12:21:05.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:04 smithi162 ceph-mon[30421]: pgmap v50: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:05.546 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:05] ENGINE Serving on http://:::9283 2024-03-30T12:21:05.546 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:05] ENGINE Bus STARTED 2024-03-30T12:21:06.001 INFO:teuthology.run_tasks:Running task print... 2024-03-30T12:21:06.011 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-03-30T12:21:06.011 INFO:teuthology.run_tasks:Running task print... 2024-03-30T12:21:06.021 INFO:teuthology.task.print:**** done start telemetry reef... 2024-03-30T12:21:06.021 INFO:teuthology.run_tasks:Running task workunit... 2024-03-30T12:21:06.036 INFO:tasks.workunit:Pulling workunits from ref 5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc 2024-03-30T12:21:06.036 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-30T12:21:06.036 DEBUG:teuthology.orchestra.run.smithi084:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-30T12:21:06.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T12:21:06.057 INFO:teuthology.orchestra.run.smithi084.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-30T12:21:06.057 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-30T12:21:06.113 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-30T12:21:06.114 DEBUG:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-30T12:21:06.170 INFO:tasks.workunit:timeout=3h 2024-03-30T12:21:06.170 INFO:tasks.workunit:cleanup=True 2024-03-30T12:21:06.171 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc 2024-03-30T12:21:06.225 INFO:tasks.workunit.client.0.smithi084.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-30T12:21:06.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:06 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/2918286006' entity='client.admin' 2024-03-30T12:21:06.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:06 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:06.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:06 smithi084 ceph-mon[37565]: pgmap v51: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:06.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:06 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:21:06.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:06 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/2918286006' entity='client.admin' 2024-03-30T12:21:06.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:06 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:06.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:06 smithi084 ceph-mon[27000]: pgmap v51: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:06.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:06 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:21:06.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:06 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/2918286006' entity='client.admin' 2024-03-30T12:21:06.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:06 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:06.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:06 smithi162 ceph-mon[30421]: pgmap v51: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:06.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:06 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:21:09.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:08 smithi084 ceph-mon[37565]: pgmap v52: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-30T12:21:09.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:08 smithi084 ceph-mon[37565]: mgrmap e21: y(active, since 92s), standbys: x 2024-03-30T12:21:09.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:08 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:09.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:08 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:09.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:08 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:09.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:08 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:09.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:08 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:21:09.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:08 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:21:09.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:08 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:09.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:08 smithi084 ceph-mon[27000]: pgmap v52: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-30T12:21:09.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:08 smithi084 ceph-mon[27000]: mgrmap e21: y(active, since 92s), standbys: x 2024-03-30T12:21:09.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:08 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:09.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:08 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:09.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:08 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:09.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:08 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:09.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:08 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:21:09.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:08 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:21:09.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:08 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:09.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:08 smithi162 ceph-mon[30421]: pgmap v52: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-30T12:21:09.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:08 smithi162 ceph-mon[30421]: mgrmap e21: y(active, since 92s), standbys: x 2024-03-30T12:21:09.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:08 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:09.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:08 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:09.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:08 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:09.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:08 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:09.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:08 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:21:09.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:08 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:21:09.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:08 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:09.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:21:09] "GET /metrics HTTP/1.1" 200 33649 "" "Prometheus/2.43.0" 2024-03-30T12:21:11.172 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:10 smithi162 ceph-mon[30421]: pgmap v53: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-30T12:21:11.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:10 smithi084 ceph-mon[37565]: pgmap v53: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-30T12:21:11.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:10 smithi084 ceph-mon[27000]: pgmap v53: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-30T12:21:13.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:12 smithi084 ceph-mon[37565]: pgmap v54: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-30T12:21:13.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:12 smithi084 ceph-mon[27000]: pgmap v54: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-30T12:21:13.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:12 smithi162 ceph-mon[30421]: pgmap v54: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-30T12:21:15.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:14 smithi084 ceph-mon[37565]: pgmap v55: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-30T12:21:15.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:14 smithi084 ceph-mon[27000]: pgmap v55: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-30T12:21:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:14 smithi162 ceph-mon[30421]: pgmap v55: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-30T12:21:16.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:16 smithi084 ceph-mon[37565]: pgmap v56: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-30T12:21:16.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:16 smithi084 ceph-mon[27000]: pgmap v56: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-30T12:21:16.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:16 smithi162 ceph-mon[30421]: pgmap v56: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-30T12:21:19.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:18 smithi084 ceph-mon[37565]: pgmap v57: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-30T12:21:19.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:18 smithi084 ceph-mon[27000]: pgmap v57: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-30T12:21:19.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:18 smithi162 ceph-mon[30421]: pgmap v57: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-30T12:21:19.544 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:21:19] "GET /metrics HTTP/1.1" 200 33649 "" "Prometheus/2.43.0" 2024-03-30T12:21:21.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:20 smithi084 ceph-mon[37565]: pgmap v58: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:21.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:20 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:21:21.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:20 smithi084 ceph-mon[27000]: pgmap v58: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:21.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:20 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:21:21.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:20 smithi162 ceph-mon[30421]: pgmap v58: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:21.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:20 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:21:23.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:22 smithi084 ceph-mon[37565]: pgmap v59: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:23.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:22 smithi084 ceph-mon[27000]: pgmap v59: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:23.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:22 smithi162 ceph-mon[30421]: pgmap v59: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:25.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:24 smithi084 ceph-mon[37565]: pgmap v60: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:25.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:24 smithi084 ceph-mon[27000]: pgmap v60: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:25.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:24 smithi162 ceph-mon[30421]: pgmap v60: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:26.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:26 smithi162 ceph-mon[30421]: pgmap v61: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:26.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:26 smithi084 ceph-mon[27000]: pgmap v61: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:26.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:26 smithi084 ceph-mon[37565]: pgmap v61: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:29.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:28 smithi084 ceph-mon[37565]: pgmap v62: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:29.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:28 smithi084 ceph-mon[27000]: pgmap v62: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:29.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:28 smithi162 ceph-mon[30421]: pgmap v62: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:29.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:21:29] "GET /metrics HTTP/1.1" 200 33648 "" "Prometheus/2.43.0" 2024-03-30T12:21:31.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:30 smithi084 ceph-mon[37565]: pgmap v63: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:31.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:30 smithi084 ceph-mon[27000]: pgmap v63: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:31.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:30 smithi162 ceph-mon[30421]: pgmap v63: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:33.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:32 smithi084 ceph-mon[37565]: pgmap v64: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:33.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:32 smithi084 ceph-mon[27000]: pgmap v64: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:33.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:32 smithi162 ceph-mon[30421]: pgmap v64: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:35.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:34 smithi084 ceph-mon[37565]: pgmap v65: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:35.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:34 smithi084 ceph-mon[27000]: pgmap v65: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:35.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:34 smithi162 ceph-mon[30421]: pgmap v65: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:36 smithi162 ceph-mon[30421]: pgmap v66: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:36 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:21:36.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:36 smithi084 ceph-mon[37565]: pgmap v66: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:36.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:36 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:21:36.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:36 smithi084 ceph-mon[27000]: pgmap v66: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:36.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:36 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:21:39.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:38 smithi084 ceph-mon[37565]: pgmap v67: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:39.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:38 smithi084 ceph-mon[27000]: pgmap v67: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:39.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:38 smithi162 ceph-mon[30421]: pgmap v67: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:39.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:21:39] "GET /metrics HTTP/1.1" 200 33644 "" "Prometheus/2.43.0" 2024-03-30T12:21:41.172 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:40 smithi162 ceph-mon[30421]: pgmap v68: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:41.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:40 smithi084 ceph-mon[27000]: pgmap v68: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:41.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:40 smithi084 ceph-mon[37565]: pgmap v68: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:43.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:42 smithi084 ceph-mon[37565]: pgmap v69: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:43.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:42 smithi084 ceph-mon[27000]: pgmap v69: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:43.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:42 smithi162 ceph-mon[30421]: pgmap v69: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:45.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:44 smithi084 ceph-mon[37565]: pgmap v70: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:45.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:44 smithi084 ceph-mon[27000]: pgmap v70: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:45.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:44 smithi162 ceph-mon[30421]: pgmap v70: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:46.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:46 smithi162 ceph-mon[30421]: pgmap v71: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:46.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:46 smithi084 ceph-mon[27000]: pgmap v71: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:46.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:46 smithi084 ceph-mon[37565]: pgmap v71: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:49.205 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:48 smithi084 ceph-mon[37565]: pgmap v72: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:49.205 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:48 smithi084 ceph-mon[27000]: pgmap v72: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:49.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:48 smithi162 ceph-mon[30421]: pgmap v72: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:49.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:21:49] "GET /metrics HTTP/1.1" 200 33644 "" "Prometheus/2.43.0" 2024-03-30T12:21:50.851 INFO:tasks.workunit.client.0.smithi084.stderr:Note: switching to '5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc'. 2024-03-30T12:21:50.851 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-03-30T12:21:50.852 INFO:tasks.workunit.client.0.smithi084.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-30T12:21:50.852 INFO:tasks.workunit.client.0.smithi084.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-30T12:21:50.852 INFO:tasks.workunit.client.0.smithi084.stderr:state without impacting any branches by switching back to a branch. 2024-03-30T12:21:50.852 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-03-30T12:21:50.852 INFO:tasks.workunit.client.0.smithi084.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-30T12:21:50.852 INFO:tasks.workunit.client.0.smithi084.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-30T12:21:50.852 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-03-30T12:21:50.852 INFO:tasks.workunit.client.0.smithi084.stderr: git switch -c 2024-03-30T12:21:50.852 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-03-30T12:21:50.852 INFO:tasks.workunit.client.0.smithi084.stderr:Or undo this operation with: 2024-03-30T12:21:50.852 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-03-30T12:21:50.852 INFO:tasks.workunit.client.0.smithi084.stderr: git switch - 2024-03-30T12:21:50.852 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-03-30T12:21:50.852 INFO:tasks.workunit.client.0.smithi084.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-30T12:21:50.852 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-03-30T12:21:50.853 INFO:tasks.workunit.client.0.smithi084.stderr:HEAD is now at 5dc2ea3016d test/ceph_test_rados: fix seeking over virtual, in-memory objects 2024-03-30T12:21:50.857 DEBUG:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-30T12:21:50.924 INFO:tasks.workunit.client.0.smithi084.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-30T12:21:50.926 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-30T12:21:50.926 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-30T12:21:51.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:50 smithi084 ceph-mon[37565]: pgmap v73: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:51.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:50 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:21:51.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:50 smithi084 ceph-mon[27000]: pgmap v73: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:51.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:50 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:21:51.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:50 smithi162 ceph-mon[30421]: pgmap v73: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:51.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:50 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:21:51.667 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-30T12:21:51.724 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-30T12:21:51.764 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-30T12:21:51.766 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-30T12:21:51.766 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-30T12:21:51.805 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-30T12:21:51.808 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-03-30T12:21:51.808 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-30T12:21:51.863 INFO:tasks.workunit:Running workunits matching test_telemetry_reef.sh on client.0... 2024-03-30T12:21:51.864 INFO:tasks.workunit:Running workunit test_telemetry_reef.sh... 2024-03-30T12:21:51.865 DEBUG:teuthology.orchestra.run.smithi084:workunit test test_telemetry_reef.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/test_telemetry_reef.sh 2024-03-30T12:21:51.922 INFO:tasks.workunit.client.0.smithi084.stderr:+ ceph config set mgr mgr/telemetry/channel_ident true 2024-03-30T12:21:52.304 INFO:tasks.workunit.client.0.smithi084.stderr:+ ceph config set mgr mgr/telemetry/organization ceph-qa 2024-03-30T12:21:52.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:52] ENGINE Bus STOPPING 2024-03-30T12:21:52.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:52] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T12:21:52.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:52] ENGINE Bus STOPPED 2024-03-30T12:21:52.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:52] ENGINE Bus STARTING 2024-03-30T12:21:52.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:52] ENGINE Serving on http://:::9283 2024-03-30T12:21:52.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:52] ENGINE Bus STARTED 2024-03-30T12:21:52.684 INFO:tasks.workunit.client.0.smithi084.stderr:+ ceph config set mgr mgr/telemetry/description 'upgrade test cluster' 2024-03-30T12:21:52.900 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:52] ENGINE Bus STOPPING 2024-03-30T12:21:52.900 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:52] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T12:21:52.900 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:52] ENGINE Bus STOPPED 2024-03-30T12:21:52.900 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:52] ENGINE Bus STARTING 2024-03-30T12:21:52.900 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:52] ENGINE Serving on http://:::9283 2024-03-30T12:21:52.900 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:52] ENGINE Bus STARTED 2024-03-30T12:21:52.901 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-mon[27000]: pgmap v74: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:52.901 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/591609127' entity='client.admin' 2024-03-30T12:21:52.901 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:52.901 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/1003143716' entity='client.admin' 2024-03-30T12:21:52.901 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:21:53.080 INFO:tasks.workunit.client.0.smithi084.stderr:+ ceph telemetry preview 2024-03-30T12:21:53.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:21:53.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:53.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:53.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-mon[37565]: pgmap v74: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:53.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/591609127' entity='client.admin' 2024-03-30T12:21:53.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:53.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/1003143716' entity='client.admin' 2024-03-30T12:21:53.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:21:53.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:21:53.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:53.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:53.255 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:52] ENGINE Bus STOPPING 2024-03-30T12:21:53.255 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:52] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T12:21:53.255 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:52] ENGINE Bus STOPPED 2024-03-30T12:21:53.255 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:52] ENGINE Bus STARTING 2024-03-30T12:21:53.255 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:53] ENGINE Serving on http://:::9283 2024-03-30T12:21:53.255 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:53] ENGINE Bus STARTED 2024-03-30T12:21:53.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:52 smithi162 ceph-mon[30421]: pgmap v74: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:53.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:52 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/591609127' entity='client.admin' 2024-03-30T12:21:53.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:52 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:53.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:52 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/1003143716' entity='client.admin' 2024-03-30T12:21:53.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:52 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:21:53.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:52 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:21:53.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:52 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:53.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:52 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:53.597 INFO:tasks.workunit.client.0.smithi084.stdout:{ 2024-03-30T12:21:53.597 INFO:tasks.workunit.client.0.smithi084.stdout: "balancer": { 2024-03-30T12:21:53.597 INFO:tasks.workunit.client.0.smithi084.stdout: "active": true, 2024-03-30T12:21:53.597 INFO:tasks.workunit.client.0.smithi084.stdout: "mode": "" 2024-03-30T12:21:53.598 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.598 INFO:tasks.workunit.client.0.smithi084.stdout: "channels": [ 2024-03-30T12:21:53.598 INFO:tasks.workunit.client.0.smithi084.stdout: "basic", 2024-03-30T12:21:53.598 INFO:tasks.workunit.client.0.smithi084.stdout: "crash", 2024-03-30T12:21:53.598 INFO:tasks.workunit.client.0.smithi084.stdout: "device", 2024-03-30T12:21:53.598 INFO:tasks.workunit.client.0.smithi084.stdout: "ident" 2024-03-30T12:21:53.598 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:53.598 INFO:tasks.workunit.client.0.smithi084.stdout: "channels_available": [ 2024-03-30T12:21:53.598 INFO:tasks.workunit.client.0.smithi084.stdout: "basic", 2024-03-30T12:21:53.598 INFO:tasks.workunit.client.0.smithi084.stdout: "ident", 2024-03-30T12:21:53.598 INFO:tasks.workunit.client.0.smithi084.stdout: "crash", 2024-03-30T12:21:53.599 INFO:tasks.workunit.client.0.smithi084.stdout: "device", 2024-03-30T12:21:53.599 INFO:tasks.workunit.client.0.smithi084.stdout: "perf" 2024-03-30T12:21:53.599 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:53.599 INFO:tasks.workunit.client.0.smithi084.stdout: "collections_available": [ 2024-03-30T12:21:53.599 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_base", 2024-03-30T12:21:53.599 INFO:tasks.workunit.client.0.smithi084.stdout: "device_base", 2024-03-30T12:21:53.599 INFO:tasks.workunit.client.0.smithi084.stdout: "crash_base", 2024-03-30T12:21:53.599 INFO:tasks.workunit.client.0.smithi084.stdout: "ident_base", 2024-03-30T12:21:53.599 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_perf", 2024-03-30T12:21:53.599 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_mds_metadata", 2024-03-30T12:21:53.599 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_usage", 2024-03-30T12:21:53.599 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_usage_by_class", 2024-03-30T12:21:53.600 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_rook_v01", 2024-03-30T12:21:53.600 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_memory_metrics", 2024-03-30T12:21:53.600 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_options_bluestore" 2024-03-30T12:21:53.600 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:53.600 INFO:tasks.workunit.client.0.smithi084.stdout: "collections_opted_in": [ 2024-03-30T12:21:53.600 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_base", 2024-03-30T12:21:53.600 INFO:tasks.workunit.client.0.smithi084.stdout: "device_base", 2024-03-30T12:21:53.600 INFO:tasks.workunit.client.0.smithi084.stdout: "crash_base", 2024-03-30T12:21:53.600 INFO:tasks.workunit.client.0.smithi084.stdout: "ident_base", 2024-03-30T12:21:53.600 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_perf", 2024-03-30T12:21:53.600 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_mds_metadata", 2024-03-30T12:21:53.600 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_usage", 2024-03-30T12:21:53.601 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_usage_by_class", 2024-03-30T12:21:53.601 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_rook_v01", 2024-03-30T12:21:53.601 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_memory_metrics", 2024-03-30T12:21:53.601 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_options_bluestore" 2024-03-30T12:21:53.601 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:53.601 INFO:tasks.workunit.client.0.smithi084.stdout: "config": { 2024-03-30T12:21:53.601 INFO:tasks.workunit.client.0.smithi084.stdout: "active_changed": [ 2024-03-30T12:21:53.601 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_allow_insecure_global_id_reclaim", 2024-03-30T12:21:53.601 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_debug", 2024-03-30T12:21:53.601 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_mon_ticket_ttl", 2024-03-30T12:21:53.601 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_service_ticket_ttl", 2024-03-30T12:21:53.601 INFO:tasks.workunit.client.0.smithi084.stdout: "bdev_debug_aio", 2024-03-30T12:21:53.602 INFO:tasks.workunit.client.0.smithi084.stdout: "client_check_pool_perm", 2024-03-30T12:21:53.602 INFO:tasks.workunit.client.0.smithi084.stdout: "client_mount_gid", 2024-03-30T12:21:53.602 INFO:tasks.workunit.client.0.smithi084.stdout: "client_mount_uid", 2024-03-30T12:21:53.602 INFO:tasks.workunit.client.0.smithi084.stdout: "client_quota", 2024-03-30T12:21:53.602 INFO:tasks.workunit.client.0.smithi084.stdout: "container_image", 2024-03-30T12:21:53.602 INFO:tasks.workunit.client.0.smithi084.stdout: "daemonize", 2024-03-30T12:21:53.602 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_asserts_on_shutdown", 2024-03-30T12:21:53.602 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mgr", 2024-03-30T12:21:53.602 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mon", 2024-03-30T12:21:53.602 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_ms", 2024-03-30T12:21:53.602 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_osd", 2024-03-30T12:21:53.602 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_paxos", 2024-03-30T12:21:53.603 INFO:tasks.workunit.client.0.smithi084.stdout: "keyring", 2024-03-30T12:21:53.603 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_block_size", 2024-03-30T12:21:53.603 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_cache_size", 2024-03-30T12:21:53.603 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_compression", 2024-03-30T12:21:53.603 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_log", 2024-03-30T12:21:53.603 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_write_buffer_size", 2024-03-30T12:21:53.603 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_file", 2024-03-30T12:21:53.603 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_journald", 2024-03-30T12:21:53.603 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_stderr", 2024-03-30T12:21:53.604 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_allow_pool_delete", 2024-03-30T12:21:53.604 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_clock_drift_allowed", 2024-03-30T12:21:53.604 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_file_level", 2024-03-30T12:21:53.604 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_file", 2024-03-30T12:21:53.604 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_journald", 2024-03-30T12:21:53.604 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_stderr", 2024-03-30T12:21:53.604 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_data_avail_warn", 2024-03-30T12:21:53.604 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_election_default_strategy", 2024-03-30T12:21:53.604 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_host", 2024-03-30T12:21:53.604 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_max_pg_per_osd", 2024-03-30T12:21:53.604 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_mgr_mkfs_grace", 2024-03-30T12:21:53.604 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_prime_pg_temp", 2024-03-30T12:21:53.605 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_reporter_subtree_level", 2024-03-30T12:21:53.605 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_pg_warn_max_object_skew", 2024-03-30T12:21:53.605 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_bytes_per_osd", 2024-03-30T12:21:53.605 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_pgs_per_osd", 2024-03-30T12:21:53.605 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-03-30T12:21:53.605 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-03-30T12:21:53.605 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-03-30T12:21:53.605 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_legacy_crush_tunables", 2024-03-30T12:21:53.605 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-03-30T12:21:53.605 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-03-30T12:21:53.605 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_too_few_osds", 2024-03-30T12:21:53.605 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_bug", 2024-03-30T12:21:53.606 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_old_message", 2024-03-30T12:21:53.606 INFO:tasks.workunit.client.0.smithi084.stdout: "no_config_file", 2024-03-30T12:21:53.606 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_default_list", 2024-03-30T12:21:53.606 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_load_list", 2024-03-30T12:21:53.606 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_crush_chooseleaf_type", 2024-03-30T12:21:53.606 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_misdirected_ops", 2024-03-30T12:21:53.606 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_op_order", 2024-03-30T12:21:53.606 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_pg_log_writeout", 2024-03-30T12:21:53.606 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_shutdown", 2024-03-30T12:21:53.606 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_cached_snaps", 2024-03-30T12:21:53.606 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_missing_on_start", 2024-03-30T12:21:53.607 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_stray_on_activate", 2024-03-30T12:21:53.607 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_deep_scrub_update_digest_min_age", 2024-03-30T12:21:53.607 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_delete_sleep", 2024-03-30T12:21:53.607 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_delete_sleep_hdd", 2024-03-30T12:21:53.607 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_delete_sleep_hybrid", 2024-03-30T12:21:53.607 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_delete_sleep_ssd", 2024-03-30T12:21:53.607 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_max_backfills", 2024-03-30T12:21:53.607 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_max_capacity_iops_ssd", 2024-03-30T12:21:53.607 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_profile", 2024-03-30T12:21:53.607 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_best_effort_lim", 2024-03-30T12:21:53.607 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_best_effort_res", 2024-03-30T12:21:53.607 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_best_effort_wgt", 2024-03-30T12:21:53.608 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_recovery_lim", 2024-03-30T12:21:53.608 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_recovery_res", 2024-03-30T12:21:53.608 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_recovery_wgt", 2024-03-30T12:21:53.608 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_client_lim", 2024-03-30T12:21:53.608 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_client_res", 2024-03-30T12:21:53.608 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_client_wgt", 2024-03-30T12:21:53.608 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target", 2024-03-30T12:21:53.608 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target_autotune", 2024-03-30T12:21:53.608 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue", 2024-03-30T12:21:53.608 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue_cut_off", 2024-03-30T12:21:53.608 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pg_delete_cost", 2024-03-30T12:21:53.608 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_erasure_code_profile", 2024-03-30T12:21:53.609 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_pg_autoscale_mode", 2024-03-30T12:21:53.609 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recover_clone_overlap", 2024-03-30T12:21:53.609 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_active", 2024-03-30T12:21:53.609 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_active_hdd", 2024-03-30T12:21:53.609 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_active_ssd", 2024-03-30T12:21:53.609 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_chunk", 2024-03-30T12:21:53.609 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_sleep", 2024-03-30T12:21:53.609 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_sleep_hdd", 2024-03-30T12:21:53.609 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_sleep_hybrid", 2024-03-30T12:21:53.609 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_sleep_ssd", 2024-03-30T12:21:53.609 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_load_threshold", 2024-03-30T12:21:53.609 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_max_interval", 2024-03-30T12:21:53.610 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_sleep", 2024-03-30T12:21:53.610 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_shutdown_pgref_assert", 2024-03-30T12:21:53.610 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_snap_trim_sleep", 2024-03-30T12:21:53.610 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_snap_trim_sleep_hdd", 2024-03-30T12:21:53.610 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_snap_trim_sleep_hybrid", 2024-03-30T12:21:53.610 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_snap_trim_sleep_ssd", 2024-03-30T12:21:53.610 INFO:tasks.workunit.client.0.smithi084.stdout: "public_addr", 2024-03-30T12:21:53.610 INFO:tasks.workunit.client.0.smithi084.stdout: "public_addrv", 2024-03-30T12:21:53.610 INFO:tasks.workunit.client.0.smithi084.stdout: "public_network", 2024-03-30T12:21:53.610 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd_default_features", 2024-03-30T12:21:53.610 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd_qos_exclude_ops", 2024-03-30T12:21:53.611 INFO:tasks.workunit.client.0.smithi084.stdout: "setgroup", 2024-03-30T12:21:53.611 INFO:tasks.workunit.client.0.smithi084.stdout: "setuser" 2024-03-30T12:21:53.611 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:53.611 INFO:tasks.workunit.client.0.smithi084.stdout: "cluster_changed": [ 2024-03-30T12:21:53.611 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_allow_insecure_global_id_reclaim", 2024-03-30T12:21:53.611 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_debug", 2024-03-30T12:21:53.611 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_mon_ticket_ttl", 2024-03-30T12:21:53.611 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_service_ticket_ttl", 2024-03-30T12:21:53.611 INFO:tasks.workunit.client.0.smithi084.stdout: "bdev_debug_aio", 2024-03-30T12:21:53.611 INFO:tasks.workunit.client.0.smithi084.stdout: "container_image", 2024-03-30T12:21:53.611 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_asserts_on_shutdown", 2024-03-30T12:21:53.611 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mgr", 2024-03-30T12:21:53.611 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mon", 2024-03-30T12:21:53.612 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_ms", 2024-03-30T12:21:53.612 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_osd", 2024-03-30T12:21:53.612 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_paxos", 2024-03-30T12:21:53.612 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_file", 2024-03-30T12:21:53.612 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_journald", 2024-03-30T12:21:53.612 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_stderr", 2024-03-30T12:21:53.612 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_join_fs", 2024-03-30T12:21:53.612 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/allow_ptrace", 2024-03-30T12:21:53.612 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/container_init", 2024-03-30T12:21:53.612 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/migration_current", 2024-03-30T12:21:53.613 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/use_repo_digest", 2024-03-30T12:21:53.613 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/ALERTMANAGER_API_HOST", 2024-03-30T12:21:53.613 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/GRAFANA_API_SSL_VERIFY", 2024-03-30T12:21:53.613 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/GRAFANA_API_URL", 2024-03-30T12:21:53.613 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/PROMETHEUS_API_HOST", 2024-03-30T12:21:53.613 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/ssl_server_port", 2024-03-30T12:21:53.613 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/orchestrator/orchestrator", 2024-03-30T12:21:53.613 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/channel_ident", 2024-03-30T12:21:53.613 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/description", 2024-03-30T12:21:53.613 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/organization", 2024-03-30T12:21:53.613 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_allow_pool_delete", 2024-03-30T12:21:53.613 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_clock_drift_allowed", 2024-03-30T12:21:53.613 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_file_level", 2024-03-30T12:21:53.614 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_file", 2024-03-30T12:21:53.614 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_data_avail_warn", 2024-03-30T12:21:53.614 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_election_default_strategy", 2024-03-30T12:21:53.614 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_max_pg_per_osd", 2024-03-30T12:21:53.614 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_mgr_mkfs_grace", 2024-03-30T12:21:53.614 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_prime_pg_temp", 2024-03-30T12:21:53.614 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_reporter_subtree_level", 2024-03-30T12:21:53.614 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_pg_warn_max_object_skew", 2024-03-30T12:21:53.614 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_bytes_per_osd", 2024-03-30T12:21:53.615 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_pgs_per_osd", 2024-03-30T12:21:53.615 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-03-30T12:21:53.615 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-03-30T12:21:53.615 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-03-30T12:21:53.615 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_legacy_crush_tunables", 2024-03-30T12:21:53.615 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-03-30T12:21:53.615 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-03-30T12:21:53.615 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_too_few_osds", 2024-03-30T12:21:53.615 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_bug", 2024-03-30T12:21:53.615 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_old_message", 2024-03-30T12:21:53.616 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_default_list", 2024-03-30T12:21:53.616 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_load_list", 2024-03-30T12:21:53.616 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_misdirected_ops", 2024-03-30T12:21:53.616 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_op_order", 2024-03-30T12:21:53.616 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_pg_log_writeout", 2024-03-30T12:21:53.616 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_shutdown", 2024-03-30T12:21:53.616 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_cached_snaps", 2024-03-30T12:21:53.617 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_missing_on_start", 2024-03-30T12:21:53.617 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_stray_on_activate", 2024-03-30T12:21:53.617 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_deep_scrub_update_digest_min_age", 2024-03-30T12:21:53.617 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_max_capacity_iops_ssd", 2024-03-30T12:21:53.617 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_profile", 2024-03-30T12:21:53.617 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target", 2024-03-30T12:21:53.617 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target_autotune", 2024-03-30T12:21:53.617 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue", 2024-03-30T12:21:53.617 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue_cut_off", 2024-03-30T12:21:53.617 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_erasure_code_profile", 2024-03-30T12:21:53.617 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_pg_autoscale_mode", 2024-03-30T12:21:53.617 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recover_clone_overlap", 2024-03-30T12:21:53.617 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_chunk", 2024-03-30T12:21:53.618 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_load_threshold", 2024-03-30T12:21:53.618 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_max_interval", 2024-03-30T12:21:53.618 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_shutdown_pgref_assert", 2024-03-30T12:21:53.618 INFO:tasks.workunit.client.0.smithi084.stdout: "public_network", 2024-03-30T12:21:53.618 INFO:tasks.workunit.client.0.smithi084.stdout: "rgw_cache_enabled", 2024-03-30T12:21:53.618 INFO:tasks.workunit.client.0.smithi084.stdout: "rgw_enable_ops_log", 2024-03-30T12:21:53.618 INFO:tasks.workunit.client.0.smithi084.stdout: "rgw_enable_usage_log" 2024-03-30T12:21:53.618 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:53.618 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.618 INFO:tasks.workunit.client.0.smithi084.stdout: "contact": null, 2024-03-30T12:21:53.619 INFO:tasks.workunit.client.0.smithi084.stdout: "crashes": [], 2024-03-30T12:21:53.619 INFO:tasks.workunit.client.0.smithi084.stdout: "created": "2024-03-30T12:13:26.814055Z", 2024-03-30T12:21:53.619 INFO:tasks.workunit.client.0.smithi084.stdout: "crush": { 2024-03-30T12:21:53.619 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket_algs": { 2024-03-30T12:21:53.619 INFO:tasks.workunit.client.0.smithi084.stdout: "straw2": 3 2024-03-30T12:21:53.619 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.619 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket_sizes": { 2024-03-30T12:21:53.619 INFO:tasks.workunit.client.0.smithi084.stdout: "2": 1, 2024-03-30T12:21:53.619 INFO:tasks.workunit.client.0.smithi084.stdout: "4": 2 2024-03-30T12:21:53.620 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.620 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket_types": { 2024-03-30T12:21:53.620 INFO:tasks.workunit.client.0.smithi084.stdout: "1": 2, 2024-03-30T12:21:53.620 INFO:tasks.workunit.client.0.smithi084.stdout: "11": 1 2024-03-30T12:21:53.620 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.620 INFO:tasks.workunit.client.0.smithi084.stdout: "compat_weight_set": false, 2024-03-30T12:21:53.620 INFO:tasks.workunit.client.0.smithi084.stdout: "device_classes": [ 2024-03-30T12:21:53.620 INFO:tasks.workunit.client.0.smithi084.stdout: 8 2024-03-30T12:21:53.620 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:53.620 INFO:tasks.workunit.client.0.smithi084.stdout: "num_buckets": 6, 2024-03-30T12:21:53.620 INFO:tasks.workunit.client.0.smithi084.stdout: "num_devices": 8, 2024-03-30T12:21:53.620 INFO:tasks.workunit.client.0.smithi084.stdout: "num_rules": 1, 2024-03-30T12:21:53.620 INFO:tasks.workunit.client.0.smithi084.stdout: "num_types": 12, 2024-03-30T12:21:53.621 INFO:tasks.workunit.client.0.smithi084.stdout: "num_weight_sets": 0, 2024-03-30T12:21:53.621 INFO:tasks.workunit.client.0.smithi084.stdout: "tunables": { 2024-03-30T12:21:53.621 INFO:tasks.workunit.client.0.smithi084.stdout: "allowed_bucket_algs": 54, 2024-03-30T12:21:53.621 INFO:tasks.workunit.client.0.smithi084.stdout: "choose_local_fallback_tries": 0, 2024-03-30T12:21:53.621 INFO:tasks.workunit.client.0.smithi084.stdout: "choose_local_tries": 0, 2024-03-30T12:21:53.621 INFO:tasks.workunit.client.0.smithi084.stdout: "choose_total_tries": 50, 2024-03-30T12:21:53.621 INFO:tasks.workunit.client.0.smithi084.stdout: "chooseleaf_descend_once": 1, 2024-03-30T12:21:53.621 INFO:tasks.workunit.client.0.smithi084.stdout: "chooseleaf_stable": 1, 2024-03-30T12:21:53.621 INFO:tasks.workunit.client.0.smithi084.stdout: "chooseleaf_vary_r": 1, 2024-03-30T12:21:53.621 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v2_rules": 0, 2024-03-30T12:21:53.622 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v3_rules": 0, 2024-03-30T12:21:53.622 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v4_buckets": 1, 2024-03-30T12:21:53.622 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v5_rules": 0, 2024-03-30T12:21:53.622 INFO:tasks.workunit.client.0.smithi084.stdout: "legacy_tunables": 0, 2024-03-30T12:21:53.622 INFO:tasks.workunit.client.0.smithi084.stdout: "minimum_required_version": "jewel", 2024-03-30T12:21:53.622 INFO:tasks.workunit.client.0.smithi084.stdout: "optimal_tunables": 1, 2024-03-30T12:21:53.622 INFO:tasks.workunit.client.0.smithi084.stdout: "profile": "jewel", 2024-03-30T12:21:53.622 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables": 1, 2024-03-30T12:21:53.622 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables2": 1, 2024-03-30T12:21:53.622 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables3": 1, 2024-03-30T12:21:53.622 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables5": 1, 2024-03-30T12:21:53.623 INFO:tasks.workunit.client.0.smithi084.stdout: "straw_calc_version": 1 2024-03-30T12:21:53.623 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:53.623 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.623 INFO:tasks.workunit.client.0.smithi084.stdout: "description": "upgrade test cluster", 2024-03-30T12:21:53.623 INFO:tasks.workunit.client.0.smithi084.stdout: "fs": { 2024-03-30T12:21:53.623 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:53.624 INFO:tasks.workunit.client.0.smithi084.stdout: "feature_flags": { 2024-03-30T12:21:53.624 INFO:tasks.workunit.client.0.smithi084.stdout: "enable_multiple": true, 2024-03-30T12:21:53.624 INFO:tasks.workunit.client.0.smithi084.stdout: "ever_enabled_multiple": true 2024-03-30T12:21:53.624 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.624 INFO:tasks.workunit.client.0.smithi084.stdout: "filesystems": [ 2024-03-30T12:21:53.624 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:53.624 INFO:tasks.workunit.client.0.smithi084.stdout: "approx_ctime": "2024-03", 2024-03-30T12:21:53.624 INFO:tasks.workunit.client.0.smithi084.stdout: "balancer_enabled": false, 2024-03-30T12:21:53.625 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:53.625 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_caps": 0, 2024-03-30T12:21:53.625 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_dns": 10, 2024-03-30T12:21:53.625 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_inos": 13, 2024-03-30T12:21:53.625 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_subtrees": 2, 2024-03-30T12:21:53.625 INFO:tasks.workunit.client.0.smithi084.stdout: "ever_allowed_features": 0, 2024-03-30T12:21:53.625 INFO:tasks.workunit.client.0.smithi084.stdout: "explicitly_allowed_features": 0, 2024-03-30T12:21:53.625 INFO:tasks.workunit.client.0.smithi084.stdout: "files": 0, 2024-03-30T12:21:53.625 INFO:tasks.workunit.client.0.smithi084.stdout: "max_mds": 1, 2024-03-30T12:21:53.626 INFO:tasks.workunit.client.0.smithi084.stdout: "num_data_pools": 1, 2024-03-30T12:21:53.626 INFO:tasks.workunit.client.0.smithi084.stdout: "num_in": 1, 2024-03-30T12:21:53.626 INFO:tasks.workunit.client.0.smithi084.stdout: "num_mds": 1, 2024-03-30T12:21:53.626 INFO:tasks.workunit.client.0.smithi084.stdout: "num_sessions": 0, 2024-03-30T12:21:53.626 INFO:tasks.workunit.client.0.smithi084.stdout: "num_standby_replay": 0, 2024-03-30T12:21:53.626 INFO:tasks.workunit.client.0.smithi084.stdout: "num_up": 1, 2024-03-30T12:21:53.626 INFO:tasks.workunit.client.0.smithi084.stdout: "snaps": 0, 2024-03-30T12:21:53.626 INFO:tasks.workunit.client.0.smithi084.stdout: "standby_count_wanted": 0 2024-03-30T12:21:53.626 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:53.626 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:53.626 INFO:tasks.workunit.client.0.smithi084.stdout: "num_standby_mds": 1, 2024-03-30T12:21:53.627 INFO:tasks.workunit.client.0.smithi084.stdout: "total_num_mds": 2 2024-03-30T12:21:53.627 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.627 INFO:tasks.workunit.client.0.smithi084.stdout: "hosts": { 2024-03-30T12:21:53.627 INFO:tasks.workunit.client.0.smithi084.stdout: "num": 2, 2024-03-30T12:21:53.627 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_mds": 2, 2024-03-30T12:21:53.627 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_mgr": 2, 2024-03-30T12:21:53.627 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_mon": 2, 2024-03-30T12:21:53.627 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_osd": 2 2024-03-30T12:21:53.627 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.627 INFO:tasks.workunit.client.0.smithi084.stdout: "leaderboard": false, 2024-03-30T12:21:53.627 INFO:tasks.workunit.client.0.smithi084.stdout: "leaderboard_description": null, 2024-03-30T12:21:53.627 INFO:tasks.workunit.client.0.smithi084.stdout: "license": "sharing-1-0", 2024-03-30T12:21:53.627 INFO:tasks.workunit.client.0.smithi084.stdout: "metadata": { 2024-03-30T12:21:53.628 INFO:tasks.workunit.client.0.smithi084.stdout: "mds": { 2024-03-30T12:21:53.628 INFO:tasks.workunit.client.0.smithi084.stdout: "arch": { 2024-03-30T12:21:53.628 INFO:tasks.workunit.client.0.smithi084.stdout: "x86_64": 2 2024-03-30T12:21:53.628 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.628 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_version": { 2024-03-30T12:21:53.628 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 2 2024-03-30T12:21:53.628 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.628 INFO:tasks.workunit.client.0.smithi084.stdout: "cpu": { 2024-03-30T12:21:53.628 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 2 2024-03-30T12:21:53.628 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.628 INFO:tasks.workunit.client.0.smithi084.stdout: "distro": { 2024-03-30T12:21:53.628 INFO:tasks.workunit.client.0.smithi084.stdout: "centos": 2 2024-03-30T12:21:53.628 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.629 INFO:tasks.workunit.client.0.smithi084.stdout: "distro_description": { 2024-03-30T12:21:53.629 INFO:tasks.workunit.client.0.smithi084.stdout: "CentOS Stream 8": 2 2024-03-30T12:21:53.629 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.629 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_description": { 2024-03-30T12:21:53.629 INFO:tasks.workunit.client.0.smithi084.stdout: "#1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024": 2 2024-03-30T12:21:53.629 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.629 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_version": { 2024-03-30T12:21:53.629 INFO:tasks.workunit.client.0.smithi084.stdout: "5.14.0-434.el9.x86_64": 2 2024-03-30T12:21:53.629 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.629 INFO:tasks.workunit.client.0.smithi084.stdout: "os": { 2024-03-30T12:21:53.629 INFO:tasks.workunit.client.0.smithi084.stdout: "Linux": 2 2024-03-30T12:21:53.630 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:53.630 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.630 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-03-30T12:21:53.630 INFO:tasks.workunit.client.0.smithi084.stdout: "arch": { 2024-03-30T12:21:53.630 INFO:tasks.workunit.client.0.smithi084.stdout: "x86_64": 3 2024-03-30T12:21:53.630 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.630 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_version": { 2024-03-30T12:21:53.630 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 3 2024-03-30T12:21:53.630 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.630 INFO:tasks.workunit.client.0.smithi084.stdout: "cpu": { 2024-03-30T12:21:53.631 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 3 2024-03-30T12:21:53.631 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.631 INFO:tasks.workunit.client.0.smithi084.stdout: "distro": { 2024-03-30T12:21:53.631 INFO:tasks.workunit.client.0.smithi084.stdout: "centos": 3 2024-03-30T12:21:53.631 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.631 INFO:tasks.workunit.client.0.smithi084.stdout: "distro_description": { 2024-03-30T12:21:53.631 INFO:tasks.workunit.client.0.smithi084.stdout: "CentOS Stream 8": 3 2024-03-30T12:21:53.631 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.631 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_description": { 2024-03-30T12:21:53.631 INFO:tasks.workunit.client.0.smithi084.stdout: "#1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024": 3 2024-03-30T12:21:53.631 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.631 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_version": { 2024-03-30T12:21:53.632 INFO:tasks.workunit.client.0.smithi084.stdout: "5.14.0-434.el9.x86_64": 3 2024-03-30T12:21:53.632 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.632 INFO:tasks.workunit.client.0.smithi084.stdout: "os": { 2024-03-30T12:21:53.632 INFO:tasks.workunit.client.0.smithi084.stdout: "Linux": 3 2024-03-30T12:21:53.632 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:53.632 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.632 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:53.632 INFO:tasks.workunit.client.0.smithi084.stdout: "arch": { 2024-03-30T12:21:53.632 INFO:tasks.workunit.client.0.smithi084.stdout: "x86_64": 8 2024-03-30T12:21:53.632 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.633 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_version": { 2024-03-30T12:21:53.633 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 8 2024-03-30T12:21:53.633 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.633 INFO:tasks.workunit.client.0.smithi084.stdout: "cpu": { 2024-03-30T12:21:53.633 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 8 2024-03-30T12:21:53.633 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.633 INFO:tasks.workunit.client.0.smithi084.stdout: "distro": { 2024-03-30T12:21:53.633 INFO:tasks.workunit.client.0.smithi084.stdout: "centos": 8 2024-03-30T12:21:53.633 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.633 INFO:tasks.workunit.client.0.smithi084.stdout: "distro_description": { 2024-03-30T12:21:53.633 INFO:tasks.workunit.client.0.smithi084.stdout: "CentOS Stream 8": 8 2024-03-30T12:21:53.633 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.634 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_description": { 2024-03-30T12:21:53.634 INFO:tasks.workunit.client.0.smithi084.stdout: "#1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024": 8 2024-03-30T12:21:53.634 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.634 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_version": { 2024-03-30T12:21:53.634 INFO:tasks.workunit.client.0.smithi084.stdout: "5.14.0-434.el9.x86_64": 8 2024-03-30T12:21:53.634 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.634 INFO:tasks.workunit.client.0.smithi084.stdout: "os": { 2024-03-30T12:21:53.634 INFO:tasks.workunit.client.0.smithi084.stdout: "Linux": 8 2024-03-30T12:21:53.634 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.634 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_objectstore": { 2024-03-30T12:21:53.635 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": 8 2024-03-30T12:21:53.635 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.635 INFO:tasks.workunit.client.0.smithi084.stdout: "rotational": { 2024-03-30T12:21:53.635 INFO:tasks.workunit.client.0.smithi084.stdout: "0": 8 2024-03-30T12:21:53.635 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:53.635 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:53.635 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.635 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-03-30T12:21:53.635 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-03-30T12:21:53.635 INFO:tasks.workunit.client.0.smithi084.stdout: "features": { 2024-03-30T12:21:53.635 INFO:tasks.workunit.client.0.smithi084.stdout: "optional": [], 2024-03-30T12:21:53.636 INFO:tasks.workunit.client.0.smithi084.stdout: "persistent": [ 2024-03-30T12:21:53.636 INFO:tasks.workunit.client.0.smithi084.stdout: "kraken", 2024-03-30T12:21:53.636 INFO:tasks.workunit.client.0.smithi084.stdout: "luminous", 2024-03-30T12:21:53.636 INFO:tasks.workunit.client.0.smithi084.stdout: "mimic", 2024-03-30T12:21:53.636 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap-prune", 2024-03-30T12:21:53.636 INFO:tasks.workunit.client.0.smithi084.stdout: "nautilus", 2024-03-30T12:21:53.636 INFO:tasks.workunit.client.0.smithi084.stdout: "octopus", 2024-03-30T12:21:53.636 INFO:tasks.workunit.client.0.smithi084.stdout: "pacific", 2024-03-30T12:21:53.636 INFO:tasks.workunit.client.0.smithi084.stdout: "elector-pinging", 2024-03-30T12:21:53.636 INFO:tasks.workunit.client.0.smithi084.stdout: "quincy", 2024-03-30T12:21:53.636 INFO:tasks.workunit.client.0.smithi084.stdout: "reef" 2024-03-30T12:21:53.636 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:53.636 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.637 INFO:tasks.workunit.client.0.smithi084.stdout: "ipv4_addr_mons": 6, 2024-03-30T12:21:53.637 INFO:tasks.workunit.client.0.smithi084.stdout: "ipv6_addr_mons": 0, 2024-03-30T12:21:53.637 INFO:tasks.workunit.client.0.smithi084.stdout: "min_mon_release": 18, 2024-03-30T12:21:53.637 INFO:tasks.workunit.client.0.smithi084.stdout: "v1_addr_mons": 3, 2024-03-30T12:21:53.637 INFO:tasks.workunit.client.0.smithi084.stdout: "v2_addr_mons": 3 2024-03-30T12:21:53.637 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.637 INFO:tasks.workunit.client.0.smithi084.stdout: "organization": "ceph-qa", 2024-03-30T12:21:53.637 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:53.637 INFO:tasks.workunit.client.0.smithi084.stdout: "cluster_network": false, 2024-03-30T12:21:53.637 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 8, 2024-03-30T12:21:53.637 INFO:tasks.workunit.client.0.smithi084.stdout: "require_min_compat_client": "luminous", 2024-03-30T12:21:53.637 INFO:tasks.workunit.client.0.smithi084.stdout: "require_osd_release": "reef" 2024-03-30T12:21:53.638 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.638 INFO:tasks.workunit.client.0.smithi084.stdout: "pools": [ 2024-03-30T12:21:53.638 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:53.638 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-03-30T12:21:53.638 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr" 2024-03-30T12:21:53.638 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:53.638 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-03-30T12:21:53.638 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-03-30T12:21:53.638 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-03-30T12:21:53.638 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-03-30T12:21:53.639 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-03-30T12:21:53.639 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 1, 2024-03-30T12:21:53.639 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 1, 2024-03-30T12:21:53.639 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 1, 2024-03-30T12:21:53.639 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-03-30T12:21:53.639 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-03-30T12:21:53.639 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 729296873738, 2024-03-30T12:21:53.639 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 1781760, 2024-03-30T12:21:53.639 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-03-30T12:21:53.639 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-03-30T12:21:53.639 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 1781760, 2024-03-30T12:21:53.639 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-03-30T12:21:53.639 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 243098959872, 2024-03-30T12:21:53.640 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 2, 2024-03-30T12:21:53.640 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-03-30T12:21:53.640 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 2.443114453853923e-06, 2024-03-30T12:21:53.640 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-03-30T12:21:53.640 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-03-30T12:21:53.640 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 212, 2024-03-30T12:21:53.640 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 313344, 2024-03-30T12:21:53.640 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 590368, 2024-03-30T12:21:53.640 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 590368, 2024-03-30T12:21:53.640 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-03-30T12:21:53.640 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 1771104, 2024-03-30T12:21:53.640 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 179, 2024-03-30T12:21:53.641 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 2473984 2024-03-30T12:21:53.641 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.641 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-03-30T12:21:53.641 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-03-30T12:21:53.641 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-03-30T12:21:53.641 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.641 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:53.641 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-03-30T12:21:53.641 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs" 2024-03-30T12:21:53.641 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:53.641 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-03-30T12:21:53.641 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-03-30T12:21:53.642 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-03-30T12:21:53.642 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-03-30T12:21:53.642 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-03-30T12:21:53.642 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 32, 2024-03-30T12:21:53.642 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 32, 2024-03-30T12:21:53.642 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 2, 2024-03-30T12:21:53.642 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-03-30T12:21:53.643 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-03-30T12:21:53.643 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 729296873738, 2024-03-30T12:21:53.643 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 98304, 2024-03-30T12:21:53.643 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-03-30T12:21:53.643 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-03-30T12:21:53.643 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 98304, 2024-03-30T12:21:53.643 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-03-30T12:21:53.643 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 243098959872, 2024-03-30T12:21:53.643 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 22, 2024-03-30T12:21:53.644 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-03-30T12:21:53.644 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 1.3479282756634348e-07, 2024-03-30T12:21:53.644 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-03-30T12:21:53.644 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-03-30T12:21:53.644 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 0, 2024-03-30T12:21:53.644 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 0, 2024-03-30T12:21:53.644 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 3430, 2024-03-30T12:21:53.644 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 3430, 2024-03-30T12:21:53.645 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-03-30T12:21:53.645 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 10290, 2024-03-30T12:21:53.645 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 51, 2024-03-30T12:21:53.645 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 20480 2024-03-30T12:21:53.645 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.645 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-03-30T12:21:53.645 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-03-30T12:21:53.645 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-03-30T12:21:53.645 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.645 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:53.645 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-03-30T12:21:53.645 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs" 2024-03-30T12:21:53.646 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:53.646 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-03-30T12:21:53.646 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-03-30T12:21:53.646 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-03-30T12:21:53.646 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-03-30T12:21:53.646 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-03-30T12:21:53.646 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 64, 2024-03-30T12:21:53.646 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 64, 2024-03-30T12:21:53.646 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 3, 2024-03-30T12:21:53.646 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-03-30T12:21:53.646 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-03-30T12:21:53.647 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 729296873738, 2024-03-30T12:21:53.647 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 0, 2024-03-30T12:21:53.647 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-03-30T12:21:53.647 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-03-30T12:21:53.647 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 0, 2024-03-30T12:21:53.647 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-03-30T12:21:53.647 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 243098959872, 2024-03-30T12:21:53.647 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 0, 2024-03-30T12:21:53.647 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-03-30T12:21:53.647 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 0.0, 2024-03-30T12:21:53.647 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-03-30T12:21:53.647 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-03-30T12:21:53.648 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 0, 2024-03-30T12:21:53.648 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 0, 2024-03-30T12:21:53.648 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 0, 2024-03-30T12:21:53.648 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 0, 2024-03-30T12:21:53.648 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-03-30T12:21:53.648 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 0, 2024-03-30T12:21:53.648 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 0, 2024-03-30T12:21:53.648 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 0 2024-03-30T12:21:53.648 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.648 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-03-30T12:21:53.648 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-03-30T12:21:53.648 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-03-30T12:21:53.649 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.649 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:53.649 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-03-30T12:21:53.649 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd" 2024-03-30T12:21:53.649 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:53.649 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-03-30T12:21:53.649 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-03-30T12:21:53.649 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-03-30T12:21:53.649 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-03-30T12:21:53.649 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-03-30T12:21:53.649 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 8, 2024-03-30T12:21:53.649 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 8, 2024-03-30T12:21:53.649 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 4, 2024-03-30T12:21:53.650 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-03-30T12:21:53.650 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-03-30T12:21:53.650 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 729296873738, 2024-03-30T12:21:53.650 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 0, 2024-03-30T12:21:53.650 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-03-30T12:21:53.650 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-03-30T12:21:53.650 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 0, 2024-03-30T12:21:53.650 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-03-30T12:21:53.650 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 243098959872, 2024-03-30T12:21:53.650 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 0, 2024-03-30T12:21:53.651 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-03-30T12:21:53.651 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 0.0, 2024-03-30T12:21:53.651 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-03-30T12:21:53.651 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-03-30T12:21:53.651 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 0, 2024-03-30T12:21:53.651 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 0, 2024-03-30T12:21:53.651 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 0, 2024-03-30T12:21:53.651 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 0, 2024-03-30T12:21:53.651 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-03-30T12:21:53.651 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 0, 2024-03-30T12:21:53.651 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 0, 2024-03-30T12:21:53.651 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 0 2024-03-30T12:21:53.652 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.652 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-03-30T12:21:53.652 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-03-30T12:21:53.652 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-03-30T12:21:53.652 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:53.652 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:53.652 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd": { 2024-03-30T12:21:53.652 INFO:tasks.workunit.client.0.smithi084.stdout: "mirroring_by_pool": [ 2024-03-30T12:21:53.652 INFO:tasks.workunit.client.0.smithi084.stdout: false 2024-03-30T12:21:53.652 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:53.652 INFO:tasks.workunit.client.0.smithi084.stdout: "num_images_by_pool": [ 2024-03-30T12:21:53.652 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:53.652 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:53.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_pools": 1 2024-03-30T12:21:53.653 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.653 INFO:tasks.workunit.client.0.smithi084.stdout: "report_id": "d6359e11-7dd4-498e-a35d-38ff58e2b1dc", 2024-03-30T12:21:53.653 INFO:tasks.workunit.client.0.smithi084.stdout: "report_timestamp": "2024-03-30T12:21:53.599161", 2024-03-30T12:21:53.653 INFO:tasks.workunit.client.0.smithi084.stdout: "report_version": 1, 2024-03-30T12:21:53.653 INFO:tasks.workunit.client.0.smithi084.stdout: "rook": { 2024-03-30T12:21:53.653 INFO:tasks.workunit.client.0.smithi084.stdout: "cluster": { 2024-03-30T12:21:53.653 INFO:tasks.workunit.client.0.smithi084.stdout: "external-mode": null, 2024-03-30T12:21:53.653 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-03-30T12:21:53.653 INFO:tasks.workunit.client.0.smithi084.stdout: "allow-multiple-per-node": null, 2024-03-30T12:21:53.653 INFO:tasks.workunit.client.0.smithi084.stdout: "count": null, 2024-03-30T12:21:53.653 INFO:tasks.workunit.client.0.smithi084.stdout: "max-id": null, 2024-03-30T12:21:53.653 INFO:tasks.workunit.client.0.smithi084.stdout: "pvc": { 2024-03-30T12:21:53.654 INFO:tasks.workunit.client.0.smithi084.stdout: "enabled": null 2024-03-30T12:21:53.654 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.654 INFO:tasks.workunit.client.0.smithi084.stdout: "stretch": { 2024-03-30T12:21:53.654 INFO:tasks.workunit.client.0.smithi084.stdout: "enabled": null 2024-03-30T12:21:53.654 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:53.654 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.654 INFO:tasks.workunit.client.0.smithi084.stdout: "network": { 2024-03-30T12:21:53.654 INFO:tasks.workunit.client.0.smithi084.stdout: "provider": null 2024-03-30T12:21:53.654 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.654 INFO:tasks.workunit.client.0.smithi084.stdout: "storage": { 2024-03-30T12:21:53.654 INFO:tasks.workunit.client.0.smithi084.stdout: "device-set": { 2024-03-30T12:21:53.655 INFO:tasks.workunit.client.0.smithi084.stdout: "count": { 2024-03-30T12:21:53.655 INFO:tasks.workunit.client.0.smithi084.stdout: "non-portable": null, 2024-03-30T12:21:53.655 INFO:tasks.workunit.client.0.smithi084.stdout: "portable": null, 2024-03-30T12:21:53.655 INFO:tasks.workunit.client.0.smithi084.stdout: "total": null 2024-03-30T12:21:53.655 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:53.655 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:53.655 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:53.655 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.655 INFO:tasks.workunit.client.0.smithi084.stdout: "csi": { 2024-03-30T12:21:53.655 INFO:tasks.workunit.client.0.smithi084.stdout: "version": null 2024-03-30T12:21:53.656 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.656 INFO:tasks.workunit.client.0.smithi084.stdout: "kubernetes": { 2024-03-30T12:21:53.656 INFO:tasks.workunit.client.0.smithi084.stdout: "version": null 2024-03-30T12:21:53.656 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.656 INFO:tasks.workunit.client.0.smithi084.stdout: "node": { 2024-03-30T12:21:53.656 INFO:tasks.workunit.client.0.smithi084.stdout: "count": { 2024-03-30T12:21:53.656 INFO:tasks.workunit.client.0.smithi084.stdout: "kubernetes-total": null, 2024-03-30T12:21:53.656 INFO:tasks.workunit.client.0.smithi084.stdout: "with-ceph-daemons": null, 2024-03-30T12:21:53.656 INFO:tasks.workunit.client.0.smithi084.stdout: "with-csi-cephfs-plugin": null, 2024-03-30T12:21:53.656 INFO:tasks.workunit.client.0.smithi084.stdout: "with-csi-nfs-plugin": null, 2024-03-30T12:21:53.656 INFO:tasks.workunit.client.0.smithi084.stdout: "with-csi-rbd-plugin": null 2024-03-30T12:21:53.656 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:53.656 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.657 INFO:tasks.workunit.client.0.smithi084.stdout: "usage": { 2024-03-30T12:21:53.657 INFO:tasks.workunit.client.0.smithi084.stdout: "storage-class": { 2024-03-30T12:21:53.657 INFO:tasks.workunit.client.0.smithi084.stdout: "count": { 2024-03-30T12:21:53.657 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket": null, 2024-03-30T12:21:53.657 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs": null, 2024-03-30T12:21:53.657 INFO:tasks.workunit.client.0.smithi084.stdout: "nfs": null, 2024-03-30T12:21:53.657 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd": null, 2024-03-30T12:21:53.657 INFO:tasks.workunit.client.0.smithi084.stdout: "total": null 2024-03-30T12:21:53.657 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:53.657 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:53.657 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.657 INFO:tasks.workunit.client.0.smithi084.stdout: "version": null 2024-03-30T12:21:53.657 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.658 INFO:tasks.workunit.client.0.smithi084.stdout: "services": {}, 2024-03-30T12:21:53.658 INFO:tasks.workunit.client.0.smithi084.stdout: "usage": { 2024-03-30T12:21:53.658 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 105, 2024-03-30T12:21:53.658 INFO:tasks.workunit.client.0.smithi084.stdout: "pools": 4, 2024-03-30T12:21:53.658 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_by_class": { 2024-03-30T12:21:53.658 INFO:tasks.workunit.client.0.smithi084.stdout: "ssd": { 2024-03-30T12:21:53.658 INFO:tasks.workunit.client.0.smithi084.stdout: "total_avail_bytes": 767710539776, 2024-03-30T12:21:53.658 INFO:tasks.workunit.client.0.smithi084.stdout: "total_bytes": 767960285184, 2024-03-30T12:21:53.658 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_bytes": 249745408, 2024-03-30T12:21:53.658 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_raw_bytes": 249745408, 2024-03-30T12:21:53.658 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_raw_ratio": 0.0003252061433158815 2024-03-30T12:21:53.658 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:53.659 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:53.659 INFO:tasks.workunit.client.0.smithi084.stdout: "total_avail_bytes": 767710539776, 2024-03-30T12:21:53.659 INFO:tasks.workunit.client.0.smithi084.stdout: "total_bytes": 767960285184, 2024-03-30T12:21:53.659 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_bytes": 249745408 2024-03-30T12:21:53.659 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:53.659 INFO:tasks.workunit.client.0.smithi084.stdout:} 2024-03-30T12:21:53.659 INFO:tasks.workunit.client.0.smithi084.stdout:Device report is generated separately. To see it run 'ceph telemetry preview-device'. 2024-03-30T12:21:53.659 INFO:tasks.workunit.client.0.smithi084.stderr:+ ceph telemetry preview-device 2024-03-30T12:21:54.124 INFO:tasks.workunit.client.0.smithi084.stdout:{ 2024-03-30T12:21:54.124 INFO:tasks.workunit.client.0.smithi084.stdout: "17efb0a6-ee90-11ee-a0f6-0cc47a8fd751": { 2024-03-30T12:21:54.124 INFO:tasks.workunit.client.0.smithi084.stdout: "INTEL_SSDPEDMD400G4_17f043cc-ee90-11ee-a0f6-0cc47a8fd751": { 2024-03-30T12:21:54.124 INFO:tasks.workunit.client.0.smithi084.stdout: "20240330-121648": { 2024-03-30T12:21:54.124 INFO:tasks.workunit.client.0.smithi084.stdout: "device": { 2024-03-30T12:21:54.124 INFO:tasks.workunit.client.0.smithi084.stdout: "info_name": "/dev/nvme0n1", 2024-03-30T12:21:54.125 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "/dev/nvme0n1", 2024-03-30T12:21:54.125 INFO:tasks.workunit.client.0.smithi084.stdout: "protocol": "NVMe", 2024-03-30T12:21:54.125 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "nvme" 2024-03-30T12:21:54.125 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.125 INFO:tasks.workunit.client.0.smithi084.stdout: "firmware_version": "8DV101H0", 2024-03-30T12:21:54.125 INFO:tasks.workunit.client.0.smithi084.stdout: "host_id": "17efb0a6-ee90-11ee-a0f6-0cc47a8fd751", 2024-03-30T12:21:54.125 INFO:tasks.workunit.client.0.smithi084.stdout: "json_format_version": [ 2024-03-30T12:21:54.125 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:54.125 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:54.125 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.125 INFO:tasks.workunit.client.0.smithi084.stdout: "local_time": { 2024-03-30T12:21:54.125 INFO:tasks.workunit.client.0.smithi084.stdout: "asctime": "Sat Mar 30 12:16:47 2024 UTC", 2024-03-30T12:21:54.125 INFO:tasks.workunit.client.0.smithi084.stdout: "time_t": 1711801007 2024-03-30T12:21:54.126 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.126 INFO:tasks.workunit.client.0.smithi084.stdout: "logical_block_size": 512, 2024-03-30T12:21:54.126 INFO:tasks.workunit.client.0.smithi084.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-03-30T12:21:54.126 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_controller_id": 0, 2024-03-30T12:21:54.126 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-03-30T12:21:54.126 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_namespaces": [ 2024-03-30T12:21:54.126 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:54.126 INFO:tasks.workunit.client.0.smithi084.stdout: "capacity": { 2024-03-30T12:21:54.126 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:54.126 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:54.126 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.126 INFO:tasks.workunit.client.0.smithi084.stdout: "formatted_lba_size": 512, 2024-03-30T12:21:54.127 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 1, 2024-03-30T12:21:54.127 INFO:tasks.workunit.client.0.smithi084.stdout: "size": { 2024-03-30T12:21:54.127 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:54.127 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:54.127 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.127 INFO:tasks.workunit.client.0.smithi084.stdout: "utilization": { 2024-03-30T12:21:54.127 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:54.127 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:54.127 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.127 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.127 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.128 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_number_of_namespaces": 1, 2024-03-30T12:21:54.128 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_pci_vendor": { 2024-03-30T12:21:54.128 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 32902, 2024-03-30T12:21:54.128 INFO:tasks.workunit.client.0.smithi084.stdout: "subsystem_id": 32902 2024-03-30T12:21:54.128 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.128 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_add_log": { 2024-03-30T12:21:54.128 INFO:tasks.workunit.client.0.smithi084.stdout: "Device stats": { 2024-03-30T12:21:54.128 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_fw_downgrades": { 2024-03-30T12:21:54.128 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:54.128 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.128 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.128 INFO:tasks.workunit.client.0.smithi084.stdout: "crc_error_count": { 2024-03-30T12:21:54.129 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.129 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.129 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.129 INFO:tasks.workunit.client.0.smithi084.stdout: "end_to_end_error_detection_count": { 2024-03-30T12:21:54.129 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.129 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.129 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.129 INFO:tasks.workunit.client.0.smithi084.stdout: "erase_fail_count": { 2024-03-30T12:21:54.129 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.129 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.129 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.129 INFO:tasks.workunit.client.0.smithi084.stdout: "host_bytes_written": { 2024-03-30T12:21:54.129 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.130 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 29064747 2024-03-30T12:21:54.130 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.130 INFO:tasks.workunit.client.0.smithi084.stdout: "host_ctx_wear_used": { 2024-03-30T12:21:54.130 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.130 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 1 2024-03-30T12:21:54.130 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.130 INFO:tasks.workunit.client.0.smithi084.stdout: "media_bytes_read": { 2024-03-30T12:21:54.130 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:54.130 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.130 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.130 INFO:tasks.workunit.client.0.smithi084.stdout: "nand_bytes_written": { 2024-03-30T12:21:54.130 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.131 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 48148094 2024-03-30T12:21:54.131 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.131 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_stat_indicator": { 2024-03-30T12:21:54.131 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:54.131 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.131 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.131 INFO:tasks.workunit.client.0.smithi084.stdout: "pll_lock_loss_count": { 2024-03-30T12:21:54.131 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.131 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.131 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.131 INFO:tasks.workunit.client.0.smithi084.stdout: "program_fail_count": { 2024-03-30T12:21:54.131 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.131 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.132 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.132 INFO:tasks.workunit.client.0.smithi084.stdout: "re_alloc_sectr_cnt": { 2024-03-30T12:21:54.132 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:54.132 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.132 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.132 INFO:tasks.workunit.client.0.smithi084.stdout: "retry_buffer_overflow_count": { 2024-03-30T12:21:54.132 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.132 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.132 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.132 INFO:tasks.workunit.client.0.smithi084.stdout: "soft_ecc_err_rate": { 2024-03-30T12:21:54.132 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:54.132 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.132 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.133 INFO:tasks.workunit.client.0.smithi084.stdout: "thermal_throttle_status": { 2024-03-30T12:21:54.133 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.133 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-03-30T12:21:54.133 INFO:tasks.workunit.client.0.smithi084.stdout: "cnt": 0, 2024-03-30T12:21:54.133 INFO:tasks.workunit.client.0.smithi084.stdout: "pct": 0 2024-03-30T12:21:54.133 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.133 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.133 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_host_reads": { 2024-03-30T12:21:54.133 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.133 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-03-30T12:21:54.133 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.133 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_media_wear": { 2024-03-30T12:21:54.133 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.134 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 64 2024-03-30T12:21:54.134 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.134 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_timer": { 2024-03-30T12:21:54.134 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.134 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-03-30T12:21:54.134 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.134 INFO:tasks.workunit.client.0.smithi084.stdout: "unexp_power_loss": { 2024-03-30T12:21:54.134 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:54.134 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.134 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.134 INFO:tasks.workunit.client.0.smithi084.stdout: "wear_leveling": { 2024-03-30T12:21:54.135 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 90, 2024-03-30T12:21:54.135 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-03-30T12:21:54.135 INFO:tasks.workunit.client.0.smithi084.stdout: "avg": 3240, 2024-03-30T12:21:54.135 INFO:tasks.workunit.client.0.smithi084.stdout: "max": 3251, 2024-03-30T12:21:54.135 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 3229 2024-03-30T12:21:54.135 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.135 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.135 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.135 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel Smart log": "nvme0n1" 2024-03-30T12:21:54.135 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.135 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_log": { 2024-03-30T12:21:54.135 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare": 100, 2024-03-30T12:21:54.135 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare_threshold": 10, 2024-03-30T12:21:54.136 INFO:tasks.workunit.client.0.smithi084.stdout: "controller_busy_time": 14, 2024-03-30T12:21:54.136 INFO:tasks.workunit.client.0.smithi084.stdout: "critical_warning": 0, 2024-03-30T12:21:54.136 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_read": 412181458, 2024-03-30T12:21:54.136 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_written": 1904787272, 2024-03-30T12:21:54.136 INFO:tasks.workunit.client.0.smithi084.stdout: "host_reads": 7071122069, 2024-03-30T12:21:54.136 INFO:tasks.workunit.client.0.smithi084.stdout: "host_writes": 34331777573, 2024-03-30T12:21:54.136 INFO:tasks.workunit.client.0.smithi084.stdout: "media_errors": 0, 2024-03-30T12:21:54.136 INFO:tasks.workunit.client.0.smithi084.stdout: "num_err_log_entries": 0, 2024-03-30T12:21:54.136 INFO:tasks.workunit.client.0.smithi084.stdout: "percentage_used": 10, 2024-03-30T12:21:54.136 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycles": 49095, 2024-03-30T12:21:54.136 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_hours": 54192, 2024-03-30T12:21:54.136 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": 29, 2024-03-30T12:21:54.136 INFO:tasks.workunit.client.0.smithi084.stdout: "unsafe_shutdowns": 535 2024-03-30T12:21:54.137 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.137 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_vendor": "intel", 2024-03-30T12:21:54.137 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycle_count": 49095, 2024-03-30T12:21:54.137 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_time": { 2024-03-30T12:21:54.137 INFO:tasks.workunit.client.0.smithi084.stdout: "hours": 54192 2024-03-30T12:21:54.137 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.137 INFO:tasks.workunit.client.0.smithi084.stdout: "serial_number": "deleted", 2024-03-30T12:21:54.137 INFO:tasks.workunit.client.0.smithi084.stdout: "smart_status": { 2024-03-30T12:21:54.137 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme": { 2024-03-30T12:21:54.137 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:54.137 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.137 INFO:tasks.workunit.client.0.smithi084.stdout: "passed": true 2024-03-30T12:21:54.137 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.138 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl": { 2024-03-30T12:21:54.138 INFO:tasks.workunit.client.0.smithi084.stdout: "argv": [ 2024-03-30T12:21:54.138 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl", 2024-03-30T12:21:54.138 INFO:tasks.workunit.client.0.smithi084.stdout: "-x", 2024-03-30T12:21:54.138 INFO:tasks.workunit.client.0.smithi084.stdout: "--json=o", 2024-03-30T12:21:54.138 INFO:tasks.workunit.client.0.smithi084.stdout: "/dev/nvme0n1" 2024-03-30T12:21:54.138 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.138 INFO:tasks.workunit.client.0.smithi084.stdout: "build_info": "(local build)", 2024-03-30T12:21:54.138 INFO:tasks.workunit.client.0.smithi084.stdout: "exit_status": 0, 2024-03-30T12:21:54.138 INFO:tasks.workunit.client.0.smithi084.stdout: "output": [ 2024-03-30T12:21:54.138 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.14.0-434.el9.x86_64] (local build)", 2024-03-30T12:21:54.138 INFO:tasks.workunit.client.0.smithi084.stdout: "Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-03-30T12:21:54.139 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:54.139 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF INFORMATION SECTION ===", 2024-03-30T12:21:54.139 INFO:tasks.workunit.client.0.smithi084.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-03-30T12:21:54.139 INFO:tasks.workunit.client.0.smithi084.stdout: "Serial Number: deleted", 2024-03-30T12:21:54.139 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Version: 8DV101H0", 2024-03-30T12:21:54.139 INFO:tasks.workunit.client.0.smithi084.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-03-30T12:21:54.139 INFO:tasks.workunit.client.0.smithi084.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-03-30T12:21:54.139 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller ID: 0", 2024-03-30T12:21:54.139 INFO:tasks.workunit.client.0.smithi084.stdout: "Number of Namespaces: 1", 2024-03-30T12:21:54.139 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-03-30T12:21:54.139 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-03-30T12:21:54.140 INFO:tasks.workunit.client.0.smithi084.stdout: "Local Time is: Sat Mar 30 12:16:47 2024 UTC", 2024-03-30T12:21:54.140 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Updates (0x02): 1 Slot", 2024-03-30T12:21:54.140 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-03-30T12:21:54.140 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-03-30T12:21:54.140 INFO:tasks.workunit.client.0.smithi084.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-03-30T12:21:54.140 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:54.140 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported Power States", 2024-03-30T12:21:54.140 INFO:tasks.workunit.client.0.smithi084.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-03-30T12:21:54.140 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-03-30T12:21:54.140 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:54.140 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-03-30T12:21:54.140 INFO:tasks.workunit.client.0.smithi084.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-03-30T12:21:54.141 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 512 0 2", 2024-03-30T12:21:54.141 INFO:tasks.workunit.client.0.smithi084.stdout: " 1 - 512 8 2", 2024-03-30T12:21:54.141 INFO:tasks.workunit.client.0.smithi084.stdout: " 2 - 512 16 2", 2024-03-30T12:21:54.141 INFO:tasks.workunit.client.0.smithi084.stdout: " 3 - 4096 0 0", 2024-03-30T12:21:54.141 INFO:tasks.workunit.client.0.smithi084.stdout: " 4 - 4096 8 0", 2024-03-30T12:21:54.141 INFO:tasks.workunit.client.0.smithi084.stdout: " 5 - 4096 64 0", 2024-03-30T12:21:54.141 INFO:tasks.workunit.client.0.smithi084.stdout: " 6 - 4096 128 0", 2024-03-30T12:21:54.141 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:54.141 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF SMART DATA SECTION ===", 2024-03-30T12:21:54.141 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-03-30T12:21:54.141 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:54.141 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-03-30T12:21:54.141 INFO:tasks.workunit.client.0.smithi084.stdout: "Critical Warning: 0x00", 2024-03-30T12:21:54.142 INFO:tasks.workunit.client.0.smithi084.stdout: "Temperature: 29 Celsius", 2024-03-30T12:21:54.142 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare: 100%", 2024-03-30T12:21:54.142 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare Threshold: 10%", 2024-03-30T12:21:54.142 INFO:tasks.workunit.client.0.smithi084.stdout: "Percentage Used: 10%", 2024-03-30T12:21:54.142 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Read: 412,181,458 [211 TB]", 2024-03-30T12:21:54.142 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Written: 1,904,787,272 [975 TB]", 2024-03-30T12:21:54.142 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Read Commands: 7,071,122,069", 2024-03-30T12:21:54.142 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Write Commands: 34,331,777,573", 2024-03-30T12:21:54.142 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller Busy Time: 14", 2024-03-30T12:21:54.142 INFO:tasks.workunit.client.0.smithi084.stdout: "Power Cycles: 49,095", 2024-03-30T12:21:54.142 INFO:tasks.workunit.client.0.smithi084.stdout: "Power On Hours: 54,192", 2024-03-30T12:21:54.142 INFO:tasks.workunit.client.0.smithi084.stdout: "Unsafe Shutdowns: 535", 2024-03-30T12:21:54.143 INFO:tasks.workunit.client.0.smithi084.stdout: "Media and Data Integrity Errors: 0", 2024-03-30T12:21:54.143 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information Log Entries: 0", 2024-03-30T12:21:54.143 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:54.143 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information (NVMe Log 0x01, max 64 entries)", 2024-03-30T12:21:54.143 INFO:tasks.workunit.client.0.smithi084.stdout: "No Errors Logged", 2024-03-30T12:21:54.143 INFO:tasks.workunit.client.0.smithi084.stdout: "" 2024-03-30T12:21:54.143 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.143 INFO:tasks.workunit.client.0.smithi084.stdout: "platform_info": "x86_64-linux-5.14.0-434.el9.x86_64", 2024-03-30T12:21:54.143 INFO:tasks.workunit.client.0.smithi084.stdout: "svn_revision": "5022", 2024-03-30T12:21:54.143 INFO:tasks.workunit.client.0.smithi084.stdout: "version": [ 2024-03-30T12:21:54.143 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:54.143 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:54.143 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:54.144 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.144 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": { 2024-03-30T12:21:54.144 INFO:tasks.workunit.client.0.smithi084.stdout: "current": 29 2024-03-30T12:21:54.144 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.144 INFO:tasks.workunit.client.0.smithi084.stdout: "user_capacity": { 2024-03-30T12:21:54.144 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:54.144 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:54.144 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.144 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.144 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.145 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.145 INFO:tasks.workunit.client.0.smithi084.stdout: "17f17a76-ee90-11ee-a0f6-0cc47a8fd751": { 2024-03-30T12:21:54.145 INFO:tasks.workunit.client.0.smithi084.stdout: "INTEL_SSDPEDMD400G4_17f1fdca-ee90-11ee-a0f6-0cc47a8fd751": { 2024-03-30T12:21:54.145 INFO:tasks.workunit.client.0.smithi084.stdout: "20240330-121645": { 2024-03-30T12:21:54.145 INFO:tasks.workunit.client.0.smithi084.stdout: "device": { 2024-03-30T12:21:54.145 INFO:tasks.workunit.client.0.smithi084.stdout: "info_name": "/dev/nvme0n1", 2024-03-30T12:21:54.145 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "/dev/nvme0n1", 2024-03-30T12:21:54.146 INFO:tasks.workunit.client.0.smithi084.stdout: "protocol": "NVMe", 2024-03-30T12:21:54.146 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "nvme" 2024-03-30T12:21:54.146 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.146 INFO:tasks.workunit.client.0.smithi084.stdout: "firmware_version": "8DV101H0", 2024-03-30T12:21:54.146 INFO:tasks.workunit.client.0.smithi084.stdout: "host_id": "17f17a76-ee90-11ee-a0f6-0cc47a8fd751", 2024-03-30T12:21:54.146 INFO:tasks.workunit.client.0.smithi084.stdout: "json_format_version": [ 2024-03-30T12:21:54.146 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:54.146 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:54.146 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.146 INFO:tasks.workunit.client.0.smithi084.stdout: "local_time": { 2024-03-30T12:21:54.146 INFO:tasks.workunit.client.0.smithi084.stdout: "asctime": "Sat Mar 30 12:16:45 2024 UTC", 2024-03-30T12:21:54.147 INFO:tasks.workunit.client.0.smithi084.stdout: "time_t": 1711801005 2024-03-30T12:21:54.147 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.147 INFO:tasks.workunit.client.0.smithi084.stdout: "logical_block_size": 512, 2024-03-30T12:21:54.147 INFO:tasks.workunit.client.0.smithi084.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-03-30T12:21:54.147 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_controller_id": 0, 2024-03-30T12:21:54.147 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-03-30T12:21:54.147 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_namespaces": [ 2024-03-30T12:21:54.147 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:54.147 INFO:tasks.workunit.client.0.smithi084.stdout: "capacity": { 2024-03-30T12:21:54.147 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:54.147 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:54.147 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.148 INFO:tasks.workunit.client.0.smithi084.stdout: "formatted_lba_size": 512, 2024-03-30T12:21:54.148 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 1, 2024-03-30T12:21:54.148 INFO:tasks.workunit.client.0.smithi084.stdout: "size": { 2024-03-30T12:21:54.148 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:54.148 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:54.148 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.148 INFO:tasks.workunit.client.0.smithi084.stdout: "utilization": { 2024-03-30T12:21:54.148 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:54.148 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:54.148 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.148 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.148 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.149 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_number_of_namespaces": 1, 2024-03-30T12:21:54.149 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_pci_vendor": { 2024-03-30T12:21:54.149 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 32902, 2024-03-30T12:21:54.149 INFO:tasks.workunit.client.0.smithi084.stdout: "subsystem_id": 32902 2024-03-30T12:21:54.149 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.149 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_add_log": { 2024-03-30T12:21:54.149 INFO:tasks.workunit.client.0.smithi084.stdout: "Device stats": { 2024-03-30T12:21:54.149 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_fw_downgrades": { 2024-03-30T12:21:54.149 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:54.149 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.149 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.149 INFO:tasks.workunit.client.0.smithi084.stdout: "crc_error_count": { 2024-03-30T12:21:54.150 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.150 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.150 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.150 INFO:tasks.workunit.client.0.smithi084.stdout: "end_to_end_error_detection_count": { 2024-03-30T12:21:54.150 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.150 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.150 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.150 INFO:tasks.workunit.client.0.smithi084.stdout: "erase_fail_count": { 2024-03-30T12:21:54.150 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.150 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.150 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.150 INFO:tasks.workunit.client.0.smithi084.stdout: "host_bytes_written": { 2024-03-30T12:21:54.151 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.151 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 33158836 2024-03-30T12:21:54.151 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.151 INFO:tasks.workunit.client.0.smithi084.stdout: "host_ctx_wear_used": { 2024-03-30T12:21:54.151 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.151 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 1 2024-03-30T12:21:54.151 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.151 INFO:tasks.workunit.client.0.smithi084.stdout: "media_bytes_read": { 2024-03-30T12:21:54.151 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:54.151 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.151 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.152 INFO:tasks.workunit.client.0.smithi084.stdout: "nand_bytes_written": { 2024-03-30T12:21:54.152 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.152 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 54845455 2024-03-30T12:21:54.152 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.152 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_stat_indicator": { 2024-03-30T12:21:54.152 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:54.152 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.152 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.152 INFO:tasks.workunit.client.0.smithi084.stdout: "pll_lock_loss_count": { 2024-03-30T12:21:54.152 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.152 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.153 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.153 INFO:tasks.workunit.client.0.smithi084.stdout: "program_fail_count": { 2024-03-30T12:21:54.153 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.153 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.153 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.153 INFO:tasks.workunit.client.0.smithi084.stdout: "re_alloc_sectr_cnt": { 2024-03-30T12:21:54.153 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:54.153 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.154 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.154 INFO:tasks.workunit.client.0.smithi084.stdout: "retry_buffer_overflow_count": { 2024-03-30T12:21:54.154 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.154 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.154 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.154 INFO:tasks.workunit.client.0.smithi084.stdout: "soft_ecc_err_rate": { 2024-03-30T12:21:54.154 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:54.154 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.154 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.154 INFO:tasks.workunit.client.0.smithi084.stdout: "thermal_throttle_status": { 2024-03-30T12:21:54.155 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.155 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-03-30T12:21:54.155 INFO:tasks.workunit.client.0.smithi084.stdout: "cnt": 0, 2024-03-30T12:21:54.155 INFO:tasks.workunit.client.0.smithi084.stdout: "pct": 0 2024-03-30T12:21:54.155 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.155 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.155 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_host_reads": { 2024-03-30T12:21:54.155 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.155 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-03-30T12:21:54.155 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.155 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_media_wear": { 2024-03-30T12:21:54.155 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.156 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 64 2024-03-30T12:21:54.156 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.156 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_timer": { 2024-03-30T12:21:54.156 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.156 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-03-30T12:21:54.156 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.156 INFO:tasks.workunit.client.0.smithi084.stdout: "unexp_power_loss": { 2024-03-30T12:21:54.156 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:54.156 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.156 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.156 INFO:tasks.workunit.client.0.smithi084.stdout: "wear_leveling": { 2024-03-30T12:21:54.156 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 88, 2024-03-30T12:21:54.156 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-03-30T12:21:54.157 INFO:tasks.workunit.client.0.smithi084.stdout: "avg": 3701, 2024-03-30T12:21:54.157 INFO:tasks.workunit.client.0.smithi084.stdout: "max": 3720, 2024-03-30T12:21:54.157 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 3684 2024-03-30T12:21:54.157 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.157 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.157 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.157 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel Smart log": "nvme0n1" 2024-03-30T12:21:54.157 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.157 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_log": { 2024-03-30T12:21:54.157 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare": 100, 2024-03-30T12:21:54.157 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare_threshold": 10, 2024-03-30T12:21:54.157 INFO:tasks.workunit.client.0.smithi084.stdout: "controller_busy_time": 6, 2024-03-30T12:21:54.157 INFO:tasks.workunit.client.0.smithi084.stdout: "critical_warning": 0, 2024-03-30T12:21:54.158 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_read": 444467307, 2024-03-30T12:21:54.158 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_written": 2173097505, 2024-03-30T12:21:54.158 INFO:tasks.workunit.client.0.smithi084.stdout: "host_reads": 7000448296, 2024-03-30T12:21:54.158 INFO:tasks.workunit.client.0.smithi084.stdout: "host_writes": 36885402494, 2024-03-30T12:21:54.158 INFO:tasks.workunit.client.0.smithi084.stdout: "media_errors": 0, 2024-03-30T12:21:54.158 INFO:tasks.workunit.client.0.smithi084.stdout: "num_err_log_entries": 0, 2024-03-30T12:21:54.158 INFO:tasks.workunit.client.0.smithi084.stdout: "percentage_used": 12, 2024-03-30T12:21:54.158 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycles": 55516, 2024-03-30T12:21:54.158 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_hours": 55370, 2024-03-30T12:21:54.158 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": 27, 2024-03-30T12:21:54.158 INFO:tasks.workunit.client.0.smithi084.stdout: "unsafe_shutdowns": 272 2024-03-30T12:21:54.159 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.159 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_vendor": "intel", 2024-03-30T12:21:54.159 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycle_count": 55516, 2024-03-30T12:21:54.159 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_time": { 2024-03-30T12:21:54.159 INFO:tasks.workunit.client.0.smithi084.stdout: "hours": 55370 2024-03-30T12:21:54.159 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.159 INFO:tasks.workunit.client.0.smithi084.stdout: "serial_number": "deleted", 2024-03-30T12:21:54.159 INFO:tasks.workunit.client.0.smithi084.stdout: "smart_status": { 2024-03-30T12:21:54.159 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme": { 2024-03-30T12:21:54.159 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:54.159 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.159 INFO:tasks.workunit.client.0.smithi084.stdout: "passed": true 2024-03-30T12:21:54.159 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.160 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl": { 2024-03-30T12:21:54.160 INFO:tasks.workunit.client.0.smithi084.stdout: "argv": [ 2024-03-30T12:21:54.160 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl", 2024-03-30T12:21:54.160 INFO:tasks.workunit.client.0.smithi084.stdout: "-x", 2024-03-30T12:21:54.160 INFO:tasks.workunit.client.0.smithi084.stdout: "--json=o", 2024-03-30T12:21:54.160 INFO:tasks.workunit.client.0.smithi084.stdout: "/dev/nvme0n1" 2024-03-30T12:21:54.160 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.160 INFO:tasks.workunit.client.0.smithi084.stdout: "build_info": "(local build)", 2024-03-30T12:21:54.160 INFO:tasks.workunit.client.0.smithi084.stdout: "exit_status": 0, 2024-03-30T12:21:54.160 INFO:tasks.workunit.client.0.smithi084.stdout: "output": [ 2024-03-30T12:21:54.160 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.14.0-434.el9.x86_64] (local build)", 2024-03-30T12:21:54.160 INFO:tasks.workunit.client.0.smithi084.stdout: "Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-03-30T12:21:54.160 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:54.161 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF INFORMATION SECTION ===", 2024-03-30T12:21:54.161 INFO:tasks.workunit.client.0.smithi084.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-03-30T12:21:54.161 INFO:tasks.workunit.client.0.smithi084.stdout: "Serial Number: deleted", 2024-03-30T12:21:54.161 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Version: 8DV101H0", 2024-03-30T12:21:54.161 INFO:tasks.workunit.client.0.smithi084.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-03-30T12:21:54.161 INFO:tasks.workunit.client.0.smithi084.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-03-30T12:21:54.161 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller ID: 0", 2024-03-30T12:21:54.161 INFO:tasks.workunit.client.0.smithi084.stdout: "Number of Namespaces: 1", 2024-03-30T12:21:54.161 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-03-30T12:21:54.161 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-03-30T12:21:54.161 INFO:tasks.workunit.client.0.smithi084.stdout: "Local Time is: Sat Mar 30 12:16:45 2024 UTC", 2024-03-30T12:21:54.161 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Updates (0x02): 1 Slot", 2024-03-30T12:21:54.162 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-03-30T12:21:54.162 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-03-30T12:21:54.162 INFO:tasks.workunit.client.0.smithi084.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-03-30T12:21:54.162 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:54.162 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported Power States", 2024-03-30T12:21:54.162 INFO:tasks.workunit.client.0.smithi084.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-03-30T12:21:54.162 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-03-30T12:21:54.162 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:54.162 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-03-30T12:21:54.162 INFO:tasks.workunit.client.0.smithi084.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-03-30T12:21:54.162 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 512 0 2", 2024-03-30T12:21:54.162 INFO:tasks.workunit.client.0.smithi084.stdout: " 1 - 512 8 2", 2024-03-30T12:21:54.163 INFO:tasks.workunit.client.0.smithi084.stdout: " 2 - 512 16 2", 2024-03-30T12:21:54.163 INFO:tasks.workunit.client.0.smithi084.stdout: " 3 - 4096 0 0", 2024-03-30T12:21:54.163 INFO:tasks.workunit.client.0.smithi084.stdout: " 4 - 4096 8 0", 2024-03-30T12:21:54.163 INFO:tasks.workunit.client.0.smithi084.stdout: " 5 - 4096 64 0", 2024-03-30T12:21:54.163 INFO:tasks.workunit.client.0.smithi084.stdout: " 6 - 4096 128 0", 2024-03-30T12:21:54.163 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:54.163 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF SMART DATA SECTION ===", 2024-03-30T12:21:54.163 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-03-30T12:21:54.163 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:54.163 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-03-30T12:21:54.163 INFO:tasks.workunit.client.0.smithi084.stdout: "Critical Warning: 0x00", 2024-03-30T12:21:54.163 INFO:tasks.workunit.client.0.smithi084.stdout: "Temperature: 27 Celsius", 2024-03-30T12:21:54.163 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare: 100%", 2024-03-30T12:21:54.164 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare Threshold: 10%", 2024-03-30T12:21:54.164 INFO:tasks.workunit.client.0.smithi084.stdout: "Percentage Used: 12%", 2024-03-30T12:21:54.164 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Read: 444,467,307 [227 TB]", 2024-03-30T12:21:54.164 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Written: 2,173,097,505 [1.11 PB]", 2024-03-30T12:21:54.164 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Read Commands: 7,000,448,296", 2024-03-30T12:21:54.164 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Write Commands: 36,885,402,494", 2024-03-30T12:21:54.164 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller Busy Time: 6", 2024-03-30T12:21:54.164 INFO:tasks.workunit.client.0.smithi084.stdout: "Power Cycles: 55,516", 2024-03-30T12:21:54.164 INFO:tasks.workunit.client.0.smithi084.stdout: "Power On Hours: 55,370", 2024-03-30T12:21:54.164 INFO:tasks.workunit.client.0.smithi084.stdout: "Unsafe Shutdowns: 272", 2024-03-30T12:21:54.164 INFO:tasks.workunit.client.0.smithi084.stdout: "Media and Data Integrity Errors: 0", 2024-03-30T12:21:54.164 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information Log Entries: 0", 2024-03-30T12:21:54.164 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:54.165 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information (NVMe Log 0x01, max 64 entries)", 2024-03-30T12:21:54.165 INFO:tasks.workunit.client.0.smithi084.stdout: "No Errors Logged", 2024-03-30T12:21:54.165 INFO:tasks.workunit.client.0.smithi084.stdout: "" 2024-03-30T12:21:54.165 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.165 INFO:tasks.workunit.client.0.smithi084.stdout: "platform_info": "x86_64-linux-5.14.0-434.el9.x86_64", 2024-03-30T12:21:54.165 INFO:tasks.workunit.client.0.smithi084.stdout: "svn_revision": "5022", 2024-03-30T12:21:54.165 INFO:tasks.workunit.client.0.smithi084.stdout: "version": [ 2024-03-30T12:21:54.165 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:54.165 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:54.165 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:54.165 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.165 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": { 2024-03-30T12:21:54.165 INFO:tasks.workunit.client.0.smithi084.stdout: "current": 27 2024-03-30T12:21:54.166 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.166 INFO:tasks.workunit.client.0.smithi084.stdout: "user_capacity": { 2024-03-30T12:21:54.166 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:54.166 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:54.166 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.166 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.166 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.166 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.166 INFO:tasks.workunit.client.0.smithi084.stdout:} 2024-03-30T12:21:54.167 INFO:tasks.workunit.client.0.smithi084.stderr:+ ceph telemetry preview-all 2024-03-30T12:21:54.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/3408915879' entity='client.admin' 2024-03-30T12:21:54.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:21:54.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:21:54.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:54.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:54.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:21:54.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:21:54.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:54.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:54.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:54.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:54.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:54.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:54.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:54.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:54.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:54.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3408915879' entity='client.admin' 2024-03-30T12:21:54.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:21:54.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:21:54.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:54.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:54.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:21:54.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:21:54.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:54.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:54.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:54.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:54.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:54.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:54.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:54.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:54.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:53 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:54.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:53 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/3408915879' entity='client.admin' 2024-03-30T12:21:54.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:53 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:21:54.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:53 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:21:54.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:53 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:54.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:53 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:54.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:53 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:21:54.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:53 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:21:54.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:53 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:54.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:53 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:54.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:53 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:54.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:53 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:54.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:53 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:54.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:53 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:54.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:53 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:54.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:53 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:54.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:53 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:54.646 INFO:tasks.workunit.client.0.smithi084.stdout:{ 2024-03-30T12:21:54.646 INFO:tasks.workunit.client.0.smithi084.stdout: "device_report": { 2024-03-30T12:21:54.646 INFO:tasks.workunit.client.0.smithi084.stdout: "17efb0a6-ee90-11ee-a0f6-0cc47a8fd751": { 2024-03-30T12:21:54.646 INFO:tasks.workunit.client.0.smithi084.stdout: "INTEL_SSDPEDMD400G4_17f043cc-ee90-11ee-a0f6-0cc47a8fd751": { 2024-03-30T12:21:54.646 INFO:tasks.workunit.client.0.smithi084.stdout: "20240330-121648": { 2024-03-30T12:21:54.646 INFO:tasks.workunit.client.0.smithi084.stdout: "device": { 2024-03-30T12:21:54.646 INFO:tasks.workunit.client.0.smithi084.stdout: "info_name": "/dev/nvme0n1", 2024-03-30T12:21:54.646 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "/dev/nvme0n1", 2024-03-30T12:21:54.646 INFO:tasks.workunit.client.0.smithi084.stdout: "protocol": "NVMe", 2024-03-30T12:21:54.646 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "nvme" 2024-03-30T12:21:54.646 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.646 INFO:tasks.workunit.client.0.smithi084.stdout: "firmware_version": "8DV101H0", 2024-03-30T12:21:54.647 INFO:tasks.workunit.client.0.smithi084.stdout: "host_id": "17efb0a6-ee90-11ee-a0f6-0cc47a8fd751", 2024-03-30T12:21:54.647 INFO:tasks.workunit.client.0.smithi084.stdout: "json_format_version": [ 2024-03-30T12:21:54.647 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:54.647 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:54.647 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.647 INFO:tasks.workunit.client.0.smithi084.stdout: "local_time": { 2024-03-30T12:21:54.647 INFO:tasks.workunit.client.0.smithi084.stdout: "asctime": "Sat Mar 30 12:16:47 2024 UTC", 2024-03-30T12:21:54.647 INFO:tasks.workunit.client.0.smithi084.stdout: "time_t": 1711801007 2024-03-30T12:21:54.647 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.647 INFO:tasks.workunit.client.0.smithi084.stdout: "logical_block_size": 512, 2024-03-30T12:21:54.647 INFO:tasks.workunit.client.0.smithi084.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-03-30T12:21:54.647 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_controller_id": 0, 2024-03-30T12:21:54.647 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-03-30T12:21:54.647 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_namespaces": [ 2024-03-30T12:21:54.648 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:54.648 INFO:tasks.workunit.client.0.smithi084.stdout: "capacity": { 2024-03-30T12:21:54.648 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:54.648 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:54.648 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.648 INFO:tasks.workunit.client.0.smithi084.stdout: "formatted_lba_size": 512, 2024-03-30T12:21:54.648 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 1, 2024-03-30T12:21:54.648 INFO:tasks.workunit.client.0.smithi084.stdout: "size": { 2024-03-30T12:21:54.648 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:54.648 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:54.648 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.648 INFO:tasks.workunit.client.0.smithi084.stdout: "utilization": { 2024-03-30T12:21:54.648 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:54.648 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:54.648 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.649 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.649 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.649 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_number_of_namespaces": 1, 2024-03-30T12:21:54.649 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_pci_vendor": { 2024-03-30T12:21:54.649 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 32902, 2024-03-30T12:21:54.649 INFO:tasks.workunit.client.0.smithi084.stdout: "subsystem_id": 32902 2024-03-30T12:21:54.649 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.649 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_add_log": { 2024-03-30T12:21:54.649 INFO:tasks.workunit.client.0.smithi084.stdout: "Device stats": { 2024-03-30T12:21:54.649 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_fw_downgrades": { 2024-03-30T12:21:54.649 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:54.649 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.649 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.649 INFO:tasks.workunit.client.0.smithi084.stdout: "crc_error_count": { 2024-03-30T12:21:54.650 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.650 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.650 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.650 INFO:tasks.workunit.client.0.smithi084.stdout: "end_to_end_error_detection_count": { 2024-03-30T12:21:54.650 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.650 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.650 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.650 INFO:tasks.workunit.client.0.smithi084.stdout: "erase_fail_count": { 2024-03-30T12:21:54.650 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.650 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.650 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.650 INFO:tasks.workunit.client.0.smithi084.stdout: "host_bytes_written": { 2024-03-30T12:21:54.650 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.650 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 29064747 2024-03-30T12:21:54.651 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.651 INFO:tasks.workunit.client.0.smithi084.stdout: "host_ctx_wear_used": { 2024-03-30T12:21:54.651 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.651 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 1 2024-03-30T12:21:54.651 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.651 INFO:tasks.workunit.client.0.smithi084.stdout: "media_bytes_read": { 2024-03-30T12:21:54.651 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:54.651 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.651 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.651 INFO:tasks.workunit.client.0.smithi084.stdout: "nand_bytes_written": { 2024-03-30T12:21:54.651 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.651 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 48148094 2024-03-30T12:21:54.651 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.651 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_stat_indicator": { 2024-03-30T12:21:54.652 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:54.652 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.652 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.652 INFO:tasks.workunit.client.0.smithi084.stdout: "pll_lock_loss_count": { 2024-03-30T12:21:54.652 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.652 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.652 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.652 INFO:tasks.workunit.client.0.smithi084.stdout: "program_fail_count": { 2024-03-30T12:21:54.652 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.652 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.652 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.652 INFO:tasks.workunit.client.0.smithi084.stdout: "re_alloc_sectr_cnt": { 2024-03-30T12:21:54.652 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:54.653 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.653 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.653 INFO:tasks.workunit.client.0.smithi084.stdout: "retry_buffer_overflow_count": { 2024-03-30T12:21:54.653 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.653 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.653 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.653 INFO:tasks.workunit.client.0.smithi084.stdout: "soft_ecc_err_rate": { 2024-03-30T12:21:54.653 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:54.653 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.653 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.653 INFO:tasks.workunit.client.0.smithi084.stdout: "thermal_throttle_status": { 2024-03-30T12:21:54.653 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.653 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-03-30T12:21:54.653 INFO:tasks.workunit.client.0.smithi084.stdout: "cnt": 0, 2024-03-30T12:21:54.653 INFO:tasks.workunit.client.0.smithi084.stdout: "pct": 0 2024-03-30T12:21:54.654 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.654 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.654 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_host_reads": { 2024-03-30T12:21:54.654 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.654 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-03-30T12:21:54.654 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.654 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_media_wear": { 2024-03-30T12:21:54.654 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.654 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 64 2024-03-30T12:21:54.654 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.654 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_timer": { 2024-03-30T12:21:54.654 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.654 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-03-30T12:21:54.654 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.654 INFO:tasks.workunit.client.0.smithi084.stdout: "unexp_power_loss": { 2024-03-30T12:21:54.655 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:54.655 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.655 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.655 INFO:tasks.workunit.client.0.smithi084.stdout: "wear_leveling": { 2024-03-30T12:21:54.655 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 90, 2024-03-30T12:21:54.655 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-03-30T12:21:54.655 INFO:tasks.workunit.client.0.smithi084.stdout: "avg": 3240, 2024-03-30T12:21:54.655 INFO:tasks.workunit.client.0.smithi084.stdout: "max": 3251, 2024-03-30T12:21:54.655 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 3229 2024-03-30T12:21:54.655 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.655 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.655 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.655 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel Smart log": "nvme0n1" 2024-03-30T12:21:54.655 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.655 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_log": { 2024-03-30T12:21:54.655 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare": 100, 2024-03-30T12:21:54.656 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare_threshold": 10, 2024-03-30T12:21:54.656 INFO:tasks.workunit.client.0.smithi084.stdout: "controller_busy_time": 14, 2024-03-30T12:21:54.656 INFO:tasks.workunit.client.0.smithi084.stdout: "critical_warning": 0, 2024-03-30T12:21:54.656 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_read": 412181458, 2024-03-30T12:21:54.656 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_written": 1904787272, 2024-03-30T12:21:54.656 INFO:tasks.workunit.client.0.smithi084.stdout: "host_reads": 7071122069, 2024-03-30T12:21:54.656 INFO:tasks.workunit.client.0.smithi084.stdout: "host_writes": 34331777573, 2024-03-30T12:21:54.656 INFO:tasks.workunit.client.0.smithi084.stdout: "media_errors": 0, 2024-03-30T12:21:54.656 INFO:tasks.workunit.client.0.smithi084.stdout: "num_err_log_entries": 0, 2024-03-30T12:21:54.656 INFO:tasks.workunit.client.0.smithi084.stdout: "percentage_used": 10, 2024-03-30T12:21:54.656 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycles": 49095, 2024-03-30T12:21:54.656 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_hours": 54192, 2024-03-30T12:21:54.656 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": 29, 2024-03-30T12:21:54.656 INFO:tasks.workunit.client.0.smithi084.stdout: "unsafe_shutdowns": 535 2024-03-30T12:21:54.656 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.657 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_vendor": "intel", 2024-03-30T12:21:54.657 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycle_count": 49095, 2024-03-30T12:21:54.657 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_time": { 2024-03-30T12:21:54.657 INFO:tasks.workunit.client.0.smithi084.stdout: "hours": 54192 2024-03-30T12:21:54.657 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.657 INFO:tasks.workunit.client.0.smithi084.stdout: "serial_number": "deleted", 2024-03-30T12:21:54.657 INFO:tasks.workunit.client.0.smithi084.stdout: "smart_status": { 2024-03-30T12:21:54.657 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme": { 2024-03-30T12:21:54.657 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:54.657 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.657 INFO:tasks.workunit.client.0.smithi084.stdout: "passed": true 2024-03-30T12:21:54.657 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.657 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl": { 2024-03-30T12:21:54.657 INFO:tasks.workunit.client.0.smithi084.stdout: "argv": [ 2024-03-30T12:21:54.657 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl", 2024-03-30T12:21:54.658 INFO:tasks.workunit.client.0.smithi084.stdout: "-x", 2024-03-30T12:21:54.658 INFO:tasks.workunit.client.0.smithi084.stdout: "--json=o", 2024-03-30T12:21:54.658 INFO:tasks.workunit.client.0.smithi084.stdout: "/dev/nvme0n1" 2024-03-30T12:21:54.658 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.658 INFO:tasks.workunit.client.0.smithi084.stdout: "build_info": "(local build)", 2024-03-30T12:21:54.658 INFO:tasks.workunit.client.0.smithi084.stdout: "exit_status": 0, 2024-03-30T12:21:54.658 INFO:tasks.workunit.client.0.smithi084.stdout: "output": [ 2024-03-30T12:21:54.658 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.14.0-434.el9.x86_64] (local build)", 2024-03-30T12:21:54.658 INFO:tasks.workunit.client.0.smithi084.stdout: "Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-03-30T12:21:54.658 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:54.658 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF INFORMATION SECTION ===", 2024-03-30T12:21:54.658 INFO:tasks.workunit.client.0.smithi084.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-03-30T12:21:54.658 INFO:tasks.workunit.client.0.smithi084.stdout: "Serial Number: deleted", 2024-03-30T12:21:54.658 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Version: 8DV101H0", 2024-03-30T12:21:54.658 INFO:tasks.workunit.client.0.smithi084.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-03-30T12:21:54.659 INFO:tasks.workunit.client.0.smithi084.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-03-30T12:21:54.659 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller ID: 0", 2024-03-30T12:21:54.659 INFO:tasks.workunit.client.0.smithi084.stdout: "Number of Namespaces: 1", 2024-03-30T12:21:54.659 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-03-30T12:21:54.659 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-03-30T12:21:54.659 INFO:tasks.workunit.client.0.smithi084.stdout: "Local Time is: Sat Mar 30 12:16:47 2024 UTC", 2024-03-30T12:21:54.659 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Updates (0x02): 1 Slot", 2024-03-30T12:21:54.659 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-03-30T12:21:54.659 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-03-30T12:21:54.659 INFO:tasks.workunit.client.0.smithi084.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-03-30T12:21:54.659 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:54.659 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported Power States", 2024-03-30T12:21:54.659 INFO:tasks.workunit.client.0.smithi084.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-03-30T12:21:54.659 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-03-30T12:21:54.659 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:54.660 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-03-30T12:21:54.660 INFO:tasks.workunit.client.0.smithi084.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-03-30T12:21:54.660 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 512 0 2", 2024-03-30T12:21:54.660 INFO:tasks.workunit.client.0.smithi084.stdout: " 1 - 512 8 2", 2024-03-30T12:21:54.660 INFO:tasks.workunit.client.0.smithi084.stdout: " 2 - 512 16 2", 2024-03-30T12:21:54.660 INFO:tasks.workunit.client.0.smithi084.stdout: " 3 - 4096 0 0", 2024-03-30T12:21:54.660 INFO:tasks.workunit.client.0.smithi084.stdout: " 4 - 4096 8 0", 2024-03-30T12:21:54.660 INFO:tasks.workunit.client.0.smithi084.stdout: " 5 - 4096 64 0", 2024-03-30T12:21:54.660 INFO:tasks.workunit.client.0.smithi084.stdout: " 6 - 4096 128 0", 2024-03-30T12:21:54.660 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:54.660 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF SMART DATA SECTION ===", 2024-03-30T12:21:54.660 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-03-30T12:21:54.660 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:54.660 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-03-30T12:21:54.660 INFO:tasks.workunit.client.0.smithi084.stdout: "Critical Warning: 0x00", 2024-03-30T12:21:54.660 INFO:tasks.workunit.client.0.smithi084.stdout: "Temperature: 29 Celsius", 2024-03-30T12:21:54.661 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare: 100%", 2024-03-30T12:21:54.661 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare Threshold: 10%", 2024-03-30T12:21:54.661 INFO:tasks.workunit.client.0.smithi084.stdout: "Percentage Used: 10%", 2024-03-30T12:21:54.661 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Read: 412,181,458 [211 TB]", 2024-03-30T12:21:54.661 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Written: 1,904,787,272 [975 TB]", 2024-03-30T12:21:54.661 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Read Commands: 7,071,122,069", 2024-03-30T12:21:54.661 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Write Commands: 34,331,777,573", 2024-03-30T12:21:54.661 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller Busy Time: 14", 2024-03-30T12:21:54.661 INFO:tasks.workunit.client.0.smithi084.stdout: "Power Cycles: 49,095", 2024-03-30T12:21:54.661 INFO:tasks.workunit.client.0.smithi084.stdout: "Power On Hours: 54,192", 2024-03-30T12:21:54.661 INFO:tasks.workunit.client.0.smithi084.stdout: "Unsafe Shutdowns: 535", 2024-03-30T12:21:54.661 INFO:tasks.workunit.client.0.smithi084.stdout: "Media and Data Integrity Errors: 0", 2024-03-30T12:21:54.661 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information Log Entries: 0", 2024-03-30T12:21:54.661 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:54.662 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information (NVMe Log 0x01, max 64 entries)", 2024-03-30T12:21:54.662 INFO:tasks.workunit.client.0.smithi084.stdout: "No Errors Logged", 2024-03-30T12:21:54.662 INFO:tasks.workunit.client.0.smithi084.stdout: "" 2024-03-30T12:21:54.662 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.662 INFO:tasks.workunit.client.0.smithi084.stdout: "platform_info": "x86_64-linux-5.14.0-434.el9.x86_64", 2024-03-30T12:21:54.662 INFO:tasks.workunit.client.0.smithi084.stdout: "svn_revision": "5022", 2024-03-30T12:21:54.662 INFO:tasks.workunit.client.0.smithi084.stdout: "version": [ 2024-03-30T12:21:54.662 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:54.662 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:54.662 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:54.662 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.662 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": { 2024-03-30T12:21:54.662 INFO:tasks.workunit.client.0.smithi084.stdout: "current": 29 2024-03-30T12:21:54.662 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.663 INFO:tasks.workunit.client.0.smithi084.stdout: "user_capacity": { 2024-03-30T12:21:54.663 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:54.663 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:54.663 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.663 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.663 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.663 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.663 INFO:tasks.workunit.client.0.smithi084.stdout: "17f17a76-ee90-11ee-a0f6-0cc47a8fd751": { 2024-03-30T12:21:54.663 INFO:tasks.workunit.client.0.smithi084.stdout: "INTEL_SSDPEDMD400G4_17f1fdca-ee90-11ee-a0f6-0cc47a8fd751": { 2024-03-30T12:21:54.663 INFO:tasks.workunit.client.0.smithi084.stdout: "20240330-121645": { 2024-03-30T12:21:54.663 INFO:tasks.workunit.client.0.smithi084.stdout: "device": { 2024-03-30T12:21:54.663 INFO:tasks.workunit.client.0.smithi084.stdout: "info_name": "/dev/nvme0n1", 2024-03-30T12:21:54.663 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "/dev/nvme0n1", 2024-03-30T12:21:54.663 INFO:tasks.workunit.client.0.smithi084.stdout: "protocol": "NVMe", 2024-03-30T12:21:54.663 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "nvme" 2024-03-30T12:21:54.664 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.664 INFO:tasks.workunit.client.0.smithi084.stdout: "firmware_version": "8DV101H0", 2024-03-30T12:21:54.664 INFO:tasks.workunit.client.0.smithi084.stdout: "host_id": "17f17a76-ee90-11ee-a0f6-0cc47a8fd751", 2024-03-30T12:21:54.664 INFO:tasks.workunit.client.0.smithi084.stdout: "json_format_version": [ 2024-03-30T12:21:54.664 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:54.664 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:54.664 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.664 INFO:tasks.workunit.client.0.smithi084.stdout: "local_time": { 2024-03-30T12:21:54.664 INFO:tasks.workunit.client.0.smithi084.stdout: "asctime": "Sat Mar 30 12:16:45 2024 UTC", 2024-03-30T12:21:54.664 INFO:tasks.workunit.client.0.smithi084.stdout: "time_t": 1711801005 2024-03-30T12:21:54.664 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.664 INFO:tasks.workunit.client.0.smithi084.stdout: "logical_block_size": 512, 2024-03-30T12:21:54.664 INFO:tasks.workunit.client.0.smithi084.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-03-30T12:21:54.664 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_controller_id": 0, 2024-03-30T12:21:54.665 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-03-30T12:21:54.665 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_namespaces": [ 2024-03-30T12:21:54.665 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:54.665 INFO:tasks.workunit.client.0.smithi084.stdout: "capacity": { 2024-03-30T12:21:54.665 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:54.665 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:54.665 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.665 INFO:tasks.workunit.client.0.smithi084.stdout: "formatted_lba_size": 512, 2024-03-30T12:21:54.665 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 1, 2024-03-30T12:21:54.665 INFO:tasks.workunit.client.0.smithi084.stdout: "size": { 2024-03-30T12:21:54.665 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:54.665 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:54.665 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.665 INFO:tasks.workunit.client.0.smithi084.stdout: "utilization": { 2024-03-30T12:21:54.665 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:54.666 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:54.666 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.666 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.666 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.666 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_number_of_namespaces": 1, 2024-03-30T12:21:54.666 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_pci_vendor": { 2024-03-30T12:21:54.666 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 32902, 2024-03-30T12:21:54.666 INFO:tasks.workunit.client.0.smithi084.stdout: "subsystem_id": 32902 2024-03-30T12:21:54.666 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.666 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_add_log": { 2024-03-30T12:21:54.666 INFO:tasks.workunit.client.0.smithi084.stdout: "Device stats": { 2024-03-30T12:21:54.666 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_fw_downgrades": { 2024-03-30T12:21:54.666 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:54.666 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.667 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.667 INFO:tasks.workunit.client.0.smithi084.stdout: "crc_error_count": { 2024-03-30T12:21:54.667 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.667 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.667 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.667 INFO:tasks.workunit.client.0.smithi084.stdout: "end_to_end_error_detection_count": { 2024-03-30T12:21:54.667 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.667 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.667 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.667 INFO:tasks.workunit.client.0.smithi084.stdout: "erase_fail_count": { 2024-03-30T12:21:54.667 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.667 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.667 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.667 INFO:tasks.workunit.client.0.smithi084.stdout: "host_bytes_written": { 2024-03-30T12:21:54.667 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.668 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 33158836 2024-03-30T12:21:54.668 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.668 INFO:tasks.workunit.client.0.smithi084.stdout: "host_ctx_wear_used": { 2024-03-30T12:21:54.668 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.668 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 1 2024-03-30T12:21:54.668 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.668 INFO:tasks.workunit.client.0.smithi084.stdout: "media_bytes_read": { 2024-03-30T12:21:54.668 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:54.668 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.668 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.668 INFO:tasks.workunit.client.0.smithi084.stdout: "nand_bytes_written": { 2024-03-30T12:21:54.668 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.668 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 54845455 2024-03-30T12:21:54.668 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.668 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_stat_indicator": { 2024-03-30T12:21:54.669 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:54.669 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.669 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.669 INFO:tasks.workunit.client.0.smithi084.stdout: "pll_lock_loss_count": { 2024-03-30T12:21:54.669 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.669 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.669 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.669 INFO:tasks.workunit.client.0.smithi084.stdout: "program_fail_count": { 2024-03-30T12:21:54.669 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.669 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.669 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.669 INFO:tasks.workunit.client.0.smithi084.stdout: "re_alloc_sectr_cnt": { 2024-03-30T12:21:54.669 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:54.669 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.669 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.669 INFO:tasks.workunit.client.0.smithi084.stdout: "retry_buffer_overflow_count": { 2024-03-30T12:21:54.670 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.670 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.670 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.670 INFO:tasks.workunit.client.0.smithi084.stdout: "soft_ecc_err_rate": { 2024-03-30T12:21:54.670 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:54.670 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.670 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.670 INFO:tasks.workunit.client.0.smithi084.stdout: "thermal_throttle_status": { 2024-03-30T12:21:54.670 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.670 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-03-30T12:21:54.670 INFO:tasks.workunit.client.0.smithi084.stdout: "cnt": 0, 2024-03-30T12:21:54.670 INFO:tasks.workunit.client.0.smithi084.stdout: "pct": 0 2024-03-30T12:21:54.670 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.670 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.671 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_host_reads": { 2024-03-30T12:21:54.671 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.671 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-03-30T12:21:54.671 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.671 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_media_wear": { 2024-03-30T12:21:54.671 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.671 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 64 2024-03-30T12:21:54.671 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.671 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_timer": { 2024-03-30T12:21:54.671 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:54.671 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-03-30T12:21:54.671 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.671 INFO:tasks.workunit.client.0.smithi084.stdout: "unexp_power_loss": { 2024-03-30T12:21:54.671 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:54.671 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:54.672 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.672 INFO:tasks.workunit.client.0.smithi084.stdout: "wear_leveling": { 2024-03-30T12:21:54.672 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 88, 2024-03-30T12:21:54.672 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-03-30T12:21:54.672 INFO:tasks.workunit.client.0.smithi084.stdout: "avg": 3701, 2024-03-30T12:21:54.672 INFO:tasks.workunit.client.0.smithi084.stdout: "max": 3720, 2024-03-30T12:21:54.672 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 3684 2024-03-30T12:21:54.672 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.672 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.672 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.672 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel Smart log": "nvme0n1" 2024-03-30T12:21:54.672 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.672 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_log": { 2024-03-30T12:21:54.672 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare": 100, 2024-03-30T12:21:54.673 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare_threshold": 10, 2024-03-30T12:21:54.673 INFO:tasks.workunit.client.0.smithi084.stdout: "controller_busy_time": 6, 2024-03-30T12:21:54.673 INFO:tasks.workunit.client.0.smithi084.stdout: "critical_warning": 0, 2024-03-30T12:21:54.673 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_read": 444467307, 2024-03-30T12:21:54.673 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_written": 2173097505, 2024-03-30T12:21:54.673 INFO:tasks.workunit.client.0.smithi084.stdout: "host_reads": 7000448296, 2024-03-30T12:21:54.673 INFO:tasks.workunit.client.0.smithi084.stdout: "host_writes": 36885402494, 2024-03-30T12:21:54.673 INFO:tasks.workunit.client.0.smithi084.stdout: "media_errors": 0, 2024-03-30T12:21:54.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_err_log_entries": 0, 2024-03-30T12:21:54.673 INFO:tasks.workunit.client.0.smithi084.stdout: "percentage_used": 12, 2024-03-30T12:21:54.673 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycles": 55516, 2024-03-30T12:21:54.673 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_hours": 55370, 2024-03-30T12:21:54.673 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": 27, 2024-03-30T12:21:54.673 INFO:tasks.workunit.client.0.smithi084.stdout: "unsafe_shutdowns": 272 2024-03-30T12:21:54.673 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.673 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_vendor": "intel", 2024-03-30T12:21:54.674 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycle_count": 55516, 2024-03-30T12:21:54.674 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_time": { 2024-03-30T12:21:54.674 INFO:tasks.workunit.client.0.smithi084.stdout: "hours": 55370 2024-03-30T12:21:54.674 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.674 INFO:tasks.workunit.client.0.smithi084.stdout: "serial_number": "deleted", 2024-03-30T12:21:54.674 INFO:tasks.workunit.client.0.smithi084.stdout: "smart_status": { 2024-03-30T12:21:54.674 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme": { 2024-03-30T12:21:54.674 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:54.674 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.674 INFO:tasks.workunit.client.0.smithi084.stdout: "passed": true 2024-03-30T12:21:54.674 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.674 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl": { 2024-03-30T12:21:54.674 INFO:tasks.workunit.client.0.smithi084.stdout: "argv": [ 2024-03-30T12:21:54.674 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl", 2024-03-30T12:21:54.674 INFO:tasks.workunit.client.0.smithi084.stdout: "-x", 2024-03-30T12:21:54.675 INFO:tasks.workunit.client.0.smithi084.stdout: "--json=o", 2024-03-30T12:21:54.675 INFO:tasks.workunit.client.0.smithi084.stdout: "/dev/nvme0n1" 2024-03-30T12:21:54.675 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.675 INFO:tasks.workunit.client.0.smithi084.stdout: "build_info": "(local build)", 2024-03-30T12:21:54.675 INFO:tasks.workunit.client.0.smithi084.stdout: "exit_status": 0, 2024-03-30T12:21:54.675 INFO:tasks.workunit.client.0.smithi084.stdout: "output": [ 2024-03-30T12:21:54.675 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.14.0-434.el9.x86_64] (local build)", 2024-03-30T12:21:54.675 INFO:tasks.workunit.client.0.smithi084.stdout: "Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-03-30T12:21:54.675 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:54.675 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF INFORMATION SECTION ===", 2024-03-30T12:21:54.675 INFO:tasks.workunit.client.0.smithi084.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-03-30T12:21:54.675 INFO:tasks.workunit.client.0.smithi084.stdout: "Serial Number: deleted", 2024-03-30T12:21:54.675 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Version: 8DV101H0", 2024-03-30T12:21:54.675 INFO:tasks.workunit.client.0.smithi084.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-03-30T12:21:54.675 INFO:tasks.workunit.client.0.smithi084.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-03-30T12:21:54.675 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller ID: 0", 2024-03-30T12:21:54.676 INFO:tasks.workunit.client.0.smithi084.stdout: "Number of Namespaces: 1", 2024-03-30T12:21:54.676 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-03-30T12:21:54.676 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-03-30T12:21:54.676 INFO:tasks.workunit.client.0.smithi084.stdout: "Local Time is: Sat Mar 30 12:16:45 2024 UTC", 2024-03-30T12:21:54.676 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Updates (0x02): 1 Slot", 2024-03-30T12:21:54.676 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-03-30T12:21:54.676 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-03-30T12:21:54.676 INFO:tasks.workunit.client.0.smithi084.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-03-30T12:21:54.676 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:54.676 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported Power States", 2024-03-30T12:21:54.676 INFO:tasks.workunit.client.0.smithi084.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-03-30T12:21:54.676 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-03-30T12:21:54.676 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:54.676 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-03-30T12:21:54.676 INFO:tasks.workunit.client.0.smithi084.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-03-30T12:21:54.676 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 512 0 2", 2024-03-30T12:21:54.677 INFO:tasks.workunit.client.0.smithi084.stdout: " 1 - 512 8 2", 2024-03-30T12:21:54.677 INFO:tasks.workunit.client.0.smithi084.stdout: " 2 - 512 16 2", 2024-03-30T12:21:54.677 INFO:tasks.workunit.client.0.smithi084.stdout: " 3 - 4096 0 0", 2024-03-30T12:21:54.677 INFO:tasks.workunit.client.0.smithi084.stdout: " 4 - 4096 8 0", 2024-03-30T12:21:54.677 INFO:tasks.workunit.client.0.smithi084.stdout: " 5 - 4096 64 0", 2024-03-30T12:21:54.677 INFO:tasks.workunit.client.0.smithi084.stdout: " 6 - 4096 128 0", 2024-03-30T12:21:54.677 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:54.677 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF SMART DATA SECTION ===", 2024-03-30T12:21:54.677 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-03-30T12:21:54.677 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:54.677 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-03-30T12:21:54.677 INFO:tasks.workunit.client.0.smithi084.stdout: "Critical Warning: 0x00", 2024-03-30T12:21:54.677 INFO:tasks.workunit.client.0.smithi084.stdout: "Temperature: 27 Celsius", 2024-03-30T12:21:54.677 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare: 100%", 2024-03-30T12:21:54.677 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare Threshold: 10%", 2024-03-30T12:21:54.677 INFO:tasks.workunit.client.0.smithi084.stdout: "Percentage Used: 12%", 2024-03-30T12:21:54.678 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Read: 444,467,307 [227 TB]", 2024-03-30T12:21:54.678 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Written: 2,173,097,505 [1.11 PB]", 2024-03-30T12:21:54.678 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Read Commands: 7,000,448,296", 2024-03-30T12:21:54.678 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Write Commands: 36,885,402,494", 2024-03-30T12:21:54.678 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller Busy Time: 6", 2024-03-30T12:21:54.678 INFO:tasks.workunit.client.0.smithi084.stdout: "Power Cycles: 55,516", 2024-03-30T12:21:54.678 INFO:tasks.workunit.client.0.smithi084.stdout: "Power On Hours: 55,370", 2024-03-30T12:21:54.678 INFO:tasks.workunit.client.0.smithi084.stdout: "Unsafe Shutdowns: 272", 2024-03-30T12:21:54.678 INFO:tasks.workunit.client.0.smithi084.stdout: "Media and Data Integrity Errors: 0", 2024-03-30T12:21:54.678 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information Log Entries: 0", 2024-03-30T12:21:54.678 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:54.678 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information (NVMe Log 0x01, max 64 entries)", 2024-03-30T12:21:54.678 INFO:tasks.workunit.client.0.smithi084.stdout: "No Errors Logged", 2024-03-30T12:21:54.678 INFO:tasks.workunit.client.0.smithi084.stdout: "" 2024-03-30T12:21:54.678 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.678 INFO:tasks.workunit.client.0.smithi084.stdout: "platform_info": "x86_64-linux-5.14.0-434.el9.x86_64", 2024-03-30T12:21:54.678 INFO:tasks.workunit.client.0.smithi084.stdout: "svn_revision": "5022", 2024-03-30T12:21:54.679 INFO:tasks.workunit.client.0.smithi084.stdout: "version": [ 2024-03-30T12:21:54.679 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:54.679 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:54.679 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:54.679 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.679 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": { 2024-03-30T12:21:54.679 INFO:tasks.workunit.client.0.smithi084.stdout: "current": 27 2024-03-30T12:21:54.679 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.679 INFO:tasks.workunit.client.0.smithi084.stdout: "user_capacity": { 2024-03-30T12:21:54.679 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:54.679 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:54.679 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.679 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.679 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.679 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.679 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.680 INFO:tasks.workunit.client.0.smithi084.stdout: "report": { 2024-03-30T12:21:54.680 INFO:tasks.workunit.client.0.smithi084.stdout: "balancer": { 2024-03-30T12:21:54.680 INFO:tasks.workunit.client.0.smithi084.stdout: "active": true, 2024-03-30T12:21:54.680 INFO:tasks.workunit.client.0.smithi084.stdout: "mode": "" 2024-03-30T12:21:54.680 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.680 INFO:tasks.workunit.client.0.smithi084.stdout: "channels": [ 2024-03-30T12:21:54.680 INFO:tasks.workunit.client.0.smithi084.stdout: "basic", 2024-03-30T12:21:54.680 INFO:tasks.workunit.client.0.smithi084.stdout: "crash", 2024-03-30T12:21:54.680 INFO:tasks.workunit.client.0.smithi084.stdout: "device", 2024-03-30T12:21:54.680 INFO:tasks.workunit.client.0.smithi084.stdout: "ident" 2024-03-30T12:21:54.680 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.680 INFO:tasks.workunit.client.0.smithi084.stdout: "channels_available": [ 2024-03-30T12:21:54.680 INFO:tasks.workunit.client.0.smithi084.stdout: "basic", 2024-03-30T12:21:54.680 INFO:tasks.workunit.client.0.smithi084.stdout: "ident", 2024-03-30T12:21:54.680 INFO:tasks.workunit.client.0.smithi084.stdout: "crash", 2024-03-30T12:21:54.681 INFO:tasks.workunit.client.0.smithi084.stdout: "device", 2024-03-30T12:21:54.681 INFO:tasks.workunit.client.0.smithi084.stdout: "perf" 2024-03-30T12:21:54.681 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.681 INFO:tasks.workunit.client.0.smithi084.stdout: "collections_available": [ 2024-03-30T12:21:54.681 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_base", 2024-03-30T12:21:54.681 INFO:tasks.workunit.client.0.smithi084.stdout: "device_base", 2024-03-30T12:21:54.681 INFO:tasks.workunit.client.0.smithi084.stdout: "crash_base", 2024-03-30T12:21:54.681 INFO:tasks.workunit.client.0.smithi084.stdout: "ident_base", 2024-03-30T12:21:54.681 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_perf", 2024-03-30T12:21:54.681 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_mds_metadata", 2024-03-30T12:21:54.681 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_usage", 2024-03-30T12:21:54.681 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_usage_by_class", 2024-03-30T12:21:54.681 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_rook_v01", 2024-03-30T12:21:54.681 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_memory_metrics", 2024-03-30T12:21:54.681 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_options_bluestore" 2024-03-30T12:21:54.682 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.682 INFO:tasks.workunit.client.0.smithi084.stdout: "collections_opted_in": [ 2024-03-30T12:21:54.682 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_base", 2024-03-30T12:21:54.682 INFO:tasks.workunit.client.0.smithi084.stdout: "device_base", 2024-03-30T12:21:54.682 INFO:tasks.workunit.client.0.smithi084.stdout: "crash_base", 2024-03-30T12:21:54.682 INFO:tasks.workunit.client.0.smithi084.stdout: "ident_base", 2024-03-30T12:21:54.682 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_perf", 2024-03-30T12:21:54.682 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_mds_metadata", 2024-03-30T12:21:54.682 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_usage", 2024-03-30T12:21:54.682 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_usage_by_class", 2024-03-30T12:21:54.682 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_rook_v01", 2024-03-30T12:21:54.682 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_memory_metrics", 2024-03-30T12:21:54.682 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_options_bluestore" 2024-03-30T12:21:54.682 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.683 INFO:tasks.workunit.client.0.smithi084.stdout: "config": { 2024-03-30T12:21:54.683 INFO:tasks.workunit.client.0.smithi084.stdout: "active_changed": [ 2024-03-30T12:21:54.683 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_allow_insecure_global_id_reclaim", 2024-03-30T12:21:54.683 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_debug", 2024-03-30T12:21:54.683 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_mon_ticket_ttl", 2024-03-30T12:21:54.683 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_service_ticket_ttl", 2024-03-30T12:21:54.683 INFO:tasks.workunit.client.0.smithi084.stdout: "bdev_debug_aio", 2024-03-30T12:21:54.683 INFO:tasks.workunit.client.0.smithi084.stdout: "client_check_pool_perm", 2024-03-30T12:21:54.683 INFO:tasks.workunit.client.0.smithi084.stdout: "client_mount_gid", 2024-03-30T12:21:54.683 INFO:tasks.workunit.client.0.smithi084.stdout: "client_mount_uid", 2024-03-30T12:21:54.683 INFO:tasks.workunit.client.0.smithi084.stdout: "client_quota", 2024-03-30T12:21:54.683 INFO:tasks.workunit.client.0.smithi084.stdout: "container_image", 2024-03-30T12:21:54.683 INFO:tasks.workunit.client.0.smithi084.stdout: "daemonize", 2024-03-30T12:21:54.683 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_asserts_on_shutdown", 2024-03-30T12:21:54.683 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mgr", 2024-03-30T12:21:54.683 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mon", 2024-03-30T12:21:54.684 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_ms", 2024-03-30T12:21:54.684 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_osd", 2024-03-30T12:21:54.684 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_paxos", 2024-03-30T12:21:54.684 INFO:tasks.workunit.client.0.smithi084.stdout: "keyring", 2024-03-30T12:21:54.684 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_block_size", 2024-03-30T12:21:54.684 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_cache_size", 2024-03-30T12:21:54.684 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_compression", 2024-03-30T12:21:54.684 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_log", 2024-03-30T12:21:54.684 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_write_buffer_size", 2024-03-30T12:21:54.684 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_file", 2024-03-30T12:21:54.684 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_journald", 2024-03-30T12:21:54.684 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_stderr", 2024-03-30T12:21:54.684 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_allow_pool_delete", 2024-03-30T12:21:54.684 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_clock_drift_allowed", 2024-03-30T12:21:54.684 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_file_level", 2024-03-30T12:21:54.684 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_file", 2024-03-30T12:21:54.684 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_journald", 2024-03-30T12:21:54.685 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_stderr", 2024-03-30T12:21:54.685 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_data_avail_warn", 2024-03-30T12:21:54.685 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_election_default_strategy", 2024-03-30T12:21:54.685 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_host", 2024-03-30T12:21:54.685 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_max_pg_per_osd", 2024-03-30T12:21:54.685 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_mgr_mkfs_grace", 2024-03-30T12:21:54.685 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_prime_pg_temp", 2024-03-30T12:21:54.685 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_reporter_subtree_level", 2024-03-30T12:21:54.685 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_pg_warn_max_object_skew", 2024-03-30T12:21:54.685 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_bytes_per_osd", 2024-03-30T12:21:54.685 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_pgs_per_osd", 2024-03-30T12:21:54.685 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-03-30T12:21:54.685 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-03-30T12:21:54.685 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-03-30T12:21:54.685 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_legacy_crush_tunables", 2024-03-30T12:21:54.685 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-03-30T12:21:54.685 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-03-30T12:21:54.686 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_too_few_osds", 2024-03-30T12:21:54.686 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_bug", 2024-03-30T12:21:54.686 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_old_message", 2024-03-30T12:21:54.686 INFO:tasks.workunit.client.0.smithi084.stdout: "no_config_file", 2024-03-30T12:21:54.686 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_default_list", 2024-03-30T12:21:54.686 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_load_list", 2024-03-30T12:21:54.686 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_crush_chooseleaf_type", 2024-03-30T12:21:54.686 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_misdirected_ops", 2024-03-30T12:21:54.686 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_op_order", 2024-03-30T12:21:54.686 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_pg_log_writeout", 2024-03-30T12:21:54.686 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_shutdown", 2024-03-30T12:21:54.686 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_cached_snaps", 2024-03-30T12:21:54.686 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_missing_on_start", 2024-03-30T12:21:54.686 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_stray_on_activate", 2024-03-30T12:21:54.686 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_deep_scrub_update_digest_min_age", 2024-03-30T12:21:54.687 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_delete_sleep", 2024-03-30T12:21:54.687 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_delete_sleep_hdd", 2024-03-30T12:21:54.687 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_delete_sleep_hybrid", 2024-03-30T12:21:54.687 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_delete_sleep_ssd", 2024-03-30T12:21:54.687 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_max_backfills", 2024-03-30T12:21:54.687 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_max_capacity_iops_ssd", 2024-03-30T12:21:54.687 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_profile", 2024-03-30T12:21:54.687 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_best_effort_lim", 2024-03-30T12:21:54.687 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_best_effort_res", 2024-03-30T12:21:54.687 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_best_effort_wgt", 2024-03-30T12:21:54.687 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_recovery_lim", 2024-03-30T12:21:54.687 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_recovery_res", 2024-03-30T12:21:54.687 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_recovery_wgt", 2024-03-30T12:21:54.687 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_client_lim", 2024-03-30T12:21:54.687 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_client_res", 2024-03-30T12:21:54.688 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_client_wgt", 2024-03-30T12:21:54.688 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target", 2024-03-30T12:21:54.688 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target_autotune", 2024-03-30T12:21:54.688 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue", 2024-03-30T12:21:54.688 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue_cut_off", 2024-03-30T12:21:54.688 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pg_delete_cost", 2024-03-30T12:21:54.688 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_erasure_code_profile", 2024-03-30T12:21:54.688 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_pg_autoscale_mode", 2024-03-30T12:21:54.688 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recover_clone_overlap", 2024-03-30T12:21:54.688 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_active", 2024-03-30T12:21:54.688 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_active_hdd", 2024-03-30T12:21:54.688 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_active_ssd", 2024-03-30T12:21:54.688 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_chunk", 2024-03-30T12:21:54.688 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_sleep", 2024-03-30T12:21:54.689 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_sleep_hdd", 2024-03-30T12:21:54.689 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_sleep_hybrid", 2024-03-30T12:21:54.689 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_sleep_ssd", 2024-03-30T12:21:54.689 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_load_threshold", 2024-03-30T12:21:54.689 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_max_interval", 2024-03-30T12:21:54.689 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_sleep", 2024-03-30T12:21:54.689 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_shutdown_pgref_assert", 2024-03-30T12:21:54.689 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_snap_trim_sleep", 2024-03-30T12:21:54.689 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_snap_trim_sleep_hdd", 2024-03-30T12:21:54.689 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_snap_trim_sleep_hybrid", 2024-03-30T12:21:54.689 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_snap_trim_sleep_ssd", 2024-03-30T12:21:54.689 INFO:tasks.workunit.client.0.smithi084.stdout: "public_addr", 2024-03-30T12:21:54.689 INFO:tasks.workunit.client.0.smithi084.stdout: "public_addrv", 2024-03-30T12:21:54.689 INFO:tasks.workunit.client.0.smithi084.stdout: "public_network", 2024-03-30T12:21:54.689 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd_default_features", 2024-03-30T12:21:54.689 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd_qos_exclude_ops", 2024-03-30T12:21:54.690 INFO:tasks.workunit.client.0.smithi084.stdout: "setgroup", 2024-03-30T12:21:54.690 INFO:tasks.workunit.client.0.smithi084.stdout: "setuser" 2024-03-30T12:21:54.690 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.690 INFO:tasks.workunit.client.0.smithi084.stdout: "cluster_changed": [ 2024-03-30T12:21:54.690 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_allow_insecure_global_id_reclaim", 2024-03-30T12:21:54.690 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_debug", 2024-03-30T12:21:54.690 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_mon_ticket_ttl", 2024-03-30T12:21:54.690 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_service_ticket_ttl", 2024-03-30T12:21:54.690 INFO:tasks.workunit.client.0.smithi084.stdout: "bdev_debug_aio", 2024-03-30T12:21:54.690 INFO:tasks.workunit.client.0.smithi084.stdout: "container_image", 2024-03-30T12:21:54.690 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_asserts_on_shutdown", 2024-03-30T12:21:54.690 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mgr", 2024-03-30T12:21:54.690 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mon", 2024-03-30T12:21:54.690 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_ms", 2024-03-30T12:21:54.690 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_osd", 2024-03-30T12:21:54.690 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_paxos", 2024-03-30T12:21:54.691 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_file", 2024-03-30T12:21:54.691 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_journald", 2024-03-30T12:21:54.691 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_stderr", 2024-03-30T12:21:54.691 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_join_fs", 2024-03-30T12:21:54.691 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/allow_ptrace", 2024-03-30T12:21:54.691 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/container_init", 2024-03-30T12:21:54.691 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/migration_current", 2024-03-30T12:21:54.691 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/use_repo_digest", 2024-03-30T12:21:54.691 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/ALERTMANAGER_API_HOST", 2024-03-30T12:21:54.691 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/GRAFANA_API_SSL_VERIFY", 2024-03-30T12:21:54.691 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/GRAFANA_API_URL", 2024-03-30T12:21:54.691 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/PROMETHEUS_API_HOST", 2024-03-30T12:21:54.691 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/ssl_server_port", 2024-03-30T12:21:54.691 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/orchestrator/orchestrator", 2024-03-30T12:21:54.691 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/channel_ident", 2024-03-30T12:21:54.692 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/description", 2024-03-30T12:21:54.692 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/organization", 2024-03-30T12:21:54.692 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_allow_pool_delete", 2024-03-30T12:21:54.692 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_clock_drift_allowed", 2024-03-30T12:21:54.692 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_file_level", 2024-03-30T12:21:54.692 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_file", 2024-03-30T12:21:54.692 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_data_avail_warn", 2024-03-30T12:21:54.692 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_election_default_strategy", 2024-03-30T12:21:54.692 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_max_pg_per_osd", 2024-03-30T12:21:54.692 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_mgr_mkfs_grace", 2024-03-30T12:21:54.692 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_prime_pg_temp", 2024-03-30T12:21:54.692 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_reporter_subtree_level", 2024-03-30T12:21:54.692 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_pg_warn_max_object_skew", 2024-03-30T12:21:54.692 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_bytes_per_osd", 2024-03-30T12:21:54.693 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_pgs_per_osd", 2024-03-30T12:21:54.693 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-03-30T12:21:54.693 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-03-30T12:21:54.693 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-03-30T12:21:54.693 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_legacy_crush_tunables", 2024-03-30T12:21:54.693 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-03-30T12:21:54.693 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-03-30T12:21:54.693 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_too_few_osds", 2024-03-30T12:21:54.693 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_bug", 2024-03-30T12:21:54.693 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_old_message", 2024-03-30T12:21:54.693 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_default_list", 2024-03-30T12:21:54.693 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_load_list", 2024-03-30T12:21:54.693 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_misdirected_ops", 2024-03-30T12:21:54.693 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_op_order", 2024-03-30T12:21:54.693 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_pg_log_writeout", 2024-03-30T12:21:54.693 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_shutdown", 2024-03-30T12:21:54.694 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_cached_snaps", 2024-03-30T12:21:54.694 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_missing_on_start", 2024-03-30T12:21:54.694 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_stray_on_activate", 2024-03-30T12:21:54.694 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_deep_scrub_update_digest_min_age", 2024-03-30T12:21:54.694 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_max_capacity_iops_ssd", 2024-03-30T12:21:54.694 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_profile", 2024-03-30T12:21:54.694 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target", 2024-03-30T12:21:54.694 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target_autotune", 2024-03-30T12:21:54.694 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue", 2024-03-30T12:21:54.694 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue_cut_off", 2024-03-30T12:21:54.694 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_erasure_code_profile", 2024-03-30T12:21:54.694 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_pg_autoscale_mode", 2024-03-30T12:21:54.694 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recover_clone_overlap", 2024-03-30T12:21:54.694 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_chunk", 2024-03-30T12:21:54.694 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_load_threshold", 2024-03-30T12:21:54.695 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_max_interval", 2024-03-30T12:21:54.695 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_shutdown_pgref_assert", 2024-03-30T12:21:54.695 INFO:tasks.workunit.client.0.smithi084.stdout: "public_network", 2024-03-30T12:21:54.695 INFO:tasks.workunit.client.0.smithi084.stdout: "rgw_cache_enabled", 2024-03-30T12:21:54.695 INFO:tasks.workunit.client.0.smithi084.stdout: "rgw_enable_ops_log", 2024-03-30T12:21:54.695 INFO:tasks.workunit.client.0.smithi084.stdout: "rgw_enable_usage_log" 2024-03-30T12:21:54.695 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:54.695 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.695 INFO:tasks.workunit.client.0.smithi084.stdout: "contact": null, 2024-03-30T12:21:54.695 INFO:tasks.workunit.client.0.smithi084.stdout: "crashes": [], 2024-03-30T12:21:54.695 INFO:tasks.workunit.client.0.smithi084.stdout: "created": "2024-03-30T12:13:26.814055Z", 2024-03-30T12:21:54.695 INFO:tasks.workunit.client.0.smithi084.stdout: "crush": { 2024-03-30T12:21:54.695 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket_algs": { 2024-03-30T12:21:54.695 INFO:tasks.workunit.client.0.smithi084.stdout: "straw2": 3 2024-03-30T12:21:54.695 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.695 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket_sizes": { 2024-03-30T12:21:54.696 INFO:tasks.workunit.client.0.smithi084.stdout: "2": 1, 2024-03-30T12:21:54.696 INFO:tasks.workunit.client.0.smithi084.stdout: "4": 2 2024-03-30T12:21:54.696 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.696 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket_types": { 2024-03-30T12:21:54.696 INFO:tasks.workunit.client.0.smithi084.stdout: "1": 2, 2024-03-30T12:21:54.696 INFO:tasks.workunit.client.0.smithi084.stdout: "11": 1 2024-03-30T12:21:54.696 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.696 INFO:tasks.workunit.client.0.smithi084.stdout: "compat_weight_set": false, 2024-03-30T12:21:54.696 INFO:tasks.workunit.client.0.smithi084.stdout: "device_classes": [ 2024-03-30T12:21:54.696 INFO:tasks.workunit.client.0.smithi084.stdout: 8 2024-03-30T12:21:54.696 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_buckets": 6, 2024-03-30T12:21:54.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_devices": 8, 2024-03-30T12:21:54.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_rules": 1, 2024-03-30T12:21:54.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_types": 12, 2024-03-30T12:21:54.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_weight_sets": 0, 2024-03-30T12:21:54.697 INFO:tasks.workunit.client.0.smithi084.stdout: "tunables": { 2024-03-30T12:21:54.697 INFO:tasks.workunit.client.0.smithi084.stdout: "allowed_bucket_algs": 54, 2024-03-30T12:21:54.697 INFO:tasks.workunit.client.0.smithi084.stdout: "choose_local_fallback_tries": 0, 2024-03-30T12:21:54.697 INFO:tasks.workunit.client.0.smithi084.stdout: "choose_local_tries": 0, 2024-03-30T12:21:54.697 INFO:tasks.workunit.client.0.smithi084.stdout: "choose_total_tries": 50, 2024-03-30T12:21:54.697 INFO:tasks.workunit.client.0.smithi084.stdout: "chooseleaf_descend_once": 1, 2024-03-30T12:21:54.697 INFO:tasks.workunit.client.0.smithi084.stdout: "chooseleaf_stable": 1, 2024-03-30T12:21:54.697 INFO:tasks.workunit.client.0.smithi084.stdout: "chooseleaf_vary_r": 1, 2024-03-30T12:21:54.697 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v2_rules": 0, 2024-03-30T12:21:54.697 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v3_rules": 0, 2024-03-30T12:21:54.697 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v4_buckets": 1, 2024-03-30T12:21:54.697 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v5_rules": 0, 2024-03-30T12:21:54.697 INFO:tasks.workunit.client.0.smithi084.stdout: "legacy_tunables": 0, 2024-03-30T12:21:54.697 INFO:tasks.workunit.client.0.smithi084.stdout: "minimum_required_version": "jewel", 2024-03-30T12:21:54.697 INFO:tasks.workunit.client.0.smithi084.stdout: "optimal_tunables": 1, 2024-03-30T12:21:54.697 INFO:tasks.workunit.client.0.smithi084.stdout: "profile": "jewel", 2024-03-30T12:21:54.697 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables": 1, 2024-03-30T12:21:54.698 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables2": 1, 2024-03-30T12:21:54.698 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables3": 1, 2024-03-30T12:21:54.698 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables5": 1, 2024-03-30T12:21:54.698 INFO:tasks.workunit.client.0.smithi084.stdout: "straw_calc_version": 1 2024-03-30T12:21:54.698 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.698 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.698 INFO:tasks.workunit.client.0.smithi084.stdout: "description": "upgrade test cluster", 2024-03-30T12:21:54.698 INFO:tasks.workunit.client.0.smithi084.stdout: "fs": { 2024-03-30T12:21:54.698 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:54.698 INFO:tasks.workunit.client.0.smithi084.stdout: "feature_flags": { 2024-03-30T12:21:54.698 INFO:tasks.workunit.client.0.smithi084.stdout: "enable_multiple": true, 2024-03-30T12:21:54.698 INFO:tasks.workunit.client.0.smithi084.stdout: "ever_enabled_multiple": true 2024-03-30T12:21:54.698 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.698 INFO:tasks.workunit.client.0.smithi084.stdout: "filesystems": [ 2024-03-30T12:21:54.699 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:54.699 INFO:tasks.workunit.client.0.smithi084.stdout: "approx_ctime": "2024-03", 2024-03-30T12:21:54.699 INFO:tasks.workunit.client.0.smithi084.stdout: "balancer_enabled": false, 2024-03-30T12:21:54.699 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:54.699 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_caps": 0, 2024-03-30T12:21:54.699 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_dns": 10, 2024-03-30T12:21:54.699 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_inos": 13, 2024-03-30T12:21:54.699 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_subtrees": 2, 2024-03-30T12:21:54.699 INFO:tasks.workunit.client.0.smithi084.stdout: "ever_allowed_features": 0, 2024-03-30T12:21:54.699 INFO:tasks.workunit.client.0.smithi084.stdout: "explicitly_allowed_features": 0, 2024-03-30T12:21:54.699 INFO:tasks.workunit.client.0.smithi084.stdout: "files": 0, 2024-03-30T12:21:54.699 INFO:tasks.workunit.client.0.smithi084.stdout: "max_mds": 1, 2024-03-30T12:21:54.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_data_pools": 1, 2024-03-30T12:21:54.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_in": 1, 2024-03-30T12:21:54.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_mds": 1, 2024-03-30T12:21:54.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_sessions": 0, 2024-03-30T12:21:54.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_standby_replay": 0, 2024-03-30T12:21:54.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_up": 1, 2024-03-30T12:21:54.700 INFO:tasks.workunit.client.0.smithi084.stdout: "snaps": 0, 2024-03-30T12:21:54.700 INFO:tasks.workunit.client.0.smithi084.stdout: "standby_count_wanted": 0 2024-03-30T12:21:54.700 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.700 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_standby_mds": 1, 2024-03-30T12:21:54.700 INFO:tasks.workunit.client.0.smithi084.stdout: "total_num_mds": 2 2024-03-30T12:21:54.700 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.700 INFO:tasks.workunit.client.0.smithi084.stdout: "hosts": { 2024-03-30T12:21:54.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num": 2, 2024-03-30T12:21:54.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_mds": 2, 2024-03-30T12:21:54.700 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_mgr": 2, 2024-03-30T12:21:54.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_mon": 2, 2024-03-30T12:21:54.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_osd": 2 2024-03-30T12:21:54.701 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.701 INFO:tasks.workunit.client.0.smithi084.stdout: "leaderboard": false, 2024-03-30T12:21:54.701 INFO:tasks.workunit.client.0.smithi084.stdout: "leaderboard_description": null, 2024-03-30T12:21:54.701 INFO:tasks.workunit.client.0.smithi084.stdout: "license": "sharing-1-0", 2024-03-30T12:21:54.701 INFO:tasks.workunit.client.0.smithi084.stdout: "metadata": { 2024-03-30T12:21:54.701 INFO:tasks.workunit.client.0.smithi084.stdout: "mds": { 2024-03-30T12:21:54.701 INFO:tasks.workunit.client.0.smithi084.stdout: "arch": { 2024-03-30T12:21:54.701 INFO:tasks.workunit.client.0.smithi084.stdout: "x86_64": 2 2024-03-30T12:21:54.701 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.701 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_version": { 2024-03-30T12:21:54.701 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 2 2024-03-30T12:21:54.701 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.701 INFO:tasks.workunit.client.0.smithi084.stdout: "cpu": { 2024-03-30T12:21:54.702 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 2 2024-03-30T12:21:54.702 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.702 INFO:tasks.workunit.client.0.smithi084.stdout: "distro": { 2024-03-30T12:21:54.702 INFO:tasks.workunit.client.0.smithi084.stdout: "centos": 2 2024-03-30T12:21:54.702 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.702 INFO:tasks.workunit.client.0.smithi084.stdout: "distro_description": { 2024-03-30T12:21:54.702 INFO:tasks.workunit.client.0.smithi084.stdout: "CentOS Stream 8": 2 2024-03-30T12:21:54.702 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.702 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_description": { 2024-03-30T12:21:54.702 INFO:tasks.workunit.client.0.smithi084.stdout: "#1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024": 2 2024-03-30T12:21:54.702 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.702 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_version": { 2024-03-30T12:21:54.702 INFO:tasks.workunit.client.0.smithi084.stdout: "5.14.0-434.el9.x86_64": 2 2024-03-30T12:21:54.703 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.703 INFO:tasks.workunit.client.0.smithi084.stdout: "os": { 2024-03-30T12:21:54.703 INFO:tasks.workunit.client.0.smithi084.stdout: "Linux": 2 2024-03-30T12:21:54.703 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.703 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.703 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-03-30T12:21:54.703 INFO:tasks.workunit.client.0.smithi084.stdout: "arch": { 2024-03-30T12:21:54.703 INFO:tasks.workunit.client.0.smithi084.stdout: "x86_64": 3 2024-03-30T12:21:54.703 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.703 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_version": { 2024-03-30T12:21:54.703 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 3 2024-03-30T12:21:54.703 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.703 INFO:tasks.workunit.client.0.smithi084.stdout: "cpu": { 2024-03-30T12:21:54.703 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 3 2024-03-30T12:21:54.703 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.704 INFO:tasks.workunit.client.0.smithi084.stdout: "distro": { 2024-03-30T12:21:54.704 INFO:tasks.workunit.client.0.smithi084.stdout: "centos": 3 2024-03-30T12:21:54.704 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.704 INFO:tasks.workunit.client.0.smithi084.stdout: "distro_description": { 2024-03-30T12:21:54.704 INFO:tasks.workunit.client.0.smithi084.stdout: "CentOS Stream 8": 3 2024-03-30T12:21:54.704 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.704 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_description": { 2024-03-30T12:21:54.704 INFO:tasks.workunit.client.0.smithi084.stdout: "#1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024": 3 2024-03-30T12:21:54.704 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.704 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_version": { 2024-03-30T12:21:54.704 INFO:tasks.workunit.client.0.smithi084.stdout: "5.14.0-434.el9.x86_64": 3 2024-03-30T12:21:54.704 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.704 INFO:tasks.workunit.client.0.smithi084.stdout: "os": { 2024-03-30T12:21:54.704 INFO:tasks.workunit.client.0.smithi084.stdout: "Linux": 3 2024-03-30T12:21:54.704 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.705 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.705 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:54.705 INFO:tasks.workunit.client.0.smithi084.stdout: "arch": { 2024-03-30T12:21:54.705 INFO:tasks.workunit.client.0.smithi084.stdout: "x86_64": 8 2024-03-30T12:21:54.705 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.705 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_version": { 2024-03-30T12:21:54.705 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 8 2024-03-30T12:21:54.705 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.705 INFO:tasks.workunit.client.0.smithi084.stdout: "cpu": { 2024-03-30T12:21:54.705 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 8 2024-03-30T12:21:54.705 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.705 INFO:tasks.workunit.client.0.smithi084.stdout: "distro": { 2024-03-30T12:21:54.705 INFO:tasks.workunit.client.0.smithi084.stdout: "centos": 8 2024-03-30T12:21:54.705 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.705 INFO:tasks.workunit.client.0.smithi084.stdout: "distro_description": { 2024-03-30T12:21:54.706 INFO:tasks.workunit.client.0.smithi084.stdout: "CentOS Stream 8": 8 2024-03-30T12:21:54.706 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.706 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_description": { 2024-03-30T12:21:54.706 INFO:tasks.workunit.client.0.smithi084.stdout: "#1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024": 8 2024-03-30T12:21:54.706 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.706 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_version": { 2024-03-30T12:21:54.706 INFO:tasks.workunit.client.0.smithi084.stdout: "5.14.0-434.el9.x86_64": 8 2024-03-30T12:21:54.706 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.706 INFO:tasks.workunit.client.0.smithi084.stdout: "os": { 2024-03-30T12:21:54.706 INFO:tasks.workunit.client.0.smithi084.stdout: "Linux": 8 2024-03-30T12:21:54.706 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.706 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_objectstore": { 2024-03-30T12:21:54.706 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": 8 2024-03-30T12:21:54.706 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.706 INFO:tasks.workunit.client.0.smithi084.stdout: "rotational": { 2024-03-30T12:21:54.707 INFO:tasks.workunit.client.0.smithi084.stdout: "0": 8 2024-03-30T12:21:54.707 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.707 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.707 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.707 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-03-30T12:21:54.707 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-03-30T12:21:54.707 INFO:tasks.workunit.client.0.smithi084.stdout: "features": { 2024-03-30T12:21:54.707 INFO:tasks.workunit.client.0.smithi084.stdout: "optional": [], 2024-03-30T12:21:54.707 INFO:tasks.workunit.client.0.smithi084.stdout: "persistent": [ 2024-03-30T12:21:54.707 INFO:tasks.workunit.client.0.smithi084.stdout: "kraken", 2024-03-30T12:21:54.707 INFO:tasks.workunit.client.0.smithi084.stdout: "luminous", 2024-03-30T12:21:54.707 INFO:tasks.workunit.client.0.smithi084.stdout: "mimic", 2024-03-30T12:21:54.707 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap-prune", 2024-03-30T12:21:54.707 INFO:tasks.workunit.client.0.smithi084.stdout: "nautilus", 2024-03-30T12:21:54.707 INFO:tasks.workunit.client.0.smithi084.stdout: "octopus", 2024-03-30T12:21:54.707 INFO:tasks.workunit.client.0.smithi084.stdout: "pacific", 2024-03-30T12:21:54.708 INFO:tasks.workunit.client.0.smithi084.stdout: "elector-pinging", 2024-03-30T12:21:54.708 INFO:tasks.workunit.client.0.smithi084.stdout: "quincy", 2024-03-30T12:21:54.708 INFO:tasks.workunit.client.0.smithi084.stdout: "reef" 2024-03-30T12:21:54.708 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:54.708 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.708 INFO:tasks.workunit.client.0.smithi084.stdout: "ipv4_addr_mons": 6, 2024-03-30T12:21:54.708 INFO:tasks.workunit.client.0.smithi084.stdout: "ipv6_addr_mons": 0, 2024-03-30T12:21:54.708 INFO:tasks.workunit.client.0.smithi084.stdout: "min_mon_release": 18, 2024-03-30T12:21:54.708 INFO:tasks.workunit.client.0.smithi084.stdout: "v1_addr_mons": 3, 2024-03-30T12:21:54.708 INFO:tasks.workunit.client.0.smithi084.stdout: "v2_addr_mons": 3 2024-03-30T12:21:54.708 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.708 INFO:tasks.workunit.client.0.smithi084.stdout: "organization": "ceph-qa", 2024-03-30T12:21:54.708 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:54.708 INFO:tasks.workunit.client.0.smithi084.stdout: "cluster_network": false, 2024-03-30T12:21:54.708 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 8, 2024-03-30T12:21:54.708 INFO:tasks.workunit.client.0.smithi084.stdout: "require_min_compat_client": "luminous", 2024-03-30T12:21:54.709 INFO:tasks.workunit.client.0.smithi084.stdout: "require_osd_release": "reef" 2024-03-30T12:21:54.709 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.709 INFO:tasks.workunit.client.0.smithi084.stdout: "pools": [ 2024-03-30T12:21:54.709 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:54.709 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-03-30T12:21:54.709 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr" 2024-03-30T12:21:54.709 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.709 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-03-30T12:21:54.709 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-03-30T12:21:54.709 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-03-30T12:21:54.709 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-03-30T12:21:54.709 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-03-30T12:21:54.709 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 1, 2024-03-30T12:21:54.709 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 1, 2024-03-30T12:21:54.709 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 1, 2024-03-30T12:21:54.709 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-03-30T12:21:54.709 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-03-30T12:21:54.710 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 729296873738, 2024-03-30T12:21:54.710 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 1781760, 2024-03-30T12:21:54.710 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-03-30T12:21:54.710 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-03-30T12:21:54.710 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 1781760, 2024-03-30T12:21:54.710 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-03-30T12:21:54.710 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 243098959872, 2024-03-30T12:21:54.710 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 2, 2024-03-30T12:21:54.710 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-03-30T12:21:54.710 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 2.443114453853923e-06, 2024-03-30T12:21:54.710 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-03-30T12:21:54.710 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-03-30T12:21:54.710 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 212, 2024-03-30T12:21:54.710 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 313344, 2024-03-30T12:21:54.711 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 590368, 2024-03-30T12:21:54.711 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 590368, 2024-03-30T12:21:54.711 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-03-30T12:21:54.711 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 1771104, 2024-03-30T12:21:54.711 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 179, 2024-03-30T12:21:54.711 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 2473984 2024-03-30T12:21:54.711 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.711 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-03-30T12:21:54.711 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-03-30T12:21:54.711 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-03-30T12:21:54.711 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.711 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:54.711 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-03-30T12:21:54.711 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs" 2024-03-30T12:21:54.712 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.712 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-03-30T12:21:54.712 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-03-30T12:21:54.712 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-03-30T12:21:54.712 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-03-30T12:21:54.712 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-03-30T12:21:54.712 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 32, 2024-03-30T12:21:54.712 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 32, 2024-03-30T12:21:54.712 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 2, 2024-03-30T12:21:54.712 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-03-30T12:21:54.712 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-03-30T12:21:54.712 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 729296873738, 2024-03-30T12:21:54.712 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 98304, 2024-03-30T12:21:54.712 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-03-30T12:21:54.713 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-03-30T12:21:54.713 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 98304, 2024-03-30T12:21:54.713 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-03-30T12:21:54.713 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 243098959872, 2024-03-30T12:21:54.713 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 22, 2024-03-30T12:21:54.713 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-03-30T12:21:54.713 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 1.3479282756634348e-07, 2024-03-30T12:21:54.713 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-03-30T12:21:54.713 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-03-30T12:21:54.713 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 0, 2024-03-30T12:21:54.713 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 0, 2024-03-30T12:21:54.713 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 3430, 2024-03-30T12:21:54.713 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 3430, 2024-03-30T12:21:54.713 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-03-30T12:21:54.713 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 10290, 2024-03-30T12:21:54.713 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 51, 2024-03-30T12:21:54.714 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 20480 2024-03-30T12:21:54.714 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.714 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-03-30T12:21:54.714 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-03-30T12:21:54.714 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-03-30T12:21:54.714 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.714 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:54.714 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-03-30T12:21:54.714 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs" 2024-03-30T12:21:54.714 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.714 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-03-30T12:21:54.714 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-03-30T12:21:54.714 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-03-30T12:21:54.714 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-03-30T12:21:54.714 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-03-30T12:21:54.715 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 64, 2024-03-30T12:21:54.715 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 64, 2024-03-30T12:21:54.715 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 3, 2024-03-30T12:21:54.715 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-03-30T12:21:54.715 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-03-30T12:21:54.715 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 729296873738, 2024-03-30T12:21:54.715 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 0, 2024-03-30T12:21:54.715 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-03-30T12:21:54.715 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-03-30T12:21:54.715 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 0, 2024-03-30T12:21:54.715 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-03-30T12:21:54.715 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 243098959872, 2024-03-30T12:21:54.715 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 0, 2024-03-30T12:21:54.715 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-03-30T12:21:54.715 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 0.0, 2024-03-30T12:21:54.715 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-03-30T12:21:54.716 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-03-30T12:21:54.716 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 0, 2024-03-30T12:21:54.716 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 0, 2024-03-30T12:21:54.716 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 0, 2024-03-30T12:21:54.716 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 0, 2024-03-30T12:21:54.716 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-03-30T12:21:54.716 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 0, 2024-03-30T12:21:54.716 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 0, 2024-03-30T12:21:54.716 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 0 2024-03-30T12:21:54.716 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.716 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-03-30T12:21:54.716 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-03-30T12:21:54.716 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-03-30T12:21:54.716 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.716 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:54.716 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-03-30T12:21:54.717 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd" 2024-03-30T12:21:54.717 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.717 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-03-30T12:21:54.717 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-03-30T12:21:54.717 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-03-30T12:21:54.717 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-03-30T12:21:54.717 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-03-30T12:21:54.717 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 8, 2024-03-30T12:21:54.717 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 8, 2024-03-30T12:21:54.717 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 4, 2024-03-30T12:21:54.717 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-03-30T12:21:54.717 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-03-30T12:21:54.717 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 729296873738, 2024-03-30T12:21:54.717 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 0, 2024-03-30T12:21:54.717 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-03-30T12:21:54.717 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-03-30T12:21:54.718 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 0, 2024-03-30T12:21:54.718 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-03-30T12:21:54.718 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 243098959872, 2024-03-30T12:21:54.718 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 0, 2024-03-30T12:21:54.718 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-03-30T12:21:54.718 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 0.0, 2024-03-30T12:21:54.718 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-03-30T12:21:54.718 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-03-30T12:21:54.718 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 0, 2024-03-30T12:21:54.718 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 0, 2024-03-30T12:21:54.718 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 0, 2024-03-30T12:21:54.718 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 0, 2024-03-30T12:21:54.718 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-03-30T12:21:54.718 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 0, 2024-03-30T12:21:54.718 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 0, 2024-03-30T12:21:54.719 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 0 2024-03-30T12:21:54.719 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.719 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-03-30T12:21:54.719 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-03-30T12:21:54.719 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-03-30T12:21:54.719 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.719 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.719 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd": { 2024-03-30T12:21:54.719 INFO:tasks.workunit.client.0.smithi084.stdout: "mirroring_by_pool": [ 2024-03-30T12:21:54.719 INFO:tasks.workunit.client.0.smithi084.stdout: false 2024-03-30T12:21:54.719 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_images_by_pool": [ 2024-03-30T12:21:54.719 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:54.719 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:54.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_pools": 1 2024-03-30T12:21:54.719 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.719 INFO:tasks.workunit.client.0.smithi084.stdout: "report_id": "d6359e11-7dd4-498e-a35d-38ff58e2b1dc", 2024-03-30T12:21:54.720 INFO:tasks.workunit.client.0.smithi084.stdout: "report_timestamp": "2024-03-30T12:21:54.637068", 2024-03-30T12:21:54.720 INFO:tasks.workunit.client.0.smithi084.stdout: "report_version": 1, 2024-03-30T12:21:54.720 INFO:tasks.workunit.client.0.smithi084.stdout: "rook": { 2024-03-30T12:21:54.720 INFO:tasks.workunit.client.0.smithi084.stdout: "cluster": { 2024-03-30T12:21:54.720 INFO:tasks.workunit.client.0.smithi084.stdout: "external-mode": null, 2024-03-30T12:21:54.720 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-03-30T12:21:54.720 INFO:tasks.workunit.client.0.smithi084.stdout: "allow-multiple-per-node": null, 2024-03-30T12:21:54.720 INFO:tasks.workunit.client.0.smithi084.stdout: "count": null, 2024-03-30T12:21:54.720 INFO:tasks.workunit.client.0.smithi084.stdout: "max-id": null, 2024-03-30T12:21:54.720 INFO:tasks.workunit.client.0.smithi084.stdout: "pvc": { 2024-03-30T12:21:54.720 INFO:tasks.workunit.client.0.smithi084.stdout: "enabled": null 2024-03-30T12:21:54.720 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.720 INFO:tasks.workunit.client.0.smithi084.stdout: "stretch": { 2024-03-30T12:21:54.720 INFO:tasks.workunit.client.0.smithi084.stdout: "enabled": null 2024-03-30T12:21:54.720 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.720 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.721 INFO:tasks.workunit.client.0.smithi084.stdout: "network": { 2024-03-30T12:21:54.721 INFO:tasks.workunit.client.0.smithi084.stdout: "provider": null 2024-03-30T12:21:54.721 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.721 INFO:tasks.workunit.client.0.smithi084.stdout: "storage": { 2024-03-30T12:21:54.721 INFO:tasks.workunit.client.0.smithi084.stdout: "device-set": { 2024-03-30T12:21:54.721 INFO:tasks.workunit.client.0.smithi084.stdout: "count": { 2024-03-30T12:21:54.721 INFO:tasks.workunit.client.0.smithi084.stdout: "non-portable": null, 2024-03-30T12:21:54.721 INFO:tasks.workunit.client.0.smithi084.stdout: "portable": null, 2024-03-30T12:21:54.721 INFO:tasks.workunit.client.0.smithi084.stdout: "total": null 2024-03-30T12:21:54.721 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.721 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.721 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.721 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.721 INFO:tasks.workunit.client.0.smithi084.stdout: "csi": { 2024-03-30T12:21:54.721 INFO:tasks.workunit.client.0.smithi084.stdout: "version": null 2024-03-30T12:21:54.722 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.722 INFO:tasks.workunit.client.0.smithi084.stdout: "kubernetes": { 2024-03-30T12:21:54.722 INFO:tasks.workunit.client.0.smithi084.stdout: "version": null 2024-03-30T12:21:54.722 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.722 INFO:tasks.workunit.client.0.smithi084.stdout: "node": { 2024-03-30T12:21:54.722 INFO:tasks.workunit.client.0.smithi084.stdout: "count": { 2024-03-30T12:21:54.722 INFO:tasks.workunit.client.0.smithi084.stdout: "kubernetes-total": null, 2024-03-30T12:21:54.722 INFO:tasks.workunit.client.0.smithi084.stdout: "with-ceph-daemons": null, 2024-03-30T12:21:54.722 INFO:tasks.workunit.client.0.smithi084.stdout: "with-csi-cephfs-plugin": null, 2024-03-30T12:21:54.722 INFO:tasks.workunit.client.0.smithi084.stdout: "with-csi-nfs-plugin": null, 2024-03-30T12:21:54.722 INFO:tasks.workunit.client.0.smithi084.stdout: "with-csi-rbd-plugin": null 2024-03-30T12:21:54.723 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.723 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.723 INFO:tasks.workunit.client.0.smithi084.stdout: "usage": { 2024-03-30T12:21:54.723 INFO:tasks.workunit.client.0.smithi084.stdout: "storage-class": { 2024-03-30T12:21:54.723 INFO:tasks.workunit.client.0.smithi084.stdout: "count": { 2024-03-30T12:21:54.723 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket": null, 2024-03-30T12:21:54.723 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs": null, 2024-03-30T12:21:54.723 INFO:tasks.workunit.client.0.smithi084.stdout: "nfs": null, 2024-03-30T12:21:54.723 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd": null, 2024-03-30T12:21:54.723 INFO:tasks.workunit.client.0.smithi084.stdout: "total": null 2024-03-30T12:21:54.723 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.723 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.723 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.723 INFO:tasks.workunit.client.0.smithi084.stdout: "version": null 2024-03-30T12:21:54.724 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.724 INFO:tasks.workunit.client.0.smithi084.stdout: "services": {}, 2024-03-30T12:21:54.724 INFO:tasks.workunit.client.0.smithi084.stdout: "usage": { 2024-03-30T12:21:54.724 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 105, 2024-03-30T12:21:54.724 INFO:tasks.workunit.client.0.smithi084.stdout: "pools": 4, 2024-03-30T12:21:54.724 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_by_class": { 2024-03-30T12:21:54.724 INFO:tasks.workunit.client.0.smithi084.stdout: "ssd": { 2024-03-30T12:21:54.724 INFO:tasks.workunit.client.0.smithi084.stdout: "total_avail_bytes": 767710539776, 2024-03-30T12:21:54.724 INFO:tasks.workunit.client.0.smithi084.stdout: "total_bytes": 767960285184, 2024-03-30T12:21:54.724 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_bytes": 249745408, 2024-03-30T12:21:54.724 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_raw_bytes": 249745408, 2024-03-30T12:21:54.724 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_raw_ratio": 0.0003252061433158815 2024-03-30T12:21:54.724 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.724 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:54.724 INFO:tasks.workunit.client.0.smithi084.stdout: "total_avail_bytes": 767710539776, 2024-03-30T12:21:54.724 INFO:tasks.workunit.client.0.smithi084.stdout: "total_bytes": 767960285184, 2024-03-30T12:21:54.725 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_bytes": 249745408 2024-03-30T12:21:54.725 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.725 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:54.725 INFO:tasks.workunit.client.0.smithi084.stdout:} 2024-03-30T12:21:54.725 INFO:tasks.workunit.client.0.smithi084.stderr:++ ceph telemetry collection ls 2024-03-30T12:21:55.139 INFO:tasks.workunit.client.0.smithi084.stderr:+ COLLECTIONS='New collections are available: 2024-03-30T12:21:55.139 INFO:tasks.workunit.client.0.smithi084.stderr:['\''basic_base'\'', '\''basic_mds_metadata'\'', '\''basic_pool_options_bluestore'\'', '\''basic_pool_usage'\'', '\''basic_rook_v01'\'', '\''basic_usage_by_class'\'', '\''crash_base'\'', '\''device_base'\'', '\''ident_base'\'', '\''perf_memory_metrics'\'', '\''perf_perf'\''] 2024-03-30T12:21:55.139 INFO:tasks.workunit.client.0.smithi084.stderr:Run `ceph telemetry on` to opt-in to these collections. 2024-03-30T12:21:55.139 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-03-30T12:21:55.139 INFO:tasks.workunit.client.0.smithi084.stderr:NAME STATUS DESC 2024-03-30T12:21:55.140 INFO:tasks.workunit.client.0.smithi084.stderr:basic_base NOT REPORTING: NOT OPTED-IN Basic information about the cluster (capacity, number and type of daemons, version, etc.) 2024-03-30T12:21:55.140 INFO:tasks.workunit.client.0.smithi084.stderr:basic_mds_metadata NOT REPORTING: NOT OPTED-IN MDS metadata 2024-03-30T12:21:55.140 INFO:tasks.workunit.client.0.smithi084.stderr:basic_pool_options_bluestore NOT REPORTING: NOT OPTED-IN Per-pool bluestore config options 2024-03-30T12:21:55.140 INFO:tasks.workunit.client.0.smithi084.stderr:basic_pool_usage NOT REPORTING: NOT OPTED-IN Default pool application and usage statistics 2024-03-30T12:21:55.140 INFO:tasks.workunit.client.0.smithi084.stderr:basic_rook_v01 NOT REPORTING: NOT OPTED-IN Basic Rook deployment data 2024-03-30T12:21:55.140 INFO:tasks.workunit.client.0.smithi084.stderr:basic_usage_by_class NOT REPORTING: NOT OPTED-IN Default device class usage statistics 2024-03-30T12:21:55.140 INFO:tasks.workunit.client.0.smithi084.stderr:crash_base NOT REPORTING: NOT OPTED-IN Information about daemon crashes (daemon type and version, backtrace, etc.) 2024-03-30T12:21:55.140 INFO:tasks.workunit.client.0.smithi084.stderr:device_base NOT REPORTING: NOT OPTED-IN Information about device health metrics 2024-03-30T12:21:55.140 INFO:tasks.workunit.client.0.smithi084.stderr:ident_base NOT REPORTING: NOT OPTED-IN User-provided identifying information about the cluster 2024-03-30T12:21:55.140 INFO:tasks.workunit.client.0.smithi084.stderr:perf_memory_metrics NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Heap stats and mempools for mon and mds 2024-03-30T12:21:55.140 INFO:tasks.workunit.client.0.smithi084.stderr:perf_perf NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Information about performance counters of the cluster ' 2024-03-30T12:21:55.140 INFO:tasks.workunit.client.0.smithi084.stderr:+ NEW_COLLECTIONS=("perf_perf" "basic_mds_metadata" "basic_pool_usage" "basic_rook_v01" "perf_memory_metrics") 2024-03-30T12:21:55.140 INFO:tasks.workunit.client.0.smithi084.stderr:+ for col in ${NEW_COLLECTIONS[@]} 2024-03-30T12:21:55.140 INFO:tasks.workunit.client.0.smithi084.stderr:+ [[ New collections are available: 2024-03-30T12:21:55.141 INFO:tasks.workunit.client.0.smithi084.stderr:['basic_base', 'basic_mds_metadata', 'basic_pool_options_bluestore', 'basic_pool_usage', 'basic_rook_v01', 'basic_usage_by_class', 'crash_base', 'device_base', 'ident_base', 'perf_memory_metrics', 'perf_perf'] 2024-03-30T12:21:55.141 INFO:tasks.workunit.client.0.smithi084.stderr:Run `ceph telemetry on` to opt-in to these collections. 2024-03-30T12:21:55.141 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-03-30T12:21:55.141 INFO:tasks.workunit.client.0.smithi084.stderr:NAME STATUS DESC 2024-03-30T12:21:55.141 INFO:tasks.workunit.client.0.smithi084.stderr:basic_base NOT REPORTING: NOT OPTED-IN Basic information about the cluster (capacity, number and type of daemons, version, etc.) 2024-03-30T12:21:55.141 INFO:tasks.workunit.client.0.smithi084.stderr:basic_mds_metadata NOT REPORTING: NOT OPTED-IN MDS metadata 2024-03-30T12:21:55.141 INFO:tasks.workunit.client.0.smithi084.stderr:basic_pool_options_bluestore NOT REPORTING: NOT OPTED-IN Per-pool bluestore config options 2024-03-30T12:21:55.141 INFO:tasks.workunit.client.0.smithi084.stderr:basic_pool_usage NOT REPORTING: NOT OPTED-IN Default pool application and usage statistics 2024-03-30T12:21:55.141 INFO:tasks.workunit.client.0.smithi084.stderr:basic_rook_v01 NOT REPORTING: NOT OPTED-IN Basic Rook deployment data 2024-03-30T12:21:55.141 INFO:tasks.workunit.client.0.smithi084.stderr:basic_usage_by_class NOT REPORTING: NOT OPTED-IN Default device class usage statistics 2024-03-30T12:21:55.141 INFO:tasks.workunit.client.0.smithi084.stderr:crash_base NOT REPORTING: NOT OPTED-IN Information about daemon crashes (daemon type and version, backtrace, etc.) 2024-03-30T12:21:55.141 INFO:tasks.workunit.client.0.smithi084.stderr:device_base NOT REPORTING: NOT OPTED-IN Information about device health metrics 2024-03-30T12:21:55.141 INFO:tasks.workunit.client.0.smithi084.stderr:ident_base NOT REPORTING: NOT OPTED-IN User-provided identifying information about the cluster 2024-03-30T12:21:55.141 INFO:tasks.workunit.client.0.smithi084.stderr:perf_memory_metrics NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Heap stats and mempools for mon and mds 2024-03-30T12:21:55.141 INFO:tasks.workunit.client.0.smithi084.stderr:perf_perf NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Information about performance counters of the cluster == *perf_perf* ]] 2024-03-30T12:21:55.142 INFO:tasks.workunit.client.0.smithi084.stderr:+ for col in ${NEW_COLLECTIONS[@]} 2024-03-30T12:21:55.142 INFO:tasks.workunit.client.0.smithi084.stderr:+ [[ New collections are available: 2024-03-30T12:21:55.142 INFO:tasks.workunit.client.0.smithi084.stderr:['basic_base', 'basic_mds_metadata', 'basic_pool_options_bluestore', 'basic_pool_usage', 'basic_rook_v01', 'basic_usage_by_class', 'crash_base', 'device_base', 'ident_base', 'perf_memory_metrics', 'perf_perf'] 2024-03-30T12:21:55.142 INFO:tasks.workunit.client.0.smithi084.stderr:Run `ceph telemetry on` to opt-in to these collections. 2024-03-30T12:21:55.142 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-03-30T12:21:55.142 INFO:tasks.workunit.client.0.smithi084.stderr:NAME STATUS DESC 2024-03-30T12:21:55.142 INFO:tasks.workunit.client.0.smithi084.stderr:basic_base NOT REPORTING: NOT OPTED-IN Basic information about the cluster (capacity, number and type of daemons, version, etc.) 2024-03-30T12:21:55.142 INFO:tasks.workunit.client.0.smithi084.stderr:basic_mds_metadata NOT REPORTING: NOT OPTED-IN MDS metadata 2024-03-30T12:21:55.142 INFO:tasks.workunit.client.0.smithi084.stderr:basic_pool_options_bluestore NOT REPORTING: NOT OPTED-IN Per-pool bluestore config options 2024-03-30T12:21:55.142 INFO:tasks.workunit.client.0.smithi084.stderr:basic_pool_usage NOT REPORTING: NOT OPTED-IN Default pool application and usage statistics 2024-03-30T12:21:55.142 INFO:tasks.workunit.client.0.smithi084.stderr:basic_rook_v01 NOT REPORTING: NOT OPTED-IN Basic Rook deployment data 2024-03-30T12:21:55.142 INFO:tasks.workunit.client.0.smithi084.stderr:basic_usage_by_class NOT REPORTING: NOT OPTED-IN Default device class usage statistics 2024-03-30T12:21:55.142 INFO:tasks.workunit.client.0.smithi084.stderr:crash_base NOT REPORTING: NOT OPTED-IN Information about daemon crashes (daemon type and version, backtrace, etc.) 2024-03-30T12:21:55.142 INFO:tasks.workunit.client.0.smithi084.stderr:device_base NOT REPORTING: NOT OPTED-IN Information about device health metrics 2024-03-30T12:21:55.143 INFO:tasks.workunit.client.0.smithi084.stderr:ident_base NOT REPORTING: NOT OPTED-IN User-provided identifying information about the cluster 2024-03-30T12:21:55.143 INFO:tasks.workunit.client.0.smithi084.stderr:perf_memory_metrics NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Heap stats and mempools for mon and mds 2024-03-30T12:21:55.143 INFO:tasks.workunit.client.0.smithi084.stderr:perf_perf NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Information about performance counters of the cluster == *basic_mds_metadata* ]] 2024-03-30T12:21:55.143 INFO:tasks.workunit.client.0.smithi084.stderr:+ for col in ${NEW_COLLECTIONS[@]} 2024-03-30T12:21:55.143 INFO:tasks.workunit.client.0.smithi084.stderr:+ [[ New collections are available: 2024-03-30T12:21:55.143 INFO:tasks.workunit.client.0.smithi084.stderr:['basic_base', 'basic_mds_metadata', 'basic_pool_options_bluestore', 'basic_pool_usage', 'basic_rook_v01', 'basic_usage_by_class', 'crash_base', 'device_base', 'ident_base', 'perf_memory_metrics', 'perf_perf'] 2024-03-30T12:21:55.143 INFO:tasks.workunit.client.0.smithi084.stderr:Run `ceph telemetry on` to opt-in to these collections. 2024-03-30T12:21:55.143 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-03-30T12:21:55.143 INFO:tasks.workunit.client.0.smithi084.stderr:NAME STATUS DESC 2024-03-30T12:21:55.143 INFO:tasks.workunit.client.0.smithi084.stderr:basic_base NOT REPORTING: NOT OPTED-IN Basic information about the cluster (capacity, number and type of daemons, version, etc.) 2024-03-30T12:21:55.143 INFO:tasks.workunit.client.0.smithi084.stderr:basic_mds_metadata NOT REPORTING: NOT OPTED-IN MDS metadata 2024-03-30T12:21:55.143 INFO:tasks.workunit.client.0.smithi084.stderr:basic_pool_options_bluestore NOT REPORTING: NOT OPTED-IN Per-pool bluestore config options 2024-03-30T12:21:55.143 INFO:tasks.workunit.client.0.smithi084.stderr:basic_pool_usage NOT REPORTING: NOT OPTED-IN Default pool application and usage statistics 2024-03-30T12:21:55.143 INFO:tasks.workunit.client.0.smithi084.stderr:basic_rook_v01 NOT REPORTING: NOT OPTED-IN Basic Rook deployment data 2024-03-30T12:21:55.143 INFO:tasks.workunit.client.0.smithi084.stderr:basic_usage_by_class NOT REPORTING: NOT OPTED-IN Default device class usage statistics 2024-03-30T12:21:55.144 INFO:tasks.workunit.client.0.smithi084.stderr:crash_base NOT REPORTING: NOT OPTED-IN Information about daemon crashes (daemon type and version, backtrace, etc.) 2024-03-30T12:21:55.144 INFO:tasks.workunit.client.0.smithi084.stderr:device_base NOT REPORTING: NOT OPTED-IN Information about device health metrics 2024-03-30T12:21:55.144 INFO:tasks.workunit.client.0.smithi084.stderr:ident_base NOT REPORTING: NOT OPTED-IN User-provided identifying information about the cluster 2024-03-30T12:21:55.144 INFO:tasks.workunit.client.0.smithi084.stderr:perf_memory_metrics NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Heap stats and mempools for mon and mds 2024-03-30T12:21:55.144 INFO:tasks.workunit.client.0.smithi084.stderr:perf_perf NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Information about performance counters of the cluster == *basic_pool_usage* ]] 2024-03-30T12:21:55.144 INFO:tasks.workunit.client.0.smithi084.stderr:+ for col in ${NEW_COLLECTIONS[@]} 2024-03-30T12:21:55.144 INFO:tasks.workunit.client.0.smithi084.stderr:+ [[ New collections are available: 2024-03-30T12:21:55.144 INFO:tasks.workunit.client.0.smithi084.stderr:['basic_base', 'basic_mds_metadata', 'basic_pool_options_bluestore', 'basic_pool_usage', 'basic_rook_v01', 'basic_usage_by_class', 'crash_base', 'device_base', 'ident_base', 'perf_memory_metrics', 'perf_perf'] 2024-03-30T12:21:55.144 INFO:tasks.workunit.client.0.smithi084.stderr:Run `ceph telemetry on` to opt-in to these collections. 2024-03-30T12:21:55.144 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-03-30T12:21:55.145 INFO:tasks.workunit.client.0.smithi084.stderr:NAME STATUS DESC 2024-03-30T12:21:55.145 INFO:tasks.workunit.client.0.smithi084.stderr:basic_base NOT REPORTING: NOT OPTED-IN Basic information about the cluster (capacity, number and type of daemons, version, etc.) 2024-03-30T12:21:55.145 INFO:tasks.workunit.client.0.smithi084.stderr:basic_mds_metadata NOT REPORTING: NOT OPTED-IN MDS metadata 2024-03-30T12:21:55.145 INFO:tasks.workunit.client.0.smithi084.stderr:basic_pool_options_bluestore NOT REPORTING: NOT OPTED-IN Per-pool bluestore config options 2024-03-30T12:21:55.145 INFO:tasks.workunit.client.0.smithi084.stderr:basic_pool_usage NOT REPORTING: NOT OPTED-IN Default pool application and usage statistics 2024-03-30T12:21:55.145 INFO:tasks.workunit.client.0.smithi084.stderr:basic_rook_v01 NOT REPORTING: NOT OPTED-IN Basic Rook deployment data 2024-03-30T12:21:55.145 INFO:tasks.workunit.client.0.smithi084.stderr:basic_usage_by_class NOT REPORTING: NOT OPTED-IN Default device class usage statistics 2024-03-30T12:21:55.145 INFO:tasks.workunit.client.0.smithi084.stderr:crash_base NOT REPORTING: NOT OPTED-IN Information about daemon crashes (daemon type and version, backtrace, etc.) 2024-03-30T12:21:55.145 INFO:tasks.workunit.client.0.smithi084.stderr:device_base NOT REPORTING: NOT OPTED-IN Information about device health metrics 2024-03-30T12:21:55.145 INFO:tasks.workunit.client.0.smithi084.stderr:ident_base NOT REPORTING: NOT OPTED-IN User-provided identifying information about the cluster 2024-03-30T12:21:55.145 INFO:tasks.workunit.client.0.smithi084.stderr:perf_memory_metrics NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Heap stats and mempools for mon and mds 2024-03-30T12:21:55.145 INFO:tasks.workunit.client.0.smithi084.stderr:perf_perf NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Information about performance counters of the cluster == *basic_rook_v01* ]] 2024-03-30T12:21:55.145 INFO:tasks.workunit.client.0.smithi084.stderr:+ for col in ${NEW_COLLECTIONS[@]} 2024-03-30T12:21:55.145 INFO:tasks.workunit.client.0.smithi084.stderr:+ [[ New collections are available: 2024-03-30T12:21:55.146 INFO:tasks.workunit.client.0.smithi084.stderr:['basic_base', 'basic_mds_metadata', 'basic_pool_options_bluestore', 'basic_pool_usage', 'basic_rook_v01', 'basic_usage_by_class', 'crash_base', 'device_base', 'ident_base', 'perf_memory_metrics', 'perf_perf'] 2024-03-30T12:21:55.146 INFO:tasks.workunit.client.0.smithi084.stderr:Run `ceph telemetry on` to opt-in to these collections. 2024-03-30T12:21:55.146 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-03-30T12:21:55.146 INFO:tasks.workunit.client.0.smithi084.stderr:NAME STATUS DESC 2024-03-30T12:21:55.146 INFO:tasks.workunit.client.0.smithi084.stderr:basic_base NOT REPORTING: NOT OPTED-IN Basic information about the cluster (capacity, number and type of daemons, version, etc.) 2024-03-30T12:21:55.146 INFO:tasks.workunit.client.0.smithi084.stderr:basic_mds_metadata NOT REPORTING: NOT OPTED-IN MDS metadata 2024-03-30T12:21:55.146 INFO:tasks.workunit.client.0.smithi084.stderr:basic_pool_options_bluestore NOT REPORTING: NOT OPTED-IN Per-pool bluestore config options 2024-03-30T12:21:55.146 INFO:tasks.workunit.client.0.smithi084.stderr:basic_pool_usage NOT REPORTING: NOT OPTED-IN Default pool application and usage statistics 2024-03-30T12:21:55.146 INFO:tasks.workunit.client.0.smithi084.stderr:basic_rook_v01 NOT REPORTING: NOT OPTED-IN Basic Rook deployment data 2024-03-30T12:21:55.146 INFO:tasks.workunit.client.0.smithi084.stderr:basic_usage_by_class NOT REPORTING: NOT OPTED-IN Default device class usage statistics 2024-03-30T12:21:55.146 INFO:tasks.workunit.client.0.smithi084.stderr:crash_base NOT REPORTING: NOT OPTED-IN Information about daemon crashes (daemon type and version, backtrace, etc.) 2024-03-30T12:21:55.146 INFO:tasks.workunit.client.0.smithi084.stderr:device_base NOT REPORTING: NOT OPTED-IN Information about device health metrics 2024-03-30T12:21:55.146 INFO:tasks.workunit.client.0.smithi084.stderr:ident_base NOT REPORTING: NOT OPTED-IN User-provided identifying information about the cluster 2024-03-30T12:21:55.147 INFO:tasks.workunit.client.0.smithi084.stderr:perf_memory_metrics NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Heap stats and mempools for mon and mds 2024-03-30T12:21:55.147 INFO:tasks.workunit.client.0.smithi084.stderr:perf_perf NOT REPORTING: NOT OPTED-IN, CHANNEL perf IS OFF Information about performance counters of the cluster == *perf_memory_metrics* ]] 2024-03-30T12:21:55.147 INFO:tasks.workunit.client.0.smithi084.stderr:+ ceph telemetry on --license sharing-1-0 2024-03-30T12:21:55.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:54 smithi084 ceph-mon[37565]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "telemetry preview", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:55.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:54 smithi084 ceph-mon[37565]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "telemetry preview", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:55.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:54 smithi084 ceph-mon[37565]: pgmap v75: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:55.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:54 smithi084 ceph-mon[37565]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-device", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:55.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:54 smithi084 ceph-mon[37565]: mgrmap e22: y(active, since 2m), standbys: x 2024-03-30T12:21:55.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:54 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:55.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:54 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:55.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:54 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:55.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:54 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:55.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:54 smithi084 ceph-mon[27000]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "telemetry preview", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:55.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:54 smithi084 ceph-mon[27000]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "telemetry preview", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:55.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:54 smithi084 ceph-mon[27000]: pgmap v75: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:55.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:54 smithi084 ceph-mon[27000]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-device", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:55.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:54 smithi084 ceph-mon[27000]: mgrmap e22: y(active, since 2m), standbys: x 2024-03-30T12:21:55.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:54 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:55.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:54 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:55.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:54 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:55.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:54 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:55.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:54 smithi162 ceph-mon[30421]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "telemetry preview", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:55.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:54 smithi162 ceph-mon[30421]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "telemetry preview", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:55.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:54 smithi162 ceph-mon[30421]: pgmap v75: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:55.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:54 smithi162 ceph-mon[30421]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-device", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:55.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:54 smithi162 ceph-mon[30421]: mgrmap e22: y(active, since 2m), standbys: x 2024-03-30T12:21:55.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:54 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:55.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:54 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:55.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:54 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:55.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:54 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:55.634 INFO:tasks.workunit.client.0.smithi084.stdout:Telemetry is on. 2024-03-30T12:21:55.634 INFO:tasks.workunit.client.0.smithi084.stdout:Some channels are disabled, please enable with: 2024-03-30T12:21:55.634 INFO:tasks.workunit.client.0.smithi084.stdout:`ceph telemetry enable channel perf` 2024-03-30T12:21:55.645 INFO:tasks.workunit.client.0.smithi084.stderr:+ ceph telemetry enable channel perf 2024-03-30T12:21:55.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:55] ENGINE Bus STOPPING 2024-03-30T12:21:55.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:55] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T12:21:55.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:55] ENGINE Bus STOPPED 2024-03-30T12:21:55.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:55] ENGINE Bus STARTING 2024-03-30T12:21:55.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:55] ENGINE Serving on http://:::9283 2024-03-30T12:21:55.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:55] ENGINE Bus STARTED 2024-03-30T12:21:56.154 INFO:tasks.workunit.client.0.smithi084.stdout:channel_perf is enabled 2024-03-30T12:21:56.166 INFO:tasks.workunit.client.0.smithi084.stderr:++ ceph config get mgr mgr/telemetry/last_opt_revision 2024-03-30T12:21:56.254 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:55] ENGINE Bus STOPPING 2024-03-30T12:21:56.254 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:55] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T12:21:56.254 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:55] ENGINE Bus STOPPED 2024-03-30T12:21:56.254 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:55] ENGINE Bus STARTING 2024-03-30T12:21:56.254 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:56] ENGINE Serving on http://:::9283 2024-03-30T12:21:56.254 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:21:56] ENGINE Bus STARTED 2024-03-30T12:21:56.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[37565]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-device", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[37565]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-all", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[37565]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-all", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:21:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:21:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:56.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[27000]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-device", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[27000]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-all", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[27000]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-all", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:21:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:21:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:56.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:56.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:56.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:56.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:55 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:56.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:55 smithi162 ceph-mon[30421]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-device", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:55 smithi162 ceph-mon[30421]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-all", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:55 smithi162 ceph-mon[30421]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "telemetry preview-all", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:55 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:55 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:55 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:55 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:55 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:55 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:21:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:55 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:21:56.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:55 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:56.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:55 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:56.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:55 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:56.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:55 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:56.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:55 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:56.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:55 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:56.542 INFO:tasks.workunit.client.0.smithi084.stderr:+ LAST_OPT_REVISION=1 2024-03-30T12:21:56.543 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 1 -ne 1 ']' 2024-03-30T12:21:56.543 INFO:tasks.workunit.client.0.smithi084.stderr:+ ceph telemetry show 2024-03-30T12:21:57.260 INFO:tasks.workunit.client.0.smithi084.stdout:{ 2024-03-30T12:21:57.260 INFO:tasks.workunit.client.0.smithi084.stdout: "balancer": { 2024-03-30T12:21:57.260 INFO:tasks.workunit.client.0.smithi084.stdout: "active": true, 2024-03-30T12:21:57.260 INFO:tasks.workunit.client.0.smithi084.stdout: "mode": "" 2024-03-30T12:21:57.260 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.261 INFO:tasks.workunit.client.0.smithi084.stdout: "channels": [ 2024-03-30T12:21:57.261 INFO:tasks.workunit.client.0.smithi084.stdout: "basic", 2024-03-30T12:21:57.261 INFO:tasks.workunit.client.0.smithi084.stdout: "crash", 2024-03-30T12:21:57.261 INFO:tasks.workunit.client.0.smithi084.stdout: "device", 2024-03-30T12:21:57.261 INFO:tasks.workunit.client.0.smithi084.stdout: "ident", 2024-03-30T12:21:57.261 INFO:tasks.workunit.client.0.smithi084.stdout: "perf" 2024-03-30T12:21:57.261 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.261 INFO:tasks.workunit.client.0.smithi084.stdout: "channels_available": [ 2024-03-30T12:21:57.261 INFO:tasks.workunit.client.0.smithi084.stdout: "basic", 2024-03-30T12:21:57.261 INFO:tasks.workunit.client.0.smithi084.stdout: "ident", 2024-03-30T12:21:57.261 INFO:tasks.workunit.client.0.smithi084.stdout: "crash", 2024-03-30T12:21:57.261 INFO:tasks.workunit.client.0.smithi084.stdout: "device", 2024-03-30T12:21:57.261 INFO:tasks.workunit.client.0.smithi084.stdout: "perf" 2024-03-30T12:21:57.261 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.262 INFO:tasks.workunit.client.0.smithi084.stdout: "collections_available": [ 2024-03-30T12:21:57.262 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_base", 2024-03-30T12:21:57.262 INFO:tasks.workunit.client.0.smithi084.stdout: "device_base", 2024-03-30T12:21:57.262 INFO:tasks.workunit.client.0.smithi084.stdout: "crash_base", 2024-03-30T12:21:57.262 INFO:tasks.workunit.client.0.smithi084.stdout: "ident_base", 2024-03-30T12:21:57.262 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_perf", 2024-03-30T12:21:57.262 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_mds_metadata", 2024-03-30T12:21:57.262 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_usage", 2024-03-30T12:21:57.262 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_usage_by_class", 2024-03-30T12:21:57.262 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_rook_v01", 2024-03-30T12:21:57.262 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_memory_metrics", 2024-03-30T12:21:57.262 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_options_bluestore" 2024-03-30T12:21:57.262 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.262 INFO:tasks.workunit.client.0.smithi084.stdout: "collections_opted_in": [ 2024-03-30T12:21:57.263 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_base", 2024-03-30T12:21:57.263 INFO:tasks.workunit.client.0.smithi084.stdout: "device_base", 2024-03-30T12:21:57.263 INFO:tasks.workunit.client.0.smithi084.stdout: "crash_base", 2024-03-30T12:21:57.263 INFO:tasks.workunit.client.0.smithi084.stdout: "ident_base", 2024-03-30T12:21:57.263 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_perf", 2024-03-30T12:21:57.263 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_mds_metadata", 2024-03-30T12:21:57.263 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_usage", 2024-03-30T12:21:57.263 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_usage_by_class", 2024-03-30T12:21:57.263 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_rook_v01", 2024-03-30T12:21:57.263 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_memory_metrics", 2024-03-30T12:21:57.263 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_options_bluestore" 2024-03-30T12:21:57.263 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.263 INFO:tasks.workunit.client.0.smithi084.stdout: "config": { 2024-03-30T12:21:57.263 INFO:tasks.workunit.client.0.smithi084.stdout: "active_changed": [ 2024-03-30T12:21:57.263 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_allow_insecure_global_id_reclaim", 2024-03-30T12:21:57.264 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_debug", 2024-03-30T12:21:57.264 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_mon_ticket_ttl", 2024-03-30T12:21:57.264 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_service_ticket_ttl", 2024-03-30T12:21:57.264 INFO:tasks.workunit.client.0.smithi084.stdout: "bdev_debug_aio", 2024-03-30T12:21:57.264 INFO:tasks.workunit.client.0.smithi084.stdout: "client_check_pool_perm", 2024-03-30T12:21:57.264 INFO:tasks.workunit.client.0.smithi084.stdout: "client_mount_gid", 2024-03-30T12:21:57.264 INFO:tasks.workunit.client.0.smithi084.stdout: "client_mount_uid", 2024-03-30T12:21:57.264 INFO:tasks.workunit.client.0.smithi084.stdout: "client_quota", 2024-03-30T12:21:57.264 INFO:tasks.workunit.client.0.smithi084.stdout: "container_image", 2024-03-30T12:21:57.264 INFO:tasks.workunit.client.0.smithi084.stdout: "daemonize", 2024-03-30T12:21:57.264 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_asserts_on_shutdown", 2024-03-30T12:21:57.264 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mgr", 2024-03-30T12:21:57.264 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mon", 2024-03-30T12:21:57.264 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_ms", 2024-03-30T12:21:57.265 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_osd", 2024-03-30T12:21:57.265 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_paxos", 2024-03-30T12:21:57.265 INFO:tasks.workunit.client.0.smithi084.stdout: "keyring", 2024-03-30T12:21:57.265 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_block_size", 2024-03-30T12:21:57.265 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_cache_size", 2024-03-30T12:21:57.265 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_compression", 2024-03-30T12:21:57.265 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_log", 2024-03-30T12:21:57.265 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_write_buffer_size", 2024-03-30T12:21:57.265 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_file", 2024-03-30T12:21:57.265 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_journald", 2024-03-30T12:21:57.265 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_stderr", 2024-03-30T12:21:57.265 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_allow_pool_delete", 2024-03-30T12:21:57.265 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_clock_drift_allowed", 2024-03-30T12:21:57.265 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_file_level", 2024-03-30T12:21:57.265 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_file", 2024-03-30T12:21:57.266 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_journald", 2024-03-30T12:21:57.266 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_stderr", 2024-03-30T12:21:57.266 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_data_avail_warn", 2024-03-30T12:21:57.266 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_election_default_strategy", 2024-03-30T12:21:57.266 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_host", 2024-03-30T12:21:57.266 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_max_pg_per_osd", 2024-03-30T12:21:57.266 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_mgr_mkfs_grace", 2024-03-30T12:21:57.266 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_prime_pg_temp", 2024-03-30T12:21:57.266 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_reporter_subtree_level", 2024-03-30T12:21:57.266 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_pg_warn_max_object_skew", 2024-03-30T12:21:57.266 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_bytes_per_osd", 2024-03-30T12:21:57.266 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_pgs_per_osd", 2024-03-30T12:21:57.266 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-03-30T12:21:57.266 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-03-30T12:21:57.267 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-03-30T12:21:57.267 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_legacy_crush_tunables", 2024-03-30T12:21:57.267 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-03-30T12:21:57.267 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-03-30T12:21:57.267 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_too_few_osds", 2024-03-30T12:21:57.267 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_bug", 2024-03-30T12:21:57.267 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_old_message", 2024-03-30T12:21:57.267 INFO:tasks.workunit.client.0.smithi084.stdout: "no_config_file", 2024-03-30T12:21:57.267 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_default_list", 2024-03-30T12:21:57.267 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_load_list", 2024-03-30T12:21:57.267 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_crush_chooseleaf_type", 2024-03-30T12:21:57.267 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_misdirected_ops", 2024-03-30T12:21:57.267 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_op_order", 2024-03-30T12:21:57.267 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_pg_log_writeout", 2024-03-30T12:21:57.268 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_shutdown", 2024-03-30T12:21:57.268 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_cached_snaps", 2024-03-30T12:21:57.268 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_missing_on_start", 2024-03-30T12:21:57.268 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_stray_on_activate", 2024-03-30T12:21:57.268 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_deep_scrub_update_digest_min_age", 2024-03-30T12:21:57.268 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_delete_sleep", 2024-03-30T12:21:57.268 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_delete_sleep_hdd", 2024-03-30T12:21:57.268 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_delete_sleep_hybrid", 2024-03-30T12:21:57.268 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_delete_sleep_ssd", 2024-03-30T12:21:57.268 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_max_backfills", 2024-03-30T12:21:57.268 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_max_capacity_iops_ssd", 2024-03-30T12:21:57.268 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_profile", 2024-03-30T12:21:57.268 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_best_effort_lim", 2024-03-30T12:21:57.268 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_best_effort_res", 2024-03-30T12:21:57.269 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_best_effort_wgt", 2024-03-30T12:21:57.269 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_recovery_lim", 2024-03-30T12:21:57.269 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_recovery_res", 2024-03-30T12:21:57.269 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_recovery_wgt", 2024-03-30T12:21:57.269 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_client_lim", 2024-03-30T12:21:57.269 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_client_res", 2024-03-30T12:21:57.269 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_client_wgt", 2024-03-30T12:21:57.269 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target", 2024-03-30T12:21:57.269 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target_autotune", 2024-03-30T12:21:57.269 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue", 2024-03-30T12:21:57.269 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue_cut_off", 2024-03-30T12:21:57.269 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pg_delete_cost", 2024-03-30T12:21:57.270 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_erasure_code_profile", 2024-03-30T12:21:57.270 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_pg_autoscale_mode", 2024-03-30T12:21:57.270 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recover_clone_overlap", 2024-03-30T12:21:57.270 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_active", 2024-03-30T12:21:57.270 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_active_hdd", 2024-03-30T12:21:57.270 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_active_ssd", 2024-03-30T12:21:57.270 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_chunk", 2024-03-30T12:21:57.270 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_sleep", 2024-03-30T12:21:57.270 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_sleep_hdd", 2024-03-30T12:21:57.270 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_sleep_hybrid", 2024-03-30T12:21:57.270 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_sleep_ssd", 2024-03-30T12:21:57.270 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_load_threshold", 2024-03-30T12:21:57.270 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_max_interval", 2024-03-30T12:21:57.270 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_sleep", 2024-03-30T12:21:57.271 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_shutdown_pgref_assert", 2024-03-30T12:21:57.271 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_snap_trim_sleep", 2024-03-30T12:21:57.271 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_snap_trim_sleep_hdd", 2024-03-30T12:21:57.271 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_snap_trim_sleep_hybrid", 2024-03-30T12:21:57.271 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_snap_trim_sleep_ssd", 2024-03-30T12:21:57.271 INFO:tasks.workunit.client.0.smithi084.stdout: "public_addr", 2024-03-30T12:21:57.271 INFO:tasks.workunit.client.0.smithi084.stdout: "public_addrv", 2024-03-30T12:21:57.271 INFO:tasks.workunit.client.0.smithi084.stdout: "public_network", 2024-03-30T12:21:57.271 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd_default_features", 2024-03-30T12:21:57.271 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd_qos_exclude_ops", 2024-03-30T12:21:57.271 INFO:tasks.workunit.client.0.smithi084.stdout: "setgroup", 2024-03-30T12:21:57.271 INFO:tasks.workunit.client.0.smithi084.stdout: "setuser" 2024-03-30T12:21:57.271 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.271 INFO:tasks.workunit.client.0.smithi084.stdout: "cluster_changed": [ 2024-03-30T12:21:57.272 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_allow_insecure_global_id_reclaim", 2024-03-30T12:21:57.272 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_debug", 2024-03-30T12:21:57.272 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_mon_ticket_ttl", 2024-03-30T12:21:57.272 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_service_ticket_ttl", 2024-03-30T12:21:57.272 INFO:tasks.workunit.client.0.smithi084.stdout: "bdev_debug_aio", 2024-03-30T12:21:57.272 INFO:tasks.workunit.client.0.smithi084.stdout: "container_image", 2024-03-30T12:21:57.272 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_asserts_on_shutdown", 2024-03-30T12:21:57.272 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mgr", 2024-03-30T12:21:57.272 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mon", 2024-03-30T12:21:57.272 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_ms", 2024-03-30T12:21:57.272 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_osd", 2024-03-30T12:21:57.272 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_paxos", 2024-03-30T12:21:57.272 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_file", 2024-03-30T12:21:57.272 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_journald", 2024-03-30T12:21:57.273 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_stderr", 2024-03-30T12:21:57.273 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_join_fs", 2024-03-30T12:21:57.273 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/allow_ptrace", 2024-03-30T12:21:57.273 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/container_init", 2024-03-30T12:21:57.273 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/migration_current", 2024-03-30T12:21:57.273 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/use_repo_digest", 2024-03-30T12:21:57.273 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/ALERTMANAGER_API_HOST", 2024-03-30T12:21:57.273 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/GRAFANA_API_SSL_VERIFY", 2024-03-30T12:21:57.273 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/GRAFANA_API_URL", 2024-03-30T12:21:57.273 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/PROMETHEUS_API_HOST", 2024-03-30T12:21:57.273 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/ssl_server_port", 2024-03-30T12:21:57.273 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/orchestrator/orchestrator", 2024-03-30T12:21:57.273 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/channel_ident", 2024-03-30T12:21:57.273 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/channel_perf", 2024-03-30T12:21:57.273 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/description", 2024-03-30T12:21:57.274 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/enabled", 2024-03-30T12:21:57.274 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/organization", 2024-03-30T12:21:57.274 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_allow_pool_delete", 2024-03-30T12:21:57.274 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_clock_drift_allowed", 2024-03-30T12:21:57.274 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_file_level", 2024-03-30T12:21:57.274 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_file", 2024-03-30T12:21:57.274 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_data_avail_warn", 2024-03-30T12:21:57.274 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_election_default_strategy", 2024-03-30T12:21:57.274 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_max_pg_per_osd", 2024-03-30T12:21:57.274 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_mgr_mkfs_grace", 2024-03-30T12:21:57.274 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_prime_pg_temp", 2024-03-30T12:21:57.274 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_reporter_subtree_level", 2024-03-30T12:21:57.274 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_pg_warn_max_object_skew", 2024-03-30T12:21:57.274 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_bytes_per_osd", 2024-03-30T12:21:57.275 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_pgs_per_osd", 2024-03-30T12:21:57.275 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-03-30T12:21:57.275 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-03-30T12:21:57.275 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-03-30T12:21:57.275 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_legacy_crush_tunables", 2024-03-30T12:21:57.275 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-03-30T12:21:57.275 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-03-30T12:21:57.275 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_too_few_osds", 2024-03-30T12:21:57.275 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_bug", 2024-03-30T12:21:57.275 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_old_message", 2024-03-30T12:21:57.275 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_default_list", 2024-03-30T12:21:57.275 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_load_list", 2024-03-30T12:21:57.275 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_misdirected_ops", 2024-03-30T12:21:57.275 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_op_order", 2024-03-30T12:21:57.275 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_pg_log_writeout", 2024-03-30T12:21:57.276 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_shutdown", 2024-03-30T12:21:57.276 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_cached_snaps", 2024-03-30T12:21:57.276 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_missing_on_start", 2024-03-30T12:21:57.276 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_stray_on_activate", 2024-03-30T12:21:57.276 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_deep_scrub_update_digest_min_age", 2024-03-30T12:21:57.276 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_max_capacity_iops_ssd", 2024-03-30T12:21:57.276 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_profile", 2024-03-30T12:21:57.276 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target", 2024-03-30T12:21:57.276 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target_autotune", 2024-03-30T12:21:57.276 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue", 2024-03-30T12:21:57.276 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue_cut_off", 2024-03-30T12:21:57.276 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_erasure_code_profile", 2024-03-30T12:21:57.276 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_pg_autoscale_mode", 2024-03-30T12:21:57.277 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recover_clone_overlap", 2024-03-30T12:21:57.277 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_chunk", 2024-03-30T12:21:57.277 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_load_threshold", 2024-03-30T12:21:57.277 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_max_interval", 2024-03-30T12:21:57.277 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_shutdown_pgref_assert", 2024-03-30T12:21:57.277 INFO:tasks.workunit.client.0.smithi084.stdout: "public_network", 2024-03-30T12:21:57.277 INFO:tasks.workunit.client.0.smithi084.stdout: "rgw_cache_enabled", 2024-03-30T12:21:57.277 INFO:tasks.workunit.client.0.smithi084.stdout: "rgw_enable_ops_log", 2024-03-30T12:21:57.277 INFO:tasks.workunit.client.0.smithi084.stdout: "rgw_enable_usage_log" 2024-03-30T12:21:57.277 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.277 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.277 INFO:tasks.workunit.client.0.smithi084.stdout: "contact": null, 2024-03-30T12:21:57.277 INFO:tasks.workunit.client.0.smithi084.stdout: "crashes": [], 2024-03-30T12:21:57.277 INFO:tasks.workunit.client.0.smithi084.stdout: "created": "2024-03-30T12:13:26.814055Z", 2024-03-30T12:21:57.277 INFO:tasks.workunit.client.0.smithi084.stdout: "crush": { 2024-03-30T12:21:57.278 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket_algs": { 2024-03-30T12:21:57.278 INFO:tasks.workunit.client.0.smithi084.stdout: "straw2": 3 2024-03-30T12:21:57.278 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.278 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket_sizes": { 2024-03-30T12:21:57.278 INFO:tasks.workunit.client.0.smithi084.stdout: "2": 1, 2024-03-30T12:21:57.278 INFO:tasks.workunit.client.0.smithi084.stdout: "4": 2 2024-03-30T12:21:57.278 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.278 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket_types": { 2024-03-30T12:21:57.278 INFO:tasks.workunit.client.0.smithi084.stdout: "1": 2, 2024-03-30T12:21:57.278 INFO:tasks.workunit.client.0.smithi084.stdout: "11": 1 2024-03-30T12:21:57.278 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.278 INFO:tasks.workunit.client.0.smithi084.stdout: "compat_weight_set": false, 2024-03-30T12:21:57.278 INFO:tasks.workunit.client.0.smithi084.stdout: "device_classes": [ 2024-03-30T12:21:57.278 INFO:tasks.workunit.client.0.smithi084.stdout: 8 2024-03-30T12:21:57.279 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_buckets": 6, 2024-03-30T12:21:57.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_devices": 8, 2024-03-30T12:21:57.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_rules": 1, 2024-03-30T12:21:57.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_types": 12, 2024-03-30T12:21:57.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_weight_sets": 0, 2024-03-30T12:21:57.279 INFO:tasks.workunit.client.0.smithi084.stdout: "tunables": { 2024-03-30T12:21:57.279 INFO:tasks.workunit.client.0.smithi084.stdout: "allowed_bucket_algs": 54, 2024-03-30T12:21:57.279 INFO:tasks.workunit.client.0.smithi084.stdout: "choose_local_fallback_tries": 0, 2024-03-30T12:21:57.279 INFO:tasks.workunit.client.0.smithi084.stdout: "choose_local_tries": 0, 2024-03-30T12:21:57.279 INFO:tasks.workunit.client.0.smithi084.stdout: "choose_total_tries": 50, 2024-03-30T12:21:57.279 INFO:tasks.workunit.client.0.smithi084.stdout: "chooseleaf_descend_once": 1, 2024-03-30T12:21:57.279 INFO:tasks.workunit.client.0.smithi084.stdout: "chooseleaf_stable": 1, 2024-03-30T12:21:57.279 INFO:tasks.workunit.client.0.smithi084.stdout: "chooseleaf_vary_r": 1, 2024-03-30T12:21:57.280 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v2_rules": 0, 2024-03-30T12:21:57.280 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v3_rules": 0, 2024-03-30T12:21:57.280 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v4_buckets": 1, 2024-03-30T12:21:57.280 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v5_rules": 0, 2024-03-30T12:21:57.280 INFO:tasks.workunit.client.0.smithi084.stdout: "legacy_tunables": 0, 2024-03-30T12:21:57.280 INFO:tasks.workunit.client.0.smithi084.stdout: "minimum_required_version": "jewel", 2024-03-30T12:21:57.280 INFO:tasks.workunit.client.0.smithi084.stdout: "optimal_tunables": 1, 2024-03-30T12:21:57.280 INFO:tasks.workunit.client.0.smithi084.stdout: "profile": "jewel", 2024-03-30T12:21:57.280 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables": 1, 2024-03-30T12:21:57.280 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables2": 1, 2024-03-30T12:21:57.280 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables3": 1, 2024-03-30T12:21:57.280 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables5": 1, 2024-03-30T12:21:57.280 INFO:tasks.workunit.client.0.smithi084.stdout: "straw_calc_version": 1 2024-03-30T12:21:57.280 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.280 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.281 INFO:tasks.workunit.client.0.smithi084.stdout: "description": "upgrade test cluster", 2024-03-30T12:21:57.281 INFO:tasks.workunit.client.0.smithi084.stdout: "fs": { 2024-03-30T12:21:57.281 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:57.281 INFO:tasks.workunit.client.0.smithi084.stdout: "feature_flags": { 2024-03-30T12:21:57.281 INFO:tasks.workunit.client.0.smithi084.stdout: "enable_multiple": true, 2024-03-30T12:21:57.281 INFO:tasks.workunit.client.0.smithi084.stdout: "ever_enabled_multiple": true 2024-03-30T12:21:57.281 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.281 INFO:tasks.workunit.client.0.smithi084.stdout: "filesystems": [ 2024-03-30T12:21:57.281 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.281 INFO:tasks.workunit.client.0.smithi084.stdout: "approx_ctime": "2024-03", 2024-03-30T12:21:57.281 INFO:tasks.workunit.client.0.smithi084.stdout: "balancer_enabled": false, 2024-03-30T12:21:57.281 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.281 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_caps": 0, 2024-03-30T12:21:57.281 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_dns": 10, 2024-03-30T12:21:57.282 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_inos": 13, 2024-03-30T12:21:57.282 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_subtrees": 2, 2024-03-30T12:21:57.282 INFO:tasks.workunit.client.0.smithi084.stdout: "ever_allowed_features": 0, 2024-03-30T12:21:57.282 INFO:tasks.workunit.client.0.smithi084.stdout: "explicitly_allowed_features": 0, 2024-03-30T12:21:57.282 INFO:tasks.workunit.client.0.smithi084.stdout: "files": 0, 2024-03-30T12:21:57.282 INFO:tasks.workunit.client.0.smithi084.stdout: "max_mds": 1, 2024-03-30T12:21:57.282 INFO:tasks.workunit.client.0.smithi084.stdout: "num_data_pools": 1, 2024-03-30T12:21:57.282 INFO:tasks.workunit.client.0.smithi084.stdout: "num_in": 1, 2024-03-30T12:21:57.282 INFO:tasks.workunit.client.0.smithi084.stdout: "num_mds": 1, 2024-03-30T12:21:57.282 INFO:tasks.workunit.client.0.smithi084.stdout: "num_sessions": 0, 2024-03-30T12:21:57.282 INFO:tasks.workunit.client.0.smithi084.stdout: "num_standby_replay": 0, 2024-03-30T12:21:57.282 INFO:tasks.workunit.client.0.smithi084.stdout: "num_up": 1, 2024-03-30T12:21:57.282 INFO:tasks.workunit.client.0.smithi084.stdout: "snaps": 0, 2024-03-30T12:21:57.282 INFO:tasks.workunit.client.0.smithi084.stdout: "standby_count_wanted": 0 2024-03-30T12:21:57.282 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.283 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.283 INFO:tasks.workunit.client.0.smithi084.stdout: "num_standby_mds": 1, 2024-03-30T12:21:57.283 INFO:tasks.workunit.client.0.smithi084.stdout: "total_num_mds": 2 2024-03-30T12:21:57.283 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.283 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_stats": { 2024-03-30T12:21:57.283 INFO:tasks.workunit.client.0.smithi084.stdout: "mds": { 2024-03-30T12:21:57.283 INFO:tasks.workunit.client.0.smithi084.stdout: "mds.611cf02078e8bf5a0a364299eaa3b024f2655c78": { 2024-03-30T12:21:57.283 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 19218432, 2024-03-30T12:21:57.283 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 308664, 2024-03-30T12:21:57.283 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2752512, 2024-03-30T12:21:57.283 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 57344, 2024-03-30T12:21:57.283 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 0, 2024-03-30T12:21:57.283 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 315, 2024-03-30T12:21:57.283 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:57.283 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 834264, 2024-03-30T12:21:57.284 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 12, 2024-03-30T12:21:57.284 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 803328, 2024-03-30T12:21:57.284 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 14462320, 2024-03-30T12:21:57.284 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 19218432 2024-03-30T12:21:57.284 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.284 INFO:tasks.workunit.client.0.smithi084.stdout: "mds.f0f02ef515f7a6934fcbe198c4bdfa6882a76018": { 2024-03-30T12:21:57.284 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 20602880, 2024-03-30T12:21:57.284 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 380688, 2024-03-30T12:21:57.284 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2752512, 2024-03-30T12:21:57.284 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 8192, 2024-03-30T12:21:57.284 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 712704, 2024-03-30T12:21:57.284 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 401, 2024-03-30T12:21:57.284 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:57.284 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 1305360, 2024-03-30T12:21:57.284 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 20, 2024-03-30T12:21:57.285 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 1206272, 2024-03-30T12:21:57.285 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 14949856, 2024-03-30T12:21:57.285 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 21315584 2024-03-30T12:21:57.285 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.285 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.285 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-03-30T12:21:57.285 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.611cf02078e8bf5a0a364299eaa3b024f2655c78": { 2024-03-30T12:21:57.285 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 44187648, 2024-03-30T12:21:57.285 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 1453056, 2024-03-30T12:21:57.285 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2752512, 2024-03-30T12:21:57.285 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 540672, 2024-03-30T12:21:57.285 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 6512640, 2024-03-30T12:21:57.285 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1924, 2024-03-30T12:21:57.285 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:57.285 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 12398520, 2024-03-30T12:21:57.286 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 22, 2024-03-30T12:21:57.286 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 3136256, 2024-03-30T12:21:57.286 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 23906632, 2024-03-30T12:21:57.286 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 50700288 2024-03-30T12:21:57.286 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.286 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.ba4e0ee80ca1c9071285ab58ebc3a0451ad8d905": { 2024-03-30T12:21:57.286 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 40304640, 2024-03-30T12:21:57.286 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 917656, 2024-03-30T12:21:57.286 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2752512, 2024-03-30T12:21:57.286 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 5079040, 2024-03-30T12:21:57.286 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 4194304, 2024-03-30T12:21:57.286 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1081, 2024-03-30T12:21:57.286 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:57.286 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 8935760, 2024-03-30T12:21:57.287 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 22, 2024-03-30T12:21:57.287 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 1228032, 2024-03-30T12:21:57.287 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 21391640, 2024-03-30T12:21:57.287 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 44498944 2024-03-30T12:21:57.287 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.287 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.f0f02ef515f7a6934fcbe198c4bdfa6882a76018": { 2024-03-30T12:21:57.287 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 34496512, 2024-03-30T12:21:57.287 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 1430872, 2024-03-30T12:21:57.287 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2752512, 2024-03-30T12:21:57.287 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-03-30T12:21:57.287 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 11051008, 2024-03-30T12:21:57.287 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1146, 2024-03-30T12:21:57.287 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:57.287 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 8736168, 2024-03-30T12:21:57.287 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 21, 2024-03-30T12:21:57.288 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 966144, 2024-03-30T12:21:57.288 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 20610816, 2024-03-30T12:21:57.288 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 45547520 2024-03-30T12:21:57.288 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.288 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.288 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:57.288 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.0": { 2024-03-30T12:21:57.288 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 52215808, 2024-03-30T12:21:57.288 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 1858880, 2024-03-30T12:21:57.288 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-03-30T12:21:57.288 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-03-30T12:21:57.288 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 393216, 2024-03-30T12:21:57.288 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1746, 2024-03-30T12:21:57.288 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:57.288 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 5836328, 2024-03-30T12:21:57.289 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 47, 2024-03-30T12:21:57.289 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 3917056, 2024-03-30T12:21:57.289 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 37719960, 2024-03-30T12:21:57.289 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 52609024 2024-03-30T12:21:57.289 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.289 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.1": { 2024-03-30T12:21:57.289 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 49963008, 2024-03-30T12:21:57.289 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 1873648, 2024-03-30T12:21:57.289 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-03-30T12:21:57.289 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-03-30T12:21:57.289 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 548864, 2024-03-30T12:21:57.289 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1672, 2024-03-30T12:21:57.289 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:57.289 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 6111392, 2024-03-30T12:21:57.289 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 47, 2024-03-30T12:21:57.290 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 3422720, 2024-03-30T12:21:57.290 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 35671664, 2024-03-30T12:21:57.290 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 50511872 2024-03-30T12:21:57.290 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.290 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.2": { 2024-03-30T12:21:57.290 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 49577984, 2024-03-30T12:21:57.290 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 1801608, 2024-03-30T12:21:57.290 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-03-30T12:21:57.290 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-03-30T12:21:57.290 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 868352, 2024-03-30T12:21:57.290 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1624, 2024-03-30T12:21:57.290 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:57.290 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 5608336, 2024-03-30T12:21:57.290 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 47, 2024-03-30T12:21:57.291 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 4068864, 2024-03-30T12:21:57.291 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 35215592, 2024-03-30T12:21:57.291 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 50446336 2024-03-30T12:21:57.291 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.291 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.3": { 2024-03-30T12:21:57.291 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 43393024, 2024-03-30T12:21:57.291 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 643872, 2024-03-30T12:21:57.291 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-03-30T12:21:57.291 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-03-30T12:21:57.291 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 827392, 2024-03-30T12:21:57.291 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1171, 2024-03-30T12:21:57.291 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:57.291 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 4017624, 2024-03-30T12:21:57.291 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 46, 2024-03-30T12:21:57.292 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 1705728, 2024-03-30T12:21:57.292 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 34142216, 2024-03-30T12:21:57.292 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 44220416 2024-03-30T12:21:57.292 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.292 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.4": { 2024-03-30T12:21:57.292 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 48390144, 2024-03-30T12:21:57.292 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 1833248, 2024-03-30T12:21:57.292 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-03-30T12:21:57.292 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 57344, 2024-03-30T12:21:57.292 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 24576, 2024-03-30T12:21:57.292 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1590, 2024-03-30T12:21:57.292 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:57.292 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 5467480, 2024-03-30T12:21:57.292 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 47, 2024-03-30T12:21:57.292 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 3278336, 2024-03-30T12:21:57.293 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 34870152, 2024-03-30T12:21:57.293 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 48414720 2024-03-30T12:21:57.293 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.293 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.5": { 2024-03-30T12:21:57.293 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 48775168, 2024-03-30T12:21:57.293 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 2056280, 2024-03-30T12:21:57.293 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-03-30T12:21:57.293 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-03-30T12:21:57.293 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 688128, 2024-03-30T12:21:57.293 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1604, 2024-03-30T12:21:57.293 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:57.293 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 5231560, 2024-03-30T12:21:57.293 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 47, 2024-03-30T12:21:57.293 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 3763200, 2024-03-30T12:21:57.293 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 34840544, 2024-03-30T12:21:57.294 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 49463296 2024-03-30T12:21:57.294 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.294 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.6": { 2024-03-30T12:21:57.294 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 44335104, 2024-03-30T12:21:57.294 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 997888, 2024-03-30T12:21:57.294 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-03-30T12:21:57.294 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 24576, 2024-03-30T12:21:57.294 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 933888, 2024-03-30T12:21:57.294 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1209, 2024-03-30T12:21:57.294 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:57.294 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 4555856, 2024-03-30T12:21:57.294 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 47, 2024-03-30T12:21:57.294 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 1896704, 2024-03-30T12:21:57.294 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 33976496, 2024-03-30T12:21:57.294 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 45268992 2024-03-30T12:21:57.295 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.295 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.7": { 2024-03-30T12:21:57.295 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 48586752, 2024-03-30T12:21:57.295 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 1769664, 2024-03-30T12:21:57.295 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-03-30T12:21:57.295 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-03-30T12:21:57.295 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 876544, 2024-03-30T12:21:57.295 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1639, 2024-03-30T12:21:57.295 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:57.295 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 5959936, 2024-03-30T12:21:57.295 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 47, 2024-03-30T12:21:57.295 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 3472384, 2024-03-30T12:21:57.295 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 34501184, 2024-03-30T12:21:57.295 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 49463296 2024-03-30T12:21:57.296 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.296 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.296 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.296 INFO:tasks.workunit.client.0.smithi084.stdout: "hosts": { 2024-03-30T12:21:57.296 INFO:tasks.workunit.client.0.smithi084.stdout: "num": 2, 2024-03-30T12:21:57.296 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_mds": 2, 2024-03-30T12:21:57.296 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_mgr": 2, 2024-03-30T12:21:57.296 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_mon": 2, 2024-03-30T12:21:57.296 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_osd": 2 2024-03-30T12:21:57.296 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.296 INFO:tasks.workunit.client.0.smithi084.stdout: "io_rate": { 2024-03-30T12:21:57.296 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_stats_delta": { 2024-03-30T12:21:57.296 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": 0, 2024-03-30T12:21:57.296 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:57.296 INFO:tasks.workunit.client.0.smithi084.stdout: "num_store_stats": 0, 2024-03-30T12:21:57.297 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:57.297 INFO:tasks.workunit.client.0.smithi084.stdout: "stamp_delta": "12.002353", 2024-03-30T12:21:57.297 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:57.297 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:57.297 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:57.297 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:57.297 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:57.297 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:57.297 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:57.297 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:57.297 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:57.297 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:57.297 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:57.297 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:57.297 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:57.298 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:57.298 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:57.298 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:57.298 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:57.298 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:57.298 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:57.298 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:57.298 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:57.298 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:57.298 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:57.298 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:57.298 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:57.298 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:57.298 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:57.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:57.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:57.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:57.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:57.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:57.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:57.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:57.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:57.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:57.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:57.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:57.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:57.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:57.299 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:57.299 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.300 INFO:tasks.workunit.client.0.smithi084.stdout: "store_stats": { 2024-03-30T12:21:57.300 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": 0, 2024-03-30T12:21:57.300 INFO:tasks.workunit.client.0.smithi084.stdout: "available": 0, 2024-03-30T12:21:57.300 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed": 0, 2024-03-30T12:21:57.300 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_allocated": 0, 2024-03-30T12:21:57.300 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_original": 0, 2024-03-30T12:21:57.300 INFO:tasks.workunit.client.0.smithi084.stdout: "data_stored": 0, 2024-03-30T12:21:57.300 INFO:tasks.workunit.client.0.smithi084.stdout: "internal_metadata": 0, 2024-03-30T12:21:57.300 INFO:tasks.workunit.client.0.smithi084.stdout: "internally_reserved": 0, 2024-03-30T12:21:57.300 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_allocated": 0, 2024-03-30T12:21:57.300 INFO:tasks.workunit.client.0.smithi084.stdout: "total": 0 2024-03-30T12:21:57.300 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.300 INFO:tasks.workunit.client.0.smithi084.stdout: "up": 0 2024-03-30T12:21:57.300 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.300 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.300 INFO:tasks.workunit.client.0.smithi084.stdout: "leaderboard": false, 2024-03-30T12:21:57.301 INFO:tasks.workunit.client.0.smithi084.stdout: "leaderboard_description": null, 2024-03-30T12:21:57.301 INFO:tasks.workunit.client.0.smithi084.stdout: "license": "sharing-1-0", 2024-03-30T12:21:57.301 INFO:tasks.workunit.client.0.smithi084.stdout: "mempool": { 2024-03-30T12:21:57.301 INFO:tasks.workunit.client.0.smithi084.stdout: "mds": { 2024-03-30T12:21:57.301 INFO:tasks.workunit.client.0.smithi084.stdout: "mds.611cf02078e8bf5a0a364299eaa3b024f2655c78": { 2024-03-30T12:21:57.301 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:57.301 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.301 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.301 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.301 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:57.301 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.301 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.301 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.301 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:57.302 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.302 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.302 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.302 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:57.302 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.302 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.302 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.302 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:57.302 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.302 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.302 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.302 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:57.302 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.302 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.302 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.303 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:57.303 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.303 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.303 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.303 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:57.303 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.303 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.303 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.303 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:57.303 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.303 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.303 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.303 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:57.303 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.303 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.303 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.304 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:57.304 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.304 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.304 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.304 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:57.304 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.304 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.304 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.304 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:57.304 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.304 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.304 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.304 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:57.304 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.304 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.305 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.305 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:57.305 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.305 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.305 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.305 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:57.305 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.305 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.305 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.305 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:57.305 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.305 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.305 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.305 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:57.305 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.306 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.306 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.306 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:57.306 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 150208, 2024-03-30T12:21:57.306 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 34 2024-03-30T12:21:57.306 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.306 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:57.306 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.306 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.306 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.306 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:57.306 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 928, 2024-03-30T12:21:57.306 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 2 2024-03-30T12:21:57.306 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.306 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:57.307 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.307 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.307 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.307 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:57.307 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.307 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.307 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.307 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:57.307 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.307 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.307 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.307 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:57.307 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.307 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.307 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.307 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:57.308 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.308 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.308 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.308 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:57.308 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.308 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.308 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.308 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:57.308 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.308 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.308 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.308 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:57.308 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.309 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.309 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.309 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.309 INFO:tasks.workunit.client.0.smithi084.stdout: "mds.f0f02ef515f7a6934fcbe198c4bdfa6882a76018": { 2024-03-30T12:21:57.309 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:57.309 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.309 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.309 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.309 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:57.309 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.309 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.309 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.309 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:57.309 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.309 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.310 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.310 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:57.310 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.310 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.310 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.310 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:57.310 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.310 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.310 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.310 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:57.310 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.310 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.311 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.311 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:57.311 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.311 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.311 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.311 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:57.311 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.311 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.311 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.311 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:57.311 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.311 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.311 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.311 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:57.312 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.312 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.312 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.312 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:57.312 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.312 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.312 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.312 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:57.312 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.312 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.312 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.312 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:57.312 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.313 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.313 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.313 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:57.313 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.313 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.313 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.313 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:57.313 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.313 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.313 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.313 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:57.313 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.313 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.313 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.313 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:57.314 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.314 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.314 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.314 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:57.314 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.314 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.314 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.314 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:57.314 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 222439, 2024-03-30T12:21:57.314 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 68 2024-03-30T12:21:57.314 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.314 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:57.314 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.314 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.315 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.315 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:57.315 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 51496, 2024-03-30T12:21:57.315 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 208 2024-03-30T12:21:57.315 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.315 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:57.315 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.315 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.315 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.315 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:57.315 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.315 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.315 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.316 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:57.316 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.316 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.316 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.316 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:57.316 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 7816, 2024-03-30T12:21:57.316 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 121 2024-03-30T12:21:57.316 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.316 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:57.316 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.316 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.316 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.316 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:57.316 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.316 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.316 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.317 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:57.317 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.317 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.317 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.317 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:57.317 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.317 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.317 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.317 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.317 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.317 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-03-30T12:21:57.317 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.611cf02078e8bf5a0a364299eaa3b024f2655c78": { 2024-03-30T12:21:57.317 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:57.317 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.317 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.318 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.318 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:57.318 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.318 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.318 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.318 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:57.318 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.318 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.318 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.318 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:57.318 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.318 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.318 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.318 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:57.319 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.319 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.319 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.319 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:57.319 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.319 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.319 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.319 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:57.319 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.319 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.319 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.319 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:57.319 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.319 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.320 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.320 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:57.320 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.320 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.320 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.320 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:57.320 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.320 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.320 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.320 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:57.320 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.320 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.320 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.320 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:57.320 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.321 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.321 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.321 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:57.321 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.321 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.321 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.321 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:57.321 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.321 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.321 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.321 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:57.321 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.321 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.321 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.321 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:57.321 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.322 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.322 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.322 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:57.322 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.322 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.322 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.322 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:57.322 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.322 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.322 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.322 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:57.322 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1124539, 2024-03-30T12:21:57.322 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 337 2024-03-30T12:21:57.323 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.323 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:57.323 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 352, 2024-03-30T12:21:57.323 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 4 2024-03-30T12:21:57.323 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.323 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:57.323 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.323 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.323 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.323 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:57.323 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.323 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.323 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.323 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:57.323 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.323 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.324 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.324 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:57.324 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.324 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.324 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.324 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:57.324 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6392, 2024-03-30T12:21:57.324 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 120 2024-03-30T12:21:57.324 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.324 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:57.324 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12744, 2024-03-30T12:21:57.324 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 1546 2024-03-30T12:21:57.324 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.324 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:57.324 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 10304, 2024-03-30T12:21:57.325 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 166 2024-03-30T12:21:57.325 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.325 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:57.325 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.325 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.325 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.325 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:57.325 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.325 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.325 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.325 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.325 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.ba4e0ee80ca1c9071285ab58ebc3a0451ad8d905": { 2024-03-30T12:21:57.325 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:57.325 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.325 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.326 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.326 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:57.326 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.326 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.326 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.326 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:57.326 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.326 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.326 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.326 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:57.326 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.326 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.326 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.326 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:57.326 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.327 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.327 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.327 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:57.327 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.327 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.327 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.327 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:57.327 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.327 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.327 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.327 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:57.327 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.329 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.329 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.329 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:57.329 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.329 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.330 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.330 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:57.330 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.330 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.330 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.330 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:57.330 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.330 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.330 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.330 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:57.330 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.330 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.330 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.330 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:57.330 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.331 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.331 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.331 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:57.331 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.331 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.331 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.331 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:57.331 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.331 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.331 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.331 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:57.331 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.331 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.331 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.331 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:57.331 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.332 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.332 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.332 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:57.332 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.332 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.332 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.332 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:57.332 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1149875, 2024-03-30T12:21:57.332 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 382 2024-03-30T12:21:57.332 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.332 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:57.332 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.332 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.332 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.332 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:57.333 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.333 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.333 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.333 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:57.333 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.333 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.333 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.333 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:57.333 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.333 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.333 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.333 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:57.333 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.333 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.333 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.334 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:57.334 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6392, 2024-03-30T12:21:57.334 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 120 2024-03-30T12:21:57.334 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.334 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:57.334 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12744, 2024-03-30T12:21:57.334 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 1546 2024-03-30T12:21:57.334 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.334 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:57.334 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5152, 2024-03-30T12:21:57.334 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 83 2024-03-30T12:21:57.334 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.334 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:57.335 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.335 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.335 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.335 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:57.335 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.335 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.335 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.335 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.335 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.f0f02ef515f7a6934fcbe198c4bdfa6882a76018": { 2024-03-30T12:21:57.335 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:57.335 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.335 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.335 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.335 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:57.335 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.335 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.336 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.336 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:57.336 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.336 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.336 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.336 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:57.336 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.336 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.336 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.336 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:57.336 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.336 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.336 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.336 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:57.336 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.337 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.337 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.337 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:57.337 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.337 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.337 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.337 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:57.337 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.337 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.337 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.337 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:57.337 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.337 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.337 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.337 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:57.338 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.338 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.338 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.338 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:57.338 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.338 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.338 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.338 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:57.338 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.338 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.338 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.338 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:57.338 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.338 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.339 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.339 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:57.339 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.339 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.339 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.339 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:57.339 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.339 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.339 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.339 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:57.339 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.339 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.339 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.339 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:57.340 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.340 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.340 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.340 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:57.340 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.340 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.340 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.340 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:57.340 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1069395, 2024-03-30T12:21:57.340 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 351 2024-03-30T12:21:57.340 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.340 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:57.340 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.340 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.340 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.341 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:57.341 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.341 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.341 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.341 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:57.341 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.341 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.341 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.341 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:57.341 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.341 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.341 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.341 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:57.341 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.341 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.342 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.342 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:57.342 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6392, 2024-03-30T12:21:57.342 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 120 2024-03-30T12:21:57.342 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.342 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:57.342 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12744, 2024-03-30T12:21:57.342 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 1546 2024-03-30T12:21:57.342 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.342 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:57.342 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5152, 2024-03-30T12:21:57.342 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 83 2024-03-30T12:21:57.342 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.342 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:57.343 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.343 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.343 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.343 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:57.343 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.343 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.343 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.343 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.343 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.343 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:57.343 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.0": { 2024-03-30T12:21:57.344 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:57.344 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.344 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.344 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.344 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:57.344 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6368, 2024-03-30T12:21:57.344 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 123 2024-03-30T12:21:57.344 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.344 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:57.344 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 16896, 2024-03-30T12:21:57.344 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8 2024-03-30T12:21:57.344 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.345 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:57.345 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-03-30T12:21:57.345 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:57.345 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.345 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:57.345 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5680, 2024-03-30T12:21:57.345 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 71 2024-03-30T12:21:57.345 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.345 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:57.345 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 20608, 2024-03-30T12:21:57.345 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 184 2024-03-30T12:21:57.345 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.345 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:57.345 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1936, 2024-03-30T12:21:57.345 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 47 2024-03-30T12:21:57.346 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.346 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:57.346 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 621095, 2024-03-30T12:21:57.346 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 20 2024-03-30T12:21:57.346 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.346 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:57.346 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 91294, 2024-03-30T12:21:57.346 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 15637 2024-03-30T12:21:57.346 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.346 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:57.346 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 203576, 2024-03-30T12:21:57.346 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 331 2024-03-30T12:21:57.346 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.347 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:57.347 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 11284, 2024-03-30T12:21:57.347 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 733 2024-03-30T12:21:57.347 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.347 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:57.347 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8832, 2024-03-30T12:21:57.347 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 184 2024-03-30T12:21:57.347 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.347 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:57.347 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.347 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.347 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.347 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:57.347 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 31420, 2024-03-30T12:21:57.347 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 199 2024-03-30T12:21:57.347 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.348 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:57.348 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 20608, 2024-03-30T12:21:57.348 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 184 2024-03-30T12:21:57.348 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.348 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:57.348 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.348 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.348 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.348 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:57.348 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 372230, 2024-03-30T12:21:57.348 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 83 2024-03-30T12:21:57.348 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.348 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:57.348 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.349 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.349 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.349 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:57.349 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 3493168, 2024-03-30T12:21:57.349 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 195 2024-03-30T12:21:57.349 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.349 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:57.349 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 7128, 2024-03-30T12:21:57.349 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 81 2024-03-30T12:21:57.349 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.349 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:57.349 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.349 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.349 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.349 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:57.349 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 521640, 2024-03-30T12:21:57.350 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 45 2024-03-30T12:21:57.350 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.350 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:57.350 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.350 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.350 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.350 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:57.350 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 92560, 2024-03-30T12:21:57.350 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 182 2024-03-30T12:21:57.350 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.350 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:57.350 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 221624, 2024-03-30T12:21:57.350 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3374 2024-03-30T12:21:57.350 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.350 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:57.351 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.351 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.351 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.351 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:57.351 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.351 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.351 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.351 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:57.351 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.351 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.351 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.351 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:57.351 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.351 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.351 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.352 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.352 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.1": { 2024-03-30T12:21:57.352 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:57.352 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.352 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.352 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.352 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:57.352 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6368, 2024-03-30T12:21:57.352 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 123 2024-03-30T12:21:57.352 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.352 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:57.352 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 16896, 2024-03-30T12:21:57.352 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8 2024-03-30T12:21:57.352 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.352 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:57.353 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-03-30T12:21:57.353 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:57.353 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.353 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:57.353 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 4320, 2024-03-30T12:21:57.353 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 54 2024-03-30T12:21:57.353 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.353 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:57.353 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19040, 2024-03-30T12:21:57.353 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 170 2024-03-30T12:21:57.353 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.353 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:57.353 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1488, 2024-03-30T12:21:57.353 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 43 2024-03-30T12:21:57.354 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.354 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:57.354 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12288, 2024-03-30T12:21:57.354 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:57.354 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.354 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:57.354 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 84916, 2024-03-30T12:21:57.354 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 14591 2024-03-30T12:21:57.354 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.354 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:57.354 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 192696, 2024-03-30T12:21:57.354 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 315 2024-03-30T12:21:57.354 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.354 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:57.355 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 9216, 2024-03-30T12:21:57.355 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 555 2024-03-30T12:21:57.355 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.355 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:57.355 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8160, 2024-03-30T12:21:57.355 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 170 2024-03-30T12:21:57.355 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.355 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:57.355 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.355 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.355 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.355 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:57.355 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 27056, 2024-03-30T12:21:57.355 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 183 2024-03-30T12:21:57.355 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.356 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:57.356 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19152, 2024-03-30T12:21:57.356 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 171 2024-03-30T12:21:57.356 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.356 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:57.356 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1472, 2024-03-30T12:21:57.356 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 2 2024-03-30T12:21:57.356 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.356 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:57.356 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 434861, 2024-03-30T12:21:57.356 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 98 2024-03-30T12:21:57.356 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.356 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:57.356 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 20128, 2024-03-30T12:21:57.356 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 5 2024-03-30T12:21:57.357 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.357 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:57.357 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2434876, 2024-03-30T12:21:57.357 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 182 2024-03-30T12:21:57.357 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.357 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:57.357 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 4840, 2024-03-30T12:21:57.357 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 55 2024-03-30T12:21:57.357 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.357 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:57.357 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.357 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.357 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.357 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:57.357 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 428904, 2024-03-30T12:21:57.358 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 37 2024-03-30T12:21:57.358 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.358 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:57.358 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.358 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.358 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.358 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:57.358 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 7280, 2024-03-30T12:21:57.358 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 18 2024-03-30T12:21:57.358 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.358 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:57.358 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 222392, 2024-03-30T12:21:57.358 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3410 2024-03-30T12:21:57.358 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.359 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:57.359 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.359 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.359 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.359 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:57.359 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.359 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.359 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.359 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:57.359 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.359 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.359 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.359 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:57.359 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.359 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.360 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.360 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.360 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.2": { 2024-03-30T12:21:57.360 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:57.360 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.360 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.360 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.360 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:57.360 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6368, 2024-03-30T12:21:57.360 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 123 2024-03-30T12:21:57.360 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.360 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:57.360 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 16896, 2024-03-30T12:21:57.360 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8 2024-03-30T12:21:57.360 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.361 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:57.361 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-03-30T12:21:57.361 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:57.361 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.361 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:57.361 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 3840, 2024-03-30T12:21:57.361 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 48 2024-03-30T12:21:57.361 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.361 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:57.361 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 18928, 2024-03-30T12:21:57.361 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 169 2024-03-30T12:21:57.361 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.361 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:57.361 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1488, 2024-03-30T12:21:57.361 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 43 2024-03-30T12:21:57.362 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.362 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:57.362 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12288, 2024-03-30T12:21:57.362 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:57.362 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.362 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:57.362 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 83401, 2024-03-30T12:21:57.362 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 14357 2024-03-30T12:21:57.362 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.362 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:57.362 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 188616, 2024-03-30T12:21:57.362 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 309 2024-03-30T12:21:57.362 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.362 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:57.362 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8188, 2024-03-30T12:21:57.363 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 505 2024-03-30T12:21:57.363 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.363 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:57.363 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8112, 2024-03-30T12:21:57.363 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 169 2024-03-30T12:21:57.363 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.363 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:57.363 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.363 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.363 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.363 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:57.363 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 25688, 2024-03-30T12:21:57.363 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 177 2024-03-30T12:21:57.363 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.364 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:57.364 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19040, 2024-03-30T12:21:57.364 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 170 2024-03-30T12:21:57.364 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.364 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:57.364 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1472, 2024-03-30T12:21:57.364 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 2 2024-03-30T12:21:57.364 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.364 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:57.364 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 305645, 2024-03-30T12:21:57.364 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 67 2024-03-30T12:21:57.364 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.364 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:57.364 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 20128, 2024-03-30T12:21:57.364 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 5 2024-03-30T12:21:57.364 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.365 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:57.365 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2444032, 2024-03-30T12:21:57.365 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 183 2024-03-30T12:21:57.365 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.365 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:57.365 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 4400, 2024-03-30T12:21:57.365 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 50 2024-03-30T12:21:57.365 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.365 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:57.365 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.365 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.365 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.365 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:57.365 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 359352, 2024-03-30T12:21:57.365 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 31 2024-03-30T12:21:57.365 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.366 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:57.366 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.366 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.366 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.366 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:57.366 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8320, 2024-03-30T12:21:57.366 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 24 2024-03-30T12:21:57.366 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.366 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:57.366 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 222392, 2024-03-30T12:21:57.366 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3410 2024-03-30T12:21:57.366 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.366 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:57.367 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.367 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.367 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.367 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:57.367 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.367 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.367 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.367 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:57.367 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.367 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.367 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.367 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:57.367 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.367 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.367 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.368 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.368 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.3": { 2024-03-30T12:21:57.368 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:57.368 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.368 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.368 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.368 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:57.368 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6368, 2024-03-30T12:21:57.368 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 123 2024-03-30T12:21:57.368 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.368 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:57.368 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 16896, 2024-03-30T12:21:57.368 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8 2024-03-30T12:21:57.368 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.368 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:57.369 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-03-30T12:21:57.369 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:57.369 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.369 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:57.369 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 3920, 2024-03-30T12:21:57.369 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 49 2024-03-30T12:21:57.369 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.369 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:57.369 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19600, 2024-03-30T12:21:57.369 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 175 2024-03-30T12:21:57.369 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.369 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:57.369 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 480, 2024-03-30T12:21:57.369 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 34 2024-03-30T12:21:57.369 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.370 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:57.370 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.370 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.370 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.370 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:57.370 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 43764, 2024-03-30T12:21:57.370 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8375 2024-03-30T12:21:57.370 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.370 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:57.370 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 125376, 2024-03-30T12:21:57.370 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 216 2024-03-30T12:21:57.370 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.370 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:57.370 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 9220, 2024-03-30T12:21:57.370 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 565 2024-03-30T12:21:57.371 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.371 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:57.371 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8400, 2024-03-30T12:21:57.371 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 175 2024-03-30T12:21:57.371 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.371 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:57.371 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.371 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.371 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.371 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:57.371 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 26472, 2024-03-30T12:21:57.371 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 184 2024-03-30T12:21:57.371 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.371 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:57.371 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19600, 2024-03-30T12:21:57.372 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 175 2024-03-30T12:21:57.372 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.372 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:57.372 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2208, 2024-03-30T12:21:57.372 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:57.372 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.372 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:57.372 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 284717, 2024-03-30T12:21:57.372 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 61 2024-03-30T12:21:57.372 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.372 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:57.372 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 26565, 2024-03-30T12:21:57.372 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 9 2024-03-30T12:21:57.372 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.372 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:57.373 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2437681, 2024-03-30T12:21:57.373 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 185 2024-03-30T12:21:57.373 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.373 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:57.373 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 4664, 2024-03-30T12:21:57.373 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 53 2024-03-30T12:21:57.373 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.373 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:57.373 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.373 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.373 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.373 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:57.373 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 417312, 2024-03-30T12:21:57.373 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 36 2024-03-30T12:21:57.373 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.374 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:57.374 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.374 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.374 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.374 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:57.374 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 10400, 2024-03-30T12:21:57.374 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 20 2024-03-30T12:21:57.374 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.374 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:57.374 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 221624, 2024-03-30T12:21:57.374 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3374 2024-03-30T12:21:57.374 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.374 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:57.374 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.374 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.375 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.375 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:57.375 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.375 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.375 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.375 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:57.375 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.375 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.375 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.375 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:57.375 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.375 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.375 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.375 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.375 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.4": { 2024-03-30T12:21:57.376 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:57.376 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.376 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.376 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.376 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:57.376 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6368, 2024-03-30T12:21:57.376 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 123 2024-03-30T12:21:57.376 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.376 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:57.376 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 16896, 2024-03-30T12:21:57.376 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8 2024-03-30T12:21:57.376 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.376 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:57.376 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-03-30T12:21:57.377 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:57.377 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.377 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:57.377 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 3280, 2024-03-30T12:21:57.377 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 41 2024-03-30T12:21:57.377 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.377 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:57.377 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19264, 2024-03-30T12:21:57.377 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 172 2024-03-30T12:21:57.377 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.377 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:57.377 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 816, 2024-03-30T12:21:57.377 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 37 2024-03-30T12:21:57.377 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.377 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:57.378 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.378 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.378 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.378 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:57.378 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 84696, 2024-03-30T12:21:57.378 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 14661 2024-03-30T12:21:57.378 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.378 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:57.378 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 194056, 2024-03-30T12:21:57.378 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 317 2024-03-30T12:21:57.378 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.378 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:57.378 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 9464, 2024-03-30T12:21:57.378 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 560 2024-03-30T12:21:57.378 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.379 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:57.379 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8256, 2024-03-30T12:21:57.379 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 172 2024-03-30T12:21:57.379 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.379 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:57.379 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.379 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.379 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.379 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:57.379 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 27232, 2024-03-30T12:21:57.379 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 185 2024-03-30T12:21:57.379 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.379 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:57.379 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19264, 2024-03-30T12:21:57.379 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 172 2024-03-30T12:21:57.380 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.380 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:57.380 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 736, 2024-03-30T12:21:57.380 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 1 2024-03-30T12:21:57.380 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.380 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:57.380 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 887720, 2024-03-30T12:21:57.380 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 66 2024-03-30T12:21:57.380 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.380 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:57.380 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12112, 2024-03-30T12:21:57.380 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:57.380 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.380 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:57.380 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2459974, 2024-03-30T12:21:57.380 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 189 2024-03-30T12:21:57.381 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.381 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:57.381 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 4752, 2024-03-30T12:21:57.381 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 54 2024-03-30T12:21:57.381 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.381 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:57.381 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.381 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.381 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.381 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:57.381 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 452088, 2024-03-30T12:21:57.381 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 39 2024-03-30T12:21:57.381 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.381 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:57.381 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.381 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.382 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.382 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:57.382 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 7904, 2024-03-30T12:21:57.382 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 16 2024-03-30T12:21:57.382 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.382 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:57.382 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 222392, 2024-03-30T12:21:57.382 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3410 2024-03-30T12:21:57.382 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.382 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:57.382 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.382 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.382 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.382 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:57.382 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.383 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.383 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.383 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:57.383 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.383 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.383 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.383 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:57.383 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.383 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.383 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.383 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.383 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.5": { 2024-03-30T12:21:57.383 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:57.383 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.383 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.383 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.384 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:57.384 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6368, 2024-03-30T12:21:57.384 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 123 2024-03-30T12:21:57.384 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.384 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:57.384 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 16896, 2024-03-30T12:21:57.384 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8 2024-03-30T12:21:57.384 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.384 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:57.384 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-03-30T12:21:57.384 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:57.384 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.384 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:57.385 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2880, 2024-03-30T12:21:57.385 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 36 2024-03-30T12:21:57.385 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.385 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:57.385 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19488, 2024-03-30T12:21:57.385 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 174 2024-03-30T12:21:57.385 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.385 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:57.385 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 480, 2024-03-30T12:21:57.385 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 34 2024-03-30T12:21:57.385 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.385 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:57.385 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.385 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.386 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.386 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:57.386 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 85864, 2024-03-30T12:21:57.386 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 14866 2024-03-30T12:21:57.386 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.386 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:57.386 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 197456, 2024-03-30T12:21:57.386 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 322 2024-03-30T12:21:57.386 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.386 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:57.386 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 9872, 2024-03-30T12:21:57.386 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 569 2024-03-30T12:21:57.386 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.386 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:57.387 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8352, 2024-03-30T12:21:57.387 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 174 2024-03-30T12:21:57.387 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.387 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:57.387 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.387 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.387 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.387 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:57.387 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 28176, 2024-03-30T12:21:57.387 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 190 2024-03-30T12:21:57.387 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.387 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:57.387 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19488, 2024-03-30T12:21:57.387 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 174 2024-03-30T12:21:57.387 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.387 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:57.388 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2208, 2024-03-30T12:21:57.388 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:57.388 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.388 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:57.388 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 819320, 2024-03-30T12:21:57.388 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 49 2024-03-30T12:21:57.388 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.388 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:57.388 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 26565, 2024-03-30T12:21:57.388 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 9 2024-03-30T12:21:57.388 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.388 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:57.388 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2435296, 2024-03-30T12:21:57.388 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 177 2024-03-30T12:21:57.388 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.388 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:57.389 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5456, 2024-03-30T12:21:57.389 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 62 2024-03-30T12:21:57.389 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.389 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:57.389 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.389 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.389 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.389 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:57.389 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 486864, 2024-03-30T12:21:57.389 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 42 2024-03-30T12:21:57.389 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.389 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:57.389 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.389 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.389 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.389 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:57.390 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 11960, 2024-03-30T12:21:57.390 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 23 2024-03-30T12:21:57.390 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.390 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:57.390 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 222136, 2024-03-30T12:21:57.390 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3398 2024-03-30T12:21:57.390 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.390 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:57.390 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.390 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.390 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.390 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:57.390 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.390 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.390 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.391 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:57.391 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.391 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.391 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.391 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:57.391 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.391 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.391 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.391 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.391 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.6": { 2024-03-30T12:21:57.391 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:57.391 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.391 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.391 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.391 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:57.392 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6368, 2024-03-30T12:21:57.392 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 123 2024-03-30T12:21:57.392 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.392 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:57.392 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 16896, 2024-03-30T12:21:57.392 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8 2024-03-30T12:21:57.392 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.392 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:57.392 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-03-30T12:21:57.392 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:57.392 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.392 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:57.392 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2320, 2024-03-30T12:21:57.393 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 29 2024-03-30T12:21:57.393 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.393 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:57.393 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 20384, 2024-03-30T12:21:57.393 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 182 2024-03-30T12:21:57.393 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.393 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:57.393 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 480, 2024-03-30T12:21:57.393 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 34 2024-03-30T12:21:57.393 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.393 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:57.393 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 14629, 2024-03-30T12:21:57.393 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:57.393 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.394 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:57.394 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 45443, 2024-03-30T12:21:57.394 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8826 2024-03-30T12:21:57.394 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.394 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:57.394 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 127416, 2024-03-30T12:21:57.394 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 219 2024-03-30T12:21:57.394 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.394 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:57.394 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 10764, 2024-03-30T12:21:57.394 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 723 2024-03-30T12:21:57.394 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.394 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:57.394 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8736, 2024-03-30T12:21:57.395 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 182 2024-03-30T12:21:57.395 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.395 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:57.395 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.395 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.395 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.395 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:57.395 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 28604, 2024-03-30T12:21:57.395 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 187 2024-03-30T12:21:57.395 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.395 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:57.395 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 20384, 2024-03-30T12:21:57.395 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 182 2024-03-30T12:21:57.395 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.395 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:57.395 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.396 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.396 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.396 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:57.396 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 197266, 2024-03-30T12:21:57.396 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 41 2024-03-30T12:21:57.396 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.396 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:57.396 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.396 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.396 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.396 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:57.396 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2436605, 2024-03-30T12:21:57.396 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 177 2024-03-30T12:21:57.396 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.396 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:57.396 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 4664, 2024-03-30T12:21:57.397 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 53 2024-03-30T12:21:57.397 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.397 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:57.397 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.397 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.397 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.397 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:57.397 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 452088, 2024-03-30T12:21:57.397 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 39 2024-03-30T12:21:57.397 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.397 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:57.397 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.397 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.397 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.397 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:57.397 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 92352, 2024-03-30T12:21:57.397 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 188 2024-03-30T12:21:57.398 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.398 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:57.398 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 221624, 2024-03-30T12:21:57.398 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3374 2024-03-30T12:21:57.398 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.398 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:57.398 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.398 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.398 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.398 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:57.398 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.398 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.398 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.398 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:57.398 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.399 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.399 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.399 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:57.399 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.399 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.399 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.399 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.399 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.7": { 2024-03-30T12:21:57.399 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:57.399 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.399 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.399 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.399 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:57.399 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6368, 2024-03-30T12:21:57.399 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 123 2024-03-30T12:21:57.400 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.400 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:57.400 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 16896, 2024-03-30T12:21:57.400 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8 2024-03-30T12:21:57.400 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.400 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:57.400 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-03-30T12:21:57.400 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:57.400 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.400 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:57.400 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1600, 2024-03-30T12:21:57.400 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 20 2024-03-30T12:21:57.400 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.400 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:57.400 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 20272, 2024-03-30T12:21:57.401 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 181 2024-03-30T12:21:57.401 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.401 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:57.401 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 928, 2024-03-30T12:21:57.401 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 38 2024-03-30T12:21:57.401 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.401 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:57.401 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 266240, 2024-03-30T12:21:57.401 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 6 2024-03-30T12:21:57.401 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.401 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:57.401 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 88533, 2024-03-30T12:21:57.401 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 15408 2024-03-30T12:21:57.401 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.401 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:57.402 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 200856, 2024-03-30T12:21:57.402 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 327 2024-03-30T12:21:57.402 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.402 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:57.402 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 11528, 2024-03-30T12:21:57.402 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 728 2024-03-30T12:21:57.402 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.402 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:57.402 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8688, 2024-03-30T12:21:57.402 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 181 2024-03-30T12:21:57.402 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.402 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:57.402 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.402 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.403 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.403 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:57.403 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 30820, 2024-03-30T12:21:57.403 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 195 2024-03-30T12:21:57.403 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.403 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:57.403 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 20272, 2024-03-30T12:21:57.403 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 181 2024-03-30T12:21:57.403 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.403 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:57.403 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.403 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.403 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.404 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:57.404 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 151165, 2024-03-30T12:21:57.404 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 30 2024-03-30T12:21:57.404 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.404 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:57.404 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.404 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.404 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.404 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:57.404 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2414766, 2024-03-30T12:21:57.404 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 187 2024-03-30T12:21:57.404 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.404 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:57.404 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5808, 2024-03-30T12:21:57.404 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 66 2024-03-30T12:21:57.404 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.404 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:57.405 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.405 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.405 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.405 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:57.405 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 533232, 2024-03-30T12:21:57.405 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 46 2024-03-30T12:21:57.405 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.405 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:57.405 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.405 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.405 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.405 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:57.405 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 95472, 2024-03-30T12:21:57.405 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 218 2024-03-30T12:21:57.405 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.406 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:57.406 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 221624, 2024-03-30T12:21:57.406 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3374 2024-03-30T12:21:57.406 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.406 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:57.406 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.406 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.406 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.406 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:57.406 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.406 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.406 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.406 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:57.406 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.407 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.407 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.407 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:57.407 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:57.407 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:57.407 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.407 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.407 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.407 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.407 INFO:tasks.workunit.client.0.smithi084.stdout: "metadata": { 2024-03-30T12:21:57.407 INFO:tasks.workunit.client.0.smithi084.stdout: "mds": { 2024-03-30T12:21:57.407 INFO:tasks.workunit.client.0.smithi084.stdout: "arch": { 2024-03-30T12:21:57.407 INFO:tasks.workunit.client.0.smithi084.stdout: "x86_64": 2 2024-03-30T12:21:57.407 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.407 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_version": { 2024-03-30T12:21:57.408 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 2 2024-03-30T12:21:57.408 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.408 INFO:tasks.workunit.client.0.smithi084.stdout: "cpu": { 2024-03-30T12:21:57.408 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 2 2024-03-30T12:21:57.408 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.408 INFO:tasks.workunit.client.0.smithi084.stdout: "distro": { 2024-03-30T12:21:57.408 INFO:tasks.workunit.client.0.smithi084.stdout: "centos": 2 2024-03-30T12:21:57.408 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.408 INFO:tasks.workunit.client.0.smithi084.stdout: "distro_description": { 2024-03-30T12:21:57.408 INFO:tasks.workunit.client.0.smithi084.stdout: "CentOS Stream 8": 2 2024-03-30T12:21:57.408 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.408 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_description": { 2024-03-30T12:21:57.408 INFO:tasks.workunit.client.0.smithi084.stdout: "#1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024": 2 2024-03-30T12:21:57.408 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.408 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_version": { 2024-03-30T12:21:57.409 INFO:tasks.workunit.client.0.smithi084.stdout: "5.14.0-434.el9.x86_64": 2 2024-03-30T12:21:57.409 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.409 INFO:tasks.workunit.client.0.smithi084.stdout: "os": { 2024-03-30T12:21:57.409 INFO:tasks.workunit.client.0.smithi084.stdout: "Linux": 2 2024-03-30T12:21:57.409 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.409 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.409 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-03-30T12:21:57.409 INFO:tasks.workunit.client.0.smithi084.stdout: "arch": { 2024-03-30T12:21:57.409 INFO:tasks.workunit.client.0.smithi084.stdout: "x86_64": 3 2024-03-30T12:21:57.409 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.409 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_version": { 2024-03-30T12:21:57.409 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 3 2024-03-30T12:21:57.409 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.409 INFO:tasks.workunit.client.0.smithi084.stdout: "cpu": { 2024-03-30T12:21:57.410 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 3 2024-03-30T12:21:57.410 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.410 INFO:tasks.workunit.client.0.smithi084.stdout: "distro": { 2024-03-30T12:21:57.410 INFO:tasks.workunit.client.0.smithi084.stdout: "centos": 3 2024-03-30T12:21:57.410 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.410 INFO:tasks.workunit.client.0.smithi084.stdout: "distro_description": { 2024-03-30T12:21:57.410 INFO:tasks.workunit.client.0.smithi084.stdout: "CentOS Stream 8": 3 2024-03-30T12:21:57.410 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.410 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_description": { 2024-03-30T12:21:57.410 INFO:tasks.workunit.client.0.smithi084.stdout: "#1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024": 3 2024-03-30T12:21:57.410 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.410 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_version": { 2024-03-30T12:21:57.410 INFO:tasks.workunit.client.0.smithi084.stdout: "5.14.0-434.el9.x86_64": 3 2024-03-30T12:21:57.410 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.411 INFO:tasks.workunit.client.0.smithi084.stdout: "os": { 2024-03-30T12:21:57.411 INFO:tasks.workunit.client.0.smithi084.stdout: "Linux": 3 2024-03-30T12:21:57.411 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.411 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.411 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:57.411 INFO:tasks.workunit.client.0.smithi084.stdout: "arch": { 2024-03-30T12:21:57.411 INFO:tasks.workunit.client.0.smithi084.stdout: "x86_64": 8 2024-03-30T12:21:57.411 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.411 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_version": { 2024-03-30T12:21:57.411 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 8 2024-03-30T12:21:57.411 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.411 INFO:tasks.workunit.client.0.smithi084.stdout: "cpu": { 2024-03-30T12:21:57.411 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 8 2024-03-30T12:21:57.411 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.411 INFO:tasks.workunit.client.0.smithi084.stdout: "distro": { 2024-03-30T12:21:57.412 INFO:tasks.workunit.client.0.smithi084.stdout: "centos": 8 2024-03-30T12:21:57.412 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.412 INFO:tasks.workunit.client.0.smithi084.stdout: "distro_description": { 2024-03-30T12:21:57.412 INFO:tasks.workunit.client.0.smithi084.stdout: "CentOS Stream 8": 8 2024-03-30T12:21:57.412 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.412 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_description": { 2024-03-30T12:21:57.412 INFO:tasks.workunit.client.0.smithi084.stdout: "#1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024": 8 2024-03-30T12:21:57.412 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.412 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_version": { 2024-03-30T12:21:57.412 INFO:tasks.workunit.client.0.smithi084.stdout: "5.14.0-434.el9.x86_64": 8 2024-03-30T12:21:57.412 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.412 INFO:tasks.workunit.client.0.smithi084.stdout: "os": { 2024-03-30T12:21:57.412 INFO:tasks.workunit.client.0.smithi084.stdout: "Linux": 8 2024-03-30T12:21:57.412 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.413 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_objectstore": { 2024-03-30T12:21:57.413 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": 8 2024-03-30T12:21:57.413 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.413 INFO:tasks.workunit.client.0.smithi084.stdout: "rotational": { 2024-03-30T12:21:57.413 INFO:tasks.workunit.client.0.smithi084.stdout: "0": 8 2024-03-30T12:21:57.413 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.413 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.413 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.413 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-03-30T12:21:57.413 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-03-30T12:21:57.413 INFO:tasks.workunit.client.0.smithi084.stdout: "features": { 2024-03-30T12:21:57.413 INFO:tasks.workunit.client.0.smithi084.stdout: "optional": [], 2024-03-30T12:21:57.413 INFO:tasks.workunit.client.0.smithi084.stdout: "persistent": [ 2024-03-30T12:21:57.413 INFO:tasks.workunit.client.0.smithi084.stdout: "kraken", 2024-03-30T12:21:57.413 INFO:tasks.workunit.client.0.smithi084.stdout: "luminous", 2024-03-30T12:21:57.414 INFO:tasks.workunit.client.0.smithi084.stdout: "mimic", 2024-03-30T12:21:57.414 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap-prune", 2024-03-30T12:21:57.414 INFO:tasks.workunit.client.0.smithi084.stdout: "nautilus", 2024-03-30T12:21:57.414 INFO:tasks.workunit.client.0.smithi084.stdout: "octopus", 2024-03-30T12:21:57.414 INFO:tasks.workunit.client.0.smithi084.stdout: "pacific", 2024-03-30T12:21:57.414 INFO:tasks.workunit.client.0.smithi084.stdout: "elector-pinging", 2024-03-30T12:21:57.414 INFO:tasks.workunit.client.0.smithi084.stdout: "quincy", 2024-03-30T12:21:57.414 INFO:tasks.workunit.client.0.smithi084.stdout: "reef" 2024-03-30T12:21:57.414 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.414 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.414 INFO:tasks.workunit.client.0.smithi084.stdout: "ipv4_addr_mons": 6, 2024-03-30T12:21:57.414 INFO:tasks.workunit.client.0.smithi084.stdout: "ipv6_addr_mons": 0, 2024-03-30T12:21:57.414 INFO:tasks.workunit.client.0.smithi084.stdout: "min_mon_release": 18, 2024-03-30T12:21:57.414 INFO:tasks.workunit.client.0.smithi084.stdout: "v1_addr_mons": 3, 2024-03-30T12:21:57.414 INFO:tasks.workunit.client.0.smithi084.stdout: "v2_addr_mons": 3 2024-03-30T12:21:57.415 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.415 INFO:tasks.workunit.client.0.smithi084.stdout: "organization": "ceph-qa", 2024-03-30T12:21:57.415 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:57.415 INFO:tasks.workunit.client.0.smithi084.stdout: "cluster_network": false, 2024-03-30T12:21:57.415 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 8, 2024-03-30T12:21:57.415 INFO:tasks.workunit.client.0.smithi084.stdout: "require_min_compat_client": "luminous", 2024-03-30T12:21:57.415 INFO:tasks.workunit.client.0.smithi084.stdout: "require_osd_release": "reef" 2024-03-30T12:21:57.415 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.415 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_perf_histograms": [ 2024-03-30T12:21:57.415 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.415 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-30T12:21:57.415 INFO:tasks.workunit.client.0.smithi084.stdout: "axes": [ 2024-03-30T12:21:57.415 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.415 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-03-30T12:21:57.415 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-03-30T12:21:57.416 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Latency (usec)", 2024-03-30T12:21:57.416 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 100000, 2024-03-30T12:21:57.416 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-03-30T12:21:57.416 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-03-30T12:21:57.416 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 99999]", 2024-03-30T12:21:57.416 INFO:tasks.workunit.client.0.smithi084.stdout: "[100000, 199999]", 2024-03-30T12:21:57.416 INFO:tasks.workunit.client.0.smithi084.stdout: "[200000, 399999]", 2024-03-30T12:21:57.416 INFO:tasks.workunit.client.0.smithi084.stdout: "[400000, 799999]", 2024-03-30T12:21:57.416 INFO:tasks.workunit.client.0.smithi084.stdout: "[800000, 1599999]", 2024-03-30T12:21:57.416 INFO:tasks.workunit.client.0.smithi084.stdout: "[1600000, 3199999]", 2024-03-30T12:21:57.416 INFO:tasks.workunit.client.0.smithi084.stdout: "[3200000, 6399999]", 2024-03-30T12:21:57.416 INFO:tasks.workunit.client.0.smithi084.stdout: "[6400000, 12799999]", 2024-03-30T12:21:57.416 INFO:tasks.workunit.client.0.smithi084.stdout: "[12800000, 25599999]", 2024-03-30T12:21:57.416 INFO:tasks.workunit.client.0.smithi084.stdout: "[25600000, 51199999]", 2024-03-30T12:21:57.416 INFO:tasks.workunit.client.0.smithi084.stdout: "[51200000, 102399999]", 2024-03-30T12:21:57.417 INFO:tasks.workunit.client.0.smithi084.stdout: "[102400000, 204799999]", 2024-03-30T12:21:57.417 INFO:tasks.workunit.client.0.smithi084.stdout: "[204800000, 409599999]", 2024-03-30T12:21:57.417 INFO:tasks.workunit.client.0.smithi084.stdout: "[409600000, 819199999]", 2024-03-30T12:21:57.417 INFO:tasks.workunit.client.0.smithi084.stdout: "[819200000, 1638399999]", 2024-03-30T12:21:57.417 INFO:tasks.workunit.client.0.smithi084.stdout: "[1638400000, 3276799999]", 2024-03-30T12:21:57.417 INFO:tasks.workunit.client.0.smithi084.stdout: "[3276800000, 6553599999]", 2024-03-30T12:21:57.417 INFO:tasks.workunit.client.0.smithi084.stdout: "[6553600000, 13107199999]", 2024-03-30T12:21:57.417 INFO:tasks.workunit.client.0.smithi084.stdout: "[13107200000, 26214399999]", 2024-03-30T12:21:57.417 INFO:tasks.workunit.client.0.smithi084.stdout: "[26214400000, 52428799999]", 2024-03-30T12:21:57.417 INFO:tasks.workunit.client.0.smithi084.stdout: "[52428800000, 104857599999]", 2024-03-30T12:21:57.417 INFO:tasks.workunit.client.0.smithi084.stdout: "[104857600000, 209715199999]", 2024-03-30T12:21:57.417 INFO:tasks.workunit.client.0.smithi084.stdout: "[209715200000, 419430399999]", 2024-03-30T12:21:57.417 INFO:tasks.workunit.client.0.smithi084.stdout: "[419430400000, 838860799999]", 2024-03-30T12:21:57.417 INFO:tasks.workunit.client.0.smithi084.stdout: "[838860800000, 1677721599999]", 2024-03-30T12:21:57.417 INFO:tasks.workunit.client.0.smithi084.stdout: "[1677721600000, 3355443199999]", 2024-03-30T12:21:57.417 INFO:tasks.workunit.client.0.smithi084.stdout: "[3355443200000, 6710886399999]", 2024-03-30T12:21:57.418 INFO:tasks.workunit.client.0.smithi084.stdout: "[6710886400000, 13421772799999]", 2024-03-30T12:21:57.418 INFO:tasks.workunit.client.0.smithi084.stdout: "[13421772800000, 26843545599999]", 2024-03-30T12:21:57.418 INFO:tasks.workunit.client.0.smithi084.stdout: "[26843545600000, 53687091199999]", 2024-03-30T12:21:57.418 INFO:tasks.workunit.client.0.smithi084.stdout: "[53687091200000, None]" 2024-03-30T12:21:57.418 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.418 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-03-30T12:21:57.418 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.418 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.418 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-03-30T12:21:57.418 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-03-30T12:21:57.418 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Request size (bytes)", 2024-03-30T12:21:57.418 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 512, 2024-03-30T12:21:57.418 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-03-30T12:21:57.418 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-03-30T12:21:57.418 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 511]", 2024-03-30T12:21:57.419 INFO:tasks.workunit.client.0.smithi084.stdout: "[512, 1023]", 2024-03-30T12:21:57.419 INFO:tasks.workunit.client.0.smithi084.stdout: "[1024, 2047]", 2024-03-30T12:21:57.419 INFO:tasks.workunit.client.0.smithi084.stdout: "[2048, 4095]", 2024-03-30T12:21:57.419 INFO:tasks.workunit.client.0.smithi084.stdout: "[4096, 8191]", 2024-03-30T12:21:57.419 INFO:tasks.workunit.client.0.smithi084.stdout: "[8192, 16383]", 2024-03-30T12:21:57.419 INFO:tasks.workunit.client.0.smithi084.stdout: "[16384, 32767]", 2024-03-30T12:21:57.419 INFO:tasks.workunit.client.0.smithi084.stdout: "[32768, 65535]", 2024-03-30T12:21:57.419 INFO:tasks.workunit.client.0.smithi084.stdout: "[65536, 131071]", 2024-03-30T12:21:57.419 INFO:tasks.workunit.client.0.smithi084.stdout: "[131072, 262143]", 2024-03-30T12:21:57.419 INFO:tasks.workunit.client.0.smithi084.stdout: "[262144, 524287]", 2024-03-30T12:21:57.419 INFO:tasks.workunit.client.0.smithi084.stdout: "[524288, 1048575]", 2024-03-30T12:21:57.419 INFO:tasks.workunit.client.0.smithi084.stdout: "[1048576, 2097151]", 2024-03-30T12:21:57.419 INFO:tasks.workunit.client.0.smithi084.stdout: "[2097152, 4194303]", 2024-03-30T12:21:57.419 INFO:tasks.workunit.client.0.smithi084.stdout: "[4194304, 8388607]", 2024-03-30T12:21:57.420 INFO:tasks.workunit.client.0.smithi084.stdout: "[8388608, 16777215]", 2024-03-30T12:21:57.420 INFO:tasks.workunit.client.0.smithi084.stdout: "[16777216, 33554431]", 2024-03-30T12:21:57.420 INFO:tasks.workunit.client.0.smithi084.stdout: "[33554432, 67108863]", 2024-03-30T12:21:57.420 INFO:tasks.workunit.client.0.smithi084.stdout: "[67108864, 134217727]", 2024-03-30T12:21:57.420 INFO:tasks.workunit.client.0.smithi084.stdout: "[134217728, 268435455]", 2024-03-30T12:21:57.420 INFO:tasks.workunit.client.0.smithi084.stdout: "[268435456, 536870911]", 2024-03-30T12:21:57.420 INFO:tasks.workunit.client.0.smithi084.stdout: "[536870912, 1073741823]", 2024-03-30T12:21:57.420 INFO:tasks.workunit.client.0.smithi084.stdout: "[1073741824, 2147483647]", 2024-03-30T12:21:57.420 INFO:tasks.workunit.client.0.smithi084.stdout: "[2147483648, 4294967295]", 2024-03-30T12:21:57.420 INFO:tasks.workunit.client.0.smithi084.stdout: "[4294967296, 8589934591]", 2024-03-30T12:21:57.420 INFO:tasks.workunit.client.0.smithi084.stdout: "[8589934592, 17179869183]", 2024-03-30T12:21:57.420 INFO:tasks.workunit.client.0.smithi084.stdout: "[17179869184, 34359738367]", 2024-03-30T12:21:57.420 INFO:tasks.workunit.client.0.smithi084.stdout: "[34359738368, 68719476735]", 2024-03-30T12:21:57.420 INFO:tasks.workunit.client.0.smithi084.stdout: "[68719476736, 137438953471]", 2024-03-30T12:21:57.420 INFO:tasks.workunit.client.0.smithi084.stdout: "[137438953472, 274877906943]", 2024-03-30T12:21:57.421 INFO:tasks.workunit.client.0.smithi084.stdout: "[274877906944, None]" 2024-03-30T12:21:57.421 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.421 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-03-30T12:21:57.421 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.421 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.421 INFO:tasks.workunit.client.0.smithi084.stdout: "osds": [ 2024-03-30T12:21:57.421 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.421 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 0, 2024-03-30T12:21:57.421 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.421 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.421 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.421 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.421 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.421 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.422 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.422 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.422 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.422 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.422 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.422 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.422 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.422 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.422 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.422 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.422 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.422 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.422 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.422 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.423 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.423 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.423 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.423 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.423 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.423 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.423 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.423 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.423 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.423 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.423 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.423 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.423 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.423 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.423 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.424 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.424 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 1, 2024-03-30T12:21:57.424 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.424 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.424 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.424 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 22, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.424 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 11, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.424 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.424 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.424 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.424 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.424 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.424 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.424 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.424 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.425 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.425 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.425 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.425 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.425 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.425 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.425 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.425 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.425 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.425 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.425 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.425 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.425 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.425 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.425 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.426 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.426 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.426 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.426 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.426 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.426 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.426 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.426 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.426 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 2, 2024-03-30T12:21:57.426 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.426 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.426 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.426 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.426 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.427 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.427 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.427 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.427 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.427 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.427 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.427 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.427 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.427 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.427 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.427 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.427 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.427 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.427 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.428 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.428 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.428 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.428 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.428 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.428 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.428 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.428 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.428 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.428 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.428 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.428 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.428 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.428 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.428 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.429 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.429 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.429 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 3, 2024-03-30T12:21:57.429 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.429 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.429 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.429 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.429 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.429 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.429 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.429 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.429 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.429 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.429 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.429 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.429 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.430 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.430 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.430 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.430 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.430 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.430 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.430 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.430 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.430 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.430 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.430 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.430 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.430 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.431 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.431 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.431 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.431 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.431 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.431 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.431 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.431 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.431 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.431 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.431 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 4, 2024-03-30T12:21:57.431 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.431 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.431 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.431 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.431 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.432 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.432 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.432 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.432 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.432 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.432 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.432 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.432 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.432 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.432 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.432 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.432 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.432 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.432 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.432 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.432 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.432 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.433 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.433 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.433 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.433 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.433 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.433 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.433 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.433 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.433 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.433 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.433 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.433 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.433 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.433 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.433 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 5, 2024-03-30T12:21:57.433 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.433 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.434 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.434 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.434 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.434 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.434 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.434 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.434 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.434 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.434 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.434 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.434 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.434 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.434 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.435 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.435 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.435 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.435 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.435 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.435 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.435 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.435 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.435 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.435 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.435 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.435 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.435 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.436 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.436 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.436 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.436 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.436 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.436 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.436 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.436 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.436 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 6, 2024-03-30T12:21:57.436 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.436 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.436 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.436 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.436 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.436 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.436 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.437 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.437 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.437 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.437 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.437 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.437 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.437 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.437 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.437 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.437 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.437 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.437 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.437 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.437 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.437 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.437 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.438 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.438 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.438 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.438 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.438 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.438 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.438 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.438 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.438 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.438 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.438 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.438 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.438 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.438 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 7, 2024-03-30T12:21:57.439 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.439 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.439 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.439 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 82, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.439 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 12, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.439 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.439 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.439 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.439 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.439 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.439 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.439 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.439 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.439 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.440 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.440 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.440 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.440 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.440 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.440 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.440 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.440 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.440 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.440 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.440 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.440 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.440 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.440 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.440 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.440 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.441 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.441 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.441 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.441 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.441 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.441 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.441 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.441 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-30T12:21:57.441 INFO:tasks.workunit.client.0.smithi084.stdout: "axes": [ 2024-03-30T12:21:57.441 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.441 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-03-30T12:21:57.441 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-03-30T12:21:57.441 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Latency (usec)", 2024-03-30T12:21:57.441 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 100000, 2024-03-30T12:21:57.442 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-03-30T12:21:57.442 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-03-30T12:21:57.442 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 99999]", 2024-03-30T12:21:57.442 INFO:tasks.workunit.client.0.smithi084.stdout: "[100000, 199999]", 2024-03-30T12:21:57.442 INFO:tasks.workunit.client.0.smithi084.stdout: "[200000, 399999]", 2024-03-30T12:21:57.442 INFO:tasks.workunit.client.0.smithi084.stdout: "[400000, 799999]", 2024-03-30T12:21:57.442 INFO:tasks.workunit.client.0.smithi084.stdout: "[800000, 1599999]", 2024-03-30T12:21:57.442 INFO:tasks.workunit.client.0.smithi084.stdout: "[1600000, 3199999]", 2024-03-30T12:21:57.442 INFO:tasks.workunit.client.0.smithi084.stdout: "[3200000, 6399999]", 2024-03-30T12:21:57.442 INFO:tasks.workunit.client.0.smithi084.stdout: "[6400000, 12799999]", 2024-03-30T12:21:57.442 INFO:tasks.workunit.client.0.smithi084.stdout: "[12800000, 25599999]", 2024-03-30T12:21:57.442 INFO:tasks.workunit.client.0.smithi084.stdout: "[25600000, 51199999]", 2024-03-30T12:21:57.442 INFO:tasks.workunit.client.0.smithi084.stdout: "[51200000, 102399999]", 2024-03-30T12:21:57.442 INFO:tasks.workunit.client.0.smithi084.stdout: "[102400000, 204799999]", 2024-03-30T12:21:57.442 INFO:tasks.workunit.client.0.smithi084.stdout: "[204800000, 409599999]", 2024-03-30T12:21:57.442 INFO:tasks.workunit.client.0.smithi084.stdout: "[409600000, 819199999]", 2024-03-30T12:21:57.443 INFO:tasks.workunit.client.0.smithi084.stdout: "[819200000, 1638399999]", 2024-03-30T12:21:57.443 INFO:tasks.workunit.client.0.smithi084.stdout: "[1638400000, 3276799999]", 2024-03-30T12:21:57.443 INFO:tasks.workunit.client.0.smithi084.stdout: "[3276800000, 6553599999]", 2024-03-30T12:21:57.443 INFO:tasks.workunit.client.0.smithi084.stdout: "[6553600000, 13107199999]", 2024-03-30T12:21:57.443 INFO:tasks.workunit.client.0.smithi084.stdout: "[13107200000, 26214399999]", 2024-03-30T12:21:57.443 INFO:tasks.workunit.client.0.smithi084.stdout: "[26214400000, 52428799999]", 2024-03-30T12:21:57.443 INFO:tasks.workunit.client.0.smithi084.stdout: "[52428800000, 104857599999]", 2024-03-30T12:21:57.443 INFO:tasks.workunit.client.0.smithi084.stdout: "[104857600000, 209715199999]", 2024-03-30T12:21:57.443 INFO:tasks.workunit.client.0.smithi084.stdout: "[209715200000, 419430399999]", 2024-03-30T12:21:57.443 INFO:tasks.workunit.client.0.smithi084.stdout: "[419430400000, 838860799999]", 2024-03-30T12:21:57.443 INFO:tasks.workunit.client.0.smithi084.stdout: "[838860800000, 1677721599999]", 2024-03-30T12:21:57.443 INFO:tasks.workunit.client.0.smithi084.stdout: "[1677721600000, 3355443199999]", 2024-03-30T12:21:57.443 INFO:tasks.workunit.client.0.smithi084.stdout: "[3355443200000, 6710886399999]", 2024-03-30T12:21:57.443 INFO:tasks.workunit.client.0.smithi084.stdout: "[6710886400000, 13421772799999]", 2024-03-30T12:21:57.443 INFO:tasks.workunit.client.0.smithi084.stdout: "[13421772800000, 26843545599999]", 2024-03-30T12:21:57.443 INFO:tasks.workunit.client.0.smithi084.stdout: "[26843545600000, 53687091199999]", 2024-03-30T12:21:57.444 INFO:tasks.workunit.client.0.smithi084.stdout: "[53687091200000, None]" 2024-03-30T12:21:57.444 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.444 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-03-30T12:21:57.444 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.444 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.444 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-03-30T12:21:57.444 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-03-30T12:21:57.444 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Request size (bytes)", 2024-03-30T12:21:57.444 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 512, 2024-03-30T12:21:57.444 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-03-30T12:21:57.444 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-03-30T12:21:57.444 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 511]", 2024-03-30T12:21:57.444 INFO:tasks.workunit.client.0.smithi084.stdout: "[512, 1023]", 2024-03-30T12:21:57.444 INFO:tasks.workunit.client.0.smithi084.stdout: "[1024, 2047]", 2024-03-30T12:21:57.445 INFO:tasks.workunit.client.0.smithi084.stdout: "[2048, 4095]", 2024-03-30T12:21:57.445 INFO:tasks.workunit.client.0.smithi084.stdout: "[4096, 8191]", 2024-03-30T12:21:57.445 INFO:tasks.workunit.client.0.smithi084.stdout: "[8192, 16383]", 2024-03-30T12:21:57.445 INFO:tasks.workunit.client.0.smithi084.stdout: "[16384, 32767]", 2024-03-30T12:21:57.445 INFO:tasks.workunit.client.0.smithi084.stdout: "[32768, 65535]", 2024-03-30T12:21:57.445 INFO:tasks.workunit.client.0.smithi084.stdout: "[65536, 131071]", 2024-03-30T12:21:57.445 INFO:tasks.workunit.client.0.smithi084.stdout: "[131072, 262143]", 2024-03-30T12:21:57.445 INFO:tasks.workunit.client.0.smithi084.stdout: "[262144, 524287]", 2024-03-30T12:21:57.445 INFO:tasks.workunit.client.0.smithi084.stdout: "[524288, 1048575]", 2024-03-30T12:21:57.445 INFO:tasks.workunit.client.0.smithi084.stdout: "[1048576, 2097151]", 2024-03-30T12:21:57.445 INFO:tasks.workunit.client.0.smithi084.stdout: "[2097152, 4194303]", 2024-03-30T12:21:57.445 INFO:tasks.workunit.client.0.smithi084.stdout: "[4194304, 8388607]", 2024-03-30T12:21:57.445 INFO:tasks.workunit.client.0.smithi084.stdout: "[8388608, 16777215]", 2024-03-30T12:21:57.445 INFO:tasks.workunit.client.0.smithi084.stdout: "[16777216, 33554431]", 2024-03-30T12:21:57.445 INFO:tasks.workunit.client.0.smithi084.stdout: "[33554432, 67108863]", 2024-03-30T12:21:57.446 INFO:tasks.workunit.client.0.smithi084.stdout: "[67108864, 134217727]", 2024-03-30T12:21:57.446 INFO:tasks.workunit.client.0.smithi084.stdout: "[134217728, 268435455]", 2024-03-30T12:21:57.446 INFO:tasks.workunit.client.0.smithi084.stdout: "[268435456, 536870911]", 2024-03-30T12:21:57.446 INFO:tasks.workunit.client.0.smithi084.stdout: "[536870912, 1073741823]", 2024-03-30T12:21:57.446 INFO:tasks.workunit.client.0.smithi084.stdout: "[1073741824, 2147483647]", 2024-03-30T12:21:57.446 INFO:tasks.workunit.client.0.smithi084.stdout: "[2147483648, 4294967295]", 2024-03-30T12:21:57.446 INFO:tasks.workunit.client.0.smithi084.stdout: "[4294967296, 8589934591]", 2024-03-30T12:21:57.446 INFO:tasks.workunit.client.0.smithi084.stdout: "[8589934592, 17179869183]", 2024-03-30T12:21:57.446 INFO:tasks.workunit.client.0.smithi084.stdout: "[17179869184, 34359738367]", 2024-03-30T12:21:57.446 INFO:tasks.workunit.client.0.smithi084.stdout: "[34359738368, 68719476735]", 2024-03-30T12:21:57.446 INFO:tasks.workunit.client.0.smithi084.stdout: "[68719476736, 137438953471]", 2024-03-30T12:21:57.446 INFO:tasks.workunit.client.0.smithi084.stdout: "[137438953472, 274877906943]", 2024-03-30T12:21:57.446 INFO:tasks.workunit.client.0.smithi084.stdout: "[274877906944, None]" 2024-03-30T12:21:57.446 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.446 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-03-30T12:21:57.447 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.447 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.447 INFO:tasks.workunit.client.0.smithi084.stdout: "osds": [ 2024-03-30T12:21:57.447 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.447 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 0, 2024-03-30T12:21:57.447 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.447 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.447 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.447 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.447 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.447 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.447 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.447 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.447 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.447 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.448 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.448 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.448 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.448 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.448 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.448 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.448 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.448 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.448 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.448 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.448 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.448 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.448 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.449 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.449 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.449 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.449 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.449 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.449 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.449 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.449 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.449 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.449 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.449 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.449 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.449 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.449 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 1, 2024-03-30T12:21:57.449 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.449 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.450 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.450 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.450 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.450 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 12, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.450 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 9, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.450 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.450 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.450 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.450 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.450 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.450 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.450 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.450 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.450 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.450 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.451 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.451 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.451 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.451 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.451 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.451 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.451 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.451 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.451 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.451 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.451 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.451 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.451 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.451 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.451 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.451 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.452 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.452 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.452 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.452 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 2, 2024-03-30T12:21:57.452 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.452 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.452 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.452 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.452 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.452 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.452 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.452 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.452 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.452 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.452 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.453 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.453 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.453 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.453 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.453 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.453 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.453 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.453 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.453 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.453 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.453 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.453 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.453 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.453 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.453 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.453 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.454 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.454 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.454 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.454 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.454 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.454 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.454 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.454 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.454 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.454 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 3, 2024-03-30T12:21:57.454 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.454 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.454 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.454 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.454 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.455 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.455 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.455 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.455 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.455 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.455 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.455 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.455 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.455 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.455 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.455 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.455 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.455 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.455 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.455 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.455 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.456 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.456 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.456 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.456 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.456 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.456 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.456 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.456 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.456 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.456 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.456 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.456 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.456 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.456 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.457 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.457 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 4, 2024-03-30T12:21:57.457 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.457 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.457 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.457 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.457 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.457 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.457 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.457 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.457 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.457 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.457 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.457 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.458 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.458 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.458 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.458 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.458 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.458 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.458 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.458 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.458 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.458 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.458 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.458 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.458 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.458 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.459 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.459 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.459 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.459 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.459 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.459 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.459 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.459 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.459 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.459 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.459 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 5, 2024-03-30T12:21:57.459 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.459 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.459 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.459 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.460 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.460 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.460 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.460 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.460 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.460 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.460 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.460 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.460 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.460 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.460 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.460 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.460 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.460 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.460 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.461 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.461 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.461 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.461 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.461 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.461 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.461 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.461 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.461 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.461 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.461 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.461 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.461 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.461 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.461 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.461 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.462 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.462 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 6, 2024-03-30T12:21:57.462 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.462 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.462 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.462 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.462 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.462 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.462 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.462 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.462 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.462 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.462 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.463 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.463 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.463 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.463 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.463 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.463 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.463 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.463 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.463 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.463 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.463 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.463 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.463 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.463 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.463 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.464 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.464 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.464 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.464 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.464 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.464 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.464 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.464 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.464 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.464 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.464 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 7, 2024-03-30T12:21:57.464 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.464 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.464 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.464 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.465 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.465 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.465 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 33, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.465 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.465 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.465 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.465 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.465 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.465 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.465 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.465 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.465 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.465 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.465 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.465 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.465 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.466 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.466 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.466 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.466 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.466 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.466 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.466 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.466 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.466 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.466 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.466 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.466 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.466 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.466 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.466 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.466 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.467 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.467 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-30T12:21:57.467 INFO:tasks.workunit.client.0.smithi084.stdout: "axes": [ 2024-03-30T12:21:57.467 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.467 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-03-30T12:21:57.467 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-03-30T12:21:57.467 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Latency (usec)", 2024-03-30T12:21:57.467 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 100000, 2024-03-30T12:21:57.467 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-03-30T12:21:57.467 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-03-30T12:21:57.467 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 99999]", 2024-03-30T12:21:57.467 INFO:tasks.workunit.client.0.smithi084.stdout: "[100000, 199999]", 2024-03-30T12:21:57.467 INFO:tasks.workunit.client.0.smithi084.stdout: "[200000, 399999]", 2024-03-30T12:21:57.467 INFO:tasks.workunit.client.0.smithi084.stdout: "[400000, 799999]", 2024-03-30T12:21:57.467 INFO:tasks.workunit.client.0.smithi084.stdout: "[800000, 1599999]", 2024-03-30T12:21:57.468 INFO:tasks.workunit.client.0.smithi084.stdout: "[1600000, 3199999]", 2024-03-30T12:21:57.468 INFO:tasks.workunit.client.0.smithi084.stdout: "[3200000, 6399999]", 2024-03-30T12:21:57.468 INFO:tasks.workunit.client.0.smithi084.stdout: "[6400000, 12799999]", 2024-03-30T12:21:57.468 INFO:tasks.workunit.client.0.smithi084.stdout: "[12800000, 25599999]", 2024-03-30T12:21:57.468 INFO:tasks.workunit.client.0.smithi084.stdout: "[25600000, 51199999]", 2024-03-30T12:21:57.468 INFO:tasks.workunit.client.0.smithi084.stdout: "[51200000, 102399999]", 2024-03-30T12:21:57.468 INFO:tasks.workunit.client.0.smithi084.stdout: "[102400000, 204799999]", 2024-03-30T12:21:57.468 INFO:tasks.workunit.client.0.smithi084.stdout: "[204800000, 409599999]", 2024-03-30T12:21:57.468 INFO:tasks.workunit.client.0.smithi084.stdout: "[409600000, 819199999]", 2024-03-30T12:21:57.468 INFO:tasks.workunit.client.0.smithi084.stdout: "[819200000, 1638399999]", 2024-03-30T12:21:57.468 INFO:tasks.workunit.client.0.smithi084.stdout: "[1638400000, 3276799999]", 2024-03-30T12:21:57.468 INFO:tasks.workunit.client.0.smithi084.stdout: "[3276800000, 6553599999]", 2024-03-30T12:21:57.468 INFO:tasks.workunit.client.0.smithi084.stdout: "[6553600000, 13107199999]", 2024-03-30T12:21:57.468 INFO:tasks.workunit.client.0.smithi084.stdout: "[13107200000, 26214399999]", 2024-03-30T12:21:57.468 INFO:tasks.workunit.client.0.smithi084.stdout: "[26214400000, 52428799999]", 2024-03-30T12:21:57.468 INFO:tasks.workunit.client.0.smithi084.stdout: "[52428800000, 104857599999]", 2024-03-30T12:21:57.469 INFO:tasks.workunit.client.0.smithi084.stdout: "[104857600000, 209715199999]", 2024-03-30T12:21:57.469 INFO:tasks.workunit.client.0.smithi084.stdout: "[209715200000, 419430399999]", 2024-03-30T12:21:57.469 INFO:tasks.workunit.client.0.smithi084.stdout: "[419430400000, 838860799999]", 2024-03-30T12:21:57.469 INFO:tasks.workunit.client.0.smithi084.stdout: "[838860800000, 1677721599999]", 2024-03-30T12:21:57.469 INFO:tasks.workunit.client.0.smithi084.stdout: "[1677721600000, 3355443199999]", 2024-03-30T12:21:57.469 INFO:tasks.workunit.client.0.smithi084.stdout: "[3355443200000, 6710886399999]", 2024-03-30T12:21:57.469 INFO:tasks.workunit.client.0.smithi084.stdout: "[6710886400000, 13421772799999]", 2024-03-30T12:21:57.469 INFO:tasks.workunit.client.0.smithi084.stdout: "[13421772800000, 26843545599999]", 2024-03-30T12:21:57.469 INFO:tasks.workunit.client.0.smithi084.stdout: "[26843545600000, 53687091199999]", 2024-03-30T12:21:57.469 INFO:tasks.workunit.client.0.smithi084.stdout: "[53687091200000, None]" 2024-03-30T12:21:57.469 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.469 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-03-30T12:21:57.469 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.469 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.469 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-03-30T12:21:57.470 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-03-30T12:21:57.470 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Request size (bytes)", 2024-03-30T12:21:57.470 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 512, 2024-03-30T12:21:57.470 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-03-30T12:21:57.470 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-03-30T12:21:57.470 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 511]", 2024-03-30T12:21:57.470 INFO:tasks.workunit.client.0.smithi084.stdout: "[512, 1023]", 2024-03-30T12:21:57.470 INFO:tasks.workunit.client.0.smithi084.stdout: "[1024, 2047]", 2024-03-30T12:21:57.470 INFO:tasks.workunit.client.0.smithi084.stdout: "[2048, 4095]", 2024-03-30T12:21:57.470 INFO:tasks.workunit.client.0.smithi084.stdout: "[4096, 8191]", 2024-03-30T12:21:57.470 INFO:tasks.workunit.client.0.smithi084.stdout: "[8192, 16383]", 2024-03-30T12:21:57.470 INFO:tasks.workunit.client.0.smithi084.stdout: "[16384, 32767]", 2024-03-30T12:21:57.470 INFO:tasks.workunit.client.0.smithi084.stdout: "[32768, 65535]", 2024-03-30T12:21:57.470 INFO:tasks.workunit.client.0.smithi084.stdout: "[65536, 131071]", 2024-03-30T12:21:57.470 INFO:tasks.workunit.client.0.smithi084.stdout: "[131072, 262143]", 2024-03-30T12:21:57.471 INFO:tasks.workunit.client.0.smithi084.stdout: "[262144, 524287]", 2024-03-30T12:21:57.471 INFO:tasks.workunit.client.0.smithi084.stdout: "[524288, 1048575]", 2024-03-30T12:21:57.471 INFO:tasks.workunit.client.0.smithi084.stdout: "[1048576, 2097151]", 2024-03-30T12:21:57.471 INFO:tasks.workunit.client.0.smithi084.stdout: "[2097152, 4194303]", 2024-03-30T12:21:57.471 INFO:tasks.workunit.client.0.smithi084.stdout: "[4194304, 8388607]", 2024-03-30T12:21:57.471 INFO:tasks.workunit.client.0.smithi084.stdout: "[8388608, 16777215]", 2024-03-30T12:21:57.471 INFO:tasks.workunit.client.0.smithi084.stdout: "[16777216, 33554431]", 2024-03-30T12:21:57.471 INFO:tasks.workunit.client.0.smithi084.stdout: "[33554432, 67108863]", 2024-03-30T12:21:57.471 INFO:tasks.workunit.client.0.smithi084.stdout: "[67108864, 134217727]", 2024-03-30T12:21:57.471 INFO:tasks.workunit.client.0.smithi084.stdout: "[134217728, 268435455]", 2024-03-30T12:21:57.471 INFO:tasks.workunit.client.0.smithi084.stdout: "[268435456, 536870911]", 2024-03-30T12:21:57.471 INFO:tasks.workunit.client.0.smithi084.stdout: "[536870912, 1073741823]", 2024-03-30T12:21:57.471 INFO:tasks.workunit.client.0.smithi084.stdout: "[1073741824, 2147483647]", 2024-03-30T12:21:57.471 INFO:tasks.workunit.client.0.smithi084.stdout: "[2147483648, 4294967295]", 2024-03-30T12:21:57.471 INFO:tasks.workunit.client.0.smithi084.stdout: "[4294967296, 8589934591]", 2024-03-30T12:21:57.472 INFO:tasks.workunit.client.0.smithi084.stdout: "[8589934592, 17179869183]", 2024-03-30T12:21:57.472 INFO:tasks.workunit.client.0.smithi084.stdout: "[17179869184, 34359738367]", 2024-03-30T12:21:57.472 INFO:tasks.workunit.client.0.smithi084.stdout: "[34359738368, 68719476735]", 2024-03-30T12:21:57.472 INFO:tasks.workunit.client.0.smithi084.stdout: "[68719476736, 137438953471]", 2024-03-30T12:21:57.472 INFO:tasks.workunit.client.0.smithi084.stdout: "[137438953472, 274877906943]", 2024-03-30T12:21:57.472 INFO:tasks.workunit.client.0.smithi084.stdout: "[274877906944, None]" 2024-03-30T12:21:57.472 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.472 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-03-30T12:21:57.472 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.472 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.472 INFO:tasks.workunit.client.0.smithi084.stdout: "osds": [ 2024-03-30T12:21:57.472 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.472 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 0, 2024-03-30T12:21:57.472 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.473 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.473 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.473 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.473 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.473 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.473 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.473 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.473 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.473 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.473 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.473 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.473 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.473 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.473 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.473 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.473 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.474 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.474 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.474 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.474 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.474 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.474 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.474 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.474 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.474 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.474 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.474 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.474 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.474 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.474 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.475 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.475 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.475 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.475 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.475 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.475 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 1, 2024-03-30T12:21:57.475 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.475 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.475 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.475 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.475 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.475 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 12, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.475 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 9, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.475 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.476 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.476 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.476 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.476 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.476 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.476 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.476 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.476 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.476 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.476 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.476 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.476 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.476 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.476 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.476 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.477 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.477 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.477 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.477 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.477 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.477 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.477 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.477 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.477 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.477 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.477 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.477 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.477 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.477 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 2, 2024-03-30T12:21:57.477 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.477 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.478 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.478 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.478 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.478 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.478 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.478 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.478 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.478 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.478 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.478 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.478 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.478 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.478 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.478 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.479 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.479 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.479 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.479 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.479 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.479 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.479 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.479 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.479 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.479 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.479 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.479 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.479 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.479 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.479 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.480 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.480 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.480 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.480 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.480 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.480 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 3, 2024-03-30T12:21:57.480 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.480 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.480 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.480 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.480 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.480 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.480 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.480 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.481 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.481 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.481 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.481 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.481 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.481 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.481 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.481 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.481 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.481 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.481 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.481 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.481 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.481 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.481 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.482 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.482 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.482 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.482 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.482 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.482 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.482 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.482 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.482 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.482 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.482 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.482 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.482 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.482 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 4, 2024-03-30T12:21:57.483 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.483 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.483 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.483 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.483 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.483 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.483 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.483 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.483 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.483 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.483 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.483 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.483 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.483 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.483 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.484 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.484 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.484 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.484 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.484 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.484 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.484 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.484 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.484 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.484 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.484 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.484 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.484 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.484 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.484 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.485 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.485 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.485 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.485 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.485 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.485 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.485 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 5, 2024-03-30T12:21:57.485 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.485 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.485 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.485 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.485 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.485 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.485 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.485 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.486 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.486 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.486 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.486 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.486 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.486 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.486 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.486 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.486 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.486 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.486 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.486 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.486 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.486 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.486 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.487 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.487 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.487 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.487 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.487 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.487 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.487 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.487 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.487 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.487 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.487 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.487 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.487 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.487 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 6, 2024-03-30T12:21:57.487 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.487 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.487 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.488 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.488 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.488 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.488 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.488 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.488 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.488 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.488 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.488 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.488 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.488 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.488 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.488 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.488 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.488 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.489 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.489 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.489 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.489 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.489 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.489 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.489 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.489 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.489 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.489 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.489 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.489 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.489 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.489 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.489 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.490 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.490 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.490 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.490 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 7, 2024-03-30T12:21:57.490 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.490 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.490 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.490 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.490 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.490 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.490 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 33, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.490 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.490 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.491 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.491 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.491 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.491 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.491 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.491 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.491 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.491 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.491 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.491 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.491 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.491 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.491 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.491 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.491 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.492 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.492 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.492 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.492 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.492 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.492 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.492 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.492 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.492 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.492 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.492 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.492 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.492 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.492 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-30T12:21:57.493 INFO:tasks.workunit.client.0.smithi084.stdout: "axes": [ 2024-03-30T12:21:57.493 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.493 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-03-30T12:21:57.493 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-03-30T12:21:57.493 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Latency (usec)", 2024-03-30T12:21:57.493 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 100000, 2024-03-30T12:21:57.493 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-03-30T12:21:57.493 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-03-30T12:21:57.493 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 99999]", 2024-03-30T12:21:57.493 INFO:tasks.workunit.client.0.smithi084.stdout: "[100000, 199999]", 2024-03-30T12:21:57.493 INFO:tasks.workunit.client.0.smithi084.stdout: "[200000, 399999]", 2024-03-30T12:21:57.493 INFO:tasks.workunit.client.0.smithi084.stdout: "[400000, 799999]", 2024-03-30T12:21:57.493 INFO:tasks.workunit.client.0.smithi084.stdout: "[800000, 1599999]", 2024-03-30T12:21:57.493 INFO:tasks.workunit.client.0.smithi084.stdout: "[1600000, 3199999]", 2024-03-30T12:21:57.493 INFO:tasks.workunit.client.0.smithi084.stdout: "[3200000, 6399999]", 2024-03-30T12:21:57.493 INFO:tasks.workunit.client.0.smithi084.stdout: "[6400000, 12799999]", 2024-03-30T12:21:57.494 INFO:tasks.workunit.client.0.smithi084.stdout: "[12800000, 25599999]", 2024-03-30T12:21:57.494 INFO:tasks.workunit.client.0.smithi084.stdout: "[25600000, 51199999]", 2024-03-30T12:21:57.494 INFO:tasks.workunit.client.0.smithi084.stdout: "[51200000, 102399999]", 2024-03-30T12:21:57.494 INFO:tasks.workunit.client.0.smithi084.stdout: "[102400000, 204799999]", 2024-03-30T12:21:57.494 INFO:tasks.workunit.client.0.smithi084.stdout: "[204800000, 409599999]", 2024-03-30T12:21:57.494 INFO:tasks.workunit.client.0.smithi084.stdout: "[409600000, 819199999]", 2024-03-30T12:21:57.494 INFO:tasks.workunit.client.0.smithi084.stdout: "[819200000, 1638399999]", 2024-03-30T12:21:57.494 INFO:tasks.workunit.client.0.smithi084.stdout: "[1638400000, 3276799999]", 2024-03-30T12:21:57.494 INFO:tasks.workunit.client.0.smithi084.stdout: "[3276800000, 6553599999]", 2024-03-30T12:21:57.494 INFO:tasks.workunit.client.0.smithi084.stdout: "[6553600000, 13107199999]", 2024-03-30T12:21:57.494 INFO:tasks.workunit.client.0.smithi084.stdout: "[13107200000, 26214399999]", 2024-03-30T12:21:57.494 INFO:tasks.workunit.client.0.smithi084.stdout: "[26214400000, 52428799999]", 2024-03-30T12:21:57.494 INFO:tasks.workunit.client.0.smithi084.stdout: "[52428800000, 104857599999]", 2024-03-30T12:21:57.494 INFO:tasks.workunit.client.0.smithi084.stdout: "[104857600000, 209715199999]", 2024-03-30T12:21:57.495 INFO:tasks.workunit.client.0.smithi084.stdout: "[209715200000, 419430399999]", 2024-03-30T12:21:57.495 INFO:tasks.workunit.client.0.smithi084.stdout: "[419430400000, 838860799999]", 2024-03-30T12:21:57.495 INFO:tasks.workunit.client.0.smithi084.stdout: "[838860800000, 1677721599999]", 2024-03-30T12:21:57.495 INFO:tasks.workunit.client.0.smithi084.stdout: "[1677721600000, 3355443199999]", 2024-03-30T12:21:57.495 INFO:tasks.workunit.client.0.smithi084.stdout: "[3355443200000, 6710886399999]", 2024-03-30T12:21:57.495 INFO:tasks.workunit.client.0.smithi084.stdout: "[6710886400000, 13421772799999]", 2024-03-30T12:21:57.495 INFO:tasks.workunit.client.0.smithi084.stdout: "[13421772800000, 26843545599999]", 2024-03-30T12:21:57.495 INFO:tasks.workunit.client.0.smithi084.stdout: "[26843545600000, 53687091199999]", 2024-03-30T12:21:57.495 INFO:tasks.workunit.client.0.smithi084.stdout: "[53687091200000, None]" 2024-03-30T12:21:57.495 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.495 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-03-30T12:21:57.495 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.495 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.495 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-03-30T12:21:57.495 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-03-30T12:21:57.495 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Request size (bytes)", 2024-03-30T12:21:57.495 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 512, 2024-03-30T12:21:57.496 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-03-30T12:21:57.496 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-03-30T12:21:57.496 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 511]", 2024-03-30T12:21:57.496 INFO:tasks.workunit.client.0.smithi084.stdout: "[512, 1023]", 2024-03-30T12:21:57.496 INFO:tasks.workunit.client.0.smithi084.stdout: "[1024, 2047]", 2024-03-30T12:21:57.496 INFO:tasks.workunit.client.0.smithi084.stdout: "[2048, 4095]", 2024-03-30T12:21:57.496 INFO:tasks.workunit.client.0.smithi084.stdout: "[4096, 8191]", 2024-03-30T12:21:57.496 INFO:tasks.workunit.client.0.smithi084.stdout: "[8192, 16383]", 2024-03-30T12:21:57.496 INFO:tasks.workunit.client.0.smithi084.stdout: "[16384, 32767]", 2024-03-30T12:21:57.496 INFO:tasks.workunit.client.0.smithi084.stdout: "[32768, 65535]", 2024-03-30T12:21:57.496 INFO:tasks.workunit.client.0.smithi084.stdout: "[65536, 131071]", 2024-03-30T12:21:57.496 INFO:tasks.workunit.client.0.smithi084.stdout: "[131072, 262143]", 2024-03-30T12:21:57.496 INFO:tasks.workunit.client.0.smithi084.stdout: "[262144, 524287]", 2024-03-30T12:21:57.496 INFO:tasks.workunit.client.0.smithi084.stdout: "[524288, 1048575]", 2024-03-30T12:21:57.496 INFO:tasks.workunit.client.0.smithi084.stdout: "[1048576, 2097151]", 2024-03-30T12:21:57.496 INFO:tasks.workunit.client.0.smithi084.stdout: "[2097152, 4194303]", 2024-03-30T12:21:57.497 INFO:tasks.workunit.client.0.smithi084.stdout: "[4194304, 8388607]", 2024-03-30T12:21:57.497 INFO:tasks.workunit.client.0.smithi084.stdout: "[8388608, 16777215]", 2024-03-30T12:21:57.497 INFO:tasks.workunit.client.0.smithi084.stdout: "[16777216, 33554431]", 2024-03-30T12:21:57.497 INFO:tasks.workunit.client.0.smithi084.stdout: "[33554432, 67108863]", 2024-03-30T12:21:57.497 INFO:tasks.workunit.client.0.smithi084.stdout: "[67108864, 134217727]", 2024-03-30T12:21:57.497 INFO:tasks.workunit.client.0.smithi084.stdout: "[134217728, 268435455]", 2024-03-30T12:21:57.497 INFO:tasks.workunit.client.0.smithi084.stdout: "[268435456, 536870911]", 2024-03-30T12:21:57.497 INFO:tasks.workunit.client.0.smithi084.stdout: "[536870912, 1073741823]", 2024-03-30T12:21:57.497 INFO:tasks.workunit.client.0.smithi084.stdout: "[1073741824, 2147483647]", 2024-03-30T12:21:57.497 INFO:tasks.workunit.client.0.smithi084.stdout: "[2147483648, 4294967295]", 2024-03-30T12:21:57.497 INFO:tasks.workunit.client.0.smithi084.stdout: "[4294967296, 8589934591]", 2024-03-30T12:21:57.497 INFO:tasks.workunit.client.0.smithi084.stdout: "[8589934592, 17179869183]", 2024-03-30T12:21:57.497 INFO:tasks.workunit.client.0.smithi084.stdout: "[17179869184, 34359738367]", 2024-03-30T12:21:57.497 INFO:tasks.workunit.client.0.smithi084.stdout: "[34359738368, 68719476735]", 2024-03-30T12:21:57.497 INFO:tasks.workunit.client.0.smithi084.stdout: "[68719476736, 137438953471]", 2024-03-30T12:21:57.498 INFO:tasks.workunit.client.0.smithi084.stdout: "[137438953472, 274877906943]", 2024-03-30T12:21:57.498 INFO:tasks.workunit.client.0.smithi084.stdout: "[274877906944, None]" 2024-03-30T12:21:57.498 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.498 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-03-30T12:21:57.498 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.498 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.498 INFO:tasks.workunit.client.0.smithi084.stdout: "osds": [ 2024-03-30T12:21:57.498 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.498 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 0, 2024-03-30T12:21:57.498 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.498 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.498 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.498 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.498 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.499 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.499 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.499 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.499 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.499 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 2, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.499 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.499 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.499 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.499 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.499 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.499 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.499 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.499 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.499 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.499 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.499 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.500 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.500 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.500 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.500 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.500 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.500 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.500 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.500 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.500 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.500 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.500 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.500 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.500 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.500 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.501 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.501 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 1, 2024-03-30T12:21:57.501 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.501 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.501 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.501 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.501 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.501 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.501 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 6, 4, 0, 0, 0, 0, 0, 0, 9, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.501 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 15, 3, 0, 0, 0, 0, 0, 0, 17, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.501 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 18, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.501 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 9, 1, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.501 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.501 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.501 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.502 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.502 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.502 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.502 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.502 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.502 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.502 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.502 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.502 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.502 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.502 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.502 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.502 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.502 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.503 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.503 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.503 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.503 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.503 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.503 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.503 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.503 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.503 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.503 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 2, 2024-03-30T12:21:57.503 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.503 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.503 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.503 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.503 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.504 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.504 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.504 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.504 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.504 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.504 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.504 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.504 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.504 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.504 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.504 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.504 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.504 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.504 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.504 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.505 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.505 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.505 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.505 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.505 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.505 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.505 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.505 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.505 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.505 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.505 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.505 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.505 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.505 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.505 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.506 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.506 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 3, 2024-03-30T12:21:57.506 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.506 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.506 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.506 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.506 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.506 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.506 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.506 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.506 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.506 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.506 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.506 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.506 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.507 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.507 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.507 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.507 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.507 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.507 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.507 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.507 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.507 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.507 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.507 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.507 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.507 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.508 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.508 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.508 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.508 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.508 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.508 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.508 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.508 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.508 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.508 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.508 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 4, 2024-03-30T12:21:57.508 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.508 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.508 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.509 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.509 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.509 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.509 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.509 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.509 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.509 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.509 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.509 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.509 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.509 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.509 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.509 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.509 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.509 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.510 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.510 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.510 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.510 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.510 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.510 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.510 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.510 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.510 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.510 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.510 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.510 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.510 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.510 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.511 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.511 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.511 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.511 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.511 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 5, 2024-03-30T12:21:57.511 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.511 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.511 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.511 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.511 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.511 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.511 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.511 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.511 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.511 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.512 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.512 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.512 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.512 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.512 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.512 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.512 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.512 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.512 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.512 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.512 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.512 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.512 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.512 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.512 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.513 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.513 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.513 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.513 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.513 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.513 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.513 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.513 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.513 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.513 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.513 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.513 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 6, 2024-03-30T12:21:57.513 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.513 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.514 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.514 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.514 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.514 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.514 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.514 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.514 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.514 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 2, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.514 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.514 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.514 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.514 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.514 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.514 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.514 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.515 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.515 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.515 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.515 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.515 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.515 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.515 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.515 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.515 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.515 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.515 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.515 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.515 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.515 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.515 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.516 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.516 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.516 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.516 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.516 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 7, 2024-03-30T12:21:57.516 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:57.516 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.516 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.516 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.516 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.516 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.516 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.516 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.516 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.516 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.517 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.517 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.517 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.517 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.517 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.517 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.517 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.517 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.517 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.517 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.517 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.517 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.517 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.517 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.517 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.518 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.518 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.518 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.518 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.518 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.518 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.518 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:57.518 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:57.518 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.518 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.518 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:57.518 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.518 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.518 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.518 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_counters": { 2024-03-30T12:21:57.519 INFO:tasks.workunit.client.0.smithi084.stdout: "mds.f0f02ef515f7a6934fcbe198c4bdfa6882a76018": { 2024-03-30T12:21:57.519 INFO:tasks.workunit.client.0.smithi084.stdout: "mds": { 2024-03-30T12:21:57.519 INFO:tasks.workunit.client.0.smithi084.stdout: "caps": { 2024-03-30T12:21:57.519 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.519 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.519 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_cap_op_flush_ack": { 2024-03-30T12:21:57.519 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.519 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.519 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_cap_op_flushsnap_ack": { 2024-03-30T12:21:57.519 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.519 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.519 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_cap_op_grant": { 2024-03-30T12:21:57.519 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.519 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.519 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_cap_op_revoke": { 2024-03-30T12:21:57.520 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.520 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.520 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_cap_op_trunc": { 2024-03-30T12:21:57.520 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.520 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.520 INFO:tasks.workunit.client.0.smithi084.stdout: "dir_commit": { 2024-03-30T12:21:57.520 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12 2024-03-30T12:21:57.520 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.520 INFO:tasks.workunit.client.0.smithi084.stdout: "dir_fetch_complete": { 2024-03-30T12:21:57.520 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.520 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.520 INFO:tasks.workunit.client.0.smithi084.stdout: "dir_fetch_keys": { 2024-03-30T12:21:57.520 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.520 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.520 INFO:tasks.workunit.client.0.smithi084.stdout: "dir_merge": { 2024-03-30T12:21:57.520 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.521 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.521 INFO:tasks.workunit.client.0.smithi084.stdout: "dir_split": { 2024-03-30T12:21:57.521 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.521 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.521 INFO:tasks.workunit.client.0.smithi084.stdout: "exported_inodes": { 2024-03-30T12:21:57.521 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.521 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.521 INFO:tasks.workunit.client.0.smithi084.stdout: "forward": { 2024-03-30T12:21:57.521 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.521 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.521 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_client_cap_release": { 2024-03-30T12:21:57.521 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.521 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.521 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_client_caps": { 2024-03-30T12:21:57.521 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.522 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.522 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_client_caps_dirty": { 2024-03-30T12:21:57.522 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.522 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.522 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_inode_file_caps": { 2024-03-30T12:21:57.522 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.522 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.522 INFO:tasks.workunit.client.0.smithi084.stdout: "imported_inodes": { 2024-03-30T12:21:57.522 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.522 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.522 INFO:tasks.workunit.client.0.smithi084.stdout: "inodes": { 2024-03-30T12:21:57.522 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-03-30T12:21:57.522 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.522 INFO:tasks.workunit.client.0.smithi084.stdout: "inodes_expired": { 2024-03-30T12:21:57.522 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.523 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.523 INFO:tasks.workunit.client.0.smithi084.stdout: "inodes_pinned": { 2024-03-30T12:21:57.523 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-03-30T12:21:57.523 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.523 INFO:tasks.workunit.client.0.smithi084.stdout: "inodes_with_caps": { 2024-03-30T12:21:57.523 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.523 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.523 INFO:tasks.workunit.client.0.smithi084.stdout: "load_cent": { 2024-03-30T12:21:57.523 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.523 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.523 INFO:tasks.workunit.client.0.smithi084.stdout: "openino_dir_fetch": { 2024-03-30T12:21:57.523 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.523 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.523 INFO:tasks.workunit.client.0.smithi084.stdout: "process_request_cap_release": { 2024-03-30T12:21:57.523 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.524 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.524 INFO:tasks.workunit.client.0.smithi084.stdout: "reply_latency": { 2024-03-30T12:21:57.524 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:57.524 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 205797 2024-03-30T12:21:57.524 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.524 INFO:tasks.workunit.client.0.smithi084.stdout: "request": { 2024-03-30T12:21:57.524 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:57.524 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.524 INFO:tasks.workunit.client.0.smithi084.stdout: "root_rbytes": { 2024-03-30T12:21:57.524 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.524 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.524 INFO:tasks.workunit.client.0.smithi084.stdout: "root_rfiles": { 2024-03-30T12:21:57.524 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.524 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.525 INFO:tasks.workunit.client.0.smithi084.stdout: "root_rsnaps": { 2024-03-30T12:21:57.525 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.525 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.525 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_reply": { 2024-03-30T12:21:57.525 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.525 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.525 INFO:tasks.workunit.client.0.smithi084.stdout: "subtrees": { 2024-03-30T12:21:57.525 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:57.525 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.525 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.525 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_cache": { 2024-03-30T12:21:57.525 INFO:tasks.workunit.client.0.smithi084.stdout: "ireq_enqueue_scrub": { 2024-03-30T12:21:57.525 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.525 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.525 INFO:tasks.workunit.client.0.smithi084.stdout: "ireq_exportdir": { 2024-03-30T12:21:57.525 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.526 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.526 INFO:tasks.workunit.client.0.smithi084.stdout: "ireq_flush": { 2024-03-30T12:21:57.526 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.526 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.526 INFO:tasks.workunit.client.0.smithi084.stdout: "ireq_fragmentdir": { 2024-03-30T12:21:57.526 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.526 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.526 INFO:tasks.workunit.client.0.smithi084.stdout: "ireq_fragstats": { 2024-03-30T12:21:57.526 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.526 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.526 INFO:tasks.workunit.client.0.smithi084.stdout: "ireq_inodestats": { 2024-03-30T12:21:57.526 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.526 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_recovering_enqueued": { 2024-03-30T12:21:57.527 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.527 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.527 INFO:tasks.workunit.client.0.smithi084.stdout: "num_recovering_prioritized": { 2024-03-30T12:21:57.527 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.527 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.527 INFO:tasks.workunit.client.0.smithi084.stdout: "num_recovering_processing": { 2024-03-30T12:21:57.527 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.527 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.527 INFO:tasks.workunit.client.0.smithi084.stdout: "num_strays": { 2024-03-30T12:21:57.527 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.527 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.527 INFO:tasks.workunit.client.0.smithi084.stdout: "num_strays_delayed": { 2024-03-30T12:21:57.527 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.527 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.527 INFO:tasks.workunit.client.0.smithi084.stdout: "num_strays_enqueuing": { 2024-03-30T12:21:57.528 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.528 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.528 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_completed": { 2024-03-30T12:21:57.528 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.528 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.528 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_started": { 2024-03-30T12:21:57.528 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.528 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.528 INFO:tasks.workunit.client.0.smithi084.stdout: "strays_created": { 2024-03-30T12:21:57.528 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.528 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.528 INFO:tasks.workunit.client.0.smithi084.stdout: "strays_enqueued": { 2024-03-30T12:21:57.528 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.528 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.528 INFO:tasks.workunit.client.0.smithi084.stdout: "strays_migrated": { 2024-03-30T12:21:57.529 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.529 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.529 INFO:tasks.workunit.client.0.smithi084.stdout: "strays_reintegrated": { 2024-03-30T12:21:57.529 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.529 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.529 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.529 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_log": { 2024-03-30T12:21:57.529 INFO:tasks.workunit.client.0.smithi084.stdout: "ev": { 2024-03-30T12:21:57.529 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5 2024-03-30T12:21:57.529 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.529 INFO:tasks.workunit.client.0.smithi084.stdout: "evadd": { 2024-03-30T12:21:57.529 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5 2024-03-30T12:21:57.529 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.529 INFO:tasks.workunit.client.0.smithi084.stdout: "evex": { 2024-03-30T12:21:57.529 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.529 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.530 INFO:tasks.workunit.client.0.smithi084.stdout: "evexd": { 2024-03-30T12:21:57.530 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.530 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.530 INFO:tasks.workunit.client.0.smithi084.stdout: "evexg": { 2024-03-30T12:21:57.530 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.530 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.530 INFO:tasks.workunit.client.0.smithi084.stdout: "evtrm": { 2024-03-30T12:21:57.530 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.530 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.530 INFO:tasks.workunit.client.0.smithi084.stdout: "jlat": { 2024-03-30T12:21:57.530 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-03-30T12:21:57.530 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13393843 2024-03-30T12:21:57.530 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.530 INFO:tasks.workunit.client.0.smithi084.stdout: "replayed": { 2024-03-30T12:21:57.530 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.531 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.531 INFO:tasks.workunit.client.0.smithi084.stdout: "seg": { 2024-03-30T12:21:57.531 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-03-30T12:21:57.531 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.531 INFO:tasks.workunit.client.0.smithi084.stdout: "segadd": { 2024-03-30T12:21:57.531 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-03-30T12:21:57.531 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.531 INFO:tasks.workunit.client.0.smithi084.stdout: "segex": { 2024-03-30T12:21:57.531 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.531 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.531 INFO:tasks.workunit.client.0.smithi084.stdout: "segexd": { 2024-03-30T12:21:57.531 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.531 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.531 INFO:tasks.workunit.client.0.smithi084.stdout: "segexg": { 2024-03-30T12:21:57.531 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.531 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.532 INFO:tasks.workunit.client.0.smithi084.stdout: "segtrm": { 2024-03-30T12:21:57.532 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.532 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.532 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.532 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_mem": { 2024-03-30T12:21:57.532 INFO:tasks.workunit.client.0.smithi084.stdout: "cap": { 2024-03-30T12:21:57.532 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.532 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.532 INFO:tasks.workunit.client.0.smithi084.stdout: "cap+": { 2024-03-30T12:21:57.532 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:57.532 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.532 INFO:tasks.workunit.client.0.smithi084.stdout: "cap-": { 2024-03-30T12:21:57.532 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:57.532 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.532 INFO:tasks.workunit.client.0.smithi084.stdout: "dir": { 2024-03-30T12:21:57.532 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12 2024-03-30T12:21:57.533 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.533 INFO:tasks.workunit.client.0.smithi084.stdout: "dir+": { 2024-03-30T12:21:57.533 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12 2024-03-30T12:21:57.533 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.533 INFO:tasks.workunit.client.0.smithi084.stdout: "dir-": { 2024-03-30T12:21:57.533 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.533 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.533 INFO:tasks.workunit.client.0.smithi084.stdout: "dn": { 2024-03-30T12:21:57.533 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-03-30T12:21:57.533 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.533 INFO:tasks.workunit.client.0.smithi084.stdout: "dn+": { 2024-03-30T12:21:57.533 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-03-30T12:21:57.533 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.534 INFO:tasks.workunit.client.0.smithi084.stdout: "dn-": { 2024-03-30T12:21:57.534 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.534 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.534 INFO:tasks.workunit.client.0.smithi084.stdout: "heap": { 2024-03-30T12:21:57.534 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 207156 2024-03-30T12:21:57.534 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.534 INFO:tasks.workunit.client.0.smithi084.stdout: "ino": { 2024-03-30T12:21:57.534 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-03-30T12:21:57.534 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.534 INFO:tasks.workunit.client.0.smithi084.stdout: "ino+": { 2024-03-30T12:21:57.534 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-03-30T12:21:57.534 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.534 INFO:tasks.workunit.client.0.smithi084.stdout: "ino-": { 2024-03-30T12:21:57.534 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.534 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.535 INFO:tasks.workunit.client.0.smithi084.stdout: "rss": { 2024-03-30T12:21:57.535 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 41676 2024-03-30T12:21:57.535 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.535 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.535 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_server": { 2024-03-30T12:21:57.535 INFO:tasks.workunit.client.0.smithi084.stdout: "cap_acquisition_throttle": { 2024-03-30T12:21:57.535 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.535 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.535 INFO:tasks.workunit.client.0.smithi084.stdout: "cap_revoke_eviction": { 2024-03-30T12:21:57.535 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.535 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.535 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_client_request": { 2024-03-30T12:21:57.535 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:57.535 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.535 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_client_session": { 2024-03-30T12:21:57.536 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 16 2024-03-30T12:21:57.536 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.536 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_peer_request": { 2024-03-30T12:21:57.536 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.536 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.536 INFO:tasks.workunit.client.0.smithi084.stdout: "req_create_latency": { 2024-03-30T12:21:57.536 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.536 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.536 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.536 INFO:tasks.workunit.client.0.smithi084.stdout: "req_getattr_latency": { 2024-03-30T12:21:57.536 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:57.536 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 205797 2024-03-30T12:21:57.536 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.536 INFO:tasks.workunit.client.0.smithi084.stdout: "req_getfilelock_latency": { 2024-03-30T12:21:57.536 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.536 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.537 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.537 INFO:tasks.workunit.client.0.smithi084.stdout: "req_getvxattr_latency": { 2024-03-30T12:21:57.537 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.537 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.537 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.537 INFO:tasks.workunit.client.0.smithi084.stdout: "req_link_latency": { 2024-03-30T12:21:57.537 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.537 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.537 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.537 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lookup_latency": { 2024-03-30T12:21:57.537 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.537 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.537 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.537 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lookuphash_latency": { 2024-03-30T12:21:57.538 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.538 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.538 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.538 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lookupino_latency": { 2024-03-30T12:21:57.538 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.538 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.538 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.538 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lookupname_latency": { 2024-03-30T12:21:57.538 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.538 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.538 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.538 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lookupparent_latency": { 2024-03-30T12:21:57.538 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.538 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.538 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.538 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lookupsnap_latency": { 2024-03-30T12:21:57.539 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.539 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.539 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.539 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lssnap_latency": { 2024-03-30T12:21:57.539 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.539 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.539 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.539 INFO:tasks.workunit.client.0.smithi084.stdout: "req_mkdir_latency": { 2024-03-30T12:21:57.539 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.539 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.539 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.539 INFO:tasks.workunit.client.0.smithi084.stdout: "req_mknod_latency": { 2024-03-30T12:21:57.539 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.539 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.539 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.540 INFO:tasks.workunit.client.0.smithi084.stdout: "req_mksnap_latency": { 2024-03-30T12:21:57.540 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.540 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.540 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.540 INFO:tasks.workunit.client.0.smithi084.stdout: "req_open_latency": { 2024-03-30T12:21:57.540 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.540 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.540 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.540 INFO:tasks.workunit.client.0.smithi084.stdout: "req_readdir_latency": { 2024-03-30T12:21:57.540 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.540 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.540 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.540 INFO:tasks.workunit.client.0.smithi084.stdout: "req_rename_latency": { 2024-03-30T12:21:57.540 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.540 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.541 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.541 INFO:tasks.workunit.client.0.smithi084.stdout: "req_renamesnap_latency": { 2024-03-30T12:21:57.541 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.541 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.541 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.541 INFO:tasks.workunit.client.0.smithi084.stdout: "req_rmdir_latency": { 2024-03-30T12:21:57.541 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.541 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.541 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.541 INFO:tasks.workunit.client.0.smithi084.stdout: "req_rmsnap_latency": { 2024-03-30T12:21:57.541 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.541 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.541 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.541 INFO:tasks.workunit.client.0.smithi084.stdout: "req_rmxattr_latency": { 2024-03-30T12:21:57.541 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.542 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.542 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.542 INFO:tasks.workunit.client.0.smithi084.stdout: "req_setattr_latency": { 2024-03-30T12:21:57.542 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.542 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.542 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.542 INFO:tasks.workunit.client.0.smithi084.stdout: "req_setdirlayout_latency": { 2024-03-30T12:21:57.542 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.542 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.542 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.542 INFO:tasks.workunit.client.0.smithi084.stdout: "req_setfilelock_latency": { 2024-03-30T12:21:57.542 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.542 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.542 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.542 INFO:tasks.workunit.client.0.smithi084.stdout: "req_setlayout_latency": { 2024-03-30T12:21:57.543 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.543 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.543 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.543 INFO:tasks.workunit.client.0.smithi084.stdout: "req_setxattr_latency": { 2024-03-30T12:21:57.543 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.543 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.543 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.543 INFO:tasks.workunit.client.0.smithi084.stdout: "req_snapdiff_latency": { 2024-03-30T12:21:57.543 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.543 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.543 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.543 INFO:tasks.workunit.client.0.smithi084.stdout: "req_symlink_latency": { 2024-03-30T12:21:57.543 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.543 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.543 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.544 INFO:tasks.workunit.client.0.smithi084.stdout: "req_unlink_latency": { 2024-03-30T12:21:57.544 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.544 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.544 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.544 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.544 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_sessions": { 2024-03-30T12:21:57.544 INFO:tasks.workunit.client.0.smithi084.stdout: "average_load": { 2024-03-30T12:21:57.544 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-03-30T12:21:57.544 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.544 INFO:tasks.workunit.client.0.smithi084.stdout: "avg_session_uptime": { 2024-03-30T12:21:57.544 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85 2024-03-30T12:21:57.544 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.544 INFO:tasks.workunit.client.0.smithi084.stdout: "mdthresh_evicted": { 2024-03-30T12:21:57.544 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.544 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.545 INFO:tasks.workunit.client.0.smithi084.stdout: "session_add": { 2024-03-30T12:21:57.545 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:57.545 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.545 INFO:tasks.workunit.client.0.smithi084.stdout: "session_count": { 2024-03-30T12:21:57.545 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.545 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.545 INFO:tasks.workunit.client.0.smithi084.stdout: "session_remove": { 2024-03-30T12:21:57.545 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:57.545 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.545 INFO:tasks.workunit.client.0.smithi084.stdout: "sessions_open": { 2024-03-30T12:21:57.545 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.545 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.545 INFO:tasks.workunit.client.0.smithi084.stdout: "sessions_stale": { 2024-03-30T12:21:57.545 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.545 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.546 INFO:tasks.workunit.client.0.smithi084.stdout: "total_load": { 2024-03-30T12:21:57.546 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:57.546 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.546 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.546 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-03-30T12:21:57.546 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-03-30T12:21:57.546 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.546 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.546 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:57.546 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.546 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.546 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-03-30T12:21:57.546 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.546 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.546 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:57.547 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 45 2024-03-30T12:21:57.547 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.547 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.547 INFO:tasks.workunit.client.0.smithi084.stdout: "purge_queue": { 2024-03-30T12:21:57.547 INFO:tasks.workunit.client.0.smithi084.stdout: "pq_executed": { 2024-03-30T12:21:57.547 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.547 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.547 INFO:tasks.workunit.client.0.smithi084.stdout: "pq_executing": { 2024-03-30T12:21:57.547 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.547 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.547 INFO:tasks.workunit.client.0.smithi084.stdout: "pq_executing_high_water": { 2024-03-30T12:21:57.547 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.547 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.547 INFO:tasks.workunit.client.0.smithi084.stdout: "pq_executing_ops": { 2024-03-30T12:21:57.548 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.548 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.548 INFO:tasks.workunit.client.0.smithi084.stdout: "pq_executing_ops_high_water": { 2024-03-30T12:21:57.548 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.548 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.548 INFO:tasks.workunit.client.0.smithi084.stdout: "pq_item_in_journal": { 2024-03-30T12:21:57.548 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.548 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.548 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.548 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.548 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.611cf02078e8bf5a0a364299eaa3b024f2655c78": { 2024-03-30T12:21:57.548 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-03-30T12:21:57.548 INFO:tasks.workunit.client.0.smithi084.stdout: "election_call": { 2024-03-30T12:21:57.548 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:57.548 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.548 INFO:tasks.workunit.client.0.smithi084.stdout: "election_lose": { 2024-03-30T12:21:57.549 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.549 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.549 INFO:tasks.workunit.client.0.smithi084.stdout: "election_win": { 2024-03-30T12:21:57.549 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-03-30T12:21:57.549 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.549 INFO:tasks.workunit.client.0.smithi084.stdout: "num_elections": { 2024-03-30T12:21:57.549 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 9 2024-03-30T12:21:57.549 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.549 INFO:tasks.workunit.client.0.smithi084.stdout: "num_sessions": { 2024-03-30T12:21:57.549 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7 2024-03-30T12:21:57.549 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.549 INFO:tasks.workunit.client.0.smithi084.stdout: "session_add": { 2024-03-30T12:21:57.549 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-03-30T12:21:57.549 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.549 INFO:tasks.workunit.client.0.smithi084.stdout: "session_rm": { 2024-03-30T12:21:57.550 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 216 2024-03-30T12:21:57.550 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.550 INFO:tasks.workunit.client.0.smithi084.stdout: "session_trim": { 2024-03-30T12:21:57.550 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.550 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.550 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.550 INFO:tasks.workunit.client.0.smithi084.stdout: "paxos": { 2024-03-30T12:21:57.550 INFO:tasks.workunit.client.0.smithi084.stdout: "accept_timeout": { 2024-03-30T12:21:57.550 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.550 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.550 INFO:tasks.workunit.client.0.smithi084.stdout: "begin": { 2024-03-30T12:21:57.550 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1009 2024-03-30T12:21:57.550 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.550 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_bytes": { 2024-03-30T12:21:57.550 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1009, 2024-03-30T12:21:57.551 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4992669 2024-03-30T12:21:57.551 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.551 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_keys": { 2024-03-30T12:21:57.551 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1009, 2024-03-30T12:21:57.551 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3027 2024-03-30T12:21:57.551 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.551 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_latency": { 2024-03-30T12:21:57.551 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1009, 2024-03-30T12:21:57.551 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 232995739 2024-03-30T12:21:57.551 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.551 INFO:tasks.workunit.client.0.smithi084.stdout: "collect": { 2024-03-30T12:21:57.551 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.551 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.552 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_bytes": { 2024-03-30T12:21:57.552 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.552 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.552 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.552 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_keys": { 2024-03-30T12:21:57.552 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.552 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.552 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.552 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_latency": { 2024-03-30T12:21:57.552 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.552 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.552 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.552 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_timeout": { 2024-03-30T12:21:57.552 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.552 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.552 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_uncommitted": { 2024-03-30T12:21:57.553 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.553 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.553 INFO:tasks.workunit.client.0.smithi084.stdout: "commit": { 2024-03-30T12:21:57.553 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1009 2024-03-30T12:21:57.553 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.553 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_bytes": { 2024-03-30T12:21:57.553 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1009, 2024-03-30T12:21:57.553 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4920026 2024-03-30T12:21:57.553 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.553 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_keys": { 2024-03-30T12:21:57.553 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1009, 2024-03-30T12:21:57.553 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6179 2024-03-30T12:21:57.553 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.553 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_latency": { 2024-03-30T12:21:57.553 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1009, 2024-03-30T12:21:57.554 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 443877358 2024-03-30T12:21:57.554 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.554 INFO:tasks.workunit.client.0.smithi084.stdout: "lease_ack_timeout": { 2024-03-30T12:21:57.554 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.554 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.554 INFO:tasks.workunit.client.0.smithi084.stdout: "lease_timeout": { 2024-03-30T12:21:57.554 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.554 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.554 INFO:tasks.workunit.client.0.smithi084.stdout: "new_pn": { 2024-03-30T12:21:57.554 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:57.554 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.554 INFO:tasks.workunit.client.0.smithi084.stdout: "new_pn_latency": { 2024-03-30T12:21:57.554 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:57.554 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 999981 2024-03-30T12:21:57.554 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.555 INFO:tasks.workunit.client.0.smithi084.stdout: "refresh": { 2024-03-30T12:21:57.555 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1011 2024-03-30T12:21:57.555 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.555 INFO:tasks.workunit.client.0.smithi084.stdout: "refresh_latency": { 2024-03-30T12:21:57.555 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1011, 2024-03-30T12:21:57.555 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2575952849 2024-03-30T12:21:57.555 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.555 INFO:tasks.workunit.client.0.smithi084.stdout: "restart": { 2024-03-30T12:21:57.555 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12 2024-03-30T12:21:57.555 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.555 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state": { 2024-03-30T12:21:57.555 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-03-30T12:21:57.555 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.555 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state_bytes": { 2024-03-30T12:21:57.555 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-03-30T12:21:57.556 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2103 2024-03-30T12:21:57.556 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.556 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state_keys": { 2024-03-30T12:21:57.556 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-03-30T12:21:57.556 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4 2024-03-30T12:21:57.556 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.556 INFO:tasks.workunit.client.0.smithi084.stdout: "start_leader": { 2024-03-30T12:21:57.556 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-03-30T12:21:57.556 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.556 INFO:tasks.workunit.client.0.smithi084.stdout: "start_peon": { 2024-03-30T12:21:57.556 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.556 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.556 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state": { 2024-03-30T12:21:57.556 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.556 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.557 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_bytes": { 2024-03-30T12:21:57.557 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.557 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.557 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.557 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_keys": { 2024-03-30T12:21:57.557 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.557 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.557 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.557 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_latency": { 2024-03-30T12:21:57.557 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.557 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.557 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.557 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.557 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache": { 2024-03-30T12:21:57.557 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-03-30T12:21:57.558 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1020054731 2024-03-30T12:21:57.558 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.558 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-03-30T12:21:57.558 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 47947776 2024-03-30T12:21:57.558 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.558 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-03-30T12:21:57.558 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 40132608 2024-03-30T12:21:57.558 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.558 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-03-30T12:21:57.558 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2147483648 2024-03-30T12:21:57.558 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.558 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-03-30T12:21:57.558 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7815168 2024-03-30T12:21:57.558 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.559 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.559 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:full": { 2024-03-30T12:21:57.559 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.559 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 348127232 2024-03-30T12:21:57.559 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.559 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.559 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.559 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.559 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.559 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.559 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.559 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.559 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277025246 2024-03-30T12:21:57.559 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.560 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.560 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 263676 2024-03-30T12:21:57.560 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.560 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.560 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.560 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.560 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.560 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.560 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.560 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.560 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.560 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.560 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.560 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.561 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.561 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.561 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.561 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.561 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.561 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.561 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.561 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.561 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.561 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.561 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.561 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.561 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.561 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.562 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 70838310 2024-03-30T12:21:57.562 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.562 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.562 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:inc": { 2024-03-30T12:21:57.562 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.562 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 348127232 2024-03-30T12:21:57.562 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.562 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.562 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.562 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.562 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.562 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.562 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.562 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.563 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277025246 2024-03-30T12:21:57.563 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.563 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.563 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 38697 2024-03-30T12:21:57.563 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.563 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.563 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.563 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.563 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.563 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.563 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.563 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.563 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.563 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.563 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.564 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.564 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.564 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.564 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.564 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.564 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.564 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.564 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.564 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.564 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.564 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.564 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.564 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.564 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.564 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.565 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71063289 2024-03-30T12:21:57.565 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.565 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.565 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:kv": { 2024-03-30T12:21:57.565 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.565 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 322961408 2024-03-30T12:21:57.565 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.565 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.565 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:57.565 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.565 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.565 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.565 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.565 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.565 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 184683497 2024-03-30T12:21:57.565 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.565 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.566 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.566 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.566 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.566 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.566 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.566 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.566 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.566 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.566 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.566 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.566 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.566 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.566 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.566 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.567 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.567 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.567 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.567 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.567 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.567 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.567 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.567 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.567 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.567 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.567 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.567 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.567 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.567 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71169047 2024-03-30T12:21:57.567 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.567 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.568 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb": { 2024-03-30T12:21:57.568 INFO:tasks.workunit.client.0.smithi084.stdout: "compact": { 2024-03-30T12:21:57.568 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.568 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.568 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_queue_len": { 2024-03-30T12:21:57.568 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.568 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.568 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_queue_merge": { 2024-03-30T12:21:57.568 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.568 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.568 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_range": { 2024-03-30T12:21:57.568 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:57.568 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.568 INFO:tasks.workunit.client.0.smithi084.stdout: "get_latency": { 2024-03-30T12:21:57.569 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 44898, 2024-03-30T12:21:57.569 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 184015215 2024-03-30T12:21:57.569 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.569 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_delay_time": { 2024-03-30T12:21:57.569 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.569 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.569 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.569 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_memtable_time": { 2024-03-30T12:21:57.569 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.569 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.569 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.569 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_pre_and_post_time": { 2024-03-30T12:21:57.569 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.569 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.569 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.570 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_wal_time": { 2024-03-30T12:21:57.570 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.570 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.570 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.570 INFO:tasks.workunit.client.0.smithi084.stdout: "submit_latency": { 2024-03-30T12:21:57.570 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.570 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.570 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.570 INFO:tasks.workunit.client.0.smithi084.stdout: "submit_sync_latency": { 2024-03-30T12:21:57.570 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2177, 2024-03-30T12:21:57.570 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 768498444 2024-03-30T12:21:57.570 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.570 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.570 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.571 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.ba4e0ee80ca1c9071285ab58ebc3a0451ad8d905": { 2024-03-30T12:21:57.571 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-03-30T12:21:57.571 INFO:tasks.workunit.client.0.smithi084.stdout: "election_call": { 2024-03-30T12:21:57.571 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-03-30T12:21:57.571 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.571 INFO:tasks.workunit.client.0.smithi084.stdout: "election_lose": { 2024-03-30T12:21:57.571 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-03-30T12:21:57.571 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.571 INFO:tasks.workunit.client.0.smithi084.stdout: "election_win": { 2024-03-30T12:21:57.571 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.571 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.571 INFO:tasks.workunit.client.0.smithi084.stdout: "num_elections": { 2024-03-30T12:21:57.571 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-03-30T12:21:57.571 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.572 INFO:tasks.workunit.client.0.smithi084.stdout: "num_sessions": { 2024-03-30T12:21:57.572 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 11 2024-03-30T12:21:57.572 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.572 INFO:tasks.workunit.client.0.smithi084.stdout: "session_add": { 2024-03-30T12:21:57.572 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5 2024-03-30T12:21:57.572 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.572 INFO:tasks.workunit.client.0.smithi084.stdout: "session_rm": { 2024-03-30T12:21:57.572 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 103 2024-03-30T12:21:57.572 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.572 INFO:tasks.workunit.client.0.smithi084.stdout: "session_trim": { 2024-03-30T12:21:57.572 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.572 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.572 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.572 INFO:tasks.workunit.client.0.smithi084.stdout: "paxos": { 2024-03-30T12:21:57.572 INFO:tasks.workunit.client.0.smithi084.stdout: "accept_timeout": { 2024-03-30T12:21:57.573 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.573 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.573 INFO:tasks.workunit.client.0.smithi084.stdout: "begin": { 2024-03-30T12:21:57.573 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 858 2024-03-30T12:21:57.573 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.573 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_bytes": { 2024-03-30T12:21:57.573 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 858, 2024-03-30T12:21:57.573 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3915449 2024-03-30T12:21:57.573 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.573 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_keys": { 2024-03-30T12:21:57.573 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.573 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.573 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.573 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_latency": { 2024-03-30T12:21:57.574 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 858, 2024-03-30T12:21:57.574 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 247995473 2024-03-30T12:21:57.574 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.574 INFO:tasks.workunit.client.0.smithi084.stdout: "collect": { 2024-03-30T12:21:57.574 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-03-30T12:21:57.574 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.574 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_bytes": { 2024-03-30T12:21:57.574 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:57.574 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73 2024-03-30T12:21:57.574 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.574 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_keys": { 2024-03-30T12:21:57.574 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:57.574 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-03-30T12:21:57.574 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.575 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_latency": { 2024-03-30T12:21:57.575 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:57.575 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.575 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.575 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_timeout": { 2024-03-30T12:21:57.575 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.575 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.575 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_uncommitted": { 2024-03-30T12:21:57.575 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.575 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.575 INFO:tasks.workunit.client.0.smithi084.stdout: "commit": { 2024-03-30T12:21:57.575 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 860 2024-03-30T12:21:57.575 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.575 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_bytes": { 2024-03-30T12:21:57.576 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.576 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.576 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.576 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_keys": { 2024-03-30T12:21:57.576 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.576 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.576 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.576 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_latency": { 2024-03-30T12:21:57.576 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.576 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.576 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.576 INFO:tasks.workunit.client.0.smithi084.stdout: "lease_ack_timeout": { 2024-03-30T12:21:57.576 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.576 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.577 INFO:tasks.workunit.client.0.smithi084.stdout: "lease_timeout": { 2024-03-30T12:21:57.577 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.577 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.577 INFO:tasks.workunit.client.0.smithi084.stdout: "new_pn": { 2024-03-30T12:21:57.577 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.577 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.577 INFO:tasks.workunit.client.0.smithi084.stdout: "new_pn_latency": { 2024-03-30T12:21:57.577 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.577 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.577 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.577 INFO:tasks.workunit.client.0.smithi084.stdout: "refresh": { 2024-03-30T12:21:57.577 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 860 2024-03-30T12:21:57.577 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.577 INFO:tasks.workunit.client.0.smithi084.stdout: "refresh_latency": { 2024-03-30T12:21:57.577 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 860, 2024-03-30T12:21:57.578 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1999963426 2024-03-30T12:21:57.578 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.578 INFO:tasks.workunit.client.0.smithi084.stdout: "restart": { 2024-03-30T12:21:57.578 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8 2024-03-30T12:21:57.578 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.578 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state": { 2024-03-30T12:21:57.578 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.578 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.578 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state_bytes": { 2024-03-30T12:21:57.578 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.578 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.578 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.578 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state_keys": { 2024-03-30T12:21:57.578 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.579 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.579 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.579 INFO:tasks.workunit.client.0.smithi084.stdout: "start_leader": { 2024-03-30T12:21:57.579 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.579 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.579 INFO:tasks.workunit.client.0.smithi084.stdout: "start_peon": { 2024-03-30T12:21:57.579 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-03-30T12:21:57.579 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.579 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state": { 2024-03-30T12:21:57.579 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 859 2024-03-30T12:21:57.579 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.579 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_bytes": { 2024-03-30T12:21:57.579 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 859, 2024-03-30T12:21:57.579 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7669880 2024-03-30T12:21:57.579 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.580 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_keys": { 2024-03-30T12:21:57.580 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 859, 2024-03-30T12:21:57.580 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6196 2024-03-30T12:21:57.580 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.580 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_latency": { 2024-03-30T12:21:57.580 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 859, 2024-03-30T12:21:57.580 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 536990179 2024-03-30T12:21:57.580 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.580 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.580 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache": { 2024-03-30T12:21:57.580 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-03-30T12:21:57.580 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1020054731 2024-03-30T12:21:57.580 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.580 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-03-30T12:21:57.580 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 41746432 2024-03-30T12:21:57.581 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.581 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-03-30T12:21:57.581 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 34226176 2024-03-30T12:21:57.581 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.581 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-03-30T12:21:57.581 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2147483648 2024-03-30T12:21:57.581 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.581 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-03-30T12:21:57.581 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7520256 2024-03-30T12:21:57.581 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.581 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.581 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:full": { 2024-03-30T12:21:57.581 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.581 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 348127232 2024-03-30T12:21:57.582 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.582 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.582 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.582 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.582 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.582 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.582 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.582 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.582 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277024170 2024-03-30T12:21:57.582 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.582 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.582 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 264106 2024-03-30T12:21:57.582 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.582 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.582 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.583 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.583 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.583 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.583 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.583 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.583 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.583 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.583 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.583 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.583 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.583 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.583 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.583 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.583 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.584 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.584 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.584 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.584 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.584 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.584 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.584 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.584 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.584 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.584 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 70838956 2024-03-30T12:21:57.584 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.584 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.584 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:inc": { 2024-03-30T12:21:57.584 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.584 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 348127232 2024-03-30T12:21:57.584 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.585 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.585 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.585 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.585 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.585 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.585 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.585 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.585 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277024170 2024-03-30T12:21:57.585 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.585 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.585 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 41136 2024-03-30T12:21:57.585 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.585 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.585 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.585 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.585 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.586 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.586 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.586 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.586 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.586 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.586 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.586 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.586 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.586 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.586 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.586 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.586 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.586 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.586 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.587 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.587 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.587 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.587 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.587 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.587 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.587 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.587 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71061926 2024-03-30T12:21:57.587 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.587 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.587 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:kv": { 2024-03-30T12:21:57.587 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.587 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 322961408 2024-03-30T12:21:57.587 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.587 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.587 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:57.588 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.588 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.588 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.588 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.588 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.588 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 184682780 2024-03-30T12:21:57.588 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.588 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.588 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.588 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.588 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.588 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.588 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.588 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.588 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.588 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.589 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.589 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.589 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.589 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.589 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.589 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.589 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.589 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.589 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.589 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.589 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.589 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.589 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.589 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.589 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.590 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.590 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.590 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.590 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.590 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71169764 2024-03-30T12:21:57.590 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.590 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.590 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb": { 2024-03-30T12:21:57.590 INFO:tasks.workunit.client.0.smithi084.stdout: "compact": { 2024-03-30T12:21:57.590 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.590 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.590 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_queue_len": { 2024-03-30T12:21:57.590 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.590 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.591 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_queue_merge": { 2024-03-30T12:21:57.591 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.591 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.591 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_range": { 2024-03-30T12:21:57.591 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:57.591 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.591 INFO:tasks.workunit.client.0.smithi084.stdout: "get_latency": { 2024-03-30T12:21:57.591 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 36857, 2024-03-30T12:21:57.591 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 100805855 2024-03-30T12:21:57.591 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.591 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_delay_time": { 2024-03-30T12:21:57.591 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.591 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.591 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.591 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_memtable_time": { 2024-03-30T12:21:57.592 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.592 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.592 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.592 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_pre_and_post_time": { 2024-03-30T12:21:57.592 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.592 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.592 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.592 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_wal_time": { 2024-03-30T12:21:57.592 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.592 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.592 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.592 INFO:tasks.workunit.client.0.smithi084.stdout: "submit_latency": { 2024-03-30T12:21:57.592 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.592 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.592 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.593 INFO:tasks.workunit.client.0.smithi084.stdout: "submit_sync_latency": { 2024-03-30T12:21:57.593 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1834, 2024-03-30T12:21:57.593 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 838324012 2024-03-30T12:21:57.593 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.593 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.593 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.593 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.f0f02ef515f7a6934fcbe198c4bdfa6882a76018": { 2024-03-30T12:21:57.593 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-03-30T12:21:57.593 INFO:tasks.workunit.client.0.smithi084.stdout: "election_call": { 2024-03-30T12:21:57.593 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:57.593 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.593 INFO:tasks.workunit.client.0.smithi084.stdout: "election_lose": { 2024-03-30T12:21:57.593 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:57.593 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.593 INFO:tasks.workunit.client.0.smithi084.stdout: "election_win": { 2024-03-30T12:21:57.593 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.594 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.594 INFO:tasks.workunit.client.0.smithi084.stdout: "num_elections": { 2024-03-30T12:21:57.594 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7 2024-03-30T12:21:57.594 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.594 INFO:tasks.workunit.client.0.smithi084.stdout: "num_sessions": { 2024-03-30T12:21:57.594 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 11 2024-03-30T12:21:57.594 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.594 INFO:tasks.workunit.client.0.smithi084.stdout: "session_add": { 2024-03-30T12:21:57.594 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4 2024-03-30T12:21:57.594 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.594 INFO:tasks.workunit.client.0.smithi084.stdout: "session_rm": { 2024-03-30T12:21:57.594 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 52 2024-03-30T12:21:57.594 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.594 INFO:tasks.workunit.client.0.smithi084.stdout: "session_trim": { 2024-03-30T12:21:57.594 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.595 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.595 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.595 INFO:tasks.workunit.client.0.smithi084.stdout: "paxos": { 2024-03-30T12:21:57.595 INFO:tasks.workunit.client.0.smithi084.stdout: "accept_timeout": { 2024-03-30T12:21:57.595 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.595 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.595 INFO:tasks.workunit.client.0.smithi084.stdout: "begin": { 2024-03-30T12:21:57.595 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 869 2024-03-30T12:21:57.595 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.595 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_bytes": { 2024-03-30T12:21:57.595 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 869, 2024-03-30T12:21:57.595 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3941418 2024-03-30T12:21:57.595 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.595 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_keys": { 2024-03-30T12:21:57.595 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.596 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.596 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.596 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_latency": { 2024-03-30T12:21:57.596 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 869, 2024-03-30T12:21:57.596 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 148996995 2024-03-30T12:21:57.596 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.596 INFO:tasks.workunit.client.0.smithi084.stdout: "collect": { 2024-03-30T12:21:57.596 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:57.596 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.596 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_bytes": { 2024-03-30T12:21:57.596 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:57.596 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 146 2024-03-30T12:21:57.596 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.596 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_keys": { 2024-03-30T12:21:57.596 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:57.597 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:57.597 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.597 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_latency": { 2024-03-30T12:21:57.597 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:57.597 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 999980 2024-03-30T12:21:57.597 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.597 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_timeout": { 2024-03-30T12:21:57.597 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.597 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.597 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_uncommitted": { 2024-03-30T12:21:57.597 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.597 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.597 INFO:tasks.workunit.client.0.smithi084.stdout: "commit": { 2024-03-30T12:21:57.597 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 870 2024-03-30T12:21:57.597 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.597 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_bytes": { 2024-03-30T12:21:57.598 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.598 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.598 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.598 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_keys": { 2024-03-30T12:21:57.598 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.598 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.598 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.598 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_latency": { 2024-03-30T12:21:57.598 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.598 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.598 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.598 INFO:tasks.workunit.client.0.smithi084.stdout: "lease_ack_timeout": { 2024-03-30T12:21:57.598 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.598 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.599 INFO:tasks.workunit.client.0.smithi084.stdout: "lease_timeout": { 2024-03-30T12:21:57.599 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.599 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.599 INFO:tasks.workunit.client.0.smithi084.stdout: "new_pn": { 2024-03-30T12:21:57.599 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.599 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.599 INFO:tasks.workunit.client.0.smithi084.stdout: "new_pn_latency": { 2024-03-30T12:21:57.599 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.599 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.599 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.599 INFO:tasks.workunit.client.0.smithi084.stdout: "refresh": { 2024-03-30T12:21:57.599 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 870 2024-03-30T12:21:57.599 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.599 INFO:tasks.workunit.client.0.smithi084.stdout: "refresh_latency": { 2024-03-30T12:21:57.599 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 870, 2024-03-30T12:21:57.599 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1897961789 2024-03-30T12:21:57.600 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.600 INFO:tasks.workunit.client.0.smithi084.stdout: "restart": { 2024-03-30T12:21:57.600 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-03-30T12:21:57.600 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.600 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state": { 2024-03-30T12:21:57.600 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.600 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.600 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state_bytes": { 2024-03-30T12:21:57.600 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.600 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.600 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.600 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state_keys": { 2024-03-30T12:21:57.600 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.600 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.601 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.601 INFO:tasks.workunit.client.0.smithi084.stdout: "start_leader": { 2024-03-30T12:21:57.601 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.601 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.601 INFO:tasks.workunit.client.0.smithi084.stdout: "start_peon": { 2024-03-30T12:21:57.601 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:57.601 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.601 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state": { 2024-03-30T12:21:57.601 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 870 2024-03-30T12:21:57.601 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.601 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_bytes": { 2024-03-30T12:21:57.601 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 870, 2024-03-30T12:21:57.601 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7720482 2024-03-30T12:21:57.601 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.601 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_keys": { 2024-03-30T12:21:57.602 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 870, 2024-03-30T12:21:57.602 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6284 2024-03-30T12:21:57.602 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.602 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_latency": { 2024-03-30T12:21:57.602 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 870, 2024-03-30T12:21:57.602 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 311993737 2024-03-30T12:21:57.602 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.602 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.602 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache": { 2024-03-30T12:21:57.602 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-03-30T12:21:57.602 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1020054731 2024-03-30T12:21:57.602 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.602 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-03-30T12:21:57.602 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 42795008 2024-03-30T12:21:57.602 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.603 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-03-30T12:21:57.603 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 29827072 2024-03-30T12:21:57.603 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.603 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-03-30T12:21:57.603 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2147483648 2024-03-30T12:21:57.603 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.603 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-03-30T12:21:57.603 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12967936 2024-03-30T12:21:57.603 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.603 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.603 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:full": { 2024-03-30T12:21:57.603 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.603 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 348127232 2024-03-30T12:21:57.603 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.603 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.604 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.604 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.604 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.604 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.604 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.604 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.604 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277024170 2024-03-30T12:21:57.604 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.604 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.604 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 264106 2024-03-30T12:21:57.604 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.604 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.604 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.604 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.604 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.605 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.605 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.605 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.605 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.605 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.605 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.605 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.605 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.605 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.605 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.605 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.605 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.605 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.605 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.605 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.606 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.606 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.606 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.606 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.606 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.606 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.606 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 70838956 2024-03-30T12:21:57.606 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.606 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.606 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:inc": { 2024-03-30T12:21:57.606 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.606 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 348127232 2024-03-30T12:21:57.606 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.606 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.606 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.607 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.607 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.607 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.607 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.607 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.607 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277024170 2024-03-30T12:21:57.607 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.607 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.607 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 41136 2024-03-30T12:21:57.607 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.607 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.607 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.607 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.607 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.607 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.608 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.608 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.608 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.608 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.608 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.608 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.608 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.608 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.608 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.608 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.608 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.608 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.608 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.608 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.608 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.608 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.609 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.609 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.609 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.609 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.609 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71061926 2024-03-30T12:21:57.609 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.609 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.609 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:kv": { 2024-03-30T12:21:57.609 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.609 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 322961408 2024-03-30T12:21:57.609 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.609 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.609 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:57.609 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.610 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.610 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.610 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.610 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.610 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 184682780 2024-03-30T12:21:57.610 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.610 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.610 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.610 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.610 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.610 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.610 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.610 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.610 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.610 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.611 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.611 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.611 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.611 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.611 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.611 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.611 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.611 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.611 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.611 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.611 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.611 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.611 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.611 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.611 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.612 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.612 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.612 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.612 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.612 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71169764 2024-03-30T12:21:57.612 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.612 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.612 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb": { 2024-03-30T12:21:57.612 INFO:tasks.workunit.client.0.smithi084.stdout: "compact": { 2024-03-30T12:21:57.612 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.612 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.612 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_queue_len": { 2024-03-30T12:21:57.612 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.612 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.612 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_queue_merge": { 2024-03-30T12:21:57.613 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.613 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.613 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_range": { 2024-03-30T12:21:57.613 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:57.613 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.613 INFO:tasks.workunit.client.0.smithi084.stdout: "get_latency": { 2024-03-30T12:21:57.613 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 36922, 2024-03-30T12:21:57.613 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 98378119 2024-03-30T12:21:57.613 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.613 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_delay_time": { 2024-03-30T12:21:57.613 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.613 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.613 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.613 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_memtable_time": { 2024-03-30T12:21:57.613 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.613 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.614 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.614 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_pre_and_post_time": { 2024-03-30T12:21:57.614 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.614 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.614 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.614 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_wal_time": { 2024-03-30T12:21:57.614 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.614 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.614 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.614 INFO:tasks.workunit.client.0.smithi084.stdout: "submit_latency": { 2024-03-30T12:21:57.614 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.614 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.614 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.614 INFO:tasks.workunit.client.0.smithi084.stdout: "submit_sync_latency": { 2024-03-30T12:21:57.615 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1880, 2024-03-30T12:21:57.615 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 539615325 2024-03-30T12:21:57.615 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.615 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.615 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.615 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.0": { 2024-03-30T12:21:57.615 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:57.615 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-03-30T12:21:57.615 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.615 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.615 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-03-30T12:21:57.615 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.615 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.615 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-03-30T12:21:57.615 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-03-30T12:21:57.616 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.616 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-03-30T12:21:57.616 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.616 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.616 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-03-30T12:21:57.616 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.616 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.616 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-03-30T12:21:57.616 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.616 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.616 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-03-30T12:21:57.616 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12288 2024-03-30T12:21:57.616 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.616 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-03-30T12:21:57.616 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7340032 2024-03-30T12:21:57.616 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.617 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-03-30T12:21:57.617 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.617 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.617 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.617 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-03-30T12:21:57.617 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.617 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.617 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.617 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-03-30T12:21:57.617 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:57.617 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.617 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-03-30T12:21:57.617 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:57.617 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.617 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-03-30T12:21:57.617 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3612672 2024-03-30T12:21:57.618 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.618 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-03-30T12:21:57.618 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3473408 2024-03-30T12:21:57.618 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.618 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-03-30T12:21:57.618 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:57.618 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.618 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-03-30T12:21:57.618 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.618 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.618 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-03-30T12:21:57.618 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.618 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-03-30T12:21:57.619 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-03-30T12:21:57.619 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.619 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-03-30T12:21:57.619 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 206272 2024-03-30T12:21:57.619 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.619 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-03-30T12:21:57.619 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 23 2024-03-30T12:21:57.619 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.619 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-03-30T12:21:57.619 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1282048 2024-03-30T12:21:57.619 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.619 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-03-30T12:21:57.619 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1286144 2024-03-30T12:21:57.619 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.619 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-03-30T12:21:57.619 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.620 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.620 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-03-30T12:21:57.620 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.620 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.620 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-03-30T12:21:57.620 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15 2024-03-30T12:21:57.620 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.620 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-03-30T12:21:57.620 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4913 2024-03-30T12:21:57.620 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.620 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-03-30T12:21:57.620 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4 2024-03-30T12:21:57.620 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.620 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-03-30T12:21:57.620 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5505 2024-03-30T12:21:57.620 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.621 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-03-30T12:21:57.621 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:57.621 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.621 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-03-30T12:21:57.621 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5505 2024-03-30T12:21:57.621 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.621 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-03-30T12:21:57.621 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:57.621 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.621 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-03-30T12:21:57.621 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.621 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.621 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-03-30T12:21:57.621 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.621 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.622 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-03-30T12:21:57.622 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.622 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.622 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-03-30T12:21:57.622 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.622 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.622 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-03-30T12:21:57.622 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.622 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.622 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-03-30T12:21:57.622 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.622 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.622 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-03-30T12:21:57.622 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.622 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.623 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-03-30T12:21:57.623 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.623 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.623 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-03-30T12:21:57.623 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.623 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.623 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-03-30T12:21:57.623 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10891264 2024-03-30T12:21:57.623 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.623 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.623 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-03-30T12:21:57.623 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-03-30T12:21:57.623 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-03-30T12:21:57.623 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.623 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-03-30T12:21:57.623 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1306624 2024-03-30T12:21:57.623 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.624 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-03-30T12:21:57.624 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 4, 2024-03-30T12:21:57.624 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 266330 2024-03-30T12:21:57.624 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.624 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-03-30T12:21:57.624 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.624 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.624 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.624 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-03-30T12:21:57.624 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.624 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.624 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-03-30T12:21:57.624 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.624 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.624 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-03-30T12:21:57.624 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.625 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.625 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-03-30T12:21:57.625 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 24, 2024-03-30T12:21:57.625 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 91898 2024-03-30T12:21:57.625 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.625 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-03-30T12:21:57.625 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.625 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.625 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.625 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-03-30T12:21:57.625 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 835, 2024-03-30T12:21:57.625 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 505201859 2024-03-30T12:21:57.625 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.625 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-03-30T12:21:57.625 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 833, 2024-03-30T12:21:57.626 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 23530520 2024-03-30T12:21:57.626 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.626 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-03-30T12:21:57.626 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 835, 2024-03-30T12:21:57.626 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 771428 2024-03-30T12:21:57.626 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.626 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-03-30T12:21:57.626 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 835, 2024-03-30T12:21:57.626 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 505973287 2024-03-30T12:21:57.626 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.626 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-03-30T12:21:57.626 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.626 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.626 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.626 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-03-30T12:21:57.627 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:57.627 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 45295 2024-03-30T12:21:57.627 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.627 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-03-30T12:21:57.627 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 6, 2024-03-30T12:21:57.627 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 17740 2024-03-30T12:21:57.627 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.627 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-03-30T12:21:57.627 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.627 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.627 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.627 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-03-30T12:21:57.627 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.627 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.627 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.627 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-03-30T12:21:57.628 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:57.628 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4487 2024-03-30T12:21:57.628 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.628 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-03-30T12:21:57.628 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3956 2024-03-30T12:21:57.628 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.628 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-03-30T12:21:57.628 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 325 2024-03-30T12:21:57.628 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.628 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-03-30T12:21:57.628 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 112, 2024-03-30T12:21:57.628 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4025869 2024-03-30T12:21:57.628 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.628 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-03-30T12:21:57.628 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 311, 2024-03-30T12:21:57.629 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 312295 2024-03-30T12:21:57.629 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.629 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-03-30T12:21:57.629 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 199, 2024-03-30T12:21:57.629 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5651384 2024-03-30T12:21:57.629 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.629 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-03-30T12:21:57.629 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.629 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.629 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-03-30T12:21:57.629 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 102, 2024-03-30T12:21:57.629 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5501883 2024-03-30T12:21:57.629 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.629 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-03-30T12:21:57.629 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3599, 2024-03-30T12:21:57.629 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3972754439 2024-03-30T12:21:57.630 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.630 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-03-30T12:21:57.630 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 126, 2024-03-30T12:21:57.630 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24960483 2024-03-30T12:21:57.630 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.630 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-03-30T12:21:57.630 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 126, 2024-03-30T12:21:57.630 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 428223713217 2024-03-30T12:21:57.630 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.630 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-03-30T12:21:57.630 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 126, 2024-03-30T12:21:57.630 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 130719619881 2024-03-30T12:21:57.630 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.630 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-03-30T12:21:57.631 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3599, 2024-03-30T12:21:57.631 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68012930173 2024-03-30T12:21:57.631 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.631 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-03-30T12:21:57.631 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3599, 2024-03-30T12:21:57.631 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 225446 2024-03-30T12:21:57.631 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.631 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-03-30T12:21:57.631 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3599, 2024-03-30T12:21:57.631 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3698458 2024-03-30T12:21:57.631 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.631 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-03-30T12:21:57.631 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3599, 2024-03-30T12:21:57.631 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2568815520 2024-03-30T12:21:57.631 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.632 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-03-30T12:21:57.632 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3599, 2024-03-30T12:21:57.632 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 531745 2024-03-30T12:21:57.632 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.632 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-03-30T12:21:57.632 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3599, 2024-03-30T12:21:57.632 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1352631181 2024-03-30T12:21:57.632 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.632 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-03-30T12:21:57.632 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3599, 2024-03-30T12:21:57.632 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 380758614 2024-03-30T12:21:57.632 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.632 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-03-30T12:21:57.632 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 893480 2024-03-30T12:21:57.633 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.633 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-03-30T12:21:57.633 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 60, 2024-03-30T12:21:57.633 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 278192 2024-03-30T12:21:57.633 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.633 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-03-30T12:21:57.633 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3599, 2024-03-30T12:21:57.633 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8278916572 2024-03-30T12:21:57.633 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.633 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-03-30T12:21:57.633 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3599, 2024-03-30T12:21:57.633 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 414555509 2024-03-30T12:21:57.633 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.633 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-03-30T12:21:57.633 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3599, 2024-03-30T12:21:57.634 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 276037833 2024-03-30T12:21:57.634 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.634 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.634 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-03-30T12:21:57.634 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-03-30T12:21:57.634 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1861633264 2024-03-30T12:21:57.634 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.634 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-03-30T12:21:57.634 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 48676864 2024-03-30T12:21:57.634 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.634 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-03-30T12:21:57.634 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 48259072 2024-03-30T12:21:57.634 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.634 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-03-30T12:21:57.635 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3137576038 2024-03-30T12:21:57.635 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.635 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-03-30T12:21:57.635 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 417792 2024-03-30T12:21:57.635 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.635 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.635 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-03-30T12:21:57.635 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.635 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-03-30T12:21:57.635 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.635 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.635 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.635 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.635 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.635 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.635 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.636 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.636 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85465145 2024-03-30T12:21:57.636 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.636 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.636 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.636 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.636 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.636 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.636 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.636 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.636 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.636 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.636 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.636 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.637 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.637 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.637 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.637 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.637 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.637 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 614400 2024-03-30T12:21:57.637 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.637 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.637 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.637 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.637 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.637 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.637 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.637 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.637 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.638 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.638 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.638 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73304007 2024-03-30T12:21:57.638 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.638 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.638 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-03-30T12:21:57.638 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.638 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-03-30T12:21:57.638 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.638 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.638 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:57.638 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.638 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.638 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.638 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.639 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.639 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 640988594 2024-03-30T12:21:57.639 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.639 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.639 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.639 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.639 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.639 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.639 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.639 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.639 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.639 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.639 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.639 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.639 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.639 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.640 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.640 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.640 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.640 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2128 2024-03-30T12:21:57.640 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.640 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.640 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.640 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.640 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.640 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.640 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.640 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.640 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.640 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.640 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.640 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 72040958 2024-03-30T12:21:57.641 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.641 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.641 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-03-30T12:21:57.641 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.641 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-03-30T12:21:57.641 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.641 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.641 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:57.641 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.641 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.641 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-03-30T12:21:57.641 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.641 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.641 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 56976763 2024-03-30T12:21:57.641 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.641 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.642 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.642 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.642 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.642 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.642 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.642 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.642 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.642 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.642 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.642 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.642 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.642 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.642 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.642 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.642 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.642 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.643 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.643 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.643 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.643 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.643 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.643 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.643 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.643 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.643 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.643 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.643 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.643 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68851893 2024-03-30T12:21:57.643 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.643 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.643 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-03-30T12:21:57.643 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.644 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-03-30T12:21:57.644 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.644 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.644 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.644 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.644 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.644 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.644 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.644 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.644 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 640988594 2024-03-30T12:21:57.644 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.644 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.644 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.644 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.644 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.644 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10592 2024-03-30T12:21:57.645 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.645 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.645 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.645 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.645 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.645 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.645 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.645 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.645 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3530 2024-03-30T12:21:57.645 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.645 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.645 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 337773 2024-03-30T12:21:57.645 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.645 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.645 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.646 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.646 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.646 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.646 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.646 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.646 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.646 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.646 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.646 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71691191 2024-03-30T12:21:57.646 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.646 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.646 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-03-30T12:21:57.646 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-03-30T12:21:57.646 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.647 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.647 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:57.647 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.647 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.647 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-03-30T12:21:57.647 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.647 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.647 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:57.647 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.647 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.647 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.647 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:57.647 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-03-30T12:21:57.647 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 47 2024-03-30T12:21:57.647 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.647 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-03-30T12:21:57.648 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.648 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.648 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-03-30T12:21:57.648 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5 2024-03-30T12:21:57.648 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.648 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-03-30T12:21:57.648 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.648 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.648 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-03-30T12:21:57.648 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.648 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.648 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-03-30T12:21:57.648 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 616 2024-03-30T12:21:57.648 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.648 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-03-30T12:21:57.648 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-03-30T12:21:57.649 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 39212871 2024-03-30T12:21:57.649 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.649 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-03-30T12:21:57.649 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.649 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.649 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-03-30T12:21:57.649 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 6, 2024-03-30T12:21:57.649 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3445578 2024-03-30T12:21:57.649 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.649 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-03-30T12:21:57.649 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-03-30T12:21:57.649 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 37409015 2024-03-30T12:21:57.649 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.649 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:57.649 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.650 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.650 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-03-30T12:21:57.650 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.650 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.650 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.650 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-30T12:21:57.650 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.650 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.650 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-03-30T12:21:57.650 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.650 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.650 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-03-30T12:21:57.650 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.650 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.650 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.650 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-03-30T12:21:57.651 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.651 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.651 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.651 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-03-30T12:21:57.651 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.651 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.651 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-03-30T12:21:57.651 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.651 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.651 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-03-30T12:21:57.651 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.651 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.651 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.651 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-30T12:21:57.651 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.652 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.652 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-30T12:21:57.652 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.652 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.652 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-03-30T12:21:57.652 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.652 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.652 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-03-30T12:21:57.652 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.652 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.652 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.652 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-03-30T12:21:57.652 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.652 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.652 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.653 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:57.653 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5 2024-03-30T12:21:57.653 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.653 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-03-30T12:21:57.653 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 616 2024-03-30T12:21:57.653 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.653 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-03-30T12:21:57.653 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-03-30T12:21:57.653 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 39212871 2024-03-30T12:21:57.653 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.653 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-30T12:21:57.653 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.653 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.653 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-03-30T12:21:57.653 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 6, 2024-03-30T12:21:57.653 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3445578 2024-03-30T12:21:57.654 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.654 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-03-30T12:21:57.654 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-03-30T12:21:57.654 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 37409015 2024-03-30T12:21:57.654 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.654 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-03-30T12:21:57.654 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.654 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.654 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-03-30T12:21:57.654 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1771104 2024-03-30T12:21:57.654 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.654 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-03-30T12:21:57.654 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6 2024-03-30T12:21:57.654 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.654 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-03-30T12:21:57.655 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:57.655 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.655 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-03-30T12:21:57.655 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 33165312 2024-03-30T12:21:57.655 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.655 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.655 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.655 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.1": { 2024-03-30T12:21:57.655 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:57.655 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-03-30T12:21:57.655 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.655 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.655 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-03-30T12:21:57.655 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.655 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.655 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-03-30T12:21:57.656 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-03-30T12:21:57.656 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.656 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-03-30T12:21:57.656 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.656 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.656 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-03-30T12:21:57.656 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.656 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.656 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-03-30T12:21:57.656 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.656 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.656 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-03-30T12:21:57.656 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12288 2024-03-30T12:21:57.656 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.656 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-03-30T12:21:57.656 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7188480 2024-03-30T12:21:57.657 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.657 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-03-30T12:21:57.657 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.657 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.657 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.657 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-03-30T12:21:57.657 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.657 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.657 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.657 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-03-30T12:21:57.657 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:57.657 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.657 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-03-30T12:21:57.657 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:57.657 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.657 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-03-30T12:21:57.658 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3624960 2024-03-30T12:21:57.658 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.658 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-03-30T12:21:57.658 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3485696 2024-03-30T12:21:57.658 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.658 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-03-30T12:21:57.658 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:57.658 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.658 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-03-30T12:21:57.658 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.658 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.658 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-03-30T12:21:57.658 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.658 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.659 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-03-30T12:21:57.659 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-03-30T12:21:57.659 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.659 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-03-30T12:21:57.659 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 206272 2024-03-30T12:21:57.659 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.659 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-03-30T12:21:57.659 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 23 2024-03-30T12:21:57.659 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.659 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-03-30T12:21:57.659 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1282048 2024-03-30T12:21:57.659 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.659 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-03-30T12:21:57.659 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1286144 2024-03-30T12:21:57.659 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.659 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-03-30T12:21:57.660 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.660 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.660 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-03-30T12:21:57.660 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.660 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.660 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-03-30T12:21:57.660 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15 2024-03-30T12:21:57.660 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.660 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-03-30T12:21:57.660 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4913 2024-03-30T12:21:57.660 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.660 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-03-30T12:21:57.660 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4 2024-03-30T12:21:57.660 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.661 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-03-30T12:21:57.661 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5505 2024-03-30T12:21:57.661 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.661 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-03-30T12:21:57.661 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:57.661 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.661 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-03-30T12:21:57.661 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5505 2024-03-30T12:21:57.661 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.661 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-03-30T12:21:57.661 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:57.661 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.661 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-03-30T12:21:57.661 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.661 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.661 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-03-30T12:21:57.662 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.662 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.662 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-03-30T12:21:57.662 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.662 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.662 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-03-30T12:21:57.662 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.662 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.662 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-03-30T12:21:57.662 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.662 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.662 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-03-30T12:21:57.662 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.662 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.662 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-03-30T12:21:57.662 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.663 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.663 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-03-30T12:21:57.663 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.663 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.663 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-03-30T12:21:57.663 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.663 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.663 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-03-30T12:21:57.663 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10752000 2024-03-30T12:21:57.663 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.663 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.663 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-03-30T12:21:57.663 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-03-30T12:21:57.663 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-03-30T12:21:57.663 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.664 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-03-30T12:21:57.664 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 696320 2024-03-30T12:21:57.664 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.664 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-03-30T12:21:57.664 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-03-30T12:21:57.664 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 630708 2024-03-30T12:21:57.664 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.664 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-03-30T12:21:57.664 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.664 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.664 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.664 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-03-30T12:21:57.664 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.664 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.664 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-03-30T12:21:57.665 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.665 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.665 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-03-30T12:21:57.665 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.665 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.665 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-03-30T12:21:57.665 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 29, 2024-03-30T12:21:57.665 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 64868 2024-03-30T12:21:57.665 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.665 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-03-30T12:21:57.665 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.665 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.665 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.665 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-03-30T12:21:57.665 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 838, 2024-03-30T12:21:57.665 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 503123192 2024-03-30T12:21:57.666 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.666 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-03-30T12:21:57.666 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 829, 2024-03-30T12:21:57.666 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 21280449 2024-03-30T12:21:57.666 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.666 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-03-30T12:21:57.666 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 838, 2024-03-30T12:21:57.666 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 785814 2024-03-30T12:21:57.666 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.666 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-03-30T12:21:57.666 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 838, 2024-03-30T12:21:57.666 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 503909006 2024-03-30T12:21:57.666 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.666 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-03-30T12:21:57.666 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.667 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.667 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.667 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-03-30T12:21:57.667 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-03-30T12:21:57.667 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 50270 2024-03-30T12:21:57.667 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.667 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-03-30T12:21:57.667 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:57.667 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4855 2024-03-30T12:21:57.667 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.667 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-03-30T12:21:57.667 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.667 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.667 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.667 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-03-30T12:21:57.667 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.668 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.668 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.668 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-03-30T12:21:57.668 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:57.668 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3635 2024-03-30T12:21:57.668 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.668 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-03-30T12:21:57.668 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3900 2024-03-30T12:21:57.668 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.668 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-03-30T12:21:57.668 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 335 2024-03-30T12:21:57.668 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.668 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-03-30T12:21:57.668 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 133, 2024-03-30T12:21:57.668 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3304115 2024-03-30T12:21:57.669 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.669 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-03-30T12:21:57.669 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 344, 2024-03-30T12:21:57.669 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 329850 2024-03-30T12:21:57.669 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.669 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-03-30T12:21:57.669 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 211, 2024-03-30T12:21:57.669 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4707541 2024-03-30T12:21:57.669 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.669 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-03-30T12:21:57.669 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.669 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.669 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-03-30T12:21:57.669 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 103, 2024-03-30T12:21:57.669 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5605124 2024-03-30T12:21:57.669 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.670 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-03-30T12:21:57.670 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3505, 2024-03-30T12:21:57.670 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3957427447 2024-03-30T12:21:57.670 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.670 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-03-30T12:21:57.670 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 119, 2024-03-30T12:21:57.670 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 27053543 2024-03-30T12:21:57.670 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.670 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-03-30T12:21:57.670 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 117, 2024-03-30T12:21:57.670 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 240384678832 2024-03-30T12:21:57.670 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.670 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-03-30T12:21:57.670 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 119, 2024-03-30T12:21:57.670 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 121988771467 2024-03-30T12:21:57.671 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.671 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-03-30T12:21:57.671 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3503, 2024-03-30T12:21:57.671 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 39465131497 2024-03-30T12:21:57.671 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.671 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-03-30T12:21:57.671 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3503, 2024-03-30T12:21:57.671 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 215627 2024-03-30T12:21:57.671 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.671 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-03-30T12:21:57.671 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3505, 2024-03-30T12:21:57.671 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 88529048 2024-03-30T12:21:57.671 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.671 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-03-30T12:21:57.671 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3505, 2024-03-30T12:21:57.672 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2506675102 2024-03-30T12:21:57.672 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.672 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-03-30T12:21:57.672 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3505, 2024-03-30T12:21:57.672 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 547201 2024-03-30T12:21:57.672 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.672 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-03-30T12:21:57.672 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3505, 2024-03-30T12:21:57.672 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1395548672 2024-03-30T12:21:57.672 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.672 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-03-30T12:21:57.672 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3505, 2024-03-30T12:21:57.672 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 385137976 2024-03-30T12:21:57.672 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.672 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-03-30T12:21:57.672 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 301998 2024-03-30T12:21:57.673 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.673 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-03-30T12:21:57.673 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 53, 2024-03-30T12:21:57.673 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 242155 2024-03-30T12:21:57.673 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.673 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-03-30T12:21:57.673 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3505, 2024-03-30T12:21:57.673 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8333575468 2024-03-30T12:21:57.673 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.673 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-03-30T12:21:57.673 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3505, 2024-03-30T12:21:57.673 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 419855241 2024-03-30T12:21:57.673 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.673 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-03-30T12:21:57.673 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3505, 2024-03-30T12:21:57.674 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 281886302 2024-03-30T12:21:57.674 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.674 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.674 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-03-30T12:21:57.674 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-03-30T12:21:57.674 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1861633264 2024-03-30T12:21:57.674 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.674 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-03-30T12:21:57.674 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 47628288 2024-03-30T12:21:57.674 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.674 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-03-30T12:21:57.674 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 46972928 2024-03-30T12:21:57.674 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.674 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-03-30T12:21:57.674 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3137576038 2024-03-30T12:21:57.675 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.675 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-03-30T12:21:57.675 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 655360 2024-03-30T12:21:57.675 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.675 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.675 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-03-30T12:21:57.675 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.675 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-03-30T12:21:57.675 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.675 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.675 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.675 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.675 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.675 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.675 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.675 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.676 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85502942 2024-03-30T12:21:57.676 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.676 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.676 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.676 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.676 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.676 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.676 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.676 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.676 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.676 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.676 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.676 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.676 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.677 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.677 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.677 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.677 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.677 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12288 2024-03-30T12:21:57.677 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.677 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.677 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.677 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.677 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.677 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.677 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.677 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.677 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.677 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.677 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.678 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73868322 2024-03-30T12:21:57.678 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.678 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.678 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-03-30T12:21:57.678 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.678 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-03-30T12:21:57.678 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.678 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.678 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:57.678 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.678 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.678 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.678 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.678 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.678 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641272070 2024-03-30T12:21:57.679 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.679 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.679 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.679 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.679 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.679 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.679 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.679 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.679 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.679 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.679 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.679 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.679 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.679 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.679 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.680 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.680 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.680 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2128 2024-03-30T12:21:57.680 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.680 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.680 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.680 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.680 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.680 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.680 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.680 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.680 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.680 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.680 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.680 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71757482 2024-03-30T12:21:57.680 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.681 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.681 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-03-30T12:21:57.681 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.681 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-03-30T12:21:57.681 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.681 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.681 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:57.681 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.681 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.681 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-03-30T12:21:57.681 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.681 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.681 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57001961 2024-03-30T12:21:57.681 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.682 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.682 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.682 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.682 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.682 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.682 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.682 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.682 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.682 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.682 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.682 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.682 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.682 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.682 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.683 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.683 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.683 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.683 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.683 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.683 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.683 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.683 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.683 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.683 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.683 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.683 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.683 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.683 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.683 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68826695 2024-03-30T12:21:57.683 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.684 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.684 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-03-30T12:21:57.684 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.684 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-03-30T12:21:57.684 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.684 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.684 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.684 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.684 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.684 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.684 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.684 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.684 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641272070 2024-03-30T12:21:57.684 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.684 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.685 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.685 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.685 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.685 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.685 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.685 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.685 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.685 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.685 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.685 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.685 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.685 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.685 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5741 2024-03-30T12:21:57.685 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.685 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.686 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 314642 2024-03-30T12:21:57.686 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.686 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.686 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.686 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.686 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.686 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.686 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.686 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.686 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.686 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.686 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.686 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71439227 2024-03-30T12:21:57.686 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.687 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.687 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-03-30T12:21:57.687 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-03-30T12:21:57.687 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.687 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.687 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:57.687 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.687 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.687 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-03-30T12:21:57.687 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.687 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.687 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:57.687 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.687 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.687 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.688 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:57.688 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-03-30T12:21:57.688 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 36 2024-03-30T12:21:57.688 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.688 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-03-30T12:21:57.688 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.688 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.688 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-03-30T12:21:57.688 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 155 2024-03-30T12:21:57.688 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.688 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-03-30T12:21:57.688 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.688 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.688 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-03-30T12:21:57.688 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.688 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.689 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-03-30T12:21:57.689 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2429440 2024-03-30T12:21:57.689 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.689 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-03-30T12:21:57.689 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 155, 2024-03-30T12:21:57.689 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1252319103 2024-03-30T12:21:57.689 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.689 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-03-30T12:21:57.689 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1052 2024-03-30T12:21:57.689 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.689 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-03-30T12:21:57.689 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 155, 2024-03-30T12:21:57.689 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 60193800 2024-03-30T12:21:57.689 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.689 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-03-30T12:21:57.690 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 155, 2024-03-30T12:21:57.690 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 216282811 2024-03-30T12:21:57.690 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.690 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:57.690 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 33 2024-03-30T12:21:57.690 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.690 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-03-30T12:21:57.690 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 33, 2024-03-30T12:21:57.690 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5664624 2024-03-30T12:21:57.690 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.690 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-30T12:21:57.690 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.690 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.690 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-03-30T12:21:57.690 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1052 2024-03-30T12:21:57.691 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.691 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-03-30T12:21:57.691 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 33, 2024-03-30T12:21:57.691 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5005861 2024-03-30T12:21:57.691 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.691 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-03-30T12:21:57.691 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 33, 2024-03-30T12:21:57.691 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4204639 2024-03-30T12:21:57.691 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.691 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-03-30T12:21:57.691 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-03-30T12:21:57.691 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.691 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-03-30T12:21:57.691 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.691 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.691 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-03-30T12:21:57.692 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 22, 2024-03-30T12:21:57.692 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 19439934 2024-03-30T12:21:57.692 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.692 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-30T12:21:57.692 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.692 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.692 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-30T12:21:57.692 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.692 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.692 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-03-30T12:21:57.692 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.692 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.692 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-03-30T12:21:57.692 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 22, 2024-03-30T12:21:57.692 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8228508 2024-03-30T12:21:57.693 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.693 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-03-30T12:21:57.693 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 22, 2024-03-30T12:21:57.693 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18340045 2024-03-30T12:21:57.693 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.693 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:57.693 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 100 2024-03-30T12:21:57.693 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.693 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-03-30T12:21:57.693 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2429440 2024-03-30T12:21:57.693 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.693 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-03-30T12:21:57.693 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 100, 2024-03-30T12:21:57.693 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1227214545 2024-03-30T12:21:57.693 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.694 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-30T12:21:57.694 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.694 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.694 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-03-30T12:21:57.694 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 100, 2024-03-30T12:21:57.694 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 46959431 2024-03-30T12:21:57.694 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.694 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-03-30T12:21:57.694 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 100, 2024-03-30T12:21:57.694 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 193738127 2024-03-30T12:21:57.694 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.694 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-03-30T12:21:57.694 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.694 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.694 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-03-30T12:21:57.695 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 590368 2024-03-30T12:21:57.695 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.695 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-03-30T12:21:57.695 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:57.695 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.695 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-03-30T12:21:57.695 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:57.695 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.695 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-03-30T12:21:57.695 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 32563200 2024-03-30T12:21:57.695 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.695 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.695 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.695 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.2": { 2024-03-30T12:21:57.695 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:57.695 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-03-30T12:21:57.696 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.696 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.696 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-03-30T12:21:57.696 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.696 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.696 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-03-30T12:21:57.696 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-03-30T12:21:57.696 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.696 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-03-30T12:21:57.696 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.696 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.696 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-03-30T12:21:57.696 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.696 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.696 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-03-30T12:21:57.696 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.697 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.697 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-03-30T12:21:57.697 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12288 2024-03-30T12:21:57.697 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.697 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-03-30T12:21:57.697 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7086080 2024-03-30T12:21:57.697 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.697 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-03-30T12:21:57.697 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.697 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.697 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.697 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-03-30T12:21:57.697 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.697 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.697 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.698 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-03-30T12:21:57.698 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:57.698 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.698 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-03-30T12:21:57.698 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:57.698 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.698 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-03-30T12:21:57.698 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3620864 2024-03-30T12:21:57.698 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.698 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-03-30T12:21:57.698 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3481600 2024-03-30T12:21:57.698 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.698 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-03-30T12:21:57.698 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:57.698 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.699 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-03-30T12:21:57.699 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.699 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.699 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-03-30T12:21:57.699 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.699 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-03-30T12:21:57.699 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-03-30T12:21:57.699 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.699 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-03-30T12:21:57.699 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 206272 2024-03-30T12:21:57.699 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.699 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-03-30T12:21:57.699 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 23 2024-03-30T12:21:57.700 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.700 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-03-30T12:21:57.700 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1282048 2024-03-30T12:21:57.700 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.700 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-03-30T12:21:57.700 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1286144 2024-03-30T12:21:57.700 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.700 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-03-30T12:21:57.700 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.700 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.700 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-03-30T12:21:57.700 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.700 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.700 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-03-30T12:21:57.700 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15 2024-03-30T12:21:57.700 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.701 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-03-30T12:21:57.701 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4913 2024-03-30T12:21:57.701 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.701 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-03-30T12:21:57.701 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4 2024-03-30T12:21:57.701 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.701 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-03-30T12:21:57.701 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5505 2024-03-30T12:21:57.701 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.701 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-03-30T12:21:57.701 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:57.701 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.701 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-03-30T12:21:57.701 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5505 2024-03-30T12:21:57.701 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.702 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-03-30T12:21:57.702 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:57.702 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.702 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-03-30T12:21:57.702 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.702 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.702 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-03-30T12:21:57.702 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.702 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.702 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-03-30T12:21:57.702 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.702 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.702 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-03-30T12:21:57.702 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.703 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.703 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-03-30T12:21:57.703 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.703 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.703 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-03-30T12:21:57.703 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.703 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.703 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-03-30T12:21:57.703 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.703 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.703 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-03-30T12:21:57.703 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.703 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.703 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-03-30T12:21:57.703 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.703 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.704 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-03-30T12:21:57.704 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10645504 2024-03-30T12:21:57.704 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.704 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.704 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-03-30T12:21:57.704 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-03-30T12:21:57.704 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-03-30T12:21:57.704 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.704 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-03-30T12:21:57.704 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 692224 2024-03-30T12:21:57.704 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.704 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-03-30T12:21:57.704 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 4, 2024-03-30T12:21:57.704 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 315497 2024-03-30T12:21:57.705 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.705 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-03-30T12:21:57.705 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.705 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.705 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.705 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-03-30T12:21:57.705 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.705 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.705 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-03-30T12:21:57.705 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.705 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.705 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-03-30T12:21:57.705 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.705 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.705 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-03-30T12:21:57.705 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 12, 2024-03-30T12:21:57.706 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14535 2024-03-30T12:21:57.706 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.706 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-03-30T12:21:57.706 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.706 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.706 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.706 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-03-30T12:21:57.706 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 837, 2024-03-30T12:21:57.706 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 475534004 2024-03-30T12:21:57.706 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.706 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-03-30T12:21:57.706 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 831, 2024-03-30T12:21:57.706 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 17874673 2024-03-30T12:21:57.706 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.706 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-03-30T12:21:57.707 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 837, 2024-03-30T12:21:57.707 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 714963 2024-03-30T12:21:57.707 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.707 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-03-30T12:21:57.707 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 837, 2024-03-30T12:21:57.707 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 476248967 2024-03-30T12:21:57.707 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.707 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-03-30T12:21:57.707 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.707 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.707 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.707 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-03-30T12:21:57.707 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-03-30T12:21:57.707 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 48785 2024-03-30T12:21:57.707 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.708 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-03-30T12:21:57.708 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.708 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.708 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.708 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-03-30T12:21:57.708 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.708 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.708 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.708 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-03-30T12:21:57.708 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.708 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.708 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.708 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-03-30T12:21:57.708 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:57.708 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4693 2024-03-30T12:21:57.708 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.709 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-03-30T12:21:57.709 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3671 2024-03-30T12:21:57.709 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.709 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-03-30T12:21:57.709 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 311 2024-03-30T12:21:57.709 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.709 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-03-30T12:21:57.709 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 86, 2024-03-30T12:21:57.709 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1322161 2024-03-30T12:21:57.709 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.709 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-03-30T12:21:57.709 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 245, 2024-03-30T12:21:57.709 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 334492 2024-03-30T12:21:57.709 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.709 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-03-30T12:21:57.710 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 159, 2024-03-30T12:21:57.710 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3351834 2024-03-30T12:21:57.710 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.710 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-03-30T12:21:57.710 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.710 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.710 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-03-30T12:21:57.710 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 103, 2024-03-30T12:21:57.710 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5611395 2024-03-30T12:21:57.710 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.710 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-03-30T12:21:57.710 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3428, 2024-03-30T12:21:57.710 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3819840965 2024-03-30T12:21:57.710 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.710 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-03-30T12:21:57.711 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 112, 2024-03-30T12:21:57.711 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24016685 2024-03-30T12:21:57.711 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.711 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-03-30T12:21:57.711 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 110, 2024-03-30T12:21:57.711 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 219937692674 2024-03-30T12:21:57.711 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.711 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-03-30T12:21:57.711 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 112, 2024-03-30T12:21:57.711 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 115547879998 2024-03-30T12:21:57.711 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.711 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-03-30T12:21:57.711 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3426, 2024-03-30T12:21:57.711 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68723871201 2024-03-30T12:21:57.711 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.712 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-03-30T12:21:57.712 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3426, 2024-03-30T12:21:57.712 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 188218 2024-03-30T12:21:57.712 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.712 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-03-30T12:21:57.712 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3428, 2024-03-30T12:21:57.712 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4325673 2024-03-30T12:21:57.712 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.712 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-03-30T12:21:57.712 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3428, 2024-03-30T12:21:57.712 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2492665956 2024-03-30T12:21:57.712 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.712 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-03-30T12:21:57.712 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3428, 2024-03-30T12:21:57.712 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 618143 2024-03-30T12:21:57.712 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.713 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-03-30T12:21:57.713 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3428, 2024-03-30T12:21:57.713 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1379868043 2024-03-30T12:21:57.713 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.713 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-03-30T12:21:57.713 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3428, 2024-03-30T12:21:57.713 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 365669512 2024-03-30T12:21:57.713 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.713 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-03-30T12:21:57.713 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 302111 2024-03-30T12:21:57.713 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.713 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-03-30T12:21:57.713 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 46, 2024-03-30T12:21:57.713 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 224325 2024-03-30T12:21:57.713 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.714 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-03-30T12:21:57.714 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3428, 2024-03-30T12:21:57.714 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8062593582 2024-03-30T12:21:57.714 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.714 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-03-30T12:21:57.714 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3428, 2024-03-30T12:21:57.714 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 400499830 2024-03-30T12:21:57.714 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.714 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-03-30T12:21:57.714 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3428, 2024-03-30T12:21:57.714 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 268926979 2024-03-30T12:21:57.714 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.714 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.714 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-03-30T12:21:57.714 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-03-30T12:21:57.715 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1861633264 2024-03-30T12:21:57.715 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.715 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-03-30T12:21:57.715 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 47562752 2024-03-30T12:21:57.715 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.715 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-03-30T12:21:57.715 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 46678016 2024-03-30T12:21:57.715 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.715 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-03-30T12:21:57.715 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3137576038 2024-03-30T12:21:57.715 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.715 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-03-30T12:21:57.715 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 884736 2024-03-30T12:21:57.715 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.715 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.715 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-03-30T12:21:57.716 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.716 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-03-30T12:21:57.716 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.716 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.716 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.716 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.716 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.716 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.716 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.716 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.716 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85503438 2024-03-30T12:21:57.716 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.716 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.716 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.716 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.716 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.717 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.717 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.717 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.717 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.717 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.717 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.717 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.717 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.717 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.717 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.718 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.718 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.718 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12288 2024-03-30T12:21:57.718 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.718 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.718 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.718 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.718 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.718 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.718 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.718 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.718 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.718 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.718 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.719 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73867826 2024-03-30T12:21:57.719 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.719 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.719 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-03-30T12:21:57.719 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.719 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-03-30T12:21:57.719 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.719 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.719 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:57.719 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.719 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.719 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.719 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.719 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.719 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641275788 2024-03-30T12:21:57.719 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.720 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.720 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.720 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.720 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.720 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.720 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.720 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.720 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.720 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.720 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.720 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.720 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.720 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.720 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.721 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.721 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.721 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2128 2024-03-30T12:21:57.721 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.721 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.721 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.721 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.721 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.721 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.721 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.721 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.721 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.721 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.721 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.721 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71753764 2024-03-30T12:21:57.722 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.722 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.722 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-03-30T12:21:57.722 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.722 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-03-30T12:21:57.722 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.722 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.722 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:57.722 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.722 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.722 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-03-30T12:21:57.722 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.722 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.722 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57002292 2024-03-30T12:21:57.723 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.723 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.723 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.723 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.723 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.723 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.723 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.723 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.723 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.723 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.723 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.723 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.723 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.723 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.723 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.724 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.724 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.724 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.724 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.724 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.724 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.724 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.724 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.724 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.724 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.724 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.724 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.724 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.724 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.724 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68826364 2024-03-30T12:21:57.725 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.725 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.725 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-03-30T12:21:57.725 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.725 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-03-30T12:21:57.725 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.725 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.725 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.725 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.725 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.725 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.725 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.725 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.725 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641275788 2024-03-30T12:21:57.725 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.726 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.726 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.726 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.726 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.726 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.726 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.726 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.726 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.726 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.726 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.726 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.726 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.726 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.726 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6863 2024-03-30T12:21:57.727 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.727 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.727 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 305417 2024-03-30T12:21:57.727 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.727 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.727 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.727 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.727 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.727 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.727 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.727 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.727 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.727 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.727 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.727 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71443612 2024-03-30T12:21:57.727 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.727 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.728 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-03-30T12:21:57.728 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-03-30T12:21:57.728 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.728 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.728 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:57.728 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.728 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.728 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-03-30T12:21:57.728 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.728 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.728 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:57.728 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.728 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.728 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.728 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:57.729 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-03-30T12:21:57.729 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 28 2024-03-30T12:21:57.729 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.729 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-03-30T12:21:57.729 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.729 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.729 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-03-30T12:21:57.729 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-03-30T12:21:57.729 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.729 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-03-30T12:21:57.729 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.729 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.729 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-03-30T12:21:57.729 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.729 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.729 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-03-30T12:21:57.730 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.730 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.730 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-03-30T12:21:57.730 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-03-30T12:21:57.730 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 121029808 2024-03-30T12:21:57.730 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.730 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-03-30T12:21:57.730 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.730 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.730 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-03-30T12:21:57.730 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-03-30T12:21:57.730 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4934667 2024-03-30T12:21:57.730 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.730 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-03-30T12:21:57.730 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-03-30T12:21:57.731 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 103164583 2024-03-30T12:21:57.731 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.731 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:57.731 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.731 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.731 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-03-30T12:21:57.731 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.731 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.731 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.731 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-30T12:21:57.731 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.731 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.731 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-03-30T12:21:57.731 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.731 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.732 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-03-30T12:21:57.732 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.732 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.732 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.732 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-03-30T12:21:57.732 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.732 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.732 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.732 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-03-30T12:21:57.732 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.732 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.732 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-03-30T12:21:57.732 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.732 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.732 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-03-30T12:21:57.732 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.733 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.733 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.733 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-30T12:21:57.733 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.733 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.733 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-30T12:21:57.733 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.733 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.733 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-03-30T12:21:57.733 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.733 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.733 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-03-30T12:21:57.733 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.733 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.733 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.734 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-03-30T12:21:57.734 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.734 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.734 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.734 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:57.734 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-03-30T12:21:57.734 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.734 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-03-30T12:21:57.734 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.734 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.737 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-03-30T12:21:57.737 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-03-30T12:21:57.737 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 121029808 2024-03-30T12:21:57.737 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.737 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-30T12:21:57.738 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.738 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.738 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-03-30T12:21:57.738 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-03-30T12:21:57.738 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4934667 2024-03-30T12:21:57.738 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.738 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-03-30T12:21:57.738 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-03-30T12:21:57.738 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 103164583 2024-03-30T12:21:57.738 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.738 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-03-30T12:21:57.738 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.738 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.738 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-03-30T12:21:57.738 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.739 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.739 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-03-30T12:21:57.739 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.739 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.739 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-03-30T12:21:57.739 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:57.739 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.739 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-03-30T12:21:57.739 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 32559104 2024-03-30T12:21:57.739 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.739 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.739 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.739 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.3": { 2024-03-30T12:21:57.739 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:57.740 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-03-30T12:21:57.740 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.740 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.740 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-03-30T12:21:57.740 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.740 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.740 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-03-30T12:21:57.740 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-03-30T12:21:57.740 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.740 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-03-30T12:21:57.740 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.740 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.740 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-03-30T12:21:57.740 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.740 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.741 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-03-30T12:21:57.741 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.741 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.741 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-03-30T12:21:57.741 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12288 2024-03-30T12:21:57.741 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.741 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-03-30T12:21:57.741 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1171456 2024-03-30T12:21:57.741 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.741 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-03-30T12:21:57.741 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.741 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.741 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.741 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-03-30T12:21:57.741 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.742 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.742 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.742 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-03-30T12:21:57.742 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:57.742 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.742 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-03-30T12:21:57.742 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 27656192 2024-03-30T12:21:57.742 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.742 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-03-30T12:21:57.742 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 868352 2024-03-30T12:21:57.742 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.742 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-03-30T12:21:57.742 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 729088 2024-03-30T12:21:57.742 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.743 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-03-30T12:21:57.743 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:57.743 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.743 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-03-30T12:21:57.743 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.743 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.743 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-03-30T12:21:57.743 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.743 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.743 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-03-30T12:21:57.743 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-03-30T12:21:57.743 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.743 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-03-30T12:21:57.743 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 206272 2024-03-30T12:21:57.743 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.743 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-03-30T12:21:57.744 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 23 2024-03-30T12:21:57.744 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.744 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-03-30T12:21:57.744 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1282048 2024-03-30T12:21:57.744 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.744 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-03-30T12:21:57.744 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1286144 2024-03-30T12:21:57.744 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.744 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-03-30T12:21:57.744 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.744 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.744 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-03-30T12:21:57.744 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.744 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.744 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-03-30T12:21:57.745 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15 2024-03-30T12:21:57.745 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.745 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-03-30T12:21:57.745 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4913 2024-03-30T12:21:57.745 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.745 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-03-30T12:21:57.745 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4 2024-03-30T12:21:57.745 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.745 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-03-30T12:21:57.745 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5503 2024-03-30T12:21:57.745 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.745 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-03-30T12:21:57.745 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:57.745 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.745 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-03-30T12:21:57.745 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5503 2024-03-30T12:21:57.746 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.746 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-03-30T12:21:57.746 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:57.746 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.746 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-03-30T12:21:57.746 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.746 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.746 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-03-30T12:21:57.746 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.746 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.746 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-03-30T12:21:57.746 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.746 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.746 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-03-30T12:21:57.747 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.747 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.747 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-03-30T12:21:57.747 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.747 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.747 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-03-30T12:21:57.747 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.747 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.747 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-03-30T12:21:57.747 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.747 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.747 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-03-30T12:21:57.747 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.747 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.747 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-03-30T12:21:57.748 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.748 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.748 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-03-30T12:21:57.748 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1978368 2024-03-30T12:21:57.748 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.748 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.748 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-03-30T12:21:57.748 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-03-30T12:21:57.748 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-03-30T12:21:57.748 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.748 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-03-30T12:21:57.748 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 716800 2024-03-30T12:21:57.748 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.748 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-03-30T12:21:57.748 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.749 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.749 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.749 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-03-30T12:21:57.749 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.749 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.749 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.749 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-03-30T12:21:57.749 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.749 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.749 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-03-30T12:21:57.749 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.749 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.749 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-03-30T12:21:57.749 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.749 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.750 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-03-30T12:21:57.750 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-03-30T12:21:57.750 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6422 2024-03-30T12:21:57.750 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.750 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-03-30T12:21:57.750 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.750 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.750 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.750 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-03-30T12:21:57.750 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 165, 2024-03-30T12:21:57.750 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 47230343 2024-03-30T12:21:57.750 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.750 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-03-30T12:21:57.750 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 160, 2024-03-30T12:21:57.750 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3625086 2024-03-30T12:21:57.751 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.751 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-03-30T12:21:57.751 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 165, 2024-03-30T12:21:57.751 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 200287 2024-03-30T12:21:57.751 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.751 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-03-30T12:21:57.751 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 165, 2024-03-30T12:21:57.751 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 47430630 2024-03-30T12:21:57.751 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.751 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-03-30T12:21:57.751 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.751 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.751 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.751 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-03-30T12:21:57.751 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:57.751 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 45757 2024-03-30T12:21:57.752 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.752 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-03-30T12:21:57.752 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.752 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.752 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.752 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-03-30T12:21:57.752 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.752 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.752 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.752 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-03-30T12:21:57.752 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.752 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.752 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.752 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-03-30T12:21:57.752 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:57.753 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4461 2024-03-30T12:21:57.753 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.753 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-03-30T12:21:57.753 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 347 2024-03-30T12:21:57.753 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.753 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-03-30T12:21:57.753 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 214 2024-03-30T12:21:57.753 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.753 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-03-30T12:21:57.753 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 86, 2024-03-30T12:21:57.753 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 961905 2024-03-30T12:21:57.753 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.753 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-03-30T12:21:57.753 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 152, 2024-03-30T12:21:57.753 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 255917 2024-03-30T12:21:57.753 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.754 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-03-30T12:21:57.754 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 66, 2024-03-30T12:21:57.754 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 413323 2024-03-30T12:21:57.754 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.754 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-03-30T12:21:57.754 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.754 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.754 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-03-30T12:21:57.754 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.754 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.754 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.754 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-03-30T12:21:57.754 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 241, 2024-03-30T12:21:57.754 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13877141 2024-03-30T12:21:57.754 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.755 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-03-30T12:21:57.755 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 53, 2024-03-30T12:21:57.755 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3444117 2024-03-30T12:21:57.755 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.755 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-03-30T12:21:57.755 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 50, 2024-03-30T12:21:57.755 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 302287727870 2024-03-30T12:21:57.755 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.755 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-03-30T12:21:57.755 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 53, 2024-03-30T12:21:57.755 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65851124247 2024-03-30T12:21:57.755 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.755 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-03-30T12:21:57.755 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 238, 2024-03-30T12:21:57.755 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 578893 2024-03-30T12:21:57.756 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.756 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-03-30T12:21:57.756 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 238, 2024-03-30T12:21:57.756 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 23718 2024-03-30T12:21:57.756 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.756 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-03-30T12:21:57.756 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 241, 2024-03-30T12:21:57.756 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 304080 2024-03-30T12:21:57.756 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.756 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-03-30T12:21:57.756 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 241, 2024-03-30T12:21:57.756 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 88609307 2024-03-30T12:21:57.756 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.756 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-03-30T12:21:57.756 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 241, 2024-03-30T12:21:57.757 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 69687 2024-03-30T12:21:57.757 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.757 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-03-30T12:21:57.757 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 241, 2024-03-30T12:21:57.757 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 48259057 2024-03-30T12:21:57.757 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.757 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-03-30T12:21:57.757 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 241, 2024-03-30T12:21:57.757 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13672331 2024-03-30T12:21:57.757 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.757 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-03-30T12:21:57.757 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 305120 2024-03-30T12:21:57.757 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.757 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-03-30T12:21:57.757 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 44, 2024-03-30T12:21:57.758 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 238004 2024-03-30T12:21:57.758 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.758 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-03-30T12:21:57.758 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 241, 2024-03-30T12:21:57.758 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 164749951 2024-03-30T12:21:57.758 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.758 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-03-30T12:21:57.758 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 241, 2024-03-30T12:21:57.758 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15966531 2024-03-30T12:21:57.758 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.758 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-03-30T12:21:57.758 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 241, 2024-03-30T12:21:57.758 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2631429 2024-03-30T12:21:57.758 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.759 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.759 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-03-30T12:21:57.759 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-03-30T12:21:57.759 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1861633264 2024-03-30T12:21:57.759 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.759 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-03-30T12:21:57.759 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 41336832 2024-03-30T12:21:57.759 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.759 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-03-30T12:21:57.759 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 40493056 2024-03-30T12:21:57.759 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.759 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-03-30T12:21:57.759 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3137576038 2024-03-30T12:21:57.759 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.759 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-03-30T12:21:57.759 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 843776 2024-03-30T12:21:57.760 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.760 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.760 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-03-30T12:21:57.760 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.760 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-03-30T12:21:57.760 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.760 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.760 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.760 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.760 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.760 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.760 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.760 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.760 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85510208 2024-03-30T12:21:57.760 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.761 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.761 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.761 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.761 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.761 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.761 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.761 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.761 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.761 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.761 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.761 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.761 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.761 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.761 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.761 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.761 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.762 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.762 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.762 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.762 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.762 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.762 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.762 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.762 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.762 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.762 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.762 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.762 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.762 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73873344 2024-03-30T12:21:57.762 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.762 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.763 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-03-30T12:21:57.763 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.763 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-03-30T12:21:57.763 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.763 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.763 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:57.763 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.763 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.763 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.763 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.763 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.763 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641326565 2024-03-30T12:21:57.763 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.763 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.763 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.763 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.764 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.764 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.764 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.764 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.764 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.764 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.764 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.764 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.764 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.764 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.764 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.764 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.764 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.764 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2128 2024-03-30T12:21:57.764 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.765 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.765 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.765 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.765 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.765 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.765 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.765 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.765 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.765 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.765 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.765 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71702987 2024-03-30T12:21:57.765 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.765 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.765 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-03-30T12:21:57.765 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.766 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-03-30T12:21:57.766 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.766 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.766 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:57.766 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.766 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.766 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-03-30T12:21:57.766 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.766 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.766 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57006805 2024-03-30T12:21:57.766 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.766 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.766 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.766 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.766 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.767 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.767 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.767 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.767 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.767 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.767 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.767 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.767 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.767 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.767 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.767 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.767 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.767 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.767 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.767 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.768 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.768 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.768 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.768 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.768 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.768 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.768 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.768 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.768 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.768 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68821851 2024-03-30T12:21:57.768 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.768 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.768 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-03-30T12:21:57.768 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.768 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-03-30T12:21:57.769 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.769 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.769 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.769 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.769 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.769 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.769 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.769 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.769 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641326565 2024-03-30T12:21:57.769 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.769 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.769 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.769 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.769 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.769 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.769 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.770 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.770 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.770 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.770 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.770 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.770 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.770 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.770 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14050 2024-03-30T12:21:57.770 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.770 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.770 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 201392 2024-03-30T12:21:57.770 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.770 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.770 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.771 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.771 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.771 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.771 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.771 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.771 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.771 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.771 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.771 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71489673 2024-03-30T12:21:57.771 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.771 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.771 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-03-30T12:21:57.771 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-03-30T12:21:57.771 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.771 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.771 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:57.771 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.772 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.772 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-03-30T12:21:57.772 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.772 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.772 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:57.772 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.772 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.772 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.772 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:57.772 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-03-30T12:21:57.772 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 36 2024-03-30T12:21:57.772 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.772 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-03-30T12:21:57.772 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.772 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.772 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-03-30T12:21:57.773 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.773 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.773 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-03-30T12:21:57.773 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.773 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.773 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-03-30T12:21:57.773 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.773 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.773 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-03-30T12:21:57.773 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.773 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.773 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-03-30T12:21:57.773 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.773 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.773 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.773 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-03-30T12:21:57.773 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.774 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.774 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-03-30T12:21:57.774 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:57.774 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 858390 2024-03-30T12:21:57.774 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.774 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-03-30T12:21:57.774 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.774 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.774 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.774 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:57.774 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.774 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.774 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-03-30T12:21:57.774 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.774 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.775 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.775 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-30T12:21:57.775 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.775 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.775 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-03-30T12:21:57.775 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.775 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.775 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-03-30T12:21:57.775 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.775 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.775 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.775 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-03-30T12:21:57.775 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.775 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.775 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.776 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-03-30T12:21:57.776 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.776 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.776 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-03-30T12:21:57.776 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.776 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.776 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-03-30T12:21:57.776 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.776 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.776 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.776 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-30T12:21:57.776 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.777 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.777 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-30T12:21:57.777 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.777 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.777 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-03-30T12:21:57.777 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.777 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.777 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-03-30T12:21:57.777 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.777 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.777 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.777 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-03-30T12:21:57.777 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.777 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.777 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.778 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:57.778 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.778 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.778 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-03-30T12:21:57.778 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.778 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.778 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-03-30T12:21:57.778 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.778 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.778 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.778 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-30T12:21:57.778 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.778 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.778 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-03-30T12:21:57.779 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:57.779 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 858390 2024-03-30T12:21:57.779 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.779 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-03-30T12:21:57.779 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.779 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.779 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.779 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-03-30T12:21:57.779 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.779 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.779 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-03-30T12:21:57.779 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.779 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.779 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-03-30T12:21:57.779 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.780 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.780 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-03-30T12:21:57.780 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:57.780 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.780 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-03-30T12:21:57.780 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 28381184 2024-03-30T12:21:57.780 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.780 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.780 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.780 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.4": { 2024-03-30T12:21:57.780 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:57.780 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-03-30T12:21:57.780 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.780 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.780 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-03-30T12:21:57.781 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.781 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.781 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-03-30T12:21:57.781 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-03-30T12:21:57.781 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.781 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-03-30T12:21:57.781 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.781 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.781 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-03-30T12:21:57.781 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.781 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.781 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-03-30T12:21:57.781 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.781 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.781 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-03-30T12:21:57.782 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12288 2024-03-30T12:21:57.782 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.782 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-03-30T12:21:57.782 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5967872 2024-03-30T12:21:57.782 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.782 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-03-30T12:21:57.782 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.782 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.782 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.782 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-03-30T12:21:57.782 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.782 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.782 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.782 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-03-30T12:21:57.783 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:57.783 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.783 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-03-30T12:21:57.783 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 27656192 2024-03-30T12:21:57.783 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.783 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-03-30T12:21:57.783 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2961408 2024-03-30T12:21:57.783 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.783 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-03-30T12:21:57.783 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2822144 2024-03-30T12:21:57.783 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.783 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-03-30T12:21:57.783 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:57.783 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.783 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-03-30T12:21:57.784 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.784 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.784 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-03-30T12:21:57.784 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.784 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-03-30T12:21:57.784 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-03-30T12:21:57.784 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.784 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-03-30T12:21:57.784 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 206272 2024-03-30T12:21:57.784 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.784 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-03-30T12:21:57.784 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 23 2024-03-30T12:21:57.784 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.784 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-03-30T12:21:57.784 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1282048 2024-03-30T12:21:57.785 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.785 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-03-30T12:21:57.785 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1286144 2024-03-30T12:21:57.785 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.785 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-03-30T12:21:57.785 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.785 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.785 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-03-30T12:21:57.785 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.785 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.785 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-03-30T12:21:57.785 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15 2024-03-30T12:21:57.785 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.785 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-03-30T12:21:57.785 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4913 2024-03-30T12:21:57.786 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.786 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-03-30T12:21:57.786 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4 2024-03-30T12:21:57.786 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.786 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-03-30T12:21:57.786 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5505 2024-03-30T12:21:57.786 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.786 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-03-30T12:21:57.786 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:57.786 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.786 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-03-30T12:21:57.786 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5505 2024-03-30T12:21:57.786 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.786 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-03-30T12:21:57.786 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:57.787 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.787 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-03-30T12:21:57.787 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.787 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.787 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-03-30T12:21:57.787 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.787 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.787 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-03-30T12:21:57.787 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.787 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.787 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-03-30T12:21:57.787 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.787 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.787 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-03-30T12:21:57.787 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.787 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.788 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-03-30T12:21:57.788 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.788 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.788 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-03-30T12:21:57.788 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.788 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.788 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-03-30T12:21:57.788 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.788 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.788 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-03-30T12:21:57.788 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.788 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.788 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-03-30T12:21:57.788 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8867840 2024-03-30T12:21:57.788 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.788 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.789 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-03-30T12:21:57.789 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-03-30T12:21:57.789 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-03-30T12:21:57.789 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.789 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-03-30T12:21:57.789 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 704512 2024-03-30T12:21:57.789 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.789 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-03-30T12:21:57.789 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 8, 2024-03-30T12:21:57.789 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 542831 2024-03-30T12:21:57.789 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.789 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-03-30T12:21:57.789 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.789 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.789 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.789 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-03-30T12:21:57.790 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.790 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.790 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-03-30T12:21:57.790 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.790 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.790 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-03-30T12:21:57.790 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.790 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.790 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-03-30T12:21:57.790 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:57.790 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1580 2024-03-30T12:21:57.790 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.790 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-03-30T12:21:57.790 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.790 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.791 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.791 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-03-30T12:21:57.791 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 676, 2024-03-30T12:21:57.791 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464886614 2024-03-30T12:21:57.791 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.791 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-03-30T12:21:57.791 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 671, 2024-03-30T12:21:57.791 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 21025217 2024-03-30T12:21:57.791 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.791 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-03-30T12:21:57.791 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 676, 2024-03-30T12:21:57.791 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 608353 2024-03-30T12:21:57.791 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.791 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-03-30T12:21:57.791 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 676, 2024-03-30T12:21:57.791 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 465494967 2024-03-30T12:21:57.792 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.792 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-03-30T12:21:57.792 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.792 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.792 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.792 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-03-30T12:21:57.792 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-03-30T12:21:57.792 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 42260 2024-03-30T12:21:57.792 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.792 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-03-30T12:21:57.792 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.792 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.792 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.792 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-03-30T12:21:57.793 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.793 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.793 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.793 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-03-30T12:21:57.793 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.793 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.793 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.793 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-03-30T12:21:57.793 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:57.793 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5157 2024-03-30T12:21:57.793 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.793 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-03-30T12:21:57.793 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3445 2024-03-30T12:21:57.793 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.793 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-03-30T12:21:57.794 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 331 2024-03-30T12:21:57.794 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.794 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-03-30T12:21:57.794 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 91, 2024-03-30T12:21:57.794 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 912687 2024-03-30T12:21:57.794 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.794 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-03-30T12:21:57.794 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 152, 2024-03-30T12:21:57.794 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 285583 2024-03-30T12:21:57.794 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.794 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-03-30T12:21:57.794 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 61, 2024-03-30T12:21:57.794 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 161018 2024-03-30T12:21:57.795 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.795 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-03-30T12:21:57.795 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.795 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.795 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-03-30T12:21:57.795 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 105, 2024-03-30T12:21:57.795 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5889652 2024-03-30T12:21:57.795 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.795 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-03-30T12:21:57.795 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3351, 2024-03-30T12:21:57.795 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3629174420 2024-03-30T12:21:57.795 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.795 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-03-30T12:21:57.795 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 41, 2024-03-30T12:21:57.795 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 28218838 2024-03-30T12:21:57.796 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.796 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-03-30T12:21:57.796 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 40, 2024-03-30T12:21:57.796 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 188843910793 2024-03-30T12:21:57.796 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.796 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-03-30T12:21:57.796 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 41, 2024-03-30T12:21:57.796 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68653768478 2024-03-30T12:21:57.796 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.796 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-03-30T12:21:57.796 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3350, 2024-03-30T12:21:57.796 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1404675857 2024-03-30T12:21:57.796 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.796 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-03-30T12:21:57.796 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3350, 2024-03-30T12:21:57.796 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 182425 2024-03-30T12:21:57.797 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.797 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-03-30T12:21:57.797 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3351, 2024-03-30T12:21:57.797 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 162275826 2024-03-30T12:21:57.797 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.797 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-03-30T12:21:57.797 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3351, 2024-03-30T12:21:57.797 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2563492024 2024-03-30T12:21:57.797 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.797 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-03-30T12:21:57.797 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3351, 2024-03-30T12:21:57.797 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 433295 2024-03-30T12:21:57.797 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.797 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-03-30T12:21:57.798 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3351, 2024-03-30T12:21:57.798 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1435464914 2024-03-30T12:21:57.798 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.798 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-03-30T12:21:57.798 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3351, 2024-03-30T12:21:57.798 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 350067453 2024-03-30T12:21:57.798 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.798 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-03-30T12:21:57.798 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 302546 2024-03-30T12:21:57.798 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.798 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-03-30T12:21:57.798 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 40, 2024-03-30T12:21:57.798 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 186223 2024-03-30T12:21:57.798 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.798 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-03-30T12:21:57.799 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3351, 2024-03-30T12:21:57.799 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8140695532 2024-03-30T12:21:57.799 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.799 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-03-30T12:21:57.799 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3351, 2024-03-30T12:21:57.799 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 382416720 2024-03-30T12:21:57.799 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.799 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-03-30T12:21:57.799 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3351, 2024-03-30T12:21:57.799 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 258568524 2024-03-30T12:21:57.799 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.799 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.799 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-03-30T12:21:57.799 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-03-30T12:21:57.799 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1861635701 2024-03-30T12:21:57.800 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.800 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-03-30T12:21:57.800 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 45531136 2024-03-30T12:21:57.800 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.800 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-03-30T12:21:57.800 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 45465600 2024-03-30T12:21:57.800 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.800 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-03-30T12:21:57.800 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3137578905 2024-03-30T12:21:57.800 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.800 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-03-30T12:21:57.800 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-03-30T12:21:57.800 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.800 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.800 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-03-30T12:21:57.801 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.801 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-03-30T12:21:57.801 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.801 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.801 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.801 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.801 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.801 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.801 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.801 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.801 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85503746 2024-03-30T12:21:57.801 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.801 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.801 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.801 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.801 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.802 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.802 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.802 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.802 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.802 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.802 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.802 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.802 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.802 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.802 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.802 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.802 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.802 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.802 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.802 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.803 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.803 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.803 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.803 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.803 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.803 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.803 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.803 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.803 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.803 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73879806 2024-03-30T12:21:57.803 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.803 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.803 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-03-30T12:21:57.803 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.803 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-03-30T12:21:57.804 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.804 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.804 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:57.804 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.804 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.804 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.804 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.804 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.804 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641278100 2024-03-30T12:21:57.804 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.804 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.804 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.804 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.804 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.804 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.805 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.805 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.805 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.805 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.805 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.805 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.805 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.805 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.805 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.805 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.805 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.805 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2128 2024-03-30T12:21:57.805 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.805 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.805 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.805 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.806 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.806 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.806 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.806 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.806 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.806 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.806 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.806 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71751452 2024-03-30T12:21:57.806 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.806 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.806 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-03-30T12:21:57.806 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.806 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-03-30T12:21:57.806 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.806 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.807 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:57.807 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.807 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.807 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-03-30T12:21:57.807 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.807 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.807 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57002497 2024-03-30T12:21:57.807 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.807 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.807 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.807 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.807 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.807 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.807 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.807 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.808 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.808 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.808 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.808 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.808 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.808 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.808 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.808 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.808 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.808 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.808 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.808 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.808 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.808 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.808 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.808 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.809 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.809 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.809 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.809 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.809 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.809 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68826159 2024-03-30T12:21:57.809 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.809 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.809 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-03-30T12:21:57.809 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.809 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-03-30T12:21:57.809 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.809 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.809 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.809 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.809 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.810 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.810 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.810 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.810 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641278100 2024-03-30T12:21:57.810 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.810 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.810 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.810 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.810 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.810 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.810 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.810 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.810 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.810 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.810 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.810 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.811 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.811 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.811 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4581 2024-03-30T12:21:57.811 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.811 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.811 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 318382 2024-03-30T12:21:57.811 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.811 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.811 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.811 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.811 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.811 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.811 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.811 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.811 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.811 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.812 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.812 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71430617 2024-03-30T12:21:57.812 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.812 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.812 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-03-30T12:21:57.812 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-03-30T12:21:57.812 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.812 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.812 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:57.812 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.812 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.812 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-03-30T12:21:57.812 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.812 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.812 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:57.813 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.813 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.813 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.813 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:57.813 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-03-30T12:21:57.813 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 41 2024-03-30T12:21:57.813 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.813 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-03-30T12:21:57.813 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.813 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.813 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-03-30T12:21:57.813 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-03-30T12:21:57.813 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.813 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-03-30T12:21:57.813 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.814 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.814 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-03-30T12:21:57.814 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.814 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.814 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-03-30T12:21:57.814 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-03-30T12:21:57.814 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.814 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-03-30T12:21:57.814 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:57.814 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7155323 2024-03-30T12:21:57.814 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.814 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-03-30T12:21:57.814 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.814 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.814 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-03-30T12:21:57.814 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:57.815 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 577055 2024-03-30T12:21:57.815 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.815 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-03-30T12:21:57.815 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:57.815 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7079265 2024-03-30T12:21:57.815 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.815 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:57.815 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.815 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.815 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-03-30T12:21:57.815 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.815 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.815 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.815 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-30T12:21:57.815 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.816 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.816 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-03-30T12:21:57.816 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.816 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.816 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-03-30T12:21:57.816 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.816 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.816 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.816 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-03-30T12:21:57.816 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.816 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.816 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.816 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-03-30T12:21:57.816 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.816 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.816 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-03-30T12:21:57.817 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.817 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.817 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-03-30T12:21:57.817 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.817 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.817 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.817 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-30T12:21:57.817 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.817 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.817 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-30T12:21:57.817 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.817 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.817 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-03-30T12:21:57.817 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.817 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.818 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-03-30T12:21:57.818 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.818 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.818 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.818 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-03-30T12:21:57.818 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.818 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.818 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.818 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:57.818 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-03-30T12:21:57.818 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.818 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-03-30T12:21:57.818 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-03-30T12:21:57.818 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.818 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-03-30T12:21:57.819 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:57.819 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7155323 2024-03-30T12:21:57.819 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.819 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-30T12:21:57.819 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.819 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.819 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-03-30T12:21:57.819 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:57.819 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 577055 2024-03-30T12:21:57.819 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.819 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-03-30T12:21:57.819 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:57.819 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7079265 2024-03-30T12:21:57.819 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.819 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-03-30T12:21:57.820 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.820 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.820 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-03-30T12:21:57.820 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.820 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.820 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-03-30T12:21:57.820 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.820 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.820 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-03-30T12:21:57.820 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:57.820 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.820 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-03-30T12:21:57.820 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 28372992 2024-03-30T12:21:57.820 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.820 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.821 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.821 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.5": { 2024-03-30T12:21:57.821 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:57.821 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-03-30T12:21:57.821 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.821 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.821 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-03-30T12:21:57.821 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.821 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.821 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-03-30T12:21:57.821 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-03-30T12:21:57.821 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.821 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-03-30T12:21:57.821 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.821 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.822 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-03-30T12:21:57.822 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.822 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.822 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-03-30T12:21:57.822 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.822 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.822 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-03-30T12:21:57.822 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12288 2024-03-30T12:21:57.822 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.822 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-03-30T12:21:57.822 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6311936 2024-03-30T12:21:57.822 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.822 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-03-30T12:21:57.822 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.822 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.823 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.823 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-03-30T12:21:57.823 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.823 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.823 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.823 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-03-30T12:21:57.823 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:57.823 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.823 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-03-30T12:21:57.823 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:57.823 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.823 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-03-30T12:21:57.823 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3305472 2024-03-30T12:21:57.823 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.823 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-03-30T12:21:57.824 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3166208 2024-03-30T12:21:57.824 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.824 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-03-30T12:21:57.824 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:57.824 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.824 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-03-30T12:21:57.824 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.824 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.824 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-03-30T12:21:57.824 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.824 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.824 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-03-30T12:21:57.824 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-03-30T12:21:57.824 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.824 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-03-30T12:21:57.824 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 206272 2024-03-30T12:21:57.825 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.825 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-03-30T12:21:57.825 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 23 2024-03-30T12:21:57.825 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.825 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-03-30T12:21:57.825 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1282048 2024-03-30T12:21:57.825 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.825 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-03-30T12:21:57.825 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1286144 2024-03-30T12:21:57.825 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.825 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-03-30T12:21:57.825 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.825 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.825 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-03-30T12:21:57.825 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.825 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.826 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-03-30T12:21:57.826 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15 2024-03-30T12:21:57.826 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.826 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-03-30T12:21:57.826 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4913 2024-03-30T12:21:57.826 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.826 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-03-30T12:21:57.826 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4 2024-03-30T12:21:57.826 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.826 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-03-30T12:21:57.826 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5505 2024-03-30T12:21:57.826 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.826 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-03-30T12:21:57.826 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:57.827 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.827 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-03-30T12:21:57.827 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5505 2024-03-30T12:21:57.827 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.827 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-03-30T12:21:57.827 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:57.827 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.827 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-03-30T12:21:57.827 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.827 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.827 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-03-30T12:21:57.827 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.827 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.827 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-03-30T12:21:57.827 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.828 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.828 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-03-30T12:21:57.828 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.828 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.828 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-03-30T12:21:57.828 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.828 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.828 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-03-30T12:21:57.828 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.828 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.828 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-03-30T12:21:57.828 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.828 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.828 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-03-30T12:21:57.828 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.828 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.829 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-03-30T12:21:57.829 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.829 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.829 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-03-30T12:21:57.829 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 9555968 2024-03-30T12:21:57.829 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.829 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.829 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-03-30T12:21:57.829 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-03-30T12:21:57.829 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-03-30T12:21:57.829 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.829 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-03-30T12:21:57.829 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 712704 2024-03-30T12:21:57.829 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.829 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-03-30T12:21:57.829 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 4, 2024-03-30T12:21:57.829 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 213724 2024-03-30T12:21:57.830 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.830 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-03-30T12:21:57.830 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.830 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.830 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.830 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-03-30T12:21:57.830 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.830 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.830 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-03-30T12:21:57.830 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.830 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.830 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-03-30T12:21:57.830 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.830 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.831 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-03-30T12:21:57.831 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-03-30T12:21:57.831 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4074 2024-03-30T12:21:57.831 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.831 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-03-30T12:21:57.831 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.831 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.831 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.831 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-03-30T12:21:57.831 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 760, 2024-03-30T12:21:57.831 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 506370534 2024-03-30T12:21:57.831 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.831 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-03-30T12:21:57.831 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 753, 2024-03-30T12:21:57.831 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 21550815 2024-03-30T12:21:57.832 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.832 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-03-30T12:21:57.832 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 760, 2024-03-30T12:21:57.832 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 685717 2024-03-30T12:21:57.832 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.832 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-03-30T12:21:57.832 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 760, 2024-03-30T12:21:57.832 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 507056251 2024-03-30T12:21:57.832 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.832 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-03-30T12:21:57.832 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.832 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.832 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.832 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-03-30T12:21:57.832 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-03-30T12:21:57.833 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 41406 2024-03-30T12:21:57.833 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.833 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-03-30T12:21:57.833 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.833 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.833 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.833 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-03-30T12:21:57.833 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.833 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.833 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.833 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-03-30T12:21:57.833 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.833 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.833 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.833 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-03-30T12:21:57.834 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:57.834 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5448 2024-03-30T12:21:57.834 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.834 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-03-30T12:21:57.834 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3429 2024-03-30T12:21:57.834 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.834 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-03-30T12:21:57.834 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 339 2024-03-30T12:21:57.834 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.834 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-03-30T12:21:57.834 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 86, 2024-03-30T12:21:57.834 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 717908 2024-03-30T12:21:57.834 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.834 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-03-30T12:21:57.834 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 138, 2024-03-30T12:21:57.835 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 248874 2024-03-30T12:21:57.835 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.835 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-03-30T12:21:57.835 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 52, 2024-03-30T12:21:57.835 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 362078 2024-03-30T12:21:57.835 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.835 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-03-30T12:21:57.835 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.835 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.835 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-03-30T12:21:57.835 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 103, 2024-03-30T12:21:57.835 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5550711 2024-03-30T12:21:57.835 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.835 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-03-30T12:21:57.836 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3370, 2024-03-30T12:21:57.836 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3982310853 2024-03-30T12:21:57.836 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.836 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-03-30T12:21:57.836 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 39, 2024-03-30T12:21:57.836 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 25110158 2024-03-30T12:21:57.836 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.836 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-03-30T12:21:57.836 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 36, 2024-03-30T12:21:57.836 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 227241838679 2024-03-30T12:21:57.836 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.836 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-03-30T12:21:57.836 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 39, 2024-03-30T12:21:57.836 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68083331791 2024-03-30T12:21:57.836 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.837 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-03-30T12:21:57.837 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3367, 2024-03-30T12:21:57.837 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1283038692 2024-03-30T12:21:57.837 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.837 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-03-30T12:21:57.837 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3367, 2024-03-30T12:21:57.837 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 193191 2024-03-30T12:21:57.837 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.837 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-03-30T12:21:57.837 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3370, 2024-03-30T12:21:57.837 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4961637 2024-03-30T12:21:57.837 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.837 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-03-30T12:21:57.837 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3370, 2024-03-30T12:21:57.837 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2577004334 2024-03-30T12:21:57.837 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.837 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-03-30T12:21:57.838 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3370, 2024-03-30T12:21:57.838 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 434973 2024-03-30T12:21:57.838 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.838 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-03-30T12:21:57.838 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3370, 2024-03-30T12:21:57.838 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1385089816 2024-03-30T12:21:57.838 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.838 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-03-30T12:21:57.838 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3370, 2024-03-30T12:21:57.838 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 369052276 2024-03-30T12:21:57.838 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.838 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-03-30T12:21:57.838 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 305106 2024-03-30T12:21:57.838 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.839 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-03-30T12:21:57.839 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 32, 2024-03-30T12:21:57.839 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 138774 2024-03-30T12:21:57.839 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.839 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-03-30T12:21:57.839 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3370, 2024-03-30T12:21:57.839 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8318639339 2024-03-30T12:21:57.839 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.839 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-03-30T12:21:57.839 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3370, 2024-03-30T12:21:57.839 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 404221513 2024-03-30T12:21:57.839 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.839 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-03-30T12:21:57.839 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3370, 2024-03-30T12:21:57.839 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 270510576 2024-03-30T12:21:57.839 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.840 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.840 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-03-30T12:21:57.840 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-03-30T12:21:57.840 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1861635701 2024-03-30T12:21:57.840 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.840 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-03-30T12:21:57.840 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 46579712 2024-03-30T12:21:57.840 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.840 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-03-30T12:21:57.840 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 45768704 2024-03-30T12:21:57.840 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.840 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-03-30T12:21:57.840 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3137578905 2024-03-30T12:21:57.840 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.840 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-03-30T12:21:57.841 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 811008 2024-03-30T12:21:57.841 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.841 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.841 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-03-30T12:21:57.841 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.841 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-03-30T12:21:57.841 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.841 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.841 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.841 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.841 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.841 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.841 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.841 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.841 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85503379 2024-03-30T12:21:57.842 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.842 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.842 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.842 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.842 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.842 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.842 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.842 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.842 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.842 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.842 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.842 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.842 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.842 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.843 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.843 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.843 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.843 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.843 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.843 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.843 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.843 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.843 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.843 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.843 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.843 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.843 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.843 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.843 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.843 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73880173 2024-03-30T12:21:57.843 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.844 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.844 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-03-30T12:21:57.844 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.844 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-03-30T12:21:57.844 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.844 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.844 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:57.844 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.844 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.844 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.844 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.844 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.844 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641275342 2024-03-30T12:21:57.844 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.845 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.845 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.845 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.845 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.845 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.845 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.845 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.845 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.845 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.845 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.845 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.845 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.845 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.845 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.845 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.845 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.846 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2128 2024-03-30T12:21:57.846 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.846 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.846 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.846 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.846 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.846 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.846 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.846 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.846 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.846 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.846 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.846 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71754210 2024-03-30T12:21:57.846 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.847 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.847 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-03-30T12:21:57.847 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.847 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-03-30T12:21:57.847 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.847 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.847 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:57.847 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.847 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.847 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-03-30T12:21:57.847 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.847 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.847 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57002252 2024-03-30T12:21:57.847 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.847 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.848 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.848 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.848 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.848 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.848 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.848 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.848 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.848 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.848 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.848 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.848 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.848 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.848 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.848 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.848 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.849 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.849 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.849 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.849 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.849 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.849 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.849 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.849 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.849 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.849 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.849 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.849 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.849 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68826404 2024-03-30T12:21:57.849 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.849 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.850 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-03-30T12:21:57.850 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.850 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-03-30T12:21:57.850 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.850 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.850 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.850 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.850 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.850 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.850 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.850 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.850 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641275342 2024-03-30T12:21:57.850 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.850 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.850 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.851 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.851 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.851 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.851 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.851 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.851 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.851 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.851 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.851 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.851 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.851 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.851 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12611 2024-03-30T12:21:57.851 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.851 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.851 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 319876 2024-03-30T12:21:57.852 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.852 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.852 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.852 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.852 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.852 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.852 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.852 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.852 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.852 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.852 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.852 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71423851 2024-03-30T12:21:57.852 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.852 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.852 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-03-30T12:21:57.852 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-03-30T12:21:57.853 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.853 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.853 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:57.853 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.853 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.853 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-03-30T12:21:57.853 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.853 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.853 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:57.853 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.853 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.853 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.853 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:57.853 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-03-30T12:21:57.853 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 42 2024-03-30T12:21:57.854 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.854 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-03-30T12:21:57.854 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.854 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.854 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-03-30T12:21:57.854 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.854 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.854 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-03-30T12:21:57.854 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.854 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.854 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-03-30T12:21:57.854 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.854 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.854 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-03-30T12:21:57.854 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.855 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.855 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-03-30T12:21:57.855 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.855 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.855 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.855 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-03-30T12:21:57.855 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.855 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.855 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-03-30T12:21:57.855 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.855 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.855 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.855 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-03-30T12:21:57.855 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.856 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.856 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.856 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:57.856 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.856 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.856 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-03-30T12:21:57.856 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.856 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.856 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.856 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-30T12:21:57.856 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.856 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.856 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-03-30T12:21:57.856 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.856 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.857 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-03-30T12:21:57.857 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.857 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.857 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.857 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-03-30T12:21:57.857 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.857 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.857 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.857 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-03-30T12:21:57.857 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.857 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.857 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-03-30T12:21:57.857 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.857 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.857 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-03-30T12:21:57.857 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.858 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.858 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.858 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-30T12:21:57.858 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.858 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.858 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-30T12:21:57.858 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.858 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.858 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-03-30T12:21:57.858 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.858 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.858 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-03-30T12:21:57.858 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.858 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.859 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.859 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-03-30T12:21:57.859 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.859 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.859 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.859 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:57.859 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.859 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.859 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-03-30T12:21:57.859 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.859 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.859 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-03-30T12:21:57.859 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.859 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.859 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.859 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-30T12:21:57.859 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.860 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.860 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-03-30T12:21:57.860 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.860 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.860 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.860 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-03-30T12:21:57.860 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.860 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.860 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.860 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-03-30T12:21:57.860 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.860 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.860 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-03-30T12:21:57.860 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.860 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.860 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-03-30T12:21:57.861 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.861 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.861 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-03-30T12:21:57.861 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:57.861 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.861 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-03-30T12:21:57.861 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 32571392 2024-03-30T12:21:57.861 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.861 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.861 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.861 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.6": { 2024-03-30T12:21:57.861 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:57.861 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-03-30T12:21:57.861 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.861 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.861 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-03-30T12:21:57.861 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.862 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.862 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-03-30T12:21:57.862 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-03-30T12:21:57.862 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.862 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-03-30T12:21:57.862 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.862 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.862 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-03-30T12:21:57.862 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.862 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.862 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-03-30T12:21:57.862 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.862 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.862 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-03-30T12:21:57.862 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12288 2024-03-30T12:21:57.862 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.862 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-03-30T12:21:57.863 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1335296 2024-03-30T12:21:57.863 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.863 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-03-30T12:21:57.863 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.863 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.863 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.863 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-03-30T12:21:57.863 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.863 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.863 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.863 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-03-30T12:21:57.863 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:57.863 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.863 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-03-30T12:21:57.863 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 27656192 2024-03-30T12:21:57.863 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.864 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-03-30T12:21:57.864 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1003520 2024-03-30T12:21:57.864 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.864 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-03-30T12:21:57.864 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 864256 2024-03-30T12:21:57.864 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.864 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-03-30T12:21:57.864 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:57.864 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.864 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-03-30T12:21:57.864 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.864 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.864 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-03-30T12:21:57.864 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.864 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.865 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-03-30T12:21:57.865 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-03-30T12:21:57.865 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.865 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-03-30T12:21:57.865 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 206272 2024-03-30T12:21:57.865 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.865 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-03-30T12:21:57.865 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 23 2024-03-30T12:21:57.865 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.865 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-03-30T12:21:57.865 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1282048 2024-03-30T12:21:57.865 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.865 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-03-30T12:21:57.865 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1286144 2024-03-30T12:21:57.865 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.865 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-03-30T12:21:57.865 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.866 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.866 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-03-30T12:21:57.866 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.866 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.866 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-03-30T12:21:57.866 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15 2024-03-30T12:21:57.866 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.866 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-03-30T12:21:57.866 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4913 2024-03-30T12:21:57.866 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.866 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-03-30T12:21:57.866 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4 2024-03-30T12:21:57.866 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.866 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-03-30T12:21:57.866 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5504 2024-03-30T12:21:57.867 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.867 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-03-30T12:21:57.867 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:57.867 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.867 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-03-30T12:21:57.867 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5504 2024-03-30T12:21:57.867 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.867 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-03-30T12:21:57.867 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:57.867 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.867 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-03-30T12:21:57.867 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.867 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.867 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-03-30T12:21:57.867 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.867 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.868 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-03-30T12:21:57.868 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.868 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.868 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-03-30T12:21:57.868 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.868 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.868 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-03-30T12:21:57.868 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.868 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.868 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-03-30T12:21:57.868 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.868 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.868 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-03-30T12:21:57.868 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.869 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.869 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-03-30T12:21:57.869 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.869 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.869 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-03-30T12:21:57.869 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.869 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.869 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-03-30T12:21:57.869 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2277376 2024-03-30T12:21:57.869 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.869 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.869 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-03-30T12:21:57.869 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-03-30T12:21:57.869 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-03-30T12:21:57.870 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.870 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-03-30T12:21:57.870 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1298432 2024-03-30T12:21:57.870 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.870 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-03-30T12:21:57.870 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.870 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.870 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.870 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-03-30T12:21:57.870 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.870 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.870 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.870 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-03-30T12:21:57.870 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.870 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.871 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-03-30T12:21:57.871 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.871 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.871 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-03-30T12:21:57.871 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.871 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.871 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-03-30T12:21:57.871 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-03-30T12:21:57.871 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6316 2024-03-30T12:21:57.871 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.871 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-03-30T12:21:57.871 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.871 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.871 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.871 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-03-30T12:21:57.872 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 198, 2024-03-30T12:21:57.872 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 50340657 2024-03-30T12:21:57.872 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.872 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-03-30T12:21:57.872 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 193, 2024-03-30T12:21:57.872 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5288152 2024-03-30T12:21:57.872 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.872 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-03-30T12:21:57.872 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 198, 2024-03-30T12:21:57.872 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 117162 2024-03-30T12:21:57.872 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.872 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-03-30T12:21:57.872 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 198, 2024-03-30T12:21:57.872 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 50457819 2024-03-30T12:21:57.872 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.872 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-03-30T12:21:57.872 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.873 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.873 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.873 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-03-30T12:21:57.873 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:57.873 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 47902 2024-03-30T12:21:57.873 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.873 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-03-30T12:21:57.873 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.873 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.873 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.873 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-03-30T12:21:57.873 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.873 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.873 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.874 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-03-30T12:21:57.874 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.874 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.874 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.874 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-03-30T12:21:57.874 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:57.874 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4265 2024-03-30T12:21:57.874 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.874 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-03-30T12:21:57.874 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 365 2024-03-30T12:21:57.874 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.874 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-03-30T12:21:57.874 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 245 2024-03-30T12:21:57.874 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.875 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-03-30T12:21:57.875 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 87, 2024-03-30T12:21:57.875 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 728825 2024-03-30T12:21:57.875 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.875 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-03-30T12:21:57.875 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 134, 2024-03-30T12:21:57.875 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 240740 2024-03-30T12:21:57.875 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.875 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-03-30T12:21:57.875 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 47, 2024-03-30T12:21:57.875 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 439675 2024-03-30T12:21:57.875 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.875 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-03-30T12:21:57.875 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.875 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.875 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-03-30T12:21:57.875 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.876 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.876 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.876 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-03-30T12:21:57.876 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 279, 2024-03-30T12:21:57.876 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2758972 2024-03-30T12:21:57.876 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.876 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-03-30T12:21:57.876 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 33, 2024-03-30T12:21:57.876 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2116004 2024-03-30T12:21:57.876 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.876 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-03-30T12:21:57.876 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 33, 2024-03-30T12:21:57.876 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 573433277782 2024-03-30T12:21:57.876 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.876 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-03-30T12:21:57.877 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 33, 2024-03-30T12:21:57.877 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 53661991452 2024-03-30T12:21:57.877 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.877 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-03-30T12:21:57.877 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 279, 2024-03-30T12:21:57.877 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 501214 2024-03-30T12:21:57.877 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.877 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-03-30T12:21:57.877 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 279, 2024-03-30T12:21:57.877 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 32257 2024-03-30T12:21:57.877 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.877 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-03-30T12:21:57.877 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 279, 2024-03-30T12:21:57.877 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 204569 2024-03-30T12:21:57.878 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.878 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-03-30T12:21:57.878 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 279, 2024-03-30T12:21:57.878 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 122915800 2024-03-30T12:21:57.878 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.878 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-03-30T12:21:57.878 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 279, 2024-03-30T12:21:57.878 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 106956 2024-03-30T12:21:57.878 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.878 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-03-30T12:21:57.878 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 279, 2024-03-30T12:21:57.878 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 79284267 2024-03-30T12:21:57.878 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.878 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-03-30T12:21:57.878 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 279, 2024-03-30T12:21:57.879 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12848334 2024-03-30T12:21:57.879 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.879 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-03-30T12:21:57.879 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 895111 2024-03-30T12:21:57.879 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.879 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-03-30T12:21:57.879 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 26, 2024-03-30T12:21:57.879 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 100596 2024-03-30T12:21:57.879 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.879 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-03-30T12:21:57.879 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 279, 2024-03-30T12:21:57.879 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 218052850 2024-03-30T12:21:57.879 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.879 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-03-30T12:21:57.879 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 279, 2024-03-30T12:21:57.879 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15376869 2024-03-30T12:21:57.879 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.880 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-03-30T12:21:57.880 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 279, 2024-03-30T12:21:57.880 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2645283 2024-03-30T12:21:57.880 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.880 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.880 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-03-30T12:21:57.880 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-03-30T12:21:57.880 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1861635701 2024-03-30T12:21:57.880 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.880 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-03-30T12:21:57.880 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 42385408 2024-03-30T12:21:57.880 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.880 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-03-30T12:21:57.880 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 41426944 2024-03-30T12:21:57.880 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.880 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-03-30T12:21:57.880 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3137578905 2024-03-30T12:21:57.881 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.881 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-03-30T12:21:57.881 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 958464 2024-03-30T12:21:57.881 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.881 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.881 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-03-30T12:21:57.881 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.881 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-03-30T12:21:57.881 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.881 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.881 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.881 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.881 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.881 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.881 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.882 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.882 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85509305 2024-03-30T12:21:57.882 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.882 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.882 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.882 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.882 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.882 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.882 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.882 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.882 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.882 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.882 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.882 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.882 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.883 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.883 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.883 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.883 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.883 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-03-30T12:21:57.883 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.883 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.883 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.883 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.883 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.883 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.883 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.883 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.883 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.883 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.883 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.884 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73866055 2024-03-30T12:21:57.884 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.884 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.884 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-03-30T12:21:57.884 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.884 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-03-30T12:21:57.884 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.884 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.884 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:57.884 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.884 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.884 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.884 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.884 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.884 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641319790 2024-03-30T12:21:57.884 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.885 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.885 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.885 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.885 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.885 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.885 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.885 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.885 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.885 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.885 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.885 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.885 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.885 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.885 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.885 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.885 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.885 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2128 2024-03-30T12:21:57.886 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.886 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.886 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.886 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.886 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.886 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.886 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.886 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.886 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.886 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.886 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.886 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71709762 2024-03-30T12:21:57.886 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.886 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.886 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-03-30T12:21:57.887 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.887 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-03-30T12:21:57.887 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.887 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.887 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:57.887 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.887 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.887 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-03-30T12:21:57.887 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.887 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.887 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57006203 2024-03-30T12:21:57.887 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.887 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.887 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.887 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.887 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.887 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.888 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.888 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.888 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.888 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.888 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.888 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.888 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.888 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.888 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.888 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.888 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.888 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.888 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.888 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.888 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.888 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.888 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.888 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.889 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.889 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.889 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.889 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.889 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.889 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68822453 2024-03-30T12:21:57.889 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.889 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.889 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-03-30T12:21:57.889 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.889 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-03-30T12:21:57.889 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.889 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.889 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.889 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.890 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.890 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.890 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.890 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.890 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641319790 2024-03-30T12:21:57.890 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.890 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.890 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.890 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.890 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.890 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5986 2024-03-30T12:21:57.890 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.890 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.890 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.890 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.890 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.891 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.891 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.891 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.891 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15565 2024-03-30T12:21:57.891 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.891 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.891 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 202345 2024-03-30T12:21:57.891 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.891 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.891 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.891 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.891 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.891 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.891 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.891 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.891 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.892 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.892 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.892 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71487994 2024-03-30T12:21:57.892 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.892 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.892 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-03-30T12:21:57.892 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-03-30T12:21:57.892 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.892 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.892 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:57.892 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.892 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.892 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-03-30T12:21:57.892 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.892 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.893 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:57.893 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.893 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.893 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.893 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:57.893 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-03-30T12:21:57.893 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 39 2024-03-30T12:21:57.893 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.893 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-03-30T12:21:57.893 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.893 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.893 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-03-30T12:21:57.893 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-03-30T12:21:57.893 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.893 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-03-30T12:21:57.894 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.894 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.894 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-03-30T12:21:57.894 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.894 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.894 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-03-30T12:21:57.894 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2812 2024-03-30T12:21:57.894 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.894 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-03-30T12:21:57.894 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 13, 2024-03-30T12:21:57.894 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 105365492 2024-03-30T12:21:57.894 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.894 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-03-30T12:21:57.895 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.895 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.895 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-03-30T12:21:57.895 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 15, 2024-03-30T12:21:57.895 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12016880 2024-03-30T12:21:57.895 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.895 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-03-30T12:21:57.895 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 13, 2024-03-30T12:21:57.895 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 81573372 2024-03-30T12:21:57.895 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.895 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:57.895 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.895 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.895 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-03-30T12:21:57.896 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.896 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.896 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.896 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-30T12:21:57.896 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.896 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.896 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-03-30T12:21:57.896 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.896 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.896 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-03-30T12:21:57.896 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.896 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.896 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.896 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-03-30T12:21:57.896 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.896 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.897 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.897 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-03-30T12:21:57.897 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.897 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.897 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-03-30T12:21:57.897 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.897 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.897 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-03-30T12:21:57.897 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.897 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.897 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.897 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-30T12:21:57.897 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.897 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.898 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-30T12:21:57.898 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.898 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.898 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-03-30T12:21:57.898 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.898 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.898 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-03-30T12:21:57.898 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.898 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.898 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.898 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-03-30T12:21:57.898 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.898 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.898 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.898 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:57.899 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-03-30T12:21:57.899 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.899 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-03-30T12:21:57.899 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2812 2024-03-30T12:21:57.899 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.899 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-03-30T12:21:57.899 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 13, 2024-03-30T12:21:57.899 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 105365492 2024-03-30T12:21:57.899 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.899 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-30T12:21:57.899 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.899 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.899 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-03-30T12:21:57.899 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 15, 2024-03-30T12:21:57.900 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12016880 2024-03-30T12:21:57.900 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.900 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-03-30T12:21:57.900 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 13, 2024-03-30T12:21:57.900 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 81573372 2024-03-30T12:21:57.900 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.900 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-03-30T12:21:57.900 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.900 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.900 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-03-30T12:21:57.900 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.900 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.900 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-03-30T12:21:57.900 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.900 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.901 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-03-30T12:21:57.901 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:57.901 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.901 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-03-30T12:21:57.901 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 28962816 2024-03-30T12:21:57.901 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.901 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.901 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.901 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.7": { 2024-03-30T12:21:57.901 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:57.901 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-03-30T12:21:57.901 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.901 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.901 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-03-30T12:21:57.901 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.902 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.902 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-03-30T12:21:57.902 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-03-30T12:21:57.902 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.902 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-03-30T12:21:57.902 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.902 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.902 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-03-30T12:21:57.902 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.902 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.902 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-03-30T12:21:57.902 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.902 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.902 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-03-30T12:21:57.902 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12288 2024-03-30T12:21:57.903 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.903 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-03-30T12:21:57.903 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6651904 2024-03-30T12:21:57.903 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.903 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-03-30T12:21:57.903 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.903 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.903 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.903 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-03-30T12:21:57.903 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.903 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.903 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.903 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-03-30T12:21:57.904 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:57.904 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.904 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-03-30T12:21:57.904 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:57.904 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.904 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-03-30T12:21:57.904 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3674112 2024-03-30T12:21:57.904 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.904 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-03-30T12:21:57.904 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3534848 2024-03-30T12:21:57.904 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.904 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-03-30T12:21:57.904 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:57.904 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.904 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-03-30T12:21:57.904 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.905 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.905 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-03-30T12:21:57.905 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.905 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.905 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-03-30T12:21:57.905 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-03-30T12:21:57.905 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.905 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-03-30T12:21:57.905 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 206272 2024-03-30T12:21:57.905 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.905 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-03-30T12:21:57.905 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 23 2024-03-30T12:21:57.905 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.905 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-03-30T12:21:57.905 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1282048 2024-03-30T12:21:57.906 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.906 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-03-30T12:21:57.906 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1286144 2024-03-30T12:21:57.906 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.906 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-03-30T12:21:57.906 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.906 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.906 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-03-30T12:21:57.906 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.906 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.906 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-03-30T12:21:57.906 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15 2024-03-30T12:21:57.906 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.906 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-03-30T12:21:57.907 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4913 2024-03-30T12:21:57.907 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.907 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-03-30T12:21:57.907 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4 2024-03-30T12:21:57.907 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.907 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-03-30T12:21:57.907 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5500 2024-03-30T12:21:57.907 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.907 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-03-30T12:21:57.907 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:57.907 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.907 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-03-30T12:21:57.907 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5500 2024-03-30T12:21:57.907 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.907 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-03-30T12:21:57.908 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:57.908 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.908 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-03-30T12:21:57.908 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.908 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.908 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-03-30T12:21:57.908 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.908 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.908 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-03-30T12:21:57.908 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.908 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.908 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-03-30T12:21:57.908 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.908 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.909 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-03-30T12:21:57.909 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.909 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.909 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-03-30T12:21:57.909 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.909 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.909 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-03-30T12:21:57.909 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.909 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.909 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-03-30T12:21:57.909 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.909 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.909 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-03-30T12:21:57.909 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.909 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.909 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-03-30T12:21:57.910 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10264576 2024-03-30T12:21:57.910 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.910 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.910 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-03-30T12:21:57.910 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-03-30T12:21:57.910 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-03-30T12:21:57.910 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.910 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-03-30T12:21:57.910 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1294336 2024-03-30T12:21:57.910 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.910 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-03-30T12:21:57.910 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-03-30T12:21:57.910 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 307770 2024-03-30T12:21:57.910 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.911 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-03-30T12:21:57.911 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.911 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.911 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.911 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-03-30T12:21:57.911 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.911 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.911 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-03-30T12:21:57.911 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.911 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.911 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-03-30T12:21:57.911 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.911 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.911 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-03-30T12:21:57.911 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 7, 2024-03-30T12:21:57.911 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 25226 2024-03-30T12:21:57.912 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.912 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-03-30T12:21:57.912 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.912 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.912 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.912 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-03-30T12:21:57.912 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 850, 2024-03-30T12:21:57.912 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 517161845 2024-03-30T12:21:57.912 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.912 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-03-30T12:21:57.912 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 841, 2024-03-30T12:21:57.912 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24730375 2024-03-30T12:21:57.912 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.912 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-03-30T12:21:57.912 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 850, 2024-03-30T12:21:57.913 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 761248 2024-03-30T12:21:57.913 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.913 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-03-30T12:21:57.913 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 850, 2024-03-30T12:21:57.913 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 517923093 2024-03-30T12:21:57.913 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.913 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-03-30T12:21:57.913 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.913 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.913 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.913 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-03-30T12:21:57.913 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:57.913 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 37459 2024-03-30T12:21:57.913 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.913 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-03-30T12:21:57.914 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.914 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.914 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.914 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-03-30T12:21:57.914 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.914 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.914 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.914 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-03-30T12:21:57.914 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:57.914 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.914 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.914 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-03-30T12:21:57.914 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:57.914 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4142 2024-03-30T12:21:57.914 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.915 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-03-30T12:21:57.915 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3787 2024-03-30T12:21:57.915 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.915 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-03-30T12:21:57.915 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 380 2024-03-30T12:21:57.915 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.915 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-03-30T12:21:57.915 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 125, 2024-03-30T12:21:57.915 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2391502 2024-03-30T12:21:57.915 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.915 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-03-30T12:21:57.915 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 197, 2024-03-30T12:21:57.915 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 450650 2024-03-30T12:21:57.915 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.916 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-03-30T12:21:57.916 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 72, 2024-03-30T12:21:57.916 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1513381 2024-03-30T12:21:57.916 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.916 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-03-30T12:21:57.916 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.916 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.916 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-03-30T12:21:57.916 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 101, 2024-03-30T12:21:57.916 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6959036 2024-03-30T12:21:57.916 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.916 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-03-30T12:21:57.916 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3392, 2024-03-30T12:21:57.916 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3804990545 2024-03-30T12:21:57.916 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.916 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-03-30T12:21:57.917 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 19, 2024-03-30T12:21:57.917 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57784091 2024-03-30T12:21:57.917 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.917 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-03-30T12:21:57.917 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 19, 2024-03-30T12:21:57.917 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 382926058093 2024-03-30T12:21:57.917 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.917 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-03-30T12:21:57.917 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 19, 2024-03-30T12:21:57.917 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 33480896939 2024-03-30T12:21:57.917 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.917 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-03-30T12:21:57.917 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3392, 2024-03-30T12:21:57.917 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1595181129 2024-03-30T12:21:57.918 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.918 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-03-30T12:21:57.918 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3392, 2024-03-30T12:21:57.918 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 185499 2024-03-30T12:21:57.918 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.918 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-03-30T12:21:57.918 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3392, 2024-03-30T12:21:57.918 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 104306493 2024-03-30T12:21:57.918 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.918 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-03-30T12:21:57.918 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3392, 2024-03-30T12:21:57.918 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2867908760 2024-03-30T12:21:57.918 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.918 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-03-30T12:21:57.918 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3392, 2024-03-30T12:21:57.919 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 488087 2024-03-30T12:21:57.919 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.919 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-03-30T12:21:57.919 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3392, 2024-03-30T12:21:57.919 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1606719659 2024-03-30T12:21:57.919 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.919 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-03-30T12:21:57.919 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3392, 2024-03-30T12:21:57.919 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 389809685 2024-03-30T12:21:57.919 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.919 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-03-30T12:21:57.919 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 893025 2024-03-30T12:21:57.919 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.919 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-03-30T12:21:57.919 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 18, 2024-03-30T12:21:57.919 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 69611 2024-03-30T12:21:57.920 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.920 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-03-30T12:21:57.920 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3392, 2024-03-30T12:21:57.920 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8773989421 2024-03-30T12:21:57.920 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.920 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-03-30T12:21:57.920 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3392, 2024-03-30T12:21:57.920 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 428689708 2024-03-30T12:21:57.920 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.920 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-03-30T12:21:57.920 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3392, 2024-03-30T12:21:57.920 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 268925833 2024-03-30T12:21:57.920 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.920 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.921 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-03-30T12:21:57.921 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-03-30T12:21:57.921 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1861635701 2024-03-30T12:21:57.921 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.921 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-03-30T12:21:57.921 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 46579712 2024-03-30T12:21:57.921 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.921 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-03-30T12:21:57.921 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 45703168 2024-03-30T12:21:57.921 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.921 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-03-30T12:21:57.921 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3137578905 2024-03-30T12:21:57.921 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.921 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-03-30T12:21:57.922 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 876544 2024-03-30T12:21:57.922 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.922 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.922 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-03-30T12:21:57.922 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.922 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-03-30T12:21:57.922 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.922 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.922 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.922 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.922 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.922 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.922 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.922 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.923 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85486641 2024-03-30T12:21:57.923 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.923 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.923 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.923 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.923 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.923 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-03-30T12:21:57.923 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.923 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.923 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 131072 2024-03-30T12:21:57.923 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.923 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.923 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.923 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.923 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.924 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.924 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.924 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.924 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 126976 2024-03-30T12:21:57.924 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.924 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.924 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.924 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.924 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.924 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.924 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.924 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.924 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.924 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.925 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.925 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73630671 2024-03-30T12:21:57.925 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.925 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.925 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-03-30T12:21:57.925 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.925 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-03-30T12:21:57.925 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.925 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.925 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:57.925 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.925 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.925 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.925 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.925 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.926 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641149810 2024-03-30T12:21:57.926 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.926 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.926 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.926 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.926 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.926 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.926 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.926 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.926 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.926 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.926 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.926 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.927 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.927 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.927 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.927 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.927 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.927 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2128 2024-03-30T12:21:57.927 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.927 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.927 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.927 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.927 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.927 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.927 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.927 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.927 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.928 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.928 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.928 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71879742 2024-03-30T12:21:57.928 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.928 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.928 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-03-30T12:21:57.928 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.928 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-03-30T12:21:57.928 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.928 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.928 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:57.928 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.928 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.928 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-03-30T12:21:57.928 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.929 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.929 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 56991094 2024-03-30T12:21:57.929 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.929 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.929 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.929 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.929 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.929 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.929 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.929 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.929 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.929 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.929 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.930 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.930 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.930 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.930 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.930 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.930 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.930 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.930 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.930 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.930 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.930 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.930 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.930 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.931 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.931 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.931 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.931 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.931 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.931 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68837562 2024-03-30T12:21:57.931 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.931 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.931 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-03-30T12:21:57.931 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:57.931 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-03-30T12:21:57.931 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.931 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:57.931 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.931 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.932 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:57.932 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.932 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.932 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:57.932 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641149810 2024-03-30T12:21:57.932 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.932 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:57.932 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.932 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.932 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:57.932 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3503 2024-03-30T12:21:57.932 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.932 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:57.932 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8175 2024-03-30T12:21:57.932 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.933 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:57.933 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.933 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.933 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:57.933 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4671 2024-03-30T12:21:57.933 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.933 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:57.933 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 328174 2024-03-30T12:21:57.933 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.933 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:57.933 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.933 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.933 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:57.933 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.934 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.934 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:57.934 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.934 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.934 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:57.934 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71537347 2024-03-30T12:21:57.934 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.934 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.934 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-03-30T12:21:57.934 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-03-30T12:21:57.934 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.934 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.934 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:57.934 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.934 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.935 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-03-30T12:21:57.935 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.935 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.935 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:57.935 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.935 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.935 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.935 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:57.935 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-03-30T12:21:57.935 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 47 2024-03-30T12:21:57.935 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.935 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-03-30T12:21:57.935 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.935 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.936 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-03-30T12:21:57.936 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 143 2024-03-30T12:21:57.936 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.936 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-03-30T12:21:57.936 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.936 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.936 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-03-30T12:21:57.936 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.936 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.936 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-03-30T12:21:57.936 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.936 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.936 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-03-30T12:21:57.936 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 143, 2024-03-30T12:21:57.936 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 137704516 2024-03-30T12:21:57.937 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.937 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-03-30T12:21:57.937 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 265810 2024-03-30T12:21:57.937 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.937 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-03-30T12:21:57.937 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 145, 2024-03-30T12:21:57.937 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 34056375 2024-03-30T12:21:57.937 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.937 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-03-30T12:21:57.937 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 143, 2024-03-30T12:21:57.937 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 128311330 2024-03-30T12:21:57.937 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.937 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:57.937 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 100 2024-03-30T12:21:57.937 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.937 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-03-30T12:21:57.938 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 100, 2024-03-30T12:21:57.938 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15648917 2024-03-30T12:21:57.938 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.938 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-30T12:21:57.938 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.938 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.938 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-03-30T12:21:57.938 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 265810 2024-03-30T12:21:57.938 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.938 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-03-30T12:21:57.938 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 100, 2024-03-30T12:21:57.938 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13977979 2024-03-30T12:21:57.938 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.938 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-03-30T12:21:57.938 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 100, 2024-03-30T12:21:57.939 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 11385497 2024-03-30T12:21:57.939 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.939 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-03-30T12:21:57.939 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 38 2024-03-30T12:21:57.939 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.939 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-03-30T12:21:57.939 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.939 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.939 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-03-30T12:21:57.939 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 38, 2024-03-30T12:21:57.939 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 36983789 2024-03-30T12:21:57.939 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.939 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-30T12:21:57.939 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.939 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.939 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-30T12:21:57.940 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.940 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.940 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-03-30T12:21:57.940 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.940 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.940 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-03-30T12:21:57.940 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 38, 2024-03-30T12:21:57.940 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 16961194 2024-03-30T12:21:57.940 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.940 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-03-30T12:21:57.940 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 38, 2024-03-30T12:21:57.941 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 34741601 2024-03-30T12:21:57.942 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.942 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:57.942 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5 2024-03-30T12:21:57.942 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.942 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-03-30T12:21:57.942 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.943 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.943 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-03-30T12:21:57.943 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-03-30T12:21:57.943 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85071810 2024-03-30T12:21:57.943 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.943 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-30T12:21:57.943 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.943 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.943 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-03-30T12:21:57.943 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 7, 2024-03-30T12:21:57.943 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3117202 2024-03-30T12:21:57.943 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.943 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-03-30T12:21:57.943 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-03-30T12:21:57.943 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 82184232 2024-03-30T12:21:57.944 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.944 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-03-30T12:21:57.944 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.944 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.944 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-03-30T12:21:57.944 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.944 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.944 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-03-30T12:21:57.944 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:57.944 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.944 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-03-30T12:21:57.944 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:57.944 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.944 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-03-30T12:21:57.944 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 33153024 2024-03-30T12:21:57.944 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.945 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.945 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.945 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.945 INFO:tasks.workunit.client.0.smithi084.stdout: "pools": [ 2024-03-30T12:21:57.945 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.945 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-03-30T12:21:57.945 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr" 2024-03-30T12:21:57.945 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.945 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-03-30T12:21:57.945 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-03-30T12:21:57.945 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-03-30T12:21:57.945 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-03-30T12:21:57.945 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-03-30T12:21:57.945 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 1, 2024-03-30T12:21:57.945 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 1, 2024-03-30T12:21:57.946 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 1, 2024-03-30T12:21:57.946 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-03-30T12:21:57.946 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-03-30T12:21:57.946 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 729296873738, 2024-03-30T12:21:57.946 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 1781760, 2024-03-30T12:21:57.946 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-03-30T12:21:57.946 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-03-30T12:21:57.946 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 1781760, 2024-03-30T12:21:57.946 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-03-30T12:21:57.946 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 243098959872, 2024-03-30T12:21:57.946 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 2, 2024-03-30T12:21:57.946 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-03-30T12:21:57.946 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 2.443114453853923e-06, 2024-03-30T12:21:57.946 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-03-30T12:21:57.947 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-03-30T12:21:57.947 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 212, 2024-03-30T12:21:57.947 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 313344, 2024-03-30T12:21:57.947 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 590368, 2024-03-30T12:21:57.947 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 590368, 2024-03-30T12:21:57.947 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-03-30T12:21:57.947 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 1771104, 2024-03-30T12:21:57.947 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 179, 2024-03-30T12:21:57.947 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 2473984 2024-03-30T12:21:57.947 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.947 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-03-30T12:21:57.947 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-03-30T12:21:57.947 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-03-30T12:21:57.947 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.947 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.948 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-03-30T12:21:57.948 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs" 2024-03-30T12:21:57.948 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.948 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-03-30T12:21:57.948 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-03-30T12:21:57.948 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-03-30T12:21:57.948 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-03-30T12:21:57.948 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-03-30T12:21:57.948 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 32, 2024-03-30T12:21:57.948 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 32, 2024-03-30T12:21:57.948 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 2, 2024-03-30T12:21:57.948 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-03-30T12:21:57.948 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-03-30T12:21:57.948 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 729296873738, 2024-03-30T12:21:57.948 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 98304, 2024-03-30T12:21:57.949 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-03-30T12:21:57.949 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-03-30T12:21:57.949 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 98304, 2024-03-30T12:21:57.949 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-03-30T12:21:57.949 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 243098959872, 2024-03-30T12:21:57.949 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 22, 2024-03-30T12:21:57.949 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-03-30T12:21:57.949 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 1.3479282756634348e-07, 2024-03-30T12:21:57.949 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-03-30T12:21:57.949 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-03-30T12:21:57.949 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 0, 2024-03-30T12:21:57.949 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 0, 2024-03-30T12:21:57.949 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 3430, 2024-03-30T12:21:57.949 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 3430, 2024-03-30T12:21:57.950 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-03-30T12:21:57.950 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 10290, 2024-03-30T12:21:57.950 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 51, 2024-03-30T12:21:57.950 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 20480 2024-03-30T12:21:57.950 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.950 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-03-30T12:21:57.950 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-03-30T12:21:57.950 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-03-30T12:21:57.950 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.950 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.950 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-03-30T12:21:57.950 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs" 2024-03-30T12:21:57.950 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.950 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-03-30T12:21:57.951 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-03-30T12:21:57.951 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-03-30T12:21:57.951 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-03-30T12:21:57.951 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-03-30T12:21:57.951 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 64, 2024-03-30T12:21:57.951 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 64, 2024-03-30T12:21:57.951 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 3, 2024-03-30T12:21:57.951 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-03-30T12:21:57.951 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-03-30T12:21:57.951 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 729296873738, 2024-03-30T12:21:57.951 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 0, 2024-03-30T12:21:57.951 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-03-30T12:21:57.951 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-03-30T12:21:57.951 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 0, 2024-03-30T12:21:57.951 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-03-30T12:21:57.951 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 243098959872, 2024-03-30T12:21:57.952 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 0, 2024-03-30T12:21:57.952 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-03-30T12:21:57.952 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 0.0, 2024-03-30T12:21:57.952 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-03-30T12:21:57.952 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-03-30T12:21:57.952 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 0, 2024-03-30T12:21:57.952 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 0, 2024-03-30T12:21:57.952 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 0, 2024-03-30T12:21:57.952 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 0, 2024-03-30T12:21:57.952 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-03-30T12:21:57.952 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 0, 2024-03-30T12:21:57.952 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 0, 2024-03-30T12:21:57.952 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 0 2024-03-30T12:21:57.952 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.953 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-03-30T12:21:57.953 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-03-30T12:21:57.953 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-03-30T12:21:57.953 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.953 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.953 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-03-30T12:21:57.953 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd" 2024-03-30T12:21:57.953 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.953 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-03-30T12:21:57.953 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-03-30T12:21:57.953 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-03-30T12:21:57.953 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-03-30T12:21:57.953 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-03-30T12:21:57.953 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 8, 2024-03-30T12:21:57.953 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 8, 2024-03-30T12:21:57.954 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 4, 2024-03-30T12:21:57.954 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-03-30T12:21:57.954 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-03-30T12:21:57.954 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 729296873738, 2024-03-30T12:21:57.954 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 0, 2024-03-30T12:21:57.954 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-03-30T12:21:57.954 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-03-30T12:21:57.954 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 0, 2024-03-30T12:21:57.954 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-03-30T12:21:57.954 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 243098959872, 2024-03-30T12:21:57.954 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 0, 2024-03-30T12:21:57.954 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-03-30T12:21:57.954 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 0.0, 2024-03-30T12:21:57.954 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-03-30T12:21:57.954 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-03-30T12:21:57.955 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 0, 2024-03-30T12:21:57.955 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 0, 2024-03-30T12:21:57.955 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 0, 2024-03-30T12:21:57.955 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 0, 2024-03-30T12:21:57.955 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-03-30T12:21:57.955 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 0, 2024-03-30T12:21:57.955 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 0, 2024-03-30T12:21:57.955 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 0 2024-03-30T12:21:57.955 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.955 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-03-30T12:21:57.955 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-03-30T12:21:57.955 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-03-30T12:21:57.955 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.955 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.955 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd": { 2024-03-30T12:21:57.956 INFO:tasks.workunit.client.0.smithi084.stdout: "mirroring_by_pool": [ 2024-03-30T12:21:57.956 INFO:tasks.workunit.client.0.smithi084.stdout: false 2024-03-30T12:21:57.956 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.956 INFO:tasks.workunit.client.0.smithi084.stdout: "num_images_by_pool": [ 2024-03-30T12:21:57.956 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:57.956 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.956 INFO:tasks.workunit.client.0.smithi084.stdout: "num_pools": 1 2024-03-30T12:21:57.956 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.956 INFO:tasks.workunit.client.0.smithi084.stdout: "report_id": "d6359e11-7dd4-498e-a35d-38ff58e2b1dc", 2024-03-30T12:21:57.956 INFO:tasks.workunit.client.0.smithi084.stdout: "report_timestamp": "2024-03-30T12:21:57.143170", 2024-03-30T12:21:57.956 INFO:tasks.workunit.client.0.smithi084.stdout: "report_version": 1, 2024-03-30T12:21:57.956 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_stats": { 2024-03-30T12:21:57.956 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "7.9.2" 2024-03-30T12:21:57.956 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.956 INFO:tasks.workunit.client.0.smithi084.stdout: "rook": { 2024-03-30T12:21:57.957 INFO:tasks.workunit.client.0.smithi084.stdout: "cluster": { 2024-03-30T12:21:57.957 INFO:tasks.workunit.client.0.smithi084.stdout: "external-mode": null, 2024-03-30T12:21:57.957 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-03-30T12:21:57.957 INFO:tasks.workunit.client.0.smithi084.stdout: "allow-multiple-per-node": null, 2024-03-30T12:21:57.957 INFO:tasks.workunit.client.0.smithi084.stdout: "count": null, 2024-03-30T12:21:57.957 INFO:tasks.workunit.client.0.smithi084.stdout: "max-id": null, 2024-03-30T12:21:57.957 INFO:tasks.workunit.client.0.smithi084.stdout: "pvc": { 2024-03-30T12:21:57.957 INFO:tasks.workunit.client.0.smithi084.stdout: "enabled": null 2024-03-30T12:21:57.957 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.957 INFO:tasks.workunit.client.0.smithi084.stdout: "stretch": { 2024-03-30T12:21:57.957 INFO:tasks.workunit.client.0.smithi084.stdout: "enabled": null 2024-03-30T12:21:57.957 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.957 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.957 INFO:tasks.workunit.client.0.smithi084.stdout: "network": { 2024-03-30T12:21:57.957 INFO:tasks.workunit.client.0.smithi084.stdout: "provider": null 2024-03-30T12:21:57.958 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.958 INFO:tasks.workunit.client.0.smithi084.stdout: "storage": { 2024-03-30T12:21:57.958 INFO:tasks.workunit.client.0.smithi084.stdout: "device-set": { 2024-03-30T12:21:57.958 INFO:tasks.workunit.client.0.smithi084.stdout: "count": { 2024-03-30T12:21:57.958 INFO:tasks.workunit.client.0.smithi084.stdout: "non-portable": null, 2024-03-30T12:21:57.958 INFO:tasks.workunit.client.0.smithi084.stdout: "portable": null, 2024-03-30T12:21:57.958 INFO:tasks.workunit.client.0.smithi084.stdout: "total": null 2024-03-30T12:21:57.958 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.958 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.958 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.958 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.958 INFO:tasks.workunit.client.0.smithi084.stdout: "csi": { 2024-03-30T12:21:57.958 INFO:tasks.workunit.client.0.smithi084.stdout: "version": null 2024-03-30T12:21:57.958 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.959 INFO:tasks.workunit.client.0.smithi084.stdout: "kubernetes": { 2024-03-30T12:21:57.959 INFO:tasks.workunit.client.0.smithi084.stdout: "version": null 2024-03-30T12:21:57.959 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.959 INFO:tasks.workunit.client.0.smithi084.stdout: "node": { 2024-03-30T12:21:57.959 INFO:tasks.workunit.client.0.smithi084.stdout: "count": { 2024-03-30T12:21:57.959 INFO:tasks.workunit.client.0.smithi084.stdout: "kubernetes-total": null, 2024-03-30T12:21:57.959 INFO:tasks.workunit.client.0.smithi084.stdout: "with-ceph-daemons": null, 2024-03-30T12:21:57.959 INFO:tasks.workunit.client.0.smithi084.stdout: "with-csi-cephfs-plugin": null, 2024-03-30T12:21:57.959 INFO:tasks.workunit.client.0.smithi084.stdout: "with-csi-nfs-plugin": null, 2024-03-30T12:21:57.959 INFO:tasks.workunit.client.0.smithi084.stdout: "with-csi-rbd-plugin": null 2024-03-30T12:21:57.959 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.959 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.959 INFO:tasks.workunit.client.0.smithi084.stdout: "usage": { 2024-03-30T12:21:57.959 INFO:tasks.workunit.client.0.smithi084.stdout: "storage-class": { 2024-03-30T12:21:57.959 INFO:tasks.workunit.client.0.smithi084.stdout: "count": { 2024-03-30T12:21:57.960 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket": null, 2024-03-30T12:21:57.960 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs": null, 2024-03-30T12:21:57.960 INFO:tasks.workunit.client.0.smithi084.stdout: "nfs": null, 2024-03-30T12:21:57.960 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd": null, 2024-03-30T12:21:57.960 INFO:tasks.workunit.client.0.smithi084.stdout: "total": null 2024-03-30T12:21:57.960 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.960 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:57.960 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.960 INFO:tasks.workunit.client.0.smithi084.stdout: "version": null 2024-03-30T12:21:57.960 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.960 INFO:tasks.workunit.client.0.smithi084.stdout: "services": {}, 2024-03-30T12:21:57.960 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_per_pg": [ 2024-03-30T12:21:57.960 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.960 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:57.960 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:57.961 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:57.961 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:57.961 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.961 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:21:57.961 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:57.961 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:57.961 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:57.961 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:57.961 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:57.961 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:57.961 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.472481+0000", 2024-03-30T12:21:57.961 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.863041+0000", 2024-03-30T12:21:57.962 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.863041+0000", 2024-03-30T12:21:57.962 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.863340+0000", 2024-03-30T12:21:57.962 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.472481+0000", 2024-03-30T12:21:57.962 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:57.962 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:57.962 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:57.962 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:57.962 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.472481+0000", 2024-03-30T12:21:57.962 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.472481+0000", 2024-03-30T12:21:57.962 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.472481+0000", 2024-03-30T12:21:57.962 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:57.962 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:57.962 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:57.962 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.472481+0000", 2024-03-30T12:21:57.963 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.472481+0000", 2024-03-30T12:21:57.963 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:57.963 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:57.963 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:57.963 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:57.963 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:57.963 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:57.963 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:57.963 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:57.963 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:57.963 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:57.963 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:57.963 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:57.963 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:57.963 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3f", 2024-03-30T12:21:57.964 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:57.964 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:57.964 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:57.964 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:57.964 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:57.964 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T18:37:21.728523+0000", 2024-03-30T12:21:57.964 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:57.964 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:57.964 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:57.964 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:57.964 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:57.964 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:57.964 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:57.964 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:57.964 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:57.965 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:57.965 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:57.965 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:57.965 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:57.965 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:57.965 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:57.965 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:57.965 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:57.965 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:57.965 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:57.965 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:57.965 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:57.965 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:57.965 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:57.966 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:57.966 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:57.966 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:57.966 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:57.966 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:57.966 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:57.966 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:57.966 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:57.966 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:57.966 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:57.966 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:57.966 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:57.966 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:57.966 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:57.966 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:57.967 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:57.967 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:57.967 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:57.967 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:57.967 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:57.967 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.967 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:57.967 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:57.967 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:57.967 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:57.967 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:57.967 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:57.967 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.967 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:21:57.967 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:57.968 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.968 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.968 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:57.968 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:57.968 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:57.968 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:57.968 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.968 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:21:57.968 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:57.968 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:57.968 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:57.968 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:57.968 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:57.968 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:57.968 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.241941+0000", 2024-03-30T12:21:57.969 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:20:37.241258+0000", 2024-03-30T12:21:57.969 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:20:37.241258+0000", 2024-03-30T12:21:57.969 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:20:37.241613+0000", 2024-03-30T12:21:57.969 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.241941+0000", 2024-03-30T12:21:57.969 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:57.969 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:57.969 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:57.969 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 68, 2024-03-30T12:21:57.969 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.241941+0000", 2024-03-30T12:21:57.969 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.241941+0000", 2024-03-30T12:21:57.969 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.241941+0000", 2024-03-30T12:21:57.969 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:57.969 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:57.969 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:57.969 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.241941+0000", 2024-03-30T12:21:57.970 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.241941+0000", 2024-03-30T12:21:57.970 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:57.970 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:57.970 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:57.970 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:57.970 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 67, 2024-03-30T12:21:57.970 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:57.970 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:57.970 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:57.970 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:57.970 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:57.970 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:57.970 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:57.970 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:57.971 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3e", 2024-03-30T12:21:57.971 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:57.971 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:57.971 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:57.971 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 27, 2024-03-30T12:21:57.971 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:57.971 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:23:14.775585+0000", 2024-03-30T12:21:57.971 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:57.971 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:57.971 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:57.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:57.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:57.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:57.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:57.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:57.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:57.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:57.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:57.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:57.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:57.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:57.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:57.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:57.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:57.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:57.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:57.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:57.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:57.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:57.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:57.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:57.973 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:57.973 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:57.973 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:57.973 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:57.973 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:57.973 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:57.973 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:57.973 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:57.973 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:57.973 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:57.973 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:57.973 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:57.973 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:57.973 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:57.973 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:57.974 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:57.974 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:57.974 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:57.974 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:57.974 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.974 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:57.974 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:57.974 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:57.974 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:57.974 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:57.974 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:57.974 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.974 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:21:57.974 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:57.974 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.975 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.975 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:57.975 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:57.975 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:57.975 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:57.975 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.975 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:21:57.975 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:57.975 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:57.975 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:57.975 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:57.975 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:57.975 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:57.975 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.007009+0000", 2024-03-30T12:21:57.976 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.853543+0000", 2024-03-30T12:21:57.976 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.853543+0000", 2024-03-30T12:21:57.976 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.853843+0000", 2024-03-30T12:21:57.976 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.007009+0000", 2024-03-30T12:21:57.976 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:57.976 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:57.976 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:57.976 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:57.976 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.007009+0000", 2024-03-30T12:21:57.976 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.007009+0000", 2024-03-30T12:21:57.976 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.007009+0000", 2024-03-30T12:21:57.976 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:57.976 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:57.976 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:57.976 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.007009+0000", 2024-03-30T12:21:57.977 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.007009+0000", 2024-03-30T12:21:57.977 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:57.977 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:57.977 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:57.977 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:57.977 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:57.977 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:57.977 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:57.977 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:57.977 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:57.977 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:57.977 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:57.977 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:57.977 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:57.977 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3d", 2024-03-30T12:21:57.978 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:57.978 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:57.978 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:57.978 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:57.978 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:57.978 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T12:28:52.339142+0000", 2024-03-30T12:21:57.978 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:57.978 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:57.978 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:57.978 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:57.978 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:57.978 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:57.978 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:57.978 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:57.978 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:57.978 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:57.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:57.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:57.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:57.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:57.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:57.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:57.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:57.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:57.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:57.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:57.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:57.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:57.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:57.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:57.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:57.980 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:57.980 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:57.980 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:57.980 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:57.980 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:57.980 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:57.980 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:57.980 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:57.980 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:57.980 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:57.980 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:57.980 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:57.980 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:57.980 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:57.980 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:57.981 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:57.981 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:57.981 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:57.981 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.981 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:57.981 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:57.981 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:57.981 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:57.981 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:57.981 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:57.981 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.981 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:21:57.981 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:57.981 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.981 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.981 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:57.982 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:57.982 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:57.982 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:57.982 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.982 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:57.982 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:57.982 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:57.982 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:57.982 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:57.982 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:57.982 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:57.982 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006430+0000", 2024-03-30T12:21:57.982 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.859615+0000", 2024-03-30T12:21:57.982 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.859615+0000", 2024-03-30T12:21:57.983 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.859974+0000", 2024-03-30T12:21:57.983 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006430+0000", 2024-03-30T12:21:57.983 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:57.983 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:57.983 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:57.983 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:57.983 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006430+0000", 2024-03-30T12:21:57.983 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006430+0000", 2024-03-30T12:21:57.983 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006430+0000", 2024-03-30T12:21:57.983 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:57.983 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:57.983 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:57.983 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006430+0000", 2024-03-30T12:21:57.983 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006430+0000", 2024-03-30T12:21:57.983 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:57.984 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:57.984 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:57.984 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:57.984 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:57.984 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:57.984 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:57.984 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:57.984 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:57.984 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:57.984 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:57.984 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:57.984 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:57.984 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3c", 2024-03-30T12:21:57.984 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:57.985 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:57.985 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:57.985 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:57.985 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:57.985 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T17:50:26.933772+0000", 2024-03-30T12:21:57.985 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:57.985 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:57.985 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:57.985 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:57.985 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:57.985 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:57.985 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:57.985 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:57.985 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:57.985 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:57.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:57.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:57.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:57.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:57.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:57.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:57.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:57.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:57.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:57.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:57.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:57.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:57.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:57.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:57.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:57.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:57.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:57.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:57.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:57.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:57.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:57.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:57.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:57.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:57.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:57.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:57.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:57.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:57.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:57.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:57.988 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:57.988 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:57.988 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:57.988 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.988 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:57.988 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:57.988 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:57.988 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:57.988 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:57.988 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:57.988 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.988 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:57.988 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:57.988 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.988 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.988 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:57.989 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:57.989 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:57.989 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:57.989 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.989 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:21:57.989 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:57.989 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:57.989 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:57.989 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:57.989 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:57.989 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:57.989 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.472207+0000", 2024-03-30T12:21:57.989 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.872098+0000", 2024-03-30T12:21:57.989 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.872098+0000", 2024-03-30T12:21:57.990 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.872400+0000", 2024-03-30T12:21:57.990 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.472207+0000", 2024-03-30T12:21:57.990 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:57.990 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:57.990 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:57.990 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:57.990 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.472207+0000", 2024-03-30T12:21:57.990 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.472207+0000", 2024-03-30T12:21:57.990 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.472207+0000", 2024-03-30T12:21:57.990 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:57.990 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:57.990 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:57.990 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.472207+0000", 2024-03-30T12:21:57.990 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.472207+0000", 2024-03-30T12:21:57.991 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:57.991 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:57.991 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:57.991 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:57.991 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:57.991 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:57.991 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:57.991 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:57.991 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:57.991 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:57.991 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:57.991 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:57.991 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:57.991 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3b", 2024-03-30T12:21:57.992 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:57.992 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:57.992 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:57.992 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:57.992 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:57.992 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-04-01T00:18:21.152462+0000", 2024-03-30T12:21:57.992 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:57.992 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:57.992 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:57.992 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:57.992 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:57.992 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:57.992 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:57.992 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:57.992 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:57.993 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:57.993 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:57.993 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:57.993 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:57.993 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:57.993 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:57.993 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:57.993 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:57.993 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:57.993 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:57.993 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:57.993 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:57.993 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:57.993 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:57.994 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:57.994 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:57.994 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:57.994 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:57.994 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:57.994 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:57.994 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:57.994 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:57.994 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:57.994 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:57.994 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:57.994 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:57.994 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:57.994 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:57.994 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:57.995 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:57.995 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:57.995 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:57.995 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:57.995 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:57.995 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.995 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:57.995 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:57.995 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:57.995 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:57.995 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:57.995 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:57.995 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.995 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:21:57.995 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:57.996 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:57.996 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:57.996 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:57.996 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:57.996 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:57.996 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:57.996 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:57.996 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:57.996 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:57.996 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:57.996 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:57.996 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:57.996 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:57.996 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:57.996 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006669+0000", 2024-03-30T12:21:57.997 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.857668+0000", 2024-03-30T12:21:57.997 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.857668+0000", 2024-03-30T12:21:57.997 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.858029+0000", 2024-03-30T12:21:57.997 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006669+0000", 2024-03-30T12:21:57.997 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:57.997 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:57.997 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:57.997 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:57.997 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006669+0000", 2024-03-30T12:21:57.997 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006669+0000", 2024-03-30T12:21:57.997 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006669+0000", 2024-03-30T12:21:57.997 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:57.997 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:57.997 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:57.997 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006669+0000", 2024-03-30T12:21:57.998 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006669+0000", 2024-03-30T12:21:57.998 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:57.998 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:57.998 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:57.998 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:57.998 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:57.998 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:57.998 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:57.998 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:57.998 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:57.998 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:57.998 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:57.998 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:57.998 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:57.999 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3a", 2024-03-30T12:21:57.999 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:57.999 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:57.999 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:57.999 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:57.999 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:57.999 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T20:17:33.313541+0000", 2024-03-30T12:21:57.999 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:57.999 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:57.999 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:57.999 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:57.999 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:57.999 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:57.999 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:57.999 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.000 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.000 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.000 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.000 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.000 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.000 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.000 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.000 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.000 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.000 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.000 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.000 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.000 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.000 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.000 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.001 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.001 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.001 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.001 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.001 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.001 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.001 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.001 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.001 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.001 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.001 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.001 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.001 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.001 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.001 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.001 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.002 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.002 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.002 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.002 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.002 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.002 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.002 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.002 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.002 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.002 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.002 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.002 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.002 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:58.002 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.003 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.003 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.003 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.003 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.003 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.003 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:58.003 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.003 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:21:58.003 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.003 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.003 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.003 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.003 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.003 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.003 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.471577+0000", 2024-03-30T12:21:58.004 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.868799+0000", 2024-03-30T12:21:58.004 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.868799+0000", 2024-03-30T12:21:58.004 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.869258+0000", 2024-03-30T12:21:58.004 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.471577+0000", 2024-03-30T12:21:58.004 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.004 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.004 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.004 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.004 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.471577+0000", 2024-03-30T12:21:58.004 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.471577+0000", 2024-03-30T12:21:58.004 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.471577+0000", 2024-03-30T12:21:58.004 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.004 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.004 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.004 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.471577+0000", 2024-03-30T12:21:58.005 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.471577+0000", 2024-03-30T12:21:58.005 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.005 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.005 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.005 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.005 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.005 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.005 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.005 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.005 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.005 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.005 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.005 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.005 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.005 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.39", 2024-03-30T12:21:58.005 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.006 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.006 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.006 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.006 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.006 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T17:00:11.265094+0000", 2024-03-30T12:21:58.006 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.006 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.006 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.006 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.006 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.006 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.006 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.006 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.006 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.006 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.007 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.007 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.007 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.007 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.007 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.007 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.007 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.007 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.007 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.007 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.007 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.007 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.007 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.007 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.007 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.008 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.008 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.008 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.008 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.008 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.008 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.008 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.008 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.008 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.008 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.008 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.008 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.008 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.008 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.008 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.008 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.008 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.008 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.009 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.009 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.009 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.009 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.009 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.009 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.009 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:58.009 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.009 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:21:58.009 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.009 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.009 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.009 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.009 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.009 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.010 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.010 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.010 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:21:58.010 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.010 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.010 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.010 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.010 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.010 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.010 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.003424+0000", 2024-03-30T12:21:58.010 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.863991+0000", 2024-03-30T12:21:58.010 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.863991+0000", 2024-03-30T12:21:58.010 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.864240+0000", 2024-03-30T12:21:58.010 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.003424+0000", 2024-03-30T12:21:58.010 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.011 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.011 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.011 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.011 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.003424+0000", 2024-03-30T12:21:58.011 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.003424+0000", 2024-03-30T12:21:58.011 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.003424+0000", 2024-03-30T12:21:58.011 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.011 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.011 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.011 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.003424+0000", 2024-03-30T12:21:58.011 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.003424+0000", 2024-03-30T12:21:58.011 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.011 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.011 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.011 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.012 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.012 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.012 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.012 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.012 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.012 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.012 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.012 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.012 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.012 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.38", 2024-03-30T12:21:58.012 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.012 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.012 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.012 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.012 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.012 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:59:30.409530+0000", 2024-03-30T12:21:58.013 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.013 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.013 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.013 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.013 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.013 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.013 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.013 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.013 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.013 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.013 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.013 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.013 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.013 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.013 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.013 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.014 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.014 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.014 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.014 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.014 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.014 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.014 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.014 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.014 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.014 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.014 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.014 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.014 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.014 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.014 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.015 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.015 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.015 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.015 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.015 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.015 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.015 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.015 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.015 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.015 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.015 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.015 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.015 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.016 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.016 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.016 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.016 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.016 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.016 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.016 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.016 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:21:58.016 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.016 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.016 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.016 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.016 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.016 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.016 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.017 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.017 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:21:58.017 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.017 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.017 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.017 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.017 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.017 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.017 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.472430+0000", 2024-03-30T12:21:58.017 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.874620+0000", 2024-03-30T12:21:58.017 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.874620+0000", 2024-03-30T12:21:58.017 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.875226+0000", 2024-03-30T12:21:58.017 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.472430+0000", 2024-03-30T12:21:58.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.472430+0000", 2024-03-30T12:21:58.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.472430+0000", 2024-03-30T12:21:58.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.472430+0000", 2024-03-30T12:21:58.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.472430+0000", 2024-03-30T12:21:58.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.472430+0000", 2024-03-30T12:21:58.018 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.018 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.019 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.019 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.019 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.019 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.019 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.019 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.019 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.019 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.019 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.019 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.019 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.019 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.37", 2024-03-30T12:21:58.019 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.019 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.020 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.020 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.020 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.020 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T21:58:40.881840+0000", 2024-03-30T12:21:58.020 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.020 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.020 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.020 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.020 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.020 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.020 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.020 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.020 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.020 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.020 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.020 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.023 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.023 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.023 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.023 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.023 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.023 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.023 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.023 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.023 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.023 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:21:58.023 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.023 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.023 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.023 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.023 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.024 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.024 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.024 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.024 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:21:58.024 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.024 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.024 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.024 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.024 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.024 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.024 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.240476+0000", 2024-03-30T12:21:58.024 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.868887+0000", 2024-03-30T12:21:58.024 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.868887+0000", 2024-03-30T12:21:58.024 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.869363+0000", 2024-03-30T12:21:58.025 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.240476+0000", 2024-03-30T12:21:58.025 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.025 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.025 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.025 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.025 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.240476+0000", 2024-03-30T12:21:58.025 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.240476+0000", 2024-03-30T12:21:58.025 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.240476+0000", 2024-03-30T12:21:58.025 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.025 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.025 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.025 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.240476+0000", 2024-03-30T12:21:58.025 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.240476+0000", 2024-03-30T12:21:58.025 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.025 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.026 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.026 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.026 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.026 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.026 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.026 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.026 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.026 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.026 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.026 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.026 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.026 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.36", 2024-03-30T12:21:58.026 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.026 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.027 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.027 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.027 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.027 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T22:40:49.543161+0000", 2024-03-30T12:21:58.027 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.027 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.027 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.027 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.027 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.027 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.027 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.027 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.027 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.027 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.030 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.030 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.030 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.030 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.030 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.030 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.030 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.030 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.030 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.030 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.030 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.030 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:21:58.030 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.030 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.031 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.031 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.031 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.031 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.031 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.031 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.031 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:21:58.031 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.031 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.031 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.031 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.031 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.031 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.031 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.240717+0000", 2024-03-30T12:21:58.031 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.863683+0000", 2024-03-30T12:21:58.031 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.863683+0000", 2024-03-30T12:21:58.032 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.863992+0000", 2024-03-30T12:21:58.032 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.240717+0000", 2024-03-30T12:21:58.032 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.032 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.032 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.032 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.032 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.240717+0000", 2024-03-30T12:21:58.032 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.240717+0000", 2024-03-30T12:21:58.032 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.240717+0000", 2024-03-30T12:21:58.032 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.032 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.032 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.032 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.240717+0000", 2024-03-30T12:21:58.033 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.240717+0000", 2024-03-30T12:21:58.033 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.033 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.033 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.033 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.033 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.033 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.033 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.033 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.033 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.033 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.033 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.033 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.033 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.033 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.35", 2024-03-30T12:21:58.034 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.034 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.034 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.034 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.034 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.034 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T21:40:36.734391+0000", 2024-03-30T12:21:58.034 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.034 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.034 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.034 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.034 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.034 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.034 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.034 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.034 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.035 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.037 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.037 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.037 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.037 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.037 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.037 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.037 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.037 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.037 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.037 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.037 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.037 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.037 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.037 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:21:58.038 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.038 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.038 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.038 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.038 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.038 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.038 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.038 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.038 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-03-30T12:21:58.038 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.038 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.038 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.038 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.038 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.039 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.039 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.598972+0000", 2024-03-30T12:21:58.039 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.862084+0000", 2024-03-30T12:21:58.039 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.862084+0000", 2024-03-30T12:21:58.039 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.862541+0000", 2024-03-30T12:21:58.039 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.598972+0000", 2024-03-30T12:21:58.039 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.039 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.039 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.039 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.039 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.598972+0000", 2024-03-30T12:21:58.039 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.598972+0000", 2024-03-30T12:21:58.039 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.598972+0000", 2024-03-30T12:21:58.039 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.039 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.040 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.040 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.598972+0000", 2024-03-30T12:21:58.040 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.598972+0000", 2024-03-30T12:21:58.040 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.040 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.040 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.040 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.040 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.040 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.040 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.040 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.040 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.040 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.040 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.041 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.041 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.041 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.34", 2024-03-30T12:21:58.041 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.041 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.041 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.041 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.041 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.041 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:40:36.445232+0000", 2024-03-30T12:21:58.041 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.041 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.041 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.041 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.041 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.041 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.041 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.042 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.043 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.043 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.043 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.043 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.043 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.043 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.043 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.043 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.043 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.043 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.043 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.043 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.043 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.043 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.043 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.044 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.044 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.044 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.044 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.044 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.044 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.044 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.044 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.044 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.044 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.044 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.044 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.044 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.044 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.044 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.045 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-03-30T12:21:58.045 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.045 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.045 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.045 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.045 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.045 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.045 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.045 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.045 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:21:58.045 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.045 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.045 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.045 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.046 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.046 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.046 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.003944+0000", 2024-03-30T12:21:58.046 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.849849+0000", 2024-03-30T12:21:58.046 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.849849+0000", 2024-03-30T12:21:58.046 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.850148+0000", 2024-03-30T12:21:58.046 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.003944+0000", 2024-03-30T12:21:58.046 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.046 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.046 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.046 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.046 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.003944+0000", 2024-03-30T12:21:58.046 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.003944+0000", 2024-03-30T12:21:58.047 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.003944+0000", 2024-03-30T12:21:58.047 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.047 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.047 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.047 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.003944+0000", 2024-03-30T12:21:58.047 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.003944+0000", 2024-03-30T12:21:58.047 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.047 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.047 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.047 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.047 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.047 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.047 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.047 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.047 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.048 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.048 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.048 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.048 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.048 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.33", 2024-03-30T12:21:58.048 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.048 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.048 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.048 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.048 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.048 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T18:55:56.657057+0000", 2024-03-30T12:21:58.048 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.048 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.048 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.048 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.048 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.049 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.050 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.050 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.050 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.050 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.050 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.050 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.050 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.050 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.050 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.050 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.050 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.050 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.050 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.050 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.050 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.051 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.051 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.051 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.051 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.051 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.051 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.051 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.051 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.051 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.051 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.051 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.051 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.051 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.051 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.051 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.052 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:21:58.052 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.052 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.052 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.052 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.052 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.052 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.052 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:21:58.052 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.052 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:21:58.052 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.052 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.052 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.052 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.052 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.053 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.053 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.005759+0000", 2024-03-30T12:21:58.053 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.864441+0000", 2024-03-30T12:21:58.053 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.864441+0000", 2024-03-30T12:21:58.053 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.865479+0000", 2024-03-30T12:21:58.053 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.005759+0000", 2024-03-30T12:21:58.053 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.053 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.053 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.053 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.053 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.005759+0000", 2024-03-30T12:21:58.053 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.005759+0000", 2024-03-30T12:21:58.053 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.005759+0000", 2024-03-30T12:21:58.053 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.053 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.054 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.054 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.005759+0000", 2024-03-30T12:21:58.054 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.005759+0000", 2024-03-30T12:21:58.054 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.054 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.054 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.054 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.054 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.054 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.054 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.054 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.054 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.054 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.054 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.054 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.055 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.055 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.32", 2024-03-30T12:21:58.055 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.055 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.055 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.055 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.055 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.055 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T14:45:55.344815+0000", 2024-03-30T12:21:58.055 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.055 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.055 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.057 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.057 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.057 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.057 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.057 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.057 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.057 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.057 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.057 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.057 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.057 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.057 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.057 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.057 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.057 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.058 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.058 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.058 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.058 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.058 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.058 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.058 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.058 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.058 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.058 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.058 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.058 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:21:58.058 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.058 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:21:58.058 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.059 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.059 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.059 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.059 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.059 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.059 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:21:58.059 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.059 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:21:58.059 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.059 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.059 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.059 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.059 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.059 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.005958+0000", 2024-03-30T12:21:58.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.866276+0000", 2024-03-30T12:21:58.060 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.866276+0000", 2024-03-30T12:21:58.060 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.866672+0000", 2024-03-30T12:21:58.060 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.005958+0000", 2024-03-30T12:21:58.060 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.060 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.060 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.060 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.060 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.005958+0000", 2024-03-30T12:21:58.060 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.005958+0000", 2024-03-30T12:21:58.060 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.005958+0000", 2024-03-30T12:21:58.060 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.060 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.060 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.060 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.005958+0000", 2024-03-30T12:21:58.061 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.005958+0000", 2024-03-30T12:21:58.061 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.061 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.061 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.061 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.061 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.061 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.061 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.061 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.061 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.061 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.061 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.061 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.061 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.061 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.31", 2024-03-30T12:21:58.062 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.062 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.062 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.062 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.062 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.062 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T22:23:49.856597+0000", 2024-03-30T12:21:58.062 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.062 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.062 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.065 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.065 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.065 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.065 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.065 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.065 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.065 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.065 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.065 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.065 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:21:58.065 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.065 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:21:58.065 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.065 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.065 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.066 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.066 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.066 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.066 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.066 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.066 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:58.066 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.066 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.066 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.066 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.066 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.066 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.066 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006129+0000", 2024-03-30T12:21:58.066 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.864447+0000", 2024-03-30T12:21:58.066 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.864447+0000", 2024-03-30T12:21:58.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.864760+0000", 2024-03-30T12:21:58.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006129+0000", 2024-03-30T12:21:58.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006129+0000", 2024-03-30T12:21:58.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006129+0000", 2024-03-30T12:21:58.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006129+0000", 2024-03-30T12:21:58.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006129+0000", 2024-03-30T12:21:58.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006129+0000", 2024-03-30T12:21:58.067 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.067 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.068 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.068 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.068 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.068 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.068 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.068 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.068 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.068 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.068 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.068 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.068 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.068 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.30", 2024-03-30T12:21:58.068 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.068 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.069 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.069 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.069 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.069 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:26:47.024806+0000", 2024-03-30T12:21:58.069 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.069 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.069 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.072 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.072 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.072 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.072 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.072 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.072 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.072 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.072 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.072 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.072 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:58.072 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.072 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.072 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.072 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.072 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.073 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.073 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:58.073 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.073 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:58.073 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.073 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.073 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.073 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.073 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.073 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.073 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006845+0000", 2024-03-30T12:21:58.073 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.863129+0000", 2024-03-30T12:21:58.073 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.863129+0000", 2024-03-30T12:21:58.073 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.863453+0000", 2024-03-30T12:21:58.073 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006845+0000", 2024-03-30T12:21:58.073 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.074 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.074 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.074 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.074 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006845+0000", 2024-03-30T12:21:58.074 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006845+0000", 2024-03-30T12:21:58.074 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006845+0000", 2024-03-30T12:21:58.074 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.074 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.074 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.074 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006845+0000", 2024-03-30T12:21:58.074 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006845+0000", 2024-03-30T12:21:58.074 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.074 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.075 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.075 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.075 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.075 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.075 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.075 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.075 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.075 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.075 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.075 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.075 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.075 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2f", 2024-03-30T12:21:58.075 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.075 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.075 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.075 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.076 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.076 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T21:19:33.658159+0000", 2024-03-30T12:21:58.076 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.076 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.076 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.076 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.076 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.076 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.076 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.076 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.076 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.076 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.076 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.076 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.076 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.076 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.079 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.079 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.079 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.079 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.079 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.079 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.079 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:58.079 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.079 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:58.079 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.079 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.079 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.079 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.079 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.079 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.079 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.079 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.080 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-03-30T12:21:58.080 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.080 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.080 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.080 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.080 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.080 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.080 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006806+0000", 2024-03-30T12:21:58.080 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.854238+0000", 2024-03-30T12:21:58.080 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.854238+0000", 2024-03-30T12:21:58.080 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.854527+0000", 2024-03-30T12:21:58.080 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006806+0000", 2024-03-30T12:21:58.080 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.080 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.080 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.080 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.080 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006806+0000", 2024-03-30T12:21:58.081 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006806+0000", 2024-03-30T12:21:58.081 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006806+0000", 2024-03-30T12:21:58.081 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.081 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.081 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.081 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006806+0000", 2024-03-30T12:21:58.081 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006806+0000", 2024-03-30T12:21:58.081 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.081 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.081 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.081 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.081 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.081 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.082 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.082 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.082 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.082 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.082 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.082 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.082 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.082 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2e", 2024-03-30T12:21:58.082 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.082 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.082 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.082 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.082 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.082 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T22:50:54.069856+0000", 2024-03-30T12:21:58.083 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.083 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.083 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.083 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.085 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.086 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.086 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.086 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.086 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.086 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.086 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.086 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.086 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-03-30T12:21:58.086 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.086 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.086 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.086 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.086 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.086 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.086 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.087 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.087 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:21:58.087 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.087 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.087 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.087 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.087 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.087 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.087 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.471919+0000", 2024-03-30T12:21:58.087 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.854077+0000", 2024-03-30T12:21:58.087 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.854077+0000", 2024-03-30T12:21:58.087 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.854461+0000", 2024-03-30T12:21:58.087 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.471919+0000", 2024-03-30T12:21:58.087 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.088 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.088 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.088 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.088 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.471919+0000", 2024-03-30T12:21:58.088 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.471919+0000", 2024-03-30T12:21:58.088 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.471919+0000", 2024-03-30T12:21:58.088 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.088 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.088 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.088 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.471919+0000", 2024-03-30T12:21:58.088 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.471919+0000", 2024-03-30T12:21:58.088 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.088 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.089 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.089 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.089 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.089 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.089 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.089 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.089 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.089 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.089 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.089 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.089 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.089 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2d", 2024-03-30T12:21:58.089 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.089 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.089 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.089 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.090 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.090 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T14:24:10.940443+0000", 2024-03-30T12:21:58.090 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.090 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.090 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.090 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.090 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.090 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.090 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.090 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.090 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.090 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.090 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.090 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.093 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.093 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.093 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.093 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.093 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.093 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.093 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.093 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.093 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:21:58.093 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.093 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.093 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.093 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.093 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.094 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.094 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:58.094 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.094 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:21:58.094 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.094 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.094 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.094 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.094 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.094 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.094 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.007245+0000", 2024-03-30T12:21:58.094 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.466689+0000", 2024-03-30T12:21:58.094 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.466689+0000", 2024-03-30T12:21:58.094 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.466957+0000", 2024-03-30T12:21:58.094 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.007245+0000", 2024-03-30T12:21:58.094 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.095 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.095 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.095 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.095 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.007245+0000", 2024-03-30T12:21:58.095 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.007245+0000", 2024-03-30T12:21:58.095 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.007245+0000", 2024-03-30T12:21:58.095 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.095 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.095 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.095 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.007245+0000", 2024-03-30T12:21:58.095 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.007245+0000", 2024-03-30T12:21:58.095 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.095 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 4, 2024-03-30T12:21:58.095 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.095 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.096 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.096 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.096 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.096 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.096 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.096 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 4, 2024-03-30T12:21:58.096 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.096 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.096 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.096 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1f", 2024-03-30T12:21:58.096 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.096 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.096 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.096 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 23, 2024-03-30T12:21:58.096 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.097 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T14:07:08.774258+0000", 2024-03-30T12:21:58.097 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.097 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.097 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 582, 2024-03-30T12:21:58.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.097 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 6, 2024-03-30T12:21:58.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 2, 2024-03-30T12:21:58.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 2, 2024-03-30T12:21:58.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.098 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.099 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-03-30T12:21:58.099 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.099 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.099 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.099 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.099 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.099 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.099 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.099 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.099 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.099 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.099 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.099 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.099 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 4, 2024-03-30T12:21:58.099 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 1 2024-03-30T12:21:58.100 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.100 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.100 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.100 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.100 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.100 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.100 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:58.100 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.100 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:21:58.100 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'4" 2024-03-30T12:21:58.100 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.100 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.100 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.100 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.100 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.101 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.101 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.101 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:21:58.101 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.101 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.101 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.101 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.101 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.101 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.101 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.003958+0000", 2024-03-30T12:21:58.101 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.863429+0000", 2024-03-30T12:21:58.101 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.863429+0000", 2024-03-30T12:21:58.101 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.863714+0000", 2024-03-30T12:21:58.101 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.003958+0000", 2024-03-30T12:21:58.101 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.101 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.102 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.102 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.102 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.003958+0000", 2024-03-30T12:21:58.102 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.003958+0000", 2024-03-30T12:21:58.102 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.003958+0000", 2024-03-30T12:21:58.102 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.102 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.102 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.102 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.003958+0000", 2024-03-30T12:21:58.102 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.003958+0000", 2024-03-30T12:21:58.102 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.102 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.102 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.102 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.103 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.103 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.103 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.103 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.103 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.103 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.103 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.103 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.103 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.103 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1e", 2024-03-30T12:21:58.103 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.103 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.103 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.103 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.104 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.104 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T19:56:31.953173+0000", 2024-03-30T12:21:58.104 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.104 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.104 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.104 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.104 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.104 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.104 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.104 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.104 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.104 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.104 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.104 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.104 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.105 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.105 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.105 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.105 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.105 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.105 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.105 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.105 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.105 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.105 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.105 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.105 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.105 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.105 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.105 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.106 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.106 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.106 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.106 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.106 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.106 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.106 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.106 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.106 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.106 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.106 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.106 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.106 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.107 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.107 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.107 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.107 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.107 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.107 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.107 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.107 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.107 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:21:58.107 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.107 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.107 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.107 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.108 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.108 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.108 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:21:58.108 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.108 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:21:58.108 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.108 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.108 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.108 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.108 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.108 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.108 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.004373+0000", 2024-03-30T12:21:58.108 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.459409+0000", 2024-03-30T12:21:58.108 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.459409+0000", 2024-03-30T12:21:58.108 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.459693+0000", 2024-03-30T12:21:58.108 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.004373+0000", 2024-03-30T12:21:58.109 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.109 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.109 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.109 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.109 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.004373+0000", 2024-03-30T12:21:58.109 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.004373+0000", 2024-03-30T12:21:58.109 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.004373+0000", 2024-03-30T12:21:58.109 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.109 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.109 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.109 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.004373+0000", 2024-03-30T12:21:58.109 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.004373+0000", 2024-03-30T12:21:58.109 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.109 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 1, 2024-03-30T12:21:58.109 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.109 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.110 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.110 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.110 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.110 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.110 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.110 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 1, 2024-03-30T12:21:58.110 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.110 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.110 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.110 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1e", 2024-03-30T12:21:58.110 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.110 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.110 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.110 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 20, 2024-03-30T12:21:58.111 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.111 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T18:56:27.891375+0000", 2024-03-30T12:21:58.111 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.111 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.111 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.111 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.111 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.111 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.111 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.111 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.111 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.111 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.111 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.111 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.112 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.112 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.112 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.112 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.112 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.112 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.112 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.112 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.112 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.112 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.112 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.112 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.112 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.112 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.112 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.113 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.113 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.113 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.113 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.113 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.113 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.113 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.113 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.113 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.113 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.113 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.113 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.113 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.113 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.113 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.114 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.114 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.114 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.114 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.114 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.114 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.114 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:21:58.114 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.114 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:21:58.114 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'1" 2024-03-30T12:21:58.114 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.114 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.114 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.115 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.115 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.115 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.115 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.115 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:21:58.115 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.115 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.115 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.115 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.115 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.115 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.115 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.007101+0000", 2024-03-30T12:21:58.115 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.864274+0000", 2024-03-30T12:21:58.115 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.864274+0000", 2024-03-30T12:21:58.115 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.864952+0000", 2024-03-30T12:21:58.116 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.007101+0000", 2024-03-30T12:21:58.116 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.116 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.116 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.116 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.116 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.007101+0000", 2024-03-30T12:21:58.116 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.007101+0000", 2024-03-30T12:21:58.116 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.007101+0000", 2024-03-30T12:21:58.116 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.116 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.116 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.116 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.007101+0000", 2024-03-30T12:21:58.116 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.007101+0000", 2024-03-30T12:21:58.116 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.117 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.117 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.117 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.117 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.117 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.117 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.117 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.117 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.117 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.117 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.117 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.117 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.117 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1f", 2024-03-30T12:21:58.117 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.117 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.118 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.118 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.118 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.118 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T14:45:00.775246+0000", 2024-03-30T12:21:58.118 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.118 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.118 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.118 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.118 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.118 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.118 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.118 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.118 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.118 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.118 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.119 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.119 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.119 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.119 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.119 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.119 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.119 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.119 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.119 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.119 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.119 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.119 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.119 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.119 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.119 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.119 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.120 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.121 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.121 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.121 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.121 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.121 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.121 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.121 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.121 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.121 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:21:58.121 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.121 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.121 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.121 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.121 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.121 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.122 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.122 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.122 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:21:58.122 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.122 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.122 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.122 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.122 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.122 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.122 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.472296+0000", 2024-03-30T12:21:58.122 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.469261+0000", 2024-03-30T12:21:58.122 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.469261+0000", 2024-03-30T12:21:58.122 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.469695+0000", 2024-03-30T12:21:58.122 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.472296+0000", 2024-03-30T12:21:58.122 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.123 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.123 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.123 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.123 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.472296+0000", 2024-03-30T12:21:58.123 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.472296+0000", 2024-03-30T12:21:58.123 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.472296+0000", 2024-03-30T12:21:58.123 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.123 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.123 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.123 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.472296+0000", 2024-03-30T12:21:58.123 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.472296+0000", 2024-03-30T12:21:58.123 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.123 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 2, 2024-03-30T12:21:58.124 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.124 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.124 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.124 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.124 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.124 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.124 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.124 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 2, 2024-03-30T12:21:58.124 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.124 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.124 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.124 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1d", 2024-03-30T12:21:58.124 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.124 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.124 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.125 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 21, 2024-03-30T12:21:58.125 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.125 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-04-01T00:02:43.407908+0000", 2024-03-30T12:21:58.125 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.125 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.125 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.125 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.125 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.125 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.125 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.125 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.125 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.125 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.125 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.126 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.126 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.126 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.126 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.126 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.126 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.126 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.126 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.126 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-03-30T12:21:58.126 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-03-30T12:21:58.126 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.126 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-03-30T12:21:58.126 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.126 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.126 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-03-30T12:21:58.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.127 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 3, 2024-03-30T12:21:58.128 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.128 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.128 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.128 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.128 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.128 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.128 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.128 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.128 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.128 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:21:58.128 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'2" 2024-03-30T12:21:58.129 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.129 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.129 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.129 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.129 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.129 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.129 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.129 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:58.129 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.129 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.129 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.129 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.129 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.129 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.129 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006676+0000", 2024-03-30T12:21:58.130 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.858880+0000", 2024-03-30T12:21:58.130 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.858880+0000", 2024-03-30T12:21:58.130 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.859422+0000", 2024-03-30T12:21:58.130 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006676+0000", 2024-03-30T12:21:58.130 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.130 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.130 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.130 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.130 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006676+0000", 2024-03-30T12:21:58.130 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006676+0000", 2024-03-30T12:21:58.130 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006676+0000", 2024-03-30T12:21:58.130 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.130 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.131 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.131 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006676+0000", 2024-03-30T12:21:58.131 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006676+0000", 2024-03-30T12:21:58.131 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.131 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.131 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.131 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.131 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.131 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.131 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.131 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.131 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.131 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.131 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.132 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.132 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.132 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1c", 2024-03-30T12:21:58.132 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.132 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.132 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.132 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.132 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.132 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T14:28:09.612172+0000", 2024-03-30T12:21:58.132 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.132 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.132 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.132 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.132 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.132 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.133 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.133 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.133 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.133 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.133 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.133 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.133 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.133 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.133 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.133 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.133 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.133 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.133 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.133 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.133 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.134 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.135 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.135 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.135 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.135 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.135 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.135 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.135 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.135 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.135 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.136 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:58.136 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.136 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.136 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.136 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.136 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.136 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.136 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.136 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.136 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:21:58.136 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.136 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.136 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.136 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.136 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.136 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.136 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.472360+0000", 2024-03-30T12:21:58.137 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.467636+0000", 2024-03-30T12:21:58.137 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.467636+0000", 2024-03-30T12:21:58.137 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.467935+0000", 2024-03-30T12:21:58.137 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.472360+0000", 2024-03-30T12:21:58.137 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.137 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.137 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.137 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.137 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.472360+0000", 2024-03-30T12:21:58.137 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.472360+0000", 2024-03-30T12:21:58.137 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.472360+0000", 2024-03-30T12:21:58.137 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.137 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.137 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.137 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.472360+0000", 2024-03-30T12:21:58.137 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.472360+0000", 2024-03-30T12:21:58.137 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.138 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 2, 2024-03-30T12:21:58.138 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.138 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.138 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.138 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.138 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.138 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.138 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.138 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 2, 2024-03-30T12:21:58.138 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.138 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.138 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.138 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1c", 2024-03-30T12:21:58.138 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.138 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.138 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.139 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 21, 2024-03-30T12:21:58.139 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.139 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T16:32:49.599855+0000", 2024-03-30T12:21:58.139 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.139 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.139 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.139 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.139 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.139 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.139 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.139 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.139 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.139 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.139 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-03-30T12:21:58.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-03-30T12:21:58.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-03-30T12:21:58.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-03-30T12:21:58.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.141 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 3, 2024-03-30T12:21:58.142 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.142 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.142 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.142 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.142 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.142 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.142 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.142 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.142 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.142 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:21:58.142 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'2" 2024-03-30T12:21:58.142 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.142 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.142 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.142 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.143 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.143 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.143 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.143 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:58.143 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.143 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.143 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.143 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.143 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.143 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.143 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.241872+0000", 2024-03-30T12:21:58.143 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:20:37.241084+0000", 2024-03-30T12:21:58.143 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:20:37.241084+0000", 2024-03-30T12:21:58.143 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:20:37.241472+0000", 2024-03-30T12:21:58.143 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.241872+0000", 2024-03-30T12:21:58.143 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.144 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.144 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.144 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 68, 2024-03-30T12:21:58.144 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.241872+0000", 2024-03-30T12:21:58.144 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.241872+0000", 2024-03-30T12:21:58.144 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.241872+0000", 2024-03-30T12:21:58.144 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.144 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.144 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.144 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.241872+0000", 2024-03-30T12:21:58.144 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.241872+0000", 2024-03-30T12:21:58.144 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.144 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.144 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.145 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.145 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 67, 2024-03-30T12:21:58.145 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.145 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.145 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.145 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.145 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.145 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.145 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.145 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.145 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1d", 2024-03-30T12:21:58.145 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.146 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.146 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.146 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 27, 2024-03-30T12:21:58.146 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.146 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T18:40:48.055427+0000", 2024-03-30T12:21:58.146 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.146 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.146 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.146 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.146 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.146 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.146 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.146 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.146 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.146 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.149 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.149 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.149 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.149 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.149 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.149 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.149 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.149 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.149 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:58.149 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.149 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.149 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.149 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.150 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.150 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.150 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.150 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.150 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:21:58.150 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.150 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.150 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.150 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.150 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.150 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.150 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.004033+0000", 2024-03-30T12:21:58.150 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.454213+0000", 2024-03-30T12:21:58.150 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.454213+0000", 2024-03-30T12:21:58.150 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.454521+0000", 2024-03-30T12:21:58.150 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.004033+0000", 2024-03-30T12:21:58.151 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.151 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.151 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.151 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.151 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.004033+0000", 2024-03-30T12:21:58.151 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.004033+0000", 2024-03-30T12:21:58.151 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.004033+0000", 2024-03-30T12:21:58.151 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.151 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.151 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.151 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.004033+0000", 2024-03-30T12:21:58.151 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.004033+0000", 2024-03-30T12:21:58.151 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.151 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 1, 2024-03-30T12:21:58.151 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.152 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.152 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.152 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.152 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.152 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.152 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.152 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 1, 2024-03-30T12:21:58.152 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.152 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.152 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.152 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1b", 2024-03-30T12:21:58.152 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.152 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.152 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.152 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 20, 2024-03-30T12:21:58.152 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.152 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T18:27:47.198072+0000", 2024-03-30T12:21:58.153 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.153 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.153 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.153 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.153 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.153 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.153 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.153 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.153 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.153 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.153 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.153 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.153 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.153 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.153 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.154 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.154 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.154 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.154 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.154 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.154 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.154 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.154 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.154 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.154 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.154 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.154 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.154 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.154 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.155 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.156 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.156 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.156 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.156 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.156 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.156 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.156 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.156 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:21:58.156 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'1" 2024-03-30T12:21:58.156 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.156 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.156 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.156 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.156 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.157 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.157 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.157 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-03-30T12:21:58.157 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.157 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.157 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.157 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.157 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.157 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.157 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.598367+0000", 2024-03-30T12:21:58.157 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.860427+0000", 2024-03-30T12:21:58.157 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.860427+0000", 2024-03-30T12:21:58.157 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.860724+0000", 2024-03-30T12:21:58.157 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.598367+0000", 2024-03-30T12:21:58.157 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.158 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.158 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.158 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.158 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.598367+0000", 2024-03-30T12:21:58.158 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.598367+0000", 2024-03-30T12:21:58.158 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.598367+0000", 2024-03-30T12:21:58.158 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.158 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.158 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.158 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.598367+0000", 2024-03-30T12:21:58.158 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.598367+0000", 2024-03-30T12:21:58.158 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.158 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.158 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.158 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.159 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.159 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.159 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.159 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.159 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.159 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.159 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.159 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.159 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.159 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1a", 2024-03-30T12:21:58.159 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.159 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.159 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.159 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.160 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.160 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T13:55:54.757770+0000", 2024-03-30T12:21:58.160 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.160 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.160 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.160 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.160 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.160 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.160 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.160 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.160 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.160 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.160 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.160 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.160 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.161 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.162 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.163 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.163 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.163 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.163 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.163 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.163 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.163 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.163 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.163 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-03-30T12:21:58.163 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.163 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.163 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.163 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.164 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.164 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.164 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.164 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.164 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:21:58.164 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.164 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.164 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.164 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.164 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.164 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.164 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.240452+0000", 2024-03-30T12:21:58.164 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.459740+0000", 2024-03-30T12:21:58.164 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.459740+0000", 2024-03-30T12:21:58.164 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.460150+0000", 2024-03-30T12:21:58.165 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.240452+0000", 2024-03-30T12:21:58.165 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.165 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.165 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.165 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.165 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.240452+0000", 2024-03-30T12:21:58.165 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.240452+0000", 2024-03-30T12:21:58.165 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.240452+0000", 2024-03-30T12:21:58.165 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.165 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.165 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.165 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.240452+0000", 2024-03-30T12:21:58.165 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.240452+0000", 2024-03-30T12:21:58.165 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.165 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 1, 2024-03-30T12:21:58.166 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.166 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.166 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.166 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.166 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.166 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.166 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.166 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 1, 2024-03-30T12:21:58.166 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.166 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.166 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.166 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1a", 2024-03-30T12:21:58.166 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.166 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.166 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.167 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 20, 2024-03-30T12:21:58.167 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.167 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T18:52:40.523467+0000", 2024-03-30T12:21:58.167 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.167 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.167 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.167 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.167 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.167 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.167 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.167 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.167 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.167 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.167 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.167 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.168 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.169 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.170 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.170 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.170 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.170 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.170 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.170 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.170 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.170 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.170 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:21:58.170 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'1" 2024-03-30T12:21:58.170 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.170 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.170 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.170 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.171 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.171 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.171 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.171 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:21:58.171 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.171 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.171 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.171 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.171 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.171 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.171 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.005836+0000", 2024-03-30T12:21:58.171 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.856652+0000", 2024-03-30T12:21:58.171 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.856652+0000", 2024-03-30T12:21:58.171 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.857403+0000", 2024-03-30T12:21:58.171 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.005836+0000", 2024-03-30T12:21:58.171 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.005836+0000", 2024-03-30T12:21:58.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.005836+0000", 2024-03-30T12:21:58.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.005836+0000", 2024-03-30T12:21:58.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.005836+0000", 2024-03-30T12:21:58.172 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.005836+0000", 2024-03-30T12:21:58.172 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.172 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.172 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.172 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.172 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.173 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.173 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.173 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.173 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.173 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.173 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.173 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.173 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.173 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1b", 2024-03-30T12:21:58.173 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.173 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.173 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.173 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.173 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.173 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T16:58:51.932935+0000", 2024-03-30T12:21:58.174 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.174 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.174 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.175 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.176 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.177 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.177 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.177 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.177 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.177 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.177 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.177 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.177 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.177 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.177 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:21:58.177 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.177 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.177 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.177 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.177 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.177 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.177 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.178 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.178 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:21:58.178 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.178 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.178 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.178 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.178 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.178 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.178 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.003877+0000", 2024-03-30T12:21:58.178 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.457947+0000", 2024-03-30T12:21:58.178 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.457947+0000", 2024-03-30T12:21:58.178 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.458253+0000", 2024-03-30T12:21:58.178 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.003877+0000", 2024-03-30T12:21:58.179 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.179 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.179 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.179 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.179 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.003877+0000", 2024-03-30T12:21:58.179 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.003877+0000", 2024-03-30T12:21:58.179 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.003877+0000", 2024-03-30T12:21:58.179 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.179 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.179 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.179 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.003877+0000", 2024-03-30T12:21:58.179 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.003877+0000", 2024-03-30T12:21:58.179 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.180 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.180 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.180 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.180 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.180 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.180 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.180 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.180 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.180 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.180 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.180 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.180 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.180 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.19", 2024-03-30T12:21:58.180 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.180 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.181 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.181 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:21:58.181 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.181 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T18:13:18.864198+0000", 2024-03-30T12:21:58.181 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.181 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.181 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.183 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.184 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.184 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.184 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.184 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.184 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.184 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.184 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.184 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.184 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.184 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.184 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.184 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.184 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.184 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:21:58.185 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.185 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.185 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.185 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.185 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.185 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.185 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.185 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.185 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:21:58.185 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.185 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.185 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.185 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.185 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.186 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.186 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.003676+0000", 2024-03-30T12:21:58.186 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.858922+0000", 2024-03-30T12:21:58.186 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.858922+0000", 2024-03-30T12:21:58.186 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.859188+0000", 2024-03-30T12:21:58.186 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.003676+0000", 2024-03-30T12:21:58.186 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.186 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.186 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.186 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.186 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.003676+0000", 2024-03-30T12:21:58.186 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.003676+0000", 2024-03-30T12:21:58.186 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.003676+0000", 2024-03-30T12:21:58.186 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.187 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.187 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.187 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.003676+0000", 2024-03-30T12:21:58.187 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.003676+0000", 2024-03-30T12:21:58.187 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.187 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.187 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.187 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.187 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.187 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.187 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.187 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.187 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.187 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.187 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.188 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.188 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.188 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.18", 2024-03-30T12:21:58.188 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.188 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.188 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.188 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.188 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.188 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T20:56:16.965191+0000", 2024-03-30T12:21:58.188 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.188 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.188 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.188 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.188 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.191 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.191 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.191 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.191 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.191 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.192 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.192 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.192 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.192 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:21:58.192 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.192 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.192 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.192 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.192 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.192 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.192 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.192 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.192 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:58.192 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.192 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.192 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.193 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.193 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.193 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.193 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006169+0000", 2024-03-30T12:21:58.193 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.466086+0000", 2024-03-30T12:21:58.193 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.466086+0000", 2024-03-30T12:21:58.193 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.466729+0000", 2024-03-30T12:21:58.193 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006169+0000", 2024-03-30T12:21:58.193 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.193 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.193 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.193 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.193 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006169+0000", 2024-03-30T12:21:58.193 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006169+0000", 2024-03-30T12:21:58.193 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006169+0000", 2024-03-30T12:21:58.194 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.194 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.194 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.194 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006169+0000", 2024-03-30T12:21:58.194 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006169+0000", 2024-03-30T12:21:58.194 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.194 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.194 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.194 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.194 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.194 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.194 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.194 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.194 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.194 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.195 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.195 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.195 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.195 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.18", 2024-03-30T12:21:58.195 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.195 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.195 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.195 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:21:58.195 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.195 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T21:46:14.144417+0000", 2024-03-30T12:21:58.195 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.195 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.195 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.195 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.195 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.195 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.197 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.198 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.198 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.198 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.198 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.198 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.198 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.198 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.198 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.198 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.198 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.198 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.198 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.198 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.198 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.198 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:58.199 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.199 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.199 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.199 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.199 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.199 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.199 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:58.199 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.199 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:21:58.199 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.199 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.199 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.199 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.199 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.199 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.200 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006172+0000", 2024-03-30T12:21:58.200 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.861328+0000", 2024-03-30T12:21:58.200 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.861328+0000", 2024-03-30T12:21:58.200 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.863262+0000", 2024-03-30T12:21:58.200 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006172+0000", 2024-03-30T12:21:58.200 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.200 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.200 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.200 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.200 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006172+0000", 2024-03-30T12:21:58.200 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006172+0000", 2024-03-30T12:21:58.200 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006172+0000", 2024-03-30T12:21:58.200 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.200 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.201 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.201 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006172+0000", 2024-03-30T12:21:58.201 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006172+0000", 2024-03-30T12:21:58.201 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.201 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.201 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.201 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.201 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.201 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.201 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.201 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.201 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.201 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.201 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.202 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.202 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.202 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.19", 2024-03-30T12:21:58.202 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.202 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.202 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.202 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.202 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.202 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T21:20:19.049967+0000", 2024-03-30T12:21:58.202 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.202 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.202 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.202 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.202 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.202 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.203 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.204 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.205 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.205 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.205 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.205 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.205 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.205 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.205 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.205 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.205 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.205 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.205 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.205 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.205 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.205 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:58.205 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.206 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:21:58.206 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.206 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.206 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.206 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.206 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.206 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.206 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.206 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.206 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:21:58.206 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.206 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.206 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.206 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.206 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.207 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.207 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.240642+0000", 2024-03-30T12:21:58.207 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.459518+0000", 2024-03-30T12:21:58.207 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.459518+0000", 2024-03-30T12:21:58.207 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.459929+0000", 2024-03-30T12:21:58.207 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.240642+0000", 2024-03-30T12:21:58.207 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.207 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.207 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.207 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.207 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.240642+0000", 2024-03-30T12:21:58.207 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.240642+0000", 2024-03-30T12:21:58.207 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.240642+0000", 2024-03-30T12:21:58.207 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.207 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.208 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.208 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.240642+0000", 2024-03-30T12:21:58.208 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.240642+0000", 2024-03-30T12:21:58.208 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.208 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.208 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.208 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.208 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.208 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.208 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.208 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.208 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.208 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.208 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.208 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.209 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.209 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.17", 2024-03-30T12:21:58.209 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.209 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.209 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.209 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:21:58.209 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.209 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T20:09:03.990119+0000", 2024-03-30T12:21:58.209 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.209 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.209 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.209 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.209 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.209 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.210 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.211 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.212 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.212 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.212 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.212 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.212 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.212 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.212 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.212 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.212 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.212 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.212 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.212 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.212 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.212 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.213 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.213 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:21:58.213 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.213 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.213 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.213 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.213 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.213 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.213 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.213 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.213 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:58.213 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.213 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.213 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.213 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.213 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.214 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.214 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006816+0000", 2024-03-30T12:21:58.214 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.861782+0000", 2024-03-30T12:21:58.214 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.861782+0000", 2024-03-30T12:21:58.214 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.862112+0000", 2024-03-30T12:21:58.214 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006816+0000", 2024-03-30T12:21:58.214 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.214 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.214 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.214 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.214 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006816+0000", 2024-03-30T12:21:58.214 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006816+0000", 2024-03-30T12:21:58.214 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006816+0000", 2024-03-30T12:21:58.214 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.215 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.215 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.215 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006816+0000", 2024-03-30T12:21:58.215 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006816+0000", 2024-03-30T12:21:58.215 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.215 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.215 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.215 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.215 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.215 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.215 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.215 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.215 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.215 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.216 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.216 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.216 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.216 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.16", 2024-03-30T12:21:58.216 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.216 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.216 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.216 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.216 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.216 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-04-01T00:01:42.946530+0000", 2024-03-30T12:21:58.216 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.216 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.216 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.217 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.218 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.219 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.219 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.219 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.219 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.219 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.219 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.219 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.219 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.219 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.219 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.219 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.219 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.219 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.219 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.219 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.219 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.220 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.220 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.220 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.220 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:58.220 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.220 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.220 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.220 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.220 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.220 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.220 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.220 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.220 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:58.220 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.220 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.221 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.221 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.221 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.221 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.221 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006757+0000", 2024-03-30T12:21:58.221 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.462698+0000", 2024-03-30T12:21:58.221 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.462698+0000", 2024-03-30T12:21:58.221 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.463745+0000", 2024-03-30T12:21:58.221 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006757+0000", 2024-03-30T12:21:58.221 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.221 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.221 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.221 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.221 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006757+0000", 2024-03-30T12:21:58.221 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006757+0000", 2024-03-30T12:21:58.221 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006757+0000", 2024-03-30T12:21:58.222 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.222 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.222 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.222 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006757+0000", 2024-03-30T12:21:58.222 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006757+0000", 2024-03-30T12:21:58.222 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.222 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.222 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.222 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.222 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.222 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.222 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.222 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.222 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.223 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.223 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.223 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.223 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.223 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.16", 2024-03-30T12:21:58.223 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.223 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.223 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.223 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:21:58.223 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.223 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T16:09:33.196928+0000", 2024-03-30T12:21:58.223 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.223 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.223 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.225 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.226 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.226 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.226 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.226 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.226 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.226 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.226 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.226 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.226 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.226 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.226 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.226 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.226 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.226 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.226 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.227 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.227 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.227 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:58.227 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.227 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.227 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.227 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.227 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.227 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.227 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:21:58.227 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.227 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-03-30T12:21:58.227 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.227 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.227 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.228 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.228 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.228 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.228 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.009497+0000", 2024-03-30T12:21:58.228 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:20:37.009140+0000", 2024-03-30T12:21:58.228 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:20:37.009140+0000", 2024-03-30T12:21:58.228 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:20:37.009497+0000", 2024-03-30T12:21:58.228 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.009497+0000", 2024-03-30T12:21:58.228 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.228 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.228 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.228 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 68, 2024-03-30T12:21:58.228 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.009497+0000", 2024-03-30T12:21:58.228 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.009497+0000", 2024-03-30T12:21:58.229 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.009497+0000", 2024-03-30T12:21:58.229 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.229 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.229 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.229 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.009497+0000", 2024-03-30T12:21:58.229 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.009497+0000", 2024-03-30T12:21:58.229 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.229 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.229 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.229 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.229 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 67, 2024-03-30T12:21:58.229 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.229 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.229 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.229 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.229 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.230 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.230 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.230 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.230 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.17", 2024-03-30T12:21:58.230 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.230 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.230 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.230 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 11, 2024-03-30T12:21:58.230 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.230 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:28:01.772821+0000", 2024-03-30T12:21:58.230 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.230 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.230 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.232 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.233 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.233 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.233 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.233 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.233 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.233 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.233 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.233 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.233 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.233 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.233 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.233 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.233 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.233 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.233 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.234 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:21:58.234 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.234 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-03-30T12:21:58.234 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.234 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.234 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.234 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.234 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.234 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.234 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.234 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.234 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:21:58.234 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.234 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.234 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.235 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.235 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.235 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.235 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006615+0000", 2024-03-30T12:21:58.235 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.463280+0000", 2024-03-30T12:21:58.235 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.463280+0000", 2024-03-30T12:21:58.235 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.463581+0000", 2024-03-30T12:21:58.235 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006615+0000", 2024-03-30T12:21:58.235 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.235 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.235 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.235 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.235 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006615+0000", 2024-03-30T12:21:58.235 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006615+0000", 2024-03-30T12:21:58.235 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006615+0000", 2024-03-30T12:21:58.235 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.236 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.236 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.236 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006615+0000", 2024-03-30T12:21:58.236 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006615+0000", 2024-03-30T12:21:58.236 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.236 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 3, 2024-03-30T12:21:58.236 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.236 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.236 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.236 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.236 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.236 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.236 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.236 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 3, 2024-03-30T12:21:58.236 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.236 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.237 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.237 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.15", 2024-03-30T12:21:58.237 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.237 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.237 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.237 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 22, 2024-03-30T12:21:58.237 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.237 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T12:38:07.390655+0000", 2024-03-30T12:21:58.237 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.237 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.237 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.237 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 90, 2024-03-30T12:21:58.237 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.237 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.237 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 6, 2024-03-30T12:21:58.238 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 2, 2024-03-30T12:21:58.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 2, 2024-03-30T12:21:58.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-03-30T12:21:58.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.239 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 4, 2024-03-30T12:21:58.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 1 2024-03-30T12:21:58.240 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.240 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.240 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.240 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.240 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.240 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.240 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.240 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.240 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:21:58.240 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'3" 2024-03-30T12:21:58.241 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.241 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.241 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.241 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.241 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.241 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.241 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.241 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-03-30T12:21:58.241 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.241 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.241 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.241 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.241 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.241 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.241 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.598950+0000", 2024-03-30T12:21:58.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.878229+0000", 2024-03-30T12:21:58.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.878229+0000", 2024-03-30T12:21:58.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.878541+0000", 2024-03-30T12:21:58.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.598950+0000", 2024-03-30T12:21:58.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.598950+0000", 2024-03-30T12:21:58.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.598950+0000", 2024-03-30T12:21:58.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.598950+0000", 2024-03-30T12:21:58.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.242 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.598950+0000", 2024-03-30T12:21:58.243 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.598950+0000", 2024-03-30T12:21:58.243 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.243 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.243 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.243 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.243 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.243 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.243 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.243 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.243 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.243 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.243 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.243 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.243 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.243 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.14", 2024-03-30T12:21:58.243 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.243 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.244 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.244 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.244 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.244 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T17:03:18.020146+0000", 2024-03-30T12:21:58.244 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.244 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.244 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.244 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.244 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.244 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.244 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.244 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.244 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.245 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.246 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.247 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.247 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.247 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.247 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.247 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.247 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.247 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.247 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.247 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.247 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.247 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.247 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.247 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.247 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-03-30T12:21:58.247 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.247 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.248 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.248 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.248 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.248 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.248 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:21:58.248 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.248 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:21:58.248 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.248 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.248 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.248 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.248 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.248 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.248 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:21:05.918478+0000", 2024-03-30T12:21:58.248 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.457759+0000", 2024-03-30T12:21:58.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.457759+0000", 2024-03-30T12:21:58.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.458102+0000", 2024-03-30T12:21:58.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:21:05.918478+0000", 2024-03-30T12:21:58.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:21:05.918478+0000", 2024-03-30T12:21:58.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:21:05.918478+0000", 2024-03-30T12:21:58.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:21:05.918478+0000", 2024-03-30T12:21:58.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:21:05.918478+0000", 2024-03-30T12:21:58.249 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:21:05.918478+0000", 2024-03-30T12:21:58.249 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.250 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 12, 2024-03-30T12:21:58.250 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.250 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.250 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.250 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.250 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.250 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.250 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.250 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 12, 2024-03-30T12:21:58.250 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.250 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.250 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.250 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.14", 2024-03-30T12:21:58.250 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.251 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.251 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.251 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 31, 2024-03-30T12:21:58.251 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.251 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T21:23:31.713303+0000", 2024-03-30T12:21:58.251 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.251 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.251 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.251 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 2632, 2024-03-30T12:21:58.251 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.251 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.251 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.251 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.251 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.251 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 12, 2024-03-30T12:21:58.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 4, 2024-03-30T12:21:58.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 4, 2024-03-30T12:21:58.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.252 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-03-30T12:21:58.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.253 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.254 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.254 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.254 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 12, 2024-03-30T12:21:58.254 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 9 2024-03-30T12:21:58.254 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.254 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.254 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.254 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.254 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.254 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.254 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:21:58.254 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.254 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:21:58.255 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "68'12" 2024-03-30T12:21:58.255 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.255 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.255 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.255 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.255 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.255 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:58.255 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.255 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:21:58.255 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.255 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.255 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.255 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.255 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.256 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.472078+0000", 2024-03-30T12:21:58.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.872085+0000", 2024-03-30T12:21:58.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.872085+0000", 2024-03-30T12:21:58.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.872384+0000", 2024-03-30T12:21:58.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.472078+0000", 2024-03-30T12:21:58.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.472078+0000", 2024-03-30T12:21:58.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.472078+0000", 2024-03-30T12:21:58.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.472078+0000", 2024-03-30T12:21:58.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.256 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.257 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.257 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.472078+0000", 2024-03-30T12:21:58.257 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.472078+0000", 2024-03-30T12:21:58.257 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.257 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.257 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.257 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.257 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.257 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.257 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.257 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.257 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.257 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.257 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.258 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.258 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.258 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.15", 2024-03-30T12:21:58.258 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.258 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.258 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.258 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.258 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.258 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T22:47:42.278500+0000", 2024-03-30T12:21:58.258 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.258 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.258 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.258 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.258 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.259 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.260 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.261 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.261 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.261 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.261 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.261 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.261 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.261 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.261 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.261 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.261 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.261 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.261 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.261 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.261 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.261 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:58.261 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.262 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:21:58.262 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.262 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.262 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.262 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.262 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.262 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.262 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:21:58.262 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.262 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:21:58.262 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.262 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.262 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.262 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.263 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.263 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006065+0000", 2024-03-30T12:21:58.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.462637+0000", 2024-03-30T12:21:58.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.462637+0000", 2024-03-30T12:21:58.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.462939+0000", 2024-03-30T12:21:58.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006065+0000", 2024-03-30T12:21:58.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006065+0000", 2024-03-30T12:21:58.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006065+0000", 2024-03-30T12:21:58.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006065+0000", 2024-03-30T12:21:58.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.263 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.264 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.264 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006065+0000", 2024-03-30T12:21:58.264 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006065+0000", 2024-03-30T12:21:58.264 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.264 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 2, 2024-03-30T12:21:58.264 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.264 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.264 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.264 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.264 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.264 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.264 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.264 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 2, 2024-03-30T12:21:58.264 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.265 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.265 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.265 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.13", 2024-03-30T12:21:58.265 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.265 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.265 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.265 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 21, 2024-03-30T12:21:58.265 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.265 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T16:48:59.027106+0000", 2024-03-30T12:21:58.265 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.265 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.265 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 34, 2024-03-30T12:21:58.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 6, 2024-03-30T12:21:58.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 2, 2024-03-30T12:21:58.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 2, 2024-03-30T12:21:58.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-03-30T12:21:58.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.267 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.268 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.268 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.268 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.268 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.268 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.268 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.268 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 3, 2024-03-30T12:21:58.268 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 7 2024-03-30T12:21:58.268 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.268 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.268 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.268 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.268 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.268 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.269 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:21:58.269 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.269 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:21:58.269 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'2" 2024-03-30T12:21:58.269 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.269 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.269 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.269 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.269 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.269 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:21:58.269 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.269 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:21:58.269 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.269 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.269 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.270 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.270 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.270 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.270 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.005712+0000", 2024-03-30T12:21:58.270 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.856544+0000", 2024-03-30T12:21:58.270 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.856544+0000", 2024-03-30T12:21:58.270 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.856865+0000", 2024-03-30T12:21:58.270 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.005712+0000", 2024-03-30T12:21:58.270 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.270 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.270 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.270 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.270 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.005712+0000", 2024-03-30T12:21:58.270 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.005712+0000", 2024-03-30T12:21:58.270 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.005712+0000", 2024-03-30T12:21:58.271 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.271 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.271 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.271 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.005712+0000", 2024-03-30T12:21:58.271 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.005712+0000", 2024-03-30T12:21:58.271 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.271 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.271 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.271 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.271 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.271 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.271 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.271 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.271 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.271 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.272 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.272 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.272 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.272 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.12", 2024-03-30T12:21:58.272 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.272 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.272 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.272 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.272 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.272 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T14:37:39.901012+0000", 2024-03-30T12:21:58.272 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.272 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.272 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.274 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.274 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.274 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.274 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.274 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.274 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.274 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.274 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.274 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.274 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.274 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.274 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.274 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.274 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.275 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.275 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.275 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.275 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.275 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.275 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.275 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.275 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.275 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.275 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.275 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.275 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.275 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.275 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.276 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.276 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.276 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.276 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:21:58.276 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.276 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:21:58.276 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.276 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.276 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.276 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.276 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.276 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.276 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.276 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.277 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:58.277 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.277 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.277 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.277 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.277 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.277 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.277 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006324+0000", 2024-03-30T12:21:58.277 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.465589+0000", 2024-03-30T12:21:58.277 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.465589+0000", 2024-03-30T12:21:58.277 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.465931+0000", 2024-03-30T12:21:58.277 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006324+0000", 2024-03-30T12:21:58.277 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.277 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.277 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.278 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.278 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006324+0000", 2024-03-30T12:21:58.278 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006324+0000", 2024-03-30T12:21:58.278 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006324+0000", 2024-03-30T12:21:58.278 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.278 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.278 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.278 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006324+0000", 2024-03-30T12:21:58.278 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006324+0000", 2024-03-30T12:21:58.278 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.278 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.278 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.278 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.278 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.279 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.279 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.279 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.279 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.279 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.279 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.279 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.279 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.279 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.12", 2024-03-30T12:21:58.279 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.279 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.279 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.279 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:21:58.279 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.279 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T18:02:38.614924+0000", 2024-03-30T12:21:58.279 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.280 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.280 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.281 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.281 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.281 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.281 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.281 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.281 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.281 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.281 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.281 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.281 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.281 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.281 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.281 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.281 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.281 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.282 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.282 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.282 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.282 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.282 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.282 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.282 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.282 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.282 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.282 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.282 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.282 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.282 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.282 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.283 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.283 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.283 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.283 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.283 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.283 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.283 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:58.283 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.283 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.283 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.283 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.283 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.283 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.283 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.283 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.284 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:21:58.284 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.284 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.284 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.284 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.284 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.284 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.284 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.472088+0000", 2024-03-30T12:21:58.284 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.870507+0000", 2024-03-30T12:21:58.284 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.870507+0000", 2024-03-30T12:21:58.284 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.870798+0000", 2024-03-30T12:21:58.284 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.472088+0000", 2024-03-30T12:21:58.284 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.284 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.285 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.285 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.285 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.472088+0000", 2024-03-30T12:21:58.285 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.472088+0000", 2024-03-30T12:21:58.285 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.472088+0000", 2024-03-30T12:21:58.285 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.285 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.285 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.285 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.472088+0000", 2024-03-30T12:21:58.285 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.472088+0000", 2024-03-30T12:21:58.285 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.285 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.285 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.286 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.286 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.286 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.286 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.286 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.286 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.286 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.286 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.286 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.286 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.286 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.13", 2024-03-30T12:21:58.286 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.286 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.286 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.286 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.287 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.287 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T18:25:30.259298+0000", 2024-03-30T12:21:58.287 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.287 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.287 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.289 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.289 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.289 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.289 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.289 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.289 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.289 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.289 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.289 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.289 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.289 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.289 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.289 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.289 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.290 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.290 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.290 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.290 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.290 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.290 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.290 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.290 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.290 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.290 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:21:58.290 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.290 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.290 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.290 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.290 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.291 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.291 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.291 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.291 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:21:58.291 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.291 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.291 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.291 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.291 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.291 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.291 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.240323+0000", 2024-03-30T12:21:58.291 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.454380+0000", 2024-03-30T12:21:58.291 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.454380+0000", 2024-03-30T12:21:58.291 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.454678+0000", 2024-03-30T12:21:58.291 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.240323+0000", 2024-03-30T12:21:58.291 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.292 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.292 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.292 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.292 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.240323+0000", 2024-03-30T12:21:58.292 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.240323+0000", 2024-03-30T12:21:58.292 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.240323+0000", 2024-03-30T12:21:58.292 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.292 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.292 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.292 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.240323+0000", 2024-03-30T12:21:58.292 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.240323+0000", 2024-03-30T12:21:58.292 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.292 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.292 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.292 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.293 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.293 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.293 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.293 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.293 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.293 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.293 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.293 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.293 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.293 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.11", 2024-03-30T12:21:58.293 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.293 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.293 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.293 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:21:58.293 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.293 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:08:24.640327+0000", 2024-03-30T12:21:58.294 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.294 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.294 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.296 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.296 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.296 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.296 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.296 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.296 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.296 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.296 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.296 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.296 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.296 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.296 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.296 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.296 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.296 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.297 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.297 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.297 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.297 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.297 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.297 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.297 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.297 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:21:58.297 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.297 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.297 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.297 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.297 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.297 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.297 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:21:58.298 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.298 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:21:58.298 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.298 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.298 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.298 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.298 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.298 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.298 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.240133+0000", 2024-03-30T12:21:58.298 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.861268+0000", 2024-03-30T12:21:58.298 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.861268+0000", 2024-03-30T12:21:58.298 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.861547+0000", 2024-03-30T12:21:58.298 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.240133+0000", 2024-03-30T12:21:58.298 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.299 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.299 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.299 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.299 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.240133+0000", 2024-03-30T12:21:58.299 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.240133+0000", 2024-03-30T12:21:58.299 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.240133+0000", 2024-03-30T12:21:58.299 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.299 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.299 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.299 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.240133+0000", 2024-03-30T12:21:58.299 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.240133+0000", 2024-03-30T12:21:58.299 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.299 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.299 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.299 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.299 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.300 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.300 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.300 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.300 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.300 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.300 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.300 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.300 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.300 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.10", 2024-03-30T12:21:58.300 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.300 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.300 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.300 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.300 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.300 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T13:28:37.342309+0000", 2024-03-30T12:21:58.301 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.301 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.301 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.303 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.303 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.303 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.303 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.303 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.303 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.303 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.303 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.303 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.303 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.303 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.303 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.303 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.303 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.303 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.304 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.304 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.304 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.304 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.304 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.304 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:21:58.304 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.304 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:21:58.304 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.304 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.304 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.304 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.304 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.304 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.304 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.304 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.304 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-03-30T12:21:58.305 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.305 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.305 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.305 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.305 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.305 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006152+0000", 2024-03-30T12:21:58.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.459790+0000", 2024-03-30T12:21:58.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.459790+0000", 2024-03-30T12:21:58.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.460090+0000", 2024-03-30T12:21:58.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006152+0000", 2024-03-30T12:21:58.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006152+0000", 2024-03-30T12:21:58.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006152+0000", 2024-03-30T12:21:58.306 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006152+0000", 2024-03-30T12:21:58.306 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.306 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.306 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.306 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006152+0000", 2024-03-30T12:21:58.306 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006152+0000", 2024-03-30T12:21:58.306 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.306 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 8, 2024-03-30T12:21:58.306 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.306 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.306 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.306 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.306 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.306 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.306 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.307 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 8, 2024-03-30T12:21:58.307 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.307 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.307 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.307 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.10", 2024-03-30T12:21:58.307 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.307 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.307 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.307 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 27, 2024-03-30T12:21:58.307 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.307 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T20:57:38.860631+0000", 2024-03-30T12:21:58.307 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.307 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.307 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 12, 2024-03-30T12:21:58.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 4, 2024-03-30T12:21:58.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 4, 2024-03-30T12:21:58.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 4, 2024-03-30T12:21:58.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.310 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.310 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.310 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.310 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.310 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.310 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 12, 2024-03-30T12:21:58.310 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.310 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.310 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.310 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.310 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.310 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.310 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.310 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.310 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.310 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-03-30T12:21:58.310 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'8" 2024-03-30T12:21:58.311 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.311 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.311 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.311 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.311 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.311 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.311 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.311 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:21:58.311 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.311 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.311 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.311 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.311 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.311 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.311 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.471853+0000", 2024-03-30T12:21:58.311 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.869750+0000", 2024-03-30T12:21:58.311 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.869750+0000", 2024-03-30T12:21:58.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.870061+0000", 2024-03-30T12:21:58.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.471853+0000", 2024-03-30T12:21:58.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.471853+0000", 2024-03-30T12:21:58.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.471853+0000", 2024-03-30T12:21:58.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.471853+0000", 2024-03-30T12:21:58.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.471853+0000", 2024-03-30T12:21:58.312 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.471853+0000", 2024-03-30T12:21:58.312 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.313 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.313 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.313 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.313 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.313 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.313 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.313 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.313 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.313 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.313 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.313 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.313 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.313 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.11", 2024-03-30T12:21:58.313 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.313 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.314 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.314 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.314 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.314 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T19:03:02.790151+0000", 2024-03-30T12:21:58.314 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.314 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.314 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.314 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.317 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.317 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.317 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.317 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.317 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.317 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.317 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.317 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.317 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.317 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.317 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:21:58.317 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.317 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.317 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.317 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.317 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.318 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.318 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.318 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.318 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-03-30T12:21:58.318 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.318 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.318 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.318 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.318 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.318 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.318 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.599069+0000", 2024-03-30T12:21:58.318 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.460817+0000", 2024-03-30T12:21:58.318 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.460817+0000", 2024-03-30T12:21:58.318 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.461178+0000", 2024-03-30T12:21:58.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.599069+0000", 2024-03-30T12:21:58.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.599069+0000", 2024-03-30T12:21:58.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.599069+0000", 2024-03-30T12:21:58.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.599069+0000", 2024-03-30T12:21:58.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.599069+0000", 2024-03-30T12:21:58.319 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.599069+0000", 2024-03-30T12:21:58.319 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.319 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 1, 2024-03-30T12:21:58.319 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.320 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.320 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.320 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.320 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.320 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.320 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.320 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 1, 2024-03-30T12:21:58.320 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.320 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.320 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.320 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.f", 2024-03-30T12:21:58.320 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.320 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.320 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.321 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 20, 2024-03-30T12:21:58.321 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.321 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T16:30:59.255694+0000", 2024-03-30T12:21:58.321 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.321 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.321 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 22, 2024-03-30T12:21:58.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.321 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-03-30T12:21:58.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-03-30T12:21:58.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-03-30T12:21:58.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.322 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.324 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 1, 2024-03-30T12:21:58.324 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 1 2024-03-30T12:21:58.324 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.324 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.324 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.324 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.324 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.324 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.324 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.324 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.324 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-03-30T12:21:58.324 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'1" 2024-03-30T12:21:58.324 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.324 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.324 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.325 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.325 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.325 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.325 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.325 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:21:58.325 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.325 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.325 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.325 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.325 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.325 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.325 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.472261+0000", 2024-03-30T12:21:58.325 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.871555+0000", 2024-03-30T12:21:58.325 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.871555+0000", 2024-03-30T12:21:58.326 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.871828+0000", 2024-03-30T12:21:58.326 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.472261+0000", 2024-03-30T12:21:58.326 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.326 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.326 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.326 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.326 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.472261+0000", 2024-03-30T12:21:58.326 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.472261+0000", 2024-03-30T12:21:58.326 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.472261+0000", 2024-03-30T12:21:58.326 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.326 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.326 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.326 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.472261+0000", 2024-03-30T12:21:58.326 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.472261+0000", 2024-03-30T12:21:58.326 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.327 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.327 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.327 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.327 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.327 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.327 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.327 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.327 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.327 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.327 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.327 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.327 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.327 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.e", 2024-03-30T12:21:58.327 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.327 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.328 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.328 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.328 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.328 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T20:02:53.212521+0000", 2024-03-30T12:21:58.328 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.328 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.328 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.330 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.331 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.331 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.331 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.331 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.331 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.331 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.331 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.331 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.331 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.331 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.331 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.331 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.331 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:21:58.331 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.331 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.332 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.332 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.332 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.332 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.332 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:58.332 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.332 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:21:58.332 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.332 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.332 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 63, 2024-03-30T12:21:58.332 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.332 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.332 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.332 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006441+0000", 2024-03-30T12:21:58.333 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:35.161426+0000", 2024-03-30T12:21:58.333 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:35.161426+0000", 2024-03-30T12:21:58.333 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:35.161648+0000", 2024-03-30T12:21:58.333 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006441+0000", 2024-03-30T12:21:58.333 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:21:58.333 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.333 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:21:58.333 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 64, 2024-03-30T12:21:58.333 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006441+0000", 2024-03-30T12:21:58.333 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006441+0000", 2024-03-30T12:21:58.333 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006441+0000", 2024-03-30T12:21:58.333 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.333 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.333 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:21:58.333 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006441+0000", 2024-03-30T12:21:58.334 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006441+0000", 2024-03-30T12:21:58.334 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.334 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.334 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.334 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.334 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 63, 2024-03-30T12:21:58.334 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.334 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.334 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.334 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.334 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.334 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.334 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.335 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.335 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.2", 2024-03-30T12:21:58.335 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.335 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.335 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.335 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-03-30T12:21:58.335 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.335 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:05:56.726860+0000", 2024-03-30T12:21:58.335 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.335 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.335 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.337 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.337 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.337 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.337 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.337 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.337 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.337 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.337 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.337 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.337 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.337 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.337 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.337 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.337 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.337 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.338 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.338 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.338 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.338 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.338 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.338 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.338 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.338 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.338 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.338 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.338 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.338 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.338 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.338 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:58.339 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.339 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:21:58.339 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.339 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.339 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.339 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.339 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.339 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.339 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.339 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.339 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:21:58.339 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.339 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.339 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.340 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.340 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.340 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.340 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006346+0000", 2024-03-30T12:21:58.340 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.462429+0000", 2024-03-30T12:21:58.340 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.462429+0000", 2024-03-30T12:21:58.340 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.462709+0000", 2024-03-30T12:21:58.340 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006346+0000", 2024-03-30T12:21:58.340 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.340 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.340 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.340 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.340 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006346+0000", 2024-03-30T12:21:58.340 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006346+0000", 2024-03-30T12:21:58.340 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006346+0000", 2024-03-30T12:21:58.341 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.341 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.341 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.341 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006346+0000", 2024-03-30T12:21:58.341 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006346+0000", 2024-03-30T12:21:58.341 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.341 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.341 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.341 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.341 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.341 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.341 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.341 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.341 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.342 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.342 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.342 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.342 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.342 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.4", 2024-03-30T12:21:58.342 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.342 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.342 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.342 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:21:58.342 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.342 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T19:16:29.579526+0000", 2024-03-30T12:21:58.342 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.342 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.342 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.344 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.344 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.344 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.344 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.344 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.344 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.344 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.344 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.344 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.344 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.344 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.344 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.344 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.344 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.344 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.345 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.345 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.345 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.345 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.345 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.345 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.345 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.345 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.345 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.345 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.345 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.345 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.345 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.346 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.346 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.346 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.346 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.346 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.346 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:21:58.346 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.346 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.346 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.346 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.346 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.346 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.346 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.346 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.347 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:58.347 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.347 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.347 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.347 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.347 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.347 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.347 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006614+0000", 2024-03-30T12:21:58.347 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.853714+0000", 2024-03-30T12:21:58.347 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.853714+0000", 2024-03-30T12:21:58.347 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.854025+0000", 2024-03-30T12:21:58.347 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006614+0000", 2024-03-30T12:21:58.347 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.347 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.347 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.348 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.348 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006614+0000", 2024-03-30T12:21:58.348 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006614+0000", 2024-03-30T12:21:58.348 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006614+0000", 2024-03-30T12:21:58.348 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.348 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.348 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.348 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006614+0000", 2024-03-30T12:21:58.348 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006614+0000", 2024-03-30T12:21:58.348 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.348 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.348 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.348 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.348 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.348 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.349 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.349 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.349 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.349 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.349 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.349 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.349 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.349 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.5", 2024-03-30T12:21:58.349 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.349 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.349 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.349 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.349 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.349 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T22:27:34.498087+0000", 2024-03-30T12:21:58.350 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.350 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.350 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.351 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.351 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.351 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.351 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.351 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.351 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.351 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.351 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.351 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.351 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.351 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.351 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.351 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.351 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.352 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.352 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.352 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.352 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.352 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.352 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.352 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.352 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.352 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.352 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.352 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.352 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.352 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.352 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.353 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.353 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.353 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.353 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.353 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.353 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.353 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.353 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.353 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.353 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:58.353 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.353 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.353 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.354 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.354 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.354 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.354 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:21:58.354 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.354 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:21:58.354 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.354 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.354 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 63, 2024-03-30T12:21:58.354 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.354 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.354 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.354 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006469+0000", 2024-03-30T12:21:58.354 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:35.050880+0000", 2024-03-30T12:21:58.354 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:35.050880+0000", 2024-03-30T12:21:58.355 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:35.051431+0000", 2024-03-30T12:21:58.355 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006469+0000", 2024-03-30T12:21:58.355 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:21:58.355 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.355 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:21:58.355 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 64, 2024-03-30T12:21:58.355 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006469+0000", 2024-03-30T12:21:58.355 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006469+0000", 2024-03-30T12:21:58.355 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006469+0000", 2024-03-30T12:21:58.355 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.355 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.355 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:21:58.355 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006469+0000", 2024-03-30T12:21:58.355 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006469+0000", 2024-03-30T12:21:58.356 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.356 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.356 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.356 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.356 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 63, 2024-03-30T12:21:58.356 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.356 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.356 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.356 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.356 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.356 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.356 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.356 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.356 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.4", 2024-03-30T12:21:58.356 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.357 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.357 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.357 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-03-30T12:21:58.357 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.357 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T22:57:58.075785+0000", 2024-03-30T12:21:58.357 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.357 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.357 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.359 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.359 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.359 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.359 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.359 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.359 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.359 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.359 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.359 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.359 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.359 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.359 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.359 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.359 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.360 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.360 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.360 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.360 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.360 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.360 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.360 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.360 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.360 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.360 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.360 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.360 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.360 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.360 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.360 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.360 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.361 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:21:58.361 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.361 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:21:58.361 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.361 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.361 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.361 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.361 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.361 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.361 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.361 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.361 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:58.361 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.361 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.361 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.362 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.362 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.362 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.362 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006213+0000", 2024-03-30T12:21:58.362 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.457289+0000", 2024-03-30T12:21:58.362 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.457289+0000", 2024-03-30T12:21:58.362 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.457612+0000", 2024-03-30T12:21:58.362 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006213+0000", 2024-03-30T12:21:58.362 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.362 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.362 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.362 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.362 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006213+0000", 2024-03-30T12:21:58.363 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006213+0000", 2024-03-30T12:21:58.363 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006213+0000", 2024-03-30T12:21:58.363 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.363 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.363 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.363 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006213+0000", 2024-03-30T12:21:58.363 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006213+0000", 2024-03-30T12:21:58.363 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.363 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.363 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.363 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.363 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.363 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.363 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.364 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.364 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.364 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.364 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.364 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.364 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.364 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.2", 2024-03-30T12:21:58.364 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.364 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.364 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.364 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:21:58.364 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.364 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T15:16:23.011997+0000", 2024-03-30T12:21:58.364 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.364 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.364 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.367 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.367 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.367 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.367 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.367 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.367 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.367 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.367 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.367 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.367 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.367 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.367 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.367 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.367 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.367 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.368 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.368 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.368 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.368 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.368 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:58.368 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.368 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.368 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.368 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.368 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.368 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.368 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.368 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.368 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-03-30T12:21:58.368 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.369 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.369 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.369 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.369 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.369 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.369 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.598734+0000", 2024-03-30T12:21:58.369 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.865706+0000", 2024-03-30T12:21:58.369 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.865706+0000", 2024-03-30T12:21:58.369 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.866070+0000", 2024-03-30T12:21:58.369 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.598734+0000", 2024-03-30T12:21:58.369 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.369 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.369 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.369 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.369 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.598734+0000", 2024-03-30T12:21:58.370 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.598734+0000", 2024-03-30T12:21:58.370 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.598734+0000", 2024-03-30T12:21:58.370 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.370 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.370 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.370 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.598734+0000", 2024-03-30T12:21:58.370 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.598734+0000", 2024-03-30T12:21:58.370 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.370 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.370 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.370 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.370 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.370 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.370 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.370 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.371 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.371 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.371 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.371 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.371 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.371 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3", 2024-03-30T12:21:58.371 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.371 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.371 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.371 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.371 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.371 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T16:56:01.599580+0000", 2024-03-30T12:21:58.371 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.371 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.371 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.371 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.372 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.372 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.372 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.372 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.372 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.372 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.372 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.372 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.372 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.372 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.372 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.372 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.372 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.372 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.372 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.372 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.374 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.374 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.374 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.374 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.374 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.374 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.374 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.374 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.374 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.374 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.374 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.374 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.374 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.374 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.374 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.375 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.375 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.375 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-03-30T12:21:58.375 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.375 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.375 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.375 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.375 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.375 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.375 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.375 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.375 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:21:58.375 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.375 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.375 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 63, 2024-03-30T12:21:58.375 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.376 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.376 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.376 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.005840+0000", 2024-03-30T12:21:58.376 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:35.162389+0000", 2024-03-30T12:21:58.376 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:35.162389+0000", 2024-03-30T12:21:58.376 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:35.162695+0000", 2024-03-30T12:21:58.376 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.005840+0000", 2024-03-30T12:21:58.376 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:21:58.376 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.376 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:21:58.376 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 64, 2024-03-30T12:21:58.376 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.005840+0000", 2024-03-30T12:21:58.376 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.005840+0000", 2024-03-30T12:21:58.376 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.005840+0000", 2024-03-30T12:21:58.376 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.377 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.377 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:21:58.377 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.005840+0000", 2024-03-30T12:21:58.377 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.005840+0000", 2024-03-30T12:21:58.377 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.377 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.377 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.377 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.377 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 63, 2024-03-30T12:21:58.377 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.377 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.377 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.377 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.377 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.378 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.378 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.378 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.378 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.7", 2024-03-30T12:21:58.378 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.378 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.378 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.378 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-03-30T12:21:58.378 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.378 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T19:20:43.739417+0000", 2024-03-30T12:21:58.378 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.378 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.378 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.378 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.378 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.379 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.379 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.379 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.379 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.379 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.379 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.379 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.379 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.379 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.379 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.379 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.379 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.379 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.379 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.381 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.381 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.381 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.381 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.381 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.381 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.381 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.381 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.381 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.381 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.381 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.381 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.381 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.381 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.381 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.382 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.382 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.382 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:21:58.382 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.382 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.382 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.382 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.382 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.382 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.382 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.382 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.382 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:21:58.382 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.382 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.383 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.383 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.383 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.383 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.383 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.005687+0000", 2024-03-30T12:21:58.383 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.860645+0000", 2024-03-30T12:21:58.383 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.860645+0000", 2024-03-30T12:21:58.383 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.861917+0000", 2024-03-30T12:21:58.383 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.005687+0000", 2024-03-30T12:21:58.383 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.383 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.383 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.383 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.383 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.005687+0000", 2024-03-30T12:21:58.383 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.005687+0000", 2024-03-30T12:21:58.383 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.005687+0000", 2024-03-30T12:21:58.384 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.384 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.384 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.384 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.005687+0000", 2024-03-30T12:21:58.384 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.005687+0000", 2024-03-30T12:21:58.384 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.384 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.384 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.384 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.384 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.384 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.384 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.384 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.384 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.384 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.384 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.385 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.385 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.385 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.0", 2024-03-30T12:21:58.385 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.385 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.385 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.385 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.385 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.385 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T15:30:51.438018+0000", 2024-03-30T12:21:58.385 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.385 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.385 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.385 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.385 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.385 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.385 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.386 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.386 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.386 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.386 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.386 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.386 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.386 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.386 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.386 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.386 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.386 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.386 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.386 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.386 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.386 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.387 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.387 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.387 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.387 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.387 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.387 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.387 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.387 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.387 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.387 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.387 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.387 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.387 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.387 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.387 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.388 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.388 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.388 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.388 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.388 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.388 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.388 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.388 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.388 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.388 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.388 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.388 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.388 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.388 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.388 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:21:58.389 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.389 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.389 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.389 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.389 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.389 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.389 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.389 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.389 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-03-30T12:21:58.389 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.389 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.389 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.389 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.389 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.389 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.389 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.007628+0000", 2024-03-30T12:21:58.389 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.457819+0000", 2024-03-30T12:21:58.390 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.457819+0000", 2024-03-30T12:21:58.390 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.459145+0000", 2024-03-30T12:21:58.390 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.007628+0000", 2024-03-30T12:21:58.390 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.390 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.390 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.390 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.390 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.007628+0000", 2024-03-30T12:21:58.390 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.007628+0000", 2024-03-30T12:21:58.390 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.007628+0000", 2024-03-30T12:21:58.390 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.390 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.390 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.390 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.007628+0000", 2024-03-30T12:21:58.390 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.007628+0000", 2024-03-30T12:21:58.391 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.391 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.391 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.391 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.391 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.391 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.391 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.391 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.391 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.391 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.391 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.391 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.391 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.391 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1", 2024-03-30T12:21:58.391 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.392 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.392 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.392 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:21:58.392 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.392 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T17:44:38.245366+0000", 2024-03-30T12:21:58.392 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.392 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.392 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.392 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.392 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.392 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.392 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.392 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.392 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.393 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.393 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.393 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.393 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.393 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.393 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.393 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.393 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.393 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.393 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.393 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.393 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.393 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.393 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.393 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.393 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.393 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.394 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.394 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.394 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.394 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.394 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.394 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.394 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.394 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.394 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.394 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.394 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.394 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.394 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.394 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.395 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.395 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.395 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.395 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.395 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.395 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.395 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.395 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.395 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.395 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.395 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.395 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-03-30T12:21:58.395 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.395 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.395 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.395 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.396 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.396 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.396 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.396 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.396 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:21:58.396 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.396 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.396 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 63, 2024-03-30T12:21:58.396 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.396 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.396 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.396 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.240291+0000", 2024-03-30T12:21:58.396 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:35.160985+0000", 2024-03-30T12:21:58.396 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:35.160985+0000", 2024-03-30T12:21:58.396 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:35.161274+0000", 2024-03-30T12:21:58.396 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.240291+0000", 2024-03-30T12:21:58.397 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:21:58.397 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.397 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:21:58.397 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 64, 2024-03-30T12:21:58.397 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.240291+0000", 2024-03-30T12:21:58.397 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.240291+0000", 2024-03-30T12:21:58.397 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.240291+0000", 2024-03-30T12:21:58.397 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.397 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.397 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:21:58.397 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.240291+0000", 2024-03-30T12:21:58.397 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.240291+0000", 2024-03-30T12:21:58.397 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.397 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.397 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.397 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.398 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 63, 2024-03-30T12:21:58.398 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.398 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.398 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.398 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.398 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.398 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.398 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.398 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.398 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.5", 2024-03-30T12:21:58.398 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.398 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.398 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.398 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-03-30T12:21:58.398 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.399 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T19:12:07.499529+0000", 2024-03-30T12:21:58.399 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.399 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.399 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.399 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.399 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.399 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.399 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.399 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.399 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.399 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.399 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.399 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.399 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.399 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.401 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.401 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.401 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.401 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.401 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.401 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.401 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.401 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.401 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.401 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.401 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.401 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.401 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.401 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.401 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.402 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.402 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.402 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.402 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.402 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.402 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.402 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.402 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:21:58.402 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.402 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.402 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.402 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.402 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.402 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.402 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.403 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.403 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:21:58.403 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.403 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.403 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.403 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.403 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.403 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.403 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.004086+0000", 2024-03-30T12:21:58.403 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.861413+0000", 2024-03-30T12:21:58.403 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.861413+0000", 2024-03-30T12:21:58.403 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.862340+0000", 2024-03-30T12:21:58.403 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.004086+0000", 2024-03-30T12:21:58.403 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.403 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.403 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.404 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.404 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.004086+0000", 2024-03-30T12:21:58.404 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.004086+0000", 2024-03-30T12:21:58.404 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.004086+0000", 2024-03-30T12:21:58.404 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.404 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.404 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.404 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.004086+0000", 2024-03-30T12:21:58.404 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.004086+0000", 2024-03-30T12:21:58.404 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.404 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.404 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.404 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.404 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.404 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.405 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.405 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.405 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.405 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.405 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.405 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.405 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.405 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2", 2024-03-30T12:21:58.405 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.405 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.405 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.405 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.405 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.405 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T22:13:39.199499+0000", 2024-03-30T12:21:58.405 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.405 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.406 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.406 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.406 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.406 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.406 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.406 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.406 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.406 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.406 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.406 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.406 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.406 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.406 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.406 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.406 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.407 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.407 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.407 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.407 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.407 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.407 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.407 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.407 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.407 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.407 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.407 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.407 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.407 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.407 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.407 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.408 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.408 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.408 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.408 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.408 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.408 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.408 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.408 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.408 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.408 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.408 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.408 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.408 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.408 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.408 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.409 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.409 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.409 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.409 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.409 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:21:58.409 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.409 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.409 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.409 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.409 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.409 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.409 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.409 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.409 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:58.409 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.409 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.410 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.410 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.410 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.410 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.410 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006241+0000", 2024-03-30T12:21:58.410 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.465618+0000", 2024-03-30T12:21:58.410 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.465618+0000", 2024-03-30T12:21:58.410 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.465946+0000", 2024-03-30T12:21:58.410 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006241+0000", 2024-03-30T12:21:58.410 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.410 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.410 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.410 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.410 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006241+0000", 2024-03-30T12:21:58.411 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006241+0000", 2024-03-30T12:21:58.411 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006241+0000", 2024-03-30T12:21:58.411 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.411 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.411 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.411 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006241+0000", 2024-03-30T12:21:58.411 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006241+0000", 2024-03-30T12:21:58.411 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.411 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.411 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.411 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.411 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.411 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.411 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.411 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.412 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.412 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.412 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.412 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.412 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.412 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.3", 2024-03-30T12:21:58.412 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.412 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.412 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.412 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:21:58.412 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.412 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T15:58:42.109572+0000", 2024-03-30T12:21:58.412 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.412 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.412 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.413 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.413 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.413 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.413 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.413 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.413 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.413 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.413 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.413 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.413 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.413 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.413 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.413 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.413 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.413 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.413 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.414 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.414 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.414 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.414 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.414 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.414 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.414 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.414 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.414 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.414 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.414 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.414 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.414 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.414 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.415 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.415 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.415 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.415 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.415 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.415 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.415 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.415 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.415 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.415 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.415 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.415 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.415 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.415 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.415 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.415 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.416 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.416 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.416 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:58.416 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.416 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.416 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.416 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.416 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.416 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.416 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.416 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.416 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:21:58.416 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.416 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.416 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 19, 2024-03-30T12:21:58.417 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.417 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.417 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.417 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.472019+0000", 2024-03-30T12:21:58.417 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:18:45.912395+0000", 2024-03-30T12:21:58.417 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:18:45.912395+0000", 2024-03-30T12:21:58.417 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:18:45.912869+0000", 2024-03-30T12:21:58.417 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.472019+0000", 2024-03-30T12:21:58.417 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:16:43.434559+0000", 2024-03-30T12:21:58.417 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.417 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:16:43.434559+0000", 2024-03-30T12:21:58.417 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-03-30T12:21:58.417 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.472019+0000", 2024-03-30T12:21:58.417 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.472019+0000", 2024-03-30T12:21:58.418 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.472019+0000", 2024-03-30T12:21:58.418 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.418 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.418 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:16:43.434559+0000", 2024-03-30T12:21:58.418 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.472019+0000", 2024-03-30T12:21:58.418 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.472019+0000", 2024-03-30T12:21:58.418 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.418 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 128, 2024-03-30T12:21:58.418 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.418 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.418 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-03-30T12:21:58.418 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.418 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.418 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.418 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.419 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 128, 2024-03-30T12:21:58.419 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.419 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.419 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.419 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "1.0", 2024-03-30T12:21:58.419 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.419 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.419 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.419 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 266, 2024-03-30T12:21:58.419 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.419 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T21:48:34.485283+0000", 2024-03-30T12:21:58.419 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.419 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.419 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.419 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 590368, 2024-03-30T12:21:58.420 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.420 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 1771104, 2024-03-30T12:21:58.420 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.420 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.420 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.420 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.420 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.420 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.420 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.420 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.420 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.420 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.420 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.420 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.420 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.421 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 6, 2024-03-30T12:21:58.421 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 2, 2024-03-30T12:21:58.421 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.421 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 2, 2024-03-30T12:21:58.421 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.421 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.421 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.421 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.421 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.421 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.421 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.421 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 6, 2024-03-30T12:21:58.421 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.421 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.422 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.422 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.422 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.422 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 212, 2024-03-30T12:21:58.422 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 306, 2024-03-30T12:21:58.422 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.422 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.422 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.422 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 179, 2024-03-30T12:21:58.422 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 2416 2024-03-30T12:21:58.422 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.422 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.422 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.422 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.423 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.423 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.423 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.423 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.423 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:21:58.423 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "66'128" 2024-03-30T12:21:58.423 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.423 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.423 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.423 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.423 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.423 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.423 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.423 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:21:58.423 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.424 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.424 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 63, 2024-03-30T12:21:58.424 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.424 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.424 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.424 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006927+0000", 2024-03-30T12:21:58.424 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:35.051577+0000", 2024-03-30T12:21:58.424 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:35.051577+0000", 2024-03-30T12:21:58.424 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:35.052180+0000", 2024-03-30T12:21:58.424 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006927+0000", 2024-03-30T12:21:58.424 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:21:58.424 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.424 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:21:58.424 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 64, 2024-03-30T12:21:58.424 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006927+0000", 2024-03-30T12:21:58.425 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006927+0000", 2024-03-30T12:21:58.425 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006927+0000", 2024-03-30T12:21:58.425 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.425 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.425 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:21:58.425 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006927+0000", 2024-03-30T12:21:58.425 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006927+0000", 2024-03-30T12:21:58.425 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.425 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.425 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.425 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.425 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 63, 2024-03-30T12:21:58.425 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.425 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.425 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.426 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.426 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.426 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.426 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.426 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.426 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.6", 2024-03-30T12:21:58.426 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.426 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.426 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.426 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-03-30T12:21:58.426 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.426 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T17:26:43.695424+0000", 2024-03-30T12:21:58.426 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.426 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.427 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.427 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.427 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.427 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.427 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.427 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.427 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.427 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.427 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.427 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.427 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.427 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.427 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.427 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.427 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.429 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.429 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.429 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.430 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.430 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.430 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.430 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.430 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.430 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:21:58.430 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.430 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.430 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.430 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.430 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.430 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.430 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:21:58.430 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.431 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:21:58.431 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.431 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.431 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.431 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.431 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.431 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.431 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.005553+0000", 2024-03-30T12:21:58.431 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.852216+0000", 2024-03-30T12:21:58.431 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.852216+0000", 2024-03-30T12:21:58.431 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.852506+0000", 2024-03-30T12:21:58.431 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.005553+0000", 2024-03-30T12:21:58.431 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.431 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.431 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.432 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.432 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.005553+0000", 2024-03-30T12:21:58.432 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.005553+0000", 2024-03-30T12:21:58.432 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.005553+0000", 2024-03-30T12:21:58.432 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.432 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.432 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.432 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.005553+0000", 2024-03-30T12:21:58.432 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.005553+0000", 2024-03-30T12:21:58.432 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.432 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.432 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.432 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.432 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.432 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.433 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.433 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.433 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.433 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.433 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.433 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.433 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.433 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1", 2024-03-30T12:21:58.433 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.433 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.433 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.433 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.433 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.433 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T20:41:21.462303+0000", 2024-03-30T12:21:58.433 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.434 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.434 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.434 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.434 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.434 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.434 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.434 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.434 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.434 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.434 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.434 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.434 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.434 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.434 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.435 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.435 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.435 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.435 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.435 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.435 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.435 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.435 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.435 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.435 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.435 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.435 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.435 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.435 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.435 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.436 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.436 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.436 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.436 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.436 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.436 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.436 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.436 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.436 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.436 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.436 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.436 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.436 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.436 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.436 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.437 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.437 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.437 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.437 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.437 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:21:58.437 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.437 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:21:58.437 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.437 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.437 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.437 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.437 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.437 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.437 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.437 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.437 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:21:58.438 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.438 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.438 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.438 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.438 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.438 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.438 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.471481+0000", 2024-03-30T12:21:58.438 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.469541+0000", 2024-03-30T12:21:58.438 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.469541+0000", 2024-03-30T12:21:58.438 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.470266+0000", 2024-03-30T12:21:58.438 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.471481+0000", 2024-03-30T12:21:58.438 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.438 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.438 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.439 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.439 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.471481+0000", 2024-03-30T12:21:58.439 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.471481+0000", 2024-03-30T12:21:58.439 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.471481+0000", 2024-03-30T12:21:58.439 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.439 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.439 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.439 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.471481+0000", 2024-03-30T12:21:58.439 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.471481+0000", 2024-03-30T12:21:58.439 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.439 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.439 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.439 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.439 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.439 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.439 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.440 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.440 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.440 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.440 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.440 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.440 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.440 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.0", 2024-03-30T12:21:58.440 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.440 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.440 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.440 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:21:58.440 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.440 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:24:57.244620+0000", 2024-03-30T12:21:58.440 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.440 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.441 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.441 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.441 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.441 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.441 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.441 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.441 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.441 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.441 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.441 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.441 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.441 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.441 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.441 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.441 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.442 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.442 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.442 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.442 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.442 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.442 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.442 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.442 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.442 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.442 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.442 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.442 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.442 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.442 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.442 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.443 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.443 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.443 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.443 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.443 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.443 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.443 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.443 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.443 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.443 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.443 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.443 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.443 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.443 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.443 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.444 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.444 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.444 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.444 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.444 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:21:58.444 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.444 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.444 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.444 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.444 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.444 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.444 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.444 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.444 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:21:58.444 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.445 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.445 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 63, 2024-03-30T12:21:58.445 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.445 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.445 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.445 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.005793+0000", 2024-03-30T12:21:58.445 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:35.162514+0000", 2024-03-30T12:21:58.445 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:35.162514+0000", 2024-03-30T12:21:58.445 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:35.162977+0000", 2024-03-30T12:21:58.445 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.005793+0000", 2024-03-30T12:21:58.445 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:21:58.445 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.445 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:21:58.445 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 64, 2024-03-30T12:21:58.445 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.005793+0000", 2024-03-30T12:21:58.445 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.005793+0000", 2024-03-30T12:21:58.446 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.005793+0000", 2024-03-30T12:21:58.446 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.446 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.446 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:21:58.446 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.005793+0000", 2024-03-30T12:21:58.446 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.005793+0000", 2024-03-30T12:21:58.446 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.446 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.446 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.446 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.446 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 63, 2024-03-30T12:21:58.446 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.446 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.446 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.447 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.447 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.447 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.447 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.447 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.447 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.3", 2024-03-30T12:21:58.447 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.447 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.447 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.447 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-03-30T12:21:58.447 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.447 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T18:39:43.550849+0000", 2024-03-30T12:21:58.447 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.447 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.447 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.448 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.448 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.448 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.448 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.448 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.448 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.448 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.448 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.448 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.448 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.448 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.448 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.448 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.448 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.448 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.448 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.449 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.449 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.449 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.449 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.449 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.449 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.449 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.449 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.449 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.449 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.449 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.449 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.449 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.449 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.449 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.450 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.450 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.450 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.450 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.450 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.450 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.450 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.450 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.450 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.450 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.450 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.450 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.450 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.450 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.451 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.451 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.451 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.451 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:21:58.451 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.451 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.451 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.451 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.451 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.451 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.451 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:58.451 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.451 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:21:58.451 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.451 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.451 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.452 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.452 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.452 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.452 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.472179+0000", 2024-03-30T12:21:58.452 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.469218+0000", 2024-03-30T12:21:58.452 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.469218+0000", 2024-03-30T12:21:58.452 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.469567+0000", 2024-03-30T12:21:58.452 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.472179+0000", 2024-03-30T12:21:58.452 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.452 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.452 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.452 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.452 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.472179+0000", 2024-03-30T12:21:58.452 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.472179+0000", 2024-03-30T12:21:58.452 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.472179+0000", 2024-03-30T12:21:58.453 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.453 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.453 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.453 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.472179+0000", 2024-03-30T12:21:58.453 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.472179+0000", 2024-03-30T12:21:58.453 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.453 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.453 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.453 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.453 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.453 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.453 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.453 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.453 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.453 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.453 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.454 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.454 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.454 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.5", 2024-03-30T12:21:58.454 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.454 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.454 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.454 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:21:58.454 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.454 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:16:05.609865+0000", 2024-03-30T12:21:58.454 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.454 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.454 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.454 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.454 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.454 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.455 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.455 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.455 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.455 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.455 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.455 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.455 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.455 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.455 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.455 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.455 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.455 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.455 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.455 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.455 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.456 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.456 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.456 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.456 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.456 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.456 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.456 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.456 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.456 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.456 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.456 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.456 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.456 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.456 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.456 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.457 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.457 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.457 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.457 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.457 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.457 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.457 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.457 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.457 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.457 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.457 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.457 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.457 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.457 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:58.457 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.458 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:21:58.458 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.458 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.458 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.458 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.458 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.458 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.458 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:21:58.458 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.458 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:21:58.458 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.458 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.458 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.458 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.458 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.459 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.459 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006792+0000", 2024-03-30T12:21:58.459 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.865518+0000", 2024-03-30T12:21:58.459 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.865518+0000", 2024-03-30T12:21:58.459 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.865798+0000", 2024-03-30T12:21:58.459 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006792+0000", 2024-03-30T12:21:58.459 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.459 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.459 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.459 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.459 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006792+0000", 2024-03-30T12:21:58.459 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006792+0000", 2024-03-30T12:21:58.459 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006792+0000", 2024-03-30T12:21:58.459 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.459 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.460 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.460 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006792+0000", 2024-03-30T12:21:58.460 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006792+0000", 2024-03-30T12:21:58.460 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.460 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.460 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.460 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.460 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.460 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.460 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.460 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.460 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.460 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.460 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.460 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.460 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.461 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.4", 2024-03-30T12:21:58.461 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.461 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.461 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.461 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.461 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.461 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T18:47:41.818140+0000", 2024-03-30T12:21:58.461 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.461 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.461 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.461 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.461 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.461 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.461 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.461 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.463 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.463 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.463 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.463 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.463 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.463 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.463 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.463 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.463 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.463 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.463 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.463 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.463 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.463 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.463 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.464 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.464 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.464 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.464 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.464 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.464 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.464 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.464 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.464 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.464 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.464 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.464 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:21:58.464 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.464 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:21:58.464 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.465 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.465 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.465 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.465 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.465 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.465 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.465 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.465 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:21:58.465 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.465 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.465 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 63, 2024-03-30T12:21:58.465 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.465 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.465 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.465 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.003500+0000", 2024-03-30T12:21:58.465 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:35.162480+0000", 2024-03-30T12:21:58.466 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:35.162480+0000", 2024-03-30T12:21:58.466 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:35.162768+0000", 2024-03-30T12:21:58.466 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.003500+0000", 2024-03-30T12:21:58.466 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:21:58.466 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.466 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:21:58.466 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 64, 2024-03-30T12:21:58.466 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.003500+0000", 2024-03-30T12:21:58.466 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.003500+0000", 2024-03-30T12:21:58.466 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.003500+0000", 2024-03-30T12:21:58.466 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.466 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.466 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:21:58.466 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.003500+0000", 2024-03-30T12:21:58.466 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.003500+0000", 2024-03-30T12:21:58.467 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.467 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.467 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.467 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.467 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 63, 2024-03-30T12:21:58.467 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.467 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.467 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.467 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.467 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.467 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.467 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.467 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.467 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.0", 2024-03-30T12:21:58.467 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.468 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.468 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.468 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-03-30T12:21:58.468 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.468 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T15:17:01.235481+0000", 2024-03-30T12:21:58.468 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.468 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.468 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.468 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.468 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.468 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.468 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.468 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.468 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.468 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.468 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.469 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.469 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.469 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.469 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.469 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.469 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.469 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.469 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.469 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.469 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.469 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.469 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.469 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.469 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.469 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.469 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.470 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.470 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.470 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.470 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.470 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.470 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.470 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.470 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.470 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.470 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.470 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.470 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.470 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.470 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.471 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.471 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.471 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.471 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.471 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.471 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.471 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.471 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.471 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.471 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.471 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:21:58.471 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.471 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.471 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.471 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.472 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.472 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.472 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:58.472 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.472 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:21:58.472 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.472 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.472 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.472 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.472 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.472 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.472 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006687+0000", 2024-03-30T12:21:58.472 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.454233+0000", 2024-03-30T12:21:58.472 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.454233+0000", 2024-03-30T12:21:58.473 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.454554+0000", 2024-03-30T12:21:58.473 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006687+0000", 2024-03-30T12:21:58.473 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.473 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.473 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.473 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.473 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006687+0000", 2024-03-30T12:21:58.473 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006687+0000", 2024-03-30T12:21:58.473 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006687+0000", 2024-03-30T12:21:58.473 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.473 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.473 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.473 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006687+0000", 2024-03-30T12:21:58.473 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006687+0000", 2024-03-30T12:21:58.473 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.474 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 1, 2024-03-30T12:21:58.474 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.474 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.474 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.474 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.474 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.474 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.474 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.474 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 1, 2024-03-30T12:21:58.474 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.474 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.474 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.474 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.6", 2024-03-30T12:21:58.474 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.474 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.475 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.475 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 20, 2024-03-30T12:21:58.475 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.475 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:05:09.010127+0000", 2024-03-30T12:21:58.475 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.475 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.475 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.475 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.475 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.475 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.475 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.475 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.475 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.475 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.476 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.476 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.476 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.476 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.476 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.476 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.476 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.476 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.476 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.476 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-03-30T12:21:58.476 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-03-30T12:21:58.476 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.476 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-03-30T12:21:58.476 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.476 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-03-30T12:21:58.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.478 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 1, 2024-03-30T12:21:58.478 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.478 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.478 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.478 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.478 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.478 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.478 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.478 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:58.478 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.478 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:21:58.478 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "62'1" 2024-03-30T12:21:58.478 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.478 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.479 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.479 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.479 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.479 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.479 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.479 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:21:58.479 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.479 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.479 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.479 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.479 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.479 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.479 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.004566+0000", 2024-03-30T12:21:58.479 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.853538+0000", 2024-03-30T12:21:58.479 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.853538+0000", 2024-03-30T12:21:58.479 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.853806+0000", 2024-03-30T12:21:58.480 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.004566+0000", 2024-03-30T12:21:58.480 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.480 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.480 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.480 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.480 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.004566+0000", 2024-03-30T12:21:58.480 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.004566+0000", 2024-03-30T12:21:58.480 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.004566+0000", 2024-03-30T12:21:58.480 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.480 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.480 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.480 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.004566+0000", 2024-03-30T12:21:58.480 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.004566+0000", 2024-03-30T12:21:58.480 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.480 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.481 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.481 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.481 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.481 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.481 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.481 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.481 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.481 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.481 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.481 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.481 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.481 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.7", 2024-03-30T12:21:58.481 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.481 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.481 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.481 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.482 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.482 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T15:36:10.741436+0000", 2024-03-30T12:21:58.482 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.482 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.482 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.482 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.482 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.482 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.482 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.482 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.482 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.482 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.482 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.482 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.482 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.483 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.483 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.483 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.483 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.483 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.483 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.483 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.483 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.483 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.483 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.483 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.483 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.483 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.483 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.484 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.484 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.484 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.484 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.484 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.484 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.484 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.484 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.484 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.484 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.484 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.484 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.484 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.484 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.484 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.485 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.485 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.485 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.485 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.485 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.485 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.485 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.485 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.485 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.485 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:21:58.485 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.485 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.485 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.485 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.485 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.486 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.486 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.486 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.486 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-03-30T12:21:58.486 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.486 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.486 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 63, 2024-03-30T12:21:58.486 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.486 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.486 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.486 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.598155+0000", 2024-03-30T12:21:58.486 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:35.162347+0000", 2024-03-30T12:21:58.486 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:35.162347+0000", 2024-03-30T12:21:58.486 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:35.162679+0000", 2024-03-30T12:21:58.486 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.598155+0000", 2024-03-30T12:21:58.487 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:21:58.487 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.487 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:21:58.487 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 64, 2024-03-30T12:21:58.487 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.598155+0000", 2024-03-30T12:21:58.487 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.598155+0000", 2024-03-30T12:21:58.487 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.598155+0000", 2024-03-30T12:21:58.487 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.487 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.487 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:21:58.487 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.598155+0000", 2024-03-30T12:21:58.487 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.598155+0000", 2024-03-30T12:21:58.487 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.487 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.487 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.488 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.488 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 63, 2024-03-30T12:21:58.488 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.488 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.488 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.488 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.488 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.488 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.488 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.488 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.488 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.1", 2024-03-30T12:21:58.488 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.488 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.488 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.488 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-03-30T12:21:58.489 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.489 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T12:24:16.565563+0000", 2024-03-30T12:21:58.489 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.489 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.489 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.489 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.489 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.489 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.489 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.489 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.489 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.489 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.489 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.489 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.489 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.490 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.490 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.490 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.490 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.490 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.490 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.490 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.490 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.490 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.490 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.490 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.490 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.490 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.490 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.491 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.491 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.491 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.491 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.491 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.491 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.491 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.491 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.491 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.491 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.491 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.491 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.491 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.491 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.491 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.491 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.492 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.492 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.492 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.492 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.492 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.492 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.492 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.492 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.492 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-03-30T12:21:58.492 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.492 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.492 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.492 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.492 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.493 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.493 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.493 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.493 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:21:58.493 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.493 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.493 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.493 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.493 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.493 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.493 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.240550+0000", 2024-03-30T12:21:58.493 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.459948+0000", 2024-03-30T12:21:58.493 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.459948+0000", 2024-03-30T12:21:58.493 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.460279+0000", 2024-03-30T12:21:58.493 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.240550+0000", 2024-03-30T12:21:58.494 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.494 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.494 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.494 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.494 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.240550+0000", 2024-03-30T12:21:58.494 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.240550+0000", 2024-03-30T12:21:58.494 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.240550+0000", 2024-03-30T12:21:58.494 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.494 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.494 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.494 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.240550+0000", 2024-03-30T12:21:58.494 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.240550+0000", 2024-03-30T12:21:58.494 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.494 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 2, 2024-03-30T12:21:58.494 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.495 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.495 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.495 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.495 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.495 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.495 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.495 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 2, 2024-03-30T12:21:58.495 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.495 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.495 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.495 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.7", 2024-03-30T12:21:58.495 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.495 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.495 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.495 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 21, 2024-03-30T12:21:58.495 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.496 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T15:37:06.870147+0000", 2024-03-30T12:21:58.496 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.496 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.496 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.496 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.496 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.496 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.496 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.496 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.496 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.496 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.496 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.496 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.496 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.496 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.497 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.497 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.497 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.497 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.497 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.497 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-03-30T12:21:58.497 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-03-30T12:21:58.497 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.497 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-03-30T12:21:58.497 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.497 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.497 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.497 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.497 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.497 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-03-30T12:21:58.497 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.498 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.498 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.498 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.498 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.498 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.498 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.498 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.498 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.498 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.498 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.498 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.498 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 3, 2024-03-30T12:21:58.498 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.498 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.499 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.499 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.499 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.499 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.499 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.499 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.499 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.499 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:21:58.499 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'2" 2024-03-30T12:21:58.499 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.499 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.499 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.499 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.499 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.499 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:58.500 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.500 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:21:58.500 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.500 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.500 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.500 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.500 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.500 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.500 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.007313+0000", 2024-03-30T12:21:58.500 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.852755+0000", 2024-03-30T12:21:58.500 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.852755+0000", 2024-03-30T12:21:58.500 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.853029+0000", 2024-03-30T12:21:58.500 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.007313+0000", 2024-03-30T12:21:58.500 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.500 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.500 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.501 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.501 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.007313+0000", 2024-03-30T12:21:58.501 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.007313+0000", 2024-03-30T12:21:58.501 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.007313+0000", 2024-03-30T12:21:58.501 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.501 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.501 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.501 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.007313+0000", 2024-03-30T12:21:58.501 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.007313+0000", 2024-03-30T12:21:58.501 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.501 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.501 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.501 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.501 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.501 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.502 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.502 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.502 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.502 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.502 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.502 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.502 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.502 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.6", 2024-03-30T12:21:58.502 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.502 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.502 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.502 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.502 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.502 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T21:03:44.655099+0000", 2024-03-30T12:21:58.503 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.503 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.503 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.503 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.503 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.503 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.503 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.503 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.503 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.503 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.503 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.503 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.503 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.503 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.503 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.504 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.504 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.504 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.504 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.504 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.504 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.504 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.504 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.504 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.504 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.504 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.504 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.504 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.504 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.504 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.505 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.505 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.505 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.505 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.505 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.505 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.505 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.505 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.505 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.505 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.505 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.505 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.505 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.505 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.505 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.505 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.506 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.506 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.506 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.506 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:58.506 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.506 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:21:58.506 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.506 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.506 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.506 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.506 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.506 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.506 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.506 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.507 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:21:58.507 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.507 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.507 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.507 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.507 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.507 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.507 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.471656+0000", 2024-03-30T12:21:58.507 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.469910+0000", 2024-03-30T12:21:58.507 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.469910+0000", 2024-03-30T12:21:58.507 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.470521+0000", 2024-03-30T12:21:58.507 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.471656+0000", 2024-03-30T12:21:58.507 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.507 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.507 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.508 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.508 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.471656+0000", 2024-03-30T12:21:58.508 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.471656+0000", 2024-03-30T12:21:58.508 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.471656+0000", 2024-03-30T12:21:58.508 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.508 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.508 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.508 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.471656+0000", 2024-03-30T12:21:58.508 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.471656+0000", 2024-03-30T12:21:58.508 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.508 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.508 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.508 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.508 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.508 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.508 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.509 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.509 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.509 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.509 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.509 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.509 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.509 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.8", 2024-03-30T12:21:58.509 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.509 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.509 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.509 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:21:58.509 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.509 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T14:12:52.044394+0000", 2024-03-30T12:21:58.509 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.509 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.510 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.510 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.510 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.510 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.510 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.510 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.510 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.510 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.510 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.510 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.510 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.510 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.510 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.510 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.510 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.511 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.511 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.511 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.511 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.511 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.511 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.511 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.511 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.511 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.511 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.511 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.511 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.511 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.511 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.511 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.511 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.512 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.512 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.512 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.512 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.512 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.512 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.512 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.512 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.512 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.512 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.512 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.512 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.513 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.513 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.513 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.513 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.513 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.513 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.513 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:21:58.513 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.513 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.513 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.513 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.513 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.513 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.513 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.513 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.514 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-03-30T12:21:58.514 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.514 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.514 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.514 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.514 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.514 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.514 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.598423+0000", 2024-03-30T12:21:58.514 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.876739+0000", 2024-03-30T12:21:58.514 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.876739+0000", 2024-03-30T12:21:58.514 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.877240+0000", 2024-03-30T12:21:58.514 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.598423+0000", 2024-03-30T12:21:58.514 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.514 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.514 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.515 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.515 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.598423+0000", 2024-03-30T12:21:58.515 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.598423+0000", 2024-03-30T12:21:58.515 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.598423+0000", 2024-03-30T12:21:58.515 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.515 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.515 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.515 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.598423+0000", 2024-03-30T12:21:58.515 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.598423+0000", 2024-03-30T12:21:58.515 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.515 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.515 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.515 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.515 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.516 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.516 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.516 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.516 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.516 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.516 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.516 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.516 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.516 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.9", 2024-03-30T12:21:58.516 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.516 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.516 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.516 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.516 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.516 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T13:36:25.328486+0000", 2024-03-30T12:21:58.517 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.517 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.517 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.518 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.518 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.518 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.518 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.518 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.518 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.518 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.518 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.518 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.518 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.518 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.518 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.518 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.518 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.518 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.519 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.519 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.519 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.520 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.520 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.520 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.520 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.520 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.520 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.520 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-03-30T12:21:58.520 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.520 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.520 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.520 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.520 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.520 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.520 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:21:58.521 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.521 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:21:58.521 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.521 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.521 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.521 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.521 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.521 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.521 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006039+0000", 2024-03-30T12:21:58.521 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.459223+0000", 2024-03-30T12:21:58.521 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.459223+0000", 2024-03-30T12:21:58.521 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.459528+0000", 2024-03-30T12:21:58.521 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006039+0000", 2024-03-30T12:21:58.521 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.521 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.522 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.522 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.522 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006039+0000", 2024-03-30T12:21:58.522 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006039+0000", 2024-03-30T12:21:58.522 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006039+0000", 2024-03-30T12:21:58.522 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.522 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.522 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.522 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006039+0000", 2024-03-30T12:21:58.522 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006039+0000", 2024-03-30T12:21:58.522 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.522 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.522 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.522 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.523 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.523 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.523 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.523 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.523 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.523 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.523 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.523 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.523 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.523 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.9", 2024-03-30T12:21:58.523 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.523 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.523 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.523 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:21:58.523 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.523 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T16:49:44.399783+0000", 2024-03-30T12:21:58.524 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.524 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.524 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.524 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.524 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.524 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.524 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.524 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.524 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.524 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.524 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.524 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.524 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.524 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.524 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.526 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.526 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.526 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.527 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.527 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.527 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.527 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:21:58.527 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.527 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:21:58.527 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.527 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.527 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.527 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.527 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.527 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.527 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.527 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.527 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:21:58.528 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.528 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.528 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.528 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.528 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.528 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.528 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.003591+0000", 2024-03-30T12:21:58.528 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.850530+0000", 2024-03-30T12:21:58.528 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.850530+0000", 2024-03-30T12:21:58.528 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.850810+0000", 2024-03-30T12:21:58.528 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.003591+0000", 2024-03-30T12:21:58.528 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.528 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.528 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.528 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.529 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.003591+0000", 2024-03-30T12:21:58.529 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.003591+0000", 2024-03-30T12:21:58.529 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.003591+0000", 2024-03-30T12:21:58.529 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.529 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.529 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.529 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.003591+0000", 2024-03-30T12:21:58.529 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.003591+0000", 2024-03-30T12:21:58.529 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.529 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.529 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.529 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.529 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.529 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.529 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.529 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.530 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.530 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.530 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.530 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.530 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.530 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.8", 2024-03-30T12:21:58.530 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.530 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.530 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.530 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.530 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.530 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T15:52:32.869322+0000", 2024-03-30T12:21:58.530 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.530 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.530 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.531 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.531 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.531 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.531 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.531 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.531 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.531 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.531 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.531 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.531 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.531 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.531 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.531 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.531 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.533 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.533 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.533 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.533 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.534 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.534 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.534 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.534 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.534 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:21:58.534 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.534 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.534 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.534 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.534 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.534 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.534 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.534 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.534 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:21:58.534 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.535 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.535 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.535 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.535 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.535 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.535 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.009648+0000", 2024-03-30T12:21:58.535 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:20:37.008926+0000", 2024-03-30T12:21:58.535 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:20:37.008926+0000", 2024-03-30T12:21:58.535 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:20:37.009330+0000", 2024-03-30T12:21:58.535 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.009648+0000", 2024-03-30T12:21:58.535 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.535 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.535 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.535 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 68, 2024-03-30T12:21:58.535 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.009648+0000", 2024-03-30T12:21:58.536 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.009648+0000", 2024-03-30T12:21:58.536 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.009648+0000", 2024-03-30T12:21:58.536 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.536 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.536 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.536 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.009648+0000", 2024-03-30T12:21:58.536 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.009648+0000", 2024-03-30T12:21:58.536 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.536 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.536 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.536 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.536 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 67, 2024-03-30T12:21:58.536 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.536 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.536 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.537 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.537 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.537 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.537 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.537 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.537 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.a", 2024-03-30T12:21:58.537 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.537 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.537 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.537 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 28, 2024-03-30T12:21:58.537 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.537 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T21:53:39.113599+0000", 2024-03-30T12:21:58.537 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.537 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.537 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.537 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.539 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.539 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.539 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.539 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.539 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.539 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.539 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.539 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.539 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.539 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.539 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.539 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.539 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.539 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.539 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.539 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.540 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.540 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.540 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.540 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.540 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.540 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.541 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.541 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.541 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:21:58.541 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.541 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.541 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.541 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.541 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.541 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.541 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:58.541 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.541 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:21:58.541 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.541 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.541 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.542 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.542 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.542 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.542 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.004114+0000", 2024-03-30T12:21:58.542 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.858419+0000", 2024-03-30T12:21:58.542 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.858419+0000", 2024-03-30T12:21:58.542 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.858733+0000", 2024-03-30T12:21:58.542 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.004114+0000", 2024-03-30T12:21:58.542 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.542 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.542 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.542 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.542 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.004114+0000", 2024-03-30T12:21:58.542 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.004114+0000", 2024-03-30T12:21:58.542 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.004114+0000", 2024-03-30T12:21:58.543 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.543 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.543 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.543 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.004114+0000", 2024-03-30T12:21:58.543 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.004114+0000", 2024-03-30T12:21:58.543 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.543 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.543 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.543 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.543 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.543 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.543 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.543 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.543 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.543 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.544 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.544 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.544 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.544 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.b", 2024-03-30T12:21:58.544 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.544 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.544 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.544 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.544 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.544 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T20:27:43.731796+0000", 2024-03-30T12:21:58.544 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.544 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.544 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.544 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.544 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.545 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.545 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.545 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.545 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.545 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.545 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.545 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.545 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.545 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.545 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.545 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.545 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.545 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.545 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.545 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.547 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.547 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.547 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.547 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.547 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.547 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.547 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:58.548 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.548 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:21:58.548 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.548 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.548 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.548 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.548 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.548 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.548 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:21:58.548 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.548 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:21:58.548 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.548 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.548 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.548 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.549 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.549 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.549 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.472063+0000", 2024-03-30T12:21:58.549 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.466979+0000", 2024-03-30T12:21:58.549 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.466979+0000", 2024-03-30T12:21:58.549 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.468017+0000", 2024-03-30T12:21:58.549 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.472063+0000", 2024-03-30T12:21:58.549 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.549 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.549 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.549 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.549 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.472063+0000", 2024-03-30T12:21:58.549 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.472063+0000", 2024-03-30T12:21:58.549 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.472063+0000", 2024-03-30T12:21:58.549 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.550 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.550 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.550 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.472063+0000", 2024-03-30T12:21:58.550 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.472063+0000", 2024-03-30T12:21:58.550 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.550 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 2, 2024-03-30T12:21:58.550 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.550 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.550 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.550 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.550 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.550 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.550 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.550 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 2, 2024-03-30T12:21:58.550 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.551 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.551 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.551 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.b", 2024-03-30T12:21:58.551 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.551 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.551 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.551 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 21, 2024-03-30T12:21:58.551 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.551 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T22:41:36.480109+0000", 2024-03-30T12:21:58.551 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.551 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.551 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.551 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.551 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.551 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-03-30T12:21:58.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-03-30T12:21:58.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-03-30T12:21:58.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-03-30T12:21:58.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.554 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.554 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.554 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.554 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.554 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.554 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 1, 2024-03-30T12:21:58.554 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.554 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.554 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.557 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.557 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.558 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.558 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.558 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:21:58.558 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.558 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:21:58.558 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'2" 2024-03-30T12:21:58.558 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.558 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.558 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.558 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.558 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.558 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.558 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.558 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:21:58.559 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.559 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.559 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.559 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.559 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.559 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.559 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.240324+0000", 2024-03-30T12:21:58.559 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.868645+0000", 2024-03-30T12:21:58.559 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.868645+0000", 2024-03-30T12:21:58.559 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.869001+0000", 2024-03-30T12:21:58.559 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.240324+0000", 2024-03-30T12:21:58.559 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.559 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.559 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.560 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.560 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.240324+0000", 2024-03-30T12:21:58.560 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.240324+0000", 2024-03-30T12:21:58.560 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.240324+0000", 2024-03-30T12:21:58.560 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.560 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.560 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.560 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.240324+0000", 2024-03-30T12:21:58.560 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.240324+0000", 2024-03-30T12:21:58.560 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.560 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.560 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.560 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.560 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.560 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.561 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.561 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.561 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.561 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.561 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.561 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.561 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.561 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.a", 2024-03-30T12:21:58.561 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.561 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.561 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.561 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.561 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.561 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T19:54:10.778279+0000", 2024-03-30T12:21:58.561 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.562 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.562 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.562 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.563 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.563 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.563 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.563 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.563 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.563 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.563 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.563 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.563 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.563 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.563 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.563 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.563 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.563 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.563 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.564 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.564 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.564 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.564 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.564 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.564 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.564 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.564 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.564 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.564 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.564 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.564 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.564 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.564 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.564 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.565 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.565 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.565 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.565 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.565 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.565 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:21:58.565 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.565 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.565 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.565 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.565 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.565 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.565 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.565 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.565 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-03-30T12:21:58.566 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.566 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.566 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.566 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.566 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.566 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.566 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.008278+0000", 2024-03-30T12:21:58.566 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.458925+0000", 2024-03-30T12:21:58.566 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.458925+0000", 2024-03-30T12:21:58.566 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.459171+0000", 2024-03-30T12:21:58.566 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.008278+0000", 2024-03-30T12:21:58.566 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.566 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.566 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.566 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.567 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.008278+0000", 2024-03-30T12:21:58.567 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.008278+0000", 2024-03-30T12:21:58.567 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.008278+0000", 2024-03-30T12:21:58.567 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.567 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.567 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.567 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.008278+0000", 2024-03-30T12:21:58.567 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.008278+0000", 2024-03-30T12:21:58.567 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.567 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.567 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.567 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.567 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.567 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.568 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.568 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.568 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.568 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.568 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.568 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.568 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.568 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.c", 2024-03-30T12:21:58.568 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.568 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.568 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.568 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:21:58.568 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.568 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T12:26:20.974369+0000", 2024-03-30T12:21:58.568 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.569 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.569 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.569 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.570 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.570 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.570 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.570 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.570 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.570 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.570 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.570 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.570 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.570 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.570 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.570 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.570 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.570 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.570 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.571 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.571 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.571 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.571 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.571 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.571 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.571 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.571 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.571 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.571 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.571 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.571 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.571 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.571 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.571 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.572 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.572 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.572 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.572 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.572 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-03-30T12:21:58.572 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.572 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.572 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.572 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.572 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.572 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.572 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.572 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.572 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:21:58.572 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.573 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.573 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.573 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.573 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.573 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.573 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.472168+0000", 2024-03-30T12:21:58.573 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.875216+0000", 2024-03-30T12:21:58.573 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.875216+0000", 2024-03-30T12:21:58.573 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.875558+0000", 2024-03-30T12:21:58.573 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.472168+0000", 2024-03-30T12:21:58.573 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.573 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.573 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.573 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.573 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.472168+0000", 2024-03-30T12:21:58.574 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.472168+0000", 2024-03-30T12:21:58.574 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.472168+0000", 2024-03-30T12:21:58.574 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.574 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.574 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.574 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.472168+0000", 2024-03-30T12:21:58.574 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.472168+0000", 2024-03-30T12:21:58.574 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.574 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.574 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.574 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.574 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.574 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.574 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.574 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.575 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.575 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.575 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.575 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.575 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.575 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.d", 2024-03-30T12:21:58.575 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.575 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.575 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.575 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.575 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.575 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T15:27:04.763910+0000", 2024-03-30T12:21:58.575 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.575 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.575 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.576 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.577 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.577 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.577 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.577 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.577 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.577 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.577 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.577 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.577 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.577 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.577 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.577 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.577 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.577 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.577 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.578 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.578 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.578 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.578 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.578 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.578 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.578 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.578 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.578 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.578 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.578 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.578 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.578 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.578 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.578 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.579 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.579 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.579 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.579 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:21:58.579 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.579 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.579 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.579 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.579 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.579 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.579 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:21:58.579 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.579 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:21:58.579 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.579 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.579 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.580 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.580 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.580 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.580 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006514+0000", 2024-03-30T12:21:58.580 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.459250+0000", 2024-03-30T12:21:58.580 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.459250+0000", 2024-03-30T12:21:58.580 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.459545+0000", 2024-03-30T12:21:58.580 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006514+0000", 2024-03-30T12:21:58.580 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.580 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.580 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.580 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.580 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006514+0000", 2024-03-30T12:21:58.580 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006514+0000", 2024-03-30T12:21:58.580 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006514+0000", 2024-03-30T12:21:58.581 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.581 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.581 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.581 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006514+0000", 2024-03-30T12:21:58.581 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006514+0000", 2024-03-30T12:21:58.581 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.581 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 1, 2024-03-30T12:21:58.581 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.581 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.581 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.581 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.581 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.581 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.581 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.581 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 1, 2024-03-30T12:21:58.582 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.582 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.582 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.582 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.d", 2024-03-30T12:21:58.582 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.582 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.582 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.582 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 20, 2024-03-30T12:21:58.582 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.582 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T20:52:38.112815+0000", 2024-03-30T12:21:58.582 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.582 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.582 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.582 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 70, 2024-03-30T12:21:58.582 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-03-30T12:21:58.583 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-03-30T12:21:58.584 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.584 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-03-30T12:21:58.584 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.584 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.584 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.584 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.584 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.584 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.584 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.584 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.584 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.584 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.584 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.584 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.584 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.585 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.585 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.585 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.585 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.585 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.585 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 1, 2024-03-30T12:21:58.585 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 1 2024-03-30T12:21:58.585 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.585 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.585 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.585 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.585 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.585 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.585 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:21:58.585 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.586 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:21:58.586 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'1" 2024-03-30T12:21:58.586 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.586 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.586 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.586 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.586 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.586 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.586 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.586 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:58.586 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.586 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.586 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.586 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.586 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.587 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.587 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006460+0000", 2024-03-30T12:21:58.587 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.852250+0000", 2024-03-30T12:21:58.587 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.852250+0000", 2024-03-30T12:21:58.587 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.852558+0000", 2024-03-30T12:21:58.587 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006460+0000", 2024-03-30T12:21:58.587 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.587 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.587 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.587 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.587 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006460+0000", 2024-03-30T12:21:58.587 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006460+0000", 2024-03-30T12:21:58.587 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006460+0000", 2024-03-30T12:21:58.587 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.587 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.588 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.588 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006460+0000", 2024-03-30T12:21:58.588 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006460+0000", 2024-03-30T12:21:58.588 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.588 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.588 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.588 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.588 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.588 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.588 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.588 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.588 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.588 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.588 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.588 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.589 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.589 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.c", 2024-03-30T12:21:58.589 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.589 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.589 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.589 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.589 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.589 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:57:15.989801+0000", 2024-03-30T12:21:58.589 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.589 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.589 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.589 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.589 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.589 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.589 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.589 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.590 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.591 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.591 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.591 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.591 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.591 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.591 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.591 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.591 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.591 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.591 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.591 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.591 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.591 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.591 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.591 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.592 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.592 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.592 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.592 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.592 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.592 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.592 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.592 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.592 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.592 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.592 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.592 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.592 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.592 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.592 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:58.592 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.593 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.593 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.593 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.593 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.593 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.593 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.593 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.593 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-03-30T12:21:58.593 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.593 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.593 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:58.593 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.593 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.593 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.593 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006716+0000", 2024-03-30T12:21:58.593 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.464021+0000", 2024-03-30T12:21:58.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.464021+0000", 2024-03-30T12:21:58.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.464968+0000", 2024-03-30T12:21:58.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006716+0000", 2024-03-30T12:21:58.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:58.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006716+0000", 2024-03-30T12:21:58.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006716+0000", 2024-03-30T12:21:58.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006716+0000", 2024-03-30T12:21:58.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:58.594 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006716+0000", 2024-03-30T12:21:58.595 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006716+0000", 2024-03-30T12:21:58.595 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.595 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 2, 2024-03-30T12:21:58.595 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.595 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.595 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:58.595 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.595 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.595 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.595 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.595 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 2, 2024-03-30T12:21:58.595 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.595 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.595 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.595 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.e", 2024-03-30T12:21:58.596 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.596 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.596 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.596 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 21, 2024-03-30T12:21:58.596 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.596 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T21:48:20.224884+0000", 2024-03-30T12:21:58.596 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.596 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.596 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.596 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-03-30T12:21:58.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-03-30T12:21:58.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-03-30T12:21:58.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.597 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-03-30T12:21:58.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.598 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.599 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 3, 2024-03-30T12:21:58.599 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.599 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.599 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.599 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.599 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.599 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.599 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.599 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:58.599 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.599 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-03-30T12:21:58.599 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'2" 2024-03-30T12:21:58.599 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.599 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.599 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.600 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.600 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.600 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.600 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.600 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:21:58.600 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.600 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.600 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.600 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.600 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.600 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.472277+0000", 2024-03-30T12:21:58.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.871376+0000", 2024-03-30T12:21:58.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.871376+0000", 2024-03-30T12:21:58.600 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.871645+0000", 2024-03-30T12:21:58.601 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.472277+0000", 2024-03-30T12:21:58.601 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.601 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.601 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.601 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.601 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.472277+0000", 2024-03-30T12:21:58.601 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.472277+0000", 2024-03-30T12:21:58.601 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.472277+0000", 2024-03-30T12:21:58.601 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.601 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.601 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.601 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.472277+0000", 2024-03-30T12:21:58.601 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.472277+0000", 2024-03-30T12:21:58.601 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.601 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.601 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.602 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.602 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.602 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.602 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.602 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.602 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.602 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.602 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.602 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.602 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.602 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.f", 2024-03-30T12:21:58.602 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.602 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.602 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.602 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.603 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.603 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T12:54:57.281972+0000", 2024-03-30T12:21:58.603 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.603 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.603 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.603 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.604 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.605 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.605 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.606 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.606 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.606 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.606 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.606 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.606 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.606 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.606 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:21:58.606 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.606 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.606 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.606 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.606 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.606 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.607 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:21:58.607 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.607 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:21:58.607 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.607 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.607 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.607 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.607 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.607 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.240081+0000", 2024-03-30T12:21:58.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.862535+0000", 2024-03-30T12:21:58.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.862535+0000", 2024-03-30T12:21:58.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.862859+0000", 2024-03-30T12:21:58.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.240081+0000", 2024-03-30T12:21:58.607 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.608 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.608 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.608 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.608 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.240081+0000", 2024-03-30T12:21:58.608 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.240081+0000", 2024-03-30T12:21:58.608 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.240081+0000", 2024-03-30T12:21:58.608 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.608 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.608 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.608 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.240081+0000", 2024-03-30T12:21:58.608 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.240081+0000", 2024-03-30T12:21:58.608 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.608 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.608 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.608 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.608 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.609 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.609 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.609 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.609 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.609 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.609 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.609 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.609 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.609 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.20", 2024-03-30T12:21:58.609 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.609 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.609 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.609 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.609 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.609 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T16:17:31.462763+0000", 2024-03-30T12:21:58.610 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.610 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.610 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.610 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.611 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.612 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.612 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.612 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.612 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.612 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.612 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.612 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.612 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.612 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.612 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.612 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.612 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.612 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.612 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.612 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.613 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.613 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.613 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.613 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:21:58.613 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.613 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:21:58.613 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.613 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.613 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.613 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.613 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.613 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.613 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.613 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.613 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-03-30T12:21:58.613 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.614 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.614 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.614 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.614 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.614 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.007057+0000", 2024-03-30T12:21:58.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.862567+0000", 2024-03-30T12:21:58.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.862567+0000", 2024-03-30T12:21:58.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.862947+0000", 2024-03-30T12:21:58.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.007057+0000", 2024-03-30T12:21:58.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.614 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.615 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.007057+0000", 2024-03-30T12:21:58.615 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.007057+0000", 2024-03-30T12:21:58.615 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.007057+0000", 2024-03-30T12:21:58.615 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.615 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.615 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.615 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.007057+0000", 2024-03-30T12:21:58.615 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.007057+0000", 2024-03-30T12:21:58.615 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.615 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.615 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.615 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.615 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.615 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.615 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.615 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.616 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.616 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.616 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.616 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.616 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.616 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.21", 2024-03-30T12:21:58.616 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.616 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.616 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.616 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.616 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.616 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T13:55:05.422370+0000", 2024-03-30T12:21:58.616 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.616 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.616 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.617 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.619 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.619 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.619 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.619 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.619 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.619 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.619 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.619 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.619 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.619 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.619 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.619 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.619 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.619 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.619 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.619 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.620 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.620 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.620 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-03-30T12:21:58.620 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.620 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.620 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.620 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.620 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.620 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.620 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.620 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.620 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:58.620 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.620 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.620 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.621 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.621 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.621 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006398+0000", 2024-03-30T12:21:58.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.856525+0000", 2024-03-30T12:21:58.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.856525+0000", 2024-03-30T12:21:58.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.856869+0000", 2024-03-30T12:21:58.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006398+0000", 2024-03-30T12:21:58.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006398+0000", 2024-03-30T12:21:58.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006398+0000", 2024-03-30T12:21:58.621 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006398+0000", 2024-03-30T12:21:58.622 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.622 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.622 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.622 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006398+0000", 2024-03-30T12:21:58.622 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006398+0000", 2024-03-30T12:21:58.622 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.622 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.622 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.622 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.622 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.622 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.622 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.622 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.622 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.622 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.623 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.623 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.623 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.623 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.22", 2024-03-30T12:21:58.623 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.623 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.623 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.623 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.623 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.623 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T20:01:47.443294+0000", 2024-03-30T12:21:58.623 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.623 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.623 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.623 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.623 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.624 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.625 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.626 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.626 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.626 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.626 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.626 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.626 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.626 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.626 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.626 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.626 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.626 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.626 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.626 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.626 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.626 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.627 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:58.627 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.627 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.627 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.627 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.627 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.627 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.627 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:58.627 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.627 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:21:58.627 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.627 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.627 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.627 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.627 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.627 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.005862+0000", 2024-03-30T12:21:58.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.859327+0000", 2024-03-30T12:21:58.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.859327+0000", 2024-03-30T12:21:58.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.859724+0000", 2024-03-30T12:21:58.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.005862+0000", 2024-03-30T12:21:58.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.005862+0000", 2024-03-30T12:21:58.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.005862+0000", 2024-03-30T12:21:58.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.005862+0000", 2024-03-30T12:21:58.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.628 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.629 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.629 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.005862+0000", 2024-03-30T12:21:58.629 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.005862+0000", 2024-03-30T12:21:58.629 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.629 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.629 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.629 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.629 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.629 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.629 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.629 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.629 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.629 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.629 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.629 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.629 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.630 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.23", 2024-03-30T12:21:58.630 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.630 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.630 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.630 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.630 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.630 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T17:53:15.692683+0000", 2024-03-30T12:21:58.630 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.630 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.630 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.630 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.630 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.630 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.630 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.631 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.632 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.633 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.633 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.633 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.633 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.633 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.633 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.633 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.633 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.633 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.633 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.633 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.633 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.633 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:58.633 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.634 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:21:58.634 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.634 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.634 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.634 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.634 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.634 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.634 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.634 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.634 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:21:58.634 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.634 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.634 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.634 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.635 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.635 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.009588+0000", 2024-03-30T12:21:58.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:20:37.008947+0000", 2024-03-30T12:21:58.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:20:37.008947+0000", 2024-03-30T12:21:58.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:20:37.009224+0000", 2024-03-30T12:21:58.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.009588+0000", 2024-03-30T12:21:58.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 68, 2024-03-30T12:21:58.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.009588+0000", 2024-03-30T12:21:58.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.009588+0000", 2024-03-30T12:21:58.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.009588+0000", 2024-03-30T12:21:58.635 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.636 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.636 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.636 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.009588+0000", 2024-03-30T12:21:58.636 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.009588+0000", 2024-03-30T12:21:58.636 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.636 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.636 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.636 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.636 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 67, 2024-03-30T12:21:58.636 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.636 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.636 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.636 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.636 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.636 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.637 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.637 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.637 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.24", 2024-03-30T12:21:58.637 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.637 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.637 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.637 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 27, 2024-03-30T12:21:58.637 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.637 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T15:42:16.251343+0000", 2024-03-30T12:21:58.637 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.637 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.637 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.637 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.637 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.637 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.638 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.639 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.640 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.640 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.640 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.640 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.640 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.640 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.640 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.640 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.640 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.640 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.640 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.640 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.640 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:58.640 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.640 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.641 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:21:58.641 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.641 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.641 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.641 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.641 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.641 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.641 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.641 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.641 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:21:58.641 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.641 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.641 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.641 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.641 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.642 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006343+0000", 2024-03-30T12:21:58.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.848029+0000", 2024-03-30T12:21:58.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.848029+0000", 2024-03-30T12:21:58.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.848297+0000", 2024-03-30T12:21:58.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006343+0000", 2024-03-30T12:21:58.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006343+0000", 2024-03-30T12:21:58.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006343+0000", 2024-03-30T12:21:58.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006343+0000", 2024-03-30T12:21:58.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.642 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.643 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.643 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006343+0000", 2024-03-30T12:21:58.643 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006343+0000", 2024-03-30T12:21:58.643 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.643 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.643 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.643 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.643 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.643 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.643 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.643 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.643 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.643 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.643 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.643 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.644 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.644 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.25", 2024-03-30T12:21:58.644 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.644 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.644 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.644 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.644 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.644 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T22:28:38.617413+0000", 2024-03-30T12:21:58.644 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.644 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.645 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.645 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.646 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.647 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.647 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.647 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.647 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.647 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.647 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.647 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.647 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.647 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.647 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.647 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.647 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.647 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.648 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.648 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.648 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.648 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.648 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.648 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.648 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.648 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.648 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.648 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.648 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.648 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.648 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.649 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:21:58.649 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.649 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.649 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.649 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.649 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.649 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.649 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:58.649 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.649 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:21:58.649 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.650 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.650 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.650 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.650 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.650 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.650 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.240786+0000", 2024-03-30T12:21:58.650 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.869115+0000", 2024-03-30T12:21:58.650 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.869115+0000", 2024-03-30T12:21:58.650 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.869414+0000", 2024-03-30T12:21:58.650 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.240786+0000", 2024-03-30T12:21:58.650 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.651 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.651 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.651 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.651 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.240786+0000", 2024-03-30T12:21:58.651 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.240786+0000", 2024-03-30T12:21:58.651 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.240786+0000", 2024-03-30T12:21:58.651 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.651 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.651 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.651 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.240786+0000", 2024-03-30T12:21:58.651 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.240786+0000", 2024-03-30T12:21:58.651 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.652 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.652 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.652 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.652 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.652 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.652 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.652 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.652 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.652 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.652 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.652 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.652 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.652 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.26", 2024-03-30T12:21:58.652 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.653 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.653 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.653 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.653 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.653 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T19:01:12.173692+0000", 2024-03-30T12:21:58.653 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.653 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.653 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.653 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.654 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.654 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.654 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.654 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.654 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.654 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.654 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.654 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.654 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.654 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.654 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.654 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.655 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.655 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.655 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.655 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.655 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.655 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.655 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.655 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.655 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.655 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.655 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.655 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.656 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.656 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.656 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.656 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.656 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.656 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.656 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.656 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.656 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.656 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.656 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.656 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.656 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.657 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.657 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.657 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.657 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.657 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:58.657 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.657 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:21:58.657 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.657 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.657 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.657 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.657 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.657 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.657 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.658 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.658 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:21:58.658 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.658 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.658 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.658 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.658 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.658 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.658 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.004639+0000", 2024-03-30T12:21:58.658 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.855480+0000", 2024-03-30T12:21:58.658 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.855480+0000", 2024-03-30T12:21:58.658 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.856088+0000", 2024-03-30T12:21:58.659 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.004639+0000", 2024-03-30T12:21:58.659 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.659 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.659 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.659 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.659 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.004639+0000", 2024-03-30T12:21:58.659 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.004639+0000", 2024-03-30T12:21:58.659 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.004639+0000", 2024-03-30T12:21:58.659 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.659 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.659 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.659 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.004639+0000", 2024-03-30T12:21:58.660 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.004639+0000", 2024-03-30T12:21:58.660 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.660 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.660 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.660 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.660 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.660 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.660 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.660 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.660 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.660 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.660 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.661 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.661 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.661 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.27", 2024-03-30T12:21:58.661 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.661 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.661 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.661 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.661 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.661 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:21:16.961559+0000", 2024-03-30T12:21:58.661 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.661 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.661 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.662 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.662 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.662 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.662 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.662 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.662 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.662 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.662 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.662 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.662 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.662 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.663 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.663 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.663 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.663 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.663 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.663 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.663 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.663 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.663 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.663 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.663 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.663 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.664 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.664 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.664 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.664 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.664 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.664 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.664 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.664 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.664 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.664 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.664 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.664 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.664 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.665 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.665 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.665 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.665 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.665 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.665 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.665 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.665 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.665 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.666 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:21:58.666 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.666 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.666 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.666 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.666 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.666 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.666 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.666 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.666 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:58.666 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.667 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.667 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.667 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.667 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.667 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.667 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006280+0000", 2024-03-30T12:21:58.667 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.854390+0000", 2024-03-30T12:21:58.667 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.854390+0000", 2024-03-30T12:21:58.667 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.854668+0000", 2024-03-30T12:21:58.667 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006280+0000", 2024-03-30T12:21:58.667 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.667 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.667 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.668 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.668 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006280+0000", 2024-03-30T12:21:58.668 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006280+0000", 2024-03-30T12:21:58.668 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006280+0000", 2024-03-30T12:21:58.668 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.668 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.668 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.668 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006280+0000", 2024-03-30T12:21:58.668 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006280+0000", 2024-03-30T12:21:58.668 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.668 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.668 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.669 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.669 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.669 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.669 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.669 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.669 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.669 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.669 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.669 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.669 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.669 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.28", 2024-03-30T12:21:58.669 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.669 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.670 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.670 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.670 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.670 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T14:39:22.128098+0000", 2024-03-30T12:21:58.670 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.670 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.670 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.670 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.670 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.670 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.670 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.670 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.671 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.671 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.671 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.671 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.671 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.671 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.671 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.671 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.671 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.671 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.671 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.671 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.672 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.673 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.673 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.673 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.673 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.674 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.674 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.674 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.674 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:58.674 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.674 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:58.674 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.674 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.674 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.674 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.674 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.675 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.675 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.675 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.675 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:21:58.675 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.675 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.675 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.675 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.675 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.675 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.675 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.003796+0000", 2024-03-30T12:21:58.675 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.850915+0000", 2024-03-30T12:21:58.675 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.850915+0000", 2024-03-30T12:21:58.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.851282+0000", 2024-03-30T12:21:58.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.003796+0000", 2024-03-30T12:21:58.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.003796+0000", 2024-03-30T12:21:58.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.003796+0000", 2024-03-30T12:21:58.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.003796+0000", 2024-03-30T12:21:58.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.676 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.677 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.677 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.003796+0000", 2024-03-30T12:21:58.677 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.003796+0000", 2024-03-30T12:21:58.677 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.677 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.677 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.677 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.677 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.677 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.677 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.677 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.677 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.677 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.677 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.678 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.678 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.678 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.29", 2024-03-30T12:21:58.678 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.678 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.678 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.678 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.678 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.678 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T16:46:50.526568+0000", 2024-03-30T12:21:58.678 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.678 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.679 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.679 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.680 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.681 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.681 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.681 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.681 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.681 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.681 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.681 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.681 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.681 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.681 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.681 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.682 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.682 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.682 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.682 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.682 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.682 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.682 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.682 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.682 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.682 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.682 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:58.683 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.683 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.683 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.683 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:21:58.683 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.683 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.683 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.683 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.683 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.683 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.683 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.683 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.684 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:58.684 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.684 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.684 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.684 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.684 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.684 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.684 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006481+0000", 2024-03-30T12:21:58.684 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.860085+0000", 2024-03-30T12:21:58.684 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.860085+0000", 2024-03-30T12:21:58.684 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.860406+0000", 2024-03-30T12:21:58.684 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006481+0000", 2024-03-30T12:21:58.684 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.685 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.685 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.685 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.685 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006481+0000", 2024-03-30T12:21:58.685 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006481+0000", 2024-03-30T12:21:58.685 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006481+0000", 2024-03-30T12:21:58.685 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.685 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.685 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.685 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006481+0000", 2024-03-30T12:21:58.685 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006481+0000", 2024-03-30T12:21:58.685 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.686 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.686 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.686 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.686 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.686 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.686 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.686 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.686 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.686 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.686 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.686 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.686 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.686 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2a", 2024-03-30T12:21:58.687 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.687 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.687 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.687 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.687 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.687 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:47:32.201939+0000", 2024-03-30T12:21:58.687 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.687 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.687 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.687 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.688 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.688 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.688 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.688 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.688 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.688 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.688 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.688 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.688 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.688 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.688 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.688 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.688 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.689 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.689 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.689 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.689 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.689 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.689 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.689 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.689 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.689 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.689 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.689 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.690 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.690 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.690 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.690 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.690 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.690 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.690 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.690 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.690 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.690 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.690 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.690 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.691 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.691 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.691 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.691 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.691 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.691 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:58.691 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.691 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:58.691 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.691 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:58.691 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.691 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.691 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.692 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.692 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.692 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.692 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.692 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.692 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:21:58.692 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.692 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.692 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.692 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.692 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.692 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.693 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.005906+0000", 2024-03-30T12:21:58.693 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.856643+0000", 2024-03-30T12:21:58.693 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.856643+0000", 2024-03-30T12:21:58.693 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.856917+0000", 2024-03-30T12:21:58.693 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.005906+0000", 2024-03-30T12:21:58.693 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.693 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.693 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.693 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.693 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.005906+0000", 2024-03-30T12:21:58.693 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.005906+0000", 2024-03-30T12:21:58.693 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.005906+0000", 2024-03-30T12:21:58.694 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.694 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.694 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.694 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.005906+0000", 2024-03-30T12:21:58.694 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.005906+0000", 2024-03-30T12:21:58.694 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.694 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.694 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.694 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.694 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.694 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.695 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.695 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.695 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.695 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.695 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.695 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.695 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.695 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2b", 2024-03-30T12:21:58.695 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.695 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.695 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.695 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.695 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.696 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T22:51:53.996045+0000", 2024-03-30T12:21:58.696 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.696 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.696 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.697 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.697 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.697 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.697 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.697 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.697 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.697 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.697 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.697 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.697 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.697 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.697 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.698 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.698 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.698 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.698 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.698 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.698 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.698 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.698 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.698 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.698 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.698 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.699 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.699 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.699 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.700 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.700 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.700 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:58.700 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.700 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.700 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.700 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:21:58.700 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.700 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.700 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.700 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:58.700 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.701 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.701 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.701 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.701 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:21:58.701 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:58.701 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:58.701 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:58.701 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:58.701 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:58.701 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:58.701 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.240724+0000", 2024-03-30T12:21:58.701 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.866801+0000", 2024-03-30T12:21:58.701 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.866801+0000", 2024-03-30T12:21:58.702 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.867176+0000", 2024-03-30T12:21:58.702 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.240724+0000", 2024-03-30T12:21:58.702 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.702 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:58.702 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.702 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:58.702 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.240724+0000", 2024-03-30T12:21:58.702 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.240724+0000", 2024-03-30T12:21:58.702 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.240724+0000", 2024-03-30T12:21:58.702 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:58.702 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:58.702 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:58.703 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.240724+0000", 2024-03-30T12:21:58.703 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.240724+0000", 2024-03-30T12:21:58.703 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:58.703 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.703 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:58.703 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:58.703 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:58.703 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:58.703 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:58.703 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:58.703 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:58.703 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.703 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:58.704 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:58.704 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:58.704 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2c", 2024-03-30T12:21:58.704 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:58.704 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:58.704 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:58.704 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:58.704 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:58.704 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T18:31:22.909206+0000", 2024-03-30T12:21:58.704 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:58.704 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:58.704 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.705 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.705 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.705 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.705 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.705 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.705 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.705 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.705 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.705 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.705 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.705 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.705 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.706 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.707 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.708 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.708 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.708 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.708 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.708 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:58.708 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:58.708 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:58.708 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:58.708 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:58.708 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.708 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.708 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:21:58.708 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:58.709 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.709 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.709 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_per_pool": [ 2024-03-30T12:21:58.709 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.709 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": 24, 2024-03-30T12:21:58.709 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-03-30T12:21:58.709 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd" 2024-03-30T12:21:58.709 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.709 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.709 INFO:tasks.workunit.client.0.smithi084.stdout: "num_pg": 8, 2024-03-30T12:21:58.709 INFO:tasks.workunit.client.0.smithi084.stdout: "num_store_stats": 8, 2024-03-30T12:21:58.709 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.710 INFO:tasks.workunit.client.0.smithi084.stdout: "poolid": 4, 2024-03-30T12:21:58.710 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.710 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.710 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.710 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.710 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.710 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.710 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.710 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.710 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.710 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.710 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.710 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.713 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.713 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.713 INFO:tasks.workunit.client.0.smithi084.stdout: "store_stats": { 2024-03-30T12:21:58.713 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": 0, 2024-03-30T12:21:58.713 INFO:tasks.workunit.client.0.smithi084.stdout: "available": 0, 2024-03-30T12:21:58.713 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed": 0, 2024-03-30T12:21:58.713 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_allocated": 0, 2024-03-30T12:21:58.713 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_original": 0, 2024-03-30T12:21:58.713 INFO:tasks.workunit.client.0.smithi084.stdout: "data_stored": 0, 2024-03-30T12:21:58.714 INFO:tasks.workunit.client.0.smithi084.stdout: "internal_metadata": 0, 2024-03-30T12:21:58.714 INFO:tasks.workunit.client.0.smithi084.stdout: "internally_reserved": 0, 2024-03-30T12:21:58.714 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_allocated": 0, 2024-03-30T12:21:58.714 INFO:tasks.workunit.client.0.smithi084.stdout: "total": 0 2024-03-30T12:21:58.714 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.714 INFO:tasks.workunit.client.0.smithi084.stdout: "up": 24 2024-03-30T12:21:58.714 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.714 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.714 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": 192, 2024-03-30T12:21:58.714 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-03-30T12:21:58.714 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs" 2024-03-30T12:21:58.715 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.715 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.715 INFO:tasks.workunit.client.0.smithi084.stdout: "num_pg": 64, 2024-03-30T12:21:58.715 INFO:tasks.workunit.client.0.smithi084.stdout: "num_store_stats": 8, 2024-03-30T12:21:58.715 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.715 INFO:tasks.workunit.client.0.smithi084.stdout: "poolid": 3, 2024-03-30T12:21:58.715 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.715 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.715 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.715 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.715 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.715 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.715 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.716 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.716 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.716 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.716 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.716 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.716 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.716 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.716 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.716 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.716 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.716 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.716 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.717 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.717 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.717 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.717 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.717 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.717 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.717 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.717 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.717 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.717 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.717 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.717 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.717 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.718 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.718 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.718 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.718 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.718 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.718 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.718 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.718 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:58.718 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.718 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.718 INFO:tasks.workunit.client.0.smithi084.stdout: "store_stats": { 2024-03-30T12:21:58.719 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": 0, 2024-03-30T12:21:58.719 INFO:tasks.workunit.client.0.smithi084.stdout: "available": 0, 2024-03-30T12:21:58.719 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed": 0, 2024-03-30T12:21:58.719 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_allocated": 0, 2024-03-30T12:21:58.719 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_original": 0, 2024-03-30T12:21:58.719 INFO:tasks.workunit.client.0.smithi084.stdout: "data_stored": 0, 2024-03-30T12:21:58.719 INFO:tasks.workunit.client.0.smithi084.stdout: "internal_metadata": 0, 2024-03-30T12:21:58.719 INFO:tasks.workunit.client.0.smithi084.stdout: "internally_reserved": 0, 2024-03-30T12:21:58.719 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_allocated": 0, 2024-03-30T12:21:58.719 INFO:tasks.workunit.client.0.smithi084.stdout: "total": 0 2024-03-30T12:21:58.719 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.720 INFO:tasks.workunit.client.0.smithi084.stdout: "up": 192 2024-03-30T12:21:58.720 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.720 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.720 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": 3, 2024-03-30T12:21:58.720 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-03-30T12:21:58.720 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr" 2024-03-30T12:21:58.720 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.720 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 128, 2024-03-30T12:21:58.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_pg": 1, 2024-03-30T12:21:58.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_store_stats": 3, 2024-03-30T12:21:58.720 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 128, 2024-03-30T12:21:58.720 INFO:tasks.workunit.client.0.smithi084.stdout: "poolid": 1, 2024-03-30T12:21:58.720 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 590368, 2024-03-30T12:21:58.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 1771104, 2024-03-30T12:21:58.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.721 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.722 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.722 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.722 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.722 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.722 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.722 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 6, 2024-03-30T12:21:58.722 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 2, 2024-03-30T12:21:58.722 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.722 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 2, 2024-03-30T12:21:58.722 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.722 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.723 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.723 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.723 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.723 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.723 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.723 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 6, 2024-03-30T12:21:58.723 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.723 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.723 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.723 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.723 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.723 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 212, 2024-03-30T12:21:58.723 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 306, 2024-03-30T12:21:58.723 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.724 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.724 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.724 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 179, 2024-03-30T12:21:58.724 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 2416 2024-03-30T12:21:58.724 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.724 INFO:tasks.workunit.client.0.smithi084.stdout: "store_stats": { 2024-03-30T12:21:58.724 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": 1781760, 2024-03-30T12:21:58.724 INFO:tasks.workunit.client.0.smithi084.stdout: "available": 0, 2024-03-30T12:21:58.724 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed": 0, 2024-03-30T12:21:58.724 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_allocated": 0, 2024-03-30T12:21:58.724 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_original": 0, 2024-03-30T12:21:58.725 INFO:tasks.workunit.client.0.smithi084.stdout: "data_stored": 1771104, 2024-03-30T12:21:58.725 INFO:tasks.workunit.client.0.smithi084.stdout: "internal_metadata": 0, 2024-03-30T12:21:58.725 INFO:tasks.workunit.client.0.smithi084.stdout: "internally_reserved": 0, 2024-03-30T12:21:58.725 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_allocated": 0, 2024-03-30T12:21:58.725 INFO:tasks.workunit.client.0.smithi084.stdout: "total": 0 2024-03-30T12:21:58.725 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.725 INFO:tasks.workunit.client.0.smithi084.stdout: "up": 3 2024-03-30T12:21:58.725 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.725 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.725 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": 96, 2024-03-30T12:21:58.725 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-03-30T12:21:58.725 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs" 2024-03-30T12:21:58.726 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.726 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 45, 2024-03-30T12:21:58.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_pg": 32, 2024-03-30T12:21:58.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_store_stats": 8, 2024-03-30T12:21:58.726 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 45, 2024-03-30T12:21:58.726 INFO:tasks.workunit.client.0.smithi084.stdout: "poolid": 2, 2024-03-30T12:21:58.726 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 3430, 2024-03-30T12:21:58.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 66, 2024-03-30T12:21:58.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 22, 2024-03-30T12:21:58.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 22, 2024-03-30T12:21:58.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 14, 2024-03-30T12:21:58.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.728 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:58.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:58.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 51, 2024-03-30T12:21:58.729 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 20 2024-03-30T12:21:58.729 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.729 INFO:tasks.workunit.client.0.smithi084.stdout: "store_stats": { 2024-03-30T12:21:58.730 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": 98304, 2024-03-30T12:21:58.730 INFO:tasks.workunit.client.0.smithi084.stdout: "available": 0, 2024-03-30T12:21:58.730 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed": 0, 2024-03-30T12:21:58.730 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_allocated": 0, 2024-03-30T12:21:58.730 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_original": 0, 2024-03-30T12:21:58.730 INFO:tasks.workunit.client.0.smithi084.stdout: "data_stored": 10290, 2024-03-30T12:21:58.730 INFO:tasks.workunit.client.0.smithi084.stdout: "internal_metadata": 0, 2024-03-30T12:21:58.730 INFO:tasks.workunit.client.0.smithi084.stdout: "internally_reserved": 0, 2024-03-30T12:21:58.730 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_allocated": 0, 2024-03-30T12:21:58.730 INFO:tasks.workunit.client.0.smithi084.stdout: "total": 0 2024-03-30T12:21:58.730 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.730 INFO:tasks.workunit.client.0.smithi084.stdout: "up": 96 2024-03-30T12:21:58.731 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.731 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.731 INFO:tasks.workunit.client.0.smithi084.stdout: "usage": { 2024-03-30T12:21:58.731 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 105, 2024-03-30T12:21:58.731 INFO:tasks.workunit.client.0.smithi084.stdout: "pools": 4, 2024-03-30T12:21:58.731 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_by_class": { 2024-03-30T12:21:58.731 INFO:tasks.workunit.client.0.smithi084.stdout: "ssd": { 2024-03-30T12:21:58.731 INFO:tasks.workunit.client.0.smithi084.stdout: "total_avail_bytes": 767710539776, 2024-03-30T12:21:58.731 INFO:tasks.workunit.client.0.smithi084.stdout: "total_bytes": 767960285184, 2024-03-30T12:21:58.731 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_bytes": 249745408, 2024-03-30T12:21:58.731 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_raw_bytes": 249745408, 2024-03-30T12:21:58.731 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_raw_ratio": 0.0003252061433158815 2024-03-30T12:21:58.731 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.731 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.732 INFO:tasks.workunit.client.0.smithi084.stdout: "total_avail_bytes": 767710539776, 2024-03-30T12:21:58.732 INFO:tasks.workunit.client.0.smithi084.stdout: "total_bytes": 767960285184, 2024-03-30T12:21:58.732 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_bytes": 249745408 2024-03-30T12:21:58.732 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.732 INFO:tasks.workunit.client.0.smithi084.stdout:} 2024-03-30T12:21:58.732 INFO:tasks.workunit.client.0.smithi084.stdout:Device report is generated separately. To see it run 'ceph telemetry show-device'. 2024-03-30T12:21:58.732 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "telemetry collection ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.732 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "telemetry collection ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.733 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='client.24869 -' entity='client.admin' cmd=[{"prefix": "telemetry on", "license": "sharing-1-0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.733 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='client.24869 -' entity='client.admin' cmd=[{"prefix": "telemetry on", "license": "sharing-1-0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.733 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: pgmap v76: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:58.733 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:58.733 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:58.733 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:21:58.733 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:21:58.733 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:58.733 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:58.733 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:58.733 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.734 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.734 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.734 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.734 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.734 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.734 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.734 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.734 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.734 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.734 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.734 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.734 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.735 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.735 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.735 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "telemetry collection ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.735 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "telemetry collection ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.735 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='client.24869 -' entity='client.admin' cmd=[{"prefix": "telemetry on", "license": "sharing-1-0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.735 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='client.24869 -' entity='client.admin' cmd=[{"prefix": "telemetry on", "license": "sharing-1-0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.735 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: pgmap v76: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:58.735 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:58.736 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:58.736 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:21:58.736 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:21:58.736 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:58.736 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:58.736 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:58.736 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.736 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.736 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.736 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.736 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.736 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.737 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.737 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.737 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.737 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.737 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.737 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.737 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.737 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.737 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.737 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.738 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.738 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.738 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.738 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.738 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.738 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.738 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.738 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.738 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/327564434' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/telemetry/last_opt_revision"}]: dispatch 2024-03-30T12:21:58.738 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/327564434' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/telemetry/last_opt_revision"}]: dispatch 2024-03-30T12:21:58.738 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:58.739 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:58.739 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.739 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.739 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.739 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.739 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.739 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.739 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.739 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.739 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.739 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.739 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.740 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.740 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.740 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.740 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.740 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.740 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.740 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.740 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/327564434' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/telemetry/last_opt_revision"}]: dispatch 2024-03-30T12:21:58.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/327564434' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/telemetry/last_opt_revision"}]: dispatch 2024-03-30T12:21:58.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:58.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:58.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.742 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.742 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.742 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.742 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.742 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.742 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.742 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.742 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.742 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.742 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.742 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.743 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.743 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.743 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.743 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.743 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.743 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.743 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.743 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.743 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.744 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.744 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.744 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.744 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.744 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.744 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.744 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.744 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.745 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.745 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:56 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.745 INFO:tasks.workunit.client.0.smithi084.stderr:+ ceph telemetry show-device 2024-03-30T12:21:58.745 INFO:tasks.workunit.client.0.smithi084.stdout:{ 2024-03-30T12:21:58.746 INFO:tasks.workunit.client.0.smithi084.stdout: "17efb0a6-ee90-11ee-a0f6-0cc47a8fd751": { 2024-03-30T12:21:58.746 INFO:tasks.workunit.client.0.smithi084.stdout: "INTEL_SSDPEDMD400G4_17f043cc-ee90-11ee-a0f6-0cc47a8fd751": { 2024-03-30T12:21:58.746 INFO:tasks.workunit.client.0.smithi084.stdout: "20240330-121648": { 2024-03-30T12:21:58.746 INFO:tasks.workunit.client.0.smithi084.stdout: "device": { 2024-03-30T12:21:58.746 INFO:tasks.workunit.client.0.smithi084.stdout: "info_name": "/dev/nvme0n1", 2024-03-30T12:21:58.746 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "/dev/nvme0n1", 2024-03-30T12:21:58.746 INFO:tasks.workunit.client.0.smithi084.stdout: "protocol": "NVMe", 2024-03-30T12:21:58.746 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "nvme" 2024-03-30T12:21:58.746 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.746 INFO:tasks.workunit.client.0.smithi084.stdout: "firmware_version": "8DV101H0", 2024-03-30T12:21:58.746 INFO:tasks.workunit.client.0.smithi084.stdout: "host_id": "17efb0a6-ee90-11ee-a0f6-0cc47a8fd751", 2024-03-30T12:21:58.746 INFO:tasks.workunit.client.0.smithi084.stdout: "json_format_version": [ 2024-03-30T12:21:58.747 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.747 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.747 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.747 INFO:tasks.workunit.client.0.smithi084.stdout: "local_time": { 2024-03-30T12:21:58.747 INFO:tasks.workunit.client.0.smithi084.stdout: "asctime": "Sat Mar 30 12:16:47 2024 UTC", 2024-03-30T12:21:58.747 INFO:tasks.workunit.client.0.smithi084.stdout: "time_t": 1711801007 2024-03-30T12:21:58.747 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.747 INFO:tasks.workunit.client.0.smithi084.stdout: "logical_block_size": 512, 2024-03-30T12:21:58.747 INFO:tasks.workunit.client.0.smithi084.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-03-30T12:21:58.747 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_controller_id": 0, 2024-03-30T12:21:58.747 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-03-30T12:21:58.747 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_namespaces": [ 2024-03-30T12:21:58.747 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.748 INFO:tasks.workunit.client.0.smithi084.stdout: "capacity": { 2024-03-30T12:21:58.748 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:58.748 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:58.748 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.748 INFO:tasks.workunit.client.0.smithi084.stdout: "formatted_lba_size": 512, 2024-03-30T12:21:58.748 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 1, 2024-03-30T12:21:58.748 INFO:tasks.workunit.client.0.smithi084.stdout: "size": { 2024-03-30T12:21:58.748 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:58.748 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:58.748 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.748 INFO:tasks.workunit.client.0.smithi084.stdout: "utilization": { 2024-03-30T12:21:58.748 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:58.749 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:58.749 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.749 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.749 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.749 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_number_of_namespaces": 1, 2024-03-30T12:21:58.749 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_pci_vendor": { 2024-03-30T12:21:58.749 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 32902, 2024-03-30T12:21:58.749 INFO:tasks.workunit.client.0.smithi084.stdout: "subsystem_id": 32902 2024-03-30T12:21:58.749 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.749 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_add_log": { 2024-03-30T12:21:58.749 INFO:tasks.workunit.client.0.smithi084.stdout: "Device stats": { 2024-03-30T12:21:58.749 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_fw_downgrades": { 2024-03-30T12:21:58.750 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:58.750 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.750 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.750 INFO:tasks.workunit.client.0.smithi084.stdout: "crc_error_count": { 2024-03-30T12:21:58.750 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.750 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.750 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.750 INFO:tasks.workunit.client.0.smithi084.stdout: "end_to_end_error_detection_count": { 2024-03-30T12:21:58.750 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.750 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.750 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.750 INFO:tasks.workunit.client.0.smithi084.stdout: "erase_fail_count": { 2024-03-30T12:21:58.750 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.751 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.751 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.751 INFO:tasks.workunit.client.0.smithi084.stdout: "host_bytes_written": { 2024-03-30T12:21:58.751 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.751 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 29064747 2024-03-30T12:21:58.751 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.751 INFO:tasks.workunit.client.0.smithi084.stdout: "host_ctx_wear_used": { 2024-03-30T12:21:58.751 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.751 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 1 2024-03-30T12:21:58.751 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.751 INFO:tasks.workunit.client.0.smithi084.stdout: "media_bytes_read": { 2024-03-30T12:21:58.751 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:58.752 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.752 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.752 INFO:tasks.workunit.client.0.smithi084.stdout: "nand_bytes_written": { 2024-03-30T12:21:58.752 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.752 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 48148094 2024-03-30T12:21:58.752 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.752 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_stat_indicator": { 2024-03-30T12:21:58.752 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:58.752 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.752 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.752 INFO:tasks.workunit.client.0.smithi084.stdout: "pll_lock_loss_count": { 2024-03-30T12:21:58.752 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.753 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.753 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.753 INFO:tasks.workunit.client.0.smithi084.stdout: "program_fail_count": { 2024-03-30T12:21:58.753 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.753 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.753 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.753 INFO:tasks.workunit.client.0.smithi084.stdout: "re_alloc_sectr_cnt": { 2024-03-30T12:21:58.753 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:58.753 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.753 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.753 INFO:tasks.workunit.client.0.smithi084.stdout: "retry_buffer_overflow_count": { 2024-03-30T12:21:58.753 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.753 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.754 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.754 INFO:tasks.workunit.client.0.smithi084.stdout: "soft_ecc_err_rate": { 2024-03-30T12:21:58.754 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:58.754 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.754 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.754 INFO:tasks.workunit.client.0.smithi084.stdout: "thermal_throttle_status": { 2024-03-30T12:21:58.754 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.754 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-03-30T12:21:58.754 INFO:tasks.workunit.client.0.smithi084.stdout: "cnt": 0, 2024-03-30T12:21:58.754 INFO:tasks.workunit.client.0.smithi084.stdout: "pct": 0 2024-03-30T12:21:58.754 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.754 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.755 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_host_reads": { 2024-03-30T12:21:58.755 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.755 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-03-30T12:21:58.755 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.755 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_media_wear": { 2024-03-30T12:21:58.755 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.755 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 64 2024-03-30T12:21:58.755 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.755 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_timer": { 2024-03-30T12:21:58.755 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.755 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-03-30T12:21:58.755 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.756 INFO:tasks.workunit.client.0.smithi084.stdout: "unexp_power_loss": { 2024-03-30T12:21:58.756 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:58.756 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.756 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.756 INFO:tasks.workunit.client.0.smithi084.stdout: "wear_leveling": { 2024-03-30T12:21:58.756 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 90, 2024-03-30T12:21:58.756 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-03-30T12:21:58.756 INFO:tasks.workunit.client.0.smithi084.stdout: "avg": 3240, 2024-03-30T12:21:58.756 INFO:tasks.workunit.client.0.smithi084.stdout: "max": 3251, 2024-03-30T12:21:58.756 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 3229 2024-03-30T12:21:58.756 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.756 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.757 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.757 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel Smart log": "nvme0n1" 2024-03-30T12:21:58.757 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.757 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_log": { 2024-03-30T12:21:58.757 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare": 100, 2024-03-30T12:21:58.757 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare_threshold": 10, 2024-03-30T12:21:58.757 INFO:tasks.workunit.client.0.smithi084.stdout: "controller_busy_time": 14, 2024-03-30T12:21:58.757 INFO:tasks.workunit.client.0.smithi084.stdout: "critical_warning": 0, 2024-03-30T12:21:58.757 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_read": 412181458, 2024-03-30T12:21:58.757 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_written": 1904787272, 2024-03-30T12:21:58.757 INFO:tasks.workunit.client.0.smithi084.stdout: "host_reads": 7071122069, 2024-03-30T12:21:58.757 INFO:tasks.workunit.client.0.smithi084.stdout: "host_writes": 34331777573, 2024-03-30T12:21:58.758 INFO:tasks.workunit.client.0.smithi084.stdout: "media_errors": 0, 2024-03-30T12:21:58.758 INFO:tasks.workunit.client.0.smithi084.stdout: "num_err_log_entries": 0, 2024-03-30T12:21:58.758 INFO:tasks.workunit.client.0.smithi084.stdout: "percentage_used": 10, 2024-03-30T12:21:58.758 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycles": 49095, 2024-03-30T12:21:58.758 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_hours": 54192, 2024-03-30T12:21:58.758 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": 29, 2024-03-30T12:21:58.758 INFO:tasks.workunit.client.0.smithi084.stdout: "unsafe_shutdowns": 535 2024-03-30T12:21:58.758 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.758 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_vendor": "intel", 2024-03-30T12:21:58.758 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycle_count": 49095, 2024-03-30T12:21:58.758 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_time": { 2024-03-30T12:21:58.759 INFO:tasks.workunit.client.0.smithi084.stdout: "hours": 54192 2024-03-30T12:21:58.759 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.759 INFO:tasks.workunit.client.0.smithi084.stdout: "serial_number": "deleted", 2024-03-30T12:21:58.759 INFO:tasks.workunit.client.0.smithi084.stdout: "smart_status": { 2024-03-30T12:21:58.759 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme": { 2024-03-30T12:21:58.759 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:58.759 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.759 INFO:tasks.workunit.client.0.smithi084.stdout: "passed": true 2024-03-30T12:21:58.759 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.759 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl": { 2024-03-30T12:21:58.759 INFO:tasks.workunit.client.0.smithi084.stdout: "argv": [ 2024-03-30T12:21:58.759 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl", 2024-03-30T12:21:58.759 INFO:tasks.workunit.client.0.smithi084.stdout: "-x", 2024-03-30T12:21:58.760 INFO:tasks.workunit.client.0.smithi084.stdout: "--json=o", 2024-03-30T12:21:58.760 INFO:tasks.workunit.client.0.smithi084.stdout: "/dev/nvme0n1" 2024-03-30T12:21:58.760 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.760 INFO:tasks.workunit.client.0.smithi084.stdout: "build_info": "(local build)", 2024-03-30T12:21:58.760 INFO:tasks.workunit.client.0.smithi084.stdout: "exit_status": 0, 2024-03-30T12:21:58.760 INFO:tasks.workunit.client.0.smithi084.stdout: "output": [ 2024-03-30T12:21:58.760 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.14.0-434.el9.x86_64] (local build)", 2024-03-30T12:21:58.760 INFO:tasks.workunit.client.0.smithi084.stdout: "Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-03-30T12:21:58.760 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:58.760 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF INFORMATION SECTION ===", 2024-03-30T12:21:58.760 INFO:tasks.workunit.client.0.smithi084.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-03-30T12:21:58.760 INFO:tasks.workunit.client.0.smithi084.stdout: "Serial Number: deleted", 2024-03-30T12:21:58.761 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Version: 8DV101H0", 2024-03-30T12:21:58.761 INFO:tasks.workunit.client.0.smithi084.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-03-30T12:21:58.761 INFO:tasks.workunit.client.0.smithi084.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-03-30T12:21:58.761 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller ID: 0", 2024-03-30T12:21:58.761 INFO:tasks.workunit.client.0.smithi084.stdout: "Number of Namespaces: 1", 2024-03-30T12:21:58.761 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-03-30T12:21:58.761 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-03-30T12:21:58.761 INFO:tasks.workunit.client.0.smithi084.stdout: "Local Time is: Sat Mar 30 12:16:47 2024 UTC", 2024-03-30T12:21:58.761 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Updates (0x02): 1 Slot", 2024-03-30T12:21:58.761 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-03-30T12:21:58.761 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-03-30T12:21:58.761 INFO:tasks.workunit.client.0.smithi084.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-03-30T12:21:58.762 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:58.762 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported Power States", 2024-03-30T12:21:58.762 INFO:tasks.workunit.client.0.smithi084.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-03-30T12:21:58.762 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-03-30T12:21:58.762 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:58.762 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-03-30T12:21:58.762 INFO:tasks.workunit.client.0.smithi084.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-03-30T12:21:58.762 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 512 0 2", 2024-03-30T12:21:58.762 INFO:tasks.workunit.client.0.smithi084.stdout: " 1 - 512 8 2", 2024-03-30T12:21:58.762 INFO:tasks.workunit.client.0.smithi084.stdout: " 2 - 512 16 2", 2024-03-30T12:21:58.762 INFO:tasks.workunit.client.0.smithi084.stdout: " 3 - 4096 0 0", 2024-03-30T12:21:58.762 INFO:tasks.workunit.client.0.smithi084.stdout: " 4 - 4096 8 0", 2024-03-30T12:21:58.763 INFO:tasks.workunit.client.0.smithi084.stdout: " 5 - 4096 64 0", 2024-03-30T12:21:58.763 INFO:tasks.workunit.client.0.smithi084.stdout: " 6 - 4096 128 0", 2024-03-30T12:21:58.763 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:58.763 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF SMART DATA SECTION ===", 2024-03-30T12:21:58.763 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-03-30T12:21:58.763 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:58.763 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-03-30T12:21:58.763 INFO:tasks.workunit.client.0.smithi084.stdout: "Critical Warning: 0x00", 2024-03-30T12:21:58.763 INFO:tasks.workunit.client.0.smithi084.stdout: "Temperature: 29 Celsius", 2024-03-30T12:21:58.763 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare: 100%", 2024-03-30T12:21:58.763 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare Threshold: 10%", 2024-03-30T12:21:58.763 INFO:tasks.workunit.client.0.smithi084.stdout: "Percentage Used: 10%", 2024-03-30T12:21:58.764 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Read: 412,181,458 [211 TB]", 2024-03-30T12:21:58.764 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Written: 1,904,787,272 [975 TB]", 2024-03-30T12:21:58.764 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Read Commands: 7,071,122,069", 2024-03-30T12:21:58.764 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Write Commands: 34,331,777,573", 2024-03-30T12:21:58.764 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller Busy Time: 14", 2024-03-30T12:21:58.764 INFO:tasks.workunit.client.0.smithi084.stdout: "Power Cycles: 49,095", 2024-03-30T12:21:58.764 INFO:tasks.workunit.client.0.smithi084.stdout: "Power On Hours: 54,192", 2024-03-30T12:21:58.764 INFO:tasks.workunit.client.0.smithi084.stdout: "Unsafe Shutdowns: 535", 2024-03-30T12:21:58.764 INFO:tasks.workunit.client.0.smithi084.stdout: "Media and Data Integrity Errors: 0", 2024-03-30T12:21:58.764 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information Log Entries: 0", 2024-03-30T12:21:58.764 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:58.764 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information (NVMe Log 0x01, max 64 entries)", 2024-03-30T12:21:58.765 INFO:tasks.workunit.client.0.smithi084.stdout: "No Errors Logged", 2024-03-30T12:21:58.765 INFO:tasks.workunit.client.0.smithi084.stdout: "" 2024-03-30T12:21:58.765 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.765 INFO:tasks.workunit.client.0.smithi084.stdout: "platform_info": "x86_64-linux-5.14.0-434.el9.x86_64", 2024-03-30T12:21:58.765 INFO:tasks.workunit.client.0.smithi084.stdout: "svn_revision": "5022", 2024-03-30T12:21:58.765 INFO:tasks.workunit.client.0.smithi084.stdout: "version": [ 2024-03-30T12:21:58.765 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.765 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.765 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:58.765 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.765 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": { 2024-03-30T12:21:58.765 INFO:tasks.workunit.client.0.smithi084.stdout: "current": 29 2024-03-30T12:21:58.765 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.765 INFO:tasks.workunit.client.0.smithi084.stdout: "user_capacity": { 2024-03-30T12:21:58.766 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:58.766 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:58.766 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.766 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.766 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.766 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.766 INFO:tasks.workunit.client.0.smithi084.stdout: "17f17a76-ee90-11ee-a0f6-0cc47a8fd751": { 2024-03-30T12:21:58.766 INFO:tasks.workunit.client.0.smithi084.stdout: "INTEL_SSDPEDMD400G4_17f1fdca-ee90-11ee-a0f6-0cc47a8fd751": { 2024-03-30T12:21:58.766 INFO:tasks.workunit.client.0.smithi084.stdout: "20240330-121645": { 2024-03-30T12:21:58.766 INFO:tasks.workunit.client.0.smithi084.stdout: "device": { 2024-03-30T12:21:58.766 INFO:tasks.workunit.client.0.smithi084.stdout: "info_name": "/dev/nvme0n1", 2024-03-30T12:21:58.766 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "/dev/nvme0n1", 2024-03-30T12:21:58.767 INFO:tasks.workunit.client.0.smithi084.stdout: "protocol": "NVMe", 2024-03-30T12:21:58.767 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "nvme" 2024-03-30T12:21:58.767 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.767 INFO:tasks.workunit.client.0.smithi084.stdout: "firmware_version": "8DV101H0", 2024-03-30T12:21:58.767 INFO:tasks.workunit.client.0.smithi084.stdout: "host_id": "17f17a76-ee90-11ee-a0f6-0cc47a8fd751", 2024-03-30T12:21:58.767 INFO:tasks.workunit.client.0.smithi084.stdout: "json_format_version": [ 2024-03-30T12:21:58.767 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.767 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.767 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.767 INFO:tasks.workunit.client.0.smithi084.stdout: "local_time": { 2024-03-30T12:21:58.767 INFO:tasks.workunit.client.0.smithi084.stdout: "asctime": "Sat Mar 30 12:16:45 2024 UTC", 2024-03-30T12:21:58.767 INFO:tasks.workunit.client.0.smithi084.stdout: "time_t": 1711801005 2024-03-30T12:21:58.768 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.768 INFO:tasks.workunit.client.0.smithi084.stdout: "logical_block_size": 512, 2024-03-30T12:21:58.768 INFO:tasks.workunit.client.0.smithi084.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-03-30T12:21:58.768 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_controller_id": 0, 2024-03-30T12:21:58.768 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-03-30T12:21:58.768 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_namespaces": [ 2024-03-30T12:21:58.768 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.768 INFO:tasks.workunit.client.0.smithi084.stdout: "capacity": { 2024-03-30T12:21:58.768 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:58.768 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:58.768 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.768 INFO:tasks.workunit.client.0.smithi084.stdout: "formatted_lba_size": 512, 2024-03-30T12:21:58.769 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 1, 2024-03-30T12:21:58.769 INFO:tasks.workunit.client.0.smithi084.stdout: "size": { 2024-03-30T12:21:58.769 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:58.769 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:58.769 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.769 INFO:tasks.workunit.client.0.smithi084.stdout: "utilization": { 2024-03-30T12:21:58.769 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:58.769 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:58.769 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.769 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.769 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.769 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_number_of_namespaces": 1, 2024-03-30T12:21:58.769 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_pci_vendor": { 2024-03-30T12:21:58.770 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 32902, 2024-03-30T12:21:58.770 INFO:tasks.workunit.client.0.smithi084.stdout: "subsystem_id": 32902 2024-03-30T12:21:58.770 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.770 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_add_log": { 2024-03-30T12:21:58.770 INFO:tasks.workunit.client.0.smithi084.stdout: "Device stats": { 2024-03-30T12:21:58.770 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_fw_downgrades": { 2024-03-30T12:21:58.770 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:58.770 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.770 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.770 INFO:tasks.workunit.client.0.smithi084.stdout: "crc_error_count": { 2024-03-30T12:21:58.770 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.770 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.771 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.771 INFO:tasks.workunit.client.0.smithi084.stdout: "end_to_end_error_detection_count": { 2024-03-30T12:21:58.771 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.771 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.771 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.771 INFO:tasks.workunit.client.0.smithi084.stdout: "erase_fail_count": { 2024-03-30T12:21:58.771 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.771 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.771 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.771 INFO:tasks.workunit.client.0.smithi084.stdout: "host_bytes_written": { 2024-03-30T12:21:58.771 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.771 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 33158836 2024-03-30T12:21:58.772 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.772 INFO:tasks.workunit.client.0.smithi084.stdout: "host_ctx_wear_used": { 2024-03-30T12:21:58.772 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.772 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 1 2024-03-30T12:21:58.772 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.772 INFO:tasks.workunit.client.0.smithi084.stdout: "media_bytes_read": { 2024-03-30T12:21:58.772 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:58.772 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.772 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.772 INFO:tasks.workunit.client.0.smithi084.stdout: "nand_bytes_written": { 2024-03-30T12:21:58.772 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.772 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 54845455 2024-03-30T12:21:58.772 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.773 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_stat_indicator": { 2024-03-30T12:21:58.773 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:58.773 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.773 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.773 INFO:tasks.workunit.client.0.smithi084.stdout: "pll_lock_loss_count": { 2024-03-30T12:21:58.773 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.773 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.773 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.773 INFO:tasks.workunit.client.0.smithi084.stdout: "program_fail_count": { 2024-03-30T12:21:58.773 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.773 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.773 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.773 INFO:tasks.workunit.client.0.smithi084.stdout: "re_alloc_sectr_cnt": { 2024-03-30T12:21:58.773 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:58.773 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.774 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.774 INFO:tasks.workunit.client.0.smithi084.stdout: "retry_buffer_overflow_count": { 2024-03-30T12:21:58.774 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.774 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.774 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.774 INFO:tasks.workunit.client.0.smithi084.stdout: "soft_ecc_err_rate": { 2024-03-30T12:21:58.774 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:58.774 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.774 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.774 INFO:tasks.workunit.client.0.smithi084.stdout: "thermal_throttle_status": { 2024-03-30T12:21:58.774 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.775 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-03-30T12:21:58.775 INFO:tasks.workunit.client.0.smithi084.stdout: "cnt": 0, 2024-03-30T12:21:58.775 INFO:tasks.workunit.client.0.smithi084.stdout: "pct": 0 2024-03-30T12:21:58.775 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.775 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.775 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_host_reads": { 2024-03-30T12:21:58.775 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.775 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-03-30T12:21:58.775 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.775 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_media_wear": { 2024-03-30T12:21:58.775 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.775 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 64 2024-03-30T12:21:58.776 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.776 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_timer": { 2024-03-30T12:21:58.776 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.776 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-03-30T12:21:58.776 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.776 INFO:tasks.workunit.client.0.smithi084.stdout: "unexp_power_loss": { 2024-03-30T12:21:58.776 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:58.776 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.776 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.776 INFO:tasks.workunit.client.0.smithi084.stdout: "wear_leveling": { 2024-03-30T12:21:58.776 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 88, 2024-03-30T12:21:58.776 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-03-30T12:21:58.776 INFO:tasks.workunit.client.0.smithi084.stdout: "avg": 3701, 2024-03-30T12:21:58.777 INFO:tasks.workunit.client.0.smithi084.stdout: "max": 3720, 2024-03-30T12:21:58.777 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 3684 2024-03-30T12:21:58.777 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.777 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.777 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.777 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel Smart log": "nvme0n1" 2024-03-30T12:21:58.777 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.777 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_log": { 2024-03-30T12:21:58.777 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare": 100, 2024-03-30T12:21:58.777 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare_threshold": 10, 2024-03-30T12:21:58.777 INFO:tasks.workunit.client.0.smithi084.stdout: "controller_busy_time": 6, 2024-03-30T12:21:58.778 INFO:tasks.workunit.client.0.smithi084.stdout: "critical_warning": 0, 2024-03-30T12:21:58.778 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_read": 444467307, 2024-03-30T12:21:58.778 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_written": 2173097505, 2024-03-30T12:21:58.778 INFO:tasks.workunit.client.0.smithi084.stdout: "host_reads": 7000448296, 2024-03-30T12:21:58.778 INFO:tasks.workunit.client.0.smithi084.stdout: "host_writes": 36885402494, 2024-03-30T12:21:58.778 INFO:tasks.workunit.client.0.smithi084.stdout: "media_errors": 0, 2024-03-30T12:21:58.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_err_log_entries": 0, 2024-03-30T12:21:58.778 INFO:tasks.workunit.client.0.smithi084.stdout: "percentage_used": 12, 2024-03-30T12:21:58.778 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycles": 55516, 2024-03-30T12:21:58.778 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_hours": 55370, 2024-03-30T12:21:58.778 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": 27, 2024-03-30T12:21:58.778 INFO:tasks.workunit.client.0.smithi084.stdout: "unsafe_shutdowns": 272 2024-03-30T12:21:58.778 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.779 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_vendor": "intel", 2024-03-30T12:21:58.779 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycle_count": 55516, 2024-03-30T12:21:58.779 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_time": { 2024-03-30T12:21:58.779 INFO:tasks.workunit.client.0.smithi084.stdout: "hours": 55370 2024-03-30T12:21:58.779 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.779 INFO:tasks.workunit.client.0.smithi084.stdout: "serial_number": "deleted", 2024-03-30T12:21:58.779 INFO:tasks.workunit.client.0.smithi084.stdout: "smart_status": { 2024-03-30T12:21:58.779 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme": { 2024-03-30T12:21:58.779 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:58.779 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.779 INFO:tasks.workunit.client.0.smithi084.stdout: "passed": true 2024-03-30T12:21:58.779 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.779 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl": { 2024-03-30T12:21:58.780 INFO:tasks.workunit.client.0.smithi084.stdout: "argv": [ 2024-03-30T12:21:58.780 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl", 2024-03-30T12:21:58.780 INFO:tasks.workunit.client.0.smithi084.stdout: "-x", 2024-03-30T12:21:58.780 INFO:tasks.workunit.client.0.smithi084.stdout: "--json=o", 2024-03-30T12:21:58.780 INFO:tasks.workunit.client.0.smithi084.stdout: "/dev/nvme0n1" 2024-03-30T12:21:58.780 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.780 INFO:tasks.workunit.client.0.smithi084.stdout: "build_info": "(local build)", 2024-03-30T12:21:58.780 INFO:tasks.workunit.client.0.smithi084.stdout: "exit_status": 0, 2024-03-30T12:21:58.780 INFO:tasks.workunit.client.0.smithi084.stdout: "output": [ 2024-03-30T12:21:58.780 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.14.0-434.el9.x86_64] (local build)", 2024-03-30T12:21:58.780 INFO:tasks.workunit.client.0.smithi084.stdout: "Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-03-30T12:21:58.780 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:58.781 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF INFORMATION SECTION ===", 2024-03-30T12:21:58.781 INFO:tasks.workunit.client.0.smithi084.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-03-30T12:21:58.781 INFO:tasks.workunit.client.0.smithi084.stdout: "Serial Number: deleted", 2024-03-30T12:21:58.781 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Version: 8DV101H0", 2024-03-30T12:21:58.781 INFO:tasks.workunit.client.0.smithi084.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-03-30T12:21:58.781 INFO:tasks.workunit.client.0.smithi084.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-03-30T12:21:58.781 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller ID: 0", 2024-03-30T12:21:58.781 INFO:tasks.workunit.client.0.smithi084.stdout: "Number of Namespaces: 1", 2024-03-30T12:21:58.781 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-03-30T12:21:58.781 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-03-30T12:21:58.781 INFO:tasks.workunit.client.0.smithi084.stdout: "Local Time is: Sat Mar 30 12:16:45 2024 UTC", 2024-03-30T12:21:58.781 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Updates (0x02): 1 Slot", 2024-03-30T12:21:58.782 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-03-30T12:21:58.782 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-03-30T12:21:58.782 INFO:tasks.workunit.client.0.smithi084.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-03-30T12:21:58.782 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:58.782 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported Power States", 2024-03-30T12:21:58.782 INFO:tasks.workunit.client.0.smithi084.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-03-30T12:21:58.782 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-03-30T12:21:58.782 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:58.782 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-03-30T12:21:58.782 INFO:tasks.workunit.client.0.smithi084.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-03-30T12:21:58.782 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 512 0 2", 2024-03-30T12:21:58.782 INFO:tasks.workunit.client.0.smithi084.stdout: " 1 - 512 8 2", 2024-03-30T12:21:58.783 INFO:tasks.workunit.client.0.smithi084.stdout: " 2 - 512 16 2", 2024-03-30T12:21:58.783 INFO:tasks.workunit.client.0.smithi084.stdout: " 3 - 4096 0 0", 2024-03-30T12:21:58.783 INFO:tasks.workunit.client.0.smithi084.stdout: " 4 - 4096 8 0", 2024-03-30T12:21:58.783 INFO:tasks.workunit.client.0.smithi084.stdout: " 5 - 4096 64 0", 2024-03-30T12:21:58.783 INFO:tasks.workunit.client.0.smithi084.stdout: " 6 - 4096 128 0", 2024-03-30T12:21:58.783 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:58.783 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF SMART DATA SECTION ===", 2024-03-30T12:21:58.783 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-03-30T12:21:58.783 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:58.783 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-03-30T12:21:58.783 INFO:tasks.workunit.client.0.smithi084.stdout: "Critical Warning: 0x00", 2024-03-30T12:21:58.783 INFO:tasks.workunit.client.0.smithi084.stdout: "Temperature: 27 Celsius", 2024-03-30T12:21:58.784 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare: 100%", 2024-03-30T12:21:58.784 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare Threshold: 10%", 2024-03-30T12:21:58.784 INFO:tasks.workunit.client.0.smithi084.stdout: "Percentage Used: 12%", 2024-03-30T12:21:58.784 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Read: 444,467,307 [227 TB]", 2024-03-30T12:21:58.784 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Written: 2,173,097,505 [1.11 PB]", 2024-03-30T12:21:58.784 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Read Commands: 7,000,448,296", 2024-03-30T12:21:58.784 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Write Commands: 36,885,402,494", 2024-03-30T12:21:58.784 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller Busy Time: 6", 2024-03-30T12:21:58.784 INFO:tasks.workunit.client.0.smithi084.stdout: "Power Cycles: 55,516", 2024-03-30T12:21:58.784 INFO:tasks.workunit.client.0.smithi084.stdout: "Power On Hours: 55,370", 2024-03-30T12:21:58.784 INFO:tasks.workunit.client.0.smithi084.stdout: "Unsafe Shutdowns: 272", 2024-03-30T12:21:58.784 INFO:tasks.workunit.client.0.smithi084.stdout: "Media and Data Integrity Errors: 0", 2024-03-30T12:21:58.784 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information Log Entries: 0", 2024-03-30T12:21:58.785 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:58.785 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information (NVMe Log 0x01, max 64 entries)", 2024-03-30T12:21:58.785 INFO:tasks.workunit.client.0.smithi084.stdout: "No Errors Logged", 2024-03-30T12:21:58.785 INFO:tasks.workunit.client.0.smithi084.stdout: "" 2024-03-30T12:21:58.785 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.785 INFO:tasks.workunit.client.0.smithi084.stdout: "platform_info": "x86_64-linux-5.14.0-434.el9.x86_64", 2024-03-30T12:21:58.785 INFO:tasks.workunit.client.0.smithi084.stdout: "svn_revision": "5022", 2024-03-30T12:21:58.785 INFO:tasks.workunit.client.0.smithi084.stdout: "version": [ 2024-03-30T12:21:58.785 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.785 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.785 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:58.785 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.786 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": { 2024-03-30T12:21:58.786 INFO:tasks.workunit.client.0.smithi084.stdout: "current": 27 2024-03-30T12:21:58.786 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.786 INFO:tasks.workunit.client.0.smithi084.stdout: "user_capacity": { 2024-03-30T12:21:58.786 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:58.786 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:58.786 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.786 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.786 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.786 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.786 INFO:tasks.workunit.client.0.smithi084.stdout:} 2024-03-30T12:21:58.787 INFO:tasks.workunit.client.0.smithi084.stderr:+ ceph telemetry show-all 2024-03-30T12:21:58.787 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='client.24875 -' entity='client.admin' cmd=[{"prefix": "telemetry enable channel", "channels": ["perf"], "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.787 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='client.24875 -' entity='client.admin' cmd=[{"prefix": "telemetry enable channel", "channels": ["perf"], "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.787 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "telemetry show", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.787 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "telemetry show", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.787 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:58.787 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:58.788 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.788 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.788 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.788 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.788 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.788 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.788 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.788 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.788 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.788 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.788 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.788 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.788 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.789 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.789 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.789 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.789 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.789 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.789 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.789 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.789 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.790 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='client.24875 -' entity='client.admin' cmd=[{"prefix": "telemetry enable channel", "channels": ["perf"], "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.790 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='client.24875 -' entity='client.admin' cmd=[{"prefix": "telemetry enable channel", "channels": ["perf"], "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.790 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "telemetry show", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.790 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "telemetry show", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.790 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:58.790 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:58.790 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.790 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.790 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.790 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.791 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.791 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.791 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.791 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.791 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.791 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.791 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.791 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.791 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.791 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.791 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.792 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.792 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.792 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.792 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.792 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.792 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.792 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.792 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.792 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.792 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='client.24911 -' entity='client.admin' cmd=[{"prefix": "telemetry show-device", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.792 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: from='client.24911 -' entity='client.admin' cmd=[{"prefix": "telemetry show-device", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.793 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[27000]: pgmap v77: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 25 op/s 2024-03-30T12:21:58.793 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.793 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.793 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.793 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='client.24911 -' entity='client.admin' cmd=[{"prefix": "telemetry show-device", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.793 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: from='client.24911 -' entity='client.admin' cmd=[{"prefix": "telemetry show-device", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.793 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:57 smithi084 ceph-mon[37565]: pgmap v77: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 25 op/s 2024-03-30T12:21:58.796 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "telemetry collection ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.796 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "telemetry collection ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.796 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='client.24869 -' entity='client.admin' cmd=[{"prefix": "telemetry on", "license": "sharing-1-0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.796 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='client.24869 -' entity='client.admin' cmd=[{"prefix": "telemetry on", "license": "sharing-1-0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.796 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: pgmap v76: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:21:58.796 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:58.797 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:58.797 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:21:58.797 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:21:58.797 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:21:58.797 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:58.797 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:58.797 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.797 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.797 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.797 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.797 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.797 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.798 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.798 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.798 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.798 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.798 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.798 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.798 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.798 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.798 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.798 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.798 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.798 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.799 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.799 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.799 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.799 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.799 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.799 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.799 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/327564434' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/telemetry/last_opt_revision"}]: dispatch 2024-03-30T12:21:58.799 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/327564434' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/telemetry/last_opt_revision"}]: dispatch 2024-03-30T12:21:58.799 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:58.799 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:58.799 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.799 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.800 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.800 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.800 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.800 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.800 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.800 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.800 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.800 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.800 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.800 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.800 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.800 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.800 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:56 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='client.24875 -' entity='client.admin' cmd=[{"prefix": "telemetry enable channel", "channels": ["perf"], "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='client.24875 -' entity='client.admin' cmd=[{"prefix": "telemetry enable channel", "channels": ["perf"], "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "telemetry show", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "telemetry show", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:21:58.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:21:58.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.803 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.803 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.803 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.803 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.803 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.803 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.803 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.803 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.803 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.803 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:21:58.803 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:21:58.803 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:21:58.804 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:21:58.804 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:21:58.804 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='client.24911 -' entity='client.admin' cmd=[{"prefix": "telemetry show-device", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.804 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: from='client.24911 -' entity='client.admin' cmd=[{"prefix": "telemetry show-device", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:21:58.804 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:57 smithi162 ceph-mon[30421]: pgmap v77: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 25 op/s 2024-03-30T12:21:58.811 INFO:tasks.workunit.client.0.smithi084.stdout:{ 2024-03-30T12:21:58.812 INFO:tasks.workunit.client.0.smithi084.stdout: "device_report": { 2024-03-30T12:21:58.812 INFO:tasks.workunit.client.0.smithi084.stdout: "17efb0a6-ee90-11ee-a0f6-0cc47a8fd751": { 2024-03-30T12:21:58.812 INFO:tasks.workunit.client.0.smithi084.stdout: "INTEL_SSDPEDMD400G4_17f043cc-ee90-11ee-a0f6-0cc47a8fd751": { 2024-03-30T12:21:58.812 INFO:tasks.workunit.client.0.smithi084.stdout: "20240330-121648": { 2024-03-30T12:21:58.812 INFO:tasks.workunit.client.0.smithi084.stdout: "device": { 2024-03-30T12:21:58.812 INFO:tasks.workunit.client.0.smithi084.stdout: "info_name": "/dev/nvme0n1", 2024-03-30T12:21:58.812 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "/dev/nvme0n1", 2024-03-30T12:21:58.812 INFO:tasks.workunit.client.0.smithi084.stdout: "protocol": "NVMe", 2024-03-30T12:21:58.812 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "nvme" 2024-03-30T12:21:58.812 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.812 INFO:tasks.workunit.client.0.smithi084.stdout: "firmware_version": "8DV101H0", 2024-03-30T12:21:58.813 INFO:tasks.workunit.client.0.smithi084.stdout: "host_id": "17efb0a6-ee90-11ee-a0f6-0cc47a8fd751", 2024-03-30T12:21:58.813 INFO:tasks.workunit.client.0.smithi084.stdout: "json_format_version": [ 2024-03-30T12:21:58.813 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.813 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.813 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.813 INFO:tasks.workunit.client.0.smithi084.stdout: "local_time": { 2024-03-30T12:21:58.813 INFO:tasks.workunit.client.0.smithi084.stdout: "asctime": "Sat Mar 30 12:16:47 2024 UTC", 2024-03-30T12:21:58.813 INFO:tasks.workunit.client.0.smithi084.stdout: "time_t": 1711801007 2024-03-30T12:21:58.813 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.813 INFO:tasks.workunit.client.0.smithi084.stdout: "logical_block_size": 512, 2024-03-30T12:21:58.813 INFO:tasks.workunit.client.0.smithi084.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-03-30T12:21:58.813 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_controller_id": 0, 2024-03-30T12:21:58.813 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-03-30T12:21:58.814 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_namespaces": [ 2024-03-30T12:21:58.814 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.814 INFO:tasks.workunit.client.0.smithi084.stdout: "capacity": { 2024-03-30T12:21:58.814 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:58.814 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:58.814 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.814 INFO:tasks.workunit.client.0.smithi084.stdout: "formatted_lba_size": 512, 2024-03-30T12:21:58.814 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 1, 2024-03-30T12:21:58.814 INFO:tasks.workunit.client.0.smithi084.stdout: "size": { 2024-03-30T12:21:58.814 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:58.814 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:58.814 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.815 INFO:tasks.workunit.client.0.smithi084.stdout: "utilization": { 2024-03-30T12:21:58.815 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:58.815 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:58.815 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.815 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.815 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.815 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_number_of_namespaces": 1, 2024-03-30T12:21:58.815 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_pci_vendor": { 2024-03-30T12:21:58.815 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 32902, 2024-03-30T12:21:58.815 INFO:tasks.workunit.client.0.smithi084.stdout: "subsystem_id": 32902 2024-03-30T12:21:58.815 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.815 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_add_log": { 2024-03-30T12:21:58.816 INFO:tasks.workunit.client.0.smithi084.stdout: "Device stats": { 2024-03-30T12:21:58.816 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_fw_downgrades": { 2024-03-30T12:21:58.816 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:58.816 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.816 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.816 INFO:tasks.workunit.client.0.smithi084.stdout: "crc_error_count": { 2024-03-30T12:21:58.816 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.816 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.816 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.816 INFO:tasks.workunit.client.0.smithi084.stdout: "end_to_end_error_detection_count": { 2024-03-30T12:21:58.816 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.816 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.816 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.817 INFO:tasks.workunit.client.0.smithi084.stdout: "erase_fail_count": { 2024-03-30T12:21:58.817 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.817 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.817 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.817 INFO:tasks.workunit.client.0.smithi084.stdout: "host_bytes_written": { 2024-03-30T12:21:58.817 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.817 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 29064747 2024-03-30T12:21:58.817 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.817 INFO:tasks.workunit.client.0.smithi084.stdout: "host_ctx_wear_used": { 2024-03-30T12:21:58.817 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.817 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 1 2024-03-30T12:21:58.817 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.817 INFO:tasks.workunit.client.0.smithi084.stdout: "media_bytes_read": { 2024-03-30T12:21:58.818 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:58.818 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.818 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.818 INFO:tasks.workunit.client.0.smithi084.stdout: "nand_bytes_written": { 2024-03-30T12:21:58.818 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.818 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 48148094 2024-03-30T12:21:58.818 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.818 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_stat_indicator": { 2024-03-30T12:21:58.818 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:58.818 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.818 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.818 INFO:tasks.workunit.client.0.smithi084.stdout: "pll_lock_loss_count": { 2024-03-30T12:21:58.819 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.819 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.819 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.819 INFO:tasks.workunit.client.0.smithi084.stdout: "program_fail_count": { 2024-03-30T12:21:58.819 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.819 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.819 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.819 INFO:tasks.workunit.client.0.smithi084.stdout: "re_alloc_sectr_cnt": { 2024-03-30T12:21:58.819 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:58.819 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.819 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.819 INFO:tasks.workunit.client.0.smithi084.stdout: "retry_buffer_overflow_count": { 2024-03-30T12:21:58.819 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.819 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.820 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.820 INFO:tasks.workunit.client.0.smithi084.stdout: "soft_ecc_err_rate": { 2024-03-30T12:21:58.820 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:58.820 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.820 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.820 INFO:tasks.workunit.client.0.smithi084.stdout: "thermal_throttle_status": { 2024-03-30T12:21:58.820 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.820 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-03-30T12:21:58.820 INFO:tasks.workunit.client.0.smithi084.stdout: "cnt": 0, 2024-03-30T12:21:58.820 INFO:tasks.workunit.client.0.smithi084.stdout: "pct": 0 2024-03-30T12:21:58.820 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.820 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.821 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_host_reads": { 2024-03-30T12:21:58.821 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.821 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-03-30T12:21:58.821 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.821 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_media_wear": { 2024-03-30T12:21:58.821 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.821 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 64 2024-03-30T12:21:58.821 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.821 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_timer": { 2024-03-30T12:21:58.821 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.821 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-03-30T12:21:58.821 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.822 INFO:tasks.workunit.client.0.smithi084.stdout: "unexp_power_loss": { 2024-03-30T12:21:58.822 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:58.822 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.822 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.822 INFO:tasks.workunit.client.0.smithi084.stdout: "wear_leveling": { 2024-03-30T12:21:58.822 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 90, 2024-03-30T12:21:58.822 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-03-30T12:21:58.822 INFO:tasks.workunit.client.0.smithi084.stdout: "avg": 3240, 2024-03-30T12:21:58.822 INFO:tasks.workunit.client.0.smithi084.stdout: "max": 3251, 2024-03-30T12:21:58.822 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 3229 2024-03-30T12:21:58.822 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.823 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.823 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.823 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel Smart log": "nvme0n1" 2024-03-30T12:21:58.823 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.823 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_log": { 2024-03-30T12:21:58.823 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare": 100, 2024-03-30T12:21:58.823 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare_threshold": 10, 2024-03-30T12:21:58.823 INFO:tasks.workunit.client.0.smithi084.stdout: "controller_busy_time": 14, 2024-03-30T12:21:58.823 INFO:tasks.workunit.client.0.smithi084.stdout: "critical_warning": 0, 2024-03-30T12:21:58.823 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_read": 412181458, 2024-03-30T12:21:58.823 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_written": 1904787272, 2024-03-30T12:21:58.823 INFO:tasks.workunit.client.0.smithi084.stdout: "host_reads": 7071122069, 2024-03-30T12:21:58.824 INFO:tasks.workunit.client.0.smithi084.stdout: "host_writes": 34331777573, 2024-03-30T12:21:58.824 INFO:tasks.workunit.client.0.smithi084.stdout: "media_errors": 0, 2024-03-30T12:21:58.824 INFO:tasks.workunit.client.0.smithi084.stdout: "num_err_log_entries": 0, 2024-03-30T12:21:58.824 INFO:tasks.workunit.client.0.smithi084.stdout: "percentage_used": 10, 2024-03-30T12:21:58.824 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycles": 49095, 2024-03-30T12:21:58.824 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_hours": 54192, 2024-03-30T12:21:58.824 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": 29, 2024-03-30T12:21:58.824 INFO:tasks.workunit.client.0.smithi084.stdout: "unsafe_shutdowns": 535 2024-03-30T12:21:58.824 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.824 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_vendor": "intel", 2024-03-30T12:21:58.824 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycle_count": 49095, 2024-03-30T12:21:58.824 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_time": { 2024-03-30T12:21:58.825 INFO:tasks.workunit.client.0.smithi084.stdout: "hours": 54192 2024-03-30T12:21:58.825 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.825 INFO:tasks.workunit.client.0.smithi084.stdout: "serial_number": "deleted", 2024-03-30T12:21:58.825 INFO:tasks.workunit.client.0.smithi084.stdout: "smart_status": { 2024-03-30T12:21:58.825 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme": { 2024-03-30T12:21:58.825 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:58.825 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.825 INFO:tasks.workunit.client.0.smithi084.stdout: "passed": true 2024-03-30T12:21:58.825 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.825 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl": { 2024-03-30T12:21:58.825 INFO:tasks.workunit.client.0.smithi084.stdout: "argv": [ 2024-03-30T12:21:58.825 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl", 2024-03-30T12:21:58.825 INFO:tasks.workunit.client.0.smithi084.stdout: "-x", 2024-03-30T12:21:58.826 INFO:tasks.workunit.client.0.smithi084.stdout: "--json=o", 2024-03-30T12:21:58.826 INFO:tasks.workunit.client.0.smithi084.stdout: "/dev/nvme0n1" 2024-03-30T12:21:58.826 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.826 INFO:tasks.workunit.client.0.smithi084.stdout: "build_info": "(local build)", 2024-03-30T12:21:58.826 INFO:tasks.workunit.client.0.smithi084.stdout: "exit_status": 0, 2024-03-30T12:21:58.826 INFO:tasks.workunit.client.0.smithi084.stdout: "output": [ 2024-03-30T12:21:58.826 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.14.0-434.el9.x86_64] (local build)", 2024-03-30T12:21:58.826 INFO:tasks.workunit.client.0.smithi084.stdout: "Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-03-30T12:21:58.826 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:58.826 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF INFORMATION SECTION ===", 2024-03-30T12:21:58.826 INFO:tasks.workunit.client.0.smithi084.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-03-30T12:21:58.826 INFO:tasks.workunit.client.0.smithi084.stdout: "Serial Number: deleted", 2024-03-30T12:21:58.827 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Version: 8DV101H0", 2024-03-30T12:21:58.827 INFO:tasks.workunit.client.0.smithi084.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-03-30T12:21:58.827 INFO:tasks.workunit.client.0.smithi084.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-03-30T12:21:58.827 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller ID: 0", 2024-03-30T12:21:58.827 INFO:tasks.workunit.client.0.smithi084.stdout: "Number of Namespaces: 1", 2024-03-30T12:21:58.827 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-03-30T12:21:58.827 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-03-30T12:21:58.827 INFO:tasks.workunit.client.0.smithi084.stdout: "Local Time is: Sat Mar 30 12:16:47 2024 UTC", 2024-03-30T12:21:58.827 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Updates (0x02): 1 Slot", 2024-03-30T12:21:58.827 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-03-30T12:21:58.827 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-03-30T12:21:58.827 INFO:tasks.workunit.client.0.smithi084.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-03-30T12:21:58.828 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:58.828 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported Power States", 2024-03-30T12:21:58.828 INFO:tasks.workunit.client.0.smithi084.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-03-30T12:21:58.828 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-03-30T12:21:58.828 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:58.828 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-03-30T12:21:58.828 INFO:tasks.workunit.client.0.smithi084.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-03-30T12:21:58.828 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 512 0 2", 2024-03-30T12:21:58.828 INFO:tasks.workunit.client.0.smithi084.stdout: " 1 - 512 8 2", 2024-03-30T12:21:58.828 INFO:tasks.workunit.client.0.smithi084.stdout: " 2 - 512 16 2", 2024-03-30T12:21:58.828 INFO:tasks.workunit.client.0.smithi084.stdout: " 3 - 4096 0 0", 2024-03-30T12:21:58.828 INFO:tasks.workunit.client.0.smithi084.stdout: " 4 - 4096 8 0", 2024-03-30T12:21:58.828 INFO:tasks.workunit.client.0.smithi084.stdout: " 5 - 4096 64 0", 2024-03-30T12:21:58.829 INFO:tasks.workunit.client.0.smithi084.stdout: " 6 - 4096 128 0", 2024-03-30T12:21:58.829 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:58.829 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF SMART DATA SECTION ===", 2024-03-30T12:21:58.829 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-03-30T12:21:58.829 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:58.829 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-03-30T12:21:58.829 INFO:tasks.workunit.client.0.smithi084.stdout: "Critical Warning: 0x00", 2024-03-30T12:21:58.829 INFO:tasks.workunit.client.0.smithi084.stdout: "Temperature: 29 Celsius", 2024-03-30T12:21:58.829 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare: 100%", 2024-03-30T12:21:58.829 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare Threshold: 10%", 2024-03-30T12:21:58.829 INFO:tasks.workunit.client.0.smithi084.stdout: "Percentage Used: 10%", 2024-03-30T12:21:58.829 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Read: 412,181,458 [211 TB]", 2024-03-30T12:21:58.829 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Written: 1,904,787,272 [975 TB]", 2024-03-30T12:21:58.830 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Read Commands: 7,071,122,069", 2024-03-30T12:21:58.830 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Write Commands: 34,331,777,573", 2024-03-30T12:21:58.830 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller Busy Time: 14", 2024-03-30T12:21:58.830 INFO:tasks.workunit.client.0.smithi084.stdout: "Power Cycles: 49,095", 2024-03-30T12:21:58.830 INFO:tasks.workunit.client.0.smithi084.stdout: "Power On Hours: 54,192", 2024-03-30T12:21:58.830 INFO:tasks.workunit.client.0.smithi084.stdout: "Unsafe Shutdowns: 535", 2024-03-30T12:21:58.830 INFO:tasks.workunit.client.0.smithi084.stdout: "Media and Data Integrity Errors: 0", 2024-03-30T12:21:58.830 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information Log Entries: 0", 2024-03-30T12:21:58.830 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:58.830 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information (NVMe Log 0x01, max 64 entries)", 2024-03-30T12:21:58.830 INFO:tasks.workunit.client.0.smithi084.stdout: "No Errors Logged", 2024-03-30T12:21:58.830 INFO:tasks.workunit.client.0.smithi084.stdout: "" 2024-03-30T12:21:58.831 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.831 INFO:tasks.workunit.client.0.smithi084.stdout: "platform_info": "x86_64-linux-5.14.0-434.el9.x86_64", 2024-03-30T12:21:58.831 INFO:tasks.workunit.client.0.smithi084.stdout: "svn_revision": "5022", 2024-03-30T12:21:58.831 INFO:tasks.workunit.client.0.smithi084.stdout: "version": [ 2024-03-30T12:21:58.831 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.831 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.831 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:58.831 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.831 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": { 2024-03-30T12:21:58.831 INFO:tasks.workunit.client.0.smithi084.stdout: "current": 29 2024-03-30T12:21:58.831 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.831 INFO:tasks.workunit.client.0.smithi084.stdout: "user_capacity": { 2024-03-30T12:21:58.831 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:58.831 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:58.832 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.832 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.832 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.832 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.832 INFO:tasks.workunit.client.0.smithi084.stdout: "17f17a76-ee90-11ee-a0f6-0cc47a8fd751": { 2024-03-30T12:21:58.832 INFO:tasks.workunit.client.0.smithi084.stdout: "INTEL_SSDPEDMD400G4_17f1fdca-ee90-11ee-a0f6-0cc47a8fd751": { 2024-03-30T12:21:58.832 INFO:tasks.workunit.client.0.smithi084.stdout: "20240330-121645": { 2024-03-30T12:21:58.832 INFO:tasks.workunit.client.0.smithi084.stdout: "device": { 2024-03-30T12:21:58.832 INFO:tasks.workunit.client.0.smithi084.stdout: "info_name": "/dev/nvme0n1", 2024-03-30T12:21:58.832 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "/dev/nvme0n1", 2024-03-30T12:21:58.832 INFO:tasks.workunit.client.0.smithi084.stdout: "protocol": "NVMe", 2024-03-30T12:21:58.832 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "nvme" 2024-03-30T12:21:58.832 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.832 INFO:tasks.workunit.client.0.smithi084.stdout: "firmware_version": "8DV101H0", 2024-03-30T12:21:58.833 INFO:tasks.workunit.client.0.smithi084.stdout: "host_id": "17f17a76-ee90-11ee-a0f6-0cc47a8fd751", 2024-03-30T12:21:58.833 INFO:tasks.workunit.client.0.smithi084.stdout: "json_format_version": [ 2024-03-30T12:21:58.833 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:58.833 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:58.833 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.833 INFO:tasks.workunit.client.0.smithi084.stdout: "local_time": { 2024-03-30T12:21:58.833 INFO:tasks.workunit.client.0.smithi084.stdout: "asctime": "Sat Mar 30 12:16:45 2024 UTC", 2024-03-30T12:21:58.833 INFO:tasks.workunit.client.0.smithi084.stdout: "time_t": 1711801005 2024-03-30T12:21:58.833 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.833 INFO:tasks.workunit.client.0.smithi084.stdout: "logical_block_size": 512, 2024-03-30T12:21:58.833 INFO:tasks.workunit.client.0.smithi084.stdout: "model_name": "INTEL SSDPEDMD400G4", 2024-03-30T12:21:58.833 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_controller_id": 0, 2024-03-30T12:21:58.833 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_ieee_oui_identifier": 6083300, 2024-03-30T12:21:58.833 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_namespaces": [ 2024-03-30T12:21:58.833 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.834 INFO:tasks.workunit.client.0.smithi084.stdout: "capacity": { 2024-03-30T12:21:58.834 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:58.834 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:58.834 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.834 INFO:tasks.workunit.client.0.smithi084.stdout: "formatted_lba_size": 512, 2024-03-30T12:21:58.834 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 1, 2024-03-30T12:21:58.834 INFO:tasks.workunit.client.0.smithi084.stdout: "size": { 2024-03-30T12:21:58.834 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:58.834 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:58.834 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.834 INFO:tasks.workunit.client.0.smithi084.stdout: "utilization": { 2024-03-30T12:21:58.834 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:58.834 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:58.835 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.835 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.835 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.835 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_number_of_namespaces": 1, 2024-03-30T12:21:58.835 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_pci_vendor": { 2024-03-30T12:21:58.835 INFO:tasks.workunit.client.0.smithi084.stdout: "id": 32902, 2024-03-30T12:21:58.835 INFO:tasks.workunit.client.0.smithi084.stdout: "subsystem_id": 32902 2024-03-30T12:21:58.835 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.835 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_add_log": { 2024-03-30T12:21:58.835 INFO:tasks.workunit.client.0.smithi084.stdout: "Device stats": { 2024-03-30T12:21:58.835 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_fw_downgrades": { 2024-03-30T12:21:58.835 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:58.835 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.836 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.836 INFO:tasks.workunit.client.0.smithi084.stdout: "crc_error_count": { 2024-03-30T12:21:58.836 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.836 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.836 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.836 INFO:tasks.workunit.client.0.smithi084.stdout: "end_to_end_error_detection_count": { 2024-03-30T12:21:58.836 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.836 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.836 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.836 INFO:tasks.workunit.client.0.smithi084.stdout: "erase_fail_count": { 2024-03-30T12:21:58.836 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.836 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.836 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.837 INFO:tasks.workunit.client.0.smithi084.stdout: "host_bytes_written": { 2024-03-30T12:21:58.837 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.837 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 33158836 2024-03-30T12:21:58.837 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.837 INFO:tasks.workunit.client.0.smithi084.stdout: "host_ctx_wear_used": { 2024-03-30T12:21:58.837 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.837 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 1 2024-03-30T12:21:58.837 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.837 INFO:tasks.workunit.client.0.smithi084.stdout: "media_bytes_read": { 2024-03-30T12:21:58.837 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:58.837 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.837 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.837 INFO:tasks.workunit.client.0.smithi084.stdout: "nand_bytes_written": { 2024-03-30T12:21:58.838 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.838 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 54845455 2024-03-30T12:21:58.838 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.838 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_stat_indicator": { 2024-03-30T12:21:58.838 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:58.838 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.838 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.838 INFO:tasks.workunit.client.0.smithi084.stdout: "pll_lock_loss_count": { 2024-03-30T12:21:58.838 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.838 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.838 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.839 INFO:tasks.workunit.client.0.smithi084.stdout: "program_fail_count": { 2024-03-30T12:21:58.839 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.839 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.839 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.839 INFO:tasks.workunit.client.0.smithi084.stdout: "re_alloc_sectr_cnt": { 2024-03-30T12:21:58.839 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:58.839 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.839 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.839 INFO:tasks.workunit.client.0.smithi084.stdout: "retry_buffer_overflow_count": { 2024-03-30T12:21:58.839 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.839 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.839 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.840 INFO:tasks.workunit.client.0.smithi084.stdout: "soft_ecc_err_rate": { 2024-03-30T12:21:58.840 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:58.840 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.840 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.840 INFO:tasks.workunit.client.0.smithi084.stdout: "thermal_throttle_status": { 2024-03-30T12:21:58.840 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.840 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-03-30T12:21:58.840 INFO:tasks.workunit.client.0.smithi084.stdout: "cnt": 0, 2024-03-30T12:21:58.840 INFO:tasks.workunit.client.0.smithi084.stdout: "pct": 0 2024-03-30T12:21:58.840 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.840 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.840 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_host_reads": { 2024-03-30T12:21:58.841 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.841 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-03-30T12:21:58.841 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.841 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_media_wear": { 2024-03-30T12:21:58.841 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.841 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 64 2024-03-30T12:21:58.841 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.841 INFO:tasks.workunit.client.0.smithi084.stdout: "timed_workload_timer": { 2024-03-30T12:21:58.841 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 100, 2024-03-30T12:21:58.841 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 65535 2024-03-30T12:21:58.841 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.841 INFO:tasks.workunit.client.0.smithi084.stdout: "unexp_power_loss": { 2024-03-30T12:21:58.841 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 0, 2024-03-30T12:21:58.841 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": 0 2024-03-30T12:21:58.841 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.842 INFO:tasks.workunit.client.0.smithi084.stdout: "wear_leveling": { 2024-03-30T12:21:58.842 INFO:tasks.workunit.client.0.smithi084.stdout: "normalized": 88, 2024-03-30T12:21:58.842 INFO:tasks.workunit.client.0.smithi084.stdout: "raw": { 2024-03-30T12:21:58.842 INFO:tasks.workunit.client.0.smithi084.stdout: "avg": 3701, 2024-03-30T12:21:58.842 INFO:tasks.workunit.client.0.smithi084.stdout: "max": 3720, 2024-03-30T12:21:58.842 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 3684 2024-03-30T12:21:58.842 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.842 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.842 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.842 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel Smart log": "nvme0n1" 2024-03-30T12:21:58.842 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.843 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_smart_health_information_log": { 2024-03-30T12:21:58.843 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare": 100, 2024-03-30T12:21:58.843 INFO:tasks.workunit.client.0.smithi084.stdout: "available_spare_threshold": 10, 2024-03-30T12:21:58.843 INFO:tasks.workunit.client.0.smithi084.stdout: "controller_busy_time": 6, 2024-03-30T12:21:58.843 INFO:tasks.workunit.client.0.smithi084.stdout: "critical_warning": 0, 2024-03-30T12:21:58.843 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_read": 444467307, 2024-03-30T12:21:58.843 INFO:tasks.workunit.client.0.smithi084.stdout: "data_units_written": 2173097505, 2024-03-30T12:21:58.843 INFO:tasks.workunit.client.0.smithi084.stdout: "host_reads": 7000448296, 2024-03-30T12:21:58.843 INFO:tasks.workunit.client.0.smithi084.stdout: "host_writes": 36885402494, 2024-03-30T12:21:58.843 INFO:tasks.workunit.client.0.smithi084.stdout: "media_errors": 0, 2024-03-30T12:21:58.843 INFO:tasks.workunit.client.0.smithi084.stdout: "num_err_log_entries": 0, 2024-03-30T12:21:58.843 INFO:tasks.workunit.client.0.smithi084.stdout: "percentage_used": 12, 2024-03-30T12:21:58.843 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycles": 55516, 2024-03-30T12:21:58.843 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_hours": 55370, 2024-03-30T12:21:58.844 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": 27, 2024-03-30T12:21:58.844 INFO:tasks.workunit.client.0.smithi084.stdout: "unsafe_shutdowns": 272 2024-03-30T12:21:58.844 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.844 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme_vendor": "intel", 2024-03-30T12:21:58.844 INFO:tasks.workunit.client.0.smithi084.stdout: "power_cycle_count": 55516, 2024-03-30T12:21:58.844 INFO:tasks.workunit.client.0.smithi084.stdout: "power_on_time": { 2024-03-30T12:21:58.844 INFO:tasks.workunit.client.0.smithi084.stdout: "hours": 55370 2024-03-30T12:21:58.844 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.844 INFO:tasks.workunit.client.0.smithi084.stdout: "serial_number": "deleted", 2024-03-30T12:21:58.844 INFO:tasks.workunit.client.0.smithi084.stdout: "smart_status": { 2024-03-30T12:21:58.844 INFO:tasks.workunit.client.0.smithi084.stdout: "nvme": { 2024-03-30T12:21:58.844 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:58.844 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.844 INFO:tasks.workunit.client.0.smithi084.stdout: "passed": true 2024-03-30T12:21:58.844 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.845 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl": { 2024-03-30T12:21:58.845 INFO:tasks.workunit.client.0.smithi084.stdout: "argv": [ 2024-03-30T12:21:58.845 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl", 2024-03-30T12:21:58.845 INFO:tasks.workunit.client.0.smithi084.stdout: "-x", 2024-03-30T12:21:58.845 INFO:tasks.workunit.client.0.smithi084.stdout: "--json=o", 2024-03-30T12:21:58.845 INFO:tasks.workunit.client.0.smithi084.stdout: "/dev/nvme0n1" 2024-03-30T12:21:58.845 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.845 INFO:tasks.workunit.client.0.smithi084.stdout: "build_info": "(local build)", 2024-03-30T12:21:58.845 INFO:tasks.workunit.client.0.smithi084.stdout: "exit_status": 0, 2024-03-30T12:21:58.845 INFO:tasks.workunit.client.0.smithi084.stdout: "output": [ 2024-03-30T12:21:58.845 INFO:tasks.workunit.client.0.smithi084.stdout: "smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.14.0-434.el9.x86_64] (local build)", 2024-03-30T12:21:58.845 INFO:tasks.workunit.client.0.smithi084.stdout: "Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org", 2024-03-30T12:21:58.845 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:58.846 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF INFORMATION SECTION ===", 2024-03-30T12:21:58.846 INFO:tasks.workunit.client.0.smithi084.stdout: "Model Number: INTEL SSDPEDMD400G4", 2024-03-30T12:21:58.846 INFO:tasks.workunit.client.0.smithi084.stdout: "Serial Number: deleted", 2024-03-30T12:21:58.846 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Version: 8DV101H0", 2024-03-30T12:21:58.846 INFO:tasks.workunit.client.0.smithi084.stdout: "PCI Vendor/Subsystem ID: 0x8086", 2024-03-30T12:21:58.846 INFO:tasks.workunit.client.0.smithi084.stdout: "IEEE OUI Identifier: 0x5cd2e4", 2024-03-30T12:21:58.846 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller ID: 0", 2024-03-30T12:21:58.846 INFO:tasks.workunit.client.0.smithi084.stdout: "Number of Namespaces: 1", 2024-03-30T12:21:58.846 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Size/Capacity: 400,088,457,216 [400 GB]", 2024-03-30T12:21:58.846 INFO:tasks.workunit.client.0.smithi084.stdout: "Namespace 1 Formatted LBA Size: 512", 2024-03-30T12:21:58.846 INFO:tasks.workunit.client.0.smithi084.stdout: "Local Time is: Sat Mar 30 12:16:45 2024 UTC", 2024-03-30T12:21:58.846 INFO:tasks.workunit.client.0.smithi084.stdout: "Firmware Updates (0x02): 1 Slot", 2024-03-30T12:21:58.847 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional Admin Commands (0x0006): Format Frmw_DL", 2024-03-30T12:21:58.847 INFO:tasks.workunit.client.0.smithi084.stdout: "Optional NVM Commands (0x0006): Wr_Unc DS_Mngmt", 2024-03-30T12:21:58.847 INFO:tasks.workunit.client.0.smithi084.stdout: "Maximum Data Transfer Size: 32 Pages", 2024-03-30T12:21:58.847 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:58.847 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported Power States", 2024-03-30T12:21:58.847 INFO:tasks.workunit.client.0.smithi084.stdout: "St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat", 2024-03-30T12:21:58.847 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 25.00W - - 0 0 0 0 0 0", 2024-03-30T12:21:58.847 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:58.847 INFO:tasks.workunit.client.0.smithi084.stdout: "Supported LBA Sizes (NSID 0x1)", 2024-03-30T12:21:58.847 INFO:tasks.workunit.client.0.smithi084.stdout: "Id Fmt Data Metadt Rel_Perf", 2024-03-30T12:21:58.847 INFO:tasks.workunit.client.0.smithi084.stdout: " 0 + 512 0 2", 2024-03-30T12:21:58.847 INFO:tasks.workunit.client.0.smithi084.stdout: " 1 - 512 8 2", 2024-03-30T12:21:58.847 INFO:tasks.workunit.client.0.smithi084.stdout: " 2 - 512 16 2", 2024-03-30T12:21:58.847 INFO:tasks.workunit.client.0.smithi084.stdout: " 3 - 4096 0 0", 2024-03-30T12:21:58.848 INFO:tasks.workunit.client.0.smithi084.stdout: " 4 - 4096 8 0", 2024-03-30T12:21:58.848 INFO:tasks.workunit.client.0.smithi084.stdout: " 5 - 4096 64 0", 2024-03-30T12:21:58.848 INFO:tasks.workunit.client.0.smithi084.stdout: " 6 - 4096 128 0", 2024-03-30T12:21:58.848 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:58.848 INFO:tasks.workunit.client.0.smithi084.stdout: "=== START OF SMART DATA SECTION ===", 2024-03-30T12:21:58.848 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART overall-health self-assessment test result: PASSED", 2024-03-30T12:21:58.848 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:58.848 INFO:tasks.workunit.client.0.smithi084.stdout: "SMART/Health Information (NVMe Log 0x02)", 2024-03-30T12:21:58.848 INFO:tasks.workunit.client.0.smithi084.stdout: "Critical Warning: 0x00", 2024-03-30T12:21:58.848 INFO:tasks.workunit.client.0.smithi084.stdout: "Temperature: 27 Celsius", 2024-03-30T12:21:58.848 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare: 100%", 2024-03-30T12:21:58.848 INFO:tasks.workunit.client.0.smithi084.stdout: "Available Spare Threshold: 10%", 2024-03-30T12:21:58.848 INFO:tasks.workunit.client.0.smithi084.stdout: "Percentage Used: 12%", 2024-03-30T12:21:58.848 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Read: 444,467,307 [227 TB]", 2024-03-30T12:21:58.849 INFO:tasks.workunit.client.0.smithi084.stdout: "Data Units Written: 2,173,097,505 [1.11 PB]", 2024-03-30T12:21:58.849 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Read Commands: 7,000,448,296", 2024-03-30T12:21:58.849 INFO:tasks.workunit.client.0.smithi084.stdout: "Host Write Commands: 36,885,402,494", 2024-03-30T12:21:58.849 INFO:tasks.workunit.client.0.smithi084.stdout: "Controller Busy Time: 6", 2024-03-30T12:21:58.849 INFO:tasks.workunit.client.0.smithi084.stdout: "Power Cycles: 55,516", 2024-03-30T12:21:58.849 INFO:tasks.workunit.client.0.smithi084.stdout: "Power On Hours: 55,370", 2024-03-30T12:21:58.849 INFO:tasks.workunit.client.0.smithi084.stdout: "Unsafe Shutdowns: 272", 2024-03-30T12:21:58.849 INFO:tasks.workunit.client.0.smithi084.stdout: "Media and Data Integrity Errors: 0", 2024-03-30T12:21:58.849 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information Log Entries: 0", 2024-03-30T12:21:58.849 INFO:tasks.workunit.client.0.smithi084.stdout: "", 2024-03-30T12:21:58.849 INFO:tasks.workunit.client.0.smithi084.stdout: "Error Information (NVMe Log 0x01, max 64 entries)", 2024-03-30T12:21:58.849 INFO:tasks.workunit.client.0.smithi084.stdout: "No Errors Logged", 2024-03-30T12:21:58.849 INFO:tasks.workunit.client.0.smithi084.stdout: "" 2024-03-30T12:21:58.850 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.850 INFO:tasks.workunit.client.0.smithi084.stdout: "platform_info": "x86_64-linux-5.14.0-434.el9.x86_64", 2024-03-30T12:21:58.850 INFO:tasks.workunit.client.0.smithi084.stdout: "svn_revision": "5022", 2024-03-30T12:21:58.850 INFO:tasks.workunit.client.0.smithi084.stdout: "version": [ 2024-03-30T12:21:58.850 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:58.850 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:58.850 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:58.850 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.850 INFO:tasks.workunit.client.0.smithi084.stdout: "temperature": { 2024-03-30T12:21:58.850 INFO:tasks.workunit.client.0.smithi084.stdout: "current": 27 2024-03-30T12:21:58.850 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.850 INFO:tasks.workunit.client.0.smithi084.stdout: "user_capacity": { 2024-03-30T12:21:58.850 INFO:tasks.workunit.client.0.smithi084.stdout: "blocks": 781422768, 2024-03-30T12:21:58.850 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 400088457216 2024-03-30T12:21:58.851 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.851 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.851 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.851 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.851 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.851 INFO:tasks.workunit.client.0.smithi084.stdout: "report": { 2024-03-30T12:21:58.851 INFO:tasks.workunit.client.0.smithi084.stdout: "balancer": { 2024-03-30T12:21:58.851 INFO:tasks.workunit.client.0.smithi084.stdout: "active": true, 2024-03-30T12:21:58.851 INFO:tasks.workunit.client.0.smithi084.stdout: "mode": "" 2024-03-30T12:21:58.851 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.851 INFO:tasks.workunit.client.0.smithi084.stdout: "channels": [ 2024-03-30T12:21:58.851 INFO:tasks.workunit.client.0.smithi084.stdout: "basic", 2024-03-30T12:21:58.851 INFO:tasks.workunit.client.0.smithi084.stdout: "crash", 2024-03-30T12:21:58.851 INFO:tasks.workunit.client.0.smithi084.stdout: "device", 2024-03-30T12:21:58.852 INFO:tasks.workunit.client.0.smithi084.stdout: "ident", 2024-03-30T12:21:58.852 INFO:tasks.workunit.client.0.smithi084.stdout: "perf" 2024-03-30T12:21:58.852 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.852 INFO:tasks.workunit.client.0.smithi084.stdout: "channels_available": [ 2024-03-30T12:21:58.852 INFO:tasks.workunit.client.0.smithi084.stdout: "basic", 2024-03-30T12:21:58.852 INFO:tasks.workunit.client.0.smithi084.stdout: "ident", 2024-03-30T12:21:58.852 INFO:tasks.workunit.client.0.smithi084.stdout: "crash", 2024-03-30T12:21:58.852 INFO:tasks.workunit.client.0.smithi084.stdout: "device", 2024-03-30T12:21:58.852 INFO:tasks.workunit.client.0.smithi084.stdout: "perf" 2024-03-30T12:21:58.852 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.852 INFO:tasks.workunit.client.0.smithi084.stdout: "collections_available": [ 2024-03-30T12:21:58.852 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_base", 2024-03-30T12:21:58.852 INFO:tasks.workunit.client.0.smithi084.stdout: "device_base", 2024-03-30T12:21:58.853 INFO:tasks.workunit.client.0.smithi084.stdout: "crash_base", 2024-03-30T12:21:58.853 INFO:tasks.workunit.client.0.smithi084.stdout: "ident_base", 2024-03-30T12:21:58.853 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_perf", 2024-03-30T12:21:58.853 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_mds_metadata", 2024-03-30T12:21:58.853 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_usage", 2024-03-30T12:21:58.853 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_usage_by_class", 2024-03-30T12:21:58.853 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_rook_v01", 2024-03-30T12:21:58.853 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_memory_metrics", 2024-03-30T12:21:58.853 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_options_bluestore" 2024-03-30T12:21:58.853 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.853 INFO:tasks.workunit.client.0.smithi084.stdout: "collections_opted_in": [ 2024-03-30T12:21:58.853 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_base", 2024-03-30T12:21:58.853 INFO:tasks.workunit.client.0.smithi084.stdout: "device_base", 2024-03-30T12:21:58.854 INFO:tasks.workunit.client.0.smithi084.stdout: "crash_base", 2024-03-30T12:21:58.854 INFO:tasks.workunit.client.0.smithi084.stdout: "ident_base", 2024-03-30T12:21:58.854 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_perf", 2024-03-30T12:21:58.854 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_mds_metadata", 2024-03-30T12:21:58.854 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_usage", 2024-03-30T12:21:58.854 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_usage_by_class", 2024-03-30T12:21:58.854 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_rook_v01", 2024-03-30T12:21:58.854 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_memory_metrics", 2024-03-30T12:21:58.854 INFO:tasks.workunit.client.0.smithi084.stdout: "basic_pool_options_bluestore" 2024-03-30T12:21:58.854 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.854 INFO:tasks.workunit.client.0.smithi084.stdout: "config": { 2024-03-30T12:21:58.854 INFO:tasks.workunit.client.0.smithi084.stdout: "active_changed": [ 2024-03-30T12:21:58.855 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_allow_insecure_global_id_reclaim", 2024-03-30T12:21:58.855 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_debug", 2024-03-30T12:21:58.855 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_mon_ticket_ttl", 2024-03-30T12:21:58.855 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_service_ticket_ttl", 2024-03-30T12:21:58.855 INFO:tasks.workunit.client.0.smithi084.stdout: "bdev_debug_aio", 2024-03-30T12:21:58.855 INFO:tasks.workunit.client.0.smithi084.stdout: "client_check_pool_perm", 2024-03-30T12:21:58.855 INFO:tasks.workunit.client.0.smithi084.stdout: "client_mount_gid", 2024-03-30T12:21:58.855 INFO:tasks.workunit.client.0.smithi084.stdout: "client_mount_uid", 2024-03-30T12:21:58.855 INFO:tasks.workunit.client.0.smithi084.stdout: "client_quota", 2024-03-30T12:21:58.855 INFO:tasks.workunit.client.0.smithi084.stdout: "container_image", 2024-03-30T12:21:58.855 INFO:tasks.workunit.client.0.smithi084.stdout: "daemonize", 2024-03-30T12:21:58.855 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_asserts_on_shutdown", 2024-03-30T12:21:58.855 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mgr", 2024-03-30T12:21:58.855 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mon", 2024-03-30T12:21:58.856 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_ms", 2024-03-30T12:21:58.856 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_osd", 2024-03-30T12:21:58.856 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_paxos", 2024-03-30T12:21:58.856 INFO:tasks.workunit.client.0.smithi084.stdout: "keyring", 2024-03-30T12:21:58.856 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_block_size", 2024-03-30T12:21:58.856 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_cache_size", 2024-03-30T12:21:58.856 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_compression", 2024-03-30T12:21:58.856 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_log", 2024-03-30T12:21:58.856 INFO:tasks.workunit.client.0.smithi084.stdout: "leveldb_write_buffer_size", 2024-03-30T12:21:58.856 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_file", 2024-03-30T12:21:58.856 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_journald", 2024-03-30T12:21:58.856 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_stderr", 2024-03-30T12:21:58.857 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_allow_pool_delete", 2024-03-30T12:21:58.857 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_clock_drift_allowed", 2024-03-30T12:21:58.857 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_file_level", 2024-03-30T12:21:58.857 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_file", 2024-03-30T12:21:58.857 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_journald", 2024-03-30T12:21:58.857 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_stderr", 2024-03-30T12:21:58.857 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_data_avail_warn", 2024-03-30T12:21:58.857 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_election_default_strategy", 2024-03-30T12:21:58.857 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_host", 2024-03-30T12:21:58.857 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_max_pg_per_osd", 2024-03-30T12:21:58.857 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_mgr_mkfs_grace", 2024-03-30T12:21:58.857 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_prime_pg_temp", 2024-03-30T12:21:58.858 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_reporter_subtree_level", 2024-03-30T12:21:58.858 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_pg_warn_max_object_skew", 2024-03-30T12:21:58.858 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_bytes_per_osd", 2024-03-30T12:21:58.858 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_pgs_per_osd", 2024-03-30T12:21:58.858 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-03-30T12:21:58.858 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-03-30T12:21:58.858 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-03-30T12:21:58.858 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_legacy_crush_tunables", 2024-03-30T12:21:58.858 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-03-30T12:21:58.858 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-03-30T12:21:58.858 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_too_few_osds", 2024-03-30T12:21:58.858 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_bug", 2024-03-30T12:21:58.859 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_old_message", 2024-03-30T12:21:58.859 INFO:tasks.workunit.client.0.smithi084.stdout: "no_config_file", 2024-03-30T12:21:58.859 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_default_list", 2024-03-30T12:21:58.859 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_load_list", 2024-03-30T12:21:58.859 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_crush_chooseleaf_type", 2024-03-30T12:21:58.859 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_misdirected_ops", 2024-03-30T12:21:58.859 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_op_order", 2024-03-30T12:21:58.859 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_pg_log_writeout", 2024-03-30T12:21:58.859 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_shutdown", 2024-03-30T12:21:58.859 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_cached_snaps", 2024-03-30T12:21:58.859 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_missing_on_start", 2024-03-30T12:21:58.859 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_stray_on_activate", 2024-03-30T12:21:58.860 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_deep_scrub_update_digest_min_age", 2024-03-30T12:21:58.860 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_delete_sleep", 2024-03-30T12:21:58.860 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_delete_sleep_hdd", 2024-03-30T12:21:58.860 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_delete_sleep_hybrid", 2024-03-30T12:21:58.860 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_delete_sleep_ssd", 2024-03-30T12:21:58.860 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_max_backfills", 2024-03-30T12:21:58.860 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_max_capacity_iops_ssd", 2024-03-30T12:21:58.860 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_profile", 2024-03-30T12:21:58.860 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_best_effort_lim", 2024-03-30T12:21:58.860 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_best_effort_res", 2024-03-30T12:21:58.860 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_best_effort_wgt", 2024-03-30T12:21:58.860 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_recovery_lim", 2024-03-30T12:21:58.860 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_recovery_res", 2024-03-30T12:21:58.861 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_background_recovery_wgt", 2024-03-30T12:21:58.861 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_client_lim", 2024-03-30T12:21:58.861 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_client_res", 2024-03-30T12:21:58.861 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_scheduler_client_wgt", 2024-03-30T12:21:58.861 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target", 2024-03-30T12:21:58.861 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target_autotune", 2024-03-30T12:21:58.861 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue", 2024-03-30T12:21:58.861 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue_cut_off", 2024-03-30T12:21:58.861 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pg_delete_cost", 2024-03-30T12:21:58.861 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_erasure_code_profile", 2024-03-30T12:21:58.861 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_pg_autoscale_mode", 2024-03-30T12:21:58.861 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recover_clone_overlap", 2024-03-30T12:21:58.861 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_active", 2024-03-30T12:21:58.862 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_active_hdd", 2024-03-30T12:21:58.862 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_active_ssd", 2024-03-30T12:21:58.862 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_chunk", 2024-03-30T12:21:58.862 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_sleep", 2024-03-30T12:21:58.862 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_sleep_hdd", 2024-03-30T12:21:58.862 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_sleep_hybrid", 2024-03-30T12:21:58.862 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_sleep_ssd", 2024-03-30T12:21:58.862 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_load_threshold", 2024-03-30T12:21:58.862 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_max_interval", 2024-03-30T12:21:58.862 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_sleep", 2024-03-30T12:21:58.862 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_shutdown_pgref_assert", 2024-03-30T12:21:58.862 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_snap_trim_sleep", 2024-03-30T12:21:58.862 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_snap_trim_sleep_hdd", 2024-03-30T12:21:58.863 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_snap_trim_sleep_hybrid", 2024-03-30T12:21:58.863 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_snap_trim_sleep_ssd", 2024-03-30T12:21:58.863 INFO:tasks.workunit.client.0.smithi084.stdout: "public_addr", 2024-03-30T12:21:58.863 INFO:tasks.workunit.client.0.smithi084.stdout: "public_addrv", 2024-03-30T12:21:58.863 INFO:tasks.workunit.client.0.smithi084.stdout: "public_network", 2024-03-30T12:21:58.863 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd_default_features", 2024-03-30T12:21:58.863 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd_qos_exclude_ops", 2024-03-30T12:21:58.863 INFO:tasks.workunit.client.0.smithi084.stdout: "setgroup", 2024-03-30T12:21:58.863 INFO:tasks.workunit.client.0.smithi084.stdout: "setuser" 2024-03-30T12:21:58.863 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.863 INFO:tasks.workunit.client.0.smithi084.stdout: "cluster_changed": [ 2024-03-30T12:21:58.863 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_allow_insecure_global_id_reclaim", 2024-03-30T12:21:58.863 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_debug", 2024-03-30T12:21:58.863 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_mon_ticket_ttl", 2024-03-30T12:21:58.864 INFO:tasks.workunit.client.0.smithi084.stdout: "auth_service_ticket_ttl", 2024-03-30T12:21:58.864 INFO:tasks.workunit.client.0.smithi084.stdout: "bdev_debug_aio", 2024-03-30T12:21:58.864 INFO:tasks.workunit.client.0.smithi084.stdout: "container_image", 2024-03-30T12:21:58.864 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_asserts_on_shutdown", 2024-03-30T12:21:58.864 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mgr", 2024-03-30T12:21:58.864 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_mon", 2024-03-30T12:21:58.864 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_ms", 2024-03-30T12:21:58.864 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_osd", 2024-03-30T12:21:58.864 INFO:tasks.workunit.client.0.smithi084.stdout: "debug_paxos", 2024-03-30T12:21:58.864 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_file", 2024-03-30T12:21:58.864 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_journald", 2024-03-30T12:21:58.864 INFO:tasks.workunit.client.0.smithi084.stdout: "log_to_stderr", 2024-03-30T12:21:58.864 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_join_fs", 2024-03-30T12:21:58.865 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/allow_ptrace", 2024-03-30T12:21:58.865 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/container_init", 2024-03-30T12:21:58.865 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/migration_current", 2024-03-30T12:21:58.865 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/cephadm/use_repo_digest", 2024-03-30T12:21:58.865 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/ALERTMANAGER_API_HOST", 2024-03-30T12:21:58.865 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/GRAFANA_API_SSL_VERIFY", 2024-03-30T12:21:58.865 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/GRAFANA_API_URL", 2024-03-30T12:21:58.865 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/PROMETHEUS_API_HOST", 2024-03-30T12:21:58.865 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/dashboard/ssl_server_port", 2024-03-30T12:21:58.865 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/orchestrator/orchestrator", 2024-03-30T12:21:58.865 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/channel_ident", 2024-03-30T12:21:58.865 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/channel_perf", 2024-03-30T12:21:58.865 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/description", 2024-03-30T12:21:58.865 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/enabled", 2024-03-30T12:21:58.866 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr/telemetry/organization", 2024-03-30T12:21:58.866 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_allow_pool_delete", 2024-03-30T12:21:58.866 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_clock_drift_allowed", 2024-03-30T12:21:58.866 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_file_level", 2024-03-30T12:21:58.866 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_cluster_log_to_file", 2024-03-30T12:21:58.866 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_data_avail_warn", 2024-03-30T12:21:58.866 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_election_default_strategy", 2024-03-30T12:21:58.866 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_max_pg_per_osd", 2024-03-30T12:21:58.866 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_mgr_mkfs_grace", 2024-03-30T12:21:58.866 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_prime_pg_temp", 2024-03-30T12:21:58.866 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_osd_reporter_subtree_level", 2024-03-30T12:21:58.866 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_pg_warn_max_object_skew", 2024-03-30T12:21:58.866 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_bytes_per_osd", 2024-03-30T12:21:58.866 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_reweight_min_pgs_per_osd", 2024-03-30T12:21:58.867 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_crush_straw_calc_version_zero", 2024-03-30T12:21:58.867 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim", 2024-03-30T12:21:58.867 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed", 2024-03-30T12:21:58.867 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_legacy_crush_tunables", 2024-03-30T12:21:58.867 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_osd_down_out_interval_zero", 2024-03-30T12:21:58.867 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_pool_pg_num_not_power_of_two", 2024-03-30T12:21:58.867 INFO:tasks.workunit.client.0.smithi084.stdout: "mon_warn_on_too_few_osds", 2024-03-30T12:21:58.867 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_bug", 2024-03-30T12:21:58.867 INFO:tasks.workunit.client.0.smithi084.stdout: "ms_die_on_old_message", 2024-03-30T12:21:58.867 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_default_list", 2024-03-30T12:21:58.867 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_class_load_list", 2024-03-30T12:21:58.868 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_misdirected_ops", 2024-03-30T12:21:58.868 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_op_order", 2024-03-30T12:21:58.868 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_pg_log_writeout", 2024-03-30T12:21:58.868 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_shutdown", 2024-03-30T12:21:58.868 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_cached_snaps", 2024-03-30T12:21:58.868 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_missing_on_start", 2024-03-30T12:21:58.868 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_debug_verify_stray_on_activate", 2024-03-30T12:21:58.868 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_deep_scrub_update_digest_min_age", 2024-03-30T12:21:58.868 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_max_capacity_iops_ssd", 2024-03-30T12:21:58.868 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mclock_profile", 2024-03-30T12:21:58.868 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target", 2024-03-30T12:21:58.868 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_memory_target_autotune", 2024-03-30T12:21:58.869 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue", 2024-03-30T12:21:58.869 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_op_queue_cut_off", 2024-03-30T12:21:58.869 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_erasure_code_profile", 2024-03-30T12:21:58.869 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pool_default_pg_autoscale_mode", 2024-03-30T12:21:58.869 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recover_clone_overlap", 2024-03-30T12:21:58.869 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_recovery_max_chunk", 2024-03-30T12:21:58.869 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_load_threshold", 2024-03-30T12:21:58.869 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_scrub_max_interval", 2024-03-30T12:21:58.869 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_shutdown_pgref_assert", 2024-03-30T12:21:58.869 INFO:tasks.workunit.client.0.smithi084.stdout: "public_network", 2024-03-30T12:21:58.869 INFO:tasks.workunit.client.0.smithi084.stdout: "rgw_cache_enabled", 2024-03-30T12:21:58.869 INFO:tasks.workunit.client.0.smithi084.stdout: "rgw_enable_ops_log", 2024-03-30T12:21:58.869 INFO:tasks.workunit.client.0.smithi084.stdout: "rgw_enable_usage_log" 2024-03-30T12:21:58.869 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:58.870 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.870 INFO:tasks.workunit.client.0.smithi084.stdout: "contact": null, 2024-03-30T12:21:58.870 INFO:tasks.workunit.client.0.smithi084.stdout: "crashes": [], 2024-03-30T12:21:58.870 INFO:tasks.workunit.client.0.smithi084.stdout: "created": "2024-03-30T12:13:26.814055Z", 2024-03-30T12:21:58.870 INFO:tasks.workunit.client.0.smithi084.stdout: "crush": { 2024-03-30T12:21:58.870 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket_algs": { 2024-03-30T12:21:58.870 INFO:tasks.workunit.client.0.smithi084.stdout: "straw2": 3 2024-03-30T12:21:58.870 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.870 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket_sizes": { 2024-03-30T12:21:58.870 INFO:tasks.workunit.client.0.smithi084.stdout: "2": 1, 2024-03-30T12:21:58.870 INFO:tasks.workunit.client.0.smithi084.stdout: "4": 2 2024-03-30T12:21:58.871 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.871 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket_types": { 2024-03-30T12:21:58.871 INFO:tasks.workunit.client.0.smithi084.stdout: "1": 2, 2024-03-30T12:21:58.871 INFO:tasks.workunit.client.0.smithi084.stdout: "11": 1 2024-03-30T12:21:58.871 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.871 INFO:tasks.workunit.client.0.smithi084.stdout: "compat_weight_set": false, 2024-03-30T12:21:58.871 INFO:tasks.workunit.client.0.smithi084.stdout: "device_classes": [ 2024-03-30T12:21:58.871 INFO:tasks.workunit.client.0.smithi084.stdout: 8 2024-03-30T12:21:58.871 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.871 INFO:tasks.workunit.client.0.smithi084.stdout: "num_buckets": 6, 2024-03-30T12:21:58.871 INFO:tasks.workunit.client.0.smithi084.stdout: "num_devices": 8, 2024-03-30T12:21:58.871 INFO:tasks.workunit.client.0.smithi084.stdout: "num_rules": 1, 2024-03-30T12:21:58.871 INFO:tasks.workunit.client.0.smithi084.stdout: "num_types": 12, 2024-03-30T12:21:58.872 INFO:tasks.workunit.client.0.smithi084.stdout: "num_weight_sets": 0, 2024-03-30T12:21:58.872 INFO:tasks.workunit.client.0.smithi084.stdout: "tunables": { 2024-03-30T12:21:58.872 INFO:tasks.workunit.client.0.smithi084.stdout: "allowed_bucket_algs": 54, 2024-03-30T12:21:58.872 INFO:tasks.workunit.client.0.smithi084.stdout: "choose_local_fallback_tries": 0, 2024-03-30T12:21:58.872 INFO:tasks.workunit.client.0.smithi084.stdout: "choose_local_tries": 0, 2024-03-30T12:21:58.872 INFO:tasks.workunit.client.0.smithi084.stdout: "choose_total_tries": 50, 2024-03-30T12:21:58.872 INFO:tasks.workunit.client.0.smithi084.stdout: "chooseleaf_descend_once": 1, 2024-03-30T12:21:58.872 INFO:tasks.workunit.client.0.smithi084.stdout: "chooseleaf_stable": 1, 2024-03-30T12:21:58.872 INFO:tasks.workunit.client.0.smithi084.stdout: "chooseleaf_vary_r": 1, 2024-03-30T12:21:58.872 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v2_rules": 0, 2024-03-30T12:21:58.872 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v3_rules": 0, 2024-03-30T12:21:58.872 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v4_buckets": 1, 2024-03-30T12:21:58.872 INFO:tasks.workunit.client.0.smithi084.stdout: "has_v5_rules": 0, 2024-03-30T12:21:58.873 INFO:tasks.workunit.client.0.smithi084.stdout: "legacy_tunables": 0, 2024-03-30T12:21:58.873 INFO:tasks.workunit.client.0.smithi084.stdout: "minimum_required_version": "jewel", 2024-03-30T12:21:58.873 INFO:tasks.workunit.client.0.smithi084.stdout: "optimal_tunables": 1, 2024-03-30T12:21:58.873 INFO:tasks.workunit.client.0.smithi084.stdout: "profile": "jewel", 2024-03-30T12:21:58.873 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables": 1, 2024-03-30T12:21:58.873 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables2": 1, 2024-03-30T12:21:58.873 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables3": 1, 2024-03-30T12:21:58.873 INFO:tasks.workunit.client.0.smithi084.stdout: "require_feature_tunables5": 1, 2024-03-30T12:21:58.873 INFO:tasks.workunit.client.0.smithi084.stdout: "straw_calc_version": 1 2024-03-30T12:21:58.873 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.873 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.873 INFO:tasks.workunit.client.0.smithi084.stdout: "description": "upgrade test cluster", 2024-03-30T12:21:58.873 INFO:tasks.workunit.client.0.smithi084.stdout: "fs": { 2024-03-30T12:21:58.874 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:58.874 INFO:tasks.workunit.client.0.smithi084.stdout: "feature_flags": { 2024-03-30T12:21:58.874 INFO:tasks.workunit.client.0.smithi084.stdout: "enable_multiple": true, 2024-03-30T12:21:58.874 INFO:tasks.workunit.client.0.smithi084.stdout: "ever_enabled_multiple": true 2024-03-30T12:21:58.874 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.874 INFO:tasks.workunit.client.0.smithi084.stdout: "filesystems": [ 2024-03-30T12:21:58.874 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:58.874 INFO:tasks.workunit.client.0.smithi084.stdout: "approx_ctime": "2024-03", 2024-03-30T12:21:58.874 INFO:tasks.workunit.client.0.smithi084.stdout: "balancer_enabled": false, 2024-03-30T12:21:58.874 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.874 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_caps": 0, 2024-03-30T12:21:58.874 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_dns": 10, 2024-03-30T12:21:58.875 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_inos": 13, 2024-03-30T12:21:58.875 INFO:tasks.workunit.client.0.smithi084.stdout: "cached_subtrees": 2, 2024-03-30T12:21:58.875 INFO:tasks.workunit.client.0.smithi084.stdout: "ever_allowed_features": 0, 2024-03-30T12:21:58.875 INFO:tasks.workunit.client.0.smithi084.stdout: "explicitly_allowed_features": 0, 2024-03-30T12:21:58.875 INFO:tasks.workunit.client.0.smithi084.stdout: "files": 0, 2024-03-30T12:21:58.875 INFO:tasks.workunit.client.0.smithi084.stdout: "max_mds": 1, 2024-03-30T12:21:58.875 INFO:tasks.workunit.client.0.smithi084.stdout: "num_data_pools": 1, 2024-03-30T12:21:58.875 INFO:tasks.workunit.client.0.smithi084.stdout: "num_in": 1, 2024-03-30T12:21:58.875 INFO:tasks.workunit.client.0.smithi084.stdout: "num_mds": 1, 2024-03-30T12:21:58.875 INFO:tasks.workunit.client.0.smithi084.stdout: "num_sessions": 0, 2024-03-30T12:21:58.875 INFO:tasks.workunit.client.0.smithi084.stdout: "num_standby_replay": 0, 2024-03-30T12:21:58.875 INFO:tasks.workunit.client.0.smithi084.stdout: "num_up": 1, 2024-03-30T12:21:58.875 INFO:tasks.workunit.client.0.smithi084.stdout: "snaps": 0, 2024-03-30T12:21:58.875 INFO:tasks.workunit.client.0.smithi084.stdout: "standby_count_wanted": 0 2024-03-30T12:21:58.876 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.876 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:58.876 INFO:tasks.workunit.client.0.smithi084.stdout: "num_standby_mds": 1, 2024-03-30T12:21:58.876 INFO:tasks.workunit.client.0.smithi084.stdout: "total_num_mds": 2 2024-03-30T12:21:58.876 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.876 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_stats": { 2024-03-30T12:21:58.876 INFO:tasks.workunit.client.0.smithi084.stdout: "mds": { 2024-03-30T12:21:58.876 INFO:tasks.workunit.client.0.smithi084.stdout: "mds.611cf02078e8bf5a0a364299eaa3b024f2655c78": { 2024-03-30T12:21:58.876 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 19218432, 2024-03-30T12:21:58.876 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 314584, 2024-03-30T12:21:58.876 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2752512, 2024-03-30T12:21:58.876 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 90112, 2024-03-30T12:21:58.877 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 0, 2024-03-30T12:21:58.877 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 315, 2024-03-30T12:21:58.877 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:58.877 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 796600, 2024-03-30T12:21:58.877 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 12, 2024-03-30T12:21:58.877 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 802304, 2024-03-30T12:21:58.877 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 14462320, 2024-03-30T12:21:58.877 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 19218432 2024-03-30T12:21:58.877 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.877 INFO:tasks.workunit.client.0.smithi084.stdout: "mds.f0f02ef515f7a6934fcbe198c4bdfa6882a76018": { 2024-03-30T12:21:58.877 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 20619264, 2024-03-30T12:21:58.877 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 373296, 2024-03-30T12:21:58.877 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2752512, 2024-03-30T12:21:58.878 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 8192, 2024-03-30T12:21:58.878 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 696320, 2024-03-30T12:21:58.878 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 402, 2024-03-30T12:21:58.878 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:58.878 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 1329184, 2024-03-30T12:21:58.878 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 20, 2024-03-30T12:21:58.878 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 1206272, 2024-03-30T12:21:58.878 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 14949808, 2024-03-30T12:21:58.878 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 21315584 2024-03-30T12:21:58.878 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.878 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.878 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-03-30T12:21:58.879 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.611cf02078e8bf5a0a364299eaa3b024f2655c78": { 2024-03-30T12:21:58.879 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 44261376, 2024-03-30T12:21:58.879 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 1724480, 2024-03-30T12:21:58.879 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2752512, 2024-03-30T12:21:58.879 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 548864, 2024-03-30T12:21:58.879 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 6438912, 2024-03-30T12:21:58.879 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1926, 2024-03-30T12:21:58.879 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:58.879 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 12168536, 2024-03-30T12:21:58.879 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 22, 2024-03-30T12:21:58.879 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 3046144, 2024-03-30T12:21:58.879 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 24020840, 2024-03-30T12:21:58.880 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 50700288 2024-03-30T12:21:58.880 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.880 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.ba4e0ee80ca1c9071285ab58ebc3a0451ad8d905": { 2024-03-30T12:21:58.880 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 36044800, 2024-03-30T12:21:58.880 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 997288, 2024-03-30T12:21:58.880 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2752512, 2024-03-30T12:21:58.880 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 540672, 2024-03-30T12:21:58.880 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 8454144, 2024-03-30T12:21:58.880 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1088, 2024-03-30T12:21:58.880 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:58.880 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 9072088, 2024-03-30T12:21:58.880 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 22, 2024-03-30T12:21:58.880 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 1049344, 2024-03-30T12:21:58.881 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 21632896, 2024-03-30T12:21:58.881 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 44498944 2024-03-30T12:21:58.881 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.881 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.f0f02ef515f7a6934fcbe198c4bdfa6882a76018": { 2024-03-30T12:21:58.881 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 34570240, 2024-03-30T12:21:58.881 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 1367224, 2024-03-30T12:21:58.881 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2752512, 2024-03-30T12:21:58.881 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-03-30T12:21:58.881 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 10977280, 2024-03-30T12:21:58.881 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1148, 2024-03-30T12:21:58.881 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:58.881 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 8590472, 2024-03-30T12:21:58.882 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 21, 2024-03-30T12:21:58.882 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 1236480, 2024-03-30T12:21:58.882 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 20623552, 2024-03-30T12:21:58.882 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 45547520 2024-03-30T12:21:58.882 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.882 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.882 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:58.882 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.0": { 2024-03-30T12:21:58.882 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 51183616, 2024-03-30T12:21:58.882 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 1783424, 2024-03-30T12:21:58.882 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-03-30T12:21:58.882 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-03-30T12:21:58.882 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 1425408, 2024-03-30T12:21:58.883 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1746, 2024-03-30T12:21:58.883 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:58.883 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 6056760, 2024-03-30T12:21:58.883 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 47, 2024-03-30T12:21:58.883 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 3774208, 2024-03-30T12:21:58.883 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 36685640, 2024-03-30T12:21:58.883 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 52609024 2024-03-30T12:21:58.883 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.883 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.1": { 2024-03-30T12:21:58.883 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 49963008, 2024-03-30T12:21:58.883 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 1890704, 2024-03-30T12:21:58.883 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-03-30T12:21:58.883 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 98304, 2024-03-30T12:21:58.884 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 548864, 2024-03-30T12:21:58.884 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1672, 2024-03-30T12:21:58.884 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:58.884 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 5871488, 2024-03-30T12:21:58.884 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 47, 2024-03-30T12:21:58.884 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 3542016, 2024-03-30T12:21:58.884 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 35676912, 2024-03-30T12:21:58.884 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 50511872 2024-03-30T12:21:58.884 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.884 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.2": { 2024-03-30T12:21:58.884 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 49577984, 2024-03-30T12:21:58.885 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 1777400, 2024-03-30T12:21:58.885 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-03-30T12:21:58.885 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-03-30T12:21:58.885 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 868352, 2024-03-30T12:21:58.885 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1624, 2024-03-30T12:21:58.885 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:58.885 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 5648416, 2024-03-30T12:21:58.885 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 47, 2024-03-30T12:21:58.885 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 4049920, 2024-03-30T12:21:58.885 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 35218664, 2024-03-30T12:21:58.885 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 50446336 2024-03-30T12:21:58.885 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.885 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.3": { 2024-03-30T12:21:58.886 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 43393024, 2024-03-30T12:21:58.886 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 664776, 2024-03-30T12:21:58.886 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-03-30T12:21:58.886 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-03-30T12:21:58.886 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 827392, 2024-03-30T12:21:58.886 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1171, 2024-03-30T12:21:58.886 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:58.886 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 3845648, 2024-03-30T12:21:58.886 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 46, 2024-03-30T12:21:58.886 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 1850624, 2024-03-30T12:21:58.886 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 34148392, 2024-03-30T12:21:58.886 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 44220416 2024-03-30T12:21:58.887 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.887 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.4": { 2024-03-30T12:21:58.887 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 48373760, 2024-03-30T12:21:58.887 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 1814464, 2024-03-30T12:21:58.887 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-03-30T12:21:58.887 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-03-30T12:21:58.887 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 40960, 2024-03-30T12:21:58.887 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1591, 2024-03-30T12:21:58.887 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:58.887 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 5465752, 2024-03-30T12:21:58.887 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 47, 2024-03-30T12:21:58.887 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 3336704, 2024-03-30T12:21:58.888 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 34873256, 2024-03-30T12:21:58.888 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 48414720 2024-03-30T12:21:58.888 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.888 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.5": { 2024-03-30T12:21:58.888 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 48816128, 2024-03-30T12:21:58.888 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 2042056, 2024-03-30T12:21:58.888 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-03-30T12:21:58.888 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-03-30T12:21:58.888 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 647168, 2024-03-30T12:21:58.888 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1605, 2024-03-30T12:21:58.888 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:58.888 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 5226808, 2024-03-30T12:21:58.888 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 47, 2024-03-30T12:21:58.889 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 3820032, 2024-03-30T12:21:58.889 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 34843648, 2024-03-30T12:21:58.889 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 49463296 2024-03-30T12:21:58.889 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.889 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.6": { 2024-03-30T12:21:58.889 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 44343296, 2024-03-30T12:21:58.889 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 977072, 2024-03-30T12:21:58.889 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-03-30T12:21:58.889 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-03-30T12:21:58.889 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 925696, 2024-03-30T12:21:58.889 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1210, 2024-03-30T12:21:58.889 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:58.890 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 4611520, 2024-03-30T12:21:58.890 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 47, 2024-03-30T12:21:58.890 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 1877248, 2024-03-30T12:21:58.890 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 33993872, 2024-03-30T12:21:58.890 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 45268992 2024-03-30T12:21:58.890 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.890 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.7": { 2024-03-30T12:21:58.890 INFO:tasks.workunit.client.0.smithi084.stdout: "actual_memory_used": 48676864, 2024-03-30T12:21:58.890 INFO:tasks.workunit.client.0.smithi084.stdout: "central_cache_freelist": 1949616, 2024-03-30T12:21:58.890 INFO:tasks.workunit.client.0.smithi084.stdout: "malloc_metadata": 2883584, 2024-03-30T12:21:58.890 INFO:tasks.workunit.client.0.smithi084.stdout: "page_heap_freelist": 0, 2024-03-30T12:21:58.890 INFO:tasks.workunit.client.0.smithi084.stdout: "released_to_os": 786432, 2024-03-30T12:21:58.891 INFO:tasks.workunit.client.0.smithi084.stdout: "spans_in_use": 1647, 2024-03-30T12:21:58.891 INFO:tasks.workunit.client.0.smithi084.stdout: "tcmalloc_page_size": 8192, 2024-03-30T12:21:58.891 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_cache_freelists": 5877744, 2024-03-30T12:21:58.891 INFO:tasks.workunit.client.0.smithi084.stdout: "thread_heaps_in_use": 47, 2024-03-30T12:21:58.891 INFO:tasks.workunit.client.0.smithi084.stdout: "transfer_cache_freelist": 3448320, 2024-03-30T12:21:58.891 INFO:tasks.workunit.client.0.smithi084.stdout: "use_by_application": 34517600, 2024-03-30T12:21:58.891 INFO:tasks.workunit.client.0.smithi084.stdout: "virtual_address_space_used": 49463296 2024-03-30T12:21:58.891 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.891 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.891 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.891 INFO:tasks.workunit.client.0.smithi084.stdout: "hosts": { 2024-03-30T12:21:58.891 INFO:tasks.workunit.client.0.smithi084.stdout: "num": 2, 2024-03-30T12:21:58.891 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_mds": 2, 2024-03-30T12:21:58.892 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_mgr": 2, 2024-03-30T12:21:58.892 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_mon": 2, 2024-03-30T12:21:58.892 INFO:tasks.workunit.client.0.smithi084.stdout: "num_with_osd": 2 2024-03-30T12:21:58.892 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.892 INFO:tasks.workunit.client.0.smithi084.stdout: "io_rate": { 2024-03-30T12:21:58.892 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_stats_delta": { 2024-03-30T12:21:58.892 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": 0, 2024-03-30T12:21:58.892 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:58.892 INFO:tasks.workunit.client.0.smithi084.stdout: "num_store_stats": 0, 2024-03-30T12:21:58.892 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:58.892 INFO:tasks.workunit.client.0.smithi084.stdout: "stamp_delta": "12.002395", 2024-03-30T12:21:58.892 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:58.893 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:58.893 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:58.893 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:58.893 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:58.893 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:58.893 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:58.893 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:58.893 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:58.893 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:58.893 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:58.893 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:58.893 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:58.893 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:58.894 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:58.894 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:58.894 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:58.894 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:58.894 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:58.894 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:58.894 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:58.894 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:58.894 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:58.894 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:58.894 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:58.894 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:58.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:58.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:58.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:58.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:58.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:58.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:58.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:58.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:58.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 254, 2024-03-30T12:21:58.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 338, 2024-03-30T12:21:58.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:58.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:58.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:58.896 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 56, 2024-03-30T12:21:58.896 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:58.896 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.896 INFO:tasks.workunit.client.0.smithi084.stdout: "store_stats": { 2024-03-30T12:21:58.896 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": 0, 2024-03-30T12:21:58.896 INFO:tasks.workunit.client.0.smithi084.stdout: "available": 0, 2024-03-30T12:21:58.896 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed": 0, 2024-03-30T12:21:58.896 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_allocated": 0, 2024-03-30T12:21:58.896 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_original": 0, 2024-03-30T12:21:58.896 INFO:tasks.workunit.client.0.smithi084.stdout: "data_stored": 0, 2024-03-30T12:21:58.896 INFO:tasks.workunit.client.0.smithi084.stdout: "internal_metadata": 0, 2024-03-30T12:21:58.896 INFO:tasks.workunit.client.0.smithi084.stdout: "internally_reserved": 0, 2024-03-30T12:21:58.896 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_allocated": 0, 2024-03-30T12:21:58.896 INFO:tasks.workunit.client.0.smithi084.stdout: "total": 0 2024-03-30T12:21:58.897 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.897 INFO:tasks.workunit.client.0.smithi084.stdout: "up": 0 2024-03-30T12:21:58.897 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.897 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.897 INFO:tasks.workunit.client.0.smithi084.stdout: "leaderboard": false, 2024-03-30T12:21:58.897 INFO:tasks.workunit.client.0.smithi084.stdout: "leaderboard_description": null, 2024-03-30T12:21:58.897 INFO:tasks.workunit.client.0.smithi084.stdout: "license": "sharing-1-0", 2024-03-30T12:21:58.897 INFO:tasks.workunit.client.0.smithi084.stdout: "mempool": { 2024-03-30T12:21:58.897 INFO:tasks.workunit.client.0.smithi084.stdout: "mds": { 2024-03-30T12:21:58.897 INFO:tasks.workunit.client.0.smithi084.stdout: "mds.611cf02078e8bf5a0a364299eaa3b024f2655c78": { 2024-03-30T12:21:58.897 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:58.897 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.897 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.898 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.898 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:58.898 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.898 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.898 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.898 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:58.898 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.898 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.898 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.898 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:58.898 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.898 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.898 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.899 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:58.899 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.899 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.899 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.899 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:58.899 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.899 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.899 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.899 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:58.899 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.899 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.899 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.900 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:58.900 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.900 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.900 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.900 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:58.900 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.900 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.900 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.900 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:58.900 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.900 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.900 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.900 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:58.901 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.901 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.901 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.901 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:58.901 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.901 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.901 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.901 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:58.901 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.901 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.901 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.901 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:58.901 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.901 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.902 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.902 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:58.902 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.902 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.902 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.902 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:58.902 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.902 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.902 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.902 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:58.902 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.903 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.903 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.903 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:58.903 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.903 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.903 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.903 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:58.903 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 150208, 2024-03-30T12:21:58.903 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 34 2024-03-30T12:21:58.903 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.903 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:58.904 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.904 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.904 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.904 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:58.904 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 928, 2024-03-30T12:21:58.904 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 2 2024-03-30T12:21:58.904 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.904 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:58.904 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.904 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.904 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.904 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:58.904 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.905 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.905 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.905 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:58.905 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.905 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.905 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.905 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:58.905 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.905 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.905 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.905 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:58.905 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.906 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.906 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.906 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:58.906 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.906 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.906 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.906 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:58.906 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.906 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.906 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.906 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:58.907 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.907 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.907 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.907 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.907 INFO:tasks.workunit.client.0.smithi084.stdout: "mds.f0f02ef515f7a6934fcbe198c4bdfa6882a76018": { 2024-03-30T12:21:58.907 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:58.907 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.907 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.907 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.907 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:58.907 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.907 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.908 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.908 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:58.908 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.908 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.908 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.908 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:58.908 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.908 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.908 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.908 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:58.908 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.908 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.909 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.909 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:58.909 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.909 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.909 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.909 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:58.909 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.909 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.909 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.909 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:58.909 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.909 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.909 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.909 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:58.910 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.910 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.910 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.910 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:58.910 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.910 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.910 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.910 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:58.910 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.910 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.910 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.910 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:58.911 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.911 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.911 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.911 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:58.911 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.911 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.911 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.911 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:58.911 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.911 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.911 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.911 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:58.912 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.912 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.912 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.912 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:58.912 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.912 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.912 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.912 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:58.912 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.912 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.912 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.912 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:58.912 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.912 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.913 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.913 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:58.913 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 222439, 2024-03-30T12:21:58.913 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 68 2024-03-30T12:21:58.913 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.913 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:58.913 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.913 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.913 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.913 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:58.913 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 51496, 2024-03-30T12:21:58.913 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 208 2024-03-30T12:21:58.913 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.914 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:58.914 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.914 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.914 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.914 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:58.914 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.914 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.914 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.914 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:58.914 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.914 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.915 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.915 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:58.915 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 7816, 2024-03-30T12:21:58.915 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 121 2024-03-30T12:21:58.915 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.915 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:58.915 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.915 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.915 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.915 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:58.915 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.915 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.915 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.916 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:58.916 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.916 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.916 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.916 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:58.916 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.916 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.916 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.916 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.916 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.916 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-03-30T12:21:58.916 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.611cf02078e8bf5a0a364299eaa3b024f2655c78": { 2024-03-30T12:21:58.916 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:58.917 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.917 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.917 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.917 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:58.917 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.917 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.917 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.917 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:58.917 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.917 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.917 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.917 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:58.917 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.918 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.918 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.918 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:58.918 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.918 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.918 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.918 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:58.918 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.918 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.918 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.918 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:58.918 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.919 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.919 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.919 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:58.919 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.919 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.919 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.919 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:58.919 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.919 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.919 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.919 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:58.919 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.920 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.920 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.920 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:58.920 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.920 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.920 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.920 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:58.920 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.920 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.920 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.920 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:58.920 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.920 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.921 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.921 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:58.921 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.921 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.921 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.921 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:58.921 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.921 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.921 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.921 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:58.921 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.921 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.921 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.922 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:58.922 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.922 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.922 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.922 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:58.922 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.922 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.922 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.922 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:58.922 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1140195, 2024-03-30T12:21:58.922 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 359 2024-03-30T12:21:58.922 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.923 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:58.923 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 352, 2024-03-30T12:21:58.923 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 4 2024-03-30T12:21:58.923 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.923 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:58.923 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.923 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.923 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.923 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:58.923 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.923 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.923 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.923 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:58.924 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.924 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.924 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.924 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:58.924 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.924 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.924 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.924 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:58.924 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6392, 2024-03-30T12:21:58.924 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 120 2024-03-30T12:21:58.924 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.924 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:58.924 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12744, 2024-03-30T12:21:58.925 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 1546 2024-03-30T12:21:58.925 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.925 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:58.925 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 10304, 2024-03-30T12:21:58.925 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 166 2024-03-30T12:21:58.925 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.925 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:58.925 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.925 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.925 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.925 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:58.925 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.925 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.926 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.926 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.926 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.ba4e0ee80ca1c9071285ab58ebc3a0451ad8d905": { 2024-03-30T12:21:58.926 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:58.926 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.926 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.926 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.926 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:58.926 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.926 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.926 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.926 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:58.927 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.927 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.927 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.927 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:58.927 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.927 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.927 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.927 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:58.927 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.927 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.927 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.927 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:58.927 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.928 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.928 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.928 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:58.928 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.928 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.928 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.928 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:58.928 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.928 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.928 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.928 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:58.928 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.928 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.929 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.929 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:58.929 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.929 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.929 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.929 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:58.929 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.929 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.929 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.929 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:58.929 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.929 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.930 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.930 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:58.930 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.930 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.930 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.930 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:58.930 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.930 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.930 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.930 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:58.930 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.930 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.931 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.931 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:58.931 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.931 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.931 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.931 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:58.931 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.931 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.931 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.931 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:58.931 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.931 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.931 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.932 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:58.932 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1318739, 2024-03-30T12:21:58.932 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 431 2024-03-30T12:21:58.932 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.932 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:58.932 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.932 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.932 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.932 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:58.932 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.932 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.932 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.932 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:58.933 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.933 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.933 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.933 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:58.933 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.933 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.933 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.933 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:58.933 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.933 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.933 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.933 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:58.933 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6392, 2024-03-30T12:21:58.933 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 120 2024-03-30T12:21:58.934 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.934 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:58.934 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12744, 2024-03-30T12:21:58.934 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 1546 2024-03-30T12:21:58.934 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.934 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:58.934 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5152, 2024-03-30T12:21:58.934 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 83 2024-03-30T12:21:58.934 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.934 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:58.934 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.934 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.934 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.935 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:58.935 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.935 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.935 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.935 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.935 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.f0f02ef515f7a6934fcbe198c4bdfa6882a76018": { 2024-03-30T12:21:58.935 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:58.935 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.935 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.935 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.935 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:58.935 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.935 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.936 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.936 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:58.936 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.936 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.936 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.936 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:58.936 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.936 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.936 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.936 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:58.936 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.936 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.936 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.936 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:58.936 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.937 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.937 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.937 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:58.937 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.937 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.937 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.937 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:58.937 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.937 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.937 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.937 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:58.937 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.937 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.937 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.938 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:58.938 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.938 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.938 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.938 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:58.938 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.938 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.938 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.938 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:58.938 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.938 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.938 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.939 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:58.939 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.939 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.939 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.939 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:58.939 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.939 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.939 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.939 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:58.939 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.939 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.939 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.940 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:58.940 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.940 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.940 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.940 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:58.940 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.940 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.940 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.940 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:58.940 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.940 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.940 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.940 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:58.941 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1085891, 2024-03-30T12:21:58.941 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 359 2024-03-30T12:21:58.941 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.941 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:58.941 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.941 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.941 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.941 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:58.941 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.941 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.941 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.941 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:58.941 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.942 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.942 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.942 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:58.942 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.942 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.942 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.942 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:58.942 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.942 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.942 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.942 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:58.943 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6392, 2024-03-30T12:21:58.943 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 120 2024-03-30T12:21:58.943 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.943 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:58.943 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12744, 2024-03-30T12:21:58.943 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 1546 2024-03-30T12:21:58.943 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.943 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:58.943 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5152, 2024-03-30T12:21:58.943 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 83 2024-03-30T12:21:58.943 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.943 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:58.944 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.944 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.944 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.944 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:58.944 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.944 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.944 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.944 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.944 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.944 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:58.944 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.0": { 2024-03-30T12:21:58.944 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:58.945 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.945 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.945 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.945 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:58.945 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6368, 2024-03-30T12:21:58.945 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 123 2024-03-30T12:21:58.945 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.945 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:58.945 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 16896, 2024-03-30T12:21:58.945 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8 2024-03-30T12:21:58.945 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.945 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:58.945 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-03-30T12:21:58.946 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:58.946 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.946 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:58.946 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5680, 2024-03-30T12:21:58.946 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 71 2024-03-30T12:21:58.946 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.946 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:58.946 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 20608, 2024-03-30T12:21:58.946 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 184 2024-03-30T12:21:58.946 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.946 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:58.947 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1936, 2024-03-30T12:21:58.947 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 47 2024-03-30T12:21:58.947 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.947 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:58.947 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 621095, 2024-03-30T12:21:58.947 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 20 2024-03-30T12:21:58.947 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.947 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:58.947 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 91294, 2024-03-30T12:21:58.947 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 15637 2024-03-30T12:21:58.947 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.947 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:58.948 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 203576, 2024-03-30T12:21:58.948 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 331 2024-03-30T12:21:58.948 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.948 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:58.948 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 11284, 2024-03-30T12:21:58.948 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 733 2024-03-30T12:21:58.948 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.948 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:58.948 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8832, 2024-03-30T12:21:58.948 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 184 2024-03-30T12:21:58.948 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.948 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:58.949 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.949 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.949 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.949 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:58.949 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 31420, 2024-03-30T12:21:58.949 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 199 2024-03-30T12:21:58.949 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.949 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:58.949 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 20608, 2024-03-30T12:21:58.949 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 184 2024-03-30T12:21:58.949 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.949 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:58.950 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.950 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.950 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.950 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:58.950 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 372230, 2024-03-30T12:21:58.950 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 83 2024-03-30T12:21:58.950 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.950 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:58.950 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.950 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.950 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.950 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:58.950 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2444592, 2024-03-30T12:21:58.951 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 194 2024-03-30T12:21:58.951 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.951 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:58.951 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 7040, 2024-03-30T12:21:58.951 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 80 2024-03-30T12:21:58.951 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.951 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:58.951 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.951 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.951 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.951 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:58.951 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 521640, 2024-03-30T12:21:58.952 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 45 2024-03-30T12:21:58.952 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.952 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:58.952 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.952 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.952 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.952 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:58.952 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 98800, 2024-03-30T12:21:58.952 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 194 2024-03-30T12:21:58.952 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.952 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:58.952 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 221624, 2024-03-30T12:21:58.952 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3374 2024-03-30T12:21:58.953 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.953 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:58.953 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.953 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.953 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.953 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:58.953 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.953 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.953 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.953 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:58.953 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.953 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.953 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.953 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:58.954 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.954 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.954 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.954 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.954 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.1": { 2024-03-30T12:21:58.954 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:58.954 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.954 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.954 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.954 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:58.954 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6368, 2024-03-30T12:21:58.954 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 123 2024-03-30T12:21:58.955 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.955 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:58.955 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 16896, 2024-03-30T12:21:58.955 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8 2024-03-30T12:21:58.955 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.955 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:58.955 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-03-30T12:21:58.955 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:58.955 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.955 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:58.955 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 4320, 2024-03-30T12:21:58.955 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 54 2024-03-30T12:21:58.955 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.956 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:58.956 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19040, 2024-03-30T12:21:58.956 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 170 2024-03-30T12:21:58.956 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.956 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:58.956 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1488, 2024-03-30T12:21:58.956 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 43 2024-03-30T12:21:58.956 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.956 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:58.956 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12288, 2024-03-30T12:21:58.956 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:58.956 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.956 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:58.957 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 84916, 2024-03-30T12:21:58.957 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 14591 2024-03-30T12:21:58.957 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.957 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:58.957 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 192696, 2024-03-30T12:21:58.957 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 315 2024-03-30T12:21:58.957 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.957 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:58.957 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 9216, 2024-03-30T12:21:58.958 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 555 2024-03-30T12:21:58.958 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.958 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:58.958 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8160, 2024-03-30T12:21:58.958 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 170 2024-03-30T12:21:58.958 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.958 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:58.958 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.958 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.958 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.958 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:58.959 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 27056, 2024-03-30T12:21:58.959 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 183 2024-03-30T12:21:58.959 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.959 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:58.959 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19152, 2024-03-30T12:21:58.959 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 171 2024-03-30T12:21:58.959 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.959 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:58.959 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1472, 2024-03-30T12:21:58.959 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 2 2024-03-30T12:21:58.959 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.959 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:58.960 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 434861, 2024-03-30T12:21:58.960 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 98 2024-03-30T12:21:58.960 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.960 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:58.960 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 20128, 2024-03-30T12:21:58.960 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 5 2024-03-30T12:21:58.960 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.960 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:58.960 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2434876, 2024-03-30T12:21:58.960 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 182 2024-03-30T12:21:58.960 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.960 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:58.960 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 4840, 2024-03-30T12:21:58.961 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 55 2024-03-30T12:21:58.961 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.961 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:58.961 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.961 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.961 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.961 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:58.961 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 428904, 2024-03-30T12:21:58.961 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 37 2024-03-30T12:21:58.961 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.961 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:58.961 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.962 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.962 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.962 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:58.962 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 7280, 2024-03-30T12:21:58.962 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 18 2024-03-30T12:21:58.962 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.962 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:58.962 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 222392, 2024-03-30T12:21:58.962 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3410 2024-03-30T12:21:58.962 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.962 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:58.966 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.966 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.966 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.966 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:58.966 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.966 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.966 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.966 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:58.966 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.966 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.966 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.967 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:58.967 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.967 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.967 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.967 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.967 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.2": { 2024-03-30T12:21:58.967 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:58.967 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.967 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.967 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.967 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:58.967 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6368, 2024-03-30T12:21:58.968 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 123 2024-03-30T12:21:58.968 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.968 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:58.968 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 16896, 2024-03-30T12:21:58.968 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8 2024-03-30T12:21:58.968 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.968 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:58.968 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-03-30T12:21:58.968 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:58.968 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.968 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:58.968 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 3840, 2024-03-30T12:21:58.969 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 48 2024-03-30T12:21:58.969 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.969 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:58.969 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 18928, 2024-03-30T12:21:58.969 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 169 2024-03-30T12:21:58.969 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.969 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:58.969 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1488, 2024-03-30T12:21:58.969 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 43 2024-03-30T12:21:58.969 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.969 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:58.969 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12288, 2024-03-30T12:21:58.969 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:58.970 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.970 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:58.970 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 83401, 2024-03-30T12:21:58.970 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 14357 2024-03-30T12:21:58.970 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.970 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:58.970 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 188616, 2024-03-30T12:21:58.970 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 309 2024-03-30T12:21:58.970 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.970 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:58.970 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8188, 2024-03-30T12:21:58.970 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 505 2024-03-30T12:21:58.971 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.971 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:58.971 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8112, 2024-03-30T12:21:58.971 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 169 2024-03-30T12:21:58.971 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.971 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:58.971 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.971 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.971 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.971 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:58.971 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 25688, 2024-03-30T12:21:58.971 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 177 2024-03-30T12:21:58.972 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.972 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:58.972 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19040, 2024-03-30T12:21:58.972 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 170 2024-03-30T12:21:58.972 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.972 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:58.972 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1472, 2024-03-30T12:21:58.972 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 2 2024-03-30T12:21:58.972 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.972 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:58.972 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 305645, 2024-03-30T12:21:58.972 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 67 2024-03-30T12:21:58.973 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.973 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:58.973 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 20128, 2024-03-30T12:21:58.973 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 5 2024-03-30T12:21:58.973 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.973 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:58.973 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2444032, 2024-03-30T12:21:58.973 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 183 2024-03-30T12:21:58.973 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.973 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:58.973 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 4400, 2024-03-30T12:21:58.973 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 50 2024-03-30T12:21:58.973 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.974 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:58.974 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.974 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.974 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.974 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:58.974 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 359352, 2024-03-30T12:21:58.974 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 31 2024-03-30T12:21:58.974 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.974 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:58.974 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.974 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.975 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.975 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:58.975 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8320, 2024-03-30T12:21:58.975 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 24 2024-03-30T12:21:58.975 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.975 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:58.975 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 222392, 2024-03-30T12:21:58.975 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3410 2024-03-30T12:21:58.975 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.975 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:58.975 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.975 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.975 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.976 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:58.976 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.976 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.976 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.976 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:58.976 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.976 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.976 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.976 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:58.976 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.976 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.976 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.977 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.977 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.3": { 2024-03-30T12:21:58.977 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:58.977 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.977 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.977 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.977 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:58.977 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6368, 2024-03-30T12:21:58.977 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 123 2024-03-30T12:21:58.977 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.977 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:58.977 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 16896, 2024-03-30T12:21:58.977 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8 2024-03-30T12:21:58.978 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.978 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:58.978 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-03-30T12:21:58.978 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:58.978 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.978 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:58.978 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 3920, 2024-03-30T12:21:58.978 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 49 2024-03-30T12:21:58.978 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.978 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:58.978 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19600, 2024-03-30T12:21:58.978 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 175 2024-03-30T12:21:58.979 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.979 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:58.979 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 480, 2024-03-30T12:21:58.979 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 34 2024-03-30T12:21:58.979 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.979 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:58.979 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.979 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.979 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.979 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:58.979 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 43764, 2024-03-30T12:21:58.979 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8375 2024-03-30T12:21:58.979 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.980 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:58.980 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 125376, 2024-03-30T12:21:58.980 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 216 2024-03-30T12:21:58.980 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.980 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:58.980 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 9220, 2024-03-30T12:21:58.980 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 565 2024-03-30T12:21:58.980 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.980 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:58.980 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8400, 2024-03-30T12:21:58.980 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 175 2024-03-30T12:21:58.981 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.981 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:58.981 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.981 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.981 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.981 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:58.981 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 26472, 2024-03-30T12:21:58.981 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 184 2024-03-30T12:21:58.981 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.981 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:58.981 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19600, 2024-03-30T12:21:58.981 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 175 2024-03-30T12:21:58.982 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.982 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:58.982 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2208, 2024-03-30T12:21:58.982 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:58.982 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.982 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:58.982 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 284717, 2024-03-30T12:21:58.982 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 61 2024-03-30T12:21:58.982 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.982 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:58.982 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 26565, 2024-03-30T12:21:58.982 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 9 2024-03-30T12:21:58.983 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.983 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:58.983 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2437681, 2024-03-30T12:21:58.983 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 185 2024-03-30T12:21:58.983 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.983 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:58.983 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 4664, 2024-03-30T12:21:58.983 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 53 2024-03-30T12:21:58.983 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.983 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:58.983 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.983 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.984 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.984 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:58.984 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 417312, 2024-03-30T12:21:58.984 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 36 2024-03-30T12:21:58.984 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.984 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:58.984 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.984 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.984 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.984 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:58.984 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 10400, 2024-03-30T12:21:58.984 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 20 2024-03-30T12:21:58.985 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.985 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:58.985 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 221624, 2024-03-30T12:21:58.985 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3374 2024-03-30T12:21:58.985 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.985 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:58.985 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.985 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.985 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.985 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:58.985 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.985 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.986 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.986 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:58.986 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.986 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.986 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.986 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:58.986 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.986 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.986 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.986 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.986 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.4": { 2024-03-30T12:21:58.986 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:58.987 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.987 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.987 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.987 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:58.987 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6368, 2024-03-30T12:21:58.987 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 123 2024-03-30T12:21:58.987 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.987 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:58.987 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 16896, 2024-03-30T12:21:58.987 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8 2024-03-30T12:21:58.987 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.987 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:58.987 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-03-30T12:21:58.988 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:58.988 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.988 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:58.988 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 3280, 2024-03-30T12:21:58.988 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 41 2024-03-30T12:21:58.988 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.988 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:58.988 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19264, 2024-03-30T12:21:58.988 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 172 2024-03-30T12:21:58.988 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.988 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:58.988 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 816, 2024-03-30T12:21:58.989 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 37 2024-03-30T12:21:58.989 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.989 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:58.989 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.989 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.989 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.989 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:58.989 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 84696, 2024-03-30T12:21:58.989 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 14661 2024-03-30T12:21:58.989 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.989 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:58.989 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 194056, 2024-03-30T12:21:58.989 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 317 2024-03-30T12:21:58.990 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.990 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:58.990 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 9464, 2024-03-30T12:21:58.990 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 560 2024-03-30T12:21:58.990 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.990 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:58.990 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8256, 2024-03-30T12:21:58.990 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 172 2024-03-30T12:21:58.990 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.990 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:58.990 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.990 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.991 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.991 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:58.991 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 27232, 2024-03-30T12:21:58.991 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 185 2024-03-30T12:21:58.991 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.991 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:58.991 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19264, 2024-03-30T12:21:58.991 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 172 2024-03-30T12:21:58.991 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.991 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:58.991 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 736, 2024-03-30T12:21:58.991 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 1 2024-03-30T12:21:58.992 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.992 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:58.992 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 887720, 2024-03-30T12:21:58.992 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 66 2024-03-30T12:21:58.992 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.992 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:58.992 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 12112, 2024-03-30T12:21:58.992 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:58.992 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.992 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:58.992 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2459974, 2024-03-30T12:21:58.992 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 189 2024-03-30T12:21:58.993 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.993 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:58.993 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 4752, 2024-03-30T12:21:58.993 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 54 2024-03-30T12:21:58.993 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.993 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:58.993 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.993 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.993 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.993 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:58.993 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 452088, 2024-03-30T12:21:58.993 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 39 2024-03-30T12:21:58.994 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.994 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:58.994 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.994 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.994 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.994 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:58.994 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 7904, 2024-03-30T12:21:58.994 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 16 2024-03-30T12:21:58.994 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.994 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:58.994 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 222392, 2024-03-30T12:21:58.994 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3410 2024-03-30T12:21:58.995 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.995 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:58.995 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.995 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.995 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.995 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:58.995 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.995 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.995 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.995 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:58.995 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.995 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.995 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.995 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:58.996 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.996 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.996 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:58.996 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.996 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.5": { 2024-03-30T12:21:58.996 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:58.996 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.996 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.996 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.996 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:58.996 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6368, 2024-03-30T12:21:58.996 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 123 2024-03-30T12:21:58.996 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.996 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:58.997 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 16896, 2024-03-30T12:21:58.997 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8 2024-03-30T12:21:58.997 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.997 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:58.997 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-03-30T12:21:58.997 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:58.997 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.997 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:58.997 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2880, 2024-03-30T12:21:58.997 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 36 2024-03-30T12:21:58.997 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.997 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:58.997 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19488, 2024-03-30T12:21:58.997 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 174 2024-03-30T12:21:58.998 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.998 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:58.998 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 480, 2024-03-30T12:21:58.998 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 34 2024-03-30T12:21:58.998 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.998 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:58.998 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:58.998 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:58.998 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.998 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:58.998 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 85864, 2024-03-30T12:21:58.998 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 14866 2024-03-30T12:21:58.998 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.999 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:58.999 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 197456, 2024-03-30T12:21:58.999 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 322 2024-03-30T12:21:58.999 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.999 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:58.999 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 9872, 2024-03-30T12:21:58.999 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 569 2024-03-30T12:21:58.999 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:58.999 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:58.999 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8352, 2024-03-30T12:21:58.999 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 174 2024-03-30T12:21:58.999 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.000 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:59.000 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.000 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.000 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.000 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:59.000 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 28176, 2024-03-30T12:21:59.000 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 190 2024-03-30T12:21:59.000 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.000 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:59.000 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 19488, 2024-03-30T12:21:59.000 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 174 2024-03-30T12:21:59.000 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.000 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:59.000 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2208, 2024-03-30T12:21:59.001 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:59.001 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.001 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:59.001 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 819320, 2024-03-30T12:21:59.001 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 49 2024-03-30T12:21:59.001 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.001 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:59.001 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 26565, 2024-03-30T12:21:59.001 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 9 2024-03-30T12:21:59.001 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.001 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:59.001 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2435296, 2024-03-30T12:21:59.002 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 177 2024-03-30T12:21:59.002 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.002 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:59.002 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5456, 2024-03-30T12:21:59.002 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 62 2024-03-30T12:21:59.002 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.002 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:59.002 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.002 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.002 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.002 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:59.002 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 486864, 2024-03-30T12:21:59.003 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 42 2024-03-30T12:21:59.003 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.003 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:59.003 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.003 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.003 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.003 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:59.003 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 11960, 2024-03-30T12:21:59.003 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 23 2024-03-30T12:21:59.003 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.003 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:59.003 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 222136, 2024-03-30T12:21:59.003 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3398 2024-03-30T12:21:59.004 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.004 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:59.004 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.004 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.004 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.004 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:59.004 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.004 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.004 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.004 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:59.004 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.004 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.005 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.005 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:59.005 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.005 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.005 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.005 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.005 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.6": { 2024-03-30T12:21:59.005 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:59.005 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.005 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.005 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.005 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:59.005 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6368, 2024-03-30T12:21:59.006 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 123 2024-03-30T12:21:59.006 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.006 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:59.006 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 16896, 2024-03-30T12:21:59.006 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8 2024-03-30T12:21:59.006 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.006 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:59.006 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-03-30T12:21:59.006 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:59.006 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.006 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:59.006 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2320, 2024-03-30T12:21:59.007 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 29 2024-03-30T12:21:59.007 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.007 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:59.007 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 20384, 2024-03-30T12:21:59.007 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 182 2024-03-30T12:21:59.007 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.007 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:59.007 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 480, 2024-03-30T12:21:59.007 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 34 2024-03-30T12:21:59.007 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.007 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:59.007 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 14629, 2024-03-30T12:21:59.008 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:59.008 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.008 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:59.008 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 45443, 2024-03-30T12:21:59.008 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8826 2024-03-30T12:21:59.008 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.008 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:59.008 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 127416, 2024-03-30T12:21:59.008 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 219 2024-03-30T12:21:59.008 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.008 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:59.008 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 10764, 2024-03-30T12:21:59.009 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 723 2024-03-30T12:21:59.009 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.009 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:59.009 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8736, 2024-03-30T12:21:59.009 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 182 2024-03-30T12:21:59.009 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.009 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:59.009 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.009 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.009 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.009 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:59.009 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 28604, 2024-03-30T12:21:59.010 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 187 2024-03-30T12:21:59.010 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.010 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:59.010 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 20384, 2024-03-30T12:21:59.010 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 182 2024-03-30T12:21:59.010 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.010 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:59.010 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.010 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.010 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.010 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:59.010 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 197266, 2024-03-30T12:21:59.011 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 41 2024-03-30T12:21:59.011 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.011 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:59.011 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.011 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.011 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.011 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:59.011 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2436605, 2024-03-30T12:21:59.011 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 177 2024-03-30T12:21:59.011 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.011 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:59.011 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 4664, 2024-03-30T12:21:59.011 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 53 2024-03-30T12:21:59.011 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.012 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:59.012 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.012 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.012 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.012 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:59.012 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 452088, 2024-03-30T12:21:59.012 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 39 2024-03-30T12:21:59.012 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.012 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:59.012 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.012 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.012 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.012 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:59.013 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 98592, 2024-03-30T12:21:59.013 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 200 2024-03-30T12:21:59.013 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.013 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:59.013 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 221624, 2024-03-30T12:21:59.013 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3374 2024-03-30T12:21:59.013 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.013 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:59.013 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.013 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.013 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.013 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:59.013 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.013 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.014 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.014 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:59.014 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.014 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.014 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.014 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:59.014 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.014 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.014 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.014 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.014 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.7": { 2024-03-30T12:21:59.014 INFO:tasks.workunit.client.0.smithi084.stdout: "bloom_filter": { 2024-03-30T12:21:59.015 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.015 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.015 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.015 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:59.015 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 6368, 2024-03-30T12:21:59.015 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 123 2024-03-30T12:21:59.015 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.015 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_reader": { 2024-03-30T12:21:59.015 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 16896, 2024-03-30T12:21:59.015 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 8 2024-03-30T12:21:59.015 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.015 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs_file_writer": { 2024-03-30T12:21:59.015 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 576, 2024-03-30T12:21:59.016 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3 2024-03-30T12:21:59.016 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.016 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_alloc": { 2024-03-30T12:21:59.016 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 1600, 2024-03-30T12:21:59.016 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 20 2024-03-30T12:21:59.016 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.016 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_blob": { 2024-03-30T12:21:59.016 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 20272, 2024-03-30T12:21:59.016 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 181 2024-03-30T12:21:59.016 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.016 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_buffer": { 2024-03-30T12:21:59.016 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 928, 2024-03-30T12:21:59.017 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 38 2024-03-30T12:21:59.017 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.017 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_data": { 2024-03-30T12:21:59.017 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 266240, 2024-03-30T12:21:59.017 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 6 2024-03-30T12:21:59.017 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.017 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_meta": { 2024-03-30T12:21:59.017 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 88533, 2024-03-30T12:21:59.017 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 15408 2024-03-30T12:21:59.017 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.017 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_onode": { 2024-03-30T12:21:59.017 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 200856, 2024-03-30T12:21:59.017 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 327 2024-03-30T12:21:59.018 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.018 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_cache_other": { 2024-03-30T12:21:59.018 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 11528, 2024-03-30T12:21:59.018 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 728 2024-03-30T12:21:59.018 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.018 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_extent": { 2024-03-30T12:21:59.018 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 8688, 2024-03-30T12:21:59.018 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 181 2024-03-30T12:21:59.018 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.018 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_fsck": { 2024-03-30T12:21:59.018 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.019 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.019 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.019 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_inline_bl": { 2024-03-30T12:21:59.019 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 30820, 2024-03-30T12:21:59.019 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 195 2024-03-30T12:21:59.019 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.019 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_shared_blob": { 2024-03-30T12:21:59.019 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 20272, 2024-03-30T12:21:59.019 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 181 2024-03-30T12:21:59.019 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.019 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_txc": { 2024-03-30T12:21:59.019 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.020 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.020 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.020 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing": { 2024-03-30T12:21:59.020 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 151165, 2024-03-30T12:21:59.020 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 30 2024-03-30T12:21:59.020 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.020 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore_writing_deferred": { 2024-03-30T12:21:59.020 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.020 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.020 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.020 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_anon": { 2024-03-30T12:21:59.020 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 2414766, 2024-03-30T12:21:59.021 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 187 2024-03-30T12:21:59.021 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.021 INFO:tasks.workunit.client.0.smithi084.stdout: "buffer_meta": { 2024-03-30T12:21:59.021 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 5808, 2024-03-30T12:21:59.021 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 66 2024-03-30T12:21:59.021 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.021 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_co": { 2024-03-30T12:21:59.021 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.021 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.021 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.021 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:59.021 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 533232, 2024-03-30T12:21:59.022 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 46 2024-03-30T12:21:59.022 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.022 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_mapbl": { 2024-03-30T12:21:59.022 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.022 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.022 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.022 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_pglog": { 2024-03-30T12:21:59.022 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 102960, 2024-03-30T12:21:59.022 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 242 2024-03-30T12:21:59.022 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.022 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap": { 2024-03-30T12:21:59.022 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 221624, 2024-03-30T12:21:59.023 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 3374 2024-03-30T12:21:59.023 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.023 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap_mapping": { 2024-03-30T12:21:59.023 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.023 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.023 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.023 INFO:tasks.workunit.client.0.smithi084.stdout: "pgmap": { 2024-03-30T12:21:59.023 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.023 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.023 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.023 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_1": { 2024-03-30T12:21:59.023 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.024 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.024 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.024 INFO:tasks.workunit.client.0.smithi084.stdout: "unittest_2": { 2024-03-30T12:21:59.024 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes": 0, 2024-03-30T12:21:59.024 INFO:tasks.workunit.client.0.smithi084.stdout: "items": 0 2024-03-30T12:21:59.024 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.024 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.024 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.024 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.024 INFO:tasks.workunit.client.0.smithi084.stdout: "metadata": { 2024-03-30T12:21:59.024 INFO:tasks.workunit.client.0.smithi084.stdout: "mds": { 2024-03-30T12:21:59.024 INFO:tasks.workunit.client.0.smithi084.stdout: "arch": { 2024-03-30T12:21:59.025 INFO:tasks.workunit.client.0.smithi084.stdout: "x86_64": 2 2024-03-30T12:21:59.025 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.025 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_version": { 2024-03-30T12:21:59.025 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 2 2024-03-30T12:21:59.025 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.025 INFO:tasks.workunit.client.0.smithi084.stdout: "cpu": { 2024-03-30T12:21:59.025 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 2 2024-03-30T12:21:59.025 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.025 INFO:tasks.workunit.client.0.smithi084.stdout: "distro": { 2024-03-30T12:21:59.025 INFO:tasks.workunit.client.0.smithi084.stdout: "centos": 2 2024-03-30T12:21:59.025 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.025 INFO:tasks.workunit.client.0.smithi084.stdout: "distro_description": { 2024-03-30T12:21:59.026 INFO:tasks.workunit.client.0.smithi084.stdout: "CentOS Stream 8": 2 2024-03-30T12:21:59.026 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.026 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_description": { 2024-03-30T12:21:59.026 INFO:tasks.workunit.client.0.smithi084.stdout: "#1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024": 2 2024-03-30T12:21:59.026 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.026 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_version": { 2024-03-30T12:21:59.026 INFO:tasks.workunit.client.0.smithi084.stdout: "5.14.0-434.el9.x86_64": 2 2024-03-30T12:21:59.026 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.026 INFO:tasks.workunit.client.0.smithi084.stdout: "os": { 2024-03-30T12:21:59.026 INFO:tasks.workunit.client.0.smithi084.stdout: "Linux": 2 2024-03-30T12:21:59.026 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.027 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.027 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-03-30T12:21:59.027 INFO:tasks.workunit.client.0.smithi084.stdout: "arch": { 2024-03-30T12:21:59.027 INFO:tasks.workunit.client.0.smithi084.stdout: "x86_64": 3 2024-03-30T12:21:59.027 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.027 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_version": { 2024-03-30T12:21:59.027 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 3 2024-03-30T12:21:59.027 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.027 INFO:tasks.workunit.client.0.smithi084.stdout: "cpu": { 2024-03-30T12:21:59.027 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 3 2024-03-30T12:21:59.027 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.028 INFO:tasks.workunit.client.0.smithi084.stdout: "distro": { 2024-03-30T12:21:59.028 INFO:tasks.workunit.client.0.smithi084.stdout: "centos": 3 2024-03-30T12:21:59.028 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.028 INFO:tasks.workunit.client.0.smithi084.stdout: "distro_description": { 2024-03-30T12:21:59.028 INFO:tasks.workunit.client.0.smithi084.stdout: "CentOS Stream 8": 3 2024-03-30T12:21:59.028 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.028 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_description": { 2024-03-30T12:21:59.028 INFO:tasks.workunit.client.0.smithi084.stdout: "#1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024": 3 2024-03-30T12:21:59.028 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.028 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_version": { 2024-03-30T12:21:59.028 INFO:tasks.workunit.client.0.smithi084.stdout: "5.14.0-434.el9.x86_64": 3 2024-03-30T12:21:59.028 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.028 INFO:tasks.workunit.client.0.smithi084.stdout: "os": { 2024-03-30T12:21:59.029 INFO:tasks.workunit.client.0.smithi084.stdout: "Linux": 3 2024-03-30T12:21:59.029 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.029 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.029 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:59.029 INFO:tasks.workunit.client.0.smithi084.stdout: "arch": { 2024-03-30T12:21:59.029 INFO:tasks.workunit.client.0.smithi084.stdout: "x86_64": 8 2024-03-30T12:21:59.029 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.029 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_version": { 2024-03-30T12:21:59.029 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 8 2024-03-30T12:21:59.029 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.029 INFO:tasks.workunit.client.0.smithi084.stdout: "cpu": { 2024-03-30T12:21:59.029 INFO:tasks.workunit.client.0.smithi084.stdout: "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz": 8 2024-03-30T12:21:59.029 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.030 INFO:tasks.workunit.client.0.smithi084.stdout: "distro": { 2024-03-30T12:21:59.030 INFO:tasks.workunit.client.0.smithi084.stdout: "centos": 8 2024-03-30T12:21:59.030 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.030 INFO:tasks.workunit.client.0.smithi084.stdout: "distro_description": { 2024-03-30T12:21:59.030 INFO:tasks.workunit.client.0.smithi084.stdout: "CentOS Stream 8": 8 2024-03-30T12:21:59.030 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.030 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_description": { 2024-03-30T12:21:59.030 INFO:tasks.workunit.client.0.smithi084.stdout: "#1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024": 8 2024-03-30T12:21:59.030 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.030 INFO:tasks.workunit.client.0.smithi084.stdout: "kernel_version": { 2024-03-30T12:21:59.030 INFO:tasks.workunit.client.0.smithi084.stdout: "5.14.0-434.el9.x86_64": 8 2024-03-30T12:21:59.030 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.030 INFO:tasks.workunit.client.0.smithi084.stdout: "os": { 2024-03-30T12:21:59.031 INFO:tasks.workunit.client.0.smithi084.stdout: "Linux": 8 2024-03-30T12:21:59.031 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.031 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_objectstore": { 2024-03-30T12:21:59.031 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": 8 2024-03-30T12:21:59.031 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.031 INFO:tasks.workunit.client.0.smithi084.stdout: "rotational": { 2024-03-30T12:21:59.031 INFO:tasks.workunit.client.0.smithi084.stdout: "0": 8 2024-03-30T12:21:59.031 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.031 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.031 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.031 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-03-30T12:21:59.031 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-03-30T12:21:59.031 INFO:tasks.workunit.client.0.smithi084.stdout: "features": { 2024-03-30T12:21:59.031 INFO:tasks.workunit.client.0.smithi084.stdout: "optional": [], 2024-03-30T12:21:59.032 INFO:tasks.workunit.client.0.smithi084.stdout: "persistent": [ 2024-03-30T12:21:59.032 INFO:tasks.workunit.client.0.smithi084.stdout: "kraken", 2024-03-30T12:21:59.032 INFO:tasks.workunit.client.0.smithi084.stdout: "luminous", 2024-03-30T12:21:59.032 INFO:tasks.workunit.client.0.smithi084.stdout: "mimic", 2024-03-30T12:21:59.032 INFO:tasks.workunit.client.0.smithi084.stdout: "osdmap-prune", 2024-03-30T12:21:59.032 INFO:tasks.workunit.client.0.smithi084.stdout: "nautilus", 2024-03-30T12:21:59.032 INFO:tasks.workunit.client.0.smithi084.stdout: "octopus", 2024-03-30T12:21:59.032 INFO:tasks.workunit.client.0.smithi084.stdout: "pacific", 2024-03-30T12:21:59.032 INFO:tasks.workunit.client.0.smithi084.stdout: "elector-pinging", 2024-03-30T12:21:59.032 INFO:tasks.workunit.client.0.smithi084.stdout: "quincy", 2024-03-30T12:21:59.032 INFO:tasks.workunit.client.0.smithi084.stdout: "reef" 2024-03-30T12:21:59.032 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.033 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.033 INFO:tasks.workunit.client.0.smithi084.stdout: "ipv4_addr_mons": 6, 2024-03-30T12:21:59.033 INFO:tasks.workunit.client.0.smithi084.stdout: "ipv6_addr_mons": 0, 2024-03-30T12:21:59.033 INFO:tasks.workunit.client.0.smithi084.stdout: "min_mon_release": 18, 2024-03-30T12:21:59.033 INFO:tasks.workunit.client.0.smithi084.stdout: "v1_addr_mons": 3, 2024-03-30T12:21:59.033 INFO:tasks.workunit.client.0.smithi084.stdout: "v2_addr_mons": 3 2024-03-30T12:21:59.033 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.033 INFO:tasks.workunit.client.0.smithi084.stdout: "organization": "ceph-qa", 2024-03-30T12:21:59.033 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:59.033 INFO:tasks.workunit.client.0.smithi084.stdout: "cluster_network": false, 2024-03-30T12:21:59.033 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 8, 2024-03-30T12:21:59.033 INFO:tasks.workunit.client.0.smithi084.stdout: "require_min_compat_client": "luminous", 2024-03-30T12:21:59.033 INFO:tasks.workunit.client.0.smithi084.stdout: "require_osd_release": "reef" 2024-03-30T12:21:59.034 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.034 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_perf_histograms": [ 2024-03-30T12:21:59.034 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.034 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-30T12:21:59.034 INFO:tasks.workunit.client.0.smithi084.stdout: "axes": [ 2024-03-30T12:21:59.034 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.034 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-03-30T12:21:59.034 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-03-30T12:21:59.034 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Latency (usec)", 2024-03-30T12:21:59.034 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 100000, 2024-03-30T12:21:59.034 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-03-30T12:21:59.035 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-03-30T12:21:59.035 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 99999]", 2024-03-30T12:21:59.035 INFO:tasks.workunit.client.0.smithi084.stdout: "[100000, 199999]", 2024-03-30T12:21:59.035 INFO:tasks.workunit.client.0.smithi084.stdout: "[200000, 399999]", 2024-03-30T12:21:59.035 INFO:tasks.workunit.client.0.smithi084.stdout: "[400000, 799999]", 2024-03-30T12:21:59.035 INFO:tasks.workunit.client.0.smithi084.stdout: "[800000, 1599999]", 2024-03-30T12:21:59.035 INFO:tasks.workunit.client.0.smithi084.stdout: "[1600000, 3199999]", 2024-03-30T12:21:59.035 INFO:tasks.workunit.client.0.smithi084.stdout: "[3200000, 6399999]", 2024-03-30T12:21:59.035 INFO:tasks.workunit.client.0.smithi084.stdout: "[6400000, 12799999]", 2024-03-30T12:21:59.035 INFO:tasks.workunit.client.0.smithi084.stdout: "[12800000, 25599999]", 2024-03-30T12:21:59.035 INFO:tasks.workunit.client.0.smithi084.stdout: "[25600000, 51199999]", 2024-03-30T12:21:59.036 INFO:tasks.workunit.client.0.smithi084.stdout: "[51200000, 102399999]", 2024-03-30T12:21:59.036 INFO:tasks.workunit.client.0.smithi084.stdout: "[102400000, 204799999]", 2024-03-30T12:21:59.036 INFO:tasks.workunit.client.0.smithi084.stdout: "[204800000, 409599999]", 2024-03-30T12:21:59.036 INFO:tasks.workunit.client.0.smithi084.stdout: "[409600000, 819199999]", 2024-03-30T12:21:59.036 INFO:tasks.workunit.client.0.smithi084.stdout: "[819200000, 1638399999]", 2024-03-30T12:21:59.036 INFO:tasks.workunit.client.0.smithi084.stdout: "[1638400000, 3276799999]", 2024-03-30T12:21:59.036 INFO:tasks.workunit.client.0.smithi084.stdout: "[3276800000, 6553599999]", 2024-03-30T12:21:59.036 INFO:tasks.workunit.client.0.smithi084.stdout: "[6553600000, 13107199999]", 2024-03-30T12:21:59.036 INFO:tasks.workunit.client.0.smithi084.stdout: "[13107200000, 26214399999]", 2024-03-30T12:21:59.036 INFO:tasks.workunit.client.0.smithi084.stdout: "[26214400000, 52428799999]", 2024-03-30T12:21:59.036 INFO:tasks.workunit.client.0.smithi084.stdout: "[52428800000, 104857599999]", 2024-03-30T12:21:59.036 INFO:tasks.workunit.client.0.smithi084.stdout: "[104857600000, 209715199999]", 2024-03-30T12:21:59.036 INFO:tasks.workunit.client.0.smithi084.stdout: "[209715200000, 419430399999]", 2024-03-30T12:21:59.037 INFO:tasks.workunit.client.0.smithi084.stdout: "[419430400000, 838860799999]", 2024-03-30T12:21:59.037 INFO:tasks.workunit.client.0.smithi084.stdout: "[838860800000, 1677721599999]", 2024-03-30T12:21:59.037 INFO:tasks.workunit.client.0.smithi084.stdout: "[1677721600000, 3355443199999]", 2024-03-30T12:21:59.037 INFO:tasks.workunit.client.0.smithi084.stdout: "[3355443200000, 6710886399999]", 2024-03-30T12:21:59.037 INFO:tasks.workunit.client.0.smithi084.stdout: "[6710886400000, 13421772799999]", 2024-03-30T12:21:59.037 INFO:tasks.workunit.client.0.smithi084.stdout: "[13421772800000, 26843545599999]", 2024-03-30T12:21:59.037 INFO:tasks.workunit.client.0.smithi084.stdout: "[26843545600000, 53687091199999]", 2024-03-30T12:21:59.037 INFO:tasks.workunit.client.0.smithi084.stdout: "[53687091200000, None]" 2024-03-30T12:21:59.037 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.037 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-03-30T12:21:59.037 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.037 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.038 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-03-30T12:21:59.038 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-03-30T12:21:59.038 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Request size (bytes)", 2024-03-30T12:21:59.038 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 512, 2024-03-30T12:21:59.038 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-03-30T12:21:59.038 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-03-30T12:21:59.038 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 511]", 2024-03-30T12:21:59.038 INFO:tasks.workunit.client.0.smithi084.stdout: "[512, 1023]", 2024-03-30T12:21:59.038 INFO:tasks.workunit.client.0.smithi084.stdout: "[1024, 2047]", 2024-03-30T12:21:59.038 INFO:tasks.workunit.client.0.smithi084.stdout: "[2048, 4095]", 2024-03-30T12:21:59.038 INFO:tasks.workunit.client.0.smithi084.stdout: "[4096, 8191]", 2024-03-30T12:21:59.038 INFO:tasks.workunit.client.0.smithi084.stdout: "[8192, 16383]", 2024-03-30T12:21:59.039 INFO:tasks.workunit.client.0.smithi084.stdout: "[16384, 32767]", 2024-03-30T12:21:59.039 INFO:tasks.workunit.client.0.smithi084.stdout: "[32768, 65535]", 2024-03-30T12:21:59.039 INFO:tasks.workunit.client.0.smithi084.stdout: "[65536, 131071]", 2024-03-30T12:21:59.039 INFO:tasks.workunit.client.0.smithi084.stdout: "[131072, 262143]", 2024-03-30T12:21:59.039 INFO:tasks.workunit.client.0.smithi084.stdout: "[262144, 524287]", 2024-03-30T12:21:59.039 INFO:tasks.workunit.client.0.smithi084.stdout: "[524288, 1048575]", 2024-03-30T12:21:59.039 INFO:tasks.workunit.client.0.smithi084.stdout: "[1048576, 2097151]", 2024-03-30T12:21:59.039 INFO:tasks.workunit.client.0.smithi084.stdout: "[2097152, 4194303]", 2024-03-30T12:21:59.039 INFO:tasks.workunit.client.0.smithi084.stdout: "[4194304, 8388607]", 2024-03-30T12:21:59.039 INFO:tasks.workunit.client.0.smithi084.stdout: "[8388608, 16777215]", 2024-03-30T12:21:59.039 INFO:tasks.workunit.client.0.smithi084.stdout: "[16777216, 33554431]", 2024-03-30T12:21:59.039 INFO:tasks.workunit.client.0.smithi084.stdout: "[33554432, 67108863]", 2024-03-30T12:21:59.040 INFO:tasks.workunit.client.0.smithi084.stdout: "[67108864, 134217727]", 2024-03-30T12:21:59.040 INFO:tasks.workunit.client.0.smithi084.stdout: "[134217728, 268435455]", 2024-03-30T12:21:59.040 INFO:tasks.workunit.client.0.smithi084.stdout: "[268435456, 536870911]", 2024-03-30T12:21:59.040 INFO:tasks.workunit.client.0.smithi084.stdout: "[536870912, 1073741823]", 2024-03-30T12:21:59.040 INFO:tasks.workunit.client.0.smithi084.stdout: "[1073741824, 2147483647]", 2024-03-30T12:21:59.040 INFO:tasks.workunit.client.0.smithi084.stdout: "[2147483648, 4294967295]", 2024-03-30T12:21:59.040 INFO:tasks.workunit.client.0.smithi084.stdout: "[4294967296, 8589934591]", 2024-03-30T12:21:59.040 INFO:tasks.workunit.client.0.smithi084.stdout: "[8589934592, 17179869183]", 2024-03-30T12:21:59.040 INFO:tasks.workunit.client.0.smithi084.stdout: "[17179869184, 34359738367]", 2024-03-30T12:21:59.040 INFO:tasks.workunit.client.0.smithi084.stdout: "[34359738368, 68719476735]", 2024-03-30T12:21:59.040 INFO:tasks.workunit.client.0.smithi084.stdout: "[68719476736, 137438953471]", 2024-03-30T12:21:59.040 INFO:tasks.workunit.client.0.smithi084.stdout: "[137438953472, 274877906943]", 2024-03-30T12:21:59.040 INFO:tasks.workunit.client.0.smithi084.stdout: "[274877906944, None]" 2024-03-30T12:21:59.040 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.041 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-03-30T12:21:59.041 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.041 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.041 INFO:tasks.workunit.client.0.smithi084.stdout: "osds": [ 2024-03-30T12:21:59.041 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.041 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 0, 2024-03-30T12:21:59.041 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.041 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.041 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.041 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.041 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.041 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.042 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.042 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.042 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.042 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.042 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.042 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.042 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.042 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.042 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.042 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.042 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.043 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.043 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.043 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.043 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.043 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.043 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.043 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.043 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.043 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.043 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.043 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.043 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.043 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.044 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.044 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.044 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.044 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.044 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.044 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.044 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 1, 2024-03-30T12:21:59.044 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.044 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.044 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.044 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 22, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.044 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 11, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.044 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.045 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.045 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.045 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.045 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.045 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.045 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.045 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.045 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.045 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.045 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.045 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.045 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.045 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.046 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.046 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.046 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.046 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.046 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.046 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.046 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.046 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.046 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.046 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.046 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.046 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.047 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.047 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.047 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.047 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.047 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.047 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 2, 2024-03-30T12:21:59.047 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.047 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.047 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.047 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.047 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.047 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.047 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.047 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.048 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.048 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.048 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.048 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.048 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.048 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.048 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.048 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.048 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.048 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.048 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.048 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.049 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.049 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.049 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.049 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.049 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.049 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.049 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.049 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.049 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.049 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.049 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.049 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.049 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.049 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.050 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.050 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.050 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 3, 2024-03-30T12:21:59.050 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.050 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.050 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.050 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.050 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.050 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.050 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.050 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.051 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.051 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.051 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.051 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.051 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.051 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.051 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.051 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.051 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.051 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.051 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.051 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.051 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.051 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.052 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.052 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.052 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.052 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.052 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.052 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.052 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.052 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.052 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.052 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.052 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.052 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.053 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.053 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.053 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 4, 2024-03-30T12:21:59.053 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.053 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.053 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.053 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.053 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.053 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.053 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.053 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.053 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.053 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.054 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.054 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.054 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.054 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.054 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.054 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.054 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.054 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.054 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.054 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.054 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.054 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.055 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.055 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.055 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.055 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.055 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.055 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.055 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.055 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.055 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.055 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.055 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.055 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.056 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.056 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.056 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 5, 2024-03-30T12:21:59.056 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.056 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.056 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.056 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.056 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.056 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.056 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.056 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.056 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.057 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.057 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.057 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.057 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.057 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.057 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.057 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.057 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.057 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.057 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.057 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.057 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.058 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.058 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.058 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.058 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.058 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.058 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.058 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.058 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.058 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.058 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.058 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.058 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.059 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.059 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.059 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.059 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 6, 2024-03-30T12:21:59.059 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.059 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.059 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.059 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.059 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.059 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.059 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.059 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.060 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.060 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.060 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.060 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.060 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.060 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.060 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.060 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.060 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.060 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.060 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.061 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.061 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.061 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.061 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.061 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.061 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.061 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.061 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.061 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.061 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.061 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.061 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.062 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.062 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.062 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.062 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.062 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.062 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 7, 2024-03-30T12:21:59.062 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.062 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.062 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.062 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 109, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.062 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 15, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.063 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.063 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.063 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.063 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.063 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.063 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.063 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.063 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.063 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.063 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.063 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.064 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.064 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.064 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.064 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.064 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.064 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.064 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.064 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.064 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.064 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.064 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.065 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.065 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.065 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.065 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.065 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.065 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.065 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.065 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.065 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.065 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.065 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-30T12:21:59.065 INFO:tasks.workunit.client.0.smithi084.stdout: "axes": [ 2024-03-30T12:21:59.066 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.066 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-03-30T12:21:59.066 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-03-30T12:21:59.066 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Latency (usec)", 2024-03-30T12:21:59.066 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 100000, 2024-03-30T12:21:59.066 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-03-30T12:21:59.066 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-03-30T12:21:59.066 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 99999]", 2024-03-30T12:21:59.066 INFO:tasks.workunit.client.0.smithi084.stdout: "[100000, 199999]", 2024-03-30T12:21:59.066 INFO:tasks.workunit.client.0.smithi084.stdout: "[200000, 399999]", 2024-03-30T12:21:59.066 INFO:tasks.workunit.client.0.smithi084.stdout: "[400000, 799999]", 2024-03-30T12:21:59.067 INFO:tasks.workunit.client.0.smithi084.stdout: "[800000, 1599999]", 2024-03-30T12:21:59.067 INFO:tasks.workunit.client.0.smithi084.stdout: "[1600000, 3199999]", 2024-03-30T12:21:59.067 INFO:tasks.workunit.client.0.smithi084.stdout: "[3200000, 6399999]", 2024-03-30T12:21:59.067 INFO:tasks.workunit.client.0.smithi084.stdout: "[6400000, 12799999]", 2024-03-30T12:21:59.067 INFO:tasks.workunit.client.0.smithi084.stdout: "[12800000, 25599999]", 2024-03-30T12:21:59.067 INFO:tasks.workunit.client.0.smithi084.stdout: "[25600000, 51199999]", 2024-03-30T12:21:59.067 INFO:tasks.workunit.client.0.smithi084.stdout: "[51200000, 102399999]", 2024-03-30T12:21:59.067 INFO:tasks.workunit.client.0.smithi084.stdout: "[102400000, 204799999]", 2024-03-30T12:21:59.067 INFO:tasks.workunit.client.0.smithi084.stdout: "[204800000, 409599999]", 2024-03-30T12:21:59.067 INFO:tasks.workunit.client.0.smithi084.stdout: "[409600000, 819199999]", 2024-03-30T12:21:59.067 INFO:tasks.workunit.client.0.smithi084.stdout: "[819200000, 1638399999]", 2024-03-30T12:21:59.067 INFO:tasks.workunit.client.0.smithi084.stdout: "[1638400000, 3276799999]", 2024-03-30T12:21:59.068 INFO:tasks.workunit.client.0.smithi084.stdout: "[3276800000, 6553599999]", 2024-03-30T12:21:59.068 INFO:tasks.workunit.client.0.smithi084.stdout: "[6553600000, 13107199999]", 2024-03-30T12:21:59.068 INFO:tasks.workunit.client.0.smithi084.stdout: "[13107200000, 26214399999]", 2024-03-30T12:21:59.068 INFO:tasks.workunit.client.0.smithi084.stdout: "[26214400000, 52428799999]", 2024-03-30T12:21:59.068 INFO:tasks.workunit.client.0.smithi084.stdout: "[52428800000, 104857599999]", 2024-03-30T12:21:59.068 INFO:tasks.workunit.client.0.smithi084.stdout: "[104857600000, 209715199999]", 2024-03-30T12:21:59.068 INFO:tasks.workunit.client.0.smithi084.stdout: "[209715200000, 419430399999]", 2024-03-30T12:21:59.068 INFO:tasks.workunit.client.0.smithi084.stdout: "[419430400000, 838860799999]", 2024-03-30T12:21:59.068 INFO:tasks.workunit.client.0.smithi084.stdout: "[838860800000, 1677721599999]", 2024-03-30T12:21:59.068 INFO:tasks.workunit.client.0.smithi084.stdout: "[1677721600000, 3355443199999]", 2024-03-30T12:21:59.068 INFO:tasks.workunit.client.0.smithi084.stdout: "[3355443200000, 6710886399999]", 2024-03-30T12:21:59.068 INFO:tasks.workunit.client.0.smithi084.stdout: "[6710886400000, 13421772799999]", 2024-03-30T12:21:59.068 INFO:tasks.workunit.client.0.smithi084.stdout: "[13421772800000, 26843545599999]", 2024-03-30T12:21:59.069 INFO:tasks.workunit.client.0.smithi084.stdout: "[26843545600000, 53687091199999]", 2024-03-30T12:21:59.069 INFO:tasks.workunit.client.0.smithi084.stdout: "[53687091200000, None]" 2024-03-30T12:21:59.069 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.069 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-03-30T12:21:59.069 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.069 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.069 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-03-30T12:21:59.069 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-03-30T12:21:59.069 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Request size (bytes)", 2024-03-30T12:21:59.069 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 512, 2024-03-30T12:21:59.069 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-03-30T12:21:59.069 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-03-30T12:21:59.070 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 511]", 2024-03-30T12:21:59.070 INFO:tasks.workunit.client.0.smithi084.stdout: "[512, 1023]", 2024-03-30T12:21:59.070 INFO:tasks.workunit.client.0.smithi084.stdout: "[1024, 2047]", 2024-03-30T12:21:59.070 INFO:tasks.workunit.client.0.smithi084.stdout: "[2048, 4095]", 2024-03-30T12:21:59.070 INFO:tasks.workunit.client.0.smithi084.stdout: "[4096, 8191]", 2024-03-30T12:21:59.070 INFO:tasks.workunit.client.0.smithi084.stdout: "[8192, 16383]", 2024-03-30T12:21:59.070 INFO:tasks.workunit.client.0.smithi084.stdout: "[16384, 32767]", 2024-03-30T12:21:59.070 INFO:tasks.workunit.client.0.smithi084.stdout: "[32768, 65535]", 2024-03-30T12:21:59.070 INFO:tasks.workunit.client.0.smithi084.stdout: "[65536, 131071]", 2024-03-30T12:21:59.070 INFO:tasks.workunit.client.0.smithi084.stdout: "[131072, 262143]", 2024-03-30T12:21:59.070 INFO:tasks.workunit.client.0.smithi084.stdout: "[262144, 524287]", 2024-03-30T12:21:59.070 INFO:tasks.workunit.client.0.smithi084.stdout: "[524288, 1048575]", 2024-03-30T12:21:59.071 INFO:tasks.workunit.client.0.smithi084.stdout: "[1048576, 2097151]", 2024-03-30T12:21:59.071 INFO:tasks.workunit.client.0.smithi084.stdout: "[2097152, 4194303]", 2024-03-30T12:21:59.071 INFO:tasks.workunit.client.0.smithi084.stdout: "[4194304, 8388607]", 2024-03-30T12:21:59.071 INFO:tasks.workunit.client.0.smithi084.stdout: "[8388608, 16777215]", 2024-03-30T12:21:59.071 INFO:tasks.workunit.client.0.smithi084.stdout: "[16777216, 33554431]", 2024-03-30T12:21:59.071 INFO:tasks.workunit.client.0.smithi084.stdout: "[33554432, 67108863]", 2024-03-30T12:21:59.071 INFO:tasks.workunit.client.0.smithi084.stdout: "[67108864, 134217727]", 2024-03-30T12:21:59.071 INFO:tasks.workunit.client.0.smithi084.stdout: "[134217728, 268435455]", 2024-03-30T12:21:59.071 INFO:tasks.workunit.client.0.smithi084.stdout: "[268435456, 536870911]", 2024-03-30T12:21:59.071 INFO:tasks.workunit.client.0.smithi084.stdout: "[536870912, 1073741823]", 2024-03-30T12:21:59.071 INFO:tasks.workunit.client.0.smithi084.stdout: "[1073741824, 2147483647]", 2024-03-30T12:21:59.071 INFO:tasks.workunit.client.0.smithi084.stdout: "[2147483648, 4294967295]", 2024-03-30T12:21:59.072 INFO:tasks.workunit.client.0.smithi084.stdout: "[4294967296, 8589934591]", 2024-03-30T12:21:59.072 INFO:tasks.workunit.client.0.smithi084.stdout: "[8589934592, 17179869183]", 2024-03-30T12:21:59.072 INFO:tasks.workunit.client.0.smithi084.stdout: "[17179869184, 34359738367]", 2024-03-30T12:21:59.072 INFO:tasks.workunit.client.0.smithi084.stdout: "[34359738368, 68719476735]", 2024-03-30T12:21:59.072 INFO:tasks.workunit.client.0.smithi084.stdout: "[68719476736, 137438953471]", 2024-03-30T12:21:59.072 INFO:tasks.workunit.client.0.smithi084.stdout: "[137438953472, 274877906943]", 2024-03-30T12:21:59.072 INFO:tasks.workunit.client.0.smithi084.stdout: "[274877906944, None]" 2024-03-30T12:21:59.072 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.072 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-03-30T12:21:59.072 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.072 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.072 INFO:tasks.workunit.client.0.smithi084.stdout: "osds": [ 2024-03-30T12:21:59.073 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.073 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 0, 2024-03-30T12:21:59.073 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.073 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.073 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.073 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.073 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.073 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.073 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.073 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.073 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.073 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.073 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.074 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.075 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.075 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.075 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.075 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.075 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.075 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.075 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.075 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.075 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.075 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.075 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.075 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.075 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.076 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.076 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 1, 2024-03-30T12:21:59.076 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.076 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.076 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.076 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.076 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.076 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 12, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.076 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 9, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.076 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.076 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.076 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.076 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.077 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.078 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.078 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.078 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.078 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.078 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.078 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.078 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.078 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.078 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.078 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.078 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.078 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.079 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.079 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 2, 2024-03-30T12:21:59.079 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.079 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.080 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.080 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.080 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.080 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.080 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.080 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.080 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.080 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.080 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.080 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.080 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.080 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.081 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.081 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.081 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.081 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.082 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 3, 2024-03-30T12:21:59.082 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.082 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.082 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.082 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.082 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.082 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.082 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.082 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.082 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.082 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.082 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.082 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.083 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.083 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.083 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.083 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.083 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.083 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.083 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.083 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.083 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.083 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.083 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.084 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.084 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.084 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.084 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.084 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.084 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.084 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.084 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.084 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.084 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.084 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.084 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.084 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.085 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 4, 2024-03-30T12:21:59.085 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.085 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.085 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.085 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.085 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.085 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.085 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.085 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.085 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.085 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.085 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.085 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.086 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.087 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.087 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.087 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.087 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.087 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.087 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.087 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.087 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.087 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.087 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.087 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.087 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.087 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 5, 2024-03-30T12:21:59.088 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.088 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.088 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.088 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.088 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.088 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.088 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.088 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.088 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.088 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.088 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.088 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.089 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.090 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.090 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.090 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.090 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.090 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.090 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.090 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.090 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.090 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.090 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.090 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.090 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 6, 2024-03-30T12:21:59.090 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.091 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.092 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.092 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.092 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.092 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.092 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.092 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.092 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.092 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.092 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.092 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.092 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.092 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.093 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.093 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.093 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.093 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.093 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.093 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.093 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.093 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.093 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.093 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.093 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.093 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 7, 2024-03-30T12:21:59.093 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 45, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.094 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.095 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.095 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.095 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.095 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.095 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.095 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.095 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.095 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.095 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.095 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.095 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.095 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.096 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.096 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.096 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.096 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.096 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.096 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.096 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.096 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.096 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.096 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.096 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.096 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.096 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.097 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-30T12:21:59.097 INFO:tasks.workunit.client.0.smithi084.stdout: "axes": [ 2024-03-30T12:21:59.097 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.097 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-03-30T12:21:59.097 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-03-30T12:21:59.097 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Latency (usec)", 2024-03-30T12:21:59.097 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 100000, 2024-03-30T12:21:59.097 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-03-30T12:21:59.097 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-03-30T12:21:59.097 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 99999]", 2024-03-30T12:21:59.097 INFO:tasks.workunit.client.0.smithi084.stdout: "[100000, 199999]", 2024-03-30T12:21:59.097 INFO:tasks.workunit.client.0.smithi084.stdout: "[200000, 399999]", 2024-03-30T12:21:59.098 INFO:tasks.workunit.client.0.smithi084.stdout: "[400000, 799999]", 2024-03-30T12:21:59.098 INFO:tasks.workunit.client.0.smithi084.stdout: "[800000, 1599999]", 2024-03-30T12:21:59.098 INFO:tasks.workunit.client.0.smithi084.stdout: "[1600000, 3199999]", 2024-03-30T12:21:59.098 INFO:tasks.workunit.client.0.smithi084.stdout: "[3200000, 6399999]", 2024-03-30T12:21:59.098 INFO:tasks.workunit.client.0.smithi084.stdout: "[6400000, 12799999]", 2024-03-30T12:21:59.098 INFO:tasks.workunit.client.0.smithi084.stdout: "[12800000, 25599999]", 2024-03-30T12:21:59.098 INFO:tasks.workunit.client.0.smithi084.stdout: "[25600000, 51199999]", 2024-03-30T12:21:59.098 INFO:tasks.workunit.client.0.smithi084.stdout: "[51200000, 102399999]", 2024-03-30T12:21:59.098 INFO:tasks.workunit.client.0.smithi084.stdout: "[102400000, 204799999]", 2024-03-30T12:21:59.098 INFO:tasks.workunit.client.0.smithi084.stdout: "[204800000, 409599999]", 2024-03-30T12:21:59.098 INFO:tasks.workunit.client.0.smithi084.stdout: "[409600000, 819199999]", 2024-03-30T12:21:59.098 INFO:tasks.workunit.client.0.smithi084.stdout: "[819200000, 1638399999]", 2024-03-30T12:21:59.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[1638400000, 3276799999]", 2024-03-30T12:21:59.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[3276800000, 6553599999]", 2024-03-30T12:21:59.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[6553600000, 13107199999]", 2024-03-30T12:21:59.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[13107200000, 26214399999]", 2024-03-30T12:21:59.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[26214400000, 52428799999]", 2024-03-30T12:21:59.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[52428800000, 104857599999]", 2024-03-30T12:21:59.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[104857600000, 209715199999]", 2024-03-30T12:21:59.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[209715200000, 419430399999]", 2024-03-30T12:21:59.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[419430400000, 838860799999]", 2024-03-30T12:21:59.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[838860800000, 1677721599999]", 2024-03-30T12:21:59.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[1677721600000, 3355443199999]", 2024-03-30T12:21:59.099 INFO:tasks.workunit.client.0.smithi084.stdout: "[3355443200000, 6710886399999]", 2024-03-30T12:21:59.100 INFO:tasks.workunit.client.0.smithi084.stdout: "[6710886400000, 13421772799999]", 2024-03-30T12:21:59.100 INFO:tasks.workunit.client.0.smithi084.stdout: "[13421772800000, 26843545599999]", 2024-03-30T12:21:59.100 INFO:tasks.workunit.client.0.smithi084.stdout: "[26843545600000, 53687091199999]", 2024-03-30T12:21:59.100 INFO:tasks.workunit.client.0.smithi084.stdout: "[53687091200000, None]" 2024-03-30T12:21:59.100 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.100 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-03-30T12:21:59.100 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.100 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.100 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-03-30T12:21:59.100 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-03-30T12:21:59.100 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Request size (bytes)", 2024-03-30T12:21:59.100 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 512, 2024-03-30T12:21:59.100 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-03-30T12:21:59.101 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-03-30T12:21:59.101 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 511]", 2024-03-30T12:21:59.101 INFO:tasks.workunit.client.0.smithi084.stdout: "[512, 1023]", 2024-03-30T12:21:59.101 INFO:tasks.workunit.client.0.smithi084.stdout: "[1024, 2047]", 2024-03-30T12:21:59.101 INFO:tasks.workunit.client.0.smithi084.stdout: "[2048, 4095]", 2024-03-30T12:21:59.101 INFO:tasks.workunit.client.0.smithi084.stdout: "[4096, 8191]", 2024-03-30T12:21:59.101 INFO:tasks.workunit.client.0.smithi084.stdout: "[8192, 16383]", 2024-03-30T12:21:59.101 INFO:tasks.workunit.client.0.smithi084.stdout: "[16384, 32767]", 2024-03-30T12:21:59.101 INFO:tasks.workunit.client.0.smithi084.stdout: "[32768, 65535]", 2024-03-30T12:21:59.101 INFO:tasks.workunit.client.0.smithi084.stdout: "[65536, 131071]", 2024-03-30T12:21:59.101 INFO:tasks.workunit.client.0.smithi084.stdout: "[131072, 262143]", 2024-03-30T12:21:59.101 INFO:tasks.workunit.client.0.smithi084.stdout: "[262144, 524287]", 2024-03-30T12:21:59.101 INFO:tasks.workunit.client.0.smithi084.stdout: "[524288, 1048575]", 2024-03-30T12:21:59.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[1048576, 2097151]", 2024-03-30T12:21:59.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[2097152, 4194303]", 2024-03-30T12:21:59.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[4194304, 8388607]", 2024-03-30T12:21:59.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[8388608, 16777215]", 2024-03-30T12:21:59.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[16777216, 33554431]", 2024-03-30T12:21:59.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[33554432, 67108863]", 2024-03-30T12:21:59.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[67108864, 134217727]", 2024-03-30T12:21:59.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[134217728, 268435455]", 2024-03-30T12:21:59.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[268435456, 536870911]", 2024-03-30T12:21:59.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[536870912, 1073741823]", 2024-03-30T12:21:59.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[1073741824, 2147483647]", 2024-03-30T12:21:59.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[2147483648, 4294967295]", 2024-03-30T12:21:59.102 INFO:tasks.workunit.client.0.smithi084.stdout: "[4294967296, 8589934591]", 2024-03-30T12:21:59.103 INFO:tasks.workunit.client.0.smithi084.stdout: "[8589934592, 17179869183]", 2024-03-30T12:21:59.103 INFO:tasks.workunit.client.0.smithi084.stdout: "[17179869184, 34359738367]", 2024-03-30T12:21:59.103 INFO:tasks.workunit.client.0.smithi084.stdout: "[34359738368, 68719476735]", 2024-03-30T12:21:59.103 INFO:tasks.workunit.client.0.smithi084.stdout: "[68719476736, 137438953471]", 2024-03-30T12:21:59.103 INFO:tasks.workunit.client.0.smithi084.stdout: "[137438953472, 274877906943]", 2024-03-30T12:21:59.103 INFO:tasks.workunit.client.0.smithi084.stdout: "[274877906944, None]" 2024-03-30T12:21:59.103 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.103 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-03-30T12:21:59.103 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.103 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.103 INFO:tasks.workunit.client.0.smithi084.stdout: "osds": [ 2024-03-30T12:21:59.103 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.103 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 0, 2024-03-30T12:21:59.104 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.104 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.105 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.106 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.106 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.106 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.106 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.106 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.106 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.106 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.106 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.106 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.106 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.106 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.106 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.106 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 1, 2024-03-30T12:21:59.107 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 12, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 9, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.107 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.108 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.108 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.108 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.108 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.108 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.108 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.108 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.108 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.108 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.108 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.108 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.108 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.109 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.109 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.109 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.109 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.109 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.109 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.109 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.109 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.109 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.109 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.109 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.109 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 2, 2024-03-30T12:21:59.110 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.110 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.111 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.111 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.111 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.111 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.111 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.111 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.111 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.111 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.111 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.111 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.111 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.111 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.111 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.112 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.112 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.112 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.112 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.112 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.112 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.112 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.112 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.112 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.112 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.112 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.112 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 3, 2024-03-30T12:21:59.112 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.113 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.113 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.113 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.113 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.113 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.113 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.113 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.113 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.113 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.113 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.113 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.113 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.113 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.114 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.115 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.115 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.115 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.115 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.115 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.115 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.115 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.115 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.115 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.115 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 4, 2024-03-30T12:21:59.115 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.115 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.116 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.116 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.116 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.116 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.116 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.116 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.116 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.116 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.116 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.116 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.116 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.116 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.116 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.117 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.118 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.118 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.118 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.118 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.118 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.118 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.118 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.118 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.118 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.118 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 5, 2024-03-30T12:21:59.118 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.118 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.118 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.119 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.120 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.121 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.121 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.121 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.121 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.121 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.121 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.121 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.121 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.121 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 6, 2024-03-30T12:21:59.121 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.121 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.121 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.121 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.122 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.123 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.123 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.123 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.123 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.123 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.123 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.123 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.123 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.123 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.123 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.123 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.123 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.124 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.124 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.124 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.124 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.124 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.124 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.124 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.124 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 7, 2024-03-30T12:21:59.124 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.124 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.124 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.124 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.124 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.124 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 45, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.125 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.126 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.126 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.126 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.126 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.126 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.126 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.126 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.126 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.126 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.126 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.126 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.126 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.126 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.127 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.127 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.127 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.127 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.127 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.127 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.127 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-30T12:21:59.127 INFO:tasks.workunit.client.0.smithi084.stdout: "axes": [ 2024-03-30T12:21:59.127 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.127 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-03-30T12:21:59.127 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-03-30T12:21:59.127 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Latency (usec)", 2024-03-30T12:21:59.128 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 100000, 2024-03-30T12:21:59.128 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-03-30T12:21:59.128 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-03-30T12:21:59.128 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 99999]", 2024-03-30T12:21:59.128 INFO:tasks.workunit.client.0.smithi084.stdout: "[100000, 199999]", 2024-03-30T12:21:59.128 INFO:tasks.workunit.client.0.smithi084.stdout: "[200000, 399999]", 2024-03-30T12:21:59.128 INFO:tasks.workunit.client.0.smithi084.stdout: "[400000, 799999]", 2024-03-30T12:21:59.128 INFO:tasks.workunit.client.0.smithi084.stdout: "[800000, 1599999]", 2024-03-30T12:21:59.128 INFO:tasks.workunit.client.0.smithi084.stdout: "[1600000, 3199999]", 2024-03-30T12:21:59.128 INFO:tasks.workunit.client.0.smithi084.stdout: "[3200000, 6399999]", 2024-03-30T12:21:59.128 INFO:tasks.workunit.client.0.smithi084.stdout: "[6400000, 12799999]", 2024-03-30T12:21:59.128 INFO:tasks.workunit.client.0.smithi084.stdout: "[12800000, 25599999]", 2024-03-30T12:21:59.128 INFO:tasks.workunit.client.0.smithi084.stdout: "[25600000, 51199999]", 2024-03-30T12:21:59.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[51200000, 102399999]", 2024-03-30T12:21:59.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[102400000, 204799999]", 2024-03-30T12:21:59.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[204800000, 409599999]", 2024-03-30T12:21:59.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[409600000, 819199999]", 2024-03-30T12:21:59.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[819200000, 1638399999]", 2024-03-30T12:21:59.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[1638400000, 3276799999]", 2024-03-30T12:21:59.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[3276800000, 6553599999]", 2024-03-30T12:21:59.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[6553600000, 13107199999]", 2024-03-30T12:21:59.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[13107200000, 26214399999]", 2024-03-30T12:21:59.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[26214400000, 52428799999]", 2024-03-30T12:21:59.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[52428800000, 104857599999]", 2024-03-30T12:21:59.129 INFO:tasks.workunit.client.0.smithi084.stdout: "[104857600000, 209715199999]", 2024-03-30T12:21:59.130 INFO:tasks.workunit.client.0.smithi084.stdout: "[209715200000, 419430399999]", 2024-03-30T12:21:59.130 INFO:tasks.workunit.client.0.smithi084.stdout: "[419430400000, 838860799999]", 2024-03-30T12:21:59.130 INFO:tasks.workunit.client.0.smithi084.stdout: "[838860800000, 1677721599999]", 2024-03-30T12:21:59.130 INFO:tasks.workunit.client.0.smithi084.stdout: "[1677721600000, 3355443199999]", 2024-03-30T12:21:59.130 INFO:tasks.workunit.client.0.smithi084.stdout: "[3355443200000, 6710886399999]", 2024-03-30T12:21:59.130 INFO:tasks.workunit.client.0.smithi084.stdout: "[6710886400000, 13421772799999]", 2024-03-30T12:21:59.130 INFO:tasks.workunit.client.0.smithi084.stdout: "[13421772800000, 26843545599999]", 2024-03-30T12:21:59.130 INFO:tasks.workunit.client.0.smithi084.stdout: "[26843545600000, 53687091199999]", 2024-03-30T12:21:59.130 INFO:tasks.workunit.client.0.smithi084.stdout: "[53687091200000, None]" 2024-03-30T12:21:59.130 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.130 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-03-30T12:21:59.130 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.131 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.131 INFO:tasks.workunit.client.0.smithi084.stdout: "buckets": 32, 2024-03-30T12:21:59.131 INFO:tasks.workunit.client.0.smithi084.stdout: "min": 0, 2024-03-30T12:21:59.131 INFO:tasks.workunit.client.0.smithi084.stdout: "name": "Request size (bytes)", 2024-03-30T12:21:59.131 INFO:tasks.workunit.client.0.smithi084.stdout: "quant_size": 512, 2024-03-30T12:21:59.131 INFO:tasks.workunit.client.0.smithi084.stdout: "ranges": [ 2024-03-30T12:21:59.131 INFO:tasks.workunit.client.0.smithi084.stdout: "[None, -1]", 2024-03-30T12:21:59.131 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 511]", 2024-03-30T12:21:59.131 INFO:tasks.workunit.client.0.smithi084.stdout: "[512, 1023]", 2024-03-30T12:21:59.131 INFO:tasks.workunit.client.0.smithi084.stdout: "[1024, 2047]", 2024-03-30T12:21:59.131 INFO:tasks.workunit.client.0.smithi084.stdout: "[2048, 4095]", 2024-03-30T12:21:59.131 INFO:tasks.workunit.client.0.smithi084.stdout: "[4096, 8191]", 2024-03-30T12:21:59.131 INFO:tasks.workunit.client.0.smithi084.stdout: "[8192, 16383]", 2024-03-30T12:21:59.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[16384, 32767]", 2024-03-30T12:21:59.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[32768, 65535]", 2024-03-30T12:21:59.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[65536, 131071]", 2024-03-30T12:21:59.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[131072, 262143]", 2024-03-30T12:21:59.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[262144, 524287]", 2024-03-30T12:21:59.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[524288, 1048575]", 2024-03-30T12:21:59.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[1048576, 2097151]", 2024-03-30T12:21:59.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[2097152, 4194303]", 2024-03-30T12:21:59.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[4194304, 8388607]", 2024-03-30T12:21:59.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[8388608, 16777215]", 2024-03-30T12:21:59.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[16777216, 33554431]", 2024-03-30T12:21:59.132 INFO:tasks.workunit.client.0.smithi084.stdout: "[33554432, 67108863]", 2024-03-30T12:21:59.133 INFO:tasks.workunit.client.0.smithi084.stdout: "[67108864, 134217727]", 2024-03-30T12:21:59.133 INFO:tasks.workunit.client.0.smithi084.stdout: "[134217728, 268435455]", 2024-03-30T12:21:59.133 INFO:tasks.workunit.client.0.smithi084.stdout: "[268435456, 536870911]", 2024-03-30T12:21:59.133 INFO:tasks.workunit.client.0.smithi084.stdout: "[536870912, 1073741823]", 2024-03-30T12:21:59.133 INFO:tasks.workunit.client.0.smithi084.stdout: "[1073741824, 2147483647]", 2024-03-30T12:21:59.133 INFO:tasks.workunit.client.0.smithi084.stdout: "[2147483648, 4294967295]", 2024-03-30T12:21:59.133 INFO:tasks.workunit.client.0.smithi084.stdout: "[4294967296, 8589934591]", 2024-03-30T12:21:59.133 INFO:tasks.workunit.client.0.smithi084.stdout: "[8589934592, 17179869183]", 2024-03-30T12:21:59.133 INFO:tasks.workunit.client.0.smithi084.stdout: "[17179869184, 34359738367]", 2024-03-30T12:21:59.133 INFO:tasks.workunit.client.0.smithi084.stdout: "[34359738368, 68719476735]", 2024-03-30T12:21:59.133 INFO:tasks.workunit.client.0.smithi084.stdout: "[68719476736, 137438953471]", 2024-03-30T12:21:59.133 INFO:tasks.workunit.client.0.smithi084.stdout: "[137438953472, 274877906943]", 2024-03-30T12:21:59.133 INFO:tasks.workunit.client.0.smithi084.stdout: "[274877906944, None]" 2024-03-30T12:21:59.134 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.134 INFO:tasks.workunit.client.0.smithi084.stdout: "scale_type": "log2" 2024-03-30T12:21:59.134 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.134 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.134 INFO:tasks.workunit.client.0.smithi084.stdout: "osds": [ 2024-03-30T12:21:59.134 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.134 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 0, 2024-03-30T12:21:59.134 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.134 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.134 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.134 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.134 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.134 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 2, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.135 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.136 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.136 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.136 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.136 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.136 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.136 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.136 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.136 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.136 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.136 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.136 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.136 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.136 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.137 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.137 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.137 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.137 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.137 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.137 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 1, 2024-03-30T12:21:59.137 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.137 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.137 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.137 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.137 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.137 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.137 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 6, 4, 0, 0, 0, 0, 0, 0, 9, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.138 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 15, 3, 0, 0, 0, 0, 0, 0, 17, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.138 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 18, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.138 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 9, 1, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.138 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.138 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.138 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.138 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.138 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.138 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.138 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.138 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.138 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.139 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.140 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.140 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.140 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.140 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.140 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 2, 2024-03-30T12:21:59.140 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.140 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.140 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.140 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.140 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.140 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.140 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.140 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.141 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.142 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.143 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.143 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.143 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.143 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.143 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.143 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 3, 2024-03-30T12:21:59.143 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.143 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.143 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.143 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.143 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.143 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.143 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.144 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.145 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.145 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.145 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.145 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.145 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.145 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.145 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.145 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.145 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.145 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.145 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.145 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.145 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.146 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.146 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.146 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.146 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 4, 2024-03-30T12:21:59.146 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.146 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.146 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.146 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.146 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.146 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.146 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.147 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.148 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.148 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.148 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.148 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.148 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.148 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.148 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.148 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.148 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.148 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.148 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.148 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.149 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.149 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.149 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.149 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.149 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 5, 2024-03-30T12:21:59.149 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.149 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.149 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.149 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.149 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.149 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.149 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.149 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.150 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.150 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.150 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.150 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.150 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.150 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.150 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.150 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.150 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.150 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.150 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.151 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.152 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.152 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.152 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.152 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.152 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 6, 2024-03-30T12:21:59.152 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.152 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.152 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.152 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.152 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.152 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.152 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.152 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.153 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.153 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 2, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.153 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.153 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.153 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.153 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.153 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.153 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.153 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.153 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.153 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.153 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.154 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.155 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.155 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.155 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.155 INFO:tasks.workunit.client.0.smithi084.stdout: "osd_id": 7, 2024-03-30T12:21:59.155 INFO:tasks.workunit.client.0.smithi084.stdout: "values": [ 2024-03-30T12:21:59.155 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.155 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.155 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.155 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.155 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.155 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.155 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.156 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.157 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.157 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.157 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.157 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.157 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.157 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.157 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.157 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.157 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.157 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.157 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]", 2024-03-30T12:21:59.157 INFO:tasks.workunit.client.0.smithi084.stdout: "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]" 2024-03-30T12:21:59.158 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.158 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.158 INFO:tasks.workunit.client.0.smithi084.stdout: ] 2024-03-30T12:21:59.158 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.158 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.158 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.158 INFO:tasks.workunit.client.0.smithi084.stdout: "perf_counters": { 2024-03-30T12:21:59.158 INFO:tasks.workunit.client.0.smithi084.stdout: "mds.f0f02ef515f7a6934fcbe198c4bdfa6882a76018": { 2024-03-30T12:21:59.158 INFO:tasks.workunit.client.0.smithi084.stdout: "mds": { 2024-03-30T12:21:59.158 INFO:tasks.workunit.client.0.smithi084.stdout: "caps": { 2024-03-30T12:21:59.158 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.158 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.159 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_cap_op_flush_ack": { 2024-03-30T12:21:59.159 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.159 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.159 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_cap_op_flushsnap_ack": { 2024-03-30T12:21:59.159 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.159 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.159 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_cap_op_grant": { 2024-03-30T12:21:59.159 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.159 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.159 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_cap_op_revoke": { 2024-03-30T12:21:59.159 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.159 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.160 INFO:tasks.workunit.client.0.smithi084.stdout: "ceph_cap_op_trunc": { 2024-03-30T12:21:59.160 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.160 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.160 INFO:tasks.workunit.client.0.smithi084.stdout: "dir_commit": { 2024-03-30T12:21:59.160 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12 2024-03-30T12:21:59.160 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.160 INFO:tasks.workunit.client.0.smithi084.stdout: "dir_fetch_complete": { 2024-03-30T12:21:59.160 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.160 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.160 INFO:tasks.workunit.client.0.smithi084.stdout: "dir_fetch_keys": { 2024-03-30T12:21:59.160 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.160 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.161 INFO:tasks.workunit.client.0.smithi084.stdout: "dir_merge": { 2024-03-30T12:21:59.161 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.161 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.161 INFO:tasks.workunit.client.0.smithi084.stdout: "dir_split": { 2024-03-30T12:21:59.161 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.161 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.161 INFO:tasks.workunit.client.0.smithi084.stdout: "exported_inodes": { 2024-03-30T12:21:59.161 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.161 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.161 INFO:tasks.workunit.client.0.smithi084.stdout: "forward": { 2024-03-30T12:21:59.161 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.161 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.162 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_client_cap_release": { 2024-03-30T12:21:59.162 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.162 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.162 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_client_caps": { 2024-03-30T12:21:59.162 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.162 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.162 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_client_caps_dirty": { 2024-03-30T12:21:59.162 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.162 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.162 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_inode_file_caps": { 2024-03-30T12:21:59.162 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.162 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.162 INFO:tasks.workunit.client.0.smithi084.stdout: "imported_inodes": { 2024-03-30T12:21:59.163 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.163 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.163 INFO:tasks.workunit.client.0.smithi084.stdout: "inodes": { 2024-03-30T12:21:59.163 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-03-30T12:21:59.163 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.163 INFO:tasks.workunit.client.0.smithi084.stdout: "inodes_expired": { 2024-03-30T12:21:59.163 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.163 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.163 INFO:tasks.workunit.client.0.smithi084.stdout: "inodes_pinned": { 2024-03-30T12:21:59.163 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-03-30T12:21:59.163 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.163 INFO:tasks.workunit.client.0.smithi084.stdout: "inodes_with_caps": { 2024-03-30T12:21:59.164 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.164 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.164 INFO:tasks.workunit.client.0.smithi084.stdout: "load_cent": { 2024-03-30T12:21:59.164 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.164 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.164 INFO:tasks.workunit.client.0.smithi084.stdout: "openino_dir_fetch": { 2024-03-30T12:21:59.164 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.164 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.164 INFO:tasks.workunit.client.0.smithi084.stdout: "process_request_cap_release": { 2024-03-30T12:21:59.164 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.164 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.164 INFO:tasks.workunit.client.0.smithi084.stdout: "reply_latency": { 2024-03-30T12:21:59.164 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:59.165 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 205797 2024-03-30T12:21:59.165 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.165 INFO:tasks.workunit.client.0.smithi084.stdout: "request": { 2024-03-30T12:21:59.165 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:59.165 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.165 INFO:tasks.workunit.client.0.smithi084.stdout: "root_rbytes": { 2024-03-30T12:21:59.165 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.165 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.165 INFO:tasks.workunit.client.0.smithi084.stdout: "root_rfiles": { 2024-03-30T12:21:59.165 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.165 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.165 INFO:tasks.workunit.client.0.smithi084.stdout: "root_rsnaps": { 2024-03-30T12:21:59.165 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.166 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.166 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_reply": { 2024-03-30T12:21:59.166 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.166 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.166 INFO:tasks.workunit.client.0.smithi084.stdout: "subtrees": { 2024-03-30T12:21:59.166 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:59.166 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.166 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.166 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_cache": { 2024-03-30T12:21:59.166 INFO:tasks.workunit.client.0.smithi084.stdout: "ireq_enqueue_scrub": { 2024-03-30T12:21:59.166 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.166 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.167 INFO:tasks.workunit.client.0.smithi084.stdout: "ireq_exportdir": { 2024-03-30T12:21:59.167 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.167 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.167 INFO:tasks.workunit.client.0.smithi084.stdout: "ireq_flush": { 2024-03-30T12:21:59.167 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.167 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.167 INFO:tasks.workunit.client.0.smithi084.stdout: "ireq_fragmentdir": { 2024-03-30T12:21:59.167 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.167 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.167 INFO:tasks.workunit.client.0.smithi084.stdout: "ireq_fragstats": { 2024-03-30T12:21:59.167 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.167 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.167 INFO:tasks.workunit.client.0.smithi084.stdout: "ireq_inodestats": { 2024-03-30T12:21:59.168 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.168 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_recovering_enqueued": { 2024-03-30T12:21:59.170 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.170 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_recovering_prioritized": { 2024-03-30T12:21:59.170 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.170 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_recovering_processing": { 2024-03-30T12:21:59.170 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.170 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.170 INFO:tasks.workunit.client.0.smithi084.stdout: "num_strays": { 2024-03-30T12:21:59.171 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.171 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.171 INFO:tasks.workunit.client.0.smithi084.stdout: "num_strays_delayed": { 2024-03-30T12:21:59.171 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.171 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.171 INFO:tasks.workunit.client.0.smithi084.stdout: "num_strays_enqueuing": { 2024-03-30T12:21:59.171 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.171 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.171 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_completed": { 2024-03-30T12:21:59.171 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.171 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.171 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_started": { 2024-03-30T12:21:59.171 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.172 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.172 INFO:tasks.workunit.client.0.smithi084.stdout: "strays_created": { 2024-03-30T12:21:59.172 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.172 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.172 INFO:tasks.workunit.client.0.smithi084.stdout: "strays_enqueued": { 2024-03-30T12:21:59.172 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.172 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.172 INFO:tasks.workunit.client.0.smithi084.stdout: "strays_migrated": { 2024-03-30T12:21:59.172 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.172 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.172 INFO:tasks.workunit.client.0.smithi084.stdout: "strays_reintegrated": { 2024-03-30T12:21:59.172 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.172 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.173 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.173 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_log": { 2024-03-30T12:21:59.173 INFO:tasks.workunit.client.0.smithi084.stdout: "ev": { 2024-03-30T12:21:59.173 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5 2024-03-30T12:21:59.173 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.173 INFO:tasks.workunit.client.0.smithi084.stdout: "evadd": { 2024-03-30T12:21:59.173 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5 2024-03-30T12:21:59.173 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.173 INFO:tasks.workunit.client.0.smithi084.stdout: "evex": { 2024-03-30T12:21:59.173 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.173 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.173 INFO:tasks.workunit.client.0.smithi084.stdout: "evexd": { 2024-03-30T12:21:59.173 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.173 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.174 INFO:tasks.workunit.client.0.smithi084.stdout: "evexg": { 2024-03-30T12:21:59.174 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.174 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.174 INFO:tasks.workunit.client.0.smithi084.stdout: "evtrm": { 2024-03-30T12:21:59.174 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.174 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.174 INFO:tasks.workunit.client.0.smithi084.stdout: "jlat": { 2024-03-30T12:21:59.174 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-03-30T12:21:59.174 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13393843 2024-03-30T12:21:59.174 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.174 INFO:tasks.workunit.client.0.smithi084.stdout: "replayed": { 2024-03-30T12:21:59.174 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.175 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.175 INFO:tasks.workunit.client.0.smithi084.stdout: "seg": { 2024-03-30T12:21:59.175 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-03-30T12:21:59.175 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.175 INFO:tasks.workunit.client.0.smithi084.stdout: "segadd": { 2024-03-30T12:21:59.175 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-03-30T12:21:59.175 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.175 INFO:tasks.workunit.client.0.smithi084.stdout: "segex": { 2024-03-30T12:21:59.175 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.175 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.175 INFO:tasks.workunit.client.0.smithi084.stdout: "segexd": { 2024-03-30T12:21:59.175 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.175 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.175 INFO:tasks.workunit.client.0.smithi084.stdout: "segexg": { 2024-03-30T12:21:59.176 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.176 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.176 INFO:tasks.workunit.client.0.smithi084.stdout: "segtrm": { 2024-03-30T12:21:59.176 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.176 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.176 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.176 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_mem": { 2024-03-30T12:21:59.176 INFO:tasks.workunit.client.0.smithi084.stdout: "cap": { 2024-03-30T12:21:59.176 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.176 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.176 INFO:tasks.workunit.client.0.smithi084.stdout: "cap+": { 2024-03-30T12:21:59.176 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:59.176 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.177 INFO:tasks.workunit.client.0.smithi084.stdout: "cap-": { 2024-03-30T12:21:59.177 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:59.177 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.177 INFO:tasks.workunit.client.0.smithi084.stdout: "dir": { 2024-03-30T12:21:59.177 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12 2024-03-30T12:21:59.177 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.177 INFO:tasks.workunit.client.0.smithi084.stdout: "dir+": { 2024-03-30T12:21:59.177 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12 2024-03-30T12:21:59.177 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.177 INFO:tasks.workunit.client.0.smithi084.stdout: "dir-": { 2024-03-30T12:21:59.177 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.177 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.177 INFO:tasks.workunit.client.0.smithi084.stdout: "dn": { 2024-03-30T12:21:59.177 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-03-30T12:21:59.178 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.178 INFO:tasks.workunit.client.0.smithi084.stdout: "dn+": { 2024-03-30T12:21:59.178 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-03-30T12:21:59.178 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.178 INFO:tasks.workunit.client.0.smithi084.stdout: "dn-": { 2024-03-30T12:21:59.178 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.178 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.178 INFO:tasks.workunit.client.0.smithi084.stdout: "heap": { 2024-03-30T12:21:59.178 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 207156 2024-03-30T12:21:59.178 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.178 INFO:tasks.workunit.client.0.smithi084.stdout: "ino": { 2024-03-30T12:21:59.178 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-03-30T12:21:59.179 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.179 INFO:tasks.workunit.client.0.smithi084.stdout: "ino+": { 2024-03-30T12:21:59.179 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-03-30T12:21:59.179 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.179 INFO:tasks.workunit.client.0.smithi084.stdout: "ino-": { 2024-03-30T12:21:59.179 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.179 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.179 INFO:tasks.workunit.client.0.smithi084.stdout: "rss": { 2024-03-30T12:21:59.179 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 41676 2024-03-30T12:21:59.179 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.179 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.179 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_server": { 2024-03-30T12:21:59.180 INFO:tasks.workunit.client.0.smithi084.stdout: "cap_acquisition_throttle": { 2024-03-30T12:21:59.180 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.180 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.180 INFO:tasks.workunit.client.0.smithi084.stdout: "cap_revoke_eviction": { 2024-03-30T12:21:59.180 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.180 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.180 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_client_request": { 2024-03-30T12:21:59.180 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:59.180 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.180 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_client_session": { 2024-03-30T12:21:59.180 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 16 2024-03-30T12:21:59.180 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.180 INFO:tasks.workunit.client.0.smithi084.stdout: "handle_peer_request": { 2024-03-30T12:21:59.181 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.181 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.181 INFO:tasks.workunit.client.0.smithi084.stdout: "req_create_latency": { 2024-03-30T12:21:59.181 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.181 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.181 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.181 INFO:tasks.workunit.client.0.smithi084.stdout: "req_getattr_latency": { 2024-03-30T12:21:59.181 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:59.181 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 205797 2024-03-30T12:21:59.181 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.181 INFO:tasks.workunit.client.0.smithi084.stdout: "req_getfilelock_latency": { 2024-03-30T12:21:59.181 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.182 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.182 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.182 INFO:tasks.workunit.client.0.smithi084.stdout: "req_getvxattr_latency": { 2024-03-30T12:21:59.182 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.182 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.182 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.182 INFO:tasks.workunit.client.0.smithi084.stdout: "req_link_latency": { 2024-03-30T12:21:59.182 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.182 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.182 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.182 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lookup_latency": { 2024-03-30T12:21:59.182 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.182 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.183 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.183 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lookuphash_latency": { 2024-03-30T12:21:59.183 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.183 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.183 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.183 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lookupino_latency": { 2024-03-30T12:21:59.183 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.183 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.183 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.183 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lookupname_latency": { 2024-03-30T12:21:59.183 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.183 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.183 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.184 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lookupparent_latency": { 2024-03-30T12:21:59.184 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.184 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.184 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.184 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lookupsnap_latency": { 2024-03-30T12:21:59.184 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.184 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.184 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.184 INFO:tasks.workunit.client.0.smithi084.stdout: "req_lssnap_latency": { 2024-03-30T12:21:59.184 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.184 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.184 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.184 INFO:tasks.workunit.client.0.smithi084.stdout: "req_mkdir_latency": { 2024-03-30T12:21:59.185 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.185 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.185 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.185 INFO:tasks.workunit.client.0.smithi084.stdout: "req_mknod_latency": { 2024-03-30T12:21:59.185 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.185 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.185 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.185 INFO:tasks.workunit.client.0.smithi084.stdout: "req_mksnap_latency": { 2024-03-30T12:21:59.185 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.185 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.185 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.185 INFO:tasks.workunit.client.0.smithi084.stdout: "req_open_latency": { 2024-03-30T12:21:59.185 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.186 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.186 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.186 INFO:tasks.workunit.client.0.smithi084.stdout: "req_readdir_latency": { 2024-03-30T12:21:59.186 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.186 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.186 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.186 INFO:tasks.workunit.client.0.smithi084.stdout: "req_rename_latency": { 2024-03-30T12:21:59.186 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.186 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.186 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.186 INFO:tasks.workunit.client.0.smithi084.stdout: "req_renamesnap_latency": { 2024-03-30T12:21:59.186 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.187 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.187 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.187 INFO:tasks.workunit.client.0.smithi084.stdout: "req_rmdir_latency": { 2024-03-30T12:21:59.187 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.187 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.187 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.187 INFO:tasks.workunit.client.0.smithi084.stdout: "req_rmsnap_latency": { 2024-03-30T12:21:59.187 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.187 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.187 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.187 INFO:tasks.workunit.client.0.smithi084.stdout: "req_rmxattr_latency": { 2024-03-30T12:21:59.187 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.187 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.188 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.188 INFO:tasks.workunit.client.0.smithi084.stdout: "req_setattr_latency": { 2024-03-30T12:21:59.188 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.188 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.188 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.188 INFO:tasks.workunit.client.0.smithi084.stdout: "req_setdirlayout_latency": { 2024-03-30T12:21:59.188 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.188 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.188 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.188 INFO:tasks.workunit.client.0.smithi084.stdout: "req_setfilelock_latency": { 2024-03-30T12:21:59.188 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.188 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.188 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.188 INFO:tasks.workunit.client.0.smithi084.stdout: "req_setlayout_latency": { 2024-03-30T12:21:59.189 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.189 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.189 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.189 INFO:tasks.workunit.client.0.smithi084.stdout: "req_setxattr_latency": { 2024-03-30T12:21:59.189 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.189 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.189 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.189 INFO:tasks.workunit.client.0.smithi084.stdout: "req_snapdiff_latency": { 2024-03-30T12:21:59.189 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.189 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.189 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.189 INFO:tasks.workunit.client.0.smithi084.stdout: "req_symlink_latency": { 2024-03-30T12:21:59.190 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.190 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.190 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.190 INFO:tasks.workunit.client.0.smithi084.stdout: "req_unlink_latency": { 2024-03-30T12:21:59.190 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.190 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.190 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.190 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.190 INFO:tasks.workunit.client.0.smithi084.stdout: "mds_sessions": { 2024-03-30T12:21:59.190 INFO:tasks.workunit.client.0.smithi084.stdout: "average_load": { 2024-03-30T12:21:59.190 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-03-30T12:21:59.190 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.191 INFO:tasks.workunit.client.0.smithi084.stdout: "avg_session_uptime": { 2024-03-30T12:21:59.191 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85 2024-03-30T12:21:59.191 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.191 INFO:tasks.workunit.client.0.smithi084.stdout: "mdthresh_evicted": { 2024-03-30T12:21:59.191 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.191 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.191 INFO:tasks.workunit.client.0.smithi084.stdout: "session_add": { 2024-03-30T12:21:59.191 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:59.191 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.191 INFO:tasks.workunit.client.0.smithi084.stdout: "session_count": { 2024-03-30T12:21:59.191 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.191 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.191 INFO:tasks.workunit.client.0.smithi084.stdout: "session_remove": { 2024-03-30T12:21:59.192 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:59.192 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.192 INFO:tasks.workunit.client.0.smithi084.stdout: "sessions_open": { 2024-03-30T12:21:59.192 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.192 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.192 INFO:tasks.workunit.client.0.smithi084.stdout: "sessions_stale": { 2024-03-30T12:21:59.192 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.192 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.192 INFO:tasks.workunit.client.0.smithi084.stdout: "total_load": { 2024-03-30T12:21:59.192 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:59.192 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.192 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.192 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-03-30T12:21:59.193 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-03-30T12:21:59.193 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.193 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.193 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:59.193 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.193 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.193 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-03-30T12:21:59.193 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.193 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.193 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:59.193 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 45 2024-03-30T12:21:59.193 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.193 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.194 INFO:tasks.workunit.client.0.smithi084.stdout: "purge_queue": { 2024-03-30T12:21:59.194 INFO:tasks.workunit.client.0.smithi084.stdout: "pq_executed": { 2024-03-30T12:21:59.194 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.194 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.194 INFO:tasks.workunit.client.0.smithi084.stdout: "pq_executing": { 2024-03-30T12:21:59.194 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.194 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.194 INFO:tasks.workunit.client.0.smithi084.stdout: "pq_executing_high_water": { 2024-03-30T12:21:59.194 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.194 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.194 INFO:tasks.workunit.client.0.smithi084.stdout: "pq_executing_ops": { 2024-03-30T12:21:59.194 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.195 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.195 INFO:tasks.workunit.client.0.smithi084.stdout: "pq_executing_ops_high_water": { 2024-03-30T12:21:59.195 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.195 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.195 INFO:tasks.workunit.client.0.smithi084.stdout: "pq_item_in_journal": { 2024-03-30T12:21:59.195 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.195 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.195 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.195 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.195 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.611cf02078e8bf5a0a364299eaa3b024f2655c78": { 2024-03-30T12:21:59.195 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-03-30T12:21:59.195 INFO:tasks.workunit.client.0.smithi084.stdout: "election_call": { 2024-03-30T12:21:59.195 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:59.196 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.196 INFO:tasks.workunit.client.0.smithi084.stdout: "election_lose": { 2024-03-30T12:21:59.196 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.196 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.196 INFO:tasks.workunit.client.0.smithi084.stdout: "election_win": { 2024-03-30T12:21:59.196 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-03-30T12:21:59.196 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_elections": { 2024-03-30T12:21:59.196 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 9 2024-03-30T12:21:59.196 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.196 INFO:tasks.workunit.client.0.smithi084.stdout: "num_sessions": { 2024-03-30T12:21:59.196 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7 2024-03-30T12:21:59.196 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.197 INFO:tasks.workunit.client.0.smithi084.stdout: "session_add": { 2024-03-30T12:21:59.197 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-03-30T12:21:59.197 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.197 INFO:tasks.workunit.client.0.smithi084.stdout: "session_rm": { 2024-03-30T12:21:59.197 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 216 2024-03-30T12:21:59.197 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.197 INFO:tasks.workunit.client.0.smithi084.stdout: "session_trim": { 2024-03-30T12:21:59.197 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.197 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.197 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.197 INFO:tasks.workunit.client.0.smithi084.stdout: "paxos": { 2024-03-30T12:21:59.197 INFO:tasks.workunit.client.0.smithi084.stdout: "accept_timeout": { 2024-03-30T12:21:59.197 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.198 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.198 INFO:tasks.workunit.client.0.smithi084.stdout: "begin": { 2024-03-30T12:21:59.198 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1009 2024-03-30T12:21:59.198 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.198 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_bytes": { 2024-03-30T12:21:59.198 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1009, 2024-03-30T12:21:59.198 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4992669 2024-03-30T12:21:59.198 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.198 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_keys": { 2024-03-30T12:21:59.198 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1009, 2024-03-30T12:21:59.198 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3027 2024-03-30T12:21:59.199 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.199 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_latency": { 2024-03-30T12:21:59.199 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1009, 2024-03-30T12:21:59.199 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 232995739 2024-03-30T12:21:59.199 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.199 INFO:tasks.workunit.client.0.smithi084.stdout: "collect": { 2024-03-30T12:21:59.199 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.199 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.199 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_bytes": { 2024-03-30T12:21:59.199 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.199 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.199 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.199 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_keys": { 2024-03-30T12:21:59.200 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.200 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.200 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.200 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_latency": { 2024-03-30T12:21:59.200 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.200 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.200 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.200 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_timeout": { 2024-03-30T12:21:59.200 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.200 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.200 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_uncommitted": { 2024-03-30T12:21:59.200 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.200 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.200 INFO:tasks.workunit.client.0.smithi084.stdout: "commit": { 2024-03-30T12:21:59.201 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1009 2024-03-30T12:21:59.201 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.201 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_bytes": { 2024-03-30T12:21:59.201 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1009, 2024-03-30T12:21:59.201 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4920026 2024-03-30T12:21:59.201 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.201 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_keys": { 2024-03-30T12:21:59.201 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1009, 2024-03-30T12:21:59.201 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6179 2024-03-30T12:21:59.201 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.201 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_latency": { 2024-03-30T12:21:59.201 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1009, 2024-03-30T12:21:59.201 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 443877358 2024-03-30T12:21:59.201 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.202 INFO:tasks.workunit.client.0.smithi084.stdout: "lease_ack_timeout": { 2024-03-30T12:21:59.202 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.202 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.202 INFO:tasks.workunit.client.0.smithi084.stdout: "lease_timeout": { 2024-03-30T12:21:59.202 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.202 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.202 INFO:tasks.workunit.client.0.smithi084.stdout: "new_pn": { 2024-03-30T12:21:59.202 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:59.202 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.202 INFO:tasks.workunit.client.0.smithi084.stdout: "new_pn_latency": { 2024-03-30T12:21:59.202 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:59.202 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 999981 2024-03-30T12:21:59.203 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.203 INFO:tasks.workunit.client.0.smithi084.stdout: "refresh": { 2024-03-30T12:21:59.203 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1011 2024-03-30T12:21:59.203 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.203 INFO:tasks.workunit.client.0.smithi084.stdout: "refresh_latency": { 2024-03-30T12:21:59.203 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1011, 2024-03-30T12:21:59.203 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2575952849 2024-03-30T12:21:59.203 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.203 INFO:tasks.workunit.client.0.smithi084.stdout: "restart": { 2024-03-30T12:21:59.203 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12 2024-03-30T12:21:59.203 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.203 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state": { 2024-03-30T12:21:59.203 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-03-30T12:21:59.204 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.204 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state_bytes": { 2024-03-30T12:21:59.204 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-03-30T12:21:59.204 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2103 2024-03-30T12:21:59.204 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.204 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state_keys": { 2024-03-30T12:21:59.204 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-03-30T12:21:59.204 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4 2024-03-30T12:21:59.204 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.204 INFO:tasks.workunit.client.0.smithi084.stdout: "start_leader": { 2024-03-30T12:21:59.204 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-03-30T12:21:59.204 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.204 INFO:tasks.workunit.client.0.smithi084.stdout: "start_peon": { 2024-03-30T12:21:59.204 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.205 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.205 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state": { 2024-03-30T12:21:59.205 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.205 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.205 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_bytes": { 2024-03-30T12:21:59.205 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.205 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.205 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.205 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_keys": { 2024-03-30T12:21:59.205 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.205 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.205 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.205 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_latency": { 2024-03-30T12:21:59.205 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.206 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.206 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.206 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.206 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache": { 2024-03-30T12:21:59.206 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-03-30T12:21:59.206 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1020054731 2024-03-30T12:21:59.206 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.206 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-03-30T12:21:59.206 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 47947776 2024-03-30T12:21:59.206 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.206 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-03-30T12:21:59.206 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 40132608 2024-03-30T12:21:59.207 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.207 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-03-30T12:21:59.207 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2147483648 2024-03-30T12:21:59.207 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.207 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-03-30T12:21:59.207 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7815168 2024-03-30T12:21:59.207 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.207 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.207 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:full": { 2024-03-30T12:21:59.207 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.207 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 348127232 2024-03-30T12:21:59.207 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.208 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.208 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.208 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.208 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.208 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.208 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.208 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.208 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277025246 2024-03-30T12:21:59.208 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.208 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.208 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 263676 2024-03-30T12:21:59.208 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.208 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.208 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.209 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.209 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.209 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.209 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.209 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.209 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.209 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.209 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.209 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.209 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.209 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.209 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.209 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.210 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.210 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.210 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.210 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.210 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.210 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.210 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.210 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.210 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.210 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.210 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 70838310 2024-03-30T12:21:59.210 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.211 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.211 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:inc": { 2024-03-30T12:21:59.211 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.211 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 348127232 2024-03-30T12:21:59.211 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.211 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.211 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.211 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.211 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.211 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.211 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.211 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.211 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277025246 2024-03-30T12:21:59.212 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.212 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.212 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 38697 2024-03-30T12:21:59.212 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.212 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.212 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.212 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.212 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.212 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.212 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.212 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.212 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.213 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.213 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.213 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.213 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.213 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.213 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.213 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.213 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.213 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.213 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.213 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.213 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.213 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.214 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.214 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.214 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.214 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.214 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71063289 2024-03-30T12:21:59.214 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.214 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.214 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:kv": { 2024-03-30T12:21:59.214 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.214 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 322961408 2024-03-30T12:21:59.214 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.214 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.214 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:59.215 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.215 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.215 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.215 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.215 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.215 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 184683497 2024-03-30T12:21:59.215 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.215 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.215 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.215 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.215 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.215 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.215 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.215 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.216 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.216 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.216 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.216 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.216 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.216 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.216 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.216 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.216 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.216 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.216 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.216 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.216 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.216 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.217 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.217 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.217 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.217 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.217 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.217 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.217 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.217 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71169047 2024-03-30T12:21:59.218 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.218 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.218 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb": { 2024-03-30T12:21:59.218 INFO:tasks.workunit.client.0.smithi084.stdout: "compact": { 2024-03-30T12:21:59.218 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.218 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.218 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_queue_len": { 2024-03-30T12:21:59.218 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.218 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.218 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_queue_merge": { 2024-03-30T12:21:59.218 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.218 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.219 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_range": { 2024-03-30T12:21:59.219 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:59.219 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.219 INFO:tasks.workunit.client.0.smithi084.stdout: "get_latency": { 2024-03-30T12:21:59.219 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 44898, 2024-03-30T12:21:59.219 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 184015215 2024-03-30T12:21:59.219 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.219 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_delay_time": { 2024-03-30T12:21:59.219 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.219 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.219 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.219 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_memtable_time": { 2024-03-30T12:21:59.220 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.220 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.220 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.220 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_pre_and_post_time": { 2024-03-30T12:21:59.220 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.220 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.220 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.220 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_wal_time": { 2024-03-30T12:21:59.220 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.220 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.220 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.220 INFO:tasks.workunit.client.0.smithi084.stdout: "submit_latency": { 2024-03-30T12:21:59.220 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.220 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.221 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.221 INFO:tasks.workunit.client.0.smithi084.stdout: "submit_sync_latency": { 2024-03-30T12:21:59.221 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2177, 2024-03-30T12:21:59.221 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 768498444 2024-03-30T12:21:59.221 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.221 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.221 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.221 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.ba4e0ee80ca1c9071285ab58ebc3a0451ad8d905": { 2024-03-30T12:21:59.221 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-03-30T12:21:59.221 INFO:tasks.workunit.client.0.smithi084.stdout: "election_call": { 2024-03-30T12:21:59.221 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-03-30T12:21:59.221 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.222 INFO:tasks.workunit.client.0.smithi084.stdout: "election_lose": { 2024-03-30T12:21:59.222 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-03-30T12:21:59.222 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.222 INFO:tasks.workunit.client.0.smithi084.stdout: "election_win": { 2024-03-30T12:21:59.222 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.222 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_elections": { 2024-03-30T12:21:59.222 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3 2024-03-30T12:21:59.222 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_sessions": { 2024-03-30T12:21:59.222 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 11 2024-03-30T12:21:59.222 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.223 INFO:tasks.workunit.client.0.smithi084.stdout: "session_add": { 2024-03-30T12:21:59.223 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5 2024-03-30T12:21:59.223 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.223 INFO:tasks.workunit.client.0.smithi084.stdout: "session_rm": { 2024-03-30T12:21:59.223 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 103 2024-03-30T12:21:59.223 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.223 INFO:tasks.workunit.client.0.smithi084.stdout: "session_trim": { 2024-03-30T12:21:59.223 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.223 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.223 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.223 INFO:tasks.workunit.client.0.smithi084.stdout: "paxos": { 2024-03-30T12:21:59.223 INFO:tasks.workunit.client.0.smithi084.stdout: "accept_timeout": { 2024-03-30T12:21:59.224 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.224 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.224 INFO:tasks.workunit.client.0.smithi084.stdout: "begin": { 2024-03-30T12:21:59.224 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 858 2024-03-30T12:21:59.224 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.224 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_bytes": { 2024-03-30T12:21:59.224 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 858, 2024-03-30T12:21:59.224 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3915449 2024-03-30T12:21:59.224 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.224 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_keys": { 2024-03-30T12:21:59.224 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.224 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.224 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.225 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_latency": { 2024-03-30T12:21:59.225 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 858, 2024-03-30T12:21:59.225 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 247995473 2024-03-30T12:21:59.225 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.225 INFO:tasks.workunit.client.0.smithi084.stdout: "collect": { 2024-03-30T12:21:59.225 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-03-30T12:21:59.225 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.225 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_bytes": { 2024-03-30T12:21:59.225 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:59.225 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73 2024-03-30T12:21:59.225 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.225 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_keys": { 2024-03-30T12:21:59.225 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:59.226 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-03-30T12:21:59.226 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.226 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_latency": { 2024-03-30T12:21:59.226 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:59.226 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.226 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.226 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_timeout": { 2024-03-30T12:21:59.226 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.226 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.226 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_uncommitted": { 2024-03-30T12:21:59.226 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.227 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.227 INFO:tasks.workunit.client.0.smithi084.stdout: "commit": { 2024-03-30T12:21:59.227 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 860 2024-03-30T12:21:59.227 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.227 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_bytes": { 2024-03-30T12:21:59.227 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.227 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.227 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.227 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_keys": { 2024-03-30T12:21:59.227 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.227 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.227 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.227 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_latency": { 2024-03-30T12:21:59.228 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.228 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.228 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.228 INFO:tasks.workunit.client.0.smithi084.stdout: "lease_ack_timeout": { 2024-03-30T12:21:59.228 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.228 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.228 INFO:tasks.workunit.client.0.smithi084.stdout: "lease_timeout": { 2024-03-30T12:21:59.228 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.228 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.228 INFO:tasks.workunit.client.0.smithi084.stdout: "new_pn": { 2024-03-30T12:21:59.228 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.228 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.229 INFO:tasks.workunit.client.0.smithi084.stdout: "new_pn_latency": { 2024-03-30T12:21:59.229 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.229 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.229 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.229 INFO:tasks.workunit.client.0.smithi084.stdout: "refresh": { 2024-03-30T12:21:59.229 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 860 2024-03-30T12:21:59.229 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.229 INFO:tasks.workunit.client.0.smithi084.stdout: "refresh_latency": { 2024-03-30T12:21:59.229 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 860, 2024-03-30T12:21:59.229 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1999963426 2024-03-30T12:21:59.229 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.229 INFO:tasks.workunit.client.0.smithi084.stdout: "restart": { 2024-03-30T12:21:59.229 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8 2024-03-30T12:21:59.230 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.230 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state": { 2024-03-30T12:21:59.230 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.230 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.230 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state_bytes": { 2024-03-30T12:21:59.230 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.230 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.230 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.230 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state_keys": { 2024-03-30T12:21:59.230 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.230 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.230 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.231 INFO:tasks.workunit.client.0.smithi084.stdout: "start_leader": { 2024-03-30T12:21:59.231 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.231 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.231 INFO:tasks.workunit.client.0.smithi084.stdout: "start_peon": { 2024-03-30T12:21:59.231 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-03-30T12:21:59.231 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.231 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state": { 2024-03-30T12:21:59.231 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 859 2024-03-30T12:21:59.231 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.231 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_bytes": { 2024-03-30T12:21:59.231 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 859, 2024-03-30T12:21:59.231 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7669880 2024-03-30T12:21:59.232 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.232 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_keys": { 2024-03-30T12:21:59.232 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 859, 2024-03-30T12:21:59.232 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6196 2024-03-30T12:21:59.232 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.232 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_latency": { 2024-03-30T12:21:59.232 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 859, 2024-03-30T12:21:59.232 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 536990179 2024-03-30T12:21:59.232 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.232 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.232 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache": { 2024-03-30T12:21:59.232 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-03-30T12:21:59.232 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1020054731 2024-03-30T12:21:59.233 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.233 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-03-30T12:21:59.233 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 41746432 2024-03-30T12:21:59.233 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.233 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-03-30T12:21:59.233 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 34226176 2024-03-30T12:21:59.233 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.233 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-03-30T12:21:59.233 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2147483648 2024-03-30T12:21:59.233 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.233 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-03-30T12:21:59.233 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7520256 2024-03-30T12:21:59.233 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.234 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.234 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:full": { 2024-03-30T12:21:59.234 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.234 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 348127232 2024-03-30T12:21:59.234 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.234 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.234 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.234 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.234 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.234 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.234 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.234 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.235 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277024170 2024-03-30T12:21:59.235 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.235 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.235 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 264106 2024-03-30T12:21:59.235 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.235 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.235 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.235 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.235 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.235 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.235 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.235 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.235 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.236 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.236 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.236 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.236 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.236 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.236 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.236 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.236 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.236 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.236 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.236 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.236 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.236 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.237 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.237 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.237 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.237 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.237 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 70838956 2024-03-30T12:21:59.237 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.237 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.237 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:inc": { 2024-03-30T12:21:59.237 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.237 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 348127232 2024-03-30T12:21:59.237 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.237 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.237 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.238 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.238 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.238 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.238 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.238 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.238 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277024170 2024-03-30T12:21:59.238 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.238 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.238 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 41136 2024-03-30T12:21:59.238 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.238 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.238 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.239 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.239 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.239 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.239 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.239 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.239 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.239 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.239 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.239 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.239 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.239 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.239 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.239 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.240 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.240 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.240 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.240 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.240 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.240 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.240 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.240 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.240 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.240 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.240 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71061926 2024-03-30T12:21:59.240 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.241 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.241 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:kv": { 2024-03-30T12:21:59.241 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.241 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 322961408 2024-03-30T12:21:59.241 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.241 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.241 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:59.241 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.241 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.241 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.241 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.241 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.241 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 184682780 2024-03-30T12:21:59.241 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.242 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.242 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.242 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.242 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.242 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.242 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.242 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.242 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.242 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.242 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.242 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.242 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.242 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.243 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.243 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.243 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.243 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.243 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.243 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.243 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.243 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.243 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.243 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.243 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.243 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.243 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.244 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.244 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.244 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71169764 2024-03-30T12:21:59.244 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.244 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.244 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb": { 2024-03-30T12:21:59.244 INFO:tasks.workunit.client.0.smithi084.stdout: "compact": { 2024-03-30T12:21:59.244 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.244 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.244 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_queue_len": { 2024-03-30T12:21:59.244 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.244 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.244 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_queue_merge": { 2024-03-30T12:21:59.245 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.245 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.245 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_range": { 2024-03-30T12:21:59.245 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:59.245 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.245 INFO:tasks.workunit.client.0.smithi084.stdout: "get_latency": { 2024-03-30T12:21:59.245 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 36857, 2024-03-30T12:21:59.245 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 100805855 2024-03-30T12:21:59.245 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.245 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_delay_time": { 2024-03-30T12:21:59.245 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.245 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.245 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.245 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_memtable_time": { 2024-03-30T12:21:59.246 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.246 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.246 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.246 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_pre_and_post_time": { 2024-03-30T12:21:59.246 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.246 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.246 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.246 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_wal_time": { 2024-03-30T12:21:59.246 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.246 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.246 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.246 INFO:tasks.workunit.client.0.smithi084.stdout: "submit_latency": { 2024-03-30T12:21:59.246 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.247 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.247 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.247 INFO:tasks.workunit.client.0.smithi084.stdout: "submit_sync_latency": { 2024-03-30T12:21:59.247 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1834, 2024-03-30T12:21:59.247 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 838324012 2024-03-30T12:21:59.247 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.247 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.247 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.247 INFO:tasks.workunit.client.0.smithi084.stdout: "mon.f0f02ef515f7a6934fcbe198c4bdfa6882a76018": { 2024-03-30T12:21:59.247 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-03-30T12:21:59.247 INFO:tasks.workunit.client.0.smithi084.stdout: "election_call": { 2024-03-30T12:21:59.247 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:59.247 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.248 INFO:tasks.workunit.client.0.smithi084.stdout: "election_lose": { 2024-03-30T12:21:59.248 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:59.248 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.248 INFO:tasks.workunit.client.0.smithi084.stdout: "election_win": { 2024-03-30T12:21:59.248 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.248 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.248 INFO:tasks.workunit.client.0.smithi084.stdout: "num_elections": { 2024-03-30T12:21:59.248 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7 2024-03-30T12:21:59.248 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.248 INFO:tasks.workunit.client.0.smithi084.stdout: "num_sessions": { 2024-03-30T12:21:59.248 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 11 2024-03-30T12:21:59.248 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.248 INFO:tasks.workunit.client.0.smithi084.stdout: "session_add": { 2024-03-30T12:21:59.249 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4 2024-03-30T12:21:59.249 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.249 INFO:tasks.workunit.client.0.smithi084.stdout: "session_rm": { 2024-03-30T12:21:59.249 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 52 2024-03-30T12:21:59.249 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.249 INFO:tasks.workunit.client.0.smithi084.stdout: "session_trim": { 2024-03-30T12:21:59.249 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.249 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.249 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.249 INFO:tasks.workunit.client.0.smithi084.stdout: "paxos": { 2024-03-30T12:21:59.249 INFO:tasks.workunit.client.0.smithi084.stdout: "accept_timeout": { 2024-03-30T12:21:59.249 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.249 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.249 INFO:tasks.workunit.client.0.smithi084.stdout: "begin": { 2024-03-30T12:21:59.250 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 869 2024-03-30T12:21:59.250 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.250 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_bytes": { 2024-03-30T12:21:59.250 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 869, 2024-03-30T12:21:59.250 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3941418 2024-03-30T12:21:59.250 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.250 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_keys": { 2024-03-30T12:21:59.250 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.250 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.250 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.250 INFO:tasks.workunit.client.0.smithi084.stdout: "begin_latency": { 2024-03-30T12:21:59.250 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 869, 2024-03-30T12:21:59.251 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 148996995 2024-03-30T12:21:59.251 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.251 INFO:tasks.workunit.client.0.smithi084.stdout: "collect": { 2024-03-30T12:21:59.251 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:59.251 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.251 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_bytes": { 2024-03-30T12:21:59.251 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:59.251 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 146 2024-03-30T12:21:59.251 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.251 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_keys": { 2024-03-30T12:21:59.251 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:59.251 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:59.251 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.252 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_latency": { 2024-03-30T12:21:59.252 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:59.252 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 999980 2024-03-30T12:21:59.252 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.252 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_timeout": { 2024-03-30T12:21:59.252 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.252 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.252 INFO:tasks.workunit.client.0.smithi084.stdout: "collect_uncommitted": { 2024-03-30T12:21:59.252 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.252 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.252 INFO:tasks.workunit.client.0.smithi084.stdout: "commit": { 2024-03-30T12:21:59.252 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 870 2024-03-30T12:21:59.252 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.252 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_bytes": { 2024-03-30T12:21:59.253 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.253 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.253 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.253 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_keys": { 2024-03-30T12:21:59.253 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.253 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.253 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.253 INFO:tasks.workunit.client.0.smithi084.stdout: "commit_latency": { 2024-03-30T12:21:59.253 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.253 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.253 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.253 INFO:tasks.workunit.client.0.smithi084.stdout: "lease_ack_timeout": { 2024-03-30T12:21:59.254 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.254 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.254 INFO:tasks.workunit.client.0.smithi084.stdout: "lease_timeout": { 2024-03-30T12:21:59.254 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.254 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.254 INFO:tasks.workunit.client.0.smithi084.stdout: "new_pn": { 2024-03-30T12:21:59.254 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.254 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.254 INFO:tasks.workunit.client.0.smithi084.stdout: "new_pn_latency": { 2024-03-30T12:21:59.254 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.254 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.254 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.254 INFO:tasks.workunit.client.0.smithi084.stdout: "refresh": { 2024-03-30T12:21:59.255 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 870 2024-03-30T12:21:59.255 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.255 INFO:tasks.workunit.client.0.smithi084.stdout: "refresh_latency": { 2024-03-30T12:21:59.255 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 870, 2024-03-30T12:21:59.255 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1897961789 2024-03-30T12:21:59.255 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.255 INFO:tasks.workunit.client.0.smithi084.stdout: "restart": { 2024-03-30T12:21:59.255 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-03-30T12:21:59.255 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.255 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state": { 2024-03-30T12:21:59.255 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.255 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.255 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state_bytes": { 2024-03-30T12:21:59.256 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.256 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.256 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.256 INFO:tasks.workunit.client.0.smithi084.stdout: "share_state_keys": { 2024-03-30T12:21:59.256 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.256 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.256 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.256 INFO:tasks.workunit.client.0.smithi084.stdout: "start_leader": { 2024-03-30T12:21:59.256 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.256 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.256 INFO:tasks.workunit.client.0.smithi084.stdout: "start_peon": { 2024-03-30T12:21:59.256 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:59.257 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.257 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state": { 2024-03-30T12:21:59.257 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 870 2024-03-30T12:21:59.257 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.257 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_bytes": { 2024-03-30T12:21:59.257 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 870, 2024-03-30T12:21:59.257 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7720482 2024-03-30T12:21:59.257 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.257 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_keys": { 2024-03-30T12:21:59.257 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 870, 2024-03-30T12:21:59.257 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6284 2024-03-30T12:21:59.257 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.258 INFO:tasks.workunit.client.0.smithi084.stdout: "store_state_latency": { 2024-03-30T12:21:59.258 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 870, 2024-03-30T12:21:59.258 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 311993737 2024-03-30T12:21:59.258 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.258 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.258 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache": { 2024-03-30T12:21:59.258 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-03-30T12:21:59.258 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1020054731 2024-03-30T12:21:59.258 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.258 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-03-30T12:21:59.258 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 42795008 2024-03-30T12:21:59.258 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.258 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-03-30T12:21:59.259 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 29827072 2024-03-30T12:21:59.259 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.259 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-03-30T12:21:59.259 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2147483648 2024-03-30T12:21:59.259 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.259 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-03-30T12:21:59.259 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12967936 2024-03-30T12:21:59.259 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.259 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.259 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:full": { 2024-03-30T12:21:59.259 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.259 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 348127232 2024-03-30T12:21:59.260 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.260 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.260 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.260 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.260 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.260 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.260 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.260 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.260 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277024170 2024-03-30T12:21:59.260 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.260 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.260 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 264106 2024-03-30T12:21:59.260 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.261 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.261 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.261 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.261 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.261 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.261 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.261 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.261 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.261 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.261 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.261 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.261 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.261 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.262 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.262 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.262 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.262 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.262 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.262 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.262 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.262 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.262 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.262 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.262 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.262 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.263 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 70838956 2024-03-30T12:21:59.263 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.263 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.263 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:inc": { 2024-03-30T12:21:59.263 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.263 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 348127232 2024-03-30T12:21:59.263 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.263 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.263 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.263 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.263 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.263 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.263 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.264 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.264 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 277024170 2024-03-30T12:21:59.264 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.264 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.264 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 41136 2024-03-30T12:21:59.264 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.264 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.264 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.264 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.264 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.264 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.264 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.264 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.265 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.265 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.265 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.265 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.265 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.265 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.265 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.265 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.265 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.265 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.265 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.265 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.266 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.266 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.266 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.266 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.266 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.266 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.266 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71061926 2024-03-30T12:21:59.266 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.266 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.266 INFO:tasks.workunit.client.0.smithi084.stdout: "prioritycache:kv": { 2024-03-30T12:21:59.266 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.266 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 322961408 2024-03-30T12:21:59.267 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.267 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.267 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:59.267 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.267 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.267 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.267 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.267 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.267 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 184682780 2024-03-30T12:21:59.267 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.267 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.267 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.268 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.268 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.268 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.268 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.268 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.268 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.268 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.268 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.268 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.268 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.268 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.268 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.268 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.269 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.269 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.269 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.269 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.269 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.269 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.269 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.269 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.269 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.269 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.269 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.269 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.269 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.270 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71169764 2024-03-30T12:21:59.270 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.270 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.270 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb": { 2024-03-30T12:21:59.270 INFO:tasks.workunit.client.0.smithi084.stdout: "compact": { 2024-03-30T12:21:59.270 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.270 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.270 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_queue_len": { 2024-03-30T12:21:59.270 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.270 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.270 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_queue_merge": { 2024-03-30T12:21:59.270 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.271 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.271 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_range": { 2024-03-30T12:21:59.271 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:59.271 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.271 INFO:tasks.workunit.client.0.smithi084.stdout: "get_latency": { 2024-03-30T12:21:59.271 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 36922, 2024-03-30T12:21:59.271 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 98378119 2024-03-30T12:21:59.271 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.271 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_delay_time": { 2024-03-30T12:21:59.271 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.271 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.271 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.271 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_memtable_time": { 2024-03-30T12:21:59.272 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.272 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.272 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.272 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_pre_and_post_time": { 2024-03-30T12:21:59.272 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.272 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.272 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.272 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_write_wal_time": { 2024-03-30T12:21:59.272 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.272 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.272 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.272 INFO:tasks.workunit.client.0.smithi084.stdout: "submit_latency": { 2024-03-30T12:21:59.273 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.273 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.273 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.273 INFO:tasks.workunit.client.0.smithi084.stdout: "submit_sync_latency": { 2024-03-30T12:21:59.273 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1880, 2024-03-30T12:21:59.273 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 539615325 2024-03-30T12:21:59.273 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.273 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.273 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.273 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.0": { 2024-03-30T12:21:59.273 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:59.273 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-03-30T12:21:59.273 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.273 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.273 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-03-30T12:21:59.274 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.274 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.274 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-03-30T12:21:59.274 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-03-30T12:21:59.274 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.274 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-03-30T12:21:59.274 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.274 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.274 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-03-30T12:21:59.274 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.274 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.274 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-03-30T12:21:59.275 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.275 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.275 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-03-30T12:21:59.275 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12288 2024-03-30T12:21:59.275 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.275 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-03-30T12:21:59.275 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7340032 2024-03-30T12:21:59.275 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.275 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-03-30T12:21:59.275 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.275 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.275 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.276 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-03-30T12:21:59.276 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.276 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.276 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.276 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-03-30T12:21:59.276 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:59.276 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.276 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-03-30T12:21:59.276 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:59.276 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.276 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-03-30T12:21:59.276 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3612672 2024-03-30T12:21:59.277 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.277 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-03-30T12:21:59.277 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3473408 2024-03-30T12:21:59.277 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.277 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-03-30T12:21:59.277 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:59.277 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.277 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-03-30T12:21:59.277 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.277 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.277 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-03-30T12:21:59.277 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.277 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-03-30T12:21:59.278 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-03-30T12:21:59.278 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.278 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-03-30T12:21:59.278 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 206272 2024-03-30T12:21:59.278 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.278 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-03-30T12:21:59.278 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 23 2024-03-30T12:21:59.278 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.278 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-03-30T12:21:59.278 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1282048 2024-03-30T12:21:59.278 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.278 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-03-30T12:21:59.279 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1286144 2024-03-30T12:21:59.279 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.279 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-03-30T12:21:59.279 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.279 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.279 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-03-30T12:21:59.279 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.279 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.279 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-03-30T12:21:59.279 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15 2024-03-30T12:21:59.279 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.279 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-03-30T12:21:59.280 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4913 2024-03-30T12:21:59.280 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.280 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-03-30T12:21:59.280 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4 2024-03-30T12:21:59.280 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.280 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-03-30T12:21:59.280 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5505 2024-03-30T12:21:59.280 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.280 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-03-30T12:21:59.280 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:59.280 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.280 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-03-30T12:21:59.280 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5505 2024-03-30T12:21:59.281 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.281 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-03-30T12:21:59.281 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:59.281 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.281 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-03-30T12:21:59.281 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.281 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.281 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-03-30T12:21:59.281 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.281 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.281 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-03-30T12:21:59.281 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.282 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.282 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-03-30T12:21:59.282 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.282 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.282 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-03-30T12:21:59.282 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.282 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.282 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-03-30T12:21:59.282 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.282 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.282 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-03-30T12:21:59.282 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.283 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.283 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-03-30T12:21:59.283 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.283 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.283 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-03-30T12:21:59.283 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.283 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.283 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-03-30T12:21:59.283 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10891264 2024-03-30T12:21:59.283 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.283 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.283 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-03-30T12:21:59.283 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-03-30T12:21:59.284 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-03-30T12:21:59.284 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.284 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-03-30T12:21:59.284 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1306624 2024-03-30T12:21:59.284 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.284 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-03-30T12:21:59.284 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 4, 2024-03-30T12:21:59.284 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 266330 2024-03-30T12:21:59.284 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.284 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-03-30T12:21:59.284 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.285 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.285 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.285 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-03-30T12:21:59.285 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.285 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.285 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-03-30T12:21:59.285 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.285 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.285 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-03-30T12:21:59.285 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.285 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.285 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-03-30T12:21:59.286 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 24, 2024-03-30T12:21:59.286 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 91898 2024-03-30T12:21:59.286 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.286 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-03-30T12:21:59.286 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.286 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.286 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.286 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-03-30T12:21:59.286 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 835, 2024-03-30T12:21:59.286 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 505201859 2024-03-30T12:21:59.286 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.286 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-03-30T12:21:59.287 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 833, 2024-03-30T12:21:59.287 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 23530520 2024-03-30T12:21:59.287 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.287 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-03-30T12:21:59.287 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 835, 2024-03-30T12:21:59.287 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 771428 2024-03-30T12:21:59.287 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.287 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-03-30T12:21:59.287 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 835, 2024-03-30T12:21:59.287 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 505973287 2024-03-30T12:21:59.287 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.287 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-03-30T12:21:59.287 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.288 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.288 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.288 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-03-30T12:21:59.288 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:59.288 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 45295 2024-03-30T12:21:59.288 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.288 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-03-30T12:21:59.288 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 6, 2024-03-30T12:21:59.288 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 17740 2024-03-30T12:21:59.288 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.288 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-03-30T12:21:59.288 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.289 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.289 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.289 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-03-30T12:21:59.289 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.289 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.289 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.289 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-03-30T12:21:59.289 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:59.289 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4487 2024-03-30T12:21:59.289 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.289 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-03-30T12:21:59.289 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3956 2024-03-30T12:21:59.289 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.290 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-03-30T12:21:59.290 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 325 2024-03-30T12:21:59.290 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.290 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-03-30T12:21:59.290 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 112, 2024-03-30T12:21:59.290 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4025869 2024-03-30T12:21:59.290 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.290 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-03-30T12:21:59.290 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 311, 2024-03-30T12:21:59.290 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 312295 2024-03-30T12:21:59.290 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.290 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-03-30T12:21:59.291 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 199, 2024-03-30T12:21:59.291 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5651384 2024-03-30T12:21:59.291 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.291 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-03-30T12:21:59.291 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.291 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.291 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-03-30T12:21:59.291 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 102, 2024-03-30T12:21:59.291 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5501883 2024-03-30T12:21:59.291 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.291 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-03-30T12:21:59.291 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3599, 2024-03-30T12:21:59.292 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3972754439 2024-03-30T12:21:59.292 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.292 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-03-30T12:21:59.292 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 126, 2024-03-30T12:21:59.292 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24960483 2024-03-30T12:21:59.292 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.292 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-03-30T12:21:59.292 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 126, 2024-03-30T12:21:59.292 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 428223713217 2024-03-30T12:21:59.292 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.292 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-03-30T12:21:59.292 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 126, 2024-03-30T12:21:59.292 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 130719619881 2024-03-30T12:21:59.293 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.293 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-03-30T12:21:59.293 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3599, 2024-03-30T12:21:59.293 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68012930173 2024-03-30T12:21:59.293 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.293 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-03-30T12:21:59.293 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3599, 2024-03-30T12:21:59.293 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 225446 2024-03-30T12:21:59.293 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.293 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-03-30T12:21:59.293 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3599, 2024-03-30T12:21:59.293 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3698458 2024-03-30T12:21:59.293 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.294 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-03-30T12:21:59.294 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3599, 2024-03-30T12:21:59.294 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2568815520 2024-03-30T12:21:59.294 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.294 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-03-30T12:21:59.294 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3599, 2024-03-30T12:21:59.294 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 531745 2024-03-30T12:21:59.294 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.294 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-03-30T12:21:59.294 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3599, 2024-03-30T12:21:59.294 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1352631181 2024-03-30T12:21:59.295 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.295 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-03-30T12:21:59.295 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3599, 2024-03-30T12:21:59.295 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 380758614 2024-03-30T12:21:59.295 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.295 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-03-30T12:21:59.295 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 893480 2024-03-30T12:21:59.295 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.295 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-03-30T12:21:59.295 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 60, 2024-03-30T12:21:59.295 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 278192 2024-03-30T12:21:59.295 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.295 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-03-30T12:21:59.296 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3599, 2024-03-30T12:21:59.296 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8278916572 2024-03-30T12:21:59.296 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.296 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-03-30T12:21:59.296 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3599, 2024-03-30T12:21:59.296 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 414555509 2024-03-30T12:21:59.296 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.296 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-03-30T12:21:59.296 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3599, 2024-03-30T12:21:59.296 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 276037833 2024-03-30T12:21:59.296 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.296 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.296 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-03-30T12:21:59.297 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-03-30T12:21:59.297 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1861633264 2024-03-30T12:21:59.297 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.297 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-03-30T12:21:59.297 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 48676864 2024-03-30T12:21:59.297 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.297 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-03-30T12:21:59.297 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 48259072 2024-03-30T12:21:59.297 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.297 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-03-30T12:21:59.297 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3137576038 2024-03-30T12:21:59.297 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.297 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-03-30T12:21:59.298 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 417792 2024-03-30T12:21:59.298 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.298 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.298 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-03-30T12:21:59.298 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.298 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-03-30T12:21:59.298 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.298 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.298 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.298 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.298 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.298 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.298 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.299 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.299 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85465145 2024-03-30T12:21:59.299 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.299 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.299 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.299 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.299 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.299 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.299 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.299 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.299 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.299 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.299 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.300 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.300 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.300 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.300 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.300 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.300 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.300 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 614400 2024-03-30T12:21:59.300 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.300 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.300 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.300 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.300 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.301 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.301 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.301 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.301 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.301 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.301 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.301 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73304007 2024-03-30T12:21:59.301 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.301 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.301 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-03-30T12:21:59.301 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.301 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-03-30T12:21:59.301 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.301 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.302 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:59.302 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.302 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.302 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.302 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.302 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.302 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 640988594 2024-03-30T12:21:59.302 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.302 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.302 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.302 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.302 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.302 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.303 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.303 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.303 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.303 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.303 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.303 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.303 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.303 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.303 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.303 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.303 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.304 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2128 2024-03-30T12:21:59.304 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.304 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.304 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.304 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.304 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.304 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.304 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.304 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.304 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.304 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.304 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.304 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 72040958 2024-03-30T12:21:59.305 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.305 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.305 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-03-30T12:21:59.305 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.305 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-03-30T12:21:59.305 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.305 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.305 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:59.305 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.305 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.305 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-03-30T12:21:59.305 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.306 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.306 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 56976763 2024-03-30T12:21:59.306 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.306 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.306 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.306 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.306 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.306 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.306 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.306 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.306 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.307 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.307 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.307 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.307 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.307 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.307 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.307 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.307 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.307 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.307 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.307 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.307 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.308 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.308 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.308 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.308 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.308 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.308 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.308 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.308 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.308 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68851893 2024-03-30T12:21:59.308 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.308 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.308 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-03-30T12:21:59.309 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.309 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-03-30T12:21:59.309 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.309 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.309 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.309 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.309 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.309 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.309 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.309 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.309 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 640988594 2024-03-30T12:21:59.310 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.310 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.310 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.310 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.310 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.310 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10592 2024-03-30T12:21:59.310 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.310 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.310 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.310 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.310 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.310 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.311 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.311 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.311 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3530 2024-03-30T12:21:59.311 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.311 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.311 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 337773 2024-03-30T12:21:59.311 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.311 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.311 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.311 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.311 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.311 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.311 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.312 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.312 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.312 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.312 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.312 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71691191 2024-03-30T12:21:59.312 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.312 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.312 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-03-30T12:21:59.312 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-03-30T12:21:59.312 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.312 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.312 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:59.313 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.313 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.313 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-03-30T12:21:59.313 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.313 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.313 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:59.313 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.313 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.313 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.313 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:59.313 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-03-30T12:21:59.313 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 47 2024-03-30T12:21:59.313 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.313 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-03-30T12:21:59.314 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.314 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.314 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-03-30T12:21:59.314 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5 2024-03-30T12:21:59.314 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.314 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-03-30T12:21:59.314 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.314 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.314 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-03-30T12:21:59.314 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.314 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.314 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-03-30T12:21:59.314 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 616 2024-03-30T12:21:59.315 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.315 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-03-30T12:21:59.315 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-03-30T12:21:59.315 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 39212871 2024-03-30T12:21:59.315 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.315 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-03-30T12:21:59.315 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.315 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.315 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-03-30T12:21:59.315 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 6, 2024-03-30T12:21:59.315 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3445578 2024-03-30T12:21:59.315 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.316 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-03-30T12:21:59.316 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-03-30T12:21:59.316 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 37409015 2024-03-30T12:21:59.316 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.316 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:59.316 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.316 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.316 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-03-30T12:21:59.316 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.316 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.316 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.316 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-30T12:21:59.317 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.317 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.317 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-03-30T12:21:59.317 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.317 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.317 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-03-30T12:21:59.317 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.317 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.317 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.317 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-03-30T12:21:59.317 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.317 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.317 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.318 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-03-30T12:21:59.318 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.318 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.318 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-03-30T12:21:59.318 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.318 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.318 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-03-30T12:21:59.318 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.318 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.318 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.318 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-30T12:21:59.318 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.319 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.319 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-30T12:21:59.319 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.319 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.319 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-03-30T12:21:59.319 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.319 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.319 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-03-30T12:21:59.319 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.319 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.319 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.319 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-03-30T12:21:59.320 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.320 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.320 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.320 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:59.320 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5 2024-03-30T12:21:59.320 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.320 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-03-30T12:21:59.320 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 616 2024-03-30T12:21:59.320 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.320 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-03-30T12:21:59.320 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-03-30T12:21:59.320 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 39212871 2024-03-30T12:21:59.321 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.321 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-30T12:21:59.321 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.321 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.321 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-03-30T12:21:59.321 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 6, 2024-03-30T12:21:59.321 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3445578 2024-03-30T12:21:59.321 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.321 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-03-30T12:21:59.321 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-03-30T12:21:59.321 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 37409015 2024-03-30T12:21:59.321 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.321 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-03-30T12:21:59.321 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.322 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.322 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-03-30T12:21:59.322 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1771104 2024-03-30T12:21:59.322 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.322 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-03-30T12:21:59.322 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6 2024-03-30T12:21:59.322 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.322 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-03-30T12:21:59.322 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:59.322 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.322 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-03-30T12:21:59.322 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 33165312 2024-03-30T12:21:59.323 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.323 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.323 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.323 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.1": { 2024-03-30T12:21:59.323 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:59.323 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-03-30T12:21:59.323 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.323 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.323 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-03-30T12:21:59.323 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.323 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.324 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-03-30T12:21:59.324 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-03-30T12:21:59.324 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.324 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-03-30T12:21:59.324 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.324 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.324 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-03-30T12:21:59.324 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.324 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.324 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-03-30T12:21:59.324 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.324 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.324 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-03-30T12:21:59.325 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12288 2024-03-30T12:21:59.325 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.325 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-03-30T12:21:59.325 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7188480 2024-03-30T12:21:59.325 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.325 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-03-30T12:21:59.325 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.325 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.325 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.325 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-03-30T12:21:59.325 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.325 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.326 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.326 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-03-30T12:21:59.326 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:59.326 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.326 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-03-30T12:21:59.326 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:59.326 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.326 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-03-30T12:21:59.326 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3624960 2024-03-30T12:21:59.326 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.326 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-03-30T12:21:59.326 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3485696 2024-03-30T12:21:59.327 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.327 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-03-30T12:21:59.327 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:59.327 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.327 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-03-30T12:21:59.327 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.327 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.327 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-03-30T12:21:59.327 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.327 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-03-30T12:21:59.327 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-03-30T12:21:59.328 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.328 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-03-30T12:21:59.328 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 206272 2024-03-30T12:21:59.328 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.328 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-03-30T12:21:59.328 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 23 2024-03-30T12:21:59.328 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.328 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-03-30T12:21:59.328 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1282048 2024-03-30T12:21:59.328 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.328 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-03-30T12:21:59.328 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1286144 2024-03-30T12:21:59.329 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.329 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-03-30T12:21:59.329 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.329 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.329 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-03-30T12:21:59.329 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.329 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.329 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-03-30T12:21:59.329 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15 2024-03-30T12:21:59.329 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.329 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-03-30T12:21:59.329 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4913 2024-03-30T12:21:59.330 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.330 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-03-30T12:21:59.330 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4 2024-03-30T12:21:59.330 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.330 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-03-30T12:21:59.330 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5505 2024-03-30T12:21:59.330 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.330 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-03-30T12:21:59.330 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:59.330 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.330 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-03-30T12:21:59.330 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5505 2024-03-30T12:21:59.331 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.331 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-03-30T12:21:59.331 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:59.331 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.331 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-03-30T12:21:59.331 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.331 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.331 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-03-30T12:21:59.331 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.331 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.331 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-03-30T12:21:59.331 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.331 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.332 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-03-30T12:21:59.332 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.332 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.332 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-03-30T12:21:59.332 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.332 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.332 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-03-30T12:21:59.332 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.332 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.332 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-03-30T12:21:59.332 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.332 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.332 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-03-30T12:21:59.333 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.333 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.333 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-03-30T12:21:59.333 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.333 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.333 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-03-30T12:21:59.333 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10752000 2024-03-30T12:21:59.333 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.333 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.333 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-03-30T12:21:59.333 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-03-30T12:21:59.333 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-03-30T12:21:59.334 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.334 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-03-30T12:21:59.334 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 696320 2024-03-30T12:21:59.334 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.334 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-03-30T12:21:59.334 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-03-30T12:21:59.334 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 630708 2024-03-30T12:21:59.334 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.334 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-03-30T12:21:59.334 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.334 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.334 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.335 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-03-30T12:21:59.335 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.335 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.335 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-03-30T12:21:59.335 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.335 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.335 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-03-30T12:21:59.335 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.335 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.335 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-03-30T12:21:59.335 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 29, 2024-03-30T12:21:59.335 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 64868 2024-03-30T12:21:59.336 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.336 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-03-30T12:21:59.336 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.336 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.336 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.336 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-03-30T12:21:59.336 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 838, 2024-03-30T12:21:59.336 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 503123192 2024-03-30T12:21:59.336 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.336 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-03-30T12:21:59.336 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 829, 2024-03-30T12:21:59.336 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 21280449 2024-03-30T12:21:59.336 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.337 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-03-30T12:21:59.337 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 838, 2024-03-30T12:21:59.337 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 785814 2024-03-30T12:21:59.337 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.337 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-03-30T12:21:59.337 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 838, 2024-03-30T12:21:59.337 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 503909006 2024-03-30T12:21:59.337 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.337 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-03-30T12:21:59.337 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.337 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.337 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.337 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-03-30T12:21:59.338 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-03-30T12:21:59.338 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 50270 2024-03-30T12:21:59.338 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.338 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-03-30T12:21:59.338 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:59.338 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4855 2024-03-30T12:21:59.338 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.338 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-03-30T12:21:59.338 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.338 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.338 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.338 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-03-30T12:21:59.338 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.339 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.339 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.339 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-03-30T12:21:59.339 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:59.339 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3635 2024-03-30T12:21:59.339 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.339 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-03-30T12:21:59.339 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3900 2024-03-30T12:21:59.339 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.339 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-03-30T12:21:59.339 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 335 2024-03-30T12:21:59.339 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.339 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-03-30T12:21:59.340 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 133, 2024-03-30T12:21:59.340 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3304115 2024-03-30T12:21:59.340 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.340 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-03-30T12:21:59.340 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 344, 2024-03-30T12:21:59.340 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 329850 2024-03-30T12:21:59.340 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.340 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-03-30T12:21:59.340 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 211, 2024-03-30T12:21:59.340 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4707541 2024-03-30T12:21:59.340 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.340 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-03-30T12:21:59.340 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.341 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.341 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-03-30T12:21:59.341 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 103, 2024-03-30T12:21:59.341 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5605124 2024-03-30T12:21:59.341 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.341 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-03-30T12:21:59.341 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3505, 2024-03-30T12:21:59.341 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3957427447 2024-03-30T12:21:59.341 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.341 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-03-30T12:21:59.341 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 119, 2024-03-30T12:21:59.341 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 27053543 2024-03-30T12:21:59.341 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.342 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-03-30T12:21:59.342 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 117, 2024-03-30T12:21:59.342 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 240384678832 2024-03-30T12:21:59.342 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.342 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-03-30T12:21:59.342 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 119, 2024-03-30T12:21:59.342 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 121988771467 2024-03-30T12:21:59.342 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.342 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-03-30T12:21:59.342 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3503, 2024-03-30T12:21:59.342 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 39465131497 2024-03-30T12:21:59.342 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.342 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-03-30T12:21:59.343 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3503, 2024-03-30T12:21:59.343 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 215627 2024-03-30T12:21:59.343 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.343 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-03-30T12:21:59.343 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3505, 2024-03-30T12:21:59.343 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 88529048 2024-03-30T12:21:59.343 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.343 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-03-30T12:21:59.343 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3505, 2024-03-30T12:21:59.343 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2506675102 2024-03-30T12:21:59.343 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.343 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-03-30T12:21:59.343 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3505, 2024-03-30T12:21:59.344 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 547201 2024-03-30T12:21:59.344 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.344 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-03-30T12:21:59.344 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3505, 2024-03-30T12:21:59.344 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1395548672 2024-03-30T12:21:59.344 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.344 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-03-30T12:21:59.344 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3505, 2024-03-30T12:21:59.344 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 385137976 2024-03-30T12:21:59.344 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.344 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-03-30T12:21:59.344 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 301998 2024-03-30T12:21:59.344 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.345 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-03-30T12:21:59.345 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 53, 2024-03-30T12:21:59.345 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 242155 2024-03-30T12:21:59.345 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.345 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-03-30T12:21:59.345 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3505, 2024-03-30T12:21:59.345 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8333575468 2024-03-30T12:21:59.345 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.345 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-03-30T12:21:59.345 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3505, 2024-03-30T12:21:59.345 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 419855241 2024-03-30T12:21:59.345 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.345 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-03-30T12:21:59.346 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3505, 2024-03-30T12:21:59.346 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 281886302 2024-03-30T12:21:59.346 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.346 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.346 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-03-30T12:21:59.346 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-03-30T12:21:59.346 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1861633264 2024-03-30T12:21:59.346 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.346 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-03-30T12:21:59.346 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 47628288 2024-03-30T12:21:59.346 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.346 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-03-30T12:21:59.347 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 46972928 2024-03-30T12:21:59.347 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.347 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-03-30T12:21:59.347 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3137576038 2024-03-30T12:21:59.347 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.347 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-03-30T12:21:59.347 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 655360 2024-03-30T12:21:59.347 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.347 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.347 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-03-30T12:21:59.347 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.347 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-03-30T12:21:59.347 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.348 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.348 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.348 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.348 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.348 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.348 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.348 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.348 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85502942 2024-03-30T12:21:59.348 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.348 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.348 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.348 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.349 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.349 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.349 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.349 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.349 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.349 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.349 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.349 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.349 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.349 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.349 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.349 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.349 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.349 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12288 2024-03-30T12:21:59.350 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.350 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.350 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.350 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.350 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.350 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.350 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.350 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.350 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.350 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.350 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.350 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73868322 2024-03-30T12:21:59.351 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.351 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.351 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-03-30T12:21:59.351 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.351 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-03-30T12:21:59.351 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.351 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.351 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:59.351 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.351 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.351 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.351 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.352 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.352 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641272070 2024-03-30T12:21:59.352 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.352 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.352 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.352 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.352 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.352 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.352 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.352 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.352 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.352 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.352 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.353 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.353 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.353 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.353 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.353 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.353 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.353 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2128 2024-03-30T12:21:59.353 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.353 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.353 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.353 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.353 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.353 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.354 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.354 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.354 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.354 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.354 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.354 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71757482 2024-03-30T12:21:59.354 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.354 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.354 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-03-30T12:21:59.354 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.354 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-03-30T12:21:59.355 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.355 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.355 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:59.355 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.355 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.355 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-03-30T12:21:59.355 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.355 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.355 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57001961 2024-03-30T12:21:59.355 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.355 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.355 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.355 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.356 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.356 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.356 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.356 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.356 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.356 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.356 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.356 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.356 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.356 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.356 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.356 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.356 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.357 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.357 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.357 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.357 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.357 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.357 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.357 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.357 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.357 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.357 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.357 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.357 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.358 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68826695 2024-03-30T12:21:59.358 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.358 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.358 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-03-30T12:21:59.358 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.358 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-03-30T12:21:59.358 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.358 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.358 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.358 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.358 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.358 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.359 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.359 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.359 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641272070 2024-03-30T12:21:59.359 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.359 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.359 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.359 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.359 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.359 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.359 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.359 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.359 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.360 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.360 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.360 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.360 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.360 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.360 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5741 2024-03-30T12:21:59.360 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.360 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.360 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 314642 2024-03-30T12:21:59.360 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.360 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.360 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.360 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.361 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.361 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.361 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.361 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.361 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.361 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.361 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.361 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71439227 2024-03-30T12:21:59.361 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.361 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.361 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-03-30T12:21:59.361 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-03-30T12:21:59.361 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.362 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.362 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:59.362 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.362 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.362 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-03-30T12:21:59.362 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.362 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.362 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:59.362 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.362 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.362 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.362 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:59.363 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-03-30T12:21:59.363 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 36 2024-03-30T12:21:59.363 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.363 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-03-30T12:21:59.363 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.363 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.363 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-03-30T12:21:59.363 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 155 2024-03-30T12:21:59.363 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.363 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-03-30T12:21:59.363 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.363 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.363 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-03-30T12:21:59.363 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.364 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.364 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-03-30T12:21:59.364 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2429440 2024-03-30T12:21:59.364 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.364 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-03-30T12:21:59.364 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 155, 2024-03-30T12:21:59.364 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1252319103 2024-03-30T12:21:59.364 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.364 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-03-30T12:21:59.364 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1052 2024-03-30T12:21:59.364 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.364 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-03-30T12:21:59.365 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 155, 2024-03-30T12:21:59.365 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 60193800 2024-03-30T12:21:59.365 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.365 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-03-30T12:21:59.365 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 155, 2024-03-30T12:21:59.365 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 216282811 2024-03-30T12:21:59.365 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.365 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:59.365 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 33 2024-03-30T12:21:59.365 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.365 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-03-30T12:21:59.365 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 33, 2024-03-30T12:21:59.365 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5664624 2024-03-30T12:21:59.366 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.366 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-30T12:21:59.366 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.366 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.366 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-03-30T12:21:59.366 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1052 2024-03-30T12:21:59.366 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.366 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-03-30T12:21:59.366 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 33, 2024-03-30T12:21:59.366 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5005861 2024-03-30T12:21:59.366 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.366 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-03-30T12:21:59.366 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 33, 2024-03-30T12:21:59.367 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4204639 2024-03-30T12:21:59.367 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.367 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-03-30T12:21:59.367 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-03-30T12:21:59.367 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.367 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-03-30T12:21:59.367 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.367 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.367 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-03-30T12:21:59.367 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 22, 2024-03-30T12:21:59.367 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 19439934 2024-03-30T12:21:59.367 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.368 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-30T12:21:59.368 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.368 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.368 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-30T12:21:59.368 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.368 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.368 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-03-30T12:21:59.368 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.368 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.368 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-03-30T12:21:59.368 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 22, 2024-03-30T12:21:59.368 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8228508 2024-03-30T12:21:59.368 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.368 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-03-30T12:21:59.369 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 22, 2024-03-30T12:21:59.369 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 18340045 2024-03-30T12:21:59.369 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.369 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:59.369 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 100 2024-03-30T12:21:59.369 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.369 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-03-30T12:21:59.369 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2429440 2024-03-30T12:21:59.369 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.369 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-03-30T12:21:59.369 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 100, 2024-03-30T12:21:59.369 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1227214545 2024-03-30T12:21:59.369 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.370 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-30T12:21:59.370 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.370 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.370 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-03-30T12:21:59.370 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 100, 2024-03-30T12:21:59.370 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 46959431 2024-03-30T12:21:59.370 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.370 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-03-30T12:21:59.370 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 100, 2024-03-30T12:21:59.370 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 193738127 2024-03-30T12:21:59.370 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.370 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-03-30T12:21:59.370 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.371 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.371 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-03-30T12:21:59.371 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 590368 2024-03-30T12:21:59.371 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.371 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-03-30T12:21:59.371 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2 2024-03-30T12:21:59.371 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.371 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-03-30T12:21:59.371 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:59.371 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.371 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-03-30T12:21:59.371 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 32563200 2024-03-30T12:21:59.371 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.372 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.372 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.372 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.2": { 2024-03-30T12:21:59.372 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:59.372 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-03-30T12:21:59.372 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.372 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.372 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-03-30T12:21:59.372 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.372 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.372 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-03-30T12:21:59.372 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-03-30T12:21:59.372 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.372 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-03-30T12:21:59.373 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.373 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.373 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-03-30T12:21:59.373 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.373 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.373 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-03-30T12:21:59.373 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.373 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.373 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-03-30T12:21:59.373 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12288 2024-03-30T12:21:59.373 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.374 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-03-30T12:21:59.374 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7086080 2024-03-30T12:21:59.374 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.374 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-03-30T12:21:59.374 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.374 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.374 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.374 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-03-30T12:21:59.374 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.374 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.374 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.375 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-03-30T12:21:59.375 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:59.375 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.375 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-03-30T12:21:59.375 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:59.375 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.375 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-03-30T12:21:59.375 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3620864 2024-03-30T12:21:59.375 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.375 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-03-30T12:21:59.375 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3481600 2024-03-30T12:21:59.375 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.375 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-03-30T12:21:59.376 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:59.376 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.376 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-03-30T12:21:59.376 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.376 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.376 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-03-30T12:21:59.376 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.376 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.376 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-03-30T12:21:59.376 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-03-30T12:21:59.376 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.376 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-03-30T12:21:59.377 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 206272 2024-03-30T12:21:59.377 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.377 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-03-30T12:21:59.377 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 23 2024-03-30T12:21:59.377 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.377 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-03-30T12:21:59.377 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1282048 2024-03-30T12:21:59.377 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.377 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-03-30T12:21:59.377 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1286144 2024-03-30T12:21:59.377 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.377 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-03-30T12:21:59.377 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.378 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.378 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-03-30T12:21:59.378 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.378 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.378 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-03-30T12:21:59.378 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15 2024-03-30T12:21:59.378 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.378 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-03-30T12:21:59.378 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4913 2024-03-30T12:21:59.378 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.378 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-03-30T12:21:59.378 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4 2024-03-30T12:21:59.378 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.379 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-03-30T12:21:59.379 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5505 2024-03-30T12:21:59.379 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.379 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-03-30T12:21:59.379 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:59.379 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.379 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-03-30T12:21:59.379 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5505 2024-03-30T12:21:59.379 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.379 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-03-30T12:21:59.379 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:59.379 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.380 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-03-30T12:21:59.380 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.380 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.380 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-03-30T12:21:59.380 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.380 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.380 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-03-30T12:21:59.380 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.380 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.380 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-03-30T12:21:59.380 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.380 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.380 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-03-30T12:21:59.381 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.381 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.381 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-03-30T12:21:59.381 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.381 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.381 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-03-30T12:21:59.381 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.381 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.381 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-03-30T12:21:59.381 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.381 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.381 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-03-30T12:21:59.381 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.382 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.382 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-03-30T12:21:59.382 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10645504 2024-03-30T12:21:59.382 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.382 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.382 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-03-30T12:21:59.382 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-03-30T12:21:59.382 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-03-30T12:21:59.382 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.382 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-03-30T12:21:59.382 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 692224 2024-03-30T12:21:59.382 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.383 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-03-30T12:21:59.383 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 4, 2024-03-30T12:21:59.383 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 315497 2024-03-30T12:21:59.383 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.383 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-03-30T12:21:59.383 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.383 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.383 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.383 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-03-30T12:21:59.383 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.383 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.383 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-03-30T12:21:59.384 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.384 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.384 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-03-30T12:21:59.384 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.384 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.384 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-03-30T12:21:59.384 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 12, 2024-03-30T12:21:59.384 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14535 2024-03-30T12:21:59.384 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.384 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-03-30T12:21:59.384 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.384 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.384 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.385 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-03-30T12:21:59.385 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 837, 2024-03-30T12:21:59.385 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 475534004 2024-03-30T12:21:59.385 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.385 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-03-30T12:21:59.385 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 831, 2024-03-30T12:21:59.385 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 17874673 2024-03-30T12:21:59.385 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.385 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-03-30T12:21:59.385 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 837, 2024-03-30T12:21:59.385 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 714963 2024-03-30T12:21:59.385 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.385 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-03-30T12:21:59.386 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 837, 2024-03-30T12:21:59.386 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 476248967 2024-03-30T12:21:59.386 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.386 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-03-30T12:21:59.386 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.386 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.386 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.386 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-03-30T12:21:59.386 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-03-30T12:21:59.386 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 48785 2024-03-30T12:21:59.386 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.386 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-03-30T12:21:59.387 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.387 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.387 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.387 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-03-30T12:21:59.387 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.387 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.387 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.387 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-03-30T12:21:59.387 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.387 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.387 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.387 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-03-30T12:21:59.387 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:59.388 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4693 2024-03-30T12:21:59.388 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.388 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-03-30T12:21:59.388 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3671 2024-03-30T12:21:59.388 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.388 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-03-30T12:21:59.388 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 311 2024-03-30T12:21:59.388 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.388 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-03-30T12:21:59.388 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 86, 2024-03-30T12:21:59.388 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1322161 2024-03-30T12:21:59.388 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.389 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-03-30T12:21:59.389 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 245, 2024-03-30T12:21:59.389 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 334492 2024-03-30T12:21:59.389 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.389 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-03-30T12:21:59.389 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 159, 2024-03-30T12:21:59.389 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3351834 2024-03-30T12:21:59.389 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.389 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-03-30T12:21:59.389 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.389 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.389 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-03-30T12:21:59.389 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 103, 2024-03-30T12:21:59.390 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5611395 2024-03-30T12:21:59.390 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.390 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-03-30T12:21:59.390 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3428, 2024-03-30T12:21:59.390 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3819840965 2024-03-30T12:21:59.390 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.390 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-03-30T12:21:59.390 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 112, 2024-03-30T12:21:59.390 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24016685 2024-03-30T12:21:59.390 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.390 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-03-30T12:21:59.390 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 110, 2024-03-30T12:21:59.390 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 219937692674 2024-03-30T12:21:59.391 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.391 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-03-30T12:21:59.391 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 112, 2024-03-30T12:21:59.391 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 115547879998 2024-03-30T12:21:59.391 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.391 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-03-30T12:21:59.391 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3426, 2024-03-30T12:21:59.391 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68723871201 2024-03-30T12:21:59.391 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.391 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-03-30T12:21:59.391 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3426, 2024-03-30T12:21:59.391 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 188218 2024-03-30T12:21:59.391 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.391 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-03-30T12:21:59.392 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3428, 2024-03-30T12:21:59.392 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4325673 2024-03-30T12:21:59.392 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.392 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-03-30T12:21:59.392 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3428, 2024-03-30T12:21:59.392 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2492665956 2024-03-30T12:21:59.392 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.392 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-03-30T12:21:59.392 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3428, 2024-03-30T12:21:59.392 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 618143 2024-03-30T12:21:59.392 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.392 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-03-30T12:21:59.393 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3428, 2024-03-30T12:21:59.393 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1379868043 2024-03-30T12:21:59.393 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.393 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-03-30T12:21:59.393 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3428, 2024-03-30T12:21:59.393 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 365669512 2024-03-30T12:21:59.393 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.393 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-03-30T12:21:59.393 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 302111 2024-03-30T12:21:59.393 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.393 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-03-30T12:21:59.393 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 46, 2024-03-30T12:21:59.393 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 224325 2024-03-30T12:21:59.394 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.394 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-03-30T12:21:59.394 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3428, 2024-03-30T12:21:59.394 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8062593582 2024-03-30T12:21:59.394 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.394 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-03-30T12:21:59.394 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3428, 2024-03-30T12:21:59.394 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 400499830 2024-03-30T12:21:59.394 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.394 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-03-30T12:21:59.394 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3428, 2024-03-30T12:21:59.394 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 268926979 2024-03-30T12:21:59.395 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.395 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.395 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-03-30T12:21:59.395 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-03-30T12:21:59.395 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1861633264 2024-03-30T12:21:59.395 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.395 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-03-30T12:21:59.395 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 47562752 2024-03-30T12:21:59.395 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.395 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-03-30T12:21:59.395 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 46678016 2024-03-30T12:21:59.395 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.395 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-03-30T12:21:59.396 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3137576038 2024-03-30T12:21:59.396 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.396 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-03-30T12:21:59.396 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 884736 2024-03-30T12:21:59.396 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.396 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.396 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-03-30T12:21:59.396 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.396 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-03-30T12:21:59.396 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.396 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.396 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.396 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.397 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.397 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.397 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.397 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.397 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85503438 2024-03-30T12:21:59.397 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.397 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.397 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.397 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.397 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.397 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.397 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.397 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.398 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.398 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.398 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.398 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.398 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.398 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.398 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.398 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.398 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.398 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12288 2024-03-30T12:21:59.398 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.398 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.399 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.399 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.399 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.399 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.399 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.399 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.399 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.399 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.399 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.399 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73867826 2024-03-30T12:21:59.399 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.399 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.399 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-03-30T12:21:59.400 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.400 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-03-30T12:21:59.400 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.400 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.400 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:59.400 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.400 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.400 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.400 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.400 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.400 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641275788 2024-03-30T12:21:59.400 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.401 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.401 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.401 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.401 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.401 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.401 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.401 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.401 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.401 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.401 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.401 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.401 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.401 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.402 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.402 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.402 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.402 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2128 2024-03-30T12:21:59.402 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.402 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.402 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.402 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.402 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.402 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.402 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.402 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.403 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.403 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.403 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.403 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71753764 2024-03-30T12:21:59.403 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.403 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.403 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-03-30T12:21:59.403 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.403 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-03-30T12:21:59.403 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.403 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.403 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:59.403 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.404 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.404 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-03-30T12:21:59.404 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.404 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.404 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57002292 2024-03-30T12:21:59.404 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.404 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.404 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.404 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.404 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.404 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.404 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.405 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.405 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.405 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.405 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.405 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.405 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.405 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.405 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.405 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.405 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.405 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.405 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.405 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.406 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.406 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.406 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.406 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.406 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.406 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.406 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.406 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.406 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.406 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68826364 2024-03-30T12:21:59.406 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.406 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.407 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-03-30T12:21:59.407 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.407 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-03-30T12:21:59.407 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.407 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.407 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.407 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.407 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.407 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.407 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.407 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.407 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641275788 2024-03-30T12:21:59.407 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.408 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.408 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.408 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.408 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.408 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.408 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.408 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.408 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.408 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.408 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.408 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.408 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.408 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.409 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6863 2024-03-30T12:21:59.409 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.409 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.409 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 305417 2024-03-30T12:21:59.409 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.409 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.409 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.409 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.409 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.409 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.409 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.409 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.410 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.410 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.410 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.410 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71443612 2024-03-30T12:21:59.410 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.410 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.410 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-03-30T12:21:59.410 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-03-30T12:21:59.410 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.410 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.410 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:59.410 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.410 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.411 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-03-30T12:21:59.411 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.411 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.411 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:59.411 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.411 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.411 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.411 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:59.411 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-03-30T12:21:59.411 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 28 2024-03-30T12:21:59.411 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.411 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-03-30T12:21:59.411 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.411 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.412 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-03-30T12:21:59.412 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-03-30T12:21:59.412 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.412 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-03-30T12:21:59.412 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.412 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.412 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-03-30T12:21:59.412 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.412 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.412 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-03-30T12:21:59.412 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.412 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.413 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-03-30T12:21:59.413 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-03-30T12:21:59.413 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 121029808 2024-03-30T12:21:59.413 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.413 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-03-30T12:21:59.413 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.413 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.413 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-03-30T12:21:59.413 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-03-30T12:21:59.413 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4934667 2024-03-30T12:21:59.413 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.413 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-03-30T12:21:59.413 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-03-30T12:21:59.414 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 103164583 2024-03-30T12:21:59.414 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.414 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:59.414 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.414 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.414 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-03-30T12:21:59.414 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.414 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.414 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.414 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-30T12:21:59.414 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.414 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.414 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-03-30T12:21:59.415 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.415 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.415 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-03-30T12:21:59.415 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.415 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.415 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.415 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-03-30T12:21:59.415 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.415 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.415 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.415 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-03-30T12:21:59.415 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.415 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.416 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-03-30T12:21:59.416 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.416 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.416 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-03-30T12:21:59.416 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.416 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.416 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.416 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-30T12:21:59.416 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.416 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.416 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-30T12:21:59.416 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.417 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.417 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-03-30T12:21:59.417 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.417 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.417 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-03-30T12:21:59.417 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.417 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.417 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.417 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-03-30T12:21:59.417 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.417 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.417 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.418 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:59.418 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10 2024-03-30T12:21:59.418 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.418 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-03-30T12:21:59.418 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.418 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.418 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-03-30T12:21:59.418 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-03-30T12:21:59.418 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 121029808 2024-03-30T12:21:59.418 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.418 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-30T12:21:59.418 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.419 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.419 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-03-30T12:21:59.419 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-03-30T12:21:59.419 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4934667 2024-03-30T12:21:59.419 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.419 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-03-30T12:21:59.419 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 10, 2024-03-30T12:21:59.419 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 103164583 2024-03-30T12:21:59.419 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.419 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-03-30T12:21:59.419 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.419 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.420 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-03-30T12:21:59.420 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.420 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.420 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-03-30T12:21:59.420 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.420 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.420 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-03-30T12:21:59.420 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:59.420 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.420 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-03-30T12:21:59.420 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 32559104 2024-03-30T12:21:59.420 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.420 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.421 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.421 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.3": { 2024-03-30T12:21:59.421 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:59.421 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-03-30T12:21:59.421 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.421 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.421 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-03-30T12:21:59.421 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.421 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.421 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-03-30T12:21:59.421 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-03-30T12:21:59.421 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.422 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-03-30T12:21:59.422 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.422 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.422 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-03-30T12:21:59.422 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.422 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.422 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-03-30T12:21:59.422 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.422 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.422 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-03-30T12:21:59.422 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12288 2024-03-30T12:21:59.423 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.423 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-03-30T12:21:59.423 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1171456 2024-03-30T12:21:59.423 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.423 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-03-30T12:21:59.423 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.423 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.423 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.423 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-03-30T12:21:59.423 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.423 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.423 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.423 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-03-30T12:21:59.424 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:59.424 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.424 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-03-30T12:21:59.424 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 27656192 2024-03-30T12:21:59.424 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.424 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-03-30T12:21:59.424 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 868352 2024-03-30T12:21:59.424 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.424 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-03-30T12:21:59.424 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 729088 2024-03-30T12:21:59.424 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.424 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-03-30T12:21:59.424 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:59.425 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.425 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-03-30T12:21:59.425 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.425 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.425 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-03-30T12:21:59.425 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.425 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.425 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-03-30T12:21:59.425 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-03-30T12:21:59.425 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.425 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-03-30T12:21:59.425 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 206272 2024-03-30T12:21:59.425 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.426 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-03-30T12:21:59.426 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 23 2024-03-30T12:21:59.426 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.426 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-03-30T12:21:59.426 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1282048 2024-03-30T12:21:59.426 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.426 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-03-30T12:21:59.426 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1286144 2024-03-30T12:21:59.426 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.426 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-03-30T12:21:59.426 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.426 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.426 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-03-30T12:21:59.427 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.427 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.427 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-03-30T12:21:59.427 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15 2024-03-30T12:21:59.427 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.427 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-03-30T12:21:59.427 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4913 2024-03-30T12:21:59.427 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.427 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-03-30T12:21:59.427 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4 2024-03-30T12:21:59.427 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.427 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-03-30T12:21:59.427 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5503 2024-03-30T12:21:59.428 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.428 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-03-30T12:21:59.428 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:59.428 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.428 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-03-30T12:21:59.428 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5503 2024-03-30T12:21:59.428 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.428 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-03-30T12:21:59.428 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:59.428 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.428 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-03-30T12:21:59.428 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.428 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.428 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-03-30T12:21:59.429 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.429 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.429 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-03-30T12:21:59.429 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.429 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.429 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-03-30T12:21:59.429 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.429 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.429 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-03-30T12:21:59.429 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.429 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.429 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-03-30T12:21:59.429 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.430 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.430 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-03-30T12:21:59.430 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.430 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.430 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-03-30T12:21:59.430 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.430 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.430 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-03-30T12:21:59.430 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.430 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.430 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-03-30T12:21:59.430 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1978368 2024-03-30T12:21:59.430 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.431 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.431 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-03-30T12:21:59.431 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-03-30T12:21:59.431 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-03-30T12:21:59.431 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.431 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-03-30T12:21:59.431 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 716800 2024-03-30T12:21:59.431 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.431 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-03-30T12:21:59.431 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.431 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.431 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.432 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-03-30T12:21:59.432 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.432 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.432 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.432 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-03-30T12:21:59.432 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.432 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.432 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-03-30T12:21:59.432 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.432 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.432 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-03-30T12:21:59.432 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.432 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.433 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-03-30T12:21:59.433 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-03-30T12:21:59.433 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6422 2024-03-30T12:21:59.433 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.433 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-03-30T12:21:59.433 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.433 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.433 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.433 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-03-30T12:21:59.433 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 165, 2024-03-30T12:21:59.433 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 47230343 2024-03-30T12:21:59.433 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.433 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-03-30T12:21:59.434 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 160, 2024-03-30T12:21:59.434 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3625086 2024-03-30T12:21:59.434 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.434 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-03-30T12:21:59.434 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 165, 2024-03-30T12:21:59.434 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 200287 2024-03-30T12:21:59.434 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.434 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-03-30T12:21:59.434 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 165, 2024-03-30T12:21:59.434 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 47430630 2024-03-30T12:21:59.434 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.434 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-03-30T12:21:59.435 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.435 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.435 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.435 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-03-30T12:21:59.435 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:59.435 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 45757 2024-03-30T12:21:59.435 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.435 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-03-30T12:21:59.435 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.435 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.435 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.435 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-03-30T12:21:59.435 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.436 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.436 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.436 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-03-30T12:21:59.436 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.436 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.436 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.436 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-03-30T12:21:59.436 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:59.436 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4461 2024-03-30T12:21:59.436 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.436 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-03-30T12:21:59.436 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 347 2024-03-30T12:21:59.437 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.437 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-03-30T12:21:59.437 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 214 2024-03-30T12:21:59.437 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.437 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-03-30T12:21:59.437 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 86, 2024-03-30T12:21:59.437 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 961905 2024-03-30T12:21:59.437 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.437 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-03-30T12:21:59.437 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 152, 2024-03-30T12:21:59.437 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 255917 2024-03-30T12:21:59.437 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.437 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-03-30T12:21:59.438 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 66, 2024-03-30T12:21:59.438 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 413323 2024-03-30T12:21:59.438 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.438 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-03-30T12:21:59.438 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.438 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.438 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-03-30T12:21:59.438 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.438 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.438 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.438 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-03-30T12:21:59.438 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 241, 2024-03-30T12:21:59.439 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13877141 2024-03-30T12:21:59.439 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.439 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-03-30T12:21:59.439 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 53, 2024-03-30T12:21:59.439 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3444117 2024-03-30T12:21:59.439 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.439 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-03-30T12:21:59.439 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 50, 2024-03-30T12:21:59.439 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 302287727870 2024-03-30T12:21:59.439 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.439 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-03-30T12:21:59.440 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 53, 2024-03-30T12:21:59.440 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65851124247 2024-03-30T12:21:59.440 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.440 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-03-30T12:21:59.440 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 238, 2024-03-30T12:21:59.440 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 578893 2024-03-30T12:21:59.440 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.440 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-03-30T12:21:59.440 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 238, 2024-03-30T12:21:59.440 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 23718 2024-03-30T12:21:59.440 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.440 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-03-30T12:21:59.440 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 241, 2024-03-30T12:21:59.440 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 304080 2024-03-30T12:21:59.440 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.441 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-03-30T12:21:59.441 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 241, 2024-03-30T12:21:59.441 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 88609307 2024-03-30T12:21:59.441 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.441 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-03-30T12:21:59.441 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 241, 2024-03-30T12:21:59.441 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 69687 2024-03-30T12:21:59.441 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.441 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-03-30T12:21:59.441 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 241, 2024-03-30T12:21:59.441 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 48259057 2024-03-30T12:21:59.441 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.441 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-03-30T12:21:59.442 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 241, 2024-03-30T12:21:59.442 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13672331 2024-03-30T12:21:59.442 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.442 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-03-30T12:21:59.442 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 305120 2024-03-30T12:21:59.442 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.442 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-03-30T12:21:59.442 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 44, 2024-03-30T12:21:59.442 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 238004 2024-03-30T12:21:59.442 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.442 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-03-30T12:21:59.442 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 241, 2024-03-30T12:21:59.442 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 164749951 2024-03-30T12:21:59.443 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.443 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-03-30T12:21:59.443 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 241, 2024-03-30T12:21:59.443 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15966531 2024-03-30T12:21:59.443 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.443 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-03-30T12:21:59.443 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 241, 2024-03-30T12:21:59.443 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2631429 2024-03-30T12:21:59.443 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.443 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.443 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-03-30T12:21:59.443 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-03-30T12:21:59.443 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1861633264 2024-03-30T12:21:59.443 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.443 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-03-30T12:21:59.444 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 41336832 2024-03-30T12:21:59.444 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.444 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-03-30T12:21:59.444 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 40493056 2024-03-30T12:21:59.444 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.444 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-03-30T12:21:59.444 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3137576038 2024-03-30T12:21:59.444 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.444 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-03-30T12:21:59.444 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 843776 2024-03-30T12:21:59.444 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.444 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.444 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-03-30T12:21:59.444 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.445 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-03-30T12:21:59.445 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.445 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.445 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.445 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.445 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.445 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.445 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.446 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.446 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85510208 2024-03-30T12:21:59.446 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.446 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.446 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.446 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.446 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.446 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.446 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.446 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.446 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.447 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.447 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.447 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.447 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.447 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.447 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.447 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.447 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.447 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.447 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.447 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.447 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.447 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.447 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.448 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.448 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.448 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.448 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.448 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.448 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.448 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73873344 2024-03-30T12:21:59.448 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.448 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.448 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-03-30T12:21:59.448 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.448 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-03-30T12:21:59.448 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.448 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.448 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:59.449 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.449 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.449 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.449 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.449 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.449 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641326565 2024-03-30T12:21:59.449 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.449 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.449 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.449 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.449 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.449 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.450 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.450 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.450 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.450 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.450 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.450 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.450 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.451 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.451 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.451 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.451 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.451 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2128 2024-03-30T12:21:59.451 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.451 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.451 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.451 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.451 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.451 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.452 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.452 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.452 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.452 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.452 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.452 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71702987 2024-03-30T12:21:59.452 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.452 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.452 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-03-30T12:21:59.452 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.452 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-03-30T12:21:59.452 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.452 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.452 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:59.453 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.453 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.453 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-03-30T12:21:59.453 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.453 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.453 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57006805 2024-03-30T12:21:59.453 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.453 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.453 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.453 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.453 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.453 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.453 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.453 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.454 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.454 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.454 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.454 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.454 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.454 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.454 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.454 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.454 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.454 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.454 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.454 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.454 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.455 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.455 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.455 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.455 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.455 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.455 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.455 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.455 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.455 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68821851 2024-03-30T12:21:59.455 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.455 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.455 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-03-30T12:21:59.455 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.455 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-03-30T12:21:59.455 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.456 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.456 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.456 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.456 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.456 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.456 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.456 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.456 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641326565 2024-03-30T12:21:59.456 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.456 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.456 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.456 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.457 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.457 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.457 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.457 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.457 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.457 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.457 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.457 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.457 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.457 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.457 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14050 2024-03-30T12:21:59.457 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.457 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.457 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 201392 2024-03-30T12:21:59.458 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.458 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.458 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.458 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.458 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.458 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.458 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.458 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.458 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.458 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.458 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.458 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71489673 2024-03-30T12:21:59.458 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.459 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.459 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-03-30T12:21:59.459 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-03-30T12:21:59.459 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.459 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.459 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:59.459 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.459 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.459 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-03-30T12:21:59.459 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.459 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.459 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:59.459 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.459 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.460 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.460 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:59.460 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-03-30T12:21:59.460 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 36 2024-03-30T12:21:59.460 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.460 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-03-30T12:21:59.460 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.460 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.460 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-03-30T12:21:59.460 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.460 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.460 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-03-30T12:21:59.460 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.460 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.461 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-03-30T12:21:59.461 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.461 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.461 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-03-30T12:21:59.461 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.461 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.461 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-03-30T12:21:59.461 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.461 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.461 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.461 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-03-30T12:21:59.462 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.462 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.462 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-03-30T12:21:59.462 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:59.462 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 858390 2024-03-30T12:21:59.462 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.462 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-03-30T12:21:59.462 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.462 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.462 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.462 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:59.462 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.462 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.463 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-03-30T12:21:59.463 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.463 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.463 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.463 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-30T12:21:59.463 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.463 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.463 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-03-30T12:21:59.463 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.464 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.464 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-03-30T12:21:59.464 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.464 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.464 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.464 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-03-30T12:21:59.464 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.464 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.464 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.464 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-03-30T12:21:59.464 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.464 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.464 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-03-30T12:21:59.465 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.465 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.465 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-03-30T12:21:59.465 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.465 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.465 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.465 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-30T12:21:59.465 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.465 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.465 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-30T12:21:59.465 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.465 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.465 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-03-30T12:21:59.466 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.466 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.466 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-03-30T12:21:59.466 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.466 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.466 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.466 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-03-30T12:21:59.466 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.466 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.466 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.466 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:59.466 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.466 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.467 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-03-30T12:21:59.467 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.467 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.467 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-03-30T12:21:59.467 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.467 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.467 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.467 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-30T12:21:59.467 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.467 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.467 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-03-30T12:21:59.467 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:59.467 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 858390 2024-03-30T12:21:59.467 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.468 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-03-30T12:21:59.468 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.468 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.468 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.468 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-03-30T12:21:59.468 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.468 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.468 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-03-30T12:21:59.468 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.468 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.468 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-03-30T12:21:59.468 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.468 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.468 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-03-30T12:21:59.469 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:59.469 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.469 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-03-30T12:21:59.469 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 28381184 2024-03-30T12:21:59.469 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.469 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.469 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.469 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.4": { 2024-03-30T12:21:59.469 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:59.469 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-03-30T12:21:59.469 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.469 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.469 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-03-30T12:21:59.469 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.470 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.470 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-03-30T12:21:59.470 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-03-30T12:21:59.470 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.470 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-03-30T12:21:59.470 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.470 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.470 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-03-30T12:21:59.470 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.470 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.470 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-03-30T12:21:59.470 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.470 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.471 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-03-30T12:21:59.471 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12288 2024-03-30T12:21:59.471 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.471 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-03-30T12:21:59.471 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5967872 2024-03-30T12:21:59.471 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.471 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-03-30T12:21:59.471 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.471 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.471 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.471 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-03-30T12:21:59.471 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.471 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.471 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.472 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-03-30T12:21:59.472 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:59.472 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.472 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-03-30T12:21:59.472 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 27656192 2024-03-30T12:21:59.472 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.472 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-03-30T12:21:59.472 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2961408 2024-03-30T12:21:59.472 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.472 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-03-30T12:21:59.472 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2822144 2024-03-30T12:21:59.472 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.472 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-03-30T12:21:59.472 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:59.473 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.473 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-03-30T12:21:59.473 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.473 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.473 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-03-30T12:21:59.473 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.473 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.473 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-03-30T12:21:59.473 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-03-30T12:21:59.473 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.473 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-03-30T12:21:59.473 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 206272 2024-03-30T12:21:59.473 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.473 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-03-30T12:21:59.473 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 23 2024-03-30T12:21:59.474 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.474 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-03-30T12:21:59.474 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1282048 2024-03-30T12:21:59.474 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.474 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-03-30T12:21:59.474 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1286144 2024-03-30T12:21:59.474 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.474 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-03-30T12:21:59.474 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.474 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.474 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-03-30T12:21:59.474 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.474 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.475 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-03-30T12:21:59.475 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15 2024-03-30T12:21:59.475 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.475 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-03-30T12:21:59.475 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4913 2024-03-30T12:21:59.475 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.475 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-03-30T12:21:59.475 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4 2024-03-30T12:21:59.475 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.475 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-03-30T12:21:59.475 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5505 2024-03-30T12:21:59.475 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.475 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-03-30T12:21:59.475 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:59.475 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.476 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-03-30T12:21:59.476 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5505 2024-03-30T12:21:59.476 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.476 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-03-30T12:21:59.476 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:59.476 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.476 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-03-30T12:21:59.476 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.476 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.476 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-03-30T12:21:59.476 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.476 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.476 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-03-30T12:21:59.476 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.477 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.477 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-03-30T12:21:59.477 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.477 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.477 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-03-30T12:21:59.477 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.477 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.477 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-03-30T12:21:59.477 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.477 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.477 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-03-30T12:21:59.477 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.477 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.477 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-03-30T12:21:59.478 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.478 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.478 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-03-30T12:21:59.478 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.478 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.478 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-03-30T12:21:59.478 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8867840 2024-03-30T12:21:59.478 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.478 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.478 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-03-30T12:21:59.478 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-03-30T12:21:59.478 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-03-30T12:21:59.479 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.479 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-03-30T12:21:59.479 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 704512 2024-03-30T12:21:59.479 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.479 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-03-30T12:21:59.479 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 8, 2024-03-30T12:21:59.479 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 542831 2024-03-30T12:21:59.479 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.479 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-03-30T12:21:59.479 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.479 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.479 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.479 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-03-30T12:21:59.480 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.480 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.480 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-03-30T12:21:59.480 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.480 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.480 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-03-30T12:21:59.480 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.480 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.480 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-03-30T12:21:59.480 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:59.480 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1580 2024-03-30T12:21:59.480 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.480 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-03-30T12:21:59.480 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.481 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.481 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.481 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-03-30T12:21:59.481 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 676, 2024-03-30T12:21:59.481 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464886614 2024-03-30T12:21:59.481 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.481 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-03-30T12:21:59.481 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 671, 2024-03-30T12:21:59.481 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 21025217 2024-03-30T12:21:59.481 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.481 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-03-30T12:21:59.481 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 676, 2024-03-30T12:21:59.481 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 608353 2024-03-30T12:21:59.481 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.482 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-03-30T12:21:59.482 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 676, 2024-03-30T12:21:59.482 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 465494967 2024-03-30T12:21:59.482 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.482 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-03-30T12:21:59.482 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.482 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.482 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.482 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-03-30T12:21:59.482 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-03-30T12:21:59.482 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 42260 2024-03-30T12:21:59.482 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.482 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-03-30T12:21:59.483 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.483 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.483 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.483 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-03-30T12:21:59.483 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.483 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.483 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.483 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-03-30T12:21:59.483 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.483 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.483 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.483 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-03-30T12:21:59.483 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:59.483 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5157 2024-03-30T12:21:59.483 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.484 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-03-30T12:21:59.484 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3445 2024-03-30T12:21:59.484 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.484 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-03-30T12:21:59.484 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 331 2024-03-30T12:21:59.484 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.484 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-03-30T12:21:59.484 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 91, 2024-03-30T12:21:59.484 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 912687 2024-03-30T12:21:59.484 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.484 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-03-30T12:21:59.484 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 152, 2024-03-30T12:21:59.484 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 285583 2024-03-30T12:21:59.484 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.484 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-03-30T12:21:59.485 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 61, 2024-03-30T12:21:59.485 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 161018 2024-03-30T12:21:59.485 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.485 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-03-30T12:21:59.485 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.485 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.485 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-03-30T12:21:59.485 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 105, 2024-03-30T12:21:59.485 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5889652 2024-03-30T12:21:59.485 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.485 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-03-30T12:21:59.485 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3351, 2024-03-30T12:21:59.485 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3629174420 2024-03-30T12:21:59.485 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.485 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-03-30T12:21:59.486 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 41, 2024-03-30T12:21:59.486 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 28218838 2024-03-30T12:21:59.486 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.486 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-03-30T12:21:59.486 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 40, 2024-03-30T12:21:59.486 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 188843910793 2024-03-30T12:21:59.486 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.486 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-03-30T12:21:59.486 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 41, 2024-03-30T12:21:59.486 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68653768478 2024-03-30T12:21:59.486 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.486 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-03-30T12:21:59.486 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3350, 2024-03-30T12:21:59.487 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1404675857 2024-03-30T12:21:59.487 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.487 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-03-30T12:21:59.487 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3350, 2024-03-30T12:21:59.487 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 182425 2024-03-30T12:21:59.487 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.487 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-03-30T12:21:59.487 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3351, 2024-03-30T12:21:59.487 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 162275826 2024-03-30T12:21:59.487 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.487 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-03-30T12:21:59.487 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3351, 2024-03-30T12:21:59.487 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2563492024 2024-03-30T12:21:59.487 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.488 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-03-30T12:21:59.488 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3351, 2024-03-30T12:21:59.488 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 433295 2024-03-30T12:21:59.488 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.488 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-03-30T12:21:59.488 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3351, 2024-03-30T12:21:59.488 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1435464914 2024-03-30T12:21:59.488 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.488 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-03-30T12:21:59.488 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3351, 2024-03-30T12:21:59.488 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 350067453 2024-03-30T12:21:59.488 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.488 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-03-30T12:21:59.488 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 302546 2024-03-30T12:21:59.488 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.489 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-03-30T12:21:59.489 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 40, 2024-03-30T12:21:59.489 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 186223 2024-03-30T12:21:59.489 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.489 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-03-30T12:21:59.489 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3351, 2024-03-30T12:21:59.489 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8140695532 2024-03-30T12:21:59.489 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.489 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-03-30T12:21:59.489 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3351, 2024-03-30T12:21:59.489 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 382416720 2024-03-30T12:21:59.489 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.489 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-03-30T12:21:59.489 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3351, 2024-03-30T12:21:59.490 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 258568524 2024-03-30T12:21:59.490 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.490 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.490 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-03-30T12:21:59.490 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-03-30T12:21:59.490 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1861635701 2024-03-30T12:21:59.490 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.491 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-03-30T12:21:59.491 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 45531136 2024-03-30T12:21:59.491 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.491 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-03-30T12:21:59.491 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 45465600 2024-03-30T12:21:59.491 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.491 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-03-30T12:21:59.491 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3137578905 2024-03-30T12:21:59.491 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.491 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-03-30T12:21:59.492 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-03-30T12:21:59.492 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.492 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.492 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-03-30T12:21:59.492 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.493 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-03-30T12:21:59.493 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.493 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.493 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.493 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.493 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.493 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.493 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.493 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.493 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85503746 2024-03-30T12:21:59.493 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.494 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.494 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.494 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.494 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.494 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.494 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.494 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.494 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.495 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.495 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.495 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.495 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.495 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.495 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.495 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.495 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.495 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.495 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.495 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.495 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.495 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.495 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.495 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.496 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.496 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.496 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.496 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.496 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.496 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73879806 2024-03-30T12:21:59.496 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.496 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.496 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-03-30T12:21:59.496 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.496 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-03-30T12:21:59.496 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.496 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.496 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:59.497 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.497 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.497 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.497 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.497 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.497 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641278100 2024-03-30T12:21:59.497 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.497 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.497 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.497 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.497 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.497 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.497 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.498 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.498 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.498 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.498 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.498 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.498 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.498 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.498 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.498 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.498 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.498 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2128 2024-03-30T12:21:59.498 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.498 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.499 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.499 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.499 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.499 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.499 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.499 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.499 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.499 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.499 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.499 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71751452 2024-03-30T12:21:59.499 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.499 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.499 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-03-30T12:21:59.499 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.499 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-03-30T12:21:59.500 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.500 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.500 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:59.500 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.500 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.500 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-03-30T12:21:59.500 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.500 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.500 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57002497 2024-03-30T12:21:59.500 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.500 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.500 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.500 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.500 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.500 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.500 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.501 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.501 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.501 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.501 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.501 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.501 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.501 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.501 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.501 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.501 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.501 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.501 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.501 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.501 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.502 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.502 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.502 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.502 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.502 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.502 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.502 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.502 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.502 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68826159 2024-03-30T12:21:59.502 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.502 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.502 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-03-30T12:21:59.503 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.503 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-03-30T12:21:59.503 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.503 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.503 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.503 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.503 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.503 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.503 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.503 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.503 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641278100 2024-03-30T12:21:59.503 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.503 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.503 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.504 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.504 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.504 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.504 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.504 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.504 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.504 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.504 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.504 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.504 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.504 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.504 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4581 2024-03-30T12:21:59.504 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.504 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.504 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 318382 2024-03-30T12:21:59.505 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.505 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.505 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.505 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.505 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.505 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.505 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.505 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.505 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.505 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.505 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.505 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71430617 2024-03-30T12:21:59.505 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.505 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.506 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-03-30T12:21:59.506 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-03-30T12:21:59.506 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.506 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.506 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:59.506 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.506 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.506 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-03-30T12:21:59.506 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.506 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.506 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:59.506 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.506 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.507 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.507 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:59.507 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-03-30T12:21:59.507 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 41 2024-03-30T12:21:59.507 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.507 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-03-30T12:21:59.507 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.507 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.507 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-03-30T12:21:59.507 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-03-30T12:21:59.508 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.508 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-03-30T12:21:59.508 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.508 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.508 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-03-30T12:21:59.508 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.508 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.508 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-03-30T12:21:59.508 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-03-30T12:21:59.508 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.508 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-03-30T12:21:59.509 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:59.509 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7155323 2024-03-30T12:21:59.509 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.509 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-03-30T12:21:59.509 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.509 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.509 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-03-30T12:21:59.509 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:59.509 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 577055 2024-03-30T12:21:59.509 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.509 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-03-30T12:21:59.509 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:59.509 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7079265 2024-03-30T12:21:59.509 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.510 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:59.510 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.510 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.510 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-03-30T12:21:59.510 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.510 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.510 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.510 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-30T12:21:59.510 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.510 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.510 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-03-30T12:21:59.510 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.510 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.510 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-03-30T12:21:59.511 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.511 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.511 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.511 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-03-30T12:21:59.511 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.511 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.511 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.511 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-03-30T12:21:59.511 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.511 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.511 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-03-30T12:21:59.511 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.511 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.512 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-03-30T12:21:59.512 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.512 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.512 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.512 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-30T12:21:59.512 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.512 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.512 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-30T12:21:59.512 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.512 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.512 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-03-30T12:21:59.512 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.512 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.513 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-03-30T12:21:59.513 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.513 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.513 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.513 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-03-30T12:21:59.513 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.513 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.513 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.513 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:59.513 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1 2024-03-30T12:21:59.513 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.513 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-03-30T12:21:59.513 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 22 2024-03-30T12:21:59.513 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.514 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-03-30T12:21:59.514 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:59.514 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7155323 2024-03-30T12:21:59.514 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.514 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-30T12:21:59.514 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.514 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.514 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-03-30T12:21:59.514 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:59.514 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 577055 2024-03-30T12:21:59.514 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.514 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-03-30T12:21:59.514 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:59.514 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 7079265 2024-03-30T12:21:59.515 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.515 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-03-30T12:21:59.515 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.515 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.515 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-03-30T12:21:59.515 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.515 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.515 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-03-30T12:21:59.515 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.515 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.515 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-03-30T12:21:59.515 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:59.515 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.516 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-03-30T12:21:59.516 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 28372992 2024-03-30T12:21:59.516 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.516 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.516 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.516 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.5": { 2024-03-30T12:21:59.516 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:59.516 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-03-30T12:21:59.516 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.516 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.516 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-03-30T12:21:59.516 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.516 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.516 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-03-30T12:21:59.517 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-03-30T12:21:59.517 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.517 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-03-30T12:21:59.517 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.517 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.517 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-03-30T12:21:59.517 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.517 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.517 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-03-30T12:21:59.517 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.517 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.517 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-03-30T12:21:59.517 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12288 2024-03-30T12:21:59.517 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.518 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-03-30T12:21:59.518 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6311936 2024-03-30T12:21:59.518 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.518 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-03-30T12:21:59.518 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.518 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.518 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.518 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-03-30T12:21:59.518 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.518 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.518 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.518 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-03-30T12:21:59.518 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:59.518 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.519 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-03-30T12:21:59.519 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:59.519 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.519 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-03-30T12:21:59.519 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3305472 2024-03-30T12:21:59.519 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.519 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-03-30T12:21:59.519 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3166208 2024-03-30T12:21:59.519 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.519 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-03-30T12:21:59.519 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:59.519 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.519 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-03-30T12:21:59.519 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.519 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.520 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-03-30T12:21:59.520 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.520 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.520 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-03-30T12:21:59.520 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-03-30T12:21:59.520 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.520 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-03-30T12:21:59.520 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 206272 2024-03-30T12:21:59.520 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.520 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-03-30T12:21:59.520 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 23 2024-03-30T12:21:59.520 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.521 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-03-30T12:21:59.521 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1282048 2024-03-30T12:21:59.521 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.521 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-03-30T12:21:59.521 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1286144 2024-03-30T12:21:59.521 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.521 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-03-30T12:21:59.521 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.521 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.521 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-03-30T12:21:59.521 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.522 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.522 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-03-30T12:21:59.522 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15 2024-03-30T12:21:59.522 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.522 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-03-30T12:21:59.522 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4913 2024-03-30T12:21:59.522 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.522 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-03-30T12:21:59.522 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4 2024-03-30T12:21:59.522 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.522 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-03-30T12:21:59.522 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5505 2024-03-30T12:21:59.522 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.523 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-03-30T12:21:59.523 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:59.523 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.523 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-03-30T12:21:59.523 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5505 2024-03-30T12:21:59.523 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.523 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-03-30T12:21:59.523 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:59.523 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.523 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-03-30T12:21:59.523 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.523 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.523 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-03-30T12:21:59.523 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.523 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.524 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-03-30T12:21:59.524 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.524 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.524 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-03-30T12:21:59.524 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.524 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.524 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-03-30T12:21:59.524 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.524 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.524 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-03-30T12:21:59.524 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.524 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.524 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-03-30T12:21:59.524 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.525 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.525 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-03-30T12:21:59.525 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.525 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.525 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-03-30T12:21:59.525 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.525 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.525 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-03-30T12:21:59.525 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 9555968 2024-03-30T12:21:59.525 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.525 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.525 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-03-30T12:21:59.525 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-03-30T12:21:59.525 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-03-30T12:21:59.526 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.526 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-03-30T12:21:59.526 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 712704 2024-03-30T12:21:59.526 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.526 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-03-30T12:21:59.526 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 4, 2024-03-30T12:21:59.526 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 213724 2024-03-30T12:21:59.526 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.526 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-03-30T12:21:59.526 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.526 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.527 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.527 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-03-30T12:21:59.527 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.527 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.527 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-03-30T12:21:59.527 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.527 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.527 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-03-30T12:21:59.527 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.527 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.527 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-03-30T12:21:59.527 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-03-30T12:21:59.527 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4074 2024-03-30T12:21:59.527 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.527 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-03-30T12:21:59.528 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.528 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.528 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.528 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-03-30T12:21:59.528 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 760, 2024-03-30T12:21:59.528 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 506370534 2024-03-30T12:21:59.528 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.528 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-03-30T12:21:59.528 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 753, 2024-03-30T12:21:59.528 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 21550815 2024-03-30T12:21:59.528 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.528 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-03-30T12:21:59.528 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 760, 2024-03-30T12:21:59.529 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 685717 2024-03-30T12:21:59.529 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.529 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-03-30T12:21:59.529 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 760, 2024-03-30T12:21:59.529 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 507056251 2024-03-30T12:21:59.529 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.529 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-03-30T12:21:59.529 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.529 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.529 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.529 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-03-30T12:21:59.529 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-03-30T12:21:59.529 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 41406 2024-03-30T12:21:59.529 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.530 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-03-30T12:21:59.530 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.530 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.530 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.530 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-03-30T12:21:59.530 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.530 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.530 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.530 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-03-30T12:21:59.530 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.530 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.530 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.530 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-03-30T12:21:59.531 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:59.531 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5448 2024-03-30T12:21:59.531 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.531 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-03-30T12:21:59.531 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3429 2024-03-30T12:21:59.531 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.531 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-03-30T12:21:59.531 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 339 2024-03-30T12:21:59.531 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.531 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-03-30T12:21:59.531 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 86, 2024-03-30T12:21:59.531 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 717908 2024-03-30T12:21:59.531 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.532 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-03-30T12:21:59.532 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 138, 2024-03-30T12:21:59.532 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 248874 2024-03-30T12:21:59.532 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.532 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-03-30T12:21:59.532 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 52, 2024-03-30T12:21:59.532 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 362078 2024-03-30T12:21:59.532 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.532 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-03-30T12:21:59.532 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.532 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.532 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-03-30T12:21:59.532 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 103, 2024-03-30T12:21:59.532 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5550711 2024-03-30T12:21:59.533 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.533 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-03-30T12:21:59.533 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3370, 2024-03-30T12:21:59.533 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3982310853 2024-03-30T12:21:59.533 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.533 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-03-30T12:21:59.533 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 39, 2024-03-30T12:21:59.533 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 25110158 2024-03-30T12:21:59.533 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.534 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-03-30T12:21:59.534 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 36, 2024-03-30T12:21:59.534 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 227241838679 2024-03-30T12:21:59.534 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.534 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-03-30T12:21:59.534 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 39, 2024-03-30T12:21:59.534 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68083331791 2024-03-30T12:21:59.534 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.534 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-03-30T12:21:59.534 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3367, 2024-03-30T12:21:59.534 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1283038692 2024-03-30T12:21:59.534 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.535 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-03-30T12:21:59.535 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3367, 2024-03-30T12:21:59.535 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 193191 2024-03-30T12:21:59.535 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.535 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-03-30T12:21:59.535 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3370, 2024-03-30T12:21:59.535 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4961637 2024-03-30T12:21:59.535 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.535 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-03-30T12:21:59.535 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3370, 2024-03-30T12:21:59.535 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2577004334 2024-03-30T12:21:59.535 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.535 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-03-30T12:21:59.535 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3370, 2024-03-30T12:21:59.535 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 434973 2024-03-30T12:21:59.536 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.536 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-03-30T12:21:59.536 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3370, 2024-03-30T12:21:59.536 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1385089816 2024-03-30T12:21:59.536 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.536 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-03-30T12:21:59.536 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3370, 2024-03-30T12:21:59.536 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 369052276 2024-03-30T12:21:59.536 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.536 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-03-30T12:21:59.536 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 305106 2024-03-30T12:21:59.536 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.536 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-03-30T12:21:59.536 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 32, 2024-03-30T12:21:59.536 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 138774 2024-03-30T12:21:59.537 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.537 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-03-30T12:21:59.537 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3370, 2024-03-30T12:21:59.537 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8318639339 2024-03-30T12:21:59.537 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.537 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-03-30T12:21:59.537 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3370, 2024-03-30T12:21:59.537 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 404221513 2024-03-30T12:21:59.537 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.537 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-03-30T12:21:59.537 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3370, 2024-03-30T12:21:59.537 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 270510576 2024-03-30T12:21:59.537 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.537 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.538 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-03-30T12:21:59.538 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-03-30T12:21:59.538 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1861635701 2024-03-30T12:21:59.538 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.538 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-03-30T12:21:59.538 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 46579712 2024-03-30T12:21:59.538 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.538 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-03-30T12:21:59.538 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 45768704 2024-03-30T12:21:59.538 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.538 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-03-30T12:21:59.538 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3137578905 2024-03-30T12:21:59.538 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.538 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-03-30T12:21:59.539 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 811008 2024-03-30T12:21:59.539 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.539 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.539 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-03-30T12:21:59.539 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.539 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-03-30T12:21:59.539 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.539 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.539 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.539 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.539 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.539 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.539 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.539 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.539 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85503379 2024-03-30T12:21:59.540 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.540 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.540 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.540 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.540 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.540 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.540 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.540 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.540 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.540 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.540 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.540 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.540 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.540 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.540 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.541 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.541 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.541 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.541 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.541 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.541 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.541 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.541 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.541 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.541 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.541 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.541 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.541 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.541 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.541 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73880173 2024-03-30T12:21:59.542 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.542 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.542 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-03-30T12:21:59.542 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.542 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-03-30T12:21:59.542 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.542 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.542 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:59.542 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.542 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.542 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.542 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.542 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.542 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641275342 2024-03-30T12:21:59.543 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.543 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.543 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.543 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.543 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.543 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.543 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.543 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.543 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.543 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.543 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.543 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.543 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.543 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.544 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.544 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.544 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.544 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2128 2024-03-30T12:21:59.544 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.544 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.544 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.544 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.544 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.544 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.544 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.544 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.544 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.544 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.544 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.545 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71754210 2024-03-30T12:21:59.545 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.545 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.545 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-03-30T12:21:59.545 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.545 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-03-30T12:21:59.545 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.545 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.545 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:59.545 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.545 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.545 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-03-30T12:21:59.545 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.545 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.545 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57002252 2024-03-30T12:21:59.546 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.546 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.546 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.546 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.546 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.546 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.546 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.546 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.546 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.546 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.546 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.547 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.547 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.547 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.547 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.547 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.547 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.547 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.547 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.547 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.547 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.547 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.547 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.547 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.547 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.548 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.548 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.548 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.548 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.548 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68826404 2024-03-30T12:21:59.548 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.548 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.548 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-03-30T12:21:59.548 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.548 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-03-30T12:21:59.548 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.548 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.548 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.548 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.548 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.549 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.549 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.549 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.549 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641275342 2024-03-30T12:21:59.549 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.549 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.549 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.549 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.549 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.549 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.549 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.549 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.549 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.550 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.550 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.550 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.550 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.550 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.550 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12611 2024-03-30T12:21:59.550 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.550 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.550 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 319876 2024-03-30T12:21:59.550 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.550 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.550 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.550 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.551 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.551 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.551 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.551 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.551 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.551 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.551 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.551 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71423851 2024-03-30T12:21:59.551 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.551 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.551 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-03-30T12:21:59.551 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-03-30T12:21:59.551 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.551 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.551 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:59.552 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.552 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.552 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-03-30T12:21:59.552 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.552 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.552 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:59.552 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.552 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.552 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.552 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:59.552 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-03-30T12:21:59.552 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 42 2024-03-30T12:21:59.552 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.553 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-03-30T12:21:59.553 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.553 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.553 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-03-30T12:21:59.553 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.553 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.553 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-03-30T12:21:59.553 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.553 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.553 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-03-30T12:21:59.553 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.553 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.553 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-03-30T12:21:59.554 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.554 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.554 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-03-30T12:21:59.554 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.554 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.554 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.555 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-03-30T12:21:59.555 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.555 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.555 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-03-30T12:21:59.555 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.555 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.555 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.555 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-03-30T12:21:59.555 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.555 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.555 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.555 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:59.555 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.555 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.555 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-03-30T12:21:59.556 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.556 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.556 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.556 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-30T12:21:59.556 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.556 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.556 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-03-30T12:21:59.556 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.556 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.556 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-03-30T12:21:59.556 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.556 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.556 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.556 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-03-30T12:21:59.557 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.557 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.557 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.557 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-03-30T12:21:59.557 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.557 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.557 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-03-30T12:21:59.557 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.557 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.557 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-03-30T12:21:59.557 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.557 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.557 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.557 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-30T12:21:59.557 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.558 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.558 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-30T12:21:59.558 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.558 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.558 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-03-30T12:21:59.558 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.558 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.558 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-03-30T12:21:59.558 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.558 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.558 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.558 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-03-30T12:21:59.558 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.559 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.559 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.559 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:59.559 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.559 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.559 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-03-30T12:21:59.559 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.559 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.559 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-03-30T12:21:59.559 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.559 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.559 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.559 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-30T12:21:59.559 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.559 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.560 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-03-30T12:21:59.560 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.560 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.560 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.560 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-03-30T12:21:59.560 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.560 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.560 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.560 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-03-30T12:21:59.560 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.560 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.560 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-03-30T12:21:59.560 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.560 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.560 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-03-30T12:21:59.561 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.561 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.561 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-03-30T12:21:59.561 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:59.561 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.561 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-03-30T12:21:59.561 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 32571392 2024-03-30T12:21:59.561 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.561 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.561 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.561 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.6": { 2024-03-30T12:21:59.561 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:59.561 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-03-30T12:21:59.562 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.562 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.562 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-03-30T12:21:59.562 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.562 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.562 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-03-30T12:21:59.562 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-03-30T12:21:59.562 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.562 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-03-30T12:21:59.562 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.562 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.562 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-03-30T12:21:59.562 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.562 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.563 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-03-30T12:21:59.563 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.563 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.563 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-03-30T12:21:59.563 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12288 2024-03-30T12:21:59.563 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.563 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-03-30T12:21:59.563 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1335296 2024-03-30T12:21:59.563 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.563 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-03-30T12:21:59.563 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.563 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.564 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.564 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-03-30T12:21:59.564 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.564 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.564 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.564 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-03-30T12:21:59.564 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:59.564 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.564 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-03-30T12:21:59.564 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 27656192 2024-03-30T12:21:59.564 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.564 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-03-30T12:21:59.564 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1003520 2024-03-30T12:21:59.564 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.565 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-03-30T12:21:59.565 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 864256 2024-03-30T12:21:59.565 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.565 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-03-30T12:21:59.565 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:59.565 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.565 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-03-30T12:21:59.565 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.565 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.565 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-03-30T12:21:59.565 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.565 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.565 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-03-30T12:21:59.565 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-03-30T12:21:59.566 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.566 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-03-30T12:21:59.566 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 206272 2024-03-30T12:21:59.566 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.566 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-03-30T12:21:59.566 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 23 2024-03-30T12:21:59.566 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.566 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-03-30T12:21:59.566 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1282048 2024-03-30T12:21:59.566 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.566 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-03-30T12:21:59.566 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1286144 2024-03-30T12:21:59.566 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.566 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-03-30T12:21:59.567 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.567 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.567 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-03-30T12:21:59.567 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.567 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.567 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-03-30T12:21:59.567 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15 2024-03-30T12:21:59.567 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.567 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-03-30T12:21:59.567 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4913 2024-03-30T12:21:59.567 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.567 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-03-30T12:21:59.567 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4 2024-03-30T12:21:59.567 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.567 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-03-30T12:21:59.568 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5504 2024-03-30T12:21:59.568 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.568 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-03-30T12:21:59.568 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:59.568 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.568 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-03-30T12:21:59.568 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5504 2024-03-30T12:21:59.568 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.568 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-03-30T12:21:59.568 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:59.568 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.568 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-03-30T12:21:59.568 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.568 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.569 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-03-30T12:21:59.569 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.569 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.569 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-03-30T12:21:59.569 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.569 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.569 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-03-30T12:21:59.569 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.569 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.569 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-03-30T12:21:59.569 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.569 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.569 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-03-30T12:21:59.570 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.570 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.570 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-03-30T12:21:59.570 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.570 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.570 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-03-30T12:21:59.570 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.570 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.570 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-03-30T12:21:59.570 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.570 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.570 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-03-30T12:21:59.570 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2277376 2024-03-30T12:21:59.570 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.571 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.571 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-03-30T12:21:59.571 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-03-30T12:21:59.571 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-03-30T12:21:59.571 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.571 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-03-30T12:21:59.571 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1298432 2024-03-30T12:21:59.571 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.571 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-03-30T12:21:59.571 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.571 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.571 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.571 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-03-30T12:21:59.572 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.572 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.572 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.572 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-03-30T12:21:59.572 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.572 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.572 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-03-30T12:21:59.572 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.572 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.572 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-03-30T12:21:59.572 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.572 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.572 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-03-30T12:21:59.572 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-03-30T12:21:59.572 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6316 2024-03-30T12:21:59.573 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.573 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-03-30T12:21:59.573 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.573 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.573 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.573 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-03-30T12:21:59.573 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 198, 2024-03-30T12:21:59.573 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 50340657 2024-03-30T12:21:59.573 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.573 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-03-30T12:21:59.573 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 193, 2024-03-30T12:21:59.573 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5288152 2024-03-30T12:21:59.573 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.573 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-03-30T12:21:59.573 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 198, 2024-03-30T12:21:59.574 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 117162 2024-03-30T12:21:59.574 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.574 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-03-30T12:21:59.574 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 198, 2024-03-30T12:21:59.574 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 50457819 2024-03-30T12:21:59.574 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.574 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-03-30T12:21:59.574 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.574 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.574 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.574 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-03-30T12:21:59.574 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:59.574 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 47902 2024-03-30T12:21:59.574 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.575 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-03-30T12:21:59.575 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.575 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.575 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.575 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-03-30T12:21:59.575 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.575 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.575 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.575 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-03-30T12:21:59.575 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.575 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.575 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.575 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-03-30T12:21:59.575 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:59.576 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4265 2024-03-30T12:21:59.576 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.576 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-03-30T12:21:59.576 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 365 2024-03-30T12:21:59.576 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.576 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-03-30T12:21:59.576 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 245 2024-03-30T12:21:59.576 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.576 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-03-30T12:21:59.576 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 87, 2024-03-30T12:21:59.576 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 728825 2024-03-30T12:21:59.576 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.576 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-03-30T12:21:59.576 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 134, 2024-03-30T12:21:59.576 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 240740 2024-03-30T12:21:59.576 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.577 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-03-30T12:21:59.577 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 47, 2024-03-30T12:21:59.577 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 439675 2024-03-30T12:21:59.577 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.577 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-03-30T12:21:59.577 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.577 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.577 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-03-30T12:21:59.577 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.577 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.577 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.577 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-03-30T12:21:59.577 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 279, 2024-03-30T12:21:59.577 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2758972 2024-03-30T12:21:59.577 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.578 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-03-30T12:21:59.578 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 33, 2024-03-30T12:21:59.578 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2116004 2024-03-30T12:21:59.578 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.578 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-03-30T12:21:59.578 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 33, 2024-03-30T12:21:59.578 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 573433277782 2024-03-30T12:21:59.578 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.578 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-03-30T12:21:59.578 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 33, 2024-03-30T12:21:59.578 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 53661991452 2024-03-30T12:21:59.578 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.579 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-03-30T12:21:59.579 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 279, 2024-03-30T12:21:59.579 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 501214 2024-03-30T12:21:59.579 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.579 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-03-30T12:21:59.579 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 279, 2024-03-30T12:21:59.579 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 32257 2024-03-30T12:21:59.579 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.579 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-03-30T12:21:59.579 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 279, 2024-03-30T12:21:59.579 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 204569 2024-03-30T12:21:59.579 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.579 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-03-30T12:21:59.580 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 279, 2024-03-30T12:21:59.580 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 122915800 2024-03-30T12:21:59.580 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.580 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-03-30T12:21:59.580 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 279, 2024-03-30T12:21:59.580 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 106956 2024-03-30T12:21:59.580 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.580 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-03-30T12:21:59.580 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 279, 2024-03-30T12:21:59.580 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 79284267 2024-03-30T12:21:59.580 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.580 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-03-30T12:21:59.580 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 279, 2024-03-30T12:21:59.580 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12848334 2024-03-30T12:21:59.580 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.581 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-03-30T12:21:59.581 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 895111 2024-03-30T12:21:59.581 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.581 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-03-30T12:21:59.581 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 26, 2024-03-30T12:21:59.581 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 100596 2024-03-30T12:21:59.581 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.581 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-03-30T12:21:59.581 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 279, 2024-03-30T12:21:59.581 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 218052850 2024-03-30T12:21:59.581 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.581 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-03-30T12:21:59.581 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 279, 2024-03-30T12:21:59.582 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15376869 2024-03-30T12:21:59.582 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.582 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-03-30T12:21:59.582 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 279, 2024-03-30T12:21:59.582 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2645283 2024-03-30T12:21:59.582 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.582 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.582 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-03-30T12:21:59.582 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-03-30T12:21:59.582 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1861635701 2024-03-30T12:21:59.582 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.582 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-03-30T12:21:59.582 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 42385408 2024-03-30T12:21:59.582 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.583 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-03-30T12:21:59.583 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 41426944 2024-03-30T12:21:59.583 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.583 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-03-30T12:21:59.583 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3137578905 2024-03-30T12:21:59.583 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.583 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-03-30T12:21:59.583 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 958464 2024-03-30T12:21:59.583 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.583 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.583 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-03-30T12:21:59.583 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.583 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-03-30T12:21:59.583 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.583 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.584 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.584 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.584 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.584 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.584 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.584 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.584 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85509305 2024-03-30T12:21:59.584 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.584 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.584 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.584 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.584 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.584 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.584 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.585 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.585 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.585 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.585 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.585 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.585 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.585 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.585 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.585 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.585 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.585 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-03-30T12:21:59.585 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.585 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.586 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.586 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.586 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.586 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.586 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.586 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.586 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.586 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.586 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.586 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73866055 2024-03-30T12:21:59.586 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.586 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.586 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-03-30T12:21:59.586 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.587 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-03-30T12:21:59.587 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.587 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.587 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:59.587 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.587 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.587 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.587 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.587 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.587 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641319790 2024-03-30T12:21:59.587 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.587 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.587 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.587 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.588 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.588 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.588 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.588 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.588 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.588 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.588 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.588 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.588 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.588 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.588 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.589 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.589 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.589 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2128 2024-03-30T12:21:59.589 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.589 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.589 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.589 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.590 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.590 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.590 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.590 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.590 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.590 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.590 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.591 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71709762 2024-03-30T12:21:59.591 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.591 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.591 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-03-30T12:21:59.591 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.591 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-03-30T12:21:59.592 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.592 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.592 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:59.592 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.592 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.592 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-03-30T12:21:59.593 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.593 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.593 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57006203 2024-03-30T12:21:59.593 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.593 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.593 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.594 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.594 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.594 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.594 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.594 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.594 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.595 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.595 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.595 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.595 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.595 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.595 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.595 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.595 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.596 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.596 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.596 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.596 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.596 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.596 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.596 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.596 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.597 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.597 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.597 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.597 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.597 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68822453 2024-03-30T12:21:59.597 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.598 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.598 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-03-30T12:21:59.598 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.598 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-03-30T12:21:59.598 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.598 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.599 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.599 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.599 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.599 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.599 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.599 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.599 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641319790 2024-03-30T12:21:59.600 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.600 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.600 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.600 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.600 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.600 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5986 2024-03-30T12:21:59.600 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.600 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.600 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.600 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.601 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.601 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.601 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.601 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.601 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15565 2024-03-30T12:21:59.601 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.601 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.601 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 202345 2024-03-30T12:21:59.601 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.601 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.601 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.601 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.601 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.601 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.602 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.602 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.602 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.602 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.602 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.602 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71487994 2024-03-30T12:21:59.602 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.602 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.602 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-03-30T12:21:59.602 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-03-30T12:21:59.602 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.602 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.603 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:59.603 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.603 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.603 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-03-30T12:21:59.603 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.603 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.603 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:59.603 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.603 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.603 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.603 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:59.603 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-03-30T12:21:59.603 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 39 2024-03-30T12:21:59.603 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.603 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-03-30T12:21:59.604 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.604 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.604 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-03-30T12:21:59.604 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-03-30T12:21:59.604 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.604 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-03-30T12:21:59.604 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.604 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.604 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-03-30T12:21:59.604 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.604 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.604 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-03-30T12:21:59.604 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2812 2024-03-30T12:21:59.605 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.605 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-03-30T12:21:59.605 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 13, 2024-03-30T12:21:59.605 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 105365492 2024-03-30T12:21:59.605 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.605 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-03-30T12:21:59.605 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.605 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.605 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-03-30T12:21:59.605 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 15, 2024-03-30T12:21:59.605 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12016880 2024-03-30T12:21:59.605 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.605 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-03-30T12:21:59.605 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 13, 2024-03-30T12:21:59.605 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 81573372 2024-03-30T12:21:59.605 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.606 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:59.606 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.606 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.606 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-03-30T12:21:59.606 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.606 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.606 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.606 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-30T12:21:59.606 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.606 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.607 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-03-30T12:21:59.607 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.607 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.607 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-03-30T12:21:59.607 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.607 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.607 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.607 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-03-30T12:21:59.607 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.608 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.608 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.608 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-03-30T12:21:59.608 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.608 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.608 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-03-30T12:21:59.608 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.608 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.608 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-03-30T12:21:59.608 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.608 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.609 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.609 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-30T12:21:59.609 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.609 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.609 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-30T12:21:59.609 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.609 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.609 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-03-30T12:21:59.609 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.609 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.610 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-03-30T12:21:59.610 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.610 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.610 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.610 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-03-30T12:21:59.610 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.610 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.610 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.610 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:59.610 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13 2024-03-30T12:21:59.610 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.610 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-03-30T12:21:59.611 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2812 2024-03-30T12:21:59.611 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.611 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-03-30T12:21:59.611 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 13, 2024-03-30T12:21:59.611 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 105365492 2024-03-30T12:21:59.611 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.611 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-30T12:21:59.611 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.611 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.611 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-03-30T12:21:59.611 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 15, 2024-03-30T12:21:59.611 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12016880 2024-03-30T12:21:59.611 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.611 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-03-30T12:21:59.612 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 13, 2024-03-30T12:21:59.612 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 81573372 2024-03-30T12:21:59.612 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.612 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-03-30T12:21:59.612 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.612 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.612 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-03-30T12:21:59.612 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.612 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.612 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-03-30T12:21:59.612 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.612 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.613 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-03-30T12:21:59.613 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:59.613 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.613 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-03-30T12:21:59.613 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 28962816 2024-03-30T12:21:59.613 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.613 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.613 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.613 INFO:tasks.workunit.client.0.smithi084.stdout: "osd.7": { 2024-03-30T12:21:59.613 INFO:tasks.workunit.client.0.smithi084.stdout: "bluefs": { 2024-03-30T12:21:59.613 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_fallback": { 2024-03-30T12:21:59.613 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.614 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.614 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_slow_size_fallback": { 2024-03-30T12:21:59.614 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.614 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.614 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_db": { 2024-03-30T12:21:59.614 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 65536 2024-03-30T12:21:59.614 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.614 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_main": { 2024-03-30T12:21:59.614 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.614 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.614 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit_wal": { 2024-03-30T12:21:59.614 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.614 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.615 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_slow": { 2024-03-30T12:21:59.615 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.615 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.615 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_sst": { 2024-03-30T12:21:59.615 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 12288 2024-03-30T12:21:59.615 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.615 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_written_wal": { 2024-03-30T12:21:59.615 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6651904 2024-03-30T12:21:59.615 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.615 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lat": { 2024-03-30T12:21:59.615 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.615 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.615 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.616 INFO:tasks.workunit.client.0.smithi084.stdout: "compact_lock_lat": { 2024-03-30T12:21:59.616 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.616 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.616 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.616 INFO:tasks.workunit.client.0.smithi084.stdout: "db_total_bytes": { 2024-03-30T12:21:59.616 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:59.616 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.616 INFO:tasks.workunit.client.0.smithi084.stdout: "db_used_bytes": { 2024-03-30T12:21:59.616 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:59.616 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.616 INFO:tasks.workunit.client.0.smithi084.stdout: "log_bytes": { 2024-03-30T12:21:59.616 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3674112 2024-03-30T12:21:59.616 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.616 INFO:tasks.workunit.client.0.smithi084.stdout: "logged_bytes": { 2024-03-30T12:21:59.616 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3534848 2024-03-30T12:21:59.616 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.617 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_db": { 2024-03-30T12:21:59.617 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 31850496 2024-03-30T12:21:59.617 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.617 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_slow": { 2024-03-30T12:21:59.617 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.617 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.617 INFO:tasks.workunit.client.0.smithi084.stdout: "max_bytes_wal": { 2024-03-30T12:21:59.617 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.618 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.618 INFO:tasks.workunit.client.0.smithi084.stdout: "num_files": { 2024-03-30T12:21:59.618 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 14 2024-03-30T12:21:59.618 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.618 INFO:tasks.workunit.client.0.smithi084.stdout: "read_bytes": { 2024-03-30T12:21:59.618 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 206272 2024-03-30T12:21:59.619 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.619 INFO:tasks.workunit.client.0.smithi084.stdout: "read_count": { 2024-03-30T12:21:59.619 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 23 2024-03-30T12:21:59.619 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.619 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes": { 2024-03-30T12:21:59.619 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1282048 2024-03-30T12:21:59.619 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.620 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_db": { 2024-03-30T12:21:59.620 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1286144 2024-03-30T12:21:59.620 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.620 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_slow": { 2024-03-30T12:21:59.620 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.620 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.621 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_bytes_wal": { 2024-03-30T12:21:59.621 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.621 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.621 INFO:tasks.workunit.client.0.smithi084.stdout: "read_disk_count": { 2024-03-30T12:21:59.621 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15 2024-03-30T12:21:59.621 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.622 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_bytes": { 2024-03-30T12:21:59.622 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4913 2024-03-30T12:21:59.622 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.622 INFO:tasks.workunit.client.0.smithi084.stdout: "read_prefetch_count": { 2024-03-30T12:21:59.622 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4 2024-03-30T12:21:59.622 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.622 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_bytes": { 2024-03-30T12:21:59.623 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5500 2024-03-30T12:21:59.623 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.623 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_buffer_count": { 2024-03-30T12:21:59.623 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:59.623 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.623 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_bytes": { 2024-03-30T12:21:59.624 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5500 2024-03-30T12:21:59.624 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.624 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_count": { 2024-03-30T12:21:59.624 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24 2024-03-30T12:21:59.624 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.624 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes": { 2024-03-30T12:21:59.625 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.625 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.625 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_db": { 2024-03-30T12:21:59.625 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.625 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.625 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_slow": { 2024-03-30T12:21:59.625 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.626 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.626 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_bytes_wal": { 2024-03-30T12:21:59.626 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.626 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.626 INFO:tasks.workunit.client.0.smithi084.stdout: "read_random_disk_count": { 2024-03-30T12:21:59.627 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.627 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.627 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_total_bytes": { 2024-03-30T12:21:59.627 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.627 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.627 INFO:tasks.workunit.client.0.smithi084.stdout: "slow_used_bytes": { 2024-03-30T12:21:59.628 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.628 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.628 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_total_bytes": { 2024-03-30T12:21:59.628 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.628 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.628 INFO:tasks.workunit.client.0.smithi084.stdout: "wal_used_bytes": { 2024-03-30T12:21:59.629 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.629 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.629 INFO:tasks.workunit.client.0.smithi084.stdout: "write_bytes": { 2024-03-30T12:21:59.629 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 10264576 2024-03-30T12:21:59.629 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.629 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.629 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore": { 2024-03-30T12:21:59.630 INFO:tasks.workunit.client.0.smithi084.stdout: "alloc_unit": { 2024-03-30T12:21:59.630 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4096 2024-03-30T12:21:59.630 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.630 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": { 2024-03-30T12:21:59.630 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1294336 2024-03-30T12:21:59.630 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.631 INFO:tasks.workunit.client.0.smithi084.stdout: "clist_lat": { 2024-03-30T12:21:59.631 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3, 2024-03-30T12:21:59.631 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 307770 2024-03-30T12:21:59.631 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.631 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_lat": { 2024-03-30T12:21:59.632 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.632 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.632 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.632 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed": { 2024-03-30T12:21:59.632 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.632 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.633 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_allocated": { 2024-03-30T12:21:59.633 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.633 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.633 INFO:tasks.workunit.client.0.smithi084.stdout: "compressed_original": { 2024-03-30T12:21:59.633 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.633 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.634 INFO:tasks.workunit.client.0.smithi084.stdout: "csum_lat": { 2024-03-30T12:21:59.634 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 7, 2024-03-30T12:21:59.634 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 25226 2024-03-30T12:21:59.634 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.634 INFO:tasks.workunit.client.0.smithi084.stdout: "decompress_lat": { 2024-03-30T12:21:59.634 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.635 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.635 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.635 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_commit_lat": { 2024-03-30T12:21:59.635 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 850, 2024-03-30T12:21:59.635 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 517161845 2024-03-30T12:21:59.635 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.636 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_final_lat": { 2024-03-30T12:21:59.636 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 841, 2024-03-30T12:21:59.636 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 24730375 2024-03-30T12:21:59.636 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.636 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_flush_lat": { 2024-03-30T12:21:59.636 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 850, 2024-03-30T12:21:59.637 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 761248 2024-03-30T12:21:59.637 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.637 INFO:tasks.workunit.client.0.smithi084.stdout: "kv_sync_lat": { 2024-03-30T12:21:59.637 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 850, 2024-03-30T12:21:59.637 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 517923093 2024-03-30T12:21:59.637 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.638 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_keys_lat": { 2024-03-30T12:21:59.638 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.638 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.638 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.638 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_get_values_lat": { 2024-03-30T12:21:59.638 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 1, 2024-03-30T12:21:59.639 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 37459 2024-03-30T12:21:59.639 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.639 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_lower_bound_lat": { 2024-03-30T12:21:59.639 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.639 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.639 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.640 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_next_lat": { 2024-03-30T12:21:59.640 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.640 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.640 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.640 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_seek_to_first_lat": { 2024-03-30T12:21:59.640 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 0, 2024-03-30T12:21:59.641 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.641 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.641 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_upper_bound_lat": { 2024-03-30T12:21:59.641 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 2, 2024-03-30T12:21:59.641 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4142 2024-03-30T12:21:59.641 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.641 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_hits": { 2024-03-30T12:21:59.641 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3787 2024-03-30T12:21:59.642 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.642 INFO:tasks.workunit.client.0.smithi084.stdout: "onode_misses": { 2024-03-30T12:21:59.642 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 380 2024-03-30T12:21:59.642 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.642 INFO:tasks.workunit.client.0.smithi084.stdout: "read_lat": { 2024-03-30T12:21:59.642 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 125, 2024-03-30T12:21:59.642 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2391502 2024-03-30T12:21:59.642 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.643 INFO:tasks.workunit.client.0.smithi084.stdout: "read_onode_meta_lat": { 2024-03-30T12:21:59.643 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 197, 2024-03-30T12:21:59.643 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 450650 2024-03-30T12:21:59.643 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.643 INFO:tasks.workunit.client.0.smithi084.stdout: "read_wait_aio_lat": { 2024-03-30T12:21:59.643 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 72, 2024-03-30T12:21:59.643 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1513381 2024-03-30T12:21:59.643 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.644 INFO:tasks.workunit.client.0.smithi084.stdout: "reads_with_retries": { 2024-03-30T12:21:59.644 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.644 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.644 INFO:tasks.workunit.client.0.smithi084.stdout: "remove_lat": { 2024-03-30T12:21:59.644 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 101, 2024-03-30T12:21:59.644 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 6959036 2024-03-30T12:21:59.644 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.644 INFO:tasks.workunit.client.0.smithi084.stdout: "state_aio_wait_lat": { 2024-03-30T12:21:59.645 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3392, 2024-03-30T12:21:59.645 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3804990545 2024-03-30T12:21:59.645 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.645 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_aio_wait_lat": { 2024-03-30T12:21:59.645 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 19, 2024-03-30T12:21:59.645 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 57784091 2024-03-30T12:21:59.645 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.646 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_cleanup_lat": { 2024-03-30T12:21:59.646 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 19, 2024-03-30T12:21:59.646 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 382926058093 2024-03-30T12:21:59.646 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.646 INFO:tasks.workunit.client.0.smithi084.stdout: "state_deferred_queued_lat": { 2024-03-30T12:21:59.646 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 19, 2024-03-30T12:21:59.646 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 33480896939 2024-03-30T12:21:59.646 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.647 INFO:tasks.workunit.client.0.smithi084.stdout: "state_done_lat": { 2024-03-30T12:21:59.647 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3392, 2024-03-30T12:21:59.647 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1595181129 2024-03-30T12:21:59.647 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.647 INFO:tasks.workunit.client.0.smithi084.stdout: "state_finishing_lat": { 2024-03-30T12:21:59.647 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3392, 2024-03-30T12:21:59.647 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 185499 2024-03-30T12:21:59.647 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.647 INFO:tasks.workunit.client.0.smithi084.stdout: "state_io_done_lat": { 2024-03-30T12:21:59.647 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3392, 2024-03-30T12:21:59.647 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 104306493 2024-03-30T12:21:59.647 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.647 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_commiting_lat": { 2024-03-30T12:21:59.647 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3392, 2024-03-30T12:21:59.648 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2867908760 2024-03-30T12:21:59.648 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.648 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_done_lat": { 2024-03-30T12:21:59.648 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3392, 2024-03-30T12:21:59.648 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 488087 2024-03-30T12:21:59.648 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.648 INFO:tasks.workunit.client.0.smithi084.stdout: "state_kv_queued_lat": { 2024-03-30T12:21:59.648 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3392, 2024-03-30T12:21:59.648 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1606719659 2024-03-30T12:21:59.648 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.648 INFO:tasks.workunit.client.0.smithi084.stdout: "state_prepare_lat": { 2024-03-30T12:21:59.648 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3392, 2024-03-30T12:21:59.648 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 389809685 2024-03-30T12:21:59.648 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.648 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": { 2024-03-30T12:21:59.648 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 893025 2024-03-30T12:21:59.649 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.649 INFO:tasks.workunit.client.0.smithi084.stdout: "truncate_lat": { 2024-03-30T12:21:59.649 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 18, 2024-03-30T12:21:59.649 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 69611 2024-03-30T12:21:59.649 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.649 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_commit_lat": { 2024-03-30T12:21:59.649 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3392, 2024-03-30T12:21:59.649 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8773989421 2024-03-30T12:21:59.649 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.649 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_submit_lat": { 2024-03-30T12:21:59.649 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3392, 2024-03-30T12:21:59.649 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 428689708 2024-03-30T12:21:59.649 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.649 INFO:tasks.workunit.client.0.smithi084.stdout: "txc_throttle_lat": { 2024-03-30T12:21:59.650 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 3392, 2024-03-30T12:21:59.650 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 268925833 2024-03-30T12:21:59.650 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.650 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.650 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache": { 2024-03-30T12:21:59.650 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_bytes": { 2024-03-30T12:21:59.650 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 1861635701 2024-03-30T12:21:59.650 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.650 INFO:tasks.workunit.client.0.smithi084.stdout: "heap_bytes": { 2024-03-30T12:21:59.650 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 46579712 2024-03-30T12:21:59.650 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.650 INFO:tasks.workunit.client.0.smithi084.stdout: "mapped_bytes": { 2024-03-30T12:21:59.650 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 45703168 2024-03-30T12:21:59.651 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.651 INFO:tasks.workunit.client.0.smithi084.stdout: "target_bytes": { 2024-03-30T12:21:59.651 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3137578905 2024-03-30T12:21:59.651 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.651 INFO:tasks.workunit.client.0.smithi084.stdout: "unmapped_bytes": { 2024-03-30T12:21:59.651 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 876544 2024-03-30T12:21:59.651 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.651 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.651 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:data": { 2024-03-30T12:21:59.651 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.651 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 159383552 2024-03-30T12:21:59.651 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.651 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.651 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.652 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.652 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.652 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.652 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.652 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.652 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85486641 2024-03-30T12:21:59.652 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.652 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.652 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.652 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.652 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.652 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8192 2024-03-30T12:21:59.652 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.652 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.653 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 131072 2024-03-30T12:21:59.653 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.653 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.653 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.653 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.653 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.653 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.653 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.653 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.653 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 126976 2024-03-30T12:21:59.653 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.653 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.653 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.653 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.654 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.654 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.654 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.654 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.654 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.654 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.654 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.654 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 73630671 2024-03-30T12:21:59.654 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.654 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.654 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv": { 2024-03-30T12:21:59.654 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.655 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 780140544 2024-03-30T12:21:59.655 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.655 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.655 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:59.655 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.655 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.655 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.655 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.655 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.655 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641149810 2024-03-30T12:21:59.655 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.655 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.655 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.655 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.655 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.655 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.656 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.656 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.656 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.656 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.656 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.656 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.656 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.656 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.656 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.656 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.656 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.656 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 2128 2024-03-30T12:21:59.656 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.656 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.656 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.656 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.657 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.657 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.657 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.657 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.657 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.657 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.657 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.657 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71879742 2024-03-30T12:21:59.657 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.657 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.657 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:kv_onode": { 2024-03-30T12:21:59.657 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.657 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 192937984 2024-03-30T12:21:59.657 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.657 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.658 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 67108864 2024-03-30T12:21:59.658 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.658 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.658 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 464 2024-03-30T12:21:59.658 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.658 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.658 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 56991094 2024-03-30T12:21:59.658 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.658 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.658 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.658 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.658 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.658 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.659 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.659 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.659 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.659 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.659 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.659 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.659 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.659 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.659 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.659 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.659 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.659 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.659 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.659 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.659 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.660 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.660 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.660 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.660 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.660 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.660 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.660 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.660 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.660 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 68837562 2024-03-30T12:21:59.660 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.660 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.660 INFO:tasks.workunit.client.0.smithi084.stdout: "bluestore-pricache:meta": { 2024-03-30T12:21:59.660 INFO:tasks.workunit.client.0.smithi084.stdout: "committed_bytes": { 2024-03-30T12:21:59.660 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 713031680 2024-03-30T12:21:59.660 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.661 INFO:tasks.workunit.client.0.smithi084.stdout: "pri0_bytes": { 2024-03-30T12:21:59.661 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.661 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.661 INFO:tasks.workunit.client.0.smithi084.stdout: "pri10_bytes": { 2024-03-30T12:21:59.661 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.661 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.661 INFO:tasks.workunit.client.0.smithi084.stdout: "pri11_bytes": { 2024-03-30T12:21:59.661 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 641149810 2024-03-30T12:21:59.661 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.661 INFO:tasks.workunit.client.0.smithi084.stdout: "pri1_bytes": { 2024-03-30T12:21:59.661 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.661 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.661 INFO:tasks.workunit.client.0.smithi084.stdout: "pri2_bytes": { 2024-03-30T12:21:59.661 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3503 2024-03-30T12:21:59.662 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.662 INFO:tasks.workunit.client.0.smithi084.stdout: "pri3_bytes": { 2024-03-30T12:21:59.662 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 8175 2024-03-30T12:21:59.662 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.662 INFO:tasks.workunit.client.0.smithi084.stdout: "pri4_bytes": { 2024-03-30T12:21:59.662 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.662 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.662 INFO:tasks.workunit.client.0.smithi084.stdout: "pri5_bytes": { 2024-03-30T12:21:59.662 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 4671 2024-03-30T12:21:59.662 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.662 INFO:tasks.workunit.client.0.smithi084.stdout: "pri6_bytes": { 2024-03-30T12:21:59.662 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 328174 2024-03-30T12:21:59.662 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.663 INFO:tasks.workunit.client.0.smithi084.stdout: "pri7_bytes": { 2024-03-30T12:21:59.663 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.663 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.663 INFO:tasks.workunit.client.0.smithi084.stdout: "pri8_bytes": { 2024-03-30T12:21:59.663 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.663 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.663 INFO:tasks.workunit.client.0.smithi084.stdout: "pri9_bytes": { 2024-03-30T12:21:59.663 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.663 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.663 INFO:tasks.workunit.client.0.smithi084.stdout: "reserved_bytes": { 2024-03-30T12:21:59.663 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 71537347 2024-03-30T12:21:59.663 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.663 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.663 INFO:tasks.workunit.client.0.smithi084.stdout: "objecter": { 2024-03-30T12:21:59.664 INFO:tasks.workunit.client.0.smithi084.stdout: "op_active": { 2024-03-30T12:21:59.664 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.664 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.664 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:59.664 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.664 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.664 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rmw": { 2024-03-30T12:21:59.664 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.664 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.664 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:59.665 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.665 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.665 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.665 INFO:tasks.workunit.client.0.smithi084.stdout: "osd": { 2024-03-30T12:21:59.665 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg": { 2024-03-30T12:21:59.665 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 47 2024-03-30T12:21:59.665 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.665 INFO:tasks.workunit.client.0.smithi084.stdout: "numpg_removing": { 2024-03-30T12:21:59.665 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.665 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.665 INFO:tasks.workunit.client.0.smithi084.stdout: "op": { 2024-03-30T12:21:59.665 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 143 2024-03-30T12:21:59.665 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.665 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_degraded": { 2024-03-30T12:21:59.666 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.666 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.666 INFO:tasks.workunit.client.0.smithi084.stdout: "op_delayed_unreadable": { 2024-03-30T12:21:59.666 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.666 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.666 INFO:tasks.workunit.client.0.smithi084.stdout: "op_in_bytes": { 2024-03-30T12:21:59.666 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.666 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.666 INFO:tasks.workunit.client.0.smithi084.stdout: "op_latency": { 2024-03-30T12:21:59.666 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 143, 2024-03-30T12:21:59.666 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 137704516 2024-03-30T12:21:59.666 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.666 INFO:tasks.workunit.client.0.smithi084.stdout: "op_out_bytes": { 2024-03-30T12:21:59.667 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 265810 2024-03-30T12:21:59.667 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.667 INFO:tasks.workunit.client.0.smithi084.stdout: "op_prepare_latency": { 2024-03-30T12:21:59.667 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 145, 2024-03-30T12:21:59.667 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 34056375 2024-03-30T12:21:59.667 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.667 INFO:tasks.workunit.client.0.smithi084.stdout: "op_process_latency": { 2024-03-30T12:21:59.667 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 143, 2024-03-30T12:21:59.667 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 128311330 2024-03-30T12:21:59.667 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.667 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r": { 2024-03-30T12:21:59.667 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 100 2024-03-30T12:21:59.667 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.668 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency": { 2024-03-30T12:21:59.668 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 100, 2024-03-30T12:21:59.668 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 15648917 2024-03-30T12:21:59.668 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.668 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_latency_out_bytes_histogram": { 2024-03-30T12:21:59.668 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.668 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.668 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_out_bytes": { 2024-03-30T12:21:59.668 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 265810 2024-03-30T12:21:59.668 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.668 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_prepare_latency": { 2024-03-30T12:21:59.668 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 100, 2024-03-30T12:21:59.668 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 13977979 2024-03-30T12:21:59.668 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.669 INFO:tasks.workunit.client.0.smithi084.stdout: "op_r_process_latency": { 2024-03-30T12:21:59.669 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 100, 2024-03-30T12:21:59.669 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 11385497 2024-03-30T12:21:59.669 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.669 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw": { 2024-03-30T12:21:59.669 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 38 2024-03-30T12:21:59.669 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.669 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_in_bytes": { 2024-03-30T12:21:59.669 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.669 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.669 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency": { 2024-03-30T12:21:59.669 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 38, 2024-03-30T12:21:59.669 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 36983789 2024-03-30T12:21:59.669 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.669 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_in_bytes_histogram": { 2024-03-30T12:21:59.670 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.670 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.670 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_latency_out_bytes_histogram": { 2024-03-30T12:21:59.670 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.670 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.670 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_out_bytes": { 2024-03-30T12:21:59.670 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.670 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.670 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_prepare_latency": { 2024-03-30T12:21:59.670 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 38, 2024-03-30T12:21:59.670 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 16961194 2024-03-30T12:21:59.671 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.671 INFO:tasks.workunit.client.0.smithi084.stdout: "op_rw_process_latency": { 2024-03-30T12:21:59.671 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 38, 2024-03-30T12:21:59.671 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 34741601 2024-03-30T12:21:59.671 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.671 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w": { 2024-03-30T12:21:59.671 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 5 2024-03-30T12:21:59.671 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.671 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_in_bytes": { 2024-03-30T12:21:59.671 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.671 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.671 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency": { 2024-03-30T12:21:59.671 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-03-30T12:21:59.671 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 85071810 2024-03-30T12:21:59.671 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.672 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_latency_in_bytes_histogram": { 2024-03-30T12:21:59.672 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.672 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.672 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_prepare_latency": { 2024-03-30T12:21:59.672 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 7, 2024-03-30T12:21:59.672 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 3117202 2024-03-30T12:21:59.672 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.672 INFO:tasks.workunit.client.0.smithi084.stdout: "op_w_process_latency": { 2024-03-30T12:21:59.672 INFO:tasks.workunit.client.0.smithi084.stdout: "count": 5, 2024-03-30T12:21:59.672 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 82184232 2024-03-30T12:21:59.672 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.672 INFO:tasks.workunit.client.0.smithi084.stdout: "op_wip": { 2024-03-30T12:21:59.672 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.672 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.673 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_bytes": { 2024-03-30T12:21:59.673 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.673 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.673 INFO:tasks.workunit.client.0.smithi084.stdout: "recovery_ops": { 2024-03-30T12:21:59.673 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 0 2024-03-30T12:21:59.673 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.673 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes": { 2024-03-30T12:21:59.673 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 95995035648 2024-03-30T12:21:59.673 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.673 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_bytes_used": { 2024-03-30T12:21:59.673 INFO:tasks.workunit.client.0.smithi084.stdout: "value": 33153024 2024-03-30T12:21:59.673 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.673 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.673 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.673 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.674 INFO:tasks.workunit.client.0.smithi084.stdout: "pools": [ 2024-03-30T12:21:59.674 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.674 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-03-30T12:21:59.674 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr" 2024-03-30T12:21:59.674 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.674 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-03-30T12:21:59.674 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-03-30T12:21:59.674 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-03-30T12:21:59.674 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-03-30T12:21:59.674 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-03-30T12:21:59.674 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 1, 2024-03-30T12:21:59.674 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 1, 2024-03-30T12:21:59.674 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 1, 2024-03-30T12:21:59.675 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-03-30T12:21:59.675 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-03-30T12:21:59.675 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 729296939274, 2024-03-30T12:21:59.675 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 1781760, 2024-03-30T12:21:59.675 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-03-30T12:21:59.675 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-03-30T12:21:59.675 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 1781760, 2024-03-30T12:21:59.675 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-03-30T12:21:59.675 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 243098976256, 2024-03-30T12:21:59.675 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 2, 2024-03-30T12:21:59.675 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-03-30T12:21:59.675 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 2.4431142264802475e-06, 2024-03-30T12:21:59.675 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-03-30T12:21:59.675 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-03-30T12:21:59.675 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 466, 2024-03-30T12:21:59.676 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 659456, 2024-03-30T12:21:59.676 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 590368, 2024-03-30T12:21:59.676 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 590368, 2024-03-30T12:21:59.676 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-03-30T12:21:59.676 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 1771104, 2024-03-30T12:21:59.676 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 235, 2024-03-30T12:21:59.676 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 2473984 2024-03-30T12:21:59.676 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.676 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-03-30T12:21:59.676 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-03-30T12:21:59.676 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-03-30T12:21:59.676 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.676 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.676 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-03-30T12:21:59.676 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs" 2024-03-30T12:21:59.677 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.677 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-03-30T12:21:59.677 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-03-30T12:21:59.677 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-03-30T12:21:59.677 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-03-30T12:21:59.677 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-03-30T12:21:59.677 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 32, 2024-03-30T12:21:59.677 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 32, 2024-03-30T12:21:59.677 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 2, 2024-03-30T12:21:59.677 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-03-30T12:21:59.677 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-03-30T12:21:59.677 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 729296939274, 2024-03-30T12:21:59.677 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 98304, 2024-03-30T12:21:59.678 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-03-30T12:21:59.678 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-03-30T12:21:59.678 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 98304, 2024-03-30T12:21:59.678 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-03-30T12:21:59.678 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 243098976256, 2024-03-30T12:21:59.678 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 22, 2024-03-30T12:21:59.678 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-03-30T12:21:59.678 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 1.3479281335548876e-07, 2024-03-30T12:21:59.678 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-03-30T12:21:59.678 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-03-30T12:21:59.678 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 0, 2024-03-30T12:21:59.678 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 0, 2024-03-30T12:21:59.678 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 3430, 2024-03-30T12:21:59.678 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 3430, 2024-03-30T12:21:59.679 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-03-30T12:21:59.679 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 10290, 2024-03-30T12:21:59.679 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 51, 2024-03-30T12:21:59.679 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 20480 2024-03-30T12:21:59.679 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.679 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-03-30T12:21:59.679 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-03-30T12:21:59.679 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-03-30T12:21:59.679 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.679 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.679 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-03-30T12:21:59.679 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs" 2024-03-30T12:21:59.679 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.679 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-03-30T12:21:59.680 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-03-30T12:21:59.680 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-03-30T12:21:59.680 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-03-30T12:21:59.680 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-03-30T12:21:59.680 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 64, 2024-03-30T12:21:59.680 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 64, 2024-03-30T12:21:59.680 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 3, 2024-03-30T12:21:59.680 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-03-30T12:21:59.680 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-03-30T12:21:59.680 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 729296939274, 2024-03-30T12:21:59.680 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 0, 2024-03-30T12:21:59.680 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-03-30T12:21:59.680 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-03-30T12:21:59.680 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 0, 2024-03-30T12:21:59.681 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-03-30T12:21:59.681 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 243098976256, 2024-03-30T12:21:59.681 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 0, 2024-03-30T12:21:59.681 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-03-30T12:21:59.681 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 0.0, 2024-03-30T12:21:59.681 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-03-30T12:21:59.681 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-03-30T12:21:59.681 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 0, 2024-03-30T12:21:59.681 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 0, 2024-03-30T12:21:59.681 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 0, 2024-03-30T12:21:59.681 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 0, 2024-03-30T12:21:59.681 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-03-30T12:21:59.681 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 0, 2024-03-30T12:21:59.681 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 0, 2024-03-30T12:21:59.682 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 0 2024-03-30T12:21:59.682 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.682 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-03-30T12:21:59.682 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-03-30T12:21:59.682 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-03-30T12:21:59.682 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.682 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.682 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-03-30T12:21:59.682 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd" 2024-03-30T12:21:59.682 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.682 INFO:tasks.workunit.client.0.smithi084.stdout: "cache_mode": "none", 2024-03-30T12:21:59.682 INFO:tasks.workunit.client.0.smithi084.stdout: "erasure_code_profile": {}, 2024-03-30T12:21:59.682 INFO:tasks.workunit.client.0.smithi084.stdout: "min_size": 2, 2024-03-30T12:21:59.683 INFO:tasks.workunit.client.0.smithi084.stdout: "options": {}, 2024-03-30T12:21:59.683 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_autoscale_mode": "off", 2024-03-30T12:21:59.683 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 8, 2024-03-30T12:21:59.683 INFO:tasks.workunit.client.0.smithi084.stdout: "pgp_num": 8, 2024-03-30T12:21:59.683 INFO:tasks.workunit.client.0.smithi084.stdout: "pool": 4, 2024-03-30T12:21:59.683 INFO:tasks.workunit.client.0.smithi084.stdout: "size": 3, 2024-03-30T12:21:59.683 INFO:tasks.workunit.client.0.smithi084.stdout: "stats": { 2024-03-30T12:21:59.683 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_raw": 729296939274, 2024-03-30T12:21:59.683 INFO:tasks.workunit.client.0.smithi084.stdout: "bytes_used": 0, 2024-03-30T12:21:59.683 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_bytes_used": 0, 2024-03-30T12:21:59.683 INFO:tasks.workunit.client.0.smithi084.stdout: "compress_under_bytes": 0, 2024-03-30T12:21:59.683 INFO:tasks.workunit.client.0.smithi084.stdout: "data_bytes_used": 0, 2024-03-30T12:21:59.683 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty": 0, 2024-03-30T12:21:59.683 INFO:tasks.workunit.client.0.smithi084.stdout: "max_avail": 243098976256, 2024-03-30T12:21:59.683 INFO:tasks.workunit.client.0.smithi084.stdout: "objects": 0, 2024-03-30T12:21:59.683 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_bytes_used": 0, 2024-03-30T12:21:59.684 INFO:tasks.workunit.client.0.smithi084.stdout: "percent_used": 0.0, 2024-03-30T12:21:59.684 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_bytes": 0, 2024-03-30T12:21:59.684 INFO:tasks.workunit.client.0.smithi084.stdout: "quota_objects": 0, 2024-03-30T12:21:59.684 INFO:tasks.workunit.client.0.smithi084.stdout: "rd": 0, 2024-03-30T12:21:59.684 INFO:tasks.workunit.client.0.smithi084.stdout: "rd_bytes": 0, 2024-03-30T12:21:59.684 INFO:tasks.workunit.client.0.smithi084.stdout: "stored": 0, 2024-03-30T12:21:59.684 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_data": 0, 2024-03-30T12:21:59.684 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_omap": 0, 2024-03-30T12:21:59.684 INFO:tasks.workunit.client.0.smithi084.stdout: "stored_raw": 0, 2024-03-30T12:21:59.684 INFO:tasks.workunit.client.0.smithi084.stdout: "wr": 0, 2024-03-30T12:21:59.684 INFO:tasks.workunit.client.0.smithi084.stdout: "wr_bytes": 0 2024-03-30T12:21:59.684 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.684 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_bytes": 0, 2024-03-30T12:21:59.684 INFO:tasks.workunit.client.0.smithi084.stdout: "target_max_objects": 0, 2024-03-30T12:21:59.685 INFO:tasks.workunit.client.0.smithi084.stdout: "type": "replicated" 2024-03-30T12:21:59.685 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.685 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.685 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd": { 2024-03-30T12:21:59.685 INFO:tasks.workunit.client.0.smithi084.stdout: "mirroring_by_pool": [ 2024-03-30T12:21:59.685 INFO:tasks.workunit.client.0.smithi084.stdout: false 2024-03-30T12:21:59.685 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.685 INFO:tasks.workunit.client.0.smithi084.stdout: "num_images_by_pool": [ 2024-03-30T12:21:59.685 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:59.685 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.685 INFO:tasks.workunit.client.0.smithi084.stdout: "num_pools": 1 2024-03-30T12:21:59.685 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.685 INFO:tasks.workunit.client.0.smithi084.stdout: "report_id": "d6359e11-7dd4-498e-a35d-38ff58e2b1dc", 2024-03-30T12:21:59.685 INFO:tasks.workunit.client.0.smithi084.stdout: "report_timestamp": "2024-03-30T12:21:58.371480", 2024-03-30T12:21:59.686 INFO:tasks.workunit.client.0.smithi084.stdout: "report_version": 1, 2024-03-30T12:21:59.686 INFO:tasks.workunit.client.0.smithi084.stdout: "rocksdb_stats": { 2024-03-30T12:21:59.686 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "7.9.2" 2024-03-30T12:21:59.686 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.686 INFO:tasks.workunit.client.0.smithi084.stdout: "rook": { 2024-03-30T12:21:59.686 INFO:tasks.workunit.client.0.smithi084.stdout: "cluster": { 2024-03-30T12:21:59.686 INFO:tasks.workunit.client.0.smithi084.stdout: "external-mode": null, 2024-03-30T12:21:59.686 INFO:tasks.workunit.client.0.smithi084.stdout: "mon": { 2024-03-30T12:21:59.686 INFO:tasks.workunit.client.0.smithi084.stdout: "allow-multiple-per-node": null, 2024-03-30T12:21:59.686 INFO:tasks.workunit.client.0.smithi084.stdout: "count": null, 2024-03-30T12:21:59.686 INFO:tasks.workunit.client.0.smithi084.stdout: "max-id": null, 2024-03-30T12:21:59.686 INFO:tasks.workunit.client.0.smithi084.stdout: "pvc": { 2024-03-30T12:21:59.686 INFO:tasks.workunit.client.0.smithi084.stdout: "enabled": null 2024-03-30T12:21:59.686 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.687 INFO:tasks.workunit.client.0.smithi084.stdout: "stretch": { 2024-03-30T12:21:59.687 INFO:tasks.workunit.client.0.smithi084.stdout: "enabled": null 2024-03-30T12:21:59.687 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.687 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.687 INFO:tasks.workunit.client.0.smithi084.stdout: "network": { 2024-03-30T12:21:59.687 INFO:tasks.workunit.client.0.smithi084.stdout: "provider": null 2024-03-30T12:21:59.687 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.687 INFO:tasks.workunit.client.0.smithi084.stdout: "storage": { 2024-03-30T12:21:59.687 INFO:tasks.workunit.client.0.smithi084.stdout: "device-set": { 2024-03-30T12:21:59.687 INFO:tasks.workunit.client.0.smithi084.stdout: "count": { 2024-03-30T12:21:59.687 INFO:tasks.workunit.client.0.smithi084.stdout: "non-portable": null, 2024-03-30T12:21:59.687 INFO:tasks.workunit.client.0.smithi084.stdout: "portable": null, 2024-03-30T12:21:59.687 INFO:tasks.workunit.client.0.smithi084.stdout: "total": null 2024-03-30T12:21:59.687 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.688 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.688 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.688 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.688 INFO:tasks.workunit.client.0.smithi084.stdout: "csi": { 2024-03-30T12:21:59.688 INFO:tasks.workunit.client.0.smithi084.stdout: "version": null 2024-03-30T12:21:59.688 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.688 INFO:tasks.workunit.client.0.smithi084.stdout: "kubernetes": { 2024-03-30T12:21:59.688 INFO:tasks.workunit.client.0.smithi084.stdout: "version": null 2024-03-30T12:21:59.688 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.688 INFO:tasks.workunit.client.0.smithi084.stdout: "node": { 2024-03-30T12:21:59.688 INFO:tasks.workunit.client.0.smithi084.stdout: "count": { 2024-03-30T12:21:59.688 INFO:tasks.workunit.client.0.smithi084.stdout: "kubernetes-total": null, 2024-03-30T12:21:59.688 INFO:tasks.workunit.client.0.smithi084.stdout: "with-ceph-daemons": null, 2024-03-30T12:21:59.688 INFO:tasks.workunit.client.0.smithi084.stdout: "with-csi-cephfs-plugin": null, 2024-03-30T12:21:59.688 INFO:tasks.workunit.client.0.smithi084.stdout: "with-csi-nfs-plugin": null, 2024-03-30T12:21:59.689 INFO:tasks.workunit.client.0.smithi084.stdout: "with-csi-rbd-plugin": null 2024-03-30T12:21:59.689 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.689 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.689 INFO:tasks.workunit.client.0.smithi084.stdout: "usage": { 2024-03-30T12:21:59.689 INFO:tasks.workunit.client.0.smithi084.stdout: "storage-class": { 2024-03-30T12:21:59.689 INFO:tasks.workunit.client.0.smithi084.stdout: "count": { 2024-03-30T12:21:59.689 INFO:tasks.workunit.client.0.smithi084.stdout: "bucket": null, 2024-03-30T12:21:59.689 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs": null, 2024-03-30T12:21:59.689 INFO:tasks.workunit.client.0.smithi084.stdout: "nfs": null, 2024-03-30T12:21:59.689 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd": null, 2024-03-30T12:21:59.689 INFO:tasks.workunit.client.0.smithi084.stdout: "total": null 2024-03-30T12:21:59.689 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.689 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:21:59.689 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.689 INFO:tasks.workunit.client.0.smithi084.stdout: "version": null 2024-03-30T12:21:59.690 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.690 INFO:tasks.workunit.client.0.smithi084.stdout: "services": {}, 2024-03-30T12:21:59.690 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_per_pg": [ 2024-03-30T12:21:59.690 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.690 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.690 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:59.690 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:59.690 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:59.690 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.690 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:21:59.690 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.690 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.690 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.691 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.691 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.691 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.691 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.472481+0000", 2024-03-30T12:21:59.691 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.863041+0000", 2024-03-30T12:21:59.691 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.863041+0000", 2024-03-30T12:21:59.691 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.863340+0000", 2024-03-30T12:21:59.691 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.472481+0000", 2024-03-30T12:21:59.691 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.691 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.691 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.691 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.692 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.472481+0000", 2024-03-30T12:21:59.692 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.472481+0000", 2024-03-30T12:21:59.692 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.472481+0000", 2024-03-30T12:21:59.692 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.692 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.692 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.692 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.472481+0000", 2024-03-30T12:21:59.692 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.472481+0000", 2024-03-30T12:21:59.692 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.692 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.692 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.692 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.692 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.692 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.693 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.693 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.693 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.693 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.693 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.693 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.693 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.693 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3f", 2024-03-30T12:21:59.693 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.693 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.693 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.693 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.693 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.693 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T18:37:21.728523+0000", 2024-03-30T12:21:59.693 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.694 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.694 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.694 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.695 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.695 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.695 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.695 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.695 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.695 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.695 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.695 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.695 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.695 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.695 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.695 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.695 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.695 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.696 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.696 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.697 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.697 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.697 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.697 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:59.697 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:59.697 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:59.697 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.697 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:21:59.697 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.697 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.697 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.697 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.697 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:59.697 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:59.697 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:59.698 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.698 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:21:59.698 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.698 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.698 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.698 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.698 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.698 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.698 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.241941+0000", 2024-03-30T12:21:59.698 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:20:37.241258+0000", 2024-03-30T12:21:59.698 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:20:37.241258+0000", 2024-03-30T12:21:59.698 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:20:37.241613+0000", 2024-03-30T12:21:59.698 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.241941+0000", 2024-03-30T12:21:59.699 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.699 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.699 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.699 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 68, 2024-03-30T12:21:59.699 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.241941+0000", 2024-03-30T12:21:59.699 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.241941+0000", 2024-03-30T12:21:59.699 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.241941+0000", 2024-03-30T12:21:59.699 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.699 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.699 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.699 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.241941+0000", 2024-03-30T12:21:59.699 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.241941+0000", 2024-03-30T12:21:59.699 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.699 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.699 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.700 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.700 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 67, 2024-03-30T12:21:59.700 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.700 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.700 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.700 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.700 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.700 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.700 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.700 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.700 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3e", 2024-03-30T12:21:59.700 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.700 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.700 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.700 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 27, 2024-03-30T12:21:59.701 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.701 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:23:14.775585+0000", 2024-03-30T12:21:59.701 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.701 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.701 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.701 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.702 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.702 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.702 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.702 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.702 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.702 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.702 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.702 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.702 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.702 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.702 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.702 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.702 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.702 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.703 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.703 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.703 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.703 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.703 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.703 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.703 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.703 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.703 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.703 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.703 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.703 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.703 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.703 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.704 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.704 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.704 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.704 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.704 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.704 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.704 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.704 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.704 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.704 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.704 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:59.704 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:59.704 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:59.704 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.704 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:21:59.705 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.705 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.705 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.705 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.705 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:59.705 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:59.705 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:59.705 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.705 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:21:59.705 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.705 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.705 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.705 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.705 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.705 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.706 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.007009+0000", 2024-03-30T12:21:59.706 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.853543+0000", 2024-03-30T12:21:59.706 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.853543+0000", 2024-03-30T12:21:59.706 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.853843+0000", 2024-03-30T12:21:59.706 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.007009+0000", 2024-03-30T12:21:59.706 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.706 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.706 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.706 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.706 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.007009+0000", 2024-03-30T12:21:59.706 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.007009+0000", 2024-03-30T12:21:59.706 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.007009+0000", 2024-03-30T12:21:59.706 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.706 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.707 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.707 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.007009+0000", 2024-03-30T12:21:59.707 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.007009+0000", 2024-03-30T12:21:59.707 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.707 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.707 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.707 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.707 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.707 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.707 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.707 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.707 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.707 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.707 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.708 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.708 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.708 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3d", 2024-03-30T12:21:59.708 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.708 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.708 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.708 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.708 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.708 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T12:28:52.339142+0000", 2024-03-30T12:21:59.708 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.709 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.709 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.709 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.709 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.709 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.709 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.709 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.709 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.709 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.709 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.709 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.710 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.710 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.710 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.710 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.710 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.710 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.710 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.710 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.710 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.710 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.711 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.712 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.712 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.712 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.712 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.712 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.712 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:59.713 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:59.713 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:59.713 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.713 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:21:59.713 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.713 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.713 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.713 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.713 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.713 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:59.713 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:59.713 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.713 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:59.713 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.714 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.714 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.714 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.714 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.714 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.714 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006430+0000", 2024-03-30T12:21:59.714 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.859615+0000", 2024-03-30T12:21:59.714 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.859615+0000", 2024-03-30T12:21:59.714 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.859974+0000", 2024-03-30T12:21:59.714 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006430+0000", 2024-03-30T12:21:59.714 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.714 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.714 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.714 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.715 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006430+0000", 2024-03-30T12:21:59.715 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006430+0000", 2024-03-30T12:21:59.715 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006430+0000", 2024-03-30T12:21:59.715 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.715 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.715 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.715 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006430+0000", 2024-03-30T12:21:59.715 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006430+0000", 2024-03-30T12:21:59.715 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.715 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.715 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.715 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.715 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.716 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.716 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.716 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.716 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.716 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.716 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.716 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.716 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.716 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3c", 2024-03-30T12:21:59.716 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.716 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.716 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.716 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.716 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.716 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T17:50:26.933772+0000", 2024-03-30T12:21:59.717 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.717 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.717 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.717 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.717 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.717 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.717 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.717 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.717 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.717 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.717 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.717 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.717 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.717 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.718 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.718 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.718 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.718 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.718 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.718 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.718 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.718 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.718 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.718 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.718 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.719 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.720 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.720 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.720 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.720 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.720 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.720 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.720 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:59.720 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:59.720 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.720 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:59.720 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.720 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.721 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.721 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.721 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:59.721 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:59.721 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:59.721 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.721 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:21:59.721 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.721 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.721 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.721 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.721 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.721 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.721 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.472207+0000", 2024-03-30T12:21:59.722 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.872098+0000", 2024-03-30T12:21:59.722 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.872098+0000", 2024-03-30T12:21:59.722 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.872400+0000", 2024-03-30T12:21:59.722 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.472207+0000", 2024-03-30T12:21:59.722 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.722 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.722 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.722 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.722 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.472207+0000", 2024-03-30T12:21:59.722 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.472207+0000", 2024-03-30T12:21:59.722 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.472207+0000", 2024-03-30T12:21:59.722 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.722 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.722 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.723 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.472207+0000", 2024-03-30T12:21:59.723 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.472207+0000", 2024-03-30T12:21:59.723 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.723 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.723 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.723 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.723 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.723 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.723 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.723 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.723 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.723 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.723 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.723 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.724 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.724 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3b", 2024-03-30T12:21:59.724 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.724 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.724 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.724 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.724 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.724 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-04-01T00:18:21.152462+0000", 2024-03-30T12:21:59.724 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.724 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.724 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.724 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.724 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.724 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.725 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.725 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.725 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.725 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.725 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.725 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.725 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.725 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.725 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.725 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.725 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.725 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.725 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.725 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.726 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.727 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.727 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.727 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.727 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.727 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.727 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:59.728 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:59.728 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:59.728 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.728 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:21:59.728 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.728 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.728 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.728 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.728 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.728 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:59.728 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:59.728 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.728 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:59.728 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.728 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.729 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.729 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.729 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.729 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.729 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006669+0000", 2024-03-30T12:21:59.729 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.857668+0000", 2024-03-30T12:21:59.729 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.857668+0000", 2024-03-30T12:21:59.729 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.858029+0000", 2024-03-30T12:21:59.729 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006669+0000", 2024-03-30T12:21:59.729 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.729 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.729 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.729 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.729 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006669+0000", 2024-03-30T12:21:59.729 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006669+0000", 2024-03-30T12:21:59.730 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006669+0000", 2024-03-30T12:21:59.730 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.730 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.730 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.730 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006669+0000", 2024-03-30T12:21:59.730 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006669+0000", 2024-03-30T12:21:59.730 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.730 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.730 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.730 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.730 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.730 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.730 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.730 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.730 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.731 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.731 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.731 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.731 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.731 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3a", 2024-03-30T12:21:59.731 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.731 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.731 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.731 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.731 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.731 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T20:17:33.313541+0000", 2024-03-30T12:21:59.731 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.731 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.732 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.732 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.732 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.732 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.732 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.732 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.732 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.732 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.732 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.732 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.732 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.732 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.732 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.732 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.733 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.734 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.734 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.734 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.735 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.735 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.735 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.735 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:59.735 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:59.735 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.735 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:59.735 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.735 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.735 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.735 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.735 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:59.735 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:59.735 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:59.735 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.735 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:21:59.736 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.736 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.736 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.736 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.736 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.736 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.736 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.471577+0000", 2024-03-30T12:21:59.736 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.868799+0000", 2024-03-30T12:21:59.736 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.868799+0000", 2024-03-30T12:21:59.736 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.869258+0000", 2024-03-30T12:21:59.736 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.471577+0000", 2024-03-30T12:21:59.736 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.736 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.736 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.736 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.737 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.471577+0000", 2024-03-30T12:21:59.737 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.471577+0000", 2024-03-30T12:21:59.737 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.471577+0000", 2024-03-30T12:21:59.737 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.737 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.737 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.737 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.471577+0000", 2024-03-30T12:21:59.737 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.471577+0000", 2024-03-30T12:21:59.737 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.737 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.737 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.737 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.737 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.737 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.738 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.738 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.738 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.738 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.738 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.738 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.738 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.738 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.39", 2024-03-30T12:21:59.738 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.738 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.738 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.738 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.738 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.739 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T17:00:11.265094+0000", 2024-03-30T12:21:59.739 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.739 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.739 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.739 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.739 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.739 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.739 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.739 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.739 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.739 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.739 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.739 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.739 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.739 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.740 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.741 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.742 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.742 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.742 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.742 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.742 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.742 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:59.742 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:59.742 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:59.742 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.742 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:21:59.742 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.742 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.742 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.742 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.743 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:59.743 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.743 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:59.743 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.743 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:21:59.743 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.743 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.743 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.743 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.743 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.743 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.743 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.003424+0000", 2024-03-30T12:21:59.743 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.863991+0000", 2024-03-30T12:21:59.743 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.863991+0000", 2024-03-30T12:21:59.743 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.864240+0000", 2024-03-30T12:21:59.743 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.003424+0000", 2024-03-30T12:21:59.744 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.744 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.744 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.744 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.744 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.003424+0000", 2024-03-30T12:21:59.744 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.003424+0000", 2024-03-30T12:21:59.744 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.003424+0000", 2024-03-30T12:21:59.744 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.744 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.744 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.744 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.003424+0000", 2024-03-30T12:21:59.744 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.003424+0000", 2024-03-30T12:21:59.744 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.744 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.745 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.745 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.745 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.745 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.745 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.745 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.745 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.745 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.745 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.745 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.745 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.745 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.38", 2024-03-30T12:21:59.745 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.745 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.745 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.746 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.746 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.746 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:59:30.409530+0000", 2024-03-30T12:21:59.746 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.746 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.746 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.746 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.746 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.746 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.746 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.746 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.746 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.746 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.747 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.748 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.749 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.749 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.749 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.749 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.749 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.749 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.749 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.749 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.749 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.749 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.749 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.749 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:59.749 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.749 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:59.750 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.750 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:21:59.750 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.750 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.750 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.750 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.750 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:59.750 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.750 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:59.750 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.750 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:21:59.750 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.750 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.750 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.751 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.751 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.751 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.751 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.472430+0000", 2024-03-30T12:21:59.751 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.874620+0000", 2024-03-30T12:21:59.751 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.874620+0000", 2024-03-30T12:21:59.751 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.875226+0000", 2024-03-30T12:21:59.751 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.472430+0000", 2024-03-30T12:21:59.751 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.751 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.751 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.751 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.751 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.472430+0000", 2024-03-30T12:21:59.751 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.472430+0000", 2024-03-30T12:21:59.751 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.472430+0000", 2024-03-30T12:21:59.752 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.752 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.752 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.752 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.472430+0000", 2024-03-30T12:21:59.752 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.472430+0000", 2024-03-30T12:21:59.752 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.752 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.752 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.752 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.752 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.752 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.752 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.752 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.752 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.753 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.753 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.753 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.753 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.753 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.37", 2024-03-30T12:21:59.753 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.753 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.753 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.753 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.753 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.753 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T21:58:40.881840+0000", 2024-03-30T12:21:59.753 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.753 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.753 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.754 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.755 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.756 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.756 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.756 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.756 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.757 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.757 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:59.757 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.757 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:59.757 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.757 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:21:59.757 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.757 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.757 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.757 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.757 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:59.757 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.757 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:59.757 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.757 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:21:59.758 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.758 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.758 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.758 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.758 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.758 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.758 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.240476+0000", 2024-03-30T12:21:59.758 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.868887+0000", 2024-03-30T12:21:59.758 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.868887+0000", 2024-03-30T12:21:59.758 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.869363+0000", 2024-03-30T12:21:59.758 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.240476+0000", 2024-03-30T12:21:59.758 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.758 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.759 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.759 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.759 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.240476+0000", 2024-03-30T12:21:59.759 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.240476+0000", 2024-03-30T12:21:59.759 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.240476+0000", 2024-03-30T12:21:59.759 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.759 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.759 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.759 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.240476+0000", 2024-03-30T12:21:59.759 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.240476+0000", 2024-03-30T12:21:59.759 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.759 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.759 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.759 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.759 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.760 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.760 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.760 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.760 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.760 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.760 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.760 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.760 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.760 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.36", 2024-03-30T12:21:59.760 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.760 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.760 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.760 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.760 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.761 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T22:40:49.543161+0000", 2024-03-30T12:21:59.761 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.761 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.761 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.761 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.761 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.761 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.761 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.761 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.761 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.761 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.761 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.761 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.762 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.763 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.764 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.764 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.764 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.764 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.764 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.764 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.764 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.764 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.764 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:59.764 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.764 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:59.764 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.765 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:21:59.765 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.765 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.765 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.765 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.765 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:59.765 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.765 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:59.765 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.765 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:21:59.766 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.766 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.766 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.766 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.766 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.766 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.766 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.240717+0000", 2024-03-30T12:21:59.766 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.863683+0000", 2024-03-30T12:21:59.766 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.863683+0000", 2024-03-30T12:21:59.766 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.863992+0000", 2024-03-30T12:21:59.766 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.240717+0000", 2024-03-30T12:21:59.766 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.766 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.766 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.767 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.767 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.240717+0000", 2024-03-30T12:21:59.767 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.240717+0000", 2024-03-30T12:21:59.767 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.240717+0000", 2024-03-30T12:21:59.767 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.767 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.767 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.767 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.240717+0000", 2024-03-30T12:21:59.767 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.240717+0000", 2024-03-30T12:21:59.767 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.767 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.767 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.767 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.767 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.768 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.768 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.768 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.768 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.768 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.768 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.768 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.768 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.768 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.35", 2024-03-30T12:21:59.768 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.768 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.768 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.768 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.768 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.768 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T21:40:36.734391+0000", 2024-03-30T12:21:59.769 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.769 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.769 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.769 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.769 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.769 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.769 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.769 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.769 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.769 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.769 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.769 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.769 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.769 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.769 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.770 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.771 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.771 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.772 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.772 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.772 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.772 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:59.772 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.772 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:59.772 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.772 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:21:59.772 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.772 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.772 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.772 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.772 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:59.772 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:59.773 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:59.773 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.773 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-03-30T12:21:59.773 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.773 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.773 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.773 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.773 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.773 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.773 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.598972+0000", 2024-03-30T12:21:59.773 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.862084+0000", 2024-03-30T12:21:59.773 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.862084+0000", 2024-03-30T12:21:59.773 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.862541+0000", 2024-03-30T12:21:59.773 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.598972+0000", 2024-03-30T12:21:59.773 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.774 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.774 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.774 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.774 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.598972+0000", 2024-03-30T12:21:59.774 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.598972+0000", 2024-03-30T12:21:59.774 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.598972+0000", 2024-03-30T12:21:59.774 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.774 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.774 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.774 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.598972+0000", 2024-03-30T12:21:59.774 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.598972+0000", 2024-03-30T12:21:59.774 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.774 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.774 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.775 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.775 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.775 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.775 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.775 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.775 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.775 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.775 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.775 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.775 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.775 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.34", 2024-03-30T12:21:59.775 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.775 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.775 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.775 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.776 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.776 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:40:36.445232+0000", 2024-03-30T12:21:59.776 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.776 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.776 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.776 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.776 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.776 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.776 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.776 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.776 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.776 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.776 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.776 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.777 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.777 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.777 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.777 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.777 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.777 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.777 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.777 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.777 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.778 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.779 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.779 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.779 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.779 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.779 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.779 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.779 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.779 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.779 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.779 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.779 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.779 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.779 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:59.779 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:59.780 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:59.780 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.780 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-03-30T12:21:59.780 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.780 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.780 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.780 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.780 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:59.780 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:59.780 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:59.780 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.780 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:21:59.780 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.780 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.781 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.781 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.781 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.781 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.781 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.003944+0000", 2024-03-30T12:21:59.781 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.849849+0000", 2024-03-30T12:21:59.781 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.849849+0000", 2024-03-30T12:21:59.781 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.850148+0000", 2024-03-30T12:21:59.781 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.003944+0000", 2024-03-30T12:21:59.781 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.781 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.781 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.781 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.781 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.003944+0000", 2024-03-30T12:21:59.781 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.003944+0000", 2024-03-30T12:21:59.782 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.003944+0000", 2024-03-30T12:21:59.782 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.782 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.782 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.782 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.003944+0000", 2024-03-30T12:21:59.782 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.003944+0000", 2024-03-30T12:21:59.782 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.782 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.782 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.782 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.782 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.782 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.782 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.782 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.783 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.783 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.783 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.783 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.783 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.783 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.33", 2024-03-30T12:21:59.783 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.783 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.783 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.783 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.783 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.783 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T18:55:56.657057+0000", 2024-03-30T12:21:59.783 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.783 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.784 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.784 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.785 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.786 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.786 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.786 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.786 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.786 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.786 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.786 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.786 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.786 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.786 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.786 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.786 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.786 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.787 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.787 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.787 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:59.787 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:59.787 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:59.787 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.787 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:21:59.787 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.787 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.787 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.787 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.787 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:59.787 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:59.787 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:21:59.787 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.788 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:21:59.788 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.788 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.788 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.788 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.788 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.788 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.788 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.005759+0000", 2024-03-30T12:21:59.788 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.864441+0000", 2024-03-30T12:21:59.788 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.864441+0000", 2024-03-30T12:21:59.788 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.865479+0000", 2024-03-30T12:21:59.788 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.005759+0000", 2024-03-30T12:21:59.788 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.788 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.789 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.789 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.789 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.005759+0000", 2024-03-30T12:21:59.789 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.005759+0000", 2024-03-30T12:21:59.789 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.005759+0000", 2024-03-30T12:21:59.789 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.789 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.789 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.789 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.005759+0000", 2024-03-30T12:21:59.789 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.005759+0000", 2024-03-30T12:21:59.789 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.789 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.789 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.790 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.790 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.790 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.790 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.790 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.790 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.790 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.790 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.790 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.790 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.790 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.32", 2024-03-30T12:21:59.790 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.790 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.791 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.791 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.791 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.791 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T14:45:55.344815+0000", 2024-03-30T12:21:59.791 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.791 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.791 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.791 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.791 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.791 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.791 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.791 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.791 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.791 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.791 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.792 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.792 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.792 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.792 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.792 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.792 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.792 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.792 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.792 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.792 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.793 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.793 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.793 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.793 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.793 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.793 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.793 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.793 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.793 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.794 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.794 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.794 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.794 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.794 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.794 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.794 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.795 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.795 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.795 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.795 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.795 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.795 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.795 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.796 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.796 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.796 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.796 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:59.796 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:59.796 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:21:59.797 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.797 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:21:59.797 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.797 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.797 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.797 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.797 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:59.798 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:59.798 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:21:59.798 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.798 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:21:59.798 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.798 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.798 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.799 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.799 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.799 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.799 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.005958+0000", 2024-03-30T12:21:59.799 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.866276+0000", 2024-03-30T12:21:59.799 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.866276+0000", 2024-03-30T12:21:59.799 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.866672+0000", 2024-03-30T12:21:59.799 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.005958+0000", 2024-03-30T12:21:59.799 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.800 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.800 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.800 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.800 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.005958+0000", 2024-03-30T12:21:59.800 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.005958+0000", 2024-03-30T12:21:59.800 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.005958+0000", 2024-03-30T12:21:59.800 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.801 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.801 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.801 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.005958+0000", 2024-03-30T12:21:59.801 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.005958+0000", 2024-03-30T12:21:59.801 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.801 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.801 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.802 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.802 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.802 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.802 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.802 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.802 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.803 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.803 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.803 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.803 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.803 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.31", 2024-03-30T12:21:59.803 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.804 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.804 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.804 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.804 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.804 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T22:23:49.856597+0000", 2024-03-30T12:21:59.804 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.804 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.804 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.804 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.804 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.804 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.805 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.806 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.807 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.807 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.807 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.807 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.807 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.807 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.807 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.807 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.807 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.807 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.807 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.807 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.807 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.807 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.808 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.808 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.808 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:59.808 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:59.808 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:21:59.808 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.808 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:21:59.808 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.808 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.808 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.808 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.809 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.809 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:59.809 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:59.809 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.809 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:59.809 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.809 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.809 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.809 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.809 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.809 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.809 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006129+0000", 2024-03-30T12:21:59.810 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.864447+0000", 2024-03-30T12:21:59.810 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.864447+0000", 2024-03-30T12:21:59.810 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.864760+0000", 2024-03-30T12:21:59.810 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006129+0000", 2024-03-30T12:21:59.810 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.810 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.810 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.810 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.810 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006129+0000", 2024-03-30T12:21:59.810 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006129+0000", 2024-03-30T12:21:59.811 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006129+0000", 2024-03-30T12:21:59.811 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.811 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.811 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.811 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006129+0000", 2024-03-30T12:21:59.811 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006129+0000", 2024-03-30T12:21:59.811 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.811 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.811 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.811 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.811 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.811 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.811 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.812 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.812 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.812 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.812 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.812 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.812 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.812 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.30", 2024-03-30T12:21:59.812 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.812 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.812 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.812 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.812 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.813 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:26:47.024806+0000", 2024-03-30T12:21:59.813 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.813 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.813 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.813 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.814 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.815 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.816 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.816 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.816 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.816 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.816 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.816 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.816 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:59.816 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:59.816 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.816 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:59.816 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.816 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.816 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.816 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.817 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.817 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:59.817 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:59.817 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.817 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:59.817 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.817 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.817 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.817 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.817 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.817 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.817 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006845+0000", 2024-03-30T12:21:59.817 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.863129+0000", 2024-03-30T12:21:59.817 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.863129+0000", 2024-03-30T12:21:59.817 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.863453+0000", 2024-03-30T12:21:59.818 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006845+0000", 2024-03-30T12:21:59.818 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.818 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.818 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.818 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.818 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006845+0000", 2024-03-30T12:21:59.818 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006845+0000", 2024-03-30T12:21:59.818 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006845+0000", 2024-03-30T12:21:59.818 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.818 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.818 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.818 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006845+0000", 2024-03-30T12:21:59.818 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006845+0000", 2024-03-30T12:21:59.818 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.819 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.819 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.819 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.819 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.819 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.819 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.819 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.819 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.819 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.819 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.819 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.819 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.819 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2f", 2024-03-30T12:21:59.819 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.820 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.820 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.820 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.820 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.820 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T21:19:33.658159+0000", 2024-03-30T12:21:59.820 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.820 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.820 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.820 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.820 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.820 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.820 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.820 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.820 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.821 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.822 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.823 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.823 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.823 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.823 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.823 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.823 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.823 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.823 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.823 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.823 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.823 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.823 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.823 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:59.823 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:59.824 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.824 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:59.824 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.824 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.824 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.824 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.824 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:59.824 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:59.824 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:59.824 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.824 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-03-30T12:21:59.824 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.824 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.824 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.825 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.825 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.825 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.825 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006806+0000", 2024-03-30T12:21:59.825 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.854238+0000", 2024-03-30T12:21:59.825 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.854238+0000", 2024-03-30T12:21:59.825 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.854527+0000", 2024-03-30T12:21:59.825 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006806+0000", 2024-03-30T12:21:59.825 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.825 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.825 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.825 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.825 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006806+0000", 2024-03-30T12:21:59.825 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006806+0000", 2024-03-30T12:21:59.826 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006806+0000", 2024-03-30T12:21:59.826 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.826 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.826 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.826 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006806+0000", 2024-03-30T12:21:59.826 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006806+0000", 2024-03-30T12:21:59.826 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.826 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.826 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.826 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.826 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.826 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.826 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.827 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.827 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.827 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.827 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.827 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.827 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.827 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2e", 2024-03-30T12:21:59.827 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.827 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.827 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.827 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.827 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.827 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T22:50:54.069856+0000", 2024-03-30T12:21:59.827 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.827 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.828 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.828 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.829 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.830 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.831 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.831 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.831 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.831 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.831 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.831 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.831 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.831 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:59.831 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:59.831 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:59.832 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.832 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-03-30T12:21:59.832 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.832 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.832 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.832 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.832 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:59.832 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:59.832 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:59.832 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.832 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:21:59.832 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.832 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.833 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.833 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.833 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.833 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.833 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.471919+0000", 2024-03-30T12:21:59.833 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.854077+0000", 2024-03-30T12:21:59.833 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.854077+0000", 2024-03-30T12:21:59.833 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.854461+0000", 2024-03-30T12:21:59.833 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.471919+0000", 2024-03-30T12:21:59.833 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.833 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.833 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.833 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.833 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.471919+0000", 2024-03-30T12:21:59.834 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.471919+0000", 2024-03-30T12:21:59.834 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.471919+0000", 2024-03-30T12:21:59.834 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.834 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.834 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.834 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.471919+0000", 2024-03-30T12:21:59.834 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.471919+0000", 2024-03-30T12:21:59.834 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.834 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.834 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.834 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.834 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.834 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.835 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.835 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.835 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.835 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.835 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.835 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.835 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.835 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2d", 2024-03-30T12:21:59.835 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.835 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.835 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.835 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.835 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.835 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T14:24:10.940443+0000", 2024-03-30T12:21:59.836 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.836 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.836 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.836 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.837 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.837 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.837 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.837 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.837 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.837 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.837 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.837 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.837 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.837 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.837 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.837 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.837 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.837 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.838 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.838 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.838 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.838 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.838 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.838 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.838 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.838 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.838 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.838 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.838 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.838 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.838 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.839 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.839 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.839 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.839 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.839 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.839 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.839 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:59.839 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:59.839 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:59.839 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.839 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:21:59.839 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.839 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.839 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.840 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.840 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:59.840 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:59.840 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:59.840 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.840 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:21:59.840 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.840 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.840 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:59.840 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.840 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.840 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.840 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.007245+0000", 2024-03-30T12:21:59.840 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.466689+0000", 2024-03-30T12:21:59.841 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.466689+0000", 2024-03-30T12:21:59.841 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.466957+0000", 2024-03-30T12:21:59.841 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.007245+0000", 2024-03-30T12:21:59.841 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.841 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.841 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.841 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:59.841 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.007245+0000", 2024-03-30T12:21:59.841 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.007245+0000", 2024-03-30T12:21:59.841 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.007245+0000", 2024-03-30T12:21:59.841 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.841 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.841 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.841 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.007245+0000", 2024-03-30T12:21:59.841 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.007245+0000", 2024-03-30T12:21:59.842 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.842 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 4, 2024-03-30T12:21:59.842 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.842 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.842 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:59.842 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.842 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.842 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.842 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.842 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 4, 2024-03-30T12:21:59.842 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.842 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.842 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.842 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1f", 2024-03-30T12:21:59.843 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.843 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.843 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.843 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 23, 2024-03-30T12:21:59.843 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.843 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T14:07:08.774258+0000", 2024-03-30T12:21:59.843 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.843 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.843 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.843 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 582, 2024-03-30T12:21:59.843 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.843 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.843 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.843 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.843 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.844 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.844 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.844 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.844 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.844 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.844 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.844 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.844 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.844 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.844 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.844 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 6, 2024-03-30T12:21:59.844 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 2, 2024-03-30T12:21:59.844 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.844 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 2, 2024-03-30T12:21:59.844 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.845 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.845 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.845 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.845 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.845 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-03-30T12:21:59.845 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.845 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.845 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.845 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.845 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.845 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.845 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.845 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.845 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.845 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.846 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.846 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.846 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 4, 2024-03-30T12:21:59.846 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 1 2024-03-30T12:21:59.846 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.846 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.846 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.846 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.846 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:59.846 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:59.846 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:59.846 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.846 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:21:59.847 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'4" 2024-03-30T12:21:59.847 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.847 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.847 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.847 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:59.847 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:59.847 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:59.847 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.847 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:21:59.847 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.847 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.847 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.847 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.848 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.848 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.848 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.003958+0000", 2024-03-30T12:21:59.848 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.863429+0000", 2024-03-30T12:21:59.848 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.863429+0000", 2024-03-30T12:21:59.848 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.863714+0000", 2024-03-30T12:21:59.848 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.003958+0000", 2024-03-30T12:21:59.848 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.848 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.848 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.848 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.848 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.003958+0000", 2024-03-30T12:21:59.848 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.003958+0000", 2024-03-30T12:21:59.848 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.003958+0000", 2024-03-30T12:21:59.849 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.849 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.849 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.849 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.003958+0000", 2024-03-30T12:21:59.849 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.003958+0000", 2024-03-30T12:21:59.849 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.849 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.849 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.849 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.849 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.849 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.849 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.849 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.849 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.849 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.850 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.850 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.850 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.850 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1e", 2024-03-30T12:21:59.850 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.850 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.850 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.850 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.850 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.850 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T19:56:31.953173+0000", 2024-03-30T12:21:59.850 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.850 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.850 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.850 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.851 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.852 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.852 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.852 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.852 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.852 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.852 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.852 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.852 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.852 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.852 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.852 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.852 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.852 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.852 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.853 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.853 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.853 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.853 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.853 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.853 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.853 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.853 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.853 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.853 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.853 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.853 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.853 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.853 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.853 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:59.853 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:59.854 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:59.854 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.854 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:21:59.854 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.854 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.854 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.854 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.854 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:59.854 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:59.854 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:21:59.854 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.854 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:21:59.854 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.854 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.855 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:59.855 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.855 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.855 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.855 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.004373+0000", 2024-03-30T12:21:59.855 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.459409+0000", 2024-03-30T12:21:59.855 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.459409+0000", 2024-03-30T12:21:59.855 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.459693+0000", 2024-03-30T12:21:59.855 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.004373+0000", 2024-03-30T12:21:59.855 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.855 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.855 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.855 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:59.855 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.004373+0000", 2024-03-30T12:21:59.855 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.004373+0000", 2024-03-30T12:21:59.856 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.004373+0000", 2024-03-30T12:21:59.856 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.856 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.856 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.856 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.004373+0000", 2024-03-30T12:21:59.856 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.004373+0000", 2024-03-30T12:21:59.856 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.856 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 1, 2024-03-30T12:21:59.856 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.856 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.856 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:59.856 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.856 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.856 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.857 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.857 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 1, 2024-03-30T12:21:59.857 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.857 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.857 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.857 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1e", 2024-03-30T12:21:59.857 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.857 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.857 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.857 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 20, 2024-03-30T12:21:59.857 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.857 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T18:56:27.891375+0000", 2024-03-30T12:21:59.857 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.857 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.857 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.858 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.858 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.858 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.858 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.858 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.858 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.858 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.858 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.858 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.858 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.858 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.858 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.858 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.858 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.859 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.859 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.859 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.859 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.859 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.859 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.859 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.859 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.859 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.859 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.859 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.859 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.859 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.860 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.860 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.860 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.860 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.860 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.860 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.860 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.860 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.860 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.860 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.860 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.860 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.860 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.861 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.861 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.861 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.861 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.861 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:59.861 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:59.861 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:21:59.861 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.861 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:21:59.861 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'1" 2024-03-30T12:21:59.861 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.861 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.861 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.862 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:59.862 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.862 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:59.862 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.862 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:21:59.862 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.862 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.862 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.862 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.862 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.862 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.862 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.007101+0000", 2024-03-30T12:21:59.862 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.864274+0000", 2024-03-30T12:21:59.862 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.864274+0000", 2024-03-30T12:21:59.863 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.864952+0000", 2024-03-30T12:21:59.863 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.007101+0000", 2024-03-30T12:21:59.863 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.863 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.863 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.863 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.863 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.007101+0000", 2024-03-30T12:21:59.863 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.007101+0000", 2024-03-30T12:21:59.863 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.007101+0000", 2024-03-30T12:21:59.863 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.863 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.863 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.863 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.007101+0000", 2024-03-30T12:21:59.864 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.007101+0000", 2024-03-30T12:21:59.864 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.864 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.864 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.864 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.864 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.864 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.864 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.864 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.864 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.864 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.864 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.864 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.864 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.865 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1f", 2024-03-30T12:21:59.865 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.865 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.865 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.865 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.865 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.865 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T14:45:00.775246+0000", 2024-03-30T12:21:59.865 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.865 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.865 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.865 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.865 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.865 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.866 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.866 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.866 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.866 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.866 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.866 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.866 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.866 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.866 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.866 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.866 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.867 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.867 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.867 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.867 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.867 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.867 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.867 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.867 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.867 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.867 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.867 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.867 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.867 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.867 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.867 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.868 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.868 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.868 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.868 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.868 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.868 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.868 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.868 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.868 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.868 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.868 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.868 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.868 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.868 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.868 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.869 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:59.869 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.869 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:59.869 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.869 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:21:59.869 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.869 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.869 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.869 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.869 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:59.869 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:59.869 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:59.869 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.869 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:21:59.870 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.870 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.870 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:59.870 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.870 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.870 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.870 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.472296+0000", 2024-03-30T12:21:59.870 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.469261+0000", 2024-03-30T12:21:59.870 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.469261+0000", 2024-03-30T12:21:59.870 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.469695+0000", 2024-03-30T12:21:59.870 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.472296+0000", 2024-03-30T12:21:59.870 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.870 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.870 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.870 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:59.871 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.472296+0000", 2024-03-30T12:21:59.871 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.472296+0000", 2024-03-30T12:21:59.871 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.472296+0000", 2024-03-30T12:21:59.871 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.871 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.871 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.871 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.472296+0000", 2024-03-30T12:21:59.871 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.472296+0000", 2024-03-30T12:21:59.871 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.871 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 2, 2024-03-30T12:21:59.871 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.871 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.871 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:59.871 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.871 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.872 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.872 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.872 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 2, 2024-03-30T12:21:59.872 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.872 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.872 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.872 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1d", 2024-03-30T12:21:59.872 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.872 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.872 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.872 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 21, 2024-03-30T12:21:59.872 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.872 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-04-01T00:02:43.407908+0000", 2024-03-30T12:21:59.872 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.873 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.873 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.873 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.873 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.873 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.873 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.873 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.873 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.873 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.873 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.873 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.873 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.873 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.873 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.873 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.873 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.874 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.874 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.874 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-03-30T12:21:59.874 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-03-30T12:21:59.874 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.874 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-03-30T12:21:59.874 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.874 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.874 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.874 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.874 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.874 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-03-30T12:21:59.874 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.874 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.875 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.875 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.875 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.875 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.875 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.875 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.875 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.875 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.875 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.875 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.875 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 3, 2024-03-30T12:21:59.875 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.875 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.875 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.875 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.876 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.876 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:59.876 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:59.876 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:59.876 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.876 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:21:59.876 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'2" 2024-03-30T12:21:59.876 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.876 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.876 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.876 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.876 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:59.876 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:59.876 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.876 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:59.876 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.877 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.877 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.877 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.877 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.877 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.877 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006676+0000", 2024-03-30T12:21:59.877 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.858880+0000", 2024-03-30T12:21:59.877 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.858880+0000", 2024-03-30T12:21:59.877 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.859422+0000", 2024-03-30T12:21:59.877 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006676+0000", 2024-03-30T12:21:59.877 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.877 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.877 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.877 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.877 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006676+0000", 2024-03-30T12:21:59.878 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006676+0000", 2024-03-30T12:21:59.878 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006676+0000", 2024-03-30T12:21:59.878 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.878 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.878 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.878 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006676+0000", 2024-03-30T12:21:59.878 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006676+0000", 2024-03-30T12:21:59.878 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.878 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.878 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.878 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.878 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.878 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.878 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.878 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.879 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.879 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.879 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.879 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.879 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.879 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1c", 2024-03-30T12:21:59.879 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.879 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.879 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.879 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.879 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.879 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T14:28:09.612172+0000", 2024-03-30T12:21:59.879 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.879 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.879 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.880 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.880 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.880 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.880 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.880 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.880 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.880 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.880 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.880 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.880 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.880 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.880 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.880 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.880 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.880 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.881 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.881 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.881 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.881 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.881 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.881 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.881 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.881 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.881 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.881 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.881 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.881 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.881 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.881 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.882 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.882 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.882 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.882 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.882 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.882 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.882 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.882 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.882 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.882 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.882 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.882 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.882 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.882 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.883 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.883 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.883 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:59.883 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:59.883 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.883 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:59.883 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.883 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.883 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.883 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.883 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:59.883 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.883 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:59.883 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.883 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:21:59.884 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.884 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.884 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:59.884 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.884 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.884 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.884 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.472360+0000", 2024-03-30T12:21:59.884 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.467636+0000", 2024-03-30T12:21:59.884 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.467636+0000", 2024-03-30T12:21:59.884 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.467935+0000", 2024-03-30T12:21:59.884 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.472360+0000", 2024-03-30T12:21:59.884 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.884 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.884 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.885 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:59.885 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.472360+0000", 2024-03-30T12:21:59.885 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.472360+0000", 2024-03-30T12:21:59.885 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.472360+0000", 2024-03-30T12:21:59.885 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.885 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.885 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.885 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.472360+0000", 2024-03-30T12:21:59.885 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.472360+0000", 2024-03-30T12:21:59.885 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.885 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 2, 2024-03-30T12:21:59.885 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.885 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.885 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:59.885 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.885 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.886 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.886 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.886 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 2, 2024-03-30T12:21:59.886 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.886 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.886 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.886 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1c", 2024-03-30T12:21:59.886 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.886 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.886 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.886 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 21, 2024-03-30T12:21:59.886 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.886 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T16:32:49.599855+0000", 2024-03-30T12:21:59.886 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.886 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.887 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.887 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.887 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.887 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.887 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.887 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.887 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.887 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.887 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.887 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.887 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.887 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.887 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.887 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.887 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.888 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.888 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.888 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-03-30T12:21:59.888 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-03-30T12:21:59.888 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.888 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-03-30T12:21:59.888 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.888 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.888 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.888 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.888 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.888 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-03-30T12:21:59.888 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.888 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.888 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.889 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.889 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.889 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.889 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.889 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.889 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.889 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.889 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.889 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.889 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 3, 2024-03-30T12:21:59.889 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.889 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.889 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.889 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.889 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.890 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:59.890 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.890 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:59.890 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.890 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:21:59.890 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'2" 2024-03-30T12:21:59.890 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.890 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.890 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.890 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.890 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:59.890 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:59.890 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.890 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:59.890 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.891 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.891 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.891 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.891 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.891 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.891 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.241872+0000", 2024-03-30T12:21:59.891 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:20:37.241084+0000", 2024-03-30T12:21:59.891 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:20:37.241084+0000", 2024-03-30T12:21:59.891 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:20:37.241472+0000", 2024-03-30T12:21:59.891 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.241872+0000", 2024-03-30T12:21:59.891 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.891 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.891 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.891 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 68, 2024-03-30T12:21:59.892 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.241872+0000", 2024-03-30T12:21:59.892 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.241872+0000", 2024-03-30T12:21:59.892 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.241872+0000", 2024-03-30T12:21:59.892 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.892 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.892 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.892 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.241872+0000", 2024-03-30T12:21:59.892 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.241872+0000", 2024-03-30T12:21:59.892 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.892 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.892 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.892 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.892 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 67, 2024-03-30T12:21:59.892 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.893 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.893 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.893 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.893 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.893 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.893 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.893 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.893 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1d", 2024-03-30T12:21:59.893 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.893 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.893 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.893 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 27, 2024-03-30T12:21:59.893 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.894 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T18:40:48.055427+0000", 2024-03-30T12:21:59.894 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.894 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.894 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.894 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.894 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.894 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.894 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.894 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.894 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.894 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.894 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.894 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.894 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.895 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.896 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.896 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.896 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.896 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.896 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.896 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.896 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.896 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.896 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.896 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.896 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.896 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.896 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.896 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.897 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.897 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.897 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.897 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.897 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.897 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.897 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:59.897 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:59.897 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.897 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:59.897 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.897 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.897 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.897 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.897 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:59.898 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:59.898 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:59.898 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.898 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:21:59.898 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.898 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.898 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:59.898 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.898 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.898 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.898 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.004033+0000", 2024-03-30T12:21:59.898 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.454213+0000", 2024-03-30T12:21:59.898 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.454213+0000", 2024-03-30T12:21:59.898 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.454521+0000", 2024-03-30T12:21:59.898 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.004033+0000", 2024-03-30T12:21:59.899 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.899 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.899 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.899 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:59.899 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.004033+0000", 2024-03-30T12:21:59.899 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.004033+0000", 2024-03-30T12:21:59.899 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.004033+0000", 2024-03-30T12:21:59.899 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.899 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.899 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.899 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.004033+0000", 2024-03-30T12:21:59.899 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.004033+0000", 2024-03-30T12:21:59.899 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.899 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 1, 2024-03-30T12:21:59.899 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.899 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.900 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:59.900 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.900 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.900 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.900 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.900 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 1, 2024-03-30T12:21:59.900 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.900 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.900 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.900 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1b", 2024-03-30T12:21:59.900 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.900 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.900 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.900 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 20, 2024-03-30T12:21:59.900 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.900 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T18:27:47.198072+0000", 2024-03-30T12:21:59.901 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.901 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.901 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.901 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.901 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.901 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.901 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.901 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.901 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.901 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.901 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.901 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.901 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.902 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.902 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.902 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.902 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.902 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.902 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.902 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.902 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.902 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.902 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.902 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.902 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.903 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.903 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.903 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.903 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.903 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.903 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.903 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.903 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.903 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.903 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.903 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.903 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.903 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.903 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.904 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.904 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.904 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.904 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.904 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.904 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.904 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.904 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.904 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:59.904 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:59.904 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:21:59.904 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.904 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:21:59.904 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'1" 2024-03-30T12:21:59.905 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.905 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.905 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.905 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:59.905 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:59.905 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:59.905 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.905 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-03-30T12:21:59.905 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.905 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.905 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.905 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.905 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.905 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.906 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.598367+0000", 2024-03-30T12:21:59.906 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.860427+0000", 2024-03-30T12:21:59.906 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.860427+0000", 2024-03-30T12:21:59.906 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.860724+0000", 2024-03-30T12:21:59.906 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.598367+0000", 2024-03-30T12:21:59.906 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.906 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.906 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.906 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.906 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.598367+0000", 2024-03-30T12:21:59.906 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.598367+0000", 2024-03-30T12:21:59.906 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.598367+0000", 2024-03-30T12:21:59.906 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.906 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.906 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.907 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.598367+0000", 2024-03-30T12:21:59.907 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.598367+0000", 2024-03-30T12:21:59.907 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.907 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.907 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.907 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.907 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.907 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.907 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.907 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.907 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.907 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.907 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.907 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.907 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.907 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1a", 2024-03-30T12:21:59.908 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.908 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.908 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.908 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.908 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.908 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T13:55:54.757770+0000", 2024-03-30T12:21:59.908 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.908 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.908 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.908 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.908 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.908 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.909 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.909 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.909 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.909 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.909 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.909 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.909 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.909 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.909 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.909 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.909 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.909 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.909 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.909 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.910 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.910 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.910 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.910 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.910 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.910 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.910 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.910 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.910 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.910 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.911 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.911 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.911 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.911 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.911 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.911 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.911 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.911 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.911 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.911 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.912 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.912 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.912 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.912 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.912 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.912 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.912 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.912 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:59.912 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:59.912 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:59.912 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.912 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-03-30T12:21:59.913 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.913 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.913 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.913 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.913 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:59.913 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:59.913 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:59.913 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.914 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:21:59.914 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.914 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.914 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:59.914 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.914 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.914 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.914 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.240452+0000", 2024-03-30T12:21:59.914 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.459740+0000", 2024-03-30T12:21:59.915 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.459740+0000", 2024-03-30T12:21:59.915 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.460150+0000", 2024-03-30T12:21:59.915 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.240452+0000", 2024-03-30T12:21:59.915 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.915 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.915 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.915 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:59.915 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.240452+0000", 2024-03-30T12:21:59.915 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.240452+0000", 2024-03-30T12:21:59.915 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.240452+0000", 2024-03-30T12:21:59.915 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.916 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.916 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.916 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.240452+0000", 2024-03-30T12:21:59.916 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.240452+0000", 2024-03-30T12:21:59.916 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.916 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 1, 2024-03-30T12:21:59.916 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.916 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.916 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:59.916 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.916 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.916 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.916 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.916 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 1, 2024-03-30T12:21:59.917 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.917 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.917 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.917 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1a", 2024-03-30T12:21:59.917 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.917 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.917 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.917 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 20, 2024-03-30T12:21:59.917 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.917 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T18:52:40.523467+0000", 2024-03-30T12:21:59.917 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.917 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.917 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.917 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.917 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.918 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.918 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.918 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.918 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.918 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.918 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.918 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.919 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.919 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.919 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.919 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.919 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.919 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.919 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.919 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.919 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.919 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.919 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.919 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.919 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.919 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.920 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.921 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.921 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.921 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.921 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.921 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.921 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.922 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.922 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:59.922 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:59.922 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:59.922 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.922 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:21:59.923 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'1" 2024-03-30T12:21:59.923 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.923 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.923 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.923 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:59.923 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:59.923 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:59.923 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.923 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:21:59.923 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.923 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.923 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.923 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.923 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.923 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.924 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.005836+0000", 2024-03-30T12:21:59.924 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.856652+0000", 2024-03-30T12:21:59.924 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.856652+0000", 2024-03-30T12:21:59.924 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.857403+0000", 2024-03-30T12:21:59.924 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.005836+0000", 2024-03-30T12:21:59.924 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.924 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.924 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.924 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.924 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.005836+0000", 2024-03-30T12:21:59.924 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.005836+0000", 2024-03-30T12:21:59.925 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.005836+0000", 2024-03-30T12:21:59.925 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.925 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.925 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.925 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.005836+0000", 2024-03-30T12:21:59.926 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.005836+0000", 2024-03-30T12:21:59.926 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.926 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.926 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.926 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.926 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.927 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.927 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.927 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.927 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.927 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.927 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.927 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.927 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.928 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1b", 2024-03-30T12:21:59.928 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.928 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.928 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.928 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.928 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.928 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T16:58:51.932935+0000", 2024-03-30T12:21:59.928 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.928 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.928 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.928 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.928 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.928 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.928 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.928 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.929 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.929 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.929 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.929 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.929 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.929 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.929 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.929 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.929 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.929 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.929 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.929 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.929 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.929 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.929 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.930 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.930 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.930 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.930 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.930 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.930 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.930 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.930 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.930 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.930 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.930 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.930 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.930 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.930 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.930 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.931 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.931 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.931 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.931 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.931 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.931 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.931 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.931 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.931 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.931 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:59.931 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:59.931 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:59.931 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.931 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:21:59.931 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.932 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.932 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.932 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.932 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:59.932 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:59.932 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:59.932 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.932 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:21:59.932 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.932 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.932 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:59.932 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.932 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.932 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.933 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.003877+0000", 2024-03-30T12:21:59.933 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.457947+0000", 2024-03-30T12:21:59.933 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.457947+0000", 2024-03-30T12:21:59.933 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.458253+0000", 2024-03-30T12:21:59.933 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.003877+0000", 2024-03-30T12:21:59.933 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.933 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.933 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.933 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:59.933 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.003877+0000", 2024-03-30T12:21:59.933 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.003877+0000", 2024-03-30T12:21:59.933 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.003877+0000", 2024-03-30T12:21:59.933 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.933 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.934 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.934 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.003877+0000", 2024-03-30T12:21:59.934 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.003877+0000", 2024-03-30T12:21:59.934 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.934 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.934 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.934 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.934 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:59.934 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.934 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.934 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.934 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.934 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.934 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.935 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.935 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.935 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.19", 2024-03-30T12:21:59.935 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.935 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.935 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.935 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:21:59.935 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.935 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T18:13:18.864198+0000", 2024-03-30T12:21:59.935 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.935 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.935 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.935 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.935 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.935 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.936 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.936 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.936 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.936 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.936 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.936 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.936 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.936 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.936 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.936 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.936 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.936 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.936 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.936 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.936 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.937 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.937 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.937 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.937 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.937 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.937 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.937 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.937 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.937 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.937 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.937 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.937 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.937 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.937 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.938 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.938 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.938 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.938 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.938 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.938 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.938 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.938 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.938 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.938 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.938 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.938 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.938 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:59.938 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:59.939 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:59.939 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.939 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:21:59.939 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.939 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.939 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.939 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.939 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:59.939 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:59.939 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:59.939 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.939 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:21:59.939 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.939 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.939 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.940 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.940 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.940 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.940 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.003676+0000", 2024-03-30T12:21:59.940 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.858922+0000", 2024-03-30T12:21:59.940 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.858922+0000", 2024-03-30T12:21:59.940 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.859188+0000", 2024-03-30T12:21:59.940 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.003676+0000", 2024-03-30T12:21:59.940 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.940 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.940 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.940 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.940 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.003676+0000", 2024-03-30T12:21:59.941 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.003676+0000", 2024-03-30T12:21:59.941 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.003676+0000", 2024-03-30T12:21:59.941 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.941 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.941 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.941 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.003676+0000", 2024-03-30T12:21:59.941 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.003676+0000", 2024-03-30T12:21:59.941 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.941 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.941 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.941 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.941 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.941 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.941 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.941 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.941 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.942 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.942 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.942 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.942 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.942 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.18", 2024-03-30T12:21:59.942 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.942 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.942 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.942 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.942 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.942 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T20:56:16.965191+0000", 2024-03-30T12:21:59.942 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.942 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.943 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.943 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.944 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.944 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.944 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.944 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.944 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.944 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.944 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.944 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.944 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.944 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.944 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.944 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.944 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.944 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.944 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.945 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.945 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.945 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.945 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.945 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.945 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.945 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.945 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.945 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.945 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.945 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.945 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.945 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.945 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.945 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:59.945 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:21:59.946 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:59.946 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.946 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:21:59.946 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.946 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.946 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.946 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.946 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.946 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:59.946 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:59.946 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.946 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:59.946 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.947 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.947 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:59.947 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.947 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.947 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.947 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006169+0000", 2024-03-30T12:21:59.947 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.466086+0000", 2024-03-30T12:21:59.947 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.466086+0000", 2024-03-30T12:21:59.947 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.466729+0000", 2024-03-30T12:21:59.947 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006169+0000", 2024-03-30T12:21:59.947 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.947 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.947 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.948 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:59.948 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006169+0000", 2024-03-30T12:21:59.948 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006169+0000", 2024-03-30T12:21:59.948 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006169+0000", 2024-03-30T12:21:59.948 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.948 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.948 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.948 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006169+0000", 2024-03-30T12:21:59.948 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006169+0000", 2024-03-30T12:21:59.948 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.948 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.948 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.948 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.949 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:59.949 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.949 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.949 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.949 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.949 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.949 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.949 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.949 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.949 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.18", 2024-03-30T12:21:59.949 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.949 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.949 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.949 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:21:59.949 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.950 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T21:46:14.144417+0000", 2024-03-30T12:21:59.950 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.950 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.950 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.950 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.950 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.950 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.950 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.950 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.950 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.950 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.950 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.950 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.950 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.951 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.951 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.951 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.951 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.951 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.951 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.951 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.951 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.951 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.952 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.952 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.952 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.952 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.952 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.952 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.952 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.953 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.953 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.953 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.953 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.953 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.953 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.953 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.953 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.953 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.953 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.953 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.953 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.953 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.953 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.954 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.954 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.954 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.954 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.954 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.954 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:21:59.954 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:21:59.954 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.954 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:59.954 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.954 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.954 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.954 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.954 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:59.955 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:59.955 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:59.955 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.955 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:21:59.955 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.955 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.955 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.955 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.955 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.955 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.955 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006172+0000", 2024-03-30T12:21:59.956 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.861328+0000", 2024-03-30T12:21:59.956 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.861328+0000", 2024-03-30T12:21:59.956 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.863262+0000", 2024-03-30T12:21:59.956 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006172+0000", 2024-03-30T12:21:59.956 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.956 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.956 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.956 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.956 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006172+0000", 2024-03-30T12:21:59.956 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006172+0000", 2024-03-30T12:21:59.956 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006172+0000", 2024-03-30T12:21:59.957 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.957 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.957 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.957 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006172+0000", 2024-03-30T12:21:59.957 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006172+0000", 2024-03-30T12:21:59.957 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.957 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.957 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.957 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.957 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.957 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.957 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.957 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.958 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.958 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.958 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.958 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.958 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.958 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.19", 2024-03-30T12:21:59.958 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.959 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.959 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.959 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.959 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.959 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T21:20:19.049967+0000", 2024-03-30T12:21:59.959 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.959 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.959 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.959 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.959 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.959 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.959 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.959 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.960 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.961 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.961 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.961 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.961 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.961 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.961 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.961 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.961 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.961 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.961 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.961 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.962 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.962 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.962 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.962 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.962 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.962 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.963 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.963 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.963 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.963 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.963 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.963 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.964 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.964 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:59.964 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:21:59.964 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:21:59.964 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.964 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:21:59.965 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.965 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.965 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.965 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.965 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:59.965 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.966 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:59.966 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.966 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:21:59.966 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.966 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.967 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:59.967 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.967 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.967 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.967 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.240642+0000", 2024-03-30T12:21:59.967 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.459518+0000", 2024-03-30T12:21:59.967 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.459518+0000", 2024-03-30T12:21:59.967 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.459929+0000", 2024-03-30T12:21:59.967 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.240642+0000", 2024-03-30T12:21:59.967 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.967 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.967 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.967 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:59.968 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.240642+0000", 2024-03-30T12:21:59.968 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.240642+0000", 2024-03-30T12:21:59.968 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.240642+0000", 2024-03-30T12:21:59.968 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.968 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.968 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.968 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.240642+0000", 2024-03-30T12:21:59.968 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.240642+0000", 2024-03-30T12:21:59.968 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.968 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.968 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.968 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.968 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:59.968 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.969 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.969 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.969 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.969 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.969 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.969 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.969 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.969 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.17", 2024-03-30T12:21:59.969 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.969 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.969 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.969 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:21:59.969 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.969 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T20:09:03.990119+0000", 2024-03-30T12:21:59.970 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.970 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.970 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.970 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.970 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.970 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.970 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.970 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.970 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.970 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.970 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.970 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.970 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.971 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.972 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.973 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.973 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.973 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.973 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.973 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.973 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.973 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.973 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:59.973 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.973 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:59.973 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.973 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:21:59.973 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.973 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.973 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.974 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.974 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.974 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:59.974 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:59.974 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.974 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:59.974 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.974 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.974 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.974 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.974 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.974 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.974 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006816+0000", 2024-03-30T12:21:59.975 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.861782+0000", 2024-03-30T12:21:59.975 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.861782+0000", 2024-03-30T12:21:59.975 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.862112+0000", 2024-03-30T12:21:59.975 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006816+0000", 2024-03-30T12:21:59.975 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.975 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.975 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.975 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:21:59.975 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006816+0000", 2024-03-30T12:21:59.975 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006816+0000", 2024-03-30T12:21:59.975 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006816+0000", 2024-03-30T12:21:59.975 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.975 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.975 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.975 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006816+0000", 2024-03-30T12:21:59.976 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006816+0000", 2024-03-30T12:21:59.976 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.976 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.976 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.976 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.976 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:21:59.976 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.976 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.976 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.976 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.976 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.976 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.976 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.976 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.977 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.16", 2024-03-30T12:21:59.977 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.977 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.977 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.977 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:21:59.977 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.977 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-04-01T00:01:42.946530+0000", 2024-03-30T12:21:59.977 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.977 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.977 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.977 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.977 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.977 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.977 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.977 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.978 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.978 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.978 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.978 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.978 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.978 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.978 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.978 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.979 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.980 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.980 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.980 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.980 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.980 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.980 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.980 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.980 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.980 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.981 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.981 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.981 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.981 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.981 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.981 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.981 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.981 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.981 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.981 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.981 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.981 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:21:59.982 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:21:59.982 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.982 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:59.982 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.982 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.982 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.982 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.982 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.982 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:59.982 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:59.982 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.982 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:21:59.982 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.982 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.983 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:59.983 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.983 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.983 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.983 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006757+0000", 2024-03-30T12:21:59.983 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.462698+0000", 2024-03-30T12:21:59.983 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.462698+0000", 2024-03-30T12:21:59.983 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.463745+0000", 2024-03-30T12:21:59.983 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006757+0000", 2024-03-30T12:21:59.983 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.983 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.983 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.983 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:21:59.983 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006757+0000", 2024-03-30T12:21:59.983 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006757+0000", 2024-03-30T12:21:59.984 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006757+0000", 2024-03-30T12:21:59.984 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.984 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.984 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:21:59.984 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006757+0000", 2024-03-30T12:21:59.984 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006757+0000", 2024-03-30T12:21:59.984 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.984 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.984 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.984 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.984 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:21:59.984 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.984 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.984 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.985 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.985 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.985 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.985 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.985 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.985 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.16", 2024-03-30T12:21:59.985 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.985 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.985 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.985 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:21:59.985 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.985 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T16:09:33.196928+0000", 2024-03-30T12:21:59.985 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.985 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.985 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.986 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.987 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.988 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.988 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.988 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.988 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.988 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.988 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.988 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.988 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.988 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.988 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.988 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.988 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.988 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.988 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.989 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.989 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.989 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.989 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:21:59.989 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:21:59.989 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.989 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:21:59.989 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.989 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.989 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.989 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.989 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:59.989 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.989 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:21:59.990 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.990 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-03-30T12:21:59.990 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.990 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.990 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:21:59.990 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.990 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.990 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.990 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.009497+0000", 2024-03-30T12:21:59.990 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:20:37.009140+0000", 2024-03-30T12:21:59.991 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:20:37.009140+0000", 2024-03-30T12:21:59.991 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:20:37.009497+0000", 2024-03-30T12:21:59.991 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.009497+0000", 2024-03-30T12:21:59.991 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.991 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:21:59.991 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.991 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 68, 2024-03-30T12:21:59.991 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.009497+0000", 2024-03-30T12:21:59.991 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.009497+0000", 2024-03-30T12:21:59.991 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.009497+0000", 2024-03-30T12:21:59.991 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:21:59.991 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:21:59.992 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:21:59.992 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.009497+0000", 2024-03-30T12:21:59.992 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.009497+0000", 2024-03-30T12:21:59.992 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:21:59.992 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:21:59.992 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:21:59.992 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:21:59.992 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 67, 2024-03-30T12:21:59.992 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:21:59.992 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:21:59.992 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:21:59.992 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:21:59.992 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:21:59.993 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:21:59.993 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:21:59.993 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:21:59.993 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.17", 2024-03-30T12:21:59.993 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:21:59.993 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:21:59.993 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:21:59.993 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 11, 2024-03-30T12:21:59.993 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:21:59.993 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:28:01.772821+0000", 2024-03-30T12:21:59.993 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:21:59.993 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:21:59.994 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:21:59.994 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:21:59.994 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:21:59.994 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:21:59.994 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:21:59.994 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:21:59.994 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:21:59.994 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:21:59.994 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:21:59.994 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:21:59.995 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:21:59.995 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:21:59.995 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:21:59.995 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:21:59.995 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:21:59.995 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:21:59.995 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:21:59.995 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:21:59.995 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:21:59.995 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:21:59.995 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:21:59.995 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:21:59.995 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:21:59.995 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:21:59.996 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:21:59.996 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:21:59.996 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:21:59.996 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:21:59.996 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:21:59.996 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:21:59.996 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:21:59.996 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:21:59.996 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:21:59.996 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:21:59.996 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:21:59.997 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:21:59.997 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:21:59.997 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:21:59.997 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:21:59.997 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:21:59.997 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:21:59.997 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.997 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:21:59.997 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:21:59.998 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:21:59.998 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:21:59.998 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.998 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:21:59.998 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.998 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-03-30T12:21:59.998 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:21:59.998 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:21:59.998 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:21:59.998 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:21:59.998 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:21:59.998 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:21:59.999 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:21:59.999 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:21:59.999 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:21:59.999 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:21:59.999 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:21:59.999 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:21:59.999 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:21:59.999 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:21:59.999 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:21:59.999 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006615+0000", 2024-03-30T12:21:59.999 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.463280+0000", 2024-03-30T12:21:59.999 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.463280+0000", 2024-03-30T12:21:59.999 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.463581+0000", 2024-03-30T12:21:59.999 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006615+0000", 2024-03-30T12:22:00.000 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.000 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.000 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.000 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:22:00.000 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006615+0000", 2024-03-30T12:22:00.000 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006615+0000", 2024-03-30T12:22:00.000 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006615+0000", 2024-03-30T12:22:00.000 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.000 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.000 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.000 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006615+0000", 2024-03-30T12:22:00.000 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006615+0000", 2024-03-30T12:22:00.000 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.000 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 3, 2024-03-30T12:22:00.001 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.001 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.001 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:22:00.001 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.001 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.001 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.001 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.001 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 3, 2024-03-30T12:22:00.001 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.001 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.001 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.001 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.15", 2024-03-30T12:22:00.001 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.001 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.001 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.002 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 22, 2024-03-30T12:22:00.002 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.002 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T12:38:07.390655+0000", 2024-03-30T12:22:00.002 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.002 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.002 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.002 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 90, 2024-03-30T12:22:00.002 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.002 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.002 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.002 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.002 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.002 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.002 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.003 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.003 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.003 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.003 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.003 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.003 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.003 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.003 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.003 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 6, 2024-03-30T12:22:00.003 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 2, 2024-03-30T12:22:00.003 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.003 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 2, 2024-03-30T12:22:00.003 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.003 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.003 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-03-30T12:22:00.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.004 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.005 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.005 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 4, 2024-03-30T12:22:00.005 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 1 2024-03-30T12:22:00.005 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.005 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.005 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.005 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.005 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.005 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.005 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:22:00.005 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.005 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:22:00.005 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'3" 2024-03-30T12:22:00.006 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.006 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.006 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.006 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.006 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.006 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:22:00.006 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.006 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-03-30T12:22:00.006 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.006 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.006 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.007 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.007 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.007 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.007 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.598950+0000", 2024-03-30T12:22:00.007 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.878229+0000", 2024-03-30T12:22:00.007 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.878229+0000", 2024-03-30T12:22:00.007 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.878541+0000", 2024-03-30T12:22:00.007 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.598950+0000", 2024-03-30T12:22:00.007 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.007 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.007 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.007 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.007 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.598950+0000", 2024-03-30T12:22:00.008 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.598950+0000", 2024-03-30T12:22:00.008 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.598950+0000", 2024-03-30T12:22:00.008 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.008 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.008 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.008 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.598950+0000", 2024-03-30T12:22:00.008 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.598950+0000", 2024-03-30T12:22:00.008 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.008 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.008 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.008 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.008 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.008 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.008 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.008 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.009 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.009 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.009 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.009 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.009 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.009 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.14", 2024-03-30T12:22:00.009 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.009 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.009 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.009 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.010 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.010 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T17:03:18.020146+0000", 2024-03-30T12:22:00.010 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.010 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.010 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.010 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.010 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.010 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.010 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.010 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.011 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.011 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.011 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.011 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.011 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.011 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.012 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.012 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.012 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.012 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.012 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.012 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.013 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.013 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.013 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.013 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.013 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.013 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.013 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.013 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.014 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.014 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.014 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.014 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.014 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.014 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.014 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.014 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.014 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.014 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.015 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.015 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.015 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.015 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.015 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.016 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.016 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.016 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.016 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.016 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.016 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.016 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:22:00.017 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.017 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-03-30T12:22:00.017 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.017 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.017 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.017 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.017 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:22:00.017 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.017 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:22:00.017 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.017 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:22:00.017 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.017 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.018 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:22:00.018 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.018 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.018 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:21:05.918478+0000", 2024-03-30T12:22:00.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.457759+0000", 2024-03-30T12:22:00.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.457759+0000", 2024-03-30T12:22:00.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.458102+0000", 2024-03-30T12:22:00.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:21:05.918478+0000", 2024-03-30T12:22:00.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.018 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.019 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:22:00.019 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:21:05.918478+0000", 2024-03-30T12:22:00.019 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:21:05.918478+0000", 2024-03-30T12:22:00.019 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:21:05.918478+0000", 2024-03-30T12:22:00.019 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.019 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.019 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.019 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:21:05.918478+0000", 2024-03-30T12:22:00.019 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:21:05.918478+0000", 2024-03-30T12:22:00.019 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.019 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 12, 2024-03-30T12:22:00.019 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.020 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.020 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:22:00.020 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.020 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.020 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.020 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.020 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 12, 2024-03-30T12:22:00.020 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.020 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.020 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.020 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.14", 2024-03-30T12:22:00.020 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.020 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.020 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.021 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 31, 2024-03-30T12:22:00.021 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.021 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T21:23:31.713303+0000", 2024-03-30T12:22:00.021 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.021 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.021 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 2632, 2024-03-30T12:22:00.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.021 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 12, 2024-03-30T12:22:00.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 4, 2024-03-30T12:22:00.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 4, 2024-03-30T12:22:00.022 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.023 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.023 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.023 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.023 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.023 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-03-30T12:22:00.023 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.023 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.023 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.023 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.023 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.023 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.023 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.023 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.023 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.023 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.023 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.024 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.024 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 12, 2024-03-30T12:22:00.024 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 9 2024-03-30T12:22:00.024 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.024 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.024 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.024 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.024 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:22:00.024 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.024 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:22:00.024 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.024 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:22:00.024 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "68'12" 2024-03-30T12:22:00.024 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.025 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.025 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.025 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.025 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.025 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:22:00.025 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.025 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:22:00.025 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.025 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.025 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.025 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.025 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.025 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.025 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.472078+0000", 2024-03-30T12:22:00.025 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.872085+0000", 2024-03-30T12:22:00.026 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.872085+0000", 2024-03-30T12:22:00.026 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.872384+0000", 2024-03-30T12:22:00.026 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.472078+0000", 2024-03-30T12:22:00.026 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.026 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.026 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.026 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.026 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.472078+0000", 2024-03-30T12:22:00.026 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.472078+0000", 2024-03-30T12:22:00.026 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.472078+0000", 2024-03-30T12:22:00.026 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.026 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.027 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.027 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.472078+0000", 2024-03-30T12:22:00.027 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.472078+0000", 2024-03-30T12:22:00.027 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.027 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.027 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.027 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.027 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.027 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.027 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.027 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.027 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.027 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.027 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.027 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.028 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.028 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.15", 2024-03-30T12:22:00.028 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.028 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.028 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.028 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.028 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.028 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T22:47:42.278500+0000", 2024-03-30T12:22:00.028 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.028 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.028 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.028 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.029 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.030 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.030 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.030 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.030 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.030 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.030 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.030 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.030 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.030 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.030 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.030 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.030 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.031 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.031 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.031 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.031 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.031 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.031 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.031 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.031 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.031 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.031 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.031 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.031 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.032 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.032 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.032 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.032 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.032 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.032 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:22:00.032 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.032 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:22:00.032 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.032 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.032 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.033 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.033 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.033 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.033 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:22:00.033 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.033 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:22:00.033 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.033 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.033 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:22:00.033 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.033 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.033 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.033 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006065+0000", 2024-03-30T12:22:00.033 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.462637+0000", 2024-03-30T12:22:00.033 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.462637+0000", 2024-03-30T12:22:00.034 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.462939+0000", 2024-03-30T12:22:00.034 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006065+0000", 2024-03-30T12:22:00.034 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.034 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.034 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.034 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:22:00.034 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006065+0000", 2024-03-30T12:22:00.034 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006065+0000", 2024-03-30T12:22:00.034 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006065+0000", 2024-03-30T12:22:00.034 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.034 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.034 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.034 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006065+0000", 2024-03-30T12:22:00.035 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006065+0000", 2024-03-30T12:22:00.035 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.035 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 2, 2024-03-30T12:22:00.035 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.035 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.035 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:22:00.035 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.035 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.035 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.035 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.035 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 2, 2024-03-30T12:22:00.035 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.035 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.035 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.036 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.13", 2024-03-30T12:22:00.036 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.036 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.036 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.036 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 21, 2024-03-30T12:22:00.036 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.036 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T16:48:59.027106+0000", 2024-03-30T12:22:00.036 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.036 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.036 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 34, 2024-03-30T12:22:00.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.036 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.037 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.037 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.037 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.037 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.037 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.037 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.037 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.037 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.037 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.037 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.037 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.037 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 6, 2024-03-30T12:22:00.037 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 2, 2024-03-30T12:22:00.038 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.038 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 2, 2024-03-30T12:22:00.038 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.038 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.038 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.038 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.038 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.038 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-03-30T12:22:00.038 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.038 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.038 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.038 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.038 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.038 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.039 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.039 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.039 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.039 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.039 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.039 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.039 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 3, 2024-03-30T12:22:00.039 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 7 2024-03-30T12:22:00.039 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.039 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.039 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.039 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.039 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.040 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.040 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:22:00.040 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.040 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:22:00.040 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'2" 2024-03-30T12:22:00.040 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.040 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.040 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.040 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.040 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.040 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:22:00.040 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.040 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:22:00.040 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.041 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.041 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.041 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.041 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.041 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.041 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.005712+0000", 2024-03-30T12:22:00.041 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.856544+0000", 2024-03-30T12:22:00.041 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.856544+0000", 2024-03-30T12:22:00.041 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.856865+0000", 2024-03-30T12:22:00.041 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.005712+0000", 2024-03-30T12:22:00.041 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.041 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.041 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.041 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.042 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.005712+0000", 2024-03-30T12:22:00.042 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.005712+0000", 2024-03-30T12:22:00.042 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.005712+0000", 2024-03-30T12:22:00.042 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.042 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.042 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.042 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.005712+0000", 2024-03-30T12:22:00.042 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.005712+0000", 2024-03-30T12:22:00.042 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.042 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.042 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.042 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.043 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.043 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.043 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.043 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.043 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.043 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.043 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.043 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.043 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.043 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.12", 2024-03-30T12:22:00.043 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.043 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.043 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.043 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.044 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.044 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T14:37:39.901012+0000", 2024-03-30T12:22:00.044 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.044 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.044 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.044 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.044 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.044 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.044 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.044 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.044 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.044 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.044 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.044 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.044 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.044 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.045 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.045 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.045 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.045 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.045 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.045 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.045 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.045 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.045 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.045 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.045 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.045 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.045 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.045 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.045 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.046 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.046 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.046 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.046 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.046 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.046 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.046 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.046 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.046 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.046 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.046 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.047 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.047 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.047 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.047 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.047 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.047 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.047 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.047 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.047 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.047 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:22:00.047 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.047 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:22:00.047 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.048 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.048 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.048 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.048 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.048 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.048 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:22:00.048 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.048 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:22:00.048 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.048 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.048 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:22:00.048 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.049 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.049 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.049 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006324+0000", 2024-03-30T12:22:00.049 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.465589+0000", 2024-03-30T12:22:00.049 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.465589+0000", 2024-03-30T12:22:00.049 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.465931+0000", 2024-03-30T12:22:00.049 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006324+0000", 2024-03-30T12:22:00.049 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.049 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.049 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.049 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:22:00.049 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006324+0000", 2024-03-30T12:22:00.049 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006324+0000", 2024-03-30T12:22:00.050 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006324+0000", 2024-03-30T12:22:00.050 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.050 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.050 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.050 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006324+0000", 2024-03-30T12:22:00.050 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006324+0000", 2024-03-30T12:22:00.051 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.051 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.051 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.051 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.051 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:22:00.051 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.052 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.052 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.052 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.052 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.052 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.052 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.053 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.053 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.12", 2024-03-30T12:22:00.053 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.053 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.053 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.053 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:22:00.053 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.053 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T18:02:38.614924+0000", 2024-03-30T12:22:00.053 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.054 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.054 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.054 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.054 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.054 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.054 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.054 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.054 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.054 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.054 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.054 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.054 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.054 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.055 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.056 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.057 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.057 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.057 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.057 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.057 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.057 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.057 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.057 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.057 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:22:00.057 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.057 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:22:00.057 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.057 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.057 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.058 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.058 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.058 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.058 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:22:00.058 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.058 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:22:00.058 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.058 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.058 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.058 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.059 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.059 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.472088+0000", 2024-03-30T12:22:00.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.870507+0000", 2024-03-30T12:22:00.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.870507+0000", 2024-03-30T12:22:00.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.870798+0000", 2024-03-30T12:22:00.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.472088+0000", 2024-03-30T12:22:00.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.472088+0000", 2024-03-30T12:22:00.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.472088+0000", 2024-03-30T12:22:00.059 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.472088+0000", 2024-03-30T12:22:00.060 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.060 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.060 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.060 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.472088+0000", 2024-03-30T12:22:00.060 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.472088+0000", 2024-03-30T12:22:00.060 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.060 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.060 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.060 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.060 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.060 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.060 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.060 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.061 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.061 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.061 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.061 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.061 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.061 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.13", 2024-03-30T12:22:00.061 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.061 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.061 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.061 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.061 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.061 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T18:25:30.259298+0000", 2024-03-30T12:22:00.061 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.061 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.062 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.062 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.063 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.064 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.065 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.065 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.065 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.065 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.065 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.065 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.065 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.065 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.065 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.065 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.065 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:22:00.065 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.065 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:22:00.066 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.066 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.066 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.066 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.066 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:22:00.066 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.066 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:22:00.066 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.066 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:22:00.066 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.066 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.066 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:22:00.066 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.067 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.067 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.240323+0000", 2024-03-30T12:22:00.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.454380+0000", 2024-03-30T12:22:00.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.454380+0000", 2024-03-30T12:22:00.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.454678+0000", 2024-03-30T12:22:00.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.240323+0000", 2024-03-30T12:22:00.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:22:00.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.240323+0000", 2024-03-30T12:22:00.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.240323+0000", 2024-03-30T12:22:00.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.240323+0000", 2024-03-30T12:22:00.067 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.068 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.068 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.068 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.240323+0000", 2024-03-30T12:22:00.068 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.240323+0000", 2024-03-30T12:22:00.068 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.068 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.068 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.068 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.068 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:22:00.068 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.068 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.068 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.068 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.068 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.068 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.068 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.069 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.069 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.11", 2024-03-30T12:22:00.069 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.069 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.069 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.069 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:22:00.069 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.069 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:08:24.640327+0000", 2024-03-30T12:22:00.069 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.069 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.069 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.069 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.070 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.071 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.072 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.072 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.072 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.072 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.072 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.072 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.072 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.072 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.072 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.072 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.072 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.072 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.072 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.072 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:22:00.073 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.073 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:22:00.073 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.073 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:22:00.073 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.073 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.073 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.073 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.073 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:22:00.073 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.073 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:22:00.073 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.073 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:22:00.073 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.073 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.073 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.074 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.074 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.074 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.074 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.240133+0000", 2024-03-30T12:22:00.074 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.861268+0000", 2024-03-30T12:22:00.074 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.861268+0000", 2024-03-30T12:22:00.074 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.861547+0000", 2024-03-30T12:22:00.074 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.240133+0000", 2024-03-30T12:22:00.074 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.074 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.074 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.074 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.074 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.240133+0000", 2024-03-30T12:22:00.075 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.240133+0000", 2024-03-30T12:22:00.075 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.240133+0000", 2024-03-30T12:22:00.075 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.075 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.075 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.075 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.240133+0000", 2024-03-30T12:22:00.075 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.240133+0000", 2024-03-30T12:22:00.075 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.075 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.075 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.075 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.075 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.075 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.075 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.076 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.076 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.076 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.076 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.076 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.076 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.076 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.10", 2024-03-30T12:22:00.076 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.076 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.076 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.076 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.076 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.076 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T13:28:37.342309+0000", 2024-03-30T12:22:00.076 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.076 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.077 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.077 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.078 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.079 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.079 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.079 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.079 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.079 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.079 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.079 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.079 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.079 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.079 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.079 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.079 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.080 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.080 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.080 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.080 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.080 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:22:00.080 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.080 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:22:00.080 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.080 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:22:00.080 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.080 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.080 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.080 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.080 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:22:00.080 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.080 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:22:00.081 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.081 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-03-30T12:22:00.081 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.081 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.081 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:22:00.081 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.081 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.081 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.081 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006152+0000", 2024-03-30T12:22:00.081 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.459790+0000", 2024-03-30T12:22:00.081 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.459790+0000", 2024-03-30T12:22:00.081 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.460090+0000", 2024-03-30T12:22:00.081 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006152+0000", 2024-03-30T12:22:00.081 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.082 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.082 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.082 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:22:00.082 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006152+0000", 2024-03-30T12:22:00.082 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006152+0000", 2024-03-30T12:22:00.082 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006152+0000", 2024-03-30T12:22:00.082 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.082 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.082 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.082 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006152+0000", 2024-03-30T12:22:00.082 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006152+0000", 2024-03-30T12:22:00.082 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.082 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 8, 2024-03-30T12:22:00.083 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.083 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.083 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:22:00.083 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.083 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.083 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.083 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.083 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 8, 2024-03-30T12:22:00.083 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.083 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.083 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.083 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.10", 2024-03-30T12:22:00.083 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.083 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.083 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.084 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 27, 2024-03-30T12:22:00.084 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.084 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T20:57:38.860631+0000", 2024-03-30T12:22:00.084 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.084 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.084 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.084 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 12, 2024-03-30T12:22:00.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 4, 2024-03-30T12:22:00.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.085 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 4, 2024-03-30T12:22:00.086 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.086 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.086 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.086 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.086 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.086 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 4, 2024-03-30T12:22:00.086 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.086 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.086 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.086 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.086 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.086 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.086 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.086 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.087 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.087 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.087 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.087 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.087 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 12, 2024-03-30T12:22:00.087 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.087 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.087 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.087 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.087 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.087 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:22:00.087 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.087 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:22:00.087 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.087 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-03-30T12:22:00.088 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'8" 2024-03-30T12:22:00.088 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.088 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.088 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.088 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.088 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.088 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:22:00.088 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.088 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:22:00.088 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.088 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.088 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.088 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.088 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.089 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.089 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.471853+0000", 2024-03-30T12:22:00.089 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.869750+0000", 2024-03-30T12:22:00.089 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.869750+0000", 2024-03-30T12:22:00.089 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.870061+0000", 2024-03-30T12:22:00.089 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.471853+0000", 2024-03-30T12:22:00.089 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.089 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.089 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.089 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.089 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.471853+0000", 2024-03-30T12:22:00.089 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.471853+0000", 2024-03-30T12:22:00.089 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.471853+0000", 2024-03-30T12:22:00.089 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.089 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.089 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.090 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.471853+0000", 2024-03-30T12:22:00.090 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.471853+0000", 2024-03-30T12:22:00.090 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.090 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.090 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.090 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.090 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.090 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.090 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.090 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.090 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.090 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.090 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.090 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.091 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.091 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.11", 2024-03-30T12:22:00.091 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.091 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.091 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.091 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.091 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.091 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T19:03:02.790151+0000", 2024-03-30T12:22:00.091 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.091 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.091 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.091 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.092 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.093 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.094 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.094 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.094 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.094 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.094 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.094 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.094 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.094 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.094 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.094 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.094 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.094 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.094 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.095 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.095 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.095 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:22:00.095 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.095 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:22:00.095 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.095 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.095 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.095 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.095 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.095 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.095 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:22:00.095 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.096 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-03-30T12:22:00.096 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.096 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.096 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:22:00.096 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.096 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.096 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.096 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.599069+0000", 2024-03-30T12:22:00.096 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.460817+0000", 2024-03-30T12:22:00.096 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.460817+0000", 2024-03-30T12:22:00.096 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.461178+0000", 2024-03-30T12:22:00.096 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.599069+0000", 2024-03-30T12:22:00.096 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.096 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.096 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.097 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:22:00.097 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.599069+0000", 2024-03-30T12:22:00.097 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.599069+0000", 2024-03-30T12:22:00.097 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.599069+0000", 2024-03-30T12:22:00.097 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.097 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.097 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.097 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.599069+0000", 2024-03-30T12:22:00.097 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.599069+0000", 2024-03-30T12:22:00.097 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.097 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 1, 2024-03-30T12:22:00.098 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.098 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.098 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:22:00.098 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.098 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.098 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.098 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.098 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 1, 2024-03-30T12:22:00.098 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.098 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.098 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.098 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.f", 2024-03-30T12:22:00.098 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.098 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.099 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.099 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 20, 2024-03-30T12:22:00.099 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.099 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T16:30:59.255694+0000", 2024-03-30T12:22:00.099 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.099 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.099 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.099 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 22, 2024-03-30T12:22:00.099 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.099 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.099 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.099 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.099 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.099 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.099 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.099 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-03-30T12:22:00.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-03-30T12:22:00.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-03-30T12:22:00.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.100 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.101 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.102 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 1, 2024-03-30T12:22:00.102 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 1 2024-03-30T12:22:00.102 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.102 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.102 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.102 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.102 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.102 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.102 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:22:00.102 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.102 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-03-30T12:22:00.102 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'1" 2024-03-30T12:22:00.102 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.102 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.103 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.103 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.103 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.103 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:22:00.103 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.103 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:22:00.103 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.103 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.103 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.103 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.103 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.103 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.103 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.472261+0000", 2024-03-30T12:22:00.103 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.871555+0000", 2024-03-30T12:22:00.103 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.871555+0000", 2024-03-30T12:22:00.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.871828+0000", 2024-03-30T12:22:00.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.472261+0000", 2024-03-30T12:22:00.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.472261+0000", 2024-03-30T12:22:00.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.472261+0000", 2024-03-30T12:22:00.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.472261+0000", 2024-03-30T12:22:00.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.472261+0000", 2024-03-30T12:22:00.104 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.472261+0000", 2024-03-30T12:22:00.105 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.105 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.105 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.105 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.105 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.105 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.105 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.105 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.105 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.105 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.105 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.105 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.105 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.105 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.e", 2024-03-30T12:22:00.105 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.106 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.106 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.106 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.106 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.106 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T20:02:53.212521+0000", 2024-03-30T12:22:00.106 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.106 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.106 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.106 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.106 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.106 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.106 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.106 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.106 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.107 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.108 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.109 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.109 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.109 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.109 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.109 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.109 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.109 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.109 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.109 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.109 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.109 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:22:00.109 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.109 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:22:00.110 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.110 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.110 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.110 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.110 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.110 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.110 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:22:00.110 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.110 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:22:00.110 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.110 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.110 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 63, 2024-03-30T12:22:00.110 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.110 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.111 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006441+0000", 2024-03-30T12:22:00.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:35.161426+0000", 2024-03-30T12:22:00.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:35.161426+0000", 2024-03-30T12:22:00.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:35.161648+0000", 2024-03-30T12:22:00.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006441+0000", 2024-03-30T12:22:00.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:22:00.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:22:00.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 64, 2024-03-30T12:22:00.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006441+0000", 2024-03-30T12:22:00.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006441+0000", 2024-03-30T12:22:00.111 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006441+0000", 2024-03-30T12:22:00.112 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.112 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.112 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:22:00.112 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006441+0000", 2024-03-30T12:22:00.112 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006441+0000", 2024-03-30T12:22:00.112 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.112 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.112 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.112 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.112 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 63, 2024-03-30T12:22:00.112 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.112 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.112 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.112 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.112 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.113 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.113 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.113 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.113 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.2", 2024-03-30T12:22:00.113 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.113 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.113 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.113 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-03-30T12:22:00.113 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.113 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:05:56.726860+0000", 2024-03-30T12:22:00.113 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.113 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.113 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.113 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.114 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.115 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.116 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.116 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.116 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.116 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.116 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.116 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.116 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.116 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.117 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.117 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.117 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.117 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.117 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.117 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.117 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.117 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.117 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.118 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.118 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:22:00.118 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.118 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:22:00.118 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.118 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.118 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.118 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.118 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.118 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.118 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:22:00.118 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.118 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:22:00.119 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.119 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.119 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:22:00.119 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.119 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.119 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.119 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006346+0000", 2024-03-30T12:22:00.119 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.462429+0000", 2024-03-30T12:22:00.119 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.462429+0000", 2024-03-30T12:22:00.119 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.462709+0000", 2024-03-30T12:22:00.119 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006346+0000", 2024-03-30T12:22:00.119 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.119 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.120 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.120 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:22:00.120 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006346+0000", 2024-03-30T12:22:00.120 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006346+0000", 2024-03-30T12:22:00.120 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006346+0000", 2024-03-30T12:22:00.120 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.120 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.120 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.120 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006346+0000", 2024-03-30T12:22:00.120 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006346+0000", 2024-03-30T12:22:00.120 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.120 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.120 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.121 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.121 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:22:00.121 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.121 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.121 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.121 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.121 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.121 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.121 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.121 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.121 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.4", 2024-03-30T12:22:00.121 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.121 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.121 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.121 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:22:00.122 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.122 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T19:16:29.579526+0000", 2024-03-30T12:22:00.122 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.122 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.122 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.122 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.123 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.123 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.123 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.123 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.123 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.123 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.123 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.123 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.123 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.123 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.123 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.123 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.123 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.123 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.123 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.124 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.124 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.124 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.124 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.124 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.124 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.124 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.124 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.124 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.124 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.124 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.124 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.124 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.124 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.124 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.125 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.125 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.125 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.125 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.125 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.125 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.125 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.125 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.125 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:22:00.125 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.125 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:22:00.125 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.125 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.125 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.125 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.126 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.126 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.126 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:22:00.126 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.126 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:22:00.126 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.126 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.126 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.126 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.126 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.126 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.126 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006614+0000", 2024-03-30T12:22:00.127 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.853714+0000", 2024-03-30T12:22:00.127 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.853714+0000", 2024-03-30T12:22:00.127 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.854025+0000", 2024-03-30T12:22:00.127 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006614+0000", 2024-03-30T12:22:00.127 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.127 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.127 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.127 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.127 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006614+0000", 2024-03-30T12:22:00.127 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006614+0000", 2024-03-30T12:22:00.127 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006614+0000", 2024-03-30T12:22:00.127 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.127 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.127 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.128 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006614+0000", 2024-03-30T12:22:00.128 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006614+0000", 2024-03-30T12:22:00.128 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.128 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.128 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.128 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.128 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.129 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.129 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.129 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.129 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.129 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.129 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.129 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.129 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.129 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.5", 2024-03-30T12:22:00.129 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.129 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.129 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.130 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.130 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.130 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T22:27:34.498087+0000", 2024-03-30T12:22:00.130 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.130 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.130 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.130 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.130 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.130 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.130 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.130 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.130 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.130 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.130 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.131 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.131 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.131 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.131 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.131 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.131 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.131 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.131 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.131 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.131 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.131 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.131 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.131 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.131 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.131 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.132 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.132 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.132 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.132 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.132 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.132 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.132 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.132 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.132 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.132 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.132 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.132 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.133 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.133 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.133 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.133 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.133 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.133 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.133 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.133 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.133 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.133 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.133 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.133 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:22:00.133 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.134 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:22:00.134 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.134 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.134 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.134 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.134 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.134 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:22:00.134 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:22:00.134 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.134 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:22:00.134 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.134 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.134 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 63, 2024-03-30T12:22:00.135 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.135 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.135 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.135 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006469+0000", 2024-03-30T12:22:00.135 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:35.050880+0000", 2024-03-30T12:22:00.135 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:35.050880+0000", 2024-03-30T12:22:00.135 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:35.051431+0000", 2024-03-30T12:22:00.135 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006469+0000", 2024-03-30T12:22:00.135 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:22:00.135 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.135 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:22:00.135 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 64, 2024-03-30T12:22:00.135 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006469+0000", 2024-03-30T12:22:00.136 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006469+0000", 2024-03-30T12:22:00.136 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006469+0000", 2024-03-30T12:22:00.136 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.136 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.136 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:22:00.136 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006469+0000", 2024-03-30T12:22:00.136 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006469+0000", 2024-03-30T12:22:00.136 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.136 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.136 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.136 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.136 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 63, 2024-03-30T12:22:00.136 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.136 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.136 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.137 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.137 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.137 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.137 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.137 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.137 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.4", 2024-03-30T12:22:00.137 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.137 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.137 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.137 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-03-30T12:22:00.137 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.137 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T22:57:58.075785+0000", 2024-03-30T12:22:00.137 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.137 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.138 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.138 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.138 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.138 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.138 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.138 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.138 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.138 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.138 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.138 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.138 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.138 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.138 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.138 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.139 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.139 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.139 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.139 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.139 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.139 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.139 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.139 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.139 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.139 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.139 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.139 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.139 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.139 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.139 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.139 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.140 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.140 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.140 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.140 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.141 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.141 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.141 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:22:00.141 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:22:00.141 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.141 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:22:00.141 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.141 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.141 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.141 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.142 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.142 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.142 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:22:00.142 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.142 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:22:00.142 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.143 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.143 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:22:00.143 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.143 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.143 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.143 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006213+0000", 2024-03-30T12:22:00.143 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.457289+0000", 2024-03-30T12:22:00.143 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.457289+0000", 2024-03-30T12:22:00.144 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.457612+0000", 2024-03-30T12:22:00.144 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006213+0000", 2024-03-30T12:22:00.144 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.144 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.144 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.144 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:22:00.144 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006213+0000", 2024-03-30T12:22:00.144 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006213+0000", 2024-03-30T12:22:00.144 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006213+0000", 2024-03-30T12:22:00.144 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006213+0000", 2024-03-30T12:22:00.145 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006213+0000", 2024-03-30T12:22:00.145 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.145 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.145 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.145 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.145 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:22:00.145 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.145 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.145 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.145 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.146 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.146 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.146 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.146 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.146 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.2", 2024-03-30T12:22:00.146 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.146 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.146 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.146 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:22:00.146 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.146 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T15:16:23.011997+0000", 2024-03-30T12:22:00.146 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.146 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.147 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.147 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.148 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.149 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.150 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.150 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.150 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.150 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.150 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.150 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.150 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.150 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.150 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.150 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.150 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.150 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:22:00.150 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.151 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:22:00.151 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.151 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.151 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.151 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.151 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.151 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.151 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:22:00.151 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.151 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-03-30T12:22:00.151 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.151 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.151 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.151 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.152 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.152 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.598734+0000", 2024-03-30T12:22:00.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.865706+0000", 2024-03-30T12:22:00.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.865706+0000", 2024-03-30T12:22:00.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.866070+0000", 2024-03-30T12:22:00.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.598734+0000", 2024-03-30T12:22:00.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.152 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.598734+0000", 2024-03-30T12:22:00.153 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.598734+0000", 2024-03-30T12:22:00.153 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.598734+0000", 2024-03-30T12:22:00.153 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.153 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.153 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.153 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.598734+0000", 2024-03-30T12:22:00.153 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.598734+0000", 2024-03-30T12:22:00.153 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.153 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.153 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.154 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.154 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.154 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.154 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.154 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.154 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.154 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.154 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.154 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.154 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.154 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.3", 2024-03-30T12:22:00.154 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.155 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.155 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.155 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.155 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.155 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T16:56:01.599580+0000", 2024-03-30T12:22:00.155 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.155 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.155 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.155 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.156 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.157 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.157 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.157 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.157 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.157 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.157 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.157 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.157 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.157 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.157 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.157 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.157 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.157 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.157 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.158 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.158 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.158 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.158 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.158 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.158 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.158 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.158 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.158 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.158 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.158 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.158 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.158 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.159 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.159 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.159 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:22:00.159 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.159 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-03-30T12:22:00.159 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.159 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.159 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.159 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.160 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.160 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.160 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:22:00.160 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.160 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:22:00.160 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.160 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.160 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 63, 2024-03-30T12:22:00.160 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.160 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.160 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.160 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.005840+0000", 2024-03-30T12:22:00.160 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:35.162389+0000", 2024-03-30T12:22:00.160 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:35.162389+0000", 2024-03-30T12:22:00.161 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:35.162695+0000", 2024-03-30T12:22:00.161 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.005840+0000", 2024-03-30T12:22:00.161 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:22:00.161 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.161 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:22:00.161 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 64, 2024-03-30T12:22:00.161 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.005840+0000", 2024-03-30T12:22:00.161 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.005840+0000", 2024-03-30T12:22:00.161 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.005840+0000", 2024-03-30T12:22:00.161 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.161 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.161 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:22:00.161 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.005840+0000", 2024-03-30T12:22:00.161 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.005840+0000", 2024-03-30T12:22:00.161 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.162 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.162 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.162 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.162 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 63, 2024-03-30T12:22:00.162 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.162 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.162 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.162 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.162 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.162 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.162 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.163 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.163 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.7", 2024-03-30T12:22:00.163 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.163 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.163 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.163 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-03-30T12:22:00.163 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.163 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T19:20:43.739417+0000", 2024-03-30T12:22:00.163 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.163 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.163 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.163 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.164 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.164 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.164 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.164 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.164 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.164 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.164 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.164 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.164 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.164 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.164 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.164 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.164 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.164 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.165 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.165 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.165 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.165 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.165 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.165 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.165 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.165 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.165 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.165 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.166 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.166 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.166 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.166 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.166 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.166 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.166 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.166 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.166 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.166 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.166 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.166 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.166 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.167 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.167 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.167 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.167 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.167 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.167 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.167 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.167 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:22:00.167 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.167 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:22:00.167 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.168 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.168 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.168 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.168 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.168 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:22:00.168 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:22:00.168 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.168 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:22:00.168 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.168 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.168 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.168 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.168 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.169 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.169 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.005687+0000", 2024-03-30T12:22:00.169 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.860645+0000", 2024-03-30T12:22:00.169 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.860645+0000", 2024-03-30T12:22:00.169 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.861917+0000", 2024-03-30T12:22:00.169 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.005687+0000", 2024-03-30T12:22:00.169 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.169 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.169 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.169 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.169 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.005687+0000", 2024-03-30T12:22:00.169 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.005687+0000", 2024-03-30T12:22:00.169 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.005687+0000", 2024-03-30T12:22:00.169 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.170 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.170 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.170 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.005687+0000", 2024-03-30T12:22:00.170 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.005687+0000", 2024-03-30T12:22:00.170 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.170 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.170 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.170 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.170 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.170 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.170 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.170 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.170 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.170 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.171 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.171 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.171 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.171 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.0", 2024-03-30T12:22:00.171 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.171 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.171 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.171 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.171 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.171 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T15:30:51.438018+0000", 2024-03-30T12:22:00.171 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.171 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.171 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.172 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.172 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.172 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.172 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.172 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.172 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.172 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.172 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.172 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.172 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.172 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.172 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.172 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.172 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.173 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.173 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.173 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.173 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.173 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.173 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.173 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.173 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.173 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.173 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.173 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.173 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.173 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.173 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.174 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.174 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.174 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.175 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.175 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.175 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.175 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:22:00.175 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:22:00.175 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.175 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:22:00.175 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.175 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.175 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.175 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.175 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:22:00.175 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.176 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:22:00.176 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.176 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-03-30T12:22:00.176 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.176 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.176 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:22:00.176 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.176 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.176 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.176 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.007628+0000", 2024-03-30T12:22:00.176 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.457819+0000", 2024-03-30T12:22:00.176 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.457819+0000", 2024-03-30T12:22:00.176 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.459145+0000", 2024-03-30T12:22:00.176 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.007628+0000", 2024-03-30T12:22:00.177 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.177 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.177 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.177 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:22:00.177 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.007628+0000", 2024-03-30T12:22:00.177 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.007628+0000", 2024-03-30T12:22:00.177 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.007628+0000", 2024-03-30T12:22:00.177 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.177 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.177 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.177 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.007628+0000", 2024-03-30T12:22:00.177 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.007628+0000", 2024-03-30T12:22:00.177 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.177 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.178 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.178 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.178 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:22:00.178 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.178 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.178 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.178 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.178 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.178 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.178 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.178 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.178 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.1", 2024-03-30T12:22:00.178 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.179 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.179 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.179 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:22:00.179 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.179 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T17:44:38.245366+0000", 2024-03-30T12:22:00.179 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.179 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.179 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.179 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.179 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.179 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.179 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.179 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.179 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.179 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.180 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.180 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.180 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.180 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.180 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.180 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.180 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.180 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.180 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.181 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.182 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.182 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.182 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.182 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.183 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.183 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:22:00.183 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.183 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:22:00.183 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.183 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-03-30T12:22:00.183 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.183 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.183 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.183 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.183 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:22:00.183 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.184 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:22:00.184 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.184 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:22:00.184 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.184 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.184 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 63, 2024-03-30T12:22:00.184 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.184 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.184 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.184 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.240291+0000", 2024-03-30T12:22:00.184 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:35.160985+0000", 2024-03-30T12:22:00.184 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:35.160985+0000", 2024-03-30T12:22:00.184 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:35.161274+0000", 2024-03-30T12:22:00.184 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.240291+0000", 2024-03-30T12:22:00.185 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:22:00.185 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.185 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:22:00.185 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 64, 2024-03-30T12:22:00.185 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.240291+0000", 2024-03-30T12:22:00.185 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.240291+0000", 2024-03-30T12:22:00.185 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.240291+0000", 2024-03-30T12:22:00.185 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.186 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.186 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:22:00.186 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.240291+0000", 2024-03-30T12:22:00.186 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.240291+0000", 2024-03-30T12:22:00.186 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.186 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.186 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.186 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.187 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 63, 2024-03-30T12:22:00.187 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.187 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.187 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.187 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.187 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.188 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.188 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.188 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.188 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.5", 2024-03-30T12:22:00.188 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.188 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.188 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.188 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-03-30T12:22:00.188 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.188 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T19:12:07.499529+0000", 2024-03-30T12:22:00.188 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.189 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.189 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.189 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.190 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.191 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.193 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.193 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.193 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.193 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.194 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.194 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.194 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.194 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.194 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.194 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:22:00.194 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.194 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:22:00.194 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.194 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:22:00.194 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.194 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.194 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.194 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.195 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.195 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.195 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:22:00.195 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.195 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:22:00.195 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.195 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.195 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.195 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.195 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.195 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.195 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.004086+0000", 2024-03-30T12:22:00.195 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.861413+0000", 2024-03-30T12:22:00.195 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.861413+0000", 2024-03-30T12:22:00.196 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.862340+0000", 2024-03-30T12:22:00.196 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.004086+0000", 2024-03-30T12:22:00.196 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.196 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.196 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.196 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.196 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.004086+0000", 2024-03-30T12:22:00.196 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.004086+0000", 2024-03-30T12:22:00.196 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.004086+0000", 2024-03-30T12:22:00.196 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.196 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.196 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.197 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.004086+0000", 2024-03-30T12:22:00.197 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.004086+0000", 2024-03-30T12:22:00.197 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.197 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.197 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.197 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.197 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.197 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.197 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.197 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.197 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.197 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.198 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.198 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.198 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.198 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2", 2024-03-30T12:22:00.198 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.198 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.198 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.198 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.198 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.198 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T22:13:39.199499+0000", 2024-03-30T12:22:00.198 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.198 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.199 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.199 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.199 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.199 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.199 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.199 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.199 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.199 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.199 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.199 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.199 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.199 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.199 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.199 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.199 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.200 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.200 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.200 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.200 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.200 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.200 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.200 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.200 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.200 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.200 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.200 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.200 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.200 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.200 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.201 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.201 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.201 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.202 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.202 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.202 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.202 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.202 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:22:00.202 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.202 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:22:00.202 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.202 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.202 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.202 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.202 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.202 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:22:00.203 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:22:00.203 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.203 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:22:00.203 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.203 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.203 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:22:00.203 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.203 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.203 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.203 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006241+0000", 2024-03-30T12:22:00.203 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.465618+0000", 2024-03-30T12:22:00.203 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.465618+0000", 2024-03-30T12:22:00.203 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.465946+0000", 2024-03-30T12:22:00.203 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006241+0000", 2024-03-30T12:22:00.204 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.204 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.204 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.204 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:22:00.204 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006241+0000", 2024-03-30T12:22:00.204 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006241+0000", 2024-03-30T12:22:00.204 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006241+0000", 2024-03-30T12:22:00.204 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.204 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.204 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.204 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006241+0000", 2024-03-30T12:22:00.204 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006241+0000", 2024-03-30T12:22:00.204 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.204 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.204 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.205 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.205 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:22:00.205 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.205 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.205 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.205 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.205 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.205 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.205 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.205 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.205 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.3", 2024-03-30T12:22:00.205 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.205 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.205 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.205 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:22:00.205 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.206 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T15:58:42.109572+0000", 2024-03-30T12:22:00.206 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.206 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.206 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.206 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.206 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.206 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.206 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.206 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.206 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.206 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.206 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.206 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.206 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.207 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.207 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.207 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.207 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.207 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.207 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.207 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.207 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.207 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.207 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.207 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.207 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.207 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.207 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.207 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.208 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.209 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.209 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.209 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.209 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.209 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.209 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.209 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.209 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.209 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.209 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:22:00.209 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:22:00.209 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.209 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:22:00.209 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.210 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.210 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.210 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.210 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.210 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.210 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:22:00.210 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.210 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:22:00.210 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.210 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.210 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 19, 2024-03-30T12:22:00.210 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.211 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.211 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.211 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:21:56.160073+0000", 2024-03-30T12:22:00.211 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:18:45.912395+0000", 2024-03-30T12:22:00.211 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:18:45.912395+0000", 2024-03-30T12:22:00.211 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:18:45.912869+0000", 2024-03-30T12:22:00.211 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:21:56.160073+0000", 2024-03-30T12:22:00.211 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:16:43.434559+0000", 2024-03-30T12:22:00.211 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.211 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:16:43.434559+0000", 2024-03-30T12:22:00.211 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 58, 2024-03-30T12:22:00.211 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:21:56.160073+0000", 2024-03-30T12:22:00.211 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:21:56.160073+0000", 2024-03-30T12:22:00.211 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:21:56.160073+0000", 2024-03-30T12:22:00.212 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.212 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.212 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:16:43.434559+0000", 2024-03-30T12:22:00.212 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:21:56.160073+0000", 2024-03-30T12:22:00.212 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:21:56.160073+0000", 2024-03-30T12:22:00.212 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.212 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 156, 2024-03-30T12:22:00.212 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.212 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.212 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 57, 2024-03-30T12:22:00.212 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.212 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.212 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.212 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.213 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 156, 2024-03-30T12:22:00.213 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.213 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.213 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.213 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "1.0", 2024-03-30T12:22:00.213 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.213 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.213 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.213 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 366, 2024-03-30T12:22:00.213 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.213 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T21:48:34.485283+0000", 2024-03-30T12:22:00.213 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.213 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.213 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.213 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 590368, 2024-03-30T12:22:00.213 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.214 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 1771104, 2024-03-30T12:22:00.214 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.214 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.214 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.214 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.214 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.214 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.214 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.214 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.214 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.214 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.214 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.214 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.214 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.214 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 6, 2024-03-30T12:22:00.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 2, 2024-03-30T12:22:00.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 2, 2024-03-30T12:22:00.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 6, 2024-03-30T12:22:00.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.215 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 466, 2024-03-30T12:22:00.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 644, 2024-03-30T12:22:00.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 235, 2024-03-30T12:22:00.216 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 2416 2024-03-30T12:22:00.216 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.216 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.216 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.217 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.217 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.217 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.217 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:22:00.217 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.217 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:22:00.217 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "68'156" 2024-03-30T12:22:00.217 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.217 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.217 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.218 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.218 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.218 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:22:00.218 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.218 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:22:00.218 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.218 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.218 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 63, 2024-03-30T12:22:00.218 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.218 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.218 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006927+0000", 2024-03-30T12:22:00.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:35.051577+0000", 2024-03-30T12:22:00.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:35.051577+0000", 2024-03-30T12:22:00.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:35.052180+0000", 2024-03-30T12:22:00.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006927+0000", 2024-03-30T12:22:00.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:22:00.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:22:00.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 64, 2024-03-30T12:22:00.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006927+0000", 2024-03-30T12:22:00.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006927+0000", 2024-03-30T12:22:00.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006927+0000", 2024-03-30T12:22:00.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.219 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:22:00.220 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006927+0000", 2024-03-30T12:22:00.220 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006927+0000", 2024-03-30T12:22:00.220 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.220 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.220 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.220 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.220 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 63, 2024-03-30T12:22:00.220 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.220 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.220 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.220 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.220 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.221 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.221 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.221 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.221 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.6", 2024-03-30T12:22:00.221 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.221 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.221 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.221 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-03-30T12:22:00.221 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.221 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T17:26:43.695424+0000", 2024-03-30T12:22:00.221 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.221 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.221 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.221 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.222 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.223 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.224 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.224 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.224 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.224 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.224 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.224 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.225 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.225 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:22:00.225 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.225 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:22:00.225 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.225 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.225 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.225 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.225 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.225 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.225 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:22:00.225 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.225 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:22:00.225 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.226 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.226 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.226 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.226 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.226 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.226 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.005553+0000", 2024-03-30T12:22:00.226 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.852216+0000", 2024-03-30T12:22:00.226 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.852216+0000", 2024-03-30T12:22:00.226 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.852506+0000", 2024-03-30T12:22:00.226 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.005553+0000", 2024-03-30T12:22:00.226 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.226 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.226 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.227 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.227 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.005553+0000", 2024-03-30T12:22:00.227 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.005553+0000", 2024-03-30T12:22:00.227 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.005553+0000", 2024-03-30T12:22:00.227 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.227 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.227 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.227 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.005553+0000", 2024-03-30T12:22:00.227 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.005553+0000", 2024-03-30T12:22:00.227 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.227 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.227 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.227 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.227 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.227 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.228 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.228 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.228 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.228 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.228 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.228 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.228 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.228 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.1", 2024-03-30T12:22:00.228 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.228 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.228 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.229 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.229 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.229 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T20:41:21.462303+0000", 2024-03-30T12:22:00.229 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.229 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.229 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.229 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.229 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.229 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.229 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.230 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.231 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.232 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo OK 2024-03-30T12:22:00.234 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.234 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.234 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.234 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.234 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.234 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.235 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.235 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.235 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.235 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.235 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.235 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.235 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.235 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.235 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.235 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.235 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.235 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:22:00.235 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.235 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:22:00.236 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.236 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.236 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.236 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.236 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.236 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.236 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:22:00.236 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.236 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:22:00.236 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.236 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.236 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:22:00.236 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.237 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.237 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.237 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.471481+0000", 2024-03-30T12:22:00.237 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.469541+0000", 2024-03-30T12:22:00.237 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.469541+0000", 2024-03-30T12:22:00.237 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.470266+0000", 2024-03-30T12:22:00.237 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.471481+0000", 2024-03-30T12:22:00.237 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.237 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.237 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.237 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:22:00.237 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.471481+0000", 2024-03-30T12:22:00.237 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.471481+0000", 2024-03-30T12:22:00.237 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.471481+0000", 2024-03-30T12:22:00.237 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.237 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.238 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.238 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.471481+0000", 2024-03-30T12:22:00.238 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.471481+0000", 2024-03-30T12:22:00.238 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.238 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.238 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.238 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.238 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:22:00.238 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.238 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.238 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.238 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.239 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.239 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.239 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.239 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.239 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.0", 2024-03-30T12:22:00.239 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.239 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.239 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.239 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:22:00.239 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.239 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:24:57.244620+0000", 2024-03-30T12:22:00.239 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.239 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.239 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.240 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.241 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.241 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.241 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.241 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.241 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.241 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.241 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.241 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.241 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.241 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.241 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.241 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.241 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.241 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.242 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.242 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.243 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.243 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.243 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.243 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.243 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.243 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:22:00.243 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.243 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:22:00.243 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.243 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.243 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.243 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.243 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.243 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.243 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:22:00.244 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.244 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:22:00.244 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.244 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.244 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 63, 2024-03-30T12:22:00.244 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.244 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.244 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.244 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.005793+0000", 2024-03-30T12:22:00.244 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:35.162514+0000", 2024-03-30T12:22:00.244 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:35.162514+0000", 2024-03-30T12:22:00.244 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:35.162977+0000", 2024-03-30T12:22:00.244 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.005793+0000", 2024-03-30T12:22:00.244 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:22:00.244 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.245 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:22:00.245 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 64, 2024-03-30T12:22:00.245 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.005793+0000", 2024-03-30T12:22:00.245 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.005793+0000", 2024-03-30T12:22:00.245 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.005793+0000", 2024-03-30T12:22:00.245 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.245 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.245 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:22:00.245 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.005793+0000", 2024-03-30T12:22:00.245 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.005793+0000", 2024-03-30T12:22:00.245 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.246 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.246 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.246 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.246 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 63, 2024-03-30T12:22:00.246 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.246 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.246 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.246 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.246 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.246 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.246 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.247 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.247 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.3", 2024-03-30T12:22:00.247 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.247 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.247 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.247 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-03-30T12:22:00.247 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.247 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T18:39:43.550849+0000", 2024-03-30T12:22:00.247 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.247 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.247 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.247 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.247 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.247 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.247 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.247 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.248 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.248 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.248 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.248 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.248 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.248 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.248 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.248 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.248 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.248 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.248 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.248 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.248 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.248 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.248 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.248 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.249 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.250 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.250 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.250 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.250 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.250 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.250 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.250 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.250 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.250 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.250 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.250 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.250 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:22:00.250 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.251 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:22:00.251 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.251 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.251 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.251 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.251 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.251 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.251 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:22:00.251 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.251 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:22:00.251 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.251 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.251 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:22:00.251 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.252 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.252 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.252 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.472179+0000", 2024-03-30T12:22:00.252 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.469218+0000", 2024-03-30T12:22:00.252 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.469218+0000", 2024-03-30T12:22:00.252 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.469567+0000", 2024-03-30T12:22:00.252 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.472179+0000", 2024-03-30T12:22:00.252 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.252 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.252 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.252 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:22:00.252 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.472179+0000", 2024-03-30T12:22:00.253 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.472179+0000", 2024-03-30T12:22:00.253 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.472179+0000", 2024-03-30T12:22:00.253 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.253 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.253 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.253 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.472179+0000", 2024-03-30T12:22:00.253 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.472179+0000", 2024-03-30T12:22:00.253 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.253 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.253 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.253 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.253 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:22:00.253 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.253 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.253 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.254 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.254 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.254 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.254 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.254 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.254 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.5", 2024-03-30T12:22:00.254 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.254 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.254 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.254 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:22:00.254 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.254 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:16:05.609865+0000", 2024-03-30T12:22:00.255 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.255 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.255 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.255 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.255 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.255 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.255 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.255 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.255 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.255 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.255 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.255 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.255 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.255 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.255 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.256 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.257 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.258 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.258 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.258 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.258 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.258 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.258 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.258 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.258 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:22:00.258 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.258 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:22:00.258 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.258 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.258 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.259 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.259 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.259 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:22:00.259 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:22:00.259 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.259 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:22:00.259 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.259 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.259 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.259 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.259 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.259 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006792+0000", 2024-03-30T12:22:00.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.865518+0000", 2024-03-30T12:22:00.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.865518+0000", 2024-03-30T12:22:00.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.865798+0000", 2024-03-30T12:22:00.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006792+0000", 2024-03-30T12:22:00.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006792+0000", 2024-03-30T12:22:00.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006792+0000", 2024-03-30T12:22:00.260 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006792+0000", 2024-03-30T12:22:00.261 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.261 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.261 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.261 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006792+0000", 2024-03-30T12:22:00.261 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006792+0000", 2024-03-30T12:22:00.261 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.261 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.261 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.261 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.261 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.261 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.261 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.261 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.261 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.262 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.262 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.262 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.262 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.262 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.4", 2024-03-30T12:22:00.262 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.262 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.262 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.262 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.262 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.262 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T18:47:41.818140+0000", 2024-03-30T12:22:00.263 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.263 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.263 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.263 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.263 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.263 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.263 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.263 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.263 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.263 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.263 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.264 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.265 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.266 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.266 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.266 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.266 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.266 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.266 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.266 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:22:00.266 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:22:00.266 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.267 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:22:00.267 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.267 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.267 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.267 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.267 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.267 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.267 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:22:00.267 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.267 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:22:00.267 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.267 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.267 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 63, 2024-03-30T12:22:00.267 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.268 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.268 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.268 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.003500+0000", 2024-03-30T12:22:00.268 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:35.162480+0000", 2024-03-30T12:22:00.268 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:35.162480+0000", 2024-03-30T12:22:00.268 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:35.162768+0000", 2024-03-30T12:22:00.268 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.003500+0000", 2024-03-30T12:22:00.268 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:22:00.268 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.268 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:22:00.268 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 64, 2024-03-30T12:22:00.268 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.003500+0000", 2024-03-30T12:22:00.268 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.003500+0000", 2024-03-30T12:22:00.268 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.003500+0000", 2024-03-30T12:22:00.268 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.269 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.269 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:22:00.269 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.003500+0000", 2024-03-30T12:22:00.269 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.003500+0000", 2024-03-30T12:22:00.269 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.269 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.269 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.269 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.269 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 63, 2024-03-30T12:22:00.269 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.269 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.269 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.269 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.269 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.269 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.269 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.270 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.270 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.0", 2024-03-30T12:22:00.270 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.270 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.270 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.270 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-03-30T12:22:00.270 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.270 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T15:17:01.235481+0000", 2024-03-30T12:22:00.270 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.270 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.270 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.270 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.270 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.271 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.271 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.271 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.271 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.271 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.271 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.271 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.271 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.271 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.271 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.271 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.271 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.271 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.271 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.271 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.272 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.273 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.273 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.273 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.273 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.273 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.273 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.273 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.274 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:22:00.274 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.274 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:22:00.274 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.274 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.274 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.274 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.274 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.274 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:22:00.274 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:22:00.274 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.274 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:22:00.274 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.274 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.274 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:22:00.275 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.275 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.275 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.275 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006687+0000", 2024-03-30T12:22:00.275 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.454233+0000", 2024-03-30T12:22:00.275 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.454233+0000", 2024-03-30T12:22:00.275 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.454554+0000", 2024-03-30T12:22:00.275 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006687+0000", 2024-03-30T12:22:00.275 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.275 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.275 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.275 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:22:00.275 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006687+0000", 2024-03-30T12:22:00.275 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006687+0000", 2024-03-30T12:22:00.275 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006687+0000", 2024-03-30T12:22:00.276 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.276 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.276 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.276 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006687+0000", 2024-03-30T12:22:00.276 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006687+0000", 2024-03-30T12:22:00.276 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.276 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 1, 2024-03-30T12:22:00.276 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.276 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.276 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:22:00.276 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.276 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.276 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.276 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.277 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 1, 2024-03-30T12:22:00.277 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.277 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.277 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.277 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.6", 2024-03-30T12:22:00.277 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.277 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.277 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.277 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 20, 2024-03-30T12:22:00.277 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.277 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:05:09.010127+0000", 2024-03-30T12:22:00.277 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.277 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.277 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.277 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.278 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-03-30T12:22:00.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-03-30T12:22:00.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-03-30T12:22:00.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-03-30T12:22:00.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.279 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 1, 2024-03-30T12:22:00.280 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.280 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.280 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.280 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.280 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.280 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.281 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:22:00.281 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:22:00.281 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.281 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:22:00.281 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "62'1" 2024-03-30T12:22:00.281 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.281 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.281 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.281 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.281 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.281 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:22:00.281 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.282 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:22:00.282 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.282 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.282 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.282 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.282 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.282 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.282 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.004566+0000", 2024-03-30T12:22:00.282 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.853538+0000", 2024-03-30T12:22:00.282 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.853538+0000", 2024-03-30T12:22:00.282 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.853806+0000", 2024-03-30T12:22:00.282 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.004566+0000", 2024-03-30T12:22:00.282 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.283 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.283 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.283 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.283 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.004566+0000", 2024-03-30T12:22:00.283 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.004566+0000", 2024-03-30T12:22:00.283 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.004566+0000", 2024-03-30T12:22:00.283 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.283 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.283 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.283 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.004566+0000", 2024-03-30T12:22:00.283 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.004566+0000", 2024-03-30T12:22:00.283 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.283 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.283 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.283 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.284 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.284 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.284 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.284 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.284 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.284 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.284 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.284 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.284 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.284 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.7", 2024-03-30T12:22:00.284 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.284 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.284 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.285 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.285 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.285 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T15:36:10.741436+0000", 2024-03-30T12:22:00.285 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.285 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.285 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.285 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.285 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.285 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.285 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.285 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.285 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.285 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.285 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.286 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.287 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.288 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.288 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.288 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.288 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.288 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.288 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.288 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.289 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:22:00.289 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.289 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:22:00.289 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.289 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.289 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.289 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.289 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.289 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.289 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:22:00.289 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.289 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-03-30T12:22:00.289 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.289 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.289 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 63, 2024-03-30T12:22:00.290 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.290 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.290 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.290 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.598155+0000", 2024-03-30T12:22:00.290 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:35.162347+0000", 2024-03-30T12:22:00.290 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:35.162347+0000", 2024-03-30T12:22:00.290 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:35.162679+0000", 2024-03-30T12:22:00.290 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.598155+0000", 2024-03-30T12:22:00.290 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:22:00.290 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.290 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:22:00.290 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 64, 2024-03-30T12:22:00.290 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.598155+0000", 2024-03-30T12:22:00.290 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.598155+0000", 2024-03-30T12:22:00.291 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.598155+0000", 2024-03-30T12:22:00.291 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.291 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.291 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:34.039736+0000", 2024-03-30T12:22:00.291 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.598155+0000", 2024-03-30T12:22:00.291 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.598155+0000", 2024-03-30T12:22:00.291 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.291 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.291 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.291 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.291 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 63, 2024-03-30T12:22:00.291 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.291 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.291 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.292 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.292 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.292 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.292 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.292 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.292 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "4.1", 2024-03-30T12:22:00.292 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.292 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.292 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.292 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 15, 2024-03-30T12:22:00.292 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.292 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T12:24:16.565563+0000", 2024-03-30T12:22:00.292 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.292 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.293 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.293 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.294 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.295 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.296 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.296 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.296 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.296 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.296 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.296 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.296 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.296 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:22:00.296 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.296 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-03-30T12:22:00.296 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.296 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.296 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.296 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.297 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:22:00.297 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.297 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:22:00.297 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.297 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:22:00.297 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.297 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.297 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:22:00.297 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.297 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.297 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.297 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.240550+0000", 2024-03-30T12:22:00.298 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.459948+0000", 2024-03-30T12:22:00.298 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.459948+0000", 2024-03-30T12:22:00.298 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.460279+0000", 2024-03-30T12:22:00.298 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.240550+0000", 2024-03-30T12:22:00.298 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.298 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.298 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.298 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:22:00.298 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.240550+0000", 2024-03-30T12:22:00.298 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.240550+0000", 2024-03-30T12:22:00.298 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.240550+0000", 2024-03-30T12:22:00.298 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.298 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.298 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.298 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.240550+0000", 2024-03-30T12:22:00.299 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.240550+0000", 2024-03-30T12:22:00.299 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.299 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 2, 2024-03-30T12:22:00.299 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.299 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.299 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:22:00.299 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.299 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.299 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.299 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.299 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 2, 2024-03-30T12:22:00.299 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.299 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.299 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.299 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.7", 2024-03-30T12:22:00.299 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.300 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.300 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.300 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 21, 2024-03-30T12:22:00.300 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.300 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T15:37:06.870147+0000", 2024-03-30T12:22:00.300 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.300 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.300 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.300 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-03-30T12:22:00.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-03-30T12:22:00.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-03-30T12:22:00.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.301 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-03-30T12:22:00.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.302 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.303 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.303 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 3, 2024-03-30T12:22:00.303 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.303 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.303 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.303 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.303 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.303 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:22:00.303 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.303 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:22:00.303 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.303 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:22:00.303 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'2" 2024-03-30T12:22:00.303 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.303 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.303 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.304 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.304 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.304 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:22:00.304 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.304 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:22:00.304 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.304 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.304 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.304 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.304 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.304 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.304 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.007313+0000", 2024-03-30T12:22:00.304 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.852755+0000", 2024-03-30T12:22:00.304 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.852755+0000", 2024-03-30T12:22:00.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.853029+0000", 2024-03-30T12:22:00.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.007313+0000", 2024-03-30T12:22:00.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.007313+0000", 2024-03-30T12:22:00.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.007313+0000", 2024-03-30T12:22:00.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.007313+0000", 2024-03-30T12:22:00.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.007313+0000", 2024-03-30T12:22:00.305 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.007313+0000", 2024-03-30T12:22:00.305 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.306 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.306 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.306 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.306 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.306 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.306 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.306 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.306 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.306 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.306 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.306 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.306 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.306 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.6", 2024-03-30T12:22:00.306 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.306 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.307 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.307 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.307 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.307 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T21:03:44.655099+0000", 2024-03-30T12:22:00.307 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.307 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.307 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.307 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.307 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.307 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.307 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.307 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.308 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.309 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.310 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.310 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.310 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.310 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.310 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.310 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.310 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.310 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.311 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.311 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.311 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:22:00.311 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.311 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:22:00.311 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.311 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.311 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.312 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.312 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.312 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.312 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:22:00.312 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.312 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:22:00.312 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.312 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.312 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:22:00.312 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.312 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.312 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.313 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.471656+0000", 2024-03-30T12:22:00.313 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.469910+0000", 2024-03-30T12:22:00.313 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.469910+0000", 2024-03-30T12:22:00.313 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.470521+0000", 2024-03-30T12:22:00.313 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.471656+0000", 2024-03-30T12:22:00.313 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.313 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.313 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.313 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:22:00.313 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.471656+0000", 2024-03-30T12:22:00.313 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.471656+0000", 2024-03-30T12:22:00.313 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.471656+0000", 2024-03-30T12:22:00.313 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.313 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.313 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.313 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.471656+0000", 2024-03-30T12:22:00.314 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.471656+0000", 2024-03-30T12:22:00.314 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.314 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.314 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.314 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.314 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:22:00.314 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.314 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.314 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.314 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.314 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.314 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.314 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.314 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.315 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.8", 2024-03-30T12:22:00.315 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.315 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.315 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.315 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:22:00.315 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.315 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T14:12:52.044394+0000", 2024-03-30T12:22:00.315 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.315 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.315 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.315 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.316 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.317 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.317 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.317 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.317 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.317 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.317 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.317 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.317 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.317 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.317 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.317 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.317 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.318 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.318 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.318 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.318 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.318 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.318 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.318 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.319 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.319 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.319 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.319 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.319 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.319 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.319 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:22:00.319 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.319 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:22:00.319 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.319 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.319 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.320 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.320 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.320 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:22:00.320 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:22:00.320 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.320 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 4, 2024-03-30T12:22:00.320 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.320 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.320 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.320 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.320 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.320 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.320 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.598423+0000", 2024-03-30T12:22:00.320 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.876739+0000", 2024-03-30T12:22:00.320 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.876739+0000", 2024-03-30T12:22:00.320 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.877240+0000", 2024-03-30T12:22:00.321 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.598423+0000", 2024-03-30T12:22:00.321 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.321 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.321 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.321 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.321 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.598423+0000", 2024-03-30T12:22:00.321 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.598423+0000", 2024-03-30T12:22:00.321 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.598423+0000", 2024-03-30T12:22:00.321 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.321 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.321 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.322 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.598423+0000", 2024-03-30T12:22:00.322 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.598423+0000", 2024-03-30T12:22:00.322 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.322 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.322 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.322 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.322 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.322 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.322 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.322 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.322 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.322 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.323 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.323 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.323 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.323 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.9", 2024-03-30T12:22:00.323 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.323 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.323 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.323 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.323 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.323 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T13:36:25.328486+0000", 2024-03-30T12:22:00.323 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.323 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.323 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.323 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.324 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.324 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.324 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.324 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.324 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.325 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.325 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.325 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.325 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.325 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.325 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.326 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.327 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.328 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.329 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.329 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.329 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.329 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.329 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.329 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.329 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:22:00.329 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:22:00.329 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.329 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 4, 2024-03-30T12:22:00.329 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.330 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.330 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.330 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.330 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.330 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.330 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:22:00.330 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.330 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:22:00.330 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.330 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.330 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:22:00.330 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.330 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.331 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.331 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006039+0000", 2024-03-30T12:22:00.331 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.459223+0000", 2024-03-30T12:22:00.331 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.459223+0000", 2024-03-30T12:22:00.331 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.459528+0000", 2024-03-30T12:22:00.331 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006039+0000", 2024-03-30T12:22:00.331 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.331 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.331 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.331 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:22:00.331 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006039+0000", 2024-03-30T12:22:00.331 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006039+0000", 2024-03-30T12:22:00.331 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006039+0000", 2024-03-30T12:22:00.331 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.332 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.332 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.332 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006039+0000", 2024-03-30T12:22:00.332 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006039+0000", 2024-03-30T12:22:00.332 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.332 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.332 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.332 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.332 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:22:00.332 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.332 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.332 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.332 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.332 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.333 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.333 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.333 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.333 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.9", 2024-03-30T12:22:00.333 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.333 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.333 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.333 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:22:00.333 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.333 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T16:49:44.399783+0000", 2024-03-30T12:22:00.333 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.333 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.333 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.333 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.333 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.334 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.335 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.336 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.336 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.336 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.336 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.336 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.337 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.337 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.337 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:22:00.337 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.337 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:22:00.337 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.337 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.337 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.337 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.337 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.337 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.337 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:22:00.337 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.337 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:22:00.338 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.338 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.338 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.338 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.338 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.338 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.338 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.003591+0000", 2024-03-30T12:22:00.338 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.850530+0000", 2024-03-30T12:22:00.338 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.850530+0000", 2024-03-30T12:22:00.338 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.850810+0000", 2024-03-30T12:22:00.338 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.003591+0000", 2024-03-30T12:22:00.338 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.338 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.339 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.339 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.339 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.003591+0000", 2024-03-30T12:22:00.339 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.003591+0000", 2024-03-30T12:22:00.339 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.003591+0000", 2024-03-30T12:22:00.339 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.339 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.339 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.339 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.003591+0000", 2024-03-30T12:22:00.339 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.003591+0000", 2024-03-30T12:22:00.339 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.339 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.339 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.339 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.339 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.340 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.340 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.340 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.340 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.340 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.340 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.340 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.340 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.340 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.8", 2024-03-30T12:22:00.340 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.340 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.340 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.340 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.340 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.340 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T15:52:32.869322+0000", 2024-03-30T12:22:00.341 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.341 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.341 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.341 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.341 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.341 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.341 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.341 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.341 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.341 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.341 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.341 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.341 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.341 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.342 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.343 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.344 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.344 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.344 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.344 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.344 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.344 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.344 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.344 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:22:00.344 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.344 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:22:00.344 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.344 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.344 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.344 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.345 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.345 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.345 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:22:00.345 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.345 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:22:00.345 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.345 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.345 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:22:00.345 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.345 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.345 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.345 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.009648+0000", 2024-03-30T12:22:00.345 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:20:37.008926+0000", 2024-03-30T12:22:00.345 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:20:37.008926+0000", 2024-03-30T12:22:00.345 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:20:37.009330+0000", 2024-03-30T12:22:00.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.009648+0000", 2024-03-30T12:22:00.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 68, 2024-03-30T12:22:00.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.009648+0000", 2024-03-30T12:22:00.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.009648+0000", 2024-03-30T12:22:00.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.009648+0000", 2024-03-30T12:22:00.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.009648+0000", 2024-03-30T12:22:00.346 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.009648+0000", 2024-03-30T12:22:00.347 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.347 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.347 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.347 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.347 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 67, 2024-03-30T12:22:00.347 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.347 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.347 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.347 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.347 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.347 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.347 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.347 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.347 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.a", 2024-03-30T12:22:00.347 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.348 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.348 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.348 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 28, 2024-03-30T12:22:00.348 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.348 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T21:53:39.113599+0000", 2024-03-30T12:22:00.348 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.348 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.348 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.348 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.348 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.348 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.348 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.348 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.348 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.349 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.350 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.351 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.351 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.351 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.351 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.351 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.351 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.351 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.351 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.351 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.351 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.351 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.351 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.351 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.351 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.351 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.352 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:22:00.352 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.352 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:22:00.352 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.352 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.352 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.352 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.352 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.352 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.352 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:22:00.352 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.352 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:22:00.352 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.352 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.353 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.353 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.353 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.353 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.353 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.004114+0000", 2024-03-30T12:22:00.353 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.858419+0000", 2024-03-30T12:22:00.353 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.858419+0000", 2024-03-30T12:22:00.353 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.858733+0000", 2024-03-30T12:22:00.353 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.004114+0000", 2024-03-30T12:22:00.353 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.353 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.353 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.354 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.354 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.004114+0000", 2024-03-30T12:22:00.354 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.004114+0000", 2024-03-30T12:22:00.354 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.004114+0000", 2024-03-30T12:22:00.354 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.354 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.354 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.354 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.004114+0000", 2024-03-30T12:22:00.354 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.004114+0000", 2024-03-30T12:22:00.354 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.354 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.354 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.354 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.354 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.355 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.355 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.355 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.355 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.355 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.355 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.355 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.355 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.355 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.b", 2024-03-30T12:22:00.355 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.355 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.355 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.355 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.355 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.355 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T20:27:43.731796+0000", 2024-03-30T12:22:00.356 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.356 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.356 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.356 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.357 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.358 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.359 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.359 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.359 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.359 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.359 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.359 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.359 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.359 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.359 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.359 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.359 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.359 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:22:00.359 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.359 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:22:00.359 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.360 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.360 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.360 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.360 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.360 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.360 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:22:00.360 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.361 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:22:00.361 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.361 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.361 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:22:00.361 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.361 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.361 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.361 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.472063+0000", 2024-03-30T12:22:00.361 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.466979+0000", 2024-03-30T12:22:00.361 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.466979+0000", 2024-03-30T12:22:00.361 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.468017+0000", 2024-03-30T12:22:00.361 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.472063+0000", 2024-03-30T12:22:00.361 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.361 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.362 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.362 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:22:00.362 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.472063+0000", 2024-03-30T12:22:00.362 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.472063+0000", 2024-03-30T12:22:00.362 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.472063+0000", 2024-03-30T12:22:00.362 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.362 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.362 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.362 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.472063+0000", 2024-03-30T12:22:00.362 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.472063+0000", 2024-03-30T12:22:00.362 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.362 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 2, 2024-03-30T12:22:00.362 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.363 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.363 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:22:00.363 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.363 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.363 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.363 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.363 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 2, 2024-03-30T12:22:00.363 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.363 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.363 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.363 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.b", 2024-03-30T12:22:00.363 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.363 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.363 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.364 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 21, 2024-03-30T12:22:00.364 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.364 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T22:41:36.480109+0000", 2024-03-30T12:22:00.364 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.364 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.364 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.364 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.364 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.364 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.365 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-03-30T12:22:00.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-03-30T12:22:00.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-03-30T12:22:00.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.366 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-03-30T12:22:00.367 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.367 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.367 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.367 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.367 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.367 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.367 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.367 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.367 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.367 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.367 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.367 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.367 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 1, 2024-03-30T12:22:00.367 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.367 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.368 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.368 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.368 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.368 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.368 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.368 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:22:00.368 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.368 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:22:00.368 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'2" 2024-03-30T12:22:00.368 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.368 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.368 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.368 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:22:00.368 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.368 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:22:00.369 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.369 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:22:00.369 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.369 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.369 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.369 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.369 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.369 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.369 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.240324+0000", 2024-03-30T12:22:00.369 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.868645+0000", 2024-03-30T12:22:00.369 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.868645+0000", 2024-03-30T12:22:00.369 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.869001+0000", 2024-03-30T12:22:00.369 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.240324+0000", 2024-03-30T12:22:00.370 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.370 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.370 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.370 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.370 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.240324+0000", 2024-03-30T12:22:00.370 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.240324+0000", 2024-03-30T12:22:00.370 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.240324+0000", 2024-03-30T12:22:00.370 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.370 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.370 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.370 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.240324+0000", 2024-03-30T12:22:00.370 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.240324+0000", 2024-03-30T12:22:00.370 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.371 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.371 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.371 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.371 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.371 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.371 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.371 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.371 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.371 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.371 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.371 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.371 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.371 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.a", 2024-03-30T12:22:00.371 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.372 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.372 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.372 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.372 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.372 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T19:54:10.778279+0000", 2024-03-30T12:22:00.372 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.372 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.372 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.372 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.372 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.372 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.372 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.372 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.372 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.373 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.374 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.374 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.374 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.374 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.374 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.374 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.374 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.374 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.374 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.374 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.374 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.374 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.374 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.375 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.375 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.375 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.375 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.375 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.375 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.375 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.375 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.375 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.375 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.375 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.375 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:22:00.376 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.376 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:22:00.376 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.376 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:22:00.376 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.376 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.376 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.376 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.376 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:22:00.376 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.376 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:22:00.376 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.376 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-03-30T12:22:00.376 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.377 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.377 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:22:00.377 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.377 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.377 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.377 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.008278+0000", 2024-03-30T12:22:00.377 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.458925+0000", 2024-03-30T12:22:00.377 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.458925+0000", 2024-03-30T12:22:00.377 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.459171+0000", 2024-03-30T12:22:00.377 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.008278+0000", 2024-03-30T12:22:00.377 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.377 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.377 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.377 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:22:00.378 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.008278+0000", 2024-03-30T12:22:00.378 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.008278+0000", 2024-03-30T12:22:00.378 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.008278+0000", 2024-03-30T12:22:00.378 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.378 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.378 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.378 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.008278+0000", 2024-03-30T12:22:00.378 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.008278+0000", 2024-03-30T12:22:00.378 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.378 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.378 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.378 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.378 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:22:00.379 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.379 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.379 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.379 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.379 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.379 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.379 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.379 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.379 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.c", 2024-03-30T12:22:00.379 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.379 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.379 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.379 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 19, 2024-03-30T12:22:00.379 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.379 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T12:26:20.974369+0000", 2024-03-30T12:22:00.379 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.380 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.380 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.380 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.381 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.381 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.381 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.381 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.381 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.381 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.381 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.381 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.381 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.381 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.381 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.381 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.381 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.382 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.382 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.382 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.382 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.382 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.382 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.382 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.382 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.382 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.382 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.382 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.382 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.383 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.383 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.383 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.383 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.383 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.383 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.383 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.383 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:22:00.383 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.383 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:22:00.383 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.383 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-03-30T12:22:00.383 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.383 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.383 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.384 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.384 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.384 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.384 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:22:00.384 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.384 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:22:00.384 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.384 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.384 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.384 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.384 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.384 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.384 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.472168+0000", 2024-03-30T12:22:00.384 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.875216+0000", 2024-03-30T12:22:00.385 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.875216+0000", 2024-03-30T12:22:00.385 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.875558+0000", 2024-03-30T12:22:00.385 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.472168+0000", 2024-03-30T12:22:00.385 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.385 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.385 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.385 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.385 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.472168+0000", 2024-03-30T12:22:00.385 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.472168+0000", 2024-03-30T12:22:00.385 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.472168+0000", 2024-03-30T12:22:00.385 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.385 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.385 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.385 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.472168+0000", 2024-03-30T12:22:00.386 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.472168+0000", 2024-03-30T12:22:00.386 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.386 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.386 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.386 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.386 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.386 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.386 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.386 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.386 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.386 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.386 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.387 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.387 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.387 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.d", 2024-03-30T12:22:00.387 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.387 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.387 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.387 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.387 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.387 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T15:27:04.763910+0000", 2024-03-30T12:22:00.387 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.387 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.387 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.387 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.387 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.388 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.388 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.388 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.388 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.388 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.388 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.388 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.388 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.388 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.388 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.388 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.388 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.388 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.388 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.388 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.389 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.389 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.389 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.389 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.389 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.389 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.389 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.389 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.389 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.389 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.389 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.389 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.389 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.389 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.390 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.390 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.390 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.390 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.390 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.390 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.390 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.390 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.390 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.390 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.390 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.390 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.390 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.390 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.391 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.391 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:22:00.391 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.391 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:22:00.391 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.391 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.391 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.391 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.391 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.391 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.391 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:22:00.391 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.391 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:22:00.391 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.392 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.393 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:22:00.393 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.393 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.393 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.394 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006514+0000", 2024-03-30T12:22:00.394 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.459250+0000", 2024-03-30T12:22:00.394 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.459250+0000", 2024-03-30T12:22:00.394 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.459545+0000", 2024-03-30T12:22:00.394 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006514+0000", 2024-03-30T12:22:00.394 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.394 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.394 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.395 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:22:00.395 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006514+0000", 2024-03-30T12:22:00.395 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006514+0000", 2024-03-30T12:22:00.395 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006514+0000", 2024-03-30T12:22:00.395 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.395 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.395 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.395 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006514+0000", 2024-03-30T12:22:00.395 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006514+0000", 2024-03-30T12:22:00.396 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.396 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 1, 2024-03-30T12:22:00.396 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.396 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.396 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:22:00.396 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.396 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.396 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.396 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.397 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 1, 2024-03-30T12:22:00.397 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.397 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.397 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.397 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.d", 2024-03-30T12:22:00.397 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.397 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.397 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.397 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 20, 2024-03-30T12:22:00.398 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.398 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T20:52:38.112815+0000", 2024-03-30T12:22:00.398 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.398 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.398 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.398 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 70, 2024-03-30T12:22:00.398 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.399 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.399 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.399 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.399 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.399 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.399 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.399 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.399 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.399 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-03-30T12:22:00.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-03-30T12:22:00.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.400 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-03-30T12:22:00.401 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.401 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.401 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.401 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.401 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.401 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.401 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.401 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.401 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.402 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.402 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.402 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.402 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.402 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.402 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.402 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.402 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.403 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.403 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 1, 2024-03-30T12:22:00.403 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 1 2024-03-30T12:22:00.403 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.403 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.403 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.403 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.403 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.404 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.404 INFO:tasks.workunit.client.0.smithi084.stdout: 3 2024-03-30T12:22:00.404 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.404 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:22:00.404 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'1" 2024-03-30T12:22:00.404 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.404 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.404 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.404 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.405 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.405 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:22:00.405 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.405 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:22:00.405 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.405 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.405 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.405 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.405 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.406 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.406 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006460+0000", 2024-03-30T12:22:00.406 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.852250+0000", 2024-03-30T12:22:00.406 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.852250+0000", 2024-03-30T12:22:00.406 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.852558+0000", 2024-03-30T12:22:00.406 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006460+0000", 2024-03-30T12:22:00.406 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.406 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.407 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.407 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.407 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006460+0000", 2024-03-30T12:22:00.407 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006460+0000", 2024-03-30T12:22:00.407 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006460+0000", 2024-03-30T12:22:00.407 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.407 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.407 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.407 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006460+0000", 2024-03-30T12:22:00.408 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006460+0000", 2024-03-30T12:22:00.408 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.408 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.408 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.408 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.408 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.408 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.408 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.408 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.408 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.408 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.409 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.409 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.409 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.409 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.c", 2024-03-30T12:22:00.409 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.409 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.409 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.409 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.409 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.409 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:57:15.989801+0000", 2024-03-30T12:22:00.409 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.409 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.409 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.409 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.410 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.410 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.410 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.410 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.410 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.410 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.410 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.410 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.410 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.410 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.410 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.410 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.411 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.412 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.413 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.413 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.413 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.413 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.413 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.413 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.413 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.413 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.413 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.413 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:22:00.414 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.414 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:22:00.414 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.414 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.414 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.414 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.414 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:22:00.414 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.414 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:22:00.414 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.415 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-03-30T12:22:00.415 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.415 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.415 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 59, 2024-03-30T12:22:00.415 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.415 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.415 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.415 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006716+0000", 2024-03-30T12:22:00.415 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.464021+0000", 2024-03-30T12:22:00.415 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.464021+0000", 2024-03-30T12:22:00.415 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.464968+0000", 2024-03-30T12:22:00.415 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006716+0000", 2024-03-30T12:22:00.415 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.415 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.416 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.416 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 60, 2024-03-30T12:22:00.416 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006716+0000", 2024-03-30T12:22:00.416 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006716+0000", 2024-03-30T12:22:00.416 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006716+0000", 2024-03-30T12:22:00.416 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.416 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.416 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:18:59.433312+0000", 2024-03-30T12:22:00.416 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006716+0000", 2024-03-30T12:22:00.416 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006716+0000", 2024-03-30T12:22:00.416 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.416 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 2, 2024-03-30T12:22:00.416 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.416 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.416 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 59, 2024-03-30T12:22:00.417 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.417 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.417 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.417 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.417 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 2, 2024-03-30T12:22:00.417 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.417 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.417 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.417 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "2.e", 2024-03-30T12:22:00.417 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.417 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.418 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.418 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 21, 2024-03-30T12:22:00.418 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.418 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T21:48:20.224884+0000", 2024-03-30T12:22:00.418 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.418 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.418 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.418 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.418 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.418 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.418 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.419 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.419 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.419 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.419 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.419 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.419 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.419 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.420 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.420 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.420 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.420 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.420 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.420 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 3, 2024-03-30T12:22:00.420 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 1, 2024-03-30T12:22:00.421 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.421 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 1, 2024-03-30T12:22:00.421 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.421 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.421 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.421 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.421 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.421 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 1, 2024-03-30T12:22:00.421 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.422 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.422 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.422 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.422 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.422 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.422 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.422 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.422 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.422 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.423 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.423 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.423 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 3, 2024-03-30T12:22:00.423 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.423 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.423 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.423 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.423 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.423 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:22:00.423 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.423 INFO:tasks.workunit.client.0.smithi084.stdout: 7 2024-03-30T12:22:00.423 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.424 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-03-30T12:22:00.424 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "61'2" 2024-03-30T12:22:00.424 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.424 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.424 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.424 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.424 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.424 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:22:00.424 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.424 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 7, 2024-03-30T12:22:00.424 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.424 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.424 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.425 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.425 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.425 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.425 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.472277+0000", 2024-03-30T12:22:00.425 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.871376+0000", 2024-03-30T12:22:00.425 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.871376+0000", 2024-03-30T12:22:00.425 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.871645+0000", 2024-03-30T12:22:00.425 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.472277+0000", 2024-03-30T12:22:00.425 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.425 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.425 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.425 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.425 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.472277+0000", 2024-03-30T12:22:00.425 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.472277+0000", 2024-03-30T12:22:00.425 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.472277+0000", 2024-03-30T12:22:00.426 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.426 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.426 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.426 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.472277+0000", 2024-03-30T12:22:00.426 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.472277+0000", 2024-03-30T12:22:00.426 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.426 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.426 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.426 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.426 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.426 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.426 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.426 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.427 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.427 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.427 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.427 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.427 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.427 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.f", 2024-03-30T12:22:00.427 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.427 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.427 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.427 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.427 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.427 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T12:54:57.281972+0000", 2024-03-30T12:22:00.427 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.427 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.427 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.428 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.429 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.430 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.431 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.431 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.431 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.431 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.431 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.431 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.431 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.431 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:22:00.431 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.431 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 7, 2024-03-30T12:22:00.431 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.431 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.431 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.432 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.432 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:22:00.432 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.432 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:22:00.432 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.432 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:22:00.432 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.432 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.432 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.432 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.432 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.432 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.432 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.240081+0000", 2024-03-30T12:22:00.432 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.862535+0000", 2024-03-30T12:22:00.433 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.862535+0000", 2024-03-30T12:22:00.433 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.862859+0000", 2024-03-30T12:22:00.433 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.240081+0000", 2024-03-30T12:22:00.433 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.433 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.433 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.433 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.433 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.240081+0000", 2024-03-30T12:22:00.433 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.240081+0000", 2024-03-30T12:22:00.433 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.240081+0000", 2024-03-30T12:22:00.433 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.433 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.433 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.433 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.240081+0000", 2024-03-30T12:22:00.434 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.240081+0000", 2024-03-30T12:22:00.434 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.434 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.434 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.434 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.434 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.434 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.434 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.434 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.434 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.434 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.435 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.435 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.435 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.435 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.20", 2024-03-30T12:22:00.435 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.435 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.435 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.435 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.435 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.435 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T16:17:31.462763+0000", 2024-03-30T12:22:00.435 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.435 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.436 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.436 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.436 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.436 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.436 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.436 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.436 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.436 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.436 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.436 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.436 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.436 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.436 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.437 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.437 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.437 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.437 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.437 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.437 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.437 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.437 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.437 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.437 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.437 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.437 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.437 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.437 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.438 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.438 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.438 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.438 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.438 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.438 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.438 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.438 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.438 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.438 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.438 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.438 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.439 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.439 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.439 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.439 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.439 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.439 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.439 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:22:00.439 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.439 INFO:tasks.workunit.client.0.smithi084.stdout: 5 2024-03-30T12:22:00.439 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.439 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:22:00.439 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.439 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.439 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.439 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.440 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:22:00.440 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.440 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:22:00.440 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.440 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 2, 2024-03-30T12:22:00.440 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.440 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.440 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.440 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.440 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.440 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.440 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.007057+0000", 2024-03-30T12:22:00.440 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.862567+0000", 2024-03-30T12:22:00.440 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.862567+0000", 2024-03-30T12:22:00.440 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.862947+0000", 2024-03-30T12:22:00.441 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.007057+0000", 2024-03-30T12:22:00.441 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.441 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.441 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.441 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.441 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.007057+0000", 2024-03-30T12:22:00.441 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.007057+0000", 2024-03-30T12:22:00.441 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.007057+0000", 2024-03-30T12:22:00.441 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.441 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.441 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.441 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.007057+0000", 2024-03-30T12:22:00.441 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.007057+0000", 2024-03-30T12:22:00.441 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.442 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.442 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.442 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.442 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.442 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.442 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.442 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.442 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.442 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.442 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.442 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.442 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.442 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.21", 2024-03-30T12:22:00.443 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.443 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.443 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.443 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.443 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.443 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T13:55:05.422370+0000", 2024-03-30T12:22:00.443 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.443 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.443 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.443 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.443 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.443 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.443 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.443 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.444 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.444 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.444 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.444 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.444 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.444 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.444 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.444 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.444 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.444 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.444 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.444 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.444 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.445 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.446 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.446 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.446 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.446 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.446 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.447 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.447 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.447 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.447 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.447 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.447 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.447 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.447 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.447 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:22:00.447 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.447 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:22:00.447 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.447 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 2, 2024-03-30T12:22:00.447 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.448 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.448 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.448 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.448 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.448 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.448 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:22:00.448 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.448 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:22:00.448 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.448 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.448 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.448 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.448 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.448 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006398+0000", 2024-03-30T12:22:00.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.856525+0000", 2024-03-30T12:22:00.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.856525+0000", 2024-03-30T12:22:00.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.856869+0000", 2024-03-30T12:22:00.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006398+0000", 2024-03-30T12:22:00.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006398+0000", 2024-03-30T12:22:00.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006398+0000", 2024-03-30T12:22:00.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006398+0000", 2024-03-30T12:22:00.449 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.450 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.450 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.450 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006398+0000", 2024-03-30T12:22:00.450 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006398+0000", 2024-03-30T12:22:00.450 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.450 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.450 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.450 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.450 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.450 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.450 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.450 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.450 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.451 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.451 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.451 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.451 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.451 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.22", 2024-03-30T12:22:00.451 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.451 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.451 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.451 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.451 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.451 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T20:01:47.443294+0000", 2024-03-30T12:22:00.451 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.451 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.451 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.452 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.453 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.454 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.454 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.454 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.454 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.454 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.454 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.454 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.454 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.454 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.454 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.454 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.454 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.454 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.454 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.455 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.455 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.455 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.455 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.455 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.455 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.455 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:22:00.455 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.455 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:22:00.455 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.455 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.455 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.455 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.455 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.455 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.456 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:22:00.456 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.456 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:22:00.456 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.456 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.456 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.456 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.456 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.456 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.456 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.005862+0000", 2024-03-30T12:22:00.456 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.859327+0000", 2024-03-30T12:22:00.456 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.859327+0000", 2024-03-30T12:22:00.456 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.859724+0000", 2024-03-30T12:22:00.456 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.005862+0000", 2024-03-30T12:22:00.456 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.456 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.457 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.457 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.457 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.005862+0000", 2024-03-30T12:22:00.457 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.005862+0000", 2024-03-30T12:22:00.457 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.005862+0000", 2024-03-30T12:22:00.457 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.457 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.457 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.457 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.005862+0000", 2024-03-30T12:22:00.457 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.005862+0000", 2024-03-30T12:22:00.457 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.457 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.457 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.457 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.457 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.458 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.458 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.458 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.458 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.458 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.458 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.458 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.458 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.458 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.23", 2024-03-30T12:22:00.458 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.458 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.458 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.458 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.459 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.459 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T17:53:15.692683+0000", 2024-03-30T12:22:00.459 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.459 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.459 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.459 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.460 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.460 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.460 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.460 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.460 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.460 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.461 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.461 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.461 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.461 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.461 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.461 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.461 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.462 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.463 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.463 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.463 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.463 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.463 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.463 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.463 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.464 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.464 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.464 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.464 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.464 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.464 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.464 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.464 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.464 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.464 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.464 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.464 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.464 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.465 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.465 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:22:00.465 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.465 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:22:00.465 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.465 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.465 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.465 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.465 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.465 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:22:00.465 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:22:00.465 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.465 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:22:00.465 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.466 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.466 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.466 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.466 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.466 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.466 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.009588+0000", 2024-03-30T12:22:00.466 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:20:37.008947+0000", 2024-03-30T12:22:00.466 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:20:37.008947+0000", 2024-03-30T12:22:00.466 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:20:37.009224+0000", 2024-03-30T12:22:00.466 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.009588+0000", 2024-03-30T12:22:00.467 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.467 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.467 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.467 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 68, 2024-03-30T12:22:00.467 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.009588+0000", 2024-03-30T12:22:00.467 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.009588+0000", 2024-03-30T12:22:00.467 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.009588+0000", 2024-03-30T12:22:00.467 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.467 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.467 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.467 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.009588+0000", 2024-03-30T12:22:00.467 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.009588+0000", 2024-03-30T12:22:00.467 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.468 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.468 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.468 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.468 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 67, 2024-03-30T12:22:00.468 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.468 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.468 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.468 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.468 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.468 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.468 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.468 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.468 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.24", 2024-03-30T12:22:00.468 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.468 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.469 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.469 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 27, 2024-03-30T12:22:00.469 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.469 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T15:42:16.251343+0000", 2024-03-30T12:22:00.469 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.469 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.469 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.469 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.469 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.469 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.469 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.469 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.469 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.469 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.469 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.470 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.470 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.470 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.470 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.470 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.470 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.470 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.470 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.470 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.470 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.470 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.471 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.471 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.471 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.471 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.471 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.471 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.471 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.471 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.471 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.471 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.471 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.471 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.471 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.471 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.471 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.472 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.472 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.472 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.472 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.472 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.472 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.472 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.472 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.472 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.472 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.472 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.472 INFO:tasks.workunit.client.0.smithi084.stdout: 2, 2024-03-30T12:22:00.473 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:22:00.473 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.473 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:22:00.473 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.473 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.473 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.473 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.473 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.473 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.473 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:22:00.473 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.474 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 1, 2024-03-30T12:22:00.474 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.474 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.474 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.474 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.474 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.474 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.474 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006343+0000", 2024-03-30T12:22:00.474 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.848029+0000", 2024-03-30T12:22:00.474 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.848029+0000", 2024-03-30T12:22:00.474 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.848297+0000", 2024-03-30T12:22:00.474 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006343+0000", 2024-03-30T12:22:00.474 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.474 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.475 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.475 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.475 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006343+0000", 2024-03-30T12:22:00.475 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006343+0000", 2024-03-30T12:22:00.475 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006343+0000", 2024-03-30T12:22:00.475 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.475 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.475 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.475 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006343+0000", 2024-03-30T12:22:00.475 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006343+0000", 2024-03-30T12:22:00.475 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.475 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.475 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.475 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.475 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.476 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.476 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.476 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.476 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.476 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.476 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.476 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.476 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.476 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.25", 2024-03-30T12:22:00.476 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.476 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.476 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.476 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.476 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.476 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T22:28:38.617413+0000", 2024-03-30T12:22:00.476 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.477 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.477 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.477 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.478 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.478 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.478 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.478 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.478 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.478 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.478 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.478 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.478 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.478 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.478 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.478 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.478 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.478 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.479 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.480 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.480 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.480 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.480 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.480 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.480 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.480 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.480 INFO:tasks.workunit.client.0.smithi084.stdout: 1, 2024-03-30T12:22:00.480 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.480 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:22:00.480 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.480 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 1, 2024-03-30T12:22:00.480 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.480 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.480 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.481 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.481 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:22:00.481 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.481 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:22:00.481 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.481 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:22:00.481 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.481 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.481 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.481 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.481 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.481 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.481 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.240786+0000", 2024-03-30T12:22:00.481 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.869115+0000", 2024-03-30T12:22:00.481 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.869115+0000", 2024-03-30T12:22:00.481 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.869414+0000", 2024-03-30T12:22:00.482 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.240786+0000", 2024-03-30T12:22:00.482 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.482 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.482 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.482 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.482 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.240786+0000", 2024-03-30T12:22:00.482 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.240786+0000", 2024-03-30T12:22:00.482 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.240786+0000", 2024-03-30T12:22:00.482 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.483 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.483 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.483 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.240786+0000", 2024-03-30T12:22:00.483 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.240786+0000", 2024-03-30T12:22:00.483 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.483 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.483 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.483 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.483 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.483 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.483 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.483 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.483 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.483 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.484 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.484 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.484 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.484 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.26", 2024-03-30T12:22:00.484 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.484 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.484 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.484 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.484 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.484 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T19:01:12.173692+0000", 2024-03-30T12:22:00.484 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.484 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.484 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.485 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.485 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.485 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.485 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.485 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.485 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.485 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.485 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.485 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.485 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.485 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.485 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.485 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.485 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.485 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.485 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.486 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.487 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.487 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.487 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.488 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.488 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.488 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:22:00.488 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.488 INFO:tasks.workunit.client.0.smithi084.stdout: 4 2024-03-30T12:22:00.488 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.488 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:22:00.488 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.488 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.488 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.488 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.488 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.488 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.488 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:22:00.488 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.489 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:22:00.489 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.489 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.489 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.489 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.489 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.489 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.489 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.004639+0000", 2024-03-30T12:22:00.489 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.855480+0000", 2024-03-30T12:22:00.489 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.855480+0000", 2024-03-30T12:22:00.489 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.856088+0000", 2024-03-30T12:22:00.489 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.004639+0000", 2024-03-30T12:22:00.489 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.490 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.490 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.490 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.490 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.004639+0000", 2024-03-30T12:22:00.490 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.004639+0000", 2024-03-30T12:22:00.490 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.004639+0000", 2024-03-30T12:22:00.490 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.490 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.490 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.490 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.004639+0000", 2024-03-30T12:22:00.490 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.004639+0000", 2024-03-30T12:22:00.490 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.490 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.490 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.490 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.491 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.491 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.491 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.491 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.491 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.491 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.491 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.491 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.491 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.491 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.27", 2024-03-30T12:22:00.491 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.491 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.491 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.491 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.491 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.492 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:21:16.961559+0000", 2024-03-30T12:22:00.492 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.492 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.492 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.492 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.492 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.492 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.492 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.492 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.492 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.492 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.492 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.492 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.492 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.492 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.492 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.493 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.494 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.494 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.494 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.494 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.494 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.494 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.494 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.494 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.494 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.494 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.494 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.494 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.494 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.495 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.495 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.495 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.495 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.495 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.495 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.495 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.495 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.495 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.495 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:22:00.495 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.495 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:22:00.495 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.495 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.495 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.496 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.496 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.496 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.496 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:22:00.496 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.496 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:22:00.496 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.496 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.496 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.496 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.496 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.496 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.496 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006280+0000", 2024-03-30T12:22:00.496 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.854390+0000", 2024-03-30T12:22:00.496 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.854390+0000", 2024-03-30T12:22:00.497 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.854668+0000", 2024-03-30T12:22:00.497 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006280+0000", 2024-03-30T12:22:00.497 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.497 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.497 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.497 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.497 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006280+0000", 2024-03-30T12:22:00.497 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006280+0000", 2024-03-30T12:22:00.497 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006280+0000", 2024-03-30T12:22:00.497 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.497 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.497 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.497 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006280+0000", 2024-03-30T12:22:00.497 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006280+0000", 2024-03-30T12:22:00.498 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.498 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.498 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.498 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.498 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.498 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.498 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.498 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.498 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.498 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.498 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.499 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.499 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.499 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.28", 2024-03-30T12:22:00.499 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.499 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.499 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.499 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.499 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.499 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T14:39:22.128098+0000", 2024-03-30T12:22:00.499 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.499 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.500 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.500 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.501 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.501 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.501 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.501 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.501 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.501 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.501 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.501 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.501 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.501 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.501 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.501 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.501 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.501 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.501 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.501 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.502 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.502 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.502 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.502 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.502 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.502 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.502 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.502 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.502 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.502 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.502 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.502 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.502 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.503 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.503 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.503 INFO:tasks.workunit.client.0.smithi084.stdout: 2 2024-03-30T12:22:00.503 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.503 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:22:00.503 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.503 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.503 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.503 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.503 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.503 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.503 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:22:00.504 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.504 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 3, 2024-03-30T12:22:00.504 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.504 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.504 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.504 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.504 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.504 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.504 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.003796+0000", 2024-03-30T12:22:00.504 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.850915+0000", 2024-03-30T12:22:00.504 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.850915+0000", 2024-03-30T12:22:00.504 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.851282+0000", 2024-03-30T12:22:00.504 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.003796+0000", 2024-03-30T12:22:00.505 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.505 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.505 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.505 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.505 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.003796+0000", 2024-03-30T12:22:00.505 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.003796+0000", 2024-03-30T12:22:00.505 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.003796+0000", 2024-03-30T12:22:00.505 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.505 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.505 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.505 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.003796+0000", 2024-03-30T12:22:00.505 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.003796+0000", 2024-03-30T12:22:00.505 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.505 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.505 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.505 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.506 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.506 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.506 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.506 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.506 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.506 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.506 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.506 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.506 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.506 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.29", 2024-03-30T12:22:00.506 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.506 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.506 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.506 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.506 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.506 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T16:46:50.526568+0000", 2024-03-30T12:22:00.507 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.507 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.507 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.507 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.508 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.508 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.508 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.508 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.508 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.508 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.508 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.508 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.508 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.508 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.508 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.508 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.508 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.509 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.509 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.509 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.509 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.509 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.509 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.509 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.509 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.509 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.509 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.509 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.509 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.509 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.509 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.510 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.510 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.510 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.510 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.510 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.510 INFO:tasks.workunit.client.0.smithi084.stdout: 3, 2024-03-30T12:22:00.510 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.510 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:22:00.510 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.510 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 3, 2024-03-30T12:22:00.510 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.510 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.511 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.511 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.511 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.511 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.511 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:22:00.511 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.511 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 5, 2024-03-30T12:22:00.511 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.511 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.511 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.511 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.511 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.512 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.512 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.006481+0000", 2024-03-30T12:22:00.512 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.860085+0000", 2024-03-30T12:22:00.512 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.860085+0000", 2024-03-30T12:22:00.512 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.860406+0000", 2024-03-30T12:22:00.512 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.006481+0000", 2024-03-30T12:22:00.512 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.512 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.512 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.512 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.512 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.006481+0000", 2024-03-30T12:22:00.512 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.006481+0000", 2024-03-30T12:22:00.512 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.006481+0000", 2024-03-30T12:22:00.512 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.513 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.513 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.513 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.006481+0000", 2024-03-30T12:22:00.513 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.006481+0000", 2024-03-30T12:22:00.513 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.513 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.513 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.513 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.513 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.513 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.513 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.513 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.513 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.514 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.514 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.514 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.514 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.514 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2a", 2024-03-30T12:22:00.514 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.514 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.514 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.514 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.514 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.515 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T23:47:32.201939+0000", 2024-03-30T12:22:00.515 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.515 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.515 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.515 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.515 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.515 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.515 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.515 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.515 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.515 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.515 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.515 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.515 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.516 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.516 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.516 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.516 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.516 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.516 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.516 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.516 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.516 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.516 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.516 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.516 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.516 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.516 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.517 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.518 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.518 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.518 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.518 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.518 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.518 INFO:tasks.workunit.client.0.smithi084.stdout: 5, 2024-03-30T12:22:00.518 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.518 INFO:tasks.workunit.client.0.smithi084.stdout: 6 2024-03-30T12:22:00.518 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.518 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 5, 2024-03-30T12:22:00.518 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.518 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.518 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.518 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.518 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.519 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.519 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:22:00.519 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.519 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 0, 2024-03-30T12:22:00.519 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.519 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.519 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.519 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.519 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.519 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.519 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.005906+0000", 2024-03-30T12:22:00.519 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.856643+0000", 2024-03-30T12:22:00.520 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.856643+0000", 2024-03-30T12:22:00.520 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.856917+0000", 2024-03-30T12:22:00.520 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.005906+0000", 2024-03-30T12:22:00.520 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.520 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.520 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.520 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.520 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.005906+0000", 2024-03-30T12:22:00.520 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.005906+0000", 2024-03-30T12:22:00.520 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.005906+0000", 2024-03-30T12:22:00.520 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.520 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.520 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.521 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.005906+0000", 2024-03-30T12:22:00.521 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.005906+0000", 2024-03-30T12:22:00.521 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.521 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.521 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.521 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.521 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.521 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.522 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.522 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.522 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.522 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.522 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.522 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.522 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.523 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2b", 2024-03-30T12:22:00.523 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.523 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.523 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.523 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.523 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.523 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T22:51:53.996045+0000", 2024-03-30T12:22:00.523 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.523 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.523 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.523 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.523 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.524 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.524 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.524 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.524 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.524 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.524 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.524 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.524 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.524 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.524 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.524 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.524 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.524 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.525 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.526 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.526 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.526 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.527 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.527 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.527 INFO:tasks.workunit.client.0.smithi084.stdout: 0, 2024-03-30T12:22:00.527 INFO:tasks.workunit.client.0.smithi084.stdout: 7, 2024-03-30T12:22:00.527 INFO:tasks.workunit.client.0.smithi084.stdout: 1 2024-03-30T12:22:00.527 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.527 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 0, 2024-03-30T12:22:00.527 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.527 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.527 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.527 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": [ 2024-03-30T12:22:00.527 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:22:00.527 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.527 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:22:00.527 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.527 INFO:tasks.workunit.client.0.smithi084.stdout: "acting_primary": 6, 2024-03-30T12:22:00.528 INFO:tasks.workunit.client.0.smithi084.stdout: "avail_no_missing": [], 2024-03-30T12:22:00.528 INFO:tasks.workunit.client.0.smithi084.stdout: "blocked_by": [], 2024-03-30T12:22:00.528 INFO:tasks.workunit.client.0.smithi084.stdout: "created": 60, 2024-03-30T12:22:00.528 INFO:tasks.workunit.client.0.smithi084.stdout: "dirty_stats_invalid": false, 2024-03-30T12:22:00.528 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_bytes_stats_invalid": false, 2024-03-30T12:22:00.528 INFO:tasks.workunit.client.0.smithi084.stdout: "hitset_stats_invalid": false, 2024-03-30T12:22:00.528 INFO:tasks.workunit.client.0.smithi084.stdout: "last_active": "2024-03-30T12:20:37.240724+0000", 2024-03-30T12:22:00.528 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_active": "2024-03-30T12:19:00.866801+0000", 2024-03-30T12:22:00.528 INFO:tasks.workunit.client.0.smithi084.stdout: "last_became_peered": "2024-03-30T12:19:00.866801+0000", 2024-03-30T12:22:00.528 INFO:tasks.workunit.client.0.smithi084.stdout: "last_change": "2024-03-30T12:19:00.867176+0000", 2024-03-30T12:22:00.528 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean": "2024-03-30T12:20:37.240724+0000", 2024-03-30T12:22:00.528 INFO:tasks.workunit.client.0.smithi084.stdout: "last_clean_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.528 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub": "0'0", 2024-03-30T12:22:00.528 INFO:tasks.workunit.client.0.smithi084.stdout: "last_deep_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.528 INFO:tasks.workunit.client.0.smithi084.stdout: "last_epoch_clean": 61, 2024-03-30T12:22:00.528 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fresh": "2024-03-30T12:20:37.240724+0000", 2024-03-30T12:22:00.529 INFO:tasks.workunit.client.0.smithi084.stdout: "last_fullsized": "2024-03-30T12:20:37.240724+0000", 2024-03-30T12:22:00.529 INFO:tasks.workunit.client.0.smithi084.stdout: "last_peered": "2024-03-30T12:20:37.240724+0000", 2024-03-30T12:22:00.529 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub": "0'0", 2024-03-30T12:22:00.529 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_duration": 0, 2024-03-30T12:22:00.529 INFO:tasks.workunit.client.0.smithi084.stdout: "last_scrub_stamp": "2024-03-30T12:19:00.437665+0000", 2024-03-30T12:22:00.529 INFO:tasks.workunit.client.0.smithi084.stdout: "last_undegraded": "2024-03-30T12:20:37.240724+0000", 2024-03-30T12:22:00.529 INFO:tasks.workunit.client.0.smithi084.stdout: "last_unstale": "2024-03-30T12:20:37.240724+0000", 2024-03-30T12:22:00.529 INFO:tasks.workunit.client.0.smithi084.stdout: "log_dups_size": 0, 2024-03-30T12:22:00.529 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.529 INFO:tasks.workunit.client.0.smithi084.stdout: "log_start": "0'0", 2024-03-30T12:22:00.529 INFO:tasks.workunit.client.0.smithi084.stdout: "manifest_stats_invalid": false, 2024-03-30T12:22:00.530 INFO:tasks.workunit.client.0.smithi084.stdout: "mapping_epoch": 60, 2024-03-30T12:22:00.530 INFO:tasks.workunit.client.0.smithi084.stdout: "object_location_counts": [], 2024-03-30T12:22:00.530 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_scrubbed": 0, 2024-03-30T12:22:00.530 INFO:tasks.workunit.client.0.smithi084.stdout: "objects_trimmed": 0, 2024-03-30T12:22:00.530 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_stats_invalid": false, 2024-03-30T12:22:00.530 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.530 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_start": "0'0", 2024-03-30T12:22:00.530 INFO:tasks.workunit.client.0.smithi084.stdout: "parent": "0.0", 2024-03-30T12:22:00.530 INFO:tasks.workunit.client.0.smithi084.stdout: "parent_split_bits": 0, 2024-03-30T12:22:00.530 INFO:tasks.workunit.client.0.smithi084.stdout: "pgid": "3.2c", 2024-03-30T12:22:00.530 INFO:tasks.workunit.client.0.smithi084.stdout: "pin_stats_invalid": false, 2024-03-30T12:22:00.531 INFO:tasks.workunit.client.0.smithi084.stdout: "purged_snaps": [], 2024-03-30T12:22:00.531 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_epoch": 68, 2024-03-30T12:22:00.531 INFO:tasks.workunit.client.0.smithi084.stdout: "reported_seq": 18, 2024-03-30T12:22:00.531 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_duration": 0.0, 2024-03-30T12:22:00.531 INFO:tasks.workunit.client.0.smithi084.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-03-31T18:31:22.909206+0000", 2024-03-30T12:22:00.531 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrim_duration": 0.0, 2024-03-30T12:22:00.531 INFO:tasks.workunit.client.0.smithi084.stdout: "snaptrimq_len": 0, 2024-03-30T12:22:00.531 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.531 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.531 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.531 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.531 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.531 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.532 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.533 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.534 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.534 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.534 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.534 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.534 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.534 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.534 INFO:tasks.workunit.client.0.smithi084.stdout: "state": "active+clean", 2024-03-30T12:22:00.534 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_invalid": false, 2024-03-30T12:22:00.534 INFO:tasks.workunit.client.0.smithi084.stdout: "up": [ 2024-03-30T12:22:00.534 INFO:tasks.workunit.client.0.smithi084.stdout: 6, 2024-03-30T12:22:00.534 INFO:tasks.workunit.client.0.smithi084.stdout: 4, 2024-03-30T12:22:00.535 INFO:tasks.workunit.client.0.smithi084.stdout: 0 2024-03-30T12:22:00.535 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.535 INFO:tasks.workunit.client.0.smithi084.stdout: "up_primary": 6, 2024-03-30T12:22:00.535 INFO:tasks.workunit.client.0.smithi084.stdout: "version": "0'0" 2024-03-30T12:22:00.535 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:22:00.535 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.535 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_per_pool": [ 2024-03-30T12:22:00.535 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.535 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": 24, 2024-03-30T12:22:00.535 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-03-30T12:22:00.535 INFO:tasks.workunit.client.0.smithi084.stdout: "rbd" 2024-03-30T12:22:00.535 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.535 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.536 INFO:tasks.workunit.client.0.smithi084.stdout: "num_pg": 8, 2024-03-30T12:22:00.536 INFO:tasks.workunit.client.0.smithi084.stdout: "num_store_stats": 8, 2024-03-30T12:22:00.536 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.536 INFO:tasks.workunit.client.0.smithi084.stdout: "poolid": 4, 2024-03-30T12:22:00.536 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.536 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.536 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.536 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.536 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.536 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.536 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.536 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.536 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.536 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.536 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.537 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.537 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.537 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.537 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.537 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.537 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.537 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.537 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.537 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.537 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.537 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.537 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.537 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.537 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.537 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.537 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.538 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.538 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.539 INFO:tasks.workunit.client.0.smithi084.stdout: "store_stats": { 2024-03-30T12:22:00.539 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": 0, 2024-03-30T12:22:00.539 INFO:tasks.workunit.client.0.smithi084.stdout: "available": 0, 2024-03-30T12:22:00.539 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed": 0, 2024-03-30T12:22:00.539 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_allocated": 0, 2024-03-30T12:22:00.539 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_original": 0, 2024-03-30T12:22:00.539 INFO:tasks.workunit.client.0.smithi084.stdout: "data_stored": 0, 2024-03-30T12:22:00.539 INFO:tasks.workunit.client.0.smithi084.stdout: "internal_metadata": 0, 2024-03-30T12:22:00.539 INFO:tasks.workunit.client.0.smithi084.stdout: "internally_reserved": 0, 2024-03-30T12:22:00.539 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_allocated": 0, 2024-03-30T12:22:00.539 INFO:tasks.workunit.client.0.smithi084.stdout: "total": 0 2024-03-30T12:22:00.539 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.540 INFO:tasks.workunit.client.0.smithi084.stdout: "up": 24 2024-03-30T12:22:00.540 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.540 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.540 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": 192, 2024-03-30T12:22:00.540 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-03-30T12:22:00.540 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs" 2024-03-30T12:22:00.540 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.540 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 0, 2024-03-30T12:22:00.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_pg": 64, 2024-03-30T12:22:00.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_store_stats": 8, 2024-03-30T12:22:00.540 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 0, 2024-03-30T12:22:00.540 INFO:tasks.workunit.client.0.smithi084.stdout: "poolid": 3, 2024-03-30T12:22:00.540 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 0, 2024-03-30T12:22:00.540 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.541 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.542 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.542 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.542 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 0, 2024-03-30T12:22:00.542 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 0, 2024-03-30T12:22:00.542 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.542 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 0, 2024-03-30T12:22:00.542 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.542 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.542 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.542 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.542 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.542 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.542 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.543 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.543 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.543 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.543 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.543 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.543 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.543 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.543 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.543 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.543 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.543 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.543 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 0, 2024-03-30T12:22:00.543 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 0 2024-03-30T12:22:00.543 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.543 INFO:tasks.workunit.client.0.smithi084.stdout: "store_stats": { 2024-03-30T12:22:00.544 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": 0, 2024-03-30T12:22:00.544 INFO:tasks.workunit.client.0.smithi084.stdout: "available": 0, 2024-03-30T12:22:00.544 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed": 0, 2024-03-30T12:22:00.544 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_allocated": 0, 2024-03-30T12:22:00.544 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_original": 0, 2024-03-30T12:22:00.544 INFO:tasks.workunit.client.0.smithi084.stdout: "data_stored": 0, 2024-03-30T12:22:00.544 INFO:tasks.workunit.client.0.smithi084.stdout: "internal_metadata": 0, 2024-03-30T12:22:00.544 INFO:tasks.workunit.client.0.smithi084.stdout: "internally_reserved": 0, 2024-03-30T12:22:00.544 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_allocated": 0, 2024-03-30T12:22:00.544 INFO:tasks.workunit.client.0.smithi084.stdout: "total": 0 2024-03-30T12:22:00.544 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.544 INFO:tasks.workunit.client.0.smithi084.stdout: "up": 192 2024-03-30T12:22:00.544 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.545 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.545 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": 3, 2024-03-30T12:22:00.545 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-03-30T12:22:00.545 INFO:tasks.workunit.client.0.smithi084.stdout: "mgr" 2024-03-30T12:22:00.545 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.545 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 156, 2024-03-30T12:22:00.545 INFO:tasks.workunit.client.0.smithi084.stdout: "num_pg": 1, 2024-03-30T12:22:00.545 INFO:tasks.workunit.client.0.smithi084.stdout: "num_store_stats": 3, 2024-03-30T12:22:00.545 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 156, 2024-03-30T12:22:00.545 INFO:tasks.workunit.client.0.smithi084.stdout: "poolid": 1, 2024-03-30T12:22:00.545 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.545 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 590368, 2024-03-30T12:22:00.545 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.545 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 1771104, 2024-03-30T12:22:00.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.546 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 6, 2024-03-30T12:22:00.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 2, 2024-03-30T12:22:00.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 2, 2024-03-30T12:22:00.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 0, 2024-03-30T12:22:00.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 6, 2024-03-30T12:22:00.547 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.548 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.548 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.548 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.548 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.548 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 466, 2024-03-30T12:22:00.548 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 644, 2024-03-30T12:22:00.548 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.548 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.548 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.548 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 235, 2024-03-30T12:22:00.548 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 2416 2024-03-30T12:22:00.548 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.549 INFO:tasks.workunit.client.0.smithi084.stdout: "store_stats": { 2024-03-30T12:22:00.549 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": 1781760, 2024-03-30T12:22:00.549 INFO:tasks.workunit.client.0.smithi084.stdout: "available": 0, 2024-03-30T12:22:00.549 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed": 0, 2024-03-30T12:22:00.549 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_allocated": 0, 2024-03-30T12:22:00.549 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_original": 0, 2024-03-30T12:22:00.549 INFO:tasks.workunit.client.0.smithi084.stdout: "data_stored": 1771104, 2024-03-30T12:22:00.549 INFO:tasks.workunit.client.0.smithi084.stdout: "internal_metadata": 0, 2024-03-30T12:22:00.549 INFO:tasks.workunit.client.0.smithi084.stdout: "internally_reserved": 0, 2024-03-30T12:22:00.549 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_allocated": 0, 2024-03-30T12:22:00.549 INFO:tasks.workunit.client.0.smithi084.stdout: "total": 0 2024-03-30T12:22:00.549 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.549 INFO:tasks.workunit.client.0.smithi084.stdout: "up": 3 2024-03-30T12:22:00.549 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.549 INFO:tasks.workunit.client.0.smithi084.stdout: { 2024-03-30T12:22:00.550 INFO:tasks.workunit.client.0.smithi084.stdout: "acting": 96, 2024-03-30T12:22:00.550 INFO:tasks.workunit.client.0.smithi084.stdout: "application": [ 2024-03-30T12:22:00.550 INFO:tasks.workunit.client.0.smithi084.stdout: "cephfs" 2024-03-30T12:22:00.550 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.550 INFO:tasks.workunit.client.0.smithi084.stdout: "log_size": 45, 2024-03-30T12:22:00.550 INFO:tasks.workunit.client.0.smithi084.stdout: "num_pg": 32, 2024-03-30T12:22:00.550 INFO:tasks.workunit.client.0.smithi084.stdout: "num_store_stats": 8, 2024-03-30T12:22:00.550 INFO:tasks.workunit.client.0.smithi084.stdout: "ondisk_log_size": 45, 2024-03-30T12:22:00.550 INFO:tasks.workunit.client.0.smithi084.stdout: "poolid": 2, 2024-03-30T12:22:00.550 INFO:tasks.workunit.client.0.smithi084.stdout: "stat_sum": { 2024-03-30T12:22:00.550 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes": 3430, 2024-03-30T12:22:00.550 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_hit_set_archive": 0, 2024-03-30T12:22:00.551 INFO:tasks.workunit.client.0.smithi084.stdout: "num_bytes_recovered": 0, 2024-03-30T12:22:00.551 INFO:tasks.workunit.client.0.smithi084.stdout: "num_deep_scrub_errors": 0, 2024-03-30T12:22:00.551 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict": 0, 2024-03-30T12:22:00.551 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_kb": 0, 2024-03-30T12:22:00.551 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_full": 0, 2024-03-30T12:22:00.551 INFO:tasks.workunit.client.0.smithi084.stdout: "num_evict_mode_some": 0, 2024-03-30T12:22:00.551 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush": 0, 2024-03-30T12:22:00.551 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_kb": 0, 2024-03-30T12:22:00.551 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_high": 0, 2024-03-30T12:22:00.551 INFO:tasks.workunit.client.0.smithi084.stdout: "num_flush_mode_low": 0, 2024-03-30T12:22:00.551 INFO:tasks.workunit.client.0.smithi084.stdout: "num_keys_recovered": 0, 2024-03-30T12:22:00.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_large_omap_objects": 0, 2024-03-30T12:22:00.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_legacy_snapsets": 0, 2024-03-30T12:22:00.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_clones": 0, 2024-03-30T12:22:00.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_object_copies": 66, 2024-03-30T12:22:00.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects": 22, 2024-03-30T12:22:00.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_degraded": 0, 2024-03-30T12:22:00.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_dirty": 22, 2024-03-30T12:22:00.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_hit_set_archive": 0, 2024-03-30T12:22:00.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_manifest": 0, 2024-03-30T12:22:00.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_misplaced": 0, 2024-03-30T12:22:00.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing": 0, 2024-03-30T12:22:00.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_missing_on_primary": 0, 2024-03-30T12:22:00.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_omap": 14, 2024-03-30T12:22:00.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_pinned": 0, 2024-03-30T12:22:00.552 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_recovered": 0, 2024-03-30T12:22:00.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_repaired": 0, 2024-03-30T12:22:00.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_objects_unfound": 0, 2024-03-30T12:22:00.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_bytes": 0, 2024-03-30T12:22:00.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_omap_keys": 0, 2024-03-30T12:22:00.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_promote": 0, 2024-03-30T12:22:00.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read": 0, 2024-03-30T12:22:00.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_read_kb": 0, 2024-03-30T12:22:00.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_scrub_errors": 0, 2024-03-30T12:22:00.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_shallow_scrub_errors": 0, 2024-03-30T12:22:00.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_whiteouts": 0, 2024-03-30T12:22:00.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write": 51, 2024-03-30T12:22:00.553 INFO:tasks.workunit.client.0.smithi084.stdout: "num_write_kb": 20 2024-03-30T12:22:00.553 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.553 INFO:tasks.workunit.client.0.smithi084.stdout: "store_stats": { 2024-03-30T12:22:00.554 INFO:tasks.workunit.client.0.smithi084.stdout: "allocated": 98304, 2024-03-30T12:22:00.554 INFO:tasks.workunit.client.0.smithi084.stdout: "available": 0, 2024-03-30T12:22:00.554 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed": 0, 2024-03-30T12:22:00.554 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_allocated": 0, 2024-03-30T12:22:00.554 INFO:tasks.workunit.client.0.smithi084.stdout: "data_compressed_original": 0, 2024-03-30T12:22:00.554 INFO:tasks.workunit.client.0.smithi084.stdout: "data_stored": 10290, 2024-03-30T12:22:00.554 INFO:tasks.workunit.client.0.smithi084.stdout: "internal_metadata": 0, 2024-03-30T12:22:00.554 INFO:tasks.workunit.client.0.smithi084.stdout: "internally_reserved": 0, 2024-03-30T12:22:00.554 INFO:tasks.workunit.client.0.smithi084.stdout: "omap_allocated": 0, 2024-03-30T12:22:00.554 INFO:tasks.workunit.client.0.smithi084.stdout: "total": 0 2024-03-30T12:22:00.554 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.554 INFO:tasks.workunit.client.0.smithi084.stdout: "up": 96 2024-03-30T12:22:00.554 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:22:00.555 INFO:tasks.workunit.client.0.smithi084.stdout: ], 2024-03-30T12:22:00.555 INFO:tasks.workunit.client.0.smithi084.stdout: "usage": { 2024-03-30T12:22:00.555 INFO:tasks.workunit.client.0.smithi084.stdout: "pg_num": 105, 2024-03-30T12:22:00.555 INFO:tasks.workunit.client.0.smithi084.stdout: "pools": 4, 2024-03-30T12:22:00.555 INFO:tasks.workunit.client.0.smithi084.stdout: "stats_by_class": { 2024-03-30T12:22:00.555 INFO:tasks.workunit.client.0.smithi084.stdout: "ssd": { 2024-03-30T12:22:00.555 INFO:tasks.workunit.client.0.smithi084.stdout: "total_avail_bytes": 767710556160, 2024-03-30T12:22:00.555 INFO:tasks.workunit.client.0.smithi084.stdout: "total_bytes": 767960285184, 2024-03-30T12:22:00.555 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_bytes": 249729024, 2024-03-30T12:22:00.555 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_raw_bytes": 249729024, 2024-03-30T12:22:00.555 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_raw_ratio": 0.0003251848102081567 2024-03-30T12:22:00.555 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:22:00.555 INFO:tasks.workunit.client.0.smithi084.stdout: }, 2024-03-30T12:22:00.556 INFO:tasks.workunit.client.0.smithi084.stdout: "total_avail_bytes": 767710556160, 2024-03-30T12:22:00.556 INFO:tasks.workunit.client.0.smithi084.stdout: "total_bytes": 767960285184, 2024-03-30T12:22:00.556 INFO:tasks.workunit.client.0.smithi084.stdout: "total_used_bytes": 249729024 2024-03-30T12:22:00.556 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:22:00.556 INFO:tasks.workunit.client.0.smithi084.stdout: } 2024-03-30T12:22:00.556 INFO:tasks.workunit.client.0.smithi084.stdout:} 2024-03-30T12:22:00.556 INFO:tasks.workunit.client.0.smithi084.stdout:OK 2024-03-30T12:22:00.556 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-30T12:22:00.557 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-30T12:22:00.557 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='client.24917 -' entity='client.admin' cmd=[{"prefix": "telemetry show-all", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:22:00.557 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:22:00.557 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:22:00.557 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.557 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.557 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.558 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.558 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.558 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.558 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.558 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.558 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.558 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:22:00.558 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:22:00.558 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.558 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.558 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.559 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:22:00.559 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:22:00.559 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.559 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.559 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.559 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:22:00.559 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:22:00.559 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.559 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.559 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='client.24917 -' entity='client.admin' cmd=[{"prefix": "telemetry show-all", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:22:00.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:22:00.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:22:00.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:22:00.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:22:00.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:22:00.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:22:00.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:22:00.562 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:22:00.562 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.562 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.562 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.562 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='client.24917 -' entity='client.admin' cmd=[{"prefix": "telemetry show-all", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:22:00.562 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:22:00.563 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:22:00.563 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.563 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.563 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.563 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.563 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:22:00.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:22:00.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:22:00.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:22:00.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.564 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.565 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.565 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:22:00.565 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:22:00.565 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.565 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.565 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.565 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='client.24917 -' entity='client.admin' cmd=[{"prefix": "telemetry show-all", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:22:00.565 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:22:00.566 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:22:00.566 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.566 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.566 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.566 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.566 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.566 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.566 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.566 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.566 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.566 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:22:00.567 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:22:00.567 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.567 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.567 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.567 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:22:00.567 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:22:00.567 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.567 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.567 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:22:00.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:22:00.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:58 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.568 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:21:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:21:59] "GET /metrics HTTP/1.1" 200 33657 "" "Prometheus/2.43.0" 2024-03-30T12:22:00.569 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:21:59 smithi084 ceph-mon[37565]: pgmap v78: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 25 op/s 2024-03-30T12:22:00.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:21:59 smithi084 ceph-mon[27000]: pgmap v78: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 25 op/s 2024-03-30T12:22:00.570 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='client.24917 -' entity='client.admin' cmd=[{"prefix": "telemetry show-all", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:22:00.570 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:22:00.570 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:22:00.570 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.570 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.570 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.570 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.570 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:22:00.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:22:00.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:22:00.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:22:00.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:22:00.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:22:00.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='client.24917 -' entity='client.admin' cmd=[{"prefix": "telemetry show-all", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:22:00.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:22:00.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:22:00.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.573 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.573 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.573 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.573 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.573 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.573 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.573 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:22:00.573 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:22:00.573 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.573 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.573 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.573 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:22:00.574 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:22:00.574 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.574 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.574 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.574 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:22:00.574 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:22:00.574 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:22:00.574 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:22:00.574 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:58 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:22:00.574 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:21:59 smithi162 ceph-mon[30421]: pgmap v78: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 25 op/s 2024-03-30T12:22:00.604 INFO:tasks.workunit:Stopping ['test_telemetry_reef.sh'] on client.0... 2024-03-30T12:22:00.604 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-30T12:22:00.895 DEBUG:teuthology.parallel:result is None 2024-03-30T12:22:00.896 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-30T12:22:00.922 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-30T12:22:00.922 DEBUG:teuthology.orchestra.run.smithi084:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-30T12:22:00.982 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-30T12:22:00.982 INFO:teuthology.run_tasks:Running task print... 2024-03-30T12:22:00.993 INFO:teuthology.task.print:**** done end telemetry reef... 2024-03-30T12:22:00.993 INFO:teuthology.run_tasks:Running task print... 2024-03-30T12:22:01.017 INFO:teuthology.task.print:**** done start parallel 2024-03-30T12:22:01.018 INFO:teuthology.run_tasks:Running task parallel... 2024-03-30T12:22:01.185 INFO:teuthology.task.parallel:starting parallel... 2024-03-30T12:22:01.185 INFO:teuthology.task.parallel:In parallel, running task full_sequential... 2024-03-30T12:22:01.186 INFO:teuthology.task.full_sequential:In full_sequential, running task print... 2024-03-30T12:22:01.186 INFO:teuthology.task.print:**** done start ec-rados-default.yaml 2024-03-30T12:22:01.186 INFO:teuthology.task.full_sequential:In full_sequential, running task rados... 2024-03-30T12:22:01.188 INFO:tasks.rados:Beginning rados... 2024-03-30T12:22:01.188 INFO:tasks.rados:config is {'clients': ['client.0'], 'ec_pool': True, 'objects': 50, 'op_weights': {'append': 100, 'copy_from': 50, 'delete': 50, 'read': 100, 'rmattr': 25, 'rollback': 50, 'setattr': 25, 'snap_create': 50, 'snap_remove': 50, 'write': 0}, 'ops': 4000, 'write_append_excl': False} 2024-03-30T12:22:01.188 INFO:tasks.rados:overrides is {'admin_socket': {'branch': 'wip-ceph_test_rados-partial-reads'}, 'ceph': {'conf': {'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd shutdown pgref assert': True}}, 'create_rbd_pool': True, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'extra_system_packages': ['python3-pytest'], 'flavor': 'default', 'sha1': '5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'workunit': {'branch': 'wip-ceph_test_rados-partial-reads', 'sha1': '5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc'}} 2024-03-30T12:22:01.188 INFO:tasks.rados:config is {'clients': ['client.0'], 'ec_pool': True, 'objects': 50, 'op_weights': {'append': 100, 'copy_from': 50, 'delete': 50, 'read': 100, 'rmattr': 25, 'rollback': 50, 'setattr': 25, 'snap_create': 50, 'snap_remove': 50, 'write': 0}, 'ops': 4000, 'write_append_excl': False} 2024-03-30T12:22:01.188 INFO:tasks.rados:joining rados 2024-03-30T12:22:01.188 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-03-30T12:22:01.204 INFO:teuthology.task.sequential:In sequential, running task print... 2024-03-30T12:22:01.204 INFO:teuthology.task.print:**** done start upgrade, wait 2024-03-30T12:22:01.204 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-03-30T12:22:01.205 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi084.front.sepia.ceph.com 2024-03-30T12:22:01.205 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -e sha1=5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc -- bash -c 'ceph config set global log_to_journald false --force' 2024-03-30T12:22:01.205 INFO:tasks.rados:clients are ['client.0', 'client.1'] 2024-03-30T12:22:01.206 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph osd erasure-code-profile set teuthologyprofile k=2 m=1 crush-failure-domain=osd 2024-03-30T12:22:01.428 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:22:01.428 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:22:03.201 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:02 smithi084 ceph-mon[37565]: pgmap v79: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 0 B/s wr, 40 op/s 2024-03-30T12:22:03.201 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:02 smithi084 ceph-mon[27000]: pgmap v79: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 0 B/s wr, 40 op/s 2024-03-30T12:22:03.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:02 smithi162 ceph-mon[30421]: pgmap v79: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 0 B/s wr, 40 op/s 2024-03-30T12:22:05.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:04 smithi084 ceph-mon[27000]: pgmap v80: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 0 B/s wr, 40 op/s 2024-03-30T12:22:05.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:04 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3242521066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T12:22:05.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:04 smithi084 ceph-mon[37565]: pgmap v80: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 0 B/s wr, 40 op/s 2024-03-30T12:22:05.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:04 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/3242521066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T12:22:05.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:04 smithi162 ceph-mon[30421]: pgmap v80: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 0 B/s wr, 40 op/s 2024-03-30T12:22:05.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:04 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/3242521066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T12:22:05.829 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -e sha1=5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-03-30T12:22:06.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:05 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/3242521066' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T12:22:06.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:05 smithi084 ceph-mon[37565]: osdmap e69: 8 total, 8 up, 8 in 2024-03-30T12:22:06.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:05 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:22:06.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:05 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3242521066' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T12:22:06.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:05 smithi084 ceph-mon[27000]: osdmap e69: 8 total, 8 up, 8 in 2024-03-30T12:22:06.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:05 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:22:06.306 INFO:tasks.rados:starting run 0 out of 1 2024-03-30T12:22:06.306 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_0 2024-03-30T12:22:06.306 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph osd pool create unique_pool_0 16 16 erasure teuthologyprofile 2024-03-30T12:22:06.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:05 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/3242521066' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T12:22:06.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:05 smithi162 ceph-mon[30421]: osdmap e69: 8 total, 8 up, 8 in 2024-03-30T12:22:06.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:05 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:22:06.373 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:22:07.172 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:06 smithi084 ceph-mon[37565]: pgmap v82: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 46 KiB/s rd, 0 B/s wr, 48 op/s 2024-03-30T12:22:07.172 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:06 smithi084 ceph-mon[27000]: pgmap v82: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 46 KiB/s rd, 0 B/s wr, 48 op/s 2024-03-30T12:22:07.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:06 smithi162 ceph-mon[30421]: pgmap v82: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 46 KiB/s rd, 0 B/s wr, 48 op/s 2024-03-30T12:22:08.039 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:22:08.268 INFO:teuthology.orchestra.run.smithi084.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc 2024-03-30T12:22:09.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:08 smithi084 ceph-mon[37565]: pgmap v83: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 0 B/s wr, 17 op/s 2024-03-30T12:22:09.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:08 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:22:09.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:08 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:22:09.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:08 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:22:09.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:08 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:22:09.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:08 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:22:09.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:08 smithi084 ceph-mon[27000]: pgmap v83: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 0 B/s wr, 17 op/s 2024-03-30T12:22:09.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:08 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:22:09.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:08 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:22:09.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:08 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:22:09.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:08 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:22:09.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:08 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:22:09.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:08 smithi162 ceph-mon[30421]: pgmap v83: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 0 B/s wr, 17 op/s 2024-03-30T12:22:09.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:08 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:22:09.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:08 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:22:09.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:08 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:22:09.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:08 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:22:09.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:08 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:22:09.405 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -e sha1=5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true ; do ceph orch ps ; ceph versions ; sleep 30 ; done' 2024-03-30T12:22:09.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:22:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:22:09] "GET /metrics HTTP/1.1" 200 33659 "" "Prometheus/2.43.0" 2024-03-30T12:22:10.097 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:09 smithi084 ceph-mon[27000]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:22:10.097 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:09 smithi084 ceph-mon[27000]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc 2024-03-30T12:22:10.097 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:09 smithi084 ceph-mon[27000]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc 2024-03-30T12:22:10.097 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:09 smithi084 ceph-mon[37565]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:22:10.098 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:09 smithi084 ceph-mon[37565]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc 2024-03-30T12:22:10.098 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:09 smithi084 ceph-mon[37565]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc 2024-03-30T12:22:10.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:09 smithi162 ceph-mon[30421]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:22:10.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:09 smithi162 ceph-mon[30421]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc 2024-03-30T12:22:10.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:09 smithi162 ceph-mon[30421]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc 2024-03-30T12:22:10.560 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:22:10.935 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:10 smithi084 ceph-mon[37565]: pgmap v84: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 0 B/s wr, 17 op/s 2024-03-30T12:22:10.936 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:10 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/4172429193' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]: dispatch 2024-03-30T12:22:10.936 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:10 smithi084 ceph-mon[27000]: pgmap v84: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 0 B/s wr, 17 op/s 2024-03-30T12:22:10.936 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:10 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/4172429193' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]: dispatch 2024-03-30T12:22:11.271 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:10 smithi162 ceph-mon[30421]: pgmap v84: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 0 B/s wr, 17 op/s 2024-03-30T12:22:11.271 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:10 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/4172429193' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]: dispatch 2024-03-30T12:22:12.030 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'unique_pool_0' created 2024-03-30T12:22:12.344 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:12 smithi084 ceph-mon[37565]: osdmap e70: 8 total, 8 up, 8 in 2024-03-30T12:22:12.344 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:12 smithi084 ceph-mon[37565]: pgmap v86: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:12.344 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:12 smithi084 ceph-mon[27000]: osdmap e70: 8 total, 8 up, 8 in 2024-03-30T12:22:12.344 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:12 smithi084 ceph-mon[27000]: pgmap v86: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:12.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:12 smithi162 ceph-mon[30421]: osdmap e70: 8 total, 8 up, 8 in 2024-03-30T12:22:12.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:12 smithi162 ceph-mon[30421]: pgmap v86: 105 pgs: 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:12.728 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-03-30T12:22:12.928 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-03-30T12:22:13.090 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T12:22:13.090 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (91s) 64s ago 2m 17.2M - 0.25.0 c8568f914cd2 6765ce007f39 2024-03-30T12:22:13.091 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi162 *:3000 running (2m) 64s ago 2m 84.8M - 9.4.7 954c08fa6188 ff2ec7518619 2024-03-30T12:22:13.091 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (3m) 64s ago 3m 12.3M - 18.2.2-1051-gf14b5682 c8fb09e16a7d a9c2e74ca2a3 2024-03-30T12:22:13.091 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi162 running (3m) 64s ago 3m 16.7M - 18.2.2-1051-gf14b5682 c8fb09e16a7d ee1770ef5edd 2024-03-30T12:22:13.091 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi162 *:8443,8765 running (6m) 64s ago 6m 448M - 18.2.2-1051-gf14b5682 c8fb09e16a7d d0e0c63b20de 2024-03-30T12:22:13.091 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:9283,8765 running (8m) 64s ago 8m 496M - 18.2.2-1051-gf14b5682 c8fb09e16a7d 000810f2a0de 2024-03-30T12:22:13.091 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (8m) 64s ago 8m 49.8M 2048M 18.2.2-1051-gf14b5682 c8fb09e16a7d 915abc0d6de7 2024-03-30T12:22:13.091 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi162 running (7m) 64s ago 7m 39.7M 2048M 18.2.2-1051-gf14b5682 c8fb09e16a7d 5bf04eacfc81 2024-03-30T12:22:13.091 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (7m) 64s ago 7m 39.8M 2048M 18.2.2-1051-gf14b5682 c8fb09e16a7d 7db3fd996ae6 2024-03-30T12:22:13.091 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (116s) 64s ago 112s 7662k - 1.5.0 0da6a335fe13 66844bed39e8 2024-03-30T12:22:13.091 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi162 *:9100 running (108s) 64s ago 108s 7906k - 1.5.0 0da6a335fe13 3d6e28b2348d 2024-03-30T12:22:13.091 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (6m) 64s ago 6m 53.2M 2992M 18.2.2-1051-gf14b5682 c8fb09e16a7d 4cad4c4383a6 2024-03-30T12:22:13.091 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (6m) 64s ago 6m 50.5M 2992M 18.2.2-1051-gf14b5682 c8fb09e16a7d 3b30b0ea0e32 2024-03-30T12:22:13.091 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (5m) 64s ago 5m 53.5M 2992M 18.2.2-1051-gf14b5682 c8fb09e16a7d eb2412618811 2024-03-30T12:22:13.092 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (5m) 64s ago 5m 39.7M 2992M 18.2.2-1051-gf14b5682 c8fb09e16a7d 8eaf6dc73c25 2024-03-30T12:22:13.092 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi162 running (4m) 64s ago 4m 52.9M 2992M 18.2.2-1051-gf14b5682 c8fb09e16a7d 1f52e827b91a 2024-03-30T12:22:13.092 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi162 running (4m) 64s ago 4m 50.7M 2992M 18.2.2-1051-gf14b5682 c8fb09e16a7d 7ba250d154aa 2024-03-30T12:22:13.092 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi162 running (4m) 64s ago 4m 42.0M 2992M 18.2.2-1051-gf14b5682 c8fb09e16a7d 656a733e8b7a 2024-03-30T12:22:13.092 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi162 running (3m) 64s ago 3m 49.0M 2992M 18.2.2-1051-gf14b5682 c8fb09e16a7d e3246b3bc88b 2024-03-30T12:22:13.092 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi162 *:9095 running (85s) 64s ago 2m 33.0M - 2.43.0 a07b618ecd1d 9858cdf4e1f2 2024-03-30T12:22:13.178 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:22:13.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:13 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/4172429193' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]': finished 2024-03-30T12:22:13.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:13 smithi084 ceph-mon[27000]: osdmap e71: 8 total, 8 up, 8 in 2024-03-30T12:22:13.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:13 smithi084 ceph-mon[27000]: from='client.24959 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:22:13.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:13 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/4172429193' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]': finished 2024-03-30T12:22:13.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:13 smithi084 ceph-mon[37565]: osdmap e71: 8 total, 8 up, 8 in 2024-03-30T12:22:13.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:13 smithi084 ceph-mon[37565]: from='client.24959 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:22:13.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:13 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/4172429193' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]': finished 2024-03-30T12:22:13.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:13 smithi162 ceph-mon[30421]: osdmap e71: 8 total, 8 up, 8 in 2024-03-30T12:22:13.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:13 smithi162 ceph-mon[30421]: from='client.24959 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:22:13.552 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-30T12:22:13.552 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-03-30T12:22:13.552 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 3 2024-03-30T12:22:13.552 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:22:13.552 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-03-30T12:22:13.552 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 2 2024-03-30T12:22:13.552 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:22:13.553 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-03-30T12:22:13.553 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 8 2024-03-30T12:22:13.553 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:22:13.553 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-03-30T12:22:13.553 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 2 2024-03-30T12:22:13.553 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:22:13.553 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-03-30T12:22:13.554 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 15 2024-03-30T12:22:13.554 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-30T12:22:13.554 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-30T12:22:14.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:14 smithi084 ceph-mon[27000]: osdmap e72: 8 total, 8 up, 8 in 2024-03-30T12:22:14.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:14 smithi084 ceph-mon[27000]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:22:14.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:14 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/2415053741' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:22:14.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:14 smithi084 ceph-mon[27000]: pgmap v89: 121 pgs: 16 unknown, 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:14.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:14 smithi084 ceph-mon[37565]: osdmap e72: 8 total, 8 up, 8 in 2024-03-30T12:22:14.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:14 smithi084 ceph-mon[37565]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:22:14.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:14 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/2415053741' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:22:14.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:14 smithi084 ceph-mon[37565]: pgmap v89: 121 pgs: 16 unknown, 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:14.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:14 smithi162 ceph-mon[30421]: osdmap e72: 8 total, 8 up, 8 in 2024-03-30T12:22:14.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:14 smithi162 ceph-mon[30421]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:22:14.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:14 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/2415053741' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:22:14.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:14 smithi162 ceph-mon[30421]: pgmap v89: 121 pgs: 16 unknown, 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:15.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:15 smithi084 ceph-mon[27000]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T12:22:15.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:15 smithi084 ceph-mon[27000]: osdmap e73: 8 total, 8 up, 8 in 2024-03-30T12:22:15.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:15 smithi084 ceph-mon[37565]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T12:22:15.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:15 smithi084 ceph-mon[37565]: osdmap e73: 8 total, 8 up, 8 in 2024-03-30T12:22:15.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:15 smithi162 ceph-mon[30421]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T12:22:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:15 smithi162 ceph-mon[30421]: osdmap e73: 8 total, 8 up, 8 in 2024-03-30T12:22:16.050 INFO:teuthology.orchestra.run.smithi084.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-03-30T12:22:16.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:16 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/251738761' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T12:22:16.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:16 smithi162 ceph-mon[30421]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T12:22:16.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:16 smithi162 ceph-mon[30421]: pgmap v91: 121 pgs: 16 unknown, 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:16.420 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:16 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/251738761' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T12:22:16.421 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:16 smithi084 ceph-mon[37565]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T12:22:16.421 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:16 smithi084 ceph-mon[37565]: pgmap v91: 121 pgs: 16 unknown, 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:16.421 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:16 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/251738761' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T12:22:16.421 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:16 smithi084 ceph-mon[27000]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T12:22:16.421 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:16 smithi084 ceph-mon[27000]: pgmap v91: 121 pgs: 16 unknown, 105 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:17.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:17 smithi162 ceph-mon[30421]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-03-30T12:22:17.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:17 smithi162 ceph-mon[30421]: osdmap e74: 8 total, 8 up, 8 in 2024-03-30T12:22:17.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:17 smithi084 ceph-mon[37565]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-03-30T12:22:17.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:17 smithi084 ceph-mon[37565]: osdmap e74: 8 total, 8 up, 8 in 2024-03-30T12:22:17.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:17 smithi084 ceph-mon[27000]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-03-30T12:22:17.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:17 smithi084 ceph-mon[27000]: osdmap e74: 8 total, 8 up, 8 in 2024-03-30T12:22:17.752 DEBUG:teuthology.orchestra.run.smithi084:> CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no-omap --ec-pool --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 0 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 25 --op rmattr 25 --op copy_from 50 --op append 100 --pool unique_pool_0 2024-03-30T12:22:17.780 INFO:tasks.rados.rados.0.smithi084.stdout:adding op weight read -> 100 2024-03-30T12:22:17.780 INFO:tasks.rados.rados.0.smithi084.stdout:adding op weight delete -> 50 2024-03-30T12:22:17.780 INFO:tasks.rados.rados.0.smithi084.stdout:adding op weight snap_create -> 50 2024-03-30T12:22:17.780 INFO:tasks.rados.rados.0.smithi084.stdout:adding op weight snap_remove -> 50 2024-03-30T12:22:17.780 INFO:tasks.rados.rados.0.smithi084.stdout:adding op weight rollback -> 50 2024-03-30T12:22:17.780 INFO:tasks.rados.rados.0.smithi084.stdout:adding op weight setattr -> 25 2024-03-30T12:22:17.780 INFO:tasks.rados.rados.0.smithi084.stdout:adding op weight rmattr -> 25 2024-03-30T12:22:17.780 INFO:tasks.rados.rados.0.smithi084.stdout:adding op weight copy_from -> 50 2024-03-30T12:22:17.780 INFO:tasks.rados.rados.0.smithi084.stdout:adding op weight append -> 100 2024-03-30T12:22:17.780 INFO:tasks.rados.rados.0.smithi084.stdout:ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable) 2024-03-30T12:22:17.780 INFO:tasks.rados.rados.0.smithi084.stdout:Configuration: 2024-03-30T12:22:17.781 INFO:tasks.rados.rados.0.smithi084.stdout: Number of operations: 4000 2024-03-30T12:22:17.781 INFO:tasks.rados.rados.0.smithi084.stdout: Number of objects: 50 2024-03-30T12:22:17.781 INFO:tasks.rados.rados.0.smithi084.stdout: Max in flight operations: 16 2024-03-30T12:22:17.781 INFO:tasks.rados.rados.0.smithi084.stdout: Object size (in bytes): 4000000 2024-03-30T12:22:17.781 INFO:tasks.rados.rados.0.smithi084.stdout: Write stride min: 400000 2024-03-30T12:22:17.781 INFO:tasks.rados.rados.0.smithi084.stdout: Write stride max: 800000 2024-03-30T12:22:18.057 INFO:tasks.rados.rados.0.smithi084.stdout:1: write initial oid 1 2024-03-30T12:22:18.058 INFO:tasks.rados.rados.0.smithi084.stdout:1: seq_num 0 ranges {0=24576} 2024-03-30T12:22:18.058 INFO:tasks.rados.rados.0.smithi084.stdout:1: writing smithi08477944-1 from 0 to 24576 tid 1 2024-03-30T12:22:18.058 INFO:tasks.rados.rados.0.smithi084.stdout:2: write initial oid 2 2024-03-30T12:22:18.058 INFO:tasks.rados.rados.0.smithi084.stdout:2: seq_num 1 ranges {0=24576} 2024-03-30T12:22:18.058 INFO:tasks.rados.rados.0.smithi084.stdout:2: writing smithi08477944-2 from 0 to 24576 tid 1 2024-03-30T12:22:18.058 INFO:tasks.rados.rados.0.smithi084.stdout:3: write initial oid 3 2024-03-30T12:22:18.058 INFO:tasks.rados.rados.0.smithi084.stdout:3: seq_num 2 ranges {0=40960} 2024-03-30T12:22:18.058 INFO:tasks.rados.rados.0.smithi084.stdout:3: writing smithi08477944-3 from 0 to 40960 tid 1 2024-03-30T12:22:18.058 INFO:tasks.rados.rados.0.smithi084.stdout:4: write initial oid 4 2024-03-30T12:22:18.058 INFO:tasks.rados.rados.0.smithi084.stdout:4: seq_num 3 ranges {0=57344} 2024-03-30T12:22:18.058 INFO:tasks.rados.rados.0.smithi084.stdout:4: writing smithi08477944-4 from 0 to 57344 tid 1 2024-03-30T12:22:18.059 INFO:tasks.rados.rados.0.smithi084.stdout:5: write initial oid 5 2024-03-30T12:22:18.059 INFO:tasks.rados.rados.0.smithi084.stdout:5: seq_num 4 ranges {0=73728} 2024-03-30T12:22:18.059 INFO:tasks.rados.rados.0.smithi084.stdout:5: writing smithi08477944-5 from 0 to 73728 tid 1 2024-03-30T12:22:18.059 INFO:tasks.rados.rados.0.smithi084.stdout:6: write initial oid 6 2024-03-30T12:22:18.059 INFO:tasks.rados.rados.0.smithi084.stdout:6: seq_num 5 ranges {0=90112} 2024-03-30T12:22:18.060 INFO:tasks.rados.rados.0.smithi084.stdout:6: writing smithi08477944-6 from 0 to 90112 tid 1 2024-03-30T12:22:18.060 INFO:tasks.rados.rados.0.smithi084.stdout:7: write initial oid 7 2024-03-30T12:22:18.061 INFO:tasks.rados.rados.0.smithi084.stdout:7: seq_num 6 ranges {0=106496} 2024-03-30T12:22:18.061 INFO:tasks.rados.rados.0.smithi084.stdout:7: writing smithi08477944-7 from 0 to 106496 tid 1 2024-03-30T12:22:18.061 INFO:tasks.rados.rados.0.smithi084.stdout:8: write initial oid 8 2024-03-30T12:22:18.062 INFO:tasks.rados.rados.0.smithi084.stdout:8: seq_num 7 ranges {0=122880} 2024-03-30T12:22:18.062 INFO:tasks.rados.rados.0.smithi084.stdout:8: writing smithi08477944-8 from 0 to 122880 tid 1 2024-03-30T12:22:18.062 INFO:tasks.rados.rados.0.smithi084.stdout:1: finishing write tid 1 to smithi08477944-1 2024-03-30T12:22:18.063 INFO:tasks.rados.rados.0.smithi084.stdout:1: finishing write tid 2 to smithi08477944-1 2024-03-30T12:22:18.063 INFO:tasks.rados.rados.0.smithi084.stdout:1: finishing write tid 3 to smithi08477944-1 2024-03-30T12:22:18.063 INFO:tasks.rados.rados.0.smithi084.stdout:1: oid 1 updating version 0 to 1 2024-03-30T12:22:18.063 INFO:tasks.rados.rados.0.smithi084.stdout:1: oid 1 updating version 1 to 2 2024-03-30T12:22:18.063 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 2 (ObjNum 0 snap 0 seq_num 0) dirty exists 2024-03-30T12:22:18.063 INFO:tasks.rados.rados.0.smithi084.stdout:1: left oid 1 (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:22:18.063 INFO:tasks.rados.rados.0.smithi084.stdout:2: finishing write tid 1 to smithi08477944-2 2024-03-30T12:22:18.063 INFO:tasks.rados.rados.0.smithi084.stdout:2: finishing write tid 2 to smithi08477944-2 2024-03-30T12:22:18.063 INFO:tasks.rados.rados.0.smithi084.stdout:1: done (7 left) 2024-03-30T12:22:18.063 INFO:tasks.rados.rados.0.smithi084.stdout:9: write initial oid 9 2024-03-30T12:22:18.063 INFO:tasks.rados.rados.0.smithi084.stdout:9: seq_num 8 ranges {0=139264} 2024-03-30T12:22:18.064 INFO:tasks.rados.rados.0.smithi084.stdout:9: writing smithi08477944-9 from 0 to 139264 tid 1 2024-03-30T12:22:18.064 INFO:tasks.rados.rados.0.smithi084.stdout:10: write initial oid 10 2024-03-30T12:22:18.064 INFO:tasks.rados.rados.0.smithi084.stdout:10: seq_num 9 ranges {0=155648} 2024-03-30T12:22:18.065 INFO:tasks.rados.rados.0.smithi084.stdout:10: writing smithi08477944-10 from 0 to 155648 tid 1 2024-03-30T12:22:18.065 INFO:tasks.rados.rados.0.smithi084.stdout:3: finishing write tid 1 to smithi08477944-3 2024-03-30T12:22:18.065 INFO:tasks.rados.rados.0.smithi084.stdout:3: finishing write tid 2 to smithi08477944-3 2024-03-30T12:22:18.065 INFO:tasks.rados.rados.0.smithi084.stdout:2: finishing write tid 3 to smithi08477944-2 2024-03-30T12:22:18.065 INFO:tasks.rados.rados.0.smithi084.stdout:2: oid 2 updating version 0 to 1 2024-03-30T12:22:18.065 INFO:tasks.rados.rados.0.smithi084.stdout:2: oid 2 updating version 1 to 2 2024-03-30T12:22:18.065 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 2 (ObjNum 1 snap 0 seq_num 1) dirty exists 2024-03-30T12:22:18.066 INFO:tasks.rados.rados.0.smithi084.stdout:2: left oid 2 (ObjNum 1 snap 0 seq_num 1) 2024-03-30T12:22:18.066 INFO:tasks.rados.rados.0.smithi084.stdout:2: done (8 left) 2024-03-30T12:22:18.066 INFO:tasks.rados.rados.0.smithi084.stdout:11: write initial oid 11 2024-03-30T12:22:18.066 INFO:tasks.rados.rados.0.smithi084.stdout:11: seq_num 10 ranges {0=172032} 2024-03-30T12:22:18.066 INFO:tasks.rados.rados.0.smithi084.stdout:11: writing smithi08477944-11 from 0 to 172032 tid 1 2024-03-30T12:22:18.066 INFO:tasks.rados.rados.0.smithi084.stdout:12: write initial oid 12 2024-03-30T12:22:18.066 INFO:tasks.rados.rados.0.smithi084.stdout:12: seq_num 11 ranges {0=188416} 2024-03-30T12:22:18.068 INFO:tasks.rados.rados.0.smithi084.stdout:12: writing smithi08477944-12 from 0 to 188416 tid 1 2024-03-30T12:22:18.069 INFO:tasks.rados.rados.0.smithi084.stdout:4: finishing write tid 1 to smithi08477944-4 2024-03-30T12:22:18.069 INFO:tasks.rados.rados.0.smithi084.stdout:4: finishing write tid 2 to smithi08477944-4 2024-03-30T12:22:18.069 INFO:tasks.rados.rados.0.smithi084.stdout:3: finishing write tid 3 to smithi08477944-3 2024-03-30T12:22:18.069 INFO:tasks.rados.rados.0.smithi084.stdout:3: oid 3 updating version 0 to 3 2024-03-30T12:22:18.069 INFO:tasks.rados.rados.0.smithi084.stdout:3: oid 3 updating version 3 to 4 2024-03-30T12:22:18.069 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 4 (ObjNum 2 snap 0 seq_num 2) dirty exists 2024-03-30T12:22:18.069 INFO:tasks.rados.rados.0.smithi084.stdout:3: left oid 3 (ObjNum 2 snap 0 seq_num 2) 2024-03-30T12:22:18.069 INFO:tasks.rados.rados.0.smithi084.stdout:9: finishing write tid 1 to smithi08477944-9 2024-03-30T12:22:18.069 INFO:tasks.rados.rados.0.smithi084.stdout:8: finishing write tid 1 to smithi08477944-8 2024-03-30T12:22:18.070 INFO:tasks.rados.rados.0.smithi084.stdout:9: finishing write tid 2 to smithi08477944-9 2024-03-30T12:22:18.070 INFO:tasks.rados.rados.0.smithi084.stdout:7: finishing write tid 1 to smithi08477944-7 2024-03-30T12:22:18.070 INFO:tasks.rados.rados.0.smithi084.stdout:7: finishing write tid 2 to smithi08477944-7 2024-03-30T12:22:18.070 INFO:tasks.rados.rados.0.smithi084.stdout:4: finishing write tid 3 to smithi08477944-4 2024-03-30T12:22:18.070 INFO:tasks.rados.rados.0.smithi084.stdout:4: oid 4 updating version 0 to 1 2024-03-30T12:22:18.070 INFO:tasks.rados.rados.0.smithi084.stdout:4: oid 4 updating version 1 to 2 2024-03-30T12:22:18.070 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 2 (ObjNum 3 snap 0 seq_num 3) dirty exists 2024-03-30T12:22:18.070 INFO:tasks.rados.rados.0.smithi084.stdout:4: left oid 4 (ObjNum 3 snap 0 seq_num 3) 2024-03-30T12:22:18.070 INFO:tasks.rados.rados.0.smithi084.stdout:8: finishing write tid 2 to smithi08477944-8 2024-03-30T12:22:18.070 INFO:tasks.rados.rados.0.smithi084.stdout:6: finishing write tid 1 to smithi08477944-6 2024-03-30T12:22:18.070 INFO:tasks.rados.rados.0.smithi084.stdout:3: done (9 left) 2024-03-30T12:22:18.070 INFO:tasks.rados.rados.0.smithi084.stdout:4: done (8 left) 2024-03-30T12:22:18.071 INFO:tasks.rados.rados.0.smithi084.stdout:13: write initial oid 13 2024-03-30T12:22:18.071 INFO:tasks.rados.rados.0.smithi084.stdout:13: seq_num 12 ranges {0=204800} 2024-03-30T12:22:18.072 INFO:tasks.rados.rados.0.smithi084.stdout:13: writing smithi08477944-13 from 0 to 204800 tid 1 2024-03-30T12:22:18.072 INFO:tasks.rados.rados.0.smithi084.stdout:14: write initial oid 14 2024-03-30T12:22:18.072 INFO:tasks.rados.rados.0.smithi084.stdout:14: seq_num 13 ranges {0=221184} 2024-03-30T12:22:18.072 INFO:tasks.rados.rados.0.smithi084.stdout:14: writing smithi08477944-14 from 0 to 221184 tid 1 2024-03-30T12:22:18.072 INFO:tasks.rados.rados.0.smithi084.stdout:15: write initial oid 15 2024-03-30T12:22:18.072 INFO:tasks.rados.rados.0.smithi084.stdout:15: seq_num 14 ranges {0=237568} 2024-03-30T12:22:18.073 INFO:tasks.rados.rados.0.smithi084.stdout:15: writing smithi08477944-15 from 0 to 237568 tid 1 2024-03-30T12:22:18.073 INFO:tasks.rados.rados.0.smithi084.stdout:16: write initial oid 16 2024-03-30T12:22:18.073 INFO:tasks.rados.rados.0.smithi084.stdout:16: seq_num 15 ranges {0=253952} 2024-03-30T12:22:18.075 INFO:tasks.rados.rados.0.smithi084.stdout:16: writing smithi08477944-16 from 0 to 253952 tid 1 2024-03-30T12:22:18.075 INFO:tasks.rados.rados.0.smithi084.stdout:6: finishing write tid 2 to smithi08477944-6 2024-03-30T12:22:18.075 INFO:tasks.rados.rados.0.smithi084.stdout:5: finishing write tid 1 to smithi08477944-5 2024-03-30T12:22:18.076 INFO:tasks.rados.rados.0.smithi084.stdout:5: finishing write tid 2 to smithi08477944-5 2024-03-30T12:22:18.076 INFO:tasks.rados.rados.0.smithi084.stdout:8: finishing write tid 3 to smithi08477944-8 2024-03-30T12:22:18.076 INFO:tasks.rados.rados.0.smithi084.stdout:8: oid 8 updating version 0 to 5 2024-03-30T12:22:18.076 INFO:tasks.rados.rados.0.smithi084.stdout:8: oid 8 updating version 5 to 6 2024-03-30T12:22:18.076 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 6 (ObjNum 7 snap 0 seq_num 7) dirty exists 2024-03-30T12:22:18.076 INFO:tasks.rados.rados.0.smithi084.stdout:8: left oid 8 (ObjNum 7 snap 0 seq_num 7) 2024-03-30T12:22:18.076 INFO:tasks.rados.rados.0.smithi084.stdout:7: finishing write tid 3 to smithi08477944-7 2024-03-30T12:22:18.076 INFO:tasks.rados.rados.0.smithi084.stdout:7: oid 7 updating version 0 to 2 2024-03-30T12:22:18.076 INFO:tasks.rados.rados.0.smithi084.stdout:7: oid 7 version 2 is already newer than 1 2024-03-30T12:22:18.076 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 2 (ObjNum 6 snap 0 seq_num 6) dirty exists 2024-03-30T12:22:18.076 INFO:tasks.rados.rados.0.smithi084.stdout:7: left oid 7 (ObjNum 6 snap 0 seq_num 6) 2024-03-30T12:22:18.076 INFO:tasks.rados.rados.0.smithi084.stdout:9: finishing write tid 3 to smithi08477944-9 2024-03-30T12:22:18.077 INFO:tasks.rados.rados.0.smithi084.stdout:9: oid 9 updating version 0 to 1 2024-03-30T12:22:18.077 INFO:tasks.rados.rados.0.smithi084.stdout:9: oid 9 updating version 1 to 2 2024-03-30T12:22:18.077 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 2 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-03-30T12:22:18.077 INFO:tasks.rados.rados.0.smithi084.stdout:9: left oid 9 (ObjNum 8 snap 0 seq_num 8) 2024-03-30T12:22:18.077 INFO:tasks.rados.rados.0.smithi084.stdout:11: finishing write tid 1 to smithi08477944-11 2024-03-30T12:22:18.077 INFO:tasks.rados.rados.0.smithi084.stdout:11: finishing write tid 2 to smithi08477944-11 2024-03-30T12:22:18.077 INFO:tasks.rados.rados.0.smithi084.stdout:5: finishing write tid 3 to smithi08477944-5 2024-03-30T12:22:18.077 INFO:tasks.rados.rados.0.smithi084.stdout:5: oid 5 updating version 0 to 1 2024-03-30T12:22:18.077 INFO:tasks.rados.rados.0.smithi084.stdout:5: oid 5 updating version 1 to 2 2024-03-30T12:22:18.077 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 2 (ObjNum 4 snap 0 seq_num 4) dirty exists 2024-03-30T12:22:18.077 INFO:tasks.rados.rados.0.smithi084.stdout:5: left oid 5 (ObjNum 4 snap 0 seq_num 4) 2024-03-30T12:22:18.077 INFO:tasks.rados.rados.0.smithi084.stdout:11: finishing write tid 3 to smithi08477944-11 2024-03-30T12:22:18.078 INFO:tasks.rados.rados.0.smithi084.stdout:11: oid 11 updating version 0 to 4 2024-03-30T12:22:18.078 INFO:tasks.rados.rados.0.smithi084.stdout:11: oid 11 version 4 is already newer than 3 2024-03-30T12:22:18.078 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 4 (ObjNum 10 snap 0 seq_num 10) dirty exists 2024-03-30T12:22:18.078 INFO:tasks.rados.rados.0.smithi084.stdout:11: left oid 11 (ObjNum 10 snap 0 seq_num 10) 2024-03-30T12:22:18.078 INFO:tasks.rados.rados.0.smithi084.stdout:6: finishing write tid 3 to smithi08477944-6 2024-03-30T12:22:18.078 INFO:tasks.rados.rados.0.smithi084.stdout:6: oid 6 updating version 0 to 1 2024-03-30T12:22:18.078 INFO:tasks.rados.rados.0.smithi084.stdout:6: oid 6 updating version 1 to 2 2024-03-30T12:22:18.078 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 2 (ObjNum 5 snap 0 seq_num 5) dirty exists 2024-03-30T12:22:18.078 INFO:tasks.rados.rados.0.smithi084.stdout:6: left oid 6 (ObjNum 5 snap 0 seq_num 5) 2024-03-30T12:22:18.078 INFO:tasks.rados.rados.0.smithi084.stdout:12: finishing write tid 1 to smithi08477944-12 2024-03-30T12:22:18.078 INFO:tasks.rados.rados.0.smithi084.stdout:13: finishing write tid 1 to smithi08477944-13 2024-03-30T12:22:18.078 INFO:tasks.rados.rados.0.smithi084.stdout:13: finishing write tid 2 to smithi08477944-13 2024-03-30T12:22:18.079 INFO:tasks.rados.rados.0.smithi084.stdout:12: finishing write tid 2 to smithi08477944-12 2024-03-30T12:22:18.079 INFO:tasks.rados.rados.0.smithi084.stdout:5: done (11 left) 2024-03-30T12:22:18.079 INFO:tasks.rados.rados.0.smithi084.stdout:6: done (10 left) 2024-03-30T12:22:18.079 INFO:tasks.rados.rados.0.smithi084.stdout:7: done (9 left) 2024-03-30T12:22:18.079 INFO:tasks.rados.rados.0.smithi084.stdout:8: done (8 left) 2024-03-30T12:22:18.079 INFO:tasks.rados.rados.0.smithi084.stdout:9: done (7 left) 2024-03-30T12:22:18.079 INFO:tasks.rados.rados.0.smithi084.stdout:11: done (6 left) 2024-03-30T12:22:18.079 INFO:tasks.rados.rados.0.smithi084.stdout:17: write initial oid 17 2024-03-30T12:22:18.079 INFO:tasks.rados.rados.0.smithi084.stdout:17: seq_num 16 ranges {0=270336} 2024-03-30T12:22:18.080 INFO:tasks.rados.rados.0.smithi084.stdout:17: writing smithi08477944-17 from 0 to 270336 tid 1 2024-03-30T12:22:18.080 INFO:tasks.rados.rados.0.smithi084.stdout:18: write initial oid 18 2024-03-30T12:22:18.080 INFO:tasks.rados.rados.0.smithi084.stdout:18: seq_num 17 ranges {0=286720} 2024-03-30T12:22:18.081 INFO:tasks.rados.rados.0.smithi084.stdout:18: writing smithi08477944-18 from 0 to 286720 tid 1 2024-03-30T12:22:18.081 INFO:tasks.rados.rados.0.smithi084.stdout:10: finishing write tid 1 to smithi08477944-10 2024-03-30T12:22:18.081 INFO:tasks.rados.rados.0.smithi084.stdout:10: finishing write tid 2 to smithi08477944-10 2024-03-30T12:22:18.081 INFO:tasks.rados.rados.0.smithi084.stdout:12: finishing write tid 3 to smithi08477944-12 2024-03-30T12:22:18.081 INFO:tasks.rados.rados.0.smithi084.stdout:12: oid 12 updating version 0 to 2 2024-03-30T12:22:18.081 INFO:tasks.rados.rados.0.smithi084.stdout:12: oid 12 version 2 is already newer than 1 2024-03-30T12:22:18.081 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 2 (ObjNum 11 snap 0 seq_num 11) dirty exists 2024-03-30T12:22:18.081 INFO:tasks.rados.rados.0.smithi084.stdout:12: left oid 12 (ObjNum 11 snap 0 seq_num 11) 2024-03-30T12:22:18.081 INFO:tasks.rados.rados.0.smithi084.stdout:15: finishing write tid 1 to smithi08477944-15 2024-03-30T12:22:18.081 INFO:tasks.rados.rados.0.smithi084.stdout:14: finishing write tid 1 to smithi08477944-14 2024-03-30T12:22:18.081 INFO:tasks.rados.rados.0.smithi084.stdout:15: finishing write tid 2 to smithi08477944-15 2024-03-30T12:22:18.082 INFO:tasks.rados.rados.0.smithi084.stdout:13: finishing write tid 3 to smithi08477944-13 2024-03-30T12:22:18.082 INFO:tasks.rados.rados.0.smithi084.stdout:13: oid 13 updating version 0 to 2 2024-03-30T12:22:18.082 INFO:tasks.rados.rados.0.smithi084.stdout:13: oid 13 version 2 is already newer than 1 2024-03-30T12:22:18.082 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 2 (ObjNum 12 snap 0 seq_num 12) dirty exists 2024-03-30T12:22:18.082 INFO:tasks.rados.rados.0.smithi084.stdout:13: left oid 13 (ObjNum 12 snap 0 seq_num 12) 2024-03-30T12:22:18.082 INFO:tasks.rados.rados.0.smithi084.stdout:14: finishing write tid 2 to smithi08477944-14 2024-03-30T12:22:18.082 INFO:tasks.rados.rados.0.smithi084.stdout:10: finishing write tid 3 to smithi08477944-10 2024-03-30T12:22:18.082 INFO:tasks.rados.rados.0.smithi084.stdout:10: oid 10 updating version 0 to 2 2024-03-30T12:22:18.082 INFO:tasks.rados.rados.0.smithi084.stdout:10: oid 10 version 2 is already newer than 1 2024-03-30T12:22:18.082 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 2 (ObjNum 9 snap 0 seq_num 9) dirty exists 2024-03-30T12:22:18.082 INFO:tasks.rados.rados.0.smithi084.stdout:10: left oid 10 (ObjNum 9 snap 0 seq_num 9) 2024-03-30T12:22:18.082 INFO:tasks.rados.rados.0.smithi084.stdout:16: finishing write tid 1 to smithi08477944-16 2024-03-30T12:22:18.083 INFO:tasks.rados.rados.0.smithi084.stdout:14: finishing write tid 3 to smithi08477944-14 2024-03-30T12:22:18.083 INFO:tasks.rados.rados.0.smithi084.stdout:14: oid 14 updating version 0 to 4 2024-03-30T12:22:18.083 INFO:tasks.rados.rados.0.smithi084.stdout:14: oid 14 version 4 is already newer than 3 2024-03-30T12:22:18.083 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 4 (ObjNum 13 snap 0 seq_num 13) dirty exists 2024-03-30T12:22:18.083 INFO:tasks.rados.rados.0.smithi084.stdout:14: left oid 14 (ObjNum 13 snap 0 seq_num 13) 2024-03-30T12:22:18.083 INFO:tasks.rados.rados.0.smithi084.stdout:16: finishing write tid 2 to smithi08477944-16 2024-03-30T12:22:18.083 INFO:tasks.rados.rados.0.smithi084.stdout:10: done (7 left) 2024-03-30T12:22:18.083 INFO:tasks.rados.rados.0.smithi084.stdout:12: done (6 left) 2024-03-30T12:22:18.083 INFO:tasks.rados.rados.0.smithi084.stdout:13: done (5 left) 2024-03-30T12:22:18.083 INFO:tasks.rados.rados.0.smithi084.stdout:14: done (4 left) 2024-03-30T12:22:18.083 INFO:tasks.rados.rados.0.smithi084.stdout:19: write initial oid 19 2024-03-30T12:22:18.083 INFO:tasks.rados.rados.0.smithi084.stdout:19: seq_num 18 ranges {0=303104} 2024-03-30T12:22:18.084 INFO:tasks.rados.rados.0.smithi084.stdout:19: writing smithi08477944-19 from 0 to 303104 tid 1 2024-03-30T12:22:18.084 INFO:tasks.rados.rados.0.smithi084.stdout:15: finishing write tid 3 to smithi08477944-15 2024-03-30T12:22:18.084 INFO:tasks.rados.rados.0.smithi084.stdout:15: oid 15 updating version 0 to 2 2024-03-30T12:22:18.085 INFO:tasks.rados.rados.0.smithi084.stdout:15: oid 15 version 2 is already newer than 1 2024-03-30T12:22:18.085 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 2 (ObjNum 14 snap 0 seq_num 14) dirty exists 2024-03-30T12:22:18.085 INFO:tasks.rados.rados.0.smithi084.stdout:15: left oid 15 (ObjNum 14 snap 0 seq_num 14) 2024-03-30T12:22:18.085 INFO:tasks.rados.rados.0.smithi084.stdout:17: finishing write tid 1 to smithi08477944-17 2024-03-30T12:22:18.085 INFO:tasks.rados.rados.0.smithi084.stdout:17: finishing write tid 2 to smithi08477944-17 2024-03-30T12:22:18.085 INFO:tasks.rados.rados.0.smithi084.stdout:16: finishing write tid 3 to smithi08477944-16 2024-03-30T12:22:18.085 INFO:tasks.rados.rados.0.smithi084.stdout:16: oid 16 updating version 0 to 1 2024-03-30T12:22:18.085 INFO:tasks.rados.rados.0.smithi084.stdout:16: oid 16 updating version 1 to 2 2024-03-30T12:22:18.085 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 2 (ObjNum 15 snap 0 seq_num 15) dirty exists 2024-03-30T12:22:18.085 INFO:tasks.rados.rados.0.smithi084.stdout:16: left oid 16 (ObjNum 15 snap 0 seq_num 15) 2024-03-30T12:22:18.085 INFO:tasks.rados.rados.0.smithi084.stdout:18: finishing write tid 1 to smithi08477944-18 2024-03-30T12:22:18.085 INFO:tasks.rados.rados.0.smithi084.stdout:17: finishing write tid 3 to smithi08477944-17 2024-03-30T12:22:18.086 INFO:tasks.rados.rados.0.smithi084.stdout:17: oid 17 updating version 0 to 4 2024-03-30T12:22:18.086 INFO:tasks.rados.rados.0.smithi084.stdout:17: oid 17 version 4 is already newer than 3 2024-03-30T12:22:18.086 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 4 (ObjNum 16 snap 0 seq_num 16) dirty exists 2024-03-30T12:22:18.086 INFO:tasks.rados.rados.0.smithi084.stdout:17: left oid 17 (ObjNum 16 snap 0 seq_num 16) 2024-03-30T12:22:18.086 INFO:tasks.rados.rados.0.smithi084.stdout:18: finishing write tid 2 to smithi08477944-18 2024-03-30T12:22:18.086 INFO:tasks.rados.rados.0.smithi084.stdout:15: done (4 left) 2024-03-30T12:22:18.086 INFO:tasks.rados.rados.0.smithi084.stdout:16: done (3 left) 2024-03-30T12:22:18.086 INFO:tasks.rados.rados.0.smithi084.stdout:17: done (2 left) 2024-03-30T12:22:18.086 INFO:tasks.rados.rados.0.smithi084.stdout:20: write initial oid 20 2024-03-30T12:22:18.086 INFO:tasks.rados.rados.0.smithi084.stdout:20: seq_num 19 ranges {0=319488} 2024-03-30T12:22:18.086 INFO:tasks.rados.rados.0.smithi084.stdout:20: writing smithi08477944-20 from 0 to 319488 tid 1 2024-03-30T12:22:18.086 INFO:tasks.rados.rados.0.smithi084.stdout:21: write initial oid 21 2024-03-30T12:22:18.087 INFO:tasks.rados.rados.0.smithi084.stdout:21: seq_num 20 ranges {0=344064} 2024-03-30T12:22:18.087 INFO:tasks.rados.rados.0.smithi084.stdout:21: writing smithi08477944-21 from 0 to 344064 tid 1 2024-03-30T12:22:18.088 INFO:tasks.rados.rados.0.smithi084.stdout:18: finishing write tid 3 to smithi08477944-18 2024-03-30T12:22:18.088 INFO:tasks.rados.rados.0.smithi084.stdout:18: oid 18 updating version 0 to 4 2024-03-30T12:22:18.088 INFO:tasks.rados.rados.0.smithi084.stdout:18: oid 18 version 4 is already newer than 3 2024-03-30T12:22:18.088 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 4 (ObjNum 17 snap 0 seq_num 17) dirty exists 2024-03-30T12:22:18.088 INFO:tasks.rados.rados.0.smithi084.stdout:18: left oid 18 (ObjNum 17 snap 0 seq_num 17) 2024-03-30T12:22:18.088 INFO:tasks.rados.rados.0.smithi084.stdout:19: finishing write tid 1 to smithi08477944-19 2024-03-30T12:22:18.088 INFO:tasks.rados.rados.0.smithi084.stdout:19: finishing write tid 2 to smithi08477944-19 2024-03-30T12:22:18.088 INFO:tasks.rados.rados.0.smithi084.stdout:19: finishing write tid 3 to smithi08477944-19 2024-03-30T12:22:18.088 INFO:tasks.rados.rados.0.smithi084.stdout:19: oid 19 updating version 0 to 3 2024-03-30T12:22:18.088 INFO:tasks.rados.rados.0.smithi084.stdout:19: oid 19 updating version 3 to 4 2024-03-30T12:22:18.088 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 4 (ObjNum 18 snap 0 seq_num 18) dirty exists 2024-03-30T12:22:18.088 INFO:tasks.rados.rados.0.smithi084.stdout:19: left oid 19 (ObjNum 18 snap 0 seq_num 18) 2024-03-30T12:22:18.089 INFO:tasks.rados.rados.0.smithi084.stdout:20: finishing write tid 1 to smithi08477944-20 2024-03-30T12:22:18.089 INFO:tasks.rados.rados.0.smithi084.stdout:20: finishing write tid 2 to smithi08477944-20 2024-03-30T12:22:18.089 INFO:tasks.rados.rados.0.smithi084.stdout:18: done (3 left) 2024-03-30T12:22:18.089 INFO:tasks.rados.rados.0.smithi084.stdout:19: done (2 left) 2024-03-30T12:22:18.089 INFO:tasks.rados.rados.0.smithi084.stdout:22: write initial oid 22 2024-03-30T12:22:18.089 INFO:tasks.rados.rados.0.smithi084.stdout:22: seq_num 21 ranges {0=360448} 2024-03-30T12:22:18.090 INFO:tasks.rados.rados.0.smithi084.stdout:22: writing smithi08477944-22 from 0 to 360448 tid 1 2024-03-30T12:22:18.090 INFO:tasks.rados.rados.0.smithi084.stdout:23: write initial oid 23 2024-03-30T12:22:18.090 INFO:tasks.rados.rados.0.smithi084.stdout:23: seq_num 22 ranges {0=376832} 2024-03-30T12:22:18.091 INFO:tasks.rados.rados.0.smithi084.stdout:23: writing smithi08477944-23 from 0 to 376832 tid 1 2024-03-30T12:22:18.091 INFO:tasks.rados.rados.0.smithi084.stdout:24: write initial oid 24 2024-03-30T12:22:18.091 INFO:tasks.rados.rados.0.smithi084.stdout:24: seq_num 23 ranges {0=393216} 2024-03-30T12:22:18.094 INFO:tasks.rados.rados.0.smithi084.stdout:24: writing smithi08477944-24 from 0 to 393216 tid 1 2024-03-30T12:22:18.094 INFO:tasks.rados.rados.0.smithi084.stdout:25: write initial oid 25 2024-03-30T12:22:18.094 INFO:tasks.rados.rados.0.smithi084.stdout:25: seq_num 24 ranges {0=409600} 2024-03-30T12:22:18.097 INFO:tasks.rados.rados.0.smithi084.stdout:25: writing smithi08477944-25 from 0 to 409600 tid 1 2024-03-30T12:22:18.097 INFO:tasks.rados.rados.0.smithi084.stdout:26: write initial oid 26 2024-03-30T12:22:18.097 INFO:tasks.rados.rados.0.smithi084.stdout:26: seq_num 25 ranges {0=425984} 2024-03-30T12:22:18.100 INFO:tasks.rados.rados.0.smithi084.stdout:26: writing smithi08477944-26 from 0 to 425984 tid 1 2024-03-30T12:22:18.100 INFO:tasks.rados.rados.0.smithi084.stdout:27: write initial oid 27 2024-03-30T12:22:18.100 INFO:tasks.rados.rados.0.smithi084.stdout:27: seq_num 26 ranges {0=442368} 2024-03-30T12:22:18.103 INFO:tasks.rados.rados.0.smithi084.stdout:27: writing smithi08477944-27 from 0 to 442368 tid 1 2024-03-30T12:22:18.103 INFO:tasks.rados.rados.0.smithi084.stdout:28: write initial oid 28 2024-03-30T12:22:18.103 INFO:tasks.rados.rados.0.smithi084.stdout:28: seq_num 27 ranges {0=458752} 2024-03-30T12:22:18.106 INFO:tasks.rados.rados.0.smithi084.stdout:28: writing smithi08477944-28 from 0 to 458752 tid 1 2024-03-30T12:22:18.106 INFO:tasks.rados.rados.0.smithi084.stdout:29: write initial oid 29 2024-03-30T12:22:18.107 INFO:tasks.rados.rados.0.smithi084.stdout:29: seq_num 28 ranges {0=475136} 2024-03-30T12:22:18.110 INFO:tasks.rados.rados.0.smithi084.stdout:29: writing smithi08477944-29 from 0 to 475136 tid 1 2024-03-30T12:22:18.110 INFO:tasks.rados.rados.0.smithi084.stdout:30: write initial oid 30 2024-03-30T12:22:18.110 INFO:tasks.rados.rados.0.smithi084.stdout:30: seq_num 29 ranges {0=491520} 2024-03-30T12:22:18.113 INFO:tasks.rados.rados.0.smithi084.stdout:30: writing smithi08477944-30 from 0 to 491520 tid 1 2024-03-30T12:22:18.113 INFO:tasks.rados.rados.0.smithi084.stdout:31: write initial oid 31 2024-03-30T12:22:18.113 INFO:tasks.rados.rados.0.smithi084.stdout:31: seq_num 30 ranges {0=507904} 2024-03-30T12:22:18.117 INFO:tasks.rados.rados.0.smithi084.stdout:31: writing smithi08477944-31 from 0 to 507904 tid 1 2024-03-30T12:22:18.117 INFO:tasks.rados.rados.0.smithi084.stdout:32: write initial oid 32 2024-03-30T12:22:18.117 INFO:tasks.rados.rados.0.smithi084.stdout:32: seq_num 31 ranges {0=524288} 2024-03-30T12:22:18.121 INFO:tasks.rados.rados.0.smithi084.stdout:32: writing smithi08477944-32 from 0 to 524288 tid 1 2024-03-30T12:22:18.121 INFO:tasks.rados.rados.0.smithi084.stdout:33: write initial oid 33 2024-03-30T12:22:18.121 INFO:tasks.rados.rados.0.smithi084.stdout:33: seq_num 32 ranges {0=540672} 2024-03-30T12:22:18.124 INFO:tasks.rados.rados.0.smithi084.stdout:33: writing smithi08477944-33 from 0 to 540672 tid 1 2024-03-30T12:22:18.124 INFO:tasks.rados.rados.0.smithi084.stdout:34: write initial oid 34 2024-03-30T12:22:18.125 INFO:tasks.rados.rados.0.smithi084.stdout:34: seq_num 33 ranges {0=557056} 2024-03-30T12:22:18.128 INFO:tasks.rados.rados.0.smithi084.stdout:34: writing smithi08477944-34 from 0 to 557056 tid 1 2024-03-30T12:22:18.129 INFO:tasks.rados.rados.0.smithi084.stdout:35: write initial oid 35 2024-03-30T12:22:18.129 INFO:tasks.rados.rados.0.smithi084.stdout:35: seq_num 34 ranges {0=573440} 2024-03-30T12:22:18.133 INFO:tasks.rados.rados.0.smithi084.stdout:35: writing smithi08477944-35 from 0 to 573440 tid 1 2024-03-30T12:22:18.133 INFO:tasks.rados.rados.0.smithi084.stdout: waiting on 16 2024-03-30T12:22:18.133 INFO:tasks.rados.rados.0.smithi084.stdout:20: finishing write tid 3 to smithi08477944-20 2024-03-30T12:22:18.134 INFO:tasks.rados.rados.0.smithi084.stdout:20: oid 20 updating version 0 to 3 2024-03-30T12:22:18.134 INFO:tasks.rados.rados.0.smithi084.stdout:20: oid 20 updating version 3 to 4 2024-03-30T12:22:18.134 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 4 (ObjNum 19 snap 0 seq_num 19) dirty exists 2024-03-30T12:22:18.134 INFO:tasks.rados.rados.0.smithi084.stdout:20: left oid 20 (ObjNum 19 snap 0 seq_num 19) 2024-03-30T12:22:18.134 INFO:tasks.rados.rados.0.smithi084.stdout:21: finishing write tid 1 to smithi08477944-21 2024-03-30T12:22:18.134 INFO:tasks.rados.rados.0.smithi084.stdout:21: finishing write tid 2 to smithi08477944-21 2024-03-30T12:22:18.134 INFO:tasks.rados.rados.0.smithi084.stdout:21: finishing write tid 3 to smithi08477944-21 2024-03-30T12:22:18.134 INFO:tasks.rados.rados.0.smithi084.stdout:21: oid 21 updating version 0 to 2 2024-03-30T12:22:18.134 INFO:tasks.rados.rados.0.smithi084.stdout:21: oid 21 version 2 is already newer than 1 2024-03-30T12:22:18.134 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 2 (ObjNum 20 snap 0 seq_num 20) dirty exists 2024-03-30T12:22:18.134 INFO:tasks.rados.rados.0.smithi084.stdout:21: left oid 21 (ObjNum 20 snap 0 seq_num 20) 2024-03-30T12:22:18.135 INFO:tasks.rados.rados.0.smithi084.stdout:22: finishing write tid 1 to smithi08477944-22 2024-03-30T12:22:18.135 INFO:tasks.rados.rados.0.smithi084.stdout:20: done (15 left) 2024-03-30T12:22:18.135 INFO:tasks.rados.rados.0.smithi084.stdout:21: done (14 left) 2024-03-30T12:22:18.135 INFO:tasks.rados.rados.0.smithi084.stdout:36: write initial oid 36 2024-03-30T12:22:18.135 INFO:tasks.rados.rados.0.smithi084.stdout:36: seq_num 35 ranges {0=589824} 2024-03-30T12:22:18.136 INFO:tasks.rados.rados.0.smithi084.stdout:36: writing smithi08477944-36 from 0 to 589824 tid 1 2024-03-30T12:22:18.137 INFO:tasks.rados.rados.0.smithi084.stdout:37: write initial oid 37 2024-03-30T12:22:18.137 INFO:tasks.rados.rados.0.smithi084.stdout:37: seq_num 36 ranges {0=606208} 2024-03-30T12:22:18.141 INFO:tasks.rados.rados.0.smithi084.stdout:37: writing smithi08477944-37 from 0 to 606208 tid 1 2024-03-30T12:22:18.141 INFO:tasks.rados.rados.0.smithi084.stdout: waiting on 16 2024-03-30T12:22:18.142 INFO:tasks.rados.rados.0.smithi084.stdout:22: finishing write tid 2 to smithi08477944-22 2024-03-30T12:22:18.142 INFO:tasks.rados.rados.0.smithi084.stdout:23: finishing write tid 1 to smithi08477944-23 2024-03-30T12:22:18.142 INFO:tasks.rados.rados.0.smithi084.stdout:22: finishing write tid 3 to smithi08477944-22 2024-03-30T12:22:18.142 INFO:tasks.rados.rados.0.smithi084.stdout:22: oid 22 updating version 0 to 7 2024-03-30T12:22:18.142 INFO:tasks.rados.rados.0.smithi084.stdout:22: oid 22 updating version 7 to 8 2024-03-30T12:22:18.142 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 8 (ObjNum 21 snap 0 seq_num 21) dirty exists 2024-03-30T12:22:18.142 INFO:tasks.rados.rados.0.smithi084.stdout:22: left oid 22 (ObjNum 21 snap 0 seq_num 21) 2024-03-30T12:22:18.142 INFO:tasks.rados.rados.0.smithi084.stdout:23: finishing write tid 2 to smithi08477944-23 2024-03-30T12:22:18.142 INFO:tasks.rados.rados.0.smithi084.stdout:22: done (15 left) 2024-03-30T12:22:18.142 INFO:tasks.rados.rados.0.smithi084.stdout:38: write initial oid 38 2024-03-30T12:22:18.142 INFO:tasks.rados.rados.0.smithi084.stdout:38: seq_num 37 ranges {0=622592} 2024-03-30T12:22:18.146 INFO:tasks.rados.rados.0.smithi084.stdout:38: writing smithi08477944-38 from 0 to 622592 tid 1 2024-03-30T12:22:18.146 INFO:tasks.rados.rados.0.smithi084.stdout: waiting on 16 2024-03-30T12:22:18.146 INFO:tasks.rados.rados.0.smithi084.stdout:23: finishing write tid 3 to smithi08477944-23 2024-03-30T12:22:18.146 INFO:tasks.rados.rados.0.smithi084.stdout:23: oid 23 updating version 0 to 2 2024-03-30T12:22:18.146 INFO:tasks.rados.rados.0.smithi084.stdout:23: oid 23 version 2 is already newer than 1 2024-03-30T12:22:18.146 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 2 (ObjNum 22 snap 0 seq_num 22) dirty exists 2024-03-30T12:22:18.146 INFO:tasks.rados.rados.0.smithi084.stdout:23: left oid 23 (ObjNum 22 snap 0 seq_num 22) 2024-03-30T12:22:18.147 INFO:tasks.rados.rados.0.smithi084.stdout:24: finishing write tid 1 to smithi08477944-24 2024-03-30T12:22:18.147 INFO:tasks.rados.rados.0.smithi084.stdout:24: finishing write tid 2 to smithi08477944-24 2024-03-30T12:22:18.147 INFO:tasks.rados.rados.0.smithi084.stdout:23: done (15 left) 2024-03-30T12:22:18.147 INFO:tasks.rados.rados.0.smithi084.stdout:39: write initial oid 39 2024-03-30T12:22:18.147 INFO:tasks.rados.rados.0.smithi084.stdout:39: seq_num 38 ranges {0=638976} 2024-03-30T12:22:18.150 INFO:tasks.rados.rados.0.smithi084.stdout:39: writing smithi08477944-39 from 0 to 638976 tid 1 2024-03-30T12:22:18.151 INFO:tasks.rados.rados.0.smithi084.stdout: waiting on 16 2024-03-30T12:22:18.151 INFO:tasks.rados.rados.0.smithi084.stdout:24: finishing write tid 3 to smithi08477944-24 2024-03-30T12:22:18.151 INFO:tasks.rados.rados.0.smithi084.stdout:24: oid 24 updating version 0 to 3 2024-03-30T12:22:18.151 INFO:tasks.rados.rados.0.smithi084.stdout:24: oid 24 updating version 3 to 4 2024-03-30T12:22:18.151 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 4 (ObjNum 23 snap 0 seq_num 23) dirty exists 2024-03-30T12:22:18.151 INFO:tasks.rados.rados.0.smithi084.stdout:24: left oid 24 (ObjNum 23 snap 0 seq_num 23) 2024-03-30T12:22:18.151 INFO:tasks.rados.rados.0.smithi084.stdout:25: finishing write tid 1 to smithi08477944-25 2024-03-30T12:22:18.151 INFO:tasks.rados.rados.0.smithi084.stdout:25: finishing write tid 2 to smithi08477944-25 2024-03-30T12:22:18.151 INFO:tasks.rados.rados.0.smithi084.stdout:24: done (15 left) 2024-03-30T12:22:18.151 INFO:tasks.rados.rados.0.smithi084.stdout:40: write initial oid 40 2024-03-30T12:22:18.151 INFO:tasks.rados.rados.0.smithi084.stdout:40: seq_num 39 ranges {0=663552} 2024-03-30T12:22:18.156 INFO:tasks.rados.rados.0.smithi084.stdout:40: writing smithi08477944-40 from 0 to 663552 tid 1 2024-03-30T12:22:18.156 INFO:tasks.rados.rados.0.smithi084.stdout: waiting on 16 2024-03-30T12:22:18.156 INFO:tasks.rados.rados.0.smithi084.stdout:25: finishing write tid 3 to smithi08477944-25 2024-03-30T12:22:18.156 INFO:tasks.rados.rados.0.smithi084.stdout:25: oid 25 updating version 0 to 5 2024-03-30T12:22:18.156 INFO:tasks.rados.rados.0.smithi084.stdout:25: oid 25 updating version 5 to 6 2024-03-30T12:22:18.156 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 6 (ObjNum 24 snap 0 seq_num 24) dirty exists 2024-03-30T12:22:18.156 INFO:tasks.rados.rados.0.smithi084.stdout:25: left oid 25 (ObjNum 24 snap 0 seq_num 24) 2024-03-30T12:22:18.156 INFO:tasks.rados.rados.0.smithi084.stdout:26: finishing write tid 1 to smithi08477944-26 2024-03-30T12:22:18.156 INFO:tasks.rados.rados.0.smithi084.stdout:26: finishing write tid 2 to smithi08477944-26 2024-03-30T12:22:18.156 INFO:tasks.rados.rados.0.smithi084.stdout:27: finishing write tid 1 to smithi08477944-27 2024-03-30T12:22:18.157 INFO:tasks.rados.rados.0.smithi084.stdout:26: finishing write tid 3 to smithi08477944-26 2024-03-30T12:22:18.157 INFO:tasks.rados.rados.0.smithi084.stdout:26: oid 26 updating version 0 to 10 2024-03-30T12:22:18.157 INFO:tasks.rados.rados.0.smithi084.stdout:26: oid 26 version 10 is already newer than 9 2024-03-30T12:22:18.157 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 10 (ObjNum 25 snap 0 seq_num 25) dirty exists 2024-03-30T12:22:18.157 INFO:tasks.rados.rados.0.smithi084.stdout:26: left oid 26 (ObjNum 25 snap 0 seq_num 25) 2024-03-30T12:22:18.157 INFO:tasks.rados.rados.0.smithi084.stdout:27: finishing write tid 2 to smithi08477944-27 2024-03-30T12:22:18.157 INFO:tasks.rados.rados.0.smithi084.stdout:25: done (15 left) 2024-03-30T12:22:18.157 INFO:tasks.rados.rados.0.smithi084.stdout:26: done (14 left) 2024-03-30T12:22:18.157 INFO:tasks.rados.rados.0.smithi084.stdout:41: write initial oid 41 2024-03-30T12:22:18.157 INFO:tasks.rados.rados.0.smithi084.stdout:41: seq_num 40 ranges {0=679936} 2024-03-30T12:22:18.160 INFO:tasks.rados.rados.0.smithi084.stdout:41: writing smithi08477944-41 from 0 to 679936 tid 1 2024-03-30T12:22:18.160 INFO:tasks.rados.rados.0.smithi084.stdout:42: write initial oid 42 2024-03-30T12:22:18.160 INFO:tasks.rados.rados.0.smithi084.stdout:42: seq_num 41 ranges {0=696320} 2024-03-30T12:22:18.165 INFO:tasks.rados.rados.0.smithi084.stdout:42: writing smithi08477944-42 from 0 to 696320 tid 1 2024-03-30T12:22:18.165 INFO:tasks.rados.rados.0.smithi084.stdout: waiting on 16 2024-03-30T12:22:18.165 INFO:tasks.rados.rados.0.smithi084.stdout:27: finishing write tid 3 to smithi08477944-27 2024-03-30T12:22:18.166 INFO:tasks.rados.rados.0.smithi084.stdout:27: oid 27 updating version 0 to 4 2024-03-30T12:22:18.166 INFO:tasks.rados.rados.0.smithi084.stdout:27: oid 27 version 4 is already newer than 3 2024-03-30T12:22:18.166 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 4 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-03-30T12:22:18.166 INFO:tasks.rados.rados.0.smithi084.stdout:27: left oid 27 (ObjNum 26 snap 0 seq_num 26) 2024-03-30T12:22:18.166 INFO:tasks.rados.rados.0.smithi084.stdout:28: finishing write tid 1 to smithi08477944-28 2024-03-30T12:22:18.166 INFO:tasks.rados.rados.0.smithi084.stdout:28: finishing write tid 2 to smithi08477944-28 2024-03-30T12:22:18.166 INFO:tasks.rados.rados.0.smithi084.stdout:28: finishing write tid 3 to smithi08477944-28 2024-03-30T12:22:18.166 INFO:tasks.rados.rados.0.smithi084.stdout:28: oid 28 updating version 0 to 4 2024-03-30T12:22:18.166 INFO:tasks.rados.rados.0.smithi084.stdout:28: oid 28 version 4 is already newer than 3 2024-03-30T12:22:18.166 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 4 (ObjNum 27 snap 0 seq_num 27) dirty exists 2024-03-30T12:22:18.166 INFO:tasks.rados.rados.0.smithi084.stdout:28: left oid 28 (ObjNum 27 snap 0 seq_num 27) 2024-03-30T12:22:18.166 INFO:tasks.rados.rados.0.smithi084.stdout:29: finishing write tid 1 to smithi08477944-29 2024-03-30T12:22:18.167 INFO:tasks.rados.rados.0.smithi084.stdout:27: done (15 left) 2024-03-30T12:22:18.167 INFO:tasks.rados.rados.0.smithi084.stdout:28: done (14 left) 2024-03-30T12:22:18.167 INFO:tasks.rados.rados.0.smithi084.stdout:43: write initial oid 43 2024-03-30T12:22:18.167 INFO:tasks.rados.rados.0.smithi084.stdout:43: seq_num 42 ranges {0=712704} 2024-03-30T12:22:18.170 INFO:tasks.rados.rados.0.smithi084.stdout:43: writing smithi08477944-43 from 0 to 712704 tid 1 2024-03-30T12:22:18.170 INFO:tasks.rados.rados.0.smithi084.stdout:44: write initial oid 44 2024-03-30T12:22:18.170 INFO:tasks.rados.rados.0.smithi084.stdout:44: seq_num 43 ranges {0=729088} 2024-03-30T12:22:18.175 INFO:tasks.rados.rados.0.smithi084.stdout:44: writing smithi08477944-44 from 0 to 729088 tid 1 2024-03-30T12:22:18.175 INFO:tasks.rados.rados.0.smithi084.stdout: waiting on 16 2024-03-30T12:22:18.176 INFO:tasks.rados.rados.0.smithi084.stdout:29: finishing write tid 2 to smithi08477944-29 2024-03-30T12:22:18.176 INFO:tasks.rados.rados.0.smithi084.stdout:29: finishing write tid 3 to smithi08477944-29 2024-03-30T12:22:18.176 INFO:tasks.rados.rados.0.smithi084.stdout:29: oid 29 updating version 0 to 5 2024-03-30T12:22:18.176 INFO:tasks.rados.rados.0.smithi084.stdout:29: oid 29 updating version 5 to 6 2024-03-30T12:22:18.176 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 6 (ObjNum 28 snap 0 seq_num 28) dirty exists 2024-03-30T12:22:18.176 INFO:tasks.rados.rados.0.smithi084.stdout:29: left oid 29 (ObjNum 28 snap 0 seq_num 28) 2024-03-30T12:22:18.176 INFO:tasks.rados.rados.0.smithi084.stdout:30: finishing write tid 1 to smithi08477944-30 2024-03-30T12:22:18.176 INFO:tasks.rados.rados.0.smithi084.stdout:30: finishing write tid 2 to smithi08477944-30 2024-03-30T12:22:18.176 INFO:tasks.rados.rados.0.smithi084.stdout:29: done (15 left) 2024-03-30T12:22:18.176 INFO:tasks.rados.rados.0.smithi084.stdout:45: write initial oid 45 2024-03-30T12:22:18.176 INFO:tasks.rados.rados.0.smithi084.stdout:45: seq_num 44 ranges {0=745472} 2024-03-30T12:22:18.183 INFO:tasks.rados.rados.0.smithi084.stdout:45: writing smithi08477944-45 from 0 to 745472 tid 1 2024-03-30T12:22:18.184 INFO:tasks.rados.rados.0.smithi084.stdout: waiting on 16 2024-03-30T12:22:18.184 INFO:tasks.rados.rados.0.smithi084.stdout:30: finishing write tid 3 to smithi08477944-30 2024-03-30T12:22:18.184 INFO:tasks.rados.rados.0.smithi084.stdout:30: oid 30 updating version 0 to 1 2024-03-30T12:22:18.184 INFO:tasks.rados.rados.0.smithi084.stdout:30: oid 30 updating version 1 to 2 2024-03-30T12:22:18.184 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 2 (ObjNum 29 snap 0 seq_num 29) dirty exists 2024-03-30T12:22:18.184 INFO:tasks.rados.rados.0.smithi084.stdout:30: left oid 30 (ObjNum 29 snap 0 seq_num 29) 2024-03-30T12:22:18.184 INFO:tasks.rados.rados.0.smithi084.stdout:31: finishing write tid 1 to smithi08477944-31 2024-03-30T12:22:18.184 INFO:tasks.rados.rados.0.smithi084.stdout:31: finishing write tid 2 to smithi08477944-31 2024-03-30T12:22:18.184 INFO:tasks.rados.rados.0.smithi084.stdout:31: finishing write tid 3 to smithi08477944-31 2024-03-30T12:22:18.184 INFO:tasks.rados.rados.0.smithi084.stdout:31: oid 31 updating version 0 to 7 2024-03-30T12:22:18.184 INFO:tasks.rados.rados.0.smithi084.stdout:31: oid 31 updating version 7 to 8 2024-03-30T12:22:18.184 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 8 (ObjNum 30 snap 0 seq_num 30) dirty exists 2024-03-30T12:22:18.184 INFO:tasks.rados.rados.0.smithi084.stdout:31: left oid 31 (ObjNum 30 snap 0 seq_num 30) 2024-03-30T12:22:18.185 INFO:tasks.rados.rados.0.smithi084.stdout:32: finishing write tid 1 to smithi08477944-32 2024-03-30T12:22:18.185 INFO:tasks.rados.rados.0.smithi084.stdout:32: finishing write tid 2 to smithi08477944-32 2024-03-30T12:22:18.185 INFO:tasks.rados.rados.0.smithi084.stdout:30: done (15 left) 2024-03-30T12:22:18.185 INFO:tasks.rados.rados.0.smithi084.stdout:31: done (14 left) 2024-03-30T12:22:18.185 INFO:tasks.rados.rados.0.smithi084.stdout:46: write initial oid 46 2024-03-30T12:22:18.185 INFO:tasks.rados.rados.0.smithi084.stdout:46: seq_num 45 ranges {0=761856} 2024-03-30T12:22:18.186 INFO:tasks.rados.rados.0.smithi084.stdout:46: writing smithi08477944-46 from 0 to 761856 tid 1 2024-03-30T12:22:18.186 INFO:tasks.rados.rados.0.smithi084.stdout:47: write initial oid 47 2024-03-30T12:22:18.186 INFO:tasks.rados.rados.0.smithi084.stdout:47: seq_num 46 ranges {0=778240} 2024-03-30T12:22:18.189 INFO:tasks.rados.rados.0.smithi084.stdout:47: writing smithi08477944-47 from 0 to 778240 tid 1 2024-03-30T12:22:18.189 INFO:tasks.rados.rados.0.smithi084.stdout: waiting on 16 2024-03-30T12:22:18.189 INFO:tasks.rados.rados.0.smithi084.stdout:32: finishing write tid 3 to smithi08477944-32 2024-03-30T12:22:18.189 INFO:tasks.rados.rados.0.smithi084.stdout:32: oid 32 updating version 0 to 4 2024-03-30T12:22:18.189 INFO:tasks.rados.rados.0.smithi084.stdout:32: oid 32 version 4 is already newer than 3 2024-03-30T12:22:18.189 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 4 (ObjNum 31 snap 0 seq_num 31) dirty exists 2024-03-30T12:22:18.189 INFO:tasks.rados.rados.0.smithi084.stdout:32: left oid 32 (ObjNum 31 snap 0 seq_num 31) 2024-03-30T12:22:18.189 INFO:tasks.rados.rados.0.smithi084.stdout:33: finishing write tid 1 to smithi08477944-33 2024-03-30T12:22:18.190 INFO:tasks.rados.rados.0.smithi084.stdout:32: done (15 left) 2024-03-30T12:22:18.190 INFO:tasks.rados.rados.0.smithi084.stdout:48: write initial oid 48 2024-03-30T12:22:18.190 INFO:tasks.rados.rados.0.smithi084.stdout:48: seq_num 47 ranges {0=794624} 2024-03-30T12:22:18.194 INFO:tasks.rados.rados.0.smithi084.stdout:48: writing smithi08477944-48 from 0 to 794624 tid 1 2024-03-30T12:22:18.194 INFO:tasks.rados.rados.0.smithi084.stdout: waiting on 16 2024-03-30T12:22:18.194 INFO:tasks.rados.rados.0.smithi084.stdout:33: finishing write tid 2 to smithi08477944-33 2024-03-30T12:22:18.194 INFO:tasks.rados.rados.0.smithi084.stdout:33: finishing write tid 3 to smithi08477944-33 2024-03-30T12:22:18.194 INFO:tasks.rados.rados.0.smithi084.stdout:33: oid 33 updating version 0 to 5 2024-03-30T12:22:18.195 INFO:tasks.rados.rados.0.smithi084.stdout:33: oid 33 updating version 5 to 6 2024-03-30T12:22:18.195 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 6 (ObjNum 32 snap 0 seq_num 32) dirty exists 2024-03-30T12:22:18.195 INFO:tasks.rados.rados.0.smithi084.stdout:33: left oid 33 (ObjNum 32 snap 0 seq_num 32) 2024-03-30T12:22:18.195 INFO:tasks.rados.rados.0.smithi084.stdout:34: finishing write tid 1 to smithi08477944-34 2024-03-30T12:22:18.195 INFO:tasks.rados.rados.0.smithi084.stdout:34: finishing write tid 2 to smithi08477944-34 2024-03-30T12:22:18.195 INFO:tasks.rados.rados.0.smithi084.stdout:33: done (15 left) 2024-03-30T12:22:18.195 INFO:tasks.rados.rados.0.smithi084.stdout:49: write initial oid 49 2024-03-30T12:22:18.195 INFO:tasks.rados.rados.0.smithi084.stdout:49: seq_num 48 ranges {0=409600,409600=401408} 2024-03-30T12:22:18.196 INFO:tasks.rados.rados.0.smithi084.stdout:49: writing smithi08477944-49 from 0 to 409600 tid 1 2024-03-30T12:22:18.200 INFO:tasks.rados.rados.0.smithi084.stdout:49: writing smithi08477944-49 from 409600 to 811008 tid 2 2024-03-30T12:22:18.200 INFO:tasks.rados.rados.0.smithi084.stdout: waiting on 16 2024-03-30T12:22:18.200 INFO:tasks.rados.rados.0.smithi084.stdout:34: finishing write tid 3 to smithi08477944-34 2024-03-30T12:22:18.200 INFO:tasks.rados.rados.0.smithi084.stdout:34: oid 34 updating version 0 to 5 2024-03-30T12:22:18.200 INFO:tasks.rados.rados.0.smithi084.stdout:34: oid 34 updating version 5 to 6 2024-03-30T12:22:18.200 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 6 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-03-30T12:22:18.201 INFO:tasks.rados.rados.0.smithi084.stdout:34: left oid 34 (ObjNum 33 snap 0 seq_num 33) 2024-03-30T12:22:18.201 INFO:tasks.rados.rados.0.smithi084.stdout:35: finishing write tid 1 to smithi08477944-35 2024-03-30T12:22:18.201 INFO:tasks.rados.rados.0.smithi084.stdout:35: finishing write tid 2 to smithi08477944-35 2024-03-30T12:22:18.201 INFO:tasks.rados.rados.0.smithi084.stdout:35: finishing write tid 3 to smithi08477944-35 2024-03-30T12:22:18.201 INFO:tasks.rados.rados.0.smithi084.stdout:35: oid 35 updating version 0 to 3 2024-03-30T12:22:18.201 INFO:tasks.rados.rados.0.smithi084.stdout:35: oid 35 updating version 3 to 4 2024-03-30T12:22:18.201 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 4 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-03-30T12:22:18.201 INFO:tasks.rados.rados.0.smithi084.stdout:35: left oid 35 (ObjNum 34 snap 0 seq_num 34) 2024-03-30T12:22:18.201 INFO:tasks.rados.rados.0.smithi084.stdout:36: finishing write tid 1 to smithi08477944-36 2024-03-30T12:22:18.201 INFO:tasks.rados.rados.0.smithi084.stdout:34: done (15 left) 2024-03-30T12:22:18.201 INFO:tasks.rados.rados.0.smithi084.stdout:35: done (14 left) 2024-03-30T12:22:18.201 INFO:tasks.rados.rados.0.smithi084.stdout:50: write initial oid 50 2024-03-30T12:22:18.201 INFO:tasks.rados.rados.0.smithi084.stdout:50: seq_num 49 ranges {0=425984,425984=401408} 2024-03-30T12:22:18.202 INFO:tasks.rados.rados.0.smithi084.stdout:50: writing smithi08477944-50 from 0 to 425984 tid 1 2024-03-30T12:22:18.206 INFO:tasks.rados.rados.0.smithi084.stdout:50: writing smithi08477944-50 from 425984 to 827392 tid 2 2024-03-30T12:22:18.206 INFO:tasks.rados.rados.0.smithi084.stdout:51: copy_from oid 2 from oid 11 current snap is 0 2024-03-30T12:22:18.206 INFO:tasks.rados.rados.0.smithi084.stdout:36: finishing write tid 2 to smithi08477944-36 2024-03-30T12:22:18.206 INFO:tasks.rados.rados.0.smithi084.stdout:36: finishing write tid 3 to smithi08477944-36 2024-03-30T12:22:18.206 INFO:tasks.rados.rados.0.smithi084.stdout:36: oid 36 updating version 0 to 5 2024-03-30T12:22:18.206 INFO:tasks.rados.rados.0.smithi084.stdout:36: oid 36 updating version 5 to 6 2024-03-30T12:22:18.206 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 6 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-03-30T12:22:18.206 INFO:tasks.rados.rados.0.smithi084.stdout:36: left oid 36 (ObjNum 35 snap 0 seq_num 35) 2024-03-30T12:22:18.206 INFO:tasks.rados.rados.0.smithi084.stdout:37: finishing write tid 1 to smithi08477944-37 2024-03-30T12:22:18.207 INFO:tasks.rados.rados.0.smithi084.stdout:37: finishing write tid 2 to smithi08477944-37 2024-03-30T12:22:18.207 INFO:tasks.rados.rados.0.smithi084.stdout:36: done (15 left) 2024-03-30T12:22:18.207 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 0 2024-03-30T12:22:18.207 INFO:tasks.rados.rados.0.smithi084.stdout:37: finishing write tid 3 to smithi08477944-37 2024-03-30T12:22:18.207 INFO:tasks.rados.rados.0.smithi084.stdout:37: oid 37 updating version 0 to 5 2024-03-30T12:22:18.207 INFO:tasks.rados.rados.0.smithi084.stdout:37: oid 37 updating version 5 to 6 2024-03-30T12:22:18.207 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 6 (ObjNum 36 snap 0 seq_num 36) dirty exists 2024-03-30T12:22:18.207 INFO:tasks.rados.rados.0.smithi084.stdout:37: left oid 37 (ObjNum 36 snap 0 seq_num 36) 2024-03-30T12:22:18.207 INFO:tasks.rados.rados.0.smithi084.stdout:38: finishing write tid 1 to smithi08477944-38 2024-03-30T12:22:18.207 INFO:tasks.rados.rados.0.smithi084.stdout:38: finishing write tid 2 to smithi08477944-38 2024-03-30T12:22:18.207 INFO:tasks.rados.rados.0.smithi084.stdout:38: finishing write tid 3 to smithi08477944-38 2024-03-30T12:22:18.207 INFO:tasks.rados.rados.0.smithi084.stdout:38: oid 38 updating version 0 to 4 2024-03-30T12:22:18.207 INFO:tasks.rados.rados.0.smithi084.stdout:38: oid 38 version 4 is already newer than 3 2024-03-30T12:22:18.207 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 4 (ObjNum 37 snap 0 seq_num 37) dirty exists 2024-03-30T12:22:18.207 INFO:tasks.rados.rados.0.smithi084.stdout:38: left oid 38 (ObjNum 37 snap 0 seq_num 37) 2024-03-30T12:22:18.207 INFO:tasks.rados.rados.0.smithi084.stdout:39: finishing write tid 1 to smithi08477944-39 2024-03-30T12:22:18.207 INFO:tasks.rados.rados.0.smithi084.stdout:52: seq_num 50 ranges {409600=442368,851968=401408} 2024-03-30T12:22:18.211 INFO:tasks.rados.rados.0.smithi084.stdout:52: writing smithi08477944-25 from 409600 to 851968 tid 1 2024-03-30T12:22:18.216 INFO:tasks.rados.rados.0.smithi084.stdout:52: writing smithi08477944-25 from 851968 to 1253376 tid 2 2024-03-30T12:22:18.216 INFO:tasks.rados.rados.0.smithi084.stdout:37: done (15 left) 2024-03-30T12:22:18.216 INFO:tasks.rados.rados.0.smithi084.stdout:38: done (14 left) 2024-03-30T12:22:18.216 INFO:tasks.rados.rados.0.smithi084.stdout:53: rmattr oid 6 current snap is 0 2024-03-30T12:22:18.217 INFO:tasks.rados.rados.0.smithi084.stdout:53: done (14 left) 2024-03-30T12:22:18.217 INFO:tasks.rados.rados.0.smithi084.stdout:54: delete oid 6 current snap is 0 2024-03-30T12:22:18.217 INFO:tasks.rados.rados.0.smithi084.stdout:39: finishing write tid 2 to smithi08477944-39 2024-03-30T12:22:18.217 INFO:tasks.rados.rados.0.smithi084.stdout:39: finishing write tid 3 to smithi08477944-39 2024-03-30T12:22:18.217 INFO:tasks.rados.rados.0.smithi084.stdout:39: oid 39 updating version 0 to 6 2024-03-30T12:22:18.217 INFO:tasks.rados.rados.0.smithi084.stdout:39: oid 39 version 6 is already newer than 5 2024-03-30T12:22:18.217 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 6 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-03-30T12:22:18.217 INFO:tasks.rados.rados.0.smithi084.stdout:39: left oid 39 (ObjNum 38 snap 0 seq_num 38) 2024-03-30T12:22:18.217 INFO:tasks.rados.rados.0.smithi084.stdout:40: finishing write tid 1 to smithi08477944-40 2024-03-30T12:22:18.217 INFO:tasks.rados.rados.0.smithi084.stdout:40: finishing write tid 2 to smithi08477944-40 2024-03-30T12:22:18.217 INFO:tasks.rados.rados.0.smithi084.stdout:40: finishing write tid 3 to smithi08477944-40 2024-03-30T12:22:18.217 INFO:tasks.rados.rados.0.smithi084.stdout:40: oid 40 updating version 0 to 7 2024-03-30T12:22:18.217 INFO:tasks.rados.rados.0.smithi084.stdout:40: oid 40 updating version 7 to 8 2024-03-30T12:22:18.217 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 8 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-03-30T12:22:18.217 INFO:tasks.rados.rados.0.smithi084.stdout:40: left oid 40 (ObjNum 39 snap 0 seq_num 39) 2024-03-30T12:22:18.218 INFO:tasks.rados.rados.0.smithi084.stdout:41: finishing write tid 1 to smithi08477944-41 2024-03-30T12:22:18.218 INFO:tasks.rados.rados.0.smithi084.stdout:41: finishing write tid 2 to smithi08477944-41 2024-03-30T12:22:18.218 INFO:tasks.rados.rados.0.smithi084.stdout:41: finishing write tid 3 to smithi08477944-41 2024-03-30T12:22:18.218 INFO:tasks.rados.rados.0.smithi084.stdout:41: oid 41 updating version 0 to 6 2024-03-30T12:22:18.218 INFO:tasks.rados.rados.0.smithi084.stdout:41: oid 41 version 6 is already newer than 5 2024-03-30T12:22:18.218 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 6 (ObjNum 40 snap 0 seq_num 40) dirty exists 2024-03-30T12:22:18.218 INFO:tasks.rados.rados.0.smithi084.stdout:41: left oid 41 (ObjNum 40 snap 0 seq_num 40) 2024-03-30T12:22:18.218 INFO:tasks.rados.rados.0.smithi084.stdout:42: finishing write tid 1 to smithi08477944-42 2024-03-30T12:22:18.218 INFO:tasks.rados.rados.0.smithi084.stdout:42: finishing write tid 2 to smithi08477944-42 2024-03-30T12:22:18.218 INFO:tasks.rados.rados.0.smithi084.stdout:42: finishing write tid 3 to smithi08477944-42 2024-03-30T12:22:18.218 INFO:tasks.rados.rados.0.smithi084.stdout:42: oid 42 updating version 0 to 8 2024-03-30T12:22:18.218 INFO:tasks.rados.rados.0.smithi084.stdout:42: oid 42 version 8 is already newer than 7 2024-03-30T12:22:18.218 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 8 (ObjNum 41 snap 0 seq_num 41) dirty exists 2024-03-30T12:22:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:42: left oid 42 (ObjNum 41 snap 0 seq_num 41) 2024-03-30T12:22:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:43: finishing write tid 1 to smithi08477944-43 2024-03-30T12:22:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:43: finishing write tid 2 to smithi08477944-43 2024-03-30T12:22:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:43: finishing write tid 3 to smithi08477944-43 2024-03-30T12:22:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:43: oid 43 updating version 0 to 5 2024-03-30T12:22:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:43: oid 43 updating version 5 to 6 2024-03-30T12:22:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 6 (ObjNum 42 snap 0 seq_num 42) dirty exists 2024-03-30T12:22:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:43: left oid 43 (ObjNum 42 snap 0 seq_num 42) 2024-03-30T12:22:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:44: finishing write tid 1 to smithi08477944-44 2024-03-30T12:22:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:44: finishing write tid 2 to smithi08477944-44 2024-03-30T12:22:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:44: finishing write tid 3 to smithi08477944-44 2024-03-30T12:22:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:44: oid 44 updating version 0 to 7 2024-03-30T12:22:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:44: oid 44 updating version 7 to 8 2024-03-30T12:22:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 8 (ObjNum 43 snap 0 seq_num 43) dirty exists 2024-03-30T12:22:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:44: left oid 44 (ObjNum 43 snap 0 seq_num 43) 2024-03-30T12:22:18.220 INFO:tasks.rados.rados.0.smithi084.stdout:45: finishing write tid 1 to smithi08477944-45 2024-03-30T12:22:18.220 INFO:tasks.rados.rados.0.smithi084.stdout:45: finishing write tid 2 to smithi08477944-45 2024-03-30T12:22:18.220 INFO:tasks.rados.rados.0.smithi084.stdout:45: finishing write tid 3 to smithi08477944-45 2024-03-30T12:22:18.220 INFO:tasks.rados.rados.0.smithi084.stdout:45: oid 45 updating version 0 to 8 2024-03-30T12:22:18.220 INFO:tasks.rados.rados.0.smithi084.stdout:45: oid 45 version 8 is already newer than 7 2024-03-30T12:22:18.220 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 8 (ObjNum 44 snap 0 seq_num 44) dirty exists 2024-03-30T12:22:18.220 INFO:tasks.rados.rados.0.smithi084.stdout:45: left oid 45 (ObjNum 44 snap 0 seq_num 44) 2024-03-30T12:22:18.220 INFO:tasks.rados.rados.0.smithi084.stdout:46: finishing write tid 1 to smithi08477944-46 2024-03-30T12:22:18.220 INFO:tasks.rados.rados.0.smithi084.stdout:46: finishing write tid 2 to smithi08477944-46 2024-03-30T12:22:18.220 INFO:tasks.rados.rados.0.smithi084.stdout:46: finishing write tid 3 to smithi08477944-46 2024-03-30T12:22:18.220 INFO:tasks.rados.rados.0.smithi084.stdout:46: oid 46 updating version 0 to 11 2024-03-30T12:22:18.220 INFO:tasks.rados.rados.0.smithi084.stdout:46: oid 46 updating version 11 to 12 2024-03-30T12:22:18.220 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 12 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-03-30T12:22:18.220 INFO:tasks.rados.rados.0.smithi084.stdout:46: left oid 46 (ObjNum 45 snap 0 seq_num 45) 2024-03-30T12:22:18.220 INFO:tasks.rados.rados.0.smithi084.stdout:47: finishing write tid 1 to smithi08477944-47 2024-03-30T12:22:18.221 INFO:tasks.rados.rados.0.smithi084.stdout:47: finishing write tid 2 to smithi08477944-47 2024-03-30T12:22:18.221 INFO:tasks.rados.rados.0.smithi084.stdout:47: finishing write tid 3 to smithi08477944-47 2024-03-30T12:22:18.221 INFO:tasks.rados.rados.0.smithi084.stdout:47: oid 47 updating version 0 to 9 2024-03-30T12:22:18.221 INFO:tasks.rados.rados.0.smithi084.stdout:47: oid 47 updating version 9 to 10 2024-03-30T12:22:18.221 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 10 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-03-30T12:22:18.221 INFO:tasks.rados.rados.0.smithi084.stdout:47: left oid 47 (ObjNum 46 snap 0 seq_num 46) 2024-03-30T12:22:18.221 INFO:tasks.rados.rados.0.smithi084.stdout:48: finishing write tid 1 to smithi08477944-48 2024-03-30T12:22:18.221 INFO:tasks.rados.rados.0.smithi084.stdout:48: finishing write tid 2 to smithi08477944-48 2024-03-30T12:22:18.221 INFO:tasks.rados.rados.0.smithi084.stdout:48: finishing write tid 3 to smithi08477944-48 2024-03-30T12:22:18.221 INFO:tasks.rados.rados.0.smithi084.stdout:48: oid 48 updating version 0 to 1 2024-03-30T12:22:18.221 INFO:tasks.rados.rados.0.smithi084.stdout:48: oid 48 updating version 1 to 2 2024-03-30T12:22:18.221 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 2 (ObjNum 47 snap 0 seq_num 47) dirty exists 2024-03-30T12:22:18.221 INFO:tasks.rados.rados.0.smithi084.stdout:48: left oid 48 (ObjNum 47 snap 0 seq_num 47) 2024-03-30T12:22:18.221 INFO:tasks.rados.rados.0.smithi084.stdout:49: finishing write tid 1 to smithi08477944-49 2024-03-30T12:22:18.221 INFO:tasks.rados.rados.0.smithi084.stdout:49: finishing write tid 2 to smithi08477944-49 2024-03-30T12:22:18.222 INFO:tasks.rados.rados.0.smithi084.stdout:49: finishing write tid 3 to smithi08477944-49 2024-03-30T12:22:18.222 INFO:tasks.rados.rados.0.smithi084.stdout:49: finishing write tid 4 to smithi08477944-49 2024-03-30T12:22:18.222 INFO:tasks.rados.rados.0.smithi084.stdout:49: oid 49 updating version 0 to 8 2024-03-30T12:22:18.222 INFO:tasks.rados.rados.0.smithi084.stdout:49: oid 49 version 8 is already newer than 7 2024-03-30T12:22:18.222 INFO:tasks.rados.rados.0.smithi084.stdout:49: oid 49 updating version 8 to 9 2024-03-30T12:22:18.222 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 9 (ObjNum 48 snap 0 seq_num 48) dirty exists 2024-03-30T12:22:18.222 INFO:tasks.rados.rados.0.smithi084.stdout:49: left oid 49 (ObjNum 48 snap 0 seq_num 48) 2024-03-30T12:22:18.222 INFO:tasks.rados.rados.0.smithi084.stdout:50: finishing write tid 1 to smithi08477944-50 2024-03-30T12:22:18.222 INFO:tasks.rados.rados.0.smithi084.stdout:50: finishing write tid 2 to smithi08477944-50 2024-03-30T12:22:18.222 INFO:tasks.rados.rados.0.smithi084.stdout:50: finishing write tid 3 to smithi08477944-50 2024-03-30T12:22:18.222 INFO:tasks.rados.rados.0.smithi084.stdout:51: finishing copy_from racing read to smithi08477944-2 2024-03-30T12:22:18.222 INFO:tasks.rados.rados.0.smithi084.stdout:51: finishing copy_from to smithi08477944-2 2024-03-30T12:22:18.222 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 4 (ObjNum 10 snap 0 seq_num 10) dirty exists 2024-03-30T12:22:18.223 INFO:tasks.rados.rados.0.smithi084.stdout:50: finishing write tid 4 to smithi08477944-50 2024-03-30T12:22:18.223 INFO:tasks.rados.rados.0.smithi084.stdout:50: oid 50 updating version 0 to 11 2024-03-30T12:22:18.223 INFO:tasks.rados.rados.0.smithi084.stdout:50: oid 50 version 11 is already newer than 10 2024-03-30T12:22:18.223 INFO:tasks.rados.rados.0.smithi084.stdout:50: oid 50 version 11 is already newer than 9 2024-03-30T12:22:18.223 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 11 (ObjNum 49 snap 0 seq_num 49) dirty exists 2024-03-30T12:22:18.223 INFO:tasks.rados.rados.0.smithi084.stdout:50: left oid 50 (ObjNum 49 snap 0 seq_num 49) 2024-03-30T12:22:18.223 INFO:tasks.rados.rados.0.smithi084.stdout:52: finishing write tid 1 to smithi08477944-25 2024-03-30T12:22:18.223 INFO:tasks.rados.rados.0.smithi084.stdout:39: done (14 left) 2024-03-30T12:22:18.223 INFO:tasks.rados.rados.0.smithi084.stdout:40: done (13 left) 2024-03-30T12:22:18.223 INFO:tasks.rados.rados.0.smithi084.stdout:41: done (12 left) 2024-03-30T12:22:18.223 INFO:tasks.rados.rados.0.smithi084.stdout:42: done (11 left) 2024-03-30T12:22:18.223 INFO:tasks.rados.rados.0.smithi084.stdout:43: done (10 left) 2024-03-30T12:22:18.223 INFO:tasks.rados.rados.0.smithi084.stdout:44: done (9 left) 2024-03-30T12:22:18.223 INFO:tasks.rados.rados.0.smithi084.stdout:45: done (8 left) 2024-03-30T12:22:18.223 INFO:tasks.rados.rados.0.smithi084.stdout:46: done (7 left) 2024-03-30T12:22:18.224 INFO:tasks.rados.rados.0.smithi084.stdout:47: done (6 left) 2024-03-30T12:22:18.224 INFO:tasks.rados.rados.0.smithi084.stdout:48: done (5 left) 2024-03-30T12:22:18.224 INFO:tasks.rados.rados.0.smithi084.stdout:49: done (4 left) 2024-03-30T12:22:18.224 INFO:tasks.rados.rados.0.smithi084.stdout:50: done (3 left) 2024-03-30T12:22:18.224 INFO:tasks.rados.rados.0.smithi084.stdout:51: done (2 left) 2024-03-30T12:22:18.224 INFO:tasks.rados.rados.0.smithi084.stdout:54: done (1 left) 2024-03-30T12:22:18.224 INFO:tasks.rados.rados.0.smithi084.stdout:55: read oid 15 snap -1 2024-03-30T12:22:18.224 INFO:tasks.rados.rados.0.smithi084.stdout:55: expect (ObjNum 14 snap 0 seq_num 14) 2024-03-30T12:22:18.224 INFO:tasks.rados.rados.0.smithi084.stdout:56: rollback oid 31 current snap is 0 2024-03-30T12:22:18.224 INFO:tasks.rados.rados.0.smithi084.stdout:56: done (2 left) 2024-03-30T12:22:18.224 INFO:tasks.rados.rados.0.smithi084.stdout:57: read oid 28 snap -1 2024-03-30T12:22:18.224 INFO:tasks.rados.rados.0.smithi084.stdout:57: expect (ObjNum 27 snap 0 seq_num 27) 2024-03-30T12:22:18.224 INFO:tasks.rados.rados.0.smithi084.stdout:58: copy_from oid 29 from oid 47 current snap is 0 2024-03-30T12:22:18.224 INFO:tasks.rados.rados.0.smithi084.stdout:59: rollback oid 45 current snap is 0 2024-03-30T12:22:18.224 INFO:tasks.rados.rados.0.smithi084.stdout:59: done (4 left) 2024-03-30T12:22:18.224 INFO:tasks.rados.rados.0.smithi084.stdout:60: copy_from oid 22 from oid 48 current snap is 0 2024-03-30T12:22:18.225 INFO:tasks.rados.rados.0.smithi084.stdout:61: delete oid 1 current snap is 0 2024-03-30T12:22:18.225 INFO:tasks.rados.rados.0.smithi084.stdout:52: finishing write tid 2 to smithi08477944-25 2024-03-30T12:22:18.225 INFO:tasks.rados.rados.0.smithi084.stdout:52: finishing write tid 3 to smithi08477944-25 2024-03-30T12:22:18.225 INFO:tasks.rados.rados.0.smithi084.stdout:61: done (5 left) 2024-03-30T12:22:18.225 INFO:tasks.rados.rados.0.smithi084.stdout:62: read oid 17 snap -1 2024-03-30T12:22:18.226 INFO:tasks.rados.rados.0.smithi084.stdout:62: expect (ObjNum 16 snap 0 seq_num 16) 2024-03-30T12:22:18.226 INFO:tasks.rados.rados.0.smithi084.stdout:63: snap_create 2024-03-30T12:22:18.226 INFO:tasks.rados.rados.0.smithi084.stdout:52: finishing write tid 4 to smithi08477944-25 2024-03-30T12:22:18.226 INFO:tasks.rados.rados.0.smithi084.stdout:52: oid 25 updating version 0 to 8 2024-03-30T12:22:18.226 INFO:tasks.rados.rados.0.smithi084.stdout:52: oid 25 updating version 8 to 9 2024-03-30T12:22:18.226 INFO:tasks.rados.rados.0.smithi084.stdout:52: oid 25 version 9 is already newer than 7 2024-03-30T12:22:18.226 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 9 (ObjNum 50 snap 0 seq_num 50) dirty exists 2024-03-30T12:22:18.226 INFO:tasks.rados.rados.0.smithi084.stdout:52: left oid 25 (ObjNum 50 snap 0 seq_num 50) 2024-03-30T12:22:18.226 INFO:tasks.rados.rados.0.smithi084.stdout:55: expect (ObjNum 14 snap 0 seq_num 14) 2024-03-30T12:22:18.228 INFO:tasks.rados.rados.0.smithi084.stdout:57: expect (ObjNum 27 snap 0 seq_num 27) 2024-03-30T12:22:18.240 INFO:tasks.rados.rados.0.smithi084.stdout:60: finishing copy_from racing read to smithi08477944-22 2024-03-30T12:22:18.240 INFO:tasks.rados.rados.0.smithi084.stdout:62: expect (ObjNum 16 snap 0 seq_num 16) 2024-03-30T12:22:18.247 INFO:tasks.rados.rados.0.smithi084.stdout:60: finishing copy_from to smithi08477944-22 2024-03-30T12:22:18.248 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 2 (ObjNum 47 snap 0 seq_num 47) dirty exists 2024-03-30T12:22:18.248 INFO:tasks.rados.rados.0.smithi084.stdout:58: finishing copy_from racing read to smithi08477944-29 2024-03-30T12:22:18.248 INFO:tasks.rados.rados.0.smithi084.stdout:58: finishing copy_from to smithi08477944-29 2024-03-30T12:22:18.248 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 10 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-03-30T12:22:18.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:18 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/140616457' entity='client.0' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2024-03-30T12:22:18.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:18 smithi162 ceph-mon[30421]: from='client.? ' entity='client.0' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2024-03-30T12:22:18.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:18 smithi162 ceph-mon[30421]: pgmap v93: 121 pgs: 121 active+clean; 580 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:18.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:18 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/140616457' entity='client.0' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2024-03-30T12:22:18.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:18 smithi084 ceph-mon[37565]: from='client.? ' entity='client.0' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2024-03-30T12:22:18.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:18 smithi084 ceph-mon[37565]: pgmap v93: 121 pgs: 121 active+clean; 580 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:18.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:18 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/140616457' entity='client.0' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2024-03-30T12:22:18.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:18 smithi084 ceph-mon[27000]: from='client.? ' entity='client.0' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2024-03-30T12:22:18.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:18 smithi084 ceph-mon[27000]: pgmap v93: 121 pgs: 121 active+clean; 580 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:19.059 INFO:tasks.rados.rados.0.smithi084.stdout:52: done (6 left) 2024-03-30T12:22:19.059 INFO:tasks.rados.rados.0.smithi084.stdout:55: done (5 left) 2024-03-30T12:22:19.059 INFO:tasks.rados.rados.0.smithi084.stdout:57: done (4 left) 2024-03-30T12:22:19.060 INFO:tasks.rados.rados.0.smithi084.stdout:58: done (3 left) 2024-03-30T12:22:19.060 INFO:tasks.rados.rados.0.smithi084.stdout:60: done (2 left) 2024-03-30T12:22:19.060 INFO:tasks.rados.rados.0.smithi084.stdout:62: done (1 left) 2024-03-30T12:22:19.060 INFO:tasks.rados.rados.0.smithi084.stdout:63: done (0 left) 2024-03-30T12:22:19.060 INFO:tasks.rados.rados.0.smithi084.stdout:64: copy_from oid 15 from oid 2 current snap is 1 2024-03-30T12:22:19.060 INFO:tasks.rados.rados.0.smithi084.stdout:65: read oid 30 snap -1 2024-03-30T12:22:19.060 INFO:tasks.rados.rados.0.smithi084.stdout:65: expect (ObjNum 29 snap 0 seq_num 29) 2024-03-30T12:22:19.060 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 1 2024-03-30T12:22:19.060 INFO:tasks.rados.rados.0.smithi084.stdout:66: seq_num 53 ranges {376832=491520,868352=401408} 2024-03-30T12:22:19.064 INFO:tasks.rados.rados.0.smithi084.stdout:66: writing smithi08477944-23 from 376832 to 868352 tid 1 2024-03-30T12:22:19.067 INFO:tasks.rados.rados.0.smithi084.stdout:66: writing smithi08477944-23 from 868352 to 1269760 tid 2 2024-03-30T12:22:19.068 INFO:tasks.rados.rados.0.smithi084.stdout:65: expect (ObjNum 29 snap 0 seq_num 29) 2024-03-30T12:22:19.085 INFO:tasks.rados.rados.0.smithi084.stdout:66: finishing write tid 1 to smithi08477944-23 2024-03-30T12:22:19.085 INFO:tasks.rados.rados.0.smithi084.stdout:64: finishing copy_from racing read to smithi08477944-15 2024-03-30T12:22:19.085 INFO:tasks.rados.rados.0.smithi084.stdout:64: finishing copy_from to smithi08477944-15 2024-03-30T12:22:19.085 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 4 (ObjNum 10 snap 0 seq_num 10) dirty exists 2024-03-30T12:22:19.085 INFO:tasks.rados.rados.0.smithi084.stdout:66: finishing write tid 2 to smithi08477944-23 2024-03-30T12:22:19.085 INFO:tasks.rados.rados.0.smithi084.stdout:66: finishing write tid 3 to smithi08477944-23 2024-03-30T12:22:19.085 INFO:tasks.rados.rados.0.smithi084.stdout:66: finishing write tid 4 to smithi08477944-23 2024-03-30T12:22:19.085 INFO:tasks.rados.rados.0.smithi084.stdout:66: oid 23 updating version 0 to 13 2024-03-30T12:22:19.086 INFO:tasks.rados.rados.0.smithi084.stdout:66: oid 23 version 13 is already newer than 11 2024-03-30T12:22:19.086 INFO:tasks.rados.rados.0.smithi084.stdout:66: oid 23 version 13 is already newer than 12 2024-03-30T12:22:19.086 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 13 (ObjNum 53 snap 1 seq_num 53) dirty exists 2024-03-30T12:22:19.086 INFO:tasks.rados.rados.0.smithi084.stdout:66: left oid 23 (ObjNum 53 snap 1 seq_num 53) 2024-03-30T12:22:19.086 INFO:tasks.rados.rados.0.smithi084.stdout:64: done (2 left) 2024-03-30T12:22:19.086 INFO:tasks.rados.rados.0.smithi084.stdout:65: done (1 left) 2024-03-30T12:22:19.086 INFO:tasks.rados.rados.0.smithi084.stdout:66: done (0 left) 2024-03-30T12:22:19.086 INFO:tasks.rados.rados.0.smithi084.stdout:67: rollback oid 43 current snap is 1 2024-03-30T12:22:19.086 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 43 to 0 2024-03-30T12:22:19.086 INFO:tasks.rados.rados.0.smithi084.stdout:68: setattr oid 30 current snap is 1 2024-03-30T12:22:19.087 INFO:tasks.rados.rados.0.smithi084.stdout:69: copy_from oid 37 from oid 3 current snap is 1 2024-03-30T12:22:19.087 INFO:tasks.rados.rados.0.smithi084.stdout:70: read oid 15 snap 0 2024-03-30T12:22:19.088 INFO:tasks.rados.rados.0.smithi084.stdout:70: expect (ObjNum 14 snap 0 seq_num 14) 2024-03-30T12:22:19.088 INFO:tasks.rados.rados.0.smithi084.stdout:71: copy_from oid 14 from oid 41 current snap is 1 2024-03-30T12:22:19.088 INFO:tasks.rados.rados.0.smithi084.stdout:72: rollback oid 38 current snap is 1 2024-03-30T12:22:19.088 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 38 to 0 2024-03-30T12:22:19.088 INFO:tasks.rados.rados.0.smithi084.stdout:73: read oid 47 snap 0 2024-03-30T12:22:19.088 INFO:tasks.rados.rados.0.smithi084.stdout:73: expect (ObjNum 46 snap 0 seq_num 46) 2024-03-30T12:22:19.088 INFO:tasks.rados.rados.0.smithi084.stdout:74: rmattr oid 18 current snap is 1 2024-03-30T12:22:19.088 INFO:tasks.rados.rados.0.smithi084.stdout:74: done (7 left) 2024-03-30T12:22:19.088 INFO:tasks.rados.rados.0.smithi084.stdout:75: copy_from oid 42 from oid 12 current snap is 1 2024-03-30T12:22:19.088 INFO:tasks.rados.rados.0.smithi084.stdout:76: read oid 26 snap -1 2024-03-30T12:22:19.088 INFO:tasks.rados.rados.0.smithi084.stdout:76: expect (ObjNum 25 snap 0 seq_num 25) 2024-03-30T12:22:19.088 INFO:tasks.rados.rados.0.smithi084.stdout:77: copy_from oid 39 from oid 33 current snap is 1 2024-03-30T12:22:19.088 INFO:tasks.rados.rados.0.smithi084.stdout:78: read oid 25 snap -1 2024-03-30T12:22:19.088 INFO:tasks.rados.rados.0.smithi084.stdout:78: expect (ObjNum 50 snap 0 seq_num 50) 2024-03-30T12:22:19.088 INFO:tasks.rados.rados.0.smithi084.stdout:79: setattr oid 46 current snap is 1 2024-03-30T12:22:19.089 INFO:tasks.rados.rados.0.smithi084.stdout:80: snap_create 2024-03-30T12:22:19.090 INFO:tasks.rados.rados.0.smithi084.stdout:67: finishing rollback tid 0 to smithi08477944-43 2024-03-30T12:22:19.090 INFO:tasks.rados.rados.0.smithi084.stdout:67: finishing rollback tid 1 to smithi08477944-43 2024-03-30T12:22:19.090 INFO:tasks.rados.rados.0.smithi084.stdout:67: finishing rollback tid 2 to smithi08477944-43 2024-03-30T12:22:19.090 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 13 (ObjNum 42 snap 0 seq_num 42) dirty exists 2024-03-30T12:22:19.091 INFO:tasks.rados.rados.0.smithi084.stdout:70: expect (ObjNum 14 snap 0 seq_num 14) 2024-03-30T12:22:19.104 INFO:tasks.rados.rados.0.smithi084.stdout:73: expect (ObjNum 46 snap 0 seq_num 46) 2024-03-30T12:22:19.133 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 6 (ObjNum 29 snap 0 seq_num 29) dirty exists 2024-03-30T12:22:19.133 INFO:tasks.rados.rados.0.smithi084.stdout:76: expect (ObjNum 25 snap 0 seq_num 25) 2024-03-30T12:22:19.145 INFO:tasks.rados.rados.0.smithi084.stdout:72: finishing rollback tid 0 to smithi08477944-38 2024-03-30T12:22:19.145 INFO:tasks.rados.rados.0.smithi084.stdout:72: finishing rollback tid 1 to smithi08477944-38 2024-03-30T12:22:19.145 INFO:tasks.rados.rados.0.smithi084.stdout:72: finishing rollback tid 2 to smithi08477944-38 2024-03-30T12:22:19.145 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 10 (ObjNum 37 snap 0 seq_num 37) dirty exists 2024-03-30T12:22:19.145 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 16 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-03-30T12:22:19.145 INFO:tasks.rados.rados.0.smithi084.stdout:77: finishing copy_from racing read to smithi08477944-39 2024-03-30T12:22:19.145 INFO:tasks.rados.rados.0.smithi084.stdout:75: finishing copy_from racing read to smithi08477944-42 2024-03-30T12:22:19.145 INFO:tasks.rados.rados.0.smithi084.stdout:75: finishing copy_from to smithi08477944-42 2024-03-30T12:22:19.145 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 2 (ObjNum 11 snap 0 seq_num 11) dirty exists 2024-03-30T12:22:19.145 INFO:tasks.rados.rados.0.smithi084.stdout:71: finishing copy_from racing read to smithi08477944-14 2024-03-30T12:22:19.145 INFO:tasks.rados.rados.0.smithi084.stdout:69: finishing copy_from to smithi08477944-37 2024-03-30T12:22:19.145 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 4 (ObjNum 2 snap 0 seq_num 2) dirty exists 2024-03-30T12:22:19.146 INFO:tasks.rados.rados.0.smithi084.stdout:78: expect (ObjNum 50 snap 0 seq_num 50) 2024-03-30T12:22:19.185 INFO:tasks.rados.rados.0.smithi084.stdout:69: finishing copy_from racing read to smithi08477944-37 2024-03-30T12:22:19.185 INFO:tasks.rados.rados.0.smithi084.stdout:77: finishing copy_from to smithi08477944-39 2024-03-30T12:22:19.185 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 6 (ObjNum 32 snap 0 seq_num 32) dirty exists 2024-03-30T12:22:19.185 INFO:tasks.rados.rados.0.smithi084.stdout:71: finishing copy_from to smithi08477944-14 2024-03-30T12:22:19.185 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 6 (ObjNum 40 snap 0 seq_num 40) dirty exists 2024-03-30T12:22:19.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:19 smithi162 ceph-mon[30421]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-30T12:22:19.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:19 smithi162 ceph-mon[30421]: Cluster is now healthy 2024-03-30T12:22:19.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:19 smithi162 ceph-mon[30421]: from='client.? ' entity='client.0' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]': finished 2024-03-30T12:22:19.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:19 smithi162 ceph-mon[30421]: osdmap e75: 8 total, 8 up, 8 in 2024-03-30T12:22:19.404 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:22:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:22:19] "GET /metrics HTTP/1.1" 200 33659 "" "Prometheus/2.43.0" 2024-03-30T12:22:19.404 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:19 smithi084 ceph-mon[37565]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-30T12:22:19.405 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:19 smithi084 ceph-mon[37565]: Cluster is now healthy 2024-03-30T12:22:19.405 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:19 smithi084 ceph-mon[37565]: from='client.? ' entity='client.0' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]': finished 2024-03-30T12:22:19.405 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:19 smithi084 ceph-mon[37565]: osdmap e75: 8 total, 8 up, 8 in 2024-03-30T12:22:19.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:19 smithi084 ceph-mon[27000]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-30T12:22:19.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:19 smithi084 ceph-mon[27000]: Cluster is now healthy 2024-03-30T12:22:19.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:19 smithi084 ceph-mon[27000]: from='client.? ' entity='client.0' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]': finished 2024-03-30T12:22:19.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:19 smithi084 ceph-mon[27000]: osdmap e75: 8 total, 8 up, 8 in 2024-03-30T12:22:20.070 INFO:tasks.rados.rados.0.smithi084.stdout:67: done (12 left) 2024-03-30T12:22:20.070 INFO:tasks.rados.rados.0.smithi084.stdout:68: done (11 left) 2024-03-30T12:22:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:69: done (10 left) 2024-03-30T12:22:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:70: done (9 left) 2024-03-30T12:22:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:71: done (8 left) 2024-03-30T12:22:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:72: done (7 left) 2024-03-30T12:22:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:73: done (6 left) 2024-03-30T12:22:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:75: done (5 left) 2024-03-30T12:22:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:76: done (4 left) 2024-03-30T12:22:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:77: done (3 left) 2024-03-30T12:22:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:78: done (2 left) 2024-03-30T12:22:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:79: done (1 left) 2024-03-30T12:22:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:80: done (0 left) 2024-03-30T12:22:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:81: rollback oid 40 current snap is 2 2024-03-30T12:22:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 40 to 1 2024-03-30T12:22:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:82: snap_create 2024-03-30T12:22:20.074 INFO:tasks.rados.rados.0.smithi084.stdout:81: finishing rollback tid 0 to smithi08477944-40 2024-03-30T12:22:20.075 INFO:tasks.rados.rados.0.smithi084.stdout:81: finishing rollback tid 1 to smithi08477944-40 2024-03-30T12:22:20.075 INFO:tasks.rados.rados.0.smithi084.stdout:81: finishing rollback tid 2 to smithi08477944-40 2024-03-30T12:22:20.075 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 14 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-03-30T12:22:20.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:20 smithi162 ceph-mon[30421]: osdmap e76: 8 total, 8 up, 8 in 2024-03-30T12:22:20.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:20 smithi162 ceph-mon[30421]: pgmap v96: 121 pgs: 121 active+clean; 580 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:20.416 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:20 smithi084 ceph-mon[37565]: osdmap e76: 8 total, 8 up, 8 in 2024-03-30T12:22:20.416 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:20 smithi084 ceph-mon[37565]: pgmap v96: 121 pgs: 121 active+clean; 580 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:20.417 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:20 smithi084 ceph-mon[27000]: osdmap e76: 8 total, 8 up, 8 in 2024-03-30T12:22:20.417 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:20 smithi084 ceph-mon[27000]: pgmap v96: 121 pgs: 121 active+clean; 580 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:21.070 INFO:tasks.rados.rados.0.smithi084.stdout:81: done (1 left) 2024-03-30T12:22:21.070 INFO:tasks.rados.rados.0.smithi084.stdout:82: done (0 left) 2024-03-30T12:22:21.070 INFO:tasks.rados.rados.0.smithi084.stdout:83: rollback oid 9 current snap is 3 2024-03-30T12:22:21.070 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 9 to 0 2024-03-30T12:22:21.070 INFO:tasks.rados.rados.0.smithi084.stdout:84: read oid 20 snap 1 2024-03-30T12:22:21.070 INFO:tasks.rados.rados.0.smithi084.stdout:84: expect (ObjNum 19 snap 0 seq_num 19) 2024-03-30T12:22:21.070 INFO:tasks.rados.rados.0.smithi084.stdout:85: read oid 41 snap -1 2024-03-30T12:22:21.070 INFO:tasks.rados.rados.0.smithi084.stdout:85: expect (ObjNum 40 snap 0 seq_num 40) 2024-03-30T12:22:21.070 INFO:tasks.rados.rados.0.smithi084.stdout:86: read oid 5 snap -1 2024-03-30T12:22:21.070 INFO:tasks.rados.rados.0.smithi084.stdout:86: expect (ObjNum 4 snap 0 seq_num 4) 2024-03-30T12:22:21.070 INFO:tasks.rados.rados.0.smithi084.stdout:87: read oid 4 snap -1 2024-03-30T12:22:21.071 INFO:tasks.rados.rados.0.smithi084.stdout:87: expect (ObjNum 3 snap 0 seq_num 3) 2024-03-30T12:22:21.071 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 3 2024-03-30T12:22:21.071 INFO:tasks.rados.rados.0.smithi084.stdout:88: seq_num 54 ranges {40960=507904,548864=401408} 2024-03-30T12:22:21.072 INFO:tasks.rados.rados.0.smithi084.stdout:88: writing smithi08477944-3 from 40960 to 548864 tid 1 2024-03-30T12:22:21.075 INFO:tasks.rados.rados.0.smithi084.stdout:88: writing smithi08477944-3 from 548864 to 950272 tid 2 2024-03-30T12:22:21.076 INFO:tasks.rados.rados.0.smithi084.stdout:89: read oid 27 snap -1 2024-03-30T12:22:21.076 INFO:tasks.rados.rados.0.smithi084.stdout:89: expect (ObjNum 26 snap 0 seq_num 26) 2024-03-30T12:22:21.076 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 3 2024-03-30T12:22:21.076 INFO:tasks.rados.rados.0.smithi084.stdout:90: seq_num 55 ranges {270336=524288,794624=401408} 2024-03-30T12:22:21.081 INFO:tasks.rados.rados.0.smithi084.stdout:90: writing smithi08477944-17 from 270336 to 794624 tid 1 2024-03-30T12:22:21.084 INFO:tasks.rados.rados.0.smithi084.stdout:90: writing smithi08477944-17 from 794624 to 1196032 tid 2 2024-03-30T12:22:21.084 INFO:tasks.rados.rados.0.smithi084.stdout:91: rollback oid 36 current snap is 3 2024-03-30T12:22:21.084 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 36 to 2 2024-03-30T12:22:21.084 INFO:tasks.rados.rados.0.smithi084.stdout:86: expect (ObjNum 4 snap 0 seq_num 4) 2024-03-30T12:22:21.087 INFO:tasks.rados.rados.0.smithi084.stdout:84: expect (ObjNum 19 snap 0 seq_num 19) 2024-03-30T12:22:21.097 INFO:tasks.rados.rados.0.smithi084.stdout:85: expect (ObjNum 40 snap 0 seq_num 40) 2024-03-30T12:22:21.115 INFO:tasks.rados.rados.0.smithi084.stdout:87: expect (ObjNum 3 snap 0 seq_num 3) 2024-03-30T12:22:21.117 INFO:tasks.rados.rados.0.smithi084.stdout:83: finishing rollback tid 0 to smithi08477944-9 2024-03-30T12:22:21.117 INFO:tasks.rados.rados.0.smithi084.stdout:83: finishing rollback tid 1 to smithi08477944-9 2024-03-30T12:22:21.117 INFO:tasks.rados.rados.0.smithi084.stdout:84: done (8 left) 2024-03-30T12:22:21.118 INFO:tasks.rados.rados.0.smithi084.stdout:85: done (7 left) 2024-03-30T12:22:21.118 INFO:tasks.rados.rados.0.smithi084.stdout:86: done (6 left) 2024-03-30T12:22:21.118 INFO:tasks.rados.rados.0.smithi084.stdout:87: done (5 left) 2024-03-30T12:22:21.118 INFO:tasks.rados.rados.0.smithi084.stdout:92: rollback oid 10 current snap is 3 2024-03-30T12:22:21.118 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 10 to 0 2024-03-30T12:22:21.118 INFO:tasks.rados.rados.0.smithi084.stdout:83: finishing rollback tid 2 to smithi08477944-9 2024-03-30T12:22:21.118 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 6 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-03-30T12:22:21.118 INFO:tasks.rados.rados.0.smithi084.stdout:89: expect (ObjNum 26 snap 0 seq_num 26) 2024-03-30T12:22:21.131 INFO:tasks.rados.rados.0.smithi084.stdout:88: finishing write tid 1 to smithi08477944-3 2024-03-30T12:22:21.131 INFO:tasks.rados.rados.0.smithi084.stdout:88: finishing write tid 2 to smithi08477944-3 2024-03-30T12:22:21.131 INFO:tasks.rados.rados.0.smithi084.stdout:88: finishing write tid 3 to smithi08477944-3 2024-03-30T12:22:21.131 INFO:tasks.rados.rados.0.smithi084.stdout:88: finishing write tid 4 to smithi08477944-3 2024-03-30T12:22:21.131 INFO:tasks.rados.rados.0.smithi084.stdout:88: oid 3 updating version 0 to 18 2024-03-30T12:22:21.131 INFO:tasks.rados.rados.0.smithi084.stdout:88: oid 3 updating version 18 to 19 2024-03-30T12:22:21.131 INFO:tasks.rados.rados.0.smithi084.stdout:88: oid 3 updating version 19 to 20 2024-03-30T12:22:21.131 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 20 (ObjNum 54 snap 3 seq_num 54) dirty exists 2024-03-30T12:22:21.131 INFO:tasks.rados.rados.0.smithi084.stdout:88: left oid 3 (ObjNum 54 snap 3 seq_num 54) 2024-03-30T12:22:21.131 INFO:tasks.rados.rados.0.smithi084.stdout:91: finishing rollback tid 0 to smithi08477944-36 2024-03-30T12:22:21.131 INFO:tasks.rados.rados.0.smithi084.stdout:91: finishing rollback tid 1 to smithi08477944-36 2024-03-30T12:22:21.131 INFO:tasks.rados.rados.0.smithi084.stdout:83: done (5 left) 2024-03-30T12:22:21.131 INFO:tasks.rados.rados.0.smithi084.stdout:88: done (4 left) 2024-03-30T12:22:21.132 INFO:tasks.rados.rados.0.smithi084.stdout:89: done (3 left) 2024-03-30T12:22:21.132 INFO:tasks.rados.rados.0.smithi084.stdout:93: snap_create 2024-03-30T12:22:21.132 INFO:tasks.rados.rados.0.smithi084.stdout:91: finishing rollback tid 2 to smithi08477944-36 2024-03-30T12:22:21.132 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 17 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-03-30T12:22:21.132 INFO:tasks.rados.rados.0.smithi084.stdout:90: finishing write tid 1 to smithi08477944-17 2024-03-30T12:22:21.132 INFO:tasks.rados.rados.0.smithi084.stdout:90: finishing write tid 2 to smithi08477944-17 2024-03-30T12:22:21.132 INFO:tasks.rados.rados.0.smithi084.stdout:90: finishing write tid 3 to smithi08477944-17 2024-03-30T12:22:21.132 INFO:tasks.rados.rados.0.smithi084.stdout:90: finishing write tid 4 to smithi08477944-17 2024-03-30T12:22:21.132 INFO:tasks.rados.rados.0.smithi084.stdout:90: oid 17 updating version 0 to 16 2024-03-30T12:22:21.132 INFO:tasks.rados.rados.0.smithi084.stdout:90: oid 17 updating version 16 to 18 2024-03-30T12:22:21.132 INFO:tasks.rados.rados.0.smithi084.stdout:90: oid 17 version 18 is already newer than 17 2024-03-30T12:22:21.132 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 18 (ObjNum 55 snap 3 seq_num 55) dirty exists 2024-03-30T12:22:21.133 INFO:tasks.rados.rados.0.smithi084.stdout:90: left oid 17 (ObjNum 55 snap 3 seq_num 55) 2024-03-30T12:22:21.133 INFO:tasks.rados.rados.0.smithi084.stdout:92: finishing rollback tid 0 to smithi08477944-10 2024-03-30T12:22:21.133 INFO:tasks.rados.rados.0.smithi084.stdout:92: finishing rollback tid 1 to smithi08477944-10 2024-03-30T12:22:21.133 INFO:tasks.rados.rados.0.smithi084.stdout:92: finishing rollback tid 2 to smithi08477944-10 2024-03-30T12:22:21.133 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 14 (ObjNum 9 snap 0 seq_num 9) dirty exists 2024-03-30T12:22:21.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:21 smithi162 ceph-mon[30421]: osdmap e77: 8 total, 8 up, 8 in 2024-03-30T12:22:21.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:21 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:22:21.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:21 smithi084 ceph-mon[27000]: osdmap e77: 8 total, 8 up, 8 in 2024-03-30T12:22:21.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:21 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:22:21.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:21 smithi084 ceph-mon[37565]: osdmap e77: 8 total, 8 up, 8 in 2024-03-30T12:22:21.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:21 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:22:22.080 INFO:tasks.rados.rados.0.smithi084.stdout:90: done (3 left) 2024-03-30T12:22:22.081 INFO:tasks.rados.rados.0.smithi084.stdout:91: done (2 left) 2024-03-30T12:22:22.081 INFO:tasks.rados.rados.0.smithi084.stdout:92: done (1 left) 2024-03-30T12:22:22.081 INFO:tasks.rados.rados.0.smithi084.stdout:93: done (0 left) 2024-03-30T12:22:22.081 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 27 current snap is 4 2024-03-30T12:22:22.081 INFO:tasks.rados.rados.0.smithi084.stdout:94: seq_num 56 ranges {442368=540672,983040=401408} 2024-03-30T12:22:22.086 INFO:tasks.rados.rados.0.smithi084.stdout:94: writing smithi08477944-27 from 442368 to 983040 tid 1 2024-03-30T12:22:22.088 INFO:tasks.rados.rados.0.smithi084.stdout:94: writing smithi08477944-27 from 983040 to 1384448 tid 2 2024-03-30T12:22:22.088 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 4 2024-03-30T12:22:22.088 INFO:tasks.rados.rados.0.smithi084.stdout:95: seq_num 57 ranges {540672=557056,1097728=401408} 2024-03-30T12:22:22.095 INFO:tasks.rados.rados.0.smithi084.stdout:95: writing smithi08477944-39 from 540672 to 1097728 tid 1 2024-03-30T12:22:22.099 INFO:tasks.rados.rados.0.smithi084.stdout:95: writing smithi08477944-39 from 1097728 to 1499136 tid 2 2024-03-30T12:22:22.099 INFO:tasks.rados.rados.0.smithi084.stdout:94: finishing write tid 1 to smithi08477944-27 2024-03-30T12:22:22.099 INFO:tasks.rados.rados.0.smithi084.stdout:94: finishing write tid 2 to smithi08477944-27 2024-03-30T12:22:22.099 INFO:tasks.rados.rados.0.smithi084.stdout:94: finishing write tid 3 to smithi08477944-27 2024-03-30T12:22:22.099 INFO:tasks.rados.rados.0.smithi084.stdout:94: finishing write tid 4 to smithi08477944-27 2024-03-30T12:22:22.099 INFO:tasks.rados.rados.0.smithi084.stdout:94: oid 27 updating version 0 to 8 2024-03-30T12:22:22.099 INFO:tasks.rados.rados.0.smithi084.stdout:94: oid 27 updating version 8 to 9 2024-03-30T12:22:22.099 INFO:tasks.rados.rados.0.smithi084.stdout:94: oid 27 updating version 9 to 10 2024-03-30T12:22:22.099 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 10 (ObjNum 56 snap 4 seq_num 56) dirty exists 2024-03-30T12:22:22.099 INFO:tasks.rados.rados.0.smithi084.stdout:94: left oid 27 (ObjNum 56 snap 4 seq_num 56) 2024-03-30T12:22:22.100 INFO:tasks.rados.rados.0.smithi084.stdout:95: finishing write tid 1 to smithi08477944-39 2024-03-30T12:22:22.100 INFO:tasks.rados.rados.0.smithi084.stdout:94: done (1 left) 2024-03-30T12:22:22.100 INFO:tasks.rados.rados.0.smithi084.stdout:96: read oid 13 snap -1 2024-03-30T12:22:22.100 INFO:tasks.rados.rados.0.smithi084.stdout:96: expect (ObjNum 12 snap 0 seq_num 12) 2024-03-30T12:22:22.100 INFO:tasks.rados.rados.0.smithi084.stdout:97: rollback oid 41 current snap is 4 2024-03-30T12:22:22.100 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 41 to 3 2024-03-30T12:22:22.100 INFO:tasks.rados.rados.0.smithi084.stdout:98: snap_remove snap 0 2024-03-30T12:22:22.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:22 smithi162 ceph-mon[30421]: osdmap e78: 8 total, 8 up, 8 in 2024-03-30T12:22:22.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:22 smithi162 ceph-mon[30421]: pgmap v99: 121 pgs: 121 active+clean; 26 MiB data, 281 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 6.6 MiB/s wr, 84 op/s 2024-03-30T12:22:22.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:22 smithi084 ceph-mon[37565]: osdmap e78: 8 total, 8 up, 8 in 2024-03-30T12:22:22.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:22 smithi084 ceph-mon[37565]: pgmap v99: 121 pgs: 121 active+clean; 26 MiB data, 281 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 6.6 MiB/s wr, 84 op/s 2024-03-30T12:22:22.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:22 smithi084 ceph-mon[27000]: osdmap e78: 8 total, 8 up, 8 in 2024-03-30T12:22:22.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:22 smithi084 ceph-mon[27000]: pgmap v99: 121 pgs: 121 active+clean; 26 MiB data, 281 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 6.6 MiB/s wr, 84 op/s 2024-03-30T12:22:23.083 INFO:tasks.rados.rados.0.smithi084.stdout:98: done (3 left) 2024-03-30T12:22:23.083 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 4 2024-03-30T12:22:23.083 INFO:tasks.rados.rados.0.smithi084.stdout:99: seq_num 58 ranges {73728=573440,647168=401408} 2024-03-30T12:22:23.087 INFO:tasks.rados.rados.0.smithi084.stdout:99: writing smithi08477944-5 from 73728 to 647168 tid 1 2024-03-30T12:22:23.090 INFO:tasks.rados.rados.0.smithi084.stdout:99: writing smithi08477944-5 from 647168 to 1048576 tid 2 2024-03-30T12:22:23.090 INFO:tasks.rados.rados.0.smithi084.stdout:100: read oid 10 snap -1 2024-03-30T12:22:23.090 INFO:tasks.rados.rados.0.smithi084.stdout:100: expect (ObjNum 9 snap 0 seq_num 9) 2024-03-30T12:22:23.090 INFO:tasks.rados.rados.0.smithi084.stdout:101: snap_create 2024-03-30T12:22:23.094 INFO:tasks.rados.rados.0.smithi084.stdout:95: finishing write tid 2 to smithi08477944-39 2024-03-30T12:22:23.094 INFO:tasks.rados.rados.0.smithi084.stdout:95: finishing write tid 3 to smithi08477944-39 2024-03-30T12:22:23.094 INFO:tasks.rados.rados.0.smithi084.stdout:95: finishing write tid 4 to smithi08477944-39 2024-03-30T12:22:23.094 INFO:tasks.rados.rados.0.smithi084.stdout:95: oid 39 updating version 0 to 20 2024-03-30T12:22:23.094 INFO:tasks.rados.rados.0.smithi084.stdout:95: oid 39 updating version 20 to 21 2024-03-30T12:22:23.094 INFO:tasks.rados.rados.0.smithi084.stdout:95: oid 39 updating version 21 to 22 2024-03-30T12:22:23.094 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 22 (ObjNum 57 snap 4 seq_num 57) dirty exists 2024-03-30T12:22:23.094 INFO:tasks.rados.rados.0.smithi084.stdout:95: left oid 39 (ObjNum 57 snap 4 seq_num 57) 2024-03-30T12:22:23.094 INFO:tasks.rados.rados.0.smithi084.stdout:97: finishing rollback tid 0 to smithi08477944-41 2024-03-30T12:22:23.094 INFO:tasks.rados.rados.0.smithi084.stdout:97: finishing rollback tid 1 to smithi08477944-41 2024-03-30T12:22:23.094 INFO:tasks.rados.rados.0.smithi084.stdout:97: finishing rollback tid 2 to smithi08477944-41 2024-03-30T12:22:23.094 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 15 (ObjNum 40 snap 0 seq_num 40) dirty exists 2024-03-30T12:22:23.094 INFO:tasks.rados.rados.0.smithi084.stdout:96: expect (ObjNum 12 snap 0 seq_num 12) 2024-03-30T12:22:23.099 INFO:tasks.rados.rados.0.smithi084.stdout:99: finishing write tid 1 to smithi08477944-5 2024-03-30T12:22:23.099 INFO:tasks.rados.rados.0.smithi084.stdout:99: finishing write tid 2 to smithi08477944-5 2024-03-30T12:22:23.099 INFO:tasks.rados.rados.0.smithi084.stdout:99: finishing write tid 3 to smithi08477944-5 2024-03-30T12:22:23.099 INFO:tasks.rados.rados.0.smithi084.stdout:99: finishing write tid 4 to smithi08477944-5 2024-03-30T12:22:23.100 INFO:tasks.rados.rados.0.smithi084.stdout:99: oid 5 updating version 0 to 13 2024-03-30T12:22:23.100 INFO:tasks.rados.rados.0.smithi084.stdout:99: oid 5 version 13 is already newer than 12 2024-03-30T12:22:23.100 INFO:tasks.rados.rados.0.smithi084.stdout:99: oid 5 version 13 is already newer than 11 2024-03-30T12:22:23.100 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 13 (ObjNum 58 snap 4 seq_num 58) dirty exists 2024-03-30T12:22:23.100 INFO:tasks.rados.rados.0.smithi084.stdout:99: left oid 5 (ObjNum 58 snap 4 seq_num 58) 2024-03-30T12:22:23.100 INFO:tasks.rados.rados.0.smithi084.stdout:100: expect (ObjNum 9 snap 0 seq_num 9) 2024-03-30T12:22:23.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:23 smithi162 ceph-mon[30421]: osdmap e79: 8 total, 8 up, 8 in 2024-03-30T12:22:23.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:23 smithi084 ceph-mon[37565]: osdmap e79: 8 total, 8 up, 8 in 2024-03-30T12:22:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:23 smithi084 ceph-mon[27000]: osdmap e79: 8 total, 8 up, 8 in 2024-03-30T12:22:24.089 INFO:tasks.rados.rados.0.smithi084.stdout:95: done (5 left) 2024-03-30T12:22:24.089 INFO:tasks.rados.rados.0.smithi084.stdout:96: done (4 left) 2024-03-30T12:22:24.089 INFO:tasks.rados.rados.0.smithi084.stdout:97: done (3 left) 2024-03-30T12:22:24.089 INFO:tasks.rados.rados.0.smithi084.stdout:99: done (2 left) 2024-03-30T12:22:24.089 INFO:tasks.rados.rados.0.smithi084.stdout:100: done (1 left) 2024-03-30T12:22:24.089 INFO:tasks.rados.rados.0.smithi084.stdout:101: done (0 left) 2024-03-30T12:22:24.090 INFO:tasks.rados.rados.0.smithi084.stdout:102: snap_remove snap 1 2024-03-30T12:22:24.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:24 smithi162 ceph-mon[30421]: osdmap e80: 8 total, 8 up, 8 in 2024-03-30T12:22:24.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:24 smithi162 ceph-mon[30421]: pgmap v102: 121 pgs: 121 active+clean; 26 MiB data, 281 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 6.6 MiB/s wr, 84 op/s 2024-03-30T12:22:24.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:24 smithi084 ceph-mon[37565]: osdmap e80: 8 total, 8 up, 8 in 2024-03-30T12:22:24.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:24 smithi084 ceph-mon[37565]: pgmap v102: 121 pgs: 121 active+clean; 26 MiB data, 281 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 6.6 MiB/s wr, 84 op/s 2024-03-30T12:22:24.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:24 smithi084 ceph-mon[27000]: osdmap e80: 8 total, 8 up, 8 in 2024-03-30T12:22:24.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:24 smithi084 ceph-mon[27000]: pgmap v102: 121 pgs: 121 active+clean; 26 MiB data, 281 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 6.6 MiB/s wr, 84 op/s 2024-03-30T12:22:25.097 INFO:tasks.rados.rados.0.smithi084.stdout:102: done (0 left) 2024-03-30T12:22:25.097 INFO:tasks.rados.rados.0.smithi084.stdout:103: read oid 29 snap 4 2024-03-30T12:22:25.098 INFO:tasks.rados.rados.0.smithi084.stdout:103: expect (ObjNum 46 snap 0 seq_num 46) 2024-03-30T12:22:25.098 INFO:tasks.rados.rados.0.smithi084.stdout:104: read oid 46 snap -1 2024-03-30T12:22:25.098 INFO:tasks.rados.rados.0.smithi084.stdout:104: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-30T12:22:25.098 INFO:tasks.rados.rados.0.smithi084.stdout:105: read oid 14 snap 4 2024-03-30T12:22:25.098 INFO:tasks.rados.rados.0.smithi084.stdout:105: expect (ObjNum 40 snap 0 seq_num 40) 2024-03-30T12:22:25.098 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 5 2024-03-30T12:22:25.098 INFO:tasks.rados.rados.0.smithi084.stdout:106: seq_num 59 ranges {811008=598016,1409024=401408} 2024-03-30T12:22:25.107 INFO:tasks.rados.rados.0.smithi084.stdout:106: writing smithi08477944-49 from 811008 to 1409024 tid 1 2024-03-30T12:22:25.110 INFO:tasks.rados.rados.0.smithi084.stdout:106: writing smithi08477944-49 from 1409024 to 1810432 tid 2 2024-03-30T12:22:25.111 INFO:tasks.rados.rados.0.smithi084.stdout:105: expect (ObjNum 40 snap 0 seq_num 40) 2024-03-30T12:22:25.132 INFO:tasks.rados.rados.0.smithi084.stdout:104: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-30T12:22:25.154 INFO:tasks.rados.rados.0.smithi084.stdout:104: done (3 left) 2024-03-30T12:22:25.155 INFO:tasks.rados.rados.0.smithi084.stdout:105: done (2 left) 2024-03-30T12:22:25.155 INFO:tasks.rados.rados.0.smithi084.stdout:107: delete oid 34 current snap is 5 2024-03-30T12:22:25.155 INFO:tasks.rados.rados.0.smithi084.stdout:106: finishing write tid 1 to smithi08477944-49 2024-03-30T12:22:25.155 INFO:tasks.rados.rados.0.smithi084.stdout:103: expect (ObjNum 46 snap 0 seq_num 46) 2024-03-30T12:22:25.175 INFO:tasks.rados.rados.0.smithi084.stdout:106: finishing write tid 2 to smithi08477944-49 2024-03-30T12:22:25.176 INFO:tasks.rados.rados.0.smithi084.stdout:106: finishing write tid 3 to smithi08477944-49 2024-03-30T12:22:25.176 INFO:tasks.rados.rados.0.smithi084.stdout:106: finishing write tid 4 to smithi08477944-49 2024-03-30T12:22:25.176 INFO:tasks.rados.rados.0.smithi084.stdout:106: oid 49 updating version 0 to 26 2024-03-30T12:22:25.176 INFO:tasks.rados.rados.0.smithi084.stdout:106: oid 49 version 26 is already newer than 25 2024-03-30T12:22:25.176 INFO:tasks.rados.rados.0.smithi084.stdout:106: oid 49 updating version 26 to 27 2024-03-30T12:22:25.176 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 27 (ObjNum 59 snap 5 seq_num 59) dirty exists 2024-03-30T12:22:25.176 INFO:tasks.rados.rados.0.smithi084.stdout:106: left oid 49 (ObjNum 59 snap 5 seq_num 59) 2024-03-30T12:22:25.176 INFO:tasks.rados.rados.0.smithi084.stdout:103: done (2 left) 2024-03-30T12:22:25.176 INFO:tasks.rados.rados.0.smithi084.stdout:106: done (1 left) 2024-03-30T12:22:25.176 INFO:tasks.rados.rados.0.smithi084.stdout:107: done (0 left) 2024-03-30T12:22:25.176 INFO:tasks.rados.rados.0.smithi084.stdout:108: read oid 43 snap -1 2024-03-30T12:22:25.176 INFO:tasks.rados.rados.0.smithi084.stdout:108: expect (ObjNum 42 snap 0 seq_num 42) 2024-03-30T12:22:25.176 INFO:tasks.rados.rados.0.smithi084.stdout:109: rollback oid 38 current snap is 5 2024-03-30T12:22:25.177 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 38 to 4 2024-03-30T12:22:25.177 INFO:tasks.rados.rados.0.smithi084.stdout:110: delete oid 12 current snap is 5 2024-03-30T12:22:25.177 INFO:tasks.rados.rados.0.smithi084.stdout:110: done (2 left) 2024-03-30T12:22:25.177 INFO:tasks.rados.rados.0.smithi084.stdout:111: read oid 17 snap 3 2024-03-30T12:22:25.177 INFO:tasks.rados.rados.0.smithi084.stdout:111: expect (ObjNum 55 snap 3 seq_num 55) 2024-03-30T12:22:25.178 INFO:tasks.rados.rados.0.smithi084.stdout:112: rollback oid 40 current snap is 5 2024-03-30T12:22:25.178 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 40 to 4 2024-03-30T12:22:25.178 INFO:tasks.rados.rados.0.smithi084.stdout:113: delete oid 8 current snap is 5 2024-03-30T12:22:25.178 INFO:tasks.rados.rados.0.smithi084.stdout:109: finishing rollback tid 0 to smithi08477944-38 2024-03-30T12:22:25.178 INFO:tasks.rados.rados.0.smithi084.stdout:109: finishing rollback tid 1 to smithi08477944-38 2024-03-30T12:22:25.178 INFO:tasks.rados.rados.0.smithi084.stdout:109: finishing rollback tid 2 to smithi08477944-38 2024-03-30T12:22:25.178 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 18 (ObjNum 37 snap 0 seq_num 37) dirty exists 2024-03-30T12:22:25.180 INFO:tasks.rados.rados.0.smithi084.stdout:109: done (4 left) 2024-03-30T12:22:25.180 INFO:tasks.rados.rados.0.smithi084.stdout:113: done (3 left) 2024-03-30T12:22:25.180 INFO:tasks.rados.rados.0.smithi084.stdout:114: setattr oid 46 current snap is 5 2024-03-30T12:22:25.181 INFO:tasks.rados.rados.0.smithi084.stdout:112: finishing rollback tid 0 to smithi08477944-40 2024-03-30T12:22:25.181 INFO:tasks.rados.rados.0.smithi084.stdout:112: finishing rollback tid 1 to smithi08477944-40 2024-03-30T12:22:25.182 INFO:tasks.rados.rados.0.smithi084.stdout:115: snap_create 2024-03-30T12:22:25.182 INFO:tasks.rados.rados.0.smithi084.stdout:112: finishing rollback tid 2 to smithi08477944-40 2024-03-30T12:22:25.182 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 22 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-03-30T12:22:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:108: expect (ObjNum 42 snap 0 seq_num 42) 2024-03-30T12:22:25.202 INFO:tasks.rados.rados.0.smithi084.stdout:111: expect (ObjNum 55 snap 3 seq_num 55) 2024-03-30T12:22:25.239 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 30 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-03-30T12:22:25.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:25 smithi162 ceph-mon[30421]: osdmap e81: 8 total, 8 up, 8 in 2024-03-30T12:22:25.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:25 smithi084 ceph-mon[37565]: osdmap e81: 8 total, 8 up, 8 in 2024-03-30T12:22:25.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:25 smithi084 ceph-mon[27000]: osdmap e81: 8 total, 8 up, 8 in 2024-03-30T12:22:26.108 INFO:tasks.rados.rados.0.smithi084.stdout:108: done (4 left) 2024-03-30T12:22:26.109 INFO:tasks.rados.rados.0.smithi084.stdout:111: done (3 left) 2024-03-30T12:22:26.109 INFO:tasks.rados.rados.0.smithi084.stdout:112: done (2 left) 2024-03-30T12:22:26.109 INFO:tasks.rados.rados.0.smithi084.stdout:114: done (1 left) 2024-03-30T12:22:26.109 INFO:tasks.rados.rados.0.smithi084.stdout:115: done (0 left) 2024-03-30T12:22:26.109 INFO:tasks.rados.rados.0.smithi084.stdout:116: copy_from oid 25 from oid 6 current snap is 6 2024-03-30T12:22:26.109 INFO:tasks.rados.rados.0.smithi084.stdout:117: setattr oid 23 current snap is 6 2024-03-30T12:22:26.110 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 6 2024-03-30T12:22:26.110 INFO:tasks.rados.rados.0.smithi084.stdout:118: seq_num 63 ranges {172032=663552,835584=401408} 2024-03-30T12:22:26.115 INFO:tasks.rados.rados.0.smithi084.stdout:118: writing smithi08477944-15 from 172032 to 835584 tid 1 2024-03-30T12:22:26.118 INFO:tasks.rados.rados.0.smithi084.stdout:118: writing smithi08477944-15 from 835584 to 1236992 tid 2 2024-03-30T12:22:26.118 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 6 2024-03-30T12:22:26.118 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 29 (ObjNum 53 snap 1 seq_num 53) dirty exists 2024-03-30T12:22:26.118 INFO:tasks.rados.rados.0.smithi084.stdout:119: seq_num 64 ranges {319488=679936,999424=401408} 2024-03-30T12:22:26.123 INFO:tasks.rados.rados.0.smithi084.stdout:119: writing smithi08477944-20 from 319488 to 999424 tid 1 2024-03-30T12:22:26.127 INFO:tasks.rados.rados.0.smithi084.stdout:119: writing smithi08477944-20 from 999424 to 1400832 tid 2 2024-03-30T12:22:26.127 INFO:tasks.rados.rados.0.smithi084.stdout:117: done (3 left) 2024-03-30T12:22:26.127 INFO:tasks.rados.rados.0.smithi084.stdout:120: rollback oid 14 current snap is 6 2024-03-30T12:22:26.127 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 14 to 2 2024-03-30T12:22:26.127 INFO:tasks.rados.rados.0.smithi084.stdout:116: finishing copy_from to smithi08477944-25 2024-03-30T12:22:26.127 INFO:tasks.rados.rados.0.smithi084.stdout:116: got expected ENOENT (src dne) 2024-03-30T12:22:26.127 INFO:tasks.rados.rados.0.smithi084.stdout:116: finishing copy_from racing read to smithi08477944-25 2024-03-30T12:22:26.127 INFO:tasks.rados.rados.0.smithi084.stdout:118: finishing write tid 1 to smithi08477944-15 2024-03-30T12:22:26.127 INFO:tasks.rados.rados.0.smithi084.stdout:118: finishing write tid 2 to smithi08477944-15 2024-03-30T12:22:26.128 INFO:tasks.rados.rados.0.smithi084.stdout:118: finishing write tid 3 to smithi08477944-15 2024-03-30T12:22:26.128 INFO:tasks.rados.rados.0.smithi084.stdout:118: finishing write tid 4 to smithi08477944-15 2024-03-30T12:22:26.128 INFO:tasks.rados.rados.0.smithi084.stdout:118: oid 15 updating version 0 to 38 2024-03-30T12:22:26.128 INFO:tasks.rados.rados.0.smithi084.stdout:118: oid 15 version 38 is already newer than 37 2024-03-30T12:22:26.128 INFO:tasks.rados.rados.0.smithi084.stdout:118: oid 15 version 38 is already newer than 36 2024-03-30T12:22:26.128 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 38 (ObjNum 63 snap 6 seq_num 63) dirty exists 2024-03-30T12:22:26.128 INFO:tasks.rados.rados.0.smithi084.stdout:118: left oid 15 (ObjNum 63 snap 6 seq_num 63) 2024-03-30T12:22:26.128 INFO:tasks.rados.rados.0.smithi084.stdout:116: done (3 left) 2024-03-30T12:22:26.128 INFO:tasks.rados.rados.0.smithi084.stdout:118: done (2 left) 2024-03-30T12:22:26.128 INFO:tasks.rados.rados.0.smithi084.stdout:121: read oid 27 snap -1 2024-03-30T12:22:26.128 INFO:tasks.rados.rados.0.smithi084.stdout:121: expect (ObjNum 56 snap 4 seq_num 56) 2024-03-30T12:22:26.128 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 6 2024-03-30T12:22:26.129 INFO:tasks.rados.rados.0.smithi084.stdout:122: seq_num 65 ranges {344064=696320,1040384=401408} 2024-03-30T12:22:26.132 INFO:tasks.rados.rados.0.smithi084.stdout:122: writing smithi08477944-21 from 344064 to 1040384 tid 1 2024-03-30T12:22:26.136 INFO:tasks.rados.rados.0.smithi084.stdout:122: writing smithi08477944-21 from 1040384 to 1441792 tid 2 2024-03-30T12:22:26.136 INFO:tasks.rados.rados.0.smithi084.stdout:123: snap_create 2024-03-30T12:22:26.136 INFO:tasks.rados.rados.0.smithi084.stdout:119: finishing write tid 1 to smithi08477944-20 2024-03-30T12:22:26.136 INFO:tasks.rados.rados.0.smithi084.stdout:119: finishing write tid 2 to smithi08477944-20 2024-03-30T12:22:26.136 INFO:tasks.rados.rados.0.smithi084.stdout:119: finishing write tid 3 to smithi08477944-20 2024-03-30T12:22:26.136 INFO:tasks.rados.rados.0.smithi084.stdout:120: finishing rollback tid 0 to smithi08477944-14 2024-03-30T12:22:26.136 INFO:tasks.rados.rados.0.smithi084.stdout:119: finishing write tid 4 to smithi08477944-20 2024-03-30T12:22:26.136 INFO:tasks.rados.rados.0.smithi084.stdout:119: oid 20 updating version 0 to 25 2024-03-30T12:22:26.136 INFO:tasks.rados.rados.0.smithi084.stdout:119: oid 20 version 25 is already newer than 24 2024-03-30T12:22:26.136 INFO:tasks.rados.rados.0.smithi084.stdout:119: oid 20 updating version 25 to 26 2024-03-30T12:22:26.136 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 26 (ObjNum 64 snap 6 seq_num 64) dirty exists 2024-03-30T12:22:26.137 INFO:tasks.rados.rados.0.smithi084.stdout:119: left oid 20 (ObjNum 64 snap 6 seq_num 64) 2024-03-30T12:22:26.137 INFO:tasks.rados.rados.0.smithi084.stdout:120: finishing rollback tid 1 to smithi08477944-14 2024-03-30T12:22:26.137 INFO:tasks.rados.rados.0.smithi084.stdout:120: finishing rollback tid 2 to smithi08477944-14 2024-03-30T12:22:26.137 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 26 (ObjNum 40 snap 0 seq_num 40) dirty exists 2024-03-30T12:22:26.137 INFO:tasks.rados.rados.0.smithi084.stdout:121: expect (ObjNum 56 snap 4 seq_num 56) 2024-03-30T12:22:26.185 INFO:tasks.rados.rados.0.smithi084.stdout:122: finishing write tid 1 to smithi08477944-21 2024-03-30T12:22:26.185 INFO:tasks.rados.rados.0.smithi084.stdout:122: finishing write tid 2 to smithi08477944-21 2024-03-30T12:22:26.185 INFO:tasks.rados.rados.0.smithi084.stdout:122: finishing write tid 3 to smithi08477944-21 2024-03-30T12:22:26.185 INFO:tasks.rados.rados.0.smithi084.stdout:122: finishing write tid 4 to smithi08477944-21 2024-03-30T12:22:26.185 INFO:tasks.rados.rados.0.smithi084.stdout:122: oid 21 updating version 0 to 6 2024-03-30T12:22:26.185 INFO:tasks.rados.rados.0.smithi084.stdout:122: oid 21 version 6 is already newer than 4 2024-03-30T12:22:26.185 INFO:tasks.rados.rados.0.smithi084.stdout:122: oid 21 version 6 is already newer than 5 2024-03-30T12:22:26.185 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 6 (ObjNum 65 snap 6 seq_num 65) dirty exists 2024-03-30T12:22:26.185 INFO:tasks.rados.rados.0.smithi084.stdout:122: left oid 21 (ObjNum 65 snap 6 seq_num 65) 2024-03-30T12:22:26.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:26 smithi162 ceph-mon[30421]: osdmap e82: 8 total, 8 up, 8 in 2024-03-30T12:22:26.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:26 smithi162 ceph-mon[30421]: pgmap v105: 121 pgs: 121 active+clean; 26 MiB data, 281 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:26.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:26 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:22:26.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:26 smithi084 ceph-mon[27000]: osdmap e82: 8 total, 8 up, 8 in 2024-03-30T12:22:26.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:26 smithi084 ceph-mon[27000]: pgmap v105: 121 pgs: 121 active+clean; 26 MiB data, 281 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:26.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:26 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:22:26.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:26 smithi084 ceph-mon[37565]: osdmap e82: 8 total, 8 up, 8 in 2024-03-30T12:22:26.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:26 smithi084 ceph-mon[37565]: pgmap v105: 121 pgs: 121 active+clean; 26 MiB data, 281 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:26.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:26 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:22:27.113 INFO:tasks.rados.rados.0.smithi084.stdout:119: done (4 left) 2024-03-30T12:22:27.113 INFO:tasks.rados.rados.0.smithi084.stdout:120: done (3 left) 2024-03-30T12:22:27.114 INFO:tasks.rados.rados.0.smithi084.stdout:121: done (2 left) 2024-03-30T12:22:27.114 INFO:tasks.rados.rados.0.smithi084.stdout:122: done (1 left) 2024-03-30T12:22:27.114 INFO:tasks.rados.rados.0.smithi084.stdout:123: done (0 left) 2024-03-30T12:22:27.114 INFO:tasks.rados.rados.0.smithi084.stdout:124: read oid 48 snap 4 2024-03-30T12:22:27.114 INFO:tasks.rados.rados.0.smithi084.stdout:124: expect (ObjNum 47 snap 0 seq_num 47) 2024-03-30T12:22:27.114 INFO:tasks.rados.rados.0.smithi084.stdout:125: read oid 49 snap 5 2024-03-30T12:22:27.114 INFO:tasks.rados.rados.0.smithi084.stdout:125: expect (ObjNum 59 snap 5 seq_num 59) 2024-03-30T12:22:27.114 INFO:tasks.rados.rados.0.smithi084.stdout:126: delete oid 44 current snap is 7 2024-03-30T12:22:27.118 INFO:tasks.rados.rados.0.smithi084.stdout:126: done (2 left) 2024-03-30T12:22:27.118 INFO:tasks.rados.rados.0.smithi084.stdout:127: rollback oid 23 current snap is 7 2024-03-30T12:22:27.118 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 23 to 3 2024-03-30T12:22:27.118 INFO:tasks.rados.rados.0.smithi084.stdout:128: read oid 30 snap -1 2024-03-30T12:22:27.118 INFO:tasks.rados.rados.0.smithi084.stdout:128: expect (ObjNum 29 snap 0 seq_num 29) 2024-03-30T12:22:27.118 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 7 2024-03-30T12:22:27.118 INFO:tasks.rados.rados.0.smithi084.stdout:129: seq_num 67 ranges {622592=729088,1351680=401408} 2024-03-30T12:22:27.126 INFO:tasks.rados.rados.0.smithi084.stdout:129: writing smithi08477944-38 from 622592 to 1351680 tid 1 2024-03-30T12:22:27.128 INFO:tasks.rados.rados.0.smithi084.stdout:129: writing smithi08477944-38 from 1351680 to 1753088 tid 2 2024-03-30T12:22:27.129 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 7 2024-03-30T12:22:27.129 INFO:tasks.rados.rados.0.smithi084.stdout:124: expect (ObjNum 47 snap 0 seq_num 47) 2024-03-30T12:22:27.151 INFO:tasks.rados.rados.0.smithi084.stdout:130: seq_num 68 ranges {573440=745472,1318912=401408} 2024-03-30T12:22:27.158 INFO:tasks.rados.rados.0.smithi084.stdout:130: writing smithi08477944-35 from 573440 to 1318912 tid 1 2024-03-30T12:22:27.161 INFO:tasks.rados.rados.0.smithi084.stdout:130: writing smithi08477944-35 from 1318912 to 1720320 tid 2 2024-03-30T12:22:27.161 INFO:tasks.rados.rados.0.smithi084.stdout:128: expect (ObjNum 29 snap 0 seq_num 29) 2024-03-30T12:22:27.177 INFO:tasks.rados.rados.0.smithi084.stdout:125: expect (ObjNum 59 snap 5 seq_num 59) 2024-03-30T12:22:27.240 INFO:tasks.rados.rados.0.smithi084.stdout:127: finishing rollback tid 0 to smithi08477944-23 2024-03-30T12:22:27.240 INFO:tasks.rados.rados.0.smithi084.stdout:127: finishing rollback tid 1 to smithi08477944-23 2024-03-30T12:22:27.241 INFO:tasks.rados.rados.0.smithi084.stdout:127: finishing rollback tid 2 to smithi08477944-23 2024-03-30T12:22:27.241 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 33 (ObjNum 53 snap 1 seq_num 53) dirty exists 2024-03-30T12:22:27.241 INFO:tasks.rados.rados.0.smithi084.stdout:129: finishing write tid 1 to smithi08477944-38 2024-03-30T12:22:27.241 INFO:tasks.rados.rados.0.smithi084.stdout:129: finishing write tid 2 to smithi08477944-38 2024-03-30T12:22:27.241 INFO:tasks.rados.rados.0.smithi084.stdout:129: finishing write tid 3 to smithi08477944-38 2024-03-30T12:22:27.241 INFO:tasks.rados.rados.0.smithi084.stdout:129: finishing write tid 4 to smithi08477944-38 2024-03-30T12:22:27.241 INFO:tasks.rados.rados.0.smithi084.stdout:129: oid 38 updating version 0 to 21 2024-03-30T12:22:27.241 INFO:tasks.rados.rados.0.smithi084.stdout:129: oid 38 updating version 21 to 22 2024-03-30T12:22:27.241 INFO:tasks.rados.rados.0.smithi084.stdout:129: oid 38 version 22 is already newer than 20 2024-03-30T12:22:27.241 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 22 (ObjNum 67 snap 7 seq_num 67) dirty exists 2024-03-30T12:22:27.242 INFO:tasks.rados.rados.0.smithi084.stdout:129: left oid 38 (ObjNum 67 snap 7 seq_num 67) 2024-03-30T12:22:27.242 INFO:tasks.rados.rados.0.smithi084.stdout:124: done (5 left) 2024-03-30T12:22:27.242 INFO:tasks.rados.rados.0.smithi084.stdout:125: done (4 left) 2024-03-30T12:22:27.242 INFO:tasks.rados.rados.0.smithi084.stdout:127: done (3 left) 2024-03-30T12:22:27.242 INFO:tasks.rados.rados.0.smithi084.stdout:128: done (2 left) 2024-03-30T12:22:27.242 INFO:tasks.rados.rados.0.smithi084.stdout:129: done (1 left) 2024-03-30T12:22:27.242 INFO:tasks.rados.rados.0.smithi084.stdout:131: copy_from oid 23 from oid 46 current snap is 7 2024-03-30T12:22:27.242 INFO:tasks.rados.rados.0.smithi084.stdout:130: finishing write tid 1 to smithi08477944-35 2024-03-30T12:22:27.242 INFO:tasks.rados.rados.0.smithi084.stdout:130: finishing write tid 2 to smithi08477944-35 2024-03-30T12:22:27.242 INFO:tasks.rados.rados.0.smithi084.stdout:130: finishing write tid 3 to smithi08477944-35 2024-03-30T12:22:27.242 INFO:tasks.rados.rados.0.smithi084.stdout:130: finishing write tid 4 to smithi08477944-35 2024-03-30T12:22:27.242 INFO:tasks.rados.rados.0.smithi084.stdout:130: oid 35 updating version 0 to 8 2024-03-30T12:22:27.242 INFO:tasks.rados.rados.0.smithi084.stdout:130: oid 35 version 8 is already newer than 7 2024-03-30T12:22:27.242 INFO:tasks.rados.rados.0.smithi084.stdout:130: oid 35 updating version 8 to 9 2024-03-30T12:22:27.243 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 9 (ObjNum 68 snap 7 seq_num 68) dirty exists 2024-03-30T12:22:27.243 INFO:tasks.rados.rados.0.smithi084.stdout:130: left oid 35 (ObjNum 68 snap 7 seq_num 68) 2024-03-30T12:22:27.243 INFO:tasks.rados.rados.0.smithi084.stdout:130: done (1 left) 2024-03-30T12:22:27.243 INFO:tasks.rados.rados.0.smithi084.stdout:132: copy_from oid 13 from oid 12 current snap is 7 2024-03-30T12:22:27.243 INFO:tasks.rados.rados.0.smithi084.stdout:133: snap_create 2024-03-30T12:22:27.243 INFO:tasks.rados.rados.0.smithi084.stdout:132: finishing copy_from to smithi08477944-13 2024-03-30T12:22:27.244 INFO:tasks.rados.rados.0.smithi084.stdout:132: got expected ENOENT (src dne) 2024-03-30T12:22:27.244 INFO:tasks.rados.rados.0.smithi084.stdout:132: finishing copy_from racing read to smithi08477944-13 2024-03-30T12:22:27.246 INFO:tasks.rados.rados.0.smithi084.stdout:131: finishing copy_from racing read to smithi08477944-23 2024-03-30T12:22:27.248 INFO:tasks.rados.rados.0.smithi084.stdout:131: finishing copy_from to smithi08477944-23 2024-03-30T12:22:27.248 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 30 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-03-30T12:22:27.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:27 smithi162 ceph-mon[30421]: osdmap e83: 8 total, 8 up, 8 in 2024-03-30T12:22:27.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:27 smithi084 ceph-mon[37565]: osdmap e83: 8 total, 8 up, 8 in 2024-03-30T12:22:27.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:27 smithi084 ceph-mon[27000]: osdmap e83: 8 total, 8 up, 8 in 2024-03-30T12:22:28.124 INFO:tasks.rados.rados.0.smithi084.stdout:131: done (2 left) 2024-03-30T12:22:28.124 INFO:tasks.rados.rados.0.smithi084.stdout:132: done (1 left) 2024-03-30T12:22:28.125 INFO:tasks.rados.rados.0.smithi084.stdout:133: done (0 left) 2024-03-30T12:22:28.125 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 8 2024-03-30T12:22:28.125 INFO:tasks.rados.rados.0.smithi084.stdout:134: seq_num 69 ranges {139264=761856,901120=401408} 2024-03-30T12:22:28.129 INFO:tasks.rados.rados.0.smithi084.stdout:134: writing smithi08477944-9 from 139264 to 901120 tid 1 2024-03-30T12:22:28.132 INFO:tasks.rados.rados.0.smithi084.stdout:134: writing smithi08477944-9 from 901120 to 1302528 tid 2 2024-03-30T12:22:28.132 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 8 2024-03-30T12:22:28.132 INFO:tasks.rados.rados.0.smithi084.stdout:135: seq_num 70 ranges {0=778240,778240=401408} 2024-03-30T12:22:28.137 INFO:tasks.rados.rados.0.smithi084.stdout:135: writing smithi08477944-12 from 0 to 778240 tid 1 2024-03-30T12:22:28.140 INFO:tasks.rados.rados.0.smithi084.stdout:135: writing smithi08477944-12 from 778240 to 1179648 tid 2 2024-03-30T12:22:28.140 INFO:tasks.rados.rados.0.smithi084.stdout:136: rollback oid 22 current snap is 8 2024-03-30T12:22:28.140 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 22 to 2 2024-03-30T12:22:28.140 INFO:tasks.rados.rados.0.smithi084.stdout:134: finishing write tid 1 to smithi08477944-9 2024-03-30T12:22:28.140 INFO:tasks.rados.rados.0.smithi084.stdout:134: finishing write tid 2 to smithi08477944-9 2024-03-30T12:22:28.140 INFO:tasks.rados.rados.0.smithi084.stdout:134: finishing write tid 3 to smithi08477944-9 2024-03-30T12:22:28.140 INFO:tasks.rados.rados.0.smithi084.stdout:134: finishing write tid 4 to smithi08477944-9 2024-03-30T12:22:28.140 INFO:tasks.rados.rados.0.smithi084.stdout:134: oid 9 updating version 0 to 12 2024-03-30T12:22:28.141 INFO:tasks.rados.rados.0.smithi084.stdout:134: oid 9 updating version 12 to 14 2024-03-30T12:22:28.141 INFO:tasks.rados.rados.0.smithi084.stdout:134: oid 9 version 14 is already newer than 13 2024-03-30T12:22:28.141 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 14 (ObjNum 69 snap 8 seq_num 69) dirty exists 2024-03-30T12:22:28.141 INFO:tasks.rados.rados.0.smithi084.stdout:134: left oid 9 (ObjNum 69 snap 8 seq_num 69) 2024-03-30T12:22:28.141 INFO:tasks.rados.rados.0.smithi084.stdout:134: done (2 left) 2024-03-30T12:22:28.141 INFO:tasks.rados.rados.0.smithi084.stdout:137: snap_create 2024-03-30T12:22:28.142 INFO:tasks.rados.rados.0.smithi084.stdout:136: finishing rollback tid 0 to smithi08477944-22 2024-03-30T12:22:28.143 INFO:tasks.rados.rados.0.smithi084.stdout:136: finishing rollback tid 1 to smithi08477944-22 2024-03-30T12:22:28.143 INFO:tasks.rados.rados.0.smithi084.stdout:136: finishing rollback tid 2 to smithi08477944-22 2024-03-30T12:22:28.143 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 34 (ObjNum 47 snap 0 seq_num 47) dirty exists 2024-03-30T12:22:28.145 INFO:tasks.rados.rados.0.smithi084.stdout:135: finishing write tid 1 to smithi08477944-12 2024-03-30T12:22:28.145 INFO:tasks.rados.rados.0.smithi084.stdout:135: finishing write tid 2 to smithi08477944-12 2024-03-30T12:22:28.145 INFO:tasks.rados.rados.0.smithi084.stdout:135: finishing write tid 3 to smithi08477944-12 2024-03-30T12:22:28.146 INFO:tasks.rados.rados.0.smithi084.stdout:135: finishing write tid 4 to smithi08477944-12 2024-03-30T12:22:28.147 INFO:tasks.rados.rados.0.smithi084.stdout:135: oid 12 updating version 0 to 21 2024-03-30T12:22:28.147 INFO:tasks.rados.rados.0.smithi084.stdout:135: oid 12 version 21 is already newer than 20 2024-03-30T12:22:28.147 INFO:tasks.rados.rados.0.smithi084.stdout:135: oid 12 version 21 is already newer than 19 2024-03-30T12:22:28.147 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 21 (ObjNum 70 snap 8 seq_num 70) dirty exists 2024-03-30T12:22:28.147 INFO:tasks.rados.rados.0.smithi084.stdout:135: left oid 12 (ObjNum 70 snap 8 seq_num 70) 2024-03-30T12:22:28.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:28 smithi162 ceph-mon[30421]: osdmap e84: 8 total, 8 up, 8 in 2024-03-30T12:22:28.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:28 smithi162 ceph-mon[30421]: pgmap v108: 121 pgs: 121 active+clean; 31 MiB data, 288 MiB used, 715 GiB / 715 GiB avail; 4.2 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2024-03-30T12:22:28.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:28 smithi084 ceph-mon[27000]: osdmap e84: 8 total, 8 up, 8 in 2024-03-30T12:22:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:28 smithi084 ceph-mon[27000]: pgmap v108: 121 pgs: 121 active+clean; 31 MiB data, 288 MiB used, 715 GiB / 715 GiB avail; 4.2 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2024-03-30T12:22:28.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:28 smithi084 ceph-mon[37565]: osdmap e84: 8 total, 8 up, 8 in 2024-03-30T12:22:28.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:28 smithi084 ceph-mon[37565]: pgmap v108: 121 pgs: 121 active+clean; 31 MiB data, 288 MiB used, 715 GiB / 715 GiB avail; 4.2 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2024-03-30T12:22:29.124 INFO:tasks.rados.rados.0.smithi084.stdout:135: done (2 left) 2024-03-30T12:22:29.124 INFO:tasks.rados.rados.0.smithi084.stdout:136: done (1 left) 2024-03-30T12:22:29.124 INFO:tasks.rados.rados.0.smithi084.stdout:137: done (0 left) 2024-03-30T12:22:29.124 INFO:tasks.rados.rados.0.smithi084.stdout:138: read oid 33 snap -1 2024-03-30T12:22:29.124 INFO:tasks.rados.rados.0.smithi084.stdout:138: expect (ObjNum 32 snap 0 seq_num 32) 2024-03-30T12:22:29.124 INFO:tasks.rados.rados.0.smithi084.stdout:139: read oid 45 snap -1 2024-03-30T12:22:29.124 INFO:tasks.rados.rados.0.smithi084.stdout:139: expect (ObjNum 44 snap 0 seq_num 44) 2024-03-30T12:22:29.124 INFO:tasks.rados.rados.0.smithi084.stdout:140: snap_create 2024-03-30T12:22:29.127 INFO:tasks.rados.rados.0.smithi084.stdout:139: expect (ObjNum 44 snap 0 seq_num 44) 2024-03-30T12:22:29.149 INFO:tasks.rados.rados.0.smithi084.stdout:138: expect (ObjNum 32 snap 0 seq_num 32) 2024-03-30T12:22:29.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:29 smithi162 ceph-mon[30421]: osdmap e85: 8 total, 8 up, 8 in 2024-03-30T12:22:29.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:29 smithi084 ceph-mon[37565]: osdmap e85: 8 total, 8 up, 8 in 2024-03-30T12:22:29.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:29 smithi084 ceph-mon[27000]: osdmap e85: 8 total, 8 up, 8 in 2024-03-30T12:22:29.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:22:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:22:29] "GET /metrics HTTP/1.1" 200 35944 "" "Prometheus/2.43.0" 2024-03-30T12:22:30.020 INFO:tasks.rados.rados.0.smithi084.stdout:138: done (2 left) 2024-03-30T12:22:30.021 INFO:tasks.rados.rados.0.smithi084.stdout:139: done (1 left) 2024-03-30T12:22:30.021 INFO:tasks.rados.rados.0.smithi084.stdout:140: done (0 left) 2024-03-30T12:22:30.021 INFO:tasks.rados.rados.0.smithi084.stdout:141: copy_from oid 48 from oid 42 current snap is 10 2024-03-30T12:22:30.021 INFO:tasks.rados.rados.0.smithi084.stdout:142: delete oid 29 current snap is 10 2024-03-30T12:22:30.025 INFO:tasks.rados.rados.0.smithi084.stdout:142: done (1 left) 2024-03-30T12:22:30.026 INFO:tasks.rados.rados.0.smithi084.stdout:143: snap_create 2024-03-30T12:22:30.029 INFO:tasks.rados.rados.0.smithi084.stdout:141: finishing copy_from racing read to smithi08477944-48 2024-03-30T12:22:30.029 INFO:tasks.rados.rados.0.smithi084.stdout:141: finishing copy_from to smithi08477944-48 2024-03-30T12:22:30.030 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 2 (ObjNum 11 snap 0 seq_num 11) dirty exists 2024-03-30T12:22:30.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:30 smithi084 ceph-mon[37565]: osdmap e86: 8 total, 8 up, 8 in 2024-03-30T12:22:30.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:30 smithi084 ceph-mon[37565]: pgmap v111: 121 pgs: 121 active+clean; 31 MiB data, 288 MiB used, 715 GiB / 715 GiB avail; 4.2 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2024-03-30T12:22:30.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:30 smithi084 ceph-mon[37565]: osdmap e87: 8 total, 8 up, 8 in 2024-03-30T12:22:30.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:30 smithi084 ceph-mon[27000]: osdmap e86: 8 total, 8 up, 8 in 2024-03-30T12:22:30.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:30 smithi084 ceph-mon[27000]: pgmap v111: 121 pgs: 121 active+clean; 31 MiB data, 288 MiB used, 715 GiB / 715 GiB avail; 4.2 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2024-03-30T12:22:30.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:30 smithi084 ceph-mon[27000]: osdmap e87: 8 total, 8 up, 8 in 2024-03-30T12:22:30.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:30 smithi162 ceph-mon[30421]: osdmap e86: 8 total, 8 up, 8 in 2024-03-30T12:22:30.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:30 smithi162 ceph-mon[30421]: pgmap v111: 121 pgs: 121 active+clean; 31 MiB data, 288 MiB used, 715 GiB / 715 GiB avail; 4.2 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2024-03-30T12:22:30.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:30 smithi162 ceph-mon[30421]: osdmap e87: 8 total, 8 up, 8 in 2024-03-30T12:22:31.025 INFO:tasks.rados.rados.0.smithi084.stdout:141: done (1 left) 2024-03-30T12:22:31.026 INFO:tasks.rados.rados.0.smithi084.stdout:143: done (0 left) 2024-03-30T12:22:31.026 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 11 2024-03-30T12:22:31.026 INFO:tasks.rados.rados.0.smithi084.stdout:144: seq_num 72 ranges {712704=409600,1122304=524288,1646592=278528} 2024-03-30T12:22:31.031 INFO:tasks.rados.rados.0.smithi084.stdout:144: writing smithi08477944-43 from 712704 to 1122304 tid 1 2024-03-30T12:22:31.034 INFO:tasks.rados.rados.0.smithi084.stdout:144: writing smithi08477944-43 from 1122304 to 1646592 tid 2 2024-03-30T12:22:31.036 INFO:tasks.rados.rados.0.smithi084.stdout:144: writing smithi08477944-43 from 1646592 to 1925120 tid 3 2024-03-30T12:22:31.036 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 11 2024-03-30T12:22:31.036 INFO:tasks.rados.rados.0.smithi084.stdout:145: seq_num 73 ranges {155648=425984,581632=409600,991232=393216} 2024-03-30T12:22:31.039 INFO:tasks.rados.rados.0.smithi084.stdout:145: writing smithi08477944-10 from 155648 to 581632 tid 1 2024-03-30T12:22:31.041 INFO:tasks.rados.rados.0.smithi084.stdout:145: writing smithi08477944-10 from 581632 to 991232 tid 2 2024-03-30T12:22:31.044 INFO:tasks.rados.rados.0.smithi084.stdout:145: writing smithi08477944-10 from 991232 to 1384448 tid 3 2024-03-30T12:22:31.044 INFO:tasks.rados.rados.0.smithi084.stdout:146: snap_create 2024-03-30T12:22:31.044 INFO:tasks.rados.rados.0.smithi084.stdout:144: finishing write tid 1 to smithi08477944-43 2024-03-30T12:22:31.044 INFO:tasks.rados.rados.0.smithi084.stdout:144: finishing write tid 2 to smithi08477944-43 2024-03-30T12:22:31.045 INFO:tasks.rados.rados.0.smithi084.stdout:144: finishing write tid 3 to smithi08477944-43 2024-03-30T12:22:31.045 INFO:tasks.rados.rados.0.smithi084.stdout:144: finishing write tid 4 to smithi08477944-43 2024-03-30T12:22:31.045 INFO:tasks.rados.rados.0.smithi084.stdout:144: finishing write tid 5 to smithi08477944-43 2024-03-30T12:22:31.045 INFO:tasks.rados.rados.0.smithi084.stdout:144: oid 43 updating version 0 to 20 2024-03-30T12:22:31.045 INFO:tasks.rados.rados.0.smithi084.stdout:144: oid 43 version 20 is already newer than 19 2024-03-30T12:22:31.045 INFO:tasks.rados.rados.0.smithi084.stdout:144: oid 43 updating version 20 to 22 2024-03-30T12:22:31.045 INFO:tasks.rados.rados.0.smithi084.stdout:144: oid 43 version 22 is already newer than 21 2024-03-30T12:22:31.045 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 22 (ObjNum 72 snap 11 seq_num 72) dirty exists 2024-03-30T12:22:31.045 INFO:tasks.rados.rados.0.smithi084.stdout:144: left oid 43 (ObjNum 72 snap 11 seq_num 72) 2024-03-30T12:22:31.046 INFO:tasks.rados.rados.0.smithi084.stdout:145: finishing write tid 1 to smithi08477944-10 2024-03-30T12:22:31.047 INFO:tasks.rados.rados.0.smithi084.stdout:145: finishing write tid 2 to smithi08477944-10 2024-03-30T12:22:31.047 INFO:tasks.rados.rados.0.smithi084.stdout:145: finishing write tid 3 to smithi08477944-10 2024-03-30T12:22:31.047 INFO:tasks.rados.rados.0.smithi084.stdout:145: finishing write tid 4 to smithi08477944-10 2024-03-30T12:22:31.048 INFO:tasks.rados.rados.0.smithi084.stdout:145: finishing write tid 5 to smithi08477944-10 2024-03-30T12:22:31.048 INFO:tasks.rados.rados.0.smithi084.stdout:145: oid 10 updating version 0 to 30 2024-03-30T12:22:31.048 INFO:tasks.rados.rados.0.smithi084.stdout:145: oid 10 version 30 is already newer than 29 2024-03-30T12:22:31.048 INFO:tasks.rados.rados.0.smithi084.stdout:145: oid 10 version 30 is already newer than 28 2024-03-30T12:22:31.048 INFO:tasks.rados.rados.0.smithi084.stdout:145: oid 10 updating version 30 to 31 2024-03-30T12:22:31.048 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 31 (ObjNum 73 snap 11 seq_num 73) dirty exists 2024-03-30T12:22:31.048 INFO:tasks.rados.rados.0.smithi084.stdout:145: left oid 10 (ObjNum 73 snap 11 seq_num 73) 2024-03-30T12:22:32.028 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:32 smithi084 ceph-mon[37565]: osdmap e88: 8 total, 8 up, 8 in 2024-03-30T12:22:32.029 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:32 smithi084 ceph-mon[37565]: pgmap v114: 121 pgs: 121 active+clean; 38 MiB data, 301 MiB used, 715 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2024-03-30T12:22:32.029 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:32 smithi084 ceph-mon[27000]: osdmap e88: 8 total, 8 up, 8 in 2024-03-30T12:22:32.029 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:32 smithi084 ceph-mon[27000]: pgmap v114: 121 pgs: 121 active+clean; 38 MiB data, 301 MiB used, 715 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2024-03-30T12:22:32.031 INFO:tasks.rados.rados.0.smithi084.stdout:144: done (2 left) 2024-03-30T12:22:32.032 INFO:tasks.rados.rados.0.smithi084.stdout:145: done (1 left) 2024-03-30T12:22:32.032 INFO:tasks.rados.rados.0.smithi084.stdout:146: done (0 left) 2024-03-30T12:22:32.032 INFO:tasks.rados.rados.0.smithi084.stdout:147: snap_create 2024-03-30T12:22:32.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:32 smithi162 ceph-mon[30421]: osdmap e88: 8 total, 8 up, 8 in 2024-03-30T12:22:32.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:32 smithi162 ceph-mon[30421]: pgmap v114: 121 pgs: 121 active+clean; 38 MiB data, 301 MiB used, 715 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2024-03-30T12:22:33.033 INFO:tasks.rados.rados.0.smithi084.stdout:147: done (0 left) 2024-03-30T12:22:33.033 INFO:tasks.rados.rados.0.smithi084.stdout:148: read oid 42 snap -1 2024-03-30T12:22:33.034 INFO:tasks.rados.rados.0.smithi084.stdout:148: expect (ObjNum 11 snap 0 seq_num 11) 2024-03-30T12:22:33.034 INFO:tasks.rados.rados.0.smithi084.stdout:149: rmattr oid 17 current snap is 13 2024-03-30T12:22:33.034 INFO:tasks.rados.rados.0.smithi084.stdout:149: done (1 left) 2024-03-30T12:22:33.034 INFO:tasks.rados.rados.0.smithi084.stdout:150: setattr oid 28 current snap is 13 2024-03-30T12:22:33.036 INFO:tasks.rados.rados.0.smithi084.stdout:151: copy_from oid 33 from oid 16 current snap is 13 2024-03-30T12:22:33.036 INFO:tasks.rados.rados.0.smithi084.stdout:152: setattr oid 32 current snap is 13 2024-03-30T12:22:33.037 INFO:tasks.rados.rados.0.smithi084.stdout:148: expect (ObjNum 11 snap 0 seq_num 11) 2024-03-30T12:22:33.045 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 13 (ObjNum 27 snap 0 seq_num 27) dirty exists 2024-03-30T12:22:33.045 INFO:tasks.rados.rados.0.smithi084.stdout:151: finishing copy_from racing read to smithi08477944-33 2024-03-30T12:22:33.045 INFO:tasks.rados.rados.0.smithi084.stdout:151: finishing copy_from to smithi08477944-33 2024-03-30T12:22:33.045 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 2 (ObjNum 15 snap 0 seq_num 15) dirty exists 2024-03-30T12:22:33.045 INFO:tasks.rados.rados.0.smithi084.stdout:148: done (3 left) 2024-03-30T12:22:33.045 INFO:tasks.rados.rados.0.smithi084.stdout:150: done (2 left) 2024-03-30T12:22:33.045 INFO:tasks.rados.rados.0.smithi084.stdout:151: done (1 left) 2024-03-30T12:22:33.045 INFO:tasks.rados.rados.0.smithi084.stdout:153: snap_remove snap 5 2024-03-30T12:22:33.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:33 smithi162 ceph-mon[30421]: osdmap e89: 8 total, 8 up, 8 in 2024-03-30T12:22:33.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:33 smithi084 ceph-mon[27000]: osdmap e89: 8 total, 8 up, 8 in 2024-03-30T12:22:33.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:33 smithi084 ceph-mon[37565]: osdmap e89: 8 total, 8 up, 8 in 2024-03-30T12:22:34.042 INFO:tasks.rados.rados.0.smithi084.stdout:153: done (1 left) 2024-03-30T12:22:34.042 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 13 2024-03-30T12:22:34.042 INFO:tasks.rados.rados.0.smithi084.stdout:154: seq_num 74 ranges {745472=442368,1187840=696320,1884160=106496} 2024-03-30T12:22:34.049 INFO:tasks.rados.rados.0.smithi084.stdout:154: writing smithi08477944-45 from 745472 to 1187840 tid 1 2024-03-30T12:22:34.053 INFO:tasks.rados.rados.0.smithi084.stdout:154: writing smithi08477944-45 from 1187840 to 1884160 tid 2 2024-03-30T12:22:34.054 INFO:tasks.rados.rados.0.smithi084.stdout:154: writing smithi08477944-45 from 1884160 to 1990656 tid 3 2024-03-30T12:22:34.054 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 42 current snap is 13 2024-03-30T12:22:34.054 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 36 (ObjNum 31 snap 0 seq_num 31) dirty exists 2024-03-30T12:22:34.054 INFO:tasks.rados.rados.0.smithi084.stdout:155: seq_num 75 ranges {188416=458752,647168=581632,1228800=221184} 2024-03-30T12:22:34.058 INFO:tasks.rados.rados.0.smithi084.stdout:155: writing smithi08477944-42 from 188416 to 647168 tid 1 2024-03-30T12:22:34.061 INFO:tasks.rados.rados.0.smithi084.stdout:155: writing smithi08477944-42 from 647168 to 1228800 tid 2 2024-03-30T12:22:34.063 INFO:tasks.rados.rados.0.smithi084.stdout:155: writing smithi08477944-42 from 1228800 to 1449984 tid 3 2024-03-30T12:22:34.063 INFO:tasks.rados.rados.0.smithi084.stdout:152: done (2 left) 2024-03-30T12:22:34.063 INFO:tasks.rados.rados.0.smithi084.stdout:156: snap_remove snap 11 2024-03-30T12:22:34.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:34 smithi162 ceph-mon[30421]: osdmap e90: 8 total, 8 up, 8 in 2024-03-30T12:22:34.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:34 smithi162 ceph-mon[30421]: pgmap v117: 121 pgs: 121 active+clean; 38 MiB data, 301 MiB used, 715 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2024-03-30T12:22:34.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:34 smithi084 ceph-mon[37565]: osdmap e90: 8 total, 8 up, 8 in 2024-03-30T12:22:34.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:34 smithi084 ceph-mon[37565]: pgmap v117: 121 pgs: 121 active+clean; 38 MiB data, 301 MiB used, 715 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2024-03-30T12:22:34.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:34 smithi084 ceph-mon[27000]: osdmap e90: 8 total, 8 up, 8 in 2024-03-30T12:22:34.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:34 smithi084 ceph-mon[27000]: pgmap v117: 121 pgs: 121 active+clean; 38 MiB data, 301 MiB used, 715 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2024-03-30T12:22:35.045 INFO:tasks.rados.rados.0.smithi084.stdout:156: done (2 left) 2024-03-30T12:22:35.045 INFO:tasks.rados.rados.0.smithi084.stdout:157: delete oid 22 current snap is 13 2024-03-30T12:22:35.045 INFO:tasks.rados.rados.0.smithi084.stdout:154: finishing write tid 1 to smithi08477944-45 2024-03-30T12:22:35.045 INFO:tasks.rados.rados.0.smithi084.stdout:154: finishing write tid 2 to smithi08477944-45 2024-03-30T12:22:35.045 INFO:tasks.rados.rados.0.smithi084.stdout:154: finishing write tid 3 to smithi08477944-45 2024-03-30T12:22:35.045 INFO:tasks.rados.rados.0.smithi084.stdout:154: finishing write tid 4 to smithi08477944-45 2024-03-30T12:22:35.045 INFO:tasks.rados.rados.0.smithi084.stdout:154: finishing write tid 5 to smithi08477944-45 2024-03-30T12:22:35.045 INFO:tasks.rados.rados.0.smithi084.stdout:154: oid 45 updating version 0 to 23 2024-03-30T12:22:35.046 INFO:tasks.rados.rados.0.smithi084.stdout:154: oid 45 updating version 23 to 24 2024-03-30T12:22:35.046 INFO:tasks.rados.rados.0.smithi084.stdout:154: oid 45 version 24 is already newer than 22 2024-03-30T12:22:35.046 INFO:tasks.rados.rados.0.smithi084.stdout:154: oid 45 version 24 is already newer than 21 2024-03-30T12:22:35.046 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 24 (ObjNum 74 snap 13 seq_num 74) dirty exists 2024-03-30T12:22:35.046 INFO:tasks.rados.rados.0.smithi084.stdout:154: left oid 45 (ObjNum 74 snap 13 seq_num 74) 2024-03-30T12:22:35.046 INFO:tasks.rados.rados.0.smithi084.stdout:155: finishing write tid 1 to smithi08477944-42 2024-03-30T12:22:35.046 INFO:tasks.rados.rados.0.smithi084.stdout:155: finishing write tid 2 to smithi08477944-42 2024-03-30T12:22:35.046 INFO:tasks.rados.rados.0.smithi084.stdout:155: finishing write tid 3 to smithi08477944-42 2024-03-30T12:22:35.046 INFO:tasks.rados.rados.0.smithi084.stdout:155: finishing write tid 4 to smithi08477944-42 2024-03-30T12:22:35.046 INFO:tasks.rados.rados.0.smithi084.stdout:155: finishing write tid 5 to smithi08477944-42 2024-03-30T12:22:35.046 INFO:tasks.rados.rados.0.smithi084.stdout:155: oid 42 updating version 0 to 43 2024-03-30T12:22:35.046 INFO:tasks.rados.rados.0.smithi084.stdout:155: oid 42 version 43 is already newer than 42 2024-03-30T12:22:35.046 INFO:tasks.rados.rados.0.smithi084.stdout:155: oid 42 updating version 43 to 44 2024-03-30T12:22:35.046 INFO:tasks.rados.rados.0.smithi084.stdout:155: oid 42 updating version 44 to 45 2024-03-30T12:22:35.046 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 45 (ObjNum 75 snap 13 seq_num 75) dirty exists 2024-03-30T12:22:35.047 INFO:tasks.rados.rados.0.smithi084.stdout:155: left oid 42 (ObjNum 75 snap 13 seq_num 75) 2024-03-30T12:22:35.050 INFO:tasks.rados.rados.0.smithi084.stdout:154: done (2 left) 2024-03-30T12:22:35.050 INFO:tasks.rados.rados.0.smithi084.stdout:155: done (1 left) 2024-03-30T12:22:35.050 INFO:tasks.rados.rados.0.smithi084.stdout:157: done (0 left) 2024-03-30T12:22:35.050 INFO:tasks.rados.rados.0.smithi084.stdout:158: snap_create 2024-03-30T12:22:35.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:35 smithi084 ceph-mon[37565]: osdmap e91: 8 total, 8 up, 8 in 2024-03-30T12:22:35.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:35 smithi084 ceph-mon[27000]: osdmap e91: 8 total, 8 up, 8 in 2024-03-30T12:22:35.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:35 smithi162 ceph-mon[30421]: osdmap e91: 8 total, 8 up, 8 in 2024-03-30T12:22:36.051 INFO:tasks.rados.rados.0.smithi084.stdout:158: done (0 left) 2024-03-30T12:22:36.052 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 31 current snap is 14 2024-03-30T12:22:36.052 INFO:tasks.rados.rados.0.smithi084.stdout:159: seq_num 77 ranges {507904=491520,999424=794624,1794048=8192} 2024-03-30T12:22:36.056 INFO:tasks.rados.rados.0.smithi084.stdout:159: writing smithi08477944-31 from 507904 to 999424 tid 1 2024-03-30T12:22:36.062 INFO:tasks.rados.rados.0.smithi084.stdout:159: writing smithi08477944-31 from 999424 to 1794048 tid 2 2024-03-30T12:22:36.062 INFO:tasks.rados.rados.0.smithi084.stdout:159: writing smithi08477944-31 from 1794048 to 1802240 tid 3 2024-03-30T12:22:36.062 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 14 2024-03-30T12:22:36.062 INFO:tasks.rados.rados.0.smithi084.stdout:160: seq_num 78 ranges {253952=516096,770048=679936,1449984=122880} 2024-03-30T12:22:36.066 INFO:tasks.rados.rados.0.smithi084.stdout:160: writing smithi08477944-16 from 253952 to 770048 tid 1 2024-03-30T12:22:36.070 INFO:tasks.rados.rados.0.smithi084.stdout:160: writing smithi08477944-16 from 770048 to 1449984 tid 2 2024-03-30T12:22:36.072 INFO:tasks.rados.rados.0.smithi084.stdout:160: writing smithi08477944-16 from 1449984 to 1572864 tid 3 2024-03-30T12:22:36.072 INFO:tasks.rados.rados.0.smithi084.stdout:161: copy_from oid 10 from oid 39 current snap is 14 2024-03-30T12:22:36.072 INFO:tasks.rados.rados.0.smithi084.stdout:159: finishing write tid 1 to smithi08477944-31 2024-03-30T12:22:36.072 INFO:tasks.rados.rados.0.smithi084.stdout:159: finishing write tid 2 to smithi08477944-31 2024-03-30T12:22:36.072 INFO:tasks.rados.rados.0.smithi084.stdout:159: finishing write tid 3 to smithi08477944-31 2024-03-30T12:22:36.072 INFO:tasks.rados.rados.0.smithi084.stdout:159: finishing write tid 4 to smithi08477944-31 2024-03-30T12:22:36.072 INFO:tasks.rados.rados.0.smithi084.stdout:159: finishing write tid 5 to smithi08477944-31 2024-03-30T12:22:36.072 INFO:tasks.rados.rados.0.smithi084.stdout:159: oid 31 updating version 0 to 24 2024-03-30T12:22:36.072 INFO:tasks.rados.rados.0.smithi084.stdout:159: oid 31 version 24 is already newer than 21 2024-03-30T12:22:36.072 INFO:tasks.rados.rados.0.smithi084.stdout:159: oid 31 version 24 is already newer than 23 2024-03-30T12:22:36.072 INFO:tasks.rados.rados.0.smithi084.stdout:159: oid 31 version 24 is already newer than 22 2024-03-30T12:22:36.072 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 24 (ObjNum 77 snap 14 seq_num 77) dirty exists 2024-03-30T12:22:36.072 INFO:tasks.rados.rados.0.smithi084.stdout:159: left oid 31 (ObjNum 77 snap 14 seq_num 77) 2024-03-30T12:22:36.073 INFO:tasks.rados.rados.0.smithi084.stdout:160: finishing write tid 1 to smithi08477944-16 2024-03-30T12:22:36.073 INFO:tasks.rados.rados.0.smithi084.stdout:159: done (2 left) 2024-03-30T12:22:36.073 INFO:tasks.rados.rados.0.smithi084.stdout:162: read oid 25 snap 4 2024-03-30T12:22:36.073 INFO:tasks.rados.rados.0.smithi084.stdout:162: expect (ObjNum 50 snap 0 seq_num 50) 2024-03-30T12:22:36.073 INFO:tasks.rados.rados.0.smithi084.stdout:163: copy_from oid 21 from oid 35 current snap is 14 2024-03-30T12:22:36.073 INFO:tasks.rados.rados.0.smithi084.stdout:164: snap_remove snap 13 2024-03-30T12:22:36.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:36 smithi162 ceph-mon[30421]: osdmap e92: 8 total, 8 up, 8 in 2024-03-30T12:22:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:36 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:22:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:36 smithi162 ceph-mon[30421]: Upgrade: Target is version 19.0.0-1864-g5dc2ea30 (unknown) 2024-03-30T12:22:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:36 smithi162 ceph-mon[30421]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, digests ['quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8'] 2024-03-30T12:22:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:36 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:22:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:36 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:22:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:36 smithi162 ceph-mon[30421]: Upgrade: Need to upgrade myself (mgr.y) 2024-03-30T12:22:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:36 smithi162 ceph-mon[30421]: pgmap v120: 121 pgs: 121 active+clean; 38 MiB data, 301 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:36.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:36 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:22:36.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:36 smithi084 ceph-mon[27000]: osdmap e92: 8 total, 8 up, 8 in 2024-03-30T12:22:36.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:36 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:22:36.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:36 smithi084 ceph-mon[27000]: Upgrade: Target is version 19.0.0-1864-g5dc2ea30 (unknown) 2024-03-30T12:22:36.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:36 smithi084 ceph-mon[27000]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, digests ['quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8'] 2024-03-30T12:22:36.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:36 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:22:36.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:36 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:22:36.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:36 smithi084 ceph-mon[27000]: Upgrade: Need to upgrade myself (mgr.y) 2024-03-30T12:22:36.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:36 smithi084 ceph-mon[27000]: pgmap v120: 121 pgs: 121 active+clean; 38 MiB data, 301 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:36.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:36 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:22:36.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:36 smithi084 ceph-mon[37565]: osdmap e92: 8 total, 8 up, 8 in 2024-03-30T12:22:36.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:36 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:22:36.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:36 smithi084 ceph-mon[37565]: Upgrade: Target is version 19.0.0-1864-g5dc2ea30 (unknown) 2024-03-30T12:22:36.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:36 smithi084 ceph-mon[37565]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, digests ['quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8'] 2024-03-30T12:22:36.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:36 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:22:36.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:36 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:22:36.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:36 smithi084 ceph-mon[37565]: Upgrade: Need to upgrade myself (mgr.y) 2024-03-30T12:22:36.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:36 smithi084 ceph-mon[37565]: pgmap v120: 121 pgs: 121 active+clean; 38 MiB data, 301 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:36.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:36 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:22:37.058 INFO:tasks.rados.rados.0.smithi084.stdout:160: finishing write tid 2 to smithi08477944-16 2024-03-30T12:22:37.058 INFO:tasks.rados.rados.0.smithi084.stdout:160: finishing write tid 3 to smithi08477944-16 2024-03-30T12:22:37.058 INFO:tasks.rados.rados.0.smithi084.stdout:160: finishing write tid 4 to smithi08477944-16 2024-03-30T12:22:37.058 INFO:tasks.rados.rados.0.smithi084.stdout:160: finishing write tid 5 to smithi08477944-16 2024-03-30T12:22:37.059 INFO:tasks.rados.rados.0.smithi084.stdout:160: oid 16 updating version 0 to 28 2024-03-30T12:22:37.059 INFO:tasks.rados.rados.0.smithi084.stdout:160: oid 16 updating version 28 to 29 2024-03-30T12:22:37.059 INFO:tasks.rados.rados.0.smithi084.stdout:160: oid 16 updating version 29 to 31 2024-03-30T12:22:37.059 INFO:tasks.rados.rados.0.smithi084.stdout:160: oid 16 version 31 is already newer than 30 2024-03-30T12:22:37.059 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 31 (ObjNum 78 snap 14 seq_num 78) dirty exists 2024-03-30T12:22:37.059 INFO:tasks.rados.rados.0.smithi084.stdout:160: left oid 16 (ObjNum 78 snap 14 seq_num 78) 2024-03-30T12:22:37.059 INFO:tasks.rados.rados.0.smithi084.stdout:162: expect (ObjNum 50 snap 0 seq_num 50) 2024-03-30T12:22:37.098 INFO:tasks.rados.rados.0.smithi084.stdout:161: finishing copy_from racing read to smithi08477944-10 2024-03-30T12:22:37.098 INFO:tasks.rados.rados.0.smithi084.stdout:161: finishing copy_from to smithi08477944-10 2024-03-30T12:22:37.098 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 22 (ObjNum 57 snap 4 seq_num 57) dirty exists 2024-03-30T12:22:37.099 INFO:tasks.rados.rados.0.smithi084.stdout:163: finishing copy_from racing read to smithi08477944-21 2024-03-30T12:22:37.099 INFO:tasks.rados.rados.0.smithi084.stdout:163: finishing copy_from to smithi08477944-21 2024-03-30T12:22:37.099 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 9 (ObjNum 68 snap 7 seq_num 68) dirty exists 2024-03-30T12:22:37.099 INFO:tasks.rados.rados.0.smithi084.stdout:160: done (4 left) 2024-03-30T12:22:37.099 INFO:tasks.rados.rados.0.smithi084.stdout:161: done (3 left) 2024-03-30T12:22:37.099 INFO:tasks.rados.rados.0.smithi084.stdout:162: done (2 left) 2024-03-30T12:22:37.099 INFO:tasks.rados.rados.0.smithi084.stdout:163: done (1 left) 2024-03-30T12:22:37.099 INFO:tasks.rados.rados.0.smithi084.stdout:164: done (0 left) 2024-03-30T12:22:37.100 INFO:tasks.rados.rados.0.smithi084.stdout:165: delete oid 48 current snap is 14 2024-03-30T12:22:37.100 INFO:tasks.rados.rados.0.smithi084.stdout:165: done (0 left) 2024-03-30T12:22:37.100 INFO:tasks.rados.rados.0.smithi084.stdout:166: snap_remove snap 4 2024-03-30T12:22:37.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:37 smithi162 ceph-mon[30421]: osdmap e93: 8 total, 8 up, 8 in 2024-03-30T12:22:37.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:37 smithi162 ceph-mon[30421]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 on smithi162 2024-03-30T12:22:37.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:37 smithi084 ceph-mon[37565]: osdmap e93: 8 total, 8 up, 8 in 2024-03-30T12:22:37.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:37 smithi084 ceph-mon[37565]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 on smithi162 2024-03-30T12:22:37.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:37 smithi084 ceph-mon[27000]: osdmap e93: 8 total, 8 up, 8 in 2024-03-30T12:22:37.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:37 smithi084 ceph-mon[27000]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 on smithi162 2024-03-30T12:22:38.069 INFO:tasks.rados.rados.0.smithi084.stdout:166: done (0 left) 2024-03-30T12:22:38.070 INFO:tasks.rados.rados.0.smithi084.stdout:167: snap_create 2024-03-30T12:22:38.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:38 smithi162 ceph-mon[30421]: osdmap e94: 8 total, 8 up, 8 in 2024-03-30T12:22:38.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:38 smithi162 ceph-mon[30421]: pgmap v123: 121 pgs: 121 active+clean; 46 MiB data, 313 MiB used, 715 GiB / 715 GiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 18 op/s 2024-03-30T12:22:38.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:38 smithi084 ceph-mon[37565]: osdmap e94: 8 total, 8 up, 8 in 2024-03-30T12:22:38.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:38 smithi084 ceph-mon[37565]: pgmap v123: 121 pgs: 121 active+clean; 46 MiB data, 313 MiB used, 715 GiB / 715 GiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 18 op/s 2024-03-30T12:22:38.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:38 smithi084 ceph-mon[27000]: osdmap e94: 8 total, 8 up, 8 in 2024-03-30T12:22:38.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:38 smithi084 ceph-mon[27000]: pgmap v123: 121 pgs: 121 active+clean; 46 MiB data, 313 MiB used, 715 GiB / 715 GiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 18 op/s 2024-03-30T12:22:39.065 INFO:tasks.rados.rados.0.smithi084.stdout:167: done (0 left) 2024-03-30T12:22:39.066 INFO:tasks.rados.rados.0.smithi084.stdout:168: read oid 46 snap -1 2024-03-30T12:22:39.066 INFO:tasks.rados.rados.0.smithi084.stdout:168: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-30T12:22:39.066 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 15 2024-03-30T12:22:39.066 INFO:tasks.rados.rados.0.smithi084.stdout:169: seq_num 80 ranges {679936=548864,1228800=450560,1679360=352256} 2024-03-30T12:22:39.072 INFO:tasks.rados.rados.0.smithi084.stdout:169: writing smithi08477944-41 from 679936 to 1228800 tid 1 2024-03-30T12:22:39.075 INFO:tasks.rados.rados.0.smithi084.stdout:169: writing smithi08477944-41 from 1228800 to 1679360 tid 2 2024-03-30T12:22:39.077 INFO:tasks.rados.rados.0.smithi084.stdout:169: writing smithi08477944-41 from 1679360 to 2031616 tid 3 2024-03-30T12:22:39.077 INFO:tasks.rados.rados.0.smithi084.stdout:170: copy_from oid 15 from oid 29 current snap is 15 2024-03-30T12:22:39.077 INFO:tasks.rados.rados.0.smithi084.stdout:168: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-30T12:22:39.101 INFO:tasks.rados.rados.0.smithi084.stdout:169: finishing write tid 1 to smithi08477944-41 2024-03-30T12:22:39.101 INFO:tasks.rados.rados.0.smithi084.stdout:169: finishing write tid 2 to smithi08477944-41 2024-03-30T12:22:39.101 INFO:tasks.rados.rados.0.smithi084.stdout:169: finishing write tid 3 to smithi08477944-41 2024-03-30T12:22:39.101 INFO:tasks.rados.rados.0.smithi084.stdout:169: finishing write tid 4 to smithi08477944-41 2024-03-30T12:22:39.101 INFO:tasks.rados.rados.0.smithi084.stdout:168: done (2 left) 2024-03-30T12:22:39.101 INFO:tasks.rados.rados.0.smithi084.stdout:171: snap_create 2024-03-30T12:22:39.101 INFO:tasks.rados.rados.0.smithi084.stdout:170: finishing copy_from to smithi08477944-15 2024-03-30T12:22:39.101 INFO:tasks.rados.rados.0.smithi084.stdout:170: got expected ENOENT (src dne) 2024-03-30T12:22:39.102 INFO:tasks.rados.rados.0.smithi084.stdout:170: finishing copy_from racing read to smithi08477944-15 2024-03-30T12:22:39.102 INFO:tasks.rados.rados.0.smithi084.stdout:169: finishing write tid 5 to smithi08477944-41 2024-03-30T12:22:39.102 INFO:tasks.rados.rados.0.smithi084.stdout:169: oid 41 updating version 0 to 40 2024-03-30T12:22:39.102 INFO:tasks.rados.rados.0.smithi084.stdout:169: oid 41 version 40 is already newer than 39 2024-03-30T12:22:39.102 INFO:tasks.rados.rados.0.smithi084.stdout:169: oid 41 updating version 40 to 42 2024-03-30T12:22:39.102 INFO:tasks.rados.rados.0.smithi084.stdout:169: oid 41 version 42 is already newer than 41 2024-03-30T12:22:39.102 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 42 (ObjNum 80 snap 15 seq_num 80) dirty exists 2024-03-30T12:22:39.102 INFO:tasks.rados.rados.0.smithi084.stdout:169: left oid 41 (ObjNum 80 snap 15 seq_num 80) 2024-03-30T12:22:39.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:39 smithi162 ceph-mon[30421]: osdmap e95: 8 total, 8 up, 8 in 2024-03-30T12:22:39.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:39 smithi084 ceph-mon[37565]: osdmap e95: 8 total, 8 up, 8 in 2024-03-30T12:22:39.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:39 smithi084 ceph-mon[27000]: osdmap e95: 8 total, 8 up, 8 in 2024-03-30T12:22:39.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:22:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:22:39] "GET /metrics HTTP/1.1" 200 36004 "" "Prometheus/2.43.0" 2024-03-30T12:22:40.019 INFO:tasks.rados.rados.0.smithi084.stdout:169: done (2 left) 2024-03-30T12:22:40.020 INFO:tasks.rados.rados.0.smithi084.stdout:170: done (1 left) 2024-03-30T12:22:40.020 INFO:tasks.rados.rados.0.smithi084.stdout:171: done (0 left) 2024-03-30T12:22:40.020 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 16 2024-03-30T12:22:40.020 INFO:tasks.rados.rados.0.smithi084.stdout:172: seq_num 81 ranges {524288=565248,1089536=737280,1826816=65536} 2024-03-30T12:22:40.026 INFO:tasks.rados.rados.0.smithi084.stdout:172: writing smithi08477944-32 from 524288 to 1089536 tid 1 2024-03-30T12:22:40.030 INFO:tasks.rados.rados.0.smithi084.stdout:172: writing smithi08477944-32 from 1089536 to 1826816 tid 2 2024-03-30T12:22:40.031 INFO:tasks.rados.rados.0.smithi084.stdout:172: writing smithi08477944-32 from 1826816 to 1892352 tid 3 2024-03-30T12:22:40.031 INFO:tasks.rados.rados.0.smithi084.stdout:173: snap_create 2024-03-30T12:22:40.031 INFO:tasks.rados.rados.0.smithi084.stdout:172: finishing write tid 1 to smithi08477944-32 2024-03-30T12:22:40.035 INFO:tasks.rados.rados.0.smithi084.stdout:172: finishing write tid 2 to smithi08477944-32 2024-03-30T12:22:40.035 INFO:tasks.rados.rados.0.smithi084.stdout:172: finishing write tid 3 to smithi08477944-32 2024-03-30T12:22:40.035 INFO:tasks.rados.rados.0.smithi084.stdout:172: finishing write tid 4 to smithi08477944-32 2024-03-30T12:22:40.036 INFO:tasks.rados.rados.0.smithi084.stdout:172: finishing write tid 5 to smithi08477944-32 2024-03-30T12:22:40.036 INFO:tasks.rados.rados.0.smithi084.stdout:172: oid 32 updating version 0 to 53 2024-03-30T12:22:40.036 INFO:tasks.rados.rados.0.smithi084.stdout:172: oid 32 version 53 is already newer than 50 2024-03-30T12:22:40.036 INFO:tasks.rados.rados.0.smithi084.stdout:172: oid 32 version 53 is already newer than 52 2024-03-30T12:22:40.036 INFO:tasks.rados.rados.0.smithi084.stdout:172: oid 32 version 53 is already newer than 51 2024-03-30T12:22:40.036 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 53 (ObjNum 81 snap 16 seq_num 81) dirty exists 2024-03-30T12:22:40.036 INFO:tasks.rados.rados.0.smithi084.stdout:172: left oid 32 (ObjNum 81 snap 16 seq_num 81) 2024-03-30T12:22:40.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:40 smithi162 ceph-mon[30421]: osdmap e96: 8 total, 8 up, 8 in 2024-03-30T12:22:40.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:40 smithi162 ceph-mon[30421]: pgmap v126: 121 pgs: 121 active+clean; 46 MiB data, 313 MiB used, 715 GiB / 715 GiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 18 op/s 2024-03-30T12:22:40.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:40 smithi162 ceph-mon[30421]: osdmap e97: 8 total, 8 up, 8 in 2024-03-30T12:22:40.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:40 smithi084 ceph-mon[37565]: osdmap e96: 8 total, 8 up, 8 in 2024-03-30T12:22:40.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:40 smithi084 ceph-mon[37565]: pgmap v126: 121 pgs: 121 active+clean; 46 MiB data, 313 MiB used, 715 GiB / 715 GiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 18 op/s 2024-03-30T12:22:40.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:40 smithi084 ceph-mon[37565]: osdmap e97: 8 total, 8 up, 8 in 2024-03-30T12:22:40.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:40 smithi084 ceph-mon[27000]: osdmap e96: 8 total, 8 up, 8 in 2024-03-30T12:22:40.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:40 smithi084 ceph-mon[27000]: pgmap v126: 121 pgs: 121 active+clean; 46 MiB data, 313 MiB used, 715 GiB / 715 GiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 18 op/s 2024-03-30T12:22:40.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:40 smithi084 ceph-mon[27000]: osdmap e97: 8 total, 8 up, 8 in 2024-03-30T12:22:41.026 INFO:tasks.rados.rados.0.smithi084.stdout:172: done (1 left) 2024-03-30T12:22:41.026 INFO:tasks.rados.rados.0.smithi084.stdout:173: done (0 left) 2024-03-30T12:22:41.026 INFO:tasks.rados.rados.0.smithi084.stdout:174: snap_create 2024-03-30T12:22:42.035 INFO:tasks.rados.rados.0.smithi084.stdout:174: done (0 left) 2024-03-30T12:22:42.036 INFO:tasks.rados.rados.0.smithi084.stdout:175: snap_remove snap 8 2024-03-30T12:22:42.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:42 smithi162 ceph-mon[30421]: osdmap e98: 8 total, 8 up, 8 in 2024-03-30T12:22:42.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:42 smithi162 ceph-mon[30421]: pgmap v129: 121 pgs: 121 active+clean; 49 MiB data, 318 MiB used, 715 GiB / 715 GiB avail; 576 KiB/s rd, 664 KiB/s wr, 3 op/s 2024-03-30T12:22:42.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:42 smithi084 ceph-mon[27000]: osdmap e98: 8 total, 8 up, 8 in 2024-03-30T12:22:42.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:42 smithi084 ceph-mon[27000]: pgmap v129: 121 pgs: 121 active+clean; 49 MiB data, 318 MiB used, 715 GiB / 715 GiB avail; 576 KiB/s rd, 664 KiB/s wr, 3 op/s 2024-03-30T12:22:42.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:42 smithi084 ceph-mon[37565]: osdmap e98: 8 total, 8 up, 8 in 2024-03-30T12:22:42.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:42 smithi084 ceph-mon[37565]: pgmap v129: 121 pgs: 121 active+clean; 49 MiB data, 318 MiB used, 715 GiB / 715 GiB avail; 576 KiB/s rd, 664 KiB/s wr, 3 op/s 2024-03-30T12:22:43.036 INFO:tasks.rados.rados.0.smithi084.stdout:175: done (0 left) 2024-03-30T12:22:43.036 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 18 2024-03-30T12:22:43.036 INFO:tasks.rados.rados.0.smithi084.stdout:176: seq_num 82 ranges {0=581632,581632=622592,1204224=180224} 2024-03-30T12:22:43.039 INFO:tasks.rados.rados.0.smithi084.stdout:176: writing smithi08477944-22 from 0 to 581632 tid 1 2024-03-30T12:22:43.044 INFO:tasks.rados.rados.0.smithi084.stdout:176: writing smithi08477944-22 from 581632 to 1204224 tid 2 2024-03-30T12:22:43.045 INFO:tasks.rados.rados.0.smithi084.stdout:176: writing smithi08477944-22 from 1204224 to 1384448 tid 3 2024-03-30T12:22:43.045 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 18 2024-03-30T12:22:43.045 INFO:tasks.rados.rados.0.smithi084.stdout:177: seq_num 83 ranges {1499136=598016,2097152=499712,2596864=303104} 2024-03-30T12:22:43.056 INFO:tasks.rados.rados.0.smithi084.stdout:177: writing smithi08477944-10 from 1499136 to 2097152 tid 1 2024-03-30T12:22:43.059 INFO:tasks.rados.rados.0.smithi084.stdout:177: writing smithi08477944-10 from 2097152 to 2596864 tid 2 2024-03-30T12:22:43.061 INFO:tasks.rados.rados.0.smithi084.stdout:177: writing smithi08477944-10 from 2596864 to 2899968 tid 3 2024-03-30T12:22:43.061 INFO:tasks.rados.rados.0.smithi084.stdout:178: setattr oid 6 current snap is 18 2024-03-30T12:22:43.061 INFO:tasks.rados.rados.0.smithi084.stdout:176: finishing write tid 1 to smithi08477944-22 2024-03-30T12:22:43.062 INFO:tasks.rados.rados.0.smithi084.stdout:176: finishing write tid 2 to smithi08477944-22 2024-03-30T12:22:43.062 INFO:tasks.rados.rados.0.smithi084.stdout:176: finishing write tid 3 to smithi08477944-22 2024-03-30T12:22:43.062 INFO:tasks.rados.rados.0.smithi084.stdout:176: finishing write tid 4 to smithi08477944-22 2024-03-30T12:22:43.062 INFO:tasks.rados.rados.0.smithi084.stdout:176: finishing write tid 5 to smithi08477944-22 2024-03-30T12:22:43.062 INFO:tasks.rados.rados.0.smithi084.stdout:176: oid 22 updating version 0 to 48 2024-03-30T12:22:43.062 INFO:tasks.rados.rados.0.smithi084.stdout:176: oid 22 updating version 48 to 50 2024-03-30T12:22:43.062 INFO:tasks.rados.rados.0.smithi084.stdout:176: oid 22 version 50 is already newer than 49 2024-03-30T12:22:43.062 INFO:tasks.rados.rados.0.smithi084.stdout:176: oid 22 version 50 is already newer than 47 2024-03-30T12:22:43.062 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 50 (ObjNum 82 snap 18 seq_num 82) dirty exists 2024-03-30T12:22:43.062 INFO:tasks.rados.rados.0.smithi084.stdout:176: left oid 22 (ObjNum 82 snap 18 seq_num 82) 2024-03-30T12:22:43.062 INFO:tasks.rados.rados.0.smithi084.stdout:177: finishing write tid 1 to smithi08477944-10 2024-03-30T12:22:43.063 INFO:tasks.rados.rados.0.smithi084.stdout:177: finishing write tid 2 to smithi08477944-10 2024-03-30T12:22:43.063 INFO:tasks.rados.rados.0.smithi084.stdout:176: done (2 left) 2024-03-30T12:22:43.063 INFO:tasks.rados.rados.0.smithi084.stdout:179: read oid 12 snap 14 2024-03-30T12:22:43.063 INFO:tasks.rados.rados.0.smithi084.stdout:179: expect (ObjNum 70 snap 8 seq_num 70) 2024-03-30T12:22:43.064 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 18 2024-03-30T12:22:43.064 INFO:tasks.rados.rados.0.smithi084.stdout:177: finishing write tid 3 to smithi08477944-10 2024-03-30T12:22:43.064 INFO:tasks.rados.rados.0.smithi084.stdout:180: seq_num 84 ranges {950272=614400,1564672=434176,1998848=368640} 2024-03-30T12:22:43.072 INFO:tasks.rados.rados.0.smithi084.stdout:180: writing smithi08477944-3 from 950272 to 1564672 tid 1 2024-03-30T12:22:43.074 INFO:tasks.rados.rados.0.smithi084.stdout:180: writing smithi08477944-3 from 1564672 to 1998848 tid 2 2024-03-30T12:22:43.077 INFO:tasks.rados.rados.0.smithi084.stdout:180: writing smithi08477944-3 from 1998848 to 2367488 tid 3 2024-03-30T12:22:43.077 INFO:tasks.rados.rados.0.smithi084.stdout:181: snap_create 2024-03-30T12:22:43.077 INFO:tasks.rados.rados.0.smithi084.stdout:177: finishing write tid 4 to smithi08477944-10 2024-03-30T12:22:43.077 INFO:tasks.rados.rados.0.smithi084.stdout:177: finishing write tid 5 to smithi08477944-10 2024-03-30T12:22:43.077 INFO:tasks.rados.rados.0.smithi084.stdout:177: oid 10 updating version 0 to 48 2024-03-30T12:22:43.077 INFO:tasks.rados.rados.0.smithi084.stdout:177: oid 10 updating version 48 to 50 2024-03-30T12:22:43.078 INFO:tasks.rados.rados.0.smithi084.stdout:177: oid 10 version 50 is already newer than 47 2024-03-30T12:22:43.078 INFO:tasks.rados.rados.0.smithi084.stdout:177: oid 10 version 50 is already newer than 49 2024-03-30T12:22:43.078 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 50 (ObjNum 83 snap 18 seq_num 83) dirty exists 2024-03-30T12:22:43.078 INFO:tasks.rados.rados.0.smithi084.stdout:177: left oid 10 (ObjNum 83 snap 18 seq_num 83) 2024-03-30T12:22:43.078 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 33 (ObjNum 305 snap 0 seq_num 0) dirty exists 2024-03-30T12:22:43.078 INFO:tasks.rados.rados.0.smithi084.stdout:179: expect (ObjNum 70 snap 8 seq_num 70) 2024-03-30T12:22:43.108 INFO:tasks.rados.rados.0.smithi084.stdout:180: finishing write tid 1 to smithi08477944-3 2024-03-30T12:22:43.108 INFO:tasks.rados.rados.0.smithi084.stdout:180: finishing write tid 2 to smithi08477944-3 2024-03-30T12:22:43.108 INFO:tasks.rados.rados.0.smithi084.stdout:180: finishing write tid 3 to smithi08477944-3 2024-03-30T12:22:43.108 INFO:tasks.rados.rados.0.smithi084.stdout:180: finishing write tid 4 to smithi08477944-3 2024-03-30T12:22:43.108 INFO:tasks.rados.rados.0.smithi084.stdout:180: finishing write tid 5 to smithi08477944-3 2024-03-30T12:22:43.108 INFO:tasks.rados.rados.0.smithi084.stdout:180: oid 3 updating version 0 to 55 2024-03-30T12:22:43.108 INFO:tasks.rados.rados.0.smithi084.stdout:180: oid 3 version 55 is already newer than 53 2024-03-30T12:22:43.108 INFO:tasks.rados.rados.0.smithi084.stdout:180: oid 3 version 55 is already newer than 52 2024-03-30T12:22:43.108 INFO:tasks.rados.rados.0.smithi084.stdout:180: oid 3 version 55 is already newer than 54 2024-03-30T12:22:43.108 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 55 (ObjNum 84 snap 18 seq_num 84) dirty exists 2024-03-30T12:22:43.108 INFO:tasks.rados.rados.0.smithi084.stdout:180: left oid 3 (ObjNum 84 snap 18 seq_num 84) 2024-03-30T12:22:43.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:43 smithi162 ceph-mon[30421]: osdmap e99: 8 total, 8 up, 8 in 2024-03-30T12:22:43.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:43 smithi084 ceph-mon[37565]: osdmap e99: 8 total, 8 up, 8 in 2024-03-30T12:22:43.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:43 smithi084 ceph-mon[27000]: osdmap e99: 8 total, 8 up, 8 in 2024-03-30T12:22:43.902 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-03-30T12:22:44.056 INFO:tasks.rados.rados.0.smithi084.stdout:177: done (4 left) 2024-03-30T12:22:44.056 INFO:tasks.rados.rados.0.smithi084.stdout:178: done (3 left) 2024-03-30T12:22:44.056 INFO:tasks.rados.rados.0.smithi084.stdout:179: done (2 left) 2024-03-30T12:22:44.056 INFO:tasks.rados.rados.0.smithi084.stdout:180: done (1 left) 2024-03-30T12:22:44.056 INFO:tasks.rados.rados.0.smithi084.stdout:181: done (0 left) 2024-03-30T12:22:44.056 INFO:tasks.rados.rados.0.smithi084.stdout:182: snap_create 2024-03-30T12:22:44.216 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T12:22:44.217 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (2m) 95s ago 2m 17.2M - 0.25.0 c8568f914cd2 6765ce007f39 2024-03-30T12:22:44.217 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi162 *:3000 running (2m) 95s ago 2m 84.8M - 9.4.7 954c08fa6188 ff2ec7518619 2024-03-30T12:22:44.217 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (3m) 95s ago 3m 12.3M - 18.2.2-1051-gf14b5682 c8fb09e16a7d a9c2e74ca2a3 2024-03-30T12:22:44.217 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi162 running (3m) 95s ago 3m 16.7M - 18.2.2-1051-gf14b5682 c8fb09e16a7d ee1770ef5edd 2024-03-30T12:22:44.217 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi162 *:8443,8765 running (7m) 95s ago 7m 448M - 18.2.2-1051-gf14b5682 c8fb09e16a7d d0e0c63b20de 2024-03-30T12:22:44.217 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:9283,8765 running (8m) 95s ago 8m 496M - 18.2.2-1051-gf14b5682 c8fb09e16a7d 000810f2a0de 2024-03-30T12:22:44.217 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (8m) 95s ago 9m 49.8M 2048M 18.2.2-1051-gf14b5682 c8fb09e16a7d 915abc0d6de7 2024-03-30T12:22:44.217 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi162 running (7m) 95s ago 7m 39.7M 2048M 18.2.2-1051-gf14b5682 c8fb09e16a7d 5bf04eacfc81 2024-03-30T12:22:44.217 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (7m) 95s ago 7m 39.8M 2048M 18.2.2-1051-gf14b5682 c8fb09e16a7d 7db3fd996ae6 2024-03-30T12:22:44.217 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (2m) 95s ago 2m 7662k - 1.5.0 0da6a335fe13 66844bed39e8 2024-03-30T12:22:44.217 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi162 *:9100 running (2m) 95s ago 2m 7906k - 1.5.0 0da6a335fe13 3d6e28b2348d 2024-03-30T12:22:44.217 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (6m) 95s ago 6m 53.2M 2992M 18.2.2-1051-gf14b5682 c8fb09e16a7d 4cad4c4383a6 2024-03-30T12:22:44.217 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (6m) 95s ago 6m 50.5M 2992M 18.2.2-1051-gf14b5682 c8fb09e16a7d 3b30b0ea0e32 2024-03-30T12:22:44.217 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (6m) 95s ago 6m 53.5M 2992M 18.2.2-1051-gf14b5682 c8fb09e16a7d eb2412618811 2024-03-30T12:22:44.218 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (5m) 95s ago 5m 39.7M 2992M 18.2.2-1051-gf14b5682 c8fb09e16a7d 8eaf6dc73c25 2024-03-30T12:22:44.218 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi162 running (5m) 95s ago 5m 52.9M 2992M 18.2.2-1051-gf14b5682 c8fb09e16a7d 1f52e827b91a 2024-03-30T12:22:44.218 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi162 running (4m) 95s ago 4m 50.7M 2992M 18.2.2-1051-gf14b5682 c8fb09e16a7d 7ba250d154aa 2024-03-30T12:22:44.218 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi162 running (4m) 95s ago 4m 42.0M 2992M 18.2.2-1051-gf14b5682 c8fb09e16a7d 656a733e8b7a 2024-03-30T12:22:44.218 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi162 running (4m) 95s ago 4m 49.0M 2992M 18.2.2-1051-gf14b5682 c8fb09e16a7d e3246b3bc88b 2024-03-30T12:22:44.218 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi162 *:9095 running (117s) 95s ago 3m 33.0M - 2.43.0 a07b618ecd1d 9858cdf4e1f2 2024-03-30T12:22:44.218 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:44 smithi084 ceph-mon[37565]: osdmap e100: 8 total, 8 up, 8 in 2024-03-30T12:22:44.218 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:44 smithi084 ceph-mon[37565]: pgmap v132: 121 pgs: 121 active+clean; 49 MiB data, 318 MiB used, 715 GiB / 715 GiB avail; 576 KiB/s rd, 664 KiB/s wr, 3 op/s 2024-03-30T12:22:44.218 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:44 smithi084 ceph-mon[37565]: from='client.24989 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:22:44.219 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:44 smithi084 ceph-mon[27000]: osdmap e100: 8 total, 8 up, 8 in 2024-03-30T12:22:44.219 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:44 smithi084 ceph-mon[27000]: pgmap v132: 121 pgs: 121 active+clean; 49 MiB data, 318 MiB used, 715 GiB / 715 GiB avail; 576 KiB/s rd, 664 KiB/s wr, 3 op/s 2024-03-30T12:22:44.219 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:44 smithi084 ceph-mon[27000]: from='client.24989 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:22:44.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:44 smithi162 ceph-mon[30421]: osdmap e100: 8 total, 8 up, 8 in 2024-03-30T12:22:44.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:44 smithi162 ceph-mon[30421]: pgmap v132: 121 pgs: 121 active+clean; 49 MiB data, 318 MiB used, 715 GiB / 715 GiB avail; 576 KiB/s rd, 664 KiB/s wr, 3 op/s 2024-03-30T12:22:44.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:44 smithi162 ceph-mon[30421]: from='client.24989 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:22:44.603 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-30T12:22:44.603 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-03-30T12:22:44.603 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 3 2024-03-30T12:22:44.603 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:22:44.603 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-03-30T12:22:44.603 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 2 2024-03-30T12:22:44.603 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:22:44.603 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-03-30T12:22:44.604 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 8 2024-03-30T12:22:44.604 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:22:44.604 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-03-30T12:22:44.604 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 2 2024-03-30T12:22:44.604 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:22:44.604 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-03-30T12:22:44.604 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 15 2024-03-30T12:22:44.604 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-30T12:22:44.604 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-30T12:22:45.023 INFO:tasks.rados.rados.0.smithi084.stdout:182: done (0 left) 2024-03-30T12:22:45.023 INFO:tasks.rados.rados.0.smithi084.stdout:183: read oid 45 snap -1 2024-03-30T12:22:45.023 INFO:tasks.rados.rados.0.smithi084.stdout:183: expect (ObjNum 74 snap 13 seq_num 74) 2024-03-30T12:22:45.023 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 31 current snap is 20 2024-03-30T12:22:45.023 INFO:tasks.rados.rados.0.smithi084.stdout:184: seq_num 85 ranges {1802240=630784,2433024=720896,3153920=81920} 2024-03-30T12:22:45.036 INFO:tasks.rados.rados.0.smithi084.stdout:184: writing smithi08477944-31 from 1802240 to 2433024 tid 1 2024-03-30T12:22:45.041 INFO:tasks.rados.rados.0.smithi084.stdout:184: writing smithi08477944-31 from 2433024 to 3153920 tid 2 2024-03-30T12:22:45.042 INFO:tasks.rados.rados.0.smithi084.stdout:184: writing smithi08477944-31 from 3153920 to 3235840 tid 3 2024-03-30T12:22:45.042 INFO:tasks.rados.rados.0.smithi084.stdout:185: read oid 49 snap -1 2024-03-30T12:22:45.042 INFO:tasks.rados.rados.0.smithi084.stdout:185: expect (ObjNum 59 snap 5 seq_num 59) 2024-03-30T12:22:45.042 INFO:tasks.rados.rados.0.smithi084.stdout:186: read oid 38 snap -1 2024-03-30T12:22:45.043 INFO:tasks.rados.rados.0.smithi084.stdout:186: expect (ObjNum 67 snap 7 seq_num 67) 2024-03-30T12:22:45.043 INFO:tasks.rados.rados.0.smithi084.stdout:187: read oid 40 snap -1 2024-03-30T12:22:45.043 INFO:tasks.rados.rados.0.smithi084.stdout:187: expect (ObjNum 39 snap 0 seq_num 39) 2024-03-30T12:22:45.043 INFO:tasks.rados.rados.0.smithi084.stdout:188: snap_create 2024-03-30T12:22:45.043 INFO:tasks.rados.rados.0.smithi084.stdout:183: expect (ObjNum 74 snap 13 seq_num 74) 2024-03-30T12:22:45.110 INFO:tasks.rados.rados.0.smithi084.stdout:184: finishing write tid 1 to smithi08477944-31 2024-03-30T12:22:45.110 INFO:tasks.rados.rados.0.smithi084.stdout:187: expect (ObjNum 39 snap 0 seq_num 39) 2024-03-30T12:22:45.126 INFO:tasks.rados.rados.0.smithi084.stdout:185: expect (ObjNum 59 snap 5 seq_num 59) 2024-03-30T12:22:45.185 INFO:tasks.rados.rados.0.smithi084.stdout:186: expect (ObjNum 67 snap 7 seq_num 67) 2024-03-30T12:22:45.239 INFO:tasks.rados.rados.0.smithi084.stdout:184: finishing write tid 2 to smithi08477944-31 2024-03-30T12:22:45.239 INFO:tasks.rados.rados.0.smithi084.stdout:184: finishing write tid 3 to smithi08477944-31 2024-03-30T12:22:45.239 INFO:tasks.rados.rados.0.smithi084.stdout:184: finishing write tid 4 to smithi08477944-31 2024-03-30T12:22:45.239 INFO:tasks.rados.rados.0.smithi084.stdout:184: finishing write tid 5 to smithi08477944-31 2024-03-30T12:22:45.239 INFO:tasks.rados.rados.0.smithi084.stdout:184: oid 31 updating version 0 to 42 2024-03-30T12:22:45.239 INFO:tasks.rados.rados.0.smithi084.stdout:184: oid 31 version 42 is already newer than 40 2024-03-30T12:22:45.239 INFO:tasks.rados.rados.0.smithi084.stdout:184: oid 31 version 42 is already newer than 41 2024-03-30T12:22:45.239 INFO:tasks.rados.rados.0.smithi084.stdout:184: oid 31 updating version 42 to 43 2024-03-30T12:22:45.239 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 43 (ObjNum 85 snap 20 seq_num 85) dirty exists 2024-03-30T12:22:45.239 INFO:tasks.rados.rados.0.smithi084.stdout:184: left oid 31 (ObjNum 85 snap 20 seq_num 85) 2024-03-30T12:22:45.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:45 smithi162 ceph-mon[30421]: osdmap e101: 8 total, 8 up, 8 in 2024-03-30T12:22:45.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:45 smithi162 ceph-mon[30421]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:22:45.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:45 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/2591112697' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:22:45.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:45 smithi162 ceph-mon[30421]: osdmap e102: 8 total, 8 up, 8 in 2024-03-30T12:22:45.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:45 smithi084 ceph-mon[37565]: osdmap e101: 8 total, 8 up, 8 in 2024-03-30T12:22:45.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:45 smithi084 ceph-mon[37565]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:22:45.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:45 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/2591112697' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:22:45.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:45 smithi084 ceph-mon[37565]: osdmap e102: 8 total, 8 up, 8 in 2024-03-30T12:22:45.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:45 smithi084 ceph-mon[27000]: osdmap e101: 8 total, 8 up, 8 in 2024-03-30T12:22:45.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:45 smithi084 ceph-mon[27000]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:22:45.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:45 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/2591112697' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:22:45.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:45 smithi084 ceph-mon[27000]: osdmap e102: 8 total, 8 up, 8 in 2024-03-30T12:22:46.030 INFO:tasks.rados.rados.0.smithi084.stdout:183: done (5 left) 2024-03-30T12:22:46.031 INFO:tasks.rados.rados.0.smithi084.stdout:184: done (4 left) 2024-03-30T12:22:46.031 INFO:tasks.rados.rados.0.smithi084.stdout:185: done (3 left) 2024-03-30T12:22:46.031 INFO:tasks.rados.rados.0.smithi084.stdout:186: done (2 left) 2024-03-30T12:22:46.031 INFO:tasks.rados.rados.0.smithi084.stdout:187: done (1 left) 2024-03-30T12:22:46.031 INFO:tasks.rados.rados.0.smithi084.stdout:188: done (0 left) 2024-03-30T12:22:46.031 INFO:tasks.rados.rados.0.smithi084.stdout:189: snap_remove snap 16 2024-03-30T12:22:46.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:46 smithi162 ceph-mon[30421]: pgmap v135: 121 pgs: 121 active+clean; 49 MiB data, 318 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:46.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:46 smithi162 ceph-mon[30421]: osdmap e103: 8 total, 8 up, 8 in 2024-03-30T12:22:46.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:46 smithi084 ceph-mon[37565]: pgmap v135: 121 pgs: 121 active+clean; 49 MiB data, 318 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:46.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:46 smithi084 ceph-mon[37565]: osdmap e103: 8 total, 8 up, 8 in 2024-03-30T12:22:46.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:46 smithi084 ceph-mon[27000]: pgmap v135: 121 pgs: 121 active+clean; 49 MiB data, 318 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:46.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:46 smithi084 ceph-mon[27000]: osdmap e103: 8 total, 8 up, 8 in 2024-03-30T12:22:47.033 INFO:tasks.rados.rados.0.smithi084.stdout:189: done (0 left) 2024-03-30T12:22:47.033 INFO:tasks.rados.rados.0.smithi084.stdout:190: read oid 36 snap -1 2024-03-30T12:22:47.033 INFO:tasks.rados.rados.0.smithi084.stdout:190: expect (ObjNum 35 snap 0 seq_num 35) 2024-03-30T12:22:47.033 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 21 2024-03-30T12:22:47.033 INFO:tasks.rados.rados.0.smithi084.stdout:191: seq_num 86 ranges {0=647168,647168=606208,1253376=196608} 2024-03-30T12:22:47.037 INFO:tasks.rados.rados.0.smithi084.stdout:191: writing smithi08477944-1 from 0 to 647168 tid 1 2024-03-30T12:22:47.041 INFO:tasks.rados.rados.0.smithi084.stdout:191: writing smithi08477944-1 from 647168 to 1253376 tid 2 2024-03-30T12:22:47.042 INFO:tasks.rados.rados.0.smithi084.stdout:191: writing smithi08477944-1 from 1253376 to 1449984 tid 3 2024-03-30T12:22:47.042 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 21 2024-03-30T12:22:47.042 INFO:tasks.rados.rados.0.smithi084.stdout:192: seq_num 87 ranges {1302528=663552,1966080=491520,2457600=311296} 2024-03-30T12:22:47.053 INFO:tasks.rados.rados.0.smithi084.stdout:192: writing smithi08477944-9 from 1302528 to 1966080 tid 1 2024-03-30T12:22:47.056 INFO:tasks.rados.rados.0.smithi084.stdout:192: writing smithi08477944-9 from 1966080 to 2457600 tid 2 2024-03-30T12:22:47.058 INFO:tasks.rados.rados.0.smithi084.stdout:192: writing smithi08477944-9 from 2457600 to 2768896 tid 3 2024-03-30T12:22:47.058 INFO:tasks.rados.rados.0.smithi084.stdout:193: rmattr oid 11 current snap is 21 2024-03-30T12:22:47.058 INFO:tasks.rados.rados.0.smithi084.stdout:193: done (3 left) 2024-03-30T12:22:47.058 INFO:tasks.rados.rados.0.smithi084.stdout:194: snap_remove snap 6 2024-03-30T12:22:48.041 INFO:tasks.rados.rados.0.smithi084.stdout:194: done (3 left) 2024-03-30T12:22:48.041 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 21 2024-03-30T12:22:48.041 INFO:tasks.rados.rados.0.smithi084.stdout:195: seq_num 88 ranges {172032=679936,851968=778240,1630208=24576} 2024-03-30T12:22:48.046 INFO:tasks.rados.rados.0.smithi084.stdout:195: writing smithi08477944-2 from 172032 to 851968 tid 1 2024-03-30T12:22:48.050 INFO:tasks.rados.rados.0.smithi084.stdout:195: writing smithi08477944-2 from 851968 to 1630208 tid 2 2024-03-30T12:22:48.050 INFO:tasks.rados.rados.0.smithi084.stdout:195: writing smithi08477944-2 from 1630208 to 1654784 tid 3 2024-03-30T12:22:48.051 INFO:tasks.rados.rados.0.smithi084.stdout:196: copy_from oid 38 from oid 46 current snap is 21 2024-03-30T12:22:48.051 INFO:tasks.rados.rados.0.smithi084.stdout:190: expect (ObjNum 35 snap 0 seq_num 35) 2024-03-30T12:22:48.071 INFO:tasks.rados.rados.0.smithi084.stdout:191: finishing write tid 1 to smithi08477944-1 2024-03-30T12:22:48.071 INFO:tasks.rados.rados.0.smithi084.stdout:191: finishing write tid 2 to smithi08477944-1 2024-03-30T12:22:48.071 INFO:tasks.rados.rados.0.smithi084.stdout:191: finishing write tid 3 to smithi08477944-1 2024-03-30T12:22:48.071 INFO:tasks.rados.rados.0.smithi084.stdout:191: finishing write tid 4 to smithi08477944-1 2024-03-30T12:22:48.071 INFO:tasks.rados.rados.0.smithi084.stdout:191: finishing write tid 5 to smithi08477944-1 2024-03-30T12:22:48.071 INFO:tasks.rados.rados.0.smithi084.stdout:191: oid 1 updating version 0 to 16 2024-03-30T12:22:48.071 INFO:tasks.rados.rados.0.smithi084.stdout:191: oid 1 updating version 16 to 17 2024-03-30T12:22:48.071 INFO:tasks.rados.rados.0.smithi084.stdout:191: oid 1 version 17 is already newer than 15 2024-03-30T12:22:48.072 INFO:tasks.rados.rados.0.smithi084.stdout:191: oid 1 version 17 is already newer than 14 2024-03-30T12:22:48.072 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 17 (ObjNum 86 snap 21 seq_num 86) dirty exists 2024-03-30T12:22:48.072 INFO:tasks.rados.rados.0.smithi084.stdout:191: left oid 1 (ObjNum 86 snap 21 seq_num 86) 2024-03-30T12:22:48.072 INFO:tasks.rados.rados.0.smithi084.stdout:192: finishing write tid 1 to smithi08477944-9 2024-03-30T12:22:48.072 INFO:tasks.rados.rados.0.smithi084.stdout:190: done (4 left) 2024-03-30T12:22:48.072 INFO:tasks.rados.rados.0.smithi084.stdout:191: done (3 left) 2024-03-30T12:22:48.072 INFO:tasks.rados.rados.0.smithi084.stdout:197: snap_remove snap 2 2024-03-30T12:22:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:48 smithi162 ceph-mon[30421]: osdmap e104: 8 total, 8 up, 8 in 2024-03-30T12:22:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:48 smithi162 ceph-mon[30421]: pgmap v138: 121 pgs: 121 active+clean; 54 MiB data, 326 MiB used, 715 GiB / 715 GiB avail; 5.3 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2024-03-30T12:22:48.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:48 smithi084 ceph-mon[27000]: osdmap e104: 8 total, 8 up, 8 in 2024-03-30T12:22:48.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:48 smithi084 ceph-mon[27000]: pgmap v138: 121 pgs: 121 active+clean; 54 MiB data, 326 MiB used, 715 GiB / 715 GiB avail; 5.3 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2024-03-30T12:22:48.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:48 smithi084 ceph-mon[37565]: osdmap e104: 8 total, 8 up, 8 in 2024-03-30T12:22:48.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:48 smithi084 ceph-mon[37565]: pgmap v138: 121 pgs: 121 active+clean; 54 MiB data, 326 MiB used, 715 GiB / 715 GiB avail; 5.3 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2024-03-30T12:22:49.053 INFO:tasks.rados.rados.0.smithi084.stdout:197: done (3 left) 2024-03-30T12:22:49.053 INFO:tasks.rados.rados.0.smithi084.stdout:198: rmattr oid 7 current snap is 21 2024-03-30T12:22:49.053 INFO:tasks.rados.rados.0.smithi084.stdout:198: done (3 left) 2024-03-30T12:22:49.053 INFO:tasks.rados.rados.0.smithi084.stdout:199: rmattr oid 24 current snap is 21 2024-03-30T12:22:49.053 INFO:tasks.rados.rados.0.smithi084.stdout:199: done (3 left) 2024-03-30T12:22:49.053 INFO:tasks.rados.rados.0.smithi084.stdout:200: rmattr oid 39 current snap is 21 2024-03-30T12:22:49.053 INFO:tasks.rados.rados.0.smithi084.stdout:200: done (3 left) 2024-03-30T12:22:49.053 INFO:tasks.rados.rados.0.smithi084.stdout:201: read oid 1 snap -1 2024-03-30T12:22:49.054 INFO:tasks.rados.rados.0.smithi084.stdout:201: expect (ObjNum 86 snap 21 seq_num 86) 2024-03-30T12:22:49.054 INFO:tasks.rados.rados.0.smithi084.stdout:202: read oid 50 snap -1 2024-03-30T12:22:49.054 INFO:tasks.rados.rados.0.smithi084.stdout:202: expect (ObjNum 49 snap 0 seq_num 49) 2024-03-30T12:22:49.054 INFO:tasks.rados.rados.0.smithi084.stdout:203: setattr oid 35 current snap is 21 2024-03-30T12:22:49.054 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 21 2024-03-30T12:22:49.054 INFO:tasks.rados.rados.0.smithi084.stdout:204: seq_num 89 ranges {1400832=696320,2097152=655360,2752512=147456} 2024-03-30T12:22:49.067 INFO:tasks.rados.rados.0.smithi084.stdout:204: writing smithi08477944-20 from 1400832 to 2097152 tid 1 2024-03-30T12:22:49.072 INFO:tasks.rados.rados.0.smithi084.stdout:204: writing smithi08477944-20 from 2097152 to 2752512 tid 2 2024-03-30T12:22:49.073 INFO:tasks.rados.rados.0.smithi084.stdout:204: writing smithi08477944-20 from 2752512 to 2899968 tid 3 2024-03-30T12:22:49.074 INFO:tasks.rados.rados.0.smithi084.stdout:192: finishing write tid 2 to smithi08477944-9 2024-03-30T12:22:49.074 INFO:tasks.rados.rados.0.smithi084.stdout:192: finishing write tid 3 to smithi08477944-9 2024-03-30T12:22:49.074 INFO:tasks.rados.rados.0.smithi084.stdout:192: finishing write tid 4 to smithi08477944-9 2024-03-30T12:22:49.074 INFO:tasks.rados.rados.0.smithi084.stdout:192: finishing write tid 5 to smithi08477944-9 2024-03-30T12:22:49.074 INFO:tasks.rados.rados.0.smithi084.stdout:192: oid 9 updating version 0 to 23 2024-03-30T12:22:49.074 INFO:tasks.rados.rados.0.smithi084.stdout:192: oid 9 version 23 is already newer than 22 2024-03-30T12:22:49.074 INFO:tasks.rados.rados.0.smithi084.stdout:192: oid 9 version 23 is already newer than 20 2024-03-30T12:22:49.075 INFO:tasks.rados.rados.0.smithi084.stdout:192: oid 9 version 23 is already newer than 21 2024-03-30T12:22:49.075 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 23 (ObjNum 87 snap 21 seq_num 87) dirty exists 2024-03-30T12:22:49.075 INFO:tasks.rados.rados.0.smithi084.stdout:192: left oid 9 (ObjNum 87 snap 21 seq_num 87) 2024-03-30T12:22:49.075 INFO:tasks.rados.rados.0.smithi084.stdout:195: finishing write tid 1 to smithi08477944-2 2024-03-30T12:22:49.075 INFO:tasks.rados.rados.0.smithi084.stdout:195: finishing write tid 2 to smithi08477944-2 2024-03-30T12:22:49.075 INFO:tasks.rados.rados.0.smithi084.stdout:195: finishing write tid 3 to smithi08477944-2 2024-03-30T12:22:49.075 INFO:tasks.rados.rados.0.smithi084.stdout:195: finishing write tid 4 to smithi08477944-2 2024-03-30T12:22:49.076 INFO:tasks.rados.rados.0.smithi084.stdout:195: finishing write tid 5 to smithi08477944-2 2024-03-30T12:22:49.076 INFO:tasks.rados.rados.0.smithi084.stdout:195: oid 2 updating version 0 to 66 2024-03-30T12:22:49.076 INFO:tasks.rados.rados.0.smithi084.stdout:195: oid 2 version 66 is already newer than 63 2024-03-30T12:22:49.076 INFO:tasks.rados.rados.0.smithi084.stdout:195: oid 2 version 66 is already newer than 65 2024-03-30T12:22:49.076 INFO:tasks.rados.rados.0.smithi084.stdout:195: oid 2 version 66 is already newer than 64 2024-03-30T12:22:49.076 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 66 (ObjNum 88 snap 21 seq_num 88) dirty exists 2024-03-30T12:22:49.076 INFO:tasks.rados.rados.0.smithi084.stdout:195: left oid 2 (ObjNum 88 snap 21 seq_num 88) 2024-03-30T12:22:49.076 INFO:tasks.rados.rados.0.smithi084.stdout:196: finishing copy_from racing read to smithi08477944-38 2024-03-30T12:22:49.077 INFO:tasks.rados.rados.0.smithi084.stdout:196: finishing copy_from to smithi08477944-38 2024-03-30T12:22:49.077 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 30 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-03-30T12:22:49.077 INFO:tasks.rados.rados.0.smithi084.stdout:192: done (6 left) 2024-03-30T12:22:49.077 INFO:tasks.rados.rados.0.smithi084.stdout:195: done (5 left) 2024-03-30T12:22:49.077 INFO:tasks.rados.rados.0.smithi084.stdout:196: done (4 left) 2024-03-30T12:22:49.077 INFO:tasks.rados.rados.0.smithi084.stdout:205: copy_from oid 25 from oid 10 current snap is 21 2024-03-30T12:22:49.077 INFO:tasks.rados.rados.0.smithi084.stdout:201: expect (ObjNum 86 snap 21 seq_num 86) 2024-03-30T12:22:49.113 INFO:tasks.rados.rados.0.smithi084.stdout:202: expect (ObjNum 49 snap 0 seq_num 49) 2024-03-30T12:22:49.135 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 23 (ObjNum 68 snap 7 seq_num 68) dirty exists 2024-03-30T12:22:49.135 INFO:tasks.rados.rados.0.smithi084.stdout:204: finishing write tid 1 to smithi08477944-20 2024-03-30T12:22:49.135 INFO:tasks.rados.rados.0.smithi084.stdout:201: done (4 left) 2024-03-30T12:22:49.136 INFO:tasks.rados.rados.0.smithi084.stdout:202: done (3 left) 2024-03-30T12:22:49.136 INFO:tasks.rados.rados.0.smithi084.stdout:203: done (2 left) 2024-03-30T12:22:49.136 INFO:tasks.rados.rados.0.smithi084.stdout:206: snap_create 2024-03-30T12:22:49.136 INFO:tasks.rados.rados.0.smithi084.stdout:204: finishing write tid 2 to smithi08477944-20 2024-03-30T12:22:49.136 INFO:tasks.rados.rados.0.smithi084.stdout:204: finishing write tid 3 to smithi08477944-20 2024-03-30T12:22:49.136 INFO:tasks.rados.rados.0.smithi084.stdout:204: finishing write tid 4 to smithi08477944-20 2024-03-30T12:22:49.136 INFO:tasks.rados.rados.0.smithi084.stdout:204: finishing write tid 5 to smithi08477944-20 2024-03-30T12:22:49.136 INFO:tasks.rados.rados.0.smithi084.stdout:204: oid 20 updating version 0 to 50 2024-03-30T12:22:49.136 INFO:tasks.rados.rados.0.smithi084.stdout:204: oid 20 updating version 50 to 55 2024-03-30T12:22:49.137 INFO:tasks.rados.rados.0.smithi084.stdout:204: oid 20 version 55 is already newer than 53 2024-03-30T12:22:49.137 INFO:tasks.rados.rados.0.smithi084.stdout:204: oid 20 version 55 is already newer than 54 2024-03-30T12:22:49.137 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 55 (ObjNum 89 snap 21 seq_num 89) dirty exists 2024-03-30T12:22:49.137 INFO:tasks.rados.rados.0.smithi084.stdout:204: left oid 20 (ObjNum 89 snap 21 seq_num 89) 2024-03-30T12:22:49.137 INFO:tasks.rados.rados.0.smithi084.stdout:205: finishing copy_from racing read to smithi08477944-25 2024-03-30T12:22:49.137 INFO:tasks.rados.rados.0.smithi084.stdout:205: finishing copy_from to smithi08477944-25 2024-03-30T12:22:49.138 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 50 (ObjNum 83 snap 18 seq_num 83) dirty exists 2024-03-30T12:22:49.295 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:49 smithi084 ceph-mon[37565]: osdmap e105: 8 total, 8 up, 8 in 2024-03-30T12:22:49.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:49 smithi084 ceph-mon[27000]: osdmap e105: 8 total, 8 up, 8 in 2024-03-30T12:22:49.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:49 smithi162 ceph-mon[30421]: osdmap e105: 8 total, 8 up, 8 in 2024-03-30T12:22:49.561 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:22:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:22:49] "GET /metrics HTTP/1.1" 200 36004 "" "Prometheus/2.43.0" 2024-03-30T12:22:50.026 INFO:tasks.rados.rados.0.smithi084.stdout:204: done (2 left) 2024-03-30T12:22:50.026 INFO:tasks.rados.rados.0.smithi084.stdout:205: done (1 left) 2024-03-30T12:22:50.026 INFO:tasks.rados.rados.0.smithi084.stdout:206: done (0 left) 2024-03-30T12:22:50.026 INFO:tasks.rados.rados.0.smithi084.stdout:207: delete oid 31 current snap is 22 2024-03-30T12:22:50.029 INFO:tasks.rados.rados.0.smithi084.stdout:207: done (0 left) 2024-03-30T12:22:50.030 INFO:tasks.rados.rados.0.smithi084.stdout:208: delete oid 26 current snap is 22 2024-03-30T12:22:50.034 INFO:tasks.rados.rados.0.smithi084.stdout:208: done (0 left) 2024-03-30T12:22:50.034 INFO:tasks.rados.rados.0.smithi084.stdout:209: copy_from oid 20 from oid 42 current snap is 22 2024-03-30T12:22:50.035 INFO:tasks.rados.rados.0.smithi084.stdout:210: delete oid 5 current snap is 22 2024-03-30T12:22:50.035 INFO:tasks.rados.rados.0.smithi084.stdout:210: done (1 left) 2024-03-30T12:22:50.036 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 22 2024-03-30T12:22:50.036 INFO:tasks.rados.rados.0.smithi084.stdout:211: seq_num 93 ranges {204800=761856,966656=647168,1613824=155648} 2024-03-30T12:22:50.040 INFO:tasks.rados.rados.0.smithi084.stdout:211: writing smithi08477944-13 from 204800 to 966656 tid 1 2024-03-30T12:22:50.044 INFO:tasks.rados.rados.0.smithi084.stdout:211: writing smithi08477944-13 from 966656 to 1613824 tid 2 2024-03-30T12:22:50.046 INFO:tasks.rados.rados.0.smithi084.stdout:211: writing smithi08477944-13 from 1613824 to 1769472 tid 3 2024-03-30T12:22:50.046 INFO:tasks.rados.rados.0.smithi084.stdout:212: read oid 19 snap -1 2024-03-30T12:22:50.046 INFO:tasks.rados.rados.0.smithi084.stdout:212: expect (ObjNum 18 snap 0 seq_num 18) 2024-03-30T12:22:50.046 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 22 2024-03-30T12:22:50.046 INFO:tasks.rados.rados.0.smithi084.stdout:209: finishing copy_from racing read to smithi08477944-20 2024-03-30T12:22:50.046 INFO:tasks.rados.rados.0.smithi084.stdout:209: finishing copy_from to smithi08477944-20 2024-03-30T12:22:50.046 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 45 (ObjNum 75 snap 13 seq_num 75) dirty exists 2024-03-30T12:22:50.047 INFO:tasks.rados.rados.0.smithi084.stdout:211: finishing write tid 1 to smithi08477944-13 2024-03-30T12:22:50.047 INFO:tasks.rados.rados.0.smithi084.stdout:213: seq_num 94 ranges {1720320=778240,2498560=532480,3031040=270336} 2024-03-30T12:22:50.059 INFO:tasks.rados.rados.0.smithi084.stdout:213: writing smithi08477944-21 from 1720320 to 2498560 tid 1 2024-03-30T12:22:50.062 INFO:tasks.rados.rados.0.smithi084.stdout:213: writing smithi08477944-21 from 2498560 to 3031040 tid 2 2024-03-30T12:22:50.064 INFO:tasks.rados.rados.0.smithi084.stdout:213: writing smithi08477944-21 from 3031040 to 3301376 tid 3 2024-03-30T12:22:50.064 INFO:tasks.rados.rados.0.smithi084.stdout:209: done (3 left) 2024-03-30T12:22:50.064 INFO:tasks.rados.rados.0.smithi084.stdout:214: delete oid 11 current snap is 22 2024-03-30T12:22:50.064 INFO:tasks.rados.rados.0.smithi084.stdout:211: finishing write tid 2 to smithi08477944-13 2024-03-30T12:22:50.064 INFO:tasks.rados.rados.0.smithi084.stdout:211: finishing write tid 3 to smithi08477944-13 2024-03-30T12:22:50.065 INFO:tasks.rados.rados.0.smithi084.stdout:211: finishing write tid 4 to smithi08477944-13 2024-03-30T12:22:50.065 INFO:tasks.rados.rados.0.smithi084.stdout:211: finishing write tid 5 to smithi08477944-13 2024-03-30T12:22:50.065 INFO:tasks.rados.rados.0.smithi084.stdout:211: oid 13 updating version 0 to 8 2024-03-30T12:22:50.065 INFO:tasks.rados.rados.0.smithi084.stdout:211: oid 13 version 8 is already newer than 6 2024-03-30T12:22:50.065 INFO:tasks.rados.rados.0.smithi084.stdout:211: oid 13 updating version 8 to 9 2024-03-30T12:22:50.065 INFO:tasks.rados.rados.0.smithi084.stdout:211: oid 13 version 9 is already newer than 7 2024-03-30T12:22:50.065 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 9 (ObjNum 93 snap 22 seq_num 93) dirty exists 2024-03-30T12:22:50.065 INFO:tasks.rados.rados.0.smithi084.stdout:211: left oid 13 (ObjNum 93 snap 22 seq_num 93) 2024-03-30T12:22:50.065 INFO:tasks.rados.rados.0.smithi084.stdout:212: expect (ObjNum 18 snap 0 seq_num 18) 2024-03-30T12:22:50.073 INFO:tasks.rados.rados.0.smithi084.stdout:213: finishing write tid 1 to smithi08477944-21 2024-03-30T12:22:50.073 INFO:tasks.rados.rados.0.smithi084.stdout:213: finishing write tid 2 to smithi08477944-21 2024-03-30T12:22:50.073 INFO:tasks.rados.rados.0.smithi084.stdout:213: finishing write tid 3 to smithi08477944-21 2024-03-30T12:22:50.074 INFO:tasks.rados.rados.0.smithi084.stdout:213: finishing write tid 4 to smithi08477944-21 2024-03-30T12:22:50.074 INFO:tasks.rados.rados.0.smithi084.stdout:213: finishing write tid 5 to smithi08477944-21 2024-03-30T12:22:50.074 INFO:tasks.rados.rados.0.smithi084.stdout:213: oid 21 updating version 0 to 23 2024-03-30T12:22:50.074 INFO:tasks.rados.rados.0.smithi084.stdout:213: oid 21 updating version 23 to 25 2024-03-30T12:22:50.074 INFO:tasks.rados.rados.0.smithi084.stdout:213: oid 21 version 25 is already newer than 22 2024-03-30T12:22:50.074 INFO:tasks.rados.rados.0.smithi084.stdout:213: oid 21 version 25 is already newer than 24 2024-03-30T12:22:50.074 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 25 (ObjNum 94 snap 22 seq_num 94) dirty exists 2024-03-30T12:22:50.074 INFO:tasks.rados.rados.0.smithi084.stdout:213: left oid 21 (ObjNum 94 snap 22 seq_num 94) 2024-03-30T12:22:50.074 INFO:tasks.rados.rados.0.smithi084.stdout:211: done (3 left) 2024-03-30T12:22:50.074 INFO:tasks.rados.rados.0.smithi084.stdout:212: done (2 left) 2024-03-30T12:22:50.074 INFO:tasks.rados.rados.0.smithi084.stdout:213: done (1 left) 2024-03-30T12:22:50.074 INFO:tasks.rados.rados.0.smithi084.stdout:214: done (0 left) 2024-03-30T12:22:50.074 INFO:tasks.rados.rados.0.smithi084.stdout:215: read oid 38 snap -1 2024-03-30T12:22:50.074 INFO:tasks.rados.rados.0.smithi084.stdout:215: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-30T12:22:50.075 INFO:tasks.rados.rados.0.smithi084.stdout:216: rollback oid 45 current snap is 22 2024-03-30T12:22:50.075 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 45 to 10 2024-03-30T12:22:50.075 INFO:tasks.rados.rados.0.smithi084.stdout:217: read oid 36 snap -1 2024-03-30T12:22:50.075 INFO:tasks.rados.rados.0.smithi084.stdout:217: expect (ObjNum 35 snap 0 seq_num 35) 2024-03-30T12:22:50.075 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 22 2024-03-30T12:22:50.075 INFO:tasks.rados.rados.0.smithi084.stdout:218: seq_num 96 ranges {1236992=409600,1646592=696320,2342912=507904} 2024-03-30T12:22:50.082 INFO:tasks.rados.rados.0.smithi084.stdout:218: writing smithi08477944-15 from 1236992 to 1646592 tid 1 2024-03-30T12:22:50.086 INFO:tasks.rados.rados.0.smithi084.stdout:218: writing smithi08477944-15 from 1646592 to 2342912 tid 2 2024-03-30T12:22:50.089 INFO:tasks.rados.rados.0.smithi084.stdout:218: writing smithi08477944-15 from 2342912 to 2850816 tid 3 2024-03-30T12:22:50.090 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 22 2024-03-30T12:22:50.090 INFO:tasks.rados.rados.0.smithi084.stdout:219: seq_num 97 ranges {303104=434176,737280=581632,1318912=540672,1859584=81920} 2024-03-30T12:22:50.093 INFO:tasks.rados.rados.0.smithi084.stdout:219: writing smithi08477944-19 from 303104 to 737280 tid 1 2024-03-30T12:22:50.097 INFO:tasks.rados.rados.0.smithi084.stdout:219: writing smithi08477944-19 from 737280 to 1318912 tid 2 2024-03-30T12:22:50.100 INFO:tasks.rados.rados.0.smithi084.stdout:219: writing smithi08477944-19 from 1318912 to 1859584 tid 3 2024-03-30T12:22:50.101 INFO:tasks.rados.rados.0.smithi084.stdout:219: writing smithi08477944-19 from 1859584 to 1941504 tid 4 2024-03-30T12:22:50.101 INFO:tasks.rados.rados.0.smithi084.stdout:220: read oid 27 snap 15 2024-03-30T12:22:50.101 INFO:tasks.rados.rados.0.smithi084.stdout:220: expect (ObjNum 56 snap 4 seq_num 56) 2024-03-30T12:22:50.101 INFO:tasks.rados.rados.0.smithi084.stdout:221: read oid 20 snap -1 2024-03-30T12:22:50.101 INFO:tasks.rados.rados.0.smithi084.stdout:221: expect (ObjNum 75 snap 13 seq_num 75) 2024-03-30T12:22:50.101 INFO:tasks.rados.rados.0.smithi084.stdout:222: read oid 1 snap 20 2024-03-30T12:22:50.101 INFO:tasks.rados.rados.0.smithi084.stdout:222: expect deleted 2024-03-30T12:22:50.101 INFO:tasks.rados.rados.0.smithi084.stdout:223: snap_remove snap 18 2024-03-30T12:22:50.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:50 smithi162 ceph-mon[30421]: osdmap e106: 8 total, 8 up, 8 in 2024-03-30T12:22:50.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:50 smithi162 ceph-mon[30421]: pgmap v141: 121 pgs: 121 active+clean; 54 MiB data, 326 MiB used, 715 GiB / 715 GiB avail; 5.3 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2024-03-30T12:22:50.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:50 smithi162 ceph-mon[30421]: osdmap e107: 8 total, 8 up, 8 in 2024-03-30T12:22:50.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:50 smithi084 ceph-mon[37565]: osdmap e106: 8 total, 8 up, 8 in 2024-03-30T12:22:50.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:50 smithi084 ceph-mon[37565]: pgmap v141: 121 pgs: 121 active+clean; 54 MiB data, 326 MiB used, 715 GiB / 715 GiB avail; 5.3 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2024-03-30T12:22:50.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:50 smithi084 ceph-mon[37565]: osdmap e107: 8 total, 8 up, 8 in 2024-03-30T12:22:50.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:50 smithi084 ceph-mon[27000]: osdmap e106: 8 total, 8 up, 8 in 2024-03-30T12:22:50.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:50 smithi084 ceph-mon[27000]: pgmap v141: 121 pgs: 121 active+clean; 54 MiB data, 326 MiB used, 715 GiB / 715 GiB avail; 5.3 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2024-03-30T12:22:50.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:50 smithi084 ceph-mon[27000]: osdmap e107: 8 total, 8 up, 8 in 2024-03-30T12:22:51.064 INFO:tasks.rados.rados.0.smithi084.stdout:223: done (8 left) 2024-03-30T12:22:51.065 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 22 2024-03-30T12:22:51.065 INFO:tasks.rados.rados.0.smithi084.stdout:224: seq_num 98 ranges {57344=450560,507904=466944,974848=737280} 2024-03-30T12:22:51.068 INFO:tasks.rados.rados.0.smithi084.stdout:224: writing smithi08477944-4 from 57344 to 507904 tid 1 2024-03-30T12:22:51.071 INFO:tasks.rados.rados.0.smithi084.stdout:224: writing smithi08477944-4 from 507904 to 974848 tid 2 2024-03-30T12:22:51.077 INFO:tasks.rados.rados.0.smithi084.stdout:224: writing smithi08477944-4 from 974848 to 1712128 tid 3 2024-03-30T12:22:51.077 INFO:tasks.rados.rados.0.smithi084.stdout:225: read oid 48 snap -1 2024-03-30T12:22:51.077 INFO:tasks.rados.rados.0.smithi084.stdout:225: expect deleted 2024-03-30T12:22:51.077 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 22 2024-03-30T12:22:51.077 INFO:tasks.rados.rados.0.smithi084.stdout:217: expect (ObjNum 35 snap 0 seq_num 35) 2024-03-30T12:22:51.092 INFO:tasks.rados.rados.0.smithi084.stdout:215: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-30T12:22:51.114 INFO:tasks.rados.rados.0.smithi084.stdout:216: finishing rollback tid 0 to smithi08477944-45 2024-03-30T12:22:51.115 INFO:tasks.rados.rados.0.smithi084.stdout:216: finishing rollback tid 1 to smithi08477944-45 2024-03-30T12:22:51.115 INFO:tasks.rados.rados.0.smithi084.stdout:216: finishing rollback tid 2 to smithi08477944-45 2024-03-30T12:22:51.115 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 64 (ObjNum 44 snap 0 seq_num 44) dirty exists 2024-03-30T12:22:51.115 INFO:tasks.rados.rados.0.smithi084.stdout:218: finishing write tid 1 to smithi08477944-15 2024-03-30T12:22:51.115 INFO:tasks.rados.rados.0.smithi084.stdout:226: seq_num 99 ranges {0=466944,466944=802816,1269760=401408} 2024-03-30T12:22:51.117 INFO:tasks.rados.rados.0.smithi084.stdout:226: writing smithi08477944-34 from 0 to 466944 tid 1 2024-03-30T12:22:51.121 INFO:tasks.rados.rados.0.smithi084.stdout:226: writing smithi08477944-34 from 466944 to 1269760 tid 2 2024-03-30T12:22:51.125 INFO:tasks.rados.rados.0.smithi084.stdout:226: writing smithi08477944-34 from 1269760 to 1671168 tid 3 2024-03-30T12:22:51.125 INFO:tasks.rados.rados.0.smithi084.stdout:215: done (10 left) 2024-03-30T12:22:51.125 INFO:tasks.rados.rados.0.smithi084.stdout:216: done (9 left) 2024-03-30T12:22:51.125 INFO:tasks.rados.rados.0.smithi084.stdout:217: done (8 left) 2024-03-30T12:22:51.125 INFO:tasks.rados.rados.0.smithi084.stdout:227: setattr oid 21 current snap is 22 2024-03-30T12:22:51.125 INFO:tasks.rados.rados.0.smithi084.stdout:218: finishing write tid 2 to smithi08477944-15 2024-03-30T12:22:51.125 INFO:tasks.rados.rados.0.smithi084.stdout:218: finishing write tid 3 to smithi08477944-15 2024-03-30T12:22:51.125 INFO:tasks.rados.rados.0.smithi084.stdout:218: finishing write tid 4 to smithi08477944-15 2024-03-30T12:22:51.125 INFO:tasks.rados.rados.0.smithi084.stdout:218: finishing write tid 5 to smithi08477944-15 2024-03-30T12:22:51.125 INFO:tasks.rados.rados.0.smithi084.stdout:218: oid 15 updating version 0 to 65 2024-03-30T12:22:51.125 INFO:tasks.rados.rados.0.smithi084.stdout:218: oid 15 updating version 65 to 67 2024-03-30T12:22:51.126 INFO:tasks.rados.rados.0.smithi084.stdout:218: oid 15 updating version 67 to 68 2024-03-30T12:22:51.126 INFO:tasks.rados.rados.0.smithi084.stdout:218: oid 15 version 68 is already newer than 66 2024-03-30T12:22:51.126 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 68 (ObjNum 96 snap 22 seq_num 96) dirty exists 2024-03-30T12:22:51.126 INFO:tasks.rados.rados.0.smithi084.stdout:218: left oid 15 (ObjNum 96 snap 22 seq_num 96) 2024-03-30T12:22:51.126 INFO:tasks.rados.rados.0.smithi084.stdout:219: finishing write tid 1 to smithi08477944-19 2024-03-30T12:22:51.126 INFO:tasks.rados.rados.0.smithi084.stdout:219: finishing write tid 2 to smithi08477944-19 2024-03-30T12:22:51.126 INFO:tasks.rados.rados.0.smithi084.stdout:219: finishing write tid 3 to smithi08477944-19 2024-03-30T12:22:51.126 INFO:tasks.rados.rados.0.smithi084.stdout:219: finishing write tid 4 to smithi08477944-19 2024-03-30T12:22:51.126 INFO:tasks.rados.rados.0.smithi084.stdout:219: finishing write tid 5 to smithi08477944-19 2024-03-30T12:22:51.126 INFO:tasks.rados.rados.0.smithi084.stdout:221: expect (ObjNum 75 snap 13 seq_num 75) 2024-03-30T12:22:51.165 INFO:tasks.rados.rados.0.smithi084.stdout:219: finishing write tid 6 to smithi08477944-19 2024-03-30T12:22:51.165 INFO:tasks.rados.rados.0.smithi084.stdout:219: oid 19 updating version 0 to 44 2024-03-30T12:22:51.165 INFO:tasks.rados.rados.0.smithi084.stdout:219: oid 19 updating version 44 to 45 2024-03-30T12:22:51.165 INFO:tasks.rados.rados.0.smithi084.stdout:219: oid 19 updating version 45 to 46 2024-03-30T12:22:51.166 INFO:tasks.rados.rados.0.smithi084.stdout:219: oid 19 updating version 46 to 47 2024-03-30T12:22:51.166 INFO:tasks.rados.rados.0.smithi084.stdout:219: oid 19 version 47 is already newer than 43 2024-03-30T12:22:51.166 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 47 (ObjNum 97 snap 22 seq_num 97) dirty exists 2024-03-30T12:22:51.166 INFO:tasks.rados.rados.0.smithi084.stdout:219: left oid 19 (ObjNum 97 snap 22 seq_num 97) 2024-03-30T12:22:51.166 INFO:tasks.rados.rados.0.smithi084.stdout:220: expect (ObjNum 56 snap 4 seq_num 56) 2024-03-30T12:22:51.209 INFO:tasks.rados.rados.0.smithi084.stdout:224: finishing write tid 1 to smithi08477944-4 2024-03-30T12:22:51.209 INFO:tasks.rados.rados.0.smithi084.stdout:224: finishing write tid 2 to smithi08477944-4 2024-03-30T12:22:51.209 INFO:tasks.rados.rados.0.smithi084.stdout:224: finishing write tid 3 to smithi08477944-4 2024-03-30T12:22:51.209 INFO:tasks.rados.rados.0.smithi084.stdout:224: finishing write tid 4 to smithi08477944-4 2024-03-30T12:22:51.209 INFO:tasks.rados.rados.0.smithi084.stdout:224: finishing write tid 5 to smithi08477944-4 2024-03-30T12:22:51.209 INFO:tasks.rados.rados.0.smithi084.stdout:224: oid 4 updating version 0 to 65 2024-03-30T12:22:51.209 INFO:tasks.rados.rados.0.smithi084.stdout:224: oid 4 version 65 is already newer than 64 2024-03-30T12:22:51.209 INFO:tasks.rados.rados.0.smithi084.stdout:224: oid 4 version 65 is already newer than 63 2024-03-30T12:22:51.210 INFO:tasks.rados.rados.0.smithi084.stdout:224: oid 4 updating version 65 to 66 2024-03-30T12:22:51.210 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 66 (ObjNum 98 snap 22 seq_num 98) dirty exists 2024-03-30T12:22:51.210 INFO:tasks.rados.rados.0.smithi084.stdout:224: left oid 4 (ObjNum 98 snap 22 seq_num 98) 2024-03-30T12:22:51.210 INFO:tasks.rados.rados.0.smithi084.stdout:226: finishing write tid 1 to smithi08477944-34 2024-03-30T12:22:51.210 INFO:tasks.rados.rados.0.smithi084.stdout:226: finishing write tid 2 to smithi08477944-34 2024-03-30T12:22:51.210 INFO:tasks.rados.rados.0.smithi084.stdout:226: finishing write tid 3 to smithi08477944-34 2024-03-30T12:22:51.210 INFO:tasks.rados.rados.0.smithi084.stdout:226: finishing write tid 4 to smithi08477944-34 2024-03-30T12:22:51.210 INFO:tasks.rados.rados.0.smithi084.stdout:226: finishing write tid 5 to smithi08477944-34 2024-03-30T12:22:51.210 INFO:tasks.rados.rados.0.smithi084.stdout:226: oid 34 updating version 0 to 35 2024-03-30T12:22:51.210 INFO:tasks.rados.rados.0.smithi084.stdout:226: oid 34 version 35 is already newer than 34 2024-03-30T12:22:51.211 INFO:tasks.rados.rados.0.smithi084.stdout:226: oid 34 version 35 is already newer than 32 2024-03-30T12:22:51.211 INFO:tasks.rados.rados.0.smithi084.stdout:226: oid 34 version 35 is already newer than 33 2024-03-30T12:22:51.211 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 35 (ObjNum 99 snap 22 seq_num 99) dirty exists 2024-03-30T12:22:51.211 INFO:tasks.rados.rados.0.smithi084.stdout:226: left oid 34 (ObjNum 99 snap 22 seq_num 99) 2024-03-30T12:22:51.211 INFO:tasks.rados.rados.0.smithi084.stdout:218: done (8 left) 2024-03-30T12:22:51.211 INFO:tasks.rados.rados.0.smithi084.stdout:219: done (7 left) 2024-03-30T12:22:51.211 INFO:tasks.rados.rados.0.smithi084.stdout:220: done (6 left) 2024-03-30T12:22:51.211 INFO:tasks.rados.rados.0.smithi084.stdout:221: done (5 left) 2024-03-30T12:22:51.211 INFO:tasks.rados.rados.0.smithi084.stdout:222: done (4 left) 2024-03-30T12:22:51.211 INFO:tasks.rados.rados.0.smithi084.stdout:224: done (3 left) 2024-03-30T12:22:51.211 INFO:tasks.rados.rados.0.smithi084.stdout:225: done (2 left) 2024-03-30T12:22:51.211 INFO:tasks.rados.rados.0.smithi084.stdout:226: done (1 left) 2024-03-30T12:22:51.211 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 22 2024-03-30T12:22:51.211 INFO:tasks.rados.rados.0.smithi084.stdout:228: seq_num 100 ranges {1941504=483328,2424832=688128,3112960=516096} 2024-03-30T12:22:51.221 INFO:tasks.rados.rados.0.smithi084.stdout:228: writing smithi08477944-19 from 1941504 to 2424832 tid 1 2024-03-30T12:22:51.225 INFO:tasks.rados.rados.0.smithi084.stdout:228: writing smithi08477944-19 from 2424832 to 3112960 tid 2 2024-03-30T12:22:51.228 INFO:tasks.rados.rados.0.smithi084.stdout:228: writing smithi08477944-19 from 3112960 to 3629056 tid 3 2024-03-30T12:22:51.228 INFO:tasks.rados.rados.0.smithi084.stdout:229: read oid 1 snap 3 2024-03-30T12:22:51.228 INFO:tasks.rados.rados.0.smithi084.stdout:229: expect deleted 2024-03-30T12:22:51.228 INFO:tasks.rados.rados.0.smithi084.stdout:230: snap_remove snap 12 2024-03-30T12:22:51.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:51 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:22:51.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:51 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:22:51.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:51 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:22:52.069 INFO:tasks.rados.rados.0.smithi084.stdout:230: done (3 left) 2024-03-30T12:22:52.070 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 22 2024-03-30T12:22:52.070 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 28 (ObjNum 94 snap 22 seq_num 94) dirty exists 2024-03-30T12:22:52.070 INFO:tasks.rados.rados.0.smithi084.stdout:228: finishing write tid 1 to smithi08477944-19 2024-03-30T12:22:52.070 INFO:tasks.rados.rados.0.smithi084.stdout:228: finishing write tid 2 to smithi08477944-19 2024-03-30T12:22:52.071 INFO:tasks.rados.rados.0.smithi084.stdout:228: finishing write tid 3 to smithi08477944-19 2024-03-30T12:22:52.071 INFO:tasks.rados.rados.0.smithi084.stdout:228: finishing write tid 4 to smithi08477944-19 2024-03-30T12:22:52.071 INFO:tasks.rados.rados.0.smithi084.stdout:228: finishing write tid 5 to smithi08477944-19 2024-03-30T12:22:52.071 INFO:tasks.rados.rados.0.smithi084.stdout:228: oid 19 updating version 0 to 52 2024-03-30T12:22:52.071 INFO:tasks.rados.rados.0.smithi084.stdout:228: oid 19 updating version 52 to 53 2024-03-30T12:22:52.071 INFO:tasks.rados.rados.0.smithi084.stdout:228: oid 19 version 53 is already newer than 51 2024-03-30T12:22:52.071 INFO:tasks.rados.rados.0.smithi084.stdout:228: oid 19 version 53 is already newer than 50 2024-03-30T12:22:52.071 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 53 (ObjNum 100 snap 22 seq_num 100) dirty exists 2024-03-30T12:22:52.072 INFO:tasks.rados.rados.0.smithi084.stdout:228: left oid 19 (ObjNum 100 snap 22 seq_num 100) 2024-03-30T12:22:52.072 INFO:tasks.rados.rados.0.smithi084.stdout:231: seq_num 101 ranges {2899968=499712,3399680=573440,3973120=524288,4497408=106496} 2024-03-30T12:22:52.088 INFO:tasks.rados.rados.0.smithi084.stdout:231: writing smithi08477944-25 from 2899968 to 3399680 tid 1 2024-03-30T12:22:52.091 INFO:tasks.rados.rados.0.smithi084.stdout:231: writing smithi08477944-25 from 3399680 to 3973120 tid 2 2024-03-30T12:22:52.094 INFO:tasks.rados.rados.0.smithi084.stdout:231: writing smithi08477944-25 from 3973120 to 4497408 tid 3 2024-03-30T12:22:52.096 INFO:tasks.rados.rados.0.smithi084.stdout:231: writing smithi08477944-25 from 4497408 to 4603904 tid 4 2024-03-30T12:22:52.096 INFO:tasks.rados.rados.0.smithi084.stdout:227: done (3 left) 2024-03-30T12:22:52.096 INFO:tasks.rados.rados.0.smithi084.stdout:228: done (2 left) 2024-03-30T12:22:52.096 INFO:tasks.rados.rados.0.smithi084.stdout:229: done (1 left) 2024-03-30T12:22:52.096 INFO:tasks.rados.rados.0.smithi084.stdout:232: delete oid 40 current snap is 22 2024-03-30T12:22:52.096 INFO:tasks.rados.rados.0.smithi084.stdout:231: finishing write tid 1 to smithi08477944-25 2024-03-30T12:22:52.096 INFO:tasks.rados.rados.0.smithi084.stdout:231: finishing write tid 2 to smithi08477944-25 2024-03-30T12:22:52.097 INFO:tasks.rados.rados.0.smithi084.stdout:232: done (1 left) 2024-03-30T12:22:52.097 INFO:tasks.rados.rados.0.smithi084.stdout:233: read oid 47 snap -1 2024-03-30T12:22:52.097 INFO:tasks.rados.rados.0.smithi084.stdout:233: expect (ObjNum 46 snap 0 seq_num 46) 2024-03-30T12:22:52.097 INFO:tasks.rados.rados.0.smithi084.stdout:234: read oid 40 snap 7 2024-03-30T12:22:52.097 INFO:tasks.rados.rados.0.smithi084.stdout:234: expect (ObjNum 39 snap 0 seq_num 39) 2024-03-30T12:22:52.098 INFO:tasks.rados.rados.0.smithi084.stdout:235: setattr oid 27 current snap is 22 2024-03-30T12:22:52.098 INFO:tasks.rados.rados.0.smithi084.stdout:231: finishing write tid 3 to smithi08477944-25 2024-03-30T12:22:52.098 INFO:tasks.rados.rados.0.smithi084.stdout:231: finishing write tid 4 to smithi08477944-25 2024-03-30T12:22:52.099 INFO:tasks.rados.rados.0.smithi084.stdout:231: finishing write tid 5 to smithi08477944-25 2024-03-30T12:22:52.099 INFO:tasks.rados.rados.0.smithi084.stdout:236: rollback oid 14 current snap is 22 2024-03-30T12:22:52.100 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 14 to 15 2024-03-30T12:22:52.100 INFO:tasks.rados.rados.0.smithi084.stdout:237: delete oid 13 current snap is 22 2024-03-30T12:22:52.100 INFO:tasks.rados.rados.0.smithi084.stdout:231: finishing write tid 6 to smithi08477944-25 2024-03-30T12:22:52.100 INFO:tasks.rados.rados.0.smithi084.stdout:231: oid 25 updating version 0 to 56 2024-03-30T12:22:52.100 INFO:tasks.rados.rados.0.smithi084.stdout:231: oid 25 version 56 is already newer than 54 2024-03-30T12:22:52.100 INFO:tasks.rados.rados.0.smithi084.stdout:231: oid 25 version 56 is already newer than 53 2024-03-30T12:22:52.100 INFO:tasks.rados.rados.0.smithi084.stdout:231: oid 25 version 56 is already newer than 55 2024-03-30T12:22:52.100 INFO:tasks.rados.rados.0.smithi084.stdout:231: oid 25 updating version 56 to 57 2024-03-30T12:22:52.101 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 57 (ObjNum 101 snap 22 seq_num 101) dirty exists 2024-03-30T12:22:52.101 INFO:tasks.rados.rados.0.smithi084.stdout:231: left oid 25 (ObjNum 101 snap 22 seq_num 101) 2024-03-30T12:22:52.101 INFO:tasks.rados.rados.0.smithi084.stdout:233: expect (ObjNum 46 snap 0 seq_num 46) 2024-03-30T12:22:52.122 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 37 (ObjNum 56 snap 4 seq_num 56) dirty exists 2024-03-30T12:22:52.123 INFO:tasks.rados.rados.0.smithi084.stdout:236: finishing rollback tid 0 to smithi08477944-14 2024-03-30T12:22:52.123 INFO:tasks.rados.rados.0.smithi084.stdout:236: finishing rollback tid 1 to smithi08477944-14 2024-03-30T12:22:52.123 INFO:tasks.rados.rados.0.smithi084.stdout:236: finishing rollback tid 2 to smithi08477944-14 2024-03-30T12:22:52.123 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 64 (ObjNum 40 snap 0 seq_num 40) dirty exists 2024-03-30T12:22:52.123 INFO:tasks.rados.rados.0.smithi084.stdout:234: expect (ObjNum 39 snap 0 seq_num 39) 2024-03-30T12:22:52.140 INFO:tasks.rados.rados.0.smithi084.stdout:231: done (5 left) 2024-03-30T12:22:52.140 INFO:tasks.rados.rados.0.smithi084.stdout:233: done (4 left) 2024-03-30T12:22:52.140 INFO:tasks.rados.rados.0.smithi084.stdout:234: done (3 left) 2024-03-30T12:22:52.141 INFO:tasks.rados.rados.0.smithi084.stdout:235: done (2 left) 2024-03-30T12:22:52.141 INFO:tasks.rados.rados.0.smithi084.stdout:236: done (1 left) 2024-03-30T12:22:52.141 INFO:tasks.rados.rados.0.smithi084.stdout:237: done (0 left) 2024-03-30T12:22:52.141 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 22 2024-03-30T12:22:52.141 INFO:tasks.rados.rados.0.smithi084.stdout:238: seq_num 104 ranges {0=548864,548864=622592,1171456=581632} 2024-03-30T12:22:52.142 INFO:tasks.rados.rados.0.smithi084.stdout:238: writing smithi08477944-26 from 0 to 548864 tid 1 2024-03-30T12:22:52.146 INFO:tasks.rados.rados.0.smithi084.stdout:238: writing smithi08477944-26 from 548864 to 1171456 tid 2 2024-03-30T12:22:52.149 INFO:tasks.rados.rados.0.smithi084.stdout:238: writing smithi08477944-26 from 1171456 to 1753088 tid 3 2024-03-30T12:22:52.149 INFO:tasks.rados.rados.0.smithi084.stdout:239: setattr oid 47 current snap is 22 2024-03-30T12:22:52.150 INFO:tasks.rados.rados.0.smithi084.stdout:238: finishing write tid 1 to smithi08477944-26 2024-03-30T12:22:52.151 INFO:tasks.rados.rados.0.smithi084.stdout:240: setattr oid 30 current snap is 22 2024-03-30T12:22:52.151 INFO:tasks.rados.rados.0.smithi084.stdout:238: finishing write tid 2 to smithi08477944-26 2024-03-30T12:22:52.152 INFO:tasks.rados.rados.0.smithi084.stdout:238: finishing write tid 3 to smithi08477944-26 2024-03-30T12:22:52.153 INFO:tasks.rados.rados.0.smithi084.stdout:238: finishing write tid 4 to smithi08477944-26 2024-03-30T12:22:52.154 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 67 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-03-30T12:22:52.154 INFO:tasks.rados.rados.0.smithi084.stdout:239: done (2 left) 2024-03-30T12:22:52.154 INFO:tasks.rados.rados.0.smithi084.stdout:241: snap_remove snap 3 2024-03-30T12:22:52.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:52 smithi162 ceph-mon[30421]: osdmap e108: 8 total, 8 up, 8 in 2024-03-30T12:22:52.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:52 smithi162 ceph-mon[30421]: pgmap v144: 121 pgs: 121 active+clean; 76 MiB data, 357 MiB used, 715 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 35 op/s 2024-03-30T12:22:52.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:52 smithi084 ceph-mon[37565]: osdmap e108: 8 total, 8 up, 8 in 2024-03-30T12:22:52.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:52 smithi084 ceph-mon[37565]: pgmap v144: 121 pgs: 121 active+clean; 76 MiB data, 357 MiB used, 715 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 35 op/s 2024-03-30T12:22:52.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:52 smithi084 ceph-mon[27000]: osdmap e108: 8 total, 8 up, 8 in 2024-03-30T12:22:52.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:52 smithi084 ceph-mon[27000]: pgmap v144: 121 pgs: 121 active+clean; 76 MiB data, 357 MiB used, 715 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 35 op/s 2024-03-30T12:22:53.071 INFO:tasks.rados.rados.0.smithi084.stdout:241: done (2 left) 2024-03-30T12:22:53.071 INFO:tasks.rados.rados.0.smithi084.stdout:242: read oid 46 snap -1 2024-03-30T12:22:53.072 INFO:tasks.rados.rados.0.smithi084.stdout:242: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-30T12:22:53.072 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 22 2024-03-30T12:22:53.072 INFO:tasks.rados.rados.0.smithi084.stdout:243: seq_num 105 ranges {0=565248,565248=507904,1073152=507904,1581056=188416} 2024-03-30T12:22:53.075 INFO:tasks.rados.rados.0.smithi084.stdout:243: writing smithi08477944-44 from 0 to 565248 tid 1 2024-03-30T12:22:53.079 INFO:tasks.rados.rados.0.smithi084.stdout:243: writing smithi08477944-44 from 565248 to 1073152 tid 2 2024-03-30T12:22:53.083 INFO:tasks.rados.rados.0.smithi084.stdout:243: writing smithi08477944-44 from 1073152 to 1581056 tid 3 2024-03-30T12:22:53.085 INFO:tasks.rados.rados.0.smithi084.stdout:243: writing smithi08477944-44 from 1581056 to 1769472 tid 4 2024-03-30T12:22:53.086 INFO:tasks.rados.rados.0.smithi084.stdout:238: finishing write tid 5 to smithi08477944-26 2024-03-30T12:22:53.086 INFO:tasks.rados.rados.0.smithi084.stdout:238: oid 26 updating version 0 to 93 2024-03-30T12:22:53.086 INFO:tasks.rados.rados.0.smithi084.stdout:238: oid 26 updating version 93 to 94 2024-03-30T12:22:53.086 INFO:tasks.rados.rados.0.smithi084.stdout:238: oid 26 version 94 is already newer than 91 2024-03-30T12:22:53.086 INFO:tasks.rados.rados.0.smithi084.stdout:238: oid 26 version 94 is already newer than 92 2024-03-30T12:22:53.086 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 94 (ObjNum 104 snap 22 seq_num 104) dirty exists 2024-03-30T12:22:53.086 INFO:tasks.rados.rados.0.smithi084.stdout:238: left oid 26 (ObjNum 104 snap 22 seq_num 104) 2024-03-30T12:22:53.086 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 38 (ObjNum 29 snap 0 seq_num 29) dirty exists 2024-03-30T12:22:53.086 INFO:tasks.rados.rados.0.smithi084.stdout:243: finishing write tid 1 to smithi08477944-44 2024-03-30T12:22:53.086 INFO:tasks.rados.rados.0.smithi084.stdout:238: done (3 left) 2024-03-30T12:22:53.086 INFO:tasks.rados.rados.0.smithi084.stdout:240: done (2 left) 2024-03-30T12:22:53.087 INFO:tasks.rados.rados.0.smithi084.stdout:244: read oid 12 snap 20 2024-03-30T12:22:53.087 INFO:tasks.rados.rados.0.smithi084.stdout:244: expect (ObjNum 70 snap 8 seq_num 70) 2024-03-30T12:22:53.087 INFO:tasks.rados.rados.0.smithi084.stdout:245: rmattr oid 32 current snap is 22 2024-03-30T12:22:53.087 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 42 current snap is 22 2024-03-30T12:22:53.087 INFO:tasks.rados.rados.0.smithi084.stdout:246: seq_num 106 ranges {1449984=581632,2031616=794624,2826240=409600} 2024-03-30T12:22:53.098 INFO:tasks.rados.rados.0.smithi084.stdout:246: writing smithi08477944-42 from 1449984 to 2031616 tid 1 2024-03-30T12:22:53.102 INFO:tasks.rados.rados.0.smithi084.stdout:246: writing smithi08477944-42 from 2031616 to 2826240 tid 2 2024-03-30T12:22:53.105 INFO:tasks.rados.rados.0.smithi084.stdout:246: writing smithi08477944-42 from 2826240 to 3235840 tid 3 2024-03-30T12:22:53.105 INFO:tasks.rados.rados.0.smithi084.stdout:247: read oid 9 snap -1 2024-03-30T12:22:53.105 INFO:tasks.rados.rados.0.smithi084.stdout:247: expect (ObjNum 87 snap 21 seq_num 87) 2024-03-30T12:22:53.105 INFO:tasks.rados.rados.0.smithi084.stdout:248: read oid 24 snap 14 2024-03-30T12:22:53.105 INFO:tasks.rados.rados.0.smithi084.stdout:248: expect (ObjNum 23 snap 0 seq_num 23) 2024-03-30T12:22:53.106 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 22 2024-03-30T12:22:53.106 INFO:tasks.rados.rados.0.smithi084.stdout:249: seq_num 107 ranges {0=598016,598016=729088,1327104=466944,1794048=8192} 2024-03-30T12:22:53.109 INFO:tasks.rados.rados.0.smithi084.stdout:249: writing smithi08477944-11 from 0 to 598016 tid 1 2024-03-30T12:22:53.113 INFO:tasks.rados.rados.0.smithi084.stdout:249: writing smithi08477944-11 from 598016 to 1327104 tid 2 2024-03-30T12:22:53.116 INFO:tasks.rados.rados.0.smithi084.stdout:249: writing smithi08477944-11 from 1327104 to 1794048 tid 3 2024-03-30T12:22:53.116 INFO:tasks.rados.rados.0.smithi084.stdout:249: writing smithi08477944-11 from 1794048 to 1802240 tid 4 2024-03-30T12:22:53.117 INFO:tasks.rados.rados.0.smithi084.stdout:250: snap_remove snap 7 2024-03-30T12:22:53.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:53 smithi162 ceph-mon[30421]: osdmap e109: 8 total, 8 up, 8 in 2024-03-30T12:22:53.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:53 smithi084 ceph-mon[37565]: osdmap e109: 8 total, 8 up, 8 in 2024-03-30T12:22:53.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:53 smithi084 ceph-mon[27000]: osdmap e109: 8 total, 8 up, 8 in 2024-03-30T12:22:54.079 INFO:tasks.rados.rados.0.smithi084.stdout:250: done (8 left) 2024-03-30T12:22:54.079 INFO:tasks.rados.rados.0.smithi084.stdout:251: copy_from oid 40 from oid 50 current snap is 22 2024-03-30T12:22:54.080 INFO:tasks.rados.rados.0.smithi084.stdout:242: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-30T12:22:54.110 INFO:tasks.rados.rados.0.smithi084.stdout:243: finishing write tid 2 to smithi08477944-44 2024-03-30T12:22:54.110 INFO:tasks.rados.rados.0.smithi084.stdout:243: finishing write tid 3 to smithi08477944-44 2024-03-30T12:22:54.110 INFO:tasks.rados.rados.0.smithi084.stdout:243: finishing write tid 4 to smithi08477944-44 2024-03-30T12:22:54.110 INFO:tasks.rados.rados.0.smithi084.stdout:242: done (8 left) 2024-03-30T12:22:54.110 INFO:tasks.rados.rados.0.smithi084.stdout:252: rollback oid 49 current snap is 22 2024-03-30T12:22:54.110 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 49 to 20 2024-03-30T12:22:54.110 INFO:tasks.rados.rados.0.smithi084.stdout:243: finishing write tid 5 to smithi08477944-44 2024-03-30T12:22:54.110 INFO:tasks.rados.rados.0.smithi084.stdout:244: expect (ObjNum 70 snap 8 seq_num 70) 2024-03-30T12:22:54.142 INFO:tasks.rados.rados.0.smithi084.stdout:243: finishing write tid 6 to smithi08477944-44 2024-03-30T12:22:54.142 INFO:tasks.rados.rados.0.smithi084.stdout:243: oid 44 updating version 0 to 63 2024-03-30T12:22:54.142 INFO:tasks.rados.rados.0.smithi084.stdout:243: oid 44 updating version 63 to 64 2024-03-30T12:22:54.143 INFO:tasks.rados.rados.0.smithi084.stdout:243: oid 44 version 64 is already newer than 62 2024-03-30T12:22:54.143 INFO:tasks.rados.rados.0.smithi084.stdout:243: oid 44 updating version 64 to 65 2024-03-30T12:22:54.143 INFO:tasks.rados.rados.0.smithi084.stdout:243: oid 44 updating version 65 to 66 2024-03-30T12:22:54.143 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 66 (ObjNum 105 snap 22 seq_num 105) dirty exists 2024-03-30T12:22:54.143 INFO:tasks.rados.rados.0.smithi084.stdout:243: left oid 44 (ObjNum 105 snap 22 seq_num 105) 2024-03-30T12:22:54.143 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 77 (ObjNum 81 snap 16 seq_num 81) dirty exists 2024-03-30T12:22:54.143 INFO:tasks.rados.rados.0.smithi084.stdout:246: finishing write tid 1 to smithi08477944-42 2024-03-30T12:22:54.143 INFO:tasks.rados.rados.0.smithi084.stdout:243: done (8 left) 2024-03-30T12:22:54.143 INFO:tasks.rados.rados.0.smithi084.stdout:244: done (7 left) 2024-03-30T12:22:54.143 INFO:tasks.rados.rados.0.smithi084.stdout:245: done (6 left) 2024-03-30T12:22:54.143 INFO:tasks.rados.rados.0.smithi084.stdout:253: rollback oid 21 current snap is 22 2024-03-30T12:22:54.143 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 21 to 10 2024-03-30T12:22:54.143 INFO:tasks.rados.rados.0.smithi084.stdout:246: finishing write tid 2 to smithi08477944-42 2024-03-30T12:22:54.143 INFO:tasks.rados.rados.0.smithi084.stdout:246: finishing write tid 3 to smithi08477944-42 2024-03-30T12:22:54.144 INFO:tasks.rados.rados.0.smithi084.stdout:246: finishing write tid 4 to smithi08477944-42 2024-03-30T12:22:54.144 INFO:tasks.rados.rados.0.smithi084.stdout:246: finishing write tid 5 to smithi08477944-42 2024-03-30T12:22:54.144 INFO:tasks.rados.rados.0.smithi084.stdout:246: oid 42 updating version 0 to 83 2024-03-30T12:22:54.144 INFO:tasks.rados.rados.0.smithi084.stdout:246: oid 42 updating version 83 to 85 2024-03-30T12:22:54.144 INFO:tasks.rados.rados.0.smithi084.stdout:246: oid 42 version 85 is already newer than 82 2024-03-30T12:22:54.145 INFO:tasks.rados.rados.0.smithi084.stdout:246: oid 42 version 85 is already newer than 84 2024-03-30T12:22:54.145 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 85 (ObjNum 106 snap 22 seq_num 106) dirty exists 2024-03-30T12:22:54.145 INFO:tasks.rados.rados.0.smithi084.stdout:246: left oid 42 (ObjNum 106 snap 22 seq_num 106) 2024-03-30T12:22:54.145 INFO:tasks.rados.rados.0.smithi084.stdout:248: expect (ObjNum 23 snap 0 seq_num 23) 2024-03-30T12:22:54.152 INFO:tasks.rados.rados.0.smithi084.stdout:249: finishing write tid 1 to smithi08477944-11 2024-03-30T12:22:54.152 INFO:tasks.rados.rados.0.smithi084.stdout:247: expect (ObjNum 87 snap 21 seq_num 87) 2024-03-30T12:22:54.248 INFO:tasks.rados.rados.0.smithi084.stdout:249: finishing write tid 2 to smithi08477944-11 2024-03-30T12:22:54.248 INFO:tasks.rados.rados.0.smithi084.stdout:249: finishing write tid 3 to smithi08477944-11 2024-03-30T12:22:54.248 INFO:tasks.rados.rados.0.smithi084.stdout:249: finishing write tid 4 to smithi08477944-11 2024-03-30T12:22:54.248 INFO:tasks.rados.rados.0.smithi084.stdout:249: finishing write tid 5 to smithi08477944-11 2024-03-30T12:22:54.248 INFO:tasks.rados.rados.0.smithi084.stdout:249: finishing write tid 6 to smithi08477944-11 2024-03-30T12:22:54.248 INFO:tasks.rados.rados.0.smithi084.stdout:249: oid 11 updating version 0 to 61 2024-03-30T12:22:54.248 INFO:tasks.rados.rados.0.smithi084.stdout:249: oid 11 version 61 is already newer than 58 2024-03-30T12:22:54.248 INFO:tasks.rados.rados.0.smithi084.stdout:249: oid 11 version 61 is already newer than 60 2024-03-30T12:22:54.249 INFO:tasks.rados.rados.0.smithi084.stdout:249: oid 11 version 61 is already newer than 59 2024-03-30T12:22:54.249 INFO:tasks.rados.rados.0.smithi084.stdout:249: oid 11 updating version 61 to 62 2024-03-30T12:22:54.249 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 62 (ObjNum 107 snap 22 seq_num 107) dirty exists 2024-03-30T12:22:54.249 INFO:tasks.rados.rados.0.smithi084.stdout:249: left oid 11 (ObjNum 107 snap 22 seq_num 107) 2024-03-30T12:22:54.249 INFO:tasks.rados.rados.0.smithi084.stdout:246: done (6 left) 2024-03-30T12:22:54.249 INFO:tasks.rados.rados.0.smithi084.stdout:247: done (5 left) 2024-03-30T12:22:54.249 INFO:tasks.rados.rados.0.smithi084.stdout:248: done (4 left) 2024-03-30T12:22:54.249 INFO:tasks.rados.rados.0.smithi084.stdout:249: done (3 left) 2024-03-30T12:22:54.249 INFO:tasks.rados.rados.0.smithi084.stdout:254: rmattr oid 2 current snap is 22 2024-03-30T12:22:54.249 INFO:tasks.rados.rados.0.smithi084.stdout:254: done (3 left) 2024-03-30T12:22:54.249 INFO:tasks.rados.rados.0.smithi084.stdout:255: rollback oid 13 current snap is 22 2024-03-30T12:22:54.249 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 13 to 14 2024-03-30T12:22:54.249 INFO:tasks.rados.rados.0.smithi084.stdout:251: finishing copy_from racing read to smithi08477944-40 2024-03-30T12:22:54.250 INFO:tasks.rados.rados.0.smithi084.stdout:251: finishing copy_from to smithi08477944-40 2024-03-30T12:22:54.250 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 11 (ObjNum 49 snap 0 seq_num 49) dirty exists 2024-03-30T12:22:54.250 INFO:tasks.rados.rados.0.smithi084.stdout:252: finishing rollback tid 0 to smithi08477944-49 2024-03-30T12:22:54.250 INFO:tasks.rados.rados.0.smithi084.stdout:252: finishing rollback tid 1 to smithi08477944-49 2024-03-30T12:22:54.250 INFO:tasks.rados.rados.0.smithi084.stdout:252: finishing rollback tid 2 to smithi08477944-49 2024-03-30T12:22:54.250 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 83 (ObjNum 59 snap 5 seq_num 59) dirty exists 2024-03-30T12:22:54.250 INFO:tasks.rados.rados.0.smithi084.stdout:253: finishing rollback tid 0 to smithi08477944-21 2024-03-30T12:22:54.250 INFO:tasks.rados.rados.0.smithi084.stdout:253: finishing rollback tid 1 to smithi08477944-21 2024-03-30T12:22:54.250 INFO:tasks.rados.rados.0.smithi084.stdout:253: finishing rollback tid 2 to smithi08477944-21 2024-03-30T12:22:54.250 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 37 (ObjNum 65 snap 6 seq_num 65) dirty exists 2024-03-30T12:22:54.250 INFO:tasks.rados.rados.0.smithi084.stdout:251: done (3 left) 2024-03-30T12:22:54.250 INFO:tasks.rados.rados.0.smithi084.stdout:252: done (2 left) 2024-03-30T12:22:54.250 INFO:tasks.rados.rados.0.smithi084.stdout:253: done (1 left) 2024-03-30T12:22:54.251 INFO:tasks.rados.rados.0.smithi084.stdout:256: rmattr oid 47 current snap is 22 2024-03-30T12:22:54.251 INFO:tasks.rados.rados.0.smithi084.stdout:257: copy_from oid 35 from oid 28 current snap is 22 2024-03-30T12:22:54.251 INFO:tasks.rados.rados.0.smithi084.stdout:258: rollback oid 39 current snap is 22 2024-03-30T12:22:54.251 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 39 to 14 2024-03-30T12:22:54.251 INFO:tasks.rados.rados.0.smithi084.stdout:259: snap_remove snap 21 2024-03-30T12:22:54.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:54 smithi162 ceph-mon[30421]: osdmap e110: 8 total, 8 up, 8 in 2024-03-30T12:22:54.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:54 smithi162 ceph-mon[30421]: pgmap v147: 121 pgs: 121 active+clean; 76 MiB data, 357 MiB used, 715 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 35 op/s 2024-03-30T12:22:54.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:54 smithi084 ceph-mon[37565]: osdmap e110: 8 total, 8 up, 8 in 2024-03-30T12:22:54.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:54 smithi084 ceph-mon[37565]: pgmap v147: 121 pgs: 121 active+clean; 76 MiB data, 357 MiB used, 715 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 35 op/s 2024-03-30T12:22:54.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:54 smithi084 ceph-mon[27000]: osdmap e110: 8 total, 8 up, 8 in 2024-03-30T12:22:54.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:54 smithi084 ceph-mon[27000]: pgmap v147: 121 pgs: 121 active+clean; 76 MiB data, 357 MiB used, 715 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 35 op/s 2024-03-30T12:22:55.024 INFO:tasks.rados.rados.0.smithi084.stdout:255: finishing rollback tid 1 to smithi08477944-13 2024-03-30T12:22:55.024 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 85 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-03-30T12:22:55.024 INFO:tasks.rados.rados.0.smithi084.stdout:255: finishing rollback tid 2 to smithi08477944-13 2024-03-30T12:22:55.024 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 20 (ObjNum 12 snap 0 seq_num 12) dirty exists 2024-03-30T12:22:55.024 INFO:tasks.rados.rados.0.smithi084.stdout:258: finishing rollback tid 0 to smithi08477944-39 2024-03-30T12:22:55.024 INFO:tasks.rados.rados.0.smithi084.stdout:258: finishing rollback tid 1 to smithi08477944-39 2024-03-30T12:22:55.024 INFO:tasks.rados.rados.0.smithi084.stdout:258: finishing rollback tid 2 to smithi08477944-39 2024-03-30T12:22:55.024 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 93 (ObjNum 57 snap 4 seq_num 57) dirty exists 2024-03-30T12:22:55.024 INFO:tasks.rados.rados.0.smithi084.stdout:257: finishing copy_from racing read to smithi08477944-35 2024-03-30T12:22:55.024 INFO:tasks.rados.rados.0.smithi084.stdout:257: finishing copy_from to smithi08477944-35 2024-03-30T12:22:55.024 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 13 (ObjNum 27 snap 0 seq_num 27) dirty exists 2024-03-30T12:22:55.024 INFO:tasks.rados.rados.0.smithi084.stdout:255: done (4 left) 2024-03-30T12:22:55.025 INFO:tasks.rados.rados.0.smithi084.stdout:256: done (3 left) 2024-03-30T12:22:55.025 INFO:tasks.rados.rados.0.smithi084.stdout:257: done (2 left) 2024-03-30T12:22:55.025 INFO:tasks.rados.rados.0.smithi084.stdout:258: done (1 left) 2024-03-30T12:22:55.025 INFO:tasks.rados.rados.0.smithi084.stdout:259: done (0 left) 2024-03-30T12:22:55.025 INFO:tasks.rados.rados.0.smithi084.stdout:260: snap_create 2024-03-30T12:22:55.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:55 smithi162 ceph-mon[30421]: osdmap e111: 8 total, 8 up, 8 in 2024-03-30T12:22:55.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:55 smithi162 ceph-mon[30421]: osdmap e112: 8 total, 8 up, 8 in 2024-03-30T12:22:55.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:55 smithi084 ceph-mon[37565]: osdmap e111: 8 total, 8 up, 8 in 2024-03-30T12:22:55.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:55 smithi084 ceph-mon[37565]: osdmap e112: 8 total, 8 up, 8 in 2024-03-30T12:22:55.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:55 smithi084 ceph-mon[27000]: osdmap e111: 8 total, 8 up, 8 in 2024-03-30T12:22:55.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:55 smithi084 ceph-mon[27000]: osdmap e112: 8 total, 8 up, 8 in 2024-03-30T12:22:56.032 INFO:tasks.rados.rados.0.smithi084.stdout:260: done (0 left) 2024-03-30T12:22:56.033 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 23 2024-03-30T12:22:56.033 INFO:tasks.rados.rados.0.smithi084.stdout:261: seq_num 108 ranges {1572864=614400,2187264=606208,2793472=598016} 2024-03-30T12:22:56.043 INFO:tasks.rados.rados.0.smithi084.stdout:261: writing smithi08477944-16 from 1572864 to 2187264 tid 1 2024-03-30T12:22:56.047 INFO:tasks.rados.rados.0.smithi084.stdout:261: writing smithi08477944-16 from 2187264 to 2793472 tid 2 2024-03-30T12:22:56.051 INFO:tasks.rados.rados.0.smithi084.stdout:261: writing smithi08477944-16 from 2793472 to 3391488 tid 3 2024-03-30T12:22:56.051 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 23 2024-03-30T12:22:56.051 INFO:tasks.rados.rados.0.smithi084.stdout:261: finishing write tid 1 to smithi08477944-16 2024-03-30T12:22:56.051 INFO:tasks.rados.rados.0.smithi084.stdout:261: finishing write tid 2 to smithi08477944-16 2024-03-30T12:22:56.051 INFO:tasks.rados.rados.0.smithi084.stdout:262: seq_num 109 ranges {286720=630784,917504=491520,1409024=483328,1892352=229376} 2024-03-30T12:22:56.056 INFO:tasks.rados.rados.0.smithi084.stdout:262: writing smithi08477944-18 from 286720 to 917504 tid 1 2024-03-30T12:22:56.059 INFO:tasks.rados.rados.0.smithi084.stdout:262: writing smithi08477944-18 from 917504 to 1409024 tid 2 2024-03-30T12:22:56.061 INFO:tasks.rados.rados.0.smithi084.stdout:262: writing smithi08477944-18 from 1409024 to 1892352 tid 3 2024-03-30T12:22:56.063 INFO:tasks.rados.rados.0.smithi084.stdout:262: writing smithi08477944-18 from 1892352 to 2121728 tid 4 2024-03-30T12:22:56.063 INFO:tasks.rados.rados.0.smithi084.stdout:263: setattr oid 45 current snap is 23 2024-03-30T12:22:56.063 INFO:tasks.rados.rados.0.smithi084.stdout:261: finishing write tid 3 to smithi08477944-16 2024-03-30T12:22:56.063 INFO:tasks.rados.rados.0.smithi084.stdout:261: finishing write tid 4 to smithi08477944-16 2024-03-30T12:22:56.063 INFO:tasks.rados.rados.0.smithi084.stdout:261: finishing write tid 5 to smithi08477944-16 2024-03-30T12:22:56.063 INFO:tasks.rados.rados.0.smithi084.stdout:261: oid 16 updating version 0 to 90 2024-03-30T12:22:56.063 INFO:tasks.rados.rados.0.smithi084.stdout:261: oid 16 updating version 90 to 91 2024-03-30T12:22:56.064 INFO:tasks.rados.rados.0.smithi084.stdout:261: oid 16 version 91 is already newer than 89 2024-03-30T12:22:56.064 INFO:tasks.rados.rados.0.smithi084.stdout:261: oid 16 version 91 is already newer than 88 2024-03-30T12:22:56.064 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 91 (ObjNum 108 snap 23 seq_num 108) dirty exists 2024-03-30T12:22:56.064 INFO:tasks.rados.rados.0.smithi084.stdout:261: left oid 16 (ObjNum 108 snap 23 seq_num 108) 2024-03-30T12:22:56.064 INFO:tasks.rados.rados.0.smithi084.stdout:262: finishing write tid 1 to smithi08477944-18 2024-03-30T12:22:56.064 INFO:tasks.rados.rados.0.smithi084.stdout:262: finishing write tid 2 to smithi08477944-18 2024-03-30T12:22:56.064 INFO:tasks.rados.rados.0.smithi084.stdout:261: done (2 left) 2024-03-30T12:22:56.064 INFO:tasks.rados.rados.0.smithi084.stdout:264: snap_remove snap 17 2024-03-30T12:22:56.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:56 smithi162 ceph-mon[30421]: pgmap v150: 121 pgs: 121 active+clean; 76 MiB data, 357 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:56.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:56 smithi162 ceph-mon[30421]: osdmap e113: 8 total, 8 up, 8 in 2024-03-30T12:22:56.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:56 smithi084 ceph-mon[37565]: pgmap v150: 121 pgs: 121 active+clean; 76 MiB data, 357 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:56.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:56 smithi084 ceph-mon[37565]: osdmap e113: 8 total, 8 up, 8 in 2024-03-30T12:22:56.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:56 smithi084 ceph-mon[27000]: pgmap v150: 121 pgs: 121 active+clean; 76 MiB data, 357 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:22:56.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:56 smithi084 ceph-mon[27000]: osdmap e113: 8 total, 8 up, 8 in 2024-03-30T12:22:57.033 INFO:tasks.rados.rados.0.smithi084.stdout:262: finishing write tid 3 to smithi08477944-18 2024-03-30T12:22:57.033 INFO:tasks.rados.rados.0.smithi084.stdout:262: finishing write tid 4 to smithi08477944-18 2024-03-30T12:22:57.033 INFO:tasks.rados.rados.0.smithi084.stdout:262: finishing write tid 5 to smithi08477944-18 2024-03-30T12:22:57.033 INFO:tasks.rados.rados.0.smithi084.stdout:262: finishing write tid 6 to smithi08477944-18 2024-03-30T12:22:57.033 INFO:tasks.rados.rados.0.smithi084.stdout:262: oid 18 updating version 0 to 97 2024-03-30T12:22:57.033 INFO:tasks.rados.rados.0.smithi084.stdout:262: oid 18 version 97 is already newer than 93 2024-03-30T12:22:57.033 INFO:tasks.rados.rados.0.smithi084.stdout:262: oid 18 version 97 is already newer than 95 2024-03-30T12:22:57.033 INFO:tasks.rados.rados.0.smithi084.stdout:262: oid 18 version 97 is already newer than 94 2024-03-30T12:22:57.033 INFO:tasks.rados.rados.0.smithi084.stdout:262: oid 18 version 97 is already newer than 96 2024-03-30T12:22:57.033 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 97 (ObjNum 109 snap 23 seq_num 109) dirty exists 2024-03-30T12:22:57.033 INFO:tasks.rados.rados.0.smithi084.stdout:262: left oid 18 (ObjNum 109 snap 23 seq_num 109) 2024-03-30T12:22:57.034 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 99 (ObjNum 44 snap 0 seq_num 44) dirty exists 2024-03-30T12:22:57.034 INFO:tasks.rados.rados.0.smithi084.stdout:262: done (2 left) 2024-03-30T12:22:57.034 INFO:tasks.rados.rados.0.smithi084.stdout:263: done (1 left) 2024-03-30T12:22:57.034 INFO:tasks.rados.rados.0.smithi084.stdout:264: done (0 left) 2024-03-30T12:22:57.034 INFO:tasks.rados.rados.0.smithi084.stdout:265: setattr oid 40 current snap is 23 2024-03-30T12:22:57.034 INFO:tasks.rados.rados.0.smithi084.stdout:266: snap_create 2024-03-30T12:22:57.042 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 97 (ObjNum 49 snap 0 seq_num 49) dirty exists 2024-03-30T12:22:58.043 INFO:tasks.rados.rados.0.smithi084.stdout:265: done (1 left) 2024-03-30T12:22:58.044 INFO:tasks.rados.rados.0.smithi084.stdout:266: done (0 left) 2024-03-30T12:22:58.044 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 33 current snap is 24 2024-03-30T12:22:58.044 INFO:tasks.rados.rados.0.smithi084.stdout:267: seq_num 110 ranges {253952=647168,901120=778240,1679360=425984} 2024-03-30T12:22:58.048 INFO:tasks.rados.rados.0.smithi084.stdout:267: writing smithi08477944-33 from 253952 to 901120 tid 1 2024-03-30T12:22:58.053 INFO:tasks.rados.rados.0.smithi084.stdout:267: writing smithi08477944-33 from 901120 to 1679360 tid 2 2024-03-30T12:22:58.056 INFO:tasks.rados.rados.0.smithi084.stdout:267: writing smithi08477944-33 from 1679360 to 2105344 tid 3 2024-03-30T12:22:58.056 INFO:tasks.rados.rados.0.smithi084.stdout:268: copy_from oid 18 from oid 13 current snap is 24 2024-03-30T12:22:58.056 INFO:tasks.rados.rados.0.smithi084.stdout:267: finishing write tid 1 to smithi08477944-33 2024-03-30T12:22:58.056 INFO:tasks.rados.rados.0.smithi084.stdout:269: snap_create 2024-03-30T12:22:58.058 INFO:tasks.rados.rados.0.smithi084.stdout:267: finishing write tid 2 to smithi08477944-33 2024-03-30T12:22:58.058 INFO:tasks.rados.rados.0.smithi084.stdout:267: finishing write tid 3 to smithi08477944-33 2024-03-30T12:22:58.058 INFO:tasks.rados.rados.0.smithi084.stdout:267: finishing write tid 4 to smithi08477944-33 2024-03-30T12:22:58.059 INFO:tasks.rados.rados.0.smithi084.stdout:267: finishing write tid 5 to smithi08477944-33 2024-03-30T12:22:58.060 INFO:tasks.rados.rados.0.smithi084.stdout:267: oid 33 updating version 0 to 102 2024-03-30T12:22:58.060 INFO:tasks.rados.rados.0.smithi084.stdout:267: oid 33 updating version 102 to 104 2024-03-30T12:22:58.060 INFO:tasks.rados.rados.0.smithi084.stdout:267: oid 33 version 104 is already newer than 103 2024-03-30T12:22:58.060 INFO:tasks.rados.rados.0.smithi084.stdout:267: oid 33 version 104 is already newer than 101 2024-03-30T12:22:58.060 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 104 (ObjNum 110 snap 24 seq_num 110) dirty exists 2024-03-30T12:22:58.060 INFO:tasks.rados.rados.0.smithi084.stdout:267: left oid 33 (ObjNum 110 snap 24 seq_num 110) 2024-03-30T12:22:58.061 INFO:tasks.rados.rados.0.smithi084.stdout:268: finishing copy_from racing read to smithi08477944-18 2024-03-30T12:22:58.062 INFO:tasks.rados.rados.0.smithi084.stdout:268: finishing copy_from to smithi08477944-18 2024-03-30T12:22:58.062 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 20 (ObjNum 12 snap 0 seq_num 12) dirty exists 2024-03-30T12:22:58.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:58 smithi162 ceph-mon[30421]: osdmap e114: 8 total, 8 up, 8 in 2024-03-30T12:22:58.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:58 smithi162 ceph-mon[30421]: pgmap v153: 121 pgs: 121 active+clean; 82 MiB data, 365 MiB used, 715 GiB / 715 GiB avail; 4.7 MiB/s rd, 3.3 MiB/s wr, 42 op/s 2024-03-30T12:22:58.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:58 smithi084 ceph-mon[37565]: osdmap e114: 8 total, 8 up, 8 in 2024-03-30T12:22:58.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:58 smithi084 ceph-mon[37565]: pgmap v153: 121 pgs: 121 active+clean; 82 MiB data, 365 MiB used, 715 GiB / 715 GiB avail; 4.7 MiB/s rd, 3.3 MiB/s wr, 42 op/s 2024-03-30T12:22:58.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:58 smithi084 ceph-mon[27000]: osdmap e114: 8 total, 8 up, 8 in 2024-03-30T12:22:58.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:58 smithi084 ceph-mon[27000]: pgmap v153: 121 pgs: 121 active+clean; 82 MiB data, 365 MiB used, 715 GiB / 715 GiB avail; 4.7 MiB/s rd, 3.3 MiB/s wr, 42 op/s 2024-03-30T12:22:59.052 INFO:tasks.rados.rados.0.smithi084.stdout:267: done (2 left) 2024-03-30T12:22:59.052 INFO:tasks.rados.rados.0.smithi084.stdout:268: done (1 left) 2024-03-30T12:22:59.052 INFO:tasks.rados.rados.0.smithi084.stdout:269: done (0 left) 2024-03-30T12:22:59.053 INFO:tasks.rados.rados.0.smithi084.stdout:270: snap_create 2024-03-30T12:22:59.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:22:59 smithi084 ceph-mon[37565]: osdmap e115: 8 total, 8 up, 8 in 2024-03-30T12:22:59.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:22:59 smithi084 ceph-mon[27000]: osdmap e115: 8 total, 8 up, 8 in 2024-03-30T12:22:59.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:22:59 smithi162 ceph-mon[30421]: osdmap e115: 8 total, 8 up, 8 in 2024-03-30T12:22:59.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:22:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:22:59] "GET /metrics HTTP/1.1" 200 36003 "" "Prometheus/2.43.0" 2024-03-30T12:23:00.029 INFO:tasks.rados.rados.0.smithi084.stdout:270: done (0 left) 2024-03-30T12:23:00.029 INFO:tasks.rados.rados.0.smithi084.stdout:271: read oid 15 snap -1 2024-03-30T12:23:00.029 INFO:tasks.rados.rados.0.smithi084.stdout:271: expect (ObjNum 96 snap 22 seq_num 96) 2024-03-30T12:23:00.030 INFO:tasks.rados.rados.0.smithi084.stdout:272: read oid 1 snap -1 2024-03-30T12:23:00.030 INFO:tasks.rados.rados.0.smithi084.stdout:272: expect (ObjNum 86 snap 21 seq_num 86) 2024-03-30T12:23:00.030 INFO:tasks.rados.rados.0.smithi084.stdout:273: read oid 10 snap -1 2024-03-30T12:23:00.030 INFO:tasks.rados.rados.0.smithi084.stdout:273: expect (ObjNum 83 snap 18 seq_num 83) 2024-03-30T12:23:00.030 INFO:tasks.rados.rados.0.smithi084.stdout:274: delete oid 49 current snap is 26 2024-03-30T12:23:00.037 INFO:tasks.rados.rados.0.smithi084.stdout:272: expect (ObjNum 86 snap 21 seq_num 86) 2024-03-30T12:23:00.078 INFO:tasks.rados.rados.0.smithi084.stdout:273: expect (ObjNum 83 snap 18 seq_num 83) 2024-03-30T12:23:00.184 INFO:tasks.rados.rados.0.smithi084.stdout:271: expect (ObjNum 96 snap 22 seq_num 96) 2024-03-30T12:23:00.278 INFO:tasks.rados.rados.0.smithi084.stdout:271: done (3 left) 2024-03-30T12:23:00.278 INFO:tasks.rados.rados.0.smithi084.stdout:272: done (2 left) 2024-03-30T12:23:00.278 INFO:tasks.rados.rados.0.smithi084.stdout:273: done (1 left) 2024-03-30T12:23:00.278 INFO:tasks.rados.rados.0.smithi084.stdout:274: done (0 left) 2024-03-30T12:23:00.278 INFO:tasks.rados.rados.0.smithi084.stdout:275: delete oid 44 current snap is 26 2024-03-30T12:23:00.279 INFO:tasks.rados.rados.0.smithi084.stdout:275: done (0 left) 2024-03-30T12:23:00.279 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 26 2024-03-30T12:23:00.280 INFO:tasks.rados.rados.0.smithi084.stdout:276: seq_num 113 ranges {4603904=696320,5300224=434176,5734400=466944,6201344=303104} 2024-03-30T12:23:00.307 INFO:tasks.rados.rados.0.smithi084.stdout:276: writing smithi08477944-25 from 4603904 to 5300224 tid 1 2024-03-30T12:23:00.309 INFO:tasks.rados.rados.0.smithi084.stdout:276: writing smithi08477944-25 from 5300224 to 5734400 tid 2 2024-03-30T12:23:00.312 INFO:tasks.rados.rados.0.smithi084.stdout:276: writing smithi08477944-25 from 5734400 to 6201344 tid 3 2024-03-30T12:23:00.315 INFO:tasks.rados.rados.0.smithi084.stdout:276: writing smithi08477944-25 from 6201344 to 6504448 tid 4 2024-03-30T12:23:00.315 INFO:tasks.rados.rados.0.smithi084.stdout:276: finishing write tid 1 to smithi08477944-25 2024-03-30T12:23:00.315 INFO:tasks.rados.rados.0.smithi084.stdout:276: finishing write tid 2 to smithi08477944-25 2024-03-30T12:23:00.315 INFO:tasks.rados.rados.0.smithi084.stdout:277: delete oid 42 current snap is 26 2024-03-30T12:23:00.315 INFO:tasks.rados.rados.0.smithi084.stdout:276: finishing write tid 3 to smithi08477944-25 2024-03-30T12:23:00.316 INFO:tasks.rados.rados.0.smithi084.stdout:277: done (1 left) 2024-03-30T12:23:00.316 INFO:tasks.rados.rados.0.smithi084.stdout:278: snap_remove snap 14 2024-03-30T12:23:00.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:00 smithi162 ceph-mon[30421]: osdmap e116: 8 total, 8 up, 8 in 2024-03-30T12:23:00.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:00 smithi162 ceph-mon[30421]: pgmap v156: 121 pgs: 121 active+clean; 82 MiB data, 365 MiB used, 715 GiB / 715 GiB avail; 4.7 MiB/s rd, 3.3 MiB/s wr, 42 op/s 2024-03-30T12:23:00.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:00 smithi162 ceph-mon[30421]: osdmap e117: 8 total, 8 up, 8 in 2024-03-30T12:23:00.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:00 smithi084 ceph-mon[37565]: osdmap e116: 8 total, 8 up, 8 in 2024-03-30T12:23:00.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:00 smithi084 ceph-mon[37565]: pgmap v156: 121 pgs: 121 active+clean; 82 MiB data, 365 MiB used, 715 GiB / 715 GiB avail; 4.7 MiB/s rd, 3.3 MiB/s wr, 42 op/s 2024-03-30T12:23:00.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:00 smithi084 ceph-mon[37565]: osdmap e117: 8 total, 8 up, 8 in 2024-03-30T12:23:00.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:00 smithi084 ceph-mon[27000]: osdmap e116: 8 total, 8 up, 8 in 2024-03-30T12:23:00.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:00 smithi084 ceph-mon[27000]: pgmap v156: 121 pgs: 121 active+clean; 82 MiB data, 365 MiB used, 715 GiB / 715 GiB avail; 4.7 MiB/s rd, 3.3 MiB/s wr, 42 op/s 2024-03-30T12:23:00.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:00 smithi084 ceph-mon[27000]: osdmap e117: 8 total, 8 up, 8 in 2024-03-30T12:23:01.055 INFO:tasks.rados.rados.0.smithi084.stdout:278: done (1 left) 2024-03-30T12:23:01.055 INFO:tasks.rados.rados.0.smithi084.stdout:279: delete oid 48 current snap is 26 2024-03-30T12:23:01.056 INFO:tasks.rados.rados.0.smithi084.stdout:276: finishing write tid 4 to smithi08477944-25 2024-03-30T12:23:01.056 INFO:tasks.rados.rados.0.smithi084.stdout:276: finishing write tid 5 to smithi08477944-25 2024-03-30T12:23:01.056 INFO:tasks.rados.rados.0.smithi084.stdout:276: finishing write tid 6 to smithi08477944-25 2024-03-30T12:23:01.056 INFO:tasks.rados.rados.0.smithi084.stdout:276: oid 25 updating version 0 to 73 2024-03-30T12:23:01.056 INFO:tasks.rados.rados.0.smithi084.stdout:276: oid 25 updating version 73 to 74 2024-03-30T12:23:01.056 INFO:tasks.rados.rados.0.smithi084.stdout:276: oid 25 updating version 74 to 76 2024-03-30T12:23:01.056 INFO:tasks.rados.rados.0.smithi084.stdout:276: oid 25 version 76 is already newer than 75 2024-03-30T12:23:01.056 INFO:tasks.rados.rados.0.smithi084.stdout:276: oid 25 version 76 is already newer than 72 2024-03-30T12:23:01.057 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 76 (ObjNum 113 snap 26 seq_num 113) dirty exists 2024-03-30T12:23:01.057 INFO:tasks.rados.rados.0.smithi084.stdout:276: left oid 25 (ObjNum 113 snap 26 seq_num 113) 2024-03-30T12:23:01.059 INFO:tasks.rados.rados.0.smithi084.stdout:276: done (1 left) 2024-03-30T12:23:01.059 INFO:tasks.rados.rados.0.smithi084.stdout:279: done (0 left) 2024-03-30T12:23:01.060 INFO:tasks.rados.rados.0.smithi084.stdout:280: copy_from oid 36 from oid 46 current snap is 26 2024-03-30T12:23:01.060 INFO:tasks.rados.rados.0.smithi084.stdout:281: rollback oid 15 current snap is 26 2024-03-30T12:23:01.060 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 15 to 19 2024-03-30T12:23:01.060 INFO:tasks.rados.rados.0.smithi084.stdout:282: setattr oid 14 current snap is 26 2024-03-30T12:23:01.062 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 26 2024-03-30T12:23:01.062 INFO:tasks.rados.rados.0.smithi084.stdout:283: seq_num 116 ranges {827392=745472,1572864=532480,2105344=638976,2744320=32768} 2024-03-30T12:23:01.072 INFO:tasks.rados.rados.0.smithi084.stdout:283: writing smithi08477944-50 from 827392 to 1572864 tid 1 2024-03-30T12:23:01.076 INFO:tasks.rados.rados.0.smithi084.stdout:283: writing smithi08477944-50 from 1572864 to 2105344 tid 2 2024-03-30T12:23:01.081 INFO:tasks.rados.rados.0.smithi084.stdout:283: writing smithi08477944-50 from 2105344 to 2744320 tid 3 2024-03-30T12:23:01.081 INFO:tasks.rados.rados.0.smithi084.stdout:283: writing smithi08477944-50 from 2744320 to 2777088 tid 4 2024-03-30T12:23:01.081 INFO:tasks.rados.rados.0.smithi084.stdout:284: read oid 12 snap 25 2024-03-30T12:23:01.082 INFO:tasks.rados.rados.0.smithi084.stdout:284: expect (ObjNum 70 snap 8 seq_num 70) 2024-03-30T12:23:01.082 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 26 2024-03-30T12:23:01.082 INFO:tasks.rados.rados.0.smithi084.stdout:281: finishing rollback tid 0 to smithi08477944-15 2024-03-30T12:23:01.082 INFO:tasks.rados.rados.0.smithi084.stdout:281: finishing rollback tid 1 to smithi08477944-15 2024-03-30T12:23:01.083 INFO:tasks.rados.rados.0.smithi084.stdout:281: finishing rollback tid 2 to smithi08477944-15 2024-03-30T12:23:01.083 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 111 (ObjNum 63 snap 6 seq_num 63) dirty exists 2024-03-30T12:23:01.083 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 84 (ObjNum 40 snap 0 seq_num 40) dirty exists 2024-03-30T12:23:01.083 INFO:tasks.rados.rados.0.smithi084.stdout:280: finishing copy_from racing read to smithi08477944-36 2024-03-30T12:23:01.083 INFO:tasks.rados.rados.0.smithi084.stdout:280: finishing copy_from to smithi08477944-36 2024-03-30T12:23:01.083 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 30 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-03-30T12:23:01.084 INFO:tasks.rados.rados.0.smithi084.stdout:283: finishing write tid 1 to smithi08477944-50 2024-03-30T12:23:01.084 INFO:tasks.rados.rados.0.smithi084.stdout:283: finishing write tid 2 to smithi08477944-50 2024-03-30T12:23:01.084 INFO:tasks.rados.rados.0.smithi084.stdout:285: seq_num 117 ranges {1449984=770048,2220032=417792,2637824=442368,3080192=344064} 2024-03-30T12:23:01.092 INFO:tasks.rados.rados.0.smithi084.stdout:285: writing smithi08477944-20 from 1449984 to 2220032 tid 1 2024-03-30T12:23:01.095 INFO:tasks.rados.rados.0.smithi084.stdout:285: writing smithi08477944-20 from 2220032 to 2637824 tid 2 2024-03-30T12:23:01.097 INFO:tasks.rados.rados.0.smithi084.stdout:285: writing smithi08477944-20 from 2637824 to 3080192 tid 3 2024-03-30T12:23:01.100 INFO:tasks.rados.rados.0.smithi084.stdout:285: writing smithi08477944-20 from 3080192 to 3424256 tid 4 2024-03-30T12:23:01.100 INFO:tasks.rados.rados.0.smithi084.stdout:280: done (5 left) 2024-03-30T12:23:01.100 INFO:tasks.rados.rados.0.smithi084.stdout:281: done (4 left) 2024-03-30T12:23:01.100 INFO:tasks.rados.rados.0.smithi084.stdout:282: done (3 left) 2024-03-30T12:23:01.100 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 26 2024-03-30T12:23:01.101 INFO:tasks.rados.rados.0.smithi084.stdout:283: finishing write tid 3 to smithi08477944-50 2024-03-30T12:23:01.101 INFO:tasks.rados.rados.0.smithi084.stdout:283: finishing write tid 4 to smithi08477944-50 2024-03-30T12:23:01.101 INFO:tasks.rados.rados.0.smithi084.stdout:283: finishing write tid 5 to smithi08477944-50 2024-03-30T12:23:01.101 INFO:tasks.rados.rados.0.smithi084.stdout:283: finishing write tid 6 to smithi08477944-50 2024-03-30T12:23:01.101 INFO:tasks.rados.rados.0.smithi084.stdout:283: oid 50 updating version 0 to 118 2024-03-30T12:23:01.101 INFO:tasks.rados.rados.0.smithi084.stdout:283: oid 50 updating version 118 to 120 2024-03-30T12:23:01.101 INFO:tasks.rados.rados.0.smithi084.stdout:283: oid 50 updating version 120 to 121 2024-03-30T12:23:01.101 INFO:tasks.rados.rados.0.smithi084.stdout:283: oid 50 version 121 is already newer than 117 2024-03-30T12:23:01.101 INFO:tasks.rados.rados.0.smithi084.stdout:283: oid 50 version 121 is already newer than 119 2024-03-30T12:23:01.102 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 121 (ObjNum 116 snap 26 seq_num 116) dirty exists 2024-03-30T12:23:01.102 INFO:tasks.rados.rados.0.smithi084.stdout:283: left oid 50 (ObjNum 116 snap 26 seq_num 116) 2024-03-30T12:23:01.102 INFO:tasks.rados.rados.0.smithi084.stdout:284: expect (ObjNum 70 snap 8 seq_num 70) 2024-03-30T12:23:01.131 INFO:tasks.rados.rados.0.smithi084.stdout:285: finishing write tid 1 to smithi08477944-20 2024-03-30T12:23:01.131 INFO:tasks.rados.rados.0.smithi084.stdout:285: finishing write tid 2 to smithi08477944-20 2024-03-30T12:23:01.131 INFO:tasks.rados.rados.0.smithi084.stdout:286: seq_num 118 ranges {1499136=786432,2285568=704512,2990080=499712} 2024-03-30T12:23:01.143 INFO:tasks.rados.rados.0.smithi084.stdout:286: writing smithi08477944-39 from 1499136 to 2285568 tid 1 2024-03-30T12:23:01.147 INFO:tasks.rados.rados.0.smithi084.stdout:286: writing smithi08477944-39 from 2285568 to 2990080 tid 2 2024-03-30T12:23:01.152 INFO:tasks.rados.rados.0.smithi084.stdout:286: writing smithi08477944-39 from 2990080 to 3489792 tid 3 2024-03-30T12:23:01.152 INFO:tasks.rados.rados.0.smithi084.stdout:283: done (3 left) 2024-03-30T12:23:01.152 INFO:tasks.rados.rados.0.smithi084.stdout:284: done (2 left) 2024-03-30T12:23:01.152 INFO:tasks.rados.rados.0.smithi084.stdout:287: rollback oid 18 current snap is 26 2024-03-30T12:23:01.152 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 18 to 10 2024-03-30T12:23:01.153 INFO:tasks.rados.rados.0.smithi084.stdout:285: finishing write tid 3 to smithi08477944-20 2024-03-30T12:23:01.153 INFO:tasks.rados.rados.0.smithi084.stdout:285: finishing write tid 4 to smithi08477944-20 2024-03-30T12:23:01.153 INFO:tasks.rados.rados.0.smithi084.stdout:285: finishing write tid 5 to smithi08477944-20 2024-03-30T12:23:01.153 INFO:tasks.rados.rados.0.smithi084.stdout:285: finishing write tid 6 to smithi08477944-20 2024-03-30T12:23:01.153 INFO:tasks.rados.rados.0.smithi084.stdout:285: oid 20 updating version 0 to 118 2024-03-30T12:23:01.153 INFO:tasks.rados.rados.0.smithi084.stdout:285: oid 20 version 118 is already newer than 114 2024-03-30T12:23:01.153 INFO:tasks.rados.rados.0.smithi084.stdout:285: oid 20 version 118 is already newer than 116 2024-03-30T12:23:01.153 INFO:tasks.rados.rados.0.smithi084.stdout:285: oid 20 version 118 is already newer than 117 2024-03-30T12:23:01.154 INFO:tasks.rados.rados.0.smithi084.stdout:285: oid 20 version 118 is already newer than 115 2024-03-30T12:23:01.154 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 118 (ObjNum 117 snap 26 seq_num 117) dirty exists 2024-03-30T12:23:01.154 INFO:tasks.rados.rados.0.smithi084.stdout:285: left oid 20 (ObjNum 117 snap 26 seq_num 117) 2024-03-30T12:23:01.154 INFO:tasks.rados.rados.0.smithi084.stdout:286: finishing write tid 1 to smithi08477944-39 2024-03-30T12:23:01.154 INFO:tasks.rados.rados.0.smithi084.stdout:286: finishing write tid 2 to smithi08477944-39 2024-03-30T12:23:01.154 INFO:tasks.rados.rados.0.smithi084.stdout:285: done (2 left) 2024-03-30T12:23:01.154 INFO:tasks.rados.rados.0.smithi084.stdout:288: snap_remove snap 23 2024-03-30T12:23:02.070 INFO:tasks.rados.rados.0.smithi084.stdout:288: done (2 left) 2024-03-30T12:23:02.070 INFO:tasks.rados.rados.0.smithi084.stdout:289: rollback oid 25 current snap is 26 2024-03-30T12:23:02.070 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 25 to 24 2024-03-30T12:23:02.070 INFO:tasks.rados.rados.0.smithi084.stdout:286: finishing write tid 3 to smithi08477944-39 2024-03-30T12:23:02.071 INFO:tasks.rados.rados.0.smithi084.stdout:286: finishing write tid 4 to smithi08477944-39 2024-03-30T12:23:02.071 INFO:tasks.rados.rados.0.smithi084.stdout:287: finishing rollback tid 0 to smithi08477944-18 2024-03-30T12:23:02.071 INFO:tasks.rados.rados.0.smithi084.stdout:287: finishing rollback tid 1 to smithi08477944-18 2024-03-30T12:23:02.071 INFO:tasks.rados.rados.0.smithi084.stdout:287: finishing rollback tid 2 to smithi08477944-18 2024-03-30T12:23:02.071 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 125 (ObjNum 17 snap 0 seq_num 17) dirty exists 2024-03-30T12:23:02.071 INFO:tasks.rados.rados.0.smithi084.stdout:286: finishing write tid 5 to smithi08477944-39 2024-03-30T12:23:02.071 INFO:tasks.rados.rados.0.smithi084.stdout:286: oid 39 updating version 0 to 119 2024-03-30T12:23:02.071 INFO:tasks.rados.rados.0.smithi084.stdout:286: oid 39 updating version 119 to 120 2024-03-30T12:23:02.071 INFO:tasks.rados.rados.0.smithi084.stdout:286: oid 39 updating version 120 to 122 2024-03-30T12:23:02.071 INFO:tasks.rados.rados.0.smithi084.stdout:286: oid 39 version 122 is already newer than 121 2024-03-30T12:23:02.071 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 122 (ObjNum 118 snap 26 seq_num 118) dirty exists 2024-03-30T12:23:02.071 INFO:tasks.rados.rados.0.smithi084.stdout:286: left oid 39 (ObjNum 118 snap 26 seq_num 118) 2024-03-30T12:23:02.071 INFO:tasks.rados.rados.0.smithi084.stdout:286: done (2 left) 2024-03-30T12:23:02.072 INFO:tasks.rados.rados.0.smithi084.stdout:287: done (1 left) 2024-03-30T12:23:02.072 INFO:tasks.rados.rados.0.smithi084.stdout:290: snap_create 2024-03-30T12:23:02.072 INFO:tasks.rados.rados.0.smithi084.stdout:289: finishing rollback tid 0 to smithi08477944-25 2024-03-30T12:23:02.072 INFO:tasks.rados.rados.0.smithi084.stdout:289: finishing rollback tid 1 to smithi08477944-25 2024-03-30T12:23:02.072 INFO:tasks.rados.rados.0.smithi084.stdout:289: finishing rollback tid 2 to smithi08477944-25 2024-03-30T12:23:02.073 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 87 (ObjNum 101 snap 22 seq_num 101) dirty exists 2024-03-30T12:23:02.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:02 smithi162 ceph-mon[30421]: osdmap e118: 8 total, 8 up, 8 in 2024-03-30T12:23:02.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:02 smithi162 ceph-mon[30421]: pgmap v159: 121 pgs: 121 active+clean; 93 MiB data, 380 MiB used, 715 GiB / 715 GiB avail; 6.0 MiB/s rd, 2.5 MiB/s wr, 24 op/s 2024-03-30T12:23:02.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:02 smithi084 ceph-mon[37565]: osdmap e118: 8 total, 8 up, 8 in 2024-03-30T12:23:02.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:02 smithi084 ceph-mon[37565]: pgmap v159: 121 pgs: 121 active+clean; 93 MiB data, 380 MiB used, 715 GiB / 715 GiB avail; 6.0 MiB/s rd, 2.5 MiB/s wr, 24 op/s 2024-03-30T12:23:02.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:02 smithi084 ceph-mon[27000]: osdmap e118: 8 total, 8 up, 8 in 2024-03-30T12:23:02.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:02 smithi084 ceph-mon[27000]: pgmap v159: 121 pgs: 121 active+clean; 93 MiB data, 380 MiB used, 715 GiB / 715 GiB avail; 6.0 MiB/s rd, 2.5 MiB/s wr, 24 op/s 2024-03-30T12:23:03.064 INFO:tasks.rados.rados.0.smithi084.stdout:289: done (1 left) 2024-03-30T12:23:03.064 INFO:tasks.rados.rados.0.smithi084.stdout:290: done (0 left) 2024-03-30T12:23:03.064 INFO:tasks.rados.rados.0.smithi084.stdout:291: read oid 23 snap -1 2024-03-30T12:23:03.065 INFO:tasks.rados.rados.0.smithi084.stdout:291: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-30T12:23:03.065 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 27 2024-03-30T12:23:03.065 INFO:tasks.rados.rados.0.smithi084.stdout:292: seq_num 119 ranges {2031616=802816,2834432=589824,3424256=409600,3833856=204800} 2024-03-30T12:23:03.079 INFO:tasks.rados.rados.0.smithi084.stdout:292: writing smithi08477944-41 from 2031616 to 2834432 tid 1 2024-03-30T12:23:03.083 INFO:tasks.rados.rados.0.smithi084.stdout:292: writing smithi08477944-41 from 2834432 to 3424256 tid 2 2024-03-30T12:23:03.086 INFO:tasks.rados.rados.0.smithi084.stdout:292: writing smithi08477944-41 from 3424256 to 3833856 tid 3 2024-03-30T12:23:03.087 INFO:tasks.rados.rados.0.smithi084.stdout:292: writing smithi08477944-41 from 3833856 to 4038656 tid 4 2024-03-30T12:23:03.088 INFO:tasks.rados.rados.0.smithi084.stdout:293: read oid 28 snap -1 2024-03-30T12:23:03.088 INFO:tasks.rados.rados.0.smithi084.stdout:293: expect (ObjNum 27 snap 0 seq_num 27) 2024-03-30T12:23:03.088 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 27 2024-03-30T12:23:03.088 INFO:tasks.rados.rados.0.smithi084.stdout:294: seq_num 120 ranges {2768896=417792,3186688=475136,3661824=622592,4284416=507904} 2024-03-30T12:23:03.105 INFO:tasks.rados.rados.0.smithi084.stdout:294: writing smithi08477944-9 from 2768896 to 3186688 tid 1 2024-03-30T12:23:03.107 INFO:tasks.rados.rados.0.smithi084.stdout:294: writing smithi08477944-9 from 3186688 to 3661824 tid 2 2024-03-30T12:23:03.111 INFO:tasks.rados.rados.0.smithi084.stdout:294: writing smithi08477944-9 from 3661824 to 4284416 tid 3 2024-03-30T12:23:03.114 INFO:tasks.rados.rados.0.smithi084.stdout:294: writing smithi08477944-9 from 4284416 to 4792320 tid 4 2024-03-30T12:23:03.114 INFO:tasks.rados.rados.0.smithi084.stdout:295: rmattr oid 34 current snap is 27 2024-03-30T12:23:03.114 INFO:tasks.rados.rados.0.smithi084.stdout:295: done (4 left) 2024-03-30T12:23:03.115 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 27 2024-03-30T12:23:03.115 INFO:tasks.rados.rados.0.smithi084.stdout:296: seq_num 121 ranges {1179648=434176,1613824=753664,2367488=425984,2793472=425984} 2024-03-30T12:23:03.123 INFO:tasks.rados.rados.0.smithi084.stdout:296: writing smithi08477944-12 from 1179648 to 1613824 tid 1 2024-03-30T12:23:03.127 INFO:tasks.rados.rados.0.smithi084.stdout:296: writing smithi08477944-12 from 1613824 to 2367488 tid 2 2024-03-30T12:23:03.129 INFO:tasks.rados.rados.0.smithi084.stdout:296: writing smithi08477944-12 from 2367488 to 2793472 tid 3 2024-03-30T12:23:03.132 INFO:tasks.rados.rados.0.smithi084.stdout:296: writing smithi08477944-12 from 2793472 to 3219456 tid 4 2024-03-30T12:23:03.132 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 27 2024-03-30T12:23:03.132 INFO:tasks.rados.rados.0.smithi084.stdout:291: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-30T12:23:03.155 INFO:tasks.rados.rados.0.smithi084.stdout:292: finishing write tid 1 to smithi08477944-41 2024-03-30T12:23:03.155 INFO:tasks.rados.rados.0.smithi084.stdout:292: finishing write tid 2 to smithi08477944-41 2024-03-30T12:23:03.155 INFO:tasks.rados.rados.0.smithi084.stdout:297: seq_num 122 ranges {40960=450560,491520=688128,1179648=630784,1810432=286720} 2024-03-30T12:23:03.157 INFO:tasks.rados.rados.0.smithi084.stdout:297: writing smithi08477944-37 from 40960 to 491520 tid 1 2024-03-30T12:23:03.161 INFO:tasks.rados.rados.0.smithi084.stdout:297: writing smithi08477944-37 from 491520 to 1179648 tid 2 2024-03-30T12:23:03.165 INFO:tasks.rados.rados.0.smithi084.stdout:297: writing smithi08477944-37 from 1179648 to 1810432 tid 3 2024-03-30T12:23:03.167 INFO:tasks.rados.rados.0.smithi084.stdout:297: writing smithi08477944-37 from 1810432 to 2097152 tid 4 2024-03-30T12:23:03.167 INFO:tasks.rados.rados.0.smithi084.stdout:291: done (5 left) 2024-03-30T12:23:03.167 INFO:tasks.rados.rados.0.smithi084.stdout:298: copy_from oid 20 from oid 11 current snap is 27 2024-03-30T12:23:03.167 INFO:tasks.rados.rados.0.smithi084.stdout:292: finishing write tid 3 to smithi08477944-41 2024-03-30T12:23:03.167 INFO:tasks.rados.rados.0.smithi084.stdout:292: finishing write tid 4 to smithi08477944-41 2024-03-30T12:23:03.167 INFO:tasks.rados.rados.0.smithi084.stdout:292: finishing write tid 5 to smithi08477944-41 2024-03-30T12:23:03.167 INFO:tasks.rados.rados.0.smithi084.stdout:293: expect (ObjNum 27 snap 0 seq_num 27) 2024-03-30T12:23:03.184 INFO:tasks.rados.rados.0.smithi084.stdout:292: finishing write tid 6 to smithi08477944-41 2024-03-30T12:23:03.184 INFO:tasks.rados.rados.0.smithi084.stdout:292: oid 41 updating version 0 to 135 2024-03-30T12:23:03.184 INFO:tasks.rados.rados.0.smithi084.stdout:292: oid 41 version 135 is already newer than 131 2024-03-30T12:23:03.184 INFO:tasks.rados.rados.0.smithi084.stdout:292: oid 41 version 135 is already newer than 132 2024-03-30T12:23:03.184 INFO:tasks.rados.rados.0.smithi084.stdout:292: oid 41 version 135 is already newer than 133 2024-03-30T12:23:03.184 INFO:tasks.rados.rados.0.smithi084.stdout:292: oid 41 version 135 is already newer than 134 2024-03-30T12:23:03.185 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 135 (ObjNum 119 snap 27 seq_num 119) dirty exists 2024-03-30T12:23:03.185 INFO:tasks.rados.rados.0.smithi084.stdout:292: left oid 41 (ObjNum 119 snap 27 seq_num 119) 2024-03-30T12:23:03.185 INFO:tasks.rados.rados.0.smithi084.stdout:294: finishing write tid 1 to smithi08477944-9 2024-03-30T12:23:03.185 INFO:tasks.rados.rados.0.smithi084.stdout:294: finishing write tid 2 to smithi08477944-9 2024-03-30T12:23:03.185 INFO:tasks.rados.rados.0.smithi084.stdout:294: finishing write tid 3 to smithi08477944-9 2024-03-30T12:23:03.185 INFO:tasks.rados.rados.0.smithi084.stdout:294: finishing write tid 4 to smithi08477944-9 2024-03-30T12:23:03.185 INFO:tasks.rados.rados.0.smithi084.stdout:294: finishing write tid 5 to smithi08477944-9 2024-03-30T12:23:03.185 INFO:tasks.rados.rados.0.smithi084.stdout:294: finishing write tid 6 to smithi08477944-9 2024-03-30T12:23:03.185 INFO:tasks.rados.rados.0.smithi084.stdout:294: oid 9 updating version 0 to 41 2024-03-30T12:23:03.185 INFO:tasks.rados.rados.0.smithi084.stdout:294: oid 9 updating version 41 to 45 2024-03-30T12:23:03.185 INFO:tasks.rados.rados.0.smithi084.stdout:294: oid 9 version 45 is already newer than 42 2024-03-30T12:23:03.185 INFO:tasks.rados.rados.0.smithi084.stdout:294: oid 9 version 45 is already newer than 43 2024-03-30T12:23:03.185 INFO:tasks.rados.rados.0.smithi084.stdout:294: oid 9 version 45 is already newer than 44 2024-03-30T12:23:03.185 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 45 (ObjNum 120 snap 27 seq_num 120) dirty exists 2024-03-30T12:23:03.186 INFO:tasks.rados.rados.0.smithi084.stdout:294: left oid 9 (ObjNum 120 snap 27 seq_num 120) 2024-03-30T12:23:03.186 INFO:tasks.rados.rados.0.smithi084.stdout:296: finishing write tid 1 to smithi08477944-12 2024-03-30T12:23:03.186 INFO:tasks.rados.rados.0.smithi084.stdout:296: finishing write tid 2 to smithi08477944-12 2024-03-30T12:23:03.186 INFO:tasks.rados.rados.0.smithi084.stdout:296: finishing write tid 3 to smithi08477944-12 2024-03-30T12:23:03.186 INFO:tasks.rados.rados.0.smithi084.stdout:296: finishing write tid 4 to smithi08477944-12 2024-03-30T12:23:03.186 INFO:tasks.rados.rados.0.smithi084.stdout:296: finishing write tid 5 to smithi08477944-12 2024-03-30T12:23:03.186 INFO:tasks.rados.rados.0.smithi084.stdout:296: finishing write tid 6 to smithi08477944-12 2024-03-30T12:23:03.186 INFO:tasks.rados.rados.0.smithi084.stdout:296: oid 12 updating version 0 to 54 2024-03-30T12:23:03.186 INFO:tasks.rados.rados.0.smithi084.stdout:296: oid 12 version 54 is already newer than 53 2024-03-30T12:23:03.186 INFO:tasks.rados.rados.0.smithi084.stdout:296: oid 12 updating version 54 to 56 2024-03-30T12:23:03.186 INFO:tasks.rados.rados.0.smithi084.stdout:296: oid 12 updating version 56 to 57 2024-03-30T12:23:03.186 INFO:tasks.rados.rados.0.smithi084.stdout:296: oid 12 version 57 is already newer than 55 2024-03-30T12:23:03.186 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 57 (ObjNum 121 snap 27 seq_num 121) dirty exists 2024-03-30T12:23:03.186 INFO:tasks.rados.rados.0.smithi084.stdout:296: left oid 12 (ObjNum 121 snap 27 seq_num 121) 2024-03-30T12:23:03.187 INFO:tasks.rados.rados.0.smithi084.stdout:292: done (5 left) 2024-03-30T12:23:03.187 INFO:tasks.rados.rados.0.smithi084.stdout:293: done (4 left) 2024-03-30T12:23:03.187 INFO:tasks.rados.rados.0.smithi084.stdout:294: done (3 left) 2024-03-30T12:23:03.187 INFO:tasks.rados.rados.0.smithi084.stdout:296: done (2 left) 2024-03-30T12:23:03.187 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 27 2024-03-30T12:23:03.187 INFO:tasks.rados.rados.0.smithi084.stdout:299: seq_num 123 ranges {3219456=466944,3686400=573440,4259840=794624,5054464=237568} 2024-03-30T12:23:03.203 INFO:tasks.rados.rados.0.smithi084.stdout:299: writing smithi08477944-12 from 3219456 to 3686400 tid 1 2024-03-30T12:23:03.210 INFO:tasks.rados.rados.0.smithi084.stdout:299: writing smithi08477944-12 from 3686400 to 4259840 tid 2 2024-03-30T12:23:03.211 INFO:tasks.rados.rados.0.smithi084.stdout:299: writing smithi08477944-12 from 4259840 to 5054464 tid 3 2024-03-30T12:23:03.212 INFO:tasks.rados.rados.0.smithi084.stdout:299: writing smithi08477944-12 from 5054464 to 5292032 tid 4 2024-03-30T12:23:03.212 INFO:tasks.rados.rados.0.smithi084.stdout:300: snap_remove snap 24 2024-03-30T12:23:03.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:03 smithi162 ceph-mon[30421]: osdmap e119: 8 total, 8 up, 8 in 2024-03-30T12:23:03.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:03 smithi084 ceph-mon[27000]: osdmap e119: 8 total, 8 up, 8 in 2024-03-30T12:23:03.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:03 smithi084 ceph-mon[37565]: osdmap e119: 8 total, 8 up, 8 in 2024-03-30T12:23:04.184 INFO:tasks.rados.rados.0.smithi084.stdout:300: done (3 left) 2024-03-30T12:23:04.184 INFO:tasks.rados.rados.0.smithi084.stdout:301: copy_from oid 17 from oid 44 current snap is 27 2024-03-30T12:23:04.184 INFO:tasks.rados.rados.0.smithi084.stdout:302: copy_from oid 21 from oid 46 current snap is 27 2024-03-30T12:23:04.184 INFO:tasks.rados.rados.0.smithi084.stdout:303: snap_create 2024-03-30T12:23:04.185 INFO:tasks.rados.rados.0.smithi084.stdout:297: finishing write tid 1 to smithi08477944-37 2024-03-30T12:23:04.185 INFO:tasks.rados.rados.0.smithi084.stdout:297: finishing write tid 2 to smithi08477944-37 2024-03-30T12:23:04.185 INFO:tasks.rados.rados.0.smithi084.stdout:297: finishing write tid 3 to smithi08477944-37 2024-03-30T12:23:04.185 INFO:tasks.rados.rados.0.smithi084.stdout:297: finishing write tid 4 to smithi08477944-37 2024-03-30T12:23:04.185 INFO:tasks.rados.rados.0.smithi084.stdout:297: finishing write tid 5 to smithi08477944-37 2024-03-30T12:23:04.185 INFO:tasks.rados.rados.0.smithi084.stdout:297: finishing write tid 6 to smithi08477944-37 2024-03-30T12:23:04.185 INFO:tasks.rados.rados.0.smithi084.stdout:297: oid 37 updating version 0 to 90 2024-03-30T12:23:04.185 INFO:tasks.rados.rados.0.smithi084.stdout:297: oid 37 version 90 is already newer than 89 2024-03-30T12:23:04.185 INFO:tasks.rados.rados.0.smithi084.stdout:297: oid 37 updating version 90 to 91 2024-03-30T12:23:04.185 INFO:tasks.rados.rados.0.smithi084.stdout:297: oid 37 updating version 91 to 92 2024-03-30T12:23:04.185 INFO:tasks.rados.rados.0.smithi084.stdout:297: oid 37 version 92 is already newer than 88 2024-03-30T12:23:04.185 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 92 (ObjNum 122 snap 27 seq_num 122) dirty exists 2024-03-30T12:23:04.185 INFO:tasks.rados.rados.0.smithi084.stdout:297: left oid 37 (ObjNum 122 snap 27 seq_num 122) 2024-03-30T12:23:04.185 INFO:tasks.rados.rados.0.smithi084.stdout:298: finishing copy_from racing read to smithi08477944-20 2024-03-30T12:23:04.186 INFO:tasks.rados.rados.0.smithi084.stdout:298: finishing copy_from to smithi08477944-20 2024-03-30T12:23:04.186 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 62 (ObjNum 107 snap 22 seq_num 107) dirty exists 2024-03-30T12:23:04.186 INFO:tasks.rados.rados.0.smithi084.stdout:299: finishing write tid 1 to smithi08477944-12 2024-03-30T12:23:04.186 INFO:tasks.rados.rados.0.smithi084.stdout:299: finishing write tid 2 to smithi08477944-12 2024-03-30T12:23:04.186 INFO:tasks.rados.rados.0.smithi084.stdout:299: finishing write tid 3 to smithi08477944-12 2024-03-30T12:23:04.186 INFO:tasks.rados.rados.0.smithi084.stdout:299: finishing write tid 4 to smithi08477944-12 2024-03-30T12:23:04.186 INFO:tasks.rados.rados.0.smithi084.stdout:299: finishing write tid 5 to smithi08477944-12 2024-03-30T12:23:04.186 INFO:tasks.rados.rados.0.smithi084.stdout:299: finishing write tid 6 to smithi08477944-12 2024-03-30T12:23:04.186 INFO:tasks.rados.rados.0.smithi084.stdout:299: oid 12 updating version 0 to 60 2024-03-30T12:23:04.186 INFO:tasks.rados.rados.0.smithi084.stdout:299: oid 12 version 60 is already newer than 59 2024-03-30T12:23:04.186 INFO:tasks.rados.rados.0.smithi084.stdout:299: oid 12 version 60 is already newer than 58 2024-03-30T12:23:04.186 INFO:tasks.rados.rados.0.smithi084.stdout:299: oid 12 updating version 60 to 62 2024-03-30T12:23:04.186 INFO:tasks.rados.rados.0.smithi084.stdout:299: oid 12 version 62 is already newer than 61 2024-03-30T12:23:04.186 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 62 (ObjNum 123 snap 27 seq_num 123) dirty exists 2024-03-30T12:23:04.186 INFO:tasks.rados.rados.0.smithi084.stdout:299: left oid 12 (ObjNum 123 snap 27 seq_num 123) 2024-03-30T12:23:04.189 INFO:tasks.rados.rados.0.smithi084.stdout:301: finishing copy_from to smithi08477944-17 2024-03-30T12:23:04.189 INFO:tasks.rados.rados.0.smithi084.stdout:301: got expected ENOENT (src dne) 2024-03-30T12:23:04.189 INFO:tasks.rados.rados.0.smithi084.stdout:301: finishing copy_from racing read to smithi08477944-17 2024-03-30T12:23:04.190 INFO:tasks.rados.rados.0.smithi084.stdout:302: finishing copy_from racing read to smithi08477944-21 2024-03-30T12:23:04.192 INFO:tasks.rados.rados.0.smithi084.stdout:302: finishing copy_from to smithi08477944-21 2024-03-30T12:23:04.192 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 30 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-03-30T12:23:04.342 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:04 smithi162 ceph-mon[30421]: osdmap e120: 8 total, 8 up, 8 in 2024-03-30T12:23:04.342 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:04 smithi162 ceph-mon[30421]: Upgrade: Updating mgr.x 2024-03-30T12:23:04.342 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:04 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:04.342 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:04 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:23:04.342 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:04 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:23:04.342 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:04 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T12:23:04.342 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:04 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:23:04.342 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:04 smithi162 ceph-mon[30421]: Deploying daemon mgr.x on smithi162 2024-03-30T12:23:04.342 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:04 smithi162 ceph-mon[30421]: pgmap v162: 121 pgs: 121 active+clean; 93 MiB data, 380 MiB used, 715 GiB / 715 GiB avail; 6.0 MiB/s rd, 2.5 MiB/s wr, 24 op/s 2024-03-30T12:23:04.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:04 smithi084 ceph-mon[37565]: osdmap e120: 8 total, 8 up, 8 in 2024-03-30T12:23:04.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:04 smithi084 ceph-mon[37565]: Upgrade: Updating mgr.x 2024-03-30T12:23:04.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:04 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:04.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:04 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:23:04.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:04 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:23:04.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:04 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T12:23:04.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:04 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:23:04.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:04 smithi084 ceph-mon[37565]: Deploying daemon mgr.x on smithi162 2024-03-30T12:23:04.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:04 smithi084 ceph-mon[37565]: pgmap v162: 121 pgs: 121 active+clean; 93 MiB data, 380 MiB used, 715 GiB / 715 GiB avail; 6.0 MiB/s rd, 2.5 MiB/s wr, 24 op/s 2024-03-30T12:23:04.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:04 smithi084 ceph-mon[27000]: osdmap e120: 8 total, 8 up, 8 in 2024-03-30T12:23:04.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:04 smithi084 ceph-mon[27000]: Upgrade: Updating mgr.x 2024-03-30T12:23:04.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:04 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:04.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:04 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:23:04.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:04 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:23:04.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:04 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T12:23:04.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:04 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:23:04.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:04 smithi084 ceph-mon[27000]: Deploying daemon mgr.x on smithi162 2024-03-30T12:23:04.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:04 smithi084 ceph-mon[27000]: pgmap v162: 121 pgs: 121 active+clean; 93 MiB data, 380 MiB used, 715 GiB / 715 GiB avail; 6.0 MiB/s rd, 2.5 MiB/s wr, 24 op/s 2024-03-30T12:23:05.027 INFO:tasks.rados.rados.0.smithi084.stdout:297: done (5 left) 2024-03-30T12:23:05.028 INFO:tasks.rados.rados.0.smithi084.stdout:298: done (4 left) 2024-03-30T12:23:05.028 INFO:tasks.rados.rados.0.smithi084.stdout:299: done (3 left) 2024-03-30T12:23:05.028 INFO:tasks.rados.rados.0.smithi084.stdout:301: done (2 left) 2024-03-30T12:23:05.028 INFO:tasks.rados.rados.0.smithi084.stdout:302: done (1 left) 2024-03-30T12:23:05.028 INFO:tasks.rados.rados.0.smithi084.stdout:303: done (0 left) 2024-03-30T12:23:05.029 INFO:tasks.rados.rados.0.smithi084.stdout:304: read oid 15 snap -1 2024-03-30T12:23:05.029 INFO:tasks.rados.rados.0.smithi084.stdout:304: expect (ObjNum 63 snap 6 seq_num 63) 2024-03-30T12:23:05.029 INFO:tasks.rados.rados.0.smithi084.stdout:305: copy_from oid 3 from oid 47 current snap is 28 2024-03-30T12:23:05.029 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 28 2024-03-30T12:23:05.029 INFO:tasks.rados.rados.0.smithi084.stdout:306: seq_num 124 ranges {761856=483328,1245184=458752,1703936=598016,2301952=548864} 2024-03-30T12:23:05.034 INFO:tasks.rados.rados.0.smithi084.stdout:306: writing smithi08477944-38 from 761856 to 1245184 tid 1 2024-03-30T12:23:05.037 INFO:tasks.rados.rados.0.smithi084.stdout:306: writing smithi08477944-38 from 1245184 to 1703936 tid 2 2024-03-30T12:23:05.041 INFO:tasks.rados.rados.0.smithi084.stdout:306: writing smithi08477944-38 from 1703936 to 2301952 tid 3 2024-03-30T12:23:05.045 INFO:tasks.rados.rados.0.smithi084.stdout:306: writing smithi08477944-38 from 2301952 to 2850816 tid 4 2024-03-30T12:23:05.046 INFO:tasks.rados.rados.0.smithi084.stdout:307: read oid 39 snap -1 2024-03-30T12:23:05.046 INFO:tasks.rados.rados.0.smithi084.stdout:307: expect (ObjNum 118 snap 26 seq_num 118) 2024-03-30T12:23:05.046 INFO:tasks.rados.rados.0.smithi084.stdout:308: rmattr oid 46 current snap is 28 2024-03-30T12:23:05.046 INFO:tasks.rados.rados.0.smithi084.stdout:304: expect (ObjNum 63 snap 6 seq_num 63) 2024-03-30T12:23:05.083 INFO:tasks.rados.rados.0.smithi084.stdout:306: finishing write tid 1 to smithi08477944-38 2024-03-30T12:23:05.083 INFO:tasks.rados.rados.0.smithi084.stdout:305: finishing copy_from racing read to smithi08477944-3 2024-03-30T12:23:05.083 INFO:tasks.rados.rados.0.smithi084.stdout:306: finishing write tid 2 to smithi08477944-38 2024-03-30T12:23:05.084 INFO:tasks.rados.rados.0.smithi084.stdout:305: finishing copy_from to smithi08477944-3 2024-03-30T12:23:05.084 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 85 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-03-30T12:23:05.084 INFO:tasks.rados.rados.0.smithi084.stdout:306: finishing write tid 3 to smithi08477944-38 2024-03-30T12:23:05.084 INFO:tasks.rados.rados.0.smithi084.stdout:306: finishing write tid 4 to smithi08477944-38 2024-03-30T12:23:05.084 INFO:tasks.rados.rados.0.smithi084.stdout:304: done (4 left) 2024-03-30T12:23:05.084 INFO:tasks.rados.rados.0.smithi084.stdout:305: done (3 left) 2024-03-30T12:23:05.084 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 28 2024-03-30T12:23:05.084 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 132 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-03-30T12:23:05.084 INFO:tasks.rados.rados.0.smithi084.stdout:309: seq_num 125 ranges {5292032=499712,5791744=745472,6537216=409600,6946816=450560} 2024-03-30T12:23:05.113 INFO:tasks.rados.rados.0.smithi084.stdout:309: writing smithi08477944-12 from 5292032 to 5791744 tid 1 2024-03-30T12:23:05.117 INFO:tasks.rados.rados.0.smithi084.stdout:309: writing smithi08477944-12 from 5791744 to 6537216 tid 2 2024-03-30T12:23:05.119 INFO:tasks.rados.rados.0.smithi084.stdout:309: writing smithi08477944-12 from 6537216 to 6946816 tid 3 2024-03-30T12:23:05.123 INFO:tasks.rados.rados.0.smithi084.stdout:309: writing smithi08477944-12 from 6946816 to 7397376 tid 4 2024-03-30T12:23:05.123 INFO:tasks.rados.rados.0.smithi084.stdout:308: done (3 left) 2024-03-30T12:23:05.123 INFO:tasks.rados.rados.0.smithi084.stdout:310: read oid 36 snap -1 2024-03-30T12:23:05.123 INFO:tasks.rados.rados.0.smithi084.stdout:310: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-30T12:23:05.123 INFO:tasks.rados.rados.0.smithi084.stdout:311: setattr oid 29 current snap is 28 2024-03-30T12:23:05.123 INFO:tasks.rados.rados.0.smithi084.stdout:306: finishing write tid 5 to smithi08477944-38 2024-03-30T12:23:05.123 INFO:tasks.rados.rados.0.smithi084.stdout:306: finishing write tid 6 to smithi08477944-38 2024-03-30T12:23:05.123 INFO:tasks.rados.rados.0.smithi084.stdout:306: oid 38 updating version 0 to 61 2024-03-30T12:23:05.123 INFO:tasks.rados.rados.0.smithi084.stdout:306: oid 38 version 61 is already newer than 59 2024-03-30T12:23:05.123 INFO:tasks.rados.rados.0.smithi084.stdout:306: oid 38 version 61 is already newer than 60 2024-03-30T12:23:05.123 INFO:tasks.rados.rados.0.smithi084.stdout:306: oid 38 updating version 61 to 62 2024-03-30T12:23:05.124 INFO:tasks.rados.rados.0.smithi084.stdout:306: oid 38 version 62 is already newer than 58 2024-03-30T12:23:05.124 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 62 (ObjNum 124 snap 28 seq_num 124) dirty exists 2024-03-30T12:23:05.124 INFO:tasks.rados.rados.0.smithi084.stdout:306: left oid 38 (ObjNum 124 snap 28 seq_num 124) 2024-03-30T12:23:05.124 INFO:tasks.rados.rados.0.smithi084.stdout:307: expect (ObjNum 118 snap 26 seq_num 118) 2024-03-30T12:23:05.245 INFO:tasks.rados.rados.0.smithi084.stdout:309: finishing write tid 1 to smithi08477944-12 2024-03-30T12:23:05.245 INFO:tasks.rados.rados.0.smithi084.stdout:309: finishing write tid 2 to smithi08477944-12 2024-03-30T12:23:05.245 INFO:tasks.rados.rados.0.smithi084.stdout:309: finishing write tid 3 to smithi08477944-12 2024-03-30T12:23:05.245 INFO:tasks.rados.rados.0.smithi084.stdout:309: finishing write tid 4 to smithi08477944-12 2024-03-30T12:23:05.245 INFO:tasks.rados.rados.0.smithi084.stdout:309: finishing write tid 5 to smithi08477944-12 2024-03-30T12:23:05.245 INFO:tasks.rados.rados.0.smithi084.stdout:309: finishing write tid 6 to smithi08477944-12 2024-03-30T12:23:05.245 INFO:tasks.rados.rados.0.smithi084.stdout:309: oid 12 updating version 0 to 70 2024-03-30T12:23:05.246 INFO:tasks.rados.rados.0.smithi084.stdout:309: oid 12 version 70 is already newer than 67 2024-03-30T12:23:05.246 INFO:tasks.rados.rados.0.smithi084.stdout:309: oid 12 version 70 is already newer than 69 2024-03-30T12:23:05.246 INFO:tasks.rados.rados.0.smithi084.stdout:309: oid 12 version 70 is already newer than 68 2024-03-30T12:23:05.246 INFO:tasks.rados.rados.0.smithi084.stdout:309: oid 12 version 70 is already newer than 66 2024-03-30T12:23:05.246 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 70 (ObjNum 125 snap 28 seq_num 125) dirty exists 2024-03-30T12:23:05.246 INFO:tasks.rados.rados.0.smithi084.stdout:309: left oid 12 (ObjNum 125 snap 28 seq_num 125) 2024-03-30T12:23:05.246 INFO:tasks.rados.rados.0.smithi084.stdout:310: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-30T12:23:05.267 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 101 (ObjNum 289 snap 0 seq_num 1) dirty exists 2024-03-30T12:23:05.267 INFO:tasks.rados.rados.0.smithi084.stdout:306: done (4 left) 2024-03-30T12:23:05.267 INFO:tasks.rados.rados.0.smithi084.stdout:307: done (3 left) 2024-03-30T12:23:05.267 INFO:tasks.rados.rados.0.smithi084.stdout:309: done (2 left) 2024-03-30T12:23:05.268 INFO:tasks.rados.rados.0.smithi084.stdout:310: done (1 left) 2024-03-30T12:23:05.268 INFO:tasks.rados.rados.0.smithi084.stdout:311: done (0 left) 2024-03-30T12:23:05.268 INFO:tasks.rados.rados.0.smithi084.stdout:312: delete oid 13 current snap is 28 2024-03-30T12:23:05.269 INFO:tasks.rados.rados.0.smithi084.stdout:312: done (0 left) 2024-03-30T12:23:05.269 INFO:tasks.rados.rados.0.smithi084.stdout:313: copy_from oid 48 from oid 31 current snap is 28 2024-03-30T12:23:05.269 INFO:tasks.rados.rados.0.smithi084.stdout:314: snap_create 2024-03-30T12:23:05.270 INFO:tasks.rados.rados.0.smithi084.stdout:313: finishing copy_from to smithi08477944-48 2024-03-30T12:23:05.270 INFO:tasks.rados.rados.0.smithi084.stdout:313: got expected ENOENT (src dne) 2024-03-30T12:23:05.270 INFO:tasks.rados.rados.0.smithi084.stdout:313: finishing copy_from racing read to smithi08477944-48 2024-03-30T12:23:05.362 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:05 smithi162 systemd[1]: Stopping Ceph mgr.x for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:23:05.363 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:05 smithi162 ceph-mon[30421]: osdmap e121: 8 total, 8 up, 8 in 2024-03-30T12:23:05.363 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:05 smithi162 ceph-mon[30421]: osdmap e122: 8 total, 8 up, 8 in 2024-03-30T12:23:05.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:05 smithi084 ceph-mon[37565]: osdmap e121: 8 total, 8 up, 8 in 2024-03-30T12:23:05.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:05 smithi084 ceph-mon[37565]: osdmap e122: 8 total, 8 up, 8 in 2024-03-30T12:23:05.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:05 smithi084 ceph-mon[27000]: osdmap e121: 8 total, 8 up, 8 in 2024-03-30T12:23:05.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:05 smithi084 ceph-mon[27000]: osdmap e122: 8 total, 8 up, 8 in 2024-03-30T12:23:05.620 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:05 smithi162 podman[63497]: 2024-03-30 12:23:05.371317925 +0000 UTC m=+0.174677349 container died d0e0c63b20de6a4549772fff6c7096a2a94c58bc282710d00d3c418c6553c1d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=reef-f14b568, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-03-30T12:23:05.990 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:05 smithi162 podman[63497]: 2024-03-30 12:23:05.731979423 +0000 UTC m=+0.535338836 container cleanup d0e0c63b20de6a4549772fff6c7096a2a94c58bc282710d00d3c418c6553c1d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=reef-f14b568, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T12:23:05.991 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:05 smithi162 bash[63497]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x 2024-03-30T12:23:06.184 INFO:tasks.rados.rados.0.smithi084.stdout:313: done (1 left) 2024-03-30T12:23:06.185 INFO:tasks.rados.rados.0.smithi084.stdout:314: done (0 left) 2024-03-30T12:23:06.185 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 29 2024-03-30T12:23:06.185 INFO:tasks.rados.rados.0.smithi084.stdout:315: seq_num 127 ranges {745472=532480,1277952=507904,1785856=778240,2564096=319488} 2024-03-30T12:23:06.191 INFO:tasks.rados.rados.0.smithi084.stdout:315: writing smithi08477944-45 from 745472 to 1277952 tid 1 2024-03-30T12:23:06.194 INFO:tasks.rados.rados.0.smithi084.stdout:315: writing smithi08477944-45 from 1277952 to 1785856 tid 2 2024-03-30T12:23:06.199 INFO:tasks.rados.rados.0.smithi084.stdout:315: writing smithi08477944-45 from 1785856 to 2564096 tid 3 2024-03-30T12:23:06.201 INFO:tasks.rados.rados.0.smithi084.stdout:315: writing smithi08477944-45 from 2564096 to 2883584 tid 4 2024-03-30T12:23:06.201 INFO:tasks.rados.rados.0.smithi084.stdout:316: rmattr oid 33 current snap is 29 2024-03-30T12:23:06.201 INFO:tasks.rados.rados.0.smithi084.stdout:316: done (1 left) 2024-03-30T12:23:06.201 INFO:tasks.rados.rados.0.smithi084.stdout:317: read oid 50 snap -1 2024-03-30T12:23:06.202 INFO:tasks.rados.rados.0.smithi084.stdout:317: expect (ObjNum 116 snap 26 seq_num 116) 2024-03-30T12:23:06.202 INFO:tasks.rados.rados.0.smithi084.stdout:318: read oid 7 snap -1 2024-03-30T12:23:06.202 INFO:tasks.rados.rados.0.smithi084.stdout:318: expect (ObjNum 6 snap 0 seq_num 6) 2024-03-30T12:23:06.202 INFO:tasks.rados.rados.0.smithi084.stdout:319: setattr oid 25 current snap is 29 2024-03-30T12:23:06.202 INFO:tasks.rados.rados.0.smithi084.stdout:315: finishing write tid 1 to smithi08477944-45 2024-03-30T12:23:06.202 INFO:tasks.rados.rados.0.smithi084.stdout:315: finishing write tid 2 to smithi08477944-45 2024-03-30T12:23:06.204 INFO:tasks.rados.rados.0.smithi084.stdout:315: finishing write tid 3 to smithi08477944-45 2024-03-30T12:23:06.204 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 29 2024-03-30T12:23:06.204 INFO:tasks.rados.rados.0.smithi084.stdout:320: seq_num 128 ranges {458752=548864,1007616=794624,1802240=581632,2383872=229376} 2024-03-30T12:23:06.209 INFO:tasks.rados.rados.0.smithi084.stdout:320: writing smithi08477944-35 from 458752 to 1007616 tid 1 2024-03-30T12:23:06.214 INFO:tasks.rados.rados.0.smithi084.stdout:320: writing smithi08477944-35 from 1007616 to 1802240 tid 2 2024-03-30T12:23:06.217 INFO:tasks.rados.rados.0.smithi084.stdout:320: writing smithi08477944-35 from 1802240 to 2383872 tid 3 2024-03-30T12:23:06.219 INFO:tasks.rados.rados.0.smithi084.stdout:320: writing smithi08477944-35 from 2383872 to 2613248 tid 4 2024-03-30T12:23:06.219 INFO:tasks.rados.rados.0.smithi084.stdout:321: snap_create 2024-03-30T12:23:06.219 INFO:tasks.rados.rados.0.smithi084.stdout:318: expect (ObjNum 6 snap 0 seq_num 6) 2024-03-30T12:23:06.223 INFO:tasks.rados.rados.0.smithi084.stdout:315: finishing write tid 4 to smithi08477944-45 2024-03-30T12:23:06.223 INFO:tasks.rados.rados.0.smithi084.stdout:315: finishing write tid 5 to smithi08477944-45 2024-03-30T12:23:06.223 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 91 (ObjNum 101 snap 22 seq_num 101) dirty exists 2024-03-30T12:23:06.223 INFO:tasks.rados.rados.0.smithi084.stdout:315: finishing write tid 6 to smithi08477944-45 2024-03-30T12:23:06.223 INFO:tasks.rados.rados.0.smithi084.stdout:315: oid 45 updating version 0 to 143 2024-03-30T12:23:06.223 INFO:tasks.rados.rados.0.smithi084.stdout:315: oid 45 updating version 143 to 147 2024-03-30T12:23:06.223 INFO:tasks.rados.rados.0.smithi084.stdout:315: oid 45 version 147 is already newer than 145 2024-03-30T12:23:06.223 INFO:tasks.rados.rados.0.smithi084.stdout:315: oid 45 version 147 is already newer than 146 2024-03-30T12:23:06.223 INFO:tasks.rados.rados.0.smithi084.stdout:315: oid 45 version 147 is already newer than 144 2024-03-30T12:23:06.223 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 147 (ObjNum 127 snap 29 seq_num 127) dirty exists 2024-03-30T12:23:06.223 INFO:tasks.rados.rados.0.smithi084.stdout:315: left oid 45 (ObjNum 127 snap 29 seq_num 127) 2024-03-30T12:23:06.223 INFO:tasks.rados.rados.0.smithi084.stdout:320: finishing write tid 1 to smithi08477944-35 2024-03-30T12:23:06.224 INFO:tasks.rados.rados.0.smithi084.stdout:317: expect (ObjNum 116 snap 26 seq_num 116) 2024-03-30T12:23:06.306 INFO:tasks.rados.rados.0.smithi084.stdout:320: finishing write tid 2 to smithi08477944-35 2024-03-30T12:23:06.306 INFO:tasks.rados.rados.0.smithi084.stdout:320: finishing write tid 3 to smithi08477944-35 2024-03-30T12:23:06.307 INFO:tasks.rados.rados.0.smithi084.stdout:320: finishing write tid 4 to smithi08477944-35 2024-03-30T12:23:06.307 INFO:tasks.rados.rados.0.smithi084.stdout:320: finishing write tid 5 to smithi08477944-35 2024-03-30T12:23:06.307 INFO:tasks.rados.rados.0.smithi084.stdout:320: finishing write tid 6 to smithi08477944-35 2024-03-30T12:23:06.307 INFO:tasks.rados.rados.0.smithi084.stdout:320: oid 35 updating version 0 to 45 2024-03-30T12:23:06.307 INFO:tasks.rados.rados.0.smithi084.stdout:320: oid 35 version 45 is already newer than 42 2024-03-30T12:23:06.307 INFO:tasks.rados.rados.0.smithi084.stdout:320: oid 35 version 45 is already newer than 43 2024-03-30T12:23:06.307 INFO:tasks.rados.rados.0.smithi084.stdout:320: oid 35 version 45 is already newer than 41 2024-03-30T12:23:06.307 INFO:tasks.rados.rados.0.smithi084.stdout:320: oid 35 version 45 is already newer than 44 2024-03-30T12:23:06.307 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 45 (ObjNum 128 snap 29 seq_num 128) dirty exists 2024-03-30T12:23:06.307 INFO:tasks.rados.rados.0.smithi084.stdout:320: left oid 35 (ObjNum 128 snap 29 seq_num 128) 2024-03-30T12:23:06.342 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:06 smithi162 ceph-mon[30421]: pgmap v165: 121 pgs: 121 active+clean; 93 MiB data, 380 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:23:06.342 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:06 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:23:06.342 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:05 smithi162 podman[63511]: 2024-03-30 12:23:05.999865301 +0000 UTC m=+0.628708398 container remove d0e0c63b20de6a4549772fff6c7096a2a94c58bc282710d00d3c418c6553c1d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, RELEASE=reef-f14b568, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-03-30T12:23:06.342 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:06 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-03-30T12:23:06.342 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:06 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mgr.x.service: Failed with result 'exit-code'. 2024-03-30T12:23:06.342 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:06 smithi162 systemd[1]: Stopped Ceph mgr.x for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:23:06.343 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:06 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mgr.x.service: Consumed 18.185s CPU time. 2024-03-30T12:23:06.343 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:06 smithi162 systemd[1]: Starting Ceph mgr.x for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:23:06.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:06 smithi084 ceph-mon[37565]: pgmap v165: 121 pgs: 121 active+clean; 93 MiB data, 380 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:23:06.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:06 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:23:06.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:06 smithi084 ceph-mon[27000]: pgmap v165: 121 pgs: 121 active+clean; 93 MiB data, 380 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:23:06.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:06 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:23:06.620 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:06 smithi162 podman[63645]: 2024-03-30 12:23:06.468113423 +0000 UTC m=+0.018093806 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:23:06.620 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:06 smithi162 podman[63645]: 2024-03-30 12:23:06.600984128 +0000 UTC m=+0.150964512 container create a9cc7956ea1df53fd892f4e9f251d84d57221871711afb77adf81b684827ef22 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-03-30T12:23:07.188 INFO:tasks.rados.rados.0.smithi084.stdout:315: done (5 left) 2024-03-30T12:23:07.188 INFO:tasks.rados.rados.0.smithi084.stdout:317: done (4 left) 2024-03-30T12:23:07.188 INFO:tasks.rados.rados.0.smithi084.stdout:318: done (3 left) 2024-03-30T12:23:07.188 INFO:tasks.rados.rados.0.smithi084.stdout:319: done (2 left) 2024-03-30T12:23:07.188 INFO:tasks.rados.rados.0.smithi084.stdout:320: done (1 left) 2024-03-30T12:23:07.188 INFO:tasks.rados.rados.0.smithi084.stdout:321: done (0 left) 2024-03-30T12:23:07.188 INFO:tasks.rados.rados.0.smithi084.stdout:322: read oid 25 snap 20 2024-03-30T12:23:07.188 INFO:tasks.rados.rados.0.smithi084.stdout:322: expect (ObjNum 50 snap 0 seq_num 50) 2024-03-30T12:23:07.189 INFO:tasks.rados.rados.0.smithi084.stdout:323: snap_remove snap 10 2024-03-30T12:23:07.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:07 smithi162 ceph-mon[30421]: osdmap e123: 8 total, 8 up, 8 in 2024-03-30T12:23:07.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:07 smithi162 podman[63645]: 2024-03-30 12:23:07.095758094 +0000 UTC m=+0.645738476 container init a9cc7956ea1df53fd892f4e9f251d84d57221871711afb77adf81b684827ef22 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=) 2024-03-30T12:23:07.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:07 smithi162 podman[63645]: 2024-03-30 12:23:07.098929984 +0000 UTC m=+0.648910367 container start a9cc7956ea1df53fd892f4e9f251d84d57221871711afb77adf81b684827ef22 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3) 2024-03-30T12:23:07.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:07 smithi162 ceph-mgr[63663]: -- 172.21.15.162:0/1859094288 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55db7a2a25a0 con 0x55db7a276c00 2024-03-30T12:23:07.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:07 smithi162 bash[63645]: a9cc7956ea1df53fd892f4e9f251d84d57221871711afb77adf81b684827ef22 2024-03-30T12:23:07.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:07 smithi162 systemd[1]: Started Ceph mgr.x for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:23:07.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:07 smithi084 ceph-mon[27000]: osdmap e123: 8 total, 8 up, 8 in 2024-03-30T12:23:07.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:07 smithi084 ceph-mon[37565]: osdmap e123: 8 total, 8 up, 8 in 2024-03-30T12:23:07.933 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:07.689+0000 7eff54e9d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T12:23:07.934 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:07.791+0000 7eff54e9d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T12:23:08.199 INFO:tasks.rados.rados.0.smithi084.stdout:323: done (1 left) 2024-03-30T12:23:08.199 INFO:tasks.rados.rados.0.smithi084.stdout:324: copy_from oid 9 from oid 36 current snap is 30 2024-03-30T12:23:08.199 INFO:tasks.rados.rados.0.smithi084.stdout:325: snap_create 2024-03-30T12:23:08.199 INFO:tasks.rados.rados.0.smithi084.stdout:322: expect (ObjNum 50 snap 0 seq_num 50) 2024-03-30T12:23:08.248 INFO:tasks.rados.rados.0.smithi084.stdout:324: finishing copy_from racing read to smithi08477944-9 2024-03-30T12:23:08.248 INFO:tasks.rados.rados.0.smithi084.stdout:324: finishing copy_from to smithi08477944-9 2024-03-30T12:23:08.248 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 30 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-03-30T12:23:08.476 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:08 smithi162 ceph-mon[30421]: osdmap e124: 8 total, 8 up, 8 in 2024-03-30T12:23:08.476 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:08 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:08.476 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:08 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:08.476 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:08 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:08.476 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:08 smithi162 ceph-mon[30421]: pgmap v168: 121 pgs: 121 active+clean; 110 MiB data, 408 MiB used, 715 GiB / 715 GiB avail; 6.9 MiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-03-30T12:23:08.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:08 smithi084 ceph-mon[37565]: osdmap e124: 8 total, 8 up, 8 in 2024-03-30T12:23:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:08 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:08 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:08 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:08 smithi084 ceph-mon[37565]: pgmap v168: 121 pgs: 121 active+clean; 110 MiB data, 408 MiB used, 715 GiB / 715 GiB avail; 6.9 MiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-03-30T12:23:08.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:08 smithi084 ceph-mon[27000]: osdmap e124: 8 total, 8 up, 8 in 2024-03-30T12:23:08.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:08 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:08.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:08 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:08.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:08 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:08.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:08 smithi084 ceph-mon[27000]: pgmap v168: 121 pgs: 121 active+clean; 110 MiB data, 408 MiB used, 715 GiB / 715 GiB avail; 6.9 MiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-03-30T12:23:08.778 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:08.484+0000 7eff54e9d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T12:23:08.779 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:08.581+0000 7eff54e9d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T12:23:08.779 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:08.731+0000 7eff54e9d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T12:23:09.119 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:08.839+0000 7eff54e9d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T12:23:09.120 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:08.930+0000 7eff54e9d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T12:23:09.217 INFO:tasks.rados.rados.0.smithi084.stdout:322: done (2 left) 2024-03-30T12:23:09.217 INFO:tasks.rados.rados.0.smithi084.stdout:324: done (1 left) 2024-03-30T12:23:09.217 INFO:tasks.rados.rados.0.smithi084.stdout:325: done (0 left) 2024-03-30T12:23:09.217 INFO:tasks.rados.rados.0.smithi084.stdout:326: snap_remove snap 28 2024-03-30T12:23:09.470 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:09 smithi162 ceph-mon[30421]: osdmap e125: 8 total, 8 up, 8 in 2024-03-30T12:23:09.471 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:09.235+0000 7eff54e9d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T12:23:09.471 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:09.365+0000 7eff54e9d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T12:23:09.471 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:09.479+0000 7eff54e9d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T12:23:09.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:09 smithi084 ceph-mon[37565]: osdmap e125: 8 total, 8 up, 8 in 2024-03-30T12:23:09.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:09 smithi084 ceph-mon[27000]: osdmap e125: 8 total, 8 up, 8 in 2024-03-30T12:23:09.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:23:09] "GET /metrics HTTP/1.1" 200 36005 "" "Prometheus/2.43.0" 2024-03-30T12:23:09.761 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:09.579+0000 7eff54e9d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T12:23:10.028 INFO:tasks.rados.rados.0.smithi084.stdout:326: done (0 left) 2024-03-30T12:23:10.028 INFO:tasks.rados.rados.0.smithi084.stdout:327: snap_remove snap 20 2024-03-30T12:23:10.120 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:09.769+0000 7eff54e9d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T12:23:10.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:10 smithi084 ceph-mon[37565]: osdmap e126: 8 total, 8 up, 8 in 2024-03-30T12:23:10.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:10 smithi084 ceph-mon[37565]: pgmap v171: 121 pgs: 121 active+clean; 110 MiB data, 408 MiB used, 715 GiB / 715 GiB avail; 6.9 MiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-03-30T12:23:10.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:10 smithi084 ceph-mon[37565]: osdmap e127: 8 total, 8 up, 8 in 2024-03-30T12:23:10.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:10 smithi084 ceph-mon[27000]: osdmap e126: 8 total, 8 up, 8 in 2024-03-30T12:23:10.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:10 smithi084 ceph-mon[27000]: pgmap v171: 121 pgs: 121 active+clean; 110 MiB data, 408 MiB used, 715 GiB / 715 GiB avail; 6.9 MiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-03-30T12:23:10.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:10 smithi084 ceph-mon[27000]: osdmap e127: 8 total, 8 up, 8 in 2024-03-30T12:23:10.511 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:10 smithi162 ceph-mon[30421]: osdmap e126: 8 total, 8 up, 8 in 2024-03-30T12:23:10.511 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:10 smithi162 ceph-mon[30421]: pgmap v171: 121 pgs: 121 active+clean; 110 MiB data, 408 MiB used, 715 GiB / 715 GiB avail; 6.9 MiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-03-30T12:23:10.511 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:10 smithi162 ceph-mon[30421]: osdmap e127: 8 total, 8 up, 8 in 2024-03-30T12:23:11.037 INFO:tasks.rados.rados.0.smithi084.stdout:327: done (0 left) 2024-03-30T12:23:11.037 INFO:tasks.rados.rados.0.smithi084.stdout:328: copy_from oid 43 from oid 3 current snap is 31 2024-03-30T12:23:11.037 INFO:tasks.rados.rados.0.smithi084.stdout:329: read oid 37 snap -1 2024-03-30T12:23:11.037 INFO:tasks.rados.rados.0.smithi084.stdout:329: expect (ObjNum 122 snap 27 seq_num 122) 2024-03-30T12:23:11.037 INFO:tasks.rados.rados.0.smithi084.stdout:330: delete oid 12 current snap is 31 2024-03-30T12:23:11.046 INFO:tasks.rados.rados.0.smithi084.stdout:330: done (2 left) 2024-03-30T12:23:11.046 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 31 2024-03-30T12:23:11.046 INFO:tasks.rados.rados.0.smithi084.stdout:331: seq_num 130 ranges {0=581632,581632=614400,1196032=598016,1794048=393216} 2024-03-30T12:23:11.053 INFO:tasks.rados.rados.0.smithi084.stdout:331: writing smithi08477944-13 from 0 to 581632 tid 1 2024-03-30T12:23:11.053 INFO:tasks.rados.rados.0.smithi084.stdout:331: writing smithi08477944-13 from 581632 to 1196032 tid 2 2024-03-30T12:23:11.056 INFO:tasks.rados.rados.0.smithi084.stdout:331: writing smithi08477944-13 from 1196032 to 1794048 tid 3 2024-03-30T12:23:11.059 INFO:tasks.rados.rados.0.smithi084.stdout:331: writing smithi08477944-13 from 1794048 to 2187264 tid 4 2024-03-30T12:23:11.059 INFO:tasks.rados.rados.0.smithi084.stdout:332: delete oid 9 current snap is 31 2024-03-30T12:23:11.060 INFO:tasks.rados.rados.0.smithi084.stdout:331: finishing write tid 1 to smithi08477944-13 2024-03-30T12:23:11.060 INFO:tasks.rados.rados.0.smithi084.stdout:331: finishing write tid 2 to smithi08477944-13 2024-03-30T12:23:11.060 INFO:tasks.rados.rados.0.smithi084.stdout:328: finishing copy_from racing read to smithi08477944-43 2024-03-30T12:23:11.060 INFO:tasks.rados.rados.0.smithi084.stdout:329: expect (ObjNum 122 snap 27 seq_num 122) 2024-03-30T12:23:11.115 INFO:tasks.rados.rados.0.smithi084.stdout:331: finishing write tid 3 to smithi08477944-13 2024-03-30T12:23:11.115 INFO:tasks.rados.rados.0.smithi084.stdout:328: finishing copy_from to smithi08477944-43 2024-03-30T12:23:11.115 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 85 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-03-30T12:23:11.115 INFO:tasks.rados.rados.0.smithi084.stdout:331: finishing write tid 4 to smithi08477944-13 2024-03-30T12:23:11.115 INFO:tasks.rados.rados.0.smithi084.stdout:328: done (3 left) 2024-03-30T12:23:11.115 INFO:tasks.rados.rados.0.smithi084.stdout:329: done (2 left) 2024-03-30T12:23:11.115 INFO:tasks.rados.rados.0.smithi084.stdout:332: done (1 left) 2024-03-30T12:23:11.115 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 31 2024-03-30T12:23:11.115 INFO:tasks.rados.rados.0.smithi084.stdout:331: finishing write tid 5 to smithi08477944-13 2024-03-30T12:23:11.115 INFO:tasks.rados.rados.0.smithi084.stdout:333: seq_num 132 ranges {2097152=614400,2711552=786432,3497984=565248,4063232=253952} 2024-03-30T12:23:11.119 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:10.794+0000 7eff54e9d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T12:23:11.119 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:10.929+0000 7eff54e9d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T12:23:11.129 INFO:tasks.rados.rados.0.smithi084.stdout:333: writing smithi08477944-37 from 2097152 to 2711552 tid 1 2024-03-30T12:23:11.133 INFO:tasks.rados.rados.0.smithi084.stdout:333: writing smithi08477944-37 from 2711552 to 3497984 tid 2 2024-03-30T12:23:11.136 INFO:tasks.rados.rados.0.smithi084.stdout:333: writing smithi08477944-37 from 3497984 to 4063232 tid 3 2024-03-30T12:23:11.138 INFO:tasks.rados.rados.0.smithi084.stdout:333: writing smithi08477944-37 from 4063232 to 4317184 tid 4 2024-03-30T12:23:11.138 INFO:tasks.rados.rados.0.smithi084.stdout:334: copy_from oid 22 from oid 21 current snap is 31 2024-03-30T12:23:11.138 INFO:tasks.rados.rados.0.smithi084.stdout:331: finishing write tid 6 to smithi08477944-13 2024-03-30T12:23:11.138 INFO:tasks.rados.rados.0.smithi084.stdout:331: oid 13 updating version 0 to 33 2024-03-30T12:23:11.138 INFO:tasks.rados.rados.0.smithi084.stdout:331: oid 13 updating version 33 to 35 2024-03-30T12:23:11.138 INFO:tasks.rados.rados.0.smithi084.stdout:331: oid 13 updating version 35 to 37 2024-03-30T12:23:11.138 INFO:tasks.rados.rados.0.smithi084.stdout:331: oid 13 version 37 is already newer than 34 2024-03-30T12:23:11.139 INFO:tasks.rados.rados.0.smithi084.stdout:331: oid 13 version 37 is already newer than 36 2024-03-30T12:23:11.139 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 37 (ObjNum 130 snap 31 seq_num 130) dirty exists 2024-03-30T12:23:11.139 INFO:tasks.rados.rados.0.smithi084.stdout:331: left oid 13 (ObjNum 130 snap 31 seq_num 130) 2024-03-30T12:23:11.139 INFO:tasks.rados.rados.0.smithi084.stdout:333: finishing write tid 1 to smithi08477944-37 2024-03-30T12:23:11.139 INFO:tasks.rados.rados.0.smithi084.stdout:333: finishing write tid 2 to smithi08477944-37 2024-03-30T12:23:11.139 INFO:tasks.rados.rados.0.smithi084.stdout:331: done (2 left) 2024-03-30T12:23:11.139 INFO:tasks.rados.rados.0.smithi084.stdout:335: setattr oid 43 current snap is 31 2024-03-30T12:23:11.140 INFO:tasks.rados.rados.0.smithi084.stdout:336: read oid 34 snap -1 2024-03-30T12:23:11.140 INFO:tasks.rados.rados.0.smithi084.stdout:336: expect (ObjNum 99 snap 22 seq_num 99) 2024-03-30T12:23:11.140 INFO:tasks.rados.rados.0.smithi084.stdout:337: snap_create 2024-03-30T12:23:11.140 INFO:tasks.rados.rados.0.smithi084.stdout:333: finishing write tid 3 to smithi08477944-37 2024-03-30T12:23:11.140 INFO:tasks.rados.rados.0.smithi084.stdout:333: finishing write tid 4 to smithi08477944-37 2024-03-30T12:23:11.140 INFO:tasks.rados.rados.0.smithi084.stdout:333: finishing write tid 5 to smithi08477944-37 2024-03-30T12:23:11.142 INFO:tasks.rados.rados.0.smithi084.stdout:333: finishing write tid 6 to smithi08477944-37 2024-03-30T12:23:11.142 INFO:tasks.rados.rados.0.smithi084.stdout:333: oid 37 updating version 0 to 108 2024-03-30T12:23:11.142 INFO:tasks.rados.rados.0.smithi084.stdout:333: oid 37 updating version 108 to 112 2024-03-30T12:23:11.142 INFO:tasks.rados.rados.0.smithi084.stdout:333: oid 37 version 112 is already newer than 111 2024-03-30T12:23:11.142 INFO:tasks.rados.rados.0.smithi084.stdout:333: oid 37 version 112 is already newer than 110 2024-03-30T12:23:11.142 INFO:tasks.rados.rados.0.smithi084.stdout:333: oid 37 version 112 is already newer than 109 2024-03-30T12:23:11.142 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 112 (ObjNum 132 snap 31 seq_num 132) dirty exists 2024-03-30T12:23:11.142 INFO:tasks.rados.rados.0.smithi084.stdout:333: left oid 37 (ObjNum 132 snap 31 seq_num 132) 2024-03-30T12:23:11.146 INFO:tasks.rados.rados.0.smithi084.stdout:334: finishing copy_from racing read to smithi08477944-22 2024-03-30T12:23:11.147 INFO:tasks.rados.rados.0.smithi084.stdout:334: finishing copy_from to smithi08477944-22 2024-03-30T12:23:11.147 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 30 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-03-30T12:23:11.148 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 91 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-03-30T12:23:11.150 INFO:tasks.rados.rados.0.smithi084.stdout:336: expect (ObjNum 99 snap 22 seq_num 99) 2024-03-30T12:23:11.546 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:11.294+0000 7eff54e9d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T12:23:11.546 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:11.389+0000 7eff54e9d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T12:23:11.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:11.589+0000 7eff54e9d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:23:11.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:11.778+0000 7eff54e9d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T12:23:12.037 INFO:tasks.rados.rados.0.smithi084.stdout:333: done (4 left) 2024-03-30T12:23:12.037 INFO:tasks.rados.rados.0.smithi084.stdout:334: done (3 left) 2024-03-30T12:23:12.037 INFO:tasks.rados.rados.0.smithi084.stdout:335: done (2 left) 2024-03-30T12:23:12.037 INFO:tasks.rados.rados.0.smithi084.stdout:336: done (1 left) 2024-03-30T12:23:12.037 INFO:tasks.rados.rados.0.smithi084.stdout:337: done (0 left) 2024-03-30T12:23:12.038 INFO:tasks.rados.rados.0.smithi084.stdout:338: read oid 31 snap -1 2024-03-30T12:23:12.038 INFO:tasks.rados.rados.0.smithi084.stdout:338: expect deleted 2024-03-30T12:23:12.038 INFO:tasks.rados.rados.0.smithi084.stdout:339: rollback oid 22 current snap is 32 2024-03-30T12:23:12.038 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 22 to 19 2024-03-30T12:23:12.038 INFO:tasks.rados.rados.0.smithi084.stdout:340: read oid 48 snap -1 2024-03-30T12:23:12.038 INFO:tasks.rados.rados.0.smithi084.stdout:340: expect deleted 2024-03-30T12:23:12.038 INFO:tasks.rados.rados.0.smithi084.stdout:341: read oid 3 snap 30 2024-03-30T12:23:12.038 INFO:tasks.rados.rados.0.smithi084.stdout:341: expect (ObjNum 46 snap 0 seq_num 46) 2024-03-30T12:23:12.038 INFO:tasks.rados.rados.0.smithi084.stdout:342: rollback oid 45 current snap is 32 2024-03-30T12:23:12.038 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 45 to 31 2024-03-30T12:23:12.038 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 32 2024-03-30T12:23:12.038 INFO:tasks.rados.rados.0.smithi084.stdout:343: seq_num 133 ranges {1654784=630784,2285568=663552,2949120=770048,3719168=172032} 2024-03-30T12:23:12.050 INFO:tasks.rados.rados.0.smithi084.stdout:343: writing smithi08477944-2 from 1654784 to 2285568 tid 1 2024-03-30T12:23:12.053 INFO:tasks.rados.rados.0.smithi084.stdout:343: writing smithi08477944-2 from 2285568 to 2949120 tid 2 2024-03-30T12:23:12.057 INFO:tasks.rados.rados.0.smithi084.stdout:343: writing smithi08477944-2 from 2949120 to 3719168 tid 3 2024-03-30T12:23:12.059 INFO:tasks.rados.rados.0.smithi084.stdout:343: writing smithi08477944-2 from 3719168 to 3891200 tid 4 2024-03-30T12:23:12.059 INFO:tasks.rados.rados.0.smithi084.stdout:344: rmattr oid 39 current snap is 32 2024-03-30T12:23:12.059 INFO:tasks.rados.rados.0.smithi084.stdout:344: done (6 left) 2024-03-30T12:23:12.059 INFO:tasks.rados.rados.0.smithi084.stdout:345: rmattr oid 11 current snap is 32 2024-03-30T12:23:12.059 INFO:tasks.rados.rados.0.smithi084.stdout:345: done (6 left) 2024-03-30T12:23:12.059 INFO:tasks.rados.rados.0.smithi084.stdout:346: rmattr oid 16 current snap is 32 2024-03-30T12:23:12.059 INFO:tasks.rados.rados.0.smithi084.stdout:346: done (6 left) 2024-03-30T12:23:12.059 INFO:tasks.rados.rados.0.smithi084.stdout:347: copy_from oid 25 from oid 33 current snap is 32 2024-03-30T12:23:12.060 INFO:tasks.rados.rados.0.smithi084.stdout:342: finishing rollback tid 0 to smithi08477944-45 2024-03-30T12:23:12.060 INFO:tasks.rados.rados.0.smithi084.stdout:339: finishing rollback tid 0 to smithi08477944-22 2024-03-30T12:23:12.060 INFO:tasks.rados.rados.0.smithi084.stdout:338: done (6 left) 2024-03-30T12:23:12.060 INFO:tasks.rados.rados.0.smithi084.stdout:340: done (5 left) 2024-03-30T12:23:12.060 INFO:tasks.rados.rados.0.smithi084.stdout:348: delete oid 26 current snap is 32 2024-03-30T12:23:12.060 INFO:tasks.rados.rados.0.smithi084.stdout:342: finishing rollback tid 1 to smithi08477944-45 2024-03-30T12:23:12.060 INFO:tasks.rados.rados.0.smithi084.stdout:342: finishing rollback tid 2 to smithi08477944-45 2024-03-30T12:23:12.060 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 173 (ObjNum 127 snap 29 seq_num 127) dirty exists 2024-03-30T12:23:12.060 INFO:tasks.rados.rados.0.smithi084.stdout:341: expect (ObjNum 46 snap 0 seq_num 46) 2024-03-30T12:23:12.084 INFO:tasks.rados.rados.0.smithi084.stdout:339: finishing rollback tid 1 to smithi08477944-22 2024-03-30T12:23:12.084 INFO:tasks.rados.rados.0.smithi084.stdout:339: finishing rollback tid 2 to smithi08477944-22 2024-03-30T12:23:12.084 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 156 (ObjNum 82 snap 18 seq_num 82) dirty exists 2024-03-30T12:23:12.084 INFO:tasks.rados.rados.0.smithi084.stdout:343: finishing write tid 1 to smithi08477944-2 2024-03-30T12:23:12.084 INFO:tasks.rados.rados.0.smithi084.stdout:343: finishing write tid 2 to smithi08477944-2 2024-03-30T12:23:12.084 INFO:tasks.rados.rados.0.smithi084.stdout:343: finishing write tid 3 to smithi08477944-2 2024-03-30T12:23:12.084 INFO:tasks.rados.rados.0.smithi084.stdout:343: finishing write tid 4 to smithi08477944-2 2024-03-30T12:23:12.085 INFO:tasks.rados.rados.0.smithi084.stdout:339: done (5 left) 2024-03-30T12:23:12.085 INFO:tasks.rados.rados.0.smithi084.stdout:341: done (4 left) 2024-03-30T12:23:12.085 INFO:tasks.rados.rados.0.smithi084.stdout:342: done (3 left) 2024-03-30T12:23:12.085 INFO:tasks.rados.rados.0.smithi084.stdout:348: done (2 left) 2024-03-30T12:23:12.085 INFO:tasks.rados.rados.0.smithi084.stdout:349: rollback oid 49 current snap is 32 2024-03-30T12:23:12.085 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 49 to 22 2024-03-30T12:23:12.085 INFO:tasks.rados.rados.0.smithi084.stdout:343: finishing write tid 5 to smithi08477944-2 2024-03-30T12:23:12.085 INFO:tasks.rados.rados.0.smithi084.stdout:343: finishing write tid 6 to smithi08477944-2 2024-03-30T12:23:12.085 INFO:tasks.rados.rados.0.smithi084.stdout:343: oid 2 updating version 0 to 161 2024-03-30T12:23:12.085 INFO:tasks.rados.rados.0.smithi084.stdout:343: oid 2 updating version 161 to 162 2024-03-30T12:23:12.085 INFO:tasks.rados.rados.0.smithi084.stdout:343: oid 2 version 162 is already newer than 159 2024-03-30T12:23:12.085 INFO:tasks.rados.rados.0.smithi084.stdout:343: oid 2 version 162 is already newer than 160 2024-03-30T12:23:12.085 INFO:tasks.rados.rados.0.smithi084.stdout:343: oid 2 version 162 is already newer than 158 2024-03-30T12:23:12.085 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 162 (ObjNum 133 snap 32 seq_num 133) dirty exists 2024-03-30T12:23:12.085 INFO:tasks.rados.rados.0.smithi084.stdout:343: left oid 2 (ObjNum 133 snap 32 seq_num 133) 2024-03-30T12:23:12.086 INFO:tasks.rados.rados.0.smithi084.stdout:347: finishing copy_from racing read to smithi08477944-25 2024-03-30T12:23:12.086 INFO:tasks.rados.rados.0.smithi084.stdout:347: finishing copy_from to smithi08477944-25 2024-03-30T12:23:12.086 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 104 (ObjNum 110 snap 24 seq_num 110) dirty exists 2024-03-30T12:23:12.086 INFO:tasks.rados.rados.0.smithi084.stdout:343: done (2 left) 2024-03-30T12:23:12.086 INFO:tasks.rados.rados.0.smithi084.stdout:347: done (1 left) 2024-03-30T12:23:12.086 INFO:tasks.rados.rados.0.smithi084.stdout:350: read oid 19 snap -1 2024-03-30T12:23:12.086 INFO:tasks.rados.rados.0.smithi084.stdout:350: expect (ObjNum 100 snap 22 seq_num 100) 2024-03-30T12:23:12.086 INFO:tasks.rados.rados.0.smithi084.stdout:351: snap_remove snap 25 2024-03-30T12:23:12.369 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:12.098+0000 7eff54e9d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:23:12.369 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:12.376+0000 7eff54e9d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T12:23:12.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:12 smithi162 ceph-mon[30421]: osdmap e128: 8 total, 8 up, 8 in 2024-03-30T12:23:12.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:12 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:12.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:12 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:12.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:12 smithi162 ceph-mon[30421]: pgmap v174: 121 pgs: 121 active+clean; 115 MiB data, 418 MiB used, 715 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2024-03-30T12:23:12.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:12 smithi084 ceph-mon[27000]: osdmap e128: 8 total, 8 up, 8 in 2024-03-30T12:23:12.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:12 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:12.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:12 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:12.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:12 smithi084 ceph-mon[27000]: pgmap v174: 121 pgs: 121 active+clean; 115 MiB data, 418 MiB used, 715 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2024-03-30T12:23:12.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:12 smithi084 ceph-mon[37565]: osdmap e128: 8 total, 8 up, 8 in 2024-03-30T12:23:12.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:12 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:12.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:12 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:12.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:12 smithi084 ceph-mon[37565]: pgmap v174: 121 pgs: 121 active+clean; 115 MiB data, 418 MiB used, 715 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2024-03-30T12:23:13.038 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:12.639+0000 7eff54e9d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T12:23:13.046 INFO:tasks.rados.rados.0.smithi084.stdout:351: done (2 left) 2024-03-30T12:23:13.046 INFO:tasks.rados.rados.0.smithi084.stdout:352: delete oid 12 current snap is 32 2024-03-30T12:23:13.046 INFO:tasks.rados.rados.0.smithi084.stdout:349: finishing rollback tid 1 to smithi08477944-49 2024-03-30T12:23:13.046 INFO:tasks.rados.rados.0.smithi084.stdout:349: finishing rollback tid 2 to smithi08477944-49 2024-03-30T12:23:13.046 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 121 (ObjNum 59 snap 5 seq_num 59) dirty exists 2024-03-30T12:23:13.046 INFO:tasks.rados.rados.0.smithi084.stdout:350: expect (ObjNum 100 snap 22 seq_num 100) 2024-03-30T12:23:13.179 INFO:tasks.rados.rados.0.smithi084.stdout:349: done (2 left) 2024-03-30T12:23:13.180 INFO:tasks.rados.rados.0.smithi084.stdout:350: done (1 left) 2024-03-30T12:23:13.180 INFO:tasks.rados.rados.0.smithi084.stdout:352: done (0 left) 2024-03-30T12:23:13.180 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 32 2024-03-30T12:23:13.180 INFO:tasks.rados.rados.0.smithi084.stdout:353: seq_num 136 ranges {0=688128,688128=720896,1409024=540672,1949696=344064} 2024-03-30T12:23:13.183 INFO:tasks.rados.rados.0.smithi084.stdout:353: writing smithi08477944-12 from 0 to 688128 tid 1 2024-03-30T12:23:13.187 INFO:tasks.rados.rados.0.smithi084.stdout:353: writing smithi08477944-12 from 688128 to 1409024 tid 2 2024-03-30T12:23:13.190 INFO:tasks.rados.rados.0.smithi084.stdout:353: writing smithi08477944-12 from 1409024 to 1949696 tid 3 2024-03-30T12:23:13.192 INFO:tasks.rados.rados.0.smithi084.stdout:353: writing smithi08477944-12 from 1949696 to 2293760 tid 4 2024-03-30T12:23:13.192 INFO:tasks.rados.rados.0.smithi084.stdout:354: snap_remove snap 30 2024-03-30T12:23:13.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:13 smithi162 ceph-mon[30421]: osdmap e129: 8 total, 8 up, 8 in 2024-03-30T12:23:13.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:13 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:13.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:13 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:13.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:13 smithi084 ceph-mon[27000]: osdmap e129: 8 total, 8 up, 8 in 2024-03-30T12:23:13.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:13 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:13.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:13 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:13.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:13 smithi084 ceph-mon[37565]: osdmap e129: 8 total, 8 up, 8 in 2024-03-30T12:23:13.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:13 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:13.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:13 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:13.869 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:13.505+0000 7eff54e9d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T12:23:14.004 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:23:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[73215]: ts=2024-03-30T12:23:13.515Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:23:14.052 INFO:tasks.rados.rados.0.smithi084.stdout:354: done (1 left) 2024-03-30T12:23:14.053 INFO:tasks.rados.rados.0.smithi084.stdout:355: snap_remove snap 26 2024-03-30T12:23:14.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:14 smithi162 ceph-mon[30421]: osdmap e130: 8 total, 8 up, 8 in 2024-03-30T12:23:14.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:14 smithi162 ceph-mon[30421]: pgmap v177: 121 pgs: 121 active+clean; 115 MiB data, 418 MiB used, 715 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2024-03-30T12:23:14.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:14.102+0000 7eff54e9d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T12:23:14.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:14.203+0000 7eff54e9d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T12:23:14.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:14 smithi084 ceph-mon[37565]: osdmap e130: 8 total, 8 up, 8 in 2024-03-30T12:23:14.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:14 smithi084 ceph-mon[37565]: pgmap v177: 121 pgs: 121 active+clean; 115 MiB data, 418 MiB used, 715 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2024-03-30T12:23:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:14 smithi084 ceph-mon[27000]: osdmap e130: 8 total, 8 up, 8 in 2024-03-30T12:23:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:14 smithi084 ceph-mon[27000]: pgmap v177: 121 pgs: 121 active+clean; 115 MiB data, 418 MiB used, 715 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2024-03-30T12:23:14.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:14.426+0000 7eff54e9d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T12:23:14.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: [30/Mar/2024:12:23:14] ENGINE Bus STARTING 2024-03-30T12:23:14.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: CherryPy Checker: 2024-03-30T12:23:14.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: The Application mounted at '' has an empty config. 2024-03-30T12:23:14.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:14.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: [30/Mar/2024:12:23:14] ENGINE Serving on http://:::9283 2024-03-30T12:23:14.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: [30/Mar/2024:12:23:14] ENGINE Bus STARTED 2024-03-30T12:23:14.952 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-03-30T12:23:15.030 INFO:tasks.rados.rados.0.smithi084.stdout:355: done (1 left) 2024-03-30T12:23:15.030 INFO:tasks.rados.rados.0.smithi084.stdout:356: snap_remove snap 19 2024-03-30T12:23:15.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:15 smithi084 ceph-mon[37565]: osdmap e131: 8 total, 8 up, 8 in 2024-03-30T12:23:15.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:15 smithi084 ceph-mon[37565]: Standby manager daemon x restarted 2024-03-30T12:23:15.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:15 smithi084 ceph-mon[37565]: Standby manager daemon x started 2024-03-30T12:23:15.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:15 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T12:23:15.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:15 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T12:23:15.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:15 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T12:23:15.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:15 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T12:23:15.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:15 smithi084 ceph-mon[37565]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:23:15.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:15 smithi084 ceph-mon[37565]: osdmap e132: 8 total, 8 up, 8 in 2024-03-30T12:23:15.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:15 smithi084 ceph-mon[27000]: osdmap e131: 8 total, 8 up, 8 in 2024-03-30T12:23:15.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:15 smithi084 ceph-mon[27000]: Standby manager daemon x restarted 2024-03-30T12:23:15.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:15 smithi084 ceph-mon[27000]: Standby manager daemon x started 2024-03-30T12:23:15.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:15 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T12:23:15.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:15 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T12:23:15.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:15 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T12:23:15.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:15 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T12:23:15.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:15 smithi084 ceph-mon[27000]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:23:15.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:15 smithi084 ceph-mon[27000]: osdmap e132: 8 total, 8 up, 8 in 2024-03-30T12:23:15.298 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T12:23:15.298 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (2m) 2m ago 3m 17.2M - 0.25.0 c8568f914cd2 6765ce007f39 2024-03-30T12:23:15.298 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi162 *:3000 running (3m) 3s ago 3m 90.1M - 9.4.7 954c08fa6188 ff2ec7518619 2024-03-30T12:23:15.299 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (4m) 2m ago 4m 12.3M - 18.2.2-1051-gf14b5682 c8fb09e16a7d a9c2e74ca2a3 2024-03-30T12:23:15.299 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi162 running (4m) 3s ago 4m 17.9M - 18.2.2-1051-gf14b5682 c8fb09e16a7d ee1770ef5edd 2024-03-30T12:23:15.299 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi162 *:8443,9283,8765 running (8s) 3s ago 7m 53.6M - 19.0.0-1864-g5dc2ea30 548196a1a838 a9cc7956ea1d 2024-03-30T12:23:15.299 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:9283,8765 running (9m) 2m ago 9m 496M - 18.2.2-1051-gf14b5682 c8fb09e16a7d 000810f2a0de 2024-03-30T12:23:15.299 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (9m) 2m ago 9m 49.8M 2048M 18.2.2-1051-gf14b5682 c8fb09e16a7d 915abc0d6de7 2024-03-30T12:23:15.299 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi162 running (8m) 3s ago 8m 42.3M 2048M 18.2.2-1051-gf14b5682 c8fb09e16a7d 5bf04eacfc81 2024-03-30T12:23:15.299 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (8m) 2m ago 8m 39.8M 2048M 18.2.2-1051-gf14b5682 c8fb09e16a7d 7db3fd996ae6 2024-03-30T12:23:15.299 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (2m) 2m ago 2m 7662k - 1.5.0 0da6a335fe13 66844bed39e8 2024-03-30T12:23:15.299 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi162 *:9100 running (2m) 3s ago 2m 15.4M - 1.5.0 0da6a335fe13 3d6e28b2348d 2024-03-30T12:23:15.299 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (7m) 2m ago 7m 53.2M 2992M 18.2.2-1051-gf14b5682 c8fb09e16a7d 4cad4c4383a6 2024-03-30T12:23:15.299 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (7m) 2m ago 7m 50.5M 2992M 18.2.2-1051-gf14b5682 c8fb09e16a7d 3b30b0ea0e32 2024-03-30T12:23:15.299 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (6m) 2m ago 6m 53.5M 2992M 18.2.2-1051-gf14b5682 c8fb09e16a7d eb2412618811 2024-03-30T12:23:15.299 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (6m) 2m ago 6m 39.7M 2992M 18.2.2-1051-gf14b5682 c8fb09e16a7d 8eaf6dc73c25 2024-03-30T12:23:15.300 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi162 running (5m) 3s ago 5m 79.8M 2992M 18.2.2-1051-gf14b5682 c8fb09e16a7d 1f52e827b91a 2024-03-30T12:23:15.300 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi162 running (5m) 3s ago 5m 74.6M 2992M 18.2.2-1051-gf14b5682 c8fb09e16a7d 7ba250d154aa 2024-03-30T12:23:15.300 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi162 running (5m) 3s ago 5m 58.7M 2992M 18.2.2-1051-gf14b5682 c8fb09e16a7d 656a733e8b7a 2024-03-30T12:23:15.300 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi162 running (4m) 3s ago 4m 73.0M 2992M 18.2.2-1051-gf14b5682 c8fb09e16a7d e3246b3bc88b 2024-03-30T12:23:15.300 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi162 *:9095 running (2m) 3s ago 3m 40.4M - 2.43.0 a07b618ecd1d 9858cdf4e1f2 2024-03-30T12:23:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:15 smithi162 ceph-mon[30421]: osdmap e131: 8 total, 8 up, 8 in 2024-03-30T12:23:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:15 smithi162 ceph-mon[30421]: Standby manager daemon x restarted 2024-03-30T12:23:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:15 smithi162 ceph-mon[30421]: Standby manager daemon x started 2024-03-30T12:23:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:15 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T12:23:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:15 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T12:23:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:15 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T12:23:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:15 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T12:23:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:15 smithi162 ceph-mon[30421]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:23:15.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:15 smithi162 ceph-mon[30421]: osdmap e132: 8 total, 8 up, 8 in 2024-03-30T12:23:15.679 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-30T12:23:15.679 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-03-30T12:23:15.679 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 3 2024-03-30T12:23:15.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:23:15.679 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-03-30T12:23:15.680 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 1, 2024-03-30T12:23:15.680 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 1 2024-03-30T12:23:15.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:23:15.680 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-03-30T12:23:15.680 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 8 2024-03-30T12:23:15.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:23:15.680 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-03-30T12:23:15.680 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 2 2024-03-30T12:23:15.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:23:15.680 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-03-30T12:23:15.680 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 14, 2024-03-30T12:23:15.680 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 1 2024-03-30T12:23:15.680 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-30T12:23:15.680 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-30T12:23:16.003 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:23:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[73215]: ts=2024-03-30T12:23:15.639Z caller=notify.go:743 level=info component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify success" attempts=4 2024-03-30T12:23:16.031 INFO:tasks.rados.rados.0.smithi084.stdout:356: done (1 left) 2024-03-30T12:23:16.031 INFO:tasks.rados.rados.0.smithi084.stdout:357: snap_remove snap 15 2024-03-30T12:23:16.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:16 smithi162 ceph-mon[30421]: mgrmap e23: y(active, since 3m), standbys: x 2024-03-30T12:23:16.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:16 smithi162 ceph-mon[30421]: from='client.25019 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:23:16.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:16 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/250646824' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:23:16.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:16 smithi162 ceph-mon[30421]: pgmap v180: 121 pgs: 121 active+clean; 115 MiB data, 418 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:23:16.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:16 smithi162 ceph-mon[30421]: osdmap e133: 8 total, 8 up, 8 in 2024-03-30T12:23:16.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:16 smithi084 ceph-mon[27000]: mgrmap e23: y(active, since 3m), standbys: x 2024-03-30T12:23:16.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:16 smithi084 ceph-mon[27000]: from='client.25019 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:23:16.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:16 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/250646824' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:23:16.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:16 smithi084 ceph-mon[27000]: pgmap v180: 121 pgs: 121 active+clean; 115 MiB data, 418 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:23:16.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:16 smithi084 ceph-mon[27000]: osdmap e133: 8 total, 8 up, 8 in 2024-03-30T12:23:16.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:16 smithi084 ceph-mon[37565]: mgrmap e23: y(active, since 3m), standbys: x 2024-03-30T12:23:16.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:16 smithi084 ceph-mon[37565]: from='client.25019 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:23:16.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:16 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/250646824' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:23:16.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:16 smithi084 ceph-mon[37565]: pgmap v180: 121 pgs: 121 active+clean; 115 MiB data, 418 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:23:16.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:16 smithi084 ceph-mon[37565]: osdmap e133: 8 total, 8 up, 8 in 2024-03-30T12:23:17.033 INFO:tasks.rados.rados.0.smithi084.stdout:357: done (1 left) 2024-03-30T12:23:17.033 INFO:tasks.rados.rados.0.smithi084.stdout:358: setattr oid 21 current snap is 32 2024-03-30T12:23:17.033 INFO:tasks.rados.rados.0.smithi084.stdout:353: finishing write tid 1 to smithi08477944-12 2024-03-30T12:23:17.033 INFO:tasks.rados.rados.0.smithi084.stdout:353: finishing write tid 2 to smithi08477944-12 2024-03-30T12:23:17.033 INFO:tasks.rados.rados.0.smithi084.stdout:353: finishing write tid 3 to smithi08477944-12 2024-03-30T12:23:17.033 INFO:tasks.rados.rados.0.smithi084.stdout:353: finishing write tid 4 to smithi08477944-12 2024-03-30T12:23:17.033 INFO:tasks.rados.rados.0.smithi084.stdout:353: finishing write tid 5 to smithi08477944-12 2024-03-30T12:23:17.033 INFO:tasks.rados.rados.0.smithi084.stdout:353: finishing write tid 6 to smithi08477944-12 2024-03-30T12:23:17.033 INFO:tasks.rados.rados.0.smithi084.stdout:353: oid 12 updating version 0 to 84 2024-03-30T12:23:17.033 INFO:tasks.rados.rados.0.smithi084.stdout:353: oid 12 updating version 84 to 85 2024-03-30T12:23:17.034 INFO:tasks.rados.rados.0.smithi084.stdout:353: oid 12 updating version 85 to 88 2024-03-30T12:23:17.034 INFO:tasks.rados.rados.0.smithi084.stdout:353: oid 12 version 88 is already newer than 87 2024-03-30T12:23:17.034 INFO:tasks.rados.rados.0.smithi084.stdout:353: oid 12 version 88 is already newer than 86 2024-03-30T12:23:17.034 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 88 (ObjNum 136 snap 32 seq_num 136) dirty exists 2024-03-30T12:23:17.034 INFO:tasks.rados.rados.0.smithi084.stdout:353: left oid 12 (ObjNum 136 snap 32 seq_num 136) 2024-03-30T12:23:17.036 INFO:tasks.rados.rados.0.smithi084.stdout:353: done (1 left) 2024-03-30T12:23:17.037 INFO:tasks.rados.rados.0.smithi084.stdout:359: read oid 27 snap -1 2024-03-30T12:23:17.037 INFO:tasks.rados.rados.0.smithi084.stdout:359: expect (ObjNum 56 snap 4 seq_num 56) 2024-03-30T12:23:17.037 INFO:tasks.rados.rados.0.smithi084.stdout:360: read oid 5 snap -1 2024-03-30T12:23:17.037 INFO:tasks.rados.rados.0.smithi084.stdout:360: expect deleted 2024-03-30T12:23:17.037 INFO:tasks.rados.rados.0.smithi084.stdout:361: read oid 28 snap 22 2024-03-30T12:23:17.037 INFO:tasks.rados.rados.0.smithi084.stdout:361: expect (ObjNum 27 snap 0 seq_num 27) 2024-03-30T12:23:17.037 INFO:tasks.rados.rados.0.smithi084.stdout:362: copy_from oid 29 from oid 23 current snap is 32 2024-03-30T12:23:17.037 INFO:tasks.rados.rados.0.smithi084.stdout:363: snap_create 2024-03-30T12:23:17.043 INFO:tasks.rados.rados.0.smithi084.stdout:361: expect (ObjNum 27 snap 0 seq_num 27) 2024-03-30T12:23:17.064 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 57 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-03-30T12:23:17.064 INFO:tasks.rados.rados.0.smithi084.stdout:362: finishing copy_from racing read to smithi08477944-29 2024-03-30T12:23:17.065 INFO:tasks.rados.rados.0.smithi084.stdout:359: expect (ObjNum 56 snap 4 seq_num 56) 2024-03-30T12:23:17.109 INFO:tasks.rados.rados.0.smithi084.stdout:362: finishing copy_from to smithi08477944-29 2024-03-30T12:23:17.109 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 30 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-03-30T12:23:18.046 INFO:tasks.rados.rados.0.smithi084.stdout:358: done (5 left) 2024-03-30T12:23:18.046 INFO:tasks.rados.rados.0.smithi084.stdout:359: done (4 left) 2024-03-30T12:23:18.046 INFO:tasks.rados.rados.0.smithi084.stdout:360: done (3 left) 2024-03-30T12:23:18.046 INFO:tasks.rados.rados.0.smithi084.stdout:361: done (2 left) 2024-03-30T12:23:18.046 INFO:tasks.rados.rados.0.smithi084.stdout:362: done (1 left) 2024-03-30T12:23:18.046 INFO:tasks.rados.rados.0.smithi084.stdout:363: done (0 left) 2024-03-30T12:23:18.046 INFO:tasks.rados.rados.0.smithi084.stdout:364: delete oid 4 current snap is 33 2024-03-30T12:23:18.049 INFO:tasks.rados.rados.0.smithi084.stdout:364: done (0 left) 2024-03-30T12:23:18.049 INFO:tasks.rados.rados.0.smithi084.stdout:365: snap_create 2024-03-30T12:23:18.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:18 smithi162 ceph-mon[30421]: osdmap e134: 8 total, 8 up, 8 in 2024-03-30T12:23:18.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:18 smithi162 ceph-mon[30421]: pgmap v183: 121 pgs: 121 active+clean; 121 MiB data, 434 MiB used, 715 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.6 MiB/s wr, 6 op/s 2024-03-30T12:23:18.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:18 smithi084 ceph-mon[37565]: osdmap e134: 8 total, 8 up, 8 in 2024-03-30T12:23:18.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:18 smithi084 ceph-mon[37565]: pgmap v183: 121 pgs: 121 active+clean; 121 MiB data, 434 MiB used, 715 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.6 MiB/s wr, 6 op/s 2024-03-30T12:23:18.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:18 smithi084 ceph-mon[27000]: osdmap e134: 8 total, 8 up, 8 in 2024-03-30T12:23:18.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:18 smithi084 ceph-mon[27000]: pgmap v183: 121 pgs: 121 active+clean; 121 MiB data, 434 MiB used, 715 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.6 MiB/s wr, 6 op/s 2024-03-30T12:23:19.055 INFO:tasks.rados.rados.0.smithi084.stdout:365: done (0 left) 2024-03-30T12:23:19.055 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 28 current snap is 34 2024-03-30T12:23:19.055 INFO:tasks.rados.rados.0.smithi084.stdout:366: seq_num 138 ranges {458752=720896,1179648=540672,1720320=557056,2277376=507904} 2024-03-30T12:23:19.061 INFO:tasks.rados.rados.0.smithi084.stdout:366: writing smithi08477944-28 from 458752 to 1179648 tid 1 2024-03-30T12:23:19.064 INFO:tasks.rados.rados.0.smithi084.stdout:366: writing smithi08477944-28 from 1179648 to 1720320 tid 2 2024-03-30T12:23:19.068 INFO:tasks.rados.rados.0.smithi084.stdout:366: writing smithi08477944-28 from 1720320 to 2277376 tid 3 2024-03-30T12:23:19.071 INFO:tasks.rados.rados.0.smithi084.stdout:366: writing smithi08477944-28 from 2277376 to 2785280 tid 4 2024-03-30T12:23:19.071 INFO:tasks.rados.rados.0.smithi084.stdout:367: rollback oid 34 current snap is 34 2024-03-30T12:23:19.071 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 34 to 9 2024-03-30T12:23:19.072 INFO:tasks.rados.rados.0.smithi084.stdout:366: finishing write tid 1 to smithi08477944-28 2024-03-30T12:23:19.072 INFO:tasks.rados.rados.0.smithi084.stdout:366: finishing write tid 2 to smithi08477944-28 2024-03-30T12:23:19.072 INFO:tasks.rados.rados.0.smithi084.stdout:366: finishing write tid 3 to smithi08477944-28 2024-03-30T12:23:19.072 INFO:tasks.rados.rados.0.smithi084.stdout:368: delete oid 8 current snap is 34 2024-03-30T12:23:19.073 INFO:tasks.rados.rados.0.smithi084.stdout:368: done (2 left) 2024-03-30T12:23:19.073 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 34 2024-03-30T12:23:19.073 INFO:tasks.rados.rados.0.smithi084.stdout:369: seq_num 140 ranges {778240=753664,1531904=704512,2236416=524288,2760704=376832} 2024-03-30T12:23:19.081 INFO:tasks.rados.rados.0.smithi084.stdout:369: writing smithi08477944-47 from 778240 to 1531904 tid 1 2024-03-30T12:23:19.086 INFO:tasks.rados.rados.0.smithi084.stdout:369: writing smithi08477944-47 from 1531904 to 2236416 tid 2 2024-03-30T12:23:19.089 INFO:tasks.rados.rados.0.smithi084.stdout:369: writing smithi08477944-47 from 2236416 to 2760704 tid 3 2024-03-30T12:23:19.091 INFO:tasks.rados.rados.0.smithi084.stdout:369: writing smithi08477944-47 from 2760704 to 3137536 tid 4 2024-03-30T12:23:19.092 INFO:tasks.rados.rados.0.smithi084.stdout:370: snap_create 2024-03-30T12:23:19.092 INFO:tasks.rados.rados.0.smithi084.stdout:366: finishing write tid 4 to smithi08477944-28 2024-03-30T12:23:19.092 INFO:tasks.rados.rados.0.smithi084.stdout:366: finishing write tid 5 to smithi08477944-28 2024-03-30T12:23:19.092 INFO:tasks.rados.rados.0.smithi084.stdout:366: finishing write tid 6 to smithi08477944-28 2024-03-30T12:23:19.092 INFO:tasks.rados.rados.0.smithi084.stdout:366: oid 28 updating version 0 to 126 2024-03-30T12:23:19.092 INFO:tasks.rados.rados.0.smithi084.stdout:366: oid 28 updating version 126 to 128 2024-03-30T12:23:19.092 INFO:tasks.rados.rados.0.smithi084.stdout:366: oid 28 version 128 is already newer than 127 2024-03-30T12:23:19.092 INFO:tasks.rados.rados.0.smithi084.stdout:366: oid 28 updating version 128 to 129 2024-03-30T12:23:19.092 INFO:tasks.rados.rados.0.smithi084.stdout:366: oid 28 version 129 is already newer than 125 2024-03-30T12:23:19.092 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 129 (ObjNum 138 snap 34 seq_num 138) dirty exists 2024-03-30T12:23:19.092 INFO:tasks.rados.rados.0.smithi084.stdout:366: left oid 28 (ObjNum 138 snap 34 seq_num 138) 2024-03-30T12:23:19.092 INFO:tasks.rados.rados.0.smithi084.stdout:367: finishing rollback tid 0 to smithi08477944-34 2024-03-30T12:23:19.092 INFO:tasks.rados.rados.0.smithi084.stdout:367: finishing rollback tid 1 to smithi08477944-34 2024-03-30T12:23:19.093 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 103 (ObjNum 273 snap 0 seq_num 1429240128) dirty dne 2024-03-30T12:23:19.093 INFO:tasks.rados.rados.0.smithi084.stdout:369: finishing write tid 1 to smithi08477944-47 2024-03-30T12:23:19.093 INFO:tasks.rados.rados.0.smithi084.stdout:369: finishing write tid 2 to smithi08477944-47 2024-03-30T12:23:19.093 INFO:tasks.rados.rados.0.smithi084.stdout:369: finishing write tid 3 to smithi08477944-47 2024-03-30T12:23:19.093 INFO:tasks.rados.rados.0.smithi084.stdout:369: finishing write tid 4 to smithi08477944-47 2024-03-30T12:23:19.094 INFO:tasks.rados.rados.0.smithi084.stdout:369: finishing write tid 5 to smithi08477944-47 2024-03-30T12:23:19.095 INFO:tasks.rados.rados.0.smithi084.stdout:369: finishing write tid 6 to smithi08477944-47 2024-03-30T12:23:19.095 INFO:tasks.rados.rados.0.smithi084.stdout:369: oid 47 updating version 0 to 164 2024-03-30T12:23:19.095 INFO:tasks.rados.rados.0.smithi084.stdout:369: oid 47 updating version 164 to 167 2024-03-30T12:23:19.095 INFO:tasks.rados.rados.0.smithi084.stdout:369: oid 47 updating version 167 to 168 2024-03-30T12:23:19.095 INFO:tasks.rados.rados.0.smithi084.stdout:369: oid 47 version 168 is already newer than 165 2024-03-30T12:23:19.095 INFO:tasks.rados.rados.0.smithi084.stdout:369: oid 47 version 168 is already newer than 166 2024-03-30T12:23:19.095 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 168 (ObjNum 140 snap 34 seq_num 140) dirty exists 2024-03-30T12:23:19.095 INFO:tasks.rados.rados.0.smithi084.stdout:369: left oid 47 (ObjNum 140 snap 34 seq_num 140) 2024-03-30T12:23:19.295 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:19 smithi084 ceph-mon[27000]: osdmap e135: 8 total, 8 up, 8 in 2024-03-30T12:23:19.295 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:19 smithi084 ceph-mon[37565]: osdmap e135: 8 total, 8 up, 8 in 2024-03-30T12:23:19.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:19 smithi162 ceph-mon[30421]: osdmap e135: 8 total, 8 up, 8 in 2024-03-30T12:23:19.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:23:19] "GET /metrics HTTP/1.1" 200 36005 "" "Prometheus/2.43.0" 2024-03-30T12:23:20.032 INFO:tasks.rados.rados.0.smithi084.stdout:366: done (3 left) 2024-03-30T12:23:20.032 INFO:tasks.rados.rados.0.smithi084.stdout:367: done (2 left) 2024-03-30T12:23:20.032 INFO:tasks.rados.rados.0.smithi084.stdout:369: done (1 left) 2024-03-30T12:23:20.033 INFO:tasks.rados.rados.0.smithi084.stdout:370: done (0 left) 2024-03-30T12:23:20.033 INFO:tasks.rados.rados.0.smithi084.stdout:371: read oid 45 snap -1 2024-03-30T12:23:20.033 INFO:tasks.rados.rados.0.smithi084.stdout:371: expect (ObjNum 127 snap 29 seq_num 127) 2024-03-30T12:23:20.033 INFO:tasks.rados.rados.0.smithi084.stdout:372: rmattr oid 18 current snap is 35 2024-03-30T12:23:20.033 INFO:tasks.rados.rados.0.smithi084.stdout:372: done (1 left) 2024-03-30T12:23:20.033 INFO:tasks.rados.rados.0.smithi084.stdout:373: read oid 28 snap -1 2024-03-30T12:23:20.033 INFO:tasks.rados.rados.0.smithi084.stdout:373: expect (ObjNum 138 snap 34 seq_num 138) 2024-03-30T12:23:20.033 INFO:tasks.rados.rados.0.smithi084.stdout:374: snap_create 2024-03-30T12:23:20.052 INFO:tasks.rados.rados.0.smithi084.stdout:373: expect (ObjNum 138 snap 34 seq_num 138) 2024-03-30T12:23:20.135 INFO:tasks.rados.rados.0.smithi084.stdout:371: expect (ObjNum 127 snap 29 seq_num 127) 2024-03-30T12:23:20.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:20 smithi162 ceph-mon[30421]: osdmap e136: 8 total, 8 up, 8 in 2024-03-30T12:23:20.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:20 smithi162 ceph-mon[30421]: pgmap v186: 121 pgs: 121 active+clean; 121 MiB data, 434 MiB used, 715 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.6 MiB/s wr, 6 op/s 2024-03-30T12:23:20.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:20 smithi162 ceph-mon[30421]: osdmap e137: 8 total, 8 up, 8 in 2024-03-30T12:23:20.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:20 smithi084 ceph-mon[27000]: osdmap e136: 8 total, 8 up, 8 in 2024-03-30T12:23:20.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:20 smithi084 ceph-mon[27000]: pgmap v186: 121 pgs: 121 active+clean; 121 MiB data, 434 MiB used, 715 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.6 MiB/s wr, 6 op/s 2024-03-30T12:23:20.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:20 smithi084 ceph-mon[27000]: osdmap e137: 8 total, 8 up, 8 in 2024-03-30T12:23:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:20 smithi084 ceph-mon[37565]: osdmap e136: 8 total, 8 up, 8 in 2024-03-30T12:23:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:20 smithi084 ceph-mon[37565]: pgmap v186: 121 pgs: 121 active+clean; 121 MiB data, 434 MiB used, 715 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.6 MiB/s wr, 6 op/s 2024-03-30T12:23:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:20 smithi084 ceph-mon[37565]: osdmap e137: 8 total, 8 up, 8 in 2024-03-30T12:23:21.040 INFO:tasks.rados.rados.0.smithi084.stdout:371: done (2 left) 2024-03-30T12:23:21.040 INFO:tasks.rados.rados.0.smithi084.stdout:373: done (1 left) 2024-03-30T12:23:21.041 INFO:tasks.rados.rados.0.smithi084.stdout:374: done (0 left) 2024-03-30T12:23:21.041 INFO:tasks.rados.rados.0.smithi084.stdout:375: read oid 10 snap -1 2024-03-30T12:23:21.041 INFO:tasks.rados.rados.0.smithi084.stdout:375: expect (ObjNum 83 snap 18 seq_num 83) 2024-03-30T12:23:21.041 INFO:tasks.rados.rados.0.smithi084.stdout:376: rollback oid 42 current snap is 36 2024-03-30T12:23:21.041 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 42 to 31 2024-03-30T12:23:21.041 INFO:tasks.rados.rados.0.smithi084.stdout:377: snap_remove snap 27 2024-03-30T12:23:21.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:21 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:23:21.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:21 smithi162 ceph-mon[30421]: osdmap e138: 8 total, 8 up, 8 in 2024-03-30T12:23:21.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:21 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:23:21.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:21 smithi084 ceph-mon[37565]: osdmap e138: 8 total, 8 up, 8 in 2024-03-30T12:23:21.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:21 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:23:21.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:21 smithi084 ceph-mon[27000]: osdmap e138: 8 total, 8 up, 8 in 2024-03-30T12:23:22.043 INFO:tasks.rados.rados.0.smithi084.stdout:377: done (2 left) 2024-03-30T12:23:22.043 INFO:tasks.rados.rados.0.smithi084.stdout:378: setattr oid 49 current snap is 36 2024-03-30T12:23:22.043 INFO:tasks.rados.rados.0.smithi084.stdout:376: finishing rollback tid 1 to smithi08477944-42 2024-03-30T12:23:22.043 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 107 (ObjNum 49 snap 0 seq_num 1953066355) dirty dne 2024-03-30T12:23:22.043 INFO:tasks.rados.rados.0.smithi084.stdout:375: expect (ObjNum 83 snap 18 seq_num 83) 2024-03-30T12:23:22.156 INFO:tasks.rados.rados.0.smithi084.stdout:375: done (2 left) 2024-03-30T12:23:22.156 INFO:tasks.rados.rados.0.smithi084.stdout:376: done (1 left) 2024-03-30T12:23:22.156 INFO:tasks.rados.rados.0.smithi084.stdout:379: read oid 47 snap -1 2024-03-30T12:23:22.156 INFO:tasks.rados.rados.0.smithi084.stdout:379: expect (ObjNum 140 snap 34 seq_num 140) 2024-03-30T12:23:22.156 INFO:tasks.rados.rados.0.smithi084.stdout:380: read oid 50 snap -1 2024-03-30T12:23:22.156 INFO:tasks.rados.rados.0.smithi084.stdout:380: expect (ObjNum 116 snap 26 seq_num 116) 2024-03-30T12:23:22.156 INFO:tasks.rados.rados.0.smithi084.stdout:381: read oid 29 snap -1 2024-03-30T12:23:22.156 INFO:tasks.rados.rados.0.smithi084.stdout:381: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-30T12:23:22.156 INFO:tasks.rados.rados.0.smithi084.stdout:382: rollback oid 5 current snap is 36 2024-03-30T12:23:22.156 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 5 to 31 2024-03-30T12:23:22.156 INFO:tasks.rados.rados.0.smithi084.stdout:383: delete oid 36 current snap is 36 2024-03-30T12:23:22.157 INFO:tasks.rados.rados.0.smithi084.stdout:382: finishing rollback tid 1 to smithi08477944-5 2024-03-30T12:23:22.157 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 51 (ObjNum 161 snap 0 seq_num 0) dirty dne 2024-03-30T12:23:22.159 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 139 (ObjNum 59 snap 5 seq_num 59) dirty exists 2024-03-30T12:23:22.159 INFO:tasks.rados.rados.0.smithi084.stdout:378: done (5 left) 2024-03-30T12:23:22.159 INFO:tasks.rados.rados.0.smithi084.stdout:382: done (4 left) 2024-03-30T12:23:22.159 INFO:tasks.rados.rados.0.smithi084.stdout:383: done (3 left) 2024-03-30T12:23:22.159 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 36 2024-03-30T12:23:22.160 INFO:tasks.rados.rados.0.smithi084.stdout:384: seq_num 142 ranges {1384448=786432,2170880=475136,2646016=540672,3186688=589824} 2024-03-30T12:23:22.171 INFO:tasks.rados.rados.0.smithi084.stdout:384: writing smithi08477944-22 from 1384448 to 2170880 tid 1 2024-03-30T12:23:22.174 INFO:tasks.rados.rados.0.smithi084.stdout:384: writing smithi08477944-22 from 2170880 to 2646016 tid 2 2024-03-30T12:23:22.177 INFO:tasks.rados.rados.0.smithi084.stdout:384: writing smithi08477944-22 from 2646016 to 3186688 tid 3 2024-03-30T12:23:22.180 INFO:tasks.rados.rados.0.smithi084.stdout:384: writing smithi08477944-22 from 3186688 to 3776512 tid 4 2024-03-30T12:23:22.181 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 36 2024-03-30T12:23:22.181 INFO:tasks.rados.rados.0.smithi084.stdout:385: seq_num 143 ranges {0=802816,802816=761856,1564672=745472,2310144=98304} 2024-03-30T12:23:22.185 INFO:tasks.rados.rados.0.smithi084.stdout:385: writing smithi08477944-6 from 0 to 802816 tid 1 2024-03-30T12:23:22.189 INFO:tasks.rados.rados.0.smithi084.stdout:385: writing smithi08477944-6 from 802816 to 1564672 tid 2 2024-03-30T12:23:22.193 INFO:tasks.rados.rados.0.smithi084.stdout:385: writing smithi08477944-6 from 1564672 to 2310144 tid 3 2024-03-30T12:23:22.194 INFO:tasks.rados.rados.0.smithi084.stdout:385: writing smithi08477944-6 from 2310144 to 2408448 tid 4 2024-03-30T12:23:22.194 INFO:tasks.rados.rados.0.smithi084.stdout:386: read oid 14 snap -1 2024-03-30T12:23:22.194 INFO:tasks.rados.rados.0.smithi084.stdout:386: expect (ObjNum 40 snap 0 seq_num 40) 2024-03-30T12:23:22.195 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 36 2024-03-30T12:23:22.195 INFO:tasks.rados.rados.0.smithi084.stdout:387: seq_num 144 ranges {4038656=16384} 2024-03-30T12:23:22.216 INFO:tasks.rados.rados.0.smithi084.stdout:387: writing smithi08477944-41 from 4038656 to 4055040 tid 1 2024-03-30T12:23:22.216 INFO:tasks.rados.rados.0.smithi084.stdout:388: read oid 32 snap 33 2024-03-30T12:23:22.216 INFO:tasks.rados.rados.0.smithi084.stdout:388: expect (ObjNum 81 snap 16 seq_num 81) 2024-03-30T12:23:22.216 INFO:tasks.rados.rados.0.smithi084.stdout:389: rmattr oid 39 current snap is 36 2024-03-30T12:23:22.216 INFO:tasks.rados.rados.0.smithi084.stdout:381: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-30T12:23:22.239 INFO:tasks.rados.rados.0.smithi084.stdout:379: expect (ObjNum 140 snap 34 seq_num 140) 2024-03-30T12:23:22.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:22 smithi162 ceph-mon[30421]: pgmap v189: 121 pgs: 121 active+clean; 123 MiB data, 454 MiB used, 715 GiB / 715 GiB avail; 7.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2024-03-30T12:23:22.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:22 smithi162 ceph-mon[30421]: osdmap e139: 8 total, 8 up, 8 in 2024-03-30T12:23:22.334 INFO:tasks.rados.rados.0.smithi084.stdout:380: expect (ObjNum 116 snap 26 seq_num 116) 2024-03-30T12:23:22.416 INFO:tasks.rados.rados.0.smithi084.stdout:384: finishing write tid 1 to smithi08477944-22 2024-03-30T12:23:22.416 INFO:tasks.rados.rados.0.smithi084.stdout:384: finishing write tid 2 to smithi08477944-22 2024-03-30T12:23:22.416 INFO:tasks.rados.rados.0.smithi084.stdout:384: finishing write tid 3 to smithi08477944-22 2024-03-30T12:23:22.416 INFO:tasks.rados.rados.0.smithi084.stdout:384: finishing write tid 4 to smithi08477944-22 2024-03-30T12:23:22.416 INFO:tasks.rados.rados.0.smithi084.stdout:384: finishing write tid 5 to smithi08477944-22 2024-03-30T12:23:22.416 INFO:tasks.rados.rados.0.smithi084.stdout:384: finishing write tid 6 to smithi08477944-22 2024-03-30T12:23:22.417 INFO:tasks.rados.rados.0.smithi084.stdout:384: oid 22 updating version 0 to 223 2024-03-30T12:23:22.417 INFO:tasks.rados.rados.0.smithi084.stdout:384: oid 22 version 223 is already newer than 222 2024-03-30T12:23:22.417 INFO:tasks.rados.rados.0.smithi084.stdout:384: oid 22 updating version 223 to 225 2024-03-30T12:23:22.417 INFO:tasks.rados.rados.0.smithi084.stdout:384: oid 22 version 225 is already newer than 224 2024-03-30T12:23:22.417 INFO:tasks.rados.rados.0.smithi084.stdout:384: oid 22 version 225 is already newer than 221 2024-03-30T12:23:22.417 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 225 (ObjNum 142 snap 36 seq_num 142) dirty exists 2024-03-30T12:23:22.417 INFO:tasks.rados.rados.0.smithi084.stdout:384: left oid 22 (ObjNum 142 snap 36 seq_num 142) 2024-03-30T12:23:22.417 INFO:tasks.rados.rados.0.smithi084.stdout:385: finishing write tid 1 to smithi08477944-6 2024-03-30T12:23:22.417 INFO:tasks.rados.rados.0.smithi084.stdout:385: finishing write tid 2 to smithi08477944-6 2024-03-30T12:23:22.417 INFO:tasks.rados.rados.0.smithi084.stdout:385: finishing write tid 3 to smithi08477944-6 2024-03-30T12:23:22.417 INFO:tasks.rados.rados.0.smithi084.stdout:385: finishing write tid 4 to smithi08477944-6 2024-03-30T12:23:22.417 INFO:tasks.rados.rados.0.smithi084.stdout:385: finishing write tid 5 to smithi08477944-6 2024-03-30T12:23:22.417 INFO:tasks.rados.rados.0.smithi084.stdout:386: expect (ObjNum 40 snap 0 seq_num 40) 2024-03-30T12:23:22.438 INFO:tasks.rados.rados.0.smithi084.stdout:385: finishing write tid 6 to smithi08477944-6 2024-03-30T12:23:22.438 INFO:tasks.rados.rados.0.smithi084.stdout:385: oid 6 updating version 0 to 115 2024-03-30T12:23:22.438 INFO:tasks.rados.rados.0.smithi084.stdout:385: oid 6 version 115 is already newer than 113 2024-03-30T12:23:22.438 INFO:tasks.rados.rados.0.smithi084.stdout:385: oid 6 version 115 is already newer than 114 2024-03-30T12:23:22.438 INFO:tasks.rados.rados.0.smithi084.stdout:385: oid 6 version 115 is already newer than 111 2024-03-30T12:23:22.438 INFO:tasks.rados.rados.0.smithi084.stdout:385: oid 6 version 115 is already newer than 112 2024-03-30T12:23:22.438 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 115 (ObjNum 143 snap 36 seq_num 143) dirty exists 2024-03-30T12:23:22.438 INFO:tasks.rados.rados.0.smithi084.stdout:385: left oid 6 (ObjNum 143 snap 36 seq_num 143) 2024-03-30T12:23:22.438 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 0 (ObjNum 118 snap 26 seq_num 118) dirty exists 2024-03-30T12:23:22.438 INFO:tasks.rados.rados.0.smithi084.stdout:387: finishing write tid 1 to smithi08477944-41 2024-03-30T12:23:22.439 INFO:tasks.rados.rados.0.smithi084.stdout:379: done (8 left) 2024-03-30T12:23:22.439 INFO:tasks.rados.rados.0.smithi084.stdout:380: done (7 left) 2024-03-30T12:23:22.439 INFO:tasks.rados.rados.0.smithi084.stdout:381: done (6 left) 2024-03-30T12:23:22.439 INFO:tasks.rados.rados.0.smithi084.stdout:384: done (5 left) 2024-03-30T12:23:22.439 INFO:tasks.rados.rados.0.smithi084.stdout:385: done (4 left) 2024-03-30T12:23:22.439 INFO:tasks.rados.rados.0.smithi084.stdout:386: done (3 left) 2024-03-30T12:23:22.439 INFO:tasks.rados.rados.0.smithi084.stdout:389: done (2 left) 2024-03-30T12:23:22.439 INFO:tasks.rados.rados.0.smithi084.stdout:390: snap_create 2024-03-30T12:23:22.439 INFO:tasks.rados.rados.0.smithi084.stdout:387: finishing write tid 2 to smithi08477944-41 2024-03-30T12:23:22.439 INFO:tasks.rados.rados.0.smithi084.stdout:387: finishing write tid 3 to smithi08477944-41 2024-03-30T12:23:22.439 INFO:tasks.rados.rados.0.smithi084.stdout:387: oid 41 updating version 0 to 211 2024-03-30T12:23:22.439 INFO:tasks.rados.rados.0.smithi084.stdout:387: oid 41 updating version 211 to 212 2024-03-30T12:23:22.439 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 212 (ObjNum 144 snap 36 seq_num 144) dirty exists 2024-03-30T12:23:22.439 INFO:tasks.rados.rados.0.smithi084.stdout:387: left oid 41 (ObjNum 144 snap 36 seq_num 144) 2024-03-30T12:23:22.440 INFO:tasks.rados.rados.0.smithi084.stdout:388: expect (ObjNum 81 snap 16 seq_num 81) 2024-03-30T12:23:22.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:22 smithi084 ceph-mon[37565]: pgmap v189: 121 pgs: 121 active+clean; 123 MiB data, 454 MiB used, 715 GiB / 715 GiB avail; 7.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2024-03-30T12:23:22.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:22 smithi084 ceph-mon[37565]: osdmap e139: 8 total, 8 up, 8 in 2024-03-30T12:23:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:22 smithi084 ceph-mon[27000]: pgmap v189: 121 pgs: 121 active+clean; 123 MiB data, 454 MiB used, 715 GiB / 715 GiB avail; 7.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2024-03-30T12:23:22.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:22 smithi084 ceph-mon[27000]: osdmap e139: 8 total, 8 up, 8 in 2024-03-30T12:23:23.066 INFO:tasks.rados.rados.0.smithi084.stdout:387: done (2 left) 2024-03-30T12:23:23.066 INFO:tasks.rados.rados.0.smithi084.stdout:388: done (1 left) 2024-03-30T12:23:23.066 INFO:tasks.rados.rados.0.smithi084.stdout:390: done (0 left) 2024-03-30T12:23:23.066 INFO:tasks.rados.rados.0.smithi084.stdout:391: delete oid 45 current snap is 37 2024-03-30T12:23:23.071 INFO:tasks.rados.rados.0.smithi084.stdout:391: done (0 left) 2024-03-30T12:23:23.071 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 37 2024-03-30T12:23:23.071 INFO:tasks.rados.rados.0.smithi084.stdout:392: seq_num 146 ranges {1810432=49152} 2024-03-30T12:23:23.081 INFO:tasks.rados.rados.0.smithi084.stdout:392: writing smithi08477944-49 from 1810432 to 1859584 tid 1 2024-03-30T12:23:23.081 INFO:tasks.rados.rados.0.smithi084.stdout:393: snap_remove snap 34 2024-03-30T12:23:24.052 INFO:tasks.rados.rados.0.smithi084.stdout:393: done (1 left) 2024-03-30T12:23:24.052 INFO:tasks.rados.rados.0.smithi084.stdout:394: copy_from oid 46 from oid 11 current snap is 37 2024-03-30T12:23:24.052 INFO:tasks.rados.rados.0.smithi084.stdout:395: setattr oid 30 current snap is 37 2024-03-30T12:23:24.052 INFO:tasks.rados.rados.0.smithi084.stdout:392: finishing write tid 1 to smithi08477944-49 2024-03-30T12:23:24.052 INFO:tasks.rados.rados.0.smithi084.stdout:392: finishing write tid 2 to smithi08477944-49 2024-03-30T12:23:24.052 INFO:tasks.rados.rados.0.smithi084.stdout:392: finishing write tid 3 to smithi08477944-49 2024-03-30T12:23:24.052 INFO:tasks.rados.rados.0.smithi084.stdout:392: oid 49 updating version 0 to 143 2024-03-30T12:23:24.052 INFO:tasks.rados.rados.0.smithi084.stdout:392: oid 49 updating version 143 to 144 2024-03-30T12:23:24.052 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 144 (ObjNum 146 snap 37 seq_num 146) dirty exists 2024-03-30T12:23:24.052 INFO:tasks.rados.rados.0.smithi084.stdout:392: left oid 49 (ObjNum 146 snap 37 seq_num 146) 2024-03-30T12:23:24.054 INFO:tasks.rados.rados.0.smithi084.stdout:392: done (2 left) 2024-03-30T12:23:24.054 INFO:tasks.rados.rados.0.smithi084.stdout:396: rollback oid 29 current snap is 37 2024-03-30T12:23:24.054 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 29 to 22 2024-03-30T12:23:24.054 INFO:tasks.rados.rados.0.smithi084.stdout:397: setattr oid 40 current snap is 37 2024-03-30T12:23:24.059 INFO:tasks.rados.rados.0.smithi084.stdout:398: snap_create 2024-03-30T12:23:24.061 INFO:tasks.rados.rados.0.smithi084.stdout:396: finishing rollback tid 0 to smithi08477944-29 2024-03-30T12:23:24.062 INFO:tasks.rados.rados.0.smithi084.stdout:396: finishing rollback tid 1 to smithi08477944-29 2024-03-30T12:23:24.062 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 136 (ObjNum 161 snap 0 seq_num 0) dirty dne 2024-03-30T12:23:24.062 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 86 (ObjNum 29 snap 0 seq_num 29) dirty exists 2024-03-30T12:23:24.065 INFO:tasks.rados.rados.0.smithi084.stdout:394: finishing copy_from racing read to smithi08477944-46 2024-03-30T12:23:24.073 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 172 (ObjNum 49 snap 0 seq_num 49) dirty exists 2024-03-30T12:23:24.073 INFO:tasks.rados.rados.0.smithi084.stdout:394: finishing copy_from to smithi08477944-46 2024-03-30T12:23:24.073 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 62 (ObjNum 107 snap 22 seq_num 107) dirty exists 2024-03-30T12:23:24.084 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: [30/Mar/2024:12:23:24] ENGINE Bus STOPPING 2024-03-30T12:23:24.084 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: [30/Mar/2024:12:23:24] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T12:23:24.084 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: [30/Mar/2024:12:23:24] ENGINE Bus STOPPED 2024-03-30T12:23:24.085 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: osdmap e140: 8 total, 8 up, 8 in 2024-03-30T12:23:24.085 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: pgmap v192: 121 pgs: 121 active+clean; 123 MiB data, 454 MiB used, 715 GiB / 715 GiB avail; 7.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2024-03-30T12:23:24.085 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:24.085 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:24.085 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:23:24.085 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:23:24.085 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:24.085 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:24.085 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-03-30T12:23:24.085 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-03-30T12:23:24.085 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: osdmap e141: 8 total, 8 up, 8 in 2024-03-30T12:23:24.086 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-03-30T12:23:24.086 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: mgrmap e24: x(active, starting, since 0.00620922s) 2024-03-30T12:23:24.086 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:23:24.086 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:23:24.086 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:23:24.086 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-30T12:23:24.086 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-30T12:23:24.086 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T12:23:24.086 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:23:24.086 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:23:24.086 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:23:24.086 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:23:24.086 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:23:24.087 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:23:24.087 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:23:24.087 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:23:24.087 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T12:23:24.087 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T12:23:24.087 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T12:23:24.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: [30/Mar/2024:12:23:24] ENGINE Bus STARTING 2024-03-30T12:23:24.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:24.197+0000 7efeb2b3c700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:23:24.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:24.197+0000 7efeb2b3c700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:23:24.371 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:24.197+0000 7efeb2b3c700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:23:24.371 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:24.197+0000 7efeb2b3c700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:23:24.371 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:24.197+0000 7efeb2b3c700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:23:24.371 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:24.198+0000 7efeb5b42700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:23:24.371 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:24.198+0000 7efeb5b42700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:23:24.371 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:24.198+0000 7efeb5b42700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:23:24.372 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:24.198+0000 7efeb5b42700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:23:24.372 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:24.198+0000 7efeb5b42700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:23:24.372 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: [30/Mar/2024:12:23:24] ENGINE Serving on http://:::9283 2024-03-30T12:23:24.372 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: [30/Mar/2024:12:23:24] ENGINE Bus STARTED 2024-03-30T12:23:24.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:24.055+0000 7f6cad2bc700 -1 mgr handle_mgr_map I was active but no longer am 2024-03-30T12:23:24.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ignoring --setuser ceph since I am not root 2024-03-30T12:23:24.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ignoring --setgroup ceph since I am not root 2024-03-30T12:23:24.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: osdmap e140: 8 total, 8 up, 8 in 2024-03-30T12:23:24.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: pgmap v192: 121 pgs: 121 active+clean; 123 MiB data, 454 MiB used, 715 GiB / 715 GiB avail; 7.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2024-03-30T12:23:24.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:24.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:24.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:23:24.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:23:24.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:24.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-03-30T12:23:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-03-30T12:23:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: osdmap e141: 8 total, 8 up, 8 in 2024-03-30T12:23:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-03-30T12:23:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: mgrmap e24: x(active, starting, since 0.00620922s) 2024-03-30T12:23:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:23:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:23:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:23:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-30T12:23:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-30T12:23:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T12:23:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:23:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:23:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:23:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:23:24.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:23:24.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:23:24.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:23:24.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:23:24.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T12:23:24.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T12:23:24.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T12:23:24.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: osdmap e140: 8 total, 8 up, 8 in 2024-03-30T12:23:24.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: pgmap v192: 121 pgs: 121 active+clean; 123 MiB data, 454 MiB used, 715 GiB / 715 GiB avail; 7.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2024-03-30T12:23:24.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:24.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:24.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:23:24.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:23:24.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' 2024-03-30T12:23:24.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:24.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.14601 172.21.15.84:0/20022426' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-03-30T12:23:24.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-03-30T12:23:24.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: osdmap e141: 8 total, 8 up, 8 in 2024-03-30T12:23:24.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-03-30T12:23:24.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: mgrmap e24: x(active, starting, since 0.00620922s) 2024-03-30T12:23:24.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:23:24.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:23:24.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:23:24.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-30T12:23:24.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-30T12:23:24.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T12:23:24.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:23:24.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:23:24.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:23:24.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:23:24.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:23:24.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:23:24.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:23:24.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:23:24.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T12:23:24.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T12:23:24.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T12:23:25.003 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:24.650+0000 7f27a6155200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T12:23:25.004 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:24.744+0000 7f27a6155200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T12:23:25.033 INFO:tasks.rados.rados.0.smithi084.stdout:394: done (4 left) 2024-03-30T12:23:25.033 INFO:tasks.rados.rados.0.smithi084.stdout:395: done (3 left) 2024-03-30T12:23:25.033 INFO:tasks.rados.rados.0.smithi084.stdout:396: done (2 left) 2024-03-30T12:23:25.033 INFO:tasks.rados.rados.0.smithi084.stdout:397: done (1 left) 2024-03-30T12:23:25.033 INFO:tasks.rados.rados.0.smithi084.stdout:398: done (0 left) 2024-03-30T12:23:25.034 INFO:tasks.rados.rados.0.smithi084.stdout:399: snap_create 2024-03-30T12:23:25.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:25 smithi162 ceph-mon[30421]: Manager daemon x is now available 2024-03-30T12:23:25.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:25 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:25.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:25 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:25.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:25 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:23:25.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:25 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-30T12:23:25.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:25 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-30T12:23:25.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:25 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-30T12:23:25.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:25 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-30T12:23:25.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:25 smithi162 ceph-mon[30421]: osdmap e142: 8 total, 8 up, 8 in 2024-03-30T12:23:25.392 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:25 smithi084 ceph-mon[27000]: Manager daemon x is now available 2024-03-30T12:23:25.393 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:25 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:25.393 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:25 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:25.393 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:25 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:23:25.393 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:25 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-30T12:23:25.393 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:25 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-30T12:23:25.393 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:25 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-30T12:23:25.394 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:25 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-30T12:23:25.394 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:25 smithi084 ceph-mon[27000]: osdmap e142: 8 total, 8 up, 8 in 2024-03-30T12:23:25.394 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:25 smithi084 ceph-mon[37565]: Manager daemon x is now available 2024-03-30T12:23:25.394 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:25 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:25.395 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:25 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:25.395 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:25 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:23:25.395 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:25 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-30T12:23:25.395 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:25 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-30T12:23:25.395 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:25 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-30T12:23:25.395 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:25 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-30T12:23:25.395 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:25 smithi084 ceph-mon[37565]: osdmap e142: 8 total, 8 up, 8 in 2024-03-30T12:23:25.727 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:25.400+0000 7f27a6155200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T12:23:25.727 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:25.494+0000 7f27a6155200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T12:23:25.727 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:25.636+0000 7f27a6155200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T12:23:25.727 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:25.734+0000 7f27a6155200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T12:23:26.004 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:25.819+0000 7f27a6155200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T12:23:26.039 INFO:tasks.rados.rados.0.smithi084.stdout:399: done (0 left) 2024-03-30T12:23:26.039 INFO:tasks.rados.rados.0.smithi084.stdout:400: setattr oid 4 current snap is 39 2024-03-30T12:23:26.042 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 39 2024-03-30T12:23:26.042 INFO:tasks.rados.rados.0.smithi084.stdout:401: seq_num 147 ranges {679936=65536} 2024-03-30T12:23:26.048 INFO:tasks.rados.rados.0.smithi084.stdout:401: writing smithi08477944-14 from 679936 to 745472 tid 1 2024-03-30T12:23:26.048 INFO:tasks.rados.rados.0.smithi084.stdout:402: read oid 16 snap 38 2024-03-30T12:23:26.048 INFO:tasks.rados.rados.0.smithi084.stdout:402: expect (ObjNum 108 snap 23 seq_num 108) 2024-03-30T12:23:26.049 INFO:tasks.rados.rados.0.smithi084.stdout:403: rmattr oid 10 current snap is 39 2024-03-30T12:23:26.049 INFO:tasks.rados.rados.0.smithi084.stdout:403: done (3 left) 2024-03-30T12:23:26.049 INFO:tasks.rados.rados.0.smithi084.stdout:404: copy_from oid 41 from oid 17 current snap is 39 2024-03-30T12:23:26.049 INFO:tasks.rados.rados.0.smithi084.stdout:405: delete oid 32 current snap is 39 2024-03-30T12:23:26.049 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 137 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:23:26.051 INFO:tasks.rados.rados.0.smithi084.stdout:400: done (4 left) 2024-03-30T12:23:26.051 INFO:tasks.rados.rados.0.smithi084.stdout:405: done (3 left) 2024-03-30T12:23:26.051 INFO:tasks.rados.rados.0.smithi084.stdout:406: rmattr oid 28 current snap is 39 2024-03-30T12:23:26.051 INFO:tasks.rados.rados.0.smithi084.stdout:407: rollback oid 31 current snap is 39 2024-03-30T12:23:26.051 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 31 to 32 2024-03-30T12:23:26.052 INFO:tasks.rados.rados.0.smithi084.stdout:408: copy_from oid 19 from oid 46 current snap is 39 2024-03-30T12:23:26.052 INFO:tasks.rados.rados.0.smithi084.stdout:409: read oid 45 snap -1 2024-03-30T12:23:26.052 INFO:tasks.rados.rados.0.smithi084.stdout:409: expect deleted 2024-03-30T12:23:26.052 INFO:tasks.rados.rados.0.smithi084.stdout:410: rollback oid 29 current snap is 39 2024-03-30T12:23:26.052 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 29 to 36 2024-03-30T12:23:26.053 INFO:tasks.rados.rados.0.smithi084.stdout:411: setattr oid 40 current snap is 39 2024-03-30T12:23:26.054 INFO:tasks.rados.rados.0.smithi084.stdout:401: finishing write tid 1 to smithi08477944-14 2024-03-30T12:23:26.054 INFO:tasks.rados.rados.0.smithi084.stdout:409: done (8 left) 2024-03-30T12:23:26.054 INFO:tasks.rados.rados.0.smithi084.stdout:412: snap_create 2024-03-30T12:23:26.055 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 139 (ObjNum 138 snap 34 seq_num 138) dirty exists 2024-03-30T12:23:26.055 INFO:tasks.rados.rados.0.smithi084.stdout:401: finishing write tid 2 to smithi08477944-14 2024-03-30T12:23:26.056 INFO:tasks.rados.rados.0.smithi084.stdout:407: finishing rollback tid 1 to smithi08477944-31 2024-03-30T12:23:26.056 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 59 (ObjNum 1601 snap 0 seq_num 1429423792) dirty dne 2024-03-30T12:23:26.058 INFO:tasks.rados.rados.0.smithi084.stdout:410: finishing rollback tid 1 to smithi08477944-29 2024-03-30T12:23:26.058 INFO:tasks.rados.rados.0.smithi084.stdout:410: finishing rollback tid 2 to smithi08477944-29 2024-03-30T12:23:26.058 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 142 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-03-30T12:23:26.058 INFO:tasks.rados.rados.0.smithi084.stdout:401: finishing write tid 3 to smithi08477944-14 2024-03-30T12:23:26.058 INFO:tasks.rados.rados.0.smithi084.stdout:401: oid 14 updating version 0 to 135 2024-03-30T12:23:26.058 INFO:tasks.rados.rados.0.smithi084.stdout:401: oid 14 version 135 is already newer than 134 2024-03-30T12:23:26.058 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 135 (ObjNum 147 snap 39 seq_num 147) dirty exists 2024-03-30T12:23:26.059 INFO:tasks.rados.rados.0.smithi084.stdout:401: left oid 14 (ObjNum 147 snap 39 seq_num 147) 2024-03-30T12:23:26.061 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 174 (ObjNum 49 snap 0 seq_num 49) dirty exists 2024-03-30T12:23:26.062 INFO:tasks.rados.rados.0.smithi084.stdout:408: finishing copy_from racing read to smithi08477944-19 2024-03-30T12:23:26.062 INFO:tasks.rados.rados.0.smithi084.stdout:404: finishing copy_from racing read to smithi08477944-41 2024-03-30T12:23:26.063 INFO:tasks.rados.rados.0.smithi084.stdout:408: finishing copy_from to smithi08477944-19 2024-03-30T12:23:26.063 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 62 (ObjNum 107 snap 22 seq_num 107) dirty exists 2024-03-30T12:23:26.067 INFO:tasks.rados.rados.0.smithi084.stdout:402: expect (ObjNum 108 snap 23 seq_num 108) 2024-03-30T12:23:26.206 INFO:tasks.rados.rados.0.smithi084.stdout:404: finishing copy_from to smithi08477944-41 2024-03-30T12:23:26.206 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 18 (ObjNum 55 snap 3 seq_num 55) dirty exists 2024-03-30T12:23:26.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:26 smithi162 ceph-mon[30421]: Deploying cephadm binary to smithi084 2024-03-30T12:23:26.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:26 smithi162 ceph-mon[30421]: Deploying cephadm binary to smithi162 2024-03-30T12:23:26.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:26 smithi162 ceph-mon[30421]: [30/Mar/2024:12:23:25] ENGINE Bus STARTING 2024-03-30T12:23:26.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:26 smithi162 ceph-mon[30421]: mgrmap e25: x(active, since 1.04754s) 2024-03-30T12:23:26.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:26 smithi162 ceph-mon[30421]: pgmap v4: 121 pgs: 121 active+clean; 129 MiB data, 511 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:23:26.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:26 smithi162 ceph-mon[30421]: osdmap e143: 8 total, 8 up, 8 in 2024-03-30T12:23:26.406 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:26.112+0000 7f27a6155200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T12:23:26.406 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:26.233+0000 7f27a6155200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T12:23:26.406 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:26.319+0000 7f27a6155200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T12:23:26.407 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:26 smithi084 ceph-mon[37565]: Deploying cephadm binary to smithi084 2024-03-30T12:23:26.407 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:26 smithi084 ceph-mon[37565]: Deploying cephadm binary to smithi162 2024-03-30T12:23:26.407 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:26 smithi084 ceph-mon[37565]: [30/Mar/2024:12:23:25] ENGINE Bus STARTING 2024-03-30T12:23:26.407 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:26 smithi084 ceph-mon[37565]: mgrmap e25: x(active, since 1.04754s) 2024-03-30T12:23:26.407 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:26 smithi084 ceph-mon[37565]: pgmap v4: 121 pgs: 121 active+clean; 129 MiB data, 511 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:23:26.407 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:26 smithi084 ceph-mon[37565]: osdmap e143: 8 total, 8 up, 8 in 2024-03-30T12:23:26.407 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:26 smithi084 ceph-mon[27000]: Deploying cephadm binary to smithi084 2024-03-30T12:23:26.408 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:26 smithi084 ceph-mon[27000]: Deploying cephadm binary to smithi162 2024-03-30T12:23:26.408 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:26 smithi084 ceph-mon[27000]: [30/Mar/2024:12:23:25] ENGINE Bus STARTING 2024-03-30T12:23:26.408 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:26 smithi084 ceph-mon[27000]: mgrmap e25: x(active, since 1.04754s) 2024-03-30T12:23:26.408 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:26 smithi084 ceph-mon[27000]: pgmap v4: 121 pgs: 121 active+clean; 129 MiB data, 511 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:23:26.408 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:26 smithi084 ceph-mon[27000]: osdmap e143: 8 total, 8 up, 8 in 2024-03-30T12:23:26.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:26.413+0000 7f27a6155200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T12:23:26.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:26.591+0000 7f27a6155200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T12:23:27.039 INFO:tasks.rados.rados.0.smithi084.stdout:401: done (8 left) 2024-03-30T12:23:27.039 INFO:tasks.rados.rados.0.smithi084.stdout:402: done (7 left) 2024-03-30T12:23:27.039 INFO:tasks.rados.rados.0.smithi084.stdout:404: done (6 left) 2024-03-30T12:23:27.039 INFO:tasks.rados.rados.0.smithi084.stdout:406: done (5 left) 2024-03-30T12:23:27.039 INFO:tasks.rados.rados.0.smithi084.stdout:407: done (4 left) 2024-03-30T12:23:27.039 INFO:tasks.rados.rados.0.smithi084.stdout:408: done (3 left) 2024-03-30T12:23:27.039 INFO:tasks.rados.rados.0.smithi084.stdout:410: done (2 left) 2024-03-30T12:23:27.039 INFO:tasks.rados.rados.0.smithi084.stdout:411: done (1 left) 2024-03-30T12:23:27.040 INFO:tasks.rados.rados.0.smithi084.stdout:412: done (0 left) 2024-03-30T12:23:27.040 INFO:tasks.rados.rados.0.smithi084.stdout:413: rmattr oid 4 current snap is 40 2024-03-30T12:23:27.040 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 40 2024-03-30T12:23:27.040 INFO:tasks.rados.rados.0.smithi084.stdout:414: seq_num 149 ranges {3137536=98304} 2024-03-30T12:23:27.057 INFO:tasks.rados.rados.0.smithi084.stdout:414: writing smithi08477944-47 from 3137536 to 3235840 tid 1 2024-03-30T12:23:27.057 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 40 2024-03-30T12:23:27.057 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 144 (ObjNum 49 snap 0 seq_num 1429350528) dirty exists 2024-03-30T12:23:27.057 INFO:tasks.rados.rados.0.smithi084.stdout:415: seq_num 150 ranges {827392=114688} 2024-03-30T12:23:27.062 INFO:tasks.rados.rados.0.smithi084.stdout:415: writing smithi08477944-40 from 827392 to 942080 tid 1 2024-03-30T12:23:27.062 INFO:tasks.rados.rados.0.smithi084.stdout:413: done (2 left) 2024-03-30T12:23:27.062 INFO:tasks.rados.rados.0.smithi084.stdout:416: read oid 33 snap 37 2024-03-30T12:23:27.063 INFO:tasks.rados.rados.0.smithi084.stdout:416: expect (ObjNum 110 snap 24 seq_num 110) 2024-03-30T12:23:27.063 INFO:tasks.rados.rados.0.smithi084.stdout:417: delete oid 23 current snap is 40 2024-03-30T12:23:27.063 INFO:tasks.rados.rados.0.smithi084.stdout:414: finishing write tid 1 to smithi08477944-47 2024-03-30T12:23:27.063 INFO:tasks.rados.rados.0.smithi084.stdout:414: finishing write tid 2 to smithi08477944-47 2024-03-30T12:23:27.063 INFO:tasks.rados.rados.0.smithi084.stdout:414: finishing write tid 3 to smithi08477944-47 2024-03-30T12:23:27.063 INFO:tasks.rados.rados.0.smithi084.stdout:414: oid 47 updating version 0 to 177 2024-03-30T12:23:27.063 INFO:tasks.rados.rados.0.smithi084.stdout:414: oid 47 version 177 is already newer than 176 2024-03-30T12:23:27.063 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 177 (ObjNum 149 snap 40 seq_num 149) dirty exists 2024-03-30T12:23:27.063 INFO:tasks.rados.rados.0.smithi084.stdout:414: left oid 47 (ObjNum 149 snap 40 seq_num 149) 2024-03-30T12:23:27.065 INFO:tasks.rados.rados.0.smithi084.stdout:414: done (3 left) 2024-03-30T12:23:27.065 INFO:tasks.rados.rados.0.smithi084.stdout:417: done (2 left) 2024-03-30T12:23:27.065 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 40 2024-03-30T12:23:27.065 INFO:tasks.rados.rados.0.smithi084.stdout:418: seq_num 152 ranges {2408448=147456} 2024-03-30T12:23:27.079 INFO:tasks.rados.rados.0.smithi084.stdout:418: writing smithi08477944-6 from 2408448 to 2555904 tid 1 2024-03-30T12:23:27.079 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 40 2024-03-30T12:23:27.079 INFO:tasks.rados.rados.0.smithi084.stdout:415: finishing write tid 1 to smithi08477944-40 2024-03-30T12:23:27.079 INFO:tasks.rados.rados.0.smithi084.stdout:419: seq_num 153 ranges {745472=163840} 2024-03-30T12:23:27.084 INFO:tasks.rados.rados.0.smithi084.stdout:419: writing smithi08477944-14 from 745472 to 909312 tid 1 2024-03-30T12:23:27.084 INFO:tasks.rados.rados.0.smithi084.stdout:420: rollback oid 17 current snap is 40 2024-03-30T12:23:27.084 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 17 to 29 2024-03-30T12:23:27.084 INFO:tasks.rados.rados.0.smithi084.stdout:415: finishing write tid 2 to smithi08477944-40 2024-03-30T12:23:27.084 INFO:tasks.rados.rados.0.smithi084.stdout:416: expect (ObjNum 110 snap 24 seq_num 110) 2024-03-30T12:23:27.148 INFO:tasks.rados.rados.0.smithi084.stdout:415: finishing write tid 3 to smithi08477944-40 2024-03-30T12:23:27.148 INFO:tasks.rados.rados.0.smithi084.stdout:415: oid 40 updating version 0 to 179 2024-03-30T12:23:27.148 INFO:tasks.rados.rados.0.smithi084.stdout:415: oid 40 updating version 179 to 180 2024-03-30T12:23:27.148 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 180 (ObjNum 150 snap 40 seq_num 150) dirty exists 2024-03-30T12:23:27.148 INFO:tasks.rados.rados.0.smithi084.stdout:415: left oid 40 (ObjNum 150 snap 40 seq_num 150) 2024-03-30T12:23:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:418: finishing write tid 1 to smithi08477944-6 2024-03-30T12:23:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:415: done (4 left) 2024-03-30T12:23:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:416: done (3 left) 2024-03-30T12:23:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:421: read oid 49 snap -1 2024-03-30T12:23:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:421: expect (ObjNum 146 snap 37 seq_num 146) 2024-03-30T12:23:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:422: copy_from oid 35 from oid 40 current snap is 40 2024-03-30T12:23:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:418: finishing write tid 2 to smithi08477944-6 2024-03-30T12:23:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:418: finishing write tid 3 to smithi08477944-6 2024-03-30T12:23:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:418: oid 6 updating version 0 to 122 2024-03-30T12:23:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:418: oid 6 version 122 is already newer than 121 2024-03-30T12:23:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 122 (ObjNum 152 snap 40 seq_num 152) dirty exists 2024-03-30T12:23:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:418: left oid 6 (ObjNum 152 snap 40 seq_num 152) 2024-03-30T12:23:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:420: finishing rollback tid 0 to smithi08477944-17 2024-03-30T12:23:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:420: finishing rollback tid 1 to smithi08477944-17 2024-03-30T12:23:27.149 INFO:tasks.rados.rados.0.smithi084.stdout:420: finishing rollback tid 2 to smithi08477944-17 2024-03-30T12:23:27.150 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 169 (ObjNum 55 snap 3 seq_num 55) dirty exists 2024-03-30T12:23:27.150 INFO:tasks.rados.rados.0.smithi084.stdout:419: finishing write tid 1 to smithi08477944-14 2024-03-30T12:23:27.150 INFO:tasks.rados.rados.0.smithi084.stdout:419: finishing write tid 2 to smithi08477944-14 2024-03-30T12:23:27.150 INFO:tasks.rados.rados.0.smithi084.stdout:418: done (4 left) 2024-03-30T12:23:27.150 INFO:tasks.rados.rados.0.smithi084.stdout:420: done (3 left) 2024-03-30T12:23:27.150 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 40 2024-03-30T12:23:27.150 INFO:tasks.rados.rados.0.smithi084.stdout:419: finishing write tid 3 to smithi08477944-14 2024-03-30T12:23:27.150 INFO:tasks.rados.rados.0.smithi084.stdout:419: oid 14 updating version 0 to 138 2024-03-30T12:23:27.150 INFO:tasks.rados.rados.0.smithi084.stdout:419: oid 14 version 138 is already newer than 137 2024-03-30T12:23:27.150 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 138 (ObjNum 153 snap 40 seq_num 153) dirty exists 2024-03-30T12:23:27.150 INFO:tasks.rados.rados.0.smithi084.stdout:419: left oid 14 (ObjNum 153 snap 40 seq_num 153) 2024-03-30T12:23:27.150 INFO:tasks.rados.rados.0.smithi084.stdout:423: seq_num 154 ranges {3235840=180224} 2024-03-30T12:23:27.165 INFO:tasks.rados.rados.0.smithi084.stdout:423: writing smithi08477944-47 from 3235840 to 3416064 tid 1 2024-03-30T12:23:27.165 INFO:tasks.rados.rados.0.smithi084.stdout:419: done (3 left) 2024-03-30T12:23:27.165 INFO:tasks.rados.rados.0.smithi084.stdout:424: read oid 37 snap -1 2024-03-30T12:23:27.165 INFO:tasks.rados.rados.0.smithi084.stdout:424: expect (ObjNum 132 snap 31 seq_num 132) 2024-03-30T12:23:27.165 INFO:tasks.rados.rados.0.smithi084.stdout:425: copy_from oid 27 from oid 48 current snap is 40 2024-03-30T12:23:27.165 INFO:tasks.rados.rados.0.smithi084.stdout:421: expect (ObjNum 146 snap 37 seq_num 146) 2024-03-30T12:23:27.261 INFO:tasks.rados.rados.0.smithi084.stdout:422: finishing copy_from racing read to smithi08477944-35 2024-03-30T12:23:27.262 INFO:tasks.rados.rados.0.smithi084.stdout:422: finishing copy_from to smithi08477944-35 2024-03-30T12:23:27.262 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 180 (ObjNum 150 snap 40 seq_num 150) dirty exists 2024-03-30T12:23:27.262 INFO:tasks.rados.rados.0.smithi084.stdout:425: finishing copy_from to smithi08477944-27 2024-03-30T12:23:27.262 INFO:tasks.rados.rados.0.smithi084.stdout:425: got expected ENOENT (src dne) 2024-03-30T12:23:27.262 INFO:tasks.rados.rados.0.smithi084.stdout:425: finishing copy_from racing read to smithi08477944-27 2024-03-30T12:23:27.262 INFO:tasks.rados.rados.0.smithi084.stdout:423: finishing write tid 1 to smithi08477944-47 2024-03-30T12:23:27.262 INFO:tasks.rados.rados.0.smithi084.stdout:421: done (4 left) 2024-03-30T12:23:27.262 INFO:tasks.rados.rados.0.smithi084.stdout:422: done (3 left) 2024-03-30T12:23:27.262 INFO:tasks.rados.rados.0.smithi084.stdout:425: done (2 left) 2024-03-30T12:23:27.262 INFO:tasks.rados.rados.0.smithi084.stdout:426: read oid 40 snap -1 2024-03-30T12:23:27.262 INFO:tasks.rados.rados.0.smithi084.stdout:426: expect (ObjNum 150 snap 40 seq_num 150) 2024-03-30T12:23:27.262 INFO:tasks.rados.rados.0.smithi084.stdout:427: delete oid 1 current snap is 40 2024-03-30T12:23:27.263 INFO:tasks.rados.rados.0.smithi084.stdout:423: finishing write tid 2 to smithi08477944-47 2024-03-30T12:23:27.263 INFO:tasks.rados.rados.0.smithi084.stdout:423: finishing write tid 3 to smithi08477944-47 2024-03-30T12:23:27.263 INFO:tasks.rados.rados.0.smithi084.stdout:423: oid 47 updating version 0 to 182 2024-03-30T12:23:27.263 INFO:tasks.rados.rados.0.smithi084.stdout:423: oid 47 version 182 is already newer than 181 2024-03-30T12:23:27.263 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 182 (ObjNum 154 snap 40 seq_num 154) dirty exists 2024-03-30T12:23:27.263 INFO:tasks.rados.rados.0.smithi084.stdout:423: left oid 47 (ObjNum 154 snap 40 seq_num 154) 2024-03-30T12:23:27.263 INFO:tasks.rados.rados.0.smithi084.stdout:424: expect (ObjNum 132 snap 31 seq_num 132) 2024-03-30T12:23:27.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:27 smithi162 ceph-mon[30421]: [30/Mar/2024:12:23:25] ENGINE Serving on http://172.21.15.162:8765 2024-03-30T12:23:27.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:27 smithi162 ceph-mon[30421]: [30/Mar/2024:12:23:25] ENGINE Serving on https://172.21.15.162:7150 2024-03-30T12:23:27.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:27 smithi162 ceph-mon[30421]: [30/Mar/2024:12:23:25] ENGINE Bus STARTED 2024-03-30T12:23:27.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:27 smithi162 ceph-mon[30421]: pgmap v6: 121 pgs: 121 active+clean; 129 MiB data, 511 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:23:27.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:27 smithi162 ceph-mon[30421]: osdmap e144: 8 total, 8 up, 8 in 2024-03-30T12:23:27.409 INFO:tasks.rados.rados.0.smithi084.stdout:426: expect (ObjNum 150 snap 40 seq_num 150) 2024-03-30T12:23:27.457 INFO:tasks.rados.rados.0.smithi084.stdout:423: done (3 left) 2024-03-30T12:23:27.457 INFO:tasks.rados.rados.0.smithi084.stdout:424: done (2 left) 2024-03-30T12:23:27.457 INFO:tasks.rados.rados.0.smithi084.stdout:426: done (1 left) 2024-03-30T12:23:27.457 INFO:tasks.rados.rados.0.smithi084.stdout:427: done (0 left) 2024-03-30T12:23:27.458 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 40 2024-03-30T12:23:27.458 INFO:tasks.rados.rados.0.smithi084.stdout:428: seq_num 156 ranges {1196032=221184} 2024-03-30T12:23:27.465 INFO:tasks.rados.rados.0.smithi084.stdout:428: writing smithi08477944-41 from 1196032 to 1417216 tid 1 2024-03-30T12:23:27.465 INFO:tasks.rados.rados.0.smithi084.stdout:429: copy_from oid 32 from oid 33 current snap is 40 2024-03-30T12:23:27.465 INFO:tasks.rados.rados.0.smithi084.stdout:430: rollback oid 23 current snap is 40 2024-03-30T12:23:27.465 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 23 to 39 2024-03-30T12:23:27.465 INFO:tasks.rados.rados.0.smithi084.stdout:431: snap_remove snap 29 2024-03-30T12:23:27.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:27 smithi084 ceph-mon[27000]: [30/Mar/2024:12:23:25] ENGINE Serving on http://172.21.15.162:8765 2024-03-30T12:23:27.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:27 smithi084 ceph-mon[27000]: [30/Mar/2024:12:23:25] ENGINE Serving on https://172.21.15.162:7150 2024-03-30T12:23:27.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:27 smithi084 ceph-mon[27000]: [30/Mar/2024:12:23:25] ENGINE Bus STARTED 2024-03-30T12:23:27.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:27 smithi084 ceph-mon[27000]: pgmap v6: 121 pgs: 121 active+clean; 129 MiB data, 511 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:23:27.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:27 smithi084 ceph-mon[27000]: osdmap e144: 8 total, 8 up, 8 in 2024-03-30T12:23:27.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:27 smithi084 ceph-mon[37565]: [30/Mar/2024:12:23:25] ENGINE Serving on http://172.21.15.162:8765 2024-03-30T12:23:27.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:27 smithi084 ceph-mon[37565]: [30/Mar/2024:12:23:25] ENGINE Serving on https://172.21.15.162:7150 2024-03-30T12:23:27.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:27 smithi084 ceph-mon[37565]: [30/Mar/2024:12:23:25] ENGINE Bus STARTED 2024-03-30T12:23:27.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:27 smithi084 ceph-mon[37565]: pgmap v6: 121 pgs: 121 active+clean; 129 MiB data, 511 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:23:27.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:27 smithi084 ceph-mon[37565]: osdmap e144: 8 total, 8 up, 8 in 2024-03-30T12:23:28.003 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:27.587+0000 7f27a6155200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T12:23:28.004 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:27.720+0000 7f27a6155200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T12:23:28.111 INFO:tasks.rados.rados.0.smithi084.stdout:431: done (3 left) 2024-03-30T12:23:28.112 INFO:tasks.rados.rados.0.smithi084.stdout:432: read oid 12 snap -1 2024-03-30T12:23:28.112 INFO:tasks.rados.rados.0.smithi084.stdout:432: expect (ObjNum 136 snap 32 seq_num 136) 2024-03-30T12:23:28.112 INFO:tasks.rados.rados.0.smithi084.stdout:433: rollback oid 40 current snap is 40 2024-03-30T12:23:28.112 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 40 to 9 2024-03-30T12:23:28.112 INFO:tasks.rados.rados.0.smithi084.stdout:434: delete oid 16 current snap is 40 2024-03-30T12:23:28.112 INFO:tasks.rados.rados.0.smithi084.stdout:430: finishing rollback tid 1 to smithi08477944-23 2024-03-30T12:23:28.112 INFO:tasks.rados.rados.0.smithi084.stdout:428: finishing write tid 1 to smithi08477944-41 2024-03-30T12:23:28.112 INFO:tasks.rados.rados.0.smithi084.stdout:428: finishing write tid 2 to smithi08477944-41 2024-03-30T12:23:28.112 INFO:tasks.rados.rados.0.smithi084.stdout:428: finishing write tid 3 to smithi08477944-41 2024-03-30T12:23:28.112 INFO:tasks.rados.rados.0.smithi084.stdout:428: oid 41 updating version 0 to 223 2024-03-30T12:23:28.112 INFO:tasks.rados.rados.0.smithi084.stdout:428: oid 41 version 223 is already newer than 222 2024-03-30T12:23:28.112 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 223 (ObjNum 156 snap 40 seq_num 156) dirty exists 2024-03-30T12:23:28.113 INFO:tasks.rados.rados.0.smithi084.stdout:428: left oid 41 (ObjNum 156 snap 40 seq_num 156) 2024-03-30T12:23:28.113 INFO:tasks.rados.rados.0.smithi084.stdout:429: finishing copy_from racing read to smithi08477944-32 2024-03-30T12:23:28.113 INFO:tasks.rados.rados.0.smithi084.stdout:430: finishing rollback tid 2 to smithi08477944-23 2024-03-30T12:23:28.113 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 154 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-03-30T12:23:28.113 INFO:tasks.rados.rados.0.smithi084.stdout:429: finishing copy_from to smithi08477944-32 2024-03-30T12:23:28.113 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 104 (ObjNum 110 snap 24 seq_num 110) dirty exists 2024-03-30T12:23:28.118 INFO:tasks.rados.rados.0.smithi084.stdout:428: done (5 left) 2024-03-30T12:23:28.119 INFO:tasks.rados.rados.0.smithi084.stdout:429: done (4 left) 2024-03-30T12:23:28.119 INFO:tasks.rados.rados.0.smithi084.stdout:430: done (3 left) 2024-03-30T12:23:28.119 INFO:tasks.rados.rados.0.smithi084.stdout:434: done (2 left) 2024-03-30T12:23:28.119 INFO:tasks.rados.rados.0.smithi084.stdout:435: rmattr oid 9 current snap is 40 2024-03-30T12:23:28.119 INFO:tasks.rados.rados.0.smithi084.stdout:435: done (2 left) 2024-03-30T12:23:28.119 INFO:tasks.rados.rados.0.smithi084.stdout:436: snap_create 2024-03-30T12:23:28.119 INFO:tasks.rados.rados.0.smithi084.stdout:433: finishing rollback tid 0 to smithi08477944-40 2024-03-30T12:23:28.119 INFO:tasks.rados.rados.0.smithi084.stdout:433: finishing rollback tid 1 to smithi08477944-40 2024-03-30T12:23:28.121 INFO:tasks.rados.rados.0.smithi084.stdout:433: finishing rollback tid 2 to smithi08477944-40 2024-03-30T12:23:28.121 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 185 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-03-30T12:23:28.132 INFO:tasks.rados.rados.0.smithi084.stdout:432: expect (ObjNum 136 snap 32 seq_num 136) 2024-03-30T12:23:28.346 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:28 smithi084 ceph-mon[37565]: mgrmap e26: x(active, since 3s) 2024-03-30T12:23:28.346 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:28 smithi084 ceph-mon[27000]: mgrmap e26: x(active, since 3s) 2024-03-30T12:23:28.347 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:28.053+0000 7f27a6155200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T12:23:28.347 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:28.157+0000 7f27a6155200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T12:23:28.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:28 smithi162 ceph-mon[30421]: mgrmap e26: x(active, since 3s) 2024-03-30T12:23:28.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:28.355+0000 7f27a6155200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:23:28.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:28.539+0000 7f27a6155200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T12:23:29.073 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:28.825+0000 7f27a6155200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:23:29.115 INFO:tasks.rados.rados.0.smithi084.stdout:432: done (2 left) 2024-03-30T12:23:29.115 INFO:tasks.rados.rados.0.smithi084.stdout:433: done (1 left) 2024-03-30T12:23:29.115 INFO:tasks.rados.rados.0.smithi084.stdout:436: done (0 left) 2024-03-30T12:23:29.115 INFO:tasks.rados.rados.0.smithi084.stdout:437: delete oid 37 current snap is 41 2024-03-30T12:23:29.119 INFO:tasks.rados.rados.0.smithi084.stdout:437: done (0 left) 2024-03-30T12:23:29.119 INFO:tasks.rados.rados.0.smithi084.stdout:438: read oid 28 snap 31 2024-03-30T12:23:29.119 INFO:tasks.rados.rados.0.smithi084.stdout:438: expect (ObjNum 27 snap 0 seq_num 27) 2024-03-30T12:23:29.119 INFO:tasks.rados.rados.0.smithi084.stdout:439: read oid 6 snap -1 2024-03-30T12:23:29.119 INFO:tasks.rados.rados.0.smithi084.stdout:439: expect (ObjNum 152 snap 40 seq_num 152) 2024-03-30T12:23:29.119 INFO:tasks.rados.rados.0.smithi084.stdout:440: snap_remove snap 33 2024-03-30T12:23:29.331 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:29.082+0000 7f27a6155200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T12:23:29.331 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:29 smithi084 ceph-mon[27000]: pgmap v8: 121 pgs: 121 active+clean; 129 MiB data, 511 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:23:29.331 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:29 smithi084 ceph-mon[27000]: osdmap e145: 8 total, 8 up, 8 in 2024-03-30T12:23:29.332 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:29 smithi084 ceph-mon[37565]: pgmap v8: 121 pgs: 121 active+clean; 129 MiB data, 511 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:23:29.332 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:29 smithi084 ceph-mon[37565]: osdmap e145: 8 total, 8 up, 8 in 2024-03-30T12:23:29.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:29 smithi162 ceph-mon[30421]: pgmap v8: 121 pgs: 121 active+clean; 129 MiB data, 511 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:23:29.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:29 smithi162 ceph-mon[30421]: osdmap e145: 8 total, 8 up, 8 in 2024-03-30T12:23:29.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:29.340+0000 7f27a6155200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T12:23:30.034 INFO:tasks.rados.rados.0.smithi084.stdout:440: done (2 left) 2024-03-30T12:23:30.034 INFO:tasks.rados.rados.0.smithi084.stdout:441: snap_remove snap 39 2024-03-30T12:23:30.206 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:30 smithi084 ceph-mon[37565]: osdmap e146: 8 total, 8 up, 8 in 2024-03-30T12:23:30.206 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:30 smithi084 ceph-mon[37565]: osdmap e147: 8 total, 8 up, 8 in 2024-03-30T12:23:30.207 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:30 smithi084 ceph-mon[27000]: osdmap e146: 8 total, 8 up, 8 in 2024-03-30T12:23:30.207 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:30 smithi084 ceph-mon[27000]: osdmap e147: 8 total, 8 up, 8 in 2024-03-30T12:23:30.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:30 smithi162 ceph-mon[30421]: osdmap e146: 8 total, 8 up, 8 in 2024-03-30T12:23:30.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:30 smithi162 ceph-mon[30421]: osdmap e147: 8 total, 8 up, 8 in 2024-03-30T12:23:30.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:30.214+0000 7f27a6155200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T12:23:31.043 INFO:tasks.rados.rados.0.smithi084.stdout:441: done (2 left) 2024-03-30T12:23:31.043 INFO:tasks.rados.rados.0.smithi084.stdout:442: snap_create 2024-03-30T12:23:31.043 INFO:tasks.rados.rados.0.smithi084.stdout:438: expect (ObjNum 27 snap 0 seq_num 27) 2024-03-30T12:23:31.061 INFO:tasks.rados.rados.0.smithi084.stdout:439: expect (ObjNum 152 snap 40 seq_num 152) 2024-03-30T12:23:31.110 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:30.850+0000 7f27a6155200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T12:23:31.110 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:30.950+0000 7f27a6155200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T12:23:31.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:31 smithi162 ceph-mon[30421]: pgmap v12: 121 pgs: 121 active+clean; 129 MiB data, 511 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:23:31.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:31 smithi162 ceph-mon[30421]: osdmap e148: 8 total, 8 up, 8 in 2024-03-30T12:23:31.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:31 smithi084 ceph-mon[27000]: pgmap v12: 121 pgs: 121 active+clean; 129 MiB data, 511 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:23:31.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:31 smithi084 ceph-mon[27000]: osdmap e148: 8 total, 8 up, 8 in 2024-03-30T12:23:31.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:31 smithi084 ceph-mon[37565]: pgmap v12: 121 pgs: 121 active+clean; 129 MiB data, 511 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:23:31.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:31 smithi084 ceph-mon[37565]: osdmap e148: 8 total, 8 up, 8 in 2024-03-30T12:23:31.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:31.191+0000 7f27a6155200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T12:23:31.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:23:31] ENGINE Bus STARTING 2024-03-30T12:23:31.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: CherryPy Checker: 2024-03-30T12:23:31.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: The Application mounted at '' has an empty config. 2024-03-30T12:23:31.505 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: 2024-03-30T12:23:31.505 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:23:31] ENGINE Serving on http://:::9283 2024-03-30T12:23:31.505 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: [30/Mar/2024:12:23:31] ENGINE Bus STARTED 2024-03-30T12:23:32.044 INFO:tasks.rados.rados.0.smithi084.stdout:438: done (2 left) 2024-03-30T12:23:32.044 INFO:tasks.rados.rados.0.smithi084.stdout:439: done (1 left) 2024-03-30T12:23:32.044 INFO:tasks.rados.rados.0.smithi084.stdout:442: done (0 left) 2024-03-30T12:23:32.044 INFO:tasks.rados.rados.0.smithi084.stdout:443: read oid 47 snap -1 2024-03-30T12:23:32.044 INFO:tasks.rados.rados.0.smithi084.stdout:443: expect (ObjNum 154 snap 40 seq_num 154) 2024-03-30T12:23:32.044 INFO:tasks.rados.rados.0.smithi084.stdout:444: rmattr oid 41 current snap is 42 2024-03-30T12:23:32.045 INFO:tasks.rados.rados.0.smithi084.stdout:444: done (1 left) 2024-03-30T12:23:32.045 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 42 2024-03-30T12:23:32.045 INFO:tasks.rados.rados.0.smithi084.stdout:445: seq_num 159 ranges {2850816=270336} 2024-03-30T12:23:32.061 INFO:tasks.rados.rados.0.smithi084.stdout:445: writing smithi08477944-38 from 2850816 to 3121152 tid 1 2024-03-30T12:23:32.062 INFO:tasks.rados.rados.0.smithi084.stdout:446: read oid 46 snap -1 2024-03-30T12:23:32.062 INFO:tasks.rados.rados.0.smithi084.stdout:446: expect (ObjNum 107 snap 22 seq_num 107) 2024-03-30T12:23:32.062 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 42 2024-03-30T12:23:32.062 INFO:tasks.rados.rados.0.smithi084.stdout:447: seq_num 160 ranges {663552=286720} 2024-03-30T12:23:32.067 INFO:tasks.rados.rados.0.smithi084.stdout:447: writing smithi08477944-40 from 663552 to 950272 tid 1 2024-03-30T12:23:32.067 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 42 2024-03-30T12:23:32.067 INFO:tasks.rados.rados.0.smithi084.stdout:448: seq_num 161 ranges {0=303104} 2024-03-30T12:23:32.069 INFO:tasks.rados.rados.0.smithi084.stdout:448: writing smithi08477944-45 from 0 to 303104 tid 1 2024-03-30T12:23:32.069 INFO:tasks.rados.rados.0.smithi084.stdout:443: expect (ObjNum 154 snap 40 seq_num 154) 2024-03-30T12:23:32.284 INFO:tasks.rados.rados.0.smithi084.stdout:445: finishing write tid 1 to smithi08477944-38 2024-03-30T12:23:32.284 INFO:tasks.rados.rados.0.smithi084.stdout:445: finishing write tid 2 to smithi08477944-38 2024-03-30T12:23:32.284 INFO:tasks.rados.rados.0.smithi084.stdout:445: finishing write tid 3 to smithi08477944-38 2024-03-30T12:23:32.284 INFO:tasks.rados.rados.0.smithi084.stdout:445: oid 38 updating version 0 to 93 2024-03-30T12:23:32.284 INFO:tasks.rados.rados.0.smithi084.stdout:445: oid 38 version 93 is already newer than 92 2024-03-30T12:23:32.284 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 93 (ObjNum 159 snap 42 seq_num 159) dirty exists 2024-03-30T12:23:32.284 INFO:tasks.rados.rados.0.smithi084.stdout:445: left oid 38 (ObjNum 159 snap 42 seq_num 159) 2024-03-30T12:23:32.284 INFO:tasks.rados.rados.0.smithi084.stdout:449: read oid 29 snap -1 2024-03-30T12:23:32.284 INFO:tasks.rados.rados.0.smithi084.stdout:449: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-30T12:23:32.285 INFO:tasks.rados.rados.0.smithi084.stdout:443: done (5 left) 2024-03-30T12:23:32.285 INFO:tasks.rados.rados.0.smithi084.stdout:445: done (4 left) 2024-03-30T12:23:32.285 INFO:tasks.rados.rados.0.smithi084.stdout:450: snap_create 2024-03-30T12:23:32.285 INFO:tasks.rados.rados.0.smithi084.stdout:447: finishing write tid 1 to smithi08477944-40 2024-03-30T12:23:32.285 INFO:tasks.rados.rados.0.smithi084.stdout:447: finishing write tid 2 to smithi08477944-40 2024-03-30T12:23:32.285 INFO:tasks.rados.rados.0.smithi084.stdout:447: finishing write tid 3 to smithi08477944-40 2024-03-30T12:23:32.285 INFO:tasks.rados.rados.0.smithi084.stdout:447: oid 40 updating version 0 to 200 2024-03-30T12:23:32.285 INFO:tasks.rados.rados.0.smithi084.stdout:447: oid 40 version 200 is already newer than 199 2024-03-30T12:23:32.285 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 200 (ObjNum 160 snap 42 seq_num 160) dirty exists 2024-03-30T12:23:32.285 INFO:tasks.rados.rados.0.smithi084.stdout:447: left oid 40 (ObjNum 160 snap 42 seq_num 160) 2024-03-30T12:23:32.285 INFO:tasks.rados.rados.0.smithi084.stdout:448: finishing write tid 1 to smithi08477944-45 2024-03-30T12:23:32.285 INFO:tasks.rados.rados.0.smithi084.stdout:448: finishing write tid 2 to smithi08477944-45 2024-03-30T12:23:32.285 INFO:tasks.rados.rados.0.smithi084.stdout:448: finishing write tid 3 to smithi08477944-45 2024-03-30T12:23:32.285 INFO:tasks.rados.rados.0.smithi084.stdout:448: oid 45 updating version 0 to 240 2024-03-30T12:23:32.285 INFO:tasks.rados.rados.0.smithi084.stdout:448: oid 45 updating version 240 to 241 2024-03-30T12:23:32.286 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 241 (ObjNum 161 snap 42 seq_num 161) dirty exists 2024-03-30T12:23:32.286 INFO:tasks.rados.rados.0.smithi084.stdout:448: left oid 45 (ObjNum 161 snap 42 seq_num 161) 2024-03-30T12:23:32.286 INFO:tasks.rados.rados.0.smithi084.stdout:446: expect (ObjNum 107 snap 22 seq_num 107) 2024-03-30T12:23:32.333 INFO:tasks.rados.rados.0.smithi084.stdout:449: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-30T12:23:32.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:32 smithi162 ceph-mon[30421]: Standby manager daemon y started 2024-03-30T12:23:32.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:32 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.84:0/831760005' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-30T12:23:32.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:32 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.84:0/831760005' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T12:23:32.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:32 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.84:0/831760005' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-30T12:23:32.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:32 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.84:0/831760005' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T12:23:32.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:32 smithi162 ceph-mon[30421]: osdmap e149: 8 total, 8 up, 8 in 2024-03-30T12:23:32.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:32 smithi084 ceph-mon[37565]: Standby manager daemon y started 2024-03-30T12:23:32.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:32 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.84:0/831760005' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-30T12:23:32.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:32 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.84:0/831760005' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T12:23:32.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:32 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.84:0/831760005' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-30T12:23:32.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:32 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.84:0/831760005' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T12:23:32.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:32 smithi084 ceph-mon[37565]: osdmap e149: 8 total, 8 up, 8 in 2024-03-30T12:23:32.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:32 smithi084 ceph-mon[27000]: Standby manager daemon y started 2024-03-30T12:23:32.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:32 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.84:0/831760005' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-30T12:23:32.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:32 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.84:0/831760005' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T12:23:32.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:32 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.84:0/831760005' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-30T12:23:32.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:32 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.84:0/831760005' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T12:23:32.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:32 smithi084 ceph-mon[27000]: osdmap e149: 8 total, 8 up, 8 in 2024-03-30T12:23:33.184 INFO:tasks.rados.rados.0.smithi084.stdout:446: done (4 left) 2024-03-30T12:23:33.184 INFO:tasks.rados.rados.0.smithi084.stdout:447: done (3 left) 2024-03-30T12:23:33.184 INFO:tasks.rados.rados.0.smithi084.stdout:448: done (2 left) 2024-03-30T12:23:33.184 INFO:tasks.rados.rados.0.smithi084.stdout:449: done (1 left) 2024-03-30T12:23:33.184 INFO:tasks.rados.rados.0.smithi084.stdout:450: done (0 left) 2024-03-30T12:23:33.184 INFO:tasks.rados.rados.0.smithi084.stdout:451: rollback oid 42 current snap is 43 2024-03-30T12:23:33.184 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 42 to 35 2024-03-30T12:23:33.184 INFO:tasks.rados.rados.0.smithi084.stdout:452: copy_from oid 3 from oid 1 current snap is 43 2024-03-30T12:23:33.184 INFO:tasks.rados.rados.0.smithi084.stdout:453: snap_remove snap 22 2024-03-30T12:23:33.317 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:33 smithi162 ceph-mon[30421]: pgmap v15: 121 pgs: 121 active+clean; 130 MiB data, 545 MiB used, 715 GiB / 715 GiB avail; 13 MiB/s rd, 1.7 MiB/s wr, 61 op/s 2024-03-30T12:23:33.318 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:33 smithi162 ceph-mon[30421]: mgrmap e27: x(active, since 8s), standbys: y 2024-03-30T12:23:33.318 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:33 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T12:23:33.318 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:33 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:33.318 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:33 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:33.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:33 smithi084 ceph-mon[37565]: pgmap v15: 121 pgs: 121 active+clean; 130 MiB data, 545 MiB used, 715 GiB / 715 GiB avail; 13 MiB/s rd, 1.7 MiB/s wr, 61 op/s 2024-03-30T12:23:33.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:33 smithi084 ceph-mon[37565]: mgrmap e27: x(active, since 8s), standbys: y 2024-03-30T12:23:33.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:33 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T12:23:33.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:33 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:33.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:33 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:33.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:33 smithi084 ceph-mon[27000]: pgmap v15: 121 pgs: 121 active+clean; 130 MiB data, 545 MiB used, 715 GiB / 715 GiB avail; 13 MiB/s rd, 1.7 MiB/s wr, 61 op/s 2024-03-30T12:23:33.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:33 smithi084 ceph-mon[27000]: mgrmap e27: x(active, since 8s), standbys: y 2024-03-30T12:23:33.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:33 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T12:23:33.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:33 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:33.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:33 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:34.188 INFO:tasks.rados.rados.0.smithi084.stdout:453: done (2 left) 2024-03-30T12:23:34.188 INFO:tasks.rados.rados.0.smithi084.stdout:454: snap_create 2024-03-30T12:23:34.188 INFO:tasks.rados.rados.0.smithi084.stdout:451: finishing rollback tid 1 to smithi08477944-42 2024-03-30T12:23:34.188 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 107 (ObjNum 4097 snap 0 seq_num 1532998400) dirty dne 2024-03-30T12:23:34.188 INFO:tasks.rados.rados.0.smithi084.stdout:452: finishing copy_from to smithi08477944-3 2024-03-30T12:23:34.188 INFO:tasks.rados.rados.0.smithi084.stdout:452: got expected ENOENT (src dne) 2024-03-30T12:23:34.188 INFO:tasks.rados.rados.0.smithi084.stdout:452: finishing copy_from racing read to smithi08477944-3 2024-03-30T12:23:34.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[37565]: osdmap e150: 8 total, 8 up, 8 in 2024-03-30T12:23:34.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:34.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:34.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:34.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:34.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:34.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:34.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:34.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:34.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:34.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:34.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[37565]: Adjusting osd_memory_target on smithi084 to 2480M 2024-03-30T12:23:34.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:34.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:34.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:34.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[37565]: pgmap v17: 121 pgs: 121 active+clean; 130 MiB data, 545 MiB used, 715 GiB / 715 GiB avail; 13 MiB/s rd, 1.7 MiB/s wr, 60 op/s 2024-03-30T12:23:34.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[27000]: osdmap e150: 8 total, 8 up, 8 in 2024-03-30T12:23:34.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:34.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:34.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:34.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:34.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:34.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:34.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:34.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:34.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:34.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:34.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[27000]: Adjusting osd_memory_target on smithi084 to 2480M 2024-03-30T12:23:34.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:34.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:34.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:34.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:34 smithi084 ceph-mon[27000]: pgmap v17: 121 pgs: 121 active+clean; 130 MiB data, 545 MiB used, 715 GiB / 715 GiB avail; 13 MiB/s rd, 1.7 MiB/s wr, 60 op/s 2024-03-30T12:23:34.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:34 smithi162 ceph-mon[30421]: osdmap e150: 8 total, 8 up, 8 in 2024-03-30T12:23:34.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:34 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:34.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:34 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:34.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:34 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:34.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:34 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:34.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:34 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:34.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:34 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:34.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:34 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:34.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:34 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:34.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:34 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:34.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:34 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:34.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:34 smithi162 ceph-mon[30421]: Adjusting osd_memory_target on smithi084 to 2480M 2024-03-30T12:23:34.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:34 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:34.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:34 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:34.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:34 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:34.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:34 smithi162 ceph-mon[30421]: pgmap v17: 121 pgs: 121 active+clean; 130 MiB data, 545 MiB used, 715 GiB / 715 GiB avail; 13 MiB/s rd, 1.7 MiB/s wr, 60 op/s 2024-03-30T12:23:35.041 INFO:tasks.rados.rados.0.smithi084.stdout:451: done (2 left) 2024-03-30T12:23:35.041 INFO:tasks.rados.rados.0.smithi084.stdout:452: done (1 left) 2024-03-30T12:23:35.041 INFO:tasks.rados.rados.0.smithi084.stdout:454: done (0 left) 2024-03-30T12:23:35.041 INFO:tasks.rados.rados.0.smithi084.stdout:455: read oid 46 snap -1 2024-03-30T12:23:35.041 INFO:tasks.rados.rados.0.smithi084.stdout:455: expect (ObjNum 107 snap 22 seq_num 107) 2024-03-30T12:23:35.041 INFO:tasks.rados.rados.0.smithi084.stdout:456: rollback oid 42 current snap is 44 2024-03-30T12:23:35.041 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 42 to 43 2024-03-30T12:23:35.041 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 44 2024-03-30T12:23:35.041 INFO:tasks.rados.rados.0.smithi084.stdout:457: seq_num 162 ranges {0=319488} 2024-03-30T12:23:35.043 INFO:tasks.rados.rados.0.smithi084.stdout:457: writing smithi08477944-26 from 0 to 319488 tid 1 2024-03-30T12:23:35.043 INFO:tasks.rados.rados.0.smithi084.stdout:458: copy_from oid 41 from oid 40 current snap is 44 2024-03-30T12:23:35.043 INFO:tasks.rados.rados.0.smithi084.stdout:459: rollback oid 37 current snap is 44 2024-03-30T12:23:35.043 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 37 to 37 2024-03-30T12:23:35.043 INFO:tasks.rados.rados.0.smithi084.stdout:460: copy_from oid 29 from oid 22 current snap is 44 2024-03-30T12:23:35.043 INFO:tasks.rados.rados.0.smithi084.stdout:461: rollback oid 7 current snap is 44 2024-03-30T12:23:35.043 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 7 to 43 2024-03-30T12:23:35.043 INFO:tasks.rados.rados.0.smithi084.stdout:462: delete oid 33 current snap is 44 2024-03-30T12:23:35.053 INFO:tasks.rados.rados.0.smithi084.stdout:456: finishing rollback tid 1 to smithi08477944-42 2024-03-30T12:23:35.054 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 107 (ObjNum 129 snap 0 seq_num 1429268384) dirty dne 2024-03-30T12:23:35.054 INFO:tasks.rados.rados.0.smithi084.stdout:461: finishing rollback tid 0 to smithi08477944-7 2024-03-30T12:23:35.054 INFO:tasks.rados.rados.0.smithi084.stdout:459: finishing rollback tid 1 to smithi08477944-37 2024-03-30T12:23:35.054 INFO:tasks.rados.rados.0.smithi084.stdout:461: finishing rollback tid 1 to smithi08477944-7 2024-03-30T12:23:35.055 INFO:tasks.rados.rados.0.smithi084.stdout:459: finishing rollback tid 2 to smithi08477944-37 2024-03-30T12:23:35.055 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 158 (ObjNum 132 snap 31 seq_num 132) dirty exists 2024-03-30T12:23:35.055 INFO:tasks.rados.rados.0.smithi084.stdout:461: finishing rollback tid 2 to smithi08477944-7 2024-03-30T12:23:35.055 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 212 (ObjNum 6 snap 0 seq_num 6) dirty exists 2024-03-30T12:23:35.056 INFO:tasks.rados.rados.0.smithi084.stdout:456: done (7 left) 2024-03-30T12:23:35.056 INFO:tasks.rados.rados.0.smithi084.stdout:459: done (6 left) 2024-03-30T12:23:35.056 INFO:tasks.rados.rados.0.smithi084.stdout:461: done (5 left) 2024-03-30T12:23:35.056 INFO:tasks.rados.rados.0.smithi084.stdout:462: done (4 left) 2024-03-30T12:23:35.056 INFO:tasks.rados.rados.0.smithi084.stdout:463: delete oid 32 current snap is 44 2024-03-30T12:23:35.057 INFO:tasks.rados.rados.0.smithi084.stdout:455: expect (ObjNum 107 snap 22 seq_num 107) 2024-03-30T12:23:35.110 INFO:tasks.rados.rados.0.smithi084.stdout:457: finishing write tid 1 to smithi08477944-26 2024-03-30T12:23:35.110 INFO:tasks.rados.rados.0.smithi084.stdout:457: finishing write tid 2 to smithi08477944-26 2024-03-30T12:23:35.110 INFO:tasks.rados.rados.0.smithi084.stdout:457: finishing write tid 3 to smithi08477944-26 2024-03-30T12:23:35.111 INFO:tasks.rados.rados.0.smithi084.stdout:457: oid 26 updating version 0 to 252 2024-03-30T12:23:35.111 INFO:tasks.rados.rados.0.smithi084.stdout:457: oid 26 updating version 252 to 253 2024-03-30T12:23:35.111 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 253 (ObjNum 162 snap 44 seq_num 162) dirty exists 2024-03-30T12:23:35.111 INFO:tasks.rados.rados.0.smithi084.stdout:457: left oid 26 (ObjNum 162 snap 44 seq_num 162) 2024-03-30T12:23:35.111 INFO:tasks.rados.rados.0.smithi084.stdout:458: finishing copy_from racing read to smithi08477944-41 2024-03-30T12:23:35.111 INFO:tasks.rados.rados.0.smithi084.stdout:458: finishing copy_from to smithi08477944-41 2024-03-30T12:23:35.112 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 200 (ObjNum 160 snap 42 seq_num 160) dirty exists 2024-03-30T12:23:35.112 INFO:tasks.rados.rados.0.smithi084.stdout:460: finishing copy_from racing read to smithi08477944-29 2024-03-30T12:23:35.112 INFO:tasks.rados.rados.0.smithi084.stdout:460: finishing copy_from to smithi08477944-29 2024-03-30T12:23:35.112 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 225 (ObjNum 142 snap 36 seq_num 142) dirty exists 2024-03-30T12:23:35.112 INFO:tasks.rados.rados.0.smithi084.stdout:455: done (4 left) 2024-03-30T12:23:35.112 INFO:tasks.rados.rados.0.smithi084.stdout:457: done (3 left) 2024-03-30T12:23:35.113 INFO:tasks.rados.rados.0.smithi084.stdout:458: done (2 left) 2024-03-30T12:23:35.113 INFO:tasks.rados.rados.0.smithi084.stdout:460: done (1 left) 2024-03-30T12:23:35.113 INFO:tasks.rados.rados.0.smithi084.stdout:463: done (0 left) 2024-03-30T12:23:35.113 INFO:tasks.rados.rados.0.smithi084.stdout:464: read oid 50 snap -1 2024-03-30T12:23:35.113 INFO:tasks.rados.rados.0.smithi084.stdout:464: expect (ObjNum 116 snap 26 seq_num 116) 2024-03-30T12:23:35.113 INFO:tasks.rados.rados.0.smithi084.stdout:465: rollback oid 34 current snap is 44 2024-03-30T12:23:35.114 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 34 to 41 2024-03-30T12:23:35.114 INFO:tasks.rados.rados.0.smithi084.stdout:466: delete oid 5 current snap is 44 2024-03-30T12:23:35.115 INFO:tasks.rados.rados.0.smithi084.stdout:466: done (2 left) 2024-03-30T12:23:35.115 INFO:tasks.rados.rados.0.smithi084.stdout:467: read oid 10 snap -1 2024-03-30T12:23:35.115 INFO:tasks.rados.rados.0.smithi084.stdout:467: expect (ObjNum 83 snap 18 seq_num 83) 2024-03-30T12:23:35.116 INFO:tasks.rados.rados.0.smithi084.stdout:468: snap_create 2024-03-30T12:23:35.116 INFO:tasks.rados.rados.0.smithi084.stdout:465: finishing rollback tid 1 to smithi08477944-34 2024-03-30T12:23:35.116 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 103 (ObjNum 65 snap 0 seq_num 0) dirty dne 2024-03-30T12:23:35.116 INFO:tasks.rados.rados.0.smithi084.stdout:464: expect (ObjNum 116 snap 26 seq_num 116) 2024-03-30T12:23:35.203 INFO:tasks.rados.rados.0.smithi084.stdout:467: expect (ObjNum 83 snap 18 seq_num 83) 2024-03-30T12:23:35.451 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:35.452 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: osdmap e151: 8 total, 8 up, 8 in 2024-03-30T12:23:35.452 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:23:35.452 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:23:35.452 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:23:35.452 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:23:35.452 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:23:35.452 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:23:35.452 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:23:35.452 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:23:35.452 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:23:35.452 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:23:35.452 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:23:35.452 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:23:35.453 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:23:35.453 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:23:35.453 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:23:35.453 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:23:35.453 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:23:35.453 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:23:35.453 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:23:35.453 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:23:35.453 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:23:35.453 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:23:35.453 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:23:35.453 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:23:35.453 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:23:35.453 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:35.453 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:35.454 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:35 smithi162 ceph-mon[30421]: osdmap e152: 8 total, 8 up, 8 in 2024-03-30T12:23:35.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:35.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: osdmap e151: 8 total, 8 up, 8 in 2024-03-30T12:23:35.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:23:35.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:23:35.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:23:35.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:23:35.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:23:35.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:23:35.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:23:35.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:23:35.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:23:35.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:23:35.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:23:35.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:23:35.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:23:35.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:23:35.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:23:35.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:23:35.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:23:35.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:23:35.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:23:35.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:23:35.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:23:35.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:23:35.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:23:35.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:23:35.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:23:35.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:35.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:35.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[27000]: osdmap e152: 8 total, 8 up, 8 in 2024-03-30T12:23:35.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:35.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: osdmap e151: 8 total, 8 up, 8 in 2024-03-30T12:23:35.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:23:35.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:23:35.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:23:35.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:23:35.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:23:35.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:23:35.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:23:35.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:23:35.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:23:35.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:23:35.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:23:35.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:23:35.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:23:35.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:23:35.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:23:35.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:23:35.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:23:35.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:23:35.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:23:35.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:23:35.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:23:35.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:23:35.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:23:35.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:23:35.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:23:35.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:35.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:35.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:35 smithi084 ceph-mon[37565]: osdmap e152: 8 total, 8 up, 8 in 2024-03-30T12:23:36.048 INFO:tasks.rados.rados.0.smithi084.stdout:464: done (3 left) 2024-03-30T12:23:36.048 INFO:tasks.rados.rados.0.smithi084.stdout:465: done (2 left) 2024-03-30T12:23:36.048 INFO:tasks.rados.rados.0.smithi084.stdout:467: done (1 left) 2024-03-30T12:23:36.048 INFO:tasks.rados.rados.0.smithi084.stdout:468: done (0 left) 2024-03-30T12:23:36.049 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 45 2024-03-30T12:23:36.049 INFO:tasks.rados.rados.0.smithi084.stdout:469: seq_num 166 ranges {3489792=385024} 2024-03-30T12:23:36.069 INFO:tasks.rados.rados.0.smithi084.stdout:469: writing smithi08477944-39 from 3489792 to 3874816 tid 1 2024-03-30T12:23:36.069 INFO:tasks.rados.rados.0.smithi084.stdout:470: read oid 48 snap -1 2024-03-30T12:23:36.070 INFO:tasks.rados.rados.0.smithi084.stdout:470: expect deleted 2024-03-30T12:23:36.070 INFO:tasks.rados.rados.0.smithi084.stdout:471: rollback oid 18 current snap is 45 2024-03-30T12:23:36.070 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 18 to 32 2024-03-30T12:23:36.070 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 45 2024-03-30T12:23:36.070 INFO:tasks.rados.rados.0.smithi084.stdout:472: seq_num 167 ranges {0=401408} 2024-03-30T12:23:36.071 INFO:tasks.rados.rados.0.smithi084.stdout:472: writing smithi08477944-44 from 0 to 401408 tid 1 2024-03-30T12:23:36.071 INFO:tasks.rados.rados.0.smithi084.stdout:473: snap_create 2024-03-30T12:23:36.072 INFO:tasks.rados.rados.0.smithi084.stdout:469: finishing write tid 1 to smithi08477944-39 2024-03-30T12:23:36.072 INFO:tasks.rados.rados.0.smithi084.stdout:469: finishing write tid 2 to smithi08477944-39 2024-03-30T12:23:36.073 INFO:tasks.rados.rados.0.smithi084.stdout:469: finishing write tid 3 to smithi08477944-39 2024-03-30T12:23:36.073 INFO:tasks.rados.rados.0.smithi084.stdout:469: oid 39 updating version 0 to 188 2024-03-30T12:23:36.073 INFO:tasks.rados.rados.0.smithi084.stdout:469: oid 39 version 188 is already newer than 187 2024-03-30T12:23:36.073 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 188 (ObjNum 166 snap 45 seq_num 166) dirty exists 2024-03-30T12:23:36.074 INFO:tasks.rados.rados.0.smithi084.stdout:469: left oid 39 (ObjNum 166 snap 45 seq_num 166) 2024-03-30T12:23:36.074 INFO:tasks.rados.rados.0.smithi084.stdout:471: finishing rollback tid 0 to smithi08477944-18 2024-03-30T12:23:36.075 INFO:tasks.rados.rados.0.smithi084.stdout:471: finishing rollback tid 1 to smithi08477944-18 2024-03-30T12:23:36.075 INFO:tasks.rados.rados.0.smithi084.stdout:471: finishing rollback tid 2 to smithi08477944-18 2024-03-30T12:23:36.076 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 257 (ObjNum 17 snap 0 seq_num 17) dirty exists 2024-03-30T12:23:36.076 INFO:tasks.rados.rados.0.smithi084.stdout:472: finishing write tid 1 to smithi08477944-44 2024-03-30T12:23:36.076 INFO:tasks.rados.rados.0.smithi084.stdout:472: finishing write tid 2 to smithi08477944-44 2024-03-30T12:23:36.077 INFO:tasks.rados.rados.0.smithi084.stdout:472: finishing write tid 3 to smithi08477944-44 2024-03-30T12:23:36.077 INFO:tasks.rados.rados.0.smithi084.stdout:472: oid 44 updating version 0 to 144 2024-03-30T12:23:36.077 INFO:tasks.rados.rados.0.smithi084.stdout:472: oid 44 version 144 is already newer than 143 2024-03-30T12:23:36.077 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 144 (ObjNum 167 snap 45 seq_num 167) dirty exists 2024-03-30T12:23:36.078 INFO:tasks.rados.rados.0.smithi084.stdout:472: left oid 44 (ObjNum 167 snap 45 seq_num 167) 2024-03-30T12:23:36.439 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:36 smithi162 ceph-mon[30421]: mgrmap e28: x(active, since 11s), standbys: y 2024-03-30T12:23:36.439 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:36 smithi162 ceph-mon[30421]: osdmap e153: 8 total, 8 up, 8 in 2024-03-30T12:23:36.440 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:36 smithi162 ceph-mon[30421]: pgmap v21: 121 pgs: 121 active+clean; 125 MiB data, 530 MiB used, 715 GiB / 715 GiB avail; 5.6 MiB/s rd, 1.4 MiB/s wr, 20 op/s 2024-03-30T12:23:36.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:36 smithi084 ceph-mon[27000]: mgrmap e28: x(active, since 11s), standbys: y 2024-03-30T12:23:36.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:36 smithi084 ceph-mon[27000]: osdmap e153: 8 total, 8 up, 8 in 2024-03-30T12:23:36.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:36 smithi084 ceph-mon[27000]: pgmap v21: 121 pgs: 121 active+clean; 125 MiB data, 530 MiB used, 715 GiB / 715 GiB avail; 5.6 MiB/s rd, 1.4 MiB/s wr, 20 op/s 2024-03-30T12:23:36.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:36 smithi084 ceph-mon[37565]: mgrmap e28: x(active, since 11s), standbys: y 2024-03-30T12:23:36.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:36 smithi084 ceph-mon[37565]: osdmap e153: 8 total, 8 up, 8 in 2024-03-30T12:23:36.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:36 smithi084 ceph-mon[37565]: pgmap v21: 121 pgs: 121 active+clean; 125 MiB data, 530 MiB used, 715 GiB / 715 GiB avail; 5.6 MiB/s rd, 1.4 MiB/s wr, 20 op/s 2024-03-30T12:23:37.059 INFO:tasks.rados.rados.0.smithi084.stdout:469: done (4 left) 2024-03-30T12:23:37.059 INFO:tasks.rados.rados.0.smithi084.stdout:470: done (3 left) 2024-03-30T12:23:37.059 INFO:tasks.rados.rados.0.smithi084.stdout:471: done (2 left) 2024-03-30T12:23:37.060 INFO:tasks.rados.rados.0.smithi084.stdout:472: done (1 left) 2024-03-30T12:23:37.060 INFO:tasks.rados.rados.0.smithi084.stdout:473: done (0 left) 2024-03-30T12:23:37.060 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 46 2024-03-30T12:23:37.060 INFO:tasks.rados.rados.0.smithi084.stdout:474: seq_num 168 ranges {286720=417792} 2024-03-30T12:23:37.063 INFO:tasks.rados.rados.0.smithi084.stdout:474: writing smithi08477944-18 from 286720 to 704512 tid 1 2024-03-30T12:23:37.063 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 46 2024-03-30T12:23:37.063 INFO:tasks.rados.rados.0.smithi084.stdout:475: seq_num 169 ranges {3874816=434176} 2024-03-30T12:23:37.086 INFO:tasks.rados.rados.0.smithi084.stdout:475: writing smithi08477944-39 from 3874816 to 4308992 tid 1 2024-03-30T12:23:37.086 INFO:tasks.rados.rados.0.smithi084.stdout:476: setattr oid 49 current snap is 46 2024-03-30T12:23:37.087 INFO:tasks.rados.rados.0.smithi084.stdout:474: finishing write tid 1 to smithi08477944-18 2024-03-30T12:23:37.087 INFO:tasks.rados.rados.0.smithi084.stdout:474: finishing write tid 2 to smithi08477944-18 2024-03-30T12:23:37.087 INFO:tasks.rados.rados.0.smithi084.stdout:474: finishing write tid 3 to smithi08477944-18 2024-03-30T12:23:37.087 INFO:tasks.rados.rados.0.smithi084.stdout:474: oid 18 updating version 0 to 259 2024-03-30T12:23:37.087 INFO:tasks.rados.rados.0.smithi084.stdout:474: oid 18 updating version 259 to 260 2024-03-30T12:23:37.087 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 260 (ObjNum 168 snap 46 seq_num 168) dirty exists 2024-03-30T12:23:37.087 INFO:tasks.rados.rados.0.smithi084.stdout:474: left oid 18 (ObjNum 168 snap 46 seq_num 168) 2024-03-30T12:23:37.088 INFO:tasks.rados.rados.0.smithi084.stdout:474: done (2 left) 2024-03-30T12:23:37.088 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 46 2024-03-30T12:23:37.088 INFO:tasks.rados.rados.0.smithi084.stdout:477: seq_num 170 ranges {0=450560} 2024-03-30T12:23:37.091 INFO:tasks.rados.rados.0.smithi084.stdout:477: writing smithi08477944-8 from 0 to 450560 tid 1 2024-03-30T12:23:37.091 INFO:tasks.rados.rados.0.smithi084.stdout:478: rollback oid 23 current snap is 46 2024-03-30T12:23:37.091 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 23 to 37 2024-03-30T12:23:37.092 INFO:tasks.rados.rados.0.smithi084.stdout:475: finishing write tid 1 to smithi08477944-39 2024-03-30T12:23:37.092 INFO:tasks.rados.rados.0.smithi084.stdout:475: finishing write tid 2 to smithi08477944-39 2024-03-30T12:23:37.092 INFO:tasks.rados.rados.0.smithi084.stdout:479: copy_from oid 9 from oid 18 current snap is 46 2024-03-30T12:23:37.092 INFO:tasks.rados.rados.0.smithi084.stdout:480: snap_remove snap 35 2024-03-30T12:23:38.071 INFO:tasks.rados.rados.0.smithi084.stdout:475: finishing write tid 3 to smithi08477944-39 2024-03-30T12:23:38.071 INFO:tasks.rados.rados.0.smithi084.stdout:475: oid 39 updating version 0 to 191 2024-03-30T12:23:38.072 INFO:tasks.rados.rados.0.smithi084.stdout:475: oid 39 version 191 is already newer than 190 2024-03-30T12:23:38.072 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 191 (ObjNum 169 snap 46 seq_num 169) dirty exists 2024-03-30T12:23:38.072 INFO:tasks.rados.rados.0.smithi084.stdout:475: left oid 39 (ObjNum 169 snap 46 seq_num 169) 2024-03-30T12:23:38.072 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 183 (ObjNum 146 snap 37 seq_num 146) dirty exists 2024-03-30T12:23:38.072 INFO:tasks.rados.rados.0.smithi084.stdout:477: finishing write tid 1 to smithi08477944-8 2024-03-30T12:23:38.072 INFO:tasks.rados.rados.0.smithi084.stdout:477: finishing write tid 2 to smithi08477944-8 2024-03-30T12:23:38.072 INFO:tasks.rados.rados.0.smithi084.stdout:478: finishing rollback tid 0 to smithi08477944-23 2024-03-30T12:23:38.072 INFO:tasks.rados.rados.0.smithi084.stdout:478: finishing rollback tid 1 to smithi08477944-23 2024-03-30T12:23:38.072 INFO:tasks.rados.rados.0.smithi084.stdout:478: finishing rollback tid 2 to smithi08477944-23 2024-03-30T12:23:38.072 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 187 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-03-30T12:23:38.072 INFO:tasks.rados.rados.0.smithi084.stdout:477: finishing write tid 3 to smithi08477944-8 2024-03-30T12:23:38.072 INFO:tasks.rados.rados.0.smithi084.stdout:477: oid 8 updating version 0 to 255 2024-03-30T12:23:38.072 INFO:tasks.rados.rados.0.smithi084.stdout:477: oid 8 version 255 is already newer than 254 2024-03-30T12:23:38.072 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 255 (ObjNum 170 snap 46 seq_num 170) dirty exists 2024-03-30T12:23:38.073 INFO:tasks.rados.rados.0.smithi084.stdout:477: left oid 8 (ObjNum 170 snap 46 seq_num 170) 2024-03-30T12:23:38.073 INFO:tasks.rados.rados.0.smithi084.stdout:479: finishing copy_from racing read to smithi08477944-9 2024-03-30T12:23:38.073 INFO:tasks.rados.rados.0.smithi084.stdout:479: finishing copy_from to smithi08477944-9 2024-03-30T12:23:38.073 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 260 (ObjNum 168 snap 46 seq_num 168) dirty exists 2024-03-30T12:23:38.073 INFO:tasks.rados.rados.0.smithi084.stdout:475: done (5 left) 2024-03-30T12:23:38.073 INFO:tasks.rados.rados.0.smithi084.stdout:476: done (4 left) 2024-03-30T12:23:38.073 INFO:tasks.rados.rados.0.smithi084.stdout:477: done (3 left) 2024-03-30T12:23:38.073 INFO:tasks.rados.rados.0.smithi084.stdout:478: done (2 left) 2024-03-30T12:23:38.073 INFO:tasks.rados.rados.0.smithi084.stdout:479: done (1 left) 2024-03-30T12:23:38.073 INFO:tasks.rados.rados.0.smithi084.stdout:480: done (0 left) 2024-03-30T12:23:38.073 INFO:tasks.rados.rados.0.smithi084.stdout:481: setattr oid 20 current snap is 46 2024-03-30T12:23:38.074 INFO:tasks.rados.rados.0.smithi084.stdout:482: read oid 22 snap 36 2024-03-30T12:23:38.074 INFO:tasks.rados.rados.0.smithi084.stdout:482: expect (ObjNum 142 snap 36 seq_num 142) 2024-03-30T12:23:38.074 INFO:tasks.rados.rados.0.smithi084.stdout:483: copy_from oid 39 from oid 12 current snap is 46 2024-03-30T12:23:38.074 INFO:tasks.rados.rados.0.smithi084.stdout:484: delete oid 4 current snap is 46 2024-03-30T12:23:38.082 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 216 (ObjNum 107 snap 22 seq_num 107) dirty exists 2024-03-30T12:23:38.082 INFO:tasks.rados.rados.0.smithi084.stdout:481: done (3 left) 2024-03-30T12:23:38.082 INFO:tasks.rados.rados.0.smithi084.stdout:484: done (2 left) 2024-03-30T12:23:38.082 INFO:tasks.rados.rados.0.smithi084.stdout:485: snap_create 2024-03-30T12:23:38.097 INFO:tasks.rados.rados.0.smithi084.stdout:482: expect (ObjNum 142 snap 36 seq_num 142) 2024-03-30T12:23:38.220 INFO:tasks.rados.rados.0.smithi084.stdout:483: finishing copy_from racing read to smithi08477944-39 2024-03-30T12:23:38.220 INFO:tasks.rados.rados.0.smithi084.stdout:483: finishing copy_from to smithi08477944-39 2024-03-30T12:23:38.220 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 88 (ObjNum 136 snap 32 seq_num 136) dirty exists 2024-03-30T12:23:38.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:38 smithi162 ceph-mon[30421]: osdmap e154: 8 total, 8 up, 8 in 2024-03-30T12:23:38.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:38 smithi084 ceph-mon[37565]: osdmap e154: 8 total, 8 up, 8 in 2024-03-30T12:23:38.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:38 smithi084 ceph-mon[27000]: osdmap e154: 8 total, 8 up, 8 in 2024-03-30T12:23:39.069 INFO:tasks.rados.rados.0.smithi084.stdout:482: done (2 left) 2024-03-30T12:23:39.070 INFO:tasks.rados.rados.0.smithi084.stdout:483: done (1 left) 2024-03-30T12:23:39.070 INFO:tasks.rados.rados.0.smithi084.stdout:485: done (0 left) 2024-03-30T12:23:39.070 INFO:tasks.rados.rados.0.smithi084.stdout:486: read oid 45 snap -1 2024-03-30T12:23:39.070 INFO:tasks.rados.rados.0.smithi084.stdout:486: expect (ObjNum 161 snap 42 seq_num 161) 2024-03-30T12:23:39.070 INFO:tasks.rados.rados.0.smithi084.stdout:487: copy_from oid 49 from oid 4 current snap is 47 2024-03-30T12:23:39.070 INFO:tasks.rados.rados.0.smithi084.stdout:488: snap_remove snap 31 2024-03-30T12:23:39.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:39 smithi162 ceph-mon[30421]: pgmap v23: 121 pgs: 121 active+clean; 125 MiB data, 530 MiB used, 715 GiB / 715 GiB avail; 5.6 MiB/s rd, 1.4 MiB/s wr, 20 op/s 2024-03-30T12:23:39.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:39 smithi162 ceph-mon[30421]: osdmap e155: 8 total, 8 up, 8 in 2024-03-30T12:23:39.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:39 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:39.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:39 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:39.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:39 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:39.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:39 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:39.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:39 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:39.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:39 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:39.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:39 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:39.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:39 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:39.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:39 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:39.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:39 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:39.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:39 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:39.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:39 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:23:39.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:39 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:23:39.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[27230]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:23:39] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-03-30T12:23:39.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[37565]: pgmap v23: 121 pgs: 121 active+clean; 125 MiB data, 530 MiB used, 715 GiB / 715 GiB avail; 5.6 MiB/s rd, 1.4 MiB/s wr, 20 op/s 2024-03-30T12:23:39.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[37565]: osdmap e155: 8 total, 8 up, 8 in 2024-03-30T12:23:39.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:39.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:39.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:39.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:39.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:39.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:39.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:39.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:39.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:39.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:39.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:39.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:23:39.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:23:39.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[27000]: pgmap v23: 121 pgs: 121 active+clean; 125 MiB data, 530 MiB used, 715 GiB / 715 GiB avail; 5.6 MiB/s rd, 1.4 MiB/s wr, 20 op/s 2024-03-30T12:23:39.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[27000]: osdmap e155: 8 total, 8 up, 8 in 2024-03-30T12:23:39.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:39.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:39.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:39.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:39.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:39.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:39.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:39.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:39.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:39.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T12:23:39.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:39.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:23:39.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:39 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:23:40.039 INFO:tasks.rados.rados.0.smithi084.stdout:488: done (2 left) 2024-03-30T12:23:40.040 INFO:tasks.rados.rados.0.smithi084.stdout:489: rollback oid 14 current snap is 47 2024-03-30T12:23:40.040 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 14 to 41 2024-03-30T12:23:40.040 INFO:tasks.rados.rados.0.smithi084.stdout:487: finishing copy_from to smithi08477944-49 2024-03-30T12:23:40.040 INFO:tasks.rados.rados.0.smithi084.stdout:487: got expected ENOENT (src dne) 2024-03-30T12:23:40.040 INFO:tasks.rados.rados.0.smithi084.stdout:487: finishing copy_from racing read to smithi08477944-49 2024-03-30T12:23:40.040 INFO:tasks.rados.rados.0.smithi084.stdout:486: expect (ObjNum 161 snap 42 seq_num 161) 2024-03-30T12:23:40.053 INFO:tasks.rados.rados.0.smithi084.stdout:486: done (2 left) 2024-03-30T12:23:40.053 INFO:tasks.rados.rados.0.smithi084.stdout:487: done (1 left) 2024-03-30T12:23:40.053 INFO:tasks.rados.rados.0.smithi084.stdout:490: snap_create 2024-03-30T12:23:40.054 INFO:tasks.rados.rados.0.smithi084.stdout:489: finishing rollback tid 0 to smithi08477944-14 2024-03-30T12:23:40.054 INFO:tasks.rados.rados.0.smithi084.stdout:489: finishing rollback tid 1 to smithi08477944-14 2024-03-30T12:23:40.054 INFO:tasks.rados.rados.0.smithi084.stdout:489: finishing rollback tid 2 to smithi08477944-14 2024-03-30T12:23:40.054 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 166 (ObjNum 153 snap 40 seq_num 153) dirty exists 2024-03-30T12:23:40.338 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:40 smithi162 ceph-mon[30421]: Adjusting osd_memory_target on smithi162 to 2480M 2024-03-30T12:23:40.338 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:40 smithi162 ceph-mon[30421]: Updating smithi084:/etc/ceph/ceph.conf 2024-03-30T12:23:40.338 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:40 smithi162 ceph-mon[30421]: Updating smithi162:/etc/ceph/ceph.conf 2024-03-30T12:23:40.338 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:40 smithi162 ceph-mon[30421]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:23:40.338 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:40 smithi162 ceph-mon[30421]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:23:40.339 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:40 smithi162 ceph-mon[30421]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:23:40.339 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:40 smithi162 ceph-mon[30421]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:23:40.339 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:40 smithi162 ceph-mon[30421]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:23:40.339 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:40 smithi162 ceph-mon[30421]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:23:40.339 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:40 smithi162 ceph-mon[30421]: osdmap e156: 8 total, 8 up, 8 in 2024-03-30T12:23:40.339 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:40 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:40.339 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:40 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:40.339 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:40 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:23:40.339 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:40 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:40.339 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:40 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:40.339 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:40 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:40.339 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:40 smithi162 ceph-mon[30421]: osdmap e157: 8 total, 8 up, 8 in 2024-03-30T12:23:40.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[27000]: Adjusting osd_memory_target on smithi162 to 2480M 2024-03-30T12:23:40.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[27000]: Updating smithi084:/etc/ceph/ceph.conf 2024-03-30T12:23:40.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[27000]: Updating smithi162:/etc/ceph/ceph.conf 2024-03-30T12:23:40.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[27000]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:23:40.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[27000]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:23:40.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[27000]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:23:40.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[27000]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:23:40.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[27000]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:23:40.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[27000]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:23:40.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[27000]: osdmap e156: 8 total, 8 up, 8 in 2024-03-30T12:23:40.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:40.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:40.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:23:40.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:40.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:40.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:40.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[27000]: osdmap e157: 8 total, 8 up, 8 in 2024-03-30T12:23:40.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[37565]: Adjusting osd_memory_target on smithi162 to 2480M 2024-03-30T12:23:40.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[37565]: Updating smithi084:/etc/ceph/ceph.conf 2024-03-30T12:23:40.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[37565]: Updating smithi162:/etc/ceph/ceph.conf 2024-03-30T12:23:40.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[37565]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:23:40.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[37565]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:23:40.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[37565]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:23:40.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[37565]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:23:40.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[37565]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:23:40.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[37565]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:23:40.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[37565]: osdmap e156: 8 total, 8 up, 8 in 2024-03-30T12:23:40.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:40.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:40.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:23:40.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:40.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:40.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:40.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:40 smithi084 ceph-mon[37565]: osdmap e157: 8 total, 8 up, 8 in 2024-03-30T12:23:41.052 INFO:tasks.rados.rados.0.smithi084.stdout:489: done (1 left) 2024-03-30T12:23:41.052 INFO:tasks.rados.rados.0.smithi084.stdout:490: done (0 left) 2024-03-30T12:23:41.052 INFO:tasks.rados.rados.0.smithi084.stdout:491: copy_from oid 16 from oid 10 current snap is 48 2024-03-30T12:23:41.052 INFO:tasks.rados.rados.0.smithi084.stdout:492: snap_remove snap 42 2024-03-30T12:23:41.338 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:41 smithi162 ceph-mon[30421]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T12:23:41.338 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:41 smithi162 ceph-mon[30421]: Reconfiguring daemon prometheus.a on smithi162 2024-03-30T12:23:41.338 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:41 smithi162 ceph-mon[30421]: pgmap v27: 121 pgs: 121 active+clean; 125 MiB data, 530 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:23:41.338 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:41 smithi162 ceph-mon[30421]: osdmap e158: 8 total, 8 up, 8 in 2024-03-30T12:23:41.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:41 smithi084 ceph-mon[27000]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T12:23:41.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:41 smithi084 ceph-mon[27000]: Reconfiguring daemon prometheus.a on smithi162 2024-03-30T12:23:41.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:41 smithi084 ceph-mon[27000]: pgmap v27: 121 pgs: 121 active+clean; 125 MiB data, 530 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:23:41.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:41 smithi084 ceph-mon[27000]: osdmap e158: 8 total, 8 up, 8 in 2024-03-30T12:23:41.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:41 smithi084 ceph-mon[37565]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T12:23:41.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:41 smithi084 ceph-mon[37565]: Reconfiguring daemon prometheus.a on smithi162 2024-03-30T12:23:41.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:41 smithi084 ceph-mon[37565]: pgmap v27: 121 pgs: 121 active+clean; 125 MiB data, 530 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:23:41.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:41 smithi084 ceph-mon[37565]: osdmap e158: 8 total, 8 up, 8 in 2024-03-30T12:23:42.054 INFO:tasks.rados.rados.0.smithi084.stdout:492: done (1 left) 2024-03-30T12:23:42.054 INFO:tasks.rados.rados.0.smithi084.stdout:493: read oid 35 snap -1 2024-03-30T12:23:42.054 INFO:tasks.rados.rados.0.smithi084.stdout:493: expect (ObjNum 150 snap 40 seq_num 150) 2024-03-30T12:23:42.054 INFO:tasks.rados.rados.0.smithi084.stdout:494: delete oid 38 current snap is 48 2024-03-30T12:23:42.054 INFO:tasks.rados.rados.0.smithi084.stdout:491: finishing copy_from racing read to smithi08477944-16 2024-03-30T12:23:42.054 INFO:tasks.rados.rados.0.smithi084.stdout:491: finishing copy_from to smithi08477944-16 2024-03-30T12:23:42.054 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 50 (ObjNum 83 snap 18 seq_num 83) dirty exists 2024-03-30T12:23:42.061 INFO:tasks.rados.rados.0.smithi084.stdout:491: done (2 left) 2024-03-30T12:23:42.061 INFO:tasks.rados.rados.0.smithi084.stdout:494: done (1 left) 2024-03-30T12:23:42.061 INFO:tasks.rados.rados.0.smithi084.stdout:495: read oid 10 snap -1 2024-03-30T12:23:42.061 INFO:tasks.rados.rados.0.smithi084.stdout:495: expect (ObjNum 83 snap 18 seq_num 83) 2024-03-30T12:23:42.062 INFO:tasks.rados.rados.0.smithi084.stdout:496: setattr oid 33 current snap is 48 2024-03-30T12:23:42.064 INFO:tasks.rados.rados.0.smithi084.stdout:497: rmattr oid 20 current snap is 48 2024-03-30T12:23:42.064 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 48 2024-03-30T12:23:42.064 INFO:tasks.rados.rados.0.smithi084.stdout:498: seq_num 173 ranges {1802240=499712} 2024-03-30T12:23:42.078 INFO:tasks.rados.rados.0.smithi084.stdout:498: writing smithi08477944-11 from 1802240 to 2301952 tid 1 2024-03-30T12:23:42.078 INFO:tasks.rados.rados.0.smithi084.stdout:499: snap_create 2024-03-30T12:23:42.078 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 239 (ObjNum 609 snap 0 seq_num 194393042) dirty exists 2024-03-30T12:23:42.078 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 241 (ObjNum 107 snap 22 seq_num 107) dirty exists 2024-03-30T12:23:42.078 INFO:tasks.rados.rados.0.smithi084.stdout:493: expect (ObjNum 150 snap 40 seq_num 150) 2024-03-30T12:23:42.126 INFO:tasks.rados.rados.0.smithi084.stdout:495: expect (ObjNum 83 snap 18 seq_num 83) 2024-03-30T12:23:42.230 INFO:tasks.rados.rados.0.smithi084.stdout:498: finishing write tid 1 to smithi08477944-11 2024-03-30T12:23:42.230 INFO:tasks.rados.rados.0.smithi084.stdout:498: finishing write tid 2 to smithi08477944-11 2024-03-30T12:23:42.230 INFO:tasks.rados.rados.0.smithi084.stdout:498: finishing write tid 3 to smithi08477944-11 2024-03-30T12:23:42.230 INFO:tasks.rados.rados.0.smithi084.stdout:498: oid 11 updating version 0 to 137 2024-03-30T12:23:42.230 INFO:tasks.rados.rados.0.smithi084.stdout:498: oid 11 updating version 137 to 138 2024-03-30T12:23:42.230 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 138 (ObjNum 173 snap 48 seq_num 173) dirty exists 2024-03-30T12:23:42.230 INFO:tasks.rados.rados.0.smithi084.stdout:498: left oid 11 (ObjNum 173 snap 48 seq_num 173) 2024-03-30T12:23:43.050 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:42 smithi162 systemd[1]: Stopping Ceph prometheus.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:23:43.058 INFO:tasks.rados.rados.0.smithi084.stdout:493: done (5 left) 2024-03-30T12:23:43.058 INFO:tasks.rados.rados.0.smithi084.stdout:495: done (4 left) 2024-03-30T12:23:43.058 INFO:tasks.rados.rados.0.smithi084.stdout:496: done (3 left) 2024-03-30T12:23:43.058 INFO:tasks.rados.rados.0.smithi084.stdout:497: done (2 left) 2024-03-30T12:23:43.058 INFO:tasks.rados.rados.0.smithi084.stdout:498: done (1 left) 2024-03-30T12:23:43.058 INFO:tasks.rados.rados.0.smithi084.stdout:499: done (0 left) 2024-03-30T12:23:43.058 INFO:tasks.rados.rados.0.smithi084.stdout:500: snap_remove snap 37 2024-03-30T12:23:43.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:43 smithi162 ceph-mon[30421]: osdmap e159: 8 total, 8 up, 8 in 2024-03-30T12:23:43.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:43 smithi162 ceph-mon[30421]: pgmap v30: 121 pgs: 121 active+clean; 124 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 7.0 MiB/s rd, 1.2 MiB/s wr, 21 op/s 2024-03-30T12:23:43.370 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:23:43.145Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-03-30T12:23:43.370 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:23:43.145Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-03-30T12:23:43.370 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:23:43.145Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-03-30T12:23:43.370 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:23:43.145Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-03-30T12:23:43.371 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:23:43.145Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-03-30T12:23:43.371 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:23:43.145Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-03-30T12:23:43.371 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:23:43.145Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-03-30T12:23:43.371 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:23:43.145Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-03-30T12:23:43.371 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:23:43.145Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-03-30T12:23:43.371 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:23:43.145Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-03-30T12:23:43.371 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:23:43.145Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-03-30T12:23:43.371 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[61562]: ts=2024-03-30T12:23:43.145Z caller=main.go:1147 level=info msg="See you next time!" 2024-03-30T12:23:43.371 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:43 smithi162 podman[71793]: 2024-03-30 12:23:43.155567114 +0000 UTC m=+0.122805184 container died 9858cdf4e1f20dacd68520d7cba3179eecbae754358bf16b15ccb0a2523377c0 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:23:43.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:43 smithi084 ceph-mon[27000]: osdmap e159: 8 total, 8 up, 8 in 2024-03-30T12:23:43.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:43 smithi084 ceph-mon[27000]: pgmap v30: 121 pgs: 121 active+clean; 124 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 7.0 MiB/s rd, 1.2 MiB/s wr, 21 op/s 2024-03-30T12:23:43.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:43 smithi084 ceph-mon[37565]: osdmap e159: 8 total, 8 up, 8 in 2024-03-30T12:23:43.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:43 smithi084 ceph-mon[37565]: pgmap v30: 121 pgs: 121 active+clean; 124 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 7.0 MiB/s rd, 1.2 MiB/s wr, 21 op/s 2024-03-30T12:23:43.869 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:43 smithi162 podman[71793]: 2024-03-30 12:23:43.595979018 +0000 UTC m=+0.563217073 container cleanup 9858cdf4e1f20dacd68520d7cba3179eecbae754358bf16b15ccb0a2523377c0 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:23:43.870 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:43 smithi162 bash[71793]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a 2024-03-30T12:23:44.061 INFO:tasks.rados.rados.0.smithi084.stdout:500: done (0 left) 2024-03-30T12:23:44.061 INFO:tasks.rados.rados.0.smithi084.stdout:501: snap_remove snap 48 2024-03-30T12:23:44.235 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:44 smithi162 ceph-mon[30421]: osdmap e160: 8 total, 8 up, 8 in 2024-03-30T12:23:44.235 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:43 smithi162 podman[71809]: 2024-03-30 12:23:43.8805108 +0000 UTC m=+0.727211122 container remove 9858cdf4e1f20dacd68520d7cba3179eecbae754358bf16b15ccb0a2523377c0 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:23:44.235 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@prometheus.a.service: Deactivated successfully. 2024-03-30T12:23:44.236 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 systemd[1]: Stopped Ceph prometheus.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:23:44.236 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@prometheus.a.service: Consumed 1.461s CPU time. 2024-03-30T12:23:44.236 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 systemd[1]: Starting Ceph prometheus.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:23:44.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:44 smithi084 ceph-mon[27000]: osdmap e160: 8 total, 8 up, 8 in 2024-03-30T12:23:44.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:44 smithi084 ceph-mon[37565]: osdmap e160: 8 total, 8 up, 8 in 2024-03-30T12:23:44.525 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 podman[71910]: 2024-03-30 12:23:44.148394348 +0000 UTC m=+0.021744291 image pull a07b618ecd1dce142bce4c52f0e80982eaf1f14265a2415c2d35978ccaa0a464 quay.io/prometheus/prometheus:v2.43.0 2024-03-30T12:23:44.525 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 podman[71910]: 2024-03-30 12:23:44.306821173 +0000 UTC m=+0.180171096 container create 9f1dfafa5a09a8886d65b8ddcbdd12e9b7eb811165af221b327f587682af4b3f (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:23:44.526 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 podman[71910]: 2024-03-30 12:23:44.534361413 +0000 UTC m=+0.407711343 container init 9f1dfafa5a09a8886d65b8ddcbdd12e9b7eb811165af221b327f587682af4b3f (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:23:44.870 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 podman[71910]: 2024-03-30 12:23:44.537281672 +0000 UTC m=+0.410631603 container start 9f1dfafa5a09a8886d65b8ddcbdd12e9b7eb811165af221b327f587682af4b3f (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:23:44.871 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:23:44.560Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-03-30T12:23:44.871 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:23:44.560Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-03-30T12:23:44.871 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:23:44.560Z caller=main.go:570 level=info host_details="(Linux 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 x86_64 smithi162 (none))" 2024-03-30T12:23:44.871 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:23:44.560Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-03-30T12:23:44.871 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:23:44.560Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-03-30T12:23:44.871 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:23:44.562Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-03-30T12:23:44.871 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:23:44.563Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-03-30T12:23:44.871 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:23:44.564Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-03-30T12:23:44.871 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:23:44.564Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-03-30T12:23:44.871 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:23:44.565Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-03-30T12:23:44.871 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:23:44.565Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.399µs 2024-03-30T12:23:44.872 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:23:44.565Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-03-30T12:23:44.872 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:23:44.566Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=2 2024-03-30T12:23:44.872 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:23:44.573Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=2 2024-03-30T12:23:44.872 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:23:44.573Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=2 2024-03-30T12:23:44.872 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:23:44.573Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=17.42µs wal_replay_duration=7.871652ms wbl_replay_duration=143ns total_replay_duration=7.906551ms 2024-03-30T12:23:44.872 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:23:44.574Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-03-30T12:23:44.872 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:23:44.574Z caller=main.go:1029 level=info msg="TSDB started" 2024-03-30T12:23:44.872 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:23:44.574Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-03-30T12:23:44.872 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:23:44.594Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=19.548322ms db_storage=775ns remote_storage=1.107µs web_handler=391ns query_engine=993ns scrape=598.954µs scrape_sd=77.82µs notify=12.095µs notify_sd=15.294µs rules=18.615916ms tracing=9.145µs 2024-03-30T12:23:44.872 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:23:44.594Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-03-30T12:23:44.872 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:23:44.594Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-03-30T12:23:44.872 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 bash[71910]: 9f1dfafa5a09a8886d65b8ddcbdd12e9b7eb811165af221b327f587682af4b3f 2024-03-30T12:23:44.872 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:23:44 smithi162 systemd[1]: Started Ceph prometheus.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:23:45.041 INFO:tasks.rados.rados.0.smithi084.stdout:501: done (0 left) 2024-03-30T12:23:45.041 INFO:tasks.rados.rados.0.smithi084.stdout:502: rollback oid 12 current snap is 49 2024-03-30T12:23:45.041 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 12 to 40 2024-03-30T12:23:45.041 INFO:tasks.rados.rados.0.smithi084.stdout:503: read oid 21 snap -1 2024-03-30T12:23:45.041 INFO:tasks.rados.rados.0.smithi084.stdout:503: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-30T12:23:45.041 INFO:tasks.rados.rados.0.smithi084.stdout:504: delete oid 11 current snap is 49 2024-03-30T12:23:45.050 INFO:tasks.rados.rados.0.smithi084.stdout:504: done (2 left) 2024-03-30T12:23:45.050 INFO:tasks.rados.rados.0.smithi084.stdout:505: read oid 41 snap -1 2024-03-30T12:23:45.050 INFO:tasks.rados.rados.0.smithi084.stdout:505: expect (ObjNum 160 snap 42 seq_num 160) 2024-03-30T12:23:45.050 INFO:tasks.rados.rados.0.smithi084.stdout:506: snap_remove snap 47 2024-03-30T12:23:45.340 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:45 smithi084 ceph-mon[27000]: pgmap v33: 121 pgs: 121 active+clean; 124 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 7.0 MiB/s rd, 1.2 MiB/s wr, 20 op/s 2024-03-30T12:23:45.340 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:45 smithi084 ceph-mon[27000]: osdmap e161: 8 total, 8 up, 8 in 2024-03-30T12:23:45.340 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:45 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:45.341 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:45 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:45.341 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:45 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T12:23:45.341 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:45 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:45.341 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:45 smithi084 ceph-mon[27000]: osdmap e162: 8 total, 8 up, 8 in 2024-03-30T12:23:45.341 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:45 smithi084 ceph-mon[37565]: pgmap v33: 121 pgs: 121 active+clean; 124 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 7.0 MiB/s rd, 1.2 MiB/s wr, 20 op/s 2024-03-30T12:23:45.341 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:45 smithi084 ceph-mon[37565]: osdmap e161: 8 total, 8 up, 8 in 2024-03-30T12:23:45.341 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:45 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:45.341 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:45 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:45.341 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:45 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T12:23:45.341 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:45 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:45.341 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:45 smithi084 ceph-mon[37565]: osdmap e162: 8 total, 8 up, 8 in 2024-03-30T12:23:45.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:45 smithi162 ceph-mon[30421]: pgmap v33: 121 pgs: 121 active+clean; 124 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 7.0 MiB/s rd, 1.2 MiB/s wr, 20 op/s 2024-03-30T12:23:45.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:45 smithi162 ceph-mon[30421]: osdmap e161: 8 total, 8 up, 8 in 2024-03-30T12:23:45.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:45 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:45.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:45 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:45.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:45 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T12:23:45.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:45 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:45.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:45 smithi162 ceph-mon[30421]: osdmap e162: 8 total, 8 up, 8 in 2024-03-30T12:23:46.023 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-03-30T12:23:46.051 INFO:tasks.rados.rados.0.smithi084.stdout:506: done (3 left) 2024-03-30T12:23:46.052 INFO:tasks.rados.rados.0.smithi084.stdout:507: rollback oid 1 current snap is 49 2024-03-30T12:23:46.052 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 1 to 38 2024-03-30T12:23:46.052 INFO:tasks.rados.rados.0.smithi084.stdout:508: read oid 31 snap -1 2024-03-30T12:23:46.052 INFO:tasks.rados.rados.0.smithi084.stdout:508: expect deleted 2024-03-30T12:23:46.052 INFO:tasks.rados.rados.0.smithi084.stdout:509: copy_from oid 10 from oid 26 current snap is 49 2024-03-30T12:23:46.052 INFO:tasks.rados.rados.0.smithi084.stdout:510: snap_remove snap 44 2024-03-30T12:23:46.349 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T12:23:46.349 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (3m) 14s ago 3m 26.1M - 0.25.0 c8568f914cd2 6765ce007f39 2024-03-30T12:23:46.349 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi162 *:3000 running (3m) 12s ago 3m 90.1M - 9.4.7 954c08fa6188 ff2ec7518619 2024-03-30T12:23:46.349 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (4m) 14s ago 4m 13.4M - 18.2.2-1051-gf14b5682 c8fb09e16a7d a9c2e74ca2a3 2024-03-30T12:23:46.349 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi162 running (4m) 12s ago 4m 18.2M - 18.2.2-1051-gf14b5682 c8fb09e16a7d ee1770ef5edd 2024-03-30T12:23:46.349 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi162 *:8443,9283,8765 running (39s) 12s ago 8m 492M - 19.0.0-1864-g5dc2ea30 548196a1a838 a9cc7956ea1d 2024-03-30T12:23:46.349 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:9283,8765 running (10m) 14s ago 9m 365M - 18.2.2-1051-gf14b5682 c8fb09e16a7d 000810f2a0de 2024-03-30T12:23:46.349 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (10m) 14s ago 10m 55.4M 2048M 18.2.2-1051-gf14b5682 c8fb09e16a7d 915abc0d6de7 2024-03-30T12:23:46.349 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi162 running (8m) 12s ago 8m 42.4M 2048M 18.2.2-1051-gf14b5682 c8fb09e16a7d 5bf04eacfc81 2024-03-30T12:23:46.349 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (8m) 14s ago 8m 44.1M 2048M 18.2.2-1051-gf14b5682 c8fb09e16a7d 7db3fd996ae6 2024-03-30T12:23:46.349 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (3m) 14s ago 3m 16.9M - 1.5.0 0da6a335fe13 66844bed39e8 2024-03-30T12:23:46.349 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi162 *:9100 running (3m) 12s ago 3m 15.4M - 1.5.0 0da6a335fe13 3d6e28b2348d 2024-03-30T12:23:46.350 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (8m) 14s ago 8m 125M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 4cad4c4383a6 2024-03-30T12:23:46.350 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (7m) 14s ago 7m 98.7M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 3b30b0ea0e32 2024-03-30T12:23:46.350 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (7m) 14s ago 7m 115M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d eb2412618811 2024-03-30T12:23:46.350 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (6m) 14s ago 6m 68.0M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 8eaf6dc73c25 2024-03-30T12:23:46.350 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi162 running (6m) 12s ago 6m 103M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 1f52e827b91a 2024-03-30T12:23:46.350 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi162 running (6m) 12s ago 6m 93.5M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 7ba250d154aa 2024-03-30T12:23:46.350 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi162 running (5m) 12s ago 5m 67.3M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 656a733e8b7a 2024-03-30T12:23:46.350 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi162 running (5m) 12s ago 5m 86.4M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d e3246b3bc88b 2024-03-30T12:23:46.350 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi162 *:9095 starting - - - - 2024-03-30T12:23:46.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:46 smithi084 ceph-mon[37565]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T12:23:46.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:46 smithi084 ceph-mon[37565]: Upgrade: Need to upgrade myself (mgr.x) 2024-03-30T12:23:46.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:46 smithi084 ceph-mon[37565]: Upgrade: Need to upgrade myself (mgr.x) 2024-03-30T12:23:46.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:46 smithi084 ceph-mon[37565]: osdmap e163: 8 total, 8 up, 8 in 2024-03-30T12:23:46.351 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:46 smithi084 ceph-mon[27000]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T12:23:46.351 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:46 smithi084 ceph-mon[27000]: Upgrade: Need to upgrade myself (mgr.x) 2024-03-30T12:23:46.351 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:46 smithi084 ceph-mon[27000]: Upgrade: Need to upgrade myself (mgr.x) 2024-03-30T12:23:46.351 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:46 smithi084 ceph-mon[27000]: osdmap e163: 8 total, 8 up, 8 in 2024-03-30T12:23:46.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:46 smithi162 ceph-mon[30421]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T12:23:46.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:46 smithi162 ceph-mon[30421]: Upgrade: Need to upgrade myself (mgr.x) 2024-03-30T12:23:46.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:46 smithi162 ceph-mon[30421]: Upgrade: Need to upgrade myself (mgr.x) 2024-03-30T12:23:46.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:46 smithi162 ceph-mon[30421]: osdmap e163: 8 total, 8 up, 8 in 2024-03-30T12:23:46.750 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-30T12:23:46.750 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-03-30T12:23:46.750 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 3 2024-03-30T12:23:46.750 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:23:46.751 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-03-30T12:23:46.751 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 1, 2024-03-30T12:23:46.751 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 1 2024-03-30T12:23:46.751 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:23:46.751 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-03-30T12:23:46.751 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 8 2024-03-30T12:23:46.751 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:23:46.751 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-03-30T12:23:46.751 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 2 2024-03-30T12:23:46.751 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:23:46.751 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-03-30T12:23:46.751 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 14, 2024-03-30T12:23:46.751 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 1 2024-03-30T12:23:46.751 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-30T12:23:46.751 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-30T12:23:47.060 INFO:tasks.rados.rados.0.smithi084.stdout:510: done (6 left) 2024-03-30T12:23:47.060 INFO:tasks.rados.rados.0.smithi084.stdout:511: delete oid 37 current snap is 49 2024-03-30T12:23:47.060 INFO:tasks.rados.rados.0.smithi084.stdout:502: finishing rollback tid 0 to smithi08477944-12 2024-03-30T12:23:47.060 INFO:tasks.rados.rados.0.smithi084.stdout:502: finishing rollback tid 1 to smithi08477944-12 2024-03-30T12:23:47.061 INFO:tasks.rados.rados.0.smithi084.stdout:502: finishing rollback tid 2 to smithi08477944-12 2024-03-30T12:23:47.061 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 124 (ObjNum 136 snap 32 seq_num 136) dirty exists 2024-03-30T12:23:47.061 INFO:tasks.rados.rados.0.smithi084.stdout:503: expect (ObjNum 45 snap 0 seq_num 45) 2024-03-30T12:23:47.087 INFO:tasks.rados.rados.0.smithi084.stdout:505: expect (ObjNum 160 snap 42 seq_num 160) 2024-03-30T12:23:47.134 INFO:tasks.rados.rados.0.smithi084.stdout:507: finishing rollback tid 1 to smithi08477944-1 2024-03-30T12:23:47.134 INFO:tasks.rados.rados.0.smithi084.stdout:507: finishing rollback tid 2 to smithi08477944-1 2024-03-30T12:23:47.135 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 183 (ObjNum 86 snap 21 seq_num 86) dirty exists 2024-03-30T12:23:47.135 INFO:tasks.rados.rados.0.smithi084.stdout:509: finishing copy_from racing read to smithi08477944-10 2024-03-30T12:23:47.135 INFO:tasks.rados.rados.0.smithi084.stdout:509: finishing copy_from to smithi08477944-10 2024-03-30T12:23:47.135 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 253 (ObjNum 162 snap 44 seq_num 162) dirty exists 2024-03-30T12:23:47.135 INFO:tasks.rados.rados.0.smithi084.stdout:502: done (6 left) 2024-03-30T12:23:47.135 INFO:tasks.rados.rados.0.smithi084.stdout:503: done (5 left) 2024-03-30T12:23:47.135 INFO:tasks.rados.rados.0.smithi084.stdout:505: done (4 left) 2024-03-30T12:23:47.135 INFO:tasks.rados.rados.0.smithi084.stdout:507: done (3 left) 2024-03-30T12:23:47.135 INFO:tasks.rados.rados.0.smithi084.stdout:508: done (2 left) 2024-03-30T12:23:47.135 INFO:tasks.rados.rados.0.smithi084.stdout:509: done (1 left) 2024-03-30T12:23:47.135 INFO:tasks.rados.rados.0.smithi084.stdout:511: done (0 left) 2024-03-30T12:23:47.135 INFO:tasks.rados.rados.0.smithi084.stdout:512: read oid 42 snap -1 2024-03-30T12:23:47.135 INFO:tasks.rados.rados.0.smithi084.stdout:512: expect deleted 2024-03-30T12:23:47.135 INFO:tasks.rados.rados.0.smithi084.stdout:513: read oid 24 snap -1 2024-03-30T12:23:47.136 INFO:tasks.rados.rados.0.smithi084.stdout:513: expect (ObjNum 23 snap 0 seq_num 23) 2024-03-30T12:23:47.136 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 49 2024-03-30T12:23:47.136 INFO:tasks.rados.rados.0.smithi084.stdout:514: seq_num 176 ranges {761856=557056} 2024-03-30T12:23:47.141 INFO:tasks.rados.rados.0.smithi084.stdout:514: writing smithi08477944-21 from 761856 to 1318912 tid 1 2024-03-30T12:23:47.141 INFO:tasks.rados.rados.0.smithi084.stdout:515: snap_remove snap 41 2024-03-30T12:23:47.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:47 smithi162 ceph-mon[30421]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:23:47.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:47 smithi162 ceph-mon[30421]: pgmap v36: 121 pgs: 121 active+clean; 126 MiB data, 561 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 830 KiB/s wr, 13 op/s 2024-03-30T12:23:47.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:47 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:47.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:47 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:23:47.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:47 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:23:47.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:47 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T12:23:47.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:47 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:23:47.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:47 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/1466783051' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:23:47.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:47 smithi162 ceph-mon[30421]: osdmap e164: 8 total, 8 up, 8 in 2024-03-30T12:23:47.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:47 smithi084 ceph-mon[27000]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:23:47.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:47 smithi084 ceph-mon[27000]: pgmap v36: 121 pgs: 121 active+clean; 126 MiB data, 561 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 830 KiB/s wr, 13 op/s 2024-03-30T12:23:47.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:47 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:47.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:47 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:23:47.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:47 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:23:47.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:47 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T12:23:47.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:47 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:23:47.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:47 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/1466783051' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:23:47.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:47 smithi084 ceph-mon[27000]: osdmap e164: 8 total, 8 up, 8 in 2024-03-30T12:23:47.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:47 smithi084 ceph-mon[37565]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:23:47.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:47 smithi084 ceph-mon[37565]: pgmap v36: 121 pgs: 121 active+clean; 126 MiB data, 561 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 830 KiB/s wr, 13 op/s 2024-03-30T12:23:47.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:47 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:47.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:47 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:23:47.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:47 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:23:47.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:47 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T12:23:47.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:47 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:23:47.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:47 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/1466783051' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:23:47.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:47 smithi084 ceph-mon[37565]: osdmap e164: 8 total, 8 up, 8 in 2024-03-30T12:23:48.078 INFO:tasks.rados.rados.0.smithi084.stdout:513: expect (ObjNum 23 snap 0 seq_num 23) 2024-03-30T12:23:48.091 INFO:tasks.rados.rados.0.smithi084.stdout:514: finishing write tid 1 to smithi08477944-21 2024-03-30T12:23:48.091 INFO:tasks.rados.rados.0.smithi084.stdout:514: finishing write tid 2 to smithi08477944-21 2024-03-30T12:23:48.091 INFO:tasks.rados.rados.0.smithi084.stdout:514: finishing write tid 3 to smithi08477944-21 2024-03-30T12:23:48.091 INFO:tasks.rados.rados.0.smithi084.stdout:514: oid 21 updating version 0 to 69 2024-03-30T12:23:48.091 INFO:tasks.rados.rados.0.smithi084.stdout:514: oid 21 updating version 69 to 70 2024-03-30T12:23:48.091 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 70 (ObjNum 176 snap 49 seq_num 176) dirty exists 2024-03-30T12:23:48.091 INFO:tasks.rados.rados.0.smithi084.stdout:514: left oid 21 (ObjNum 176 snap 49 seq_num 176) 2024-03-30T12:23:48.091 INFO:tasks.rados.rados.0.smithi084.stdout:512: done (3 left) 2024-03-30T12:23:48.091 INFO:tasks.rados.rados.0.smithi084.stdout:513: done (2 left) 2024-03-30T12:23:48.091 INFO:tasks.rados.rados.0.smithi084.stdout:514: done (1 left) 2024-03-30T12:23:48.091 INFO:tasks.rados.rados.0.smithi084.stdout:515: done (0 left) 2024-03-30T12:23:48.091 INFO:tasks.rados.rados.0.smithi084.stdout:516: snap_remove snap 43 2024-03-30T12:23:48.191 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:48 smithi084 ceph-mon[27000]: Upgrade: Updating mgr.y 2024-03-30T12:23:48.191 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:48 smithi084 ceph-mon[27000]: Deploying daemon mgr.y on smithi084 2024-03-30T12:23:48.191 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:48 smithi084 ceph-mon[27000]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:23:48.191 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:48 smithi084 ceph-mon[37565]: Upgrade: Updating mgr.y 2024-03-30T12:23:48.192 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:48 smithi084 ceph-mon[37565]: Deploying daemon mgr.y on smithi084 2024-03-30T12:23:48.192 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:48 smithi084 ceph-mon[37565]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:23:48.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:48 smithi162 ceph-mon[30421]: Upgrade: Updating mgr.y 2024-03-30T12:23:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:48 smithi162 ceph-mon[30421]: Deploying daemon mgr.y on smithi084 2024-03-30T12:23:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:48 smithi162 ceph-mon[30421]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:23:48.464 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:48 smithi084 systemd[1]: Stopping Ceph mgr.y for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:23:48.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:48 smithi084 podman[80540]: 2024-03-30 12:23:48.473049521 +0000 UTC m=+0.132751814 container died 000810f2a0de0642a92a7b94ddbccd245d88a009173afdd4d28ed4fabc073112 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=reef-f14b568, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-03-30T12:23:49.074 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:48 smithi084 podman[80540]: 2024-03-30 12:23:48.892297948 +0000 UTC m=+0.552000233 container cleanup 000810f2a0de0642a92a7b94ddbccd245d88a009173afdd4d28ed4fabc073112 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=reef-f14b568, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-03-30T12:23:49.074 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:48 smithi084 bash[80540]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y 2024-03-30T12:23:49.091 INFO:tasks.rados.rados.0.smithi084.stdout:516: done (0 left) 2024-03-30T12:23:49.091 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 49 2024-03-30T12:23:49.091 INFO:tasks.rados.rados.0.smithi084.stdout:517: seq_num 177 ranges {0=573440} 2024-03-30T12:23:49.095 INFO:tasks.rados.rados.0.smithi084.stdout:517: writing smithi08477944-37 from 0 to 573440 tid 1 2024-03-30T12:23:49.095 INFO:tasks.rados.rados.0.smithi084.stdout:518: read oid 9 snap -1 2024-03-30T12:23:49.095 INFO:tasks.rados.rados.0.smithi084.stdout:518: expect (ObjNum 168 snap 46 seq_num 168) 2024-03-30T12:23:49.095 INFO:tasks.rados.rados.0.smithi084.stdout:519: rollback oid 16 current snap is 49 2024-03-30T12:23:49.095 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 16 to 32 2024-03-30T12:23:49.095 INFO:tasks.rados.rados.0.smithi084.stdout:520: delete oid 11 current snap is 49 2024-03-30T12:23:49.100 INFO:tasks.rados.rados.0.smithi084.stdout:518: expect (ObjNum 168 snap 46 seq_num 168) 2024-03-30T12:23:49.125 INFO:tasks.rados.rados.0.smithi084.stdout:519: finishing rollback tid 0 to smithi08477944-16 2024-03-30T12:23:49.126 INFO:tasks.rados.rados.0.smithi084.stdout:517: finishing write tid 1 to smithi08477944-37 2024-03-30T12:23:49.126 INFO:tasks.rados.rados.0.smithi084.stdout:517: finishing write tid 2 to smithi08477944-37 2024-03-30T12:23:49.126 INFO:tasks.rados.rados.0.smithi084.stdout:519: finishing rollback tid 1 to smithi08477944-16 2024-03-30T12:23:49.126 INFO:tasks.rados.rados.0.smithi084.stdout:519: finishing rollback tid 2 to smithi08477944-16 2024-03-30T12:23:49.126 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 296 (ObjNum 108 snap 23 seq_num 108) dirty exists 2024-03-30T12:23:49.126 INFO:tasks.rados.rados.0.smithi084.stdout:517: finishing write tid 3 to smithi08477944-37 2024-03-30T12:23:49.126 INFO:tasks.rados.rados.0.smithi084.stdout:517: oid 37 updating version 0 to 255 2024-03-30T12:23:49.126 INFO:tasks.rados.rados.0.smithi084.stdout:517: oid 37 updating version 255 to 256 2024-03-30T12:23:49.127 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 256 (ObjNum 177 snap 49 seq_num 177) dirty exists 2024-03-30T12:23:49.127 INFO:tasks.rados.rados.0.smithi084.stdout:517: left oid 37 (ObjNum 177 snap 49 seq_num 177) 2024-03-30T12:23:49.127 INFO:tasks.rados.rados.0.smithi084.stdout:517: done (3 left) 2024-03-30T12:23:49.127 INFO:tasks.rados.rados.0.smithi084.stdout:518: done (2 left) 2024-03-30T12:23:49.127 INFO:tasks.rados.rados.0.smithi084.stdout:519: done (1 left) 2024-03-30T12:23:49.127 INFO:tasks.rados.rados.0.smithi084.stdout:520: done (0 left) 2024-03-30T12:23:49.127 INFO:tasks.rados.rados.0.smithi084.stdout:521: read oid 39 snap -1 2024-03-30T12:23:49.127 INFO:tasks.rados.rados.0.smithi084.stdout:521: expect (ObjNum 136 snap 32 seq_num 136) 2024-03-30T12:23:49.127 INFO:tasks.rados.rados.0.smithi084.stdout:522: read oid 5 snap -1 2024-03-30T12:23:49.128 INFO:tasks.rados.rados.0.smithi084.stdout:522: expect deleted 2024-03-30T12:23:49.128 INFO:tasks.rados.rados.0.smithi084.stdout:523: snap_remove snap 32 2024-03-30T12:23:49.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:49 smithi162 ceph-mon[30421]: pgmap v38: 121 pgs: 121 active+clean; 126 MiB data, 561 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 829 KiB/s wr, 13 op/s 2024-03-30T12:23:49.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:49 smithi162 ceph-mon[30421]: osdmap e165: 8 total, 8 up, 8 in 2024-03-30T12:23:49.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:49 smithi084 ceph-mon[27000]: pgmap v38: 121 pgs: 121 active+clean; 126 MiB data, 561 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 829 KiB/s wr, 13 op/s 2024-03-30T12:23:49.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:49 smithi084 ceph-mon[27000]: osdmap e165: 8 total, 8 up, 8 in 2024-03-30T12:23:49.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:49 smithi084 ceph-mon[37565]: pgmap v38: 121 pgs: 121 active+clean; 126 MiB data, 561 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 829 KiB/s wr, 13 op/s 2024-03-30T12:23:49.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:49 smithi084 ceph-mon[37565]: osdmap e165: 8 total, 8 up, 8 in 2024-03-30T12:23:49.430 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:49 smithi084 podman[80554]: 2024-03-30 12:23:49.202522139 +0000 UTC m=+0.730784080 container remove 000810f2a0de0642a92a7b94ddbccd245d88a009173afdd4d28ed4fabc073112 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=reef-f14b568, org.label-schema.schema-version=1.0) 2024-03-30T12:23:49.431 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:49 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-03-30T12:23:49.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:49 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mgr.y.service: Failed with result 'exit-code'. 2024-03-30T12:23:49.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:49 smithi084 systemd[1]: Stopped Ceph mgr.y for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:23:49.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:49 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mgr.y.service: Consumed 1min 2.265s CPU time. 2024-03-30T12:23:49.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:49 smithi084 systemd[1]: Starting Ceph mgr.y for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:23:50.043 INFO:tasks.rados.rados.0.smithi084.stdout:523: done (2 left) 2024-03-30T12:23:50.043 INFO:tasks.rados.rados.0.smithi084.stdout:524: snap_remove snap 40 2024-03-30T12:23:50.154 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:50 smithi084 ceph-mon[37565]: osdmap e166: 8 total, 8 up, 8 in 2024-03-30T12:23:50.155 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:50 smithi084 ceph-mon[37565]: osdmap e167: 8 total, 8 up, 8 in 2024-03-30T12:23:50.155 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:50 smithi084 ceph-mon[27000]: osdmap e166: 8 total, 8 up, 8 in 2024-03-30T12:23:50.155 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:50 smithi084 ceph-mon[27000]: osdmap e167: 8 total, 8 up, 8 in 2024-03-30T12:23:50.155 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:49 smithi084 podman[80687]: 2024-03-30 12:23:49.763622837 +0000 UTC m=+0.018083393 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:23:50.155 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:49 smithi084 podman[80687]: 2024-03-30 12:23:49.895541718 +0000 UTC m=+0.150002292 container create 9a2aba19dffcdf4dfd9b047d4513c92d321ee672d0a261227650944062c61c58 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3) 2024-03-30T12:23:50.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:50 smithi162 ceph-mon[30421]: osdmap e166: 8 total, 8 up, 8 in 2024-03-30T12:23:50.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:50 smithi162 ceph-mon[30421]: osdmap e167: 8 total, 8 up, 8 in 2024-03-30T12:23:50.474 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:50 smithi084 podman[80687]: 2024-03-30 12:23:50.163867312 +0000 UTC m=+0.418327851 container init 9a2aba19dffcdf4dfd9b047d4513c92d321ee672d0a261227650944062c61c58 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-03-30T12:23:50.474 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:50 smithi084 podman[80687]: 2024-03-30 12:23:50.16732027 +0000 UTC m=+0.421780801 container start 9a2aba19dffcdf4dfd9b047d4513c92d321ee672d0a261227650944062c61c58 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-03-30T12:23:50.474 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:50 smithi084 ceph-mgr[80707]: -- 172.21.15.84:0/678051063 <== mon.2 v2:172.21.15.84:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563872ec05a0 con 0x563872e94800 2024-03-30T12:23:50.474 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:50 smithi084 bash[80687]: 9a2aba19dffcdf4dfd9b047d4513c92d321ee672d0a261227650944062c61c58 2024-03-30T12:23:50.475 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:50 smithi084 systemd[1]: Started Ceph mgr.y for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:23:51.003 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:50.757+0000 7f9536b53200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T12:23:51.004 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:50.860+0000 7f9536b53200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T12:23:51.045 INFO:tasks.rados.rados.0.smithi084.stdout:524: done (2 left) 2024-03-30T12:23:51.045 INFO:tasks.rados.rados.0.smithi084.stdout:525: snap_remove snap 36 2024-03-30T12:23:51.339 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:51 smithi084 ceph-mon[37565]: pgmap v42: 121 pgs: 121 active+clean; 126 MiB data, 561 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:23:51.339 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:51 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:51.339 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:51 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:51.339 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:51 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:51.340 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:51 smithi084 ceph-mon[37565]: osdmap e168: 8 total, 8 up, 8 in 2024-03-30T12:23:51.340 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:51 smithi084 ceph-mon[27000]: pgmap v42: 121 pgs: 121 active+clean; 126 MiB data, 561 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:23:51.340 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:51 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:51.340 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:51 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:51.340 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:51 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:51.340 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:51 smithi084 ceph-mon[27000]: osdmap e168: 8 total, 8 up, 8 in 2024-03-30T12:23:51.369 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:23:51] "GET /metrics HTTP/1.1" 200 36001 "" "Prometheus/2.43.0" 2024-03-30T12:23:51.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:51 smithi162 ceph-mon[30421]: pgmap v42: 121 pgs: 121 active+clean; 126 MiB data, 561 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:23:51.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:51 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:51.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:51 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:51.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:51 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:51.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:51 smithi162 ceph-mon[30421]: osdmap e168: 8 total, 8 up, 8 in 2024-03-30T12:23:51.680 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:51.585+0000 7f9536b53200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T12:23:51.681 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:51.688+0000 7f9536b53200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T12:23:51.975 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:51.829+0000 7f9536b53200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T12:23:51.975 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:51.925+0000 7f9536b53200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T12:23:52.049 INFO:tasks.rados.rados.0.smithi084.stdout:525: done (2 left) 2024-03-30T12:23:52.049 INFO:tasks.rados.rados.0.smithi084.stdout:526: copy_from oid 22 from oid 10 current snap is 49 2024-03-30T12:23:52.050 INFO:tasks.rados.rados.0.smithi084.stdout:527: rmattr oid 30 current snap is 49 2024-03-30T12:23:52.050 INFO:tasks.rados.rados.0.smithi084.stdout:528: read oid 37 snap -1 2024-03-30T12:23:52.050 INFO:tasks.rados.rados.0.smithi084.stdout:528: expect (ObjNum 177 snap 49 seq_num 177) 2024-03-30T12:23:52.050 INFO:tasks.rados.rados.0.smithi084.stdout:529: setattr oid 44 current snap is 49 2024-03-30T12:23:52.050 INFO:tasks.rados.rados.0.smithi084.stdout:521: expect (ObjNum 136 snap 32 seq_num 136) 2024-03-30T12:23:52.118 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 129 (ObjNum 29 snap 0 seq_num 29) dirty exists 2024-03-30T12:23:52.118 INFO:tasks.rados.rados.0.smithi084.stdout:528: expect (ObjNum 177 snap 49 seq_num 177) 2024-03-30T12:23:52.133 INFO:tasks.rados.rados.0.smithi084.stdout:526: finishing copy_from racing read to smithi08477944-22 2024-03-30T12:23:52.133 INFO:tasks.rados.rados.0.smithi084.stdout:526: finishing copy_from to smithi08477944-22 2024-03-30T12:23:52.133 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 253 (ObjNum 162 snap 44 seq_num 162) dirty exists 2024-03-30T12:23:52.134 INFO:tasks.rados.rados.0.smithi084.stdout:521: done (5 left) 2024-03-30T12:23:52.134 INFO:tasks.rados.rados.0.smithi084.stdout:522: done (4 left) 2024-03-30T12:23:52.134 INFO:tasks.rados.rados.0.smithi084.stdout:526: done (3 left) 2024-03-30T12:23:52.134 INFO:tasks.rados.rados.0.smithi084.stdout:527: done (2 left) 2024-03-30T12:23:52.134 INFO:tasks.rados.rados.0.smithi084.stdout:528: done (1 left) 2024-03-30T12:23:52.134 INFO:tasks.rados.rados.0.smithi084.stdout:530: delete oid 26 current snap is 49 2024-03-30T12:23:52.136 INFO:tasks.rados.rados.0.smithi084.stdout:530: done (1 left) 2024-03-30T12:23:52.136 INFO:tasks.rados.rados.0.smithi084.stdout:531: snap_create 2024-03-30T12:23:52.136 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 166 (ObjNum 167 snap 45 seq_num 167) dirty exists 2024-03-30T12:23:52.253 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:52.013+0000 7f9536b53200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T12:23:52.618 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:52.297+0000 7f9536b53200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T12:23:52.618 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:52.422+0000 7f9536b53200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T12:23:52.618 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:52.520+0000 7f9536b53200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T12:23:52.618 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:52.625+0000 7f9536b53200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T12:23:52.956 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:52.801+0000 7f9536b53200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T12:23:53.058 INFO:tasks.rados.rados.0.smithi084.stdout:529: done (1 left) 2024-03-30T12:23:53.059 INFO:tasks.rados.rados.0.smithi084.stdout:531: done (0 left) 2024-03-30T12:23:53.059 INFO:tasks.rados.rados.0.smithi084.stdout:532: rollback oid 47 current snap is 50 2024-03-30T12:23:53.059 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 38 2024-03-30T12:23:53.059 INFO:tasks.rados.rados.0.smithi084.stdout:533: read oid 10 snap -1 2024-03-30T12:23:53.059 INFO:tasks.rados.rados.0.smithi084.stdout:533: expect (ObjNum 162 snap 44 seq_num 162) 2024-03-30T12:23:53.059 INFO:tasks.rados.rados.0.smithi084.stdout:534: read oid 42 snap 45 2024-03-30T12:23:53.059 INFO:tasks.rados.rados.0.smithi084.stdout:534: expect deleted 2024-03-30T12:23:53.059 INFO:tasks.rados.rados.0.smithi084.stdout:535: snap_remove snap 9 2024-03-30T12:23:53.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:53 smithi084 ceph-mon[37565]: osdmap e169: 8 total, 8 up, 8 in 2024-03-30T12:23:53.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:53 smithi084 ceph-mon[37565]: pgmap v45: 121 pgs: 121 active+clean; 126 MiB data, 562 MiB used, 715 GiB / 715 GiB avail; 2.4 MiB/s rd, 355 KiB/s wr, 6 op/s 2024-03-30T12:23:53.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:53 smithi084 ceph-mon[27000]: osdmap e169: 8 total, 8 up, 8 in 2024-03-30T12:23:53.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:53 smithi084 ceph-mon[27000]: pgmap v45: 121 pgs: 121 active+clean; 126 MiB data, 562 MiB used, 715 GiB / 715 GiB avail; 2.4 MiB/s rd, 355 KiB/s wr, 6 op/s 2024-03-30T12:23:53.312 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:53 smithi162 ceph-mon[30421]: osdmap e169: 8 total, 8 up, 8 in 2024-03-30T12:23:53.313 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:53 smithi162 ceph-mon[30421]: pgmap v45: 121 pgs: 121 active+clean; 126 MiB data, 562 MiB used, 715 GiB / 715 GiB avail; 2.4 MiB/s rd, 355 KiB/s wr, 6 op/s 2024-03-30T12:23:54.057 INFO:tasks.rados.rados.0.smithi084.stdout:535: done (3 left) 2024-03-30T12:23:54.057 INFO:tasks.rados.rados.0.smithi084.stdout:536: rmattr oid 46 current snap is 50 2024-03-30T12:23:54.057 INFO:tasks.rados.rados.0.smithi084.stdout:536: done (3 left) 2024-03-30T12:23:54.058 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 50 2024-03-30T12:23:54.058 INFO:tasks.rados.rados.0.smithi084.stdout:537: seq_num 180 ranges {950272=622592} 2024-03-30T12:23:54.058 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:53.810+0000 7f9536b53200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T12:23:54.058 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:53.944+0000 7f9536b53200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T12:23:54.066 INFO:tasks.rados.rados.0.smithi084.stdout:537: writing smithi08477944-40 from 950272 to 1572864 tid 1 2024-03-30T12:23:54.066 INFO:tasks.rados.rados.0.smithi084.stdout:532: finishing rollback tid 0 to smithi08477944-47 2024-03-30T12:23:54.066 INFO:tasks.rados.rados.0.smithi084.stdout:532: finishing rollback tid 1 to smithi08477944-47 2024-03-30T12:23:54.066 INFO:tasks.rados.rados.0.smithi084.stdout:532: finishing rollback tid 2 to smithi08477944-47 2024-03-30T12:23:54.066 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 303 (ObjNum 140 snap 34 seq_num 140) dirty exists 2024-03-30T12:23:54.067 INFO:tasks.rados.rados.0.smithi084.stdout:533: expect (ObjNum 162 snap 44 seq_num 162) 2024-03-30T12:23:54.081 INFO:tasks.rados.rados.0.smithi084.stdout:537: finishing write tid 1 to smithi08477944-40 2024-03-30T12:23:54.081 INFO:tasks.rados.rados.0.smithi084.stdout:537: finishing write tid 2 to smithi08477944-40 2024-03-30T12:23:54.081 INFO:tasks.rados.rados.0.smithi084.stdout:532: done (3 left) 2024-03-30T12:23:54.081 INFO:tasks.rados.rados.0.smithi084.stdout:533: done (2 left) 2024-03-30T12:23:54.081 INFO:tasks.rados.rados.0.smithi084.stdout:534: done (1 left) 2024-03-30T12:23:54.082 INFO:tasks.rados.rados.0.smithi084.stdout:538: read oid 4 snap -1 2024-03-30T12:23:54.082 INFO:tasks.rados.rados.0.smithi084.stdout:538: expect deleted 2024-03-30T12:23:54.082 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 50 2024-03-30T12:23:54.082 INFO:tasks.rados.rados.0.smithi084.stdout:539: seq_num 181 ranges {2293760=638976} 2024-03-30T12:23:54.098 INFO:tasks.rados.rados.0.smithi084.stdout:539: writing smithi08477944-12 from 2293760 to 2932736 tid 1 2024-03-30T12:23:54.098 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 50 2024-03-30T12:23:54.098 INFO:tasks.rados.rados.0.smithi084.stdout:540: seq_num 182 ranges {3391488=655360} 2024-03-30T12:23:54.121 INFO:tasks.rados.rados.0.smithi084.stdout:540: writing smithi08477944-16 from 3391488 to 4046848 tid 1 2024-03-30T12:23:54.121 INFO:tasks.rados.rados.0.smithi084.stdout:541: read oid 35 snap 45 2024-03-30T12:23:54.121 INFO:tasks.rados.rados.0.smithi084.stdout:541: expect (ObjNum 150 snap 40 seq_num 150) 2024-03-30T12:23:54.121 INFO:tasks.rados.rados.0.smithi084.stdout:542: rmattr oid 2 current snap is 50 2024-03-30T12:23:54.121 INFO:tasks.rados.rados.0.smithi084.stdout:542: done (5 left) 2024-03-30T12:23:54.121 INFO:tasks.rados.rados.0.smithi084.stdout:543: read oid 46 snap -1 2024-03-30T12:23:54.121 INFO:tasks.rados.rados.0.smithi084.stdout:543: expect (ObjNum 107 snap 22 seq_num 107) 2024-03-30T12:23:54.121 INFO:tasks.rados.rados.0.smithi084.stdout:544: copy_from oid 28 from oid 49 current snap is 50 2024-03-30T12:23:54.121 INFO:tasks.rados.rados.0.smithi084.stdout:545: read oid 39 snap -1 2024-03-30T12:23:54.122 INFO:tasks.rados.rados.0.smithi084.stdout:545: expect (ObjNum 136 snap 32 seq_num 136) 2024-03-30T12:23:54.122 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 50 2024-03-30T12:23:54.122 INFO:tasks.rados.rados.0.smithi084.stdout:546: seq_num 183 ranges {573440=671744} 2024-03-30T12:23:54.128 INFO:tasks.rados.rados.0.smithi084.stdout:546: writing smithi08477944-37 from 573440 to 1245184 tid 1 2024-03-30T12:23:54.128 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 50 2024-03-30T12:23:54.128 INFO:tasks.rados.rados.0.smithi084.stdout:547: seq_num 184 ranges {1802240=688128} 2024-03-30T12:23:54.142 INFO:tasks.rados.rados.0.smithi084.stdout:547: writing smithi08477944-19 from 1802240 to 2490368 tid 1 2024-03-30T12:23:54.143 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 50 2024-03-30T12:23:54.143 INFO:tasks.rados.rados.0.smithi084.stdout:548: seq_num 185 ranges {0=704512} 2024-03-30T12:23:54.147 INFO:tasks.rados.rados.0.smithi084.stdout:548: writing smithi08477944-48 from 0 to 704512 tid 1 2024-03-30T12:23:54.147 INFO:tasks.rados.rados.0.smithi084.stdout:549: copy_from oid 36 from oid 44 current snap is 50 2024-03-30T12:23:54.147 INFO:tasks.rados.rados.0.smithi084.stdout:537: finishing write tid 3 to smithi08477944-40 2024-03-30T12:23:54.147 INFO:tasks.rados.rados.0.smithi084.stdout:537: oid 40 updating version 0 to 305 2024-03-30T12:23:54.148 INFO:tasks.rados.rados.0.smithi084.stdout:537: oid 40 updating version 305 to 306 2024-03-30T12:23:54.148 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 306 (ObjNum 180 snap 50 seq_num 180) dirty exists 2024-03-30T12:23:54.148 INFO:tasks.rados.rados.0.smithi084.stdout:537: left oid 40 (ObjNum 180 snap 50 seq_num 180) 2024-03-30T12:23:54.148 INFO:tasks.rados.rados.0.smithi084.stdout:539: finishing write tid 1 to smithi08477944-12 2024-03-30T12:23:54.148 INFO:tasks.rados.rados.0.smithi084.stdout:539: finishing write tid 2 to smithi08477944-12 2024-03-30T12:23:54.148 INFO:tasks.rados.rados.0.smithi084.stdout:539: finishing write tid 3 to smithi08477944-12 2024-03-30T12:23:54.148 INFO:tasks.rados.rados.0.smithi084.stdout:539: oid 12 updating version 0 to 146 2024-03-30T12:23:54.148 INFO:tasks.rados.rados.0.smithi084.stdout:539: oid 12 updating version 146 to 147 2024-03-30T12:23:54.148 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 147 (ObjNum 181 snap 50 seq_num 181) dirty exists 2024-03-30T12:23:54.148 INFO:tasks.rados.rados.0.smithi084.stdout:539: left oid 12 (ObjNum 181 snap 50 seq_num 181) 2024-03-30T12:23:54.148 INFO:tasks.rados.rados.0.smithi084.stdout:537: done (11 left) 2024-03-30T12:23:54.149 INFO:tasks.rados.rados.0.smithi084.stdout:538: done (10 left) 2024-03-30T12:23:54.149 INFO:tasks.rados.rados.0.smithi084.stdout:539: done (9 left) 2024-03-30T12:23:54.149 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 50 2024-03-30T12:23:54.149 INFO:tasks.rados.rados.0.smithi084.stdout:550: seq_num 186 ranges {1802240=720896} 2024-03-30T12:23:54.161 INFO:tasks.rados.rados.0.smithi084.stdout:550: writing smithi08477944-20 from 1802240 to 2523136 tid 1 2024-03-30T12:23:54.161 INFO:tasks.rados.rados.0.smithi084.stdout:551: delete oid 2 current snap is 50 2024-03-30T12:23:54.161 INFO:tasks.rados.rados.0.smithi084.stdout:543: expect (ObjNum 107 snap 22 seq_num 107) 2024-03-30T12:23:54.211 INFO:tasks.rados.rados.0.smithi084.stdout:541: expect (ObjNum 150 snap 40 seq_num 150) 2024-03-30T12:23:54.260 INFO:tasks.rados.rados.0.smithi084.stdout:540: finishing write tid 1 to smithi08477944-16 2024-03-30T12:23:54.261 INFO:tasks.rados.rados.0.smithi084.stdout:540: finishing write tid 2 to smithi08477944-16 2024-03-30T12:23:54.261 INFO:tasks.rados.rados.0.smithi084.stdout:545: expect (ObjNum 136 snap 32 seq_num 136) 2024-03-30T12:23:54.322 INFO:tasks.rados.rados.0.smithi084.stdout:546: finishing write tid 1 to smithi08477944-37 2024-03-30T12:23:54.322 INFO:tasks.rados.rados.0.smithi084.stdout:546: finishing write tid 2 to smithi08477944-37 2024-03-30T12:23:54.322 INFO:tasks.rados.rados.0.smithi084.stdout:540: finishing write tid 3 to smithi08477944-16 2024-03-30T12:23:54.322 INFO:tasks.rados.rados.0.smithi084.stdout:540: oid 16 updating version 0 to 332 2024-03-30T12:23:54.322 INFO:tasks.rados.rados.0.smithi084.stdout:540: oid 16 updating version 332 to 333 2024-03-30T12:23:54.322 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 333 (ObjNum 182 snap 50 seq_num 182) dirty exists 2024-03-30T12:23:54.322 INFO:tasks.rados.rados.0.smithi084.stdout:540: left oid 16 (ObjNum 182 snap 50 seq_num 182) 2024-03-30T12:23:54.322 INFO:tasks.rados.rados.0.smithi084.stdout:546: finishing write tid 3 to smithi08477944-37 2024-03-30T12:23:54.322 INFO:tasks.rados.rados.0.smithi084.stdout:546: oid 37 updating version 0 to 258 2024-03-30T12:23:54.322 INFO:tasks.rados.rados.0.smithi084.stdout:546: oid 37 version 258 is already newer than 257 2024-03-30T12:23:54.323 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 258 (ObjNum 183 snap 50 seq_num 183) dirty exists 2024-03-30T12:23:54.323 INFO:tasks.rados.rados.0.smithi084.stdout:546: left oid 37 (ObjNum 183 snap 50 seq_num 183) 2024-03-30T12:23:54.323 INFO:tasks.rados.rados.0.smithi084.stdout:544: finishing copy_from racing read to smithi08477944-28 2024-03-30T12:23:54.323 INFO:tasks.rados.rados.0.smithi084.stdout:544: finishing copy_from to smithi08477944-28 2024-03-30T12:23:54.323 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 183 (ObjNum 146 snap 37 seq_num 146) dirty exists 2024-03-30T12:23:54.323 INFO:tasks.rados.rados.0.smithi084.stdout:547: finishing write tid 1 to smithi08477944-19 2024-03-30T12:23:54.323 INFO:tasks.rados.rados.0.smithi084.stdout:547: finishing write tid 2 to smithi08477944-19 2024-03-30T12:23:54.323 INFO:tasks.rados.rados.0.smithi084.stdout:540: done (10 left) 2024-03-30T12:23:54.323 INFO:tasks.rados.rados.0.smithi084.stdout:541: done (9 left) 2024-03-30T12:23:54.323 INFO:tasks.rados.rados.0.smithi084.stdout:543: done (8 left) 2024-03-30T12:23:54.323 INFO:tasks.rados.rados.0.smithi084.stdout:544: done (7 left) 2024-03-30T12:23:54.323 INFO:tasks.rados.rados.0.smithi084.stdout:545: done (6 left) 2024-03-30T12:23:54.323 INFO:tasks.rados.rados.0.smithi084.stdout:546: done (5 left) 2024-03-30T12:23:54.323 INFO:tasks.rados.rados.0.smithi084.stdout:551: done (4 left) 2024-03-30T12:23:54.323 INFO:tasks.rados.rados.0.smithi084.stdout:552: snap_remove snap 49 2024-03-30T12:23:54.324 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:54 smithi084 ceph-mon[27000]: osdmap e170: 8 total, 8 up, 8 in 2024-03-30T12:23:54.324 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:54 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:54.325 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:54 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:54.325 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:54 smithi084 ceph-mon[37565]: osdmap e170: 8 total, 8 up, 8 in 2024-03-30T12:23:54.325 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:54 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:54.325 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:54 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:54.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:54 smithi162 ceph-mon[30421]: osdmap e170: 8 total, 8 up, 8 in 2024-03-30T12:23:54.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:54 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:54.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:54 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:54.633 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:54.332+0000 7f9536b53200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T12:23:54.633 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:54.429+0000 7f9536b53200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T12:23:54.633 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:54.640+0000 7f9536b53200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:23:55.003 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:54.837+0000 7f9536b53200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T12:23:55.045 INFO:tasks.rados.rados.0.smithi084.stdout:552: done (4 left) 2024-03-30T12:23:55.045 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 50 2024-03-30T12:23:55.045 INFO:tasks.rados.rados.0.smithi084.stdout:553: seq_num 188 ranges {1236992=753664} 2024-03-30T12:23:55.057 INFO:tasks.rados.rados.0.smithi084.stdout:553: writing smithi08477944-15 from 1236992 to 1990656 tid 1 2024-03-30T12:23:55.057 INFO:tasks.rados.rados.0.smithi084.stdout:554: read oid 30 snap -1 2024-03-30T12:23:55.057 INFO:tasks.rados.rados.0.smithi084.stdout:554: expect (ObjNum 29 snap 0 seq_num 29) 2024-03-30T12:23:55.057 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 50 2024-03-30T12:23:55.057 INFO:tasks.rados.rados.0.smithi084.stdout:547: finishing write tid 3 to smithi08477944-19 2024-03-30T12:23:55.057 INFO:tasks.rados.rados.0.smithi084.stdout:547: oid 19 updating version 0 to 173 2024-03-30T12:23:55.057 INFO:tasks.rados.rados.0.smithi084.stdout:547: oid 19 version 173 is already newer than 172 2024-03-30T12:23:55.058 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 173 (ObjNum 184 snap 50 seq_num 184) dirty exists 2024-03-30T12:23:55.058 INFO:tasks.rados.rados.0.smithi084.stdout:547: left oid 19 (ObjNum 184 snap 50 seq_num 184) 2024-03-30T12:23:55.058 INFO:tasks.rados.rados.0.smithi084.stdout:548: finishing write tid 1 to smithi08477944-48 2024-03-30T12:23:55.058 INFO:tasks.rados.rados.0.smithi084.stdout:555: seq_num 189 ranges {106496=770048} 2024-03-30T12:23:55.062 INFO:tasks.rados.rados.0.smithi084.stdout:555: writing smithi08477944-7 from 106496 to 876544 tid 1 2024-03-30T12:23:55.062 INFO:tasks.rados.rados.0.smithi084.stdout:547: done (6 left) 2024-03-30T12:23:55.062 INFO:tasks.rados.rados.0.smithi084.stdout:556: snap_remove snap 38 2024-03-30T12:23:55.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:55 smithi162 ceph-mon[30421]: osdmap e171: 8 total, 8 up, 8 in 2024-03-30T12:23:55.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:55 smithi162 ceph-mon[30421]: pgmap v48: 121 pgs: 121 active+clean; 126 MiB data, 562 MiB used, 715 GiB / 715 GiB avail; 2.4 MiB/s rd, 354 KiB/s wr, 5 op/s 2024-03-30T12:23:55.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:55 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:23:55.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:55 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:55.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:55 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:55.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:55 smithi162 ceph-mon[30421]: osdmap e172: 8 total, 8 up, 8 in 2024-03-30T12:23:55.414 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:55.155+0000 7f9536b53200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:23:55.414 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:55.422+0000 7f9536b53200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T12:23:55.415 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:55 smithi084 ceph-mon[27000]: osdmap e171: 8 total, 8 up, 8 in 2024-03-30T12:23:55.415 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:55 smithi084 ceph-mon[27000]: pgmap v48: 121 pgs: 121 active+clean; 126 MiB data, 562 MiB used, 715 GiB / 715 GiB avail; 2.4 MiB/s rd, 354 KiB/s wr, 5 op/s 2024-03-30T12:23:55.415 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:55 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:23:55.415 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:55 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:55.415 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:55 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:55.415 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:55 smithi084 ceph-mon[27000]: osdmap e172: 8 total, 8 up, 8 in 2024-03-30T12:23:55.415 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:55 smithi084 ceph-mon[37565]: osdmap e171: 8 total, 8 up, 8 in 2024-03-30T12:23:55.415 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:55 smithi084 ceph-mon[37565]: pgmap v48: 121 pgs: 121 active+clean; 126 MiB data, 562 MiB used, 715 GiB / 715 GiB avail; 2.4 MiB/s rd, 354 KiB/s wr, 5 op/s 2024-03-30T12:23:55.415 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:55 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:23:55.416 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:55 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:55.416 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:55 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:55.416 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:55 smithi084 ceph-mon[37565]: osdmap e172: 8 total, 8 up, 8 in 2024-03-30T12:23:55.962 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:55.681+0000 7f9536b53200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T12:23:56.074 INFO:tasks.rados.rados.0.smithi084.stdout:556: done (6 left) 2024-03-30T12:23:56.074 INFO:tasks.rados.rados.0.smithi084.stdout:557: read oid 34 snap -1 2024-03-30T12:23:56.074 INFO:tasks.rados.rados.0.smithi084.stdout:557: expect deleted 2024-03-30T12:23:56.074 INFO:tasks.rados.rados.0.smithi084.stdout:558: rmattr oid 47 current snap is 50 2024-03-30T12:23:56.074 INFO:tasks.rados.rados.0.smithi084.stdout:548: finishing write tid 2 to smithi08477944-48 2024-03-30T12:23:56.074 INFO:tasks.rados.rados.0.smithi084.stdout:549: finishing copy_from racing read to smithi08477944-36 2024-03-30T12:23:56.074 INFO:tasks.rados.rados.0.smithi084.stdout:549: finishing copy_from to smithi08477944-36 2024-03-30T12:23:56.074 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 166 (ObjNum 167 snap 45 seq_num 167) dirty exists 2024-03-30T12:23:56.074 INFO:tasks.rados.rados.0.smithi084.stdout:548: finishing write tid 3 to smithi08477944-48 2024-03-30T12:23:56.074 INFO:tasks.rados.rados.0.smithi084.stdout:548: oid 48 updating version 0 to 29 2024-03-30T12:23:56.074 INFO:tasks.rados.rados.0.smithi084.stdout:548: oid 48 version 29 is already newer than 28 2024-03-30T12:23:56.074 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 29 (ObjNum 185 snap 50 seq_num 185) dirty exists 2024-03-30T12:23:56.075 INFO:tasks.rados.rados.0.smithi084.stdout:548: left oid 48 (ObjNum 185 snap 50 seq_num 185) 2024-03-30T12:23:56.075 INFO:tasks.rados.rados.0.smithi084.stdout:550: finishing write tid 1 to smithi08477944-20 2024-03-30T12:23:56.075 INFO:tasks.rados.rados.0.smithi084.stdout:550: finishing write tid 2 to smithi08477944-20 2024-03-30T12:23:56.075 INFO:tasks.rados.rados.0.smithi084.stdout:550: finishing write tid 3 to smithi08477944-20 2024-03-30T12:23:56.075 INFO:tasks.rados.rados.0.smithi084.stdout:550: oid 20 updating version 0 to 319 2024-03-30T12:23:56.075 INFO:tasks.rados.rados.0.smithi084.stdout:550: oid 20 version 319 is already newer than 318 2024-03-30T12:23:56.075 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 319 (ObjNum 186 snap 50 seq_num 186) dirty exists 2024-03-30T12:23:56.075 INFO:tasks.rados.rados.0.smithi084.stdout:550: left oid 20 (ObjNum 186 snap 50 seq_num 186) 2024-03-30T12:23:56.075 INFO:tasks.rados.rados.0.smithi084.stdout:554: expect (ObjNum 29 snap 0 seq_num 29) 2024-03-30T12:23:56.105 INFO:tasks.rados.rados.0.smithi084.stdout:553: finishing write tid 1 to smithi08477944-15 2024-03-30T12:23:56.105 INFO:tasks.rados.rados.0.smithi084.stdout:553: finishing write tid 2 to smithi08477944-15 2024-03-30T12:23:56.105 INFO:tasks.rados.rados.0.smithi084.stdout:548: done (7 left) 2024-03-30T12:23:56.105 INFO:tasks.rados.rados.0.smithi084.stdout:549: done (6 left) 2024-03-30T12:23:56.106 INFO:tasks.rados.rados.0.smithi084.stdout:550: done (5 left) 2024-03-30T12:23:56.106 INFO:tasks.rados.rados.0.smithi084.stdout:554: done (4 left) 2024-03-30T12:23:56.106 INFO:tasks.rados.rados.0.smithi084.stdout:559: delete oid 6 current snap is 50 2024-03-30T12:23:56.106 INFO:tasks.rados.rados.0.smithi084.stdout:553: finishing write tid 3 to smithi08477944-15 2024-03-30T12:23:56.106 INFO:tasks.rados.rados.0.smithi084.stdout:553: oid 15 updating version 0 to 233 2024-03-30T12:23:56.106 INFO:tasks.rados.rados.0.smithi084.stdout:553: oid 15 version 233 is already newer than 232 2024-03-30T12:23:56.106 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 233 (ObjNum 188 snap 50 seq_num 188) dirty exists 2024-03-30T12:23:56.106 INFO:tasks.rados.rados.0.smithi084.stdout:553: left oid 15 (ObjNum 188 snap 50 seq_num 188) 2024-03-30T12:23:56.106 INFO:tasks.rados.rados.0.smithi084.stdout:555: finishing write tid 1 to smithi08477944-7 2024-03-30T12:23:56.106 INFO:tasks.rados.rados.0.smithi084.stdout:555: finishing write tid 2 to smithi08477944-7 2024-03-30T12:23:56.106 INFO:tasks.rados.rados.0.smithi084.stdout:555: finishing write tid 3 to smithi08477944-7 2024-03-30T12:23:56.106 INFO:tasks.rados.rados.0.smithi084.stdout:555: oid 7 updating version 0 to 328 2024-03-30T12:23:56.106 INFO:tasks.rados.rados.0.smithi084.stdout:555: oid 7 version 328 is already newer than 327 2024-03-30T12:23:56.106 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 328 (ObjNum 189 snap 50 seq_num 189) dirty exists 2024-03-30T12:23:56.106 INFO:tasks.rados.rados.0.smithi084.stdout:555: left oid 7 (ObjNum 189 snap 50 seq_num 189) 2024-03-30T12:23:56.107 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 329 (ObjNum 140 snap 34 seq_num 140) dirty exists 2024-03-30T12:23:56.107 INFO:tasks.rados.rados.0.smithi084.stdout:553: done (4 left) 2024-03-30T12:23:56.107 INFO:tasks.rados.rados.0.smithi084.stdout:555: done (3 left) 2024-03-30T12:23:56.107 INFO:tasks.rados.rados.0.smithi084.stdout:557: done (2 left) 2024-03-30T12:23:56.107 INFO:tasks.rados.rados.0.smithi084.stdout:558: done (1 left) 2024-03-30T12:23:56.107 INFO:tasks.rados.rados.0.smithi084.stdout:559: done (0 left) 2024-03-30T12:23:56.107 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 50 2024-03-30T12:23:56.108 INFO:tasks.rados.rados.0.smithi084.stdout:560: seq_num 191 ranges {0=802816} 2024-03-30T12:23:56.112 INFO:tasks.rados.rados.0.smithi084.stdout:560: writing smithi08477944-4 from 0 to 802816 tid 1 2024-03-30T12:23:56.112 INFO:tasks.rados.rados.0.smithi084.stdout:561: read oid 11 snap -1 2024-03-30T12:23:56.112 INFO:tasks.rados.rados.0.smithi084.stdout:561: expect deleted 2024-03-30T12:23:56.112 INFO:tasks.rados.rados.0.smithi084.stdout:562: read oid 42 snap 46 2024-03-30T12:23:56.112 INFO:tasks.rados.rados.0.smithi084.stdout:562: expect deleted 2024-03-30T12:23:56.112 INFO:tasks.rados.rados.0.smithi084.stdout:563: setattr oid 18 current snap is 50 2024-03-30T12:23:56.113 INFO:tasks.rados.rados.0.smithi084.stdout:561: done (3 left) 2024-03-30T12:23:56.113 INFO:tasks.rados.rados.0.smithi084.stdout:562: done (2 left) 2024-03-30T12:23:56.113 INFO:tasks.rados.rados.0.smithi084.stdout:564: snap_remove snap 45 2024-03-30T12:23:56.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:56 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:56.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:56 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:56.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:56 smithi084 ceph-mon[37565]: osdmap e173: 8 total, 8 up, 8 in 2024-03-30T12:23:56.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:56 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:56.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:56 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:56.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:56 smithi084 ceph-mon[27000]: osdmap e173: 8 total, 8 up, 8 in 2024-03-30T12:23:56.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:56 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:56.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:56 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:56.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:56 smithi162 ceph-mon[30421]: osdmap e173: 8 total, 8 up, 8 in 2024-03-30T12:23:56.942 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:56.522+0000 7f9536b53200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T12:23:57.105 INFO:tasks.rados.rados.0.smithi084.stdout:564: done (2 left) 2024-03-30T12:23:57.105 INFO:tasks.rados.rados.0.smithi084.stdout:565: delete oid 41 current snap is 50 2024-03-30T12:23:57.105 INFO:tasks.rados.rados.0.smithi084.stdout:560: finishing write tid 1 to smithi08477944-4 2024-03-30T12:23:57.105 INFO:tasks.rados.rados.0.smithi084.stdout:560: finishing write tid 2 to smithi08477944-4 2024-03-30T12:23:57.105 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 343 (ObjNum 168 snap 46 seq_num 168) dirty exists 2024-03-30T12:23:57.105 INFO:tasks.rados.rados.0.smithi084.stdout:560: finishing write tid 3 to smithi08477944-4 2024-03-30T12:23:57.105 INFO:tasks.rados.rados.0.smithi084.stdout:560: oid 4 updating version 0 to 227 2024-03-30T12:23:57.106 INFO:tasks.rados.rados.0.smithi084.stdout:560: oid 4 updating version 227 to 228 2024-03-30T12:23:57.106 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 228 (ObjNum 191 snap 50 seq_num 191) dirty exists 2024-03-30T12:23:57.106 INFO:tasks.rados.rados.0.smithi084.stdout:560: left oid 4 (ObjNum 191 snap 50 seq_num 191) 2024-03-30T12:23:57.115 INFO:tasks.rados.rados.0.smithi084.stdout:560: done (2 left) 2024-03-30T12:23:57.115 INFO:tasks.rados.rados.0.smithi084.stdout:563: done (1 left) 2024-03-30T12:23:57.115 INFO:tasks.rados.rados.0.smithi084.stdout:565: done (0 left) 2024-03-30T12:23:57.115 INFO:tasks.rados.rados.0.smithi084.stdout:566: snap_create 2024-03-30T12:23:57.217 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:57.112+0000 7f9536b53200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T12:23:57.217 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:57 smithi084 ceph-mon[27000]: pgmap v50: 121 pgs: 121 active+clean; 106 MiB data, 583 MiB used, 715 GiB / 715 GiB avail; 4.7 MiB/s rd, 2.1 MiB/s wr, 26 op/s 2024-03-30T12:23:57.217 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:57 smithi084 ceph-mon[37565]: pgmap v50: 121 pgs: 121 active+clean; 106 MiB data, 583 MiB used, 715 GiB / 715 GiB avail; 4.7 MiB/s rd, 2.1 MiB/s wr, 26 op/s 2024-03-30T12:23:57.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:57 smithi162 ceph-mon[30421]: pgmap v50: 121 pgs: 121 active+clean; 106 MiB data, 583 MiB used, 715 GiB / 715 GiB avail; 4.7 MiB/s rd, 2.1 MiB/s wr, 26 op/s 2024-03-30T12:23:57.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:57.225+0000 7f9536b53200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T12:23:57.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:57.451+0000 7f9536b53200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T12:23:57.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:23:57] ENGINE Bus STARTING 2024-03-30T12:23:58.004 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: CherryPy Checker: 2024-03-30T12:23:58.004 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: The Application mounted at '' has an empty config. 2024-03-30T12:23:58.004 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:58.004 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:23:57] ENGINE Serving on http://:::9283 2024-03-30T12:23:58.004 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:23:57] ENGINE Bus STARTED 2024-03-30T12:23:58.114 INFO:tasks.rados.rados.0.smithi084.stdout:566: done (0 left) 2024-03-30T12:23:58.114 INFO:tasks.rados.rados.0.smithi084.stdout:567: setattr oid 43 current snap is 51 2024-03-30T12:23:58.115 INFO:tasks.rados.rados.0.smithi084.stdout:568: snap_remove snap 46 2024-03-30T12:23:58.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:58 smithi162 ceph-mon[30421]: osdmap e174: 8 total, 8 up, 8 in 2024-03-30T12:23:58.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:58 smithi162 ceph-mon[30421]: Standby manager daemon y restarted 2024-03-30T12:23:58.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:58 smithi162 ceph-mon[30421]: Standby manager daemon y started 2024-03-30T12:23:58.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:58 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-30T12:23:58.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:58 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T12:23:58.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:58 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-30T12:23:58.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:58 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T12:23:58.374 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:58 smithi084 ceph-mon[27000]: osdmap e174: 8 total, 8 up, 8 in 2024-03-30T12:23:58.374 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:58 smithi084 ceph-mon[27000]: Standby manager daemon y restarted 2024-03-30T12:23:58.374 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:58 smithi084 ceph-mon[27000]: Standby manager daemon y started 2024-03-30T12:23:58.374 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:58 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-30T12:23:58.374 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:58 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T12:23:58.377 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:58 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-30T12:23:58.378 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:58 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T12:23:58.378 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:58 smithi084 ceph-mon[37565]: osdmap e174: 8 total, 8 up, 8 in 2024-03-30T12:23:58.378 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:58 smithi084 ceph-mon[37565]: Standby manager daemon y restarted 2024-03-30T12:23:58.378 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:58 smithi084 ceph-mon[37565]: Standby manager daemon y started 2024-03-30T12:23:58.378 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:58 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-30T12:23:58.378 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:58 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T12:23:58.378 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:58 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-30T12:23:58.378 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:58 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T12:23:58.955 INFO:tasks.rados.rados.0.smithi084.stdout:568: done (1 left) 2024-03-30T12:23:58.955 INFO:tasks.rados.rados.0.smithi084.stdout:569: read oid 21 snap -1 2024-03-30T12:23:58.955 INFO:tasks.rados.rados.0.smithi084.stdout:569: expect (ObjNum 176 snap 49 seq_num 176) 2024-03-30T12:23:58.955 INFO:tasks.rados.rados.0.smithi084.stdout:570: rmattr oid 5 current snap is 51 2024-03-30T12:23:58.955 INFO:tasks.rados.rados.0.smithi084.stdout:570: done (2 left) 2024-03-30T12:23:58.955 INFO:tasks.rados.rados.0.smithi084.stdout:571: rollback oid 35 current snap is 51 2024-03-30T12:23:58.955 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 35 to 50 2024-03-30T12:23:58.955 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 189 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-03-30T12:23:58.956 INFO:tasks.rados.rados.0.smithi084.stdout:567: done (2 left) 2024-03-30T12:23:58.956 INFO:tasks.rados.rados.0.smithi084.stdout:572: rollback oid 46 current snap is 51 2024-03-30T12:23:58.956 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 46 to 50 2024-03-30T12:23:58.956 INFO:tasks.rados.rados.0.smithi084.stdout:573: rollback oid 37 current snap is 51 2024-03-30T12:23:58.956 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 37 to 50 2024-03-30T12:23:58.956 INFO:tasks.rados.rados.0.smithi084.stdout:574: snap_create 2024-03-30T12:23:58.965 INFO:tasks.rados.rados.0.smithi084.stdout:571: finishing rollback tid 0 to smithi08477944-35 2024-03-30T12:23:58.966 INFO:tasks.rados.rados.0.smithi084.stdout:573: finishing rollback tid 0 to smithi08477944-37 2024-03-30T12:23:58.967 INFO:tasks.rados.rados.0.smithi084.stdout:573: finishing rollback tid 1 to smithi08477944-37 2024-03-30T12:23:58.967 INFO:tasks.rados.rados.0.smithi084.stdout:573: finishing rollback tid 2 to smithi08477944-37 2024-03-30T12:23:58.967 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 261 (ObjNum 183 snap 50 seq_num 183) dirty exists 2024-03-30T12:23:58.968 INFO:tasks.rados.rados.0.smithi084.stdout:571: finishing rollback tid 1 to smithi08477944-35 2024-03-30T12:23:58.968 INFO:tasks.rados.rados.0.smithi084.stdout:572: finishing rollback tid 0 to smithi08477944-46 2024-03-30T12:23:58.968 INFO:tasks.rados.rados.0.smithi084.stdout:572: finishing rollback tid 1 to smithi08477944-46 2024-03-30T12:23:58.968 INFO:tasks.rados.rados.0.smithi084.stdout:572: finishing rollback tid 2 to smithi08477944-46 2024-03-30T12:23:58.968 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 309 (ObjNum 107 snap 22 seq_num 107) dirty exists 2024-03-30T12:23:58.970 INFO:tasks.rados.rados.0.smithi084.stdout:571: finishing rollback tid 2 to smithi08477944-35 2024-03-30T12:23:58.970 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 186 (ObjNum 150 snap 40 seq_num 150) dirty exists 2024-03-30T12:23:58.970 INFO:tasks.rados.rados.0.smithi084.stdout:569: expect (ObjNum 176 snap 49 seq_num 176) 2024-03-30T12:23:59.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: pgmap v53: 121 pgs: 121 active+clean; 106 MiB data, 583 MiB used, 715 GiB / 715 GiB avail; 4.7 MiB/s rd, 2.1 MiB/s wr, 26 op/s 2024-03-30T12:23:59.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: osdmap e175: 8 total, 8 up, 8 in 2024-03-30T12:23:59.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: mgrmap e29: x(active, since 34s), standbys: y 2024-03-30T12:23:59.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:59.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:59.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:23:59.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:23:59.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:59.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:59.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-03-30T12:23:59.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-03-30T12:23:59.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: osdmap e176: 8 total, 8 up, 8 in 2024-03-30T12:23:59.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.24793 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-03-30T12:23:59.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: mgrmap e30: y(active, starting, since 0.0113237s) 2024-03-30T12:23:59.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:23:59.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:23:59.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:23:59.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-30T12:23:59.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-30T12:23:59.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T12:23:59.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:23:59.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:23:59.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:23:59.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:23:59.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:23:59.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:23:59.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:23:59.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:23:59.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T12:23:59.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T12:23:59.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: pgmap v53: 121 pgs: 121 active+clean; 106 MiB data, 583 MiB used, 715 GiB / 715 GiB avail; 4.7 MiB/s rd, 2.1 MiB/s wr, 26 op/s 2024-03-30T12:23:59.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: osdmap e175: 8 total, 8 up, 8 in 2024-03-30T12:23:59.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: mgrmap e29: x(active, since 34s), standbys: y 2024-03-30T12:23:59.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:59.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:59.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:23:59.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:23:59.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:59.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:59.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-03-30T12:23:59.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-03-30T12:23:59.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: osdmap e176: 8 total, 8 up, 8 in 2024-03-30T12:23:59.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.24793 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-03-30T12:23:59.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: mgrmap e30: y(active, starting, since 0.0113237s) 2024-03-30T12:23:59.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:23:59.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:23:59.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:23:59.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-30T12:23:59.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-30T12:23:59.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T12:23:59.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:23:59.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:23:59.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:23:59.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:23:59.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:23:59.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:23:59.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:23:59.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:23:59.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T12:23:59.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T12:23:59.259 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T12:23:59.259 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: Manager daemon y is now available 2024-03-30T12:23:59.259 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:59.259 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:59.259 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:23:59.259 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T12:23:59.259 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T12:23:59.260 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T12:23:59.260 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: Manager daemon y is now available 2024-03-30T12:23:59.260 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:59.260 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:59.260 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:23:59.260 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T12:23:59.260 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T12:23:59.260 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:23:58] ENGINE Bus STOPPING 2024-03-30T12:23:59.260 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:23:58] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T12:23:59.261 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:23:58] ENGINE Bus STOPPED 2024-03-30T12:23:59.261 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:23:59] ENGINE Bus STARTING 2024-03-30T12:23:59.261 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:59.114+0000 7f9497037700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:23:59.261 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:59.114+0000 7f9497037700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:23:59.261 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:59.114+0000 7f9497037700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:23:59.261 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:59.114+0000 7f9497037700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:23:59.261 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:59.114+0000 7f9497037700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:23:59.261 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:59.115+0000 7f9494832700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:23:59.261 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:59.115+0000 7f9494832700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:23:59.261 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:59.115+0000 7f9494832700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:23:59.261 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:59.115+0000 7f9494832700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:23:59.261 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:23:59.116+0000 7f9494832700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:23:59.261 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:23:59] ENGINE Serving on http://:::9283 2024-03-30T12:23:59.261 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:23:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:23:59] ENGINE Bus STARTED 2024-03-30T12:23:59.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: ignoring --setuser ceph since I am not root 2024-03-30T12:23:59.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: ignoring --setgroup ceph since I am not root 2024-03-30T12:23:59.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mgr[63663]: -- 172.21.15.162:0/2874976278 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fc4632a5a0 con 0x55fc462fe800 2024-03-30T12:23:59.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: pgmap v53: 121 pgs: 121 active+clean; 106 MiB data, 583 MiB used, 715 GiB / 715 GiB avail; 4.7 MiB/s rd, 2.1 MiB/s wr, 26 op/s 2024-03-30T12:23:59.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: osdmap e175: 8 total, 8 up, 8 in 2024-03-30T12:23:59.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: mgrmap e29: x(active, since 34s), standbys: y 2024-03-30T12:23:59.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:59.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:59.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:23:59.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:23:59.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' 2024-03-30T12:23:59.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:59.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.24793 172.21.15.162:0/3796778071' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-03-30T12:23:59.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-03-30T12:23:59.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: osdmap e176: 8 total, 8 up, 8 in 2024-03-30T12:23:59.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.24793 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-03-30T12:23:59.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: mgrmap e30: y(active, starting, since 0.0113237s) 2024-03-30T12:23:59.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:23:59.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:23:59.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:23:59.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-30T12:23:59.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-30T12:23:59.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T12:23:59.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:23:59.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:23:59.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:23:59.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:23:59.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:23:59.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:23:59.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:23:59.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:23:59.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T12:23:59.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T12:23:59.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T12:23:59.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: Manager daemon y is now available 2024-03-30T12:23:59.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:59.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:23:59.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:23:59.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T12:23:59.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T12:23:59.869 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:59.588+0000 7f995f203200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T12:23:59.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:23:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:23:59.684+0000 7f995f203200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T12:23:59.965 INFO:tasks.rados.rados.0.smithi084.stdout:569: done (4 left) 2024-03-30T12:23:59.965 INFO:tasks.rados.rados.0.smithi084.stdout:571: done (3 left) 2024-03-30T12:23:59.965 INFO:tasks.rados.rados.0.smithi084.stdout:572: done (2 left) 2024-03-30T12:23:59.965 INFO:tasks.rados.rados.0.smithi084.stdout:573: done (1 left) 2024-03-30T12:23:59.965 INFO:tasks.rados.rados.0.smithi084.stdout:574: done (0 left) 2024-03-30T12:23:59.965 INFO:tasks.rados.rados.0.smithi084.stdout:575: copy_from oid 32 from oid 6 current snap is 52 2024-03-30T12:23:59.965 INFO:tasks.rados.rados.0.smithi084.stdout:576: rollback oid 1 current snap is 52 2024-03-30T12:23:59.965 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 1 to 50 2024-03-30T12:23:59.965 INFO:tasks.rados.rados.0.smithi084.stdout:577: setattr oid 50 current snap is 52 2024-03-30T12:23:59.966 INFO:tasks.rados.rados.0.smithi084.stdout:575: finishing copy_from to smithi08477944-32 2024-03-30T12:23:59.966 INFO:tasks.rados.rados.0.smithi084.stdout:575: got expected ENOENT (src dne) 2024-03-30T12:23:59.966 INFO:tasks.rados.rados.0.smithi084.stdout:578: delete oid 37 current snap is 52 2024-03-30T12:23:59.966 INFO:tasks.rados.rados.0.smithi084.stdout:575: finishing copy_from racing read to smithi08477944-32 2024-03-30T12:23:59.969 INFO:tasks.rados.rados.0.smithi084.stdout:576: finishing rollback tid 0 to smithi08477944-1 2024-03-30T12:23:59.969 INFO:tasks.rados.rados.0.smithi084.stdout:576: finishing rollback tid 1 to smithi08477944-1 2024-03-30T12:23:59.970 INFO:tasks.rados.rados.0.smithi084.stdout:576: finishing rollback tid 2 to smithi08477944-1 2024-03-30T12:23:59.970 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 189 (ObjNum 86 snap 21 seq_num 86) dirty exists 2024-03-30T12:23:59.970 INFO:tasks.rados.rados.0.smithi084.stdout:575: done (3 left) 2024-03-30T12:23:59.970 INFO:tasks.rados.rados.0.smithi084.stdout:576: done (2 left) 2024-03-30T12:23:59.970 INFO:tasks.rados.rados.0.smithi084.stdout:578: done (1 left) 2024-03-30T12:23:59.970 INFO:tasks.rados.rados.0.smithi084.stdout:579: snap_create 2024-03-30T12:23:59.971 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 353 (ObjNum 116 snap 26 seq_num 116) dirty exists 2024-03-30T12:24:00.048 INFO:tasks.rados.rados.0.smithi084.stdout:577: done (1 left) 2024-03-30T12:24:00.048 INFO:tasks.rados.rados.0.smithi084.stdout:579: done (0 left) 2024-03-30T12:24:00.048 INFO:tasks.rados.rados.0.smithi084.stdout:580: delete oid 9 current snap is 53 2024-03-30T12:24:00.055 INFO:tasks.rados.rados.0.smithi084.stdout:580: done (0 left) 2024-03-30T12:24:00.055 INFO:tasks.rados.rados.0.smithi084.stdout:581: snap_create 2024-03-30T12:24:00.465 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:24:00.377+0000 7f995f203200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T12:24:00.465 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:24:00.473+0000 7f995f203200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T12:24:00.724 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:24:00.622+0000 7f995f203200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T12:24:00.724 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:24:00.732+0000 7f995f203200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T12:24:00.989 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:24:00.815+0000 7f995f203200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T12:24:00.989 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:00 smithi162 ceph-mon[30421]: [30/Mar/2024:12:23:59] ENGINE Bus STARTING 2024-03-30T12:24:00.989 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:00 smithi162 ceph-mon[30421]: [30/Mar/2024:12:23:59] ENGINE Serving on https://172.21.15.84:7150 2024-03-30T12:24:00.989 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:00 smithi162 ceph-mon[30421]: [30/Mar/2024:12:23:59] ENGINE Serving on http://172.21.15.84:8765 2024-03-30T12:24:00.989 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:00 smithi162 ceph-mon[30421]: [30/Mar/2024:12:23:59] ENGINE Bus STARTED 2024-03-30T12:24:00.989 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:00 smithi162 ceph-mon[30421]: mgrmap e31: y(active, since 1.01203s) 2024-03-30T12:24:00.989 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:00 smithi162 ceph-mon[30421]: osdmap e177: 8 total, 8 up, 8 in 2024-03-30T12:24:00.989 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:00 smithi162 ceph-mon[30421]: pgmap v4: 121 pgs: 121 active+clean; 53 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 90 GiB/s rd, 40 GiB/s wr, 703.49k op/s; 391 MiB/s, 1.39k objects/s recovering 2024-03-30T12:24:00.989 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:00 smithi162 ceph-mon[30421]: osdmap e178: 8 total, 8 up, 8 in 2024-03-30T12:24:01.054 INFO:tasks.rados.rados.0.smithi084.stdout:581: done (0 left) 2024-03-30T12:24:01.055 INFO:tasks.rados.rados.0.smithi084.stdout:582: rmattr oid 13 current snap is 54 2024-03-30T12:24:01.055 INFO:tasks.rados.rados.0.smithi084.stdout:582: done (0 left) 2024-03-30T12:24:01.055 INFO:tasks.rados.rados.0.smithi084.stdout:583: snap_create 2024-03-30T12:24:01.139 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:00 smithi084 ceph-mon[27000]: [30/Mar/2024:12:23:59] ENGINE Bus STARTING 2024-03-30T12:24:01.139 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:00 smithi084 ceph-mon[27000]: [30/Mar/2024:12:23:59] ENGINE Serving on https://172.21.15.84:7150 2024-03-30T12:24:01.139 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:00 smithi084 ceph-mon[27000]: [30/Mar/2024:12:23:59] ENGINE Serving on http://172.21.15.84:8765 2024-03-30T12:24:01.139 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:00 smithi084 ceph-mon[27000]: [30/Mar/2024:12:23:59] ENGINE Bus STARTED 2024-03-30T12:24:01.139 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:00 smithi084 ceph-mon[27000]: mgrmap e31: y(active, since 1.01203s) 2024-03-30T12:24:01.139 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:00 smithi084 ceph-mon[27000]: osdmap e177: 8 total, 8 up, 8 in 2024-03-30T12:24:01.139 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:00 smithi084 ceph-mon[27000]: pgmap v4: 121 pgs: 121 active+clean; 53 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 90 GiB/s rd, 40 GiB/s wr, 703.49k op/s; 391 MiB/s, 1.39k objects/s recovering 2024-03-30T12:24:01.139 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:00 smithi084 ceph-mon[27000]: osdmap e178: 8 total, 8 up, 8 in 2024-03-30T12:24:01.140 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:00 smithi084 ceph-mon[37565]: [30/Mar/2024:12:23:59] ENGINE Bus STARTING 2024-03-30T12:24:01.140 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:00 smithi084 ceph-mon[37565]: [30/Mar/2024:12:23:59] ENGINE Serving on https://172.21.15.84:7150 2024-03-30T12:24:01.140 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:00 smithi084 ceph-mon[37565]: [30/Mar/2024:12:23:59] ENGINE Serving on http://172.21.15.84:8765 2024-03-30T12:24:01.140 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:00 smithi084 ceph-mon[37565]: [30/Mar/2024:12:23:59] ENGINE Bus STARTED 2024-03-30T12:24:01.140 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:00 smithi084 ceph-mon[37565]: mgrmap e31: y(active, since 1.01203s) 2024-03-30T12:24:01.140 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:00 smithi084 ceph-mon[37565]: osdmap e177: 8 total, 8 up, 8 in 2024-03-30T12:24:01.140 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:00 smithi084 ceph-mon[37565]: pgmap v4: 121 pgs: 121 active+clean; 53 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 90 GiB/s rd, 40 GiB/s wr, 703.49k op/s; 391 MiB/s, 1.39k objects/s recovering 2024-03-30T12:24:01.140 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:00 smithi084 ceph-mon[37565]: osdmap e178: 8 total, 8 up, 8 in 2024-03-30T12:24:01.291 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:24:01.097+0000 7f995f203200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T12:24:01.292 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:24:01.211+0000 7f995f203200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T12:24:01.292 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:24:01.299+0000 7f995f203200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T12:24:01.608 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:24:01.408+0000 7f995f203200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T12:24:01.609 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:24:01.616+0000 7f995f203200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T12:24:02.055 INFO:tasks.rados.rados.0.smithi084.stdout:583: done (0 left) 2024-03-30T12:24:02.055 INFO:tasks.rados.rados.0.smithi084.stdout:584: copy_from oid 43 from oid 39 current snap is 55 2024-03-30T12:24:02.055 INFO:tasks.rados.rados.0.smithi084.stdout:585: delete oid 49 current snap is 55 2024-03-30T12:24:02.064 INFO:tasks.rados.rados.0.smithi084.stdout:585: done (1 left) 2024-03-30T12:24:02.064 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 55 2024-03-30T12:24:02.064 INFO:tasks.rados.rados.0.smithi084.stdout:586: seq_num 196 ranges {761856=491520,1253376=401408} 2024-03-30T12:24:02.071 INFO:tasks.rados.rados.0.smithi084.stdout:586: writing smithi08477944-23 from 761856 to 1253376 tid 1 2024-03-30T12:24:02.074 INFO:tasks.rados.rados.0.smithi084.stdout:586: writing smithi08477944-23 from 1253376 to 1654784 tid 2 2024-03-30T12:24:02.074 INFO:tasks.rados.rados.0.smithi084.stdout:587: rollback oid 3 current snap is 55 2024-03-30T12:24:02.074 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 3 to 52 2024-03-30T12:24:02.074 INFO:tasks.rados.rados.0.smithi084.stdout:584: finishing copy_from racing read to smithi08477944-43 2024-03-30T12:24:02.074 INFO:tasks.rados.rados.0.smithi084.stdout:584: finishing copy_from to smithi08477944-43 2024-03-30T12:24:02.074 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 88 (ObjNum 136 snap 32 seq_num 136) dirty exists 2024-03-30T12:24:02.075 INFO:tasks.rados.rados.0.smithi084.stdout:584: done (2 left) 2024-03-30T12:24:02.075 INFO:tasks.rados.rados.0.smithi084.stdout:588: snap_create 2024-03-30T12:24:02.076 INFO:tasks.rados.rados.0.smithi084.stdout:586: finishing write tid 1 to smithi08477944-23 2024-03-30T12:24:02.076 INFO:tasks.rados.rados.0.smithi084.stdout:586: finishing write tid 2 to smithi08477944-23 2024-03-30T12:24:02.076 INFO:tasks.rados.rados.0.smithi084.stdout:586: finishing write tid 3 to smithi08477944-23 2024-03-30T12:24:02.078 INFO:tasks.rados.rados.0.smithi084.stdout:586: finishing write tid 4 to smithi08477944-23 2024-03-30T12:24:02.078 INFO:tasks.rados.rados.0.smithi084.stdout:586: oid 23 updating version 0 to 272 2024-03-30T12:24:02.078 INFO:tasks.rados.rados.0.smithi084.stdout:586: oid 23 updating version 272 to 273 2024-03-30T12:24:02.078 INFO:tasks.rados.rados.0.smithi084.stdout:586: oid 23 updating version 273 to 274 2024-03-30T12:24:02.078 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 274 (ObjNum 196 snap 55 seq_num 196) dirty exists 2024-03-30T12:24:02.078 INFO:tasks.rados.rados.0.smithi084.stdout:586: left oid 23 (ObjNum 196 snap 55 seq_num 196) 2024-03-30T12:24:02.079 INFO:tasks.rados.rados.0.smithi084.stdout:587: finishing rollback tid 0 to smithi08477944-3 2024-03-30T12:24:02.079 INFO:tasks.rados.rados.0.smithi084.stdout:587: finishing rollback tid 1 to smithi08477944-3 2024-03-30T12:24:02.079 INFO:tasks.rados.rados.0.smithi084.stdout:587: finishing rollback tid 2 to smithi08477944-3 2024-03-30T12:24:02.079 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 315 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-03-30T12:24:02.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:02 smithi084 ceph-mon[37565]: pgmap v6: 121 pgs: 121 active+clean; 53 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 400 MiB/s rd, 179 MiB/s wr, 3.04k op/s; 1.7 MiB/s, 6 objects/s recovering 2024-03-30T12:24:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:02 smithi084 ceph-mon[37565]: osdmap e179: 8 total, 8 up, 8 in 2024-03-30T12:24:02.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:02 smithi084 ceph-mon[27000]: pgmap v6: 121 pgs: 121 active+clean; 53 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 400 MiB/s rd, 179 MiB/s wr, 3.04k op/s; 1.7 MiB/s, 6 objects/s recovering 2024-03-30T12:24:02.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:02 smithi084 ceph-mon[27000]: osdmap e179: 8 total, 8 up, 8 in 2024-03-30T12:24:02.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:02 smithi162 ceph-mon[30421]: pgmap v6: 121 pgs: 121 active+clean; 53 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 400 MiB/s rd, 179 MiB/s wr, 3.04k op/s; 1.7 MiB/s, 6 objects/s recovering 2024-03-30T12:24:02.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:02 smithi162 ceph-mon[30421]: osdmap e179: 8 total, 8 up, 8 in 2024-03-30T12:24:02.869 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:24:02.643+0000 7f995f203200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T12:24:02.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:24:02.781+0000 7f995f203200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T12:24:03.069 INFO:tasks.rados.rados.0.smithi084.stdout:586: done (2 left) 2024-03-30T12:24:03.069 INFO:tasks.rados.rados.0.smithi084.stdout:587: done (1 left) 2024-03-30T12:24:03.069 INFO:tasks.rados.rados.0.smithi084.stdout:588: done (0 left) 2024-03-30T12:24:03.069 INFO:tasks.rados.rados.0.smithi084.stdout:589: read oid 42 snap -1 2024-03-30T12:24:03.069 INFO:tasks.rados.rados.0.smithi084.stdout:589: expect deleted 2024-03-30T12:24:03.069 INFO:tasks.rados.rados.0.smithi084.stdout:590: read oid 24 snap -1 2024-03-30T12:24:03.069 INFO:tasks.rados.rados.0.smithi084.stdout:590: expect (ObjNum 23 snap 0 seq_num 23) 2024-03-30T12:24:03.070 INFO:tasks.rados.rados.0.smithi084.stdout:591: snap_create 2024-03-30T12:24:03.073 INFO:tasks.rados.rados.0.smithi084.stdout:590: expect (ObjNum 23 snap 0 seq_num 23) 2024-03-30T12:24:03.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:03 smithi084 ceph-mon[37565]: osdmap e180: 8 total, 8 up, 8 in 2024-03-30T12:24:03.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:03 smithi084 ceph-mon[37565]: mgrmap e32: y(active, since 3s) 2024-03-30T12:24:03.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:03 smithi084 ceph-mon[27000]: osdmap e180: 8 total, 8 up, 8 in 2024-03-30T12:24:03.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:03 smithi084 ceph-mon[27000]: mgrmap e32: y(active, since 3s) 2024-03-30T12:24:03.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:03 smithi162 ceph-mon[30421]: osdmap e180: 8 total, 8 up, 8 in 2024-03-30T12:24:03.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:03 smithi162 ceph-mon[30421]: mgrmap e32: y(active, since 3s) 2024-03-30T12:24:03.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:24:03.146+0000 7f995f203200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T12:24:03.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:24:03.236+0000 7f995f203200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T12:24:03.869 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:24:03.438+0000 7f995f203200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:24:03.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:24:03.628+0000 7f995f203200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T12:24:04.074 INFO:tasks.rados.rados.0.smithi084.stdout:589: done (2 left) 2024-03-30T12:24:04.074 INFO:tasks.rados.rados.0.smithi084.stdout:590: done (1 left) 2024-03-30T12:24:04.074 INFO:tasks.rados.rados.0.smithi084.stdout:591: done (0 left) 2024-03-30T12:24:04.074 INFO:tasks.rados.rados.0.smithi084.stdout:592: delete oid 10 current snap is 57 2024-03-30T12:24:04.080 INFO:tasks.rados.rados.0.smithi084.stdout:592: done (0 left) 2024-03-30T12:24:04.080 INFO:tasks.rados.rados.0.smithi084.stdout:593: snap_create 2024-03-30T12:24:04.204 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:24:03.932+0000 7f995f203200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:24:04.204 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:24:04.212+0000 7f995f203200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T12:24:04.204 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:04 smithi162 ceph-mon[30421]: pgmap v9: 121 pgs: 121 active+clean; 53 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 133 MiB/s rd, 60 MiB/s wr, 1.01k op/s; 577 KiB/s, 2 objects/s recovering 2024-03-30T12:24:04.204 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:04 smithi162 ceph-mon[30421]: osdmap e181: 8 total, 8 up, 8 in 2024-03-30T12:24:04.204 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:04 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:04.204 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:04 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:04.204 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:04 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:04.204 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:04 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:04.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:04 smithi084 ceph-mon[37565]: pgmap v9: 121 pgs: 121 active+clean; 53 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 133 MiB/s rd, 60 MiB/s wr, 1.01k op/s; 577 KiB/s, 2 objects/s recovering 2024-03-30T12:24:04.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:04 smithi084 ceph-mon[37565]: osdmap e181: 8 total, 8 up, 8 in 2024-03-30T12:24:04.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:04 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:04.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:04 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:04.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:04 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:04.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:04 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:04.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:04 smithi084 ceph-mon[27000]: pgmap v9: 121 pgs: 121 active+clean; 53 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 133 MiB/s rd, 60 MiB/s wr, 1.01k op/s; 577 KiB/s, 2 objects/s recovering 2024-03-30T12:24:04.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:04 smithi084 ceph-mon[27000]: osdmap e181: 8 total, 8 up, 8 in 2024-03-30T12:24:04.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:04 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:04.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:04 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:04.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:04 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:04.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:04 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:04.869 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:24:04.476+0000 7f995f203200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T12:24:05.080 INFO:tasks.rados.rados.0.smithi084.stdout:593: done (0 left) 2024-03-30T12:24:05.080 INFO:tasks.rados.rados.0.smithi084.stdout:594: read oid 17 snap -1 2024-03-30T12:24:05.080 INFO:tasks.rados.rados.0.smithi084.stdout:594: expect (ObjNum 55 snap 3 seq_num 55) 2024-03-30T12:24:05.080 INFO:tasks.rados.rados.0.smithi084.stdout:595: rollback oid 6 current snap is 58 2024-03-30T12:24:05.080 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 6 to 53 2024-03-30T12:24:05.080 INFO:tasks.rados.rados.0.smithi084.stdout:596: read oid 27 snap 57 2024-03-30T12:24:05.080 INFO:tasks.rados.rados.0.smithi084.stdout:596: expect (ObjNum 56 snap 4 seq_num 56) 2024-03-30T12:24:05.080 INFO:tasks.rados.rados.0.smithi084.stdout:597: copy_from oid 11 from oid 8 current snap is 58 2024-03-30T12:24:05.081 INFO:tasks.rados.rados.0.smithi084.stdout:598: copy_from oid 13 from oid 12 current snap is 58 2024-03-30T12:24:05.081 INFO:tasks.rados.rados.0.smithi084.stdout:599: setattr oid 45 current snap is 58 2024-03-30T12:24:05.082 INFO:tasks.rados.rados.0.smithi084.stdout:600: rollback oid 29 current snap is 58 2024-03-30T12:24:05.082 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 29 to 57 2024-03-30T12:24:05.082 INFO:tasks.rados.rados.0.smithi084.stdout:601: copy_from oid 24 from oid 21 current snap is 58 2024-03-30T12:24:05.082 INFO:tasks.rados.rados.0.smithi084.stdout:602: read oid 32 snap -1 2024-03-30T12:24:05.082 INFO:tasks.rados.rados.0.smithi084.stdout:602: expect deleted 2024-03-30T12:24:05.082 INFO:tasks.rados.rados.0.smithi084.stdout:603: copy_from oid 1 from oid 36 current snap is 58 2024-03-30T12:24:05.082 INFO:tasks.rados.rados.0.smithi084.stdout:604: delete oid 5 current snap is 58 2024-03-30T12:24:05.084 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:05 smithi084 ceph-mon[27000]: osdmap e182: 8 total, 8 up, 8 in 2024-03-30T12:24:05.085 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:05 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:05.085 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:05 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:05.085 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:05 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:05.085 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:05 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:05.086 INFO:tasks.rados.rados.0.smithi084.stdout:602: done (10 left) 2024-03-30T12:24:05.087 INFO:tasks.rados.rados.0.smithi084.stdout:604: done (9 left) 2024-03-30T12:24:05.087 INFO:tasks.rados.rados.0.smithi084.stdout:605: read oid 41 snap -1 2024-03-30T12:24:05.087 INFO:tasks.rados.rados.0.smithi084.stdout:605: expect deleted 2024-03-30T12:24:05.087 INFO:tasks.rados.rados.0.smithi084.stdout:606: read oid 39 snap 53 2024-03-30T12:24:05.087 INFO:tasks.rados.rados.0.smithi084.stdout:606: expect (ObjNum 136 snap 32 seq_num 136) 2024-03-30T12:24:05.087 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 58 2024-03-30T12:24:05.087 INFO:tasks.rados.rados.0.smithi084.stdout:607: seq_num 199 ranges {3137536=540672,3678208=401408} 2024-03-30T12:24:05.107 INFO:tasks.rados.rados.0.smithi084.stdout:607: writing smithi08477944-47 from 3137536 to 3678208 tid 1 2024-03-30T12:24:05.110 INFO:tasks.rados.rados.0.smithi084.stdout:607: writing smithi08477944-47 from 3678208 to 4079616 tid 2 2024-03-30T12:24:05.110 INFO:tasks.rados.rados.0.smithi084.stdout:608: rmattr oid 40 current snap is 58 2024-03-30T12:24:05.110 INFO:tasks.rados.rados.0.smithi084.stdout:608: done (12 left) 2024-03-30T12:24:05.110 INFO:tasks.rados.rados.0.smithi084.stdout:609: snap_remove snap 56 2024-03-30T12:24:05.369 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:24:05.337+0000 7f995f203200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T12:24:05.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:05 smithi162 ceph-mon[30421]: osdmap e182: 8 total, 8 up, 8 in 2024-03-30T12:24:05.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:05 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:05.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:05 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:05.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:05 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:05.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:05 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:05.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:05 smithi084 ceph-mon[37565]: osdmap e182: 8 total, 8 up, 8 in 2024-03-30T12:24:05.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:05 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:05.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:05 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:05.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:05 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:05.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:05 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:06.090 INFO:tasks.rados.rados.0.smithi084.stdout:609: done (12 left) 2024-03-30T12:24:06.090 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 31 current snap is 58 2024-03-30T12:24:06.091 INFO:tasks.rados.rados.0.smithi084.stdout:610: seq_num 200 ranges {0=557056,557056=401408} 2024-03-30T12:24:06.094 INFO:tasks.rados.rados.0.smithi084.stdout:610: writing smithi08477944-31 from 0 to 557056 tid 1 2024-03-30T12:24:06.097 INFO:tasks.rados.rados.0.smithi084.stdout:610: writing smithi08477944-31 from 557056 to 958464 tid 2 2024-03-30T12:24:06.098 INFO:tasks.rados.rados.0.smithi084.stdout:611: rollback oid 50 current snap is 58 2024-03-30T12:24:06.098 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 355 (ObjNum 161 snap 42 seq_num 161) dirty exists 2024-03-30T12:24:06.098 INFO:tasks.rados.rados.0.smithi084.stdout:595: finishing rollback tid 1 to smithi08477944-6 2024-03-30T12:24:06.098 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 0 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-03-30T12:24:06.098 INFO:tasks.rados.rados.0.smithi084.stdout:600: finishing rollback tid 0 to smithi08477944-29 2024-03-30T12:24:06.098 INFO:tasks.rados.rados.0.smithi084.stdout:600: finishing rollback tid 1 to smithi08477944-29 2024-03-30T12:24:06.098 INFO:tasks.rados.rados.0.smithi084.stdout:600: finishing rollback tid 2 to smithi08477944-29 2024-03-30T12:24:06.098 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 231 (ObjNum 142 snap 36 seq_num 142) dirty exists 2024-03-30T12:24:06.098 INFO:tasks.rados.rados.0.smithi084.stdout:596: expect (ObjNum 56 snap 4 seq_num 56) 2024-03-30T12:24:06.146 INFO:tasks.rados.rados.0.smithi084.stdout:597: finishing copy_from racing read to smithi08477944-11 2024-03-30T12:24:06.146 INFO:tasks.rados.rados.0.smithi084.stdout:594: expect (ObjNum 55 snap 3 seq_num 55) 2024-03-30T12:24:06.181 INFO:tasks.rados.rados.0.smithi084.stdout:597: finishing copy_from to smithi08477944-11 2024-03-30T12:24:06.181 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 255 (ObjNum 170 snap 46 seq_num 170) dirty exists 2024-03-30T12:24:06.181 INFO:tasks.rados.rados.0.smithi084.stdout:603: finishing copy_from racing read to smithi08477944-1 2024-03-30T12:24:06.181 INFO:tasks.rados.rados.0.smithi084.stdout:601: finishing copy_from racing read to smithi08477944-24 2024-03-30T12:24:06.181 INFO:tasks.rados.rados.0.smithi084.stdout:603: finishing copy_from to smithi08477944-1 2024-03-30T12:24:06.181 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 166 (ObjNum 167 snap 45 seq_num 167) dirty exists 2024-03-30T12:24:06.181 INFO:tasks.rados.rados.0.smithi084.stdout:606: expect (ObjNum 136 snap 32 seq_num 136) 2024-03-30T12:24:06.238 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:06 smithi162 ceph-mon[30421]: pgmap v12: 121 pgs: 121 active+clean; 53 MiB data, 593 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:24:06.239 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:06 smithi162 ceph-mon[30421]: osdmap e183: 8 total, 8 up, 8 in 2024-03-30T12:24:06.239 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:24:05.917+0000 7f995f203200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T12:24:06.239 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:24:06.020+0000 7f995f203200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T12:24:06.239 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:24:06.247+0000 7f995f203200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T12:24:06.244 INFO:tasks.rados.rados.0.smithi084.stdout:598: finishing copy_from racing read to smithi08477944-13 2024-03-30T12:24:06.244 INFO:tasks.rados.rados.0.smithi084.stdout:601: finishing copy_from to smithi08477944-24 2024-03-30T12:24:06.244 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 70 (ObjNum 176 snap 49 seq_num 176) dirty exists 2024-03-30T12:24:06.244 INFO:tasks.rados.rados.0.smithi084.stdout:598: finishing copy_from to smithi08477944-13 2024-03-30T12:24:06.244 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 147 (ObjNum 181 snap 50 seq_num 181) dirty exists 2024-03-30T12:24:06.244 INFO:tasks.rados.rados.0.smithi084.stdout:607: finishing write tid 1 to smithi08477944-47 2024-03-30T12:24:06.244 INFO:tasks.rados.rados.0.smithi084.stdout:607: finishing write tid 2 to smithi08477944-47 2024-03-30T12:24:06.244 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 50 to 53 2024-03-30T12:24:06.244 INFO:tasks.rados.rados.0.smithi084.stdout:607: finishing write tid 3 to smithi08477944-47 2024-03-30T12:24:06.244 INFO:tasks.rados.rados.0.smithi084.stdout:607: finishing write tid 4 to smithi08477944-47 2024-03-30T12:24:06.244 INFO:tasks.rados.rados.0.smithi084.stdout:607: oid 47 updating version 0 to 357 2024-03-30T12:24:06.244 INFO:tasks.rados.rados.0.smithi084.stdout:607: oid 47 updating version 357 to 359 2024-03-30T12:24:06.244 INFO:tasks.rados.rados.0.smithi084.stdout:607: oid 47 version 359 is already newer than 358 2024-03-30T12:24:06.245 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 359 (ObjNum 199 snap 58 seq_num 199) dirty exists 2024-03-30T12:24:06.245 INFO:tasks.rados.rados.0.smithi084.stdout:607: left oid 47 (ObjNum 199 snap 58 seq_num 199) 2024-03-30T12:24:06.245 INFO:tasks.rados.rados.0.smithi084.stdout:610: finishing write tid 1 to smithi08477944-31 2024-03-30T12:24:06.245 INFO:tasks.rados.rados.0.smithi084.stdout:610: finishing write tid 2 to smithi08477944-31 2024-03-30T12:24:06.245 INFO:tasks.rados.rados.0.smithi084.stdout:610: finishing write tid 3 to smithi08477944-31 2024-03-30T12:24:06.245 INFO:tasks.rados.rados.0.smithi084.stdout:610: finishing write tid 4 to smithi08477944-31 2024-03-30T12:24:06.245 INFO:tasks.rados.rados.0.smithi084.stdout:610: oid 31 updating version 0 to 234 2024-03-30T12:24:06.245 INFO:tasks.rados.rados.0.smithi084.stdout:610: oid 31 version 234 is already newer than 232 2024-03-30T12:24:06.245 INFO:tasks.rados.rados.0.smithi084.stdout:610: oid 31 updating version 234 to 235 2024-03-30T12:24:06.245 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 235 (ObjNum 200 snap 58 seq_num 200) dirty exists 2024-03-30T12:24:06.245 INFO:tasks.rados.rados.0.smithi084.stdout:610: left oid 31 (ObjNum 200 snap 58 seq_num 200) 2024-03-30T12:24:06.245 INFO:tasks.rados.rados.0.smithi084.stdout:594: done (13 left) 2024-03-30T12:24:06.245 INFO:tasks.rados.rados.0.smithi084.stdout:595: done (12 left) 2024-03-30T12:24:06.245 INFO:tasks.rados.rados.0.smithi084.stdout:596: done (11 left) 2024-03-30T12:24:06.246 INFO:tasks.rados.rados.0.smithi084.stdout:597: done (10 left) 2024-03-30T12:24:06.246 INFO:tasks.rados.rados.0.smithi084.stdout:598: done (9 left) 2024-03-30T12:24:06.246 INFO:tasks.rados.rados.0.smithi084.stdout:599: done (8 left) 2024-03-30T12:24:06.246 INFO:tasks.rados.rados.0.smithi084.stdout:600: done (7 left) 2024-03-30T12:24:06.246 INFO:tasks.rados.rados.0.smithi084.stdout:601: done (6 left) 2024-03-30T12:24:06.246 INFO:tasks.rados.rados.0.smithi084.stdout:603: done (5 left) 2024-03-30T12:24:06.246 INFO:tasks.rados.rados.0.smithi084.stdout:605: done (4 left) 2024-03-30T12:24:06.246 INFO:tasks.rados.rados.0.smithi084.stdout:606: done (3 left) 2024-03-30T12:24:06.246 INFO:tasks.rados.rados.0.smithi084.stdout:607: done (2 left) 2024-03-30T12:24:06.246 INFO:tasks.rados.rados.0.smithi084.stdout:610: done (1 left) 2024-03-30T12:24:06.246 INFO:tasks.rados.rados.0.smithi084.stdout:612: snap_create 2024-03-30T12:24:06.247 INFO:tasks.rados.rados.0.smithi084.stdout:611: finishing rollback tid 0 to smithi08477944-50 2024-03-30T12:24:06.247 INFO:tasks.rados.rados.0.smithi084.stdout:611: finishing rollback tid 1 to smithi08477944-50 2024-03-30T12:24:06.247 INFO:tasks.rados.rados.0.smithi084.stdout:611: finishing rollback tid 2 to smithi08477944-50 2024-03-30T12:24:06.247 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 361 (ObjNum 116 snap 26 seq_num 116) dirty exists 2024-03-30T12:24:06.373 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:06 smithi084 ceph-mon[37565]: pgmap v12: 121 pgs: 121 active+clean; 53 MiB data, 593 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:24:06.373 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:06 smithi084 ceph-mon[37565]: osdmap e183: 8 total, 8 up, 8 in 2024-03-30T12:24:06.373 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:06 smithi084 ceph-mon[27000]: pgmap v12: 121 pgs: 121 active+clean; 53 MiB data, 593 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:24:06.373 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:06 smithi084 ceph-mon[27000]: osdmap e183: 8 total, 8 up, 8 in 2024-03-30T12:24:06.619 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: [30/Mar/2024:12:24:06] ENGINE Bus STARTING 2024-03-30T12:24:06.620 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: CherryPy Checker: 2024-03-30T12:24:06.620 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: The Application mounted at '' has an empty config. 2024-03-30T12:24:06.620 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: 2024-03-30T12:24:06.620 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: [30/Mar/2024:12:24:06] ENGINE Serving on http://:::9283 2024-03-30T12:24:06.620 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: [30/Mar/2024:12:24:06] ENGINE Bus STARTED 2024-03-30T12:24:07.101 INFO:tasks.rados.rados.0.smithi084.stdout:611: done (1 left) 2024-03-30T12:24:07.101 INFO:tasks.rados.rados.0.smithi084.stdout:612: done (0 left) 2024-03-30T12:24:07.101 INFO:tasks.rados.rados.0.smithi084.stdout:613: copy_from oid 48 from oid 7 current snap is 59 2024-03-30T12:24:07.101 INFO:tasks.rados.rados.0.smithi084.stdout:614: read oid 2 snap -1 2024-03-30T12:24:07.101 INFO:tasks.rados.rados.0.smithi084.stdout:614: expect deleted 2024-03-30T12:24:07.101 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 59 2024-03-30T12:24:07.102 INFO:tasks.rados.rados.0.smithi084.stdout:615: seq_num 201 ranges {2932736=573440,3506176=401408} 2024-03-30T12:24:07.120 INFO:tasks.rados.rados.0.smithi084.stdout:615: writing smithi08477944-13 from 2932736 to 3506176 tid 1 2024-03-30T12:24:07.122 INFO:tasks.rados.rados.0.smithi084.stdout:615: writing smithi08477944-13 from 3506176 to 3907584 tid 2 2024-03-30T12:24:07.122 INFO:tasks.rados.rados.0.smithi084.stdout:616: read oid 47 snap -1 2024-03-30T12:24:07.122 INFO:tasks.rados.rados.0.smithi084.stdout:616: expect (ObjNum 199 snap 58 seq_num 199) 2024-03-30T12:24:07.122 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 59 2024-03-30T12:24:07.123 INFO:tasks.rados.rados.0.smithi084.stdout:617: seq_num 202 ranges {0=589824,589824=401408} 2024-03-30T12:24:07.125 INFO:tasks.rados.rados.0.smithi084.stdout:617: writing smithi08477944-37 from 0 to 589824 tid 1 2024-03-30T12:24:07.128 INFO:tasks.rados.rados.0.smithi084.stdout:617: writing smithi08477944-37 from 589824 to 991232 tid 2 2024-03-30T12:24:07.128 INFO:tasks.rados.rados.0.smithi084.stdout:618: setattr oid 17 current snap is 59 2024-03-30T12:24:07.128 INFO:tasks.rados.rados.0.smithi084.stdout:613: finishing copy_from racing read to smithi08477944-48 2024-03-30T12:24:07.128 INFO:tasks.rados.rados.0.smithi084.stdout:613: finishing copy_from to smithi08477944-48 2024-03-30T12:24:07.129 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 328 (ObjNum 189 snap 50 seq_num 189) dirty exists 2024-03-30T12:24:07.129 INFO:tasks.rados.rados.0.smithi084.stdout:615: finishing write tid 1 to smithi08477944-13 2024-03-30T12:24:07.129 INFO:tasks.rados.rados.0.smithi084.stdout:615: finishing write tid 2 to smithi08477944-13 2024-03-30T12:24:07.129 INFO:tasks.rados.rados.0.smithi084.stdout:615: finishing write tid 3 to smithi08477944-13 2024-03-30T12:24:07.129 INFO:tasks.rados.rados.0.smithi084.stdout:615: finishing write tid 4 to smithi08477944-13 2024-03-30T12:24:07.129 INFO:tasks.rados.rados.0.smithi084.stdout:615: oid 13 updating version 0 to 150 2024-03-30T12:24:07.129 INFO:tasks.rados.rados.0.smithi084.stdout:615: oid 13 version 150 is already newer than 149 2024-03-30T12:24:07.129 INFO:tasks.rados.rados.0.smithi084.stdout:615: oid 13 version 150 is already newer than 148 2024-03-30T12:24:07.129 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 150 (ObjNum 201 snap 59 seq_num 201) dirty exists 2024-03-30T12:24:07.129 INFO:tasks.rados.rados.0.smithi084.stdout:615: left oid 13 (ObjNum 201 snap 59 seq_num 201) 2024-03-30T12:24:07.130 INFO:tasks.rados.rados.0.smithi084.stdout:613: done (5 left) 2024-03-30T12:24:07.130 INFO:tasks.rados.rados.0.smithi084.stdout:614: done (4 left) 2024-03-30T12:24:07.130 INFO:tasks.rados.rados.0.smithi084.stdout:615: done (3 left) 2024-03-30T12:24:07.130 INFO:tasks.rados.rados.0.smithi084.stdout:619: snap_create 2024-03-30T12:24:07.131 INFO:tasks.rados.rados.0.smithi084.stdout:617: finishing write tid 1 to smithi08477944-37 2024-03-30T12:24:07.131 INFO:tasks.rados.rados.0.smithi084.stdout:617: finishing write tid 2 to smithi08477944-37 2024-03-30T12:24:07.131 INFO:tasks.rados.rados.0.smithi084.stdout:617: finishing write tid 3 to smithi08477944-37 2024-03-30T12:24:07.132 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 247 (ObjNum 55 snap 3 seq_num 55) dirty exists 2024-03-30T12:24:07.134 INFO:tasks.rados.rados.0.smithi084.stdout:616: expect (ObjNum 199 snap 58 seq_num 199) 2024-03-30T12:24:07.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:07 smithi084 ceph-mon[27000]: osdmap e184: 8 total, 8 up, 8 in 2024-03-30T12:24:07.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:07 smithi084 ceph-mon[27000]: Standby manager daemon x started 2024-03-30T12:24:07.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:07 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.162:0/2133402002' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T12:24:07.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:07 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.162:0/2133402002' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T12:24:07.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:07 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.162:0/2133402002' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T12:24:07.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:07 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.162:0/2133402002' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T12:24:07.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:07 smithi084 ceph-mon[37565]: osdmap e184: 8 total, 8 up, 8 in 2024-03-30T12:24:07.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:07 smithi084 ceph-mon[37565]: Standby manager daemon x started 2024-03-30T12:24:07.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:07 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.162:0/2133402002' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T12:24:07.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:07 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.162:0/2133402002' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T12:24:07.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:07 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.162:0/2133402002' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T12:24:07.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:07 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.162:0/2133402002' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T12:24:07.307 INFO:tasks.rados.rados.0.smithi084.stdout:617: finishing write tid 4 to smithi08477944-37 2024-03-30T12:24:07.308 INFO:tasks.rados.rados.0.smithi084.stdout:617: oid 37 updating version 0 to 264 2024-03-30T12:24:07.308 INFO:tasks.rados.rados.0.smithi084.stdout:617: oid 37 updating version 264 to 265 2024-03-30T12:24:07.308 INFO:tasks.rados.rados.0.smithi084.stdout:617: oid 37 updating version 265 to 266 2024-03-30T12:24:07.308 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 266 (ObjNum 202 snap 59 seq_num 202) dirty exists 2024-03-30T12:24:07.308 INFO:tasks.rados.rados.0.smithi084.stdout:617: left oid 37 (ObjNum 202 snap 59 seq_num 202) 2024-03-30T12:24:07.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:07 smithi162 ceph-mon[30421]: osdmap e184: 8 total, 8 up, 8 in 2024-03-30T12:24:07.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:07 smithi162 ceph-mon[30421]: Standby manager daemon x started 2024-03-30T12:24:07.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:07 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.162:0/2133402002' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T12:24:07.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:07 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.162:0/2133402002' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T12:24:07.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:07 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.162:0/2133402002' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T12:24:07.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:07 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.162:0/2133402002' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T12:24:08.101 INFO:tasks.rados.rados.0.smithi084.stdout:616: done (3 left) 2024-03-30T12:24:08.102 INFO:tasks.rados.rados.0.smithi084.stdout:617: done (2 left) 2024-03-30T12:24:08.102 INFO:tasks.rados.rados.0.smithi084.stdout:618: done (1 left) 2024-03-30T12:24:08.102 INFO:tasks.rados.rados.0.smithi084.stdout:619: done (0 left) 2024-03-30T12:24:08.102 INFO:tasks.rados.rados.0.smithi084.stdout:620: snap_create 2024-03-30T12:24:08.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:08 smithi162 ceph-mon[30421]: pgmap v15: 121 pgs: 121 active+clean; 56 MiB data, 597 MiB used, 715 GiB / 715 GiB avail; 340 KiB/s rd, 778 KiB/s wr, 38 op/s 2024-03-30T12:24:08.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:08 smithi162 ceph-mon[30421]: osdmap e185: 8 total, 8 up, 8 in 2024-03-30T12:24:08.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:08 smithi162 ceph-mon[30421]: mgrmap e33: y(active, since 8s), standbys: x 2024-03-30T12:24:08.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:08 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T12:24:08.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:08 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:08.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:08 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:08.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:08 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:24:08.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:08 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:24:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:08 smithi084 ceph-mon[37565]: pgmap v15: 121 pgs: 121 active+clean; 56 MiB data, 597 MiB used, 715 GiB / 715 GiB avail; 340 KiB/s rd, 778 KiB/s wr, 38 op/s 2024-03-30T12:24:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:08 smithi084 ceph-mon[37565]: osdmap e185: 8 total, 8 up, 8 in 2024-03-30T12:24:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:08 smithi084 ceph-mon[37565]: mgrmap e33: y(active, since 8s), standbys: x 2024-03-30T12:24:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:08 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T12:24:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:08 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:08 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:08 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:24:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:08 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:24:08.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:08 smithi084 ceph-mon[27000]: pgmap v15: 121 pgs: 121 active+clean; 56 MiB data, 597 MiB used, 715 GiB / 715 GiB avail; 340 KiB/s rd, 778 KiB/s wr, 38 op/s 2024-03-30T12:24:08.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:08 smithi084 ceph-mon[27000]: osdmap e185: 8 total, 8 up, 8 in 2024-03-30T12:24:08.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:08 smithi084 ceph-mon[27000]: mgrmap e33: y(active, since 8s), standbys: x 2024-03-30T12:24:08.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:08 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T12:24:08.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:08 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:08.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:08 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:08.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:08 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:24:08.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:08 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:24:09.113 INFO:tasks.rados.rados.0.smithi084.stdout:620: done (0 left) 2024-03-30T12:24:09.113 INFO:tasks.rados.rados.0.smithi084.stdout:621: copy_from oid 22 from oid 47 current snap is 61 2024-03-30T12:24:09.114 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 27 current snap is 61 2024-03-30T12:24:09.114 INFO:tasks.rados.rados.0.smithi084.stdout:622: seq_num 203 ranges {1384448=606208,1990656=401408} 2024-03-30T12:24:09.123 INFO:tasks.rados.rados.0.smithi084.stdout:622: writing smithi08477944-27 from 1384448 to 1990656 tid 1 2024-03-30T12:24:09.126 INFO:tasks.rados.rados.0.smithi084.stdout:622: writing smithi08477944-27 from 1990656 to 2392064 tid 2 2024-03-30T12:24:09.126 INFO:tasks.rados.rados.0.smithi084.stdout:623: snap_create 2024-03-30T12:24:09.135 INFO:tasks.rados.rados.0.smithi084.stdout:622: finishing write tid 1 to smithi08477944-27 2024-03-30T12:24:09.135 INFO:tasks.rados.rados.0.smithi084.stdout:621: finishing copy_from racing read to smithi08477944-22 2024-03-30T12:24:09.136 INFO:tasks.rados.rados.0.smithi084.stdout:622: finishing write tid 2 to smithi08477944-27 2024-03-30T12:24:09.136 INFO:tasks.rados.rados.0.smithi084.stdout:622: finishing write tid 3 to smithi08477944-27 2024-03-30T12:24:09.137 INFO:tasks.rados.rados.0.smithi084.stdout:622: finishing write tid 4 to smithi08477944-27 2024-03-30T12:24:09.137 INFO:tasks.rados.rados.0.smithi084.stdout:622: oid 27 updating version 0 to 159 2024-03-30T12:24:09.138 INFO:tasks.rados.rados.0.smithi084.stdout:622: oid 27 version 159 is already newer than 157 2024-03-30T12:24:09.138 INFO:tasks.rados.rados.0.smithi084.stdout:622: oid 27 version 159 is already newer than 158 2024-03-30T12:24:09.138 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 159 (ObjNum 203 snap 61 seq_num 203) dirty exists 2024-03-30T12:24:09.138 INFO:tasks.rados.rados.0.smithi084.stdout:622: left oid 27 (ObjNum 203 snap 61 seq_num 203) 2024-03-30T12:24:09.138 INFO:tasks.rados.rados.0.smithi084.stdout:621: finishing copy_from to smithi08477944-22 2024-03-30T12:24:09.138 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 359 (ObjNum 199 snap 58 seq_num 199) dirty exists 2024-03-30T12:24:09.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:09 smithi162 ceph-mon[30421]: Updating smithi084:/etc/ceph/ceph.conf 2024-03-30T12:24:09.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:09 smithi162 ceph-mon[30421]: Updating smithi162:/etc/ceph/ceph.conf 2024-03-30T12:24:09.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:09 smithi162 ceph-mon[30421]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:24:09.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:09 smithi162 ceph-mon[30421]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:24:09.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:09 smithi162 ceph-mon[30421]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:24:09.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:09 smithi162 ceph-mon[30421]: osdmap e186: 8 total, 8 up, 8 in 2024-03-30T12:24:09.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:09 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:09.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:09 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:09.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:09 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:09.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:09 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:09.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:09 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:09.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:09 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:09.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:09 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:24:09.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[37565]: Updating smithi084:/etc/ceph/ceph.conf 2024-03-30T12:24:09.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[37565]: Updating smithi162:/etc/ceph/ceph.conf 2024-03-30T12:24:09.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[37565]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:24:09.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[37565]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:24:09.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[37565]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:24:09.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[37565]: osdmap e186: 8 total, 8 up, 8 in 2024-03-30T12:24:09.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:09.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:09.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:09.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:09.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:09.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:09.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:24:09.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[27000]: Updating smithi084:/etc/ceph/ceph.conf 2024-03-30T12:24:09.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[27000]: Updating smithi162:/etc/ceph/ceph.conf 2024-03-30T12:24:09.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[27000]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:24:09.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[27000]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:24:09.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[27000]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:24:09.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[27000]: osdmap e186: 8 total, 8 up, 8 in 2024-03-30T12:24:09.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:09.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:09.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:09.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:09.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:09.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:09.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:09 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:24:10.047 INFO:tasks.rados.rados.0.smithi084.stdout:621: done (2 left) 2024-03-30T12:24:10.047 INFO:tasks.rados.rados.0.smithi084.stdout:622: done (1 left) 2024-03-30T12:24:10.047 INFO:tasks.rados.rados.0.smithi084.stdout:623: done (0 left) 2024-03-30T12:24:10.048 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 62 2024-03-30T12:24:10.048 INFO:tasks.rados.rados.0.smithi084.stdout:624: seq_num 204 ranges {942080=622592,1564672=401408} 2024-03-30T12:24:10.055 INFO:tasks.rados.rados.0.smithi084.stdout:624: writing smithi08477944-35 from 942080 to 1564672 tid 1 2024-03-30T12:24:10.058 INFO:tasks.rados.rados.0.smithi084.stdout:624: writing smithi08477944-35 from 1564672 to 1966080 tid 2 2024-03-30T12:24:10.058 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 62 2024-03-30T12:24:10.058 INFO:tasks.rados.rados.0.smithi084.stdout:625: seq_num 205 ranges {1572864=638976,2211840=401408} 2024-03-30T12:24:10.070 INFO:tasks.rados.rados.0.smithi084.stdout:625: writing smithi08477944-40 from 1572864 to 2211840 tid 1 2024-03-30T12:24:10.074 INFO:tasks.rados.rados.0.smithi084.stdout:625: writing smithi08477944-40 from 2211840 to 2613248 tid 2 2024-03-30T12:24:10.074 INFO:tasks.rados.rados.0.smithi084.stdout:626: read oid 22 snap -1 2024-03-30T12:24:10.074 INFO:tasks.rados.rados.0.smithi084.stdout:626: expect (ObjNum 199 snap 58 seq_num 199) 2024-03-30T12:24:10.074 INFO:tasks.rados.rados.0.smithi084.stdout:627: rollback oid 20 current snap is 62 2024-03-30T12:24:10.074 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 20 to 58 2024-03-30T12:24:10.074 INFO:tasks.rados.rados.0.smithi084.stdout:628: setattr oid 30 current snap is 62 2024-03-30T12:24:10.074 INFO:tasks.rados.rados.0.smithi084.stdout:624: finishing write tid 1 to smithi08477944-35 2024-03-30T12:24:10.074 INFO:tasks.rados.rados.0.smithi084.stdout:624: finishing write tid 2 to smithi08477944-35 2024-03-30T12:24:10.074 INFO:tasks.rados.rados.0.smithi084.stdout:624: finishing write tid 3 to smithi08477944-35 2024-03-30T12:24:10.074 INFO:tasks.rados.rados.0.smithi084.stdout:624: finishing write tid 4 to smithi08477944-35 2024-03-30T12:24:10.074 INFO:tasks.rados.rados.0.smithi084.stdout:624: oid 35 updating version 0 to 190 2024-03-30T12:24:10.074 INFO:tasks.rados.rados.0.smithi084.stdout:624: oid 35 updating version 190 to 192 2024-03-30T12:24:10.075 INFO:tasks.rados.rados.0.smithi084.stdout:624: oid 35 version 192 is already newer than 191 2024-03-30T12:24:10.075 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 192 (ObjNum 204 snap 62 seq_num 204) dirty exists 2024-03-30T12:24:10.075 INFO:tasks.rados.rados.0.smithi084.stdout:624: left oid 35 (ObjNum 204 snap 62 seq_num 204) 2024-03-30T12:24:10.075 INFO:tasks.rados.rados.0.smithi084.stdout:624: done (4 left) 2024-03-30T12:24:10.076 INFO:tasks.rados.rados.0.smithi084.stdout:629: read oid 4 snap 51 2024-03-30T12:24:10.076 INFO:tasks.rados.rados.0.smithi084.stdout:629: expect (ObjNum 191 snap 50 seq_num 191) 2024-03-30T12:24:10.076 INFO:tasks.rados.rados.0.smithi084.stdout:630: delete oid 16 current snap is 62 2024-03-30T12:24:10.076 INFO:tasks.rados.rados.0.smithi084.stdout:625: finishing write tid 1 to smithi08477944-40 2024-03-30T12:24:10.078 INFO:tasks.rados.rados.0.smithi084.stdout:630: done (5 left) 2024-03-30T12:24:10.078 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 62 2024-03-30T12:24:10.078 INFO:tasks.rados.rados.0.smithi084.stdout:631: seq_num 207 ranges {2293760=671744,2965504=401408} 2024-03-30T12:24:10.096 INFO:tasks.rados.rados.0.smithi084.stdout:631: writing smithi08477944-43 from 2293760 to 2965504 tid 1 2024-03-30T12:24:10.098 INFO:tasks.rados.rados.0.smithi084.stdout:631: writing smithi08477944-43 from 2965504 to 3366912 tid 2 2024-03-30T12:24:10.098 INFO:tasks.rados.rados.0.smithi084.stdout:632: copy_from oid 49 from oid 12 current snap is 62 2024-03-30T12:24:10.098 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 147 (ObjNum 29 snap 0 seq_num 29) dirty exists 2024-03-30T12:24:10.098 INFO:tasks.rados.rados.0.smithi084.stdout:629: expect (ObjNum 191 snap 50 seq_num 191) 2024-03-30T12:24:10.121 INFO:tasks.rados.rados.0.smithi084.stdout:625: finishing write tid 2 to smithi08477944-40 2024-03-30T12:24:10.121 INFO:tasks.rados.rados.0.smithi084.stdout:625: finishing write tid 3 to smithi08477944-40 2024-03-30T12:24:10.121 INFO:tasks.rados.rados.0.smithi084.stdout:628: done (6 left) 2024-03-30T12:24:10.121 INFO:tasks.rados.rados.0.smithi084.stdout:629: done (5 left) 2024-03-30T12:24:10.122 INFO:tasks.rados.rados.0.smithi084.stdout:633: snap_remove snap 57 2024-03-30T12:24:10.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:24:10.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:24:10.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:24:10.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T12:24:10.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: Reconfiguring daemon prometheus.a on smithi162 2024-03-30T12:24:10.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: pgmap v18: 121 pgs: 121 active+clean; 56 MiB data, 597 MiB used, 715 GiB / 715 GiB avail; 340 KiB/s rd, 778 KiB/s wr, 38 op/s 2024-03-30T12:24:10.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: osdmap e187: 8 total, 8 up, 8 in 2024-03-30T12:24:10.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:10.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:10.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:10.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:10.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:10.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:10.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:10.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:10.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:10.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:24:10.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:24:10.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:10.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:10.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:10.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:24:10.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:24:10.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:10.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:10.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:10.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:24:10.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:24:10.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:10.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:10.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:10.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:10 smithi162 ceph-mon[30421]: osdmap e188: 8 total, 8 up, 8 in 2024-03-30T12:24:10.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:24:10.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:24:10.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:24:10.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T12:24:10.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: Reconfiguring daemon prometheus.a on smithi162 2024-03-30T12:24:10.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: pgmap v18: 121 pgs: 121 active+clean; 56 MiB data, 597 MiB used, 715 GiB / 715 GiB avail; 340 KiB/s rd, 778 KiB/s wr, 38 op/s 2024-03-30T12:24:10.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: osdmap e187: 8 total, 8 up, 8 in 2024-03-30T12:24:10.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:10.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:10.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:10.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:10.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:10.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:10.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:10.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:10.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:10.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:24:10.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:24:10.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:10.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:10.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:10.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:24:10.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:24:10.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:10.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:10.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:10.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:24:10.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:24:10.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:10.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:10.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:10.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[37565]: osdmap e188: 8 total, 8 up, 8 in 2024-03-30T12:24:10.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:24:10.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:24:10.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:24:10.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T12:24:10.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: Reconfiguring daemon prometheus.a on smithi162 2024-03-30T12:24:10.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: pgmap v18: 121 pgs: 121 active+clean; 56 MiB data, 597 MiB used, 715 GiB / 715 GiB avail; 340 KiB/s rd, 778 KiB/s wr, 38 op/s 2024-03-30T12:24:10.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: osdmap e187: 8 total, 8 up, 8 in 2024-03-30T12:24:10.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:10.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:10.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:10.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:10.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:10.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:10.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:10.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:10.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:10.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:24:10.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:24:10.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:10.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:10.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:10.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:24:10.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:24:10.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:10.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:10.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:10.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:24:10.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:24:10.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:10.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:10.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:10.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:10 smithi084 ceph-mon[27000]: osdmap e188: 8 total, 8 up, 8 in 2024-03-30T12:24:11.135 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:11 smithi162 ceph-mon[30421]: mgrmap e34: y(active, since 11s), standbys: x 2024-03-30T12:24:11.137 INFO:tasks.rados.rados.0.smithi084.stdout:633: done (5 left) 2024-03-30T12:24:11.138 INFO:tasks.rados.rados.0.smithi084.stdout:634: delete oid 37 current snap is 62 2024-03-30T12:24:11.138 INFO:tasks.rados.rados.0.smithi084.stdout:627: finishing rollback tid 0 to smithi08477944-20 2024-03-30T12:24:11.138 INFO:tasks.rados.rados.0.smithi084.stdout:627: finishing rollback tid 1 to smithi08477944-20 2024-03-30T12:24:11.138 INFO:tasks.rados.rados.0.smithi084.stdout:627: finishing rollback tid 2 to smithi08477944-20 2024-03-30T12:24:11.138 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 369 (ObjNum 186 snap 50 seq_num 186) dirty exists 2024-03-30T12:24:11.138 INFO:tasks.rados.rados.0.smithi084.stdout:625: finishing write tid 4 to smithi08477944-40 2024-03-30T12:24:11.138 INFO:tasks.rados.rados.0.smithi084.stdout:625: oid 40 updating version 0 to 363 2024-03-30T12:24:11.138 INFO:tasks.rados.rados.0.smithi084.stdout:625: oid 40 updating version 363 to 364 2024-03-30T12:24:11.138 INFO:tasks.rados.rados.0.smithi084.stdout:625: oid 40 updating version 364 to 365 2024-03-30T12:24:11.138 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 365 (ObjNum 205 snap 62 seq_num 205) dirty exists 2024-03-30T12:24:11.138 INFO:tasks.rados.rados.0.smithi084.stdout:625: left oid 40 (ObjNum 205 snap 62 seq_num 205) 2024-03-30T12:24:11.138 INFO:tasks.rados.rados.0.smithi084.stdout:626: expect (ObjNum 199 snap 58 seq_num 199) 2024-03-30T12:24:11.310 INFO:tasks.rados.rados.0.smithi084.stdout:631: finishing write tid 1 to smithi08477944-43 2024-03-30T12:24:11.310 INFO:tasks.rados.rados.0.smithi084.stdout:631: finishing write tid 2 to smithi08477944-43 2024-03-30T12:24:11.310 INFO:tasks.rados.rados.0.smithi084.stdout:631: finishing write tid 3 to smithi08477944-43 2024-03-30T12:24:11.310 INFO:tasks.rados.rados.0.smithi084.stdout:631: finishing write tid 4 to smithi08477944-43 2024-03-30T12:24:11.310 INFO:tasks.rados.rados.0.smithi084.stdout:631: oid 43 updating version 0 to 201 2024-03-30T12:24:11.310 INFO:tasks.rados.rados.0.smithi084.stdout:631: oid 43 updating version 201 to 202 2024-03-30T12:24:11.310 INFO:tasks.rados.rados.0.smithi084.stdout:631: oid 43 updating version 202 to 203 2024-03-30T12:24:11.310 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 203 (ObjNum 207 snap 62 seq_num 207) dirty exists 2024-03-30T12:24:11.310 INFO:tasks.rados.rados.0.smithi084.stdout:631: left oid 43 (ObjNum 207 snap 62 seq_num 207) 2024-03-30T12:24:11.311 INFO:tasks.rados.rados.0.smithi084.stdout:632: finishing copy_from racing read to smithi08477944-49 2024-03-30T12:24:11.311 INFO:tasks.rados.rados.0.smithi084.stdout:632: finishing copy_from to smithi08477944-49 2024-03-30T12:24:11.311 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 147 (ObjNum 181 snap 50 seq_num 181) dirty exists 2024-03-30T12:24:11.311 INFO:tasks.rados.rados.0.smithi084.stdout:625: done (5 left) 2024-03-30T12:24:11.311 INFO:tasks.rados.rados.0.smithi084.stdout:626: done (4 left) 2024-03-30T12:24:11.311 INFO:tasks.rados.rados.0.smithi084.stdout:627: done (3 left) 2024-03-30T12:24:11.311 INFO:tasks.rados.rados.0.smithi084.stdout:631: done (2 left) 2024-03-30T12:24:11.311 INFO:tasks.rados.rados.0.smithi084.stdout:632: done (1 left) 2024-03-30T12:24:11.311 INFO:tasks.rados.rados.0.smithi084.stdout:634: done (0 left) 2024-03-30T12:24:11.311 INFO:tasks.rados.rados.0.smithi084.stdout:635: read oid 30 snap -1 2024-03-30T12:24:11.311 INFO:tasks.rados.rados.0.smithi084.stdout:635: expect (ObjNum 29 snap 0 seq_num 29) 2024-03-30T12:24:11.311 INFO:tasks.rados.rados.0.smithi084.stdout:636: copy_from oid 33 from oid 4 current snap is 62 2024-03-30T12:24:11.311 INFO:tasks.rados.rados.0.smithi084.stdout:637: delete oid 17 current snap is 62 2024-03-30T12:24:11.312 INFO:tasks.rados.rados.0.smithi084.stdout:637: done (2 left) 2024-03-30T12:24:11.312 INFO:tasks.rados.rados.0.smithi084.stdout:638: read oid 24 snap -1 2024-03-30T12:24:11.313 INFO:tasks.rados.rados.0.smithi084.stdout:638: expect (ObjNum 176 snap 49 seq_num 176) 2024-03-30T12:24:11.313 INFO:tasks.rados.rados.0.smithi084.stdout:639: rmattr oid 47 current snap is 62 2024-03-30T12:24:11.313 INFO:tasks.rados.rados.0.smithi084.stdout:640: copy_from oid 17 from oid 20 current snap is 62 2024-03-30T12:24:11.313 INFO:tasks.rados.rados.0.smithi084.stdout:641: read oid 43 snap -1 2024-03-30T12:24:11.313 INFO:tasks.rados.rados.0.smithi084.stdout:641: expect (ObjNum 207 snap 62 seq_num 207) 2024-03-30T12:24:11.313 INFO:tasks.rados.rados.0.smithi084.stdout:642: delete oid 10 current snap is 62 2024-03-30T12:24:11.313 INFO:tasks.rados.rados.0.smithi084.stdout:635: expect (ObjNum 29 snap 0 seq_num 29) 2024-03-30T12:24:11.337 INFO:tasks.rados.rados.0.smithi084.stdout:636: finishing copy_from racing read to smithi08477944-33 2024-03-30T12:24:11.337 INFO:tasks.rados.rados.0.smithi084.stdout:636: finishing copy_from to smithi08477944-33 2024-03-30T12:24:11.337 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 228 (ObjNum 191 snap 50 seq_num 191) dirty exists 2024-03-30T12:24:11.337 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 379 (ObjNum 199 snap 58 seq_num 199) dirty exists 2024-03-30T12:24:11.337 INFO:tasks.rados.rados.0.smithi084.stdout:638: expect (ObjNum 176 snap 49 seq_num 176) 2024-03-30T12:24:11.388 INFO:tasks.rados.rados.0.smithi084.stdout:640: finishing copy_from racing read to smithi08477944-17 2024-03-30T12:24:11.388 INFO:tasks.rados.rados.0.smithi084.stdout:640: finishing copy_from to smithi08477944-17 2024-03-30T12:24:11.388 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 369 (ObjNum 186 snap 50 seq_num 186) dirty exists 2024-03-30T12:24:11.388 INFO:tasks.rados.rados.0.smithi084.stdout:641: expect (ObjNum 207 snap 62 seq_num 207) 2024-03-30T12:24:11.464 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[63659]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:24:11] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-03-30T12:24:11.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:11 smithi084 ceph-mon[37565]: mgrmap e34: y(active, since 11s), standbys: x 2024-03-30T12:24:11.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:11 smithi084 ceph-mon[27000]: mgrmap e34: y(active, since 11s), standbys: x 2024-03-30T12:24:11.509 INFO:tasks.rados.rados.0.smithi084.stdout:635: done (6 left) 2024-03-30T12:24:11.509 INFO:tasks.rados.rados.0.smithi084.stdout:636: done (5 left) 2024-03-30T12:24:11.509 INFO:tasks.rados.rados.0.smithi084.stdout:638: done (4 left) 2024-03-30T12:24:11.509 INFO:tasks.rados.rados.0.smithi084.stdout:639: done (3 left) 2024-03-30T12:24:11.509 INFO:tasks.rados.rados.0.smithi084.stdout:640: done (2 left) 2024-03-30T12:24:11.509 INFO:tasks.rados.rados.0.smithi084.stdout:641: done (1 left) 2024-03-30T12:24:11.509 INFO:tasks.rados.rados.0.smithi084.stdout:642: done (0 left) 2024-03-30T12:24:11.509 INFO:tasks.rados.rados.0.smithi084.stdout:643: snap_remove snap 55 2024-03-30T12:24:12.136 INFO:tasks.rados.rados.0.smithi084.stdout:643: done (0 left) 2024-03-30T12:24:12.136 INFO:tasks.rados.rados.0.smithi084.stdout:644: snap_remove snap 53 2024-03-30T12:24:12.284 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:12 smithi162 ceph-mon[30421]: pgmap v21: 121 pgs: 121 active+clean; 70 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 6.5 MiB/s rd, 3.6 MiB/s wr, 34 op/s 2024-03-30T12:24:12.284 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:12 smithi162 ceph-mon[30421]: osdmap e189: 8 total, 8 up, 8 in 2024-03-30T12:24:12.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:12 smithi084 ceph-mon[37565]: pgmap v21: 121 pgs: 121 active+clean; 70 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 6.5 MiB/s rd, 3.6 MiB/s wr, 34 op/s 2024-03-30T12:24:12.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:12 smithi084 ceph-mon[37565]: osdmap e189: 8 total, 8 up, 8 in 2024-03-30T12:24:12.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:12 smithi084 ceph-mon[27000]: pgmap v21: 121 pgs: 121 active+clean; 70 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 6.5 MiB/s rd, 3.6 MiB/s wr, 34 op/s 2024-03-30T12:24:12.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:12 smithi084 ceph-mon[27000]: osdmap e189: 8 total, 8 up, 8 in 2024-03-30T12:24:12.619 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:12 smithi162 systemd[1]: Stopping Ceph prometheus.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:24:12.982 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:24:12.706Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-03-30T12:24:12.982 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:24:12.706Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-03-30T12:24:12.982 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:24:12.706Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-03-30T12:24:12.982 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:24:12.706Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-03-30T12:24:12.982 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:24:12.706Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-03-30T12:24:12.982 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:24:12.706Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-03-30T12:24:12.982 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:24:12.706Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-03-30T12:24:12.982 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:24:12.706Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-03-30T12:24:12.982 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:24:12.706Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-03-30T12:24:12.983 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:24:12.706Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-03-30T12:24:12.983 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:24:12.706Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-03-30T12:24:12.983 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[71926]: ts=2024-03-30T12:24:12.706Z caller=main.go:1147 level=info msg="See you next time!" 2024-03-30T12:24:12.983 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:12 smithi162 podman[74423]: 2024-03-30 12:24:12.716394373 +0000 UTC m=+0.133261368 container died 9f1dfafa5a09a8886d65b8ddcbdd12e9b7eb811165af221b327f587682af4b3f (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:24:13.148 INFO:tasks.rados.rados.0.smithi084.stdout:644: done (0 left) 2024-03-30T12:24:13.148 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 62 2024-03-30T12:24:13.148 INFO:tasks.rados.rados.0.smithi084.stdout:645: seq_num 211 ranges {909312=737280,1646592=401408} 2024-03-30T12:24:13.158 INFO:tasks.rados.rados.0.smithi084.stdout:645: writing smithi08477944-14 from 909312 to 1646592 tid 1 2024-03-30T12:24:13.161 INFO:tasks.rados.rados.0.smithi084.stdout:645: writing smithi08477944-14 from 1646592 to 2048000 tid 2 2024-03-30T12:24:13.162 INFO:tasks.rados.rados.0.smithi084.stdout:646: read oid 31 snap -1 2024-03-30T12:24:13.162 INFO:tasks.rados.rados.0.smithi084.stdout:646: expect (ObjNum 200 snap 58 seq_num 200) 2024-03-30T12:24:13.163 INFO:tasks.rados.rados.0.smithi084.stdout:647: rollback oid 17 current snap is 62 2024-03-30T12:24:13.163 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 17 to 61 2024-03-30T12:24:13.163 INFO:tasks.rados.rados.0.smithi084.stdout:648: rollback oid 2 current snap is 62 2024-03-30T12:24:13.163 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 2 to 51 2024-03-30T12:24:13.163 INFO:tasks.rados.rados.0.smithi084.stdout:649: read oid 39 snap -1 2024-03-30T12:24:13.163 INFO:tasks.rados.rados.0.smithi084.stdout:649: expect (ObjNum 136 snap 32 seq_num 136) 2024-03-30T12:24:13.163 INFO:tasks.rados.rados.0.smithi084.stdout:650: read oid 46 snap 50 2024-03-30T12:24:13.163 INFO:tasks.rados.rados.0.smithi084.stdout:650: expect (ObjNum 107 snap 22 seq_num 107) 2024-03-30T12:24:13.163 INFO:tasks.rados.rados.0.smithi084.stdout:651: snap_create 2024-03-30T12:24:13.163 INFO:tasks.rados.rados.0.smithi084.stdout:648: finishing rollback tid 1 to smithi08477944-2 2024-03-30T12:24:13.163 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 0 (ObjNum 65 snap 0 seq_num 1633445225) dirty dne 2024-03-30T12:24:13.165 INFO:tasks.rados.rados.0.smithi084.stdout:645: finishing write tid 1 to smithi08477944-14 2024-03-30T12:24:13.166 INFO:tasks.rados.rados.0.smithi084.stdout:645: finishing write tid 2 to smithi08477944-14 2024-03-30T12:24:13.166 INFO:tasks.rados.rados.0.smithi084.stdout:645: finishing write tid 3 to smithi08477944-14 2024-03-30T12:24:13.167 INFO:tasks.rados.rados.0.smithi084.stdout:645: finishing write tid 4 to smithi08477944-14 2024-03-30T12:24:13.167 INFO:tasks.rados.rados.0.smithi084.stdout:645: oid 14 updating version 0 to 268 2024-03-30T12:24:13.167 INFO:tasks.rados.rados.0.smithi084.stdout:645: oid 14 updating version 268 to 270 2024-03-30T12:24:13.168 INFO:tasks.rados.rados.0.smithi084.stdout:645: oid 14 version 270 is already newer than 269 2024-03-30T12:24:13.168 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 270 (ObjNum 211 snap 62 seq_num 211) dirty exists 2024-03-30T12:24:13.168 INFO:tasks.rados.rados.0.smithi084.stdout:645: left oid 14 (ObjNum 211 snap 62 seq_num 211) 2024-03-30T12:24:13.169 INFO:tasks.rados.rados.0.smithi084.stdout:647: finishing rollback tid 0 to smithi08477944-17 2024-03-30T12:24:13.170 INFO:tasks.rados.rados.0.smithi084.stdout:647: finishing rollback tid 1 to smithi08477944-17 2024-03-30T12:24:13.170 INFO:tasks.rados.rados.0.smithi084.stdout:647: finishing rollback tid 2 to smithi08477944-17 2024-03-30T12:24:13.170 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 372 (ObjNum 55 snap 3 seq_num 55) dirty exists 2024-03-30T12:24:13.171 INFO:tasks.rados.rados.0.smithi084.stdout:650: expect (ObjNum 107 snap 22 seq_num 107) 2024-03-30T12:24:13.218 INFO:tasks.rados.rados.0.smithi084.stdout:646: expect (ObjNum 200 snap 58 seq_num 200) 2024-03-30T12:24:13.242 INFO:tasks.rados.rados.0.smithi084.stdout:649: expect (ObjNum 136 snap 32 seq_num 136) 2024-03-30T12:24:13.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:13 smithi162 ceph-mon[30421]: osdmap e190: 8 total, 8 up, 8 in 2024-03-30T12:24:13.370 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:13 smithi162 podman[74423]: 2024-03-30 12:24:13.190151633 +0000 UTC m=+0.607018620 container cleanup 9f1dfafa5a09a8886d65b8ddcbdd12e9b7eb811165af221b327f587682af4b3f (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:24:13.370 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:13 smithi162 bash[74423]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a 2024-03-30T12:24:13.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:13 smithi084 ceph-mon[37565]: osdmap e190: 8 total, 8 up, 8 in 2024-03-30T12:24:13.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:13 smithi084 ceph-mon[27000]: osdmap e190: 8 total, 8 up, 8 in 2024-03-30T12:24:13.811 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:13 smithi162 podman[74437]: 2024-03-30 12:24:13.458084328 +0000 UTC m=+0.744899191 container remove 9f1dfafa5a09a8886d65b8ddcbdd12e9b7eb811165af221b327f587682af4b3f (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:24:13.812 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:13 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@prometheus.a.service: Deactivated successfully. 2024-03-30T12:24:13.812 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:13 smithi162 systemd[1]: Stopped Ceph prometheus.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:24:13.812 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:13 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@prometheus.a.service: Consumed 1.062s CPU time. 2024-03-30T12:24:13.812 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:13 smithi162 systemd[1]: Starting Ceph prometheus.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:24:14.077 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:13 smithi162 podman[74532]: 2024-03-30 12:24:13.724337321 +0000 UTC m=+0.019125494 image pull a07b618ecd1dce142bce4c52f0e80982eaf1f14265a2415c2d35978ccaa0a464 quay.io/prometheus/prometheus:v2.43.0 2024-03-30T12:24:14.078 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:13 smithi162 podman[74532]: 2024-03-30 12:24:13.850759483 +0000 UTC m=+0.145547633 container create bd7d323e4b47f5b925fd0b03e0e115caf2c83241ec4d8f8755e483ac59be31a4 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:24:14.078 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 podman[74532]: 2024-03-30 12:24:14.086937215 +0000 UTC m=+0.381725387 container init bd7d323e4b47f5b925fd0b03e0e115caf2c83241ec4d8f8755e483ac59be31a4 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:24:14.152 INFO:tasks.rados.rados.0.smithi084.stdout:645: done (6 left) 2024-03-30T12:24:14.152 INFO:tasks.rados.rados.0.smithi084.stdout:646: done (5 left) 2024-03-30T12:24:14.152 INFO:tasks.rados.rados.0.smithi084.stdout:647: done (4 left) 2024-03-30T12:24:14.152 INFO:tasks.rados.rados.0.smithi084.stdout:648: done (3 left) 2024-03-30T12:24:14.152 INFO:tasks.rados.rados.0.smithi084.stdout:649: done (2 left) 2024-03-30T12:24:14.152 INFO:tasks.rados.rados.0.smithi084.stdout:650: done (1 left) 2024-03-30T12:24:14.152 INFO:tasks.rados.rados.0.smithi084.stdout:651: done (0 left) 2024-03-30T12:24:14.152 INFO:tasks.rados.rados.0.smithi084.stdout:652: read oid 27 snap -1 2024-03-30T12:24:14.152 INFO:tasks.rados.rados.0.smithi084.stdout:652: expect (ObjNum 203 snap 61 seq_num 203) 2024-03-30T12:24:14.152 INFO:tasks.rados.rados.0.smithi084.stdout:653: snap_create 2024-03-30T12:24:14.164 INFO:tasks.rados.rados.0.smithi084.stdout:652: expect (ObjNum 203 snap 61 seq_num 203) 2024-03-30T12:24:14.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-mon[30421]: pgmap v24: 121 pgs: 121 active+clean; 70 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 6.5 MiB/s rd, 3.6 MiB/s wr, 34 op/s 2024-03-30T12:24:14.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-mon[30421]: osdmap e191: 8 total, 8 up, 8 in 2024-03-30T12:24:14.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:24:14.370 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 podman[74532]: 2024-03-30 12:24:14.090599038 +0000 UTC m=+0.385387185 container start bd7d323e4b47f5b925fd0b03e0e115caf2c83241ec4d8f8755e483ac59be31a4 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:24:14.370 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:24:14.124Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-03-30T12:24:14.370 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:24:14.124Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-03-30T12:24:14.370 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:24:14.124Z caller=main.go:570 level=info host_details="(Linux 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 x86_64 smithi162 (none))" 2024-03-30T12:24:14.370 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:24:14.124Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-03-30T12:24:14.371 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:24:14.124Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-03-30T12:24:14.371 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:24:14.126Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-03-30T12:24:14.371 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:24:14.126Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-03-30T12:24:14.371 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:24:14.127Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-03-30T12:24:14.371 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:24:14.127Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-03-30T12:24:14.371 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:24:14.129Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-03-30T12:24:14.371 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:24:14.129Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=57.7µs 2024-03-30T12:24:14.371 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:24:14.129Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-03-30T12:24:14.371 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:24:14.131Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=3 2024-03-30T12:24:14.371 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:24:14.137Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=3 2024-03-30T12:24:14.371 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:24:14.141Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=3 2024-03-30T12:24:14.371 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:24:14.141Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=3 2024-03-30T12:24:14.371 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:24:14.141Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=70.17µs wal_replay_duration=11.764802ms wbl_replay_duration=112ns total_replay_duration=12.035333ms 2024-03-30T12:24:14.372 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:24:14.143Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-03-30T12:24:14.372 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:24:14.143Z caller=main.go:1029 level=info msg="TSDB started" 2024-03-30T12:24:14.372 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:24:14.143Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-03-30T12:24:14.372 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:24:14.163Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=20.607033ms db_storage=861ns remote_storage=1.408µs web_handler=365ns query_engine=594ns scrape=276.284µs scrape_sd=78.576µs notify=9.304µs notify_sd=22.829µs rules=20.000508ms tracing=7.954µs 2024-03-30T12:24:14.372 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:24:14.164Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-03-30T12:24:14.372 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:24:14.164Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-03-30T12:24:14.372 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 bash[74532]: bd7d323e4b47f5b925fd0b03e0e115caf2c83241ec4d8f8755e483ac59be31a4 2024-03-30T12:24:14.372 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:24:14 smithi162 systemd[1]: Started Ceph prometheus.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:24:14.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:14 smithi084 ceph-mon[37565]: pgmap v24: 121 pgs: 121 active+clean; 70 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 6.5 MiB/s rd, 3.6 MiB/s wr, 34 op/s 2024-03-30T12:24:14.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:14 smithi084 ceph-mon[37565]: osdmap e191: 8 total, 8 up, 8 in 2024-03-30T12:24:14.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:14 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:24:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:14 smithi084 ceph-mon[27000]: pgmap v24: 121 pgs: 121 active+clean; 70 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 6.5 MiB/s rd, 3.6 MiB/s wr, 34 op/s 2024-03-30T12:24:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:14 smithi084 ceph-mon[27000]: osdmap e191: 8 total, 8 up, 8 in 2024-03-30T12:24:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:14 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:24:15.154 INFO:tasks.rados.rados.0.smithi084.stdout:652: done (1 left) 2024-03-30T12:24:15.154 INFO:tasks.rados.rados.0.smithi084.stdout:653: done (0 left) 2024-03-30T12:24:15.154 INFO:tasks.rados.rados.0.smithi084.stdout:654: read oid 9 snap -1 2024-03-30T12:24:15.154 INFO:tasks.rados.rados.0.smithi084.stdout:654: expect deleted 2024-03-30T12:24:15.154 INFO:tasks.rados.rados.0.smithi084.stdout:655: snap_remove snap 60 2024-03-30T12:24:15.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:15 smithi162 ceph-mon[30421]: osdmap e192: 8 total, 8 up, 8 in 2024-03-30T12:24:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:15 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:15 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:15 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T12:24:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:15 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:15.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:15 smithi084 ceph-mon[37565]: osdmap e192: 8 total, 8 up, 8 in 2024-03-30T12:24:15.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:15 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:15.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:15 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:15.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:15 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T12:24:15.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:15 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:15.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:15 smithi084 ceph-mon[27000]: osdmap e192: 8 total, 8 up, 8 in 2024-03-30T12:24:15.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:15 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:15.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:15 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:15.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:15 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T12:24:15.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:15 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:16.164 INFO:tasks.rados.rados.0.smithi084.stdout:655: done (1 left) 2024-03-30T12:24:16.164 INFO:tasks.rados.rados.0.smithi084.stdout:656: copy_from oid 21 from oid 38 current snap is 64 2024-03-30T12:24:16.165 INFO:tasks.rados.rados.0.smithi084.stdout:654: done (1 left) 2024-03-30T12:24:16.165 INFO:tasks.rados.rados.0.smithi084.stdout:657: rmattr oid 22 current snap is 64 2024-03-30T12:24:16.165 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 64 2024-03-30T12:24:16.165 INFO:tasks.rados.rados.0.smithi084.stdout:658: seq_num 212 ranges {0=753664,753664=401408} 2024-03-30T12:24:16.169 INFO:tasks.rados.rados.0.smithi084.stdout:658: writing smithi08477944-2 from 0 to 753664 tid 1 2024-03-30T12:24:16.173 INFO:tasks.rados.rados.0.smithi084.stdout:658: writing smithi08477944-2 from 753664 to 1155072 tid 2 2024-03-30T12:24:16.173 INFO:tasks.rados.rados.0.smithi084.stdout:659: read oid 34 snap 52 2024-03-30T12:24:16.173 INFO:tasks.rados.rados.0.smithi084.stdout:659: expect deleted 2024-03-30T12:24:16.173 INFO:tasks.rados.rados.0.smithi084.stdout:660: read oid 10 snap -1 2024-03-30T12:24:16.173 INFO:tasks.rados.rados.0.smithi084.stdout:660: expect deleted 2024-03-30T12:24:16.173 INFO:tasks.rados.rados.0.smithi084.stdout:661: rmattr oid 40 current snap is 64 2024-03-30T12:24:16.173 INFO:tasks.rados.rados.0.smithi084.stdout:661: done (5 left) 2024-03-30T12:24:16.173 INFO:tasks.rados.rados.0.smithi084.stdout:662: rmattr oid 49 current snap is 64 2024-03-30T12:24:16.173 INFO:tasks.rados.rados.0.smithi084.stdout:662: done (5 left) 2024-03-30T12:24:16.173 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 64 2024-03-30T12:24:16.173 INFO:tasks.rados.rados.0.smithi084.stdout:656: finishing copy_from to smithi08477944-21 2024-03-30T12:24:16.173 INFO:tasks.rados.rados.0.smithi084.stdout:656: got expected ENOENT (src dne) 2024-03-30T12:24:16.174 INFO:tasks.rados.rados.0.smithi084.stdout:656: finishing copy_from racing read to smithi08477944-21 2024-03-30T12:24:16.174 INFO:tasks.rados.rados.0.smithi084.stdout:663: seq_num 213 ranges {1318912=770048,2088960=401408} 2024-03-30T12:24:16.185 INFO:tasks.rados.rados.0.smithi084.stdout:663: writing smithi08477944-24 from 1318912 to 2088960 tid 1 2024-03-30T12:24:16.188 INFO:tasks.rados.rados.0.smithi084.stdout:663: writing smithi08477944-24 from 2088960 to 2490368 tid 2 2024-03-30T12:24:16.188 INFO:tasks.rados.rados.0.smithi084.stdout:656: done (5 left) 2024-03-30T12:24:16.188 INFO:tasks.rados.rados.0.smithi084.stdout:664: rollback oid 33 current snap is 64 2024-03-30T12:24:16.188 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 33 to 58 2024-03-30T12:24:16.188 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 360 (ObjNum 199 snap 58 seq_num 199) dirty exists 2024-03-30T12:24:16.188 INFO:tasks.rados.rados.0.smithi084.stdout:658: finishing write tid 1 to smithi08477944-2 2024-03-30T12:24:16.188 INFO:tasks.rados.rados.0.smithi084.stdout:658: finishing write tid 2 to smithi08477944-2 2024-03-30T12:24:16.188 INFO:tasks.rados.rados.0.smithi084.stdout:658: finishing write tid 3 to smithi08477944-2 2024-03-30T12:24:16.188 INFO:tasks.rados.rados.0.smithi084.stdout:658: finishing write tid 4 to smithi08477944-2 2024-03-30T12:24:16.188 INFO:tasks.rados.rados.0.smithi084.stdout:658: oid 2 updating version 0 to 361 2024-03-30T12:24:16.189 INFO:tasks.rados.rados.0.smithi084.stdout:658: oid 2 updating version 361 to 363 2024-03-30T12:24:16.189 INFO:tasks.rados.rados.0.smithi084.stdout:658: oid 2 version 363 is already newer than 362 2024-03-30T12:24:16.189 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 363 (ObjNum 212 snap 64 seq_num 212) dirty exists 2024-03-30T12:24:16.189 INFO:tasks.rados.rados.0.smithi084.stdout:658: left oid 2 (ObjNum 212 snap 64 seq_num 212) 2024-03-30T12:24:16.189 INFO:tasks.rados.rados.0.smithi084.stdout:657: done (5 left) 2024-03-30T12:24:16.189 INFO:tasks.rados.rados.0.smithi084.stdout:658: done (4 left) 2024-03-30T12:24:16.189 INFO:tasks.rados.rados.0.smithi084.stdout:659: done (3 left) 2024-03-30T12:24:16.189 INFO:tasks.rados.rados.0.smithi084.stdout:660: done (2 left) 2024-03-30T12:24:16.189 INFO:tasks.rados.rados.0.smithi084.stdout:665: delete oid 35 current snap is 64 2024-03-30T12:24:16.190 INFO:tasks.rados.rados.0.smithi084.stdout:663: finishing write tid 1 to smithi08477944-24 2024-03-30T12:24:16.191 INFO:tasks.rados.rados.0.smithi084.stdout:664: finishing rollback tid 0 to smithi08477944-33 2024-03-30T12:24:16.191 INFO:tasks.rados.rados.0.smithi084.stdout:664: finishing rollback tid 1 to smithi08477944-33 2024-03-30T12:24:16.191 INFO:tasks.rados.rados.0.smithi084.stdout:664: finishing rollback tid 2 to smithi08477944-33 2024-03-30T12:24:16.191 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 407 (ObjNum 33 snap 0 seq_num 1429437056) dirty exists 2024-03-30T12:24:16.192 INFO:tasks.rados.rados.0.smithi084.stdout:664: done (2 left) 2024-03-30T12:24:16.192 INFO:tasks.rados.rados.0.smithi084.stdout:665: done (1 left) 2024-03-30T12:24:16.192 INFO:tasks.rados.rados.0.smithi084.stdout:666: rmattr oid 37 current snap is 64 2024-03-30T12:24:16.192 INFO:tasks.rados.rados.0.smithi084.stdout:666: done (1 left) 2024-03-30T12:24:16.192 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 64 2024-03-30T12:24:16.192 INFO:tasks.rados.rados.0.smithi084.stdout:667: seq_num 215 ranges {1155072=409600,1564672=532480,2097152=270336} 2024-03-30T12:24:16.200 INFO:tasks.rados.rados.0.smithi084.stdout:667: writing smithi08477944-2 from 1155072 to 1564672 tid 1 2024-03-30T12:24:16.203 INFO:tasks.rados.rados.0.smithi084.stdout:667: writing smithi08477944-2 from 1564672 to 2097152 tid 2 2024-03-30T12:24:16.205 INFO:tasks.rados.rados.0.smithi084.stdout:667: writing smithi08477944-2 from 2097152 to 2367488 tid 3 2024-03-30T12:24:16.205 INFO:tasks.rados.rados.0.smithi084.stdout:668: rollback oid 29 current snap is 64 2024-03-30T12:24:16.205 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 29 to 54 2024-03-30T12:24:16.206 INFO:tasks.rados.rados.0.smithi084.stdout:663: finishing write tid 2 to smithi08477944-24 2024-03-30T12:24:16.206 INFO:tasks.rados.rados.0.smithi084.stdout:663: finishing write tid 3 to smithi08477944-24 2024-03-30T12:24:16.206 INFO:tasks.rados.rados.0.smithi084.stdout:663: finishing write tid 4 to smithi08477944-24 2024-03-30T12:24:16.206 INFO:tasks.rados.rados.0.smithi084.stdout:663: oid 24 updating version 0 to 153 2024-03-30T12:24:16.206 INFO:tasks.rados.rados.0.smithi084.stdout:663: oid 24 version 153 is already newer than 151 2024-03-30T12:24:16.206 INFO:tasks.rados.rados.0.smithi084.stdout:663: oid 24 version 153 is already newer than 152 2024-03-30T12:24:16.206 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 153 (ObjNum 213 snap 64 seq_num 213) dirty exists 2024-03-30T12:24:16.206 INFO:tasks.rados.rados.0.smithi084.stdout:663: left oid 24 (ObjNum 213 snap 64 seq_num 213) 2024-03-30T12:24:16.206 INFO:tasks.rados.rados.0.smithi084.stdout:667: finishing write tid 1 to smithi08477944-2 2024-03-30T12:24:16.206 INFO:tasks.rados.rados.0.smithi084.stdout:663: done (2 left) 2024-03-30T12:24:16.206 INFO:tasks.rados.rados.0.smithi084.stdout:669: read oid 38 snap -1 2024-03-30T12:24:16.206 INFO:tasks.rados.rados.0.smithi084.stdout:669: expect deleted 2024-03-30T12:24:16.206 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 64 2024-03-30T12:24:16.206 INFO:tasks.rados.rados.0.smithi084.stdout:670: seq_num 216 ranges {3907584=425984,4333568=409600,4743168=393216} 2024-03-30T12:24:16.228 INFO:tasks.rados.rados.0.smithi084.stdout:670: writing smithi08477944-13 from 3907584 to 4333568 tid 1 2024-03-30T12:24:16.230 INFO:tasks.rados.rados.0.smithi084.stdout:670: writing smithi08477944-13 from 4333568 to 4743168 tid 2 2024-03-30T12:24:16.233 INFO:tasks.rados.rados.0.smithi084.stdout:670: writing smithi08477944-13 from 4743168 to 5136384 tid 3 2024-03-30T12:24:16.233 INFO:tasks.rados.rados.0.smithi084.stdout:671: setattr oid 40 current snap is 64 2024-03-30T12:24:16.233 INFO:tasks.rados.rados.0.smithi084.stdout:667: finishing write tid 2 to smithi08477944-2 2024-03-30T12:24:16.234 INFO:tasks.rados.rados.0.smithi084.stdout:667: finishing write tid 3 to smithi08477944-2 2024-03-30T12:24:16.234 INFO:tasks.rados.rados.0.smithi084.stdout:667: finishing write tid 4 to smithi08477944-2 2024-03-30T12:24:16.234 INFO:tasks.rados.rados.0.smithi084.stdout:668: finishing rollback tid 0 to smithi08477944-29 2024-03-30T12:24:16.234 INFO:tasks.rados.rados.0.smithi084.stdout:668: finishing rollback tid 1 to smithi08477944-29 2024-03-30T12:24:16.234 INFO:tasks.rados.rados.0.smithi084.stdout:668: finishing rollback tid 2 to smithi08477944-29 2024-03-30T12:24:16.234 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 245 (ObjNum 142 snap 36 seq_num 142) dirty exists 2024-03-30T12:24:16.234 INFO:tasks.rados.rados.0.smithi084.stdout:667: finishing write tid 5 to smithi08477944-2 2024-03-30T12:24:16.234 INFO:tasks.rados.rados.0.smithi084.stdout:667: oid 2 updating version 0 to 365 2024-03-30T12:24:16.234 INFO:tasks.rados.rados.0.smithi084.stdout:667: oid 2 updating version 365 to 366 2024-03-30T12:24:16.234 INFO:tasks.rados.rados.0.smithi084.stdout:667: oid 2 updating version 366 to 367 2024-03-30T12:24:16.234 INFO:tasks.rados.rados.0.smithi084.stdout:667: oid 2 version 367 is already newer than 364 2024-03-30T12:24:16.234 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 367 (ObjNum 215 snap 64 seq_num 215) dirty exists 2024-03-30T12:24:16.234 INFO:tasks.rados.rados.0.smithi084.stdout:667: left oid 2 (ObjNum 215 snap 64 seq_num 215) 2024-03-30T12:24:16.235 INFO:tasks.rados.rados.0.smithi084.stdout:670: finishing write tid 1 to smithi08477944-13 2024-03-30T12:24:16.235 INFO:tasks.rados.rados.0.smithi084.stdout:670: finishing write tid 2 to smithi08477944-13 2024-03-30T12:24:16.235 INFO:tasks.rados.rados.0.smithi084.stdout:667: done (4 left) 2024-03-30T12:24:16.235 INFO:tasks.rados.rados.0.smithi084.stdout:668: done (3 left) 2024-03-30T12:24:16.235 INFO:tasks.rados.rados.0.smithi084.stdout:669: done (2 left) 2024-03-30T12:24:16.236 INFO:tasks.rados.rados.0.smithi084.stdout:672: copy_from oid 41 from oid 48 current snap is 64 2024-03-30T12:24:16.236 INFO:tasks.rados.rados.0.smithi084.stdout:673: read oid 11 snap 58 2024-03-30T12:24:16.236 INFO:tasks.rados.rados.0.smithi084.stdout:673: expect (ObjNum 170 snap 46 seq_num 170) 2024-03-30T12:24:16.236 INFO:tasks.rados.rados.0.smithi084.stdout:674: rmattr oid 23 current snap is 64 2024-03-30T12:24:16.236 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 64 2024-03-30T12:24:16.236 INFO:tasks.rados.rados.0.smithi084.stdout:675: seq_num 217 ranges {4079616=442368,4521984=696320,5218304=106496} 2024-03-30T12:24:16.259 INFO:tasks.rados.rados.0.smithi084.stdout:675: writing smithi08477944-22 from 4079616 to 4521984 tid 1 2024-03-30T12:24:16.263 INFO:tasks.rados.rados.0.smithi084.stdout:675: writing smithi08477944-22 from 4521984 to 5218304 tid 2 2024-03-30T12:24:16.264 INFO:tasks.rados.rados.0.smithi084.stdout:675: writing smithi08477944-22 from 5218304 to 5324800 tid 3 2024-03-30T12:24:16.264 INFO:tasks.rados.rados.0.smithi084.stdout:676: rmattr oid 43 current snap is 64 2024-03-30T12:24:16.264 INFO:tasks.rados.rados.0.smithi084.stdout:676: done (6 left) 2024-03-30T12:24:16.264 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 64 2024-03-30T12:24:16.264 INFO:tasks.rados.rados.0.smithi084.stdout:670: finishing write tid 3 to smithi08477944-13 2024-03-30T12:24:16.264 INFO:tasks.rados.rados.0.smithi084.stdout:670: finishing write tid 4 to smithi08477944-13 2024-03-30T12:24:16.264 INFO:tasks.rados.rados.0.smithi084.stdout:670: finishing write tid 5 to smithi08477944-13 2024-03-30T12:24:16.265 INFO:tasks.rados.rados.0.smithi084.stdout:670: oid 13 updating version 0 to 155 2024-03-30T12:24:16.265 INFO:tasks.rados.rados.0.smithi084.stdout:670: oid 13 updating version 155 to 156 2024-03-30T12:24:16.265 INFO:tasks.rados.rados.0.smithi084.stdout:670: oid 13 updating version 156 to 157 2024-03-30T12:24:16.265 INFO:tasks.rados.rados.0.smithi084.stdout:670: oid 13 version 157 is already newer than 154 2024-03-30T12:24:16.265 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 157 (ObjNum 216 snap 64 seq_num 216) dirty exists 2024-03-30T12:24:16.265 INFO:tasks.rados.rados.0.smithi084.stdout:670: left oid 13 (ObjNum 216 snap 64 seq_num 216) 2024-03-30T12:24:16.265 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 409 (ObjNum 205 snap 62 seq_num 205) dirty exists 2024-03-30T12:24:16.265 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 281 (ObjNum 196 snap 55 seq_num 196) dirty exists 2024-03-30T12:24:16.265 INFO:tasks.rados.rados.0.smithi084.stdout:673: expect (ObjNum 170 snap 46 seq_num 170) 2024-03-30T12:24:16.276 INFO:tasks.rados.rados.0.smithi084.stdout:672: finishing copy_from racing read to smithi08477944-41 2024-03-30T12:24:16.276 INFO:tasks.rados.rados.0.smithi084.stdout:672: finishing copy_from to smithi08477944-41 2024-03-30T12:24:16.276 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 328 (ObjNum 189 snap 50 seq_num 189) dirty exists 2024-03-30T12:24:16.276 INFO:tasks.rados.rados.0.smithi084.stdout:675: finishing write tid 1 to smithi08477944-22 2024-03-30T12:24:16.276 INFO:tasks.rados.rados.0.smithi084.stdout:675: finishing write tid 2 to smithi08477944-22 2024-03-30T12:24:16.276 INFO:tasks.rados.rados.0.smithi084.stdout:675: finishing write tid 3 to smithi08477944-22 2024-03-30T12:24:16.276 INFO:tasks.rados.rados.0.smithi084.stdout:675: finishing write tid 4 to smithi08477944-22 2024-03-30T12:24:16.276 INFO:tasks.rados.rados.0.smithi084.stdout:677: seq_num 218 ranges {0=458752,458752=581632,1040384=221184} 2024-03-30T12:24:16.278 INFO:tasks.rados.rados.0.smithi084.stdout:677: writing smithi08477944-6 from 0 to 458752 tid 1 2024-03-30T12:24:16.282 INFO:tasks.rados.rados.0.smithi084.stdout:677: writing smithi08477944-6 from 458752 to 1040384 tid 2 2024-03-30T12:24:16.284 INFO:tasks.rados.rados.0.smithi084.stdout:677: writing smithi08477944-6 from 1040384 to 1261568 tid 3 2024-03-30T12:24:16.284 INFO:tasks.rados.rados.0.smithi084.stdout:670: done (6 left) 2024-03-30T12:24:16.284 INFO:tasks.rados.rados.0.smithi084.stdout:671: done (5 left) 2024-03-30T12:24:16.284 INFO:tasks.rados.rados.0.smithi084.stdout:672: done (4 left) 2024-03-30T12:24:16.284 INFO:tasks.rados.rados.0.smithi084.stdout:673: done (3 left) 2024-03-30T12:24:16.284 INFO:tasks.rados.rados.0.smithi084.stdout:674: done (2 left) 2024-03-30T12:24:16.284 INFO:tasks.rados.rados.0.smithi084.stdout:678: read oid 18 snap 63 2024-03-30T12:24:16.284 INFO:tasks.rados.rados.0.smithi084.stdout:678: expect (ObjNum 168 snap 46 seq_num 168) 2024-03-30T12:24:16.284 INFO:tasks.rados.rados.0.smithi084.stdout:679: rmattr oid 45 current snap is 64 2024-03-30T12:24:16.285 INFO:tasks.rados.rados.0.smithi084.stdout:675: finishing write tid 5 to smithi08477944-22 2024-03-30T12:24:16.285 INFO:tasks.rados.rados.0.smithi084.stdout:675: oid 22 updating version 0 to 369 2024-03-30T12:24:16.285 INFO:tasks.rados.rados.0.smithi084.stdout:675: oid 22 updating version 369 to 371 2024-03-30T12:24:16.285 INFO:tasks.rados.rados.0.smithi084.stdout:675: oid 22 version 371 is already newer than 368 2024-03-30T12:24:16.285 INFO:tasks.rados.rados.0.smithi084.stdout:675: oid 22 version 371 is already newer than 370 2024-03-30T12:24:16.285 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 371 (ObjNum 217 snap 64 seq_num 217) dirty exists 2024-03-30T12:24:16.285 INFO:tasks.rados.rados.0.smithi084.stdout:675: left oid 22 (ObjNum 217 snap 64 seq_num 217) 2024-03-30T12:24:16.285 INFO:tasks.rados.rados.0.smithi084.stdout:677: finishing write tid 1 to smithi08477944-6 2024-03-30T12:24:16.285 INFO:tasks.rados.rados.0.smithi084.stdout:675: done (3 left) 2024-03-30T12:24:16.285 INFO:tasks.rados.rados.0.smithi084.stdout:680: rmattr oid 48 current snap is 64 2024-03-30T12:24:16.285 INFO:tasks.rados.rados.0.smithi084.stdout:680: done (3 left) 2024-03-30T12:24:16.285 INFO:tasks.rados.rados.0.smithi084.stdout:681: snap_remove snap 59 2024-03-30T12:24:16.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:16 smithi162 ceph-mon[30421]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T12:24:16.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:16 smithi162 ceph-mon[30421]: pgmap v27: 121 pgs: 121 active+clean; 70 MiB data, 639 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:24:16.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:16 smithi162 ceph-mon[30421]: osdmap e193: 8 total, 8 up, 8 in 2024-03-30T12:24:16.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:16 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:24:16.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:16 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T12:24:16.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:16 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:24:16.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:16 smithi084 ceph-mon[37565]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T12:24:16.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:16 smithi084 ceph-mon[37565]: pgmap v27: 121 pgs: 121 active+clean; 70 MiB data, 639 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:24:16.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:16 smithi084 ceph-mon[37565]: osdmap e193: 8 total, 8 up, 8 in 2024-03-30T12:24:16.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:16 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:24:16.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:16 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T12:24:16.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:16 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:24:16.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:16 smithi084 ceph-mon[27000]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T12:24:16.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:16 smithi084 ceph-mon[27000]: pgmap v27: 121 pgs: 121 active+clean; 70 MiB data, 639 MiB used, 715 GiB / 715 GiB avail 2024-03-30T12:24:16.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:16 smithi084 ceph-mon[27000]: osdmap e193: 8 total, 8 up, 8 in 2024-03-30T12:24:16.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:16 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:24:16.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:16 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T12:24:16.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:16 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:24:17.098 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-03-30T12:24:17.171 INFO:tasks.rados.rados.0.smithi084.stdout:681: done (3 left) 2024-03-30T12:24:17.171 INFO:tasks.rados.rados.0.smithi084.stdout:682: snap_create 2024-03-30T12:24:17.171 INFO:tasks.rados.rados.0.smithi084.stdout:677: finishing write tid 2 to smithi08477944-6 2024-03-30T12:24:17.171 INFO:tasks.rados.rados.0.smithi084.stdout:677: finishing write tid 3 to smithi08477944-6 2024-03-30T12:24:17.171 INFO:tasks.rados.rados.0.smithi084.stdout:677: finishing write tid 4 to smithi08477944-6 2024-03-30T12:24:17.171 INFO:tasks.rados.rados.0.smithi084.stdout:677: finishing write tid 5 to smithi08477944-6 2024-03-30T12:24:17.171 INFO:tasks.rados.rados.0.smithi084.stdout:677: oid 6 updating version 0 to 215 2024-03-30T12:24:17.171 INFO:tasks.rados.rados.0.smithi084.stdout:677: oid 6 version 215 is already newer than 214 2024-03-30T12:24:17.172 INFO:tasks.rados.rados.0.smithi084.stdout:677: oid 6 version 215 is already newer than 212 2024-03-30T12:24:17.172 INFO:tasks.rados.rados.0.smithi084.stdout:677: oid 6 version 215 is already newer than 213 2024-03-30T12:24:17.172 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 215 (ObjNum 218 snap 64 seq_num 218) dirty exists 2024-03-30T12:24:17.172 INFO:tasks.rados.rados.0.smithi084.stdout:677: left oid 6 (ObjNum 218 snap 64 seq_num 218) 2024-03-30T12:24:17.172 INFO:tasks.rados.rados.0.smithi084.stdout:678: expect (ObjNum 168 snap 46 seq_num 168) 2024-03-30T12:24:17.200 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 386 (ObjNum 161 snap 42 seq_num 161) dirty exists 2024-03-30T12:24:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:17 smithi162 ceph-mon[30421]: Upgrade: Updating mgr.x 2024-03-30T12:24:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:17 smithi162 ceph-mon[30421]: Deploying daemon mgr.x on smithi162 2024-03-30T12:24:17.361 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:17 smithi162 ceph-mon[30421]: osdmap e194: 8 total, 8 up, 8 in 2024-03-30T12:24:17.420 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:17 smithi084 ceph-mon[37565]: Upgrade: Updating mgr.x 2024-03-30T12:24:17.420 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:17 smithi084 ceph-mon[37565]: Deploying daemon mgr.x on smithi162 2024-03-30T12:24:17.420 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:17 smithi084 ceph-mon[37565]: osdmap e194: 8 total, 8 up, 8 in 2024-03-30T12:24:17.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:17 smithi084 ceph-mon[27000]: Upgrade: Updating mgr.x 2024-03-30T12:24:17.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:17 smithi084 ceph-mon[27000]: Deploying daemon mgr.x on smithi162 2024-03-30T12:24:17.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:17 smithi084 ceph-mon[27000]: osdmap e194: 8 total, 8 up, 8 in 2024-03-30T12:24:17.421 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T12:24:17.421 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (3m) 14s ago 4m 25.2M - 0.25.0 c8568f914cd2 6765ce007f39 2024-03-30T12:24:17.421 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi162 *:3000 running (4m) 13s ago 4m 90.1M - 9.4.7 954c08fa6188 ff2ec7518619 2024-03-30T12:24:17.421 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (5m) 14s ago 5m 13.6M - 18.2.2-1051-gf14b5682 c8fb09e16a7d a9c2e74ca2a3 2024-03-30T12:24:17.421 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi162 running (5m) 13s ago 5m 18.6M - 18.2.2-1051-gf14b5682 c8fb09e16a7d ee1770ef5edd 2024-03-30T12:24:17.421 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi162 *:8443,9283,8765 running (70s) 13s ago 8m 70.9M - 19.0.0-1864-g5dc2ea30 548196a1a838 a9cc7956ea1d 2024-03-30T12:24:17.421 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (27s) 14s ago 10m 476M - 19.0.0-1864-g5dc2ea30 548196a1a838 9a2aba19dffc 2024-03-30T12:24:17.421 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (10m) 14s ago 10m 58.2M 2048M 18.2.2-1051-gf14b5682 c8fb09e16a7d 915abc0d6de7 2024-03-30T12:24:17.421 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi162 running (9m) 13s ago 9m 46.8M 2048M 18.2.2-1051-gf14b5682 c8fb09e16a7d 5bf04eacfc81 2024-03-30T12:24:17.421 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (9m) 14s ago 9m 47.0M 2048M 18.2.2-1051-gf14b5682 c8fb09e16a7d 7db3fd996ae6 2024-03-30T12:24:17.421 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (4m) 14s ago 3m 16.9M - 1.5.0 0da6a335fe13 66844bed39e8 2024-03-30T12:24:17.421 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi162 *:9100 running (3m) 13s ago 3m 15.5M - 1.5.0 0da6a335fe13 3d6e28b2348d 2024-03-30T12:24:17.422 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (8m) 14s ago 8m 154M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 4cad4c4383a6 2024-03-30T12:24:17.422 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (8m) 14s ago 8m 116M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 3b30b0ea0e32 2024-03-30T12:24:17.422 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (7m) 14s ago 7m 130M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d eb2412618811 2024-03-30T12:24:17.422 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (7m) 14s ago 7m 77.5M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 8eaf6dc73c25 2024-03-30T12:24:17.422 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi162 running (6m) 13s ago 6m 127M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 1f52e827b91a 2024-03-30T12:24:17.422 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi162 running (6m) 13s ago 6m 111M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 7ba250d154aa 2024-03-30T12:24:17.422 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi162 running (6m) 13s ago 6m 71.2M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 656a733e8b7a 2024-03-30T12:24:17.422 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi162 running (5m) 13s ago 5m 88.7M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d e3246b3bc88b 2024-03-30T12:24:17.422 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi162 *:9095 starting - - - - 2024-03-30T12:24:17.807 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-30T12:24:17.807 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-03-30T12:24:17.807 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 3 2024-03-30T12:24:17.807 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:24:17.807 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-03-30T12:24:17.807 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 2 2024-03-30T12:24:17.807 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:24:17.807 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-03-30T12:24:17.808 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 8 2024-03-30T12:24:17.808 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:24:17.808 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-03-30T12:24:17.808 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 2 2024-03-30T12:24:17.808 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:24:17.808 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-03-30T12:24:17.808 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 13, 2024-03-30T12:24:17.808 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 2 2024-03-30T12:24:17.808 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-30T12:24:17.808 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-30T12:24:18.172 INFO:tasks.rados.rados.0.smithi084.stdout:677: done (3 left) 2024-03-30T12:24:18.172 INFO:tasks.rados.rados.0.smithi084.stdout:678: done (2 left) 2024-03-30T12:24:18.172 INFO:tasks.rados.rados.0.smithi084.stdout:679: done (1 left) 2024-03-30T12:24:18.172 INFO:tasks.rados.rados.0.smithi084.stdout:682: done (0 left) 2024-03-30T12:24:18.172 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 65 2024-03-30T12:24:18.173 INFO:tasks.rados.rados.0.smithi084.stdout:683: seq_num 219 ranges {704512=475136,1179648=466944,1646592=335872} 2024-03-30T12:24:18.178 INFO:tasks.rados.rados.0.smithi084.stdout:683: writing smithi08477944-18 from 704512 to 1179648 tid 1 2024-03-30T12:24:18.181 INFO:tasks.rados.rados.0.smithi084.stdout:683: writing smithi08477944-18 from 1179648 to 1646592 tid 2 2024-03-30T12:24:18.183 INFO:tasks.rados.rados.0.smithi084.stdout:683: writing smithi08477944-18 from 1646592 to 1982464 tid 3 2024-03-30T12:24:18.183 INFO:tasks.rados.rados.0.smithi084.stdout:684: copy_from oid 5 from oid 33 current snap is 65 2024-03-30T12:24:18.183 INFO:tasks.rados.rados.0.smithi084.stdout:685: snap_remove snap 51 2024-03-30T12:24:18.214 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:17 smithi162 systemd[1]: Stopping Ceph mgr.x for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:24:18.215 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:18 smithi162 ceph-mon[30421]: pgmap v30: 121 pgs: 121 active+clean; 79 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 2.5 MiB/s wr, 22 op/s 2024-03-30T12:24:18.215 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:18 smithi162 ceph-mon[30421]: from='client.25151 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:24:18.215 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:18 smithi162 ceph-mon[30421]: osdmap e195: 8 total, 8 up, 8 in 2024-03-30T12:24:18.215 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:18 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/3743151628' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:24:18.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:18 smithi084 ceph-mon[37565]: pgmap v30: 121 pgs: 121 active+clean; 79 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 2.5 MiB/s wr, 22 op/s 2024-03-30T12:24:18.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:18 smithi084 ceph-mon[37565]: from='client.25151 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:24:18.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:18 smithi084 ceph-mon[37565]: osdmap e195: 8 total, 8 up, 8 in 2024-03-30T12:24:18.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:18 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/3743151628' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:24:18.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:18 smithi084 ceph-mon[27000]: pgmap v30: 121 pgs: 121 active+clean; 79 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 2.5 MiB/s wr, 22 op/s 2024-03-30T12:24:18.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:18 smithi084 ceph-mon[27000]: from='client.25151 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:24:18.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:18 smithi084 ceph-mon[27000]: osdmap e195: 8 total, 8 up, 8 in 2024-03-30T12:24:18.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:18 smithi084 ceph-mon[27000]: from='client.? 172.21.15.84:0/3743151628' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:24:18.525 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:18 smithi162 podman[74883]: 2024-03-30 12:24:18.223306491 +0000 UTC m=+0.144662193 container died a9cc7956ea1df53fd892f4e9f251d84d57221871711afb77adf81b684827ef22 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-03-30T12:24:18.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:18 smithi162 podman[74883]: 2024-03-30 12:24:18.708927349 +0000 UTC m=+0.630283081 container cleanup a9cc7956ea1df53fd892f4e9f251d84d57221871711afb77adf81b684827ef22 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0) 2024-03-30T12:24:18.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:18 smithi162 bash[74883]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x 2024-03-30T12:24:19.181 INFO:tasks.rados.rados.0.smithi084.stdout:685: done (2 left) 2024-03-30T12:24:19.181 INFO:tasks.rados.rados.0.smithi084.stdout:686: rollback oid 46 current snap is 65 2024-03-30T12:24:19.181 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 46 to 50 2024-03-30T12:24:19.181 INFO:tasks.rados.rados.0.smithi084.stdout:683: finishing write tid 1 to smithi08477944-18 2024-03-30T12:24:19.181 INFO:tasks.rados.rados.0.smithi084.stdout:683: finishing write tid 2 to smithi08477944-18 2024-03-30T12:24:19.181 INFO:tasks.rados.rados.0.smithi084.stdout:683: finishing write tid 3 to smithi08477944-18 2024-03-30T12:24:19.181 INFO:tasks.rados.rados.0.smithi084.stdout:683: finishing write tid 4 to smithi08477944-18 2024-03-30T12:24:19.181 INFO:tasks.rados.rados.0.smithi084.stdout:684: finishing copy_from racing read to smithi08477944-5 2024-03-30T12:24:19.181 INFO:tasks.rados.rados.0.smithi084.stdout:683: finishing write tid 5 to smithi08477944-18 2024-03-30T12:24:19.182 INFO:tasks.rados.rados.0.smithi084.stdout:683: oid 18 updating version 0 to 395 2024-03-30T12:24:19.182 INFO:tasks.rados.rados.0.smithi084.stdout:683: oid 18 version 395 is already newer than 394 2024-03-30T12:24:19.182 INFO:tasks.rados.rados.0.smithi084.stdout:683: oid 18 version 395 is already newer than 393 2024-03-30T12:24:19.182 INFO:tasks.rados.rados.0.smithi084.stdout:683: oid 18 version 395 is already newer than 392 2024-03-30T12:24:19.182 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 395 (ObjNum 219 snap 65 seq_num 219) dirty exists 2024-03-30T12:24:19.182 INFO:tasks.rados.rados.0.smithi084.stdout:683: left oid 18 (ObjNum 219 snap 65 seq_num 219) 2024-03-30T12:24:19.183 INFO:tasks.rados.rados.0.smithi084.stdout:684: finishing copy_from to smithi08477944-5 2024-03-30T12:24:19.183 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 407 (ObjNum 81 snap 0 seq_num 1532388430) dirty exists 2024-03-30T12:24:19.183 INFO:tasks.rados.rados.0.smithi084.stdout:683: done (2 left) 2024-03-30T12:24:19.183 INFO:tasks.rados.rados.0.smithi084.stdout:684: done (1 left) 2024-03-30T12:24:19.183 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 65 2024-03-30T12:24:19.183 INFO:tasks.rados.rados.0.smithi084.stdout:687: seq_num 220 ranges {876544=491520,1368064=753664,2121728=49152} 2024-03-30T12:24:19.189 INFO:tasks.rados.rados.0.smithi084.stdout:687: writing smithi08477944-41 from 876544 to 1368064 tid 1 2024-03-30T12:24:19.194 INFO:tasks.rados.rados.0.smithi084.stdout:687: writing smithi08477944-41 from 1368064 to 2121728 tid 2 2024-03-30T12:24:19.195 INFO:tasks.rados.rados.0.smithi084.stdout:687: writing smithi08477944-41 from 2121728 to 2170880 tid 3 2024-03-30T12:24:19.195 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 65 2024-03-30T12:24:19.196 INFO:tasks.rados.rados.0.smithi084.stdout:687: finishing write tid 1 to smithi08477944-41 2024-03-30T12:24:19.196 INFO:tasks.rados.rados.0.smithi084.stdout:686: finishing rollback tid 0 to smithi08477944-46 2024-03-30T12:24:19.196 INFO:tasks.rados.rados.0.smithi084.stdout:686: finishing rollback tid 1 to smithi08477944-46 2024-03-30T12:24:19.196 INFO:tasks.rados.rados.0.smithi084.stdout:686: finishing rollback tid 2 to smithi08477944-46 2024-03-30T12:24:19.196 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 374 (ObjNum 107 snap 22 seq_num 107) dirty exists 2024-03-30T12:24:19.196 INFO:tasks.rados.rados.0.smithi084.stdout:688: seq_num 221 ranges {1654784=507904,2162688=688128,2850816=114688} 2024-03-30T12:24:19.207 INFO:tasks.rados.rados.0.smithi084.stdout:688: writing smithi08477944-23 from 1654784 to 2162688 tid 1 2024-03-30T12:24:19.211 INFO:tasks.rados.rados.0.smithi084.stdout:688: writing smithi08477944-23 from 2162688 to 2850816 tid 2 2024-03-30T12:24:19.212 INFO:tasks.rados.rados.0.smithi084.stdout:688: writing smithi08477944-23 from 2850816 to 2965504 tid 3 2024-03-30T12:24:19.212 INFO:tasks.rados.rados.0.smithi084.stdout:686: done (2 left) 2024-03-30T12:24:19.212 INFO:tasks.rados.rados.0.smithi084.stdout:689: snap_create 2024-03-30T12:24:19.212 INFO:tasks.rados.rados.0.smithi084.stdout:687: finishing write tid 2 to smithi08477944-41 2024-03-30T12:24:19.212 INFO:tasks.rados.rados.0.smithi084.stdout:687: finishing write tid 3 to smithi08477944-41 2024-03-30T12:24:19.212 INFO:tasks.rados.rados.0.smithi084.stdout:687: finishing write tid 4 to smithi08477944-41 2024-03-30T12:24:19.213 INFO:tasks.rados.rados.0.smithi084.stdout:687: finishing write tid 5 to smithi08477944-41 2024-03-30T12:24:19.213 INFO:tasks.rados.rados.0.smithi084.stdout:687: oid 41 updating version 0 to 403 2024-03-30T12:24:19.213 INFO:tasks.rados.rados.0.smithi084.stdout:687: oid 41 version 403 is already newer than 402 2024-03-30T12:24:19.213 INFO:tasks.rados.rados.0.smithi084.stdout:687: oid 41 version 403 is already newer than 397 2024-03-30T12:24:19.213 INFO:tasks.rados.rados.0.smithi084.stdout:687: oid 41 updating version 403 to 404 2024-03-30T12:24:19.213 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 404 (ObjNum 220 snap 65 seq_num 220) dirty exists 2024-03-30T12:24:19.213 INFO:tasks.rados.rados.0.smithi084.stdout:687: left oid 41 (ObjNum 220 snap 65 seq_num 220) 2024-03-30T12:24:19.213 INFO:tasks.rados.rados.0.smithi084.stdout:688: finishing write tid 1 to smithi08477944-23 2024-03-30T12:24:19.214 INFO:tasks.rados.rados.0.smithi084.stdout:688: finishing write tid 2 to smithi08477944-23 2024-03-30T12:24:19.215 INFO:tasks.rados.rados.0.smithi084.stdout:688: finishing write tid 3 to smithi08477944-23 2024-03-30T12:24:19.215 INFO:tasks.rados.rados.0.smithi084.stdout:688: finishing write tid 4 to smithi08477944-23 2024-03-30T12:24:19.216 INFO:tasks.rados.rados.0.smithi084.stdout:688: finishing write tid 5 to smithi08477944-23 2024-03-30T12:24:19.216 INFO:tasks.rados.rados.0.smithi084.stdout:688: oid 23 updating version 0 to 292 2024-03-30T12:24:19.216 INFO:tasks.rados.rados.0.smithi084.stdout:688: oid 23 version 292 is already newer than 290 2024-03-30T12:24:19.216 INFO:tasks.rados.rados.0.smithi084.stdout:688: oid 23 version 292 is already newer than 289 2024-03-30T12:24:19.216 INFO:tasks.rados.rados.0.smithi084.stdout:688: oid 23 version 292 is already newer than 291 2024-03-30T12:24:19.216 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 292 (ObjNum 221 snap 65 seq_num 221) dirty exists 2024-03-30T12:24:19.216 INFO:tasks.rados.rados.0.smithi084.stdout:688: left oid 23 (ObjNum 221 snap 65 seq_num 221) 2024-03-30T12:24:19.327 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:19 smithi162 ceph-mon[30421]: from='client.15267 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:24:19.327 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:19 smithi162 ceph-mon[30421]: osdmap e196: 8 total, 8 up, 8 in 2024-03-30T12:24:19.327 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:18 smithi162 podman[74897]: 2024-03-30 12:24:18.97730303 +0000 UTC m=+0.754288264 container remove a9cc7956ea1df53fd892f4e9f251d84d57221871711afb77adf81b684827ef22 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3) 2024-03-30T12:24:19.327 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:18 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-03-30T12:24:19.327 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:19 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mgr.x.service: Failed with result 'exit-code'. 2024-03-30T12:24:19.327 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:19 smithi162 systemd[1]: Stopped Ceph mgr.x for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:24:19.327 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:19 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mgr.x.service: Consumed 25.060s CPU time. 2024-03-30T12:24:19.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:19 smithi084 ceph-mon[27000]: from='client.15267 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:24:19.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:19 smithi084 ceph-mon[27000]: osdmap e196: 8 total, 8 up, 8 in 2024-03-30T12:24:19.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:24:19] "GET /metrics HTTP/1.1" 200 35996 "" "Prometheus/2.43.0" 2024-03-30T12:24:19.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:19 smithi084 ceph-mon[37565]: from='client.15267 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:24:19.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:19 smithi084 ceph-mon[37565]: osdmap e196: 8 total, 8 up, 8 in 2024-03-30T12:24:19.619 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:19 smithi162 systemd[1]: Starting Ceph mgr.x for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:24:19.620 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:19 smithi162 podman[75032]: 2024-03-30 12:24:19.453407795 +0000 UTC m=+0.018233443 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:24:19.620 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:19 smithi162 podman[75032]: 2024-03-30 12:24:19.579032481 +0000 UTC m=+0.143858172 container create eec968f3fcc609a858442d5cf320c1f3925b2448b868d2f76a308c2f3b37fcd8 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-03-30T12:24:20.053 INFO:tasks.rados.rados.0.smithi084.stdout:687: done (2 left) 2024-03-30T12:24:20.053 INFO:tasks.rados.rados.0.smithi084.stdout:688: done (1 left) 2024-03-30T12:24:20.053 INFO:tasks.rados.rados.0.smithi084.stdout:689: done (0 left) 2024-03-30T12:24:20.053 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 66 2024-03-30T12:24:20.053 INFO:tasks.rados.rados.0.smithi084.stdout:690: seq_num 222 ranges {303104=524288,827392=565248,1392640=237568} 2024-03-30T12:24:20.057 INFO:tasks.rados.rados.0.smithi084.stdout:690: writing smithi08477944-45 from 303104 to 827392 tid 1 2024-03-30T12:24:20.061 INFO:tasks.rados.rados.0.smithi084.stdout:690: writing smithi08477944-45 from 827392 to 1392640 tid 2 2024-03-30T12:24:20.062 INFO:tasks.rados.rados.0.smithi084.stdout:690: writing smithi08477944-45 from 1392640 to 1630208 tid 3 2024-03-30T12:24:20.062 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 66 2024-03-30T12:24:20.062 INFO:tasks.rados.rados.0.smithi084.stdout:691: seq_num 223 ranges {0=540672,540672=450560,991232=352256} 2024-03-30T12:24:20.065 INFO:tasks.rados.rados.0.smithi084.stdout:691: writing smithi08477944-10 from 0 to 540672 tid 1 2024-03-30T12:24:20.068 INFO:tasks.rados.rados.0.smithi084.stdout:691: writing smithi08477944-10 from 540672 to 991232 tid 2 2024-03-30T12:24:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:691: writing smithi08477944-10 from 991232 to 1343488 tid 3 2024-03-30T12:24:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:692: delete oid 7 current snap is 66 2024-03-30T12:24:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:690: finishing write tid 1 to smithi08477944-45 2024-03-30T12:24:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:690: finishing write tid 2 to smithi08477944-45 2024-03-30T12:24:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:690: finishing write tid 3 to smithi08477944-45 2024-03-30T12:24:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:690: finishing write tid 4 to smithi08477944-45 2024-03-30T12:24:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:690: finishing write tid 5 to smithi08477944-45 2024-03-30T12:24:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:690: oid 45 updating version 0 to 412 2024-03-30T12:24:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:690: oid 45 version 412 is already newer than 411 2024-03-30T12:24:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:690: oid 45 version 412 is already newer than 410 2024-03-30T12:24:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:690: oid 45 updating version 412 to 413 2024-03-30T12:24:20.071 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 413 (ObjNum 222 snap 66 seq_num 222) dirty exists 2024-03-30T12:24:20.072 INFO:tasks.rados.rados.0.smithi084.stdout:690: left oid 45 (ObjNum 222 snap 66 seq_num 222) 2024-03-30T12:24:20.073 INFO:tasks.rados.rados.0.smithi084.stdout:690: done (2 left) 2024-03-30T12:24:20.073 INFO:tasks.rados.rados.0.smithi084.stdout:692: done (1 left) 2024-03-30T12:24:20.073 INFO:tasks.rados.rados.0.smithi084.stdout:693: rmattr oid 20 current snap is 66 2024-03-30T12:24:20.074 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 66 2024-03-30T12:24:20.074 INFO:tasks.rados.rados.0.smithi084.stdout:694: seq_num 225 ranges {4079616=573440,4653056=622592,5275648=180224} 2024-03-30T12:24:20.098 INFO:tasks.rados.rados.0.smithi084.stdout:694: writing smithi08477944-47 from 4079616 to 4653056 tid 1 2024-03-30T12:24:20.102 INFO:tasks.rados.rados.0.smithi084.stdout:694: writing smithi08477944-47 from 4653056 to 5275648 tid 2 2024-03-30T12:24:20.103 INFO:tasks.rados.rados.0.smithi084.stdout:694: writing smithi08477944-47 from 5275648 to 5455872 tid 3 2024-03-30T12:24:20.104 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 66 2024-03-30T12:24:20.104 INFO:tasks.rados.rados.0.smithi084.stdout:691: finishing write tid 1 to smithi08477944-10 2024-03-30T12:24:20.104 INFO:tasks.rados.rados.0.smithi084.stdout:691: finishing write tid 2 to smithi08477944-10 2024-03-30T12:24:20.104 INFO:tasks.rados.rados.0.smithi084.stdout:691: finishing write tid 3 to smithi08477944-10 2024-03-30T12:24:20.104 INFO:tasks.rados.rados.0.smithi084.stdout:691: finishing write tid 4 to smithi08477944-10 2024-03-30T12:24:20.104 INFO:tasks.rados.rados.0.smithi084.stdout:691: finishing write tid 5 to smithi08477944-10 2024-03-30T12:24:20.104 INFO:tasks.rados.rados.0.smithi084.stdout:691: oid 10 updating version 0 to 280 2024-03-30T12:24:20.104 INFO:tasks.rados.rados.0.smithi084.stdout:691: oid 10 updating version 280 to 283 2024-03-30T12:24:20.104 INFO:tasks.rados.rados.0.smithi084.stdout:691: oid 10 version 283 is already newer than 282 2024-03-30T12:24:20.104 INFO:tasks.rados.rados.0.smithi084.stdout:691: oid 10 version 283 is already newer than 281 2024-03-30T12:24:20.104 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 283 (ObjNum 223 snap 66 seq_num 223) dirty exists 2024-03-30T12:24:20.104 INFO:tasks.rados.rados.0.smithi084.stdout:691: left oid 10 (ObjNum 223 snap 66 seq_num 223) 2024-03-30T12:24:20.105 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 429 (ObjNum 186 snap 50 seq_num 186) dirty exists 2024-03-30T12:24:20.105 INFO:tasks.rados.rados.0.smithi084.stdout:694: finishing write tid 1 to smithi08477944-47 2024-03-30T12:24:20.105 INFO:tasks.rados.rados.0.smithi084.stdout:695: seq_num 226 ranges {876544=589824,1466368=507904,1974272=294912} 2024-03-30T12:24:20.111 INFO:tasks.rados.rados.0.smithi084.stdout:695: writing smithi08477944-48 from 876544 to 1466368 tid 1 2024-03-30T12:24:20.114 INFO:tasks.rados.rados.0.smithi084.stdout:695: writing smithi08477944-48 from 1466368 to 1974272 tid 2 2024-03-30T12:24:20.116 INFO:tasks.rados.rados.0.smithi084.stdout:695: writing smithi08477944-48 from 1974272 to 2269184 tid 3 2024-03-30T12:24:20.116 INFO:tasks.rados.rados.0.smithi084.stdout:691: done (3 left) 2024-03-30T12:24:20.116 INFO:tasks.rados.rados.0.smithi084.stdout:693: done (2 left) 2024-03-30T12:24:20.117 INFO:tasks.rados.rados.0.smithi084.stdout:696: delete oid 20 current snap is 66 2024-03-30T12:24:20.117 INFO:tasks.rados.rados.0.smithi084.stdout:694: finishing write tid 2 to smithi08477944-47 2024-03-30T12:24:20.117 INFO:tasks.rados.rados.0.smithi084.stdout:694: finishing write tid 3 to smithi08477944-47 2024-03-30T12:24:20.117 INFO:tasks.rados.rados.0.smithi084.stdout:694: finishing write tid 4 to smithi08477944-47 2024-03-30T12:24:20.117 INFO:tasks.rados.rados.0.smithi084.stdout:694: finishing write tid 5 to smithi08477944-47 2024-03-30T12:24:20.117 INFO:tasks.rados.rados.0.smithi084.stdout:694: oid 47 updating version 0 to 432 2024-03-30T12:24:20.117 INFO:tasks.rados.rados.0.smithi084.stdout:694: oid 47 updating version 432 to 433 2024-03-30T12:24:20.117 INFO:tasks.rados.rados.0.smithi084.stdout:694: oid 47 version 433 is already newer than 431 2024-03-30T12:24:20.117 INFO:tasks.rados.rados.0.smithi084.stdout:694: oid 47 updating version 433 to 434 2024-03-30T12:24:20.117 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 434 (ObjNum 225 snap 66 seq_num 225) dirty exists 2024-03-30T12:24:20.117 INFO:tasks.rados.rados.0.smithi084.stdout:694: left oid 47 (ObjNum 225 snap 66 seq_num 225) 2024-03-30T12:24:20.117 INFO:tasks.rados.rados.0.smithi084.stdout:695: finishing write tid 1 to smithi08477944-48 2024-03-30T12:24:20.118 INFO:tasks.rados.rados.0.smithi084.stdout:695: finishing write tid 2 to smithi08477944-48 2024-03-30T12:24:20.118 INFO:tasks.rados.rados.0.smithi084.stdout:695: finishing write tid 3 to smithi08477944-48 2024-03-30T12:24:20.118 INFO:tasks.rados.rados.0.smithi084.stdout:694: done (2 left) 2024-03-30T12:24:20.118 INFO:tasks.rados.rados.0.smithi084.stdout:696: done (1 left) 2024-03-30T12:24:20.118 INFO:tasks.rados.rados.0.smithi084.stdout:697: snap_create 2024-03-30T12:24:20.119 INFO:tasks.rados.rados.0.smithi084.stdout:695: finishing write tid 4 to smithi08477944-48 2024-03-30T12:24:20.119 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:19 smithi162 podman[75032]: 2024-03-30 12:24:19.815337473 +0000 UTC m=+0.380163112 container init eec968f3fcc609a858442d5cf320c1f3925b2448b868d2f76a308c2f3b37fcd8 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-03-30T12:24:20.120 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:19 smithi162 podman[75032]: 2024-03-30 12:24:19.817936242 +0000 UTC m=+0.382761882 container start eec968f3fcc609a858442d5cf320c1f3925b2448b868d2f76a308c2f3b37fcd8 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-03-30T12:24:20.120 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:19 smithi162 ceph-mgr[75051]: -- 172.21.15.162:0/627819747 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5603580a85a0 con 0x56035807c800 2024-03-30T12:24:20.120 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:19 smithi162 bash[75032]: eec968f3fcc609a858442d5cf320c1f3925b2448b868d2f76a308c2f3b37fcd8 2024-03-30T12:24:20.120 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:19 smithi162 systemd[1]: Started Ceph mgr.x for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:24:20.120 INFO:tasks.rados.rados.0.smithi084.stdout:695: finishing write tid 5 to smithi08477944-48 2024-03-30T12:24:20.120 INFO:tasks.rados.rados.0.smithi084.stdout:695: oid 48 updating version 0 to 330 2024-03-30T12:24:20.120 INFO:tasks.rados.rados.0.smithi084.stdout:695: oid 48 version 330 is already newer than 329 2024-03-30T12:24:20.120 INFO:tasks.rados.rados.0.smithi084.stdout:695: oid 48 updating version 330 to 331 2024-03-30T12:24:20.121 INFO:tasks.rados.rados.0.smithi084.stdout:695: oid 48 updating version 331 to 332 2024-03-30T12:24:20.121 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 332 (ObjNum 226 snap 66 seq_num 226) dirty exists 2024-03-30T12:24:20.121 INFO:tasks.rados.rados.0.smithi084.stdout:695: left oid 48 (ObjNum 226 snap 66 seq_num 226) 2024-03-30T12:24:20.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:20 smithi084 ceph-mon[27000]: pgmap v33: 121 pgs: 121 active+clean; 79 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 2.5 MiB/s wr, 22 op/s 2024-03-30T12:24:20.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:20 smithi084 ceph-mon[27000]: osdmap e197: 8 total, 8 up, 8 in 2024-03-30T12:24:20.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:20 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:20.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:20 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:20.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:20 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:20.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:20 smithi084 ceph-mon[27000]: osdmap e198: 8 total, 8 up, 8 in 2024-03-30T12:24:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:20 smithi084 ceph-mon[37565]: pgmap v33: 121 pgs: 121 active+clean; 79 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 2.5 MiB/s wr, 22 op/s 2024-03-30T12:24:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:20 smithi084 ceph-mon[37565]: osdmap e197: 8 total, 8 up, 8 in 2024-03-30T12:24:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:20 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:20.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:20 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:20.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:20 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:20.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:20 smithi084 ceph-mon[37565]: osdmap e198: 8 total, 8 up, 8 in 2024-03-30T12:24:20.506 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:20.403+0000 7f3b438a4200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T12:24:20.506 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:20.514+0000 7f3b438a4200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T12:24:20.506 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:20 smithi162 ceph-mon[30421]: pgmap v33: 121 pgs: 121 active+clean; 79 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 2.5 MiB/s wr, 22 op/s 2024-03-30T12:24:20.506 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:20 smithi162 ceph-mon[30421]: osdmap e197: 8 total, 8 up, 8 in 2024-03-30T12:24:20.506 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:20 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:20.506 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:20 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:20.507 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:20 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:20.507 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:20 smithi162 ceph-mon[30421]: osdmap e198: 8 total, 8 up, 8 in 2024-03-30T12:24:21.063 INFO:tasks.rados.rados.0.smithi084.stdout:695: done (1 left) 2024-03-30T12:24:21.063 INFO:tasks.rados.rados.0.smithi084.stdout:697: done (0 left) 2024-03-30T12:24:21.063 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 67 2024-03-30T12:24:21.063 INFO:tasks.rados.rados.0.smithi084.stdout:698: seq_num 228 ranges {5136384=622592,5758976=671744,6430720=131072} 2024-03-30T12:24:21.093 INFO:tasks.rados.rados.0.smithi084.stdout:698: writing smithi08477944-13 from 5136384 to 5758976 tid 1 2024-03-30T12:24:21.097 INFO:tasks.rados.rados.0.smithi084.stdout:698: writing smithi08477944-13 from 5758976 to 6430720 tid 2 2024-03-30T12:24:21.097 INFO:tasks.rados.rados.0.smithi084.stdout:698: writing smithi08477944-13 from 6430720 to 6561792 tid 3 2024-03-30T12:24:21.098 INFO:tasks.rados.rados.0.smithi084.stdout:699: delete oid 50 current snap is 67 2024-03-30T12:24:21.102 INFO:tasks.rados.rados.0.smithi084.stdout:698: finishing write tid 1 to smithi08477944-13 2024-03-30T12:24:21.103 INFO:tasks.rados.rados.0.smithi084.stdout:699: done (1 left) 2024-03-30T12:24:21.103 INFO:tasks.rados.rados.0.smithi084.stdout:700: rollback oid 21 current snap is 67 2024-03-30T12:24:21.103 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 21 to 61 2024-03-30T12:24:21.103 INFO:tasks.rados.rados.0.smithi084.stdout:701: snap_remove snap 66 2024-03-30T12:24:21.546 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:21.205+0000 7f3b438a4200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T12:24:21.546 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:21.306+0000 7f3b438a4200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T12:24:21.547 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:21.453+0000 7f3b438a4200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T12:24:21.869 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:21.556+0000 7f3b438a4200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T12:24:21.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:21.641+0000 7f3b438a4200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T12:24:22.075 INFO:tasks.rados.rados.0.smithi084.stdout:701: done (2 left) 2024-03-30T12:24:22.075 INFO:tasks.rados.rados.0.smithi084.stdout:702: snap_create 2024-03-30T12:24:22.075 INFO:tasks.rados.rados.0.smithi084.stdout:698: finishing write tid 2 to smithi08477944-13 2024-03-30T12:24:22.076 INFO:tasks.rados.rados.0.smithi084.stdout:698: finishing write tid 3 to smithi08477944-13 2024-03-30T12:24:22.076 INFO:tasks.rados.rados.0.smithi084.stdout:698: finishing write tid 4 to smithi08477944-13 2024-03-30T12:24:22.076 INFO:tasks.rados.rados.0.smithi084.stdout:698: finishing write tid 5 to smithi08477944-13 2024-03-30T12:24:22.076 INFO:tasks.rados.rados.0.smithi084.stdout:698: oid 13 updating version 0 to 160 2024-03-30T12:24:22.076 INFO:tasks.rados.rados.0.smithi084.stdout:698: oid 13 updating version 160 to 161 2024-03-30T12:24:22.076 INFO:tasks.rados.rados.0.smithi084.stdout:698: oid 13 version 161 is already newer than 159 2024-03-30T12:24:22.076 INFO:tasks.rados.rados.0.smithi084.stdout:698: oid 13 version 161 is already newer than 158 2024-03-30T12:24:22.076 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 161 (ObjNum 228 snap 67 seq_num 228) dirty exists 2024-03-30T12:24:22.076 INFO:tasks.rados.rados.0.smithi084.stdout:698: left oid 13 (ObjNum 228 snap 67 seq_num 228) 2024-03-30T12:24:22.076 INFO:tasks.rados.rados.0.smithi084.stdout:700: finishing rollback tid 0 to smithi08477944-21 2024-03-30T12:24:22.076 INFO:tasks.rados.rados.0.smithi084.stdout:700: finishing rollback tid 1 to smithi08477944-21 2024-03-30T12:24:22.076 INFO:tasks.rados.rados.0.smithi084.stdout:700: finishing rollback tid 2 to smithi08477944-21 2024-03-30T12:24:22.076 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 92 (ObjNum 176 snap 49 seq_num 176) dirty exists 2024-03-30T12:24:22.239 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:22 smithi162 ceph-mon[30421]: pgmap v36: 121 pgs: 121 active+clean; 91 MiB data, 763 MiB used, 714 GiB / 715 GiB avail; 860 KiB/s rd, 2.9 MiB/s wr, 25 op/s 2024-03-30T12:24:22.240 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:22 smithi162 ceph-mon[30421]: osdmap e199: 8 total, 8 up, 8 in 2024-03-30T12:24:22.240 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:21.912+0000 7f3b438a4200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T12:24:22.240 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:22.034+0000 7f3b438a4200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T12:24:22.240 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:22.137+0000 7f3b438a4200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T12:24:22.240 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:22.248+0000 7f3b438a4200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T12:24:22.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:22 smithi084 ceph-mon[37565]: pgmap v36: 121 pgs: 121 active+clean; 91 MiB data, 763 MiB used, 714 GiB / 715 GiB avail; 860 KiB/s rd, 2.9 MiB/s wr, 25 op/s 2024-03-30T12:24:22.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:22 smithi084 ceph-mon[37565]: osdmap e199: 8 total, 8 up, 8 in 2024-03-30T12:24:22.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:22 smithi084 ceph-mon[27000]: pgmap v36: 121 pgs: 121 active+clean; 91 MiB data, 763 MiB used, 714 GiB / 715 GiB avail; 860 KiB/s rd, 2.9 MiB/s wr, 25 op/s 2024-03-30T12:24:22.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:22 smithi084 ceph-mon[27000]: osdmap e199: 8 total, 8 up, 8 in 2024-03-30T12:24:22.541 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:22.431+0000 7f3b438a4200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T12:24:23.083 INFO:tasks.rados.rados.0.smithi084.stdout:698: done (2 left) 2024-03-30T12:24:23.083 INFO:tasks.rados.rados.0.smithi084.stdout:700: done (1 left) 2024-03-30T12:24:23.083 INFO:tasks.rados.rados.0.smithi084.stdout:702: done (0 left) 2024-03-30T12:24:23.084 INFO:tasks.rados.rados.0.smithi084.stdout:703: read oid 46 snap -1 2024-03-30T12:24:23.084 INFO:tasks.rados.rados.0.smithi084.stdout:703: expect (ObjNum 107 snap 22 seq_num 107) 2024-03-30T12:24:23.084 INFO:tasks.rados.rados.0.smithi084.stdout:704: read oid 12 snap -1 2024-03-30T12:24:23.084 INFO:tasks.rados.rados.0.smithi084.stdout:704: expect (ObjNum 181 snap 50 seq_num 181) 2024-03-30T12:24:23.084 INFO:tasks.rados.rados.0.smithi084.stdout:705: read oid 29 snap -1 2024-03-30T12:24:23.084 INFO:tasks.rados.rados.0.smithi084.stdout:705: expect (ObjNum 142 snap 36 seq_num 142) 2024-03-30T12:24:23.084 INFO:tasks.rados.rados.0.smithi084.stdout:706: snap_remove snap 63 2024-03-30T12:24:23.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:23 smithi162 ceph-mon[30421]: osdmap e200: 8 total, 8 up, 8 in 2024-03-30T12:24:23.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:23 smithi084 ceph-mon[27000]: osdmap e200: 8 total, 8 up, 8 in 2024-03-30T12:24:23.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:23 smithi084 ceph-mon[37565]: osdmap e200: 8 total, 8 up, 8 in 2024-03-30T12:24:23.841 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:23.473+0000 7f3b438a4200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T12:24:23.841 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:23.611+0000 7f3b438a4200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T12:24:24.095 INFO:tasks.rados.rados.0.smithi084.stdout:706: done (3 left) 2024-03-30T12:24:24.095 INFO:tasks.rados.rados.0.smithi084.stdout:707: setattr oid 42 current snap is 68 2024-03-30T12:24:24.095 INFO:tasks.rados.rados.0.smithi084.stdout:705: expect (ObjNum 142 snap 36 seq_num 142) 2024-03-30T12:24:24.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:24 smithi162 ceph-mon[30421]: pgmap v39: 121 pgs: 121 active+clean; 91 MiB data, 763 MiB used, 714 GiB / 715 GiB avail; 860 KiB/s rd, 2.9 MiB/s wr, 25 op/s 2024-03-30T12:24:24.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:24 smithi162 ceph-mon[30421]: osdmap e201: 8 total, 8 up, 8 in 2024-03-30T12:24:24.120 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:23.969+0000 7f3b438a4200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T12:24:24.120 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:24.062+0000 7f3b438a4200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T12:24:24.218 INFO:tasks.rados.rados.0.smithi084.stdout:704: expect (ObjNum 181 snap 50 seq_num 181) 2024-03-30T12:24:24.333 INFO:tasks.rados.rados.0.smithi084.stdout:703: expect (ObjNum 107 snap 22 seq_num 107) 2024-03-30T12:24:24.382 INFO:tasks.rados.rados.0.smithi084.stdout:703: done (3 left) 2024-03-30T12:24:24.382 INFO:tasks.rados.rados.0.smithi084.stdout:704: done (2 left) 2024-03-30T12:24:24.382 INFO:tasks.rados.rados.0.smithi084.stdout:705: done (1 left) 2024-03-30T12:24:24.382 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 68 2024-03-30T12:24:24.382 INFO:tasks.rados.rados.0.smithi084.stdout:708: seq_num 230 ranges {2932736=655360,3588096=491520,4079616=311296} 2024-03-30T12:24:24.398 INFO:tasks.rados.rados.0.smithi084.stdout:708: writing smithi08477944-12 from 2932736 to 3588096 tid 1 2024-03-30T12:24:24.400 INFO:tasks.rados.rados.0.smithi084.stdout:708: writing smithi08477944-12 from 3588096 to 4079616 tid 2 2024-03-30T12:24:24.403 INFO:tasks.rados.rados.0.smithi084.stdout:708: writing smithi08477944-12 from 4079616 to 4390912 tid 3 2024-03-30T12:24:24.403 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 373 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:24:24.403 INFO:tasks.rados.rados.0.smithi084.stdout:709: read oid 21 snap 52 2024-03-30T12:24:24.403 INFO:tasks.rados.rados.0.smithi084.stdout:709: expect (ObjNum 176 snap 49 seq_num 176) 2024-03-30T12:24:24.403 INFO:tasks.rados.rados.0.smithi084.stdout:707: done (2 left) 2024-03-30T12:24:24.403 INFO:tasks.rados.rados.0.smithi084.stdout:710: snap_create 2024-03-30T12:24:24.403 INFO:tasks.rados.rados.0.smithi084.stdout:708: finishing write tid 1 to smithi08477944-12 2024-03-30T12:24:24.403 INFO:tasks.rados.rados.0.smithi084.stdout:708: finishing write tid 2 to smithi08477944-12 2024-03-30T12:24:24.405 INFO:tasks.rados.rados.0.smithi084.stdout:708: finishing write tid 3 to smithi08477944-12 2024-03-30T12:24:24.406 INFO:tasks.rados.rados.0.smithi084.stdout:708: finishing write tid 4 to smithi08477944-12 2024-03-30T12:24:24.407 INFO:tasks.rados.rados.0.smithi084.stdout:708: finishing write tid 5 to smithi08477944-12 2024-03-30T12:24:24.407 INFO:tasks.rados.rados.0.smithi084.stdout:708: oid 12 updating version 0 to 174 2024-03-30T12:24:24.408 INFO:tasks.rados.rados.0.smithi084.stdout:708: oid 12 version 174 is already newer than 173 2024-03-30T12:24:24.408 INFO:tasks.rados.rados.0.smithi084.stdout:708: oid 12 updating version 174 to 176 2024-03-30T12:24:24.408 INFO:tasks.rados.rados.0.smithi084.stdout:708: oid 12 version 176 is already newer than 175 2024-03-30T12:24:24.408 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 176 (ObjNum 230 snap 68 seq_num 230) dirty exists 2024-03-30T12:24:24.408 INFO:tasks.rados.rados.0.smithi084.stdout:708: left oid 12 (ObjNum 230 snap 68 seq_num 230) 2024-03-30T12:24:24.411 INFO:tasks.rados.rados.0.smithi084.stdout:709: expect (ObjNum 176 snap 49 seq_num 176) 2024-03-30T12:24:24.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:24 smithi084 ceph-mon[27000]: pgmap v39: 121 pgs: 121 active+clean; 91 MiB data, 763 MiB used, 714 GiB / 715 GiB avail; 860 KiB/s rd, 2.9 MiB/s wr, 25 op/s 2024-03-30T12:24:24.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:24 smithi084 ceph-mon[27000]: osdmap e201: 8 total, 8 up, 8 in 2024-03-30T12:24:24.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:24 smithi084 ceph-mon[37565]: pgmap v39: 121 pgs: 121 active+clean; 91 MiB data, 763 MiB used, 714 GiB / 715 GiB avail; 860 KiB/s rd, 2.9 MiB/s wr, 25 op/s 2024-03-30T12:24:24.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:24 smithi084 ceph-mon[37565]: osdmap e201: 8 total, 8 up, 8 in 2024-03-30T12:24:24.619 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:24.270+0000 7f3b438a4200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:24:24.620 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:24.475+0000 7f3b438a4200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T12:24:25.051 INFO:tasks.rados.rados.0.smithi084.stdout:708: done (2 left) 2024-03-30T12:24:25.051 INFO:tasks.rados.rados.0.smithi084.stdout:709: done (1 left) 2024-03-30T12:24:25.051 INFO:tasks.rados.rados.0.smithi084.stdout:710: done (0 left) 2024-03-30T12:24:25.051 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 69 2024-03-30T12:24:25.051 INFO:tasks.rados.rados.0.smithi084.stdout:711: seq_num 231 ranges {0=671744,671744=778240,1449984=24576} 2024-03-30T12:24:25.054 INFO:tasks.rados.rados.0.smithi084.stdout:711: writing smithi08477944-37 from 0 to 671744 tid 1 2024-03-30T12:24:25.060 INFO:tasks.rados.rados.0.smithi084.stdout:711: writing smithi08477944-37 from 671744 to 1449984 tid 2 2024-03-30T12:24:25.060 INFO:tasks.rados.rados.0.smithi084.stdout:711: writing smithi08477944-37 from 1449984 to 1474560 tid 3 2024-03-30T12:24:25.060 INFO:tasks.rados.rados.0.smithi084.stdout:712: snap_create 2024-03-30T12:24:25.060 INFO:tasks.rados.rados.0.smithi084.stdout:711: finishing write tid 1 to smithi08477944-37 2024-03-30T12:24:25.063 INFO:tasks.rados.rados.0.smithi084.stdout:711: finishing write tid 2 to smithi08477944-37 2024-03-30T12:24:25.063 INFO:tasks.rados.rados.0.smithi084.stdout:711: finishing write tid 3 to smithi08477944-37 2024-03-30T12:24:25.064 INFO:tasks.rados.rados.0.smithi084.stdout:711: finishing write tid 4 to smithi08477944-37 2024-03-30T12:24:25.065 INFO:tasks.rados.rados.0.smithi084.stdout:711: finishing write tid 5 to smithi08477944-37 2024-03-30T12:24:25.065 INFO:tasks.rados.rados.0.smithi084.stdout:711: oid 37 updating version 0 to 287 2024-03-30T12:24:25.065 INFO:tasks.rados.rados.0.smithi084.stdout:711: oid 37 version 287 is already newer than 286 2024-03-30T12:24:25.066 INFO:tasks.rados.rados.0.smithi084.stdout:711: oid 37 version 287 is already newer than 285 2024-03-30T12:24:25.066 INFO:tasks.rados.rados.0.smithi084.stdout:711: oid 37 version 287 is already newer than 284 2024-03-30T12:24:25.066 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 287 (ObjNum 231 snap 69 seq_num 231) dirty exists 2024-03-30T12:24:25.066 INFO:tasks.rados.rados.0.smithi084.stdout:711: left oid 37 (ObjNum 231 snap 69 seq_num 231) 2024-03-30T12:24:25.087 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:24.792+0000 7f3b438a4200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:24:25.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:25 smithi162 ceph-mon[30421]: osdmap e202: 8 total, 8 up, 8 in 2024-03-30T12:24:25.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:25 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:25.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:25 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:25.360 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:25 smithi162 ceph-mon[30421]: osdmap e203: 8 total, 8 up, 8 in 2024-03-30T12:24:25.361 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:25.115+0000 7f3b438a4200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T12:24:25.361 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:25.368+0000 7f3b438a4200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T12:24:25.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:25 smithi084 ceph-mon[27000]: osdmap e202: 8 total, 8 up, 8 in 2024-03-30T12:24:25.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:25 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:25.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:25 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:25.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:25 smithi084 ceph-mon[27000]: osdmap e203: 8 total, 8 up, 8 in 2024-03-30T12:24:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:25 smithi084 ceph-mon[37565]: osdmap e202: 8 total, 8 up, 8 in 2024-03-30T12:24:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:25 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:25 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:25 smithi084 ceph-mon[37565]: osdmap e203: 8 total, 8 up, 8 in 2024-03-30T12:24:26.060 INFO:tasks.rados.rados.0.smithi084.stdout:711: done (1 left) 2024-03-30T12:24:26.060 INFO:tasks.rados.rados.0.smithi084.stdout:712: done (0 left) 2024-03-30T12:24:26.060 INFO:tasks.rados.rados.0.smithi084.stdout:713: read oid 11 snap 58 2024-03-30T12:24:26.060 INFO:tasks.rados.rados.0.smithi084.stdout:713: expect (ObjNum 170 snap 46 seq_num 170) 2024-03-30T12:24:26.060 INFO:tasks.rados.rados.0.smithi084.stdout:714: snap_create 2024-03-30T12:24:26.064 INFO:tasks.rados.rados.0.smithi084.stdout:713: expect (ObjNum 170 snap 46 seq_num 170) 2024-03-30T12:24:26.329 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:26 smithi162 ceph-mon[30421]: pgmap v42: 121 pgs: 121 active+clean; 97 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2024-03-30T12:24:26.329 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:26 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:26.329 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:26 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:26.329 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:26 smithi162 ceph-mon[30421]: osdmap e204: 8 total, 8 up, 8 in 2024-03-30T12:24:26.329 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:26.246+0000 7f3b438a4200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T12:24:26.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:26 smithi084 ceph-mon[27000]: pgmap v42: 121 pgs: 121 active+clean; 97 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2024-03-30T12:24:26.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:26 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:26.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:26 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:26.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:26 smithi084 ceph-mon[27000]: osdmap e204: 8 total, 8 up, 8 in 2024-03-30T12:24:26.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:26 smithi084 ceph-mon[37565]: pgmap v42: 121 pgs: 121 active+clean; 97 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2024-03-30T12:24:26.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:26 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:26.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:26 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:26.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:26 smithi084 ceph-mon[37565]: osdmap e204: 8 total, 8 up, 8 in 2024-03-30T12:24:27.062 INFO:tasks.rados.rados.0.smithi084.stdout:713: done (1 left) 2024-03-30T12:24:27.062 INFO:tasks.rados.rados.0.smithi084.stdout:714: done (0 left) 2024-03-30T12:24:27.062 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 71 2024-03-30T12:24:27.062 INFO:tasks.rados.rados.0.smithi084.stdout:715: seq_num 232 ranges {1343488=688128,2031616=663552,2695168=139264} 2024-03-30T12:24:27.073 INFO:tasks.rados.rados.0.smithi084.stdout:715: writing smithi08477944-10 from 1343488 to 2031616 tid 1 2024-03-30T12:24:27.076 INFO:tasks.rados.rados.0.smithi084.stdout:715: writing smithi08477944-10 from 2031616 to 2695168 tid 2 2024-03-30T12:24:27.078 INFO:tasks.rados.rados.0.smithi084.stdout:715: writing smithi08477944-10 from 2695168 to 2834432 tid 3 2024-03-30T12:24:27.078 INFO:tasks.rados.rados.0.smithi084.stdout:716: copy_from oid 5 from oid 16 current snap is 71 2024-03-30T12:24:27.078 INFO:tasks.rados.rados.0.smithi084.stdout:717: copy_from oid 36 from oid 3 current snap is 71 2024-03-30T12:24:27.078 INFO:tasks.rados.rados.0.smithi084.stdout:718: read oid 6 snap -1 2024-03-30T12:24:27.078 INFO:tasks.rados.rados.0.smithi084.stdout:718: expect (ObjNum 218 snap 64 seq_num 218) 2024-03-30T12:24:27.078 INFO:tasks.rados.rados.0.smithi084.stdout:719: read oid 47 snap -1 2024-03-30T12:24:27.078 INFO:tasks.rados.rados.0.smithi084.stdout:719: expect (ObjNum 225 snap 66 seq_num 225) 2024-03-30T12:24:27.078 INFO:tasks.rados.rados.0.smithi084.stdout:720: snap_create 2024-03-30T12:24:27.081 INFO:tasks.rados.rados.0.smithi084.stdout:715: finishing write tid 1 to smithi08477944-10 2024-03-30T12:24:27.083 INFO:tasks.rados.rados.0.smithi084.stdout:715: finishing write tid 2 to smithi08477944-10 2024-03-30T12:24:27.083 INFO:tasks.rados.rados.0.smithi084.stdout:715: finishing write tid 3 to smithi08477944-10 2024-03-30T12:24:27.083 INFO:tasks.rados.rados.0.smithi084.stdout:716: finishing copy_from to smithi08477944-5 2024-03-30T12:24:27.083 INFO:tasks.rados.rados.0.smithi084.stdout:716: got expected ENOENT (src dne) 2024-03-30T12:24:27.083 INFO:tasks.rados.rados.0.smithi084.stdout:715: finishing write tid 4 to smithi08477944-10 2024-03-30T12:24:27.083 INFO:tasks.rados.rados.0.smithi084.stdout:716: finishing copy_from racing read to smithi08477944-5 2024-03-30T12:24:27.084 INFO:tasks.rados.rados.0.smithi084.stdout:715: finishing write tid 5 to smithi08477944-10 2024-03-30T12:24:27.084 INFO:tasks.rados.rados.0.smithi084.stdout:715: oid 10 updating version 0 to 291 2024-03-30T12:24:27.084 INFO:tasks.rados.rados.0.smithi084.stdout:715: oid 10 version 291 is already newer than 289 2024-03-30T12:24:27.084 INFO:tasks.rados.rados.0.smithi084.stdout:715: oid 10 version 291 is already newer than 290 2024-03-30T12:24:27.084 INFO:tasks.rados.rados.0.smithi084.stdout:715: oid 10 updating version 291 to 292 2024-03-30T12:24:27.084 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 292 (ObjNum 232 snap 71 seq_num 232) dirty exists 2024-03-30T12:24:27.084 INFO:tasks.rados.rados.0.smithi084.stdout:715: left oid 10 (ObjNum 232 snap 71 seq_num 232) 2024-03-30T12:24:27.087 INFO:tasks.rados.rados.0.smithi084.stdout:718: expect (ObjNum 218 snap 64 seq_num 218) 2024-03-30T12:24:27.088 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:26.835+0000 7f3b438a4200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T12:24:27.088 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:26.936+0000 7f3b438a4200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T12:24:27.123 INFO:tasks.rados.rados.0.smithi084.stdout:717: finishing copy_from racing read to smithi08477944-36 2024-03-30T12:24:27.123 INFO:tasks.rados.rados.0.smithi084.stdout:717: finishing copy_from to smithi08477944-36 2024-03-30T12:24:27.123 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 315 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-03-30T12:24:27.123 INFO:tasks.rados.rados.0.smithi084.stdout:719: expect (ObjNum 225 snap 66 seq_num 225) 2024-03-30T12:24:27.369 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:27.168+0000 7f3b438a4200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T12:24:27.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: [30/Mar/2024:12:24:27] ENGINE Bus STARTING 2024-03-30T12:24:27.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: CherryPy Checker: 2024-03-30T12:24:27.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: The Application mounted at '' has an empty config. 2024-03-30T12:24:27.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:27.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: [30/Mar/2024:12:24:27] ENGINE Serving on http://:::9283 2024-03-30T12:24:27.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: [30/Mar/2024:12:24:27] ENGINE Bus STARTED 2024-03-30T12:24:28.062 INFO:tasks.rados.rados.0.smithi084.stdout:715: done (5 left) 2024-03-30T12:24:28.062 INFO:tasks.rados.rados.0.smithi084.stdout:716: done (4 left) 2024-03-30T12:24:28.062 INFO:tasks.rados.rados.0.smithi084.stdout:717: done (3 left) 2024-03-30T12:24:28.062 INFO:tasks.rados.rados.0.smithi084.stdout:718: done (2 left) 2024-03-30T12:24:28.062 INFO:tasks.rados.rados.0.smithi084.stdout:719: done (1 left) 2024-03-30T12:24:28.063 INFO:tasks.rados.rados.0.smithi084.stdout:720: done (0 left) 2024-03-30T12:24:28.063 INFO:tasks.rados.rados.0.smithi084.stdout:721: rmattr oid 17 current snap is 72 2024-03-30T12:24:28.063 INFO:tasks.rados.rados.0.smithi084.stdout:722: read oid 13 snap -1 2024-03-30T12:24:28.063 INFO:tasks.rados.rados.0.smithi084.stdout:722: expect (ObjNum 228 snap 67 seq_num 228) 2024-03-30T12:24:28.063 INFO:tasks.rados.rados.0.smithi084.stdout:723: rollback oid 14 current snap is 72 2024-03-30T12:24:28.063 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 14 to 71 2024-03-30T12:24:28.063 INFO:tasks.rados.rados.0.smithi084.stdout:724: delete oid 10 current snap is 72 2024-03-30T12:24:28.064 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 374 (ObjNum 55 snap 3 seq_num 55) dirty exists 2024-03-30T12:24:28.070 INFO:tasks.rados.rados.0.smithi084.stdout:723: finishing rollback tid 0 to smithi08477944-14 2024-03-30T12:24:28.075 INFO:tasks.rados.rados.0.smithi084.stdout:723: finishing rollback tid 1 to smithi08477944-14 2024-03-30T12:24:28.075 INFO:tasks.rados.rados.0.smithi084.stdout:723: finishing rollback tid 2 to smithi08477944-14 2024-03-30T12:24:28.075 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 296 (ObjNum 211 snap 62 seq_num 211) dirty exists 2024-03-30T12:24:28.075 INFO:tasks.rados.rados.0.smithi084.stdout:721: done (3 left) 2024-03-30T12:24:28.075 INFO:tasks.rados.rados.0.smithi084.stdout:723: done (2 left) 2024-03-30T12:24:28.075 INFO:tasks.rados.rados.0.smithi084.stdout:724: done (1 left) 2024-03-30T12:24:28.075 INFO:tasks.rados.rados.0.smithi084.stdout:725: snap_create 2024-03-30T12:24:28.100 INFO:tasks.rados.rados.0.smithi084.stdout:722: expect (ObjNum 228 snap 67 seq_num 228) 2024-03-30T12:24:28.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:28 smithi162 ceph-mon[30421]: pgmap v45: 121 pgs: 121 active+clean; 98 MiB data, 809 MiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 2.0 MiB/s wr, 20 op/s 2024-03-30T12:24:28.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:28 smithi162 ceph-mon[30421]: osdmap e205: 8 total, 8 up, 8 in 2024-03-30T12:24:28.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:28 smithi162 ceph-mon[30421]: Standby manager daemon x restarted 2024-03-30T12:24:28.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:28 smithi162 ceph-mon[30421]: Standby manager daemon x started 2024-03-30T12:24:28.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:28 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.162:0/932679282' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T12:24:28.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:28 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.162:0/932679282' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T12:24:28.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:28 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.162:0/932679282' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T12:24:28.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:28 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.162:0/932679282' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T12:24:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:28 smithi084 ceph-mon[27000]: pgmap v45: 121 pgs: 121 active+clean; 98 MiB data, 809 MiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 2.0 MiB/s wr, 20 op/s 2024-03-30T12:24:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:28 smithi084 ceph-mon[27000]: osdmap e205: 8 total, 8 up, 8 in 2024-03-30T12:24:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:28 smithi084 ceph-mon[27000]: Standby manager daemon x restarted 2024-03-30T12:24:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:28 smithi084 ceph-mon[27000]: Standby manager daemon x started 2024-03-30T12:24:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:28 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.162:0/932679282' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T12:24:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:28 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.162:0/932679282' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T12:24:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:28 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.162:0/932679282' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T12:24:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:28 smithi084 ceph-mon[27000]: from='mgr.? 172.21.15.162:0/932679282' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T12:24:28.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:28 smithi084 ceph-mon[37565]: pgmap v45: 121 pgs: 121 active+clean; 98 MiB data, 809 MiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 2.0 MiB/s wr, 20 op/s 2024-03-30T12:24:28.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:28 smithi084 ceph-mon[37565]: osdmap e205: 8 total, 8 up, 8 in 2024-03-30T12:24:28.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:28 smithi084 ceph-mon[37565]: Standby manager daemon x restarted 2024-03-30T12:24:28.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:28 smithi084 ceph-mon[37565]: Standby manager daemon x started 2024-03-30T12:24:28.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:28 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.162:0/932679282' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T12:24:28.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:28 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.162:0/932679282' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T12:24:28.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:28 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.162:0/932679282' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T12:24:28.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:28 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.162:0/932679282' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T12:24:29.075 INFO:tasks.rados.rados.0.smithi084.stdout:722: done (1 left) 2024-03-30T12:24:29.075 INFO:tasks.rados.rados.0.smithi084.stdout:725: done (0 left) 2024-03-30T12:24:29.075 INFO:tasks.rados.rados.0.smithi084.stdout:726: setattr oid 39 current snap is 73 2024-03-30T12:24:29.076 INFO:tasks.rados.rados.0.smithi084.stdout:727: read oid 37 snap -1 2024-03-30T12:24:29.076 INFO:tasks.rados.rados.0.smithi084.stdout:727: expect (ObjNum 231 snap 69 seq_num 231) 2024-03-30T12:24:29.077 INFO:tasks.rados.rados.0.smithi084.stdout:728: read oid 25 snap -1 2024-03-30T12:24:29.077 INFO:tasks.rados.rados.0.smithi084.stdout:728: expect (ObjNum 110 snap 24 seq_num 110) 2024-03-30T12:24:29.077 INFO:tasks.rados.rados.0.smithi084.stdout:729: read oid 43 snap -1 2024-03-30T12:24:29.077 INFO:tasks.rados.rados.0.smithi084.stdout:729: expect (ObjNum 207 snap 62 seq_num 207) 2024-03-30T12:24:29.077 INFO:tasks.rados.rados.0.smithi084.stdout:730: rmattr oid 12 current snap is 73 2024-03-30T12:24:29.077 INFO:tasks.rados.rados.0.smithi084.stdout:730: done (4 left) 2024-03-30T12:24:29.077 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 73 2024-03-30T12:24:29.077 INFO:tasks.rados.rados.0.smithi084.stdout:731: seq_num 234 ranges {0=729088,729088=434176,1163264=368640} 2024-03-30T12:24:29.081 INFO:tasks.rados.rados.0.smithi084.stdout:731: writing smithi08477944-9 from 0 to 729088 tid 1 2024-03-30T12:24:29.085 INFO:tasks.rados.rados.0.smithi084.stdout:731: writing smithi08477944-9 from 729088 to 1163264 tid 2 2024-03-30T12:24:29.088 INFO:tasks.rados.rados.0.smithi084.stdout:731: writing smithi08477944-9 from 1163264 to 1531904 tid 3 2024-03-30T12:24:29.088 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 375 (ObjNum 136 snap 32 seq_num 136) dirty exists 2024-03-30T12:24:29.088 INFO:tasks.rados.rados.0.smithi084.stdout:726: done (4 left) 2024-03-30T12:24:29.088 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 30 current snap is 73 2024-03-30T12:24:29.089 INFO:tasks.rados.rados.0.smithi084.stdout:732: seq_num 235 ranges {491520=745472,1236992=712704,1949696=90112} 2024-03-30T12:24:29.096 INFO:tasks.rados.rados.0.smithi084.stdout:732: writing smithi08477944-30 from 491520 to 1236992 tid 1 2024-03-30T12:24:29.101 INFO:tasks.rados.rados.0.smithi084.stdout:732: writing smithi08477944-30 from 1236992 to 1949696 tid 2 2024-03-30T12:24:29.102 INFO:tasks.rados.rados.0.smithi084.stdout:732: writing smithi08477944-30 from 1949696 to 2039808 tid 3 2024-03-30T12:24:29.102 INFO:tasks.rados.rados.0.smithi084.stdout:731: finishing write tid 1 to smithi08477944-9 2024-03-30T12:24:29.102 INFO:tasks.rados.rados.0.smithi084.stdout:733: rmattr oid 20 current snap is 73 2024-03-30T12:24:29.102 INFO:tasks.rados.rados.0.smithi084.stdout:733: done (5 left) 2024-03-30T12:24:29.102 INFO:tasks.rados.rados.0.smithi084.stdout:734: snap_create 2024-03-30T12:24:29.102 INFO:tasks.rados.rados.0.smithi084.stdout:731: finishing write tid 2 to smithi08477944-9 2024-03-30T12:24:29.102 INFO:tasks.rados.rados.0.smithi084.stdout:731: finishing write tid 3 to smithi08477944-9 2024-03-30T12:24:29.102 INFO:tasks.rados.rados.0.smithi084.stdout:731: finishing write tid 4 to smithi08477944-9 2024-03-30T12:24:29.103 INFO:tasks.rados.rados.0.smithi084.stdout:731: finishing write tid 5 to smithi08477944-9 2024-03-30T12:24:29.103 INFO:tasks.rados.rados.0.smithi084.stdout:731: oid 9 updating version 0 to 265 2024-03-30T12:24:29.103 INFO:tasks.rados.rados.0.smithi084.stdout:731: oid 9 version 265 is already newer than 263 2024-03-30T12:24:29.103 INFO:tasks.rados.rados.0.smithi084.stdout:731: oid 9 version 265 is already newer than 264 2024-03-30T12:24:29.103 INFO:tasks.rados.rados.0.smithi084.stdout:731: oid 9 version 265 is already newer than 262 2024-03-30T12:24:29.103 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 265 (ObjNum 234 snap 73 seq_num 234) dirty exists 2024-03-30T12:24:29.103 INFO:tasks.rados.rados.0.smithi084.stdout:731: left oid 9 (ObjNum 234 snap 73 seq_num 234) 2024-03-30T12:24:29.103 INFO:tasks.rados.rados.0.smithi084.stdout:729: expect (ObjNum 207 snap 62 seq_num 207) 2024-03-30T12:24:29.229 INFO:tasks.rados.rados.0.smithi084.stdout:727: expect (ObjNum 231 snap 69 seq_num 231) 2024-03-30T12:24:29.269 INFO:tasks.rados.rados.0.smithi084.stdout:732: finishing write tid 1 to smithi08477944-30 2024-03-30T12:24:29.270 INFO:tasks.rados.rados.0.smithi084.stdout:728: expect (ObjNum 110 snap 24 seq_num 110) 2024-03-30T12:24:29.329 INFO:tasks.rados.rados.0.smithi084.stdout:732: finishing write tid 2 to smithi08477944-30 2024-03-30T12:24:29.329 INFO:tasks.rados.rados.0.smithi084.stdout:732: finishing write tid 3 to smithi08477944-30 2024-03-30T12:24:29.329 INFO:tasks.rados.rados.0.smithi084.stdout:732: finishing write tid 4 to smithi08477944-30 2024-03-30T12:24:29.329 INFO:tasks.rados.rados.0.smithi084.stdout:732: finishing write tid 5 to smithi08477944-30 2024-03-30T12:24:29.329 INFO:tasks.rados.rados.0.smithi084.stdout:732: oid 30 updating version 0 to 164 2024-03-30T12:24:29.329 INFO:tasks.rados.rados.0.smithi084.stdout:732: oid 30 version 164 is already newer than 162 2024-03-30T12:24:29.330 INFO:tasks.rados.rados.0.smithi084.stdout:732: oid 30 version 164 is already newer than 161 2024-03-30T12:24:29.330 INFO:tasks.rados.rados.0.smithi084.stdout:732: oid 30 version 164 is already newer than 163 2024-03-30T12:24:29.330 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 164 (ObjNum 235 snap 73 seq_num 235) dirty exists 2024-03-30T12:24:29.330 INFO:tasks.rados.rados.0.smithi084.stdout:732: left oid 30 (ObjNum 235 snap 73 seq_num 235) 2024-03-30T12:24:29.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:29 smithi162 ceph-mon[30421]: osdmap e206: 8 total, 8 up, 8 in 2024-03-30T12:24:29.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:29 smithi162 ceph-mon[30421]: mgrmap e35: y(active, since 29s), standbys: x 2024-03-30T12:24:29.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:29 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:29.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:29 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:29.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:29 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:24:29.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:29 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:24:29.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:29 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:29.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:29 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:24:29.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:24:29] "GET /metrics HTTP/1.1" 200 35996 "" "Prometheus/2.43.0" 2024-03-30T12:24:29.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:29 smithi084 ceph-mon[37565]: osdmap e206: 8 total, 8 up, 8 in 2024-03-30T12:24:29.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:29 smithi084 ceph-mon[37565]: mgrmap e35: y(active, since 29s), standbys: x 2024-03-30T12:24:29.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:29 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:29.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:29 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:29.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:29 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:24:29.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:29 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:24:29.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:29 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:29.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:29 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:24:29.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:29 smithi084 ceph-mon[27000]: osdmap e206: 8 total, 8 up, 8 in 2024-03-30T12:24:29.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:29 smithi084 ceph-mon[27000]: mgrmap e35: y(active, since 29s), standbys: x 2024-03-30T12:24:29.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:29 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:29.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:29 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:29.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:29 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:24:29.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:29 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:24:29.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:29 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:29.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:29 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:24:30.110 INFO:tasks.rados.rados.0.smithi084.stdout:727: done (5 left) 2024-03-30T12:24:30.111 INFO:tasks.rados.rados.0.smithi084.stdout:728: done (4 left) 2024-03-30T12:24:30.111 INFO:tasks.rados.rados.0.smithi084.stdout:729: done (3 left) 2024-03-30T12:24:30.111 INFO:tasks.rados.rados.0.smithi084.stdout:731: done (2 left) 2024-03-30T12:24:30.111 INFO:tasks.rados.rados.0.smithi084.stdout:732: done (1 left) 2024-03-30T12:24:30.111 INFO:tasks.rados.rados.0.smithi084.stdout:734: done (0 left) 2024-03-30T12:24:30.111 INFO:tasks.rados.rados.0.smithi084.stdout:735: snap_create 2024-03-30T12:24:30.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:30 smithi162 ceph-mon[30421]: pgmap v48: 121 pgs: 121 active+clean; 98 MiB data, 809 MiB used, 714 GiB / 715 GiB avail; 2.3 MiB/s rd, 348 KiB/s wr, 8 op/s 2024-03-30T12:24:30.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:30 smithi162 ceph-mon[30421]: osdmap e207: 8 total, 8 up, 8 in 2024-03-30T12:24:30.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:30 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:30.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:30 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:24:30.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:30 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:30.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:30 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-30T12:24:30.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:30 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-03-30T12:24:30.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:30 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-03-30T12:24:30.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:30 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-03-30T12:24:30.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:30 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-30T12:24:30.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:30 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-03-30T12:24:30.451 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:30 smithi084 ceph-mon[37565]: pgmap v48: 121 pgs: 121 active+clean; 98 MiB data, 809 MiB used, 714 GiB / 715 GiB avail; 2.3 MiB/s rd, 348 KiB/s wr, 8 op/s 2024-03-30T12:24:30.451 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:30 smithi084 ceph-mon[37565]: osdmap e207: 8 total, 8 up, 8 in 2024-03-30T12:24:30.451 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:30 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:30.451 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:30 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:24:30.451 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:30 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:30.451 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:30 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-30T12:24:30.451 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:30 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-03-30T12:24:30.451 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:30 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-03-30T12:24:30.451 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:30 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-03-30T12:24:30.451 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:30 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-30T12:24:30.452 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:30 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-03-30T12:24:30.452 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:30 smithi084 ceph-mon[27000]: pgmap v48: 121 pgs: 121 active+clean; 98 MiB data, 809 MiB used, 714 GiB / 715 GiB avail; 2.3 MiB/s rd, 348 KiB/s wr, 8 op/s 2024-03-30T12:24:30.452 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:30 smithi084 ceph-mon[27000]: osdmap e207: 8 total, 8 up, 8 in 2024-03-30T12:24:30.452 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:30 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:30.452 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:30 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:24:30.452 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:30 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:30.452 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:30 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-30T12:24:30.452 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:30 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-03-30T12:24:30.452 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:30 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-03-30T12:24:30.452 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:30 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-03-30T12:24:30.452 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:30 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-30T12:24:30.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:30 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-03-30T12:24:31.108 INFO:tasks.rados.rados.0.smithi084.stdout:735: done (0 left) 2024-03-30T12:24:31.109 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 75 2024-03-30T12:24:31.109 INFO:tasks.rados.rados.0.smithi084.stdout:736: seq_num 236 ranges {1196032=761856,1957888=647168,2605056=155648} 2024-03-30T12:24:31.119 INFO:tasks.rados.rados.0.smithi084.stdout:736: writing smithi08477944-17 from 1196032 to 1957888 tid 1 2024-03-30T12:24:31.123 INFO:tasks.rados.rados.0.smithi084.stdout:736: writing smithi08477944-17 from 1957888 to 2605056 tid 2 2024-03-30T12:24:31.124 INFO:tasks.rados.rados.0.smithi084.stdout:736: writing smithi08477944-17 from 2605056 to 2760704 tid 3 2024-03-30T12:24:31.124 INFO:tasks.rados.rados.0.smithi084.stdout:737: delete oid 15 current snap is 75 2024-03-30T12:24:31.127 INFO:tasks.rados.rados.0.smithi084.stdout:736: finishing write tid 1 to smithi08477944-17 2024-03-30T12:24:31.127 INFO:tasks.rados.rados.0.smithi084.stdout:736: finishing write tid 2 to smithi08477944-17 2024-03-30T12:24:31.128 INFO:tasks.rados.rados.0.smithi084.stdout:736: finishing write tid 3 to smithi08477944-17 2024-03-30T12:24:31.129 INFO:tasks.rados.rados.0.smithi084.stdout:736: finishing write tid 4 to smithi08477944-17 2024-03-30T12:24:31.130 INFO:tasks.rados.rados.0.smithi084.stdout:737: done (1 left) 2024-03-30T12:24:31.130 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 27 current snap is 75 2024-03-30T12:24:31.130 INFO:tasks.rados.rados.0.smithi084.stdout:738: seq_num 238 ranges {2392064=794624,3186688=417792,3604480=385024} 2024-03-30T12:24:31.150 INFO:tasks.rados.rados.0.smithi084.stdout:738: writing smithi08477944-27 from 2392064 to 3186688 tid 1 2024-03-30T12:24:31.150 INFO:tasks.rados.rados.0.smithi084.stdout:738: writing smithi08477944-27 from 3186688 to 3604480 tid 2 2024-03-30T12:24:31.153 INFO:tasks.rados.rados.0.smithi084.stdout:738: writing smithi08477944-27 from 3604480 to 3989504 tid 3 2024-03-30T12:24:31.153 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 75 2024-03-30T12:24:31.153 INFO:tasks.rados.rados.0.smithi084.stdout:736: finishing write tid 5 to smithi08477944-17 2024-03-30T12:24:31.153 INFO:tasks.rados.rados.0.smithi084.stdout:736: oid 17 updating version 0 to 378 2024-03-30T12:24:31.153 INFO:tasks.rados.rados.0.smithi084.stdout:736: oid 17 version 378 is already newer than 377 2024-03-30T12:24:31.153 INFO:tasks.rados.rados.0.smithi084.stdout:736: oid 17 updating version 378 to 379 2024-03-30T12:24:31.153 INFO:tasks.rados.rados.0.smithi084.stdout:736: oid 17 version 379 is already newer than 376 2024-03-30T12:24:31.153 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 379 (ObjNum 236 snap 75 seq_num 236) dirty exists 2024-03-30T12:24:31.153 INFO:tasks.rados.rados.0.smithi084.stdout:736: left oid 17 (ObjNum 236 snap 75 seq_num 236) 2024-03-30T12:24:31.154 INFO:tasks.rados.rados.0.smithi084.stdout:739: seq_num 239 ranges {0=409600,409600=704512,1114112=499712} 2024-03-30T12:24:31.155 INFO:tasks.rados.rados.0.smithi084.stdout:739: writing smithi08477944-10 from 0 to 409600 tid 1 2024-03-30T12:24:31.160 INFO:tasks.rados.rados.0.smithi084.stdout:739: writing smithi08477944-10 from 409600 to 1114112 tid 2 2024-03-30T12:24:31.164 INFO:tasks.rados.rados.0.smithi084.stdout:739: writing smithi08477944-10 from 1114112 to 1613824 tid 3 2024-03-30T12:24:31.164 INFO:tasks.rados.rados.0.smithi084.stdout:736: done (2 left) 2024-03-30T12:24:31.164 INFO:tasks.rados.rados.0.smithi084.stdout:740: delete oid 12 current snap is 75 2024-03-30T12:24:31.165 INFO:tasks.rados.rados.0.smithi084.stdout:738: finishing write tid 1 to smithi08477944-27 2024-03-30T12:24:31.165 INFO:tasks.rados.rados.0.smithi084.stdout:738: finishing write tid 2 to smithi08477944-27 2024-03-30T12:24:31.165 INFO:tasks.rados.rados.0.smithi084.stdout:738: finishing write tid 3 to smithi08477944-27 2024-03-30T12:24:31.165 INFO:tasks.rados.rados.0.smithi084.stdout:738: finishing write tid 4 to smithi08477944-27 2024-03-30T12:24:31.165 INFO:tasks.rados.rados.0.smithi084.stdout:739: finishing write tid 1 to smithi08477944-10 2024-03-30T12:24:31.165 INFO:tasks.rados.rados.0.smithi084.stdout:738: finishing write tid 5 to smithi08477944-27 2024-03-30T12:24:31.165 INFO:tasks.rados.rados.0.smithi084.stdout:738: oid 27 updating version 0 to 180 2024-03-30T12:24:31.165 INFO:tasks.rados.rados.0.smithi084.stdout:738: oid 27 version 180 is already newer than 179 2024-03-30T12:24:31.165 INFO:tasks.rados.rados.0.smithi084.stdout:738: oid 27 version 180 is already newer than 178 2024-03-30T12:24:31.166 INFO:tasks.rados.rados.0.smithi084.stdout:738: oid 27 updating version 180 to 181 2024-03-30T12:24:31.166 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 181 (ObjNum 238 snap 75 seq_num 238) dirty exists 2024-03-30T12:24:31.166 INFO:tasks.rados.rados.0.smithi084.stdout:738: left oid 27 (ObjNum 238 snap 75 seq_num 238) 2024-03-30T12:24:31.166 INFO:tasks.rados.rados.0.smithi084.stdout:739: finishing write tid 2 to smithi08477944-10 2024-03-30T12:24:31.166 INFO:tasks.rados.rados.0.smithi084.stdout:738: done (2 left) 2024-03-30T12:24:31.167 INFO:tasks.rados.rados.0.smithi084.stdout:740: done (1 left) 2024-03-30T12:24:31.167 INFO:tasks.rados.rados.0.smithi084.stdout:741: read oid 41 snap -1 2024-03-30T12:24:31.167 INFO:tasks.rados.rados.0.smithi084.stdout:741: expect (ObjNum 220 snap 65 seq_num 220) 2024-03-30T12:24:31.167 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 75 2024-03-30T12:24:31.167 INFO:tasks.rados.rados.0.smithi084.stdout:742: seq_num 241 ranges {3776512=442368,4218880=466944,4685824=688128,5373952=49152} 2024-03-30T12:24:31.191 INFO:tasks.rados.rados.0.smithi084.stdout:742: writing smithi08477944-29 from 3776512 to 4218880 tid 1 2024-03-30T12:24:31.194 INFO:tasks.rados.rados.0.smithi084.stdout:742: writing smithi08477944-29 from 4218880 to 4685824 tid 2 2024-03-30T12:24:31.199 INFO:tasks.rados.rados.0.smithi084.stdout:742: writing smithi08477944-29 from 4685824 to 5373952 tid 3 2024-03-30T12:24:31.200 INFO:tasks.rados.rados.0.smithi084.stdout:742: writing smithi08477944-29 from 5373952 to 5423104 tid 4 2024-03-30T12:24:31.200 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 75 2024-03-30T12:24:31.200 INFO:tasks.rados.rados.0.smithi084.stdout:739: finishing write tid 3 to smithi08477944-10 2024-03-30T12:24:31.200 INFO:tasks.rados.rados.0.smithi084.stdout:739: finishing write tid 4 to smithi08477944-10 2024-03-30T12:24:31.200 INFO:tasks.rados.rados.0.smithi084.stdout:739: finishing write tid 5 to smithi08477944-10 2024-03-30T12:24:31.200 INFO:tasks.rados.rados.0.smithi084.stdout:739: oid 10 updating version 0 to 302 2024-03-30T12:24:31.200 INFO:tasks.rados.rados.0.smithi084.stdout:739: oid 10 version 302 is already newer than 300 2024-03-30T12:24:31.200 INFO:tasks.rados.rados.0.smithi084.stdout:739: oid 10 version 302 is already newer than 301 2024-03-30T12:24:31.201 INFO:tasks.rados.rados.0.smithi084.stdout:739: oid 10 version 302 is already newer than 299 2024-03-30T12:24:31.201 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 302 (ObjNum 239 snap 75 seq_num 239) dirty exists 2024-03-30T12:24:31.201 INFO:tasks.rados.rados.0.smithi084.stdout:739: left oid 10 (ObjNum 239 snap 75 seq_num 239) 2024-03-30T12:24:31.201 INFO:tasks.rados.rados.0.smithi084.stdout:741: expect (ObjNum 220 snap 65 seq_num 220) 2024-03-30T12:24:31.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:31 smithi084 ceph-mon[37565]: Upgrade: Setting container_image for all mgr 2024-03-30T12:24:31.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:31 smithi084 ceph-mon[37565]: Upgrade: It appears safe to stop mon.a 2024-03-30T12:24:31.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:31 smithi084 ceph-mon[37565]: osdmap e208: 8 total, 8 up, 8 in 2024-03-30T12:24:31.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:31 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:31.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:31 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:24:31.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:31 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:24:31.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:31 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:24:31.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:31 smithi084 ceph-mon[27000]: Upgrade: Setting container_image for all mgr 2024-03-30T12:24:31.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:31 smithi084 ceph-mon[27000]: Upgrade: It appears safe to stop mon.a 2024-03-30T12:24:31.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:31 smithi084 ceph-mon[27000]: osdmap e208: 8 total, 8 up, 8 in 2024-03-30T12:24:31.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:31 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:31.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:31 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:24:31.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:31 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:24:31.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:31 smithi084 ceph-mon[27000]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:24:31.273 INFO:tasks.rados.rados.0.smithi084.stdout:742: finishing write tid 1 to smithi08477944-29 2024-03-30T12:24:31.273 INFO:tasks.rados.rados.0.smithi084.stdout:742: finishing write tid 2 to smithi08477944-29 2024-03-30T12:24:31.274 INFO:tasks.rados.rados.0.smithi084.stdout:743: seq_num 242 ranges {2293760=458752,2752512=753664,3506176=450560} 2024-03-30T12:24:31.289 INFO:tasks.rados.rados.0.smithi084.stdout:743: writing smithi08477944-39 from 2293760 to 2752512 tid 1 2024-03-30T12:24:31.295 INFO:tasks.rados.rados.0.smithi084.stdout:743: writing smithi08477944-39 from 2752512 to 3506176 tid 2 2024-03-30T12:24:31.299 INFO:tasks.rados.rados.0.smithi084.stdout:743: writing smithi08477944-39 from 3506176 to 3956736 tid 3 2024-03-30T12:24:31.299 INFO:tasks.rados.rados.0.smithi084.stdout:739: done (3 left) 2024-03-30T12:24:31.299 INFO:tasks.rados.rados.0.smithi084.stdout:741: done (2 left) 2024-03-30T12:24:31.299 INFO:tasks.rados.rados.0.smithi084.stdout:744: delete oid 15 current snap is 75 2024-03-30T12:24:31.299 INFO:tasks.rados.rados.0.smithi084.stdout:742: finishing write tid 3 to smithi08477944-29 2024-03-30T12:24:31.299 INFO:tasks.rados.rados.0.smithi084.stdout:742: finishing write tid 4 to smithi08477944-29 2024-03-30T12:24:31.299 INFO:tasks.rados.rados.0.smithi084.stdout:742: finishing write tid 5 to smithi08477944-29 2024-03-30T12:24:31.299 INFO:tasks.rados.rados.0.smithi084.stdout:742: finishing write tid 6 to smithi08477944-29 2024-03-30T12:24:31.299 INFO:tasks.rados.rados.0.smithi084.stdout:742: oid 29 updating version 0 to 256 2024-03-30T12:24:31.300 INFO:tasks.rados.rados.0.smithi084.stdout:742: oid 29 updating version 256 to 257 2024-03-30T12:24:31.300 INFO:tasks.rados.rados.0.smithi084.stdout:742: oid 29 version 257 is already newer than 254 2024-03-30T12:24:31.300 INFO:tasks.rados.rados.0.smithi084.stdout:742: oid 29 version 257 is already newer than 255 2024-03-30T12:24:31.300 INFO:tasks.rados.rados.0.smithi084.stdout:742: oid 29 version 257 is already newer than 253 2024-03-30T12:24:31.300 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 257 (ObjNum 241 snap 75 seq_num 241) dirty exists 2024-03-30T12:24:31.300 INFO:tasks.rados.rados.0.smithi084.stdout:742: left oid 29 (ObjNum 241 snap 75 seq_num 241) 2024-03-30T12:24:31.300 INFO:tasks.rados.rados.0.smithi084.stdout:743: finishing write tid 1 to smithi08477944-39 2024-03-30T12:24:31.301 INFO:tasks.rados.rados.0.smithi084.stdout:743: finishing write tid 2 to smithi08477944-39 2024-03-30T12:24:31.301 INFO:tasks.rados.rados.0.smithi084.stdout:743: finishing write tid 3 to smithi08477944-39 2024-03-30T12:24:31.301 INFO:tasks.rados.rados.0.smithi084.stdout:743: finishing write tid 4 to smithi08477944-39 2024-03-30T12:24:31.302 INFO:tasks.rados.rados.0.smithi084.stdout:742: done (2 left) 2024-03-30T12:24:31.302 INFO:tasks.rados.rados.0.smithi084.stdout:744: done (1 left) 2024-03-30T12:24:31.302 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 75 2024-03-30T12:24:31.302 INFO:tasks.rados.rados.0.smithi084.stdout:745: seq_num 244 ranges {0=491520,491520=573440,1064960=458752,1523712=172032} 2024-03-30T12:24:31.304 INFO:tasks.rados.rados.0.smithi084.stdout:745: writing smithi08477944-38 from 0 to 491520 tid 1 2024-03-30T12:24:31.307 INFO:tasks.rados.rados.0.smithi084.stdout:745: writing smithi08477944-38 from 491520 to 1064960 tid 2 2024-03-30T12:24:31.310 INFO:tasks.rados.rados.0.smithi084.stdout:745: writing smithi08477944-38 from 1064960 to 1523712 tid 3 2024-03-30T12:24:31.312 INFO:tasks.rados.rados.0.smithi084.stdout:745: writing smithi08477944-38 from 1523712 to 1695744 tid 4 2024-03-30T12:24:31.312 INFO:tasks.rados.rados.0.smithi084.stdout:746: copy_from oid 34 from oid 41 current snap is 75 2024-03-30T12:24:31.312 INFO:tasks.rados.rados.0.smithi084.stdout:743: finishing write tid 5 to smithi08477944-39 2024-03-30T12:24:31.312 INFO:tasks.rados.rados.0.smithi084.stdout:743: oid 39 updating version 0 to 381 2024-03-30T12:24:31.312 INFO:tasks.rados.rados.0.smithi084.stdout:743: oid 39 updating version 381 to 382 2024-03-30T12:24:31.312 INFO:tasks.rados.rados.0.smithi084.stdout:743: oid 39 updating version 382 to 384 2024-03-30T12:24:31.312 INFO:tasks.rados.rados.0.smithi084.stdout:743: oid 39 version 384 is already newer than 383 2024-03-30T12:24:31.312 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 384 (ObjNum 242 snap 75 seq_num 242) dirty exists 2024-03-30T12:24:31.312 INFO:tasks.rados.rados.0.smithi084.stdout:743: left oid 39 (ObjNum 242 snap 75 seq_num 242) 2024-03-30T12:24:31.312 INFO:tasks.rados.rados.0.smithi084.stdout:745: finishing write tid 1 to smithi08477944-38 2024-03-30T12:24:31.313 INFO:tasks.rados.rados.0.smithi084.stdout:745: finishing write tid 2 to smithi08477944-38 2024-03-30T12:24:31.313 INFO:tasks.rados.rados.0.smithi084.stdout:743: done (2 left) 2024-03-30T12:24:31.313 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 75 2024-03-30T12:24:31.313 INFO:tasks.rados.rados.0.smithi084.stdout:747: seq_num 245 ranges {0=507904,507904=458752,966656=671744,1638400=73728} 2024-03-30T12:24:31.315 INFO:tasks.rados.rados.0.smithi084.stdout:747: writing smithi08477944-50 from 0 to 507904 tid 1 2024-03-30T12:24:31.317 INFO:tasks.rados.rados.0.smithi084.stdout:747: writing smithi08477944-50 from 507904 to 966656 tid 2 2024-03-30T12:24:31.321 INFO:tasks.rados.rados.0.smithi084.stdout:747: writing smithi08477944-50 from 966656 to 1638400 tid 3 2024-03-30T12:24:31.323 INFO:tasks.rados.rados.0.smithi084.stdout:747: writing smithi08477944-50 from 1638400 to 1712128 tid 4 2024-03-30T12:24:31.323 INFO:tasks.rados.rados.0.smithi084.stdout:748: delete oid 18 current snap is 75 2024-03-30T12:24:31.323 INFO:tasks.rados.rados.0.smithi084.stdout:745: finishing write tid 3 to smithi08477944-38 2024-03-30T12:24:31.323 INFO:tasks.rados.rados.0.smithi084.stdout:745: finishing write tid 4 to smithi08477944-38 2024-03-30T12:24:31.323 INFO:tasks.rados.rados.0.smithi084.stdout:745: finishing write tid 5 to smithi08477944-38 2024-03-30T12:24:31.323 INFO:tasks.rados.rados.0.smithi084.stdout:745: finishing write tid 6 to smithi08477944-38 2024-03-30T12:24:31.323 INFO:tasks.rados.rados.0.smithi084.stdout:745: oid 38 updating version 0 to 169 2024-03-30T12:24:31.323 INFO:tasks.rados.rados.0.smithi084.stdout:745: oid 38 version 169 is already newer than 165 2024-03-30T12:24:31.323 INFO:tasks.rados.rados.0.smithi084.stdout:745: oid 38 version 169 is already newer than 166 2024-03-30T12:24:31.323 INFO:tasks.rados.rados.0.smithi084.stdout:745: oid 38 version 169 is already newer than 168 2024-03-30T12:24:31.323 INFO:tasks.rados.rados.0.smithi084.stdout:745: oid 38 version 169 is already newer than 167 2024-03-30T12:24:31.323 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 169 (ObjNum 244 snap 75 seq_num 244) dirty exists 2024-03-30T12:24:31.323 INFO:tasks.rados.rados.0.smithi084.stdout:745: left oid 38 (ObjNum 244 snap 75 seq_num 244) 2024-03-30T12:24:31.323 INFO:tasks.rados.rados.0.smithi084.stdout:747: finishing write tid 1 to smithi08477944-50 2024-03-30T12:24:31.324 INFO:tasks.rados.rados.0.smithi084.stdout:747: finishing write tid 2 to smithi08477944-50 2024-03-30T12:24:31.324 INFO:tasks.rados.rados.0.smithi084.stdout:746: finishing copy_from racing read to smithi08477944-34 2024-03-30T12:24:31.324 INFO:tasks.rados.rados.0.smithi084.stdout:746: finishing copy_from to smithi08477944-34 2024-03-30T12:24:31.324 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 404 (ObjNum 220 snap 65 seq_num 220) dirty exists 2024-03-30T12:24:31.325 INFO:tasks.rados.rados.0.smithi084.stdout:747: finishing write tid 3 to smithi08477944-50 2024-03-30T12:24:31.325 INFO:tasks.rados.rados.0.smithi084.stdout:747: finishing write tid 4 to smithi08477944-50 2024-03-30T12:24:31.325 INFO:tasks.rados.rados.0.smithi084.stdout:747: finishing write tid 5 to smithi08477944-50 2024-03-30T12:24:31.328 INFO:tasks.rados.rados.0.smithi084.stdout:747: finishing write tid 6 to smithi08477944-50 2024-03-30T12:24:31.328 INFO:tasks.rados.rados.0.smithi084.stdout:747: oid 50 updating version 0 to 427 2024-03-30T12:24:31.328 INFO:tasks.rados.rados.0.smithi084.stdout:747: oid 50 version 427 is already newer than 426 2024-03-30T12:24:31.329 INFO:tasks.rados.rados.0.smithi084.stdout:747: oid 50 version 427 is already newer than 424 2024-03-30T12:24:31.329 INFO:tasks.rados.rados.0.smithi084.stdout:747: oid 50 version 427 is already newer than 425 2024-03-30T12:24:31.329 INFO:tasks.rados.rados.0.smithi084.stdout:747: oid 50 updating version 427 to 428 2024-03-30T12:24:31.329 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 428 (ObjNum 245 snap 75 seq_num 245) dirty exists 2024-03-30T12:24:31.329 INFO:tasks.rados.rados.0.smithi084.stdout:747: left oid 50 (ObjNum 245 snap 75 seq_num 245) 2024-03-30T12:24:31.329 INFO:tasks.rados.rados.0.smithi084.stdout:745: done (3 left) 2024-03-30T12:24:31.329 INFO:tasks.rados.rados.0.smithi084.stdout:746: done (2 left) 2024-03-30T12:24:31.329 INFO:tasks.rados.rados.0.smithi084.stdout:747: done (1 left) 2024-03-30T12:24:31.329 INFO:tasks.rados.rados.0.smithi084.stdout:748: done (0 left) 2024-03-30T12:24:31.329 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 75 2024-03-30T12:24:31.329 INFO:tasks.rados.rados.0.smithi084.stdout:749: seq_num 247 ranges {778240=540672,1318912=622592,1941504=581632} 2024-03-30T12:24:31.335 INFO:tasks.rados.rados.0.smithi084.stdout:749: writing smithi08477944-3 from 778240 to 1318912 tid 1 2024-03-30T12:24:31.339 INFO:tasks.rados.rados.0.smithi084.stdout:749: writing smithi08477944-3 from 1318912 to 1941504 tid 2 2024-03-30T12:24:31.342 INFO:tasks.rados.rados.0.smithi084.stdout:749: writing smithi08477944-3 from 1941504 to 2523136 tid 3 2024-03-30T12:24:31.343 INFO:tasks.rados.rados.0.smithi084.stdout:750: snap_create 2024-03-30T12:24:31.343 INFO:tasks.rados.rados.0.smithi084.stdout:749: finishing write tid 1 to smithi08477944-3 2024-03-30T12:24:31.343 INFO:tasks.rados.rados.0.smithi084.stdout:749: finishing write tid 2 to smithi08477944-3 2024-03-30T12:24:31.345 INFO:tasks.rados.rados.0.smithi084.stdout:749: finishing write tid 3 to smithi08477944-3 2024-03-30T12:24:31.345 INFO:tasks.rados.rados.0.smithi084.stdout:749: finishing write tid 4 to smithi08477944-3 2024-03-30T12:24:31.346 INFO:tasks.rados.rados.0.smithi084.stdout:749: finishing write tid 5 to smithi08477944-3 2024-03-30T12:24:31.346 INFO:tasks.rados.rados.0.smithi084.stdout:749: oid 3 updating version 0 to 376 2024-03-30T12:24:31.346 INFO:tasks.rados.rados.0.smithi084.stdout:749: oid 3 updating version 376 to 377 2024-03-30T12:24:31.346 INFO:tasks.rados.rados.0.smithi084.stdout:749: oid 3 updating version 377 to 378 2024-03-30T12:24:31.346 INFO:tasks.rados.rados.0.smithi084.stdout:749: oid 3 version 378 is already newer than 375 2024-03-30T12:24:31.347 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 378 (ObjNum 247 snap 75 seq_num 247) dirty exists 2024-03-30T12:24:31.347 INFO:tasks.rados.rados.0.smithi084.stdout:749: left oid 3 (ObjNum 247 snap 75 seq_num 247) 2024-03-30T12:24:31.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:31 smithi162 ceph-mon[30421]: Upgrade: Setting container_image for all mgr 2024-03-30T12:24:31.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:31 smithi162 ceph-mon[30421]: Upgrade: It appears safe to stop mon.a 2024-03-30T12:24:31.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:31 smithi162 ceph-mon[30421]: osdmap e208: 8 total, 8 up, 8 in 2024-03-30T12:24:31.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:31 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' 2024-03-30T12:24:31.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:31 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:24:31.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:31 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:24:31.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:31 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:24:32.122 INFO:tasks.rados.rados.0.smithi084.stdout:749: done (1 left) 2024-03-30T12:24:32.122 INFO:tasks.rados.rados.0.smithi084.stdout:750: done (0 left) 2024-03-30T12:24:32.122 INFO:tasks.rados.rados.0.smithi084.stdout:751: snap_remove snap 64 2024-03-30T12:24:32.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:32 smithi162 ceph-mon[30421]: Upgrade: Updating mon.a 2024-03-30T12:24:32.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:32 smithi162 ceph-mon[30421]: Deploying daemon mon.a on smithi084 2024-03-30T12:24:32.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:32 smithi162 ceph-mon[30421]: pgmap v51: 121 pgs: 121 active+clean; 105 MiB data, 820 MiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 1.6 MiB/s wr, 19 op/s 2024-03-30T12:24:32.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:32 smithi162 ceph-mon[30421]: osdmap e209: 8 total, 8 up, 8 in 2024-03-30T12:24:32.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:32 smithi084 ceph-mon[37565]: Upgrade: Updating mon.a 2024-03-30T12:24:32.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:32 smithi084 ceph-mon[37565]: Deploying daemon mon.a on smithi084 2024-03-30T12:24:32.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:32 smithi084 ceph-mon[37565]: pgmap v51: 121 pgs: 121 active+clean; 105 MiB data, 820 MiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 1.6 MiB/s wr, 19 op/s 2024-03-30T12:24:32.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:32 smithi084 ceph-mon[37565]: osdmap e209: 8 total, 8 up, 8 in 2024-03-30T12:24:32.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:32 smithi084 ceph-mon[27000]: Upgrade: Updating mon.a 2024-03-30T12:24:32.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:32 smithi084 ceph-mon[27000]: Deploying daemon mon.a on smithi084 2024-03-30T12:24:32.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:32 smithi084 ceph-mon[27000]: pgmap v51: 121 pgs: 121 active+clean; 105 MiB data, 820 MiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 1.6 MiB/s wr, 19 op/s 2024-03-30T12:24:32.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:32 smithi084 ceph-mon[27000]: osdmap e209: 8 total, 8 up, 8 in 2024-03-30T12:24:33.106 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:32 smithi084 systemd[1]: Stopping Ceph mon.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:24:33.106 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[26996]: 2024-03-30T12:24:33.104+0000 7fabdbc18700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:24:33.106 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[26996]: 2024-03-30T12:24:33.104+0000 7fabdbc18700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-03-30T12:24:33.397 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:33 smithi084 podman[89106]: 2024-03-30 12:24:33.125509427 +0000 UTC m=+0.123562604 container died 915abc0d6de7e577785ce0af684cbd8c35fe1ef5e1b6b6f947de7f77b234e687 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-f14b568, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=) 2024-03-30T12:24:33.397 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:24:33] ENGINE Bus STOPPING 2024-03-30T12:24:33.397 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:24:33] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T12:24:33.397 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:24:33] ENGINE Bus STOPPED 2024-03-30T12:24:33.397 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:24:33] ENGINE Bus STARTING 2024-03-30T12:24:33.397 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:24:33] ENGINE Serving on http://:::9283 2024-03-30T12:24:33.398 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:24:33] ENGINE Bus STARTED 2024-03-30T12:24:33.747 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:33 smithi084 podman[89106]: 2024-03-30 12:24:33.496898301 +0000 UTC m=+0.494951473 container cleanup 915abc0d6de7e577785ce0af684cbd8c35fe1ef5e1b6b6f947de7f77b234e687 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=reef-f14b568, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-03-30T12:24:33.747 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:33 smithi084 bash[89106]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a 2024-03-30T12:24:34.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:33 smithi084 podman[89120]: 2024-03-30 12:24:33.756354534 +0000 UTC m=+0.632141589 container remove 915abc0d6de7e577785ce0af684cbd8c35fe1ef5e1b6b6f947de7f77b234e687 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=reef-f14b568, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-03-30T12:24:34.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:33 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mon.a.service: Deactivated successfully. 2024-03-30T12:24:34.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:33 smithi084 systemd[1]: Stopped Ceph mon.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:24:34.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:33 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mon.a.service: Consumed 13.445s CPU time. 2024-03-30T12:24:34.438 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 systemd[1]: Starting Ceph mon.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:24:34.438 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 podman[89260]: 2024-03-30 12:24:34.229787847 +0000 UTC m=+0.018789808 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:24:34.438 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 podman[89260]: 2024-03-30 12:24:34.340514041 +0000 UTC m=+0.129515989 container create a0811f2ae47df6b863f8534b406e5853d9c81b6e3cdf859cb5bffd684a8776ff (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a, CEPH_POINT_RELEASE=, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326) 2024-03-30T12:24:34.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 podman[89260]: 2024-03-30 12:24:34.576630392 +0000 UTC m=+0.365632348 container init a0811f2ae47df6b863f8534b406e5853d9c81b6e3cdf859cb5bffd684a8776ff (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-03-30T12:24:34.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 podman[89260]: 2024-03-30 12:24:34.579854847 +0000 UTC m=+0.368856796 container start a0811f2ae47df6b863f8534b406e5853d9c81b6e3cdf859cb5bffd684a8776ff (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:24:34.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: set uid:gid to 167:167 (ceph:ceph) 2024-03-30T12:24:34.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev), process ceph-mon, pid 2 2024-03-30T12:24:34.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: pidfile_write: ignore empty --pid-file 2024-03-30T12:24:34.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: load: jerasure load: lrc 2024-03-30T12:24:34.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: RocksDB version: 7.9.2 2024-03-30T12:24:34.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Git sha 0 2024-03-30T12:24:34.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Compile date 2024-03-29 20:54:14 2024-03-30T12:24:34.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: DB SUMMARY 2024-03-30T12:24:34.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: DB Session ID: JXI0XZ8FNL702RPR0MY5 2024-03-30T12:24:34.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: CURRENT file: CURRENT 2024-03-30T12:24:34.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: IDENTITY file: IDENTITY 2024-03-30T12:24:34.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1511 Bytes 2024-03-30T12:24:34.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000032.sst 2024-03-30T12:24:34.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000030.log size: 4198404 ; 2024-03-30T12:24:34.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.error_if_exists: 0 2024-03-30T12:24:34.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.create_if_missing: 0 2024-03-30T12:24:34.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.paranoid_checks: 1 2024-03-30T12:24:34.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-30T12:24:34.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-30T12:24:34.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-30T12:24:34.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.env: 0x563e4257fb20 2024-03-30T12:24:34.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.fs: PosixFileSystem 2024-03-30T12:24:34.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.info_log: 0x563e44cf58e0 2024-03-30T12:24:34.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_file_opening_threads: 16 2024-03-30T12:24:34.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.statistics: (nil) 2024-03-30T12:24:34.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.use_fsync: 0 2024-03-30T12:24:34.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_log_file_size: 0 2024-03-30T12:24:34.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-30T12:24:34.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-30T12:24:34.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.keep_log_file_num: 1000 2024-03-30T12:24:34.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.recycle_log_file_num: 0 2024-03-30T12:24:34.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.allow_fallocate: 1 2024-03-30T12:24:34.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.allow_mmap_reads: 0 2024-03-30T12:24:34.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.allow_mmap_writes: 0 2024-03-30T12:24:34.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.use_direct_reads: 0 2024-03-30T12:24:34.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-30T12:24:34.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.create_missing_column_families: 0 2024-03-30T12:24:34.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.db_log_dir: 2024-03-30T12:24:34.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.wal_dir: 2024-03-30T12:24:34.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-30T12:24:34.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-30T12:24:34.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-30T12:24:34.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-30T12:24:34.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-30T12:24:34.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-30T12:24:34.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.advise_random_on_open: 1 2024-03-30T12:24:34.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.db_write_buffer_size: 0 2024-03-30T12:24:34.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.write_buffer_manager: 0x563e44cc8dc0 2024-03-30T12:24:34.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-30T12:24:34.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-30T12:24:34.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-30T12:24:34.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.rate_limiter: (nil) 2024-03-30T12:24:34.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-30T12:24:34.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.wal_recovery_mode: 2 2024-03-30T12:24:34.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.enable_thread_tracking: 0 2024-03-30T12:24:34.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.enable_pipelined_write: 0 2024-03-30T12:24:34.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.unordered_write: 0 2024-03-30T12:24:34.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-30T12:24:34.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-30T12:24:34.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-30T12:24:34.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-30T12:24:34.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.row_cache: None 2024-03-30T12:24:34.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.wal_filter: None 2024-03-30T12:24:34.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-30T12:24:34.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.allow_ingest_behind: 0 2024-03-30T12:24:34.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.two_write_queues: 0 2024-03-30T12:24:34.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.manual_wal_flush: 0 2024-03-30T12:24:34.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.wal_compression: 0 2024-03-30T12:24:34.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.atomic_flush: 0 2024-03-30T12:24:34.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-30T12:24:34.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-30T12:24:34.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-30T12:24:34.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.log_readahead_size: 0 2024-03-30T12:24:34.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-30T12:24:34.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.best_efforts_recovery: 0 2024-03-30T12:24:34.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-30T12:24:34.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-30T12:24:34.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.allow_data_in_errors: 0 2024-03-30T12:24:34.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.db_host_id: __hostname__ 2024-03-30T12:24:34.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-30T12:24:34.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_background_jobs: 2 2024-03-30T12:24:34.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_background_compactions: -1 2024-03-30T12:24:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_subcompactions: 1 2024-03-30T12:24:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-30T12:24:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-30T12:24:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-30T12:24:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_total_wal_size: 0 2024-03-30T12:24:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-30T12:24:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-30T12:24:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-30T12:24:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-30T12:24:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_open_files: -1 2024-03-30T12:24:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.bytes_per_sync: 0 2024-03-30T12:24:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-30T12:24:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-30T12:24:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.compaction_readahead_size: 0 2024-03-30T12:24:34.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_background_flushes: -1 2024-03-30T12:24:34.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Compression algorithms supported: 2024-03-30T12:24:34.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-30T12:24:34.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: kZSTD supported: 0 2024-03-30T12:24:34.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: kXpressCompression supported: 0 2024-03-30T12:24:34.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: kLZ4HCCompression supported: 1 2024-03-30T12:24:34.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: kZlibCompression supported: 1 2024-03-30T12:24:34.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: kSnappyCompression supported: 1 2024-03-30T12:24:34.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: kLZ4Compression supported: 1 2024-03-30T12:24:34.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: kBZip2Compression supported: 0 2024-03-30T12:24:34.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-30T12:24:34.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-30T12:24:34.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 2024-03-30T12:24:34.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-30T12:24:34.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-30T12:24:34.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.merge_operator: 2024-03-30T12:24:34.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.compaction_filter: None 2024-03-30T12:24:34.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.compaction_filter_factory: None 2024-03-30T12:24:34.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.sst_partitioner_factory: None 2024-03-30T12:24:34.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-30T12:24:34.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-30T12:24:34.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563e44cf59e0) 2024-03-30T12:24:34.765 INFO:journalctl@ceph.mon.a.smithi084.stdout: cache_index_and_filter_blocks: 1 2024-03-30T12:24:34.765 INFO:journalctl@ceph.mon.a.smithi084.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-30T12:24:34.765 INFO:journalctl@ceph.mon.a.smithi084.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-30T12:24:34.765 INFO:journalctl@ceph.mon.a.smithi084.stdout: pin_top_level_index_and_filter: 1 2024-03-30T12:24:34.765 INFO:journalctl@ceph.mon.a.smithi084.stdout: index_type: 0 2024-03-30T12:24:34.765 INFO:journalctl@ceph.mon.a.smithi084.stdout: data_block_index_type: 0 2024-03-30T12:24:34.765 INFO:journalctl@ceph.mon.a.smithi084.stdout: index_shortening: 1 2024-03-30T12:24:34.766 INFO:journalctl@ceph.mon.a.smithi084.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-30T12:24:34.766 INFO:journalctl@ceph.mon.a.smithi084.stdout: checksum: 4 2024-03-30T12:24:34.766 INFO:journalctl@ceph.mon.a.smithi084.stdout: no_block_cache: 0 2024-03-30T12:24:34.766 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache: 0x563e44cfb090 2024-03-30T12:24:34.766 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache_name: BinnedLRUCache 2024-03-30T12:24:34.766 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache_options: 2024-03-30T12:24:34.766 INFO:journalctl@ceph.mon.a.smithi084.stdout: capacity : 536870912 2024-03-30T12:24:34.766 INFO:journalctl@ceph.mon.a.smithi084.stdout: num_shard_bits : 4 2024-03-30T12:24:34.766 INFO:journalctl@ceph.mon.a.smithi084.stdout: strict_capacity_limit : 0 2024-03-30T12:24:34.766 INFO:journalctl@ceph.mon.a.smithi084.stdout: high_pri_pool_ratio: 0.000 2024-03-30T12:24:34.766 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache_compressed: (nil) 2024-03-30T12:24:34.766 INFO:journalctl@ceph.mon.a.smithi084.stdout: persistent_cache: (nil) 2024-03-30T12:24:34.766 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_size: 4096 2024-03-30T12:24:34.766 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_size_deviation: 10 2024-03-30T12:24:34.767 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_restart_interval: 16 2024-03-30T12:24:34.767 INFO:journalctl@ceph.mon.a.smithi084.stdout: index_block_restart_interval: 1 2024-03-30T12:24:34.767 INFO:journalctl@ceph.mon.a.smithi084.stdout: metadata_block_size: 4096 2024-03-30T12:24:34.767 INFO:journalctl@ceph.mon.a.smithi084.stdout: partition_filters: 0 2024-03-30T12:24:34.767 INFO:journalctl@ceph.mon.a.smithi084.stdout: use_delta_encoding: 1 2024-03-30T12:24:34.767 INFO:journalctl@ceph.mon.a.smithi084.stdout: filter_policy: bloomfilter 2024-03-30T12:24:34.767 INFO:journalctl@ceph.mon.a.smithi084.stdout: whole_key_filtering: 1 2024-03-30T12:24:34.767 INFO:journalctl@ceph.mon.a.smithi084.stdout: verify_compression: 0 2024-03-30T12:24:34.767 INFO:journalctl@ceph.mon.a.smithi084.stdout: read_amp_bytes_per_bit: 0 2024-03-30T12:24:34.767 INFO:journalctl@ceph.mon.a.smithi084.stdout: format_version: 5 2024-03-30T12:24:34.767 INFO:journalctl@ceph.mon.a.smithi084.stdout: enable_index_compression: 1 2024-03-30T12:24:34.767 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_align: 0 2024-03-30T12:24:34.767 INFO:journalctl@ceph.mon.a.smithi084.stdout: max_auto_readahead_size: 262144 2024-03-30T12:24:34.767 INFO:journalctl@ceph.mon.a.smithi084.stdout: prepopulate_block_cache: 0 2024-03-30T12:24:34.767 INFO:journalctl@ceph.mon.a.smithi084.stdout: initial_auto_readahead_size: 8192 2024-03-30T12:24:34.768 INFO:journalctl@ceph.mon.a.smithi084.stdout: num_file_reads_for_auto_readahead: 2 2024-03-30T12:24:34.768 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.write_buffer_size: 33554432 2024-03-30T12:24:34.768 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_write_buffer_number: 2 2024-03-30T12:24:34.768 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.compression: NoCompression 2024-03-30T12:24:34.768 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.bottommost_compression: Disabled 2024-03-30T12:24:34.768 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.prefix_extractor: nullptr 2024-03-30T12:24:34.768 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-30T12:24:34.768 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.num_levels: 7 2024-03-30T12:24:34.768 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-30T12:24:34.768 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-30T12:24:34.768 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-30T12:24:34.768 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-30T12:24:34.768 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-30T12:24:34.768 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-30T12:24:34.768 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-30T12:24:34.769 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-30T12:24:34.769 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-30T12:24:34.769 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-30T12:24:34.769 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-30T12:24:34.769 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-30T12:24:34.769 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-30T12:24:34.769 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.compression_opts.level: 32767 2024-03-30T12:24:34.769 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.compression_opts.strategy: 0 2024-03-30T12:24:34.769 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-30T12:24:34.769 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-30T12:24:34.769 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-30T12:24:34.769 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-30T12:24:34.769 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.compression_opts.enabled: false 2024-03-30T12:24:34.769 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-30T12:24:34.769 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-30T12:24:34.769 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-30T12:24:34.770 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-30T12:24:34.770 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.target_file_size_base: 67108864 2024-03-30T12:24:34.770 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-30T12:24:34.770 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-30T12:24:34.770 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-30T12:24:34.770 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-30T12:24:34.770 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-30T12:24:34.770 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-30T12:24:34.770 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-30T12:24:34.770 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-30T12:24:34.770 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-30T12:24:34.770 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-30T12:24:34.770 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-30T12:24:34.770 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-30T12:24:34.771 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-30T12:24:34.771 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-30T12:24:34.771 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.arena_block_size: 1048576 2024-03-30T12:24:34.771 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-30T12:24:34.771 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-30T12:24:34.771 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.disable_auto_compactions: 0 2024-03-30T12:24:34.771 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-30T12:24:34.771 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-30T12:24:34.771 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-30T12:24:34.771 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-30T12:24:34.771 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-30T12:24:34.771 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-30T12:24:34.771 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-30T12:24:34.771 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-30T12:24:34.771 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-30T12:24:34.772 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-30T12:24:34.772 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.table_properties_collectors: 2024-03-30T12:24:34.772 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.inplace_update_support: 0 2024-03-30T12:24:34.772 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-30T12:24:34.772 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-30T12:24:34.772 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-30T12:24:34.772 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-30T12:24:34.772 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.bloom_locality: 0 2024-03-30T12:24:34.772 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.max_successive_merges: 0 2024-03-30T12:24:34.772 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-30T12:24:34.772 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.paranoid_file_checks: 0 2024-03-30T12:24:34.772 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.force_consistency_checks: 1 2024-03-30T12:24:34.772 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.report_bg_io_stats: 0 2024-03-30T12:24:34.772 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.ttl: 2592000 2024-03-30T12:24:34.772 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-30T12:24:34.772 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-30T12:24:34.773 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-30T12:24:34.773 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.enable_blob_files: false 2024-03-30T12:24:34.773 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.min_blob_size: 0 2024-03-30T12:24:34.773 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.blob_file_size: 268435456 2024-03-30T12:24:34.773 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-30T12:24:34.773 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-30T12:24:34.773 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-30T12:24:34.773 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-30T12:24:34.773 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-30T12:24:34.773 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.blob_file_starting_level: 0 2024-03-30T12:24:34.773 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-30T12:24:34.773 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-30T12:24:34.773 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12944, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-03-30T12:24:34.773 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-03-30T12:24:34.773 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: fe707cb2-6db3-42ad-9851-ba2c5cd8c227 2024-03-30T12:24:34.774 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711801474608464, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-03-30T12:24:34.774 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-03-30T12:24:34.774 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711801474619488, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 3933528, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12945, "largest_seqno": 14951, "table_properties": {"data_size": 3923386, "index_size": 6882, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2245, "raw_key_size": 21522, "raw_average_key_size": 24, "raw_value_size": 3903686, "raw_average_value_size": 4430, "num_data_blocks": 302, "num_entries": 881, "num_filter_entries": 881, "num_deletions": 33, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711801474, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "fe707cb2-6db3-42ad-9851-ba2c5cd8c227", "db_session_id": "JXI0XZ8FNL702RPR0MY5", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-03-30T12:24:34.774 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711801474619594, "job": 1, "event": "recovery_finished"} 2024-03-30T12:24:34.774 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-03-30T12:24:34.774 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-30T12:24:34.774 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-30T12:24:34.774 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563e44dee000 2024-03-30T12:24:34.774 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: DB pointer 0x563e44dd8000 2024-03-30T12:24:34.774 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-30T12:24:34.774 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-30T12:24:34.774 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** DB Stats ** 2024-03-30T12:24:34.774 INFO:journalctl@ceph.mon.a.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T12:24:34.774 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-30T12:24:34.775 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T12:24:34.775 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T12:24:34.775 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-30T12:24:34.775 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T12:24:34.775 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T12:24:34.775 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-03-30T12:24:34.775 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** Compaction Stats [default] ** 2024-03-30T12:24:34.775 INFO:journalctl@ceph.mon.a.smithi084.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T12:24:34.775 INFO:journalctl@ceph.mon.a.smithi084.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-30T12:24:34.775 INFO:journalctl@ceph.mon.a.smithi084.stdout: L0 1/0 3.75 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 723.8 0.01 0.00 1 0.005 0 0 0.0 0.0 2024-03-30T12:24:34.775 INFO:journalctl@ceph.mon.a.smithi084.stdout: L6 1/0 6.82 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-03-30T12:24:34.775 INFO:journalctl@ceph.mon.a.smithi084.stdout: Sum 2/0 10.57 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 723.8 0.01 0.00 1 0.005 0 0 0.0 0.0 2024-03-30T12:24:34.775 INFO:journalctl@ceph.mon.a.smithi084.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 723.8 0.01 0.00 1 0.005 0 0 0.0 0.0 2024-03-30T12:24:34.775 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-03-30T12:24:34.775 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** Compaction Stats [default] ** 2024-03-30T12:24:34.775 INFO:journalctl@ceph.mon.a.smithi084.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T12:24:34.776 INFO:journalctl@ceph.mon.a.smithi084.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-30T12:24:34.776 INFO:journalctl@ceph.mon.a.smithi084.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 723.8 0.01 0.00 1 0.005 0 0 0.0 0.0 2024-03-30T12:24:34.776 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-03-30T12:24:34.776 INFO:journalctl@ceph.mon.a.smithi084.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-30T12:24:34.776 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-03-30T12:24:34.776 INFO:journalctl@ceph.mon.a.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T12:24:34.776 INFO:journalctl@ceph.mon.a.smithi084.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-03-30T12:24:34.776 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-30T12:24:34.776 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-30T12:24:34.776 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-30T12:24:34.776 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-30T12:24:34.776 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative compaction: 0.00 GB write, 232.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T12:24:34.776 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval compaction: 0.00 GB write, 232.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T12:24:34.776 INFO:journalctl@ceph.mon.a.smithi084.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-30T12:24:34.776 INFO:journalctl@ceph.mon.a.smithi084.stdout: Block cache BinnedLRUCache@0x563e44cfb090#2 capacity: 512.00 MB usage: 10.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-03-30T12:24:34.777 INFO:journalctl@ceph.mon.a.smithi084.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.28 KB,0.000435114%) IndexBlock(1,8.08 KB,0.00154078%) Misc(1,0.00 KB,0%) 2024-03-30T12:24:34.777 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-03-30T12:24:34.777 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-30T12:24:34.777 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: starting mon.a rank 0 at public addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] at bind addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:24:34.777 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: mon.a@-1(???) e3 preinit fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:24:34.777 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: mon.a@-1(???).mds e6 new map 2024-03-30T12:24:34.777 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: mon.a@-1(???).mds e6 print_map 2024-03-30T12:24:34.777 INFO:journalctl@ceph.mon.a.smithi084.stdout: e6 2024-03-30T12:24:34.777 INFO:journalctl@ceph.mon.a.smithi084.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-30T12:24:34.777 INFO:journalctl@ceph.mon.a.smithi084.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-30T12:24:34.777 INFO:journalctl@ceph.mon.a.smithi084.stdout: legacy client fscid: 1 2024-03-30T12:24:34.777 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-03-30T12:24:34.777 INFO:journalctl@ceph.mon.a.smithi084.stdout: Filesystem 'cephfs' (1) 2024-03-30T12:24:34.777 INFO:journalctl@ceph.mon.a.smithi084.stdout: fs_name cephfs 2024-03-30T12:24:34.777 INFO:journalctl@ceph.mon.a.smithi084.stdout: epoch 6 2024-03-30T12:24:34.777 INFO:journalctl@ceph.mon.a.smithi084.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-30T12:24:34.778 INFO:journalctl@ceph.mon.a.smithi084.stdout: created 2024-03-30T12:19:00.832494+0000 2024-03-30T12:24:34.778 INFO:journalctl@ceph.mon.a.smithi084.stdout: modified 2024-03-30T12:19:02.842890+0000 2024-03-30T12:24:34.778 INFO:journalctl@ceph.mon.a.smithi084.stdout: tableserver 0 2024-03-30T12:24:34.778 INFO:journalctl@ceph.mon.a.smithi084.stdout: root 0 2024-03-30T12:24:34.778 INFO:journalctl@ceph.mon.a.smithi084.stdout: session_timeout 60 2024-03-30T12:24:34.778 INFO:journalctl@ceph.mon.a.smithi084.stdout: session_autoclose 300 2024-03-30T12:24:34.778 INFO:journalctl@ceph.mon.a.smithi084.stdout: max_file_size 1099511627776 2024-03-30T12:24:34.778 INFO:journalctl@ceph.mon.a.smithi084.stdout: max_xattr_size 65536 2024-03-30T12:24:34.778 INFO:journalctl@ceph.mon.a.smithi084.stdout: required_client_features {} 2024-03-30T12:24:34.778 INFO:journalctl@ceph.mon.a.smithi084.stdout: last_failure 0 2024-03-30T12:24:34.778 INFO:journalctl@ceph.mon.a.smithi084.stdout: last_failure_osd_epoch 0 2024-03-30T12:24:34.778 INFO:journalctl@ceph.mon.a.smithi084.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-30T12:24:34.778 INFO:journalctl@ceph.mon.a.smithi084.stdout: max_mds 1 2024-03-30T12:24:34.778 INFO:journalctl@ceph.mon.a.smithi084.stdout: in 0 2024-03-30T12:24:34.778 INFO:journalctl@ceph.mon.a.smithi084.stdout: up {0=24331} 2024-03-30T12:24:34.779 INFO:journalctl@ceph.mon.a.smithi084.stdout: failed 2024-03-30T12:24:34.779 INFO:journalctl@ceph.mon.a.smithi084.stdout: damaged 2024-03-30T12:24:34.779 INFO:journalctl@ceph.mon.a.smithi084.stdout: stopped 2024-03-30T12:24:34.779 INFO:journalctl@ceph.mon.a.smithi084.stdout: data_pools [3] 2024-03-30T12:24:34.779 INFO:journalctl@ceph.mon.a.smithi084.stdout: metadata_pool 2 2024-03-30T12:24:34.779 INFO:journalctl@ceph.mon.a.smithi084.stdout: inline_data disabled 2024-03-30T12:24:34.779 INFO:journalctl@ceph.mon.a.smithi084.stdout: balancer 2024-03-30T12:24:34.779 INFO:journalctl@ceph.mon.a.smithi084.stdout: bal_rank_mask -1 2024-03-30T12:24:34.779 INFO:journalctl@ceph.mon.a.smithi084.stdout: standby_count_wanted 0 2024-03-30T12:24:34.779 INFO:journalctl@ceph.mon.a.smithi084.stdout: [mds.b{0:24331} state up:active seq 3 addr [v2:172.21.15.162:6832/1272121665,v1:172.21.15.162:6833/1272121665] compat {c=[1],r=[1],i=[7ff]}] 2024-03-30T12:24:34.779 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-03-30T12:24:34.779 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-03-30T12:24:34.779 INFO:journalctl@ceph.mon.a.smithi084.stdout: Standby daemons: 2024-03-30T12:24:34.779 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-03-30T12:24:34.779 INFO:journalctl@ceph.mon.a.smithi084.stdout: [mds.a{-1:14448} state up:standby seq 1 addr [v2:172.21.15.84:6834/420740305,v1:172.21.15.84:6835/420740305] compat {c=[1],r=[1],i=[7ff]}] 2024-03-30T12:24:34.780 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: mon.a@-1(???).osd e210 crush map has features 3314933069573799936, adjusting msgr requires 2024-03-30T12:24:34.780 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: mon.a@-1(???).osd e210 crush map has features 432629308056666112, adjusting msgr requires 2024-03-30T12:24:34.780 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: mon.a@-1(???).osd e210 crush map has features 432629308056666112, adjusting msgr requires 2024-03-30T12:24:34.780 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: mon.a@-1(???).osd e210 crush map has features 432629308056666112, adjusting msgr requires 2024-03-30T12:24:34.780 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 ceph-mon[89279]: mon.a@-1(???).paxosservice(auth 1..18) refresh upgraded, format 0 -> 3 2024-03-30T12:24:34.780 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 bash[89260]: a0811f2ae47df6b863f8534b406e5853d9c81b6e3cdf859cb5bffd684a8776ff 2024-03-30T12:24:34.780 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:34 smithi084 systemd[1]: Started Ceph mon.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:24:37.713 INFO:tasks.rados.rados.0.smithi084.stdout:751: done (0 left) 2024-03-30T12:24:37.714 INFO:tasks.rados.rados.0.smithi084.stdout:752: rmattr oid 46 current snap is 76 2024-03-30T12:24:37.714 INFO:tasks.rados.rados.0.smithi084.stdout:752: done (0 left) 2024-03-30T12:24:37.714 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 76 2024-03-30T12:24:37.714 INFO:tasks.rados.rados.0.smithi084.stdout:753: seq_num 248 ranges {1318912=557056,1875968=507904,2383872=442368,2826240=253952} 2024-03-30T12:24:37.723 INFO:tasks.rados.rados.0.smithi084.stdout:753: writing smithi08477944-21 from 1318912 to 1875968 tid 1 2024-03-30T12:24:37.727 INFO:tasks.rados.rados.0.smithi084.stdout:753: writing smithi08477944-21 from 1875968 to 2383872 tid 2 2024-03-30T12:24:37.730 INFO:tasks.rados.rados.0.smithi084.stdout:753: writing smithi08477944-21 from 2383872 to 2826240 tid 3 2024-03-30T12:24:37.732 INFO:tasks.rados.rados.0.smithi084.stdout:753: writing smithi08477944-21 from 2826240 to 3080192 tid 4 2024-03-30T12:24:37.732 INFO:tasks.rados.rados.0.smithi084.stdout:754: delete oid 39 current snap is 76 2024-03-30T12:24:37.732 INFO:tasks.rados.rados.0.smithi084.stdout:753: finishing write tid 1 to smithi08477944-21 2024-03-30T12:24:37.732 INFO:tasks.rados.rados.0.smithi084.stdout:753: finishing write tid 2 to smithi08477944-21 2024-03-30T12:24:37.735 INFO:tasks.rados.rados.0.smithi084.stdout:753: finishing write tid 3 to smithi08477944-21 2024-03-30T12:24:37.735 INFO:tasks.rados.rados.0.smithi084.stdout:754: done (1 left) 2024-03-30T12:24:37.735 INFO:tasks.rados.rados.0.smithi084.stdout:755: read oid 49 snap -1 2024-03-30T12:24:37.735 INFO:tasks.rados.rados.0.smithi084.stdout:755: expect (ObjNum 181 snap 50 seq_num 181) 2024-03-30T12:24:37.735 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 28 current snap is 76 2024-03-30T12:24:37.735 INFO:tasks.rados.rados.0.smithi084.stdout:756: seq_num 250 ranges {1859584=589824,2449408=679936,3129344=409600,3538944=114688} 2024-03-30T12:24:37.749 INFO:tasks.rados.rados.0.smithi084.stdout:756: writing smithi08477944-28 from 1859584 to 2449408 tid 1 2024-03-30T12:24:37.754 INFO:tasks.rados.rados.0.smithi084.stdout:756: writing smithi08477944-28 from 2449408 to 3129344 tid 2 2024-03-30T12:24:37.757 INFO:tasks.rados.rados.0.smithi084.stdout:756: writing smithi08477944-28 from 3129344 to 3538944 tid 3 2024-03-30T12:24:37.759 INFO:tasks.rados.rados.0.smithi084.stdout:756: writing smithi08477944-28 from 3538944 to 3653632 tid 4 2024-03-30T12:24:37.759 INFO:tasks.rados.rados.0.smithi084.stdout:757: read oid 39 snap -1 2024-03-30T12:24:37.759 INFO:tasks.rados.rados.0.smithi084.stdout:757: expect deleted 2024-03-30T12:24:37.759 INFO:tasks.rados.rados.0.smithi084.stdout:758: rmattr oid 12 current snap is 76 2024-03-30T12:24:37.759 INFO:tasks.rados.rados.0.smithi084.stdout:758: done (4 left) 2024-03-30T12:24:37.759 INFO:tasks.rados.rados.0.smithi084.stdout:759: delete oid 3 current snap is 76 2024-03-30T12:24:37.759 INFO:tasks.rados.rados.0.smithi084.stdout:753: finishing write tid 4 to smithi08477944-21 2024-03-30T12:24:37.759 INFO:tasks.rados.rados.0.smithi084.stdout:753: finishing write tid 5 to smithi08477944-21 2024-03-30T12:24:37.759 INFO:tasks.rados.rados.0.smithi084.stdout:753: finishing write tid 6 to smithi08477944-21 2024-03-30T12:24:37.760 INFO:tasks.rados.rados.0.smithi084.stdout:753: oid 21 updating version 0 to 102 2024-03-30T12:24:37.760 INFO:tasks.rados.rados.0.smithi084.stdout:753: oid 21 version 102 is already newer than 101 2024-03-30T12:24:37.760 INFO:tasks.rados.rados.0.smithi084.stdout:753: oid 21 version 102 is already newer than 100 2024-03-30T12:24:37.760 INFO:tasks.rados.rados.0.smithi084.stdout:753: oid 21 updating version 102 to 104 2024-03-30T12:24:37.760 INFO:tasks.rados.rados.0.smithi084.stdout:753: oid 21 version 104 is already newer than 103 2024-03-30T12:24:37.760 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 104 (ObjNum 248 snap 76 seq_num 248) dirty exists 2024-03-30T12:24:37.760 INFO:tasks.rados.rados.0.smithi084.stdout:753: left oid 21 (ObjNum 248 snap 76 seq_num 248) 2024-03-30T12:24:37.760 INFO:tasks.rados.rados.0.smithi084.stdout:755: expect (ObjNum 181 snap 50 seq_num 181) 2024-03-30T12:24:37.881 INFO:tasks.rados.rados.0.smithi084.stdout:756: finishing write tid 1 to smithi08477944-28 2024-03-30T12:24:37.881 INFO:tasks.rados.rados.0.smithi084.stdout:756: finishing write tid 2 to smithi08477944-28 2024-03-30T12:24:37.881 INFO:tasks.rados.rados.0.smithi084.stdout:756: finishing write tid 3 to smithi08477944-28 2024-03-30T12:24:37.881 INFO:tasks.rados.rados.0.smithi084.stdout:756: finishing write tid 4 to smithi08477944-28 2024-03-30T12:24:37.881 INFO:tasks.rados.rados.0.smithi084.stdout:756: finishing write tid 5 to smithi08477944-28 2024-03-30T12:24:37.881 INFO:tasks.rados.rados.0.smithi084.stdout:756: finishing write tid 6 to smithi08477944-28 2024-03-30T12:24:37.882 INFO:tasks.rados.rados.0.smithi084.stdout:756: oid 28 updating version 0 to 259 2024-03-30T12:24:37.882 INFO:tasks.rados.rados.0.smithi084.stdout:756: oid 28 updating version 259 to 263 2024-03-30T12:24:37.882 INFO:tasks.rados.rados.0.smithi084.stdout:756: oid 28 updating version 263 to 264 2024-03-30T12:24:37.882 INFO:tasks.rados.rados.0.smithi084.stdout:756: oid 28 version 264 is already newer than 260 2024-03-30T12:24:37.882 INFO:tasks.rados.rados.0.smithi084.stdout:756: oid 28 updating version 264 to 265 2024-03-30T12:24:37.882 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 265 (ObjNum 250 snap 76 seq_num 250) dirty exists 2024-03-30T12:24:37.882 INFO:tasks.rados.rados.0.smithi084.stdout:756: left oid 28 (ObjNum 250 snap 76 seq_num 250) 2024-03-30T12:24:37.882 INFO:tasks.rados.rados.0.smithi084.stdout:753: done (4 left) 2024-03-30T12:24:37.882 INFO:tasks.rados.rados.0.smithi084.stdout:755: done (3 left) 2024-03-30T12:24:37.882 INFO:tasks.rados.rados.0.smithi084.stdout:756: done (2 left) 2024-03-30T12:24:37.882 INFO:tasks.rados.rados.0.smithi084.stdout:757: done (1 left) 2024-03-30T12:24:37.882 INFO:tasks.rados.rados.0.smithi084.stdout:759: done (0 left) 2024-03-30T12:24:37.882 INFO:tasks.rados.rados.0.smithi084.stdout:760: copy_from oid 50 from oid 30 current snap is 76 2024-03-30T12:24:37.882 INFO:tasks.rados.rados.0.smithi084.stdout:761: snap_remove snap 74 2024-03-30T12:24:37.960 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ignoring --setuser ceph since I am not root 2024-03-30T12:24:37.960 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ignoring --setgroup ceph since I am not root 2024-03-30T12:24:37.960 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:37.960 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:37.960 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:37.960 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:37.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[37565]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:24:37.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[37565]: pgmap v55: 121 pgs: 121 active+clean; 118 MiB data, 856 MiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 3.3 MiB/s wr, 21 op/s 2024-03-30T12:24:37.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[37565]: pgmap v56: 121 pgs: 121 active+clean; 120 MiB data, 861 MiB used, 714 GiB / 715 GiB avail; 928 KiB/s rd, 2.1 MiB/s wr, 7 op/s 2024-03-30T12:24:37.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[37565]: mon.a calling monitor election 2024-03-30T12:24:37.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[37565]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-30T12:24:37.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[37565]: monmap e3: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-30T12:24:37.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[37565]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-30T12:24:37.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[37565]: osdmap e210: 8 total, 8 up, 8 in 2024-03-30T12:24:37.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[37565]: mgrmap e35: y(active, since 38s), standbys: x 2024-03-30T12:24:37.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[37565]: overall HEALTH_OK 2024-03-30T12:24:37.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[37565]: from='mgr.15204 ' entity='' 2024-03-30T12:24:37.961 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[37565]: mgrmap e36: y(active, since 38s), standbys: x 2024-03-30T12:24:37.962 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[89279]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:37.962 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[89279]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:37.962 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[89279]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:37.962 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[89279]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:37.962 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[89279]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:24:37.962 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[89279]: pgmap v55: 121 pgs: 121 active+clean; 118 MiB data, 856 MiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 3.3 MiB/s wr, 21 op/s 2024-03-30T12:24:37.962 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[89279]: pgmap v56: 121 pgs: 121 active+clean; 120 MiB data, 861 MiB used, 714 GiB / 715 GiB avail; 928 KiB/s rd, 2.1 MiB/s wr, 7 op/s 2024-03-30T12:24:37.962 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[89279]: mon.a calling monitor election 2024-03-30T12:24:37.962 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[89279]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-30T12:24:37.962 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[89279]: monmap e3: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-30T12:24:37.962 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[89279]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-30T12:24:37.962 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[89279]: osdmap e210: 8 total, 8 up, 8 in 2024-03-30T12:24:37.962 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[89279]: mgrmap e35: y(active, since 38s), standbys: x 2024-03-30T12:24:37.962 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[89279]: overall HEALTH_OK 2024-03-30T12:24:37.963 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[89279]: from='mgr.15204 ' entity='' 2024-03-30T12:24:37.963 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:37 smithi084 ceph-mon[89279]: mgrmap e36: y(active, since 38s), standbys: x 2024-03-30T12:24:38.120 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: ignoring --setuser ceph since I am not root 2024-03-30T12:24:38.120 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: ignoring --setgroup ceph since I am not root 2024-03-30T12:24:38.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:37 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:38.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:37 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:38.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:37 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:38.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:37 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:38.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:37 smithi162 ceph-mon[30421]: from='mgr.15204 172.21.15.84:0/883880936' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:24:38.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:37 smithi162 ceph-mon[30421]: pgmap v55: 121 pgs: 121 active+clean; 118 MiB data, 856 MiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 3.3 MiB/s wr, 21 op/s 2024-03-30T12:24:38.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:37 smithi162 ceph-mon[30421]: pgmap v56: 121 pgs: 121 active+clean; 120 MiB data, 861 MiB used, 714 GiB / 715 GiB avail; 928 KiB/s rd, 2.1 MiB/s wr, 7 op/s 2024-03-30T12:24:38.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:37 smithi162 ceph-mon[30421]: mon.a calling monitor election 2024-03-30T12:24:38.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:37 smithi162 ceph-mon[30421]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-30T12:24:38.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:37 smithi162 ceph-mon[30421]: monmap e3: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-30T12:24:38.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:37 smithi162 ceph-mon[30421]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-30T12:24:38.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:37 smithi162 ceph-mon[30421]: osdmap e210: 8 total, 8 up, 8 in 2024-03-30T12:24:38.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:37 smithi162 ceph-mon[30421]: mgrmap e35: y(active, since 38s), standbys: x 2024-03-30T12:24:38.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:37 smithi162 ceph-mon[30421]: overall HEALTH_OK 2024-03-30T12:24:38.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:37 smithi162 ceph-mon[30421]: from='mgr.15204 ' entity='' 2024-03-30T12:24:38.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:37 smithi162 ceph-mon[30421]: mgrmap e36: y(active, since 38s), standbys: x 2024-03-30T12:24:38.619 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:38.241+0000 7fae7d5be200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T12:24:38.620 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:38.334+0000 7fae7d5be200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T12:24:38.703 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:38.290+0000 7f1fa0138200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T12:24:38.703 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:38.384+0000 7f1fa0138200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T12:24:38.704 INFO:tasks.rados.rados.0.smithi084.stdout:761: done (1 left) 2024-03-30T12:24:38.704 INFO:tasks.rados.rados.0.smithi084.stdout:762: snap_create 2024-03-30T12:24:38.704 INFO:tasks.rados.rados.0.smithi084.stdout:760: finishing copy_from racing read to smithi08477944-50 2024-03-30T12:24:38.704 INFO:tasks.rados.rados.0.smithi084.stdout:760: finishing copy_from to smithi08477944-50 2024-03-30T12:24:38.704 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 164 (ObjNum 235 snap 73 seq_num 235) dirty exists 2024-03-30T12:24:38.962 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:38 smithi162 ceph-mon[30421]: osdmap e211: 8 total, 8 up, 8 in 2024-03-30T12:24:39.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:38 smithi084 ceph-mon[89279]: osdmap e211: 8 total, 8 up, 8 in 2024-03-30T12:24:39.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:38 smithi084 ceph-mon[37565]: osdmap e211: 8 total, 8 up, 8 in 2024-03-30T12:24:39.290 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:38.971+0000 7fae7d5be200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T12:24:39.290 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:39.063+0000 7fae7d5be200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T12:24:39.290 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:39.204+0000 7fae7d5be200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T12:24:39.290 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:39.298+0000 7fae7d5be200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T12:24:39.343 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:39.023+0000 7f1fa0138200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T12:24:39.343 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:39.116+0000 7f1fa0138200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T12:24:39.343 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:39.256+0000 7f1fa0138200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T12:24:39.343 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:39.352+0000 7f1fa0138200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T12:24:39.621 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:39.383+0000 7fae7d5be200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T12:24:39.625 INFO:tasks.rados.rados.0.smithi084.stdout:760: done (1 left) 2024-03-30T12:24:39.625 INFO:tasks.rados.rados.0.smithi084.stdout:762: done (0 left) 2024-03-30T12:24:39.625 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 77 2024-03-30T12:24:39.625 INFO:tasks.rados.rados.0.smithi084.stdout:763: seq_num 252 ranges {3080192=630784,3710976=499712,4210688=425984,4636672=278528} 2024-03-30T12:24:39.646 INFO:tasks.rados.rados.0.smithi084.stdout:763: writing smithi08477944-21 from 3080192 to 3710976 tid 1 2024-03-30T12:24:39.649 INFO:tasks.rados.rados.0.smithi084.stdout:763: writing smithi08477944-21 from 3710976 to 4210688 tid 2 2024-03-30T12:24:39.652 INFO:tasks.rados.rados.0.smithi084.stdout:763: writing smithi08477944-21 from 4210688 to 4636672 tid 3 2024-03-30T12:24:39.654 INFO:tasks.rados.rados.0.smithi084.stdout:763: writing smithi08477944-21 from 4636672 to 4915200 tid 4 2024-03-30T12:24:39.654 INFO:tasks.rados.rados.0.smithi084.stdout:764: rollback oid 42 current snap is 77 2024-03-30T12:24:39.654 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 42 to 58 2024-03-30T12:24:39.654 INFO:tasks.rados.rados.0.smithi084.stdout:763: finishing write tid 1 to smithi08477944-21 2024-03-30T12:24:39.654 INFO:tasks.rados.rados.0.smithi084.stdout:763: finishing write tid 2 to smithi08477944-21 2024-03-30T12:24:39.654 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 77 2024-03-30T12:24:39.654 INFO:tasks.rados.rados.0.smithi084.stdout:765: seq_num 253 ranges {5455872=647168,6103040=786432,6889472=417792} 2024-03-30T12:24:39.687 INFO:tasks.rados.rados.0.smithi084.stdout:765: writing smithi08477944-47 from 5455872 to 6103040 tid 1 2024-03-30T12:24:39.693 INFO:tasks.rados.rados.0.smithi084.stdout:765: writing smithi08477944-47 from 6103040 to 6889472 tid 2 2024-03-30T12:24:39.696 INFO:tasks.rados.rados.0.smithi084.stdout:765: writing smithi08477944-47 from 6889472 to 7307264 tid 3 2024-03-30T12:24:39.696 INFO:tasks.rados.rados.0.smithi084.stdout:766: copy_from oid 13 from oid 7 current snap is 77 2024-03-30T12:24:39.696 INFO:tasks.rados.rados.0.smithi084.stdout:763: finishing write tid 3 to smithi08477944-21 2024-03-30T12:24:39.696 INFO:tasks.rados.rados.0.smithi084.stdout:763: finishing write tid 4 to smithi08477944-21 2024-03-30T12:24:39.696 INFO:tasks.rados.rados.0.smithi084.stdout:763: finishing write tid 5 to smithi08477944-21 2024-03-30T12:24:39.696 INFO:tasks.rados.rados.0.smithi084.stdout:767: snap_create 2024-03-30T12:24:39.697 INFO:tasks.rados.rados.0.smithi084.stdout:764: finishing rollback tid 0 to smithi08477944-42 2024-03-30T12:24:39.697 INFO:tasks.rados.rados.0.smithi084.stdout:764: finishing rollback tid 1 to smithi08477944-42 2024-03-30T12:24:39.697 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 387 (ObjNum 129 snap 0 seq_num 1429063360) dirty dne 2024-03-30T12:24:39.697 INFO:tasks.rados.rados.0.smithi084.stdout:763: finishing write tid 6 to smithi08477944-21 2024-03-30T12:24:39.697 INFO:tasks.rados.rados.0.smithi084.stdout:763: oid 21 updating version 0 to 109 2024-03-30T12:24:39.697 INFO:tasks.rados.rados.0.smithi084.stdout:763: oid 21 version 109 is already newer than 108 2024-03-30T12:24:39.697 INFO:tasks.rados.rados.0.smithi084.stdout:763: oid 21 updating version 109 to 110 2024-03-30T12:24:39.697 INFO:tasks.rados.rados.0.smithi084.stdout:763: oid 21 updating version 110 to 111 2024-03-30T12:24:39.697 INFO:tasks.rados.rados.0.smithi084.stdout:763: oid 21 updating version 111 to 112 2024-03-30T12:24:39.697 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 112 (ObjNum 252 snap 77 seq_num 252) dirty exists 2024-03-30T12:24:39.697 INFO:tasks.rados.rados.0.smithi084.stdout:763: left oid 21 (ObjNum 252 snap 77 seq_num 252) 2024-03-30T12:24:39.697 INFO:tasks.rados.rados.0.smithi084.stdout:765: finishing write tid 1 to smithi08477944-47 2024-03-30T12:24:39.697 INFO:tasks.rados.rados.0.smithi084.stdout:765: finishing write tid 2 to smithi08477944-47 2024-03-30T12:24:39.699 INFO:tasks.rados.rados.0.smithi084.stdout:765: finishing write tid 3 to smithi08477944-47 2024-03-30T12:24:39.699 INFO:tasks.rados.rados.0.smithi084.stdout:766: finishing copy_from to smithi08477944-13 2024-03-30T12:24:39.699 INFO:tasks.rados.rados.0.smithi084.stdout:766: got expected ENOENT (src dne) 2024-03-30T12:24:39.700 INFO:tasks.rados.rados.0.smithi084.stdout:765: finishing write tid 4 to smithi08477944-47 2024-03-30T12:24:39.700 INFO:tasks.rados.rados.0.smithi084.stdout:766: finishing copy_from racing read to smithi08477944-13 2024-03-30T12:24:39.700 INFO:tasks.rados.rados.0.smithi084.stdout:765: finishing write tid 5 to smithi08477944-47 2024-03-30T12:24:39.700 INFO:tasks.rados.rados.0.smithi084.stdout:765: oid 47 updating version 0 to 454 2024-03-30T12:24:39.700 INFO:tasks.rados.rados.0.smithi084.stdout:765: oid 47 updating version 454 to 455 2024-03-30T12:24:39.700 INFO:tasks.rados.rados.0.smithi084.stdout:765: oid 47 updating version 455 to 456 2024-03-30T12:24:39.701 INFO:tasks.rados.rados.0.smithi084.stdout:765: oid 47 version 456 is already newer than 453 2024-03-30T12:24:39.701 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 456 (ObjNum 253 snap 77 seq_num 253) dirty exists 2024-03-30T12:24:39.701 INFO:tasks.rados.rados.0.smithi084.stdout:765: left oid 47 (ObjNum 253 snap 77 seq_num 253) 2024-03-30T12:24:39.704 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:39.434+0000 7f1fa0138200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T12:24:39.931 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:39 smithi162 ceph-mon[30421]: osdmap e212: 8 total, 8 up, 8 in 2024-03-30T12:24:39.931 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:39 smithi162 ceph-mon[30421]: osdmap e213: 8 total, 8 up, 8 in 2024-03-30T12:24:39.931 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:39.646+0000 7fae7d5be200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T12:24:39.931 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:39.761+0000 7fae7d5be200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T12:24:39.931 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:39.845+0000 7fae7d5be200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T12:24:39.931 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:39.939+0000 7fae7d5be200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T12:24:40.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:39 smithi084 ceph-mon[37565]: osdmap e212: 8 total, 8 up, 8 in 2024-03-30T12:24:40.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:39 smithi084 ceph-mon[37565]: osdmap e213: 8 total, 8 up, 8 in 2024-03-30T12:24:40.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:39 smithi084 ceph-mon[89279]: osdmap e212: 8 total, 8 up, 8 in 2024-03-30T12:24:40.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:39 smithi084 ceph-mon[89279]: osdmap e213: 8 total, 8 up, 8 in 2024-03-30T12:24:40.004 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:39.725+0000 7f1fa0138200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T12:24:40.004 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:39.834+0000 7f1fa0138200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T12:24:40.004 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:39.919+0000 7f1fa0138200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T12:24:40.369 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:40.117+0000 7fae7d5be200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T12:24:40.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:40.014+0000 7f1fa0138200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T12:24:40.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:40.189+0000 7f1fa0138200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T12:24:40.626 INFO:tasks.rados.rados.0.smithi084.stdout:763: done (4 left) 2024-03-30T12:24:40.626 INFO:tasks.rados.rados.0.smithi084.stdout:764: done (3 left) 2024-03-30T12:24:40.626 INFO:tasks.rados.rados.0.smithi084.stdout:765: done (2 left) 2024-03-30T12:24:40.626 INFO:tasks.rados.rados.0.smithi084.stdout:766: done (1 left) 2024-03-30T12:24:40.626 INFO:tasks.rados.rados.0.smithi084.stdout:767: done (0 left) 2024-03-30T12:24:40.626 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 78 2024-03-30T12:24:40.626 INFO:tasks.rados.rados.0.smithi084.stdout:768: seq_num 254 ranges {0=663552,663552=663552,1327104=540672} 2024-03-30T12:24:40.630 INFO:tasks.rados.rados.0.smithi084.stdout:768: writing smithi08477944-15 from 0 to 663552 tid 1 2024-03-30T12:24:40.635 INFO:tasks.rados.rados.0.smithi084.stdout:768: writing smithi08477944-15 from 663552 to 1327104 tid 2 2024-03-30T12:24:40.639 INFO:tasks.rados.rados.0.smithi084.stdout:768: writing smithi08477944-15 from 1327104 to 1867776 tid 3 2024-03-30T12:24:40.639 INFO:tasks.rados.rados.0.smithi084.stdout:769: delete oid 31 current snap is 78 2024-03-30T12:24:40.639 INFO:tasks.rados.rados.0.smithi084.stdout:768: finishing write tid 1 to smithi08477944-15 2024-03-30T12:24:40.639 INFO:tasks.rados.rados.0.smithi084.stdout:768: finishing write tid 2 to smithi08477944-15 2024-03-30T12:24:40.641 INFO:tasks.rados.rados.0.smithi084.stdout:768: finishing write tid 3 to smithi08477944-15 2024-03-30T12:24:40.641 INFO:tasks.rados.rados.0.smithi084.stdout:768: finishing write tid 4 to smithi08477944-15 2024-03-30T12:24:40.643 INFO:tasks.rados.rados.0.smithi084.stdout:768: finishing write tid 5 to smithi08477944-15 2024-03-30T12:24:40.643 INFO:tasks.rados.rados.0.smithi084.stdout:768: oid 15 updating version 0 to 391 2024-03-30T12:24:40.643 INFO:tasks.rados.rados.0.smithi084.stdout:768: oid 15 version 391 is already newer than 390 2024-03-30T12:24:40.643 INFO:tasks.rados.rados.0.smithi084.stdout:768: oid 15 version 391 is already newer than 389 2024-03-30T12:24:40.643 INFO:tasks.rados.rados.0.smithi084.stdout:768: oid 15 version 391 is already newer than 388 2024-03-30T12:24:40.643 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 391 (ObjNum 254 snap 78 seq_num 254) dirty exists 2024-03-30T12:24:40.643 INFO:tasks.rados.rados.0.smithi084.stdout:768: left oid 15 (ObjNum 254 snap 78 seq_num 254) 2024-03-30T12:24:40.643 INFO:tasks.rados.rados.0.smithi084.stdout:768: done (1 left) 2024-03-30T12:24:40.643 INFO:tasks.rados.rados.0.smithi084.stdout:769: done (0 left) 2024-03-30T12:24:40.644 INFO:tasks.rados.rados.0.smithi084.stdout:770: snap_create 2024-03-30T12:24:41.369 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:41.085+0000 7fae7d5be200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T12:24:41.370 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:41.215+0000 7fae7d5be200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T12:24:41.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:41.150+0000 7f1fa0138200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T12:24:41.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:41.281+0000 7f1fa0138200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T12:24:41.634 INFO:tasks.rados.rados.0.smithi084.stdout:770: done (0 left) 2024-03-30T12:24:41.634 INFO:tasks.rados.rados.0.smithi084.stdout:771: copy_from oid 33 from oid 44 current snap is 79 2024-03-30T12:24:41.634 INFO:tasks.rados.rados.0.smithi084.stdout:772: delete oid 3 current snap is 79 2024-03-30T12:24:41.637 INFO:tasks.rados.rados.0.smithi084.stdout:772: done (1 left) 2024-03-30T12:24:41.637 INFO:tasks.rados.rados.0.smithi084.stdout:773: snap_remove snap 52 2024-03-30T12:24:41.828 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:41 smithi162 ceph-mon[30421]: osdmap e214: 8 total, 8 up, 8 in 2024-03-30T12:24:41.828 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:41.548+0000 7fae7d5be200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T12:24:41.829 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:41.640+0000 7fae7d5be200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T12:24:41.829 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:41.836+0000 7fae7d5be200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:24:41.904 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:41.615+0000 7f1fa0138200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T12:24:41.904 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:41.714+0000 7f1fa0138200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T12:24:41.904 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:41 smithi084 ceph-mon[37565]: osdmap e214: 8 total, 8 up, 8 in 2024-03-30T12:24:41.904 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:41 smithi084 ceph-mon[89279]: osdmap e214: 8 total, 8 up, 8 in 2024-03-30T12:24:42.119 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:42.024+0000 7fae7d5be200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T12:24:42.253 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:41.911+0000 7f1fa0138200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:24:42.253 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:42.099+0000 7f1fa0138200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T12:24:42.394 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:42.329+0000 7fae7d5be200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:24:42.628 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:42.386+0000 7f1fa0138200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T12:24:42.643 INFO:tasks.rados.rados.0.smithi084.stdout:773: done (1 left) 2024-03-30T12:24:42.643 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 79 2024-03-30T12:24:42.644 INFO:tasks.rados.rados.0.smithi084.stdout:774: seq_num 257 ranges {4915200=712704,5627904=720896,6348800=483328} 2024-03-30T12:24:42.675 INFO:tasks.rados.rados.0.smithi084.stdout:774: writing smithi08477944-21 from 4915200 to 5627904 tid 1 2024-03-30T12:24:42.679 INFO:tasks.rados.rados.0.smithi084.stdout:774: writing smithi08477944-21 from 5627904 to 6348800 tid 2 2024-03-30T12:24:42.682 INFO:tasks.rados.rados.0.smithi084.stdout:774: writing smithi08477944-21 from 6348800 to 6832128 tid 3 2024-03-30T12:24:42.682 INFO:tasks.rados.rados.0.smithi084.stdout:775: read oid 3 snap -1 2024-03-30T12:24:42.682 INFO:tasks.rados.rados.0.smithi084.stdout:775: expect deleted 2024-03-30T12:24:42.683 INFO:tasks.rados.rados.0.smithi084.stdout:776: read oid 23 snap -1 2024-03-30T12:24:42.683 INFO:tasks.rados.rados.0.smithi084.stdout:776: expect (ObjNum 221 snap 65 seq_num 221) 2024-03-30T12:24:42.683 INFO:tasks.rados.rados.0.smithi084.stdout:777: snap_create 2024-03-30T12:24:42.683 INFO:tasks.rados.rados.0.smithi084.stdout:771: finishing copy_from racing read to smithi08477944-33 2024-03-30T12:24:42.683 INFO:tasks.rados.rados.0.smithi084.stdout:771: finishing copy_from to smithi08477944-33 2024-03-30T12:24:42.683 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 166 (ObjNum 167 snap 45 seq_num 167) dirty exists 2024-03-30T12:24:42.683 INFO:tasks.rados.rados.0.smithi084.stdout:774: finishing write tid 1 to smithi08477944-21 2024-03-30T12:24:42.683 INFO:tasks.rados.rados.0.smithi084.stdout:774: finishing write tid 2 to smithi08477944-21 2024-03-30T12:24:42.685 INFO:tasks.rados.rados.0.smithi084.stdout:774: finishing write tid 3 to smithi08477944-21 2024-03-30T12:24:42.685 INFO:tasks.rados.rados.0.smithi084.stdout:774: finishing write tid 4 to smithi08477944-21 2024-03-30T12:24:42.686 INFO:tasks.rados.rados.0.smithi084.stdout:774: finishing write tid 5 to smithi08477944-21 2024-03-30T12:24:42.686 INFO:tasks.rados.rados.0.smithi084.stdout:774: oid 21 updating version 0 to 118 2024-03-30T12:24:42.686 INFO:tasks.rados.rados.0.smithi084.stdout:774: oid 21 version 118 is already newer than 117 2024-03-30T12:24:42.686 INFO:tasks.rados.rados.0.smithi084.stdout:774: oid 21 updating version 118 to 119 2024-03-30T12:24:42.686 INFO:tasks.rados.rados.0.smithi084.stdout:774: oid 21 version 119 is already newer than 116 2024-03-30T12:24:42.686 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 119 (ObjNum 257 snap 79 seq_num 257) dirty exists 2024-03-30T12:24:42.687 INFO:tasks.rados.rados.0.smithi084.stdout:774: left oid 21 (ObjNum 257 snap 79 seq_num 257) 2024-03-30T12:24:42.692 INFO:tasks.rados.rados.0.smithi084.stdout:776: expect (ObjNum 221 snap 65 seq_num 221) 2024-03-30T12:24:42.859 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:42.607+0000 7fae7d5be200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T12:24:42.860 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:42 smithi162 ceph-mon[30421]: osdmap e215: 8 total, 8 up, 8 in 2024-03-30T12:24:42.897 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:42 smithi084 ceph-mon[37565]: osdmap e215: 8 total, 8 up, 8 in 2024-03-30T12:24:42.897 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:42 smithi084 ceph-mon[89279]: osdmap e215: 8 total, 8 up, 8 in 2024-03-30T12:24:42.897 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:42.649+0000 7f1fa0138200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T12:24:43.119 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:42.867+0000 7fae7d5be200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T12:24:43.254 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:42.905+0000 7f1fa0138200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T12:24:43.643 INFO:tasks.rados.rados.0.smithi084.stdout:771: done (4 left) 2024-03-30T12:24:43.643 INFO:tasks.rados.rados.0.smithi084.stdout:774: done (3 left) 2024-03-30T12:24:43.643 INFO:tasks.rados.rados.0.smithi084.stdout:775: done (2 left) 2024-03-30T12:24:43.644 INFO:tasks.rados.rados.0.smithi084.stdout:776: done (1 left) 2024-03-30T12:24:43.644 INFO:tasks.rados.rados.0.smithi084.stdout:777: done (0 left) 2024-03-30T12:24:43.644 INFO:tasks.rados.rados.0.smithi084.stdout:778: snap_remove snap 78 2024-03-30T12:24:44.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:43 smithi084 ceph-mon[89279]: osdmap e216: 8 total, 8 up, 8 in 2024-03-30T12:24:44.004 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:43.709+0000 7f1fa0138200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T12:24:44.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:43 smithi084 ceph-mon[37565]: osdmap e216: 8 total, 8 up, 8 in 2024-03-30T12:24:44.004 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:24:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[73215]: ts=2024-03-30T12:24:43.521Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused" 2024-03-30T12:24:44.004 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:24:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[73215]: ts=2024-03-30T12:24:43.522Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:24:44.119 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:43.694+0000 7fae7d5be200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T12:24:44.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:43 smithi162 ceph-mon[30421]: osdmap e216: 8 total, 8 up, 8 in 2024-03-30T12:24:44.592 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:44.275+0000 7fae7d5be200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T12:24:44.593 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:44.378+0000 7fae7d5be200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T12:24:44.597 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:44.281+0000 7f1fa0138200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T12:24:44.597 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:44.380+0000 7f1fa0138200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T12:24:44.597 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:44.605+0000 7f1fa0138200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T12:24:44.608 INFO:tasks.rados.rados.0.smithi084.stdout:778: done (0 left) 2024-03-30T12:24:44.609 INFO:tasks.rados.rados.0.smithi084.stdout:779: read oid 47 snap -1 2024-03-30T12:24:44.609 INFO:tasks.rados.rados.0.smithi084.stdout:779: expect (ObjNum 253 snap 77 seq_num 253) 2024-03-30T12:24:44.609 INFO:tasks.rados.rados.0.smithi084.stdout:780: rollback oid 40 current snap is 80 2024-03-30T12:24:44.609 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 40 to 67 2024-03-30T12:24:44.609 INFO:tasks.rados.rados.0.smithi084.stdout:781: delete oid 37 current snap is 80 2024-03-30T12:24:44.613 INFO:tasks.rados.rados.0.smithi084.stdout:781: done (2 left) 2024-03-30T12:24:44.613 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 80 2024-03-30T12:24:44.614 INFO:tasks.rados.rados.0.smithi084.stdout:782: seq_num 259 ranges {0=745472,745472=540672,1286144=581632,1867776=81920} 2024-03-30T12:24:44.618 INFO:tasks.rados.rados.0.smithi084.stdout:782: writing smithi08477944-7 from 0 to 745472 tid 1 2024-03-30T12:24:44.621 INFO:tasks.rados.rados.0.smithi084.stdout:782: writing smithi08477944-7 from 745472 to 1286144 tid 2 2024-03-30T12:24:44.625 INFO:tasks.rados.rados.0.smithi084.stdout:782: writing smithi08477944-7 from 1286144 to 1867776 tid 3 2024-03-30T12:24:44.626 INFO:tasks.rados.rados.0.smithi084.stdout:782: writing smithi08477944-7 from 1867776 to 1949696 tid 4 2024-03-30T12:24:44.626 INFO:tasks.rados.rados.0.smithi084.stdout:783: read oid 20 snap -1 2024-03-30T12:24:44.626 INFO:tasks.rados.rados.0.smithi084.stdout:783: expect deleted 2024-03-30T12:24:44.626 INFO:tasks.rados.rados.0.smithi084.stdout:784: snap_remove snap 58 2024-03-30T12:24:44.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:44.601+0000 7fae7d5be200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T12:24:44.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: [30/Mar/2024:12:24:44] ENGINE Bus STARTING 2024-03-30T12:24:44.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: CherryPy Checker: 2024-03-30T12:24:44.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: The Application mounted at '' has an empty config. 2024-03-30T12:24:44.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: 2024-03-30T12:24:44.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: [30/Mar/2024:12:24:44] ENGINE Serving on http://:::9283 2024-03-30T12:24:44.870 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x[75047]: [30/Mar/2024:12:24:44] ENGINE Bus STARTED 2024-03-30T12:24:44.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: osdmap e217: 8 total, 8 up, 8 in 2024-03-30T12:24:44.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: Standby manager daemon x restarted 2024-03-30T12:24:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: Standby manager daemon x started 2024-03-30T12:24:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.162:0/3389953165' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T12:24:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.162:0/3389953165' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T12:24:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.162:0/3389953165' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T12:24:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: Active manager daemon y restarted 2024-03-30T12:24:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: Activating manager daemon y 2024-03-30T12:24:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: from='mgr.? 172.21.15.162:0/3389953165' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T12:24:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: osdmap e218: 8 total, 8 up, 8 in 2024-03-30T12:24:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: mgrmap e37: y(active, starting, since 0.00860854s), standbys: x 2024-03-30T12:24:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-30T12:24:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-30T12:24:44.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T12:24:44.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T12:24:44.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:24:44.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:24:44.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:24:44.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:24:44.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:24:44.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:24:44.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:24:44.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:24:44.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T12:24:44.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T12:24:44.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T12:24:44.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:44 smithi162 ceph-mon[30421]: Manager daemon y is now available 2024-03-30T12:24:44.885 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:24:44] ENGINE Bus STARTING 2024-03-30T12:24:44.886 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:44.757+0000 7f1f0155b700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:24:44.886 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:44.757+0000 7f1f0155b700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:24:44.886 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:44.757+0000 7f1f0155b700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:24:44.886 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:44.756+0000 7f1efe555700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:24:44.886 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:44.757+0000 7f1f0155b700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:24:44.886 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:44.757+0000 7f1efe555700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:24:44.886 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:44.757+0000 7f1efe555700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:24:44.886 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:44.757+0000 7f1efe555700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:24:44.889 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:44.757+0000 7f1f0155b700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:24:44.889 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:44.757+0000 7f1efe555700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-30T12:24:44.890 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: CherryPy Checker: 2024-03-30T12:24:44.890 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: The Application mounted at '' has an empty config. 2024-03-30T12:24:44.890 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:44.890 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:24:44] ENGINE Serving on http://:::9283 2024-03-30T12:24:44.890 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:24:44] ENGINE Bus STARTED 2024-03-30T12:24:44.890 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: osdmap e217: 8 total, 8 up, 8 in 2024-03-30T12:24:44.890 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: Standby manager daemon x restarted 2024-03-30T12:24:44.890 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: Standby manager daemon x started 2024-03-30T12:24:44.890 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.162:0/3389953165' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T12:24:44.890 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.162:0/3389953165' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T12:24:44.891 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.162:0/3389953165' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T12:24:44.891 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: Active manager daemon y restarted 2024-03-30T12:24:44.891 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: Activating manager daemon y 2024-03-30T12:24:44.891 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: from='mgr.? 172.21.15.162:0/3389953165' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T12:24:44.891 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: osdmap e218: 8 total, 8 up, 8 in 2024-03-30T12:24:44.891 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: mgrmap e37: y(active, starting, since 0.00860854s), standbys: x 2024-03-30T12:24:44.891 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:44.891 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:44.891 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:44.891 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-30T12:24:44.891 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-30T12:24:44.891 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T12:24:44.891 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T12:24:44.891 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:24:44.891 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:24:44.891 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:24:44.892 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:24:44.892 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:24:44.892 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:24:44.892 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:24:44.892 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:24:44.892 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T12:24:44.892 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T12:24:44.892 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T12:24:44.892 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[37565]: Manager daemon y is now available 2024-03-30T12:24:44.892 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: osdmap e217: 8 total, 8 up, 8 in 2024-03-30T12:24:44.892 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: Standby manager daemon x restarted 2024-03-30T12:24:44.892 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: Standby manager daemon x started 2024-03-30T12:24:44.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: from='mgr.? 172.21.15.162:0/3389953165' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T12:24:44.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: from='mgr.? 172.21.15.162:0/3389953165' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T12:24:44.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: from='mgr.? 172.21.15.162:0/3389953165' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T12:24:44.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: Active manager daemon y restarted 2024-03-30T12:24:44.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: Activating manager daemon y 2024-03-30T12:24:44.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: from='mgr.? 172.21.15.162:0/3389953165' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T12:24:44.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: osdmap e218: 8 total, 8 up, 8 in 2024-03-30T12:24:44.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: mgrmap e37: y(active, starting, since 0.00860854s), standbys: x 2024-03-30T12:24:44.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:44.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:44.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:44.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-30T12:24:44.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-30T12:24:44.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T12:24:44.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T12:24:44.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:24:44.894 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:24:44.894 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:24:44.894 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:24:44.894 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:24:44.894 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:24:44.894 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:24:44.894 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:24:44.895 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T12:24:44.895 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T12:24:44.895 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T12:24:44.895 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-mon[89279]: Manager daemon y is now available 2024-03-30T12:24:45.253 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:24:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[73215]: ts=2024-03-30T12:24:44.894Z caller=notify.go:743 level=info component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify success" attempts=3 2024-03-30T12:24:45.622 INFO:tasks.rados.rados.0.smithi084.stdout:784: done (4 left) 2024-03-30T12:24:45.622 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 80 2024-03-30T12:24:45.622 INFO:tasks.rados.rados.0.smithi084.stdout:785: seq_num 260 ranges {5324800=761856,6086656=417792,6504448=786432} 2024-03-30T12:24:45.653 INFO:tasks.rados.rados.0.smithi084.stdout:785: writing smithi08477944-22 from 5324800 to 6086656 tid 1 2024-03-30T12:24:45.655 INFO:tasks.rados.rados.0.smithi084.stdout:785: writing smithi08477944-22 from 6086656 to 6504448 tid 2 2024-03-30T12:24:45.660 INFO:tasks.rados.rados.0.smithi084.stdout:785: writing smithi08477944-22 from 6504448 to 7290880 tid 3 2024-03-30T12:24:45.660 INFO:tasks.rados.rados.0.smithi084.stdout:786: snap_create 2024-03-30T12:24:45.660 INFO:tasks.rados.rados.0.smithi084.stdout:779: expect (ObjNum 253 snap 77 seq_num 253) 2024-03-30T12:24:45.914 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:45 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:45.914 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:45 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:45.914 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:45 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:24:45.915 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:45 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T12:24:45.915 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:45 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T12:24:45.915 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:45 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:45.915 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:45 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:45.915 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:45 smithi162 ceph-mon[30421]: mgrmap e38: y(active, since 1.00992s), standbys: x 2024-03-30T12:24:45.915 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:45 smithi162 ceph-mon[30421]: osdmap e219: 8 total, 8 up, 8 in 2024-03-30T12:24:46.003 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:24:45.623+0000 7f1f562eb700 -1 mgr.server handle_report got status from non-daemon mon.a 2024-03-30T12:24:46.004 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:24:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[73215]: ts=2024-03-30T12:24:45.529Z caller=notify.go:743 level=info component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify success" attempts=4 2024-03-30T12:24:46.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:45 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:46.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:45 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:46.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:45 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:24:46.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:45 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T12:24:46.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:45 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T12:24:46.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:45 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:46.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:45 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:46.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:45 smithi084 ceph-mon[37565]: mgrmap e38: y(active, since 1.00992s), standbys: x 2024-03-30T12:24:46.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:45 smithi084 ceph-mon[37565]: osdmap e219: 8 total, 8 up, 8 in 2024-03-30T12:24:46.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:46.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:46.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:24:46.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T12:24:46.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T12:24:46.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:46.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:46.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:45 smithi084 ceph-mon[89279]: mgrmap e38: y(active, since 1.00992s), standbys: x 2024-03-30T12:24:46.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:45 smithi084 ceph-mon[89279]: osdmap e219: 8 total, 8 up, 8 in 2024-03-30T12:24:46.080 INFO:tasks.rados.rados.0.smithi084.stdout:780: finishing rollback tid 0 to smithi08477944-40 2024-03-30T12:24:46.080 INFO:tasks.rados.rados.0.smithi084.stdout:780: finishing rollback tid 1 to smithi08477944-40 2024-03-30T12:24:46.080 INFO:tasks.rados.rados.0.smithi084.stdout:780: finishing rollback tid 2 to smithi08477944-40 2024-03-30T12:24:46.080 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 472 (ObjNum 205 snap 62 seq_num 205) dirty exists 2024-03-30T12:24:46.080 INFO:tasks.rados.rados.0.smithi084.stdout:782: finishing write tid 1 to smithi08477944-7 2024-03-30T12:24:46.081 INFO:tasks.rados.rados.0.smithi084.stdout:782: finishing write tid 2 to smithi08477944-7 2024-03-30T12:24:46.081 INFO:tasks.rados.rados.0.smithi084.stdout:782: finishing write tid 3 to smithi08477944-7 2024-03-30T12:24:46.081 INFO:tasks.rados.rados.0.smithi084.stdout:782: finishing write tid 4 to smithi08477944-7 2024-03-30T12:24:46.081 INFO:tasks.rados.rados.0.smithi084.stdout:782: finishing write tid 5 to smithi08477944-7 2024-03-30T12:24:46.081 INFO:tasks.rados.rados.0.smithi084.stdout:782: finishing write tid 6 to smithi08477944-7 2024-03-30T12:24:46.081 INFO:tasks.rados.rados.0.smithi084.stdout:782: oid 7 updating version 0 to 473 2024-03-30T12:24:46.081 INFO:tasks.rados.rados.0.smithi084.stdout:782: oid 7 updating version 473 to 474 2024-03-30T12:24:46.081 INFO:tasks.rados.rados.0.smithi084.stdout:782: oid 7 updating version 474 to 477 2024-03-30T12:24:46.081 INFO:tasks.rados.rados.0.smithi084.stdout:782: oid 7 version 477 is already newer than 476 2024-03-30T12:24:46.081 INFO:tasks.rados.rados.0.smithi084.stdout:782: oid 7 version 477 is already newer than 475 2024-03-30T12:24:46.081 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 477 (ObjNum 259 snap 80 seq_num 259) dirty exists 2024-03-30T12:24:46.081 INFO:tasks.rados.rados.0.smithi084.stdout:782: left oid 7 (ObjNum 259 snap 80 seq_num 259) 2024-03-30T12:24:46.081 INFO:tasks.rados.rados.0.smithi084.stdout:785: finishing write tid 1 to smithi08477944-22 2024-03-30T12:24:46.081 INFO:tasks.rados.rados.0.smithi084.stdout:785: finishing write tid 2 to smithi08477944-22 2024-03-30T12:24:46.081 INFO:tasks.rados.rados.0.smithi084.stdout:785: finishing write tid 3 to smithi08477944-22 2024-03-30T12:24:46.082 INFO:tasks.rados.rados.0.smithi084.stdout:785: finishing write tid 4 to smithi08477944-22 2024-03-30T12:24:46.082 INFO:tasks.rados.rados.0.smithi084.stdout:785: finishing write tid 5 to smithi08477944-22 2024-03-30T12:24:46.082 INFO:tasks.rados.rados.0.smithi084.stdout:785: oid 22 updating version 0 to 382 2024-03-30T12:24:46.082 INFO:tasks.rados.rados.0.smithi084.stdout:785: oid 22 updating version 382 to 383 2024-03-30T12:24:46.082 INFO:tasks.rados.rados.0.smithi084.stdout:785: oid 22 updating version 383 to 384 2024-03-30T12:24:46.082 INFO:tasks.rados.rados.0.smithi084.stdout:785: oid 22 updating version 384 to 385 2024-03-30T12:24:46.082 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 385 (ObjNum 260 snap 80 seq_num 260) dirty exists 2024-03-30T12:24:46.082 INFO:tasks.rados.rados.0.smithi084.stdout:785: left oid 22 (ObjNum 260 snap 80 seq_num 260) 2024-03-30T12:24:46.661 INFO:tasks.rados.rados.0.smithi084.stdout:779: done (5 left) 2024-03-30T12:24:46.661 INFO:tasks.rados.rados.0.smithi084.stdout:780: done (4 left) 2024-03-30T12:24:46.661 INFO:tasks.rados.rados.0.smithi084.stdout:782: done (3 left) 2024-03-30T12:24:46.661 INFO:tasks.rados.rados.0.smithi084.stdout:783: done (2 left) 2024-03-30T12:24:46.661 INFO:tasks.rados.rados.0.smithi084.stdout:785: done (1 left) 2024-03-30T12:24:46.661 INFO:tasks.rados.rados.0.smithi084.stdout:786: done (0 left) 2024-03-30T12:24:46.661 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 81 2024-03-30T12:24:46.662 INFO:tasks.rados.rados.0.smithi084.stdout:787: seq_num 261 ranges {2490368=778240,3268608=704512,3973120=499712} 2024-03-30T12:24:46.678 INFO:tasks.rados.rados.0.smithi084.stdout:787: writing smithi08477944-19 from 2490368 to 3268608 tid 1 2024-03-30T12:24:46.682 INFO:tasks.rados.rados.0.smithi084.stdout:787: writing smithi08477944-19 from 3268608 to 3973120 tid 2 2024-03-30T12:24:46.686 INFO:tasks.rados.rados.0.smithi084.stdout:787: writing smithi08477944-19 from 3973120 to 4472832 tid 3 2024-03-30T12:24:46.686 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 81 2024-03-30T12:24:46.686 INFO:tasks.rados.rados.0.smithi084.stdout:787: finishing write tid 1 to smithi08477944-19 2024-03-30T12:24:46.686 INFO:tasks.rados.rados.0.smithi084.stdout:788: seq_num 262 ranges {2105344=794624,2899968=589824,3489792=614400} 2024-03-30T12:24:46.702 INFO:tasks.rados.rados.0.smithi084.stdout:788: writing smithi08477944-25 from 2105344 to 2899968 tid 1 2024-03-30T12:24:46.705 INFO:tasks.rados.rados.0.smithi084.stdout:788: writing smithi08477944-25 from 2899968 to 3489792 tid 2 2024-03-30T12:24:46.710 INFO:tasks.rados.rados.0.smithi084.stdout:788: writing smithi08477944-25 from 3489792 to 4104192 tid 3 2024-03-30T12:24:46.710 INFO:tasks.rados.rados.0.smithi084.stdout:789: rmattr oid 42 current snap is 81 2024-03-30T12:24:46.710 INFO:tasks.rados.rados.0.smithi084.stdout:787: finishing write tid 2 to smithi08477944-19 2024-03-30T12:24:46.710 INFO:tasks.rados.rados.0.smithi084.stdout:787: finishing write tid 3 to smithi08477944-19 2024-03-30T12:24:46.710 INFO:tasks.rados.rados.0.smithi084.stdout:787: finishing write tid 4 to smithi08477944-19 2024-03-30T12:24:46.710 INFO:tasks.rados.rados.0.smithi084.stdout:787: finishing write tid 5 to smithi08477944-19 2024-03-30T12:24:46.710 INFO:tasks.rados.rados.0.smithi084.stdout:787: oid 19 updating version 0 to 227 2024-03-30T12:24:46.711 INFO:tasks.rados.rados.0.smithi084.stdout:787: oid 19 updating version 227 to 228 2024-03-30T12:24:46.711 INFO:tasks.rados.rados.0.smithi084.stdout:787: oid 19 version 228 is already newer than 225 2024-03-30T12:24:46.711 INFO:tasks.rados.rados.0.smithi084.stdout:787: oid 19 version 228 is already newer than 226 2024-03-30T12:24:46.711 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 228 (ObjNum 261 snap 81 seq_num 261) dirty exists 2024-03-30T12:24:46.711 INFO:tasks.rados.rados.0.smithi084.stdout:787: left oid 19 (ObjNum 261 snap 81 seq_num 261) 2024-03-30T12:24:46.711 INFO:tasks.rados.rados.0.smithi084.stdout:788: finishing write tid 1 to smithi08477944-25 2024-03-30T12:24:46.711 INFO:tasks.rados.rados.0.smithi084.stdout:788: finishing write tid 2 to smithi08477944-25 2024-03-30T12:24:46.711 INFO:tasks.rados.rados.0.smithi084.stdout:787: done (2 left) 2024-03-30T12:24:46.711 INFO:tasks.rados.rados.0.smithi084.stdout:790: delete oid 35 current snap is 81 2024-03-30T12:24:46.711 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 0 (ObjNum 65 snap 0 seq_num 1717195375) dirty dne 2024-03-30T12:24:46.712 INFO:tasks.rados.rados.0.smithi084.stdout:789: done (2 left) 2024-03-30T12:24:46.712 INFO:tasks.rados.rados.0.smithi084.stdout:790: done (1 left) 2024-03-30T12:24:46.712 INFO:tasks.rados.rados.0.smithi084.stdout:791: copy_from oid 21 from oid 5 current snap is 81 2024-03-30T12:24:46.712 INFO:tasks.rados.rados.0.smithi084.stdout:792: snap_create 2024-03-30T12:24:46.712 INFO:tasks.rados.rados.0.smithi084.stdout:788: finishing write tid 3 to smithi08477944-25 2024-03-30T12:24:46.712 INFO:tasks.rados.rados.0.smithi084.stdout:788: finishing write tid 4 to smithi08477944-25 2024-03-30T12:24:46.714 INFO:tasks.rados.rados.0.smithi084.stdout:791: finishing copy_from racing read to smithi08477944-21 2024-03-30T12:24:46.715 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:46 smithi162 ceph-mon[30421]: [30/Mar/2024:12:24:45] ENGINE Bus STARTING 2024-03-30T12:24:46.715 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:46 smithi162 ceph-mon[30421]: [30/Mar/2024:12:24:45] ENGINE Serving on https://172.21.15.84:7150 2024-03-30T12:24:46.715 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:46 smithi162 ceph-mon[30421]: [30/Mar/2024:12:24:45] ENGINE Serving on http://172.21.15.84:8765 2024-03-30T12:24:46.715 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:46 smithi162 ceph-mon[30421]: [30/Mar/2024:12:24:45] ENGINE Bus STARTED 2024-03-30T12:24:46.715 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:46 smithi162 ceph-mon[30421]: pgmap v4: 121 pgs: 121 active+clean; 134 MiB data, 937 MiB used, 714 GiB / 715 GiB avail; 95 GiB/s rd, 42 GiB/s wr, 648.76k op/s; 332 MiB/s, 1.18k objects/s recovering 2024-03-30T12:24:46.716 INFO:tasks.rados.rados.0.smithi084.stdout:791: finishing copy_from to smithi08477944-21 2024-03-30T12:24:46.716 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 407 (ObjNum 289 snap 0 seq_num 1) dirty exists 2024-03-30T12:24:46.716 INFO:tasks.rados.rados.0.smithi084.stdout:788: finishing write tid 5 to smithi08477944-25 2024-03-30T12:24:46.716 INFO:tasks.rados.rados.0.smithi084.stdout:788: oid 25 updating version 0 to 411 2024-03-30T12:24:46.716 INFO:tasks.rados.rados.0.smithi084.stdout:788: oid 25 version 411 is already newer than 410 2024-03-30T12:24:46.716 INFO:tasks.rados.rados.0.smithi084.stdout:788: oid 25 version 411 is already newer than 408 2024-03-30T12:24:46.716 INFO:tasks.rados.rados.0.smithi084.stdout:788: oid 25 version 411 is already newer than 409 2024-03-30T12:24:46.716 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 411 (ObjNum 262 snap 81 seq_num 262) dirty exists 2024-03-30T12:24:46.716 INFO:tasks.rados.rados.0.smithi084.stdout:788: left oid 25 (ObjNum 262 snap 81 seq_num 262) 2024-03-30T12:24:47.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:46 smithi084 ceph-mon[37565]: [30/Mar/2024:12:24:45] ENGINE Bus STARTING 2024-03-30T12:24:47.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:46 smithi084 ceph-mon[37565]: [30/Mar/2024:12:24:45] ENGINE Serving on https://172.21.15.84:7150 2024-03-30T12:24:47.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:46 smithi084 ceph-mon[37565]: [30/Mar/2024:12:24:45] ENGINE Serving on http://172.21.15.84:8765 2024-03-30T12:24:47.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:46 smithi084 ceph-mon[37565]: [30/Mar/2024:12:24:45] ENGINE Bus STARTED 2024-03-30T12:24:47.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:46 smithi084 ceph-mon[37565]: pgmap v4: 121 pgs: 121 active+clean; 134 MiB data, 937 MiB used, 714 GiB / 715 GiB avail; 95 GiB/s rd, 42 GiB/s wr, 648.76k op/s; 332 MiB/s, 1.18k objects/s recovering 2024-03-30T12:24:47.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:46 smithi084 ceph-mon[89279]: [30/Mar/2024:12:24:45] ENGINE Bus STARTING 2024-03-30T12:24:47.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:46 smithi084 ceph-mon[89279]: [30/Mar/2024:12:24:45] ENGINE Serving on https://172.21.15.84:7150 2024-03-30T12:24:47.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:46 smithi084 ceph-mon[89279]: [30/Mar/2024:12:24:45] ENGINE Serving on http://172.21.15.84:8765 2024-03-30T12:24:47.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:46 smithi084 ceph-mon[89279]: [30/Mar/2024:12:24:45] ENGINE Bus STARTED 2024-03-30T12:24:47.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:46 smithi084 ceph-mon[89279]: pgmap v4: 121 pgs: 121 active+clean; 134 MiB data, 937 MiB used, 714 GiB / 715 GiB avail; 95 GiB/s rd, 42 GiB/s wr, 648.76k op/s; 332 MiB/s, 1.18k objects/s recovering 2024-03-30T12:24:47.653 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:47 smithi084 ceph-mon[89279]: pgmap v5: 121 pgs: 121 active+clean; 134 MiB data, 937 MiB used, 714 GiB / 715 GiB avail; 498 MiB/s rd, 218 MiB/s wr, 3.31k op/s; 1.7 MiB/s, 6 objects/s recovering 2024-03-30T12:24:47.653 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:47 smithi084 ceph-mon[89279]: mgrmap e39: y(active, since 2s), standbys: x 2024-03-30T12:24:47.653 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:47 smithi084 ceph-mon[89279]: osdmap e220: 8 total, 8 up, 8 in 2024-03-30T12:24:47.663 INFO:tasks.rados.rados.0.smithi084.stdout:788: done (2 left) 2024-03-30T12:24:47.663 INFO:tasks.rados.rados.0.smithi084.stdout:791: done (1 left) 2024-03-30T12:24:47.663 INFO:tasks.rados.rados.0.smithi084.stdout:792: done (0 left) 2024-03-30T12:24:47.663 INFO:tasks.rados.rados.0.smithi084.stdout:793: rollback oid 44 current snap is 82 2024-03-30T12:24:47.663 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 44 to 72 2024-03-30T12:24:47.663 INFO:tasks.rados.rados.0.smithi084.stdout:794: copy_from oid 18 from oid 38 current snap is 82 2024-03-30T12:24:47.663 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 82 2024-03-30T12:24:47.663 INFO:tasks.rados.rados.0.smithi084.stdout:795: seq_num 264 ranges {0=425984,425984=761856,1187840=770048,1957888=73728} 2024-03-30T12:24:47.665 INFO:tasks.rados.rados.0.smithi084.stdout:795: writing smithi08477944-3 from 0 to 425984 tid 1 2024-03-30T12:24:47.670 INFO:tasks.rados.rados.0.smithi084.stdout:795: writing smithi08477944-3 from 425984 to 1187840 tid 2 2024-03-30T12:24:47.675 INFO:tasks.rados.rados.0.smithi084.stdout:795: writing smithi08477944-3 from 1187840 to 1957888 tid 3 2024-03-30T12:24:47.676 INFO:tasks.rados.rados.0.smithi084.stdout:795: writing smithi08477944-3 from 1957888 to 2031616 tid 4 2024-03-30T12:24:47.676 INFO:tasks.rados.rados.0.smithi084.stdout:796: snap_remove snap 67 2024-03-30T12:24:48.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:47 smithi084 ceph-mon[37565]: pgmap v5: 121 pgs: 121 active+clean; 134 MiB data, 937 MiB used, 714 GiB / 715 GiB avail; 498 MiB/s rd, 218 MiB/s wr, 3.31k op/s; 1.7 MiB/s, 6 objects/s recovering 2024-03-30T12:24:48.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:47 smithi084 ceph-mon[37565]: mgrmap e39: y(active, since 2s), standbys: x 2024-03-30T12:24:48.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:47 smithi084 ceph-mon[37565]: osdmap e220: 8 total, 8 up, 8 in 2024-03-30T12:24:48.087 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:47 smithi162 ceph-mon[30421]: pgmap v5: 121 pgs: 121 active+clean; 134 MiB data, 937 MiB used, 714 GiB / 715 GiB avail; 498 MiB/s rd, 218 MiB/s wr, 3.31k op/s; 1.7 MiB/s, 6 objects/s recovering 2024-03-30T12:24:48.087 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:47 smithi162 ceph-mon[30421]: mgrmap e39: y(active, since 2s), standbys: x 2024-03-30T12:24:48.087 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:47 smithi162 ceph-mon[30421]: osdmap e220: 8 total, 8 up, 8 in 2024-03-30T12:24:48.158 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-03-30T12:24:48.479 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T12:24:48.479 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (4m) 45s ago 4m 25.2M - 0.25.0 c8568f914cd2 6765ce007f39 2024-03-30T12:24:48.479 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi162 *:3000 running (4m) 24s ago 4m 88.6M - 9.4.7 954c08fa6188 ff2ec7518619 2024-03-30T12:24:48.479 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (5m) 45s ago 5m 13.6M - 18.2.2-1051-gf14b5682 c8fb09e16a7d a9c2e74ca2a3 2024-03-30T12:24:48.479 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi162 running (5m) 24s ago 5m 18.9M - 18.2.2-1051-gf14b5682 c8fb09e16a7d ee1770ef5edd 2024-03-30T12:24:48.479 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi162 *:8443,9283,8765 running (29s) 24s ago 9m 64.1M - 19.0.0-1864-g5dc2ea30 548196a1a838 eec968f3fcc6 2024-03-30T12:24:48.479 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (58s) 45s ago 11m 476M - 19.0.0-1864-g5dc2ea30 548196a1a838 9a2aba19dffc 2024-03-30T12:24:48.480 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (11m) 45s ago 11m 58.2M 2048M 18.2.2-1051-gf14b5682 c8fb09e16a7d 915abc0d6de7 2024-03-30T12:24:48.480 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi162 running (9m) 24s ago 9m 50.1M 2048M 18.2.2-1051-gf14b5682 c8fb09e16a7d 5bf04eacfc81 2024-03-30T12:24:48.480 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (9m) 45s ago 9m 47.0M 2048M 18.2.2-1051-gf14b5682 c8fb09e16a7d 7db3fd996ae6 2024-03-30T12:24:48.480 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (4m) 45s ago 4m 16.9M - 1.5.0 0da6a335fe13 66844bed39e8 2024-03-30T12:24:48.480 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi162 *:9100 running (4m) 24s ago 4m 15.9M - 1.5.0 0da6a335fe13 3d6e28b2348d 2024-03-30T12:24:48.480 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (9m) 45s ago 9m 154M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 4cad4c4383a6 2024-03-30T12:24:48.480 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (8m) 45s ago 8m 116M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 3b30b0ea0e32 2024-03-30T12:24:48.480 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (8m) 45s ago 8m 130M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d eb2412618811 2024-03-30T12:24:48.480 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (7m) 45s ago 7m 77.5M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 8eaf6dc73c25 2024-03-30T12:24:48.480 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi162 running (7m) 24s ago 7m 146M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 1f52e827b91a 2024-03-30T12:24:48.480 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi162 running (7m) 24s ago 7m 127M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 7ba250d154aa 2024-03-30T12:24:48.480 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi162 running (6m) 24s ago 6m 82.4M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 656a733e8b7a 2024-03-30T12:24:48.480 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi162 running (6m) 24s ago 6m 97.9M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d e3246b3bc88b 2024-03-30T12:24:48.480 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi162 *:9095 running (34s) 24s ago 5m 37.1M - 2.43.0 a07b618ecd1d bd7d323e4b47 2024-03-30T12:24:48.691 INFO:tasks.rados.rados.0.smithi084.stdout:796: done (3 left) 2024-03-30T12:24:48.691 INFO:tasks.rados.rados.0.smithi084.stdout:797: snap_create 2024-03-30T12:24:48.691 INFO:tasks.rados.rados.0.smithi084.stdout:793: finishing rollback tid 0 to smithi08477944-44 2024-03-30T12:24:48.691 INFO:tasks.rados.rados.0.smithi084.stdout:793: finishing rollback tid 1 to smithi08477944-44 2024-03-30T12:24:48.691 INFO:tasks.rados.rados.0.smithi084.stdout:793: finishing rollback tid 2 to smithi08477944-44 2024-03-30T12:24:48.691 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 232 (ObjNum 167 snap 45 seq_num 167) dirty exists 2024-03-30T12:24:48.691 INFO:tasks.rados.rados.0.smithi084.stdout:795: finishing write tid 1 to smithi08477944-3 2024-03-30T12:24:48.692 INFO:tasks.rados.rados.0.smithi084.stdout:794: finishing copy_from racing read to smithi08477944-18 2024-03-30T12:24:48.692 INFO:tasks.rados.rados.0.smithi084.stdout:795: finishing write tid 2 to smithi08477944-3 2024-03-30T12:24:48.692 INFO:tasks.rados.rados.0.smithi084.stdout:794: finishing copy_from to smithi08477944-18 2024-03-30T12:24:48.692 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 169 (ObjNum 244 snap 75 seq_num 244) dirty exists 2024-03-30T12:24:48.692 INFO:tasks.rados.rados.0.smithi084.stdout:795: finishing write tid 3 to smithi08477944-3 2024-03-30T12:24:48.692 INFO:tasks.rados.rados.0.smithi084.stdout:795: finishing write tid 4 to smithi08477944-3 2024-03-30T12:24:48.692 INFO:tasks.rados.rados.0.smithi084.stdout:795: finishing write tid 5 to smithi08477944-3 2024-03-30T12:24:48.692 INFO:tasks.rados.rados.0.smithi084.stdout:795: finishing write tid 6 to smithi08477944-3 2024-03-30T12:24:48.692 INFO:tasks.rados.rados.0.smithi084.stdout:795: oid 3 updating version 0 to 389 2024-03-30T12:24:48.693 INFO:tasks.rados.rados.0.smithi084.stdout:795: oid 3 updating version 389 to 390 2024-03-30T12:24:48.693 INFO:tasks.rados.rados.0.smithi084.stdout:795: oid 3 version 390 is already newer than 387 2024-03-30T12:24:48.693 INFO:tasks.rados.rados.0.smithi084.stdout:795: oid 3 version 390 is already newer than 386 2024-03-30T12:24:48.693 INFO:tasks.rados.rados.0.smithi084.stdout:795: oid 3 version 390 is already newer than 388 2024-03-30T12:24:48.693 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 390 (ObjNum 264 snap 82 seq_num 264) dirty exists 2024-03-30T12:24:48.693 INFO:tasks.rados.rados.0.smithi084.stdout:795: left oid 3 (ObjNum 264 snap 82 seq_num 264) 2024-03-30T12:24:48.743 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:48 smithi084 ceph-mon[37565]: osdmap e221: 8 total, 8 up, 8 in 2024-03-30T12:24:48.744 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:48 smithi084 ceph-mon[89279]: osdmap e221: 8 total, 8 up, 8 in 2024-03-30T12:24:48.896 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-30T12:24:48.897 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-03-30T12:24:48.897 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 2, 2024-03-30T12:24:48.897 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 1 2024-03-30T12:24:48.897 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:24:48.897 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-03-30T12:24:48.897 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 2 2024-03-30T12:24:48.897 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:24:48.897 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-03-30T12:24:48.897 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 8 2024-03-30T12:24:48.897 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:24:48.897 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-03-30T12:24:48.898 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 2 2024-03-30T12:24:48.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:24:48.898 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-03-30T12:24:48.898 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 12, 2024-03-30T12:24:48.898 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 3 2024-03-30T12:24:48.898 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-30T12:24:48.898 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-30T12:24:48.996 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:48 smithi162 ceph-mon[30421]: osdmap e221: 8 total, 8 up, 8 in 2024-03-30T12:24:49.628 INFO:tasks.rados.rados.0.smithi084.stdout:793: done (3 left) 2024-03-30T12:24:49.628 INFO:tasks.rados.rados.0.smithi084.stdout:794: done (2 left) 2024-03-30T12:24:49.628 INFO:tasks.rados.rados.0.smithi084.stdout:795: done (1 left) 2024-03-30T12:24:49.628 INFO:tasks.rados.rados.0.smithi084.stdout:797: done (0 left) 2024-03-30T12:24:49.628 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 83 2024-03-30T12:24:49.628 INFO:tasks.rados.rados.0.smithi084.stdout:798: seq_num 265 ranges {401408=442368,843776=647168,1490944=573440,2064384=385024} 2024-03-30T12:24:49.632 INFO:tasks.rados.rados.0.smithi084.stdout:798: writing smithi08477944-1 from 401408 to 843776 tid 1 2024-03-30T12:24:49.636 INFO:tasks.rados.rados.0.smithi084.stdout:798: writing smithi08477944-1 from 843776 to 1490944 tid 2 2024-03-30T12:24:49.640 INFO:tasks.rados.rados.0.smithi084.stdout:798: writing smithi08477944-1 from 1490944 to 2064384 tid 3 2024-03-30T12:24:49.643 INFO:tasks.rados.rados.0.smithi084.stdout:798: writing smithi08477944-1 from 2064384 to 2449408 tid 4 2024-03-30T12:24:49.643 INFO:tasks.rados.rados.0.smithi084.stdout:799: read oid 35 snap -1 2024-03-30T12:24:49.643 INFO:tasks.rados.rados.0.smithi084.stdout:799: expect deleted 2024-03-30T12:24:49.643 INFO:tasks.rados.rados.0.smithi084.stdout:800: snap_create 2024-03-30T12:24:49.643 INFO:tasks.rados.rados.0.smithi084.stdout:798: finishing write tid 1 to smithi08477944-1 2024-03-30T12:24:49.643 INFO:tasks.rados.rados.0.smithi084.stdout:798: finishing write tid 2 to smithi08477944-1 2024-03-30T12:24:49.643 INFO:tasks.rados.rados.0.smithi084.stdout:798: finishing write tid 3 to smithi08477944-1 2024-03-30T12:24:49.645 INFO:tasks.rados.rados.0.smithi084.stdout:798: finishing write tid 4 to smithi08477944-1 2024-03-30T12:24:49.646 INFO:tasks.rados.rados.0.smithi084.stdout:798: finishing write tid 5 to smithi08477944-1 2024-03-30T12:24:49.650 INFO:tasks.rados.rados.0.smithi084.stdout:798: finishing write tid 6 to smithi08477944-1 2024-03-30T12:24:49.651 INFO:tasks.rados.rados.0.smithi084.stdout:798: oid 1 updating version 0 to 196 2024-03-30T12:24:49.651 INFO:tasks.rados.rados.0.smithi084.stdout:798: oid 1 updating version 196 to 198 2024-03-30T12:24:49.651 INFO:tasks.rados.rados.0.smithi084.stdout:798: oid 1 version 198 is already newer than 194 2024-03-30T12:24:49.651 INFO:tasks.rados.rados.0.smithi084.stdout:798: oid 1 version 198 is already newer than 195 2024-03-30T12:24:49.651 INFO:tasks.rados.rados.0.smithi084.stdout:798: oid 1 version 198 is already newer than 197 2024-03-30T12:24:49.651 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 198 (ObjNum 265 snap 83 seq_num 265) dirty exists 2024-03-30T12:24:49.651 INFO:tasks.rados.rados.0.smithi084.stdout:798: left oid 1 (ObjNum 265 snap 83 seq_num 265) 2024-03-30T12:24:49.669 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:24:49] "GET /metrics HTTP/1.1" 200 33281 "" "Prometheus/2.43.0" 2024-03-30T12:24:50.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:49 smithi084 ceph-mon[89279]: from='client.25214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:24:50.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:49 smithi084 ceph-mon[89279]: from='client.25220 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:24:50.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:49 smithi084 ceph-mon[89279]: pgmap v8: 121 pgs: 121 active+clean; 134 MiB data, 937 MiB used, 714 GiB / 715 GiB avail; 165 MiB/s rd, 73 MiB/s wr, 1.10k op/s; 577 KiB/s, 2 objects/s recovering 2024-03-30T12:24:50.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:49 smithi084 ceph-mon[89279]: mgrmap e40: y(active, since 4s), standbys: x 2024-03-30T12:24:50.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:49 smithi084 ceph-mon[89279]: osdmap e222: 8 total, 8 up, 8 in 2024-03-30T12:24:50.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:49 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/3596815906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:24:50.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:49 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:50.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:49 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:50.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:49 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:50.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:49 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:50.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:49 smithi084 ceph-mon[89279]: osdmap e223: 8 total, 8 up, 8 in 2024-03-30T12:24:50.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:49 smithi084 ceph-mon[37565]: from='client.25214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:24:50.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:49 smithi084 ceph-mon[37565]: from='client.25220 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:24:50.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:49 smithi084 ceph-mon[37565]: pgmap v8: 121 pgs: 121 active+clean; 134 MiB data, 937 MiB used, 714 GiB / 715 GiB avail; 165 MiB/s rd, 73 MiB/s wr, 1.10k op/s; 577 KiB/s, 2 objects/s recovering 2024-03-30T12:24:50.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:49 smithi084 ceph-mon[37565]: mgrmap e40: y(active, since 4s), standbys: x 2024-03-30T12:24:50.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:49 smithi084 ceph-mon[37565]: osdmap e222: 8 total, 8 up, 8 in 2024-03-30T12:24:50.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:49 smithi084 ceph-mon[37565]: from='client.? 172.21.15.84:0/3596815906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:24:50.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:49 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:50.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:49 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:50.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:49 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:50.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:49 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:50.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:49 smithi084 ceph-mon[37565]: osdmap e223: 8 total, 8 up, 8 in 2024-03-30T12:24:50.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:49 smithi162 ceph-mon[30421]: from='client.25214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:24:50.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:49 smithi162 ceph-mon[30421]: from='client.25220 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:24:50.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:49 smithi162 ceph-mon[30421]: pgmap v8: 121 pgs: 121 active+clean; 134 MiB data, 937 MiB used, 714 GiB / 715 GiB avail; 165 MiB/s rd, 73 MiB/s wr, 1.10k op/s; 577 KiB/s, 2 objects/s recovering 2024-03-30T12:24:50.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:49 smithi162 ceph-mon[30421]: mgrmap e40: y(active, since 4s), standbys: x 2024-03-30T12:24:50.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:49 smithi162 ceph-mon[30421]: osdmap e222: 8 total, 8 up, 8 in 2024-03-30T12:24:50.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:49 smithi162 ceph-mon[30421]: from='client.? 172.21.15.84:0/3596815906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:24:50.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:49 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:50.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:49 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:50.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:49 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:50.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:49 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:50.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:49 smithi162 ceph-mon[30421]: osdmap e223: 8 total, 8 up, 8 in 2024-03-30T12:24:50.630 INFO:tasks.rados.rados.0.smithi084.stdout:798: done (2 left) 2024-03-30T12:24:50.631 INFO:tasks.rados.rados.0.smithi084.stdout:799: done (1 left) 2024-03-30T12:24:50.631 INFO:tasks.rados.rados.0.smithi084.stdout:800: done (0 left) 2024-03-30T12:24:50.631 INFO:tasks.rados.rados.0.smithi084.stdout:801: rollback oid 37 current snap is 84 2024-03-30T12:24:50.631 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 37 to 62 2024-03-30T12:24:50.631 INFO:tasks.rados.rados.0.smithi084.stdout:802: delete oid 44 current snap is 84 2024-03-30T12:24:50.633 INFO:tasks.rados.rados.0.smithi084.stdout:802: done (1 left) 2024-03-30T12:24:50.634 INFO:tasks.rados.rados.0.smithi084.stdout:803: copy_from oid 39 from oid 8 current snap is 84 2024-03-30T12:24:50.634 INFO:tasks.rados.rados.0.smithi084.stdout:804: read oid 46 snap 50 2024-03-30T12:24:50.634 INFO:tasks.rados.rados.0.smithi084.stdout:804: expect (ObjNum 107 snap 22 seq_num 107) 2024-03-30T12:24:50.634 INFO:tasks.rados.rados.0.smithi084.stdout:805: rollback oid 29 current snap is 84 2024-03-30T12:24:50.634 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 29 to 71 2024-03-30T12:24:50.634 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 84 2024-03-30T12:24:50.634 INFO:tasks.rados.rados.0.smithi084.stdout:806: seq_num 267 ranges {2039808=475136,2514944=458752,2973696=540672,3514368=606208} 2024-03-30T12:24:50.648 INFO:tasks.rados.rados.0.smithi084.stdout:806: writing smithi08477944-50 from 2039808 to 2514944 tid 1 2024-03-30T12:24:50.651 INFO:tasks.rados.rados.0.smithi084.stdout:806: writing smithi08477944-50 from 2514944 to 2973696 tid 2 2024-03-30T12:24:50.654 INFO:tasks.rados.rados.0.smithi084.stdout:806: writing smithi08477944-50 from 2973696 to 3514368 tid 3 2024-03-30T12:24:50.658 INFO:tasks.rados.rados.0.smithi084.stdout:806: writing smithi08477944-50 from 3514368 to 4120576 tid 4 2024-03-30T12:24:50.658 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 84 2024-03-30T12:24:50.658 INFO:tasks.rados.rados.0.smithi084.stdout:801: finishing rollback tid 1 to smithi08477944-37 2024-03-30T12:24:50.658 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 310 (ObjNum 65 snap 0 seq_num 193469186) dirty dne 2024-03-30T12:24:50.658 INFO:tasks.rados.rados.0.smithi084.stdout:805: finishing rollback tid 0 to smithi08477944-29 2024-03-30T12:24:50.658 INFO:tasks.rados.rados.0.smithi084.stdout:805: finishing rollback tid 1 to smithi08477944-29 2024-03-30T12:24:50.658 INFO:tasks.rados.rados.0.smithi084.stdout:807: seq_num 268 ranges {2490368=491520,2981888=745472,3727360=745472,4472832=114688} 2024-03-30T12:24:50.674 INFO:tasks.rados.rados.0.smithi084.stdout:807: writing smithi08477944-24 from 2490368 to 2981888 tid 1 2024-03-30T12:24:50.677 INFO:tasks.rados.rados.0.smithi084.stdout:807: writing smithi08477944-24 from 2981888 to 3727360 tid 2 2024-03-30T12:24:50.681 INFO:tasks.rados.rados.0.smithi084.stdout:807: writing smithi08477944-24 from 3727360 to 4472832 tid 3 2024-03-30T12:24:50.683 INFO:tasks.rados.rados.0.smithi084.stdout:807: writing smithi08477944-24 from 4472832 to 4587520 tid 4 2024-03-30T12:24:50.683 INFO:tasks.rados.rados.0.smithi084.stdout:801: done (5 left) 2024-03-30T12:24:50.683 INFO:tasks.rados.rados.0.smithi084.stdout:808: snap_remove snap 76 2024-03-30T12:24:51.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:51 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:51 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:51 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:51 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:51 smithi162 ceph-mon[30421]: pgmap v11: 121 pgs: 121 active+clean; 134 MiB data, 937 MiB used, 714 GiB / 715 GiB avail 2024-03-30T12:24:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:51 smithi162 ceph-mon[30421]: osdmap e224: 8 total, 8 up, 8 in 2024-03-30T12:24:51.634 INFO:tasks.rados.rados.0.smithi084.stdout:805: finishing rollback tid 2 to smithi08477944-29 2024-03-30T12:24:51.634 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 291 (ObjNum 142 snap 36 seq_num 142) dirty exists 2024-03-30T12:24:51.634 INFO:tasks.rados.rados.0.smithi084.stdout:803: finishing copy_from racing read to smithi08477944-39 2024-03-30T12:24:51.634 INFO:tasks.rados.rados.0.smithi084.stdout:803: finishing copy_from to smithi08477944-39 2024-03-30T12:24:51.634 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 255 (ObjNum 170 snap 46 seq_num 170) dirty exists 2024-03-30T12:24:51.634 INFO:tasks.rados.rados.0.smithi084.stdout:804: expect (ObjNum 107 snap 22 seq_num 107) 2024-03-30T12:24:51.688 INFO:tasks.rados.rados.0.smithi084.stdout:806: finishing write tid 1 to smithi08477944-50 2024-03-30T12:24:51.688 INFO:tasks.rados.rados.0.smithi084.stdout:806: finishing write tid 2 to smithi08477944-50 2024-03-30T12:24:51.688 INFO:tasks.rados.rados.0.smithi084.stdout:806: finishing write tid 3 to smithi08477944-50 2024-03-30T12:24:51.688 INFO:tasks.rados.rados.0.smithi084.stdout:803: done (5 left) 2024-03-30T12:24:51.688 INFO:tasks.rados.rados.0.smithi084.stdout:804: done (4 left) 2024-03-30T12:24:51.689 INFO:tasks.rados.rados.0.smithi084.stdout:805: done (3 left) 2024-03-30T12:24:51.689 INFO:tasks.rados.rados.0.smithi084.stdout:808: done (2 left) 2024-03-30T12:24:51.689 INFO:tasks.rados.rados.0.smithi084.stdout:809: rmattr oid 23 current snap is 84 2024-03-30T12:24:51.689 INFO:tasks.rados.rados.0.smithi084.stdout:806: finishing write tid 4 to smithi08477944-50 2024-03-30T12:24:51.689 INFO:tasks.rados.rados.0.smithi084.stdout:806: finishing write tid 5 to smithi08477944-50 2024-03-30T12:24:51.689 INFO:tasks.rados.rados.0.smithi084.stdout:806: finishing write tid 6 to smithi08477944-50 2024-03-30T12:24:51.689 INFO:tasks.rados.rados.0.smithi084.stdout:806: oid 50 updating version 0 to 467 2024-03-30T12:24:51.689 INFO:tasks.rados.rados.0.smithi084.stdout:806: oid 50 version 467 is already newer than 466 2024-03-30T12:24:51.689 INFO:tasks.rados.rados.0.smithi084.stdout:806: oid 50 version 467 is already newer than 463 2024-03-30T12:24:51.689 INFO:tasks.rados.rados.0.smithi084.stdout:806: oid 50 version 467 is already newer than 465 2024-03-30T12:24:51.689 INFO:tasks.rados.rados.0.smithi084.stdout:806: oid 50 version 467 is already newer than 464 2024-03-30T12:24:51.689 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 467 (ObjNum 267 snap 84 seq_num 267) dirty exists 2024-03-30T12:24:51.689 INFO:tasks.rados.rados.0.smithi084.stdout:806: left oid 50 (ObjNum 267 snap 84 seq_num 267) 2024-03-30T12:24:51.689 INFO:tasks.rados.rados.0.smithi084.stdout:807: finishing write tid 1 to smithi08477944-24 2024-03-30T12:24:51.689 INFO:tasks.rados.rados.0.smithi084.stdout:807: finishing write tid 2 to smithi08477944-24 2024-03-30T12:24:51.690 INFO:tasks.rados.rados.0.smithi084.stdout:806: done (2 left) 2024-03-30T12:24:51.690 INFO:tasks.rados.rados.0.smithi084.stdout:810: setattr oid 10 current snap is 84 2024-03-30T12:24:51.690 INFO:tasks.rados.rados.0.smithi084.stdout:807: finishing write tid 3 to smithi08477944-24 2024-03-30T12:24:51.690 INFO:tasks.rados.rados.0.smithi084.stdout:807: finishing write tid 4 to smithi08477944-24 2024-03-30T12:24:51.690 INFO:tasks.rados.rados.0.smithi084.stdout:807: finishing write tid 5 to smithi08477944-24 2024-03-30T12:24:51.690 INFO:tasks.rados.rados.0.smithi084.stdout:807: finishing write tid 6 to smithi08477944-24 2024-03-30T12:24:51.690 INFO:tasks.rados.rados.0.smithi084.stdout:807: oid 24 updating version 0 to 163 2024-03-30T12:24:51.690 INFO:tasks.rados.rados.0.smithi084.stdout:807: oid 24 updating version 163 to 166 2024-03-30T12:24:51.690 INFO:tasks.rados.rados.0.smithi084.stdout:807: oid 24 version 166 is already newer than 164 2024-03-30T12:24:51.690 INFO:tasks.rados.rados.0.smithi084.stdout:807: oid 24 version 166 is already newer than 165 2024-03-30T12:24:51.690 INFO:tasks.rados.rados.0.smithi084.stdout:807: oid 24 version 166 is already newer than 162 2024-03-30T12:24:51.690 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 166 (ObjNum 268 snap 84 seq_num 268) dirty exists 2024-03-30T12:24:51.690 INFO:tasks.rados.rados.0.smithi084.stdout:807: left oid 24 (ObjNum 268 snap 84 seq_num 268) 2024-03-30T12:24:51.690 INFO:tasks.rados.rados.0.smithi084.stdout:807: done (2 left) 2024-03-30T12:24:51.691 INFO:tasks.rados.rados.0.smithi084.stdout:811: snap_remove snap 73 2024-03-30T12:24:51.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:51 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:51.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:51 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:51.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:51 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:51.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:51 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:51.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:51 smithi084 ceph-mon[89279]: pgmap v11: 121 pgs: 121 active+clean; 134 MiB data, 937 MiB used, 714 GiB / 715 GiB avail 2024-03-30T12:24:51.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:51 smithi084 ceph-mon[89279]: osdmap e224: 8 total, 8 up, 8 in 2024-03-30T12:24:51.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:51 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:51.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:51 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:51.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:51 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:51.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:51 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:51.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:51 smithi084 ceph-mon[37565]: pgmap v11: 121 pgs: 121 active+clean; 134 MiB data, 937 MiB used, 714 GiB / 715 GiB avail 2024-03-30T12:24:51.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:51 smithi084 ceph-mon[37565]: osdmap e224: 8 total, 8 up, 8 in 2024-03-30T12:24:52.640 INFO:tasks.rados.rados.0.smithi084.stdout:811: done (2 left) 2024-03-30T12:24:52.640 INFO:tasks.rados.rados.0.smithi084.stdout:812: rollback oid 31 current snap is 84 2024-03-30T12:24:52.640 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 31 to 61 2024-03-30T12:24:52.640 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 316 (ObjNum 221 snap 65 seq_num 221) dirty exists 2024-03-30T12:24:52.641 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 321 (ObjNum 239 snap 75 seq_num 239) dirty exists 2024-03-30T12:24:52.641 INFO:tasks.rados.rados.0.smithi084.stdout:809: done (2 left) 2024-03-30T12:24:52.641 INFO:tasks.rados.rados.0.smithi084.stdout:810: done (1 left) 2024-03-30T12:24:52.641 INFO:tasks.rados.rados.0.smithi084.stdout:813: snap_remove snap 71 2024-03-30T12:24:52.852 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:52 smithi162 ceph-mon[30421]: osdmap e225: 8 total, 8 up, 8 in 2024-03-30T12:24:53.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:52 smithi084 ceph-mon[37565]: osdmap e225: 8 total, 8 up, 8 in 2024-03-30T12:24:53.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:52 smithi084 ceph-mon[89279]: osdmap e225: 8 total, 8 up, 8 in 2024-03-30T12:24:53.642 INFO:tasks.rados.rados.0.smithi084.stdout:813: done (1 left) 2024-03-30T12:24:53.642 INFO:tasks.rados.rados.0.smithi084.stdout:814: read oid 46 snap -1 2024-03-30T12:24:53.642 INFO:tasks.rados.rados.0.smithi084.stdout:814: expect (ObjNum 107 snap 22 seq_num 107) 2024-03-30T12:24:53.642 INFO:tasks.rados.rados.0.smithi084.stdout:815: copy_from oid 20 from oid 11 current snap is 84 2024-03-30T12:24:53.642 INFO:tasks.rados.rados.0.smithi084.stdout:812: finishing rollback tid 1 to smithi08477944-31 2024-03-30T12:24:53.642 INFO:tasks.rados.rados.0.smithi084.stdout:812: finishing rollback tid 2 to smithi08477944-31 2024-03-30T12:24:53.642 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 297 (ObjNum 200 snap 58 seq_num 200) dirty exists 2024-03-30T12:24:53.642 INFO:tasks.rados.rados.0.smithi084.stdout:812: done (2 left) 2024-03-30T12:24:53.643 INFO:tasks.rados.rados.0.smithi084.stdout:816: snap_remove snap 50 2024-03-30T12:24:53.970 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:53 smithi162 ceph-mon[30421]: pgmap v14: 121 pgs: 121 active+clean; 146 MiB data, 976 MiB used, 714 GiB / 715 GiB avail; 53 KiB/s rd, 2.8 MiB/s wr, 37 op/s 2024-03-30T12:24:53.970 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:53 smithi162 ceph-mon[30421]: osdmap e226: 8 total, 8 up, 8 in 2024-03-30T12:24:54.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:53 smithi084 ceph-mon[89279]: pgmap v14: 121 pgs: 121 active+clean; 146 MiB data, 976 MiB used, 714 GiB / 715 GiB avail; 53 KiB/s rd, 2.8 MiB/s wr, 37 op/s 2024-03-30T12:24:54.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:53 smithi084 ceph-mon[89279]: osdmap e226: 8 total, 8 up, 8 in 2024-03-30T12:24:54.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:53 smithi084 ceph-mon[37565]: pgmap v14: 121 pgs: 121 active+clean; 146 MiB data, 976 MiB used, 714 GiB / 715 GiB avail; 53 KiB/s rd, 2.8 MiB/s wr, 37 op/s 2024-03-30T12:24:54.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:53 smithi084 ceph-mon[37565]: osdmap e226: 8 total, 8 up, 8 in 2024-03-30T12:24:54.628 INFO:tasks.rados.rados.0.smithi084.stdout:816: done (2 left) 2024-03-30T12:24:54.628 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 84 2024-03-30T12:24:54.628 INFO:tasks.rados.rados.0.smithi084.stdout:817: seq_num 269 ranges {2760704=507904,3268608=630784,3899392=557056,4456448=417792} 2024-03-30T12:24:54.648 INFO:tasks.rados.rados.0.smithi084.stdout:817: writing smithi08477944-17 from 2760704 to 3268608 tid 1 2024-03-30T12:24:54.653 INFO:tasks.rados.rados.0.smithi084.stdout:817: writing smithi08477944-17 from 3268608 to 3899392 tid 2 2024-03-30T12:24:54.656 INFO:tasks.rados.rados.0.smithi084.stdout:817: writing smithi08477944-17 from 3899392 to 4456448 tid 3 2024-03-30T12:24:54.659 INFO:tasks.rados.rados.0.smithi084.stdout:817: writing smithi08477944-17 from 4456448 to 4874240 tid 4 2024-03-30T12:24:54.659 INFO:tasks.rados.rados.0.smithi084.stdout:815: finishing copy_from racing read to smithi08477944-20 2024-03-30T12:24:54.660 INFO:tasks.rados.rados.0.smithi084.stdout:815: finishing copy_from to smithi08477944-20 2024-03-30T12:24:54.660 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 255 (ObjNum 170 snap 46 seq_num 170) dirty exists 2024-03-30T12:24:54.660 INFO:tasks.rados.rados.0.smithi084.stdout:814: expect (ObjNum 107 snap 22 seq_num 107) 2024-03-30T12:24:54.712 INFO:tasks.rados.rados.0.smithi084.stdout:817: finishing write tid 1 to smithi08477944-17 2024-03-30T12:24:54.712 INFO:tasks.rados.rados.0.smithi084.stdout:817: finishing write tid 2 to smithi08477944-17 2024-03-30T12:24:54.712 INFO:tasks.rados.rados.0.smithi084.stdout:817: finishing write tid 3 to smithi08477944-17 2024-03-30T12:24:54.712 INFO:tasks.rados.rados.0.smithi084.stdout:817: finishing write tid 4 to smithi08477944-17 2024-03-30T12:24:54.712 INFO:tasks.rados.rados.0.smithi084.stdout:814: done (2 left) 2024-03-30T12:24:54.712 INFO:tasks.rados.rados.0.smithi084.stdout:815: done (1 left) 2024-03-30T12:24:54.712 INFO:tasks.rados.rados.0.smithi084.stdout:818: delete oid 31 current snap is 84 2024-03-30T12:24:54.712 INFO:tasks.rados.rados.0.smithi084.stdout:817: finishing write tid 5 to smithi08477944-17 2024-03-30T12:24:54.712 INFO:tasks.rados.rados.0.smithi084.stdout:817: finishing write tid 6 to smithi08477944-17 2024-03-30T12:24:54.712 INFO:tasks.rados.rados.0.smithi084.stdout:817: oid 17 updating version 0 to 395 2024-03-30T12:24:54.712 INFO:tasks.rados.rados.0.smithi084.stdout:817: oid 17 version 395 is already newer than 394 2024-03-30T12:24:54.713 INFO:tasks.rados.rados.0.smithi084.stdout:817: oid 17 version 395 is already newer than 393 2024-03-30T12:24:54.713 INFO:tasks.rados.rados.0.smithi084.stdout:817: oid 17 updating version 395 to 396 2024-03-30T12:24:54.713 INFO:tasks.rados.rados.0.smithi084.stdout:817: oid 17 version 396 is already newer than 392 2024-03-30T12:24:54.713 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 396 (ObjNum 269 snap 84 seq_num 269) dirty exists 2024-03-30T12:24:54.713 INFO:tasks.rados.rados.0.smithi084.stdout:817: left oid 17 (ObjNum 269 snap 84 seq_num 269) 2024-03-30T12:24:54.713 INFO:tasks.rados.rados.0.smithi084.stdout:817: done (1 left) 2024-03-30T12:24:54.713 INFO:tasks.rados.rados.0.smithi084.stdout:818: done (0 left) 2024-03-30T12:24:54.713 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 84 2024-03-30T12:24:54.714 INFO:tasks.rados.rados.0.smithi084.stdout:819: seq_num 271 ranges {2170880=540672,2711552=802816,3514368=516096,4030464=286720} 2024-03-30T12:24:54.728 INFO:tasks.rados.rados.0.smithi084.stdout:819: writing smithi08477944-41 from 2170880 to 2711552 tid 1 2024-03-30T12:24:54.732 INFO:tasks.rados.rados.0.smithi084.stdout:819: writing smithi08477944-41 from 2711552 to 3514368 tid 2 2024-03-30T12:24:54.735 INFO:tasks.rados.rados.0.smithi084.stdout:819: writing smithi08477944-41 from 3514368 to 4030464 tid 3 2024-03-30T12:24:54.737 INFO:tasks.rados.rados.0.smithi084.stdout:819: writing smithi08477944-41 from 4030464 to 4317184 tid 4 2024-03-30T12:24:54.737 INFO:tasks.rados.rados.0.smithi084.stdout:820: rollback oid 47 current snap is 84 2024-03-30T12:24:54.737 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 80 2024-03-30T12:24:54.737 INFO:tasks.rados.rados.0.smithi084.stdout:819: finishing write tid 1 to smithi08477944-41 2024-03-30T12:24:54.737 INFO:tasks.rados.rados.0.smithi084.stdout:819: finishing write tid 2 to smithi08477944-41 2024-03-30T12:24:54.737 INFO:tasks.rados.rados.0.smithi084.stdout:821: snap_create 2024-03-30T12:24:54.739 INFO:tasks.rados.rados.0.smithi084.stdout:819: finishing write tid 3 to smithi08477944-41 2024-03-30T12:24:54.739 INFO:tasks.rados.rados.0.smithi084.stdout:819: finishing write tid 4 to smithi08477944-41 2024-03-30T12:24:54.740 INFO:tasks.rados.rados.0.smithi084.stdout:819: finishing write tid 5 to smithi08477944-41 2024-03-30T12:24:54.740 INFO:tasks.rados.rados.0.smithi084.stdout:820: finishing rollback tid 0 to smithi08477944-47 2024-03-30T12:24:54.740 INFO:tasks.rados.rados.0.smithi084.stdout:820: finishing rollback tid 1 to smithi08477944-47 2024-03-30T12:24:54.741 INFO:tasks.rados.rados.0.smithi084.stdout:819: finishing write tid 6 to smithi08477944-41 2024-03-30T12:24:54.741 INFO:tasks.rados.rados.0.smithi084.stdout:819: oid 41 updating version 0 to 486 2024-03-30T12:24:54.741 INFO:tasks.rados.rados.0.smithi084.stdout:819: oid 41 version 486 is already newer than 483 2024-03-30T12:24:54.741 INFO:tasks.rados.rados.0.smithi084.stdout:819: oid 41 version 486 is already newer than 485 2024-03-30T12:24:54.741 INFO:tasks.rados.rados.0.smithi084.stdout:819: oid 41 updating version 486 to 487 2024-03-30T12:24:54.741 INFO:tasks.rados.rados.0.smithi084.stdout:819: oid 41 version 487 is already newer than 484 2024-03-30T12:24:54.741 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 487 (ObjNum 271 snap 84 seq_num 271) dirty exists 2024-03-30T12:24:54.741 INFO:tasks.rados.rados.0.smithi084.stdout:819: left oid 41 (ObjNum 271 snap 84 seq_num 271) 2024-03-30T12:24:54.741 INFO:tasks.rados.rados.0.smithi084.stdout:820: finishing rollback tid 2 to smithi08477944-47 2024-03-30T12:24:54.742 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 528 (ObjNum 253 snap 77 seq_num 253) dirty exists 2024-03-30T12:24:55.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:54 smithi084 ceph-mon[89279]: osdmap e227: 8 total, 8 up, 8 in 2024-03-30T12:24:55.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:54 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:55.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:54 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:55.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:54 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:24:55.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:54 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:24:55.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:54 smithi084 ceph-mon[89279]: osdmap e228: 8 total, 8 up, 8 in 2024-03-30T12:24:55.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:54 smithi084 ceph-mon[37565]: osdmap e227: 8 total, 8 up, 8 in 2024-03-30T12:24:55.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:54 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:55.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:54 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:55.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:54 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:24:55.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:54 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:24:55.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:54 smithi084 ceph-mon[37565]: osdmap e228: 8 total, 8 up, 8 in 2024-03-30T12:24:55.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:54 smithi162 ceph-mon[30421]: osdmap e227: 8 total, 8 up, 8 in 2024-03-30T12:24:55.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:54 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:55.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:54 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:55.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:54 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:24:55.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:54 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:24:55.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:54 smithi162 ceph-mon[30421]: osdmap e228: 8 total, 8 up, 8 in 2024-03-30T12:24:55.658 INFO:tasks.rados.rados.0.smithi084.stdout:819: done (2 left) 2024-03-30T12:24:55.658 INFO:tasks.rados.rados.0.smithi084.stdout:820: done (1 left) 2024-03-30T12:24:55.658 INFO:tasks.rados.rados.0.smithi084.stdout:821: done (0 left) 2024-03-30T12:24:55.658 INFO:tasks.rados.rados.0.smithi084.stdout:822: rmattr oid 32 current snap is 85 2024-03-30T12:24:55.658 INFO:tasks.rados.rados.0.smithi084.stdout:822: done (0 left) 2024-03-30T12:24:55.658 INFO:tasks.rados.rados.0.smithi084.stdout:823: read oid 50 snap -1 2024-03-30T12:24:55.658 INFO:tasks.rados.rados.0.smithi084.stdout:823: expect (ObjNum 267 snap 84 seq_num 267) 2024-03-30T12:24:55.658 INFO:tasks.rados.rados.0.smithi084.stdout:824: snap_create 2024-03-30T12:24:55.674 INFO:tasks.rados.rados.0.smithi084.stdout:823: expect (ObjNum 267 snap 84 seq_num 267) 2024-03-30T12:24:56.002 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: Updating smithi084:/etc/ceph/ceph.conf 2024-03-30T12:24:56.002 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: Updating smithi162:/etc/ceph/ceph.conf 2024-03-30T12:24:56.002 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:24:56.002 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:24:56.002 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:24:56.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:24:56.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: pgmap v17: 121 pgs: 121 active+clean; 146 MiB data, 976 MiB used, 714 GiB / 715 GiB avail; 53 KiB/s rd, 2.8 MiB/s wr, 37 op/s 2024-03-30T12:24:56.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:24:56.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:56.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:24:56.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:56.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:56.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:56.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:56.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:56.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:56.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:56.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:56.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:56.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:24:56.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:24:56.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:56.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:56.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:56.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:24:56.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:24:56.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:56.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:56.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: Updating smithi084:/etc/ceph/ceph.conf 2024-03-30T12:24:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: Updating smithi162:/etc/ceph/ceph.conf 2024-03-30T12:24:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:24:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:24:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:24:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:24:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: pgmap v17: 121 pgs: 121 active+clean; 146 MiB data, 976 MiB used, 714 GiB / 715 GiB avail; 53 KiB/s rd, 2.8 MiB/s wr, 37 op/s 2024-03-30T12:24:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:24:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:24:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:56.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:56.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:56.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:56.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:56.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:56.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:56.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:24:56.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:24:56.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:56.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:56.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:56.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:24:56.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:24:56.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:56.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:56.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:56.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:24:56.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:24:56.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:56.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:56.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:56.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:56.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:56.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:56.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:56.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:56.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:56.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:24:56.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-30T12:24:56.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-03-30T12:24:56.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:24:56.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:24:56.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:56.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:56.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:56.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:56.009 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:56.009 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:56.009 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:56.009 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:56.009 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:56.009 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:24:56.009 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-30T12:24:56.009 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:55 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-03-30T12:24:56.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: Updating smithi084:/etc/ceph/ceph.conf 2024-03-30T12:24:56.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: Updating smithi162:/etc/ceph/ceph.conf 2024-03-30T12:24:56.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:24:56.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T12:24:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:24:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-03-30T12:24:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: pgmap v17: 121 pgs: 121 active+clean; 146 MiB data, 976 MiB used, 714 GiB / 715 GiB avail; 53 KiB/s rd, 2.8 MiB/s wr, 37 op/s 2024-03-30T12:24:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: Updating smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:24:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config-key dump", "format": "json"}]: dispatch 2024-03-30T12:24:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:56.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:56.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:56.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:24:56.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:24:56.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:56.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:56.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:56.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:24:56.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:24:56.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:56.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:56.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:56.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd='heap' args=[stats]: dispatch 2024-03-30T12:24:56.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='admin socket' entity='admin socket' cmd=heap args=[stats]: finished 2024-03-30T12:24:56.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:24:56.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:24:56.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:24:56.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:56.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:56.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:56.124 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:56.124 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:56.124 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:24:56.124 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:24:56.124 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-30T12:24:56.124 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:55 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-03-30T12:24:56.670 INFO:tasks.rados.rados.0.smithi084.stdout:823: done (1 left) 2024-03-30T12:24:56.670 INFO:tasks.rados.rados.0.smithi084.stdout:824: done (0 left) 2024-03-30T12:24:56.670 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 86 2024-03-30T12:24:56.670 INFO:tasks.rados.rados.0.smithi084.stdout:825: seq_num 272 ranges {2932736=565248,3497984=688128,4186112=729088,4915200=188416} 2024-03-30T12:24:56.689 INFO:tasks.rados.rados.0.smithi084.stdout:825: writing smithi08477944-49 from 2932736 to 3497984 tid 1 2024-03-30T12:24:56.694 INFO:tasks.rados.rados.0.smithi084.stdout:825: writing smithi08477944-49 from 3497984 to 4186112 tid 2 2024-03-30T12:24:56.697 INFO:tasks.rados.rados.0.smithi084.stdout:825: writing smithi08477944-49 from 4186112 to 4915200 tid 3 2024-03-30T12:24:56.699 INFO:tasks.rados.rados.0.smithi084.stdout:825: writing smithi08477944-49 from 4915200 to 5103616 tid 4 2024-03-30T12:24:56.699 INFO:tasks.rados.rados.0.smithi084.stdout:826: rmattr oid 3 current snap is 86 2024-03-30T12:24:56.699 INFO:tasks.rados.rados.0.smithi084.stdout:826: done (1 left) 2024-03-30T12:24:56.699 INFO:tasks.rados.rados.0.smithi084.stdout:827: setattr oid 14 current snap is 86 2024-03-30T12:24:56.699 INFO:tasks.rados.rados.0.smithi084.stdout:825: finishing write tid 1 to smithi08477944-49 2024-03-30T12:24:56.699 INFO:tasks.rados.rados.0.smithi084.stdout:825: finishing write tid 2 to smithi08477944-49 2024-03-30T12:24:56.701 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 86 2024-03-30T12:24:56.701 INFO:tasks.rados.rados.0.smithi084.stdout:828: seq_num 273 ranges {0=581632,581632=565248,1146880=532480,1679360=507904} 2024-03-30T12:24:56.705 INFO:tasks.rados.rados.0.smithi084.stdout:828: writing smithi08477944-26 from 0 to 581632 tid 1 2024-03-30T12:24:56.708 INFO:tasks.rados.rados.0.smithi084.stdout:828: writing smithi08477944-26 from 581632 to 1146880 tid 2 2024-03-30T12:24:56.711 INFO:tasks.rados.rados.0.smithi084.stdout:828: writing smithi08477944-26 from 1146880 to 1679360 tid 3 2024-03-30T12:24:56.715 INFO:tasks.rados.rados.0.smithi084.stdout:828: writing smithi08477944-26 from 1679360 to 2187264 tid 4 2024-03-30T12:24:56.715 INFO:tasks.rados.rados.0.smithi084.stdout:829: delete oid 30 current snap is 86 2024-03-30T12:24:56.715 INFO:tasks.rados.rados.0.smithi084.stdout:825: finishing write tid 3 to smithi08477944-49 2024-03-30T12:24:56.716 INFO:tasks.rados.rados.0.smithi084.stdout:825: finishing write tid 4 to smithi08477944-49 2024-03-30T12:24:56.716 INFO:tasks.rados.rados.0.smithi084.stdout:825: finishing write tid 5 to smithi08477944-49 2024-03-30T12:24:56.716 INFO:tasks.rados.rados.0.smithi084.stdout:825: finishing write tid 6 to smithi08477944-49 2024-03-30T12:24:56.716 INFO:tasks.rados.rados.0.smithi084.stdout:825: oid 49 updating version 0 to 328 2024-03-30T12:24:56.716 INFO:tasks.rados.rados.0.smithi084.stdout:825: oid 49 version 328 is already newer than 326 2024-03-30T12:24:56.716 INFO:tasks.rados.rados.0.smithi084.stdout:825: oid 49 updating version 328 to 330 2024-03-30T12:24:56.716 INFO:tasks.rados.rados.0.smithi084.stdout:825: oid 49 version 330 is already newer than 327 2024-03-30T12:24:56.716 INFO:tasks.rados.rados.0.smithi084.stdout:825: oid 49 version 330 is already newer than 329 2024-03-30T12:24:56.716 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 330 (ObjNum 272 snap 86 seq_num 272) dirty exists 2024-03-30T12:24:56.716 INFO:tasks.rados.rados.0.smithi084.stdout:825: left oid 49 (ObjNum 272 snap 86 seq_num 272) 2024-03-30T12:24:56.716 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 337 (ObjNum 211 snap 62 seq_num 211) dirty exists 2024-03-30T12:24:56.716 INFO:tasks.rados.rados.0.smithi084.stdout:828: finishing write tid 1 to smithi08477944-26 2024-03-30T12:24:56.716 INFO:tasks.rados.rados.0.smithi084.stdout:828: finishing write tid 2 to smithi08477944-26 2024-03-30T12:24:56.716 INFO:tasks.rados.rados.0.smithi084.stdout:828: finishing write tid 3 to smithi08477944-26 2024-03-30T12:24:56.718 INFO:tasks.rados.rados.0.smithi084.stdout:828: finishing write tid 4 to smithi08477944-26 2024-03-30T12:24:56.718 INFO:tasks.rados.rados.0.smithi084.stdout:828: finishing write tid 5 to smithi08477944-26 2024-03-30T12:24:56.720 INFO:tasks.rados.rados.0.smithi084.stdout:825: done (3 left) 2024-03-30T12:24:56.720 INFO:tasks.rados.rados.0.smithi084.stdout:827: done (2 left) 2024-03-30T12:24:56.720 INFO:tasks.rados.rados.0.smithi084.stdout:829: done (1 left) 2024-03-30T12:24:56.720 INFO:tasks.rados.rados.0.smithi084.stdout:830: read oid 5 snap -1 2024-03-30T12:24:56.720 INFO:tasks.rados.rados.0.smithi084.stdout:830: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:24:56.720 INFO:tasks.rados.rados.0.smithi084.stdout:831: read oid 38 snap -1 2024-03-30T12:24:56.720 INFO:tasks.rados.rados.0.smithi084.stdout:831: expect (ObjNum 244 snap 75 seq_num 244) 2024-03-30T12:24:56.720 INFO:tasks.rados.rados.0.smithi084.stdout:832: snap_create 2024-03-30T12:24:56.721 INFO:tasks.rados.rados.0.smithi084.stdout:828: finishing write tid 6 to smithi08477944-26 2024-03-30T12:24:56.721 INFO:tasks.rados.rados.0.smithi084.stdout:828: oid 26 updating version 0 to 412 2024-03-30T12:24:56.721 INFO:tasks.rados.rados.0.smithi084.stdout:828: oid 26 updating version 412 to 415 2024-03-30T12:24:56.721 INFO:tasks.rados.rados.0.smithi084.stdout:828: oid 26 version 415 is already newer than 414 2024-03-30T12:24:56.721 INFO:tasks.rados.rados.0.smithi084.stdout:828: oid 26 version 415 is already newer than 411 2024-03-30T12:24:56.721 INFO:tasks.rados.rados.0.smithi084.stdout:828: oid 26 version 415 is already newer than 413 2024-03-30T12:24:56.721 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 415 (ObjNum 273 snap 86 seq_num 273) dirty exists 2024-03-30T12:24:56.721 INFO:tasks.rados.rados.0.smithi084.stdout:828: left oid 26 (ObjNum 273 snap 86 seq_num 273) 2024-03-30T12:24:56.723 INFO:tasks.rados.rados.0.smithi084.stdout:830: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:24:56.726 INFO:tasks.rados.rados.0.smithi084.stdout:831: expect (ObjNum 244 snap 75 seq_num 244) 2024-03-30T12:24:57.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:56 smithi084 ceph-mon[37565]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:24:57.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:56 smithi084 ceph-mon[37565]: Upgrade: It appears safe to stop mon.c 2024-03-30T12:24:57.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:56 smithi084 ceph-mon[37565]: osdmap e229: 8 total, 8 up, 8 in 2024-03-30T12:24:57.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:56 smithi084 ceph-mon[89279]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:24:57.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:56 smithi084 ceph-mon[89279]: Upgrade: It appears safe to stop mon.c 2024-03-30T12:24:57.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:56 smithi084 ceph-mon[89279]: osdmap e229: 8 total, 8 up, 8 in 2024-03-30T12:24:57.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:56 smithi162 ceph-mon[30421]: Updating smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T12:24:57.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:56 smithi162 ceph-mon[30421]: Upgrade: It appears safe to stop mon.c 2024-03-30T12:24:57.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:56 smithi162 ceph-mon[30421]: osdmap e229: 8 total, 8 up, 8 in 2024-03-30T12:24:57.703 INFO:tasks.rados.rados.0.smithi084.stdout:828: done (3 left) 2024-03-30T12:24:57.703 INFO:tasks.rados.rados.0.smithi084.stdout:830: done (2 left) 2024-03-30T12:24:57.703 INFO:tasks.rados.rados.0.smithi084.stdout:831: done (1 left) 2024-03-30T12:24:57.704 INFO:tasks.rados.rados.0.smithi084.stdout:832: done (0 left) 2024-03-30T12:24:57.704 INFO:tasks.rados.rados.0.smithi084.stdout:833: copy_from oid 44 from oid 47 current snap is 87 2024-03-30T12:24:57.704 INFO:tasks.rados.rados.0.smithi084.stdout:834: copy_from oid 18 from oid 21 current snap is 87 2024-03-30T12:24:57.704 INFO:tasks.rados.rados.0.smithi084.stdout:835: snap_create 2024-03-30T12:24:57.707 INFO:tasks.rados.rados.0.smithi084.stdout:834: finishing copy_from racing read to smithi08477944-18 2024-03-30T12:24:57.710 INFO:tasks.rados.rados.0.smithi084.stdout:834: finishing copy_from to smithi08477944-18 2024-03-30T12:24:57.710 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 407 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:24:57.728 INFO:tasks.rados.rados.0.smithi084.stdout:833: finishing copy_from racing read to smithi08477944-44 2024-03-30T12:24:57.732 INFO:tasks.rados.rados.0.smithi084.stdout:833: finishing copy_from to smithi08477944-44 2024-03-30T12:24:57.732 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 528 (ObjNum 253 snap 77 seq_num 253) dirty exists 2024-03-30T12:24:57.902 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:57 smithi084 ceph-mon[89279]: pgmap v20: 121 pgs: 121 active+clean; 151 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.2 MiB/s wr, 29 op/s 2024-03-30T12:24:57.902 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:57 smithi084 ceph-mon[89279]: osdmap e230: 8 total, 8 up, 8 in 2024-03-30T12:24:57.902 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:57 smithi084 ceph-mon[89279]: mgrmap e41: y(active, since 12s), standbys: x 2024-03-30T12:24:57.902 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:57 smithi084 ceph-mon[89279]: Upgrade: Updating mon.c 2024-03-30T12:24:57.902 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:57.902 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:24:57.903 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:24:57.903 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:24:57.903 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:57 smithi084 ceph-mon[89279]: Deploying daemon mon.c on smithi084 2024-03-30T12:24:57.903 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:57 smithi084 ceph-mon[37565]: pgmap v20: 121 pgs: 121 active+clean; 151 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.2 MiB/s wr, 29 op/s 2024-03-30T12:24:57.903 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:57 smithi084 ceph-mon[37565]: osdmap e230: 8 total, 8 up, 8 in 2024-03-30T12:24:57.903 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:57 smithi084 ceph-mon[37565]: mgrmap e41: y(active, since 12s), standbys: x 2024-03-30T12:24:57.903 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:57 smithi084 ceph-mon[37565]: Upgrade: Updating mon.c 2024-03-30T12:24:57.903 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:57 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:57.903 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:57 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:24:57.903 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:57 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:24:57.903 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:57 smithi084 ceph-mon[37565]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:24:57.903 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:57 smithi084 ceph-mon[37565]: Deploying daemon mon.c on smithi084 2024-03-30T12:24:58.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:57 smithi162 ceph-mon[30421]: pgmap v20: 121 pgs: 121 active+clean; 151 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.2 MiB/s wr, 29 op/s 2024-03-30T12:24:58.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:57 smithi162 ceph-mon[30421]: osdmap e230: 8 total, 8 up, 8 in 2024-03-30T12:24:58.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:57 smithi162 ceph-mon[30421]: mgrmap e41: y(active, since 12s), standbys: x 2024-03-30T12:24:58.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:57 smithi162 ceph-mon[30421]: Upgrade: Updating mon.c 2024-03-30T12:24:58.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:57 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:24:58.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:57 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:24:58.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:57 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:24:58.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:57 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:24:58.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:57 smithi162 ceph-mon[30421]: Deploying daemon mon.c on smithi084 2024-03-30T12:24:58.709 INFO:tasks.rados.rados.0.smithi084.stdout:833: done (2 left) 2024-03-30T12:24:58.709 INFO:tasks.rados.rados.0.smithi084.stdout:834: done (1 left) 2024-03-30T12:24:58.709 INFO:tasks.rados.rados.0.smithi084.stdout:835: done (0 left) 2024-03-30T12:24:58.709 INFO:tasks.rados.rados.0.smithi084.stdout:836: read oid 16 snap 86 2024-03-30T12:24:58.709 INFO:tasks.rados.rados.0.smithi084.stdout:836: expect deleted 2024-03-30T12:24:58.710 INFO:tasks.rados.rados.0.smithi084.stdout:837: setattr oid 20 current snap is 88 2024-03-30T12:24:58.710 INFO:tasks.rados.rados.0.smithi084.stdout:836: done (1 left) 2024-03-30T12:24:58.710 INFO:tasks.rados.rados.0.smithi084.stdout:838: copy_from oid 11 from oid 22 current snap is 88 2024-03-30T12:24:58.710 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 88 2024-03-30T12:24:58.710 INFO:tasks.rados.rados.0.smithi084.stdout:839: seq_num 275 ranges {4874240=614400,5488640=786432,6275072=499712,6774784=319488} 2024-03-30T12:24:58.741 INFO:tasks.rados.rados.0.smithi084.stdout:839: writing smithi08477944-17 from 4874240 to 5488640 tid 1 2024-03-30T12:24:58.745 INFO:tasks.rados.rados.0.smithi084.stdout:839: writing smithi08477944-17 from 5488640 to 6275072 tid 2 2024-03-30T12:24:58.748 INFO:tasks.rados.rados.0.smithi084.stdout:839: writing smithi08477944-17 from 6275072 to 6774784 tid 3 2024-03-30T12:24:58.751 INFO:tasks.rados.rados.0.smithi084.stdout:839: writing smithi08477944-17 from 6774784 to 7094272 tid 4 2024-03-30T12:24:58.751 INFO:tasks.rados.rados.0.smithi084.stdout:840: setattr oid 29 current snap is 88 2024-03-30T12:24:58.751 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 530 (ObjNum 170 snap 46 seq_num 170) dirty exists 2024-03-30T12:24:58.751 INFO:tasks.rados.rados.0.smithi084.stdout:838: finishing copy_from racing read to smithi08477944-11 2024-03-30T12:24:58.751 INFO:tasks.rados.rados.0.smithi084.stdout:838: finishing copy_from to smithi08477944-11 2024-03-30T12:24:58.751 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 385 (ObjNum 260 snap 80 seq_num 260) dirty exists 2024-03-30T12:24:58.753 INFO:tasks.rados.rados.0.smithi084.stdout:839: finishing write tid 1 to smithi08477944-17 2024-03-30T12:24:58.753 INFO:tasks.rados.rados.0.smithi084.stdout:839: finishing write tid 2 to smithi08477944-17 2024-03-30T12:24:58.754 INFO:tasks.rados.rados.0.smithi084.stdout:839: finishing write tid 3 to smithi08477944-17 2024-03-30T12:24:58.754 INFO:tasks.rados.rados.0.smithi084.stdout:839: finishing write tid 4 to smithi08477944-17 2024-03-30T12:24:58.754 INFO:tasks.rados.rados.0.smithi084.stdout:839: finishing write tid 5 to smithi08477944-17 2024-03-30T12:24:58.755 INFO:tasks.rados.rados.0.smithi084.stdout:839: finishing write tid 6 to smithi08477944-17 2024-03-30T12:24:58.755 INFO:tasks.rados.rados.0.smithi084.stdout:839: oid 17 updating version 0 to 401 2024-03-30T12:24:58.755 INFO:tasks.rados.rados.0.smithi084.stdout:839: oid 17 version 401 is already newer than 399 2024-03-30T12:24:58.755 INFO:tasks.rados.rados.0.smithi084.stdout:839: oid 17 version 401 is already newer than 400 2024-03-30T12:24:58.755 INFO:tasks.rados.rados.0.smithi084.stdout:839: oid 17 version 401 is already newer than 398 2024-03-30T12:24:58.756 INFO:tasks.rados.rados.0.smithi084.stdout:839: oid 17 version 401 is already newer than 397 2024-03-30T12:24:58.756 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 401 (ObjNum 275 snap 88 seq_num 275) dirty exists 2024-03-30T12:24:58.756 INFO:tasks.rados.rados.0.smithi084.stdout:839: left oid 17 (ObjNum 275 snap 88 seq_num 275) 2024-03-30T12:24:58.756 INFO:tasks.rados.rados.0.smithi084.stdout:837: done (3 left) 2024-03-30T12:24:58.756 INFO:tasks.rados.rados.0.smithi084.stdout:838: done (2 left) 2024-03-30T12:24:58.756 INFO:tasks.rados.rados.0.smithi084.stdout:839: done (1 left) 2024-03-30T12:24:58.756 INFO:tasks.rados.rados.0.smithi084.stdout:841: snap_create 2024-03-30T12:24:58.757 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 316 (ObjNum 142 snap 36 seq_num 142) dirty exists 2024-03-30T12:24:58.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:58 smithi084 systemd[1]: Stopping Ceph mon.c for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:24:58.933 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:58 smithi084 ceph-mon[37565]: osdmap e231: 8 total, 8 up, 8 in 2024-03-30T12:24:58.934 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:24:58 smithi084 ceph-mon[89279]: osdmap e231: 8 total, 8 up, 8 in 2024-03-30T12:24:59.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:24:58 smithi162 ceph-mon[30421]: osdmap e231: 8 total, 8 up, 8 in 2024-03-30T12:24:59.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-c[37553]: 2024-03-30T12:24:58.940+0000 7f813f0bb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:24:59.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-c[37553]: 2024-03-30T12:24:58.940+0000 7f813f0bb700 -1 mon.c@2(peon) e3 *** Got Signal Terminated *** 2024-03-30T12:24:59.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:59 smithi084 podman[91648]: 2024-03-30 12:24:59.074115172 +0000 UTC m=+0.231088743 container died 7db3fd996ae688acf3db1e40e93db4a79bc2e21885a0eb4427790cc2900fd312 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, RELEASE=reef-f14b568, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T12:24:59.607 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:24:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:24:59] "GET /metrics HTTP/1.1" 200 33281 "" "Prometheus/2.43.0" 2024-03-30T12:24:59.608 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:59 smithi084 podman[91648]: 2024-03-30 12:24:59.40735451 +0000 UTC m=+0.564328072 container cleanup 7db3fd996ae688acf3db1e40e93db4a79bc2e21885a0eb4427790cc2900fd312 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-c, org.label-schema.vendor=CentOS, RELEASE=reef-f14b568, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=) 2024-03-30T12:24:59.608 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:59 smithi084 bash[91648]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-c 2024-03-30T12:25:00.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:59 smithi084 podman[91662]: 2024-03-30 12:24:59.617041949 +0000 UTC m=+0.542117235 container remove 7db3fd996ae688acf3db1e40e93db4a79bc2e21885a0eb4427790cc2900fd312 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-c, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=reef-f14b568, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-03-30T12:25:00.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:59 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mon.c.service: Deactivated successfully. 2024-03-30T12:25:00.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:59 smithi084 systemd[1]: Stopped Ceph mon.c for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:25:00.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:24:59 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mon.c.service: Consumed 7.937s CPU time. 2024-03-30T12:25:00.325 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 systemd[1]: Starting Ceph mon.c for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:25:00.326 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 podman[91791]: 2024-03-30 12:25:00.243312182 +0000 UTC m=+0.112446028 container create f79eca93cddd9abe90ae55c3022e5d05a733f3e02d80e1b088a09f3c6b20ae85 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-c, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-03-30T12:25:00.326 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 podman[91791]: 2024-03-30 12:25:00.148637229 +0000 UTC m=+0.017771069 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:25:00.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 podman[91791]: 2024-03-30 12:25:00.454132541 +0000 UTC m=+0.323266392 container init f79eca93cddd9abe90ae55c3022e5d05a733f3e02d80e1b088a09f3c6b20ae85 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-c, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3) 2024-03-30T12:25:00.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 podman[91791]: 2024-03-30 12:25:00.45754023 +0000 UTC m=+0.326674071 container start f79eca93cddd9abe90ae55c3022e5d05a733f3e02d80e1b088a09f3c6b20ae85 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-c, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.build-date=20240326, ceph=True, org.label-schema.license=GPLv2) 2024-03-30T12:25:00.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: set uid:gid to 167:167 (ceph:ceph) 2024-03-30T12:25:00.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev), process ceph-mon, pid 2 2024-03-30T12:25:00.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: pidfile_write: ignore empty --pid-file 2024-03-30T12:25:00.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: load: jerasure load: lrc 2024-03-30T12:25:00.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: RocksDB version: 7.9.2 2024-03-30T12:25:00.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Git sha 0 2024-03-30T12:25:00.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Compile date 2024-03-29 20:54:14 2024-03-30T12:25:00.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: DB SUMMARY 2024-03-30T12:25:00.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: DB Session ID: GXXGGMOCO2JPIPK9LTMD 2024-03-30T12:25:00.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: CURRENT file: CURRENT 2024-03-30T12:25:00.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: IDENTITY file: IDENTITY 2024-03-30T12:25:00.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1405 Bytes 2024-03-30T12:25:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 1, files: 000027.sst 2024-03-30T12:25:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000025.log size: 9889844 ; 2024-03-30T12:25:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.error_if_exists: 0 2024-03-30T12:25:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.create_if_missing: 0 2024-03-30T12:25:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.paranoid_checks: 1 2024-03-30T12:25:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-30T12:25:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-30T12:25:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-30T12:25:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.env: 0x55768cb43b20 2024-03-30T12:25:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.fs: PosixFileSystem 2024-03-30T12:25:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.info_log: 0x55768d9458e0 2024-03-30T12:25:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_file_opening_threads: 16 2024-03-30T12:25:00.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.statistics: (nil) 2024-03-30T12:25:00.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.use_fsync: 0 2024-03-30T12:25:00.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_log_file_size: 0 2024-03-30T12:25:00.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-30T12:25:00.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-30T12:25:00.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.keep_log_file_num: 1000 2024-03-30T12:25:00.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.recycle_log_file_num: 0 2024-03-30T12:25:00.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.allow_fallocate: 1 2024-03-30T12:25:00.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.allow_mmap_reads: 0 2024-03-30T12:25:00.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.allow_mmap_writes: 0 2024-03-30T12:25:00.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.use_direct_reads: 0 2024-03-30T12:25:00.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-30T12:25:00.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.create_missing_column_families: 0 2024-03-30T12:25:00.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.db_log_dir: 2024-03-30T12:25:00.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.wal_dir: 2024-03-30T12:25:00.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-30T12:25:00.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-30T12:25:00.760 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-30T12:25:00.760 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-30T12:25:00.760 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-30T12:25:00.760 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-30T12:25:00.760 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.advise_random_on_open: 1 2024-03-30T12:25:00.760 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.db_write_buffer_size: 0 2024-03-30T12:25:00.760 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.write_buffer_manager: 0x55768d918dc0 2024-03-30T12:25:00.760 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-30T12:25:00.760 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-30T12:25:00.760 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-30T12:25:00.760 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.rate_limiter: (nil) 2024-03-30T12:25:00.760 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-30T12:25:00.760 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.wal_recovery_mode: 2 2024-03-30T12:25:00.761 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.enable_thread_tracking: 0 2024-03-30T12:25:00.761 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.enable_pipelined_write: 0 2024-03-30T12:25:00.761 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.unordered_write: 0 2024-03-30T12:25:00.761 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-30T12:25:00.761 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-30T12:25:00.761 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-30T12:25:00.761 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-30T12:25:00.761 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.row_cache: None 2024-03-30T12:25:00.761 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.wal_filter: None 2024-03-30T12:25:00.761 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-30T12:25:00.761 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.allow_ingest_behind: 0 2024-03-30T12:25:00.761 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.two_write_queues: 0 2024-03-30T12:25:00.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.manual_wal_flush: 0 2024-03-30T12:25:00.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.wal_compression: 0 2024-03-30T12:25:00.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.atomic_flush: 0 2024-03-30T12:25:00.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-30T12:25:00.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-30T12:25:00.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-30T12:25:00.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.log_readahead_size: 0 2024-03-30T12:25:00.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-30T12:25:00.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.best_efforts_recovery: 0 2024-03-30T12:25:00.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-30T12:25:00.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-30T12:25:00.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.allow_data_in_errors: 0 2024-03-30T12:25:00.763 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.db_host_id: __hostname__ 2024-03-30T12:25:00.763 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-30T12:25:00.763 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_background_jobs: 2 2024-03-30T12:25:00.763 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_background_compactions: -1 2024-03-30T12:25:00.763 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_subcompactions: 1 2024-03-30T12:25:00.763 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-30T12:25:00.763 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-30T12:25:00.763 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-30T12:25:00.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_total_wal_size: 0 2024-03-30T12:25:00.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-30T12:25:00.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-30T12:25:00.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-30T12:25:00.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-30T12:25:00.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_open_files: -1 2024-03-30T12:25:00.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.bytes_per_sync: 0 2024-03-30T12:25:00.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-30T12:25:00.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-30T12:25:00.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.compaction_readahead_size: 0 2024-03-30T12:25:00.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_background_flushes: -1 2024-03-30T12:25:00.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Compression algorithms supported: 2024-03-30T12:25:00.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-30T12:25:00.765 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: kZSTD supported: 0 2024-03-30T12:25:00.765 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: kXpressCompression supported: 0 2024-03-30T12:25:00.765 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: kLZ4HCCompression supported: 1 2024-03-30T12:25:00.765 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: kZlibCompression supported: 1 2024-03-30T12:25:00.765 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: kSnappyCompression supported: 1 2024-03-30T12:25:00.765 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: kLZ4Compression supported: 1 2024-03-30T12:25:00.765 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: kBZip2Compression supported: 0 2024-03-30T12:25:00.765 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-30T12:25:00.765 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-30T12:25:00.765 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000010 2024-03-30T12:25:00.765 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-30T12:25:00.765 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-30T12:25:00.765 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.merge_operator: 2024-03-30T12:25:00.766 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.compaction_filter: None 2024-03-30T12:25:00.766 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.compaction_filter_factory: None 2024-03-30T12:25:00.766 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.sst_partitioner_factory: None 2024-03-30T12:25:00.766 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-30T12:25:00.766 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-30T12:25:00.766 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55768d9459e0) 2024-03-30T12:25:00.766 INFO:journalctl@ceph.mon.c.smithi084.stdout: cache_index_and_filter_blocks: 1 2024-03-30T12:25:00.766 INFO:journalctl@ceph.mon.c.smithi084.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-30T12:25:00.766 INFO:journalctl@ceph.mon.c.smithi084.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-30T12:25:00.766 INFO:journalctl@ceph.mon.c.smithi084.stdout: pin_top_level_index_and_filter: 1 2024-03-30T12:25:00.766 INFO:journalctl@ceph.mon.c.smithi084.stdout: index_type: 0 2024-03-30T12:25:00.766 INFO:journalctl@ceph.mon.c.smithi084.stdout: data_block_index_type: 0 2024-03-30T12:25:00.767 INFO:journalctl@ceph.mon.c.smithi084.stdout: index_shortening: 1 2024-03-30T12:25:00.768 INFO:journalctl@ceph.mon.c.smithi084.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-30T12:25:00.768 INFO:journalctl@ceph.mon.c.smithi084.stdout: checksum: 4 2024-03-30T12:25:00.768 INFO:journalctl@ceph.mon.c.smithi084.stdout: no_block_cache: 0 2024-03-30T12:25:00.768 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_cache: 0x55768d94b090 2024-03-30T12:25:00.768 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_cache_name: BinnedLRUCache 2024-03-30T12:25:00.768 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_cache_options: 2024-03-30T12:25:00.768 INFO:journalctl@ceph.mon.c.smithi084.stdout: capacity : 536870912 2024-03-30T12:25:00.768 INFO:journalctl@ceph.mon.c.smithi084.stdout: num_shard_bits : 4 2024-03-30T12:25:00.768 INFO:journalctl@ceph.mon.c.smithi084.stdout: strict_capacity_limit : 0 2024-03-30T12:25:00.768 INFO:journalctl@ceph.mon.c.smithi084.stdout: high_pri_pool_ratio: 0.000 2024-03-30T12:25:00.768 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_cache_compressed: (nil) 2024-03-30T12:25:00.768 INFO:journalctl@ceph.mon.c.smithi084.stdout: persistent_cache: (nil) 2024-03-30T12:25:00.768 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_size: 4096 2024-03-30T12:25:00.769 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_size_deviation: 10 2024-03-30T12:25:00.769 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_restart_interval: 16 2024-03-30T12:25:00.769 INFO:journalctl@ceph.mon.c.smithi084.stdout: index_block_restart_interval: 1 2024-03-30T12:25:00.769 INFO:journalctl@ceph.mon.c.smithi084.stdout: metadata_block_size: 4096 2024-03-30T12:25:00.769 INFO:journalctl@ceph.mon.c.smithi084.stdout: partition_filters: 0 2024-03-30T12:25:00.769 INFO:journalctl@ceph.mon.c.smithi084.stdout: use_delta_encoding: 1 2024-03-30T12:25:00.769 INFO:journalctl@ceph.mon.c.smithi084.stdout: filter_policy: bloomfilter 2024-03-30T12:25:00.769 INFO:journalctl@ceph.mon.c.smithi084.stdout: whole_key_filtering: 1 2024-03-30T12:25:00.769 INFO:journalctl@ceph.mon.c.smithi084.stdout: verify_compression: 0 2024-03-30T12:25:00.769 INFO:journalctl@ceph.mon.c.smithi084.stdout: read_amp_bytes_per_bit: 0 2024-03-30T12:25:00.769 INFO:journalctl@ceph.mon.c.smithi084.stdout: format_version: 5 2024-03-30T12:25:00.769 INFO:journalctl@ceph.mon.c.smithi084.stdout: enable_index_compression: 1 2024-03-30T12:25:00.769 INFO:journalctl@ceph.mon.c.smithi084.stdout: block_align: 0 2024-03-30T12:25:00.769 INFO:journalctl@ceph.mon.c.smithi084.stdout: max_auto_readahead_size: 262144 2024-03-30T12:25:00.769 INFO:journalctl@ceph.mon.c.smithi084.stdout: prepopulate_block_cache: 0 2024-03-30T12:25:00.770 INFO:journalctl@ceph.mon.c.smithi084.stdout: initial_auto_readahead_size: 8192 2024-03-30T12:25:00.770 INFO:journalctl@ceph.mon.c.smithi084.stdout: num_file_reads_for_auto_readahead: 2 2024-03-30T12:25:00.770 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.write_buffer_size: 33554432 2024-03-30T12:25:00.770 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_write_buffer_number: 2 2024-03-30T12:25:00.770 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.compression: NoCompression 2024-03-30T12:25:00.770 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.bottommost_compression: Disabled 2024-03-30T12:25:00.770 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.prefix_extractor: nullptr 2024-03-30T12:25:00.770 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-30T12:25:00.770 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.num_levels: 7 2024-03-30T12:25:00.770 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-30T12:25:00.770 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-30T12:25:00.770 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-30T12:25:00.770 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-30T12:25:00.771 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-30T12:25:00.771 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-30T12:25:00.771 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-30T12:25:00.771 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-30T12:25:00.771 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-30T12:25:00.771 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-30T12:25:00.771 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-30T12:25:00.771 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-30T12:25:00.771 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-30T12:25:00.771 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.compression_opts.level: 32767 2024-03-30T12:25:00.771 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.compression_opts.strategy: 0 2024-03-30T12:25:00.771 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-30T12:25:00.771 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-30T12:25:00.771 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-30T12:25:00.771 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-30T12:25:00.771 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.compression_opts.enabled: false 2024-03-30T12:25:00.772 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-30T12:25:00.772 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-30T12:25:00.772 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-30T12:25:00.772 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-30T12:25:00.772 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.target_file_size_base: 67108864 2024-03-30T12:25:00.772 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-30T12:25:00.772 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-30T12:25:00.772 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-30T12:25:00.772 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-30T12:25:00.772 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-30T12:25:00.773 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-30T12:25:00.773 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-30T12:25:00.773 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-30T12:25:00.773 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-30T12:25:00.773 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-30T12:25:00.773 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-30T12:25:00.773 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-30T12:25:00.773 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-30T12:25:00.773 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-30T12:25:00.773 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.arena_block_size: 1048576 2024-03-30T12:25:00.773 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-30T12:25:00.773 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-30T12:25:00.773 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.disable_auto_compactions: 0 2024-03-30T12:25:00.773 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-30T12:25:00.773 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-30T12:25:00.774 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-30T12:25:00.774 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-30T12:25:00.774 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-30T12:25:00.774 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-30T12:25:00.774 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-30T12:25:00.774 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-30T12:25:00.774 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-30T12:25:00.774 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-30T12:25:00.774 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.table_properties_collectors: 2024-03-30T12:25:00.774 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.inplace_update_support: 0 2024-03-30T12:25:00.774 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-30T12:25:00.774 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-30T12:25:00.774 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-30T12:25:00.774 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-30T12:25:00.775 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.bloom_locality: 0 2024-03-30T12:25:00.775 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.max_successive_merges: 0 2024-03-30T12:25:00.775 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-30T12:25:00.775 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.paranoid_file_checks: 0 2024-03-30T12:25:00.775 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.force_consistency_checks: 1 2024-03-30T12:25:00.775 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.report_bg_io_stats: 0 2024-03-30T12:25:00.775 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.ttl: 2592000 2024-03-30T12:25:00.775 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-30T12:25:00.775 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-30T12:25:00.775 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-30T12:25:00.775 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.enable_blob_files: false 2024-03-30T12:25:00.775 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.min_blob_size: 0 2024-03-30T12:25:00.775 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.blob_file_size: 268435456 2024-03-30T12:25:00.775 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-30T12:25:00.775 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-30T12:25:00.776 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-30T12:25:00.776 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-30T12:25:00.776 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-30T12:25:00.776 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.blob_file_starting_level: 0 2024-03-30T12:25:00.776 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-30T12:25:00.776 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-30T12:25:00.776 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 13499, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-03-30T12:25:00.776 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-03-30T12:25:00.776 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a5921325-f35f-436a-af47-e87239de7656 2024-03-30T12:25:00.776 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711801500487508, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-03-30T12:25:00.776 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-03-30T12:25:00.776 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711801500510159, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 6118180, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 13504, "largest_seqno": 16743, "table_properties": {"data_size": 6103787, "index_size": 9660, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3717, "raw_key_size": 33571, "raw_average_key_size": 22, "raw_value_size": 6073552, "raw_average_value_size": 4145, "num_data_blocks": 420, "num_entries": 1465, "num_filter_entries": 1465, "num_deletions": 288, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711801500, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a5921325-f35f-436a-af47-e87239de7656", "db_session_id": "GXXGGMOCO2JPIPK9LTMD", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-03-30T12:25:00.776 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711801500510279, "job": 1, "event": "recovery_finished"} 2024-03-30T12:25:00.777 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-03-30T12:25:00.777 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-30T12:25:00.777 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-30T12:25:00.777 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55768da3e000 2024-03-30T12:25:00.777 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: DB pointer 0x55768da28000 2024-03-30T12:25:00.777 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-30T12:25:00.777 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-30T12:25:00.777 INFO:journalctl@ceph.mon.c.smithi084.stdout: ** DB Stats ** 2024-03-30T12:25:00.777 INFO:journalctl@ceph.mon.c.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T12:25:00.777 INFO:journalctl@ceph.mon.c.smithi084.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-30T12:25:00.777 INFO:journalctl@ceph.mon.c.smithi084.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T12:25:00.777 INFO:journalctl@ceph.mon.c.smithi084.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T12:25:00.777 INFO:journalctl@ceph.mon.c.smithi084.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-30T12:25:00.777 INFO:journalctl@ceph.mon.c.smithi084.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T12:25:00.777 INFO:journalctl@ceph.mon.c.smithi084.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T12:25:00.778 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-03-30T12:25:00.778 INFO:journalctl@ceph.mon.c.smithi084.stdout: ** Compaction Stats [default] ** 2024-03-30T12:25:00.778 INFO:journalctl@ceph.mon.c.smithi084.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T12:25:00.778 INFO:journalctl@ceph.mon.c.smithi084.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-30T12:25:00.778 INFO:journalctl@ceph.mon.c.smithi084.stdout: L0 1/0 5.83 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 612.4 0.01 0.00 1 0.010 0 0 0.0 0.0 2024-03-30T12:25:00.778 INFO:journalctl@ceph.mon.c.smithi084.stdout: L6 1/0 6.82 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-03-30T12:25:00.778 INFO:journalctl@ceph.mon.c.smithi084.stdout: Sum 2/0 12.65 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 612.4 0.01 0.00 1 0.010 0 0 0.0 0.0 2024-03-30T12:25:00.778 INFO:journalctl@ceph.mon.c.smithi084.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 612.4 0.01 0.00 1 0.010 0 0 0.0 0.0 2024-03-30T12:25:00.778 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-03-30T12:25:00.778 INFO:journalctl@ceph.mon.c.smithi084.stdout: ** Compaction Stats [default] ** 2024-03-30T12:25:00.778 INFO:journalctl@ceph.mon.c.smithi084.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T12:25:00.778 INFO:journalctl@ceph.mon.c.smithi084.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-30T12:25:00.778 INFO:journalctl@ceph.mon.c.smithi084.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 612.4 0.01 0.00 1 0.010 0 0 0.0 0.0 2024-03-30T12:25:00.778 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-03-30T12:25:00.779 INFO:journalctl@ceph.mon.c.smithi084.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-30T12:25:00.779 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-03-30T12:25:00.779 INFO:journalctl@ceph.mon.c.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T12:25:00.779 INFO:journalctl@ceph.mon.c.smithi084.stdout: Flush(GB): cumulative 0.006, interval 0.006 2024-03-30T12:25:00.779 INFO:journalctl@ceph.mon.c.smithi084.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-30T12:25:00.779 INFO:journalctl@ceph.mon.c.smithi084.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-30T12:25:00.779 INFO:journalctl@ceph.mon.c.smithi084.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-30T12:25:00.779 INFO:journalctl@ceph.mon.c.smithi084.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-30T12:25:00.779 INFO:journalctl@ceph.mon.c.smithi084.stdout: Cumulative compaction: 0.01 GB write, 214.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T12:25:00.779 INFO:journalctl@ceph.mon.c.smithi084.stdout: Interval compaction: 0.01 GB write, 214.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T12:25:00.779 INFO:journalctl@ceph.mon.c.smithi084.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-30T12:25:00.779 INFO:journalctl@ceph.mon.c.smithi084.stdout: Block cache BinnedLRUCache@0x55768d94b090#2 capacity: 512.00 MB usage: 14.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-03-30T12:25:00.779 INFO:journalctl@ceph.mon.c.smithi084.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.03 KB,0.0007689%) IndexBlock(1,10.08 KB,0.00192225%) Misc(1,0.00 KB,0%) 2024-03-30T12:25:00.779 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-03-30T12:25:00.779 INFO:journalctl@ceph.mon.c.smithi084.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-30T12:25:00.780 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: starting mon.c rank 2 at public addrs [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] at bind addrs [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:25:00.780 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: mon.c@-1(???) e3 preinit fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:25:00.780 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: mon.c@-1(???).mds e6 new map 2024-03-30T12:25:00.780 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: mon.c@-1(???).mds e6 print_map 2024-03-30T12:25:00.780 INFO:journalctl@ceph.mon.c.smithi084.stdout: e6 2024-03-30T12:25:00.780 INFO:journalctl@ceph.mon.c.smithi084.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-30T12:25:00.780 INFO:journalctl@ceph.mon.c.smithi084.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-30T12:25:00.780 INFO:journalctl@ceph.mon.c.smithi084.stdout: legacy client fscid: 1 2024-03-30T12:25:00.780 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-03-30T12:25:00.780 INFO:journalctl@ceph.mon.c.smithi084.stdout: Filesystem 'cephfs' (1) 2024-03-30T12:25:00.780 INFO:journalctl@ceph.mon.c.smithi084.stdout: fs_name cephfs 2024-03-30T12:25:00.781 INFO:journalctl@ceph.mon.c.smithi084.stdout: epoch 6 2024-03-30T12:25:00.781 INFO:journalctl@ceph.mon.c.smithi084.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-30T12:25:00.781 INFO:journalctl@ceph.mon.c.smithi084.stdout: created 2024-03-30T12:19:00.832494+0000 2024-03-30T12:25:00.781 INFO:journalctl@ceph.mon.c.smithi084.stdout: modified 2024-03-30T12:19:02.842890+0000 2024-03-30T12:25:00.781 INFO:journalctl@ceph.mon.c.smithi084.stdout: tableserver 0 2024-03-30T12:25:00.781 INFO:journalctl@ceph.mon.c.smithi084.stdout: root 0 2024-03-30T12:25:00.781 INFO:journalctl@ceph.mon.c.smithi084.stdout: session_timeout 60 2024-03-30T12:25:00.781 INFO:journalctl@ceph.mon.c.smithi084.stdout: session_autoclose 300 2024-03-30T12:25:00.781 INFO:journalctl@ceph.mon.c.smithi084.stdout: max_file_size 1099511627776 2024-03-30T12:25:00.781 INFO:journalctl@ceph.mon.c.smithi084.stdout: max_xattr_size 65536 2024-03-30T12:25:00.781 INFO:journalctl@ceph.mon.c.smithi084.stdout: required_client_features {} 2024-03-30T12:25:00.781 INFO:journalctl@ceph.mon.c.smithi084.stdout: last_failure 0 2024-03-30T12:25:00.781 INFO:journalctl@ceph.mon.c.smithi084.stdout: last_failure_osd_epoch 0 2024-03-30T12:25:00.781 INFO:journalctl@ceph.mon.c.smithi084.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-30T12:25:00.781 INFO:journalctl@ceph.mon.c.smithi084.stdout: max_mds 1 2024-03-30T12:25:00.782 INFO:journalctl@ceph.mon.c.smithi084.stdout: in 0 2024-03-30T12:25:00.782 INFO:journalctl@ceph.mon.c.smithi084.stdout: up {0=24331} 2024-03-30T12:25:00.782 INFO:journalctl@ceph.mon.c.smithi084.stdout: failed 2024-03-30T12:25:00.782 INFO:journalctl@ceph.mon.c.smithi084.stdout: damaged 2024-03-30T12:25:00.782 INFO:journalctl@ceph.mon.c.smithi084.stdout: stopped 2024-03-30T12:25:00.782 INFO:journalctl@ceph.mon.c.smithi084.stdout: data_pools [3] 2024-03-30T12:25:00.782 INFO:journalctl@ceph.mon.c.smithi084.stdout: metadata_pool 2 2024-03-30T12:25:00.782 INFO:journalctl@ceph.mon.c.smithi084.stdout: inline_data disabled 2024-03-30T12:25:00.782 INFO:journalctl@ceph.mon.c.smithi084.stdout: balancer 2024-03-30T12:25:00.782 INFO:journalctl@ceph.mon.c.smithi084.stdout: bal_rank_mask -1 2024-03-30T12:25:00.782 INFO:journalctl@ceph.mon.c.smithi084.stdout: standby_count_wanted 0 2024-03-30T12:25:00.782 INFO:journalctl@ceph.mon.c.smithi084.stdout: [mds.b{0:24331} state up:active seq 3 addr [v2:172.21.15.162:6832/1272121665,v1:172.21.15.162:6833/1272121665] compat {c=[1],r=[1],i=[7ff]}] 2024-03-30T12:25:00.782 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-03-30T12:25:00.782 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-03-30T12:25:00.782 INFO:journalctl@ceph.mon.c.smithi084.stdout: Standby daemons: 2024-03-30T12:25:00.782 INFO:journalctl@ceph.mon.c.smithi084.stdout: 2024-03-30T12:25:00.783 INFO:journalctl@ceph.mon.c.smithi084.stdout: [mds.a{-1:14448} state up:standby seq 1 addr [v2:172.21.15.84:6834/420740305,v1:172.21.15.84:6835/420740305] compat {c=[1],r=[1],i=[7ff]}] 2024-03-30T12:25:00.783 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: mon.c@-1(???).osd e232 crush map has features 3314933069573799936, adjusting msgr requires 2024-03-30T12:25:00.783 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: mon.c@-1(???).osd e232 crush map has features 432629308056666112, adjusting msgr requires 2024-03-30T12:25:00.783 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: mon.c@-1(???).osd e232 crush map has features 432629308056666112, adjusting msgr requires 2024-03-30T12:25:00.783 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: mon.c@-1(???).osd e232 crush map has features 432629308056666112, adjusting msgr requires 2024-03-30T12:25:00.783 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 ceph-mon[91810]: mon.c@-1(???).paxosservice(auth 1..19) refresh upgraded, format 0 -> 3 2024-03-30T12:25:00.783 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 bash[91791]: f79eca93cddd9abe90ae55c3022e5d05a733f3e02d80e1b088a09f3c6b20ae85 2024-03-30T12:25:00.783 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:00 smithi084 systemd[1]: Started Ceph mon.c for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:25:07.269 INFO:tasks.rados.rados.0.smithi084.stdout:840: done (1 left) 2024-03-30T12:25:07.269 INFO:tasks.rados.rados.0.smithi084.stdout:841: done (0 left) 2024-03-30T12:25:07.269 INFO:tasks.rados.rados.0.smithi084.stdout:842: snap_create 2024-03-30T12:25:07.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:07 smithi162 ceph-mon[30421]: mon.c calling monitor election 2024-03-30T12:25:07.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:07 smithi162 ceph-mon[30421]: pgmap v29: 121 pgs: 121 active+clean; 171 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 12 op/s 2024-03-30T12:25:07.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:07 smithi162 ceph-mon[30421]: mon.a calling monitor election 2024-03-30T12:25:07.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:07 smithi162 ceph-mon[30421]: mon.b calling monitor election 2024-03-30T12:25:07.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:07 smithi162 ceph-mon[30421]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-30T12:25:07.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:07 smithi162 ceph-mon[30421]: monmap e3: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-30T12:25:07.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:07 smithi162 ceph-mon[30421]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-30T12:25:07.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:07 smithi162 ceph-mon[30421]: osdmap e233: 8 total, 8 up, 8 in 2024-03-30T12:25:07.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:07 smithi162 ceph-mon[30421]: mgrmap e41: y(active, since 22s), standbys: x 2024-03-30T12:25:07.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:07 smithi162 ceph-mon[30421]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-03-30T12:25:07.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:07 smithi162 ceph-mon[30421]: Cluster is now healthy 2024-03-30T12:25:07.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:07 smithi162 ceph-mon[30421]: overall HEALTH_OK 2024-03-30T12:25:07.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:07 smithi084 ceph-mon[91810]: mon.c calling monitor election 2024-03-30T12:25:07.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:07 smithi084 ceph-mon[91810]: pgmap v29: 121 pgs: 121 active+clean; 171 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 12 op/s 2024-03-30T12:25:07.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:07 smithi084 ceph-mon[91810]: mon.a calling monitor election 2024-03-30T12:25:07.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:07 smithi084 ceph-mon[91810]: mon.b calling monitor election 2024-03-30T12:25:07.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:07 smithi084 ceph-mon[91810]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-30T12:25:07.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:07 smithi084 ceph-mon[91810]: monmap e3: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-30T12:25:07.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:07 smithi084 ceph-mon[91810]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-30T12:25:07.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:07 smithi084 ceph-mon[91810]: osdmap e233: 8 total, 8 up, 8 in 2024-03-30T12:25:07.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:07 smithi084 ceph-mon[91810]: mgrmap e41: y(active, since 22s), standbys: x 2024-03-30T12:25:07.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:07 smithi084 ceph-mon[91810]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-03-30T12:25:07.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:07 smithi084 ceph-mon[91810]: Cluster is now healthy 2024-03-30T12:25:07.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:07 smithi084 ceph-mon[91810]: overall HEALTH_OK 2024-03-30T12:25:07.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:07 smithi084 ceph-mon[89279]: mon.c calling monitor election 2024-03-30T12:25:07.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:07 smithi084 ceph-mon[89279]: pgmap v29: 121 pgs: 121 active+clean; 171 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 12 op/s 2024-03-30T12:25:07.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:07 smithi084 ceph-mon[89279]: mon.a calling monitor election 2024-03-30T12:25:07.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:07 smithi084 ceph-mon[89279]: mon.b calling monitor election 2024-03-30T12:25:07.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:07 smithi084 ceph-mon[89279]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-30T12:25:07.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:07 smithi084 ceph-mon[89279]: monmap e3: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-30T12:25:07.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:07 smithi084 ceph-mon[89279]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-30T12:25:07.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:07 smithi084 ceph-mon[89279]: osdmap e233: 8 total, 8 up, 8 in 2024-03-30T12:25:07.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:07 smithi084 ceph-mon[89279]: mgrmap e41: y(active, since 22s), standbys: x 2024-03-30T12:25:07.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:07 smithi084 ceph-mon[89279]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-03-30T12:25:07.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:07 smithi084 ceph-mon[89279]: Cluster is now healthy 2024-03-30T12:25:07.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:07 smithi084 ceph-mon[89279]: overall HEALTH_OK 2024-03-30T12:25:08.277 INFO:tasks.rados.rados.0.smithi084.stdout:842: done (0 left) 2024-03-30T12:25:08.277 INFO:tasks.rados.rados.0.smithi084.stdout:843: copy_from oid 10 from oid 16 current snap is 90 2024-03-30T12:25:08.278 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 90 2024-03-30T12:25:08.278 INFO:tasks.rados.rados.0.smithi084.stdout:844: seq_num 276 ranges {0=630784,630784=671744,1302528=704512,2007040=229376} 2024-03-30T12:25:08.281 INFO:tasks.rados.rados.0.smithi084.stdout:844: writing smithi08477944-5 from 0 to 630784 tid 1 2024-03-30T12:25:08.285 INFO:tasks.rados.rados.0.smithi084.stdout:844: writing smithi08477944-5 from 630784 to 1302528 tid 2 2024-03-30T12:25:08.289 INFO:tasks.rados.rados.0.smithi084.stdout:844: writing smithi08477944-5 from 1302528 to 2007040 tid 3 2024-03-30T12:25:08.291 INFO:tasks.rados.rados.0.smithi084.stdout:844: writing smithi08477944-5 from 2007040 to 2236416 tid 4 2024-03-30T12:25:08.291 INFO:tasks.rados.rados.0.smithi084.stdout:845: read oid 23 snap 62 2024-03-30T12:25:08.291 INFO:tasks.rados.rados.0.smithi084.stdout:845: expect (ObjNum 196 snap 55 seq_num 196) 2024-03-30T12:25:08.291 INFO:tasks.rados.rados.0.smithi084.stdout:846: rollback oid 49 current snap is 90 2024-03-30T12:25:08.291 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 49 to 62 2024-03-30T12:25:08.291 INFO:tasks.rados.rados.0.smithi084.stdout:843: finishing copy_from to smithi08477944-10 2024-03-30T12:25:08.291 INFO:tasks.rados.rados.0.smithi084.stdout:843: got expected ENOENT (src dne) 2024-03-30T12:25:08.291 INFO:tasks.rados.rados.0.smithi084.stdout:843: finishing copy_from racing read to smithi08477944-10 2024-03-30T12:25:08.291 INFO:tasks.rados.rados.0.smithi084.stdout:844: finishing write tid 1 to smithi08477944-5 2024-03-30T12:25:08.292 INFO:tasks.rados.rados.0.smithi084.stdout:844: finishing write tid 2 to smithi08477944-5 2024-03-30T12:25:08.292 INFO:tasks.rados.rados.0.smithi084.stdout:843: done (3 left) 2024-03-30T12:25:08.292 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 90 2024-03-30T12:25:08.292 INFO:tasks.rados.rados.0.smithi084.stdout:847: seq_num 277 ranges {2449408=647168,3096576=557056,3653632=516096,4169728=532480} 2024-03-30T12:25:08.309 INFO:tasks.rados.rados.0.smithi084.stdout:847: writing smithi08477944-1 from 2449408 to 3096576 tid 1 2024-03-30T12:25:08.310 INFO:tasks.rados.rados.0.smithi084.stdout:847: writing smithi08477944-1 from 3096576 to 3653632 tid 2 2024-03-30T12:25:08.313 INFO:tasks.rados.rados.0.smithi084.stdout:847: writing smithi08477944-1 from 3653632 to 4169728 tid 3 2024-03-30T12:25:08.317 INFO:tasks.rados.rados.0.smithi084.stdout:847: writing smithi08477944-1 from 4169728 to 4702208 tid 4 2024-03-30T12:25:08.317 INFO:tasks.rados.rados.0.smithi084.stdout:848: read oid 42 snap -1 2024-03-30T12:25:08.317 INFO:tasks.rados.rados.0.smithi084.stdout:848: expect deleted 2024-03-30T12:25:08.317 INFO:tasks.rados.rados.0.smithi084.stdout:844: finishing write tid 3 to smithi08477944-5 2024-03-30T12:25:08.317 INFO:tasks.rados.rados.0.smithi084.stdout:849: read oid 43 snap -1 2024-03-30T12:25:08.317 INFO:tasks.rados.rados.0.smithi084.stdout:849: expect (ObjNum 207 snap 62 seq_num 207) 2024-03-30T12:25:08.317 INFO:tasks.rados.rados.0.smithi084.stdout:850: copy_from oid 35 from oid 21 current snap is 90 2024-03-30T12:25:08.317 INFO:tasks.rados.rados.0.smithi084.stdout:844: finishing write tid 4 to smithi08477944-5 2024-03-30T12:25:08.317 INFO:tasks.rados.rados.0.smithi084.stdout:844: finishing write tid 5 to smithi08477944-5 2024-03-30T12:25:08.318 INFO:tasks.rados.rados.0.smithi084.stdout:845: expect (ObjNum 196 snap 55 seq_num 196) 2024-03-30T12:25:08.377 INFO:tasks.rados.rados.0.smithi084.stdout:846: finishing rollback tid 0 to smithi08477944-49 2024-03-30T12:25:08.377 INFO:tasks.rados.rados.0.smithi084.stdout:844: finishing write tid 6 to smithi08477944-5 2024-03-30T12:25:08.377 INFO:tasks.rados.rados.0.smithi084.stdout:844: oid 5 updating version 0 to 413 2024-03-30T12:25:08.377 INFO:tasks.rados.rados.0.smithi084.stdout:844: oid 5 version 413 is already newer than 412 2024-03-30T12:25:08.377 INFO:tasks.rados.rados.0.smithi084.stdout:844: oid 5 updating version 413 to 416 2024-03-30T12:25:08.377 INFO:tasks.rados.rados.0.smithi084.stdout:844: oid 5 version 416 is already newer than 414 2024-03-30T12:25:08.377 INFO:tasks.rados.rados.0.smithi084.stdout:844: oid 5 version 416 is already newer than 415 2024-03-30T12:25:08.378 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 416 (ObjNum 276 snap 90 seq_num 276) dirty exists 2024-03-30T12:25:08.378 INFO:tasks.rados.rados.0.smithi084.stdout:844: left oid 5 (ObjNum 276 snap 90 seq_num 276) 2024-03-30T12:25:08.378 INFO:tasks.rados.rados.0.smithi084.stdout:846: finishing rollback tid 1 to smithi08477944-49 2024-03-30T12:25:08.378 INFO:tasks.rados.rados.0.smithi084.stdout:844: done (6 left) 2024-03-30T12:25:08.378 INFO:tasks.rados.rados.0.smithi084.stdout:845: done (5 left) 2024-03-30T12:25:08.378 INFO:tasks.rados.rados.0.smithi084.stdout:851: copy_from oid 45 from oid 9 current snap is 90 2024-03-30T12:25:08.378 INFO:tasks.rados.rados.0.smithi084.stdout:846: finishing rollback tid 2 to smithi08477944-49 2024-03-30T12:25:08.378 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 334 (ObjNum 181 snap 50 seq_num 181) dirty exists 2024-03-30T12:25:08.379 INFO:tasks.rados.rados.0.smithi084.stdout:847: finishing write tid 1 to smithi08477944-1 2024-03-30T12:25:08.379 INFO:tasks.rados.rados.0.smithi084.stdout:847: finishing write tid 2 to smithi08477944-1 2024-03-30T12:25:08.379 INFO:tasks.rados.rados.0.smithi084.stdout:847: finishing write tid 3 to smithi08477944-1 2024-03-30T12:25:08.379 INFO:tasks.rados.rados.0.smithi084.stdout:847: finishing write tid 4 to smithi08477944-1 2024-03-30T12:25:08.379 INFO:tasks.rados.rados.0.smithi084.stdout:847: finishing write tid 5 to smithi08477944-1 2024-03-30T12:25:08.379 INFO:tasks.rados.rados.0.smithi084.stdout:850: finishing copy_from racing read to smithi08477944-35 2024-03-30T12:25:08.379 INFO:tasks.rados.rados.0.smithi084.stdout:847: finishing write tid 6 to smithi08477944-1 2024-03-30T12:25:08.379 INFO:tasks.rados.rados.0.smithi084.stdout:847: oid 1 updating version 0 to 202 2024-03-30T12:25:08.379 INFO:tasks.rados.rados.0.smithi084.stdout:847: oid 1 updating version 202 to 203 2024-03-30T12:25:08.379 INFO:tasks.rados.rados.0.smithi084.stdout:847: oid 1 version 203 is already newer than 199 2024-03-30T12:25:08.379 INFO:tasks.rados.rados.0.smithi084.stdout:847: oid 1 version 203 is already newer than 201 2024-03-30T12:25:08.379 INFO:tasks.rados.rados.0.smithi084.stdout:847: oid 1 version 203 is already newer than 200 2024-03-30T12:25:08.379 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 203 (ObjNum 277 snap 90 seq_num 277) dirty exists 2024-03-30T12:25:08.379 INFO:tasks.rados.rados.0.smithi084.stdout:847: left oid 1 (ObjNum 277 snap 90 seq_num 277) 2024-03-30T12:25:08.379 INFO:tasks.rados.rados.0.smithi084.stdout:850: finishing copy_from to smithi08477944-35 2024-03-30T12:25:08.380 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 407 (ObjNum 65 snap 0 seq_num 1499748467) dirty exists 2024-03-30T12:25:08.380 INFO:tasks.rados.rados.0.smithi084.stdout:849: expect (ObjNum 207 snap 62 seq_num 207) 2024-03-30T12:25:08.502 INFO:tasks.rados.rados.0.smithi084.stdout:851: finishing copy_from racing read to smithi08477944-45 2024-03-30T12:25:08.502 INFO:tasks.rados.rados.0.smithi084.stdout:851: finishing copy_from to smithi08477944-45 2024-03-30T12:25:08.503 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 265 (ObjNum 234 snap 73 seq_num 234) dirty exists 2024-03-30T12:25:08.503 INFO:tasks.rados.rados.0.smithi084.stdout:846: done (5 left) 2024-03-30T12:25:08.503 INFO:tasks.rados.rados.0.smithi084.stdout:847: done (4 left) 2024-03-30T12:25:08.503 INFO:tasks.rados.rados.0.smithi084.stdout:848: done (3 left) 2024-03-30T12:25:08.503 INFO:tasks.rados.rados.0.smithi084.stdout:849: done (2 left) 2024-03-30T12:25:08.503 INFO:tasks.rados.rados.0.smithi084.stdout:850: done (1 left) 2024-03-30T12:25:08.503 INFO:tasks.rados.rados.0.smithi084.stdout:851: done (0 left) 2024-03-30T12:25:08.503 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 90 2024-03-30T12:25:08.503 INFO:tasks.rados.rados.0.smithi084.stdout:852: seq_num 278 ranges {802816=663552,1466368=442368,1908736=720896,2629632=442368} 2024-03-30T12:25:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:08 smithi084 ceph-mon[91810]: osdmap e234: 8 total, 8 up, 8 in 2024-03-30T12:25:08.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:08 smithi084 ceph-mon[89279]: osdmap e234: 8 total, 8 up, 8 in 2024-03-30T12:25:08.510 INFO:tasks.rados.rados.0.smithi084.stdout:852: writing smithi08477944-4 from 802816 to 1466368 tid 1 2024-03-30T12:25:08.512 INFO:tasks.rados.rados.0.smithi084.stdout:852: writing smithi08477944-4 from 1466368 to 1908736 tid 2 2024-03-30T12:25:08.516 INFO:tasks.rados.rados.0.smithi084.stdout:852: writing smithi08477944-4 from 1908736 to 2629632 tid 3 2024-03-30T12:25:08.519 INFO:tasks.rados.rados.0.smithi084.stdout:852: writing smithi08477944-4 from 2629632 to 3072000 tid 4 2024-03-30T12:25:08.519 INFO:tasks.rados.rados.0.smithi084.stdout:853: snap_remove snap 84 2024-03-30T12:25:08.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:08 smithi162 ceph-mon[30421]: osdmap e234: 8 total, 8 up, 8 in 2024-03-30T12:25:09.290 INFO:tasks.rados.rados.0.smithi084.stdout:853: done (1 left) 2024-03-30T12:25:09.290 INFO:tasks.rados.rados.0.smithi084.stdout:854: rmattr oid 34 current snap is 90 2024-03-30T12:25:09.290 INFO:tasks.rados.rados.0.smithi084.stdout:854: done (1 left) 2024-03-30T12:25:09.291 INFO:tasks.rados.rados.0.smithi084.stdout:855: rollback oid 27 current snap is 90 2024-03-30T12:25:09.291 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 27 to 88 2024-03-30T12:25:09.291 INFO:tasks.rados.rados.0.smithi084.stdout:856: delete oid 13 current snap is 90 2024-03-30T12:25:09.291 INFO:tasks.rados.rados.0.smithi084.stdout:852: finishing write tid 1 to smithi08477944-4 2024-03-30T12:25:09.291 INFO:tasks.rados.rados.0.smithi084.stdout:852: finishing write tid 2 to smithi08477944-4 2024-03-30T12:25:09.291 INFO:tasks.rados.rados.0.smithi084.stdout:852: finishing write tid 3 to smithi08477944-4 2024-03-30T12:25:09.291 INFO:tasks.rados.rados.0.smithi084.stdout:852: finishing write tid 4 to smithi08477944-4 2024-03-30T12:25:09.291 INFO:tasks.rados.rados.0.smithi084.stdout:852: finishing write tid 5 to smithi08477944-4 2024-03-30T12:25:09.291 INFO:tasks.rados.rados.0.smithi084.stdout:852: finishing write tid 6 to smithi08477944-4 2024-03-30T12:25:09.291 INFO:tasks.rados.rados.0.smithi084.stdout:852: oid 4 updating version 0 to 319 2024-03-30T12:25:09.292 INFO:tasks.rados.rados.0.smithi084.stdout:852: oid 4 updating version 319 to 321 2024-03-30T12:25:09.292 INFO:tasks.rados.rados.0.smithi084.stdout:852: oid 4 updating version 321 to 322 2024-03-30T12:25:09.292 INFO:tasks.rados.rados.0.smithi084.stdout:852: oid 4 version 322 is already newer than 318 2024-03-30T12:25:09.292 INFO:tasks.rados.rados.0.smithi084.stdout:852: oid 4 version 322 is already newer than 320 2024-03-30T12:25:09.292 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 322 (ObjNum 278 snap 90 seq_num 278) dirty exists 2024-03-30T12:25:09.292 INFO:tasks.rados.rados.0.smithi084.stdout:852: left oid 4 (ObjNum 278 snap 90 seq_num 278) 2024-03-30T12:25:09.301 INFO:tasks.rados.rados.0.smithi084.stdout:855: finishing rollback tid 0 to smithi08477944-27 2024-03-30T12:25:09.302 INFO:tasks.rados.rados.0.smithi084.stdout:855: finishing rollback tid 1 to smithi08477944-27 2024-03-30T12:25:09.302 INFO:tasks.rados.rados.0.smithi084.stdout:852: done (2 left) 2024-03-30T12:25:09.303 INFO:tasks.rados.rados.0.smithi084.stdout:856: done (1 left) 2024-03-30T12:25:09.303 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 90 2024-03-30T12:25:09.303 INFO:tasks.rados.rados.0.smithi084.stdout:857: seq_num 280 ranges {3366912=696320,4063232=606208,4669440=688128,5357568=311296} 2024-03-30T12:25:09.324 INFO:tasks.rados.rados.0.smithi084.stdout:857: writing smithi08477944-43 from 3366912 to 4063232 tid 1 2024-03-30T12:25:09.327 INFO:tasks.rados.rados.0.smithi084.stdout:857: writing smithi08477944-43 from 4063232 to 4669440 tid 2 2024-03-30T12:25:09.331 INFO:tasks.rados.rados.0.smithi084.stdout:857: writing smithi08477944-43 from 4669440 to 5357568 tid 3 2024-03-30T12:25:09.334 INFO:tasks.rados.rados.0.smithi084.stdout:857: writing smithi08477944-43 from 5357568 to 5668864 tid 4 2024-03-30T12:25:09.334 INFO:tasks.rados.rados.0.smithi084.stdout:855: finishing rollback tid 2 to smithi08477944-27 2024-03-30T12:25:09.334 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 407 (ObjNum 238 snap 75 seq_num 238) dirty exists 2024-03-30T12:25:09.334 INFO:tasks.rados.rados.0.smithi084.stdout:857: finishing write tid 1 to smithi08477944-43 2024-03-30T12:25:09.334 INFO:tasks.rados.rados.0.smithi084.stdout:857: finishing write tid 2 to smithi08477944-43 2024-03-30T12:25:09.334 INFO:tasks.rados.rados.0.smithi084.stdout:858: read oid 14 snap -1 2024-03-30T12:25:09.334 INFO:tasks.rados.rados.0.smithi084.stdout:858: expect (ObjNum 211 snap 62 seq_num 211) 2024-03-30T12:25:09.334 INFO:tasks.rados.rados.0.smithi084.stdout:855: done (2 left) 2024-03-30T12:25:09.334 INFO:tasks.rados.rados.0.smithi084.stdout:859: snap_remove snap 75 2024-03-30T12:25:09.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:09 smithi162 ceph-mon[30421]: osdmap e235: 8 total, 8 up, 8 in 2024-03-30T12:25:09.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:09 smithi162 ceph-mon[30421]: pgmap v32: 121 pgs: 121 active+clean; 171 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-03-30T12:25:09.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:25:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:25:09] "GET /metrics HTTP/1.1" 200 36005 "" "Prometheus/2.43.0" 2024-03-30T12:25:09.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:09 smithi084 ceph-mon[91810]: osdmap e235: 8 total, 8 up, 8 in 2024-03-30T12:25:09.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:09 smithi084 ceph-mon[91810]: pgmap v32: 121 pgs: 121 active+clean; 171 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-03-30T12:25:09.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:09 smithi084 ceph-mon[89279]: osdmap e235: 8 total, 8 up, 8 in 2024-03-30T12:25:09.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:09 smithi084 ceph-mon[89279]: pgmap v32: 121 pgs: 121 active+clean; 171 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-03-30T12:25:10.300 INFO:tasks.rados.rados.0.smithi084.stdout:859: done (2 left) 2024-03-30T12:25:10.300 INFO:tasks.rados.rados.0.smithi084.stdout:860: rollback oid 47 current snap is 90 2024-03-30T12:25:10.300 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 69 2024-03-30T12:25:10.300 INFO:tasks.rados.rados.0.smithi084.stdout:861: snap_remove snap 68 2024-03-30T12:25:10.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:10 smithi162 ceph-mon[30421]: osdmap e236: 8 total, 8 up, 8 in 2024-03-30T12:25:10.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:10 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:10.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:10 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:10.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:25:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:25:10.520+0000 7f1f562eb700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-30T12:25:10.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:10 smithi084 ceph-mon[91810]: osdmap e236: 8 total, 8 up, 8 in 2024-03-30T12:25:10.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:10 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:10.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:10 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:10.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:10 smithi084 ceph-mon[89279]: osdmap e236: 8 total, 8 up, 8 in 2024-03-30T12:25:10.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:10 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:10.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:10 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:11.301 INFO:tasks.rados.rados.0.smithi084.stdout:861: done (3 left) 2024-03-30T12:25:11.301 INFO:tasks.rados.rados.0.smithi084.stdout:862: rollback oid 7 current snap is 90 2024-03-30T12:25:11.301 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 7 to 87 2024-03-30T12:25:11.301 INFO:tasks.rados.rados.0.smithi084.stdout:863: snap_remove snap 85 2024-03-30T12:25:11.304 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:11 smithi084 ceph-mon[91810]: osdmap e237: 8 total, 8 up, 8 in 2024-03-30T12:25:11.304 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:11 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:11.304 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:11 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:11.304 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:11 smithi084 ceph-mon[91810]: pgmap v35: 121 pgs: 121 active+clean; 174 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 5.1 MiB/s rd, 1.1 MiB/s wr, 7 op/s 2024-03-30T12:25:11.305 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:11 smithi084 ceph-mon[89279]: osdmap e237: 8 total, 8 up, 8 in 2024-03-30T12:25:11.305 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:11 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:11.305 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:11 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:11.305 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:11 smithi084 ceph-mon[89279]: pgmap v35: 121 pgs: 121 active+clean; 174 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 5.1 MiB/s rd, 1.1 MiB/s wr, 7 op/s 2024-03-30T12:25:11.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:11 smithi162 ceph-mon[30421]: osdmap e237: 8 total, 8 up, 8 in 2024-03-30T12:25:11.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:11 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:11.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:11 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:11.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:11 smithi162 ceph-mon[30421]: pgmap v35: 121 pgs: 121 active+clean; 174 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 5.1 MiB/s rd, 1.1 MiB/s wr, 7 op/s 2024-03-30T12:25:12.311 INFO:tasks.rados.rados.0.smithi084.stdout:863: done (4 left) 2024-03-30T12:25:12.311 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 46 current snap is 90 2024-03-30T12:25:12.311 INFO:tasks.rados.rados.0.smithi084.stdout:857: finishing write tid 3 to smithi08477944-43 2024-03-30T12:25:12.311 INFO:tasks.rados.rados.0.smithi084.stdout:864: seq_num 281 ranges {1802240=712704,2514944=491520,3006464=491520,3497984=622592} 2024-03-30T12:25:12.326 INFO:tasks.rados.rados.0.smithi084.stdout:864: writing smithi08477944-46 from 1802240 to 2514944 tid 1 2024-03-30T12:25:12.329 INFO:tasks.rados.rados.0.smithi084.stdout:864: writing smithi08477944-46 from 2514944 to 3006464 tid 2 2024-03-30T12:25:12.332 INFO:tasks.rados.rados.0.smithi084.stdout:864: writing smithi08477944-46 from 3006464 to 3497984 tid 3 2024-03-30T12:25:12.335 INFO:tasks.rados.rados.0.smithi084.stdout:864: writing smithi08477944-46 from 3497984 to 4120576 tid 4 2024-03-30T12:25:12.336 INFO:tasks.rados.rados.0.smithi084.stdout:865: snap_remove snap 70 2024-03-30T12:25:12.559 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:12 smithi084 ceph-mon[91810]: osdmap e238: 8 total, 8 up, 8 in 2024-03-30T12:25:12.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:12 smithi084 ceph-mon[89279]: osdmap e238: 8 total, 8 up, 8 in 2024-03-30T12:25:12.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:12 smithi162 ceph-mon[30421]: osdmap e238: 8 total, 8 up, 8 in 2024-03-30T12:25:13.325 INFO:tasks.rados.rados.0.smithi084.stdout:865: done (5 left) 2024-03-30T12:25:13.325 INFO:tasks.rados.rados.0.smithi084.stdout:866: delete oid 9 current snap is 90 2024-03-30T12:25:13.325 INFO:tasks.rados.rados.0.smithi084.stdout:857: finishing write tid 4 to smithi08477944-43 2024-03-30T12:25:13.326 INFO:tasks.rados.rados.0.smithi084.stdout:857: finishing write tid 5 to smithi08477944-43 2024-03-30T12:25:13.326 INFO:tasks.rados.rados.0.smithi084.stdout:857: finishing write tid 6 to smithi08477944-43 2024-03-30T12:25:13.326 INFO:tasks.rados.rados.0.smithi084.stdout:857: oid 43 updating version 0 to 530 2024-03-30T12:25:13.326 INFO:tasks.rados.rados.0.smithi084.stdout:857: oid 43 version 530 is already newer than 529 2024-03-30T12:25:13.326 INFO:tasks.rados.rados.0.smithi084.stdout:857: oid 43 updating version 530 to 532 2024-03-30T12:25:13.326 INFO:tasks.rados.rados.0.smithi084.stdout:857: oid 43 updating version 532 to 533 2024-03-30T12:25:13.326 INFO:tasks.rados.rados.0.smithi084.stdout:857: oid 43 version 533 is already newer than 531 2024-03-30T12:25:13.326 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 533 (ObjNum 280 snap 90 seq_num 280) dirty exists 2024-03-30T12:25:13.326 INFO:tasks.rados.rados.0.smithi084.stdout:857: left oid 43 (ObjNum 280 snap 90 seq_num 280) 2024-03-30T12:25:13.326 INFO:tasks.rados.rados.0.smithi084.stdout:858: expect (ObjNum 211 snap 62 seq_num 211) 2024-03-30T12:25:13.430 INFO:tasks.rados.rados.0.smithi084.stdout:860: finishing rollback tid 0 to smithi08477944-47 2024-03-30T12:25:13.431 INFO:tasks.rados.rados.0.smithi084.stdout:860: finishing rollback tid 1 to smithi08477944-47 2024-03-30T12:25:13.431 INFO:tasks.rados.rados.0.smithi084.stdout:860: finishing rollback tid 2 to smithi08477944-47 2024-03-30T12:25:13.431 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 536 (ObjNum 225 snap 66 seq_num 225) dirty exists 2024-03-30T12:25:13.431 INFO:tasks.rados.rados.0.smithi084.stdout:862: finishing rollback tid 0 to smithi08477944-7 2024-03-30T12:25:13.431 INFO:tasks.rados.rados.0.smithi084.stdout:862: finishing rollback tid 1 to smithi08477944-7 2024-03-30T12:25:13.431 INFO:tasks.rados.rados.0.smithi084.stdout:862: finishing rollback tid 2 to smithi08477944-7 2024-03-30T12:25:13.431 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 546 (ObjNum 259 snap 80 seq_num 259) dirty exists 2024-03-30T12:25:13.431 INFO:tasks.rados.rados.0.smithi084.stdout:857: done (5 left) 2024-03-30T12:25:13.431 INFO:tasks.rados.rados.0.smithi084.stdout:858: done (4 left) 2024-03-30T12:25:13.431 INFO:tasks.rados.rados.0.smithi084.stdout:860: done (3 left) 2024-03-30T12:25:13.431 INFO:tasks.rados.rados.0.smithi084.stdout:862: done (2 left) 2024-03-30T12:25:13.431 INFO:tasks.rados.rados.0.smithi084.stdout:866: done (1 left) 2024-03-30T12:25:13.431 INFO:tasks.rados.rados.0.smithi084.stdout:867: snap_remove snap 54 2024-03-30T12:25:13.464 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:13 smithi084 ceph-mon[91810]: osdmap e239: 8 total, 8 up, 8 in 2024-03-30T12:25:13.464 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:13 smithi084 ceph-mon[91810]: pgmap v38: 121 pgs: 121 active+clean; 177 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 5.1 MiB/s rd, 2.5 MiB/s wr, 12 op/s 2024-03-30T12:25:13.464 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:13 smithi084 ceph-mon[89279]: osdmap e239: 8 total, 8 up, 8 in 2024-03-30T12:25:13.464 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:13 smithi084 ceph-mon[89279]: pgmap v38: 121 pgs: 121 active+clean; 177 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 5.1 MiB/s rd, 2.5 MiB/s wr, 12 op/s 2024-03-30T12:25:13.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:13 smithi162 ceph-mon[30421]: osdmap e239: 8 total, 8 up, 8 in 2024-03-30T12:25:13.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:13 smithi162 ceph-mon[30421]: pgmap v38: 121 pgs: 121 active+clean; 177 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 5.1 MiB/s rd, 2.5 MiB/s wr, 12 op/s 2024-03-30T12:25:14.323 INFO:tasks.rados.rados.0.smithi084.stdout:867: done (1 left) 2024-03-30T12:25:14.323 INFO:tasks.rados.rados.0.smithi084.stdout:868: copy_from oid 1 from oid 49 current snap is 90 2024-03-30T12:25:14.323 INFO:tasks.rados.rados.0.smithi084.stdout:864: finishing write tid 1 to smithi08477944-46 2024-03-30T12:25:14.323 INFO:tasks.rados.rados.0.smithi084.stdout:864: finishing write tid 2 to smithi08477944-46 2024-03-30T12:25:14.323 INFO:tasks.rados.rados.0.smithi084.stdout:864: finishing write tid 3 to smithi08477944-46 2024-03-30T12:25:14.323 INFO:tasks.rados.rados.0.smithi084.stdout:864: finishing write tid 4 to smithi08477944-46 2024-03-30T12:25:14.323 INFO:tasks.rados.rados.0.smithi084.stdout:864: finishing write tid 5 to smithi08477944-46 2024-03-30T12:25:14.323 INFO:tasks.rados.rados.0.smithi084.stdout:864: finishing write tid 6 to smithi08477944-46 2024-03-30T12:25:14.323 INFO:tasks.rados.rados.0.smithi084.stdout:864: oid 46 updating version 0 to 428 2024-03-30T12:25:14.323 INFO:tasks.rados.rados.0.smithi084.stdout:864: oid 46 version 428 is already newer than 425 2024-03-30T12:25:14.324 INFO:tasks.rados.rados.0.smithi084.stdout:864: oid 46 updating version 428 to 429 2024-03-30T12:25:14.324 INFO:tasks.rados.rados.0.smithi084.stdout:864: oid 46 version 429 is already newer than 426 2024-03-30T12:25:14.324 INFO:tasks.rados.rados.0.smithi084.stdout:864: oid 46 version 429 is already newer than 427 2024-03-30T12:25:14.324 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 429 (ObjNum 281 snap 90 seq_num 281) dirty exists 2024-03-30T12:25:14.324 INFO:tasks.rados.rados.0.smithi084.stdout:864: left oid 46 (ObjNum 281 snap 90 seq_num 281) 2024-03-30T12:25:14.324 INFO:tasks.rados.rados.0.smithi084.stdout:864: done (1 left) 2024-03-30T12:25:14.324 INFO:tasks.rados.rados.0.smithi084.stdout:869: delete oid 46 current snap is 90 2024-03-30T12:25:14.332 INFO:tasks.rados.rados.0.smithi084.stdout:869: done (1 left) 2024-03-30T12:25:14.332 INFO:tasks.rados.rados.0.smithi084.stdout:870: snap_remove snap 72 2024-03-30T12:25:14.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:14 smithi162 ceph-mon[30421]: osdmap e240: 8 total, 8 up, 8 in 2024-03-30T12:25:14.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:14 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:14.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:14 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:14.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:14 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:14.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:14 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:25:14.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:14 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:14.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:14 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:25:14.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:14 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:25:14.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:14 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-30T12:25:14.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:14 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-03-30T12:25:14.632 INFO:tasks.rados.rados.0.smithi084.stdout:870: done (1 left) 2024-03-30T12:25:14.633 INFO:tasks.rados.rados.0.smithi084.stdout:871: snap_create 2024-03-30T12:25:14.633 INFO:tasks.rados.rados.0.smithi084.stdout:868: finishing copy_from racing read to smithi08477944-1 2024-03-30T12:25:14.633 INFO:tasks.rados.rados.0.smithi084.stdout:868: finishing copy_from to smithi08477944-1 2024-03-30T12:25:14.633 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 334 (ObjNum 181 snap 50 seq_num 181) dirty exists 2024-03-30T12:25:14.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:14 smithi084 ceph-mon[91810]: osdmap e240: 8 total, 8 up, 8 in 2024-03-30T12:25:14.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:14 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:14.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:14 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:14.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:14 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:14.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:14 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:25:14.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:14 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:14.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:14 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:25:14.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:14 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:25:14.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:14 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-30T12:25:14.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:14 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-03-30T12:25:14.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:14 smithi084 ceph-mon[89279]: osdmap e240: 8 total, 8 up, 8 in 2024-03-30T12:25:14.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:14 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:14.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:14 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:14.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:14 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:14.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:14 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:25:14.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:14 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:14.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:14 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:25:14.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:14 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:25:14.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:14 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-30T12:25:14.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:14 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-03-30T12:25:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:15 smithi162 ceph-mon[30421]: Upgrade: It appears safe to stop mon.b 2024-03-30T12:25:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:15 smithi162 ceph-mon[30421]: osdmap e241: 8 total, 8 up, 8 in 2024-03-30T12:25:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:15 smithi162 ceph-mon[30421]: pgmap v41: 121 pgs: 121 active+clean; 177 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 1.4 MiB/s wr, 4 op/s 2024-03-30T12:25:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:15 smithi162 ceph-mon[30421]: osdmap e242: 8 total, 8 up, 8 in 2024-03-30T12:25:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:15 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:25:15.635 INFO:tasks.rados.rados.0.smithi084.stdout:868: done (1 left) 2024-03-30T12:25:15.636 INFO:tasks.rados.rados.0.smithi084.stdout:871: done (0 left) 2024-03-30T12:25:15.636 INFO:tasks.rados.rados.0.smithi084.stdout:872: copy_from oid 20 from oid 32 current snap is 91 2024-03-30T12:25:15.636 INFO:tasks.rados.rados.0.smithi084.stdout:873: delete oid 3 current snap is 91 2024-03-30T12:25:15.639 INFO:tasks.rados.rados.0.smithi084.stdout:873: done (1 left) 2024-03-30T12:25:15.639 INFO:tasks.rados.rados.0.smithi084.stdout:874: copy_from oid 45 from oid 37 current snap is 91 2024-03-30T12:25:15.640 INFO:tasks.rados.rados.0.smithi084.stdout:875: snap_remove snap 81 2024-03-30T12:25:15.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:15 smithi084 ceph-mon[91810]: Upgrade: It appears safe to stop mon.b 2024-03-30T12:25:15.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:15 smithi084 ceph-mon[91810]: osdmap e241: 8 total, 8 up, 8 in 2024-03-30T12:25:15.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:15 smithi084 ceph-mon[91810]: pgmap v41: 121 pgs: 121 active+clean; 177 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 1.4 MiB/s wr, 4 op/s 2024-03-30T12:25:15.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:15 smithi084 ceph-mon[91810]: osdmap e242: 8 total, 8 up, 8 in 2024-03-30T12:25:15.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:15 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:25:15.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:15 smithi084 ceph-mon[89279]: Upgrade: It appears safe to stop mon.b 2024-03-30T12:25:15.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:15 smithi084 ceph-mon[89279]: osdmap e241: 8 total, 8 up, 8 in 2024-03-30T12:25:15.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:15 smithi084 ceph-mon[89279]: pgmap v41: 121 pgs: 121 active+clean; 177 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 1.4 MiB/s wr, 4 op/s 2024-03-30T12:25:15.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:15 smithi084 ceph-mon[89279]: osdmap e242: 8 total, 8 up, 8 in 2024-03-30T12:25:15.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:15 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:25:16.639 INFO:tasks.rados.rados.0.smithi084.stdout:875: done (2 left) 2024-03-30T12:25:16.640 INFO:tasks.rados.rados.0.smithi084.stdout:876: snap_create 2024-03-30T12:25:16.640 INFO:tasks.rados.rados.0.smithi084.stdout:872: finishing copy_from to smithi08477944-20 2024-03-30T12:25:16.640 INFO:tasks.rados.rados.0.smithi084.stdout:872: got expected ENOENT (src dne) 2024-03-30T12:25:16.640 INFO:tasks.rados.rados.0.smithi084.stdout:872: finishing copy_from racing read to smithi08477944-20 2024-03-30T12:25:16.640 INFO:tasks.rados.rados.0.smithi084.stdout:874: finishing copy_from to smithi08477944-45 2024-03-30T12:25:16.640 INFO:tasks.rados.rados.0.smithi084.stdout:874: got expected ENOENT (src dne) 2024-03-30T12:25:16.640 INFO:tasks.rados.rados.0.smithi084.stdout:874: finishing copy_from racing read to smithi08477944-45 2024-03-30T12:25:16.832 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:16 smithi162 ceph-mon[30421]: osdmap e243: 8 total, 8 up, 8 in 2024-03-30T12:25:16.832 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:16 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:16.832 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:16 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:25:16.832 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:16 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:25:16.832 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:16 smithi162 ceph-mon[30421]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:17.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:16 smithi084 ceph-mon[91810]: osdmap e243: 8 total, 8 up, 8 in 2024-03-30T12:25:17.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:16 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:17.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:16 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:25:17.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:16 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:25:17.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:16 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:17.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:16 smithi084 ceph-mon[89279]: osdmap e243: 8 total, 8 up, 8 in 2024-03-30T12:25:17.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:16 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:17.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:16 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:25:17.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:16 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:25:17.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:16 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:17.650 INFO:tasks.rados.rados.0.smithi084.stdout:872: done (2 left) 2024-03-30T12:25:17.650 INFO:tasks.rados.rados.0.smithi084.stdout:874: done (1 left) 2024-03-30T12:25:17.650 INFO:tasks.rados.rados.0.smithi084.stdout:876: done (0 left) 2024-03-30T12:25:17.650 INFO:tasks.rados.rados.0.smithi084.stdout:877: snap_remove snap 79 2024-03-30T12:25:17.779 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:17 smithi162 ceph-mon[30421]: Upgrade: Updating mon.b 2024-03-30T12:25:17.779 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:17 smithi162 ceph-mon[30421]: Deploying daemon mon.b on smithi162 2024-03-30T12:25:17.779 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:17 smithi162 ceph-mon[30421]: pgmap v44: 121 pgs: 121 active+clean; 170 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 1.3 MiB/s wr, 3 op/s 2024-03-30T12:25:17.779 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:17 smithi162 ceph-mon[30421]: osdmap e244: 8 total, 8 up, 8 in 2024-03-30T12:25:18.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:17 smithi084 ceph-mon[91810]: Upgrade: Updating mon.b 2024-03-30T12:25:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:17 smithi084 ceph-mon[91810]: Deploying daemon mon.b on smithi162 2024-03-30T12:25:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:17 smithi084 ceph-mon[91810]: pgmap v44: 121 pgs: 121 active+clean; 170 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 1.3 MiB/s wr, 3 op/s 2024-03-30T12:25:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:17 smithi084 ceph-mon[91810]: osdmap e244: 8 total, 8 up, 8 in 2024-03-30T12:25:18.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:17 smithi084 ceph-mon[89279]: Upgrade: Updating mon.b 2024-03-30T12:25:18.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:17 smithi084 ceph-mon[89279]: Deploying daemon mon.b on smithi162 2024-03-30T12:25:18.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:17 smithi084 ceph-mon[89279]: pgmap v44: 121 pgs: 121 active+clean; 170 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 1.3 MiB/s wr, 3 op/s 2024-03-30T12:25:18.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:17 smithi084 ceph-mon[89279]: osdmap e244: 8 total, 8 up, 8 in 2024-03-30T12:25:18.035 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:17 smithi162 systemd[1]: Stopping Ceph mon.b for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:25:18.310 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-b[30395]: 2024-03-30T12:25:18.043+0000 7fbb3e0b0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:25:18.310 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-b[30395]: 2024-03-30T12:25:18.043+0000 7fbb3e0b0700 -1 mon.b@1(peon) e3 *** Got Signal Terminated *** 2024-03-30T12:25:18.310 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:18 smithi162 podman[83545]: 2024-03-30 12:25:18.084599672 +0000 UTC m=+0.156999158 container died 5bf04eacfc81296cc2545bdedfd39b17cd887cd14614db12d94e99e0c6a81711 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-b, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=reef-f14b568, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-03-30T12:25:18.594 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:18 smithi162 podman[83545]: 2024-03-30 12:25:18.418340473 +0000 UTC m=+0.490739948 container cleanup 5bf04eacfc81296cc2545bdedfd39b17cd887cd14614db12d94e99e0c6a81711 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=reef-f14b568, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD) 2024-03-30T12:25:18.594 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:18 smithi162 bash[83545]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-b 2024-03-30T12:25:18.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:18 smithi162 podman[83559]: 2024-03-30 12:25:18.603074735 +0000 UTC m=+0.517001762 container remove 5bf04eacfc81296cc2545bdedfd39b17cd887cd14614db12d94e99e0c6a81711 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=reef-f14b568, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-03-30T12:25:18.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:18 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mon.b.service: Deactivated successfully. 2024-03-30T12:25:18.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:18 smithi162 systemd[1]: Stopped Ceph mon.b for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:25:18.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:18 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mon.b.service: Consumed 9.320s CPU time. 2024-03-30T12:25:19.249 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-03-30T12:25:19.287 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 systemd[1]: Starting Ceph mon.b for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:25:19.287 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 podman[83690]: 2024-03-30 12:25:19.155805387 +0000 UTC m=+0.018030257 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:25:19.287 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 podman[83690]: 2024-03-30 12:25:19.295949373 +0000 UTC m=+0.158174272 container create 149ae6649e0c574a1f1db7826e9c70277f61a3d34a743ad4a10dcc252a8ad511 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-03-30T12:25:19.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:25:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:25:19] "GET /metrics HTTP/1.1" 200 36003 "" "Prometheus/2.43.0" 2024-03-30T12:25:19.549 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 podman[83690]: 2024-03-30 12:25:19.532001648 +0000 UTC m=+0.394226516 container init 149ae6649e0c574a1f1db7826e9c70277f61a3d34a743ad4a10dcc252a8ad511 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3) 2024-03-30T12:25:19.549 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 podman[83690]: 2024-03-30 12:25:19.535320456 +0000 UTC m=+0.397545304 container start 149ae6649e0c574a1f1db7826e9c70277f61a3d34a743ad4a10dcc252a8ad511 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T12:25:19.564 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T12:25:19.564 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (4m) 10s ago 5m 25.2M - 0.25.0 c8568f914cd2 6765ce007f39 2024-03-30T12:25:19.564 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi162 *:3000 running (5m) 30s ago 5m 90.9M - 9.4.7 954c08fa6188 ff2ec7518619 2024-03-30T12:25:19.564 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (6m) 10s ago 6m 14.3M - 18.2.2-1051-gf14b5682 c8fb09e16a7d a9c2e74ca2a3 2024-03-30T12:25:19.564 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi162 running (6m) 30s ago 6m 19.2M - 18.2.2-1051-gf14b5682 c8fb09e16a7d ee1770ef5edd 2024-03-30T12:25:19.564 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi162 *:8443,9283,8765 running (60s) 30s ago 9m 447M - 19.0.0-1864-g5dc2ea30 548196a1a838 eec968f3fcc6 2024-03-30T12:25:19.564 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (89s) 10s ago 11m 501M - 19.0.0-1864-g5dc2ea30 548196a1a838 9a2aba19dffc 2024-03-30T12:25:19.564 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (45s) 10s ago 11m 38.4M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 a0811f2ae47d 2024-03-30T12:25:19.564 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi162 running (10m) 30s ago 10m 54.8M 2048M 18.2.2-1051-gf14b5682 c8fb09e16a7d 5bf04eacfc81 2024-03-30T12:25:19.564 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (19s) 10s ago 10m 25.9M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 f79eca93cddd 2024-03-30T12:25:19.565 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (5m) 10s ago 4m 17.3M - 1.5.0 0da6a335fe13 66844bed39e8 2024-03-30T12:25:19.565 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi162 *:9100 running (4m) 30s ago 4m 15.4M - 1.5.0 0da6a335fe13 3d6e28b2348d 2024-03-30T12:25:19.565 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (9m) 10s ago 9m 212M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 4cad4c4383a6 2024-03-30T12:25:19.565 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (9m) 10s ago 9m 153M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 3b30b0ea0e32 2024-03-30T12:25:19.565 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (8m) 10s ago 8m 169M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d eb2412618811 2024-03-30T12:25:19.565 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (8m) 10s ago 8m 98.5M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 8eaf6dc73c25 2024-03-30T12:25:19.565 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi162 running (7m) 30s ago 7m 163M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 1f52e827b91a 2024-03-30T12:25:19.565 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi162 running (7m) 30s ago 7m 149M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 7ba250d154aa 2024-03-30T12:25:19.565 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi162 running (7m) 30s ago 7m 85.6M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 656a733e8b7a 2024-03-30T12:25:19.565 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi162 running (6m) 30s ago 6m 103M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d e3246b3bc88b 2024-03-30T12:25:19.565 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi162 *:9095 running (65s) 30s ago 5m 40.6M - 2.43.0 a07b618ecd1d bd7d323e4b47 2024-03-30T12:25:19.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: set uid:gid to 167:167 (ceph:ceph) 2024-03-30T12:25:19.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev), process ceph-mon, pid 2 2024-03-30T12:25:19.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: pidfile_write: ignore empty --pid-file 2024-03-30T12:25:19.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: load: jerasure load: lrc 2024-03-30T12:25:19.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: RocksDB version: 7.9.2 2024-03-30T12:25:19.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Git sha 0 2024-03-30T12:25:19.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Compile date 2024-03-29 20:54:14 2024-03-30T12:25:19.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: DB SUMMARY 2024-03-30T12:25:19.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: DB Session ID: CNUP0S6EISDS6B0YEYQP 2024-03-30T12:25:19.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: CURRENT file: CURRENT 2024-03-30T12:25:19.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: IDENTITY file: IDENTITY 2024-03-30T12:25:19.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1405 Bytes 2024-03-30T12:25:19.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 1, files: 000027.sst 2024-03-30T12:25:19.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000025.log size: 10844538 ; 2024-03-30T12:25:19.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.error_if_exists: 0 2024-03-30T12:25:19.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.create_if_missing: 0 2024-03-30T12:25:19.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.paranoid_checks: 1 2024-03-30T12:25:19.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-30T12:25:19.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-30T12:25:19.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-30T12:25:19.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.env: 0x5557b3721b20 2024-03-30T12:25:19.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.fs: PosixFileSystem 2024-03-30T12:25:19.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.info_log: 0x5557b58458e0 2024-03-30T12:25:19.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_file_opening_threads: 16 2024-03-30T12:25:19.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.statistics: (nil) 2024-03-30T12:25:19.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.use_fsync: 0 2024-03-30T12:25:19.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_log_file_size: 0 2024-03-30T12:25:19.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-30T12:25:19.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-30T12:25:19.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.keep_log_file_num: 1000 2024-03-30T12:25:19.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.recycle_log_file_num: 0 2024-03-30T12:25:19.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.allow_fallocate: 1 2024-03-30T12:25:19.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.allow_mmap_reads: 0 2024-03-30T12:25:19.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.allow_mmap_writes: 0 2024-03-30T12:25:19.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.use_direct_reads: 0 2024-03-30T12:25:19.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-30T12:25:19.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.create_missing_column_families: 0 2024-03-30T12:25:19.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.db_log_dir: 2024-03-30T12:25:19.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.wal_dir: 2024-03-30T12:25:19.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-30T12:25:19.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-30T12:25:19.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-30T12:25:19.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-30T12:25:19.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-30T12:25:19.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-30T12:25:19.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.advise_random_on_open: 1 2024-03-30T12:25:19.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.db_write_buffer_size: 0 2024-03-30T12:25:19.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.write_buffer_manager: 0x5557b5818dc0 2024-03-30T12:25:19.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-30T12:25:19.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-30T12:25:19.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-30T12:25:19.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.rate_limiter: (nil) 2024-03-30T12:25:19.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-30T12:25:19.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.wal_recovery_mode: 2 2024-03-30T12:25:19.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.enable_thread_tracking: 0 2024-03-30T12:25:19.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.enable_pipelined_write: 0 2024-03-30T12:25:19.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.unordered_write: 0 2024-03-30T12:25:19.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-30T12:25:19.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-30T12:25:19.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-30T12:25:19.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-30T12:25:19.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.row_cache: None 2024-03-30T12:25:19.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.wal_filter: None 2024-03-30T12:25:19.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-30T12:25:19.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.allow_ingest_behind: 0 2024-03-30T12:25:19.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.two_write_queues: 0 2024-03-30T12:25:19.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.manual_wal_flush: 0 2024-03-30T12:25:19.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.wal_compression: 0 2024-03-30T12:25:19.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.atomic_flush: 0 2024-03-30T12:25:19.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-30T12:25:19.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-30T12:25:19.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-30T12:25:19.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.log_readahead_size: 0 2024-03-30T12:25:19.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-30T12:25:19.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.best_efforts_recovery: 0 2024-03-30T12:25:19.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-30T12:25:19.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-30T12:25:19.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.allow_data_in_errors: 0 2024-03-30T12:25:19.876 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.db_host_id: __hostname__ 2024-03-30T12:25:19.876 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-30T12:25:19.877 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_background_jobs: 2 2024-03-30T12:25:19.877 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_background_compactions: -1 2024-03-30T12:25:19.877 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_subcompactions: 1 2024-03-30T12:25:19.877 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-30T12:25:19.877 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-30T12:25:19.877 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-30T12:25:19.877 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_total_wal_size: 0 2024-03-30T12:25:19.877 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-30T12:25:19.877 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-30T12:25:19.878 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-30T12:25:19.878 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-30T12:25:19.878 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_open_files: -1 2024-03-30T12:25:19.878 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.bytes_per_sync: 0 2024-03-30T12:25:19.878 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-30T12:25:19.878 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-30T12:25:19.878 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.compaction_readahead_size: 0 2024-03-30T12:25:19.878 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_background_flushes: -1 2024-03-30T12:25:19.878 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Compression algorithms supported: 2024-03-30T12:25:19.878 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-30T12:25:19.878 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: kZSTD supported: 0 2024-03-30T12:25:19.878 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: kXpressCompression supported: 0 2024-03-30T12:25:19.878 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: kLZ4HCCompression supported: 1 2024-03-30T12:25:19.878 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: kZlibCompression supported: 1 2024-03-30T12:25:19.878 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: kSnappyCompression supported: 1 2024-03-30T12:25:19.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: kLZ4Compression supported: 1 2024-03-30T12:25:19.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: kBZip2Compression supported: 0 2024-03-30T12:25:19.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-30T12:25:19.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-30T12:25:19.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000010 2024-03-30T12:25:19.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-30T12:25:19.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-30T12:25:19.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.merge_operator: 2024-03-30T12:25:19.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.compaction_filter: None 2024-03-30T12:25:19.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.compaction_filter_factory: None 2024-03-30T12:25:19.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.sst_partitioner_factory: None 2024-03-30T12:25:19.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-30T12:25:19.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-30T12:25:19.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5557b58459e0) 2024-03-30T12:25:19.880 INFO:journalctl@ceph.mon.b.smithi162.stdout: cache_index_and_filter_blocks: 1 2024-03-30T12:25:19.880 INFO:journalctl@ceph.mon.b.smithi162.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-30T12:25:19.880 INFO:journalctl@ceph.mon.b.smithi162.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-30T12:25:19.880 INFO:journalctl@ceph.mon.b.smithi162.stdout: pin_top_level_index_and_filter: 1 2024-03-30T12:25:19.880 INFO:journalctl@ceph.mon.b.smithi162.stdout: index_type: 0 2024-03-30T12:25:19.880 INFO:journalctl@ceph.mon.b.smithi162.stdout: data_block_index_type: 0 2024-03-30T12:25:19.880 INFO:journalctl@ceph.mon.b.smithi162.stdout: index_shortening: 1 2024-03-30T12:25:19.880 INFO:journalctl@ceph.mon.b.smithi162.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-30T12:25:19.880 INFO:journalctl@ceph.mon.b.smithi162.stdout: checksum: 4 2024-03-30T12:25:19.880 INFO:journalctl@ceph.mon.b.smithi162.stdout: no_block_cache: 0 2024-03-30T12:25:19.880 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_cache: 0x5557b584b090 2024-03-30T12:25:19.880 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_cache_name: BinnedLRUCache 2024-03-30T12:25:19.880 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_cache_options: 2024-03-30T12:25:19.880 INFO:journalctl@ceph.mon.b.smithi162.stdout: capacity : 536870912 2024-03-30T12:25:19.880 INFO:journalctl@ceph.mon.b.smithi162.stdout: num_shard_bits : 4 2024-03-30T12:25:19.881 INFO:journalctl@ceph.mon.b.smithi162.stdout: strict_capacity_limit : 0 2024-03-30T12:25:19.881 INFO:journalctl@ceph.mon.b.smithi162.stdout: high_pri_pool_ratio: 0.000 2024-03-30T12:25:19.881 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_cache_compressed: (nil) 2024-03-30T12:25:19.881 INFO:journalctl@ceph.mon.b.smithi162.stdout: persistent_cache: (nil) 2024-03-30T12:25:19.881 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_size: 4096 2024-03-30T12:25:19.881 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_size_deviation: 10 2024-03-30T12:25:19.881 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_restart_interval: 16 2024-03-30T12:25:19.881 INFO:journalctl@ceph.mon.b.smithi162.stdout: index_block_restart_interval: 1 2024-03-30T12:25:19.881 INFO:journalctl@ceph.mon.b.smithi162.stdout: metadata_block_size: 4096 2024-03-30T12:25:19.881 INFO:journalctl@ceph.mon.b.smithi162.stdout: partition_filters: 0 2024-03-30T12:25:19.881 INFO:journalctl@ceph.mon.b.smithi162.stdout: use_delta_encoding: 1 2024-03-30T12:25:19.881 INFO:journalctl@ceph.mon.b.smithi162.stdout: filter_policy: bloomfilter 2024-03-30T12:25:19.881 INFO:journalctl@ceph.mon.b.smithi162.stdout: whole_key_filtering: 1 2024-03-30T12:25:19.881 INFO:journalctl@ceph.mon.b.smithi162.stdout: verify_compression: 0 2024-03-30T12:25:19.881 INFO:journalctl@ceph.mon.b.smithi162.stdout: read_amp_bytes_per_bit: 0 2024-03-30T12:25:19.882 INFO:journalctl@ceph.mon.b.smithi162.stdout: format_version: 5 2024-03-30T12:25:19.882 INFO:journalctl@ceph.mon.b.smithi162.stdout: enable_index_compression: 1 2024-03-30T12:25:19.882 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_align: 0 2024-03-30T12:25:19.882 INFO:journalctl@ceph.mon.b.smithi162.stdout: max_auto_readahead_size: 262144 2024-03-30T12:25:19.882 INFO:journalctl@ceph.mon.b.smithi162.stdout: prepopulate_block_cache: 0 2024-03-30T12:25:19.882 INFO:journalctl@ceph.mon.b.smithi162.stdout: initial_auto_readahead_size: 8192 2024-03-30T12:25:19.882 INFO:journalctl@ceph.mon.b.smithi162.stdout: num_file_reads_for_auto_readahead: 2 2024-03-30T12:25:19.882 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.write_buffer_size: 33554432 2024-03-30T12:25:19.882 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_write_buffer_number: 2 2024-03-30T12:25:19.882 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.compression: NoCompression 2024-03-30T12:25:19.882 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.bottommost_compression: Disabled 2024-03-30T12:25:19.882 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.prefix_extractor: nullptr 2024-03-30T12:25:19.882 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-30T12:25:19.882 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.num_levels: 7 2024-03-30T12:25:19.883 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-30T12:25:19.883 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-30T12:25:19.883 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-30T12:25:19.883 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-30T12:25:19.883 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-30T12:25:19.883 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-30T12:25:19.883 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-30T12:25:19.883 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-30T12:25:19.883 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-30T12:25:19.883 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-30T12:25:19.883 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-30T12:25:19.883 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-30T12:25:19.883 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-30T12:25:19.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.compression_opts.level: 32767 2024-03-30T12:25:19.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.compression_opts.strategy: 0 2024-03-30T12:25:19.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-30T12:25:19.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-30T12:25:19.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-30T12:25:19.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-30T12:25:19.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.compression_opts.enabled: false 2024-03-30T12:25:19.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-30T12:25:19.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-30T12:25:19.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-30T12:25:19.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-30T12:25:19.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.target_file_size_base: 67108864 2024-03-30T12:25:19.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-30T12:25:19.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-30T12:25:19.884 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-30T12:25:19.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-30T12:25:19.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-30T12:25:19.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-30T12:25:19.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-30T12:25:19.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-30T12:25:19.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-30T12:25:19.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-30T12:25:19.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-30T12:25:19.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-30T12:25:19.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-30T12:25:19.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-30T12:25:19.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.arena_block_size: 1048576 2024-03-30T12:25:19.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-30T12:25:19.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-30T12:25:19.886 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.disable_auto_compactions: 0 2024-03-30T12:25:19.886 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-30T12:25:19.886 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-30T12:25:19.886 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-30T12:25:19.886 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-30T12:25:19.886 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-30T12:25:19.886 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-30T12:25:19.886 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-30T12:25:19.886 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-30T12:25:19.886 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-30T12:25:19.886 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-30T12:25:19.886 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.table_properties_collectors: 2024-03-30T12:25:19.886 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.inplace_update_support: 0 2024-03-30T12:25:19.887 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-30T12:25:19.887 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-30T12:25:19.887 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-30T12:25:19.887 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-30T12:25:19.887 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.bloom_locality: 0 2024-03-30T12:25:19.887 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.max_successive_merges: 0 2024-03-30T12:25:19.887 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-30T12:25:19.887 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.paranoid_file_checks: 0 2024-03-30T12:25:19.887 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.force_consistency_checks: 1 2024-03-30T12:25:19.887 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.report_bg_io_stats: 0 2024-03-30T12:25:19.887 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.ttl: 2592000 2024-03-30T12:25:19.887 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-30T12:25:19.887 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-30T12:25:19.887 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-30T12:25:19.887 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.enable_blob_files: false 2024-03-30T12:25:19.888 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.min_blob_size: 0 2024-03-30T12:25:19.888 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.blob_file_size: 268435456 2024-03-30T12:25:19.888 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-30T12:25:19.888 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-30T12:25:19.888 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-30T12:25:19.888 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-30T12:25:19.888 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-30T12:25:19.888 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.blob_file_starting_level: 0 2024-03-30T12:25:19.888 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-30T12:25:19.888 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-30T12:25:19.888 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 13576, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-03-30T12:25:19.888 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-03-30T12:25:19.888 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ac8b1a12-694a-45e8-83c4-764ddf4323fb 2024-03-30T12:25:19.888 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711801519564765, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-03-30T12:25:19.889 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-03-30T12:25:19.889 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711801519590547, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 6671322, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 13581, "largest_seqno": 17285, "table_properties": {"data_size": 6655124, "index_size": 11081, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 4101, "raw_key_size": 37071, "raw_average_key_size": 22, "raw_value_size": 6621400, "raw_average_value_size": 4089, "num_data_blocks": 481, "num_entries": 1619, "num_filter_entries": 1619, "num_deletions": 290, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711801519, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ac8b1a12-694a-45e8-83c4-764ddf4323fb", "db_session_id": "CNUP0S6EISDS6B0YEYQP", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-03-30T12:25:19.889 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711801519590680, "job": 1, "event": "recovery_finished"} 2024-03-30T12:25:19.889 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-03-30T12:25:19.889 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-30T12:25:19.889 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-30T12:25:19.889 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5557b593e000 2024-03-30T12:25:19.889 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: DB pointer 0x5557b5928000 2024-03-30T12:25:19.889 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-30T12:25:19.889 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-30T12:25:19.889 INFO:journalctl@ceph.mon.b.smithi162.stdout: ** DB Stats ** 2024-03-30T12:25:19.889 INFO:journalctl@ceph.mon.b.smithi162.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T12:25:19.889 INFO:journalctl@ceph.mon.b.smithi162.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-30T12:25:19.889 INFO:journalctl@ceph.mon.b.smithi162.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T12:25:19.890 INFO:journalctl@ceph.mon.b.smithi162.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T12:25:19.890 INFO:journalctl@ceph.mon.b.smithi162.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-30T12:25:19.890 INFO:journalctl@ceph.mon.b.smithi162.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T12:25:19.890 INFO:journalctl@ceph.mon.b.smithi162.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T12:25:19.890 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-03-30T12:25:19.890 INFO:journalctl@ceph.mon.b.smithi162.stdout: ** Compaction Stats [default] ** 2024-03-30T12:25:19.890 INFO:journalctl@ceph.mon.b.smithi162.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T12:25:19.890 INFO:journalctl@ceph.mon.b.smithi162.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-30T12:25:19.890 INFO:journalctl@ceph.mon.b.smithi162.stdout: L0 1/0 6.36 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 543.6 0.01 0.00 1 0.012 0 0 0.0 0.0 2024-03-30T12:25:19.890 INFO:journalctl@ceph.mon.b.smithi162.stdout: L6 1/0 6.82 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-03-30T12:25:19.890 INFO:journalctl@ceph.mon.b.smithi162.stdout: Sum 2/0 13.18 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 543.6 0.01 0.00 1 0.012 0 0 0.0 0.0 2024-03-30T12:25:19.890 INFO:journalctl@ceph.mon.b.smithi162.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 543.6 0.01 0.00 1 0.012 0 0 0.0 0.0 2024-03-30T12:25:19.890 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-03-30T12:25:19.891 INFO:journalctl@ceph.mon.b.smithi162.stdout: ** Compaction Stats [default] ** 2024-03-30T12:25:19.891 INFO:journalctl@ceph.mon.b.smithi162.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T12:25:19.891 INFO:journalctl@ceph.mon.b.smithi162.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-30T12:25:19.891 INFO:journalctl@ceph.mon.b.smithi162.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 543.6 0.01 0.00 1 0.012 0 0 0.0 0.0 2024-03-30T12:25:19.891 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-03-30T12:25:19.891 INFO:journalctl@ceph.mon.b.smithi162.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-30T12:25:19.891 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-03-30T12:25:19.891 INFO:journalctl@ceph.mon.b.smithi162.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T12:25:19.891 INFO:journalctl@ceph.mon.b.smithi162.stdout: Flush(GB): cumulative 0.006, interval 0.006 2024-03-30T12:25:19.891 INFO:journalctl@ceph.mon.b.smithi162.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-30T12:25:19.891 INFO:journalctl@ceph.mon.b.smithi162.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-30T12:25:19.891 INFO:journalctl@ceph.mon.b.smithi162.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-30T12:25:19.891 INFO:journalctl@ceph.mon.b.smithi162.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-30T12:25:19.891 INFO:journalctl@ceph.mon.b.smithi162.stdout: Cumulative compaction: 0.01 GB write, 220.97 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T12:25:19.892 INFO:journalctl@ceph.mon.b.smithi162.stdout: Interval compaction: 0.01 GB write, 220.97 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T12:25:19.892 INFO:journalctl@ceph.mon.b.smithi162.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-30T12:25:19.892 INFO:journalctl@ceph.mon.b.smithi162.stdout: Block cache BinnedLRUCache@0x5557b584b090#2 capacity: 512.00 MB usage: 16.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-03-30T12:25:19.892 INFO:journalctl@ceph.mon.b.smithi162.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.53 KB,0.000864267%) IndexBlock(1,12.08 KB,0.00230372%) Misc(1,0.00 KB,0%) 2024-03-30T12:25:19.892 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-03-30T12:25:19.892 INFO:journalctl@ceph.mon.b.smithi162.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-30T12:25:19.892 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: starting mon.b rank 1 at public addrs [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] at bind addrs [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:25:19.892 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: mon.b@-1(???) e3 preinit fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:25:19.892 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: mon.b@-1(???).mds e6 new map 2024-03-30T12:25:19.892 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: mon.b@-1(???).mds e6 print_map 2024-03-30T12:25:19.892 INFO:journalctl@ceph.mon.b.smithi162.stdout: e6 2024-03-30T12:25:19.892 INFO:journalctl@ceph.mon.b.smithi162.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-30T12:25:19.892 INFO:journalctl@ceph.mon.b.smithi162.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-30T12:25:19.892 INFO:journalctl@ceph.mon.b.smithi162.stdout: legacy client fscid: 1 2024-03-30T12:25:19.892 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-03-30T12:25:19.893 INFO:journalctl@ceph.mon.b.smithi162.stdout: Filesystem 'cephfs' (1) 2024-03-30T12:25:19.893 INFO:journalctl@ceph.mon.b.smithi162.stdout: fs_name cephfs 2024-03-30T12:25:19.893 INFO:journalctl@ceph.mon.b.smithi162.stdout: epoch 6 2024-03-30T12:25:19.893 INFO:journalctl@ceph.mon.b.smithi162.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-30T12:25:19.893 INFO:journalctl@ceph.mon.b.smithi162.stdout: created 2024-03-30T12:19:00.832494+0000 2024-03-30T12:25:19.893 INFO:journalctl@ceph.mon.b.smithi162.stdout: modified 2024-03-30T12:19:02.842890+0000 2024-03-30T12:25:19.893 INFO:journalctl@ceph.mon.b.smithi162.stdout: tableserver 0 2024-03-30T12:25:19.893 INFO:journalctl@ceph.mon.b.smithi162.stdout: root 0 2024-03-30T12:25:19.893 INFO:journalctl@ceph.mon.b.smithi162.stdout: session_timeout 60 2024-03-30T12:25:19.893 INFO:journalctl@ceph.mon.b.smithi162.stdout: session_autoclose 300 2024-03-30T12:25:19.893 INFO:journalctl@ceph.mon.b.smithi162.stdout: max_file_size 1099511627776 2024-03-30T12:25:19.893 INFO:journalctl@ceph.mon.b.smithi162.stdout: max_xattr_size 65536 2024-03-30T12:25:19.893 INFO:journalctl@ceph.mon.b.smithi162.stdout: required_client_features {} 2024-03-30T12:25:19.893 INFO:journalctl@ceph.mon.b.smithi162.stdout: last_failure 0 2024-03-30T12:25:19.893 INFO:journalctl@ceph.mon.b.smithi162.stdout: last_failure_osd_epoch 0 2024-03-30T12:25:19.894 INFO:journalctl@ceph.mon.b.smithi162.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-30T12:25:19.894 INFO:journalctl@ceph.mon.b.smithi162.stdout: max_mds 1 2024-03-30T12:25:19.894 INFO:journalctl@ceph.mon.b.smithi162.stdout: in 0 2024-03-30T12:25:19.894 INFO:journalctl@ceph.mon.b.smithi162.stdout: up {0=24331} 2024-03-30T12:25:19.894 INFO:journalctl@ceph.mon.b.smithi162.stdout: failed 2024-03-30T12:25:19.894 INFO:journalctl@ceph.mon.b.smithi162.stdout: damaged 2024-03-30T12:25:19.894 INFO:journalctl@ceph.mon.b.smithi162.stdout: stopped 2024-03-30T12:25:19.894 INFO:journalctl@ceph.mon.b.smithi162.stdout: data_pools [3] 2024-03-30T12:25:19.894 INFO:journalctl@ceph.mon.b.smithi162.stdout: metadata_pool 2 2024-03-30T12:25:19.894 INFO:journalctl@ceph.mon.b.smithi162.stdout: inline_data disabled 2024-03-30T12:25:19.894 INFO:journalctl@ceph.mon.b.smithi162.stdout: balancer 2024-03-30T12:25:19.894 INFO:journalctl@ceph.mon.b.smithi162.stdout: bal_rank_mask -1 2024-03-30T12:25:19.894 INFO:journalctl@ceph.mon.b.smithi162.stdout: standby_count_wanted 0 2024-03-30T12:25:19.894 INFO:journalctl@ceph.mon.b.smithi162.stdout: [mds.b{0:24331} state up:active seq 3 addr [v2:172.21.15.162:6832/1272121665,v1:172.21.15.162:6833/1272121665] compat {c=[1],r=[1],i=[7ff]}] 2024-03-30T12:25:19.894 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-03-30T12:25:19.895 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-03-30T12:25:19.895 INFO:journalctl@ceph.mon.b.smithi162.stdout: Standby daemons: 2024-03-30T12:25:19.895 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-03-30T12:25:19.895 INFO:journalctl@ceph.mon.b.smithi162.stdout: [mds.a{-1:14448} state up:standby seq 1 addr [v2:172.21.15.84:6834/420740305,v1:172.21.15.84:6835/420740305] compat {c=[1],r=[1],i=[7ff]}] 2024-03-30T12:25:19.895 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: mon.b@-1(???).osd e245 crush map has features 3314933069573799936, adjusting msgr requires 2024-03-30T12:25:19.895 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: mon.b@-1(???).osd e245 crush map has features 432629308056666112, adjusting msgr requires 2024-03-30T12:25:19.895 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: mon.b@-1(???).osd e245 crush map has features 432629308056666112, adjusting msgr requires 2024-03-30T12:25:19.895 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: mon.b@-1(???).osd e245 crush map has features 432629308056666112, adjusting msgr requires 2024-03-30T12:25:19.895 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 ceph-mon[83709]: mon.b@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2024-03-30T12:25:19.895 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 bash[83690]: 149ae6649e0c574a1f1db7826e9c70277f61a3d34a743ad4a10dcc252a8ad511 2024-03-30T12:25:19.895 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:19 smithi162 systemd[1]: Started Ceph mon.b for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:25:19.954 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-30T12:25:19.954 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-03-30T12:25:19.954 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 1, 2024-03-30T12:25:19.954 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 2 2024-03-30T12:25:19.954 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:25:19.954 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-03-30T12:25:19.954 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 2 2024-03-30T12:25:19.954 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:25:19.954 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-03-30T12:25:19.954 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 8 2024-03-30T12:25:19.954 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:25:19.954 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-03-30T12:25:19.955 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 2 2024-03-30T12:25:19.955 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:25:19.955 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-03-30T12:25:19.955 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 11, 2024-03-30T12:25:19.955 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 4 2024-03-30T12:25:19.955 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-30T12:25:19.955 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-30T12:25:25.004 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:25:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:25:24.600+0000 7f1f562eb700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-30T12:25:25.145 INFO:tasks.rados.rados.0.smithi084.stdout:877: done (0 left) 2024-03-30T12:25:25.145 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 92 2024-03-30T12:25:25.145 INFO:tasks.rados.rados.0.smithi084.stdout:878: seq_num 285 ranges {4104192=778240,4882432=475136,5357568=475136,5832704=655360} 2024-03-30T12:25:25.173 INFO:tasks.rados.rados.0.smithi084.stdout:878: writing smithi08477944-25 from 4104192 to 4882432 tid 1 2024-03-30T12:25:25.175 INFO:tasks.rados.rados.0.smithi084.stdout:878: writing smithi08477944-25 from 4882432 to 5357568 tid 2 2024-03-30T12:25:25.178 INFO:tasks.rados.rados.0.smithi084.stdout:878: writing smithi08477944-25 from 5357568 to 5832704 tid 3 2024-03-30T12:25:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:878: writing smithi08477944-25 from 5832704 to 6488064 tid 4 2024-03-30T12:25:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:879: copy_from oid 1 from oid 10 current snap is 92 2024-03-30T12:25:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:878: finishing write tid 1 to smithi08477944-25 2024-03-30T12:25:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:878: finishing write tid 2 to smithi08477944-25 2024-03-30T12:25:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:878: finishing write tid 3 to smithi08477944-25 2024-03-30T12:25:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:880: read oid 46 snap -1 2024-03-30T12:25:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:880: expect deleted 2024-03-30T12:25:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 92 2024-03-30T12:25:25.184 INFO:tasks.rados.rados.0.smithi084.stdout:881: seq_num 286 ranges {4587520=794624,5382144=761856,6144000=679936,6823936=163840} 2024-03-30T12:25:25.212 INFO:tasks.rados.rados.0.smithi084.stdout:881: writing smithi08477944-24 from 4587520 to 5382144 tid 1 2024-03-30T12:25:25.216 INFO:tasks.rados.rados.0.smithi084.stdout:881: writing smithi08477944-24 from 5382144 to 6144000 tid 2 2024-03-30T12:25:25.219 INFO:tasks.rados.rados.0.smithi084.stdout:881: writing smithi08477944-24 from 6144000 to 6823936 tid 3 2024-03-30T12:25:25.220 INFO:tasks.rados.rados.0.smithi084.stdout:881: writing smithi08477944-24 from 6823936 to 6987776 tid 4 2024-03-30T12:25:25.220 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 92 2024-03-30T12:25:25.221 INFO:tasks.rados.rados.0.smithi084.stdout:882: seq_num 287 ranges {2236416=8192} 2024-03-30T12:25:25.234 INFO:tasks.rados.rados.0.smithi084.stdout:882: writing smithi08477944-5 from 2236416 to 2244608 tid 1 2024-03-30T12:25:25.234 INFO:tasks.rados.rados.0.smithi084.stdout:883: rollback oid 26 current snap is 92 2024-03-30T12:25:25.234 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 26 to 65 2024-03-30T12:25:25.234 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 92 2024-03-30T12:25:25.234 INFO:tasks.rados.rados.0.smithi084.stdout:884: seq_num 288 ranges {0=24576} 2024-03-30T12:25:25.235 INFO:tasks.rados.rados.0.smithi084.stdout:884: writing smithi08477944-37 from 0 to 24576 tid 1 2024-03-30T12:25:25.235 INFO:tasks.rados.rados.0.smithi084.stdout:885: copy_from oid 35 from oid 18 current snap is 92 2024-03-30T12:25:25.235 INFO:tasks.rados.rados.0.smithi084.stdout:878: finishing write tid 4 to smithi08477944-25 2024-03-30T12:25:25.235 INFO:tasks.rados.rados.0.smithi084.stdout:878: finishing write tid 5 to smithi08477944-25 2024-03-30T12:25:25.235 INFO:tasks.rados.rados.0.smithi084.stdout:878: finishing write tid 6 to smithi08477944-25 2024-03-30T12:25:25.235 INFO:tasks.rados.rados.0.smithi084.stdout:878: oid 25 updating version 0 to 418 2024-03-30T12:25:25.235 INFO:tasks.rados.rados.0.smithi084.stdout:878: oid 25 updating version 418 to 419 2024-03-30T12:25:25.235 INFO:tasks.rados.rados.0.smithi084.stdout:878: oid 25 updating version 419 to 421 2024-03-30T12:25:25.235 INFO:tasks.rados.rados.0.smithi084.stdout:878: oid 25 version 421 is already newer than 420 2024-03-30T12:25:25.235 INFO:tasks.rados.rados.0.smithi084.stdout:878: oid 25 version 421 is already newer than 417 2024-03-30T12:25:25.235 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 421 (ObjNum 285 snap 92 seq_num 285) dirty exists 2024-03-30T12:25:25.235 INFO:tasks.rados.rados.0.smithi084.stdout:878: left oid 25 (ObjNum 285 snap 92 seq_num 285) 2024-03-30T12:25:25.235 INFO:tasks.rados.rados.0.smithi084.stdout:879: finishing copy_from racing read to smithi08477944-1 2024-03-30T12:25:25.235 INFO:tasks.rados.rados.0.smithi084.stdout:878: done (7 left) 2024-03-30T12:25:25.235 INFO:tasks.rados.rados.0.smithi084.stdout:880: done (6 left) 2024-03-30T12:25:25.235 INFO:tasks.rados.rados.0.smithi084.stdout:886: copy_from oid 20 from oid 50 current snap is 92 2024-03-30T12:25:25.236 INFO:tasks.rados.rados.0.smithi084.stdout:879: finishing copy_from to smithi08477944-1 2024-03-30T12:25:25.236 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 321 (ObjNum 239 snap 75 seq_num 239) dirty exists 2024-03-30T12:25:25.236 INFO:tasks.rados.rados.0.smithi084.stdout:881: finishing write tid 1 to smithi08477944-24 2024-03-30T12:25:25.236 INFO:tasks.rados.rados.0.smithi084.stdout:881: finishing write tid 2 to smithi08477944-24 2024-03-30T12:25:25.236 INFO:tasks.rados.rados.0.smithi084.stdout:881: finishing write tid 3 to smithi08477944-24 2024-03-30T12:25:25.236 INFO:tasks.rados.rados.0.smithi084.stdout:881: finishing write tid 4 to smithi08477944-24 2024-03-30T12:25:25.236 INFO:tasks.rados.rados.0.smithi084.stdout:881: finishing write tid 5 to smithi08477944-24 2024-03-30T12:25:25.236 INFO:tasks.rados.rados.0.smithi084.stdout:879: done (6 left) 2024-03-30T12:25:25.236 INFO:tasks.rados.rados.0.smithi084.stdout:887: read oid 6 snap -1 2024-03-30T12:25:25.236 INFO:tasks.rados.rados.0.smithi084.stdout:887: expect (ObjNum 218 snap 64 seq_num 218) 2024-03-30T12:25:25.236 INFO:tasks.rados.rados.0.smithi084.stdout:888: setattr oid 16 current snap is 92 2024-03-30T12:25:25.236 INFO:tasks.rados.rados.0.smithi084.stdout:881: finishing write tid 6 to smithi08477944-24 2024-03-30T12:25:25.236 INFO:tasks.rados.rados.0.smithi084.stdout:881: oid 24 updating version 0 to 172 2024-03-30T12:25:25.236 INFO:tasks.rados.rados.0.smithi084.stdout:881: oid 24 version 172 is already newer than 168 2024-03-30T12:25:25.236 INFO:tasks.rados.rados.0.smithi084.stdout:881: oid 24 version 172 is already newer than 170 2024-03-30T12:25:25.237 INFO:tasks.rados.rados.0.smithi084.stdout:881: oid 24 version 172 is already newer than 171 2024-03-30T12:25:25.237 INFO:tasks.rados.rados.0.smithi084.stdout:881: oid 24 version 172 is already newer than 169 2024-03-30T12:25:25.237 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 172 (ObjNum 286 snap 92 seq_num 286) dirty exists 2024-03-30T12:25:25.237 INFO:tasks.rados.rados.0.smithi084.stdout:881: left oid 24 (ObjNum 286 snap 92 seq_num 286) 2024-03-30T12:25:25.239 INFO:tasks.rados.rados.0.smithi084.stdout:881: done (7 left) 2024-03-30T12:25:25.239 INFO:tasks.rados.rados.0.smithi084.stdout:889: rollback oid 29 current snap is 92 2024-03-30T12:25:25.239 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 29 to 88 2024-03-30T12:25:25.239 INFO:tasks.rados.rados.0.smithi084.stdout:890: rollback oid 17 current snap is 92 2024-03-30T12:25:25.239 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 17 to 89 2024-03-30T12:25:25.239 INFO:tasks.rados.rados.0.smithi084.stdout:891: read oid 49 snap -1 2024-03-30T12:25:25.239 INFO:tasks.rados.rados.0.smithi084.stdout:891: expect (ObjNum 181 snap 50 seq_num 181) 2024-03-30T12:25:25.239 INFO:tasks.rados.rados.0.smithi084.stdout:892: rollback oid 21 current snap is 92 2024-03-30T12:25:25.239 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 21 to 89 2024-03-30T12:25:25.239 INFO:tasks.rados.rados.0.smithi084.stdout:893: delete oid 22 current snap is 92 2024-03-30T12:25:25.239 INFO:tasks.rados.rados.0.smithi084.stdout:884: finishing write tid 1 to smithi08477944-37 2024-03-30T12:25:25.239 INFO:tasks.rados.rados.0.smithi084.stdout:885: finishing copy_from racing read to smithi08477944-35 2024-03-30T12:25:25.240 INFO:tasks.rados.rados.0.smithi084.stdout:883: finishing rollback tid 0 to smithi08477944-26 2024-03-30T12:25:25.240 INFO:tasks.rados.rados.0.smithi084.stdout:884: finishing write tid 2 to smithi08477944-37 2024-03-30T12:25:25.240 INFO:tasks.rados.rados.0.smithi084.stdout:882: finishing write tid 1 to smithi08477944-5 2024-03-30T12:25:25.241 INFO:tasks.rados.rados.0.smithi084.stdout:882: finishing write tid 2 to smithi08477944-5 2024-03-30T12:25:25.242 INFO:tasks.rados.rados.0.smithi084.stdout:883: finishing rollback tid 1 to smithi08477944-26 2024-03-30T12:25:25.246 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 459 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-03-30T12:25:25.246 INFO:tasks.rados.rados.0.smithi084.stdout:884: finishing write tid 3 to smithi08477944-37 2024-03-30T12:25:25.246 INFO:tasks.rados.rados.0.smithi084.stdout:884: oid 37 updating version 0 to 376 2024-03-30T12:25:25.246 INFO:tasks.rados.rados.0.smithi084.stdout:884: oid 37 updating version 376 to 377 2024-03-30T12:25:25.247 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 377 (ObjNum 288 snap 92 seq_num 288) dirty exists 2024-03-30T12:25:25.247 INFO:tasks.rados.rados.0.smithi084.stdout:884: left oid 37 (ObjNum 288 snap 92 seq_num 288) 2024-03-30T12:25:25.247 INFO:tasks.rados.rados.0.smithi084.stdout:887: expect (ObjNum 218 snap 64 seq_num 218) 2024-03-30T12:25:25.280 INFO:tasks.rados.rados.0.smithi084.stdout:885: finishing copy_from to smithi08477944-35 2024-03-30T12:25:25.281 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 407 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:25:25.281 INFO:tasks.rados.rados.0.smithi084.stdout:882: finishing write tid 3 to smithi08477944-5 2024-03-30T12:25:25.281 INFO:tasks.rados.rados.0.smithi084.stdout:882: oid 5 updating version 0 to 422 2024-03-30T12:25:25.281 INFO:tasks.rados.rados.0.smithi084.stdout:882: oid 5 updating version 422 to 423 2024-03-30T12:25:25.281 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 423 (ObjNum 287 snap 92 seq_num 287) dirty exists 2024-03-30T12:25:25.281 INFO:tasks.rados.rados.0.smithi084.stdout:882: left oid 5 (ObjNum 287 snap 92 seq_num 287) 2024-03-30T12:25:25.281 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 544 (ObjNum 33 snap 0 seq_num 1429517776) dirty exists 2024-03-30T12:25:25.281 INFO:tasks.rados.rados.0.smithi084.stdout:889: finishing rollback tid 0 to smithi08477944-29 2024-03-30T12:25:25.281 INFO:tasks.rados.rados.0.smithi084.stdout:890: finishing rollback tid 0 to smithi08477944-17 2024-03-30T12:25:25.281 INFO:tasks.rados.rados.0.smithi084.stdout:890: finishing rollback tid 1 to smithi08477944-17 2024-03-30T12:25:25.281 INFO:tasks.rados.rados.0.smithi084.stdout:882: done (11 left) 2024-03-30T12:25:25.281 INFO:tasks.rados.rados.0.smithi084.stdout:883: done (10 left) 2024-03-30T12:25:25.281 INFO:tasks.rados.rados.0.smithi084.stdout:884: done (9 left) 2024-03-30T12:25:25.281 INFO:tasks.rados.rados.0.smithi084.stdout:885: done (8 left) 2024-03-30T12:25:25.281 INFO:tasks.rados.rados.0.smithi084.stdout:887: done (7 left) 2024-03-30T12:25:25.282 INFO:tasks.rados.rados.0.smithi084.stdout:888: done (6 left) 2024-03-30T12:25:25.282 INFO:tasks.rados.rados.0.smithi084.stdout:893: done (5 left) 2024-03-30T12:25:25.282 INFO:tasks.rados.rados.0.smithi084.stdout:894: copy_from oid 15 from oid 6 current snap is 92 2024-03-30T12:25:25.282 INFO:tasks.rados.rados.0.smithi084.stdout:892: finishing rollback tid 0 to smithi08477944-21 2024-03-30T12:25:25.282 INFO:tasks.rados.rados.0.smithi084.stdout:892: finishing rollback tid 1 to smithi08477944-21 2024-03-30T12:25:25.282 INFO:tasks.rados.rados.0.smithi084.stdout:892: finishing rollback tid 2 to smithi08477944-21 2024-03-30T12:25:25.282 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 410 (ObjNum 113 snap 0 seq_num 1532996928) dirty exists 2024-03-30T12:25:25.282 INFO:tasks.rados.rados.0.smithi084.stdout:889: finishing rollback tid 1 to smithi08477944-29 2024-03-30T12:25:25.282 INFO:tasks.rados.rados.0.smithi084.stdout:889: finishing rollback tid 2 to smithi08477944-29 2024-03-30T12:25:25.282 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 380 (ObjNum 142 snap 36 seq_num 142) dirty exists 2024-03-30T12:25:25.282 INFO:tasks.rados.rados.0.smithi084.stdout:891: expect (ObjNum 181 snap 50 seq_num 181) 2024-03-30T12:25:25.392 INFO:tasks.rados.rados.0.smithi084.stdout:890: finishing rollback tid 2 to smithi08477944-17 2024-03-30T12:25:25.393 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 407 (ObjNum 275 snap 88 seq_num 275) dirty exists 2024-03-30T12:25:25.393 INFO:tasks.rados.rados.0.smithi084.stdout:886: finishing copy_from racing read to smithi08477944-20 2024-03-30T12:25:25.393 INFO:tasks.rados.rados.0.smithi084.stdout:886: finishing copy_from to smithi08477944-20 2024-03-30T12:25:25.393 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 467 (ObjNum 267 snap 84 seq_num 267) dirty exists 2024-03-30T12:25:25.393 INFO:tasks.rados.rados.0.smithi084.stdout:886: done (5 left) 2024-03-30T12:25:25.393 INFO:tasks.rados.rados.0.smithi084.stdout:889: done (4 left) 2024-03-30T12:25:25.393 INFO:tasks.rados.rados.0.smithi084.stdout:890: done (3 left) 2024-03-30T12:25:25.393 INFO:tasks.rados.rados.0.smithi084.stdout:891: done (2 left) 2024-03-30T12:25:25.393 INFO:tasks.rados.rados.0.smithi084.stdout:892: done (1 left) 2024-03-30T12:25:25.393 INFO:tasks.rados.rados.0.smithi084.stdout:895: setattr oid 3 current snap is 92 2024-03-30T12:25:25.393 INFO:tasks.rados.rados.0.smithi084.stdout:894: finishing copy_from racing read to smithi08477944-15 2024-03-30T12:25:25.393 INFO:tasks.rados.rados.0.smithi084.stdout:894: finishing copy_from to smithi08477944-15 2024-03-30T12:25:25.394 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 215 (ObjNum 218 snap 64 seq_num 218) dirty exists 2024-03-30T12:25:25.394 INFO:tasks.rados.rados.0.smithi084.stdout:894: done (1 left) 2024-03-30T12:25:25.395 INFO:tasks.rados.rados.0.smithi084.stdout:896: snap_create 2024-03-30T12:25:25.397 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 462 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-03-30T12:25:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:25:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[91810]: mon.a calling monitor election 2024-03-30T12:25:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[91810]: mon.c calling monitor election 2024-03-30T12:25:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:25:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:25:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[91810]: mon.b calling monitor election 2024-03-30T12:25:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[91810]: pgmap v48: 121 pgs: 121 active+clean; 170 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 170 B/s rd, 856 KiB/s wr, 2 op/s 2024-03-30T12:25:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[91810]: pgmap v49: 121 pgs: 121 active+clean; 170 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-03-30T12:25:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[91810]: pgmap v50: 121 pgs: 121 active+clean; 170 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-03-30T12:25:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[91810]: mon.a is new leader, mons a,c in quorum (ranks 0,2) 2024-03-30T12:25:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[91810]: overall HEALTH_OK 2024-03-30T12:25:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[91810]: mon.a calling monitor election 2024-03-30T12:25:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[91810]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-30T12:25:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[91810]: monmap e4: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-30T12:25:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[91810]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-30T12:25:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[91810]: osdmap e245: 8 total, 8 up, 8 in 2024-03-30T12:25:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[91810]: mgrmap e41: y(active, since 40s), standbys: x 2024-03-30T12:25:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[91810]: overall HEALTH_OK 2024-03-30T12:25:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:25:25.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:25:25.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[89279]: mon.a calling monitor election 2024-03-30T12:25:25.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[89279]: mon.c calling monitor election 2024-03-30T12:25:25.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:25:25.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:25:25.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[89279]: mon.b calling monitor election 2024-03-30T12:25:25.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[89279]: pgmap v48: 121 pgs: 121 active+clean; 170 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 170 B/s rd, 856 KiB/s wr, 2 op/s 2024-03-30T12:25:25.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[89279]: pgmap v49: 121 pgs: 121 active+clean; 170 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-03-30T12:25:25.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[89279]: pgmap v50: 121 pgs: 121 active+clean; 170 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-03-30T12:25:25.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[89279]: mon.a is new leader, mons a,c in quorum (ranks 0,2) 2024-03-30T12:25:25.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[89279]: overall HEALTH_OK 2024-03-30T12:25:25.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[89279]: mon.a calling monitor election 2024-03-30T12:25:25.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[89279]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-30T12:25:25.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[89279]: monmap e4: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-30T12:25:25.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[89279]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-30T12:25:25.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[89279]: osdmap e245: 8 total, 8 up, 8 in 2024-03-30T12:25:25.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[89279]: mgrmap e41: y(active, since 40s), standbys: x 2024-03-30T12:25:25.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[89279]: overall HEALTH_OK 2024-03-30T12:25:25.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:25.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:25.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:25:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T12:25:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:25 smithi162 ceph-mon[83709]: mon.a calling monitor election 2024-03-30T12:25:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:25 smithi162 ceph-mon[83709]: mon.c calling monitor election 2024-03-30T12:25:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T12:25:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T12:25:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:25 smithi162 ceph-mon[83709]: mon.b calling monitor election 2024-03-30T12:25:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:25 smithi162 ceph-mon[83709]: pgmap v48: 121 pgs: 121 active+clean; 170 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 170 B/s rd, 856 KiB/s wr, 2 op/s 2024-03-30T12:25:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:25 smithi162 ceph-mon[83709]: pgmap v49: 121 pgs: 121 active+clean; 170 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-03-30T12:25:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:25 smithi162 ceph-mon[83709]: pgmap v50: 121 pgs: 121 active+clean; 170 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-03-30T12:25:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:25 smithi162 ceph-mon[83709]: mon.a is new leader, mons a,c in quorum (ranks 0,2) 2024-03-30T12:25:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:25 smithi162 ceph-mon[83709]: overall HEALTH_OK 2024-03-30T12:25:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:25 smithi162 ceph-mon[83709]: mon.a calling monitor election 2024-03-30T12:25:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:25 smithi162 ceph-mon[83709]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-30T12:25:25.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:25 smithi162 ceph-mon[83709]: monmap e4: 3 mons at {a=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],b=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0],c=[v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-30T12:25:25.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:25 smithi162 ceph-mon[83709]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-30T12:25:25.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:25 smithi162 ceph-mon[83709]: osdmap e245: 8 total, 8 up, 8 in 2024-03-30T12:25:25.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:25 smithi162 ceph-mon[83709]: mgrmap e41: y(active, since 40s), standbys: x 2024-03-30T12:25:25.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:25 smithi162 ceph-mon[83709]: overall HEALTH_OK 2024-03-30T12:25:25.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:25.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:25.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:25:26.156 INFO:tasks.rados.rados.0.smithi084.stdout:895: done (1 left) 2024-03-30T12:25:26.157 INFO:tasks.rados.rados.0.smithi084.stdout:896: done (0 left) 2024-03-30T12:25:26.157 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 93 2024-03-30T12:25:26.157 INFO:tasks.rados.rados.0.smithi084.stdout:897: seq_num 290 ranges {1261568=57344} 2024-03-30T12:25:26.164 INFO:tasks.rados.rados.0.smithi084.stdout:897: writing smithi08477944-6 from 1261568 to 1318912 tid 1 2024-03-30T12:25:26.164 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 93 2024-03-30T12:25:26.164 INFO:tasks.rados.rados.0.smithi084.stdout:898: seq_num 291 ranges {7307264=81920} 2024-03-30T12:25:26.205 INFO:tasks.rados.rados.0.smithi084.stdout:898: writing smithi08477944-44 from 7307264 to 7389184 tid 1 2024-03-30T12:25:26.205 INFO:tasks.rados.rados.0.smithi084.stdout:899: read oid 50 snap -1 2024-03-30T12:25:26.205 INFO:tasks.rados.rados.0.smithi084.stdout:899: expect (ObjNum 267 snap 84 seq_num 267) 2024-03-30T12:25:26.205 INFO:tasks.rados.rados.0.smithi084.stdout:900: copy_from oid 1 from oid 25 current snap is 93 2024-03-30T12:25:26.205 INFO:tasks.rados.rados.0.smithi084.stdout:897: finishing write tid 1 to smithi08477944-6 2024-03-30T12:25:26.205 INFO:tasks.rados.rados.0.smithi084.stdout:897: finishing write tid 2 to smithi08477944-6 2024-03-30T12:25:26.205 INFO:tasks.rados.rados.0.smithi084.stdout:897: finishing write tid 3 to smithi08477944-6 2024-03-30T12:25:26.205 INFO:tasks.rados.rados.0.smithi084.stdout:897: oid 6 updating version 0 to 534 2024-03-30T12:25:26.205 INFO:tasks.rados.rados.0.smithi084.stdout:897: oid 6 updating version 534 to 535 2024-03-30T12:25:26.205 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 535 (ObjNum 290 snap 93 seq_num 290) dirty exists 2024-03-30T12:25:26.205 INFO:tasks.rados.rados.0.smithi084.stdout:897: left oid 6 (ObjNum 290 snap 93 seq_num 290) 2024-03-30T12:25:26.205 INFO:tasks.rados.rados.0.smithi084.stdout:897: done (3 left) 2024-03-30T12:25:26.205 INFO:tasks.rados.rados.0.smithi084.stdout:901: read oid 29 snap 92 2024-03-30T12:25:26.206 INFO:tasks.rados.rados.0.smithi084.stdout:901: expect (ObjNum 142 snap 36 seq_num 142) 2024-03-30T12:25:26.206 INFO:tasks.rados.rados.0.smithi084.stdout:902: read oid 32 snap -1 2024-03-30T12:25:26.206 INFO:tasks.rados.rados.0.smithi084.stdout:902: expect deleted 2024-03-30T12:25:26.206 INFO:tasks.rados.rados.0.smithi084.stdout:903: copy_from oid 22 from oid 5 current snap is 93 2024-03-30T12:25:26.206 INFO:tasks.rados.rados.0.smithi084.stdout:904: setattr oid 24 current snap is 93 2024-03-30T12:25:26.206 INFO:tasks.rados.rados.0.smithi084.stdout:905: delete oid 8 current snap is 93 2024-03-30T12:25:26.209 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 173 (ObjNum 286 snap 92 seq_num 286) dirty exists 2024-03-30T12:25:26.209 INFO:tasks.rados.rados.0.smithi084.stdout:904: done (7 left) 2024-03-30T12:25:26.209 INFO:tasks.rados.rados.0.smithi084.stdout:905: done (6 left) 2024-03-30T12:25:26.209 INFO:tasks.rados.rados.0.smithi084.stdout:906: setattr oid 12 current snap is 93 2024-03-30T12:25:26.209 INFO:tasks.rados.rados.0.smithi084.stdout:898: finishing write tid 1 to smithi08477944-44 2024-03-30T12:25:26.210 INFO:tasks.rados.rados.0.smithi084.stdout:898: finishing write tid 2 to smithi08477944-44 2024-03-30T12:25:26.211 INFO:tasks.rados.rados.0.smithi084.stdout:898: finishing write tid 3 to smithi08477944-44 2024-03-30T12:25:26.211 INFO:tasks.rados.rados.0.smithi084.stdout:898: oid 44 updating version 0 to 537 2024-03-30T12:25:26.211 INFO:tasks.rados.rados.0.smithi084.stdout:898: oid 44 version 537 is already newer than 536 2024-03-30T12:25:26.211 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 537 (ObjNum 291 snap 93 seq_num 291) dirty exists 2024-03-30T12:25:26.211 INFO:tasks.rados.rados.0.smithi084.stdout:898: left oid 44 (ObjNum 291 snap 93 seq_num 291) 2024-03-30T12:25:26.211 INFO:tasks.rados.rados.0.smithi084.stdout:898: done (6 left) 2024-03-30T12:25:26.211 INFO:tasks.rados.rados.0.smithi084.stdout:902: done (5 left) 2024-03-30T12:25:26.212 INFO:tasks.rados.rados.0.smithi084.stdout:907: snap_create 2024-03-30T12:25:26.214 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 408 (ObjNum 225 snap 0 seq_num 1428786768) dirty exists 2024-03-30T12:25:26.217 INFO:tasks.rados.rados.0.smithi084.stdout:903: finishing copy_from racing read to smithi08477944-22 2024-03-30T12:25:26.221 INFO:tasks.rados.rados.0.smithi084.stdout:903: finishing copy_from to smithi08477944-22 2024-03-30T12:25:26.222 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 423 (ObjNum 287 snap 92 seq_num 287) dirty exists 2024-03-30T12:25:26.224 INFO:tasks.rados.rados.0.smithi084.stdout:901: expect (ObjNum 142 snap 36 seq_num 142) 2024-03-30T12:25:26.353 INFO:tasks.rados.rados.0.smithi084.stdout:899: expect (ObjNum 267 snap 84 seq_num 267) 2024-03-30T12:25:26.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:26 smithi162 ceph-mon[83709]: osdmap e246: 8 total, 8 up, 8 in 2024-03-30T12:25:26.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:26 smithi084 ceph-mon[91810]: osdmap e246: 8 total, 8 up, 8 in 2024-03-30T12:25:26.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:26 smithi084 ceph-mon[89279]: osdmap e246: 8 total, 8 up, 8 in 2024-03-30T12:25:26.504 INFO:tasks.rados.rados.0.smithi084.stdout:900: finishing copy_from racing read to smithi08477944-1 2024-03-30T12:25:26.504 INFO:tasks.rados.rados.0.smithi084.stdout:900: finishing copy_from to smithi08477944-1 2024-03-30T12:25:26.504 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 421 (ObjNum 285 snap 92 seq_num 285) dirty exists 2024-03-30T12:25:27.163 INFO:tasks.rados.rados.0.smithi084.stdout:899: done (5 left) 2024-03-30T12:25:27.163 INFO:tasks.rados.rados.0.smithi084.stdout:900: done (4 left) 2024-03-30T12:25:27.164 INFO:tasks.rados.rados.0.smithi084.stdout:901: done (3 left) 2024-03-30T12:25:27.164 INFO:tasks.rados.rados.0.smithi084.stdout:903: done (2 left) 2024-03-30T12:25:27.164 INFO:tasks.rados.rados.0.smithi084.stdout:906: done (1 left) 2024-03-30T12:25:27.164 INFO:tasks.rados.rados.0.smithi084.stdout:907: done (0 left) 2024-03-30T12:25:27.164 INFO:tasks.rados.rados.0.smithi084.stdout:908: read oid 42 snap -1 2024-03-30T12:25:27.164 INFO:tasks.rados.rados.0.smithi084.stdout:908: expect deleted 2024-03-30T12:25:27.164 INFO:tasks.rados.rados.0.smithi084.stdout:909: snap_remove snap 87 2024-03-30T12:25:27.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:27 smithi084 ceph-mon[91810]: osdmap e247: 8 total, 8 up, 8 in 2024-03-30T12:25:27.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:27 smithi084 ceph-mon[91810]: pgmap v53: 121 pgs: 121 active+clean; 181 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2024-03-30T12:25:27.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:27 smithi084 ceph-mon[89279]: osdmap e247: 8 total, 8 up, 8 in 2024-03-30T12:25:27.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:27 smithi084 ceph-mon[89279]: pgmap v53: 121 pgs: 121 active+clean; 181 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2024-03-30T12:25:27.531 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:27 smithi162 ceph-mon[83709]: osdmap e247: 8 total, 8 up, 8 in 2024-03-30T12:25:27.532 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:27 smithi162 ceph-mon[83709]: pgmap v53: 121 pgs: 121 active+clean; 181 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2024-03-30T12:25:28.173 INFO:tasks.rados.rados.0.smithi084.stdout:909: done (1 left) 2024-03-30T12:25:28.173 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 94 2024-03-30T12:25:28.173 INFO:tasks.rados.rados.0.smithi084.stdout:910: seq_num 293 ranges {6488064=114688} 2024-03-30T12:25:28.210 INFO:tasks.rados.rados.0.smithi084.stdout:910: writing smithi08477944-1 from 6488064 to 6602752 tid 1 2024-03-30T12:25:28.210 INFO:tasks.rados.rados.0.smithi084.stdout:911: copy_from oid 3 from oid 29 current snap is 94 2024-03-30T12:25:28.210 INFO:tasks.rados.rados.0.smithi084.stdout:908: done (2 left) 2024-03-30T12:25:28.210 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 94 2024-03-30T12:25:28.210 INFO:tasks.rados.rados.0.smithi084.stdout:912: seq_num 294 ranges {6488064=131072} 2024-03-30T12:25:28.245 INFO:tasks.rados.rados.0.smithi084.stdout:912: writing smithi08477944-25 from 6488064 to 6619136 tid 1 2024-03-30T12:25:28.246 INFO:tasks.rados.rados.0.smithi084.stdout:913: snap_remove snap 80 2024-03-30T12:25:28.471 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:28 smithi162 ceph-mon[83709]: osdmap e248: 8 total, 8 up, 8 in 2024-03-30T12:25:28.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:28 smithi084 ceph-mon[91810]: osdmap e248: 8 total, 8 up, 8 in 2024-03-30T12:25:28.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:28 smithi084 ceph-mon[89279]: osdmap e248: 8 total, 8 up, 8 in 2024-03-30T12:25:29.179 INFO:tasks.rados.rados.0.smithi084.stdout:910: finishing write tid 1 to smithi08477944-1 2024-03-30T12:25:29.179 INFO:tasks.rados.rados.0.smithi084.stdout:910: finishing write tid 2 to smithi08477944-1 2024-03-30T12:25:29.179 INFO:tasks.rados.rados.0.smithi084.stdout:910: finishing write tid 3 to smithi08477944-1 2024-03-30T12:25:29.179 INFO:tasks.rados.rados.0.smithi084.stdout:910: oid 1 updating version 0 to 423 2024-03-30T12:25:29.179 INFO:tasks.rados.rados.0.smithi084.stdout:910: oid 1 version 423 is already newer than 422 2024-03-30T12:25:29.179 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 423 (ObjNum 293 snap 94 seq_num 293) dirty exists 2024-03-30T12:25:29.179 INFO:tasks.rados.rados.0.smithi084.stdout:910: left oid 1 (ObjNum 293 snap 94 seq_num 293) 2024-03-30T12:25:29.180 INFO:tasks.rados.rados.0.smithi084.stdout:911: finishing copy_from racing read to smithi08477944-3 2024-03-30T12:25:29.180 INFO:tasks.rados.rados.0.smithi084.stdout:911: finishing copy_from to smithi08477944-3 2024-03-30T12:25:29.180 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 380 (ObjNum 142 snap 36 seq_num 142) dirty exists 2024-03-30T12:25:29.180 INFO:tasks.rados.rados.0.smithi084.stdout:912: finishing write tid 1 to smithi08477944-25 2024-03-30T12:25:29.180 INFO:tasks.rados.rados.0.smithi084.stdout:912: finishing write tid 2 to smithi08477944-25 2024-03-30T12:25:29.180 INFO:tasks.rados.rados.0.smithi084.stdout:912: finishing write tid 3 to smithi08477944-25 2024-03-30T12:25:29.180 INFO:tasks.rados.rados.0.smithi084.stdout:912: oid 25 updating version 0 to 425 2024-03-30T12:25:29.180 INFO:tasks.rados.rados.0.smithi084.stdout:912: oid 25 version 425 is already newer than 424 2024-03-30T12:25:29.180 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 425 (ObjNum 294 snap 94 seq_num 294) dirty exists 2024-03-30T12:25:29.180 INFO:tasks.rados.rados.0.smithi084.stdout:912: left oid 25 (ObjNum 294 snap 94 seq_num 294) 2024-03-30T12:25:29.180 INFO:tasks.rados.rados.0.smithi084.stdout:910: done (3 left) 2024-03-30T12:25:29.180 INFO:tasks.rados.rados.0.smithi084.stdout:911: done (2 left) 2024-03-30T12:25:29.180 INFO:tasks.rados.rados.0.smithi084.stdout:912: done (1 left) 2024-03-30T12:25:29.180 INFO:tasks.rados.rados.0.smithi084.stdout:913: done (0 left) 2024-03-30T12:25:29.180 INFO:tasks.rados.rados.0.smithi084.stdout:914: delete oid 38 current snap is 94 2024-03-30T12:25:29.186 INFO:tasks.rados.rados.0.smithi084.stdout:914: done (0 left) 2024-03-30T12:25:29.186 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 46 current snap is 94 2024-03-30T12:25:29.186 INFO:tasks.rados.rados.0.smithi084.stdout:915: seq_num 296 ranges {0=163840} 2024-03-30T12:25:29.187 INFO:tasks.rados.rados.0.smithi084.stdout:915: writing smithi08477944-46 from 0 to 163840 tid 1 2024-03-30T12:25:29.187 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 94 2024-03-30T12:25:29.187 INFO:tasks.rados.rados.0.smithi084.stdout:916: seq_num 297 ranges {1261568=180224} 2024-03-30T12:25:29.196 INFO:tasks.rados.rados.0.smithi084.stdout:916: writing smithi08477944-15 from 1261568 to 1441792 tid 1 2024-03-30T12:25:29.196 INFO:tasks.rados.rados.0.smithi084.stdout:917: read oid 31 snap -1 2024-03-30T12:25:29.197 INFO:tasks.rados.rados.0.smithi084.stdout:917: expect deleted 2024-03-30T12:25:29.197 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 94 2024-03-30T12:25:29.197 INFO:tasks.rados.rados.0.smithi084.stdout:915: finishing write tid 1 to smithi08477944-46 2024-03-30T12:25:29.197 INFO:tasks.rados.rados.0.smithi084.stdout:918: seq_num 298 ranges {2965504=196608} 2024-03-30T12:25:29.213 INFO:tasks.rados.rados.0.smithi084.stdout:918: writing smithi08477944-23 from 2965504 to 3162112 tid 1 2024-03-30T12:25:29.213 INFO:tasks.rados.rados.0.smithi084.stdout:919: snap_remove snap 83 2024-03-30T12:25:29.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:29 smithi162 ceph-mon[83709]: osdmap e249: 8 total, 8 up, 8 in 2024-03-30T12:25:29.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:29 smithi162 ceph-mon[83709]: pgmap v56: 121 pgs: 121 active+clean; 181 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.8 MiB/s wr, 20 op/s 2024-03-30T12:25:29.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:29 smithi084 ceph-mon[89279]: osdmap e249: 8 total, 8 up, 8 in 2024-03-30T12:25:29.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:29 smithi084 ceph-mon[89279]: pgmap v56: 121 pgs: 121 active+clean; 181 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.8 MiB/s wr, 20 op/s 2024-03-30T12:25:29.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:25:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:25:29] "GET /metrics HTTP/1.1" 200 36003 "" "Prometheus/2.43.0" 2024-03-30T12:25:29.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:29 smithi084 ceph-mon[91810]: osdmap e249: 8 total, 8 up, 8 in 2024-03-30T12:25:29.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:29 smithi084 ceph-mon[91810]: pgmap v56: 121 pgs: 121 active+clean; 181 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.0 MiB/s rd, 2.8 MiB/s wr, 20 op/s 2024-03-30T12:25:29.637 INFO:tasks.rados.rados.0.smithi084.stdout:919: done (4 left) 2024-03-30T12:25:29.638 INFO:tasks.rados.rados.0.smithi084.stdout:920: rmattr oid 47 current snap is 94 2024-03-30T12:25:29.638 INFO:tasks.rados.rados.0.smithi084.stdout:915: finishing write tid 2 to smithi08477944-46 2024-03-30T12:25:29.638 INFO:tasks.rados.rados.0.smithi084.stdout:915: finishing write tid 3 to smithi08477944-46 2024-03-30T12:25:29.638 INFO:tasks.rados.rados.0.smithi084.stdout:915: oid 46 updating version 0 to 485 2024-03-30T12:25:29.638 INFO:tasks.rados.rados.0.smithi084.stdout:915: oid 46 version 485 is already newer than 484 2024-03-30T12:25:29.638 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 485 (ObjNum 296 snap 94 seq_num 296) dirty exists 2024-03-30T12:25:29.638 INFO:tasks.rados.rados.0.smithi084.stdout:915: left oid 46 (ObjNum 296 snap 94 seq_num 296) 2024-03-30T12:25:29.638 INFO:tasks.rados.rados.0.smithi084.stdout:916: finishing write tid 1 to smithi08477944-15 2024-03-30T12:25:29.638 INFO:tasks.rados.rados.0.smithi084.stdout:916: finishing write tid 2 to smithi08477944-15 2024-03-30T12:25:29.638 INFO:tasks.rados.rados.0.smithi084.stdout:916: finishing write tid 3 to smithi08477944-15 2024-03-30T12:25:29.638 INFO:tasks.rados.rados.0.smithi084.stdout:916: oid 15 updating version 0 to 420 2024-03-30T12:25:29.638 INFO:tasks.rados.rados.0.smithi084.stdout:916: oid 15 version 420 is already newer than 419 2024-03-30T12:25:29.638 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 420 (ObjNum 297 snap 94 seq_num 297) dirty exists 2024-03-30T12:25:29.639 INFO:tasks.rados.rados.0.smithi084.stdout:916: left oid 15 (ObjNum 297 snap 94 seq_num 297) 2024-03-30T12:25:29.639 INFO:tasks.rados.rados.0.smithi084.stdout:918: finishing write tid 1 to smithi08477944-23 2024-03-30T12:25:29.639 INFO:tasks.rados.rados.0.smithi084.stdout:918: finishing write tid 2 to smithi08477944-23 2024-03-30T12:25:29.639 INFO:tasks.rados.rados.0.smithi084.stdout:918: finishing write tid 3 to smithi08477944-23 2024-03-30T12:25:29.639 INFO:tasks.rados.rados.0.smithi084.stdout:918: oid 23 updating version 0 to 381 2024-03-30T12:25:29.639 INFO:tasks.rados.rados.0.smithi084.stdout:918: oid 23 version 381 is already newer than 380 2024-03-30T12:25:29.639 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 381 (ObjNum 298 snap 94 seq_num 298) dirty exists 2024-03-30T12:25:29.639 INFO:tasks.rados.rados.0.smithi084.stdout:918: left oid 23 (ObjNum 298 snap 94 seq_num 298) 2024-03-30T12:25:29.639 INFO:tasks.rados.rados.0.smithi084.stdout:915: done (4 left) 2024-03-30T12:25:29.639 INFO:tasks.rados.rados.0.smithi084.stdout:916: done (3 left) 2024-03-30T12:25:29.639 INFO:tasks.rados.rados.0.smithi084.stdout:917: done (2 left) 2024-03-30T12:25:29.640 INFO:tasks.rados.rados.0.smithi084.stdout:918: done (1 left) 2024-03-30T12:25:29.640 INFO:tasks.rados.rados.0.smithi084.stdout:921: snap_remove snap 69 2024-03-30T12:25:30.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:30 smithi084 ceph-mon[91810]: osdmap e250: 8 total, 8 up, 8 in 2024-03-30T12:25:30.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:30 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:30.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:30 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:30.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:30 smithi084 ceph-mon[91810]: osdmap e251: 8 total, 8 up, 8 in 2024-03-30T12:25:30.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:30 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:25:30.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:30 smithi084 ceph-mon[89279]: osdmap e250: 8 total, 8 up, 8 in 2024-03-30T12:25:30.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:30 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:30.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:30 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:30.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:30 smithi084 ceph-mon[89279]: osdmap e251: 8 total, 8 up, 8 in 2024-03-30T12:25:30.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:30 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:25:30.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:30 smithi162 ceph-mon[83709]: osdmap e250: 8 total, 8 up, 8 in 2024-03-30T12:25:30.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:30 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:30.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:30 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:30.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:30 smithi162 ceph-mon[83709]: osdmap e251: 8 total, 8 up, 8 in 2024-03-30T12:25:30.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:30 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:25:30.648 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 602 (ObjNum 225 snap 66 seq_num 225) dirty exists 2024-03-30T12:25:30.648 INFO:tasks.rados.rados.0.smithi084.stdout:920: done (1 left) 2024-03-30T12:25:30.648 INFO:tasks.rados.rados.0.smithi084.stdout:921: done (0 left) 2024-03-30T12:25:30.648 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 94 2024-03-30T12:25:30.648 INFO:tasks.rados.rados.0.smithi084.stdout:922: seq_num 299 ranges {4472832=212992} 2024-03-30T12:25:30.674 INFO:tasks.rados.rados.0.smithi084.stdout:922: writing smithi08477944-19 from 4472832 to 4685824 tid 1 2024-03-30T12:25:30.674 INFO:tasks.rados.rados.0.smithi084.stdout:923: read oid 41 snap -1 2024-03-30T12:25:30.674 INFO:tasks.rados.rados.0.smithi084.stdout:923: expect (ObjNum 271 snap 84 seq_num 271) 2024-03-30T12:25:30.674 INFO:tasks.rados.rados.0.smithi084.stdout:924: snap_remove snap 91 2024-03-30T12:25:31.640 INFO:tasks.rados.rados.0.smithi084.stdout:922: finishing write tid 1 to smithi08477944-19 2024-03-30T12:25:31.640 INFO:tasks.rados.rados.0.smithi084.stdout:922: finishing write tid 2 to smithi08477944-19 2024-03-30T12:25:31.640 INFO:tasks.rados.rados.0.smithi084.stdout:922: finishing write tid 3 to smithi08477944-19 2024-03-30T12:25:31.640 INFO:tasks.rados.rados.0.smithi084.stdout:922: oid 19 updating version 0 to 538 2024-03-30T12:25:31.640 INFO:tasks.rados.rados.0.smithi084.stdout:922: oid 19 updating version 538 to 539 2024-03-30T12:25:31.640 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 539 (ObjNum 299 snap 94 seq_num 299) dirty exists 2024-03-30T12:25:31.641 INFO:tasks.rados.rados.0.smithi084.stdout:922: left oid 19 (ObjNum 299 snap 94 seq_num 299) 2024-03-30T12:25:31.641 INFO:tasks.rados.rados.0.smithi084.stdout:923: expect (ObjNum 271 snap 84 seq_num 271) 2024-03-30T12:25:31.805 INFO:tasks.rados.rados.0.smithi084.stdout:922: done (2 left) 2024-03-30T12:25:31.805 INFO:tasks.rados.rados.0.smithi084.stdout:923: done (1 left) 2024-03-30T12:25:31.805 INFO:tasks.rados.rados.0.smithi084.stdout:924: done (0 left) 2024-03-30T12:25:31.805 INFO:tasks.rados.rados.0.smithi084.stdout:925: read oid 4 snap -1 2024-03-30T12:25:31.805 INFO:tasks.rados.rados.0.smithi084.stdout:925: expect (ObjNum 278 snap 90 seq_num 278) 2024-03-30T12:25:31.805 INFO:tasks.rados.rados.0.smithi084.stdout:926: snap_create 2024-03-30T12:25:31.813 INFO:tasks.rados.rados.0.smithi084.stdout:925: expect (ObjNum 278 snap 90 seq_num 278) 2024-03-30T12:25:31.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:31 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:31.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:31 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:31.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:31 smithi162 ceph-mon[83709]: pgmap v59: 121 pgs: 121 active+clean; 186 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-03-30T12:25:31.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:31 smithi162 ceph-mon[83709]: osdmap e252: 8 total, 8 up, 8 in 2024-03-30T12:25:32.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:31 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:32.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:31 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:32.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:31 smithi084 ceph-mon[89279]: pgmap v59: 121 pgs: 121 active+clean; 186 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-03-30T12:25:32.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:31 smithi084 ceph-mon[89279]: osdmap e252: 8 total, 8 up, 8 in 2024-03-30T12:25:32.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:31 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:32.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:31 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:32.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:31 smithi084 ceph-mon[91810]: pgmap v59: 121 pgs: 121 active+clean; 186 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-03-30T12:25:32.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:31 smithi084 ceph-mon[91810]: osdmap e252: 8 total, 8 up, 8 in 2024-03-30T12:25:32.650 INFO:tasks.rados.rados.0.smithi084.stdout:925: done (1 left) 2024-03-30T12:25:32.650 INFO:tasks.rados.rados.0.smithi084.stdout:926: done (0 left) 2024-03-30T12:25:32.650 INFO:tasks.rados.rados.0.smithi084.stdout:927: snap_remove snap 86 2024-03-30T12:25:32.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:32 smithi162 ceph-mon[83709]: osdmap e253: 8 total, 8 up, 8 in 2024-03-30T12:25:33.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:32 smithi084 ceph-mon[91810]: osdmap e253: 8 total, 8 up, 8 in 2024-03-30T12:25:33.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:32 smithi084 ceph-mon[89279]: osdmap e253: 8 total, 8 up, 8 in 2024-03-30T12:25:33.652 INFO:tasks.rados.rados.0.smithi084.stdout:927: done (0 left) 2024-03-30T12:25:33.652 INFO:tasks.rados.rados.0.smithi084.stdout:928: copy_from oid 25 from oid 20 current snap is 95 2024-03-30T12:25:33.652 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 95 2024-03-30T12:25:33.652 INFO:tasks.rados.rados.0.smithi084.stdout:929: seq_num 300 ranges {5455872=229376} 2024-03-30T12:25:33.684 INFO:tasks.rados.rados.0.smithi084.stdout:929: writing smithi08477944-47 from 5455872 to 5685248 tid 1 2024-03-30T12:25:33.684 INFO:tasks.rados.rados.0.smithi084.stdout:930: read oid 50 snap -1 2024-03-30T12:25:33.685 INFO:tasks.rados.rados.0.smithi084.stdout:930: expect (ObjNum 267 snap 84 seq_num 267) 2024-03-30T12:25:33.685 INFO:tasks.rados.rados.0.smithi084.stdout:931: rmattr oid 45 current snap is 95 2024-03-30T12:25:33.685 INFO:tasks.rados.rados.0.smithi084.stdout:931: done (3 left) 2024-03-30T12:25:33.685 INFO:tasks.rados.rados.0.smithi084.stdout:932: delete oid 46 current snap is 95 2024-03-30T12:25:33.685 INFO:tasks.rados.rados.0.smithi084.stdout:928: finishing copy_from racing read to smithi08477944-25 2024-03-30T12:25:33.688 INFO:tasks.rados.rados.0.smithi084.stdout:928: finishing copy_from to smithi08477944-25 2024-03-30T12:25:33.688 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 467 (ObjNum 267 snap 84 seq_num 267) dirty exists 2024-03-30T12:25:33.688 INFO:tasks.rados.rados.0.smithi084.stdout:929: finishing write tid 1 to smithi08477944-47 2024-03-30T12:25:33.688 INFO:tasks.rados.rados.0.smithi084.stdout:928: done (3 left) 2024-03-30T12:25:33.688 INFO:tasks.rados.rados.0.smithi084.stdout:932: done (2 left) 2024-03-30T12:25:33.688 INFO:tasks.rados.rados.0.smithi084.stdout:933: delete oid 44 current snap is 95 2024-03-30T12:25:33.688 INFO:tasks.rados.rados.0.smithi084.stdout:929: finishing write tid 2 to smithi08477944-47 2024-03-30T12:25:33.689 INFO:tasks.rados.rados.0.smithi084.stdout:929: finishing write tid 3 to smithi08477944-47 2024-03-30T12:25:33.689 INFO:tasks.rados.rados.0.smithi084.stdout:929: oid 47 updating version 0 to 625 2024-03-30T12:25:33.689 INFO:tasks.rados.rados.0.smithi084.stdout:929: oid 47 version 625 is already newer than 624 2024-03-30T12:25:33.689 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 625 (ObjNum 300 snap 95 seq_num 300) dirty exists 2024-03-30T12:25:33.689 INFO:tasks.rados.rados.0.smithi084.stdout:929: left oid 47 (ObjNum 300 snap 95 seq_num 300) 2024-03-30T12:25:33.691 INFO:tasks.rados.rados.0.smithi084.stdout:929: done (2 left) 2024-03-30T12:25:33.691 INFO:tasks.rados.rados.0.smithi084.stdout:933: done (1 left) 2024-03-30T12:25:33.691 INFO:tasks.rados.rados.0.smithi084.stdout:934: read oid 44 snap 61 2024-03-30T12:25:33.691 INFO:tasks.rados.rados.0.smithi084.stdout:934: expect (ObjNum 167 snap 45 seq_num 167) 2024-03-30T12:25:33.691 INFO:tasks.rados.rados.0.smithi084.stdout:935: read oid 9 snap -1 2024-03-30T12:25:33.691 INFO:tasks.rados.rados.0.smithi084.stdout:935: expect deleted 2024-03-30T12:25:33.691 INFO:tasks.rados.rados.0.smithi084.stdout:936: snap_create 2024-03-30T12:25:33.694 INFO:tasks.rados.rados.0.smithi084.stdout:934: expect (ObjNum 167 snap 45 seq_num 167) 2024-03-30T12:25:33.707 INFO:tasks.rados.rados.0.smithi084.stdout:930: expect (ObjNum 267 snap 84 seq_num 267) 2024-03-30T12:25:33.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:33 smithi162 ceph-mon[83709]: pgmap v62: 121 pgs: 121 active+clean; 192 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 5.7 MiB/s rd, 3.2 MiB/s wr, 20 op/s 2024-03-30T12:25:33.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:33 smithi162 ceph-mon[83709]: osdmap e254: 8 total, 8 up, 8 in 2024-03-30T12:25:34.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:33 smithi084 ceph-mon[91810]: pgmap v62: 121 pgs: 121 active+clean; 192 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 5.7 MiB/s rd, 3.2 MiB/s wr, 20 op/s 2024-03-30T12:25:34.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:33 smithi084 ceph-mon[91810]: osdmap e254: 8 total, 8 up, 8 in 2024-03-30T12:25:34.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:33 smithi084 ceph-mon[89279]: pgmap v62: 121 pgs: 121 active+clean; 192 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 5.7 MiB/s rd, 3.2 MiB/s wr, 20 op/s 2024-03-30T12:25:34.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:33 smithi084 ceph-mon[89279]: osdmap e254: 8 total, 8 up, 8 in 2024-03-30T12:25:34.635 INFO:tasks.rados.rados.0.smithi084.stdout:930: done (3 left) 2024-03-30T12:25:34.635 INFO:tasks.rados.rados.0.smithi084.stdout:934: done (2 left) 2024-03-30T12:25:34.635 INFO:tasks.rados.rados.0.smithi084.stdout:935: done (1 left) 2024-03-30T12:25:34.635 INFO:tasks.rados.rados.0.smithi084.stdout:936: done (0 left) 2024-03-30T12:25:34.635 INFO:tasks.rados.rados.0.smithi084.stdout:937: copy_from oid 23 from oid 38 current snap is 96 2024-03-30T12:25:34.635 INFO:tasks.rados.rados.0.smithi084.stdout:938: snap_remove snap 82 2024-03-30T12:25:34.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:34 smithi162 ceph-mon[83709]: osdmap e255: 8 total, 8 up, 8 in 2024-03-30T12:25:34.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:34 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:34.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:34 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:34.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:34 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:34.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:34 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:25:34.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:34 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:34.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:34 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:25:34.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:34 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:25:34.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:34 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:34.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:34 smithi162 ceph-mon[83709]: osdmap e256: 8 total, 8 up, 8 in 2024-03-30T12:25:34.881 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:34 smithi084 ceph-mon[89279]: osdmap e255: 8 total, 8 up, 8 in 2024-03-30T12:25:34.881 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:34 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:34.881 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:34 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:34.881 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:34 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:34.881 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:34 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:25:34.881 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:34 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:34.881 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:34 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:25:34.881 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:34 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:25:34.881 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:34 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:34.881 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:34 smithi084 ceph-mon[89279]: osdmap e256: 8 total, 8 up, 8 in 2024-03-30T12:25:34.882 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:34 smithi084 ceph-mon[91810]: osdmap e255: 8 total, 8 up, 8 in 2024-03-30T12:25:34.882 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:34 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:34.882 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:34 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:34.882 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:34 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:34.882 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:34 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:25:34.882 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:34 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:34.882 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:34 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:25:34.882 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:34 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:25:34.882 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:34 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:34.882 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:34 smithi084 ceph-mon[91810]: osdmap e256: 8 total, 8 up, 8 in 2024-03-30T12:25:35.637 INFO:tasks.rados.rados.0.smithi084.stdout:938: done (1 left) 2024-03-30T12:25:35.637 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 96 2024-03-30T12:25:35.638 INFO:tasks.rados.rados.0.smithi084.stdout:937: finishing copy_from to smithi08477944-23 2024-03-30T12:25:35.638 INFO:tasks.rados.rados.0.smithi084.stdout:937: got expected ENOENT (src dne) 2024-03-30T12:25:35.638 INFO:tasks.rados.rados.0.smithi084.stdout:937: finishing copy_from racing read to smithi08477944-23 2024-03-30T12:25:35.638 INFO:tasks.rados.rados.0.smithi084.stdout:939: seq_num 303 ranges {0=278528} 2024-03-30T12:25:35.640 INFO:tasks.rados.rados.0.smithi084.stdout:939: writing smithi08477944-12 from 0 to 278528 tid 1 2024-03-30T12:25:35.640 INFO:tasks.rados.rados.0.smithi084.stdout:937: done (1 left) 2024-03-30T12:25:35.640 INFO:tasks.rados.rados.0.smithi084.stdout:940: copy_from oid 2 from oid 28 current snap is 96 2024-03-30T12:25:35.640 INFO:tasks.rados.rados.0.smithi084.stdout:941: rmattr oid 15 current snap is 96 2024-03-30T12:25:35.640 INFO:tasks.rados.rados.0.smithi084.stdout:941: done (2 left) 2024-03-30T12:25:35.640 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 27 current snap is 96 2024-03-30T12:25:35.640 INFO:tasks.rados.rados.0.smithi084.stdout:942: seq_num 304 ranges {3989504=294912} 2024-03-30T12:25:35.664 INFO:tasks.rados.rados.0.smithi084.stdout:942: writing smithi08477944-27 from 3989504 to 4284416 tid 1 2024-03-30T12:25:35.664 INFO:tasks.rados.rados.0.smithi084.stdout:943: snap_create 2024-03-30T12:25:35.665 INFO:tasks.rados.rados.0.smithi084.stdout:939: finishing write tid 1 to smithi08477944-12 2024-03-30T12:25:35.665 INFO:tasks.rados.rados.0.smithi084.stdout:939: finishing write tid 2 to smithi08477944-12 2024-03-30T12:25:35.665 INFO:tasks.rados.rados.0.smithi084.stdout:939: finishing write tid 3 to smithi08477944-12 2024-03-30T12:25:35.665 INFO:tasks.rados.rados.0.smithi084.stdout:939: oid 12 updating version 0 to 410 2024-03-30T12:25:35.665 INFO:tasks.rados.rados.0.smithi084.stdout:939: oid 12 version 410 is already newer than 409 2024-03-30T12:25:35.665 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 410 (ObjNum 303 snap 96 seq_num 303) dirty exists 2024-03-30T12:25:35.665 INFO:tasks.rados.rados.0.smithi084.stdout:939: left oid 12 (ObjNum 303 snap 96 seq_num 303) 2024-03-30T12:25:35.668 INFO:tasks.rados.rados.0.smithi084.stdout:942: finishing write tid 1 to smithi08477944-27 2024-03-30T12:25:35.669 INFO:tasks.rados.rados.0.smithi084.stdout:942: finishing write tid 2 to smithi08477944-27 2024-03-30T12:25:35.670 INFO:tasks.rados.rados.0.smithi084.stdout:942: finishing write tid 3 to smithi08477944-27 2024-03-30T12:25:35.670 INFO:tasks.rados.rados.0.smithi084.stdout:942: oid 27 updating version 0 to 412 2024-03-30T12:25:35.671 INFO:tasks.rados.rados.0.smithi084.stdout:942: oid 27 version 412 is already newer than 411 2024-03-30T12:25:35.671 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 412 (ObjNum 304 snap 96 seq_num 304) dirty exists 2024-03-30T12:25:35.671 INFO:tasks.rados.rados.0.smithi084.stdout:942: left oid 27 (ObjNum 304 snap 96 seq_num 304) 2024-03-30T12:25:35.678 INFO:tasks.rados.rados.0.smithi084.stdout:940: finishing copy_from racing read to smithi08477944-2 2024-03-30T12:25:35.679 INFO:tasks.rados.rados.0.smithi084.stdout:940: finishing copy_from to smithi08477944-2 2024-03-30T12:25:35.679 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 265 (ObjNum 250 snap 76 seq_num 250) dirty exists 2024-03-30T12:25:36.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:35 smithi084 ceph-mon[89279]: Reconfiguring mon.a (monmap changed)... 2024-03-30T12:25:36.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:35 smithi084 ceph-mon[89279]: Reconfiguring daemon mon.a on smithi084 2024-03-30T12:25:36.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:35 smithi084 ceph-mon[89279]: pgmap v65: 121 pgs: 121 active+clean; 192 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 5.7 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2024-03-30T12:25:36.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:35 smithi084 ceph-mon[89279]: osdmap e257: 8 total, 8 up, 8 in 2024-03-30T12:25:36.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:35 smithi084 ceph-mon[91810]: Reconfiguring mon.a (monmap changed)... 2024-03-30T12:25:36.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:35 smithi084 ceph-mon[91810]: Reconfiguring daemon mon.a on smithi084 2024-03-30T12:25:36.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:35 smithi084 ceph-mon[91810]: pgmap v65: 121 pgs: 121 active+clean; 192 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 5.7 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2024-03-30T12:25:36.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:35 smithi084 ceph-mon[91810]: osdmap e257: 8 total, 8 up, 8 in 2024-03-30T12:25:36.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:35 smithi162 ceph-mon[83709]: Reconfiguring mon.a (monmap changed)... 2024-03-30T12:25:36.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:35 smithi162 ceph-mon[83709]: Reconfiguring daemon mon.a on smithi084 2024-03-30T12:25:36.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:35 smithi162 ceph-mon[83709]: pgmap v65: 121 pgs: 121 active+clean; 192 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 5.7 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2024-03-30T12:25:36.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:35 smithi162 ceph-mon[83709]: osdmap e257: 8 total, 8 up, 8 in 2024-03-30T12:25:36.660 INFO:tasks.rados.rados.0.smithi084.stdout:939: done (3 left) 2024-03-30T12:25:36.660 INFO:tasks.rados.rados.0.smithi084.stdout:940: done (2 left) 2024-03-30T12:25:36.660 INFO:tasks.rados.rados.0.smithi084.stdout:942: done (1 left) 2024-03-30T12:25:36.660 INFO:tasks.rados.rados.0.smithi084.stdout:943: done (0 left) 2024-03-30T12:25:36.660 INFO:tasks.rados.rados.0.smithi084.stdout:944: rollback oid 26 current snap is 97 2024-03-30T12:25:36.660 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 26 to 77 2024-03-30T12:25:36.661 INFO:tasks.rados.rados.0.smithi084.stdout:945: copy_from oid 48 from oid 14 current snap is 97 2024-03-30T12:25:36.661 INFO:tasks.rados.rados.0.smithi084.stdout:946: snap_create 2024-03-30T12:25:36.662 INFO:tasks.rados.rados.0.smithi084.stdout:944: finishing rollback tid 1 to smithi08477944-26 2024-03-30T12:25:36.662 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 459 (ObjNum 129 snap 0 seq_num 1429131712) dirty dne 2024-03-30T12:25:36.674 INFO:tasks.rados.rados.0.smithi084.stdout:945: finishing copy_from racing read to smithi08477944-48 2024-03-30T12:25:36.676 INFO:tasks.rados.rados.0.smithi084.stdout:945: finishing copy_from to smithi08477944-48 2024-03-30T12:25:36.676 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 337 (ObjNum 211 snap 62 seq_num 211) dirty exists 2024-03-30T12:25:37.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:36 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:37.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:36 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:37.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:36 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:25:37.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:36 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T12:25:37.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:36 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:37.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:36 smithi084 ceph-mon[89279]: osdmap e258: 8 total, 8 up, 8 in 2024-03-30T12:25:37.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:36 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:37.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:36 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:37.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:36 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:25:37.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:36 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T12:25:37.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:36 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:37.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:36 smithi084 ceph-mon[91810]: osdmap e258: 8 total, 8 up, 8 in 2024-03-30T12:25:37.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:36 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:37.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:36 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:37.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:36 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:25:37.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:36 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T12:25:37.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:36 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:37.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:36 smithi162 ceph-mon[83709]: osdmap e258: 8 total, 8 up, 8 in 2024-03-30T12:25:37.660 INFO:tasks.rados.rados.0.smithi084.stdout:944: done (2 left) 2024-03-30T12:25:37.660 INFO:tasks.rados.rados.0.smithi084.stdout:945: done (1 left) 2024-03-30T12:25:37.660 INFO:tasks.rados.rados.0.smithi084.stdout:946: done (0 left) 2024-03-30T12:25:37.660 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 98 2024-03-30T12:25:37.660 INFO:tasks.rados.rados.0.smithi084.stdout:947: seq_num 305 ranges {3162112=311296} 2024-03-30T12:25:37.680 INFO:tasks.rados.rados.0.smithi084.stdout:947: writing smithi08477944-23 from 3162112 to 3473408 tid 1 2024-03-30T12:25:37.680 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 98 2024-03-30T12:25:37.680 INFO:tasks.rados.rados.0.smithi084.stdout:948: seq_num 306 ranges {778240=327680} 2024-03-30T12:25:37.687 INFO:tasks.rados.rados.0.smithi084.stdout:948: writing smithi08477944-36 from 778240 to 1105920 tid 1 2024-03-30T12:25:37.687 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 98 2024-03-30T12:25:37.687 INFO:tasks.rados.rados.0.smithi084.stdout:947: finishing write tid 1 to smithi08477944-23 2024-03-30T12:25:37.687 INFO:tasks.rados.rados.0.smithi084.stdout:947: finishing write tid 2 to smithi08477944-23 2024-03-30T12:25:37.687 INFO:tasks.rados.rados.0.smithi084.stdout:947: finishing write tid 3 to smithi08477944-23 2024-03-30T12:25:37.687 INFO:tasks.rados.rados.0.smithi084.stdout:947: oid 23 updating version 0 to 404 2024-03-30T12:25:37.687 INFO:tasks.rados.rados.0.smithi084.stdout:947: oid 23 version 404 is already newer than 403 2024-03-30T12:25:37.687 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 404 (ObjNum 305 snap 98 seq_num 305) dirty exists 2024-03-30T12:25:37.687 INFO:tasks.rados.rados.0.smithi084.stdout:947: left oid 23 (ObjNum 305 snap 98 seq_num 305) 2024-03-30T12:25:37.688 INFO:tasks.rados.rados.0.smithi084.stdout:949: seq_num 307 ranges {278528=344064} 2024-03-30T12:25:37.691 INFO:tasks.rados.rados.0.smithi084.stdout:949: writing smithi08477944-12 from 278528 to 622592 tid 1 2024-03-30T12:25:37.691 INFO:tasks.rados.rados.0.smithi084.stdout:947: done (2 left) 2024-03-30T12:25:37.691 INFO:tasks.rados.rados.0.smithi084.stdout:950: snap_create 2024-03-30T12:25:37.691 INFO:tasks.rados.rados.0.smithi084.stdout:948: finishing write tid 1 to smithi08477944-36 2024-03-30T12:25:37.691 INFO:tasks.rados.rados.0.smithi084.stdout:948: finishing write tid 2 to smithi08477944-36 2024-03-30T12:25:37.691 INFO:tasks.rados.rados.0.smithi084.stdout:948: finishing write tid 3 to smithi08477944-36 2024-03-30T12:25:37.691 INFO:tasks.rados.rados.0.smithi084.stdout:948: oid 36 updating version 0 to 406 2024-03-30T12:25:37.692 INFO:tasks.rados.rados.0.smithi084.stdout:948: oid 36 updating version 406 to 407 2024-03-30T12:25:37.692 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 407 (ObjNum 306 snap 98 seq_num 306) dirty exists 2024-03-30T12:25:37.692 INFO:tasks.rados.rados.0.smithi084.stdout:948: left oid 36 (ObjNum 306 snap 98 seq_num 306) 2024-03-30T12:25:37.697 INFO:tasks.rados.rados.0.smithi084.stdout:949: finishing write tid 1 to smithi08477944-12 2024-03-30T12:25:37.697 INFO:tasks.rados.rados.0.smithi084.stdout:949: finishing write tid 2 to smithi08477944-12 2024-03-30T12:25:37.698 INFO:tasks.rados.rados.0.smithi084.stdout:949: finishing write tid 3 to smithi08477944-12 2024-03-30T12:25:37.699 INFO:tasks.rados.rados.0.smithi084.stdout:949: oid 12 updating version 0 to 414 2024-03-30T12:25:37.699 INFO:tasks.rados.rados.0.smithi084.stdout:949: oid 12 version 414 is already newer than 413 2024-03-30T12:25:37.699 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 414 (ObjNum 307 snap 98 seq_num 307) dirty exists 2024-03-30T12:25:37.699 INFO:tasks.rados.rados.0.smithi084.stdout:949: left oid 12 (ObjNum 307 snap 98 seq_num 307) 2024-03-30T12:25:38.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:37 smithi084 ceph-mon[89279]: Reconfiguring mgr.y (monmap changed)... 2024-03-30T12:25:38.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:37 smithi084 ceph-mon[89279]: Reconfiguring daemon mgr.y on smithi084 2024-03-30T12:25:38.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:37 smithi084 ceph-mon[89279]: pgmap v68: 121 pgs: 121 active+clean; 194 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.6 MiB/s rd, 1.1 MiB/s wr, 7 op/s 2024-03-30T12:25:38.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:37 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:38.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:37 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:38.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:37 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:25:38.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:37 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:25:38.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:37 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:38.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:37 smithi084 ceph-mon[89279]: osdmap e259: 8 total, 8 up, 8 in 2024-03-30T12:25:38.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:37 smithi084 ceph-mon[91810]: Reconfiguring mgr.y (monmap changed)... 2024-03-30T12:25:38.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:37 smithi084 ceph-mon[91810]: Reconfiguring daemon mgr.y on smithi084 2024-03-30T12:25:38.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:37 smithi084 ceph-mon[91810]: pgmap v68: 121 pgs: 121 active+clean; 194 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.6 MiB/s rd, 1.1 MiB/s wr, 7 op/s 2024-03-30T12:25:38.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:37 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:38.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:37 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:38.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:37 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:25:38.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:37 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:25:38.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:37 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:38.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:37 smithi084 ceph-mon[91810]: osdmap e259: 8 total, 8 up, 8 in 2024-03-30T12:25:38.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:37 smithi162 ceph-mon[83709]: Reconfiguring mgr.y (monmap changed)... 2024-03-30T12:25:38.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:37 smithi162 ceph-mon[83709]: Reconfiguring daemon mgr.y on smithi084 2024-03-30T12:25:38.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:37 smithi162 ceph-mon[83709]: pgmap v68: 121 pgs: 121 active+clean; 194 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.6 MiB/s rd, 1.1 MiB/s wr, 7 op/s 2024-03-30T12:25:38.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:37 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:38.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:37 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:38.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:37 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:25:38.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:37 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:25:38.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:37 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:38.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:37 smithi162 ceph-mon[83709]: osdmap e259: 8 total, 8 up, 8 in 2024-03-30T12:25:38.661 INFO:tasks.rados.rados.0.smithi084.stdout:948: done (2 left) 2024-03-30T12:25:38.662 INFO:tasks.rados.rados.0.smithi084.stdout:949: done (1 left) 2024-03-30T12:25:38.662 INFO:tasks.rados.rados.0.smithi084.stdout:950: done (0 left) 2024-03-30T12:25:38.662 INFO:tasks.rados.rados.0.smithi084.stdout:951: read oid 16 snap -1 2024-03-30T12:25:38.662 INFO:tasks.rados.rados.0.smithi084.stdout:951: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:25:38.662 INFO:tasks.rados.rados.0.smithi084.stdout:952: snap_create 2024-03-30T12:25:38.664 INFO:tasks.rados.rados.0.smithi084.stdout:951: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:25:39.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:38 smithi084 ceph-mon[89279]: Reconfiguring mon.c (monmap changed)... 2024-03-30T12:25:39.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:38 smithi084 ceph-mon[89279]: Reconfiguring daemon mon.c on smithi084 2024-03-30T12:25:39.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:38 smithi084 ceph-mon[89279]: pgmap v71: 121 pgs: 121 active+clean; 194 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.6 MiB/s rd, 1.1 MiB/s wr, 7 op/s 2024-03-30T12:25:39.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:38 smithi084 ceph-mon[89279]: osdmap e260: 8 total, 8 up, 8 in 2024-03-30T12:25:39.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:38 smithi084 ceph-mon[91810]: Reconfiguring mon.c (monmap changed)... 2024-03-30T12:25:39.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:38 smithi084 ceph-mon[91810]: Reconfiguring daemon mon.c on smithi084 2024-03-30T12:25:39.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:38 smithi084 ceph-mon[91810]: pgmap v71: 121 pgs: 121 active+clean; 194 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.6 MiB/s rd, 1.1 MiB/s wr, 7 op/s 2024-03-30T12:25:39.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:38 smithi084 ceph-mon[91810]: osdmap e260: 8 total, 8 up, 8 in 2024-03-30T12:25:39.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:38 smithi162 ceph-mon[83709]: Reconfiguring mon.c (monmap changed)... 2024-03-30T12:25:39.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:38 smithi162 ceph-mon[83709]: Reconfiguring daemon mon.c on smithi084 2024-03-30T12:25:39.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:38 smithi162 ceph-mon[83709]: pgmap v71: 121 pgs: 121 active+clean; 194 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.6 MiB/s rd, 1.1 MiB/s wr, 7 op/s 2024-03-30T12:25:39.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:38 smithi162 ceph-mon[83709]: osdmap e260: 8 total, 8 up, 8 in 2024-03-30T12:25:39.637 INFO:tasks.rados.rados.0.smithi084.stdout:951: done (1 left) 2024-03-30T12:25:39.637 INFO:tasks.rados.rados.0.smithi084.stdout:952: done (0 left) 2024-03-30T12:25:39.637 INFO:tasks.rados.rados.0.smithi084.stdout:953: rmattr oid 40 current snap is 100 2024-03-30T12:25:39.637 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 100 2024-03-30T12:25:39.637 INFO:tasks.rados.rados.0.smithi084.stdout:954: seq_num 308 ranges {0=360448} 2024-03-30T12:25:39.639 INFO:tasks.rados.rados.0.smithi084.stdout:954: writing smithi08477944-32 from 0 to 360448 tid 1 2024-03-30T12:25:39.639 INFO:tasks.rados.rados.0.smithi084.stdout:955: snap_create 2024-03-30T12:25:39.644 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 631 (ObjNum 205 snap 62 seq_num 205) dirty exists 2024-03-30T12:25:39.646 INFO:tasks.rados.rados.0.smithi084.stdout:954: finishing write tid 1 to smithi08477944-32 2024-03-30T12:25:39.647 INFO:tasks.rados.rados.0.smithi084.stdout:954: finishing write tid 2 to smithi08477944-32 2024-03-30T12:25:39.649 INFO:tasks.rados.rados.0.smithi084.stdout:954: finishing write tid 3 to smithi08477944-32 2024-03-30T12:25:39.649 INFO:tasks.rados.rados.0.smithi084.stdout:954: oid 32 updating version 0 to 409 2024-03-30T12:25:39.649 INFO:tasks.rados.rados.0.smithi084.stdout:954: oid 32 version 409 is already newer than 408 2024-03-30T12:25:39.649 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 409 (ObjNum 308 snap 100 seq_num 308) dirty exists 2024-03-30T12:25:39.650 INFO:tasks.rados.rados.0.smithi084.stdout:954: left oid 32 (ObjNum 308 snap 100 seq_num 308) 2024-03-30T12:25:39.653 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:25:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:25:39] "GET /metrics HTTP/1.1" 200 35999 "" "Prometheus/2.43.0" 2024-03-30T12:25:40.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:40 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:40.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:40 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:40.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:40 smithi084 ceph-mon[91810]: Reconfiguring osd.0 (monmap changed)... 2024-03-30T12:25:40.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:40 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-30T12:25:40.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:40 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:40.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:40 smithi084 ceph-mon[91810]: Reconfiguring daemon osd.0 on smithi084 2024-03-30T12:25:40.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:40 smithi084 ceph-mon[91810]: osdmap e261: 8 total, 8 up, 8 in 2024-03-30T12:25:40.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:40 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:40.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:40 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:40 smithi084 ceph-mon[89279]: Reconfiguring osd.0 (monmap changed)... 2024-03-30T12:25:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:40 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-30T12:25:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:40 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:40 smithi084 ceph-mon[89279]: Reconfiguring daemon osd.0 on smithi084 2024-03-30T12:25:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:40 smithi084 ceph-mon[89279]: osdmap e261: 8 total, 8 up, 8 in 2024-03-30T12:25:40.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:40 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:40.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:40 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:40.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:40 smithi162 ceph-mon[83709]: Reconfiguring osd.0 (monmap changed)... 2024-03-30T12:25:40.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:40 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-30T12:25:40.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:40 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:40.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:40 smithi162 ceph-mon[83709]: Reconfiguring daemon osd.0 on smithi084 2024-03-30T12:25:40.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:40 smithi162 ceph-mon[83709]: osdmap e261: 8 total, 8 up, 8 in 2024-03-30T12:25:40.647 INFO:tasks.rados.rados.0.smithi084.stdout:953: done (2 left) 2024-03-30T12:25:40.648 INFO:tasks.rados.rados.0.smithi084.stdout:954: done (1 left) 2024-03-30T12:25:40.648 INFO:tasks.rados.rados.0.smithi084.stdout:955: done (0 left) 2024-03-30T12:25:40.648 INFO:tasks.rados.rados.0.smithi084.stdout:956: snap_remove snap 61 2024-03-30T12:25:41.652 INFO:tasks.rados.rados.0.smithi084.stdout:956: done (0 left) 2024-03-30T12:25:41.653 INFO:tasks.rados.rados.0.smithi084.stdout:957: copy_from oid 33 from oid 1 current snap is 101 2024-03-30T12:25:41.653 INFO:tasks.rados.rados.0.smithi084.stdout:958: read oid 46 snap -1 2024-03-30T12:25:41.653 INFO:tasks.rados.rados.0.smithi084.stdout:958: expect deleted 2024-03-30T12:25:41.653 INFO:tasks.rados.rados.0.smithi084.stdout:959: snap_remove snap 77 2024-03-30T12:25:41.849 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:41 smithi084 ceph-mon[89279]: pgmap v74: 121 pgs: 121 active+clean; 196 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 744 KiB/s wr, 2 op/s 2024-03-30T12:25:41.849 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:41 smithi084 ceph-mon[89279]: osdmap e262: 8 total, 8 up, 8 in 2024-03-30T12:25:41.849 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:41.849 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:41.849 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-30T12:25:41.849 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:41.850 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:41 smithi084 ceph-mon[91810]: pgmap v74: 121 pgs: 121 active+clean; 196 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 744 KiB/s wr, 2 op/s 2024-03-30T12:25:41.850 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:41 smithi084 ceph-mon[91810]: osdmap e262: 8 total, 8 up, 8 in 2024-03-30T12:25:41.850 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:41.850 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:41.850 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-30T12:25:41.850 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:42.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:41 smithi162 ceph-mon[83709]: pgmap v74: 121 pgs: 121 active+clean; 196 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 744 KiB/s wr, 2 op/s 2024-03-30T12:25:42.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:41 smithi162 ceph-mon[83709]: osdmap e262: 8 total, 8 up, 8 in 2024-03-30T12:25:42.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:42.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:42.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-30T12:25:42.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:42.664 INFO:tasks.rados.rados.0.smithi084.stdout:959: done (2 left) 2024-03-30T12:25:42.664 INFO:tasks.rados.rados.0.smithi084.stdout:960: snap_remove snap 92 2024-03-30T12:25:43.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:42 smithi084 ceph-mon[91810]: Reconfiguring osd.1 (monmap changed)... 2024-03-30T12:25:43.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:42 smithi084 ceph-mon[91810]: Reconfiguring daemon osd.1 on smithi084 2024-03-30T12:25:43.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:42 smithi084 ceph-mon[91810]: osdmap e263: 8 total, 8 up, 8 in 2024-03-30T12:25:43.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:42 smithi084 ceph-mon[89279]: Reconfiguring osd.1 (monmap changed)... 2024-03-30T12:25:43.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:42 smithi084 ceph-mon[89279]: Reconfiguring daemon osd.1 on smithi084 2024-03-30T12:25:43.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:42 smithi084 ceph-mon[89279]: osdmap e263: 8 total, 8 up, 8 in 2024-03-30T12:25:43.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:42 smithi162 ceph-mon[83709]: Reconfiguring osd.1 (monmap changed)... 2024-03-30T12:25:43.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:42 smithi162 ceph-mon[83709]: Reconfiguring daemon osd.1 on smithi084 2024-03-30T12:25:43.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:42 smithi162 ceph-mon[83709]: osdmap e263: 8 total, 8 up, 8 in 2024-03-30T12:25:43.666 INFO:tasks.rados.rados.0.smithi084.stdout:960: done (2 left) 2024-03-30T12:25:43.667 INFO:tasks.rados.rados.0.smithi084.stdout:961: snap_create 2024-03-30T12:25:43.667 INFO:tasks.rados.rados.0.smithi084.stdout:957: finishing copy_from racing read to smithi08477944-33 2024-03-30T12:25:43.667 INFO:tasks.rados.rados.0.smithi084.stdout:957: finishing copy_from to smithi08477944-33 2024-03-30T12:25:43.667 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 423 (ObjNum 293 snap 94 seq_num 293) dirty exists 2024-03-30T12:25:44.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:43 smithi084 ceph-mon[91810]: pgmap v77: 121 pgs: 121 active+clean; 199 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 17 KiB/s rd, 1.8 MiB/s wr, 8 op/s 2024-03-30T12:25:44.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:43 smithi084 ceph-mon[91810]: osdmap e264: 8 total, 8 up, 8 in 2024-03-30T12:25:44.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:43 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:44.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:43 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:44.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:43 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-30T12:25:44.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:43 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:44.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:43 smithi084 ceph-mon[89279]: pgmap v77: 121 pgs: 121 active+clean; 199 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 17 KiB/s rd, 1.8 MiB/s wr, 8 op/s 2024-03-30T12:25:44.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:43 smithi084 ceph-mon[89279]: osdmap e264: 8 total, 8 up, 8 in 2024-03-30T12:25:44.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:43 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:44.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:43 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:44.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:43 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-30T12:25:44.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:43 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:44.038 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:43 smithi162 ceph-mon[83709]: pgmap v77: 121 pgs: 121 active+clean; 199 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 17 KiB/s rd, 1.8 MiB/s wr, 8 op/s 2024-03-30T12:25:44.038 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:43 smithi162 ceph-mon[83709]: osdmap e264: 8 total, 8 up, 8 in 2024-03-30T12:25:44.038 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:43 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:44.038 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:43 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:44.038 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:43 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-30T12:25:44.038 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:43 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:44.638 INFO:tasks.rados.rados.0.smithi084.stdout:957: done (2 left) 2024-03-30T12:25:44.638 INFO:tasks.rados.rados.0.smithi084.stdout:958: done (1 left) 2024-03-30T12:25:44.638 INFO:tasks.rados.rados.0.smithi084.stdout:961: done (0 left) 2024-03-30T12:25:44.639 INFO:tasks.rados.rados.0.smithi084.stdout:962: rmattr oid 26 current snap is 102 2024-03-30T12:25:44.639 INFO:tasks.rados.rados.0.smithi084.stdout:962: done (0 left) 2024-03-30T12:25:44.639 INFO:tasks.rados.rados.0.smithi084.stdout:963: rmattr oid 47 current snap is 102 2024-03-30T12:25:44.639 INFO:tasks.rados.rados.0.smithi084.stdout:964: rmattr oid 11 current snap is 102 2024-03-30T12:25:44.639 INFO:tasks.rados.rados.0.smithi084.stdout:965: snap_remove snap 100 2024-03-30T12:25:44.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:44 smithi084 ceph-mon[91810]: Reconfiguring osd.2 (monmap changed)... 2024-03-30T12:25:44.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:44 smithi084 ceph-mon[91810]: Reconfiguring daemon osd.2 on smithi084 2024-03-30T12:25:44.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:44 smithi084 ceph-mon[91810]: osdmap e265: 8 total, 8 up, 8 in 2024-03-30T12:25:44.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:44 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:44.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:44 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:44.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:44 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-30T12:25:44.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:44 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:44.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:44 smithi084 ceph-mon[91810]: osdmap e266: 8 total, 8 up, 8 in 2024-03-30T12:25:44.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:44 smithi084 ceph-mon[89279]: Reconfiguring osd.2 (monmap changed)... 2024-03-30T12:25:44.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:44 smithi084 ceph-mon[89279]: Reconfiguring daemon osd.2 on smithi084 2024-03-30T12:25:44.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:44 smithi084 ceph-mon[89279]: osdmap e265: 8 total, 8 up, 8 in 2024-03-30T12:25:44.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-30T12:25:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:44 smithi084 ceph-mon[89279]: osdmap e266: 8 total, 8 up, 8 in 2024-03-30T12:25:44.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:44 smithi162 ceph-mon[83709]: Reconfiguring osd.2 (monmap changed)... 2024-03-30T12:25:44.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:44 smithi162 ceph-mon[83709]: Reconfiguring daemon osd.2 on smithi084 2024-03-30T12:25:44.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:44 smithi162 ceph-mon[83709]: osdmap e265: 8 total, 8 up, 8 in 2024-03-30T12:25:44.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:44 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:44.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:44 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:44.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:44 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-30T12:25:44.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:44 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:44.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:44 smithi162 ceph-mon[83709]: osdmap e266: 8 total, 8 up, 8 in 2024-03-30T12:25:45.640 INFO:tasks.rados.rados.0.smithi084.stdout:965: done (2 left) 2024-03-30T12:25:45.640 INFO:tasks.rados.rados.0.smithi084.stdout:966: delete oid 10 current snap is 102 2024-03-30T12:25:45.640 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 468 (ObjNum 260 snap 80 seq_num 260) dirty exists 2024-03-30T12:25:45.640 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 657 (ObjNum 300 snap 95 seq_num 300) dirty exists 2024-03-30T12:25:45.644 INFO:tasks.rados.rados.0.smithi084.stdout:963: done (2 left) 2024-03-30T12:25:45.644 INFO:tasks.rados.rados.0.smithi084.stdout:964: done (1 left) 2024-03-30T12:25:45.644 INFO:tasks.rados.rados.0.smithi084.stdout:966: done (0 left) 2024-03-30T12:25:45.644 INFO:tasks.rados.rados.0.smithi084.stdout:967: rollback oid 3 current snap is 102 2024-03-30T12:25:45.644 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 3 to 93 2024-03-30T12:25:45.645 INFO:tasks.rados.rados.0.smithi084.stdout:968: setattr oid 37 current snap is 102 2024-03-30T12:25:45.647 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 102 2024-03-30T12:25:45.647 INFO:tasks.rados.rados.0.smithi084.stdout:969: seq_num 310 ranges {0=401408} 2024-03-30T12:25:45.651 INFO:tasks.rados.rados.0.smithi084.stdout:969: writing smithi08477944-18 from 0 to 401408 tid 1 2024-03-30T12:25:45.651 INFO:tasks.rados.rados.0.smithi084.stdout:967: finishing rollback tid 0 to smithi08477944-3 2024-03-30T12:25:45.651 INFO:tasks.rados.rados.0.smithi084.stdout:967: finishing rollback tid 1 to smithi08477944-3 2024-03-30T12:25:45.651 INFO:tasks.rados.rados.0.smithi084.stdout:967: finishing rollback tid 2 to smithi08477944-3 2024-03-30T12:25:45.651 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 556 (ObjNum 449 snap 0 seq_num 1429409920) dirty exists 2024-03-30T12:25:45.651 INFO:tasks.rados.rados.0.smithi084.stdout:967: done (2 left) 2024-03-30T12:25:45.652 INFO:tasks.rados.rados.0.smithi084.stdout:970: snap_create 2024-03-30T12:25:45.652 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 409 (ObjNum 288 snap 92 seq_num 288) dirty exists 2024-03-30T12:25:45.656 INFO:tasks.rados.rados.0.smithi084.stdout:969: finishing write tid 1 to smithi08477944-18 2024-03-30T12:25:45.656 INFO:tasks.rados.rados.0.smithi084.stdout:969: finishing write tid 2 to smithi08477944-18 2024-03-30T12:25:45.659 INFO:tasks.rados.rados.0.smithi084.stdout:969: finishing write tid 3 to smithi08477944-18 2024-03-30T12:25:45.659 INFO:tasks.rados.rados.0.smithi084.stdout:969: oid 18 updating version 0 to 595 2024-03-30T12:25:45.659 INFO:tasks.rados.rados.0.smithi084.stdout:969: oid 18 version 595 is already newer than 594 2024-03-30T12:25:45.659 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 595 (ObjNum 310 snap 102 seq_num 310) dirty exists 2024-03-30T12:25:45.659 INFO:tasks.rados.rados.0.smithi084.stdout:969: left oid 18 (ObjNum 310 snap 102 seq_num 310) 2024-03-30T12:25:45.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:45 smithi084 ceph-mon[91810]: Reconfiguring osd.3 (monmap changed)... 2024-03-30T12:25:45.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:45 smithi084 ceph-mon[91810]: Reconfiguring daemon osd.3 on smithi084 2024-03-30T12:25:45.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:45 smithi084 ceph-mon[91810]: pgmap v80: 121 pgs: 121 active+clean; 199 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 17 KiB/s rd, 1.1 MiB/s wr, 5 op/s 2024-03-30T12:25:45.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:25:45.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:45 smithi084 ceph-mon[91810]: osdmap e267: 8 total, 8 up, 8 in 2024-03-30T12:25:45.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:45 smithi084 ceph-mon[89279]: Reconfiguring osd.3 (monmap changed)... 2024-03-30T12:25:45.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:45 smithi084 ceph-mon[89279]: Reconfiguring daemon osd.3 on smithi084 2024-03-30T12:25:45.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:45 smithi084 ceph-mon[89279]: pgmap v80: 121 pgs: 121 active+clean; 199 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 17 KiB/s rd, 1.1 MiB/s wr, 5 op/s 2024-03-30T12:25:45.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:25:45.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:45 smithi084 ceph-mon[89279]: osdmap e267: 8 total, 8 up, 8 in 2024-03-30T12:25:46.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:45 smithi162 ceph-mon[83709]: Reconfiguring osd.3 (monmap changed)... 2024-03-30T12:25:46.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:45 smithi162 ceph-mon[83709]: Reconfiguring daemon osd.3 on smithi084 2024-03-30T12:25:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:45 smithi162 ceph-mon[83709]: pgmap v80: 121 pgs: 121 active+clean; 199 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 17 KiB/s rd, 1.1 MiB/s wr, 5 op/s 2024-03-30T12:25:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:25:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:45 smithi162 ceph-mon[83709]: osdmap e267: 8 total, 8 up, 8 in 2024-03-30T12:25:46.645 INFO:tasks.rados.rados.0.smithi084.stdout:968: done (2 left) 2024-03-30T12:25:46.645 INFO:tasks.rados.rados.0.smithi084.stdout:969: done (1 left) 2024-03-30T12:25:46.645 INFO:tasks.rados.rados.0.smithi084.stdout:970: done (0 left) 2024-03-30T12:25:46.646 INFO:tasks.rados.rados.0.smithi084.stdout:971: read oid 7 snap 97 2024-03-30T12:25:46.646 INFO:tasks.rados.rados.0.smithi084.stdout:971: expect (ObjNum 259 snap 80 seq_num 259) 2024-03-30T12:25:46.646 INFO:tasks.rados.rados.0.smithi084.stdout:972: rmattr oid 2 current snap is 103 2024-03-30T12:25:46.646 INFO:tasks.rados.rados.0.smithi084.stdout:973: copy_from oid 46 from oid 47 current snap is 103 2024-03-30T12:25:46.646 INFO:tasks.rados.rados.0.smithi084.stdout:974: copy_from oid 38 from oid 20 current snap is 103 2024-03-30T12:25:46.646 INFO:tasks.rados.rados.0.smithi084.stdout:975: copy_from oid 44 from oid 39 current snap is 103 2024-03-30T12:25:46.646 INFO:tasks.rados.rados.0.smithi084.stdout:976: delete oid 25 current snap is 103 2024-03-30T12:25:46.650 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 558 (ObjNum 250 snap 76 seq_num 250) dirty exists 2024-03-30T12:25:46.652 INFO:tasks.rados.rados.0.smithi084.stdout:972: done (5 left) 2024-03-30T12:25:46.652 INFO:tasks.rados.rados.0.smithi084.stdout:976: done (4 left) 2024-03-30T12:25:46.652 INFO:tasks.rados.rados.0.smithi084.stdout:977: rollback oid 49 current snap is 103 2024-03-30T12:25:46.652 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 49 to 99 2024-03-30T12:25:46.653 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 103 2024-03-30T12:25:46.653 INFO:tasks.rados.rados.0.smithi084.stdout:978: seq_num 312 ranges {0=434176} 2024-03-30T12:25:46.655 INFO:tasks.rados.rados.0.smithi084.stdout:978: writing smithi08477944-16 from 0 to 434176 tid 1 2024-03-30T12:25:46.655 INFO:tasks.rados.rados.0.smithi084.stdout:979: snap_remove snap 102 2024-03-30T12:25:47.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:47 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:47.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:47 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:47.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:47 smithi084 ceph-mon[91810]: Reconfiguring mds.a (monmap changed)... 2024-03-30T12:25:47.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:47 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-30T12:25:47.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:47 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:47.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:47 smithi084 ceph-mon[91810]: Reconfiguring daemon mds.a on smithi084 2024-03-30T12:25:47.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:47 smithi084 ceph-mon[91810]: pgmap v83: 121 pgs: 121 active+clean; 190 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 1 op/s 2024-03-30T12:25:47.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:47 smithi084 ceph-mon[91810]: osdmap e268: 8 total, 8 up, 8 in 2024-03-30T12:25:47.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:47 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:47.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:47 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:47.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:47 smithi084 ceph-mon[89279]: Reconfiguring mds.a (monmap changed)... 2024-03-30T12:25:47.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:47 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-30T12:25:47.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:47 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:47.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:47 smithi084 ceph-mon[89279]: Reconfiguring daemon mds.a on smithi084 2024-03-30T12:25:47.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:47 smithi084 ceph-mon[89279]: pgmap v83: 121 pgs: 121 active+clean; 190 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 1 op/s 2024-03-30T12:25:47.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:47 smithi084 ceph-mon[89279]: osdmap e268: 8 total, 8 up, 8 in 2024-03-30T12:25:47.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:47 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:47.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:47 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:47.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:47 smithi162 ceph-mon[83709]: Reconfiguring mds.a (monmap changed)... 2024-03-30T12:25:47.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:47 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-30T12:25:47.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:47 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:47.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:47 smithi162 ceph-mon[83709]: Reconfiguring daemon mds.a on smithi084 2024-03-30T12:25:47.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:47 smithi162 ceph-mon[83709]: pgmap v83: 121 pgs: 121 active+clean; 190 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 1 op/s 2024-03-30T12:25:47.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:47 smithi162 ceph-mon[83709]: osdmap e268: 8 total, 8 up, 8 in 2024-03-30T12:25:47.644 INFO:tasks.rados.rados.0.smithi084.stdout:979: done (6 left) 2024-03-30T12:25:47.644 INFO:tasks.rados.rados.0.smithi084.stdout:980: snap_remove snap 96 2024-03-30T12:25:48.653 INFO:tasks.rados.rados.0.smithi084.stdout:980: done (6 left) 2024-03-30T12:25:48.653 INFO:tasks.rados.rados.0.smithi084.stdout:981: copy_from oid 1 from oid 11 current snap is 103 2024-03-30T12:25:48.653 INFO:tasks.rados.rados.0.smithi084.stdout:977: finishing rollback tid 0 to smithi08477944-49 2024-03-30T12:25:48.653 INFO:tasks.rados.rados.0.smithi084.stdout:975: finishing copy_from racing read to smithi08477944-44 2024-03-30T12:25:48.653 INFO:tasks.rados.rados.0.smithi084.stdout:977: finishing rollback tid 1 to smithi08477944-49 2024-03-30T12:25:48.654 INFO:tasks.rados.rados.0.smithi084.stdout:977: finishing rollback tid 2 to smithi08477944-49 2024-03-30T12:25:48.654 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 427 (ObjNum 181 snap 50 seq_num 181) dirty exists 2024-03-30T12:25:48.654 INFO:tasks.rados.rados.0.smithi084.stdout:971: expect (ObjNum 259 snap 80 seq_num 259) 2024-03-30T12:25:48.715 INFO:tasks.rados.rados.0.smithi084.stdout:975: finishing copy_from to smithi08477944-44 2024-03-30T12:25:48.715 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 255 (ObjNum 170 snap 46 seq_num 170) dirty exists 2024-03-30T12:25:48.715 INFO:tasks.rados.rados.0.smithi084.stdout:978: finishing write tid 1 to smithi08477944-16 2024-03-30T12:25:48.716 INFO:tasks.rados.rados.0.smithi084.stdout:978: finishing write tid 2 to smithi08477944-16 2024-03-30T12:25:48.716 INFO:tasks.rados.rados.0.smithi084.stdout:978: finishing write tid 3 to smithi08477944-16 2024-03-30T12:25:48.716 INFO:tasks.rados.rados.0.smithi084.stdout:978: oid 16 updating version 0 to 597 2024-03-30T12:25:48.716 INFO:tasks.rados.rados.0.smithi084.stdout:978: oid 16 updating version 597 to 598 2024-03-30T12:25:48.716 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 598 (ObjNum 312 snap 103 seq_num 312) dirty exists 2024-03-30T12:25:48.716 INFO:tasks.rados.rados.0.smithi084.stdout:978: left oid 16 (ObjNum 312 snap 103 seq_num 312) 2024-03-30T12:25:48.716 INFO:tasks.rados.rados.0.smithi084.stdout:974: finishing copy_from racing read to smithi08477944-38 2024-03-30T12:25:48.716 INFO:tasks.rados.rados.0.smithi084.stdout:974: finishing copy_from to smithi08477944-38 2024-03-30T12:25:48.716 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 467 (ObjNum 267 snap 84 seq_num 267) dirty exists 2024-03-30T12:25:48.717 INFO:tasks.rados.rados.0.smithi084.stdout:973: finishing copy_from racing read to smithi08477944-46 2024-03-30T12:25:48.717 INFO:tasks.rados.rados.0.smithi084.stdout:973: finishing copy_from to smithi08477944-46 2024-03-30T12:25:48.717 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 657 (ObjNum 300 snap 95 seq_num 300) dirty exists 2024-03-30T12:25:48.717 INFO:tasks.rados.rados.0.smithi084.stdout:971: done (6 left) 2024-03-30T12:25:48.717 INFO:tasks.rados.rados.0.smithi084.stdout:973: done (5 left) 2024-03-30T12:25:48.717 INFO:tasks.rados.rados.0.smithi084.stdout:974: done (4 left) 2024-03-30T12:25:48.718 INFO:tasks.rados.rados.0.smithi084.stdout:975: done (3 left) 2024-03-30T12:25:48.718 INFO:tasks.rados.rados.0.smithi084.stdout:977: done (2 left) 2024-03-30T12:25:48.718 INFO:tasks.rados.rados.0.smithi084.stdout:978: done (1 left) 2024-03-30T12:25:48.718 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 103 2024-03-30T12:25:48.718 INFO:tasks.rados.rados.0.smithi084.stdout:981: finishing copy_from racing read to smithi08477944-1 2024-03-30T12:25:48.718 INFO:tasks.rados.rados.0.smithi084.stdout:982: seq_num 313 ranges {7094272=450560} 2024-03-30T12:25:48.754 INFO:tasks.rados.rados.0.smithi084.stdout:982: writing smithi08477944-17 from 7094272 to 7544832 tid 1 2024-03-30T12:25:48.754 INFO:tasks.rados.rados.0.smithi084.stdout:983: copy_from oid 3 from oid 35 current snap is 103 2024-03-30T12:25:48.754 INFO:tasks.rados.rados.0.smithi084.stdout:981: finishing copy_from to smithi08477944-1 2024-03-30T12:25:48.754 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 468 (ObjNum 260 snap 80 seq_num 260) dirty exists 2024-03-30T12:25:48.755 INFO:tasks.rados.rados.0.smithi084.stdout:981: done (2 left) 2024-03-30T12:25:48.755 INFO:tasks.rados.rados.0.smithi084.stdout:984: snap_create 2024-03-30T12:25:48.757 INFO:tasks.rados.rados.0.smithi084.stdout:983: finishing copy_from racing read to smithi08477944-3 2024-03-30T12:25:48.757 INFO:tasks.rados.rados.0.smithi084.stdout:982: finishing write tid 1 to smithi08477944-17 2024-03-30T12:25:48.757 INFO:tasks.rados.rados.0.smithi084.stdout:982: finishing write tid 2 to smithi08477944-17 2024-03-30T12:25:48.757 INFO:tasks.rados.rados.0.smithi084.stdout:983: finishing copy_from to smithi08477944-3 2024-03-30T12:25:48.757 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 407 (ObjNum 129 snap 0 seq_num 1428878416) dirty exists 2024-03-30T12:25:48.758 INFO:tasks.rados.rados.0.smithi084.stdout:982: finishing write tid 3 to smithi08477944-17 2024-03-30T12:25:48.758 INFO:tasks.rados.rados.0.smithi084.stdout:982: oid 17 updating version 0 to 457 2024-03-30T12:25:48.758 INFO:tasks.rados.rados.0.smithi084.stdout:982: oid 17 version 457 is already newer than 456 2024-03-30T12:25:48.758 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 457 (ObjNum 313 snap 103 seq_num 313) dirty exists 2024-03-30T12:25:48.758 INFO:tasks.rados.rados.0.smithi084.stdout:982: left oid 17 (ObjNum 313 snap 103 seq_num 313) 2024-03-30T12:25:48.968 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:48 smithi162 ceph-mon[83709]: osdmap e269: 8 total, 8 up, 8 in 2024-03-30T12:25:48.968 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:48 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:48.968 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:48 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:48.968 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:48 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:25:48.968 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:48 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:25:48.968 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:48 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:49.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:48 smithi084 ceph-mon[89279]: osdmap e269: 8 total, 8 up, 8 in 2024-03-30T12:25:49.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:48 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:49.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:48 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:49.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:48 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:25:49.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:48 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:25:49.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:48 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:49.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:48 smithi084 ceph-mon[91810]: osdmap e269: 8 total, 8 up, 8 in 2024-03-30T12:25:49.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:48 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:49.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:48 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:49.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:48 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T12:25:49.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:48 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T12:25:49.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:48 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:49.640 INFO:tasks.rados.rados.0.smithi084.stdout:982: done (2 left) 2024-03-30T12:25:49.640 INFO:tasks.rados.rados.0.smithi084.stdout:983: done (1 left) 2024-03-30T12:25:49.641 INFO:tasks.rados.rados.0.smithi084.stdout:984: done (0 left) 2024-03-30T12:25:49.641 INFO:tasks.rados.rados.0.smithi084.stdout:985: copy_from oid 34 from oid 25 current snap is 104 2024-03-30T12:25:49.641 INFO:tasks.rados.rados.0.smithi084.stdout:986: rollback oid 49 current snap is 104 2024-03-30T12:25:49.641 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 49 to 62 2024-03-30T12:25:49.641 INFO:tasks.rados.rados.0.smithi084.stdout:987: delete oid 4 current snap is 104 2024-03-30T12:25:49.643 INFO:tasks.rados.rados.0.smithi084.stdout:987: done (2 left) 2024-03-30T12:25:49.643 INFO:tasks.rados.rados.0.smithi084.stdout:988: delete oid 44 current snap is 104 2024-03-30T12:25:49.644 INFO:tasks.rados.rados.0.smithi084.stdout:985: finishing copy_from to smithi08477944-34 2024-03-30T12:25:49.644 INFO:tasks.rados.rados.0.smithi084.stdout:985: got expected ENOENT (src dne) 2024-03-30T12:25:49.644 INFO:tasks.rados.rados.0.smithi084.stdout:985: finishing copy_from racing read to smithi08477944-34 2024-03-30T12:25:49.646 INFO:tasks.rados.rados.0.smithi084.stdout:986: finishing rollback tid 0 to smithi08477944-49 2024-03-30T12:25:49.647 INFO:tasks.rados.rados.0.smithi084.stdout:986: finishing rollback tid 1 to smithi08477944-49 2024-03-30T12:25:49.648 INFO:tasks.rados.rados.0.smithi084.stdout:986: finishing rollback tid 2 to smithi08477944-49 2024-03-30T12:25:49.648 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 439 (ObjNum 181 snap 50 seq_num 181) dirty exists 2024-03-30T12:25:49.648 INFO:tasks.rados.rados.0.smithi084.stdout:985: done (2 left) 2024-03-30T12:25:49.648 INFO:tasks.rados.rados.0.smithi084.stdout:986: done (1 left) 2024-03-30T12:25:49.648 INFO:tasks.rados.rados.0.smithi084.stdout:988: done (0 left) 2024-03-30T12:25:49.648 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 104 2024-03-30T12:25:49.648 INFO:tasks.rados.rados.0.smithi084.stdout:989: seq_num 316 ranges {0=499712} 2024-03-30T12:25:49.650 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:25:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:25:49] "GET /metrics HTTP/1.1" 200 36002 "" "Prometheus/2.43.0" 2024-03-30T12:25:49.652 INFO:tasks.rados.rados.0.smithi084.stdout:989: writing smithi08477944-10 from 0 to 499712 tid 1 2024-03-30T12:25:49.652 INFO:tasks.rados.rados.0.smithi084.stdout:990: rmattr oid 1 current snap is 104 2024-03-30T12:25:49.652 INFO:tasks.rados.rados.0.smithi084.stdout:990: done (1 left) 2024-03-30T12:25:49.652 INFO:tasks.rados.rados.0.smithi084.stdout:991: read oid 7 snap 97 2024-03-30T12:25:49.653 INFO:tasks.rados.rados.0.smithi084.stdout:991: expect (ObjNum 259 snap 80 seq_num 259) 2024-03-30T12:25:49.653 INFO:tasks.rados.rados.0.smithi084.stdout:992: snap_remove snap 99 2024-03-30T12:25:50.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:49 smithi084 ceph-mon[91810]: Reconfiguring mon.b (monmap changed)... 2024-03-30T12:25:50.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:49 smithi084 ceph-mon[91810]: Reconfiguring daemon mon.b on smithi162 2024-03-30T12:25:50.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:49 smithi084 ceph-mon[91810]: pgmap v86: 121 pgs: 121 active+clean; 190 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 1 op/s 2024-03-30T12:25:50.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:49 smithi084 ceph-mon[91810]: osdmap e270: 8 total, 8 up, 8 in 2024-03-30T12:25:50.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:49 smithi084 ceph-mon[91810]: osdmap e271: 8 total, 8 up, 8 in 2024-03-30T12:25:50.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:49 smithi084 ceph-mon[89279]: Reconfiguring mon.b (monmap changed)... 2024-03-30T12:25:50.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:49 smithi084 ceph-mon[89279]: Reconfiguring daemon mon.b on smithi162 2024-03-30T12:25:50.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:49 smithi084 ceph-mon[89279]: pgmap v86: 121 pgs: 121 active+clean; 190 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 1 op/s 2024-03-30T12:25:50.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:49 smithi084 ceph-mon[89279]: osdmap e270: 8 total, 8 up, 8 in 2024-03-30T12:25:50.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:49 smithi084 ceph-mon[89279]: osdmap e271: 8 total, 8 up, 8 in 2024-03-30T12:25:50.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:49 smithi162 ceph-mon[83709]: Reconfiguring mon.b (monmap changed)... 2024-03-30T12:25:50.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:49 smithi162 ceph-mon[83709]: Reconfiguring daemon mon.b on smithi162 2024-03-30T12:25:50.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:49 smithi162 ceph-mon[83709]: pgmap v86: 121 pgs: 121 active+clean; 190 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 1 op/s 2024-03-30T12:25:50.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:49 smithi162 ceph-mon[83709]: osdmap e270: 8 total, 8 up, 8 in 2024-03-30T12:25:50.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:49 smithi162 ceph-mon[83709]: osdmap e271: 8 total, 8 up, 8 in 2024-03-30T12:25:50.323 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-03-30T12:25:50.655 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T12:25:50.656 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (5m) 41s ago 5m 25.2M - 0.25.0 c8568f914cd2 6765ce007f39 2024-03-30T12:25:50.656 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi162 *:3000 running (5m) 21s ago 5m 91.0M - 9.4.7 954c08fa6188 ff2ec7518619 2024-03-30T12:25:50.656 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (6m) 41s ago 6m 14.3M - 18.2.2-1051-gf14b5682 c8fb09e16a7d a9c2e74ca2a3 2024-03-30T12:25:50.656 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi162 running (6m) 21s ago 6m 19.7M - 18.2.2-1051-gf14b5682 c8fb09e16a7d ee1770ef5edd 2024-03-30T12:25:50.656 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi162 *:8443,9283,8765 running (91s) 21s ago 10m 449M - 19.0.0-1864-g5dc2ea30 548196a1a838 eec968f3fcc6 2024-03-30T12:25:50.656 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (2m) 41s ago 12m 501M - 19.0.0-1864-g5dc2ea30 548196a1a838 9a2aba19dffc 2024-03-30T12:25:50.656 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (76s) 41s ago 12m 38.4M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 a0811f2ae47d 2024-03-30T12:25:50.656 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi162 running (31s) 21s ago 10m 24.9M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 149ae6649e0c 2024-03-30T12:25:50.656 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (50s) 41s ago 10m 25.9M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 f79eca93cddd 2024-03-30T12:25:50.656 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (5m) 41s ago 5m 17.3M - 1.5.0 0da6a335fe13 66844bed39e8 2024-03-30T12:25:50.656 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi162 *:9100 running (5m) 21s ago 5m 15.5M - 1.5.0 0da6a335fe13 3d6e28b2348d 2024-03-30T12:25:50.656 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (10m) 41s ago 10m 212M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 4cad4c4383a6 2024-03-30T12:25:50.656 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (9m) 41s ago 9m 153M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 3b30b0ea0e32 2024-03-30T12:25:50.657 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (9m) 41s ago 9m 169M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d eb2412618811 2024-03-30T12:25:50.657 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (8m) 41s ago 8m 98.5M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 8eaf6dc73c25 2024-03-30T12:25:50.657 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi162 running (8m) 21s ago 8m 195M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 1f52e827b91a 2024-03-30T12:25:50.657 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi162 running (8m) 21s ago 8m 188M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 7ba250d154aa 2024-03-30T12:25:50.657 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi162 running (7m) 21s ago 7m 108M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 656a733e8b7a 2024-03-30T12:25:50.657 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi162 running (7m) 21s ago 7m 127M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d e3246b3bc88b 2024-03-30T12:25:50.657 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi162 *:9095 running (96s) 21s ago 6m 51.4M - 2.43.0 a07b618ecd1d bd7d323e4b47 2024-03-30T12:25:50.658 INFO:tasks.rados.rados.0.smithi084.stdout:992: done (2 left) 2024-03-30T12:25:50.658 INFO:tasks.rados.rados.0.smithi084.stdout:993: read oid 13 snap -1 2024-03-30T12:25:50.658 INFO:tasks.rados.rados.0.smithi084.stdout:993: expect deleted 2024-03-30T12:25:50.658 INFO:tasks.rados.rados.0.smithi084.stdout:994: snap_remove snap 62 2024-03-30T12:25:51.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:50 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:51.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:50 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:51.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:50 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:25:51.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:50 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T12:25:51.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:50 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:51.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:50 smithi084 ceph-mon[91810]: osdmap e272: 8 total, 8 up, 8 in 2024-03-30T12:25:51.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:50 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:51.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:50 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:51.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:50 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:25:51.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:50 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T12:25:51.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:50 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:51.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:50 smithi084 ceph-mon[89279]: osdmap e272: 8 total, 8 up, 8 in 2024-03-30T12:25:51.030 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:50 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:51.030 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:50 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:51.031 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:50 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T12:25:51.031 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:50 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T12:25:51.031 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:50 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:51.031 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:50 smithi162 ceph-mon[83709]: osdmap e272: 8 total, 8 up, 8 in 2024-03-30T12:25:51.082 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-30T12:25:51.082 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-03-30T12:25:51.082 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 3 2024-03-30T12:25:51.082 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:25:51.082 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-03-30T12:25:51.082 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 2 2024-03-30T12:25:51.082 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:25:51.083 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-03-30T12:25:51.083 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 8 2024-03-30T12:25:51.083 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:25:51.083 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-03-30T12:25:51.083 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 2 2024-03-30T12:25:51.083 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:25:51.083 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-03-30T12:25:51.083 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 10, 2024-03-30T12:25:51.083 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 5 2024-03-30T12:25:51.083 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-30T12:25:51.083 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-30T12:25:51.661 INFO:tasks.rados.rados.0.smithi084.stdout:994: done (3 left) 2024-03-30T12:25:51.661 INFO:tasks.rados.rados.0.smithi084.stdout:995: rollback oid 3 current snap is 104 2024-03-30T12:25:51.661 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 3 to 93 2024-03-30T12:25:51.662 INFO:tasks.rados.rados.0.smithi084.stdout:991: expect (ObjNum 259 snap 80 seq_num 259) 2024-03-30T12:25:51.722 INFO:tasks.rados.rados.0.smithi084.stdout:989: finishing write tid 1 to smithi08477944-10 2024-03-30T12:25:51.723 INFO:tasks.rados.rados.0.smithi084.stdout:989: finishing write tid 2 to smithi08477944-10 2024-03-30T12:25:51.723 INFO:tasks.rados.rados.0.smithi084.stdout:989: finishing write tid 3 to smithi08477944-10 2024-03-30T12:25:51.723 INFO:tasks.rados.rados.0.smithi084.stdout:989: oid 10 updating version 0 to 414 2024-03-30T12:25:51.723 INFO:tasks.rados.rados.0.smithi084.stdout:989: oid 10 updating version 414 to 415 2024-03-30T12:25:51.723 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 415 (ObjNum 316 snap 104 seq_num 316) dirty exists 2024-03-30T12:25:51.723 INFO:tasks.rados.rados.0.smithi084.stdout:989: left oid 10 (ObjNum 316 snap 104 seq_num 316) 2024-03-30T12:25:51.723 INFO:tasks.rados.rados.0.smithi084.stdout:989: done (3 left) 2024-03-30T12:25:51.723 INFO:tasks.rados.rados.0.smithi084.stdout:991: done (2 left) 2024-03-30T12:25:51.723 INFO:tasks.rados.rados.0.smithi084.stdout:996: snap_create 2024-03-30T12:25:51.723 INFO:tasks.rados.rados.0.smithi084.stdout:995: finishing rollback tid 0 to smithi08477944-3 2024-03-30T12:25:51.723 INFO:tasks.rados.rados.0.smithi084.stdout:995: finishing rollback tid 1 to smithi08477944-3 2024-03-30T12:25:51.723 INFO:tasks.rados.rados.0.smithi084.stdout:995: finishing rollback tid 2 to smithi08477944-3 2024-03-30T12:25:51.724 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 660 (ObjNum 129 snap 0 seq_num 1429327056) dirty exists 2024-03-30T12:25:52.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:51 smithi084 ceph-mon[91810]: Reconfiguring mgr.x (monmap changed)... 2024-03-30T12:25:52.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:51 smithi084 ceph-mon[91810]: Reconfiguring daemon mgr.x on smithi162 2024-03-30T12:25:52.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:51 smithi084 ceph-mon[91810]: from='client.44120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:25:52.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:51 smithi084 ceph-mon[91810]: pgmap v89: 121 pgs: 121 active+clean; 209 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 2.8 MiB/s rd, 4.6 MiB/s wr, 18 op/s 2024-03-30T12:25:52.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:51 smithi084 ceph-mon[91810]: from='client.34191 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:25:52.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:51 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/3128557393' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:25:52.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:51 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:52.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:51 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:52.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:51 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-30T12:25:52.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:51 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:52.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:51 smithi084 ceph-mon[91810]: osdmap e273: 8 total, 8 up, 8 in 2024-03-30T12:25:52.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:51 smithi084 ceph-mon[89279]: Reconfiguring mgr.x (monmap changed)... 2024-03-30T12:25:52.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:51 smithi084 ceph-mon[89279]: Reconfiguring daemon mgr.x on smithi162 2024-03-30T12:25:52.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:51 smithi084 ceph-mon[89279]: from='client.44120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:25:52.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:51 smithi084 ceph-mon[89279]: pgmap v89: 121 pgs: 121 active+clean; 209 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 2.8 MiB/s rd, 4.6 MiB/s wr, 18 op/s 2024-03-30T12:25:52.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:51 smithi084 ceph-mon[89279]: from='client.34191 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:25:52.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:51 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/3128557393' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:25:52.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:51 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:52.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:51 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:52.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:51 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-30T12:25:52.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:51 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:52.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:51 smithi084 ceph-mon[89279]: osdmap e273: 8 total, 8 up, 8 in 2024-03-30T12:25:52.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:51 smithi162 ceph-mon[83709]: Reconfiguring mgr.x (monmap changed)... 2024-03-30T12:25:52.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:51 smithi162 ceph-mon[83709]: Reconfiguring daemon mgr.x on smithi162 2024-03-30T12:25:52.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:51 smithi162 ceph-mon[83709]: from='client.44120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:25:52.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:51 smithi162 ceph-mon[83709]: pgmap v89: 121 pgs: 121 active+clean; 209 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 2.8 MiB/s rd, 4.6 MiB/s wr, 18 op/s 2024-03-30T12:25:52.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:51 smithi162 ceph-mon[83709]: from='client.34191 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:25:52.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:51 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/3128557393' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:25:52.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:51 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:52.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:51 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:52.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:51 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-30T12:25:52.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:51 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:52.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:51 smithi162 ceph-mon[83709]: osdmap e273: 8 total, 8 up, 8 in 2024-03-30T12:25:52.658 INFO:tasks.rados.rados.0.smithi084.stdout:993: done (2 left) 2024-03-30T12:25:52.658 INFO:tasks.rados.rados.0.smithi084.stdout:995: done (1 left) 2024-03-30T12:25:52.658 INFO:tasks.rados.rados.0.smithi084.stdout:996: done (0 left) 2024-03-30T12:25:52.658 INFO:tasks.rados.rados.0.smithi084.stdout:997: snap_create 2024-03-30T12:25:53.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:52 smithi084 ceph-mon[91810]: Reconfiguring osd.4 (monmap changed)... 2024-03-30T12:25:53.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:52 smithi084 ceph-mon[91810]: Reconfiguring daemon osd.4 on smithi162 2024-03-30T12:25:53.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:52 smithi084 ceph-mon[91810]: osdmap e274: 8 total, 8 up, 8 in 2024-03-30T12:25:53.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:52 smithi084 ceph-mon[89279]: Reconfiguring osd.4 (monmap changed)... 2024-03-30T12:25:53.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:52 smithi084 ceph-mon[89279]: Reconfiguring daemon osd.4 on smithi162 2024-03-30T12:25:53.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:52 smithi084 ceph-mon[89279]: osdmap e274: 8 total, 8 up, 8 in 2024-03-30T12:25:53.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:52 smithi162 ceph-mon[83709]: Reconfiguring osd.4 (monmap changed)... 2024-03-30T12:25:53.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:52 smithi162 ceph-mon[83709]: Reconfiguring daemon osd.4 on smithi162 2024-03-30T12:25:53.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:52 smithi162 ceph-mon[83709]: osdmap e274: 8 total, 8 up, 8 in 2024-03-30T12:25:53.659 INFO:tasks.rados.rados.0.smithi084.stdout:997: done (0 left) 2024-03-30T12:25:53.659 INFO:tasks.rados.rados.0.smithi084.stdout:998: delete oid 39 current snap is 106 2024-03-30T12:25:53.665 INFO:tasks.rados.rados.0.smithi084.stdout:998: done (0 left) 2024-03-30T12:25:53.665 INFO:tasks.rados.rados.0.smithi084.stdout:999: rollback oid 33 current snap is 106 2024-03-30T12:25:53.665 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 33 to 90 2024-03-30T12:25:53.665 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 106 2024-03-30T12:25:53.665 INFO:tasks.rados.rados.0.smithi084.stdout:1000: seq_num 318 ranges {622592=532480} 2024-03-30T12:25:53.672 INFO:tasks.rados.rados.0.smithi084.stdout:1000: writing smithi08477944-12 from 622592 to 1155072 tid 1 2024-03-30T12:25:53.672 INFO:tasks.rados.rados.0.smithi084.stdout:1001: rollback oid 42 current snap is 106 2024-03-30T12:25:53.672 INFO:tasks.rados.rados.0.smithi084.stdout:999: finishing rollback tid 0 to smithi08477944-33 2024-03-30T12:25:53.672 INFO:tasks.rados.rados.0.smithi084.stdout:999: finishing rollback tid 1 to smithi08477944-33 2024-03-30T12:25:53.672 INFO:tasks.rados.rados.0.smithi084.stdout:999: finishing rollback tid 2 to smithi08477944-33 2024-03-30T12:25:53.672 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 687 (ObjNum 167 snap 45 seq_num 167) dirty exists 2024-03-30T12:25:53.672 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 42 to 95 2024-03-30T12:25:53.672 INFO:tasks.rados.rados.0.smithi084.stdout:999: done (2 left) 2024-03-30T12:25:53.673 INFO:tasks.rados.rados.0.smithi084.stdout:1002: snap_remove snap 103 2024-03-30T12:25:53.949 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:53 smithi162 ceph-mon[83709]: pgmap v92: 121 pgs: 121 active+clean; 209 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 2.8 MiB/s rd, 4.6 MiB/s wr, 18 op/s 2024-03-30T12:25:53.949 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:53 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:53.950 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:53 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:53.950 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:53 smithi162 ceph-mon[83709]: Reconfiguring osd.5 (monmap changed)... 2024-03-30T12:25:53.950 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:53 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-30T12:25:53.950 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:53 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:53.950 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:53 smithi162 ceph-mon[83709]: Reconfiguring daemon osd.5 on smithi162 2024-03-30T12:25:53.950 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:53 smithi162 ceph-mon[83709]: osdmap e275: 8 total, 8 up, 8 in 2024-03-30T12:25:54.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:53 smithi084 ceph-mon[91810]: pgmap v92: 121 pgs: 121 active+clean; 209 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 2.8 MiB/s rd, 4.6 MiB/s wr, 18 op/s 2024-03-30T12:25:54.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:53 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:54.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:53 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:54.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:53 smithi084 ceph-mon[91810]: Reconfiguring osd.5 (monmap changed)... 2024-03-30T12:25:54.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:53 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-30T12:25:54.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:53 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:54.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:53 smithi084 ceph-mon[91810]: Reconfiguring daemon osd.5 on smithi162 2024-03-30T12:25:54.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:53 smithi084 ceph-mon[91810]: osdmap e275: 8 total, 8 up, 8 in 2024-03-30T12:25:54.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:53 smithi084 ceph-mon[89279]: pgmap v92: 121 pgs: 121 active+clean; 209 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 2.8 MiB/s rd, 4.6 MiB/s wr, 18 op/s 2024-03-30T12:25:54.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:53 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:54.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:53 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:54.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:53 smithi084 ceph-mon[89279]: Reconfiguring osd.5 (monmap changed)... 2024-03-30T12:25:54.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:53 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-30T12:25:54.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:53 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:54.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:53 smithi084 ceph-mon[89279]: Reconfiguring daemon osd.5 on smithi162 2024-03-30T12:25:54.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:53 smithi084 ceph-mon[89279]: osdmap e275: 8 total, 8 up, 8 in 2024-03-30T12:25:54.645 INFO:tasks.rados.rados.0.smithi084.stdout:1002: done (2 left) 2024-03-30T12:25:54.645 INFO:tasks.rados.rados.0.smithi084.stdout:1003: read oid 8 snap -1 2024-03-30T12:25:54.645 INFO:tasks.rados.rados.0.smithi084.stdout:1003: expect deleted 2024-03-30T12:25:54.645 INFO:tasks.rados.rados.0.smithi084.stdout:1004: setattr oid 25 current snap is 106 2024-03-30T12:25:54.645 INFO:tasks.rados.rados.0.smithi084.stdout:1001: finishing rollback tid 1 to smithi08477944-42 2024-03-30T12:25:54.645 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 0 (ObjNum 129 snap 0 seq_num 1429911160) dirty dne 2024-03-30T12:25:54.645 INFO:tasks.rados.rados.0.smithi084.stdout:1000: finishing write tid 1 to smithi08477944-12 2024-03-30T12:25:54.645 INFO:tasks.rados.rados.0.smithi084.stdout:1000: finishing write tid 2 to smithi08477944-12 2024-03-30T12:25:54.645 INFO:tasks.rados.rados.0.smithi084.stdout:1000: finishing write tid 3 to smithi08477944-12 2024-03-30T12:25:54.645 INFO:tasks.rados.rados.0.smithi084.stdout:1000: oid 12 updating version 0 to 416 2024-03-30T12:25:54.645 INFO:tasks.rados.rados.0.smithi084.stdout:1000: oid 12 version 416 is already newer than 415 2024-03-30T12:25:54.646 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 416 (ObjNum 318 snap 106 seq_num 318) dirty exists 2024-03-30T12:25:54.646 INFO:tasks.rados.rados.0.smithi084.stdout:1000: left oid 12 (ObjNum 318 snap 106 seq_num 318) 2024-03-30T12:25:54.648 INFO:tasks.rados.rados.0.smithi084.stdout:1000: done (3 left) 2024-03-30T12:25:54.648 INFO:tasks.rados.rados.0.smithi084.stdout:1001: done (2 left) 2024-03-30T12:25:54.648 INFO:tasks.rados.rados.0.smithi084.stdout:1003: done (1 left) 2024-03-30T12:25:54.648 INFO:tasks.rados.rados.0.smithi084.stdout:1005: delete oid 6 current snap is 106 2024-03-30T12:25:54.655 INFO:tasks.rados.rados.0.smithi084.stdout:1005: done (1 left) 2024-03-30T12:25:54.656 INFO:tasks.rados.rados.0.smithi084.stdout:1006: snap_create 2024-03-30T12:25:54.657 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 470 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:25:55.652 INFO:tasks.rados.rados.0.smithi084.stdout:1004: done (1 left) 2024-03-30T12:25:55.652 INFO:tasks.rados.rados.0.smithi084.stdout:1006: done (0 left) 2024-03-30T12:25:55.652 INFO:tasks.rados.rados.0.smithi084.stdout:1007: rollback oid 41 current snap is 107 2024-03-30T12:25:55.652 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 41 to 101 2024-03-30T12:25:55.652 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 107 2024-03-30T12:25:55.652 INFO:tasks.rados.rados.0.smithi084.stdout:1008: seq_num 320 ranges {0=565248} 2024-03-30T12:25:55.655 INFO:tasks.rados.rados.0.smithi084.stdout:1008: writing smithi08477944-4 from 0 to 565248 tid 1 2024-03-30T12:25:55.655 INFO:tasks.rados.rados.0.smithi084.stdout:1009: delete oid 19 current snap is 107 2024-03-30T12:25:55.656 INFO:tasks.rados.rados.0.smithi084.stdout:1007: finishing rollback tid 0 to smithi08477944-41 2024-03-30T12:25:55.656 INFO:tasks.rados.rados.0.smithi084.stdout:1007: finishing rollback tid 1 to smithi08477944-41 2024-03-30T12:25:55.656 INFO:tasks.rados.rados.0.smithi084.stdout:1007: finishing rollback tid 2 to smithi08477944-41 2024-03-30T12:25:55.656 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 618 (ObjNum 271 snap 84 seq_num 271) dirty exists 2024-03-30T12:25:55.658 INFO:tasks.rados.rados.0.smithi084.stdout:1008: finishing write tid 1 to smithi08477944-4 2024-03-30T12:25:55.659 INFO:tasks.rados.rados.0.smithi084.stdout:1008: finishing write tid 2 to smithi08477944-4 2024-03-30T12:25:55.661 INFO:tasks.rados.rados.0.smithi084.stdout:1007: done (2 left) 2024-03-30T12:25:55.661 INFO:tasks.rados.rados.0.smithi084.stdout:1009: done (1 left) 2024-03-30T12:25:55.662 INFO:tasks.rados.rados.0.smithi084.stdout:1010: rollback oid 6 current snap is 107 2024-03-30T12:25:55.662 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 6 to 65 2024-03-30T12:25:55.662 INFO:tasks.rados.rados.0.smithi084.stdout:1008: finishing write tid 3 to smithi08477944-4 2024-03-30T12:25:55.662 INFO:tasks.rados.rados.0.smithi084.stdout:1008: oid 4 updating version 0 to 440 2024-03-30T12:25:55.662 INFO:tasks.rados.rados.0.smithi084.stdout:1008: oid 4 version 440 is already newer than 439 2024-03-30T12:25:55.662 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 440 (ObjNum 320 snap 107 seq_num 320) dirty exists 2024-03-30T12:25:55.662 INFO:tasks.rados.rados.0.smithi084.stdout:1008: left oid 4 (ObjNum 320 snap 107 seq_num 320) 2024-03-30T12:25:55.662 INFO:tasks.rados.rados.0.smithi084.stdout:1008: done (1 left) 2024-03-30T12:25:55.662 INFO:tasks.rados.rados.0.smithi084.stdout:1011: snap_remove snap 95 2024-03-30T12:25:56.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:55 smithi084 ceph-mon[91810]: pgmap v95: 121 pgs: 121 active+clean; 209 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail 2024-03-30T12:25:56.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:55 smithi084 ceph-mon[91810]: osdmap e276: 8 total, 8 up, 8 in 2024-03-30T12:25:56.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:55 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:56.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:55 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:56.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:55 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-30T12:25:56.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:55 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:56.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:55 smithi084 ceph-mon[89279]: pgmap v95: 121 pgs: 121 active+clean; 209 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail 2024-03-30T12:25:56.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:55 smithi084 ceph-mon[89279]: osdmap e276: 8 total, 8 up, 8 in 2024-03-30T12:25:56.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:56.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:56.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-30T12:25:56.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:56.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:55 smithi162 ceph-mon[83709]: pgmap v95: 121 pgs: 121 active+clean; 209 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail 2024-03-30T12:25:56.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:55 smithi162 ceph-mon[83709]: osdmap e276: 8 total, 8 up, 8 in 2024-03-30T12:25:56.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:55 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:56.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:55 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:56.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:55 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-30T12:25:56.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:55 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:56.654 INFO:tasks.rados.rados.0.smithi084.stdout:1011: done (1 left) 2024-03-30T12:25:56.655 INFO:tasks.rados.rados.0.smithi084.stdout:1012: read oid 20 snap -1 2024-03-30T12:25:56.655 INFO:tasks.rados.rados.0.smithi084.stdout:1012: expect (ObjNum 267 snap 84 seq_num 267) 2024-03-30T12:25:56.655 INFO:tasks.rados.rados.0.smithi084.stdout:1013: rmattr oid 30 current snap is 107 2024-03-30T12:25:56.655 INFO:tasks.rados.rados.0.smithi084.stdout:1013: done (2 left) 2024-03-30T12:25:56.655 INFO:tasks.rados.rados.0.smithi084.stdout:1014: copy_from oid 42 from oid 40 current snap is 107 2024-03-30T12:25:56.655 INFO:tasks.rados.rados.0.smithi084.stdout:1010: finishing rollback tid 1 to smithi08477944-6 2024-03-30T12:25:56.655 INFO:tasks.rados.rados.0.smithi084.stdout:1010: finishing rollback tid 2 to smithi08477944-6 2024-03-30T12:25:56.655 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 545 (ObjNum 218 snap 64 seq_num 218) dirty exists 2024-03-30T12:25:56.655 INFO:tasks.rados.rados.0.smithi084.stdout:1010: done (2 left) 2024-03-30T12:25:56.655 INFO:tasks.rados.rados.0.smithi084.stdout:1015: snap_create 2024-03-30T12:25:56.680 INFO:tasks.rados.rados.0.smithi084.stdout:1012: expect (ObjNum 267 snap 84 seq_num 267) 2024-03-30T12:25:56.834 INFO:tasks.rados.rados.0.smithi084.stdout:1014: finishing copy_from racing read to smithi08477944-42 2024-03-30T12:25:56.834 INFO:tasks.rados.rados.0.smithi084.stdout:1014: finishing copy_from to smithi08477944-42 2024-03-30T12:25:56.834 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 631 (ObjNum 205 snap 62 seq_num 205) dirty exists 2024-03-30T12:25:56.970 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:56 smithi162 ceph-mon[83709]: Reconfiguring osd.6 (monmap changed)... 2024-03-30T12:25:56.970 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:56 smithi162 ceph-mon[83709]: Reconfiguring daemon osd.6 on smithi162 2024-03-30T12:25:56.970 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:56 smithi162 ceph-mon[83709]: osdmap e277: 8 total, 8 up, 8 in 2024-03-30T12:25:56.970 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:56 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:56.971 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:56 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:56.971 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:56 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-30T12:25:56.971 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:56 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:57.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:56 smithi084 ceph-mon[91810]: Reconfiguring osd.6 (monmap changed)... 2024-03-30T12:25:57.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:56 smithi084 ceph-mon[91810]: Reconfiguring daemon osd.6 on smithi162 2024-03-30T12:25:57.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:56 smithi084 ceph-mon[91810]: osdmap e277: 8 total, 8 up, 8 in 2024-03-30T12:25:57.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:56 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:57.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:56 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:57.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:56 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-30T12:25:57.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:56 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:57.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:56 smithi084 ceph-mon[89279]: Reconfiguring osd.6 (monmap changed)... 2024-03-30T12:25:57.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:56 smithi084 ceph-mon[89279]: Reconfiguring daemon osd.6 on smithi162 2024-03-30T12:25:57.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:56 smithi084 ceph-mon[89279]: osdmap e277: 8 total, 8 up, 8 in 2024-03-30T12:25:57.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:56 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:57.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:56 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:57.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:56 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-30T12:25:57.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:56 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:57.672 INFO:tasks.rados.rados.0.smithi084.stdout:1012: done (2 left) 2024-03-30T12:25:57.673 INFO:tasks.rados.rados.0.smithi084.stdout:1014: done (1 left) 2024-03-30T12:25:57.673 INFO:tasks.rados.rados.0.smithi084.stdout:1015: done (0 left) 2024-03-30T12:25:57.673 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 28 current snap is 108 2024-03-30T12:25:57.673 INFO:tasks.rados.rados.0.smithi084.stdout:1016: seq_num 322 ranges {3653632=598016} 2024-03-30T12:25:57.695 INFO:tasks.rados.rados.0.smithi084.stdout:1016: writing smithi08477944-28 from 3653632 to 4251648 tid 1 2024-03-30T12:25:57.695 INFO:tasks.rados.rados.0.smithi084.stdout:1017: rmattr oid 39 current snap is 108 2024-03-30T12:25:57.695 INFO:tasks.rados.rados.0.smithi084.stdout:1017: done (1 left) 2024-03-30T12:25:57.695 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 108 2024-03-30T12:25:57.695 INFO:tasks.rados.rados.0.smithi084.stdout:1018: seq_num 323 ranges {2170880=614400} 2024-03-30T12:25:57.711 INFO:tasks.rados.rados.0.smithi084.stdout:1018: writing smithi08477944-34 from 2170880 to 2785280 tid 1 2024-03-30T12:25:57.711 INFO:tasks.rados.rados.0.smithi084.stdout:1019: copy_from oid 3 from oid 13 current snap is 108 2024-03-30T12:25:57.711 INFO:tasks.rados.rados.0.smithi084.stdout:1016: finishing write tid 1 to smithi08477944-28 2024-03-30T12:25:57.711 INFO:tasks.rados.rados.0.smithi084.stdout:1016: finishing write tid 2 to smithi08477944-28 2024-03-30T12:25:57.711 INFO:tasks.rados.rados.0.smithi084.stdout:1016: finishing write tid 3 to smithi08477944-28 2024-03-30T12:25:57.711 INFO:tasks.rados.rados.0.smithi084.stdout:1016: oid 28 updating version 0 to 444 2024-03-30T12:25:57.711 INFO:tasks.rados.rados.0.smithi084.stdout:1016: oid 28 updating version 444 to 445 2024-03-30T12:25:57.711 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 445 (ObjNum 322 snap 108 seq_num 322) dirty exists 2024-03-30T12:25:57.712 INFO:tasks.rados.rados.0.smithi084.stdout:1016: left oid 28 (ObjNum 322 snap 108 seq_num 322) 2024-03-30T12:25:57.712 INFO:tasks.rados.rados.0.smithi084.stdout:1016: done (2 left) 2024-03-30T12:25:57.712 INFO:tasks.rados.rados.0.smithi084.stdout:1020: copy_from oid 5 from oid 45 current snap is 108 2024-03-30T12:25:57.712 INFO:tasks.rados.rados.0.smithi084.stdout:1021: snap_create 2024-03-30T12:25:57.712 INFO:tasks.rados.rados.0.smithi084.stdout:1019: finishing copy_from to smithi08477944-3 2024-03-30T12:25:57.712 INFO:tasks.rados.rados.0.smithi084.stdout:1019: got expected ENOENT (src dne) 2024-03-30T12:25:57.712 INFO:tasks.rados.rados.0.smithi084.stdout:1019: finishing copy_from racing read to smithi08477944-3 2024-03-30T12:25:57.719 INFO:tasks.rados.rados.0.smithi084.stdout:1018: finishing write tid 1 to smithi08477944-34 2024-03-30T12:25:57.719 INFO:tasks.rados.rados.0.smithi084.stdout:1018: finishing write tid 2 to smithi08477944-34 2024-03-30T12:25:57.719 INFO:tasks.rados.rados.0.smithi084.stdout:1018: finishing write tid 3 to smithi08477944-34 2024-03-30T12:25:57.719 INFO:tasks.rados.rados.0.smithi084.stdout:1018: oid 34 updating version 0 to 418 2024-03-30T12:25:57.719 INFO:tasks.rados.rados.0.smithi084.stdout:1018: oid 34 version 418 is already newer than 417 2024-03-30T12:25:57.719 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 418 (ObjNum 323 snap 108 seq_num 323) dirty exists 2024-03-30T12:25:57.719 INFO:tasks.rados.rados.0.smithi084.stdout:1018: left oid 34 (ObjNum 323 snap 108 seq_num 323) 2024-03-30T12:25:57.723 INFO:tasks.rados.rados.0.smithi084.stdout:1020: finishing copy_from racing read to smithi08477944-5 2024-03-30T12:25:57.723 INFO:tasks.rados.rados.0.smithi084.stdout:1020: finishing copy_from to smithi08477944-5 2024-03-30T12:25:57.723 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 265 (ObjNum 234 snap 73 seq_num 234) dirty exists 2024-03-30T12:25:57.918 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:57 smithi162 ceph-mon[83709]: Reconfiguring osd.7 (monmap changed)... 2024-03-30T12:25:57.919 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:57 smithi162 ceph-mon[83709]: Reconfiguring daemon osd.7 on smithi162 2024-03-30T12:25:57.919 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:57 smithi162 ceph-mon[83709]: pgmap v98: 121 pgs: 121 active+clean; 206 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 130 KiB/s wr, 7 op/s 2024-03-30T12:25:57.919 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:57 smithi162 ceph-mon[83709]: osdmap e278: 8 total, 8 up, 8 in 2024-03-30T12:25:58.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:57 smithi084 ceph-mon[91810]: Reconfiguring osd.7 (monmap changed)... 2024-03-30T12:25:58.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:57 smithi084 ceph-mon[91810]: Reconfiguring daemon osd.7 on smithi162 2024-03-30T12:25:58.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:57 smithi084 ceph-mon[91810]: pgmap v98: 121 pgs: 121 active+clean; 206 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 130 KiB/s wr, 7 op/s 2024-03-30T12:25:58.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:57 smithi084 ceph-mon[91810]: osdmap e278: 8 total, 8 up, 8 in 2024-03-30T12:25:58.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:57 smithi084 ceph-mon[89279]: Reconfiguring osd.7 (monmap changed)... 2024-03-30T12:25:58.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:57 smithi084 ceph-mon[89279]: Reconfiguring daemon osd.7 on smithi162 2024-03-30T12:25:58.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:57 smithi084 ceph-mon[89279]: pgmap v98: 121 pgs: 121 active+clean; 206 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 130 KiB/s wr, 7 op/s 2024-03-30T12:25:58.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:57 smithi084 ceph-mon[89279]: osdmap e278: 8 total, 8 up, 8 in 2024-03-30T12:25:58.674 INFO:tasks.rados.rados.0.smithi084.stdout:1018: done (3 left) 2024-03-30T12:25:58.674 INFO:tasks.rados.rados.0.smithi084.stdout:1019: done (2 left) 2024-03-30T12:25:58.674 INFO:tasks.rados.rados.0.smithi084.stdout:1020: done (1 left) 2024-03-30T12:25:58.674 INFO:tasks.rados.rados.0.smithi084.stdout:1021: done (0 left) 2024-03-30T12:25:58.674 INFO:tasks.rados.rados.0.smithi084.stdout:1022: snap_create 2024-03-30T12:25:58.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:58 smithi162 ceph-mon[83709]: osdmap e279: 8 total, 8 up, 8 in 2024-03-30T12:25:58.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:58 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:58.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:58 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:58.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:58 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-30T12:25:58.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:58 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:59.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:58 smithi084 ceph-mon[89279]: osdmap e279: 8 total, 8 up, 8 in 2024-03-30T12:25:59.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:58 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:59.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:58 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:59.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:58 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-30T12:25:59.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:58 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:59.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:58 smithi084 ceph-mon[91810]: osdmap e279: 8 total, 8 up, 8 in 2024-03-30T12:25:59.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:58 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:59.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:58 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:59.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:58 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-30T12:25:59.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:58 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:25:59.642 INFO:tasks.rados.rados.0.smithi084.stdout:1022: done (0 left) 2024-03-30T12:25:59.642 INFO:tasks.rados.rados.0.smithi084.stdout:1023: snap_remove snap 93 2024-03-30T12:25:59.672 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:25:59] "GET /metrics HTTP/1.1" 200 36002 "" "Prometheus/2.43.0" 2024-03-30T12:25:59.673 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[89279]: Reconfiguring mds.b (monmap changed)... 2024-03-30T12:25:59.673 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[89279]: Reconfiguring daemon mds.b on smithi162 2024-03-30T12:25:59.673 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[89279]: pgmap v101: 121 pgs: 121 active+clean; 206 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 130 KiB/s wr, 7 op/s 2024-03-30T12:25:59.673 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[89279]: osdmap e280: 8 total, 8 up, 8 in 2024-03-30T12:25:59.673 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:59.673 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:59.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:59 smithi162 ceph-mon[83709]: Reconfiguring mds.b (monmap changed)... 2024-03-30T12:25:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:59 smithi162 ceph-mon[83709]: Reconfiguring daemon mds.b on smithi162 2024-03-30T12:25:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:59 smithi162 ceph-mon[83709]: pgmap v101: 121 pgs: 121 active+clean; 206 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 130 KiB/s wr, 7 op/s 2024-03-30T12:25:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:59 smithi162 ceph-mon[83709]: osdmap e280: 8 total, 8 up, 8 in 2024-03-30T12:25:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:25:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:25:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:25:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T12:25:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-03-30T12:25:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T12:25:59.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-03-30T12:25:59.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T12:25:59.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-03-30T12:25:59.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:25:59.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:25:59.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-30T12:25:59.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:25:59 smithi162 ceph-mon[83709]: osdmap e281: 8 total, 8 up, 8 in 2024-03-30T12:26:00.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:26:00.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:00.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:00.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:00.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T12:26:00.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-03-30T12:26:00.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T12:26:00.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-03-30T12:26:00.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T12:26:00.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-03-30T12:26:00.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:00.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:00.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-30T12:26:00.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[89279]: osdmap e281: 8 total, 8 up, 8 in 2024-03-30T12:26:00.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[91810]: Reconfiguring mds.b (monmap changed)... 2024-03-30T12:26:00.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[91810]: Reconfiguring daemon mds.b on smithi162 2024-03-30T12:26:00.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[91810]: pgmap v101: 121 pgs: 121 active+clean; 206 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 130 KiB/s wr, 7 op/s 2024-03-30T12:26:00.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[91810]: osdmap e280: 8 total, 8 up, 8 in 2024-03-30T12:26:00.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:00.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:00.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:26:00.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:00.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:00.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:00.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T12:26:00.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-03-30T12:26:00.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T12:26:00.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-03-30T12:26:00.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T12:26:00.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-03-30T12:26:00.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:00.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:00.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-30T12:26:00.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:25:59 smithi084 ceph-mon[91810]: osdmap e281: 8 total, 8 up, 8 in 2024-03-30T12:26:00.646 INFO:tasks.rados.rados.0.smithi084.stdout:1023: done (0 left) 2024-03-30T12:26:00.646 INFO:tasks.rados.rados.0.smithi084.stdout:1024: rollback oid 5 current snap is 110 2024-03-30T12:26:00.646 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 5 to 109 2024-03-30T12:26:00.646 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 110 2024-03-30T12:26:00.646 INFO:tasks.rados.rados.0.smithi084.stdout:1025: seq_num 324 ranges {3776512=630784} 2024-03-30T12:26:00.672 INFO:tasks.rados.rados.0.smithi084.stdout:1025: writing smithi08477944-29 from 3776512 to 4407296 tid 1 2024-03-30T12:26:00.672 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 110 2024-03-30T12:26:00.672 INFO:tasks.rados.rados.0.smithi084.stdout:1024: finishing rollback tid 0 to smithi08477944-5 2024-03-30T12:26:00.672 INFO:tasks.rados.rados.0.smithi084.stdout:1026: seq_num 325 ranges {499712=647168} 2024-03-30T12:26:00.679 INFO:tasks.rados.rados.0.smithi084.stdout:1026: writing smithi08477944-10 from 499712 to 1146880 tid 1 2024-03-30T12:26:00.679 INFO:tasks.rados.rados.0.smithi084.stdout:1027: delete oid 26 current snap is 110 2024-03-30T12:26:00.679 INFO:tasks.rados.rados.0.smithi084.stdout:1024: finishing rollback tid 1 to smithi08477944-5 2024-03-30T12:26:00.679 INFO:tasks.rados.rados.0.smithi084.stdout:1024: finishing rollback tid 2 to smithi08477944-5 2024-03-30T12:26:00.679 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 473 (ObjNum 234 snap 73 seq_num 234) dirty exists 2024-03-30T12:26:00.679 INFO:tasks.rados.rados.0.smithi084.stdout:1025: finishing write tid 1 to smithi08477944-29 2024-03-30T12:26:00.679 INFO:tasks.rados.rados.0.smithi084.stdout:1025: finishing write tid 2 to smithi08477944-29 2024-03-30T12:26:00.679 INFO:tasks.rados.rados.0.smithi084.stdout:1025: finishing write tid 3 to smithi08477944-29 2024-03-30T12:26:00.679 INFO:tasks.rados.rados.0.smithi084.stdout:1025: oid 29 updating version 0 to 451 2024-03-30T12:26:00.679 INFO:tasks.rados.rados.0.smithi084.stdout:1025: oid 29 updating version 451 to 452 2024-03-30T12:26:00.679 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 452 (ObjNum 324 snap 110 seq_num 324) dirty exists 2024-03-30T12:26:00.680 INFO:tasks.rados.rados.0.smithi084.stdout:1025: left oid 29 (ObjNum 324 snap 110 seq_num 324) 2024-03-30T12:26:00.680 INFO:tasks.rados.rados.0.smithi084.stdout:1024: done (3 left) 2024-03-30T12:26:00.680 INFO:tasks.rados.rados.0.smithi084.stdout:1025: done (2 left) 2024-03-30T12:26:00.680 INFO:tasks.rados.rados.0.smithi084.stdout:1027: done (1 left) 2024-03-30T12:26:00.680 INFO:tasks.rados.rados.0.smithi084.stdout:1028: read oid 39 snap -1 2024-03-30T12:26:00.681 INFO:tasks.rados.rados.0.smithi084.stdout:1028: expect deleted 2024-03-30T12:26:00.681 INFO:tasks.rados.rados.0.smithi084.stdout:1029: snap_remove snap 104 2024-03-30T12:26:00.727 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:00 smithi084 ceph-mon[89279]: Upgrade: Setting container_image for all mon 2024-03-30T12:26:00.727 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:00 smithi084 ceph-mon[89279]: Upgrade: Setting container_image for all crash 2024-03-30T12:26:00.727 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:00 smithi084 ceph-mon[89279]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-30T12:26:00.728 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:00 smithi084 ceph-mon[89279]: Upgrade: osd.0 is safe to restart 2024-03-30T12:26:00.728 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:00 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:26:00.728 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:00 smithi084 ceph-mon[89279]: osdmap e282: 8 total, 8 up, 8 in 2024-03-30T12:26:00.728 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:00 smithi084 ceph-mon[91810]: Upgrade: Setting container_image for all mon 2024-03-30T12:26:00.728 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:00 smithi084 ceph-mon[91810]: Upgrade: Setting container_image for all crash 2024-03-30T12:26:00.728 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:00 smithi084 ceph-mon[91810]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-30T12:26:00.728 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:00 smithi084 ceph-mon[91810]: Upgrade: osd.0 is safe to restart 2024-03-30T12:26:00.728 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:00 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:26:00.728 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:00 smithi084 ceph-mon[91810]: osdmap e282: 8 total, 8 up, 8 in 2024-03-30T12:26:01.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:00 smithi162 ceph-mon[83709]: Upgrade: Setting container_image for all mon 2024-03-30T12:26:01.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:00 smithi162 ceph-mon[83709]: Upgrade: Setting container_image for all crash 2024-03-30T12:26:01.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:00 smithi162 ceph-mon[83709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-30T12:26:01.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:00 smithi162 ceph-mon[83709]: Upgrade: osd.0 is safe to restart 2024-03-30T12:26:01.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:00 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:26:01.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:00 smithi162 ceph-mon[83709]: osdmap e282: 8 total, 8 up, 8 in 2024-03-30T12:26:01.682 INFO:tasks.rados.rados.0.smithi084.stdout:1029: done (2 left) 2024-03-30T12:26:01.682 INFO:tasks.rados.rados.0.smithi084.stdout:1030: snap_remove snap 89 2024-03-30T12:26:02.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:01 smithi084 ceph-mon[91810]: pgmap v104: 121 pgs: 121 active+clean; 213 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.4 MiB/s wr, 5 op/s 2024-03-30T12:26:02.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:01 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:02.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:01 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-30T12:26:02.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:01 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:26:02.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:01 smithi084 ceph-mon[89279]: pgmap v104: 121 pgs: 121 active+clean; 213 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.4 MiB/s wr, 5 op/s 2024-03-30T12:26:02.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:01 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:02.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:01 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-30T12:26:02.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:01 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:26:02.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:01 smithi162 ceph-mon[83709]: pgmap v104: 121 pgs: 121 active+clean; 213 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.4 MiB/s wr, 5 op/s 2024-03-30T12:26:02.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:01 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:02.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:01 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-30T12:26:02.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:01 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:26:02.703 INFO:tasks.rados.rados.0.smithi084.stdout:1030: done (2 left) 2024-03-30T12:26:02.703 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 110 2024-03-30T12:26:02.703 INFO:tasks.rados.rados.0.smithi084.stdout:1031: seq_num 327 ranges {5685248=679936} 2024-03-30T12:26:02.739 INFO:tasks.rados.rados.0.smithi084.stdout:1031: writing smithi08477944-47 from 5685248 to 6365184 tid 1 2024-03-30T12:26:02.739 INFO:tasks.rados.rados.0.smithi084.stdout:1032: copy_from oid 46 from oid 44 current snap is 110 2024-03-30T12:26:02.739 INFO:tasks.rados.rados.0.smithi084.stdout:1026: finishing write tid 1 to smithi08477944-10 2024-03-30T12:26:02.739 INFO:tasks.rados.rados.0.smithi084.stdout:1026: finishing write tid 2 to smithi08477944-10 2024-03-30T12:26:02.739 INFO:tasks.rados.rados.0.smithi084.stdout:1026: finishing write tid 3 to smithi08477944-10 2024-03-30T12:26:02.739 INFO:tasks.rados.rados.0.smithi084.stdout:1026: oid 10 updating version 0 to 432 2024-03-30T12:26:02.739 INFO:tasks.rados.rados.0.smithi084.stdout:1026: oid 10 version 432 is already newer than 431 2024-03-30T12:26:02.739 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 432 (ObjNum 325 snap 110 seq_num 325) dirty exists 2024-03-30T12:26:02.739 INFO:tasks.rados.rados.0.smithi084.stdout:1026: left oid 10 (ObjNum 325 snap 110 seq_num 325) 2024-03-30T12:26:02.739 INFO:tasks.rados.rados.0.smithi084.stdout:1026: done (3 left) 2024-03-30T12:26:02.740 INFO:tasks.rados.rados.0.smithi084.stdout:1028: done (2 left) 2024-03-30T12:26:02.740 INFO:tasks.rados.rados.0.smithi084.stdout:1033: snap_create 2024-03-30T12:26:02.740 INFO:tasks.rados.rados.0.smithi084.stdout:1032: finishing copy_from to smithi08477944-46 2024-03-30T12:26:02.740 INFO:tasks.rados.rados.0.smithi084.stdout:1032: got expected ENOENT (src dne) 2024-03-30T12:26:02.740 INFO:tasks.rados.rados.0.smithi084.stdout:1032: finishing copy_from racing read to smithi08477944-46 2024-03-30T12:26:02.741 INFO:tasks.rados.rados.0.smithi084.stdout:1031: finishing write tid 1 to smithi08477944-47 2024-03-30T12:26:02.741 INFO:tasks.rados.rados.0.smithi084.stdout:1031: finishing write tid 2 to smithi08477944-47 2024-03-30T12:26:02.748 INFO:tasks.rados.rados.0.smithi084.stdout:1031: finishing write tid 3 to smithi08477944-47 2024-03-30T12:26:02.749 INFO:tasks.rados.rados.0.smithi084.stdout:1031: oid 47 updating version 0 to 716 2024-03-30T12:26:02.749 INFO:tasks.rados.rados.0.smithi084.stdout:1031: oid 47 version 716 is already newer than 715 2024-03-30T12:26:02.750 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 716 (ObjNum 327 snap 110 seq_num 327) dirty exists 2024-03-30T12:26:02.750 INFO:tasks.rados.rados.0.smithi084.stdout:1031: left oid 47 (ObjNum 327 snap 110 seq_num 327) 2024-03-30T12:26:02.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:02 smithi084 ceph-mon[91810]: Upgrade: Updating osd.0 2024-03-30T12:26:02.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:02 smithi084 ceph-mon[91810]: Deploying daemon osd.0 on smithi084 2024-03-30T12:26:02.926 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:02 smithi084 ceph-mon[91810]: osdmap e283: 8 total, 8 up, 8 in 2024-03-30T12:26:02.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:02 smithi084 ceph-mon[89279]: Upgrade: Updating osd.0 2024-03-30T12:26:02.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:02 smithi084 ceph-mon[89279]: Deploying daemon osd.0 on smithi084 2024-03-30T12:26:02.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:02 smithi084 ceph-mon[89279]: osdmap e283: 8 total, 8 up, 8 in 2024-03-30T12:26:03.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:02 smithi162 ceph-mon[83709]: Upgrade: Updating osd.0 2024-03-30T12:26:03.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:02 smithi162 ceph-mon[83709]: Deploying daemon osd.0 on smithi084 2024-03-30T12:26:03.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:02 smithi162 ceph-mon[83709]: osdmap e283: 8 total, 8 up, 8 in 2024-03-30T12:26:03.708 INFO:tasks.rados.rados.0.smithi084.stdout:1031: done (2 left) 2024-03-30T12:26:03.709 INFO:tasks.rados.rados.0.smithi084.stdout:1032: done (1 left) 2024-03-30T12:26:03.709 INFO:tasks.rados.rados.0.smithi084.stdout:1033: done (0 left) 2024-03-30T12:26:03.709 INFO:tasks.rados.rados.0.smithi084.stdout:1034: delete oid 3 current snap is 111 2024-03-30T12:26:03.711 INFO:tasks.rados.rados.0.smithi084.stdout:1034: done (0 left) 2024-03-30T12:26:03.711 INFO:tasks.rados.rados.0.smithi084.stdout:1035: read oid 6 snap -1 2024-03-30T12:26:03.711 INFO:tasks.rados.rados.0.smithi084.stdout:1035: expect (ObjNum 218 snap 64 seq_num 218) 2024-03-30T12:26:03.711 INFO:tasks.rados.rados.0.smithi084.stdout:1036: delete oid 30 current snap is 111 2024-03-30T12:26:03.713 INFO:tasks.rados.rados.0.smithi084.stdout:1036: done (1 left) 2024-03-30T12:26:03.713 INFO:tasks.rados.rados.0.smithi084.stdout:1037: snap_remove snap 101 2024-03-30T12:26:04.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:03 smithi084 ceph-mon[89279]: pgmap v107: 121 pgs: 121 active+clean; 213 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.4 MiB/s wr, 5 op/s 2024-03-30T12:26:04.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:03 smithi084 ceph-mon[89279]: osdmap e284: 8 total, 8 up, 8 in 2024-03-30T12:26:04.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:03 smithi084 ceph-mon[91810]: pgmap v107: 121 pgs: 121 active+clean; 213 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.4 MiB/s wr, 5 op/s 2024-03-30T12:26:04.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:03 smithi084 ceph-mon[91810]: osdmap e284: 8 total, 8 up, 8 in 2024-03-30T12:26:04.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:03 smithi162 ceph-mon[83709]: pgmap v107: 121 pgs: 121 active+clean; 213 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.4 MiB/s wr, 5 op/s 2024-03-30T12:26:04.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:03 smithi162 ceph-mon[83709]: osdmap e284: 8 total, 8 up, 8 in 2024-03-30T12:26:04.645 INFO:tasks.rados.rados.0.smithi084.stdout:1037: done (1 left) 2024-03-30T12:26:04.645 INFO:tasks.rados.rados.0.smithi084.stdout:1038: read oid 44 snap -1 2024-03-30T12:26:04.645 INFO:tasks.rados.rados.0.smithi084.stdout:1038: expect deleted 2024-03-30T12:26:04.645 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 111 2024-03-30T12:26:04.645 INFO:tasks.rados.rados.0.smithi084.stdout:1039: seq_num 330 ranges {0=737280} 2024-03-30T12:26:04.649 INFO:tasks.rados.rados.0.smithi084.stdout:1039: writing smithi08477944-8 from 0 to 737280 tid 1 2024-03-30T12:26:04.649 INFO:tasks.rados.rados.0.smithi084.stdout:1040: snap_remove snap 65 2024-03-30T12:26:05.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:04 smithi084 ceph-mon[91810]: osdmap e285: 8 total, 8 up, 8 in 2024-03-30T12:26:05.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:04 smithi084 ceph-mon[91810]: osdmap e286: 8 total, 8 up, 8 in 2024-03-30T12:26:05.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:04 smithi084 ceph-mon[89279]: osdmap e285: 8 total, 8 up, 8 in 2024-03-30T12:26:05.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:04 smithi084 ceph-mon[89279]: osdmap e286: 8 total, 8 up, 8 in 2024-03-30T12:26:05.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:04 smithi084 systemd[1]: Stopping Ceph osd.0 for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:26:05.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:04 smithi162 ceph-mon[83709]: osdmap e285: 8 total, 8 up, 8 in 2024-03-30T12:26:05.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:04 smithi162 ceph-mon[83709]: osdmap e286: 8 total, 8 up, 8 in 2024-03-30T12:26:05.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[41482]: 2024-03-30T12:26:05.062+0000 7f16cf7ef700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:26:05.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[41482]: 2024-03-30T12:26:05.062+0000 7f16cf7ef700 -1 osd.0 286 *** Got signal Terminated *** 2024-03-30T12:26:05.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[41482]: 2024-03-30T12:26:05.062+0000 7f16cf7ef700 -1 osd.0 286 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T12:26:05.646 INFO:tasks.rados.rados.0.smithi084.stdout:1040: done (3 left) 2024-03-30T12:26:05.646 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 111 2024-03-30T12:26:05.646 INFO:tasks.rados.rados.0.smithi084.stdout:1035: expect (ObjNum 218 snap 64 seq_num 218) 2024-03-30T12:26:05.688 INFO:tasks.rados.rados.0.smithi084.stdout:1039: finishing write tid 1 to smithi08477944-8 2024-03-30T12:26:05.688 INFO:tasks.rados.rados.0.smithi084.stdout:1039: finishing write tid 2 to smithi08477944-8 2024-03-30T12:26:05.688 INFO:tasks.rados.rados.0.smithi084.stdout:1039: finishing write tid 3 to smithi08477944-8 2024-03-30T12:26:05.688 INFO:tasks.rados.rados.0.smithi084.stdout:1039: oid 8 updating version 0 to 662 2024-03-30T12:26:05.689 INFO:tasks.rados.rados.0.smithi084.stdout:1039: oid 8 updating version 662 to 663 2024-03-30T12:26:05.689 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 663 (ObjNum 330 snap 111 seq_num 330) dirty exists 2024-03-30T12:26:05.689 INFO:tasks.rados.rados.0.smithi084.stdout:1039: left oid 8 (ObjNum 330 snap 111 seq_num 330) 2024-03-30T12:26:05.689 INFO:tasks.rados.rados.0.smithi084.stdout:1041: seq_num 331 ranges {1441792=753664} 2024-03-30T12:26:05.700 INFO:tasks.rados.rados.0.smithi084.stdout:1041: writing smithi08477944-15 from 1441792 to 2195456 tid 1 2024-03-30T12:26:05.700 INFO:tasks.rados.rados.0.smithi084.stdout:1035: done (3 left) 2024-03-30T12:26:05.701 INFO:tasks.rados.rados.0.smithi084.stdout:1038: done (2 left) 2024-03-30T12:26:05.701 INFO:tasks.rados.rados.0.smithi084.stdout:1039: done (1 left) 2024-03-30T12:26:05.701 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 111 2024-03-30T12:26:05.701 INFO:tasks.rados.rados.0.smithi084.stdout:1042: seq_num 332 ranges {0=770048} 2024-03-30T12:26:05.704 INFO:tasks.rados.rados.0.smithi084.stdout:1042: writing smithi08477944-35 from 0 to 770048 tid 1 2024-03-30T12:26:05.704 INFO:tasks.rados.rados.0.smithi084.stdout:1043: snap_remove snap 90 2024-03-30T12:26:06.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:05 smithi084 ceph-mon[91810]: pgmap v110: 121 pgs: 121 active+clean; 213 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail 2024-03-30T12:26:06.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:05 smithi084 ceph-mon[91810]: osd.0 marked itself down and dead 2024-03-30T12:26:06.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:05 smithi084 ceph-mon[91810]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T12:26:06.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:05 smithi084 ceph-mon[91810]: osdmap e287: 8 total, 7 up, 8 in 2024-03-30T12:26:06.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:05 smithi084 ceph-mon[89279]: pgmap v110: 121 pgs: 121 active+clean; 213 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail 2024-03-30T12:26:06.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:05 smithi084 ceph-mon[89279]: osd.0 marked itself down and dead 2024-03-30T12:26:06.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:05 smithi084 ceph-mon[89279]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T12:26:06.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:05 smithi084 ceph-mon[89279]: osdmap e287: 8 total, 7 up, 8 in 2024-03-30T12:26:06.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:05 smithi162 ceph-mon[83709]: pgmap v110: 121 pgs: 121 active+clean; 213 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail 2024-03-30T12:26:06.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:05 smithi162 ceph-mon[83709]: osd.0 marked itself down and dead 2024-03-30T12:26:06.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:05 smithi162 ceph-mon[83709]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T12:26:06.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:05 smithi162 ceph-mon[83709]: osdmap e287: 8 total, 7 up, 8 in 2024-03-30T12:26:06.471 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:06 smithi084 podman[96761]: 2024-03-30 12:26:06.21245758 +0000 UTC m=+1.256906261 container died 4cad4c4383a6e7d8b0585e3636f03995fed02e9290c4833e166a66af78c4cec7 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=reef-f14b568, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-03-30T12:26:06.653 INFO:tasks.rados.rados.0.smithi084.stdout:1043: done (2 left) 2024-03-30T12:26:06.653 INFO:tasks.rados.rados.0.smithi084.stdout:1044: rollback oid 24 current snap is 111 2024-03-30T12:26:06.653 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 24 to 98 2024-03-30T12:26:06.653 INFO:tasks.rados.rados.0.smithi084.stdout:1045: read oid 25 snap -1 2024-03-30T12:26:06.653 INFO:tasks.rados.rados.0.smithi084.stdout:1045: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:26:06.653 INFO:tasks.rados.rados.0.smithi084.stdout:1046: read oid 3 snap -1 2024-03-30T12:26:06.653 INFO:tasks.rados.rados.0.smithi084.stdout:1046: expect deleted 2024-03-30T12:26:06.653 INFO:tasks.rados.rados.0.smithi084.stdout:1047: snap_remove snap 109 2024-03-30T12:26:06.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:06 smithi084 podman[96761]: 2024-03-30 12:26:06.621569317 +0000 UTC m=+1.666018067 container cleanup 4cad4c4383a6e7d8b0585e3636f03995fed02e9290c4833e166a66af78c4cec7 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=reef-f14b568) 2024-03-30T12:26:06.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:06 smithi084 bash[96761]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0 2024-03-30T12:26:07.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:06 smithi084 podman[96791]: 2024-03-30 12:26:06.881749587 +0000 UTC m=+0.673517323 container remove 4cad4c4383a6e7d8b0585e3636f03995fed02e9290c4833e166a66af78c4cec7 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-f14b568, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T12:26:07.576 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:07 smithi084 podman[96882]: 2024-03-30 12:26:07.191852906 +0000 UTC m=+0.017913365 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:26:07.576 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:07 smithi084 podman[96882]: 2024-03-30 12:26:07.324297473 +0000 UTC m=+0.150357968 container create 259a25f1e765557114f4d87c307ddda279cb9b3e44af3c31b038f03e40708695 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True) 2024-03-30T12:26:07.649 INFO:tasks.rados.rados.0.smithi084.stdout:1047: done (5 left) 2024-03-30T12:26:07.650 INFO:tasks.rados.rados.0.smithi084.stdout:1048: read oid 5 snap -1 2024-03-30T12:26:07.650 INFO:tasks.rados.rados.0.smithi084.stdout:1048: expect (ObjNum 234 snap 73 seq_num 234) 2024-03-30T12:26:07.650 INFO:tasks.rados.rados.0.smithi084.stdout:1041: finishing write tid 1 to smithi08477944-15 2024-03-30T12:26:07.650 INFO:tasks.rados.rados.0.smithi084.stdout:1041: finishing write tid 2 to smithi08477944-15 2024-03-30T12:26:07.650 INFO:tasks.rados.rados.0.smithi084.stdout:1049: read oid 20 snap 98 2024-03-30T12:26:07.650 INFO:tasks.rados.rados.0.smithi084.stdout:1049: expect (ObjNum 267 snap 84 seq_num 267) 2024-03-30T12:26:07.650 INFO:tasks.rados.rados.0.smithi084.stdout:1046: done (6 left) 2024-03-30T12:26:07.650 INFO:tasks.rados.rados.0.smithi084.stdout:1050: delete oid 31 current snap is 111 2024-03-30T12:26:07.650 INFO:tasks.rados.rados.0.smithi084.stdout:1045: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:26:07.653 INFO:tasks.rados.rados.0.smithi084.stdout:1044: finishing rollback tid 0 to smithi08477944-24 2024-03-30T12:26:07.653 INFO:tasks.rados.rados.0.smithi084.stdout:1041: finishing write tid 3 to smithi08477944-15 2024-03-30T12:26:07.653 INFO:tasks.rados.rados.0.smithi084.stdout:1041: oid 15 updating version 0 to 632 2024-03-30T12:26:07.653 INFO:tasks.rados.rados.0.smithi084.stdout:1041: oid 15 updating version 632 to 633 2024-03-30T12:26:07.654 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 633 (ObjNum 331 snap 111 seq_num 331) dirty exists 2024-03-30T12:26:07.654 INFO:tasks.rados.rados.0.smithi084.stdout:1041: left oid 15 (ObjNum 331 snap 111 seq_num 331) 2024-03-30T12:26:07.654 INFO:tasks.rados.rados.0.smithi084.stdout:1044: finishing rollback tid 1 to smithi08477944-24 2024-03-30T12:26:07.654 INFO:tasks.rados.rados.0.smithi084.stdout:1042: finishing write tid 1 to smithi08477944-35 2024-03-30T12:26:07.654 INFO:tasks.rados.rados.0.smithi084.stdout:1044: finishing rollback tid 2 to smithi08477944-24 2024-03-30T12:26:07.654 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 223 (ObjNum 286 snap 92 seq_num 286) dirty exists 2024-03-30T12:26:07.654 INFO:tasks.rados.rados.0.smithi084.stdout:1042: finishing write tid 2 to smithi08477944-35 2024-03-30T12:26:07.654 INFO:tasks.rados.rados.0.smithi084.stdout:1042: finishing write tid 3 to smithi08477944-35 2024-03-30T12:26:07.654 INFO:tasks.rados.rados.0.smithi084.stdout:1042: oid 35 updating version 0 to 469 2024-03-30T12:26:07.654 INFO:tasks.rados.rados.0.smithi084.stdout:1042: oid 35 updating version 469 to 470 2024-03-30T12:26:07.654 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 470 (ObjNum 332 snap 111 seq_num 332) dirty exists 2024-03-30T12:26:07.654 INFO:tasks.rados.rados.0.smithi084.stdout:1042: left oid 35 (ObjNum 332 snap 111 seq_num 332) 2024-03-30T12:26:07.658 INFO:tasks.rados.rados.0.smithi084.stdout:1041: done (6 left) 2024-03-30T12:26:07.658 INFO:tasks.rados.rados.0.smithi084.stdout:1042: done (5 left) 2024-03-30T12:26:07.658 INFO:tasks.rados.rados.0.smithi084.stdout:1044: done (4 left) 2024-03-30T12:26:07.658 INFO:tasks.rados.rados.0.smithi084.stdout:1045: done (3 left) 2024-03-30T12:26:07.658 INFO:tasks.rados.rados.0.smithi084.stdout:1050: done (2 left) 2024-03-30T12:26:07.658 INFO:tasks.rados.rados.0.smithi084.stdout:1051: read oid 6 snap -1 2024-03-30T12:26:07.659 INFO:tasks.rados.rados.0.smithi084.stdout:1051: expect (ObjNum 218 snap 64 seq_num 218) 2024-03-30T12:26:07.659 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 111 2024-03-30T12:26:07.659 INFO:tasks.rados.rados.0.smithi084.stdout:1052: seq_num 334 ranges {7290880=802816} 2024-03-30T12:26:07.702 INFO:tasks.rados.rados.0.smithi084.stdout:1052: writing smithi08477944-11 from 7290880 to 8093696 tid 1 2024-03-30T12:26:07.703 INFO:tasks.rados.rados.0.smithi084.stdout:1053: snap_create 2024-03-30T12:26:07.703 INFO:tasks.rados.rados.0.smithi084.stdout:1048: expect (ObjNum 234 snap 73 seq_num 234) 2024-03-30T12:26:07.743 INFO:tasks.rados.rados.0.smithi084.stdout:1051: expect (ObjNum 218 snap 64 seq_num 218) 2024-03-30T12:26:07.775 INFO:tasks.rados.rados.0.smithi084.stdout:1049: expect (ObjNum 267 snap 84 seq_num 267) 2024-03-30T12:26:07.898 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:07 smithi084 ceph-mon[89279]: pgmap v113: 121 pgs: 15 stale+active+clean, 106 active+clean; 216 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 925 KiB/s rd, 658 KiB/s wr, 4 op/s 2024-03-30T12:26:07.898 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:07 smithi084 ceph-mon[89279]: osdmap e288: 8 total, 7 up, 8 in 2024-03-30T12:26:07.898 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:07 smithi084 ceph-mon[91810]: pgmap v113: 121 pgs: 15 stale+active+clean, 106 active+clean; 216 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 925 KiB/s rd, 658 KiB/s wr, 4 op/s 2024-03-30T12:26:07.898 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:07 smithi084 ceph-mon[91810]: osdmap e288: 8 total, 7 up, 8 in 2024-03-30T12:26:07.899 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:07 smithi084 podman[96882]: 2024-03-30 12:26:07.585394527 +0000 UTC m=+0.411454982 container init 259a25f1e765557114f4d87c307ddda279cb9b3e44af3c31b038f03e40708695 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-03-30T12:26:07.899 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:07 smithi084 podman[96882]: 2024-03-30 12:26:07.589006338 +0000 UTC m=+0.415066798 container start 259a25f1e765557114f4d87c307ddda279cb9b3e44af3c31b038f03e40708695 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0-deactivate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-03-30T12:26:07.899 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:07 smithi084 podman[96882]: 2024-03-30 12:26:07.684936329 +0000 UTC m=+0.510996800 container attach 259a25f1e765557114f4d87c307ddda279cb9b3e44af3c31b038f03e40708695 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True) 2024-03-30T12:26:07.932 INFO:tasks.rados.rados.0.smithi084.stdout:1052: finishing write tid 1 to smithi08477944-11 2024-03-30T12:26:07.932 INFO:tasks.rados.rados.0.smithi084.stdout:1052: finishing write tid 2 to smithi08477944-11 2024-03-30T12:26:07.933 INFO:tasks.rados.rados.0.smithi084.stdout:1052: finishing write tid 3 to smithi08477944-11 2024-03-30T12:26:07.933 INFO:tasks.rados.rados.0.smithi084.stdout:1052: oid 11 updating version 0 to 474 2024-03-30T12:26:07.933 INFO:tasks.rados.rados.0.smithi084.stdout:1052: oid 11 updating version 474 to 475 2024-03-30T12:26:07.933 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 475 (ObjNum 334 snap 111 seq_num 334) dirty exists 2024-03-30T12:26:07.933 INFO:tasks.rados.rados.0.smithi084.stdout:1052: left oid 11 (ObjNum 334 snap 111 seq_num 334) 2024-03-30T12:26:08.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:07 smithi162 ceph-mon[83709]: pgmap v113: 121 pgs: 15 stale+active+clean, 106 active+clean; 216 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 925 KiB/s rd, 658 KiB/s wr, 4 op/s 2024-03-30T12:26:08.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:07 smithi162 ceph-mon[83709]: osdmap e288: 8 total, 7 up, 8 in 2024-03-30T12:26:08.245 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:07 smithi084 podman[96882]: 2024-03-30 12:26:07.907513414 +0000 UTC m=+0.733573870 container died 259a25f1e765557114f4d87c307ddda279cb9b3e44af3c31b038f03e40708695 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0-deactivate, org.label-schema.build-date=20240326, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-03-30T12:26:08.661 INFO:tasks.rados.rados.0.smithi084.stdout:1048: done (4 left) 2024-03-30T12:26:08.661 INFO:tasks.rados.rados.0.smithi084.stdout:1049: done (3 left) 2024-03-30T12:26:08.661 INFO:tasks.rados.rados.0.smithi084.stdout:1051: done (2 left) 2024-03-30T12:26:08.661 INFO:tasks.rados.rados.0.smithi084.stdout:1052: done (1 left) 2024-03-30T12:26:08.661 INFO:tasks.rados.rados.0.smithi084.stdout:1053: done (0 left) 2024-03-30T12:26:08.662 INFO:tasks.rados.rados.0.smithi084.stdout:1054: read oid 49 snap -1 2024-03-30T12:26:08.662 INFO:tasks.rados.rados.0.smithi084.stdout:1054: expect (ObjNum 181 snap 50 seq_num 181) 2024-03-30T12:26:08.662 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 112 2024-03-30T12:26:08.662 INFO:tasks.rados.rados.0.smithi084.stdout:1055: seq_num 335 ranges {1531904=417792,1949696=401408} 2024-03-30T12:26:08.672 INFO:tasks.rados.rados.0.smithi084.stdout:1055: writing smithi08477944-45 from 1531904 to 1949696 tid 1 2024-03-30T12:26:08.675 INFO:tasks.rados.rados.0.smithi084.stdout:1055: writing smithi08477944-45 from 1949696 to 2351104 tid 2 2024-03-30T12:26:08.675 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 112 2024-03-30T12:26:08.675 INFO:tasks.rados.rados.0.smithi084.stdout:1056: seq_num 336 ranges {401408=434176,835584=401408} 2024-03-30T12:26:08.680 INFO:tasks.rados.rados.0.smithi084.stdout:1056: writing smithi08477944-18 from 401408 to 835584 tid 1 2024-03-30T12:26:08.682 INFO:tasks.rados.rados.0.smithi084.stdout:1056: writing smithi08477944-18 from 835584 to 1236992 tid 2 2024-03-30T12:26:08.682 INFO:tasks.rados.rados.0.smithi084.stdout:1057: rollback oid 27 current snap is 112 2024-03-30T12:26:08.683 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 27 to 108 2024-03-30T12:26:08.683 INFO:tasks.rados.rados.0.smithi084.stdout:1054: expect (ObjNum 181 snap 50 seq_num 181) 2024-03-30T12:26:08.804 INFO:tasks.rados.rados.0.smithi084.stdout:1055: finishing write tid 1 to smithi08477944-45 2024-03-30T12:26:08.804 INFO:tasks.rados.rados.0.smithi084.stdout:1055: finishing write tid 2 to smithi08477944-45 2024-03-30T12:26:08.804 INFO:tasks.rados.rados.0.smithi084.stdout:1055: finishing write tid 3 to smithi08477944-45 2024-03-30T12:26:08.804 INFO:tasks.rados.rados.0.smithi084.stdout:1054: done (3 left) 2024-03-30T12:26:08.804 INFO:tasks.rados.rados.0.smithi084.stdout:1058: read oid 34 snap -1 2024-03-30T12:26:08.805 INFO:tasks.rados.rados.0.smithi084.stdout:1058: expect (ObjNum 323 snap 108 seq_num 323) 2024-03-30T12:26:08.805 INFO:tasks.rados.rados.0.smithi084.stdout:1059: read oid 49 snap -1 2024-03-30T12:26:08.805 INFO:tasks.rados.rados.0.smithi084.stdout:1059: expect (ObjNum 181 snap 50 seq_num 181) 2024-03-30T12:26:08.805 INFO:tasks.rados.rados.0.smithi084.stdout:1060: read oid 32 snap 111 2024-03-30T12:26:08.805 INFO:tasks.rados.rados.0.smithi084.stdout:1060: expect (ObjNum 308 snap 100 seq_num 308) 2024-03-30T12:26:08.805 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 112 2024-03-30T12:26:08.805 INFO:tasks.rados.rados.0.smithi084.stdout:1055: finishing write tid 4 to smithi08477944-45 2024-03-30T12:26:08.805 INFO:tasks.rados.rados.0.smithi084.stdout:1055: oid 45 updating version 0 to 658 2024-03-30T12:26:08.805 INFO:tasks.rados.rados.0.smithi084.stdout:1055: oid 45 updating version 658 to 660 2024-03-30T12:26:08.805 INFO:tasks.rados.rados.0.smithi084.stdout:1055: oid 45 version 660 is already newer than 659 2024-03-30T12:26:08.805 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 660 (ObjNum 335 snap 112 seq_num 335) dirty exists 2024-03-30T12:26:08.805 INFO:tasks.rados.rados.0.smithi084.stdout:1055: left oid 45 (ObjNum 335 snap 112 seq_num 335) 2024-03-30T12:26:08.805 INFO:tasks.rados.rados.0.smithi084.stdout:1056: finishing write tid 1 to smithi08477944-18 2024-03-30T12:26:08.805 INFO:tasks.rados.rados.0.smithi084.stdout:1056: finishing write tid 2 to smithi08477944-18 2024-03-30T12:26:08.806 INFO:tasks.rados.rados.0.smithi084.stdout:1056: finishing write tid 3 to smithi08477944-18 2024-03-30T12:26:08.806 INFO:tasks.rados.rados.0.smithi084.stdout:1061: seq_num 337 ranges {0=450560,450560=401408} 2024-03-30T12:26:08.806 INFO:tasks.rados.rados.0.smithi084.stdout:1061: writing smithi08477944-25 from 0 to 450560 tid 1 2024-03-30T12:26:08.809 INFO:tasks.rados.rados.0.smithi084.stdout:1061: writing smithi08477944-25 from 450560 to 851968 tid 2 2024-03-30T12:26:08.809 INFO:tasks.rados.rados.0.smithi084.stdout:1055: done (6 left) 2024-03-30T12:26:08.809 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 112 2024-03-30T12:26:08.809 INFO:tasks.rados.rados.0.smithi084.stdout:1057: finishing rollback tid 0 to smithi08477944-27 2024-03-30T12:26:08.810 INFO:tasks.rados.rados.0.smithi084.stdout:1057: finishing rollback tid 1 to smithi08477944-27 2024-03-30T12:26:08.810 INFO:tasks.rados.rados.0.smithi084.stdout:1057: finishing rollback tid 2 to smithi08477944-27 2024-03-30T12:26:08.810 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 421 (ObjNum 304 snap 96 seq_num 304) dirty exists 2024-03-30T12:26:08.810 INFO:tasks.rados.rados.0.smithi084.stdout:1056: finishing write tid 4 to smithi08477944-18 2024-03-30T12:26:08.810 INFO:tasks.rados.rados.0.smithi084.stdout:1056: oid 18 updating version 0 to 662 2024-03-30T12:26:08.810 INFO:tasks.rados.rados.0.smithi084.stdout:1056: oid 18 updating version 662 to 663 2024-03-30T12:26:08.810 INFO:tasks.rados.rados.0.smithi084.stdout:1056: oid 18 updating version 663 to 664 2024-03-30T12:26:08.810 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 664 (ObjNum 336 snap 112 seq_num 336) dirty exists 2024-03-30T12:26:08.810 INFO:tasks.rados.rados.0.smithi084.stdout:1056: left oid 18 (ObjNum 336 snap 112 seq_num 336) 2024-03-30T12:26:08.810 INFO:tasks.rados.rados.0.smithi084.stdout:1062: seq_num 338 ranges {4120576=466944,4587520=401408} 2024-03-30T12:26:08.835 INFO:tasks.rados.rados.0.smithi084.stdout:1062: writing smithi08477944-38 from 4120576 to 4587520 tid 1 2024-03-30T12:26:08.838 INFO:tasks.rados.rados.0.smithi084.stdout:1062: writing smithi08477944-38 from 4587520 to 4988928 tid 2 2024-03-30T12:26:08.838 INFO:tasks.rados.rados.0.smithi084.stdout:1056: done (6 left) 2024-03-30T12:26:08.838 INFO:tasks.rados.rados.0.smithi084.stdout:1057: done (5 left) 2024-03-30T12:26:08.838 INFO:tasks.rados.rados.0.smithi084.stdout:1063: read oid 46 snap -1 2024-03-30T12:26:08.838 INFO:tasks.rados.rados.0.smithi084.stdout:1063: expect (ObjNum 300 snap 95 seq_num 300) 2024-03-30T12:26:08.838 INFO:tasks.rados.rados.0.smithi084.stdout:1064: rmattr oid 50 current snap is 112 2024-03-30T12:26:08.838 INFO:tasks.rados.rados.0.smithi084.stdout:1059: expect (ObjNum 181 snap 50 seq_num 181) 2024-03-30T12:26:08.963 INFO:tasks.rados.rados.0.smithi084.stdout:1060: expect (ObjNum 308 snap 100 seq_num 308) 2024-03-30T12:26:08.977 INFO:tasks.rados.rados.0.smithi084.stdout:1058: expect (ObjNum 323 snap 108 seq_num 323) 2024-03-30T12:26:09.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:08 smithi084 ceph-mon[89279]: osdmap e289: 8 total, 7 up, 8 in 2024-03-30T12:26:09.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:08 smithi084 ceph-mon[91810]: osdmap e289: 8 total, 7 up, 8 in 2024-03-30T12:26:09.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:08 smithi084 podman[96908]: 2024-03-30 12:26:08.630491666 +0000 UTC m=+0.715923551 container remove 259a25f1e765557114f4d87c307ddda279cb9b3e44af3c31b038f03e40708695 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-03-30T12:26:09.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:08 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.0.service: Deactivated successfully. 2024-03-30T12:26:09.005 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:08 smithi084 systemd[1]: Stopped Ceph osd.0 for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:26:09.005 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:08 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.0.service: Consumed 11.744s CPU time. 2024-03-30T12:26:09.005 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:08 smithi084 systemd[1]: Starting Ceph osd.0 for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:26:09.106 INFO:tasks.rados.rados.0.smithi084.stdout:1061: finishing write tid 1 to smithi08477944-25 2024-03-30T12:26:09.106 INFO:tasks.rados.rados.0.smithi084.stdout:1061: finishing write tid 2 to smithi08477944-25 2024-03-30T12:26:09.106 INFO:tasks.rados.rados.0.smithi084.stdout:1061: finishing write tid 3 to smithi08477944-25 2024-03-30T12:26:09.106 INFO:tasks.rados.rados.0.smithi084.stdout:1061: finishing write tid 4 to smithi08477944-25 2024-03-30T12:26:09.106 INFO:tasks.rados.rados.0.smithi084.stdout:1061: oid 25 updating version 0 to 478 2024-03-30T12:26:09.106 INFO:tasks.rados.rados.0.smithi084.stdout:1061: oid 25 version 478 is already newer than 476 2024-03-30T12:26:09.106 INFO:tasks.rados.rados.0.smithi084.stdout:1061: oid 25 version 478 is already newer than 477 2024-03-30T12:26:09.106 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 478 (ObjNum 337 snap 112 seq_num 337) dirty exists 2024-03-30T12:26:09.106 INFO:tasks.rados.rados.0.smithi084.stdout:1061: left oid 25 (ObjNum 337 snap 112 seq_num 337) 2024-03-30T12:26:09.107 INFO:tasks.rados.rados.0.smithi084.stdout:1058: done (6 left) 2024-03-30T12:26:09.107 INFO:tasks.rados.rados.0.smithi084.stdout:1059: done (5 left) 2024-03-30T12:26:09.107 INFO:tasks.rados.rados.0.smithi084.stdout:1060: done (4 left) 2024-03-30T12:26:09.107 INFO:tasks.rados.rados.0.smithi084.stdout:1061: done (3 left) 2024-03-30T12:26:09.107 INFO:tasks.rados.rados.0.smithi084.stdout:1065: delete oid 19 current snap is 112 2024-03-30T12:26:09.107 INFO:tasks.rados.rados.0.smithi084.stdout:1062: finishing write tid 1 to smithi08477944-38 2024-03-30T12:26:09.107 INFO:tasks.rados.rados.0.smithi084.stdout:1062: finishing write tid 2 to smithi08477944-38 2024-03-30T12:26:09.107 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 666 (ObjNum 267 snap 84 seq_num 267) dirty exists 2024-03-30T12:26:09.107 INFO:tasks.rados.rados.0.smithi084.stdout:1062: finishing write tid 3 to smithi08477944-38 2024-03-30T12:26:09.107 INFO:tasks.rados.rados.0.smithi084.stdout:1062: finishing write tid 4 to smithi08477944-38 2024-03-30T12:26:09.107 INFO:tasks.rados.rados.0.smithi084.stdout:1062: oid 38 updating version 0 to 468 2024-03-30T12:26:09.107 INFO:tasks.rados.rados.0.smithi084.stdout:1062: oid 38 updating version 468 to 469 2024-03-30T12:26:09.107 INFO:tasks.rados.rados.0.smithi084.stdout:1062: oid 38 updating version 469 to 470 2024-03-30T12:26:09.107 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 470 (ObjNum 338 snap 112 seq_num 338) dirty exists 2024-03-30T12:26:09.108 INFO:tasks.rados.rados.0.smithi084.stdout:1062: left oid 38 (ObjNum 338 snap 112 seq_num 338) 2024-03-30T12:26:09.108 INFO:tasks.rados.rados.0.smithi084.stdout:1063: expect (ObjNum 300 snap 95 seq_num 300) 2024-03-30T12:26:09.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:08 smithi162 ceph-mon[83709]: osdmap e289: 8 total, 7 up, 8 in 2024-03-30T12:26:09.349 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:26:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:26:09] "GET /metrics HTTP/1.1" 200 35929 "" "Prometheus/2.43.0" 2024-03-30T12:26:09.349 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:09 smithi084 podman[97012]: 2024-03-30 12:26:09.00299739 +0000 UTC m=+0.025423815 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:26:09.349 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:09 smithi084 podman[97012]: 2024-03-30 12:26:09.131395889 +0000 UTC m=+0.153822291 container create 82580c7b05d3a85efa05df4959947fa415401abffa616522034e2dbb49bac022 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0-activate, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_CLEAN=True, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2) 2024-03-30T12:26:09.474 INFO:tasks.rados.rados.0.smithi084.stdout:1062: done (3 left) 2024-03-30T12:26:09.474 INFO:tasks.rados.rados.0.smithi084.stdout:1063: done (2 left) 2024-03-30T12:26:09.474 INFO:tasks.rados.rados.0.smithi084.stdout:1064: done (1 left) 2024-03-30T12:26:09.474 INFO:tasks.rados.rados.0.smithi084.stdout:1065: done (0 left) 2024-03-30T12:26:09.474 INFO:tasks.rados.rados.0.smithi084.stdout:1066: snap_create 2024-03-30T12:26:09.646 INFO:tasks.rados.rados.0.smithi084.stdout:1066: done (0 left) 2024-03-30T12:26:09.646 INFO:tasks.rados.rados.0.smithi084.stdout:1067: read oid 10 snap -1 2024-03-30T12:26:09.646 INFO:tasks.rados.rados.0.smithi084.stdout:1067: expect (ObjNum 325 snap 110 seq_num 325) 2024-03-30T12:26:09.646 INFO:tasks.rados.rados.0.smithi084.stdout:1068: delete oid 19 current snap is 113 2024-03-30T12:26:09.651 INFO:tasks.rados.rados.0.smithi084.stdout:1068: done (1 left) 2024-03-30T12:26:09.651 INFO:tasks.rados.rados.0.smithi084.stdout:1069: delete oid 5 current snap is 113 2024-03-30T12:26:09.657 INFO:tasks.rados.rados.0.smithi084.stdout:1069: done (1 left) 2024-03-30T12:26:09.657 INFO:tasks.rados.rados.0.smithi084.stdout:1070: read oid 9 snap -1 2024-03-30T12:26:09.657 INFO:tasks.rados.rados.0.smithi084.stdout:1070: expect deleted 2024-03-30T12:26:09.657 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 113 2024-03-30T12:26:09.657 INFO:tasks.rados.rados.0.smithi084.stdout:1071: seq_num 342 ranges {4120576=532480,4653056=401408} 2024-03-30T12:26:09.658 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:09 smithi084 podman[97012]: 2024-03-30 12:26:09.358697991 +0000 UTC m=+0.381124396 container init 82580c7b05d3a85efa05df4959947fa415401abffa616522034e2dbb49bac022 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0-activate, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T12:26:09.658 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:09 smithi084 podman[97012]: 2024-03-30 12:26:09.361961247 +0000 UTC m=+0.384387658 container start 82580c7b05d3a85efa05df4959947fa415401abffa616522034e2dbb49bac022 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0-activate, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T12:26:09.658 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:09 smithi084 podman[97012]: 2024-03-30 12:26:09.467099492 +0000 UTC m=+0.489525905 container attach 82580c7b05d3a85efa05df4959947fa415401abffa616522034e2dbb49bac022 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0-activate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T12:26:09.682 INFO:tasks.rados.rados.0.smithi084.stdout:1071: writing smithi08477944-50 from 4120576 to 4653056 tid 1 2024-03-30T12:26:09.684 INFO:tasks.rados.rados.0.smithi084.stdout:1071: writing smithi08477944-50 from 4653056 to 5054464 tid 2 2024-03-30T12:26:09.685 INFO:tasks.rados.rados.0.smithi084.stdout:1072: rmattr oid 45 current snap is 113 2024-03-30T12:26:09.685 INFO:tasks.rados.rados.0.smithi084.stdout:1072: done (3 left) 2024-03-30T12:26:09.685 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 113 2024-03-30T12:26:09.685 INFO:tasks.rados.rados.0.smithi084.stdout:1073: seq_num 343 ranges {3473408=548864,4022272=401408} 2024-03-30T12:26:09.706 INFO:tasks.rados.rados.0.smithi084.stdout:1073: writing smithi08477944-23 from 3473408 to 4022272 tid 1 2024-03-30T12:26:09.709 INFO:tasks.rados.rados.0.smithi084.stdout:1073: writing smithi08477944-23 from 4022272 to 4423680 tid 2 2024-03-30T12:26:09.709 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 113 2024-03-30T12:26:09.709 INFO:tasks.rados.rados.0.smithi084.stdout:1074: seq_num 344 ranges {0=565248,565248=401408} 2024-03-30T12:26:09.712 INFO:tasks.rados.rados.0.smithi084.stdout:1074: writing smithi08477944-5 from 0 to 565248 tid 1 2024-03-30T12:26:09.714 INFO:tasks.rados.rados.0.smithi084.stdout:1074: writing smithi08477944-5 from 565248 to 966656 tid 2 2024-03-30T12:26:09.714 INFO:tasks.rados.rados.0.smithi084.stdout:1075: snap_remove snap 112 2024-03-30T12:26:10.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:09 smithi084 ceph-mon[89279]: pgmap v116: 121 pgs: 15 stale+active+clean, 106 active+clean; 216 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 925 KiB/s rd, 658 KiB/s wr, 4 op/s 2024-03-30T12:26:10.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:09 smithi084 ceph-mon[89279]: osdmap e290: 8 total, 7 up, 8 in 2024-03-30T12:26:10.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:09 smithi084 ceph-mon[89279]: osdmap e291: 8 total, 7 up, 8 in 2024-03-30T12:26:10.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:09 smithi084 ceph-mon[91810]: pgmap v116: 121 pgs: 15 stale+active+clean, 106 active+clean; 216 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 925 KiB/s rd, 658 KiB/s wr, 4 op/s 2024-03-30T12:26:10.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:09 smithi084 ceph-mon[91810]: osdmap e290: 8 total, 7 up, 8 in 2024-03-30T12:26:10.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:09 smithi084 ceph-mon[91810]: osdmap e291: 8 total, 7 up, 8 in 2024-03-30T12:26:10.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0-activate[97027]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-30T12:26:10.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0-activate[97027]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-03-30T12:26:10.005 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:09 smithi084 bash[97012]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-30T12:26:10.005 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:09 smithi084 bash[97012]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-03-30T12:26:10.005 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:09 smithi084 bash[97012]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-03-30T12:26:10.005 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:09 smithi084 bash[97012]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-03-30T12:26:10.005 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:09 smithi084 bash[97012]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-03-30T12:26:10.005 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:09 smithi084 bash[97012]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-30T12:26:10.005 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:09 smithi084 bash[97012]: --> ceph-volume raw activate successful for osd ID: 0 2024-03-30T12:26:10.005 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0-activate[97027]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-03-30T12:26:10.005 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0-activate[97027]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-03-30T12:26:10.005 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0-activate[97027]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-03-30T12:26:10.005 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0-activate[97027]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-30T12:26:10.005 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0-activate[97027]: --> ceph-volume raw activate successful for osd ID: 0 2024-03-30T12:26:10.005 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:09 smithi084 podman[97012]: 2024-03-30 12:26:09.838047881 +0000 UTC m=+0.860474297 container died 82580c7b05d3a85efa05df4959947fa415401abffa616522034e2dbb49bac022 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0-activate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:26:10.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:09 smithi162 ceph-mon[83709]: pgmap v116: 121 pgs: 15 stale+active+clean, 106 active+clean; 216 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 925 KiB/s rd, 658 KiB/s wr, 4 op/s 2024-03-30T12:26:10.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:09 smithi162 ceph-mon[83709]: osdmap e290: 8 total, 7 up, 8 in 2024-03-30T12:26:10.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:09 smithi162 ceph-mon[83709]: osdmap e291: 8 total, 7 up, 8 in 2024-03-30T12:26:10.670 INFO:tasks.rados.rados.0.smithi084.stdout:1075: done (5 left) 2024-03-30T12:26:10.670 INFO:tasks.rados.rados.0.smithi084.stdout:1076: snap_remove snap 106 2024-03-30T12:26:10.714 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:10 smithi084 podman[97144]: 2024-03-30 12:26:10.470310145 +0000 UTC m=+0.626992491 container remove 82580c7b05d3a85efa05df4959947fa415401abffa616522034e2dbb49bac022 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0-activate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-03-30T12:26:10.714 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:10 smithi084 podman[97205]: 2024-03-30 12:26:10.582841397 +0000 UTC m=+0.017709671 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:26:10.714 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:10 smithi084 podman[97205]: 2024-03-30 12:26:10.704641727 +0000 UTC m=+0.139510028 container create c91eea4f8484a882462e101dfbee98de22970be73fb19f046a4b0074b175a355 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3) 2024-03-30T12:26:10.965 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:10 smithi084 ceph-mon[89279]: Health check failed: Degraded data redundancy: 107/528 objects degraded (20.265%), 15 pgs degraded (PG_DEGRADED) 2024-03-30T12:26:10.965 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:10 smithi084 ceph-mon[89279]: osdmap e292: 8 total, 7 up, 8 in 2024-03-30T12:26:10.965 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:10 smithi084 ceph-mon[91810]: Health check failed: Degraded data redundancy: 107/528 objects degraded (20.265%), 15 pgs degraded (PG_DEGRADED) 2024-03-30T12:26:10.965 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:10 smithi084 ceph-mon[91810]: osdmap e292: 8 total, 7 up, 8 in 2024-03-30T12:26:11.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:10 smithi162 ceph-mon[83709]: Health check failed: Degraded data redundancy: 107/528 objects degraded (20.265%), 15 pgs degraded (PG_DEGRADED) 2024-03-30T12:26:11.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:10 smithi162 ceph-mon[83709]: osdmap e292: 8 total, 7 up, 8 in 2024-03-30T12:26:11.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:10 smithi084 podman[97205]: 2024-03-30 12:26:10.97433167 +0000 UTC m=+0.409199941 container init c91eea4f8484a882462e101dfbee98de22970be73fb19f046a4b0074b175a355 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T12:26:11.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:10 smithi084 podman[97205]: 2024-03-30 12:26:10.977559847 +0000 UTC m=+0.412428106 container start c91eea4f8484a882462e101dfbee98de22970be73fb19f046a4b0074b175a355 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-03-30T12:26:11.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:10 smithi084 ceph-osd[97224]: -- 172.21.15.84:0/4059144324 <== mon.2 v2:172.21.15.84:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5606f6a73680 con 0x5606f6a3cc00 2024-03-30T12:26:11.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:11 smithi084 bash[97205]: c91eea4f8484a882462e101dfbee98de22970be73fb19f046a4b0074b175a355 2024-03-30T12:26:11.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:11 smithi084 systemd[1]: Started Ceph osd.0 for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:26:11.672 INFO:tasks.rados.rados.0.smithi084.stdout:1076: done (5 left) 2024-03-30T12:26:11.672 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 113 2024-03-30T12:26:11.672 INFO:tasks.rados.rados.0.smithi084.stdout:1067: expect (ObjNum 325 snap 110 seq_num 325) 2024-03-30T12:26:11.720 INFO:tasks.rados.rados.0.smithi084.stdout:1071: finishing write tid 1 to smithi08477944-50 2024-03-30T12:26:11.720 INFO:tasks.rados.rados.0.smithi084.stdout:1071: finishing write tid 2 to smithi08477944-50 2024-03-30T12:26:11.720 INFO:tasks.rados.rados.0.smithi084.stdout:1071: finishing write tid 3 to smithi08477944-50 2024-03-30T12:26:11.720 INFO:tasks.rados.rados.0.smithi084.stdout:1071: finishing write tid 4 to smithi08477944-50 2024-03-30T12:26:11.720 INFO:tasks.rados.rados.0.smithi084.stdout:1071: oid 50 updating version 0 to 668 2024-03-30T12:26:11.720 INFO:tasks.rados.rados.0.smithi084.stdout:1071: oid 50 updating version 668 to 669 2024-03-30T12:26:11.720 INFO:tasks.rados.rados.0.smithi084.stdout:1071: oid 50 updating version 669 to 670 2024-03-30T12:26:11.720 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 670 (ObjNum 342 snap 113 seq_num 342) dirty exists 2024-03-30T12:26:11.720 INFO:tasks.rados.rados.0.smithi084.stdout:1071: left oid 50 (ObjNum 342 snap 113 seq_num 342) 2024-03-30T12:26:11.720 INFO:tasks.rados.rados.0.smithi084.stdout:1073: finishing write tid 1 to smithi08477944-23 2024-03-30T12:26:11.720 INFO:tasks.rados.rados.0.smithi084.stdout:1073: finishing write tid 2 to smithi08477944-23 2024-03-30T12:26:11.720 INFO:tasks.rados.rados.0.smithi084.stdout:1073: finishing write tid 3 to smithi08477944-23 2024-03-30T12:26:11.720 INFO:tasks.rados.rados.0.smithi084.stdout:1073: finishing write tid 4 to smithi08477944-23 2024-03-30T12:26:11.721 INFO:tasks.rados.rados.0.smithi084.stdout:1073: oid 23 updating version 0 to 472 2024-03-30T12:26:11.721 INFO:tasks.rados.rados.0.smithi084.stdout:1073: oid 23 version 472 is already newer than 471 2024-03-30T12:26:11.721 INFO:tasks.rados.rados.0.smithi084.stdout:1073: oid 23 updating version 472 to 473 2024-03-30T12:26:11.721 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 473 (ObjNum 343 snap 113 seq_num 343) dirty exists 2024-03-30T12:26:11.721 INFO:tasks.rados.rados.0.smithi084.stdout:1073: left oid 23 (ObjNum 343 snap 113 seq_num 343) 2024-03-30T12:26:11.721 INFO:tasks.rados.rados.0.smithi084.stdout:1074: finishing write tid 1 to smithi08477944-5 2024-03-30T12:26:11.721 INFO:tasks.rados.rados.0.smithi084.stdout:1077: seq_num 345 ranges {1236992=581632,1818624=401408} 2024-03-30T12:26:11.730 INFO:tasks.rados.rados.0.smithi084.stdout:1077: writing smithi08477944-18 from 1236992 to 1818624 tid 1 2024-03-30T12:26:11.733 INFO:tasks.rados.rados.0.smithi084.stdout:1077: writing smithi08477944-18 from 1818624 to 2220032 tid 2 2024-03-30T12:26:11.734 INFO:tasks.rados.rados.0.smithi084.stdout:1067: done (5 left) 2024-03-30T12:26:11.734 INFO:tasks.rados.rados.0.smithi084.stdout:1070: done (4 left) 2024-03-30T12:26:11.734 INFO:tasks.rados.rados.0.smithi084.stdout:1071: done (3 left) 2024-03-30T12:26:11.734 INFO:tasks.rados.rados.0.smithi084.stdout:1073: done (2 left) 2024-03-30T12:26:11.734 INFO:tasks.rados.rados.0.smithi084.stdout:1078: read oid 29 snap 107 2024-03-30T12:26:11.734 INFO:tasks.rados.rados.0.smithi084.stdout:1078: expect (ObjNum 142 snap 36 seq_num 142) 2024-03-30T12:26:11.734 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 113 2024-03-30T12:26:11.734 INFO:tasks.rados.rados.0.smithi084.stdout:1074: finishing write tid 2 to smithi08477944-5 2024-03-30T12:26:11.734 INFO:tasks.rados.rados.0.smithi084.stdout:1074: finishing write tid 3 to smithi08477944-5 2024-03-30T12:26:11.734 INFO:tasks.rados.rados.0.smithi084.stdout:1074: finishing write tid 4 to smithi08477944-5 2024-03-30T12:26:11.734 INFO:tasks.rados.rados.0.smithi084.stdout:1074: oid 5 updating version 0 to 480 2024-03-30T12:26:11.735 INFO:tasks.rados.rados.0.smithi084.stdout:1074: oid 5 updating version 480 to 482 2024-03-30T12:26:11.735 INFO:tasks.rados.rados.0.smithi084.stdout:1074: oid 5 version 482 is already newer than 481 2024-03-30T12:26:11.735 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 482 (ObjNum 344 snap 113 seq_num 344) dirty exists 2024-03-30T12:26:11.735 INFO:tasks.rados.rados.0.smithi084.stdout:1074: left oid 5 (ObjNum 344 snap 113 seq_num 344) 2024-03-30T12:26:11.735 INFO:tasks.rados.rados.0.smithi084.stdout:1079: seq_num 346 ranges {6365184=598016,6963200=401408} 2024-03-30T12:26:11.771 INFO:tasks.rados.rados.0.smithi084.stdout:1079: writing smithi08477944-47 from 6365184 to 6963200 tid 1 2024-03-30T12:26:11.774 INFO:tasks.rados.rados.0.smithi084.stdout:1079: writing smithi08477944-47 from 6963200 to 7364608 tid 2 2024-03-30T12:26:11.774 INFO:tasks.rados.rados.0.smithi084.stdout:1074: done (3 left) 2024-03-30T12:26:11.774 INFO:tasks.rados.rados.0.smithi084.stdout:1080: delete oid 5 current snap is 113 2024-03-30T12:26:11.775 INFO:tasks.rados.rados.0.smithi084.stdout:1077: finishing write tid 1 to smithi08477944-18 2024-03-30T12:26:11.775 INFO:tasks.rados.rados.0.smithi084.stdout:1077: finishing write tid 2 to smithi08477944-18 2024-03-30T12:26:11.775 INFO:tasks.rados.rados.0.smithi084.stdout:1077: finishing write tid 3 to smithi08477944-18 2024-03-30T12:26:11.775 INFO:tasks.rados.rados.0.smithi084.stdout:1077: finishing write tid 4 to smithi08477944-18 2024-03-30T12:26:11.775 INFO:tasks.rados.rados.0.smithi084.stdout:1077: oid 18 updating version 0 to 682 2024-03-30T12:26:11.775 INFO:tasks.rados.rados.0.smithi084.stdout:1077: oid 18 version 682 is already newer than 681 2024-03-30T12:26:11.775 INFO:tasks.rados.rados.0.smithi084.stdout:1077: oid 18 updating version 682 to 683 2024-03-30T12:26:11.775 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 683 (ObjNum 345 snap 113 seq_num 345) dirty exists 2024-03-30T12:26:11.775 INFO:tasks.rados.rados.0.smithi084.stdout:1077: left oid 18 (ObjNum 345 snap 113 seq_num 345) 2024-03-30T12:26:11.776 INFO:tasks.rados.rados.0.smithi084.stdout:1078: expect (ObjNum 142 snap 36 seq_num 142) 2024-03-30T12:26:11.901 INFO:tasks.rados.rados.0.smithi084.stdout:1079: finishing write tid 1 to smithi08477944-47 2024-03-30T12:26:11.901 INFO:tasks.rados.rados.0.smithi084.stdout:1079: finishing write tid 2 to smithi08477944-47 2024-03-30T12:26:11.901 INFO:tasks.rados.rados.0.smithi084.stdout:1079: finishing write tid 3 to smithi08477944-47 2024-03-30T12:26:11.901 INFO:tasks.rados.rados.0.smithi084.stdout:1079: finishing write tid 4 to smithi08477944-47 2024-03-30T12:26:11.901 INFO:tasks.rados.rados.0.smithi084.stdout:1079: oid 47 updating version 0 to 723 2024-03-30T12:26:11.901 INFO:tasks.rados.rados.0.smithi084.stdout:1079: oid 47 version 723 is already newer than 722 2024-03-30T12:26:11.901 INFO:tasks.rados.rados.0.smithi084.stdout:1079: oid 47 updating version 723 to 724 2024-03-30T12:26:11.901 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 724 (ObjNum 346 snap 113 seq_num 346) dirty exists 2024-03-30T12:26:11.901 INFO:tasks.rados.rados.0.smithi084.stdout:1079: left oid 47 (ObjNum 346 snap 113 seq_num 346) 2024-03-30T12:26:11.901 INFO:tasks.rados.rados.0.smithi084.stdout:1077: done (3 left) 2024-03-30T12:26:11.901 INFO:tasks.rados.rados.0.smithi084.stdout:1078: done (2 left) 2024-03-30T12:26:11.902 INFO:tasks.rados.rados.0.smithi084.stdout:1079: done (1 left) 2024-03-30T12:26:11.902 INFO:tasks.rados.rados.0.smithi084.stdout:1080: done (0 left) 2024-03-30T12:26:11.902 INFO:tasks.rados.rados.0.smithi084.stdout:1081: read oid 41 snap 88 2024-03-30T12:26:11.902 INFO:tasks.rados.rados.0.smithi084.stdout:1081: expect (ObjNum 271 snap 84 seq_num 271) 2024-03-30T12:26:11.902 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 113 2024-03-30T12:26:11.902 INFO:tasks.rados.rados.0.smithi084.stdout:1082: seq_num 348 ranges {1105920=630784,1736704=401408} 2024-03-30T12:26:11.910 INFO:tasks.rados.rados.0.smithi084.stdout:1082: writing smithi08477944-36 from 1105920 to 1736704 tid 1 2024-03-30T12:26:11.912 INFO:tasks.rados.rados.0.smithi084.stdout:1082: writing smithi08477944-36 from 1736704 to 2138112 tid 2 2024-03-30T12:26:11.912 INFO:tasks.rados.rados.0.smithi084.stdout:1083: rollback oid 4 current snap is 113 2024-03-30T12:26:11.912 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 4 to 88 2024-03-30T12:26:11.912 INFO:tasks.rados.rados.0.smithi084.stdout:1084: rmattr oid 46 current snap is 113 2024-03-30T12:26:11.913 INFO:tasks.rados.rados.0.smithi084.stdout:1084: done (3 left) 2024-03-30T12:26:11.913 INFO:tasks.rados.rados.0.smithi084.stdout:1085: setattr oid 10 current snap is 113 2024-03-30T12:26:11.915 INFO:tasks.rados.rados.0.smithi084.stdout:1086: snap_remove snap 94 2024-03-30T12:26:11.924 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:11.517+0000 7f5da9b707c0 -1 Falling back to public interface 2024-03-30T12:26:11.924 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:11 smithi084 ceph-mon[91810]: pgmap v119: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 215 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 2.0 MiB/s wr, 24 op/s; 107/528 objects degraded (20.265%) 2024-03-30T12:26:11.924 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:11 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:11.924 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:11 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:11.924 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:11 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:26:11.925 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:11 smithi084 ceph-mon[91810]: osdmap e293: 8 total, 7 up, 8 in 2024-03-30T12:26:11.925 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:11 smithi084 ceph-mon[89279]: pgmap v119: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 215 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 2.0 MiB/s wr, 24 op/s; 107/528 objects degraded (20.265%) 2024-03-30T12:26:11.925 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:11 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:11.925 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:11 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:11.925 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:11 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:26:11.925 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:11 smithi084 ceph-mon[89279]: osdmap e293: 8 total, 7 up, 8 in 2024-03-30T12:26:12.021 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:11 smithi162 ceph-mon[83709]: pgmap v119: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 215 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 2.0 MiB/s wr, 24 op/s; 107/528 objects degraded (20.265%) 2024-03-30T12:26:12.021 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:11 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:12.021 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:11 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:12.021 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:11 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:26:12.021 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:11 smithi162 ceph-mon[83709]: osdmap e293: 8 total, 7 up, 8 in 2024-03-30T12:26:12.723 INFO:tasks.rados.rados.0.smithi084.stdout:1086: done (4 left) 2024-03-30T12:26:12.723 INFO:tasks.rados.rados.0.smithi084.stdout:1087: rmattr oid 11 current snap is 113 2024-03-30T12:26:12.724 INFO:tasks.rados.rados.0.smithi084.stdout:1081: expect (ObjNum 271 snap 84 seq_num 271) 2024-03-30T12:26:12.894 INFO:tasks.rados.rados.0.smithi084.stdout:1082: finishing write tid 1 to smithi08477944-36 2024-03-30T12:26:12.895 INFO:tasks.rados.rados.0.smithi084.stdout:1082: finishing write tid 2 to smithi08477944-36 2024-03-30T12:26:12.895 INFO:tasks.rados.rados.0.smithi084.stdout:1082: finishing write tid 3 to smithi08477944-36 2024-03-30T12:26:12.895 INFO:tasks.rados.rados.0.smithi084.stdout:1081: done (4 left) 2024-03-30T12:26:12.895 INFO:tasks.rados.rados.0.smithi084.stdout:1088: snap_remove snap 105 2024-03-30T12:26:13.732 INFO:tasks.rados.rados.0.smithi084.stdout:1088: done (4 left) 2024-03-30T12:26:13.732 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 113 2024-03-30T12:26:13.732 INFO:tasks.rados.rados.0.smithi084.stdout:1089: seq_num 349 ranges {737280=655360,1392640=401408} 2024-03-30T12:26:13.739 INFO:tasks.rados.rados.0.smithi084.stdout:1089: writing smithi08477944-8 from 737280 to 1392640 tid 1 2024-03-30T12:26:13.742 INFO:tasks.rados.rados.0.smithi084.stdout:1089: writing smithi08477944-8 from 1392640 to 1794048 tid 2 2024-03-30T12:26:13.742 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 113 2024-03-30T12:26:13.742 INFO:tasks.rados.rados.0.smithi084.stdout:1083: finishing rollback tid 0 to smithi08477944-4 2024-03-30T12:26:13.742 INFO:tasks.rados.rados.0.smithi084.stdout:1083: finishing rollback tid 1 to smithi08477944-4 2024-03-30T12:26:13.743 INFO:tasks.rados.rados.0.smithi084.stdout:1083: finishing rollback tid 2 to smithi08477944-4 2024-03-30T12:26:13.743 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 473 (ObjNum 191 snap 50 seq_num 191) dirty exists 2024-03-30T12:26:13.743 INFO:tasks.rados.rados.0.smithi084.stdout:1082: finishing write tid 4 to smithi08477944-36 2024-03-30T12:26:13.743 INFO:tasks.rados.rados.0.smithi084.stdout:1082: oid 36 updating version 0 to 477 2024-03-30T12:26:13.743 INFO:tasks.rados.rados.0.smithi084.stdout:1082: oid 36 version 477 is already newer than 475 2024-03-30T12:26:13.743 INFO:tasks.rados.rados.0.smithi084.stdout:1082: oid 36 version 477 is already newer than 476 2024-03-30T12:26:13.743 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 477 (ObjNum 348 snap 113 seq_num 348) dirty exists 2024-03-30T12:26:13.743 INFO:tasks.rados.rados.0.smithi084.stdout:1082: left oid 36 (ObjNum 348 snap 113 seq_num 348) 2024-03-30T12:26:13.743 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 442 (ObjNum 325 snap 110 seq_num 325) dirty exists 2024-03-30T12:26:13.743 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 484 (ObjNum 334 snap 111 seq_num 334) dirty exists 2024-03-30T12:26:13.743 INFO:tasks.rados.rados.0.smithi084.stdout:1090: seq_num 350 ranges {770048=671744,1441792=401408} 2024-03-30T12:26:13.750 INFO:tasks.rados.rados.0.smithi084.stdout:1090: writing smithi08477944-35 from 770048 to 1441792 tid 1 2024-03-30T12:26:13.753 INFO:tasks.rados.rados.0.smithi084.stdout:1090: writing smithi08477944-35 from 1441792 to 1843200 tid 2 2024-03-30T12:26:13.753 INFO:tasks.rados.rados.0.smithi084.stdout:1082: done (5 left) 2024-03-30T12:26:13.753 INFO:tasks.rados.rados.0.smithi084.stdout:1083: done (4 left) 2024-03-30T12:26:13.753 INFO:tasks.rados.rados.0.smithi084.stdout:1085: done (3 left) 2024-03-30T12:26:13.753 INFO:tasks.rados.rados.0.smithi084.stdout:1087: done (2 left) 2024-03-30T12:26:13.753 INFO:tasks.rados.rados.0.smithi084.stdout:1091: rollback oid 12 current snap is 113 2024-03-30T12:26:13.753 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 12 to 110 2024-03-30T12:26:13.754 INFO:tasks.rados.rados.0.smithi084.stdout:1089: finishing write tid 1 to smithi08477944-8 2024-03-30T12:26:13.754 INFO:tasks.rados.rados.0.smithi084.stdout:1089: finishing write tid 2 to smithi08477944-8 2024-03-30T12:26:13.754 INFO:tasks.rados.rados.0.smithi084.stdout:1089: finishing write tid 3 to smithi08477944-8 2024-03-30T12:26:13.754 INFO:tasks.rados.rados.0.smithi084.stdout:1089: finishing write tid 4 to smithi08477944-8 2024-03-30T12:26:13.754 INFO:tasks.rados.rados.0.smithi084.stdout:1089: oid 8 updating version 0 to 666 2024-03-30T12:26:13.754 INFO:tasks.rados.rados.0.smithi084.stdout:1089: oid 8 version 666 is already newer than 665 2024-03-30T12:26:13.754 INFO:tasks.rados.rados.0.smithi084.stdout:1089: oid 8 version 666 is already newer than 664 2024-03-30T12:26:13.754 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 666 (ObjNum 349 snap 113 seq_num 349) dirty exists 2024-03-30T12:26:13.754 INFO:tasks.rados.rados.0.smithi084.stdout:1089: left oid 8 (ObjNum 349 snap 113 seq_num 349) 2024-03-30T12:26:13.754 INFO:tasks.rados.rados.0.smithi084.stdout:1089: done (2 left) 2024-03-30T12:26:13.754 INFO:tasks.rados.rados.0.smithi084.stdout:1092: rollback oid 25 current snap is 113 2024-03-30T12:26:13.754 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 25 to 98 2024-03-30T12:26:13.754 INFO:tasks.rados.rados.0.smithi084.stdout:1093: rmattr oid 46 current snap is 113 2024-03-30T12:26:13.754 INFO:tasks.rados.rados.0.smithi084.stdout:1094: rmattr oid 18 current snap is 113 2024-03-30T12:26:13.754 INFO:tasks.rados.rados.0.smithi084.stdout:1095: delete oid 7 current snap is 113 2024-03-30T12:26:13.755 INFO:tasks.rados.rados.0.smithi084.stdout:1095: done (5 left) 2024-03-30T12:26:13.756 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 113 2024-03-30T12:26:13.756 INFO:tasks.rados.rados.0.smithi084.stdout:1096: seq_num 352 ranges {7290880=704512,7995392=401408} 2024-03-30T12:26:13.798 INFO:tasks.rados.rados.0.smithi084.stdout:1096: writing smithi08477944-1 from 7290880 to 7995392 tid 1 2024-03-30T12:26:13.802 INFO:tasks.rados.rados.0.smithi084.stdout:1096: writing smithi08477944-1 from 7995392 to 8396800 tid 2 2024-03-30T12:26:13.802 INFO:tasks.rados.rados.0.smithi084.stdout:1097: snap_remove snap 108 2024-03-30T12:26:14.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:13 smithi084 ceph-mon[91810]: pgmap v122: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 215 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 2.0 MiB/s wr, 24 op/s; 107/528 objects degraded (20.265%) 2024-03-30T12:26:14.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:13 smithi084 ceph-mon[91810]: osdmap e294: 8 total, 7 up, 8 in 2024-03-30T12:26:14.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:13 smithi084 ceph-mon[89279]: pgmap v122: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 215 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 2.0 MiB/s wr, 24 op/s; 107/528 objects degraded (20.265%) 2024-03-30T12:26:14.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:13 smithi084 ceph-mon[89279]: osdmap e294: 8 total, 7 up, 8 in 2024-03-30T12:26:14.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:13 smithi162 ceph-mon[83709]: pgmap v122: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 215 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 2.0 MiB/s wr, 24 op/s; 107/528 objects degraded (20.265%) 2024-03-30T12:26:14.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:13 smithi162 ceph-mon[83709]: osdmap e294: 8 total, 7 up, 8 in 2024-03-30T12:26:14.736 INFO:tasks.rados.rados.0.smithi084.stdout:1097: done (6 left) 2024-03-30T12:26:14.736 INFO:tasks.rados.rados.0.smithi084.stdout:1098: read oid 34 snap -1 2024-03-30T12:26:14.736 INFO:tasks.rados.rados.0.smithi084.stdout:1098: expect (ObjNum 323 snap 108 seq_num 323) 2024-03-30T12:26:14.737 INFO:tasks.rados.rados.0.smithi084.stdout:1099: copy_from oid 32 from oid 40 current snap is 113 2024-03-30T12:26:14.737 INFO:tasks.rados.rados.0.smithi084.stdout:1090: finishing write tid 1 to smithi08477944-35 2024-03-30T12:26:14.737 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 702 (ObjNum 345 snap 113 seq_num 345) dirty exists 2024-03-30T12:26:14.737 INFO:tasks.rados.rados.0.smithi084.stdout:1094: done (7 left) 2024-03-30T12:26:14.737 INFO:tasks.rados.rados.0.smithi084.stdout:1100: delete oid 2 current snap is 113 2024-03-30T12:26:14.737 INFO:tasks.rados.rados.0.smithi084.stdout:1091: finishing rollback tid 0 to smithi08477944-12 2024-03-30T12:26:14.737 INFO:tasks.rados.rados.0.smithi084.stdout:1090: finishing write tid 2 to smithi08477944-35 2024-03-30T12:26:14.737 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 667 (ObjNum 300 snap 95 seq_num 300) dirty exists 2024-03-30T12:26:14.737 INFO:tasks.rados.rados.0.smithi084.stdout:1091: finishing rollback tid 1 to smithi08477944-12 2024-03-30T12:26:14.737 INFO:tasks.rados.rados.0.smithi084.stdout:1092: finishing rollback tid 0 to smithi08477944-25 2024-03-30T12:26:14.737 INFO:tasks.rados.rados.0.smithi084.stdout:1090: finishing write tid 3 to smithi08477944-35 2024-03-30T12:26:14.737 INFO:tasks.rados.rados.0.smithi084.stdout:1091: finishing rollback tid 2 to smithi08477944-12 2024-03-30T12:26:14.737 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 424 (ObjNum 318 snap 106 seq_num 318) dirty exists 2024-03-30T12:26:14.737 INFO:tasks.rados.rados.0.smithi084.stdout:1092: finishing rollback tid 1 to smithi08477944-25 2024-03-30T12:26:14.738 INFO:tasks.rados.rados.0.smithi084.stdout:1092: finishing rollback tid 2 to smithi08477944-25 2024-03-30T12:26:14.738 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 487 (ObjNum 267 snap 84 seq_num 267) dirty exists 2024-03-30T12:26:14.738 INFO:tasks.rados.rados.0.smithi084.stdout:1090: finishing write tid 4 to smithi08477944-35 2024-03-30T12:26:14.738 INFO:tasks.rados.rados.0.smithi084.stdout:1090: oid 35 updating version 0 to 472 2024-03-30T12:26:14.738 INFO:tasks.rados.rados.0.smithi084.stdout:1090: oid 35 version 472 is already newer than 471 2024-03-30T12:26:14.738 INFO:tasks.rados.rados.0.smithi084.stdout:1090: oid 35 updating version 472 to 473 2024-03-30T12:26:14.738 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 473 (ObjNum 350 snap 113 seq_num 350) dirty exists 2024-03-30T12:26:14.738 INFO:tasks.rados.rados.0.smithi084.stdout:1090: left oid 35 (ObjNum 350 snap 113 seq_num 350) 2024-03-30T12:26:14.738 INFO:tasks.rados.rados.0.smithi084.stdout:1096: finishing write tid 1 to smithi08477944-1 2024-03-30T12:26:14.738 INFO:tasks.rados.rados.0.smithi084.stdout:1096: finishing write tid 2 to smithi08477944-1 2024-03-30T12:26:14.738 INFO:tasks.rados.rados.0.smithi084.stdout:1096: finishing write tid 3 to smithi08477944-1 2024-03-30T12:26:14.738 INFO:tasks.rados.rados.0.smithi084.stdout:1096: finishing write tid 4 to smithi08477944-1 2024-03-30T12:26:14.738 INFO:tasks.rados.rados.0.smithi084.stdout:1096: oid 1 updating version 0 to 476 2024-03-30T12:26:14.738 INFO:tasks.rados.rados.0.smithi084.stdout:1096: oid 1 version 476 is already newer than 474 2024-03-30T12:26:14.739 INFO:tasks.rados.rados.0.smithi084.stdout:1096: oid 1 version 476 is already newer than 475 2024-03-30T12:26:14.739 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 476 (ObjNum 352 snap 113 seq_num 352) dirty exists 2024-03-30T12:26:14.739 INFO:tasks.rados.rados.0.smithi084.stdout:1096: left oid 1 (ObjNum 352 snap 113 seq_num 352) 2024-03-30T12:26:14.744 INFO:tasks.rados.rados.0.smithi084.stdout:1090: done (7 left) 2024-03-30T12:26:14.744 INFO:tasks.rados.rados.0.smithi084.stdout:1091: done (6 left) 2024-03-30T12:26:14.744 INFO:tasks.rados.rados.0.smithi084.stdout:1092: done (5 left) 2024-03-30T12:26:14.745 INFO:tasks.rados.rados.0.smithi084.stdout:1093: done (4 left) 2024-03-30T12:26:14.745 INFO:tasks.rados.rados.0.smithi084.stdout:1096: done (3 left) 2024-03-30T12:26:14.745 INFO:tasks.rados.rados.0.smithi084.stdout:1100: done (2 left) 2024-03-30T12:26:14.745 INFO:tasks.rados.rados.0.smithi084.stdout:1101: copy_from oid 23 from oid 25 current snap is 113 2024-03-30T12:26:14.745 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 113 2024-03-30T12:26:14.745 INFO:tasks.rados.rados.0.smithi084.stdout:1102: seq_num 354 ranges {4317184=737280,5054464=401408} 2024-03-30T12:26:14.769 INFO:tasks.rados.rados.0.smithi084.stdout:1102: writing smithi08477944-41 from 4317184 to 5054464 tid 1 2024-03-30T12:26:14.771 INFO:tasks.rados.rados.0.smithi084.stdout:1102: writing smithi08477944-41 from 5054464 to 5455872 tid 2 2024-03-30T12:26:14.772 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 113 2024-03-30T12:26:14.772 INFO:tasks.rados.rados.0.smithi084.stdout:1103: seq_num 355 ranges {24576=753664,778240=401408} 2024-03-30T12:26:14.776 INFO:tasks.rados.rados.0.smithi084.stdout:1103: writing smithi08477944-37 from 24576 to 778240 tid 1 2024-03-30T12:26:14.778 INFO:tasks.rados.rados.0.smithi084.stdout:1103: writing smithi08477944-37 from 778240 to 1179648 tid 2 2024-03-30T12:26:14.779 INFO:tasks.rados.rados.0.smithi084.stdout:1104: read oid 18 snap -1 2024-03-30T12:26:14.779 INFO:tasks.rados.rados.0.smithi084.stdout:1104: expect (ObjNum 345 snap 113 seq_num 345) 2024-03-30T12:26:14.779 INFO:tasks.rados.rados.0.smithi084.stdout:1105: rollback oid 26 current snap is 113 2024-03-30T12:26:14.779 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 26 to 110 2024-03-30T12:26:14.779 INFO:tasks.rados.rados.0.smithi084.stdout:1099: finishing copy_from racing read to smithi08477944-32 2024-03-30T12:26:14.779 INFO:tasks.rados.rados.0.smithi084.stdout:1099: finishing copy_from to smithi08477944-32 2024-03-30T12:26:14.779 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 631 (ObjNum 205 snap 62 seq_num 205) dirty exists 2024-03-30T12:26:14.779 INFO:tasks.rados.rados.0.smithi084.stdout:1098: expect (ObjNum 323 snap 108 seq_num 323) 2024-03-30T12:26:14.907 INFO:tasks.rados.rados.0.smithi084.stdout:1101: finishing copy_from racing read to smithi08477944-23 2024-03-30T12:26:14.907 INFO:tasks.rados.rados.0.smithi084.stdout:1102: finishing write tid 1 to smithi08477944-41 2024-03-30T12:26:14.907 INFO:tasks.rados.rados.0.smithi084.stdout:1102: finishing write tid 2 to smithi08477944-41 2024-03-30T12:26:14.908 INFO:tasks.rados.rados.0.smithi084.stdout:1102: finishing write tid 3 to smithi08477944-41 2024-03-30T12:26:14.908 INFO:tasks.rados.rados.0.smithi084.stdout:1101: finishing copy_from to smithi08477944-23 2024-03-30T12:26:14.908 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 487 (ObjNum 267 snap 84 seq_num 267) dirty exists 2024-03-30T12:26:14.908 INFO:tasks.rados.rados.0.smithi084.stdout:1102: finishing write tid 4 to smithi08477944-41 2024-03-30T12:26:14.908 INFO:tasks.rados.rados.0.smithi084.stdout:1102: oid 41 updating version 0 to 710 2024-03-30T12:26:14.908 INFO:tasks.rados.rados.0.smithi084.stdout:1102: oid 41 updating version 710 to 712 2024-03-30T12:26:14.908 INFO:tasks.rados.rados.0.smithi084.stdout:1102: oid 41 version 712 is already newer than 711 2024-03-30T12:26:14.908 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 712 (ObjNum 354 snap 113 seq_num 354) dirty exists 2024-03-30T12:26:14.908 INFO:tasks.rados.rados.0.smithi084.stdout:1102: left oid 41 (ObjNum 354 snap 113 seq_num 354) 2024-03-30T12:26:14.908 INFO:tasks.rados.rados.0.smithi084.stdout:1105: finishing rollback tid 1 to smithi08477944-26 2024-03-30T12:26:14.908 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 459 (ObjNum 1057 snap 0 seq_num 1532997840) dirty dne 2024-03-30T12:26:14.908 INFO:tasks.rados.rados.0.smithi084.stdout:1103: finishing write tid 1 to smithi08477944-37 2024-03-30T12:26:14.908 INFO:tasks.rados.rados.0.smithi084.stdout:1103: finishing write tid 2 to smithi08477944-37 2024-03-30T12:26:14.908 INFO:tasks.rados.rados.0.smithi084.stdout:1103: finishing write tid 3 to smithi08477944-37 2024-03-30T12:26:14.908 INFO:tasks.rados.rados.0.smithi084.stdout:1098: done (6 left) 2024-03-30T12:26:14.909 INFO:tasks.rados.rados.0.smithi084.stdout:1099: done (5 left) 2024-03-30T12:26:14.909 INFO:tasks.rados.rados.0.smithi084.stdout:1101: done (4 left) 2024-03-30T12:26:14.909 INFO:tasks.rados.rados.0.smithi084.stdout:1102: done (3 left) 2024-03-30T12:26:14.909 INFO:tasks.rados.rados.0.smithi084.stdout:1105: done (2 left) 2024-03-30T12:26:14.909 INFO:tasks.rados.rados.0.smithi084.stdout:1106: copy_from oid 23 from oid 16 current snap is 113 2024-03-30T12:26:14.909 INFO:tasks.rados.rados.0.smithi084.stdout:1103: finishing write tid 4 to smithi08477944-37 2024-03-30T12:26:14.909 INFO:tasks.rados.rados.0.smithi084.stdout:1103: oid 37 updating version 0 to 445 2024-03-30T12:26:14.909 INFO:tasks.rados.rados.0.smithi084.stdout:1103: oid 37 updating version 445 to 446 2024-03-30T12:26:14.909 INFO:tasks.rados.rados.0.smithi084.stdout:1103: oid 37 version 446 is already newer than 444 2024-03-30T12:26:14.909 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 446 (ObjNum 355 snap 113 seq_num 355) dirty exists 2024-03-30T12:26:14.909 INFO:tasks.rados.rados.0.smithi084.stdout:1103: left oid 37 (ObjNum 355 snap 113 seq_num 355) 2024-03-30T12:26:14.909 INFO:tasks.rados.rados.0.smithi084.stdout:1104: expect (ObjNum 345 snap 113 seq_num 345) 2024-03-30T12:26:14.994 INFO:tasks.rados.rados.0.smithi084.stdout:1106: finishing copy_from racing read to smithi08477944-23 2024-03-30T12:26:14.994 INFO:tasks.rados.rados.0.smithi084.stdout:1106: finishing copy_from to smithi08477944-23 2024-03-30T12:26:14.994 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 598 (ObjNum 312 snap 103 seq_num 312) dirty exists 2024-03-30T12:26:14.994 INFO:tasks.rados.rados.0.smithi084.stdout:1103: done (2 left) 2024-03-30T12:26:14.994 INFO:tasks.rados.rados.0.smithi084.stdout:1104: done (1 left) 2024-03-30T12:26:14.994 INFO:tasks.rados.rados.0.smithi084.stdout:1106: done (0 left) 2024-03-30T12:26:14.994 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 113 2024-03-30T12:26:14.994 INFO:tasks.rados.rados.0.smithi084.stdout:1107: seq_num 356 ranges {4988928=770048,5758976=401408} 2024-03-30T12:26:15.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:14.749+0000 7f5da9b707c0 -1 osd.0 286 log_to_monitors true 2024-03-30T12:26:15.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:14 smithi084 ceph-mon[91810]: osdmap e295: 8 total, 7 up, 8 in 2024-03-30T12:26:15.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:14 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:15.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:14 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:26:15.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:14 smithi084 ceph-mon[89279]: osdmap e295: 8 total, 7 up, 8 in 2024-03-30T12:26:15.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:14 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:15.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:14 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:26:15.026 INFO:tasks.rados.rados.0.smithi084.stdout:1107: writing smithi08477944-38 from 4988928 to 5758976 tid 1 2024-03-30T12:26:15.030 INFO:tasks.rados.rados.0.smithi084.stdout:1107: writing smithi08477944-38 from 5758976 to 6160384 tid 2 2024-03-30T12:26:15.030 INFO:tasks.rados.rados.0.smithi084.stdout:1108: read oid 40 snap 111 2024-03-30T12:26:15.030 INFO:tasks.rados.rados.0.smithi084.stdout:1108: expect (ObjNum 205 snap 62 seq_num 205) 2024-03-30T12:26:15.030 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 113 2024-03-30T12:26:15.030 INFO:tasks.rados.rados.0.smithi084.stdout:1109: seq_num 357 ranges {1843200=786432,2629632=401408} 2024-03-30T12:26:15.044 INFO:tasks.rados.rados.0.smithi084.stdout:1109: writing smithi08477944-35 from 1843200 to 2629632 tid 1 2024-03-30T12:26:15.047 INFO:tasks.rados.rados.0.smithi084.stdout:1109: writing smithi08477944-35 from 2629632 to 3031040 tid 2 2024-03-30T12:26:15.047 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 113 2024-03-30T12:26:15.047 INFO:tasks.rados.rados.0.smithi084.stdout:1107: finishing write tid 1 to smithi08477944-38 2024-03-30T12:26:15.047 INFO:tasks.rados.rados.0.smithi084.stdout:1110: seq_num 358 ranges {2351104=802816,3153920=401408} 2024-03-30T12:26:15.063 INFO:tasks.rados.rados.0.smithi084.stdout:1110: writing smithi08477944-45 from 2351104 to 3153920 tid 1 2024-03-30T12:26:15.068 INFO:tasks.rados.rados.0.smithi084.stdout:1110: writing smithi08477944-45 from 3153920 to 3555328 tid 2 2024-03-30T12:26:15.068 INFO:tasks.rados.rados.0.smithi084.stdout:1111: read oid 2 snap -1 2024-03-30T12:26:15.068 INFO:tasks.rados.rados.0.smithi084.stdout:1111: expect deleted 2024-03-30T12:26:15.068 INFO:tasks.rados.rados.0.smithi084.stdout:1112: snap_create 2024-03-30T12:26:15.068 INFO:tasks.rados.rados.0.smithi084.stdout:1107: finishing write tid 2 to smithi08477944-38 2024-03-30T12:26:15.068 INFO:tasks.rados.rados.0.smithi084.stdout:1107: finishing write tid 3 to smithi08477944-38 2024-03-30T12:26:15.068 INFO:tasks.rados.rados.0.smithi084.stdout:1107: finishing write tid 4 to smithi08477944-38 2024-03-30T12:26:15.068 INFO:tasks.rados.rados.0.smithi084.stdout:1107: oid 38 updating version 0 to 473 2024-03-30T12:26:15.068 INFO:tasks.rados.rados.0.smithi084.stdout:1107: oid 38 version 473 is already newer than 472 2024-03-30T12:26:15.068 INFO:tasks.rados.rados.0.smithi084.stdout:1107: oid 38 version 473 is already newer than 471 2024-03-30T12:26:15.069 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 473 (ObjNum 356 snap 113 seq_num 356) dirty exists 2024-03-30T12:26:15.069 INFO:tasks.rados.rados.0.smithi084.stdout:1107: left oid 38 (ObjNum 356 snap 113 seq_num 356) 2024-03-30T12:26:15.069 INFO:tasks.rados.rados.0.smithi084.stdout:1108: expect (ObjNum 205 snap 62 seq_num 205) 2024-03-30T12:26:15.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:14 smithi162 ceph-mon[83709]: osdmap e295: 8 total, 7 up, 8 in 2024-03-30T12:26:15.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:14 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:15.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:14 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:26:15.199 INFO:tasks.rados.rados.0.smithi084.stdout:1109: finishing write tid 1 to smithi08477944-35 2024-03-30T12:26:15.199 INFO:tasks.rados.rados.0.smithi084.stdout:1109: finishing write tid 2 to smithi08477944-35 2024-03-30T12:26:15.199 INFO:tasks.rados.rados.0.smithi084.stdout:1109: finishing write tid 3 to smithi08477944-35 2024-03-30T12:26:15.199 INFO:tasks.rados.rados.0.smithi084.stdout:1109: finishing write tid 4 to smithi08477944-35 2024-03-30T12:26:15.199 INFO:tasks.rados.rados.0.smithi084.stdout:1109: oid 35 updating version 0 to 477 2024-03-30T12:26:15.199 INFO:tasks.rados.rados.0.smithi084.stdout:1109: oid 35 updating version 477 to 479 2024-03-30T12:26:15.200 INFO:tasks.rados.rados.0.smithi084.stdout:1109: oid 35 version 479 is already newer than 478 2024-03-30T12:26:15.200 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 479 (ObjNum 357 snap 113 seq_num 357) dirty exists 2024-03-30T12:26:15.200 INFO:tasks.rados.rados.0.smithi084.stdout:1109: left oid 35 (ObjNum 357 snap 113 seq_num 357) 2024-03-30T12:26:15.200 INFO:tasks.rados.rados.0.smithi084.stdout:1110: finishing write tid 1 to smithi08477944-45 2024-03-30T12:26:15.200 INFO:tasks.rados.rados.0.smithi084.stdout:1110: finishing write tid 2 to smithi08477944-45 2024-03-30T12:26:15.200 INFO:tasks.rados.rados.0.smithi084.stdout:1110: finishing write tid 3 to smithi08477944-45 2024-03-30T12:26:15.200 INFO:tasks.rados.rados.0.smithi084.stdout:1110: finishing write tid 4 to smithi08477944-45 2024-03-30T12:26:15.200 INFO:tasks.rados.rados.0.smithi084.stdout:1110: oid 45 updating version 0 to 714 2024-03-30T12:26:15.200 INFO:tasks.rados.rados.0.smithi084.stdout:1110: oid 45 version 714 is already newer than 713 2024-03-30T12:26:15.200 INFO:tasks.rados.rados.0.smithi084.stdout:1110: oid 45 updating version 714 to 715 2024-03-30T12:26:15.200 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 715 (ObjNum 358 snap 113 seq_num 358) dirty exists 2024-03-30T12:26:15.200 INFO:tasks.rados.rados.0.smithi084.stdout:1110: left oid 45 (ObjNum 358 snap 113 seq_num 358) 2024-03-30T12:26:15.747 INFO:tasks.rados.rados.0.smithi084.stdout:1107: done (5 left) 2024-03-30T12:26:15.747 INFO:tasks.rados.rados.0.smithi084.stdout:1108: done (4 left) 2024-03-30T12:26:15.747 INFO:tasks.rados.rados.0.smithi084.stdout:1109: done (3 left) 2024-03-30T12:26:15.747 INFO:tasks.rados.rados.0.smithi084.stdout:1110: done (2 left) 2024-03-30T12:26:15.747 INFO:tasks.rados.rados.0.smithi084.stdout:1111: done (1 left) 2024-03-30T12:26:15.747 INFO:tasks.rados.rados.0.smithi084.stdout:1112: done (0 left) 2024-03-30T12:26:15.747 INFO:tasks.rados.rados.0.smithi084.stdout:1113: setattr oid 23 current snap is 114 2024-03-30T12:26:15.748 INFO:tasks.rados.rados.0.smithi084.stdout:1114: snap_remove snap 88 2024-03-30T12:26:15.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:15 smithi084 ceph-mon[91810]: pgmap v125: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 215 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 107/528 objects degraded (20.265%) 2024-03-30T12:26:15.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:15 smithi084 ceph-mon[91810]: osdmap e296: 8 total, 7 up, 8 in 2024-03-30T12:26:15.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:15 smithi084 ceph-mon[91810]: from='osd.0 [v2:172.21.15.84:6802/1465604312,v1:172.21.15.84:6803/1465604312]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T12:26:15.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:15 smithi084 ceph-mon[91810]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T12:26:15.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:15 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:15.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:15 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:15.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:15 smithi084 ceph-mon[89279]: pgmap v125: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 215 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 107/528 objects degraded (20.265%) 2024-03-30T12:26:15.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:15 smithi084 ceph-mon[89279]: osdmap e296: 8 total, 7 up, 8 in 2024-03-30T12:26:15.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:15 smithi084 ceph-mon[89279]: from='osd.0 [v2:172.21.15.84:6802/1465604312,v1:172.21.15.84:6803/1465604312]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T12:26:15.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:15 smithi084 ceph-mon[89279]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T12:26:15.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:15 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:15.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:15 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:16.082 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:15.772+0000 7f5d9afc8700 -1 osd.0 286 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T12:26:16.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:15 smithi162 ceph-mon[83709]: pgmap v125: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 215 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 107/528 objects degraded (20.265%) 2024-03-30T12:26:16.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:15 smithi162 ceph-mon[83709]: osdmap e296: 8 total, 7 up, 8 in 2024-03-30T12:26:16.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:15 smithi162 ceph-mon[83709]: from='osd.0 [v2:172.21.15.84:6802/1465604312,v1:172.21.15.84:6803/1465604312]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T12:26:16.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:15 smithi162 ceph-mon[83709]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T12:26:16.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:15 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:16.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:15 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:16.757 INFO:tasks.rados.rados.0.smithi084.stdout:1114: done (1 left) 2024-03-30T12:26:16.757 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 114 2024-03-30T12:26:16.758 INFO:tasks.rados.rados.0.smithi084.stdout:1115: seq_num 359 ranges {3555328=417792,3973120=417792,4390912=385024} 2024-03-30T12:26:16.780 INFO:tasks.rados.rados.0.smithi084.stdout:1115: writing smithi08477944-45 from 3555328 to 3973120 tid 1 2024-03-30T12:26:16.783 INFO:tasks.rados.rados.0.smithi084.stdout:1115: writing smithi08477944-45 from 3973120 to 4390912 tid 2 2024-03-30T12:26:16.786 INFO:tasks.rados.rados.0.smithi084.stdout:1115: writing smithi08477944-45 from 4390912 to 4775936 tid 3 2024-03-30T12:26:16.786 INFO:tasks.rados.rados.0.smithi084.stdout:1116: snap_remove snap 111 2024-03-30T12:26:16.831 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:16 smithi084 ceph-mon[91810]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-30T12:26:16.832 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:16 smithi084 ceph-mon[91810]: osdmap e297: 8 total, 7 up, 8 in 2024-03-30T12:26:16.832 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:16 smithi084 ceph-mon[91810]: from='osd.0 [v2:172.21.15.84:6802/1465604312,v1:172.21.15.84:6803/1465604312]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:26:16.832 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:16 smithi084 ceph-mon[91810]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:26:16.832 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:16 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:16.832 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:16 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:16.832 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:16 smithi084 ceph-mon[91810]: pgmap v128: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 229 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 4.6 MiB/s wr, 28 op/s; 119/555 objects degraded (21.441%) 2024-03-30T12:26:16.832 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:16 smithi084 ceph-mon[89279]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-30T12:26:16.832 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:16 smithi084 ceph-mon[89279]: osdmap e297: 8 total, 7 up, 8 in 2024-03-30T12:26:16.832 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:16 smithi084 ceph-mon[89279]: from='osd.0 [v2:172.21.15.84:6802/1465604312,v1:172.21.15.84:6803/1465604312]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:26:16.832 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:16 smithi084 ceph-mon[89279]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:26:16.832 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:16 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:16.833 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:16 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:16.833 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:16 smithi084 ceph-mon[89279]: pgmap v128: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 229 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 4.6 MiB/s wr, 28 op/s; 119/555 objects degraded (21.441%) 2024-03-30T12:26:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:16 smithi162 ceph-mon[83709]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-30T12:26:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:16 smithi162 ceph-mon[83709]: osdmap e297: 8 total, 7 up, 8 in 2024-03-30T12:26:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:16 smithi162 ceph-mon[83709]: from='osd.0 [v2:172.21.15.84:6802/1465604312,v1:172.21.15.84:6803/1465604312]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:26:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:16 smithi162 ceph-mon[83709]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:26:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:16 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:16 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:16 smithi162 ceph-mon[83709]: pgmap v128: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 229 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 4.6 MiB/s wr, 28 op/s; 119/555 objects degraded (21.441%) 2024-03-30T12:26:17.754 INFO:tasks.rados.rados.0.smithi084.stdout:1116: done (2 left) 2024-03-30T12:26:17.754 INFO:tasks.rados.rados.0.smithi084.stdout:1117: delete oid 1 current snap is 114 2024-03-30T12:26:17.754 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 632 (ObjNum 312 snap 103 seq_num 312) dirty exists 2024-03-30T12:26:17.755 INFO:tasks.rados.rados.0.smithi084.stdout:1115: finishing write tid 1 to smithi08477944-45 2024-03-30T12:26:17.755 INFO:tasks.rados.rados.0.smithi084.stdout:1115: finishing write tid 2 to smithi08477944-45 2024-03-30T12:26:17.755 INFO:tasks.rados.rados.0.smithi084.stdout:1115: finishing write tid 3 to smithi08477944-45 2024-03-30T12:26:17.755 INFO:tasks.rados.rados.0.smithi084.stdout:1115: finishing write tid 4 to smithi08477944-45 2024-03-30T12:26:17.755 INFO:tasks.rados.rados.0.smithi084.stdout:1115: finishing write tid 5 to smithi08477944-45 2024-03-30T12:26:17.755 INFO:tasks.rados.rados.0.smithi084.stdout:1115: oid 45 updating version 0 to 728 2024-03-30T12:26:17.755 INFO:tasks.rados.rados.0.smithi084.stdout:1115: oid 45 version 728 is already newer than 727 2024-03-30T12:26:17.755 INFO:tasks.rados.rados.0.smithi084.stdout:1115: oid 45 version 728 is already newer than 726 2024-03-30T12:26:17.755 INFO:tasks.rados.rados.0.smithi084.stdout:1115: oid 45 version 728 is already newer than 725 2024-03-30T12:26:17.755 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 728 (ObjNum 359 snap 114 seq_num 359) dirty exists 2024-03-30T12:26:17.755 INFO:tasks.rados.rados.0.smithi084.stdout:1115: left oid 45 (ObjNum 359 snap 114 seq_num 359) 2024-03-30T12:26:17.827 INFO:tasks.rados.rados.0.smithi084.stdout:1113: done (2 left) 2024-03-30T12:26:17.827 INFO:tasks.rados.rados.0.smithi084.stdout:1115: done (1 left) 2024-03-30T12:26:17.828 INFO:tasks.rados.rados.0.smithi084.stdout:1117: done (0 left) 2024-03-30T12:26:17.828 INFO:tasks.rados.rados.0.smithi084.stdout:1118: rollback oid 50 current snap is 114 2024-03-30T12:26:17.828 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 50 to 98 2024-03-30T12:26:17.828 INFO:tasks.rados.rados.0.smithi084.stdout:1119: copy_from oid 39 from oid 10 current snap is 114 2024-03-30T12:26:17.828 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 114 2024-03-30T12:26:17.828 INFO:tasks.rados.rados.0.smithi084.stdout:1120: seq_num 361 ranges {0=450560,450560=581632,1032192=221184} 2024-03-30T12:26:17.830 INFO:tasks.rados.rados.0.smithi084.stdout:1120: writing smithi08477944-2 from 0 to 450560 tid 1 2024-03-30T12:26:17.837 INFO:tasks.rados.rados.0.smithi084.stdout:1120: writing smithi08477944-2 from 450560 to 1032192 tid 2 2024-03-30T12:26:17.838 INFO:tasks.rados.rados.0.smithi084.stdout:1120: writing smithi08477944-2 from 1032192 to 1253376 tid 3 2024-03-30T12:26:17.838 INFO:tasks.rados.rados.0.smithi084.stdout:1118: finishing rollback tid 0 to smithi08477944-50 2024-03-30T12:26:17.838 INFO:tasks.rados.rados.0.smithi084.stdout:1118: finishing rollback tid 1 to smithi08477944-50 2024-03-30T12:26:17.838 INFO:tasks.rados.rados.0.smithi084.stdout:1118: finishing rollback tid 2 to smithi08477944-50 2024-03-30T12:26:17.838 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 740 (ObjNum 267 snap 84 seq_num 267) dirty exists 2024-03-30T12:26:17.839 INFO:tasks.rados.rados.0.smithi084.stdout:1118: done (2 left) 2024-03-30T12:26:17.839 INFO:tasks.rados.rados.0.smithi084.stdout:1121: read oid 34 snap -1 2024-03-30T12:26:17.839 INFO:tasks.rados.rados.0.smithi084.stdout:1121: expect (ObjNum 323 snap 108 seq_num 323) 2024-03-30T12:26:17.839 INFO:tasks.rados.rados.0.smithi084.stdout:1122: rollback oid 27 current snap is 114 2024-03-30T12:26:17.839 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 27 to 97 2024-03-30T12:26:17.839 INFO:tasks.rados.rados.0.smithi084.stdout:1123: rollback oid 25 current snap is 114 2024-03-30T12:26:17.840 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 25 to 113 2024-03-30T12:26:17.840 INFO:tasks.rados.rados.0.smithi084.stdout:1124: copy_from oid 35 from oid 30 current snap is 114 2024-03-30T12:26:17.840 INFO:tasks.rados.rados.0.smithi084.stdout:1125: snap_create 2024-03-30T12:26:17.841 INFO:tasks.rados.rados.0.smithi084.stdout:1120: finishing write tid 1 to smithi08477944-2 2024-03-30T12:26:17.841 INFO:tasks.rados.rados.0.smithi084.stdout:1123: finishing rollback tid 0 to smithi08477944-25 2024-03-30T12:26:17.842 INFO:tasks.rados.rados.0.smithi084.stdout:1120: finishing write tid 2 to smithi08477944-2 2024-03-30T12:26:17.843 INFO:tasks.rados.rados.0.smithi084.stdout:1120: finishing write tid 3 to smithi08477944-2 2024-03-30T12:26:17.843 INFO:tasks.rados.rados.0.smithi084.stdout:1120: finishing write tid 4 to smithi08477944-2 2024-03-30T12:26:17.843 INFO:tasks.rados.rados.0.smithi084.stdout:1123: finishing rollback tid 1 to smithi08477944-25 2024-03-30T12:26:17.844 INFO:tasks.rados.rados.0.smithi084.stdout:1123: finishing rollback tid 2 to smithi08477944-25 2024-03-30T12:26:17.844 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 490 (ObjNum 267 snap 84 seq_num 267) dirty exists 2024-03-30T12:26:17.844 INFO:tasks.rados.rados.0.smithi084.stdout:1120: finishing write tid 5 to smithi08477944-2 2024-03-30T12:26:17.845 INFO:tasks.rados.rados.0.smithi084.stdout:1120: oid 2 updating version 0 to 672 2024-03-30T12:26:17.845 INFO:tasks.rados.rados.0.smithi084.stdout:1120: oid 2 version 672 is already newer than 669 2024-03-30T12:26:17.845 INFO:tasks.rados.rados.0.smithi084.stdout:1120: oid 2 version 672 is already newer than 670 2024-03-30T12:26:17.845 INFO:tasks.rados.rados.0.smithi084.stdout:1120: oid 2 version 672 is already newer than 671 2024-03-30T12:26:17.845 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 672 (ObjNum 361 snap 114 seq_num 361) dirty exists 2024-03-30T12:26:17.845 INFO:tasks.rados.rados.0.smithi084.stdout:1120: left oid 2 (ObjNum 361 snap 114 seq_num 361) 2024-03-30T12:26:17.846 INFO:tasks.rados.rados.0.smithi084.stdout:1119: finishing copy_from racing read to smithi08477944-39 2024-03-30T12:26:17.846 INFO:tasks.rados.rados.0.smithi084.stdout:1119: finishing copy_from to smithi08477944-39 2024-03-30T12:26:17.846 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 442 (ObjNum 325 snap 110 seq_num 325) dirty exists 2024-03-30T12:26:17.852 INFO:tasks.rados.rados.0.smithi084.stdout:1124: finishing copy_from to smithi08477944-35 2024-03-30T12:26:17.853 INFO:tasks.rados.rados.0.smithi084.stdout:1124: got expected ENOENT (src dne) 2024-03-30T12:26:17.853 INFO:tasks.rados.rados.0.smithi084.stdout:1124: finishing copy_from racing read to smithi08477944-35 2024-03-30T12:26:17.854 INFO:tasks.rados.rados.0.smithi084.stdout:1121: expect (ObjNum 323 snap 108 seq_num 323) 2024-03-30T12:26:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-mon[91810]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T12:26:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-mon[91810]: osd.0 [v2:172.21.15.84:6802/1465604312,v1:172.21.15.84:6803/1465604312] boot 2024-03-30T12:26:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-mon[91810]: osdmap e298: 8 total, 8 up, 8 in 2024-03-30T12:26:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:26:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-mon[91810]: Health check update: Degraded data redundancy: 119/555 objects degraded (21.441%), 15 pgs degraded (PG_DEGRADED) 2024-03-30T12:26:18.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-mon[91810]: mgrmap e42: y(active, since 92s), standbys: x 2024-03-30T12:26:18.005 INFO:tasks.rados.rados.0.smithi084.stdout:1122: finishing rollback tid 0 to smithi08477944-27 2024-03-30T12:26:18.005 INFO:tasks.rados.rados.0.smithi084.stdout:1122: finishing rollback tid 1 to smithi08477944-27 2024-03-30T12:26:18.006 INFO:tasks.rados.rados.0.smithi084.stdout:1122: finishing rollback tid 2 to smithi08477944-27 2024-03-30T12:26:18.006 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 427 (ObjNum 304 snap 96 seq_num 304) dirty exists 2024-03-30T12:26:18.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-mon[89279]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T12:26:18.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-mon[89279]: osd.0 [v2:172.21.15.84:6802/1465604312,v1:172.21.15.84:6803/1465604312] boot 2024-03-30T12:26:18.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-mon[89279]: osdmap e298: 8 total, 8 up, 8 in 2024-03-30T12:26:18.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:26:18.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-mon[89279]: Health check update: Degraded data redundancy: 119/555 objects degraded (21.441%), 15 pgs degraded (PG_DEGRADED) 2024-03-30T12:26:18.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-mon[89279]: mgrmap e42: y(active, since 92s), standbys: x 2024-03-30T12:26:18.008 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:17.784+0000 7f5d81f96700 -1 osd.0 pg_epoch: 299 pg[5.es2( v 284'173 (0'0,284'173] local-lis/les=298/299 n=2 ec=71/71 lis/c=298/298 les/c/f=299/299/0 sis=298) [4,5,0]p4(0) r=2 lpr=298 luod=0'0 crt=284'173 lcod 0'0 mlcod 0'0 active mbc={}] update_snap_map remove_oid 5:75e7add2:::smithi08477944-21:7d failed with -2 2024-03-30T12:26:18.008 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:17.789+0000 7f5d85f9e700 -1 osd.0 pg_epoch: 299 pg[5.es2( v 299'175 (0'0,299'175] local-lis/les=298/299 n=1 ec=71/71 lis/c=298/298 les/c/f=299/299/0 sis=298) [4,5,0]p4(0) r=2 lpr=298 luod=0'0 crt=299'175 mlcod 299'175 active mbc={} ps=[7c~1]] update_snap_map remove_oid 5:75e7add2:::smithi08477944-21:9a failed with -2 2024-03-30T12:26:18.008 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:17.875+0000 7f5d8679f700 -1 osd.0 pg_epoch: 299 pg[5.5s0( v 299'495 (0'0,299'495] local-lis/les=298/299 n=11 ec=71/71 lis/c=298/298 les/c/f=299/299/0 sis=298) [0,1,4]p0(0) r=0 lpr=298 luod=299'493 crt=299'493 lcod 299'491 mlcod 299'491 active+clean+snaptrim trimq=[97~1,99~1,9d~1,a8~2,ab~2,ae~2] ps=[7c~1]] update_snap_map remove_oid 5:aff7632d:::smithi08477944-23:9c failed with -2 2024-03-30T12:26:18.009 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:17.878+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b0=[]:{a0=[a0,9d],af=[af,ae,ad,ab,aa,a9,a8,a1],b0=[b0]} for object 5:aff7632d:::smithi08477944-23:9c 2024-03-30T12:26:18.009 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:17.887+0000 7f5d83799700 -1 osd.0 pg_epoch: 299 pg[5.3s0( v 299'502 (0'0,299'502] local-lis/les=298/299 n=8 ec=71/71 lis/c=298/298 les/c/f=299/299/0 sis=298) [0,3,6]p0(0) r=0 lpr=298 crt=299'502 lcod 299'500 mlcod 299'500 active+clean+snaptrim trimq=[97~1,99~1,9d~1,a8~2,ab~2,ae~2] ps=[7c~1]] update_snap_map remove_oid 5:c4ecc257:::smithi08477944-17:9a failed with -2 2024-03-30T12:26:18.010 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:17.888+0000 7f5d83799700 -1 osd.0 pg_epoch: 299 pg[5.3s0( v 299'504 (0'0,299'504] local-lis/les=298/299 n=7 ec=71/71 lis/c=298/298 les/c/f=299/299/0 sis=298) [0,3,6]p0(0) r=0 lpr=298 luod=299'502 crt=299'502 lcod 299'500 mlcod 299'500 active+clean+snaptrim trimq=[97~1,99~1,9d~1,a8~2,ab~2,ae~2] ps=[7c~1]] update_snap_map remove_oid 5:c570ada9:::smithi08477944-15:9a failed with -2 2024-03-30T12:26:18.010 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:17.890+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:18.010 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:17.926+0000 7f5d84f9c700 -1 osd.0 pg_epoch: 299 pg[5.8s1( v 295'726 (0'0,295'726] local-lis/les=298/299 n=21 ec=71/71 lis/c=298/298 les/c/f=299/299/0 sis=298) [2,0,1]p2(0) r=1 lpr=298 luod=0'0 crt=295'726 mlcod 0'0 active mbc={}] update_snap_map remove_oid 5:142396d3:::smithi08477944-33:8b failed with -2 2024-03-30T12:26:18.010 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:17.928+0000 7f5d88fa4700 -1 osd.0 pg_epoch: 299 pg[5.8s1( v 299'728 (0'0,299'728] local-lis/les=298/299 n=20 ec=71/71 lis/c=298/298 les/c/f=299/299/0 sis=298) [2,0,1]p2(0) r=1 lpr=298 luod=0'0 crt=295'726 mlcod 0'0 active mbc={}] update_snap_map remove_oid 5:15c62ace:::smithi08477944-20:7c failed with -2 2024-03-30T12:26:18.010 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:17.931+0000 7f5d84f9c700 -1 osd.0 pg_epoch: 299 pg[5.8s1( v 299'730 (0'0,299'730] local-lis/les=298/299 n=19 ec=71/71 lis/c=298/298 les/c/f=299/299/0 sis=298) [2,0,1]p2(0) r=1 lpr=298 luod=0'0 crt=299'730 mlcod 299'730 active mbc={}] update_snap_map remove_oid 5:13f126c3:::smithi08477944-47:7c failed with -2 2024-03-30T12:26:18.011 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:17.932+0000 7f5d88fa4700 -1 osd.0 pg_epoch: 299 pg[5.8s1( v 299'732 (0'0,299'732] local-lis/les=298/299 n=18 ec=71/71 lis/c=298/298 les/c/f=299/299/0 sis=298) [2,0,1]p2(0) r=1 lpr=298 luod=0'0 crt=299'730 mlcod 299'730 active mbc={}] update_snap_map remove_oid 5:1bc98262:::smithi08477944-40:8c failed with -2 2024-03-30T12:26:18.011 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:17.935+0000 7f5d84f9c700 -1 osd.0 pg_epoch: 299 pg[5.8s1( v 299'734 (0'0,299'734] local-lis/les=298/299 n=17 ec=71/71 lis/c=298/298 les/c/f=299/299/0 sis=298) [2,0,1]p2(0) r=1 lpr=298 luod=0'0 crt=299'734 mlcod 299'734 active mbc={}] update_snap_map remove_oid 5:1f1ce0b4:::smithi08477944-7:7c failed with -2 2024-03-30T12:26:18.011 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:17.938+0000 7f5d84f9c700 -1 osd.0 pg_epoch: 299 pg[5.8s1( v 299'738 (0'0,299'738] local-lis/les=298/299 n=16 ec=71/71 lis/c=298/298 les/c/f=299/299/0 sis=298) [2,0,1]p2(0) r=1 lpr=298 luod=0'0 crt=299'736 lcod 299'736 mlcod 299'736 active mbc={} ps=[7c~1]] update_snap_map remove_oid 5:15c62ace:::smithi08477944-20:9a failed with -2 2024-03-30T12:26:18.011 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:17.947+0000 7f5d84f9c700 -1 osd.0 pg_epoch: 299 pg[5.8s1( v 299'746 (0'0,299'746] local-lis/les=298/299 n=13 ec=71/71 lis/c=298/298 les/c/f=299/299/0 sis=298) [2,0,1]p2(0) r=1 lpr=298 luod=0'0 crt=299'746 mlcod 299'746 active mbc={} ps=[7c~1,97~1]] update_snap_map remove_oid 5:13f126c3:::smithi08477944-47:9c failed with -2 2024-03-30T12:26:18.011 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:17.950+0000 7f5d88fa4700 -1 osd.0 pg_epoch: 299 pg[5.8s1( v 299'748 (0'0,299'748] local-lis/les=298/299 n=12 ec=71/71 lis/c=298/298 les/c/f=299/299/0 sis=298) [2,0,1]p2(0) r=1 lpr=298 luod=0'0 crt=299'748 mlcod 299'748 active mbc={} ps=[7c~1,97~1,99~1]] update_snap_map remove_oid 5:13f126c3:::smithi08477944-47:9d failed with -2 2024-03-30T12:26:18.011 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:17.952+0000 7f5d88fa4700 -1 osd.0 pg_epoch: 299 pg[5.8s1( v 299'750 (0'0,299'750] local-lis/les=298/299 n=11 ec=71/71 lis/c=298/298 les/c/f=299/299/0 sis=298) [2,0,1]p2(0) r=1 lpr=298 luod=0'0 crt=299'750 mlcod 299'750 active mbc={} ps=[7c~1,97~1,99~1,9d~1]] update_snap_map remove_oid 5:142396d3:::smithi08477944-33:a8 failed with -2 2024-03-30T12:26:18.012 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:17.965+0000 7f5d86fa0700 -1 osd.0 pg_epoch: 299 pg[5.cs2( v 299'265 (0'0,299'265] local-lis/les=298/299 n=10 ec=71/71 lis/c=298/298 les/c/f=299/299/0 sis=298) [1,4,0]p1(0) r=2 lpr=298 luod=0'0 crt=299'265 mlcod 299'265 active mbc={}] update_snap_map remove_oid 5:379116f1:::smithi08477944-1:8f failed with -2 2024-03-30T12:26:18.012 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:17.970+0000 7f5d82f98700 -1 osd.0 pg_epoch: 299 pg[5.cs2( v 299'269 (0'0,299'269] local-lis/les=298/299 n=8 ec=71/71 lis/c=298/298 les/c/f=299/299/0 sis=298) [1,4,0]p1(0) r=2 lpr=298 luod=0'0 crt=299'269 mlcod 299'269 active mbc={} ps=[7c~1,97~1]] update_snap_map remove_oid 5:3d2430b2:::smithi08477944-35:9a failed with -2 2024-03-30T12:26:18.012 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:17.971+0000 7f5d82f98700 -1 osd.0 pg_epoch: 299 pg[5.cs2( v 299'271 (0'0,299'271] local-lis/les=298/299 n=7 ec=71/71 lis/c=298/298 les/c/f=299/299/0 sis=298) [1,4,0]p1(0) r=2 lpr=298 luod=0'0 crt=299'269 mlcod 299'269 active mbc={} ps=[7c~1,97~1]] update_snap_map remove_oid 5:379116f1:::smithi08477944-1:9a failed with -2 2024-03-30T12:26:18.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:17 smithi162 ceph-mon[83709]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T12:26:18.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:17 smithi162 ceph-mon[83709]: osd.0 [v2:172.21.15.84:6802/1465604312,v1:172.21.15.84:6803/1465604312] boot 2024-03-30T12:26:18.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:17 smithi162 ceph-mon[83709]: osdmap e298: 8 total, 8 up, 8 in 2024-03-30T12:26:18.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:17 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T12:26:18.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:17 smithi162 ceph-mon[83709]: Health check update: Degraded data redundancy: 119/555 objects degraded (21.441%), 15 pgs degraded (PG_DEGRADED) 2024-03-30T12:26:18.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:17 smithi162 ceph-mon[83709]: mgrmap e42: y(active, since 92s), standbys: x 2024-03-30T12:26:18.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:18.031+0000 7f5d8579d700 -1 osd.0 pg_epoch: 299 pg[5.7s2( v 299'630 (0'0,299'630] local-lis/les=298/299 n=18 ec=71/71 lis/c=298/298 les/c/f=299/299/0 sis=298) [5,1,0]p5(0) r=2 lpr=298 luod=0'0 crt=299'630 mlcod 299'630 active mbc={}] update_snap_map remove_oid 5:e3498042:::smithi08477944-22:8c failed with -2 2024-03-30T12:26:18.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:18.032+0000 7f5d81795700 -1 osd.0 pg_epoch: 299 pg[5.7s2( v 299'632 (0'0,299'632] local-lis/les=298/299 n=17 ec=71/71 lis/c=298/298 les/c/f=299/299/0 sis=298) [5,1,0]p5(0) r=2 lpr=298 luod=0'0 crt=299'630 lcod 299'630 mlcod 299'630 active mbc={}] update_snap_map remove_oid 5:ebb89a92:::smithi08477944-2:9e failed with -2 2024-03-30T12:26:18.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:18.034+0000 7f5d81795700 -1 osd.0 pg_epoch: 299 pg[5.7s2( v 299'634 (0'0,299'634] local-lis/les=298/299 n=16 ec=71/71 lis/c=298/298 les/c/f=299/299/0 sis=298) [5,1,0]p5(0) r=2 lpr=298 luod=0'0 crt=299'634 mlcod 299'634 active mbc={}] update_snap_map remove_oid 5:ef2e2d93:::smithi08477944-8:9b failed with -2 2024-03-30T12:26:18.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:18.037+0000 7f5d81795700 -1 osd.0 pg_epoch: 299 pg[5.7s2( v 299'638 (0'0,299'638] local-lis/les=298/299 n=13 ec=71/71 lis/c=298/298 les/c/f=299/299/0 sis=298) [5,1,0]p5(0) r=2 lpr=298 luod=0'0 crt=299'636 lcod 299'636 mlcod 299'636 active mbc={} ps=[7c~1]] update_snap_map remove_oid 5:e134969d:::smithi08477944-26:9a failed with -2 2024-03-30T12:26:18.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:18.038+0000 7f5d81795700 -1 osd.0 pg_epoch: 299 pg[5.7s2( v 299'640 (0'0,299'640] local-lis/les=298/299 n=12 ec=71/71 lis/c=298/298 les/c/f=299/299/0 sis=298) [5,1,0]p5(0) r=2 lpr=298 luod=0'0 crt=299'640 mlcod 299'640 active mbc={} ps=[7c~1]] update_snap_map remove_oid 5:e3498042:::smithi08477944-22:9a failed with -2 2024-03-30T12:26:18.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:18.042+0000 7f5d83799700 -1 osd.0 pg_epoch: 299 pg[5.bs1( v 299'479 (0'0,299'479] local-lis/les=298/299 n=8 ec=71/71 lis/c=298/298 les/c/f=299/299/0 sis=298) [2,0,5]p2(0) r=1 lpr=298 luod=0'0 crt=299'477 mlcod 299'477 active mbc={}] update_snap_map remove_oid 5:d6cd5686:::smithi08477944-31:8a failed with -2 2024-03-30T12:26:18.505 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:18.042+0000 7f5d8579d700 -1 osd.0 pg_epoch: 299 pg[5.7s2( v 299'644 (0'0,299'644] local-lis/les=298/299 n=11 ec=71/71 lis/c=298/298 les/c/f=299/299/0 sis=298) [5,1,0]p5(0) r=2 lpr=298 luod=0'0 crt=299'642 lcod 299'642 mlcod 299'642 active mbc={} ps=[7c~1,97~1,99~1]] update_snap_map remove_oid 5:ee7c920a:::smithi08477944-46:9d failed with -2 2024-03-30T12:26:18.505 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:18.045+0000 7f5d877a1700 -1 osd.0 pg_epoch: 299 pg[5.bs1( v 299'481 (0'0,299'481] local-lis/les=298/299 n=7 ec=71/71 lis/c=298/298 les/c/f=299/299/0 sis=298) [2,0,5]p2(0) r=1 lpr=298 luod=0'0 crt=299'481 mlcod 299'481 active mbc={} ps=[7c~1]] update_snap_map remove_oid 5:d0b42308:::smithi08477944-29:9a failed with -2 2024-03-30T12:26:18.758 INFO:tasks.rados.rados.0.smithi084.stdout:1119: done (6 left) 2024-03-30T12:26:18.758 INFO:tasks.rados.rados.0.smithi084.stdout:1120: done (5 left) 2024-03-30T12:26:18.758 INFO:tasks.rados.rados.0.smithi084.stdout:1121: done (4 left) 2024-03-30T12:26:18.758 INFO:tasks.rados.rados.0.smithi084.stdout:1122: done (3 left) 2024-03-30T12:26:18.758 INFO:tasks.rados.rados.0.smithi084.stdout:1123: done (2 left) 2024-03-30T12:26:18.758 INFO:tasks.rados.rados.0.smithi084.stdout:1124: done (1 left) 2024-03-30T12:26:18.758 INFO:tasks.rados.rados.0.smithi084.stdout:1125: done (0 left) 2024-03-30T12:26:18.758 INFO:tasks.rados.rados.0.smithi084.stdout:1126: read oid 31 snap 114 2024-03-30T12:26:18.758 INFO:tasks.rados.rados.0.smithi084.stdout:1126: expect deleted 2024-03-30T12:26:18.759 INFO:tasks.rados.rados.0.smithi084.stdout:1127: delete oid 4 current snap is 115 2024-03-30T12:26:18.762 INFO:tasks.rados.rados.0.smithi084.stdout:1126: done (1 left) 2024-03-30T12:26:18.762 INFO:tasks.rados.rados.0.smithi084.stdout:1127: done (0 left) 2024-03-30T12:26:18.762 INFO:tasks.rados.rados.0.smithi084.stdout:1128: snap_remove snap 97 2024-03-30T12:26:19.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:18 smithi084 ceph-mon[89279]: osdmap e299: 8 total, 8 up, 8 in 2024-03-30T12:26:19.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset b0=[]:{a0=[a0,9d],af=[af,ae,ad,ab,aa,a9,a8,a1],b0=[b0]} for object 5:aff7632d:::smithi08477944-23:9c 2024-03-30T12:26:19.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:19.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:18 smithi084 ceph-mon[89279]: pgmap v131: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 229 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 4.6 MiB/s wr, 28 op/s; 119/555 objects degraded (21.441%) 2024-03-30T12:26:19.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:18 smithi084 ceph-mon[91810]: osdmap e299: 8 total, 8 up, 8 in 2024-03-30T12:26:19.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset b0=[]:{a0=[a0,9d],af=[af,ae,ad,ab,aa,a9,a8,a1],b0=[b0]} for object 5:aff7632d:::smithi08477944-23:9c 2024-03-30T12:26:19.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:19.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:18 smithi084 ceph-mon[91810]: pgmap v131: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 229 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 4.6 MiB/s wr, 28 op/s; 119/555 objects degraded (21.441%) 2024-03-30T12:26:19.006 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:18.771+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:19.006 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:18.772+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b0=[]:{a0=[a0,9d],af=[af,ae,ad,ab,aa,a9,a8,a1],b0=[b0]} for object 5:aff7632d:::smithi08477944-23:9c 2024-03-30T12:26:19.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:18 smithi162 ceph-mon[83709]: osdmap e299: 8 total, 8 up, 8 in 2024-03-30T12:26:19.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset b0=[]:{a0=[a0,9d],af=[af,ae,ad,ab,aa,a9,a8,a1],b0=[b0]} for object 5:aff7632d:::smithi08477944-23:9c 2024-03-30T12:26:19.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:19.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:18 smithi162 ceph-mon[83709]: pgmap v131: 121 pgs: 15 active+undersized+degraded, 38 active+undersized, 68 active+clean; 229 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 4.6 MiB/s wr, 28 op/s; 119/555 objects degraded (21.441%) 2024-03-30T12:26:19.555 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:26:19] "GET /metrics HTTP/1.1" 200 36059 "" "Prometheus/2.43.0" 2024-03-30T12:26:19.767 INFO:tasks.rados.rados.0.smithi084.stdout:1128: done (0 left) 2024-03-30T12:26:19.767 INFO:tasks.rados.rados.0.smithi084.stdout:1129: read oid 34 snap -1 2024-03-30T12:26:19.768 INFO:tasks.rados.rados.0.smithi084.stdout:1129: expect (ObjNum 323 snap 108 seq_num 323) 2024-03-30T12:26:19.768 INFO:tasks.rados.rados.0.smithi084.stdout:1130: delete oid 33 current snap is 115 2024-03-30T12:26:19.777 INFO:tasks.rados.rados.0.smithi084.stdout:1130: done (1 left) 2024-03-30T12:26:19.777 INFO:tasks.rados.rados.0.smithi084.stdout:1131: snap_remove snap 114 2024-03-30T12:26:20.004 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:26:19.563+0000 7f1f562eb700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-03-30T12:26:20.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:19.780+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b0=[]:{a0=[a0,9d],af=[af,ae,ad,ab,aa,a9,a8,a1],b0=[b0]} for object 5:aff7632d:::smithi08477944-23:9c 2024-03-30T12:26:20.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:19.781+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[91810]: osdmap e300: 8 total, 8 up, 8 in 2024-03-30T12:26:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset b0=[]:{a0=[a0,9d],af=[af,ae,ad,ab,aa,a9,a8,a1],b0=[b0]} for object 5:aff7632d:::smithi08477944-23:9c 2024-03-30T12:26:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:26:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:26:20.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:20.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:26:20.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:20.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:20.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:20.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-30T12:26:20.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[91810]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-30T12:26:20.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[91810]: Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-03-30T12:26:20.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[89279]: osdmap e300: 8 total, 8 up, 8 in 2024-03-30T12:26:20.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:20.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset b0=[]:{a0=[a0,9d],af=[af,ae,ad,ab,aa,a9,a8,a1],b0=[b0]} for object 5:aff7632d:::smithi08477944-23:9c 2024-03-30T12:26:20.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:20.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:20.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:26:20.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:26:20.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:20.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:26:20.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:20.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:20.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:20.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-30T12:26:20.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[89279]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-30T12:26:20.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:19 smithi084 ceph-mon[89279]: Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-03-30T12:26:20.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:19 smithi162 ceph-mon[83709]: osdmap e300: 8 total, 8 up, 8 in 2024-03-30T12:26:20.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:20.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset b0=[]:{a0=[a0,9d],af=[af,ae,ad,ab,aa,a9,a8,a1],b0=[b0]} for object 5:aff7632d:::smithi08477944-23:9c 2024-03-30T12:26:20.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:19 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:20.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:19 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:20.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:19 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:26:20.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:19 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:26:20.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:19 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:20.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:19 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:26:20.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:19 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:20.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:19 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:19 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:19 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-30T12:26:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:19 smithi162 ceph-mon[83709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-30T12:26:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:19 smithi162 ceph-mon[83709]: Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-03-30T12:26:20.771 INFO:tasks.rados.rados.0.smithi084.stdout:1131: done (1 left) 2024-03-30T12:26:20.772 INFO:tasks.rados.rados.0.smithi084.stdout:1132: read oid 4 snap 110 2024-03-30T12:26:20.772 INFO:tasks.rados.rados.0.smithi084.stdout:1132: expect (ObjNum 320 snap 107 seq_num 320) 2024-03-30T12:26:20.772 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 115 2024-03-30T12:26:20.772 INFO:tasks.rados.rados.0.smithi084.stdout:1133: seq_num 364 ranges {3031040=499712,3530752=638976,4169728=163840} 2024-03-30T12:26:20.790 INFO:tasks.rados.rados.0.smithi084.stdout:1133: writing smithi08477944-35 from 3031040 to 3530752 tid 1 2024-03-30T12:26:20.794 INFO:tasks.rados.rados.0.smithi084.stdout:1133: writing smithi08477944-35 from 3530752 to 4169728 tid 2 2024-03-30T12:26:20.795 INFO:tasks.rados.rados.0.smithi084.stdout:1133: writing smithi08477944-35 from 4169728 to 4333568 tid 3 2024-03-30T12:26:20.795 INFO:tasks.rados.rados.0.smithi084.stdout:1134: snap_create 2024-03-30T12:26:20.795 INFO:tasks.rados.rados.0.smithi084.stdout:1129: expect (ObjNum 323 snap 108 seq_num 323) 2024-03-30T12:26:20.923 INFO:tasks.rados.rados.0.smithi084.stdout:1132: expect (ObjNum 320 snap 107 seq_num 320) 2024-03-30T12:26:20.938 INFO:tasks.rados.rados.0.smithi084.stdout:1133: finishing write tid 1 to smithi08477944-35 2024-03-30T12:26:20.938 INFO:tasks.rados.rados.0.smithi084.stdout:1133: finishing write tid 2 to smithi08477944-35 2024-03-30T12:26:20.938 INFO:tasks.rados.rados.0.smithi084.stdout:1133: finishing write tid 3 to smithi08477944-35 2024-03-30T12:26:20.938 INFO:tasks.rados.rados.0.smithi084.stdout:1133: finishing write tid 4 to smithi08477944-35 2024-03-30T12:26:20.938 INFO:tasks.rados.rados.0.smithi084.stdout:1133: finishing write tid 5 to smithi08477944-35 2024-03-30T12:26:20.938 INFO:tasks.rados.rados.0.smithi084.stdout:1133: oid 35 updating version 0 to 484 2024-03-30T12:26:20.938 INFO:tasks.rados.rados.0.smithi084.stdout:1133: oid 35 version 484 is already newer than 481 2024-03-30T12:26:20.938 INFO:tasks.rados.rados.0.smithi084.stdout:1133: oid 35 version 484 is already newer than 483 2024-03-30T12:26:20.939 INFO:tasks.rados.rados.0.smithi084.stdout:1133: oid 35 version 484 is already newer than 482 2024-03-30T12:26:20.939 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 484 (ObjNum 364 snap 115 seq_num 364) dirty exists 2024-03-30T12:26:20.939 INFO:tasks.rados.rados.0.smithi084.stdout:1133: left oid 35 (ObjNum 364 snap 115 seq_num 364) 2024-03-30T12:26:21.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:20.789+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:21.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:20.790+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:21.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:20 smithi084 ceph-mon[91810]: osdmap e301: 8 total, 8 up, 8 in 2024-03-30T12:26:21.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset b0=[]:{a0=[a0,9d],af=[af,ae,ad,ab,aa,a9,a8,a1],b0=[b0]} for object 5:aff7632d:::smithi08477944-23:9c 2024-03-30T12:26:21.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:21.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:20 smithi084 ceph-mon[91810]: pgmap v134: 121 pgs: 4 active+undersized+degraded, 11 active+undersized, 106 active+clean; 172 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 4.0 MiB/s rd, 604 KiB/s wr, 7 op/s; 31/414 objects degraded (7.488%); 14 MiB/s, 5 objects/s recovering 2024-03-30T12:26:21.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:20 smithi084 ceph-mon[89279]: osdmap e301: 8 total, 8 up, 8 in 2024-03-30T12:26:21.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset b0=[]:{a0=[a0,9d],af=[af,ae,ad,ab,aa,a9,a8,a1],b0=[b0]} for object 5:aff7632d:::smithi08477944-23:9c 2024-03-30T12:26:21.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:21.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:20 smithi084 ceph-mon[89279]: pgmap v134: 121 pgs: 4 active+undersized+degraded, 11 active+undersized, 106 active+clean; 172 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 4.0 MiB/s rd, 604 KiB/s wr, 7 op/s; 31/414 objects degraded (7.488%); 14 MiB/s, 5 objects/s recovering 2024-03-30T12:26:21.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:20 smithi162 ceph-mon[83709]: osdmap e301: 8 total, 8 up, 8 in 2024-03-30T12:26:21.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset b0=[]:{a0=[a0,9d],af=[af,ae,ad,ab,aa,a9,a8,a1],b0=[b0]} for object 5:aff7632d:::smithi08477944-23:9c 2024-03-30T12:26:21.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:21.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:20 smithi162 ceph-mon[83709]: pgmap v134: 121 pgs: 4 active+undersized+degraded, 11 active+undersized, 106 active+clean; 172 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 4.0 MiB/s rd, 604 KiB/s wr, 7 op/s; 31/414 objects degraded (7.488%); 14 MiB/s, 5 objects/s recovering 2024-03-30T12:26:21.446 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-03-30T12:26:21.767 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T12:26:21.767 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (5m) 6s ago 6m 25.2M - 0.25.0 c8568f914cd2 6765ce007f39 2024-03-30T12:26:21.767 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi162 *:3000 running (6m) 52s ago 6m 91.0M - 9.4.7 954c08fa6188 ff2ec7518619 2024-03-30T12:26:21.767 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (7m) 6s ago 7m 14.7M - 18.2.2-1051-gf14b5682 c8fb09e16a7d a9c2e74ca2a3 2024-03-30T12:26:21.767 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi162 running (7m) 52s ago 7m 19.7M - 18.2.2-1051-gf14b5682 c8fb09e16a7d ee1770ef5edd 2024-03-30T12:26:21.767 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi162 *:8443,9283,8765 running (2m) 52s ago 10m 449M - 19.0.0-1864-g5dc2ea30 548196a1a838 eec968f3fcc6 2024-03-30T12:26:21.767 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (2m) 6s ago 12m 507M - 19.0.0-1864-g5dc2ea30 548196a1a838 9a2aba19dffc 2024-03-30T12:26:21.767 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (107s) 6s ago 12m 47.4M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 a0811f2ae47d 2024-03-30T12:26:21.767 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi162 running (62s) 52s ago 11m 24.9M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 149ae6649e0c 2024-03-30T12:26:21.767 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (81s) 6s ago 11m 38.3M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 f79eca93cddd 2024-03-30T12:26:21.767 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (6m) 6s ago 6m 16.9M - 1.5.0 0da6a335fe13 66844bed39e8 2024-03-30T12:26:21.767 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi162 *:9100 running (5m) 52s ago 5m 15.5M - 1.5.0 0da6a335fe13 3d6e28b2348d 2024-03-30T12:26:21.767 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (11s) 6s ago 10m 12.4M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 c91eea4f8484 2024-03-30T12:26:21.768 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (10m) 6s ago 10m 212M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 3b30b0ea0e32 2024-03-30T12:26:21.768 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (9m) 6s ago 9m 232M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d eb2412618811 2024-03-30T12:26:21.768 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (9m) 6s ago 9m 118M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 8eaf6dc73c25 2024-03-30T12:26:21.768 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi162 running (9m) 52s ago 8m 195M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 1f52e827b91a 2024-03-30T12:26:21.768 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi162 running (8m) 52s ago 8m 188M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 7ba250d154aa 2024-03-30T12:26:21.768 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi162 running (8m) 52s ago 8m 108M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 656a733e8b7a 2024-03-30T12:26:21.768 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi162 running (7m) 52s ago 7m 127M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d e3246b3bc88b 2024-03-30T12:26:21.768 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi162 *:9095 running (2m) 52s ago 6m 51.4M - 2.43.0 a07b618ecd1d bd7d323e4b47 2024-03-30T12:26:21.775 INFO:tasks.rados.rados.0.smithi084.stdout:1129: done (3 left) 2024-03-30T12:26:21.775 INFO:tasks.rados.rados.0.smithi084.stdout:1132: done (2 left) 2024-03-30T12:26:21.775 INFO:tasks.rados.rados.0.smithi084.stdout:1133: done (1 left) 2024-03-30T12:26:21.775 INFO:tasks.rados.rados.0.smithi084.stdout:1134: done (0 left) 2024-03-30T12:26:21.775 INFO:tasks.rados.rados.0.smithi084.stdout:1135: read oid 39 snap -1 2024-03-30T12:26:21.775 INFO:tasks.rados.rados.0.smithi084.stdout:1135: expect (ObjNum 325 snap 110 seq_num 325) 2024-03-30T12:26:21.775 INFO:tasks.rados.rados.0.smithi084.stdout:1136: copy_from oid 13 from oid 4 current snap is 116 2024-03-30T12:26:21.775 INFO:tasks.rados.rados.0.smithi084.stdout:1137: setattr oid 47 current snap is 116 2024-03-30T12:26:21.776 INFO:tasks.rados.rados.0.smithi084.stdout:1136: finishing copy_from to smithi08477944-13 2024-03-30T12:26:21.776 INFO:tasks.rados.rados.0.smithi084.stdout:1136: got expected ENOENT (src dne) 2024-03-30T12:26:21.776 INFO:tasks.rados.rados.0.smithi084.stdout:1136: finishing copy_from racing read to smithi08477944-13 2024-03-30T12:26:21.777 INFO:tasks.rados.rados.0.smithi084.stdout:1136: done (2 left) 2024-03-30T12:26:21.777 INFO:tasks.rados.rados.0.smithi084.stdout:1138: copy_from oid 46 from oid 9 current snap is 116 2024-03-30T12:26:21.777 INFO:tasks.rados.rados.0.smithi084.stdout:1139: snap_create 2024-03-30T12:26:21.777 INFO:tasks.rados.rados.0.smithi084.stdout:1138: finishing copy_from to smithi08477944-46 2024-03-30T12:26:21.778 INFO:tasks.rados.rados.0.smithi084.stdout:1138: got expected ENOENT (src dne) 2024-03-30T12:26:21.778 INFO:tasks.rados.rados.0.smithi084.stdout:1138: finishing copy_from racing read to smithi08477944-46 2024-03-30T12:26:21.782 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 772 (ObjNum 346 snap 113 seq_num 346) dirty exists 2024-03-30T12:26:21.784 INFO:tasks.rados.rados.0.smithi084.stdout:1135: expect (ObjNum 325 snap 110 seq_num 325) 2024-03-30T12:26:22.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:21 smithi084 ceph-mon[91810]: osdmap e302: 8 total, 8 up, 8 in 2024-03-30T12:26:22.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:22.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:22.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:21 smithi084 ceph-mon[91810]: from='client.34209 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:26:22.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:21 smithi084 ceph-mon[89279]: osdmap e302: 8 total, 8 up, 8 in 2024-03-30T12:26:22.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:22.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:22.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:21 smithi084 ceph-mon[89279]: from='client.34209 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:26:22.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:21.786+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:22.005 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:21.791+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:22.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:21 smithi162 ceph-mon[83709]: osdmap e302: 8 total, 8 up, 8 in 2024-03-30T12:26:22.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:22.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:22.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:21 smithi162 ceph-mon[83709]: from='client.34209 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:26:22.161 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-30T12:26:22.162 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-03-30T12:26:22.162 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 3 2024-03-30T12:26:22.162 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:26:22.162 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-03-30T12:26:22.162 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 2 2024-03-30T12:26:22.162 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:26:22.162 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-03-30T12:26:22.162 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 7, 2024-03-30T12:26:22.162 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 1 2024-03-30T12:26:22.162 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:26:22.162 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-03-30T12:26:22.162 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 2 2024-03-30T12:26:22.162 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:26:22.163 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-03-30T12:26:22.163 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 9, 2024-03-30T12:26:22.163 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 6 2024-03-30T12:26:22.163 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-30T12:26:22.163 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-30T12:26:22.780 INFO:tasks.rados.rados.0.smithi084.stdout:1135: done (3 left) 2024-03-30T12:26:22.780 INFO:tasks.rados.rados.0.smithi084.stdout:1137: done (2 left) 2024-03-30T12:26:22.780 INFO:tasks.rados.rados.0.smithi084.stdout:1138: done (1 left) 2024-03-30T12:26:22.780 INFO:tasks.rados.rados.0.smithi084.stdout:1139: done (0 left) 2024-03-30T12:26:22.780 INFO:tasks.rados.rados.0.smithi084.stdout:1140: snap_remove snap 110 2024-03-30T12:26:23.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:22 smithi162 ceph-mon[83709]: from='client.44150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:26:23.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:22 smithi162 ceph-mon[83709]: osdmap e303: 8 total, 8 up, 8 in 2024-03-30T12:26:23.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:23.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:23.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:22 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/3588855802' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:23.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:22 smithi162 ceph-mon[83709]: pgmap v137: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 165 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 4.0 MiB/s rd, 884 KiB/s wr, 12 op/s; 17 MiB/s, 7 objects/s recovering 2024-03-30T12:26:23.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:22 smithi084 ceph-mon[91810]: from='client.44150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:26:23.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:22 smithi084 ceph-mon[91810]: osdmap e303: 8 total, 8 up, 8 in 2024-03-30T12:26:23.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:23.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:23.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:22 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/3588855802' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:23.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:22 smithi084 ceph-mon[91810]: pgmap v137: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 165 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 4.0 MiB/s rd, 884 KiB/s wr, 12 op/s; 17 MiB/s, 7 objects/s recovering 2024-03-30T12:26:23.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:26:22.780+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 2 pgs snaptrim_error (PG_DAMAGED) 2024-03-30T12:26:23.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:22 smithi084 ceph-mon[89279]: from='client.44150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:26:23.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:22 smithi084 ceph-mon[89279]: osdmap e303: 8 total, 8 up, 8 in 2024-03-30T12:26:23.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:23.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:23.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:22 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/3588855802' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:23.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:22 smithi084 ceph-mon[89279]: pgmap v137: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 165 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 4.0 MiB/s rd, 884 KiB/s wr, 12 op/s; 17 MiB/s, 7 objects/s recovering 2024-03-30T12:26:23.793 INFO:tasks.rados.rados.0.smithi084.stdout:1140: done (0 left) 2024-03-30T12:26:23.794 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 117 2024-03-30T12:26:23.795 INFO:tasks.rados.rados.0.smithi084.stdout:1141: seq_num 365 ranges {1794048=516096,2310144=573440,2883584=229376} 2024-03-30T12:26:23.801 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:23.556+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:23.802 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:23.556+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:23.802 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:23 smithi084 ceph-mon[91810]: Health check failed: Possible data damage: 2 pgs snaptrim_error (PG_DAMAGED) 2024-03-30T12:26:23.802 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:23 smithi084 ceph-mon[91810]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/414 objects degraded (7.488%), 4 pgs degraded) 2024-03-30T12:26:23.802 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:23 smithi084 ceph-mon[91810]: osdmap e304: 8 total, 8 up, 8 in 2024-03-30T12:26:23.802 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:23.802 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:23.802 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:23 smithi084 ceph-mon[89279]: Health check failed: Possible data damage: 2 pgs snaptrim_error (PG_DAMAGED) 2024-03-30T12:26:23.803 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:23 smithi084 ceph-mon[89279]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/414 objects degraded (7.488%), 4 pgs degraded) 2024-03-30T12:26:23.803 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:23 smithi084 ceph-mon[89279]: osdmap e304: 8 total, 8 up, 8 in 2024-03-30T12:26:23.803 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:23.803 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:23.805 INFO:tasks.rados.rados.0.smithi084.stdout:1141: writing smithi08477944-8 from 1794048 to 2310144 tid 1 2024-03-30T12:26:23.809 INFO:tasks.rados.rados.0.smithi084.stdout:1141: writing smithi08477944-8 from 2310144 to 2883584 tid 2 2024-03-30T12:26:23.811 INFO:tasks.rados.rados.0.smithi084.stdout:1141: writing smithi08477944-8 from 2883584 to 3112960 tid 3 2024-03-30T12:26:23.811 INFO:tasks.rados.rados.0.smithi084.stdout:1142: rollback oid 31 current snap is 117 2024-03-30T12:26:23.811 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 31 to 113 2024-03-30T12:26:23.811 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 117 2024-03-30T12:26:23.811 INFO:tasks.rados.rados.0.smithi084.stdout:1143: seq_num 366 ranges {4120576=532480,4653056=458752,5111808=344064} 2024-03-30T12:26:23.838 INFO:tasks.rados.rados.0.smithi084.stdout:1143: writing smithi08477944-20 from 4120576 to 4653056 tid 1 2024-03-30T12:26:23.839 INFO:tasks.rados.rados.0.smithi084.stdout:1143: writing smithi08477944-20 from 4653056 to 5111808 tid 2 2024-03-30T12:26:23.843 INFO:tasks.rados.rados.0.smithi084.stdout:1143: writing smithi08477944-20 from 5111808 to 5455872 tid 3 2024-03-30T12:26:23.843 INFO:tasks.rados.rados.0.smithi084.stdout:1144: read oid 41 snap -1 2024-03-30T12:26:23.843 INFO:tasks.rados.rados.0.smithi084.stdout:1144: expect (ObjNum 354 snap 113 seq_num 354) 2024-03-30T12:26:23.843 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 117 2024-03-30T12:26:23.843 INFO:tasks.rados.rados.0.smithi084.stdout:1142: finishing rollback tid 1 to smithi08477944-31 2024-03-30T12:26:23.843 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 0 (ObjNum 81 snap 0 seq_num 1482381410) dirty dne 2024-03-30T12:26:23.843 INFO:tasks.rados.rados.0.smithi084.stdout:1141: finishing write tid 1 to smithi08477944-8 2024-03-30T12:26:23.843 INFO:tasks.rados.rados.0.smithi084.stdout:1145: seq_num 367 ranges {4120576=548864,4669440=737280,5406720=65536} 2024-03-30T12:26:23.868 INFO:tasks.rados.rados.0.smithi084.stdout:1145: writing smithi08477944-50 from 4120576 to 4669440 tid 1 2024-03-30T12:26:23.871 INFO:tasks.rados.rados.0.smithi084.stdout:1145: writing smithi08477944-50 from 4669440 to 5406720 tid 2 2024-03-30T12:26:23.873 INFO:tasks.rados.rados.0.smithi084.stdout:1145: writing smithi08477944-50 from 5406720 to 5472256 tid 3 2024-03-30T12:26:23.873 INFO:tasks.rados.rados.0.smithi084.stdout:1142: done (4 left) 2024-03-30T12:26:23.873 INFO:tasks.rados.rados.0.smithi084.stdout:1146: rollback oid 13 current snap is 117 2024-03-30T12:26:23.873 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 13 to 115 2024-03-30T12:26:23.873 INFO:tasks.rados.rados.0.smithi084.stdout:1141: finishing write tid 2 to smithi08477944-8 2024-03-30T12:26:23.874 INFO:tasks.rados.rados.0.smithi084.stdout:1141: finishing write tid 3 to smithi08477944-8 2024-03-30T12:26:23.874 INFO:tasks.rados.rados.0.smithi084.stdout:1141: finishing write tid 4 to smithi08477944-8 2024-03-30T12:26:23.874 INFO:tasks.rados.rados.0.smithi084.stdout:1141: finishing write tid 5 to smithi08477944-8 2024-03-30T12:26:23.874 INFO:tasks.rados.rados.0.smithi084.stdout:1141: oid 8 updating version 0 to 673 2024-03-30T12:26:23.874 INFO:tasks.rados.rados.0.smithi084.stdout:1141: oid 8 updating version 673 to 675 2024-03-30T12:26:23.874 INFO:tasks.rados.rados.0.smithi084.stdout:1141: oid 8 version 675 is already newer than 674 2024-03-30T12:26:23.874 INFO:tasks.rados.rados.0.smithi084.stdout:1141: oid 8 updating version 675 to 676 2024-03-30T12:26:23.874 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 676 (ObjNum 365 snap 117 seq_num 365) dirty exists 2024-03-30T12:26:23.874 INFO:tasks.rados.rados.0.smithi084.stdout:1141: left oid 8 (ObjNum 365 snap 117 seq_num 365) 2024-03-30T12:26:23.874 INFO:tasks.rados.rados.0.smithi084.stdout:1143: finishing write tid 1 to smithi08477944-20 2024-03-30T12:26:23.874 INFO:tasks.rados.rados.0.smithi084.stdout:1143: finishing write tid 2 to smithi08477944-20 2024-03-30T12:26:23.874 INFO:tasks.rados.rados.0.smithi084.stdout:1143: finishing write tid 3 to smithi08477944-20 2024-03-30T12:26:23.874 INFO:tasks.rados.rados.0.smithi084.stdout:1141: done (4 left) 2024-03-30T12:26:23.875 INFO:tasks.rados.rados.0.smithi084.stdout:1147: read oid 44 snap -1 2024-03-30T12:26:23.875 INFO:tasks.rados.rados.0.smithi084.stdout:1147: expect deleted 2024-03-30T12:26:23.875 INFO:tasks.rados.rados.0.smithi084.stdout:1148: rollback oid 43 current snap is 117 2024-03-30T12:26:23.875 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 43 to 113 2024-03-30T12:26:23.875 INFO:tasks.rados.rados.0.smithi084.stdout:1143: finishing write tid 4 to smithi08477944-20 2024-03-30T12:26:23.875 INFO:tasks.rados.rados.0.smithi084.stdout:1143: finishing write tid 5 to smithi08477944-20 2024-03-30T12:26:23.875 INFO:tasks.rados.rados.0.smithi084.stdout:1143: oid 20 updating version 0 to 783 2024-03-30T12:26:23.875 INFO:tasks.rados.rados.0.smithi084.stdout:1143: oid 20 version 783 is already newer than 782 2024-03-30T12:26:23.875 INFO:tasks.rados.rados.0.smithi084.stdout:1143: oid 20 version 783 is already newer than 781 2024-03-30T12:26:23.875 INFO:tasks.rados.rados.0.smithi084.stdout:1143: oid 20 version 783 is already newer than 780 2024-03-30T12:26:23.875 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 783 (ObjNum 366 snap 117 seq_num 366) dirty exists 2024-03-30T12:26:23.875 INFO:tasks.rados.rados.0.smithi084.stdout:1143: left oid 20 (ObjNum 366 snap 117 seq_num 366) 2024-03-30T12:26:23.875 INFO:tasks.rados.rados.0.smithi084.stdout:1144: expect (ObjNum 354 snap 113 seq_num 354) 2024-03-30T12:26:24.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:23 smithi162 ceph-mon[83709]: Health check failed: Possible data damage: 2 pgs snaptrim_error (PG_DAMAGED) 2024-03-30T12:26:24.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:23 smithi162 ceph-mon[83709]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/414 objects degraded (7.488%), 4 pgs degraded) 2024-03-30T12:26:24.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:23 smithi162 ceph-mon[83709]: osdmap e304: 8 total, 8 up, 8 in 2024-03-30T12:26:24.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:24.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:24.131 INFO:tasks.rados.rados.0.smithi084.stdout:1143: done (5 left) 2024-03-30T12:26:24.131 INFO:tasks.rados.rados.0.smithi084.stdout:1144: done (4 left) 2024-03-30T12:26:24.131 INFO:tasks.rados.rados.0.smithi084.stdout:1149: read oid 6 snap -1 2024-03-30T12:26:24.131 INFO:tasks.rados.rados.0.smithi084.stdout:1149: expect (ObjNum 218 snap 64 seq_num 218) 2024-03-30T12:26:24.131 INFO:tasks.rados.rados.0.smithi084.stdout:1150: delete oid 45 current snap is 117 2024-03-30T12:26:24.131 INFO:tasks.rados.rados.0.smithi084.stdout:1146: finishing rollback tid 1 to smithi08477944-13 2024-03-30T12:26:24.131 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 0 (ObjNum 289 snap 0 seq_num 0) dirty dne 2024-03-30T12:26:24.132 INFO:tasks.rados.rados.0.smithi084.stdout:1145: finishing write tid 1 to smithi08477944-50 2024-03-30T12:26:24.132 INFO:tasks.rados.rados.0.smithi084.stdout:1145: finishing write tid 2 to smithi08477944-50 2024-03-30T12:26:24.132 INFO:tasks.rados.rados.0.smithi084.stdout:1145: finishing write tid 3 to smithi08477944-50 2024-03-30T12:26:24.132 INFO:tasks.rados.rados.0.smithi084.stdout:1148: finishing rollback tid 0 to smithi08477944-43 2024-03-30T12:26:24.132 INFO:tasks.rados.rados.0.smithi084.stdout:1145: finishing write tid 4 to smithi08477944-50 2024-03-30T12:26:24.132 INFO:tasks.rados.rados.0.smithi084.stdout:1148: finishing rollback tid 1 to smithi08477944-43 2024-03-30T12:26:24.132 INFO:tasks.rados.rados.0.smithi084.stdout:1148: finishing rollback tid 2 to smithi08477944-43 2024-03-30T12:26:24.132 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 548 (ObjNum 280 snap 90 seq_num 280) dirty exists 2024-03-30T12:26:24.132 INFO:tasks.rados.rados.0.smithi084.stdout:1145: finishing write tid 5 to smithi08477944-50 2024-03-30T12:26:24.132 INFO:tasks.rados.rados.0.smithi084.stdout:1145: oid 50 updating version 0 to 762 2024-03-30T12:26:24.132 INFO:tasks.rados.rados.0.smithi084.stdout:1145: oid 50 version 762 is already newer than 760 2024-03-30T12:26:24.132 INFO:tasks.rados.rados.0.smithi084.stdout:1145: oid 50 version 762 is already newer than 761 2024-03-30T12:26:24.132 INFO:tasks.rados.rados.0.smithi084.stdout:1145: oid 50 updating version 762 to 763 2024-03-30T12:26:24.132 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 763 (ObjNum 367 snap 117 seq_num 367) dirty exists 2024-03-30T12:26:24.132 INFO:tasks.rados.rados.0.smithi084.stdout:1145: left oid 50 (ObjNum 367 snap 117 seq_num 367) 2024-03-30T12:26:24.134 INFO:tasks.rados.rados.0.smithi084.stdout:1145: done (5 left) 2024-03-30T12:26:24.134 INFO:tasks.rados.rados.0.smithi084.stdout:1146: done (4 left) 2024-03-30T12:26:24.134 INFO:tasks.rados.rados.0.smithi084.stdout:1147: done (3 left) 2024-03-30T12:26:24.134 INFO:tasks.rados.rados.0.smithi084.stdout:1148: done (2 left) 2024-03-30T12:26:24.134 INFO:tasks.rados.rados.0.smithi084.stdout:1150: done (1 left) 2024-03-30T12:26:24.134 INFO:tasks.rados.rados.0.smithi084.stdout:1151: rollback oid 3 current snap is 117 2024-03-30T12:26:24.135 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 3 to 113 2024-03-30T12:26:24.135 INFO:tasks.rados.rados.0.smithi084.stdout:1152: read oid 34 snap 116 2024-03-30T12:26:24.135 INFO:tasks.rados.rados.0.smithi084.stdout:1152: expect (ObjNum 323 snap 108 seq_num 323) 2024-03-30T12:26:24.135 INFO:tasks.rados.rados.0.smithi084.stdout:1153: read oid 24 snap -1 2024-03-30T12:26:24.135 INFO:tasks.rados.rados.0.smithi084.stdout:1153: expect (ObjNum 286 snap 92 seq_num 286) 2024-03-30T12:26:24.135 INFO:tasks.rados.rados.0.smithi084.stdout:1154: rollback oid 7 current snap is 117 2024-03-30T12:26:24.135 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 7 to 98 2024-03-30T12:26:24.135 INFO:tasks.rados.rados.0.smithi084.stdout:1155: delete oid 4 current snap is 117 2024-03-30T12:26:24.136 INFO:tasks.rados.rados.0.smithi084.stdout:1154: finishing rollback tid 1 to smithi08477944-7 2024-03-30T12:26:24.136 INFO:tasks.rados.rados.0.smithi084.stdout:1154: finishing rollback tid 2 to smithi08477944-7 2024-03-30T12:26:24.136 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 785 (ObjNum 259 snap 80 seq_num 259) dirty exists 2024-03-30T12:26:24.137 INFO:tasks.rados.rados.0.smithi084.stdout:1154: done (5 left) 2024-03-30T12:26:24.137 INFO:tasks.rados.rados.0.smithi084.stdout:1155: done (4 left) 2024-03-30T12:26:24.138 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 117 2024-03-30T12:26:24.138 INFO:tasks.rados.rados.0.smithi084.stdout:1156: seq_num 370 ranges {1155072=606208,1761280=794624,2555904=8192} 2024-03-30T12:26:24.147 INFO:tasks.rados.rados.0.smithi084.stdout:1156: writing smithi08477944-12 from 1155072 to 1761280 tid 1 2024-03-30T12:26:24.152 INFO:tasks.rados.rados.0.smithi084.stdout:1156: writing smithi08477944-12 from 1761280 to 2555904 tid 2 2024-03-30T12:26:24.152 INFO:tasks.rados.rados.0.smithi084.stdout:1156: writing smithi08477944-12 from 2555904 to 2564096 tid 3 2024-03-30T12:26:24.152 INFO:tasks.rados.rados.0.smithi084.stdout:1157: copy_from oid 28 from oid 42 current snap is 117 2024-03-30T12:26:24.152 INFO:tasks.rados.rados.0.smithi084.stdout:1149: expect (ObjNum 218 snap 64 seq_num 218) 2024-03-30T12:26:24.188 INFO:tasks.rados.rados.0.smithi084.stdout:1151: finishing rollback tid 1 to smithi08477944-3 2024-03-30T12:26:24.188 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 661 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-03-30T12:26:24.188 INFO:tasks.rados.rados.0.smithi084.stdout:1152: expect (ObjNum 323 snap 108 seq_num 323) 2024-03-30T12:26:24.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:23.807+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:24.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:23.810+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:24.308 INFO:tasks.rados.rados.0.smithi084.stdout:1156: finishing write tid 1 to smithi08477944-12 2024-03-30T12:26:24.308 INFO:tasks.rados.rados.0.smithi084.stdout:1156: finishing write tid 2 to smithi08477944-12 2024-03-30T12:26:24.308 INFO:tasks.rados.rados.0.smithi084.stdout:1156: finishing write tid 3 to smithi08477944-12 2024-03-30T12:26:24.308 INFO:tasks.rados.rados.0.smithi084.stdout:1156: finishing write tid 4 to smithi08477944-12 2024-03-30T12:26:24.308 INFO:tasks.rados.rados.0.smithi084.stdout:1156: finishing write tid 5 to smithi08477944-12 2024-03-30T12:26:24.308 INFO:tasks.rados.rados.0.smithi084.stdout:1156: oid 12 updating version 0 to 431 2024-03-30T12:26:24.308 INFO:tasks.rados.rados.0.smithi084.stdout:1156: oid 12 version 431 is already newer than 430 2024-03-30T12:26:24.309 INFO:tasks.rados.rados.0.smithi084.stdout:1156: oid 12 version 431 is already newer than 429 2024-03-30T12:26:24.309 INFO:tasks.rados.rados.0.smithi084.stdout:1156: oid 12 version 431 is already newer than 428 2024-03-30T12:26:24.309 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 431 (ObjNum 370 snap 117 seq_num 370) dirty exists 2024-03-30T12:26:24.309 INFO:tasks.rados.rados.0.smithi084.stdout:1156: left oid 12 (ObjNum 370 snap 117 seq_num 370) 2024-03-30T12:26:24.309 INFO:tasks.rados.rados.0.smithi084.stdout:1157: finishing copy_from racing read to smithi08477944-28 2024-03-30T12:26:24.309 INFO:tasks.rados.rados.0.smithi084.stdout:1157: finishing copy_from to smithi08477944-28 2024-03-30T12:26:24.309 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 631 (ObjNum 205 snap 62 seq_num 205) dirty exists 2024-03-30T12:26:24.309 INFO:tasks.rados.rados.0.smithi084.stdout:1153: expect (ObjNum 286 snap 92 seq_num 286) 2024-03-30T12:26:24.634 INFO:tasks.rados.rados.0.smithi084.stdout:1149: done (5 left) 2024-03-30T12:26:24.634 INFO:tasks.rados.rados.0.smithi084.stdout:1151: done (4 left) 2024-03-30T12:26:24.634 INFO:tasks.rados.rados.0.smithi084.stdout:1152: done (3 left) 2024-03-30T12:26:24.635 INFO:tasks.rados.rados.0.smithi084.stdout:1153: done (2 left) 2024-03-30T12:26:24.635 INFO:tasks.rados.rados.0.smithi084.stdout:1156: done (1 left) 2024-03-30T12:26:24.635 INFO:tasks.rados.rados.0.smithi084.stdout:1157: done (0 left) 2024-03-30T12:26:24.635 INFO:tasks.rados.rados.0.smithi084.stdout:1158: snap_remove snap 115 2024-03-30T12:26:24.651 INFO:tasks.rados.rados.0.smithi084.stdout:1158: done (0 left) 2024-03-30T12:26:24.651 INFO:tasks.rados.rados.0.smithi084.stdout:1159: copy_from oid 32 from oid 37 current snap is 117 2024-03-30T12:26:24.651 INFO:tasks.rados.rados.0.smithi084.stdout:1160: copy_from oid 7 from oid 48 current snap is 117 2024-03-30T12:26:24.651 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 27 current snap is 117 2024-03-30T12:26:24.651 INFO:tasks.rados.rados.0.smithi084.stdout:1161: seq_num 371 ranges {4284416=622592,4907008=679936,5586944=122880} 2024-03-30T12:26:24.679 INFO:tasks.rados.rados.0.smithi084.stdout:1161: writing smithi08477944-27 from 4284416 to 4907008 tid 1 2024-03-30T12:26:24.682 INFO:tasks.rados.rados.0.smithi084.stdout:1161: writing smithi08477944-27 from 4907008 to 5586944 tid 2 2024-03-30T12:26:24.683 INFO:tasks.rados.rados.0.smithi084.stdout:1161: writing smithi08477944-27 from 5586944 to 5709824 tid 3 2024-03-30T12:26:24.683 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 31 current snap is 117 2024-03-30T12:26:24.683 INFO:tasks.rados.rados.0.smithi084.stdout:1159: finishing copy_from racing read to smithi08477944-32 2024-03-30T12:26:24.683 INFO:tasks.rados.rados.0.smithi084.stdout:1162: seq_num 372 ranges {0=638976,638976=565248,1204224=237568} 2024-03-30T12:26:24.687 INFO:tasks.rados.rados.0.smithi084.stdout:1162: writing smithi08477944-31 from 0 to 638976 tid 1 2024-03-30T12:26:24.690 INFO:tasks.rados.rados.0.smithi084.stdout:1162: writing smithi08477944-31 from 638976 to 1204224 tid 2 2024-03-30T12:26:24.692 INFO:tasks.rados.rados.0.smithi084.stdout:1162: writing smithi08477944-31 from 1204224 to 1441792 tid 3 2024-03-30T12:26:24.692 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 30 current snap is 117 2024-03-30T12:26:24.692 INFO:tasks.rados.rados.0.smithi084.stdout:1159: finishing copy_from to smithi08477944-32 2024-03-30T12:26:24.692 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 446 (ObjNum 355 snap 113 seq_num 355) dirty exists 2024-03-30T12:26:24.692 INFO:tasks.rados.rados.0.smithi084.stdout:1160: finishing copy_from racing read to smithi08477944-7 2024-03-30T12:26:24.692 INFO:tasks.rados.rados.0.smithi084.stdout:1163: seq_num 373 ranges {0=655360,655360=499712,1155072=303104} 2024-03-30T12:26:24.695 INFO:tasks.rados.rados.0.smithi084.stdout:1163: writing smithi08477944-30 from 0 to 655360 tid 1 2024-03-30T12:26:24.698 INFO:tasks.rados.rados.0.smithi084.stdout:1163: writing smithi08477944-30 from 655360 to 1155072 tid 2 2024-03-30T12:26:24.701 INFO:tasks.rados.rados.0.smithi084.stdout:1163: writing smithi08477944-30 from 1155072 to 1458176 tid 3 2024-03-30T12:26:24.701 INFO:tasks.rados.rados.0.smithi084.stdout:1159: done (4 left) 2024-03-30T12:26:24.701 INFO:tasks.rados.rados.0.smithi084.stdout:1164: rmattr oid 49 current snap is 117 2024-03-30T12:26:24.701 INFO:tasks.rados.rados.0.smithi084.stdout:1164: done (4 left) 2024-03-30T12:26:24.701 INFO:tasks.rados.rados.0.smithi084.stdout:1165: delete oid 15 current snap is 117 2024-03-30T12:26:24.701 INFO:tasks.rados.rados.0.smithi084.stdout:1160: finishing copy_from to smithi08477944-7 2024-03-30T12:26:24.701 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 337 (ObjNum 211 snap 62 seq_num 211) dirty exists 2024-03-30T12:26:24.701 INFO:tasks.rados.rados.0.smithi084.stdout:1161: finishing write tid 1 to smithi08477944-27 2024-03-30T12:26:24.701 INFO:tasks.rados.rados.0.smithi084.stdout:1161: finishing write tid 2 to smithi08477944-27 2024-03-30T12:26:24.702 INFO:tasks.rados.rados.0.smithi084.stdout:1161: finishing write tid 3 to smithi08477944-27 2024-03-30T12:26:24.702 INFO:tasks.rados.rados.0.smithi084.stdout:1161: finishing write tid 4 to smithi08477944-27 2024-03-30T12:26:24.702 INFO:tasks.rados.rados.0.smithi084.stdout:1161: finishing write tid 5 to smithi08477944-27 2024-03-30T12:26:24.702 INFO:tasks.rados.rados.0.smithi084.stdout:1161: oid 27 updating version 0 to 435 2024-03-30T12:26:24.702 INFO:tasks.rados.rados.0.smithi084.stdout:1161: oid 27 version 435 is already newer than 434 2024-03-30T12:26:24.703 INFO:tasks.rados.rados.0.smithi084.stdout:1161: oid 27 version 435 is already newer than 433 2024-03-30T12:26:24.703 INFO:tasks.rados.rados.0.smithi084.stdout:1161: oid 27 version 435 is already newer than 432 2024-03-30T12:26:24.703 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 435 (ObjNum 371 snap 117 seq_num 371) dirty exists 2024-03-30T12:26:24.704 INFO:tasks.rados.rados.0.smithi084.stdout:1161: left oid 27 (ObjNum 371 snap 117 seq_num 371) 2024-03-30T12:26:24.704 INFO:tasks.rados.rados.0.smithi084.stdout:1162: finishing write tid 1 to smithi08477944-31 2024-03-30T12:26:24.704 INFO:tasks.rados.rados.0.smithi084.stdout:1162: finishing write tid 2 to smithi08477944-31 2024-03-30T12:26:24.704 INFO:tasks.rados.rados.0.smithi084.stdout:1162: finishing write tid 3 to smithi08477944-31 2024-03-30T12:26:24.704 INFO:tasks.rados.rados.0.smithi084.stdout:1162: finishing write tid 4 to smithi08477944-31 2024-03-30T12:26:24.704 INFO:tasks.rados.rados.0.smithi084.stdout:1162: finishing write tid 5 to smithi08477944-31 2024-03-30T12:26:24.704 INFO:tasks.rados.rados.0.smithi084.stdout:1162: oid 31 updating version 0 to 632 2024-03-30T12:26:24.704 INFO:tasks.rados.rados.0.smithi084.stdout:1162: oid 31 updating version 632 to 635 2024-03-30T12:26:24.704 INFO:tasks.rados.rados.0.smithi084.stdout:1162: oid 31 version 635 is already newer than 633 2024-03-30T12:26:24.704 INFO:tasks.rados.rados.0.smithi084.stdout:1162: oid 31 version 635 is already newer than 634 2024-03-30T12:26:24.704 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 635 (ObjNum 372 snap 117 seq_num 372) dirty exists 2024-03-30T12:26:24.704 INFO:tasks.rados.rados.0.smithi084.stdout:1162: left oid 31 (ObjNum 372 snap 117 seq_num 372) 2024-03-30T12:26:24.704 INFO:tasks.rados.rados.0.smithi084.stdout:1163: finishing write tid 1 to smithi08477944-30 2024-03-30T12:26:24.704 INFO:tasks.rados.rados.0.smithi084.stdout:1163: finishing write tid 2 to smithi08477944-30 2024-03-30T12:26:24.705 INFO:tasks.rados.rados.0.smithi084.stdout:1163: finishing write tid 3 to smithi08477944-30 2024-03-30T12:26:24.705 INFO:tasks.rados.rados.0.smithi084.stdout:1160: done (4 left) 2024-03-30T12:26:24.705 INFO:tasks.rados.rados.0.smithi084.stdout:1161: done (3 left) 2024-03-30T12:26:24.705 INFO:tasks.rados.rados.0.smithi084.stdout:1162: done (2 left) 2024-03-30T12:26:24.705 INFO:tasks.rados.rados.0.smithi084.stdout:1165: done (1 left) 2024-03-30T12:26:24.706 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 117 2024-03-30T12:26:24.706 INFO:tasks.rados.rados.0.smithi084.stdout:1166: seq_num 375 ranges {0=688128,688128=663552,1351680=139264} 2024-03-30T12:26:24.706 INFO:tasks.rados.rados.0.smithi084.stdout:1166: writing smithi08477944-5 from 0 to 688128 tid 1 2024-03-30T12:26:24.710 INFO:tasks.rados.rados.0.smithi084.stdout:1166: writing smithi08477944-5 from 688128 to 1351680 tid 2 2024-03-30T12:26:24.711 INFO:tasks.rados.rados.0.smithi084.stdout:1166: writing smithi08477944-5 from 1351680 to 1490944 tid 3 2024-03-30T12:26:24.711 INFO:tasks.rados.rados.0.smithi084.stdout:1167: delete oid 38 current snap is 117 2024-03-30T12:26:24.711 INFO:tasks.rados.rados.0.smithi084.stdout:1163: finishing write tid 4 to smithi08477944-30 2024-03-30T12:26:24.711 INFO:tasks.rados.rados.0.smithi084.stdout:1163: finishing write tid 5 to smithi08477944-30 2024-03-30T12:26:24.711 INFO:tasks.rados.rados.0.smithi084.stdout:1163: oid 30 updating version 0 to 474 2024-03-30T12:26:24.711 INFO:tasks.rados.rados.0.smithi084.stdout:1163: oid 30 updating version 474 to 476 2024-03-30T12:26:24.711 INFO:tasks.rados.rados.0.smithi084.stdout:1163: oid 30 updating version 476 to 477 2024-03-30T12:26:24.711 INFO:tasks.rados.rados.0.smithi084.stdout:1163: oid 30 version 477 is already newer than 475 2024-03-30T12:26:24.712 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 477 (ObjNum 373 snap 117 seq_num 373) dirty exists 2024-03-30T12:26:24.712 INFO:tasks.rados.rados.0.smithi084.stdout:1163: left oid 30 (ObjNum 373 snap 117 seq_num 373) 2024-03-30T12:26:24.712 INFO:tasks.rados.rados.0.smithi084.stdout:1166: finishing write tid 1 to smithi08477944-5 2024-03-30T12:26:24.714 INFO:tasks.rados.rados.0.smithi084.stdout:1163: done (2 left) 2024-03-30T12:26:24.714 INFO:tasks.rados.rados.0.smithi084.stdout:1167: done (1 left) 2024-03-30T12:26:24.714 INFO:tasks.rados.rados.0.smithi084.stdout:1168: setattr oid 17 current snap is 117 2024-03-30T12:26:24.714 INFO:tasks.rados.rados.0.smithi084.stdout:1166: finishing write tid 2 to smithi08477944-5 2024-03-30T12:26:24.714 INFO:tasks.rados.rados.0.smithi084.stdout:1166: finishing write tid 3 to smithi08477944-5 2024-03-30T12:26:24.714 INFO:tasks.rados.rados.0.smithi084.stdout:1166: finishing write tid 4 to smithi08477944-5 2024-03-30T12:26:24.715 INFO:tasks.rados.rados.0.smithi084.stdout:1166: finishing write tid 5 to smithi08477944-5 2024-03-30T12:26:24.715 INFO:tasks.rados.rados.0.smithi084.stdout:1166: oid 5 updating version 0 to 491 2024-03-30T12:26:24.715 INFO:tasks.rados.rados.0.smithi084.stdout:1166: oid 5 updating version 491 to 493 2024-03-30T12:26:24.715 INFO:tasks.rados.rados.0.smithi084.stdout:1166: oid 5 version 493 is already newer than 492 2024-03-30T12:26:24.716 INFO:tasks.rados.rados.0.smithi084.stdout:1166: oid 5 updating version 493 to 494 2024-03-30T12:26:24.716 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 494 (ObjNum 375 snap 117 seq_num 375) dirty exists 2024-03-30T12:26:24.716 INFO:tasks.rados.rados.0.smithi084.stdout:1166: left oid 5 (ObjNum 375 snap 117 seq_num 375) 2024-03-30T12:26:24.716 INFO:tasks.rados.rados.0.smithi084.stdout:1166: done (1 left) 2024-03-30T12:26:24.716 INFO:tasks.rados.rados.0.smithi084.stdout:1169: read oid 1 snap -1 2024-03-30T12:26:24.716 INFO:tasks.rados.rados.0.smithi084.stdout:1169: expect deleted 2024-03-30T12:26:24.716 INFO:tasks.rados.rados.0.smithi084.stdout:1170: snap_remove snap 113 2024-03-30T12:26:25.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:24.663+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:25.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:24.664+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:25.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:24 smithi084 ceph-mon[89279]: osdmap e305: 8 total, 8 up, 8 in 2024-03-30T12:26:25.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:25.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:25.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:24 smithi084 ceph-mon[89279]: pgmap v140: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 165 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 280 KiB/s wr, 5 op/s; 3.4 MiB/s, 2 objects/s recovering 2024-03-30T12:26:25.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:24 smithi084 ceph-mon[89279]: osdmap e306: 8 total, 8 up, 8 in 2024-03-30T12:26:25.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:25.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:25.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:24 smithi084 ceph-mon[91810]: osdmap e305: 8 total, 8 up, 8 in 2024-03-30T12:26:25.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:25.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:25.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:24 smithi084 ceph-mon[91810]: pgmap v140: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 165 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 280 KiB/s wr, 5 op/s; 3.4 MiB/s, 2 objects/s recovering 2024-03-30T12:26:25.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:24 smithi084 ceph-mon[91810]: osdmap e306: 8 total, 8 up, 8 in 2024-03-30T12:26:25.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:25.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:25.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:24 smithi162 ceph-mon[83709]: osdmap e305: 8 total, 8 up, 8 in 2024-03-30T12:26:25.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:25.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:25.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:24 smithi162 ceph-mon[83709]: pgmap v140: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 165 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 280 KiB/s wr, 5 op/s; 3.4 MiB/s, 2 objects/s recovering 2024-03-30T12:26:25.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:24 smithi162 ceph-mon[83709]: osdmap e306: 8 total, 8 up, 8 in 2024-03-30T12:26:25.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset a5=[]:{a5=[a1,a0,9d]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:25.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:25.656 INFO:tasks.rados.rados.0.smithi084.stdout:1170: done (2 left) 2024-03-30T12:26:25.656 INFO:tasks.rados.rados.0.smithi084.stdout:1171: snap_remove snap 107 2024-03-30T12:26:26.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:25.670+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:26.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:25.670+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:26.656 INFO:tasks.rados.rados.0.smithi084.stdout:1171: done (2 left) 2024-03-30T12:26:26.657 INFO:tasks.rados.rados.0.smithi084.stdout:1172: snap_create 2024-03-30T12:26:26.657 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 635 (ObjNum 313 snap 103 seq_num 313) dirty exists 2024-03-30T12:26:27.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:26 smithi084 ceph-mon[91810]: osdmap e307: 8 total, 8 up, 8 in 2024-03-30T12:26:27.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:27.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:27.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:26 smithi084 ceph-mon[89279]: osdmap e307: 8 total, 8 up, 8 in 2024-03-30T12:26:27.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:27.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:27.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:26.671+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:27.005 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:26.672+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:27.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:26 smithi162 ceph-mon[83709]: osdmap e307: 8 total, 8 up, 8 in 2024-03-30T12:26:27.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:27.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:27.659 INFO:tasks.rados.rados.0.smithi084.stdout:1168: done (2 left) 2024-03-30T12:26:27.659 INFO:tasks.rados.rados.0.smithi084.stdout:1169: done (1 left) 2024-03-30T12:26:27.659 INFO:tasks.rados.rados.0.smithi084.stdout:1172: done (0 left) 2024-03-30T12:26:27.659 INFO:tasks.rados.rados.0.smithi084.stdout:1173: rollback oid 14 current snap is 118 2024-03-30T12:26:27.659 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 14 to 116 2024-03-30T12:26:27.659 INFO:tasks.rados.rados.0.smithi084.stdout:1174: snap_remove snap 98 2024-03-30T12:26:28.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:27 smithi084 ceph-mon[89279]: pgmap v143: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 181 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 4.4 MiB/s wr, 30 op/s 2024-03-30T12:26:28.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:27 smithi084 ceph-mon[89279]: osdmap e308: 8 total, 8 up, 8 in 2024-03-30T12:26:28.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:28.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:28.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:27.674+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:28.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:27.674+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:28.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:27 smithi084 ceph-mon[91810]: pgmap v143: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 181 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 4.4 MiB/s wr, 30 op/s 2024-03-30T12:26:28.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:27 smithi084 ceph-mon[91810]: osdmap e308: 8 total, 8 up, 8 in 2024-03-30T12:26:28.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:28.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:28.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:27 smithi162 ceph-mon[83709]: pgmap v143: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 181 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 4.4 MiB/s wr, 30 op/s 2024-03-30T12:26:28.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:27 smithi162 ceph-mon[83709]: osdmap e308: 8 total, 8 up, 8 in 2024-03-30T12:26:28.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:28.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:28.677 INFO:tasks.rados.rados.0.smithi084.stdout:1173: finishing rollback tid 0 to smithi08477944-14 2024-03-30T12:26:28.678 INFO:tasks.rados.rados.0.smithi084.stdout:1173: finishing rollback tid 1 to smithi08477944-14 2024-03-30T12:26:28.678 INFO:tasks.rados.rados.0.smithi084.stdout:1173: finishing rollback tid 2 to smithi08477944-14 2024-03-30T12:26:28.678 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 474 (ObjNum 211 snap 62 seq_num 211) dirty exists 2024-03-30T12:26:28.678 INFO:tasks.rados.rados.0.smithi084.stdout:1173: done (1 left) 2024-03-30T12:26:28.678 INFO:tasks.rados.rados.0.smithi084.stdout:1174: done (0 left) 2024-03-30T12:26:28.678 INFO:tasks.rados.rados.0.smithi084.stdout:1175: snap_remove snap 117 2024-03-30T12:26:29.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:28 smithi084 ceph-mon[89279]: osdmap e309: 8 total, 8 up, 8 in 2024-03-30T12:26:29.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:29.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:28 smithi084 ceph-mon[91810]: osdmap e309: 8 total, 8 up, 8 in 2024-03-30T12:26:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:29.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:28.690+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:29.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:28.691+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:29.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:28 smithi162 ceph-mon[83709]: osdmap e309: 8 total, 8 up, 8 in 2024-03-30T12:26:29.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:29.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:29.670 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:26:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:26:29] "GET /metrics HTTP/1.1" 200 36059 "" "Prometheus/2.43.0" 2024-03-30T12:26:29.683 INFO:tasks.rados.rados.0.smithi084.stdout:1175: done (0 left) 2024-03-30T12:26:29.683 INFO:tasks.rados.rados.0.smithi084.stdout:1176: rollback oid 16 current snap is 118 2024-03-30T12:26:29.684 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 16 to 116 2024-03-30T12:26:29.684 INFO:tasks.rados.rados.0.smithi084.stdout:1177: read oid 31 snap -1 2024-03-30T12:26:29.684 INFO:tasks.rados.rados.0.smithi084.stdout:1177: expect (ObjNum 372 snap 117 seq_num 372) 2024-03-30T12:26:29.684 INFO:tasks.rados.rados.0.smithi084.stdout:1178: read oid 6 snap -1 2024-03-30T12:26:29.684 INFO:tasks.rados.rados.0.smithi084.stdout:1178: expect (ObjNum 218 snap 64 seq_num 218) 2024-03-30T12:26:29.684 INFO:tasks.rados.rados.0.smithi084.stdout:1179: rollback oid 23 current snap is 118 2024-03-30T12:26:29.684 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 23 to 116 2024-03-30T12:26:29.684 INFO:tasks.rados.rados.0.smithi084.stdout:1180: read oid 50 snap -1 2024-03-30T12:26:29.684 INFO:tasks.rados.rados.0.smithi084.stdout:1180: expect (ObjNum 367 snap 117 seq_num 367) 2024-03-30T12:26:29.684 INFO:tasks.rados.rados.0.smithi084.stdout:1181: read oid 47 snap -1 2024-03-30T12:26:29.684 INFO:tasks.rados.rados.0.smithi084.stdout:1181: expect (ObjNum 346 snap 113 seq_num 346) 2024-03-30T12:26:29.684 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 118 2024-03-30T12:26:29.684 INFO:tasks.rados.rados.0.smithi084.stdout:1182: seq_num 377 ranges {0=720896,720896=434176,1155072=368640} 2024-03-30T12:26:29.687 INFO:tasks.rados.rados.0.smithi084.stdout:1182: writing smithi08477944-38 from 0 to 720896 tid 1 2024-03-30T12:26:29.690 INFO:tasks.rados.rados.0.smithi084.stdout:1182: writing smithi08477944-38 from 720896 to 1155072 tid 2 2024-03-30T12:26:29.694 INFO:tasks.rados.rados.0.smithi084.stdout:1182: writing smithi08477944-38 from 1155072 to 1523712 tid 3 2024-03-30T12:26:29.694 INFO:tasks.rados.rados.0.smithi084.stdout:1183: copy_from oid 3 from oid 29 current snap is 118 2024-03-30T12:26:29.694 INFO:tasks.rados.rados.0.smithi084.stdout:1184: snap_create 2024-03-30T12:26:29.702 INFO:tasks.rados.rados.0.smithi084.stdout:1178: expect (ObjNum 218 snap 64 seq_num 218) 2024-03-30T12:26:29.742 INFO:tasks.rados.rados.0.smithi084.stdout:1179: finishing rollback tid 0 to smithi08477944-23 2024-03-30T12:26:29.742 INFO:tasks.rados.rados.0.smithi084.stdout:1176: finishing rollback tid 0 to smithi08477944-16 2024-03-30T12:26:29.742 INFO:tasks.rados.rados.0.smithi084.stdout:1176: finishing rollback tid 1 to smithi08477944-16 2024-03-30T12:26:29.743 INFO:tasks.rados.rados.0.smithi084.stdout:1179: finishing rollback tid 1 to smithi08477944-23 2024-03-30T12:26:29.743 INFO:tasks.rados.rados.0.smithi084.stdout:1177: expect (ObjNum 372 snap 117 seq_num 372) 2024-03-30T12:26:29.782 INFO:tasks.rados.rados.0.smithi084.stdout:1179: finishing rollback tid 2 to smithi08477944-23 2024-03-30T12:26:29.783 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 635 (ObjNum 312 snap 103 seq_num 312) dirty exists 2024-03-30T12:26:29.783 INFO:tasks.rados.rados.0.smithi084.stdout:1182: finishing write tid 1 to smithi08477944-38 2024-03-30T12:26:29.783 INFO:tasks.rados.rados.0.smithi084.stdout:1182: finishing write tid 2 to smithi08477944-38 2024-03-30T12:26:29.783 INFO:tasks.rados.rados.0.smithi084.stdout:1182: finishing write tid 3 to smithi08477944-38 2024-03-30T12:26:29.783 INFO:tasks.rados.rados.0.smithi084.stdout:1182: finishing write tid 4 to smithi08477944-38 2024-03-30T12:26:29.783 INFO:tasks.rados.rados.0.smithi084.stdout:1182: finishing write tid 5 to smithi08477944-38 2024-03-30T12:26:29.783 INFO:tasks.rados.rados.0.smithi084.stdout:1182: oid 38 updating version 0 to 479 2024-03-30T12:26:29.783 INFO:tasks.rados.rados.0.smithi084.stdout:1182: oid 38 updating version 479 to 480 2024-03-30T12:26:29.783 INFO:tasks.rados.rados.0.smithi084.stdout:1182: oid 38 updating version 480 to 482 2024-03-30T12:26:29.783 INFO:tasks.rados.rados.0.smithi084.stdout:1182: oid 38 version 482 is already newer than 481 2024-03-30T12:26:29.783 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 482 (ObjNum 377 snap 118 seq_num 377) dirty exists 2024-03-30T12:26:29.783 INFO:tasks.rados.rados.0.smithi084.stdout:1182: left oid 38 (ObjNum 377 snap 118 seq_num 377) 2024-03-30T12:26:29.783 INFO:tasks.rados.rados.0.smithi084.stdout:1176: finishing rollback tid 2 to smithi08477944-16 2024-03-30T12:26:29.783 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 795 (ObjNum 312 snap 103 seq_num 312) dirty exists 2024-03-30T12:26:29.784 INFO:tasks.rados.rados.0.smithi084.stdout:1181: expect (ObjNum 346 snap 113 seq_num 346) 2024-03-30T12:26:30.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:29 smithi084 ceph-mon[91810]: pgmap v146: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 181 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 4.4 MiB/s wr, 30 op/s 2024-03-30T12:26:30.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:29 smithi084 ceph-mon[91810]: osdmap e310: 8 total, 8 up, 8 in 2024-03-30T12:26:30.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:30.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:30.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:29.701+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:30.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:29.708+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:30.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:29 smithi084 ceph-mon[89279]: pgmap v146: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 181 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 4.4 MiB/s wr, 30 op/s 2024-03-30T12:26:30.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:29 smithi084 ceph-mon[89279]: osdmap e310: 8 total, 8 up, 8 in 2024-03-30T12:26:30.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:30.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:30.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:29 smithi162 ceph-mon[83709]: pgmap v146: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 181 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 4.4 MiB/s wr, 30 op/s 2024-03-30T12:26:30.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:29 smithi162 ceph-mon[83709]: osdmap e310: 8 total, 8 up, 8 in 2024-03-30T12:26:30.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:30.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:30.367 INFO:tasks.rados.rados.0.smithi084.stdout:1180: expect (ObjNum 367 snap 117 seq_num 367) 2024-03-30T12:26:30.615 INFO:tasks.rados.rados.0.smithi084.stdout:1183: finishing copy_from racing read to smithi08477944-3 2024-03-30T12:26:30.615 INFO:tasks.rados.rados.0.smithi084.stdout:1183: finishing copy_from to smithi08477944-3 2024-03-30T12:26:30.615 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 452 (ObjNum 324 snap 110 seq_num 324) dirty exists 2024-03-30T12:26:30.687 INFO:tasks.rados.rados.0.smithi084.stdout:1176: done (8 left) 2024-03-30T12:26:30.687 INFO:tasks.rados.rados.0.smithi084.stdout:1177: done (7 left) 2024-03-30T12:26:30.687 INFO:tasks.rados.rados.0.smithi084.stdout:1178: done (6 left) 2024-03-30T12:26:30.687 INFO:tasks.rados.rados.0.smithi084.stdout:1179: done (5 left) 2024-03-30T12:26:30.687 INFO:tasks.rados.rados.0.smithi084.stdout:1180: done (4 left) 2024-03-30T12:26:30.687 INFO:tasks.rados.rados.0.smithi084.stdout:1181: done (3 left) 2024-03-30T12:26:30.687 INFO:tasks.rados.rados.0.smithi084.stdout:1182: done (2 left) 2024-03-30T12:26:30.687 INFO:tasks.rados.rados.0.smithi084.stdout:1183: done (1 left) 2024-03-30T12:26:30.688 INFO:tasks.rados.rados.0.smithi084.stdout:1184: done (0 left) 2024-03-30T12:26:30.688 INFO:tasks.rados.rados.0.smithi084.stdout:1185: snap_create 2024-03-30T12:26:31.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:30 smithi084 ceph-mon[91810]: osdmap e311: 8 total, 8 up, 8 in 2024-03-30T12:26:31.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:31.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:31.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:30 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:31.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:30 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:26:31.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:30 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:31.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:30 smithi084 ceph-mon[89279]: osdmap e311: 8 total, 8 up, 8 in 2024-03-30T12:26:31.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:31.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:31.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:30 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:31.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:30 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:26:31.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:30 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:31.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:30 smithi162 ceph-mon[83709]: osdmap e311: 8 total, 8 up, 8 in 2024-03-30T12:26:31.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:31.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:31.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:30 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:31.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:30 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:26:31.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:30 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:31.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:31.156+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:31.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:31.156+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:31.693 INFO:tasks.rados.rados.0.smithi084.stdout:1185: done (0 left) 2024-03-30T12:26:31.693 INFO:tasks.rados.rados.0.smithi084.stdout:1186: snap_remove snap 116 2024-03-30T12:26:32.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:31 smithi084 ceph-mon[91810]: pgmap v149: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 144 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 6 op/s 2024-03-30T12:26:32.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:31 smithi084 ceph-mon[91810]: osdmap e312: 8 total, 8 up, 8 in 2024-03-30T12:26:32.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:31 smithi084 ceph-mon[89279]: pgmap v149: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 144 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 6 op/s 2024-03-30T12:26:32.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:31 smithi084 ceph-mon[89279]: osdmap e312: 8 total, 8 up, 8 in 2024-03-30T12:26:32.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:31 smithi162 ceph-mon[83709]: pgmap v149: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 144 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 6 op/s 2024-03-30T12:26:32.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:31 smithi162 ceph-mon[83709]: osdmap e312: 8 total, 8 up, 8 in 2024-03-30T12:26:32.707 INFO:tasks.rados.rados.0.smithi084.stdout:1186: done (0 left) 2024-03-30T12:26:32.707 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 33 current snap is 120 2024-03-30T12:26:32.707 INFO:tasks.rados.rados.0.smithi084.stdout:1187: seq_num 378 ranges {0=737280,737280=720896,1458176=81920} 2024-03-30T12:26:32.712 INFO:tasks.rados.rados.0.smithi084.stdout:1187: writing smithi08477944-33 from 0 to 737280 tid 1 2024-03-30T12:26:32.717 INFO:tasks.rados.rados.0.smithi084.stdout:1187: writing smithi08477944-33 from 737280 to 1458176 tid 2 2024-03-30T12:26:32.718 INFO:tasks.rados.rados.0.smithi084.stdout:1187: writing smithi08477944-33 from 1458176 to 1540096 tid 3 2024-03-30T12:26:32.718 INFO:tasks.rados.rados.0.smithi084.stdout:1188: copy_from oid 22 from oid 50 current snap is 120 2024-03-30T12:26:32.719 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 120 2024-03-30T12:26:32.719 INFO:tasks.rados.rados.0.smithi084.stdout:1189: seq_num 379 ranges {1523712=753664,2277376=606208,2883584=196608} 2024-03-30T12:26:32.731 INFO:tasks.rados.rados.0.smithi084.stdout:1189: writing smithi08477944-38 from 1523712 to 2277376 tid 1 2024-03-30T12:26:32.735 INFO:tasks.rados.rados.0.smithi084.stdout:1189: writing smithi08477944-38 from 2277376 to 2883584 tid 2 2024-03-30T12:26:32.737 INFO:tasks.rados.rados.0.smithi084.stdout:1189: writing smithi08477944-38 from 2883584 to 3080192 tid 3 2024-03-30T12:26:32.737 INFO:tasks.rados.rados.0.smithi084.stdout:1190: read oid 17 snap -1 2024-03-30T12:26:32.737 INFO:tasks.rados.rados.0.smithi084.stdout:1190: expect (ObjNum 313 snap 103 seq_num 313) 2024-03-30T12:26:32.737 INFO:tasks.rados.rados.0.smithi084.stdout:1191: snap_create 2024-03-30T12:26:32.737 INFO:tasks.rados.rados.0.smithi084.stdout:1187: finishing write tid 1 to smithi08477944-33 2024-03-30T12:26:32.737 INFO:tasks.rados.rados.0.smithi084.stdout:1187: finishing write tid 2 to smithi08477944-33 2024-03-30T12:26:32.737 INFO:tasks.rados.rados.0.smithi084.stdout:1187: finishing write tid 3 to smithi08477944-33 2024-03-30T12:26:32.737 INFO:tasks.rados.rados.0.smithi084.stdout:1187: finishing write tid 4 to smithi08477944-33 2024-03-30T12:26:32.737 INFO:tasks.rados.rados.0.smithi084.stdout:1187: finishing write tid 5 to smithi08477944-33 2024-03-30T12:26:32.737 INFO:tasks.rados.rados.0.smithi084.stdout:1187: oid 33 updating version 0 to 820 2024-03-30T12:26:32.737 INFO:tasks.rados.rados.0.smithi084.stdout:1187: oid 33 version 820 is already newer than 817 2024-03-30T12:26:32.737 INFO:tasks.rados.rados.0.smithi084.stdout:1187: oid 33 version 820 is already newer than 819 2024-03-30T12:26:32.738 INFO:tasks.rados.rados.0.smithi084.stdout:1187: oid 33 version 820 is already newer than 818 2024-03-30T12:26:32.738 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 820 (ObjNum 378 snap 120 seq_num 378) dirty exists 2024-03-30T12:26:32.738 INFO:tasks.rados.rados.0.smithi084.stdout:1187: left oid 33 (ObjNum 378 snap 120 seq_num 378) 2024-03-30T12:26:32.740 INFO:tasks.rados.rados.0.smithi084.stdout:1189: finishing write tid 1 to smithi08477944-38 2024-03-30T12:26:32.740 INFO:tasks.rados.rados.0.smithi084.stdout:1189: finishing write tid 2 to smithi08477944-38 2024-03-30T12:26:32.740 INFO:tasks.rados.rados.0.smithi084.stdout:1189: finishing write tid 3 to smithi08477944-38 2024-03-30T12:26:32.742 INFO:tasks.rados.rados.0.smithi084.stdout:1189: finishing write tid 4 to smithi08477944-38 2024-03-30T12:26:32.743 INFO:tasks.rados.rados.0.smithi084.stdout:1189: finishing write tid 5 to smithi08477944-38 2024-03-30T12:26:32.743 INFO:tasks.rados.rados.0.smithi084.stdout:1189: oid 38 updating version 0 to 483 2024-03-30T12:26:32.743 INFO:tasks.rados.rados.0.smithi084.stdout:1189: oid 38 updating version 483 to 485 2024-03-30T12:26:32.743 INFO:tasks.rados.rados.0.smithi084.stdout:1189: oid 38 version 485 is already newer than 484 2024-03-30T12:26:32.743 INFO:tasks.rados.rados.0.smithi084.stdout:1189: oid 38 updating version 485 to 486 2024-03-30T12:26:32.744 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 486 (ObjNum 379 snap 120 seq_num 379) dirty exists 2024-03-30T12:26:32.744 INFO:tasks.rados.rados.0.smithi084.stdout:1189: left oid 38 (ObjNum 379 snap 120 seq_num 379) 2024-03-30T12:26:32.749 INFO:tasks.rados.rados.0.smithi084.stdout:1188: finishing copy_from racing read to smithi08477944-22 2024-03-30T12:26:32.758 INFO:tasks.rados.rados.0.smithi084.stdout:1188: finishing copy_from to smithi08477944-22 2024-03-30T12:26:32.758 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 763 (ObjNum 367 snap 117 seq_num 367) dirty exists 2024-03-30T12:26:32.765 INFO:tasks.rados.rados.0.smithi084.stdout:1190: expect (ObjNum 313 snap 103 seq_num 313) 2024-03-30T12:26:33.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:33.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:33.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:32 smithi084 ceph-mon[91810]: osdmap e313: 8 total, 8 up, 8 in 2024-03-30T12:26:33.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:33.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:33.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:32 smithi084 ceph-mon[89279]: osdmap e313: 8 total, 8 up, 8 in 2024-03-30T12:26:33.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:32.720+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:33.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:32.720+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:33.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:33.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:33.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:32 smithi162 ceph-mon[83709]: osdmap e313: 8 total, 8 up, 8 in 2024-03-30T12:26:33.714 INFO:tasks.rados.rados.0.smithi084.stdout:1187: done (4 left) 2024-03-30T12:26:33.714 INFO:tasks.rados.rados.0.smithi084.stdout:1188: done (3 left) 2024-03-30T12:26:33.714 INFO:tasks.rados.rados.0.smithi084.stdout:1189: done (2 left) 2024-03-30T12:26:33.714 INFO:tasks.rados.rados.0.smithi084.stdout:1190: done (1 left) 2024-03-30T12:26:33.714 INFO:tasks.rados.rados.0.smithi084.stdout:1191: done (0 left) 2024-03-30T12:26:33.714 INFO:tasks.rados.rados.0.smithi084.stdout:1192: delete oid 40 current snap is 121 2024-03-30T12:26:33.719 INFO:tasks.rados.rados.0.smithi084.stdout:1192: done (0 left) 2024-03-30T12:26:33.719 INFO:tasks.rados.rados.0.smithi084.stdout:1193: snap_remove snap 118 2024-03-30T12:26:34.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:33 smithi084 ceph-mon[91810]: pgmap v152: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 144 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 7 op/s 2024-03-30T12:26:34.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:33 smithi084 ceph-mon[91810]: osdmap e314: 8 total, 8 up, 8 in 2024-03-30T12:26:34.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:34.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:34.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:33.726+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:34.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:33.726+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:34.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:33 smithi084 ceph-mon[89279]: pgmap v152: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 144 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 7 op/s 2024-03-30T12:26:34.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:33 smithi084 ceph-mon[89279]: osdmap e314: 8 total, 8 up, 8 in 2024-03-30T12:26:34.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:34.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:34.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:33 smithi162 ceph-mon[83709]: pgmap v152: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 144 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 7 op/s 2024-03-30T12:26:34.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:33 smithi162 ceph-mon[83709]: osdmap e314: 8 total, 8 up, 8 in 2024-03-30T12:26:34.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:34.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:34.720 INFO:tasks.rados.rados.0.smithi084.stdout:1193: done (0 left) 2024-03-30T12:26:34.720 INFO:tasks.rados.rados.0.smithi084.stdout:1194: snap_remove snap 120 2024-03-30T12:26:35.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:34.727+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:35.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:34.727+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:35.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:34 smithi084 ceph-mon[89279]: osdmap e315: 8 total, 8 up, 8 in 2024-03-30T12:26:35.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:35.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:35.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:34 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-30T12:26:35.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:34 smithi084 ceph-mon[91810]: osdmap e315: 8 total, 8 up, 8 in 2024-03-30T12:26:35.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:35.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:35.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:34 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-30T12:26:35.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:34 smithi162 ceph-mon[83709]: osdmap e315: 8 total, 8 up, 8 in 2024-03-30T12:26:35.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:35.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:35.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:34 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-30T12:26:35.723 INFO:tasks.rados.rados.0.smithi084.stdout:1194: done (0 left) 2024-03-30T12:26:35.723 INFO:tasks.rados.rados.0.smithi084.stdout:1195: snap_remove snap 119 2024-03-30T12:26:35.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:35 smithi084 ceph-mon[89279]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-30T12:26:35.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:35 smithi084 ceph-mon[89279]: Upgrade: osd.1 is safe to restart 2024-03-30T12:26:35.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:35 smithi084 ceph-mon[89279]: pgmap v155: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 144 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-03-30T12:26:35.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:35.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:35.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:35 smithi084 ceph-mon[89279]: osdmap e316: 8 total, 8 up, 8 in 2024-03-30T12:26:35.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:35 smithi084 ceph-mon[91810]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-30T12:26:35.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:35 smithi084 ceph-mon[91810]: Upgrade: osd.1 is safe to restart 2024-03-30T12:26:35.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:35 smithi084 ceph-mon[91810]: pgmap v155: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 144 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-03-30T12:26:35.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:35.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:35.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:35 smithi084 ceph-mon[91810]: osdmap e316: 8 total, 8 up, 8 in 2024-03-30T12:26:36.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:35 smithi162 ceph-mon[83709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-30T12:26:36.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:35 smithi162 ceph-mon[83709]: Upgrade: osd.1 is safe to restart 2024-03-30T12:26:36.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:35 smithi162 ceph-mon[83709]: pgmap v155: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 144 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-03-30T12:26:36.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:36.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:36.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:35 smithi162 ceph-mon[83709]: osdmap e316: 8 total, 8 up, 8 in 2024-03-30T12:26:36.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:35.968+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:36.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:35.968+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:36.728 INFO:tasks.rados.rados.0.smithi084.stdout:1195: done (0 left) 2024-03-30T12:26:36.728 INFO:tasks.rados.rados.0.smithi084.stdout:1196: delete oid 34 current snap is 121 2024-03-30T12:26:36.734 INFO:tasks.rados.rados.0.smithi084.stdout:1196: done (0 left) 2024-03-30T12:26:36.735 INFO:tasks.rados.rados.0.smithi084.stdout:1197: read oid 33 snap -1 2024-03-30T12:26:36.735 INFO:tasks.rados.rados.0.smithi084.stdout:1197: expect (ObjNum 378 snap 120 seq_num 378) 2024-03-30T12:26:36.735 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 121 2024-03-30T12:26:36.735 INFO:tasks.rados.rados.0.smithi084.stdout:1198: seq_num 382 ranges {2048000=802816,2850816=704512,3555328=98304} 2024-03-30T12:26:36.750 INFO:tasks.rados.rados.0.smithi084.stdout:1198: writing smithi08477944-48 from 2048000 to 2850816 tid 1 2024-03-30T12:26:36.754 INFO:tasks.rados.rados.0.smithi084.stdout:1198: writing smithi08477944-48 from 2850816 to 3555328 tid 2 2024-03-30T12:26:36.755 INFO:tasks.rados.rados.0.smithi084.stdout:1198: writing smithi08477944-48 from 3555328 to 3653632 tid 3 2024-03-30T12:26:36.755 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 121 2024-03-30T12:26:36.755 INFO:tasks.rados.rados.0.smithi084.stdout:1199: seq_num 383 ranges {1490944=417792,1908736=589824,2498560=417792,2916352=196608} 2024-03-30T12:26:36.765 INFO:tasks.rados.rados.0.smithi084.stdout:1199: writing smithi08477944-5 from 1490944 to 1908736 tid 1 2024-03-30T12:26:36.769 INFO:tasks.rados.rados.0.smithi084.stdout:1199: writing smithi08477944-5 from 1908736 to 2498560 tid 2 2024-03-30T12:26:36.771 INFO:tasks.rados.rados.0.smithi084.stdout:1199: writing smithi08477944-5 from 2498560 to 2916352 tid 3 2024-03-30T12:26:36.772 INFO:tasks.rados.rados.0.smithi084.stdout:1199: writing smithi08477944-5 from 2916352 to 3112960 tid 4 2024-03-30T12:26:36.773 INFO:tasks.rados.rados.0.smithi084.stdout:1200: read oid 42 snap -1 2024-03-30T12:26:36.773 INFO:tasks.rados.rados.0.smithi084.stdout:1200: expect (ObjNum 205 snap 62 seq_num 205) 2024-03-30T12:26:36.773 INFO:tasks.rados.rados.0.smithi084.stdout:1201: copy_from oid 50 from oid 21 current snap is 121 2024-03-30T12:26:36.773 INFO:tasks.rados.rados.0.smithi084.stdout:1197: expect (ObjNum 378 snap 120 seq_num 378) 2024-03-30T12:26:36.817 INFO:tasks.rados.rados.0.smithi084.stdout:1198: finishing write tid 1 to smithi08477944-48 2024-03-30T12:26:36.817 INFO:tasks.rados.rados.0.smithi084.stdout:1198: finishing write tid 2 to smithi08477944-48 2024-03-30T12:26:36.817 INFO:tasks.rados.rados.0.smithi084.stdout:1198: finishing write tid 3 to smithi08477944-48 2024-03-30T12:26:36.817 INFO:tasks.rados.rados.0.smithi084.stdout:1198: finishing write tid 4 to smithi08477944-48 2024-03-30T12:26:36.817 INFO:tasks.rados.rados.0.smithi084.stdout:1198: finishing write tid 5 to smithi08477944-48 2024-03-30T12:26:36.817 INFO:tasks.rados.rados.0.smithi084.stdout:1198: oid 48 updating version 0 to 341 2024-03-30T12:26:36.817 INFO:tasks.rados.rados.0.smithi084.stdout:1198: oid 48 version 341 is already newer than 340 2024-03-30T12:26:36.817 INFO:tasks.rados.rados.0.smithi084.stdout:1198: oid 48 version 341 is already newer than 339 2024-03-30T12:26:36.817 INFO:tasks.rados.rados.0.smithi084.stdout:1198: oid 48 version 341 is already newer than 338 2024-03-30T12:26:36.817 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 341 (ObjNum 382 snap 121 seq_num 382) dirty exists 2024-03-30T12:26:36.817 INFO:tasks.rados.rados.0.smithi084.stdout:1198: left oid 48 (ObjNum 382 snap 121 seq_num 382) 2024-03-30T12:26:36.817 INFO:tasks.rados.rados.0.smithi084.stdout:1199: finishing write tid 1 to smithi08477944-5 2024-03-30T12:26:36.818 INFO:tasks.rados.rados.0.smithi084.stdout:1197: done (4 left) 2024-03-30T12:26:36.818 INFO:tasks.rados.rados.0.smithi084.stdout:1198: done (3 left) 2024-03-30T12:26:36.818 INFO:tasks.rados.rados.0.smithi084.stdout:1202: read oid 3 snap -1 2024-03-30T12:26:36.818 INFO:tasks.rados.rados.0.smithi084.stdout:1202: expect (ObjNum 324 snap 110 seq_num 324) 2024-03-30T12:26:36.818 INFO:tasks.rados.rados.0.smithi084.stdout:1203: copy_from oid 10 from oid 45 current snap is 121 2024-03-30T12:26:36.818 INFO:tasks.rados.rados.0.smithi084.stdout:1199: finishing write tid 2 to smithi08477944-5 2024-03-30T12:26:36.818 INFO:tasks.rados.rados.0.smithi084.stdout:1199: finishing write tid 3 to smithi08477944-5 2024-03-30T12:26:36.818 INFO:tasks.rados.rados.0.smithi084.stdout:1201: finishing copy_from racing read to smithi08477944-50 2024-03-30T12:26:36.818 INFO:tasks.rados.rados.0.smithi084.stdout:1199: finishing write tid 4 to smithi08477944-5 2024-03-30T12:26:36.818 INFO:tasks.rados.rados.0.smithi084.stdout:1199: finishing write tid 5 to smithi08477944-5 2024-03-30T12:26:36.818 INFO:tasks.rados.rados.0.smithi084.stdout:1201: finishing copy_from to smithi08477944-50 2024-03-30T12:26:36.818 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 410 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:26:36.818 INFO:tasks.rados.rados.0.smithi084.stdout:1199: finishing write tid 6 to smithi08477944-5 2024-03-30T12:26:36.818 INFO:tasks.rados.rados.0.smithi084.stdout:1199: oid 5 updating version 0 to 499 2024-03-30T12:26:36.818 INFO:tasks.rados.rados.0.smithi084.stdout:1199: oid 5 version 499 is already newer than 496 2024-03-30T12:26:36.819 INFO:tasks.rados.rados.0.smithi084.stdout:1199: oid 5 version 499 is already newer than 497 2024-03-30T12:26:36.819 INFO:tasks.rados.rados.0.smithi084.stdout:1199: oid 5 version 499 is already newer than 498 2024-03-30T12:26:36.819 INFO:tasks.rados.rados.0.smithi084.stdout:1199: oid 5 version 499 is already newer than 495 2024-03-30T12:26:36.819 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 499 (ObjNum 383 snap 121 seq_num 383) dirty exists 2024-03-30T12:26:36.819 INFO:tasks.rados.rados.0.smithi084.stdout:1199: left oid 5 (ObjNum 383 snap 121 seq_num 383) 2024-03-30T12:26:36.819 INFO:tasks.rados.rados.0.smithi084.stdout:1199: done (4 left) 2024-03-30T12:26:36.819 INFO:tasks.rados.rados.0.smithi084.stdout:1201: done (3 left) 2024-03-30T12:26:36.819 INFO:tasks.rados.rados.0.smithi084.stdout:1204: read oid 22 snap -1 2024-03-30T12:26:36.819 INFO:tasks.rados.rados.0.smithi084.stdout:1204: expect (ObjNum 367 snap 117 seq_num 367) 2024-03-30T12:26:36.819 INFO:tasks.rados.rados.0.smithi084.stdout:1205: read oid 15 snap -1 2024-03-30T12:26:36.819 INFO:tasks.rados.rados.0.smithi084.stdout:1205: expect deleted 2024-03-30T12:26:36.819 INFO:tasks.rados.rados.0.smithi084.stdout:1206: read oid 9 snap -1 2024-03-30T12:26:36.819 INFO:tasks.rados.rados.0.smithi084.stdout:1206: expect deleted 2024-03-30T12:26:36.819 INFO:tasks.rados.rados.0.smithi084.stdout:1207: snap_create 2024-03-30T12:26:36.819 INFO:tasks.rados.rados.0.smithi084.stdout:1200: expect (ObjNum 205 snap 62 seq_num 205) 2024-03-30T12:26:36.944 INFO:tasks.rados.rados.0.smithi084.stdout:1203: finishing copy_from to smithi08477944-10 2024-03-30T12:26:36.944 INFO:tasks.rados.rados.0.smithi084.stdout:1203: got expected ENOENT (src dne) 2024-03-30T12:26:36.944 INFO:tasks.rados.rados.0.smithi084.stdout:1203: finishing copy_from racing read to smithi08477944-10 2024-03-30T12:26:36.944 INFO:tasks.rados.rados.0.smithi084.stdout:1202: expect (ObjNum 324 snap 110 seq_num 324) 2024-03-30T12:26:36.984 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:36.735+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:36.984 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:36.736+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:36.984 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:36 smithi084 ceph-mon[91810]: osdmap e317: 8 total, 8 up, 8 in 2024-03-30T12:26:36.984 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:36 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:36.984 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:36 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-30T12:26:36.985 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:36 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:26:36.985 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:36 smithi084 ceph-mon[89279]: osdmap e317: 8 total, 8 up, 8 in 2024-03-30T12:26:36.985 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:36 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:36.985 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:36 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-30T12:26:36.985 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:36 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:26:37.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:36 smithi162 ceph-mon[83709]: osdmap e317: 8 total, 8 up, 8 in 2024-03-30T12:26:37.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:36 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:37.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:36 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-30T12:26:37.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:36 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:26:37.152 INFO:tasks.rados.rados.0.smithi084.stdout:1204: expect (ObjNum 367 snap 117 seq_num 367) 2024-03-30T12:26:37.740 INFO:tasks.rados.rados.0.smithi084.stdout:1200: done (6 left) 2024-03-30T12:26:37.740 INFO:tasks.rados.rados.0.smithi084.stdout:1202: done (5 left) 2024-03-30T12:26:37.741 INFO:tasks.rados.rados.0.smithi084.stdout:1203: done (4 left) 2024-03-30T12:26:37.741 INFO:tasks.rados.rados.0.smithi084.stdout:1204: done (3 left) 2024-03-30T12:26:37.741 INFO:tasks.rados.rados.0.smithi084.stdout:1205: done (2 left) 2024-03-30T12:26:37.741 INFO:tasks.rados.rados.0.smithi084.stdout:1206: done (1 left) 2024-03-30T12:26:37.741 INFO:tasks.rados.rados.0.smithi084.stdout:1207: done (0 left) 2024-03-30T12:26:37.741 INFO:tasks.rados.rados.0.smithi084.stdout:1208: snap_remove snap 121 2024-03-30T12:26:37.993 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:37.993 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:37.993 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:37 smithi084 ceph-mon[89279]: Upgrade: Updating osd.1 2024-03-30T12:26:37.993 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:37 smithi084 ceph-mon[89279]: Deploying daemon osd.1 on smithi084 2024-03-30T12:26:37.993 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:37 smithi084 ceph-mon[89279]: pgmap v158: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 138 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 5.4 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-03-30T12:26:37.993 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:37.993 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:37 smithi084 ceph-mon[89279]: osdmap e318: 8 total, 8 up, 8 in 2024-03-30T12:26:37.994 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:37.994 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:37.994 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:37.994 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:37 smithi084 ceph-mon[91810]: Upgrade: Updating osd.1 2024-03-30T12:26:37.994 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:37 smithi084 ceph-mon[91810]: Deploying daemon osd.1 on smithi084 2024-03-30T12:26:37.994 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:37 smithi084 ceph-mon[91810]: pgmap v158: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 138 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 5.4 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-03-30T12:26:37.994 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:37.994 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:37 smithi084 ceph-mon[91810]: osdmap e318: 8 total, 8 up, 8 in 2024-03-30T12:26:37.994 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:38.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:38.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:38.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:37 smithi162 ceph-mon[83709]: Upgrade: Updating osd.1 2024-03-30T12:26:38.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:37 smithi162 ceph-mon[83709]: Deploying daemon osd.1 on smithi084 2024-03-30T12:26:38.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:37 smithi162 ceph-mon[83709]: pgmap v158: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 138 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 5.4 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-03-30T12:26:38.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:38.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:37 smithi162 ceph-mon[83709]: osdmap e318: 8 total, 8 up, 8 in 2024-03-30T12:26:38.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:38.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:38.096+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:38.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:38.096+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:38.745 INFO:tasks.rados.rados.0.smithi084.stdout:1208: done (0 left) 2024-03-30T12:26:38.745 INFO:tasks.rados.rados.0.smithi084.stdout:1209: rollback oid 10 current snap is 122 2024-03-30T12:26:38.745 INFO:tasks.rados.rados.0.smithi084.stdout:1209: done (0 left) 2024-03-30T12:26:38.746 INFO:tasks.rados.rados.0.smithi084.stdout:1210: delete oid 1 current snap is 122 2024-03-30T12:26:38.749 INFO:tasks.rados.rados.0.smithi084.stdout:1210: done (0 left) 2024-03-30T12:26:38.749 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 122 2024-03-30T12:26:38.749 INFO:tasks.rados.rados.0.smithi084.stdout:1211: seq_num 385 ranges {5455872=450560,5906432=761856,6668288=442368} 2024-03-30T12:26:38.782 INFO:tasks.rados.rados.0.smithi084.stdout:1211: writing smithi08477944-41 from 5455872 to 5906432 tid 1 2024-03-30T12:26:38.785 INFO:tasks.rados.rados.0.smithi084.stdout:1211: writing smithi08477944-41 from 5906432 to 6668288 tid 2 2024-03-30T12:26:38.788 INFO:tasks.rados.rados.0.smithi084.stdout:1211: writing smithi08477944-41 from 6668288 to 7110656 tid 3 2024-03-30T12:26:38.788 INFO:tasks.rados.rados.0.smithi084.stdout:1212: copy_from oid 10 from oid 5 current snap is 122 2024-03-30T12:26:38.788 INFO:tasks.rados.rados.0.smithi084.stdout:1211: finishing write tid 1 to smithi08477944-41 2024-03-30T12:26:38.788 INFO:tasks.rados.rados.0.smithi084.stdout:1213: rollback oid 2 current snap is 122 2024-03-30T12:26:38.788 INFO:tasks.rados.rados.0.smithi084.stdout:1213: done (2 left) 2024-03-30T12:26:38.788 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 122 2024-03-30T12:26:38.788 INFO:tasks.rados.rados.0.smithi084.stdout:1214: seq_num 386 ranges {0=466944,466944=638976,1105920=565248} 2024-03-30T12:26:38.790 INFO:tasks.rados.rados.0.smithi084.stdout:1214: writing smithi08477944-45 from 0 to 466944 tid 1 2024-03-30T12:26:38.794 INFO:tasks.rados.rados.0.smithi084.stdout:1214: writing smithi08477944-45 from 466944 to 1105920 tid 2 2024-03-30T12:26:38.798 INFO:tasks.rados.rados.0.smithi084.stdout:1214: writing smithi08477944-45 from 1105920 to 1671168 tid 3 2024-03-30T12:26:38.798 INFO:tasks.rados.rados.0.smithi084.stdout:1215: delete oid 12 current snap is 122 2024-03-30T12:26:38.798 INFO:tasks.rados.rados.0.smithi084.stdout:1211: finishing write tid 2 to smithi08477944-41 2024-03-30T12:26:38.798 INFO:tasks.rados.rados.0.smithi084.stdout:1211: finishing write tid 3 to smithi08477944-41 2024-03-30T12:26:38.799 INFO:tasks.rados.rados.0.smithi084.stdout:1211: finishing write tid 4 to smithi08477944-41 2024-03-30T12:26:38.799 INFO:tasks.rados.rados.0.smithi084.stdout:1214: finishing write tid 1 to smithi08477944-45 2024-03-30T12:26:38.799 INFO:tasks.rados.rados.0.smithi084.stdout:1211: finishing write tid 5 to smithi08477944-41 2024-03-30T12:26:38.799 INFO:tasks.rados.rados.0.smithi084.stdout:1211: oid 41 updating version 0 to 806 2024-03-30T12:26:38.799 INFO:tasks.rados.rados.0.smithi084.stdout:1211: oid 41 version 806 is already newer than 803 2024-03-30T12:26:38.799 INFO:tasks.rados.rados.0.smithi084.stdout:1211: oid 41 version 806 is already newer than 804 2024-03-30T12:26:38.799 INFO:tasks.rados.rados.0.smithi084.stdout:1211: oid 41 version 806 is already newer than 805 2024-03-30T12:26:38.799 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 806 (ObjNum 385 snap 122 seq_num 385) dirty exists 2024-03-30T12:26:38.799 INFO:tasks.rados.rados.0.smithi084.stdout:1211: left oid 41 (ObjNum 385 snap 122 seq_num 385) 2024-03-30T12:26:38.799 INFO:tasks.rados.rados.0.smithi084.stdout:1214: finishing write tid 2 to smithi08477944-45 2024-03-30T12:26:38.800 INFO:tasks.rados.rados.0.smithi084.stdout:1211: done (3 left) 2024-03-30T12:26:38.800 INFO:tasks.rados.rados.0.smithi084.stdout:1215: done (2 left) 2024-03-30T12:26:38.800 INFO:tasks.rados.rados.0.smithi084.stdout:1216: setattr oid 29 current snap is 122 2024-03-30T12:26:38.801 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 122 2024-03-30T12:26:38.801 INFO:tasks.rados.rados.0.smithi084.stdout:1217: seq_num 388 ranges {2138112=507904,2646016=458752,3104768=606208,3710976=139264} 2024-03-30T12:26:38.815 INFO:tasks.rados.rados.0.smithi084.stdout:1217: writing smithi08477944-36 from 2138112 to 2646016 tid 1 2024-03-30T12:26:38.818 INFO:tasks.rados.rados.0.smithi084.stdout:1217: writing smithi08477944-36 from 2646016 to 3104768 tid 2 2024-03-30T12:26:38.821 INFO:tasks.rados.rados.0.smithi084.stdout:1217: writing smithi08477944-36 from 3104768 to 3710976 tid 3 2024-03-30T12:26:38.823 INFO:tasks.rados.rados.0.smithi084.stdout:1217: writing smithi08477944-36 from 3710976 to 3850240 tid 4 2024-03-30T12:26:38.823 INFO:tasks.rados.rados.0.smithi084.stdout:1218: rollback oid 48 current snap is 122 2024-03-30T12:26:38.823 INFO:tasks.rados.rados.0.smithi084.stdout:1218: done (4 left) 2024-03-30T12:26:38.823 INFO:tasks.rados.rados.0.smithi084.stdout:1219: snap_create 2024-03-30T12:26:38.823 INFO:tasks.rados.rados.0.smithi084.stdout:1214: finishing write tid 3 to smithi08477944-45 2024-03-30T12:26:38.823 INFO:tasks.rados.rados.0.smithi084.stdout:1214: finishing write tid 4 to smithi08477944-45 2024-03-30T12:26:38.823 INFO:tasks.rados.rados.0.smithi084.stdout:1214: finishing write tid 5 to smithi08477944-45 2024-03-30T12:26:38.823 INFO:tasks.rados.rados.0.smithi084.stdout:1214: oid 45 updating version 0 to 807 2024-03-30T12:26:38.823 INFO:tasks.rados.rados.0.smithi084.stdout:1214: oid 45 updating version 807 to 809 2024-03-30T12:26:38.824 INFO:tasks.rados.rados.0.smithi084.stdout:1214: oid 45 updating version 809 to 810 2024-03-30T12:26:38.824 INFO:tasks.rados.rados.0.smithi084.stdout:1214: oid 45 version 810 is already newer than 808 2024-03-30T12:26:38.824 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 810 (ObjNum 386 snap 122 seq_num 386) dirty exists 2024-03-30T12:26:38.824 INFO:tasks.rados.rados.0.smithi084.stdout:1214: left oid 45 (ObjNum 386 snap 122 seq_num 386) 2024-03-30T12:26:38.824 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 636 (ObjNum 324 snap 110 seq_num 324) dirty exists 2024-03-30T12:26:38.824 INFO:tasks.rados.rados.0.smithi084.stdout:1212: finishing copy_from racing read to smithi08477944-10 2024-03-30T12:26:38.824 INFO:tasks.rados.rados.0.smithi084.stdout:1212: finishing copy_from to smithi08477944-10 2024-03-30T12:26:38.824 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 499 (ObjNum 383 snap 121 seq_num 383) dirty exists 2024-03-30T12:26:38.824 INFO:tasks.rados.rados.0.smithi084.stdout:1217: finishing write tid 1 to smithi08477944-36 2024-03-30T12:26:38.824 INFO:tasks.rados.rados.0.smithi084.stdout:1217: finishing write tid 2 to smithi08477944-36 2024-03-30T12:26:38.825 INFO:tasks.rados.rados.0.smithi084.stdout:1217: finishing write tid 3 to smithi08477944-36 2024-03-30T12:26:38.825 INFO:tasks.rados.rados.0.smithi084.stdout:1217: finishing write tid 4 to smithi08477944-36 2024-03-30T12:26:38.826 INFO:tasks.rados.rados.0.smithi084.stdout:1217: finishing write tid 5 to smithi08477944-36 2024-03-30T12:26:38.827 INFO:tasks.rados.rados.0.smithi084.stdout:1217: finishing write tid 6 to smithi08477944-36 2024-03-30T12:26:38.827 INFO:tasks.rados.rados.0.smithi084.stdout:1217: oid 36 updating version 0 to 638 2024-03-30T12:26:38.827 INFO:tasks.rados.rados.0.smithi084.stdout:1217: oid 36 updating version 638 to 639 2024-03-30T12:26:38.827 INFO:tasks.rados.rados.0.smithi084.stdout:1217: oid 36 version 639 is already newer than 637 2024-03-30T12:26:38.828 INFO:tasks.rados.rados.0.smithi084.stdout:1217: oid 36 version 639 is already newer than 636 2024-03-30T12:26:38.828 INFO:tasks.rados.rados.0.smithi084.stdout:1217: oid 36 updating version 639 to 640 2024-03-30T12:26:38.828 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 640 (ObjNum 388 snap 122 seq_num 388) dirty exists 2024-03-30T12:26:38.828 INFO:tasks.rados.rados.0.smithi084.stdout:1217: left oid 36 (ObjNum 388 snap 122 seq_num 388) 2024-03-30T12:26:38.969 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:38 smithi084 ceph-mon[91810]: osdmap e319: 8 total, 8 up, 8 in 2024-03-30T12:26:38.969 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:38 smithi084 ceph-mon[91810]: pgmap v161: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 138 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 5.4 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-03-30T12:26:38.970 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:38.758+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:38.970 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:38.758+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:38.970 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:38 smithi084 ceph-mon[89279]: osdmap e319: 8 total, 8 up, 8 in 2024-03-30T12:26:38.970 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:38 smithi084 ceph-mon[89279]: pgmap v161: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 138 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 5.4 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-03-30T12:26:39.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:38 smithi162 ceph-mon[83709]: osdmap e319: 8 total, 8 up, 8 in 2024-03-30T12:26:39.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:38 smithi162 ceph-mon[83709]: pgmap v161: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 138 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 5.4 MiB/s rd, 2.0 MiB/s wr, 4 op/s 2024-03-30T12:26:39.573 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:26:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:26:39] "GET /metrics HTTP/1.1" 200 36187 "" "Prometheus/2.43.0" 2024-03-30T12:26:39.574 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:39 smithi084 systemd[1]: Stopping Ceph osd.1 for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:26:39.751 INFO:tasks.rados.rados.0.smithi084.stdout:1212: done (4 left) 2024-03-30T12:26:39.752 INFO:tasks.rados.rados.0.smithi084.stdout:1214: done (3 left) 2024-03-30T12:26:39.752 INFO:tasks.rados.rados.0.smithi084.stdout:1216: done (2 left) 2024-03-30T12:26:39.752 INFO:tasks.rados.rados.0.smithi084.stdout:1217: done (1 left) 2024-03-30T12:26:39.752 INFO:tasks.rados.rados.0.smithi084.stdout:1219: done (0 left) 2024-03-30T12:26:39.752 INFO:tasks.rados.rados.0.smithi084.stdout:1220: snap_remove snap 122 2024-03-30T12:26:40.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:40.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:40.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:39 smithi084 ceph-mon[91810]: osdmap e320: 8 total, 8 up, 8 in 2024-03-30T12:26:40.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:39 smithi084 ceph-mon[91810]: osd.1 marked itself down and dead 2024-03-30T12:26:40.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:39.770+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:40.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:40.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:40.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:39 smithi084 ceph-mon[89279]: osdmap e320: 8 total, 8 up, 8 in 2024-03-30T12:26:40.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:39 smithi084 ceph-mon[89279]: osd.1 marked itself down and dead 2024-03-30T12:26:40.006 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1[47593]: 2024-03-30T12:26:39.581+0000 7f175ce81700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:26:40.006 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1[47593]: 2024-03-30T12:26:39.581+0000 7f175ce81700 -1 osd.1 320 *** Got signal Terminated *** 2024-03-30T12:26:40.006 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1[47593]: 2024-03-30T12:26:39.581+0000 7f175ce81700 -1 osd.1 320 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T12:26:40.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:40.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:40.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:39 smithi162 ceph-mon[83709]: osdmap e320: 8 total, 8 up, 8 in 2024-03-30T12:26:40.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:39 smithi162 ceph-mon[83709]: osd.1 marked itself down and dead 2024-03-30T12:26:40.591 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:40 smithi084 podman[101473]: 2024-03-30 12:26:40.315952465 +0000 UTC m=+0.842508014 container died 3b30b0ea0e323aeccd2cb0f3cf829c313bb6a5082754bc4c6b94c15b06b0011d (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, RELEASE=reef-f14b568, org.label-schema.vendor=CentOS) 2024-03-30T12:26:40.772 INFO:tasks.rados.rados.0.smithi084.stdout:1220: done (0 left) 2024-03-30T12:26:40.773 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 123 2024-03-30T12:26:40.773 INFO:tasks.rados.rados.0.smithi084.stdout:1221: seq_num 389 ranges {4407296=524288,4931584=745472,5677056=458752} 2024-03-30T12:26:40.798 INFO:tasks.rados.rados.0.smithi084.stdout:1221: writing smithi08477944-29 from 4407296 to 4931584 tid 1 2024-03-30T12:26:40.802 INFO:tasks.rados.rados.0.smithi084.stdout:1221: writing smithi08477944-29 from 4931584 to 5677056 tid 2 2024-03-30T12:26:40.805 INFO:tasks.rados.rados.0.smithi084.stdout:1221: writing smithi08477944-29 from 5677056 to 6135808 tid 3 2024-03-30T12:26:40.805 INFO:tasks.rados.rados.0.smithi084.stdout:1222: copy_from oid 14 from oid 8 current snap is 123 2024-03-30T12:26:40.805 INFO:tasks.rados.rados.0.smithi084.stdout:1221: finishing write tid 1 to smithi08477944-29 2024-03-30T12:26:40.805 INFO:tasks.rados.rados.0.smithi084.stdout:1223: setattr oid 25 current snap is 123 2024-03-30T12:26:40.806 INFO:tasks.rados.rados.0.smithi084.stdout:1224: rollback oid 45 current snap is 123 2024-03-30T12:26:40.806 INFO:tasks.rados.rados.0.smithi084.stdout:1224: done (3 left) 2024-03-30T12:26:40.806 INFO:tasks.rados.rados.0.smithi084.stdout:1225: rollback oid 42 current snap is 123 2024-03-30T12:26:40.807 INFO:tasks.rados.rados.0.smithi084.stdout:1225: done (3 left) 2024-03-30T12:26:40.807 INFO:tasks.rados.rados.0.smithi084.stdout:1226: snap_create 2024-03-30T12:26:40.809 INFO:tasks.rados.rados.0.smithi084.stdout:1221: finishing write tid 2 to smithi08477944-29 2024-03-30T12:26:40.809 INFO:tasks.rados.rados.0.smithi084.stdout:1221: finishing write tid 3 to smithi08477944-29 2024-03-30T12:26:40.809 INFO:tasks.rados.rados.0.smithi084.stdout:1221: finishing write tid 4 to smithi08477944-29 2024-03-30T12:26:40.810 INFO:tasks.rados.rados.0.smithi084.stdout:1221: finishing write tid 5 to smithi08477944-29 2024-03-30T12:26:40.810 INFO:tasks.rados.rados.0.smithi084.stdout:1221: oid 29 updating version 0 to 639 2024-03-30T12:26:40.810 INFO:tasks.rados.rados.0.smithi084.stdout:1221: oid 29 version 639 is already newer than 637 2024-03-30T12:26:40.810 INFO:tasks.rados.rados.0.smithi084.stdout:1221: oid 29 version 639 is already newer than 638 2024-03-30T12:26:40.810 INFO:tasks.rados.rados.0.smithi084.stdout:1221: oid 29 updating version 639 to 640 2024-03-30T12:26:40.810 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 640 (ObjNum 389 snap 123 seq_num 389) dirty exists 2024-03-30T12:26:40.810 INFO:tasks.rados.rados.0.smithi084.stdout:1221: left oid 29 (ObjNum 389 snap 123 seq_num 389) 2024-03-30T12:26:40.811 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 500 (ObjNum 267 snap 84 seq_num 267) dirty exists 2024-03-30T12:26:40.819 INFO:tasks.rados.rados.0.smithi084.stdout:1222: finishing copy_from racing read to smithi08477944-14 2024-03-30T12:26:40.821 INFO:tasks.rados.rados.0.smithi084.stdout:1222: finishing copy_from to smithi08477944-14 2024-03-30T12:26:40.821 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 676 (ObjNum 365 snap 117 seq_num 365) dirty exists 2024-03-30T12:26:40.966 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:40.966 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:40.966 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:40 smithi084 ceph-mon[89279]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T12:26:40.966 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:40 smithi084 ceph-mon[89279]: osdmap e321: 8 total, 7 up, 8 in 2024-03-30T12:26:40.966 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:40 smithi084 ceph-mon[89279]: pgmap v164: 121 pgs: 37 peering, 1 stale+active+clean, 2 active+clean+snaptrim_error, 81 active+clean; 131 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 8.3 MiB/s rd, 2.3 MiB/s wr, 15 op/s 2024-03-30T12:26:40.967 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:40.967 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:40.967 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:40 smithi084 ceph-mon[91810]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T12:26:40.967 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:40 smithi084 ceph-mon[91810]: osdmap e321: 8 total, 7 up, 8 in 2024-03-30T12:26:40.967 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:40 smithi084 ceph-mon[91810]: pgmap v164: 121 pgs: 37 peering, 1 stale+active+clean, 2 active+clean+snaptrim_error, 81 active+clean; 131 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 8.3 MiB/s rd, 2.3 MiB/s wr, 15 op/s 2024-03-30T12:26:40.967 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:40.778+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:40.967 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:40 smithi084 podman[101473]: 2024-03-30 12:26:40.690247863 +0000 UTC m=+1.216803422 container cleanup 3b30b0ea0e323aeccd2cb0f3cf829c313bb6a5082754bc4c6b94c15b06b0011d (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, RELEASE=reef-f14b568, ceph=True, org.label-schema.build-date=20240326) 2024-03-30T12:26:40.967 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:40 smithi084 bash[101473]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1 2024-03-30T12:26:41.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:41.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset af=[]:{af=[ae,ad,ab,aa,a8,a1]} for object 5:a6b30f34:::smithi08477944-36:a0 2024-03-30T12:26:41.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:40 smithi162 ceph-mon[83709]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T12:26:41.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:40 smithi162 ceph-mon[83709]: osdmap e321: 8 total, 7 up, 8 in 2024-03-30T12:26:41.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:40 smithi162 ceph-mon[83709]: pgmap v164: 121 pgs: 37 peering, 1 stale+active+clean, 2 active+clean+snaptrim_error, 81 active+clean; 131 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 8.3 MiB/s rd, 2.3 MiB/s wr, 15 op/s 2024-03-30T12:26:41.253 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:40 smithi084 podman[101501]: 2024-03-30 12:26:40.975218862 +0000 UTC m=+0.656744790 container remove 3b30b0ea0e323aeccd2cb0f3cf829c313bb6a5082754bc4c6b94c15b06b0011d (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, RELEASE=reef-f14b568, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-03-30T12:26:41.624 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:41 smithi084 podman[101593]: 2024-03-30 12:26:41.207496157 +0000 UTC m=+0.017946707 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:26:41.625 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:41 smithi084 podman[101593]: 2024-03-30 12:26:41.309570921 +0000 UTC m=+0.120021520 container create 10b9dafd5352750a7ae3e54109d75ecc90de7aa6f18afe4571e79b6946b10bc9 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1-deactivate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.schema-version=1.0) 2024-03-30T12:26:41.625 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:41 smithi084 podman[101593]: 2024-03-30 12:26:41.511992584 +0000 UTC m=+0.322443130 container init 10b9dafd5352750a7ae3e54109d75ecc90de7aa6f18afe4571e79b6946b10bc9 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:26:41.625 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:41 smithi084 podman[101593]: 2024-03-30 12:26:41.515322014 +0000 UTC m=+0.325772562 container start 10b9dafd5352750a7ae3e54109d75ecc90de7aa6f18afe4571e79b6946b10bc9 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1-deactivate, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T12:26:41.761 INFO:tasks.rados.rados.0.smithi084.stdout:1221: done (3 left) 2024-03-30T12:26:41.761 INFO:tasks.rados.rados.0.smithi084.stdout:1222: done (2 left) 2024-03-30T12:26:41.761 INFO:tasks.rados.rados.0.smithi084.stdout:1223: done (1 left) 2024-03-30T12:26:41.761 INFO:tasks.rados.rados.0.smithi084.stdout:1226: done (0 left) 2024-03-30T12:26:41.761 INFO:tasks.rados.rados.0.smithi084.stdout:1227: delete oid 14 current snap is 124 2024-03-30T12:26:41.766 INFO:tasks.rados.rados.0.smithi084.stdout:1227: done (0 left) 2024-03-30T12:26:41.766 INFO:tasks.rados.rados.0.smithi084.stdout:1228: read oid 24 snap -1 2024-03-30T12:26:41.766 INFO:tasks.rados.rados.0.smithi084.stdout:1228: expect (ObjNum 286 snap 92 seq_num 286) 2024-03-30T12:26:41.766 INFO:tasks.rados.rados.0.smithi084.stdout:1229: delete oid 36 current snap is 124 2024-03-30T12:26:41.770 INFO:tasks.rados.rados.0.smithi084.stdout:1229: done (1 left) 2024-03-30T12:26:41.770 INFO:tasks.rados.rados.0.smithi084.stdout:1230: snap_remove snap 123 2024-03-30T12:26:42.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:41.774+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:42.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:42.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:41 smithi084 ceph-mon[89279]: Health check failed: Reduced data availability: 10 pgs inactive, 13 pgs peering (PG_AVAILABILITY) 2024-03-30T12:26:42.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:41 smithi084 ceph-mon[89279]: osdmap e322: 8 total, 7 up, 8 in 2024-03-30T12:26:42.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:42.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:41 smithi084 ceph-mon[91810]: Health check failed: Reduced data availability: 10 pgs inactive, 13 pgs peering (PG_AVAILABILITY) 2024-03-30T12:26:42.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:41 smithi084 ceph-mon[91810]: osdmap e322: 8 total, 7 up, 8 in 2024-03-30T12:26:42.005 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:41 smithi084 podman[101593]: 2024-03-30 12:26:41.633970461 +0000 UTC m=+0.444421009 container attach 10b9dafd5352750a7ae3e54109d75ecc90de7aa6f18afe4571e79b6946b10bc9 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=) 2024-03-30T12:26:42.005 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:41 smithi084 podman[101593]: 2024-03-30 12:26:41.817044649 +0000 UTC m=+0.627495187 container died 10b9dafd5352750a7ae3e54109d75ecc90de7aa6f18afe4571e79b6946b10bc9 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326) 2024-03-30T12:26:42.021 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:42.021 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:41 smithi162 ceph-mon[83709]: Health check failed: Reduced data availability: 10 pgs inactive, 13 pgs peering (PG_AVAILABILITY) 2024-03-30T12:26:42.021 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:41 smithi162 ceph-mon[83709]: osdmap e322: 8 total, 7 up, 8 in 2024-03-30T12:26:42.747 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:42 smithi084 podman[101619]: 2024-03-30 12:26:42.448405939 +0000 UTC m=+0.625772846 container remove 10b9dafd5352750a7ae3e54109d75ecc90de7aa6f18afe4571e79b6946b10bc9 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T12:26:42.747 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:42 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.1.service: Deactivated successfully. 2024-03-30T12:26:42.747 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:42 smithi084 systemd[1]: Stopped Ceph osd.1 for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:26:42.747 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:42 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.1.service: Consumed 11.028s CPU time. 2024-03-30T12:26:42.747 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:42 smithi084 systemd[1]: Starting Ceph osd.1 for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:26:42.768 INFO:tasks.rados.rados.0.smithi084.stdout:1230: done (1 left) 2024-03-30T12:26:42.768 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 124 2024-03-30T12:26:42.768 INFO:tasks.rados.rados.0.smithi084.stdout:1228: expect (ObjNum 286 snap 92 seq_num 286) 2024-03-30T12:26:43.000 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:42.957+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:43.000 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:43.000 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:42 smithi084 ceph-mon[91810]: osdmap e323: 8 total, 7 up, 8 in 2024-03-30T12:26:43.000 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:43.001 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:42 smithi084 ceph-mon[91810]: pgmap v167: 121 pgs: 1 peering+snaptrim_error, 43 peering, 1 active+clean+snaptrim_error, 76 active+clean; 133 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.7 MiB/s wr, 17 op/s 2024-03-30T12:26:43.001 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:43.001 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:42 smithi084 ceph-mon[89279]: osdmap e323: 8 total, 7 up, 8 in 2024-03-30T12:26:43.001 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:43.001 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:42 smithi084 ceph-mon[89279]: pgmap v167: 121 pgs: 1 peering+snaptrim_error, 43 peering, 1 active+clean+snaptrim_error, 76 active+clean; 133 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.7 MiB/s wr, 17 op/s 2024-03-30T12:26:43.001 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:42 smithi084 podman[101727]: 2024-03-30 12:26:42.792614435 +0000 UTC m=+0.018075638 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:26:43.001 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:42 smithi084 podman[101727]: 2024-03-30 12:26:42.891164491 +0000 UTC m=+0.116625672 container create 3ac8a1d507efef3b935f8399e6cb3cd0072e4af94028fbeeef68512f692e7392 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1-activate, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=) 2024-03-30T12:26:43.106 INFO:tasks.rados.rados.0.smithi084.stdout:1231: seq_num 392 ranges {4120576=573440,4694016=802816,5496832=401408} 2024-03-30T12:26:43.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:43.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:42 smithi162 ceph-mon[83709]: osdmap e323: 8 total, 7 up, 8 in 2024-03-30T12:26:43.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:43.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:42 smithi162 ceph-mon[83709]: pgmap v167: 121 pgs: 1 peering+snaptrim_error, 43 peering, 1 active+clean+snaptrim_error, 76 active+clean; 133 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.7 MiB/s wr, 17 op/s 2024-03-30T12:26:43.130 INFO:tasks.rados.rados.0.smithi084.stdout:1231: writing smithi08477944-25 from 4120576 to 4694016 tid 1 2024-03-30T12:26:43.135 INFO:tasks.rados.rados.0.smithi084.stdout:1231: writing smithi08477944-25 from 4694016 to 5496832 tid 2 2024-03-30T12:26:43.139 INFO:tasks.rados.rados.0.smithi084.stdout:1231: writing smithi08477944-25 from 5496832 to 5898240 tid 3 2024-03-30T12:26:43.139 INFO:tasks.rados.rados.0.smithi084.stdout:1228: done (1 left) 2024-03-30T12:26:43.139 INFO:tasks.rados.rados.0.smithi084.stdout:1232: read oid 23 snap -1 2024-03-30T12:26:43.139 INFO:tasks.rados.rados.0.smithi084.stdout:1232: expect (ObjNum 312 snap 103 seq_num 312) 2024-03-30T12:26:43.139 INFO:tasks.rados.rados.0.smithi084.stdout:1233: snap_create 2024-03-30T12:26:43.141 INFO:tasks.rados.rados.0.smithi084.stdout:1231: finishing write tid 1 to smithi08477944-25 2024-03-30T12:26:43.142 INFO:tasks.rados.rados.0.smithi084.stdout:1231: finishing write tid 2 to smithi08477944-25 2024-03-30T12:26:43.142 INFO:tasks.rados.rados.0.smithi084.stdout:1231: finishing write tid 3 to smithi08477944-25 2024-03-30T12:26:43.143 INFO:tasks.rados.rados.0.smithi084.stdout:1231: finishing write tid 4 to smithi08477944-25 2024-03-30T12:26:43.144 INFO:tasks.rados.rados.0.smithi084.stdout:1231: finishing write tid 5 to smithi08477944-25 2024-03-30T12:26:43.144 INFO:tasks.rados.rados.0.smithi084.stdout:1231: oid 25 updating version 0 to 501 2024-03-30T12:26:43.144 INFO:tasks.rados.rados.0.smithi084.stdout:1231: oid 25 updating version 501 to 504 2024-03-30T12:26:43.144 INFO:tasks.rados.rados.0.smithi084.stdout:1231: oid 25 version 504 is already newer than 503 2024-03-30T12:26:43.144 INFO:tasks.rados.rados.0.smithi084.stdout:1231: oid 25 version 504 is already newer than 502 2024-03-30T12:26:43.145 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 504 (ObjNum 392 snap 124 seq_num 392) dirty exists 2024-03-30T12:26:43.145 INFO:tasks.rados.rados.0.smithi084.stdout:1231: left oid 25 (ObjNum 392 snap 124 seq_num 392) 2024-03-30T12:26:43.146 INFO:tasks.rados.rados.0.smithi084.stdout:1232: expect (ObjNum 312 snap 103 seq_num 312) 2024-03-30T12:26:43.253 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:43 smithi084 podman[101727]: 2024-03-30 12:26:43.144378887 +0000 UTC m=+0.369840112 container init 3ac8a1d507efef3b935f8399e6cb3cd0072e4af94028fbeeef68512f692e7392 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-03-30T12:26:43.253 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:43 smithi084 podman[101727]: 2024-03-30 12:26:43.149510619 +0000 UTC m=+0.374971803 container start 3ac8a1d507efef3b935f8399e6cb3cd0072e4af94028fbeeef68512f692e7392 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1-activate, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3) 2024-03-30T12:26:43.254 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:43 smithi084 podman[101727]: 2024-03-30 12:26:43.252243477 +0000 UTC m=+0.477704667 container attach 3ac8a1d507efef3b935f8399e6cb3cd0072e4af94028fbeeef68512f692e7392 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1-activate, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:26:43.772 INFO:tasks.rados.rados.0.smithi084.stdout:1231: done (2 left) 2024-03-30T12:26:43.772 INFO:tasks.rados.rados.0.smithi084.stdout:1232: done (1 left) 2024-03-30T12:26:43.772 INFO:tasks.rados.rados.0.smithi084.stdout:1233: done (0 left) 2024-03-30T12:26:43.772 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 125 2024-03-30T12:26:43.772 INFO:tasks.rados.rados.0.smithi084.stdout:1234: seq_num 393 ranges {6135808=589824,6725632=679936,7405568=524288} 2024-03-30T12:26:43.809 INFO:tasks.rados.rados.0.smithi084.stdout:1234: writing smithi08477944-29 from 6135808 to 6725632 tid 1 2024-03-30T12:26:43.811 INFO:tasks.rados.rados.0.smithi084.stdout:1234: writing smithi08477944-29 from 6725632 to 7405568 tid 2 2024-03-30T12:26:43.817 INFO:tasks.rados.rados.0.smithi084.stdout:1234: writing smithi08477944-29 from 7405568 to 7929856 tid 3 2024-03-30T12:26:43.817 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 125 2024-03-30T12:26:43.817 INFO:tasks.rados.rados.0.smithi084.stdout:1234: finishing write tid 1 to smithi08477944-29 2024-03-30T12:26:43.817 INFO:tasks.rados.rados.0.smithi084.stdout:1235: seq_num 394 ranges {5898240=606208,6504448=565248,7069696=557056,7626752=81920} 2024-03-30T12:26:43.851 INFO:tasks.rados.rados.0.smithi084.stdout:1235: writing smithi08477944-25 from 5898240 to 6504448 tid 1 2024-03-30T12:26:43.859 INFO:tasks.rados.rados.0.smithi084.stdout:1235: writing smithi08477944-25 from 6504448 to 7069696 tid 2 2024-03-30T12:26:43.859 INFO:tasks.rados.rados.0.smithi084.stdout:1235: writing smithi08477944-25 from 7069696 to 7626752 tid 3 2024-03-30T12:26:43.861 INFO:tasks.rados.rados.0.smithi084.stdout:1235: writing smithi08477944-25 from 7626752 to 7708672 tid 4 2024-03-30T12:26:43.861 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 125 2024-03-30T12:26:43.861 INFO:tasks.rados.rados.0.smithi084.stdout:1234: finishing write tid 2 to smithi08477944-29 2024-03-30T12:26:43.861 INFO:tasks.rados.rados.0.smithi084.stdout:1236: seq_num 395 ranges {434176=622592,1056768=450560,1507328=753664} 2024-03-30T12:26:43.865 INFO:tasks.rados.rados.0.smithi084.stdout:1236: writing smithi08477944-16 from 434176 to 1056768 tid 1 2024-03-30T12:26:43.867 INFO:tasks.rados.rados.0.smithi084.stdout:1236: writing smithi08477944-16 from 1056768 to 1507328 tid 2 2024-03-30T12:26:43.871 INFO:tasks.rados.rados.0.smithi084.stdout:1236: writing smithi08477944-16 from 1507328 to 2260992 tid 3 2024-03-30T12:26:43.871 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 125 2024-03-30T12:26:43.871 INFO:tasks.rados.rados.0.smithi084.stdout:1234: finishing write tid 3 to smithi08477944-29 2024-03-30T12:26:43.871 INFO:tasks.rados.rados.0.smithi084.stdout:1234: finishing write tid 4 to smithi08477944-29 2024-03-30T12:26:43.871 INFO:tasks.rados.rados.0.smithi084.stdout:1234: finishing write tid 5 to smithi08477944-29 2024-03-30T12:26:43.871 INFO:tasks.rados.rados.0.smithi084.stdout:1234: oid 29 updating version 0 to 644 2024-03-30T12:26:43.871 INFO:tasks.rados.rados.0.smithi084.stdout:1234: oid 29 version 644 is already newer than 641 2024-03-30T12:26:43.871 INFO:tasks.rados.rados.0.smithi084.stdout:1234: oid 29 version 644 is already newer than 642 2024-03-30T12:26:43.872 INFO:tasks.rados.rados.0.smithi084.stdout:1234: oid 29 version 644 is already newer than 643 2024-03-30T12:26:43.872 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 644 (ObjNum 393 snap 125 seq_num 393) dirty exists 2024-03-30T12:26:43.872 INFO:tasks.rados.rados.0.smithi084.stdout:1234: left oid 29 (ObjNum 393 snap 125 seq_num 393) 2024-03-30T12:26:43.872 INFO:tasks.rados.rados.0.smithi084.stdout:1235: finishing write tid 1 to smithi08477944-25 2024-03-30T12:26:43.872 INFO:tasks.rados.rados.0.smithi084.stdout:1235: finishing write tid 2 to smithi08477944-25 2024-03-30T12:26:43.872 INFO:tasks.rados.rados.0.smithi084.stdout:1235: finishing write tid 3 to smithi08477944-25 2024-03-30T12:26:43.872 INFO:tasks.rados.rados.0.smithi084.stdout:1235: finishing write tid 4 to smithi08477944-25 2024-03-30T12:26:43.872 INFO:tasks.rados.rados.0.smithi084.stdout:1237: seq_num 396 ranges {1671168=638976,2310144=786432,3096576=417792} 2024-03-30T12:26:43.883 INFO:tasks.rados.rados.0.smithi084.stdout:1237: writing smithi08477944-45 from 1671168 to 2310144 tid 1 2024-03-30T12:26:43.888 INFO:tasks.rados.rados.0.smithi084.stdout:1237: writing smithi08477944-45 from 2310144 to 3096576 tid 2 2024-03-30T12:26:43.890 INFO:tasks.rados.rados.0.smithi084.stdout:1237: writing smithi08477944-45 from 3096576 to 3514368 tid 3 2024-03-30T12:26:43.890 INFO:tasks.rados.rados.0.smithi084.stdout:1234: done (3 left) 2024-03-30T12:26:43.890 INFO:tasks.rados.rados.0.smithi084.stdout:1238: snap_remove snap 124 2024-03-30T12:26:43.913 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:43.822+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:43.914 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:43 smithi084 ceph-mon[89279]: osdmap e324: 8 total, 7 up, 8 in 2024-03-30T12:26:43.914 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:43.914 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:43 smithi084 ceph-mon[91810]: osdmap e324: 8 total, 7 up, 8 in 2024-03-30T12:26:43.914 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:43.914 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1-activate[101742]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-30T12:26:43.914 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1-activate[101742]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-03-30T12:26:43.915 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:43 smithi084 bash[101727]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-30T12:26:43.915 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:43 smithi084 bash[101727]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-03-30T12:26:43.915 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:43 smithi084 bash[101727]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-03-30T12:26:43.915 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:43 smithi084 bash[101727]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-03-30T12:26:43.915 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:43 smithi084 bash[101727]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-03-30T12:26:43.915 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:43 smithi084 bash[101727]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-30T12:26:43.915 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:43 smithi084 bash[101727]: --> ceph-volume raw activate successful for osd ID: 1 2024-03-30T12:26:43.915 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1-activate[101742]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-03-30T12:26:43.915 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1-activate[101742]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-03-30T12:26:43.915 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1-activate[101742]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-03-30T12:26:43.915 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1-activate[101742]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-30T12:26:43.915 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1-activate[101742]: --> ceph-volume raw activate successful for osd ID: 1 2024-03-30T12:26:43.915 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:43 smithi084 podman[101727]: 2024-03-30 12:26:43.621158281 +0000 UTC m=+0.846619454 container died 3ac8a1d507efef3b935f8399e6cb3cd0072e4af94028fbeeef68512f692e7392 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1-activate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-03-30T12:26:44.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:43 smithi162 ceph-mon[83709]: osdmap e324: 8 total, 7 up, 8 in 2024-03-30T12:26:44.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:44.504 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:44 smithi084 podman[101875]: 2024-03-30 12:26:44.189080375 +0000 UTC m=+0.562783953 container remove 3ac8a1d507efef3b935f8399e6cb3cd0072e4af94028fbeeef68512f692e7392 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1-activate, CEPH_POINT_RELEASE=, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:26:44.504 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:44 smithi084 podman[101936]: 2024-03-30 12:26:44.301740939 +0000 UTC m=+0.018434641 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:26:44.504 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:44 smithi084 podman[101936]: 2024-03-30 12:26:44.406589171 +0000 UTC m=+0.123282858 container create 7518832f6b4a391e2435e2e75922ddfc415518e90fe1f1ea857527acb77b0499 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-03-30T12:26:44.773 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:44 smithi084 podman[101936]: 2024-03-30 12:26:44.625627258 +0000 UTC m=+0.342320961 container init 7518832f6b4a391e2435e2e75922ddfc415518e90fe1f1ea857527acb77b0499 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD) 2024-03-30T12:26:44.773 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:44 smithi084 podman[101936]: 2024-03-30 12:26:44.628650437 +0000 UTC m=+0.345344131 container start 7518832f6b4a391e2435e2e75922ddfc415518e90fe1f1ea857527acb77b0499 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T12:26:44.773 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:44 smithi084 ceph-osd[101955]: -- 172.21.15.84:0/4074155596 <== mon.2 v2:172.21.15.84:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558af4319680 con 0x558af42e3000 2024-03-30T12:26:44.773 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:44 smithi084 bash[101936]: 7518832f6b4a391e2435e2e75922ddfc415518e90fe1f1ea857527acb77b0499 2024-03-30T12:26:44.773 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:44 smithi084 systemd[1]: Started Ceph osd.1 for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:26:44.777 INFO:tasks.rados.rados.0.smithi084.stdout:1238: done (3 left) 2024-03-30T12:26:44.777 INFO:tasks.rados.rados.0.smithi084.stdout:1239: rollback oid 21 current snap is 125 2024-03-30T12:26:44.777 INFO:tasks.rados.rados.0.smithi084.stdout:1239: done (3 left) 2024-03-30T12:26:44.777 INFO:tasks.rados.rados.0.smithi084.stdout:1240: read oid 50 snap -1 2024-03-30T12:26:44.777 INFO:tasks.rados.rados.0.smithi084.stdout:1240: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:26:44.777 INFO:tasks.rados.rados.0.smithi084.stdout:1241: read oid 42 snap -1 2024-03-30T12:26:44.777 INFO:tasks.rados.rados.0.smithi084.stdout:1241: expect (ObjNum 205 snap 62 seq_num 205) 2024-03-30T12:26:44.777 INFO:tasks.rados.rados.0.smithi084.stdout:1242: delete oid 48 current snap is 125 2024-03-30T12:26:44.777 INFO:tasks.rados.rados.0.smithi084.stdout:1235: finishing write tid 5 to smithi08477944-25 2024-03-30T12:26:44.777 INFO:tasks.rados.rados.0.smithi084.stdout:1235: finishing write tid 6 to smithi08477944-25 2024-03-30T12:26:44.777 INFO:tasks.rados.rados.0.smithi084.stdout:1235: oid 25 updating version 0 to 506 2024-03-30T12:26:44.778 INFO:tasks.rados.rados.0.smithi084.stdout:1235: oid 25 updating version 506 to 509 2024-03-30T12:26:44.778 INFO:tasks.rados.rados.0.smithi084.stdout:1235: oid 25 version 509 is already newer than 505 2024-03-30T12:26:44.778 INFO:tasks.rados.rados.0.smithi084.stdout:1235: oid 25 version 509 is already newer than 508 2024-03-30T12:26:44.778 INFO:tasks.rados.rados.0.smithi084.stdout:1235: oid 25 version 509 is already newer than 507 2024-03-30T12:26:44.778 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 509 (ObjNum 394 snap 125 seq_num 394) dirty exists 2024-03-30T12:26:44.778 INFO:tasks.rados.rados.0.smithi084.stdout:1235: left oid 25 (ObjNum 394 snap 125 seq_num 394) 2024-03-30T12:26:44.778 INFO:tasks.rados.rados.0.smithi084.stdout:1236: finishing write tid 1 to smithi08477944-16 2024-03-30T12:26:44.778 INFO:tasks.rados.rados.0.smithi084.stdout:1236: finishing write tid 2 to smithi08477944-16 2024-03-30T12:26:44.778 INFO:tasks.rados.rados.0.smithi084.stdout:1236: finishing write tid 3 to smithi08477944-16 2024-03-30T12:26:44.778 INFO:tasks.rados.rados.0.smithi084.stdout:1236: finishing write tid 4 to smithi08477944-16 2024-03-30T12:26:44.778 INFO:tasks.rados.rados.0.smithi084.stdout:1236: finishing write tid 5 to smithi08477944-16 2024-03-30T12:26:44.778 INFO:tasks.rados.rados.0.smithi084.stdout:1236: oid 16 updating version 0 to 814 2024-03-30T12:26:44.778 INFO:tasks.rados.rados.0.smithi084.stdout:1236: oid 16 version 814 is already newer than 813 2024-03-30T12:26:44.778 INFO:tasks.rados.rados.0.smithi084.stdout:1236: oid 16 updating version 814 to 815 2024-03-30T12:26:44.778 INFO:tasks.rados.rados.0.smithi084.stdout:1236: oid 16 version 815 is already newer than 812 2024-03-30T12:26:44.779 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 815 (ObjNum 395 snap 125 seq_num 395) dirty exists 2024-03-30T12:26:44.779 INFO:tasks.rados.rados.0.smithi084.stdout:1236: left oid 16 (ObjNum 395 snap 125 seq_num 395) 2024-03-30T12:26:44.779 INFO:tasks.rados.rados.0.smithi084.stdout:1237: finishing write tid 1 to smithi08477944-45 2024-03-30T12:26:44.779 INFO:tasks.rados.rados.0.smithi084.stdout:1237: finishing write tid 2 to smithi08477944-45 2024-03-30T12:26:44.779 INFO:tasks.rados.rados.0.smithi084.stdout:1237: finishing write tid 3 to smithi08477944-45 2024-03-30T12:26:44.779 INFO:tasks.rados.rados.0.smithi084.stdout:1237: finishing write tid 4 to smithi08477944-45 2024-03-30T12:26:44.779 INFO:tasks.rados.rados.0.smithi084.stdout:1237: finishing write tid 5 to smithi08477944-45 2024-03-30T12:26:44.779 INFO:tasks.rados.rados.0.smithi084.stdout:1237: oid 45 updating version 0 to 817 2024-03-30T12:26:44.779 INFO:tasks.rados.rados.0.smithi084.stdout:1237: oid 45 updating version 817 to 818 2024-03-30T12:26:44.779 INFO:tasks.rados.rados.0.smithi084.stdout:1237: oid 45 updating version 818 to 819 2024-03-30T12:26:44.779 INFO:tasks.rados.rados.0.smithi084.stdout:1237: oid 45 updating version 819 to 820 2024-03-30T12:26:44.779 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 820 (ObjNum 396 snap 125 seq_num 396) dirty exists 2024-03-30T12:26:44.779 INFO:tasks.rados.rados.0.smithi084.stdout:1237: left oid 45 (ObjNum 396 snap 125 seq_num 396) 2024-03-30T12:26:44.781 INFO:tasks.rados.rados.0.smithi084.stdout:1240: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:26:44.785 INFO:tasks.rados.rados.0.smithi084.stdout:1235: done (5 left) 2024-03-30T12:26:44.785 INFO:tasks.rados.rados.0.smithi084.stdout:1236: done (4 left) 2024-03-30T12:26:44.785 INFO:tasks.rados.rados.0.smithi084.stdout:1237: done (3 left) 2024-03-30T12:26:44.785 INFO:tasks.rados.rados.0.smithi084.stdout:1240: done (2 left) 2024-03-30T12:26:44.785 INFO:tasks.rados.rados.0.smithi084.stdout:1242: done (1 left) 2024-03-30T12:26:44.785 INFO:tasks.rados.rados.0.smithi084.stdout:1243: delete oid 9 current snap is 125 2024-03-30T12:26:44.787 INFO:tasks.rados.rados.0.smithi084.stdout:1243: done (1 left) 2024-03-30T12:26:44.787 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 125 2024-03-30T12:26:44.787 INFO:tasks.rados.rados.0.smithi084.stdout:1244: seq_num 399 ranges {0=688128,688128=434176,1122304=745472,1867776=24576} 2024-03-30T12:26:44.791 INFO:tasks.rados.rados.0.smithi084.stdout:1244: writing smithi08477944-4 from 0 to 688128 tid 1 2024-03-30T12:26:44.794 INFO:tasks.rados.rados.0.smithi084.stdout:1244: writing smithi08477944-4 from 688128 to 1122304 tid 2 2024-03-30T12:26:44.799 INFO:tasks.rados.rados.0.smithi084.stdout:1244: writing smithi08477944-4 from 1122304 to 1867776 tid 3 2024-03-30T12:26:44.799 INFO:tasks.rados.rados.0.smithi084.stdout:1244: writing smithi08477944-4 from 1867776 to 1892352 tid 4 2024-03-30T12:26:44.799 INFO:tasks.rados.rados.0.smithi084.stdout:1245: delete oid 27 current snap is 125 2024-03-30T12:26:44.799 INFO:tasks.rados.rados.0.smithi084.stdout:1241: expect (ObjNum 205 snap 62 seq_num 205) 2024-03-30T12:26:44.924 INFO:tasks.rados.rados.0.smithi084.stdout:1244: finishing write tid 1 to smithi08477944-4 2024-03-30T12:26:44.924 INFO:tasks.rados.rados.0.smithi084.stdout:1244: finishing write tid 2 to smithi08477944-4 2024-03-30T12:26:44.924 INFO:tasks.rados.rados.0.smithi084.stdout:1244: finishing write tid 3 to smithi08477944-4 2024-03-30T12:26:44.924 INFO:tasks.rados.rados.0.smithi084.stdout:1241: done (2 left) 2024-03-30T12:26:44.924 INFO:tasks.rados.rados.0.smithi084.stdout:1245: done (1 left) 2024-03-30T12:26:44.924 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 125 2024-03-30T12:26:44.924 INFO:tasks.rados.rados.0.smithi084.stdout:1244: finishing write tid 4 to smithi08477944-4 2024-03-30T12:26:44.925 INFO:tasks.rados.rados.0.smithi084.stdout:1244: finishing write tid 5 to smithi08477944-4 2024-03-30T12:26:44.925 INFO:tasks.rados.rados.0.smithi084.stdout:1244: finishing write tid 6 to smithi08477944-4 2024-03-30T12:26:44.925 INFO:tasks.rados.rados.0.smithi084.stdout:1244: oid 4 updating version 0 to 647 2024-03-30T12:26:44.925 INFO:tasks.rados.rados.0.smithi084.stdout:1244: oid 4 updating version 647 to 649 2024-03-30T12:26:44.925 INFO:tasks.rados.rados.0.smithi084.stdout:1244: oid 4 version 649 is already newer than 648 2024-03-30T12:26:44.925 INFO:tasks.rados.rados.0.smithi084.stdout:1244: oid 4 version 649 is already newer than 645 2024-03-30T12:26:44.925 INFO:tasks.rados.rados.0.smithi084.stdout:1244: oid 4 version 649 is already newer than 646 2024-03-30T12:26:44.925 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 649 (ObjNum 399 snap 125 seq_num 399) dirty exists 2024-03-30T12:26:44.925 INFO:tasks.rados.rados.0.smithi084.stdout:1244: left oid 4 (ObjNum 399 snap 125 seq_num 399) 2024-03-30T12:26:44.925 INFO:tasks.rados.rados.0.smithi084.stdout:1246: seq_num 401 ranges {3112960=720896,3833856=606208,4440064=598016} 2024-03-30T12:26:44.944 INFO:tasks.rados.rados.0.smithi084.stdout:1246: writing smithi08477944-8 from 3112960 to 3833856 tid 1 2024-03-30T12:26:44.947 INFO:tasks.rados.rados.0.smithi084.stdout:1246: writing smithi08477944-8 from 3833856 to 4440064 tid 2 2024-03-30T12:26:44.951 INFO:tasks.rados.rados.0.smithi084.stdout:1246: writing smithi08477944-8 from 4440064 to 5038080 tid 3 2024-03-30T12:26:44.951 INFO:tasks.rados.rados.0.smithi084.stdout:1244: done (1 left) 2024-03-30T12:26:44.951 INFO:tasks.rados.rados.0.smithi084.stdout:1247: rollback oid 18 current snap is 125 2024-03-30T12:26:44.951 INFO:tasks.rados.rados.0.smithi084.stdout:1247: done (1 left) 2024-03-30T12:26:44.951 INFO:tasks.rados.rados.0.smithi084.stdout:1248: rollback oid 11 current snap is 125 2024-03-30T12:26:44.951 INFO:tasks.rados.rados.0.smithi084.stdout:1248: done (1 left) 2024-03-30T12:26:44.951 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 125 2024-03-30T12:26:44.951 INFO:tasks.rados.rados.0.smithi084.stdout:1246: finishing write tid 1 to smithi08477944-8 2024-03-30T12:26:44.952 INFO:tasks.rados.rados.0.smithi084.stdout:1246: finishing write tid 2 to smithi08477944-8 2024-03-30T12:26:44.952 INFO:tasks.rados.rados.0.smithi084.stdout:1249: seq_num 402 ranges {434176=737280,1171456=491520,1662976=516096,2179072=196608} 2024-03-30T12:26:44.957 INFO:tasks.rados.rados.0.smithi084.stdout:1249: writing smithi08477944-23 from 434176 to 1171456 tid 1 2024-03-30T12:26:44.960 INFO:tasks.rados.rados.0.smithi084.stdout:1249: writing smithi08477944-23 from 1171456 to 1662976 tid 2 2024-03-30T12:26:44.963 INFO:tasks.rados.rados.0.smithi084.stdout:1249: writing smithi08477944-23 from 1662976 to 2179072 tid 3 2024-03-30T12:26:44.965 INFO:tasks.rados.rados.0.smithi084.stdout:1249: writing smithi08477944-23 from 2179072 to 2375680 tid 4 2024-03-30T12:26:44.965 INFO:tasks.rados.rados.0.smithi084.stdout:1250: read oid 25 snap -1 2024-03-30T12:26:44.965 INFO:tasks.rados.rados.0.smithi084.stdout:1250: expect (ObjNum 394 snap 125 seq_num 394) 2024-03-30T12:26:44.965 INFO:tasks.rados.rados.0.smithi084.stdout:1251: snap_create 2024-03-30T12:26:44.965 INFO:tasks.rados.rados.0.smithi084.stdout:1246: finishing write tid 3 to smithi08477944-8 2024-03-30T12:26:44.965 INFO:tasks.rados.rados.0.smithi084.stdout:1246: finishing write tid 4 to smithi08477944-8 2024-03-30T12:26:44.965 INFO:tasks.rados.rados.0.smithi084.stdout:1246: finishing write tid 5 to smithi08477944-8 2024-03-30T12:26:44.965 INFO:tasks.rados.rados.0.smithi084.stdout:1246: oid 8 updating version 0 to 766 2024-03-30T12:26:44.965 INFO:tasks.rados.rados.0.smithi084.stdout:1246: oid 8 version 766 is already newer than 764 2024-03-30T12:26:44.966 INFO:tasks.rados.rados.0.smithi084.stdout:1246: oid 8 updating version 766 to 767 2024-03-30T12:26:44.966 INFO:tasks.rados.rados.0.smithi084.stdout:1246: oid 8 version 767 is already newer than 765 2024-03-30T12:26:44.966 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 767 (ObjNum 401 snap 125 seq_num 401) dirty exists 2024-03-30T12:26:44.966 INFO:tasks.rados.rados.0.smithi084.stdout:1246: left oid 8 (ObjNum 401 snap 125 seq_num 401) 2024-03-30T12:26:44.966 INFO:tasks.rados.rados.0.smithi084.stdout:1249: finishing write tid 1 to smithi08477944-23 2024-03-30T12:26:44.966 INFO:tasks.rados.rados.0.smithi084.stdout:1249: finishing write tid 2 to smithi08477944-23 2024-03-30T12:26:44.966 INFO:tasks.rados.rados.0.smithi084.stdout:1249: finishing write tid 3 to smithi08477944-23 2024-03-30T12:26:44.966 INFO:tasks.rados.rados.0.smithi084.stdout:1249: finishing write tid 4 to smithi08477944-23 2024-03-30T12:26:44.967 INFO:tasks.rados.rados.0.smithi084.stdout:1249: finishing write tid 5 to smithi08477944-23 2024-03-30T12:26:44.968 INFO:tasks.rados.rados.0.smithi084.stdout:1249: finishing write tid 6 to smithi08477944-23 2024-03-30T12:26:44.968 INFO:tasks.rados.rados.0.smithi084.stdout:1249: oid 23 updating version 0 to 644 2024-03-30T12:26:44.969 INFO:tasks.rados.rados.0.smithi084.stdout:1249: oid 23 version 644 is already newer than 643 2024-03-30T12:26:44.969 INFO:tasks.rados.rados.0.smithi084.stdout:1249: oid 23 updating version 644 to 645 2024-03-30T12:26:44.969 INFO:tasks.rados.rados.0.smithi084.stdout:1249: oid 23 updating version 645 to 646 2024-03-30T12:26:44.969 INFO:tasks.rados.rados.0.smithi084.stdout:1249: oid 23 version 646 is already newer than 642 2024-03-30T12:26:44.969 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 646 (ObjNum 402 snap 125 seq_num 402) dirty exists 2024-03-30T12:26:44.969 INFO:tasks.rados.rados.0.smithi084.stdout:1249: left oid 23 (ObjNum 402 snap 125 seq_num 402) 2024-03-30T12:26:45.003 INFO:tasks.rados.rados.0.smithi084.stdout:1250: expect (ObjNum 394 snap 125 seq_num 394) 2024-03-30T12:26:45.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:44 smithi162 ceph-mon[83709]: osdmap e325: 8 total, 7 up, 8 in 2024-03-30T12:26:45.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:45.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:44 smithi162 ceph-mon[83709]: pgmap v170: 121 pgs: 1 peering+snaptrim_error, 43 peering, 1 active+clean+snaptrim_error, 76 active+clean; 133 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 1.9 MiB/s rd, 418 KiB/s wr, 2 op/s 2024-03-30T12:26:45.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:44 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:45.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:44 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:26:45.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:44 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:45.165 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:44.793+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:45.165 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:44 smithi084 ceph-mon[89279]: osdmap e325: 8 total, 7 up, 8 in 2024-03-30T12:26:45.166 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:45.166 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:44 smithi084 ceph-mon[89279]: pgmap v170: 121 pgs: 1 peering+snaptrim_error, 43 peering, 1 active+clean+snaptrim_error, 76 active+clean; 133 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 1.9 MiB/s rd, 418 KiB/s wr, 2 op/s 2024-03-30T12:26:45.166 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:45.166 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:26:45.166 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:45.166 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:44 smithi084 ceph-mon[91810]: osdmap e325: 8 total, 7 up, 8 in 2024-03-30T12:26:45.166 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:45.167 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:44 smithi084 ceph-mon[91810]: pgmap v170: 121 pgs: 1 peering+snaptrim_error, 43 peering, 1 active+clean+snaptrim_error, 76 active+clean; 133 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 1.9 MiB/s rd, 418 KiB/s wr, 2 op/s 2024-03-30T12:26:45.167 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:44 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:45.167 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:44 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:26:45.167 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:44 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:45.504 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1[101951]: 2024-03-30T12:26:45.173+0000 7f498b2217c0 -1 Falling back to public interface 2024-03-30T12:26:45.783 INFO:tasks.rados.rados.0.smithi084.stdout:1246: done (3 left) 2024-03-30T12:26:45.783 INFO:tasks.rados.rados.0.smithi084.stdout:1249: done (2 left) 2024-03-30T12:26:45.783 INFO:tasks.rados.rados.0.smithi084.stdout:1250: done (1 left) 2024-03-30T12:26:45.784 INFO:tasks.rados.rados.0.smithi084.stdout:1251: done (0 left) 2024-03-30T12:26:45.784 INFO:tasks.rados.rados.0.smithi084.stdout:1252: read oid 12 snap 125 2024-03-30T12:26:45.784 INFO:tasks.rados.rados.0.smithi084.stdout:1252: expect deleted 2024-03-30T12:26:45.784 INFO:tasks.rados.rados.0.smithi084.stdout:1253: delete oid 3 current snap is 126 2024-03-30T12:26:45.790 INFO:tasks.rados.rados.0.smithi084.stdout:1252: done (1 left) 2024-03-30T12:26:45.790 INFO:tasks.rados.rados.0.smithi084.stdout:1253: done (0 left) 2024-03-30T12:26:45.790 INFO:tasks.rados.rados.0.smithi084.stdout:1254: read oid 32 snap -1 2024-03-30T12:26:45.790 INFO:tasks.rados.rados.0.smithi084.stdout:1254: expect (ObjNum 355 snap 113 seq_num 355) 2024-03-30T12:26:45.790 INFO:tasks.rados.rados.0.smithi084.stdout:1255: copy_from oid 11 from oid 28 current snap is 126 2024-03-30T12:26:45.790 INFO:tasks.rados.rados.0.smithi084.stdout:1256: read oid 48 snap -1 2024-03-30T12:26:45.791 INFO:tasks.rados.rados.0.smithi084.stdout:1256: expect deleted 2024-03-30T12:26:45.791 INFO:tasks.rados.rados.0.smithi084.stdout:1257: read oid 8 snap -1 2024-03-30T12:26:45.791 INFO:tasks.rados.rados.0.smithi084.stdout:1257: expect (ObjNum 401 snap 125 seq_num 401) 2024-03-30T12:26:45.791 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 42 current snap is 126 2024-03-30T12:26:45.791 INFO:tasks.rados.rados.0.smithi084.stdout:1258: seq_num 404 ranges {2613248=770048,3383296=712704,4096000=491520} 2024-03-30T12:26:45.809 INFO:tasks.rados.rados.0.smithi084.stdout:1258: writing smithi08477944-42 from 2613248 to 3383296 tid 1 2024-03-30T12:26:45.814 INFO:tasks.rados.rados.0.smithi084.stdout:1258: writing smithi08477944-42 from 3383296 to 4096000 tid 2 2024-03-30T12:26:45.816 INFO:tasks.rados.rados.0.smithi084.stdout:1258: writing smithi08477944-42 from 4096000 to 4587520 tid 3 2024-03-30T12:26:45.816 INFO:tasks.rados.rados.0.smithi084.stdout:1259: snap_remove snap 125 2024-03-30T12:26:46.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:45.791+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:46.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:46.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:45 smithi084 ceph-mon[89279]: osdmap e326: 8 total, 7 up, 8 in 2024-03-30T12:26:46.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:26:46.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:46.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:46.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:45 smithi084 ceph-mon[91810]: osdmap e326: 8 total, 7 up, 8 in 2024-03-30T12:26:46.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:26:46.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:45 smithi162 ceph-mon[83709]: osdmap e326: 8 total, 7 up, 8 in 2024-03-30T12:26:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:26:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:46.790 INFO:tasks.rados.rados.0.smithi084.stdout:1259: done (5 left) 2024-03-30T12:26:46.791 INFO:tasks.rados.rados.0.smithi084.stdout:1260: rollback oid 21 current snap is 126 2024-03-30T12:26:46.791 INFO:tasks.rados.rados.0.smithi084.stdout:1260: done (5 left) 2024-03-30T12:26:46.791 INFO:tasks.rados.rados.0.smithi084.stdout:1261: read oid 13 snap -1 2024-03-30T12:26:46.791 INFO:tasks.rados.rados.0.smithi084.stdout:1261: expect deleted 2024-03-30T12:26:46.791 INFO:tasks.rados.rados.0.smithi084.stdout:1262: setattr oid 17 current snap is 126 2024-03-30T12:26:46.791 INFO:tasks.rados.rados.0.smithi084.stdout:1254: expect (ObjNum 355 snap 113 seq_num 355) 2024-03-30T12:26:46.828 INFO:tasks.rados.rados.0.smithi084.stdout:1255: finishing copy_from racing read to smithi08477944-11 2024-03-30T12:26:46.828 INFO:tasks.rados.rados.0.smithi084.stdout:1255: finishing copy_from to smithi08477944-11 2024-03-30T12:26:46.828 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 631 (ObjNum 205 snap 62 seq_num 205) dirty exists 2024-03-30T12:26:46.828 INFO:tasks.rados.rados.0.smithi084.stdout:1257: expect (ObjNum 401 snap 125 seq_num 401) 2024-03-30T12:26:47.063 INFO:tasks.rados.rados.0.smithi084.stdout:1258: finishing write tid 1 to smithi08477944-42 2024-03-30T12:26:47.063 INFO:tasks.rados.rados.0.smithi084.stdout:1258: finishing write tid 2 to smithi08477944-42 2024-03-30T12:26:47.063 INFO:tasks.rados.rados.0.smithi084.stdout:1258: finishing write tid 3 to smithi08477944-42 2024-03-30T12:26:47.063 INFO:tasks.rados.rados.0.smithi084.stdout:1258: finishing write tid 4 to smithi08477944-42 2024-03-30T12:26:47.063 INFO:tasks.rados.rados.0.smithi084.stdout:1258: finishing write tid 5 to smithi08477944-42 2024-03-30T12:26:47.063 INFO:tasks.rados.rados.0.smithi084.stdout:1258: oid 42 updating version 0 to 636 2024-03-30T12:26:47.063 INFO:tasks.rados.rados.0.smithi084.stdout:1258: oid 42 updating version 636 to 639 2024-03-30T12:26:47.063 INFO:tasks.rados.rados.0.smithi084.stdout:1258: oid 42 version 639 is already newer than 638 2024-03-30T12:26:47.063 INFO:tasks.rados.rados.0.smithi084.stdout:1258: oid 42 version 639 is already newer than 637 2024-03-30T12:26:47.063 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 639 (ObjNum 404 snap 126 seq_num 404) dirty exists 2024-03-30T12:26:47.063 INFO:tasks.rados.rados.0.smithi084.stdout:1258: left oid 42 (ObjNum 404 snap 126 seq_num 404) 2024-03-30T12:26:47.064 INFO:tasks.rados.rados.0.smithi084.stdout:1254: done (6 left) 2024-03-30T12:26:47.064 INFO:tasks.rados.rados.0.smithi084.stdout:1255: done (5 left) 2024-03-30T12:26:47.064 INFO:tasks.rados.rados.0.smithi084.stdout:1256: done (4 left) 2024-03-30T12:26:47.064 INFO:tasks.rados.rados.0.smithi084.stdout:1257: done (3 left) 2024-03-30T12:26:47.064 INFO:tasks.rados.rados.0.smithi084.stdout:1258: done (2 left) 2024-03-30T12:26:47.064 INFO:tasks.rados.rados.0.smithi084.stdout:1261: done (1 left) 2024-03-30T12:26:47.064 INFO:tasks.rados.rados.0.smithi084.stdout:1263: read oid 27 snap -1 2024-03-30T12:26:47.064 INFO:tasks.rados.rados.0.smithi084.stdout:1263: expect deleted 2024-03-30T12:26:47.064 INFO:tasks.rados.rados.0.smithi084.stdout:1264: snap_create 2024-03-30T12:26:47.065 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 640 (ObjNum 313 snap 103 seq_num 313) dirty exists 2024-03-30T12:26:47.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:46 smithi162 ceph-mon[83709]: osdmap e327: 8 total, 7 up, 8 in 2024-03-30T12:26:47.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:47.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:46 smithi162 ceph-mon[83709]: pgmap v173: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 1 active+clean+snaptrim_error, 9 active+undersized+degraded, 34 active+undersized, 76 active+clean; 138 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 4.7 MiB/s wr, 24 op/s; 31/228 objects degraded (13.596%) 2024-03-30T12:26:47.225 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:46 smithi084 ceph-mon[91810]: osdmap e327: 8 total, 7 up, 8 in 2024-03-30T12:26:47.225 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:47.225 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:46 smithi084 ceph-mon[91810]: pgmap v173: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 1 active+clean+snaptrim_error, 9 active+undersized+degraded, 34 active+undersized, 76 active+clean; 138 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 4.7 MiB/s wr, 24 op/s; 31/228 objects degraded (13.596%) 2024-03-30T12:26:47.225 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:46.797+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:47.225 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:46 smithi084 ceph-mon[89279]: osdmap e327: 8 total, 7 up, 8 in 2024-03-30T12:26:47.226 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:47.226 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:46 smithi084 ceph-mon[89279]: pgmap v173: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 1 active+clean+snaptrim_error, 9 active+undersized+degraded, 34 active+undersized, 76 active+clean; 138 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 4.7 MiB/s wr, 24 op/s; 31/228 objects degraded (13.596%) 2024-03-30T12:26:47.797 INFO:tasks.rados.rados.0.smithi084.stdout:1262: done (2 left) 2024-03-30T12:26:47.797 INFO:tasks.rados.rados.0.smithi084.stdout:1263: done (1 left) 2024-03-30T12:26:47.797 INFO:tasks.rados.rados.0.smithi084.stdout:1264: done (0 left) 2024-03-30T12:26:47.797 INFO:tasks.rados.rados.0.smithi084.stdout:1265: snap_create 2024-03-30T12:26:48.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:47 smithi162 ceph-mon[83709]: Health check failed: Degraded data redundancy: 31/228 objects degraded (13.596%), 10 pgs degraded (PG_DEGRADED) 2024-03-30T12:26:48.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:47 smithi162 ceph-mon[83709]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs inactive, 13 pgs peering) 2024-03-30T12:26:48.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:48.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:47 smithi162 ceph-mon[83709]: osdmap e328: 8 total, 7 up, 8 in 2024-03-30T12:26:48.166 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:47 smithi084 ceph-mon[91810]: Health check failed: Degraded data redundancy: 31/228 objects degraded (13.596%), 10 pgs degraded (PG_DEGRADED) 2024-03-30T12:26:48.166 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:47 smithi084 ceph-mon[91810]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs inactive, 13 pgs peering) 2024-03-30T12:26:48.166 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:48.166 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:47 smithi084 ceph-mon[91810]: osdmap e328: 8 total, 7 up, 8 in 2024-03-30T12:26:48.166 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:47 smithi084 ceph-mon[89279]: Health check failed: Degraded data redundancy: 31/228 objects degraded (13.596%), 10 pgs degraded (PG_DEGRADED) 2024-03-30T12:26:48.167 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:47 smithi084 ceph-mon[89279]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs inactive, 13 pgs peering) 2024-03-30T12:26:48.167 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset b3=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:48.167 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:47 smithi084 ceph-mon[89279]: osdmap e328: 8 total, 7 up, 8 in 2024-03-30T12:26:48.490 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1[101951]: 2024-03-30T12:26:48.382+0000 7f498b2217c0 -1 osd.1 320 log_to_monitors true 2024-03-30T12:26:48.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:48.498+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:48.803 INFO:tasks.rados.rados.0.smithi084.stdout:1265: done (0 left) 2024-03-30T12:26:48.803 INFO:tasks.rados.rados.0.smithi084.stdout:1266: rmattr oid 27 current snap is 128 2024-03-30T12:26:48.803 INFO:tasks.rados.rados.0.smithi084.stdout:1266: done (0 left) 2024-03-30T12:26:48.803 INFO:tasks.rados.rados.0.smithi084.stdout:1267: rollback oid 10 current snap is 128 2024-03-30T12:26:48.803 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 10 to 127 2024-03-30T12:26:48.803 INFO:tasks.rados.rados.0.smithi084.stdout:1268: read oid 14 snap -1 2024-03-30T12:26:48.803 INFO:tasks.rados.rados.0.smithi084.stdout:1268: expect deleted 2024-03-30T12:26:48.803 INFO:tasks.rados.rados.0.smithi084.stdout:1269: read oid 42 snap -1 2024-03-30T12:26:48.803 INFO:tasks.rados.rados.0.smithi084.stdout:1269: expect (ObjNum 404 snap 126 seq_num 404) 2024-03-30T12:26:48.803 INFO:tasks.rados.rados.0.smithi084.stdout:1270: read oid 12 snap -1 2024-03-30T12:26:48.804 INFO:tasks.rados.rados.0.smithi084.stdout:1270: expect deleted 2024-03-30T12:26:48.804 INFO:tasks.rados.rados.0.smithi084.stdout:1271: snap_remove snap 126 2024-03-30T12:26:49.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:48 smithi162 ceph-mon[83709]: osdmap e329: 8 total, 7 up, 8 in 2024-03-30T12:26:49.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:48 smithi162 ceph-mon[83709]: from='osd.1 [v2:172.21.15.84:6810/3267314044,v1:172.21.15.84:6811/3267314044]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T12:26:49.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:48 smithi162 ceph-mon[83709]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T12:26:49.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:49.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:48 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:49.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:48 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:49.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:48 smithi162 ceph-mon[83709]: pgmap v176: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 1 active+clean+snaptrim_error, 9 active+undersized+degraded, 34 active+undersized, 76 active+clean; 138 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 4.7 MiB/s wr, 24 op/s; 31/228 objects degraded (13.596%) 2024-03-30T12:26:49.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:48.820+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:49.254 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:26:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1[101951]: 2024-03-30T12:26:48.827+0000 7f4978671700 -1 osd.1 320 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T12:26:49.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:48 smithi084 ceph-mon[91810]: osdmap e329: 8 total, 7 up, 8 in 2024-03-30T12:26:49.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:48 smithi084 ceph-mon[91810]: from='osd.1 [v2:172.21.15.84:6810/3267314044,v1:172.21.15.84:6811/3267314044]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T12:26:49.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:48 smithi084 ceph-mon[91810]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T12:26:49.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:49.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:48 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:49.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:48 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:49.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:48 smithi084 ceph-mon[91810]: pgmap v176: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 1 active+clean+snaptrim_error, 9 active+undersized+degraded, 34 active+undersized, 76 active+clean; 138 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 4.7 MiB/s wr, 24 op/s; 31/228 objects degraded (13.596%) 2024-03-30T12:26:49.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:48 smithi084 ceph-mon[89279]: osdmap e329: 8 total, 7 up, 8 in 2024-03-30T12:26:49.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:48 smithi084 ceph-mon[89279]: from='osd.1 [v2:172.21.15.84:6810/3267314044,v1:172.21.15.84:6811/3267314044]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T12:26:49.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:48 smithi084 ceph-mon[89279]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T12:26:49.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:49.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:48 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:49.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:48 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:49.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:48 smithi084 ceph-mon[89279]: pgmap v176: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 1 active+clean+snaptrim_error, 9 active+undersized+degraded, 34 active+undersized, 76 active+clean; 138 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 4.7 MiB/s wr, 24 op/s; 31/228 objects degraded (13.596%) 2024-03-30T12:26:49.588 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:26:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:26:49] "GET /metrics HTTP/1.1" 200 36257 "" "Prometheus/2.43.0" 2024-03-30T12:26:49.813 INFO:tasks.rados.rados.0.smithi084.stdout:1271: done (4 left) 2024-03-30T12:26:49.813 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 128 2024-03-30T12:26:49.813 INFO:tasks.rados.rados.0.smithi084.stdout:1272: seq_num 405 ranges {0=786432,786432=589824,1376256=614400} 2024-03-30T12:26:49.817 INFO:tasks.rados.rados.0.smithi084.stdout:1272: writing smithi08477944-3 from 0 to 786432 tid 1 2024-03-30T12:26:49.822 INFO:tasks.rados.rados.0.smithi084.stdout:1272: writing smithi08477944-3 from 786432 to 1376256 tid 2 2024-03-30T12:26:49.826 INFO:tasks.rados.rados.0.smithi084.stdout:1272: writing smithi08477944-3 from 1376256 to 1990656 tid 3 2024-03-30T12:26:49.826 INFO:tasks.rados.rados.0.smithi084.stdout:1273: rollback oid 30 current snap is 128 2024-03-30T12:26:49.826 INFO:tasks.rados.rados.0.smithi084.stdout:1267: finishing rollback tid 0 to smithi08477944-10 2024-03-30T12:26:49.826 INFO:tasks.rados.rados.0.smithi084.stdout:1267: finishing rollback tid 1 to smithi08477944-10 2024-03-30T12:26:49.826 INFO:tasks.rados.rados.0.smithi084.stdout:1267: finishing rollback tid 2 to smithi08477944-10 2024-03-30T12:26:49.827 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 680 (ObjNum 383 snap 121 seq_num 383) dirty exists 2024-03-30T12:26:49.827 INFO:tasks.rados.rados.0.smithi084.stdout:1269: expect (ObjNum 404 snap 126 seq_num 404) 2024-03-30T12:26:50.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:49.831+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:50.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:49 smithi084 ceph-mon[89279]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-30T12:26:50.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:49 smithi084 ceph-mon[89279]: osdmap e330: 8 total, 7 up, 8 in 2024-03-30T12:26:50.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:49 smithi084 ceph-mon[89279]: from='osd.1 [v2:172.21.15.84:6810/3267314044,v1:172.21.15.84:6811/3267314044]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:26:50.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:49 smithi084 ceph-mon[89279]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:26:50.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:50.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:49 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:50.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:49 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:50.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:49 smithi084 ceph-mon[91810]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-30T12:26:50.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:49 smithi084 ceph-mon[91810]: osdmap e330: 8 total, 7 up, 8 in 2024-03-30T12:26:50.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:49 smithi084 ceph-mon[91810]: from='osd.1 [v2:172.21.15.84:6810/3267314044,v1:172.21.15.84:6811/3267314044]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:26:50.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:49 smithi084 ceph-mon[91810]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:26:50.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:50.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:49 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:50.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:49 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:50.048 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 30 to 127 2024-03-30T12:26:50.049 INFO:tasks.rados.rados.0.smithi084.stdout:1267: done (5 left) 2024-03-30T12:26:50.049 INFO:tasks.rados.rados.0.smithi084.stdout:1268: done (4 left) 2024-03-30T12:26:50.049 INFO:tasks.rados.rados.0.smithi084.stdout:1269: done (3 left) 2024-03-30T12:26:50.049 INFO:tasks.rados.rados.0.smithi084.stdout:1270: done (2 left) 2024-03-30T12:26:50.049 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 33 current snap is 128 2024-03-30T12:26:50.049 INFO:tasks.rados.rados.0.smithi084.stdout:1274: seq_num 406 ranges {1540096=802816,2342912=475136,2818048=499712,3317760=229376} 2024-03-30T12:26:50.061 INFO:tasks.rados.rados.0.smithi084.stdout:1274: writing smithi08477944-33 from 1540096 to 2342912 tid 1 2024-03-30T12:26:50.064 INFO:tasks.rados.rados.0.smithi084.stdout:1274: writing smithi08477944-33 from 2342912 to 2818048 tid 2 2024-03-30T12:26:50.067 INFO:tasks.rados.rados.0.smithi084.stdout:1274: writing smithi08477944-33 from 2818048 to 3317760 tid 3 2024-03-30T12:26:50.068 INFO:tasks.rados.rados.0.smithi084.stdout:1274: writing smithi08477944-33 from 3317760 to 3547136 tid 4 2024-03-30T12:26:50.068 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 128 2024-03-30T12:26:50.068 INFO:tasks.rados.rados.0.smithi084.stdout:1273: finishing rollback tid 0 to smithi08477944-30 2024-03-30T12:26:50.068 INFO:tasks.rados.rados.0.smithi084.stdout:1275: seq_num 407 ranges {0=425984,425984=761856,1187840=704512,1892352=139264} 2024-03-30T12:26:50.071 INFO:tasks.rados.rados.0.smithi084.stdout:1275: writing smithi08477944-13 from 0 to 425984 tid 1 2024-03-30T12:26:50.077 INFO:tasks.rados.rados.0.smithi084.stdout:1275: writing smithi08477944-13 from 425984 to 1187840 tid 2 2024-03-30T12:26:50.082 INFO:tasks.rados.rados.0.smithi084.stdout:1275: writing smithi08477944-13 from 1187840 to 1892352 tid 3 2024-03-30T12:26:50.083 INFO:tasks.rados.rados.0.smithi084.stdout:1275: writing smithi08477944-13 from 1892352 to 2031616 tid 4 2024-03-30T12:26:50.083 INFO:tasks.rados.rados.0.smithi084.stdout:1276: copy_from oid 37 from oid 38 current snap is 128 2024-03-30T12:26:50.083 INFO:tasks.rados.rados.0.smithi084.stdout:1273: finishing rollback tid 1 to smithi08477944-30 2024-03-30T12:26:50.083 INFO:tasks.rados.rados.0.smithi084.stdout:1273: finishing rollback tid 2 to smithi08477944-30 2024-03-30T12:26:50.083 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 489 (ObjNum 373 snap 117 seq_num 373) dirty exists 2024-03-30T12:26:50.083 INFO:tasks.rados.rados.0.smithi084.stdout:1275: finishing write tid 1 to smithi08477944-13 2024-03-30T12:26:50.083 INFO:tasks.rados.rados.0.smithi084.stdout:1275: finishing write tid 2 to smithi08477944-13 2024-03-30T12:26:50.083 INFO:tasks.rados.rados.0.smithi084.stdout:1273: done (4 left) 2024-03-30T12:26:50.083 INFO:tasks.rados.rados.0.smithi084.stdout:1277: snap_remove snap 127 2024-03-30T12:26:50.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:49 smithi162 ceph-mon[83709]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-30T12:26:50.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:49 smithi162 ceph-mon[83709]: osdmap e330: 8 total, 7 up, 8 in 2024-03-30T12:26:50.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:49 smithi162 ceph-mon[83709]: from='osd.1 [v2:172.21.15.84:6810/3267314044,v1:172.21.15.84:6811/3267314044]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:26:50.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:49 smithi162 ceph-mon[83709]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:26:50.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:50.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:49 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:50.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:49 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:50.803 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:50 smithi084 ceph-mon[89279]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T12:26:50.803 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:50 smithi084 ceph-mon[89279]: osd.1 [v2:172.21.15.84:6810/3267314044,v1:172.21.15.84:6811/3267314044] boot 2024-03-30T12:26:50.803 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:50 smithi084 ceph-mon[89279]: osdmap e331: 8 total, 8 up, 8 in 2024-03-30T12:26:50.804 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:50 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:26:50.804 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:50.804 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:50 smithi084 ceph-mon[89279]: pgmap v179: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 1 active+clean+snaptrim_error, 22 peering, 4 active+undersized+degraded, 17 active+undersized, 76 active+clean; 138 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.8 MiB/s wr, 4 op/s; 18/243 objects degraded (7.407%) 2024-03-30T12:26:50.818 INFO:tasks.rados.rados.0.smithi084.stdout:1277: done (4 left) 2024-03-30T12:26:50.818 INFO:tasks.rados.rados.0.smithi084.stdout:1278: snap_create 2024-03-30T12:26:50.818 INFO:tasks.rados.rados.0.smithi084.stdout:1275: finishing write tid 3 to smithi08477944-13 2024-03-30T12:26:50.818 INFO:tasks.rados.rados.0.smithi084.stdout:1275: finishing write tid 4 to smithi08477944-13 2024-03-30T12:26:50.818 INFO:tasks.rados.rados.0.smithi084.stdout:1275: finishing write tid 5 to smithi08477944-13 2024-03-30T12:26:50.818 INFO:tasks.rados.rados.0.smithi084.stdout:1275: finishing write tid 6 to smithi08477944-13 2024-03-30T12:26:50.818 INFO:tasks.rados.rados.0.smithi084.stdout:1275: oid 13 updating version 0 to 246 2024-03-30T12:26:50.818 INFO:tasks.rados.rados.0.smithi084.stdout:1275: oid 13 updating version 246 to 249 2024-03-30T12:26:50.818 INFO:tasks.rados.rados.0.smithi084.stdout:1275: oid 13 updating version 249 to 250 2024-03-30T12:26:50.818 INFO:tasks.rados.rados.0.smithi084.stdout:1275: oid 13 version 250 is already newer than 248 2024-03-30T12:26:50.819 INFO:tasks.rados.rados.0.smithi084.stdout:1275: oid 13 version 250 is already newer than 247 2024-03-30T12:26:50.819 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 250 (ObjNum 407 snap 128 seq_num 407) dirty exists 2024-03-30T12:26:50.819 INFO:tasks.rados.rados.0.smithi084.stdout:1275: left oid 13 (ObjNum 407 snap 128 seq_num 407) 2024-03-30T12:26:50.819 INFO:tasks.rados.rados.0.smithi084.stdout:1276: finishing copy_from racing read to smithi08477944-37 2024-03-30T12:26:50.819 INFO:tasks.rados.rados.0.smithi084.stdout:1276: finishing copy_from to smithi08477944-37 2024-03-30T12:26:50.819 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 486 (ObjNum 379 snap 120 seq_num 379) dirty exists 2024-03-30T12:26:50.844 INFO:tasks.rados.rados.0.smithi084.stdout:1272: finishing write tid 1 to smithi08477944-3 2024-03-30T12:26:50.845 INFO:tasks.rados.rados.0.smithi084.stdout:1272: finishing write tid 2 to smithi08477944-3 2024-03-30T12:26:50.846 INFO:tasks.rados.rados.0.smithi084.stdout:1272: finishing write tid 3 to smithi08477944-3 2024-03-30T12:26:50.846 INFO:tasks.rados.rados.0.smithi084.stdout:1272: finishing write tid 4 to smithi08477944-3 2024-03-30T12:26:50.846 INFO:tasks.rados.rados.0.smithi084.stdout:1274: finishing write tid 1 to smithi08477944-33 2024-03-30T12:26:50.848 INFO:tasks.rados.rados.0.smithi084.stdout:1272: finishing write tid 5 to smithi08477944-3 2024-03-30T12:26:50.848 INFO:tasks.rados.rados.0.smithi084.stdout:1272: oid 3 updating version 0 to 769 2024-03-30T12:26:50.848 INFO:tasks.rados.rados.0.smithi084.stdout:1272: oid 3 updating version 769 to 772 2024-03-30T12:26:50.849 INFO:tasks.rados.rados.0.smithi084.stdout:1272: oid 3 version 772 is already newer than 771 2024-03-30T12:26:50.849 INFO:tasks.rados.rados.0.smithi084.stdout:1272: oid 3 version 772 is already newer than 770 2024-03-30T12:26:50.849 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 772 (ObjNum 405 snap 128 seq_num 405) dirty exists 2024-03-30T12:26:50.849 INFO:tasks.rados.rados.0.smithi084.stdout:1272: left oid 3 (ObjNum 405 snap 128 seq_num 405) 2024-03-30T12:26:50.849 INFO:tasks.rados.rados.0.smithi084.stdout:1274: finishing write tid 2 to smithi08477944-33 2024-03-30T12:26:50.849 INFO:tasks.rados.rados.0.smithi084.stdout:1274: finishing write tid 3 to smithi08477944-33 2024-03-30T12:26:50.849 INFO:tasks.rados.rados.0.smithi084.stdout:1274: finishing write tid 4 to smithi08477944-33 2024-03-30T12:26:50.850 INFO:tasks.rados.rados.0.smithi084.stdout:1274: finishing write tid 5 to smithi08477944-33 2024-03-30T12:26:50.853 INFO:tasks.rados.rados.0.smithi084.stdout:1274: finishing write tid 6 to smithi08477944-33 2024-03-30T12:26:50.853 INFO:tasks.rados.rados.0.smithi084.stdout:1274: oid 33 updating version 0 to 831 2024-03-30T12:26:50.853 INFO:tasks.rados.rados.0.smithi084.stdout:1274: oid 33 version 831 is already newer than 830 2024-03-30T12:26:50.853 INFO:tasks.rados.rados.0.smithi084.stdout:1274: oid 33 updating version 831 to 833 2024-03-30T12:26:50.853 INFO:tasks.rados.rados.0.smithi084.stdout:1274: oid 33 version 833 is already newer than 832 2024-03-30T12:26:50.853 INFO:tasks.rados.rados.0.smithi084.stdout:1274: oid 33 version 833 is already newer than 829 2024-03-30T12:26:50.853 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 833 (ObjNum 406 snap 128 seq_num 406) dirty exists 2024-03-30T12:26:50.853 INFO:tasks.rados.rados.0.smithi084.stdout:1274: left oid 33 (ObjNum 406 snap 128 seq_num 406) 2024-03-30T12:26:51.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:50 smithi162 ceph-mon[83709]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T12:26:51.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:50 smithi162 ceph-mon[83709]: osd.1 [v2:172.21.15.84:6810/3267314044,v1:172.21.15.84:6811/3267314044] boot 2024-03-30T12:26:51.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:50 smithi162 ceph-mon[83709]: osdmap e331: 8 total, 8 up, 8 in 2024-03-30T12:26:51.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:50 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:26:51.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:51.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:50 smithi162 ceph-mon[83709]: pgmap v179: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 1 active+clean+snaptrim_error, 22 peering, 4 active+undersized+degraded, 17 active+undersized, 76 active+clean; 138 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.8 MiB/s wr, 4 op/s; 18/243 objects degraded (7.407%) 2024-03-30T12:26:51.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:50.830+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:51.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:50.876+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:51.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:50 smithi084 ceph-mon[91810]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T12:26:51.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:50 smithi084 ceph-mon[91810]: osd.1 [v2:172.21.15.84:6810/3267314044,v1:172.21.15.84:6811/3267314044] boot 2024-03-30T12:26:51.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:50 smithi084 ceph-mon[91810]: osdmap e331: 8 total, 8 up, 8 in 2024-03-30T12:26:51.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:50 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T12:26:51.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:51.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:50 smithi084 ceph-mon[91810]: pgmap v179: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 1 active+clean+snaptrim_error, 22 peering, 4 active+undersized+degraded, 17 active+undersized, 76 active+clean; 138 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.8 MiB/s wr, 4 op/s; 18/243 objects degraded (7.407%) 2024-03-30T12:26:51.827 INFO:tasks.rados.rados.0.smithi084.stdout:1272: done (4 left) 2024-03-30T12:26:51.827 INFO:tasks.rados.rados.0.smithi084.stdout:1274: done (3 left) 2024-03-30T12:26:51.827 INFO:tasks.rados.rados.0.smithi084.stdout:1275: done (2 left) 2024-03-30T12:26:51.827 INFO:tasks.rados.rados.0.smithi084.stdout:1276: done (1 left) 2024-03-30T12:26:51.827 INFO:tasks.rados.rados.0.smithi084.stdout:1278: done (0 left) 2024-03-30T12:26:51.827 INFO:tasks.rados.rados.0.smithi084.stdout:1279: delete oid 39 current snap is 129 2024-03-30T12:26:51.832 INFO:tasks.rados.rados.0.smithi084.stdout:1279: done (0 left) 2024-03-30T12:26:51.832 INFO:tasks.rados.rados.0.smithi084.stdout:1280: snap_remove snap 128 2024-03-30T12:26:52.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:51 smithi162 ceph-mon[83709]: osdmap e332: 8 total, 8 up, 8 in 2024-03-30T12:26:52.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:52.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:52.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:51.837+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:52.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:51.838+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:52.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:51 smithi084 ceph-mon[89279]: osdmap e332: 8 total, 8 up, 8 in 2024-03-30T12:26:52.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:52.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:52.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:51 smithi084 ceph-mon[91810]: osdmap e332: 8 total, 8 up, 8 in 2024-03-30T12:26:52.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:52.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:52.518 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-03-30T12:26:52.833 INFO:tasks.rados.rados.0.smithi084.stdout:1280: done (0 left) 2024-03-30T12:26:52.833 INFO:tasks.rados.rados.0.smithi084.stdout:1281: read oid 30 snap -1 2024-03-30T12:26:52.834 INFO:tasks.rados.rados.0.smithi084.stdout:1281: expect (ObjNum 373 snap 117 seq_num 373) 2024-03-30T12:26:52.834 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 129 2024-03-30T12:26:52.834 INFO:tasks.rados.rados.0.smithi084.stdout:1282: seq_num 409 ranges {1253376=458752,1712128=532480,2244608=720896,2965504=352256} 2024-03-30T12:26:52.843 INFO:tasks.rados.rados.0.smithi084.stdout:1282: writing smithi08477944-2 from 1253376 to 1712128 tid 1 2024-03-30T12:26:52.845 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T12:26:52.845 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (6m) 4s ago 7m 25.2M - 0.25.0 c8568f914cd2 6765ce007f39 2024-03-30T12:26:52.845 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi162 *:3000 running (6m) 83s ago 6m 91.0M - 9.4.7 954c08fa6188 ff2ec7518619 2024-03-30T12:26:52.845 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (7m) 4s ago 7m 14.8M - 18.2.2-1051-gf14b5682 c8fb09e16a7d a9c2e74ca2a3 2024-03-30T12:26:52.845 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi162 running (7m) 83s ago 7m 19.7M - 18.2.2-1051-gf14b5682 c8fb09e16a7d ee1770ef5edd 2024-03-30T12:26:52.845 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi162 *:8443,9283,8765 running (2m) 83s ago 11m 449M - 19.0.0-1864-g5dc2ea30 548196a1a838 eec968f3fcc6 2024-03-30T12:26:52.846 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (3m) 4s ago 13m 508M - 19.0.0-1864-g5dc2ea30 548196a1a838 9a2aba19dffc 2024-03-30T12:26:52.846 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (2m) 4s ago 13m 49.7M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 a0811f2ae47d 2024-03-30T12:26:52.846 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi162 running (93s) 83s ago 11m 24.9M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 149ae6649e0c 2024-03-30T12:26:52.846 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (112s) 4s ago 11m 41.6M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 f79eca93cddd 2024-03-30T12:26:52.846 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (6m) 4s ago 6m 16.9M - 1.5.0 0da6a335fe13 66844bed39e8 2024-03-30T12:26:52.846 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi162 *:9100 running (6m) 83s ago 6m 15.5M - 1.5.0 0da6a335fe13 3d6e28b2348d 2024-03-30T12:26:52.846 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (42s) 4s ago 11m 146M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 c91eea4f8484 2024-03-30T12:26:52.846 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (8s) 4s ago 10m 11.7M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 7518832f6b4a 2024-03-30T12:26:52.846 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (10m) 4s ago 10m 271M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d eb2412618811 2024-03-30T12:26:52.846 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (9m) 4s ago 9m 130M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 8eaf6dc73c25 2024-03-30T12:26:52.846 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi162 running (9m) 83s ago 9m 195M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 1f52e827b91a 2024-03-30T12:26:52.846 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi162 running (9m) 83s ago 9m 188M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 7ba250d154aa 2024-03-30T12:26:52.846 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi162 running (8m) 83s ago 8m 108M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 656a733e8b7a 2024-03-30T12:26:52.846 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi162 running (8m) 83s ago 8m 127M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d e3246b3bc88b 2024-03-30T12:26:52.847 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi162 *:9095 running (2m) 83s ago 7m 51.4M - 2.43.0 a07b618ecd1d bd7d323e4b47 2024-03-30T12:26:52.847 INFO:tasks.rados.rados.0.smithi084.stdout:1282: writing smithi08477944-2 from 1712128 to 2244608 tid 2 2024-03-30T12:26:52.851 INFO:tasks.rados.rados.0.smithi084.stdout:1282: writing smithi08477944-2 from 2244608 to 2965504 tid 3 2024-03-30T12:26:52.853 INFO:tasks.rados.rados.0.smithi084.stdout:1282: writing smithi08477944-2 from 2965504 to 3317760 tid 4 2024-03-30T12:26:52.853 INFO:tasks.rados.rados.0.smithi084.stdout:1283: snap_create 2024-03-30T12:26:52.853 INFO:tasks.rados.rados.0.smithi084.stdout:1281: expect (ObjNum 373 snap 117 seq_num 373) 2024-03-30T12:26:52.897 INFO:tasks.rados.rados.0.smithi084.stdout:1282: finishing write tid 1 to smithi08477944-2 2024-03-30T12:26:52.897 INFO:tasks.rados.rados.0.smithi084.stdout:1282: finishing write tid 2 to smithi08477944-2 2024-03-30T12:26:52.897 INFO:tasks.rados.rados.0.smithi084.stdout:1282: finishing write tid 3 to smithi08477944-2 2024-03-30T12:26:52.897 INFO:tasks.rados.rados.0.smithi084.stdout:1282: finishing write tid 4 to smithi08477944-2 2024-03-30T12:26:52.897 INFO:tasks.rados.rados.0.smithi084.stdout:1282: finishing write tid 5 to smithi08477944-2 2024-03-30T12:26:52.897 INFO:tasks.rados.rados.0.smithi084.stdout:1282: finishing write tid 6 to smithi08477944-2 2024-03-30T12:26:52.897 INFO:tasks.rados.rados.0.smithi084.stdout:1282: oid 2 updating version 0 to 773 2024-03-30T12:26:52.897 INFO:tasks.rados.rados.0.smithi084.stdout:1282: oid 2 updating version 773 to 775 2024-03-30T12:26:52.897 INFO:tasks.rados.rados.0.smithi084.stdout:1282: oid 2 updating version 775 to 777 2024-03-30T12:26:52.898 INFO:tasks.rados.rados.0.smithi084.stdout:1282: oid 2 version 777 is already newer than 774 2024-03-30T12:26:52.898 INFO:tasks.rados.rados.0.smithi084.stdout:1282: oid 2 version 777 is already newer than 776 2024-03-30T12:26:52.898 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 777 (ObjNum 409 snap 129 seq_num 409) dirty exists 2024-03-30T12:26:52.898 INFO:tasks.rados.rados.0.smithi084.stdout:1282: left oid 2 (ObjNum 409 snap 129 seq_num 409) 2024-03-30T12:26:53.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:52 smithi162 ceph-mon[83709]: osdmap e333: 8 total, 8 up, 8 in 2024-03-30T12:26:53.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:53.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:53.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:52 smithi162 ceph-mon[83709]: from='client.34233 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:26:53.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:52 smithi162 ceph-mon[83709]: pgmap v182: 121 pgs: 1 peering+snaptrim_error, 1 active+clean+snaptrim_error, 27 peering, 4 active+undersized+degraded, 12 active+undersized, 76 active+clean; 139 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.8 MiB/s rd, 2.3 MiB/s wr, 13 op/s; 5/246 objects degraded (2.033%) 2024-03-30T12:26:53.246 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:52.857+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:53.246 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:52.857+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:53.247 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:52 smithi084 ceph-mon[91810]: osdmap e333: 8 total, 8 up, 8 in 2024-03-30T12:26:53.247 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:53.247 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:53.247 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:52 smithi084 ceph-mon[91810]: from='client.34233 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:26:53.247 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:52 smithi084 ceph-mon[91810]: pgmap v182: 121 pgs: 1 peering+snaptrim_error, 1 active+clean+snaptrim_error, 27 peering, 4 active+undersized+degraded, 12 active+undersized, 76 active+clean; 139 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.8 MiB/s rd, 2.3 MiB/s wr, 13 op/s; 5/246 objects degraded (2.033%) 2024-03-30T12:26:53.247 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-30T12:26:53.247 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-03-30T12:26:53.247 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 3 2024-03-30T12:26:53.247 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:26:53.248 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-03-30T12:26:53.248 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 2 2024-03-30T12:26:53.248 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:26:53.248 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-03-30T12:26:53.248 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 6, 2024-03-30T12:26:53.248 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 2 2024-03-30T12:26:53.248 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:26:53.248 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-03-30T12:26:53.248 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 2 2024-03-30T12:26:53.248 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:26:53.248 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-03-30T12:26:53.248 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 8, 2024-03-30T12:26:53.248 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 7 2024-03-30T12:26:53.248 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-30T12:26:53.248 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-30T12:26:53.249 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:52 smithi084 ceph-mon[89279]: osdmap e333: 8 total, 8 up, 8 in 2024-03-30T12:26:53.249 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:53.249 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:53.249 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:52 smithi084 ceph-mon[89279]: from='client.34233 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:26:53.249 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:52 smithi084 ceph-mon[89279]: pgmap v182: 121 pgs: 1 peering+snaptrim_error, 1 active+clean+snaptrim_error, 27 peering, 4 active+undersized+degraded, 12 active+undersized, 76 active+clean; 139 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.8 MiB/s rd, 2.3 MiB/s wr, 13 op/s; 5/246 objects degraded (2.033%) 2024-03-30T12:26:53.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:26:53.489+0000 7f1f562eb700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-03-30T12:26:53.844 INFO:tasks.rados.rados.0.smithi084.stdout:1281: done (2 left) 2024-03-30T12:26:53.845 INFO:tasks.rados.rados.0.smithi084.stdout:1282: done (1 left) 2024-03-30T12:26:53.845 INFO:tasks.rados.rados.0.smithi084.stdout:1283: done (0 left) 2024-03-30T12:26:53.845 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 130 2024-03-30T12:26:53.845 INFO:tasks.rados.rados.0.smithi084.stdout:1284: seq_num 410 ranges {0=475136,475136=417792,892928=475136,1368064=425984,1794048=286720} 2024-03-30T12:26:53.847 INFO:tasks.rados.rados.0.smithi084.stdout:1284: writing smithi08477944-19 from 0 to 475136 tid 1 2024-03-30T12:26:53.849 INFO:tasks.rados.rados.0.smithi084.stdout:1284: writing smithi08477944-19 from 475136 to 892928 tid 2 2024-03-30T12:26:53.851 INFO:tasks.rados.rados.0.smithi084.stdout:1284: writing smithi08477944-19 from 892928 to 1368064 tid 3 2024-03-30T12:26:53.854 INFO:tasks.rados.rados.0.smithi084.stdout:1284: writing smithi08477944-19 from 1368064 to 1794048 tid 4 2024-03-30T12:26:53.856 INFO:tasks.rados.rados.0.smithi084.stdout:1284: writing smithi08477944-19 from 1794048 to 2080768 tid 5 2024-03-30T12:26:53.856 INFO:tasks.rados.rados.0.smithi084.stdout:1285: copy_from oid 10 from oid 3 current snap is 130 2024-03-30T12:26:53.856 INFO:tasks.rados.rados.0.smithi084.stdout:1284: finishing write tid 1 to smithi08477944-19 2024-03-30T12:26:53.856 INFO:tasks.rados.rados.0.smithi084.stdout:1284: finishing write tid 2 to smithi08477944-19 2024-03-30T12:26:53.856 INFO:tasks.rados.rados.0.smithi084.stdout:1284: finishing write tid 3 to smithi08477944-19 2024-03-30T12:26:53.856 INFO:tasks.rados.rados.0.smithi084.stdout:1286: snap_remove snap 129 2024-03-30T12:26:54.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:53 smithi162 ceph-mon[83709]: Health check update: Degraded data redundancy: 5/246 objects degraded (2.033%), 4 pgs degraded (PG_DEGRADED) 2024-03-30T12:26:54.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:53 smithi162 ceph-mon[83709]: osdmap e334: 8 total, 8 up, 8 in 2024-03-30T12:26:54.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:53 smithi162 ceph-mon[83709]: from='client.44174 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:26:54.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:54.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:54.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:53 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/1290805417' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:54.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:53 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:54.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:53 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:54.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:53 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:26:54.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:53 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:26:54.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:53 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:54.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:53 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:26:54.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:53 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:54.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:53 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:54.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:53 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:54.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:53 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-30T12:26:54.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:53 smithi162 ceph-mon[83709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-30T12:26:54.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:53 smithi162 ceph-mon[83709]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-03-30T12:26:54.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:53.878+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:54.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:53.878+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:54.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[89279]: Health check update: Degraded data redundancy: 5/246 objects degraded (2.033%), 4 pgs degraded (PG_DEGRADED) 2024-03-30T12:26:54.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[89279]: osdmap e334: 8 total, 8 up, 8 in 2024-03-30T12:26:54.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[89279]: from='client.44174 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:26:54.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:54.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:54.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/1290805417' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:54.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:54.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:54.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:26:54.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:26:54.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:54.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:26:54.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:54.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:54.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:54.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-30T12:26:54.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[89279]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-30T12:26:54.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[89279]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-03-30T12:26:54.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[91810]: Health check update: Degraded data redundancy: 5/246 objects degraded (2.033%), 4 pgs degraded (PG_DEGRADED) 2024-03-30T12:26:54.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[91810]: osdmap e334: 8 total, 8 up, 8 in 2024-03-30T12:26:54.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[91810]: from='client.44174 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:26:54.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:54.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:54.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/1290805417' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:54.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:54.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:54.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:26:54.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:26:54.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:26:54.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:26:54.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:54.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:54.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:26:54.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-30T12:26:54.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[91810]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-30T12:26:54.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:53 smithi084 ceph-mon[91810]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-03-30T12:26:54.848 INFO:tasks.rados.rados.0.smithi084.stdout:1286: done (2 left) 2024-03-30T12:26:54.848 INFO:tasks.rados.rados.0.smithi084.stdout:1287: delete oid 29 current snap is 130 2024-03-30T12:26:54.848 INFO:tasks.rados.rados.0.smithi084.stdout:1284: finishing write tid 4 to smithi08477944-19 2024-03-30T12:26:54.848 INFO:tasks.rados.rados.0.smithi084.stdout:1284: finishing write tid 5 to smithi08477944-19 2024-03-30T12:26:54.848 INFO:tasks.rados.rados.0.smithi084.stdout:1284: finishing write tid 6 to smithi08477944-19 2024-03-30T12:26:54.848 INFO:tasks.rados.rados.0.smithi084.stdout:1284: finishing write tid 7 to smithi08477944-19 2024-03-30T12:26:54.848 INFO:tasks.rados.rados.0.smithi084.stdout:1284: oid 19 updating version 0 to 551 2024-03-30T12:26:54.848 INFO:tasks.rados.rados.0.smithi084.stdout:1284: oid 19 updating version 551 to 553 2024-03-30T12:26:54.848 INFO:tasks.rados.rados.0.smithi084.stdout:1284: oid 19 updating version 553 to 554 2024-03-30T12:26:54.849 INFO:tasks.rados.rados.0.smithi084.stdout:1284: oid 19 version 554 is already newer than 552 2024-03-30T12:26:54.849 INFO:tasks.rados.rados.0.smithi084.stdout:1284: oid 19 version 554 is already newer than 550 2024-03-30T12:26:54.849 INFO:tasks.rados.rados.0.smithi084.stdout:1284: oid 19 version 554 is already newer than 549 2024-03-30T12:26:54.849 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 554 (ObjNum 410 snap 130 seq_num 410) dirty exists 2024-03-30T12:26:54.849 INFO:tasks.rados.rados.0.smithi084.stdout:1284: left oid 19 (ObjNum 410 snap 130 seq_num 410) 2024-03-30T12:26:54.849 INFO:tasks.rados.rados.0.smithi084.stdout:1285: finishing copy_from racing read to smithi08477944-10 2024-03-30T12:26:54.849 INFO:tasks.rados.rados.0.smithi084.stdout:1285: finishing copy_from to smithi08477944-10 2024-03-30T12:26:54.849 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 772 (ObjNum 405 snap 128 seq_num 405) dirty exists 2024-03-30T12:26:54.853 INFO:tasks.rados.rados.0.smithi084.stdout:1284: done (2 left) 2024-03-30T12:26:54.853 INFO:tasks.rados.rados.0.smithi084.stdout:1285: done (1 left) 2024-03-30T12:26:54.853 INFO:tasks.rados.rados.0.smithi084.stdout:1287: done (0 left) 2024-03-30T12:26:54.853 INFO:tasks.rados.rados.0.smithi084.stdout:1288: read oid 24 snap -1 2024-03-30T12:26:54.853 INFO:tasks.rados.rados.0.smithi084.stdout:1288: expect (ObjNum 286 snap 92 seq_num 286) 2024-03-30T12:26:54.853 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 130 2024-03-30T12:26:54.853 INFO:tasks.rados.rados.0.smithi084.stdout:1289: seq_num 412 ranges {2932736=507904,3440640=630784,4071424=491520,4562944=483328} 2024-03-30T12:26:54.871 INFO:tasks.rados.rados.0.smithi084.stdout:1289: writing smithi08477944-49 from 2932736 to 3440640 tid 1 2024-03-30T12:26:54.876 INFO:tasks.rados.rados.0.smithi084.stdout:1289: writing smithi08477944-49 from 3440640 to 4071424 tid 2 2024-03-30T12:26:54.880 INFO:tasks.rados.rados.0.smithi084.stdout:1289: writing smithi08477944-49 from 4071424 to 4562944 tid 3 2024-03-30T12:26:54.883 INFO:tasks.rados.rados.0.smithi084.stdout:1289: writing smithi08477944-49 from 4562944 to 5046272 tid 4 2024-03-30T12:26:54.884 INFO:tasks.rados.rados.0.smithi084.stdout:1290: copy_from oid 36 from oid 47 current snap is 130 2024-03-30T12:26:54.884 INFO:tasks.rados.rados.0.smithi084.stdout:1289: finishing write tid 1 to smithi08477944-49 2024-03-30T12:26:54.884 INFO:tasks.rados.rados.0.smithi084.stdout:1291: rollback oid 32 current snap is 130 2024-03-30T12:26:54.884 INFO:tasks.rados.rados.0.smithi084.stdout:1291: done (3 left) 2024-03-30T12:26:54.884 INFO:tasks.rados.rados.0.smithi084.stdout:1292: snap_create 2024-03-30T12:26:54.884 INFO:tasks.rados.rados.0.smithi084.stdout:1289: finishing write tid 2 to smithi08477944-49 2024-03-30T12:26:54.885 INFO:tasks.rados.rados.0.smithi084.stdout:1288: expect (ObjNum 286 snap 92 seq_num 286) 2024-03-30T12:26:55.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:54 smithi162 ceph-mon[83709]: osdmap e335: 8 total, 8 up, 8 in 2024-03-30T12:26:55.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:55.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:55.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:54 smithi162 ceph-mon[83709]: pgmap v185: 121 pgs: 1 peering+snaptrim_error, 1 active+clean+snaptrim_error, 27 peering, 92 active+clean; 139 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 4.2 MiB/s rd, 482 KiB/s wr, 8 op/s 2024-03-30T12:26:55.218 INFO:tasks.rados.rados.0.smithi084.stdout:1289: finishing write tid 3 to smithi08477944-49 2024-03-30T12:26:55.218 INFO:tasks.rados.rados.0.smithi084.stdout:1289: finishing write tid 4 to smithi08477944-49 2024-03-30T12:26:55.218 INFO:tasks.rados.rados.0.smithi084.stdout:1289: finishing write tid 5 to smithi08477944-49 2024-03-30T12:26:55.219 INFO:tasks.rados.rados.0.smithi084.stdout:1289: finishing write tid 6 to smithi08477944-49 2024-03-30T12:26:55.219 INFO:tasks.rados.rados.0.smithi084.stdout:1289: oid 49 updating version 0 to 650 2024-03-30T12:26:55.219 INFO:tasks.rados.rados.0.smithi084.stdout:1289: oid 49 version 650 is already newer than 649 2024-03-30T12:26:55.219 INFO:tasks.rados.rados.0.smithi084.stdout:1289: oid 49 updating version 650 to 651 2024-03-30T12:26:55.219 INFO:tasks.rados.rados.0.smithi084.stdout:1289: oid 49 version 651 is already newer than 648 2024-03-30T12:26:55.219 INFO:tasks.rados.rados.0.smithi084.stdout:1289: oid 49 version 651 is already newer than 647 2024-03-30T12:26:55.219 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 651 (ObjNum 412 snap 130 seq_num 412) dirty exists 2024-03-30T12:26:55.219 INFO:tasks.rados.rados.0.smithi084.stdout:1289: left oid 49 (ObjNum 412 snap 130 seq_num 412) 2024-03-30T12:26:55.219 INFO:tasks.rados.rados.0.smithi084.stdout:1290: finishing copy_from racing read to smithi08477944-36 2024-03-30T12:26:55.219 INFO:tasks.rados.rados.0.smithi084.stdout:1290: finishing copy_from to smithi08477944-36 2024-03-30T12:26:55.219 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 772 (ObjNum 346 snap 113 seq_num 346) dirty exists 2024-03-30T12:26:55.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:54 smithi084 ceph-mon[91810]: osdmap e335: 8 total, 8 up, 8 in 2024-03-30T12:26:55.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:55.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:55.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:54 smithi084 ceph-mon[91810]: pgmap v185: 121 pgs: 1 peering+snaptrim_error, 1 active+clean+snaptrim_error, 27 peering, 92 active+clean; 139 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 4.2 MiB/s rd, 482 KiB/s wr, 8 op/s 2024-03-30T12:26:55.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:54.854+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:55.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:54.854+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:55.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:54 smithi084 ceph-mon[89279]: osdmap e335: 8 total, 8 up, 8 in 2024-03-30T12:26:55.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:55.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:55.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:54 smithi084 ceph-mon[89279]: pgmap v185: 121 pgs: 1 peering+snaptrim_error, 1 active+clean+snaptrim_error, 27 peering, 92 active+clean; 139 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 4.2 MiB/s rd, 482 KiB/s wr, 8 op/s 2024-03-30T12:26:55.858 INFO:tasks.rados.rados.0.smithi084.stdout:1288: done (3 left) 2024-03-30T12:26:55.858 INFO:tasks.rados.rados.0.smithi084.stdout:1289: done (2 left) 2024-03-30T12:26:55.859 INFO:tasks.rados.rados.0.smithi084.stdout:1290: done (1 left) 2024-03-30T12:26:55.859 INFO:tasks.rados.rados.0.smithi084.stdout:1292: done (0 left) 2024-03-30T12:26:55.859 INFO:tasks.rados.rados.0.smithi084.stdout:1293: rollback oid 45 current snap is 131 2024-03-30T12:26:55.859 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 45 to 130 2024-03-30T12:26:55.859 INFO:tasks.rados.rados.0.smithi084.stdout:1294: delete oid 41 current snap is 131 2024-03-30T12:26:55.864 INFO:tasks.rados.rados.0.smithi084.stdout:1293: finishing rollback tid 0 to smithi08477944-45 2024-03-30T12:26:55.866 INFO:tasks.rados.rados.0.smithi084.stdout:1293: finishing rollback tid 1 to smithi08477944-45 2024-03-30T12:26:55.866 INFO:tasks.rados.rados.0.smithi084.stdout:1293: finishing rollback tid 2 to smithi08477944-45 2024-03-30T12:26:55.866 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 828 (ObjNum 396 snap 125 seq_num 396) dirty exists 2024-03-30T12:26:55.866 INFO:tasks.rados.rados.0.smithi084.stdout:1293: done (1 left) 2024-03-30T12:26:55.866 INFO:tasks.rados.rados.0.smithi084.stdout:1294: done (0 left) 2024-03-30T12:26:55.866 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 131 2024-03-30T12:26:55.866 INFO:tasks.rados.rados.0.smithi084.stdout:1295: seq_num 414 ranges {6987776=540672,7528448=802816,8331264=458752,8790016=344064} 2024-03-30T12:26:55.905 INFO:tasks.rados.rados.0.smithi084.stdout:1295: writing smithi08477944-24 from 6987776 to 7528448 tid 1 2024-03-30T12:26:55.909 INFO:tasks.rados.rados.0.smithi084.stdout:1295: writing smithi08477944-24 from 7528448 to 8331264 tid 2 2024-03-30T12:26:55.911 INFO:tasks.rados.rados.0.smithi084.stdout:1295: writing smithi08477944-24 from 8331264 to 8790016 tid 3 2024-03-30T12:26:55.914 INFO:tasks.rados.rados.0.smithi084.stdout:1295: writing smithi08477944-24 from 8790016 to 9134080 tid 4 2024-03-30T12:26:55.914 INFO:tasks.rados.rados.0.smithi084.stdout:1296: read oid 5 snap -1 2024-03-30T12:26:55.914 INFO:tasks.rados.rados.0.smithi084.stdout:1296: expect (ObjNum 383 snap 121 seq_num 383) 2024-03-30T12:26:55.914 INFO:tasks.rados.rados.0.smithi084.stdout:1297: read oid 33 snap 130 2024-03-30T12:26:55.914 INFO:tasks.rados.rados.0.smithi084.stdout:1297: expect (ObjNum 406 snap 128 seq_num 406) 2024-03-30T12:26:55.914 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 131 2024-03-30T12:26:55.914 INFO:tasks.rados.rados.0.smithi084.stdout:1295: finishing write tid 1 to smithi08477944-24 2024-03-30T12:26:55.915 INFO:tasks.rados.rados.0.smithi084.stdout:1298: seq_num 415 ranges {5046272=557056,5603328=688128,6291456=663552,6955008=253952} 2024-03-30T12:26:55.945 INFO:tasks.rados.rados.0.smithi084.stdout:1298: writing smithi08477944-49 from 5046272 to 5603328 tid 1 2024-03-30T12:26:55.949 INFO:tasks.rados.rados.0.smithi084.stdout:1298: writing smithi08477944-49 from 5603328 to 6291456 tid 2 2024-03-30T12:26:55.952 INFO:tasks.rados.rados.0.smithi084.stdout:1298: writing smithi08477944-49 from 6291456 to 6955008 tid 3 2024-03-30T12:26:55.958 INFO:tasks.rados.rados.0.smithi084.stdout:1298: writing smithi08477944-49 from 6955008 to 7208960 tid 4 2024-03-30T12:26:55.958 INFO:tasks.rados.rados.0.smithi084.stdout:1299: delete oid 19 current snap is 131 2024-03-30T12:26:55.958 INFO:tasks.rados.rados.0.smithi084.stdout:1295: finishing write tid 2 to smithi08477944-24 2024-03-30T12:26:55.958 INFO:tasks.rados.rados.0.smithi084.stdout:1295: finishing write tid 3 to smithi08477944-24 2024-03-30T12:26:55.958 INFO:tasks.rados.rados.0.smithi084.stdout:1295: finishing write tid 4 to smithi08477944-24 2024-03-30T12:26:55.958 INFO:tasks.rados.rados.0.smithi084.stdout:1295: finishing write tid 5 to smithi08477944-24 2024-03-30T12:26:55.958 INFO:tasks.rados.rados.0.smithi084.stdout:1295: finishing write tid 6 to smithi08477944-24 2024-03-30T12:26:55.958 INFO:tasks.rados.rados.0.smithi084.stdout:1295: oid 24 updating version 0 to 254 2024-03-30T12:26:55.958 INFO:tasks.rados.rados.0.smithi084.stdout:1295: oid 24 version 254 is already newer than 253 2024-03-30T12:26:55.958 INFO:tasks.rados.rados.0.smithi084.stdout:1295: oid 24 updating version 254 to 255 2024-03-30T12:26:55.958 INFO:tasks.rados.rados.0.smithi084.stdout:1295: oid 24 updating version 255 to 256 2024-03-30T12:26:55.958 INFO:tasks.rados.rados.0.smithi084.stdout:1295: oid 24 version 256 is already newer than 252 2024-03-30T12:26:55.959 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 256 (ObjNum 414 snap 131 seq_num 414) dirty exists 2024-03-30T12:26:55.959 INFO:tasks.rados.rados.0.smithi084.stdout:1295: left oid 24 (ObjNum 414 snap 131 seq_num 414) 2024-03-30T12:26:55.959 INFO:tasks.rados.rados.0.smithi084.stdout:1297: expect (ObjNum 406 snap 128 seq_num 406) 2024-03-30T12:26:56.070 INFO:tasks.rados.rados.0.smithi084.stdout:1296: expect (ObjNum 383 snap 121 seq_num 383) 2024-03-30T12:26:56.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:55 smithi162 ceph-mon[83709]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/246 objects degraded (2.033%), 4 pgs degraded) 2024-03-30T12:26:56.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:56.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:56.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:55 smithi162 ceph-mon[83709]: osdmap e336: 8 total, 8 up, 8 in 2024-03-30T12:26:56.173 INFO:tasks.rados.rados.0.smithi084.stdout:1298: finishing write tid 1 to smithi08477944-49 2024-03-30T12:26:56.173 INFO:tasks.rados.rados.0.smithi084.stdout:1298: finishing write tid 2 to smithi08477944-49 2024-03-30T12:26:56.173 INFO:tasks.rados.rados.0.smithi084.stdout:1298: finishing write tid 3 to smithi08477944-49 2024-03-30T12:26:56.173 INFO:tasks.rados.rados.0.smithi084.stdout:1298: finishing write tid 4 to smithi08477944-49 2024-03-30T12:26:56.173 INFO:tasks.rados.rados.0.smithi084.stdout:1298: finishing write tid 5 to smithi08477944-49 2024-03-30T12:26:56.173 INFO:tasks.rados.rados.0.smithi084.stdout:1298: finishing write tid 6 to smithi08477944-49 2024-03-30T12:26:56.173 INFO:tasks.rados.rados.0.smithi084.stdout:1298: oid 49 updating version 0 to 775 2024-03-30T12:26:56.173 INFO:tasks.rados.rados.0.smithi084.stdout:1298: oid 49 version 775 is already newer than 774 2024-03-30T12:26:56.173 INFO:tasks.rados.rados.0.smithi084.stdout:1298: oid 49 version 775 is already newer than 773 2024-03-30T12:26:56.173 INFO:tasks.rados.rados.0.smithi084.stdout:1298: oid 49 updating version 775 to 777 2024-03-30T12:26:56.173 INFO:tasks.rados.rados.0.smithi084.stdout:1298: oid 49 version 777 is already newer than 776 2024-03-30T12:26:56.173 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 777 (ObjNum 415 snap 131 seq_num 415) dirty exists 2024-03-30T12:26:56.173 INFO:tasks.rados.rados.0.smithi084.stdout:1298: left oid 49 (ObjNum 415 snap 131 seq_num 415) 2024-03-30T12:26:56.174 INFO:tasks.rados.rados.0.smithi084.stdout:1295: done (4 left) 2024-03-30T12:26:56.174 INFO:tasks.rados.rados.0.smithi084.stdout:1296: done (3 left) 2024-03-30T12:26:56.174 INFO:tasks.rados.rados.0.smithi084.stdout:1297: done (2 left) 2024-03-30T12:26:56.174 INFO:tasks.rados.rados.0.smithi084.stdout:1298: done (1 left) 2024-03-30T12:26:56.174 INFO:tasks.rados.rados.0.smithi084.stdout:1299: done (0 left) 2024-03-30T12:26:56.174 INFO:tasks.rados.rados.0.smithi084.stdout:1300: snap_remove snap 130 2024-03-30T12:26:56.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:55 smithi084 ceph-mon[91810]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/246 objects degraded (2.033%), 4 pgs degraded) 2024-03-30T12:26:56.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:56.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:56.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:55 smithi084 ceph-mon[91810]: osdmap e336: 8 total, 8 up, 8 in 2024-03-30T12:26:56.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:55.865+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:56.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:55.865+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:56.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:55 smithi084 ceph-mon[89279]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/246 objects degraded (2.033%), 4 pgs degraded) 2024-03-30T12:26:56.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:56.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:56.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:55 smithi084 ceph-mon[89279]: osdmap e336: 8 total, 8 up, 8 in 2024-03-30T12:26:56.863 INFO:tasks.rados.rados.0.smithi084.stdout:1300: done (0 left) 2024-03-30T12:26:56.863 INFO:tasks.rados.rados.0.smithi084.stdout:1301: read oid 18 snap -1 2024-03-30T12:26:56.863 INFO:tasks.rados.rados.0.smithi084.stdout:1301: expect (ObjNum 345 snap 113 seq_num 345) 2024-03-30T12:26:56.864 INFO:tasks.rados.rados.0.smithi084.stdout:1302: snap_create 2024-03-30T12:26:56.874 INFO:tasks.rados.rados.0.smithi084.stdout:1301: expect (ObjNum 345 snap 113 seq_num 345) 2024-03-30T12:26:57.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:56 smithi162 ceph-mon[83709]: osdmap e337: 8 total, 8 up, 8 in 2024-03-30T12:26:57.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:57.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:57.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:56 smithi162 ceph-mon[83709]: pgmap v188: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 142 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 6.1 MiB/s rd, 4.7 MiB/s wr, 11 op/s; 3.7 MiB/s, 1 objects/s recovering 2024-03-30T12:26:57.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:57.075+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:57.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:57.075+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:56 smithi084 ceph-mon[89279]: osdmap e337: 8 total, 8 up, 8 in 2024-03-30T12:26:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:56 smithi084 ceph-mon[89279]: pgmap v188: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 142 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 6.1 MiB/s rd, 4.7 MiB/s wr, 11 op/s; 3.7 MiB/s, 1 objects/s recovering 2024-03-30T12:26:57.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:56 smithi084 ceph-mon[91810]: osdmap e337: 8 total, 8 up, 8 in 2024-03-30T12:26:57.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:57.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:57.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:56 smithi084 ceph-mon[91810]: pgmap v188: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 142 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 6.1 MiB/s rd, 4.7 MiB/s wr, 11 op/s; 3.7 MiB/s, 1 objects/s recovering 2024-03-30T12:26:57.864 INFO:tasks.rados.rados.0.smithi084.stdout:1301: done (1 left) 2024-03-30T12:26:57.864 INFO:tasks.rados.rados.0.smithi084.stdout:1302: done (0 left) 2024-03-30T12:26:57.864 INFO:tasks.rados.rados.0.smithi084.stdout:1303: read oid 12 snap -1 2024-03-30T12:26:57.864 INFO:tasks.rados.rados.0.smithi084.stdout:1303: expect deleted 2024-03-30T12:26:57.864 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 132 2024-03-30T12:26:57.864 INFO:tasks.rados.rados.0.smithi084.stdout:1304: seq_num 417 ranges {1179648=589824,1769472=458752,2228224=679936,2908160=466944} 2024-03-30T12:26:57.873 INFO:tasks.rados.rados.0.smithi084.stdout:1304: writing smithi08477944-32 from 1179648 to 1769472 tid 1 2024-03-30T12:26:57.876 INFO:tasks.rados.rados.0.smithi084.stdout:1304: writing smithi08477944-32 from 1769472 to 2228224 tid 2 2024-03-30T12:26:57.880 INFO:tasks.rados.rados.0.smithi084.stdout:1304: writing smithi08477944-32 from 2228224 to 2908160 tid 3 2024-03-30T12:26:57.884 INFO:tasks.rados.rados.0.smithi084.stdout:1304: writing smithi08477944-32 from 2908160 to 3375104 tid 4 2024-03-30T12:26:57.884 INFO:tasks.rados.rados.0.smithi084.stdout:1305: read oid 19 snap -1 2024-03-30T12:26:57.884 INFO:tasks.rados.rados.0.smithi084.stdout:1305: expect deleted 2024-03-30T12:26:57.884 INFO:tasks.rados.rados.0.smithi084.stdout:1306: read oid 28 snap -1 2024-03-30T12:26:57.884 INFO:tasks.rados.rados.0.smithi084.stdout:1306: expect (ObjNum 205 snap 62 seq_num 205) 2024-03-30T12:26:57.884 INFO:tasks.rados.rados.0.smithi084.stdout:1307: rollback oid 26 current snap is 132 2024-03-30T12:26:57.884 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 26 to 131 2024-03-30T12:26:57.884 INFO:tasks.rados.rados.0.smithi084.stdout:1304: finishing write tid 1 to smithi08477944-32 2024-03-30T12:26:57.884 INFO:tasks.rados.rados.0.smithi084.stdout:1303: done (4 left) 2024-03-30T12:26:57.884 INFO:tasks.rados.rados.0.smithi084.stdout:1308: rollback oid 25 current snap is 132 2024-03-30T12:26:57.885 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 25 to 131 2024-03-30T12:26:57.885 INFO:tasks.rados.rados.0.smithi084.stdout:1304: finishing write tid 2 to smithi08477944-32 2024-03-30T12:26:57.885 INFO:tasks.rados.rados.0.smithi084.stdout:1309: read oid 42 snap -1 2024-03-30T12:26:57.885 INFO:tasks.rados.rados.0.smithi084.stdout:1309: expect (ObjNum 404 snap 126 seq_num 404) 2024-03-30T12:26:57.885 INFO:tasks.rados.rados.0.smithi084.stdout:1310: delete oid 44 current snap is 132 2024-03-30T12:26:57.887 INFO:tasks.rados.rados.0.smithi084.stdout:1305: done (6 left) 2024-03-30T12:26:57.887 INFO:tasks.rados.rados.0.smithi084.stdout:1310: done (5 left) 2024-03-30T12:26:57.887 INFO:tasks.rados.rados.0.smithi084.stdout:1311: rollback oid 12 current snap is 132 2024-03-30T12:26:57.888 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 12 to 131 2024-03-30T12:26:57.888 INFO:tasks.rados.rados.0.smithi084.stdout:1312: rmattr oid 41 current snap is 132 2024-03-30T12:26:57.888 INFO:tasks.rados.rados.0.smithi084.stdout:1312: done (6 left) 2024-03-30T12:26:57.888 INFO:tasks.rados.rados.0.smithi084.stdout:1313: setattr oid 41 current snap is 132 2024-03-30T12:26:57.888 INFO:tasks.rados.rados.0.smithi084.stdout:1314: read oid 49 snap 131 2024-03-30T12:26:57.888 INFO:tasks.rados.rados.0.smithi084.stdout:1314: expect (ObjNum 415 snap 131 seq_num 415) 2024-03-30T12:26:57.888 INFO:tasks.rados.rados.0.smithi084.stdout:1315: setattr oid 4 current snap is 132 2024-03-30T12:26:57.890 INFO:tasks.rados.rados.0.smithi084.stdout:1316: read oid 5 snap 131 2024-03-30T12:26:57.890 INFO:tasks.rados.rados.0.smithi084.stdout:1316: expect (ObjNum 383 snap 121 seq_num 383) 2024-03-30T12:26:57.890 INFO:tasks.rados.rados.0.smithi084.stdout:1317: rollback oid 40 current snap is 132 2024-03-30T12:26:57.890 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 40 to 131 2024-03-30T12:26:57.890 INFO:tasks.rados.rados.0.smithi084.stdout:1318: rollback oid 45 current snap is 132 2024-03-30T12:26:57.891 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 45 to 131 2024-03-30T12:26:57.891 INFO:tasks.rados.rados.0.smithi084.stdout:1319: read oid 34 snap -1 2024-03-30T12:26:57.891 INFO:tasks.rados.rados.0.smithi084.stdout:1319: expect deleted 2024-03-30T12:26:57.891 INFO:tasks.rados.rados.0.smithi084.stdout:1320: read oid 15 snap -1 2024-03-30T12:26:57.891 INFO:tasks.rados.rados.0.smithi084.stdout:1320: expect deleted 2024-03-30T12:26:57.891 INFO:tasks.rados.rados.0.smithi084.stdout:1321: setattr oid 19 current snap is 132 2024-03-30T12:26:57.891 INFO:tasks.rados.rados.0.smithi084.stdout:1311: finishing rollback tid 1 to smithi08477944-12 2024-03-30T12:26:57.891 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 0 (ObjNum 129 snap 0 seq_num 1429196744) dirty dne 2024-03-30T12:26:57.891 INFO:tasks.rados.rados.0.smithi084.stdout:1304: finishing write tid 3 to smithi08477944-32 2024-03-30T12:26:57.891 INFO:tasks.rados.rados.0.smithi084.stdout:1311: done (14 left) 2024-03-30T12:26:57.891 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 132 2024-03-30T12:26:57.891 INFO:tasks.rados.rados.0.smithi084.stdout:1322: seq_num 419 ranges {0=622592,622592=671744,1294336=647168,1941504=286720} 2024-03-30T12:26:57.895 INFO:tasks.rados.rados.0.smithi084.stdout:1322: writing smithi08477944-50 from 0 to 622592 tid 1 2024-03-30T12:26:57.899 INFO:tasks.rados.rados.0.smithi084.stdout:1322: writing smithi08477944-50 from 622592 to 1294336 tid 2 2024-03-30T12:26:57.904 INFO:tasks.rados.rados.0.smithi084.stdout:1322: writing smithi08477944-50 from 1294336 to 1941504 tid 3 2024-03-30T12:26:57.906 INFO:tasks.rados.rados.0.smithi084.stdout:1322: writing smithi08477944-50 from 1941504 to 2228224 tid 4 2024-03-30T12:26:57.906 INFO:tasks.rados.rados.0.smithi084.stdout:1323: snap_create 2024-03-30T12:26:57.908 INFO:tasks.rados.rados.0.smithi084.stdout:1308: finishing rollback tid 0 to smithi08477944-25 2024-03-30T12:26:57.908 INFO:tasks.rados.rados.0.smithi084.stdout:1307: finishing rollback tid 1 to smithi08477944-26 2024-03-30T12:26:57.909 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 0 (ObjNum 289 snap 0 seq_num 0) dirty dne 2024-03-30T12:26:57.909 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 556 (ObjNum 33 snap 0 seq_num 1429290832) dirty exists 2024-03-30T12:26:57.909 INFO:tasks.rados.rados.0.smithi084.stdout:1308: finishing rollback tid 1 to smithi08477944-25 2024-03-30T12:26:57.909 INFO:tasks.rados.rados.0.smithi084.stdout:1306: expect (ObjNum 205 snap 62 seq_num 205) 2024-03-30T12:26:58.029 INFO:tasks.rados.rados.0.smithi084.stdout:1304: finishing write tid 4 to smithi08477944-32 2024-03-30T12:26:58.030 INFO:tasks.rados.rados.0.smithi084.stdout:1304: finishing write tid 5 to smithi08477944-32 2024-03-30T12:26:58.030 INFO:tasks.rados.rados.0.smithi084.stdout:1317: finishing rollback tid 1 to smithi08477944-40 2024-03-30T12:26:58.030 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 0 (ObjNum -1641803672 snap 32767 seq_num 304) dirty dne 2024-03-30T12:26:58.030 INFO:tasks.rados.rados.0.smithi084.stdout:1316: expect (ObjNum 383 snap 121 seq_num 383) 2024-03-30T12:26:58.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:57 smithi162 ceph-mon[83709]: osdmap e338: 8 total, 8 up, 8 in 2024-03-30T12:26:58.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:58.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:58.131 INFO:tasks.rados.rados.0.smithi084.stdout:1308: finishing rollback tid 2 to smithi08477944-25 2024-03-30T12:26:58.132 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 634 (ObjNum 394 snap 125 seq_num 394) dirty exists 2024-03-30T12:26:58.132 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 835 (ObjNum 289 snap 0 seq_num 1) dirty exists 2024-03-30T12:26:58.132 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 651 (ObjNum 399 snap 125 seq_num 399) dirty exists 2024-03-30T12:26:58.132 INFO:tasks.rados.rados.0.smithi084.stdout:1318: finishing rollback tid 0 to smithi08477944-45 2024-03-30T12:26:58.132 INFO:tasks.rados.rados.0.smithi084.stdout:1318: finishing rollback tid 1 to smithi08477944-45 2024-03-30T12:26:58.132 INFO:tasks.rados.rados.0.smithi084.stdout:1318: finishing rollback tid 2 to smithi08477944-45 2024-03-30T12:26:58.132 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 839 (ObjNum 396 snap 125 seq_num 396) dirty exists 2024-03-30T12:26:58.132 INFO:tasks.rados.rados.0.smithi084.stdout:1322: finishing write tid 1 to smithi08477944-50 2024-03-30T12:26:58.132 INFO:tasks.rados.rados.0.smithi084.stdout:1322: finishing write tid 2 to smithi08477944-50 2024-03-30T12:26:58.132 INFO:tasks.rados.rados.0.smithi084.stdout:1322: finishing write tid 3 to smithi08477944-50 2024-03-30T12:26:58.132 INFO:tasks.rados.rados.0.smithi084.stdout:1309: expect (ObjNum 404 snap 126 seq_num 404) 2024-03-30T12:26:58.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:57 smithi084 ceph-mon[91810]: osdmap e338: 8 total, 8 up, 8 in 2024-03-30T12:26:58.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:58.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:58.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:57.871+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:58.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:57.871+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:58.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:57 smithi084 ceph-mon[89279]: osdmap e338: 8 total, 8 up, 8 in 2024-03-30T12:26:58.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:58.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:58.340 INFO:tasks.rados.rados.0.smithi084.stdout:1322: finishing write tid 4 to smithi08477944-50 2024-03-30T12:26:58.340 INFO:tasks.rados.rados.0.smithi084.stdout:1322: finishing write tid 5 to smithi08477944-50 2024-03-30T12:26:58.340 INFO:tasks.rados.rados.0.smithi084.stdout:1322: finishing write tid 6 to smithi08477944-50 2024-03-30T12:26:58.340 INFO:tasks.rados.rados.0.smithi084.stdout:1322: oid 50 updating version 0 to 842 2024-03-30T12:26:58.340 INFO:tasks.rados.rados.0.smithi084.stdout:1322: oid 50 updating version 842 to 845 2024-03-30T12:26:58.340 INFO:tasks.rados.rados.0.smithi084.stdout:1322: oid 50 version 845 is already newer than 841 2024-03-30T12:26:58.341 INFO:tasks.rados.rados.0.smithi084.stdout:1322: oid 50 version 845 is already newer than 843 2024-03-30T12:26:58.341 INFO:tasks.rados.rados.0.smithi084.stdout:1322: oid 50 version 845 is already newer than 844 2024-03-30T12:26:58.341 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 845 (ObjNum 419 snap 132 seq_num 419) dirty exists 2024-03-30T12:26:58.341 INFO:tasks.rados.rados.0.smithi084.stdout:1322: left oid 50 (ObjNum 419 snap 132 seq_num 419) 2024-03-30T12:26:58.341 INFO:tasks.rados.rados.0.smithi084.stdout:1314: expect (ObjNum 415 snap 131 seq_num 415) 2024-03-30T12:26:58.683 INFO:tasks.rados.rados.0.smithi084.stdout:1304: finishing write tid 6 to smithi08477944-32 2024-03-30T12:26:58.683 INFO:tasks.rados.rados.0.smithi084.stdout:1304: oid 32 updating version 0 to 779 2024-03-30T12:26:58.683 INFO:tasks.rados.rados.0.smithi084.stdout:1304: oid 32 version 779 is already newer than 778 2024-03-30T12:26:58.683 INFO:tasks.rados.rados.0.smithi084.stdout:1304: oid 32 updating version 779 to 780 2024-03-30T12:26:58.683 INFO:tasks.rados.rados.0.smithi084.stdout:1304: oid 32 updating version 780 to 782 2024-03-30T12:26:58.683 INFO:tasks.rados.rados.0.smithi084.stdout:1304: oid 32 version 782 is already newer than 781 2024-03-30T12:26:58.683 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 782 (ObjNum 417 snap 132 seq_num 417) dirty exists 2024-03-30T12:26:58.683 INFO:tasks.rados.rados.0.smithi084.stdout:1304: left oid 32 (ObjNum 417 snap 132 seq_num 417) 2024-03-30T12:26:58.873 INFO:tasks.rados.rados.0.smithi084.stdout:1304: done (15 left) 2024-03-30T12:26:58.873 INFO:tasks.rados.rados.0.smithi084.stdout:1306: done (14 left) 2024-03-30T12:26:58.873 INFO:tasks.rados.rados.0.smithi084.stdout:1307: done (13 left) 2024-03-30T12:26:58.873 INFO:tasks.rados.rados.0.smithi084.stdout:1308: done (12 left) 2024-03-30T12:26:58.873 INFO:tasks.rados.rados.0.smithi084.stdout:1309: done (11 left) 2024-03-30T12:26:58.873 INFO:tasks.rados.rados.0.smithi084.stdout:1313: done (10 left) 2024-03-30T12:26:58.874 INFO:tasks.rados.rados.0.smithi084.stdout:1314: done (9 left) 2024-03-30T12:26:58.874 INFO:tasks.rados.rados.0.smithi084.stdout:1315: done (8 left) 2024-03-30T12:26:58.874 INFO:tasks.rados.rados.0.smithi084.stdout:1316: done (7 left) 2024-03-30T12:26:58.874 INFO:tasks.rados.rados.0.smithi084.stdout:1317: done (6 left) 2024-03-30T12:26:58.874 INFO:tasks.rados.rados.0.smithi084.stdout:1318: done (5 left) 2024-03-30T12:26:58.874 INFO:tasks.rados.rados.0.smithi084.stdout:1319: done (4 left) 2024-03-30T12:26:58.874 INFO:tasks.rados.rados.0.smithi084.stdout:1320: done (3 left) 2024-03-30T12:26:58.874 INFO:tasks.rados.rados.0.smithi084.stdout:1321: done (2 left) 2024-03-30T12:26:58.874 INFO:tasks.rados.rados.0.smithi084.stdout:1322: done (1 left) 2024-03-30T12:26:58.874 INFO:tasks.rados.rados.0.smithi084.stdout:1323: done (0 left) 2024-03-30T12:26:58.874 INFO:tasks.rados.rados.0.smithi084.stdout:1324: read oid 27 snap -1 2024-03-30T12:26:58.874 INFO:tasks.rados.rados.0.smithi084.stdout:1324: expect deleted 2024-03-30T12:26:58.874 INFO:tasks.rados.rados.0.smithi084.stdout:1325: rmattr oid 22 current snap is 133 2024-03-30T12:26:58.874 INFO:tasks.rados.rados.0.smithi084.stdout:1326: read oid 43 snap 131 2024-03-30T12:26:58.874 INFO:tasks.rados.rados.0.smithi084.stdout:1326: expect (ObjNum 280 snap 90 seq_num 280) 2024-03-30T12:26:58.875 INFO:tasks.rados.rados.0.smithi084.stdout:1327: snap_create 2024-03-30T12:26:58.882 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 778 (ObjNum 367 snap 117 seq_num 367) dirty exists 2024-03-30T12:26:58.901 INFO:tasks.rados.rados.0.smithi084.stdout:1326: expect (ObjNum 280 snap 90 seq_num 280) 2024-03-30T12:26:59.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:58 smithi162 ceph-mon[83709]: osdmap e339: 8 total, 8 up, 8 in 2024-03-30T12:26:59.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:59.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:59.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:58 smithi162 ceph-mon[83709]: pgmap v191: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 142 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 6.1 MiB/s rd, 4.7 MiB/s wr, 11 op/s; 3.7 MiB/s, 1 objects/s recovering 2024-03-30T12:26:59.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:58.890+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:59.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:58.890+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:59.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:58 smithi084 ceph-mon[91810]: osdmap e339: 8 total, 8 up, 8 in 2024-03-30T12:26:59.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:59.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:59.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:58 smithi084 ceph-mon[91810]: pgmap v191: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 142 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 6.1 MiB/s rd, 4.7 MiB/s wr, 11 op/s; 3.7 MiB/s, 1 objects/s recovering 2024-03-30T12:26:59.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:58 smithi084 ceph-mon[89279]: osdmap e339: 8 total, 8 up, 8 in 2024-03-30T12:26:59.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:26:59.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:26:59.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:58 smithi084 ceph-mon[89279]: pgmap v191: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 142 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 6.1 MiB/s rd, 4.7 MiB/s wr, 11 op/s; 3.7 MiB/s, 1 objects/s recovering 2024-03-30T12:26:59.622 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:26:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:26:59] "GET /metrics HTTP/1.1" 200 36257 "" "Prometheus/2.43.0" 2024-03-30T12:26:59.880 INFO:tasks.rados.rados.0.smithi084.stdout:1324: done (3 left) 2024-03-30T12:26:59.880 INFO:tasks.rados.rados.0.smithi084.stdout:1325: done (2 left) 2024-03-30T12:26:59.880 INFO:tasks.rados.rados.0.smithi084.stdout:1326: done (1 left) 2024-03-30T12:26:59.880 INFO:tasks.rados.rados.0.smithi084.stdout:1327: done (0 left) 2024-03-30T12:26:59.880 INFO:tasks.rados.rados.0.smithi084.stdout:1328: setattr oid 18 current snap is 134 2024-03-30T12:26:59.882 INFO:tasks.rados.rados.0.smithi084.stdout:1329: setattr oid 47 current snap is 134 2024-03-30T12:26:59.885 INFO:tasks.rados.rados.0.smithi084.stdout:1330: delete oid 41 current snap is 134 2024-03-30T12:26:59.890 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 836 (ObjNum 346 snap 113 seq_num 346) dirty exists 2024-03-30T12:26:59.891 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 847 (ObjNum 345 snap 113 seq_num 345) dirty exists 2024-03-30T12:26:59.891 INFO:tasks.rados.rados.0.smithi084.stdout:1328: done (2 left) 2024-03-30T12:26:59.891 INFO:tasks.rados.rados.0.smithi084.stdout:1329: done (1 left) 2024-03-30T12:26:59.891 INFO:tasks.rados.rados.0.smithi084.stdout:1330: done (0 left) 2024-03-30T12:26:59.891 INFO:tasks.rados.rados.0.smithi084.stdout:1331: snap_create 2024-03-30T12:27:00.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:59 smithi084 ceph-mon[91810]: osdmap e340: 8 total, 8 up, 8 in 2024-03-30T12:27:00.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:00.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:00.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:00.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:26:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:27:00.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:59.897+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:00.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:26:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:26:59.898+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:59 smithi084 ceph-mon[89279]: osdmap e340: 8 total, 8 up, 8 in 2024-03-30T12:27:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:00.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:00.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:26:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:27:00.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:59 smithi162 ceph-mon[83709]: osdmap e340: 8 total, 8 up, 8 in 2024-03-30T12:27:00.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:00.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:00.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:00.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:26:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:27:00.891 INFO:tasks.rados.rados.0.smithi084.stdout:1331: done (0 left) 2024-03-30T12:27:00.892 INFO:tasks.rados.rados.0.smithi084.stdout:1332: copy_from oid 49 from oid 48 current snap is 135 2024-03-30T12:27:00.892 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 135 2024-03-30T12:27:00.892 INFO:tasks.rados.rados.0.smithi084.stdout:1333: seq_num 421 ranges {0=655360,655360=442368,1097728=663552,1761280=499712} 2024-03-30T12:27:00.894 INFO:tasks.rados.rados.0.smithi084.stdout:1333: writing smithi08477944-15 from 0 to 655360 tid 1 2024-03-30T12:27:00.897 INFO:tasks.rados.rados.0.smithi084.stdout:1333: writing smithi08477944-15 from 655360 to 1097728 tid 2 2024-03-30T12:27:00.901 INFO:tasks.rados.rados.0.smithi084.stdout:1333: writing smithi08477944-15 from 1097728 to 1761280 tid 3 2024-03-30T12:27:00.905 INFO:tasks.rados.rados.0.smithi084.stdout:1333: writing smithi08477944-15 from 1761280 to 2260992 tid 4 2024-03-30T12:27:00.905 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 135 2024-03-30T12:27:00.905 INFO:tasks.rados.rados.0.smithi084.stdout:1332: finishing copy_from to smithi08477944-49 2024-03-30T12:27:00.905 INFO:tasks.rados.rados.0.smithi084.stdout:1332: got expected ENOENT (src dne) 2024-03-30T12:27:00.905 INFO:tasks.rados.rados.0.smithi084.stdout:1332: finishing copy_from racing read to smithi08477944-49 2024-03-30T12:27:00.905 INFO:tasks.rados.rados.0.smithi084.stdout:1334: seq_num 422 ranges {7544832=671744,8216576=729088,8945664=417792,9363456=458752} 2024-03-30T12:27:00.948 INFO:tasks.rados.rados.0.smithi084.stdout:1334: writing smithi08477944-17 from 7544832 to 8216576 tid 1 2024-03-30T12:27:00.952 INFO:tasks.rados.rados.0.smithi084.stdout:1334: writing smithi08477944-17 from 8216576 to 8945664 tid 2 2024-03-30T12:27:00.954 INFO:tasks.rados.rados.0.smithi084.stdout:1334: writing smithi08477944-17 from 8945664 to 9363456 tid 3 2024-03-30T12:27:00.959 INFO:tasks.rados.rados.0.smithi084.stdout:1334: writing smithi08477944-17 from 9363456 to 9822208 tid 4 2024-03-30T12:27:00.959 INFO:tasks.rados.rados.0.smithi084.stdout:1332: done (2 left) 2024-03-30T12:27:00.959 INFO:tasks.rados.rados.0.smithi084.stdout:1335: rollback oid 33 current snap is 135 2024-03-30T12:27:00.959 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 33 to 134 2024-03-30T12:27:00.959 INFO:tasks.rados.rados.0.smithi084.stdout:1333: finishing write tid 1 to smithi08477944-15 2024-03-30T12:27:00.959 INFO:tasks.rados.rados.0.smithi084.stdout:1333: finishing write tid 2 to smithi08477944-15 2024-03-30T12:27:00.959 INFO:tasks.rados.rados.0.smithi084.stdout:1333: finishing write tid 3 to smithi08477944-15 2024-03-30T12:27:00.959 INFO:tasks.rados.rados.0.smithi084.stdout:1333: finishing write tid 4 to smithi08477944-15 2024-03-30T12:27:00.959 INFO:tasks.rados.rados.0.smithi084.stdout:1333: finishing write tid 5 to smithi08477944-15 2024-03-30T12:27:00.959 INFO:tasks.rados.rados.0.smithi084.stdout:1333: finishing write tid 6 to smithi08477944-15 2024-03-30T12:27:00.959 INFO:tasks.rados.rados.0.smithi084.stdout:1333: oid 15 updating version 0 to 642 2024-03-30T12:27:00.959 INFO:tasks.rados.rados.0.smithi084.stdout:1333: oid 15 updating version 642 to 644 2024-03-30T12:27:00.960 INFO:tasks.rados.rados.0.smithi084.stdout:1333: oid 15 version 644 is already newer than 643 2024-03-30T12:27:00.960 INFO:tasks.rados.rados.0.smithi084.stdout:1333: oid 15 updating version 644 to 646 2024-03-30T12:27:00.960 INFO:tasks.rados.rados.0.smithi084.stdout:1333: oid 15 version 646 is already newer than 645 2024-03-30T12:27:00.960 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 646 (ObjNum 421 snap 135 seq_num 421) dirty exists 2024-03-30T12:27:00.960 INFO:tasks.rados.rados.0.smithi084.stdout:1333: left oid 15 (ObjNum 421 snap 135 seq_num 421) 2024-03-30T12:27:00.960 INFO:tasks.rados.rados.0.smithi084.stdout:1334: finishing write tid 1 to smithi08477944-17 2024-03-30T12:27:00.960 INFO:tasks.rados.rados.0.smithi084.stdout:1334: finishing write tid 2 to smithi08477944-17 2024-03-30T12:27:00.960 INFO:tasks.rados.rados.0.smithi084.stdout:1334: finishing write tid 3 to smithi08477944-17 2024-03-30T12:27:00.960 INFO:tasks.rados.rados.0.smithi084.stdout:1333: done (2 left) 2024-03-30T12:27:00.960 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 135 2024-03-30T12:27:00.960 INFO:tasks.rados.rados.0.smithi084.stdout:1336: seq_num 423 ranges {3317760=688128,4005888=614400,4620288=622592,5242880=368640} 2024-03-30T12:27:00.980 INFO:tasks.rados.rados.0.smithi084.stdout:1336: writing smithi08477944-2 from 3317760 to 4005888 tid 1 2024-03-30T12:27:00.982 INFO:tasks.rados.rados.0.smithi084.stdout:1336: writing smithi08477944-2 from 4005888 to 4620288 tid 2 2024-03-30T12:27:00.986 INFO:tasks.rados.rados.0.smithi084.stdout:1336: writing smithi08477944-2 from 4620288 to 5242880 tid 3 2024-03-30T12:27:00.989 INFO:tasks.rados.rados.0.smithi084.stdout:1336: writing smithi08477944-2 from 5242880 to 5611520 tid 4 2024-03-30T12:27:00.989 INFO:tasks.rados.rados.0.smithi084.stdout:1337: delete oid 47 current snap is 135 2024-03-30T12:27:00.989 INFO:tasks.rados.rados.0.smithi084.stdout:1334: finishing write tid 4 to smithi08477944-17 2024-03-30T12:27:00.989 INFO:tasks.rados.rados.0.smithi084.stdout:1334: finishing write tid 5 to smithi08477944-17 2024-03-30T12:27:00.989 INFO:tasks.rados.rados.0.smithi084.stdout:1335: finishing rollback tid 0 to smithi08477944-33 2024-03-30T12:27:00.989 INFO:tasks.rados.rados.0.smithi084.stdout:1335: finishing rollback tid 1 to smithi08477944-33 2024-03-30T12:27:00.989 INFO:tasks.rados.rados.0.smithi084.stdout:1335: finishing rollback tid 2 to smithi08477944-33 2024-03-30T12:27:00.990 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 840 (ObjNum 406 snap 128 seq_num 406) dirty exists 2024-03-30T12:27:00.990 INFO:tasks.rados.rados.0.smithi084.stdout:1334: finishing write tid 6 to smithi08477944-17 2024-03-30T12:27:00.990 INFO:tasks.rados.rados.0.smithi084.stdout:1334: oid 17 updating version 0 to 650 2024-03-30T12:27:00.990 INFO:tasks.rados.rados.0.smithi084.stdout:1334: oid 17 version 650 is already newer than 649 2024-03-30T12:27:00.990 INFO:tasks.rados.rados.0.smithi084.stdout:1334: oid 17 version 650 is already newer than 648 2024-03-30T12:27:00.990 INFO:tasks.rados.rados.0.smithi084.stdout:1334: oid 17 version 650 is already newer than 647 2024-03-30T12:27:00.990 INFO:tasks.rados.rados.0.smithi084.stdout:1334: oid 17 updating version 650 to 651 2024-03-30T12:27:00.990 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 651 (ObjNum 422 snap 135 seq_num 422) dirty exists 2024-03-30T12:27:00.990 INFO:tasks.rados.rados.0.smithi084.stdout:1334: left oid 17 (ObjNum 422 snap 135 seq_num 422) 2024-03-30T12:27:00.990 INFO:tasks.rados.rados.0.smithi084.stdout:1336: finishing write tid 1 to smithi08477944-2 2024-03-30T12:27:00.990 INFO:tasks.rados.rados.0.smithi084.stdout:1336: finishing write tid 2 to smithi08477944-2 2024-03-30T12:27:00.991 INFO:tasks.rados.rados.0.smithi084.stdout:1336: finishing write tid 3 to smithi08477944-2 2024-03-30T12:27:00.992 INFO:tasks.rados.rados.0.smithi084.stdout:1334: done (3 left) 2024-03-30T12:27:00.992 INFO:tasks.rados.rados.0.smithi084.stdout:1335: done (2 left) 2024-03-30T12:27:00.992 INFO:tasks.rados.rados.0.smithi084.stdout:1337: done (1 left) 2024-03-30T12:27:00.992 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 135 2024-03-30T12:27:00.992 INFO:tasks.rados.rados.0.smithi084.stdout:1338: seq_num 425 ranges {0=720896,720896=778240,1499136=638976,2138112=188416} 2024-03-30T12:27:00.996 INFO:tasks.rados.rados.0.smithi084.stdout:1338: writing smithi08477944-44 from 0 to 720896 tid 1 2024-03-30T12:27:01.000 INFO:tasks.rados.rados.0.smithi084.stdout:1338: writing smithi08477944-44 from 720896 to 1499136 tid 2 2024-03-30T12:27:01.004 INFO:tasks.rados.rados.0.smithi084.stdout:1338: writing smithi08477944-44 from 1499136 to 2138112 tid 3 2024-03-30T12:27:01.005 INFO:tasks.rados.rados.0.smithi084.stdout:1338: writing smithi08477944-44 from 2138112 to 2326528 tid 4 2024-03-30T12:27:01.005 INFO:tasks.rados.rados.0.smithi084.stdout:1339: read oid 20 snap -1 2024-03-30T12:27:01.005 INFO:tasks.rados.rados.0.smithi084.stdout:1339: expect (ObjNum 366 snap 117 seq_num 366) 2024-03-30T12:27:01.005 INFO:tasks.rados.rados.0.smithi084.stdout:1340: snap_create 2024-03-30T12:27:01.005 INFO:tasks.rados.rados.0.smithi084.stdout:1336: finishing write tid 4 to smithi08477944-2 2024-03-30T12:27:01.005 INFO:tasks.rados.rados.0.smithi084.stdout:1336: finishing write tid 5 to smithi08477944-2 2024-03-30T12:27:01.006 INFO:tasks.rados.rados.0.smithi084.stdout:1336: finishing write tid 6 to smithi08477944-2 2024-03-30T12:27:01.006 INFO:tasks.rados.rados.0.smithi084.stdout:1336: oid 2 updating version 0 to 779 2024-03-30T12:27:01.006 INFO:tasks.rados.rados.0.smithi084.stdout:1336: oid 2 updating version 779 to 780 2024-03-30T12:27:01.006 INFO:tasks.rados.rados.0.smithi084.stdout:1336: oid 2 updating version 780 to 783 2024-03-30T12:27:01.006 INFO:tasks.rados.rados.0.smithi084.stdout:1336: oid 2 version 783 is already newer than 782 2024-03-30T12:27:01.006 INFO:tasks.rados.rados.0.smithi084.stdout:1336: oid 2 version 783 is already newer than 781 2024-03-30T12:27:01.006 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 783 (ObjNum 423 snap 135 seq_num 423) dirty exists 2024-03-30T12:27:01.006 INFO:tasks.rados.rados.0.smithi084.stdout:1336: left oid 2 (ObjNum 423 snap 135 seq_num 423) 2024-03-30T12:27:01.006 INFO:tasks.rados.rados.0.smithi084.stdout:1338: finishing write tid 1 to smithi08477944-44 2024-03-30T12:27:01.006 INFO:tasks.rados.rados.0.smithi084.stdout:1338: finishing write tid 2 to smithi08477944-44 2024-03-30T12:27:01.009 INFO:tasks.rados.rados.0.smithi084.stdout:1338: finishing write tid 3 to smithi08477944-44 2024-03-30T12:27:01.009 INFO:tasks.rados.rados.0.smithi084.stdout:1338: finishing write tid 4 to smithi08477944-44 2024-03-30T12:27:01.009 INFO:tasks.rados.rados.0.smithi084.stdout:1338: finishing write tid 5 to smithi08477944-44 2024-03-30T12:27:01.010 INFO:tasks.rados.rados.0.smithi084.stdout:1338: finishing write tid 6 to smithi08477944-44 2024-03-30T12:27:01.010 INFO:tasks.rados.rados.0.smithi084.stdout:1338: oid 44 updating version 0 to 559 2024-03-30T12:27:01.010 INFO:tasks.rados.rados.0.smithi084.stdout:1338: oid 44 version 559 is already newer than 557 2024-03-30T12:27:01.011 INFO:tasks.rados.rados.0.smithi084.stdout:1338: oid 44 updating version 559 to 560 2024-03-30T12:27:01.011 INFO:tasks.rados.rados.0.smithi084.stdout:1338: oid 44 version 560 is already newer than 558 2024-03-30T12:27:01.011 INFO:tasks.rados.rados.0.smithi084.stdout:1338: oid 44 updating version 560 to 561 2024-03-30T12:27:01.011 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 561 (ObjNum 425 snap 135 seq_num 425) dirty exists 2024-03-30T12:27:01.011 INFO:tasks.rados.rados.0.smithi084.stdout:1338: left oid 44 (ObjNum 425 snap 135 seq_num 425) 2024-03-30T12:27:01.022 INFO:tasks.rados.rados.0.smithi084.stdout:1339: expect (ObjNum 366 snap 117 seq_num 366) 2024-03-30T12:27:01.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:00 smithi084 ceph-mon[91810]: osdmap e341: 8 total, 8 up, 8 in 2024-03-30T12:27:01.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:01.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:01.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:00 smithi084 ceph-mon[91810]: pgmap v194: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 138 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 1.0 MiB/s wr, 41 op/s 2024-03-30T12:27:01.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:00.901+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:01.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:00.902+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:01.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:00 smithi084 ceph-mon[89279]: osdmap e341: 8 total, 8 up, 8 in 2024-03-30T12:27:01.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:01.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:01.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:00 smithi084 ceph-mon[89279]: pgmap v194: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 138 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 1.0 MiB/s wr, 41 op/s 2024-03-30T12:27:01.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:00 smithi162 ceph-mon[83709]: osdmap e341: 8 total, 8 up, 8 in 2024-03-30T12:27:01.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:01.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:01.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:00 smithi162 ceph-mon[83709]: pgmap v194: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 138 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 1.0 MiB/s wr, 41 op/s 2024-03-30T12:27:01.898 INFO:tasks.rados.rados.0.smithi084.stdout:1336: done (3 left) 2024-03-30T12:27:01.898 INFO:tasks.rados.rados.0.smithi084.stdout:1338: done (2 left) 2024-03-30T12:27:01.898 INFO:tasks.rados.rados.0.smithi084.stdout:1339: done (1 left) 2024-03-30T12:27:01.898 INFO:tasks.rados.rados.0.smithi084.stdout:1340: done (0 left) 2024-03-30T12:27:01.898 INFO:tasks.rados.rados.0.smithi084.stdout:1341: snap_remove snap 131 2024-03-30T12:27:02.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:01 smithi084 ceph-mon[89279]: osdmap e342: 8 total, 8 up, 8 in 2024-03-30T12:27:02.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:02.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:01 smithi084 ceph-mon[91810]: osdmap e342: 8 total, 8 up, 8 in 2024-03-30T12:27:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:02.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:01.906+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:02.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:01.906+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:02.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:01 smithi162 ceph-mon[83709]: osdmap e342: 8 total, 8 up, 8 in 2024-03-30T12:27:02.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset bc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:02.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:01 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:02.903 INFO:tasks.rados.rados.0.smithi084.stdout:1341: done (0 left) 2024-03-30T12:27:02.903 INFO:tasks.rados.rados.0.smithi084.stdout:1342: delete oid 32 current snap is 136 2024-03-30T12:27:02.907 INFO:tasks.rados.rados.0.smithi084.stdout:1342: done (0 left) 2024-03-30T12:27:02.907 INFO:tasks.rados.rados.0.smithi084.stdout:1343: delete oid 21 current snap is 136 2024-03-30T12:27:02.910 INFO:tasks.rados.rados.0.smithi084.stdout:1343: done (0 left) 2024-03-30T12:27:02.910 INFO:tasks.rados.rados.0.smithi084.stdout:1344: snap_remove snap 134 2024-03-30T12:27:03.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:02 smithi084 ceph-mon[91810]: osdmap e343: 8 total, 8 up, 8 in 2024-03-30T12:27:03.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:03.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:03.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:02 smithi084 ceph-mon[91810]: pgmap v197: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 142 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 23 MiB/s rd, 2.1 MiB/s wr, 46 op/s 2024-03-30T12:27:03.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:02 smithi084 ceph-mon[89279]: osdmap e343: 8 total, 8 up, 8 in 2024-03-30T12:27:03.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:03.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:03.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:02 smithi084 ceph-mon[89279]: pgmap v197: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 142 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 23 MiB/s rd, 2.1 MiB/s wr, 46 op/s 2024-03-30T12:27:03.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:02.910+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:03.255 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:02.910+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:03.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:02 smithi162 ceph-mon[83709]: osdmap e343: 8 total, 8 up, 8 in 2024-03-30T12:27:03.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:03.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:03.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:02 smithi162 ceph-mon[83709]: pgmap v197: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 142 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 23 MiB/s rd, 2.1 MiB/s wr, 46 op/s 2024-03-30T12:27:03.909 INFO:tasks.rados.rados.0.smithi084.stdout:1344: done (0 left) 2024-03-30T12:27:03.909 INFO:tasks.rados.rados.0.smithi084.stdout:1345: snap_remove snap 135 2024-03-30T12:27:04.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:04.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:04.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:03 smithi084 ceph-mon[91810]: osdmap e344: 8 total, 8 up, 8 in 2024-03-30T12:27:04.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:04.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:04.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:03 smithi084 ceph-mon[89279]: osdmap e344: 8 total, 8 up, 8 in 2024-03-30T12:27:04.255 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:03.922+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:04.255 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:03.922+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:04.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:04.382 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:04.382 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:03 smithi162 ceph-mon[83709]: osdmap e344: 8 total, 8 up, 8 in 2024-03-30T12:27:04.917 INFO:tasks.rados.rados.0.smithi084.stdout:1345: done (0 left) 2024-03-30T12:27:04.917 INFO:tasks.rados.rados.0.smithi084.stdout:1346: copy_from oid 11 from oid 16 current snap is 136 2024-03-30T12:27:04.917 INFO:tasks.rados.rados.0.smithi084.stdout:1347: rollback oid 40 current snap is 136 2024-03-30T12:27:04.917 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 40 to 132 2024-03-30T12:27:04.917 INFO:tasks.rados.rados.0.smithi084.stdout:1348: read oid 17 snap -1 2024-03-30T12:27:04.917 INFO:tasks.rados.rados.0.smithi084.stdout:1348: expect (ObjNum 422 snap 135 seq_num 422) 2024-03-30T12:27:04.917 INFO:tasks.rados.rados.0.smithi084.stdout:1349: read oid 15 snap -1 2024-03-30T12:27:04.917 INFO:tasks.rados.rados.0.smithi084.stdout:1349: expect (ObjNum 421 snap 135 seq_num 421) 2024-03-30T12:27:04.918 INFO:tasks.rados.rados.0.smithi084.stdout:1350: snap_remove snap 133 2024-03-30T12:27:05.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:04 smithi084 ceph-mon[91810]: osdmap e345: 8 total, 8 up, 8 in 2024-03-30T12:27:05.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:05.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:05.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:04 smithi084 ceph-mon[91810]: pgmap v200: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 142 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 8.4 MiB/s rd, 1.0 MiB/s wr, 4 op/s 2024-03-30T12:27:05.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:04 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:05.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:04.932+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:05.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:04.965+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:05.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:04 smithi084 ceph-mon[89279]: osdmap e345: 8 total, 8 up, 8 in 2024-03-30T12:27:05.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:05.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:05.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:04 smithi084 ceph-mon[89279]: pgmap v200: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 142 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 8.4 MiB/s rd, 1.0 MiB/s wr, 4 op/s 2024-03-30T12:27:05.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:04 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:05.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:04 smithi162 ceph-mon[83709]: osdmap e345: 8 total, 8 up, 8 in 2024-03-30T12:27:05.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:05.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:05.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:04 smithi162 ceph-mon[83709]: pgmap v200: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 142 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 8.4 MiB/s rd, 1.0 MiB/s wr, 4 op/s 2024-03-30T12:27:05.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:04 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:05.927 INFO:tasks.rados.rados.0.smithi084.stdout:1350: done (4 left) 2024-03-30T12:27:05.927 INFO:tasks.rados.rados.0.smithi084.stdout:1351: rollback oid 38 current snap is 136 2024-03-30T12:27:05.927 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 38 to 132 2024-03-30T12:27:05.927 INFO:tasks.rados.rados.0.smithi084.stdout:1352: rollback oid 27 current snap is 136 2024-03-30T12:27:05.927 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 27 to 132 2024-03-30T12:27:05.927 INFO:tasks.rados.rados.0.smithi084.stdout:1353: setattr oid 8 current snap is 136 2024-03-30T12:27:05.927 INFO:tasks.rados.rados.0.smithi084.stdout:1354: read oid 45 snap -1 2024-03-30T12:27:05.928 INFO:tasks.rados.rados.0.smithi084.stdout:1354: expect (ObjNum 396 snap 125 seq_num 396) 2024-03-30T12:27:05.928 INFO:tasks.rados.rados.0.smithi084.stdout:1355: snap_create 2024-03-30T12:27:05.928 INFO:tasks.rados.rados.0.smithi084.stdout:1347: finishing rollback tid 1 to smithi08477944-40 2024-03-30T12:27:05.928 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 0 (ObjNum 33 snap 0 seq_num 1394497328) dirty dne 2024-03-30T12:27:05.928 INFO:tasks.rados.rados.0.smithi084.stdout:1346: finishing copy_from racing read to smithi08477944-11 2024-03-30T12:27:05.928 INFO:tasks.rados.rados.0.smithi084.stdout:1346: finishing copy_from to smithi08477944-11 2024-03-30T12:27:05.928 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 815 (ObjNum 395 snap 125 seq_num 395) dirty exists 2024-03-30T12:27:05.928 INFO:tasks.rados.rados.0.smithi084.stdout:1348: expect (ObjNum 422 snap 135 seq_num 422) 2024-03-30T12:27:06.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:05 smithi084 ceph-mon[91810]: osdmap e346: 8 total, 8 up, 8 in 2024-03-30T12:27:06.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:06.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:06.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:05.936+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:06.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:05.938+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:06.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:05 smithi084 ceph-mon[89279]: osdmap e346: 8 total, 8 up, 8 in 2024-03-30T12:27:06.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:06.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:06.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:05 smithi162 ceph-mon[83709]: osdmap e346: 8 total, 8 up, 8 in 2024-03-30T12:27:06.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:06.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:06.552 INFO:tasks.rados.rados.0.smithi084.stdout:1349: expect (ObjNum 421 snap 135 seq_num 421) 2024-03-30T12:27:06.609 INFO:tasks.rados.rados.0.smithi084.stdout:1351: finishing rollback tid 0 to smithi08477944-38 2024-03-30T12:27:06.609 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 784 (ObjNum 401 snap 125 seq_num 401) dirty exists 2024-03-30T12:27:06.609 INFO:tasks.rados.rados.0.smithi084.stdout:1352: finishing rollback tid 1 to smithi08477944-27 2024-03-30T12:27:06.609 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 0 (ObjNum 49 snap 0 seq_num 194110667) dirty dne 2024-03-30T12:27:06.609 INFO:tasks.rados.rados.0.smithi084.stdout:1351: finishing rollback tid 1 to smithi08477944-38 2024-03-30T12:27:06.609 INFO:tasks.rados.rados.0.smithi084.stdout:1351: finishing rollback tid 2 to smithi08477944-38 2024-03-30T12:27:06.609 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 492 (ObjNum 379 snap 120 seq_num 379) dirty exists 2024-03-30T12:27:06.609 INFO:tasks.rados.rados.0.smithi084.stdout:1354: expect (ObjNum 396 snap 125 seq_num 396) 2024-03-30T12:27:06.933 INFO:tasks.rados.rados.0.smithi084.stdout:1346: done (8 left) 2024-03-30T12:27:06.934 INFO:tasks.rados.rados.0.smithi084.stdout:1347: done (7 left) 2024-03-30T12:27:06.934 INFO:tasks.rados.rados.0.smithi084.stdout:1348: done (6 left) 2024-03-30T12:27:06.935 INFO:tasks.rados.rados.0.smithi084.stdout:1349: done (5 left) 2024-03-30T12:27:06.936 INFO:tasks.rados.rados.0.smithi084.stdout:1351: done (4 left) 2024-03-30T12:27:06.936 INFO:tasks.rados.rados.0.smithi084.stdout:1352: done (3 left) 2024-03-30T12:27:06.936 INFO:tasks.rados.rados.0.smithi084.stdout:1353: done (2 left) 2024-03-30T12:27:06.936 INFO:tasks.rados.rados.0.smithi084.stdout:1354: done (1 left) 2024-03-30T12:27:06.936 INFO:tasks.rados.rados.0.smithi084.stdout:1355: done (0 left) 2024-03-30T12:27:06.936 INFO:tasks.rados.rados.0.smithi084.stdout:1356: copy_from oid 12 from oid 38 current snap is 137 2024-03-30T12:27:06.936 INFO:tasks.rados.rados.0.smithi084.stdout:1357: read oid 23 snap 132 2024-03-30T12:27:06.936 INFO:tasks.rados.rados.0.smithi084.stdout:1357: expect (ObjNum 402 snap 125 seq_num 402) 2024-03-30T12:27:06.936 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 31 current snap is 137 2024-03-30T12:27:06.937 INFO:tasks.rados.rados.0.smithi084.stdout:1358: seq_num 428 ranges {1441792=778240,2220032=483328,2703360=409600,3112960=417792,3530752=294912} 2024-03-30T12:27:06.946 INFO:tasks.rados.rados.0.smithi084.stdout:1358: writing smithi08477944-31 from 1441792 to 2220032 tid 1 2024-03-30T12:27:06.949 INFO:tasks.rados.rados.0.smithi084.stdout:1358: writing smithi08477944-31 from 2220032 to 2703360 tid 2 2024-03-30T12:27:06.952 INFO:tasks.rados.rados.0.smithi084.stdout:1358: writing smithi08477944-31 from 2703360 to 3112960 tid 3 2024-03-30T12:27:06.954 INFO:tasks.rados.rados.0.smithi084.stdout:1358: writing smithi08477944-31 from 3112960 to 3530752 tid 4 2024-03-30T12:27:06.956 INFO:tasks.rados.rados.0.smithi084.stdout:1358: writing smithi08477944-31 from 3530752 to 3825664 tid 5 2024-03-30T12:27:06.956 INFO:tasks.rados.rados.0.smithi084.stdout:1359: rollback oid 15 current snap is 137 2024-03-30T12:27:06.956 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 15 to 136 2024-03-30T12:27:06.957 INFO:tasks.rados.rados.0.smithi084.stdout:1357: expect (ObjNum 402 snap 125 seq_num 402) 2024-03-30T12:27:07.031 INFO:tasks.rados.rados.0.smithi084.stdout:1356: finishing copy_from racing read to smithi08477944-12 2024-03-30T12:27:07.031 INFO:tasks.rados.rados.0.smithi084.stdout:1358: finishing write tid 1 to smithi08477944-31 2024-03-30T12:27:07.031 INFO:tasks.rados.rados.0.smithi084.stdout:1358: finishing write tid 2 to smithi08477944-31 2024-03-30T12:27:07.032 INFO:tasks.rados.rados.0.smithi084.stdout:1358: finishing write tid 3 to smithi08477944-31 2024-03-30T12:27:07.032 INFO:tasks.rados.rados.0.smithi084.stdout:1356: finishing copy_from to smithi08477944-12 2024-03-30T12:27:07.032 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 492 (ObjNum 379 snap 120 seq_num 379) dirty exists 2024-03-30T12:27:07.032 INFO:tasks.rados.rados.0.smithi084.stdout:1358: finishing write tid 4 to smithi08477944-31 2024-03-30T12:27:07.032 INFO:tasks.rados.rados.0.smithi084.stdout:1359: finishing rollback tid 0 to smithi08477944-15 2024-03-30T12:27:07.032 INFO:tasks.rados.rados.0.smithi084.stdout:1358: finishing write tid 5 to smithi08477944-31 2024-03-30T12:27:07.032 INFO:tasks.rados.rados.0.smithi084.stdout:1356: done (3 left) 2024-03-30T12:27:07.032 INFO:tasks.rados.rados.0.smithi084.stdout:1357: done (2 left) 2024-03-30T12:27:07.032 INFO:tasks.rados.rados.0.smithi084.stdout:1360: read oid 34 snap -1 2024-03-30T12:27:07.032 INFO:tasks.rados.rados.0.smithi084.stdout:1360: expect deleted 2024-03-30T12:27:07.032 INFO:tasks.rados.rados.0.smithi084.stdout:1361: copy_from oid 30 from oid 19 current snap is 137 2024-03-30T12:27:07.032 INFO:tasks.rados.rados.0.smithi084.stdout:1358: finishing write tid 6 to smithi08477944-31 2024-03-30T12:27:07.032 INFO:tasks.rados.rados.0.smithi084.stdout:1359: finishing rollback tid 1 to smithi08477944-15 2024-03-30T12:27:07.032 INFO:tasks.rados.rados.0.smithi084.stdout:1359: finishing rollback tid 2 to smithi08477944-15 2024-03-30T12:27:07.033 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 654 (ObjNum 421 snap 135 seq_num 421) dirty exists 2024-03-30T12:27:07.033 INFO:tasks.rados.rados.0.smithi084.stdout:1358: finishing write tid 7 to smithi08477944-31 2024-03-30T12:27:07.033 INFO:tasks.rados.rados.0.smithi084.stdout:1358: oid 31 updating version 0 to 657 2024-03-30T12:27:07.033 INFO:tasks.rados.rados.0.smithi084.stdout:1358: oid 31 version 657 is already newer than 655 2024-03-30T12:27:07.033 INFO:tasks.rados.rados.0.smithi084.stdout:1358: oid 31 version 657 is already newer than 652 2024-03-30T12:27:07.033 INFO:tasks.rados.rados.0.smithi084.stdout:1358: oid 31 version 657 is already newer than 654 2024-03-30T12:27:07.033 INFO:tasks.rados.rados.0.smithi084.stdout:1358: oid 31 version 657 is already newer than 656 2024-03-30T12:27:07.033 INFO:tasks.rados.rados.0.smithi084.stdout:1358: oid 31 version 657 is already newer than 653 2024-03-30T12:27:07.033 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 657 (ObjNum 428 snap 137 seq_num 428) dirty exists 2024-03-30T12:27:07.033 INFO:tasks.rados.rados.0.smithi084.stdout:1358: left oid 31 (ObjNum 428 snap 137 seq_num 428) 2024-03-30T12:27:07.033 INFO:tasks.rados.rados.0.smithi084.stdout:1358: done (3 left) 2024-03-30T12:27:07.033 INFO:tasks.rados.rados.0.smithi084.stdout:1359: done (2 left) 2024-03-30T12:27:07.033 INFO:tasks.rados.rados.0.smithi084.stdout:1362: snap_create 2024-03-30T12:27:07.034 INFO:tasks.rados.rados.0.smithi084.stdout:1361: finishing copy_from racing read to smithi08477944-30 2024-03-30T12:27:07.034 INFO:tasks.rados.rados.0.smithi084.stdout:1361: finishing copy_from to smithi08477944-30 2024-03-30T12:27:07.034 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 556 (ObjNum 177 snap 0 seq_num 194169681) dirty exists 2024-03-30T12:27:07.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:06 smithi084 ceph-mon[89279]: osdmap e347: 8 total, 8 up, 8 in 2024-03-30T12:27:07.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:07.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:07.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:06 smithi084 ceph-mon[89279]: pgmap v203: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 153 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-03-30T12:27:07.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:06 smithi084 ceph-mon[91810]: osdmap e347: 8 total, 8 up, 8 in 2024-03-30T12:27:07.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:07.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:07.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:06 smithi084 ceph-mon[91810]: pgmap v203: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 153 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-03-30T12:27:07.255 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:06.945+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:07.255 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:06.949+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:07.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:06 smithi162 ceph-mon[83709]: osdmap e347: 8 total, 8 up, 8 in 2024-03-30T12:27:07.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:07.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:07.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:06 smithi162 ceph-mon[83709]: pgmap v203: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 153 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-03-30T12:27:07.934 INFO:tasks.rados.rados.0.smithi084.stdout:1360: done (2 left) 2024-03-30T12:27:07.934 INFO:tasks.rados.rados.0.smithi084.stdout:1361: done (1 left) 2024-03-30T12:27:07.934 INFO:tasks.rados.rados.0.smithi084.stdout:1362: done (0 left) 2024-03-30T12:27:07.934 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 138 2024-03-30T12:27:07.934 INFO:tasks.rados.rados.0.smithi084.stdout:1363: seq_num 429 ranges {0=794624,794624=770048,1564672=622592,2187264=212992} 2024-03-30T12:27:07.938 INFO:tasks.rados.rados.0.smithi084.stdout:1363: writing smithi08477944-47 from 0 to 794624 tid 1 2024-03-30T12:27:07.943 INFO:tasks.rados.rados.0.smithi084.stdout:1363: writing smithi08477944-47 from 794624 to 1564672 tid 2 2024-03-30T12:27:07.947 INFO:tasks.rados.rados.0.smithi084.stdout:1363: writing smithi08477944-47 from 1564672 to 2187264 tid 3 2024-03-30T12:27:07.949 INFO:tasks.rados.rados.0.smithi084.stdout:1363: writing smithi08477944-47 from 2187264 to 2400256 tid 4 2024-03-30T12:27:07.949 INFO:tasks.rados.rados.0.smithi084.stdout:1364: read oid 37 snap -1 2024-03-30T12:27:07.949 INFO:tasks.rados.rados.0.smithi084.stdout:1364: expect (ObjNum 379 snap 120 seq_num 379) 2024-03-30T12:27:07.949 INFO:tasks.rados.rados.0.smithi084.stdout:1365: snap_create 2024-03-30T12:27:07.949 INFO:tasks.rados.rados.0.smithi084.stdout:1363: finishing write tid 1 to smithi08477944-47 2024-03-30T12:27:07.950 INFO:tasks.rados.rados.0.smithi084.stdout:1363: finishing write tid 2 to smithi08477944-47 2024-03-30T12:27:07.952 INFO:tasks.rados.rados.0.smithi084.stdout:1363: finishing write tid 3 to smithi08477944-47 2024-03-30T12:27:07.952 INFO:tasks.rados.rados.0.smithi084.stdout:1363: finishing write tid 4 to smithi08477944-47 2024-03-30T12:27:07.953 INFO:tasks.rados.rados.0.smithi084.stdout:1363: finishing write tid 5 to smithi08477944-47 2024-03-30T12:27:07.954 INFO:tasks.rados.rados.0.smithi084.stdout:1363: finishing write tid 6 to smithi08477944-47 2024-03-30T12:27:07.955 INFO:tasks.rados.rados.0.smithi084.stdout:1363: oid 47 updating version 0 to 860 2024-03-30T12:27:07.955 INFO:tasks.rados.rados.0.smithi084.stdout:1363: oid 47 version 860 is already newer than 858 2024-03-30T12:27:07.955 INFO:tasks.rados.rados.0.smithi084.stdout:1363: oid 47 version 860 is already newer than 859 2024-03-30T12:27:07.955 INFO:tasks.rados.rados.0.smithi084.stdout:1363: oid 47 version 860 is already newer than 857 2024-03-30T12:27:07.955 INFO:tasks.rados.rados.0.smithi084.stdout:1363: oid 47 version 860 is already newer than 856 2024-03-30T12:27:07.955 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 860 (ObjNum 429 snap 138 seq_num 429) dirty exists 2024-03-30T12:27:07.955 INFO:tasks.rados.rados.0.smithi084.stdout:1363: left oid 47 (ObjNum 429 snap 138 seq_num 429) 2024-03-30T12:27:07.970 INFO:tasks.rados.rados.0.smithi084.stdout:1364: expect (ObjNum 379 snap 120 seq_num 379) 2024-03-30T12:27:08.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:07 smithi084 ceph-mon[91810]: osdmap e348: 8 total, 8 up, 8 in 2024-03-30T12:27:08.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:08.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:08.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:07 smithi084 ceph-mon[89279]: osdmap e348: 8 total, 8 up, 8 in 2024-03-30T12:27:08.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:08.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:08.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:07.952+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:08.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:07.952+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:08.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:07 smithi162 ceph-mon[83709]: osdmap e348: 8 total, 8 up, 8 in 2024-03-30T12:27:08.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:08.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:08.945 INFO:tasks.rados.rados.0.smithi084.stdout:1363: done (2 left) 2024-03-30T12:27:08.945 INFO:tasks.rados.rados.0.smithi084.stdout:1364: done (1 left) 2024-03-30T12:27:08.945 INFO:tasks.rados.rados.0.smithi084.stdout:1365: done (0 left) 2024-03-30T12:27:08.945 INFO:tasks.rados.rados.0.smithi084.stdout:1366: snap_create 2024-03-30T12:27:09.190 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:09.127+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:09.190 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:09.127+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:09.191 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:08 smithi084 ceph-mon[89279]: osdmap e349: 8 total, 8 up, 8 in 2024-03-30T12:27:09.191 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:09.191 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:08 smithi084 ceph-mon[89279]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:09.191 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:08 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-30T12:27:09.191 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:08 smithi084 ceph-mon[89279]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-30T12:27:09.191 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:08 smithi084 ceph-mon[89279]: Upgrade: osd.2 is safe to restart 2024-03-30T12:27:09.191 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:08 smithi084 ceph-mon[89279]: pgmap v206: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 153 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-03-30T12:27:09.191 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:08 smithi084 ceph-mon[91810]: osdmap e349: 8 total, 8 up, 8 in 2024-03-30T12:27:09.191 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:09.191 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:08 smithi084 ceph-mon[91810]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:09.191 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:08 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-30T12:27:09.191 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:08 smithi084 ceph-mon[91810]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-30T12:27:09.192 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:08 smithi084 ceph-mon[91810]: Upgrade: osd.2 is safe to restart 2024-03-30T12:27:09.192 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:08 smithi084 ceph-mon[91810]: pgmap v206: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 153 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-03-30T12:27:09.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:08 smithi162 ceph-mon[83709]: osdmap e349: 8 total, 8 up, 8 in 2024-03-30T12:27:09.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:09.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:08 smithi162 ceph-mon[83709]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:09.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:08 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-30T12:27:09.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:08 smithi162 ceph-mon[83709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-30T12:27:09.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:08 smithi162 ceph-mon[83709]: Upgrade: osd.2 is safe to restart 2024-03-30T12:27:09.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:08 smithi162 ceph-mon[83709]: pgmap v206: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 153 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-03-30T12:27:09.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:27:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:27:09] "GET /metrics HTTP/1.1" 200 36275 "" "Prometheus/2.43.0" 2024-03-30T12:27:09.947 INFO:tasks.rados.rados.0.smithi084.stdout:1366: done (0 left) 2024-03-30T12:27:09.947 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 27 current snap is 140 2024-03-30T12:27:09.948 INFO:tasks.rados.rados.0.smithi084.stdout:1367: seq_num 430 ranges {0=8192} 2024-03-30T12:27:09.948 INFO:tasks.rados.rados.0.smithi084.stdout:1367: writing smithi08477944-27 from 0 to 8192 tid 1 2024-03-30T12:27:09.948 INFO:tasks.rados.rados.0.smithi084.stdout:1368: setattr oid 26 current snap is 140 2024-03-30T12:27:09.948 INFO:tasks.rados.rados.0.smithi084.stdout:1369: read oid 1 snap -1 2024-03-30T12:27:09.948 INFO:tasks.rados.rados.0.smithi084.stdout:1369: expect deleted 2024-03-30T12:27:09.948 INFO:tasks.rados.rados.0.smithi084.stdout:1370: rollback oid 7 current snap is 140 2024-03-30T12:27:09.948 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 7 to 138 2024-03-30T12:27:09.948 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 140 2024-03-30T12:27:09.948 INFO:tasks.rados.rados.0.smithi084.stdout:1371: seq_num 431 ranges {5472256=24576} 2024-03-30T12:27:09.978 INFO:tasks.rados.rados.0.smithi084.stdout:1371: writing smithi08477944-22 from 5472256 to 5496832 tid 1 2024-03-30T12:27:09.978 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 140 2024-03-30T12:27:09.978 INFO:tasks.rados.rados.0.smithi084.stdout:1370: finishing rollback tid 0 to smithi08477944-7 2024-03-30T12:27:09.978 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 785 (ObjNum 33 snap 0 seq_num 1429702960) dirty exists 2024-03-30T12:27:09.978 INFO:tasks.rados.rados.0.smithi084.stdout:1370: finishing rollback tid 1 to smithi08477944-7 2024-03-30T12:27:09.978 INFO:tasks.rados.rados.0.smithi084.stdout:1372: seq_num 432 ranges {9822208=40960} 2024-03-30T12:27:10.032 INFO:tasks.rados.rados.0.smithi084.stdout:1372: writing smithi08477944-17 from 9822208 to 9863168 tid 1 2024-03-30T12:27:10.032 INFO:tasks.rados.rados.0.smithi084.stdout:1368: done (5 left) 2024-03-30T12:27:10.032 INFO:tasks.rados.rados.0.smithi084.stdout:1369: done (4 left) 2024-03-30T12:27:10.032 INFO:tasks.rados.rados.0.smithi084.stdout:1373: delete oid 47 current snap is 140 2024-03-30T12:27:10.032 INFO:tasks.rados.rados.0.smithi084.stdout:1370: finishing rollback tid 2 to smithi08477944-7 2024-03-30T12:27:10.032 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 864 (ObjNum 211 snap 62 seq_num 211) dirty exists 2024-03-30T12:27:10.032 INFO:tasks.rados.rados.0.smithi084.stdout:1367: finishing write tid 1 to smithi08477944-27 2024-03-30T12:27:10.032 INFO:tasks.rados.rados.0.smithi084.stdout:1367: finishing write tid 2 to smithi08477944-27 2024-03-30T12:27:10.032 INFO:tasks.rados.rados.0.smithi084.stdout:1367: finishing write tid 3 to smithi08477944-27 2024-03-30T12:27:10.032 INFO:tasks.rados.rados.0.smithi084.stdout:1367: oid 27 updating version 0 to 494 2024-03-30T12:27:10.032 INFO:tasks.rados.rados.0.smithi084.stdout:1367: oid 27 version 494 is already newer than 493 2024-03-30T12:27:10.032 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 494 (ObjNum 430 snap 140 seq_num 430) dirty exists 2024-03-30T12:27:10.032 INFO:tasks.rados.rados.0.smithi084.stdout:1367: left oid 27 (ObjNum 430 snap 140 seq_num 430) 2024-03-30T12:27:10.033 INFO:tasks.rados.rados.0.smithi084.stdout:1371: finishing write tid 1 to smithi08477944-22 2024-03-30T12:27:10.033 INFO:tasks.rados.rados.0.smithi084.stdout:1371: finishing write tid 2 to smithi08477944-22 2024-03-30T12:27:10.033 INFO:tasks.rados.rados.0.smithi084.stdout:1371: finishing write tid 3 to smithi08477944-22 2024-03-30T12:27:10.033 INFO:tasks.rados.rados.0.smithi084.stdout:1371: oid 22 updating version 0 to 786 2024-03-30T12:27:10.033 INFO:tasks.rados.rados.0.smithi084.stdout:1371: oid 22 updating version 786 to 787 2024-03-30T12:27:10.033 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 787 (ObjNum 431 snap 140 seq_num 431) dirty exists 2024-03-30T12:27:10.033 INFO:tasks.rados.rados.0.smithi084.stdout:1371: left oid 22 (ObjNum 431 snap 140 seq_num 431) 2024-03-30T12:27:10.035 INFO:tasks.rados.rados.0.smithi084.stdout:1367: done (4 left) 2024-03-30T12:27:10.035 INFO:tasks.rados.rados.0.smithi084.stdout:1370: done (3 left) 2024-03-30T12:27:10.035 INFO:tasks.rados.rados.0.smithi084.stdout:1371: done (2 left) 2024-03-30T12:27:10.035 INFO:tasks.rados.rados.0.smithi084.stdout:1373: done (1 left) 2024-03-30T12:27:10.035 INFO:tasks.rados.rados.0.smithi084.stdout:1374: delete oid 15 current snap is 140 2024-03-30T12:27:10.036 INFO:tasks.rados.rados.0.smithi084.stdout:1372: finishing write tid 1 to smithi08477944-17 2024-03-30T12:27:10.036 INFO:tasks.rados.rados.0.smithi084.stdout:1372: finishing write tid 2 to smithi08477944-17 2024-03-30T12:27:10.037 INFO:tasks.rados.rados.0.smithi084.stdout:1374: done (1 left) 2024-03-30T12:27:10.037 INFO:tasks.rados.rados.0.smithi084.stdout:1375: copy_from oid 9 from oid 19 current snap is 140 2024-03-30T12:27:10.037 INFO:tasks.rados.rados.0.smithi084.stdout:1376: read oid 29 snap 137 2024-03-30T12:27:10.037 INFO:tasks.rados.rados.0.smithi084.stdout:1376: expect deleted 2024-03-30T12:27:10.037 INFO:tasks.rados.rados.0.smithi084.stdout:1377: snap_remove snap 132 2024-03-30T12:27:10.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:09 smithi084 ceph-mon[91810]: osdmap e350: 8 total, 8 up, 8 in 2024-03-30T12:27:10.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:10.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:10.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:09 smithi084 ceph-mon[89279]: osdmap e350: 8 total, 8 up, 8 in 2024-03-30T12:27:10.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:10.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:10.255 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:09.966+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:10.255 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:09.967+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:10.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:09 smithi162 ceph-mon[83709]: osdmap e350: 8 total, 8 up, 8 in 2024-03-30T12:27:10.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:10.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:10.959 INFO:tasks.rados.rados.0.smithi084.stdout:1377: done (3 left) 2024-03-30T12:27:10.960 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 28 current snap is 140 2024-03-30T12:27:10.960 INFO:tasks.rados.rados.0.smithi084.stdout:1378: seq_num 435 ranges {2613248=90112} 2024-03-30T12:27:10.974 INFO:tasks.rados.rados.0.smithi084.stdout:1378: writing smithi08477944-28 from 2613248 to 2703360 tid 1 2024-03-30T12:27:10.975 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 140 2024-03-30T12:27:10.975 INFO:tasks.rados.rados.0.smithi084.stdout:1379: seq_num 436 ranges {2220032=106496} 2024-03-30T12:27:10.986 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:10.972+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:10.986 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:10.975+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset ca=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:10.987 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:10 smithi084 ceph-mon[91810]: osdmap e351: 8 total, 8 up, 8 in 2024-03-30T12:27:10.987 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:10.987 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:10.987 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:10 smithi084 ceph-mon[91810]: Upgrade: Updating osd.2 2024-03-30T12:27:10.987 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:10 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:10.987 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:10 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-30T12:27:10.987 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:10 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:27:10.987 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:10 smithi084 ceph-mon[91810]: Deploying daemon osd.2 on smithi084 2024-03-30T12:27:10.987 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:10 smithi084 ceph-mon[91810]: pgmap v209: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 160 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 4.7 MiB/s rd, 1.9 MiB/s wr, 19 op/s 2024-03-30T12:27:10.988 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:10 smithi084 ceph-mon[89279]: osdmap e351: 8 total, 8 up, 8 in 2024-03-30T12:27:10.988 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:10.988 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:10.988 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:10 smithi084 ceph-mon[89279]: Upgrade: Updating osd.2 2024-03-30T12:27:10.988 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:10 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:10.988 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:10 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-30T12:27:10.988 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:10 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:27:10.988 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:10 smithi084 ceph-mon[89279]: Deploying daemon osd.2 on smithi084 2024-03-30T12:27:10.988 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:10 smithi084 ceph-mon[89279]: pgmap v209: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 160 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 4.7 MiB/s rd, 1.9 MiB/s wr, 19 op/s 2024-03-30T12:27:10.990 INFO:tasks.rados.rados.0.smithi084.stdout:1379: writing smithi08477944-18 from 2220032 to 2326528 tid 1 2024-03-30T12:27:10.990 INFO:tasks.rados.rados.0.smithi084.stdout:1380: read oid 15 snap -1 2024-03-30T12:27:10.990 INFO:tasks.rados.rados.0.smithi084.stdout:1380: expect deleted 2024-03-30T12:27:10.990 INFO:tasks.rados.rados.0.smithi084.stdout:1372: finishing write tid 3 to smithi08477944-17 2024-03-30T12:27:10.990 INFO:tasks.rados.rados.0.smithi084.stdout:1372: oid 17 updating version 0 to 655 2024-03-30T12:27:10.991 INFO:tasks.rados.rados.0.smithi084.stdout:1372: oid 17 updating version 655 to 656 2024-03-30T12:27:10.991 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 656 (ObjNum 432 snap 140 seq_num 432) dirty exists 2024-03-30T12:27:10.991 INFO:tasks.rados.rados.0.smithi084.stdout:1372: left oid 17 (ObjNum 432 snap 140 seq_num 432) 2024-03-30T12:27:10.991 INFO:tasks.rados.rados.0.smithi084.stdout:1375: finishing copy_from racing read to smithi08477944-9 2024-03-30T12:27:10.991 INFO:tasks.rados.rados.0.smithi084.stdout:1375: finishing copy_from to smithi08477944-9 2024-03-30T12:27:10.991 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 556 (ObjNum 33 snap 0 seq_num 1428919888) dirty exists 2024-03-30T12:27:10.991 INFO:tasks.rados.rados.0.smithi084.stdout:1378: finishing write tid 1 to smithi08477944-28 2024-03-30T12:27:10.991 INFO:tasks.rados.rados.0.smithi084.stdout:1378: finishing write tid 2 to smithi08477944-28 2024-03-30T12:27:10.991 INFO:tasks.rados.rados.0.smithi084.stdout:1378: finishing write tid 3 to smithi08477944-28 2024-03-30T12:27:10.992 INFO:tasks.rados.rados.0.smithi084.stdout:1378: oid 28 updating version 0 to 658 2024-03-30T12:27:10.992 INFO:tasks.rados.rados.0.smithi084.stdout:1378: oid 28 updating version 658 to 659 2024-03-30T12:27:10.992 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 659 (ObjNum 435 snap 140 seq_num 435) dirty exists 2024-03-30T12:27:10.992 INFO:tasks.rados.rados.0.smithi084.stdout:1378: left oid 28 (ObjNum 435 snap 140 seq_num 435) 2024-03-30T12:27:10.992 INFO:tasks.rados.rados.0.smithi084.stdout:1372: done (5 left) 2024-03-30T12:27:10.992 INFO:tasks.rados.rados.0.smithi084.stdout:1375: done (4 left) 2024-03-30T12:27:10.992 INFO:tasks.rados.rados.0.smithi084.stdout:1376: done (3 left) 2024-03-30T12:27:10.992 INFO:tasks.rados.rados.0.smithi084.stdout:1378: done (2 left) 2024-03-30T12:27:10.992 INFO:tasks.rados.rados.0.smithi084.stdout:1381: delete oid 47 current snap is 140 2024-03-30T12:27:10.993 INFO:tasks.rados.rados.0.smithi084.stdout:1380: done (2 left) 2024-03-30T12:27:10.993 INFO:tasks.rados.rados.0.smithi084.stdout:1381: done (1 left) 2024-03-30T12:27:10.993 INFO:tasks.rados.rados.0.smithi084.stdout:1382: rmattr oid 38 current snap is 140 2024-03-30T12:27:10.993 INFO:tasks.rados.rados.0.smithi084.stdout:1382: done (1 left) 2024-03-30T12:27:10.994 INFO:tasks.rados.rados.0.smithi084.stdout:1383: snap_create 2024-03-30T12:27:10.994 INFO:tasks.rados.rados.0.smithi084.stdout:1379: finishing write tid 1 to smithi08477944-18 2024-03-30T12:27:10.994 INFO:tasks.rados.rados.0.smithi084.stdout:1379: finishing write tid 2 to smithi08477944-18 2024-03-30T12:27:10.994 INFO:tasks.rados.rados.0.smithi084.stdout:1379: finishing write tid 3 to smithi08477944-18 2024-03-30T12:27:10.994 INFO:tasks.rados.rados.0.smithi084.stdout:1379: oid 18 updating version 0 to 865 2024-03-30T12:27:10.994 INFO:tasks.rados.rados.0.smithi084.stdout:1379: oid 18 updating version 865 to 866 2024-03-30T12:27:10.994 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 866 (ObjNum 436 snap 140 seq_num 436) dirty exists 2024-03-30T12:27:10.994 INFO:tasks.rados.rados.0.smithi084.stdout:1379: left oid 18 (ObjNum 436 snap 140 seq_num 436) 2024-03-30T12:27:11.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:10 smithi162 ceph-mon[83709]: osdmap e351: 8 total, 8 up, 8 in 2024-03-30T12:27:11.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:11.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset c5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:11.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:10 smithi162 ceph-mon[83709]: Upgrade: Updating osd.2 2024-03-30T12:27:11.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:10 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:11.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:10 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-30T12:27:11.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:10 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:27:11.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:10 smithi162 ceph-mon[83709]: Deploying daemon osd.2 on smithi084 2024-03-30T12:27:11.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:10 smithi162 ceph-mon[83709]: pgmap v209: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 160 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 4.7 MiB/s rd, 1.9 MiB/s wr, 19 op/s 2024-03-30T12:27:11.963 INFO:tasks.rados.rados.0.smithi084.stdout:1379: done (1 left) 2024-03-30T12:27:11.963 INFO:tasks.rados.rados.0.smithi084.stdout:1383: done (0 left) 2024-03-30T12:27:11.963 INFO:tasks.rados.rados.0.smithi084.stdout:1384: snap_remove snap 139 2024-03-30T12:27:12.120 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:11 smithi084 ceph-mon[91810]: osdmap e352: 8 total, 8 up, 8 in 2024-03-30T12:27:12.120 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:12.120 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset ca=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:12.120 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:11 smithi084 ceph-mon[89279]: osdmap e352: 8 total, 8 up, 8 in 2024-03-30T12:27:12.120 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:12.121 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset ca=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:12.271 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:11 smithi162 ceph-mon[83709]: osdmap e352: 8 total, 8 up, 8 in 2024-03-30T12:27:12.271 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:12.271 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset ca=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:12.970 INFO:tasks.rados.rados.0.smithi084.stdout:1384: done (0 left) 2024-03-30T12:27:12.970 INFO:tasks.rados.rados.0.smithi084.stdout:1385: delete oid 49 current snap is 141 2024-03-30T12:27:12.976 INFO:tasks.rados.rados.0.smithi084.stdout:1385: done (0 left) 2024-03-30T12:27:12.976 INFO:tasks.rados.rados.0.smithi084.stdout:1386: delete oid 40 current snap is 141 2024-03-30T12:27:12.982 INFO:tasks.rados.rados.0.smithi084.stdout:1386: done (0 left) 2024-03-30T12:27:12.982 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 141 2024-03-30T12:27:12.982 INFO:tasks.rados.rados.0.smithi084.stdout:1387: seq_num 440 ranges {0=172032} 2024-03-30T12:27:12.983 INFO:tasks.rados.rados.0.smithi084.stdout:1387: writing smithi08477944-15 from 0 to 172032 tid 1 2024-03-30T12:27:12.983 INFO:tasks.rados.rados.0.smithi084.stdout:1388: delete oid 41 current snap is 141 2024-03-30T12:27:12.987 INFO:tasks.rados.rados.0.smithi084.stdout:1387: finishing write tid 1 to smithi08477944-15 2024-03-30T12:27:12.987 INFO:tasks.rados.rados.0.smithi084.stdout:1387: finishing write tid 2 to smithi08477944-15 2024-03-30T12:27:12.989 INFO:tasks.rados.rados.0.smithi084.stdout:1388: done (1 left) 2024-03-30T12:27:12.989 INFO:tasks.rados.rados.0.smithi084.stdout:1389: read oid 43 snap -1 2024-03-30T12:27:12.989 INFO:tasks.rados.rados.0.smithi084.stdout:1389: expect (ObjNum 280 snap 90 seq_num 280) 2024-03-30T12:27:12.989 INFO:tasks.rados.rados.0.smithi084.stdout:1390: read oid 50 snap -1 2024-03-30T12:27:12.989 INFO:tasks.rados.rados.0.smithi084.stdout:1390: expect (ObjNum 419 snap 132 seq_num 419) 2024-03-30T12:27:12.989 INFO:tasks.rados.rados.0.smithi084.stdout:1391: delete oid 28 current snap is 141 2024-03-30T12:27:12.989 INFO:tasks.rados.rados.0.smithi084.stdout:1387: finishing write tid 3 to smithi08477944-15 2024-03-30T12:27:12.989 INFO:tasks.rados.rados.0.smithi084.stdout:1387: oid 15 updating version 0 to 658 2024-03-30T12:27:12.989 INFO:tasks.rados.rados.0.smithi084.stdout:1387: oid 15 updating version 658 to 659 2024-03-30T12:27:12.990 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 659 (ObjNum 440 snap 141 seq_num 440) dirty exists 2024-03-30T12:27:12.990 INFO:tasks.rados.rados.0.smithi084.stdout:1387: left oid 15 (ObjNum 440 snap 141 seq_num 440) 2024-03-30T12:27:12.991 INFO:tasks.rados.rados.0.smithi084.stdout:1387: done (3 left) 2024-03-30T12:27:12.991 INFO:tasks.rados.rados.0.smithi084.stdout:1391: done (2 left) 2024-03-30T12:27:12.991 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 141 2024-03-30T12:27:12.991 INFO:tasks.rados.rados.0.smithi084.stdout:1392: seq_num 443 ranges {2048000=221184} 2024-03-30T12:27:13.005 INFO:tasks.rados.rados.0.smithi084.stdout:1392: writing smithi08477944-7 from 2048000 to 2269184 tid 1 2024-03-30T12:27:13.006 INFO:tasks.rados.rados.0.smithi084.stdout:1393: snap_remove snap 137 2024-03-30T12:27:13.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:12 smithi084 ceph-mon[89279]: osdmap e353: 8 total, 8 up, 8 in 2024-03-30T12:27:13.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:12 smithi084 ceph-mon[89279]: pgmap v212: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 160 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 6.4 MiB/s rd, 1.9 MiB/s wr, 22 op/s 2024-03-30T12:27:13.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:12 smithi084 ceph-mon[91810]: osdmap e353: 8 total, 8 up, 8 in 2024-03-30T12:27:13.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:12 smithi084 ceph-mon[91810]: pgmap v212: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 160 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 6.4 MiB/s rd, 1.9 MiB/s wr, 22 op/s 2024-03-30T12:27:13.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:12.983+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset ca=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:13.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:12.984+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:13.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:12 smithi162 ceph-mon[83709]: osdmap e353: 8 total, 8 up, 8 in 2024-03-30T12:27:13.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:12 smithi162 ceph-mon[83709]: pgmap v212: 121 pgs: 2 active+clean+snaptrim_error, 119 active+clean; 160 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 6.4 MiB/s rd, 1.9 MiB/s wr, 22 op/s 2024-03-30T12:27:13.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:13 smithi084 systemd[1]: Stopping Ceph osd.2 for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:27:13.989 INFO:tasks.rados.rados.0.smithi084.stdout:1390: expect (ObjNum 419 snap 132 seq_num 419) 2024-03-30T12:27:14.051 INFO:tasks.rados.rados.0.smithi084.stdout:1392: finishing write tid 1 to smithi08477944-7 2024-03-30T12:27:14.052 INFO:tasks.rados.rados.0.smithi084.stdout:1390: done (3 left) 2024-03-30T12:27:14.052 INFO:tasks.rados.rados.0.smithi084.stdout:1393: done (2 left) 2024-03-30T12:27:14.052 INFO:tasks.rados.rados.0.smithi084.stdout:1394: read oid 5 snap -1 2024-03-30T12:27:14.052 INFO:tasks.rados.rados.0.smithi084.stdout:1394: expect (ObjNum 383 snap 121 seq_num 383) 2024-03-30T12:27:14.052 INFO:tasks.rados.rados.0.smithi084.stdout:1395: delete oid 11 current snap is 141 2024-03-30T12:27:14.052 INFO:tasks.rados.rados.0.smithi084.stdout:1392: finishing write tid 2 to smithi08477944-7 2024-03-30T12:27:14.052 INFO:tasks.rados.rados.0.smithi084.stdout:1392: finishing write tid 3 to smithi08477944-7 2024-03-30T12:27:14.052 INFO:tasks.rados.rados.0.smithi084.stdout:1392: oid 7 updating version 0 to 881 2024-03-30T12:27:14.052 INFO:tasks.rados.rados.0.smithi084.stdout:1392: oid 7 version 881 is already newer than 880 2024-03-30T12:27:14.052 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 881 (ObjNum 443 snap 141 seq_num 443) dirty exists 2024-03-30T12:27:14.052 INFO:tasks.rados.rados.0.smithi084.stdout:1392: left oid 7 (ObjNum 443 snap 141 seq_num 443) 2024-03-30T12:27:14.052 INFO:tasks.rados.rados.0.smithi084.stdout:1389: expect (ObjNum 280 snap 90 seq_num 280) 2024-03-30T12:27:14.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:13.985+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset ca=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:14.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:13.989+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:14.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:13 smithi084 ceph-mon[89279]: osdmap e354: 8 total, 8 up, 8 in 2024-03-30T12:27:14.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset ca=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:14.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:14.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:13 smithi084 ceph-mon[89279]: osd.2 marked itself down and dead 2024-03-30T12:27:14.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[53674]: 2024-03-30T12:27:13.868+0000 7fb1f91b6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:27:14.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[53674]: 2024-03-30T12:27:13.868+0000 7fb1f91b6700 -1 osd.2 354 *** Got signal Terminated *** 2024-03-30T12:27:14.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[53674]: 2024-03-30T12:27:13.868+0000 7fb1f91b6700 -1 osd.2 354 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T12:27:14.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:13 smithi084 ceph-mon[91810]: osdmap e354: 8 total, 8 up, 8 in 2024-03-30T12:27:14.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset ca=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:14.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:14.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:13 smithi084 ceph-mon[91810]: osd.2 marked itself down and dead 2024-03-30T12:27:14.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:13 smithi162 ceph-mon[83709]: osdmap e354: 8 total, 8 up, 8 in 2024-03-30T12:27:14.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset ca=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:14.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:14.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:13 smithi162 ceph-mon[83709]: osd.2 marked itself down and dead 2024-03-30T12:27:14.805 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:14 smithi084 podman[106508]: 2024-03-30 12:27:14.550547961 +0000 UTC m=+0.808440623 container died eb2412618811050be88e33eb9d1fbdcb9fa62ed24bde730b489cd3d9a70c8d9d (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2, org.label-schema.license=GPLv2, RELEASE=reef-f14b568, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-03-30T12:27:15.013 INFO:tasks.rados.rados.0.smithi084.stdout:1394: expect (ObjNum 383 snap 121 seq_num 383) 2024-03-30T12:27:15.122 INFO:tasks.rados.rados.0.smithi084.stdout:1389: done (3 left) 2024-03-30T12:27:15.122 INFO:tasks.rados.rados.0.smithi084.stdout:1392: done (2 left) 2024-03-30T12:27:15.122 INFO:tasks.rados.rados.0.smithi084.stdout:1394: done (1 left) 2024-03-30T12:27:15.122 INFO:tasks.rados.rados.0.smithi084.stdout:1395: done (0 left) 2024-03-30T12:27:15.122 INFO:tasks.rados.rados.0.smithi084.stdout:1396: read oid 39 snap 136 2024-03-30T12:27:15.122 INFO:tasks.rados.rados.0.smithi084.stdout:1396: expect deleted 2024-03-30T12:27:15.122 INFO:tasks.rados.rados.0.smithi084.stdout:1397: read oid 27 snap 138 2024-03-30T12:27:15.122 INFO:tasks.rados.rados.0.smithi084.stdout:1397: expect deleted 2024-03-30T12:27:15.122 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 141 2024-03-30T12:27:15.122 INFO:tasks.rados.rados.0.smithi084.stdout:1398: seq_num 445 ranges {3112960=253952} 2024-03-30T12:27:15.139 INFO:tasks.rados.rados.0.smithi084.stdout:1398: writing smithi08477944-5 from 3112960 to 3366912 tid 1 2024-03-30T12:27:15.139 INFO:tasks.rados.rados.0.smithi084.stdout:1399: rollback oid 38 current snap is 141 2024-03-30T12:27:15.139 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 38 to 140 2024-03-30T12:27:15.139 INFO:tasks.rados.rados.0.smithi084.stdout:1396: done (3 left) 2024-03-30T12:27:15.139 INFO:tasks.rados.rados.0.smithi084.stdout:1397: done (2 left) 2024-03-30T12:27:15.140 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 141 2024-03-30T12:27:15.140 INFO:tasks.rados.rados.0.smithi084.stdout:1400: seq_num 446 ranges {0=278528} 2024-03-30T12:27:15.140 INFO:tasks.rados.rados.0.smithi084.stdout:1400: writing smithi08477944-14 from 0 to 278528 tid 1 2024-03-30T12:27:15.141 INFO:tasks.rados.rados.0.smithi084.stdout:1401: setattr oid 17 current snap is 141 2024-03-30T12:27:15.143 INFO:tasks.rados.rados.0.smithi084.stdout:1402: copy_from oid 40 from oid 24 current snap is 141 2024-03-30T12:27:15.143 INFO:tasks.rados.rados.0.smithi084.stdout:1403: read oid 33 snap -1 2024-03-30T12:27:15.143 INFO:tasks.rados.rados.0.smithi084.stdout:1403: expect (ObjNum 406 snap 128 seq_num 406) 2024-03-30T12:27:15.143 INFO:tasks.rados.rados.0.smithi084.stdout:1404: rollback oid 7 current snap is 141 2024-03-30T12:27:15.143 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 7 to 140 2024-03-30T12:27:15.143 INFO:tasks.rados.rados.0.smithi084.stdout:1405: read oid 25 snap -1 2024-03-30T12:27:15.143 INFO:tasks.rados.rados.0.smithi084.stdout:1405: expect (ObjNum 394 snap 125 seq_num 394) 2024-03-30T12:27:15.143 INFO:tasks.rados.rados.0.smithi084.stdout:1406: snap_remove snap 136 2024-03-30T12:27:15.196 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:14.999+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:15.196 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:15.002+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset ca=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:15.197 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:14 smithi084 podman[106508]: 2024-03-30 12:27:14.94376027 +0000 UTC m=+1.201652969 container cleanup eb2412618811050be88e33eb9d1fbdcb9fa62ed24bde730b489cd3d9a70c8d9d (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=reef-f14b568) 2024-03-30T12:27:15.198 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:14 smithi084 bash[106508]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2 2024-03-30T12:27:15.198 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:14 smithi084 ceph-mon[91810]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T12:27:15.198 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:14 smithi084 ceph-mon[91810]: osdmap e355: 8 total, 7 up, 8 in 2024-03-30T12:27:15.198 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset ca=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:15.198 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:15.198 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:14 smithi084 ceph-mon[91810]: pgmap v215: 121 pgs: 12 stale+active+clean, 2 active+clean+snaptrim_error, 107 active+clean; 160 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 1.7 MiB/s rd, 10 KiB/s wr, 2 op/s 2024-03-30T12:27:15.198 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:14 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:15.198 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:14 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:27:15.199 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:14 smithi084 ceph-mon[89279]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T12:27:15.199 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:14 smithi084 ceph-mon[89279]: osdmap e355: 8 total, 7 up, 8 in 2024-03-30T12:27:15.199 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset ca=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:15.199 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:15.199 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:14 smithi084 ceph-mon[89279]: pgmap v215: 121 pgs: 12 stale+active+clean, 2 active+clean+snaptrim_error, 107 active+clean; 160 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 1.7 MiB/s rd, 10 KiB/s wr, 2 op/s 2024-03-30T12:27:15.199 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:14 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:15.199 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:14 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:27:15.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:14 smithi162 ceph-mon[83709]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T12:27:15.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:14 smithi162 ceph-mon[83709]: osdmap e355: 8 total, 7 up, 8 in 2024-03-30T12:27:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset ca=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:14 smithi162 ceph-mon[83709]: pgmap v215: 121 pgs: 12 stale+active+clean, 2 active+clean+snaptrim_error, 107 active+clean; 160 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 1.7 MiB/s rd, 10 KiB/s wr, 2 op/s 2024-03-30T12:27:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:14 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:14 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:27:15.499 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:15 smithi084 podman[106536]: 2024-03-30 12:27:15.203882022 +0000 UTC m=+0.651660542 container remove eb2412618811050be88e33eb9d1fbdcb9fa62ed24bde730b489cd3d9a70c8d9d (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, RELEASE=reef-f14b568, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-03-30T12:27:15.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:15 smithi084 podman[106625]: 2024-03-30 12:27:15.411444816 +0000 UTC m=+0.017788558 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:27:15.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:15 smithi084 podman[106625]: 2024-03-30 12:27:15.529720747 +0000 UTC m=+0.136064473 container create 6f54457eb59d3aa8757ae6c5d22f82db67b016b60e02f15873e30f1fce202c36 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-03-30T12:27:15.988 INFO:tasks.rados.rados.0.smithi084.stdout:1406: done (8 left) 2024-03-30T12:27:15.989 INFO:tasks.rados.rados.0.smithi084.stdout:1407: delete oid 27 current snap is 141 2024-03-30T12:27:15.989 INFO:tasks.rados.rados.0.smithi084.stdout:1398: finishing write tid 1 to smithi08477944-5 2024-03-30T12:27:15.989 INFO:tasks.rados.rados.0.smithi084.stdout:1399: finishing rollback tid 0 to smithi08477944-38 2024-03-30T12:27:15.989 INFO:tasks.rados.rados.0.smithi084.stdout:1399: finishing rollback tid 1 to smithi08477944-38 2024-03-30T12:27:15.989 INFO:tasks.rados.rados.0.smithi084.stdout:1399: finishing rollback tid 2 to smithi08477944-38 2024-03-30T12:27:15.989 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 559 (ObjNum 379 snap 120 seq_num 379) dirty exists 2024-03-30T12:27:15.989 INFO:tasks.rados.rados.0.smithi084.stdout:1398: finishing write tid 2 to smithi08477944-5 2024-03-30T12:27:15.989 INFO:tasks.rados.rados.0.smithi084.stdout:1400: finishing write tid 1 to smithi08477944-14 2024-03-30T12:27:15.989 INFO:tasks.rados.rados.0.smithi084.stdout:1400: finishing write tid 2 to smithi08477944-14 2024-03-30T12:27:15.989 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 660 (ObjNum 432 snap 140 seq_num 432) dirty exists 2024-03-30T12:27:15.989 INFO:tasks.rados.rados.0.smithi084.stdout:1400: finishing write tid 3 to smithi08477944-14 2024-03-30T12:27:15.989 INFO:tasks.rados.rados.0.smithi084.stdout:1400: oid 14 updating version 0 to 773 2024-03-30T12:27:15.990 INFO:tasks.rados.rados.0.smithi084.stdout:1400: oid 14 updating version 773 to 774 2024-03-30T12:27:15.990 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 774 (ObjNum 446 snap 141 seq_num 446) dirty exists 2024-03-30T12:27:15.990 INFO:tasks.rados.rados.0.smithi084.stdout:1400: left oid 14 (ObjNum 446 snap 141 seq_num 446) 2024-03-30T12:27:15.990 INFO:tasks.rados.rados.0.smithi084.stdout:1403: expect (ObjNum 406 snap 128 seq_num 406) 2024-03-30T12:27:16.082 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:15 smithi084 ceph-mon[91810]: osdmap e356: 8 total, 7 up, 8 in 2024-03-30T12:27:16.083 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:16.083 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset ca=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:16.083 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:16.003+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:16.083 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:16.003+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:16.083 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:15 smithi084 podman[106625]: 2024-03-30 12:27:15.790895412 +0000 UTC m=+0.397239139 container init 6f54457eb59d3aa8757ae6c5d22f82db67b016b60e02f15873e30f1fce202c36 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-03-30T12:27:16.083 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:15 smithi084 podman[106625]: 2024-03-30 12:27:15.79418253 +0000 UTC m=+0.400526263 container start 6f54457eb59d3aa8757ae6c5d22f82db67b016b60e02f15873e30f1fce202c36 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T12:27:16.083 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:15 smithi084 podman[106625]: 2024-03-30 12:27:15.873765579 +0000 UTC m=+0.480109322 container attach 6f54457eb59d3aa8757ae6c5d22f82db67b016b60e02f15873e30f1fce202c36 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, ceph=True) 2024-03-30T12:27:16.084 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:15 smithi084 ceph-mon[89279]: osdmap e356: 8 total, 7 up, 8 in 2024-03-30T12:27:16.084 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:16.084 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset ca=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:16.111 INFO:tasks.rados.rados.0.smithi084.stdout:1404: finishing rollback tid 0 to smithi08477944-7 2024-03-30T12:27:16.111 INFO:tasks.rados.rados.0.smithi084.stdout:1404: finishing rollback tid 1 to smithi08477944-7 2024-03-30T12:27:16.111 INFO:tasks.rados.rados.0.smithi084.stdout:1404: finishing rollback tid 2 to smithi08477944-7 2024-03-30T12:27:16.111 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 884 (ObjNum 211 snap 62 seq_num 211) dirty exists 2024-03-30T12:27:16.111 INFO:tasks.rados.rados.0.smithi084.stdout:1399: done (8 left) 2024-03-30T12:27:16.111 INFO:tasks.rados.rados.0.smithi084.stdout:1400: done (7 left) 2024-03-30T12:27:16.111 INFO:tasks.rados.rados.0.smithi084.stdout:1401: done (6 left) 2024-03-30T12:27:16.111 INFO:tasks.rados.rados.0.smithi084.stdout:1403: done (5 left) 2024-03-30T12:27:16.111 INFO:tasks.rados.rados.0.smithi084.stdout:1404: done (4 left) 2024-03-30T12:27:16.111 INFO:tasks.rados.rados.0.smithi084.stdout:1407: done (3 left) 2024-03-30T12:27:16.112 INFO:tasks.rados.rados.0.smithi084.stdout:1408: rollback oid 17 current snap is 141 2024-03-30T12:27:16.112 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 17 to 138 2024-03-30T12:27:16.112 INFO:tasks.rados.rados.0.smithi084.stdout:1398: finishing write tid 3 to smithi08477944-5 2024-03-30T12:27:16.112 INFO:tasks.rados.rados.0.smithi084.stdout:1398: oid 5 updating version 0 to 817 2024-03-30T12:27:16.112 INFO:tasks.rados.rados.0.smithi084.stdout:1398: oid 5 updating version 817 to 818 2024-03-30T12:27:16.112 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 818 (ObjNum 445 snap 141 seq_num 445) dirty exists 2024-03-30T12:27:16.112 INFO:tasks.rados.rados.0.smithi084.stdout:1398: left oid 5 (ObjNum 445 snap 141 seq_num 445) 2024-03-30T12:27:16.112 INFO:tasks.rados.rados.0.smithi084.stdout:1402: finishing copy_from racing read to smithi08477944-40 2024-03-30T12:27:16.112 INFO:tasks.rados.rados.0.smithi084.stdout:1402: finishing copy_from to smithi08477944-40 2024-03-30T12:27:16.112 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 256 (ObjNum 414 snap 131 seq_num 414) dirty exists 2024-03-30T12:27:16.112 INFO:tasks.rados.rados.0.smithi084.stdout:1405: expect (ObjNum 394 snap 125 seq_num 394) 2024-03-30T12:27:16.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:15 smithi162 ceph-mon[83709]: osdmap e356: 8 total, 7 up, 8 in 2024-03-30T12:27:16.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:16.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset ca=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:16.434 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:16 smithi084 podman[106625]: 2024-03-30 12:27:16.092145247 +0000 UTC m=+0.698488980 container died 6f54457eb59d3aa8757ae6c5d22f82db67b016b60e02f15873e30f1fce202c36 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2-deactivate, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-03-30T12:27:16.518 INFO:tasks.rados.rados.0.smithi084.stdout:1408: finishing rollback tid 0 to smithi08477944-17 2024-03-30T12:27:16.518 INFO:tasks.rados.rados.0.smithi084.stdout:1408: finishing rollback tid 1 to smithi08477944-17 2024-03-30T12:27:16.518 INFO:tasks.rados.rados.0.smithi084.stdout:1398: done (3 left) 2024-03-30T12:27:16.518 INFO:tasks.rados.rados.0.smithi084.stdout:1402: done (2 left) 2024-03-30T12:27:16.518 INFO:tasks.rados.rados.0.smithi084.stdout:1405: done (1 left) 2024-03-30T12:27:16.518 INFO:tasks.rados.rados.0.smithi084.stdout:1409: read oid 18 snap -1 2024-03-30T12:27:16.518 INFO:tasks.rados.rados.0.smithi084.stdout:1409: expect (ObjNum 436 snap 140 seq_num 436) 2024-03-30T12:27:16.519 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 141 2024-03-30T12:27:16.519 INFO:tasks.rados.rados.0.smithi084.stdout:1408: finishing rollback tid 2 to smithi08477944-17 2024-03-30T12:27:16.519 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 663 (ObjNum 422 snap 135 seq_num 422) dirty exists 2024-03-30T12:27:16.519 INFO:tasks.rados.rados.0.smithi084.stdout:1410: seq_num 448 ranges {7708672=311296} 2024-03-30T12:27:16.561 INFO:tasks.rados.rados.0.smithi084.stdout:1410: writing smithi08477944-25 from 7708672 to 8019968 tid 1 2024-03-30T12:27:16.561 INFO:tasks.rados.rados.0.smithi084.stdout:1408: done (2 left) 2024-03-30T12:27:16.561 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 141 2024-03-30T12:27:16.561 INFO:tasks.rados.rados.0.smithi084.stdout:1411: seq_num 449 ranges {1990656=327680} 2024-03-30T12:27:16.573 INFO:tasks.rados.rados.0.smithi084.stdout:1411: writing smithi08477944-10 from 1990656 to 2318336 tid 1 2024-03-30T12:27:16.573 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 141 2024-03-30T12:27:16.573 INFO:tasks.rados.rados.0.smithi084.stdout:1412: seq_num 450 ranges {7364608=344064} 2024-03-30T12:27:16.614 INFO:tasks.rados.rados.0.smithi084.stdout:1412: writing smithi08477944-36 from 7364608 to 7708672 tid 1 2024-03-30T12:27:16.614 INFO:tasks.rados.rados.0.smithi084.stdout:1413: delete oid 26 current snap is 141 2024-03-30T12:27:16.614 INFO:tasks.rados.rados.0.smithi084.stdout:1409: expect (ObjNum 436 snap 140 seq_num 436) 2024-03-30T12:27:16.745 INFO:tasks.rados.rados.0.smithi084.stdout:1410: finishing write tid 1 to smithi08477944-25 2024-03-30T12:27:16.746 INFO:tasks.rados.rados.0.smithi084.stdout:1410: finishing write tid 2 to smithi08477944-25 2024-03-30T12:27:16.746 INFO:tasks.rados.rados.0.smithi084.stdout:1410: finishing write tid 3 to smithi08477944-25 2024-03-30T12:27:16.746 INFO:tasks.rados.rados.0.smithi084.stdout:1410: oid 25 updating version 0 to 820 2024-03-30T12:27:16.746 INFO:tasks.rados.rados.0.smithi084.stdout:1410: oid 25 version 820 is already newer than 819 2024-03-30T12:27:16.746 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 820 (ObjNum 448 snap 141 seq_num 448) dirty exists 2024-03-30T12:27:16.746 INFO:tasks.rados.rados.0.smithi084.stdout:1410: left oid 25 (ObjNum 448 snap 141 seq_num 448) 2024-03-30T12:27:16.746 INFO:tasks.rados.rados.0.smithi084.stdout:1411: finishing write tid 1 to smithi08477944-10 2024-03-30T12:27:16.746 INFO:tasks.rados.rados.0.smithi084.stdout:1409: done (4 left) 2024-03-30T12:27:16.746 INFO:tasks.rados.rados.0.smithi084.stdout:1410: done (3 left) 2024-03-30T12:27:16.746 INFO:tasks.rados.rados.0.smithi084.stdout:1413: done (2 left) 2024-03-30T12:27:16.746 INFO:tasks.rados.rados.0.smithi084.stdout:1414: rollback oid 47 current snap is 141 2024-03-30T12:27:16.747 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 140 2024-03-30T12:27:16.747 INFO:tasks.rados.rados.0.smithi084.stdout:1411: finishing write tid 2 to smithi08477944-10 2024-03-30T12:27:16.747 INFO:tasks.rados.rados.0.smithi084.stdout:1411: finishing write tid 3 to smithi08477944-10 2024-03-30T12:27:16.747 INFO:tasks.rados.rados.0.smithi084.stdout:1411: oid 10 updating version 0 to 776 2024-03-30T12:27:16.747 INFO:tasks.rados.rados.0.smithi084.stdout:1411: oid 10 version 776 is already newer than 775 2024-03-30T12:27:16.747 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 776 (ObjNum 449 snap 141 seq_num 449) dirty exists 2024-03-30T12:27:16.747 INFO:tasks.rados.rados.0.smithi084.stdout:1411: left oid 10 (ObjNum 449 snap 141 seq_num 449) 2024-03-30T12:27:16.747 INFO:tasks.rados.rados.0.smithi084.stdout:1412: finishing write tid 1 to smithi08477944-36 2024-03-30T12:27:16.748 INFO:tasks.rados.rados.0.smithi084.stdout:1412: finishing write tid 2 to smithi08477944-36 2024-03-30T12:27:16.748 INFO:tasks.rados.rados.0.smithi084.stdout:1412: finishing write tid 3 to smithi08477944-36 2024-03-30T12:27:16.748 INFO:tasks.rados.rados.0.smithi084.stdout:1412: oid 36 updating version 0 to 786 2024-03-30T12:27:16.748 INFO:tasks.rados.rados.0.smithi084.stdout:1412: oid 36 version 786 is already newer than 785 2024-03-30T12:27:16.748 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 786 (ObjNum 450 snap 141 seq_num 450) dirty exists 2024-03-30T12:27:16.748 INFO:tasks.rados.rados.0.smithi084.stdout:1412: left oid 36 (ObjNum 450 snap 141 seq_num 450) 2024-03-30T12:27:16.748 INFO:tasks.rados.rados.0.smithi084.stdout:1411: done (2 left) 2024-03-30T12:27:16.748 INFO:tasks.rados.rados.0.smithi084.stdout:1412: done (1 left) 2024-03-30T12:27:16.748 INFO:tasks.rados.rados.0.smithi084.stdout:1415: snap_remove snap 138 2024-03-30T12:27:16.996 INFO:tasks.rados.rados.0.smithi084.stdout:1415: done (1 left) 2024-03-30T12:27:16.996 INFO:tasks.rados.rados.0.smithi084.stdout:1416: rmattr oid 4 current snap is 141 2024-03-30T12:27:16.996 INFO:tasks.rados.rados.0.smithi084.stdout:1417: snap_create 2024-03-30T12:27:16.996 INFO:tasks.rados.rados.0.smithi084.stdout:1414: finishing rollback tid 1 to smithi08477944-47 2024-03-30T12:27:16.996 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 866 (ObjNum 65 snap 0 seq_num 1394492240) dirty dne 2024-03-30T12:27:17.000 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 661 (ObjNum 399 snap 125 seq_num 399) dirty exists 2024-03-30T12:27:17.243 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:17 smithi084 ceph-mon[89279]: osdmap e357: 8 total, 7 up, 8 in 2024-03-30T12:27:17.243 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:17.243 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:17.243 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:17 smithi084 ceph-mon[89279]: pgmap v218: 121 pgs: 9 active+undersized+degraded, 1 stale+active+clean, 2 active+clean+snaptrim_error, 21 active+undersized, 88 active+clean; 160 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 14 MiB/s rd, 2.4 MiB/s wr, 15 op/s; 32/315 objects degraded (10.159%) 2024-03-30T12:27:17.243 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:17 smithi084 ceph-mon[91810]: osdmap e357: 8 total, 7 up, 8 in 2024-03-30T12:27:17.243 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:17.243 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:17.244 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:17 smithi084 ceph-mon[91810]: pgmap v218: 121 pgs: 9 active+undersized+degraded, 1 stale+active+clean, 2 active+clean+snaptrim_error, 21 active+undersized, 88 active+clean; 160 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 14 MiB/s rd, 2.4 MiB/s wr, 15 op/s; 32/315 objects degraded (10.159%) 2024-03-30T12:27:17.245 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:17.006+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:17.245 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:17.006+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:17.245 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:16 smithi084 podman[106651]: 2024-03-30 12:27:16.803145308 +0000 UTC m=+0.705085390 container remove 6f54457eb59d3aa8757ae6c5d22f82db67b016b60e02f15873e30f1fce202c36 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.license=GPLv2) 2024-03-30T12:27:17.245 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:16 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.2.service: Deactivated successfully. 2024-03-30T12:27:17.245 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:16 smithi084 systemd[1]: Stopped Ceph osd.2 for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:27:17.245 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:16 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.2.service: Consumed 14.135s CPU time. 2024-03-30T12:27:17.245 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:17 smithi084 systemd[1]: Starting Ceph osd.2 for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:27:17.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:17 smithi162 ceph-mon[83709]: osdmap e357: 8 total, 7 up, 8 in 2024-03-30T12:27:17.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:17.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:17.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:17 smithi162 ceph-mon[83709]: pgmap v218: 121 pgs: 9 active+undersized+degraded, 1 stale+active+clean, 2 active+clean+snaptrim_error, 21 active+undersized, 88 active+clean; 160 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 14 MiB/s rd, 2.4 MiB/s wr, 15 op/s; 32/315 objects degraded (10.159%) 2024-03-30T12:27:17.497 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:17 smithi084 podman[106754]: 2024-03-30 12:27:17.154664616 +0000 UTC m=+0.017528731 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:27:17.497 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:17 smithi084 podman[106754]: 2024-03-30 12:27:17.254115512 +0000 UTC m=+0.116979606 container create 069a30930c666bca84479206fbfda694125b2386fabce37b7b15415184171e10 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2-activate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True) 2024-03-30T12:27:17.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:17 smithi084 podman[106754]: 2024-03-30 12:27:17.506643691 +0000 UTC m=+0.369507785 container init 069a30930c666bca84479206fbfda694125b2386fabce37b7b15415184171e10 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2-activate, org.label-schema.schema-version=1.0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:27:17.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:17 smithi084 podman[106754]: 2024-03-30 12:27:17.510120657 +0000 UTC m=+0.372984757 container start 069a30930c666bca84479206fbfda694125b2386fabce37b7b15415184171e10 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2-activate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, CEPH_POINT_RELEASE=) 2024-03-30T12:27:17.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:17 smithi084 podman[106754]: 2024-03-30 12:27:17.606668262 +0000 UTC m=+0.469532358 container attach 069a30930c666bca84479206fbfda694125b2386fabce37b7b15415184171e10 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2-activate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=) 2024-03-30T12:27:18.001 INFO:tasks.rados.rados.0.smithi084.stdout:1414: done (2 left) 2024-03-30T12:27:18.002 INFO:tasks.rados.rados.0.smithi084.stdout:1416: done (1 left) 2024-03-30T12:27:18.002 INFO:tasks.rados.rados.0.smithi084.stdout:1417: done (0 left) 2024-03-30T12:27:18.002 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 142 2024-03-30T12:27:18.002 INFO:tasks.rados.rados.0.smithi084.stdout:1418: seq_num 452 ranges {0=376832} 2024-03-30T12:27:18.003 INFO:tasks.rados.rados.0.smithi084.stdout:1418: writing smithi08477944-32 from 0 to 376832 tid 1 2024-03-30T12:27:18.004 INFO:tasks.rados.rados.0.smithi084.stdout:1419: rollback oid 4 current snap is 142 2024-03-30T12:27:18.004 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 4 to 140 2024-03-30T12:27:18.004 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 142 2024-03-30T12:27:18.004 INFO:tasks.rados.rados.0.smithi084.stdout:1420: seq_num 453 ranges {9822208=393216} 2024-03-30T12:27:18.059 INFO:tasks.rados.rados.0.smithi084.stdout:1420: writing smithi08477944-17 from 9822208 to 10215424 tid 1 2024-03-30T12:27:18.059 INFO:tasks.rados.rados.0.smithi084.stdout:1421: rollback oid 34 current snap is 142 2024-03-30T12:27:18.059 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 34 to 141 2024-03-30T12:27:18.059 INFO:tasks.rados.rados.0.smithi084.stdout:1418: finishing write tid 1 to smithi08477944-32 2024-03-30T12:27:18.059 INFO:tasks.rados.rados.0.smithi084.stdout:1422: setattr oid 14 current snap is 142 2024-03-30T12:27:18.059 INFO:tasks.rados.rados.0.smithi084.stdout:1419: finishing rollback tid 0 to smithi08477944-4 2024-03-30T12:27:18.059 INFO:tasks.rados.rados.0.smithi084.stdout:1419: finishing rollback tid 1 to smithi08477944-4 2024-03-30T12:27:18.060 INFO:tasks.rados.rados.0.smithi084.stdout:1418: finishing write tid 2 to smithi08477944-32 2024-03-30T12:27:18.060 INFO:tasks.rados.rados.0.smithi084.stdout:1419: finishing rollback tid 2 to smithi08477944-4 2024-03-30T12:27:18.060 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 664 (ObjNum 399 snap 125 seq_num 399) dirty exists 2024-03-30T12:27:18.060 INFO:tasks.rados.rados.0.smithi084.stdout:1418: finishing write tid 3 to smithi08477944-32 2024-03-30T12:27:18.060 INFO:tasks.rados.rados.0.smithi084.stdout:1418: oid 32 updating version 0 to 788 2024-03-30T12:27:18.060 INFO:tasks.rados.rados.0.smithi084.stdout:1418: oid 32 version 788 is already newer than 787 2024-03-30T12:27:18.060 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 788 (ObjNum 452 snap 142 seq_num 452) dirty exists 2024-03-30T12:27:18.060 INFO:tasks.rados.rados.0.smithi084.stdout:1418: left oid 32 (ObjNum 452 snap 142 seq_num 452) 2024-03-30T12:27:18.060 INFO:tasks.rados.rados.0.smithi084.stdout:1418: done (4 left) 2024-03-30T12:27:18.061 INFO:tasks.rados.rados.0.smithi084.stdout:1419: done (3 left) 2024-03-30T12:27:18.061 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 142 2024-03-30T12:27:18.061 INFO:tasks.rados.rados.0.smithi084.stdout:1423: seq_num 454 ranges {0=409600} 2024-03-30T12:27:18.062 INFO:tasks.rados.rados.0.smithi084.stdout:1423: writing smithi08477944-41 from 0 to 409600 tid 1 2024-03-30T12:27:18.062 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 142 2024-03-30T12:27:18.062 INFO:tasks.rados.rados.0.smithi084.stdout:1424: seq_num 455 ranges {3080192=425984} 2024-03-30T12:27:18.085 INFO:tasks.rados.rados.0.smithi084.stdout:1424: writing smithi08477944-12 from 3080192 to 3506176 tid 1 2024-03-30T12:27:18.085 INFO:tasks.rados.rados.0.smithi084.stdout:1425: read oid 5 snap -1 2024-03-30T12:27:18.086 INFO:tasks.rados.rados.0.smithi084.stdout:1425: expect (ObjNum 445 snap 141 seq_num 445) 2024-03-30T12:27:18.086 INFO:tasks.rados.rados.0.smithi084.stdout:1426: read oid 25 snap -1 2024-03-30T12:27:18.086 INFO:tasks.rados.rados.0.smithi084.stdout:1426: expect (ObjNum 448 snap 141 seq_num 448) 2024-03-30T12:27:18.086 INFO:tasks.rados.rados.0.smithi084.stdout:1427: snap_remove snap 140 2024-03-30T12:27:18.250 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:18.018+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:18.250 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:18.018+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:18.251 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:18 smithi084 ceph-mon[91810]: Health check failed: Degraded data redundancy: 32/315 objects degraded (10.159%), 9 pgs degraded (PG_DEGRADED) 2024-03-30T12:27:18.251 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:18 smithi084 ceph-mon[91810]: osdmap e358: 8 total, 7 up, 8 in 2024-03-30T12:27:18.251 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:18.251 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:18.251 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:18 smithi084 ceph-mon[89279]: Health check failed: Degraded data redundancy: 32/315 objects degraded (10.159%), 9 pgs degraded (PG_DEGRADED) 2024-03-30T12:27:18.251 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:18 smithi084 ceph-mon[89279]: osdmap e358: 8 total, 7 up, 8 in 2024-03-30T12:27:18.251 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:18.251 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:18.252 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2-activate[106770]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-30T12:27:18.252 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2-activate[106770]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-03-30T12:27:18.252 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:17 smithi084 bash[106754]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-30T12:27:18.252 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:17 smithi084 bash[106754]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-03-30T12:27:18.252 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:17 smithi084 bash[106754]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-03-30T12:27:18.252 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:17 smithi084 bash[106754]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-03-30T12:27:18.252 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:17 smithi084 bash[106754]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-03-30T12:27:18.252 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:17 smithi084 bash[106754]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-30T12:27:18.252 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:17 smithi084 bash[106754]: --> ceph-volume raw activate successful for osd ID: 2 2024-03-30T12:27:18.252 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2-activate[106770]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-03-30T12:27:18.252 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2-activate[106770]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-03-30T12:27:18.252 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2-activate[106770]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-03-30T12:27:18.252 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2-activate[106770]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-30T12:27:18.252 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2-activate[106770]: --> ceph-volume raw activate successful for osd ID: 2 2024-03-30T12:27:18.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:17 smithi084 podman[106754]: 2024-03-30 12:27:17.968970016 +0000 UTC m=+0.831834118 container died 069a30930c666bca84479206fbfda694125b2386fabce37b7b15415184171e10 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2-activate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-03-30T12:27:18.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:18 smithi162 ceph-mon[83709]: Health check failed: Degraded data redundancy: 32/315 objects degraded (10.159%), 9 pgs degraded (PG_DEGRADED) 2024-03-30T12:27:18.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:18 smithi162 ceph-mon[83709]: osdmap e358: 8 total, 7 up, 8 in 2024-03-30T12:27:18.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:18.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:18.964 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:18 smithi084 podman[106903]: 2024-03-30 12:27:18.627251975 +0000 UTC m=+0.649606115 container remove 069a30930c666bca84479206fbfda694125b2386fabce37b7b15415184171e10 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2-activate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240326, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-03-30T12:27:18.964 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:18 smithi084 podman[106968]: 2024-03-30 12:27:18.743479539 +0000 UTC m=+0.017923446 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:27:18.964 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:18 smithi084 podman[106968]: 2024-03-30 12:27:18.861525966 +0000 UTC m=+0.135969844 container create 647dd862762d15ac87205b69aafe05003cc671720aa4bd6a7f511cc71402646f (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T12:27:19.009 INFO:tasks.rados.rados.0.smithi084.stdout:1427: done (7 left) 2024-03-30T12:27:19.009 INFO:tasks.rados.rados.0.smithi084.stdout:1428: copy_from oid 50 from oid 40 current snap is 142 2024-03-30T12:27:19.009 INFO:tasks.rados.rados.0.smithi084.stdout:1420: finishing write tid 1 to smithi08477944-17 2024-03-30T12:27:19.009 INFO:tasks.rados.rados.0.smithi084.stdout:1420: finishing write tid 2 to smithi08477944-17 2024-03-30T12:27:19.009 INFO:tasks.rados.rados.0.smithi084.stdout:1421: finishing rollback tid 1 to smithi08477944-34 2024-03-30T12:27:19.009 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 0 (ObjNum 1281 snap 0 seq_num 1532997904) dirty dne 2024-03-30T12:27:19.009 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 777 (ObjNum 446 snap 141 seq_num 446) dirty exists 2024-03-30T12:27:19.009 INFO:tasks.rados.rados.0.smithi084.stdout:1420: finishing write tid 3 to smithi08477944-17 2024-03-30T12:27:19.009 INFO:tasks.rados.rados.0.smithi084.stdout:1420: oid 17 updating version 0 to 665 2024-03-30T12:27:19.010 INFO:tasks.rados.rados.0.smithi084.stdout:1420: oid 17 version 665 is already newer than 664 2024-03-30T12:27:19.010 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 665 (ObjNum 453 snap 142 seq_num 453) dirty exists 2024-03-30T12:27:19.010 INFO:tasks.rados.rados.0.smithi084.stdout:1420: left oid 17 (ObjNum 453 snap 142 seq_num 453) 2024-03-30T12:27:19.010 INFO:tasks.rados.rados.0.smithi084.stdout:1423: finishing write tid 1 to smithi08477944-41 2024-03-30T12:27:19.010 INFO:tasks.rados.rados.0.smithi084.stdout:1423: finishing write tid 2 to smithi08477944-41 2024-03-30T12:27:19.010 INFO:tasks.rados.rados.0.smithi084.stdout:1423: finishing write tid 3 to smithi08477944-41 2024-03-30T12:27:19.010 INFO:tasks.rados.rados.0.smithi084.stdout:1423: oid 41 updating version 0 to 871 2024-03-30T12:27:19.010 INFO:tasks.rados.rados.0.smithi084.stdout:1423: oid 41 version 871 is already newer than 870 2024-03-30T12:27:19.010 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 871 (ObjNum 454 snap 142 seq_num 454) dirty exists 2024-03-30T12:27:19.010 INFO:tasks.rados.rados.0.smithi084.stdout:1423: left oid 41 (ObjNum 454 snap 142 seq_num 454) 2024-03-30T12:27:19.010 INFO:tasks.rados.rados.0.smithi084.stdout:1424: finishing write tid 1 to smithi08477944-12 2024-03-30T12:27:19.010 INFO:tasks.rados.rados.0.smithi084.stdout:1420: done (7 left) 2024-03-30T12:27:19.010 INFO:tasks.rados.rados.0.smithi084.stdout:1421: done (6 left) 2024-03-30T12:27:19.010 INFO:tasks.rados.rados.0.smithi084.stdout:1422: done (5 left) 2024-03-30T12:27:19.011 INFO:tasks.rados.rados.0.smithi084.stdout:1423: done (4 left) 2024-03-30T12:27:19.011 INFO:tasks.rados.rados.0.smithi084.stdout:1429: copy_from oid 44 from oid 15 current snap is 142 2024-03-30T12:27:19.011 INFO:tasks.rados.rados.0.smithi084.stdout:1424: finishing write tid 2 to smithi08477944-12 2024-03-30T12:27:19.011 INFO:tasks.rados.rados.0.smithi084.stdout:1424: finishing write tid 3 to smithi08477944-12 2024-03-30T12:27:19.011 INFO:tasks.rados.rados.0.smithi084.stdout:1424: oid 12 updating version 0 to 496 2024-03-30T12:27:19.011 INFO:tasks.rados.rados.0.smithi084.stdout:1424: oid 12 updating version 496 to 497 2024-03-30T12:27:19.011 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 497 (ObjNum 455 snap 142 seq_num 455) dirty exists 2024-03-30T12:27:19.018 INFO:tasks.rados.rados.0.smithi084.stdout:1424: left oid 12 (ObjNum 455 snap 142 seq_num 455) 2024-03-30T12:27:19.018 INFO:tasks.rados.rados.0.smithi084.stdout:1425: expect (ObjNum 445 snap 141 seq_num 445) 2024-03-30T12:27:19.176 INFO:tasks.rados.rados.0.smithi084.stdout:1426: expect (ObjNum 448 snap 141 seq_num 448) 2024-03-30T12:27:19.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:19 smithi084 ceph-mon[89279]: osdmap e359: 8 total, 7 up, 8 in 2024-03-30T12:27:19.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:19.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:19.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:19 smithi084 ceph-mon[89279]: pgmap v221: 121 pgs: 9 active+undersized+degraded, 1 stale+active+clean, 2 active+clean+snaptrim_error, 21 active+undersized, 88 active+clean; 160 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 14 MiB/s rd, 2.4 MiB/s wr, 15 op/s; 32/315 objects degraded (10.159%) 2024-03-30T12:27:19.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:19.021+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:19.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:19.021+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:19.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:19 smithi084 ceph-mon[91810]: osdmap e359: 8 total, 7 up, 8 in 2024-03-30T12:27:19.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:19.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:19.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:19 smithi084 ceph-mon[91810]: pgmap v221: 121 pgs: 9 active+undersized+degraded, 1 stale+active+clean, 2 active+clean+snaptrim_error, 21 active+undersized, 88 active+clean; 160 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 14 MiB/s rd, 2.4 MiB/s wr, 15 op/s; 32/315 objects degraded (10.159%) 2024-03-30T12:27:19.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:19 smithi084 podman[106968]: 2024-03-30 12:27:19.114331026 +0000 UTC m=+0.388774922 container init 647dd862762d15ac87205b69aafe05003cc671720aa4bd6a7f511cc71402646f (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T12:27:19.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:19 smithi084 podman[106968]: 2024-03-30 12:27:19.117890724 +0000 UTC m=+0.392334612 container start 647dd862762d15ac87205b69aafe05003cc671720aa4bd6a7f511cc71402646f (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326) 2024-03-30T12:27:19.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:19 smithi084 ceph-osd[106988]: -- 172.21.15.84:0/1214045460 <== mon.2 v2:172.21.15.84:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563f45c0f680 con 0x563f45bd9400 2024-03-30T12:27:19.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:19 smithi084 bash[106968]: 647dd862762d15ac87205b69aafe05003cc671720aa4bd6a7f511cc71402646f 2024-03-30T12:27:19.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:19 smithi084 systemd[1]: Started Ceph osd.2 for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:27:19.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:19 smithi162 ceph-mon[83709]: osdmap e359: 8 total, 7 up, 8 in 2024-03-30T12:27:19.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:19.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:19.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:19 smithi162 ceph-mon[83709]: pgmap v221: 121 pgs: 9 active+undersized+degraded, 1 stale+active+clean, 2 active+clean+snaptrim_error, 21 active+undersized, 88 active+clean; 160 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 14 MiB/s rd, 2.4 MiB/s wr, 15 op/s; 32/315 objects degraded (10.159%) 2024-03-30T12:27:19.659 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:27:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:27:19] "GET /metrics HTTP/1.1" 200 36263 "" "Prometheus/2.43.0" 2024-03-30T12:27:19.726 INFO:tasks.rados.rados.0.smithi084.stdout:1428: finishing copy_from racing read to smithi08477944-50 2024-03-30T12:27:19.726 INFO:tasks.rados.rados.0.smithi084.stdout:1428: finishing copy_from to smithi08477944-50 2024-03-30T12:27:19.726 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 256 (ObjNum 414 snap 131 seq_num 414) dirty exists 2024-03-30T12:27:19.726 INFO:tasks.rados.rados.0.smithi084.stdout:1424: done (4 left) 2024-03-30T12:27:19.726 INFO:tasks.rados.rados.0.smithi084.stdout:1425: done (3 left) 2024-03-30T12:27:19.727 INFO:tasks.rados.rados.0.smithi084.stdout:1426: done (2 left) 2024-03-30T12:27:19.728 INFO:tasks.rados.rados.0.smithi084.stdout:1428: done (1 left) 2024-03-30T12:27:19.728 INFO:tasks.rados.rados.0.smithi084.stdout:1430: read oid 40 snap 141 2024-03-30T12:27:19.728 INFO:tasks.rados.rados.0.smithi084.stdout:1430: expect (ObjNum 414 snap 131 seq_num 414) 2024-03-30T12:27:19.728 INFO:tasks.rados.rados.0.smithi084.stdout:1431: copy_from oid 2 from oid 8 current snap is 142 2024-03-30T12:27:19.728 INFO:tasks.rados.rados.0.smithi084.stdout:1432: read oid 38 snap 141 2024-03-30T12:27:19.728 INFO:tasks.rados.rados.0.smithi084.stdout:1432: expect (ObjNum 379 snap 120 seq_num 379) 2024-03-30T12:27:19.728 INFO:tasks.rados.rados.0.smithi084.stdout:1433: read oid 10 snap -1 2024-03-30T12:27:19.728 INFO:tasks.rados.rados.0.smithi084.stdout:1433: expect (ObjNum 449 snap 141 seq_num 449) 2024-03-30T12:27:19.729 INFO:tasks.rados.rados.0.smithi084.stdout:1434: rollback oid 22 current snap is 142 2024-03-30T12:27:19.729 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 22 to 141 2024-03-30T12:27:19.729 INFO:tasks.rados.rados.0.smithi084.stdout:1435: copy_from oid 1 from oid 31 current snap is 142 2024-03-30T12:27:19.729 INFO:tasks.rados.rados.0.smithi084.stdout:1436: read oid 29 snap -1 2024-03-30T12:27:19.729 INFO:tasks.rados.rados.0.smithi084.stdout:1436: expect deleted 2024-03-30T12:27:19.729 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 142 2024-03-30T12:27:19.729 INFO:tasks.rados.rados.0.smithi084.stdout:1437: seq_num 456 ranges {0=442368} 2024-03-30T12:27:19.731 INFO:tasks.rados.rados.0.smithi084.stdout:1437: writing smithi08477944-26 from 0 to 442368 tid 1 2024-03-30T12:27:19.731 INFO:tasks.rados.rados.0.smithi084.stdout:1438: rollback oid 36 current snap is 142 2024-03-30T12:27:19.731 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 36 to 141 2024-03-30T12:27:19.731 INFO:tasks.rados.rados.0.smithi084.stdout:1439: snap_create 2024-03-30T12:27:19.739 INFO:tasks.rados.rados.0.smithi084.stdout:1434: finishing rollback tid 0 to smithi08477944-22 2024-03-30T12:27:19.742 INFO:tasks.rados.rados.0.smithi084.stdout:1438: finishing rollback tid 0 to smithi08477944-36 2024-03-30T12:27:19.742 INFO:tasks.rados.rados.0.smithi084.stdout:1438: finishing rollback tid 1 to smithi08477944-36 2024-03-30T12:27:19.742 INFO:tasks.rados.rados.0.smithi084.stdout:1438: finishing rollback tid 2 to smithi08477944-36 2024-03-30T12:27:19.742 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 791 (ObjNum 450 snap 141 seq_num 450) dirty exists 2024-03-30T12:27:19.748 INFO:tasks.rados.rados.0.smithi084.stdout:1429: finishing copy_from racing read to smithi08477944-44 2024-03-30T12:27:19.748 INFO:tasks.rados.rados.0.smithi084.stdout:1429: finishing copy_from to smithi08477944-44 2024-03-30T12:27:19.748 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 659 (ObjNum 440 snap 141 seq_num 440) dirty exists 2024-03-30T12:27:19.748 INFO:tasks.rados.rados.0.smithi084.stdout:1434: finishing rollback tid 1 to smithi08477944-22 2024-03-30T12:27:19.748 INFO:tasks.rados.rados.0.smithi084.stdout:1434: finishing rollback tid 2 to smithi08477944-22 2024-03-30T12:27:19.748 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 791 (ObjNum 431 snap 140 seq_num 431) dirty exists 2024-03-30T12:27:19.748 INFO:tasks.rados.rados.0.smithi084.stdout:1437: finishing write tid 1 to smithi08477944-26 2024-03-30T12:27:19.748 INFO:tasks.rados.rados.0.smithi084.stdout:1437: finishing write tid 2 to smithi08477944-26 2024-03-30T12:27:19.753 INFO:tasks.rados.rados.0.smithi084.stdout:1433: expect (ObjNum 449 snap 141 seq_num 449) 2024-03-30T12:27:19.861 INFO:tasks.rados.rados.0.smithi084.stdout:1432: expect (ObjNum 379 snap 120 seq_num 379) 2024-03-30T12:27:19.968 INFO:tasks.rados.rados.0.smithi084.stdout:1435: finishing copy_from racing read to smithi08477944-1 2024-03-30T12:27:19.968 INFO:tasks.rados.rados.0.smithi084.stdout:1435: finishing copy_from to smithi08477944-1 2024-03-30T12:27:19.968 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 657 (ObjNum 428 snap 137 seq_num 428) dirty exists 2024-03-30T12:27:19.969 INFO:tasks.rados.rados.0.smithi084.stdout:1431: finishing copy_from racing read to smithi08477944-2 2024-03-30T12:27:19.969 INFO:tasks.rados.rados.0.smithi084.stdout:1437: finishing write tid 3 to smithi08477944-26 2024-03-30T12:27:19.969 INFO:tasks.rados.rados.0.smithi084.stdout:1437: oid 26 updating version 0 to 793 2024-03-30T12:27:19.969 INFO:tasks.rados.rados.0.smithi084.stdout:1437: oid 26 version 793 is already newer than 792 2024-03-30T12:27:19.969 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 793 (ObjNum 456 snap 142 seq_num 456) dirty exists 2024-03-30T12:27:19.969 INFO:tasks.rados.rados.0.smithi084.stdout:1437: left oid 26 (ObjNum 456 snap 142 seq_num 456) 2024-03-30T12:27:19.969 INFO:tasks.rados.rados.0.smithi084.stdout:1431: finishing copy_from to smithi08477944-2 2024-03-30T12:27:19.969 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 784 (ObjNum 401 snap 125 seq_num 401) dirty exists 2024-03-30T12:27:19.969 INFO:tasks.rados.rados.0.smithi084.stdout:1430: expect (ObjNum 414 snap 131 seq_num 414) 2024-03-30T12:27:20.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:19.668+0000 7f13676087c0 -1 Falling back to public interface 2024-03-30T12:27:20.303 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:20 smithi084 ceph-mon[91810]: osdmap e360: 8 total, 7 up, 8 in 2024-03-30T12:27:20.304 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:20.304 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:20.304 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:20 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:20.304 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:20 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:20.304 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:20 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:27:20.304 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:20 smithi084 ceph-mon[89279]: osdmap e360: 8 total, 7 up, 8 in 2024-03-30T12:27:20.304 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:20.304 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:20.304 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:20 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:20.304 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:20 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:20.304 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:20 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:27:20.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:20 smithi162 ceph-mon[83709]: osdmap e360: 8 total, 7 up, 8 in 2024-03-30T12:27:20.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:20.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:20.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:20 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:20.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:20 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:20.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:20 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:27:20.473 INFO:tasks.rados.rados.0.smithi084.stdout:1429: done (10 left) 2024-03-30T12:27:20.473 INFO:tasks.rados.rados.0.smithi084.stdout:1430: done (9 left) 2024-03-30T12:27:20.475 INFO:tasks.rados.rados.0.smithi084.stdout:1431: done (8 left) 2024-03-30T12:27:20.475 INFO:tasks.rados.rados.0.smithi084.stdout:1432: done (7 left) 2024-03-30T12:27:20.475 INFO:tasks.rados.rados.0.smithi084.stdout:1433: done (6 left) 2024-03-30T12:27:20.475 INFO:tasks.rados.rados.0.smithi084.stdout:1434: done (5 left) 2024-03-30T12:27:20.476 INFO:tasks.rados.rados.0.smithi084.stdout:1435: done (4 left) 2024-03-30T12:27:20.476 INFO:tasks.rados.rados.0.smithi084.stdout:1436: done (3 left) 2024-03-30T12:27:20.476 INFO:tasks.rados.rados.0.smithi084.stdout:1437: done (2 left) 2024-03-30T12:27:20.477 INFO:tasks.rados.rados.0.smithi084.stdout:1438: done (1 left) 2024-03-30T12:27:20.478 INFO:tasks.rados.rados.0.smithi084.stdout:1439: done (0 left) 2024-03-30T12:27:20.478 INFO:tasks.rados.rados.0.smithi084.stdout:1440: rmattr oid 18 current snap is 143 2024-03-30T12:27:20.478 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 143 2024-03-30T12:27:20.478 INFO:tasks.rados.rados.0.smithi084.stdout:1441: seq_num 457 ranges {278528=458752} 2024-03-30T12:27:20.478 INFO:tasks.rados.rados.0.smithi084.stdout:1441: writing smithi08477944-14 from 278528 to 737280 tid 1 2024-03-30T12:27:20.478 INFO:tasks.rados.rados.0.smithi084.stdout:1442: snap_create 2024-03-30T12:27:20.482 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 875 (ObjNum 436 snap 140 seq_num 436) dirty exists 2024-03-30T12:27:20.485 INFO:tasks.rados.rados.0.smithi084.stdout:1441: finishing write tid 1 to smithi08477944-14 2024-03-30T12:27:20.486 INFO:tasks.rados.rados.0.smithi084.stdout:1441: finishing write tid 2 to smithi08477944-14 2024-03-30T12:27:20.486 INFO:tasks.rados.rados.0.smithi084.stdout:1441: finishing write tid 3 to smithi08477944-14 2024-03-30T12:27:20.486 INFO:tasks.rados.rados.0.smithi084.stdout:1441: oid 14 updating version 0 to 779 2024-03-30T12:27:20.486 INFO:tasks.rados.rados.0.smithi084.stdout:1441: oid 14 version 779 is already newer than 778 2024-03-30T12:27:20.486 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 779 (ObjNum 457 snap 143 seq_num 457) dirty exists 2024-03-30T12:27:20.486 INFO:tasks.rados.rados.0.smithi084.stdout:1441: left oid 14 (ObjNum 457 snap 143 seq_num 457) 2024-03-30T12:27:20.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:20.494+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:20.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:20.494+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:21.270 INFO:tasks.rados.rados.0.smithi084.stdout:1440: done (2 left) 2024-03-30T12:27:21.271 INFO:tasks.rados.rados.0.smithi084.stdout:1441: done (1 left) 2024-03-30T12:27:21.271 INFO:tasks.rados.rados.0.smithi084.stdout:1442: done (0 left) 2024-03-30T12:27:21.271 INFO:tasks.rados.rados.0.smithi084.stdout:1443: copy_from oid 34 from oid 41 current snap is 144 2024-03-30T12:27:21.271 INFO:tasks.rados.rados.0.smithi084.stdout:1444: rollback oid 2 current snap is 144 2024-03-30T12:27:21.271 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 2 to 141 2024-03-30T12:27:21.271 INFO:tasks.rados.rados.0.smithi084.stdout:1445: rollback oid 26 current snap is 144 2024-03-30T12:27:21.271 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 26 to 141 2024-03-30T12:27:21.271 INFO:tasks.rados.rados.0.smithi084.stdout:1446: read oid 9 snap -1 2024-03-30T12:27:21.271 INFO:tasks.rados.rados.0.smithi084.stdout:1446: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:27:21.271 INFO:tasks.rados.rados.0.smithi084.stdout:1447: rollback oid 37 current snap is 144 2024-03-30T12:27:21.271 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 37 to 143 2024-03-30T12:27:21.271 INFO:tasks.rados.rados.0.smithi084.stdout:1448: delete oid 4 current snap is 144 2024-03-30T12:27:21.272 INFO:tasks.rados.rados.0.smithi084.stdout:1446: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:27:21.276 INFO:tasks.rados.rados.0.smithi084.stdout:1444: finishing rollback tid 0 to smithi08477944-2 2024-03-30T12:27:21.277 INFO:tasks.rados.rados.0.smithi084.stdout:1447: finishing rollback tid 0 to smithi08477944-37 2024-03-30T12:27:21.277 INFO:tasks.rados.rados.0.smithi084.stdout:1446: done (5 left) 2024-03-30T12:27:21.277 INFO:tasks.rados.rados.0.smithi084.stdout:1448: done (4 left) 2024-03-30T12:27:21.277 INFO:tasks.rados.rados.0.smithi084.stdout:1449: snap_create 2024-03-30T12:27:21.277 INFO:tasks.rados.rados.0.smithi084.stdout:1447: finishing rollback tid 1 to smithi08477944-37 2024-03-30T12:27:21.277 INFO:tasks.rados.rados.0.smithi084.stdout:1447: finishing rollback tid 2 to smithi08477944-37 2024-03-30T12:27:21.277 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 782 (ObjNum 379 snap 120 seq_num 379) dirty exists 2024-03-30T12:27:21.278 INFO:tasks.rados.rados.0.smithi084.stdout:1444: finishing rollback tid 1 to smithi08477944-2 2024-03-30T12:27:21.278 INFO:tasks.rados.rados.0.smithi084.stdout:1444: finishing rollback tid 2 to smithi08477944-2 2024-03-30T12:27:21.278 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 796 (ObjNum 423 snap 135 seq_num 423) dirty exists 2024-03-30T12:27:21.279 INFO:tasks.rados.rados.0.smithi084.stdout:1445: finishing rollback tid 0 to smithi08477944-26 2024-03-30T12:27:21.279 INFO:tasks.rados.rados.0.smithi084.stdout:1445: finishing rollback tid 1 to smithi08477944-26 2024-03-30T12:27:21.279 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 798 (ObjNum 289 snap 0 seq_num 0) dirty dne 2024-03-30T12:27:21.280 INFO:tasks.rados.rados.0.smithi084.stdout:1443: finishing copy_from racing read to smithi08477944-34 2024-03-30T12:27:21.280 INFO:tasks.rados.rados.0.smithi084.stdout:1443: finishing copy_from to smithi08477944-34 2024-03-30T12:27:21.280 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 871 (ObjNum 454 snap 142 seq_num 454) dirty exists 2024-03-30T12:27:21.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:21 smithi084 ceph-mon[89279]: osdmap e361: 8 total, 7 up, 8 in 2024-03-30T12:27:21.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:21.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:21.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:21 smithi084 ceph-mon[89279]: pgmap v224: 121 pgs: 10 active+undersized+degraded, 2 active+clean+snaptrim_error, 27 active+undersized, 82 active+clean; 176 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 14 MiB/s rd, 4.0 MiB/s wr, 19 op/s; 40/339 objects degraded (11.799%) 2024-03-30T12:27:21.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:21.283+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:21.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:21.284+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:21.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:21 smithi084 ceph-mon[91810]: osdmap e361: 8 total, 7 up, 8 in 2024-03-30T12:27:21.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:21.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:21.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:21 smithi084 ceph-mon[91810]: pgmap v224: 121 pgs: 10 active+undersized+degraded, 2 active+clean+snaptrim_error, 27 active+undersized, 82 active+clean; 176 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 14 MiB/s rd, 4.0 MiB/s wr, 19 op/s; 40/339 objects degraded (11.799%) 2024-03-30T12:27:21.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:21 smithi162 ceph-mon[83709]: osdmap e361: 8 total, 7 up, 8 in 2024-03-30T12:27:21.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:21.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:21.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:21 smithi162 ceph-mon[83709]: pgmap v224: 121 pgs: 10 active+undersized+degraded, 2 active+clean+snaptrim_error, 27 active+undersized, 82 active+clean; 176 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 14 MiB/s rd, 4.0 MiB/s wr, 19 op/s; 40/339 objects degraded (11.799%) 2024-03-30T12:27:22.275 INFO:tasks.rados.rados.0.smithi084.stdout:1443: done (4 left) 2024-03-30T12:27:22.275 INFO:tasks.rados.rados.0.smithi084.stdout:1444: done (3 left) 2024-03-30T12:27:22.275 INFO:tasks.rados.rados.0.smithi084.stdout:1445: done (2 left) 2024-03-30T12:27:22.275 INFO:tasks.rados.rados.0.smithi084.stdout:1447: done (1 left) 2024-03-30T12:27:22.275 INFO:tasks.rados.rados.0.smithi084.stdout:1449: done (0 left) 2024-03-30T12:27:22.275 INFO:tasks.rados.rados.0.smithi084.stdout:1450: copy_from oid 2 from oid 47 current snap is 145 2024-03-30T12:27:22.275 INFO:tasks.rados.rados.0.smithi084.stdout:1451: snap_remove snap 144 2024-03-30T12:27:22.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:22 smithi084 ceph-mon[91810]: osdmap e362: 8 total, 7 up, 8 in 2024-03-30T12:27:22.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:22.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:22.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:22 smithi084 ceph-mon[89279]: osdmap e362: 8 total, 7 up, 8 in 2024-03-30T12:27:22.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:22.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:22.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:22.288+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:22.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:22.288+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:22.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:22 smithi162 ceph-mon[83709]: osdmap e362: 8 total, 7 up, 8 in 2024-03-30T12:27:22.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:22.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:23.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:22.900+0000 7f13676087c0 -1 osd.2 354 log_to_monitors true 2024-03-30T12:27:23.277 INFO:tasks.rados.rados.0.smithi084.stdout:1451: done (1 left) 2024-03-30T12:27:23.277 INFO:tasks.rados.rados.0.smithi084.stdout:1452: rollback oid 25 current snap is 145 2024-03-30T12:27:23.277 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 25 to 143 2024-03-30T12:27:23.277 INFO:tasks.rados.rados.0.smithi084.stdout:1450: finishing copy_from to smithi08477944-2 2024-03-30T12:27:23.277 INFO:tasks.rados.rados.0.smithi084.stdout:1450: got expected ENOENT (src dne) 2024-03-30T12:27:23.278 INFO:tasks.rados.rados.0.smithi084.stdout:1450: finishing copy_from racing read to smithi08477944-2 2024-03-30T12:27:23.278 INFO:tasks.rados.rados.0.smithi084.stdout:1450: done (1 left) 2024-03-30T12:27:23.278 INFO:tasks.rados.rados.0.smithi084.stdout:1453: rmattr oid 50 current snap is 145 2024-03-30T12:27:23.278 INFO:tasks.rados.rados.0.smithi084.stdout:1454: read oid 34 snap 142 2024-03-30T12:27:23.278 INFO:tasks.rados.rados.0.smithi084.stdout:1454: expect deleted 2024-03-30T12:27:23.278 INFO:tasks.rados.rados.0.smithi084.stdout:1455: delete oid 23 current snap is 145 2024-03-30T12:27:23.289 INFO:tasks.rados.rados.0.smithi084.stdout:1454: done (3 left) 2024-03-30T12:27:23.290 INFO:tasks.rados.rados.0.smithi084.stdout:1455: done (2 left) 2024-03-30T12:27:23.290 INFO:tasks.rados.rados.0.smithi084.stdout:1456: read oid 41 snap -1 2024-03-30T12:27:23.290 INFO:tasks.rados.rados.0.smithi084.stdout:1456: expect (ObjNum 454 snap 142 seq_num 454) 2024-03-30T12:27:23.290 INFO:tasks.rados.rados.0.smithi084.stdout:1457: read oid 40 snap -1 2024-03-30T12:27:23.290 INFO:tasks.rados.rados.0.smithi084.stdout:1457: expect (ObjNum 414 snap 131 seq_num 414) 2024-03-30T12:27:23.290 INFO:tasks.rados.rados.0.smithi084.stdout:1458: copy_from oid 16 from oid 26 current snap is 145 2024-03-30T12:27:23.290 INFO:tasks.rados.rados.0.smithi084.stdout:1459: rollback oid 24 current snap is 145 2024-03-30T12:27:23.290 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 24 to 141 2024-03-30T12:27:23.290 INFO:tasks.rados.rados.0.smithi084.stdout:1460: snap_create 2024-03-30T12:27:23.290 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 877 (ObjNum 414 snap 131 seq_num 414) dirty exists 2024-03-30T12:27:23.291 INFO:tasks.rados.rados.0.smithi084.stdout:1452: finishing rollback tid 0 to smithi08477944-25 2024-03-30T12:27:23.295 INFO:tasks.rados.rados.0.smithi084.stdout:1456: expect (ObjNum 454 snap 142 seq_num 454) 2024-03-30T12:27:23.314 INFO:tasks.rados.rados.0.smithi084.stdout:1452: finishing rollback tid 1 to smithi08477944-25 2024-03-30T12:27:23.314 INFO:tasks.rados.rados.0.smithi084.stdout:1452: finishing rollback tid 2 to smithi08477944-25 2024-03-30T12:27:23.314 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 823 (ObjNum 448 snap 141 seq_num 448) dirty exists 2024-03-30T12:27:23.314 INFO:tasks.rados.rados.0.smithi084.stdout:1459: finishing rollback tid 0 to smithi08477944-24 2024-03-30T12:27:23.314 INFO:tasks.rados.rados.0.smithi084.stdout:1459: finishing rollback tid 1 to smithi08477944-24 2024-03-30T12:27:23.314 INFO:tasks.rados.rados.0.smithi084.stdout:1458: finishing copy_from to smithi08477944-16 2024-03-30T12:27:23.314 INFO:tasks.rados.rados.0.smithi084.stdout:1458: got expected ENOENT (src dne) 2024-03-30T12:27:23.314 INFO:tasks.rados.rados.0.smithi084.stdout:1458: finishing copy_from racing read to smithi08477944-16 2024-03-30T12:27:23.314 INFO:tasks.rados.rados.0.smithi084.stdout:1459: finishing rollback tid 2 to smithi08477944-24 2024-03-30T12:27:23.314 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 262 (ObjNum 414 snap 131 seq_num 414) dirty exists 2024-03-30T12:27:23.326 INFO:tasks.rados.rados.0.smithi084.stdout:1457: expect (ObjNum 414 snap 131 seq_num 414) 2024-03-30T12:27:23.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:23 smithi162 ceph-mon[83709]: osdmap e363: 8 total, 7 up, 8 in 2024-03-30T12:27:23.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:23.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:23.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:23 smithi162 ceph-mon[83709]: pgmap v227: 121 pgs: 10 active+undersized+degraded, 2 active+clean+snaptrim_error, 27 active+undersized, 82 active+clean; 177 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 20 MiB/s rd, 4.3 MiB/s wr, 26 op/s; 42/354 objects degraded (11.864%) 2024-03-30T12:27:23.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:23 smithi162 ceph-mon[83709]: from='osd.2 [v2:172.21.15.84:6818/3020788159,v1:172.21.15.84:6819/3020788159]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-30T12:27:23.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:23.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:23.642 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-03-30T12:27:23.642 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:23.316+0000 7f1358a60700 -1 osd.2 354 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T12:27:23.642 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:23 smithi084 ceph-mon[91810]: osdmap e363: 8 total, 7 up, 8 in 2024-03-30T12:27:23.643 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:23.643 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:23.643 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:23 smithi084 ceph-mon[91810]: pgmap v227: 121 pgs: 10 active+undersized+degraded, 2 active+clean+snaptrim_error, 27 active+undersized, 82 active+clean; 177 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 20 MiB/s rd, 4.3 MiB/s wr, 26 op/s; 42/354 objects degraded (11.864%) 2024-03-30T12:27:23.643 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:23 smithi084 ceph-mon[91810]: from='osd.2 [v2:172.21.15.84:6818/3020788159,v1:172.21.15.84:6819/3020788159]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-30T12:27:23.643 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:23.643 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:23.643 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:23.292+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:23.643 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:23.295+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:23.644 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:23 smithi084 ceph-mon[89279]: osdmap e363: 8 total, 7 up, 8 in 2024-03-30T12:27:23.644 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:23.644 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:23.644 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:23 smithi084 ceph-mon[89279]: pgmap v227: 121 pgs: 10 active+undersized+degraded, 2 active+clean+snaptrim_error, 27 active+undersized, 82 active+clean; 177 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 20 MiB/s rd, 4.3 MiB/s wr, 26 op/s; 42/354 objects degraded (11.864%) 2024-03-30T12:27:23.644 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:23 smithi084 ceph-mon[89279]: from='osd.2 [v2:172.21.15.84:6818/3020788159,v1:172.21.15.84:6819/3020788159]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-30T12:27:23.644 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:23.644 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:23.980 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T12:27:23.980 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (6m) 0s ago 7m 25.2M - 0.25.0 c8568f914cd2 6765ce007f39 2024-03-30T12:27:23.980 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi162 *:3000 running (7m) 114s ago 7m 91.0M - 9.4.7 954c08fa6188 ff2ec7518619 2024-03-30T12:27:23.980 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (8m) 0s ago 8m 15.0M - 18.2.2-1051-gf14b5682 c8fb09e16a7d a9c2e74ca2a3 2024-03-30T12:27:23.980 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi162 running (8m) 114s ago 8m 19.7M - 18.2.2-1051-gf14b5682 c8fb09e16a7d ee1770ef5edd 2024-03-30T12:27:23.980 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi162 *:8443,9283,8765 running (3m) 114s ago 11m 449M - 19.0.0-1864-g5dc2ea30 548196a1a838 eec968f3fcc6 2024-03-30T12:27:23.980 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (3m) 0s ago 13m 510M - 19.0.0-1864-g5dc2ea30 548196a1a838 9a2aba19dffc 2024-03-30T12:27:23.980 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (2m) 0s ago 13m 52.6M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 a0811f2ae47d 2024-03-30T12:27:23.981 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi162 running (2m) 114s ago 12m 24.9M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 149ae6649e0c 2024-03-30T12:27:23.981 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (2m) 0s ago 12m 44.4M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 f79eca93cddd 2024-03-30T12:27:23.981 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (7m) 0s ago 7m 17.5M - 1.5.0 0da6a335fe13 66844bed39e8 2024-03-30T12:27:23.981 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi162 *:9100 running (6m) 114s ago 6m 15.5M - 1.5.0 0da6a335fe13 3d6e28b2348d 2024-03-30T12:27:23.981 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (73s) 0s ago 11m 196M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 c91eea4f8484 2024-03-30T12:27:23.981 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (39s) 0s ago 11m 108M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 7518832f6b4a 2024-03-30T12:27:23.981 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (5s) 0s ago 10m 15.1M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 647dd862762d 2024-03-30T12:27:23.981 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (10m) 0s ago 10m 138M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 8eaf6dc73c25 2024-03-30T12:27:23.981 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi162 running (10m) 114s ago 10m 195M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 1f52e827b91a 2024-03-30T12:27:23.981 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi162 running (9m) 114s ago 9m 188M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 7ba250d154aa 2024-03-30T12:27:23.981 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi162 running (9m) 114s ago 9m 108M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 656a733e8b7a 2024-03-30T12:27:23.981 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi162 running (8m) 114s ago 8m 127M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d e3246b3bc88b 2024-03-30T12:27:23.981 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi162 *:9095 running (3m) 114s ago 7m 51.4M - 2.43.0 a07b618ecd1d bd7d323e4b47 2024-03-30T12:27:24.292 INFO:tasks.rados.rados.0.smithi084.stdout:1452: done (6 left) 2024-03-30T12:27:24.292 INFO:tasks.rados.rados.0.smithi084.stdout:1453: done (5 left) 2024-03-30T12:27:24.292 INFO:tasks.rados.rados.0.smithi084.stdout:1456: done (4 left) 2024-03-30T12:27:24.292 INFO:tasks.rados.rados.0.smithi084.stdout:1457: done (3 left) 2024-03-30T12:27:24.292 INFO:tasks.rados.rados.0.smithi084.stdout:1458: done (2 left) 2024-03-30T12:27:24.292 INFO:tasks.rados.rados.0.smithi084.stdout:1459: done (1 left) 2024-03-30T12:27:24.292 INFO:tasks.rados.rados.0.smithi084.stdout:1460: done (0 left) 2024-03-30T12:27:24.292 INFO:tasks.rados.rados.0.smithi084.stdout:1461: rmattr oid 9 current snap is 146 2024-03-30T12:27:24.292 INFO:tasks.rados.rados.0.smithi084.stdout:1462: copy_from oid 11 from oid 13 current snap is 146 2024-03-30T12:27:24.292 INFO:tasks.rados.rados.0.smithi084.stdout:1463: delete oid 35 current snap is 146 2024-03-30T12:27:24.302 INFO:tasks.rados.rados.0.smithi084.stdout:1463: done (2 left) 2024-03-30T12:27:24.302 INFO:tasks.rados.rados.0.smithi084.stdout:1464: rollback oid 49 current snap is 146 2024-03-30T12:27:24.302 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 49 to 145 2024-03-30T12:27:24.302 INFO:tasks.rados.rados.0.smithi084.stdout:1465: snap_create 2024-03-30T12:27:24.305 INFO:tasks.rados.rados.0.smithi084.stdout:1464: finishing rollback tid 1 to smithi08477944-49 2024-03-30T12:27:24.306 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 784 (ObjNum 97 snap 0 seq_num 1429445904) dirty dne 2024-03-30T12:27:24.424 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-30T12:27:24.424 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-03-30T12:27:24.424 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 3 2024-03-30T12:27:24.424 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:27:24.424 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-03-30T12:27:24.424 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 2 2024-03-30T12:27:24.424 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:27:24.424 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-03-30T12:27:24.424 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 5, 2024-03-30T12:27:24.424 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 3 2024-03-30T12:27:24.425 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:27:24.425 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-03-30T12:27:24.425 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 2 2024-03-30T12:27:24.425 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:27:24.425 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-03-30T12:27:24.425 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 7, 2024-03-30T12:27:24.425 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 8 2024-03-30T12:27:24.425 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-30T12:27:24.425 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-30T12:27:24.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:24 smithi162 ceph-mon[83709]: Health check update: Degraded data redundancy: 42/354 objects degraded (11.864%), 10 pgs degraded (PG_DEGRADED) 2024-03-30T12:27:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:24 smithi162 ceph-mon[83709]: from='osd.2 [v2:172.21.15.84:6818/3020788159,v1:172.21.15.84:6819/3020788159]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-30T12:27:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:24 smithi162 ceph-mon[83709]: osdmap e364: 8 total, 7 up, 8 in 2024-03-30T12:27:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:24 smithi162 ceph-mon[83709]: from='osd.2 [v2:172.21.15.84:6818/3020788159,v1:172.21.15.84:6819/3020788159]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:27:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:24 smithi162 ceph-mon[83709]: from='client.34257 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:27:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:24 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:24 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:24.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:24.296+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:24.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:24.304+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:24.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:24 smithi084 ceph-mon[91810]: Health check update: Degraded data redundancy: 42/354 objects degraded (11.864%), 10 pgs degraded (PG_DEGRADED) 2024-03-30T12:27:24.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:24 smithi084 ceph-mon[91810]: from='osd.2 [v2:172.21.15.84:6818/3020788159,v1:172.21.15.84:6819/3020788159]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-30T12:27:24.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:24 smithi084 ceph-mon[91810]: osdmap e364: 8 total, 7 up, 8 in 2024-03-30T12:27:24.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:24 smithi084 ceph-mon[91810]: from='osd.2 [v2:172.21.15.84:6818/3020788159,v1:172.21.15.84:6819/3020788159]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:27:24.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:24.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:24.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:24 smithi084 ceph-mon[91810]: from='client.34257 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:27:24.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:24 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:24.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:24 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:24.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:24 smithi084 ceph-mon[89279]: Health check update: Degraded data redundancy: 42/354 objects degraded (11.864%), 10 pgs degraded (PG_DEGRADED) 2024-03-30T12:27:24.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:24 smithi084 ceph-mon[89279]: from='osd.2 [v2:172.21.15.84:6818/3020788159,v1:172.21.15.84:6819/3020788159]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-30T12:27:24.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:24 smithi084 ceph-mon[89279]: osdmap e364: 8 total, 7 up, 8 in 2024-03-30T12:27:24.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:24 smithi084 ceph-mon[89279]: from='osd.2 [v2:172.21.15.84:6818/3020788159,v1:172.21.15.84:6819/3020788159]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:27:24.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:24.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:24.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:24 smithi084 ceph-mon[89279]: from='client.34257 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:27:24.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:24 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:24.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:24 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:25.293 INFO:tasks.rados.rados.0.smithi084.stdout:1464: done (3 left) 2024-03-30T12:27:25.293 INFO:tasks.rados.rados.0.smithi084.stdout:1465: done (2 left) 2024-03-30T12:27:25.293 INFO:tasks.rados.rados.0.smithi084.stdout:1466: read oid 48 snap 143 2024-03-30T12:27:25.293 INFO:tasks.rados.rados.0.smithi084.stdout:1466: expect deleted 2024-03-30T12:27:25.293 INFO:tasks.rados.rados.0.smithi084.stdout:1467: rollback oid 2 current snap is 147 2024-03-30T12:27:25.293 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 2 to 143 2024-03-30T12:27:25.293 INFO:tasks.rados.rados.0.smithi084.stdout:1468: read oid 44 snap 146 2024-03-30T12:27:25.293 INFO:tasks.rados.rados.0.smithi084.stdout:1468: expect (ObjNum 440 snap 141 seq_num 440) 2024-03-30T12:27:25.293 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 147 2024-03-30T12:27:25.293 INFO:tasks.rados.rados.0.smithi084.stdout:1469: seq_num 461 ranges {5455872=524288} 2024-03-30T12:27:25.326 INFO:tasks.rados.rados.0.smithi084.stdout:1469: writing smithi08477944-20 from 5455872 to 5980160 tid 1 2024-03-30T12:27:25.327 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 147 2024-03-30T12:27:25.327 INFO:tasks.rados.rados.0.smithi084.stdout:1470: seq_num 462 ranges {0=540672} 2024-03-30T12:27:25.330 INFO:tasks.rados.rados.0.smithi084.stdout:1470: writing smithi08477944-19 from 0 to 540672 tid 1 2024-03-30T12:27:25.330 INFO:tasks.rados.rados.0.smithi084.stdout:1471: rollback oid 8 current snap is 147 2024-03-30T12:27:25.330 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 8 to 141 2024-03-30T12:27:25.330 INFO:tasks.rados.rados.0.smithi084.stdout:1468: expect (ObjNum 440 snap 141 seq_num 440) 2024-03-30T12:27:25.338 INFO:tasks.rados.rados.0.smithi084.stdout:1467: finishing rollback tid 0 to smithi08477944-2 2024-03-30T12:27:25.339 INFO:tasks.rados.rados.0.smithi084.stdout:1467: finishing rollback tid 1 to smithi08477944-2 2024-03-30T12:27:25.339 INFO:tasks.rados.rados.0.smithi084.stdout:1467: finishing rollback tid 2 to smithi08477944-2 2024-03-30T12:27:25.339 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 801 (ObjNum 401 snap 125 seq_num 401) dirty exists 2024-03-30T12:27:25.339 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 557 (ObjNum 33 snap 0 seq_num 1429424816) dirty exists 2024-03-30T12:27:25.339 INFO:tasks.rados.rados.0.smithi084.stdout:1462: finishing copy_from racing read to smithi08477944-11 2024-03-30T12:27:25.339 INFO:tasks.rados.rados.0.smithi084.stdout:1462: finishing copy_from to smithi08477944-11 2024-03-30T12:27:25.339 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 250 (ObjNum 407 snap 128 seq_num 407) dirty exists 2024-03-30T12:27:25.339 INFO:tasks.rados.rados.0.smithi084.stdout:1469: finishing write tid 1 to smithi08477944-20 2024-03-30T12:27:25.339 INFO:tasks.rados.rados.0.smithi084.stdout:1469: finishing write tid 2 to smithi08477944-20 2024-03-30T12:27:25.339 INFO:tasks.rados.rados.0.smithi084.stdout:1471: finishing rollback tid 0 to smithi08477944-8 2024-03-30T12:27:25.339 INFO:tasks.rados.rados.0.smithi084.stdout:1471: finishing rollback tid 1 to smithi08477944-8 2024-03-30T12:27:25.339 INFO:tasks.rados.rados.0.smithi084.stdout:1471: finishing rollback tid 2 to smithi08477944-8 2024-03-30T12:27:25.339 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 804 (ObjNum 401 snap 125 seq_num 401) dirty exists 2024-03-30T12:27:25.339 INFO:tasks.rados.rados.0.smithi084.stdout:1470: finishing write tid 1 to smithi08477944-19 2024-03-30T12:27:25.340 INFO:tasks.rados.rados.0.smithi084.stdout:1470: finishing write tid 2 to smithi08477944-19 2024-03-30T12:27:25.340 INFO:tasks.rados.rados.0.smithi084.stdout:1461: done (7 left) 2024-03-30T12:27:25.340 INFO:tasks.rados.rados.0.smithi084.stdout:1462: done (6 left) 2024-03-30T12:27:25.340 INFO:tasks.rados.rados.0.smithi084.stdout:1466: done (5 left) 2024-03-30T12:27:25.340 INFO:tasks.rados.rados.0.smithi084.stdout:1467: done (4 left) 2024-03-30T12:27:25.340 INFO:tasks.rados.rados.0.smithi084.stdout:1468: done (3 left) 2024-03-30T12:27:25.340 INFO:tasks.rados.rados.0.smithi084.stdout:1471: done (2 left) 2024-03-30T12:27:25.340 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 147 2024-03-30T12:27:25.340 INFO:tasks.rados.rados.0.smithi084.stdout:1470: finishing write tid 3 to smithi08477944-19 2024-03-30T12:27:25.340 INFO:tasks.rados.rados.0.smithi084.stdout:1470: oid 19 updating version 0 to 660 2024-03-30T12:27:25.340 INFO:tasks.rados.rados.0.smithi084.stdout:1470: oid 19 updating version 660 to 661 2024-03-30T12:27:25.340 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 661 (ObjNum 462 snap 147 seq_num 462) dirty exists 2024-03-30T12:27:25.340 INFO:tasks.rados.rados.0.smithi084.stdout:1470: left oid 19 (ObjNum 462 snap 147 seq_num 462) 2024-03-30T12:27:25.340 INFO:tasks.rados.rados.0.smithi084.stdout:1469: finishing write tid 3 to smithi08477944-20 2024-03-30T12:27:25.340 INFO:tasks.rados.rados.0.smithi084.stdout:1469: oid 20 updating version 0 to 888 2024-03-30T12:27:25.341 INFO:tasks.rados.rados.0.smithi084.stdout:1469: oid 20 updating version 888 to 889 2024-03-30T12:27:25.341 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 889 (ObjNum 461 snap 147 seq_num 461) dirty exists 2024-03-30T12:27:25.341 INFO:tasks.rados.rados.0.smithi084.stdout:1469: left oid 20 (ObjNum 461 snap 147 seq_num 461) 2024-03-30T12:27:25.341 INFO:tasks.rados.rados.0.smithi084.stdout:1472: seq_num 463 ranges {0=557056} 2024-03-30T12:27:25.341 INFO:tasks.rados.rados.0.smithi084.stdout:1472: writing smithi08477944-35 from 0 to 557056 tid 1 2024-03-30T12:27:25.341 INFO:tasks.rados.rados.0.smithi084.stdout:1469: done (2 left) 2024-03-30T12:27:25.341 INFO:tasks.rados.rados.0.smithi084.stdout:1470: done (1 left) 2024-03-30T12:27:25.342 INFO:tasks.rados.rados.0.smithi084.stdout:1473: read oid 15 snap -1 2024-03-30T12:27:25.342 INFO:tasks.rados.rados.0.smithi084.stdout:1473: expect (ObjNum 440 snap 141 seq_num 440) 2024-03-30T12:27:25.342 INFO:tasks.rados.rados.0.smithi084.stdout:1474: snap_remove snap 146 2024-03-30T12:27:25.490 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:25.299+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:25.490 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:25.300+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:25.490 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-mon[91810]: from='client.34263 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:27:25.490 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-mon[91810]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T12:27:25.490 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-mon[91810]: osd.2 [v2:172.21.15.84:6818/3020788159,v1:172.21.15.84:6819/3020788159] boot 2024-03-30T12:27:25.491 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-mon[91810]: osdmap e365: 8 total, 8 up, 8 in 2024-03-30T12:27:25.491 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:27:25.491 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:25.491 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:25.491 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/69956714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:27:25.491 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-mon[91810]: pgmap v230: 121 pgs: 10 active+undersized+degraded, 2 active+clean+snaptrim_error, 27 active+undersized, 82 active+clean; 181 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 6.6 MiB/s rd, 1.2 MiB/s wr, 7 op/s; 42/357 objects degraded (11.765%) 2024-03-30T12:27:25.491 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-mon[91810]: osdmap e366: 8 total, 8 up, 8 in 2024-03-30T12:27:25.491 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:25.344+0000 7f1341a32700 -1 osd.2 pg_epoch: 366 pg[5.as0( v 356'303 (0'0,356'303] local-lis/les=365/366 n=3 ec=71/71 lis/c=365/365 les/c/f=366/366/0 sis=365) [2,4,3]p2(0) r=0 lpr=365 crt=356'303 mlcod 0'0 active+clean+snaptrim trimq=[c7~3,cb~1,cf~1] ps=[97~1,99~1,9d~1,a0~2,a8~1f,ca~1]] update_snap_map remove_oid 5:54568f59:::smithi08477944-30:c7 failed with -2 2024-03-30T12:27:25.491 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:25.347+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:25.491 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:25.389+0000 7f1346a3c700 -1 osd.2 pg_epoch: 366 pg[5.8s0( v 366'889 (0'0,366'889] local-lis/les=365/366 n=8 ec=71/71 lis/c=365/365 les/c/f=366/366/0 sis=365) [2,0,1]p2(0) r=0 lpr=365 crt=366'889 mlcod 366'889 active+clean+snaptrim trimq=[c7~3,cb~1,cf~1] ps=[97~1,99~1,9d~1,a0~2,a8~1f,ca~1]] update_snap_map remove_oid 5:1f1ce0b4:::smithi08477944-7:ca failed with -2 2024-03-30T12:27:25.491 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:25.392+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:25.492 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:25.392+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:25.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-mon[89279]: from='client.34263 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:27:25.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-mon[89279]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T12:27:25.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-mon[89279]: osd.2 [v2:172.21.15.84:6818/3020788159,v1:172.21.15.84:6819/3020788159] boot 2024-03-30T12:27:25.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-mon[89279]: osdmap e365: 8 total, 8 up, 8 in 2024-03-30T12:27:25.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:27:25.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:25.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:25.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/69956714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:27:25.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-mon[89279]: pgmap v230: 121 pgs: 10 active+undersized+degraded, 2 active+clean+snaptrim_error, 27 active+undersized, 82 active+clean; 181 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 6.6 MiB/s rd, 1.2 MiB/s wr, 7 op/s; 42/357 objects degraded (11.765%) 2024-03-30T12:27:25.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-mon[89279]: osdmap e366: 8 total, 8 up, 8 in 2024-03-30T12:27:25.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:25 smithi162 ceph-mon[83709]: from='client.34263 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:27:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:25 smithi162 ceph-mon[83709]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T12:27:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:25 smithi162 ceph-mon[83709]: osd.2 [v2:172.21.15.84:6818/3020788159,v1:172.21.15.84:6819/3020788159] boot 2024-03-30T12:27:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:25 smithi162 ceph-mon[83709]: osdmap e365: 8 total, 8 up, 8 in 2024-03-30T12:27:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T12:27:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:25 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/69956714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:27:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:25 smithi162 ceph-mon[83709]: pgmap v230: 121 pgs: 10 active+undersized+degraded, 2 active+clean+snaptrim_error, 27 active+undersized, 82 active+clean; 181 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 6.6 MiB/s rd, 1.2 MiB/s wr, 7 op/s; 42/357 objects degraded (11.765%) 2024-03-30T12:27:25.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:25 smithi162 ceph-mon[83709]: osdmap e366: 8 total, 8 up, 8 in 2024-03-30T12:27:25.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:25.497+0000 7f134022f700 -1 osd.2 pg_epoch: 366 pg[5.ds0( v 364'877 (0'0,364'877] local-lis/les=365/366 n=8 ec=71/71 lis/c=365/365 les/c/f=366/366/0 sis=365) [2,7,5]p2(0) r=0 lpr=365 crt=364'877 mlcod 0'0 active+clean+snaptrim trimq=[c7~3,cb~1,cf~1] ps=[97~1,99~1,9d~1,a0~2,a8~1f,ca~1]] update_snap_map remove_oid 5:ba8bf6d7:::smithi08477944-18:ca failed with -2 2024-03-30T12:27:25.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:25.501+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:25.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:25.501+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:25.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:25.517+0000 7f1345239700 -1 osd.2 pg_epoch: 366 pg[5.bs0( v 362'576 (0'0,362'576] local-lis/les=365/366 n=8 ec=71/71 lis/c=365/365 les/c/f=366/366/0 sis=365) [2,0,5]p2(0) r=0 lpr=365 crt=362'576 mlcod 0'0 active+clean+snaptrim trimq=[c7~3,cb~1,cf~1] ps=[97~1,99~1,9d~1,a0~2,a8~1f,ca~1]] update_snap_map remove_oid 5:d602921a:::smithi08477944-28:ca failed with -2 2024-03-30T12:27:25.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:25.518+0000 7f1345239700 -1 osd.2 pg_epoch: 366 pg[5.bs0( v 366'578 (0'0,366'578] local-lis/les=365/366 n=7 ec=71/71 lis/c=365/365 les/c/f=366/366/0 sis=365) [2,0,5]p2(0) r=0 lpr=365 luod=362'576 crt=362'576 lcod 362'576 mlcod 0'0 active+clean+snaptrim trimq=[c7~3,cb~1,cf~1] ps=[97~1,99~1,9d~1,a0~2,a8~1f,ca~1]] update_snap_map remove_oid 5:d6cd5686:::smithi08477944-31:c7 failed with -2 2024-03-30T12:27:25.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:25.519+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:26.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:26.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:26.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:26.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:26.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:26.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:26.320 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:26.320 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:26.320 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:26.320 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:26.320 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:26.320 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:26.321 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:26.325+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:26.321 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:26.325+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:26.321 INFO:tasks.rados.rados.0.smithi084.stdout:1474: done (2 left) 2024-03-30T12:27:26.322 INFO:tasks.rados.rados.0.smithi084.stdout:1475: rollback oid 10 current snap is 147 2024-03-30T12:27:26.322 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 10 to 141 2024-03-30T12:27:26.322 INFO:tasks.rados.rados.0.smithi084.stdout:1473: expect (ObjNum 440 snap 141 seq_num 440) 2024-03-30T12:27:26.328 INFO:tasks.rados.rados.0.smithi084.stdout:1472: finishing write tid 1 to smithi08477944-35 2024-03-30T12:27:26.328 INFO:tasks.rados.rados.0.smithi084.stdout:1472: finishing write tid 2 to smithi08477944-35 2024-03-30T12:27:26.328 INFO:tasks.rados.rados.0.smithi084.stdout:1472: finishing write tid 3 to smithi08477944-35 2024-03-30T12:27:26.329 INFO:tasks.rados.rados.0.smithi084.stdout:1472: oid 35 updating version 0 to 660 2024-03-30T12:27:26.329 INFO:tasks.rados.rados.0.smithi084.stdout:1472: oid 35 version 660 is already newer than 659 2024-03-30T12:27:26.329 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 660 (ObjNum 463 snap 147 seq_num 463) dirty exists 2024-03-30T12:27:26.329 INFO:tasks.rados.rados.0.smithi084.stdout:1472: left oid 35 (ObjNum 463 snap 147 seq_num 463) 2024-03-30T12:27:26.329 INFO:tasks.rados.rados.0.smithi084.stdout:1472: done (2 left) 2024-03-30T12:27:26.329 INFO:tasks.rados.rados.0.smithi084.stdout:1473: done (1 left) 2024-03-30T12:27:26.329 INFO:tasks.rados.rados.0.smithi084.stdout:1476: read oid 22 snap 145 2024-03-30T12:27:26.329 INFO:tasks.rados.rados.0.smithi084.stdout:1476: expect (ObjNum 431 snap 140 seq_num 431) 2024-03-30T12:27:26.329 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 147 2024-03-30T12:27:26.329 INFO:tasks.rados.rados.0.smithi084.stdout:1475: finishing rollback tid 0 to smithi08477944-10 2024-03-30T12:27:26.329 INFO:tasks.rados.rados.0.smithi084.stdout:1475: finishing rollback tid 1 to smithi08477944-10 2024-03-30T12:27:26.329 INFO:tasks.rados.rados.0.smithi084.stdout:1477: seq_num 464 ranges {409600=573440} 2024-03-30T12:27:26.333 INFO:tasks.rados.rados.0.smithi084.stdout:1477: writing smithi08477944-34 from 409600 to 983040 tid 1 2024-03-30T12:27:26.333 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 147 2024-03-30T12:27:26.334 INFO:tasks.rados.rados.0.smithi084.stdout:1475: finishing rollback tid 2 to smithi08477944-10 2024-03-30T12:27:26.334 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 785 (ObjNum 449 snap 141 seq_num 449) dirty exists 2024-03-30T12:27:26.334 INFO:tasks.rados.rados.0.smithi084.stdout:1478: seq_num 465 ranges {10215424=598016} 2024-03-30T12:27:26.393 INFO:tasks.rados.rados.0.smithi084.stdout:1478: writing smithi08477944-17 from 10215424 to 10813440 tid 1 2024-03-30T12:27:26.393 INFO:tasks.rados.rados.0.smithi084.stdout:1475: done (3 left) 2024-03-30T12:27:26.393 INFO:tasks.rados.rados.0.smithi084.stdout:1479: rollback oid 31 current snap is 147 2024-03-30T12:27:26.393 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 31 to 141 2024-03-30T12:27:26.393 INFO:tasks.rados.rados.0.smithi084.stdout:1480: rollback oid 28 current snap is 147 2024-03-30T12:27:26.393 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 28 to 142 2024-03-30T12:27:26.393 INFO:tasks.rados.rados.0.smithi084.stdout:1481: snap_create 2024-03-30T12:27:26.393 INFO:tasks.rados.rados.0.smithi084.stdout:1477: finishing write tid 1 to smithi08477944-34 2024-03-30T12:27:26.393 INFO:tasks.rados.rados.0.smithi084.stdout:1477: finishing write tid 2 to smithi08477944-34 2024-03-30T12:27:26.393 INFO:tasks.rados.rados.0.smithi084.stdout:1477: finishing write tid 3 to smithi08477944-34 2024-03-30T12:27:26.394 INFO:tasks.rados.rados.0.smithi084.stdout:1477: oid 34 updating version 0 to 872 2024-03-30T12:27:26.394 INFO:tasks.rados.rados.0.smithi084.stdout:1477: oid 34 updating version 872 to 873 2024-03-30T12:27:26.394 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 873 (ObjNum 464 snap 147 seq_num 464) dirty exists 2024-03-30T12:27:26.394 INFO:tasks.rados.rados.0.smithi084.stdout:1477: left oid 34 (ObjNum 464 snap 147 seq_num 464) 2024-03-30T12:27:26.394 INFO:tasks.rados.rados.0.smithi084.stdout:1476: expect (ObjNum 431 snap 140 seq_num 431) 2024-03-30T12:27:26.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:26.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:26.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:26.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:26.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:26.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:26.749 INFO:tasks.rados.rados.0.smithi084.stdout:1479: finishing rollback tid 0 to smithi08477944-31 2024-03-30T12:27:26.749 INFO:tasks.rados.rados.0.smithi084.stdout:1479: finishing rollback tid 1 to smithi08477944-31 2024-03-30T12:27:26.749 INFO:tasks.rados.rados.0.smithi084.stdout:1479: finishing rollback tid 2 to smithi08477944-31 2024-03-30T12:27:26.749 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 668 (ObjNum 428 snap 137 seq_num 428) dirty exists 2024-03-30T12:27:26.749 INFO:tasks.rados.rados.0.smithi084.stdout:1480: finishing rollback tid 1 to smithi08477944-28 2024-03-30T12:27:26.750 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 660 (ObjNum 33 snap 0 seq_num 1394492664) dirty dne 2024-03-30T12:27:26.750 INFO:tasks.rados.rados.0.smithi084.stdout:1478: finishing write tid 1 to smithi08477944-17 2024-03-30T12:27:26.750 INFO:tasks.rados.rados.0.smithi084.stdout:1478: finishing write tid 2 to smithi08477944-17 2024-03-30T12:27:26.750 INFO:tasks.rados.rados.0.smithi084.stdout:1478: finishing write tid 3 to smithi08477944-17 2024-03-30T12:27:26.750 INFO:tasks.rados.rados.0.smithi084.stdout:1478: oid 17 updating version 0 to 667 2024-03-30T12:27:26.750 INFO:tasks.rados.rados.0.smithi084.stdout:1478: oid 17 version 667 is already newer than 666 2024-03-30T12:27:26.750 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 667 (ObjNum 465 snap 147 seq_num 465) dirty exists 2024-03-30T12:27:26.750 INFO:tasks.rados.rados.0.smithi084.stdout:1478: left oid 17 (ObjNum 465 snap 147 seq_num 465) 2024-03-30T12:27:26.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:26.331+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:26.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:26.332+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:26.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:26.326+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:26.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:26.326+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:26.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:26.326+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:27.323 INFO:tasks.rados.rados.0.smithi084.stdout:1476: done (5 left) 2024-03-30T12:27:27.323 INFO:tasks.rados.rados.0.smithi084.stdout:1477: done (4 left) 2024-03-30T12:27:27.323 INFO:tasks.rados.rados.0.smithi084.stdout:1478: done (3 left) 2024-03-30T12:27:27.323 INFO:tasks.rados.rados.0.smithi084.stdout:1479: done (2 left) 2024-03-30T12:27:27.323 INFO:tasks.rados.rados.0.smithi084.stdout:1480: done (1 left) 2024-03-30T12:27:27.323 INFO:tasks.rados.rados.0.smithi084.stdout:1481: done (0 left) 2024-03-30T12:27:27.324 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 148 2024-03-30T12:27:27.324 INFO:tasks.rados.rados.0.smithi084.stdout:1482: seq_num 466 ranges {3080192=614400} 2024-03-30T12:27:27.342 INFO:tasks.rados.rados.0.smithi084.stdout:1482: writing smithi08477944-38 from 3080192 to 3694592 tid 1 2024-03-30T12:27:27.343 INFO:tasks.rados.rados.0.smithi084.stdout:1483: snap_create 2024-03-30T12:27:27.347 INFO:tasks.rados.rados.0.smithi084.stdout:1482: finishing write tid 1 to smithi08477944-38 2024-03-30T12:27:27.348 INFO:tasks.rados.rados.0.smithi084.stdout:1482: finishing write tid 2 to smithi08477944-38 2024-03-30T12:27:27.349 INFO:tasks.rados.rados.0.smithi084.stdout:1482: finishing write tid 3 to smithi08477944-38 2024-03-30T12:27:27.349 INFO:tasks.rados.rados.0.smithi084.stdout:1482: oid 38 updating version 0 to 561 2024-03-30T12:27:27.349 INFO:tasks.rados.rados.0.smithi084.stdout:1482: oid 38 version 561 is already newer than 560 2024-03-30T12:27:27.349 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 561 (ObjNum 466 snap 148 seq_num 466) dirty exists 2024-03-30T12:27:27.349 INFO:tasks.rados.rados.0.smithi084.stdout:1482: left oid 38 (ObjNum 466 snap 148 seq_num 466) 2024-03-30T12:27:27.608 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:27.525+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:27.608 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:27.525+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d1=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:27.608 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:27.608 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:27.609 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:27.609 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:27.609 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:27 smithi084 ceph-mon[91810]: osdmap e367: 8 total, 8 up, 8 in 2024-03-30T12:27:27.609 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:27.609 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:27.609 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:27 smithi084 ceph-mon[91810]: pgmap v233: 121 pgs: 7 active+undersized+degraded, 2 active+clean+snaptrim_error, 11 active+undersized, 101 active+clean; 192 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 253 KiB/s rd, 1.6 MiB/s wr, 8 op/s; 34/378 objects degraded (8.995%); 7.7 MiB/s, 1 objects/s recovering 2024-03-30T12:27:27.609 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:27.353+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:27.609 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:27.353+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:27.609 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:27.354+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:27.609 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:27.354+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:27.610 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:27.355+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:27.610 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:27.355+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:27.610 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:27.610 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:27.610 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:27.610 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:27.610 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:27 smithi084 ceph-mon[89279]: osdmap e367: 8 total, 8 up, 8 in 2024-03-30T12:27:27.610 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:27.610 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:27.610 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:27 smithi084 ceph-mon[89279]: pgmap v233: 121 pgs: 7 active+undersized+degraded, 2 active+clean+snaptrim_error, 11 active+undersized, 101 active+clean; 192 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 253 KiB/s rd, 1.6 MiB/s wr, 8 op/s; 34/378 objects degraded (8.995%); 7.7 MiB/s, 1 objects/s recovering 2024-03-30T12:27:27.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:27.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:27.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:27.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:27.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:27 smithi162 ceph-mon[83709]: osdmap e367: 8 total, 8 up, 8 in 2024-03-30T12:27:27.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset cc=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:27.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:27.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:27 smithi162 ceph-mon[83709]: pgmap v233: 121 pgs: 7 active+undersized+degraded, 2 active+clean+snaptrim_error, 11 active+undersized, 101 active+clean; 192 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 253 KiB/s rd, 1.6 MiB/s wr, 8 op/s; 34/378 objects degraded (8.995%); 7.7 MiB/s, 1 objects/s recovering 2024-03-30T12:27:28.003 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:27:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:27:27.781+0000 7f1f562eb700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-03-30T12:27:28.326 INFO:tasks.rados.rados.0.smithi084.stdout:1482: done (1 left) 2024-03-30T12:27:28.326 INFO:tasks.rados.rados.0.smithi084.stdout:1483: done (0 left) 2024-03-30T12:27:28.326 INFO:tasks.rados.rados.0.smithi084.stdout:1484: setattr oid 29 current snap is 149 2024-03-30T12:27:28.330 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 31 current snap is 149 2024-03-30T12:27:28.330 INFO:tasks.rados.rados.0.smithi084.stdout:1485: seq_num 467 ranges {3825664=630784} 2024-03-30T12:27:28.353 INFO:tasks.rados.rados.0.smithi084.stdout:1485: writing smithi08477944-31 from 3825664 to 4456448 tid 1 2024-03-30T12:27:28.353 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 46 current snap is 149 2024-03-30T12:27:28.353 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 669 (ObjNum 0 snap 0 seq_num 304) dirty exists 2024-03-30T12:27:28.353 INFO:tasks.rados.rados.0.smithi084.stdout:1486: seq_num 468 ranges {5685248=647168} 2024-03-30T12:27:28.386 INFO:tasks.rados.rados.0.smithi084.stdout:1486: writing smithi08477944-46 from 5685248 to 6332416 tid 1 2024-03-30T12:27:28.386 INFO:tasks.rados.rados.0.smithi084.stdout:1484: done (2 left) 2024-03-30T12:27:28.386 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 149 2024-03-30T12:27:28.386 INFO:tasks.rados.rados.0.smithi084.stdout:1487: seq_num 469 ranges {8019968=663552} 2024-03-30T12:27:28.432 INFO:tasks.rados.rados.0.smithi084.stdout:1487: writing smithi08477944-25 from 8019968 to 8683520 tid 1 2024-03-30T12:27:28.432 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 149 2024-03-30T12:27:28.432 INFO:tasks.rados.rados.0.smithi084.stdout:1488: seq_num 470 ranges {5038080=679936} 2024-03-30T12:27:28.463 INFO:tasks.rados.rados.0.smithi084.stdout:1488: writing smithi08477944-2 from 5038080 to 5718016 tid 1 2024-03-30T12:27:28.463 INFO:tasks.rados.rados.0.smithi084.stdout:1489: rmattr oid 12 current snap is 149 2024-03-30T12:27:28.463 INFO:tasks.rados.rados.0.smithi084.stdout:1489: done (4 left) 2024-03-30T12:27:28.463 INFO:tasks.rados.rados.0.smithi084.stdout:1490: setattr oid 47 current snap is 149 2024-03-30T12:27:28.463 INFO:tasks.rados.rados.0.smithi084.stdout:1485: finishing write tid 1 to smithi08477944-31 2024-03-30T12:27:28.464 INFO:tasks.rados.rados.0.smithi084.stdout:1485: finishing write tid 2 to smithi08477944-31 2024-03-30T12:27:28.464 INFO:tasks.rados.rados.0.smithi084.stdout:1485: finishing write tid 3 to smithi08477944-31 2024-03-30T12:27:28.464 INFO:tasks.rados.rados.0.smithi084.stdout:1485: oid 31 updating version 0 to 671 2024-03-30T12:27:28.464 INFO:tasks.rados.rados.0.smithi084.stdout:1485: oid 31 version 671 is already newer than 670 2024-03-30T12:27:28.464 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 671 (ObjNum 467 snap 149 seq_num 467) dirty exists 2024-03-30T12:27:28.464 INFO:tasks.rados.rados.0.smithi084.stdout:1485: left oid 31 (ObjNum 467 snap 149 seq_num 467) 2024-03-30T12:27:28.464 INFO:tasks.rados.rados.0.smithi084.stdout:1486: finishing write tid 1 to smithi08477944-46 2024-03-30T12:27:28.464 INFO:tasks.rados.rados.0.smithi084.stdout:1486: finishing write tid 2 to smithi08477944-46 2024-03-30T12:27:28.464 INFO:tasks.rados.rados.0.smithi084.stdout:1486: finishing write tid 3 to smithi08477944-46 2024-03-30T12:27:28.464 INFO:tasks.rados.rados.0.smithi084.stdout:1486: oid 46 updating version 0 to 806 2024-03-30T12:27:28.464 INFO:tasks.rados.rados.0.smithi084.stdout:1486: oid 46 version 806 is already newer than 805 2024-03-30T12:27:28.464 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 806 (ObjNum 468 snap 149 seq_num 468) dirty exists 2024-03-30T12:27:28.464 INFO:tasks.rados.rados.0.smithi084.stdout:1486: left oid 46 (ObjNum 468 snap 149 seq_num 468) 2024-03-30T12:27:28.464 INFO:tasks.rados.rados.0.smithi084.stdout:1487: finishing write tid 1 to smithi08477944-25 2024-03-30T12:27:28.465 INFO:tasks.rados.rados.0.smithi084.stdout:1487: finishing write tid 2 to smithi08477944-25 2024-03-30T12:27:28.465 INFO:tasks.rados.rados.0.smithi084.stdout:1487: finishing write tid 3 to smithi08477944-25 2024-03-30T12:27:28.465 INFO:tasks.rados.rados.0.smithi084.stdout:1487: oid 25 updating version 0 to 824 2024-03-30T12:27:28.465 INFO:tasks.rados.rados.0.smithi084.stdout:1487: oid 25 updating version 824 to 825 2024-03-30T12:27:28.465 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 825 (ObjNum 469 snap 149 seq_num 469) dirty exists 2024-03-30T12:27:28.465 INFO:tasks.rados.rados.0.smithi084.stdout:1487: left oid 25 (ObjNum 469 snap 149 seq_num 469) 2024-03-30T12:27:28.465 INFO:tasks.rados.rados.0.smithi084.stdout:1485: done (4 left) 2024-03-30T12:27:28.465 INFO:tasks.rados.rados.0.smithi084.stdout:1486: done (3 left) 2024-03-30T12:27:28.465 INFO:tasks.rados.rados.0.smithi084.stdout:1487: done (2 left) 2024-03-30T12:27:28.465 INFO:tasks.rados.rados.0.smithi084.stdout:1491: rollback oid 24 current snap is 149 2024-03-30T12:27:28.465 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 24 to 148 2024-03-30T12:27:28.465 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 149 2024-03-30T12:27:28.465 INFO:tasks.rados.rados.0.smithi084.stdout:1492: seq_num 471 ranges {9134080=696320} 2024-03-30T12:27:28.516 INFO:tasks.rados.rados.0.smithi084.stdout:1492: writing smithi08477944-40 from 9134080 to 9830400 tid 1 2024-03-30T12:27:28.516 INFO:tasks.rados.rados.0.smithi084.stdout:1493: rollback oid 42 current snap is 149 2024-03-30T12:27:28.516 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 42 to 143 2024-03-30T12:27:28.517 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 892 (ObjNum 33 snap 0 seq_num 1429648048) dirty exists 2024-03-30T12:27:28.517 INFO:tasks.rados.rados.0.smithi084.stdout:1488: finishing write tid 1 to smithi08477944-2 2024-03-30T12:27:28.517 INFO:tasks.rados.rados.0.smithi084.stdout:1488: finishing write tid 2 to smithi08477944-2 2024-03-30T12:27:28.517 INFO:tasks.rados.rados.0.smithi084.stdout:1488: finishing write tid 3 to smithi08477944-2 2024-03-30T12:27:28.517 INFO:tasks.rados.rados.0.smithi084.stdout:1488: oid 2 updating version 0 to 807 2024-03-30T12:27:28.517 INFO:tasks.rados.rados.0.smithi084.stdout:1488: oid 2 updating version 807 to 808 2024-03-30T12:27:28.517 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 808 (ObjNum 470 snap 149 seq_num 470) dirty exists 2024-03-30T12:27:28.517 INFO:tasks.rados.rados.0.smithi084.stdout:1488: left oid 2 (ObjNum 470 snap 149 seq_num 470) 2024-03-30T12:27:28.517 INFO:tasks.rados.rados.0.smithi084.stdout:1491: finishing rollback tid 0 to smithi08477944-24 2024-03-30T12:27:28.517 INFO:tasks.rados.rados.0.smithi084.stdout:1491: finishing rollback tid 1 to smithi08477944-24 2024-03-30T12:27:28.517 INFO:tasks.rados.rados.0.smithi084.stdout:1491: finishing rollback tid 2 to smithi08477944-24 2024-03-30T12:27:28.517 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 266 (ObjNum 414 snap 131 seq_num 414) dirty exists 2024-03-30T12:27:28.517 INFO:tasks.rados.rados.0.smithi084.stdout:1488: done (4 left) 2024-03-30T12:27:28.517 INFO:tasks.rados.rados.0.smithi084.stdout:1490: done (3 left) 2024-03-30T12:27:28.517 INFO:tasks.rados.rados.0.smithi084.stdout:1491: done (2 left) 2024-03-30T12:27:28.518 INFO:tasks.rados.rados.0.smithi084.stdout:1494: copy_from oid 34 from oid 6 current snap is 149 2024-03-30T12:27:28.518 INFO:tasks.rados.rados.0.smithi084.stdout:1495: delete oid 21 current snap is 149 2024-03-30T12:27:28.518 INFO:tasks.rados.rados.0.smithi084.stdout:1495: done (3 left) 2024-03-30T12:27:28.518 INFO:tasks.rados.rados.0.smithi084.stdout:1496: rmattr oid 26 current snap is 149 2024-03-30T12:27:28.518 INFO:tasks.rados.rados.0.smithi084.stdout:1496: done (3 left) 2024-03-30T12:27:28.519 INFO:tasks.rados.rados.0.smithi084.stdout:1497: copy_from oid 48 from oid 47 current snap is 149 2024-03-30T12:27:28.519 INFO:tasks.rados.rados.0.smithi084.stdout:1498: setattr oid 23 current snap is 149 2024-03-30T12:27:28.519 INFO:tasks.rados.rados.0.smithi084.stdout:1499: snap_create 2024-03-30T12:27:28.521 INFO:tasks.rados.rados.0.smithi084.stdout:1493: finishing rollback tid 0 to smithi08477944-42 2024-03-30T12:27:28.521 INFO:tasks.rados.rados.0.smithi084.stdout:1493: finishing rollback tid 1 to smithi08477944-42 2024-03-30T12:27:28.522 INFO:tasks.rados.rados.0.smithi084.stdout:1494: finishing copy_from racing read to smithi08477944-34 2024-03-30T12:27:28.523 INFO:tasks.rados.rados.0.smithi084.stdout:1497: finishing copy_from racing read to smithi08477944-48 2024-03-30T12:27:28.523 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 793 (ObjNum 33 snap 0 seq_num 1429537648) dirty exists 2024-03-30T12:27:28.524 INFO:tasks.rados.rados.0.smithi084.stdout:1493: finishing rollback tid 2 to smithi08477944-42 2024-03-30T12:27:28.524 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 670 (ObjNum 404 snap 126 seq_num 404) dirty exists 2024-03-30T12:27:28.524 INFO:tasks.rados.rados.0.smithi084.stdout:1492: finishing write tid 1 to smithi08477944-40 2024-03-30T12:27:28.524 INFO:tasks.rados.rados.0.smithi084.stdout:1494: finishing copy_from to smithi08477944-34 2024-03-30T12:27:28.524 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 545 (ObjNum 218 snap 64 seq_num 218) dirty exists 2024-03-30T12:27:28.524 INFO:tasks.rados.rados.0.smithi084.stdout:1497: finishing copy_from to smithi08477944-48 2024-03-30T12:27:28.524 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 892 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:27:28.525 INFO:tasks.rados.rados.0.smithi084.stdout:1492: finishing write tid 2 to smithi08477944-40 2024-03-30T12:27:28.527 INFO:tasks.rados.rados.0.smithi084.stdout:1492: finishing write tid 3 to smithi08477944-40 2024-03-30T12:27:28.527 INFO:tasks.rados.rados.0.smithi084.stdout:1492: oid 40 updating version 0 to 895 2024-03-30T12:27:28.527 INFO:tasks.rados.rados.0.smithi084.stdout:1492: oid 40 version 895 is already newer than 894 2024-03-30T12:27:28.527 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 895 (ObjNum 471 snap 149 seq_num 471) dirty exists 2024-03-30T12:27:28.527 INFO:tasks.rados.rados.0.smithi084.stdout:1492: left oid 40 (ObjNum 471 snap 149 seq_num 471) 2024-03-30T12:27:28.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:28 smithi162 ceph-mon[83709]: osdmap e368: 8 total, 8 up, 8 in 2024-03-30T12:27:28.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:28.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:28.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:28.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:28.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:28.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset d1=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:28.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:28 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:28.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:28 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:28.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:28 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:27:28.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:28 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:27:28.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:28 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:28.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:28 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:27:28.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:28 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:27:28.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:28 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:27:28.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:28 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:27:28.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:28 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-30T12:27:28.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:28.342+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d1=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:28.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:28.342+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:28.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:28.338+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:28.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:28.338+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:28.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:28.338+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:28.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:28.339+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:28.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:28.341+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[91810]: osdmap e368: 8 total, 8 up, 8 in 2024-03-30T12:27:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset d1=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:27:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:27:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:27:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:27:28.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:27:28.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:27:28.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-30T12:27:28.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[89279]: osdmap e368: 8 total, 8 up, 8 in 2024-03-30T12:27:28.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:28.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:28.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:28.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:28.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:28.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset d1=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:28.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:28.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:28.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:27:28.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:27:28.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:28.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:27:28.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:27:28.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:27:28.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:27:28.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:28 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-30T12:27:29.335 INFO:tasks.rados.rados.0.smithi084.stdout:1492: done (5 left) 2024-03-30T12:27:29.336 INFO:tasks.rados.rados.0.smithi084.stdout:1493: done (4 left) 2024-03-30T12:27:29.336 INFO:tasks.rados.rados.0.smithi084.stdout:1494: done (3 left) 2024-03-30T12:27:29.336 INFO:tasks.rados.rados.0.smithi084.stdout:1497: done (2 left) 2024-03-30T12:27:29.336 INFO:tasks.rados.rados.0.smithi084.stdout:1498: done (1 left) 2024-03-30T12:27:29.336 INFO:tasks.rados.rados.0.smithi084.stdout:1499: done (0 left) 2024-03-30T12:27:29.336 INFO:tasks.rados.rados.0.smithi084.stdout:1500: delete oid 24 current snap is 150 2024-03-30T12:27:29.341 INFO:tasks.rados.rados.0.smithi084.stdout:1500: done (0 left) 2024-03-30T12:27:29.342 INFO:tasks.rados.rados.0.smithi084.stdout:1501: rmattr oid 14 current snap is 150 2024-03-30T12:27:29.342 INFO:tasks.rados.rados.0.smithi084.stdout:1502: delete oid 7 current snap is 150 2024-03-30T12:27:29.346 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 786 (ObjNum 457 snap 143 seq_num 457) dirty exists 2024-03-30T12:27:29.347 INFO:tasks.rados.rados.0.smithi084.stdout:1501: done (1 left) 2024-03-30T12:27:29.347 INFO:tasks.rados.rados.0.smithi084.stdout:1502: done (0 left) 2024-03-30T12:27:29.347 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 150 2024-03-30T12:27:29.347 INFO:tasks.rados.rados.0.smithi084.stdout:1503: seq_num 475 ranges {0=761856} 2024-03-30T12:27:29.352 INFO:tasks.rados.rados.0.smithi084.stdout:1503: writing smithi08477944-4 from 0 to 761856 tid 1 2024-03-30T12:27:29.352 INFO:tasks.rados.rados.0.smithi084.stdout:1504: snap_create 2024-03-30T12:27:29.358 INFO:tasks.rados.rados.0.smithi084.stdout:1503: finishing write tid 1 to smithi08477944-4 2024-03-30T12:27:29.358 INFO:tasks.rados.rados.0.smithi084.stdout:1503: finishing write tid 2 to smithi08477944-4 2024-03-30T12:27:29.358 INFO:tasks.rados.rados.0.smithi084.stdout:1503: finishing write tid 3 to smithi08477944-4 2024-03-30T12:27:29.358 INFO:tasks.rados.rados.0.smithi084.stdout:1503: oid 4 updating version 0 to 672 2024-03-30T12:27:29.358 INFO:tasks.rados.rados.0.smithi084.stdout:1503: oid 4 updating version 672 to 673 2024-03-30T12:27:29.358 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 673 (ObjNum 475 snap 150 seq_num 475) dirty exists 2024-03-30T12:27:29.358 INFO:tasks.rados.rados.0.smithi084.stdout:1503: left oid 4 (ObjNum 475 snap 150 seq_num 475) 2024-03-30T12:27:29.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:29 smithi162 ceph-mon[83709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-30T12:27:29.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:29 smithi162 ceph-mon[83709]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-03-30T12:27:29.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:29 smithi162 ceph-mon[83709]: osdmap e369: 8 total, 8 up, 8 in 2024-03-30T12:27:29.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:29.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:29.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:29.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:29.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset d1=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:29.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:29.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:29 smithi162 ceph-mon[83709]: pgmap v236: 121 pgs: 6 active+clean+snaptrim_error, 6 active+undersized, 109 active+clean; 192 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 1006 KiB/s wr, 14 op/s; 19 MiB/s, 5 objects/s recovering 2024-03-30T12:27:29.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:27:29] "GET /metrics HTTP/1.1" 200 36263 "" "Prometheus/2.43.0" 2024-03-30T12:27:29.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:29.354+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:29.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:29.355+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d1=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:29.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:27:29.331+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : Health check update: Possible data damage: 6 pgs snaptrim_error (PG_DAMAGED) 2024-03-30T12:27:29.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-mon[89279]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-30T12:27:29.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-mon[89279]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-03-30T12:27:29.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-mon[89279]: osdmap e369: 8 total, 8 up, 8 in 2024-03-30T12:27:29.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:29.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:29.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:29.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:29.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset d1=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:29.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:29.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-mon[89279]: pgmap v236: 121 pgs: 6 active+clean+snaptrim_error, 6 active+undersized, 109 active+clean; 192 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 1006 KiB/s wr, 14 op/s; 19 MiB/s, 5 objects/s recovering 2024-03-30T12:27:29.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-mon[91810]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-30T12:27:29.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-mon[91810]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-03-30T12:27:29.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-mon[91810]: osdmap e369: 8 total, 8 up, 8 in 2024-03-30T12:27:29.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:29.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:29.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:29.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:29.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset d1=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:29.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:29.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-mon[91810]: pgmap v236: 121 pgs: 6 active+clean+snaptrim_error, 6 active+undersized, 109 active+clean; 192 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 1006 KiB/s wr, 14 op/s; 19 MiB/s, 5 objects/s recovering 2024-03-30T12:27:29.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:29.339+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:29.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:29.339+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:29.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:29.339+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:29.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:29.340+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:29.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:29.340+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:29.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:29.340+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:30.348 INFO:tasks.rados.rados.0.smithi084.stdout:1503: done (1 left) 2024-03-30T12:27:30.348 INFO:tasks.rados.rados.0.smithi084.stdout:1504: done (0 left) 2024-03-30T12:27:30.348 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 151 2024-03-30T12:27:30.349 INFO:tasks.rados.rados.0.smithi084.stdout:1505: seq_num 476 ranges {3514368=778240} 2024-03-30T12:27:30.371 INFO:tasks.rados.rados.0.smithi084.stdout:1505: writing smithi08477944-45 from 3514368 to 4292608 tid 1 2024-03-30T12:27:30.371 INFO:tasks.rados.rados.0.smithi084.stdout:1506: snap_remove snap 148 2024-03-30T12:27:30.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:30 smithi162 ceph-mon[83709]: Health check update: Possible data damage: 6 pgs snaptrim_error (PG_DAMAGED) 2024-03-30T12:27:30.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:30 smithi162 ceph-mon[83709]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 34/378 objects degraded (8.995%), 7 pgs degraded) 2024-03-30T12:27:30.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:30.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:30.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:30.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:30.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:30 smithi162 ceph-mon[83709]: osdmap e370: 8 total, 8 up, 8 in 2024-03-30T12:27:30.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:30.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset d1=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:30.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:30 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:30.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:30 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:27:30.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:30.426+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:30.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:30.426+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d1=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:30.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:30.381+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:30.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:30.381+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:30.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:30.381+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:30.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:30.381+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:30.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:30.384+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-mon[91810]: Health check update: Possible data damage: 6 pgs snaptrim_error (PG_DAMAGED) 2024-03-30T12:27:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-mon[91810]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 34/378 objects degraded (8.995%), 7 pgs degraded) 2024-03-30T12:27:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-mon[91810]: osdmap e370: 8 total, 8 up, 8 in 2024-03-30T12:27:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset d1=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:27:30.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-mon[89279]: Health check update: Possible data damage: 6 pgs snaptrim_error (PG_DAMAGED) 2024-03-30T12:27:30.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-mon[89279]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 34/378 objects degraded (8.995%), 7 pgs degraded) 2024-03-30T12:27:30.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:30.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:30.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:30.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:30.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-mon[89279]: osdmap e370: 8 total, 8 up, 8 in 2024-03-30T12:27:30.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:30.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset d1=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:30.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:30.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:30 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:27:31.355 INFO:tasks.rados.rados.0.smithi084.stdout:1506: done (1 left) 2024-03-30T12:27:31.355 INFO:tasks.rados.rados.0.smithi084.stdout:1507: copy_from oid 25 from oid 40 current snap is 151 2024-03-30T12:27:31.355 INFO:tasks.rados.rados.0.smithi084.stdout:1505: finishing write tid 1 to smithi08477944-45 2024-03-30T12:27:31.355 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 151 2024-03-30T12:27:31.355 INFO:tasks.rados.rados.0.smithi084.stdout:1508: seq_num 477 ranges {0=794624} 2024-03-30T12:27:31.360 INFO:tasks.rados.rados.0.smithi084.stdout:1508: writing smithi08477944-29 from 0 to 794624 tid 1 2024-03-30T12:27:31.360 INFO:tasks.rados.rados.0.smithi084.stdout:1509: snap_remove snap 143 2024-03-30T12:27:31.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:31 smithi162 ceph-mon[83709]: osdmap e371: 8 total, 8 up, 8 in 2024-03-30T12:27:31.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:31.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:31.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:31.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:31.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:31.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset d1=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:31.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:31 smithi162 ceph-mon[83709]: pgmap v239: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 196 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 15 op/s; 12 MiB/s, 3 objects/s recovering 2024-03-30T12:27:31.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:31.365+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d1=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:31.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:31.366+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:31.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:31 smithi084 ceph-mon[91810]: osdmap e371: 8 total, 8 up, 8 in 2024-03-30T12:27:31.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:31.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:31.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:31.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:31.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:31.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset d1=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:31.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:31 smithi084 ceph-mon[91810]: pgmap v239: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 196 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 15 op/s; 12 MiB/s, 3 objects/s recovering 2024-03-30T12:27:31.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:31 smithi084 ceph-mon[89279]: osdmap e371: 8 total, 8 up, 8 in 2024-03-30T12:27:31.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:31.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:31.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:31.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:31.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:31.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset d1=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:31.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:31 smithi084 ceph-mon[89279]: pgmap v239: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 196 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 15 op/s; 12 MiB/s, 3 objects/s recovering 2024-03-30T12:27:31.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:31.359+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:31.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:31.359+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:31.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:31.359+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:31.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:31.359+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:31.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:31.359+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:31.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:31.359+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:32.361 INFO:tasks.rados.rados.0.smithi084.stdout:1509: done (3 left) 2024-03-30T12:27:32.361 INFO:tasks.rados.rados.0.smithi084.stdout:1510: delete oid 17 current snap is 151 2024-03-30T12:27:32.361 INFO:tasks.rados.rados.0.smithi084.stdout:1505: finishing write tid 2 to smithi08477944-45 2024-03-30T12:27:32.361 INFO:tasks.rados.rados.0.smithi084.stdout:1505: finishing write tid 3 to smithi08477944-45 2024-03-30T12:27:32.361 INFO:tasks.rados.rados.0.smithi084.stdout:1505: oid 45 updating version 0 to 881 2024-03-30T12:27:32.362 INFO:tasks.rados.rados.0.smithi084.stdout:1505: oid 45 updating version 881 to 882 2024-03-30T12:27:32.362 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 882 (ObjNum 476 snap 151 seq_num 476) dirty exists 2024-03-30T12:27:32.362 INFO:tasks.rados.rados.0.smithi084.stdout:1505: left oid 45 (ObjNum 476 snap 151 seq_num 476) 2024-03-30T12:27:32.362 INFO:tasks.rados.rados.0.smithi084.stdout:1508: finishing write tid 1 to smithi08477944-29 2024-03-30T12:27:32.362 INFO:tasks.rados.rados.0.smithi084.stdout:1508: finishing write tid 2 to smithi08477944-29 2024-03-30T12:27:32.362 INFO:tasks.rados.rados.0.smithi084.stdout:1508: finishing write tid 3 to smithi08477944-29 2024-03-30T12:27:32.362 INFO:tasks.rados.rados.0.smithi084.stdout:1508: oid 29 updating version 0 to 675 2024-03-30T12:27:32.362 INFO:tasks.rados.rados.0.smithi084.stdout:1508: oid 29 version 675 is already newer than 674 2024-03-30T12:27:32.362 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 675 (ObjNum 477 snap 151 seq_num 477) dirty exists 2024-03-30T12:27:32.362 INFO:tasks.rados.rados.0.smithi084.stdout:1508: left oid 29 (ObjNum 477 snap 151 seq_num 477) 2024-03-30T12:27:32.362 INFO:tasks.rados.rados.0.smithi084.stdout:1507: finishing copy_from racing read to smithi08477944-25 2024-03-30T12:27:32.362 INFO:tasks.rados.rados.0.smithi084.stdout:1507: finishing copy_from to smithi08477944-25 2024-03-30T12:27:32.362 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 895 (ObjNum 471 snap 149 seq_num 471) dirty exists 2024-03-30T12:27:32.369 INFO:tasks.rados.rados.0.smithi084.stdout:1505: done (3 left) 2024-03-30T12:27:32.369 INFO:tasks.rados.rados.0.smithi084.stdout:1507: done (2 left) 2024-03-30T12:27:32.369 INFO:tasks.rados.rados.0.smithi084.stdout:1508: done (1 left) 2024-03-30T12:27:32.369 INFO:tasks.rados.rados.0.smithi084.stdout:1510: done (0 left) 2024-03-30T12:27:32.369 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 151 2024-03-30T12:27:32.369 INFO:tasks.rados.rados.0.smithi084.stdout:1511: seq_num 479 ranges {0=425984,425984=401408} 2024-03-30T12:27:32.372 INFO:tasks.rados.rados.0.smithi084.stdout:1511: writing smithi08477944-23 from 0 to 425984 tid 1 2024-03-30T12:27:32.375 INFO:tasks.rados.rados.0.smithi084.stdout:1511: writing smithi08477944-23 from 425984 to 827392 tid 2 2024-03-30T12:27:32.375 INFO:tasks.rados.rados.0.smithi084.stdout:1512: snap_create 2024-03-30T12:27:32.377 INFO:tasks.rados.rados.0.smithi084.stdout:1511: finishing write tid 1 to smithi08477944-23 2024-03-30T12:27:32.377 INFO:tasks.rados.rados.0.smithi084.stdout:1511: finishing write tid 2 to smithi08477944-23 2024-03-30T12:27:32.378 INFO:tasks.rados.rados.0.smithi084.stdout:1511: finishing write tid 3 to smithi08477944-23 2024-03-30T12:27:32.380 INFO:tasks.rados.rados.0.smithi084.stdout:1511: finishing write tid 4 to smithi08477944-23 2024-03-30T12:27:32.380 INFO:tasks.rados.rados.0.smithi084.stdout:1511: oid 23 updating version 0 to 796 2024-03-30T12:27:32.380 INFO:tasks.rados.rados.0.smithi084.stdout:1511: oid 23 version 796 is already newer than 794 2024-03-30T12:27:32.380 INFO:tasks.rados.rados.0.smithi084.stdout:1511: oid 23 version 796 is already newer than 795 2024-03-30T12:27:32.380 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 796 (ObjNum 479 snap 151 seq_num 479) dirty exists 2024-03-30T12:27:32.380 INFO:tasks.rados.rados.0.smithi084.stdout:1511: left oid 23 (ObjNum 479 snap 151 seq_num 479) 2024-03-30T12:27:32.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:32.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:32.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:32.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:32.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:32 smithi162 ceph-mon[83709]: osdmap e372: 8 total, 8 up, 8 in 2024-03-30T12:27:32.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset d1=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:32.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:32.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:32.371+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:32.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:32.375+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:32.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:32.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:32.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:32.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:32.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:32 smithi084 ceph-mon[91810]: osdmap e372: 8 total, 8 up, 8 in 2024-03-30T12:27:32.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset d1=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:32.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:32 smithi084 ceph-mon[89279]: osdmap e372: 8 total, 8 up, 8 in 2024-03-30T12:27:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset d1=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:32.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:32.380+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:32.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:32.380+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:32.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:32.380+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:32.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:32.380+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:32.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:32.380+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:33.367 INFO:tasks.rados.rados.0.smithi084.stdout:1511: done (1 left) 2024-03-30T12:27:33.367 INFO:tasks.rados.rados.0.smithi084.stdout:1512: done (0 left) 2024-03-30T12:27:33.367 INFO:tasks.rados.rados.0.smithi084.stdout:1513: read oid 33 snap -1 2024-03-30T12:27:33.367 INFO:tasks.rados.rados.0.smithi084.stdout:1513: expect (ObjNum 406 snap 128 seq_num 406) 2024-03-30T12:27:33.367 INFO:tasks.rados.rados.0.smithi084.stdout:1514: read oid 6 snap -1 2024-03-30T12:27:33.367 INFO:tasks.rados.rados.0.smithi084.stdout:1514: expect (ObjNum 218 snap 64 seq_num 218) 2024-03-30T12:27:33.367 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 152 2024-03-30T12:27:33.367 INFO:tasks.rados.rados.0.smithi084.stdout:1515: seq_num 480 ranges {5718016=442368,6160384=401408} 2024-03-30T12:27:33.400 INFO:tasks.rados.rados.0.smithi084.stdout:1515: writing smithi08477944-2 from 5718016 to 6160384 tid 1 2024-03-30T12:27:33.403 INFO:tasks.rados.rados.0.smithi084.stdout:1515: writing smithi08477944-2 from 6160384 to 6561792 tid 2 2024-03-30T12:27:33.403 INFO:tasks.rados.rados.0.smithi084.stdout:1516: delete oid 8 current snap is 152 2024-03-30T12:27:33.403 INFO:tasks.rados.rados.0.smithi084.stdout:1514: expect (ObjNum 218 snap 64 seq_num 218) 2024-03-30T12:27:33.436 INFO:tasks.rados.rados.0.smithi084.stdout:1513: expect (ObjNum 406 snap 128 seq_num 406) 2024-03-30T12:27:33.551 INFO:tasks.rados.rados.0.smithi084.stdout:1515: finishing write tid 1 to smithi08477944-2 2024-03-30T12:27:33.551 INFO:tasks.rados.rados.0.smithi084.stdout:1515: finishing write tid 2 to smithi08477944-2 2024-03-30T12:27:33.551 INFO:tasks.rados.rados.0.smithi084.stdout:1515: finishing write tid 3 to smithi08477944-2 2024-03-30T12:27:33.551 INFO:tasks.rados.rados.0.smithi084.stdout:1515: finishing write tid 4 to smithi08477944-2 2024-03-30T12:27:33.551 INFO:tasks.rados.rados.0.smithi084.stdout:1515: oid 2 updating version 0 to 811 2024-03-30T12:27:33.551 INFO:tasks.rados.rados.0.smithi084.stdout:1515: oid 2 version 811 is already newer than 810 2024-03-30T12:27:33.551 INFO:tasks.rados.rados.0.smithi084.stdout:1515: oid 2 version 811 is already newer than 809 2024-03-30T12:27:33.551 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 811 (ObjNum 480 snap 152 seq_num 480) dirty exists 2024-03-30T12:27:33.551 INFO:tasks.rados.rados.0.smithi084.stdout:1515: left oid 2 (ObjNum 480 snap 152 seq_num 480) 2024-03-30T12:27:33.552 INFO:tasks.rados.rados.0.smithi084.stdout:1513: done (3 left) 2024-03-30T12:27:33.552 INFO:tasks.rados.rados.0.smithi084.stdout:1514: done (2 left) 2024-03-30T12:27:33.552 INFO:tasks.rados.rados.0.smithi084.stdout:1515: done (1 left) 2024-03-30T12:27:33.552 INFO:tasks.rados.rados.0.smithi084.stdout:1516: done (0 left) 2024-03-30T12:27:33.552 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 42 current snap is 152 2024-03-30T12:27:33.552 INFO:tasks.rados.rados.0.smithi084.stdout:1517: seq_num 482 ranges {4587520=475136,5062656=401408} 2024-03-30T12:27:33.577 INFO:tasks.rados.rados.0.smithi084.stdout:1517: writing smithi08477944-42 from 4587520 to 5062656 tid 1 2024-03-30T12:27:33.579 INFO:tasks.rados.rados.0.smithi084.stdout:1517: writing smithi08477944-42 from 5062656 to 5464064 tid 2 2024-03-30T12:27:33.579 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 152 2024-03-30T12:27:33.580 INFO:tasks.rados.rados.0.smithi084.stdout:1518: seq_num 483 ranges {0=491520,491520=401408} 2024-03-30T12:27:33.582 INFO:tasks.rados.rados.0.smithi084.stdout:1518: writing smithi08477944-39 from 0 to 491520 tid 1 2024-03-30T12:27:33.586 INFO:tasks.rados.rados.0.smithi084.stdout:1518: writing smithi08477944-39 from 491520 to 892928 tid 2 2024-03-30T12:27:33.586 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 152 2024-03-30T12:27:33.586 INFO:tasks.rados.rados.0.smithi084.stdout:1517: finishing write tid 1 to smithi08477944-42 2024-03-30T12:27:33.586 INFO:tasks.rados.rados.0.smithi084.stdout:1517: finishing write tid 2 to smithi08477944-42 2024-03-30T12:27:33.586 INFO:tasks.rados.rados.0.smithi084.stdout:1517: finishing write tid 3 to smithi08477944-42 2024-03-30T12:27:33.586 INFO:tasks.rados.rados.0.smithi084.stdout:1517: finishing write tid 4 to smithi08477944-42 2024-03-30T12:27:33.587 INFO:tasks.rados.rados.0.smithi084.stdout:1517: oid 42 updating version 0 to 674 2024-03-30T12:27:33.587 INFO:tasks.rados.rados.0.smithi084.stdout:1517: oid 42 version 674 is already newer than 673 2024-03-30T12:27:33.587 INFO:tasks.rados.rados.0.smithi084.stdout:1517: oid 42 version 674 is already newer than 672 2024-03-30T12:27:33.587 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 674 (ObjNum 482 snap 152 seq_num 482) dirty exists 2024-03-30T12:27:33.587 INFO:tasks.rados.rados.0.smithi084.stdout:1517: left oid 42 (ObjNum 482 snap 152 seq_num 482) 2024-03-30T12:27:33.587 INFO:tasks.rados.rados.0.smithi084.stdout:1519: seq_num 484 ranges {827392=507904,1335296=401408} 2024-03-30T12:27:33.592 INFO:tasks.rados.rados.0.smithi084.stdout:1519: writing smithi08477944-23 from 827392 to 1335296 tid 1 2024-03-30T12:27:33.595 INFO:tasks.rados.rados.0.smithi084.stdout:1519: writing smithi08477944-23 from 1335296 to 1736704 tid 2 2024-03-30T12:27:33.595 INFO:tasks.rados.rados.0.smithi084.stdout:1517: done (2 left) 2024-03-30T12:27:33.595 INFO:tasks.rados.rados.0.smithi084.stdout:1520: delete oid 1 current snap is 152 2024-03-30T12:27:33.595 INFO:tasks.rados.rados.0.smithi084.stdout:1518: finishing write tid 1 to smithi08477944-39 2024-03-30T12:27:33.596 INFO:tasks.rados.rados.0.smithi084.stdout:1518: finishing write tid 2 to smithi08477944-39 2024-03-30T12:27:33.596 INFO:tasks.rados.rados.0.smithi084.stdout:1518: finishing write tid 3 to smithi08477944-39 2024-03-30T12:27:33.596 INFO:tasks.rados.rados.0.smithi084.stdout:1518: finishing write tid 4 to smithi08477944-39 2024-03-30T12:27:33.596 INFO:tasks.rados.rados.0.smithi084.stdout:1518: oid 39 updating version 0 to 675 2024-03-30T12:27:33.596 INFO:tasks.rados.rados.0.smithi084.stdout:1518: oid 39 updating version 675 to 677 2024-03-30T12:27:33.596 INFO:tasks.rados.rados.0.smithi084.stdout:1518: oid 39 version 677 is already newer than 676 2024-03-30T12:27:33.596 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 677 (ObjNum 483 snap 152 seq_num 483) dirty exists 2024-03-30T12:27:33.596 INFO:tasks.rados.rados.0.smithi084.stdout:1518: left oid 39 (ObjNum 483 snap 152 seq_num 483) 2024-03-30T12:27:33.597 INFO:tasks.rados.rados.0.smithi084.stdout:1519: finishing write tid 1 to smithi08477944-23 2024-03-30T12:27:33.598 INFO:tasks.rados.rados.0.smithi084.stdout:1518: done (2 left) 2024-03-30T12:27:33.598 INFO:tasks.rados.rados.0.smithi084.stdout:1520: done (1 left) 2024-03-30T12:27:33.598 INFO:tasks.rados.rados.0.smithi084.stdout:1521: rmattr oid 7 current snap is 152 2024-03-30T12:27:33.598 INFO:tasks.rados.rados.0.smithi084.stdout:1521: done (1 left) 2024-03-30T12:27:33.598 INFO:tasks.rados.rados.0.smithi084.stdout:1522: read oid 29 snap -1 2024-03-30T12:27:33.598 INFO:tasks.rados.rados.0.smithi084.stdout:1522: expect (ObjNum 477 snap 151 seq_num 477) 2024-03-30T12:27:33.598 INFO:tasks.rados.rados.0.smithi084.stdout:1523: snap_create 2024-03-30T12:27:33.598 INFO:tasks.rados.rados.0.smithi084.stdout:1519: finishing write tid 2 to smithi08477944-23 2024-03-30T12:27:33.598 INFO:tasks.rados.rados.0.smithi084.stdout:1519: finishing write tid 3 to smithi08477944-23 2024-03-30T12:27:33.599 INFO:tasks.rados.rados.0.smithi084.stdout:1519: finishing write tid 4 to smithi08477944-23 2024-03-30T12:27:33.599 INFO:tasks.rados.rados.0.smithi084.stdout:1519: oid 23 updating version 0 to 798 2024-03-30T12:27:33.599 INFO:tasks.rados.rados.0.smithi084.stdout:1519: oid 23 updating version 798 to 799 2024-03-30T12:27:33.599 INFO:tasks.rados.rados.0.smithi084.stdout:1519: oid 23 version 799 is already newer than 797 2024-03-30T12:27:33.599 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 799 (ObjNum 484 snap 152 seq_num 484) dirty exists 2024-03-30T12:27:33.599 INFO:tasks.rados.rados.0.smithi084.stdout:1519: left oid 23 (ObjNum 484 snap 152 seq_num 484) 2024-03-30T12:27:33.601 INFO:tasks.rados.rados.0.smithi084.stdout:1522: expect (ObjNum 477 snap 151 seq_num 477) 2024-03-30T12:27:33.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:33 smithi162 ceph-mon[83709]: osdmap e373: 8 total, 8 up, 8 in 2024-03-30T12:27:33.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:33.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:33.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:33.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:33.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:33.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:33.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:33 smithi162 ceph-mon[83709]: pgmap v242: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 196 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2024-03-30T12:27:33.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:33.381+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:33.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:33.381+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:33.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:33 smithi084 ceph-mon[89279]: osdmap e373: 8 total, 8 up, 8 in 2024-03-30T12:27:33.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:33.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:33.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:33.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:33.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:33.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:33.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:33 smithi084 ceph-mon[89279]: pgmap v242: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 196 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2024-03-30T12:27:33.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:33 smithi084 ceph-mon[91810]: osdmap e373: 8 total, 8 up, 8 in 2024-03-30T12:27:33.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:33.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:33.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:33.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:33.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:33.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:33.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:33 smithi084 ceph-mon[91810]: pgmap v242: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 196 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2024-03-30T12:27:33.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:33.377+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:33.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:33.377+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:33.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:33.378+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:33.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:33.378+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:33.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:33.378+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:33.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:33.378+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:34.372 INFO:tasks.rados.rados.0.smithi084.stdout:1519: done (2 left) 2024-03-30T12:27:34.372 INFO:tasks.rados.rados.0.smithi084.stdout:1522: done (1 left) 2024-03-30T12:27:34.372 INFO:tasks.rados.rados.0.smithi084.stdout:1523: done (0 left) 2024-03-30T12:27:34.373 INFO:tasks.rados.rados.0.smithi084.stdout:1524: read oid 33 snap -1 2024-03-30T12:27:34.373 INFO:tasks.rados.rados.0.smithi084.stdout:1524: expect (ObjNum 406 snap 128 seq_num 406) 2024-03-30T12:27:34.373 INFO:tasks.rados.rados.0.smithi084.stdout:1525: snap_remove snap 151 2024-03-30T12:27:34.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:34 smithi162 ceph-mon[83709]: osdmap e374: 8 total, 8 up, 8 in 2024-03-30T12:27:34.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:34.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:34.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:34.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:34.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:34.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:34.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:34.385+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:34.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:34.385+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:34.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:34 smithi084 ceph-mon[91810]: osdmap e374: 8 total, 8 up, 8 in 2024-03-30T12:27:34.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:34.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:34.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:34.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:34.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:34.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:34.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:34.382+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:34.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:34.382+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:34.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:34.382+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:34.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:34.383+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:34.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:34.384+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:34.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:34 smithi084 ceph-mon[89279]: osdmap e374: 8 total, 8 up, 8 in 2024-03-30T12:27:34.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:34.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:34.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:34.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:34.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:34.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:35.382 INFO:tasks.rados.rados.0.smithi084.stdout:1525: done (1 left) 2024-03-30T12:27:35.382 INFO:tasks.rados.rados.0.smithi084.stdout:1526: snap_create 2024-03-30T12:27:35.382 INFO:tasks.rados.rados.0.smithi084.stdout:1524: expect (ObjNum 406 snap 128 seq_num 406) 2024-03-30T12:27:35.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:35.394+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:35.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:35.394+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:35.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-mon[89279]: osdmap e375: 8 total, 8 up, 8 in 2024-03-30T12:27:35.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:35.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:35.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:35.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:35.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:35.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:35.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-mon[89279]: pgmap v245: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 200 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.0 MiB/s wr, 20 op/s 2024-03-30T12:27:35.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:35.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-mon[91810]: osdmap e375: 8 total, 8 up, 8 in 2024-03-30T12:27:35.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:35.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:35.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:35.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:35.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:35.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:35.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-mon[91810]: pgmap v245: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 200 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.0 MiB/s wr, 20 op/s 2024-03-30T12:27:35.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:35.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:35 smithi162 ceph-mon[83709]: osdmap e375: 8 total, 8 up, 8 in 2024-03-30T12:27:35.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:35.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:35.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:35.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:35.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:35.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:35.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:35 smithi162 ceph-mon[83709]: pgmap v245: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 200 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.0 MiB/s wr, 20 op/s 2024-03-30T12:27:35.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:35 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:36.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:35.956+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:36.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:35.956+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:36.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:35.956+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:36.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:35.956+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:36.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:35.956+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:36.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:35.956+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:36.386 INFO:tasks.rados.rados.0.smithi084.stdout:1524: done (1 left) 2024-03-30T12:27:36.386 INFO:tasks.rados.rados.0.smithi084.stdout:1526: done (0 left) 2024-03-30T12:27:36.386 INFO:tasks.rados.rados.0.smithi084.stdout:1527: snap_remove snap 149 2024-03-30T12:27:36.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:36 smithi084 ceph-mon[91810]: osdmap e376: 8 total, 8 up, 8 in 2024-03-30T12:27:36.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:36.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:36.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:36 smithi084 ceph-mon[89279]: osdmap e376: 8 total, 8 up, 8 in 2024-03-30T12:27:36.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:36.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:36.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:36.389+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:36.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:36.389+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:36.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:36.389+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:36.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:36.390+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:36.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:36.390+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:36.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:36 smithi162 ceph-mon[83709]: osdmap e376: 8 total, 8 up, 8 in 2024-03-30T12:27:36.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:36.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:37.388 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:37.097+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:37.388 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:37.097+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:37.402 INFO:tasks.rados.rados.0.smithi084.stdout:1527: done (0 left) 2024-03-30T12:27:37.402 INFO:tasks.rados.rados.0.smithi084.stdout:1528: read oid 38 snap 145 2024-03-30T12:27:37.402 INFO:tasks.rados.rados.0.smithi084.stdout:1528: expect (ObjNum 379 snap 120 seq_num 379) 2024-03-30T12:27:37.402 INFO:tasks.rados.rados.0.smithi084.stdout:1529: rmattr oid 15 current snap is 154 2024-03-30T12:27:37.402 INFO:tasks.rados.rados.0.smithi084.stdout:1529: done (1 left) 2024-03-30T12:27:37.402 INFO:tasks.rados.rados.0.smithi084.stdout:1530: read oid 2 snap -1 2024-03-30T12:27:37.403 INFO:tasks.rados.rados.0.smithi084.stdout:1530: expect (ObjNum 480 snap 152 seq_num 480) 2024-03-30T12:27:37.403 INFO:tasks.rados.rados.0.smithi084.stdout:1531: copy_from oid 13 from oid 7 current snap is 154 2024-03-30T12:27:37.403 INFO:tasks.rados.rados.0.smithi084.stdout:1532: rollback oid 30 current snap is 154 2024-03-30T12:27:37.403 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 30 to 141 2024-03-30T12:27:37.403 INFO:tasks.rados.rados.0.smithi084.stdout:1533: read oid 12 snap -1 2024-03-30T12:27:37.403 INFO:tasks.rados.rados.0.smithi084.stdout:1533: expect (ObjNum 455 snap 142 seq_num 455) 2024-03-30T12:27:37.403 INFO:tasks.rados.rados.0.smithi084.stdout:1534: delete oid 15 current snap is 154 2024-03-30T12:27:37.411 INFO:tasks.rados.rados.0.smithi084.stdout:1534: done (5 left) 2024-03-30T12:27:37.411 INFO:tasks.rados.rados.0.smithi084.stdout:1535: rollback oid 45 current snap is 154 2024-03-30T12:27:37.411 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 45 to 145 2024-03-30T12:27:37.411 INFO:tasks.rados.rados.0.smithi084.stdout:1536: delete oid 33 current snap is 154 2024-03-30T12:27:37.412 INFO:tasks.rados.rados.0.smithi084.stdout:1532: finishing rollback tid 0 to smithi08477944-30 2024-03-30T12:27:37.413 INFO:tasks.rados.rados.0.smithi084.stdout:1532: finishing rollback tid 1 to smithi08477944-30 2024-03-30T12:27:37.413 INFO:tasks.rados.rados.0.smithi084.stdout:1532: finishing rollback tid 2 to smithi08477944-30 2024-03-30T12:27:37.413 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 564 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:27:37.413 INFO:tasks.rados.rados.0.smithi084.stdout:1531: finishing copy_from to smithi08477944-13 2024-03-30T12:27:37.413 INFO:tasks.rados.rados.0.smithi084.stdout:1531: got expected ENOENT (src dne) 2024-03-30T12:27:37.415 INFO:tasks.rados.rados.0.smithi084.stdout:1531: finishing copy_from racing read to smithi08477944-13 2024-03-30T12:27:37.415 INFO:tasks.rados.rados.0.smithi084.stdout:1531: done (6 left) 2024-03-30T12:27:37.415 INFO:tasks.rados.rados.0.smithi084.stdout:1532: done (5 left) 2024-03-30T12:27:37.415 INFO:tasks.rados.rados.0.smithi084.stdout:1536: done (4 left) 2024-03-30T12:27:37.415 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 154 2024-03-30T12:27:37.415 INFO:tasks.rados.rados.0.smithi084.stdout:1537: seq_num 488 ranges {2031616=581632,2613248=401408} 2024-03-30T12:27:37.430 INFO:tasks.rados.rados.0.smithi084.stdout:1537: writing smithi08477944-13 from 2031616 to 2613248 tid 1 2024-03-30T12:27:37.432 INFO:tasks.rados.rados.0.smithi084.stdout:1537: writing smithi08477944-13 from 2613248 to 3014656 tid 2 2024-03-30T12:27:37.432 INFO:tasks.rados.rados.0.smithi084.stdout:1538: snap_remove snap 142 2024-03-30T12:27:37.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:37.413+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:37.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:37.418+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:37.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:37.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:37.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:37.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:37.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:37.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:37.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:37.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:37.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-mon[89279]: osdmap e377: 8 total, 8 up, 8 in 2024-03-30T12:27:37.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-mon[89279]: pgmap v248: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 213 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 927 KiB/s rd, 4.3 MiB/s wr, 21 op/s 2024-03-30T12:27:37.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:37.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:37.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:37.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:37.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:37.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:37.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:37.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:37.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-mon[91810]: osdmap e377: 8 total, 8 up, 8 in 2024-03-30T12:27:37.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-mon[91810]: pgmap v248: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 213 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 927 KiB/s rd, 4.3 MiB/s wr, 21 op/s 2024-03-30T12:27:37.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:37.408+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:37.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:37.408+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:37.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:37.408+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:37.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:37.408+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:37.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:37.408+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:37.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:37.408+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:37.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:37.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:37.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:37.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:37.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:37.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:37.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:37.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:37.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:37 smithi162 ceph-mon[83709]: osdmap e377: 8 total, 8 up, 8 in 2024-03-30T12:27:37.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:37 smithi162 ceph-mon[83709]: pgmap v248: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 213 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 927 KiB/s rd, 4.3 MiB/s wr, 21 op/s 2024-03-30T12:27:38.406 INFO:tasks.rados.rados.0.smithi084.stdout:1538: done (5 left) 2024-03-30T12:27:38.407 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 154 2024-03-30T12:27:38.407 INFO:tasks.rados.rados.0.smithi084.stdout:1539: seq_num 489 ranges {7708672=598016,8306688=401408} 2024-03-30T12:27:38.451 INFO:tasks.rados.rados.0.smithi084.stdout:1539: writing smithi08477944-36 from 7708672 to 8306688 tid 1 2024-03-30T12:27:38.454 INFO:tasks.rados.rados.0.smithi084.stdout:1539: writing smithi08477944-36 from 8306688 to 8708096 tid 2 2024-03-30T12:27:38.454 INFO:tasks.rados.rados.0.smithi084.stdout:1540: read oid 34 snap -1 2024-03-30T12:27:38.454 INFO:tasks.rados.rados.0.smithi084.stdout:1540: expect (ObjNum 218 snap 64 seq_num 218) 2024-03-30T12:27:38.454 INFO:tasks.rados.rados.0.smithi084.stdout:1541: snap_remove snap 153 2024-03-30T12:27:38.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:38.418+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:38.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:38.419+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:38.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:38.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:38.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:38 smithi084 ceph-mon[89279]: osdmap e378: 8 total, 8 up, 8 in 2024-03-30T12:27:38.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:38.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:38.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:38.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:38.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:38.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:38.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:38.413+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:38.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:38.413+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:38.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:38.413+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:38.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:38.413+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:38.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:38.413+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:38.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:38.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:38.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:38 smithi084 ceph-mon[91810]: osdmap e378: 8 total, 8 up, 8 in 2024-03-30T12:27:38.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:38.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:38.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:38.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:38.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:38.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:38.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:38.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:38.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:38 smithi162 ceph-mon[83709]: osdmap e378: 8 total, 8 up, 8 in 2024-03-30T12:27:38.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:38.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset c7=[]:{} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:38.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:38.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:38.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:38.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:39.418 INFO:tasks.rados.rados.0.smithi084.stdout:1541: done (7 left) 2024-03-30T12:27:39.418 INFO:tasks.rados.rados.0.smithi084.stdout:1542: snap_remove snap 147 2024-03-30T12:27:39.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:39.426+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:39.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:39.426+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:39.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:27:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:27:39] "GET /metrics HTTP/1.1" 200 36280 "" "Prometheus/2.43.0" 2024-03-30T12:27:39.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:39.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:39.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:39.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:39 smithi084 ceph-mon[89279]: osdmap e379: 8 total, 8 up, 8 in 2024-03-30T12:27:39.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:39.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:39.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:39.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:39 smithi084 ceph-mon[89279]: pgmap v251: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 213 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 8.8 MiB/s rd, 3.4 MiB/s wr, 12 op/s 2024-03-30T12:27:39.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:39.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:39.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:39.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:39 smithi084 ceph-mon[91810]: osdmap e379: 8 total, 8 up, 8 in 2024-03-30T12:27:39.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:39.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:39.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:39.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:39 smithi084 ceph-mon[91810]: pgmap v251: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 213 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 8.8 MiB/s rd, 3.4 MiB/s wr, 12 op/s 2024-03-30T12:27:39.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:39.423+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:39.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:39.423+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:39.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:39.424+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:39.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:39.424+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:39.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:39.424+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:39.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:39.424+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:39.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:39.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:39.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:39.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:39 smithi162 ceph-mon[83709]: osdmap e379: 8 total, 8 up, 8 in 2024-03-30T12:27:39.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:39.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:39.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:39.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:39 smithi162 ceph-mon[83709]: pgmap v251: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 213 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 8.8 MiB/s rd, 3.4 MiB/s wr, 12 op/s 2024-03-30T12:27:40.417 INFO:tasks.rados.rados.0.smithi084.stdout:1542: done (7 left) 2024-03-30T12:27:40.417 INFO:tasks.rados.rados.0.smithi084.stdout:1543: rmattr oid 49 current snap is 154 2024-03-30T12:27:40.417 INFO:tasks.rados.rados.0.smithi084.stdout:1543: done (7 left) 2024-03-30T12:27:40.417 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 154 2024-03-30T12:27:40.417 INFO:tasks.rados.rados.0.smithi084.stdout:1535: finishing rollback tid 0 to smithi08477944-45 2024-03-30T12:27:40.417 INFO:tasks.rados.rados.0.smithi084.stdout:1544: seq_num 490 ranges {540672=614400,1155072=401408} 2024-03-30T12:27:40.423 INFO:tasks.rados.rados.0.smithi084.stdout:1544: writing smithi08477944-19 from 540672 to 1155072 tid 1 2024-03-30T12:27:40.427 INFO:tasks.rados.rados.0.smithi084.stdout:1544: writing smithi08477944-19 from 1155072 to 1556480 tid 2 2024-03-30T12:27:40.427 INFO:tasks.rados.rados.0.smithi084.stdout:1545: read oid 48 snap -1 2024-03-30T12:27:40.427 INFO:tasks.rados.rados.0.smithi084.stdout:1545: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:27:40.427 INFO:tasks.rados.rados.0.smithi084.stdout:1546: copy_from oid 11 from oid 43 current snap is 154 2024-03-30T12:27:40.427 INFO:tasks.rados.rados.0.smithi084.stdout:1547: read oid 6 snap -1 2024-03-30T12:27:40.427 INFO:tasks.rados.rados.0.smithi084.stdout:1547: expect (ObjNum 218 snap 64 seq_num 218) 2024-03-30T12:27:40.427 INFO:tasks.rados.rados.0.smithi084.stdout:1548: rollback oid 3 current snap is 154 2024-03-30T12:27:40.427 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 3 to 150 2024-03-30T12:27:40.427 INFO:tasks.rados.rados.0.smithi084.stdout:1549: read oid 21 snap -1 2024-03-30T12:27:40.428 INFO:tasks.rados.rados.0.smithi084.stdout:1549: expect deleted 2024-03-30T12:27:40.428 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 31 current snap is 154 2024-03-30T12:27:40.428 INFO:tasks.rados.rados.0.smithi084.stdout:1550: seq_num 491 ranges {4456448=630784,5087232=401408} 2024-03-30T12:27:40.455 INFO:tasks.rados.rados.0.smithi084.stdout:1550: writing smithi08477944-31 from 4456448 to 5087232 tid 1 2024-03-30T12:27:40.457 INFO:tasks.rados.rados.0.smithi084.stdout:1550: writing smithi08477944-31 from 5087232 to 5488640 tid 2 2024-03-30T12:27:40.458 INFO:tasks.rados.rados.0.smithi084.stdout:1551: rollback oid 41 current snap is 154 2024-03-30T12:27:40.458 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 41 to 141 2024-03-30T12:27:40.458 INFO:tasks.rados.rados.0.smithi084.stdout:1535: finishing rollback tid 1 to smithi08477944-45 2024-03-30T12:27:40.458 INFO:tasks.rados.rados.0.smithi084.stdout:1535: finishing rollback tid 2 to smithi08477944-45 2024-03-30T12:27:40.458 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 886 (ObjNum 396 snap 125 seq_num 396) dirty exists 2024-03-30T12:27:40.458 INFO:tasks.rados.rados.0.smithi084.stdout:1528: expect (ObjNum 379 snap 120 seq_num 379) 2024-03-30T12:27:40.562 INFO:tasks.rados.rados.0.smithi084.stdout:1533: expect (ObjNum 455 snap 142 seq_num 455) 2024-03-30T12:27:40.723 INFO:tasks.rados.rados.0.smithi084.stdout:1530: expect (ObjNum 480 snap 152 seq_num 480) 2024-03-30T12:27:40.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:40.433+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:40.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:40.433+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:40.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:40.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:40.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:40.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:40.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:40 smithi084 ceph-mon[91810]: osdmap e380: 8 total, 8 up, 8 in 2024-03-30T12:27:40.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:40.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:40 smithi084 ceph-mon[89279]: osdmap e380: 8 total, 8 up, 8 in 2024-03-30T12:27:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:40.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:40.445+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:40.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:40.445+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:40.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:40.445+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:40.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:40.446+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:40.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:40.446+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:40.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:40.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:40.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:40.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:40.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:40 smithi162 ceph-mon[83709]: osdmap e380: 8 total, 8 up, 8 in 2024-03-30T12:27:40.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:40.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:41.148 INFO:tasks.rados.rados.0.smithi084.stdout:1537: finishing write tid 1 to smithi08477944-13 2024-03-30T12:27:41.149 INFO:tasks.rados.rados.0.smithi084.stdout:1537: finishing write tid 2 to smithi08477944-13 2024-03-30T12:27:41.149 INFO:tasks.rados.rados.0.smithi084.stdout:1537: finishing write tid 3 to smithi08477944-13 2024-03-30T12:27:41.149 INFO:tasks.rados.rados.0.smithi084.stdout:1537: finishing write tid 4 to smithi08477944-13 2024-03-30T12:27:41.149 INFO:tasks.rados.rados.0.smithi084.stdout:1537: oid 13 updating version 0 to 278 2024-03-30T12:27:41.149 INFO:tasks.rados.rados.0.smithi084.stdout:1537: oid 13 version 278 is already newer than 277 2024-03-30T12:27:41.149 INFO:tasks.rados.rados.0.smithi084.stdout:1537: oid 13 version 278 is already newer than 276 2024-03-30T12:27:41.149 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 278 (ObjNum 488 snap 154 seq_num 488) dirty exists 2024-03-30T12:27:41.149 INFO:tasks.rados.rados.0.smithi084.stdout:1537: left oid 13 (ObjNum 488 snap 154 seq_num 488) 2024-03-30T12:27:41.149 INFO:tasks.rados.rados.0.smithi084.stdout:1539: finishing write tid 1 to smithi08477944-36 2024-03-30T12:27:41.149 INFO:tasks.rados.rados.0.smithi084.stdout:1528: done (14 left) 2024-03-30T12:27:41.149 INFO:tasks.rados.rados.0.smithi084.stdout:1530: done (13 left) 2024-03-30T12:27:41.149 INFO:tasks.rados.rados.0.smithi084.stdout:1533: done (12 left) 2024-03-30T12:27:41.149 INFO:tasks.rados.rados.0.smithi084.stdout:1535: done (11 left) 2024-03-30T12:27:41.149 INFO:tasks.rados.rados.0.smithi084.stdout:1537: done (10 left) 2024-03-30T12:27:41.150 INFO:tasks.rados.rados.0.smithi084.stdout:1552: snap_remove snap 145 2024-03-30T12:27:41.437 INFO:tasks.rados.rados.0.smithi084.stdout:1552: done (10 left) 2024-03-30T12:27:41.438 INFO:tasks.rados.rados.0.smithi084.stdout:1553: rollback oid 30 current snap is 154 2024-03-30T12:27:41.438 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 30 to 150 2024-03-30T12:27:41.439 INFO:tasks.rados.rados.0.smithi084.stdout:1539: finishing write tid 2 to smithi08477944-36 2024-03-30T12:27:41.439 INFO:tasks.rados.rados.0.smithi084.stdout:1539: finishing write tid 3 to smithi08477944-36 2024-03-30T12:27:41.439 INFO:tasks.rados.rados.0.smithi084.stdout:1539: finishing write tid 4 to smithi08477944-36 2024-03-30T12:27:41.439 INFO:tasks.rados.rados.0.smithi084.stdout:1539: oid 36 updating version 0 to 801 2024-03-30T12:27:41.439 INFO:tasks.rados.rados.0.smithi084.stdout:1539: oid 36 updating version 801 to 802 2024-03-30T12:27:41.439 INFO:tasks.rados.rados.0.smithi084.stdout:1539: oid 36 version 802 is already newer than 800 2024-03-30T12:27:41.439 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 802 (ObjNum 489 snap 154 seq_num 489) dirty exists 2024-03-30T12:27:41.440 INFO:tasks.rados.rados.0.smithi084.stdout:1539: left oid 36 (ObjNum 489 snap 154 seq_num 489) 2024-03-30T12:27:41.440 INFO:tasks.rados.rados.0.smithi084.stdout:1540: expect (ObjNum 218 snap 64 seq_num 218) 2024-03-30T12:27:41.470 INFO:tasks.rados.rados.0.smithi084.stdout:1539: done (10 left) 2024-03-30T12:27:41.470 INFO:tasks.rados.rados.0.smithi084.stdout:1540: done (9 left) 2024-03-30T12:27:41.470 INFO:tasks.rados.rados.0.smithi084.stdout:1549: done (8 left) 2024-03-30T12:27:41.470 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 154 2024-03-30T12:27:41.471 INFO:tasks.rados.rados.0.smithi084.stdout:1545: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:27:41.471 INFO:tasks.rados.rados.0.smithi084.stdout:1544: finishing write tid 1 to smithi08477944-19 2024-03-30T12:27:41.471 INFO:tasks.rados.rados.0.smithi084.stdout:1544: finishing write tid 2 to smithi08477944-19 2024-03-30T12:27:41.471 INFO:tasks.rados.rados.0.smithi084.stdout:1548: finishing rollback tid 0 to smithi08477944-3 2024-03-30T12:27:41.471 INFO:tasks.rados.rados.0.smithi084.stdout:1548: finishing rollback tid 1 to smithi08477944-3 2024-03-30T12:27:41.471 INFO:tasks.rados.rados.0.smithi084.stdout:1548: finishing rollback tid 2 to smithi08477944-3 2024-03-30T12:27:41.471 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 828 (ObjNum 405 snap 128 seq_num 405) dirty exists 2024-03-30T12:27:41.471 INFO:tasks.rados.rados.0.smithi084.stdout:1544: finishing write tid 3 to smithi08477944-19 2024-03-30T12:27:41.471 INFO:tasks.rados.rados.0.smithi084.stdout:1547: expect (ObjNum 218 snap 64 seq_num 218) 2024-03-30T12:27:41.504 INFO:tasks.rados.rados.0.smithi084.stdout:1544: finishing write tid 4 to smithi08477944-19 2024-03-30T12:27:41.504 INFO:tasks.rados.rados.0.smithi084.stdout:1544: oid 19 updating version 0 to 662 2024-03-30T12:27:41.504 INFO:tasks.rados.rados.0.smithi084.stdout:1544: oid 19 updating version 662 to 663 2024-03-30T12:27:41.504 INFO:tasks.rados.rados.0.smithi084.stdout:1544: oid 19 updating version 663 to 664 2024-03-30T12:27:41.504 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 664 (ObjNum 490 snap 154 seq_num 490) dirty exists 2024-03-30T12:27:41.505 INFO:tasks.rados.rados.0.smithi084.stdout:1544: left oid 19 (ObjNum 490 snap 154 seq_num 490) 2024-03-30T12:27:41.505 INFO:tasks.rados.rados.0.smithi084.stdout:1546: finishing copy_from racing read to smithi08477944-11 2024-03-30T12:27:41.505 INFO:tasks.rados.rados.0.smithi084.stdout:1546: finishing copy_from to smithi08477944-11 2024-03-30T12:27:41.505 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 548 (ObjNum 280 snap 90 seq_num 280) dirty exists 2024-03-30T12:27:41.505 INFO:tasks.rados.rados.0.smithi084.stdout:1550: finishing write tid 1 to smithi08477944-31 2024-03-30T12:27:41.505 INFO:tasks.rados.rados.0.smithi084.stdout:1554: seq_num 492 ranges {2318336=647168,2965504=401408} 2024-03-30T12:27:41.519 INFO:tasks.rados.rados.0.smithi084.stdout:1554: writing smithi08477944-10 from 2318336 to 2965504 tid 1 2024-03-30T12:27:41.521 INFO:tasks.rados.rados.0.smithi084.stdout:1554: writing smithi08477944-10 from 2965504 to 3366912 tid 2 2024-03-30T12:27:41.521 INFO:tasks.rados.rados.0.smithi084.stdout:1544: done (8 left) 2024-03-30T12:27:41.521 INFO:tasks.rados.rados.0.smithi084.stdout:1545: done (7 left) 2024-03-30T12:27:41.521 INFO:tasks.rados.rados.0.smithi084.stdout:1546: done (6 left) 2024-03-30T12:27:41.522 INFO:tasks.rados.rados.0.smithi084.stdout:1547: done (5 left) 2024-03-30T12:27:41.522 INFO:tasks.rados.rados.0.smithi084.stdout:1548: done (4 left) 2024-03-30T12:27:41.522 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 42 current snap is 154 2024-03-30T12:27:41.522 INFO:tasks.rados.rados.0.smithi084.stdout:1550: finishing write tid 2 to smithi08477944-31 2024-03-30T12:27:41.522 INFO:tasks.rados.rados.0.smithi084.stdout:1550: finishing write tid 3 to smithi08477944-31 2024-03-30T12:27:41.522 INFO:tasks.rados.rados.0.smithi084.stdout:1555: seq_num 493 ranges {5464064=663552,6127616=401408} 2024-03-30T12:27:41.553 INFO:tasks.rados.rados.0.smithi084.stdout:1555: writing smithi08477944-42 from 5464064 to 6127616 tid 1 2024-03-30T12:27:41.556 INFO:tasks.rados.rados.0.smithi084.stdout:1555: writing smithi08477944-42 from 6127616 to 6529024 tid 2 2024-03-30T12:27:41.556 INFO:tasks.rados.rados.0.smithi084.stdout:1556: snap_create 2024-03-30T12:27:41.556 INFO:tasks.rados.rados.0.smithi084.stdout:1551: finishing rollback tid 0 to smithi08477944-41 2024-03-30T12:27:41.556 INFO:tasks.rados.rados.0.smithi084.stdout:1551: finishing rollback tid 1 to smithi08477944-41 2024-03-30T12:27:41.556 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 889 (ObjNum 33 snap 0 seq_num 1429896264) dirty dne 2024-03-30T12:27:41.556 INFO:tasks.rados.rados.0.smithi084.stdout:1550: finishing write tid 4 to smithi08477944-31 2024-03-30T12:27:41.556 INFO:tasks.rados.rados.0.smithi084.stdout:1550: oid 31 updating version 0 to 676 2024-03-30T12:27:41.556 INFO:tasks.rados.rados.0.smithi084.stdout:1550: oid 31 updating version 676 to 677 2024-03-30T12:27:41.557 INFO:tasks.rados.rados.0.smithi084.stdout:1550: oid 31 updating version 677 to 678 2024-03-30T12:27:41.557 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 678 (ObjNum 491 snap 154 seq_num 491) dirty exists 2024-03-30T12:27:41.557 INFO:tasks.rados.rados.0.smithi084.stdout:1550: left oid 31 (ObjNum 491 snap 154 seq_num 491) 2024-03-30T12:27:41.557 INFO:tasks.rados.rados.0.smithi084.stdout:1553: finishing rollback tid 0 to smithi08477944-30 2024-03-30T12:27:41.557 INFO:tasks.rados.rados.0.smithi084.stdout:1553: finishing rollback tid 1 to smithi08477944-30 2024-03-30T12:27:41.557 INFO:tasks.rados.rados.0.smithi084.stdout:1553: finishing rollback tid 2 to smithi08477944-30 2024-03-30T12:27:41.557 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 567 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:27:41.557 INFO:tasks.rados.rados.0.smithi084.stdout:1554: finishing write tid 1 to smithi08477944-10 2024-03-30T12:27:41.557 INFO:tasks.rados.rados.0.smithi084.stdout:1554: finishing write tid 2 to smithi08477944-10 2024-03-30T12:27:41.557 INFO:tasks.rados.rados.0.smithi084.stdout:1554: finishing write tid 3 to smithi08477944-10 2024-03-30T12:27:41.557 INFO:tasks.rados.rados.0.smithi084.stdout:1554: finishing write tid 4 to smithi08477944-10 2024-03-30T12:27:41.557 INFO:tasks.rados.rados.0.smithi084.stdout:1554: oid 10 updating version 0 to 788 2024-03-30T12:27:41.557 INFO:tasks.rados.rados.0.smithi084.stdout:1554: oid 10 updating version 788 to 789 2024-03-30T12:27:41.558 INFO:tasks.rados.rados.0.smithi084.stdout:1554: oid 10 version 789 is already newer than 787 2024-03-30T12:27:41.558 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 789 (ObjNum 492 snap 154 seq_num 492) dirty exists 2024-03-30T12:27:41.558 INFO:tasks.rados.rados.0.smithi084.stdout:1554: left oid 10 (ObjNum 492 snap 154 seq_num 492) 2024-03-30T12:27:41.558 INFO:tasks.rados.rados.0.smithi084.stdout:1555: finishing write tid 1 to smithi08477944-42 2024-03-30T12:27:41.558 INFO:tasks.rados.rados.0.smithi084.stdout:1555: finishing write tid 2 to smithi08477944-42 2024-03-30T12:27:41.559 INFO:tasks.rados.rados.0.smithi084.stdout:1555: finishing write tid 3 to smithi08477944-42 2024-03-30T12:27:41.559 INFO:tasks.rados.rados.0.smithi084.stdout:1555: finishing write tid 4 to smithi08477944-42 2024-03-30T12:27:41.559 INFO:tasks.rados.rados.0.smithi084.stdout:1555: oid 42 updating version 0 to 680 2024-03-30T12:27:41.559 INFO:tasks.rados.rados.0.smithi084.stdout:1555: oid 42 version 680 is already newer than 679 2024-03-30T12:27:41.559 INFO:tasks.rados.rados.0.smithi084.stdout:1555: oid 42 updating version 680 to 681 2024-03-30T12:27:41.559 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 681 (ObjNum 493 snap 154 seq_num 493) dirty exists 2024-03-30T12:27:41.559 INFO:tasks.rados.rados.0.smithi084.stdout:1555: left oid 42 (ObjNum 493 snap 154 seq_num 493) 2024-03-30T12:27:41.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:41.446+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:41.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:41.446+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:41.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:41 smithi084 ceph-mon[89279]: osdmap e381: 8 total, 8 up, 8 in 2024-03-30T12:27:41.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:41.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:41.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:41.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:41.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:41.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:41.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:41 smithi084 ceph-mon[89279]: pgmap v254: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 215 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2024-03-30T12:27:41.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:41 smithi084 ceph-mon[91810]: osdmap e381: 8 total, 8 up, 8 in 2024-03-30T12:27:41.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:41.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:41.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:41.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:41.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:41.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:41.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:41 smithi084 ceph-mon[91810]: pgmap v254: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 215 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2024-03-30T12:27:41.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:41.439+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:41.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:41.439+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:41.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:41.440+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:41.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:41.440+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:41.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:41.440+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:41.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:41.440+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:41.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:41 smithi162 ceph-mon[83709]: osdmap e381: 8 total, 8 up, 8 in 2024-03-30T12:27:41.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:41.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:41.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:41.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:41.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:41.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:41.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:41 smithi162 ceph-mon[83709]: pgmap v254: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 215 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2024-03-30T12:27:42.436 INFO:tasks.rados.rados.0.smithi084.stdout:1550: done (5 left) 2024-03-30T12:27:42.436 INFO:tasks.rados.rados.0.smithi084.stdout:1551: done (4 left) 2024-03-30T12:27:42.436 INFO:tasks.rados.rados.0.smithi084.stdout:1553: done (3 left) 2024-03-30T12:27:42.436 INFO:tasks.rados.rados.0.smithi084.stdout:1554: done (2 left) 2024-03-30T12:27:42.436 INFO:tasks.rados.rados.0.smithi084.stdout:1555: done (1 left) 2024-03-30T12:27:42.437 INFO:tasks.rados.rados.0.smithi084.stdout:1556: done (0 left) 2024-03-30T12:27:42.437 INFO:tasks.rados.rados.0.smithi084.stdout:1557: delete oid 50 current snap is 155 2024-03-30T12:27:42.443 INFO:tasks.rados.rados.0.smithi084.stdout:1557: done (0 left) 2024-03-30T12:27:42.443 INFO:tasks.rados.rados.0.smithi084.stdout:1558: rmattr oid 47 current snap is 155 2024-03-30T12:27:42.443 INFO:tasks.rados.rados.0.smithi084.stdout:1559: delete oid 15 current snap is 155 2024-03-30T12:27:42.447 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 901 (ObjNum 65 snap 0 seq_num 1431335509) dirty exists 2024-03-30T12:27:42.449 INFO:tasks.rados.rados.0.smithi084.stdout:1558: done (1 left) 2024-03-30T12:27:42.449 INFO:tasks.rados.rados.0.smithi084.stdout:1559: done (0 left) 2024-03-30T12:27:42.449 INFO:tasks.rados.rados.0.smithi084.stdout:1560: snap_remove snap 154 2024-03-30T12:27:42.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:42.455+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:42.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:42.456+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:42.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:42.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:42.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:42.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:42.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:42 smithi084 ceph-mon[89279]: osdmap e382: 8 total, 8 up, 8 in 2024-03-30T12:27:42.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:42.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:42.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:42.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:42.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:42.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:42.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:42 smithi084 ceph-mon[91810]: osdmap e382: 8 total, 8 up, 8 in 2024-03-30T12:27:42.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:42.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:42.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:42.447+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:42.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:42.447+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:42.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:42.447+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:42.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:42.447+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:42.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:42.449+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:42.770 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:42.770 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:42.770 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:42.771 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:42.771 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:42 smithi162 ceph-mon[83709]: osdmap e382: 8 total, 8 up, 8 in 2024-03-30T12:27:42.771 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:42.771 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:43.441 INFO:tasks.rados.rados.0.smithi084.stdout:1560: done (0 left) 2024-03-30T12:27:43.441 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 155 2024-03-30T12:27:43.441 INFO:tasks.rados.rados.0.smithi084.stdout:1561: seq_num 496 ranges {1736704=712704,2449408=401408} 2024-03-30T12:27:43.454 INFO:tasks.rados.rados.0.smithi084.stdout:1561: writing smithi08477944-23 from 1736704 to 2449408 tid 1 2024-03-30T12:27:43.457 INFO:tasks.rados.rados.0.smithi084.stdout:1561: writing smithi08477944-23 from 2449408 to 2850816 tid 2 2024-03-30T12:27:43.457 INFO:tasks.rados.rados.0.smithi084.stdout:1562: read oid 15 snap -1 2024-03-30T12:27:43.457 INFO:tasks.rados.rados.0.smithi084.stdout:1562: expect deleted 2024-03-30T12:27:43.457 INFO:tasks.rados.rados.0.smithi084.stdout:1563: setattr oid 36 current snap is 155 2024-03-30T12:27:43.460 INFO:tasks.rados.rados.0.smithi084.stdout:1562: done (2 left) 2024-03-30T12:27:43.460 INFO:tasks.rados.rados.0.smithi084.stdout:1564: snap_create 2024-03-30T12:27:43.462 INFO:tasks.rados.rados.0.smithi084.stdout:1561: finishing write tid 1 to smithi08477944-23 2024-03-30T12:27:43.462 INFO:tasks.rados.rados.0.smithi084.stdout:1561: finishing write tid 2 to smithi08477944-23 2024-03-30T12:27:43.462 INFO:tasks.rados.rados.0.smithi084.stdout:1561: finishing write tid 3 to smithi08477944-23 2024-03-30T12:27:43.464 INFO:tasks.rados.rados.0.smithi084.stdout:1561: finishing write tid 4 to smithi08477944-23 2024-03-30T12:27:43.464 INFO:tasks.rados.rados.0.smithi084.stdout:1561: oid 23 updating version 0 to 803 2024-03-30T12:27:43.465 INFO:tasks.rados.rados.0.smithi084.stdout:1561: oid 23 updating version 803 to 804 2024-03-30T12:27:43.465 INFO:tasks.rados.rados.0.smithi084.stdout:1561: oid 23 updating version 804 to 805 2024-03-30T12:27:43.465 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 805 (ObjNum 496 snap 155 seq_num 496) dirty exists 2024-03-30T12:27:43.465 INFO:tasks.rados.rados.0.smithi084.stdout:1561: left oid 23 (ObjNum 496 snap 155 seq_num 496) 2024-03-30T12:27:43.465 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 806 (ObjNum 489 snap 154 seq_num 489) dirty exists 2024-03-30T12:27:43.626 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:43.465+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:43.627 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:43.467+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:43.627 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-mon[89279]: osdmap e383: 8 total, 8 up, 8 in 2024-03-30T12:27:43.627 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:43.627 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:43.627 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:43.627 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:43.627 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:43.628 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:43.628 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-mon[89279]: pgmap v257: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 216 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 9.0 MiB/s rd, 2.1 MiB/s wr, 9 op/s 2024-03-30T12:27:43.628 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-30T12:27:43.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-mon[91810]: osdmap e383: 8 total, 8 up, 8 in 2024-03-30T12:27:43.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:43.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:43.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:43.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:43.628 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:43.629 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:43.629 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-mon[91810]: pgmap v257: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 216 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 9.0 MiB/s rd, 2.1 MiB/s wr, 9 op/s 2024-03-30T12:27:43.629 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-30T12:27:43.629 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:43.605+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:43.629 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:43.605+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:43.629 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:43.605+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:43.629 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:43.605+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:43.629 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:43.605+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:43.629 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:43.605+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:43.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:43 smithi162 ceph-mon[83709]: osdmap e383: 8 total, 8 up, 8 in 2024-03-30T12:27:43.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:43.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:43.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:43.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:43.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:43.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:43.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:43 smithi162 ceph-mon[83709]: pgmap v257: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 216 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 9.0 MiB/s rd, 2.1 MiB/s wr, 9 op/s 2024-03-30T12:27:43.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:43 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-30T12:27:44.447 INFO:tasks.rados.rados.0.smithi084.stdout:1561: done (2 left) 2024-03-30T12:27:44.447 INFO:tasks.rados.rados.0.smithi084.stdout:1563: done (1 left) 2024-03-30T12:27:44.448 INFO:tasks.rados.rados.0.smithi084.stdout:1564: done (0 left) 2024-03-30T12:27:44.448 INFO:tasks.rados.rados.0.smithi084.stdout:1565: delete oid 2 current snap is 156 2024-03-30T12:27:44.452 INFO:tasks.rados.rados.0.smithi084.stdout:1565: done (0 left) 2024-03-30T12:27:44.452 INFO:tasks.rados.rados.0.smithi084.stdout:1566: copy_from oid 29 from oid 30 current snap is 156 2024-03-30T12:27:44.452 INFO:tasks.rados.rados.0.smithi084.stdout:1567: read oid 1 snap 155 2024-03-30T12:27:44.452 INFO:tasks.rados.rados.0.smithi084.stdout:1567: expect deleted 2024-03-30T12:27:44.452 INFO:tasks.rados.rados.0.smithi084.stdout:1568: rollback oid 17 current snap is 156 2024-03-30T12:27:44.452 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 17 to 141 2024-03-30T12:27:44.452 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 156 2024-03-30T12:27:44.453 INFO:tasks.rados.rados.0.smithi084.stdout:1569: seq_num 498 ranges {0=745472,745472=401408} 2024-03-30T12:27:44.457 INFO:tasks.rados.rados.0.smithi084.stdout:1569: writing smithi08477944-49 from 0 to 745472 tid 1 2024-03-30T12:27:44.460 INFO:tasks.rados.rados.0.smithi084.stdout:1569: writing smithi08477944-49 from 745472 to 1146880 tid 2 2024-03-30T12:27:44.460 INFO:tasks.rados.rados.0.smithi084.stdout:1570: setattr oid 5 current snap is 156 2024-03-30T12:27:44.460 INFO:tasks.rados.rados.0.smithi084.stdout:1566: finishing copy_from racing read to smithi08477944-29 2024-03-30T12:27:44.460 INFO:tasks.rados.rados.0.smithi084.stdout:1568: finishing rollback tid 1 to smithi08477944-17 2024-03-30T12:27:44.460 INFO:tasks.rados.rados.0.smithi084.stdout:1568: finishing rollback tid 2 to smithi08477944-17 2024-03-30T12:27:44.460 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 683 (ObjNum 422 snap 135 seq_num 422) dirty exists 2024-03-30T12:27:44.460 INFO:tasks.rados.rados.0.smithi084.stdout:1566: finishing copy_from to smithi08477944-29 2024-03-30T12:27:44.460 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 567 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:27:44.462 INFO:tasks.rados.rados.0.smithi084.stdout:1566: done (4 left) 2024-03-30T12:27:44.462 INFO:tasks.rados.rados.0.smithi084.stdout:1567: done (3 left) 2024-03-30T12:27:44.462 INFO:tasks.rados.rados.0.smithi084.stdout:1568: done (2 left) 2024-03-30T12:27:44.462 INFO:tasks.rados.rados.0.smithi084.stdout:1571: read oid 39 snap 155 2024-03-30T12:27:44.462 INFO:tasks.rados.rados.0.smithi084.stdout:1571: expect (ObjNum 483 snap 152 seq_num 483) 2024-03-30T12:27:44.462 INFO:tasks.rados.rados.0.smithi084.stdout:1572: rmattr oid 47 current snap is 156 2024-03-30T12:27:44.462 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 156 2024-03-30T12:27:44.462 INFO:tasks.rados.rados.0.smithi084.stdout:1573: seq_num 499 ranges {0=761856,761856=401408} 2024-03-30T12:27:44.467 INFO:tasks.rados.rados.0.smithi084.stdout:1573: writing smithi08477944-50 from 0 to 761856 tid 1 2024-03-30T12:27:44.470 INFO:tasks.rados.rados.0.smithi084.stdout:1573: writing smithi08477944-50 from 761856 to 1163264 tid 2 2024-03-30T12:27:44.470 INFO:tasks.rados.rados.0.smithi084.stdout:1574: rollback oid 17 current snap is 156 2024-03-30T12:27:44.470 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 17 to 152 2024-03-30T12:27:44.470 INFO:tasks.rados.rados.0.smithi084.stdout:1569: finishing write tid 1 to smithi08477944-49 2024-03-30T12:27:44.470 INFO:tasks.rados.rados.0.smithi084.stdout:1569: finishing write tid 2 to smithi08477944-49 2024-03-30T12:27:44.470 INFO:tasks.rados.rados.0.smithi084.stdout:1569: finishing write tid 3 to smithi08477944-49 2024-03-30T12:27:44.470 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 903 (ObjNum 2529 snap 0 seq_num 1532998208) dirty exists 2024-03-30T12:27:44.470 INFO:tasks.rados.rados.0.smithi084.stdout:1569: finishing write tid 4 to smithi08477944-49 2024-03-30T12:27:44.471 INFO:tasks.rados.rados.0.smithi084.stdout:1569: oid 49 updating version 0 to 809 2024-03-30T12:27:44.471 INFO:tasks.rados.rados.0.smithi084.stdout:1569: oid 49 version 809 is already newer than 808 2024-03-30T12:27:44.471 INFO:tasks.rados.rados.0.smithi084.stdout:1569: oid 49 version 809 is already newer than 807 2024-03-30T12:27:44.471 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 809 (ObjNum 498 snap 156 seq_num 498) dirty exists 2024-03-30T12:27:44.471 INFO:tasks.rados.rados.0.smithi084.stdout:1569: left oid 49 (ObjNum 498 snap 156 seq_num 498) 2024-03-30T12:27:44.471 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 896 (ObjNum 445 snap 141 seq_num 445) dirty exists 2024-03-30T12:27:44.471 INFO:tasks.rados.rados.0.smithi084.stdout:1571: expect (ObjNum 483 snap 152 seq_num 483) 2024-03-30T12:27:44.498 INFO:tasks.rados.rados.0.smithi084.stdout:1573: finishing write tid 1 to smithi08477944-50 2024-03-30T12:27:44.498 INFO:tasks.rados.rados.0.smithi084.stdout:1574: finishing rollback tid 0 to smithi08477944-17 2024-03-30T12:27:44.498 INFO:tasks.rados.rados.0.smithi084.stdout:1573: finishing write tid 2 to smithi08477944-50 2024-03-30T12:27:44.498 INFO:tasks.rados.rados.0.smithi084.stdout:1569: done (5 left) 2024-03-30T12:27:44.498 INFO:tasks.rados.rados.0.smithi084.stdout:1570: done (4 left) 2024-03-30T12:27:44.498 INFO:tasks.rados.rados.0.smithi084.stdout:1571: done (3 left) 2024-03-30T12:27:44.499 INFO:tasks.rados.rados.0.smithi084.stdout:1572: done (2 left) 2024-03-30T12:27:44.499 INFO:tasks.rados.rados.0.smithi084.stdout:1575: copy_from oid 34 from oid 31 current snap is 156 2024-03-30T12:27:44.499 INFO:tasks.rados.rados.0.smithi084.stdout:1573: finishing write tid 3 to smithi08477944-50 2024-03-30T12:27:44.499 INFO:tasks.rados.rados.0.smithi084.stdout:1574: finishing rollback tid 1 to smithi08477944-17 2024-03-30T12:27:44.499 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 685 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-03-30T12:27:44.499 INFO:tasks.rados.rados.0.smithi084.stdout:1573: finishing write tid 4 to smithi08477944-50 2024-03-30T12:27:44.499 INFO:tasks.rados.rados.0.smithi084.stdout:1573: oid 50 updating version 0 to 892 2024-03-30T12:27:44.499 INFO:tasks.rados.rados.0.smithi084.stdout:1573: oid 50 updating version 892 to 894 2024-03-30T12:27:44.499 INFO:tasks.rados.rados.0.smithi084.stdout:1573: oid 50 version 894 is already newer than 893 2024-03-30T12:27:44.499 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 894 (ObjNum 499 snap 156 seq_num 499) dirty exists 2024-03-30T12:27:44.499 INFO:tasks.rados.rados.0.smithi084.stdout:1573: left oid 50 (ObjNum 499 snap 156 seq_num 499) 2024-03-30T12:27:44.499 INFO:tasks.rados.rados.0.smithi084.stdout:1573: done (2 left) 2024-03-30T12:27:44.499 INFO:tasks.rados.rados.0.smithi084.stdout:1574: done (1 left) 2024-03-30T12:27:44.499 INFO:tasks.rados.rados.0.smithi084.stdout:1576: rollback oid 33 current snap is 156 2024-03-30T12:27:44.500 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 33 to 141 2024-03-30T12:27:44.500 INFO:tasks.rados.rados.0.smithi084.stdout:1577: setattr oid 2 current snap is 156 2024-03-30T12:27:44.500 INFO:tasks.rados.rados.0.smithi084.stdout:1578: read oid 6 snap -1 2024-03-30T12:27:44.501 INFO:tasks.rados.rados.0.smithi084.stdout:1578: expect (ObjNum 218 snap 64 seq_num 218) 2024-03-30T12:27:44.501 INFO:tasks.rados.rados.0.smithi084.stdout:1579: copy_from oid 43 from oid 38 current snap is 156 2024-03-30T12:27:44.501 INFO:tasks.rados.rados.0.smithi084.stdout:1580: copy_from oid 39 from oid 5 current snap is 156 2024-03-30T12:27:44.501 INFO:tasks.rados.rados.0.smithi084.stdout:1581: read oid 10 snap 155 2024-03-30T12:27:44.501 INFO:tasks.rados.rados.0.smithi084.stdout:1581: expect (ObjNum 492 snap 154 seq_num 492) 2024-03-30T12:27:44.502 INFO:tasks.rados.rados.0.smithi084.stdout:1582: read oid 25 snap 141 2024-03-30T12:27:44.502 INFO:tasks.rados.rados.0.smithi084.stdout:1582: expect (ObjNum 448 snap 141 seq_num 448) 2024-03-30T12:27:44.502 INFO:tasks.rados.rados.0.smithi084.stdout:1583: rollback oid 46 current snap is 156 2024-03-30T12:27:44.502 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 46 to 141 2024-03-30T12:27:44.502 INFO:tasks.rados.rados.0.smithi084.stdout:1584: snap_remove snap 152 2024-03-30T12:27:44.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:44.460+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:44.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:44.460+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:44.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:44.454+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:44.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:44.454+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:44.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:44.454+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:44.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:44.454+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:44.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:44.454+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:44.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:44 smithi084 ceph-mon[91810]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-30T12:27:44.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:44 smithi084 ceph-mon[91810]: Upgrade: osd.3 is safe to restart 2024-03-30T12:27:44.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:44 smithi084 ceph-mon[91810]: osdmap e384: 8 total, 8 up, 8 in 2024-03-30T12:27:44.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:44.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:44.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:44.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:44.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:44.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:44 smithi084 ceph-mon[89279]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-30T12:27:44.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:44 smithi084 ceph-mon[89279]: Upgrade: osd.3 is safe to restart 2024-03-30T12:27:44.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:44 smithi084 ceph-mon[89279]: osdmap e384: 8 total, 8 up, 8 in 2024-03-30T12:27:44.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:44.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:44.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:44.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:44.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:44.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:44.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:44 smithi162 ceph-mon[83709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-30T12:27:44.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:44 smithi162 ceph-mon[83709]: Upgrade: osd.3 is safe to restart 2024-03-30T12:27:44.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:44 smithi162 ceph-mon[83709]: osdmap e384: 8 total, 8 up, 8 in 2024-03-30T12:27:44.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:44.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:44.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:44.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:44.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:44.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:45.460 INFO:tasks.rados.rados.0.smithi084.stdout:1584: done (9 left) 2024-03-30T12:27:45.461 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 30 current snap is 156 2024-03-30T12:27:45.461 INFO:tasks.rados.rados.0.smithi084.stdout:1576: finishing rollback tid 1 to smithi08477944-33 2024-03-30T12:27:45.461 INFO:tasks.rados.rados.0.smithi084.stdout:1585: seq_num 500 ranges {0=778240,778240=401408} 2024-03-30T12:27:45.465 INFO:tasks.rados.rados.0.smithi084.stdout:1585: writing smithi08477944-30 from 0 to 778240 tid 1 2024-03-30T12:27:45.469 INFO:tasks.rados.rados.0.smithi084.stdout:1585: writing smithi08477944-30 from 778240 to 1179648 tid 2 2024-03-30T12:27:45.469 INFO:tasks.rados.rados.0.smithi084.stdout:1586: copy_from oid 28 from oid 49 current snap is 156 2024-03-30T12:27:45.469 INFO:tasks.rados.rados.0.smithi084.stdout:1576: finishing rollback tid 2 to smithi08477944-33 2024-03-30T12:27:45.469 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 905 (ObjNum 406 snap 128 seq_num 406) dirty exists 2024-03-30T12:27:45.469 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 839 (ObjNum 49 snap 0 seq_num 1533501543) dirty exists 2024-03-30T12:27:45.469 INFO:tasks.rados.rados.0.smithi084.stdout:1583: finishing rollback tid 0 to smithi08477944-46 2024-03-30T12:27:45.469 INFO:tasks.rados.rados.0.smithi084.stdout:1583: finishing rollback tid 1 to smithi08477944-46 2024-03-30T12:27:45.469 INFO:tasks.rados.rados.0.smithi084.stdout:1583: finishing rollback tid 2 to smithi08477944-46 2024-03-30T12:27:45.469 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 843 (ObjNum 300 snap 95 seq_num 300) dirty exists 2024-03-30T12:27:45.469 INFO:tasks.rados.rados.0.smithi084.stdout:1578: expect (ObjNum 218 snap 64 seq_num 218) 2024-03-30T12:27:45.504 INFO:tasks.rados.rados.0.smithi084.stdout:1581: expect (ObjNum 492 snap 154 seq_num 492) 2024-03-30T12:27:45.660 INFO:tasks.rados.rados.0.smithi084.stdout:1579: finishing copy_from racing read to smithi08477944-43 2024-03-30T12:27:45.660 INFO:tasks.rados.rados.0.smithi084.stdout:1579: finishing copy_from to smithi08477944-43 2024-03-30T12:27:45.661 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 561 (ObjNum 466 snap 148 seq_num 466) dirty exists 2024-03-30T12:27:45.661 INFO:tasks.rados.rados.0.smithi084.stdout:1575: finishing copy_from racing read to smithi08477944-34 2024-03-30T12:27:45.661 INFO:tasks.rados.rados.0.smithi084.stdout:1575: finishing copy_from to smithi08477944-34 2024-03-30T12:27:45.661 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 678 (ObjNum 491 snap 154 seq_num 491) dirty exists 2024-03-30T12:27:45.661 INFO:tasks.rados.rados.0.smithi084.stdout:1582: expect (ObjNum 448 snap 141 seq_num 448) 2024-03-30T12:27:45.730 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:45.472+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:45.730 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:45.472+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:45.731 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:45.467+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:45.731 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:45.467+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:45.731 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:45.467+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:45.731 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:45.468+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:45.731 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:45.468+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:45.731 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:45.468+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:45.731 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:45.732 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:45.732 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:45.732 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:45.732 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[91810]: osdmap e385: 8 total, 8 up, 8 in 2024-03-30T12:27:45.732 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[91810]: Upgrade: Updating osd.3 2024-03-30T12:27:45.732 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:45.732 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:45.732 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:45.732 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-30T12:27:45.732 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:27:45.732 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[91810]: Deploying daemon osd.3 on smithi084 2024-03-30T12:27:45.732 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[91810]: pgmap v260: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 217 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 496 KiB/s wr, 4 op/s 2024-03-30T12:27:45.732 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:27:45.733 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:45.733 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:45.733 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:45.733 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:45.733 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[89279]: osdmap e385: 8 total, 8 up, 8 in 2024-03-30T12:27:45.733 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[89279]: Upgrade: Updating osd.3 2024-03-30T12:27:45.733 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:45.733 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:45.733 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:45.734 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-30T12:27:45.734 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:27:45.734 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[89279]: Deploying daemon osd.3 on smithi084 2024-03-30T12:27:45.734 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[89279]: pgmap v260: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 217 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 496 KiB/s wr, 4 op/s 2024-03-30T12:27:45.734 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:27:45.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:45.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:45.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:45.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:45.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:45 smithi162 ceph-mon[83709]: osdmap e385: 8 total, 8 up, 8 in 2024-03-30T12:27:45.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:45 smithi162 ceph-mon[83709]: Upgrade: Updating osd.3 2024-03-30T12:27:45.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:45.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset d5=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:45.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:45.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-30T12:27:45.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:27:45.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:45 smithi162 ceph-mon[83709]: Deploying daemon osd.3 on smithi084 2024-03-30T12:27:45.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:45 smithi162 ceph-mon[83709]: pgmap v260: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 217 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 496 KiB/s wr, 4 op/s 2024-03-30T12:27:45.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:27:46.211 INFO:tasks.rados.rados.0.smithi084.stdout:1580: finishing copy_from racing read to smithi08477944-39 2024-03-30T12:27:46.211 INFO:tasks.rados.rados.0.smithi084.stdout:1580: finishing copy_from to smithi08477944-39 2024-03-30T12:27:46.211 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 896 (ObjNum 445 snap 141 seq_num 445) dirty exists 2024-03-30T12:27:46.211 INFO:tasks.rados.rados.0.smithi084.stdout:1585: finishing write tid 1 to smithi08477944-30 2024-03-30T12:27:46.211 INFO:tasks.rados.rados.0.smithi084.stdout:1585: finishing write tid 2 to smithi08477944-30 2024-03-30T12:27:46.212 INFO:tasks.rados.rados.0.smithi084.stdout:1585: finishing write tid 3 to smithi08477944-30 2024-03-30T12:27:46.212 INFO:tasks.rados.rados.0.smithi084.stdout:1585: finishing write tid 4 to smithi08477944-30 2024-03-30T12:27:46.212 INFO:tasks.rados.rados.0.smithi084.stdout:1585: oid 30 updating version 0 to 568 2024-03-30T12:27:46.212 INFO:tasks.rados.rados.0.smithi084.stdout:1585: oid 30 updating version 568 to 569 2024-03-30T12:27:46.212 INFO:tasks.rados.rados.0.smithi084.stdout:1585: oid 30 updating version 569 to 570 2024-03-30T12:27:46.212 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 570 (ObjNum 500 snap 156 seq_num 500) dirty exists 2024-03-30T12:27:46.212 INFO:tasks.rados.rados.0.smithi084.stdout:1585: left oid 30 (ObjNum 500 snap 156 seq_num 500) 2024-03-30T12:27:46.212 INFO:tasks.rados.rados.0.smithi084.stdout:1586: finishing copy_from racing read to smithi08477944-28 2024-03-30T12:27:46.212 INFO:tasks.rados.rados.0.smithi084.stdout:1586: finishing copy_from to smithi08477944-28 2024-03-30T12:27:46.212 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 809 (ObjNum 498 snap 156 seq_num 498) dirty exists 2024-03-30T12:27:46.212 INFO:tasks.rados.rados.0.smithi084.stdout:1575: done (10 left) 2024-03-30T12:27:46.212 INFO:tasks.rados.rados.0.smithi084.stdout:1576: done (9 left) 2024-03-30T12:27:46.212 INFO:tasks.rados.rados.0.smithi084.stdout:1577: done (8 left) 2024-03-30T12:27:46.212 INFO:tasks.rados.rados.0.smithi084.stdout:1578: done (7 left) 2024-03-30T12:27:46.213 INFO:tasks.rados.rados.0.smithi084.stdout:1579: done (6 left) 2024-03-30T12:27:46.213 INFO:tasks.rados.rados.0.smithi084.stdout:1580: done (5 left) 2024-03-30T12:27:46.213 INFO:tasks.rados.rados.0.smithi084.stdout:1581: done (4 left) 2024-03-30T12:27:46.213 INFO:tasks.rados.rados.0.smithi084.stdout:1582: done (3 left) 2024-03-30T12:27:46.213 INFO:tasks.rados.rados.0.smithi084.stdout:1583: done (2 left) 2024-03-30T12:27:46.213 INFO:tasks.rados.rados.0.smithi084.stdout:1585: done (1 left) 2024-03-30T12:27:46.213 INFO:tasks.rados.rados.0.smithi084.stdout:1586: done (0 left) 2024-03-30T12:27:46.213 INFO:tasks.rados.rados.0.smithi084.stdout:1587: setattr oid 39 current snap is 156 2024-03-30T12:27:46.214 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 156 2024-03-30T12:27:46.214 INFO:tasks.rados.rados.0.smithi084.stdout:1588: seq_num 501 ranges {557056=794624,1351680=401408} 2024-03-30T12:27:46.220 INFO:tasks.rados.rados.0.smithi084.stdout:1588: writing smithi08477944-35 from 557056 to 1351680 tid 1 2024-03-30T12:27:46.222 INFO:tasks.rados.rados.0.smithi084.stdout:1588: writing smithi08477944-35 from 1351680 to 1753088 tid 2 2024-03-30T12:27:46.222 INFO:tasks.rados.rados.0.smithi084.stdout:1589: snap_create 2024-03-30T12:27:46.222 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 897 (ObjNum 445 snap 141 seq_num 445) dirty exists 2024-03-30T12:27:46.224 INFO:tasks.rados.rados.0.smithi084.stdout:1588: finishing write tid 1 to smithi08477944-35 2024-03-30T12:27:46.224 INFO:tasks.rados.rados.0.smithi084.stdout:1588: finishing write tid 2 to smithi08477944-35 2024-03-30T12:27:46.225 INFO:tasks.rados.rados.0.smithi084.stdout:1588: finishing write tid 3 to smithi08477944-35 2024-03-30T12:27:46.226 INFO:tasks.rados.rados.0.smithi084.stdout:1588: finishing write tid 4 to smithi08477944-35 2024-03-30T12:27:46.226 INFO:tasks.rados.rados.0.smithi084.stdout:1588: oid 35 updating version 0 to 662 2024-03-30T12:27:46.226 INFO:tasks.rados.rados.0.smithi084.stdout:1588: oid 35 updating version 662 to 663 2024-03-30T12:27:46.226 INFO:tasks.rados.rados.0.smithi084.stdout:1588: oid 35 updating version 663 to 664 2024-03-30T12:27:46.226 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 664 (ObjNum 501 snap 156 seq_num 501) dirty exists 2024-03-30T12:27:46.226 INFO:tasks.rados.rados.0.smithi084.stdout:1588: left oid 35 (ObjNum 501 snap 156 seq_num 501) 2024-03-30T12:27:46.466 INFO:tasks.rados.rados.0.smithi084.stdout:1587: done (2 left) 2024-03-30T12:27:46.466 INFO:tasks.rados.rados.0.smithi084.stdout:1588: done (1 left) 2024-03-30T12:27:46.466 INFO:tasks.rados.rados.0.smithi084.stdout:1589: done (0 left) 2024-03-30T12:27:46.466 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 42 current snap is 157 2024-03-30T12:27:46.466 INFO:tasks.rados.rados.0.smithi084.stdout:1590: seq_num 502 ranges {6529024=409600,6938624=417792,7356416=385024} 2024-03-30T12:27:46.503 INFO:tasks.rados.rados.0.smithi084.stdout:1590: writing smithi08477944-42 from 6529024 to 6938624 tid 1 2024-03-30T12:27:46.506 INFO:tasks.rados.rados.0.smithi084.stdout:1590: writing smithi08477944-42 from 6938624 to 7356416 tid 2 2024-03-30T12:27:46.509 INFO:tasks.rados.rados.0.smithi084.stdout:1590: writing smithi08477944-42 from 7356416 to 7741440 tid 3 2024-03-30T12:27:46.509 INFO:tasks.rados.rados.0.smithi084.stdout:1591: snap_create 2024-03-30T12:27:46.511 INFO:tasks.rados.rados.0.smithi084.stdout:1590: finishing write tid 1 to smithi08477944-42 2024-03-30T12:27:46.511 INFO:tasks.rados.rados.0.smithi084.stdout:1590: finishing write tid 2 to smithi08477944-42 2024-03-30T12:27:46.512 INFO:tasks.rados.rados.0.smithi084.stdout:1590: finishing write tid 3 to smithi08477944-42 2024-03-30T12:27:46.513 INFO:tasks.rados.rados.0.smithi084.stdout:1590: finishing write tid 4 to smithi08477944-42 2024-03-30T12:27:46.514 INFO:tasks.rados.rados.0.smithi084.stdout:1590: finishing write tid 5 to smithi08477944-42 2024-03-30T12:27:46.514 INFO:tasks.rados.rados.0.smithi084.stdout:1590: oid 42 updating version 0 to 901 2024-03-30T12:27:46.514 INFO:tasks.rados.rados.0.smithi084.stdout:1590: oid 42 version 901 is already newer than 899 2024-03-30T12:27:46.514 INFO:tasks.rados.rados.0.smithi084.stdout:1590: oid 42 version 901 is already newer than 900 2024-03-30T12:27:46.514 INFO:tasks.rados.rados.0.smithi084.stdout:1590: oid 42 version 901 is already newer than 898 2024-03-30T12:27:46.514 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 901 (ObjNum 502 snap 157 seq_num 502) dirty exists 2024-03-30T12:27:46.514 INFO:tasks.rados.rados.0.smithi084.stdout:1590: left oid 42 (ObjNum 502 snap 157 seq_num 502) 2024-03-30T12:27:46.648 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:46.515+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:46.648 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:46.516+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:46.649 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:46.649 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:46.649 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:46.649 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:46.649 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:46 smithi084 ceph-mon[89279]: osdmap e386: 8 total, 8 up, 8 in 2024-03-30T12:27:46.649 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:46.649 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:46.649 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:46.649 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:46.649 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:46.650 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:46.650 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:46 smithi084 ceph-mon[91810]: osdmap e386: 8 total, 8 up, 8 in 2024-03-30T12:27:46.650 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:46.650 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:46.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:46.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset cb=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:46.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset d8=[]:{d8=[d8,d7,d5,d2,d0,cd,cc]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:46.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:46.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:46 smithi162 ceph-mon[83709]: osdmap e386: 8 total, 8 up, 8 in 2024-03-30T12:27:46.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:46.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:47.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:46.930+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:47.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:46.930+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:47.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:46.931+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:47.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:46.931+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{d8=[d8,d7,d5,d2,d0,cd,cc],da=[da]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:47.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:46.931+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:47.471 INFO:tasks.rados.rados.0.smithi084.stdout:1590: done (1 left) 2024-03-30T12:27:47.471 INFO:tasks.rados.rados.0.smithi084.stdout:1591: done (0 left) 2024-03-30T12:27:47.471 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 158 2024-03-30T12:27:47.472 INFO:tasks.rados.rados.0.smithi084.stdout:1592: seq_num 503 ranges {2326528=425984,2752512=704512,3457024=98304} 2024-03-30T12:27:47.488 INFO:tasks.rados.rados.0.smithi084.stdout:1592: writing smithi08477944-18 from 2326528 to 2752512 tid 1 2024-03-30T12:27:47.491 INFO:tasks.rados.rados.0.smithi084.stdout:1592: writing smithi08477944-18 from 2752512 to 3457024 tid 2 2024-03-30T12:27:47.492 INFO:tasks.rados.rados.0.smithi084.stdout:1592: writing smithi08477944-18 from 3457024 to 3555328 tid 3 2024-03-30T12:27:47.492 INFO:tasks.rados.rados.0.smithi084.stdout:1593: snap_create 2024-03-30T12:27:47.496 INFO:tasks.rados.rados.0.smithi084.stdout:1592: finishing write tid 1 to smithi08477944-18 2024-03-30T12:27:47.496 INFO:tasks.rados.rados.0.smithi084.stdout:1592: finishing write tid 2 to smithi08477944-18 2024-03-30T12:27:47.496 INFO:tasks.rados.rados.0.smithi084.stdout:1592: finishing write tid 3 to smithi08477944-18 2024-03-30T12:27:47.497 INFO:tasks.rados.rados.0.smithi084.stdout:1592: finishing write tid 4 to smithi08477944-18 2024-03-30T12:27:47.499 INFO:tasks.rados.rados.0.smithi084.stdout:1592: finishing write tid 5 to smithi08477944-18 2024-03-30T12:27:47.499 INFO:tasks.rados.rados.0.smithi084.stdout:1592: oid 18 updating version 0 to 896 2024-03-30T12:27:47.499 INFO:tasks.rados.rados.0.smithi084.stdout:1592: oid 18 updating version 896 to 899 2024-03-30T12:27:47.499 INFO:tasks.rados.rados.0.smithi084.stdout:1592: oid 18 version 899 is already newer than 898 2024-03-30T12:27:47.499 INFO:tasks.rados.rados.0.smithi084.stdout:1592: oid 18 version 899 is already newer than 897 2024-03-30T12:27:47.499 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 899 (ObjNum 503 snap 158 seq_num 503) dirty exists 2024-03-30T12:27:47.499 INFO:tasks.rados.rados.0.smithi084.stdout:1592: left oid 18 (ObjNum 503 snap 158 seq_num 503) 2024-03-30T12:27:47.602 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:47 smithi084 ceph-mon[91810]: osdmap e387: 8 total, 8 up, 8 in 2024-03-30T12:27:47.602 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:47.602 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:47.603 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:47 smithi084 ceph-mon[91810]: pgmap v263: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 227 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 9.7 MiB/s rd, 4.3 MiB/s wr, 29 op/s 2024-03-30T12:27:47.603 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:47 smithi084 ceph-mon[89279]: osdmap e387: 8 total, 8 up, 8 in 2024-03-30T12:27:47.603 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:47.603 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:47.603 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:47 smithi084 ceph-mon[89279]: pgmap v263: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 227 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 9.7 MiB/s rd, 4.3 MiB/s wr, 29 op/s 2024-03-30T12:27:47.603 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:47.498+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:47.603 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:47.498+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:47.604 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:47.498+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{d8=[d8,d7,d5,d2,d0,cd,cc],da=[da]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:47.604 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:47.498+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:47.604 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:47.501+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:47.604 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:47.501+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:47.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:47 smithi162 ceph-mon[83709]: osdmap e387: 8 total, 8 up, 8 in 2024-03-30T12:27:47.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:47.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:47.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:47 smithi162 ceph-mon[83709]: pgmap v263: 121 pgs: 6 active+clean+snaptrim_error, 115 active+clean; 227 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 9.7 MiB/s rd, 4.3 MiB/s wr, 29 op/s 2024-03-30T12:27:47.888 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:47.608+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:47.888 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:47.608+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:47.888 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:47 smithi084 systemd[1]: Stopping Ceph osd.3 for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:27:48.253 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3[59573]: 2024-03-30T12:27:47.896+0000 7fa2c56be700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:27:48.253 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3[59573]: 2024-03-30T12:27:47.896+0000 7fa2c56be700 -1 osd.3 388 *** Got signal Terminated *** 2024-03-30T12:27:48.254 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3[59573]: 2024-03-30T12:27:47.896+0000 7fa2c56be700 -1 osd.3 388 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T12:27:48.473 INFO:tasks.rados.rados.0.smithi084.stdout:1592: done (1 left) 2024-03-30T12:27:48.473 INFO:tasks.rados.rados.0.smithi084.stdout:1593: done (0 left) 2024-03-30T12:27:48.473 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 159 2024-03-30T12:27:48.473 INFO:tasks.rados.rados.0.smithi084.stdout:1594: seq_num 504 ranges {0=450560,450560=589824,1040384=212992} 2024-03-30T12:27:48.475 INFO:tasks.rados.rados.0.smithi084.stdout:1594: writing smithi08477944-17 from 0 to 450560 tid 1 2024-03-30T12:27:48.480 INFO:tasks.rados.rados.0.smithi084.stdout:1594: writing smithi08477944-17 from 450560 to 1040384 tid 2 2024-03-30T12:27:48.482 INFO:tasks.rados.rados.0.smithi084.stdout:1594: writing smithi08477944-17 from 1040384 to 1253376 tid 3 2024-03-30T12:27:48.482 INFO:tasks.rados.rados.0.smithi084.stdout:1595: rollback oid 22 current snap is 159 2024-03-30T12:27:48.482 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 22 to 150 2024-03-30T12:27:48.482 INFO:tasks.rados.rados.0.smithi084.stdout:1596: delete oid 39 current snap is 159 2024-03-30T12:27:48.490 INFO:tasks.rados.rados.0.smithi084.stdout:1595: finishing rollback tid 0 to smithi08477944-22 2024-03-30T12:27:48.491 INFO:tasks.rados.rados.0.smithi084.stdout:1595: finishing rollback tid 1 to smithi08477944-22 2024-03-30T12:27:48.491 INFO:tasks.rados.rados.0.smithi084.stdout:1595: finishing rollback tid 2 to smithi08477944-22 2024-03-30T12:27:48.491 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 853 (ObjNum 431 snap 140 seq_num 431) dirty exists 2024-03-30T12:27:48.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:48.493+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:48.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:48.489+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:48.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:48.489+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:48.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:48.489+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:48.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:48.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:48.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{d8=[d8,d7,d5,d2,d0,cd,cc],da=[da]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:48.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:48.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-mon[91810]: osdmap e388: 8 total, 8 up, 8 in 2024-03-30T12:27:48.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:48.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{d8=[d8,d7,d5,d2,d0,cd,cc],da=[da]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:48.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:48.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:48.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:48.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:48.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-mon[91810]: osd.3 marked itself down and dead 2024-03-30T12:27:48.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:48.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:48.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{d8=[d8,d7,d5,d2,d0,cd,cc],da=[da]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:48.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:48.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-mon[89279]: osdmap e388: 8 total, 8 up, 8 in 2024-03-30T12:27:48.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:48.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{d8=[d8,d7,d5,d2,d0,cd,cc],da=[da]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:48.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:48.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:48.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:48.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:48.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:48 smithi084 ceph-mon[89279]: osd.3 marked itself down and dead 2024-03-30T12:27:48.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:48.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:48.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{d8=[d8,d7,d5,d2,d0,cd,cc],da=[da]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:48.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset cd=[]:{cd=[cd,cc]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:48.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:48 smithi162 ceph-mon[83709]: osdmap e388: 8 total, 8 up, 8 in 2024-03-30T12:27:48.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:48.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{d8=[d8,d7,d5,d2,d0,cd,cc],da=[da]} for object 5:54568f59:::smithi08477944-30:c7 2024-03-30T12:27:48.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:48.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:48.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{a5=[a1,a0,9d],b3=[b3,b0,aa],c5=[c5,c4,c3,c2],ca=[ca,c9,c8,c7],cb=[cb],cc=[cc],d1=[d0,ce,cd],d5=[d5,d4,d2]} for object 5:c4ecc257:::smithi08477944-17:9a 2024-03-30T12:27:48.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:48.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:48 smithi162 ceph-mon[83709]: osd.3 marked itself down and dead 2024-03-30T12:27:49.253 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:49 smithi084 podman[111392]: 2024-03-30 12:27:49.017750939 +0000 UTC m=+1.219551050 container died 8eaf6dc73c250211eadda640f4b5ea384765ed1dea0e0f5e42db2e3efa8426ba (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=reef-f14b568, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-03-30T12:27:49.498 INFO:tasks.rados.rados.0.smithi084.stdout:1594: finishing write tid 1 to smithi08477944-17 2024-03-30T12:27:49.499 INFO:tasks.rados.rados.0.smithi084.stdout:1594: finishing write tid 2 to smithi08477944-17 2024-03-30T12:27:49.500 INFO:tasks.rados.rados.0.smithi084.stdout:1594: finishing write tid 3 to smithi08477944-17 2024-03-30T12:27:49.501 INFO:tasks.rados.rados.0.smithi084.stdout:1594: finishing write tid 4 to smithi08477944-17 2024-03-30T12:27:49.503 INFO:tasks.rados.rados.0.smithi084.stdout:1594: finishing write tid 5 to smithi08477944-17 2024-03-30T12:27:49.503 INFO:tasks.rados.rados.0.smithi084.stdout:1594: oid 17 updating version 0 to 905 2024-03-30T12:27:49.503 INFO:tasks.rados.rados.0.smithi084.stdout:1594: oid 17 version 905 is already newer than 903 2024-03-30T12:27:49.503 INFO:tasks.rados.rados.0.smithi084.stdout:1594: oid 17 version 905 is already newer than 902 2024-03-30T12:27:49.503 INFO:tasks.rados.rados.0.smithi084.stdout:1594: oid 17 version 905 is already newer than 904 2024-03-30T12:27:49.503 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 905 (ObjNum 504 snap 159 seq_num 504) dirty exists 2024-03-30T12:27:49.503 INFO:tasks.rados.rados.0.smithi084.stdout:1594: left oid 17 (ObjNum 504 snap 159 seq_num 504) 2024-03-30T12:27:49.503 INFO:tasks.rados.rados.0.smithi084.stdout:1594: done (2 left) 2024-03-30T12:27:49.503 INFO:tasks.rados.rados.0.smithi084.stdout:1595: done (1 left) 2024-03-30T12:27:49.503 INFO:tasks.rados.rados.0.smithi084.stdout:1596: done (0 left) 2024-03-30T12:27:49.504 INFO:tasks.rados.rados.0.smithi084.stdout:1597: snap_remove snap 156 2024-03-30T12:27:49.589 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:27:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:27:49] "GET /metrics HTTP/1.1" 200 36265 "" "Prometheus/2.43.0" 2024-03-30T12:27:49.589 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:49.498+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:49.590 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:49 smithi084 ceph-mon[89279]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T12:27:49.590 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:49 smithi084 ceph-mon[89279]: osdmap e389: 8 total, 7 up, 8 in 2024-03-30T12:27:49.590 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:49.590 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:49.590 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:49.590 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:49.590 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:49 smithi084 ceph-mon[89279]: pgmap v266: 121 pgs: 16 stale+active+clean, 6 active+clean+snaptrim_error, 99 active+clean; 235 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 9.7 MiB/s rd, 5.2 MiB/s wr, 32 op/s 2024-03-30T12:27:49.591 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:49 smithi084 podman[111392]: 2024-03-30 12:27:49.413558736 +0000 UTC m=+1.615358841 container cleanup 8eaf6dc73c250211eadda640f4b5ea384765ed1dea0e0f5e42db2e3efa8426ba (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, RELEASE=reef-f14b568, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True) 2024-03-30T12:27:49.591 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:49 smithi084 bash[111392]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3 2024-03-30T12:27:49.591 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:49 smithi084 ceph-mon[91810]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T12:27:49.591 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:49 smithi084 ceph-mon[91810]: osdmap e389: 8 total, 7 up, 8 in 2024-03-30T12:27:49.591 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:49.591 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:49.591 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:49.591 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:49.591 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:49 smithi084 ceph-mon[91810]: pgmap v266: 121 pgs: 16 stale+active+clean, 6 active+clean+snaptrim_error, 99 active+clean; 235 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 9.7 MiB/s rd, 5.2 MiB/s wr, 32 op/s 2024-03-30T12:27:49.592 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:49.493+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:49.592 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:49.493+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:49.592 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:49.493+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:49.592 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:49.493+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:49.592 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:49.495+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:49.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:49 smithi162 ceph-mon[83709]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T12:27:49.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:49 smithi162 ceph-mon[83709]: osdmap e389: 8 total, 7 up, 8 in 2024-03-30T12:27:49.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:49.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:49.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:49.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:49.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:49 smithi162 ceph-mon[83709]: pgmap v266: 121 pgs: 16 stale+active+clean, 6 active+clean+snaptrim_error, 99 active+clean; 235 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 9.7 MiB/s rd, 5.2 MiB/s wr, 32 op/s 2024-03-30T12:27:50.006 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:49 smithi084 podman[111420]: 2024-03-30 12:27:49.59843 +0000 UTC m=+0.575316967 container remove 8eaf6dc73c250211eadda640f4b5ea384765ed1dea0e0f5e42db2e3efa8426ba (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=reef-f14b568, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-03-30T12:27:50.334 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:50 smithi084 podman[111509]: 2024-03-30 12:27:49.921344639 +0000 UTC m=+0.017814893 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:27:50.335 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:50 smithi084 podman[111509]: 2024-03-30 12:27:50.024339984 +0000 UTC m=+0.120810219 container create 44736a435b07bf9afa673acd9ce0333db5612656f9196d42dec16a3a9b9dfb8b (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_CLEAN=True, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-03-30T12:27:50.335 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:50 smithi084 podman[111509]: 2024-03-30 12:27:50.260352988 +0000 UTC m=+0.356823223 container init 44736a435b07bf9afa673acd9ce0333db5612656f9196d42dec16a3a9b9dfb8b (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True) 2024-03-30T12:27:50.335 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:50 smithi084 podman[111509]: 2024-03-30 12:27:50.263520927 +0000 UTC m=+0.359991168 container start 44736a435b07bf9afa673acd9ce0333db5612656f9196d42dec16a3a9b9dfb8b (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:27:50.335 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:50 smithi084 podman[111509]: 2024-03-30 12:27:50.343345463 +0000 UTC m=+0.439815710 container attach 44736a435b07bf9afa673acd9ce0333db5612656f9196d42dec16a3a9b9dfb8b (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-03-30T12:27:50.492 INFO:tasks.rados.rados.0.smithi084.stdout:1597: done (0 left) 2024-03-30T12:27:50.492 INFO:tasks.rados.rados.0.smithi084.stdout:1598: snap_create 2024-03-30T12:27:50.588 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:50 smithi084 ceph-mon[89279]: osdmap e390: 8 total, 7 up, 8 in 2024-03-30T12:27:50.588 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:50.588 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:50.588 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:50.589 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:50.589 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:50 smithi084 ceph-mon[91810]: osdmap e390: 8 total, 7 up, 8 in 2024-03-30T12:27:50.589 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:50.589 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:50.590 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:50.590 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:50.590 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:50.505+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:50.591 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:50 smithi084 podman[111509]: 2024-03-30 12:27:50.553896756 +0000 UTC m=+0.650367001 container died 44736a435b07bf9afa673acd9ce0333db5612656f9196d42dec16a3a9b9dfb8b (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.vendor=CentOS) 2024-03-30T12:27:50.862 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:50.594+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:50.862 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:50.595+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:50.862 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:50.595+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:50.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:50 smithi162 ceph-mon[83709]: osdmap e390: 8 total, 7 up, 8 in 2024-03-30T12:27:50.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:50.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:50.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:50.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:51.497 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:51 smithi084 podman[111535]: 2024-03-30 12:27:51.180526618 +0000 UTC m=+0.621632337 container remove 44736a435b07bf9afa673acd9ce0333db5612656f9196d42dec16a3a9b9dfb8b (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, maintainer=Guillaume Abrioux ) 2024-03-30T12:27:51.497 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:51 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.3.service: Deactivated successfully. 2024-03-30T12:27:51.497 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:51 smithi084 systemd[1]: Stopped Ceph osd.3 for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:27:51.498 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:51 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.3.service: Consumed 8.850s CPU time. 2024-03-30T12:27:51.498 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:51 smithi084 systemd[1]: Starting Ceph osd.3 for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:27:51.503 INFO:tasks.rados.rados.0.smithi084.stdout:1598: done (0 left) 2024-03-30T12:27:51.504 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 160 2024-03-30T12:27:51.504 INFO:tasks.rados.rados.0.smithi084.stdout:1599: seq_num 506 ranges {3366912=483328,3850240=761856,4612096=40960} 2024-03-30T12:27:51.524 INFO:tasks.rados.rados.0.smithi084.stdout:1599: writing smithi08477944-10 from 3366912 to 3850240 tid 1 2024-03-30T12:27:51.529 INFO:tasks.rados.rados.0.smithi084.stdout:1599: writing smithi08477944-10 from 3850240 to 4612096 tid 2 2024-03-30T12:27:51.529 INFO:tasks.rados.rados.0.smithi084.stdout:1599: writing smithi08477944-10 from 4612096 to 4653056 tid 3 2024-03-30T12:27:51.530 INFO:tasks.rados.rados.0.smithi084.stdout:1600: snap_create 2024-03-30T12:27:51.530 INFO:tasks.rados.rados.0.smithi084.stdout:1599: finishing write tid 1 to smithi08477944-10 2024-03-30T12:27:51.533 INFO:tasks.rados.rados.0.smithi084.stdout:1599: finishing write tid 2 to smithi08477944-10 2024-03-30T12:27:51.533 INFO:tasks.rados.rados.0.smithi084.stdout:1599: finishing write tid 3 to smithi08477944-10 2024-03-30T12:27:51.534 INFO:tasks.rados.rados.0.smithi084.stdout:1599: finishing write tid 4 to smithi08477944-10 2024-03-30T12:27:51.535 INFO:tasks.rados.rados.0.smithi084.stdout:1599: finishing write tid 5 to smithi08477944-10 2024-03-30T12:27:51.535 INFO:tasks.rados.rados.0.smithi084.stdout:1599: oid 10 updating version 0 to 793 2024-03-30T12:27:51.535 INFO:tasks.rados.rados.0.smithi084.stdout:1599: oid 10 version 793 is already newer than 792 2024-03-30T12:27:51.535 INFO:tasks.rados.rados.0.smithi084.stdout:1599: oid 10 version 793 is already newer than 791 2024-03-30T12:27:51.535 INFO:tasks.rados.rados.0.smithi084.stdout:1599: oid 10 version 793 is already newer than 790 2024-03-30T12:27:51.535 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 793 (ObjNum 506 snap 160 seq_num 506) dirty exists 2024-03-30T12:27:51.535 INFO:tasks.rados.rados.0.smithi084.stdout:1599: left oid 10 (ObjNum 506 snap 160 seq_num 506) 2024-03-30T12:27:51.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:51.510+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:51.754 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:51 smithi084 podman[111638]: 2024-03-30 12:27:51.531386036 +0000 UTC m=+0.022759672 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:27:51.754 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:51 smithi084 podman[111638]: 2024-03-30 12:27:51.656933712 +0000 UTC m=+0.148307336 container create cbacb2e5e69631452719ad506427e79b85b24bab631f82924017e3f81b60a139 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3-activate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-03-30T12:27:51.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:51 smithi084 ceph-mon[89279]: osdmap e391: 8 total, 7 up, 8 in 2024-03-30T12:27:51.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:51 smithi084 ceph-mon[89279]: pgmap v269: 121 pgs: 2 active+undersized+degraded, 8 peering, 4 stale+active+clean, 6 active+clean+snaptrim_error, 17 active+undersized, 84 active+clean; 236 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 6 op/s; 12/507 objects degraded (2.367%) 2024-03-30T12:27:51.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:51 smithi084 ceph-mon[91810]: osdmap e391: 8 total, 7 up, 8 in 2024-03-30T12:27:51.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:51.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:51.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:51.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:51.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:51 smithi084 ceph-mon[91810]: pgmap v269: 121 pgs: 2 active+undersized+degraded, 8 peering, 4 stale+active+clean, 6 active+clean+snaptrim_error, 17 active+undersized, 84 active+clean; 236 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 6 op/s; 12/507 objects degraded (2.367%) 2024-03-30T12:27:51.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:51.597+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:51.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:51.597+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:51.757 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:51.597+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:51.757 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:51.597+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:51.757 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:51.597+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:51.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:51 smithi162 ceph-mon[83709]: osdmap e391: 8 total, 7 up, 8 in 2024-03-30T12:27:51.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:51.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:51.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:51.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:51.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:51 smithi162 ceph-mon[83709]: pgmap v269: 121 pgs: 2 active+undersized+degraded, 8 peering, 4 stale+active+clean, 6 active+clean+snaptrim_error, 17 active+undersized, 84 active+clean; 236 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 6 op/s; 12/507 objects degraded (2.367%) 2024-03-30T12:27:52.254 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:51 smithi084 podman[111638]: 2024-03-30 12:27:51.926028216 +0000 UTC m=+0.417401840 container init cbacb2e5e69631452719ad506427e79b85b24bab631f82924017e3f81b60a139 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3-activate, GIT_CLEAN=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T12:27:52.254 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:51 smithi084 podman[111638]: 2024-03-30 12:27:51.929212713 +0000 UTC m=+0.420586341 container start cbacb2e5e69631452719ad506427e79b85b24bab631f82924017e3f81b60a139 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3-activate, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-03-30T12:27:52.254 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:52 smithi084 podman[111638]: 2024-03-30 12:27:52.009272618 +0000 UTC m=+0.500646251 container attach cbacb2e5e69631452719ad506427e79b85b24bab631f82924017e3f81b60a139 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3-activate, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, ceph=True) 2024-03-30T12:27:52.507 INFO:tasks.rados.rados.0.smithi084.stdout:1599: done (1 left) 2024-03-30T12:27:52.507 INFO:tasks.rados.rados.0.smithi084.stdout:1600: done (0 left) 2024-03-30T12:27:52.507 INFO:tasks.rados.rados.0.smithi084.stdout:1601: rollback oid 27 current snap is 161 2024-03-30T12:27:52.507 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 27 to 157 2024-03-30T12:27:52.507 INFO:tasks.rados.rados.0.smithi084.stdout:1602: delete oid 39 current snap is 161 2024-03-30T12:27:52.508 INFO:tasks.rados.rados.0.smithi084.stdout:1602: done (1 left) 2024-03-30T12:27:52.508 INFO:tasks.rados.rados.0.smithi084.stdout:1603: rollback oid 5 current snap is 161 2024-03-30T12:27:52.509 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 5 to 160 2024-03-30T12:27:52.509 INFO:tasks.rados.rados.0.smithi084.stdout:1604: copy_from oid 6 from oid 24 current snap is 161 2024-03-30T12:27:52.509 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 161 2024-03-30T12:27:52.509 INFO:tasks.rados.rados.0.smithi084.stdout:1605: seq_num 508 ranges {1253376=516096,1769472=524288,2293760=278528} 2024-03-30T12:27:52.518 INFO:tasks.rados.rados.0.smithi084.stdout:1605: writing smithi08477944-17 from 1253376 to 1769472 tid 1 2024-03-30T12:27:52.521 INFO:tasks.rados.rados.0.smithi084.stdout:1605: writing smithi08477944-17 from 1769472 to 2293760 tid 2 2024-03-30T12:27:52.523 INFO:tasks.rados.rados.0.smithi084.stdout:1605: writing smithi08477944-17 from 2293760 to 2572288 tid 3 2024-03-30T12:27:52.523 INFO:tasks.rados.rados.0.smithi084.stdout:1606: snap_create 2024-03-30T12:27:52.523 INFO:tasks.rados.rados.0.smithi084.stdout:1601: finishing rollback tid 1 to smithi08477944-27 2024-03-30T12:27:52.523 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-03-30T12:27:52.523 INFO:tasks.rados.rados.0.smithi084.stdout:1604: finishing copy_from to smithi08477944-6 2024-03-30T12:27:52.523 INFO:tasks.rados.rados.0.smithi084.stdout:1604: got expected ENOENT (src dne) 2024-03-30T12:27:52.523 INFO:tasks.rados.rados.0.smithi084.stdout:1604: finishing copy_from racing read to smithi08477944-6 2024-03-30T12:27:52.523 INFO:tasks.rados.rados.0.smithi084.stdout:1603: finishing rollback tid 0 to smithi08477944-5 2024-03-30T12:27:52.523 INFO:tasks.rados.rados.0.smithi084.stdout:1603: finishing rollback tid 1 to smithi08477944-5 2024-03-30T12:27:52.524 INFO:tasks.rados.rados.0.smithi084.stdout:1603: finishing rollback tid 2 to smithi08477944-5 2024-03-30T12:27:52.524 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 899 (ObjNum 445 snap 141 seq_num 445) dirty exists 2024-03-30T12:27:52.524 INFO:tasks.rados.rados.0.smithi084.stdout:1605: finishing write tid 1 to smithi08477944-17 2024-03-30T12:27:52.524 INFO:tasks.rados.rados.0.smithi084.stdout:1605: finishing write tid 2 to smithi08477944-17 2024-03-30T12:27:52.525 INFO:tasks.rados.rados.0.smithi084.stdout:1605: finishing write tid 3 to smithi08477944-17 2024-03-30T12:27:52.525 INFO:tasks.rados.rados.0.smithi084.stdout:1605: finishing write tid 4 to smithi08477944-17 2024-03-30T12:27:52.527 INFO:tasks.rados.rados.0.smithi084.stdout:1605: finishing write tid 5 to smithi08477944-17 2024-03-30T12:27:52.527 INFO:tasks.rados.rados.0.smithi084.stdout:1605: oid 17 updating version 0 to 908 2024-03-30T12:27:52.527 INFO:tasks.rados.rados.0.smithi084.stdout:1605: oid 17 version 908 is already newer than 907 2024-03-30T12:27:52.527 INFO:tasks.rados.rados.0.smithi084.stdout:1605: oid 17 updating version 908 to 909 2024-03-30T12:27:52.527 INFO:tasks.rados.rados.0.smithi084.stdout:1605: oid 17 updating version 909 to 910 2024-03-30T12:27:52.527 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 910 (ObjNum 508 snap 161 seq_num 508) dirty exists 2024-03-30T12:27:52.527 INFO:tasks.rados.rados.0.smithi084.stdout:1605: left oid 17 (ObjNum 508 snap 161 seq_num 508) 2024-03-30T12:27:52.745 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:52.514+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:52.745 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:52.512+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:52.745 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:52.514+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:52.745 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:52.515+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:52.745 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:52 smithi084 ceph-mon[91810]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-03-30T12:27:52.746 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:52 smithi084 ceph-mon[91810]: Health check failed: Degraded data redundancy: 12/507 objects degraded (2.367%), 2 pgs degraded (PG_DEGRADED) 2024-03-30T12:27:52.746 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:52.746 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:52 smithi084 ceph-mon[91810]: osdmap e392: 8 total, 7 up, 8 in 2024-03-30T12:27:52.746 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:52.746 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:52.746 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:52.746 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:52 smithi084 ceph-mon[89279]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-03-30T12:27:52.746 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:52 smithi084 ceph-mon[89279]: Health check failed: Degraded data redundancy: 12/507 objects degraded (2.367%), 2 pgs degraded (PG_DEGRADED) 2024-03-30T12:27:52.746 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:52.746 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:52 smithi084 ceph-mon[89279]: osdmap e392: 8 total, 7 up, 8 in 2024-03-30T12:27:52.747 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:52.747 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:52.747 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:52.747 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3-activate[111652]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-30T12:27:52.747 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3-activate[111652]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-03-30T12:27:52.747 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:52 smithi084 bash[111638]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-30T12:27:52.747 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:52 smithi084 bash[111638]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-03-30T12:27:52.747 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:52 smithi084 bash[111638]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-03-30T12:27:52.747 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:52 smithi084 bash[111638]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-03-30T12:27:52.747 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:52 smithi084 bash[111638]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-3/block 2024-03-30T12:27:52.747 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:52 smithi084 bash[111638]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-30T12:27:52.747 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:52 smithi084 bash[111638]: --> ceph-volume raw activate successful for osd ID: 3 2024-03-30T12:27:52.747 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3-activate[111652]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-03-30T12:27:52.748 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3-activate[111652]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-03-30T12:27:52.748 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3-activate[111652]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-3/block 2024-03-30T12:27:52.748 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3-activate[111652]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-30T12:27:52.748 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3-activate[111652]: --> ceph-volume raw activate successful for osd ID: 3 2024-03-30T12:27:52.748 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:52 smithi084 podman[111638]: 2024-03-30 12:27:52.392465899 +0000 UTC m=+0.883839522 container died cbacb2e5e69631452719ad506427e79b85b24bab631f82924017e3f81b60a139 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3-activate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-03-30T12:27:52.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:52 smithi162 ceph-mon[83709]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-03-30T12:27:52.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:52 smithi162 ceph-mon[83709]: Health check failed: Degraded data redundancy: 12/507 objects degraded (2.367%), 2 pgs degraded (PG_DEGRADED) 2024-03-30T12:27:52.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:52.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:52 smithi162 ceph-mon[83709]: osdmap e392: 8 total, 7 up, 8 in 2024-03-30T12:27:52.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:52.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:52.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:53.329 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:53 smithi084 podman[111781]: 2024-03-30 12:27:53.087878802 +0000 UTC m=+0.690685483 container remove cbacb2e5e69631452719ad506427e79b85b24bab631f82924017e3f81b60a139 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3-activate, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-03-30T12:27:53.329 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:53 smithi084 podman[111846]: 2024-03-30 12:27:53.200521115 +0000 UTC m=+0.017813509 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:27:53.329 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:53 smithi084 podman[111846]: 2024-03-30 12:27:53.338711824 +0000 UTC m=+0.156004218 container create c088a701b71bfcc7ffe508390740b4c1bb16069f20b1e37bd52e58a1987824ae (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3) 2024-03-30T12:27:53.512 INFO:tasks.rados.rados.0.smithi084.stdout:1601: done (4 left) 2024-03-30T12:27:53.512 INFO:tasks.rados.rados.0.smithi084.stdout:1603: done (3 left) 2024-03-30T12:27:53.512 INFO:tasks.rados.rados.0.smithi084.stdout:1604: done (2 left) 2024-03-30T12:27:53.512 INFO:tasks.rados.rados.0.smithi084.stdout:1605: done (1 left) 2024-03-30T12:27:53.512 INFO:tasks.rados.rados.0.smithi084.stdout:1606: done (0 left) 2024-03-30T12:27:53.512 INFO:tasks.rados.rados.0.smithi084.stdout:1607: snap_remove snap 150 2024-03-30T12:27:53.623 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:53.623 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:53 smithi084 ceph-mon[91810]: osdmap e393: 8 total, 7 up, 8 in 2024-03-30T12:27:53.623 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:53.624 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:53.624 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:53.624 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:53 smithi084 ceph-mon[91810]: pgmap v272: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 80 active+clean, 23 active+undersized, 5 active+clean+snaptrim_error, 1 stale+active+clean, 8 peering, 3 active+undersized+degraded; 239 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 894 KiB/s wr, 8 op/s; 40/513 objects degraded (7.797%) 2024-03-30T12:27:53.624 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:53.624 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:53 smithi084 ceph-mon[89279]: osdmap e393: 8 total, 7 up, 8 in 2024-03-30T12:27:53.624 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:53.624 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:53.624 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:53.624 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:53 smithi084 ceph-mon[89279]: pgmap v272: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 80 active+clean, 23 active+undersized, 5 active+clean+snaptrim_error, 1 stale+active+clean, 8 peering, 3 active+undersized+degraded; 239 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 894 KiB/s wr, 8 op/s; 40/513 objects degraded (7.797%) 2024-03-30T12:27:53.624 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:53 smithi084 podman[111846]: 2024-03-30 12:27:53.533119317 +0000 UTC m=+0.350411710 container init c088a701b71bfcc7ffe508390740b4c1bb16069f20b1e37bd52e58a1987824ae (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True) 2024-03-30T12:27:53.625 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:53 smithi084 podman[111846]: 2024-03-30 12:27:53.536317548 +0000 UTC m=+0.353609951 container start c088a701b71bfcc7ffe508390740b4c1bb16069f20b1e37bd52e58a1987824ae (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3) 2024-03-30T12:27:53.625 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:53 smithi084 ceph-osd[111865]: -- 172.21.15.84:0/819579040 <== mon.2 v2:172.21.15.84:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55abb0617680 con 0x55abb05e0c00 2024-03-30T12:27:53.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:53.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:53 smithi162 ceph-mon[83709]: osdmap e393: 8 total, 7 up, 8 in 2024-03-30T12:27:53.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:53.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:53.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:53.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:53 smithi162 ceph-mon[83709]: pgmap v272: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 80 active+clean, 23 active+undersized, 5 active+clean+snaptrim_error, 1 stale+active+clean, 8 peering, 3 active+undersized+degraded; 239 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 894 KiB/s wr, 8 op/s; 40/513 objects degraded (7.797%) 2024-03-30T12:27:53.901 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:53 smithi084 bash[111846]: c088a701b71bfcc7ffe508390740b4c1bb16069f20b1e37bd52e58a1987824ae 2024-03-30T12:27:53.902 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:53 smithi084 systemd[1]: Started Ceph osd.3 for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:27:53.902 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:53.806+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:53.902 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:53.806+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:53.902 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:53.807+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:53.902 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:53.807+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:53.902 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:53.807+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:54.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:53.908+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:54.254 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3[111861]: 2024-03-30T12:27:54.077+0000 7fa71fd137c0 -1 Falling back to public interface 2024-03-30T12:27:54.514 INFO:tasks.rados.rados.0.smithi084.stdout:1607: done (0 left) 2024-03-30T12:27:54.514 INFO:tasks.rados.rados.0.smithi084.stdout:1608: read oid 42 snap 141 2024-03-30T12:27:54.514 INFO:tasks.rados.rados.0.smithi084.stdout:1608: expect (ObjNum 404 snap 126 seq_num 404) 2024-03-30T12:27:54.514 INFO:tasks.rados.rados.0.smithi084.stdout:1609: delete oid 2 current snap is 162 2024-03-30T12:27:54.523 INFO:tasks.rados.rados.0.smithi084.stdout:1609: done (1 left) 2024-03-30T12:27:54.523 INFO:tasks.rados.rados.0.smithi084.stdout:1610: rmattr oid 46 current snap is 162 2024-03-30T12:27:54.523 INFO:tasks.rados.rados.0.smithi084.stdout:1610: done (1 left) 2024-03-30T12:27:54.523 INFO:tasks.rados.rados.0.smithi084.stdout:1611: snap_remove snap 155 2024-03-30T12:27:54.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:54.526+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:54 smithi084 ceph-mon[91810]: osdmap e394: 8 total, 7 up, 8 in 2024-03-30T12:27:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:54 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:54 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:54 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:27:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:54.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:54 smithi084 ceph-mon[89279]: osdmap e394: 8 total, 7 up, 8 in 2024-03-30T12:27:54.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:54 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:54.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:54 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:54.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:54 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:27:54.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:54.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:54.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:54.793 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-03-30T12:27:54.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:54 smithi162 ceph-mon[83709]: osdmap e394: 8 total, 7 up, 8 in 2024-03-30T12:27:54.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:54 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:54.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:54 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:54.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:54 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:27:54.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:54.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:54.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:55.136 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T12:27:55.136 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (7m) 32s ago 8m 25.2M - 0.25.0 c8568f914cd2 6765ce007f39 2024-03-30T12:27:55.136 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi162 *:3000 running (7m) 2m ago 7m 91.0M - 9.4.7 954c08fa6188 ff2ec7518619 2024-03-30T12:27:55.136 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (9m) 32s ago 9m 15.0M - 18.2.2-1051-gf14b5682 c8fb09e16a7d a9c2e74ca2a3 2024-03-30T12:27:55.136 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi162 running (8m) 2m ago 8m 19.7M - 18.2.2-1051-gf14b5682 c8fb09e16a7d ee1770ef5edd 2024-03-30T12:27:55.137 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi162 *:8443,9283,8765 running (3m) 2m ago 12m 449M - 19.0.0-1864-g5dc2ea30 548196a1a838 eec968f3fcc6 2024-03-30T12:27:55.137 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (4m) 32s ago 14m 510M - 19.0.0-1864-g5dc2ea30 548196a1a838 9a2aba19dffc 2024-03-30T12:27:55.137 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (3m) 32s ago 14m 52.6M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 a0811f2ae47d 2024-03-30T12:27:55.137 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi162 running (2m) 2m ago 12m 24.9M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 149ae6649e0c 2024-03-30T12:27:55.137 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (2m) 32s ago 12m 44.4M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 f79eca93cddd 2024-03-30T12:27:55.137 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (7m) 32s ago 7m 17.5M - 1.5.0 0da6a335fe13 66844bed39e8 2024-03-30T12:27:55.137 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi162 *:9100 running (7m) 2m ago 7m 15.5M - 1.5.0 0da6a335fe13 3d6e28b2348d 2024-03-30T12:27:55.137 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (104s) 32s ago 12m 196M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 c91eea4f8484 2024-03-30T12:27:55.137 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (70s) 32s ago 11m 108M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 7518832f6b4a 2024-03-30T12:27:55.137 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (36s) 32s ago 11m 15.1M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 647dd862762d 2024-03-30T12:27:55.137 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 starting - - - 2480M 2024-03-30T12:27:55.137 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi162 running (10m) 2m ago 10m 195M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 1f52e827b91a 2024-03-30T12:27:55.137 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi162 running (10m) 2m ago 10m 188M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 7ba250d154aa 2024-03-30T12:27:55.137 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi162 running (9m) 2m ago 9m 108M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 656a733e8b7a 2024-03-30T12:27:55.137 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi162 running (9m) 2m ago 9m 127M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d e3246b3bc88b 2024-03-30T12:27:55.137 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi162 *:9095 running (3m) 2m ago 8m 51.4M - 2.43.0 a07b618ecd1d bd7d323e4b47 2024-03-30T12:27:55.138 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:55.008+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:55.138 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:55.008+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:55.138 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:55.008+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:55.532 INFO:tasks.rados.rados.0.smithi084.stdout:1611: done (1 left) 2024-03-30T12:27:55.533 INFO:tasks.rados.rados.0.smithi084.stdout:1612: delete oid 27 current snap is 162 2024-03-30T12:27:55.533 INFO:tasks.rados.rados.0.smithi084.stdout:1608: expect (ObjNum 404 snap 126 seq_num 404) 2024-03-30T12:27:55.567 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-30T12:27:55.568 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-03-30T12:27:55.568 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 3 2024-03-30T12:27:55.568 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:27:55.568 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-03-30T12:27:55.568 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 2 2024-03-30T12:27:55.568 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:27:55.569 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-03-30T12:27:55.569 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 4, 2024-03-30T12:27:55.569 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 3 2024-03-30T12:27:55.569 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:27:55.569 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-03-30T12:27:55.569 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 2 2024-03-30T12:27:55.570 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:27:55.570 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-03-30T12:27:55.570 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 6, 2024-03-30T12:27:55.570 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 8 2024-03-30T12:27:55.570 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-30T12:27:55.571 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-30T12:27:55.759 INFO:tasks.rados.rados.0.smithi084.stdout:1608: done (1 left) 2024-03-30T12:27:55.759 INFO:tasks.rados.rados.0.smithi084.stdout:1612: done (0 left) 2024-03-30T12:27:55.760 INFO:tasks.rados.rados.0.smithi084.stdout:1613: snap_remove snap 158 2024-03-30T12:27:55.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:55.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:55 smithi162 ceph-mon[83709]: osdmap e395: 8 total, 7 up, 8 in 2024-03-30T12:27:55.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:55.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:55 smithi162 ceph-mon[83709]: pgmap v275: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 77 active+clean, 32 active+undersized, 4 active+clean+snaptrim_error, 6 active+undersized+degraded; 239 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 602 KiB/s wr, 7 op/s; 48/513 objects degraded (9.357%) 2024-03-30T12:27:56.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:55.544+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:56.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:56.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:55 smithi084 ceph-mon[89279]: osdmap e395: 8 total, 7 up, 8 in 2024-03-30T12:27:56.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:56.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:55 smithi084 ceph-mon[89279]: pgmap v275: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 77 active+clean, 32 active+undersized, 4 active+clean+snaptrim_error, 6 active+undersized+degraded; 239 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 602 KiB/s wr, 7 op/s; 48/513 objects degraded (9.357%) 2024-03-30T12:27:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:55 smithi084 ceph-mon[91810]: osdmap e395: 8 total, 7 up, 8 in 2024-03-30T12:27:56.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:56.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:55 smithi084 ceph-mon[91810]: pgmap v275: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 77 active+clean, 32 active+undersized, 4 active+clean+snaptrim_error, 6 active+undersized+degraded; 239 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 602 KiB/s wr, 7 op/s; 48/513 objects degraded (9.357%) 2024-03-30T12:27:56.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:55.548+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:56.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:55.548+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:56.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:55.549+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:56.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:55.549+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:56.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:55.549+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:56.539 INFO:tasks.rados.rados.0.smithi084.stdout:1613: done (0 left) 2024-03-30T12:27:56.539 INFO:tasks.rados.rados.0.smithi084.stdout:1614: read oid 49 snap -1 2024-03-30T12:27:56.539 INFO:tasks.rados.rados.0.smithi084.stdout:1614: expect (ObjNum 498 snap 156 seq_num 498) 2024-03-30T12:27:56.540 INFO:tasks.rados.rados.0.smithi084.stdout:1615: copy_from oid 22 from oid 39 current snap is 162 2024-03-30T12:27:56.540 INFO:tasks.rados.rados.0.smithi084.stdout:1616: read oid 50 snap 161 2024-03-30T12:27:56.540 INFO:tasks.rados.rados.0.smithi084.stdout:1616: expect (ObjNum 499 snap 156 seq_num 499) 2024-03-30T12:27:56.540 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 162 2024-03-30T12:27:56.540 INFO:tasks.rados.rados.0.smithi084.stdout:1617: seq_num 511 ranges {0=565248,565248=630784,1196032=172032} 2024-03-30T12:27:56.542 INFO:tasks.rados.rados.0.smithi084.stdout:1617: writing smithi08477944-47 from 0 to 565248 tid 1 2024-03-30T12:27:56.547 INFO:tasks.rados.rados.0.smithi084.stdout:1617: writing smithi08477944-47 from 565248 to 1196032 tid 2 2024-03-30T12:27:56.548 INFO:tasks.rados.rados.0.smithi084.stdout:1617: writing smithi08477944-47 from 1196032 to 1368064 tid 3 2024-03-30T12:27:56.549 INFO:tasks.rados.rados.0.smithi084.stdout:1615: finishing copy_from to smithi08477944-22 2024-03-30T12:27:56.549 INFO:tasks.rados.rados.0.smithi084.stdout:1615: got expected ENOENT (src dne) 2024-03-30T12:27:56.549 INFO:tasks.rados.rados.0.smithi084.stdout:1615: finishing copy_from racing read to smithi08477944-22 2024-03-30T12:27:56.549 INFO:tasks.rados.rados.0.smithi084.stdout:1615: done (3 left) 2024-03-30T12:27:56.549 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 162 2024-03-30T12:27:56.549 INFO:tasks.rados.rados.0.smithi084.stdout:1618: seq_num 512 ranges {4653056=581632,5234688=516096,5750784=286720} 2024-03-30T12:27:56.577 INFO:tasks.rados.rados.0.smithi084.stdout:1618: writing smithi08477944-10 from 4653056 to 5234688 tid 1 2024-03-30T12:27:56.580 INFO:tasks.rados.rados.0.smithi084.stdout:1618: writing smithi08477944-10 from 5234688 to 5750784 tid 2 2024-03-30T12:27:56.582 INFO:tasks.rados.rados.0.smithi084.stdout:1618: writing smithi08477944-10 from 5750784 to 6037504 tid 3 2024-03-30T12:27:56.582 INFO:tasks.rados.rados.0.smithi084.stdout:1619: rollback oid 41 current snap is 162 2024-03-30T12:27:56.582 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 41 to 141 2024-03-30T12:27:56.582 INFO:tasks.rados.rados.0.smithi084.stdout:1620: setattr oid 21 current snap is 162 2024-03-30T12:27:56.583 INFO:tasks.rados.rados.0.smithi084.stdout:1617: finishing write tid 1 to smithi08477944-47 2024-03-30T12:27:56.583 INFO:tasks.rados.rados.0.smithi084.stdout:1614: expect (ObjNum 498 snap 156 seq_num 498) 2024-03-30T12:27:56.616 INFO:tasks.rados.rados.0.smithi084.stdout:1617: finishing write tid 2 to smithi08477944-47 2024-03-30T12:27:56.616 INFO:tasks.rados.rados.0.smithi084.stdout:1617: finishing write tid 3 to smithi08477944-47 2024-03-30T12:27:56.616 INFO:tasks.rados.rados.0.smithi084.stdout:1617: finishing write tid 4 to smithi08477944-47 2024-03-30T12:27:56.616 INFO:tasks.rados.rados.0.smithi084.stdout:1616: expect (ObjNum 499 snap 156 seq_num 499) 2024-03-30T12:27:56.658 INFO:tasks.rados.rados.0.smithi084.stdout:1617: finishing write tid 5 to smithi08477944-47 2024-03-30T12:27:56.658 INFO:tasks.rados.rados.0.smithi084.stdout:1617: oid 47 updating version 0 to 910 2024-03-30T12:27:56.658 INFO:tasks.rados.rados.0.smithi084.stdout:1617: oid 47 version 910 is already newer than 908 2024-03-30T12:27:56.658 INFO:tasks.rados.rados.0.smithi084.stdout:1617: oid 47 version 910 is already newer than 907 2024-03-30T12:27:56.658 INFO:tasks.rados.rados.0.smithi084.stdout:1617: oid 47 version 910 is already newer than 909 2024-03-30T12:27:56.658 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 910 (ObjNum 511 snap 162 seq_num 511) dirty exists 2024-03-30T12:27:56.658 INFO:tasks.rados.rados.0.smithi084.stdout:1617: left oid 47 (ObjNum 511 snap 162 seq_num 511) 2024-03-30T12:27:56.658 INFO:tasks.rados.rados.0.smithi084.stdout:1614: done (5 left) 2024-03-30T12:27:56.658 INFO:tasks.rados.rados.0.smithi084.stdout:1616: done (4 left) 2024-03-30T12:27:56.659 INFO:tasks.rados.rados.0.smithi084.stdout:1617: done (3 left) 2024-03-30T12:27:56.659 INFO:tasks.rados.rados.0.smithi084.stdout:1621: read oid 26 snap -1 2024-03-30T12:27:56.659 INFO:tasks.rados.rados.0.smithi084.stdout:1621: expect deleted 2024-03-30T12:27:56.659 INFO:tasks.rados.rados.0.smithi084.stdout:1622: snap_remove snap 157 2024-03-30T12:27:56.870 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:56.551+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:56.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:56 smithi162 ceph-mon[83709]: from='client.44213 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:27:56.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:56.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:56.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:56.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:56 smithi162 ceph-mon[83709]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:27:56.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:56 smithi162 ceph-mon[83709]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-03-30T12:27:56.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:56 smithi162 ceph-mon[83709]: osdmap e396: 8 total, 7 up, 8 in 2024-03-30T12:27:56.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:56.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:56.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:56.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:56.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:56 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/3534313399' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:27:56.871 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:56.559+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:56.871 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:56.561+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:56.871 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:56.562+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:56.871 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-mon[89279]: from='client.44213 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:27:56.871 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:56.871 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:56.872 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:56.872 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-mon[89279]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:27:56.872 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-mon[89279]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-03-30T12:27:56.872 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-mon[89279]: osdmap e396: 8 total, 7 up, 8 in 2024-03-30T12:27:56.872 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:56.872 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:56.872 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:56.872 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:56.872 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/3534313399' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:27:56.872 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-mon[91810]: from='client.44213 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:27:56.872 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:56.872 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:56.872 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:56.873 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-mon[91810]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:27:56.873 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-mon[91810]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-03-30T12:27:56.873 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-mon[91810]: osdmap e396: 8 total, 7 up, 8 in 2024-03-30T12:27:56.873 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:56.873 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:56.873 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:56.873 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:56.873 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/3534313399' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:27:57.254 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3[111861]: 2024-03-30T12:27:56.905+0000 7fa71fd137c0 -1 osd.3 388 log_to_monitors true 2024-03-30T12:27:57.541 INFO:tasks.rados.rados.0.smithi084.stdout:1622: done (4 left) 2024-03-30T12:27:57.542 INFO:tasks.rados.rados.0.smithi084.stdout:1623: delete oid 37 current snap is 162 2024-03-30T12:27:57.542 INFO:tasks.rados.rados.0.smithi084.stdout:1618: finishing write tid 1 to smithi08477944-10 2024-03-30T12:27:57.542 INFO:tasks.rados.rados.0.smithi084.stdout:1619: finishing rollback tid 1 to smithi08477944-41 2024-03-30T12:27:57.542 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 889 (ObjNum 33 snap 0 seq_num 1555112680) dirty dne 2024-03-30T12:27:57.542 INFO:tasks.rados.rados.0.smithi084.stdout:1618: finishing write tid 2 to smithi08477944-10 2024-03-30T12:27:57.542 INFO:tasks.rados.rados.0.smithi084.stdout:1618: finishing write tid 3 to smithi08477944-10 2024-03-30T12:27:57.542 INFO:tasks.rados.rados.0.smithi084.stdout:1618: finishing write tid 4 to smithi08477944-10 2024-03-30T12:27:57.542 INFO:tasks.rados.rados.0.smithi084.stdout:1618: finishing write tid 5 to smithi08477944-10 2024-03-30T12:27:57.542 INFO:tasks.rados.rados.0.smithi084.stdout:1618: oid 10 updating version 0 to 797 2024-03-30T12:27:57.542 INFO:tasks.rados.rados.0.smithi084.stdout:1618: oid 10 version 797 is already newer than 794 2024-03-30T12:27:57.542 INFO:tasks.rados.rados.0.smithi084.stdout:1618: oid 10 version 797 is already newer than 796 2024-03-30T12:27:57.542 INFO:tasks.rados.rados.0.smithi084.stdout:1618: oid 10 version 797 is already newer than 795 2024-03-30T12:27:57.543 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 797 (ObjNum 512 snap 162 seq_num 512) dirty exists 2024-03-30T12:27:57.543 INFO:tasks.rados.rados.0.smithi084.stdout:1618: left oid 10 (ObjNum 512 snap 162 seq_num 512) 2024-03-30T12:27:57.543 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 412 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:27:57.546 INFO:tasks.rados.rados.0.smithi084.stdout:1618: done (4 left) 2024-03-30T12:27:57.546 INFO:tasks.rados.rados.0.smithi084.stdout:1619: done (3 left) 2024-03-30T12:27:57.546 INFO:tasks.rados.rados.0.smithi084.stdout:1620: done (2 left) 2024-03-30T12:27:57.546 INFO:tasks.rados.rados.0.smithi084.stdout:1621: done (1 left) 2024-03-30T12:27:57.547 INFO:tasks.rados.rados.0.smithi084.stdout:1623: done (0 left) 2024-03-30T12:27:57.547 INFO:tasks.rados.rados.0.smithi084.stdout:1624: snap_create 2024-03-30T12:27:57.824 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:57.548+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:57.825 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:57 smithi084 ceph-mon[91810]: osdmap e397: 8 total, 7 up, 8 in 2024-03-30T12:27:57.825 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:57.825 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:57.825 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:57.825 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:57.825 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:57 smithi084 ceph-mon[91810]: pgmap v278: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 77 active+clean, 32 active+undersized, 4 active+clean+snaptrim_error, 6 active+undersized+degraded; 230 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 3.3 MiB/s rd, 636 KiB/s wr, 4 op/s; 49/501 objects degraded (9.780%) 2024-03-30T12:27:57.825 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:57 smithi084 ceph-mon[91810]: from='osd.3 [v2:172.21.15.84:6826/2970863287,v1:172.21.15.84:6827/2970863287]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-30T12:27:57.825 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:57 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:57.825 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:57 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:57.826 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:57 smithi084 ceph-mon[89279]: osdmap e397: 8 total, 7 up, 8 in 2024-03-30T12:27:57.826 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:57.826 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:57.826 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:57.826 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:57.826 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:57 smithi084 ceph-mon[89279]: pgmap v278: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 77 active+clean, 32 active+undersized, 4 active+clean+snaptrim_error, 6 active+undersized+degraded; 230 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 3.3 MiB/s rd, 636 KiB/s wr, 4 op/s; 49/501 objects degraded (9.780%) 2024-03-30T12:27:57.826 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:57 smithi084 ceph-mon[89279]: from='osd.3 [v2:172.21.15.84:6826/2970863287,v1:172.21.15.84:6827/2970863287]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-30T12:27:57.826 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:57.826 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:57.827 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3[111861]: 2024-03-30T12:27:57.584+0000 7fa71116b700 -1 osd.3 388 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T12:27:57.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:57 smithi162 ceph-mon[83709]: osdmap e397: 8 total, 7 up, 8 in 2024-03-30T12:27:57.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:57.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:57.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:57.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:57.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:57 smithi162 ceph-mon[83709]: pgmap v278: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 77 active+clean, 32 active+undersized, 4 active+clean+snaptrim_error, 6 active+undersized+degraded; 230 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 3.3 MiB/s rd, 636 KiB/s wr, 4 op/s; 49/501 objects degraded (9.780%) 2024-03-30T12:27:57.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:57 smithi162 ceph-mon[83709]: from='osd.3 [v2:172.21.15.84:6826/2970863287,v1:172.21.15.84:6827/2970863287]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-30T12:27:57.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:57 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:57.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:57 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:58.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:57.832+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:58.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:57.832+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:58.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:57.832+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:58.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:57.833+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:58.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:57.833+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:58.548 INFO:tasks.rados.rados.0.smithi084.stdout:1624: done (0 left) 2024-03-30T12:27:58.548 INFO:tasks.rados.rados.0.smithi084.stdout:1625: read oid 15 snap 161 2024-03-30T12:27:58.548 INFO:tasks.rados.rados.0.smithi084.stdout:1625: expect deleted 2024-03-30T12:27:58.548 INFO:tasks.rados.rados.0.smithi084.stdout:1626: setattr oid 3 current snap is 163 2024-03-30T12:27:58.550 INFO:tasks.rados.rados.0.smithi084.stdout:1627: snap_remove snap 162 2024-03-30T12:27:58.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:58 smithi162 ceph-mon[83709]: Health check update: Degraded data redundancy: 49/501 objects degraded (9.780%), 8 pgs degraded (PG_DEGRADED) 2024-03-30T12:27:58.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:58 smithi162 ceph-mon[83709]: from='osd.3 [v2:172.21.15.84:6826/2970863287,v1:172.21.15.84:6827/2970863287]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-30T12:27:58.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:58.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:58 smithi162 ceph-mon[83709]: osdmap e398: 8 total, 7 up, 8 in 2024-03-30T12:27:58.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:58 smithi162 ceph-mon[83709]: from='osd.3 [v2:172.21.15.84:6826/2970863287,v1:172.21.15.84:6827/2970863287]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:27:58.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:58.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:58.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:58.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:58 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:58.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:58 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:58.988 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:58.564+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:58.988 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:58.565+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:58.989 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:58.565+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:58.989 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:58.570+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:58.989 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:58 smithi084 ceph-mon[89279]: Health check update: Degraded data redundancy: 49/501 objects degraded (9.780%), 8 pgs degraded (PG_DEGRADED) 2024-03-30T12:27:58.989 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:58 smithi084 ceph-mon[89279]: from='osd.3 [v2:172.21.15.84:6826/2970863287,v1:172.21.15.84:6827/2970863287]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-30T12:27:58.989 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:58.989 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:58 smithi084 ceph-mon[89279]: osdmap e398: 8 total, 7 up, 8 in 2024-03-30T12:27:58.989 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:58 smithi084 ceph-mon[89279]: from='osd.3 [v2:172.21.15.84:6826/2970863287,v1:172.21.15.84:6827/2970863287]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:27:58.989 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:58.989 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:58.990 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:58.990 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:58 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:58.990 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:58 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:58.990 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:58 smithi084 ceph-mon[91810]: Health check update: Degraded data redundancy: 49/501 objects degraded (9.780%), 8 pgs degraded (PG_DEGRADED) 2024-03-30T12:27:58.990 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:58 smithi084 ceph-mon[91810]: from='osd.3 [v2:172.21.15.84:6826/2970863287,v1:172.21.15.84:6827/2970863287]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-30T12:27:58.990 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:58.990 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:58 smithi084 ceph-mon[91810]: osdmap e398: 8 total, 7 up, 8 in 2024-03-30T12:27:58.990 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:58 smithi084 ceph-mon[91810]: from='osd.3 [v2:172.21.15.84:6826/2970863287,v1:172.21.15.84:6827/2970863287]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-03-30T12:27:58.990 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:58.990 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:58.990 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:58.991 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:58 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:58.991 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:58 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:27:59.550 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:27:59] "GET /metrics HTTP/1.1" 200 36265 "" "Prometheus/2.43.0" 2024-03-30T12:27:59.551 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-mon[89279]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T12:27:59.551 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-mon[89279]: osd.3 [v2:172.21.15.84:6826/2970863287,v1:172.21.15.84:6827/2970863287] boot 2024-03-30T12:27:59.551 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-mon[89279]: osdmap e399: 8 total, 8 up, 8 in 2024-03-30T12:27:59.551 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:27:59.551 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:59.552 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:59.552 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:59.552 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:59.552 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-mon[89279]: pgmap v281: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 77 active+clean, 32 active+undersized, 4 active+clean+snaptrim_error, 6 active+undersized+degraded; 232 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 4.1 MiB/s rd, 970 KiB/s wr, 6 op/s; 49/504 objects degraded (9.722%) 2024-03-30T12:27:59.552 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:59.558+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:59.552 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:59.558+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:59.552 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-mon[91810]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T12:27:59.553 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-mon[91810]: osd.3 [v2:172.21.15.84:6826/2970863287,v1:172.21.15.84:6827/2970863287] boot 2024-03-30T12:27:59.553 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-mon[91810]: osdmap e399: 8 total, 8 up, 8 in 2024-03-30T12:27:59.553 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:27:59.553 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:59.553 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:59.553 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:59.553 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:59.553 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-mon[91810]: pgmap v281: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 77 active+clean, 32 active+undersized, 4 active+clean+snaptrim_error, 6 active+undersized+degraded; 232 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 4.1 MiB/s rd, 970 KiB/s wr, 6 op/s; 49/504 objects degraded (9.722%) 2024-03-30T12:27:59.553 INFO:tasks.rados.rados.0.smithi084.stdout:1627: done (2 left) 2024-03-30T12:27:59.553 INFO:tasks.rados.rados.0.smithi084.stdout:1628: read oid 42 snap 159 2024-03-30T12:27:59.553 INFO:tasks.rados.rados.0.smithi084.stdout:1628: expect (ObjNum 502 snap 157 seq_num 502) 2024-03-30T12:27:59.554 INFO:tasks.rados.rados.0.smithi084.stdout:1629: snap_create 2024-03-30T12:27:59.554 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 883 (ObjNum 405 snap 128 seq_num 405) dirty exists 2024-03-30T12:27:59.600 INFO:tasks.rados.rados.0.smithi084.stdout:1628: expect (ObjNum 502 snap 157 seq_num 502) 2024-03-30T12:27:59.844 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:59.569+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:59.844 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:27:59.639+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:27:59.845 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:59.560+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:59.845 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:59.561+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:59.845 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:59.561+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:59.845 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:59.575+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:27:59.845 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:27:59.575+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:27:59.846 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:27:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3[111861]: 2024-03-30T12:27:59.585+0000 7fa6fe946700 -1 osd.3 pg_epoch: 400 pg[5.1s1( v 386'525 (0'0,386'525] local-lis/les=399/400 n=7 ec=71/71 lis/c=399/399 les/c/f=400/400/0 sis=399) [4,3,7]p4(0) r=1 lpr=399 luod=0'0 crt=386'525 lcod 0'0 mlcod 0'0 active mbc={} ps=[97~1,99~1,9d~1,a0~2,a8~24,cd~8,d6~4]] update_snap_map remove_oid 5:84fd3c62:::smithi08477944-19:d8 failed with -2 2024-03-30T12:27:59.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:59 smithi162 ceph-mon[83709]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T12:27:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:59 smithi162 ceph-mon[83709]: osd.3 [v2:172.21.15.84:6826/2970863287,v1:172.21.15.84:6827/2970863287] boot 2024-03-30T12:27:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:59 smithi162 ceph-mon[83709]: osdmap e399: 8 total, 8 up, 8 in 2024-03-30T12:27:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T12:27:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:27:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:27:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:27:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:27:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:27:59 smithi162 ceph-mon[83709]: pgmap v281: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 77 active+clean, 32 active+undersized, 4 active+clean+snaptrim_error, 6 active+undersized+degraded; 232 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 4.1 MiB/s rd, 970 KiB/s wr, 6 op/s; 49/504 objects degraded (9.722%) 2024-03-30T12:28:00.562 INFO:tasks.rados.rados.0.smithi084.stdout:1625: done (3 left) 2024-03-30T12:28:00.562 INFO:tasks.rados.rados.0.smithi084.stdout:1626: done (2 left) 2024-03-30T12:28:00.562 INFO:tasks.rados.rados.0.smithi084.stdout:1628: done (1 left) 2024-03-30T12:28:00.562 INFO:tasks.rados.rados.0.smithi084.stdout:1629: done (0 left) 2024-03-30T12:28:00.563 INFO:tasks.rados.rados.0.smithi084.stdout:1630: snap_remove snap 141 2024-03-30T12:28:00.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:00.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:00 smithi162 ceph-mon[83709]: osdmap e400: 8 total, 8 up, 8 in 2024-03-30T12:28:00.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:00.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:00.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:00.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:00.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:00.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:00 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:00.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:00 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:28:00.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:00.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:00 smithi084 ceph-mon[91810]: osdmap e400: 8 total, 8 up, 8 in 2024-03-30T12:28:00.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:00.944 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:00.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:00.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:00.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:00.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:00 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:00.945 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:00 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:28:00.945 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:00.945 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:00 smithi084 ceph-mon[89279]: osdmap e400: 8 total, 8 up, 8 in 2024-03-30T12:28:00.945 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:00.945 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:00.945 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:00.946 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:00.946 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:00.946 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:00 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:00.946 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:00 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:28:01.489 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:01.468+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:01.489 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:01.468+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:01.570 INFO:tasks.rados.rados.0.smithi084.stdout:1630: done (0 left) 2024-03-30T12:28:01.570 INFO:tasks.rados.rados.0.smithi084.stdout:1631: delete oid 31 current snap is 164 2024-03-30T12:28:01.580 INFO:tasks.rados.rados.0.smithi084.stdout:1631: done (0 left) 2024-03-30T12:28:01.580 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 164 2024-03-30T12:28:01.580 INFO:tasks.rados.rados.0.smithi084.stdout:1632: seq_num 515 ranges {0=630784,630784=565248,1196032=237568} 2024-03-30T12:28:01.584 INFO:tasks.rados.rados.0.smithi084.stdout:1632: writing smithi08477944-37 from 0 to 630784 tid 1 2024-03-30T12:28:01.587 INFO:tasks.rados.rados.0.smithi084.stdout:1632: writing smithi08477944-37 from 630784 to 1196032 tid 2 2024-03-30T12:28:01.589 INFO:tasks.rados.rados.0.smithi084.stdout:1632: writing smithi08477944-37 from 1196032 to 1433600 tid 3 2024-03-30T12:28:01.589 INFO:tasks.rados.rados.0.smithi084.stdout:1633: rmattr oid 7 current snap is 164 2024-03-30T12:28:01.589 INFO:tasks.rados.rados.0.smithi084.stdout:1633: done (1 left) 2024-03-30T12:28:01.589 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 164 2024-03-30T12:28:01.589 INFO:tasks.rados.rados.0.smithi084.stdout:1632: finishing write tid 1 to smithi08477944-37 2024-03-30T12:28:01.589 INFO:tasks.rados.rados.0.smithi084.stdout:1634: seq_num 516 ranges {0=647168,647168=450560,1097728=352256} 2024-03-30T12:28:01.592 INFO:tasks.rados.rados.0.smithi084.stdout:1634: writing smithi08477944-1 from 0 to 647168 tid 1 2024-03-30T12:28:01.595 INFO:tasks.rados.rados.0.smithi084.stdout:1634: writing smithi08477944-1 from 647168 to 1097728 tid 2 2024-03-30T12:28:01.598 INFO:tasks.rados.rados.0.smithi084.stdout:1634: writing smithi08477944-1 from 1097728 to 1449984 tid 3 2024-03-30T12:28:01.598 INFO:tasks.rados.rados.0.smithi084.stdout:1635: snap_create 2024-03-30T12:28:01.598 INFO:tasks.rados.rados.0.smithi084.stdout:1632: finishing write tid 2 to smithi08477944-37 2024-03-30T12:28:01.598 INFO:tasks.rados.rados.0.smithi084.stdout:1632: finishing write tid 3 to smithi08477944-37 2024-03-30T12:28:01.598 INFO:tasks.rados.rados.0.smithi084.stdout:1632: finishing write tid 4 to smithi08477944-37 2024-03-30T12:28:01.598 INFO:tasks.rados.rados.0.smithi084.stdout:1632: finishing write tid 5 to smithi08477944-37 2024-03-30T12:28:01.598 INFO:tasks.rados.rados.0.smithi084.stdout:1632: oid 37 updating version 0 to 802 2024-03-30T12:28:01.598 INFO:tasks.rados.rados.0.smithi084.stdout:1632: oid 37 version 802 is already newer than 800 2024-03-30T12:28:01.598 INFO:tasks.rados.rados.0.smithi084.stdout:1632: oid 37 version 802 is already newer than 801 2024-03-30T12:28:01.598 INFO:tasks.rados.rados.0.smithi084.stdout:1632: oid 37 version 802 is already newer than 799 2024-03-30T12:28:01.598 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 802 (ObjNum 515 snap 164 seq_num 515) dirty exists 2024-03-30T12:28:01.598 INFO:tasks.rados.rados.0.smithi084.stdout:1632: left oid 37 (ObjNum 515 snap 164 seq_num 515) 2024-03-30T12:28:01.598 INFO:tasks.rados.rados.0.smithi084.stdout:1634: finishing write tid 1 to smithi08477944-1 2024-03-30T12:28:01.599 INFO:tasks.rados.rados.0.smithi084.stdout:1634: finishing write tid 2 to smithi08477944-1 2024-03-30T12:28:01.600 INFO:tasks.rados.rados.0.smithi084.stdout:1634: finishing write tid 3 to smithi08477944-1 2024-03-30T12:28:01.600 INFO:tasks.rados.rados.0.smithi084.stdout:1634: finishing write tid 4 to smithi08477944-1 2024-03-30T12:28:01.601 INFO:tasks.rados.rados.0.smithi084.stdout:1634: finishing write tid 5 to smithi08477944-1 2024-03-30T12:28:01.601 INFO:tasks.rados.rados.0.smithi084.stdout:1634: oid 1 updating version 0 to 668 2024-03-30T12:28:01.602 INFO:tasks.rados.rados.0.smithi084.stdout:1634: oid 1 version 668 is already newer than 667 2024-03-30T12:28:01.602 INFO:tasks.rados.rados.0.smithi084.stdout:1634: oid 1 version 668 is already newer than 665 2024-03-30T12:28:01.602 INFO:tasks.rados.rados.0.smithi084.stdout:1634: oid 1 version 668 is already newer than 666 2024-03-30T12:28:01.602 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 668 (ObjNum 516 snap 164 seq_num 516) dirty exists 2024-03-30T12:28:01.602 INFO:tasks.rados.rados.0.smithi084.stdout:1634: left oid 1 (ObjNum 516 snap 164 seq_num 516) 2024-03-30T12:28:01.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:01 smithi084 ceph-mon[91810]: osdmap e401: 8 total, 8 up, 8 in 2024-03-30T12:28:01.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:01 smithi084 ceph-mon[91810]: pgmap v284: 121 pgs: 6 peering, 2 active+undersized+degraded+snaptrim_error, 86 active+clean, 20 active+undersized, 4 active+clean+snaptrim_error, 3 active+undersized+degraded; 229 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 853 KiB/s rd, 672 KiB/s wr, 14 op/s; 36/501 objects degraded (7.186%) 2024-03-30T12:28:01.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:01 smithi084 ceph-mon[89279]: osdmap e401: 8 total, 8 up, 8 in 2024-03-30T12:28:01.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:01 smithi084 ceph-mon[89279]: pgmap v284: 121 pgs: 6 peering, 2 active+undersized+degraded+snaptrim_error, 86 active+clean, 20 active+undersized, 4 active+clean+snaptrim_error, 3 active+undersized+degraded; 229 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 853 KiB/s rd, 672 KiB/s wr, 14 op/s; 36/501 objects degraded (7.186%) 2024-03-30T12:28:01.755 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:01.578+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:01.755 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:01.579+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:01.755 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:28:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3[111861]: 2024-03-30T12:28:01.580+0000 7fa6fe946700 -1 osd.3 pg_epoch: 401 pg[5.1s1( v 400'529 (0'0,400'529] local-lis/les=399/400 n=6 ec=71/71 lis/c=399/399 les/c/f=400/400/0 sis=399) [4,3,7]p4(0) r=1 lpr=399 luod=0'0 crt=400'529 mlcod 400'529 active mbc={} ps=[97~1,99~1,9d~1,a0~2,a8~24,cd~11,e1~1]] update_snap_map remove_oid 5:84fd3c62:::smithi08477944-19:d1 failed with -2 2024-03-30T12:28:01.756 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:28:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3[111861]: 2024-03-30T12:28:01.583+0000 7fa6fa93e700 -1 osd.3 pg_epoch: 402 pg[5.1s1( v 402'531 (0'0,402'531] local-lis/les=399/400 n=5 ec=71/71 lis/c=399/399 les/c/f=400/400/0 sis=399) [4,3,7]p4(0) r=1 lpr=399 luod=0'0 crt=400'529 mlcod 400'529 active mbc={} ps=[97~1,99~1,9d~1,a0~2,a8~24,cd~11,e1~1]] update_snap_map remove_oid 5:830e7f70:::smithi08477944-44:cc failed with -2 2024-03-30T12:28:01.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:01.498+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:01.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:01.498+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:01.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:01.498+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:01.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:01.498+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:01.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:01.583+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:01.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:01.583+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:01.757 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:01.583+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:01.757 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:01.583+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:01.757 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:01.584+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:01.757 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:01.585+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:01.757 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:01.585+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:01.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:01 smithi162 ceph-mon[83709]: osdmap e401: 8 total, 8 up, 8 in 2024-03-30T12:28:01.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:01 smithi162 ceph-mon[83709]: pgmap v284: 121 pgs: 6 peering, 2 active+undersized+degraded+snaptrim_error, 86 active+clean, 20 active+undersized, 4 active+clean+snaptrim_error, 3 active+undersized+degraded; 229 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 853 KiB/s rd, 672 KiB/s wr, 14 op/s; 36/501 objects degraded (7.186%) 2024-03-30T12:28:02.254 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:28:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:28:01.809+0000 7f1f562eb700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-03-30T12:28:02.581 INFO:tasks.rados.rados.0.smithi084.stdout:1632: done (2 left) 2024-03-30T12:28:02.581 INFO:tasks.rados.rados.0.smithi084.stdout:1634: done (1 left) 2024-03-30T12:28:02.581 INFO:tasks.rados.rados.0.smithi084.stdout:1635: done (0 left) 2024-03-30T12:28:02.581 INFO:tasks.rados.rados.0.smithi084.stdout:1636: read oid 48 snap -1 2024-03-30T12:28:02.581 INFO:tasks.rados.rados.0.smithi084.stdout:1636: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:28:02.581 INFO:tasks.rados.rados.0.smithi084.stdout:1637: snap_create 2024-03-30T12:28:02.582 INFO:tasks.rados.rados.0.smithi084.stdout:1636: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:28:02.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:02.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:02.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:02.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:02.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:02.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:02.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:02 smithi162 ceph-mon[83709]: osdmap e402: 8 total, 8 up, 8 in 2024-03-30T12:28:02.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:02.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:02.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:02.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:02.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:02.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:02.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:02 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:02.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:02 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:02.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:02 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:28:02.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:02 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:28:02.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:02 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:02.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:02 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:28:02.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:02 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:28:02.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:02 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:28:02.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:02 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:28:02.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:02 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-30T12:28:03.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:02.712+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:03.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:02.712+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:03.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:02.710+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:03.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:02.710+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:03.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:02.711+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:03.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:02.711+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[91810]: osdmap e402: 8 total, 8 up, 8 in 2024-03-30T12:28:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:03.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:03.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:03.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:03.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:03.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:28:03.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:28:03.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:03.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:28:03.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:28:03.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:28:03.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:28:03.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-30T12:28:03.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:03.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:03.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:03.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:03.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:03.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:03.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[89279]: osdmap e402: 8 total, 8 up, 8 in 2024-03-30T12:28:03.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:03.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:03.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:03.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:03.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:03.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:03.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:03.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:03.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:28:03.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:28:03.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:03.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:28:03.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:28:03.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:28:03.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:28:03.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:02 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-30T12:28:03.588 INFO:tasks.rados.rados.0.smithi084.stdout:1636: done (1 left) 2024-03-30T12:28:03.588 INFO:tasks.rados.rados.0.smithi084.stdout:1637: done (0 left) 2024-03-30T12:28:03.588 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 166 2024-03-30T12:28:03.588 INFO:tasks.rados.rados.0.smithi084.stdout:1638: seq_num 517 ranges {5496832=663552,6160384=786432,6946816=16384} 2024-03-30T12:28:03.620 INFO:tasks.rados.rados.0.smithi084.stdout:1638: writing smithi08477944-22 from 5496832 to 6160384 tid 1 2024-03-30T12:28:03.624 INFO:tasks.rados.rados.0.smithi084.stdout:1638: writing smithi08477944-22 from 6160384 to 6946816 tid 2 2024-03-30T12:28:03.624 INFO:tasks.rados.rados.0.smithi084.stdout:1638: writing smithi08477944-22 from 6946816 to 6963200 tid 3 2024-03-30T12:28:03.624 INFO:tasks.rados.rados.0.smithi084.stdout:1639: copy_from oid 50 from oid 15 current snap is 166 2024-03-30T12:28:03.624 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 166 2024-03-30T12:28:03.625 INFO:tasks.rados.rados.0.smithi084.stdout:1640: seq_num 518 ranges {0=679936,679936=671744,1351680=131072} 2024-03-30T12:28:03.628 INFO:tasks.rados.rados.0.smithi084.stdout:1640: writing smithi08477944-8 from 0 to 679936 tid 1 2024-03-30T12:28:03.632 INFO:tasks.rados.rados.0.smithi084.stdout:1640: writing smithi08477944-8 from 679936 to 1351680 tid 2 2024-03-30T12:28:03.634 INFO:tasks.rados.rados.0.smithi084.stdout:1640: writing smithi08477944-8 from 1351680 to 1482752 tid 3 2024-03-30T12:28:03.634 INFO:tasks.rados.rados.0.smithi084.stdout:1641: copy_from oid 31 from oid 27 current snap is 166 2024-03-30T12:28:03.634 INFO:tasks.rados.rados.0.smithi084.stdout:1639: finishing copy_from to smithi08477944-50 2024-03-30T12:28:03.634 INFO:tasks.rados.rados.0.smithi084.stdout:1639: got expected ENOENT (src dne) 2024-03-30T12:28:03.634 INFO:tasks.rados.rados.0.smithi084.stdout:1639: finishing copy_from racing read to smithi08477944-50 2024-03-30T12:28:03.634 INFO:tasks.rados.rados.0.smithi084.stdout:1638: finishing write tid 1 to smithi08477944-22 2024-03-30T12:28:03.634 INFO:tasks.rados.rados.0.smithi084.stdout:1638: finishing write tid 2 to smithi08477944-22 2024-03-30T12:28:03.634 INFO:tasks.rados.rados.0.smithi084.stdout:1638: finishing write tid 3 to smithi08477944-22 2024-03-30T12:28:03.634 INFO:tasks.rados.rados.0.smithi084.stdout:1638: finishing write tid 4 to smithi08477944-22 2024-03-30T12:28:03.634 INFO:tasks.rados.rados.0.smithi084.stdout:1639: done (3 left) 2024-03-30T12:28:03.634 INFO:tasks.rados.rados.0.smithi084.stdout:1642: snap_create 2024-03-30T12:28:03.637 INFO:tasks.rados.rados.0.smithi084.stdout:1638: finishing write tid 5 to smithi08477944-22 2024-03-30T12:28:03.637 INFO:tasks.rados.rados.0.smithi084.stdout:1638: oid 22 updating version 0 to 898 2024-03-30T12:28:03.638 INFO:tasks.rados.rados.0.smithi084.stdout:1638: oid 22 updating version 898 to 900 2024-03-30T12:28:03.638 INFO:tasks.rados.rados.0.smithi084.stdout:1638: oid 22 version 900 is already newer than 899 2024-03-30T12:28:03.638 INFO:tasks.rados.rados.0.smithi084.stdout:1638: oid 22 version 900 is already newer than 897 2024-03-30T12:28:03.638 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 900 (ObjNum 517 snap 166 seq_num 517) dirty exists 2024-03-30T12:28:03.638 INFO:tasks.rados.rados.0.smithi084.stdout:1638: left oid 22 (ObjNum 517 snap 166 seq_num 517) 2024-03-30T12:28:03.638 INFO:tasks.rados.rados.0.smithi084.stdout:1641: finishing copy_from to smithi08477944-31 2024-03-30T12:28:03.638 INFO:tasks.rados.rados.0.smithi084.stdout:1641: got expected ENOENT (src dne) 2024-03-30T12:28:03.638 INFO:tasks.rados.rados.0.smithi084.stdout:1640: finishing write tid 1 to smithi08477944-8 2024-03-30T12:28:03.638 INFO:tasks.rados.rados.0.smithi084.stdout:1641: finishing copy_from racing read to smithi08477944-31 2024-03-30T12:28:03.639 INFO:tasks.rados.rados.0.smithi084.stdout:1640: finishing write tid 2 to smithi08477944-8 2024-03-30T12:28:03.639 INFO:tasks.rados.rados.0.smithi084.stdout:1640: finishing write tid 3 to smithi08477944-8 2024-03-30T12:28:03.639 INFO:tasks.rados.rados.0.smithi084.stdout:1640: finishing write tid 4 to smithi08477944-8 2024-03-30T12:28:03.641 INFO:tasks.rados.rados.0.smithi084.stdout:1640: finishing write tid 5 to smithi08477944-8 2024-03-30T12:28:03.641 INFO:tasks.rados.rados.0.smithi084.stdout:1640: oid 8 updating version 0 to 901 2024-03-30T12:28:03.641 INFO:tasks.rados.rados.0.smithi084.stdout:1640: oid 8 updating version 901 to 904 2024-03-30T12:28:03.641 INFO:tasks.rados.rados.0.smithi084.stdout:1640: oid 8 version 904 is already newer than 903 2024-03-30T12:28:03.641 INFO:tasks.rados.rados.0.smithi084.stdout:1640: oid 8 version 904 is already newer than 902 2024-03-30T12:28:03.641 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 904 (ObjNum 518 snap 166 seq_num 518) dirty exists 2024-03-30T12:28:03.641 INFO:tasks.rados.rados.0.smithi084.stdout:1640: left oid 8 (ObjNum 518 snap 166 seq_num 518) 2024-03-30T12:28:03.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:03 smithi162 ceph-mon[83709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-30T12:28:03.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:03 smithi162 ceph-mon[83709]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-03-30T12:28:03.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:03 smithi162 ceph-mon[83709]: osdmap e403: 8 total, 8 up, 8 in 2024-03-30T12:28:03.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:03 smithi162 ceph-mon[83709]: pgmap v287: 121 pgs: 6 peering, 1 active+undersized+degraded+snaptrim_error, 106 active+clean, 2 active+undersized, 5 active+clean+snaptrim_error, 1 active+undersized+degraded; 229 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 6.4 MiB/s rd, 338 KiB/s wr, 13 op/s; 6/501 objects degraded (1.198%); 1.7 MiB/s, 0 objects/s recovering 2024-03-30T12:28:03.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:03.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:03.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:03.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:03.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:03.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:04.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:03.636+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:04.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:03.637+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:04.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-mon[91810]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-30T12:28:04.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-mon[91810]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-03-30T12:28:04.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-mon[91810]: osdmap e403: 8 total, 8 up, 8 in 2024-03-30T12:28:04.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-mon[91810]: pgmap v287: 121 pgs: 6 peering, 1 active+undersized+degraded+snaptrim_error, 106 active+clean, 2 active+undersized, 5 active+clean+snaptrim_error, 1 active+undersized+degraded; 229 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 6.4 MiB/s rd, 338 KiB/s wr, 13 op/s; 6/501 objects degraded (1.198%); 1.7 MiB/s, 0 objects/s recovering 2024-03-30T12:28:04.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:04.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:04.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:04.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:04.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:04.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:04.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-mon[89279]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-30T12:28:04.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-mon[89279]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-03-30T12:28:04.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-mon[89279]: osdmap e403: 8 total, 8 up, 8 in 2024-03-30T12:28:04.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-mon[89279]: pgmap v287: 121 pgs: 6 peering, 1 active+undersized+degraded+snaptrim_error, 106 active+clean, 2 active+undersized, 5 active+clean+snaptrim_error, 1 active+undersized+degraded; 229 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 6.4 MiB/s rd, 338 KiB/s wr, 13 op/s; 6/501 objects degraded (1.198%); 1.7 MiB/s, 0 objects/s recovering 2024-03-30T12:28:04.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:04.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:04.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:04.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:04.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:04.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:04.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:03.595+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:04.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:03.595+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:04.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:03.595+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:04.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:03.595+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:04.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:03.595+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:04.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:03.595+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:04.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:03.595+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:04.596 INFO:tasks.rados.rados.0.smithi084.stdout:1638: done (3 left) 2024-03-30T12:28:04.596 INFO:tasks.rados.rados.0.smithi084.stdout:1640: done (2 left) 2024-03-30T12:28:04.596 INFO:tasks.rados.rados.0.smithi084.stdout:1641: done (1 left) 2024-03-30T12:28:04.596 INFO:tasks.rados.rados.0.smithi084.stdout:1642: done (0 left) 2024-03-30T12:28:04.596 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 167 2024-03-30T12:28:04.596 INFO:tasks.rados.rados.0.smithi084.stdout:1643: seq_num 519 ranges {3694592=696320,4390912=548864,4939776=253952} 2024-03-30T12:28:04.621 INFO:tasks.rados.rados.0.smithi084.stdout:1643: writing smithi08477944-43 from 3694592 to 4390912 tid 1 2024-03-30T12:28:04.625 INFO:tasks.rados.rados.0.smithi084.stdout:1643: writing smithi08477944-43 from 4390912 to 4939776 tid 2 2024-03-30T12:28:04.627 INFO:tasks.rados.rados.0.smithi084.stdout:1643: writing smithi08477944-43 from 4939776 to 5193728 tid 3 2024-03-30T12:28:04.627 INFO:tasks.rados.rados.0.smithi084.stdout:1644: delete oid 18 current snap is 167 2024-03-30T12:28:04.642 INFO:tasks.rados.rados.0.smithi084.stdout:1643: finishing write tid 1 to smithi08477944-43 2024-03-30T12:28:04.643 INFO:tasks.rados.rados.0.smithi084.stdout:1643: finishing write tid 2 to smithi08477944-43 2024-03-30T12:28:04.643 INFO:tasks.rados.rados.0.smithi084.stdout:1643: finishing write tid 3 to smithi08477944-43 2024-03-30T12:28:04.643 INFO:tasks.rados.rados.0.smithi084.stdout:1643: finishing write tid 4 to smithi08477944-43 2024-03-30T12:28:04.646 INFO:tasks.rados.rados.0.smithi084.stdout:1643: finishing write tid 5 to smithi08477944-43 2024-03-30T12:28:04.646 INFO:tasks.rados.rados.0.smithi084.stdout:1643: oid 43 updating version 0 to 667 2024-03-30T12:28:04.646 INFO:tasks.rados.rados.0.smithi084.stdout:1643: oid 43 version 667 is already newer than 665 2024-03-30T12:28:04.646 INFO:tasks.rados.rados.0.smithi084.stdout:1643: oid 43 updating version 667 to 668 2024-03-30T12:28:04.646 INFO:tasks.rados.rados.0.smithi084.stdout:1643: oid 43 version 668 is already newer than 666 2024-03-30T12:28:04.646 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 668 (ObjNum 519 snap 167 seq_num 519) dirty exists 2024-03-30T12:28:04.646 INFO:tasks.rados.rados.0.smithi084.stdout:1643: left oid 43 (ObjNum 519 snap 167 seq_num 519) 2024-03-30T12:28:04.647 INFO:tasks.rados.rados.0.smithi084.stdout:1643: done (1 left) 2024-03-30T12:28:04.647 INFO:tasks.rados.rados.0.smithi084.stdout:1644: done (0 left) 2024-03-30T12:28:04.647 INFO:tasks.rados.rados.0.smithi084.stdout:1645: read oid 36 snap -1 2024-03-30T12:28:04.647 INFO:tasks.rados.rados.0.smithi084.stdout:1645: expect (ObjNum 489 snap 154 seq_num 489) 2024-03-30T12:28:04.647 INFO:tasks.rados.rados.0.smithi084.stdout:1646: read oid 16 snap -1 2024-03-30T12:28:04.647 INFO:tasks.rados.rados.0.smithi084.stdout:1646: expect (ObjNum 395 snap 125 seq_num 395) 2024-03-30T12:28:04.647 INFO:tasks.rados.rados.0.smithi084.stdout:1647: snap_create 2024-03-30T12:28:04.658 INFO:tasks.rados.rados.0.smithi084.stdout:1646: expect (ObjNum 395 snap 125 seq_num 395) 2024-03-30T12:28:04.728 INFO:tasks.rados.rados.0.smithi084.stdout:1645: expect (ObjNum 489 snap 154 seq_num 489) 2024-03-30T12:28:04.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:04 smithi162 ceph-mon[83709]: Health check update: Degraded data redundancy: 6/501 objects degraded (1.198%), 2 pgs degraded (PG_DEGRADED) 2024-03-30T12:28:04.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:04.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:04.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:04.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:04.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:04 smithi162 ceph-mon[83709]: osdmap e404: 8 total, 8 up, 8 in 2024-03-30T12:28:04.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:04.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:05.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:04.659+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:05.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:04.668+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:05.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:04 smithi084 ceph-mon[91810]: Health check update: Degraded data redundancy: 6/501 objects degraded (1.198%), 2 pgs degraded (PG_DEGRADED) 2024-03-30T12:28:05.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:05.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:05.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:05.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:05.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:04 smithi084 ceph-mon[91810]: osdmap e404: 8 total, 8 up, 8 in 2024-03-30T12:28:05.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:05.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:05.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:04.652+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:05.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:04.652+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:05.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:04.653+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:05.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:04.655+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:05.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:04 smithi084 ceph-mon[89279]: Health check update: Degraded data redundancy: 6/501 objects degraded (1.198%), 2 pgs degraded (PG_DEGRADED) 2024-03-30T12:28:05.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:05.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:05.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:05.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset dc=[]:{cd=[cd,cc],dc=[dc,db,da,d5]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:05.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:04 smithi084 ceph-mon[89279]: osdmap e404: 8 total, 8 up, 8 in 2024-03-30T12:28:05.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:05.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:05.606 INFO:tasks.rados.rados.0.smithi084.stdout:1645: done (2 left) 2024-03-30T12:28:05.607 INFO:tasks.rados.rados.0.smithi084.stdout:1646: done (1 left) 2024-03-30T12:28:05.607 INFO:tasks.rados.rados.0.smithi084.stdout:1647: done (0 left) 2024-03-30T12:28:05.607 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 168 2024-03-30T12:28:05.607 INFO:tasks.rados.rados.0.smithi084.stdout:1648: seq_num 521 ranges {1146880=729088,1875968=720896,2596864=81920} 2024-03-30T12:28:05.617 INFO:tasks.rados.rados.0.smithi084.stdout:1648: writing smithi08477944-49 from 1146880 to 1875968 tid 1 2024-03-30T12:28:05.621 INFO:tasks.rados.rados.0.smithi084.stdout:1648: writing smithi08477944-49 from 1875968 to 2596864 tid 2 2024-03-30T12:28:05.622 INFO:tasks.rados.rados.0.smithi084.stdout:1648: writing smithi08477944-49 from 2596864 to 2678784 tid 3 2024-03-30T12:28:05.622 INFO:tasks.rados.rados.0.smithi084.stdout:1649: read oid 38 snap -1 2024-03-30T12:28:05.622 INFO:tasks.rados.rados.0.smithi084.stdout:1649: expect (ObjNum 466 snap 148 seq_num 466) 2024-03-30T12:28:05.622 INFO:tasks.rados.rados.0.smithi084.stdout:1650: delete oid 33 current snap is 168 2024-03-30T12:28:05.625 INFO:tasks.rados.rados.0.smithi084.stdout:1648: finishing write tid 1 to smithi08477944-49 2024-03-30T12:28:05.627 INFO:tasks.rados.rados.0.smithi084.stdout:1648: finishing write tid 2 to smithi08477944-49 2024-03-30T12:28:05.627 INFO:tasks.rados.rados.0.smithi084.stdout:1648: finishing write tid 3 to smithi08477944-49 2024-03-30T12:28:05.627 INFO:tasks.rados.rados.0.smithi084.stdout:1648: finishing write tid 4 to smithi08477944-49 2024-03-30T12:28:05.628 INFO:tasks.rados.rados.0.smithi084.stdout:1648: finishing write tid 5 to smithi08477944-49 2024-03-30T12:28:05.629 INFO:tasks.rados.rados.0.smithi084.stdout:1648: oid 49 updating version 0 to 812 2024-03-30T12:28:05.629 INFO:tasks.rados.rados.0.smithi084.stdout:1648: oid 49 version 812 is already newer than 811 2024-03-30T12:28:05.629 INFO:tasks.rados.rados.0.smithi084.stdout:1648: oid 49 updating version 812 to 813 2024-03-30T12:28:05.629 INFO:tasks.rados.rados.0.smithi084.stdout:1648: oid 49 version 813 is already newer than 810 2024-03-30T12:28:05.629 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 813 (ObjNum 521 snap 168 seq_num 521) dirty exists 2024-03-30T12:28:05.629 INFO:tasks.rados.rados.0.smithi084.stdout:1648: left oid 49 (ObjNum 521 snap 168 seq_num 521) 2024-03-30T12:28:05.631 INFO:tasks.rados.rados.0.smithi084.stdout:1648: done (2 left) 2024-03-30T12:28:05.631 INFO:tasks.rados.rados.0.smithi084.stdout:1650: done (1 left) 2024-03-30T12:28:05.632 INFO:tasks.rados.rados.0.smithi084.stdout:1651: snap_create 2024-03-30T12:28:05.634 INFO:tasks.rados.rados.0.smithi084.stdout:1649: expect (ObjNum 466 snap 148 seq_num 466) 2024-03-30T12:28:05.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:05 smithi162 ceph-mon[83709]: osdmap e405: 8 total, 8 up, 8 in 2024-03-30T12:28:05.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:05.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:05.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:05.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:05.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:05.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:05 smithi162 ceph-mon[83709]: pgmap v290: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 227 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 6.4 MiB/s rd, 354 KiB/s wr, 3 op/s; 1.7 MiB/s, 0 objects/s recovering 2024-03-30T12:28:05.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:06.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:05.629+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:06.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:05.630+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:06.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:05 smithi084 ceph-mon[91810]: osdmap e405: 8 total, 8 up, 8 in 2024-03-30T12:28:06.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:06.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:06.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:06.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:06.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:06.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:05 smithi084 ceph-mon[91810]: pgmap v290: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 227 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 6.4 MiB/s rd, 354 KiB/s wr, 3 op/s; 1.7 MiB/s, 0 objects/s recovering 2024-03-30T12:28:06.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:06.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:05 smithi084 ceph-mon[89279]: osdmap e405: 8 total, 8 up, 8 in 2024-03-30T12:28:06.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:06.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:06.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:06.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:06.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:06.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:05 smithi084 ceph-mon[89279]: pgmap v290: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 227 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 6.4 MiB/s rd, 354 KiB/s wr, 3 op/s; 1.7 MiB/s, 0 objects/s recovering 2024-03-30T12:28:06.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:06.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:05.635+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:06.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:05.635+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:06.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:05.635+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:06.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:05.635+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:06.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:05.636+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:06.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:05.636+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:06.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:05.636+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:06.603 INFO:tasks.rados.rados.0.smithi084.stdout:1649: done (1 left) 2024-03-30T12:28:06.603 INFO:tasks.rados.rados.0.smithi084.stdout:1651: done (0 left) 2024-03-30T12:28:06.603 INFO:tasks.rados.rados.0.smithi084.stdout:1652: snap_create 2024-03-30T12:28:06.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:06 smithi162 ceph-mon[83709]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/501 objects degraded (1.198%), 2 pgs degraded) 2024-03-30T12:28:06.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:06 smithi162 ceph-mon[83709]: osdmap e406: 8 total, 8 up, 8 in 2024-03-30T12:28:06.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:06.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:06.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:06.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:06.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:06.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:07.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:06 smithi084 ceph-mon[91810]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/501 objects degraded (1.198%), 2 pgs degraded) 2024-03-30T12:28:07.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:06 smithi084 ceph-mon[91810]: osdmap e406: 8 total, 8 up, 8 in 2024-03-30T12:28:07.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:07.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:07.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:07.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:07.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:07.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:07.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:06.611+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:07.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:06.611+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:07.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:06.611+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:07.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:06.611+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:06 smithi084 ceph-mon[89279]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/501 objects degraded (1.198%), 2 pgs degraded) 2024-03-30T12:28:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:06 smithi084 ceph-mon[89279]: osdmap e406: 8 total, 8 up, 8 in 2024-03-30T12:28:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:07.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:07.211+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:07.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:07.211+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:07.610 INFO:tasks.rados.rados.0.smithi084.stdout:1652: done (0 left) 2024-03-30T12:28:07.610 INFO:tasks.rados.rados.0.smithi084.stdout:1653: read oid 37 snap 160 2024-03-30T12:28:07.610 INFO:tasks.rados.rados.0.smithi084.stdout:1653: expect (ObjNum 379 snap 120 seq_num 379) 2024-03-30T12:28:07.610 INFO:tasks.rados.rados.0.smithi084.stdout:1654: read oid 11 snap -1 2024-03-30T12:28:07.610 INFO:tasks.rados.rados.0.smithi084.stdout:1654: expect (ObjNum 280 snap 90 seq_num 280) 2024-03-30T12:28:07.610 INFO:tasks.rados.rados.0.smithi084.stdout:1655: read oid 3 snap -1 2024-03-30T12:28:07.610 INFO:tasks.rados.rados.0.smithi084.stdout:1655: expect (ObjNum 405 snap 128 seq_num 405) 2024-03-30T12:28:07.611 INFO:tasks.rados.rados.0.smithi084.stdout:1656: snap_create 2024-03-30T12:28:07.623 INFO:tasks.rados.rados.0.smithi084.stdout:1655: expect (ObjNum 405 snap 128 seq_num 405) 2024-03-30T12:28:07.681 INFO:tasks.rados.rados.0.smithi084.stdout:1653: expect (ObjNum 379 snap 120 seq_num 379) 2024-03-30T12:28:07.784 INFO:tasks.rados.rados.0.smithi084.stdout:1654: expect (ObjNum 280 snap 90 seq_num 280) 2024-03-30T12:28:07.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:07.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:07.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:07.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:07.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:07 smithi162 ceph-mon[83709]: osdmap e407: 8 total, 8 up, 8 in 2024-03-30T12:28:07.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:07 smithi162 ceph-mon[83709]: pgmap v293: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 200 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 6.3 MiB/s rd, 2.1 MiB/s wr, 8 op/s 2024-03-30T12:28:08.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:07.625+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:08.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:07.625+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:08.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:08.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:08.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:08.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:08.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:07 smithi084 ceph-mon[91810]: osdmap e407: 8 total, 8 up, 8 in 2024-03-30T12:28:08.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:07 smithi084 ceph-mon[91810]: pgmap v293: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 200 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 6.3 MiB/s rd, 2.1 MiB/s wr, 8 op/s 2024-03-30T12:28:08.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:08.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:08.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:08.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:08.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:07 smithi084 ceph-mon[89279]: osdmap e407: 8 total, 8 up, 8 in 2024-03-30T12:28:08.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:07 smithi084 ceph-mon[89279]: pgmap v293: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 200 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 6.3 MiB/s rd, 2.1 MiB/s wr, 8 op/s 2024-03-30T12:28:08.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:07.625+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:08.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:07.625+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:08.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:07.626+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:08.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:07.626+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:08.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:07.626+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:08.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:07.626+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:08.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:07.626+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:08.611 INFO:tasks.rados.rados.0.smithi084.stdout:1653: done (3 left) 2024-03-30T12:28:08.611 INFO:tasks.rados.rados.0.smithi084.stdout:1654: done (2 left) 2024-03-30T12:28:08.611 INFO:tasks.rados.rados.0.smithi084.stdout:1655: done (1 left) 2024-03-30T12:28:08.611 INFO:tasks.rados.rados.0.smithi084.stdout:1656: done (0 left) 2024-03-30T12:28:08.611 INFO:tasks.rados.rados.0.smithi084.stdout:1657: read oid 11 snap -1 2024-03-30T12:28:08.611 INFO:tasks.rados.rados.0.smithi084.stdout:1657: expect (ObjNum 280 snap 90 seq_num 280) 2024-03-30T12:28:08.611 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 171 2024-03-30T12:28:08.611 INFO:tasks.rados.rados.0.smithi084.stdout:1658: seq_num 523 ranges {5488640=770048,6258688=491520,6750208=311296} 2024-03-30T12:28:08.645 INFO:tasks.rados.rados.0.smithi084.stdout:1658: writing smithi08477944-34 from 5488640 to 6258688 tid 1 2024-03-30T12:28:08.647 INFO:tasks.rados.rados.0.smithi084.stdout:1658: writing smithi08477944-34 from 6258688 to 6750208 tid 2 2024-03-30T12:28:08.650 INFO:tasks.rados.rados.0.smithi084.stdout:1658: writing smithi08477944-34 from 6750208 to 7061504 tid 3 2024-03-30T12:28:08.650 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 171 2024-03-30T12:28:08.650 INFO:tasks.rados.rados.0.smithi084.stdout:1659: seq_num 524 ranges {3514368=786432,4300800=778240,5079040=24576} 2024-03-30T12:28:08.673 INFO:tasks.rados.rados.0.smithi084.stdout:1659: writing smithi08477944-45 from 3514368 to 4300800 tid 1 2024-03-30T12:28:08.678 INFO:tasks.rados.rados.0.smithi084.stdout:1659: writing smithi08477944-45 from 4300800 to 5079040 tid 2 2024-03-30T12:28:08.678 INFO:tasks.rados.rados.0.smithi084.stdout:1659: writing smithi08477944-45 from 5079040 to 5103616 tid 3 2024-03-30T12:28:08.678 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 171 2024-03-30T12:28:08.678 INFO:tasks.rados.rados.0.smithi084.stdout:1660: seq_num 525 ranges {9830400=802816,10633216=712704,11345920=90112} 2024-03-30T12:28:08.734 INFO:tasks.rados.rados.0.smithi084.stdout:1660: writing smithi08477944-25 from 9830400 to 10633216 tid 1 2024-03-30T12:28:08.738 INFO:tasks.rados.rados.0.smithi084.stdout:1660: writing smithi08477944-25 from 10633216 to 11345920 tid 2 2024-03-30T12:28:08.739 INFO:tasks.rados.rados.0.smithi084.stdout:1660: writing smithi08477944-25 from 11345920 to 11436032 tid 3 2024-03-30T12:28:08.739 INFO:tasks.rados.rados.0.smithi084.stdout:1661: rollback oid 6 current snap is 171 2024-03-30T12:28:08.739 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 6 to 166 2024-03-30T12:28:08.739 INFO:tasks.rados.rados.0.smithi084.stdout:1657: expect (ObjNum 280 snap 90 seq_num 280) 2024-03-30T12:28:08.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:08.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:08.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:08 smithi162 ceph-mon[83709]: osdmap e408: 8 total, 8 up, 8 in 2024-03-30T12:28:08.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:08.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:08 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:08.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:08.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:08.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:08 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:08.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:08 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:08.891 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:08.892 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:08.892 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:08 smithi084 ceph-mon[91810]: osdmap e408: 8 total, 8 up, 8 in 2024-03-30T12:28:08.892 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:08.892 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:08 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:08.892 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:08.892 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:08.892 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:08 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:08.892 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:08 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:08.892 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:08.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:08.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:08 smithi084 ceph-mon[89279]: osdmap e408: 8 total, 8 up, 8 in 2024-03-30T12:28:08.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:08.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:08 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:08.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:08.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:08.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:08 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:08.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:08 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:08.893 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:08.626+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:08.893 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:08.626+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:08.893 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:08.626+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:08.894 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:08.627+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:08.975 INFO:tasks.rados.rados.0.smithi084.stdout:1658: finishing write tid 1 to smithi08477944-34 2024-03-30T12:28:08.975 INFO:tasks.rados.rados.0.smithi084.stdout:1657: done (4 left) 2024-03-30T12:28:08.975 INFO:tasks.rados.rados.0.smithi084.stdout:1662: setattr oid 44 current snap is 171 2024-03-30T12:28:08.975 INFO:tasks.rados.rados.0.smithi084.stdout:1658: finishing write tid 2 to smithi08477944-34 2024-03-30T12:28:08.976 INFO:tasks.rados.rados.0.smithi084.stdout:1658: finishing write tid 3 to smithi08477944-34 2024-03-30T12:28:08.976 INFO:tasks.rados.rados.0.smithi084.stdout:1658: finishing write tid 4 to smithi08477944-34 2024-03-30T12:28:08.976 INFO:tasks.rados.rados.0.smithi084.stdout:1658: finishing write tid 5 to smithi08477944-34 2024-03-30T12:28:08.976 INFO:tasks.rados.rados.0.smithi084.stdout:1658: oid 34 updating version 0 to 877 2024-03-30T12:28:08.976 INFO:tasks.rados.rados.0.smithi084.stdout:1658: oid 34 version 877 is already newer than 874 2024-03-30T12:28:08.976 INFO:tasks.rados.rados.0.smithi084.stdout:1658: oid 34 version 877 is already newer than 875 2024-03-30T12:28:08.977 INFO:tasks.rados.rados.0.smithi084.stdout:1658: oid 34 version 877 is already newer than 876 2024-03-30T12:28:08.977 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 877 (ObjNum 523 snap 171 seq_num 523) dirty exists 2024-03-30T12:28:08.977 INFO:tasks.rados.rados.0.smithi084.stdout:1658: left oid 34 (ObjNum 523 snap 171 seq_num 523) 2024-03-30T12:28:08.977 INFO:tasks.rados.rados.0.smithi084.stdout:1659: finishing write tid 1 to smithi08477944-45 2024-03-30T12:28:08.977 INFO:tasks.rados.rados.0.smithi084.stdout:1659: finishing write tid 2 to smithi08477944-45 2024-03-30T12:28:08.977 INFO:tasks.rados.rados.0.smithi084.stdout:1659: finishing write tid 3 to smithi08477944-45 2024-03-30T12:28:08.977 INFO:tasks.rados.rados.0.smithi084.stdout:1659: finishing write tid 4 to smithi08477944-45 2024-03-30T12:28:08.978 INFO:tasks.rados.rados.0.smithi084.stdout:1659: finishing write tid 5 to smithi08477944-45 2024-03-30T12:28:08.978 INFO:tasks.rados.rados.0.smithi084.stdout:1659: oid 45 updating version 0 to 905 2024-03-30T12:28:08.978 INFO:tasks.rados.rados.0.smithi084.stdout:1659: oid 45 updating version 905 to 906 2024-03-30T12:28:08.979 INFO:tasks.rados.rados.0.smithi084.stdout:1659: oid 45 version 906 is already newer than 904 2024-03-30T12:28:08.979 INFO:tasks.rados.rados.0.smithi084.stdout:1659: oid 45 updating version 906 to 907 2024-03-30T12:28:08.979 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 907 (ObjNum 524 snap 171 seq_num 524) dirty exists 2024-03-30T12:28:08.979 INFO:tasks.rados.rados.0.smithi084.stdout:1659: left oid 45 (ObjNum 524 snap 171 seq_num 524) 2024-03-30T12:28:08.979 INFO:tasks.rados.rados.0.smithi084.stdout:1660: finishing write tid 1 to smithi08477944-25 2024-03-30T12:28:08.979 INFO:tasks.rados.rados.0.smithi084.stdout:1661: finishing rollback tid 0 to smithi08477944-6 2024-03-30T12:28:08.980 INFO:tasks.rados.rados.0.smithi084.stdout:1661: finishing rollback tid 1 to smithi08477944-6 2024-03-30T12:28:08.980 INFO:tasks.rados.rados.0.smithi084.stdout:1661: finishing rollback tid 2 to smithi08477944-6 2024-03-30T12:28:08.981 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 671 (ObjNum 218 snap 64 seq_num 218) dirty exists 2024-03-30T12:28:08.981 INFO:tasks.rados.rados.0.smithi084.stdout:1660: finishing write tid 2 to smithi08477944-25 2024-03-30T12:28:08.981 INFO:tasks.rados.rados.0.smithi084.stdout:1660: finishing write tid 3 to smithi08477944-25 2024-03-30T12:28:08.982 INFO:tasks.rados.rados.0.smithi084.stdout:1660: finishing write tid 4 to smithi08477944-25 2024-03-30T12:28:08.982 INFO:tasks.rados.rados.0.smithi084.stdout:1660: finishing write tid 5 to smithi08477944-25 2024-03-30T12:28:08.982 INFO:tasks.rados.rados.0.smithi084.stdout:1660: oid 25 updating version 0 to 902 2024-03-30T12:28:08.982 INFO:tasks.rados.rados.0.smithi084.stdout:1660: oid 25 version 902 is already newer than 901 2024-03-30T12:28:08.982 INFO:tasks.rados.rados.0.smithi084.stdout:1660: oid 25 updating version 902 to 903 2024-03-30T12:28:08.983 INFO:tasks.rados.rados.0.smithi084.stdout:1660: oid 25 version 903 is already newer than 900 2024-03-30T12:28:08.983 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 903 (ObjNum 525 snap 171 seq_num 525) dirty exists 2024-03-30T12:28:08.983 INFO:tasks.rados.rados.0.smithi084.stdout:1660: left oid 25 (ObjNum 525 snap 171 seq_num 525) 2024-03-30T12:28:08.984 INFO:tasks.rados.rados.0.smithi084.stdout:1658: done (4 left) 2024-03-30T12:28:08.984 INFO:tasks.rados.rados.0.smithi084.stdout:1659: done (3 left) 2024-03-30T12:28:08.984 INFO:tasks.rados.rados.0.smithi084.stdout:1660: done (2 left) 2024-03-30T12:28:08.984 INFO:tasks.rados.rados.0.smithi084.stdout:1661: done (1 left) 2024-03-30T12:28:08.984 INFO:tasks.rados.rados.0.smithi084.stdout:1663: read oid 25 snap 163 2024-03-30T12:28:08.984 INFO:tasks.rados.rados.0.smithi084.stdout:1663: expect (ObjNum 471 snap 149 seq_num 471) 2024-03-30T12:28:08.984 INFO:tasks.rados.rados.0.smithi084.stdout:1664: read oid 47 snap -1 2024-03-30T12:28:08.984 INFO:tasks.rados.rados.0.smithi084.stdout:1664: expect (ObjNum 511 snap 162 seq_num 511) 2024-03-30T12:28:08.984 INFO:tasks.rados.rados.0.smithi084.stdout:1665: snap_remove snap 169 2024-03-30T12:28:09.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:08.900+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:09.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:08.900+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:09.623 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:28:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:28:09] "GET /metrics HTTP/1.1" 200 36114 "" "Prometheus/2.43.0" 2024-03-30T12:28:09.627 INFO:tasks.rados.rados.0.smithi084.stdout:1665: done (3 left) 2024-03-30T12:28:09.628 INFO:tasks.rados.rados.0.smithi084.stdout:1666: snap_create 2024-03-30T12:28:09.628 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 672 (ObjNum 440 snap 141 seq_num 440) dirty exists 2024-03-30T12:28:09.628 INFO:tasks.rados.rados.0.smithi084.stdout:1664: expect (ObjNum 511 snap 162 seq_num 511) 2024-03-30T12:28:09.663 INFO:tasks.rados.rados.0.smithi084.stdout:1663: expect (ObjNum 471 snap 149 seq_num 471) 2024-03-30T12:28:09.993 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:09 smithi084 ceph-mon[91810]: osdmap e409: 8 total, 8 up, 8 in 2024-03-30T12:28:09.994 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:09.994 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:09.994 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:09.994 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:09.994 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:09 smithi084 ceph-mon[91810]: pgmap v296: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 200 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 1.8 MiB/s wr, 11 op/s 2024-03-30T12:28:09.994 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:09 smithi084 ceph-mon[89279]: osdmap e409: 8 total, 8 up, 8 in 2024-03-30T12:28:09.994 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:09.995 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:09.995 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:09.995 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:09.995 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:09 smithi084 ceph-mon[89279]: pgmap v296: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 200 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 1.8 MiB/s wr, 11 op/s 2024-03-30T12:28:09.995 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:09.634+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:09.995 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:09.634+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:09.995 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:09.635+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:09.995 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:09.635+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:09.995 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:09.635+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:09.995 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:09.636+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:09.995 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:09.636+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:10.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:09 smithi162 ceph-mon[83709]: osdmap e409: 8 total, 8 up, 8 in 2024-03-30T12:28:10.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:10.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:10.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:10.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:10.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:09 smithi162 ceph-mon[83709]: pgmap v296: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 200 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 1.8 MiB/s wr, 11 op/s 2024-03-30T12:28:10.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:10.001+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:10.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:10.001+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:10.630 INFO:tasks.rados.rados.0.smithi084.stdout:1662: done (3 left) 2024-03-30T12:28:10.630 INFO:tasks.rados.rados.0.smithi084.stdout:1663: done (2 left) 2024-03-30T12:28:10.630 INFO:tasks.rados.rados.0.smithi084.stdout:1664: done (1 left) 2024-03-30T12:28:10.630 INFO:tasks.rados.rados.0.smithi084.stdout:1666: done (0 left) 2024-03-30T12:28:10.630 INFO:tasks.rados.rados.0.smithi084.stdout:1667: snap_remove snap 161 2024-03-30T12:28:11.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:11.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:11.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:11.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:11.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:11.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:10 smithi084 ceph-mon[89279]: osdmap e410: 8 total, 8 up, 8 in 2024-03-30T12:28:11.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:11.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:10 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:11.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:11.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:11.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:11.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:11.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:11.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:10 smithi084 ceph-mon[91810]: osdmap e410: 8 total, 8 up, 8 in 2024-03-30T12:28:11.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:11.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:10 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:11.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:11.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:11.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:11.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:11.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:11.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:10 smithi162 ceph-mon[83709]: osdmap e410: 8 total, 8 up, 8 in 2024-03-30T12:28:11.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:11.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:10 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:11.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:11.104+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:11.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:11.104+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:11.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:11.104+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:11.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:11.104+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:11.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:11.105+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:11.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:11.105+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:11.645 INFO:tasks.rados.rados.0.smithi084.stdout:1667: done (0 left) 2024-03-30T12:28:11.645 INFO:tasks.rados.rados.0.smithi084.stdout:1668: rollback oid 17 current snap is 172 2024-03-30T12:28:11.645 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 17 to 164 2024-03-30T12:28:11.645 INFO:tasks.rados.rados.0.smithi084.stdout:1669: snap_remove snap 163 2024-03-30T12:28:12.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:12.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:12.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:11 smithi084 ceph-mon[91810]: osdmap e411: 8 total, 8 up, 8 in 2024-03-30T12:28:12.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:11 smithi084 ceph-mon[91810]: pgmap v299: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 203 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 23 MiB/s rd, 776 KiB/s wr, 16 op/s 2024-03-30T12:28:12.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:12.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:12.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:11 smithi084 ceph-mon[89279]: osdmap e411: 8 total, 8 up, 8 in 2024-03-30T12:28:12.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:11 smithi084 ceph-mon[89279]: pgmap v299: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 203 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 23 MiB/s rd, 776 KiB/s wr, 16 op/s 2024-03-30T12:28:12.005 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:11.657+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:12.005 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:11.660+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:12.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:11.651+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:12.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:11.651+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:12.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:11.651+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:12.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:11.651+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:12.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:11.651+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:12.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:11.653+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:12.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:11.653+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:12.021 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:12.021 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:12.021 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:11 smithi162 ceph-mon[83709]: osdmap e411: 8 total, 8 up, 8 in 2024-03-30T12:28:12.021 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:11 smithi162 ceph-mon[83709]: pgmap v299: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 203 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 23 MiB/s rd, 776 KiB/s wr, 16 op/s 2024-03-30T12:28:12.648 INFO:tasks.rados.rados.0.smithi084.stdout:1669: done (1 left) 2024-03-30T12:28:12.649 INFO:tasks.rados.rados.0.smithi084.stdout:1670: snap_create 2024-03-30T12:28:12.649 INFO:tasks.rados.rados.0.smithi084.stdout:1668: finishing rollback tid 0 to smithi08477944-17 2024-03-30T12:28:12.649 INFO:tasks.rados.rados.0.smithi084.stdout:1668: finishing rollback tid 1 to smithi08477944-17 2024-03-30T12:28:12.649 INFO:tasks.rados.rados.0.smithi084.stdout:1668: finishing rollback tid 2 to smithi08477944-17 2024-03-30T12:28:12.649 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 913 (ObjNum 508 snap 161 seq_num 508) dirty exists 2024-03-30T12:28:13.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:12.665+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:13.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:12.666+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:13.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:12.663+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:13.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:12.664+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:13.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:12.664+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:13.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:12.665+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:13.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:13.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:13.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:13.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:13.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:13.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:13.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:13.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:13.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:13.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:13.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[91810]: osdmap e412: 8 total, 8 up, 8 in 2024-03-30T12:28:13.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:13.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:13.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:13.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:13.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:13.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:13.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:13.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:13.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:13.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:13.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:13.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:13.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[89279]: osdmap e412: 8 total, 8 up, 8 in 2024-03-30T12:28:13.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:13.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:13.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:13.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:13.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:13.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:13.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:13.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:13.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:13.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:13.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:13.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:13.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:12 smithi162 ceph-mon[83709]: osdmap e412: 8 total, 8 up, 8 in 2024-03-30T12:28:13.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:13.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:13.664 INFO:tasks.rados.rados.0.smithi084.stdout:1668: done (1 left) 2024-03-30T12:28:13.664 INFO:tasks.rados.rados.0.smithi084.stdout:1670: done (0 left) 2024-03-30T12:28:13.664 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 173 2024-03-30T12:28:13.664 INFO:tasks.rados.rados.0.smithi084.stdout:1671: seq_num 526 ranges {0=417792,417792=589824,1007616=614400} 2024-03-30T12:28:13.666 INFO:tasks.rados.rados.0.smithi084.stdout:1671: writing smithi08477944-48 from 0 to 417792 tid 1 2024-03-30T12:28:13.669 INFO:tasks.rados.rados.0.smithi084.stdout:1671: writing smithi08477944-48 from 417792 to 1007616 tid 2 2024-03-30T12:28:13.674 INFO:tasks.rados.rados.0.smithi084.stdout:1671: writing smithi08477944-48 from 1007616 to 1622016 tid 3 2024-03-30T12:28:13.674 INFO:tasks.rados.rados.0.smithi084.stdout:1672: setattr oid 21 current snap is 173 2024-03-30T12:28:13.674 INFO:tasks.rados.rados.0.smithi084.stdout:1671: finishing write tid 1 to smithi08477944-48 2024-03-30T12:28:13.674 INFO:tasks.rados.rados.0.smithi084.stdout:1671: finishing write tid 2 to smithi08477944-48 2024-03-30T12:28:13.674 INFO:tasks.rados.rados.0.smithi084.stdout:1673: snap_create 2024-03-30T12:28:13.677 INFO:tasks.rados.rados.0.smithi084.stdout:1671: finishing write tid 3 to smithi08477944-48 2024-03-30T12:28:13.677 INFO:tasks.rados.rados.0.smithi084.stdout:1671: finishing write tid 4 to smithi08477944-48 2024-03-30T12:28:13.679 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 413 (ObjNum 33 snap 0 seq_num 1394497328) dirty exists 2024-03-30T12:28:13.680 INFO:tasks.rados.rados.0.smithi084.stdout:1671: finishing write tid 5 to smithi08477944-48 2024-03-30T12:28:13.680 INFO:tasks.rados.rados.0.smithi084.stdout:1671: oid 48 updating version 0 to 895 2024-03-30T12:28:13.680 INFO:tasks.rados.rados.0.smithi084.stdout:1671: oid 48 updating version 895 to 896 2024-03-30T12:28:13.680 INFO:tasks.rados.rados.0.smithi084.stdout:1671: oid 48 version 896 is already newer than 894 2024-03-30T12:28:13.680 INFO:tasks.rados.rados.0.smithi084.stdout:1671: oid 48 version 896 is already newer than 893 2024-03-30T12:28:13.680 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 896 (ObjNum 526 snap 173 seq_num 526) dirty exists 2024-03-30T12:28:13.681 INFO:tasks.rados.rados.0.smithi084.stdout:1671: left oid 48 (ObjNum 526 snap 173 seq_num 526) 2024-03-30T12:28:14.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:13.688+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:14.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:13.688+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:14.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:13.670+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:14.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:13.670+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:14.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:13.670+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:14.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:13.670+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:14.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:13.670+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:14.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:13.671+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:14.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:13.671+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:14.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:13 smithi084 ceph-mon[89279]: osdmap e413: 8 total, 8 up, 8 in 2024-03-30T12:28:14.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:14.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:14.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:14.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:14.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:14.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:14.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:13 smithi084 ceph-mon[89279]: pgmap v302: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 203 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 19 MiB/s rd, 776 KiB/s wr, 12 op/s 2024-03-30T12:28:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:13 smithi084 ceph-mon[91810]: osdmap e413: 8 total, 8 up, 8 in 2024-03-30T12:28:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:14.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:14.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:14.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:14.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:14.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:13 smithi084 ceph-mon[91810]: pgmap v302: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 203 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 19 MiB/s rd, 776 KiB/s wr, 12 op/s 2024-03-30T12:28:14.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:13 smithi162 ceph-mon[83709]: osdmap e413: 8 total, 8 up, 8 in 2024-03-30T12:28:14.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:14.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:14.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:14.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:14.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:14.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:14.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:13 smithi162 ceph-mon[83709]: pgmap v302: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 203 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 19 MiB/s rd, 776 KiB/s wr, 12 op/s 2024-03-30T12:28:14.667 INFO:tasks.rados.rados.0.smithi084.stdout:1671: done (2 left) 2024-03-30T12:28:14.667 INFO:tasks.rados.rados.0.smithi084.stdout:1672: done (1 left) 2024-03-30T12:28:14.667 INFO:tasks.rados.rados.0.smithi084.stdout:1673: done (0 left) 2024-03-30T12:28:14.667 INFO:tasks.rados.rados.0.smithi084.stdout:1674: setattr oid 1 current snap is 174 2024-03-30T12:28:14.667 INFO:tasks.rados.rados.0.smithi084.stdout:1675: rmattr oid 4 current snap is 174 2024-03-30T12:28:14.667 INFO:tasks.rados.rados.0.smithi084.stdout:1675: done (1 left) 2024-03-30T12:28:14.667 INFO:tasks.rados.rados.0.smithi084.stdout:1676: copy_from oid 15 from oid 24 current snap is 174 2024-03-30T12:28:14.668 INFO:tasks.rados.rados.0.smithi084.stdout:1677: snap_remove snap 173 2024-03-30T12:28:15.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:14.680+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:15.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:14.680+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:15.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:15.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:15.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:15.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:15.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:14 smithi084 ceph-mon[89279]: osdmap e414: 8 total, 8 up, 8 in 2024-03-30T12:28:15.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:15.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:15.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:15.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:15.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:15.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:15.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:14 smithi084 ceph-mon[91810]: osdmap e414: 8 total, 8 up, 8 in 2024-03-30T12:28:15.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:15.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:15.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:15.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:15.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:15.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:15.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:14 smithi162 ceph-mon[83709]: osdmap e414: 8 total, 8 up, 8 in 2024-03-30T12:28:15.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:15.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:15.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:15.201+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:15.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:15.201+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:15.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:15.201+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:15.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:15.201+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:15.676 INFO:tasks.rados.rados.0.smithi084.stdout:1677: done (2 left) 2024-03-30T12:28:15.676 INFO:tasks.rados.rados.0.smithi084.stdout:1678: setattr oid 39 current snap is 174 2024-03-30T12:28:15.676 INFO:tasks.rados.rados.0.smithi084.stdout:1676: finishing copy_from to smithi08477944-15 2024-03-30T12:28:15.676 INFO:tasks.rados.rados.0.smithi084.stdout:1676: got expected ENOENT (src dne) 2024-03-30T12:28:15.677 INFO:tasks.rados.rados.0.smithi084.stdout:1676: finishing copy_from racing read to smithi08477944-15 2024-03-30T12:28:15.677 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 669 (ObjNum 516 snap 164 seq_num 516) dirty exists 2024-03-30T12:28:15.677 INFO:tasks.rados.rados.0.smithi084.stdout:1674: done (2 left) 2024-03-30T12:28:15.677 INFO:tasks.rados.rados.0.smithi084.stdout:1676: done (1 left) 2024-03-30T12:28:15.677 INFO:tasks.rados.rados.0.smithi084.stdout:1679: read oid 46 snap 167 2024-03-30T12:28:15.678 INFO:tasks.rados.rados.0.smithi084.stdout:1679: expect (ObjNum 300 snap 95 seq_num 300) 2024-03-30T12:28:15.678 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 174 2024-03-30T12:28:15.678 INFO:tasks.rados.rados.0.smithi084.stdout:1680: seq_num 527 ranges {6963200=434176,7397376=475136,7872512=565248,8437760=163840} 2024-03-30T12:28:15.717 INFO:tasks.rados.rados.0.smithi084.stdout:1680: writing smithi08477944-22 from 6963200 to 7397376 tid 1 2024-03-30T12:28:15.720 INFO:tasks.rados.rados.0.smithi084.stdout:1680: writing smithi08477944-22 from 7397376 to 7872512 tid 2 2024-03-30T12:28:15.723 INFO:tasks.rados.rados.0.smithi084.stdout:1680: writing smithi08477944-22 from 7872512 to 8437760 tid 3 2024-03-30T12:28:15.724 INFO:tasks.rados.rados.0.smithi084.stdout:1680: writing smithi08477944-22 from 8437760 to 8601600 tid 4 2024-03-30T12:28:15.724 INFO:tasks.rados.rados.0.smithi084.stdout:1681: copy_from oid 27 from oid 33 current snap is 174 2024-03-30T12:28:15.724 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 914 (ObjNum 33 snap 0 seq_num 1394497328) dirty exists 2024-03-30T12:28:15.724 INFO:tasks.rados.rados.0.smithi084.stdout:1679: expect (ObjNum 300 snap 95 seq_num 300) 2024-03-30T12:28:16.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:15 smithi084 ceph-mon[91810]: pgmap v304: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 204 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 20 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2024-03-30T12:28:16.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:15 smithi084 ceph-mon[91810]: osdmap e415: 8 total, 8 up, 8 in 2024-03-30T12:28:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:15 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:15 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:28:16.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:15.684+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:16.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:15.685+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:16.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:15 smithi084 ceph-mon[89279]: pgmap v304: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 204 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 20 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2024-03-30T12:28:16.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:15 smithi084 ceph-mon[89279]: osdmap e415: 8 total, 8 up, 8 in 2024-03-30T12:28:16.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:16.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:16.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:15 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:16.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:15 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:28:16.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:15.738+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:16.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:15.738+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:16.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:15.739+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:16.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:15.739+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:16.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:15.739+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:16.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:15.739+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:16.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:15.739+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:16.087 INFO:tasks.rados.rados.0.smithi084.stdout:1680: finishing write tid 1 to smithi08477944-22 2024-03-30T12:28:16.087 INFO:tasks.rados.rados.0.smithi084.stdout:1680: finishing write tid 2 to smithi08477944-22 2024-03-30T12:28:16.087 INFO:tasks.rados.rados.0.smithi084.stdout:1680: finishing write tid 3 to smithi08477944-22 2024-03-30T12:28:16.087 INFO:tasks.rados.rados.0.smithi084.stdout:1680: finishing write tid 4 to smithi08477944-22 2024-03-30T12:28:16.087 INFO:tasks.rados.rados.0.smithi084.stdout:1680: finishing write tid 5 to smithi08477944-22 2024-03-30T12:28:16.087 INFO:tasks.rados.rados.0.smithi084.stdout:1681: finishing copy_from to smithi08477944-27 2024-03-30T12:28:16.087 INFO:tasks.rados.rados.0.smithi084.stdout:1681: got expected ENOENT (src dne) 2024-03-30T12:28:16.087 INFO:tasks.rados.rados.0.smithi084.stdout:1681: finishing copy_from racing read to smithi08477944-27 2024-03-30T12:28:16.087 INFO:tasks.rados.rados.0.smithi084.stdout:1680: finishing write tid 6 to smithi08477944-22 2024-03-30T12:28:16.087 INFO:tasks.rados.rados.0.smithi084.stdout:1680: oid 22 updating version 0 to 917 2024-03-30T12:28:16.088 INFO:tasks.rados.rados.0.smithi084.stdout:1680: oid 22 updating version 917 to 918 2024-03-30T12:28:16.088 INFO:tasks.rados.rados.0.smithi084.stdout:1680: oid 22 version 918 is already newer than 916 2024-03-30T12:28:16.088 INFO:tasks.rados.rados.0.smithi084.stdout:1680: oid 22 version 918 is already newer than 914 2024-03-30T12:28:16.088 INFO:tasks.rados.rados.0.smithi084.stdout:1680: oid 22 version 918 is already newer than 915 2024-03-30T12:28:16.088 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 918 (ObjNum 527 snap 174 seq_num 527) dirty exists 2024-03-30T12:28:16.088 INFO:tasks.rados.rados.0.smithi084.stdout:1680: left oid 22 (ObjNum 527 snap 174 seq_num 527) 2024-03-30T12:28:16.088 INFO:tasks.rados.rados.0.smithi084.stdout:1678: done (3 left) 2024-03-30T12:28:16.088 INFO:tasks.rados.rados.0.smithi084.stdout:1679: done (2 left) 2024-03-30T12:28:16.088 INFO:tasks.rados.rados.0.smithi084.stdout:1680: done (1 left) 2024-03-30T12:28:16.088 INFO:tasks.rados.rados.0.smithi084.stdout:1681: done (0 left) 2024-03-30T12:28:16.088 INFO:tasks.rados.rados.0.smithi084.stdout:1682: rollback oid 9 current snap is 174 2024-03-30T12:28:16.088 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 9 to 159 2024-03-30T12:28:16.088 INFO:tasks.rados.rados.0.smithi084.stdout:1683: read oid 12 snap -1 2024-03-30T12:28:16.088 INFO:tasks.rados.rados.0.smithi084.stdout:1683: expect (ObjNum 455 snap 142 seq_num 455) 2024-03-30T12:28:16.088 INFO:tasks.rados.rados.0.smithi084.stdout:1684: copy_from oid 21 from oid 15 current snap is 174 2024-03-30T12:28:16.088 INFO:tasks.rados.rados.0.smithi084.stdout:1685: copy_from oid 13 from oid 36 current snap is 174 2024-03-30T12:28:16.089 INFO:tasks.rados.rados.0.smithi084.stdout:1686: snap_remove snap 165 2024-03-30T12:28:16.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:15 smithi162 ceph-mon[83709]: pgmap v304: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 204 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 20 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2024-03-30T12:28:16.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:15 smithi162 ceph-mon[83709]: osdmap e415: 8 total, 8 up, 8 in 2024-03-30T12:28:16.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:16.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:16.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:15 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:16.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:15 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:28:16.683 INFO:tasks.rados.rados.0.smithi084.stdout:1686: done (4 left) 2024-03-30T12:28:16.683 INFO:tasks.rados.rados.0.smithi084.stdout:1687: read oid 41 snap -1 2024-03-30T12:28:16.683 INFO:tasks.rados.rados.0.smithi084.stdout:1687: expect deleted 2024-03-30T12:28:16.683 INFO:tasks.rados.rados.0.smithi084.stdout:1688: read oid 46 snap 168 2024-03-30T12:28:16.683 INFO:tasks.rados.rados.0.smithi084.stdout:1688: expect (ObjNum 300 snap 95 seq_num 300) 2024-03-30T12:28:16.683 INFO:tasks.rados.rados.0.smithi084.stdout:1689: snap_create 2024-03-30T12:28:16.683 INFO:tasks.rados.rados.0.smithi084.stdout:1684: finishing copy_from to smithi08477944-21 2024-03-30T12:28:16.683 INFO:tasks.rados.rados.0.smithi084.stdout:1684: got expected ENOENT (src dne) 2024-03-30T12:28:16.683 INFO:tasks.rados.rados.0.smithi084.stdout:1684: finishing copy_from racing read to smithi08477944-21 2024-03-30T12:28:16.683 INFO:tasks.rados.rados.0.smithi084.stdout:1682: finishing rollback tid 0 to smithi08477944-9 2024-03-30T12:28:16.683 INFO:tasks.rados.rados.0.smithi084.stdout:1682: finishing rollback tid 1 to smithi08477944-9 2024-03-30T12:28:16.683 INFO:tasks.rados.rados.0.smithi084.stdout:1682: finishing rollback tid 2 to smithi08477944-9 2024-03-30T12:28:16.684 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 560 (ObjNum 177 snap 0 seq_num 194169681) dirty exists 2024-03-30T12:28:16.684 INFO:tasks.rados.rados.0.smithi084.stdout:1683: expect (ObjNum 455 snap 142 seq_num 455) 2024-03-30T12:28:16.856 INFO:tasks.rados.rados.0.smithi084.stdout:1685: finishing copy_from racing read to smithi08477944-13 2024-03-30T12:28:16.856 INFO:tasks.rados.rados.0.smithi084.stdout:1685: finishing copy_from to smithi08477944-13 2024-03-30T12:28:16.856 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 806 (ObjNum 489 snap 154 seq_num 489) dirty exists 2024-03-30T12:28:16.856 INFO:tasks.rados.rados.0.smithi084.stdout:1688: expect (ObjNum 300 snap 95 seq_num 300) 2024-03-30T12:28:17.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:16.694+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:17.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:16.695+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:17.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:16.688+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:17.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:16.688+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:17.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:16.689+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:17.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:16.689+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:17.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:17.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:17.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:17.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:17.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:17.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-mon[91810]: osdmap e416: 8 total, 8 up, 8 in 2024-03-30T12:28:17.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:17.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:17.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:17.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:17.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:17.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:17.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:17.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:17.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:17.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:17.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-mon[89279]: osdmap e416: 8 total, 8 up, 8 in 2024-03-30T12:28:17.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:17.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:17.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:17.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:17.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:17.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:17.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:16 smithi162 ceph-mon[83709]: osdmap e416: 8 total, 8 up, 8 in 2024-03-30T12:28:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:17.683 INFO:tasks.rados.rados.0.smithi084.stdout:1682: done (6 left) 2024-03-30T12:28:17.683 INFO:tasks.rados.rados.0.smithi084.stdout:1683: done (5 left) 2024-03-30T12:28:17.683 INFO:tasks.rados.rados.0.smithi084.stdout:1684: done (4 left) 2024-03-30T12:28:17.683 INFO:tasks.rados.rados.0.smithi084.stdout:1685: done (3 left) 2024-03-30T12:28:17.683 INFO:tasks.rados.rados.0.smithi084.stdout:1687: done (2 left) 2024-03-30T12:28:17.683 INFO:tasks.rados.rados.0.smithi084.stdout:1688: done (1 left) 2024-03-30T12:28:17.683 INFO:tasks.rados.rados.0.smithi084.stdout:1689: done (0 left) 2024-03-30T12:28:17.683 INFO:tasks.rados.rados.0.smithi084.stdout:1690: snap_remove snap 167 2024-03-30T12:28:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:17 smithi084 ceph-mon[91810]: pgmap v307: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 204 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 999 KiB/s rd, 386 KiB/s wr, 12 op/s 2024-03-30T12:28:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:17 smithi084 ceph-mon[91810]: osdmap e417: 8 total, 8 up, 8 in 2024-03-30T12:28:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:17 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-30T12:28:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:17 smithi084 ceph-mon[89279]: pgmap v307: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 204 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 999 KiB/s rd, 386 KiB/s wr, 12 op/s 2024-03-30T12:28:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:17 smithi084 ceph-mon[89279]: osdmap e417: 8 total, 8 up, 8 in 2024-03-30T12:28:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:17 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-30T12:28:18.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:17 smithi162 ceph-mon[83709]: pgmap v307: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 204 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 999 KiB/s rd, 386 KiB/s wr, 12 op/s 2024-03-30T12:28:18.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:18.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:18.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:18.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:18.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:17 smithi162 ceph-mon[83709]: osdmap e417: 8 total, 8 up, 8 in 2024-03-30T12:28:18.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:18.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:18.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:17 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-30T12:28:18.686 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:18.305+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:18.686 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:18.306+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:18.686 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:18.304+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:18.686 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:18.304+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:18.686 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:18.304+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:18.687 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:18.305+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:18.687 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:18.305+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:18.687 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:18.306+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:18.687 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:18.306+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:18.695 INFO:tasks.rados.rados.0.smithi084.stdout:1690: done (0 left) 2024-03-30T12:28:18.696 INFO:tasks.rados.rados.0.smithi084.stdout:1691: copy_from oid 3 from oid 28 current snap is 175 2024-03-30T12:28:18.696 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 175 2024-03-30T12:28:18.696 INFO:tasks.rados.rados.0.smithi084.stdout:1692: seq_num 528 ranges {5103616=450560,5554176=761856,6316032=442368} 2024-03-30T12:28:18.726 INFO:tasks.rados.rados.0.smithi084.stdout:1692: writing smithi08477944-45 from 5103616 to 5554176 tid 1 2024-03-30T12:28:18.730 INFO:tasks.rados.rados.0.smithi084.stdout:1692: writing smithi08477944-45 from 5554176 to 6316032 tid 2 2024-03-30T12:28:18.734 INFO:tasks.rados.rados.0.smithi084.stdout:1692: writing smithi08477944-45 from 6316032 to 6758400 tid 3 2024-03-30T12:28:18.734 INFO:tasks.rados.rados.0.smithi084.stdout:1693: read oid 14 snap -1 2024-03-30T12:28:18.734 INFO:tasks.rados.rados.0.smithi084.stdout:1693: expect (ObjNum 457 snap 143 seq_num 457) 2024-03-30T12:28:18.734 INFO:tasks.rados.rados.0.smithi084.stdout:1694: snap_create 2024-03-30T12:28:18.734 INFO:tasks.rados.rados.0.smithi084.stdout:1691: finishing copy_from racing read to smithi08477944-3 2024-03-30T12:28:18.734 INFO:tasks.rados.rados.0.smithi084.stdout:1691: finishing copy_from to smithi08477944-3 2024-03-30T12:28:18.734 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 809 (ObjNum 498 snap 156 seq_num 498) dirty exists 2024-03-30T12:28:18.734 INFO:tasks.rados.rados.0.smithi084.stdout:1692: finishing write tid 1 to smithi08477944-45 2024-03-30T12:28:18.735 INFO:tasks.rados.rados.0.smithi084.stdout:1692: finishing write tid 2 to smithi08477944-45 2024-03-30T12:28:18.735 INFO:tasks.rados.rados.0.smithi084.stdout:1692: finishing write tid 3 to smithi08477944-45 2024-03-30T12:28:18.735 INFO:tasks.rados.rados.0.smithi084.stdout:1692: finishing write tid 4 to smithi08477944-45 2024-03-30T12:28:18.736 INFO:tasks.rados.rados.0.smithi084.stdout:1692: finishing write tid 5 to smithi08477944-45 2024-03-30T12:28:18.736 INFO:tasks.rados.rados.0.smithi084.stdout:1692: oid 45 updating version 0 to 911 2024-03-30T12:28:18.737 INFO:tasks.rados.rados.0.smithi084.stdout:1692: oid 45 version 911 is already newer than 910 2024-03-30T12:28:18.737 INFO:tasks.rados.rados.0.smithi084.stdout:1692: oid 45 version 911 is already newer than 909 2024-03-30T12:28:18.737 INFO:tasks.rados.rados.0.smithi084.stdout:1692: oid 45 updating version 911 to 912 2024-03-30T12:28:18.737 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 912 (ObjNum 528 snap 175 seq_num 528) dirty exists 2024-03-30T12:28:18.737 INFO:tasks.rados.rados.0.smithi084.stdout:1692: left oid 45 (ObjNum 528 snap 175 seq_num 528) 2024-03-30T12:28:18.742 INFO:tasks.rados.rados.0.smithi084.stdout:1693: expect (ObjNum 457 snap 143 seq_num 457) 2024-03-30T12:28:19.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:18.707+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:19.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:18.708+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:19.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-mon[91810]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-30T12:28:19.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-mon[91810]: Upgrade: osd.4 is safe to restart 2024-03-30T12:28:19.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-mon[91810]: osdmap e418: 8 total, 8 up, 8 in 2024-03-30T12:28:19.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:19.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-30T12:28:19.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:28:19.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-mon[89279]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-30T12:28:19.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-mon[89279]: Upgrade: osd.4 is safe to restart 2024-03-30T12:28:19.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-mon[89279]: osdmap e418: 8 total, 8 up, 8 in 2024-03-30T12:28:19.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:19.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-30T12:28:19.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:28:19.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:18.701+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:19.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:18.702+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:19.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:18.702+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:19.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:18.702+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:19.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:18 smithi162 ceph-mon[83709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-30T12:28:19.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:18 smithi162 ceph-mon[83709]: Upgrade: osd.4 is safe to restart 2024-03-30T12:28:19.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:18 smithi162 ceph-mon[83709]: osdmap e418: 8 total, 8 up, 8 in 2024-03-30T12:28:19.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:18 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:19.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:18 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-30T12:28:19.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:18 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:28:19.696 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:28:19] "GET /metrics HTTP/1.1" 200 36260 "" "Prometheus/2.43.0" 2024-03-30T12:28:19.700 INFO:tasks.rados.rados.0.smithi084.stdout:1691: done (3 left) 2024-03-30T12:28:19.700 INFO:tasks.rados.rados.0.smithi084.stdout:1692: done (2 left) 2024-03-30T12:28:19.700 INFO:tasks.rados.rados.0.smithi084.stdout:1693: done (1 left) 2024-03-30T12:28:19.700 INFO:tasks.rados.rados.0.smithi084.stdout:1694: done (0 left) 2024-03-30T12:28:19.700 INFO:tasks.rados.rados.0.smithi084.stdout:1695: read oid 31 snap -1 2024-03-30T12:28:19.701 INFO:tasks.rados.rados.0.smithi084.stdout:1695: expect deleted 2024-03-30T12:28:19.701 INFO:tasks.rados.rados.0.smithi084.stdout:1696: read oid 34 snap -1 2024-03-30T12:28:19.701 INFO:tasks.rados.rados.0.smithi084.stdout:1696: expect (ObjNum 523 snap 171 seq_num 523) 2024-03-30T12:28:19.701 INFO:tasks.rados.rados.0.smithi084.stdout:1697: read oid 1 snap -1 2024-03-30T12:28:19.701 INFO:tasks.rados.rados.0.smithi084.stdout:1697: expect (ObjNum 516 snap 164 seq_num 516) 2024-03-30T12:28:19.701 INFO:tasks.rados.rados.0.smithi084.stdout:1698: read oid 7 snap -1 2024-03-30T12:28:19.701 INFO:tasks.rados.rados.0.smithi084.stdout:1698: expect deleted 2024-03-30T12:28:19.701 INFO:tasks.rados.rados.0.smithi084.stdout:1699: read oid 37 snap 175 2024-03-30T12:28:19.701 INFO:tasks.rados.rados.0.smithi084.stdout:1699: expect (ObjNum 515 snap 164 seq_num 515) 2024-03-30T12:28:19.701 INFO:tasks.rados.rados.0.smithi084.stdout:1700: rollback oid 12 current snap is 176 2024-03-30T12:28:19.701 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 12 to 160 2024-03-30T12:28:19.701 INFO:tasks.rados.rados.0.smithi084.stdout:1701: read oid 3 snap -1 2024-03-30T12:28:19.701 INFO:tasks.rados.rados.0.smithi084.stdout:1701: expect (ObjNum 498 snap 156 seq_num 498) 2024-03-30T12:28:19.701 INFO:tasks.rados.rados.0.smithi084.stdout:1702: copy_from oid 44 from oid 41 current snap is 176 2024-03-30T12:28:19.701 INFO:tasks.rados.rados.0.smithi084.stdout:1703: read oid 25 snap -1 2024-03-30T12:28:19.702 INFO:tasks.rados.rados.0.smithi084.stdout:1703: expect (ObjNum 525 snap 171 seq_num 525) 2024-03-30T12:28:19.702 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 176 2024-03-30T12:28:19.702 INFO:tasks.rados.rados.0.smithi084.stdout:1704: seq_num 529 ranges {0=466944,466944=647168,1114112=532480,1646592=24576} 2024-03-30T12:28:19.702 INFO:tasks.rados.rados.0.smithi084.stdout:1704: writing smithi08477944-15 from 0 to 466944 tid 1 2024-03-30T12:28:19.707 INFO:tasks.rados.rados.0.smithi084.stdout:1704: writing smithi08477944-15 from 466944 to 1114112 tid 2 2024-03-30T12:28:19.714 INFO:tasks.rados.rados.0.smithi084.stdout:1704: writing smithi08477944-15 from 1114112 to 1646592 tid 3 2024-03-30T12:28:19.714 INFO:tasks.rados.rados.0.smithi084.stdout:1704: writing smithi08477944-15 from 1646592 to 1671168 tid 4 2024-03-30T12:28:19.714 INFO:tasks.rados.rados.0.smithi084.stdout:1705: snap_create 2024-03-30T12:28:19.714 INFO:tasks.rados.rados.0.smithi084.stdout:1702: finishing copy_from to smithi08477944-44 2024-03-30T12:28:19.714 INFO:tasks.rados.rados.0.smithi084.stdout:1702: got expected ENOENT (src dne) 2024-03-30T12:28:19.714 INFO:tasks.rados.rados.0.smithi084.stdout:1702: finishing copy_from racing read to smithi08477944-44 2024-03-30T12:28:19.714 INFO:tasks.rados.rados.0.smithi084.stdout:1701: expect (ObjNum 498 snap 156 seq_num 498) 2024-03-30T12:28:19.749 INFO:tasks.rados.rados.0.smithi084.stdout:1699: expect (ObjNum 515 snap 164 seq_num 515) 2024-03-30T12:28:19.791 INFO:tasks.rados.rados.0.smithi084.stdout:1704: finishing write tid 1 to smithi08477944-15 2024-03-30T12:28:19.791 INFO:tasks.rados.rados.0.smithi084.stdout:1697: expect (ObjNum 516 snap 164 seq_num 516) 2024-03-30T12:28:19.830 INFO:tasks.rados.rados.0.smithi084.stdout:1704: finishing write tid 2 to smithi08477944-15 2024-03-30T12:28:19.830 INFO:tasks.rados.rados.0.smithi084.stdout:1704: finishing write tid 3 to smithi08477944-15 2024-03-30T12:28:19.830 INFO:tasks.rados.rados.0.smithi084.stdout:1704: finishing write tid 4 to smithi08477944-15 2024-03-30T12:28:19.830 INFO:tasks.rados.rados.0.smithi084.stdout:1704: finishing write tid 5 to smithi08477944-15 2024-03-30T12:28:19.830 INFO:tasks.rados.rados.0.smithi084.stdout:1704: finishing write tid 6 to smithi08477944-15 2024-03-30T12:28:19.830 INFO:tasks.rados.rados.0.smithi084.stdout:1704: oid 15 updating version 0 to 916 2024-03-30T12:28:19.831 INFO:tasks.rados.rados.0.smithi084.stdout:1704: oid 15 updating version 916 to 918 2024-03-30T12:28:19.831 INFO:tasks.rados.rados.0.smithi084.stdout:1704: oid 15 updating version 918 to 919 2024-03-30T12:28:19.831 INFO:tasks.rados.rados.0.smithi084.stdout:1704: oid 15 version 919 is already newer than 915 2024-03-30T12:28:19.831 INFO:tasks.rados.rados.0.smithi084.stdout:1704: oid 15 version 919 is already newer than 917 2024-03-30T12:28:19.831 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 919 (ObjNum 529 snap 176 seq_num 529) dirty exists 2024-03-30T12:28:19.831 INFO:tasks.rados.rados.0.smithi084.stdout:1704: left oid 15 (ObjNum 529 snap 176 seq_num 529) 2024-03-30T12:28:19.831 INFO:tasks.rados.rados.0.smithi084.stdout:1696: expect (ObjNum 523 snap 171 seq_num 523) 2024-03-30T12:28:19.941 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:19.941 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:19.941 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:19.941 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:19.941 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:19.941 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:19.941 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:19 smithi162 ceph-mon[83709]: Upgrade: Updating osd.4 2024-03-30T12:28:19.942 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:19 smithi162 ceph-mon[83709]: Deploying daemon osd.4 on smithi162 2024-03-30T12:28:19.942 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:19 smithi162 ceph-mon[83709]: pgmap v310: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 206 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 396 KiB/s wr, 12 op/s 2024-03-30T12:28:19.942 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:19.942 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:19.942 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:19.942 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:19.942 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:19 smithi162 ceph-mon[83709]: osdmap e419: 8 total, 8 up, 8 in 2024-03-30T12:28:19.942 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:19.942 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:20.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:19.715+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:20.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:19.721+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:20.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:19.711+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:20.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:19.714+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:20.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:19.714+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:20.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:19.714+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:20.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:19.714+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:20.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:19.714+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:20.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:19.714+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:20.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[91810]: Upgrade: Updating osd.4 2024-03-30T12:28:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[91810]: Deploying daemon osd.4 on smithi162 2024-03-30T12:28:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[91810]: pgmap v310: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 206 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 396 KiB/s wr, 12 op/s 2024-03-30T12:28:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[91810]: osdmap e419: 8 total, 8 up, 8 in 2024-03-30T12:28:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:20.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:20.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:20.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:20.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:20.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:20.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:20.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:20.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[89279]: Upgrade: Updating osd.4 2024-03-30T12:28:20.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[89279]: Deploying daemon osd.4 on smithi162 2024-03-30T12:28:20.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[89279]: pgmap v310: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 206 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 396 KiB/s wr, 12 op/s 2024-03-30T12:28:20.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:20.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:20.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:20.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:20.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[89279]: osdmap e419: 8 total, 8 up, 8 in 2024-03-30T12:28:20.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:20.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:20.264 INFO:tasks.rados.rados.0.smithi084.stdout:1700: finishing rollback tid 0 to smithi08477944-12 2024-03-30T12:28:20.264 INFO:tasks.rados.rados.0.smithi084.stdout:1700: finishing rollback tid 1 to smithi08477944-12 2024-03-30T12:28:20.264 INFO:tasks.rados.rados.0.smithi084.stdout:1700: finishing rollback tid 2 to smithi08477944-12 2024-03-30T12:28:20.265 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 880 (ObjNum 455 snap 142 seq_num 455) dirty exists 2024-03-30T12:28:20.265 INFO:tasks.rados.rados.0.smithi084.stdout:1703: expect (ObjNum 525 snap 171 seq_num 525) 2024-03-30T12:28:20.966 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:20 smithi162 ceph-mon[83709]: osdmap e420: 8 total, 8 up, 8 in 2024-03-30T12:28:20.966 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:20.966 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:20.966 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:20.966 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:20.966 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:20.966 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:21.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:20 smithi084 ceph-mon[89279]: osdmap e420: 8 total, 8 up, 8 in 2024-03-30T12:28:21.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:21.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:21.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:21.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:21.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:21.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:21.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:20 smithi084 ceph-mon[91810]: osdmap e420: 8 total, 8 up, 8 in 2024-03-30T12:28:21.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:21.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:21.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:21.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:21.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:21.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:21.119 INFO:tasks.rados.rados.0.smithi084.stdout:1695: done (10 left) 2024-03-30T12:28:21.120 INFO:tasks.rados.rados.0.smithi084.stdout:1696: done (9 left) 2024-03-30T12:28:21.120 INFO:tasks.rados.rados.0.smithi084.stdout:1697: done (8 left) 2024-03-30T12:28:21.120 INFO:tasks.rados.rados.0.smithi084.stdout:1698: done (7 left) 2024-03-30T12:28:21.120 INFO:tasks.rados.rados.0.smithi084.stdout:1699: done (6 left) 2024-03-30T12:28:21.120 INFO:tasks.rados.rados.0.smithi084.stdout:1700: done (5 left) 2024-03-30T12:28:21.120 INFO:tasks.rados.rados.0.smithi084.stdout:1701: done (4 left) 2024-03-30T12:28:21.120 INFO:tasks.rados.rados.0.smithi084.stdout:1702: done (3 left) 2024-03-30T12:28:21.120 INFO:tasks.rados.rados.0.smithi084.stdout:1703: done (2 left) 2024-03-30T12:28:21.120 INFO:tasks.rados.rados.0.smithi084.stdout:1704: done (1 left) 2024-03-30T12:28:21.120 INFO:tasks.rados.rados.0.smithi084.stdout:1705: done (0 left) 2024-03-30T12:28:21.120 INFO:tasks.rados.rados.0.smithi084.stdout:1706: copy_from oid 35 from oid 2 current snap is 177 2024-03-30T12:28:21.120 INFO:tasks.rados.rados.0.smithi084.stdout:1707: copy_from oid 24 from oid 12 current snap is 177 2024-03-30T12:28:21.120 INFO:tasks.rados.rados.0.smithi084.stdout:1708: copy_from oid 44 from oid 36 current snap is 177 2024-03-30T12:28:21.120 INFO:tasks.rados.rados.0.smithi084.stdout:1709: snap_create 2024-03-30T12:28:21.124 INFO:tasks.rados.rados.0.smithi084.stdout:1706: finishing copy_from to smithi08477944-35 2024-03-30T12:28:21.124 INFO:tasks.rados.rados.0.smithi084.stdout:1706: got expected ENOENT (src dne) 2024-03-30T12:28:21.124 INFO:tasks.rados.rados.0.smithi084.stdout:1706: finishing copy_from racing read to smithi08477944-35 2024-03-30T12:28:21.134 INFO:tasks.rados.rados.0.smithi084.stdout:1707: finishing copy_from racing read to smithi08477944-24 2024-03-30T12:28:21.137 INFO:tasks.rados.rados.0.smithi084.stdout:1707: finishing copy_from to smithi08477944-24 2024-03-30T12:28:21.137 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 880 (ObjNum 455 snap 142 seq_num 455) dirty exists 2024-03-30T12:28:21.158 INFO:tasks.rados.rados.0.smithi084.stdout:1708: finishing copy_from racing read to smithi08477944-44 2024-03-30T12:28:21.161 INFO:tasks.rados.rados.0.smithi084.stdout:1708: finishing copy_from to smithi08477944-44 2024-03-30T12:28:21.162 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 806 (ObjNum 489 snap 154 seq_num 489) dirty exists 2024-03-30T12:28:21.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:21.132+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:21.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:21.132+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:21.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:21.331+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:21.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:21.331+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:21.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:21.331+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:21.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:21.331+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:21.712 INFO:tasks.rados.rados.0.smithi084.stdout:1706: done (3 left) 2024-03-30T12:28:21.712 INFO:tasks.rados.rados.0.smithi084.stdout:1707: done (2 left) 2024-03-30T12:28:21.712 INFO:tasks.rados.rados.0.smithi084.stdout:1708: done (1 left) 2024-03-30T12:28:21.712 INFO:tasks.rados.rados.0.smithi084.stdout:1709: done (0 left) 2024-03-30T12:28:21.712 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 178 2024-03-30T12:28:21.712 INFO:tasks.rados.rados.0.smithi084.stdout:1710: seq_num 530 ranges {6758400=483328,7241728=532480,7774208=671744} 2024-03-30T12:28:21.750 INFO:tasks.rados.rados.0.smithi084.stdout:1710: writing smithi08477944-45 from 6758400 to 7241728 tid 1 2024-03-30T12:28:21.754 INFO:tasks.rados.rados.0.smithi084.stdout:1710: writing smithi08477944-45 from 7241728 to 7774208 tid 2 2024-03-30T12:28:21.757 INFO:tasks.rados.rados.0.smithi084.stdout:1710: writing smithi08477944-45 from 7774208 to 8445952 tid 3 2024-03-30T12:28:21.758 INFO:tasks.rados.rados.0.smithi084.stdout:1711: rollback oid 15 current snap is 178 2024-03-30T12:28:21.758 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 15 to 177 2024-03-30T12:28:21.758 INFO:tasks.rados.rados.0.smithi084.stdout:1710: finishing write tid 1 to smithi08477944-45 2024-03-30T12:28:21.758 INFO:tasks.rados.rados.0.smithi084.stdout:1712: snap_remove snap 160 2024-03-30T12:28:21.922 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:21 smithi162 systemd[1]: Stopping Ceph osd.4 for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:28:21.922 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:21 smithi162 ceph-mon[83709]: pgmap v313: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 217 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 26 MiB/s rd, 3.1 MiB/s wr, 18 op/s 2024-03-30T12:28:21.922 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:21 smithi162 ceph-mon[83709]: osdmap e421: 8 total, 8 up, 8 in 2024-03-30T12:28:22.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:21 smithi084 ceph-mon[89279]: pgmap v313: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 217 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 26 MiB/s rd, 3.1 MiB/s wr, 18 op/s 2024-03-30T12:28:22.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:21 smithi084 ceph-mon[89279]: osdmap e421: 8 total, 8 up, 8 in 2024-03-30T12:28:22.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:21 smithi084 ceph-mon[91810]: pgmap v313: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 217 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 26 MiB/s rd, 3.1 MiB/s wr, 18 op/s 2024-03-30T12:28:22.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:21 smithi084 ceph-mon[91810]: osdmap e421: 8 total, 8 up, 8 in 2024-03-30T12:28:22.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:21.769+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:22.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:21.772+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:22.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:21.761+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:22.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:21.761+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:22.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:21.761+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:22.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:21.761+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:22.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:21.761+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:22.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:21.764+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:22.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:21.764+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:22.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[35199]: 2024-03-30T12:28:21.930+0000 7fee98f55700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:28:22.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[35199]: 2024-03-30T12:28:21.930+0000 7fee98f55700 -1 osd.4 421 *** Got signal Terminated *** 2024-03-30T12:28:22.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[35199]: 2024-03-30T12:28:21.930+0000 7fee98f55700 -1 osd.4 421 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T12:28:22.721 INFO:tasks.rados.rados.0.smithi084.stdout:1710: finishing write tid 2 to smithi08477944-45 2024-03-30T12:28:22.721 INFO:tasks.rados.rados.0.smithi084.stdout:1710: finishing write tid 3 to smithi08477944-45 2024-03-30T12:28:22.721 INFO:tasks.rados.rados.0.smithi084.stdout:1710: finishing write tid 4 to smithi08477944-45 2024-03-30T12:28:22.721 INFO:tasks.rados.rados.0.smithi084.stdout:1711: finishing rollback tid 0 to smithi08477944-15 2024-03-30T12:28:22.721 INFO:tasks.rados.rados.0.smithi084.stdout:1711: finishing rollback tid 1 to smithi08477944-15 2024-03-30T12:28:22.721 INFO:tasks.rados.rados.0.smithi084.stdout:1711: finishing rollback tid 2 to smithi08477944-15 2024-03-30T12:28:22.721 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 922 (ObjNum 529 snap 176 seq_num 529) dirty exists 2024-03-30T12:28:22.721 INFO:tasks.rados.rados.0.smithi084.stdout:1710: finishing write tid 5 to smithi08477944-45 2024-03-30T12:28:22.721 INFO:tasks.rados.rados.0.smithi084.stdout:1710: oid 45 updating version 0 to 914 2024-03-30T12:28:22.721 INFO:tasks.rados.rados.0.smithi084.stdout:1710: oid 45 updating version 914 to 915 2024-03-30T12:28:22.722 INFO:tasks.rados.rados.0.smithi084.stdout:1710: oid 45 updating version 915 to 917 2024-03-30T12:28:22.722 INFO:tasks.rados.rados.0.smithi084.stdout:1710: oid 45 version 917 is already newer than 916 2024-03-30T12:28:22.722 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 917 (ObjNum 530 snap 178 seq_num 530) dirty exists 2024-03-30T12:28:22.722 INFO:tasks.rados.rados.0.smithi084.stdout:1710: left oid 45 (ObjNum 530 snap 178 seq_num 530) 2024-03-30T12:28:22.722 INFO:tasks.rados.rados.0.smithi084.stdout:1710: done (2 left) 2024-03-30T12:28:22.722 INFO:tasks.rados.rados.0.smithi084.stdout:1711: done (1 left) 2024-03-30T12:28:22.722 INFO:tasks.rados.rados.0.smithi084.stdout:1712: done (0 left) 2024-03-30T12:28:22.722 INFO:tasks.rados.rados.0.smithi084.stdout:1713: read oid 6 snap 168 2024-03-30T12:28:22.722 INFO:tasks.rados.rados.0.smithi084.stdout:1713: expect (ObjNum 218 snap 64 seq_num 218) 2024-03-30T12:28:22.722 INFO:tasks.rados.rados.0.smithi084.stdout:1714: rollback oid 37 current snap is 178 2024-03-30T12:28:22.722 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 37 to 168 2024-03-30T12:28:22.722 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 178 2024-03-30T12:28:22.722 INFO:tasks.rados.rados.0.smithi084.stdout:1715: seq_num 531 ranges {2678784=499712,3178496=417792,3596288=548864,4145152=237568} 2024-03-30T12:28:22.739 INFO:tasks.rados.rados.0.smithi084.stdout:1715: writing smithi08477944-49 from 2678784 to 3178496 tid 1 2024-03-30T12:28:22.741 INFO:tasks.rados.rados.0.smithi084.stdout:1715: writing smithi08477944-49 from 3178496 to 3596288 tid 2 2024-03-30T12:28:22.744 INFO:tasks.rados.rados.0.smithi084.stdout:1715: writing smithi08477944-49 from 3596288 to 4145152 tid 3 2024-03-30T12:28:22.746 INFO:tasks.rados.rados.0.smithi084.stdout:1715: writing smithi08477944-49 from 4145152 to 4382720 tid 4 2024-03-30T12:28:22.746 INFO:tasks.rados.rados.0.smithi084.stdout:1716: copy_from oid 32 from oid 11 current snap is 178 2024-03-30T12:28:22.746 INFO:tasks.rados.rados.0.smithi084.stdout:1714: finishing rollback tid 0 to smithi08477944-37 2024-03-30T12:28:22.746 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 178 2024-03-30T12:28:22.746 INFO:tasks.rados.rados.0.smithi084.stdout:1714: finishing rollback tid 1 to smithi08477944-37 2024-03-30T12:28:22.746 INFO:tasks.rados.rados.0.smithi084.stdout:1714: finishing rollback tid 2 to smithi08477944-37 2024-03-30T12:28:22.746 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 805 (ObjNum 515 snap 164 seq_num 515) dirty exists 2024-03-30T12:28:22.746 INFO:tasks.rados.rados.0.smithi084.stdout:1717: seq_num 532 ranges {8708096=516096,9224192=696320,9920512=507904} 2024-03-30T12:28:22.794 INFO:tasks.rados.rados.0.smithi084.stdout:1717: writing smithi08477944-36 from 8708096 to 9224192 tid 1 2024-03-30T12:28:22.798 INFO:tasks.rados.rados.0.smithi084.stdout:1717: writing smithi08477944-36 from 9224192 to 9920512 tid 2 2024-03-30T12:28:22.801 INFO:tasks.rados.rados.0.smithi084.stdout:1717: writing smithi08477944-36 from 9920512 to 10428416 tid 3 2024-03-30T12:28:22.801 INFO:tasks.rados.rados.0.smithi084.stdout:1714: done (4 left) 2024-03-30T12:28:22.801 INFO:tasks.rados.rados.0.smithi084.stdout:1718: snap_remove snap 159 2024-03-30T12:28:23.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:22.733+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:23.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:22.741+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:23.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:22.741+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:23.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:22.741+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:23.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:23.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:23.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:23.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:23.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:23.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:23.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-mon[89279]: osdmap e422: 8 total, 8 up, 8 in 2024-03-30T12:28:23.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:23.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:23.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:23.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:23.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-mon[89279]: osd.4 marked itself down and dead 2024-03-30T12:28:23.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:23.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:23.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:23.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:23.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:23.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:23.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-mon[91810]: osdmap e422: 8 total, 8 up, 8 in 2024-03-30T12:28:23.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:23.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:23.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:23.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:23.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:22 smithi084 ceph-mon[91810]: osd.4 marked itself down and dead 2024-03-30T12:28:23.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:23.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:23.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:23.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:23.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:23.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:23.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:22 smithi162 ceph-mon[83709]: osdmap e422: 8 total, 8 up, 8 in 2024-03-30T12:28:23.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:23.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:23.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:23.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:23.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:22 smithi162 ceph-mon[83709]: osd.4 marked itself down and dead 2024-03-30T12:28:23.572 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:23 smithi162 podman[88908]: 2024-03-30 12:28:23.305314438 +0000 UTC m=+1.479504707 container died 1f52e827b91a78e5278f731215b08232361a5ecfdf082d7bf4eda5c1f77d34af (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=reef-f14b568, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-03-30T12:28:23.721 INFO:tasks.rados.rados.0.smithi084.stdout:1718: done (4 left) 2024-03-30T12:28:23.721 INFO:tasks.rados.rados.0.smithi084.stdout:1719: snap_remove snap 164 2024-03-30T12:28:23.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:23 smithi162 podman[88908]: 2024-03-30 12:28:23.747384773 +0000 UTC m=+1.921575040 container cleanup 1f52e827b91a78e5278f731215b08232361a5ecfdf082d7bf4eda5c1f77d34af (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=reef-f14b568, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-03-30T12:28:23.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:23 smithi162 bash[88908]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4 2024-03-30T12:28:23.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:23.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:23.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:23 smithi162 ceph-mon[83709]: pgmap v316: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 218 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 26 MiB/s rd, 3.1 MiB/s wr, 17 op/s 2024-03-30T12:28:23.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:23 smithi162 ceph-mon[83709]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T12:28:23.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:23 smithi162 ceph-mon[83709]: osdmap e423: 8 total, 7 up, 8 in 2024-03-30T12:28:23.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:23.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:23.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:23.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:24.006 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:23.736+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:24.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:24.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:24.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:23 smithi084 ceph-mon[89279]: pgmap v316: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 218 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 26 MiB/s rd, 3.1 MiB/s wr, 17 op/s 2024-03-30T12:28:24.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:23 smithi084 ceph-mon[89279]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T12:28:24.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:23 smithi084 ceph-mon[89279]: osdmap e423: 8 total, 7 up, 8 in 2024-03-30T12:28:24.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:24.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:24.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:24.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:24.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:24.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:24.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:23 smithi084 ceph-mon[91810]: pgmap v316: 121 pgs: 115 active+clean, 6 active+clean+snaptrim_error; 218 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 26 MiB/s rd, 3.1 MiB/s wr, 17 op/s 2024-03-30T12:28:24.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:23 smithi084 ceph-mon[91810]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T12:28:24.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:23 smithi084 ceph-mon[91810]: osdmap e423: 8 total, 7 up, 8 in 2024-03-30T12:28:24.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:24.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:24.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:24.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:24.009 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:23.730+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:24.009 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:23.731+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:24.009 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:23.731+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:24.009 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:23.734+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:24.009 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:23.734+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:24.344 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:23 smithi162 podman[88938]: 2024-03-30 12:28:23.924149119 +0000 UTC m=+0.616908842 container remove 1f52e827b91a78e5278f731215b08232361a5ecfdf082d7bf4eda5c1f77d34af (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-f14b568, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux ) 2024-03-30T12:28:24.596 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:24 smithi162 podman[89032]: 2024-03-30 12:28:24.257381754 +0000 UTC m=+0.018170075 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:28:24.596 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:24 smithi162 podman[89032]: 2024-03-30 12:28:24.391760938 +0000 UTC m=+0.152549239 container create a74c7e2d67f70a69c35c6402b0152ee2dac10969005f707076615be4e596b28d (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-03-30T12:28:24.596 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:24 smithi162 podman[89032]: 2024-03-30 12:28:24.602688667 +0000 UTC m=+0.363476965 container init a74c7e2d67f70a69c35c6402b0152ee2dac10969005f707076615be4e596b28d (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4-deactivate, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.license=GPLv2) 2024-03-30T12:28:24.733 INFO:tasks.rados.rados.0.smithi084.stdout:1713: expect (ObjNum 218 snap 64 seq_num 218) 2024-03-30T12:28:24.768 INFO:tasks.rados.rados.0.smithi084.stdout:1715: finishing write tid 1 to smithi08477944-49 2024-03-30T12:28:24.769 INFO:tasks.rados.rados.0.smithi084.stdout:1715: finishing write tid 2 to smithi08477944-49 2024-03-30T12:28:24.769 INFO:tasks.rados.rados.0.smithi084.stdout:1715: finishing write tid 3 to smithi08477944-49 2024-03-30T12:28:24.769 INFO:tasks.rados.rados.0.smithi084.stdout:1715: finishing write tid 4 to smithi08477944-49 2024-03-30T12:28:24.769 INFO:tasks.rados.rados.0.smithi084.stdout:1715: finishing write tid 5 to smithi08477944-49 2024-03-30T12:28:24.769 INFO:tasks.rados.rados.0.smithi084.stdout:1717: finishing write tid 1 to smithi08477944-36 2024-03-30T12:28:24.769 INFO:tasks.rados.rados.0.smithi084.stdout:1715: finishing write tid 6 to smithi08477944-49 2024-03-30T12:28:24.769 INFO:tasks.rados.rados.0.smithi084.stdout:1715: oid 49 updating version 0 to 814 2024-03-30T12:28:24.769 INFO:tasks.rados.rados.0.smithi084.stdout:1715: oid 49 updating version 814 to 818 2024-03-30T12:28:24.769 INFO:tasks.rados.rados.0.smithi084.stdout:1715: oid 49 version 818 is already newer than 815 2024-03-30T12:28:24.769 INFO:tasks.rados.rados.0.smithi084.stdout:1715: oid 49 version 818 is already newer than 816 2024-03-30T12:28:24.769 INFO:tasks.rados.rados.0.smithi084.stdout:1715: oid 49 version 818 is already newer than 817 2024-03-30T12:28:24.769 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 818 (ObjNum 531 snap 178 seq_num 531) dirty exists 2024-03-30T12:28:24.769 INFO:tasks.rados.rados.0.smithi084.stdout:1715: left oid 49 (ObjNum 531 snap 178 seq_num 531) 2024-03-30T12:28:24.769 INFO:tasks.rados.rados.0.smithi084.stdout:1717: finishing write tid 2 to smithi08477944-36 2024-03-30T12:28:24.769 INFO:tasks.rados.rados.0.smithi084.stdout:1713: done (4 left) 2024-03-30T12:28:24.770 INFO:tasks.rados.rados.0.smithi084.stdout:1715: done (3 left) 2024-03-30T12:28:24.770 INFO:tasks.rados.rados.0.smithi084.stdout:1719: done (2 left) 2024-03-30T12:28:24.770 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 33 current snap is 178 2024-03-30T12:28:24.770 INFO:tasks.rados.rados.0.smithi084.stdout:1717: finishing write tid 3 to smithi08477944-36 2024-03-30T12:28:24.770 INFO:tasks.rados.rados.0.smithi084.stdout:1717: finishing write tid 4 to smithi08477944-36 2024-03-30T12:28:24.770 INFO:tasks.rados.rados.0.smithi084.stdout:1720: seq_num 533 ranges {0=532480,532480=630784,1163264=516096,1679360=57344} 2024-03-30T12:28:24.771 INFO:tasks.rados.rados.0.smithi084.stdout:1720: writing smithi08477944-33 from 0 to 532480 tid 1 2024-03-30T12:28:24.775 INFO:tasks.rados.rados.0.smithi084.stdout:1720: writing smithi08477944-33 from 532480 to 1163264 tid 2 2024-03-30T12:28:24.778 INFO:tasks.rados.rados.0.smithi084.stdout:1720: writing smithi08477944-33 from 1163264 to 1679360 tid 3 2024-03-30T12:28:24.779 INFO:tasks.rados.rados.0.smithi084.stdout:1720: writing smithi08477944-33 from 1679360 to 1736704 tid 4 2024-03-30T12:28:24.779 INFO:tasks.rados.rados.0.smithi084.stdout:1721: setattr oid 15 current snap is 178 2024-03-30T12:28:24.779 INFO:tasks.rados.rados.0.smithi084.stdout:1717: finishing write tid 5 to smithi08477944-36 2024-03-30T12:28:24.779 INFO:tasks.rados.rados.0.smithi084.stdout:1717: oid 36 updating version 0 to 821 2024-03-30T12:28:24.779 INFO:tasks.rados.rados.0.smithi084.stdout:1717: oid 36 version 821 is already newer than 820 2024-03-30T12:28:24.779 INFO:tasks.rados.rados.0.smithi084.stdout:1717: oid 36 updating version 821 to 822 2024-03-30T12:28:24.779 INFO:tasks.rados.rados.0.smithi084.stdout:1717: oid 36 version 822 is already newer than 819 2024-03-30T12:28:24.779 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 822 (ObjNum 532 snap 178 seq_num 532) dirty exists 2024-03-30T12:28:24.779 INFO:tasks.rados.rados.0.smithi084.stdout:1717: left oid 36 (ObjNum 532 snap 178 seq_num 532) 2024-03-30T12:28:24.779 INFO:tasks.rados.rados.0.smithi084.stdout:1716: finishing copy_from racing read to smithi08477944-32 2024-03-30T12:28:24.779 INFO:tasks.rados.rados.0.smithi084.stdout:1716: finishing copy_from to smithi08477944-32 2024-03-30T12:28:24.780 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 548 (ObjNum 280 snap 90 seq_num 280) dirty exists 2024-03-30T12:28:24.780 INFO:tasks.rados.rados.0.smithi084.stdout:1720: finishing write tid 1 to smithi08477944-33 2024-03-30T12:28:24.780 INFO:tasks.rados.rados.0.smithi084.stdout:1720: finishing write tid 2 to smithi08477944-33 2024-03-30T12:28:24.781 INFO:tasks.rados.rados.0.smithi084.stdout:1716: done (3 left) 2024-03-30T12:28:24.781 INFO:tasks.rados.rados.0.smithi084.stdout:1717: done (2 left) 2024-03-30T12:28:24.781 INFO:tasks.rados.rados.0.smithi084.stdout:1722: rollback oid 11 current snap is 178 2024-03-30T12:28:24.781 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 11 to 177 2024-03-30T12:28:24.782 INFO:tasks.rados.rados.0.smithi084.stdout:1723: read oid 47 snap -1 2024-03-30T12:28:24.782 INFO:tasks.rados.rados.0.smithi084.stdout:1723: expect (ObjNum 511 snap 162 seq_num 511) 2024-03-30T12:28:24.782 INFO:tasks.rados.rados.0.smithi084.stdout:1724: snap_remove snap 176 2024-03-30T12:28:24.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:24 smithi162 ceph-mon[83709]: osdmap e424: 8 total, 7 up, 8 in 2024-03-30T12:28:24.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:24.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:24.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:24.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:24.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:24 smithi162 podman[89032]: 2024-03-30 12:28:24.605780822 +0000 UTC m=+0.366569121 container start a74c7e2d67f70a69c35c6402b0152ee2dac10969005f707076615be4e596b28d (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3) 2024-03-30T12:28:24.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:24 smithi162 podman[89032]: 2024-03-30 12:28:24.719833297 +0000 UTC m=+0.480621605 container attach a74c7e2d67f70a69c35c6402b0152ee2dac10969005f707076615be4e596b28d (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3) 2024-03-30T12:28:25.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:24.744+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:25.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:24 smithi084 ceph-mon[89279]: osdmap e424: 8 total, 7 up, 8 in 2024-03-30T12:28:25.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:25.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:25.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:25.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:24 smithi084 ceph-mon[91810]: osdmap e424: 8 total, 7 up, 8 in 2024-03-30T12:28:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:25.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:25.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:24.738+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:25.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:24.738+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:25.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:24.738+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:25.188 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:24 smithi162 podman[89032]: 2024-03-30 12:28:24.916664412 +0000 UTC m=+0.677452703 container died a74c7e2d67f70a69c35c6402b0152ee2dac10969005f707076615be4e596b28d (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True) 2024-03-30T12:28:25.729 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:25 smithi162 podman[89058]: 2024-03-30 12:28:25.46519359 +0000 UTC m=+0.543214523 container remove a74c7e2d67f70a69c35c6402b0152ee2dac10969005f707076615be4e596b28d (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-03-30T12:28:25.729 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:25 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.4.service: Deactivated successfully. 2024-03-30T12:28:25.729 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:25 smithi162 systemd[1]: Stopped Ceph osd.4 for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:28:25.729 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:25 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.4.service: Consumed 12.248s CPU time. 2024-03-30T12:28:25.729 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:25 smithi162 systemd[1]: Starting Ceph osd.4 for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:28:25.738 INFO:tasks.rados.rados.0.smithi084.stdout:1724: done (4 left) 2024-03-30T12:28:25.738 INFO:tasks.rados.rados.0.smithi084.stdout:1725: read oid 37 snap 177 2024-03-30T12:28:25.738 INFO:tasks.rados.rados.0.smithi084.stdout:1725: expect (ObjNum 515 snap 164 seq_num 515) 2024-03-30T12:28:25.738 INFO:tasks.rados.rados.0.smithi084.stdout:1726: rollback oid 12 current snap is 178 2024-03-30T12:28:25.738 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 12 to 171 2024-03-30T12:28:25.738 INFO:tasks.rados.rados.0.smithi084.stdout:1720: finishing write tid 3 to smithi08477944-33 2024-03-30T12:28:25.738 INFO:tasks.rados.rados.0.smithi084.stdout:1720: finishing write tid 4 to smithi08477944-33 2024-03-30T12:28:25.738 INFO:tasks.rados.rados.0.smithi084.stdout:1720: finishing write tid 5 to smithi08477944-33 2024-03-30T12:28:25.738 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 923 (ObjNum 529 snap 176 seq_num 529) dirty exists 2024-03-30T12:28:25.739 INFO:tasks.rados.rados.0.smithi084.stdout:1721: done (5 left) 2024-03-30T12:28:25.739 INFO:tasks.rados.rados.0.smithi084.stdout:1727: read oid 41 snap 166 2024-03-30T12:28:25.739 INFO:tasks.rados.rados.0.smithi084.stdout:1727: expect deleted 2024-03-30T12:28:25.739 INFO:tasks.rados.rados.0.smithi084.stdout:1728: snap_create 2024-03-30T12:28:25.739 INFO:tasks.rados.rados.0.smithi084.stdout:1720: finishing write tid 6 to smithi08477944-33 2024-03-30T12:28:25.739 INFO:tasks.rados.rados.0.smithi084.stdout:1720: oid 33 updating version 0 to 914 2024-03-30T12:28:25.739 INFO:tasks.rados.rados.0.smithi084.stdout:1720: oid 33 version 914 is already newer than 913 2024-03-30T12:28:25.739 INFO:tasks.rados.rados.0.smithi084.stdout:1720: oid 33 updating version 914 to 917 2024-03-30T12:28:25.739 INFO:tasks.rados.rados.0.smithi084.stdout:1720: oid 33 version 917 is already newer than 915 2024-03-30T12:28:25.739 INFO:tasks.rados.rados.0.smithi084.stdout:1720: oid 33 version 917 is already newer than 916 2024-03-30T12:28:25.739 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 917 (ObjNum 533 snap 178 seq_num 533) dirty exists 2024-03-30T12:28:25.739 INFO:tasks.rados.rados.0.smithi084.stdout:1720: left oid 33 (ObjNum 533 snap 178 seq_num 533) 2024-03-30T12:28:25.739 INFO:tasks.rados.rados.0.smithi084.stdout:1723: expect (ObjNum 511 snap 162 seq_num 511) 2024-03-30T12:28:25.777 INFO:tasks.rados.rados.0.smithi084.stdout:1722: finishing rollback tid 0 to smithi08477944-11 2024-03-30T12:28:25.777 INFO:tasks.rados.rados.0.smithi084.stdout:1722: finishing rollback tid 1 to smithi08477944-11 2024-03-30T12:28:25.777 INFO:tasks.rados.rados.0.smithi084.stdout:1722: finishing rollback tid 2 to smithi08477944-11 2024-03-30T12:28:25.777 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 906 (ObjNum 280 snap 90 seq_num 280) dirty exists 2024-03-30T12:28:25.777 INFO:tasks.rados.rados.0.smithi084.stdout:1726: finishing rollback tid 0 to smithi08477944-12 2024-03-30T12:28:25.777 INFO:tasks.rados.rados.0.smithi084.stdout:1726: finishing rollback tid 1 to smithi08477944-12 2024-03-30T12:28:25.777 INFO:tasks.rados.rados.0.smithi084.stdout:1726: finishing rollback tid 2 to smithi08477944-12 2024-03-30T12:28:25.777 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 883 (ObjNum 455 snap 142 seq_num 455) dirty exists 2024-03-30T12:28:25.777 INFO:tasks.rados.rados.0.smithi084.stdout:1725: expect (ObjNum 515 snap 164 seq_num 515) 2024-03-30T12:28:25.937 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-03-30T12:28:26.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:25.753+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:26.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:25 smithi084 ceph-mon[91810]: pgmap v319: 121 pgs: 4 active+undersized, 3 active+undersized+degraded, 1 peering+snaptrim_error, 1 peering, 7 stale+active+clean, 100 active+clean, 5 active+clean+snaptrim_error; 221 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 5 op/s; 5/513 objects degraded (0.975%) 2024-03-30T12:28:26.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:25 smithi084 ceph-mon[91810]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-03-30T12:28:26.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:25 smithi084 ceph-mon[91810]: Health check failed: Degraded data redundancy: 5/513 objects degraded (0.975%), 3 pgs degraded (PG_DEGRADED) 2024-03-30T12:28:26.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:26.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:26.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:26.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:25 smithi084 ceph-mon[91810]: osdmap e425: 8 total, 7 up, 8 in 2024-03-30T12:28:26.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:26.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:25.742+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:26.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:25.742+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:26.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:25.743+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:26.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:25.743+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:26.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:25.743+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:26.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:25 smithi084 ceph-mon[89279]: pgmap v319: 121 pgs: 4 active+undersized, 3 active+undersized+degraded, 1 peering+snaptrim_error, 1 peering, 7 stale+active+clean, 100 active+clean, 5 active+clean+snaptrim_error; 221 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 5 op/s; 5/513 objects degraded (0.975%) 2024-03-30T12:28:26.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:25 smithi084 ceph-mon[89279]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-03-30T12:28:26.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:25 smithi084 ceph-mon[89279]: Health check failed: Degraded data redundancy: 5/513 objects degraded (0.975%), 3 pgs degraded (PG_DEGRADED) 2024-03-30T12:28:26.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:26.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:26.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:26.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:25 smithi084 ceph-mon[89279]: osdmap e425: 8 total, 7 up, 8 in 2024-03-30T12:28:26.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:26.023 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:25 smithi162 podman[89164]: 2024-03-30 12:28:25.908073758 +0000 UTC m=+0.110370791 container create b06f1bdac081f748a30bc9d5d7f4a0bd4639faa17baeb998bb4567989ed976c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4-activate, ceph=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-03-30T12:28:26.023 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:25 smithi162 podman[89164]: 2024-03-30 12:28:25.815779121 +0000 UTC m=+0.018076113 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:28:26.023 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:25 smithi162 ceph-mon[83709]: pgmap v319: 121 pgs: 4 active+undersized, 3 active+undersized+degraded, 1 peering+snaptrim_error, 1 peering, 7 stale+active+clean, 100 active+clean, 5 active+clean+snaptrim_error; 221 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 5 op/s; 5/513 objects degraded (0.975%) 2024-03-30T12:28:26.023 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:25 smithi162 ceph-mon[83709]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-03-30T12:28:26.023 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:25 smithi162 ceph-mon[83709]: Health check failed: Degraded data redundancy: 5/513 objects degraded (0.975%), 3 pgs degraded (PG_DEGRADED) 2024-03-30T12:28:26.023 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:26.023 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:26.023 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:26.023 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:25 smithi162 ceph-mon[83709]: osdmap e425: 8 total, 7 up, 8 in 2024-03-30T12:28:26.024 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:26.250 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T12:28:26.251 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (7m) 28s ago 8m 25.3M - 0.25.0 c8568f914cd2 6765ce007f39 2024-03-30T12:28:26.251 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi162 *:3000 running (8m) 2m ago 8m 91.0M - 9.4.7 954c08fa6188 ff2ec7518619 2024-03-30T12:28:26.251 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (9m) 28s ago 9m 15.1M - 18.2.2-1051-gf14b5682 c8fb09e16a7d a9c2e74ca2a3 2024-03-30T12:28:26.251 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi162 running (9m) 2m ago 9m 19.7M - 18.2.2-1051-gf14b5682 c8fb09e16a7d ee1770ef5edd 2024-03-30T12:28:26.251 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi162 *:8443,9283,8765 running (4m) 2m ago 12m 449M - 19.0.0-1864-g5dc2ea30 548196a1a838 eec968f3fcc6 2024-03-30T12:28:26.251 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (4m) 28s ago 14m 512M - 19.0.0-1864-g5dc2ea30 548196a1a838 9a2aba19dffc 2024-03-30T12:28:26.251 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (3m) 28s ago 14m 55.0M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 a0811f2ae47d 2024-03-30T12:28:26.251 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi162 running (3m) 2m ago 13m 24.9M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 149ae6649e0c 2024-03-30T12:28:26.251 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (3m) 28s ago 13m 47.4M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 f79eca93cddd 2024-03-30T12:28:26.251 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (8m) 28s ago 8m 16.9M - 1.5.0 0da6a335fe13 66844bed39e8 2024-03-30T12:28:26.251 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi162 *:9100 running (8m) 2m ago 8m 15.5M - 1.5.0 0da6a335fe13 3d6e28b2348d 2024-03-30T12:28:26.251 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (2m) 28s ago 12m 182M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 c91eea4f8484 2024-03-30T12:28:26.251 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (101s) 28s ago 12m 109M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 7518832f6b4a 2024-03-30T12:28:26.252 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (67s) 28s ago 11m 123M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 647dd862762d 2024-03-30T12:28:26.252 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (33s) 28s ago 11m 15.1M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 c088a701b71b 2024-03-30T12:28:26.252 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi162 running (11m) 2m ago 11m 195M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 1f52e827b91a 2024-03-30T12:28:26.252 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi162 running (10m) 2m ago 10m 188M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 7ba250d154aa 2024-03-30T12:28:26.252 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi162 running (10m) 2m ago 10m 108M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 656a733e8b7a 2024-03-30T12:28:26.252 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi162 running (9m) 2m ago 9m 127M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d e3246b3bc88b 2024-03-30T12:28:26.252 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi162 *:9095 running (4m) 2m ago 8m 51.4M - 2.43.0 a07b618ecd1d bd7d323e4b47 2024-03-30T12:28:26.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:26 smithi162 podman[89164]: 2024-03-30 12:28:26.177693943 +0000 UTC m=+0.379990938 container init b06f1bdac081f748a30bc9d5d7f4a0bd4639faa17baeb998bb4567989ed976c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:28:26.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:26 smithi162 podman[89164]: 2024-03-30 12:28:26.180920805 +0000 UTC m=+0.383217800 container start b06f1bdac081f748a30bc9d5d7f4a0bd4639faa17baeb998bb4567989ed976c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4-activate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T12:28:26.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:26 smithi162 podman[89164]: 2024-03-30 12:28:26.252687045 +0000 UTC m=+0.454984045 container attach b06f1bdac081f748a30bc9d5d7f4a0bd4639faa17baeb998bb4567989ed976c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4-activate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-03-30T12:28:26.636 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-30T12:28:26.636 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-03-30T12:28:26.636 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 3 2024-03-30T12:28:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:28:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-03-30T12:28:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 2 2024-03-30T12:28:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:28:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-03-30T12:28:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 3, 2024-03-30T12:28:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 4 2024-03-30T12:28:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:28:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-03-30T12:28:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 2 2024-03-30T12:28:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:28:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-03-30T12:28:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 5, 2024-03-30T12:28:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 9 2024-03-30T12:28:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-30T12:28:26.638 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-30T12:28:26.740 INFO:tasks.rados.rados.0.smithi084.stdout:1720: done (6 left) 2024-03-30T12:28:26.740 INFO:tasks.rados.rados.0.smithi084.stdout:1722: done (5 left) 2024-03-30T12:28:26.740 INFO:tasks.rados.rados.0.smithi084.stdout:1723: done (4 left) 2024-03-30T12:28:26.740 INFO:tasks.rados.rados.0.smithi084.stdout:1725: done (3 left) 2024-03-30T12:28:26.740 INFO:tasks.rados.rados.0.smithi084.stdout:1726: done (2 left) 2024-03-30T12:28:26.740 INFO:tasks.rados.rados.0.smithi084.stdout:1727: done (1 left) 2024-03-30T12:28:26.741 INFO:tasks.rados.rados.0.smithi084.stdout:1728: done (0 left) 2024-03-30T12:28:26.741 INFO:tasks.rados.rados.0.smithi084.stdout:1729: snap_create 2024-03-30T12:28:26.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:26.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:26 smithi162 ceph-mon[83709]: osdmap e426: 8 total, 7 up, 8 in 2024-03-30T12:28:26.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:26.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:26.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:26.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:26 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/353107049' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:28:26.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4-activate[89179]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-30T12:28:26.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4-activate[89179]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-03-30T12:28:26.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:26 smithi162 bash[89164]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-30T12:28:26.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:26 smithi162 bash[89164]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-03-30T12:28:26.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:26 smithi162 bash[89164]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-03-30T12:28:26.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:26 smithi162 bash[89164]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-03-30T12:28:26.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:26 smithi162 bash[89164]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-4/block 2024-03-30T12:28:26.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:26 smithi162 bash[89164]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-30T12:28:26.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:26 smithi162 bash[89164]: --> ceph-volume raw activate successful for osd ID: 4 2024-03-30T12:28:26.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4-activate[89179]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-03-30T12:28:26.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4-activate[89179]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-03-30T12:28:26.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4-activate[89179]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-4/block 2024-03-30T12:28:26.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4-activate[89179]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-30T12:28:26.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4-activate[89179]: --> ceph-volume raw activate successful for osd ID: 4 2024-03-30T12:28:26.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:26 smithi162 podman[89164]: 2024-03-30 12:28:26.653416016 +0000 UTC m=+0.855713009 container died b06f1bdac081f748a30bc9d5d7f4a0bd4639faa17baeb998bb4567989ed976c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4-activate, org.label-schema.vendor=CentOS, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-03-30T12:28:27.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:27.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:26 smithi084 ceph-mon[91810]: osdmap e426: 8 total, 7 up, 8 in 2024-03-30T12:28:27.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:27.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:27.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:27.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:26 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/353107049' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:28:27.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:27.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:26 smithi084 ceph-mon[89279]: osdmap e426: 8 total, 7 up, 8 in 2024-03-30T12:28:27.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:27.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:27.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:27.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:26 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/353107049' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:28:27.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:27.258+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:27.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:27.011+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:27.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:27.011+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:27.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:27.011+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:27.561 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:27 smithi162 podman[89300]: 2024-03-30 12:28:27.248431367 +0000 UTC m=+0.589967559 container remove b06f1bdac081f748a30bc9d5d7f4a0bd4639faa17baeb998bb4567989ed976c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4-activate, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T12:28:27.561 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:27 smithi162 podman[89364]: 2024-03-30 12:28:27.364084688 +0000 UTC m=+0.018057968 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:28:27.561 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:27 smithi162 podman[89364]: 2024-03-30 12:28:27.474391502 +0000 UTC m=+0.128364807 container create 4197b37d2bb891d688a8c001724b66d9a7db20d74ec7a4aa2b2d0caf7e6378fb (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:28:27.742 INFO:tasks.rados.rados.0.smithi084.stdout:1729: done (0 left) 2024-03-30T12:28:27.742 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 180 2024-03-30T12:28:27.742 INFO:tasks.rados.rados.0.smithi084.stdout:1730: seq_num 534 ranges {1163264=548864,1712128=516096,2228224=688128} 2024-03-30T12:28:27.751 INFO:tasks.rados.rados.0.smithi084.stdout:1730: writing smithi08477944-50 from 1163264 to 1712128 tid 1 2024-03-30T12:28:27.754 INFO:tasks.rados.rados.0.smithi084.stdout:1730: writing smithi08477944-50 from 1712128 to 2228224 tid 2 2024-03-30T12:28:27.759 INFO:tasks.rados.rados.0.smithi084.stdout:1730: writing smithi08477944-50 from 2228224 to 2916352 tid 3 2024-03-30T12:28:27.759 INFO:tasks.rados.rados.0.smithi084.stdout:1731: rmattr oid 14 current snap is 180 2024-03-30T12:28:27.759 INFO:tasks.rados.rados.0.smithi084.stdout:1732: read oid 45 snap -1 2024-03-30T12:28:27.759 INFO:tasks.rados.rados.0.smithi084.stdout:1732: expect (ObjNum 530 snap 178 seq_num 530) 2024-03-30T12:28:27.759 INFO:tasks.rados.rados.0.smithi084.stdout:1733: snap_create 2024-03-30T12:28:27.759 INFO:tasks.rados.rados.0.smithi084.stdout:1730: finishing write tid 1 to smithi08477944-50 2024-03-30T12:28:27.761 INFO:tasks.rados.rados.0.smithi084.stdout:1730: finishing write tid 2 to smithi08477944-50 2024-03-30T12:28:27.761 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 806 (ObjNum 457 snap 143 seq_num 457) dirty exists 2024-03-30T12:28:27.763 INFO:tasks.rados.rados.0.smithi084.stdout:1730: finishing write tid 3 to smithi08477944-50 2024-03-30T12:28:27.764 INFO:tasks.rados.rados.0.smithi084.stdout:1730: finishing write tid 4 to smithi08477944-50 2024-03-30T12:28:27.784 INFO:tasks.rados.rados.0.smithi084.stdout:1730: finishing write tid 5 to smithi08477944-50 2024-03-30T12:28:27.784 INFO:tasks.rados.rados.0.smithi084.stdout:1730: oid 50 updating version 0 to 922 2024-03-30T12:28:27.785 INFO:tasks.rados.rados.0.smithi084.stdout:1730: oid 50 version 922 is already newer than 921 2024-03-30T12:28:27.785 INFO:tasks.rados.rados.0.smithi084.stdout:1730: oid 50 version 922 is already newer than 920 2024-03-30T12:28:27.785 INFO:tasks.rados.rados.0.smithi084.stdout:1730: oid 50 version 922 is already newer than 919 2024-03-30T12:28:27.785 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 922 (ObjNum 534 snap 180 seq_num 534) dirty exists 2024-03-30T12:28:27.785 INFO:tasks.rados.rados.0.smithi084.stdout:1730: left oid 50 (ObjNum 534 snap 180 seq_num 534) 2024-03-30T12:28:27.794 INFO:tasks.rados.rados.0.smithi084.stdout:1732: expect (ObjNum 530 snap 178 seq_num 530) 2024-03-30T12:28:27.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:27 smithi162 ceph-mon[83709]: from='client.34299 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:28:27.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:27 smithi162 ceph-mon[83709]: from='client.44240 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:28:27.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:27 smithi162 ceph-mon[83709]: pgmap v322: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 29 active+undersized, 9 active+undersized+degraded, 1 peering+snaptrim_error, 1 peering, 1 stale+active+clean, 75 active+clean, 4 active+clean+snaptrim_error; 230 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 1.0 MiB/s rd, 3.8 MiB/s wr, 13 op/s; 44/510 objects degraded (8.627%) 2024-03-30T12:28:27.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:27 smithi162 ceph-mon[83709]: osdmap e427: 8 total, 7 up, 8 in 2024-03-30T12:28:27.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:27 smithi162 podman[89364]: 2024-03-30 12:28:27.659954901 +0000 UTC m=+0.313928176 container init 4197b37d2bb891d688a8c001724b66d9a7db20d74ec7a4aa2b2d0caf7e6378fb (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2) 2024-03-30T12:28:27.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:27 smithi162 podman[89364]: 2024-03-30 12:28:27.662979053 +0000 UTC m=+0.316952317 container start 4197b37d2bb891d688a8c001724b66d9a7db20d74ec7a4aa2b2d0caf7e6378fb (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-03-30T12:28:27.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:27 smithi162 ceph-osd[89383]: -- 172.21.15.162:0/2393563566 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556cc20f5680 con 0x556cc20bec00 2024-03-30T12:28:27.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:27 smithi162 bash[89364]: 4197b37d2bb891d688a8c001724b66d9a7db20d74ec7a4aa2b2d0caf7e6378fb 2024-03-30T12:28:27.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:27 smithi162 systemd[1]: Started Ceph osd.4 for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:28:28.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:27.771+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:28.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:27 smithi084 ceph-mon[91810]: from='client.34299 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:28:28.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:27 smithi084 ceph-mon[91810]: from='client.44240 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:28:28.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:27 smithi084 ceph-mon[91810]: pgmap v322: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 29 active+undersized, 9 active+undersized+degraded, 1 peering+snaptrim_error, 1 peering, 1 stale+active+clean, 75 active+clean, 4 active+clean+snaptrim_error; 230 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 1.0 MiB/s rd, 3.8 MiB/s wr, 13 op/s; 44/510 objects degraded (8.627%) 2024-03-30T12:28:28.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:27 smithi084 ceph-mon[91810]: osdmap e427: 8 total, 7 up, 8 in 2024-03-30T12:28:28.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:27 smithi084 ceph-mon[89279]: from='client.34299 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:28:28.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:27 smithi084 ceph-mon[89279]: from='client.44240 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:28:28.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:27 smithi084 ceph-mon[89279]: pgmap v322: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 29 active+undersized, 9 active+undersized+degraded, 1 peering+snaptrim_error, 1 peering, 1 stale+active+clean, 75 active+clean, 4 active+clean+snaptrim_error; 230 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 1.0 MiB/s rd, 3.8 MiB/s wr, 13 op/s; 44/510 objects degraded (8.627%) 2024-03-30T12:28:28.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:27 smithi084 ceph-mon[89279]: osdmap e427: 8 total, 7 up, 8 in 2024-03-30T12:28:28.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:27.762+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:28.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:27.763+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:28.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:27.763+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:28.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:27.765+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:28.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:27.765+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:28.580 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:28.207+0000 7f9e71c8b7c0 -1 Falling back to public interface 2024-03-30T12:28:28.756 INFO:tasks.rados.rados.0.smithi084.stdout:1730: done (3 left) 2024-03-30T12:28:28.757 INFO:tasks.rados.rados.0.smithi084.stdout:1731: done (2 left) 2024-03-30T12:28:28.757 INFO:tasks.rados.rados.0.smithi084.stdout:1732: done (1 left) 2024-03-30T12:28:28.757 INFO:tasks.rados.rados.0.smithi084.stdout:1733: done (0 left) 2024-03-30T12:28:28.757 INFO:tasks.rados.rados.0.smithi084.stdout:1734: read oid 48 snap -1 2024-03-30T12:28:28.757 INFO:tasks.rados.rados.0.smithi084.stdout:1734: expect (ObjNum 526 snap 173 seq_num 526) 2024-03-30T12:28:28.757 INFO:tasks.rados.rados.0.smithi084.stdout:1735: delete oid 39 current snap is 181 2024-03-30T12:28:28.764 INFO:tasks.rados.rados.0.smithi084.stdout:1735: done (1 left) 2024-03-30T12:28:28.764 INFO:tasks.rados.rados.0.smithi084.stdout:1736: read oid 35 snap -1 2024-03-30T12:28:28.764 INFO:tasks.rados.rados.0.smithi084.stdout:1736: expect (ObjNum 501 snap 156 seq_num 501) 2024-03-30T12:28:28.764 INFO:tasks.rados.rados.0.smithi084.stdout:1737: snap_create 2024-03-30T12:28:28.767 INFO:tasks.rados.rados.0.smithi084.stdout:1734: expect (ObjNum 526 snap 173 seq_num 526) 2024-03-30T12:28:28.811 INFO:tasks.rados.rados.0.smithi084.stdout:1736: expect (ObjNum 501 snap 156 seq_num 501) 2024-03-30T12:28:28.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:28.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:28.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:28.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:28.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:28 smithi162 ceph-mon[83709]: osdmap e428: 8 total, 7 up, 8 in 2024-03-30T12:28:28.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:28.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:28.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:28.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:28 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:28.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:28 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:28.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:28 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:28:29.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:28.770+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:29.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:28.811+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:29.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:28.811+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:29.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:28.812+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:29.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-mon[91810]: osdmap e428: 8 total, 7 up, 8 in 2024-03-30T12:28:29.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:29.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:29.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:29.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:29.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:29.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:28:29.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:29.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:29.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:29.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:29.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-mon[89279]: osdmap e428: 8 total, 7 up, 8 in 2024-03-30T12:28:29.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:29.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:29.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:29.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:29.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:29.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:28 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:28:29.696 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:28:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:28:29] "GET /metrics HTTP/1.1" 200 36260 "" "Prometheus/2.43.0" 2024-03-30T12:28:29.766 INFO:tasks.rados.rados.0.smithi084.stdout:1734: done (2 left) 2024-03-30T12:28:29.767 INFO:tasks.rados.rados.0.smithi084.stdout:1736: done (1 left) 2024-03-30T12:28:29.767 INFO:tasks.rados.rados.0.smithi084.stdout:1737: done (0 left) 2024-03-30T12:28:29.767 INFO:tasks.rados.rados.0.smithi084.stdout:1738: snap_create 2024-03-30T12:28:30.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:30.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:29 smithi084 ceph-mon[91810]: pgmap v325: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 33 active+undersized, 11 active+undersized+degraded, 71 active+clean, 4 active+clean+snaptrim_error; 242 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 7.9 MiB/s rd, 5.9 MiB/s wr, 16 op/s; 59/516 objects degraded (11.434%) 2024-03-30T12:28:30.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:29 smithi084 ceph-mon[91810]: osdmap e429: 8 total, 7 up, 8 in 2024-03-30T12:28:30.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:30.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:30.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:30.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:29 smithi084 ceph-mon[91810]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-03-30T12:28:30.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:29 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:30.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:29 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:28:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:29 smithi084 ceph-mon[89279]: pgmap v325: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 33 active+undersized, 11 active+undersized+degraded, 71 active+clean, 4 active+clean+snaptrim_error; 242 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 7.9 MiB/s rd, 5.9 MiB/s wr, 16 op/s; 59/516 objects degraded (11.434%) 2024-03-30T12:28:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:29 smithi084 ceph-mon[89279]: osdmap e429: 8 total, 7 up, 8 in 2024-03-30T12:28:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:29 smithi084 ceph-mon[89279]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-03-30T12:28:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:29 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:29 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:28:30.026 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:30.026 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:29 smithi162 ceph-mon[83709]: pgmap v325: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 33 active+undersized, 11 active+undersized+degraded, 71 active+clean, 4 active+clean+snaptrim_error; 242 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 7.9 MiB/s rd, 5.9 MiB/s wr, 16 op/s; 59/516 objects degraded (11.434%) 2024-03-30T12:28:30.027 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:29 smithi162 ceph-mon[83709]: osdmap e429: 8 total, 7 up, 8 in 2024-03-30T12:28:30.027 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:30.027 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:30.027 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:30.027 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:29 smithi162 ceph-mon[83709]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-03-30T12:28:30.027 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:29 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:30.027 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:29 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:28:30.774 INFO:tasks.rados.rados.0.smithi084.stdout:1738: done (0 left) 2024-03-30T12:28:30.774 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 183 2024-03-30T12:28:30.774 INFO:tasks.rados.rados.0.smithi084.stdout:1739: seq_num 536 ranges {5668864=581632,6250496=688128,6938624=516096} 2024-03-30T12:28:30.807 INFO:tasks.rados.rados.0.smithi084.stdout:1739: writing smithi08477944-11 from 5668864 to 6250496 tid 1 2024-03-30T12:28:30.811 INFO:tasks.rados.rados.0.smithi084.stdout:1739: writing smithi08477944-11 from 6250496 to 6938624 tid 2 2024-03-30T12:28:30.814 INFO:tasks.rados.rados.0.smithi084.stdout:1739: writing smithi08477944-11 from 6938624 to 7454720 tid 3 2024-03-30T12:28:30.814 INFO:tasks.rados.rados.0.smithi084.stdout:1740: delete oid 48 current snap is 183 2024-03-30T12:28:30.814 INFO:tasks.rados.rados.0.smithi084.stdout:1739: finishing write tid 1 to smithi08477944-11 2024-03-30T12:28:30.817 INFO:tasks.rados.rados.0.smithi084.stdout:1739: finishing write tid 2 to smithi08477944-11 2024-03-30T12:28:30.817 INFO:tasks.rados.rados.0.smithi084.stdout:1739: finishing write tid 3 to smithi08477944-11 2024-03-30T12:28:30.818 INFO:tasks.rados.rados.0.smithi084.stdout:1739: finishing write tid 4 to smithi08477944-11 2024-03-30T12:28:30.820 INFO:tasks.rados.rados.0.smithi084.stdout:1740: done (1 left) 2024-03-30T12:28:30.820 INFO:tasks.rados.rados.0.smithi084.stdout:1741: snap_create 2024-03-30T12:28:30.820 INFO:tasks.rados.rados.0.smithi084.stdout:1739: finishing write tid 5 to smithi08477944-11 2024-03-30T12:28:30.820 INFO:tasks.rados.rados.0.smithi084.stdout:1739: oid 11 updating version 0 to 907 2024-03-30T12:28:30.820 INFO:tasks.rados.rados.0.smithi084.stdout:1739: oid 11 updating version 907 to 910 2024-03-30T12:28:30.821 INFO:tasks.rados.rados.0.smithi084.stdout:1739: oid 11 version 910 is already newer than 909 2024-03-30T12:28:30.821 INFO:tasks.rados.rados.0.smithi084.stdout:1739: oid 11 version 910 is already newer than 908 2024-03-30T12:28:30.821 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 910 (ObjNum 536 snap 183 seq_num 536) dirty exists 2024-03-30T12:28:30.821 INFO:tasks.rados.rados.0.smithi084.stdout:1739: left oid 11 (ObjNum 536 snap 183 seq_num 536) 2024-03-30T12:28:31.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:31.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:30 smithi162 ceph-mon[83709]: osdmap e430: 8 total, 7 up, 8 in 2024-03-30T12:28:31.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:30 smithi162 ceph-mon[83709]: pgmap v328: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 33 active+undersized, 11 active+undersized+degraded, 71 active+clean, 4 active+clean+snaptrim_error; 242 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.9 MiB/s wr, 9 op/s; 59/522 objects degraded (11.303%) 2024-03-30T12:28:31.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:30.775+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:31.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:31.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:30 smithi084 ceph-mon[89279]: osdmap e430: 8 total, 7 up, 8 in 2024-03-30T12:28:31.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:30 smithi084 ceph-mon[89279]: pgmap v328: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 33 active+undersized, 11 active+undersized+degraded, 71 active+clean, 4 active+clean+snaptrim_error; 242 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.9 MiB/s wr, 9 op/s; 59/522 objects degraded (11.303%) 2024-03-30T12:28:31.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:31.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:30 smithi084 ceph-mon[91810]: osdmap e430: 8 total, 7 up, 8 in 2024-03-30T12:28:31.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:30 smithi084 ceph-mon[91810]: pgmap v328: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 33 active+undersized, 11 active+undersized+degraded, 71 active+clean, 4 active+clean+snaptrim_error; 242 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.9 MiB/s wr, 9 op/s; 59/522 objects degraded (11.303%) 2024-03-30T12:28:31.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:30.819+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:31.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:30.819+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:31.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:30.819+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:31.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:30.819+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:31.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:30.819+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:31.760 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:31.448+0000 7f9e71c8b7c0 -1 osd.4 422 log_to_monitors true 2024-03-30T12:28:31.778 INFO:tasks.rados.rados.0.smithi084.stdout:1739: done (1 left) 2024-03-30T12:28:31.778 INFO:tasks.rados.rados.0.smithi084.stdout:1741: done (0 left) 2024-03-30T12:28:31.778 INFO:tasks.rados.rados.0.smithi084.stdout:1742: read oid 1 snap -1 2024-03-30T12:28:31.778 INFO:tasks.rados.rados.0.smithi084.stdout:1742: expect (ObjNum 516 snap 164 seq_num 516) 2024-03-30T12:28:31.778 INFO:tasks.rados.rados.0.smithi084.stdout:1743: setattr oid 42 current snap is 184 2024-03-30T12:28:31.780 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 184 2024-03-30T12:28:31.780 INFO:tasks.rados.rados.0.smithi084.stdout:1744: seq_num 538 ranges {6037504=614400,6651904=450560,7102464=704512,7806976=49152} 2024-03-30T12:28:31.816 INFO:tasks.rados.rados.0.smithi084.stdout:1744: writing smithi08477944-10 from 6037504 to 6651904 tid 1 2024-03-30T12:28:31.818 INFO:tasks.rados.rados.0.smithi084.stdout:1744: writing smithi08477944-10 from 6651904 to 7102464 tid 2 2024-03-30T12:28:31.822 INFO:tasks.rados.rados.0.smithi084.stdout:1744: writing smithi08477944-10 from 7102464 to 7806976 tid 3 2024-03-30T12:28:31.823 INFO:tasks.rados.rados.0.smithi084.stdout:1744: writing smithi08477944-10 from 7806976 to 7856128 tid 4 2024-03-30T12:28:31.823 INFO:tasks.rados.rados.0.smithi084.stdout:1745: snap_create 2024-03-30T12:28:31.823 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 925 (ObjNum 502 snap 157 seq_num 502) dirty exists 2024-03-30T12:28:31.823 INFO:tasks.rados.rados.0.smithi084.stdout:1742: expect (ObjNum 516 snap 164 seq_num 516) 2024-03-30T12:28:31.861 INFO:tasks.rados.rados.0.smithi084.stdout:1744: finishing write tid 1 to smithi08477944-10 2024-03-30T12:28:31.861 INFO:tasks.rados.rados.0.smithi084.stdout:1744: finishing write tid 2 to smithi08477944-10 2024-03-30T12:28:31.861 INFO:tasks.rados.rados.0.smithi084.stdout:1744: finishing write tid 3 to smithi08477944-10 2024-03-30T12:28:31.861 INFO:tasks.rados.rados.0.smithi084.stdout:1744: finishing write tid 4 to smithi08477944-10 2024-03-30T12:28:31.861 INFO:tasks.rados.rados.0.smithi084.stdout:1744: finishing write tid 5 to smithi08477944-10 2024-03-30T12:28:31.861 INFO:tasks.rados.rados.0.smithi084.stdout:1744: finishing write tid 6 to smithi08477944-10 2024-03-30T12:28:31.862 INFO:tasks.rados.rados.0.smithi084.stdout:1744: oid 10 updating version 0 to 807 2024-03-30T12:28:31.862 INFO:tasks.rados.rados.0.smithi084.stdout:1744: oid 10 updating version 807 to 809 2024-03-30T12:28:31.862 INFO:tasks.rados.rados.0.smithi084.stdout:1744: oid 10 updating version 809 to 811 2024-03-30T12:28:31.862 INFO:tasks.rados.rados.0.smithi084.stdout:1744: oid 10 version 811 is already newer than 808 2024-03-30T12:28:31.862 INFO:tasks.rados.rados.0.smithi084.stdout:1744: oid 10 version 811 is already newer than 810 2024-03-30T12:28:31.862 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 811 (ObjNum 538 snap 184 seq_num 538) dirty exists 2024-03-30T12:28:31.862 INFO:tasks.rados.rados.0.smithi084.stdout:1744: left oid 10 (ObjNum 538 snap 184 seq_num 538) 2024-03-30T12:28:32.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:31.807+0000 7f9e630e3700 -1 osd.4 422 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T12:28:32.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:31 smithi162 ceph-mon[83709]: Health check update: Degraded data redundancy: 59/522 objects degraded (11.303%), 13 pgs degraded (PG_DEGRADED) 2024-03-30T12:28:32.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:32.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:31 smithi162 ceph-mon[83709]: osdmap e431: 8 total, 7 up, 8 in 2024-03-30T12:28:32.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:32.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:32.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:32.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:31 smithi162 ceph-mon[83709]: from='osd.4 [v2:172.21.15.162:6800/2186427236,v1:172.21.15.162:6801/2186427236]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T12:28:32.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:31 smithi162 ceph-mon[83709]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T12:28:32.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:31.786+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:32.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:31.784+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:32.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:31.785+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:32.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:31.786+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:32.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:31 smithi084 ceph-mon[91810]: Health check update: Degraded data redundancy: 59/522 objects degraded (11.303%), 13 pgs degraded (PG_DEGRADED) 2024-03-30T12:28:32.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:32.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:31 smithi084 ceph-mon[91810]: osdmap e431: 8 total, 7 up, 8 in 2024-03-30T12:28:32.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:32.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:32.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:32.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:31 smithi084 ceph-mon[91810]: from='osd.4 [v2:172.21.15.162:6800/2186427236,v1:172.21.15.162:6801/2186427236]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T12:28:32.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:31 smithi084 ceph-mon[91810]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T12:28:32.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:31 smithi084 ceph-mon[89279]: Health check update: Degraded data redundancy: 59/522 objects degraded (11.303%), 13 pgs degraded (PG_DEGRADED) 2024-03-30T12:28:32.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:32.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:31 smithi084 ceph-mon[89279]: osdmap e431: 8 total, 7 up, 8 in 2024-03-30T12:28:32.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:32.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:32.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:32.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:31 smithi084 ceph-mon[89279]: from='osd.4 [v2:172.21.15.162:6800/2186427236,v1:172.21.15.162:6801/2186427236]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T12:28:32.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:31 smithi084 ceph-mon[89279]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T12:28:32.785 INFO:tasks.rados.rados.0.smithi084.stdout:1742: done (3 left) 2024-03-30T12:28:32.785 INFO:tasks.rados.rados.0.smithi084.stdout:1743: done (2 left) 2024-03-30T12:28:32.785 INFO:tasks.rados.rados.0.smithi084.stdout:1744: done (1 left) 2024-03-30T12:28:32.785 INFO:tasks.rados.rados.0.smithi084.stdout:1745: done (0 left) 2024-03-30T12:28:32.785 INFO:tasks.rados.rados.0.smithi084.stdout:1746: delete oid 9 current snap is 185 2024-03-30T12:28:32.796 INFO:tasks.rados.rados.0.smithi084.stdout:1746: done (0 left) 2024-03-30T12:28:32.796 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 185 2024-03-30T12:28:32.796 INFO:tasks.rados.rados.0.smithi084.stdout:1747: seq_num 540 ranges {1753088=647168,2400256=671744,3072000=532480} 2024-03-30T12:28:32.809 INFO:tasks.rados.rados.0.smithi084.stdout:1747: writing smithi08477944-35 from 1753088 to 2400256 tid 1 2024-03-30T12:28:32.812 INFO:tasks.rados.rados.0.smithi084.stdout:1747: writing smithi08477944-35 from 2400256 to 3072000 tid 2 2024-03-30T12:28:32.816 INFO:tasks.rados.rados.0.smithi084.stdout:1747: writing smithi08477944-35 from 3072000 to 3604480 tid 3 2024-03-30T12:28:32.816 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 185 2024-03-30T12:28:32.816 INFO:tasks.rados.rados.0.smithi084.stdout:1748: seq_num 541 ranges {1261568=663552,1925120=557056,2482176=475136,2957312=172032} 2024-03-30T12:28:32.826 INFO:tasks.rados.rados.0.smithi084.stdout:1748: writing smithi08477944-6 from 1261568 to 1925120 tid 1 2024-03-30T12:28:32.830 INFO:tasks.rados.rados.0.smithi084.stdout:1748: writing smithi08477944-6 from 1925120 to 2482176 tid 2 2024-03-30T12:28:32.832 INFO:tasks.rados.rados.0.smithi084.stdout:1748: writing smithi08477944-6 from 2482176 to 2957312 tid 3 2024-03-30T12:28:32.832 INFO:tasks.rados.rados.0.smithi084.stdout:1748: writing smithi08477944-6 from 2957312 to 3129344 tid 4 2024-03-30T12:28:32.833 INFO:tasks.rados.rados.0.smithi084.stdout:1749: delete oid 37 current snap is 185 2024-03-30T12:28:32.835 INFO:tasks.rados.rados.0.smithi084.stdout:1749: done (2 left) 2024-03-30T12:28:32.835 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 185 2024-03-30T12:28:32.835 INFO:tasks.rados.rados.0.smithi084.stdout:1750: seq_num 543 ranges {0=704512,704512=729088,1433600=475136} 2024-03-30T12:28:32.839 INFO:tasks.rados.rados.0.smithi084.stdout:1750: writing smithi08477944-2 from 0 to 704512 tid 1 2024-03-30T12:28:32.843 INFO:tasks.rados.rados.0.smithi084.stdout:1750: writing smithi08477944-2 from 704512 to 1433600 tid 2 2024-03-30T12:28:32.845 INFO:tasks.rados.rados.0.smithi084.stdout:1750: writing smithi08477944-2 from 1433600 to 1908736 tid 3 2024-03-30T12:28:32.846 INFO:tasks.rados.rados.0.smithi084.stdout:1751: copy_from oid 43 from oid 28 current snap is 185 2024-03-30T12:28:32.846 INFO:tasks.rados.rados.0.smithi084.stdout:1750: finishing write tid 1 to smithi08477944-2 2024-03-30T12:28:32.846 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 46 current snap is 185 2024-03-30T12:28:32.846 INFO:tasks.rados.rados.0.smithi084.stdout:1752: seq_num 544 ranges {5685248=720896,6406144=614400,7020544=589824} 2024-03-30T12:28:32.879 INFO:tasks.rados.rados.0.smithi084.stdout:1752: writing smithi08477944-46 from 5685248 to 6406144 tid 1 2024-03-30T12:28:32.882 INFO:tasks.rados.rados.0.smithi084.stdout:1752: writing smithi08477944-46 from 6406144 to 7020544 tid 2 2024-03-30T12:28:32.887 INFO:tasks.rados.rados.0.smithi084.stdout:1752: writing smithi08477944-46 from 7020544 to 7610368 tid 3 2024-03-30T12:28:32.887 INFO:tasks.rados.rados.0.smithi084.stdout:1753: copy_from oid 40 from oid 16 current snap is 185 2024-03-30T12:28:32.887 INFO:tasks.rados.rados.0.smithi084.stdout:1750: finishing write tid 2 to smithi08477944-2 2024-03-30T12:28:32.887 INFO:tasks.rados.rados.0.smithi084.stdout:1750: finishing write tid 3 to smithi08477944-2 2024-03-30T12:28:32.887 INFO:tasks.rados.rados.0.smithi084.stdout:1750: finishing write tid 4 to smithi08477944-2 2024-03-30T12:28:32.887 INFO:tasks.rados.rados.0.smithi084.stdout:1750: finishing write tid 5 to smithi08477944-2 2024-03-30T12:28:32.887 INFO:tasks.rados.rados.0.smithi084.stdout:1750: oid 2 updating version 0 to 941 2024-03-30T12:28:32.887 INFO:tasks.rados.rados.0.smithi084.stdout:1750: oid 2 updating version 941 to 943 2024-03-30T12:28:32.887 INFO:tasks.rados.rados.0.smithi084.stdout:1750: oid 2 version 943 is already newer than 942 2024-03-30T12:28:32.888 INFO:tasks.rados.rados.0.smithi084.stdout:1750: oid 2 updating version 943 to 944 2024-03-30T12:28:32.888 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 944 (ObjNum 543 snap 185 seq_num 543) dirty exists 2024-03-30T12:28:32.888 INFO:tasks.rados.rados.0.smithi084.stdout:1750: left oid 2 (ObjNum 543 snap 185 seq_num 543) 2024-03-30T12:28:32.888 INFO:tasks.rados.rados.0.smithi084.stdout:1752: finishing write tid 1 to smithi08477944-46 2024-03-30T12:28:32.888 INFO:tasks.rados.rados.0.smithi084.stdout:1750: done (5 left) 2024-03-30T12:28:32.888 INFO:tasks.rados.rados.0.smithi084.stdout:1754: delete oid 7 current snap is 185 2024-03-30T12:28:32.888 INFO:tasks.rados.rados.0.smithi084.stdout:1752: finishing write tid 2 to smithi08477944-46 2024-03-30T12:28:32.888 INFO:tasks.rados.rados.0.smithi084.stdout:1754: done (5 left) 2024-03-30T12:28:32.888 INFO:tasks.rados.rados.0.smithi084.stdout:1755: snap_remove snap 175 2024-03-30T12:28:33.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:32 smithi162 ceph-mon[83709]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-30T12:28:33.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:32 smithi162 ceph-mon[83709]: from='osd.4 [v2:172.21.15.162:6800/2186427236,v1:172.21.15.162:6801/2186427236]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:28:33.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:32 smithi162 ceph-mon[83709]: osdmap e432: 8 total, 7 up, 8 in 2024-03-30T12:28:33.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:33.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:33.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:32 smithi162 ceph-mon[83709]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:28:33.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:33.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:33.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:32 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:33.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:32 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:33.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:32 smithi162 ceph-mon[83709]: pgmap v331: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 33 active+undersized, 11 active+undersized+degraded, 71 active+clean, 4 active+clean+snaptrim_error; 242 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 3.4 MiB/s rd, 0 B/s wr, 5 op/s; 60/528 objects degraded (11.364%) 2024-03-30T12:28:33.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:32.802+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:33.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:32.793+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:33.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:32.793+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:33.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:32.793+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:33.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:32.793+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:33.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:32.794+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:33.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-mon[89279]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-30T12:28:33.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-mon[89279]: from='osd.4 [v2:172.21.15.162:6800/2186427236,v1:172.21.15.162:6801/2186427236]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:28:33.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-mon[89279]: osdmap e432: 8 total, 7 up, 8 in 2024-03-30T12:28:33.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:33.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:33.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-mon[89279]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:28:33.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:33.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:33.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:33.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:33.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-mon[89279]: pgmap v331: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 33 active+undersized, 11 active+undersized+degraded, 71 active+clean, 4 active+clean+snaptrim_error; 242 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 3.4 MiB/s rd, 0 B/s wr, 5 op/s; 60/528 objects degraded (11.364%) 2024-03-30T12:28:33.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-mon[91810]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-30T12:28:33.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-mon[91810]: from='osd.4 [v2:172.21.15.162:6800/2186427236,v1:172.21.15.162:6801/2186427236]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:28:33.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-mon[91810]: osdmap e432: 8 total, 7 up, 8 in 2024-03-30T12:28:33.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:33.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:33.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-mon[91810]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:28:33.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:33.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:33.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:33.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:33.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:32 smithi084 ceph-mon[91810]: pgmap v331: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 33 active+undersized, 11 active+undersized+degraded, 71 active+clean, 4 active+clean+snaptrim_error; 242 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 3.4 MiB/s rd, 0 B/s wr, 5 op/s; 60/528 objects degraded (11.364%) 2024-03-30T12:28:33.782 INFO:tasks.rados.rados.0.smithi084.stdout:1755: done (5 left) 2024-03-30T12:28:33.782 INFO:tasks.rados.rados.0.smithi084.stdout:1756: snap_remove snap 178 2024-03-30T12:28:34.045 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-mon[83709]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T12:28:34.045 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-mon[83709]: osd.4 [v2:172.21.15.162:6800/2186427236,v1:172.21.15.162:6801/2186427236] boot 2024-03-30T12:28:34.045 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-mon[83709]: osdmap e433: 8 total, 8 up, 8 in 2024-03-30T12:28:34.045 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:28:34.045 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:34.046 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:34.046 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:34.046 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:34.046 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:34.046 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:34.046 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-mon[83709]: osdmap e434: 8 total, 8 up, 8 in 2024-03-30T12:28:34.047 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.824+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.047 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.829+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.047 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.835+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.047 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.841+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.047 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.846+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.047 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.851+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.047 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.857+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.047 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.862+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.047 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.867+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.047 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.872+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.047 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.877+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.048 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.882+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.048 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.886+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.048 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.891+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.048 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.895+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.048 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.900+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.048 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.905+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.048 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.910+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.048 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.914+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.048 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.919+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.048 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.924+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.048 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.929+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.048 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.933+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.048 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.938+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.048 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.942+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.049 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.946+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.049 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.951+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.049 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.957+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.049 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.961+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.049 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.968+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.049 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.972+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.049 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.977+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.049 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.981+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.049 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.986+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.049 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.991+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.049 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:33.995+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.049 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.000+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.049 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.005+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.049 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.009+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.050 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.013+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.050 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.017+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.050 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.022+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.050 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.026+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.050 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.031+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.050 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.035+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.050 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.040+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.050 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.044+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.050 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.049+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.050 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.053+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:33.796+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:34.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:34.001+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:34.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:33.785+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:34.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:33.786+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:34.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:33.786+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:34.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:33.802+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-mon[91810]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T12:28:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-mon[91810]: osd.4 [v2:172.21.15.162:6800/2186427236,v1:172.21.15.162:6801/2186427236] boot 2024-03-30T12:28:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-mon[91810]: osdmap e433: 8 total, 8 up, 8 in 2024-03-30T12:28:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:28:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-mon[91810]: osdmap e434: 8 total, 8 up, 8 in 2024-03-30T12:28:34.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-mon[89279]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T12:28:34.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-mon[89279]: osd.4 [v2:172.21.15.162:6800/2186427236,v1:172.21.15.162:6801/2186427236] boot 2024-03-30T12:28:34.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-mon[89279]: osdmap e433: 8 total, 8 up, 8 in 2024-03-30T12:28:34.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T12:28:34.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:34.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:34.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:34.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:34.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:34.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:34.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:33 smithi084 ceph-mon[89279]: osdmap e434: 8 total, 8 up, 8 in 2024-03-30T12:28:34.299 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.058+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.299 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.062+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.299 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.067+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.299 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.071+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.299 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.076+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.299 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.080+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.299 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.085+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.299 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.091+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.300 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.096+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.300 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.100+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.300 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.107+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.300 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.112+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.300 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.117+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.300 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.122+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.300 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.127+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.300 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.131+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.300 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.136+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.301 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.140+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.301 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.144+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.301 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.149+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.301 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.153+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.302 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.158+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.302 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.162+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.302 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.167+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.302 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.172+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.302 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.176+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.302 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.181+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.302 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.185+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.302 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.190+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.303 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.194+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.303 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.199+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.303 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.203+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.303 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.208+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.303 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.212+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.303 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.217+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.303 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.221+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.303 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.225+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.303 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.232+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.304 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.237+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.304 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.242+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.304 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.248+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.304 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.254+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.304 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.260+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.304 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.265+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.304 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.270+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.304 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.276+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.304 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.282+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.304 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.286+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.304 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.291+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.305 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.296+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.305 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.301+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.305 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.306+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.551 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.311+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.551 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.316+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.551 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.320+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.551 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.325+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.551 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.330+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.551 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.335+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.551 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.340+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.552 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.346+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.552 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.350+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.552 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.355+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.552 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.360+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.552 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.364+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.552 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.369+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.552 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.373+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.552 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.378+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.552 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.383+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.552 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.388+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.553 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.392+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.553 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.397+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.553 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.401+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.553 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.406+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.553 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.411+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.553 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.416+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.553 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.421+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.553 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.426+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.553 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.431+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.553 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.436+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.553 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.441+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.553 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.446+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.554 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.450+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.554 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.456+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.554 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.461+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.554 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.466+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.554 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.471+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.554 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.475+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.554 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.480+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.554 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.485+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.554 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.490+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.554 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.495+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.554 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.500+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.554 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.505+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.554 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.510+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.555 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.515+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.555 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.520+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.555 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.524+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.555 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.529+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.555 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.534+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.555 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.539+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.555 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.544+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.555 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.548+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.555 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.553+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.555 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.558+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.786 INFO:tasks.rados.rados.0.smithi084.stdout:1756: done (5 left) 2024-03-30T12:28:34.786 INFO:tasks.rados.rados.0.smithi084.stdout:1757: copy_from oid 30 from oid 11 current snap is 185 2024-03-30T12:28:34.786 INFO:tasks.rados.rados.0.smithi084.stdout:1752: finishing write tid 3 to smithi08477944-46 2024-03-30T12:28:34.786 INFO:tasks.rados.rados.0.smithi084.stdout:1752: finishing write tid 4 to smithi08477944-46 2024-03-30T12:28:34.786 INFO:tasks.rados.rados.0.smithi084.stdout:1752: finishing write tid 5 to smithi08477944-46 2024-03-30T12:28:34.786 INFO:tasks.rados.rados.0.smithi084.stdout:1752: oid 46 updating version 0 to 949 2024-03-30T12:28:34.787 INFO:tasks.rados.rados.0.smithi084.stdout:1752: oid 46 version 949 is already newer than 946 2024-03-30T12:28:34.787 INFO:tasks.rados.rados.0.smithi084.stdout:1752: oid 46 version 949 is already newer than 948 2024-03-30T12:28:34.787 INFO:tasks.rados.rados.0.smithi084.stdout:1752: oid 46 version 949 is already newer than 947 2024-03-30T12:28:34.787 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 949 (ObjNum 544 snap 185 seq_num 544) dirty exists 2024-03-30T12:28:34.787 INFO:tasks.rados.rados.0.smithi084.stdout:1752: left oid 46 (ObjNum 544 snap 185 seq_num 544) 2024-03-30T12:28:34.787 INFO:tasks.rados.rados.0.smithi084.stdout:1753: finishing copy_from racing read to smithi08477944-40 2024-03-30T12:28:34.787 INFO:tasks.rados.rados.0.smithi084.stdout:1753: finishing copy_from to smithi08477944-40 2024-03-30T12:28:34.787 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 815 (ObjNum 395 snap 125 seq_num 395) dirty exists 2024-03-30T12:28:34.787 INFO:tasks.rados.rados.0.smithi084.stdout:1747: finishing write tid 1 to smithi08477944-35 2024-03-30T12:28:34.787 INFO:tasks.rados.rados.0.smithi084.stdout:1747: finishing write tid 2 to smithi08477944-35 2024-03-30T12:28:34.787 INFO:tasks.rados.rados.0.smithi084.stdout:1747: finishing write tid 3 to smithi08477944-35 2024-03-30T12:28:34.787 INFO:tasks.rados.rados.0.smithi084.stdout:1748: finishing write tid 1 to smithi08477944-6 2024-03-30T12:28:34.787 INFO:tasks.rados.rados.0.smithi084.stdout:1747: finishing write tid 4 to smithi08477944-35 2024-03-30T12:28:34.788 INFO:tasks.rados.rados.0.smithi084.stdout:1747: finishing write tid 5 to smithi08477944-35 2024-03-30T12:28:34.788 INFO:tasks.rados.rados.0.smithi084.stdout:1747: oid 35 updating version 0 to 670 2024-03-30T12:28:34.788 INFO:tasks.rados.rados.0.smithi084.stdout:1747: oid 35 updating version 670 to 673 2024-03-30T12:28:34.788 INFO:tasks.rados.rados.0.smithi084.stdout:1747: oid 35 version 673 is already newer than 672 2024-03-30T12:28:34.788 INFO:tasks.rados.rados.0.smithi084.stdout:1747: oid 35 version 673 is already newer than 671 2024-03-30T12:28:34.788 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 673 (ObjNum 540 snap 185 seq_num 540) dirty exists 2024-03-30T12:28:34.788 INFO:tasks.rados.rados.0.smithi084.stdout:1747: left oid 35 (ObjNum 540 snap 185 seq_num 540) 2024-03-30T12:28:34.788 INFO:tasks.rados.rados.0.smithi084.stdout:1748: finishing write tid 2 to smithi08477944-6 2024-03-30T12:28:34.788 INFO:tasks.rados.rados.0.smithi084.stdout:1748: finishing write tid 3 to smithi08477944-6 2024-03-30T12:28:34.788 INFO:tasks.rados.rados.0.smithi084.stdout:1748: finishing write tid 4 to smithi08477944-6 2024-03-30T12:28:34.788 INFO:tasks.rados.rados.0.smithi084.stdout:1748: finishing write tid 5 to smithi08477944-6 2024-03-30T12:28:34.788 INFO:tasks.rados.rados.0.smithi084.stdout:1748: finishing write tid 6 to smithi08477944-6 2024-03-30T12:28:34.788 INFO:tasks.rados.rados.0.smithi084.stdout:1748: oid 6 updating version 0 to 808 2024-03-30T12:28:34.788 INFO:tasks.rados.rados.0.smithi084.stdout:1748: oid 6 updating version 808 to 811 2024-03-30T12:28:34.789 INFO:tasks.rados.rados.0.smithi084.stdout:1748: oid 6 version 811 is already newer than 807 2024-03-30T12:28:34.789 INFO:tasks.rados.rados.0.smithi084.stdout:1748: oid 6 version 811 is already newer than 809 2024-03-30T12:28:34.789 INFO:tasks.rados.rados.0.smithi084.stdout:1748: oid 6 version 811 is already newer than 810 2024-03-30T12:28:34.789 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 811 (ObjNum 541 snap 185 seq_num 541) dirty exists 2024-03-30T12:28:34.789 INFO:tasks.rados.rados.0.smithi084.stdout:1748: left oid 6 (ObjNum 541 snap 185 seq_num 541) 2024-03-30T12:28:34.789 INFO:tasks.rados.rados.0.smithi084.stdout:1751: finishing copy_from racing read to smithi08477944-43 2024-03-30T12:28:34.789 INFO:tasks.rados.rados.0.smithi084.stdout:1751: finishing copy_from to smithi08477944-43 2024-03-30T12:28:34.789 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 809 (ObjNum 498 snap 156 seq_num 498) dirty exists 2024-03-30T12:28:34.789 INFO:tasks.rados.rados.0.smithi084.stdout:1747: done (5 left) 2024-03-30T12:28:34.789 INFO:tasks.rados.rados.0.smithi084.stdout:1748: done (4 left) 2024-03-30T12:28:34.789 INFO:tasks.rados.rados.0.smithi084.stdout:1751: done (3 left) 2024-03-30T12:28:34.789 INFO:tasks.rados.rados.0.smithi084.stdout:1752: done (2 left) 2024-03-30T12:28:34.789 INFO:tasks.rados.rados.0.smithi084.stdout:1753: done (1 left) 2024-03-30T12:28:34.789 INFO:tasks.rados.rados.0.smithi084.stdout:1758: read oid 22 snap -1 2024-03-30T12:28:34.789 INFO:tasks.rados.rados.0.smithi084.stdout:1758: expect (ObjNum 527 snap 174 seq_num 527) 2024-03-30T12:28:34.790 INFO:tasks.rados.rados.0.smithi084.stdout:1759: rmattr oid 27 current snap is 185 2024-03-30T12:28:34.790 INFO:tasks.rados.rados.0.smithi084.stdout:1759: done (2 left) 2024-03-30T12:28:34.790 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 185 2024-03-30T12:28:34.790 INFO:tasks.rados.rados.0.smithi084.stdout:1760: seq_num 546 ranges {2260992=753664,3014656=778240,3792896=425984} 2024-03-30T12:28:34.801 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.564+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.801 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.569+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.801 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.573+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.802 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.579+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.802 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.584+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.802 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.588+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.802 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.594+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.802 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.600+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.802 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.606+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.802 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.611+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.802 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.616+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.802 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.621+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.802 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.626+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.802 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.631+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.802 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.636+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.803 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.641+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.803 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.646+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.803 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.651+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.803 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.656+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.803 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.661+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.803 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.665+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.803 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.670+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.804 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.676+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.804 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.681+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.804 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.686+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.804 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.692+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.804 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.697+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.804 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.702+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.804 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.707+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.804 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.712+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.804 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.718+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.804 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.722+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.804 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.727+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.804 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.732+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.804 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.737+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.805 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.742+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.805 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.747+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.805 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.753+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.805 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.758+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.805 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.763+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.805 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.768+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.805 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.773+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.805 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.778+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.805 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.783+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.805 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.791+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.805 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.801+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.805 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.809+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:34.805 INFO:tasks.rados.rados.0.smithi084.stdout:1760: writing smithi08477944-40 from 2260992 to 3014656 tid 1 2024-03-30T12:28:34.808 INFO:tasks.rados.rados.0.smithi084.stdout:1760: writing smithi08477944-40 from 3014656 to 3792896 tid 2 2024-03-30T12:28:34.812 INFO:tasks.rados.rados.0.smithi084.stdout:1760: writing smithi08477944-40 from 3792896 to 4218880 tid 3 2024-03-30T12:28:34.812 INFO:tasks.rados.rados.0.smithi084.stdout:1761: rollback oid 41 current snap is 185 2024-03-30T12:28:34.812 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 41 to 171 2024-03-30T12:28:34.812 INFO:tasks.rados.rados.0.smithi084.stdout:1760: finishing write tid 1 to smithi08477944-40 2024-03-30T12:28:34.812 INFO:tasks.rados.rados.0.smithi084.stdout:1762: rollback oid 29 current snap is 185 2024-03-30T12:28:34.813 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 29 to 172 2024-03-30T12:28:34.813 INFO:tasks.rados.rados.0.smithi084.stdout:1763: read oid 17 snap -1 2024-03-30T12:28:34.813 INFO:tasks.rados.rados.0.smithi084.stdout:1763: expect (ObjNum 508 snap 161 seq_num 508) 2024-03-30T12:28:34.813 INFO:tasks.rados.rados.0.smithi084.stdout:1764: rmattr oid 24 current snap is 185 2024-03-30T12:28:34.813 INFO:tasks.rados.rados.0.smithi084.stdout:1764: done (6 left) 2024-03-30T12:28:34.813 INFO:tasks.rados.rados.0.smithi084.stdout:1765: setattr oid 27 current snap is 185 2024-03-30T12:28:34.814 INFO:tasks.rados.rados.0.smithi084.stdout:1766: delete oid 19 current snap is 185 2024-03-30T12:28:34.815 INFO:tasks.rados.rados.0.smithi084.stdout:1760: finishing write tid 2 to smithi08477944-40 2024-03-30T12:28:34.816 INFO:tasks.rados.rados.0.smithi084.stdout:1761: finishing rollback tid 1 to smithi08477944-41 2024-03-30T12:28:34.817 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 889 (ObjNum 177 snap 0 seq_num 1) dirty dne 2024-03-30T12:28:34.819 INFO:tasks.rados.rados.0.smithi084.stdout:1760: finishing write tid 3 to smithi08477944-40 2024-03-30T12:28:34.820 INFO:tasks.rados.rados.0.smithi084.stdout:1762: finishing rollback tid 0 to smithi08477944-29 2024-03-30T12:28:34.820 INFO:tasks.rados.rados.0.smithi084.stdout:1760: finishing write tid 4 to smithi08477944-40 2024-03-30T12:28:34.820 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 884 (ObjNum 113 snap 0 seq_num 1394495056) dirty exists 2024-03-30T12:28:34.823 INFO:tasks.rados.rados.0.smithi084.stdout:1761: done (7 left) 2024-03-30T12:28:34.823 INFO:tasks.rados.rados.0.smithi084.stdout:1765: done (6 left) 2024-03-30T12:28:34.823 INFO:tasks.rados.rados.0.smithi084.stdout:1766: done (5 left) 2024-03-30T12:28:34.823 INFO:tasks.rados.rados.0.smithi084.stdout:1767: copy_from oid 49 from oid 14 current snap is 185 2024-03-30T12:28:34.823 INFO:tasks.rados.rados.0.smithi084.stdout:1768: delete oid 2 current snap is 185 2024-03-30T12:28:34.824 INFO:tasks.rados.rados.0.smithi084.stdout:1762: finishing rollback tid 1 to smithi08477944-29 2024-03-30T12:28:34.824 INFO:tasks.rados.rados.0.smithi084.stdout:1762: finishing rollback tid 2 to smithi08477944-29 2024-03-30T12:28:34.824 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 813 (ObjNum 33 snap 0 seq_num 1558240336) dirty exists 2024-03-30T12:28:34.826 INFO:tasks.rados.rados.0.smithi084.stdout:1760: finishing write tid 5 to smithi08477944-40 2024-03-30T12:28:34.826 INFO:tasks.rados.rados.0.smithi084.stdout:1760: oid 40 updating version 0 to 924 2024-03-30T12:28:34.826 INFO:tasks.rados.rados.0.smithi084.stdout:1760: oid 40 version 924 is already newer than 922 2024-03-30T12:28:34.826 INFO:tasks.rados.rados.0.smithi084.stdout:1760: oid 40 version 924 is already newer than 923 2024-03-30T12:28:34.826 INFO:tasks.rados.rados.0.smithi084.stdout:1760: oid 40 version 924 is already newer than 921 2024-03-30T12:28:34.826 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 924 (ObjNum 546 snap 185 seq_num 546) dirty exists 2024-03-30T12:28:34.826 INFO:tasks.rados.rados.0.smithi084.stdout:1760: left oid 40 (ObjNum 546 snap 185 seq_num 546) 2024-03-30T12:28:34.828 INFO:tasks.rados.rados.0.smithi084.stdout:1763: expect (ObjNum 508 snap 161 seq_num 508) 2024-03-30T12:28:34.931 INFO:tasks.rados.rados.0.smithi084.stdout:1760: done (6 left) 2024-03-30T12:28:34.931 INFO:tasks.rados.rados.0.smithi084.stdout:1762: done (5 left) 2024-03-30T12:28:34.931 INFO:tasks.rados.rados.0.smithi084.stdout:1763: done (4 left) 2024-03-30T12:28:34.931 INFO:tasks.rados.rados.0.smithi084.stdout:1768: done (3 left) 2024-03-30T12:28:34.931 INFO:tasks.rados.rados.0.smithi084.stdout:1769: read oid 28 snap -1 2024-03-30T12:28:34.931 INFO:tasks.rados.rados.0.smithi084.stdout:1769: expect (ObjNum 498 snap 156 seq_num 498) 2024-03-30T12:28:34.931 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 185 2024-03-30T12:28:34.932 INFO:tasks.rados.rados.0.smithi084.stdout:1767: finishing copy_from racing read to smithi08477944-49 2024-03-30T12:28:34.932 INFO:tasks.rados.rados.0.smithi084.stdout:1767: finishing copy_from to smithi08477944-49 2024-03-30T12:28:34.932 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 806 (ObjNum 457 snap 143 seq_num 457) dirty exists 2024-03-30T12:28:34.932 INFO:tasks.rados.rados.0.smithi084.stdout:1758: expect (ObjNum 527 snap 174 seq_num 527) 2024-03-30T12:28:35.056 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:35.056 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:35.056 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:35.057 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:35.057 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:35.057 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:35.057 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-mon[83709]: pgmap v334: 121 pgs: 1 peering+snaptrim_error, 1 active+undersized+degraded+snaptrim_error, 30 active+undersized, 8 active+undersized+degraded, 77 active+clean, 4 active+clean+snaptrim_error; 246 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.2 MiB/s rd, 1004 KiB/s wr, 3 op/s; 50/537 objects degraded (9.311%) 2024-03-30T12:28:35.057 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-mon[83709]: osdmap e435: 8 total, 8 up, 8 in 2024-03-30T12:28:35.057 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.821+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.058 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.831+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.058 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.841+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.058 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.855+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.058 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.861+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.058 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.867+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.058 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.872+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.058 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.877+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.058 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.883+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.058 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.887+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.058 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.893+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.058 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.898+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.058 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.903+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.908+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.913+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.918+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.923+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.929+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.934+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.938+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.944+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.950+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.955+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.960+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.966+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.977+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.060 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.983+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.060 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.988+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.060 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:34.994+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.060 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.003+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.060 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.008+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.060 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.014+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.060 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.019+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.060 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.025+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.060 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.030+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.060 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.036+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.060 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.042+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.060 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.047+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.060 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.053+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.061 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.059+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.061 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.064+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:34.795+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:35.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:34.795+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:35.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:35.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:35.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:35.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:35.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:35.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:35.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-mon[91810]: pgmap v334: 121 pgs: 1 peering+snaptrim_error, 1 active+undersized+degraded+snaptrim_error, 30 active+undersized, 8 active+undersized+degraded, 77 active+clean, 4 active+clean+snaptrim_error; 246 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.2 MiB/s rd, 1004 KiB/s wr, 3 op/s; 50/537 objects degraded (9.311%) 2024-03-30T12:28:35.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-mon[91810]: osdmap e435: 8 total, 8 up, 8 in 2024-03-30T12:28:35.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:35.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:35.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:35.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:35.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:35.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:35.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-mon[89279]: pgmap v334: 121 pgs: 1 peering+snaptrim_error, 1 active+undersized+degraded+snaptrim_error, 30 active+undersized, 8 active+undersized+degraded, 77 active+clean, 4 active+clean+snaptrim_error; 246 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1.2 MiB/s rd, 1004 KiB/s wr, 3 op/s; 50/537 objects degraded (9.311%) 2024-03-30T12:28:35.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-mon[89279]: osdmap e435: 8 total, 8 up, 8 in 2024-03-30T12:28:35.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:34.797+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:35.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:34.797+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:35.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:34.797+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:35.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:34.797+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:35.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:34.797+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:35.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:34.797+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:35.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:34.798+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:35.312 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.071+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.312 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.076+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.312 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.082+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.312 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.088+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.312 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.093+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.312 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.098+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.313 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.103+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.313 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.109+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.313 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.114+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.313 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.119+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.313 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.125+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.313 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.130+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.313 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.135+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.313 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.141+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.313 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.146+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.313 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.151+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.313 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.157+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.313 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.162+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.313 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.167+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.313 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.173+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.314 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.179+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.314 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.188+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.314 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.194+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.314 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.199+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.314 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.205+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.314 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.211+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.314 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.217+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.314 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.223+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.314 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.230+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.314 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.237+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.314 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.244+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.314 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.250+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.314 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.257+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.315 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.263+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.315 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.270+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.315 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.275+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.315 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.281+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.315 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.287+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.315 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.294+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.315 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.300+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.315 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.306+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.315 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.312+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.315 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.319+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.566 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.324+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.567 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.330+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.567 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.336+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.567 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.341+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.567 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.347+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.567 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.352+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.567 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.358+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.567 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.364+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.567 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.369+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.567 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.375+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.567 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.380+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.567 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.386+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.567 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.391+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.568 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.397+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.568 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.403+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.568 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.409+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.568 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.417+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.568 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.423+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.568 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.428+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.568 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.433+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.568 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.439+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.569 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.444+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.569 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.450+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.569 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.459+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.569 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.465+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.569 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.471+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.569 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.476+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.569 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.482+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.569 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.488+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.569 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.494+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.569 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.500+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.569 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.507+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.569 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.514+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.569 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.522+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.569 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.529+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.570 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.535+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.570 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.541+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.570 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.547+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.570 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.552+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.570 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.557+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.570 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.563+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.570 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.568+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.570 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.574+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.600 INFO:tasks.rados.rados.0.smithi084.stdout:1757: finishing copy_from racing read to smithi08477944-30 2024-03-30T12:28:35.600 INFO:tasks.rados.rados.0.smithi084.stdout:1757: finishing copy_from to smithi08477944-30 2024-03-30T12:28:35.600 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 910 (ObjNum 536 snap 183 seq_num 536) dirty exists 2024-03-30T12:28:35.601 INFO:tasks.rados.rados.0.smithi084.stdout:1770: seq_num 549 ranges {1671168=802816,2473984=483328,2957312=434176,3391488=286720} 2024-03-30T12:28:35.614 INFO:tasks.rados.rados.0.smithi084.stdout:1770: writing smithi08477944-15 from 1671168 to 2473984 tid 1 2024-03-30T12:28:35.617 INFO:tasks.rados.rados.0.smithi084.stdout:1770: writing smithi08477944-15 from 2473984 to 2957312 tid 2 2024-03-30T12:28:35.620 INFO:tasks.rados.rados.0.smithi084.stdout:1770: writing smithi08477944-15 from 2957312 to 3391488 tid 3 2024-03-30T12:28:35.622 INFO:tasks.rados.rados.0.smithi084.stdout:1770: writing smithi08477944-15 from 3391488 to 3678208 tid 4 2024-03-30T12:28:35.623 INFO:tasks.rados.rados.0.smithi084.stdout:1757: done (4 left) 2024-03-30T12:28:35.623 INFO:tasks.rados.rados.0.smithi084.stdout:1758: done (3 left) 2024-03-30T12:28:35.623 INFO:tasks.rados.rados.0.smithi084.stdout:1767: done (2 left) 2024-03-30T12:28:35.623 INFO:tasks.rados.rados.0.smithi084.stdout:1771: read oid 4 snap -1 2024-03-30T12:28:35.623 INFO:tasks.rados.rados.0.smithi084.stdout:1771: expect (ObjNum 475 snap 150 seq_num 475) 2024-03-30T12:28:35.623 INFO:tasks.rados.rados.0.smithi084.stdout:1772: snap_create 2024-03-30T12:28:35.623 INFO:tasks.rados.rados.0.smithi084.stdout:1769: expect (ObjNum 498 snap 156 seq_num 498) 2024-03-30T12:28:35.658 INFO:tasks.rados.rados.0.smithi084.stdout:1770: finishing write tid 1 to smithi08477944-15 2024-03-30T12:28:35.658 INFO:tasks.rados.rados.0.smithi084.stdout:1770: finishing write tid 2 to smithi08477944-15 2024-03-30T12:28:35.658 INFO:tasks.rados.rados.0.smithi084.stdout:1770: finishing write tid 3 to smithi08477944-15 2024-03-30T12:28:35.658 INFO:tasks.rados.rados.0.smithi084.stdout:1770: finishing write tid 4 to smithi08477944-15 2024-03-30T12:28:35.658 INFO:tasks.rados.rados.0.smithi084.stdout:1770: finishing write tid 5 to smithi08477944-15 2024-03-30T12:28:35.658 INFO:tasks.rados.rados.0.smithi084.stdout:1770: finishing write tid 6 to smithi08477944-15 2024-03-30T12:28:35.658 INFO:tasks.rados.rados.0.smithi084.stdout:1770: oid 15 updating version 0 to 929 2024-03-30T12:28:35.658 INFO:tasks.rados.rados.0.smithi084.stdout:1770: oid 15 version 929 is already newer than 926 2024-03-30T12:28:35.658 INFO:tasks.rados.rados.0.smithi084.stdout:1770: oid 15 updating version 929 to 930 2024-03-30T12:28:35.658 INFO:tasks.rados.rados.0.smithi084.stdout:1770: oid 15 version 930 is already newer than 928 2024-03-30T12:28:35.658 INFO:tasks.rados.rados.0.smithi084.stdout:1770: oid 15 version 930 is already newer than 927 2024-03-30T12:28:35.658 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 930 (ObjNum 549 snap 185 seq_num 549) dirty exists 2024-03-30T12:28:35.659 INFO:tasks.rados.rados.0.smithi084.stdout:1770: left oid 15 (ObjNum 549 snap 185 seq_num 549) 2024-03-30T12:28:35.659 INFO:tasks.rados.rados.0.smithi084.stdout:1771: expect (ObjNum 475 snap 150 seq_num 475) 2024-03-30T12:28:35.813 INFO:tasks.rados.rados.0.smithi084.stdout:1769: done (3 left) 2024-03-30T12:28:35.813 INFO:tasks.rados.rados.0.smithi084.stdout:1770: done (2 left) 2024-03-30T12:28:35.813 INFO:tasks.rados.rados.0.smithi084.stdout:1771: done (1 left) 2024-03-30T12:28:35.813 INFO:tasks.rados.rados.0.smithi084.stdout:1772: done (0 left) 2024-03-30T12:28:35.813 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 186 2024-03-30T12:28:35.813 INFO:tasks.rados.rados.0.smithi084.stdout:1773: seq_num 550 ranges {0=417792,417792=770048,1187840=638976,1826816=196608} 2024-03-30T12:28:35.814 INFO:tasks.rados.rados.0.smithi084.stdout:1773: writing smithi08477944-39 from 0 to 417792 tid 1 2024-03-30T12:28:35.820 INFO:tasks.rados.rados.0.smithi084.stdout:1773: writing smithi08477944-39 from 417792 to 1187840 tid 2 2024-03-30T12:28:35.821 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.580+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.821 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.586+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.822 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.592+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.822 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.598+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.822 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.603+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.822 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.610+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.822 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.615+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.822 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.621+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.822 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.628+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.822 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.634+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.822 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.641+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.822 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.646+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.822 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.653+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.822 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.662+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.822 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.669+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.822 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.676+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.823 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.682+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.823 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.689+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.823 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.696+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.823 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.702+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.823 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.709+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.823 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.716+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.722+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.728+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.736+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.743+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.749+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.756+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.763+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.769+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.776+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.782+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.790+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.796+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.803+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.809+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.825 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.816+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:35.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:35.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:35.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:35.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:35.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:35.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:35.826 INFO:tasks.rados.rados.0.smithi084.stdout:1773: writing smithi08477944-39 from 1187840 to 1826816 tid 3 2024-03-30T12:28:35.826 INFO:tasks.rados.rados.0.smithi084.stdout:1773: writing smithi08477944-39 from 1826816 to 2023424 tid 4 2024-03-30T12:28:35.826 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 186 2024-03-30T12:28:35.826 INFO:tasks.rados.rados.0.smithi084.stdout:1773: finishing write tid 1 to smithi08477944-39 2024-03-30T12:28:35.826 INFO:tasks.rados.rados.0.smithi084.stdout:1773: finishing write tid 2 to smithi08477944-39 2024-03-30T12:28:35.826 INFO:tasks.rados.rados.0.smithi084.stdout:1774: seq_num 551 ranges {3694592=434176,4128768=647168,4775936=450560,5226496=507904} 2024-03-30T12:28:35.848 INFO:tasks.rados.rados.0.smithi084.stdout:1774: writing smithi08477944-38 from 3694592 to 4128768 tid 1 2024-03-30T12:28:35.852 INFO:tasks.rados.rados.0.smithi084.stdout:1774: writing smithi08477944-38 from 4128768 to 4775936 tid 2 2024-03-30T12:28:35.855 INFO:tasks.rados.rados.0.smithi084.stdout:1774: writing smithi08477944-38 from 4775936 to 5226496 tid 3 2024-03-30T12:28:35.859 INFO:tasks.rados.rados.0.smithi084.stdout:1774: writing smithi08477944-38 from 5226496 to 5734400 tid 4 2024-03-30T12:28:35.859 INFO:tasks.rados.rados.0.smithi084.stdout:1775: read oid 35 snap -1 2024-03-30T12:28:35.859 INFO:tasks.rados.rados.0.smithi084.stdout:1775: expect (ObjNum 540 snap 185 seq_num 540) 2024-03-30T12:28:35.859 INFO:tasks.rados.rados.0.smithi084.stdout:1776: copy_from oid 28 from oid 26 current snap is 186 2024-03-30T12:28:35.859 INFO:tasks.rados.rados.0.smithi084.stdout:1773: finishing write tid 3 to smithi08477944-39 2024-03-30T12:28:35.859 INFO:tasks.rados.rados.0.smithi084.stdout:1773: finishing write tid 4 to smithi08477944-39 2024-03-30T12:28:35.859 INFO:tasks.rados.rados.0.smithi084.stdout:1773: finishing write tid 5 to smithi08477944-39 2024-03-30T12:28:35.859 INFO:tasks.rados.rados.0.smithi084.stdout:1773: finishing write tid 6 to smithi08477944-39 2024-03-30T12:28:35.859 INFO:tasks.rados.rados.0.smithi084.stdout:1773: oid 39 updating version 0 to 935 2024-03-30T12:28:35.860 INFO:tasks.rados.rados.0.smithi084.stdout:1773: oid 39 version 935 is already newer than 933 2024-03-30T12:28:35.860 INFO:tasks.rados.rados.0.smithi084.stdout:1773: oid 39 version 935 is already newer than 931 2024-03-30T12:28:35.860 INFO:tasks.rados.rados.0.smithi084.stdout:1773: oid 39 version 935 is already newer than 932 2024-03-30T12:28:35.860 INFO:tasks.rados.rados.0.smithi084.stdout:1773: oid 39 version 935 is already newer than 934 2024-03-30T12:28:35.860 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 935 (ObjNum 550 snap 186 seq_num 550) dirty exists 2024-03-30T12:28:35.860 INFO:tasks.rados.rados.0.smithi084.stdout:1773: left oid 39 (ObjNum 550 snap 186 seq_num 550) 2024-03-30T12:28:35.860 INFO:tasks.rados.rados.0.smithi084.stdout:1774: finishing write tid 1 to smithi08477944-38 2024-03-30T12:28:35.860 INFO:tasks.rados.rados.0.smithi084.stdout:1774: finishing write tid 2 to smithi08477944-38 2024-03-30T12:28:35.860 INFO:tasks.rados.rados.0.smithi084.stdout:1774: finishing write tid 3 to smithi08477944-38 2024-03-30T12:28:35.860 INFO:tasks.rados.rados.0.smithi084.stdout:1773: done (3 left) 2024-03-30T12:28:35.860 INFO:tasks.rados.rados.0.smithi084.stdout:1777: snap_remove snap 171 2024-03-30T12:28:36.078 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.827+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.079 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.836+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.079 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.844+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.079 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.851+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.079 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.858+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.079 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.866+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.079 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.875+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.079 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.883+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.079 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.890+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.079 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.897+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.079 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.904+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.079 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.911+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.080 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.918+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.080 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.926+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.080 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.935+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.080 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.942+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.080 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.950+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.080 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.957+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.080 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.964+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.080 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.972+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.081 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.979+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.081 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.986+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.081 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:35.993+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.081 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.001+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.081 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.008+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.081 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.016+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.081 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.024+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.081 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.032+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.081 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.038+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.081 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.045+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.081 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.051+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.081 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.059+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.081 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.065+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.081 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.072+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.082 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.079+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.082 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.086+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:35.826+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:36.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:35.826+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:36.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:36.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:36.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:36.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:36.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:36.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:36.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:35.859+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:36.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:35.859+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:36.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:35.860+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:36.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:35.861+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:36.334 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.094+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.334 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.101+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.334 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.108+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.334 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.115+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.335 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.122+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.335 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.130+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.335 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.136+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.335 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.143+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.335 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.150+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.335 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.157+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.335 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.164+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.335 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.172+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.335 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.180+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.335 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.186+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.335 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.193+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.335 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.201+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.335 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.208+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.336 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.215+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.336 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.222+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.336 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.229+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.336 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.236+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.336 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.243+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.336 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.250+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.336 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.257+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.336 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.264+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.336 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.270+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.336 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.276+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.337 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.283+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.337 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.291+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.337 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.298+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.337 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.305+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.337 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.312+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.337 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.320+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.337 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.327+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.337 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.334+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.337 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.342+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.585 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.350+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.585 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.357+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.585 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.365+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.586 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.372+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.586 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.380+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.586 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.387+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.586 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.394+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.586 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.403+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.586 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.411+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.586 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.419+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.586 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.426+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.586 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.434+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.586 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.442+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.586 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.449+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.586 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.457+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.586 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.465+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.586 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.473+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.587 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.480+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.587 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.487+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.587 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.495+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.587 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.502+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.587 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.510+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.587 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.518+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.587 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.525+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.587 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.533+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.587 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.540+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.587 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.547+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.588 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.555+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.588 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.563+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.588 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.570+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.588 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.578+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.588 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.585+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.588 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.593+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.821 INFO:tasks.rados.rados.0.smithi084.stdout:1777: done (3 left) 2024-03-30T12:28:36.821 INFO:tasks.rados.rados.0.smithi084.stdout:1778: read oid 39 snap -1 2024-03-30T12:28:36.821 INFO:tasks.rados.rados.0.smithi084.stdout:1778: expect (ObjNum 550 snap 186 seq_num 550) 2024-03-30T12:28:36.821 INFO:tasks.rados.rados.0.smithi084.stdout:1779: delete oid 27 current snap is 186 2024-03-30T12:28:36.821 INFO:tasks.rados.rados.0.smithi084.stdout:1776: finishing copy_from to smithi08477944-28 2024-03-30T12:28:36.821 INFO:tasks.rados.rados.0.smithi084.stdout:1776: got expected ENOENT (src dne) 2024-03-30T12:28:36.821 INFO:tasks.rados.rados.0.smithi084.stdout:1776: finishing copy_from racing read to smithi08477944-28 2024-03-30T12:28:36.821 INFO:tasks.rados.rados.0.smithi084.stdout:1774: finishing write tid 4 to smithi08477944-38 2024-03-30T12:28:36.821 INFO:tasks.rados.rados.0.smithi084.stdout:1774: finishing write tid 5 to smithi08477944-38 2024-03-30T12:28:36.821 INFO:tasks.rados.rados.0.smithi084.stdout:1774: finishing write tid 6 to smithi08477944-38 2024-03-30T12:28:36.822 INFO:tasks.rados.rados.0.smithi084.stdout:1774: oid 38 updating version 0 to 913 2024-03-30T12:28:36.822 INFO:tasks.rados.rados.0.smithi084.stdout:1774: oid 38 updating version 913 to 915 2024-03-30T12:28:36.822 INFO:tasks.rados.rados.0.smithi084.stdout:1774: oid 38 version 915 is already newer than 912 2024-03-30T12:28:36.822 INFO:tasks.rados.rados.0.smithi084.stdout:1774: oid 38 version 915 is already newer than 911 2024-03-30T12:28:36.822 INFO:tasks.rados.rados.0.smithi084.stdout:1774: oid 38 version 915 is already newer than 914 2024-03-30T12:28:36.822 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 915 (ObjNum 551 snap 186 seq_num 551) dirty exists 2024-03-30T12:28:36.822 INFO:tasks.rados.rados.0.smithi084.stdout:1774: left oid 38 (ObjNum 551 snap 186 seq_num 551) 2024-03-30T12:28:36.822 INFO:tasks.rados.rados.0.smithi084.stdout:1775: expect (ObjNum 540 snap 185 seq_num 540) 2024-03-30T12:28:36.843 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-mon[83709]: osdmap e436: 8 total, 8 up, 8 in 2024-03-30T12:28:36.843 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:36.843 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:36.843 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:36.843 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:36.843 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:36.844 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:36.844 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-mon[83709]: pgmap v337: 121 pgs: 1 peering+snaptrim_error, 9 active+undersized, 4 active+undersized+degraded, 102 active+clean, 5 active+clean+snaptrim_error; 254 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 8.0 MiB/s rd, 3.4 MiB/s wr, 22 op/s; 14/561 objects degraded (2.496%); 7.7 MiB/s, 1 objects/s recovering 2024-03-30T12:28:36.844 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.600+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.844 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.608+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.844 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.616+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.844 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.624+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.845 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.632+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.845 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.639+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.845 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.647+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.845 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.655+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.845 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.664+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.845 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.671+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.845 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.679+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.845 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.686+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.845 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.694+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.845 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.702+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.845 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.714+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.845 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.721+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.845 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.729+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.845 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.737+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.846 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.745+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.846 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.754+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.846 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.761+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.846 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.768+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.846 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.776+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.846 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.783+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.846 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.791+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.846 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.799+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.846 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.808+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.846 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.817+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.846 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.831+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.846 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.851+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:36.970 INFO:tasks.rados.rados.0.smithi084.stdout:1778: expect (ObjNum 550 snap 186 seq_num 550) 2024-03-30T12:28:37.031 INFO:tasks.rados.rados.0.smithi084.stdout:1774: done (4 left) 2024-03-30T12:28:37.031 INFO:tasks.rados.rados.0.smithi084.stdout:1775: done (3 left) 2024-03-30T12:28:37.031 INFO:tasks.rados.rados.0.smithi084.stdout:1776: done (2 left) 2024-03-30T12:28:37.031 INFO:tasks.rados.rados.0.smithi084.stdout:1778: done (1 left) 2024-03-30T12:28:37.031 INFO:tasks.rados.rados.0.smithi084.stdout:1779: done (0 left) 2024-03-30T12:28:37.031 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 186 2024-03-30T12:28:37.031 INFO:tasks.rados.rados.0.smithi084.stdout:1780: seq_num 553 ranges {0=466944,466944=417792,884736=417792,1302528=516096,1818624=253952} 2024-03-30T12:28:37.033 INFO:tasks.rados.rados.0.smithi084.stdout:1780: writing smithi08477944-26 from 0 to 466944 tid 1 2024-03-30T12:28:37.035 INFO:tasks.rados.rados.0.smithi084.stdout:1780: writing smithi08477944-26 from 466944 to 884736 tid 2 2024-03-30T12:28:37.038 INFO:tasks.rados.rados.0.smithi084.stdout:1780: writing smithi08477944-26 from 884736 to 1302528 tid 3 2024-03-30T12:28:37.041 INFO:tasks.rados.rados.0.smithi084.stdout:1780: writing smithi08477944-26 from 1302528 to 1818624 tid 4 2024-03-30T12:28:37.043 INFO:tasks.rados.rados.0.smithi084.stdout:1780: writing smithi08477944-26 from 1818624 to 2072576 tid 5 2024-03-30T12:28:37.043 INFO:tasks.rados.rados.0.smithi084.stdout:1781: read oid 21 snap 170 2024-03-30T12:28:37.043 INFO:tasks.rados.rados.0.smithi084.stdout:1781: expect (ObjNum 1428949920 snap 21994 seq_num 1428729376) 2024-03-30T12:28:37.043 INFO:tasks.rados.rados.0.smithi084.stdout:1780: finishing write tid 1 to smithi08477944-26 2024-03-30T12:28:37.043 INFO:tasks.rados.rados.0.smithi084.stdout:1780: finishing write tid 2 to smithi08477944-26 2024-03-30T12:28:37.043 INFO:tasks.rados.rados.0.smithi084.stdout:1780: finishing write tid 3 to smithi08477944-26 2024-03-30T12:28:37.043 INFO:tasks.rados.rados.0.smithi084.stdout:1782: read oid 8 snap -1 2024-03-30T12:28:37.044 INFO:tasks.rados.rados.0.smithi084.stdout:1782: expect (ObjNum 518 snap 166 seq_num 518) 2024-03-30T12:28:37.044 INFO:tasks.rados.rados.0.smithi084.stdout:1783: delete oid 17 current snap is 186 2024-03-30T12:28:37.045 INFO:tasks.rados.rados.0.smithi084.stdout:1783: done (3 left) 2024-03-30T12:28:37.045 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 46 current snap is 186 2024-03-30T12:28:37.045 INFO:tasks.rados.rados.0.smithi084.stdout:1784: seq_num 555 ranges {7610368=499712,8110080=638976,8749056=425984,9175040=540672} 2024-03-30T12:28:37.091 INFO:tasks.rados.rados.0.smithi084.stdout:1784: writing smithi08477944-46 from 7610368 to 8110080 tid 1 2024-03-30T12:28:37.094 INFO:tasks.rados.rados.0.smithi084.stdout:1784: writing smithi08477944-46 from 8110080 to 8749056 tid 2 2024-03-30T12:28:37.095 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.860+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.095 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.868+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.095 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.875+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.095 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.882+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.096 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.889+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.096 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.896+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.096 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.902+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.096 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.910+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.096 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.918+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.096 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.925+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.096 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.931+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.096 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.938+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.096 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.944+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.096 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.951+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.096 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.959+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.096 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.965+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.096 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.972+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.097 INFO:tasks.rados.rados.0.smithi084.stdout:1784: writing smithi08477944-46 from 8749056 to 9175040 tid 3 2024-03-30T12:28:37.097 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.979+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.097 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.990+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.097 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:36.998+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.098 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.005+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.098 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.013+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.098 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.020+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.098 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.027+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.098 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.033+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.098 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.041+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.098 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.048+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.098 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.059+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.098 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.067+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.098 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.074+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.098 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.081+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.098 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.088+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.099 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.095+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.099 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.102+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.100 INFO:tasks.rados.rados.0.smithi084.stdout:1784: writing smithi08477944-46 from 9175040 to 9715712 tid 4 2024-03-30T12:28:37.100 INFO:tasks.rados.rados.0.smithi084.stdout:1785: snap_create 2024-03-30T12:28:37.100 INFO:tasks.rados.rados.0.smithi084.stdout:1780: finishing write tid 4 to smithi08477944-26 2024-03-30T12:28:37.100 INFO:tasks.rados.rados.0.smithi084.stdout:1780: finishing write tid 5 to smithi08477944-26 2024-03-30T12:28:37.101 INFO:tasks.rados.rados.0.smithi084.stdout:1781: expect (ObjNum 1428949920 snap 21994 seq_num 1428729376) 2024-03-30T12:28:37.104 INFO:tasks.rados.rados.0.smithi084.stdout:1780: finishing write tid 6 to smithi08477944-26 2024-03-30T12:28:37.104 INFO:tasks.rados.rados.0.smithi084.stdout:1782: expect (ObjNum 518 snap 166 seq_num 518) 2024-03-30T12:28:37.148 INFO:tasks.rados.rados.0.smithi084.stdout:1780: finishing write tid 7 to smithi08477944-26 2024-03-30T12:28:37.148 INFO:tasks.rados.rados.0.smithi084.stdout:1780: oid 26 updating version 0 to 964 2024-03-30T12:28:37.148 INFO:tasks.rados.rados.0.smithi084.stdout:1780: oid 26 version 964 is already newer than 962 2024-03-30T12:28:37.148 INFO:tasks.rados.rados.0.smithi084.stdout:1780: oid 26 updating version 964 to 966 2024-03-30T12:28:37.148 INFO:tasks.rados.rados.0.smithi084.stdout:1780: oid 26 version 966 is already newer than 965 2024-03-30T12:28:37.148 INFO:tasks.rados.rados.0.smithi084.stdout:1780: oid 26 version 966 is already newer than 961 2024-03-30T12:28:37.148 INFO:tasks.rados.rados.0.smithi084.stdout:1780: oid 26 version 966 is already newer than 963 2024-03-30T12:28:37.148 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 966 (ObjNum 553 snap 186 seq_num 553) dirty exists 2024-03-30T12:28:37.148 INFO:tasks.rados.rados.0.smithi084.stdout:1780: left oid 26 (ObjNum 553 snap 186 seq_num 553) 2024-03-30T12:28:37.148 INFO:tasks.rados.rados.0.smithi084.stdout:1784: finishing write tid 1 to smithi08477944-46 2024-03-30T12:28:37.148 INFO:tasks.rados.rados.0.smithi084.stdout:1784: finishing write tid 2 to smithi08477944-46 2024-03-30T12:28:37.149 INFO:tasks.rados.rados.0.smithi084.stdout:1784: finishing write tid 3 to smithi08477944-46 2024-03-30T12:28:37.149 INFO:tasks.rados.rados.0.smithi084.stdout:1784: finishing write tid 4 to smithi08477944-46 2024-03-30T12:28:37.149 INFO:tasks.rados.rados.0.smithi084.stdout:1784: finishing write tid 5 to smithi08477944-46 2024-03-30T12:28:37.149 INFO:tasks.rados.rados.0.smithi084.stdout:1784: finishing write tid 6 to smithi08477944-46 2024-03-30T12:28:37.149 INFO:tasks.rados.rados.0.smithi084.stdout:1784: oid 46 updating version 0 to 969 2024-03-30T12:28:37.149 INFO:tasks.rados.rados.0.smithi084.stdout:1784: oid 46 updating version 969 to 971 2024-03-30T12:28:37.149 INFO:tasks.rados.rados.0.smithi084.stdout:1784: oid 46 version 971 is already newer than 968 2024-03-30T12:28:37.149 INFO:tasks.rados.rados.0.smithi084.stdout:1784: oid 46 version 971 is already newer than 970 2024-03-30T12:28:37.149 INFO:tasks.rados.rados.0.smithi084.stdout:1784: oid 46 updating version 971 to 972 2024-03-30T12:28:37.149 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 972 (ObjNum 555 snap 186 seq_num 555) dirty exists 2024-03-30T12:28:37.149 INFO:tasks.rados.rados.0.smithi084.stdout:1784: left oid 46 (ObjNum 555 snap 186 seq_num 555) 2024-03-30T12:28:37.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:36.830+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:37.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:36.832+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:37.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:36.839+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:37.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:36.839+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:37.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:36.839+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:37.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:36.839+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:37.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:36.839+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:37.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:36.839+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:37.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:36.839+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:37.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:36 smithi084 ceph-mon[91810]: osdmap e436: 8 total, 8 up, 8 in 2024-03-30T12:28:37.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:37.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:37.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:37.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:37.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:37.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:37.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:36 smithi084 ceph-mon[91810]: pgmap v337: 121 pgs: 1 peering+snaptrim_error, 9 active+undersized, 4 active+undersized+degraded, 102 active+clean, 5 active+clean+snaptrim_error; 254 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 8.0 MiB/s rd, 3.4 MiB/s wr, 22 op/s; 14/561 objects degraded (2.496%); 7.7 MiB/s, 1 objects/s recovering 2024-03-30T12:28:37.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:36 smithi084 ceph-mon[89279]: osdmap e436: 8 total, 8 up, 8 in 2024-03-30T12:28:37.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:37.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:37.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:37.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:37.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:37.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:37.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:36 smithi084 ceph-mon[89279]: pgmap v337: 121 pgs: 1 peering+snaptrim_error, 9 active+undersized, 4 active+undersized+degraded, 102 active+clean, 5 active+clean+snaptrim_error; 254 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 8.0 MiB/s rd, 3.4 MiB/s wr, 22 op/s; 14/561 objects degraded (2.496%); 7.7 MiB/s, 1 objects/s recovering 2024-03-30T12:28:37.349 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.112+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.350 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.120+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.350 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.127+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.350 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.134+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.350 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.141+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.350 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.148+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.350 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.155+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.350 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.162+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.350 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.169+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.350 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.176+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.350 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.183+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.350 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.190+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.350 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.196+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.204+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.214+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.221+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.228+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.235+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.242+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.249+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.257+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.263+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.269+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.352 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.276+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.352 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.284+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.352 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.291+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.352 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.298+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.352 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.305+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.352 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.312+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.352 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.321+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.352 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.329+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.352 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.336+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.352 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.343+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.352 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.350+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.352 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.357+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.600 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.365+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.600 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.372+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.600 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.379+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.600 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.386+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.393+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.400+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.408+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.415+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.424+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.430+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.438+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.446+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.453+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.460+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.468+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.475+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.482+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.489+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.496+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.503+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.511+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.520+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.527+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.534+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.541+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.548+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.556+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.563+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.570+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.578+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.603 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.585+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.603 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.593+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.603 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.600+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.603 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.607+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.828 INFO:tasks.rados.rados.0.smithi084.stdout:1780: done (4 left) 2024-03-30T12:28:37.828 INFO:tasks.rados.rados.0.smithi084.stdout:1781: done (3 left) 2024-03-30T12:28:37.828 INFO:tasks.rados.rados.0.smithi084.stdout:1782: done (2 left) 2024-03-30T12:28:37.828 INFO:tasks.rados.rados.0.smithi084.stdout:1784: done (1 left) 2024-03-30T12:28:37.828 INFO:tasks.rados.rados.0.smithi084.stdout:1785: done (0 left) 2024-03-30T12:28:37.828 INFO:tasks.rados.rados.0.smithi084.stdout:1786: snap_remove snap 180 2024-03-30T12:28:37.853 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-mon[83709]: Health check update: Degraded data redundancy: 14/561 objects degraded (2.496%), 4 pgs degraded (PG_DEGRADED) 2024-03-30T12:28:37.853 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-mon[83709]: osdmap e437: 8 total, 8 up, 8 in 2024-03-30T12:28:37.853 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:37.853 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:37.854 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:37.854 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:37.854 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:37.854 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:37.854 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.616+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.854 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.623+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.855 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.631+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.855 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.638+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.855 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.645+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.855 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.653+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.855 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.660+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.855 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.668+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.855 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.675+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.855 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.683+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.855 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.691+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.855 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.699+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.855 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.707+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.856 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.714+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.856 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.722+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.856 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.729+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.856 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.737+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.856 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.744+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.856 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.752+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.856 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.760+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.856 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.767+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.856 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.775+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.856 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.782+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.856 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.789+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.856 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.798+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.856 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.806+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.856 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.814+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.857 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.821+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.857 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.829+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.857 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.839+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.857 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.847+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.857 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.854+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:37.857 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.861+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.105 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.875+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.105 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.882+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.105 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.889+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.105 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.897+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.105 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.904+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.106 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.914+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.106 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.923+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.106 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.931+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.106 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.940+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.106 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.949+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.106 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.957+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.106 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.965+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.106 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.972+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.106 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.980+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.106 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.988+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.106 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:37.997+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.106 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.007+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.107 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.014+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.107 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.022+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.107 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.030+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.107 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.038+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.107 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.045+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.107 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.053+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.107 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.060+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.107 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.068+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.107 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.076+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.107 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.085+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.107 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.094+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.107 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.103+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.107 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.112+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:37.836+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:38.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:37.836+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:38.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:37 smithi084 ceph-mon[91810]: Health check update: Degraded data redundancy: 14/561 objects degraded (2.496%), 4 pgs degraded (PG_DEGRADED) 2024-03-30T12:28:38.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:37 smithi084 ceph-mon[91810]: osdmap e437: 8 total, 8 up, 8 in 2024-03-30T12:28:38.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:38.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:38.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:38.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:38.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:38.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:38.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:37 smithi084 ceph-mon[89279]: Health check update: Degraded data redundancy: 14/561 objects degraded (2.496%), 4 pgs degraded (PG_DEGRADED) 2024-03-30T12:28:38.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:37 smithi084 ceph-mon[89279]: osdmap e437: 8 total, 8 up, 8 in 2024-03-30T12:28:38.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:38.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:38.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:38.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:38.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:38.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:38.363 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.121+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.363 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.128+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.363 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.136+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.363 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.143+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.363 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.151+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.363 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.160+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.363 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.170+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.363 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.178+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.363 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.187+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.363 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.195+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.364 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.204+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.364 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.213+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.364 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.222+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.364 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.231+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.364 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.239+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.364 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.247+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.364 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.255+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.364 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.264+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.364 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.272+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.364 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.281+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.364 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.290+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.364 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.299+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.364 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.307+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.364 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.315+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.365 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.325+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.365 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.334+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.365 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.343+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.365 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.352+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.365 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.361+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.365 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.370+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.379+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.387+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.396+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.406+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.414+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.423+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.432+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.440+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.449+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.458+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.467+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.475+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.485+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.494+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.503+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.512+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.520+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.622 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.530+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.622 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.539+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.622 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.548+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.622 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.557+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.622 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.566+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.622 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.575+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.622 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.584+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.622 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.593+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.622 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.602+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.622 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.610+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.622 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.619+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:38.353+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:38.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:38.353+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:38.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:38.353+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:38.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:38.354+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:38.838 INFO:tasks.rados.rados.0.smithi084.stdout:1786: done (0 left) 2024-03-30T12:28:38.838 INFO:tasks.rados.rados.0.smithi084.stdout:1787: rollback oid 34 current snap is 187 2024-03-30T12:28:38.838 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 34 to 182 2024-03-30T12:28:38.838 INFO:tasks.rados.rados.0.smithi084.stdout:1788: snap_remove snap 179 2024-03-30T12:28:38.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-mon[83709]: osdmap e438: 8 total, 8 up, 8 in 2024-03-30T12:28:38.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:38.879 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:38.880 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:38.880 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:38.880 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:28:38.880 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:28:38.880 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:38.880 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:28:38.880 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:28:38.880 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:28:38.880 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:28:38.880 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-30T12:28:38.880 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-mon[83709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-30T12:28:38.880 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-mon[83709]: Upgrade: osd.5 is safe to restart 2024-03-30T12:28:38.880 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-mon[83709]: pgmap v340: 121 pgs: 2 active+clean+snaptrim, 113 active+clean, 6 active+clean+snaptrim_error; 268 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 9.4 MiB/s rd, 5.9 MiB/s wr, 28 op/s; 8.1 MiB/s, 1 objects/s recovering 2024-03-30T12:28:38.881 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.629+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.881 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.639+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.881 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.648+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.881 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.657+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.881 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.666+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.881 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.675+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.881 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.684+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.881 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.693+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.881 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.702+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.882 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.711+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.882 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.722+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.882 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.732+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.882 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.741+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.882 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.751+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.882 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.761+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.882 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.770+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.882 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.780+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.882 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.791+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.882 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.801+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.882 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.810+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.882 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.820+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.882 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.830+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.883 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.840+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.883 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.857+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.883 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.869+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.883 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.877+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:38.883 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.886+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.131 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.895+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.131 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.903+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.131 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.912+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.131 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.921+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.131 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.929+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.131 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.937+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.131 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.945+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.131 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.954+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.131 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.962+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.131 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.970+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.131 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.978+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.132 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.986+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.132 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:38.998+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.132 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.008+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.132 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.018+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.132 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.027+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.132 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.036+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.132 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.044+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.132 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.053+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.132 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.060+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.132 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.069+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.132 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.078+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.132 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.086+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.132 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.095+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.132 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.105+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.133 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.114+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.133 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.123+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.133 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.133+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:38.849+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:39.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:38.850+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:39.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:38.844+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:39.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:38.844+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:39.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:38.844+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:39.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:38.844+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:39.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:38.845+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:39.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:38.845+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:39.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:38.845+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[91810]: osdmap e438: 8 total, 8 up, 8 in 2024-03-30T12:28:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:28:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:28:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:28:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:28:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:28:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:28:39.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-30T12:28:39.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[91810]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-30T12:28:39.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[91810]: Upgrade: osd.5 is safe to restart 2024-03-30T12:28:39.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[91810]: pgmap v340: 121 pgs: 2 active+clean+snaptrim, 113 active+clean, 6 active+clean+snaptrim_error; 268 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 9.4 MiB/s rd, 5.9 MiB/s wr, 28 op/s; 8.1 MiB/s, 1 objects/s recovering 2024-03-30T12:28:39.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[89279]: osdmap e438: 8 total, 8 up, 8 in 2024-03-30T12:28:39.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:39.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:39.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:39.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:39.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:28:39.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:28:39.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:39.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:28:39.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:28:39.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:28:39.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:28:39.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-30T12:28:39.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[89279]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-30T12:28:39.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[89279]: Upgrade: osd.5 is safe to restart 2024-03-30T12:28:39.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:38 smithi084 ceph-mon[89279]: pgmap v340: 121 pgs: 2 active+clean+snaptrim, 113 active+clean, 6 active+clean+snaptrim_error; 268 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 9.4 MiB/s rd, 5.9 MiB/s wr, 28 op/s; 8.1 MiB/s, 1 objects/s recovering 2024-03-30T12:28:39.382 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.143+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.382 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.152+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.382 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.160+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.382 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.168+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.382 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.177+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.382 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.185+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.382 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.195+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.382 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.203+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.382 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.211+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.219+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.228+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.236+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.245+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.256+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.266+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.275+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.284+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.293+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.302+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.311+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.321+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.332+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.341+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.384 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.351+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.384 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.361+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.384 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.370+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.384 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.380+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.384 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.389+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.634 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.400+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.410+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.420+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.434+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.443+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.452+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.461+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.469+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.477+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.485+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.494+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.502+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.510+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.636 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.520+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.636 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.528+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.636 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.536+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.636 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.545+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.636 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.554+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.636 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.562+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.636 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.570+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.636 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.579+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.636 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.588+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.636 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.596+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.636 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.605+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.636 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.614+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.637 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.624+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.637 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.633+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.637 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.642+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:28:39] "GET /metrics HTTP/1.1" 200 36263 "" "Prometheus/2.43.0" 2024-03-30T12:28:39.844 INFO:tasks.rados.rados.0.smithi084.stdout:1788: done (1 left) 2024-03-30T12:28:39.844 INFO:tasks.rados.rados.0.smithi084.stdout:1789: copy_from oid 27 from oid 37 current snap is 187 2024-03-30T12:28:39.844 INFO:tasks.rados.rados.0.smithi084.stdout:1787: finishing rollback tid 0 to smithi08477944-34 2024-03-30T12:28:39.844 INFO:tasks.rados.rados.0.smithi084.stdout:1787: finishing rollback tid 1 to smithi08477944-34 2024-03-30T12:28:39.844 INFO:tasks.rados.rados.0.smithi084.stdout:1787: finishing rollback tid 2 to smithi08477944-34 2024-03-30T12:28:39.844 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 888 (ObjNum 523 snap 171 seq_num 523) dirty exists 2024-03-30T12:28:39.844 INFO:tasks.rados.rados.0.smithi084.stdout:1787: done (1 left) 2024-03-30T12:28:39.844 INFO:tasks.rados.rados.0.smithi084.stdout:1790: snap_remove snap 185 2024-03-30T12:28:39.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:39.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:39.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:39.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:39.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:39.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:39.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-mon[83709]: osdmap e439: 8 total, 8 up, 8 in 2024-03-30T12:28:39.885 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:39.886 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:39.886 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:39.886 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:39.886 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-mon[83709]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/561 objects degraded (2.496%), 4 pgs degraded) 2024-03-30T12:28:39.886 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.651+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.886 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.660+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.886 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.669+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.886 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.679+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.887 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.688+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.887 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.697+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.887 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.705+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.887 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.714+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.887 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.723+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.887 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.732+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.887 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.741+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.887 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.750+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.887 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.758+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.887 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.767+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.887 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.776+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.887 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.785+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.887 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.793+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.887 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.803+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.887 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.811+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.888 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.820+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.888 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.829+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.888 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.838+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.888 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.848+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.888 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.865+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.888 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.875+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.888 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.884+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:39.888 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.893+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.144 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.902+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.144 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.911+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.144 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.920+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.144 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.928+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.144 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.937+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.144 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.946+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.145 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.955+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.145 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.965+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.145 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.974+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.145 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.983+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.145 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:39.991+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.145 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.001+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.145 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.010+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.145 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.020+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.145 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.029+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.145 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.038+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.145 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.046+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.055+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.064+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.073+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.083+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.094+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.105+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.115+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.125+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.134+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.147 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.142+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.147 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.151+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:39.858+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:40.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:39.858+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:40.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:39.849+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:40.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:39.849+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:40.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:39.850+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:40.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:39.850+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:40.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-mon[89279]: osdmap e439: 8 total, 8 up, 8 in 2024-03-30T12:28:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-mon[89279]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/561 objects degraded (2.496%), 4 pgs degraded) 2024-03-30T12:28:40.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:40.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:40.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:40.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:40.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:40.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:40.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-mon[91810]: osdmap e439: 8 total, 8 up, 8 in 2024-03-30T12:28:40.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:40.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:40.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:40.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:40.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:39 smithi084 ceph-mon[91810]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/561 objects degraded (2.496%), 4 pgs degraded) 2024-03-30T12:28:40.402 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.161+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.403 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.172+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.403 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.182+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.403 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.193+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.403 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.203+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.403 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.213+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.403 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.224+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.403 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.234+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.403 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.244+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.403 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.254+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.403 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.264+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.403 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.275+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.404 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.285+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.404 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.295+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.404 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.305+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.404 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.315+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.404 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.326+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.404 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.336+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.404 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.348+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.404 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.357+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.404 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.367+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.404 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.378+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.404 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.388+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.404 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.399+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.404 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.410+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.662 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.420+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.662 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.430+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.663 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.444+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.663 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.454+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.663 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.464+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.663 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.474+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.663 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.485+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.663 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.496+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.663 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.506+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.663 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.516+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.663 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.526+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.663 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.536+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.663 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.546+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.663 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.556+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.663 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.565+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.575+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.586+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.597+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.608+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.618+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.629+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.639+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.649+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.660+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.670+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.844 INFO:tasks.rados.rados.0.smithi084.stdout:1790: done (1 left) 2024-03-30T12:28:40.844 INFO:tasks.rados.rados.0.smithi084.stdout:1791: delete oid 11 current snap is 187 2024-03-30T12:28:40.844 INFO:tasks.rados.rados.0.smithi084.stdout:1789: finishing copy_from to smithi08477944-27 2024-03-30T12:28:40.844 INFO:tasks.rados.rados.0.smithi084.stdout:1789: got expected ENOENT (src dne) 2024-03-30T12:28:40.845 INFO:tasks.rados.rados.0.smithi084.stdout:1789: finishing copy_from racing read to smithi08477944-27 2024-03-30T12:28:40.860 INFO:tasks.rados.rados.0.smithi084.stdout:1789: done (1 left) 2024-03-30T12:28:40.860 INFO:tasks.rados.rados.0.smithi084.stdout:1791: done (0 left) 2024-03-30T12:28:40.860 INFO:tasks.rados.rados.0.smithi084.stdout:1792: read oid 47 snap -1 2024-03-30T12:28:40.860 INFO:tasks.rados.rados.0.smithi084.stdout:1792: expect (ObjNum 511 snap 162 seq_num 511) 2024-03-30T12:28:40.860 INFO:tasks.rados.rados.0.smithi084.stdout:1793: read oid 33 snap -1 2024-03-30T12:28:40.861 INFO:tasks.rados.rados.0.smithi084.stdout:1793: expect (ObjNum 533 snap 178 seq_num 533) 2024-03-30T12:28:40.861 INFO:tasks.rados.rados.0.smithi084.stdout:1794: rollback oid 5 current snap is 187 2024-03-30T12:28:40.861 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 5 to 184 2024-03-30T12:28:40.861 INFO:tasks.rados.rados.0.smithi084.stdout:1795: delete oid 14 current snap is 187 2024-03-30T12:28:40.865 INFO:tasks.rados.rados.0.smithi084.stdout:1795: done (3 left) 2024-03-30T12:28:40.865 INFO:tasks.rados.rados.0.smithi084.stdout:1796: snap_create 2024-03-30T12:28:40.866 INFO:tasks.rados.rados.0.smithi084.stdout:1794: finishing rollback tid 0 to smithi08477944-5 2024-03-30T12:28:40.867 INFO:tasks.rados.rados.0.smithi084.stdout:1794: finishing rollback tid 1 to smithi08477944-5 2024-03-30T12:28:40.867 INFO:tasks.rados.rados.0.smithi084.stdout:1794: finishing rollback tid 2 to smithi08477944-5 2024-03-30T12:28:40.867 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 914 (ObjNum 445 snap 141 seq_num 445) dirty exists 2024-03-30T12:28:40.869 INFO:tasks.rados.rados.0.smithi084.stdout:1792: expect (ObjNum 511 snap 162 seq_num 511) 2024-03-30T12:28:40.913 INFO:tasks.rados.rados.0.smithi084.stdout:1793: expect (ObjNum 533 snap 178 seq_num 533) 2024-03-30T12:28:40.920 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:40.920 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:40.920 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:40.920 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-mon[83709]: osdmap e440: 8 total, 8 up, 8 in 2024-03-30T12:28:40.920 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:40.920 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:40.920 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:40.920 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-mon[83709]: Upgrade: Updating osd.5 2024-03-30T12:28:40.920 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:40.920 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-30T12:28:40.920 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:28:40.920 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-mon[83709]: Deploying daemon osd.5 on smithi162 2024-03-30T12:28:40.920 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-mon[83709]: pgmap v343: 121 pgs: 2 active+clean+snaptrim, 113 active+clean, 6 active+clean+snaptrim_error; 272 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.0 MiB/s rd, 4.4 MiB/s wr, 14 op/s; 396 KiB/s, 0 objects/s recovering 2024-03-30T12:28:40.921 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.681+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.921 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.691+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.921 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.702+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.921 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.712+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.921 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.722+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.921 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.733+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.921 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.743+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.921 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.754+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.922 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.766+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.922 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.777+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.922 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.789+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.922 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.801+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.922 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.811+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.922 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.822+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.922 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.834+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.922 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.845+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.922 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.862+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.922 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.877+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.922 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.887+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.922 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.897+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.922 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.909+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.923 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.918+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:40.923 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.928+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.176 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.938+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.176 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.947+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.176 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.956+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.177 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.966+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.177 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.975+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.177 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.985+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.177 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:40.996+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.177 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.006+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.177 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.016+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.177 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.026+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.177 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.035+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.177 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.045+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.177 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.054+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.177 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.064+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.177 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.073+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.177 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.083+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.177 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.094+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.177 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.104+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.178 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.115+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.178 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.126+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.178 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.135+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.178 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.145+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.178 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.154+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.179 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.164+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.179 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.174+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.179 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.184+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:40.863+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:41.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:40.863+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:41.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:41.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:41.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:41.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[91810]: osdmap e440: 8 total, 8 up, 8 in 2024-03-30T12:28:41.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:41.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:41.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:41.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[91810]: Upgrade: Updating osd.5 2024-03-30T12:28:41.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:41.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-30T12:28:41.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:28:41.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[91810]: Deploying daemon osd.5 on smithi162 2024-03-30T12:28:41.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[91810]: pgmap v343: 121 pgs: 2 active+clean+snaptrim, 113 active+clean, 6 active+clean+snaptrim_error; 272 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.0 MiB/s rd, 4.4 MiB/s wr, 14 op/s; 396 KiB/s, 0 objects/s recovering 2024-03-30T12:28:41.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:40.865+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:41.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:40.865+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:41.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:40.865+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:41.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:40.865+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:41.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:40.865+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:41.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:40.866+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:41.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:40.866+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:41.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:41.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:41.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:41.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[89279]: osdmap e440: 8 total, 8 up, 8 in 2024-03-30T12:28:41.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:41.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:41.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:41.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[89279]: Upgrade: Updating osd.5 2024-03-30T12:28:41.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:41.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-30T12:28:41.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:28:41.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[89279]: Deploying daemon osd.5 on smithi162 2024-03-30T12:28:41.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:40 smithi084 ceph-mon[89279]: pgmap v343: 121 pgs: 2 active+clean+snaptrim, 113 active+clean, 6 active+clean+snaptrim_error; 272 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.0 MiB/s rd, 4.4 MiB/s wr, 14 op/s; 396 KiB/s, 0 objects/s recovering 2024-03-30T12:28:41.436 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.194+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.436 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.204+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.436 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.213+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.436 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.222+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.436 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.232+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.436 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.243+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.436 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.255+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.266+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.278+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.289+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.300+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.310+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.320+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.329+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.339+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.351+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.360+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.371+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.381+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.392+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.438 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.403+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.438 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.413+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.438 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.423+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.438 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.434+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.438 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.443+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.687 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.454+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.687 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.464+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.687 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.474+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.688 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.484+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.688 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.493+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.688 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.502+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.688 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.511+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.688 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.522+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.688 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.531+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.688 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.542+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.688 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.552+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.688 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.563+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.688 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.573+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.688 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.583+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.688 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.593+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.688 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.603+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.689 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.615+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.689 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.625+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.689 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.635+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.689 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.645+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.689 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.654+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.689 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.664+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.689 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.675+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.689 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.685+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.689 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.695+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.859 INFO:tasks.rados.rados.0.smithi084.stdout:1792: done (3 left) 2024-03-30T12:28:41.860 INFO:tasks.rados.rados.0.smithi084.stdout:1793: done (2 left) 2024-03-30T12:28:41.860 INFO:tasks.rados.rados.0.smithi084.stdout:1794: done (1 left) 2024-03-30T12:28:41.860 INFO:tasks.rados.rados.0.smithi084.stdout:1796: done (0 left) 2024-03-30T12:28:41.860 INFO:tasks.rados.rados.0.smithi084.stdout:1797: rmattr oid 40 current snap is 188 2024-03-30T12:28:41.860 INFO:tasks.rados.rados.0.smithi084.stdout:1798: rmattr oid 12 current snap is 188 2024-03-30T12:28:41.860 INFO:tasks.rados.rados.0.smithi084.stdout:1798: done (1 left) 2024-03-30T12:28:41.860 INFO:tasks.rados.rados.0.smithi084.stdout:1799: rollback oid 27 current snap is 188 2024-03-30T12:28:41.860 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 27 to 186 2024-03-30T12:28:41.860 INFO:tasks.rados.rados.0.smithi084.stdout:1800: snap_create 2024-03-30T12:28:41.864 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 926 (ObjNum 546 snap 185 seq_num 546) dirty exists 2024-03-30T12:28:41.903 INFO:tasks.rados.rados.0.smithi084.stdout:1799: finishing rollback tid 1 to smithi08477944-27 2024-03-30T12:28:41.903 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 0 (ObjNum 161 snap 0 seq_num 0) dirty dne 2024-03-30T12:28:41.942 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-mon[83709]: osdmap e441: 8 total, 8 up, 8 in 2024-03-30T12:28:41.942 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:41.942 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:41.942 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:41.942 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:41.942 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:41.942 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:41.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.705+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.715+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.726+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.736+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.746+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.756+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.766+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.777+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.787+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.798+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.810+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.821+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.831+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.842+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.852+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.862+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.920+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.929+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.939+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:41.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.950+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.200 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.960+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.200 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.970+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.200 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.980+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.200 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:41.991+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.200 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.001+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.200 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.013+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.200 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.023+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.200 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.034+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.201 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.044+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.201 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.055+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.201 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.065+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.201 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.077+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.201 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.087+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.201 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.098+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.201 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.108+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.201 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.117+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.201 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.128+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.201 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.139+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.201 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.165+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.201 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.176+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.201 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.187+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.201 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.197+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.202 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.207+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:41.873+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:42.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:41.874+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:42.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:41.869+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:42.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:41.870+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:42.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:41.870+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:42.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:41.871+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:42.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:41 smithi084 ceph-mon[91810]: osdmap e441: 8 total, 8 up, 8 in 2024-03-30T12:28:42.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:42.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:42.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:42.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:42.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:42.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:42.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:41 smithi084 ceph-mon[89279]: osdmap e441: 8 total, 8 up, 8 in 2024-03-30T12:28:42.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:42.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:42.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:42.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:42.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:42.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:42.454 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.218+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.455 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.228+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.455 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.239+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.455 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.249+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.455 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.259+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.455 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.269+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.455 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.281+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.455 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.291+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.455 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.303+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.456 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.314+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.456 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.325+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.456 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.335+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.456 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.345+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.456 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.356+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.456 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.367+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.456 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.377+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.456 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.388+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.456 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.398+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.457 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.409+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.457 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.419+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.457 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.429+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.457 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.439+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.457 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.450+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.457 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.460+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.705 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.471+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.706 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.481+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.706 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.491+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.706 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.501+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.706 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.511+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.706 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.523+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.706 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.534+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.706 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.545+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.706 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.555+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.707 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.565+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.707 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.576+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.707 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.587+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.707 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.598+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.707 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.608+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.707 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.618+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.707 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.629+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.707 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.639+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.707 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.650+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.707 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.661+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.707 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.671+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.707 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.681+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.707 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.691+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.707 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.702+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.708 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.713+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.870 INFO:tasks.rados.rados.0.smithi084.stdout:1797: done (2 left) 2024-03-30T12:28:42.870 INFO:tasks.rados.rados.0.smithi084.stdout:1799: done (1 left) 2024-03-30T12:28:42.871 INFO:tasks.rados.rados.0.smithi084.stdout:1800: done (0 left) 2024-03-30T12:28:42.871 INFO:tasks.rados.rados.0.smithi084.stdout:1801: rollback oid 31 current snap is 189 2024-03-30T12:28:42.871 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 31 to 168 2024-03-30T12:28:42.871 INFO:tasks.rados.rados.0.smithi084.stdout:1802: snap_remove snap 183 2024-03-30T12:28:42.966 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-mon[83709]: osdmap e442: 8 total, 8 up, 8 in 2024-03-30T12:28:42.966 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:42.966 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:42.966 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:42.966 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:42.966 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:42.966 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:42.966 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-mon[83709]: pgmap v346: 121 pgs: 2 active+clean+snaptrim, 113 active+clean, 6 active+clean+snaptrim_error; 274 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.1 MiB/s rd, 1.5 MiB/s wr, 9 op/s 2024-03-30T12:28:42.967 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.724+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.967 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.735+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.967 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.745+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.967 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.757+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.967 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.769+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.967 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.781+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.967 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.793+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.968 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.804+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.968 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.816+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.968 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.828+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.968 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.840+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.968 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.852+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.968 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.865+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.968 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.882+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.968 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.895+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.968 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.906+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.968 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.918+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.968 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.929+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.968 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.942+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.968 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.953+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.968 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.963+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:42.968 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.974+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.218 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.984+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:42.995+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.005+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.016+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.026+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.038+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.049+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.060+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.072+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.083+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.094+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.105+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.115+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.126+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.137+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.220 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.149+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.220 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.162+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.220 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.174+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.220 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.186+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.220 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.198+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.220 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.210+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.220 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.223+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:42.878+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:43.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:42.878+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:43.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:42 smithi084 ceph-mon[91810]: osdmap e442: 8 total, 8 up, 8 in 2024-03-30T12:28:43.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:43.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:43.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:43.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:43.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:43.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:43.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:42 smithi084 ceph-mon[91810]: pgmap v346: 121 pgs: 2 active+clean+snaptrim, 113 active+clean, 6 active+clean+snaptrim_error; 274 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.1 MiB/s rd, 1.5 MiB/s wr, 9 op/s 2024-03-30T12:28:43.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:42.881+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:43.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:42.881+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:43.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:42.881+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:43.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:42.881+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:43.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:42.881+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:43.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:42.881+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:43.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:42.882+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:43.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:42 smithi084 ceph-mon[89279]: osdmap e442: 8 total, 8 up, 8 in 2024-03-30T12:28:43.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:43.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:43.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:43.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:43.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:43.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:43.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:42 smithi084 ceph-mon[89279]: pgmap v346: 121 pgs: 2 active+clean+snaptrim, 113 active+clean, 6 active+clean+snaptrim_error; 274 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.1 MiB/s rd, 1.5 MiB/s wr, 9 op/s 2024-03-30T12:28:43.469 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.237+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.470 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.251+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.470 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.263+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.470 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.276+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.470 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.289+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.470 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.301+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.470 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.315+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.470 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.329+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.470 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.344+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.470 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.358+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.470 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.371+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.470 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.385+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.470 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.397+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.471 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.411+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.471 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.424+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.471 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.437+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.471 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.451+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.471 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.464+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.471 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.477+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.727 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.491+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.727 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.503+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.727 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.516+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.727 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.530+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.727 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.544+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.727 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.558+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.727 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.572+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.727 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.587+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.728 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.601+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.728 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.614+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.728 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.629+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.728 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.643+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.728 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.657+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.728 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.672+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.728 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.687+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.728 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.702+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.729 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.719+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.868 INFO:tasks.rados.rados.0.smithi084.stdout:1802: done (1 left) 2024-03-30T12:28:43.868 INFO:tasks.rados.rados.0.smithi084.stdout:1803: rmattr oid 21 current snap is 189 2024-03-30T12:28:43.868 INFO:tasks.rados.rados.0.smithi084.stdout:1804: snap_remove snap 182 2024-03-30T12:28:43.984 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.733+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.745+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.758+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.771+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.783+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.797+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.809+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.821+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.833+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.846+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.858+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.872+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.894+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.906+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.921+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.933+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.945+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.958+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.970+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.981+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:43.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:43.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:43.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-mon[83709]: osdmap e443: 8 total, 8 up, 8 in 2024-03-30T12:28:43.986 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:43.987 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:43.987 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:43.987 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:44.242 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:43.991+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.242 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.004+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.242 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.016+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.242 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.029+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.242 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.042+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.242 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.054+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.242 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.065+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.242 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.078+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.242 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.090+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.242 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.102+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.243 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.115+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.243 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.127+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.243 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.139+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.243 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.152+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.243 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.165+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.243 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.178+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.243 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.191+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.243 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.202+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.243 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.214+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.243 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.226+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.243 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.237+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.243 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.249+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:43.877+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:44.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:43.877+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:44.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:43.875+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:44.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:43.876+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:44.258 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:43.876+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:44.258 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:43.877+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:44.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:44.259 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:44.259 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:43 smithi084 ceph-mon[91810]: osdmap e443: 8 total, 8 up, 8 in 2024-03-30T12:28:44.259 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:44.259 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:44.259 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:44.259 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:44.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:44.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:44.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:43 smithi084 ceph-mon[89279]: osdmap e443: 8 total, 8 up, 8 in 2024-03-30T12:28:44.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:44.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:44.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:44.260 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:44.497 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.261+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.498 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.273+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.498 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.286+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.498 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.299+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.498 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.309+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.498 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.321+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.498 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.333+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.498 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.346+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.498 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.359+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.498 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.371+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.498 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.384+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.498 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.395+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.499 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.407+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.499 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.420+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.499 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.431+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.499 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.443+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.499 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.455+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.499 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.466+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.499 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.478+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.499 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.492+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.499 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.505+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.750 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.519+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.751 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.531+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.751 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.544+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.751 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.560+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.751 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.574+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.751 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.588+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.751 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.601+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.751 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.613+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.751 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.625+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.751 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.638+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.751 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.650+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.751 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.663+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.751 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.677+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.751 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.691+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.752 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.704+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.752 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.720+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.752 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.743+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.752 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.758+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:44.867 INFO:tasks.rados.rados.0.smithi084.stdout:1804: done (2 left) 2024-03-30T12:28:44.867 INFO:tasks.rados.rados.0.smithi084.stdout:1805: rollback oid 44 current snap is 189 2024-03-30T12:28:44.867 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 44 to 174 2024-03-30T12:28:44.867 INFO:tasks.rados.rados.0.smithi084.stdout:1801: finishing rollback tid 1 to smithi08477944-31 2024-03-30T12:28:44.867 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 810 (ObjNum 129 snap 0 seq_num 1426816432) dirty dne 2024-03-30T12:28:44.867 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 5081 (ObjNum 289 snap 0 seq_num 0) dirty exists 2024-03-30T12:28:44.867 INFO:tasks.rados.rados.0.smithi084.stdout:1801: done (2 left) 2024-03-30T12:28:44.867 INFO:tasks.rados.rados.0.smithi084.stdout:1803: done (1 left) 2024-03-30T12:28:44.867 INFO:tasks.rados.rados.0.smithi084.stdout:1806: read oid 11 snap -1 2024-03-30T12:28:44.867 INFO:tasks.rados.rados.0.smithi084.stdout:1806: expect deleted 2024-03-30T12:28:44.868 INFO:tasks.rados.rados.0.smithi084.stdout:1807: snap_create 2024-03-30T12:28:44.894 INFO:tasks.rados.rados.0.smithi084.stdout:1805: finishing rollback tid 0 to smithi08477944-44 2024-03-30T12:28:44.909 INFO:tasks.rados.rados.0.smithi084.stdout:1805: finishing rollback tid 1 to smithi08477944-44 2024-03-30T12:28:44.910 INFO:tasks.rados.rados.0.smithi084.stdout:1805: finishing rollback tid 2 to smithi08477944-44 2024-03-30T12:28:44.910 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 7016 (ObjNum 440 snap 141 seq_num 440) dirty exists 2024-03-30T12:28:45.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-mon[83709]: osdmap e444: 8 total, 8 up, 8 in 2024-03-30T12:28:45.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:45.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:45.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:45.010 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:45.010 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:45.010 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:45.010 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-mon[83709]: pgmap v349: 121 pgs: 2 active+clean+snaptrim, 113 active+clean, 6 active+clean+snaptrim_error; 274 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 3.7 MiB/s rd, 494 KiB/s wr, 8 op/s 2024-03-30T12:28:45.010 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:45.010 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:28:45.010 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:45.010 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-mon[83709]: osdmap e445: 8 total, 8 up, 8 in 2024-03-30T12:28:45.010 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.773+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.010 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.787+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.011 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.803+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.011 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.816+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.011 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.829+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.011 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.842+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.011 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.856+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.011 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.869+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.011 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.896+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.011 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.910+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.011 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.924+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.011 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.937+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.011 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.949+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.011 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.962+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.011 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.976+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.011 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:44.990+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.012 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.003+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.012 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.016+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.012 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:44 smithi162 systemd[1]: Stopping Ceph osd.5 for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:28:45.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:44.878+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:45.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:44.879+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:45.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-mon[91810]: osdmap e444: 8 total, 8 up, 8 in 2024-03-30T12:28:45.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:45.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:45.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:45.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:45.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:45.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:45.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-mon[91810]: pgmap v349: 121 pgs: 2 active+clean+snaptrim, 113 active+clean, 6 active+clean+snaptrim_error; 274 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 3.7 MiB/s rd, 494 KiB/s wr, 8 op/s 2024-03-30T12:28:45.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:45.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:28:45.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-mon[91810]: osdmap e445: 8 total, 8 up, 8 in 2024-03-30T12:28:45.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:44.873+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:45.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:44.873+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:45.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:44.873+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:45.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:44.873+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:45.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:44.873+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:45.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:44.873+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:45.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:44.873+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:45.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-mon[89279]: osdmap e444: 8 total, 8 up, 8 in 2024-03-30T12:28:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-mon[89279]: pgmap v349: 121 pgs: 2 active+clean+snaptrim, 113 active+clean, 6 active+clean+snaptrim_error; 274 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 3.7 MiB/s rd, 494 KiB/s wr, 8 op/s 2024-03-30T12:28:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:28:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:44 smithi084 ceph-mon[89279]: osdmap e445: 8 total, 8 up, 8 in 2024-03-30T12:28:45.268 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.031+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.268 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.044+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.268 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.056+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.268 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.067+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.268 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.081+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.268 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.094+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.268 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.107+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.268 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.120+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.269 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.133+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.269 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.148+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.269 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.161+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.269 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.174+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.269 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.187+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.269 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.198+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.269 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.209+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.269 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.241+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.269 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.253+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.269 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.265+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.269 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.276+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.519 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[40835]: 2024-03-30T12:28:45.497+0000 7fadbb848700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:28:45.519 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[40835]: 2024-03-30T12:28:45.497+0000 7fadbb848700 -1 osd.5 445 *** Got signal Terminated *** 2024-03-30T12:28:45.519 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[40835]: 2024-03-30T12:28:45.497+0000 7fadbb848700 -1 osd.5 445 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T12:28:45.520 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.287+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.520 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.299+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.520 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.311+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.520 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.324+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.520 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.337+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.520 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.348+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.520 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.359+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.520 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.370+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.520 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.381+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.520 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.393+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.520 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.405+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.520 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.416+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.520 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.428+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.520 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.439+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.521 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.455+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.521 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.467+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.521 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.479+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.521 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.491+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.521 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.503+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.521 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.515+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.521 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.527+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.539+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.550+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.561+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.572+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.584+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.595+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.606+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.618+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.630+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.641+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.652+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.664+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.675+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.686+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.698+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.709+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.721+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.733+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.744+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.757+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.769+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.775 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.781+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:45.869 INFO:tasks.rados.rados.0.smithi084.stdout:1805: done (2 left) 2024-03-30T12:28:45.869 INFO:tasks.rados.rados.0.smithi084.stdout:1806: done (1 left) 2024-03-30T12:28:45.869 INFO:tasks.rados.rados.0.smithi084.stdout:1807: done (0 left) 2024-03-30T12:28:45.869 INFO:tasks.rados.rados.0.smithi084.stdout:1808: copy_from oid 21 from oid 50 current snap is 190 2024-03-30T12:28:45.869 INFO:tasks.rados.rados.0.smithi084.stdout:1809: read oid 7 snap -1 2024-03-30T12:28:45.870 INFO:tasks.rados.rados.0.smithi084.stdout:1809: expect deleted 2024-03-30T12:28:45.870 INFO:tasks.rados.rados.0.smithi084.stdout:1810: read oid 37 snap -1 2024-03-30T12:28:45.870 INFO:tasks.rados.rados.0.smithi084.stdout:1810: expect deleted 2024-03-30T12:28:45.870 INFO:tasks.rados.rados.0.smithi084.stdout:1811: snap_create 2024-03-30T12:28:46.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-mon[83709]: osd.5 marked itself down and dead 2024-03-30T12:28:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-mon[83709]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T12:28:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-mon[83709]: osdmap e446: 8 total, 7 up, 8 in 2024-03-30T12:28:46.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.792+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:46.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.804+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:46.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.815+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:46.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.826+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:46.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.838+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:46.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.849+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:46.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.860+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:46.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:28:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:28:45.872+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:28:46.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:45.874+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:46.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:45.879+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:46.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:45.884+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:46.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:45.885+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:46.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:46.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:46.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:46.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:46.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:46.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:46.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:45 smithi084 ceph-mon[89279]: osd.5 marked itself down and dead 2024-03-30T12:28:46.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:45 smithi084 ceph-mon[89279]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T12:28:46.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:45 smithi084 ceph-mon[89279]: osdmap e446: 8 total, 7 up, 8 in 2024-03-30T12:28:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset da=[]:{cb=[cb]} for object 5:d602921a:::smithi08477944-28:ca 2024-03-30T12:28:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset e5=[]:{cd=[cd,cc],dc=[dc,db,da,d5],e5=[e5,e4,e3,e2,e0,df,de]} for object 5:ba8bf6d7:::smithi08477944-18:ca 2024-03-30T12:28:46.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:46.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:46.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:45 smithi084 ceph-mon[91810]: osd.5 marked itself down and dead 2024-03-30T12:28:46.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:45 smithi084 ceph-mon[91810]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T12:28:46.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:45 smithi084 ceph-mon[91810]: osdmap e446: 8 total, 7 up, 8 in 2024-03-30T12:28:46.672 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:46 smithi162 podman[93886]: 2024-03-30 12:28:46.402650311 +0000 UTC m=+1.251343789 container died 7ba250d154aa084d3a0409f2e7e02420e28b1ba4d83c25b01e343bd054fdbf1c (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, RELEASE=reef-f14b568, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-03-30T12:28:46.875 INFO:tasks.rados.rados.0.smithi084.stdout:1809: done (3 left) 2024-03-30T12:28:46.875 INFO:tasks.rados.rados.0.smithi084.stdout:1811: done (2 left) 2024-03-30T12:28:46.875 INFO:tasks.rados.rados.0.smithi084.stdout:1812: rollback oid 44 current snap is 191 2024-03-30T12:28:46.875 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 44 to 181 2024-03-30T12:28:46.877 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 191 2024-03-30T12:28:46.877 INFO:tasks.rados.rados.0.smithi084.stdout:1813: seq_num 558 ranges {0=548864,548864=688128,1236992=606208,1843200=311296} 2024-03-30T12:28:46.879 INFO:tasks.rados.rados.0.smithi084.stdout:1813: writing smithi08477944-18 from 0 to 548864 tid 1 2024-03-30T12:28:46.884 INFO:tasks.rados.rados.0.smithi084.stdout:1813: writing smithi08477944-18 from 548864 to 1236992 tid 2 2024-03-30T12:28:46.888 INFO:tasks.rados.rados.0.smithi084.stdout:1813: writing smithi08477944-18 from 1236992 to 1843200 tid 3 2024-03-30T12:28:46.890 INFO:tasks.rados.rados.0.smithi084.stdout:1813: writing smithi08477944-18 from 1843200 to 2154496 tid 4 2024-03-30T12:28:46.890 INFO:tasks.rados.rados.0.smithi084.stdout:1814: snap_create 2024-03-30T12:28:46.896 INFO:tasks.rados.rados.0.smithi084.stdout:1812: finishing rollback tid 0 to smithi08477944-44 2024-03-30T12:28:46.896 INFO:tasks.rados.rados.0.smithi084.stdout:1812: finishing rollback tid 1 to smithi08477944-44 2024-03-30T12:28:46.896 INFO:tasks.rados.rados.0.smithi084.stdout:1812: finishing rollback tid 2 to smithi08477944-44 2024-03-30T12:28:46.897 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 8008 (ObjNum 489 snap 154 seq_num 489) dirty exists 2024-03-30T12:28:46.900 INFO:tasks.rados.rados.0.smithi084.stdout:1813: finishing write tid 1 to smithi08477944-18 2024-03-30T12:28:46.900 INFO:tasks.rados.rados.0.smithi084.stdout:1813: finishing write tid 2 to smithi08477944-18 2024-03-30T12:28:46.900 INFO:tasks.rados.rados.0.smithi084.stdout:1813: finishing write tid 3 to smithi08477944-18 2024-03-30T12:28:46.901 INFO:tasks.rados.rados.0.smithi084.stdout:1813: finishing write tid 4 to smithi08477944-18 2024-03-30T12:28:46.903 INFO:tasks.rados.rados.0.smithi084.stdout:1813: finishing write tid 5 to smithi08477944-18 2024-03-30T12:28:46.905 INFO:tasks.rados.rados.0.smithi084.stdout:1813: finishing write tid 6 to smithi08477944-18 2024-03-30T12:28:46.905 INFO:tasks.rados.rados.0.smithi084.stdout:1813: oid 18 updating version 0 to 928 2024-03-30T12:28:46.905 INFO:tasks.rados.rados.0.smithi084.stdout:1813: oid 18 version 928 is already newer than 926 2024-03-30T12:28:46.905 INFO:tasks.rados.rados.0.smithi084.stdout:1813: oid 18 version 928 is already newer than 927 2024-03-30T12:28:46.905 INFO:tasks.rados.rados.0.smithi084.stdout:1813: oid 18 version 928 is already newer than 925 2024-03-30T12:28:46.905 INFO:tasks.rados.rados.0.smithi084.stdout:1813: oid 18 version 928 is already newer than 924 2024-03-30T12:28:46.905 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 928 (ObjNum 558 snap 191 seq_num 558) dirty exists 2024-03-30T12:28:46.905 INFO:tasks.rados.rados.0.smithi084.stdout:1813: left oid 18 (ObjNum 558 snap 191 seq_num 558) 2024-03-30T12:28:46.914 INFO:tasks.rados.rados.0.smithi084.stdout:1808: finishing copy_from racing read to smithi08477944-21 2024-03-30T12:28:46.916 INFO:tasks.rados.rados.0.smithi084.stdout:1808: finishing copy_from to smithi08477944-21 2024-03-30T12:28:46.916 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 922 (ObjNum 534 snap 180 seq_num 534) dirty exists 2024-03-30T12:28:46.988 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:46.988 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:46.988 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:46.988 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:46.988 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:46 smithi162 ceph-mon[83709]: pgmap v352: 121 pgs: 19 stale+active+clean, 2 active+clean+snaptrim, 94 active+clean, 6 active+clean+snaptrim_error; 274 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 2.2 MiB/s rd, 0 B/s wr, 5 op/s 2024-03-30T12:28:46.988 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:46 smithi162 ceph-mon[83709]: osdmap e447: 8 total, 7 up, 8 in 2024-03-30T12:28:47.239 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:46 smithi162 podman[93886]: 2024-03-30 12:28:46.997275879 +0000 UTC m=+1.845969345 container cleanup 7ba250d154aa084d3a0409f2e7e02420e28b1ba4d83c25b01e343bd054fdbf1c (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5, RELEASE=reef-f14b568, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T12:28:47.240 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:46 smithi162 bash[93886]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5 2024-03-30T12:28:47.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:46.878+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:47.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:46.878+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:47.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:46.885+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:47.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:46.885+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:47.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:46.887+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:47.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:46.887+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:47.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:47.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:47.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:47.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:47.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:46 smithi084 ceph-mon[91810]: pgmap v352: 121 pgs: 19 stale+active+clean, 2 active+clean+snaptrim, 94 active+clean, 6 active+clean+snaptrim_error; 274 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 2.2 MiB/s rd, 0 B/s wr, 5 op/s 2024-03-30T12:28:47.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:46 smithi084 ceph-mon[91810]: osdmap e447: 8 total, 7 up, 8 in 2024-03-30T12:28:47.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:47.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:47.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:47.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:47.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:46 smithi084 ceph-mon[89279]: pgmap v352: 121 pgs: 19 stale+active+clean, 2 active+clean+snaptrim, 94 active+clean, 6 active+clean+snaptrim_error; 274 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 2.2 MiB/s rd, 0 B/s wr, 5 op/s 2024-03-30T12:28:47.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:46 smithi084 ceph-mon[89279]: osdmap e447: 8 total, 7 up, 8 in 2024-03-30T12:28:47.598 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:47 smithi162 podman[93903]: 2024-03-30 12:28:47.249078541 +0000 UTC m=+0.848676049 container remove 7ba250d154aa084d3a0409f2e7e02420e28b1ba4d83c25b01e343bd054fdbf1c (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5, GIT_CLEAN=True, RELEASE=reef-f14b568, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-03-30T12:28:47.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:47 smithi162 podman[93987]: 2024-03-30 12:28:47.512238812 +0000 UTC m=+0.023293549 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:28:47.896 INFO:tasks.rados.rados.0.smithi084.stdout:1808: done (4 left) 2024-03-30T12:28:47.896 INFO:tasks.rados.rados.0.smithi084.stdout:1810: done (3 left) 2024-03-30T12:28:47.896 INFO:tasks.rados.rados.0.smithi084.stdout:1812: done (2 left) 2024-03-30T12:28:47.896 INFO:tasks.rados.rados.0.smithi084.stdout:1813: done (1 left) 2024-03-30T12:28:47.896 INFO:tasks.rados.rados.0.smithi084.stdout:1814: done (0 left) 2024-03-30T12:28:47.896 INFO:tasks.rados.rados.0.smithi084.stdout:1815: read oid 21 snap -1 2024-03-30T12:28:47.896 INFO:tasks.rados.rados.0.smithi084.stdout:1815: expect (ObjNum 534 snap 180 seq_num 534) 2024-03-30T12:28:47.896 INFO:tasks.rados.rados.0.smithi084.stdout:1816: snap_remove snap 170 2024-03-30T12:28:48.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:47.914+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:48.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:47.914+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:48.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:47.914+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:48.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:47.915+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:48.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:48.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:48.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:48.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:48.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:48.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:48.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:48.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:48.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:48.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:48.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:48 smithi162 podman[93987]: 2024-03-30 12:28:48.459102081 +0000 UTC m=+0.970156804 container create de82048c56a3d2fb53f13c715f978502586bdeae4f72a6b15c8fddfd028a0b8f (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326) 2024-03-30T12:28:48.910 INFO:tasks.rados.rados.0.smithi084.stdout:1816: done (1 left) 2024-03-30T12:28:48.910 INFO:tasks.rados.rados.0.smithi084.stdout:1817: copy_from oid 1 from oid 37 current snap is 192 2024-03-30T12:28:48.910 INFO:tasks.rados.rados.0.smithi084.stdout:1815: expect (ObjNum 534 snap 180 seq_num 534) 2024-03-30T12:28:49.007 INFO:tasks.rados.rados.0.smithi084.stdout:1815: done (1 left) 2024-03-30T12:28:49.007 INFO:tasks.rados.rados.0.smithi084.stdout:1818: snap_create 2024-03-30T12:28:49.010 INFO:tasks.rados.rados.0.smithi084.stdout:1817: finishing copy_from to smithi08477944-1 2024-03-30T12:28:49.010 INFO:tasks.rados.rados.0.smithi084.stdout:1817: got expected ENOENT (src dne) 2024-03-30T12:28:49.010 INFO:tasks.rados.rados.0.smithi084.stdout:1817: finishing copy_from racing read to smithi08477944-1 2024-03-30T12:28:49.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:48.920+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:49.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:48.920+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:49.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:48 smithi084 ceph-mon[91810]: osdmap e448: 8 total, 7 up, 8 in 2024-03-30T12:28:49.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:49.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:49.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:48 smithi084 ceph-mon[91810]: pgmap v355: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 1 active+undersized+degraded, 13 active+undersized, 5 peering, 9 stale+active+clean, 1 active+clean+snaptrim, 86 active+clean, 4 active+clean+snaptrim_error; 276 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 255 B/s rd, 526 KiB/s wr, 7 op/s; 36/603 objects degraded (5.970%) 2024-03-30T12:28:49.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:48 smithi084 ceph-mon[89279]: osdmap e448: 8 total, 7 up, 8 in 2024-03-30T12:28:49.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:49.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:49.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:48 smithi084 ceph-mon[89279]: pgmap v355: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 1 active+undersized+degraded, 13 active+undersized, 5 peering, 9 stale+active+clean, 1 active+clean+snaptrim, 86 active+clean, 4 active+clean+snaptrim_error; 276 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 255 B/s rd, 526 KiB/s wr, 7 op/s; 36/603 objects degraded (5.970%) 2024-03-30T12:28:49.299 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:48 smithi162 ceph-mon[83709]: osdmap e448: 8 total, 7 up, 8 in 2024-03-30T12:28:49.299 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:49.299 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:49.299 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:48 smithi162 ceph-mon[83709]: pgmap v355: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 1 active+undersized+degraded, 13 active+undersized, 5 peering, 9 stale+active+clean, 1 active+clean+snaptrim, 86 active+clean, 4 active+clean+snaptrim_error; 276 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 255 B/s rd, 526 KiB/s wr, 7 op/s; 36/603 objects degraded (5.970%) 2024-03-30T12:28:49.546 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:28:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:28:49] "GET /metrics HTTP/1.1" 200 36257 "" "Prometheus/2.43.0" 2024-03-30T12:28:49.553 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:49 smithi162 podman[93987]: 2024-03-30 12:28:49.462653572 +0000 UTC m=+1.973708302 container init de82048c56a3d2fb53f13c715f978502586bdeae4f72a6b15c8fddfd028a0b8f (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, ceph=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:28:49.553 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:49 smithi162 podman[93987]: 2024-03-30 12:28:49.468079051 +0000 UTC m=+1.979133768 container start de82048c56a3d2fb53f13c715f978502586bdeae4f72a6b15c8fddfd028a0b8f (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5-deactivate, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=) 2024-03-30T12:28:49.553 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:49 smithi162 podman[93987]: 2024-03-30 12:28:49.562717031 +0000 UTC m=+2.073771754 container attach de82048c56a3d2fb53f13c715f978502586bdeae4f72a6b15c8fddfd028a0b8f (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5-deactivate, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-03-30T12:28:49.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:49 smithi162 podman[93987]: 2024-03-30 12:28:49.811862021 +0000 UTC m=+2.322916745 container died de82048c56a3d2fb53f13c715f978502586bdeae4f72a6b15c8fddfd028a0b8f (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5) 2024-03-30T12:28:49.904 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:49.553+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:49.904 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:49.553+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:49.904 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:49.553+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:49.904 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:49.553+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:49.912 INFO:tasks.rados.rados.0.smithi084.stdout:1817: done (1 left) 2024-03-30T12:28:49.912 INFO:tasks.rados.rados.0.smithi084.stdout:1818: done (0 left) 2024-03-30T12:28:49.912 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 193 2024-03-30T12:28:49.912 INFO:tasks.rados.rados.0.smithi084.stdout:1819: seq_num 559 ranges {2916352=565248,3481600=573440,4055040=409600,4464640=622592} 2024-03-30T12:28:49.931 INFO:tasks.rados.rados.0.smithi084.stdout:1819: writing smithi08477944-21 from 2916352 to 3481600 tid 1 2024-03-30T12:28:49.934 INFO:tasks.rados.rados.0.smithi084.stdout:1819: writing smithi08477944-21 from 3481600 to 4055040 tid 2 2024-03-30T12:28:49.937 INFO:tasks.rados.rados.0.smithi084.stdout:1819: writing smithi08477944-21 from 4055040 to 4464640 tid 3 2024-03-30T12:28:49.941 INFO:tasks.rados.rados.0.smithi084.stdout:1819: writing smithi08477944-21 from 4464640 to 5087232 tid 4 2024-03-30T12:28:49.941 INFO:tasks.rados.rados.0.smithi084.stdout:1820: snap_remove snap 177 2024-03-30T12:28:50.172 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:49.943+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:50.172 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:49.943+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:50.172 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:50.172 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:50.172 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:49 smithi084 ceph-mon[91810]: Health check failed: Degraded data redundancy: 36/603 objects degraded (5.970%), 3 pgs degraded (PG_DEGRADED) 2024-03-30T12:28:50.172 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:49 smithi084 ceph-mon[91810]: osdmap e449: 8 total, 7 up, 8 in 2024-03-30T12:28:50.172 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:50.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:50.173 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:50.173 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:50.173 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:49 smithi084 ceph-mon[89279]: Health check failed: Degraded data redundancy: 36/603 objects degraded (5.970%), 3 pgs degraded (PG_DEGRADED) 2024-03-30T12:28:50.173 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:49 smithi084 ceph-mon[89279]: osdmap e449: 8 total, 7 up, 8 in 2024-03-30T12:28:50.173 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:50.173 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:50.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:50.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:50.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:49 smithi162 ceph-mon[83709]: Health check failed: Degraded data redundancy: 36/603 objects degraded (5.970%), 3 pgs degraded (PG_DEGRADED) 2024-03-30T12:28:50.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:49 smithi162 ceph-mon[83709]: osdmap e449: 8 total, 7 up, 8 in 2024-03-30T12:28:50.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:50.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:50.684 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:50 smithi162 podman[94012]: 2024-03-30 12:28:50.428357165 +0000 UTC m=+0.610498188 container remove de82048c56a3d2fb53f13c715f978502586bdeae4f72a6b15c8fddfd028a0b8f (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3) 2024-03-30T12:28:50.684 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:50 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.5.service: Deactivated successfully. 2024-03-30T12:28:50.684 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:50 smithi162 systemd[1]: Stopped Ceph osd.5 for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:28:50.684 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:50 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.5.service: Consumed 27.311s CPU time. 2024-03-30T12:28:50.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:50.575+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:50.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:50.575+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:50.928 INFO:tasks.rados.rados.0.smithi084.stdout:1820: done (1 left) 2024-03-30T12:28:50.928 INFO:tasks.rados.rados.0.smithi084.stdout:1821: read oid 46 snap -1 2024-03-30T12:28:50.928 INFO:tasks.rados.rados.0.smithi084.stdout:1821: expect (ObjNum 555 snap 186 seq_num 555) 2024-03-30T12:28:50.928 INFO:tasks.rados.rados.0.smithi084.stdout:1822: snap_create 2024-03-30T12:28:50.929 INFO:tasks.rados.rados.0.smithi084.stdout:1819: finishing write tid 1 to smithi08477944-21 2024-03-30T12:28:50.929 INFO:tasks.rados.rados.0.smithi084.stdout:1819: finishing write tid 2 to smithi08477944-21 2024-03-30T12:28:50.929 INFO:tasks.rados.rados.0.smithi084.stdout:1819: finishing write tid 3 to smithi08477944-21 2024-03-30T12:28:50.929 INFO:tasks.rados.rados.0.smithi084.stdout:1819: finishing write tid 4 to smithi08477944-21 2024-03-30T12:28:50.929 INFO:tasks.rados.rados.0.smithi084.stdout:1819: finishing write tid 5 to smithi08477944-21 2024-03-30T12:28:50.929 INFO:tasks.rados.rados.0.smithi084.stdout:1819: finishing write tid 6 to smithi08477944-21 2024-03-30T12:28:50.929 INFO:tasks.rados.rados.0.smithi084.stdout:1819: oid 21 updating version 0 to 5716 2024-03-30T12:28:50.929 INFO:tasks.rados.rados.0.smithi084.stdout:1819: oid 21 version 5716 is already newer than 5713 2024-03-30T12:28:50.929 INFO:tasks.rados.rados.0.smithi084.stdout:1819: oid 21 version 5716 is already newer than 5715 2024-03-30T12:28:50.929 INFO:tasks.rados.rados.0.smithi084.stdout:1819: oid 21 version 5716 is already newer than 5714 2024-03-30T12:28:50.929 INFO:tasks.rados.rados.0.smithi084.stdout:1819: oid 21 updating version 5716 to 5717 2024-03-30T12:28:50.929 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 5717 (ObjNum 559 snap 193 seq_num 559) dirty exists 2024-03-30T12:28:50.929 INFO:tasks.rados.rados.0.smithi084.stdout:1819: left oid 21 (ObjNum 559 snap 193 seq_num 559) 2024-03-30T12:28:50.971 INFO:tasks.rados.rados.0.smithi084.stdout:1821: expect (ObjNum 555 snap 186 seq_num 555) 2024-03-30T12:28:51.037 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:51.037 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:51.037 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:50 smithi162 ceph-mon[83709]: osdmap e450: 8 total, 7 up, 8 in 2024-03-30T12:28:51.037 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:51.037 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:51.037 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:50 smithi162 ceph-mon[83709]: pgmap v358: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 8 active+undersized+degraded, 30 active+undersized, 5 peering, 2 stale+active+clean, 1 active+clean+snaptrim, 69 active+clean, 4 active+clean+snaptrim_error; 276 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 255 B/s rd, 526 KiB/s wr, 5 op/s; 68/603 objects degraded (11.277%) 2024-03-30T12:28:51.037 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:50 smithi162 systemd[1]: Starting Ceph osd.5 for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:28:51.037 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:50 smithi162 podman[94110]: 2024-03-30 12:28:50.832663992 +0000 UTC m=+0.022604586 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:28:51.037 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:51 smithi162 podman[94110]: 2024-03-30 12:28:51.046219031 +0000 UTC m=+0.236159609 container create 680c892658ddd0d94c8646fd1ee477185b0b4a3311ab8cb2b4e7f4642998cf2c (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5-activate, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-03-30T12:28:51.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:50.934+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:51.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:50.934+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:51.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:51.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:51.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:50 smithi084 ceph-mon[91810]: osdmap e450: 8 total, 7 up, 8 in 2024-03-30T12:28:51.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:51.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:51.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:50 smithi084 ceph-mon[91810]: pgmap v358: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 8 active+undersized+degraded, 30 active+undersized, 5 peering, 2 stale+active+clean, 1 active+clean+snaptrim, 69 active+clean, 4 active+clean+snaptrim_error; 276 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 255 B/s rd, 526 KiB/s wr, 5 op/s; 68/603 objects degraded (11.277%) 2024-03-30T12:28:51.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:50.931+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:51.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:50.931+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:51.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:50.932+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:51.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:50.932+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:51.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:51.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:51.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:50 smithi084 ceph-mon[89279]: osdmap e450: 8 total, 7 up, 8 in 2024-03-30T12:28:51.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:51.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:51.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:50 smithi084 ceph-mon[89279]: pgmap v358: 121 pgs: 2 active+undersized+degraded+snaptrim_error, 8 active+undersized+degraded, 30 active+undersized, 5 peering, 2 stale+active+clean, 1 active+clean+snaptrim, 69 active+clean, 4 active+clean+snaptrim_error; 276 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 255 B/s rd, 526 KiB/s wr, 5 op/s; 68/603 objects degraded (11.277%) 2024-03-30T12:28:51.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:51 smithi162 podman[94110]: 2024-03-30 12:28:51.290986609 +0000 UTC m=+0.480927207 container init 680c892658ddd0d94c8646fd1ee477185b0b4a3311ab8cb2b4e7f4642998cf2c (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3) 2024-03-30T12:28:51.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:51 smithi162 podman[94110]: 2024-03-30 12:28:51.295483697 +0000 UTC m=+0.485424282 container start 680c892658ddd0d94c8646fd1ee477185b0b4a3311ab8cb2b4e7f4642998cf2c (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:28:51.810 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:51 smithi162 podman[94110]: 2024-03-30 12:28:51.396443895 +0000 UTC m=+0.586384496 container attach 680c892658ddd0d94c8646fd1ee477185b0b4a3311ab8cb2b4e7f4642998cf2c (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5-activate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326) 2024-03-30T12:28:51.927 INFO:tasks.rados.rados.0.smithi084.stdout:1819: done (2 left) 2024-03-30T12:28:51.927 INFO:tasks.rados.rados.0.smithi084.stdout:1821: done (1 left) 2024-03-30T12:28:51.927 INFO:tasks.rados.rados.0.smithi084.stdout:1822: done (0 left) 2024-03-30T12:28:51.927 INFO:tasks.rados.rados.0.smithi084.stdout:1823: rollback oid 23 current snap is 194 2024-03-30T12:28:51.927 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 23 to 166 2024-03-30T12:28:51.927 INFO:tasks.rados.rados.0.smithi084.stdout:1824: copy_from oid 7 from oid 25 current snap is 194 2024-03-30T12:28:51.927 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 194 2024-03-30T12:28:51.927 INFO:tasks.rados.rados.0.smithi084.stdout:1825: seq_num 560 ranges {1482752=581632,2064384=458752,2523136=614400,3137536=532480} 2024-03-30T12:28:51.939 INFO:tasks.rados.rados.0.smithi084.stdout:1825: writing smithi08477944-8 from 1482752 to 2064384 tid 1 2024-03-30T12:28:51.941 INFO:tasks.rados.rados.0.smithi084.stdout:1825: writing smithi08477944-8 from 2064384 to 2523136 tid 2 2024-03-30T12:28:51.944 INFO:tasks.rados.rados.0.smithi084.stdout:1825: writing smithi08477944-8 from 2523136 to 3137536 tid 3 2024-03-30T12:28:51.948 INFO:tasks.rados.rados.0.smithi084.stdout:1825: writing smithi08477944-8 from 3137536 to 3670016 tid 4 2024-03-30T12:28:51.948 INFO:tasks.rados.rados.0.smithi084.stdout:1826: snap_remove snap 193 2024-03-30T12:28:52.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:52.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:52.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:51 smithi162 ceph-mon[83709]: osdmap e451: 8 total, 7 up, 8 in 2024-03-30T12:28:52.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:52.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:52.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5-activate[94124]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-30T12:28:52.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5-activate[94124]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-03-30T12:28:52.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:51 smithi162 bash[94110]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-30T12:28:52.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:51 smithi162 bash[94110]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-03-30T12:28:52.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:51 smithi162 bash[94110]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-03-30T12:28:52.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:51 smithi162 bash[94110]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-03-30T12:28:52.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:51 smithi162 bash[94110]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-5/block 2024-03-30T12:28:52.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:51 smithi162 bash[94110]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-30T12:28:52.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:51 smithi162 bash[94110]: --> ceph-volume raw activate successful for osd ID: 5 2024-03-30T12:28:52.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5-activate[94124]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-03-30T12:28:52.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5-activate[94124]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-03-30T12:28:52.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5-activate[94124]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-5/block 2024-03-30T12:28:52.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5-activate[94124]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-30T12:28:52.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5-activate[94124]: --> ceph-volume raw activate successful for osd ID: 5 2024-03-30T12:28:52.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:51 smithi162 podman[94110]: 2024-03-30 12:28:51.852155624 +0000 UTC m=+1.042096209 container died 680c892658ddd0d94c8646fd1ee477185b0b4a3311ab8cb2b4e7f4642998cf2c (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5-activate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T12:28:52.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:51.933+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:52.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:51.933+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:52.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:51.937+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:52.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:51.938+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:52.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:52.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:52.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:51 smithi084 ceph-mon[91810]: osdmap e451: 8 total, 7 up, 8 in 2024-03-30T12:28:52.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:52.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:52.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:52.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:52.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:51 smithi084 ceph-mon[89279]: osdmap e451: 8 total, 7 up, 8 in 2024-03-30T12:28:52.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:52.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:52.940 INFO:tasks.rados.rados.0.smithi084.stdout:1826: done (3 left) 2024-03-30T12:28:52.940 INFO:tasks.rados.rados.0.smithi084.stdout:1827: read oid 31 snap -1 2024-03-30T12:28:52.940 INFO:tasks.rados.rados.0.smithi084.stdout:1827: expect deleted 2024-03-30T12:28:52.940 INFO:tasks.rados.rados.0.smithi084.stdout:1823: finishing rollback tid 0 to smithi08477944-23 2024-03-30T12:28:52.940 INFO:tasks.rados.rados.0.smithi084.stdout:1823: finishing rollback tid 1 to smithi08477944-23 2024-03-30T12:28:52.940 INFO:tasks.rados.rados.0.smithi084.stdout:1823: finishing rollback tid 2 to smithi08477944-23 2024-03-30T12:28:52.940 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 825 (ObjNum 496 snap 155 seq_num 496) dirty exists 2024-03-30T12:28:52.941 INFO:tasks.rados.rados.0.smithi084.stdout:1825: finishing write tid 1 to smithi08477944-8 2024-03-30T12:28:52.941 INFO:tasks.rados.rados.0.smithi084.stdout:1825: finishing write tid 2 to smithi08477944-8 2024-03-30T12:28:52.941 INFO:tasks.rados.rados.0.smithi084.stdout:1825: finishing write tid 3 to smithi08477944-8 2024-03-30T12:28:52.941 INFO:tasks.rados.rados.0.smithi084.stdout:1825: finishing write tid 4 to smithi08477944-8 2024-03-30T12:28:52.941 INFO:tasks.rados.rados.0.smithi084.stdout:1828: read oid 29 snap -1 2024-03-30T12:28:52.941 INFO:tasks.rados.rados.0.smithi084.stdout:1828: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:28:52.941 INFO:tasks.rados.rados.0.smithi084.stdout:1823: done (4 left) 2024-03-30T12:28:52.941 INFO:tasks.rados.rados.0.smithi084.stdout:1829: read oid 39 snap -1 2024-03-30T12:28:52.941 INFO:tasks.rados.rados.0.smithi084.stdout:1829: expect (ObjNum 550 snap 186 seq_num 550) 2024-03-30T12:28:52.941 INFO:tasks.rados.rados.0.smithi084.stdout:1830: delete oid 33 current snap is 194 2024-03-30T12:28:52.941 INFO:tasks.rados.rados.0.smithi084.stdout:1825: finishing write tid 5 to smithi08477944-8 2024-03-30T12:28:52.941 INFO:tasks.rados.rados.0.smithi084.stdout:1825: finishing write tid 6 to smithi08477944-8 2024-03-30T12:28:52.941 INFO:tasks.rados.rados.0.smithi084.stdout:1825: oid 8 updating version 0 to 988 2024-03-30T12:28:52.941 INFO:tasks.rados.rados.0.smithi084.stdout:1825: oid 8 version 988 is already newer than 987 2024-03-30T12:28:52.941 INFO:tasks.rados.rados.0.smithi084.stdout:1825: oid 8 version 988 is already newer than 984 2024-03-30T12:28:52.942 INFO:tasks.rados.rados.0.smithi084.stdout:1825: oid 8 version 988 is already newer than 985 2024-03-30T12:28:52.942 INFO:tasks.rados.rados.0.smithi084.stdout:1825: oid 8 version 988 is already newer than 986 2024-03-30T12:28:52.942 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 988 (ObjNum 560 snap 194 seq_num 560) dirty exists 2024-03-30T12:28:52.942 INFO:tasks.rados.rados.0.smithi084.stdout:1825: left oid 8 (ObjNum 560 snap 194 seq_num 560) 2024-03-30T12:28:52.942 INFO:tasks.rados.rados.0.smithi084.stdout:1824: finishing copy_from racing read to smithi08477944-7 2024-03-30T12:28:52.942 INFO:tasks.rados.rados.0.smithi084.stdout:1824: finishing copy_from to smithi08477944-7 2024-03-30T12:28:52.942 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 903 (ObjNum 525 snap 171 seq_num 525) dirty exists 2024-03-30T12:28:52.942 INFO:tasks.rados.rados.0.smithi084.stdout:1828: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:28:52.944 INFO:tasks.rados.rados.0.smithi084.stdout:1824: done (5 left) 2024-03-30T12:28:52.944 INFO:tasks.rados.rados.0.smithi084.stdout:1825: done (4 left) 2024-03-30T12:28:52.944 INFO:tasks.rados.rados.0.smithi084.stdout:1827: done (3 left) 2024-03-30T12:28:52.944 INFO:tasks.rados.rados.0.smithi084.stdout:1828: done (2 left) 2024-03-30T12:28:52.944 INFO:tasks.rados.rados.0.smithi084.stdout:1830: done (1 left) 2024-03-30T12:28:52.944 INFO:tasks.rados.rados.0.smithi084.stdout:1831: delete oid 43 current snap is 194 2024-03-30T12:28:52.947 INFO:tasks.rados.rados.0.smithi084.stdout:1829: expect (ObjNum 550 snap 186 seq_num 550) 2024-03-30T12:28:53.005 INFO:tasks.rados.rados.0.smithi084.stdout:1829: done (1 left) 2024-03-30T12:28:53.005 INFO:tasks.rados.rados.0.smithi084.stdout:1831: done (0 left) 2024-03-30T12:28:53.005 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 194 2024-03-30T12:28:53.006 INFO:tasks.rados.rados.0.smithi084.stdout:1832: seq_num 563 ranges {2023424=638976,2662400=565248,3227648=794624,4022272=245760} 2024-03-30T12:28:53.021 INFO:tasks.rados.rados.0.smithi084.stdout:1832: writing smithi08477944-39 from 2023424 to 2662400 tid 1 2024-03-30T12:28:53.025 INFO:tasks.rados.rados.0.smithi084.stdout:1832: writing smithi08477944-39 from 2662400 to 3227648 tid 2 2024-03-30T12:28:53.030 INFO:tasks.rados.rados.0.smithi084.stdout:1832: writing smithi08477944-39 from 3227648 to 4022272 tid 3 2024-03-30T12:28:53.031 INFO:tasks.rados.rados.0.smithi084.stdout:1832: writing smithi08477944-39 from 4022272 to 4268032 tid 4 2024-03-30T12:28:53.031 INFO:tasks.rados.rados.0.smithi084.stdout:1832: finishing write tid 1 to smithi08477944-39 2024-03-30T12:28:53.031 INFO:tasks.rados.rados.0.smithi084.stdout:1832: finishing write tid 2 to smithi08477944-39 2024-03-30T12:28:53.031 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 194 2024-03-30T12:28:53.032 INFO:tasks.rados.rados.0.smithi084.stdout:1833: seq_num 564 ranges {0=655360,655360=442368,1097728=598016,1695744=565248} 2024-03-30T12:28:53.035 INFO:tasks.rados.rados.0.smithi084.stdout:1833: writing smithi08477944-41 from 0 to 655360 tid 1 2024-03-30T12:28:53.038 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:52 smithi162 podman[94256]: 2024-03-30 12:28:52.779379086 +0000 UTC m=+0.922165216 container remove 680c892658ddd0d94c8646fd1ee477185b0b4a3311ab8cb2b4e7f4642998cf2c (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5-activate, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T12:28:53.038 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:53 smithi162 podman[94315]: 2024-03-30 12:28:52.917275209 +0000 UTC m=+0.020923373 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:28:53.038 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:53.039 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:53.039 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:52 smithi162 ceph-mon[83709]: osdmap e452: 8 total, 7 up, 8 in 2024-03-30T12:28:53.039 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:53.039 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:53.039 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:53.039 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:53.039 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:52 smithi162 ceph-mon[83709]: pgmap v361: 121 pgs: 1 active+clean+snaptrim, 2 active+undersized+degraded+snaptrim_error, 10 active+undersized+degraded, 38 active+undersized, 66 active+clean, 4 active+clean+snaptrim_error; 289 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 2.1 MiB/s rd, 1.2 MiB/s wr, 3 op/s; 76/612 objects degraded (12.418%) 2024-03-30T12:28:53.039 INFO:tasks.rados.rados.0.smithi084.stdout:1833: writing smithi08477944-41 from 655360 to 1097728 tid 2 2024-03-30T12:28:53.041 INFO:tasks.rados.rados.0.smithi084.stdout:1833: writing smithi08477944-41 from 1097728 to 1695744 tid 3 2024-03-30T12:28:53.045 INFO:tasks.rados.rados.0.smithi084.stdout:1833: writing smithi08477944-41 from 1695744 to 2260992 tid 4 2024-03-30T12:28:53.045 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 194 2024-03-30T12:28:53.045 INFO:tasks.rados.rados.0.smithi084.stdout:1832: finishing write tid 3 to smithi08477944-39 2024-03-30T12:28:53.045 INFO:tasks.rados.rados.0.smithi084.stdout:1834: seq_num 565 ranges {5980160=671744,6651904=729088,7380992=753664,8134656=122880} 2024-03-30T12:28:53.081 INFO:tasks.rados.rados.0.smithi084.stdout:1834: writing smithi08477944-20 from 5980160 to 6651904 tid 1 2024-03-30T12:28:53.086 INFO:tasks.rados.rados.0.smithi084.stdout:1834: writing smithi08477944-20 from 6651904 to 7380992 tid 2 2024-03-30T12:28:53.090 INFO:tasks.rados.rados.0.smithi084.stdout:1834: writing smithi08477944-20 from 7380992 to 8134656 tid 3 2024-03-30T12:28:53.092 INFO:tasks.rados.rados.0.smithi084.stdout:1834: writing smithi08477944-20 from 8134656 to 8257536 tid 4 2024-03-30T12:28:53.092 INFO:tasks.rados.rados.0.smithi084.stdout:1835: setattr oid 19 current snap is 194 2024-03-30T12:28:53.092 INFO:tasks.rados.rados.0.smithi084.stdout:1832: finishing write tid 4 to smithi08477944-39 2024-03-30T12:28:53.092 INFO:tasks.rados.rados.0.smithi084.stdout:1832: finishing write tid 5 to smithi08477944-39 2024-03-30T12:28:53.092 INFO:tasks.rados.rados.0.smithi084.stdout:1832: finishing write tid 6 to smithi08477944-39 2024-03-30T12:28:53.092 INFO:tasks.rados.rados.0.smithi084.stdout:1832: oid 39 updating version 0 to 937 2024-03-30T12:28:53.092 INFO:tasks.rados.rados.0.smithi084.stdout:1832: oid 39 updating version 937 to 941 2024-03-30T12:28:53.093 INFO:tasks.rados.rados.0.smithi084.stdout:1832: oid 39 version 941 is already newer than 939 2024-03-30T12:28:53.093 INFO:tasks.rados.rados.0.smithi084.stdout:1832: oid 39 version 941 is already newer than 938 2024-03-30T12:28:53.093 INFO:tasks.rados.rados.0.smithi084.stdout:1832: oid 39 version 941 is already newer than 940 2024-03-30T12:28:53.093 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 941 (ObjNum 563 snap 194 seq_num 563) dirty exists 2024-03-30T12:28:53.093 INFO:tasks.rados.rados.0.smithi084.stdout:1832: left oid 39 (ObjNum 563 snap 194 seq_num 563) 2024-03-30T12:28:53.093 INFO:tasks.rados.rados.0.smithi084.stdout:1833: finishing write tid 1 to smithi08477944-41 2024-03-30T12:28:53.093 INFO:tasks.rados.rados.0.smithi084.stdout:1833: finishing write tid 2 to smithi08477944-41 2024-03-30T12:28:53.093 INFO:tasks.rados.rados.0.smithi084.stdout:1833: finishing write tid 3 to smithi08477944-41 2024-03-30T12:28:53.093 INFO:tasks.rados.rados.0.smithi084.stdout:1833: finishing write tid 4 to smithi08477944-41 2024-03-30T12:28:53.093 INFO:tasks.rados.rados.0.smithi084.stdout:1833: finishing write tid 5 to smithi08477944-41 2024-03-30T12:28:53.093 INFO:tasks.rados.rados.0.smithi084.stdout:1833: finishing write tid 6 to smithi08477944-41 2024-03-30T12:28:53.093 INFO:tasks.rados.rados.0.smithi084.stdout:1833: oid 41 updating version 0 to 930 2024-03-30T12:28:53.093 INFO:tasks.rados.rados.0.smithi084.stdout:1833: oid 41 updating version 930 to 931 2024-03-30T12:28:53.093 INFO:tasks.rados.rados.0.smithi084.stdout:1833: oid 41 updating version 931 to 932 2024-03-30T12:28:53.093 INFO:tasks.rados.rados.0.smithi084.stdout:1833: oid 41 version 932 is already newer than 929 2024-03-30T12:28:53.094 INFO:tasks.rados.rados.0.smithi084.stdout:1833: oid 41 updating version 932 to 933 2024-03-30T12:28:53.094 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 933 (ObjNum 564 snap 194 seq_num 564) dirty exists 2024-03-30T12:28:53.094 INFO:tasks.rados.rados.0.smithi084.stdout:1833: left oid 41 (ObjNum 564 snap 194 seq_num 564) 2024-03-30T12:28:53.094 INFO:tasks.rados.rados.0.smithi084.stdout:1834: finishing write tid 1 to smithi08477944-20 2024-03-30T12:28:53.094 INFO:tasks.rados.rados.0.smithi084.stdout:1834: finishing write tid 2 to smithi08477944-20 2024-03-30T12:28:53.094 INFO:tasks.rados.rados.0.smithi084.stdout:1832: done (3 left) 2024-03-30T12:28:53.094 INFO:tasks.rados.rados.0.smithi084.stdout:1833: done (2 left) 2024-03-30T12:28:53.094 INFO:tasks.rados.rados.0.smithi084.stdout:1836: delete oid 10 current snap is 194 2024-03-30T12:28:53.096 INFO:tasks.rados.rados.0.smithi084.stdout:1834: finishing write tid 3 to smithi08477944-20 2024-03-30T12:28:53.096 INFO:tasks.rados.rados.0.smithi084.stdout:1834: finishing write tid 4 to smithi08477944-20 2024-03-30T12:28:53.097 INFO:tasks.rados.rados.0.smithi084.stdout:1834: finishing write tid 5 to smithi08477944-20 2024-03-30T12:28:53.097 INFO:tasks.rados.rados.0.smithi084.stdout:1836: done (2 left) 2024-03-30T12:28:53.097 INFO:tasks.rados.rados.0.smithi084.stdout:1837: read oid 3 snap -1 2024-03-30T12:28:53.097 INFO:tasks.rados.rados.0.smithi084.stdout:1837: expect (ObjNum 498 snap 156 seq_num 498) 2024-03-30T12:28:53.097 INFO:tasks.rados.rados.0.smithi084.stdout:1838: read oid 28 snap 186 2024-03-30T12:28:53.097 INFO:tasks.rados.rados.0.smithi084.stdout:1838: expect (ObjNum 498 snap 156 seq_num 498) 2024-03-30T12:28:53.097 INFO:tasks.rados.rados.0.smithi084.stdout:1839: rmattr oid 4 current snap is 194 2024-03-30T12:28:53.097 INFO:tasks.rados.rados.0.smithi084.stdout:1839: done (4 left) 2024-03-30T12:28:53.097 INFO:tasks.rados.rados.0.smithi084.stdout:1840: snap_create 2024-03-30T12:28:53.098 INFO:tasks.rados.rados.0.smithi084.stdout:1834: finishing write tid 6 to smithi08477944-20 2024-03-30T12:28:53.098 INFO:tasks.rados.rados.0.smithi084.stdout:1834: oid 20 updating version 0 to 935 2024-03-30T12:28:53.098 INFO:tasks.rados.rados.0.smithi084.stdout:1834: oid 20 version 935 is already newer than 932 2024-03-30T12:28:53.098 INFO:tasks.rados.rados.0.smithi084.stdout:1834: oid 20 version 935 is already newer than 934 2024-03-30T12:28:53.098 INFO:tasks.rados.rados.0.smithi084.stdout:1834: oid 20 version 935 is already newer than 933 2024-03-30T12:28:53.098 INFO:tasks.rados.rados.0.smithi084.stdout:1834: oid 20 version 935 is already newer than 931 2024-03-30T12:28:53.098 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 935 (ObjNum 565 snap 194 seq_num 565) dirty exists 2024-03-30T12:28:53.098 INFO:tasks.rados.rados.0.smithi084.stdout:1834: left oid 20 (ObjNum 565 snap 194 seq_num 565) 2024-03-30T12:28:53.103 INFO:tasks.rados.rados.0.smithi084.stdout:1838: expect (ObjNum 498 snap 156 seq_num 498) 2024-03-30T12:28:53.134 INFO:tasks.rados.rados.0.smithi084.stdout:1837: expect (ObjNum 498 snap 156 seq_num 498) 2024-03-30T12:28:53.165 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 11071 (ObjNum 1429506826 snap 21994 seq_num 304) dirty exists 2024-03-30T12:28:53.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:52.947+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:53.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:52.948+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:53.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:52.946+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:53.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:52.946+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:53.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:52.946+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:53.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:52.946+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 100=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:53.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:53.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:53.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:52 smithi084 ceph-mon[89279]: osdmap e452: 8 total, 7 up, 8 in 2024-03-30T12:28:53.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:53.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:53.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:53.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:53.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:52 smithi084 ceph-mon[89279]: pgmap v361: 121 pgs: 1 active+clean+snaptrim, 2 active+undersized+degraded+snaptrim_error, 10 active+undersized+degraded, 38 active+undersized, 66 active+clean, 4 active+clean+snaptrim_error; 289 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 2.1 MiB/s rd, 1.2 MiB/s wr, 3 op/s; 76/612 objects degraded (12.418%) 2024-03-30T12:28:53.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:53.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:53.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:52 smithi084 ceph-mon[91810]: osdmap e452: 8 total, 7 up, 8 in 2024-03-30T12:28:53.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:53.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:53.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset d4=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:53.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:53.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:52 smithi084 ceph-mon[91810]: pgmap v361: 121 pgs: 1 active+clean+snaptrim, 2 active+undersized+degraded+snaptrim_error, 10 active+undersized+degraded, 38 active+undersized, 66 active+clean, 4 active+clean+snaptrim_error; 289 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 2.1 MiB/s rd, 1.2 MiB/s wr, 3 op/s; 76/612 objects degraded (12.418%) 2024-03-30T12:28:53.291 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:53 smithi162 podman[94315]: 2024-03-30 12:28:53.047136975 +0000 UTC m=+0.150785179 container create cd8795ac188ad1b560f666ebb382734ac15f32f34ade9745ef500522a5f471ac (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-03-30T12:28:53.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:53 smithi162 podman[94315]: 2024-03-30 12:28:53.300113542 +0000 UTC m=+0.403761704 container init cd8795ac188ad1b560f666ebb382734ac15f32f34ade9745ef500522a5f471ac (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2) 2024-03-30T12:28:53.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:53 smithi162 podman[94315]: 2024-03-30 12:28:53.303784646 +0000 UTC m=+0.407432797 container start cd8795ac188ad1b560f666ebb382734ac15f32f34ade9745ef500522a5f471ac (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-03-30T12:28:53.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:53 smithi162 ceph-osd[94334]: -- 172.21.15.162:0/140876866 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558ebed07680 con 0x558ebecd1400 2024-03-30T12:28:53.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:53 smithi162 bash[94315]: cd8795ac188ad1b560f666ebb382734ac15f32f34ade9745ef500522a5f471ac 2024-03-30T12:28:53.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:53 smithi162 systemd[1]: Started Ceph osd.5 for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:28:53.945 INFO:tasks.rados.rados.0.smithi084.stdout:1834: done (4 left) 2024-03-30T12:28:53.945 INFO:tasks.rados.rados.0.smithi084.stdout:1835: done (3 left) 2024-03-30T12:28:53.945 INFO:tasks.rados.rados.0.smithi084.stdout:1837: done (2 left) 2024-03-30T12:28:53.945 INFO:tasks.rados.rados.0.smithi084.stdout:1838: done (1 left) 2024-03-30T12:28:53.945 INFO:tasks.rados.rados.0.smithi084.stdout:1840: done (0 left) 2024-03-30T12:28:53.945 INFO:tasks.rados.rados.0.smithi084.stdout:1841: read oid 32 snap 189 2024-03-30T12:28:53.946 INFO:tasks.rados.rados.0.smithi084.stdout:1841: expect (ObjNum 280 snap 90 seq_num 280) 2024-03-30T12:28:53.946 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 46 current snap is 195 2024-03-30T12:28:53.946 INFO:tasks.rados.rados.0.smithi084.stdout:1842: seq_num 567 ranges {9715712=704512,10420224=499712,10919936=770048,11689984=335872} 2024-03-30T12:28:54.002 INFO:tasks.rados.rados.0.smithi084.stdout:1842: writing smithi08477944-46 from 9715712 to 10420224 tid 1 2024-03-30T12:28:54.004 INFO:tasks.rados.rados.0.smithi084.stdout:1842: writing smithi08477944-46 from 10420224 to 10919936 tid 2 2024-03-30T12:28:54.008 INFO:tasks.rados.rados.0.smithi084.stdout:1842: writing smithi08477944-46 from 10919936 to 11689984 tid 3 2024-03-30T12:28:54.011 INFO:tasks.rados.rados.0.smithi084.stdout:1842: writing smithi08477944-46 from 11689984 to 12025856 tid 4 2024-03-30T12:28:54.011 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 195 2024-03-30T12:28:54.011 INFO:tasks.rados.rados.0.smithi084.stdout:1843: seq_num 568 ranges {3366912=720896,4087808=786432,4874240=581632,5455872=237568} 2024-03-30T12:28:54.033 INFO:tasks.rados.rados.0.smithi084.stdout:1843: writing smithi08477944-5 from 3366912 to 4087808 tid 1 2024-03-30T12:28:54.037 INFO:tasks.rados.rados.0.smithi084.stdout:1843: writing smithi08477944-5 from 4087808 to 4874240 tid 2 2024-03-30T12:28:54.040 INFO:tasks.rados.rados.0.smithi084.stdout:1843: writing smithi08477944-5 from 4874240 to 5455872 tid 3 2024-03-30T12:28:54.042 INFO:tasks.rados.rados.0.smithi084.stdout:1843: writing smithi08477944-5 from 5455872 to 5693440 tid 4 2024-03-30T12:28:54.042 INFO:tasks.rados.rados.0.smithi084.stdout:1844: read oid 50 snap -1 2024-03-30T12:28:54.042 INFO:tasks.rados.rados.0.smithi084.stdout:1844: expect (ObjNum 534 snap 180 seq_num 534) 2024-03-30T12:28:54.042 INFO:tasks.rados.rados.0.smithi084.stdout:1845: read oid 26 snap -1 2024-03-30T12:28:54.042 INFO:tasks.rados.rados.0.smithi084.stdout:1845: expect (ObjNum 553 snap 186 seq_num 553) 2024-03-30T12:28:54.043 INFO:tasks.rados.rados.0.smithi084.stdout:1846: delete oid 42 current snap is 195 2024-03-30T12:28:54.043 INFO:tasks.rados.rados.0.smithi084.stdout:1841: expect (ObjNum 280 snap 90 seq_num 280) 2024-03-30T12:28:54.122 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:28:53.847+0000 7f832b7267c0 -1 Falling back to public interface 2024-03-30T12:28:54.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:53 smithi162 ceph-mon[83709]: osdmap e453: 8 total, 7 up, 8 in 2024-03-30T12:28:54.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:54.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 100=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:54.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:54.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:54.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:53 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:54.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:53 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:54.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:53 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:28:54.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:53.954+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:54.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:53.954+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:54.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:53.952+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 100=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:54.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:53.952+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:54.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:53 smithi084 ceph-mon[91810]: osdmap e453: 8 total, 7 up, 8 in 2024-03-30T12:28:54.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:54.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 100=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:54.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:54.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:54.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:53 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:54.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:53 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:54.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:53 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:28:54.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:53 smithi084 ceph-mon[89279]: osdmap e453: 8 total, 7 up, 8 in 2024-03-30T12:28:54.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:54.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 100=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:54.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:54.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:54.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:53 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:54.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:53 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:54.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:53 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:28:54.318 INFO:tasks.rados.rados.0.smithi084.stdout:1842: finishing write tid 1 to smithi08477944-46 2024-03-30T12:28:54.319 INFO:tasks.rados.rados.0.smithi084.stdout:1842: finishing write tid 2 to smithi08477944-46 2024-03-30T12:28:54.319 INFO:tasks.rados.rados.0.smithi084.stdout:1841: done (5 left) 2024-03-30T12:28:54.319 INFO:tasks.rados.rados.0.smithi084.stdout:1846: done (4 left) 2024-03-30T12:28:54.319 INFO:tasks.rados.rados.0.smithi084.stdout:1847: delete oid 13 current snap is 195 2024-03-30T12:28:54.319 INFO:tasks.rados.rados.0.smithi084.stdout:1842: finishing write tid 3 to smithi08477944-46 2024-03-30T12:28:54.319 INFO:tasks.rados.rados.0.smithi084.stdout:1842: finishing write tid 4 to smithi08477944-46 2024-03-30T12:28:54.319 INFO:tasks.rados.rados.0.smithi084.stdout:1842: finishing write tid 5 to smithi08477944-46 2024-03-30T12:28:54.319 INFO:tasks.rados.rados.0.smithi084.stdout:1842: finishing write tid 6 to smithi08477944-46 2024-03-30T12:28:54.319 INFO:tasks.rados.rados.0.smithi084.stdout:1842: oid 46 updating version 0 to 990 2024-03-30T12:28:54.319 INFO:tasks.rados.rados.0.smithi084.stdout:1842: oid 46 updating version 990 to 994 2024-03-30T12:28:54.319 INFO:tasks.rados.rados.0.smithi084.stdout:1842: oid 46 version 994 is already newer than 993 2024-03-30T12:28:54.320 INFO:tasks.rados.rados.0.smithi084.stdout:1842: oid 46 version 994 is already newer than 992 2024-03-30T12:28:54.320 INFO:tasks.rados.rados.0.smithi084.stdout:1842: oid 46 version 994 is already newer than 991 2024-03-30T12:28:54.320 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 994 (ObjNum 567 snap 195 seq_num 567) dirty exists 2024-03-30T12:28:54.320 INFO:tasks.rados.rados.0.smithi084.stdout:1842: left oid 46 (ObjNum 567 snap 195 seq_num 567) 2024-03-30T12:28:54.320 INFO:tasks.rados.rados.0.smithi084.stdout:1843: finishing write tid 1 to smithi08477944-5 2024-03-30T12:28:54.320 INFO:tasks.rados.rados.0.smithi084.stdout:1843: finishing write tid 2 to smithi08477944-5 2024-03-30T12:28:54.320 INFO:tasks.rados.rados.0.smithi084.stdout:1843: finishing write tid 3 to smithi08477944-5 2024-03-30T12:28:54.320 INFO:tasks.rados.rados.0.smithi084.stdout:1843: finishing write tid 4 to smithi08477944-5 2024-03-30T12:28:54.320 INFO:tasks.rados.rados.0.smithi084.stdout:1843: finishing write tid 5 to smithi08477944-5 2024-03-30T12:28:54.320 INFO:tasks.rados.rados.0.smithi084.stdout:1843: finishing write tid 6 to smithi08477944-5 2024-03-30T12:28:54.320 INFO:tasks.rados.rados.0.smithi084.stdout:1843: oid 5 updating version 0 to 916 2024-03-30T12:28:54.320 INFO:tasks.rados.rados.0.smithi084.stdout:1843: oid 5 updating version 916 to 919 2024-03-30T12:28:54.320 INFO:tasks.rados.rados.0.smithi084.stdout:1843: oid 5 version 919 is already newer than 917 2024-03-30T12:28:54.321 INFO:tasks.rados.rados.0.smithi084.stdout:1843: oid 5 version 919 is already newer than 915 2024-03-30T12:28:54.321 INFO:tasks.rados.rados.0.smithi084.stdout:1843: oid 5 version 919 is already newer than 918 2024-03-30T12:28:54.321 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 919 (ObjNum 568 snap 195 seq_num 568) dirty exists 2024-03-30T12:28:54.321 INFO:tasks.rados.rados.0.smithi084.stdout:1843: left oid 5 (ObjNum 568 snap 195 seq_num 568) 2024-03-30T12:28:54.321 INFO:tasks.rados.rados.0.smithi084.stdout:1844: expect (ObjNum 534 snap 180 seq_num 534) 2024-03-30T12:28:54.423 INFO:tasks.rados.rados.0.smithi084.stdout:1845: expect (ObjNum 553 snap 186 seq_num 553) 2024-03-30T12:28:54.477 INFO:tasks.rados.rados.0.smithi084.stdout:1842: done (4 left) 2024-03-30T12:28:54.477 INFO:tasks.rados.rados.0.smithi084.stdout:1843: done (3 left) 2024-03-30T12:28:54.478 INFO:tasks.rados.rados.0.smithi084.stdout:1844: done (2 left) 2024-03-30T12:28:54.478 INFO:tasks.rados.rados.0.smithi084.stdout:1845: done (1 left) 2024-03-30T12:28:54.478 INFO:tasks.rados.rados.0.smithi084.stdout:1847: done (0 left) 2024-03-30T12:28:54.478 INFO:tasks.rados.rados.0.smithi084.stdout:1848: snap_create 2024-03-30T12:28:54.949 INFO:tasks.rados.rados.0.smithi084.stdout:1848: done (0 left) 2024-03-30T12:28:54.949 INFO:tasks.rados.rados.0.smithi084.stdout:1849: delete oid 1 current snap is 196 2024-03-30T12:28:54.954 INFO:tasks.rados.rados.0.smithi084.stdout:1849: done (0 left) 2024-03-30T12:28:54.954 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 196 2024-03-30T12:28:54.954 INFO:tasks.rados.rados.0.smithi084.stdout:1850: seq_num 572 ranges {4218880=786432,5005312=770048,5775360=557056,6332416=278528} 2024-03-30T12:28:54.982 INFO:tasks.rados.rados.0.smithi084.stdout:1850: writing smithi08477944-40 from 4218880 to 5005312 tid 1 2024-03-30T12:28:54.987 INFO:tasks.rados.rados.0.smithi084.stdout:1850: writing smithi08477944-40 from 5005312 to 5775360 tid 2 2024-03-30T12:28:54.990 INFO:tasks.rados.rados.0.smithi084.stdout:1850: writing smithi08477944-40 from 5775360 to 6332416 tid 3 2024-03-30T12:28:54.993 INFO:tasks.rados.rados.0.smithi084.stdout:1850: writing smithi08477944-40 from 6332416 to 6610944 tid 4 2024-03-30T12:28:54.993 INFO:tasks.rados.rados.0.smithi084.stdout:1851: copy_from oid 26 from oid 4 current snap is 196 2024-03-30T12:28:54.993 INFO:tasks.rados.rados.0.smithi084.stdout:1850: finishing write tid 1 to smithi08477944-40 2024-03-30T12:28:54.993 INFO:tasks.rados.rados.0.smithi084.stdout:1850: finishing write tid 2 to smithi08477944-40 2024-03-30T12:28:54.993 INFO:tasks.rados.rados.0.smithi084.stdout:1852: snap_create 2024-03-30T12:28:54.996 INFO:tasks.rados.rados.0.smithi084.stdout:1850: finishing write tid 3 to smithi08477944-40 2024-03-30T12:28:54.996 INFO:tasks.rados.rados.0.smithi084.stdout:1850: finishing write tid 4 to smithi08477944-40 2024-03-30T12:28:54.996 INFO:tasks.rados.rados.0.smithi084.stdout:1850: finishing write tid 5 to smithi08477944-40 2024-03-30T12:28:54.998 INFO:tasks.rados.rados.0.smithi084.stdout:1850: finishing write tid 6 to smithi08477944-40 2024-03-30T12:28:54.998 INFO:tasks.rados.rados.0.smithi084.stdout:1850: oid 40 updating version 0 to 939 2024-03-30T12:28:54.998 INFO:tasks.rados.rados.0.smithi084.stdout:1850: oid 40 updating version 939 to 941 2024-03-30T12:28:54.998 INFO:tasks.rados.rados.0.smithi084.stdout:1850: oid 40 version 941 is already newer than 940 2024-03-30T12:28:54.998 INFO:tasks.rados.rados.0.smithi084.stdout:1850: oid 40 version 941 is already newer than 938 2024-03-30T12:28:54.998 INFO:tasks.rados.rados.0.smithi084.stdout:1850: oid 40 version 941 is already newer than 937 2024-03-30T12:28:54.998 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 941 (ObjNum 572 snap 196 seq_num 572) dirty exists 2024-03-30T12:28:54.999 INFO:tasks.rados.rados.0.smithi084.stdout:1850: left oid 40 (ObjNum 572 snap 196 seq_num 572) 2024-03-30T12:28:54.999 INFO:tasks.rados.rados.0.smithi084.stdout:1851: finishing copy_from racing read to smithi08477944-26 2024-03-30T12:28:54.999 INFO:tasks.rados.rados.0.smithi084.stdout:1851: finishing copy_from to smithi08477944-26 2024-03-30T12:28:54.999 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 673 (ObjNum 475 snap 150 seq_num 475) dirty exists 2024-03-30T12:28:55.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:54.957+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:55.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:54.957+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:55.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 100=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:55.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:55.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:54 smithi084 ceph-mon[89279]: osdmap e454: 8 total, 7 up, 8 in 2024-03-30T12:28:55.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:55.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:55.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:54 smithi084 ceph-mon[89279]: Health check update: Degraded data redundancy: 76/612 objects degraded (12.418%), 12 pgs degraded (PG_DEGRADED) 2024-03-30T12:28:55.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:54 smithi084 ceph-mon[89279]: pgmap v364: 121 pgs: 1 active+clean+snaptrim, 2 active+undersized+degraded+snaptrim_error, 10 active+undersized+degraded, 38 active+undersized, 66 active+clean, 4 active+clean+snaptrim_error; 306 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 11 MiB/s rd, 5.5 MiB/s wr, 13 op/s; 77/621 objects degraded (12.399%) 2024-03-30T12:28:55.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 100=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:55.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:55.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:54 smithi084 ceph-mon[91810]: osdmap e454: 8 total, 7 up, 8 in 2024-03-30T12:28:55.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:55.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:55.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:54 smithi084 ceph-mon[91810]: Health check update: Degraded data redundancy: 76/612 objects degraded (12.418%), 12 pgs degraded (PG_DEGRADED) 2024-03-30T12:28:55.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:54 smithi084 ceph-mon[91810]: pgmap v364: 121 pgs: 1 active+clean+snaptrim, 2 active+undersized+degraded+snaptrim_error, 10 active+undersized+degraded, 38 active+undersized, 66 active+clean, 4 active+clean+snaptrim_error; 306 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 11 MiB/s rd, 5.5 MiB/s wr, 13 op/s; 77/621 objects degraded (12.399%) 2024-03-30T12:28:55.257 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:54.954+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:55.257 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:54.954+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:55.257 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:54.955+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:55.257 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:54.955+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 100=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:55.367 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 100=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:55.367 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:55.367 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:54 smithi162 ceph-mon[83709]: osdmap e454: 8 total, 7 up, 8 in 2024-03-30T12:28:55.368 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:55.368 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:55.368 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:54 smithi162 ceph-mon[83709]: Health check update: Degraded data redundancy: 76/612 objects degraded (12.418%), 12 pgs degraded (PG_DEGRADED) 2024-03-30T12:28:55.368 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:54 smithi162 ceph-mon[83709]: pgmap v364: 121 pgs: 1 active+clean+snaptrim, 2 active+undersized+degraded+snaptrim_error, 10 active+undersized+degraded, 38 active+undersized, 66 active+clean, 4 active+clean+snaptrim_error; 306 MiB data, 4.8 GiB used, 710 GiB / 715 GiB avail; 11 MiB/s rd, 5.5 MiB/s wr, 13 op/s; 77/621 objects degraded (12.399%) 2024-03-30T12:28:55.958 INFO:tasks.rados.rados.0.smithi084.stdout:1850: done (2 left) 2024-03-30T12:28:55.958 INFO:tasks.rados.rados.0.smithi084.stdout:1851: done (1 left) 2024-03-30T12:28:55.958 INFO:tasks.rados.rados.0.smithi084.stdout:1852: done (0 left) 2024-03-30T12:28:55.958 INFO:tasks.rados.rados.0.smithi084.stdout:1853: snap_remove snap 186 2024-03-30T12:28:56.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:55.964+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:56.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:55.964+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:56.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:56.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 100=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:56.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:56.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:56.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:55 smithi084 ceph-mon[89279]: osdmap e455: 8 total, 7 up, 8 in 2024-03-30T12:28:56.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 100=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:55 smithi084 ceph-mon[91810]: osdmap e455: 8 total, 7 up, 8 in 2024-03-30T12:28:56.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:55.962+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 100=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:56.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:55.963+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:56.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:56.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 100=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:56.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:56.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:56.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:55 smithi162 ceph-mon[83709]: osdmap e455: 8 total, 7 up, 8 in 2024-03-30T12:28:56.962 INFO:tasks.rados.rados.0.smithi084.stdout:1853: done (0 left) 2024-03-30T12:28:56.962 INFO:tasks.rados.rados.0.smithi084.stdout:1854: delete oid 21 current snap is 197 2024-03-30T12:28:56.969 INFO:tasks.rados.rados.0.smithi084.stdout:1854: done (0 left) 2024-03-30T12:28:56.969 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 197 2024-03-30T12:28:56.969 INFO:tasks.rados.rados.0.smithi084.stdout:1855: seq_num 574 ranges {2850816=16384} 2024-03-30T12:28:56.985 INFO:tasks.rados.rados.0.smithi084.stdout:1855: writing smithi08477944-23 from 2850816 to 2867200 tid 1 2024-03-30T12:28:56.985 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 197 2024-03-30T12:28:56.985 INFO:tasks.rados.rados.0.smithi084.stdout:1856: seq_num 575 ranges {0=32768} 2024-03-30T12:28:56.986 INFO:tasks.rados.rados.0.smithi084.stdout:1856: writing smithi08477944-43 from 0 to 32768 tid 1 2024-03-30T12:28:56.986 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 197 2024-03-30T12:28:56.986 INFO:tasks.rados.rados.0.smithi084.stdout:1857: seq_num 576 ranges {0=49152} 2024-03-30T12:28:56.986 INFO:tasks.rados.rados.0.smithi084.stdout:1857: writing smithi08477944-48 from 0 to 49152 tid 1 2024-03-30T12:28:56.986 INFO:tasks.rados.rados.0.smithi084.stdout:1858: read oid 10 snap -1 2024-03-30T12:28:56.986 INFO:tasks.rados.rados.0.smithi084.stdout:1858: expect deleted 2024-03-30T12:28:56.986 INFO:tasks.rados.rados.0.smithi084.stdout:1859: snap_remove snap 189 2024-03-30T12:28:57.018 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-03-30T12:28:57.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:56.971+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:57.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:56.971+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:57.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:56.968+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:57.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:56.968+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:57.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:56.968+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:57.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:56.968+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 100=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:57.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 100=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:57.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:57.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:56 smithi084 ceph-mon[91810]: osdmap e456: 8 total, 7 up, 8 in 2024-03-30T12:28:57.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:57.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:57.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:56 smithi084 ceph-mon[91810]: pgmap v367: 121 pgs: 1 active+clean+snaptrim, 2 active+undersized+degraded+snaptrim_error, 10 active+undersized+degraded, 38 active+undersized, 66 active+clean, 4 active+clean+snaptrim_error; 311 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 14 MiB/s rd, 5.4 MiB/s wr, 15 op/s; 79/633 objects degraded (12.480%) 2024-03-30T12:28:57.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 100=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:57.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:57.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:56 smithi084 ceph-mon[89279]: osdmap e456: 8 total, 7 up, 8 in 2024-03-30T12:28:57.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:57.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:57.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:56 smithi084 ceph-mon[89279]: pgmap v367: 121 pgs: 1 active+clean+snaptrim, 2 active+undersized+degraded+snaptrim_error, 10 active+undersized+degraded, 38 active+undersized, 66 active+clean, 4 active+clean+snaptrim_error; 311 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 14 MiB/s rd, 5.4 MiB/s wr, 15 op/s; 79/633 objects degraded (12.480%) 2024-03-30T12:28:57.347 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T12:28:57.348 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (8m) 60s ago 9m 25.3M - 0.25.0 c8568f914cd2 6765ce007f39 2024-03-30T12:28:57.348 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi162 *:3000 running (8m) 25s ago 8m 90.5M - 9.4.7 954c08fa6188 ff2ec7518619 2024-03-30T12:28:57.348 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (10m) 60s ago 10m 15.1M - 18.2.2-1051-gf14b5682 c8fb09e16a7d a9c2e74ca2a3 2024-03-30T12:28:57.348 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi162 running (10m) 25s ago 10m 21.3M - 18.2.2-1051-gf14b5682 c8fb09e16a7d ee1770ef5edd 2024-03-30T12:28:57.348 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi162 *:8443,9283,8765 running (4m) 25s ago 13m 451M - 19.0.0-1864-g5dc2ea30 548196a1a838 eec968f3fcc6 2024-03-30T12:28:57.348 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (5m) 60s ago 15m 512M - 19.0.0-1864-g5dc2ea30 548196a1a838 9a2aba19dffc 2024-03-30T12:28:57.348 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (4m) 60s ago 15m 55.0M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 a0811f2ae47d 2024-03-30T12:28:57.348 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi162 running (3m) 25s ago 13m 46.2M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 149ae6649e0c 2024-03-30T12:28:57.348 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (3m) 60s ago 13m 47.4M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 f79eca93cddd 2024-03-30T12:28:57.348 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (8m) 60s ago 8m 16.9M - 1.5.0 0da6a335fe13 66844bed39e8 2024-03-30T12:28:57.348 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi162 *:9100 running (8m) 25s ago 8m 15.7M - 1.5.0 0da6a335fe13 3d6e28b2348d 2024-03-30T12:28:57.348 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (2m) 60s ago 13m 182M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 c91eea4f8484 2024-03-30T12:28:57.348 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (2m) 60s ago 12m 109M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 7518832f6b4a 2024-03-30T12:28:57.348 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (98s) 60s ago 12m 123M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 647dd862762d 2024-03-30T12:28:57.349 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (64s) 60s ago 11m 15.1M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 c088a701b71b 2024-03-30T12:28:57.349 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi162 running (29s) 25s ago 11m 11.8M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 4197b37d2bb8 2024-03-30T12:28:57.349 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi162 starting - - - 2480M 2024-03-30T12:28:57.349 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi162 running (10m) 25s ago 10m 179M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 656a733e8b7a 2024-03-30T12:28:57.349 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi162 running (10m) 25s ago 10m 224M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d e3246b3bc88b 2024-03-30T12:28:57.349 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi162 *:9095 running (4m) 25s ago 9m 55.9M - 2.43.0 a07b618ecd1d bd7d323e4b47 2024-03-30T12:28:57.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 100=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:57.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:57.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:56 smithi162 ceph-mon[83709]: osdmap e456: 8 total, 7 up, 8 in 2024-03-30T12:28:57.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:57.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:57.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:56 smithi162 ceph-mon[83709]: pgmap v367: 121 pgs: 1 active+clean+snaptrim, 2 active+undersized+degraded+snaptrim_error, 10 active+undersized+degraded, 38 active+undersized, 66 active+clean, 4 active+clean+snaptrim_error; 311 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 14 MiB/s rd, 5.4 MiB/s wr, 15 op/s; 79/633 objects degraded (12.480%) 2024-03-30T12:28:57.804 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-30T12:28:57.804 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-03-30T12:28:57.804 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 3 2024-03-30T12:28:57.804 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:28:57.804 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-03-30T12:28:57.804 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 2 2024-03-30T12:28:57.804 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:28:57.804 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-03-30T12:28:57.804 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 2, 2024-03-30T12:28:57.805 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 5 2024-03-30T12:28:57.805 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:28:57.805 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-03-30T12:28:57.805 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 2 2024-03-30T12:28:57.805 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:28:57.805 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-03-30T12:28:57.805 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 4, 2024-03-30T12:28:57.805 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 10 2024-03-30T12:28:57.805 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-30T12:28:57.805 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-30T12:28:57.965 INFO:tasks.rados.rados.0.smithi084.stdout:1857: finishing write tid 1 to smithi08477944-48 2024-03-30T12:28:57.966 INFO:tasks.rados.rados.0.smithi084.stdout:1855: finishing write tid 1 to smithi08477944-23 2024-03-30T12:28:57.966 INFO:tasks.rados.rados.0.smithi084.stdout:1857: finishing write tid 2 to smithi08477944-48 2024-03-30T12:28:57.966 INFO:tasks.rados.rados.0.smithi084.stdout:1855: finishing write tid 2 to smithi08477944-23 2024-03-30T12:28:57.966 INFO:tasks.rados.rados.0.smithi084.stdout:1855: finishing write tid 3 to smithi08477944-23 2024-03-30T12:28:57.966 INFO:tasks.rados.rados.0.smithi084.stdout:1855: oid 23 updating version 0 to 827 2024-03-30T12:28:57.966 INFO:tasks.rados.rados.0.smithi084.stdout:1855: oid 23 version 827 is already newer than 826 2024-03-30T12:28:57.966 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 827 (ObjNum 574 snap 197 seq_num 574) dirty exists 2024-03-30T12:28:57.966 INFO:tasks.rados.rados.0.smithi084.stdout:1855: left oid 23 (ObjNum 574 snap 197 seq_num 574) 2024-03-30T12:28:57.966 INFO:tasks.rados.rados.0.smithi084.stdout:1856: finishing write tid 1 to smithi08477944-43 2024-03-30T12:28:57.966 INFO:tasks.rados.rados.0.smithi084.stdout:1856: finishing write tid 2 to smithi08477944-43 2024-03-30T12:28:57.966 INFO:tasks.rados.rados.0.smithi084.stdout:1857: finishing write tid 3 to smithi08477944-48 2024-03-30T12:28:57.966 INFO:tasks.rados.rados.0.smithi084.stdout:1857: oid 48 updating version 0 to 899 2024-03-30T12:28:57.966 INFO:tasks.rados.rados.0.smithi084.stdout:1857: oid 48 version 899 is already newer than 898 2024-03-30T12:28:57.967 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 899 (ObjNum 576 snap 197 seq_num 576) dirty exists 2024-03-30T12:28:57.967 INFO:tasks.rados.rados.0.smithi084.stdout:1857: left oid 48 (ObjNum 576 snap 197 seq_num 576) 2024-03-30T12:28:57.967 INFO:tasks.rados.rados.0.smithi084.stdout:1856: finishing write tid 3 to smithi08477944-43 2024-03-30T12:28:57.967 INFO:tasks.rados.rados.0.smithi084.stdout:1856: oid 43 updating version 0 to 12888 2024-03-30T12:28:57.967 INFO:tasks.rados.rados.0.smithi084.stdout:1856: oid 43 updating version 12888 to 12889 2024-03-30T12:28:57.967 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 12889 (ObjNum 575 snap 197 seq_num 575) dirty exists 2024-03-30T12:28:57.967 INFO:tasks.rados.rados.0.smithi084.stdout:1856: left oid 43 (ObjNum 575 snap 197 seq_num 575) 2024-03-30T12:28:57.967 INFO:tasks.rados.rados.0.smithi084.stdout:1855: done (4 left) 2024-03-30T12:28:57.967 INFO:tasks.rados.rados.0.smithi084.stdout:1856: done (3 left) 2024-03-30T12:28:57.967 INFO:tasks.rados.rados.0.smithi084.stdout:1857: done (2 left) 2024-03-30T12:28:57.967 INFO:tasks.rados.rados.0.smithi084.stdout:1858: done (1 left) 2024-03-30T12:28:57.967 INFO:tasks.rados.rados.0.smithi084.stdout:1859: done (0 left) 2024-03-30T12:28:57.967 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 197 2024-03-30T12:28:57.967 INFO:tasks.rados.rados.0.smithi084.stdout:1860: seq_num 577 ranges {8601600=65536} 2024-03-30T12:28:58.013 INFO:tasks.rados.rados.0.smithi084.stdout:1860: writing smithi08477944-22 from 8601600 to 8667136 tid 1 2024-03-30T12:28:58.013 INFO:tasks.rados.rados.0.smithi084.stdout:1861: read oid 40 snap 166 2024-03-30T12:28:58.013 INFO:tasks.rados.rados.0.smithi084.stdout:1861: expect (ObjNum 471 snap 149 seq_num 471) 2024-03-30T12:28:58.013 INFO:tasks.rados.rados.0.smithi084.stdout:1862: rollback oid 43 current snap is 197 2024-03-30T12:28:58.014 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 43 to 172 2024-03-30T12:28:58.014 INFO:tasks.rados.rados.0.smithi084.stdout:1863: delete oid 7 current snap is 197 2024-03-30T12:28:58.018 INFO:tasks.rados.rados.0.smithi084.stdout:1860: finishing write tid 1 to smithi08477944-22 2024-03-30T12:28:58.021 INFO:tasks.rados.rados.0.smithi084.stdout:1860: finishing write tid 2 to smithi08477944-22 2024-03-30T12:28:58.023 INFO:tasks.rados.rados.0.smithi084.stdout:1860: finishing write tid 3 to smithi08477944-22 2024-03-30T12:28:58.023 INFO:tasks.rados.rados.0.smithi084.stdout:1860: oid 22 updating version 0 to 998 2024-03-30T12:28:58.023 INFO:tasks.rados.rados.0.smithi084.stdout:1860: oid 22 updating version 998 to 999 2024-03-30T12:28:58.023 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 999 (ObjNum 577 snap 197 seq_num 577) dirty exists 2024-03-30T12:28:58.023 INFO:tasks.rados.rados.0.smithi084.stdout:1860: left oid 22 (ObjNum 577 snap 197 seq_num 577) 2024-03-30T12:28:58.029 INFO:tasks.rados.rados.0.smithi084.stdout:1862: finishing rollback tid 0 to smithi08477944-43 2024-03-30T12:28:58.029 INFO:tasks.rados.rados.0.smithi084.stdout:1862: finishing rollback tid 1 to smithi08477944-43 2024-03-30T12:28:58.029 INFO:tasks.rados.rados.0.smithi084.stdout:1862: finishing rollback tid 2 to smithi08477944-43 2024-03-30T12:28:58.029 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 13336 (ObjNum 519 snap 167 seq_num 519) dirty exists 2024-03-30T12:28:58.037 INFO:tasks.rados.rados.0.smithi084.stdout:1860: done (3 left) 2024-03-30T12:28:58.037 INFO:tasks.rados.rados.0.smithi084.stdout:1862: done (2 left) 2024-03-30T12:28:58.038 INFO:tasks.rados.rados.0.smithi084.stdout:1863: done (1 left) 2024-03-30T12:28:58.038 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 197 2024-03-30T12:28:58.038 INFO:tasks.rados.rados.0.smithi084.stdout:1864: seq_num 579 ranges {0=98304} 2024-03-30T12:28:58.038 INFO:tasks.rados.rados.0.smithi084.stdout:1864: writing smithi08477944-21 from 0 to 98304 tid 1 2024-03-30T12:28:58.038 INFO:tasks.rados.rados.0.smithi084.stdout:1865: snap_create 2024-03-30T12:28:58.045 INFO:tasks.rados.rados.0.smithi084.stdout:1864: finishing write tid 1 to smithi08477944-21 2024-03-30T12:28:58.045 INFO:tasks.rados.rados.0.smithi084.stdout:1864: finishing write tid 2 to smithi08477944-21 2024-03-30T12:28:58.049 INFO:tasks.rados.rados.0.smithi084.stdout:1864: finishing write tid 3 to smithi08477944-21 2024-03-30T12:28:58.049 INFO:tasks.rados.rados.0.smithi084.stdout:1864: oid 21 updating version 0 to 5720 2024-03-30T12:28:58.049 INFO:tasks.rados.rados.0.smithi084.stdout:1864: oid 21 updating version 5720 to 5721 2024-03-30T12:28:58.049 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 5721 (ObjNum 579 snap 197 seq_num 579) dirty exists 2024-03-30T12:28:58.049 INFO:tasks.rados.rados.0.smithi084.stdout:1864: left oid 21 (ObjNum 579 snap 197 seq_num 579) 2024-03-30T12:28:58.050 INFO:tasks.rados.rados.0.smithi084.stdout:1861: expect (ObjNum 471 snap 149 seq_num 471) 2024-03-30T12:28:58.071 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:58.071 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 100=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:58.071 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:57 smithi162 ceph-mon[83709]: osdmap e457: 8 total, 7 up, 8 in 2024-03-30T12:28:58.071 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:58.071 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:58.071 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:57 smithi162 ceph-mon[83709]: from='client.34323 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:28:58.071 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:57 smithi162 ceph-mon[83709]: from='client.44264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:28:58.071 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:57 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/2452833659' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:28:58.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:57.977+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:58.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:57.977+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:58.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:57.972+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 100=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:58.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:57.972+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:58.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:58.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 100=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:58.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:57 smithi084 ceph-mon[91810]: osdmap e457: 8 total, 7 up, 8 in 2024-03-30T12:28:58.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:58.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:58.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:57 smithi084 ceph-mon[91810]: from='client.34323 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:28:58.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:57 smithi084 ceph-mon[91810]: from='client.44264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:28:58.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:57 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/2452833659' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:28:58.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:58.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 100=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:58.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:57 smithi084 ceph-mon[89279]: osdmap e457: 8 total, 7 up, 8 in 2024-03-30T12:28:58.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:58.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:58.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:57 smithi084 ceph-mon[89279]: from='client.34323 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:28:58.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:57 smithi084 ceph-mon[89279]: from='client.44264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:28:58.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:57 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/2452833659' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:28:58.980 INFO:tasks.rados.rados.0.smithi084.stdout:1861: done (2 left) 2024-03-30T12:28:58.980 INFO:tasks.rados.rados.0.smithi084.stdout:1864: done (1 left) 2024-03-30T12:28:58.980 INFO:tasks.rados.rados.0.smithi084.stdout:1865: done (0 left) 2024-03-30T12:28:58.980 INFO:tasks.rados.rados.0.smithi084.stdout:1866: read oid 39 snap 166 2024-03-30T12:28:58.980 INFO:tasks.rados.rados.0.smithi084.stdout:1866: expect deleted 2024-03-30T12:28:58.980 INFO:tasks.rados.rados.0.smithi084.stdout:1867: snap_remove snap 195 2024-03-30T12:28:59.227 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:58.993+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:59.227 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:58.993+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:59.228 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 100=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:59.228 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:59.228 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:58 smithi084 ceph-mon[91810]: osdmap e458: 8 total, 7 up, 8 in 2024-03-30T12:28:59.228 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:59.228 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:59.228 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:58 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:59.228 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:58 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:59.228 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:58 smithi084 ceph-mon[91810]: pgmap v370: 121 pgs: 1 active+clean+snaptrim, 2 active+undersized+degraded+snaptrim_error, 10 active+undersized+degraded, 38 active+undersized, 66 active+clean, 4 active+clean+snaptrim_error; 313 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 15 MiB/s rd, 1.7 MiB/s wr, 16 op/s; 80/645 objects degraded (12.403%) 2024-03-30T12:28:59.228 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 100=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:59.229 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:59.229 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:58 smithi084 ceph-mon[89279]: osdmap e458: 8 total, 7 up, 8 in 2024-03-30T12:28:59.229 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:59.229 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:59.229 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:58 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:59.229 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:58 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:59.229 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:58 smithi084 ceph-mon[89279]: pgmap v370: 121 pgs: 1 active+clean+snaptrim, 2 active+undersized+degraded+snaptrim_error, 10 active+undersized+degraded, 38 active+undersized, 66 active+clean, 4 active+clean+snaptrim_error; 313 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 15 MiB/s rd, 1.7 MiB/s wr, 16 op/s; 80/645 objects degraded (12.403%) 2024-03-30T12:28:59.369 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:28:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:28:59.171+0000 7f832b7267c0 -1 osd.5 445 log_to_monitors true 2024-03-30T12:28:59.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 100=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:59.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:59.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:58 smithi162 ceph-mon[83709]: osdmap e458: 8 total, 7 up, 8 in 2024-03-30T12:28:59.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:28:59.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:28:59.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:58 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:59.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:58 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:28:59.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:58 smithi162 ceph-mon[83709]: pgmap v370: 121 pgs: 1 active+clean+snaptrim, 2 active+undersized+degraded+snaptrim_error, 10 active+undersized+degraded, 38 active+undersized, 66 active+clean, 4 active+clean+snaptrim_error; 313 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 15 MiB/s rd, 1.7 MiB/s wr, 16 op/s; 80/645 objects degraded (12.403%) 2024-03-30T12:28:59.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:28:59] "GET /metrics HTTP/1.1" 200 36257 "" "Prometheus/2.43.0" 2024-03-30T12:28:59.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:59.235+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:59.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:59.235+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:28:59.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:59.235+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:28:59.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:59.235+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:28:59.978 INFO:tasks.rados.rados.0.smithi084.stdout:1867: done (1 left) 2024-03-30T12:28:59.978 INFO:tasks.rados.rados.0.smithi084.stdout:1868: read oid 22 snap -1 2024-03-30T12:28:59.978 INFO:tasks.rados.rados.0.smithi084.stdout:1868: expect (ObjNum 577 snap 197 seq_num 577) 2024-03-30T12:28:59.978 INFO:tasks.rados.rados.0.smithi084.stdout:1869: read oid 25 snap 184 2024-03-30T12:28:59.978 INFO:tasks.rados.rados.0.smithi084.stdout:1869: expect (ObjNum 525 snap 171 seq_num 525) 2024-03-30T12:28:59.978 INFO:tasks.rados.rados.0.smithi084.stdout:1870: rollback oid 43 current snap is 198 2024-03-30T12:28:59.978 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 43 to 194 2024-03-30T12:28:59.978 INFO:tasks.rados.rados.0.smithi084.stdout:1866: done (3 left) 2024-03-30T12:28:59.978 INFO:tasks.rados.rados.0.smithi084.stdout:1871: delete oid 29 current snap is 198 2024-03-30T12:28:59.988 INFO:tasks.rados.rados.0.smithi084.stdout:1871: done (3 left) 2024-03-30T12:28:59.988 INFO:tasks.rados.rados.0.smithi084.stdout:1872: rollback oid 2 current snap is 198 2024-03-30T12:28:59.988 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 2 to 197 2024-03-30T12:28:59.988 INFO:tasks.rados.rados.0.smithi084.stdout:1873: copy_from oid 26 from oid 7 current snap is 198 2024-03-30T12:28:59.988 INFO:tasks.rados.rados.0.smithi084.stdout:1874: delete oid 17 current snap is 198 2024-03-30T12:28:59.991 INFO:tasks.rados.rados.0.smithi084.stdout:1874: done (5 left) 2024-03-30T12:28:59.991 INFO:tasks.rados.rados.0.smithi084.stdout:1875: setattr oid 45 current snap is 198 2024-03-30T12:28:59.992 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 46 current snap is 198 2024-03-30T12:28:59.992 INFO:tasks.rados.rados.0.smithi084.stdout:1876: seq_num 582 ranges {12025856=155648} 2024-03-30T12:29:00.059 INFO:tasks.rados.rados.0.smithi084.stdout:1876: writing smithi08477944-46 from 12025856 to 12181504 tid 1 2024-03-30T12:29:00.060 INFO:tasks.rados.rados.0.smithi084.stdout:1877: read oid 31 snap -1 2024-03-30T12:29:00.060 INFO:tasks.rados.rados.0.smithi084.stdout:1877: expect deleted 2024-03-30T12:29:00.060 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 198 2024-03-30T12:29:00.060 INFO:tasks.rados.rados.0.smithi084.stdout:1870: finishing rollback tid 0 to smithi08477944-43 2024-03-30T12:29:00.060 INFO:tasks.rados.rados.0.smithi084.stdout:1878: seq_num 583 ranges {0=172032} 2024-03-30T12:29:00.060 INFO:tasks.rados.rados.0.smithi084.stdout:1878: writing smithi08477944-13 from 0 to 172032 tid 1 2024-03-30T12:29:00.061 INFO:tasks.rados.rados.0.smithi084.stdout:1879: snap_create 2024-03-30T12:29:00.061 INFO:tasks.rados.rados.0.smithi084.stdout:1870: finishing rollback tid 1 to smithi08477944-43 2024-03-30T12:29:00.061 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 14179 (ObjNum 129 snap 0 seq_num 1429836432) dirty dne 2024-03-30T12:29:00.061 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 935 (ObjNum 530 snap 178 seq_num 530) dirty exists 2024-03-30T12:29:00.061 INFO:tasks.rados.rados.0.smithi084.stdout:1868: expect (ObjNum 577 snap 197 seq_num 577) 2024-03-30T12:29:00.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:59.991+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:00.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:28:59.991+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:00.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:59.989+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:00.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:28:59.991+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-mon[89279]: osdmap e459: 8 total, 7 up, 8 in 2024-03-30T12:29:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:00.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:00.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-mon[89279]: from='osd.5 [v2:172.21.15.162:6808/360140107,v1:172.21.15.162:6809/360140107]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T12:29:00.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-mon[89279]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T12:29:00.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:00.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:00.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-mon[89279]: Health check update: Degraded data redundancy: 80/645 objects degraded (12.403%), 12 pgs degraded (PG_DEGRADED) 2024-03-30T12:29:00.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:00.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:29:00.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:00.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:00.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-mon[91810]: osdmap e459: 8 total, 7 up, 8 in 2024-03-30T12:29:00.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:00.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:00.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-mon[91810]: from='osd.5 [v2:172.21.15.162:6808/360140107,v1:172.21.15.162:6809/360140107]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T12:29:00.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-mon[91810]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T12:29:00.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:00.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:00.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-mon[91810]: Health check update: Degraded data redundancy: 80/645 objects degraded (12.403%), 12 pgs degraded (PG_DEGRADED) 2024-03-30T12:29:00.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:00.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:29:00.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:00.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:28:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:00.369 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:00.038+0000 7f831cb7e700 -1 osd.5 445 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T12:29:00.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:59 smithi162 ceph-mon[83709]: osdmap e459: 8 total, 7 up, 8 in 2024-03-30T12:29:00.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:00.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:00.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:59 smithi162 ceph-mon[83709]: from='osd.5 [v2:172.21.15.162:6808/360140107,v1:172.21.15.162:6809/360140107]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T12:29:00.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:59 smithi162 ceph-mon[83709]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T12:29:00.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:00.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:00.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:59 smithi162 ceph-mon[83709]: Health check update: Degraded data redundancy: 80/645 objects degraded (12.403%), 12 pgs degraded (PG_DEGRADED) 2024-03-30T12:29:00.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:00.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:29:00.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:00.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:28:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:00.862 INFO:tasks.rados.rados.0.smithi084.stdout:1873: finishing copy_from to smithi08477944-26 2024-03-30T12:29:00.862 INFO:tasks.rados.rados.0.smithi084.stdout:1873: got expected ENOENT (src dne) 2024-03-30T12:29:00.862 INFO:tasks.rados.rados.0.smithi084.stdout:1873: finishing copy_from racing read to smithi08477944-26 2024-03-30T12:29:00.862 INFO:tasks.rados.rados.0.smithi084.stdout:1872: finishing rollback tid 1 to smithi08477944-2 2024-03-30T12:29:00.862 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 0 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-03-30T12:29:00.862 INFO:tasks.rados.rados.0.smithi084.stdout:1869: expect (ObjNum 525 snap 171 seq_num 525) 2024-03-30T12:29:01.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:01.009+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:01.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:01.010+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:01.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:01 smithi084 ceph-mon[89279]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-30T12:29:01.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:01 smithi084 ceph-mon[89279]: osdmap e460: 8 total, 7 up, 8 in 2024-03-30T12:29:01.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:01 smithi084 ceph-mon[89279]: from='osd.5 [v2:172.21.15.162:6808/360140107,v1:172.21.15.162:6809/360140107]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:29:01.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:01.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:01.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:01.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:01.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:01 smithi084 ceph-mon[89279]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:29:01.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:01 smithi084 ceph-mon[89279]: pgmap v373: 121 pgs: 1 active+clean+snaptrim, 2 active+undersized+degraded+snaptrim_error, 10 active+undersized+degraded, 38 active+undersized, 66 active+clean, 4 active+clean+snaptrim_error; 316 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 19 MiB/s rd, 1.3 MiB/s wr, 15 op/s; 83/657 objects degraded (12.633%) 2024-03-30T12:29:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:01 smithi084 ceph-mon[91810]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-30T12:29:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:01 smithi084 ceph-mon[91810]: osdmap e460: 8 total, 7 up, 8 in 2024-03-30T12:29:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:01 smithi084 ceph-mon[91810]: from='osd.5 [v2:172.21.15.162:6808/360140107,v1:172.21.15.162:6809/360140107]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:29:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:01 smithi084 ceph-mon[91810]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:29:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:01 smithi084 ceph-mon[91810]: pgmap v373: 121 pgs: 1 active+clean+snaptrim, 2 active+undersized+degraded+snaptrim_error, 10 active+undersized+degraded, 38 active+undersized, 66 active+clean, 4 active+clean+snaptrim_error; 316 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 19 MiB/s rd, 1.3 MiB/s wr, 15 op/s; 83/657 objects degraded (12.633%) 2024-03-30T12:29:01.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:01.008+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:01.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:01.008+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:01.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:01.015+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:01.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:01.015+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:01.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:00 smithi162 ceph-mon[83709]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-30T12:29:01.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:00 smithi162 ceph-mon[83709]: osdmap e460: 8 total, 7 up, 8 in 2024-03-30T12:29:01.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:00 smithi162 ceph-mon[83709]: from='osd.5 [v2:172.21.15.162:6808/360140107,v1:172.21.15.162:6809/360140107]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:29:01.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:01.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:01.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:01.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:01.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:00 smithi162 ceph-mon[83709]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:29:01.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:00 smithi162 ceph-mon[83709]: pgmap v373: 121 pgs: 1 active+clean+snaptrim, 2 active+undersized+degraded+snaptrim_error, 10 active+undersized+degraded, 38 active+undersized, 66 active+clean, 4 active+clean+snaptrim_error; 316 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 19 MiB/s rd, 1.3 MiB/s wr, 15 op/s; 83/657 objects degraded (12.633%) 2024-03-30T12:29:01.784 INFO:tasks.rados.rados.0.smithi084.stdout:1876: finishing write tid 1 to smithi08477944-46 2024-03-30T12:29:01.784 INFO:tasks.rados.rados.0.smithi084.stdout:1876: finishing write tid 2 to smithi08477944-46 2024-03-30T12:29:01.785 INFO:tasks.rados.rados.0.smithi084.stdout:1878: finishing write tid 1 to smithi08477944-13 2024-03-30T12:29:01.785 INFO:tasks.rados.rados.0.smithi084.stdout:1878: finishing write tid 2 to smithi08477944-13 2024-03-30T12:29:01.785 INFO:tasks.rados.rados.0.smithi084.stdout:1868: done (9 left) 2024-03-30T12:29:01.785 INFO:tasks.rados.rados.0.smithi084.stdout:1869: done (8 left) 2024-03-30T12:29:01.785 INFO:tasks.rados.rados.0.smithi084.stdout:1870: done (7 left) 2024-03-30T12:29:01.785 INFO:tasks.rados.rados.0.smithi084.stdout:1872: done (6 left) 2024-03-30T12:29:01.785 INFO:tasks.rados.rados.0.smithi084.stdout:1873: done (5 left) 2024-03-30T12:29:01.785 INFO:tasks.rados.rados.0.smithi084.stdout:1875: done (4 left) 2024-03-30T12:29:01.786 INFO:tasks.rados.rados.0.smithi084.stdout:1877: done (3 left) 2024-03-30T12:29:01.786 INFO:tasks.rados.rados.0.smithi084.stdout:1879: done (2 left) 2024-03-30T12:29:01.786 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 199 2024-03-30T12:29:01.786 INFO:tasks.rados.rados.0.smithi084.stdout:1880: seq_num 584 ranges {98304=188416} 2024-03-30T12:29:01.787 INFO:tasks.rados.rados.0.smithi084.stdout:1880: writing smithi08477944-21 from 98304 to 286720 tid 1 2024-03-30T12:29:01.787 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 199 2024-03-30T12:29:01.787 INFO:tasks.rados.rados.0.smithi084.stdout:1881: seq_num 585 ranges {2916352=204800} 2024-03-30T12:29:01.803 INFO:tasks.rados.rados.0.smithi084.stdout:1881: writing smithi08477944-50 from 2916352 to 3121152 tid 1 2024-03-30T12:29:01.803 INFO:tasks.rados.rados.0.smithi084.stdout:1882: snap_create 2024-03-30T12:29:01.803 INFO:tasks.rados.rados.0.smithi084.stdout:1876: finishing write tid 3 to smithi08477944-46 2024-03-30T12:29:01.803 INFO:tasks.rados.rados.0.smithi084.stdout:1876: oid 46 updating version 0 to 1003 2024-03-30T12:29:01.803 INFO:tasks.rados.rados.0.smithi084.stdout:1876: oid 46 version 1003 is already newer than 1002 2024-03-30T12:29:01.803 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 1003 (ObjNum 582 snap 198 seq_num 582) dirty exists 2024-03-30T12:29:01.803 INFO:tasks.rados.rados.0.smithi084.stdout:1876: left oid 46 (ObjNum 582 snap 198 seq_num 582) 2024-03-30T12:29:01.803 INFO:tasks.rados.rados.0.smithi084.stdout:1878: finishing write tid 3 to smithi08477944-13 2024-03-30T12:29:01.803 INFO:tasks.rados.rados.0.smithi084.stdout:1878: oid 13 updating version 0 to 883 2024-03-30T12:29:01.804 INFO:tasks.rados.rados.0.smithi084.stdout:1878: oid 13 version 883 is already newer than 882 2024-03-30T12:29:01.804 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 883 (ObjNum 583 snap 198 seq_num 583) dirty exists 2024-03-30T12:29:01.804 INFO:tasks.rados.rados.0.smithi084.stdout:1878: left oid 13 (ObjNum 583 snap 198 seq_num 583) 2024-03-30T12:29:02.000 INFO:tasks.rados.rados.0.smithi084.stdout:1876: done (4 left) 2024-03-30T12:29:02.000 INFO:tasks.rados.rados.0.smithi084.stdout:1878: done (3 left) 2024-03-30T12:29:02.000 INFO:tasks.rados.rados.0.smithi084.stdout:1882: done (2 left) 2024-03-30T12:29:02.000 INFO:tasks.rados.rados.0.smithi084.stdout:1883: rmattr oid 38 current snap is 200 2024-03-30T12:29:02.000 INFO:tasks.rados.rados.0.smithi084.stdout:1883: done (2 left) 2024-03-30T12:29:02.000 INFO:tasks.rados.rados.0.smithi084.stdout:1884: read oid 12 snap -1 2024-03-30T12:29:02.000 INFO:tasks.rados.rados.0.smithi084.stdout:1884: expect (ObjNum 455 snap 142 seq_num 455) 2024-03-30T12:29:02.001 INFO:tasks.rados.rados.0.smithi084.stdout:1885: copy_from oid 30 from oid 46 current snap is 200 2024-03-30T12:29:02.001 INFO:tasks.rados.rados.0.smithi084.stdout:1886: snap_create 2024-03-30T12:29:02.025 INFO:tasks.rados.rados.0.smithi084.stdout:1881: finishing write tid 1 to smithi08477944-50 2024-03-30T12:29:02.025 INFO:tasks.rados.rados.0.smithi084.stdout:1881: finishing write tid 2 to smithi08477944-50 2024-03-30T12:29:02.027 INFO:tasks.rados.rados.0.smithi084.stdout:1881: finishing write tid 3 to smithi08477944-50 2024-03-30T12:29:02.027 INFO:tasks.rados.rados.0.smithi084.stdout:1881: oid 50 updating version 0 to 938 2024-03-30T12:29:02.027 INFO:tasks.rados.rados.0.smithi084.stdout:1881: oid 50 version 938 is already newer than 937 2024-03-30T12:29:02.027 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 938 (ObjNum 585 snap 199 seq_num 585) dirty exists 2024-03-30T12:29:02.028 INFO:tasks.rados.rados.0.smithi084.stdout:1881: left oid 50 (ObjNum 585 snap 199 seq_num 585) 2024-03-30T12:29:02.041 INFO:tasks.rados.rados.0.smithi084.stdout:1884: expect (ObjNum 455 snap 142 seq_num 455) 2024-03-30T12:29:02.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-mon[83709]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T12:29:02.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-mon[83709]: osd.5 [v2:172.21.15.162:6808/360140107,v1:172.21.15.162:6809/360140107] boot 2024-03-30T12:29:02.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-mon[83709]: osdmap e461: 8 total, 8 up, 8 in 2024-03-30T12:29:02.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:29:02.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:02.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:02.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:02.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:02.221 INFO:tasks.rados.rados.0.smithi084.stdout:1880: finishing write tid 1 to smithi08477944-21 2024-03-30T12:29:02.222 INFO:tasks.rados.rados.0.smithi084.stdout:1880: finishing write tid 2 to smithi08477944-21 2024-03-30T12:29:02.222 INFO:tasks.rados.rados.0.smithi084.stdout:1880: finishing write tid 3 to smithi08477944-21 2024-03-30T12:29:02.222 INFO:tasks.rados.rados.0.smithi084.stdout:1880: oid 21 updating version 0 to 5724 2024-03-30T12:29:02.222 INFO:tasks.rados.rados.0.smithi084.stdout:1880: oid 21 version 5724 is already newer than 5723 2024-03-30T12:29:02.222 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 5724 (ObjNum 584 snap 199 seq_num 584) dirty exists 2024-03-30T12:29:02.222 INFO:tasks.rados.rados.0.smithi084.stdout:1880: left oid 21 (ObjNum 584 snap 199 seq_num 584) 2024-03-30T12:29:02.222 INFO:tasks.rados.rados.0.smithi084.stdout:1885: finishing copy_from racing read to smithi08477944-30 2024-03-30T12:29:02.222 INFO:tasks.rados.rados.0.smithi084.stdout:1885: finishing copy_from to smithi08477944-30 2024-03-30T12:29:02.222 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 1003 (ObjNum 582 snap 198 seq_num 582) dirty exists 2024-03-30T12:29:02.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:02.004+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:02.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:02.005+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:02.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:02.005+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:02.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:02.006+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:02.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:02.039+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:02.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:02.169+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:02 smithi084 ceph-mon[91810]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T12:29:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:02 smithi084 ceph-mon[91810]: osd.5 [v2:172.21.15.162:6808/360140107,v1:172.21.15.162:6809/360140107] boot 2024-03-30T12:29:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:02 smithi084 ceph-mon[91810]: osdmap e461: 8 total, 8 up, 8 in 2024-03-30T12:29:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:02 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:29:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:02.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:02.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:02.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:02.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:02 smithi084 ceph-mon[89279]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T12:29:02.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:02 smithi084 ceph-mon[89279]: osd.5 [v2:172.21.15.162:6808/360140107,v1:172.21.15.162:6809/360140107] boot 2024-03-30T12:29:02.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:02 smithi084 ceph-mon[89279]: osdmap e461: 8 total, 8 up, 8 in 2024-03-30T12:29:02.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:02 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T12:29:02.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:02.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:02.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:02.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:02.709 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.464+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.709 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.480+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.709 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.496+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.709 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.511+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.709 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.526+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.709 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.542+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.709 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.559+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.709 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.575+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.709 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.590+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.709 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.606+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.710 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.622+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.710 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.639+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.710 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.655+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.710 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.671+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.710 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.688+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.710 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.703+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.710 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.498+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.710 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.509+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.710 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.518+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.711 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.528+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.711 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.535+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.711 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.545+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.711 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.556+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.711 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.565+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.711 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.575+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.711 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.588+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.711 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.599+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.711 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.608+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.711 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.619+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.711 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.629+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.711 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.642+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.711 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.651+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.712 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.661+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.712 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.671+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.712 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.678+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.712 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.688+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.712 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.699+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.712 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.708+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.712 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.716+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.963 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.721+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.963 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.736+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.963 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.752+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.963 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.768+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.963 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.785+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.963 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.800+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.963 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.816+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.964 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.831+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.964 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.847+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.964 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.863+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.964 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.878+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.964 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.896+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.964 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.915+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.964 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.934+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.964 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.953+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:02.964 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.727+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.964 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.738+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.965 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.748+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.965 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.758+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.965 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.764+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.965 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.773+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.965 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.781+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.965 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.792+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.965 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.804+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.965 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.815+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.965 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.826+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.965 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.835+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.965 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.847+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.965 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.855+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.965 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.865+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.965 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.877+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.966 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.893+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.966 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.906+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.966 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.921+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.966 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.934+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.966 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.947+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:02.966 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.959+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.015 INFO:tasks.rados.rados.0.smithi084.stdout:1880: done (4 left) 2024-03-30T12:29:03.015 INFO:tasks.rados.rados.0.smithi084.stdout:1881: done (3 left) 2024-03-30T12:29:03.015 INFO:tasks.rados.rados.0.smithi084.stdout:1884: done (2 left) 2024-03-30T12:29:03.015 INFO:tasks.rados.rados.0.smithi084.stdout:1885: done (1 left) 2024-03-30T12:29:03.015 INFO:tasks.rados.rados.0.smithi084.stdout:1886: done (0 left) 2024-03-30T12:29:03.015 INFO:tasks.rados.rados.0.smithi084.stdout:1887: rollback oid 30 current snap is 201 2024-03-30T12:29:03.015 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 30 to 192 2024-03-30T12:29:03.015 INFO:tasks.rados.rados.0.smithi084.stdout:1888: rollback oid 36 current snap is 201 2024-03-30T12:29:03.015 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 36 to 187 2024-03-30T12:29:03.015 INFO:tasks.rados.rados.0.smithi084.stdout:1889: read oid 1 snap -1 2024-03-30T12:29:03.015 INFO:tasks.rados.rados.0.smithi084.stdout:1889: expect deleted 2024-03-30T12:29:03.015 INFO:tasks.rados.rados.0.smithi084.stdout:1890: snap_remove snap 166 2024-03-30T12:29:03.214 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.971+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.214 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:02.990+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.214 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.006+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.214 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.028+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.215 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.045+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.215 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.059+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.215 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.074+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.215 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.089+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.215 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.106+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.215 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.122+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.215 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.139+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.215 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.154+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.215 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.171+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.215 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.187+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.215 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.206+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.216 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-mon[83709]: osdmap e462: 8 total, 8 up, 8 in 2024-03-30T12:29:03.216 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:03.216 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:03.216 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:03.216 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:03.216 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:03.216 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:03.216 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-mon[83709]: pgmap v376: 121 pgs: 1 active+clean+snaptrim, 2 peering, 2 active+undersized+degraded+snaptrim_error, 9 active+undersized+degraded, 34 active+undersized, 69 active+clean, 4 active+clean+snaptrim_error; 321 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 9.7 MiB/s rd, 802 KiB/s wr, 8 op/s; 78/666 objects degraded (11.712%) 2024-03-30T12:29:03.216 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.973+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.217 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.986+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.217 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:02.997+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.217 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.012+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.217 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.027+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.217 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.044+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.217 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.055+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.217 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.067+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.217 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.080+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.217 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.091+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.217 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.104+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.217 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.115+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.217 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.125+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.217 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.132+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.217 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.142+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.217 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.153+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.218 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.165+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.218 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.176+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.218 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.186+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.218 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.195+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.218 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.203+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.218 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.214+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.471 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.221+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.471 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.239+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.471 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.257+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.274+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.290+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.308+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.323+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.339+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.354+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.370+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.384+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.398+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.413+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.427+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.444+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.459+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.474+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.473 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.226+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.473 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.236+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.473 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.246+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.473 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.260+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.473 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.269+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.473 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.282+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.473 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.294+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.473 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.306+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.473 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.320+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.474 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.330+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.474 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.337+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.474 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.343+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.474 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.348+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.474 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.358+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.474 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.369+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.474 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.374+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.474 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.386+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.474 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.397+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.474 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.404+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.474 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.411+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.474 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.421+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.474 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.431+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.474 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.437+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.475 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.447+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.475 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.459+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.475 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.470+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.475 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.479+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:03.033+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:03.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:03.035+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:03.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:03 smithi084 ceph-mon[91810]: osdmap e462: 8 total, 8 up, 8 in 2024-03-30T12:29:03.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:03.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:03.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:03.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:03.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:03.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:03.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:03 smithi084 ceph-mon[91810]: pgmap v376: 121 pgs: 1 active+clean+snaptrim, 2 peering, 2 active+undersized+degraded+snaptrim_error, 9 active+undersized+degraded, 34 active+undersized, 69 active+clean, 4 active+clean+snaptrim_error; 321 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 9.7 MiB/s rd, 802 KiB/s wr, 8 op/s; 78/666 objects degraded (11.712%) 2024-03-30T12:29:03.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:03 smithi084 ceph-mon[89279]: osdmap e462: 8 total, 8 up, 8 in 2024-03-30T12:29:03.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:03.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:03.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:03.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:03.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:03.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:03.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:03 smithi084 ceph-mon[89279]: pgmap v376: 121 pgs: 1 active+clean+snaptrim, 2 peering, 2 active+undersized+degraded+snaptrim_error, 9 active+undersized+degraded, 34 active+undersized, 69 active+clean, 4 active+clean+snaptrim_error; 321 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 9.7 MiB/s rd, 802 KiB/s wr, 8 op/s; 78/666 objects degraded (11.712%) 2024-03-30T12:29:03.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:03.026+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:03.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:03.028+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:03.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:03.028+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:03.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:03.028+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:03.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:03.028+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:03.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:03.030+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:03.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:03.030+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:03.732 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.491+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.733 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.507+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.733 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.522+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.733 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.539+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.733 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.553+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.733 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.568+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.733 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.583+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.733 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.596+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.733 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.611+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.733 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.626+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.733 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.640+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.733 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.655+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.733 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.670+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.733 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.685+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.734 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.699+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.734 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.713+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.734 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.727+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.734 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.491+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.734 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.501+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.734 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.513+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.734 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.519+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.734 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.529+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.735 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.541+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.735 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.550+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.735 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.561+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.735 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.573+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.735 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.584+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.735 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.594+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.735 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.605+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.735 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.617+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.736 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.624+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.736 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.636+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.736 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.646+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.736 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.657+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.736 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.665+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.736 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.674+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.736 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.683+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.736 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.695+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.736 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.705+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.736 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.717+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.736 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.728+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.736 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.739+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.740+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.754+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.774+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.790+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.805+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.821+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.987 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.837+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.987 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.853+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.987 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.867+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.987 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.884+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.987 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.899+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.987 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.914+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.987 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.932+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.987 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.947+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.987 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.962+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.987 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.977+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:03.988 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.751+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.988 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.766+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.988 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.779+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.988 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.791+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.988 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.802+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.988 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.813+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.988 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.825+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.988 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.833+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.988 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.841+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.988 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.851+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.988 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.863+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.988 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.870+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.988 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.882+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.989 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.892+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.989 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.904+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.989 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.915+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.989 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.925+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.989 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.932+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.989 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.943+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.989 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.952+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.989 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.962+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.989 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.974+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:03.989 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.985+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.021 INFO:tasks.rados.rados.0.smithi084.stdout:1890: done (3 left) 2024-03-30T12:29:04.021 INFO:tasks.rados.rados.0.smithi084.stdout:1891: snap_create 2024-03-30T12:29:04.021 INFO:tasks.rados.rados.0.smithi084.stdout:1887: finishing rollback tid 0 to smithi08477944-30 2024-03-30T12:29:04.021 INFO:tasks.rados.rados.0.smithi084.stdout:1887: finishing rollback tid 1 to smithi08477944-30 2024-03-30T12:29:04.021 INFO:tasks.rados.rados.0.smithi084.stdout:1887: finishing rollback tid 2 to smithi08477944-30 2024-03-30T12:29:04.021 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 1006 (ObjNum 536 snap 183 seq_num 536) dirty exists 2024-03-30T12:29:04.022 INFO:tasks.rados.rados.0.smithi084.stdout:1888: finishing rollback tid 0 to smithi08477944-36 2024-03-30T12:29:04.022 INFO:tasks.rados.rados.0.smithi084.stdout:1888: finishing rollback tid 1 to smithi08477944-36 2024-03-30T12:29:04.022 INFO:tasks.rados.rados.0.smithi084.stdout:1888: finishing rollback tid 2 to smithi08477944-36 2024-03-30T12:29:04.022 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 830 (ObjNum 532 snap 178 seq_num 532) dirty exists 2024-03-30T12:29:04.247 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-mon[83709]: osdmap e463: 8 total, 8 up, 8 in 2024-03-30T12:29:04.247 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:04.248 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:04.248 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:04.248 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:04.248 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:04.248 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:04.248 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:03.994+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.248 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.009+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.248 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.024+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.248 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.050+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.248 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.067+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.249 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.081+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.249 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.097+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.249 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.112+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.249 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.126+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.249 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.141+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.249 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.156+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.249 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.171+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.249 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.186+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.249 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.203+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.249 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.219+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.249 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.237+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.250 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:03.996+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.250 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.009+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.250 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.022+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.250 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.035+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.250 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.052+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.250 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.065+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.250 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.074+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.250 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.084+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.250 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.094+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.250 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.105+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.250 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.115+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.251 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.125+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.251 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.135+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.251 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.143+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.251 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.154+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.251 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.168+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.251 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.180+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.251 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.192+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.251 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.200+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.251 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.211+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.251 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.226+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.251 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.236+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.251 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.244+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.419 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:04.030+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:04.419 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:04.030+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:04.419 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:04.046+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:04.419 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:04.046+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:04.420 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:04.047+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:04.420 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:04.047+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:04.420 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:04 smithi084 ceph-mon[91810]: osdmap e463: 8 total, 8 up, 8 in 2024-03-30T12:29:04.420 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:04.420 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:04.420 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:04.420 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:04.420 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:04.420 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:04.421 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:04 smithi084 ceph-mon[89279]: osdmap e463: 8 total, 8 up, 8 in 2024-03-30T12:29:04.421 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:04.421 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:04.421 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:04.421 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:04.421 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:04.421 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:04.500 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.255+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.500 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.272+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.500 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.289+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.500 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.304+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.500 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.319+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.501 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.334+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.501 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.349+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.501 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.367+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.501 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.385+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.501 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.402+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.501 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.416+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.501 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.431+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.501 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.445+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.501 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.461+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.501 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.477+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.501 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.493+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.501 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.508+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.502 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.259+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.502 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.272+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.502 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.286+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.502 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.299+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.502 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.310+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.502 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.322+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.502 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.333+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.502 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.347+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.502 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.359+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.502 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.368+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.502 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.375+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.502 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.389+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.503 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.398+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.503 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.407+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.503 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.420+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.503 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.428+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.503 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.435+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.503 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.446+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.503 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.458+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.503 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.470+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.503 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.484+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.503 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.492+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.503 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.498+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.503 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.505+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:29:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:29:04.428+0000 7f1f562eb700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-03-30T12:29:04.756 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.524+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.756 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.540+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.756 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.554+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.756 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.570+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.756 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.585+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.756 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.601+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.756 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.616+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.756 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.631+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.757 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.646+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.757 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.661+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.757 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.676+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.757 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.691+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.757 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.705+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.757 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.721+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.757 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.737+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.757 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.751+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:04.757 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.521+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.757 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.532+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.758 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.547+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.758 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.557+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.758 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.568+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.758 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.575+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.758 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.584+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.758 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.597+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.758 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.608+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.758 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.622+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.758 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.640+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.758 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.653+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.758 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.666+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.758 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.676+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.758 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.686+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.758 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.698+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.759 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.710+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.759 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.725+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.759 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.737+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.759 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.750+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:04.759 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.764+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.009 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.767+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.010 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.783+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.010 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.799+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.010 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.815+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.010 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.829+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.010 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.843+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.010 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.857+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.010 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.873+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.010 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.889+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.010 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.904+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.010 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.920+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.010 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.936+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.010 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.950+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.010 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.966+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.011 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.981+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.011 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:04.996+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.011 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.011+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.011 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.777+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.011 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.790+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.011 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.800+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.011 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.811+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.011 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.860+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.011 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.874+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.011 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.886+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.011 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.901+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.011 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.908+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.012 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.922+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.012 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.936+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.012 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.949+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.012 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.961+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.012 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.968+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.012 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.984+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.012 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:04.997+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.012 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.007+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.012 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.017+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.022 INFO:tasks.rados.rados.0.smithi084.stdout:1887: done (3 left) 2024-03-30T12:29:05.022 INFO:tasks.rados.rados.0.smithi084.stdout:1888: done (2 left) 2024-03-30T12:29:05.022 INFO:tasks.rados.rados.0.smithi084.stdout:1889: done (1 left) 2024-03-30T12:29:05.022 INFO:tasks.rados.rados.0.smithi084.stdout:1891: done (0 left) 2024-03-30T12:29:05.022 INFO:tasks.rados.rados.0.smithi084.stdout:1892: snap_create 2024-03-30T12:29:05.267 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.027+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.267 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.046+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.268 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.061+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.268 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.075+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.268 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.091+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.268 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.108+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.268 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.122+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.268 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.138+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.268 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.152+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.268 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.168+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.268 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.185+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.268 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.200+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.268 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.215+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.268 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.230+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.268 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.244+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.269 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.259+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.269 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-mon[83709]: osdmap e464: 8 total, 8 up, 8 in 2024-03-30T12:29:05.269 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:05.269 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:05.269 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:05.269 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:05.269 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:05.269 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:05.270 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:05.270 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:05.270 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:29:05.270 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:29:05.270 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:05.270 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:29:05.270 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:29:05.270 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:29:05.270 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:29:05.270 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-30T12:29:05.270 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-mon[83709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-30T12:29:05.270 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-mon[83709]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-03-30T12:29:05.270 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-mon[83709]: Health check update: Degraded data redundancy: 78/666 objects degraded (11.712%), 11 pgs degraded (PG_DEGRADED) 2024-03-30T12:29:05.270 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-mon[83709]: pgmap v379: 121 pgs: 1 active+clean+snaptrim, 2 peering, 7 active+undersized+degraded, 27 active+undersized, 78 active+clean, 6 active+clean+snaptrim_error; 340 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 3.0 MiB/s wr, 10 op/s; 40/681 objects degraded (5.874%); 5.1 MiB/s, 1 objects/s recovering 2024-03-30T12:29:05.271 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.032+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.271 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.048+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.271 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.057+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.271 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.067+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.271 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.078+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.271 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.090+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.271 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.101+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.271 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.112+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.271 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.126+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.271 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.141+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.271 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.155+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.271 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.166+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.272 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.179+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.272 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.189+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.272 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.203+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.272 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.214+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.272 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.229+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.272 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.248+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.272 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.261+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.272 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.275+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:05.038+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:05.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:05.038+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:05.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:05.136+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:05.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:05.136+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:05.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:05.136+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:05.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:05.136+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:05.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:05.136+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:05.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:05.137+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:05.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:05.137+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[91810]: osdmap e464: 8 total, 8 up, 8 in 2024-03-30T12:29:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:29:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:29:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:29:05.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:29:05.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:29:05.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:29:05.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-30T12:29:05.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[91810]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-30T12:29:05.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[91810]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-03-30T12:29:05.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[91810]: Health check update: Degraded data redundancy: 78/666 objects degraded (11.712%), 11 pgs degraded (PG_DEGRADED) 2024-03-30T12:29:05.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[91810]: pgmap v379: 121 pgs: 1 active+clean+snaptrim, 2 peering, 7 active+undersized+degraded, 27 active+undersized, 78 active+clean, 6 active+clean+snaptrim_error; 340 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 3.0 MiB/s wr, 10 op/s; 40/681 objects degraded (5.874%); 5.1 MiB/s, 1 objects/s recovering 2024-03-30T12:29:05.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[89279]: osdmap e464: 8 total, 8 up, 8 in 2024-03-30T12:29:05.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:05.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:29:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:29:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:29:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:29:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:29:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:29:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-30T12:29:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[89279]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-30T12:29:05.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[89279]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-03-30T12:29:05.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[89279]: Health check update: Degraded data redundancy: 78/666 objects degraded (11.712%), 11 pgs degraded (PG_DEGRADED) 2024-03-30T12:29:05.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:05 smithi084 ceph-mon[89279]: pgmap v379: 121 pgs: 1 active+clean+snaptrim, 2 peering, 7 active+undersized+degraded, 27 active+undersized, 78 active+clean, 6 active+clean+snaptrim_error; 340 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 1023 B/s rd, 3.0 MiB/s wr, 10 op/s; 40/681 objects degraded (5.874%); 5.1 MiB/s, 1 objects/s recovering 2024-03-30T12:29:05.527 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.276+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.527 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.293+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.527 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.307+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.528 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.321+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.528 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.337+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.528 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.353+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.528 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.368+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.528 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.381+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.528 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.398+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.528 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.413+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.528 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.428+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.528 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.443+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.528 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.460+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.528 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.475+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.528 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.490+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.528 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.504+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.528 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.521+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.529 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.535+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.529 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.290+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.529 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.303+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.529 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.316+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.529 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.331+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.529 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.338+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.529 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.347+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.530 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.354+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.530 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.367+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.530 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.382+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.530 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.393+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.530 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.405+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.530 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.419+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.530 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.433+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.530 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.446+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.530 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.460+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.530 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.475+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.530 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.484+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.530 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.496+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.530 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.511+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.530 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.525+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.531 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.534+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.779 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.551+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.779 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.565+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.779 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.580+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.779 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.595+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.779 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.611+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.779 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.626+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.780 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.641+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.780 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.657+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.780 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.673+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.780 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.688+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.780 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.703+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.780 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.718+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.780 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.733+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.780 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.748+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.780 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.763+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.780 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.779+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:05.780 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.549+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.781 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.563+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.781 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.580+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.781 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.588+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.781 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.598+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.781 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.614+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.781 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.631+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.781 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.644+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.781 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.659+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.781 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.667+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.781 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.682+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.781 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.695+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.781 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.711+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.781 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.726+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.781 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.743+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.782 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.757+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.782 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.771+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:05.782 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.786+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.029 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-mon[83709]: osdmap e465: 8 total, 8 up, 8 in 2024-03-30T12:29:06.029 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:06.029 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:06.029 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:06.030 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:06.030 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:06.030 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:06.030 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.794+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.030 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.812+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.030 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.826+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.030 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.842+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.031 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.858+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.031 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.875+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.031 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.889+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.031 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.906+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.031 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.921+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.031 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.937+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.031 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.953+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.031 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.967+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.031 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:05.983+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.031 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.000+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.031 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.016+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.031 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.030+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.032 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.803+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.032 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.818+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.032 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.832+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.032 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.847+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.032 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.860+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.032 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.873+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.032 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.887+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.032 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.896+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.032 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.911+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.032 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.924+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.032 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.939+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.033 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.955+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.033 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.971+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.033 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.979+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.033 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:05.994+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.033 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.008+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.033 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.021+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.033 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.037+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.033 INFO:tasks.rados.rados.0.smithi084.stdout:1892: done (0 left) 2024-03-30T12:29:06.034 INFO:tasks.rados.rados.0.smithi084.stdout:1893: setattr oid 22 current snap is 203 2024-03-30T12:29:06.034 INFO:tasks.rados.rados.0.smithi084.stdout:1894: snap_remove snap 197 2024-03-30T12:29:06.289 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.051+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.289 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.066+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.289 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.081+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.289 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.097+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.289 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.112+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.289 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.128+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.289 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.142+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.289 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.159+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.289 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.173+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.289 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.188+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.289 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.203+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.290 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.219+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.290 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.234+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.290 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.250+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.290 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.266+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.290 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.282+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.290 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.059+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.290 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.070+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.290 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.082+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.291 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.097+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.291 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.112+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.291 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.127+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.291 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.142+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.291 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.152+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.291 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.165+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.291 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.182+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.291 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.190+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.291 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.199+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.291 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.214+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.291 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.223+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.291 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.237+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.291 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.253+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.291 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.260+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.292 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.277+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.292 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.294+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:06.043+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:06.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:06.043+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:06.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:06 smithi084 ceph-mon[91810]: osdmap e465: 8 total, 8 up, 8 in 2024-03-30T12:29:06.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:06.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:06.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:06.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:06.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:06.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:06.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:06 smithi084 ceph-mon[89279]: osdmap e465: 8 total, 8 up, 8 in 2024-03-30T12:29:06.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:06.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:06.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:06.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:06.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:06.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:06.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:06.040+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:06.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:06.040+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:06.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:06.040+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:06.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:06.040+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:06.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.297+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.314+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.331+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.345+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.360+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.376+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.392+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.408+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.425+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.547 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.440+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.547 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.456+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.547 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.473+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.547 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.488+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.547 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.504+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.547 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.521+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.547 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.539+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.547 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.309+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.547 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.323+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.333+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.349+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.364+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.372+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.388+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.396+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.412+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.427+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.442+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.458+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.468+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.482+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.491+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.507+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.549 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.523+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.549 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.538+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.549 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.553+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.799 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.555+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.799 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.572+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.799 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.587+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.799 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.601+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.799 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.618+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.799 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.633+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.799 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.648+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.799 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.663+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.799 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.678+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.693+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.709+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.726+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.742+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.758+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.774+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.790+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:06.800 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.571+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.800 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.586+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.800 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.601+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.800 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.611+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.801 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.621+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.801 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.640+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.801 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.656+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.801 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.671+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.801 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.684+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.801 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.703+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.801 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.711+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.801 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.727+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.801 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.744+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.801 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.760+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.801 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.775+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:06.801 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.791+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.041 INFO:tasks.rados.rados.0.smithi084.stdout:1894: done (1 left) 2024-03-30T12:29:07.041 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 203 2024-03-30T12:29:07.041 INFO:tasks.rados.rados.0.smithi084.stdout:1895: seq_num 586 ranges {0=221184} 2024-03-30T12:29:07.043 INFO:tasks.rados.rados.0.smithi084.stdout:1895: writing smithi08477944-11 from 0 to 221184 tid 1 2024-03-30T12:29:07.043 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 203 2024-03-30T12:29:07.043 INFO:tasks.rados.rados.0.smithi084.stdout:1896: seq_num 587 ranges {761856=237568} 2024-03-30T12:29:07.048 INFO:tasks.rados.rados.0.smithi084.stdout:1896: writing smithi08477944-26 from 761856 to 999424 tid 1 2024-03-30T12:29:07.049 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 3345 (ObjNum 577 snap 197 seq_num 577) dirty exists 2024-03-30T12:29:07.049 INFO:tasks.rados.rados.0.smithi084.stdout:1893: done (2 left) 2024-03-30T12:29:07.049 INFO:tasks.rados.rados.0.smithi084.stdout:1897: setattr oid 23 current snap is 203 2024-03-30T12:29:07.050 INFO:tasks.rados.rados.0.smithi084.stdout:1898: snap_remove snap 190 2024-03-30T12:29:07.055 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:07.056 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:07.056 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:07.056 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:07.056 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-mon[83709]: osdmap e466: 8 total, 8 up, 8 in 2024-03-30T12:29:07.056 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:07.056 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:07.056 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-mon[83709]: pgmap v382: 121 pgs: 3 active+clean+snaptrim, 2 peering, 110 active+clean, 6 active+clean+snaptrim_error; 340 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 517 KiB/s rd, 3.0 MiB/s wr, 9 op/s; 25 MiB/s, 5 objects/s recovering 2024-03-30T12:29:07.056 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.807+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.057 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.825+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.057 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.841+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.057 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.849+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.057 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.866+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.057 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.881+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.057 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.901+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.057 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.916+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.057 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.932+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.057 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.948+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.057 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.958+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.057 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.967+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.057 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.983+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.057 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:06.997+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.057 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.013+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.058 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.031+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.058 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.047+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.058 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.806+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.058 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.822+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.058 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.837+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.058 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.854+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.058 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.870+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.058 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.886+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.058 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.903+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.058 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.918+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.058 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.933+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.949+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.965+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.980+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:06.996+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.012+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.027+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.042+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.064+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.313 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.080+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.313 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.095+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.313 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.112+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.313 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.129+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.313 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.145+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.313 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.163+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.313 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.179+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.313 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.196+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.313 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.212+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.314 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.226+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.314 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.242+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.314 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.259+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.314 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.274+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.314 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.289+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.314 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.305+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.314 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.320+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.314 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.074+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.315 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.090+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.315 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.103+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.315 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.115+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.315 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.132+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.315 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.149+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.315 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.158+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.315 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.167+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.315 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.184+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.315 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.202+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.315 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.211+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.315 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.226+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.315 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.242+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.316 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.258+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.316 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.274+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.316 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.292+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.316 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.308+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:07.052+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:07.553 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:07.052+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:07.554 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:07.554 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:07.554 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:07.554 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:07.554 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:07 smithi084 ceph-mon[89279]: osdmap e466: 8 total, 8 up, 8 in 2024-03-30T12:29:07.554 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:07.555 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:07.555 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:07 smithi084 ceph-mon[89279]: pgmap v382: 121 pgs: 3 active+clean+snaptrim, 2 peering, 110 active+clean, 6 active+clean+snaptrim_error; 340 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 517 KiB/s rd, 3.0 MiB/s wr, 9 op/s; 25 MiB/s, 5 objects/s recovering 2024-03-30T12:29:07.555 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:07.555 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:07.555 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:07.555 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:07.555 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:07 smithi084 ceph-mon[91810]: osdmap e466: 8 total, 8 up, 8 in 2024-03-30T12:29:07.555 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:07.555 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:07.556 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:07 smithi084 ceph-mon[91810]: pgmap v382: 121 pgs: 3 active+clean+snaptrim, 2 peering, 110 active+clean, 6 active+clean+snaptrim_error; 340 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 517 KiB/s rd, 3.0 MiB/s wr, 9 op/s; 25 MiB/s, 5 objects/s recovering 2024-03-30T12:29:07.556 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:07.057+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:07.556 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:07.057+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:07.556 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:07.058+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:07.556 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:07.059+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:07.556 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:07.059+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:07.556 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:07.059+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:07.556 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:07.059+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:07.569 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.336+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.569 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.350+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.569 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.366+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.569 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.381+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.569 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.397+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.569 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.413+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.569 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.430+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.570 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.446+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.570 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.465+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.570 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.480+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.570 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.496+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.570 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.512+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.570 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.530+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.570 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.544+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.570 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.560+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.570 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.577+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.570 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.327+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.570 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.342+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.571 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.362+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.571 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.378+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.571 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.397+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.571 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.413+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.571 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.425+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.571 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.440+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.571 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.453+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.571 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.472+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.571 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.488+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.571 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.505+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.571 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.524+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.571 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.539+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.571 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.552+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.571 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.566+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.823 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.593+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.608+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.624+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.639+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.654+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.669+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.685+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.702+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.718+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.734+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.750+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.766+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.783+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.825 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.798+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.825 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.815+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.825 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.831+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:07.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.583+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.600+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.617+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.636+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.648+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.669+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.685+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.826 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.696+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.826 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.712+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.826 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.729+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.826 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.738+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.826 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.751+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.826 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.764+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.826 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.777+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.826 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.797+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:07.826 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.815+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.051 INFO:tasks.rados.rados.0.smithi084.stdout:1898: done (3 left) 2024-03-30T12:29:08.051 INFO:tasks.rados.rados.0.smithi084.stdout:1899: read oid 4 snap -1 2024-03-30T12:29:08.051 INFO:tasks.rados.rados.0.smithi084.stdout:1899: expect (ObjNum 475 snap 150 seq_num 475) 2024-03-30T12:29:08.051 INFO:tasks.rados.rados.0.smithi084.stdout:1900: delete oid 14 current snap is 203 2024-03-30T12:29:08.051 INFO:tasks.rados.rados.0.smithi084.stdout:1895: finishing write tid 1 to smithi08477944-11 2024-03-30T12:29:08.051 INFO:tasks.rados.rados.0.smithi084.stdout:1895: finishing write tid 2 to smithi08477944-11 2024-03-30T12:29:08.051 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 831 (ObjNum 574 snap 197 seq_num 574) dirty exists 2024-03-30T12:29:08.051 INFO:tasks.rados.rados.0.smithi084.stdout:1895: finishing write tid 3 to smithi08477944-11 2024-03-30T12:29:08.051 INFO:tasks.rados.rados.0.smithi084.stdout:1895: oid 11 updating version 0 to 920 2024-03-30T12:29:08.051 INFO:tasks.rados.rados.0.smithi084.stdout:1895: oid 11 updating version 920 to 921 2024-03-30T12:29:08.051 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 921 (ObjNum 586 snap 203 seq_num 586) dirty exists 2024-03-30T12:29:08.052 INFO:tasks.rados.rados.0.smithi084.stdout:1895: left oid 11 (ObjNum 586 snap 203 seq_num 586) 2024-03-30T12:29:08.052 INFO:tasks.rados.rados.0.smithi084.stdout:1896: finishing write tid 1 to smithi08477944-26 2024-03-30T12:29:08.052 INFO:tasks.rados.rados.0.smithi084.stdout:1896: finishing write tid 2 to smithi08477944-26 2024-03-30T12:29:08.052 INFO:tasks.rados.rados.0.smithi084.stdout:1896: finishing write tid 3 to smithi08477944-26 2024-03-30T12:29:08.052 INFO:tasks.rados.rados.0.smithi084.stdout:1896: oid 26 updating version 0 to 3851 2024-03-30T12:29:08.052 INFO:tasks.rados.rados.0.smithi084.stdout:1896: oid 26 updating version 3851 to 3852 2024-03-30T12:29:08.052 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 3852 (ObjNum 587 snap 203 seq_num 587) dirty exists 2024-03-30T12:29:08.052 INFO:tasks.rados.rados.0.smithi084.stdout:1896: left oid 26 (ObjNum 587 snap 203 seq_num 587) 2024-03-30T12:29:08.057 INFO:tasks.rados.rados.0.smithi084.stdout:1899: expect (ObjNum 475 snap 150 seq_num 475) 2024-03-30T12:29:08.082 INFO:tasks.rados.rados.0.smithi084.stdout:1895: done (4 left) 2024-03-30T12:29:08.082 INFO:tasks.rados.rados.0.smithi084.stdout:1896: done (3 left) 2024-03-30T12:29:08.082 INFO:tasks.rados.rados.0.smithi084.stdout:1897: done (2 left) 2024-03-30T12:29:08.082 INFO:tasks.rados.rados.0.smithi084.stdout:1899: done (1 left) 2024-03-30T12:29:08.083 INFO:tasks.rados.rados.0.smithi084.stdout:1900: done (0 left) 2024-03-30T12:29:08.083 INFO:tasks.rados.rados.0.smithi084.stdout:1901: snap_remove snap 187 2024-03-30T12:29:08.084 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-mon[83709]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 40/681 objects degraded (5.874%), 7 pgs degraded) 2024-03-30T12:29:08.084 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-mon[83709]: osdmap e467: 8 total, 8 up, 8 in 2024-03-30T12:29:08.084 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:08.084 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:08.084 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-mon[83709]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:08.084 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:08.084 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:08.085 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:08.085 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.832+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.085 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.849+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.085 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.868+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.085 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.880+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.085 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.902+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.085 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.919+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.085 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.930+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.086 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.948+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.086 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.966+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.086 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:07.982+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.086 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.000+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.086 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.016+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.086 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.036+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.086 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.054+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.086 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.080+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.086 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.848+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.086 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.863+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.086 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.881+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.895+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.910+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.926+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.942+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.956+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.973+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:07.989+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.005+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.021+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.036+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.055+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.076+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.092+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.350 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.107+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.350 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.123+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.350 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.140+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.350 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.158+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.350 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.173+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.350 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.189+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.350 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.205+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.219+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.234+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.250+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.266+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.280+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.297+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.312+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.328+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.342+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.351 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.099+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.352 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.115+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.352 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.128+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.352 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.142+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.352 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.156+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.352 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.174+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.352 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.190+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.352 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.209+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.352 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.228+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.352 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.242+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.352 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.257+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.352 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.274+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.352 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.292+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.352 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.310+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.352 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.324+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.353 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.340+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:08.059+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:08.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:08.059+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:08 smithi084 ceph-mon[91810]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 40/681 objects degraded (5.874%), 7 pgs degraded) 2024-03-30T12:29:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:08 smithi084 ceph-mon[91810]: osdmap e467: 8 total, 8 up, 8 in 2024-03-30T12:29:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:08 smithi084 ceph-mon[91810]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:08.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:08.061+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:08.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:08.061+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:08.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:08.065+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:08.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:08.065+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:08.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:08 smithi084 ceph-mon[89279]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 40/681 objects degraded (5.874%), 7 pgs degraded) 2024-03-30T12:29:08.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:08 smithi084 ceph-mon[89279]: osdmap e467: 8 total, 8 up, 8 in 2024-03-30T12:29:08.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:08.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:08.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:08 smithi084 ceph-mon[89279]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:08.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:08.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:08.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:08.603 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.357+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.603 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.374+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.603 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.392+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.603 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.408+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.603 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.424+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.604 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.440+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.604 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.456+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.604 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.469+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.604 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.484+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.604 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.501+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.604 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.518+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.604 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.534+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.604 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.553+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.604 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.567+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.604 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.583+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.605 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.600+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.605 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.361+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.605 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.375+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.605 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.389+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.605 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.403+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.605 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.419+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.605 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.434+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.605 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.452+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.605 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.471+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.605 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.487+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.606 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.500+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.606 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.518+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.606 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.536+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.606 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.551+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.606 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.567+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.606 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.586+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.606 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.599+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.606 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.610+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.854 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.617+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.854 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.631+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.855 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.645+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.855 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.662+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.855 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.678+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.855 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.695+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.855 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.709+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.855 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.725+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.855 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.740+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.855 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.758+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.855 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.775+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.855 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.791+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.855 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.807+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.855 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.822+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.855 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.840+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.856 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.855+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:08.856 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.626+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.856 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.646+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.856 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.665+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.856 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.682+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.856 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.696+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.856 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.721+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.856 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.739+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.856 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.759+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.857 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.777+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.857 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.797+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.857 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.814+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.857 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.833+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:08.857 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.847+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.058 INFO:tasks.rados.rados.0.smithi084.stdout:1901: done (0 left) 2024-03-30T12:29:09.058 INFO:tasks.rados.rados.0.smithi084.stdout:1902: rollback oid 11 current snap is 203 2024-03-30T12:29:09.058 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 11 to 181 2024-03-30T12:29:09.058 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 203 2024-03-30T12:29:09.059 INFO:tasks.rados.rados.0.smithi084.stdout:1903: seq_num 589 ranges {3129344=270336} 2024-03-30T12:29:09.078 INFO:tasks.rados.rados.0.smithi084.stdout:1903: writing smithi08477944-6 from 3129344 to 3399680 tid 1 2024-03-30T12:29:09.078 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 203 2024-03-30T12:29:09.078 INFO:tasks.rados.rados.0.smithi084.stdout:1902: finishing rollback tid 0 to smithi08477944-11 2024-03-30T12:29:09.078 INFO:tasks.rados.rados.0.smithi084.stdout:1904: seq_num 590 ranges {0=286720} 2024-03-30T12:29:09.082 INFO:tasks.rados.rados.0.smithi084.stdout:1904: writing smithi08477944-37 from 0 to 286720 tid 1 2024-03-30T12:29:09.082 INFO:tasks.rados.rados.0.smithi084.stdout:1905: snap_create 2024-03-30T12:29:09.082 INFO:tasks.rados.rados.0.smithi084.stdout:1902: finishing rollback tid 1 to smithi08477944-11 2024-03-30T12:29:09.082 INFO:tasks.rados.rados.0.smithi084.stdout:1902: finishing rollback tid 2 to smithi08477944-11 2024-03-30T12:29:09.082 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 924 (ObjNum 280 snap 90 seq_num 280) dirty exists 2024-03-30T12:29:09.083 INFO:tasks.rados.rados.0.smithi084.stdout:1904: finishing write tid 1 to smithi08477944-37 2024-03-30T12:29:09.084 INFO:tasks.rados.rados.0.smithi084.stdout:1904: finishing write tid 2 to smithi08477944-37 2024-03-30T12:29:09.085 INFO:tasks.rados.rados.0.smithi084.stdout:1904: finishing write tid 3 to smithi08477944-37 2024-03-30T12:29:09.085 INFO:tasks.rados.rados.0.smithi084.stdout:1904: oid 37 updating version 0 to 815 2024-03-30T12:29:09.085 INFO:tasks.rados.rados.0.smithi084.stdout:1904: oid 37 updating version 815 to 816 2024-03-30T12:29:09.085 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 816 (ObjNum 590 snap 203 seq_num 590) dirty exists 2024-03-30T12:29:09.085 INFO:tasks.rados.rados.0.smithi084.stdout:1904: left oid 37 (ObjNum 590 snap 203 seq_num 590) 2024-03-30T12:29:09.097 INFO:tasks.rados.rados.0.smithi084.stdout:1903: finishing write tid 1 to smithi08477944-6 2024-03-30T12:29:09.098 INFO:tasks.rados.rados.0.smithi084.stdout:1903: finishing write tid 2 to smithi08477944-6 2024-03-30T12:29:09.102 INFO:tasks.rados.rados.0.smithi084.stdout:1903: finishing write tid 3 to smithi08477944-6 2024-03-30T12:29:09.102 INFO:tasks.rados.rados.0.smithi084.stdout:1903: oid 6 updating version 0 to 17482 2024-03-30T12:29:09.102 INFO:tasks.rados.rados.0.smithi084.stdout:1903: oid 6 version 17482 is already newer than 17481 2024-03-30T12:29:09.103 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 17482 (ObjNum 589 snap 203 seq_num 589) dirty exists 2024-03-30T12:29:09.103 INFO:tasks.rados.rados.0.smithi084.stdout:1903: left oid 6 (ObjNum 589 snap 203 seq_num 589) 2024-03-30T12:29:09.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-mon[83709]: osdmap e468: 8 total, 8 up, 8 in 2024-03-30T12:29:09.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:09.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:09.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:09.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:09.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:09.110 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:09.111 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-mon[83709]: pgmap v385: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 340 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 1.1 MiB/s rd, 126 KiB/s wr, 4 op/s; 22 MiB/s, 4 objects/s recovering 2024-03-30T12:29:09.111 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.862+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.111 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.873+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.111 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.887+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.111 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.904+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.111 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.923+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.111 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.942+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.111 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.961+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.112 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.979+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.112 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:08.997+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.112 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.017+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.112 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.028+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.112 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.047+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.112 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.073+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.112 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.098+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.112 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.116+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.112 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.872+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.112 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.887+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.112 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.904+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.113 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.920+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.113 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.937+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.113 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.951+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.113 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.967+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.113 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:08.984+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.113 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.000+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.113 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.015+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.113 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.032+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.113 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.048+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.113 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.064+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.113 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.087+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.113 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.103+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.113 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.119+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.295 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:09.070+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:09.295 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:09.071+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:09.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-mon[89279]: osdmap e468: 8 total, 8 up, 8 in 2024-03-30T12:29:09.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:09.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:09.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:09.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:09.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:09.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:09.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-mon[89279]: pgmap v385: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 340 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 1.1 MiB/s rd, 126 KiB/s wr, 4 op/s; 22 MiB/s, 4 objects/s recovering 2024-03-30T12:29:09.297 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-mon[91810]: osdmap e468: 8 total, 8 up, 8 in 2024-03-30T12:29:09.297 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:09.297 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:09.297 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:09.297 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:09.297 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:09.297 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:09.297 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-mon[91810]: pgmap v385: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 340 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 1.1 MiB/s rd, 126 KiB/s wr, 4 op/s; 22 MiB/s, 4 objects/s recovering 2024-03-30T12:29:09.297 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:09.077+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:09.297 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:09.077+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:09.298 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:09.077+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:09.298 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:09.077+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:09.298 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:09.078+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:09.298 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:09.078+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:09.298 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:09.078+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:09.361 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.137+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.361 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.156+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.361 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.170+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.361 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.194+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.361 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.211+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.362 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.230+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.362 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.250+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.362 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.265+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.362 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.284+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.362 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.298+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.362 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.316+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.362 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.336+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.362 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.357+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.362 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.133+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.362 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.149+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.362 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.164+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.363 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.181+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.363 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.198+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.363 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.213+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.363 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.228+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.363 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.244+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.363 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.259+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.363 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.275+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.363 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.292+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.363 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.307+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.363 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.323+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.363 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.337+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.363 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.353+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.363 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.369+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.617 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.388+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.617 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.402+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.617 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.419+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.617 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.436+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.618 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.451+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.618 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.467+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.618 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.484+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.618 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.501+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.618 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.516+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.618 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.532+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.618 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.547+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.618 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.562+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.618 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.577+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.618 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.593+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.618 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.610+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.625+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.384+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.403+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.414+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.434+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.452+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.471+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.491+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.502+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.516+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.533+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.551+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.571+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.594+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.613+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:29:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:29:09] "GET /metrics HTTP/1.1" 200 36257 "" "Prometheus/2.43.0" 2024-03-30T12:29:09.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.634+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.654+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.673+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.692+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.713+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.731+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.750+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.766+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.786+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.814+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.836+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.846+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.867+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:09.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.642+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.659+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.676+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.691+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.708+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.724+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.739+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.872 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.755+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.872 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.769+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.872 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.785+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.872 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.801+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.872 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.816+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.872 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.831+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.872 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.847+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:09.872 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.862+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.064 INFO:tasks.rados.rados.0.smithi084.stdout:1902: done (3 left) 2024-03-30T12:29:10.064 INFO:tasks.rados.rados.0.smithi084.stdout:1903: done (2 left) 2024-03-30T12:29:10.064 INFO:tasks.rados.rados.0.smithi084.stdout:1904: done (1 left) 2024-03-30T12:29:10.064 INFO:tasks.rados.rados.0.smithi084.stdout:1905: done (0 left) 2024-03-30T12:29:10.064 INFO:tasks.rados.rados.0.smithi084.stdout:1906: rollback oid 16 current snap is 204 2024-03-30T12:29:10.064 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 16 to 192 2024-03-30T12:29:10.065 INFO:tasks.rados.rados.0.smithi084.stdout:1907: read oid 42 snap -1 2024-03-30T12:29:10.065 INFO:tasks.rados.rados.0.smithi084.stdout:1907: expect deleted 2024-03-30T12:29:10.065 INFO:tasks.rados.rados.0.smithi084.stdout:1908: snap_remove snap 203 2024-03-30T12:29:10.128 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-mon[83709]: osdmap e469: 8 total, 8 up, 8 in 2024-03-30T12:29:10.128 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:10.128 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:10.128 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:10.128 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:10.129 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:10.129 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:10.129 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.888+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.129 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.911+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.129 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.931+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.129 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.952+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.129 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.974+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.129 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:09.989+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.129 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.004+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.130 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.035+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.130 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.047+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.130 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.067+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.130 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.086+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.130 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.103+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.130 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.116+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.130 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.128+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.130 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.880+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.130 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.894+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.130 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.909+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.130 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.925+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.131 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.939+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.131 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.954+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.131 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.969+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.131 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:09.985+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.131 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.002+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.131 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.018+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.131 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.034+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.131 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.053+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.131 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.069+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.131 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.090+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.131 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.105+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.131 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.122+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.131 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.136+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.382 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.154+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.382 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.168+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.382 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.187+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.382 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.202+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.382 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.218+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.382 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.234+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.382 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.251+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.382 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.266+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.285+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.303+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.318+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.334+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.350+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.365+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.380+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.383 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.149+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.383 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.171+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.384 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.189+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.384 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.203+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.384 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.219+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.384 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.238+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.384 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.258+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.384 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.278+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.384 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.298+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.384 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.317+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.384 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.335+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.384 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.357+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.384 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.372+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:10.074+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:10.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:10.075+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:10.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:10.075+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:10.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:10.077+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:10.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:10.078+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:10.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:10.082+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:10.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:10 smithi084 ceph-mon[91810]: osdmap e469: 8 total, 8 up, 8 in 2024-03-30T12:29:10.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:10.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:10.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:10.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:10.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:10.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:10.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:10 smithi084 ceph-mon[89279]: osdmap e469: 8 total, 8 up, 8 in 2024-03-30T12:29:10.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:10.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:10.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:10.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:10.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:10.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:10.640 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.397+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.640 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.412+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.640 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.430+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.640 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.447+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.640 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.463+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.640 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.479+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.640 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.493+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.640 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.511+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.526+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.540+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.557+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.572+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.586+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.601+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.617+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.633+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.648+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.641 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.389+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.641 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.411+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.641 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.422+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.642 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.437+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.642 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.454+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.642 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.475+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.642 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.494+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.642 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.522+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.642 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.543+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.642 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.562+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.642 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.585+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.642 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.608+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.642 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.629+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.891 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.650+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.891 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.664+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.891 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.681+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.891 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.703+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.891 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.723+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.892 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.741+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.892 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.765+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.892 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.786+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.892 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.808+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.892 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.823+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.892 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.841+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.892 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.863+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.892 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.887+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:10.892 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.666+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.892 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.681+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.892 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.698+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.892 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.715+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.893 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.730+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.893 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.746+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.893 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.761+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.893 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.778+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.893 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.793+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.893 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.807+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.893 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.821+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.893 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.836+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.893 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.852+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.893 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.866+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.893 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.883+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:10.893 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.898+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.072 INFO:tasks.rados.rados.0.smithi084.stdout:1908: done (2 left) 2024-03-30T12:29:11.072 INFO:tasks.rados.rados.0.smithi084.stdout:1909: copy_from oid 12 from oid 25 current snap is 204 2024-03-30T12:29:11.072 INFO:tasks.rados.rados.0.smithi084.stdout:1906: finishing rollback tid 0 to smithi08477944-16 2024-03-30T12:29:11.072 INFO:tasks.rados.rados.0.smithi084.stdout:1906: finishing rollback tid 1 to smithi08477944-16 2024-03-30T12:29:11.072 INFO:tasks.rados.rados.0.smithi084.stdout:1906: finishing rollback tid 2 to smithi08477944-16 2024-03-30T12:29:11.072 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 942 (ObjNum 395 snap 125 seq_num 395) dirty exists 2024-03-30T12:29:11.072 INFO:tasks.rados.rados.0.smithi084.stdout:1906: done (2 left) 2024-03-30T12:29:11.073 INFO:tasks.rados.rados.0.smithi084.stdout:1907: done (1 left) 2024-03-30T12:29:11.073 INFO:tasks.rados.rados.0.smithi084.stdout:1910: snap_create 2024-03-30T12:29:11.126 INFO:tasks.rados.rados.0.smithi084.stdout:1909: finishing copy_from racing read to smithi08477944-12 2024-03-30T12:29:11.128 INFO:tasks.rados.rados.0.smithi084.stdout:1909: finishing copy_from to smithi08477944-12 2024-03-30T12:29:11.128 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 903 (ObjNum 525 snap 171 seq_num 525) dirty exists 2024-03-30T12:29:11.144 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-mon[83709]: osdmap e470: 8 total, 8 up, 8 in 2024-03-30T12:29:11.144 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:11.144 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:11.144 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:11.144 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:11.144 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:11.145 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:11.145 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-mon[83709]: pgmap v388: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 346 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 559 KiB/s rd, 228 KiB/s wr, 9 op/s; 1.9 MiB/s, 0 objects/s recovering 2024-03-30T12:29:11.145 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.915+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.145 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.929+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.145 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.944+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.145 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.962+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.145 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.978+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.145 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:10.994+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.145 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.010+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.145 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.025+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.041+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.060+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.076+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.097+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.124+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.141+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.146 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.908+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.146 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.931+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.146 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.952+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.146 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.973+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.146 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:10.993+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.146 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.009+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.147 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.034+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.147 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.050+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.147 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.070+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.147 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.096+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.147 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.117+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.147 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.152+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.398 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.173+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.399 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.196+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.399 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.216+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.399 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.237+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.399 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.250+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.399 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.264+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.399 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.282+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.399 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.304+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.399 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.325+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.399 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.348+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.399 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.369+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.399 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.382+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.399 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.397+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.400 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.156+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.400 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.172+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.400 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.187+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.400 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.203+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.400 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.219+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.400 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.234+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.400 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.250+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.400 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.265+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.400 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.281+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.400 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.296+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.400 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.311+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.400 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.325+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.401 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.341+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.401 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.355+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.401 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.371+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.401 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.388+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.401 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.406+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:11.082+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:11.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:11.082+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:11.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:11 smithi084 ceph-mon[91810]: osdmap e470: 8 total, 8 up, 8 in 2024-03-30T12:29:11.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:11.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:11.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:11.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:11.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:11.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:11.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:11 smithi084 ceph-mon[91810]: pgmap v388: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 346 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 559 KiB/s rd, 228 KiB/s wr, 9 op/s; 1.9 MiB/s, 0 objects/s recovering 2024-03-30T12:29:11.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:11 smithi084 ceph-mon[89279]: osdmap e470: 8 total, 8 up, 8 in 2024-03-30T12:29:11.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:11.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:11.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:11.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:11.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:11.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:11.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:11 smithi084 ceph-mon[89279]: pgmap v388: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 346 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 559 KiB/s rd, 228 KiB/s wr, 9 op/s; 1.9 MiB/s, 0 objects/s recovering 2024-03-30T12:29:11.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:11.090+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:11.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:11.090+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:11.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:11.090+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:11.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:11.090+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:11.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:11.090+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:11.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:11.091+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:11.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:11.091+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:11.651 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.420+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.651 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.442+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.651 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.464+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.651 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.484+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.651 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.497+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.651 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.517+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.651 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.533+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.652 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.551+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.652 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.563+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.652 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.584+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.652 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.595+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.652 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.617+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.652 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.638+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.652 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.659+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.652 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.423+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.652 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.438+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.652 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.454+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.652 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.469+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.652 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.484+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.653 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.500+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.653 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.516+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.653 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.530+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.653 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.548+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.653 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.566+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.653 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.581+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.653 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.600+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.653 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.615+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.653 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.632+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.653 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.649+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.909 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.666+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.909 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.681+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.909 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.697+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.909 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.713+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.909 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.729+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.909 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.745+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.910 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.761+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.910 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.777+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.910 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.792+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.910 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.808+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.910 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.823+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.910 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.840+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.910 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.857+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.910 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.872+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.910 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.887+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.910 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.902+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:11.910 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.681+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.911 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.706+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.911 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.727+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.911 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.750+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.911 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.762+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.911 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.784+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.911 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.801+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.911 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.820+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.911 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.833+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.911 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.850+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.911 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.876+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:11.911 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.898+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.072 INFO:tasks.rados.rados.0.smithi084.stdout:1909: done (1 left) 2024-03-30T12:29:12.073 INFO:tasks.rados.rados.0.smithi084.stdout:1910: done (0 left) 2024-03-30T12:29:12.073 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 205 2024-03-30T12:29:12.073 INFO:tasks.rados.rados.0.smithi084.stdout:1911: seq_num 591 ranges {6610944=303104} 2024-03-30T12:29:12.111 INFO:tasks.rados.rados.0.smithi084.stdout:1911: writing smithi08477944-40 from 6610944 to 6914048 tid 1 2024-03-30T12:29:12.111 INFO:tasks.rados.rados.0.smithi084.stdout:1912: copy_from oid 27 from oid 9 current snap is 205 2024-03-30T12:29:12.111 INFO:tasks.rados.rados.0.smithi084.stdout:1913: snap_remove snap 174 2024-03-30T12:29:12.170 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-mon[83709]: osdmap e471: 8 total, 8 up, 8 in 2024-03-30T12:29:12.170 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:12.170 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:12.170 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:12.170 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:12.170 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:12.170 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:12.171 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.921+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.171 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.944+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.171 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.971+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.171 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:11.994+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.171 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.010+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.171 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.027+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.171 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.048+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.171 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.064+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.171 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.082+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.171 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.109+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.172 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.131+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.172 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.147+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.172 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.165+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.172 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.917+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.172 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.932+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.172 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.947+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.172 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.961+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.172 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.976+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.172 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:11.992+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.172 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.007+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.172 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.024+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.172 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.039+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.172 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.054+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.172 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.072+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.173 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.096+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.173 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.114+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.173 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.129+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.173 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.145+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.173 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.162+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.173 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.178+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.427 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.187+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.428 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.209+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.428 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.230+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.428 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.255+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.428 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.279+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.428 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.304+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.428 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.327+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.428 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.349+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.428 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.372+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.428 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.395+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.428 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.418+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.429 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.193+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.429 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.209+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.429 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.226+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.429 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.240+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.429 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.255+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.429 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.269+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.429 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.285+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.429 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.300+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.429 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.316+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.429 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.330+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.429 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.346+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.429 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.363+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.429 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.380+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.430 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.395+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.430 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.411+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.430 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.426+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:12.089+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:12.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:12.090+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:12.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:12 smithi084 ceph-mon[91810]: osdmap e471: 8 total, 8 up, 8 in 2024-03-30T12:29:12.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:12.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:12.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:12.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:12.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:12.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:12.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:12 smithi084 ceph-mon[89279]: osdmap e471: 8 total, 8 up, 8 in 2024-03-30T12:29:12.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:12.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:12.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:12.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:12.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:12.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:12.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:12.077+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:12.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:12.078+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:12.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:12.078+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:12.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:12.078+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:12.691 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.442+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.691 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.456+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.691 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.472+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.691 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.486+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.504+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.519+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.535+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.551+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.571+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.589+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.605+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.623+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.638+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.653+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.669+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.685+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.693 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.435+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.693 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.456+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.693 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.477+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.693 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.499+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.693 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.520+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.693 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.540+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.693 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.563+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.693 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.585+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.693 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.607+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.693 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.629+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.693 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.652+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.693 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.674+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.693 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.698+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.956 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.723+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.956 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.741+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.956 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.762+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.956 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.788+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.956 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.800+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.956 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.823+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.956 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.848+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.957 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.871+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.957 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.885+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.957 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.905+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.957 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.928+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.957 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.945+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:12.957 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.699+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.957 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.715+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.957 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.730+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.957 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.745+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.957 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.760+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.957 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.775+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.957 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.792+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.957 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.807+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.958 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.822+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.958 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.837+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.958 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.851+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.958 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.868+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.958 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.888+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.958 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.901+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.958 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.916+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.958 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.932+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.958 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.948+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:12.958 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.962+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.087 INFO:tasks.rados.rados.0.smithi084.stdout:1913: done (2 left) 2024-03-30T12:29:13.087 INFO:tasks.rados.rados.0.smithi084.stdout:1914: copy_from oid 32 from oid 2 current snap is 205 2024-03-30T12:29:13.087 INFO:tasks.rados.rados.0.smithi084.stdout:1915: rmattr oid 1 current snap is 205 2024-03-30T12:29:13.088 INFO:tasks.rados.rados.0.smithi084.stdout:1915: done (3 left) 2024-03-30T12:29:13.088 INFO:tasks.rados.rados.0.smithi084.stdout:1916: copy_from oid 42 from oid 13 current snap is 205 2024-03-30T12:29:13.088 INFO:tasks.rados.rados.0.smithi084.stdout:1917: snap_create 2024-03-30T12:29:13.088 INFO:tasks.rados.rados.0.smithi084.stdout:1912: finishing copy_from to smithi08477944-27 2024-03-30T12:29:13.088 INFO:tasks.rados.rados.0.smithi084.stdout:1912: got expected ENOENT (src dne) 2024-03-30T12:29:13.088 INFO:tasks.rados.rados.0.smithi084.stdout:1912: finishing copy_from racing read to smithi08477944-27 2024-03-30T12:29:13.088 INFO:tasks.rados.rados.0.smithi084.stdout:1911: finishing write tid 1 to smithi08477944-40 2024-03-30T12:29:13.088 INFO:tasks.rados.rados.0.smithi084.stdout:1911: finishing write tid 2 to smithi08477944-40 2024-03-30T12:29:13.088 INFO:tasks.rados.rados.0.smithi084.stdout:1911: finishing write tid 3 to smithi08477944-40 2024-03-30T12:29:13.088 INFO:tasks.rados.rados.0.smithi084.stdout:1911: oid 40 updating version 0 to 945 2024-03-30T12:29:13.088 INFO:tasks.rados.rados.0.smithi084.stdout:1911: oid 40 updating version 945 to 946 2024-03-30T12:29:13.088 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 946 (ObjNum 591 snap 205 seq_num 591) dirty exists 2024-03-30T12:29:13.088 INFO:tasks.rados.rados.0.smithi084.stdout:1911: left oid 40 (ObjNum 591 snap 205 seq_num 591) 2024-03-30T12:29:13.105 INFO:tasks.rados.rados.0.smithi084.stdout:1914: finishing copy_from to smithi08477944-32 2024-03-30T12:29:13.105 INFO:tasks.rados.rados.0.smithi084.stdout:1914: got expected ENOENT (src dne) 2024-03-30T12:29:13.105 INFO:tasks.rados.rados.0.smithi084.stdout:1914: finishing copy_from racing read to smithi08477944-32 2024-03-30T12:29:13.124 INFO:tasks.rados.rados.0.smithi084.stdout:1916: finishing copy_from racing read to smithi08477944-42 2024-03-30T12:29:13.125 INFO:tasks.rados.rados.0.smithi084.stdout:1916: finishing copy_from to smithi08477944-42 2024-03-30T12:29:13.125 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 883 (ObjNum 583 snap 198 seq_num 583) dirty exists 2024-03-30T12:29:13.209 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.979+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.210 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:12.996+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.210 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.011+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.210 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.027+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.210 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.045+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.210 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.063+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.210 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.079+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.210 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.102+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.210 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.126+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.210 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.144+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.210 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.159+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.210 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.177+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.210 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.197+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.211 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:13.211 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:13.211 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:13.211 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-mon[83709]: osdmap e472: 8 total, 8 up, 8 in 2024-03-30T12:29:13.211 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:13.211 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:13.211 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:13.211 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-mon[83709]: pgmap v391: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 347 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1023 B/s rd, 248 KiB/s wr, 13 op/s 2024-03-30T12:29:13.211 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.964+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.211 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:12.986+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.212 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.009+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.212 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.031+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.212 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.055+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.212 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.082+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.212 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.121+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.212 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.144+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.212 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.168+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.212 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.192+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.212 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.211+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.471 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.234+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.471 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.253+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.471 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.267+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.471 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.287+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.471 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.313+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.471 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.329+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.471 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.356+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.471 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.383+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.471 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.408+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.471 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.434+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.471 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.461+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.471 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.477+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.217+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.235+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.251+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.269+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.288+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.306+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.327+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.345+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.364+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.379+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.394+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.412+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.473 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.431+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.473 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.448+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.473 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.465+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:13.098+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:13.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:13.099+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:13.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:13.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:13.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:13.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:13 smithi084 ceph-mon[91810]: osdmap e472: 8 total, 8 up, 8 in 2024-03-30T12:29:13.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:13.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:13.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:13.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:13 smithi084 ceph-mon[91810]: pgmap v391: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 347 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1023 B/s rd, 248 KiB/s wr, 13 op/s 2024-03-30T12:29:13.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:13.102+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:13.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:13.103+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:13.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:13.103+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:13.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:13.103+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:13.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:13.103+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:13.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:13.103+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:13.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:13.104+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:13.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:13.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:13.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:13.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:13 smithi084 ceph-mon[89279]: osdmap e472: 8 total, 8 up, 8 in 2024-03-30T12:29:13.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:13.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:13.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:13.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:13 smithi084 ceph-mon[89279]: pgmap v391: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 347 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 1023 B/s rd, 248 KiB/s wr, 13 op/s 2024-03-30T12:29:13.731 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.501+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.731 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.527+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.731 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.549+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.731 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.578+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.731 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.604+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.731 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.618+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.731 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.641+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.732 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.670+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.732 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.697+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.732 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.716+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.732 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.737+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.732 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.486+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.732 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.505+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.732 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.522+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.732 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.540+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.732 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.557+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.732 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.573+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.732 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.594+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.733 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.612+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.733 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.630+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.733 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.653+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.733 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.670+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.733 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.688+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.733 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.704+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.733 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.724+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.989 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.763+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.989 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.790+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.989 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.818+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.989 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.842+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.989 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.873+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.989 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.898+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.989 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.922+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.989 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.951+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.989 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:13.978+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:13.990 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.742+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.990 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.760+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.990 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.776+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.990 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.796+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.990 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.813+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.990 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.830+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.990 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.849+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.990 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.867+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.990 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.892+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.990 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.911+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.991 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.926+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.991 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.943+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.991 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.961+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.991 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.978+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:13.991 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:13.996+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.098 INFO:tasks.rados.rados.0.smithi084.stdout:1911: done (4 left) 2024-03-30T12:29:14.098 INFO:tasks.rados.rados.0.smithi084.stdout:1912: done (3 left) 2024-03-30T12:29:14.098 INFO:tasks.rados.rados.0.smithi084.stdout:1914: done (2 left) 2024-03-30T12:29:14.098 INFO:tasks.rados.rados.0.smithi084.stdout:1916: done (1 left) 2024-03-30T12:29:14.098 INFO:tasks.rados.rados.0.smithi084.stdout:1917: done (0 left) 2024-03-30T12:29:14.098 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 206 2024-03-30T12:29:14.098 INFO:tasks.rados.rados.0.smithi084.stdout:1918: seq_num 592 ranges {6914048=319488} 2024-03-30T12:29:14.137 INFO:tasks.rados.rados.0.smithi084.stdout:1918: writing smithi08477944-40 from 6914048 to 7233536 tid 1 2024-03-30T12:29:14.137 INFO:tasks.rados.rados.0.smithi084.stdout:1919: setattr oid 23 current snap is 206 2024-03-30T12:29:14.140 INFO:tasks.rados.rados.0.smithi084.stdout:1920: delete oid 21 current snap is 206 2024-03-30T12:29:14.143 INFO:tasks.rados.rados.0.smithi084.stdout:1918: finishing write tid 1 to smithi08477944-40 2024-03-30T12:29:14.143 INFO:tasks.rados.rados.0.smithi084.stdout:1918: finishing write tid 2 to smithi08477944-40 2024-03-30T12:29:14.145 INFO:tasks.rados.rados.0.smithi084.stdout:1918: finishing write tid 3 to smithi08477944-40 2024-03-30T12:29:14.145 INFO:tasks.rados.rados.0.smithi084.stdout:1918: oid 40 updating version 0 to 949 2024-03-30T12:29:14.145 INFO:tasks.rados.rados.0.smithi084.stdout:1918: oid 40 version 949 is already newer than 948 2024-03-30T12:29:14.146 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 949 (ObjNum 592 snap 206 seq_num 592) dirty exists 2024-03-30T12:29:14.146 INFO:tasks.rados.rados.0.smithi084.stdout:1918: left oid 40 (ObjNum 592 snap 206 seq_num 592) 2024-03-30T12:29:14.146 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 832 (ObjNum 574 snap 197 seq_num 574) dirty exists 2024-03-30T12:29:14.152 INFO:tasks.rados.rados.0.smithi084.stdout:1918: done (2 left) 2024-03-30T12:29:14.152 INFO:tasks.rados.rados.0.smithi084.stdout:1919: done (1 left) 2024-03-30T12:29:14.153 INFO:tasks.rados.rados.0.smithi084.stdout:1920: done (0 left) 2024-03-30T12:29:14.153 INFO:tasks.rados.rados.0.smithi084.stdout:1921: read oid 41 snap -1 2024-03-30T12:29:14.153 INFO:tasks.rados.rados.0.smithi084.stdout:1921: expect (ObjNum 564 snap 194 seq_num 564) 2024-03-30T12:29:14.153 INFO:tasks.rados.rados.0.smithi084.stdout:1922: rollback oid 4 current snap is 206 2024-03-30T12:29:14.153 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 4 to 204 2024-03-30T12:29:14.153 INFO:tasks.rados.rados.0.smithi084.stdout:1923: setattr oid 3 current snap is 206 2024-03-30T12:29:14.154 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 206 2024-03-30T12:29:14.155 INFO:tasks.rados.rados.0.smithi084.stdout:1924: seq_num 594 ranges {0=352256} 2024-03-30T12:29:14.157 INFO:tasks.rados.rados.0.smithi084.stdout:1924: writing smithi08477944-10 from 0 to 352256 tid 1 2024-03-30T12:29:14.157 INFO:tasks.rados.rados.0.smithi084.stdout:1925: copy_from oid 47 from oid 11 current snap is 206 2024-03-30T12:29:14.157 INFO:tasks.rados.rados.0.smithi084.stdout:1926: snap_remove snap 184 2024-03-30T12:29:14.241 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-mon[83709]: osdmap e473: 8 total, 8 up, 8 in 2024-03-30T12:29:14.241 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:14.241 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:14.241 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:14.241 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:14.241 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:14.241 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:14.241 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.013+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.242 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.031+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.242 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.050+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.242 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.068+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.242 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.086+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.242 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.106+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.242 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.129+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.242 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.146+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.242 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.166+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.242 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.188+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.242 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.209+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.242 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.227+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.242 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.243+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.243 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.005+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.243 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.031+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.243 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.055+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.243 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.082+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.243 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.103+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.243 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.129+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.243 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.156+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.243 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.179+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.243 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.200+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.243 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.221+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.243 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.249+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:14.105+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:14.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:14.105+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:14.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:14.104+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:14.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:14.104+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:14.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:14.105+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:14.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:14.106+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:14.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:14 smithi084 ceph-mon[91810]: osdmap e473: 8 total, 8 up, 8 in 2024-03-30T12:29:14.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:14.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:14.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:14.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:14.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:14.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:14.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:14 smithi084 ceph-mon[89279]: osdmap e473: 8 total, 8 up, 8 in 2024-03-30T12:29:14.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:14.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:14.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:14.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:14.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:14.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:14.506 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.280+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.506 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.302+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.506 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.329+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.506 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.356+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.506 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.384+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.506 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.411+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.507 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.436+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.507 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.466+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.507 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.481+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.507 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.498+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.507 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.261+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.507 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.279+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.507 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.297+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.507 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.313+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.507 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.332+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.507 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.349+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.507 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.366+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.507 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.384+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.508 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.402+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.508 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.420+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.508 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.440+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.508 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.458+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.508 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.476+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.508 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.495+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.771 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.519+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.772 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.544+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.772 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.573+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.772 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.590+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.772 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.616+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.772 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.642+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.772 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.668+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.772 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.694+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.772 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.721+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.772 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.736+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.772 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.764+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:14.772 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.514+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.533+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.550+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.569+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.590+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.607+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.624+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.640+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.657+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.674+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.692+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.708+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.726+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.746+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.761+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:14.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.779+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.023 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.791+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.024 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.816+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.024 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.829+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.024 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.856+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.024 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.884+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.024 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.910+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.024 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.935+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.024 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.959+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.024 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:14.983+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.024 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.009+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.024 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.031+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.024 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.797+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.025 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.814+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.025 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.834+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.025 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.851+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.025 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.869+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.025 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.886+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.025 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.903+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.025 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.920+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.025 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.935+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.025 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.952+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.025 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.968+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.025 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.983+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.025 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:14.998+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.025 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.014+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.025 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.031+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.111 INFO:tasks.rados.rados.0.smithi084.stdout:1926: done (5 left) 2024-03-30T12:29:15.112 INFO:tasks.rados.rados.0.smithi084.stdout:1927: snap_create 2024-03-30T12:29:15.112 INFO:tasks.rados.rados.0.smithi084.stdout:1922: finishing rollback tid 0 to smithi08477944-4 2024-03-30T12:29:15.112 INFO:tasks.rados.rados.0.smithi084.stdout:1922: finishing rollback tid 1 to smithi08477944-4 2024-03-30T12:29:15.112 INFO:tasks.rados.rados.0.smithi084.stdout:1922: finishing rollback tid 2 to smithi08477944-4 2024-03-30T12:29:15.112 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 817 (ObjNum 475 snap 150 seq_num 475) dirty exists 2024-03-30T12:29:15.112 INFO:tasks.rados.rados.0.smithi084.stdout:1921: expect (ObjNum 564 snap 194 seq_num 564) 2024-03-30T12:29:15.193 INFO:tasks.rados.rados.0.smithi084.stdout:1924: finishing write tid 1 to smithi08477944-10 2024-03-30T12:29:15.194 INFO:tasks.rados.rados.0.smithi084.stdout:1924: finishing write tid 2 to smithi08477944-10 2024-03-30T12:29:15.194 INFO:tasks.rados.rados.0.smithi084.stdout:1924: finishing write tid 3 to smithi08477944-10 2024-03-30T12:29:15.194 INFO:tasks.rados.rados.0.smithi084.stdout:1924: oid 10 updating version 0 to 817 2024-03-30T12:29:15.194 INFO:tasks.rados.rados.0.smithi084.stdout:1924: oid 10 updating version 817 to 818 2024-03-30T12:29:15.194 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 818 (ObjNum 594 snap 206 seq_num 594) dirty exists 2024-03-30T12:29:15.194 INFO:tasks.rados.rados.0.smithi084.stdout:1924: left oid 10 (ObjNum 594 snap 206 seq_num 594) 2024-03-30T12:29:15.194 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 6542 (ObjNum 498 snap 156 seq_num 498) dirty exists 2024-03-30T12:29:15.194 INFO:tasks.rados.rados.0.smithi084.stdout:1925: finishing copy_from racing read to smithi08477944-47 2024-03-30T12:29:15.194 INFO:tasks.rados.rados.0.smithi084.stdout:1925: finishing copy_from to smithi08477944-47 2024-03-30T12:29:15.194 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 924 (ObjNum 280 snap 90 seq_num 280) dirty exists 2024-03-30T12:29:15.274 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.049+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.274 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.065+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.274 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.085+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.274 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.101+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.274 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.125+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.274 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.142+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.274 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.158+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.275 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.175+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.275 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.192+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.275 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.206+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.275 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.222+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.275 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.238+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.275 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.253+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.275 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.269+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.275 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:15.275 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-mon[83709]: osdmap e474: 8 total, 8 up, 8 in 2024-03-30T12:29:15.275 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:15.275 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:15.276 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:15.276 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:15.276 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:15.276 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-mon[83709]: pgmap v394: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 347 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 511 B/s rd, 140 KiB/s wr, 6 op/s 2024-03-30T12:29:15.276 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:15.276 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:29:15.276 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:15.276 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.047+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.276 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.072+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.276 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.094+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.276 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.113+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.276 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.137+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.277 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.150+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.277 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.175+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.277 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.197+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.277 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.225+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.277 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.250+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.277 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.268+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.277 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.282+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:15.117+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:15.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:15.117+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:15.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:15.115+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:15.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:15.115+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:15.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:15.117+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:15.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:15.117+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:15.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:15.117+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:15.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:15.118+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:15.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:15.118+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:15.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:15.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-mon[91810]: osdmap e474: 8 total, 8 up, 8 in 2024-03-30T12:29:15.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:15.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:15.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:15.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:15.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:15.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-mon[91810]: pgmap v394: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 347 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 511 B/s rd, 140 KiB/s wr, 6 op/s 2024-03-30T12:29:15.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:15.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:29:15.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:15.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:15.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-mon[89279]: osdmap e474: 8 total, 8 up, 8 in 2024-03-30T12:29:15.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:15.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:15.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:15.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:15.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:15.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-mon[89279]: pgmap v394: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 347 MiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 511 B/s rd, 140 KiB/s wr, 6 op/s 2024-03-30T12:29:15.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:15.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:29:15.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:15 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:15.533 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.286+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.533 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.302+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.533 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.317+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.533 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.332+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.533 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.347+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.533 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.363+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.533 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.380+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.534 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.397+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.534 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.414+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.534 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.430+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.534 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.447+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.534 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.463+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.534 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.478+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.534 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.493+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.534 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.510+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.534 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.526+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.534 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.301+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.535 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.330+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.535 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.354+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.535 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.379+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.535 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.401+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.535 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.418+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.535 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.437+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.535 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.450+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.535 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.475+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.535 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.499+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.535 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.524+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.798 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.550+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.798 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.571+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.798 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.597+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.798 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.622+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.798 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.649+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.798 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.663+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.798 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.687+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.798 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.705+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.798 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.731+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.798 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.756+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.798 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.783+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:15.799 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.540+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.799 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.557+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.799 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.572+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.799 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.587+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.799 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.604+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.799 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.618+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.799 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.634+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.799 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.648+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.799 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.664+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.680+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.693+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.710+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.726+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.741+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.759+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.774+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.789+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:15.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.805+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.806+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.826+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.854+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.879+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.897+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.917+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.942+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.956+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:15.980+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.062 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.004+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.062 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.029+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.062 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.055+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.062 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.820+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.062 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.836+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.062 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.851+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.062 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.866+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.062 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.881+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.062 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.897+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.062 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.912+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.063 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.929+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.063 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.943+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.063 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.960+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.063 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.975+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.063 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:15.989+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.063 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.004+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.063 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.021+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.063 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.036+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.063 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.051+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.063 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.068+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.115 INFO:tasks.rados.rados.0.smithi084.stdout:1921: done (5 left) 2024-03-30T12:29:16.115 INFO:tasks.rados.rados.0.smithi084.stdout:1922: done (4 left) 2024-03-30T12:29:16.115 INFO:tasks.rados.rados.0.smithi084.stdout:1923: done (3 left) 2024-03-30T12:29:16.115 INFO:tasks.rados.rados.0.smithi084.stdout:1924: done (2 left) 2024-03-30T12:29:16.115 INFO:tasks.rados.rados.0.smithi084.stdout:1925: done (1 left) 2024-03-30T12:29:16.115 INFO:tasks.rados.rados.0.smithi084.stdout:1927: done (0 left) 2024-03-30T12:29:16.115 INFO:tasks.rados.rados.0.smithi084.stdout:1928: rollback oid 29 current snap is 207 2024-03-30T12:29:16.115 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 29 to 205 2024-03-30T12:29:16.115 INFO:tasks.rados.rados.0.smithi084.stdout:1929: snap_remove snap 206 2024-03-30T12:29:16.319 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.086+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.319 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.100+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.319 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.119+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.319 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.137+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.319 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.153+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.319 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.167+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.319 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.183+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.319 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.201+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.319 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.217+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.319 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.232+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.319 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.247+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.320 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.263+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.320 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.278+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.320 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.293+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.320 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.309+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.320 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:16.320 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-mon[83709]: osdmap e475: 8 total, 8 up, 8 in 2024-03-30T12:29:16.320 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:16.320 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:16.321 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:16.321 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:16.321 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:16.321 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.078+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.321 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.091+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.321 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.116+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.321 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.146+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.321 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.170+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.321 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.186+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.321 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.204+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.321 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.229+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.321 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.253+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.322 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.279+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.322 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.304+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.322 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.327+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:16.125+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:16.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:16.125+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:16.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:16.125+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:16.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:16.126+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:16.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:16.126+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:16.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:16.127+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:16.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:16.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:16 smithi084 ceph-mon[89279]: osdmap e475: 8 total, 8 up, 8 in 2024-03-30T12:29:16.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:16.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:16.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:16.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:16.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:16.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:16.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:16 smithi084 ceph-mon[91810]: osdmap e475: 8 total, 8 up, 8 in 2024-03-30T12:29:16.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:16.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:16.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:16.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:16.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:16.583 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.327+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.583 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.342+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.583 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.357+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.583 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.371+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.583 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.387+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.583 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.403+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.583 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.417+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.583 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.433+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.584 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.450+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.584 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.465+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.584 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.480+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.584 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.495+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.584 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.511+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.584 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.526+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.584 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.541+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.584 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.558+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.584 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.574+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.584 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.590+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.585 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.352+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.585 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.376+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.585 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.400+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.585 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.423+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.585 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.437+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.585 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.460+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.585 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.488+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.585 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.511+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.585 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.536+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.585 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.551+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.586 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.573+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.836 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.598+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.836 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.623+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.836 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.641+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.836 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.668+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.836 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.681+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.836 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.706+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.836 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.730+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.836 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.756+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.836 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.783+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.836 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.806+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.836 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.833+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:16.837 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.607+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.837 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.623+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.837 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.638+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.837 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.655+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.837 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.672+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.837 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.688+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.837 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.703+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.837 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.718+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.837 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.736+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.837 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.752+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.837 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.766+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.837 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.781+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.837 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.798+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.838 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.813+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.838 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.828+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:16.838 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.844+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.096 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.860+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.096 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.874+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.096 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.898+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.096 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.924+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.096 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.948+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.097 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.966+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.097 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:16.980+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.097 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.000+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.097 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.013+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.097 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.038+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.097 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.061+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.097 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.088+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.097 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.860+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.097 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.879+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.097 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.895+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.098 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.912+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.098 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.927+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.098 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.943+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.098 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.958+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.098 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.974+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.098 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:16.992+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.098 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.009+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.098 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.024+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.098 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.040+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.098 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.055+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.098 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.070+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.099 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.085+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.099 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.104+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.117 INFO:tasks.rados.rados.0.smithi084.stdout:1929: done (1 left) 2024-03-30T12:29:17.117 INFO:tasks.rados.rados.0.smithi084.stdout:1930: rollback oid 42 current snap is 207 2024-03-30T12:29:17.118 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 42 to 201 2024-03-30T12:29:17.118 INFO:tasks.rados.rados.0.smithi084.stdout:1928: finishing rollback tid 1 to smithi08477944-29 2024-03-30T12:29:17.118 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 814 (ObjNum 929 snap 0 seq_num 178852701) dirty dne 2024-03-30T12:29:17.118 INFO:tasks.rados.rados.0.smithi084.stdout:1928: done (1 left) 2024-03-30T12:29:17.118 INFO:tasks.rados.rados.0.smithi084.stdout:1931: delete oid 11 current snap is 207 2024-03-30T12:29:17.123 INFO:tasks.rados.rados.0.smithi084.stdout:1930: finishing rollback tid 0 to smithi08477944-42 2024-03-30T12:29:17.123 INFO:tasks.rados.rados.0.smithi084.stdout:1930: finishing rollback tid 1 to smithi08477944-42 2024-03-30T12:29:17.124 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 944 (ObjNum 177 snap 0 seq_num 194169681) dirty dne 2024-03-30T12:29:17.128 INFO:tasks.rados.rados.0.smithi084.stdout:1930: done (1 left) 2024-03-30T12:29:17.128 INFO:tasks.rados.rados.0.smithi084.stdout:1931: done (0 left) 2024-03-30T12:29:17.128 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 207 2024-03-30T12:29:17.128 INFO:tasks.rados.rados.0.smithi084.stdout:1932: seq_num 596 ranges {7061504=385024} 2024-03-30T12:29:17.170 INFO:tasks.rados.rados.0.smithi084.stdout:1932: writing smithi08477944-34 from 7061504 to 7446528 tid 1 2024-03-30T12:29:17.170 INFO:tasks.rados.rados.0.smithi084.stdout:1933: rmattr oid 44 current snap is 207 2024-03-30T12:29:17.170 INFO:tasks.rados.rados.0.smithi084.stdout:1934: rmattr oid 10 current snap is 207 2024-03-30T12:29:17.170 INFO:tasks.rados.rados.0.smithi084.stdout:1934: done (2 left) 2024-03-30T12:29:17.171 INFO:tasks.rados.rados.0.smithi084.stdout:1935: copy_from oid 23 from oid 37 current snap is 207 2024-03-30T12:29:17.171 INFO:tasks.rados.rados.0.smithi084.stdout:1936: copy_from oid 11 from oid 50 current snap is 207 2024-03-30T12:29:17.171 INFO:tasks.rados.rados.0.smithi084.stdout:1937: snap_remove snap 181 2024-03-30T12:29:17.347 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.121+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.347 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.141+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.347 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.157+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.347 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.172+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.347 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.191+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.347 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.208+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.347 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.224+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.347 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.239+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.347 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.253+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.347 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.270+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.347 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.286+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.348 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.300+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.348 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.315+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.348 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.332+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.348 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.349+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.348 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-mon[83709]: osdmap e476: 8 total, 8 up, 8 in 2024-03-30T12:29:17.348 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:17.348 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:17.348 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:17.348 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:17.348 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:17.349 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:17.349 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-mon[83709]: pgmap v397: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 357 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 511 B/s rd, 2.9 MiB/s wr, 13 op/s 2024-03-30T12:29:17.349 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.111+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.349 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.137+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.349 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.156+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.349 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.176+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.349 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.205+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.349 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.227+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.349 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.253+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.349 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.268+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.350 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.291+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.350 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.317+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.350 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.334+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.350 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.354+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:17.124+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:17.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:17.126+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:17.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:17 smithi084 ceph-mon[89279]: osdmap e476: 8 total, 8 up, 8 in 2024-03-30T12:29:17.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:17.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:17.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:17.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:17.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:17.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:17.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:17 smithi084 ceph-mon[89279]: pgmap v397: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 357 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 511 B/s rd, 2.9 MiB/s wr, 13 op/s 2024-03-30T12:29:17.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:17 smithi084 ceph-mon[91810]: osdmap e476: 8 total, 8 up, 8 in 2024-03-30T12:29:17.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:17.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:17.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:17.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:17.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:17.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:17.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:17 smithi084 ceph-mon[91810]: pgmap v397: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 357 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 511 B/s rd, 2.9 MiB/s wr, 13 op/s 2024-03-30T12:29:17.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:17.121+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:17.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:17.121+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:17.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:17.122+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:17.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:17.122+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:17.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:17.124+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:17.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:17.124+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:17.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:17.124+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:17.599 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.369+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.599 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.383+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.599 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.404+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.599 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.423+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.599 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.442+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.599 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.471+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.600 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.496+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.600 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.522+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.600 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.546+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.600 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.559+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.600 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.583+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.600 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.598+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.600 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.365+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.600 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.386+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.600 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.403+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.600 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.419+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.600 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.435+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.451+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.466+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.481+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.496+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.512+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.527+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.543+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.559+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.574+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.590+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.867 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.607+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.867 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.622+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.867 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.639+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.868 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.656+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.868 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.671+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.868 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.685+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.868 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.699+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.868 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.714+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.868 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.730+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.868 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.745+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.868 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.761+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.868 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.776+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.868 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.792+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.868 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.809+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.825+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.840+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.856+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.873+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:17.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.623+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.637+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.660+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.685+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.716+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.741+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.759+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.782+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.806+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.830+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:17.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.854+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.889+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.904+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.920+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.935+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.953+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.968+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.982+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:17.997+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.011+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.028+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.047+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.065+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.081+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.098+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.114+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:18.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:18.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-mon[83709]: osdmap e477: 8 total, 8 up, 8 in 2024-03-30T12:29:18.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:18.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:18.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:18.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:18.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.877+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.902+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.927+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.952+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:17.981+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.005+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.032+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.122 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.050+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.122 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.080+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.122 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.106+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.122 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.126+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.130 INFO:tasks.rados.rados.0.smithi084.stdout:1937: done (4 left) 2024-03-30T12:29:18.131 INFO:tasks.rados.rados.0.smithi084.stdout:1938: rollback oid 1 current snap is 207 2024-03-30T12:29:18.131 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 1 to 204 2024-03-30T12:29:18.131 INFO:tasks.rados.rados.0.smithi084.stdout:1932: finishing write tid 1 to smithi08477944-34 2024-03-30T12:29:18.131 INFO:tasks.rados.rados.0.smithi084.stdout:1935: finishing copy_from racing read to smithi08477944-23 2024-03-30T12:29:18.131 INFO:tasks.rados.rados.0.smithi084.stdout:1932: finishing write tid 2 to smithi08477944-34 2024-03-30T12:29:18.131 INFO:tasks.rados.rados.0.smithi084.stdout:1935: finishing copy_from to smithi08477944-23 2024-03-30T12:29:18.131 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 816 (ObjNum 590 snap 203 seq_num 590) dirty exists 2024-03-30T12:29:18.131 INFO:tasks.rados.rados.0.smithi084.stdout:1932: finishing write tid 3 to smithi08477944-34 2024-03-30T12:29:18.131 INFO:tasks.rados.rados.0.smithi084.stdout:1932: oid 34 updating version 0 to 905 2024-03-30T12:29:18.131 INFO:tasks.rados.rados.0.smithi084.stdout:1932: oid 34 version 905 is already newer than 904 2024-03-30T12:29:18.131 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 905 (ObjNum 596 snap 207 seq_num 596) dirty exists 2024-03-30T12:29:18.131 INFO:tasks.rados.rados.0.smithi084.stdout:1932: left oid 34 (ObjNum 596 snap 207 seq_num 596) 2024-03-30T12:29:18.131 INFO:tasks.rados.rados.0.smithi084.stdout:1936: finishing copy_from racing read to smithi08477944-11 2024-03-30T12:29:18.132 INFO:tasks.rados.rados.0.smithi084.stdout:1936: finishing copy_from to smithi08477944-11 2024-03-30T12:29:18.132 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 938 (ObjNum 585 snap 199 seq_num 585) dirty exists 2024-03-30T12:29:18.132 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 20036 (ObjNum 489 snap 154 seq_num 489) dirty exists 2024-03-30T12:29:18.132 INFO:tasks.rados.rados.0.smithi084.stdout:1932: done (4 left) 2024-03-30T12:29:18.132 INFO:tasks.rados.rados.0.smithi084.stdout:1933: done (3 left) 2024-03-30T12:29:18.132 INFO:tasks.rados.rados.0.smithi084.stdout:1935: done (2 left) 2024-03-30T12:29:18.132 INFO:tasks.rados.rados.0.smithi084.stdout:1936: done (1 left) 2024-03-30T12:29:18.132 INFO:tasks.rados.rados.0.smithi084.stdout:1939: rollback oid 9 current snap is 207 2024-03-30T12:29:18.132 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 9 to 204 2024-03-30T12:29:18.132 INFO:tasks.rados.rados.0.smithi084.stdout:1940: read oid 48 snap -1 2024-03-30T12:29:18.132 INFO:tasks.rados.rados.0.smithi084.stdout:1940: expect (ObjNum 576 snap 197 seq_num 576) 2024-03-30T12:29:18.132 INFO:tasks.rados.rados.0.smithi084.stdout:1941: rollback oid 47 current snap is 207 2024-03-30T12:29:18.132 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 172 2024-03-30T12:29:18.132 INFO:tasks.rados.rados.0.smithi084.stdout:1942: snap_remove snap 191 2024-03-30T12:29:18.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.133+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.157+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.174+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.191+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.208+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.223+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.240+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.257+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.274+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.290+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.307+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.322+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.338+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.353+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.369+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.150+0000 7f8304b4e700 -1 osd.5 pg_epoch: 478 pg[5.4s2( v 478'659 (0'0,478'659] local-lis/les=461/462 n=8 ec=71/71 lis/c=461/461 les/c/f=462/462/0 sis=461) [7,2,5]p7(0) r=2 lpr=461 luod=0'0 crt=477'657 mlcod 477'657 active mbc={} ps=[97~1,99~1,9d~1,a0~2,a8~3f,e8~3,ec~8,f5~6,fc~2,100~1,102~1,104~1,10a~1,10d~1]] update_snap_map remove_oid 5:2bd7b7a9:::smithi08477944-11:f5 failed with -2 2024-03-30T12:29:18.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.161+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.179+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.200+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.214+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.372 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.229+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.372 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.249+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.372 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.269+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.372 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.282+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.372 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.297+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.372 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.320+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.372 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.339+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.372 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.359+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:18.137+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:18.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:18.138+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:18.504 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:29:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3[111861]: 2024-03-30T12:29:18.147+0000 7fa6ff147700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap f4 after trimming was started 2024-03-30T12:29:18.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:18.143+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:18.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:18.147+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:18.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:18.148+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:18.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:18.148+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:18.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:18.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:18.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:18 smithi084 ceph-mon[89279]: osdmap e477: 8 total, 8 up, 8 in 2024-03-30T12:29:18.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:18.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:18.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:18.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:18.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:18.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:18.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:18 smithi084 ceph-mon[91810]: osdmap e477: 8 total, 8 up, 8 in 2024-03-30T12:29:18.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:18.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:18.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:18.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:18.633 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.386+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.633 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.413+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.633 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.431+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.633 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.453+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.633 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.473+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.634 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.487+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.634 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.508+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.634 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.536+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.634 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.563+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.634 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.588+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.634 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.602+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.634 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.616+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.634 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.384+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.634 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.401+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.415+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.433+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.449+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.464+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.481+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.499+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.513+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.530+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.546+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.561+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.578+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.593+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.610+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.625+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.636 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.641+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.898 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.643+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.898 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.670+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.898 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.695+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.898 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.713+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.898 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.732+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.899 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.760+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.899 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.787+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.899 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.801+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.899 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.824+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.899 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.848+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.899 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.875+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.899 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.891+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:18.899 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.656+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.899 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.675+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.899 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.689+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.899 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.704+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.899 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.725+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.900 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.742+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.900 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.757+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.900 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.774+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.900 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.788+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.900 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.806+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.900 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.824+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.900 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.841+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.900 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.858+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.900 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.873+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.900 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.890+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:18.901 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.905+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.143 INFO:tasks.rados.rados.0.smithi084.stdout:1942: done (4 left) 2024-03-30T12:29:19.143 INFO:tasks.rados.rados.0.smithi084.stdout:1943: rollback oid 40 current snap is 207 2024-03-30T12:29:19.143 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 40 to 194 2024-03-30T12:29:19.143 INFO:tasks.rados.rados.0.smithi084.stdout:1940: expect (ObjNum 576 snap 197 seq_num 576) 2024-03-30T12:29:19.145 INFO:tasks.rados.rados.0.smithi084.stdout:1938: finishing rollback tid 1 to smithi08477944-1 2024-03-30T12:29:19.145 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 674 (ObjNum 129 snap 0 seq_num 1430175072) dirty dne 2024-03-30T12:29:19.145 INFO:tasks.rados.rados.0.smithi084.stdout:1941: finishing rollback tid 0 to smithi08477944-47 2024-03-30T12:29:19.145 INFO:tasks.rados.rados.0.smithi084.stdout:1941: finishing rollback tid 1 to smithi08477944-47 2024-03-30T12:29:19.145 INFO:tasks.rados.rados.0.smithi084.stdout:1941: finishing rollback tid 2 to smithi08477944-47 2024-03-30T12:29:19.145 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 954 (ObjNum 511 snap 162 seq_num 511) dirty exists 2024-03-30T12:29:19.146 INFO:tasks.rados.rados.0.smithi084.stdout:1939: finishing rollback tid 1 to smithi08477944-9 2024-03-30T12:29:19.146 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 561 (ObjNum 161 snap 0 seq_num 0) dirty dne 2024-03-30T12:29:19.146 INFO:tasks.rados.rados.0.smithi084.stdout:1938: done (4 left) 2024-03-30T12:29:19.146 INFO:tasks.rados.rados.0.smithi084.stdout:1939: done (3 left) 2024-03-30T12:29:19.146 INFO:tasks.rados.rados.0.smithi084.stdout:1940: done (2 left) 2024-03-30T12:29:19.146 INFO:tasks.rados.rados.0.smithi084.stdout:1941: done (1 left) 2024-03-30T12:29:19.146 INFO:tasks.rados.rados.0.smithi084.stdout:1944: delete oid 36 current snap is 207 2024-03-30T12:29:19.151 INFO:tasks.rados.rados.0.smithi084.stdout:1944: done (1 left) 2024-03-30T12:29:19.151 INFO:tasks.rados.rados.0.smithi084.stdout:1945: rollback oid 34 current snap is 207 2024-03-30T12:29:19.151 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 34 to 199 2024-03-30T12:29:19.151 INFO:tasks.rados.rados.0.smithi084.stdout:1946: snap_create 2024-03-30T12:29:19.151 INFO:tasks.rados.rados.0.smithi084.stdout:1943: finishing rollback tid 0 to smithi08477944-40 2024-03-30T12:29:19.151 INFO:tasks.rados.rados.0.smithi084.stdout:1943: finishing rollback tid 1 to smithi08477944-40 2024-03-30T12:29:19.152 INFO:tasks.rados.rados.0.smithi084.stdout:1943: finishing rollback tid 2 to smithi08477944-40 2024-03-30T12:29:19.152 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 957 (ObjNum 546 snap 185 seq_num 546) dirty exists 2024-03-30T12:29:19.157 INFO:tasks.rados.rados.0.smithi084.stdout:1945: finishing rollback tid 0 to smithi08477944-34 2024-03-30T12:29:19.157 INFO:tasks.rados.rados.0.smithi084.stdout:1945: finishing rollback tid 1 to smithi08477944-34 2024-03-30T12:29:19.157 INFO:tasks.rados.rados.0.smithi084.stdout:1945: finishing rollback tid 2 to smithi08477944-34 2024-03-30T12:29:19.157 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 908 (ObjNum 523 snap 171 seq_num 523) dirty exists 2024-03-30T12:29:19.165 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:19.165 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-mon[83709]: osdmap e478: 8 total, 8 up, 8 in 2024-03-30T12:29:19.165 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:19.165 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:19.165 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:19.165 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:19.166 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:19.166 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-mon[83709]: pgmap v400: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 358 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.6 MiB/s rd, 4.3 MiB/s wr, 15 op/s 2024-03-30T12:29:19.166 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.916+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.166 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.930+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.166 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.954+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.166 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.977+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.166 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:18.991+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.166 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.017+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.166 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.036+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.167 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.053+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.167 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.079+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.167 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.105+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.167 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.118+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.167 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.146+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.167 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.921+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.167 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.936+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.167 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.952+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.167 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.969+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.167 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:18.984+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.168 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.000+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.168 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.015+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.168 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.031+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.168 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.049+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.168 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.063+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.168 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.079+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.168 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.095+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.168 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.113+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.168 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.128+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.168 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.150+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.168 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.173+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.404 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:29:19] "GET /metrics HTTP/1.1" 200 36253 "" "Prometheus/2.43.0" 2024-03-30T12:29:19.404 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:19.146+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:19.404 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:19.146+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:19.404 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:19.146+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:19.405 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:19.146+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:19.405 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:19.146+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:19.405 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:19.147+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:19.405 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:19.147+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:19.405 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:19.151+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:19.405 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:19.151+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:19.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:19.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-mon[89279]: osdmap e478: 8 total, 8 up, 8 in 2024-03-30T12:29:19.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:19.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:19.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:19.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:19.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:19.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-mon[89279]: pgmap v400: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 358 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.6 MiB/s rd, 4.3 MiB/s wr, 15 op/s 2024-03-30T12:29:19.406 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:19.406 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-mon[91810]: osdmap e478: 8 total, 8 up, 8 in 2024-03-30T12:29:19.406 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:19.406 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:19.407 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:19.407 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:19.407 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:19.407 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:19 smithi084 ceph-mon[91810]: pgmap v400: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 358 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 1.6 MiB/s rd, 4.3 MiB/s wr, 15 op/s 2024-03-30T12:29:19.420 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.179+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.420 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.199+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.420 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.219+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.421 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.233+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.421 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.253+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.421 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.282+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.421 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.296+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.421 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.321+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.421 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.346+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.421 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.373+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.421 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.398+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.421 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.420+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.421 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.190+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.421 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.206+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.422 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.221+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.422 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.237+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.422 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.253+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.422 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.267+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.422 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.282+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.422 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.300+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.422 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.315+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.422 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.329+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.422 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.344+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.422 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.360+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.422 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.376+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.422 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.393+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.423 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.411+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.681 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.439+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.682 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.463+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.682 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.485+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.682 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.505+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.682 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.531+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.682 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.560+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.682 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.589+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.682 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.615+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.682 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.641+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.682 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.669+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.683 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.428+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.683 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.447+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.683 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.464+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.683 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.480+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.683 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.500+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.683 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.517+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.683 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.538+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.683 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.556+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.683 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.577+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.683 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.597+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.683 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.617+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.684 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.635+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.684 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.654+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.684 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.673+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.684 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.689+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.937 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.707+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.937 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.727+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.937 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.747+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.937 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.765+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.937 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.782+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.937 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.801+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.937 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.818+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.937 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.839+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.938 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.857+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.938 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.874+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.938 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.894+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.938 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.910+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.938 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.928+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:19.938 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.698+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.938 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.715+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.938 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.746+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.938 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.775+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.938 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.810+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.939 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.832+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.939 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.862+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.939 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.892+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:19.939 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.922+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.150 INFO:tasks.rados.rados.0.smithi084.stdout:1943: done (2 left) 2024-03-30T12:29:20.150 INFO:tasks.rados.rados.0.smithi084.stdout:1945: done (1 left) 2024-03-30T12:29:20.150 INFO:tasks.rados.rados.0.smithi084.stdout:1946: done (0 left) 2024-03-30T12:29:20.150 INFO:tasks.rados.rados.0.smithi084.stdout:1947: snap_create 2024-03-30T12:29:20.192 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:20.192 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:20.192 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:20.193 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:20.193 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-mon[83709]: osdmap e479: 8 total, 8 up, 8 in 2024-03-30T12:29:20.193 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:20.193 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:20.193 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-30T12:29:20.193 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-mon[83709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-30T12:29:20.193 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-mon[83709]: Upgrade: osd.6 is safe to restart 2024-03-30T12:29:20.193 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.953+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.193 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:19.983+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.193 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.011+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.194 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.039+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.194 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.065+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.194 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.088+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.194 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.109+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.194 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.134+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.194 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.166+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.194 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.193+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.194 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.945+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.194 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.961+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.194 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:19.983+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.194 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.003+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.194 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.023+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.195 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.041+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.195 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.060+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.195 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.081+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.195 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.101+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.195 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.119+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.195 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.140+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.195 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.160+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.195 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.180+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.195 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.200+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.453 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.216+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.453 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.235+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.453 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.263+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.453 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.276+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.453 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.289+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.453 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.304+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.454 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.329+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.454 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.341+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.454 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.370+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.454 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.396+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.454 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.410+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.454 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.435+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.454 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.460+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.454 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.217+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.454 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.238+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.454 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.254+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.454 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.274+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.455 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.292+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.455 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.310+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.455 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.326+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.455 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.343+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.455 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.363+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.455 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.378+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.455 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.394+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.455 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.412+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.455 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.428+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.455 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.448+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:20.165+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:20.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:20.165+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-mon[91810]: osdmap e479: 8 total, 8 up, 8 in 2024-03-30T12:29:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-30T12:29:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-mon[91810]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-30T12:29:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-mon[91810]: Upgrade: osd.6 is safe to restart 2024-03-30T12:29:20.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:20.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:20.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:20.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:20.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-mon[89279]: osdmap e479: 8 total, 8 up, 8 in 2024-03-30T12:29:20.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:20.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:20.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-30T12:29:20.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-mon[89279]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-30T12:29:20.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-mon[89279]: Upgrade: osd.6 is safe to restart 2024-03-30T12:29:20.714 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.465+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.715 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.486+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.715 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.503+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.715 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.519+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.715 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.537+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.715 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.552+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.715 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.569+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.715 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.585+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.715 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.605+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.715 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.620+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.715 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.637+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.715 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.653+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.716 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.669+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.716 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.686+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.716 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.706+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.716 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.488+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.716 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.505+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.716 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.523+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.716 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.545+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.716 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.571+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.716 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.596+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.716 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.624+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.716 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.649+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.717 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.666+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.717 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.693+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.976 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.726+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.976 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.743+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.976 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.762+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.976 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.779+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.976 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.797+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.976 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.815+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.976 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.831+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.976 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.852+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.976 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.871+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.976 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.888+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.977 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.905+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.977 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.921+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.977 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.940+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.977 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.955+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.977 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.970+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:20.977 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.722+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.977 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.751+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.977 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.782+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.977 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.809+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.977 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.841+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.977 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.866+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.977 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.893+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.978 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.917+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.978 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.932+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.978 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.963+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:20.978 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:20.983+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.154 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:20.815+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:21.154 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:20.815+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:21.154 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:20.815+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:21.154 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:20.816+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:21.159 INFO:tasks.rados.rados.0.smithi084.stdout:1947: done (0 left) 2024-03-30T12:29:21.159 INFO:tasks.rados.rados.0.smithi084.stdout:1948: snap_create 2024-03-30T12:29:21.231 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:20.987+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.231 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.001+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.231 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.017+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.231 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.032+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.231 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.049+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.232 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.063+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.232 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.079+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.232 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.097+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.232 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.115+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.232 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.135+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.232 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.152+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.232 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.171+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.232 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.188+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.232 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.207+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.232 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.223+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.232 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-mon[83709]: osdmap e480: 8 total, 8 up, 8 in 2024-03-30T12:29:21.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:21.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:21.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-mon[83709]: pgmap v403: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 361 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-03-30T12:29:21.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:21.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:21.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:21.233 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:21.233 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.005+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.233 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.033+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.233 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.057+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.233 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.081+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.233 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.101+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.233 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.119+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.234 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.146+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.234 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.161+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.234 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.191+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.234 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.216+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.429 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:21.170+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:21.430 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:21.170+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:21.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:21 smithi084 ceph-mon[89279]: osdmap e480: 8 total, 8 up, 8 in 2024-03-30T12:29:21.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:21.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:21.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:21 smithi084 ceph-mon[89279]: pgmap v403: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 361 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-03-30T12:29:21.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:21.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:21.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:21.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:21.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:21 smithi084 ceph-mon[91810]: osdmap e480: 8 total, 8 up, 8 in 2024-03-30T12:29:21.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:21.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:21.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:21 smithi084 ceph-mon[91810]: pgmap v403: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 361 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 5 op/s 2024-03-30T12:29:21.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:21.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:21.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:21.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:21.488 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.239+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.488 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.254+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.488 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.272+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.488 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.289+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.488 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.305+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.488 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.322+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.488 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.340+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.488 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.358+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.489 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.374+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.489 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.390+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.489 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.407+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.489 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.423+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.489 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.440+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.489 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.457+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.489 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.473+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.489 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.488+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.489 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.245+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.489 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.267+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.490 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.291+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.490 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.316+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.490 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.337+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.490 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.365+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.490 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.387+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.490 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.413+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.490 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.438+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.490 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.461+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.490 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.476+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.490 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.496+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.749 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.505+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.749 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.521+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.749 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.536+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.749 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.552+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.749 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.568+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.749 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.584+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.749 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.601+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.749 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.616+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.749 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.634+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.749 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.653+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.749 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.670+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.749 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.687+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.749 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.704+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.750 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.721+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.750 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.740+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.750 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.756+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:21.750 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.518+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.750 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.543+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.750 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.563+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.750 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.583+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.750 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.608+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.750 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.638+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.750 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.663+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.750 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.692+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.751 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.708+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.751 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.733+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:21.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:21.437+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:21.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:21.437+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:21.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:21.437+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:21.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:21.437+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:21.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:21.437+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:21.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:21.437+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:21.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:21.437+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:21.999 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.773+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.000 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.791+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.000 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.812+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.000 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.830+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.000 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.849+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.000 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.864+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.000 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.882+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.000 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.901+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.000 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.919+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.000 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.937+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.000 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.954+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.000 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.972+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.000 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:21.990+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.001 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.759+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.001 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.787+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.001 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.819+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.001 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.847+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.001 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.875+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.001 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.903+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.001 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.931+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.001 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.959+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.001 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:21.985+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.171 INFO:tasks.rados.rados.0.smithi084.stdout:1948: done (0 left) 2024-03-30T12:29:22.171 INFO:tasks.rados.rados.0.smithi084.stdout:1949: read oid 21 snap -1 2024-03-30T12:29:22.171 INFO:tasks.rados.rados.0.smithi084.stdout:1949: expect deleted 2024-03-30T12:29:22.171 INFO:tasks.rados.rados.0.smithi084.stdout:1950: delete oid 10 current snap is 210 2024-03-30T12:29:22.175 INFO:tasks.rados.rados.0.smithi084.stdout:1949: done (1 left) 2024-03-30T12:29:22.175 INFO:tasks.rados.rados.0.smithi084.stdout:1950: done (0 left) 2024-03-30T12:29:22.175 INFO:tasks.rados.rados.0.smithi084.stdout:1951: rollback oid 38 current snap is 210 2024-03-30T12:29:22.175 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 38 to 202 2024-03-30T12:29:22.175 INFO:tasks.rados.rados.0.smithi084.stdout:1952: snap_remove snap 196 2024-03-30T12:29:22.253 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.007+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.026+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.044+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.060+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.076+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.093+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.115+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.134+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.150+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.167+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.194+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.210+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.233+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.255 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.251+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.255 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-mon[83709]: osdmap e481: 8 total, 8 up, 8 in 2024-03-30T12:29:22.255 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:22.255 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:22.255 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:22.255 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:22.255 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:22.255 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:22.255 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-mon[83709]: Upgrade: Updating osd.6 2024-03-30T12:29:22.255 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:22.255 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-30T12:29:22.256 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:29:22.256 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-mon[83709]: Deploying daemon osd.6 on smithi162 2024-03-30T12:29:22.256 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.010+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.256 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.041+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.256 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.072+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.256 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.098+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.256 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.125+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.256 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.152+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.256 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.180+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.256 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.214+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.256 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.231+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:22.180+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:22.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:22.180+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:22.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:22.185+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:22.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:22.188+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:22.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:22.189+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:22.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:22.189+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:22.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-mon[89279]: osdmap e481: 8 total, 8 up, 8 in 2024-03-30T12:29:22.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:22.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:22.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-mon[89279]: Upgrade: Updating osd.6 2024-03-30T12:29:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-30T12:29:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:29:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-mon[89279]: Deploying daemon osd.6 on smithi162 2024-03-30T12:29:22.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-mon[91810]: osdmap e481: 8 total, 8 up, 8 in 2024-03-30T12:29:22.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:22.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:22.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:22.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:22.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:22.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:22.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-mon[91810]: Upgrade: Updating osd.6 2024-03-30T12:29:22.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:22.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-30T12:29:22.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:29:22.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:22 smithi084 ceph-mon[91810]: Deploying daemon osd.6 on smithi162 2024-03-30T12:29:22.508 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.261+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.508 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.285+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.508 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.309+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.508 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.339+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.508 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.365+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.508 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.398+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.509 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.426+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.509 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.460+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.509 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.481+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.509 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.500+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.509 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.270+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.509 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.290+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.509 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.310+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.509 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.329+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.509 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.346+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.509 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.363+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.509 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.383+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.509 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.400+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.509 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.420+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.510 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.437+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.510 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.456+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.510 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.477+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.510 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.496+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.510 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.514+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.762 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.531+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.763 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.546+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.763 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.563+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.763 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.581+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.763 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.618+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.763 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.635+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.763 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.651+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.763 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.667+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.763 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.682+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.763 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.698+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.763 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.715+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.763 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.732+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.763 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.749+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.764 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.763+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:22.764 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.525+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.764 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.553+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.764 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.573+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.764 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.591+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.764 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.635+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.764 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.659+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.764 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.687+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.764 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.717+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.764 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.742+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:22.764 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.770+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.020 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.778+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.020 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.795+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.020 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.810+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.020 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.828+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.021 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.844+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.021 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.860+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.021 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.877+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.021 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.892+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.021 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.911+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.021 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.926+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.021 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.961+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.021 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:22.987+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.021 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.002+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.021 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.019+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.021 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.797+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.021 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.816+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.022 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.836+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.022 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.866+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.022 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.894+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.022 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.916+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.022 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.942+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.022 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:22.978+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.022 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.012+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.022 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.027+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.173 INFO:tasks.rados.rados.0.smithi084.stdout:1952: done (1 left) 2024-03-30T12:29:23.173 INFO:tasks.rados.rados.0.smithi084.stdout:1953: snap_create 2024-03-30T12:29:23.173 INFO:tasks.rados.rados.0.smithi084.stdout:1951: finishing rollback tid 0 to smithi08477944-38 2024-03-30T12:29:23.173 INFO:tasks.rados.rados.0.smithi084.stdout:1951: finishing rollback tid 1 to smithi08477944-38 2024-03-30T12:29:23.173 INFO:tasks.rados.rados.0.smithi084.stdout:1951: finishing rollback tid 2 to smithi08477944-38 2024-03-30T12:29:23.173 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1009 (ObjNum 551 snap 186 seq_num 551) dirty exists 2024-03-30T12:29:23.288 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-mon[83709]: osdmap e482: 8 total, 8 up, 8 in 2024-03-30T12:29:23.288 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:23.288 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:23.288 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:23.288 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:23.288 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:23.288 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:23.288 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-mon[83709]: pgmap v406: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 360 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 36 KiB/s rd, 926 KiB/s wr, 7 op/s 2024-03-30T12:29:23.289 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.051+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.289 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.077+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.289 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.092+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.289 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.116+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.289 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.140+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.289 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.166+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.289 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.267+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.289 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.037+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.289 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.053+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.290 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.069+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.290 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.085+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.290 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.104+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.290 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.120+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.290 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.140+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.290 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.157+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.290 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.174+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.290 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.296+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:23.180+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:23.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:23.180+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:23 smithi084 ceph-mon[89279]: osdmap e482: 8 total, 8 up, 8 in 2024-03-30T12:29:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:23 smithi084 ceph-mon[89279]: pgmap v406: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 360 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 36 KiB/s rd, 926 KiB/s wr, 7 op/s 2024-03-30T12:29:23.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:23 smithi084 ceph-mon[91810]: osdmap e482: 8 total, 8 up, 8 in 2024-03-30T12:29:23.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:23.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:23.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:23.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:23.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:23.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:23.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:23 smithi084 ceph-mon[91810]: pgmap v406: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 360 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 36 KiB/s rd, 926 KiB/s wr, 7 op/s 2024-03-30T12:29:23.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:23.260+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:23.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:23.260+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:23.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:23.260+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:23.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:23.260+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:23.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:23.260+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:23.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:23.261+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:23.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:23.261+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:23.571 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.314+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.572 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.342+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.572 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.370+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.572 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.392+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.572 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.418+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.572 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.446+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.572 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.460+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.572 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.486+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.572 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.510+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.572 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.535+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.572 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.560+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.572 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.312+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.572 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.329+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.345+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.362+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.379+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.397+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.413+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.429+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.445+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.465+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.480+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.496+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.512+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.528+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.543+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.835 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.559+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.835 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.574+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.835 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.590+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.835 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.605+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.836 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.621+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.836 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.639+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.836 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.654+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.836 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.670+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.836 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.685+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.836 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.706+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.836 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.727+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.836 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.745+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.836 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.761+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.836 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.779+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.836 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.797+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.836 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.812+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.836 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.828+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:23.837 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.583+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.837 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.609+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.837 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.636+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.837 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.662+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.837 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.689+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.837 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.713+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.837 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.744+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.837 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.767+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.837 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.792+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.837 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.812+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:23.837 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.842+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.089 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.845+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.089 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.863+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.089 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.878+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.089 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.894+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.089 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.910+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.089 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.927+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.089 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.961+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.089 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.976+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.089 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:23.992+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.089 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.008+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.090 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.027+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.090 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.044+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.090 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.059+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.090 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.075+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.090 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.092+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.090 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.868+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.090 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.894+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.091 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.923+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.091 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.968+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.091 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:23.995+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.091 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.012+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.091 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.039+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.091 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.067+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.091 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.096+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.238 INFO:tasks.rados.rados.0.smithi084.stdout:1951: done (1 left) 2024-03-30T12:29:24.238 INFO:tasks.rados.rados.0.smithi084.stdout:1953: done (0 left) 2024-03-30T12:29:24.238 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 211 2024-03-30T12:29:24.239 INFO:tasks.rados.rados.0.smithi084.stdout:1954: seq_num 599 ranges {4218880=434176} 2024-03-30T12:29:24.264 INFO:tasks.rados.rados.0.smithi084.stdout:1954: writing smithi08477944-40 from 4218880 to 4653056 tid 1 2024-03-30T12:29:24.265 INFO:tasks.rados.rados.0.smithi084.stdout:1955: setattr oid 18 current snap is 211 2024-03-30T12:29:24.266 INFO:tasks.rados.rados.0.smithi084.stdout:1956: setattr oid 7 current snap is 211 2024-03-30T12:29:24.268 INFO:tasks.rados.rados.0.smithi084.stdout:1957: rollback oid 12 current snap is 211 2024-03-30T12:29:24.268 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 12 to 194 2024-03-30T12:29:24.268 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 211 2024-03-30T12:29:24.269 INFO:tasks.rados.rados.0.smithi084.stdout:1958: seq_num 600 ranges {761856=450560} 2024-03-30T12:29:24.277 INFO:tasks.rados.rados.0.smithi084.stdout:1958: writing smithi08477944-4 from 761856 to 1212416 tid 1 2024-03-30T12:29:24.277 INFO:tasks.rados.rados.0.smithi084.stdout:1959: read oid 32 snap 205 2024-03-30T12:29:24.277 INFO:tasks.rados.rados.0.smithi084.stdout:1959: expect (ObjNum 280 snap 90 seq_num 280) 2024-03-30T12:29:24.277 INFO:tasks.rados.rados.0.smithi084.stdout:1960: copy_from oid 46 from oid 20 current snap is 211 2024-03-30T12:29:24.277 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 944 (ObjNum 558 snap 191 seq_num 558) dirty exists 2024-03-30T12:29:24.277 INFO:tasks.rados.rados.0.smithi084.stdout:1955: done (6 left) 2024-03-30T12:29:24.277 INFO:tasks.rados.rados.0.smithi084.stdout:1961: read oid 38 snap 194 2024-03-30T12:29:24.277 INFO:tasks.rados.rados.0.smithi084.stdout:1961: expect (ObjNum 551 snap 186 seq_num 551) 2024-03-30T12:29:24.277 INFO:tasks.rados.rados.0.smithi084.stdout:1962: snap_create 2024-03-30T12:29:24.277 INFO:tasks.rados.rados.0.smithi084.stdout:1954: finishing write tid 1 to smithi08477944-40 2024-03-30T12:29:24.278 INFO:tasks.rados.rados.0.smithi084.stdout:1954: finishing write tid 2 to smithi08477944-40 2024-03-30T12:29:24.278 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 961 (ObjNum 145 snap 0 seq_num 1428775048) dirty exists 2024-03-30T12:29:24.278 INFO:tasks.rados.rados.0.smithi084.stdout:1954: finishing write tid 3 to smithi08477944-40 2024-03-30T12:29:24.278 INFO:tasks.rados.rados.0.smithi084.stdout:1954: oid 40 updating version 0 to 959 2024-03-30T12:29:24.278 INFO:tasks.rados.rados.0.smithi084.stdout:1954: oid 40 updating version 959 to 960 2024-03-30T12:29:24.278 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 960 (ObjNum 599 snap 211 seq_num 599) dirty exists 2024-03-30T12:29:24.278 INFO:tasks.rados.rados.0.smithi084.stdout:1954: left oid 40 (ObjNum 599 snap 211 seq_num 599) 2024-03-30T12:29:24.278 INFO:tasks.rados.rados.0.smithi084.stdout:1957: finishing rollback tid 0 to smithi08477944-12 2024-03-30T12:29:24.278 INFO:tasks.rados.rados.0.smithi084.stdout:1957: finishing rollback tid 1 to smithi08477944-12 2024-03-30T12:29:24.279 INFO:tasks.rados.rados.0.smithi084.stdout:1957: finishing rollback tid 2 to smithi08477944-12 2024-03-30T12:29:24.279 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 911 (ObjNum 455 snap 142 seq_num 455) dirty exists 2024-03-30T12:29:24.285 INFO:tasks.rados.rados.0.smithi084.stdout:1958: finishing write tid 1 to smithi08477944-4 2024-03-30T12:29:24.285 INFO:tasks.rados.rados.0.smithi084.stdout:1958: finishing write tid 2 to smithi08477944-4 2024-03-30T12:29:24.288 INFO:tasks.rados.rados.0.smithi084.stdout:1958: finishing write tid 3 to smithi08477944-4 2024-03-30T12:29:24.288 INFO:tasks.rados.rados.0.smithi084.stdout:1958: oid 4 updating version 0 to 819 2024-03-30T12:29:24.288 INFO:tasks.rados.rados.0.smithi084.stdout:1958: oid 4 version 819 is already newer than 818 2024-03-30T12:29:24.288 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 819 (ObjNum 600 snap 211 seq_num 600) dirty exists 2024-03-30T12:29:24.288 INFO:tasks.rados.rados.0.smithi084.stdout:1958: left oid 4 (ObjNum 600 snap 211 seq_num 600) 2024-03-30T12:29:24.306 INFO:tasks.rados.rados.0.smithi084.stdout:1959: expect (ObjNum 280 snap 90 seq_num 280) 2024-03-30T12:29:24.342 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:24.343 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:24.343 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-mon[83709]: osdmap e483: 8 total, 8 up, 8 in 2024-03-30T12:29:24.343 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:24.343 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:24.343 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:24.343 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:24.343 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.111+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.343 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.131+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.343 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.150+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.344 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.167+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.344 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.265+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.344 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.285+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.344 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.315+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.344 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.334+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.344 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.350+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.344 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.124+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.344 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.149+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.344 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.239+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.344 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.267+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.344 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.292+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.344 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.311+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.345 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.323+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:24.246+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:24.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:24.247+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:24.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:24.275+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:24.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:24.275+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:24.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:24.278+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:24.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:24.280+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:24.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:24.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:24.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:24 smithi084 ceph-mon[89279]: osdmap e483: 8 total, 8 up, 8 in 2024-03-30T12:29:24.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:24.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:24.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:24.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:24 smithi084 ceph-mon[91810]: osdmap e483: 8 total, 8 up, 8 in 2024-03-30T12:29:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 103=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:24.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:24.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:24.589 INFO:tasks.rados.rados.0.smithi084.stdout:1961: expect (ObjNum 551 snap 186 seq_num 551) 2024-03-30T12:29:24.601 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.363+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.601 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.382+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.601 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.404+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.602 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.429+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.602 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.456+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.602 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.470+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.602 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.500+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.602 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.530+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.602 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.563+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.603 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.592+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.603 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.371+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.603 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.390+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.603 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.408+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.604 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.424+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.604 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.440+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.604 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.457+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.604 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.473+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.604 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.489+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.604 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.505+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.605 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.521+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.605 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.537+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.605 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.557+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.605 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.576+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.605 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.592+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.605 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.608+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.863 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.621+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.863 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.649+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.863 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.679+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.863 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.707+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.864 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.736+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.864 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.758+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.864 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.778+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.864 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.805+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.864 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.823+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.864 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.853+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:24.864 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.626+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.864 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.641+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.864 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.660+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.864 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.675+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.864 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.693+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.864 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.708+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.865 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.723+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.865 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.738+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.865 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.754+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.865 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.773+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.865 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.790+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.865 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.807+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.865 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.823+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.865 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.838+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.865 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.853+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.865 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.871+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:24.920 INFO:tasks.rados.rados.0.smithi084.stdout:1960: finishing copy_from racing read to smithi08477944-46 2024-03-30T12:29:24.921 INFO:tasks.rados.rados.0.smithi084.stdout:1960: finishing copy_from to smithi08477944-46 2024-03-30T12:29:24.921 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 935 (ObjNum 565 snap 194 seq_num 565) dirty exists 2024-03-30T12:29:25.119 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.885+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.913+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.945+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:24.979+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.010+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.033+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.061+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.090+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.116+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.887+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.903+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.921+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.938+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.956+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.975+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:24.991+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.011+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.028+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.045+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.061+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.076+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.095+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.112+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.249 INFO:tasks.rados.rados.0.smithi084.stdout:1954: done (7 left) 2024-03-30T12:29:25.250 INFO:tasks.rados.rados.0.smithi084.stdout:1956: done (6 left) 2024-03-30T12:29:25.250 INFO:tasks.rados.rados.0.smithi084.stdout:1957: done (5 left) 2024-03-30T12:29:25.250 INFO:tasks.rados.rados.0.smithi084.stdout:1958: done (4 left) 2024-03-30T12:29:25.250 INFO:tasks.rados.rados.0.smithi084.stdout:1959: done (3 left) 2024-03-30T12:29:25.250 INFO:tasks.rados.rados.0.smithi084.stdout:1960: done (2 left) 2024-03-30T12:29:25.250 INFO:tasks.rados.rados.0.smithi084.stdout:1961: done (1 left) 2024-03-30T12:29:25.250 INFO:tasks.rados.rados.0.smithi084.stdout:1962: done (0 left) 2024-03-30T12:29:25.250 INFO:tasks.rados.rados.0.smithi084.stdout:1963: copy_from oid 23 from oid 16 current snap is 212 2024-03-30T12:29:25.250 INFO:tasks.rados.rados.0.smithi084.stdout:1964: setattr oid 43 current snap is 212 2024-03-30T12:29:25.251 INFO:tasks.rados.rados.0.smithi084.stdout:1965: snap_create 2024-03-30T12:29:25.264 INFO:tasks.rados.rados.0.smithi084.stdout:1963: finishing copy_from racing read to smithi08477944-23 2024-03-30T12:29:25.266 INFO:tasks.rados.rados.0.smithi084.stdout:1963: finishing copy_from to smithi08477944-23 2024-03-30T12:29:25.266 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 942 (ObjNum 395 snap 125 seq_num 395) dirty exists 2024-03-30T12:29:25.273 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 22485 (ObjNum 305 snap 0 seq_num 1532997120) dirty exists 2024-03-30T12:29:25.381 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-mon[83709]: osdmap e484: 8 total, 8 up, 8 in 2024-03-30T12:29:25.381 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:25.381 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:25.381 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:25.381 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:25.381 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:25.381 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:25.381 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-mon[83709]: pgmap v409: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 360 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 36 KiB/s rd, 70 KiB/s wr, 6 op/s 2024-03-30T12:29:25.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.146+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.173+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.199+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.225+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.253+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.275+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.302+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.330+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.357+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.385+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.129+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.146+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.161+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.180+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.198+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.214+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.232+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.250+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.270+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.287+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.305+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.383 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.321+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.384 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.338+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.384 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.355+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.384 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.375+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:25.256+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:25.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:25.257+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:25.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:25 smithi084 ceph-mon[89279]: osdmap e484: 8 total, 8 up, 8 in 2024-03-30T12:29:25.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:25.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:25.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:25.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:25.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:25.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:25.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:25 smithi084 ceph-mon[89279]: pgmap v409: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 360 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 36 KiB/s rd, 70 KiB/s wr, 6 op/s 2024-03-30T12:29:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:25 smithi084 ceph-mon[91810]: osdmap e484: 8 total, 8 up, 8 in 2024-03-30T12:29:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:25 smithi084 ceph-mon[91810]: pgmap v409: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 360 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 36 KiB/s rd, 70 KiB/s wr, 6 op/s 2024-03-30T12:29:25.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:25.261+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:25.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:25.261+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:25.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:25.261+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:25.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:25.261+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:25.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:25.261+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:25.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:25.264+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:25.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:25.264+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:25.639 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.420+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.639 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.450+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.639 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.477+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.639 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.512+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.640 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.547+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.640 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.578+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.640 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.607+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.640 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.636+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.640 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.392+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.640 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.409+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.640 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.427+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.640 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.444+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.640 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.462+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.640 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.479+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.640 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.499+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.515+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.531+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.548+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.565+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.582+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.597+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.613+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.629+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.647+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.906 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.666+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.906 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.695+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.906 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.710+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.906 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.729+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.906 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.744+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.906 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.766+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.906 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.791+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.907 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.815+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.907 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.836+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.907 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.861+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.907 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.893+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:25.907 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.666+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.907 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.683+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.907 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.702+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.907 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.719+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.907 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.739+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.907 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.758+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.907 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.776+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.907 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.798+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.817+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.843+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.858+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.881+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.897+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:25.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.914+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.170 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.924+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.170 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.953+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.170 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:25.986+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.170 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.012+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.170 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.048+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.170 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.070+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.170 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.086+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.170 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.113+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.170 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.145+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.171 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.931+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.171 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.951+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.171 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.967+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.171 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:25.986+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.171 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.003+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.171 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.021+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.171 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.039+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.171 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.061+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.171 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.082+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.171 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.103+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.171 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.120+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.171 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.138+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.172 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.159+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.172 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.175+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.250 INFO:tasks.rados.rados.0.smithi084.stdout:1963: done (2 left) 2024-03-30T12:29:26.250 INFO:tasks.rados.rados.0.smithi084.stdout:1964: done (1 left) 2024-03-30T12:29:26.250 INFO:tasks.rados.rados.0.smithi084.stdout:1965: done (0 left) 2024-03-30T12:29:26.250 INFO:tasks.rados.rados.0.smithi084.stdout:1966: copy_from oid 9 from oid 43 current snap is 213 2024-03-30T12:29:26.250 INFO:tasks.rados.rados.0.smithi084.stdout:1967: copy_from oid 20 from oid 18 current snap is 213 2024-03-30T12:29:26.250 INFO:tasks.rados.rados.0.smithi084.stdout:1968: read oid 15 snap 208 2024-03-30T12:29:26.250 INFO:tasks.rados.rados.0.smithi084.stdout:1968: expect (ObjNum 549 snap 185 seq_num 549) 2024-03-30T12:29:26.250 INFO:tasks.rados.rados.0.smithi084.stdout:1969: rollback oid 48 current snap is 213 2024-03-30T12:29:26.251 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 48 to 168 2024-03-30T12:29:26.251 INFO:tasks.rados.rados.0.smithi084.stdout:1970: read oid 19 snap -1 2024-03-30T12:29:26.251 INFO:tasks.rados.rados.0.smithi084.stdout:1970: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:29:26.251 INFO:tasks.rados.rados.0.smithi084.stdout:1971: delete oid 30 current snap is 213 2024-03-30T12:29:26.254 INFO:tasks.rados.rados.0.smithi084.stdout:1969: finishing rollback tid 0 to smithi08477944-48 2024-03-30T12:29:26.258 INFO:tasks.rados.rados.0.smithi084.stdout:1971: done (5 left) 2024-03-30T12:29:26.259 INFO:tasks.rados.rados.0.smithi084.stdout:1972: read oid 49 snap -1 2024-03-30T12:29:26.259 INFO:tasks.rados.rados.0.smithi084.stdout:1972: expect (ObjNum 457 snap 143 seq_num 457) 2024-03-30T12:29:26.259 INFO:tasks.rados.rados.0.smithi084.stdout:1973: rollback oid 44 current snap is 213 2024-03-30T12:29:26.259 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 44 to 168 2024-03-30T12:29:26.259 INFO:tasks.rados.rados.0.smithi084.stdout:1974: snap_create 2024-03-30T12:29:26.259 INFO:tasks.rados.rados.0.smithi084.stdout:1969: finishing rollback tid 1 to smithi08477944-48 2024-03-30T12:29:26.259 INFO:tasks.rados.rados.0.smithi084.stdout:1969: finishing rollback tid 2 to smithi08477944-48 2024-03-30T12:29:26.259 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 902 (ObjNum 129 snap 0 seq_num 194468093) dirty exists 2024-03-30T12:29:26.269 INFO:tasks.rados.rados.0.smithi084.stdout:1972: expect (ObjNum 457 snap 143 seq_num 457) 2024-03-30T12:29:26.299 INFO:tasks.rados.rados.0.smithi084.stdout:1968: expect (ObjNum 549 snap 185 seq_num 549) 2024-03-30T12:29:26.432 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.196+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.433 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.215+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.433 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.237+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.433 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.256+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.433 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.284+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.433 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.304+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.433 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.322+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.433 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.343+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.433 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.364+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.433 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.383+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.433 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.402+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.433 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.423+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-mon[83709]: osdmap e485: 8 total, 8 up, 8 in 2024-03-30T12:29:26.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:26.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:26.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:26.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:26.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:26.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:26.435 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.178+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.435 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.206+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.435 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.228+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.435 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.258+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.435 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.284+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.435 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.319+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.435 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.350+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.435 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.382+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.435 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.421+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.451 INFO:tasks.rados.rados.0.smithi084.stdout:1967: finishing copy_from racing read to smithi08477944-20 2024-03-30T12:29:26.451 INFO:tasks.rados.rados.0.smithi084.stdout:1970: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:29:26.454 INFO:tasks.rados.rados.0.smithi084.stdout:1966: finishing copy_from racing read to smithi08477944-9 2024-03-30T12:29:26.454 INFO:tasks.rados.rados.0.smithi084.stdout:1967: finishing copy_from to smithi08477944-20 2024-03-30T12:29:26.454 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 944 (ObjNum 558 snap 191 seq_num 558) dirty exists 2024-03-30T12:29:26.454 INFO:tasks.rados.rados.0.smithi084.stdout:1966: finishing copy_from to smithi08477944-9 2024-03-30T12:29:26.454 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 22485 (ObjNum 49 snap 0 seq_num 1953066355) dirty exists 2024-03-30T12:29:26.454 INFO:tasks.rados.rados.0.smithi084.stdout:1973: finishing rollback tid 0 to smithi08477944-44 2024-03-30T12:29:26.455 INFO:tasks.rados.rados.0.smithi084.stdout:1973: finishing rollback tid 1 to smithi08477944-44 2024-03-30T12:29:26.455 INFO:tasks.rados.rados.0.smithi084.stdout:1973: finishing rollback tid 2 to smithi08477944-44 2024-03-30T12:29:26.455 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 22789 (ObjNum 440 snap 141 seq_num 440) dirty exists 2024-03-30T12:29:26.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:26.255+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:26.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:26.255+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:26.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:26.261+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:26.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:26.262+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:26.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:26.263+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:26.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:26.263+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:26.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:26 smithi084 ceph-mon[91810]: osdmap e485: 8 total, 8 up, 8 in 2024-03-30T12:29:26.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:26.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:26.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:26.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:26.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:26.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:26.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:26 smithi084 ceph-mon[89279]: osdmap e485: 8 total, 8 up, 8 in 2024-03-30T12:29:26.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:26.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:26.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:26.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:26.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:26.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:26.700 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.440+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.700 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.461+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.700 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.481+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.700 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.498+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.700 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.520+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.701 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.537+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.701 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.558+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.701 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.575+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.701 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.596+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.701 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.617+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.701 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.634+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.701 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.654+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.701 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.671+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.701 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.688+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.702 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.456+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.702 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.476+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.702 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.507+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.702 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.538+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.702 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.572+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.702 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.591+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.702 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.620+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.702 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.654+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.702 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.682+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.960 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.714+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.960 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.752+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.960 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.778+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.960 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.808+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.960 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.836+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.960 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.871+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.961 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.901+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.961 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.939+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:26.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.706+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.724+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.743+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.761+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.782+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.799+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.819+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.842+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.860+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.962 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.876+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.962 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.896+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.962 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.912+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.962 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.929+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:26.962 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.949+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.218 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.968+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.218 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:26.999+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.218 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.031+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.218 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.076+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.218 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.106+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.218 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.150+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.218 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.185+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.218 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.217+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.968+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:26.985+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.003+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.023+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.040+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.060+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.080+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.099+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.123+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.142+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.160+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.219 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.179+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.220 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.199+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.220 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.225+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.263 INFO:tasks.rados.rados.0.smithi084.stdout:1966: done (7 left) 2024-03-30T12:29:27.264 INFO:tasks.rados.rados.0.smithi084.stdout:1967: done (6 left) 2024-03-30T12:29:27.264 INFO:tasks.rados.rados.0.smithi084.stdout:1968: done (5 left) 2024-03-30T12:29:27.264 INFO:tasks.rados.rados.0.smithi084.stdout:1969: done (4 left) 2024-03-30T12:29:27.264 INFO:tasks.rados.rados.0.smithi084.stdout:1970: done (3 left) 2024-03-30T12:29:27.264 INFO:tasks.rados.rados.0.smithi084.stdout:1972: done (2 left) 2024-03-30T12:29:27.264 INFO:tasks.rados.rados.0.smithi084.stdout:1973: done (1 left) 2024-03-30T12:29:27.264 INFO:tasks.rados.rados.0.smithi084.stdout:1974: done (0 left) 2024-03-30T12:29:27.264 INFO:tasks.rados.rados.0.smithi084.stdout:1975: copy_from oid 19 from oid 39 current snap is 214 2024-03-30T12:29:27.264 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 214 2024-03-30T12:29:27.264 INFO:tasks.rados.rados.0.smithi084.stdout:1976: seq_num 602 ranges {5734400=491520} 2024-03-30T12:29:27.298 INFO:tasks.rados.rados.0.smithi084.stdout:1976: writing smithi08477944-38 from 5734400 to 6225920 tid 1 2024-03-30T12:29:27.298 INFO:tasks.rados.rados.0.smithi084.stdout:1977: snap_create 2024-03-30T12:29:27.305 INFO:tasks.rados.rados.0.smithi084.stdout:1976: finishing write tid 1 to smithi08477944-38 2024-03-30T12:29:27.305 INFO:tasks.rados.rados.0.smithi084.stdout:1976: finishing write tid 2 to smithi08477944-38 2024-03-30T12:29:27.307 INFO:tasks.rados.rados.0.smithi084.stdout:1976: finishing write tid 3 to smithi08477944-38 2024-03-30T12:29:27.307 INFO:tasks.rados.rados.0.smithi084.stdout:1976: oid 38 updating version 0 to 1012 2024-03-30T12:29:27.307 INFO:tasks.rados.rados.0.smithi084.stdout:1976: oid 38 version 1012 is already newer than 1011 2024-03-30T12:29:27.307 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1012 (ObjNum 602 snap 214 seq_num 602) dirty exists 2024-03-30T12:29:27.307 INFO:tasks.rados.rados.0.smithi084.stdout:1976: left oid 38 (ObjNum 602 snap 214 seq_num 602) 2024-03-30T12:29:27.339 INFO:tasks.rados.rados.0.smithi084.stdout:1975: finishing copy_from racing read to smithi08477944-19 2024-03-30T12:29:27.348 INFO:tasks.rados.rados.0.smithi084.stdout:1975: finishing copy_from to smithi08477944-19 2024-03-30T12:29:27.348 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 941 (ObjNum 563 snap 194 seq_num 563) dirty exists 2024-03-30T12:29:27.474 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:27.474 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:27.474 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-mon[83709]: osdmap e486: 8 total, 8 up, 8 in 2024-03-30T12:29:27.474 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:27.474 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:27.474 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:27.474 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:27.474 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-mon[83709]: pgmap v412: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 373 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 4.1 MiB/s rd, 2.5 MiB/s wr, 3 op/s 2024-03-30T12:29:27.475 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.241+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.475 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.276+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.475 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.309+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.475 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.355+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.475 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.393+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.475 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.427+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.475 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.455+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.475 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.246+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.476 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.266+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.476 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.294+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.476 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.322+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.476 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.359+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.476 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.381+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.476 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.401+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.476 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.419+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.476 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.439+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.476 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.464+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.724 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:27 smithi162 systemd[1]: Stopping Ceph osd.6 for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:29:27.725 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.493+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.725 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.529+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.725 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.572+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.725 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.610+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.725 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.645+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.725 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.682+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.725 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.729+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.726 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.482+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.726 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.501+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.726 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.521+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.726 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.543+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.726 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.562+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.726 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.582+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.726 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.602+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.726 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.624+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.726 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.646+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.726 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.664+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.726 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.686+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.726 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.708+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.727 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.730+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:27.270+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:27.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:27.270+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:27.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:27.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:27.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:27 smithi084 ceph-mon[91810]: osdmap e486: 8 total, 8 up, 8 in 2024-03-30T12:29:27.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:27.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:27.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:27.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:27.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:27 smithi084 ceph-mon[91810]: pgmap v412: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 373 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 4.1 MiB/s rd, 2.5 MiB/s wr, 3 op/s 2024-03-30T12:29:27.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:27.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:27.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:27 smithi084 ceph-mon[89279]: osdmap e486: 8 total, 8 up, 8 in 2024-03-30T12:29:27.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:27.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:27.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:27.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:27.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:27 smithi084 ceph-mon[89279]: pgmap v412: 121 pgs: 4 active+clean+snaptrim, 111 active+clean, 6 active+clean+snaptrim_error; 373 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 4.1 MiB/s rd, 2.5 MiB/s wr, 3 op/s 2024-03-30T12:29:27.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:27.309+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:27.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:27.309+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:27.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:27.309+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:27.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:27.311+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:27.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:27.312+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:27.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:27.312+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:27.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:27.312+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:27.984 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.761+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.984 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.793+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.984 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.835+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.984 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.871+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.985 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.903+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.985 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.939+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.985 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.968+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:27.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.754+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.786+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.807+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.830+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.853+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.876+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.895+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.915+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.931+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.951+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.970+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:27.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:27.987+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.233 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-03-30T12:29:28.238 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.010+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.238 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.032+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.238 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.052+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.238 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.071+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.238 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.089+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.239 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.106+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.239 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.123+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.239 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.145+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.239 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.161+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.239 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.177+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.239 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.195+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.239 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.211+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.239 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.228+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.239 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.243+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.240 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[46849]: 2024-03-30T12:29:27.993+0000 7f2cc51c5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:29:28.240 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[46849]: 2024-03-30T12:29:27.993+0000 7f2cc51c5700 -1 osd.6 487 *** Got signal Terminated *** 2024-03-30T12:29:28.240 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[46849]: 2024-03-30T12:29:27.993+0000 7f2cc51c5700 -1 osd.6 487 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T12:29:28.240 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:27.995+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:28.240 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:28.028+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:28.240 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:28.063+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:28.240 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:28.099+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:28.240 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:28.132+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:28.241 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:28.163+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:28.241 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:28.200+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:28.241 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:28.235+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:28.275 INFO:tasks.rados.rados.0.smithi084.stdout:1975: done (2 left) 2024-03-30T12:29:28.276 INFO:tasks.rados.rados.0.smithi084.stdout:1976: done (1 left) 2024-03-30T12:29:28.276 INFO:tasks.rados.rados.0.smithi084.stdout:1977: done (0 left) 2024-03-30T12:29:28.276 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 215 2024-03-30T12:29:28.276 INFO:tasks.rados.rados.0.smithi084.stdout:1978: seq_num 603 ranges {0=507904} 2024-03-30T12:29:28.279 INFO:tasks.rados.rados.0.smithi084.stdout:1978: writing smithi08477944-43 from 0 to 507904 tid 1 2024-03-30T12:29:28.279 INFO:tasks.rados.rados.0.smithi084.stdout:1979: snap_remove snap 194 2024-03-30T12:29:28.497 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:28.266+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e9 after trimming was started 2024-03-30T12:29:28.497 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:28.497 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-mon[83709]: osdmap e487: 8 total, 8 up, 8 in 2024-03-30T12:29:28.497 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:28.497 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:28.497 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:28.498 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:28.498 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:28.498 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-mon[83709]: osd.6 marked itself down and dead 2024-03-30T12:29:28.498 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.260+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.498 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.276+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.498 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.305+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.498 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.319+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.498 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.333+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.498 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.347+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.498 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.360+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.498 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.374+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.499 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.389+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.499 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.403+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.499 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.418+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.499 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.433+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.499 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.448+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.499 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.462+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.499 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.476+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.499 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.490+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.499 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.505+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:28.292+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:28.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:28.286+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:28.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:28.288+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:28.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:28.288+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:28.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:28.288+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:28.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:28.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:28 smithi084 ceph-mon[91810]: osdmap e487: 8 total, 8 up, 8 in 2024-03-30T12:29:28.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:28.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:28.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:28.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:28.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:28.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:28 smithi084 ceph-mon[91810]: osd.6 marked itself down and dead 2024-03-30T12:29:28.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:28.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:28 smithi084 ceph-mon[89279]: osdmap e487: 8 total, 8 up, 8 in 2024-03-30T12:29:28.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:28.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:28.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:28.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:28.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:28.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:28 smithi084 ceph-mon[89279]: osd.6 marked itself down and dead 2024-03-30T12:29:28.665 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T12:29:28.665 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (8m) 91s ago 9m 25.3M - 0.25.0 c8568f914cd2 6765ce007f39 2024-03-30T12:29:28.665 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi162 *:3000 running (9m) 30s ago 9m 90.5M - 9.4.7 954c08fa6188 ff2ec7518619 2024-03-30T12:29:28.666 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (10m) 91s ago 10m 15.1M - 18.2.2-1051-gf14b5682 c8fb09e16a7d a9c2e74ca2a3 2024-03-30T12:29:28.666 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi162 running (10m) 30s ago 10m 21.6M - 18.2.2-1051-gf14b5682 c8fb09e16a7d ee1770ef5edd 2024-03-30T12:29:28.666 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi162 *:8443,9283,8765 running (5m) 30s ago 14m 451M - 19.0.0-1864-g5dc2ea30 548196a1a838 eec968f3fcc6 2024-03-30T12:29:28.666 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (5m) 91s ago 15m 512M - 19.0.0-1864-g5dc2ea30 548196a1a838 9a2aba19dffc 2024-03-30T12:29:28.666 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (4m) 91s ago 15m 55.0M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 a0811f2ae47d 2024-03-30T12:29:28.666 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi162 running (4m) 30s ago 14m 48.9M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 149ae6649e0c 2024-03-30T12:29:28.666 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (4m) 91s ago 14m 47.4M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 f79eca93cddd 2024-03-30T12:29:28.666 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (9m) 91s ago 9m 16.9M - 1.5.0 0da6a335fe13 66844bed39e8 2024-03-30T12:29:28.666 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi162 *:9100 running (9m) 30s ago 9m 15.2M - 1.5.0 0da6a335fe13 3d6e28b2348d 2024-03-30T12:29:28.666 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (3m) 91s ago 13m 182M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 c91eea4f8484 2024-03-30T12:29:28.666 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (2m) 91s ago 13m 109M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 7518832f6b4a 2024-03-30T12:29:28.666 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (2m) 91s ago 12m 123M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 647dd862762d 2024-03-30T12:29:28.666 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (95s) 91s ago 12m 15.1M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 c088a701b71b 2024-03-30T12:29:28.667 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi162 running (61s) 30s ago 12m 217M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 4197b37d2bb8 2024-03-30T12:29:28.667 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi162 running (35s) 30s ago 11m 11.8M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 cd8795ac188a 2024-03-30T12:29:28.667 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi162 running (11m) 30s ago 11m 183M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d 656a733e8b7a 2024-03-30T12:29:28.667 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi162 running (10m) 30s ago 10m 309M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d e3246b3bc88b 2024-03-30T12:29:28.667 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi162 *:9095 running (5m) 30s ago 10m 55.9M - 2.43.0 a07b618ecd1d bd7d323e4b47 2024-03-30T12:29:28.752 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.520+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.753 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.535+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.753 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.550+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.753 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.567+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.753 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.581+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.753 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.596+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.753 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.611+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.753 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.625+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.753 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.641+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.753 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.655+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.753 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.671+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.753 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.686+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.753 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.701+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.753 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.716+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.754 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.731+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:28.754 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.746+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.006 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:28 smithi162 podman[98794]: 2024-03-30 12:29:28.80048738 +0000 UTC m=+0.941981998 container died 656a733e8b7af2ee28672cabf932894f0bfd98cab272f21b0b0cf7f36f1ba765 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=reef-f14b568) 2024-03-30T12:29:29.006 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.760+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.006 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.779+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.006 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.795+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.006 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.812+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.006 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.830+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.006 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.845+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.007 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.860+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.007 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.878+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.007 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.893+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.007 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.908+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.007 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.923+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.007 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.938+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.007 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.952+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.007 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.967+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.007 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.981+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.007 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:28.997+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.202 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-30T12:29:29.202 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-03-30T12:29:29.202 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 3 2024-03-30T12:29:29.202 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:29:29.203 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-03-30T12:29:29.203 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 2 2024-03-30T12:29:29.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:29:29.203 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-03-30T12:29:29.203 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 1, 2024-03-30T12:29:29.203 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 6 2024-03-30T12:29:29.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:29:29.203 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-03-30T12:29:29.203 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 2 2024-03-30T12:29:29.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:29:29.203 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-03-30T12:29:29.203 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 3, 2024-03-30T12:29:29.203 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 11 2024-03-30T12:29:29.203 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-30T12:29:29.204 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-30T12:29:29.263 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.014+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.263 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.029+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.264 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.044+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.264 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.064+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.264 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.079+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.264 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.094+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.264 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.111+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.265 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.127+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.265 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.141+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.265 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.160+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.265 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.174+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.265 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.188+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.266 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.202+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.266 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.216+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.266 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.230+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.266 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.244+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.267 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.258+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.278 INFO:tasks.rados.rados.0.smithi084.stdout:1979: done (1 left) 2024-03-30T12:29:29.278 INFO:tasks.rados.rados.0.smithi084.stdout:1980: copy_from oid 29 from oid 6 current snap is 215 2024-03-30T12:29:29.278 INFO:tasks.rados.rados.0.smithi084.stdout:1978: finishing write tid 1 to smithi08477944-43 2024-03-30T12:29:29.279 INFO:tasks.rados.rados.0.smithi084.stdout:1978: finishing write tid 2 to smithi08477944-43 2024-03-30T12:29:29.279 INFO:tasks.rados.rados.0.smithi084.stdout:1978: finishing write tid 3 to smithi08477944-43 2024-03-30T12:29:29.279 INFO:tasks.rados.rados.0.smithi084.stdout:1978: oid 43 updating version 0 to 23361 2024-03-30T12:29:29.279 INFO:tasks.rados.rados.0.smithi084.stdout:1978: oid 43 updating version 23361 to 23362 2024-03-30T12:29:29.279 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 23362 (ObjNum 603 snap 215 seq_num 603) dirty exists 2024-03-30T12:29:29.279 INFO:tasks.rados.rados.0.smithi084.stdout:1978: left oid 43 (ObjNum 603 snap 215 seq_num 603) 2024-03-30T12:29:29.279 INFO:tasks.rados.rados.0.smithi084.stdout:1978: done (1 left) 2024-03-30T12:29:29.279 INFO:tasks.rados.rados.0.smithi084.stdout:1981: copy_from oid 23 from oid 16 current snap is 215 2024-03-30T12:29:29.279 INFO:tasks.rados.rados.0.smithi084.stdout:1982: delete oid 10 current snap is 215 2024-03-30T12:29:29.294 INFO:tasks.rados.rados.0.smithi084.stdout:1982: done (2 left) 2024-03-30T12:29:29.294 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 215 2024-03-30T12:29:29.294 INFO:tasks.rados.rados.0.smithi084.stdout:1983: seq_num 605 ranges {4268032=540672} 2024-03-30T12:29:29.323 INFO:tasks.rados.rados.0.smithi084.stdout:1983: writing smithi08477944-19 from 4268032 to 4808704 tid 1 2024-03-30T12:29:29.323 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 215 2024-03-30T12:29:29.323 INFO:tasks.rados.rados.0.smithi084.stdout:1981: finishing copy_from racing read to smithi08477944-23 2024-03-30T12:29:29.323 INFO:tasks.rados.rados.0.smithi084.stdout:1981: finishing copy_from to smithi08477944-23 2024-03-30T12:29:29.324 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 942 (ObjNum 395 snap 125 seq_num 395) dirty exists 2024-03-30T12:29:29.324 INFO:tasks.rados.rados.0.smithi084.stdout:1980: finishing copy_from racing read to smithi08477944-29 2024-03-30T12:29:29.324 INFO:tasks.rados.rados.0.smithi084.stdout:1984: seq_num 606 ranges {1212416=557056} 2024-03-30T12:29:29.334 INFO:tasks.rados.rados.0.smithi084.stdout:1984: writing smithi08477944-4 from 1212416 to 1769472 tid 1 2024-03-30T12:29:29.334 INFO:tasks.rados.rados.0.smithi084.stdout:1981: done (3 left) 2024-03-30T12:29:29.334 INFO:tasks.rados.rados.0.smithi084.stdout:1985: read oid 17 snap -1 2024-03-30T12:29:29.335 INFO:tasks.rados.rados.0.smithi084.stdout:1985: expect deleted 2024-03-30T12:29:29.335 INFO:tasks.rados.rados.0.smithi084.stdout:1986: copy_from oid 37 from oid 30 current snap is 215 2024-03-30T12:29:29.335 INFO:tasks.rados.rados.0.smithi084.stdout:1980: finishing copy_from to smithi08477944-29 2024-03-30T12:29:29.335 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 17482 (ObjNum 589 snap 203 seq_num 589) dirty exists 2024-03-30T12:29:29.335 INFO:tasks.rados.rados.0.smithi084.stdout:1980: done (4 left) 2024-03-30T12:29:29.335 INFO:tasks.rados.rados.0.smithi084.stdout:1987: read oid 2 snap -1 2024-03-30T12:29:29.335 INFO:tasks.rados.rados.0.smithi084.stdout:1987: expect deleted 2024-03-30T12:29:29.335 INFO:tasks.rados.rados.0.smithi084.stdout:1988: setattr oid 23 current snap is 215 2024-03-30T12:29:29.335 INFO:tasks.rados.rados.0.smithi084.stdout:1983: finishing write tid 1 to smithi08477944-19 2024-03-30T12:29:29.335 INFO:tasks.rados.rados.0.smithi084.stdout:1983: finishing write tid 2 to smithi08477944-19 2024-03-30T12:29:29.336 INFO:tasks.rados.rados.0.smithi084.stdout:1986: finishing copy_from to smithi08477944-37 2024-03-30T12:29:29.336 INFO:tasks.rados.rados.0.smithi084.stdout:1986: got expected ENOENT (src dne) 2024-03-30T12:29:29.336 INFO:tasks.rados.rados.0.smithi084.stdout:1986: finishing copy_from racing read to smithi08477944-37 2024-03-30T12:29:29.336 INFO:tasks.rados.rados.0.smithi084.stdout:1985: done (5 left) 2024-03-30T12:29:29.336 INFO:tasks.rados.rados.0.smithi084.stdout:1986: done (4 left) 2024-03-30T12:29:29.336 INFO:tasks.rados.rados.0.smithi084.stdout:1989: setattr oid 29 current snap is 215 2024-03-30T12:29:29.337 INFO:tasks.rados.rados.0.smithi084.stdout:1984: finishing write tid 1 to smithi08477944-4 2024-03-30T12:29:29.339 INFO:tasks.rados.rados.0.smithi084.stdout:1987: done (4 left) 2024-03-30T12:29:29.339 INFO:tasks.rados.rados.0.smithi084.stdout:1990: rmattr oid 40 current snap is 215 2024-03-30T12:29:29.339 INFO:tasks.rados.rados.0.smithi084.stdout:1991: read oid 21 snap -1 2024-03-30T12:29:29.339 INFO:tasks.rados.rados.0.smithi084.stdout:1991: expect deleted 2024-03-30T12:29:29.339 INFO:tasks.rados.rados.0.smithi084.stdout:1992: read oid 47 snap -1 2024-03-30T12:29:29.340 INFO:tasks.rados.rados.0.smithi084.stdout:1992: expect (ObjNum 511 snap 162 seq_num 511) 2024-03-30T12:29:29.340 INFO:tasks.rados.rados.0.smithi084.stdout:1993: rollback oid 42 current snap is 215 2024-03-30T12:29:29.340 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 42 to 168 2024-03-30T12:29:29.340 INFO:tasks.rados.rados.0.smithi084.stdout:1994: copy_from oid 39 from oid 49 current snap is 215 2024-03-30T12:29:29.340 INFO:tasks.rados.rados.0.smithi084.stdout:1995: snap_remove snap 198 2024-03-30T12:29:29.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:29:29] "GET /metrics HTTP/1.1" 200 36253 "" "Prometheus/2.43.0" 2024-03-30T12:29:29.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:29.292+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:29.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:29.285+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:29.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:29.285+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:29.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:29.285+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:29.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:29.285+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:29.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:29.285+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:29.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:29.287+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:29.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:29.287+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:29.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-mon[91810]: from='client.44279 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:29:29.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-mon[91810]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T12:29:29.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-mon[91810]: osdmap e488: 8 total, 7 up, 8 in 2024-03-30T12:29:29.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:29.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:29.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:29.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:29.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:29.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-mon[91810]: from='client.44285 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:29:29.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-mon[91810]: pgmap v415: 121 pgs: 2 peering, 14 stale+active+clean, 4 active+clean+snaptrim, 95 active+clean, 6 active+clean+snaptrim_error; 377 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 8.2 MiB/s rd, 3.3 MiB/s wr, 24 op/s 2024-03-30T12:29:29.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/322207109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:29:29.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-mon[89279]: from='client.44279 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:29:29.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-mon[89279]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T12:29:29.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-mon[89279]: osdmap e488: 8 total, 7 up, 8 in 2024-03-30T12:29:29.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:29.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:29.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:29.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:29.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:29.510 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-mon[89279]: from='client.44285 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:29:29.510 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-mon[89279]: pgmap v415: 121 pgs: 2 peering, 14 stale+active+clean, 4 active+clean+snaptrim, 95 active+clean, 6 active+clean+snaptrim_error; 377 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 8.2 MiB/s rd, 3.3 MiB/s wr, 24 op/s 2024-03-30T12:29:29.510 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:29 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/322207109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:29:29.527 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:29 smithi162 podman[98794]: 2024-03-30 12:29:29.275730403 +0000 UTC m=+1.417225007 container cleanup 656a733e8b7af2ee28672cabf932894f0bfd98cab272f21b0b0cf7f36f1ba765 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=reef-f14b568) 2024-03-30T12:29:29.527 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:29 smithi162 bash[98794]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6 2024-03-30T12:29:29.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-mon[83709]: from='client.44279 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:29:29.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-mon[83709]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T12:29:29.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-mon[83709]: osdmap e488: 8 total, 7 up, 8 in 2024-03-30T12:29:29.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:29.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:29.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:29.529 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:29.529 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:29.529 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-mon[83709]: from='client.44285 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:29:29.529 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-mon[83709]: pgmap v415: 121 pgs: 2 peering, 14 stale+active+clean, 4 active+clean+snaptrim, 95 active+clean, 6 active+clean+snaptrim_error; 377 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 8.2 MiB/s rd, 3.3 MiB/s wr, 24 op/s 2024-03-30T12:29:29.529 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/322207109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:29:29.530 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.274+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.530 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.308+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.530 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.327+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.530 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.343+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.530 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.363+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.530 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.381+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.531 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.395+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.531 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.412+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.531 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.429+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.531 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.447+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.531 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.462+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.531 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.477+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.532 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.492+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.532 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.507+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.532 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.520+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.532 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.535+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.783 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:29 smithi162 podman[98808]: 2024-03-30 12:29:29.576172511 +0000 UTC m=+0.773181178 container remove 656a733e8b7af2ee28672cabf932894f0bfd98cab272f21b0b0cf7f36f1ba765 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=reef-f14b568, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-03-30T12:29:29.783 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.550+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.783 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.566+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.783 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.580+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.784 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.595+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.784 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.612+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.784 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.630+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.784 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.644+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.784 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.659+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.784 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.675+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.784 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.690+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.784 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.707+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.784 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.723+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.784 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.738+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.784 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.753+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.785 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.771+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:29.785 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.788+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.037 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:30 smithi162 podman[98884]: 2024-03-30 12:29:29.916103742 +0000 UTC m=+0.027151000 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:29:30.037 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.805+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.037 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.822+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.037 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.841+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.037 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.858+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.037 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.876+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.037 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.892+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.037 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.910+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.038 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.927+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.038 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.944+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.038 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.957+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.038 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.971+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.038 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:29.985+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.038 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.000+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.038 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.015+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.038 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.030+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.038 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.045+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.279 INFO:tasks.rados.rados.0.smithi084.stdout:1995: done (9 left) 2024-03-30T12:29:30.279 INFO:tasks.rados.rados.0.smithi084.stdout:1996: rmattr oid 15 current snap is 215 2024-03-30T12:29:30.279 INFO:tasks.rados.rados.0.smithi084.stdout:1997: snap_create 2024-03-30T12:29:30.279 INFO:tasks.rados.rados.0.smithi084.stdout:1984: finishing write tid 2 to smithi08477944-4 2024-03-30T12:29:30.279 INFO:tasks.rados.rados.0.smithi084.stdout:1993: finishing rollback tid 1 to smithi08477944-42 2024-03-30T12:29:30.279 INFO:tasks.rados.rados.0.smithi084.stdout:1984: finishing write tid 3 to smithi08477944-4 2024-03-30T12:29:30.279 INFO:tasks.rados.rados.0.smithi084.stdout:1984: oid 4 updating version 0 to 17483 2024-03-30T12:29:30.279 INFO:tasks.rados.rados.0.smithi084.stdout:1984: oid 4 updating version 17483 to 17484 2024-03-30T12:29:30.279 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 17484 (ObjNum 606 snap 215 seq_num 606) dirty exists 2024-03-30T12:29:30.280 INFO:tasks.rados.rados.0.smithi084.stdout:1984: left oid 4 (ObjNum 606 snap 215 seq_num 606) 2024-03-30T12:29:30.280 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 943 (ObjNum 395 snap 125 seq_num 395) dirty exists 2024-03-30T12:29:30.280 INFO:tasks.rados.rados.0.smithi084.stdout:1993: finishing rollback tid 2 to smithi08477944-42 2024-03-30T12:29:30.280 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 946 (ObjNum 502 snap 157 seq_num 502) dirty exists 2024-03-30T12:29:30.280 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 17485 (ObjNum 589 snap 203 seq_num 589) dirty exists 2024-03-30T12:29:30.280 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 965 (ObjNum 599 snap 211 seq_num 599) dirty exists 2024-03-30T12:29:30.280 INFO:tasks.rados.rados.0.smithi084.stdout:1992: expect (ObjNum 511 snap 162 seq_num 511) 2024-03-30T12:29:30.289 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.059+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.289 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.074+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.289 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.089+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.289 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.103+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.289 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.117+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.289 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.133+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.289 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.149+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.289 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.163+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.290 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.177+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.290 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.192+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.290 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.207+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.290 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.223+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.290 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.237+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.290 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.297+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.290 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-mon[83709]: osdmap e489: 8 total, 7 up, 8 in 2024-03-30T12:29:30.290 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:30.290 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:30.290 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:30.290 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:30.290 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:30.291 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:30.291 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:29:30.332 INFO:tasks.rados.rados.0.smithi084.stdout:1983: finishing write tid 3 to smithi08477944-19 2024-03-30T12:29:30.332 INFO:tasks.rados.rados.0.smithi084.stdout:1983: oid 19 updating version 0 to 23724 2024-03-30T12:29:30.332 INFO:tasks.rados.rados.0.smithi084.stdout:1983: oid 19 updating version 23724 to 23725 2024-03-30T12:29:30.332 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 23725 (ObjNum 605 snap 215 seq_num 605) dirty exists 2024-03-30T12:29:30.332 INFO:tasks.rados.rados.0.smithi084.stdout:1983: left oid 19 (ObjNum 605 snap 215 seq_num 605) 2024-03-30T12:29:30.332 INFO:tasks.rados.rados.0.smithi084.stdout:1994: finishing copy_from racing read to smithi08477944-39 2024-03-30T12:29:30.332 INFO:tasks.rados.rados.0.smithi084.stdout:1994: finishing copy_from to smithi08477944-39 2024-03-30T12:29:30.332 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 806 (ObjNum 457 snap 143 seq_num 457) dirty exists 2024-03-30T12:29:30.332 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 947 (ObjNum 549 snap 185 seq_num 549) dirty exists 2024-03-30T12:29:30.550 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.311+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.551 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.326+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.551 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.340+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.551 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.354+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.551 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.370+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.551 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.383+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.551 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.397+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.551 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.413+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.551 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.427+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.551 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.442+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.551 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.457+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.551 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.471+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.551 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.485+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.552 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.500+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.552 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.515+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.552 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.530+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.552 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.544+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.552 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.558+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:30.287+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:30.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:30.283+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:30.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:30.283+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:30.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:30.283+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:30.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:30.286+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:30.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:30 smithi084 ceph-mon[89279]: osdmap e489: 8 total, 7 up, 8 in 2024-03-30T12:29:30.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:30.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:30.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:30.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:30.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:30.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:30 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:30.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:30 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:29:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:30 smithi084 ceph-mon[91810]: osdmap e489: 8 total, 7 up, 8 in 2024-03-30T12:29:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:30 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:30 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:29:30.806 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:30 smithi162 podman[98884]: 2024-03-30 12:29:30.754222493 +0000 UTC m=+0.865269737 container create ce4315a9d9a5d1085c17c5c1eb97e9d9fef906d25d4b1034fbd52306d2f41f0a (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6-deactivate, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:29:30.807 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.574+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.807 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.590+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.807 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.605+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.807 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.620+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.807 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.636+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.807 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.650+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.807 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.664+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.807 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.680+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.807 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.695+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.807 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.709+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.807 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.723+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.808 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.738+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.808 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.752+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.808 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.769+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.808 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.783+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:30.808 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.799+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.072 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:31 smithi162 podman[98884]: 2024-03-30 12:29:31.016143827 +0000 UTC m=+1.127191074 container init ce4315a9d9a5d1085c17c5c1eb97e9d9fef906d25d4b1034fbd52306d2f41f0a (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-03-30T12:29:31.072 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:31 smithi162 podman[98884]: 2024-03-30 12:29:31.021508078 +0000 UTC m=+1.132555322 container start ce4315a9d9a5d1085c17c5c1eb97e9d9fef906d25d4b1034fbd52306d2f41f0a (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS) 2024-03-30T12:29:31.073 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.815+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.073 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.829+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.073 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.844+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.073 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.860+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.073 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.877+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.073 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.894+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.073 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.909+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.073 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.924+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.074 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.939+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.074 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.956+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.074 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.971+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.074 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.985+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.074 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:30.999+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.074 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.013+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.074 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.030+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.074 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.046+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.074 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.066+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.074 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.080+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.291 INFO:tasks.rados.rados.0.smithi084.stdout:1983: done (10 left) 2024-03-30T12:29:31.291 INFO:tasks.rados.rados.0.smithi084.stdout:1984: done (9 left) 2024-03-30T12:29:31.292 INFO:tasks.rados.rados.0.smithi084.stdout:1988: done (8 left) 2024-03-30T12:29:31.292 INFO:tasks.rados.rados.0.smithi084.stdout:1989: done (7 left) 2024-03-30T12:29:31.292 INFO:tasks.rados.rados.0.smithi084.stdout:1990: done (6 left) 2024-03-30T12:29:31.292 INFO:tasks.rados.rados.0.smithi084.stdout:1991: done (5 left) 2024-03-30T12:29:31.292 INFO:tasks.rados.rados.0.smithi084.stdout:1992: done (4 left) 2024-03-30T12:29:31.292 INFO:tasks.rados.rados.0.smithi084.stdout:1993: done (3 left) 2024-03-30T12:29:31.292 INFO:tasks.rados.rados.0.smithi084.stdout:1994: done (2 left) 2024-03-30T12:29:31.292 INFO:tasks.rados.rados.0.smithi084.stdout:1996: done (1 left) 2024-03-30T12:29:31.292 INFO:tasks.rados.rados.0.smithi084.stdout:1997: done (0 left) 2024-03-30T12:29:31.292 INFO:tasks.rados.rados.0.smithi084.stdout:1998: delete oid 15 current snap is 216 2024-03-30T12:29:31.295 INFO:tasks.rados.rados.0.smithi084.stdout:1998: done (0 left) 2024-03-30T12:29:31.295 INFO:tasks.rados.rados.0.smithi084.stdout:1999: snap_remove snap 199 2024-03-30T12:29:31.324 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:31 smithi162 podman[98884]: 2024-03-30 12:29:31.133003586 +0000 UTC m=+1.244050825 container attach ce4315a9d9a5d1085c17c5c1eb97e9d9fef906d25d4b1034fbd52306d2f41f0a (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.build-date=20240326) 2024-03-30T12:29:31.325 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.099+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.325 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.115+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.325 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.132+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.325 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.147+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.325 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.161+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.325 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.175+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.325 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.192+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.325 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.218+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.325 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.234+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.325 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.249+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.325 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.264+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.326 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.280+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.326 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.296+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.326 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.316+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:31.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:31.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:31.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-mon[83709]: osdmap e490: 8 total, 7 up, 8 in 2024-03-30T12:29:31.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:31.326 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:31.327 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-mon[83709]: pgmap v418: 121 pgs: 5 active+undersized+degraded, 13 active+undersized, 5 peering, 9 stale+active+clean, 3 active+clean+snaptrim, 80 active+clean, 6 active+clean+snaptrim_error; 377 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 4.1 MiB/s rd, 862 KiB/s wr, 21 op/s; 16/765 objects degraded (2.092%) 2024-03-30T12:29:31.577 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:31 smithi162 podman[98884]: 2024-03-30 12:29:31.465867971 +0000 UTC m=+1.576915216 container died ce4315a9d9a5d1085c17c5c1eb97e9d9fef906d25d4b1034fbd52306d2f41f0a (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:29:31.577 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.333+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.577 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.350+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.577 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.366+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.577 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.383+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.577 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.400+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.577 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.416+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.578 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.434+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.578 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.450+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.578 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.466+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.578 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.484+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.578 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.499+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.578 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.513+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.578 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.527+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.578 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.541+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.578 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.556+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.578 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.570+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.578 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.585+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:31.298+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:31.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:31.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:31.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:31.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:31 smithi084 ceph-mon[91810]: osdmap e490: 8 total, 7 up, 8 in 2024-03-30T12:29:31.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:31.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:31.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:31 smithi084 ceph-mon[91810]: pgmap v418: 121 pgs: 5 active+undersized+degraded, 13 active+undersized, 5 peering, 9 stale+active+clean, 3 active+clean+snaptrim, 80 active+clean, 6 active+clean+snaptrim_error; 377 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 4.1 MiB/s rd, 862 KiB/s wr, 21 op/s; 16/765 objects degraded (2.092%) 2024-03-30T12:29:31.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:31.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:31.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:31.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:31 smithi084 ceph-mon[89279]: osdmap e490: 8 total, 7 up, 8 in 2024-03-30T12:29:31.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:31.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:31.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:31 smithi084 ceph-mon[89279]: pgmap v418: 121 pgs: 5 active+undersized+degraded, 13 active+undersized, 5 peering, 9 stale+active+clean, 3 active+clean+snaptrim, 80 active+clean, 6 active+clean+snaptrim_error; 377 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 4.1 MiB/s rd, 862 KiB/s wr, 21 op/s; 16/765 objects degraded (2.092%) 2024-03-30T12:29:31.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:31.296+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:31.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:31.296+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:31.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:31.296+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:31.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:31.296+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:31.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:31.296+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:31.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:31.296+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:31.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:31.296+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:31.829 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.599+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.829 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.612+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.829 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.627+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.829 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.641+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.829 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.656+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.829 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.671+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.829 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.686+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.829 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.700+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.829 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.716+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.829 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.732+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.829 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.746+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.829 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.761+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.830 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.775+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.830 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.791+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.830 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.807+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.830 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.821+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:31.830 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.836+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.083 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:32 smithi162 podman[98909]: 2024-03-30 12:29:32.079971868 +0000 UTC m=+0.607056262 container remove ce4315a9d9a5d1085c17c5c1eb97e9d9fef906d25d4b1034fbd52306d2f41f0a (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T12:29:32.083 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.852+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.083 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.949+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.083 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.963+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.083 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.978+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.083 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:31.993+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.083 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.008+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.083 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.022+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.083 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.037+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.084 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.052+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.084 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.067+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.084 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.081+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.296 INFO:tasks.rados.rados.0.smithi084.stdout:1999: done (0 left) 2024-03-30T12:29:32.297 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 216 2024-03-30T12:29:32.297 INFO:tasks.rados.rados.0.smithi084.stdout:2000: seq_num 608 ranges {0=589824} 2024-03-30T12:29:32.300 INFO:tasks.rados.rados.0.smithi084.stdout:2000: writing smithi08477944-21 from 0 to 589824 tid 1 2024-03-30T12:29:32.300 INFO:tasks.rados.rados.0.smithi084.stdout:2001: rmattr oid 18 current snap is 216 2024-03-30T12:29:32.300 INFO:tasks.rados.rados.0.smithi084.stdout:2002: copy_from oid 46 from oid 10 current snap is 216 2024-03-30T12:29:32.300 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 216 2024-03-30T12:29:32.300 INFO:tasks.rados.rados.0.smithi084.stdout:2003: seq_num 609 ranges {0=606208} 2024-03-30T12:29:32.304 INFO:tasks.rados.rados.0.smithi084.stdout:2003: writing smithi08477944-7 from 0 to 606208 tid 1 2024-03-30T12:29:32.304 INFO:tasks.rados.rados.0.smithi084.stdout:2004: snap_remove snap 202 2024-03-30T12:29:32.337 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-mon[83709]: Health check failed: Degraded data redundancy: 16/765 objects degraded (2.092%), 5 pgs degraded (PG_DEGRADED) 2024-03-30T12:29:32.337 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:32.337 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:32.337 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:32.337 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:32.338 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-mon[83709]: osdmap e491: 8 total, 7 up, 8 in 2024-03-30T12:29:32.338 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:32.338 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.099+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.338 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.117+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.338 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.133+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.338 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.149+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.338 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.174+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.338 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.191+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.338 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.206+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.338 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.220+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.339 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.234+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.339 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.249+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.339 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.264+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.339 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.282+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.339 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.298+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.339 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.325+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.339 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.330+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.339 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.345+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.339 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:32 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.6.service: Deactivated successfully. 2024-03-30T12:29:32.339 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:32 smithi162 systemd[1]: Stopped Ceph osd.6 for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:29:32.339 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:32 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.6.service: Consumed 22.890s CPU time. 2024-03-30T12:29:32.601 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:32 smithi162 systemd[1]: Starting Ceph osd.6 for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:29:32.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.361+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.380+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.395+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.410+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.426+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.444+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.460+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.477+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.602 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.494+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.603 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.511+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.603 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.528+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.603 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.545+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.603 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.561+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.603 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.578+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.603 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.594+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.603 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.610+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:32.305+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:32.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:32.310+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:32.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:32.310+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:32.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:32.311+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:32.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:32.313+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:32.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:32 smithi084 ceph-mon[91810]: Health check failed: Degraded data redundancy: 16/765 objects degraded (2.092%), 5 pgs degraded (PG_DEGRADED) 2024-03-30T12:29:32.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:32.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:32.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:32.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:32.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:32 smithi084 ceph-mon[91810]: osdmap e491: 8 total, 7 up, 8 in 2024-03-30T12:29:32.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:32 smithi084 ceph-mon[89279]: Health check failed: Degraded data redundancy: 16/765 objects degraded (2.092%), 5 pgs degraded (PG_DEGRADED) 2024-03-30T12:29:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:32 smithi084 ceph-mon[89279]: osdmap e491: 8 total, 7 up, 8 in 2024-03-30T12:29:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:32.861 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:32 smithi162 podman[99001]: 2024-03-30 12:29:32.574015094 +0000 UTC m=+0.026323515 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:29:32.862 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:32 smithi162 podman[99001]: 2024-03-30 12:29:32.697912987 +0000 UTC m=+0.150221442 container create 39c12841168f96aad80054aaba0b699e744f37e8818ee8f4871b8579446e7ede (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux ) 2024-03-30T12:29:32.862 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.625+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.862 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.639+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.862 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.655+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.862 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.669+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.862 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.685+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.863 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.703+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.863 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.717+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.863 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.732+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.863 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.747+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.863 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.762+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.863 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.776+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.863 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.791+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.863 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.806+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.863 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.825+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.863 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.842+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:32.863 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.857+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:32 smithi162 podman[99001]: 2024-03-30 12:29:32.985183929 +0000 UTC m=+0.437492348 container init 39c12841168f96aad80054aaba0b699e744f37e8818ee8f4871b8579446e7ede (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6-activate, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD) 2024-03-30T12:29:33.120 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:32 smithi162 podman[99001]: 2024-03-30 12:29:32.992065181 +0000 UTC m=+0.444373597 container start 39c12841168f96aad80054aaba0b699e744f37e8818ee8f4871b8579446e7ede (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6-activate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True) 2024-03-30T12:29:33.120 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:33 smithi162 podman[99001]: 2024-03-30 12:29:33.093154889 +0000 UTC m=+0.545463306 container attach 39c12841168f96aad80054aaba0b699e744f37e8818ee8f4871b8579446e7ede (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6-activate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-03-30T12:29:33.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.870+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.892+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.906+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.921+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.935+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.951+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.965+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.981+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:32.999+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.015+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.031+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.048+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.064+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.081+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.097+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.114+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.306 INFO:tasks.rados.rados.0.smithi084.stdout:2004: done (4 left) 2024-03-30T12:29:33.306 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 216 2024-03-30T12:29:33.306 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 946 (ObjNum 558 snap 191 seq_num 558) dirty exists 2024-03-30T12:29:33.306 INFO:tasks.rados.rados.0.smithi084.stdout:2003: finishing write tid 1 to smithi08477944-7 2024-03-30T12:29:33.306 INFO:tasks.rados.rados.0.smithi084.stdout:2002: finishing copy_from to smithi08477944-46 2024-03-30T12:29:33.306 INFO:tasks.rados.rados.0.smithi084.stdout:2002: got expected ENOENT (src dne) 2024-03-30T12:29:33.306 INFO:tasks.rados.rados.0.smithi084.stdout:2003: finishing write tid 2 to smithi08477944-7 2024-03-30T12:29:33.306 INFO:tasks.rados.rados.0.smithi084.stdout:2002: finishing copy_from racing read to smithi08477944-46 2024-03-30T12:29:33.307 INFO:tasks.rados.rados.0.smithi084.stdout:2003: finishing write tid 3 to smithi08477944-7 2024-03-30T12:29:33.307 INFO:tasks.rados.rados.0.smithi084.stdout:2003: oid 7 updating version 0 to 967 2024-03-30T12:29:33.307 INFO:tasks.rados.rados.0.smithi084.stdout:2003: oid 7 updating version 967 to 968 2024-03-30T12:29:33.307 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 968 (ObjNum 609 snap 216 seq_num 609) dirty exists 2024-03-30T12:29:33.307 INFO:tasks.rados.rados.0.smithi084.stdout:2003: left oid 7 (ObjNum 609 snap 216 seq_num 609) 2024-03-30T12:29:33.307 INFO:tasks.rados.rados.0.smithi084.stdout:2000: finishing write tid 1 to smithi08477944-21 2024-03-30T12:29:33.307 INFO:tasks.rados.rados.0.smithi084.stdout:2000: finishing write tid 2 to smithi08477944-21 2024-03-30T12:29:33.307 INFO:tasks.rados.rados.0.smithi084.stdout:2000: finishing write tid 3 to smithi08477944-21 2024-03-30T12:29:33.307 INFO:tasks.rados.rados.0.smithi084.stdout:2000: oid 21 updating version 0 to 12834 2024-03-30T12:29:33.307 INFO:tasks.rados.rados.0.smithi084.stdout:2000: oid 21 version 12834 is already newer than 12833 2024-03-30T12:29:33.307 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 12834 (ObjNum 608 snap 216 seq_num 608) dirty exists 2024-03-30T12:29:33.307 INFO:tasks.rados.rados.0.smithi084.stdout:2000: left oid 21 (ObjNum 608 snap 216 seq_num 608) 2024-03-30T12:29:33.307 INFO:tasks.rados.rados.0.smithi084.stdout:2005: seq_num 610 ranges {0=622592} 2024-03-30T12:29:33.309 INFO:tasks.rados.rados.0.smithi084.stdout:2005: writing smithi08477944-48 from 0 to 622592 tid 1 2024-03-30T12:29:33.309 INFO:tasks.rados.rados.0.smithi084.stdout:2000: done (4 left) 2024-03-30T12:29:33.309 INFO:tasks.rados.rados.0.smithi084.stdout:2001: done (3 left) 2024-03-30T12:29:33.309 INFO:tasks.rados.rados.0.smithi084.stdout:2002: done (2 left) 2024-03-30T12:29:33.310 INFO:tasks.rados.rados.0.smithi084.stdout:2003: done (1 left) 2024-03-30T12:29:33.310 INFO:tasks.rados.rados.0.smithi084.stdout:2006: rollback oid 5 current snap is 216 2024-03-30T12:29:33.310 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 5 to 204 2024-03-30T12:29:33.310 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 216 2024-03-30T12:29:33.310 INFO:tasks.rados.rados.0.smithi084.stdout:2007: seq_num 611 ranges {0=638976} 2024-03-30T12:29:33.313 INFO:tasks.rados.rados.0.smithi084.stdout:2007: writing smithi08477944-36 from 0 to 638976 tid 1 2024-03-30T12:29:33.313 INFO:tasks.rados.rados.0.smithi084.stdout:2008: snap_create 2024-03-30T12:29:33.316 INFO:tasks.rados.rados.0.smithi084.stdout:2005: finishing write tid 1 to smithi08477944-48 2024-03-30T12:29:33.318 INFO:tasks.rados.rados.0.smithi084.stdout:2006: finishing rollback tid 0 to smithi08477944-5 2024-03-30T12:29:33.318 INFO:tasks.rados.rados.0.smithi084.stdout:2006: finishing rollback tid 1 to smithi08477944-5 2024-03-30T12:29:33.318 INFO:tasks.rados.rados.0.smithi084.stdout:2006: finishing rollback tid 2 to smithi08477944-5 2024-03-30T12:29:33.318 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 941 (ObjNum 568 snap 195 seq_num 568) dirty exists 2024-03-30T12:29:33.319 INFO:tasks.rados.rados.0.smithi084.stdout:2005: finishing write tid 2 to smithi08477944-48 2024-03-30T12:29:33.322 INFO:tasks.rados.rados.0.smithi084.stdout:2007: finishing write tid 1 to smithi08477944-36 2024-03-30T12:29:33.322 INFO:tasks.rados.rados.0.smithi084.stdout:2007: finishing write tid 2 to smithi08477944-36 2024-03-30T12:29:33.323 INFO:tasks.rados.rados.0.smithi084.stdout:2005: finishing write tid 3 to smithi08477944-48 2024-03-30T12:29:33.323 INFO:tasks.rados.rados.0.smithi084.stdout:2005: oid 48 updating version 0 to 903 2024-03-30T12:29:33.323 INFO:tasks.rados.rados.0.smithi084.stdout:2005: oid 48 updating version 903 to 904 2024-03-30T12:29:33.323 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 904 (ObjNum 610 snap 216 seq_num 610) dirty exists 2024-03-30T12:29:33.323 INFO:tasks.rados.rados.0.smithi084.stdout:2005: left oid 48 (ObjNum 610 snap 216 seq_num 610) 2024-03-30T12:29:33.324 INFO:tasks.rados.rados.0.smithi084.stdout:2007: finishing write tid 3 to smithi08477944-36 2024-03-30T12:29:33.324 INFO:tasks.rados.rados.0.smithi084.stdout:2007: oid 36 updating version 0 to 944 2024-03-30T12:29:33.325 INFO:tasks.rados.rados.0.smithi084.stdout:2007: oid 36 updating version 944 to 945 2024-03-30T12:29:33.325 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 945 (ObjNum 611 snap 216 seq_num 611) dirty exists 2024-03-30T12:29:33.325 INFO:tasks.rados.rados.0.smithi084.stdout:2007: left oid 36 (ObjNum 611 snap 216 seq_num 611) 2024-03-30T12:29:33.387 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.130+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.387 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.145+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.387 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.161+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.387 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.177+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.387 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.193+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.387 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.210+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.387 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.226+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.387 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.241+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.387 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.257+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.387 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.273+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.387 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.288+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.388 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.304+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.388 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.324+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.388 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.343+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.388 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.359+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.388 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.376+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.388 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-mon[83709]: osdmap e492: 8 total, 7 up, 8 in 2024-03-30T12:29:33.388 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:33.388 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:33.388 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:33.388 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:33.388 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:33.389 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-mon[83709]: pgmap v421: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 7 active+undersized+degraded, 30 active+undersized, 5 peering, 3 active+clean+snaptrim, 70 active+clean, 5 active+clean+snaptrim_error; 392 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.0 MiB/s wr, 11 op/s; 66/783 objects degraded (8.429%) 2024-03-30T12:29:33.651 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.395+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.651 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.412+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.651 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.430+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.651 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.446+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.651 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.462+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.651 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.477+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.651 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.495+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.651 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.514+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.651 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.530+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.652 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.546+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.652 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.563+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.652 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.580+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.652 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.595+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.652 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.611+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.652 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.627+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.652 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.643+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.652 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.658+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:33.313+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:33.754 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:29:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3[111861]: 2024-03-30T12:29:33.328+0000 7fa6ff147700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 109 after trimming was started 2024-03-30T12:29:33.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:33 smithi084 ceph-mon[91810]: osdmap e492: 8 total, 7 up, 8 in 2024-03-30T12:29:33.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:33.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:33.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:33.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:33.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:33.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:33 smithi084 ceph-mon[91810]: pgmap v421: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 7 active+undersized+degraded, 30 active+undersized, 5 peering, 3 active+clean+snaptrim, 70 active+clean, 5 active+clean+snaptrim_error; 392 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.0 MiB/s wr, 11 op/s; 66/783 objects degraded (8.429%) 2024-03-30T12:29:33.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:33 smithi084 ceph-mon[89279]: osdmap e492: 8 total, 7 up, 8 in 2024-03-30T12:29:33.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:33.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:33.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:33.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 111=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:33.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:33.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:33 smithi084 ceph-mon[89279]: pgmap v421: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 7 active+undersized+degraded, 30 active+undersized, 5 peering, 3 active+clean+snaptrim, 70 active+clean, 5 active+clean+snaptrim_error; 392 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 3.2 MiB/s rd, 2.0 MiB/s wr, 11 op/s; 66/783 objects degraded (8.429%) 2024-03-30T12:29:33.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:33.326+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:33.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:33.327+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:33.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:33.327+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:33.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:33.327+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:33.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:33.327+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:33.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:33.327+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:33.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:33.328+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:33.906 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6-activate[99016]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-30T12:29:33.906 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6-activate[99016]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-03-30T12:29:33.906 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:33 smithi162 bash[99001]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-30T12:29:33.906 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:33 smithi162 bash[99001]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-03-30T12:29:33.907 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:33 smithi162 bash[99001]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-03-30T12:29:33.907 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:33 smithi162 bash[99001]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-03-30T12:29:33.907 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:33 smithi162 bash[99001]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-03-30T12:29:33.907 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:33 smithi162 bash[99001]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-30T12:29:33.907 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:33 smithi162 bash[99001]: --> ceph-volume raw activate successful for osd ID: 6 2024-03-30T12:29:33.907 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6-activate[99016]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-03-30T12:29:33.907 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6-activate[99016]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-03-30T12:29:33.907 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6-activate[99016]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-03-30T12:29:33.907 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6-activate[99016]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-30T12:29:33.907 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6-activate[99016]: --> ceph-volume raw activate successful for osd ID: 6 2024-03-30T12:29:33.907 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:33 smithi162 podman[99001]: 2024-03-30 12:29:33.706704959 +0000 UTC m=+1.159013370 container died 39c12841168f96aad80054aaba0b699e744f37e8818ee8f4871b8579446e7ede (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6-activate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:29:33.907 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.674+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.691+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.707+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.723+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.740+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.754+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.768+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.781+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.796+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.812+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.825+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.840+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.855+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.870+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.884+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.909 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.900+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:33.909 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.914+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.164 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.935+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.165 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.951+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.165 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.967+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.165 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.981+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.165 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:33.994+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.165 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.009+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.165 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.025+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.165 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.040+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.165 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.055+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.165 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.069+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.165 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.084+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.165 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.099+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.165 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.114+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.165 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.129+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.166 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.143+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.166 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.158+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.166 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.172+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.308 INFO:tasks.rados.rados.0.smithi084.stdout:2005: done (3 left) 2024-03-30T12:29:34.308 INFO:tasks.rados.rados.0.smithi084.stdout:2006: done (2 left) 2024-03-30T12:29:34.308 INFO:tasks.rados.rados.0.smithi084.stdout:2007: done (1 left) 2024-03-30T12:29:34.308 INFO:tasks.rados.rados.0.smithi084.stdout:2008: done (0 left) 2024-03-30T12:29:34.308 INFO:tasks.rados.rados.0.smithi084.stdout:2009: snap_remove snap 201 2024-03-30T12:29:34.427 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:34 smithi162 podman[99148]: 2024-03-30 12:29:34.340068354 +0000 UTC m=+0.622204929 container remove 39c12841168f96aad80054aaba0b699e744f37e8818ee8f4871b8579446e7ede (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-03-30T12:29:34.428 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:34.428 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-mon[83709]: osdmap e493: 8 total, 7 up, 8 in 2024-03-30T12:29:34.428 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:34.428 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:34.428 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:34.428 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:34.428 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.186+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.428 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.200+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.428 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.215+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.428 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.229+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.428 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.245+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.429 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.259+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.429 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.274+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.429 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.289+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.429 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.304+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.429 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.321+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.429 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.336+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.429 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.353+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.429 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.369+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.429 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.384+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.429 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.401+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.429 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.418+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.429 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.435+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.688 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:34 smithi162 podman[99195]: 2024-03-30 12:29:34.506394593 +0000 UTC m=+0.028654317 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:29:34.688 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:34 smithi162 podman[99195]: 2024-03-30 12:29:34.62453322 +0000 UTC m=+0.146792920 container create 40ed6df811943a51095d3bdc149c040a773bf5fef5a35541bcd55d8bacabd790 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326) 2024-03-30T12:29:34.689 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.454+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.689 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.471+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.689 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.488+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.689 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.505+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.689 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.520+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.689 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.534+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.689 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.550+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.689 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.564+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.689 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.579+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.689 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.594+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.690 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.608+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.690 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.622+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.690 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.638+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.690 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.652+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.690 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.667+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.690 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.682+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.690 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.697+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:34.320+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:34.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:34.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:34 smithi084 ceph-mon[89279]: osdmap e493: 8 total, 7 up, 8 in 2024-03-30T12:29:34.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:34.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:34.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:34.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:34.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:34.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:34 smithi084 ceph-mon[91810]: osdmap e493: 8 total, 7 up, 8 in 2024-03-30T12:29:34.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:34.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:34.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:34.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:34.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:34.518+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:34.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:34.519+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:34.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:34.519+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:34.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:34.519+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:34.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.712+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.727+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.742+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.758+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.775+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.800+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.818+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.833+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.847+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.945 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.862+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.945 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.877+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.945 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.892+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.945 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.906+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.945 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.921+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.945 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.936+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:34.945 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.951+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.205 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:34 smithi162 podman[99195]: 2024-03-30 12:29:34.96072864 +0000 UTC m=+0.482988363 container init 40ed6df811943a51095d3bdc149c040a773bf5fef5a35541bcd55d8bacabd790 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240326, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:29:35.205 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:34 smithi162 podman[99195]: 2024-03-30 12:29:34.965816524 +0000 UTC m=+0.488076229 container start 40ed6df811943a51095d3bdc149c040a773bf5fef5a35541bcd55d8bacabd790 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, io.buildah.version=1.33.5, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T12:29:35.205 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-osd[99211]: -- 172.21.15.162:0/1640859581 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f99f775680 con 0x55f99f73f000 2024-03-30T12:29:35.205 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.967+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.205 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:34.985+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.205 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.004+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.205 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.018+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.205 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.033+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.205 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.047+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.206 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.063+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.206 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.077+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.206 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.093+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.206 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.108+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.206 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.122+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.206 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.137+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.206 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.152+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.206 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.167+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.206 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.183+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.206 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.198+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.206 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.213+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.321 INFO:tasks.rados.rados.0.smithi084.stdout:2009: done (0 left) 2024-03-30T12:29:35.321 INFO:tasks.rados.rados.0.smithi084.stdout:2010: read oid 16 snap -1 2024-03-30T12:29:35.321 INFO:tasks.rados.rados.0.smithi084.stdout:2010: expect (ObjNum 395 snap 125 seq_num 395) 2024-03-30T12:29:35.322 INFO:tasks.rados.rados.0.smithi084.stdout:2011: rollback oid 31 current snap is 217 2024-03-30T12:29:35.322 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 31 to 172 2024-03-30T12:29:35.322 INFO:tasks.rados.rados.0.smithi084.stdout:2012: rollback oid 36 current snap is 217 2024-03-30T12:29:35.322 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 36 to 213 2024-03-30T12:29:35.322 INFO:tasks.rados.rados.0.smithi084.stdout:2013: rollback oid 28 current snap is 217 2024-03-30T12:29:35.322 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 28 to 208 2024-03-30T12:29:35.322 INFO:tasks.rados.rados.0.smithi084.stdout:2014: snap_create 2024-03-30T12:29:35.329 INFO:tasks.rados.rados.0.smithi084.stdout:2011: finishing rollback tid 1 to smithi08477944-31 2024-03-30T12:29:35.329 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 810 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-03-30T12:29:35.329 INFO:tasks.rados.rados.0.smithi084.stdout:2013: finishing rollback tid 0 to smithi08477944-28 2024-03-30T12:29:35.330 INFO:tasks.rados.rados.0.smithi084.stdout:2013: finishing rollback tid 1 to smithi08477944-28 2024-03-30T12:29:35.330 INFO:tasks.rados.rados.0.smithi084.stdout:2013: finishing rollback tid 2 to smithi08477944-28 2024-03-30T12:29:35.330 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 17488 (ObjNum 498 snap 156 seq_num 498) dirty exists 2024-03-30T12:29:35.330 INFO:tasks.rados.rados.0.smithi084.stdout:2012: finishing rollback tid 0 to smithi08477944-36 2024-03-30T12:29:35.331 INFO:tasks.rados.rados.0.smithi084.stdout:2012: finishing rollback tid 1 to smithi08477944-36 2024-03-30T12:29:35.331 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 947 (ObjNum 33 snap 0 seq_num 1429422320) dirty dne 2024-03-30T12:29:35.336 INFO:tasks.rados.rados.0.smithi084.stdout:2010: expect (ObjNum 395 snap 125 seq_num 395) 2024-03-30T12:29:35.464 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:35 smithi162 bash[99195]: 40ed6df811943a51095d3bdc149c040a773bf5fef5a35541bcd55d8bacabd790 2024-03-30T12:29:35.465 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:35 smithi162 systemd[1]: Started Ceph osd.6 for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:29:35.465 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.230+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.465 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.245+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.465 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.261+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.465 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.279+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.465 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.298+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.465 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.315+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.465 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.340+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.466 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.356+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.466 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.373+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.466 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.389+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.466 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.406+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.466 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.423+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.466 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.440+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.466 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.457+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.466 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-mon[83709]: osdmap e494: 8 total, 7 up, 8 in 2024-03-30T12:29:35.466 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:35.466 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:35.466 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:35.467 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:35.467 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:35.467 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-mon[83709]: pgmap v424: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 8 active+undersized+degraded, 34 active+undersized, 3 active+clean+snaptrim, 70 active+clean, 5 active+clean+snaptrim_error; 396 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 4.2 MiB/s rd, 3.1 MiB/s wr, 22 op/s; 67/795 objects degraded (8.428%) 2024-03-30T12:29:35.467 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:35.467 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:35.731 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:29:35.514+0000 7f5c0a4b17c0 -1 Falling back to public interface 2024-03-30T12:29:35.732 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.472+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.732 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.489+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.732 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.503+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.732 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.520+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.732 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.538+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.732 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.554+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.732 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.571+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.732 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.589+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.732 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.606+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.732 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.621+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.732 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.638+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.733 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.654+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.733 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.670+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.733 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.686+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.733 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.704+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.733 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.721+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:35.338+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:35.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-mon[91810]: osdmap e494: 8 total, 7 up, 8 in 2024-03-30T12:29:35.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:35.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:35.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:35.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:35.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:35.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-mon[91810]: pgmap v424: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 8 active+undersized+degraded, 34 active+undersized, 3 active+clean+snaptrim, 70 active+clean, 5 active+clean+snaptrim_error; 396 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 4.2 MiB/s rd, 3.1 MiB/s wr, 22 op/s; 67/795 objects degraded (8.428%) 2024-03-30T12:29:35.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:35.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:35.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:35.333+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:35.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:35.333+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:35.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:35.333+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:35.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:35.333+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:35.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:35.335+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:35.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:35.337+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:35.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:35.337+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:35.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-mon[89279]: osdmap e494: 8 total, 7 up, 8 in 2024-03-30T12:29:35.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:35.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:35.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:35.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:35.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:35.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-mon[89279]: pgmap v424: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 8 active+undersized+degraded, 34 active+undersized, 3 active+clean+snaptrim, 70 active+clean, 5 active+clean+snaptrim_error; 396 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 4.2 MiB/s rd, 3.1 MiB/s wr, 22 op/s; 67/795 objects degraded (8.428%) 2024-03-30T12:29:35.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:35.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:35 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:35.999 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.739+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.999 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.757+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.999 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.773+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:35.999 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.789+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.000 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.806+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.000 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.823+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.000 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.839+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.000 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.856+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.000 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.870+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.000 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.888+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.000 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.905+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.000 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.920+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.000 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.938+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.000 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.954+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.000 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.970+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.000 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:35.988+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.000 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.006+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.255 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.023+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.255 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.041+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.256 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.059+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.256 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.079+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.256 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.095+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.256 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.113+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.256 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.130+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.256 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.148+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.256 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.164+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.256 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.180+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.256 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.197+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.256 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.215+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.256 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.232+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.256 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.247+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.256 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.263+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.320 INFO:tasks.rados.rados.0.smithi084.stdout:2010: done (4 left) 2024-03-30T12:29:36.320 INFO:tasks.rados.rados.0.smithi084.stdout:2011: done (3 left) 2024-03-30T12:29:36.320 INFO:tasks.rados.rados.0.smithi084.stdout:2012: done (2 left) 2024-03-30T12:29:36.320 INFO:tasks.rados.rados.0.smithi084.stdout:2013: done (1 left) 2024-03-30T12:29:36.320 INFO:tasks.rados.rados.0.smithi084.stdout:2014: done (0 left) 2024-03-30T12:29:36.320 INFO:tasks.rados.rados.0.smithi084.stdout:2015: rollback oid 20 current snap is 218 2024-03-30T12:29:36.320 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 20 to 211 2024-03-30T12:29:36.320 INFO:tasks.rados.rados.0.smithi084.stdout:2016: copy_from oid 33 from oid 28 current snap is 218 2024-03-30T12:29:36.321 INFO:tasks.rados.rados.0.smithi084.stdout:2017: read oid 50 snap 207 2024-03-30T12:29:36.321 INFO:tasks.rados.rados.0.smithi084.stdout:2017: expect (ObjNum 585 snap 199 seq_num 585) 2024-03-30T12:29:36.321 INFO:tasks.rados.rados.0.smithi084.stdout:2018: delete oid 29 current snap is 218 2024-03-30T12:29:36.334 INFO:tasks.rados.rados.0.smithi084.stdout:2015: finishing rollback tid 0 to smithi08477944-20 2024-03-30T12:29:36.334 INFO:tasks.rados.rados.0.smithi084.stdout:2015: finishing rollback tid 1 to smithi08477944-20 2024-03-30T12:29:36.334 INFO:tasks.rados.rados.0.smithi084.stdout:2015: finishing rollback tid 2 to smithi08477944-20 2024-03-30T12:29:36.334 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 972 (ObjNum 565 snap 194 seq_num 565) dirty exists 2024-03-30T12:29:36.338 INFO:tasks.rados.rados.0.smithi084.stdout:2015: done (3 left) 2024-03-30T12:29:36.338 INFO:tasks.rados.rados.0.smithi084.stdout:2018: done (2 left) 2024-03-30T12:29:36.338 INFO:tasks.rados.rados.0.smithi084.stdout:2019: rmattr oid 23 current snap is 218 2024-03-30T12:29:36.338 INFO:tasks.rados.rados.0.smithi084.stdout:2020: delete oid 8 current snap is 218 2024-03-30T12:29:36.342 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 948 (ObjNum 395 snap 125 seq_num 395) dirty exists 2024-03-30T12:29:36.342 INFO:tasks.rados.rados.0.smithi084.stdout:2016: finishing copy_from racing read to smithi08477944-33 2024-03-30T12:29:36.347 INFO:tasks.rados.rados.0.smithi084.stdout:2017: expect (ObjNum 585 snap 199 seq_num 585) 2024-03-30T12:29:36.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-mon[83709]: osdmap e495: 8 total, 7 up, 8 in 2024-03-30T12:29:36.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:36.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:36.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:36.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:36.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:36.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:29:36.519 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.277+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.519 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.315+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.519 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.336+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.519 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.360+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.519 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.375+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.519 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.390+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.519 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.405+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.519 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.419+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.519 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.435+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.519 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.450+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.519 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.465+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.519 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.480+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.520 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.495+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.520 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.510+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.520 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.525+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.530 INFO:tasks.rados.rados.0.smithi084.stdout:2016: finishing copy_from to smithi08477944-33 2024-03-30T12:29:36.530 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 17488 (ObjNum 498 snap 156 seq_num 498) dirty exists 2024-03-30T12:29:36.530 INFO:tasks.rados.rados.0.smithi084.stdout:2016: done (3 left) 2024-03-30T12:29:36.530 INFO:tasks.rados.rados.0.smithi084.stdout:2017: done (2 left) 2024-03-30T12:29:36.530 INFO:tasks.rados.rados.0.smithi084.stdout:2019: done (1 left) 2024-03-30T12:29:36.530 INFO:tasks.rados.rados.0.smithi084.stdout:2020: done (0 left) 2024-03-30T12:29:36.530 INFO:tasks.rados.rados.0.smithi084.stdout:2021: copy_from oid 11 from oid 18 current snap is 218 2024-03-30T12:29:36.530 INFO:tasks.rados.rados.0.smithi084.stdout:2022: read oid 33 snap 209 2024-03-30T12:29:36.530 INFO:tasks.rados.rados.0.smithi084.stdout:2022: expect deleted 2024-03-30T12:29:36.530 INFO:tasks.rados.rados.0.smithi084.stdout:2023: read oid 43 snap -1 2024-03-30T12:29:36.530 INFO:tasks.rados.rados.0.smithi084.stdout:2023: expect (ObjNum 603 snap 215 seq_num 603) 2024-03-30T12:29:36.530 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 218 2024-03-30T12:29:36.531 INFO:tasks.rados.rados.0.smithi084.stdout:2024: seq_num 614 ranges {622592=688128} 2024-03-30T12:29:36.538 INFO:tasks.rados.rados.0.smithi084.stdout:2024: writing smithi08477944-48 from 622592 to 1310720 tid 1 2024-03-30T12:29:36.538 INFO:tasks.rados.rados.0.smithi084.stdout:2025: delete oid 16 current snap is 218 2024-03-30T12:29:36.541 INFO:tasks.rados.rados.0.smithi084.stdout:2021: finishing copy_from racing read to smithi08477944-11 2024-03-30T12:29:36.546 INFO:tasks.rados.rados.0.smithi084.stdout:2024: finishing write tid 1 to smithi08477944-48 2024-03-30T12:29:36.546 INFO:tasks.rados.rados.0.smithi084.stdout:2021: finishing copy_from to smithi08477944-11 2024-03-30T12:29:36.546 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 946 (ObjNum 558 snap 191 seq_num 558) dirty exists 2024-03-30T12:29:36.546 INFO:tasks.rados.rados.0.smithi084.stdout:2024: finishing write tid 2 to smithi08477944-48 2024-03-30T12:29:36.546 INFO:tasks.rados.rados.0.smithi084.stdout:2021: done (4 left) 2024-03-30T12:29:36.546 INFO:tasks.rados.rados.0.smithi084.stdout:2022: done (3 left) 2024-03-30T12:29:36.547 INFO:tasks.rados.rados.0.smithi084.stdout:2025: done (2 left) 2024-03-30T12:29:36.547 INFO:tasks.rados.rados.0.smithi084.stdout:2026: delete oid 14 current snap is 218 2024-03-30T12:29:36.547 INFO:tasks.rados.rados.0.smithi084.stdout:2023: expect (ObjNum 603 snap 215 seq_num 603) 2024-03-30T12:29:36.564 INFO:tasks.rados.rados.0.smithi084.stdout:2024: finishing write tid 3 to smithi08477944-48 2024-03-30T12:29:36.564 INFO:tasks.rados.rados.0.smithi084.stdout:2024: oid 48 updating version 0 to 906 2024-03-30T12:29:36.564 INFO:tasks.rados.rados.0.smithi084.stdout:2024: oid 48 version 906 is already newer than 905 2024-03-30T12:29:36.564 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 906 (ObjNum 614 snap 218 seq_num 614) dirty exists 2024-03-30T12:29:36.564 INFO:tasks.rados.rados.0.smithi084.stdout:2024: left oid 48 (ObjNum 614 snap 218 seq_num 614) 2024-03-30T12:29:36.564 INFO:tasks.rados.rados.0.smithi084.stdout:2023: done (2 left) 2024-03-30T12:29:36.564 INFO:tasks.rados.rados.0.smithi084.stdout:2024: done (1 left) 2024-03-30T12:29:36.564 INFO:tasks.rados.rados.0.smithi084.stdout:2026: done (0 left) 2024-03-30T12:29:36.565 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 218 2024-03-30T12:29:36.565 INFO:tasks.rados.rados.0.smithi084.stdout:2027: seq_num 617 ranges {0=737280} 2024-03-30T12:29:36.569 INFO:tasks.rados.rados.0.smithi084.stdout:2027: writing smithi08477944-8 from 0 to 737280 tid 1 2024-03-30T12:29:36.569 INFO:tasks.rados.rados.0.smithi084.stdout:2028: setattr oid 49 current snap is 218 2024-03-30T12:29:36.570 INFO:tasks.rados.rados.0.smithi084.stdout:2029: snap_remove snap 210 2024-03-30T12:29:36.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:36.334+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:36.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:36 smithi084 ceph-mon[89279]: osdmap e495: 8 total, 7 up, 8 in 2024-03-30T12:29:36.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:36.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:36.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:36.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:36.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:36.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:36 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:29:36.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:36 smithi084 ceph-mon[91810]: osdmap e495: 8 total, 7 up, 8 in 2024-03-30T12:29:36.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:36.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:36.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:36.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:36.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:36.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:36 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:29:36.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:36.334+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:36.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:36.337+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:36.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:36.338+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:36.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:36.339+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:36.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.540+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.560+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.575+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.590+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.607+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.622+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.636+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.766+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:36.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.781+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.039 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.797+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.039 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.810+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.039 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.824+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.040 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.839+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.040 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.854+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.040 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.871+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.040 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.885+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.040 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.901+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.040 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.915+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.040 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.929+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.040 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.944+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.040 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.959+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.040 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.974+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.299 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:36.989+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.299 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.040+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.299 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.056+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.299 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.070+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.299 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.083+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.300 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.097+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.300 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.112+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.300 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.129+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.300 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.145+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.300 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.159+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.300 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.173+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.300 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.188+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.300 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.203+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.300 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.218+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.300 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.236+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.300 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.251+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.337 INFO:tasks.rados.rados.0.smithi084.stdout:2029: done (2 left) 2024-03-30T12:29:37.337 INFO:tasks.rados.rados.0.smithi084.stdout:2030: delete oid 41 current snap is 218 2024-03-30T12:29:37.337 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 949 (ObjNum 457 snap 143 seq_num 457) dirty exists 2024-03-30T12:29:37.337 INFO:tasks.rados.rados.0.smithi084.stdout:2027: finishing write tid 1 to smithi08477944-8 2024-03-30T12:29:37.337 INFO:tasks.rados.rados.0.smithi084.stdout:2027: finishing write tid 2 to smithi08477944-8 2024-03-30T12:29:37.337 INFO:tasks.rados.rados.0.smithi084.stdout:2027: finishing write tid 3 to smithi08477944-8 2024-03-30T12:29:37.337 INFO:tasks.rados.rados.0.smithi084.stdout:2027: oid 8 updating version 0 to 13444 2024-03-30T12:29:37.337 INFO:tasks.rados.rados.0.smithi084.stdout:2027: oid 8 version 13444 is already newer than 13443 2024-03-30T12:29:37.337 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 13444 (ObjNum 617 snap 218 seq_num 617) dirty exists 2024-03-30T12:29:37.337 INFO:tasks.rados.rados.0.smithi084.stdout:2027: left oid 8 (ObjNum 617 snap 218 seq_num 617) 2024-03-30T12:29:37.342 INFO:tasks.rados.rados.0.smithi084.stdout:2027: done (2 left) 2024-03-30T12:29:37.342 INFO:tasks.rados.rados.0.smithi084.stdout:2028: done (1 left) 2024-03-30T12:29:37.342 INFO:tasks.rados.rados.0.smithi084.stdout:2030: done (0 left) 2024-03-30T12:29:37.342 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 218 2024-03-30T12:29:37.342 INFO:tasks.rados.rados.0.smithi084.stdout:2031: seq_num 619 ranges {589824=770048} 2024-03-30T12:29:37.351 INFO:tasks.rados.rados.0.smithi084.stdout:2031: writing smithi08477944-21 from 589824 to 1359872 tid 1 2024-03-30T12:29:37.351 INFO:tasks.rados.rados.0.smithi084.stdout:2032: rollback oid 24 current snap is 218 2024-03-30T12:29:37.351 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 24 to 209 2024-03-30T12:29:37.351 INFO:tasks.rados.rados.0.smithi084.stdout:2033: copy_from oid 44 from oid 15 current snap is 218 2024-03-30T12:29:37.351 INFO:tasks.rados.rados.0.smithi084.stdout:2034: rmattr oid 11 current snap is 218 2024-03-30T12:29:37.351 INFO:tasks.rados.rados.0.smithi084.stdout:2035: rmattr oid 16 current snap is 218 2024-03-30T12:29:37.351 INFO:tasks.rados.rados.0.smithi084.stdout:2035: done (4 left) 2024-03-30T12:29:37.351 INFO:tasks.rados.rados.0.smithi084.stdout:2036: delete oid 47 current snap is 218 2024-03-30T12:29:37.353 INFO:tasks.rados.rados.0.smithi084.stdout:2036: done (4 left) 2024-03-30T12:29:37.353 INFO:tasks.rados.rados.0.smithi084.stdout:2037: read oid 32 snap -1 2024-03-30T12:29:37.353 INFO:tasks.rados.rados.0.smithi084.stdout:2037: expect (ObjNum 280 snap 90 seq_num 280) 2024-03-30T12:29:37.353 INFO:tasks.rados.rados.0.smithi084.stdout:2038: read oid 18 snap -1 2024-03-30T12:29:37.353 INFO:tasks.rados.rados.0.smithi084.stdout:2038: expect (ObjNum 558 snap 191 seq_num 558) 2024-03-30T12:29:37.354 INFO:tasks.rados.rados.0.smithi084.stdout:2039: delete oid 50 current snap is 218 2024-03-30T12:29:37.354 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 947 (ObjNum 558 snap 191 seq_num 558) dirty exists 2024-03-30T12:29:37.362 INFO:tasks.rados.rados.0.smithi084.stdout:2034: done (6 left) 2024-03-30T12:29:37.362 INFO:tasks.rados.rados.0.smithi084.stdout:2039: done (5 left) 2024-03-30T12:29:37.362 INFO:tasks.rados.rados.0.smithi084.stdout:2040: snap_create 2024-03-30T12:29:37.364 INFO:tasks.rados.rados.0.smithi084.stdout:2038: expect (ObjNum 558 snap 191 seq_num 558) 2024-03-30T12:29:37.441 INFO:tasks.rados.rados.0.smithi084.stdout:2032: finishing rollback tid 0 to smithi08477944-24 2024-03-30T12:29:37.441 INFO:tasks.rados.rados.0.smithi084.stdout:2032: finishing rollback tid 1 to smithi08477944-24 2024-03-30T12:29:37.441 INFO:tasks.rados.rados.0.smithi084.stdout:2032: finishing rollback tid 2 to smithi08477944-24 2024-03-30T12:29:37.441 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 5505 (ObjNum 455 snap 142 seq_num 455) dirty exists 2024-03-30T12:29:37.441 INFO:tasks.rados.rados.0.smithi084.stdout:2033: finishing copy_from to smithi08477944-44 2024-03-30T12:29:37.441 INFO:tasks.rados.rados.0.smithi084.stdout:2033: got expected ENOENT (src dne) 2024-03-30T12:29:37.441 INFO:tasks.rados.rados.0.smithi084.stdout:2033: finishing copy_from racing read to smithi08477944-44 2024-03-30T12:29:37.441 INFO:tasks.rados.rados.0.smithi084.stdout:2031: finishing write tid 1 to smithi08477944-21 2024-03-30T12:29:37.441 INFO:tasks.rados.rados.0.smithi084.stdout:2031: finishing write tid 2 to smithi08477944-21 2024-03-30T12:29:37.442 INFO:tasks.rados.rados.0.smithi084.stdout:2037: expect (ObjNum 280 snap 90 seq_num 280) 2024-03-30T12:29:37.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-mon[83709]: osdmap e496: 8 total, 7 up, 8 in 2024-03-30T12:29:37.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:37.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:37.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:37.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:37.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:37.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-mon[83709]: pgmap v427: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 8 active+undersized+degraded, 34 active+undersized, 3 active+clean+snaptrim, 70 active+clean, 5 active+clean+snaptrim_error; 397 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1004 KiB/s rd, 1.2 MiB/s wr, 12 op/s; 68/804 objects degraded (8.458%) 2024-03-30T12:29:37.554 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.265+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.555 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.322+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.555 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.337+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.555 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.363+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.555 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.384+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.555 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.394+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.555 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.411+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.555 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.428+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.555 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.444+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.555 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.459+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.555 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.474+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.555 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.489+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.556 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.503+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.556 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.517+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.556 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.532+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.556 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.547+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.556 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.561+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.717 INFO:tasks.rados.rados.0.smithi084.stdout:2031: finishing write tid 3 to smithi08477944-21 2024-03-30T12:29:37.717 INFO:tasks.rados.rados.0.smithi084.stdout:2031: oid 21 updating version 0 to 14046 2024-03-30T12:29:37.717 INFO:tasks.rados.rados.0.smithi084.stdout:2031: oid 21 updating version 14046 to 14047 2024-03-30T12:29:37.717 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 14047 (ObjNum 619 snap 218 seq_num 619) dirty exists 2024-03-30T12:29:37.717 INFO:tasks.rados.rados.0.smithi084.stdout:2031: left oid 21 (ObjNum 619 snap 218 seq_num 619) 2024-03-30T12:29:37.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:37.353+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:37.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:37 smithi084 ceph-mon[91810]: osdmap e496: 8 total, 7 up, 8 in 2024-03-30T12:29:37.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:37.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:37.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:37.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:37.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:37.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:37 smithi084 ceph-mon[91810]: pgmap v427: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 8 active+undersized+degraded, 34 active+undersized, 3 active+clean+snaptrim, 70 active+clean, 5 active+clean+snaptrim_error; 397 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1004 KiB/s rd, 1.2 MiB/s wr, 12 op/s; 68/804 objects degraded (8.458%) 2024-03-30T12:29:37.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:37.341+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:37.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:37.341+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:37.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:37.341+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:37.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:37.341+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:37.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:37.342+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:37.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:37.342+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:37.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:37.342+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:37.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:37 smithi084 ceph-mon[89279]: osdmap e496: 8 total, 7 up, 8 in 2024-03-30T12:29:37.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:37.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:37.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:37.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:37.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:37.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:37 smithi084 ceph-mon[89279]: pgmap v427: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 8 active+undersized+degraded, 34 active+undersized, 3 active+clean+snaptrim, 70 active+clean, 5 active+clean+snaptrim_error; 397 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1004 KiB/s rd, 1.2 MiB/s wr, 12 op/s; 68/804 objects degraded (8.458%) 2024-03-30T12:29:37.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.576+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.605+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.619+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.705+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.720+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.735+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.751+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.766+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.781+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.795+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:37.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.811+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.175 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.826+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.175 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.920+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.175 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.937+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.176 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.952+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.176 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.967+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.176 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:37.984+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.176 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.000+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.176 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.015+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.176 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.033+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.176 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.051+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.176 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.068+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.176 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.083+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.176 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.101+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.176 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.117+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.176 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.133+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.176 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.148+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.176 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.165+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.177 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.182+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.345 INFO:tasks.rados.rados.0.smithi084.stdout:2031: done (5 left) 2024-03-30T12:29:38.345 INFO:tasks.rados.rados.0.smithi084.stdout:2032: done (4 left) 2024-03-30T12:29:38.345 INFO:tasks.rados.rados.0.smithi084.stdout:2033: done (3 left) 2024-03-30T12:29:38.345 INFO:tasks.rados.rados.0.smithi084.stdout:2037: done (2 left) 2024-03-30T12:29:38.345 INFO:tasks.rados.rados.0.smithi084.stdout:2038: done (1 left) 2024-03-30T12:29:38.345 INFO:tasks.rados.rados.0.smithi084.stdout:2040: done (0 left) 2024-03-30T12:29:38.345 INFO:tasks.rados.rados.0.smithi084.stdout:2041: rollback oid 30 current snap is 219 2024-03-30T12:29:38.345 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 30 to 192 2024-03-30T12:29:38.345 INFO:tasks.rados.rados.0.smithi084.stdout:2042: rollback oid 21 current snap is 219 2024-03-30T12:29:38.345 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 21 to 209 2024-03-30T12:29:38.345 INFO:tasks.rados.rados.0.smithi084.stdout:2043: delete oid 10 current snap is 219 2024-03-30T12:29:38.347 INFO:tasks.rados.rados.0.smithi084.stdout:2043: done (2 left) 2024-03-30T12:29:38.347 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 219 2024-03-30T12:29:38.347 INFO:tasks.rados.rados.0.smithi084.stdout:2044: seq_num 623 ranges {1310720=442368,1753088=401408} 2024-03-30T12:29:38.357 INFO:tasks.rados.rados.0.smithi084.stdout:2044: writing smithi08477944-48 from 1310720 to 1753088 tid 1 2024-03-30T12:29:38.360 INFO:tasks.rados.rados.0.smithi084.stdout:2044: writing smithi08477944-48 from 1753088 to 2154496 tid 2 2024-03-30T12:29:38.360 INFO:tasks.rados.rados.0.smithi084.stdout:2045: snap_create 2024-03-30T12:29:38.360 INFO:tasks.rados.rados.0.smithi084.stdout:2041: finishing rollback tid 1 to smithi08477944-30 2024-03-30T12:29:38.360 INFO:tasks.rados.rados.0.smithi084.stdout:2041: finishing rollback tid 2 to smithi08477944-30 2024-03-30T12:29:38.360 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 1014 (ObjNum 536 snap 183 seq_num 536) dirty exists 2024-03-30T12:29:38.361 INFO:tasks.rados.rados.0.smithi084.stdout:2042: finishing rollback tid 0 to smithi08477944-21 2024-03-30T12:29:38.361 INFO:tasks.rados.rados.0.smithi084.stdout:2042: finishing rollback tid 1 to smithi08477944-21 2024-03-30T12:29:38.361 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 14252 (ObjNum 161 snap 0 seq_num 1428975680) dirty dne 2024-03-30T12:29:38.362 INFO:tasks.rados.rados.0.smithi084.stdout:2044: finishing write tid 1 to smithi08477944-48 2024-03-30T12:29:38.363 INFO:tasks.rados.rados.0.smithi084.stdout:2044: finishing write tid 2 to smithi08477944-48 2024-03-30T12:29:38.363 INFO:tasks.rados.rados.0.smithi084.stdout:2044: finishing write tid 3 to smithi08477944-48 2024-03-30T12:29:38.365 INFO:tasks.rados.rados.0.smithi084.stdout:2044: finishing write tid 4 to smithi08477944-48 2024-03-30T12:29:38.365 INFO:tasks.rados.rados.0.smithi084.stdout:2044: oid 48 updating version 0 to 909 2024-03-30T12:29:38.365 INFO:tasks.rados.rados.0.smithi084.stdout:2044: oid 48 version 909 is already newer than 907 2024-03-30T12:29:38.365 INFO:tasks.rados.rados.0.smithi084.stdout:2044: oid 48 version 909 is already newer than 908 2024-03-30T12:29:38.365 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 909 (ObjNum 623 snap 219 seq_num 623) dirty exists 2024-03-30T12:29:38.365 INFO:tasks.rados.rados.0.smithi084.stdout:2044: left oid 48 (ObjNum 623 snap 219 seq_num 623) 2024-03-30T12:29:38.440 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-mon[83709]: Health check update: Degraded data redundancy: 68/804 objects degraded (8.458%), 9 pgs degraded (PG_DEGRADED) 2024-03-30T12:29:38.440 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:38.440 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:38.440 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:38.440 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:38.440 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-mon[83709]: osdmap e497: 8 total, 7 up, 8 in 2024-03-30T12:29:38.440 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:38.441 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.199+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.441 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.215+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.441 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.231+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.441 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.248+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.441 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.263+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.441 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.278+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.441 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.294+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.441 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.312+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.441 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.334+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.441 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.365+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.441 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.399+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.441 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.413+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.441 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.431+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.442 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.448+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.691 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.465+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.691 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.483+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.691 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.500+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.516+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.535+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.551+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.568+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.588+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.605+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.623+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.641+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.660+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.679+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.699+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:38.353+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:38.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:38 smithi084 ceph-mon[91810]: Health check update: Degraded data redundancy: 68/804 objects degraded (8.458%), 9 pgs degraded (PG_DEGRADED) 2024-03-30T12:29:38.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:38.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:38.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:38.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:38.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:38 smithi084 ceph-mon[91810]: osdmap e497: 8 total, 7 up, 8 in 2024-03-30T12:29:38.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:38.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:38.354+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:38.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:38.354+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:38.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:38.355+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:38.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:38.357+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:38.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:38 smithi084 ceph-mon[89279]: Health check update: Degraded data redundancy: 68/804 objects degraded (8.458%), 9 pgs degraded (PG_DEGRADED) 2024-03-30T12:29:38.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:38.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:38.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:38.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:38.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:38 smithi084 ceph-mon[89279]: osdmap e497: 8 total, 7 up, 8 in 2024-03-30T12:29:38.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:38.943 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:29:38.864+0000 7f5c0a4b17c0 -1 osd.6 487 log_to_monitors true 2024-03-30T12:29:38.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.721+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.742+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.762+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.783+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.802+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.821+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.847+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.864+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.880+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.897+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.938+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:38.944 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.952+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.206 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:38.995+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.206 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.009+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.206 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.023+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.206 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.038+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.206 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.052+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.206 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.067+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.207 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.081+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.207 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.095+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.207 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.109+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.207 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.123+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.207 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.138+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.207 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.153+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.207 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.167+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.207 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.183+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.207 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.199+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.349 INFO:tasks.rados.rados.0.smithi084.stdout:2041: done (3 left) 2024-03-30T12:29:39.349 INFO:tasks.rados.rados.0.smithi084.stdout:2042: done (2 left) 2024-03-30T12:29:39.350 INFO:tasks.rados.rados.0.smithi084.stdout:2044: done (1 left) 2024-03-30T12:29:39.350 INFO:tasks.rados.rados.0.smithi084.stdout:2045: done (0 left) 2024-03-30T12:29:39.350 INFO:tasks.rados.rados.0.smithi084.stdout:2046: rmattr oid 36 current snap is 220 2024-03-30T12:29:39.350 INFO:tasks.rados.rados.0.smithi084.stdout:2046: done (0 left) 2024-03-30T12:29:39.350 INFO:tasks.rados.rados.0.smithi084.stdout:2047: delete oid 24 current snap is 220 2024-03-30T12:29:39.369 INFO:tasks.rados.rados.0.smithi084.stdout:2047: done (0 left) 2024-03-30T12:29:39.369 INFO:tasks.rados.rados.0.smithi084.stdout:2048: read oid 46 snap -1 2024-03-30T12:29:39.369 INFO:tasks.rados.rados.0.smithi084.stdout:2048: expect (ObjNum 565 snap 194 seq_num 565) 2024-03-30T12:29:39.369 INFO:tasks.rados.rados.0.smithi084.stdout:2049: rmattr oid 48 current snap is 220 2024-03-30T12:29:39.369 INFO:tasks.rados.rados.0.smithi084.stdout:2050: snap_create 2024-03-30T12:29:39.420 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 910 (ObjNum 623 snap 219 seq_num 623) dirty exists 2024-03-30T12:29:39.457 INFO:tasks.rados.rados.0.smithi084.stdout:2048: expect (ObjNum 565 snap 194 seq_num 565) 2024-03-30T12:29:39.489 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.214+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.489 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.229+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.489 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.245+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.489 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.259+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.489 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.274+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.489 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.289+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.489 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.305+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.489 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.319+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.490 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.333+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.490 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.349+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.490 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.370+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.490 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-mon[83709]: osdmap e498: 8 total, 7 up, 8 in 2024-03-30T12:29:39.490 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:39.490 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:39.490 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:39.490 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:39.490 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:39.490 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-mon[83709]: pgmap v430: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 8 active+undersized+degraded, 34 active+undersized, 3 active+clean+snaptrim, 70 active+clean, 5 active+clean+snaptrim_error; 408 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 5.8 MiB/s rd, 900 KiB/s wr, 11 op/s; 68/831 objects degraded (8.183%) 2024-03-30T12:29:39.491 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-mon[83709]: from='osd.6 [v2:172.21.15.162:6816/1765787761,v1:172.21.15.162:6817/1765787761]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T12:29:39.491 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-mon[83709]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T12:29:39.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:29:39] "GET /metrics HTTP/1.1" 200 36254 "" "Prometheus/2.43.0" 2024-03-30T12:29:39.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:39.355+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:39.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-mon[89279]: osdmap e498: 8 total, 7 up, 8 in 2024-03-30T12:29:39.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:39.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:39.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:39.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:39.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:39.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-mon[89279]: pgmap v430: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 8 active+undersized+degraded, 34 active+undersized, 3 active+clean+snaptrim, 70 active+clean, 5 active+clean+snaptrim_error; 408 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 5.8 MiB/s rd, 900 KiB/s wr, 11 op/s; 68/831 objects degraded (8.183%) 2024-03-30T12:29:39.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-mon[89279]: from='osd.6 [v2:172.21.15.162:6816/1765787761,v1:172.21.15.162:6817/1765787761]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T12:29:39.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-mon[89279]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T12:29:39.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:39.352+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:39.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:39.352+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:39.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:39.356+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:39.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:39.356+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:39.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:39.356+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:39.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:39.356+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:39.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:39.356+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:39.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-mon[91810]: osdmap e498: 8 total, 7 up, 8 in 2024-03-30T12:29:39.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:39.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:39.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:39.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:39.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:39.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-mon[91810]: pgmap v430: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 8 active+undersized+degraded, 34 active+undersized, 3 active+clean+snaptrim, 70 active+clean, 5 active+clean+snaptrim_error; 408 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 5.8 MiB/s rd, 900 KiB/s wr, 11 op/s; 68/831 objects degraded (8.183%) 2024-03-30T12:29:39.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-mon[91810]: from='osd.6 [v2:172.21.15.162:6816/1765787761,v1:172.21.15.162:6817/1765787761]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T12:29:39.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:39 smithi084 ceph-mon[91810]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T12:29:39.758 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.497+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:39.758 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.653+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.022 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:29:39.880+0000 7f5bf7901700 -1 osd.6 487 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T12:29:40.022 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.766+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.022 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.801+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.022 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.821+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.023 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.842+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.023 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.860+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.023 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.878+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.023 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.894+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.023 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.909+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.023 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.924+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.023 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.940+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.023 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.955+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.023 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.971+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.023 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:39.986+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.023 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.000+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.023 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.015+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.023 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.029+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.283 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.044+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.283 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.058+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.283 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.072+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.283 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.090+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.283 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.105+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.283 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.122+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.283 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.137+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.283 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.154+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.284 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.170+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.284 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.191+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.284 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.208+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.284 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.223+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.284 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.240+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.284 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.258+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.284 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.276+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.284 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.290+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.360 INFO:tasks.rados.rados.0.smithi084.stdout:2048: done (2 left) 2024-03-30T12:29:40.360 INFO:tasks.rados.rados.0.smithi084.stdout:2049: done (1 left) 2024-03-30T12:29:40.360 INFO:tasks.rados.rados.0.smithi084.stdout:2050: done (0 left) 2024-03-30T12:29:40.360 INFO:tasks.rados.rados.0.smithi084.stdout:2051: snap_create 2024-03-30T12:29:40.545 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-mon[83709]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-30T12:29:40.545 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:40.545 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-mon[83709]: osdmap e499: 8 total, 7 up, 8 in 2024-03-30T12:29:40.545 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:40.545 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:40.545 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:40.545 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:40.545 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-mon[83709]: from='osd.6 [v2:172.21.15.162:6816/1765787761,v1:172.21.15.162:6817/1765787761]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:29:40.545 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-mon[83709]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:29:40.546 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-mon[83709]: from='osd.6 ' entity='osd.6' 2024-03-30T12:29:40.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.307+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.322+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.337+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.352+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.386+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.406+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.424+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.441+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.457+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.473+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.547 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.489+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.547 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.506+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.547 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.522+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.547 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.538+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.547 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.553+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:40.375+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:40.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:40 smithi084 ceph-mon[91810]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-30T12:29:40.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:40.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:40 smithi084 ceph-mon[91810]: osdmap e499: 8 total, 7 up, 8 in 2024-03-30T12:29:40.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:40.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:40.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:40.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:40.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:40 smithi084 ceph-mon[91810]: from='osd.6 [v2:172.21.15.162:6816/1765787761,v1:172.21.15.162:6817/1765787761]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:29:40.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:40 smithi084 ceph-mon[91810]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:29:40.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:40 smithi084 ceph-mon[91810]: from='osd.6 ' entity='osd.6' 2024-03-30T12:29:40.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:40.374+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:40.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:40.377+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:40.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:40.377+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:40.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:40.379+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:40 smithi084 ceph-mon[89279]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-30T12:29:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:40 smithi084 ceph-mon[89279]: osdmap e499: 8 total, 7 up, 8 in 2024-03-30T12:29:40.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:40.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:40.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:40.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:40.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:40 smithi084 ceph-mon[89279]: from='osd.6 [v2:172.21.15.162:6816/1765787761,v1:172.21.15.162:6817/1765787761]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:29:40.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:40 smithi084 ceph-mon[89279]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:29:40.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:40 smithi084 ceph-mon[89279]: from='osd.6 ' entity='osd.6' 2024-03-30T12:29:40.802 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.568+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.803 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.583+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.803 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.597+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.803 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.611+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.803 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.625+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.803 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.640+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.803 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.654+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.803 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.671+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.803 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.688+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.803 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.706+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.803 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.723+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.803 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.739+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.803 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.757+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.803 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.775+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.804 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.792+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:40.804 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.810+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.067 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.825+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.067 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.843+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.067 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.859+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.068 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.880+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.068 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.896+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.068 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.911+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.068 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.925+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.068 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.939+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.068 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.955+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.068 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.969+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.068 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.985+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.068 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:40.999+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.068 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.014+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.068 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.029+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.068 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.045+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.068 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.059+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.068 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.075+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.317 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.090+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.318 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.105+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.318 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.119+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.318 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.135+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.318 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.150+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.318 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.166+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.318 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.180+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.318 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.195+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.318 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.209+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.318 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.227+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.318 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.244+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.318 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.262+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.319 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.279+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.319 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.295+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.319 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.310+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.319 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.325+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.363 INFO:tasks.rados.rados.0.smithi084.stdout:2051: done (0 left) 2024-03-30T12:29:41.363 INFO:tasks.rados.rados.0.smithi084.stdout:2052: delete oid 28 current snap is 222 2024-03-30T12:29:41.369 INFO:tasks.rados.rados.0.smithi084.stdout:2052: done (0 left) 2024-03-30T12:29:41.369 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 222 2024-03-30T12:29:41.369 INFO:tasks.rados.rados.0.smithi084.stdout:2053: seq_num 626 ranges {737280=491520,1228800=401408} 2024-03-30T12:29:41.376 INFO:tasks.rados.rados.0.smithi084.stdout:2053: writing smithi08477944-39 from 737280 to 1228800 tid 1 2024-03-30T12:29:41.379 INFO:tasks.rados.rados.0.smithi084.stdout:2053: writing smithi08477944-39 from 1228800 to 1630208 tid 2 2024-03-30T12:29:41.379 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 222 2024-03-30T12:29:41.379 INFO:tasks.rados.rados.0.smithi084.stdout:2054: seq_num 627 ranges {172032=507904,679936=401408} 2024-03-30T12:29:41.383 INFO:tasks.rados.rados.0.smithi084.stdout:2054: writing smithi08477944-13 from 172032 to 679936 tid 1 2024-03-30T12:29:41.385 INFO:tasks.rados.rados.0.smithi084.stdout:2054: writing smithi08477944-13 from 679936 to 1081344 tid 2 2024-03-30T12:29:41.385 INFO:tasks.rados.rados.0.smithi084.stdout:2055: snap_remove snap 192 2024-03-30T12:29:41.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-mon[83709]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T12:29:41.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-mon[83709]: osd.6 [v2:172.21.15.162:6816/1765787761,v1:172.21.15.162:6817/1765787761] boot 2024-03-30T12:29:41.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-mon[83709]: osdmap e500: 8 total, 8 up, 8 in 2024-03-30T12:29:41.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:29:41.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:41.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:41.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:41.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:41.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:41.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-mon[83709]: pgmap v433: 121 pgs: 7 peering, 1 active+undersized+degraded+snaptrim_error, 5 active+undersized+degraded, 30 active+undersized, 3 active+clean+snaptrim, 70 active+clean, 5 active+clean+snaptrim_error; 410 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 12 MiB/s rd, 1.4 MiB/s wr, 13 op/s; 59/843 objects degraded (6.999%) 2024-03-30T12:29:41.572 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.341+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.358+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.388+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.417+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.437+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.455+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.471+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.486+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.502+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.518+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.533+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.549+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.565+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.579+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:41.379+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:41.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:41.472+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:41.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-mon[91810]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T12:29:41.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-mon[91810]: osd.6 [v2:172.21.15.162:6816/1765787761,v1:172.21.15.162:6817/1765787761] boot 2024-03-30T12:29:41.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-mon[91810]: osdmap e500: 8 total, 8 up, 8 in 2024-03-30T12:29:41.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:29:41.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:41.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:41.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:41.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:41.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:41.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-mon[91810]: pgmap v433: 121 pgs: 7 peering, 1 active+undersized+degraded+snaptrim_error, 5 active+undersized+degraded, 30 active+undersized, 3 active+clean+snaptrim, 70 active+clean, 5 active+clean+snaptrim_error; 410 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 12 MiB/s rd, 1.4 MiB/s wr, 13 op/s; 59/843 objects degraded (6.999%) 2024-03-30T12:29:41.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-mon[89279]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T12:29:41.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-mon[89279]: osd.6 [v2:172.21.15.162:6816/1765787761,v1:172.21.15.162:6817/1765787761] boot 2024-03-30T12:29:41.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-mon[89279]: osdmap e500: 8 total, 8 up, 8 in 2024-03-30T12:29:41.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T12:29:41.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:41.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:41.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:41.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:41.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:41.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-mon[89279]: pgmap v433: 121 pgs: 7 peering, 1 active+undersized+degraded+snaptrim_error, 5 active+undersized+degraded, 30 active+undersized, 3 active+clean+snaptrim, 70 active+clean, 5 active+clean+snaptrim_error; 410 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 12 MiB/s rd, 1.4 MiB/s wr, 13 op/s; 59/843 objects degraded (6.999%) 2024-03-30T12:29:41.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:41.368+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:41.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:41.368+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:41.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:41.369+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:41.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:41.369+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:41.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:41.370+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:41.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:41.370+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:41.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:41.370+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:41.831 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:41.687+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:41.831 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:41.718+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:41.831 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:41.749+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:41.831 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:41.785+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:41.831 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:41.812+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:41.831 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.596+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.831 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.611+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.831 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.625+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.832 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.640+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.832 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.655+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.832 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.670+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.832 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.686+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.832 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.706+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.832 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.725+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.832 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.745+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.832 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.763+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.832 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.781+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.832 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.798+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.832 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.820+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:41.832 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.839+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.085 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:41.848+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.086 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:41.881+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.086 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:41.915+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.086 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:41.940+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.086 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:41.963+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.086 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:41.991+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.086 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.021+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.086 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.051+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.086 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.083+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.086 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.855+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.086 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.871+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.888+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.903+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.918+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.933+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.950+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.970+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:41.987+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.003+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.020+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.037+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.054+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.073+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.087 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.092+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.341 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.112+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.341 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.130+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.341 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.147+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.341 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.164+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.342 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.183+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.342 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.202+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.342 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.220+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.342 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.238+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.342 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.253+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.342 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.275+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.342 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.294+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.342 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.315+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.342 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.335+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.342 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.115+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.342 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.152+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.343 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.187+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.343 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.218+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.343 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.252+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.343 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.284+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.343 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.328+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.377 INFO:tasks.rados.rados.0.smithi084.stdout:2053: finishing write tid 1 to smithi08477944-39 2024-03-30T12:29:42.377 INFO:tasks.rados.rados.0.smithi084.stdout:2053: finishing write tid 2 to smithi08477944-39 2024-03-30T12:29:42.377 INFO:tasks.rados.rados.0.smithi084.stdout:2053: finishing write tid 3 to smithi08477944-39 2024-03-30T12:29:42.378 INFO:tasks.rados.rados.0.smithi084.stdout:2053: finishing write tid 4 to smithi08477944-39 2024-03-30T12:29:42.378 INFO:tasks.rados.rados.0.smithi084.stdout:2053: oid 39 updating version 0 to 949 2024-03-30T12:29:42.378 INFO:tasks.rados.rados.0.smithi084.stdout:2053: oid 39 updating version 949 to 950 2024-03-30T12:29:42.378 INFO:tasks.rados.rados.0.smithi084.stdout:2053: oid 39 updating version 950 to 951 2024-03-30T12:29:42.378 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 951 (ObjNum 626 snap 222 seq_num 626) dirty exists 2024-03-30T12:29:42.378 INFO:tasks.rados.rados.0.smithi084.stdout:2053: left oid 39 (ObjNum 626 snap 222 seq_num 626) 2024-03-30T12:29:42.378 INFO:tasks.rados.rados.0.smithi084.stdout:2054: finishing write tid 1 to smithi08477944-13 2024-03-30T12:29:42.378 INFO:tasks.rados.rados.0.smithi084.stdout:2054: finishing write tid 2 to smithi08477944-13 2024-03-30T12:29:42.378 INFO:tasks.rados.rados.0.smithi084.stdout:2054: finishing write tid 3 to smithi08477944-13 2024-03-30T12:29:42.378 INFO:tasks.rados.rados.0.smithi084.stdout:2054: finishing write tid 4 to smithi08477944-13 2024-03-30T12:29:42.378 INFO:tasks.rados.rados.0.smithi084.stdout:2054: oid 13 updating version 0 to 5510 2024-03-30T12:29:42.378 INFO:tasks.rados.rados.0.smithi084.stdout:2054: oid 13 updating version 5510 to 5511 2024-03-30T12:29:42.378 INFO:tasks.rados.rados.0.smithi084.stdout:2054: oid 13 version 5511 is already newer than 5509 2024-03-30T12:29:42.378 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 5511 (ObjNum 627 snap 222 seq_num 627) dirty exists 2024-03-30T12:29:42.379 INFO:tasks.rados.rados.0.smithi084.stdout:2054: left oid 13 (ObjNum 627 snap 222 seq_num 627) 2024-03-30T12:29:42.379 INFO:tasks.rados.rados.0.smithi084.stdout:2053: done (2 left) 2024-03-30T12:29:42.379 INFO:tasks.rados.rados.0.smithi084.stdout:2054: done (1 left) 2024-03-30T12:29:42.379 INFO:tasks.rados.rados.0.smithi084.stdout:2055: done (0 left) 2024-03-30T12:29:42.379 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 222 2024-03-30T12:29:42.379 INFO:tasks.rados.rados.0.smithi084.stdout:2056: seq_num 628 ranges {7061504=524288,7585792=401408} 2024-03-30T12:29:42.419 INFO:tasks.rados.rados.0.smithi084.stdout:2056: writing smithi08477944-34 from 7061504 to 7585792 tid 1 2024-03-30T12:29:42.422 INFO:tasks.rados.rados.0.smithi084.stdout:2056: writing smithi08477944-34 from 7585792 to 7987200 tid 2 2024-03-30T12:29:42.422 INFO:tasks.rados.rados.0.smithi084.stdout:2057: read oid 36 snap 218 2024-03-30T12:29:42.422 INFO:tasks.rados.rados.0.smithi084.stdout:2057: expect deleted 2024-03-30T12:29:42.422 INFO:tasks.rados.rados.0.smithi084.stdout:2058: delete oid 26 current snap is 222 2024-03-30T12:29:42.425 INFO:tasks.rados.rados.0.smithi084.stdout:2056: finishing write tid 1 to smithi08477944-34 2024-03-30T12:29:42.426 INFO:tasks.rados.rados.0.smithi084.stdout:2056: finishing write tid 2 to smithi08477944-34 2024-03-30T12:29:42.426 INFO:tasks.rados.rados.0.smithi084.stdout:2056: finishing write tid 3 to smithi08477944-34 2024-03-30T12:29:42.429 INFO:tasks.rados.rados.0.smithi084.stdout:2056: finishing write tid 4 to smithi08477944-34 2024-03-30T12:29:42.429 INFO:tasks.rados.rados.0.smithi084.stdout:2056: oid 34 updating version 0 to 913 2024-03-30T12:29:42.429 INFO:tasks.rados.rados.0.smithi084.stdout:2056: oid 34 version 913 is already newer than 912 2024-03-30T12:29:42.429 INFO:tasks.rados.rados.0.smithi084.stdout:2056: oid 34 updating version 913 to 914 2024-03-30T12:29:42.429 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 914 (ObjNum 628 snap 222 seq_num 628) dirty exists 2024-03-30T12:29:42.429 INFO:tasks.rados.rados.0.smithi084.stdout:2056: left oid 34 (ObjNum 628 snap 222 seq_num 628) 2024-03-30T12:29:42.436 INFO:tasks.rados.rados.0.smithi084.stdout:2056: done (2 left) 2024-03-30T12:29:42.436 INFO:tasks.rados.rados.0.smithi084.stdout:2057: done (1 left) 2024-03-30T12:29:42.436 INFO:tasks.rados.rados.0.smithi084.stdout:2058: done (0 left) 2024-03-30T12:29:42.436 INFO:tasks.rados.rados.0.smithi084.stdout:2059: delete oid 23 current snap is 222 2024-03-30T12:29:42.439 INFO:tasks.rados.rados.0.smithi084.stdout:2059: done (0 left) 2024-03-30T12:29:42.439 INFO:tasks.rados.rados.0.smithi084.stdout:2060: setattr oid 9 current snap is 222 2024-03-30T12:29:42.440 INFO:tasks.rados.rados.0.smithi084.stdout:2061: snap_remove snap 172 2024-03-30T12:29:42.595 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:42.596 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-mon[83709]: osdmap e501: 8 total, 8 up, 8 in 2024-03-30T12:29:42.596 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:42.596 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:42.596 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:42.596 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:42.596 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:42.596 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.352+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.596 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.369+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.596 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.393+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.597 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.412+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.597 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.429+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.597 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.445+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.597 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.462+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.597 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.479+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.597 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.495+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.597 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.512+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.597 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.528+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.597 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.544+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.597 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.558+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.597 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.577+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.597 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.594+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.598 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.361+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.598 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.387+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.598 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.420+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.598 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.453+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.598 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.484+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.598 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.514+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.598 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.544+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.598 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.574+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.598 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.603+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:42.387+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:42.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:42.388+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:42.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:42.383+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:42.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:42.383+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:42.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:42.383+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:42.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:42.383+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:42.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:42.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:42 smithi084 ceph-mon[91810]: osdmap e501: 8 total, 8 up, 8 in 2024-03-30T12:29:42.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:42.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:42.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:42.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:42.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:42.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:42.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:42 smithi084 ceph-mon[89279]: osdmap e501: 8 total, 8 up, 8 in 2024-03-30T12:29:42.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:42.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:42.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:42.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:42.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:42.850 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.631+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.850 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.661+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.850 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.695+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.851 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.736+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.851 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.771+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.851 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.790+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.851 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.814+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.851 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.844+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:42.851 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.615+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.851 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.631+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.851 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.647+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.851 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.665+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.851 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.680+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.851 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.698+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.851 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.715+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.852 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.734+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.852 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.756+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.852 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.773+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.852 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.793+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.852 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.813+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.852 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.836+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:42.852 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.858+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.101 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.877+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.101 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.910+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.101 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.934+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.101 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.953+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.101 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.976+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.101 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:42.997+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.101 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:43.022+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.101 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:43.052+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.101 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:43.083+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.102 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.875+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.102 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.895+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.102 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.910+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.102 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.926+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.102 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.944+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.102 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.964+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.102 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.980+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.102 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:42.999+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.102 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.015+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.102 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.031+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.103 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.046+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.103 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.068+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.103 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.090+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.103 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.108+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.352 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.127+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.352 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.180+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.352 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.200+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.352 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.221+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.352 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.238+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.352 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.256+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.352 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.276+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.352 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.295+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.352 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.337+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.353 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:43.121+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.353 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:43.185+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.353 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:43.214+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.353 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:43.246+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.353 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:43.280+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.353 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:43.328+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.353 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:43.360+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.382 INFO:tasks.rados.rados.0.smithi084.stdout:2061: done (1 left) 2024-03-30T12:29:43.382 INFO:tasks.rados.rados.0.smithi084.stdout:2062: snap_create 2024-03-30T12:29:43.382 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 22486 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:29:43.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-mon[83709]: osdmap e502: 8 total, 8 up, 8 in 2024-03-30T12:29:43.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:43.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:43.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:43.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:43.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:43.611 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:43.612 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-mon[83709]: pgmap v436: 121 pgs: 1 peering+snaptrim_error, 7 peering, 5 active+undersized+degraded, 20 active+undersized, 3 active+clean+snaptrim, 80 active+clean, 5 active+clean+snaptrim_error; 412 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 10 MiB/s rd, 1.1 MiB/s wr, 18 op/s; 20/861 objects degraded (2.323%) 2024-03-30T12:29:43.612 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.362+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.612 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.379+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.612 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.409+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.612 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.436+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.612 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.461+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.612 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.484+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.612 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.506+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.612 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.596+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.612 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.618+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.613 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:43.410+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.613 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:43.445+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.613 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:43.488+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.613 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:43.586+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.613 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:29:43.402+0000 7f5be50dc700 -1 osd.6 pg_epoch: 502 pg[5.9s1( v 503'561 (0'0,503'561] local-lis/les=500/501 n=8 ec=71/71 lis/c=500/500 les/c/f=501/501/0 sis=500) [7,6,1]p7(0) r=1 lpr=500 luod=0'0 crt=502'559 lcod 502'559 mlcod 502'559 active mbc={} ps=[97~1,99~1,9d~1,a0~2,a8~3f,e8~3,ec~f,fc~b,108~3,10d~1,111~1]] update_snap_map remove_oid 5:9de8ba35:::smithi08477944-34:f9 failed with -2 2024-03-30T12:29:43.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:43.391+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:43.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:43.391+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:43.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:43 smithi084 ceph-mon[91810]: osdmap e502: 8 total, 8 up, 8 in 2024-03-30T12:29:43.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:43.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:43.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:43.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:43.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:43.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:43.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:43 smithi084 ceph-mon[91810]: pgmap v436: 121 pgs: 1 peering+snaptrim_error, 7 peering, 5 active+undersized+degraded, 20 active+undersized, 3 active+clean+snaptrim, 80 active+clean, 5 active+clean+snaptrim_error; 412 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 10 MiB/s rd, 1.1 MiB/s wr, 18 op/s; 20/861 objects degraded (2.323%) 2024-03-30T12:29:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:43 smithi084 ceph-mon[89279]: osdmap e502: 8 total, 8 up, 8 in 2024-03-30T12:29:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:43 smithi084 ceph-mon[89279]: pgmap v436: 121 pgs: 1 peering+snaptrim_error, 7 peering, 5 active+undersized+degraded, 20 active+undersized, 3 active+clean+snaptrim, 80 active+clean, 5 active+clean+snaptrim_error; 412 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 10 MiB/s rd, 1.1 MiB/s wr, 18 op/s; 20/861 objects degraded (2.323%) 2024-03-30T12:29:43.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:43.387+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:43.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:43.387+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:43.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:43.388+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:43.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:43.388+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:43.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:43.389+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:43.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:43.389+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:43.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:43.389+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:43.868 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:43.627+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.868 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:43.670+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.868 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:43.708+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.868 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:43.773+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.868 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:43.809+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.868 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:43.841+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:43.868 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.642+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.667+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.686+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.707+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.754+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.779+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.802+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.829+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.854+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:43.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.876+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:43.882+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:44.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:43.910+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:44.122 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:43.953+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:44.122 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:43.994+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:44.122 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:44.032+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:44.122 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:44.075+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:44.122 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:44.119+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:44.122 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.901+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.122 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.930+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.122 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.951+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.122 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.975+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.122 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:43.994+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.122 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.018+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.123 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.040+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.123 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.063+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.123 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.084+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.123 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.107+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.378 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-mon[83709]: Health check update: Degraded data redundancy: 20/861 objects degraded (2.323%), 5 pgs degraded (PG_DEGRADED) 2024-03-30T12:29:44.379 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:44.379 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:44.379 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-mon[83709]: osdmap e503: 8 total, 8 up, 8 in 2024-03-30T12:29:44.379 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.136+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.379 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.162+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.379 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.192+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.379 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.221+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.379 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.248+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.379 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.276+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.380 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.301+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.380 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.330+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.380 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.358+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.380 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:44.168+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:44.380 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:44.208+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:44.380 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:44.258+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:44.380 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:44.301+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:44.380 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:44.342+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:44.389 INFO:tasks.rados.rados.0.smithi084.stdout:2060: done (1 left) 2024-03-30T12:29:44.389 INFO:tasks.rados.rados.0.smithi084.stdout:2062: done (0 left) 2024-03-30T12:29:44.389 INFO:tasks.rados.rados.0.smithi084.stdout:2063: read oid 42 snap -1 2024-03-30T12:29:44.389 INFO:tasks.rados.rados.0.smithi084.stdout:2063: expect (ObjNum 502 snap 157 seq_num 502) 2024-03-30T12:29:44.389 INFO:tasks.rados.rados.0.smithi084.stdout:2064: snap_remove snap 221 2024-03-30T12:29:44.647 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.391+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.648 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.427+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.648 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.459+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.648 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.494+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.648 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.518+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.648 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.543+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.648 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.568+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.648 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.599+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.648 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.627+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.649 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:44.649 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:44.649 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:44.649 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:44.649 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:44.649 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:44.649 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:44.392+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:44.649 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:44.439+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:44.649 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:44.483+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:44.649 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:44.537+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:44.649 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:44.582+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:44.650 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:44.628+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:44.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:44.397+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:44.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:44.397+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:44.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-mon[89279]: Health check update: Degraded data redundancy: 20/861 objects degraded (2.323%), 5 pgs degraded (PG_DEGRADED) 2024-03-30T12:29:44.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:44.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:44.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-mon[89279]: osdmap e503: 8 total, 8 up, 8 in 2024-03-30T12:29:44.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:44.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:44.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:44.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-mon[91810]: Health check update: Degraded data redundancy: 20/861 objects degraded (2.323%), 5 pgs degraded (PG_DEGRADED) 2024-03-30T12:29:44.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:44.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:44.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-mon[91810]: osdmap e503: 8 total, 8 up, 8 in 2024-03-30T12:29:44.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:44.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:44.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:44.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:44.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:44.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:44.923 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.655+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.923 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.687+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.923 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.719+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.923 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.759+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.923 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.792+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.923 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.818+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.923 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.843+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.923 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.866+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.923 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.897+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.923 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.930+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:44.924 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:44.679+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:44.924 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:44.729+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:44.924 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:44.766+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:44.924 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:44.806+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:44.924 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:44.854+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:44.924 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:44.901+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.180 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.962+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.181 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:44.989+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.181 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.012+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.181 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.036+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.181 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.055+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.181 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.076+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.181 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.103+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.181 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.123+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.181 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.143+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.181 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.165+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.181 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.188+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.181 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:44.945+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.182 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:44.983+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.182 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:45.022+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.182 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:45.065+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.182 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:45.106+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.182 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:45.143+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.182 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:45.176+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:44.765+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:45.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:44.765+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:45.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:44.765+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:45.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:44.765+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:45.399 INFO:tasks.rados.rados.0.smithi084.stdout:2063: expect (ObjNum 502 snap 157 seq_num 502) 2024-03-30T12:29:45.439 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-mon[83709]: osdmap e504: 8 total, 8 up, 8 in 2024-03-30T12:29:45.439 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:45.439 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:45.439 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-mon[83709]: pgmap v439: 121 pgs: 1 peering+snaptrim_error, 7 peering, 1 active+undersized+degraded, 5 active+undersized, 4 active+clean+snaptrim, 98 active+clean, 5 active+clean+snaptrim_error; 419 MiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 4.1 MiB/s rd, 394 KiB/s wr, 19 op/s; 6/867 objects degraded (0.692%) 2024-03-30T12:29:45.439 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:45.440 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:29:45.440 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:45.440 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:45.440 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:45.440 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:45.440 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.214+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.440 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.240+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.441 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.263+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.441 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.284+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.441 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.308+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.441 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.330+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.441 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.354+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.441 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.378+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.441 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.401+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.441 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.427+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.441 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.446+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.441 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:45.217+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.441 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:45.247+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.442 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:45.285+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.442 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:45.327+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.442 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:45.369+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.442 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:45.418+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.698 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.470+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.698 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.492+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.698 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.516+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.698 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.539+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.698 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.562+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.698 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.583+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.699 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.605+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.699 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.627+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.699 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.653+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.699 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.679+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.699 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:45.464+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.699 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:45.500+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.699 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:45.538+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.699 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:45.575+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.699 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:45.614+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.699 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:45.657+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.699 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:45.693+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:45.410+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:45.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:45.410+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:45.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-mon[91810]: osdmap e504: 8 total, 8 up, 8 in 2024-03-30T12:29:45.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:45.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:45.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-mon[91810]: pgmap v439: 121 pgs: 1 peering+snaptrim_error, 7 peering, 1 active+undersized+degraded, 5 active+undersized, 4 active+clean+snaptrim, 98 active+clean, 5 active+clean+snaptrim_error; 419 MiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 4.1 MiB/s rd, 394 KiB/s wr, 19 op/s; 6/867 objects degraded (0.692%) 2024-03-30T12:29:45.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:45.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:29:45.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:45.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:45.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:45.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:45.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:45.407+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:45.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:45.408+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:45.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:45.408+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:45.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:45.409+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:45.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:45.409+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:45.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:45.409+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:45.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:45.409+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:45.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-mon[89279]: osdmap e504: 8 total, 8 up, 8 in 2024-03-30T12:29:45.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:45.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:45.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-mon[89279]: pgmap v439: 121 pgs: 1 peering+snaptrim_error, 7 peering, 1 active+undersized+degraded, 5 active+undersized, 4 active+clean+snaptrim, 98 active+clean, 5 active+clean+snaptrim_error; 419 MiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 4.1 MiB/s rd, 394 KiB/s wr, 19 op/s; 6/867 objects degraded (0.692%) 2024-03-30T12:29:45.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:45.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:29:45.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:45.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:45.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:45.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:45.958 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:45.737+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.958 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:45.772+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.958 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:45.811+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.958 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:45.852+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.958 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:45.889+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.958 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:45.928+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:45.958 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.704+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.958 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.728+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.958 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.749+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.959 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.774+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.959 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.799+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.959 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.823+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.959 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.846+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.959 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.871+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.959 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.898+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.959 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.922+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:45.959 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.949+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.025 INFO:tasks.rados.rados.0.smithi084.stdout:2063: done (1 left) 2024-03-30T12:29:46.025 INFO:tasks.rados.rados.0.smithi084.stdout:2064: done (0 left) 2024-03-30T12:29:46.025 INFO:tasks.rados.rados.0.smithi084.stdout:2065: delete oid 26 current snap is 223 2024-03-30T12:29:46.037 INFO:tasks.rados.rados.0.smithi084.stdout:2065: done (0 left) 2024-03-30T12:29:46.038 INFO:tasks.rados.rados.0.smithi084.stdout:2066: read oid 42 snap -1 2024-03-30T12:29:46.038 INFO:tasks.rados.rados.0.smithi084.stdout:2066: expect (ObjNum 502 snap 157 seq_num 502) 2024-03-30T12:29:46.038 INFO:tasks.rados.rados.0.smithi084.stdout:2067: delete oid 28 current snap is 223 2024-03-30T12:29:46.049 INFO:tasks.rados.rados.0.smithi084.stdout:2067: done (1 left) 2024-03-30T12:29:46.049 INFO:tasks.rados.rados.0.smithi084.stdout:2068: snap_create 2024-03-30T12:29:46.060 INFO:tasks.rados.rados.0.smithi084.stdout:2066: expect (ObjNum 502 snap 157 seq_num 502) 2024-03-30T12:29:46.222 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:45.964+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.223 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.000+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.223 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.039+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.223 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.076+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.223 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.116+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.223 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.151+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.223 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.191+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.223 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.972+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.223 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:45.993+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.223 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.014+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.223 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.037+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.223 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.062+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.223 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.086+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.224 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.107+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.224 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.131+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.224 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.159+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.224 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.182+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.224 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.201+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.474 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.225+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.474 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.253+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.474 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.279+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.474 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.300+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.474 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.328+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.475 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.350+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.475 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.372+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.475 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.394+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.475 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.413+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.475 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.440+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.475 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.463+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.475 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-mon[83709]: osdmap e505: 8 total, 8 up, 8 in 2024-03-30T12:29:46.475 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:46.475 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:46.476 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:46.476 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:46.476 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:46.476 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:46.476 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:46.476 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:46.476 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.232+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.476 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.268+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.476 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.306+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.476 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.332+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.476 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.371+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.476 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.405+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.477 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.441+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.477 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.481+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.735 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.519+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.735 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.560+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.735 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.601+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.735 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.638+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.735 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.668+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.735 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.718+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.736 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.493+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.736 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.517+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.736 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.539+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.736 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.561+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.736 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.583+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.736 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.609+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.736 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.635+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.736 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.664+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.736 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.691+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.737 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.713+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.737 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.742+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:46 smithi084 ceph-mon[91810]: osdmap e505: 8 total, 8 up, 8 in 2024-03-30T12:29:46.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:46.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:46.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:46.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:46.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:46.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:46.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:46 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:46.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:46 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:46.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:46 smithi084 ceph-mon[89279]: osdmap e505: 8 total, 8 up, 8 in 2024-03-30T12:29:46.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:46.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:46.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:46.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:46.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:46.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:46.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:46 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:46.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:46 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:46.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.770+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.790+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.822+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.844+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.871+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.894+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.913+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.986 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.931+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.987 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.955+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.987 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.975+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:46.987 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.742+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.987 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.782+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.987 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.816+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.987 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.855+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.987 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.900+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.987 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.935+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.987 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:46.970+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:46.988 INFO:tasks.rados.rados.0.smithi084.stdout:2066: done (1 left) 2024-03-30T12:29:46.988 INFO:tasks.rados.rados.0.smithi084.stdout:2068: done (0 left) 2024-03-30T12:29:46.988 INFO:tasks.rados.rados.0.smithi084.stdout:2069: snap_remove snap 217 2024-03-30T12:29:47.243 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:46.998+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.243 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.024+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.243 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.046+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.243 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.066+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.244 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.087+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.244 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.108+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.244 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.128+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.244 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.153+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.244 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.175+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.244 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.196+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.244 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.220+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.244 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.241+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.244 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.012+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:47.244 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.031+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:47.244 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.058+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:47.244 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.092+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:47.245 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.128+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:47.245 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.150+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:47.245 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.182+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:47.245 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.213+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:47.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:46.997+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:47.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:46.998+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:47.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:46.995+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:47.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:46.997+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:47.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:46.997+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:47.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:46.997+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:47.500 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-mon[83709]: pgmap v441: 121 pgs: 5 active+clean+snaptrim, 110 active+clean, 6 active+clean+snaptrim_error; 422 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 5.1 MiB/s rd, 810 KiB/s wr, 12 op/s; 6.0 MiB/s, 2 objects/s recovering 2024-03-30T12:29:47.500 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-mon[83709]: osdmap e506: 8 total, 8 up, 8 in 2024-03-30T12:29:47.501 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.263+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.501 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.289+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.501 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.311+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.501 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.333+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.501 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.354+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.501 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.377+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.501 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.396+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.501 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.421+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.501 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.440+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.502 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.466+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.502 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.485+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.502 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.507+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.502 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.250+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:47.502 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.285+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:47.502 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.320+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:47.502 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.348+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:47.502 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.374+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:47.502 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.411+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:47.502 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.443+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:47.502 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.478+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:47.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:47 smithi084 ceph-mon[91810]: pgmap v441: 121 pgs: 5 active+clean+snaptrim, 110 active+clean, 6 active+clean+snaptrim_error; 422 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 5.1 MiB/s rd, 810 KiB/s wr, 12 op/s; 6.0 MiB/s, 2 objects/s recovering 2024-03-30T12:29:47.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:47 smithi084 ceph-mon[91810]: osdmap e506: 8 total, 8 up, 8 in 2024-03-30T12:29:47.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:47 smithi084 ceph-mon[89279]: pgmap v441: 121 pgs: 5 active+clean+snaptrim, 110 active+clean, 6 active+clean+snaptrim_error; 422 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 5.1 MiB/s rd, 810 KiB/s wr, 12 op/s; 6.0 MiB/s, 2 objects/s recovering 2024-03-30T12:29:47.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:47 smithi084 ceph-mon[89279]: osdmap e506: 8 total, 8 up, 8 in 2024-03-30T12:29:47.764 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.525+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.764 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.545+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.764 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.565+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.764 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.586+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.764 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.604+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.764 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.625+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.764 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.652+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.764 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.670+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.764 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.691+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.764 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.713+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.764 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.734+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.764 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.753+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:47.765 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.510+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:47.765 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.539+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:47.765 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.576+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:47.765 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.616+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:47.765 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.648+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:47.765 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.681+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:47.765 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.711+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:47.765 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.745+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:47.988 INFO:tasks.rados.rados.0.smithi084.stdout:2069: done (0 left) 2024-03-30T12:29:47.988 INFO:tasks.rados.rados.0.smithi084.stdout:2070: copy_from oid 33 from oid 14 current snap is 224 2024-03-30T12:29:47.988 INFO:tasks.rados.rados.0.smithi084.stdout:2071: rmattr oid 20 current snap is 224 2024-03-30T12:29:47.988 INFO:tasks.rados.rados.0.smithi084.stdout:2072: snap_remove snap 211 2024-03-30T12:29:48.016 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.771+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.016 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.794+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.016 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.813+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.016 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.834+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.017 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.858+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.017 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.879+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.017 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.898+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.017 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.916+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.017 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.938+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.017 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.956+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.017 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:47.975+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.017 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.002+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.017 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.024+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.018 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.782+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.018 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.814+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.018 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.849+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.018 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.874+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.018 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.908+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.018 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.942+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.018 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:47.980+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.018 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.018+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:48.005+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:48.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:48.005+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:48.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:47.994+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:48.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:47.994+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:48.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:47.995+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:48.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:47.995+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:48.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:47.996+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:48.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:47.996+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:48.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:47.996+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:48.273 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.044+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.273 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.063+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.273 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.082+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.273 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.104+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.273 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.128+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.273 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.151+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.274 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.176+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.274 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.202+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.274 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.223+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.274 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.244+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.274 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.263+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.274 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.055+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.274 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.089+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.274 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.125+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.274 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.167+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.275 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.214+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.275 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.247+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.275 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.279+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.524 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:48.524 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:48.524 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:48.524 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:48.524 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:48.524 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:48.524 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-mon[83709]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/867 objects degraded (0.692%), 1 pg degraded) 2024-03-30T12:29:48.524 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-mon[83709]: osdmap e507: 8 total, 8 up, 8 in 2024-03-30T12:29:48.525 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.286+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.525 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.310+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.525 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.333+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.525 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.353+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.525 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.374+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.525 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.395+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.525 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.416+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.525 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.438+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.525 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.461+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.525 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.484+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.525 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.503+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.526 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.531+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.526 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.304+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.526 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.333+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.526 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.373+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.526 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.402+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.526 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.433+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.526 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.469+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.526 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.508+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.526 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.531+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:48.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:48.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:48.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:48.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:48.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:48.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:48 smithi084 ceph-mon[91810]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/867 objects degraded (0.692%), 1 pg degraded) 2024-03-30T12:29:48.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:48 smithi084 ceph-mon[91810]: osdmap e507: 8 total, 8 up, 8 in 2024-03-30T12:29:48.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:48.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:48.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:48.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:48.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:48.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:48.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:48 smithi084 ceph-mon[89279]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/867 objects degraded (0.692%), 1 pg degraded) 2024-03-30T12:29:48.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:48 smithi084 ceph-mon[89279]: osdmap e507: 8 total, 8 up, 8 in 2024-03-30T12:29:48.778 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.558+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.778 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.591+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.778 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.623+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.778 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.658+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.778 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.700+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.778 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.742+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.778 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.776+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:48.779 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.556+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.779 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.574+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.779 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.598+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.779 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.620+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.779 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.642+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.779 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.668+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.779 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.688+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.779 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.715+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.779 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.740+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.779 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.762+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:48.987 INFO:tasks.rados.rados.0.smithi084.stdout:2070: finishing copy_from to smithi08477944-33 2024-03-30T12:29:48.987 INFO:tasks.rados.rados.0.smithi084.stdout:2070: got expected ENOENT (src dne) 2024-03-30T12:29:48.987 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 17490 (ObjNum 565 snap 194 seq_num 565) dirty exists 2024-03-30T12:29:48.988 INFO:tasks.rados.rados.0.smithi084.stdout:2070: finishing copy_from racing read to smithi08477944-33 2024-03-30T12:29:48.988 INFO:tasks.rados.rados.0.smithi084.stdout:2070: done (2 left) 2024-03-30T12:29:48.988 INFO:tasks.rados.rados.0.smithi084.stdout:2071: done (1 left) 2024-03-30T12:29:48.988 INFO:tasks.rados.rados.0.smithi084.stdout:2072: done (0 left) 2024-03-30T12:29:48.988 INFO:tasks.rados.rados.0.smithi084.stdout:2073: snap_create 2024-03-30T12:29:49.030 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.786+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.030 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.809+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.030 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.837+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.030 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.860+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.030 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.883+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.030 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.907+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.030 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.931+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.030 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.959+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.030 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:48.982+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.030 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.014+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.031 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.815+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.031 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.849+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.031 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.890+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.031 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.928+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.031 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:48.962+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.031 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.010+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:48.995+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:49.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:48.996+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:49.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:48.999+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:49.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:48.999+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:49.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:49.000+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:49.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:49.000+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:49.282 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.050+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.282 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.089+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.282 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.126+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.282 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.171+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.282 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.219+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.282 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.263+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.282 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.037+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.283 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.060+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.283 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.084+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.283 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.107+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.283 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.137+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.283 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.160+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.283 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.187+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.283 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.212+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.283 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.236+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.283 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.260+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.545 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.290+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.545 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.317+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.343+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.363+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.386+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.412+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.433+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.454+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.474+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.500+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.525+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.547 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:49.547 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:49.547 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:49.547 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:49.547 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:49.547 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:49.547 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-mon[83709]: pgmap v444: 121 pgs: 5 active+clean+snaptrim, 110 active+clean, 6 active+clean+snaptrim_error; 422 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 5.2 MiB/s rd, 620 KiB/s wr, 10 op/s; 6.0 MiB/s, 2 objects/s recovering 2024-03-30T12:29:49.547 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-mon[83709]: osdmap e508: 8 total, 8 up, 8 in 2024-03-30T12:29:49.547 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.299+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.328+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.365+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.403+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.442+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.477+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.510+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.538+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:29:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:29:49] "GET /metrics HTTP/1.1" 200 36255 "" "Prometheus/2.43.0" 2024-03-30T12:29:49.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:49.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:49.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:49.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:49.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:49.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:49.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:49 smithi084 ceph-mon[91810]: pgmap v444: 121 pgs: 5 active+clean+snaptrim, 110 active+clean, 6 active+clean+snaptrim_error; 422 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 5.2 MiB/s rd, 620 KiB/s wr, 10 op/s; 6.0 MiB/s, 2 objects/s recovering 2024-03-30T12:29:49.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:49 smithi084 ceph-mon[91810]: osdmap e508: 8 total, 8 up, 8 in 2024-03-30T12:29:49.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:49.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:49.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:49.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:49.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:49.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:49.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:49 smithi084 ceph-mon[89279]: pgmap v444: 121 pgs: 5 active+clean+snaptrim, 110 active+clean, 6 active+clean+snaptrim_error; 422 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 5.2 MiB/s rd, 620 KiB/s wr, 10 op/s; 6.0 MiB/s, 2 objects/s recovering 2024-03-30T12:29:49.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:49 smithi084 ceph-mon[89279]: osdmap e508: 8 total, 8 up, 8 in 2024-03-30T12:29:49.817 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.571+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.817 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.607+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.817 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.649+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.818 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.688+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.818 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.725+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.818 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.759+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.818 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.799+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:49.818 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.549+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.818 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.571+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.818 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.595+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.818 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.617+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.818 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.638+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.818 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.656+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.818 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.677+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.818 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.701+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.819 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.723+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.819 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.744+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.819 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.763+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.819 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.780+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.819 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.801+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.819 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.823+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:49.990 INFO:tasks.rados.rados.0.smithi084.stdout:2073: done (0 left) 2024-03-30T12:29:49.990 INFO:tasks.rados.rados.0.smithi084.stdout:2074: read oid 47 snap -1 2024-03-30T12:29:49.990 INFO:tasks.rados.rados.0.smithi084.stdout:2074: expect deleted 2024-03-30T12:29:49.990 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 225 2024-03-30T12:29:49.991 INFO:tasks.rados.rados.0.smithi084.stdout:2075: seq_num 633 ranges {3506176=606208,4112384=401408} 2024-03-30T12:29:50.013 INFO:tasks.rados.rados.0.smithi084.stdout:2075: writing smithi08477944-12 from 3506176 to 4112384 tid 1 2024-03-30T12:29:50.016 INFO:tasks.rados.rados.0.smithi084.stdout:2075: writing smithi08477944-12 from 4112384 to 4513792 tid 2 2024-03-30T12:29:50.016 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 225 2024-03-30T12:29:50.016 INFO:tasks.rados.rados.0.smithi084.stdout:2076: seq_num 634 ranges {737280=622592,1359872=401408} 2024-03-30T12:29:50.023 INFO:tasks.rados.rados.0.smithi084.stdout:2076: writing smithi08477944-8 from 737280 to 1359872 tid 1 2024-03-30T12:29:50.026 INFO:tasks.rados.rados.0.smithi084.stdout:2076: writing smithi08477944-8 from 1359872 to 1761280 tid 2 2024-03-30T12:29:50.026 INFO:tasks.rados.rados.0.smithi084.stdout:2074: done (2 left) 2024-03-30T12:29:50.026 INFO:tasks.rados.rados.0.smithi084.stdout:2077: delete oid 50 current snap is 225 2024-03-30T12:29:50.026 INFO:tasks.rados.rados.0.smithi084.stdout:2075: finishing write tid 1 to smithi08477944-12 2024-03-30T12:29:50.029 INFO:tasks.rados.rados.0.smithi084.stdout:2077: done (2 left) 2024-03-30T12:29:50.029 INFO:tasks.rados.rados.0.smithi084.stdout:2078: delete oid 10 current snap is 225 2024-03-30T12:29:50.029 INFO:tasks.rados.rados.0.smithi084.stdout:2075: finishing write tid 2 to smithi08477944-12 2024-03-30T12:29:50.032 INFO:tasks.rados.rados.0.smithi084.stdout:2075: finishing write tid 3 to smithi08477944-12 2024-03-30T12:29:50.033 INFO:tasks.rados.rados.0.smithi084.stdout:2075: finishing write tid 4 to smithi08477944-12 2024-03-30T12:29:50.034 INFO:tasks.rados.rados.0.smithi084.stdout:2075: oid 12 updating version 0 to 916 2024-03-30T12:29:50.034 INFO:tasks.rados.rados.0.smithi084.stdout:2075: oid 12 version 916 is already newer than 915 2024-03-30T12:29:50.034 INFO:tasks.rados.rados.0.smithi084.stdout:2075: oid 12 updating version 916 to 917 2024-03-30T12:29:50.034 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 917 (ObjNum 633 snap 225 seq_num 633) dirty exists 2024-03-30T12:29:50.034 INFO:tasks.rados.rados.0.smithi084.stdout:2075: left oid 12 (ObjNum 633 snap 225 seq_num 633) 2024-03-30T12:29:50.044 INFO:tasks.rados.rados.0.smithi084.stdout:2075: done (2 left) 2024-03-30T12:29:50.044 INFO:tasks.rados.rados.0.smithi084.stdout:2078: done (1 left) 2024-03-30T12:29:50.044 INFO:tasks.rados.rados.0.smithi084.stdout:2079: read oid 46 snap -1 2024-03-30T12:29:50.045 INFO:tasks.rados.rados.0.smithi084.stdout:2079: expect (ObjNum 565 snap 194 seq_num 565) 2024-03-30T12:29:50.045 INFO:tasks.rados.rados.0.smithi084.stdout:2080: read oid 24 snap -1 2024-03-30T12:29:50.045 INFO:tasks.rados.rados.0.smithi084.stdout:2080: expect deleted 2024-03-30T12:29:50.045 INFO:tasks.rados.rados.0.smithi084.stdout:2081: read oid 9 snap -1 2024-03-30T12:29:50.045 INFO:tasks.rados.rados.0.smithi084.stdout:2081: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:29:50.045 INFO:tasks.rados.rados.0.smithi084.stdout:2082: read oid 28 snap -1 2024-03-30T12:29:50.045 INFO:tasks.rados.rados.0.smithi084.stdout:2082: expect deleted 2024-03-30T12:29:50.045 INFO:tasks.rados.rados.0.smithi084.stdout:2083: snap_remove snap 209 2024-03-30T12:29:50.071 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.845+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.071 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.889+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.071 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.927+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.071 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.961+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.071 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:49.989+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.071 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:50.027+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.071 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.844+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.071 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.864+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.071 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.889+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.072 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.909+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.072 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.934+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.072 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.956+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.072 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:49.983+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.072 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.008+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.072 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.031+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.072 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.055+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.072 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.078+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:49.998+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:50.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:49.998+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:50.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:49.996+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:50.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:49.996+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:50.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:49.999+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:50.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:49.999+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:50.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:49.999+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:50.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:50.000+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:50.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:50.000+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:50.339 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.100+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.339 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.126+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.339 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.150+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.340 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.172+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.340 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.197+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.340 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.221+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.340 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.242+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.340 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.265+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.340 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.286+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.340 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.307+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.340 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.326+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.341 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:50.100+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.341 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:50.145+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.341 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:50.184+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.341 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:50.220+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.341 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:50.266+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.341 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:50.307+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.341 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:50.347+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.596 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:50.596 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:50.596 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:50.596 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:50.596 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:50.596 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:50.596 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-mon[83709]: osdmap e509: 8 total, 8 up, 8 in 2024-03-30T12:29:50.597 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.347+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.597 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.369+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.597 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.391+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.597 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.411+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.597 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.437+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.597 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.459+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.597 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.482+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.597 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.502+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.597 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.521+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.597 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.545+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.597 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.564+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.597 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.585+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.597 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.604+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.598 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:50.388+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.598 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:50.424+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.598 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:50.463+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.598 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:50.501+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.598 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:50.550+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.598 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:50.587+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:50.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:50.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:50.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:50.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:50.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:50.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:50 smithi084 ceph-mon[89279]: osdmap e509: 8 total, 8 up, 8 in 2024-03-30T12:29:50.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:50.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:50.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:50.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:50.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:50.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:50.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:50 smithi084 ceph-mon[91810]: osdmap e509: 8 total, 8 up, 8 in 2024-03-30T12:29:50.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:50.616+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:50.649+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:50.683+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:50.713+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:50.746+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:50.784+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:50.817+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:50.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.625+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.645+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.664+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.689+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.710+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.731+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.751+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.772+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.792+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.816+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.837+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:50.997 INFO:tasks.rados.rados.0.smithi084.stdout:2081: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:29:51.000 INFO:tasks.rados.rados.0.smithi084.stdout:2076: finishing write tid 1 to smithi08477944-8 2024-03-30T12:29:51.000 INFO:tasks.rados.rados.0.smithi084.stdout:2076: finishing write tid 2 to smithi08477944-8 2024-03-30T12:29:51.000 INFO:tasks.rados.rados.0.smithi084.stdout:2076: finishing write tid 3 to smithi08477944-8 2024-03-30T12:29:51.000 INFO:tasks.rados.rados.0.smithi084.stdout:2076: finishing write tid 4 to smithi08477944-8 2024-03-30T12:29:51.001 INFO:tasks.rados.rados.0.smithi084.stdout:2076: oid 8 updating version 0 to 16701 2024-03-30T12:29:51.001 INFO:tasks.rados.rados.0.smithi084.stdout:2076: oid 8 updating version 16701 to 16703 2024-03-30T12:29:51.001 INFO:tasks.rados.rados.0.smithi084.stdout:2076: oid 8 version 16703 is already newer than 16702 2024-03-30T12:29:51.001 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 16703 (ObjNum 634 snap 225 seq_num 634) dirty exists 2024-03-30T12:29:51.001 INFO:tasks.rados.rados.0.smithi084.stdout:2076: left oid 8 (ObjNum 634 snap 225 seq_num 634) 2024-03-30T12:29:51.001 INFO:tasks.rados.rados.0.smithi084.stdout:2079: expect (ObjNum 565 snap 194 seq_num 565) 2024-03-30T12:29:51.145 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:50.853+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.145 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:50.914+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.146 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:50.947+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.146 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:50.986+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.146 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.025+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.146 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.061+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.146 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.099+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.146 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.134+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.856+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.906+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.930+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.952+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.970+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:50.990+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.147 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.015+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.147 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.036+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.147 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.055+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.147 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.074+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.147 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.093+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.147 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.112+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.147 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.132+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:51.005+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:51.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:51.005+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:51.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:51.001+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:51.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:51.001+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:51.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:51.001+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:51.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:51.001+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:51.410 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.169+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.410 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.207+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.410 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.239+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.410 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.273+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.410 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.308+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.410 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.350+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.410 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.398+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.410 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.153+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.410 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.176+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.411 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.195+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.411 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.213+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.411 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.233+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.411 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.251+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.411 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.270+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.411 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.289+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.411 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.307+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.411 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.326+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.411 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.349+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.411 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.375+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.411 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.396+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.600 INFO:tasks.rados.rados.0.smithi084.stdout:2076: done (5 left) 2024-03-30T12:29:51.600 INFO:tasks.rados.rados.0.smithi084.stdout:2079: done (4 left) 2024-03-30T12:29:51.600 INFO:tasks.rados.rados.0.smithi084.stdout:2080: done (3 left) 2024-03-30T12:29:51.600 INFO:tasks.rados.rados.0.smithi084.stdout:2081: done (2 left) 2024-03-30T12:29:51.601 INFO:tasks.rados.rados.0.smithi084.stdout:2082: done (1 left) 2024-03-30T12:29:51.601 INFO:tasks.rados.rados.0.smithi084.stdout:2083: done (0 left) 2024-03-30T12:29:51.601 INFO:tasks.rados.rados.0.smithi084.stdout:2084: rmattr oid 41 current snap is 225 2024-03-30T12:29:51.601 INFO:tasks.rados.rados.0.smithi084.stdout:2084: done (0 left) 2024-03-30T12:29:51.601 INFO:tasks.rados.rados.0.smithi084.stdout:2085: delete oid 3 current snap is 225 2024-03-30T12:29:51.616 INFO:tasks.rados.rados.0.smithi084.stdout:2085: done (0 left) 2024-03-30T12:29:51.617 INFO:tasks.rados.rados.0.smithi084.stdout:2086: rollback oid 38 current snap is 225 2024-03-30T12:29:51.617 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 38 to 220 2024-03-30T12:29:51.617 INFO:tasks.rados.rados.0.smithi084.stdout:2087: rollback oid 39 current snap is 225 2024-03-30T12:29:51.617 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 39 to 215 2024-03-30T12:29:51.617 INFO:tasks.rados.rados.0.smithi084.stdout:2088: read oid 2 snap 214 2024-03-30T12:29:51.617 INFO:tasks.rados.rados.0.smithi084.stdout:2088: expect deleted 2024-03-30T12:29:51.617 INFO:tasks.rados.rados.0.smithi084.stdout:2089: read oid 37 snap 188 2024-03-30T12:29:51.617 INFO:tasks.rados.rados.0.smithi084.stdout:2089: expect deleted 2024-03-30T12:29:51.617 INFO:tasks.rados.rados.0.smithi084.stdout:2090: rollback oid 4 current snap is 225 2024-03-30T12:29:51.617 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 4 to 223 2024-03-30T12:29:51.617 INFO:tasks.rados.rados.0.smithi084.stdout:2091: rollback oid 50 current snap is 225 2024-03-30T12:29:51.617 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 50 to 205 2024-03-30T12:29:51.617 INFO:tasks.rados.rados.0.smithi084.stdout:2092: snap_create 2024-03-30T12:29:51.621 INFO:tasks.rados.rados.0.smithi084.stdout:2087: finishing rollback tid 0 to smithi08477944-39 2024-03-30T12:29:51.622 INFO:tasks.rados.rados.0.smithi084.stdout:2087: finishing rollback tid 1 to smithi08477944-39 2024-03-30T12:29:51.622 INFO:tasks.rados.rados.0.smithi084.stdout:2086: finishing rollback tid 0 to smithi08477944-38 2024-03-30T12:29:51.623 INFO:tasks.rados.rados.0.smithi084.stdout:2086: finishing rollback tid 1 to smithi08477944-38 2024-03-30T12:29:51.623 INFO:tasks.rados.rados.0.smithi084.stdout:2086: finishing rollback tid 2 to smithi08477944-38 2024-03-30T12:29:51.623 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1017 (ObjNum 602 snap 214 seq_num 602) dirty exists 2024-03-30T12:29:51.623 INFO:tasks.rados.rados.0.smithi084.stdout:2090: finishing rollback tid 0 to smithi08477944-4 2024-03-30T12:29:51.623 INFO:tasks.rados.rados.0.smithi084.stdout:2090: finishing rollback tid 1 to smithi08477944-4 2024-03-30T12:29:51.624 INFO:tasks.rados.rados.0.smithi084.stdout:2091: finishing rollback tid 1 to smithi08477944-50 2024-03-30T12:29:51.624 INFO:tasks.rados.rados.0.smithi084.stdout:2087: finishing rollback tid 2 to smithi08477944-39 2024-03-30T12:29:51.624 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 954 (ObjNum 457 snap 143 seq_num 457) dirty exists 2024-03-30T12:29:51.625 INFO:tasks.rados.rados.0.smithi084.stdout:2090: finishing rollback tid 2 to smithi08477944-4 2024-03-30T12:29:51.625 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 17493 (ObjNum 606 snap 215 seq_num 606) dirty exists 2024-03-30T12:29:51.625 INFO:tasks.rados.rados.0.smithi084.stdout:2091: finishing rollback tid 2 to smithi08477944-50 2024-03-30T12:29:51.625 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 955 (ObjNum 585 snap 199 seq_num 585) dirty exists 2024-03-30T12:29:51.671 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.417+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.671 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.438+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.671 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.456+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.671 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.474+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.671 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.493+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.671 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.516+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.672 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.542+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.672 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.565+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.672 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.582+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.672 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.609+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.672 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.637+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.672 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.655+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.672 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:51.672 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:51.672 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:51.673 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:51.673 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:51.673 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:51.673 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-mon[83709]: pgmap v447: 121 pgs: 5 active+clean+snaptrim, 110 active+clean, 6 active+clean+snaptrim_error; 424 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 6.0 MiB/s rd, 496 KiB/s wr, 9 op/s 2024-03-30T12:29:51.673 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-mon[83709]: osdmap e510: 8 total, 8 up, 8 in 2024-03-30T12:29:51.673 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:51.673 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.439+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.673 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.486+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.673 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.528+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.673 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.562+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.673 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.598+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.673 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.646+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:51.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:51.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:51.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:51.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:51.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:51.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:51 smithi084 ceph-mon[91810]: pgmap v447: 121 pgs: 5 active+clean+snaptrim, 110 active+clean, 6 active+clean+snaptrim_error; 424 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 6.0 MiB/s rd, 496 KiB/s wr, 9 op/s 2024-03-30T12:29:51.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:51 smithi084 ceph-mon[91810]: osdmap e510: 8 total, 8 up, 8 in 2024-03-30T12:29:51.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:51 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:51.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:51.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:51 smithi084 ceph-mon[89279]: pgmap v447: 121 pgs: 5 active+clean+snaptrim, 110 active+clean, 6 active+clean+snaptrim_error; 424 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 6.0 MiB/s rd, 496 KiB/s wr, 9 op/s 2024-03-30T12:29:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:51 smithi084 ceph-mon[89279]: osdmap e510: 8 total, 8 up, 8 in 2024-03-30T12:29:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:51 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:51.939 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.678+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.939 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.712+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.940 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.736+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.940 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.760+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.940 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.783+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.940 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.804+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.940 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.829+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.940 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.854+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.940 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.874+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.940 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.896+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.940 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.923+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.940 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.947+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:51.941 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.685+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.941 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.717+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.941 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.756+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.941 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.796+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.941 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.834+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.941 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.877+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:51.941 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.922+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.191 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:51.973+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.191 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.001+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.191 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.026+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.191 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.048+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.191 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.075+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.192 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.100+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.192 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.122+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.192 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.147+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.192 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.175+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.192 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.198+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.192 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.954+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.192 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:51.992+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.192 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:52.028+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.192 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:52.064+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.192 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:52.103+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.192 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:52.147+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.192 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:52.188+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.443 INFO:tasks.rados.rados.0.smithi084.stdout:2086: done (6 left) 2024-03-30T12:29:52.443 INFO:tasks.rados.rados.0.smithi084.stdout:2087: done (5 left) 2024-03-30T12:29:52.443 INFO:tasks.rados.rados.0.smithi084.stdout:2088: done (4 left) 2024-03-30T12:29:52.443 INFO:tasks.rados.rados.0.smithi084.stdout:2089: done (3 left) 2024-03-30T12:29:52.443 INFO:tasks.rados.rados.0.smithi084.stdout:2090: done (2 left) 2024-03-30T12:29:52.443 INFO:tasks.rados.rados.0.smithi084.stdout:2091: done (1 left) 2024-03-30T12:29:52.443 INFO:tasks.rados.rados.0.smithi084.stdout:2092: done (0 left) 2024-03-30T12:29:52.443 INFO:tasks.rados.rados.0.smithi084.stdout:2093: copy_from oid 12 from oid 43 current snap is 226 2024-03-30T12:29:52.444 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 226 2024-03-30T12:29:52.444 INFO:tasks.rados.rados.0.smithi084.stdout:2094: seq_num 638 ranges {737280=688128,1425408=401408} 2024-03-30T12:29:52.445 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:52.445 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:52.445 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:52.445 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:52.445 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:52.445 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:52.445 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:52.445 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:29:52.445 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:29:52.445 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:52.445 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:29:52.445 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:29:52.446 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:29:52.446 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:29:52.446 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-30T12:29:52.446 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-mon[83709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-30T12:29:52.446 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-mon[83709]: Upgrade: osd.7 is safe to restart 2024-03-30T12:29:52.446 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.219+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.446 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.241+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.446 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.264+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.446 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.285+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.446 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.309+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.446 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.332+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.447 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.355+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.447 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.384+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.447 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.406+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.447 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.427+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.447 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.451+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.447 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:52.238+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.447 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:52.291+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.447 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:52.328+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.447 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:52.358+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.447 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:52.391+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.447 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:52.435+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.450 INFO:tasks.rados.rados.0.smithi084.stdout:2094: writing smithi08477944-49 from 737280 to 1425408 tid 1 2024-03-30T12:29:52.453 INFO:tasks.rados.rados.0.smithi084.stdout:2094: writing smithi08477944-49 from 1425408 to 1826816 tid 2 2024-03-30T12:29:52.453 INFO:tasks.rados.rados.0.smithi084.stdout:2095: copy_from oid 6 from oid 21 current snap is 226 2024-03-30T12:29:52.453 INFO:tasks.rados.rados.0.smithi084.stdout:2096: snap_remove snap 220 2024-03-30T12:29:52.708 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.480+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.708 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.501+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.708 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.520+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.708 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.540+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.708 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.558+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.708 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.577+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.709 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.596+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.709 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.619+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.709 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.644+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.709 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.669+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.709 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.692+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.709 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.714+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.709 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:52.476+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.709 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:52.507+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.709 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:52.547+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.709 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:52.581+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.709 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:52.611+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.709 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:52.644+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.710 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:52.677+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:52.454+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:52.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:52.454+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:52.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:52.450+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:52.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:52.450+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:52.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:52.450+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:52.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:52.450+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:52.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:52.450+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:52.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:52.450+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:52.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:52.450+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:29:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:29:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:29:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:29:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:29:52.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:29:52.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-30T12:29:52.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[91810]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-30T12:29:52.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[91810]: Upgrade: osd.7 is safe to restart 2024-03-30T12:29:52.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:52.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:52.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:52.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:52.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:52.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:52.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:52.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:29:52.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:29:52.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:52.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:29:52.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:29:52.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:29:52.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:29:52.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-30T12:29:52.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[89279]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-30T12:29:52.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:52 smithi084 ceph-mon[89279]: Upgrade: osd.7 is safe to restart 2024-03-30T12:29:52.960 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.734+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.960 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.754+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.960 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.776+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.960 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.800+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.820+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.840+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.862+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.896+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.918+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.943+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.967+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:52.961 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:52.716+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.961 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:52.756+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.961 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:52.790+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.961 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:52.831+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.961 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:52.876+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.962 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:52.909+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:52.962 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:52.951+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:53.233 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:52.993+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.233 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.013+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.233 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.035+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.233 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.057+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.233 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.083+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.233 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.101+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.233 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.119+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.233 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.138+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.233 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.159+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.233 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.178+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.234 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.196+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.234 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.216+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.234 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.001+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:53.234 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.033+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:53.234 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.062+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:53.234 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.093+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:53.234 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.130+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:53.234 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.157+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:53.234 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.187+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:53.234 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.240+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:53.448 INFO:tasks.rados.rados.0.smithi084.stdout:2096: done (3 left) 2024-03-30T12:29:53.448 INFO:tasks.rados.rados.0.smithi084.stdout:2097: snap_remove snap 208 2024-03-30T12:29:53.487 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:53.487 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:53.487 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-mon[83709]: osdmap e511: 8 total, 8 up, 8 in 2024-03-30T12:29:53.487 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:53.487 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:53.487 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:53.487 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:53.487 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-mon[83709]: pgmap v450: 121 pgs: 5 active+clean+snaptrim, 110 active+clean, 6 active+clean+snaptrim_error; 424 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 11 MiB/s rd, 496 KiB/s wr, 3 op/s 2024-03-30T12:29:53.488 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.245+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.488 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.264+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.488 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.282+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.488 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.306+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.488 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.325+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.488 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.344+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.488 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.362+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.488 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.379+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.488 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.403+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.488 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.421+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.488 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.440+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.488 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.464+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.488 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.489+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.489 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.275+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:53.489 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.309+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:53.489 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.347+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:53.489 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.387+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:53.489 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.423+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:53.489 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.464+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:53.489 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.495+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:53.752 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.535+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:53.752 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.569+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:53.752 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.604+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:53.752 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.634+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:53.753 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.670+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:53.753 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.708+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:53.753 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.737+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:53.753 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.510+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.753 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.529+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.753 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.551+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.753 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.568+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.753 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.588+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.753 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.609+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.753 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.628+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.753 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.647+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.753 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.667+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.754 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.685+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.754 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.706+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.754 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.724+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.754 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.744+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:53.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:53.455+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:53.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:53.455+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:53.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:53.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:53.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:53 smithi084 ceph-mon[89279]: osdmap e511: 8 total, 8 up, 8 in 2024-03-30T12:29:53.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:53.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:53.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:53.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:53.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:53 smithi084 ceph-mon[89279]: pgmap v450: 121 pgs: 5 active+clean+snaptrim, 110 active+clean, 6 active+clean+snaptrim_error; 424 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 11 MiB/s rd, 496 KiB/s wr, 3 op/s 2024-03-30T12:29:53.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:53.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:53.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:53 smithi084 ceph-mon[91810]: osdmap e511: 8 total, 8 up, 8 in 2024-03-30T12:29:53.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:53.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:53.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:53.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:53.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:53 smithi084 ceph-mon[91810]: pgmap v450: 121 pgs: 5 active+clean+snaptrim, 110 active+clean, 6 active+clean+snaptrim_error; 424 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 11 MiB/s rd, 496 KiB/s wr, 3 op/s 2024-03-30T12:29:54.017 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.778+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.017 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.822+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.017 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.866+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.017 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.909+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.017 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.946+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.017 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:53.987+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.018 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.763+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.018 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.789+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.018 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.814+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.018 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.838+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.018 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.857+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.018 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.879+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.018 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.903+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.018 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.929+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.018 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.953+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.018 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:53.983+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.018 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.009+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:53.909+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:54.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:53.909+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:54.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:53.909+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:54.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:53.910+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:54.286 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.025+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.287 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.057+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.287 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.096+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.287 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.136+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.287 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.178+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.287 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.219+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.287 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.261+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.287 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.034+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.288 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.059+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.288 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.084+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.288 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.114+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.288 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.143+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.288 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.168+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.288 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.192+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.288 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.218+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.288 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.243+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.288 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.269+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.449 INFO:tasks.rados.rados.0.smithi084.stdout:2097: done (3 left) 2024-03-30T12:29:54.450 INFO:tasks.rados.rados.0.smithi084.stdout:2098: read oid 20 snap 200 2024-03-30T12:29:54.450 INFO:tasks.rados.rados.0.smithi084.stdout:2098: expect (ObjNum 565 snap 194 seq_num 565) 2024-03-30T12:29:54.450 INFO:tasks.rados.rados.0.smithi084.stdout:2099: read oid 39 snap -1 2024-03-30T12:29:54.450 INFO:tasks.rados.rados.0.smithi084.stdout:2099: expect (ObjNum 457 snap 143 seq_num 457) 2024-03-30T12:29:54.450 INFO:tasks.rados.rados.0.smithi084.stdout:2100: copy_from oid 38 from oid 25 current snap is 226 2024-03-30T12:29:54.450 INFO:tasks.rados.rados.0.smithi084.stdout:2094: finishing write tid 1 to smithi08477944-49 2024-03-30T12:29:54.450 INFO:tasks.rados.rados.0.smithi084.stdout:2094: finishing write tid 2 to smithi08477944-49 2024-03-30T12:29:54.450 INFO:tasks.rados.rados.0.smithi084.stdout:2094: finishing write tid 3 to smithi08477944-49 2024-03-30T12:29:54.450 INFO:tasks.rados.rados.0.smithi084.stdout:2094: finishing write tid 4 to smithi08477944-49 2024-03-30T12:29:54.450 INFO:tasks.rados.rados.0.smithi084.stdout:2094: oid 49 updating version 0 to 951 2024-03-30T12:29:54.450 INFO:tasks.rados.rados.0.smithi084.stdout:2094: oid 49 updating version 951 to 953 2024-03-30T12:29:54.450 INFO:tasks.rados.rados.0.smithi084.stdout:2094: oid 49 version 953 is already newer than 952 2024-03-30T12:29:54.450 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 953 (ObjNum 638 snap 226 seq_num 638) dirty exists 2024-03-30T12:29:54.450 INFO:tasks.rados.rados.0.smithi084.stdout:2094: left oid 49 (ObjNum 638 snap 226 seq_num 638) 2024-03-30T12:29:54.451 INFO:tasks.rados.rados.0.smithi084.stdout:2093: finishing copy_from racing read to smithi08477944-12 2024-03-30T12:29:54.451 INFO:tasks.rados.rados.0.smithi084.stdout:2094: done (5 left) 2024-03-30T12:29:54.451 INFO:tasks.rados.rados.0.smithi084.stdout:2101: delete oid 19 current snap is 226 2024-03-30T12:29:54.451 INFO:tasks.rados.rados.0.smithi084.stdout:2093: finishing copy_from to smithi08477944-12 2024-03-30T12:29:54.451 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 23362 (ObjNum 603 snap 215 seq_num 603) dirty exists 2024-03-30T12:29:54.451 INFO:tasks.rados.rados.0.smithi084.stdout:2095: finishing copy_from to smithi08477944-6 2024-03-30T12:29:54.451 INFO:tasks.rados.rados.0.smithi084.stdout:2095: got expected ENOENT (src dne) 2024-03-30T12:29:54.451 INFO:tasks.rados.rados.0.smithi084.stdout:2095: finishing copy_from racing read to smithi08477944-6 2024-03-30T12:29:54.466 INFO:tasks.rados.rados.0.smithi084.stdout:2099: expect (ObjNum 457 snap 143 seq_num 457) 2024-03-30T12:29:54.501 INFO:tasks.rados.rados.0.smithi084.stdout:2098: expect (ObjNum 565 snap 194 seq_num 565) 2024-03-30T12:29:54.541 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:54.541 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:54.541 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-mon[83709]: osdmap e512: 8 total, 8 up, 8 in 2024-03-30T12:29:54.542 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:54.542 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-30T12:29:54.542 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:29:54.542 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:54.542 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:54.542 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:54.542 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:54.542 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.300+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.542 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.344+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.543 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.381+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.543 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.423+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.543 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.467+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.543 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.510+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.543 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.292+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.543 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.315+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.543 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.334+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.543 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.357+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.543 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.388+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.543 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.407+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.543 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.429+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.543 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.451+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.544 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.488+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.544 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.518+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.544 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.546+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:54.475+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:54.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:54.476+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-mon[91810]: osdmap e512: 8 total, 8 up, 8 in 2024-03-30T12:29:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-30T12:29:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:29:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:54.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:54.460+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:54.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:54.460+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:54.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:54.461+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:54.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:54.462+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:54.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:54.462+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:54.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:54.492+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:54.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:54.493+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:54.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:54.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:54.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-mon[89279]: osdmap e512: 8 total, 8 up, 8 in 2024-03-30T12:29:54.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:54.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-30T12:29:54.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:29:54.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:54.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:54.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:54.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:54.799 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.551+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.799 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.589+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.799 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.636+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.799 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.675+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.799 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.713+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.799 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.747+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.799 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.787+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:54.799 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.577+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.603+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.626+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.654+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.679+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.701+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.719+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.740+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.762+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.781+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:54.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.806+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.053 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.827+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.053 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.845+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.053 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.868+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.053 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.886+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.053 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.917+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.053 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.939+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.054 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.965+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.054 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:54.988+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.054 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.011+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.054 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.041+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.054 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.817+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.054 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.853+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.054 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.891+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.054 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.930+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.054 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.956+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.054 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:54.995+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.055 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.034+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.082 INFO:tasks.rados.rados.0.smithi084.stdout:2100: finishing copy_from racing read to smithi08477944-38 2024-03-30T12:29:55.083 INFO:tasks.rados.rados.0.smithi084.stdout:2100: finishing copy_from to smithi08477944-38 2024-03-30T12:29:55.083 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 903 (ObjNum 525 snap 171 seq_num 525) dirty exists 2024-03-30T12:29:55.083 INFO:tasks.rados.rados.0.smithi084.stdout:2093: done (5 left) 2024-03-30T12:29:55.083 INFO:tasks.rados.rados.0.smithi084.stdout:2095: done (4 left) 2024-03-30T12:29:55.083 INFO:tasks.rados.rados.0.smithi084.stdout:2098: done (3 left) 2024-03-30T12:29:55.083 INFO:tasks.rados.rados.0.smithi084.stdout:2099: done (2 left) 2024-03-30T12:29:55.083 INFO:tasks.rados.rados.0.smithi084.stdout:2100: done (1 left) 2024-03-30T12:29:55.083 INFO:tasks.rados.rados.0.smithi084.stdout:2101: done (0 left) 2024-03-30T12:29:55.083 INFO:tasks.rados.rados.0.smithi084.stdout:2102: snap_remove snap 205 2024-03-30T12:29:55.309 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.072+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.310 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.108+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.310 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.142+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.310 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.180+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.310 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.212+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.310 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.246+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.310 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.284+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.310 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.317+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.310 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.062+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.310 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.088+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.311 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.108+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.311 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.128+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.311 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.150+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.311 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.167+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.311 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.187+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.311 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.207+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.311 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.226+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.311 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.246+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.311 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.264+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.311 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.284+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.311 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.305+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.567 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.326+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.568 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.343+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.568 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.366+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.568 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.388+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.568 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.407+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.568 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.429+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.568 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.452+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.568 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.480+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.568 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.499+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.568 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.518+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.568 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.536+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.568 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.556+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.569 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-mon[83709]: Upgrade: Updating osd.7 2024-03-30T12:29:55.569 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-mon[83709]: Deploying daemon osd.7 on smithi162 2024-03-30T12:29:55.569 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-mon[83709]: osdmap e513: 8 total, 8 up, 8 in 2024-03-30T12:29:55.569 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:55.569 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:55.569 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:55.569 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:55.569 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:55.569 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:55.569 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-mon[83709]: pgmap v453: 121 pgs: 5 active+clean+snaptrim, 110 active+clean, 6 active+clean+snaptrim_error; 426 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 5.6 MiB/s rd, 0 B/s wr, 3 op/s 2024-03-30T12:29:55.569 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:55.570 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.355+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.570 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.391+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.570 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.424+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.570 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.458+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.570 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.491+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.570 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.516+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.570 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.552+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-mon[91810]: Upgrade: Updating osd.7 2024-03-30T12:29:55.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-mon[91810]: Deploying daemon osd.7 on smithi162 2024-03-30T12:29:55.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-mon[91810]: osdmap e513: 8 total, 8 up, 8 in 2024-03-30T12:29:55.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:55.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:55.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:55.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:55.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:55.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:55.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-mon[91810]: pgmap v453: 121 pgs: 5 active+clean+snaptrim, 110 active+clean, 6 active+clean+snaptrim_error; 426 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 5.6 MiB/s rd, 0 B/s wr, 3 op/s 2024-03-30T12:29:55.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:55.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-mon[89279]: Upgrade: Updating osd.7 2024-03-30T12:29:55.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-mon[89279]: Deploying daemon osd.7 on smithi162 2024-03-30T12:29:55.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-mon[89279]: osdmap e513: 8 total, 8 up, 8 in 2024-03-30T12:29:55.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:55.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:55.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:55.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:55.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:55.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:55.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-mon[89279]: pgmap v453: 121 pgs: 5 active+clean+snaptrim, 110 active+clean, 6 active+clean+snaptrim_error; 426 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 5.6 MiB/s rd, 0 B/s wr, 3 op/s 2024-03-30T12:29:55.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:55.806 INFO:tasks.rados.rados.0.smithi084.stdout:2102: done (0 left) 2024-03-30T12:29:55.806 INFO:tasks.rados.rados.0.smithi084.stdout:2103: read oid 10 snap -1 2024-03-30T12:29:55.806 INFO:tasks.rados.rados.0.smithi084.stdout:2103: expect deleted 2024-03-30T12:29:55.806 INFO:tasks.rados.rados.0.smithi084.stdout:2104: snap_create 2024-03-30T12:29:55.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.575+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.598+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.618+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.638+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.664+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.683+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.704+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.727+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.747+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.824 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.766+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.825 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.786+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.825 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.809+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:55.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.585+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.619+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.651+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.690+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.724+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.760+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.796+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:55.825 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.831+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.082 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.843+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.083 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.863+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.083 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.884+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.083 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.905+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.083 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.926+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.083 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.950+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.083 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.970+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.083 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:55.995+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.083 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.019+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.083 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.044+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.083 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.070+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.083 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.090+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.084 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.861+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.084 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.904+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.084 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.942+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.084 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:55.986+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.084 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:56.035+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.084 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:56.071+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:55.815+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:56.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:55.815+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:56.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:55.828+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:56.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:55.828+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:56.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:55.828+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:56.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:55.829+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:56.340 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:56.110+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.340 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:56.144+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.340 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:56.185+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.340 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:56.229+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.341 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:56.271+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.341 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:56.305+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.341 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:56.337+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.341 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.113+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.341 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.139+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.341 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.161+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.341 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.180+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.341 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.201+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.341 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.225+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.342 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.245+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.342 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.266+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.342 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.286+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.342 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.308+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.342 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.329+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.610 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:56.385+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.610 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:56.418+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.610 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:56.459+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.610 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:56.497+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.610 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:56.540+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.610 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:56.588+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.610 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.356+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.381+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.413+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.431+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.451+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.473+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.494+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.513+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.533+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.550+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.570+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.590+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.617+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.816 INFO:tasks.rados.rados.0.smithi084.stdout:2103: done (1 left) 2024-03-30T12:29:56.816 INFO:tasks.rados.rados.0.smithi084.stdout:2104: done (0 left) 2024-03-30T12:29:56.816 INFO:tasks.rados.rados.0.smithi084.stdout:2105: read oid 28 snap 218 2024-03-30T12:29:56.816 INFO:tasks.rados.rados.0.smithi084.stdout:2105: expect (ObjNum 498 snap 156 seq_num 498) 2024-03-30T12:29:56.817 INFO:tasks.rados.rados.0.smithi084.stdout:2106: snap_remove snap 216 2024-03-30T12:29:56.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-mon[83709]: osdmap e514: 8 total, 8 up, 8 in 2024-03-30T12:29:56.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:56.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:56.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:56.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:56.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:56.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:56.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-mon[83709]: pgmap v455: 121 pgs: 5 active+clean+snaptrim, 110 active+clean, 6 active+clean+snaptrim_error; 428 MiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 534 KiB/s rd, 368 KiB/s wr, 5 op/s 2024-03-30T12:29:56.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.640+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.665+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.685+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.705+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.729+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.752+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.780+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.802+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.834+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.872 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.858+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:56.872 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:56.622+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.872 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:56.657+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.872 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:56.695+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.872 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:56.731+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.872 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:56.756+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.872 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:56.795+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:56.872 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:56.845+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.139 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:56.879+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.139 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:56.923+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.139 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:56.962+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.140 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:57.003+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.140 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:57.051+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.140 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:57.081+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.140 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:57.118+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.140 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.889+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.140 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.912+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.140 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.934+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.140 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.965+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.141 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:56.987+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.141 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.011+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.141 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.038+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.141 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.075+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.141 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.097+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.141 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.122+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.141 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.145+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:56.826+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:57.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:56.827+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:56 smithi084 ceph-mon[89279]: osdmap e514: 8 total, 8 up, 8 in 2024-03-30T12:29:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:56 smithi084 ceph-mon[89279]: pgmap v455: 121 pgs: 5 active+clean+snaptrim, 110 active+clean, 6 active+clean+snaptrim_error; 428 MiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 534 KiB/s rd, 368 KiB/s wr, 5 op/s 2024-03-30T12:29:57.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:56 smithi084 ceph-mon[91810]: osdmap e514: 8 total, 8 up, 8 in 2024-03-30T12:29:57.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:57.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:57.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:57.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:57.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:57.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:57.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:56 smithi084 ceph-mon[91810]: pgmap v455: 121 pgs: 5 active+clean+snaptrim, 110 active+clean, 6 active+clean+snaptrim_error; 428 MiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 534 KiB/s rd, 368 KiB/s wr, 5 op/s 2024-03-30T12:29:57.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:56.822+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:57.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:56.822+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:57.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:56.822+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:57.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:56.822+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:57.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:56.822+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:57.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:56.823+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:57.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:56.823+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:57.412 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:57.157+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.412 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:57.196+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.412 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:57.241+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.412 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:57.277+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.412 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:57.314+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.412 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:57.354+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.412 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:57.394+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.412 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.171+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.412 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.197+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.412 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.224+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.413 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.244+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.413 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.272+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.413 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.301+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.413 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.325+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.413 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.347+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.413 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.370+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.413 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.390+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.663 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:57.434+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.663 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:57.475+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.663 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:57.512+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.663 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:57.539+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.663 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:57.581+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.663 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:57.621+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.663 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:57.666+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.421+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.448+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.469+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.490+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.514+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.538+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.562+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.587+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.616+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.645+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.822 INFO:tasks.rados.rados.0.smithi084.stdout:2106: done (1 left) 2024-03-30T12:29:57.823 INFO:tasks.rados.rados.0.smithi084.stdout:2107: rmattr oid 17 current snap is 227 2024-03-30T12:29:57.823 INFO:tasks.rados.rados.0.smithi084.stdout:2107: done (1 left) 2024-03-30T12:29:57.823 INFO:tasks.rados.rados.0.smithi084.stdout:2108: copy_from oid 26 from oid 25 current snap is 227 2024-03-30T12:29:57.823 INFO:tasks.rados.rados.0.smithi084.stdout:2105: expect (ObjNum 498 snap 156 seq_num 498) 2024-03-30T12:29:57.860 INFO:tasks.rados.rados.0.smithi084.stdout:2105: done (1 left) 2024-03-30T12:29:57.860 INFO:tasks.rados.rados.0.smithi084.stdout:2109: read oid 38 snap -1 2024-03-30T12:29:57.861 INFO:tasks.rados.rados.0.smithi084.stdout:2109: expect (ObjNum 525 snap 171 seq_num 525) 2024-03-30T12:29:57.861 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 227 2024-03-30T12:29:57.861 INFO:tasks.rados.rados.0.smithi084.stdout:2110: seq_num 640 ranges {4653056=729088,5382144=401408} 2024-03-30T12:29:57.892 INFO:tasks.rados.rados.0.smithi084.stdout:2110: writing smithi08477944-40 from 4653056 to 5382144 tid 1 2024-03-30T12:29:57.895 INFO:tasks.rados.rados.0.smithi084.stdout:2110: writing smithi08477944-40 from 5382144 to 5783552 tid 2 2024-03-30T12:29:57.895 INFO:tasks.rados.rados.0.smithi084.stdout:2111: copy_from oid 46 from oid 29 current snap is 227 2024-03-30T12:29:57.895 INFO:tasks.rados.rados.0.smithi084.stdout:2112: copy_from oid 21 from oid 23 current snap is 227 2024-03-30T12:29:57.895 INFO:tasks.rados.rados.0.smithi084.stdout:2113: read oid 35 snap -1 2024-03-30T12:29:57.895 INFO:tasks.rados.rados.0.smithi084.stdout:2113: expect (ObjNum 540 snap 185 seq_num 540) 2024-03-30T12:29:57.895 INFO:tasks.rados.rados.0.smithi084.stdout:2114: delete oid 34 current snap is 227 2024-03-30T12:29:57.904 INFO:tasks.rados.rados.0.smithi084.stdout:2114: done (6 left) 2024-03-30T12:29:57.904 INFO:tasks.rados.rados.0.smithi084.stdout:2115: snap_remove snap 214 2024-03-30T12:29:57.923 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.671+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.924 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.700+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.924 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.722+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.924 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.746+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.924 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.780+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.924 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.809+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.924 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.855+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.924 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.897+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:57.924 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:57.925 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:57.925 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:57.925 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:57.925 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-mon[83709]: osdmap e515: 8 total, 8 up, 8 in 2024-03-30T12:29:57.925 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:57.925 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:57.926 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:57.700+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.926 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:57.744+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.926 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:57.774+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.926 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:57.812+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:57.926 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:57.867+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:58.177 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:57.949+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:58.177 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:57.988+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:58.177 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:58.040+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:58.177 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:58.101+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:58.177 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:58.148+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:58.177 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.931+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.177 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.959+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.178 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:57.984+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.178 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.013+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.178 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.055+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.178 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.093+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.178 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.119+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.178 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.152+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:57.831+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:58.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:57.831+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:58.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:58.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:58.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:58.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:58.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:57 smithi084 ceph-mon[89279]: osdmap e515: 8 total, 8 up, 8 in 2024-03-30T12:29:58.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:58.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:58.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:58.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:58.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:58.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:58.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:57 smithi084 ceph-mon[91810]: osdmap e515: 8 total, 8 up, 8 in 2024-03-30T12:29:58.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:58.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:58.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:57.829+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:58.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:57.830+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:58.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:57.830+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:58.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:57.830+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:58.442 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.184+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.443 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.212+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.443 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.243+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.443 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.276+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.443 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.304+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.443 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.336+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.443 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.365+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.443 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.396+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.443 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.425+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.443 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:29:58 smithi162 systemd[1]: Stopping Ceph osd.7 for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:29:58.444 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:58.185+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:58.444 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:58.222+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:58.444 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:58.285+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:58.444 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:58.334+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:58.444 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:58.395+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:58.444 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:58.449+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:58.706 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:58.494+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:58.707 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:58.543+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:58.707 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:58.588+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:58.707 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:58.628+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:58.707 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:58.664+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:58.707 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:58.696+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:58.707 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.460+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.707 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.496+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.707 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.531+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.707 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.560+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.708 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.588+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.708 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.619+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.708 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.658+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.708 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.686+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.708 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.715+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.841 INFO:tasks.rados.rados.0.smithi084.stdout:2115: done (6 left) 2024-03-30T12:29:58.842 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 227 2024-03-30T12:29:58.842 INFO:tasks.rados.rados.0.smithi084.stdout:2116: seq_num 642 ranges {3121152=761856,3883008=401408} 2024-03-30T12:29:58.863 INFO:tasks.rados.rados.0.smithi084.stdout:2116: writing smithi08477944-50 from 3121152 to 3883008 tid 1 2024-03-30T12:29:58.866 INFO:tasks.rados.rados.0.smithi084.stdout:2116: writing smithi08477944-50 from 3883008 to 4284416 tid 2 2024-03-30T12:29:58.866 INFO:tasks.rados.rados.0.smithi084.stdout:2117: snap_remove snap 218 2024-03-30T12:29:58.965 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:58.741+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:58.966 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:58.783+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:58.966 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:58.820+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:58.966 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:58.876+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:58.966 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:58.911+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:58.966 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:58.946+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:58.966 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[52743]: 2024-03-30T12:29:58.776+0000 7f7a6a2ba700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:29:58.966 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[52743]: 2024-03-30T12:29:58.776+0000 7f7a6a2ba700 -1 osd.7 516 *** Got signal Terminated *** 2024-03-30T12:29:58.966 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[52743]: 2024-03-30T12:29:58.776+0000 7f7a6a2ba700 -1 osd.7 516 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T12:29:58.967 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.740+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.967 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.758+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.967 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.797+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.967 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.829+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.967 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.869+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.967 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.888+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.967 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.904+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.967 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.922+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.967 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.941+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.967 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.962+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:58.967 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-mon[83709]: osdmap e516: 8 total, 8 up, 8 in 2024-03-30T12:29:58.967 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:58.968 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:58.968 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:58.968 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:58.968 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:58.968 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:58.968 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-mon[83709]: pgmap v458: 121 pgs: 5 active+clean+snaptrim, 110 active+clean, 6 active+clean+snaptrim_error; 440 MiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 15 MiB/s rd, 3.2 MiB/s wr, 7 op/s 2024-03-30T12:29:58.968 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-mon[83709]: osd.7 marked itself down and dead 2024-03-30T12:29:59.222 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:58.975+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.222 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.004+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.222 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.029+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.222 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.058+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.222 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.084+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.222 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.111+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.222 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.139+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.222 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.173+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.222 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.203+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.223 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.981+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.223 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:58.996+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.223 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.013+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.223 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.032+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.223 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.047+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.223 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.065+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.223 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.080+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.223 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.096+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.223 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.112+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.223 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.128+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.223 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.146+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.224 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.166+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.224 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.182+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.224 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.198+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.224 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.214+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:58.853+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:59.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:58.854+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:59.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:58 smithi084 ceph-mon[91810]: osdmap e516: 8 total, 8 up, 8 in 2024-03-30T12:29:59.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:59.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:59.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:59.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:59.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:59.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:59.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:58 smithi084 ceph-mon[91810]: pgmap v458: 121 pgs: 5 active+clean+snaptrim, 110 active+clean, 6 active+clean+snaptrim_error; 440 MiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 15 MiB/s rd, 3.2 MiB/s wr, 7 op/s 2024-03-30T12:29:59.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:58 smithi084 ceph-mon[91810]: osd.7 marked itself down and dead 2024-03-30T12:29:59.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:58.852+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:59.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:58.853+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:59.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:58.857+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:29:59.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:58.857+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:59.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:58.857+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:59.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:58 smithi084 ceph-mon[89279]: osdmap e516: 8 total, 8 up, 8 in 2024-03-30T12:29:59.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:59.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:59.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:59.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:29:59.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:59.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:59.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:58 smithi084 ceph-mon[89279]: pgmap v458: 121 pgs: 5 active+clean+snaptrim, 110 active+clean, 6 active+clean+snaptrim_error; 440 MiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 15 MiB/s rd, 3.2 MiB/s wr, 7 op/s 2024-03-30T12:29:59.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:58 smithi084 ceph-mon[89279]: osd.7 marked itself down and dead 2024-03-30T12:29:59.483 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.235+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.483 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.251+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.483 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.280+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.483 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.312+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.483 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.346+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.483 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.388+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.483 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.422+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.483 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.454+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.483 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.230+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.484 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.248+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.484 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.265+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.484 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.282+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.484 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.297+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.484 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.314+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.484 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.334+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.484 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.355+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.484 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.370+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.484 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.386+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.484 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.403+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.484 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.421+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.484 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.441+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.484 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.458+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.484 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.475+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.617 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:29:59] "GET /metrics HTTP/1.1" 200 36255 "" "Prometheus/2.43.0" 2024-03-30T12:29:59.617 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-03-30T12:29:59.744 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:29:59 smithi162 podman[103478]: 2024-03-30 12:29:59.526066006 +0000 UTC m=+0.933836266 container died e3246b3bc88be5107f232ed14d62d8f88d52edf09b6e84bf88e50b97790d0d1d (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-f14b568, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-03-30T12:29:59.744 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.490+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.744 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.527+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.744 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.558+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.745 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.575+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.745 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.657+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.745 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.686+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.745 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.717+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.745 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.737+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.745 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.494+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.745 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.513+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.745 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.531+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.745 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.550+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.745 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.569+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.745 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.649+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.745 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.670+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.746 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.686+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.746 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.702+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.746 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.718+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.746 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.735+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.746 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.752+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.872 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-mon[91810]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T12:29:59.873 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-mon[91810]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-03-30T12:29:59.873 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-mon[91810]: osdmap e517: 8 total, 7 up, 8 in 2024-03-30T12:29:59.873 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:59.873 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:59.873 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:59.873 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:59.873 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:59.873 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-mon[91810]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:29:59.873 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:59.873 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:29:59.873 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-mon[89279]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T12:29:59.874 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-mon[89279]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-03-30T12:29:59.874 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-mon[89279]: osdmap e517: 8 total, 7 up, 8 in 2024-03-30T12:29:59.874 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:59.874 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:59.874 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:59.874 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:59.874 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:59.874 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-mon[89279]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:29:59.874 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:59.874 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:29:59.876 INFO:tasks.rados.rados.0.smithi084.stdout:2110: finishing write tid 1 to smithi08477944-40 2024-03-30T12:29:59.877 INFO:tasks.rados.rados.0.smithi084.stdout:2110: finishing write tid 2 to smithi08477944-40 2024-03-30T12:29:59.877 INFO:tasks.rados.rados.0.smithi084.stdout:2110: finishing write tid 3 to smithi08477944-40 2024-03-30T12:29:59.877 INFO:tasks.rados.rados.0.smithi084.stdout:2112: finishing copy_from to smithi08477944-21 2024-03-30T12:29:59.877 INFO:tasks.rados.rados.0.smithi084.stdout:2112: got expected ENOENT (src dne) 2024-03-30T12:29:59.877 INFO:tasks.rados.rados.0.smithi084.stdout:2113: expect (ObjNum 540 snap 185 seq_num 540) 2024-03-30T12:29:59.996 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.769+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.997 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.785+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.997 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.844+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.997 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.861+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.997 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.900+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.997 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.922+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.997 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.937+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.997 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.953+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.997 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.971+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.997 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:29:59.987+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:29:59.997 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-mon[83709]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T12:29:59.997 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-mon[83709]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-03-30T12:29:59.998 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-mon[83709]: osdmap e517: 8 total, 7 up, 8 in 2024-03-30T12:29:59.998 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:29:59.998 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:29:59.998 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:29:59.998 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:29:59.998 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:29:59.998 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-mon[83709]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:29:59.998 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:29:59.998 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:29:59.998 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.767+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.998 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.837+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.999 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.870+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.999 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.902+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.999 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.928+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.999 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.960+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:29:59.999 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:29:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:29:59.987+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:00.036 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T12:30:00.036 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (9m) 2m ago 10m 25.3M - 0.25.0 c8568f914cd2 6765ce007f39 2024-03-30T12:30:00.036 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi162 *:3000 running (9m) 15s ago 9m 91.0M - 9.4.7 954c08fa6188 ff2ec7518619 2024-03-30T12:30:00.036 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (11m) 2m ago 11m 15.1M - 18.2.2-1051-gf14b5682 c8fb09e16a7d a9c2e74ca2a3 2024-03-30T12:30:00.036 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi162 running (11m) 15s ago 11m 21.8M - 18.2.2-1051-gf14b5682 c8fb09e16a7d ee1770ef5edd 2024-03-30T12:30:00.036 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi162 *:8443,9283,8765 running (5m) 15s ago 14m 451M - 19.0.0-1864-g5dc2ea30 548196a1a838 eec968f3fcc6 2024-03-30T12:30:00.036 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (6m) 2m ago 16m 512M - 19.0.0-1864-g5dc2ea30 548196a1a838 9a2aba19dffc 2024-03-30T12:30:00.036 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (5m) 2m ago 16m 55.0M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 a0811f2ae47d 2024-03-30T12:30:00.037 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi162 running (4m) 15s ago 14m 52.1M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 149ae6649e0c 2024-03-30T12:30:00.037 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (4m) 2m ago 14m 47.4M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 f79eca93cddd 2024-03-30T12:30:00.037 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (9m) 2m ago 9m 16.9M - 1.5.0 0da6a335fe13 66844bed39e8 2024-03-30T12:30:00.037 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi162 *:9100 running (9m) 15s ago 9m 15.1M - 1.5.0 0da6a335fe13 3d6e28b2348d 2024-03-30T12:30:00.037 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (3m) 2m ago 14m 182M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 c91eea4f8484 2024-03-30T12:30:00.037 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (3m) 2m ago 13m 109M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 7518832f6b4a 2024-03-30T12:30:00.037 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (2m) 2m ago 13m 123M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 647dd862762d 2024-03-30T12:30:00.037 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (2m) 2m ago 13m 15.1M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 c088a701b71b 2024-03-30T12:30:00.037 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi162 running (92s) 15s ago 12m 323M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 4197b37d2bb8 2024-03-30T12:30:00.037 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi162 running (67s) 15s ago 12m 344M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 cd8795ac188a 2024-03-30T12:30:00.037 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi162 running (25s) 15s ago 11m 12.8M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 40ed6df81194 2024-03-30T12:30:00.037 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi162 running (11m) 15s ago 11m 312M 2480M 18.2.2-1051-gf14b5682 c8fb09e16a7d e3246b3bc88b 2024-03-30T12:30:00.037 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi162 *:9095 running (5m) 15s ago 10m 55.9M - 2.43.0 a07b618ecd1d bd7d323e4b47 2024-03-30T12:30:00.045 INFO:tasks.rados.rados.0.smithi084.stdout:2112: finishing copy_from racing read to smithi08477944-21 2024-03-30T12:30:00.045 INFO:tasks.rados.rados.0.smithi084.stdout:2110: finishing write tid 4 to smithi08477944-40 2024-03-30T12:30:00.045 INFO:tasks.rados.rados.0.smithi084.stdout:2110: oid 40 updating version 0 to 17493 2024-03-30T12:30:00.045 INFO:tasks.rados.rados.0.smithi084.stdout:2110: oid 40 version 17493 is already newer than 17492 2024-03-30T12:30:00.046 INFO:tasks.rados.rados.0.smithi084.stdout:2110: oid 40 version 17493 is already newer than 17491 2024-03-30T12:30:00.046 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 17493 (ObjNum 640 snap 227 seq_num 640) dirty exists 2024-03-30T12:30:00.046 INFO:tasks.rados.rados.0.smithi084.stdout:2110: left oid 40 (ObjNum 640 snap 227 seq_num 640) 2024-03-30T12:30:00.046 INFO:tasks.rados.rados.0.smithi084.stdout:2108: finishing copy_from racing read to smithi08477944-26 2024-03-30T12:30:00.046 INFO:tasks.rados.rados.0.smithi084.stdout:2110: done (7 left) 2024-03-30T12:30:00.046 INFO:tasks.rados.rados.0.smithi084.stdout:2112: done (6 left) 2024-03-30T12:30:00.046 INFO:tasks.rados.rados.0.smithi084.stdout:2113: done (5 left) 2024-03-30T12:30:00.046 INFO:tasks.rados.rados.0.smithi084.stdout:2117: done (4 left) 2024-03-30T12:30:00.046 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 227 2024-03-30T12:30:00.046 INFO:tasks.rados.rados.0.smithi084.stdout:2109: expect (ObjNum 525 snap 171 seq_num 525) 2024-03-30T12:30:00.253 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.016+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:00.253 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.035+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:00.253 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.065+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:00.253 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.113+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:00.253 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.198+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:00.253 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.223+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:00.253 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.245+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:00.253 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.004+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.019+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.037+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.054+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.069+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.085+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.190+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.209+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.225+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.243+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.261+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.255 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:59.895+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:00.255 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:29:59.895+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:00.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:59.881+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:00.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:59.882+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:00.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:29:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:29:59.884+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:00.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:29:59.999+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Possible data damage: 6 pgs snaptrim_error 2024-03-30T12:30:00.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:29:59.999+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : [WRN] OSD_DOWN: 1 osds down 2024-03-30T12:30:00.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:29:59.999+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : osd.7 (root=default,host=smithi162) is down 2024-03-30T12:30:00.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:29:59.999+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : [WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-03-30T12:30:00.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:29:59.999+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : all OSDs are running squid or later but require_osd_release < squid 2024-03-30T12:30:00.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:29:59.999+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : [ERR] PG_DAMAGED: Possible data damage: 6 pgs snaptrim_error 2024-03-30T12:30:00.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:29:59.999+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : pg 5.3 is active+clean+snaptrim_error, acting [0,3,6] 2024-03-30T12:30:00.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:29:59.999+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : pg 5.5 is active+clean+snaptrim_error, acting [0,1,4] 2024-03-30T12:30:00.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:29:59.999+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : pg 5.8 is active+clean+snaptrim_error, acting [2,0,1] 2024-03-30T12:30:00.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:29:59.999+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : pg 5.a is active+clean+snaptrim_error, acting [2,4,3] 2024-03-30T12:30:00.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:29:59.999+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : pg 5.b is active+clean+snaptrim_error, acting [2,0,5] 2024-03-30T12:30:00.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:29:59.999+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : pg 5.d is active+clean+snaptrim_error, acting [2,7,5] 2024-03-30T12:30:00.505 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.272+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:00.505 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.300+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:00.505 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.317+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:00.505 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.347+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:00.505 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.440+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:00.505 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.456+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:00.505 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.484+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:00.505 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.277+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.506 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.294+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.506 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.314+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.506 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.331+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.506 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.348+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.506 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.427+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.506 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.445+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.506 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.464+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.506 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.481+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.506 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.496+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.506 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.513+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.549 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-30T12:30:00.549 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-03-30T12:30:00.549 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 3 2024-03-30T12:30:00.549 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:30:00.549 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-03-30T12:30:00.550 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 2 2024-03-30T12:30:00.550 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:30:00.550 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-03-30T12:30:00.550 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 7 2024-03-30T12:30:00.550 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:30:00.550 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-03-30T12:30:00.550 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 2 2024-03-30T12:30:00.550 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:30:00.550 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-03-30T12:30:00.550 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 2, 2024-03-30T12:30:00.550 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 12 2024-03-30T12:30:00.550 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-30T12:30:00.550 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-30T12:30:00.762 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.530+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.762 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.548+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.762 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.562+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.763 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.578+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.763 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.598+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.763 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.615+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.763 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.634+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.763 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.650+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.763 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.668+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.763 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.684+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.763 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.703+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:00.763 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.514+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:00.764 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.541+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:00.764 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.577+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:00.764 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.594+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:00.764 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.623+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:00.764 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.651+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:00.764 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.680+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:00.764 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.709+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.010 INFO:tasks.rados.rados.0.smithi084.stdout:2111: finishing copy_from to smithi08477944-46 2024-03-30T12:30:01.010 INFO:tasks.rados.rados.0.smithi084.stdout:2111: got expected ENOENT (src dne) 2024-03-30T12:30:01.010 INFO:tasks.rados.rados.0.smithi084.stdout:2111: finishing copy_from racing read to smithi08477944-46 2024-03-30T12:30:01.010 INFO:tasks.rados.rados.0.smithi084.stdout:2118: seq_num 643 ranges {0=778240,778240=401408} 2024-03-30T12:30:01.014 INFO:tasks.rados.rados.0.smithi084.stdout:2118: writing smithi08477944-24 from 0 to 778240 tid 1 2024-03-30T12:30:01.014 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.771+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.014 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.802+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.014 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.830+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.015 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.863+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.015 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.881+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.015 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.909+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.015 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:00.994+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.015 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.023+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.015 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.722+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.015 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.782+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.015 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.798+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.015 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.814+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.016 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.830+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.016 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.845+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.016 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.861+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.016 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.879+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.016 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.899+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.016 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.957+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.016 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:00.972+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.016 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.002+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.016 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.018+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:01.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:01.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:01.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-mon[83709]: osdmap e518: 8 total, 7 up, 8 in 2024-03-30T12:30:01.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:01.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:01.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-mon[83709]: Health detail: HEALTH_ERR 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Possible data damage: 6 pgs snaptrim_error 2024-03-30T12:30:01.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-mon[83709]: [WRN] OSD_DOWN: 1 osds down 2024-03-30T12:30:01.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-mon[83709]: osd.7 (root=default,host=smithi162) is down 2024-03-30T12:30:01.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-mon[83709]: [WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-03-30T12:30:01.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-mon[83709]: all OSDs are running squid or later but require_osd_release < squid 2024-03-30T12:30:01.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-mon[83709]: [ERR] PG_DAMAGED: Possible data damage: 6 pgs snaptrim_error 2024-03-30T12:30:01.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-mon[83709]: pg 5.3 is active+clean+snaptrim_error, acting [0,3,6] 2024-03-30T12:30:01.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-mon[83709]: pg 5.5 is active+clean+snaptrim_error, acting [0,1,4] 2024-03-30T12:30:01.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-mon[83709]: pg 5.8 is active+clean+snaptrim_error, acting [2,0,1] 2024-03-30T12:30:01.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-mon[83709]: pg 5.a is active+clean+snaptrim_error, acting [2,4,3] 2024-03-30T12:30:01.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-mon[83709]: pg 5.b is active+clean+snaptrim_error, acting [2,0,5] 2024-03-30T12:30:01.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-mon[83709]: pg 5.d is active+clean+snaptrim_error, acting [2,7,5] 2024-03-30T12:30:01.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-mon[83709]: from='client.54262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:30:01.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/3931062026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:01.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:00 smithi162 ceph-mon[83709]: pgmap v461: 121 pgs: 1 active+undersized+degraded, 10 active+undersized, 10 peering, 13 stale+active+clean, 5 active+clean+snaptrim, 76 active+clean, 6 active+clean+snaptrim_error; 451 MiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 18 MiB/s rd, 5.7 MiB/s wr, 6 op/s; 1/918 objects degraded (0.109%) 2024-03-30T12:30:01.019 INFO:tasks.rados.rados.0.smithi084.stdout:2118: writing smithi08477944-24 from 778240 to 1179648 tid 2 2024-03-30T12:30:01.020 INFO:tasks.rados.rados.0.smithi084.stdout:2109: done (4 left) 2024-03-30T12:30:01.020 INFO:tasks.rados.rados.0.smithi084.stdout:2111: done (3 left) 2024-03-30T12:30:01.020 INFO:tasks.rados.rados.0.smithi084.stdout:2119: copy_from oid 36 from oid 31 current snap is 227 2024-03-30T12:30:01.020 INFO:tasks.rados.rados.0.smithi084.stdout:2108: finishing copy_from to smithi08477944-26 2024-03-30T12:30:01.020 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 903 (ObjNum 525 snap 171 seq_num 525) dirty exists 2024-03-30T12:30:01.020 INFO:tasks.rados.rados.0.smithi084.stdout:2116: finishing write tid 1 to smithi08477944-50 2024-03-30T12:30:01.020 INFO:tasks.rados.rados.0.smithi084.stdout:2116: finishing write tid 2 to smithi08477944-50 2024-03-30T12:30:01.020 INFO:tasks.rados.rados.0.smithi084.stdout:2108: done (3 left) 2024-03-30T12:30:01.020 INFO:tasks.rados.rados.0.smithi084.stdout:2120: rollback oid 2 current snap is 227 2024-03-30T12:30:01.020 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 2 to 224 2024-03-30T12:30:01.020 INFO:tasks.rados.rados.0.smithi084.stdout:2116: finishing write tid 3 to smithi08477944-50 2024-03-30T12:30:01.020 INFO:tasks.rados.rados.0.smithi084.stdout:2116: finishing write tid 4 to smithi08477944-50 2024-03-30T12:30:01.020 INFO:tasks.rados.rados.0.smithi084.stdout:2116: oid 50 updating version 0 to 959 2024-03-30T12:30:01.021 INFO:tasks.rados.rados.0.smithi084.stdout:2116: oid 50 version 959 is already newer than 957 2024-03-30T12:30:01.021 INFO:tasks.rados.rados.0.smithi084.stdout:2116: oid 50 version 959 is already newer than 958 2024-03-30T12:30:01.021 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 959 (ObjNum 642 snap 227 seq_num 642) dirty exists 2024-03-30T12:30:01.021 INFO:tasks.rados.rados.0.smithi084.stdout:2116: left oid 50 (ObjNum 642 snap 227 seq_num 642) 2024-03-30T12:30:01.021 INFO:tasks.rados.rados.0.smithi084.stdout:2116: done (3 left) 2024-03-30T12:30:01.021 INFO:tasks.rados.rados.0.smithi084.stdout:2121: delete oid 23 current snap is 227 2024-03-30T12:30:01.021 INFO:tasks.rados.rados.0.smithi084.stdout:2119: finishing copy_from to smithi08477944-36 2024-03-30T12:30:01.021 INFO:tasks.rados.rados.0.smithi084.stdout:2119: got expected ENOENT (src dne) 2024-03-30T12:30:01.021 INFO:tasks.rados.rados.0.smithi084.stdout:2119: finishing copy_from racing read to smithi08477944-36 2024-03-30T12:30:01.021 INFO:tasks.rados.rados.0.smithi084.stdout:2119: done (3 left) 2024-03-30T12:30:01.021 INFO:tasks.rados.rados.0.smithi084.stdout:2121: done (2 left) 2024-03-30T12:30:01.021 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 227 2024-03-30T12:30:01.021 INFO:tasks.rados.rados.0.smithi084.stdout:2122: seq_num 645 ranges {0=409600,409600=778240,1187840=24576} 2024-03-30T12:30:01.022 INFO:tasks.rados.rados.0.smithi084.stdout:2122: writing smithi08477944-36 from 0 to 409600 tid 1 2024-03-30T12:30:01.026 INFO:tasks.rados.rados.0.smithi084.stdout:2122: writing smithi08477944-36 from 409600 to 1187840 tid 2 2024-03-30T12:30:01.026 INFO:tasks.rados.rados.0.smithi084.stdout:2122: writing smithi08477944-36 from 1187840 to 1212416 tid 3 2024-03-30T12:30:01.026 INFO:tasks.rados.rados.0.smithi084.stdout:2123: copy_from oid 27 from oid 41 current snap is 227 2024-03-30T12:30:01.026 INFO:tasks.rados.rados.0.smithi084.stdout:2122: finishing write tid 1 to smithi08477944-36 2024-03-30T12:30:01.026 INFO:tasks.rados.rados.0.smithi084.stdout:2118: finishing write tid 1 to smithi08477944-24 2024-03-30T12:30:01.027 INFO:tasks.rados.rados.0.smithi084.stdout:2124: snap_remove snap 225 2024-03-30T12:30:01.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:01.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:01.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:01.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[91810]: osdmap e518: 8 total, 7 up, 8 in 2024-03-30T12:30:01.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:01.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:01.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[91810]: Health detail: HEALTH_ERR 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Possible data damage: 6 pgs snaptrim_error 2024-03-30T12:30:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[91810]: [WRN] OSD_DOWN: 1 osds down 2024-03-30T12:30:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[91810]: osd.7 (root=default,host=smithi162) is down 2024-03-30T12:30:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[91810]: [WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-03-30T12:30:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[91810]: all OSDs are running squid or later but require_osd_release < squid 2024-03-30T12:30:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[91810]: [ERR] PG_DAMAGED: Possible data damage: 6 pgs snaptrim_error 2024-03-30T12:30:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[91810]: pg 5.3 is active+clean+snaptrim_error, acting [0,3,6] 2024-03-30T12:30:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[91810]: pg 5.5 is active+clean+snaptrim_error, acting [0,1,4] 2024-03-30T12:30:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[91810]: pg 5.8 is active+clean+snaptrim_error, acting [2,0,1] 2024-03-30T12:30:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[91810]: pg 5.a is active+clean+snaptrim_error, acting [2,4,3] 2024-03-30T12:30:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[91810]: pg 5.b is active+clean+snaptrim_error, acting [2,0,5] 2024-03-30T12:30:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[91810]: pg 5.d is active+clean+snaptrim_error, acting [2,7,5] 2024-03-30T12:30:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[91810]: from='client.54262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:30:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/3931062026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[91810]: pgmap v461: 121 pgs: 1 active+undersized+degraded, 10 active+undersized, 10 peering, 13 stale+active+clean, 5 active+clean+snaptrim, 76 active+clean, 6 active+clean+snaptrim_error; 451 MiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 18 MiB/s rd, 5.7 MiB/s wr, 6 op/s; 1/918 objects degraded (0.109%) 2024-03-30T12:30:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[89279]: osdmap e518: 8 total, 7 up, 8 in 2024-03-30T12:30:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[89279]: Health detail: HEALTH_ERR 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Possible data damage: 6 pgs snaptrim_error 2024-03-30T12:30:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[89279]: [WRN] OSD_DOWN: 1 osds down 2024-03-30T12:30:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[89279]: osd.7 (root=default,host=smithi162) is down 2024-03-30T12:30:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[89279]: [WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-03-30T12:30:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[89279]: all OSDs are running squid or later but require_osd_release < squid 2024-03-30T12:30:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[89279]: [ERR] PG_DAMAGED: Possible data damage: 6 pgs snaptrim_error 2024-03-30T12:30:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[89279]: pg 5.3 is active+clean+snaptrim_error, acting [0,3,6] 2024-03-30T12:30:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[89279]: pg 5.5 is active+clean+snaptrim_error, acting [0,1,4] 2024-03-30T12:30:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[89279]: pg 5.8 is active+clean+snaptrim_error, acting [2,0,1] 2024-03-30T12:30:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[89279]: pg 5.a is active+clean+snaptrim_error, acting [2,4,3] 2024-03-30T12:30:01.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[89279]: pg 5.b is active+clean+snaptrim_error, acting [2,0,5] 2024-03-30T12:30:01.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[89279]: pg 5.d is active+clean+snaptrim_error, acting [2,7,5] 2024-03-30T12:30:01.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[89279]: from='client.54262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:30:01.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/3931062026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:01.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:00 smithi084 ceph-mon[89279]: pgmap v461: 121 pgs: 1 active+undersized+degraded, 10 active+undersized, 10 peering, 13 stale+active+clean, 5 active+clean+snaptrim, 76 active+clean, 6 active+clean+snaptrim_error; 451 MiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 18 MiB/s rd, 5.7 MiB/s wr, 6 op/s; 1/918 objects degraded (0.109%) 2024-03-30T12:30:01.265 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.061+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.265 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.093+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.265 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.123+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.265 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.156+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.266 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.183+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.266 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.273+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.266 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.036+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.266 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.057+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.266 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.073+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.266 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.089+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.266 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.105+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.266 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.124+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.266 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.139+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.266 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.158+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.266 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.175+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.267 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.191+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.267 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.207+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.545 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.306+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.545 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.340+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.545 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.366+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.545 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.397+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.545 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.426+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.545 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.459+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.545 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.490+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.545 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.521+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.280+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.295+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.312+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.328+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.343+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.359+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.375+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.392+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.412+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.429+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.444+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.462+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.479+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.547 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.494+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.547 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.510+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.547 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.526+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.820 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.539+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.820 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.568+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.820 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.597+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.820 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.612+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.820 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.629+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.820 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.647+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.820 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.662+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.821 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.679+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.821 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.694+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.821 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.714+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.821 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.733+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.821 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.749+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:01.821 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.558+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.821 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.592+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.821 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.622+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.821 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.655+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.821 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.683+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.821 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.715+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.821 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.741+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:01.890 INFO:tasks.rados.rados.0.smithi084.stdout:2124: done (4 left) 2024-03-30T12:30:01.890 INFO:tasks.rados.rados.0.smithi084.stdout:2125: read oid 38 snap -1 2024-03-30T12:30:01.890 INFO:tasks.rados.rados.0.smithi084.stdout:2125: expect (ObjNum 525 snap 171 seq_num 525) 2024-03-30T12:30:01.890 INFO:tasks.rados.rados.0.smithi084.stdout:2126: copy_from oid 35 from oid 42 current snap is 227 2024-03-30T12:30:01.890 INFO:tasks.rados.rados.0.smithi084.stdout:2123: finishing copy_from to smithi08477944-27 2024-03-30T12:30:01.890 INFO:tasks.rados.rados.0.smithi084.stdout:2123: got expected ENOENT (src dne) 2024-03-30T12:30:01.891 INFO:tasks.rados.rados.0.smithi084.stdout:2123: finishing copy_from racing read to smithi08477944-27 2024-03-30T12:30:01.891 INFO:tasks.rados.rados.0.smithi084.stdout:2122: finishing write tid 2 to smithi08477944-36 2024-03-30T12:30:01.891 INFO:tasks.rados.rados.0.smithi084.stdout:2122: finishing write tid 3 to smithi08477944-36 2024-03-30T12:30:01.891 INFO:tasks.rados.rados.0.smithi084.stdout:2122: finishing write tid 4 to smithi08477944-36 2024-03-30T12:30:01.891 INFO:tasks.rados.rados.0.smithi084.stdout:2122: finishing write tid 5 to smithi08477944-36 2024-03-30T12:30:01.891 INFO:tasks.rados.rados.0.smithi084.stdout:2122: oid 36 updating version 0 to 954 2024-03-30T12:30:01.891 INFO:tasks.rados.rados.0.smithi084.stdout:2122: oid 36 updating version 954 to 957 2024-03-30T12:30:01.891 INFO:tasks.rados.rados.0.smithi084.stdout:2122: oid 36 version 957 is already newer than 956 2024-03-30T12:30:01.891 INFO:tasks.rados.rados.0.smithi084.stdout:2122: oid 36 version 957 is already newer than 955 2024-03-30T12:30:01.891 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 957 (ObjNum 645 snap 227 seq_num 645) dirty exists 2024-03-30T12:30:01.891 INFO:tasks.rados.rados.0.smithi084.stdout:2122: left oid 36 (ObjNum 645 snap 227 seq_num 645) 2024-03-30T12:30:01.891 INFO:tasks.rados.rados.0.smithi084.stdout:2118: finishing write tid 2 to smithi08477944-24 2024-03-30T12:30:01.891 INFO:tasks.rados.rados.0.smithi084.stdout:2118: finishing write tid 3 to smithi08477944-24 2024-03-30T12:30:01.891 INFO:tasks.rados.rados.0.smithi084.stdout:2120: finishing rollback tid 1 to smithi08477944-2 2024-03-30T12:30:01.892 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 0 (ObjNum 897 snap 0 seq_num 1532997712) dirty dne 2024-03-30T12:30:01.892 INFO:tasks.rados.rados.0.smithi084.stdout:2118: finishing write tid 4 to smithi08477944-24 2024-03-30T12:30:01.892 INFO:tasks.rados.rados.0.smithi084.stdout:2118: oid 24 updating version 0 to 7588 2024-03-30T12:30:01.892 INFO:tasks.rados.rados.0.smithi084.stdout:2118: oid 24 updating version 7588 to 7590 2024-03-30T12:30:01.892 INFO:tasks.rados.rados.0.smithi084.stdout:2118: oid 24 version 7590 is already newer than 7589 2024-03-30T12:30:01.892 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 7590 (ObjNum 643 snap 227 seq_num 643) dirty exists 2024-03-30T12:30:01.892 INFO:tasks.rados.rados.0.smithi084.stdout:2118: left oid 24 (ObjNum 643 snap 227 seq_num 643) 2024-03-30T12:30:01.892 INFO:tasks.rados.rados.0.smithi084.stdout:2118: done (5 left) 2024-03-30T12:30:01.892 INFO:tasks.rados.rados.0.smithi084.stdout:2120: done (4 left) 2024-03-30T12:30:01.892 INFO:tasks.rados.rados.0.smithi084.stdout:2122: done (3 left) 2024-03-30T12:30:01.892 INFO:tasks.rados.rados.0.smithi084.stdout:2123: done (2 left) 2024-03-30T12:30:01.892 INFO:tasks.rados.rados.0.smithi084.stdout:2127: rollback oid 17 current snap is 227 2024-03-30T12:30:01.892 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 17 to 223 2024-03-30T12:30:01.892 INFO:tasks.rados.rados.0.smithi084.stdout:2128: setattr oid 11 current snap is 227 2024-03-30T12:30:01.893 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 227 2024-03-30T12:30:01.893 INFO:tasks.rados.rados.0.smithi084.stdout:2129: seq_num 646 ranges {1761280=425984,2187264=655360,2842624=147456} 2024-03-30T12:30:01.904 INFO:tasks.rados.rados.0.smithi084.stdout:2129: writing smithi08477944-8 from 1761280 to 2187264 tid 1 2024-03-30T12:30:01.909 INFO:tasks.rados.rados.0.smithi084.stdout:2129: writing smithi08477944-8 from 2187264 to 2842624 tid 2 2024-03-30T12:30:01.910 INFO:tasks.rados.rados.0.smithi084.stdout:2129: writing smithi08477944-8 from 2842624 to 2990080 tid 3 2024-03-30T12:30:01.910 INFO:tasks.rados.rados.0.smithi084.stdout:2130: delete oid 3 current snap is 227 2024-03-30T12:30:01.910 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 948 (ObjNum 558 snap 191 seq_num 558) dirty exists 2024-03-30T12:30:01.911 INFO:tasks.rados.rados.0.smithi084.stdout:2127: finishing rollback tid 1 to smithi08477944-17 2024-03-30T12:30:01.911 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 936 (ObjNum 1345 snap 0 seq_num 1555196752) dirty dne 2024-03-30T12:30:01.925 INFO:tasks.rados.rados.0.smithi084.stdout:2126: finishing copy_from racing read to smithi08477944-35 2024-03-30T12:30:01.930 INFO:tasks.rados.rados.0.smithi084.stdout:2129: finishing write tid 1 to smithi08477944-8 2024-03-30T12:30:01.930 INFO:tasks.rados.rados.0.smithi084.stdout:2129: finishing write tid 2 to smithi08477944-8 2024-03-30T12:30:01.930 INFO:tasks.rados.rados.0.smithi084.stdout:2129: finishing write tid 3 to smithi08477944-8 2024-03-30T12:30:01.932 INFO:tasks.rados.rados.0.smithi084.stdout:2126: finishing copy_from to smithi08477944-35 2024-03-30T12:30:01.933 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 946 (ObjNum 502 snap 157 seq_num 502) dirty exists 2024-03-30T12:30:01.937 INFO:tasks.rados.rados.0.smithi084.stdout:2129: finishing write tid 4 to smithi08477944-8 2024-03-30T12:30:01.938 INFO:tasks.rados.rados.0.smithi084.stdout:2126: done (5 left) 2024-03-30T12:30:01.938 INFO:tasks.rados.rados.0.smithi084.stdout:2127: done (4 left) 2024-03-30T12:30:01.938 INFO:tasks.rados.rados.0.smithi084.stdout:2128: done (3 left) 2024-03-30T12:30:01.938 INFO:tasks.rados.rados.0.smithi084.stdout:2130: done (2 left) 2024-03-30T12:30:01.938 INFO:tasks.rados.rados.0.smithi084.stdout:2131: setattr oid 36 current snap is 227 2024-03-30T12:30:01.940 INFO:tasks.rados.rados.0.smithi084.stdout:2132: copy_from oid 37 from oid 43 current snap is 227 2024-03-30T12:30:01.940 INFO:tasks.rados.rados.0.smithi084.stdout:2133: read oid 49 snap -1 2024-03-30T12:30:01.940 INFO:tasks.rados.rados.0.smithi084.stdout:2133: expect (ObjNum 638 snap 226 seq_num 638) 2024-03-30T12:30:01.940 INFO:tasks.rados.rados.0.smithi084.stdout:2134: snap_create 2024-03-30T12:30:01.943 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 958 (ObjNum 645 snap 227 seq_num 645) dirty exists 2024-03-30T12:30:01.947 INFO:tasks.rados.rados.0.smithi084.stdout:2125: expect (ObjNum 525 snap 171 seq_num 525) 2024-03-30T12:30:02.072 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.767+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.072 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.831+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.072 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.850+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.072 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.868+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.072 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.884+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.072 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.904+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.072 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.925+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.073 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.949+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.073 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.966+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.073 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.983+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.073 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:01.998+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.073 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.063+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.073 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-mon[83709]: Health check failed: Reduced data availability: 1 pg inactive, 2 pgs peering (PG_AVAILABILITY) 2024-03-30T12:30:02.073 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-mon[83709]: Health check failed: Degraded data redundancy: 1/918 objects degraded (0.109%), 1 pg degraded (PG_DEGRADED) 2024-03-30T12:30:02.073 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.771+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.073 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.840+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.074 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.858+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.074 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.894+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.074 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.934+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.074 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.966+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.074 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:01.987+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.074 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.067+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:01.902+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:02.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:01.905+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:01 smithi084 ceph-mon[91810]: Health check failed: Reduced data availability: 1 pg inactive, 2 pgs peering (PG_AVAILABILITY) 2024-03-30T12:30:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:01 smithi084 ceph-mon[91810]: Health check failed: Degraded data redundancy: 1/918 objects degraded (0.109%), 1 pg degraded (PG_DEGRADED) 2024-03-30T12:30:02.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:01.902+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:02.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:01.902+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:02.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:01.905+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:02.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:01.905+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:02.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:01.905+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:02.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:01 smithi084 ceph-mon[89279]: Health check failed: Reduced data availability: 1 pg inactive, 2 pgs peering (PG_AVAILABILITY) 2024-03-30T12:30:02.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:01 smithi084 ceph-mon[89279]: Health check failed: Degraded data redundancy: 1/918 objects degraded (0.109%), 1 pg degraded (PG_DEGRADED) 2024-03-30T12:30:02.331 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.095+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.332 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.124+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.332 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.153+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.332 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.181+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.332 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.212+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.332 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.243+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.332 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.272+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.332 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.300+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.332 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.080+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.332 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.096+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.333 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.113+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.333 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.130+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.333 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.148+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.333 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.163+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.333 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.180+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.333 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.195+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.333 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.213+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.333 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.229+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.333 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.244+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.333 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.263+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.333 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.280+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.333 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.297+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.589 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.351+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.590 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.384+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.590 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.412+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.590 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.442+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.590 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.460+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.590 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.491+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.590 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.517+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.590 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.549+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.590 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.589+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.590 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.312+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.591 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.349+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.591 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.364+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.591 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.380+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.591 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.396+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.591 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.414+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.591 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.432+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.591 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.449+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.591 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.467+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.591 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.483+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.591 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.501+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.591 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.518+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.591 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.533+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.591 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.550+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.591 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.566+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.592 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.597+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.858 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.612+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.859 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.642+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.859 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.665+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.859 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.682+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.859 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.715+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.859 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.745+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.859 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.819+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.859 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.842+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.859 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.866+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:02.859 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.616+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.859 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.631+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.860 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.646+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.860 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.662+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.860 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.681+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.860 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.698+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.860 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.715+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.860 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.733+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.860 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.750+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.860 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.767+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.860 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.829+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.860 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.846+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:02.907 INFO:tasks.rados.rados.0.smithi084.stdout:2133: expect (ObjNum 638 snap 226 seq_num 638) 2024-03-30T12:30:02.985 INFO:tasks.rados.rados.0.smithi084.stdout:2129: finishing write tid 5 to smithi08477944-8 2024-03-30T12:30:02.985 INFO:tasks.rados.rados.0.smithi084.stdout:2129: oid 8 updating version 0 to 19160 2024-03-30T12:30:02.985 INFO:tasks.rados.rados.0.smithi084.stdout:2129: oid 8 version 19160 is already newer than 19159 2024-03-30T12:30:02.985 INFO:tasks.rados.rados.0.smithi084.stdout:2129: oid 8 updating version 19160 to 19162 2024-03-30T12:30:02.985 INFO:tasks.rados.rados.0.smithi084.stdout:2129: oid 8 version 19162 is already newer than 19161 2024-03-30T12:30:02.986 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 19162 (ObjNum 646 snap 227 seq_num 646) dirty exists 2024-03-30T12:30:02.986 INFO:tasks.rados.rados.0.smithi084.stdout:2129: left oid 8 (ObjNum 646 snap 227 seq_num 646) 2024-03-30T12:30:02.986 INFO:tasks.rados.rados.0.smithi084.stdout:2132: finishing copy_from racing read to smithi08477944-37 2024-03-30T12:30:02.986 INFO:tasks.rados.rados.0.smithi084.stdout:2132: finishing copy_from to smithi08477944-37 2024-03-30T12:30:02.986 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 23362 (ObjNum 603 snap 215 seq_num 603) dirty exists 2024-03-30T12:30:02.986 INFO:tasks.rados.rados.0.smithi084.stdout:2125: done (5 left) 2024-03-30T12:30:02.986 INFO:tasks.rados.rados.0.smithi084.stdout:2129: done (4 left) 2024-03-30T12:30:02.986 INFO:tasks.rados.rados.0.smithi084.stdout:2131: done (3 left) 2024-03-30T12:30:02.986 INFO:tasks.rados.rados.0.smithi084.stdout:2132: done (2 left) 2024-03-30T12:30:02.986 INFO:tasks.rados.rados.0.smithi084.stdout:2133: done (1 left) 2024-03-30T12:30:02.986 INFO:tasks.rados.rados.0.smithi084.stdout:2134: done (0 left) 2024-03-30T12:30:02.986 INFO:tasks.rados.rados.0.smithi084.stdout:2135: read oid 2 snap -1 2024-03-30T12:30:02.986 INFO:tasks.rados.rados.0.smithi084.stdout:2135: expect deleted 2024-03-30T12:30:02.986 INFO:tasks.rados.rados.0.smithi084.stdout:2136: snap_create 2024-03-30T12:30:03.118 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-mon[83709]: osdmap e519: 8 total, 7 up, 8 in 2024-03-30T12:30:03.118 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:03.118 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:03.118 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:03.118 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:03.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:03.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-mon[83709]: pgmap v463: 121 pgs: 6 active+undersized+degraded, 28 active+undersized, 10 peering, 3 stale+active+clean, 4 active+clean+snaptrim, 64 active+clean, 6 active+clean+snaptrim_error; 451 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 14 MiB/s rd, 4.7 MiB/s wr, 2 op/s; 29/912 objects degraded (3.180%) 2024-03-30T12:30:03.119 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.884+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.119 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.916+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.119 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.939+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.119 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:02.965+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.119 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.031+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.119 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.064+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.119 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.096+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.867+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.885+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.906+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.925+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.943+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:02.959+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.025+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.043+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.059+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.075+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.092+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.109+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.126+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:02.909+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:03.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:02.910+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:03.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:02 smithi084 ceph-mon[91810]: osdmap e519: 8 total, 7 up, 8 in 2024-03-30T12:30:03.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:03.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:03.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:03.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:03.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:03.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:02 smithi084 ceph-mon[91810]: pgmap v463: 121 pgs: 6 active+undersized+degraded, 28 active+undersized, 10 peering, 3 stale+active+clean, 4 active+clean+snaptrim, 64 active+clean, 6 active+clean+snaptrim_error; 451 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 14 MiB/s rd, 4.7 MiB/s wr, 2 op/s; 29/912 objects degraded (3.180%) 2024-03-30T12:30:03.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:02 smithi084 ceph-mon[89279]: osdmap e519: 8 total, 7 up, 8 in 2024-03-30T12:30:03.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:03.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:03.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:03.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:03.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:03.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:02 smithi084 ceph-mon[89279]: pgmap v463: 121 pgs: 6 active+undersized+degraded, 28 active+undersized, 10 peering, 3 stale+active+clean, 4 active+clean+snaptrim, 64 active+clean, 6 active+clean+snaptrim_error; 451 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 14 MiB/s rd, 4.7 MiB/s wr, 2 op/s; 29/912 objects degraded (3.180%) 2024-03-30T12:30:03.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.128+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.156+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.182+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.212+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.244+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.271+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.301+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.334+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.359+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.147+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.163+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.180+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.196+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.213+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.230+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.248+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.263+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.279+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.296+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.315+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.332+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.349+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.661 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:03 smithi162 podman[103478]: 2024-03-30 12:30:03.534046501 +0000 UTC m=+4.941816761 container cleanup e3246b3bc88be5107f232ed14d62d8f88d52edf09b6e84bf88e50b97790d0d1d (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, RELEASE=reef-f14b568, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-03-30T12:30:03.662 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:03 smithi162 bash[103478]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7 2024-03-30T12:30:03.662 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.392+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.662 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.423+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.662 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.455+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.662 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.487+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.662 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.518+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.662 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.551+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.662 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.585+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.662 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.618+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.663 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.651+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.663 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.366+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.663 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.382+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.663 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.400+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.663 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.418+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.663 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.435+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.663 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.453+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.468+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.485+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.502+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.519+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.536+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.555+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.578+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.597+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.615+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.632+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.651+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.664 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.670+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.908 INFO:tasks.rados.rados.0.smithi084.stdout:2135: done (1 left) 2024-03-30T12:30:03.909 INFO:tasks.rados.rados.0.smithi084.stdout:2136: done (0 left) 2024-03-30T12:30:03.909 INFO:tasks.rados.rados.0.smithi084.stdout:2137: snap_create 2024-03-30T12:30:03.923 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-mon[83709]: osdmap e520: 8 total, 7 up, 8 in 2024-03-30T12:30:03.923 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:03.923 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:03.923 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:03 smithi162 podman[103496]: 2024-03-30 12:30:03.844525711 +0000 UTC m=+4.320101276 container remove e3246b3bc88be5107f232ed14d62d8f88d52edf09b6e84bf88e50b97790d0d1d (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7, ceph=True, org.label-schema.vendor=CentOS, RELEASE=reef-f14b568, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-03-30T12:30:03.924 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.685+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.924 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.720+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.924 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.751+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.924 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.784+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.924 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.807+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.924 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.828+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.924 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.860+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.924 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.896+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.924 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.929+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:03.924 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.694+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.925 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.713+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.925 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.733+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.925 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.749+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.925 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.766+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.925 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.781+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.925 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.800+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.925 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.818+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.925 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.835+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.925 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.851+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.925 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.868+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.925 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.887+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:03.925 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.907+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:03.917+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:04.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:03.919+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:04.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:03 smithi084 ceph-mon[91810]: osdmap e520: 8 total, 7 up, 8 in 2024-03-30T12:30:04.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:04.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:04.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:03 smithi084 ceph-mon[89279]: osdmap e520: 8 total, 7 up, 8 in 2024-03-30T12:30:04.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:04.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:04.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:03.691+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:04.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:03.692+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:04.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:03.692+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:04.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:03.916+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:04.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:03.916+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:04.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:03.916+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:04.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:03.916+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:04.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:03.918+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:04.179 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.931+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.180 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.953+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.180 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.973+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.180 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:03.992+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.180 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.014+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.180 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.033+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.180 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.055+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.180 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.073+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.180 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.092+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.180 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.113+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.180 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.132+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.180 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.150+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.180 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.170+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.181 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:03.964+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.181 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.001+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.181 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.037+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.181 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.070+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.181 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.105+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.181 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.138+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.181 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.166+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.435 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:04 smithi162 podman[103570]: 2024-03-30 12:30:04.221406012 +0000 UTC m=+0.029058436 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:30:04.436 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:04 smithi162 podman[103570]: 2024-03-30 12:30:04.345763618 +0000 UTC m=+0.153416012 container create 573d7dffc16d03f82efa592a880edff98cc52853fdb5c1856c82ccf03452a5eb (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=) 2024-03-30T12:30:04.436 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.204+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.436 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.235+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.436 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.264+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.436 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.290+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.436 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.324+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.437 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.359+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.437 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.391+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.437 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.418+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.187+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.206+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.225+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.244+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.263+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.278+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.295+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.311+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.327+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.438 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.342+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.438 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.360+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.438 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.377+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.438 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.392+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.438 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.408+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.438 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.425+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.438 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.444+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.690 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:04 smithi162 podman[103570]: 2024-03-30 12:30:04.615719934 +0000 UTC m=+0.423372349 container init 573d7dffc16d03f82efa592a880edff98cc52853fdb5c1856c82ccf03452a5eb (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-03-30T12:30:04.690 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:04 smithi162 podman[103570]: 2024-03-30 12:30:04.621010907 +0000 UTC m=+0.428663307 container start 573d7dffc16d03f82efa592a880edff98cc52853fdb5c1856c82ccf03452a5eb (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7-deactivate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-03-30T12:30:04.690 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.445+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.690 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.484+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.690 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.512+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.691 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.544+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.691 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.561+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.691 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.578+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.691 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.606+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.691 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.638+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.691 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.671+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.691 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.465+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.691 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.493+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.691 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.536+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.691 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.554+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.691 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.574+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.590+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.606+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.623+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.644+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.665+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.683+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.692 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.698+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.920 INFO:tasks.rados.rados.0.smithi084.stdout:2137: done (0 left) 2024-03-30T12:30:04.920 INFO:tasks.rados.rados.0.smithi084.stdout:2138: copy_from oid 41 from oid 34 current snap is 230 2024-03-30T12:30:04.920 INFO:tasks.rados.rados.0.smithi084.stdout:2139: read oid 14 snap 204 2024-03-30T12:30:04.920 INFO:tasks.rados.rados.0.smithi084.stdout:2139: expect deleted 2024-03-30T12:30:04.920 INFO:tasks.rados.rados.0.smithi084.stdout:2140: delete oid 13 current snap is 230 2024-03-30T12:30:04.922 INFO:tasks.rados.rados.0.smithi084.stdout:2138: finishing copy_from to smithi08477944-41 2024-03-30T12:30:04.922 INFO:tasks.rados.rados.0.smithi084.stdout:2138: got expected ENOENT (src dne) 2024-03-30T12:30:04.923 INFO:tasks.rados.rados.0.smithi084.stdout:2138: finishing copy_from racing read to smithi08477944-41 2024-03-30T12:30:04.941 INFO:tasks.rados.rados.0.smithi084.stdout:2138: done (2 left) 2024-03-30T12:30:04.941 INFO:tasks.rados.rados.0.smithi084.stdout:2139: done (1 left) 2024-03-30T12:30:04.941 INFO:tasks.rados.rados.0.smithi084.stdout:2140: done (0 left) 2024-03-30T12:30:04.941 INFO:tasks.rados.rados.0.smithi084.stdout:2141: rmattr oid 34 current snap is 230 2024-03-30T12:30:04.941 INFO:tasks.rados.rados.0.smithi084.stdout:2141: done (0 left) 2024-03-30T12:30:04.941 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 230 2024-03-30T12:30:04.941 INFO:tasks.rados.rados.0.smithi084.stdout:2142: seq_num 649 ranges {2154496=475136,2629632=761856,3391488=40960} 2024-03-30T12:30:04.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.717+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.739+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.759+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.778+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.796+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.819+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.840+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.859+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.883+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.903+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.928+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:04.944 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:04 smithi162 podman[103570]: 2024-03-30 12:30:04.726975898 +0000 UTC m=+0.534628294 container attach 573d7dffc16d03f82efa592a880edff98cc52853fdb5c1856c82ccf03452a5eb (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7-deactivate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, ceph=True) 2024-03-30T12:30:04.944 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:04.944 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:04.944 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:04.944 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:04.944 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:04.944 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-mon[83709]: osdmap e521: 8 total, 7 up, 8 in 2024-03-30T12:30:04.944 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:04.944 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:04.944 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:04.945 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-mon[83709]: pgmap v466: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 38 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 460 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 4.1 MiB/s wr, 5 op/s; 81/924 objects degraded (8.766%) 2024-03-30T12:30:04.945 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.710+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.945 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.731+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.945 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.758+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.945 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.791+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.945 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.822+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.945 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.849+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.945 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.890+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.945 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.913+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:04.955 INFO:tasks.rados.rados.0.smithi084.stdout:2142: writing smithi08477944-48 from 2154496 to 2629632 tid 1 2024-03-30T12:30:04.960 INFO:tasks.rados.rados.0.smithi084.stdout:2142: writing smithi08477944-48 from 2629632 to 3391488 tid 2 2024-03-30T12:30:04.961 INFO:tasks.rados.rados.0.smithi084.stdout:2142: writing smithi08477944-48 from 3391488 to 3432448 tid 3 2024-03-30T12:30:04.961 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 230 2024-03-30T12:30:04.961 INFO:tasks.rados.rados.0.smithi084.stdout:2143: seq_num 650 ranges {5668864=491520,6160384=647168,6807552=155648} 2024-03-30T12:30:04.996 INFO:tasks.rados.rados.0.smithi084.stdout:2143: writing smithi08477944-32 from 5668864 to 6160384 tid 1 2024-03-30T12:30:05.000 INFO:tasks.rados.rados.0.smithi084.stdout:2143: writing smithi08477944-32 from 6160384 to 6807552 tid 2 2024-03-30T12:30:05.002 INFO:tasks.rados.rados.0.smithi084.stdout:2143: writing smithi08477944-32 from 6807552 to 6963200 tid 3 2024-03-30T12:30:05.002 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 46 current snap is 230 2024-03-30T12:30:05.002 INFO:tasks.rados.rados.0.smithi084.stdout:2142: finishing write tid 1 to smithi08477944-48 2024-03-30T12:30:05.002 INFO:tasks.rados.rados.0.smithi084.stdout:2142: finishing write tid 2 to smithi08477944-48 2024-03-30T12:30:05.003 INFO:tasks.rados.rados.0.smithi084.stdout:2142: finishing write tid 3 to smithi08477944-48 2024-03-30T12:30:05.003 INFO:tasks.rados.rados.0.smithi084.stdout:2142: finishing write tid 4 to smithi08477944-48 2024-03-30T12:30:05.003 INFO:tasks.rados.rados.0.smithi084.stdout:2142: finishing write tid 5 to smithi08477944-48 2024-03-30T12:30:05.003 INFO:tasks.rados.rados.0.smithi084.stdout:2142: oid 48 updating version 0 to 912 2024-03-30T12:30:05.003 INFO:tasks.rados.rados.0.smithi084.stdout:2142: oid 48 updating version 912 to 914 2024-03-30T12:30:05.003 INFO:tasks.rados.rados.0.smithi084.stdout:2142: oid 48 version 914 is already newer than 911 2024-03-30T12:30:05.003 INFO:tasks.rados.rados.0.smithi084.stdout:2142: oid 48 version 914 is already newer than 913 2024-03-30T12:30:05.003 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 914 (ObjNum 649 snap 230 seq_num 649) dirty exists 2024-03-30T12:30:05.003 INFO:tasks.rados.rados.0.smithi084.stdout:2142: left oid 48 (ObjNum 649 snap 230 seq_num 649) 2024-03-30T12:30:05.003 INFO:tasks.rados.rados.0.smithi084.stdout:2143: finishing write tid 1 to smithi08477944-32 2024-03-30T12:30:05.003 INFO:tasks.rados.rados.0.smithi084.stdout:2144: seq_num 651 ranges {8257536=507904,8765440=532480,9297920=270336} 2024-03-30T12:30:05.050 INFO:tasks.rados.rados.0.smithi084.stdout:2144: writing smithi08477944-46 from 8257536 to 8765440 tid 1 2024-03-30T12:30:05.053 INFO:tasks.rados.rados.0.smithi084.stdout:2144: writing smithi08477944-46 from 8765440 to 9297920 tid 2 2024-03-30T12:30:05.055 INFO:tasks.rados.rados.0.smithi084.stdout:2144: writing smithi08477944-46 from 9297920 to 9568256 tid 3 2024-03-30T12:30:05.055 INFO:tasks.rados.rados.0.smithi084.stdout:2142: done (2 left) 2024-03-30T12:30:05.055 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 230 2024-03-30T12:30:05.055 INFO:tasks.rados.rados.0.smithi084.stdout:2143: finishing write tid 2 to smithi08477944-32 2024-03-30T12:30:05.055 INFO:tasks.rados.rados.0.smithi084.stdout:2145: seq_num 652 ranges {5693440=524288,6217728=409600,6627328=393216} 2024-03-30T12:30:05.090 INFO:tasks.rados.rados.0.smithi084.stdout:2145: writing smithi08477944-5 from 5693440 to 6217728 tid 1 2024-03-30T12:30:05.092 INFO:tasks.rados.rados.0.smithi084.stdout:2145: writing smithi08477944-5 from 6217728 to 6627328 tid 2 2024-03-30T12:30:05.095 INFO:tasks.rados.rados.0.smithi084.stdout:2145: writing smithi08477944-5 from 6627328 to 7020544 tid 3 2024-03-30T12:30:05.095 INFO:tasks.rados.rados.0.smithi084.stdout:2146: read oid 43 snap 168 2024-03-30T12:30:05.095 INFO:tasks.rados.rados.0.smithi084.stdout:2146: expect (ObjNum 519 snap 167 seq_num 519) 2024-03-30T12:30:05.095 INFO:tasks.rados.rados.0.smithi084.stdout:2147: snap_remove snap 228 2024-03-30T12:30:05.210 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.951+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.210 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.976+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.210 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:04.998+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.210 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.025+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.210 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.042+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.210 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.060+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.210 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.077+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.210 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.096+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.210 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.117+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.210 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.136+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.211 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.152+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.211 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.169+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.211 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.185+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.211 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.201+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.211 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.216+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.211 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:05 smithi162 podman[103570]: 2024-03-30 12:30:05.077543779 +0000 UTC m=+0.885196185 container died 573d7dffc16d03f82efa592a880edff98cc52853fdb5c1856c82ccf03452a5eb (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7-deactivate, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_BRANCH=HEAD) 2024-03-30T12:30:05.211 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.954+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.211 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:04.984+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.212 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.013+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.212 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.037+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.212 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.089+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.212 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.127+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.212 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.159+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.212 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.192+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:04.926+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:05.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:04.927+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:05.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:04.922+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:05.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:04.922+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:05.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:04.922+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:05.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:05.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:05.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:05.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:05.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:05.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:04 smithi084 ceph-mon[91810]: osdmap e521: 8 total, 7 up, 8 in 2024-03-30T12:30:05.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:05.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:05.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:05.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:04 smithi084 ceph-mon[91810]: pgmap v466: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 38 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 460 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 4.1 MiB/s wr, 5 op/s; 81/924 objects degraded (8.766%) 2024-03-30T12:30:05.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:05.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:05.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:05.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:05.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:05.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:04 smithi084 ceph-mon[89279]: osdmap e521: 8 total, 7 up, 8 in 2024-03-30T12:30:05.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:05.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:05.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:05.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:04 smithi084 ceph-mon[89279]: pgmap v466: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 38 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 460 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 4.1 MiB/s wr, 5 op/s; 81/924 objects degraded (8.766%) 2024-03-30T12:30:05.472 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.233+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.473 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.250+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.473 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.264+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.473 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.283+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.473 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.298+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.473 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.315+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.473 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.334+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.473 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.358+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.473 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.376+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.473 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.395+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.473 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.414+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.473 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.430+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.473 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.447+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.473 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.465+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.474 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.223+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.474 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.249+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.474 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.281+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.474 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.310+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.474 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.338+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.474 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.368+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.474 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.397+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.474 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.426+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.474 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.457+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.728 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.480+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.728 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.499+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.728 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.516+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.728 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.534+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.728 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.550+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.728 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.567+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.728 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.582+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.729 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.601+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.729 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.618+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.729 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.635+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.729 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.652+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.729 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.668+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.729 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.686+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.729 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.702+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.729 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.719+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.729 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.491+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.729 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.520+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.730 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.552+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.730 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.584+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.730 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.614+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.730 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.642+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.730 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.671+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.730 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.704+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.928 INFO:tasks.rados.rados.0.smithi084.stdout:2147: done (4 left) 2024-03-30T12:30:05.928 INFO:tasks.rados.rados.0.smithi084.stdout:2148: snap_create 2024-03-30T12:30:05.928 INFO:tasks.rados.rados.0.smithi084.stdout:2143: finishing write tid 3 to smithi08477944-32 2024-03-30T12:30:05.929 INFO:tasks.rados.rados.0.smithi084.stdout:2143: finishing write tid 4 to smithi08477944-32 2024-03-30T12:30:05.929 INFO:tasks.rados.rados.0.smithi084.stdout:2143: finishing write tid 5 to smithi08477944-32 2024-03-30T12:30:05.929 INFO:tasks.rados.rados.0.smithi084.stdout:2143: oid 32 updating version 0 to 962 2024-03-30T12:30:05.929 INFO:tasks.rados.rados.0.smithi084.stdout:2143: oid 32 version 962 is already newer than 959 2024-03-30T12:30:05.929 INFO:tasks.rados.rados.0.smithi084.stdout:2143: oid 32 version 962 is already newer than 961 2024-03-30T12:30:05.929 INFO:tasks.rados.rados.0.smithi084.stdout:2143: oid 32 version 962 is already newer than 960 2024-03-30T12:30:05.929 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 962 (ObjNum 650 snap 230 seq_num 650) dirty exists 2024-03-30T12:30:05.929 INFO:tasks.rados.rados.0.smithi084.stdout:2143: left oid 32 (ObjNum 650 snap 230 seq_num 650) 2024-03-30T12:30:05.929 INFO:tasks.rados.rados.0.smithi084.stdout:2144: finishing write tid 1 to smithi08477944-46 2024-03-30T12:30:05.929 INFO:tasks.rados.rados.0.smithi084.stdout:2144: finishing write tid 2 to smithi08477944-46 2024-03-30T12:30:05.929 INFO:tasks.rados.rados.0.smithi084.stdout:2144: finishing write tid 3 to smithi08477944-46 2024-03-30T12:30:05.929 INFO:tasks.rados.rados.0.smithi084.stdout:2144: finishing write tid 4 to smithi08477944-46 2024-03-30T12:30:05.929 INFO:tasks.rados.rados.0.smithi084.stdout:2144: finishing write tid 5 to smithi08477944-46 2024-03-30T12:30:05.929 INFO:tasks.rados.rados.0.smithi084.stdout:2144: oid 46 updating version 0 to 19917 2024-03-30T12:30:05.930 INFO:tasks.rados.rados.0.smithi084.stdout:2144: oid 46 updating version 19917 to 19918 2024-03-30T12:30:05.930 INFO:tasks.rados.rados.0.smithi084.stdout:2144: oid 46 updating version 19918 to 19919 2024-03-30T12:30:05.930 INFO:tasks.rados.rados.0.smithi084.stdout:2144: oid 46 updating version 19919 to 19920 2024-03-30T12:30:05.930 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 19920 (ObjNum 651 snap 230 seq_num 651) dirty exists 2024-03-30T12:30:05.930 INFO:tasks.rados.rados.0.smithi084.stdout:2144: left oid 46 (ObjNum 651 snap 230 seq_num 651) 2024-03-30T12:30:05.930 INFO:tasks.rados.rados.0.smithi084.stdout:2145: finishing write tid 1 to smithi08477944-5 2024-03-30T12:30:05.930 INFO:tasks.rados.rados.0.smithi084.stdout:2145: finishing write tid 2 to smithi08477944-5 2024-03-30T12:30:05.930 INFO:tasks.rados.rados.0.smithi084.stdout:2145: finishing write tid 3 to smithi08477944-5 2024-03-30T12:30:05.930 INFO:tasks.rados.rados.0.smithi084.stdout:2145: finishing write tid 4 to smithi08477944-5 2024-03-30T12:30:05.930 INFO:tasks.rados.rados.0.smithi084.stdout:2145: finishing write tid 5 to smithi08477944-5 2024-03-30T12:30:05.930 INFO:tasks.rados.rados.0.smithi084.stdout:2145: oid 5 updating version 0 to 950 2024-03-30T12:30:05.930 INFO:tasks.rados.rados.0.smithi084.stdout:2145: oid 5 updating version 950 to 951 2024-03-30T12:30:05.930 INFO:tasks.rados.rados.0.smithi084.stdout:2145: oid 5 version 951 is already newer than 949 2024-03-30T12:30:05.930 INFO:tasks.rados.rados.0.smithi084.stdout:2145: oid 5 updating version 951 to 952 2024-03-30T12:30:05.931 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 952 (ObjNum 652 snap 230 seq_num 652) dirty exists 2024-03-30T12:30:05.931 INFO:tasks.rados.rados.0.smithi084.stdout:2145: left oid 5 (ObjNum 652 snap 230 seq_num 652) 2024-03-30T12:30:05.931 INFO:tasks.rados.rados.0.smithi084.stdout:2146: expect (ObjNum 519 snap 167 seq_num 519) 2024-03-30T12:30:05.988 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.737+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.988 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.753+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.988 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.770+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.989 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.788+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.989 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.805+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.989 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.821+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.989 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.841+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.989 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.860+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.989 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.881+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.989 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.908+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.989 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.930+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.989 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.952+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.989 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.976+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:05.989 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:05 smithi162 podman[103595]: 2024-03-30 12:30:05.793645761 +0000 UTC m=+0.708966068 container remove 573d7dffc16d03f82efa592a880edff98cc52853fdb5c1856c82ccf03452a5eb (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-03-30T12:30:05.990 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:05 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.7.service: Deactivated successfully. 2024-03-30T12:30:05.990 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:05 smithi162 systemd[1]: Stopped Ceph osd.7 for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:30:05.990 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:05 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.7.service: Consumed 1min 30.911s CPU time. 2024-03-30T12:30:05.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-mon[83709]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 2 pgs peering) 2024-03-30T12:30:05.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:05.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:05.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-mon[83709]: osdmap e522: 8 total, 7 up, 8 in 2024-03-30T12:30:05.992 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.736+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.992 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.771+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.992 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.801+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.992 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.834+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.992 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.863+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.992 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.903+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.992 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.938+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:05.992 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:05.972+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.253 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:06 smithi162 systemd[1]: Starting Ceph osd.7 for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:30:06.253 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.001+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.253 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.031+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.253 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.064+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.254 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.091+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.254 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.130+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.254 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.160+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.254 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.186+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.254 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.207+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.254 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.243+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:05.996+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.019+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.038+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.057+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.077+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.254 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.096+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.255 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.115+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.255 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.136+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.255 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.155+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.255 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.179+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.255 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.199+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.255 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.218+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.255 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.238+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.255 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.261+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:05 smithi084 ceph-mon[89279]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 2 pgs peering) 2024-03-30T12:30:06.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:06.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:06.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:05 smithi084 ceph-mon[89279]: osdmap e522: 8 total, 7 up, 8 in 2024-03-30T12:30:06.256 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:05.939+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:06.256 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:05.940+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:06.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:05 smithi084 ceph-mon[91810]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 2 pgs peering) 2024-03-30T12:30:06.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:06.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:06.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:05 smithi084 ceph-mon[91810]: osdmap e522: 8 total, 7 up, 8 in 2024-03-30T12:30:06.511 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:06 smithi162 podman[103687]: 2024-03-30 12:30:06.308797144 +0000 UTC m=+0.025865884 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:30:06.511 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:06 smithi162 podman[103687]: 2024-03-30 12:30:06.422784696 +0000 UTC m=+0.139853443 container create e9c1d890ae6744b160a8a96fa9d36cfa04600f0cdb67d4e16c91d4ac725eadef (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7-activate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240326) 2024-03-30T12:30:06.512 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.282+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.512 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.303+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.512 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.324+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.512 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.344+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.512 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.362+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.512 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.384+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.512 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.401+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.512 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.420+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.512 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.441+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.512 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.459+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.512 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.475+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.513 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.492+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.513 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.509+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.513 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.276+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.513 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.309+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.513 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.331+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.513 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.357+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.513 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.376+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.513 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.403+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.513 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.433+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.513 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.462+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.513 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.489+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.513 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.519+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:06.366+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:06.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:06.366+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:06.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:06.366+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:06.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:06.367+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:06.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:06.367+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:06.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.529+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.552+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.570+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.586+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.611+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.628+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.646+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.663+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.681+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.698+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.717+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.774 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.734+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.775 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.751+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.775 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.766+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.775 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.781+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:06.775 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.555+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.775 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.581+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.775 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.600+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.775 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.619+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.775 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.651+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.775 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.681+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.775 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.710+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.775 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.738+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.775 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.766+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:06.935 INFO:tasks.rados.rados.0.smithi084.stdout:2143: done (4 left) 2024-03-30T12:30:06.935 INFO:tasks.rados.rados.0.smithi084.stdout:2144: done (3 left) 2024-03-30T12:30:06.935 INFO:tasks.rados.rados.0.smithi084.stdout:2145: done (2 left) 2024-03-30T12:30:06.936 INFO:tasks.rados.rados.0.smithi084.stdout:2146: done (1 left) 2024-03-30T12:30:06.936 INFO:tasks.rados.rados.0.smithi084.stdout:2148: done (0 left) 2024-03-30T12:30:06.936 INFO:tasks.rados.rados.0.smithi084.stdout:2149: snap_create 2024-03-30T12:30:06.938 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:06.941+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:06.938 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:06.943+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:06.939 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:06.939 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:06.939 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:06.939 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:06 smithi084 ceph-mon[89279]: osdmap e523: 8 total, 7 up, 8 in 2024-03-30T12:30:06.939 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:06.939 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:06.939 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:06 smithi084 ceph-mon[89279]: pgmap v469: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 38 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 466 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 9.6 MiB/s rd, 3.7 MiB/s wr, 20 op/s; 81/936 objects degraded (8.654%) 2024-03-30T12:30:06.939 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:06.939 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:06.940 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:06.940 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:06 smithi084 ceph-mon[91810]: osdmap e523: 8 total, 7 up, 8 in 2024-03-30T12:30:06.940 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:06.940 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:06.940 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:06 smithi084 ceph-mon[91810]: pgmap v469: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 38 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 466 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 9.6 MiB/s rd, 3.7 MiB/s wr, 20 op/s; 81/936 objects degraded (8.654%) 2024-03-30T12:30:07.026 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.797+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.027 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.817+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.027 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.836+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.027 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.856+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.027 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.875+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.027 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.895+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.027 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.915+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.027 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.938+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.027 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.962+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.027 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.978+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.027 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:06.996+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.027 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.016+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.028 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:06 smithi162 podman[103687]: 2024-03-30 12:30:06.801233508 +0000 UTC m=+0.518302256 container init e9c1d890ae6744b160a8a96fa9d36cfa04600f0cdb67d4e16c91d4ac725eadef (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7-activate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240326) 2024-03-30T12:30:07.028 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:06 smithi162 podman[103687]: 2024-03-30 12:30:06.806646069 +0000 UTC m=+0.523714810 container start e9c1d890ae6744b160a8a96fa9d36cfa04600f0cdb67d4e16c91d4ac725eadef (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7-activate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T12:30:07.028 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:06 smithi162 podman[103687]: 2024-03-30 12:30:06.90142969 +0000 UTC m=+0.618498435 container attach e9c1d890ae6744b160a8a96fa9d36cfa04600f0cdb67d4e16c91d4ac725eadef (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7-activate, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-03-30T12:30:07.028 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:07.028 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:07.028 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:07.028 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-mon[83709]: osdmap e523: 8 total, 7 up, 8 in 2024-03-30T12:30:07.028 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:07.028 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:07.028 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-mon[83709]: pgmap v469: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 38 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 466 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 9.6 MiB/s rd, 3.7 MiB/s wr, 20 op/s; 81/936 objects degraded (8.654%) 2024-03-30T12:30:07.030 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.798+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.030 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.834+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.030 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.868+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.030 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.895+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.030 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.930+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.031 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.964+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.031 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:06.999+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.031 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.020+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:06.947+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:07.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:06.947+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:07.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:06.944+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:07.286 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.034+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.286 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.052+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.286 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.069+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.286 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.086+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.286 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.105+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.286 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.121+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.286 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.139+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.286 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.157+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.286 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.177+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.286 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.196+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.287 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.216+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.287 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.234+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.287 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.252+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.287 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.274+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.289 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.053+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.289 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.083+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.289 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.118+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.289 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.151+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.289 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.183+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.289 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.213+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.289 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.249+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.289 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.279+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.543 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[60320]: logger=cleanup t=2024-03-30T12:30:07.296995291Z level=info msg="Completed cleanup jobs" duration=11.299475ms 2024-03-30T12:30:07.543 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.293+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.543 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.314+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.544 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.333+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.544 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.352+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.544 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.375+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.544 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.395+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.544 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.414+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.544 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.435+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.544 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.454+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.544 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.473+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.544 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.492+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.544 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.512+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.544 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.532+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.545 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.299+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.545 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.336+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.545 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.372+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.545 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.402+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.545 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.431+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.545 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.463+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.545 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.497+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.545 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.529+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.545 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7-activate[103701]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-30T12:30:07.545 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7-activate[103701]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-7 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-03-30T12:30:07.546 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:07 smithi162 bash[103687]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-30T12:30:07.546 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:07 smithi162 bash[103687]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-7 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-03-30T12:30:07.546 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:07 smithi162 bash[103687]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-03-30T12:30:07.546 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:07 smithi162 bash[103687]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-03-30T12:30:07.546 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:07 smithi162 bash[103687]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-7/block 2024-03-30T12:30:07.546 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:07 smithi162 bash[103687]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-30T12:30:07.546 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:07 smithi162 bash[103687]: --> ceph-volume raw activate successful for osd ID: 7 2024-03-30T12:30:07.546 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7-activate[103701]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-03-30T12:30:07.546 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7-activate[103701]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-03-30T12:30:07.546 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7-activate[103701]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-7/block 2024-03-30T12:30:07.546 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7-activate[103701]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-30T12:30:07.546 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7-activate[103701]: --> ceph-volume raw activate successful for osd ID: 7 2024-03-30T12:30:07.546 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:07 smithi162 podman[103687]: 2024-03-30 12:30:07.5380212 +0000 UTC m=+1.255089941 container died e9c1d890ae6744b160a8a96fa9d36cfa04600f0cdb67d4e16c91d4ac725eadef (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7-activate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-03-30T12:30:07.799 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.568+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.799 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.590+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.799 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.618+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.799 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.649+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.799 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.684+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.800 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.712+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.800 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.739+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.800 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.767+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.800 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.795+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:07.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.551+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.573+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.590+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.607+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.623+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.640+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.800 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.656+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.801 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.673+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.801 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.691+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.801 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.708+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.801 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.725+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.801 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.741+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.801 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.759+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.801 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.776+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.801 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.791+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.801 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.807+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:07.936 INFO:tasks.rados.rados.0.smithi084.stdout:2149: done (0 left) 2024-03-30T12:30:07.937 INFO:tasks.rados.rados.0.smithi084.stdout:2150: delete oid 40 current snap is 232 2024-03-30T12:30:07.943 INFO:tasks.rados.rados.0.smithi084.stdout:2150: done (0 left) 2024-03-30T12:30:07.943 INFO:tasks.rados.rados.0.smithi084.stdout:2151: snap_remove snap 213 2024-03-30T12:30:08.058 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.824+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.843+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.859+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.875+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.893+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.911+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.927+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.947+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.967+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.983+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:07.998+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.018+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.037+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.054+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.060 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:08.060 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:08.060 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:08.060 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-mon[83709]: Health check update: Degraded data redundancy: 81/936 objects degraded (8.654%), 12 pgs degraded (PG_DEGRADED) 2024-03-30T12:30:08.060 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-mon[83709]: osdmap e524: 8 total, 7 up, 8 in 2024-03-30T12:30:08.060 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:08.060 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:08.060 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.825+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.060 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.853+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.882+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.910+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.944+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:07.976+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.006+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.039+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.066+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:07.950+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:08.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:07.950+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:08.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:07.947+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:08.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:07.950+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:08.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:07.950+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:08.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:07.950+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:08.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:07.950+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:08.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:08.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:08.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:08.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:07 smithi084 ceph-mon[91810]: Health check update: Degraded data redundancy: 81/936 objects degraded (8.654%), 12 pgs degraded (PG_DEGRADED) 2024-03-30T12:30:08.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:07 smithi084 ceph-mon[91810]: osdmap e524: 8 total, 7 up, 8 in 2024-03-30T12:30:08.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:08.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:08.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:08.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:08.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:08.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:07 smithi084 ceph-mon[89279]: Health check update: Degraded data redundancy: 81/936 objects degraded (8.654%), 12 pgs degraded (PG_DEGRADED) 2024-03-30T12:30:08.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:07 smithi084 ceph-mon[89279]: osdmap e524: 8 total, 7 up, 8 in 2024-03-30T12:30:08.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:08.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:08.310 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.094+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.311 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.127+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.311 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.148+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.311 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.175+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.311 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.207+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.311 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.236+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.311 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.265+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.311 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.295+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.311 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.072+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.311 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.088+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.311 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.104+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.312 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.125+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.312 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.153+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.312 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.170+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.312 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.186+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.312 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.201+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.312 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.217+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.312 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.236+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.312 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.252+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.312 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.270+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.312 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.286+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.312 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.302+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.312 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.318+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.571 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.322+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.572 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.352+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.572 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.379+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.572 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.442+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.572 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.470+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.572 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.500+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.572 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.531+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.572 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.563+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.572 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.579+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.572 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.334+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.572 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.352+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.572 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.367+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.380+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.428+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.443+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.458+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.474+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.493+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.509+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.526+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.543+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.573 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.561+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.837 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.605+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.837 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.635+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.837 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.668+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.837 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.698+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.838 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.732+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.838 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.765+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.838 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.794+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.838 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.823+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:08.838 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.580+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.838 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.599+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.838 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.614+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.838 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.631+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.838 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.649+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.838 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.665+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.838 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.681+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.839 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.697+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.839 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.714+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.839 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.731+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.839 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.746+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.839 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.764+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.839 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.780+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.839 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.797+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.839 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.813+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.839 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.829+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.839 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.845+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:08.945 INFO:tasks.rados.rados.0.smithi084.stdout:2151: done (0 left) 2024-03-30T12:30:08.974 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 232 2024-03-30T12:30:08.974 INFO:tasks.rados.rados.0.smithi084.stdout:2152: seq_num 654 ranges {7020544=557056,7577600=630784,8208384=172032} 2024-03-30T12:30:08.987 INFO:tasks.rados.rados.0.smithi084.stdout:2152: writing smithi08477944-5 from 7020544 to 7577600 tid 1 2024-03-30T12:30:08.991 INFO:tasks.rados.rados.0.smithi084.stdout:2152: writing smithi08477944-5 from 7577600 to 8208384 tid 2 2024-03-30T12:30:08.993 INFO:tasks.rados.rados.0.smithi084.stdout:2152: writing smithi08477944-5 from 8208384 to 8380416 tid 3 2024-03-30T12:30:08.993 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 232 2024-03-30T12:30:08.993 INFO:tasks.rados.rados.0.smithi084.stdout:2152: finishing write tid 1 to smithi08477944-5 2024-03-30T12:30:08.993 INFO:tasks.rados.rados.0.smithi084.stdout:2153: seq_num 655 ranges {1179648=573440,1753088=516096,2269184=286720} 2024-03-30T12:30:09.003 INFO:tasks.rados.rados.0.smithi084.stdout:2153: writing smithi08477944-24 from 1179648 to 1753088 tid 1 2024-03-30T12:30:09.006 INFO:tasks.rados.rados.0.smithi084.stdout:2153: writing smithi08477944-24 from 1753088 to 2269184 tid 2 2024-03-30T12:30:09.008 INFO:tasks.rados.rados.0.smithi084.stdout:2153: writing smithi08477944-24 from 2269184 to 2555904 tid 3 2024-03-30T12:30:09.008 INFO:tasks.rados.rados.0.smithi084.stdout:2154: rollback oid 13 current snap is 232 2024-03-30T12:30:09.008 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 13 to 231 2024-03-30T12:30:09.008 INFO:tasks.rados.rados.0.smithi084.stdout:2152: finishing write tid 2 to smithi08477944-5 2024-03-30T12:30:09.008 INFO:tasks.rados.rados.0.smithi084.stdout:2152: finishing write tid 3 to smithi08477944-5 2024-03-30T12:30:09.008 INFO:tasks.rados.rados.0.smithi084.stdout:2152: finishing write tid 4 to smithi08477944-5 2024-03-30T12:30:09.009 INFO:tasks.rados.rados.0.smithi084.stdout:2152: finishing write tid 5 to smithi08477944-5 2024-03-30T12:30:09.009 INFO:tasks.rados.rados.0.smithi084.stdout:2152: oid 5 updating version 0 to 955 2024-03-30T12:30:09.009 INFO:tasks.rados.rados.0.smithi084.stdout:2152: oid 5 updating version 955 to 956 2024-03-30T12:30:09.009 INFO:tasks.rados.rados.0.smithi084.stdout:2152: oid 5 version 956 is already newer than 953 2024-03-30T12:30:09.009 INFO:tasks.rados.rados.0.smithi084.stdout:2152: oid 5 version 956 is already newer than 954 2024-03-30T12:30:09.009 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 956 (ObjNum 654 snap 232 seq_num 654) dirty exists 2024-03-30T12:30:09.009 INFO:tasks.rados.rados.0.smithi084.stdout:2152: left oid 5 (ObjNum 654 snap 232 seq_num 654) 2024-03-30T12:30:09.009 INFO:tasks.rados.rados.0.smithi084.stdout:2152: done (2 left) 2024-03-30T12:30:09.009 INFO:tasks.rados.rados.0.smithi084.stdout:2155: delete oid 45 current snap is 232 2024-03-30T12:30:09.026 INFO:tasks.rados.rados.0.smithi084.stdout:2155: done (2 left) 2024-03-30T12:30:09.026 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 232 2024-03-30T12:30:09.026 INFO:tasks.rados.rados.0.smithi084.stdout:2156: seq_num 657 ranges {0=606208,606208=688128,1294336=114688} 2024-03-30T12:30:09.029 INFO:tasks.rados.rados.0.smithi084.stdout:2156: writing smithi08477944-9 from 0 to 606208 tid 1 2024-03-30T12:30:09.033 INFO:tasks.rados.rados.0.smithi084.stdout:2156: writing smithi08477944-9 from 606208 to 1294336 tid 2 2024-03-30T12:30:09.034 INFO:tasks.rados.rados.0.smithi084.stdout:2156: writing smithi08477944-9 from 1294336 to 1409024 tid 3 2024-03-30T12:30:09.034 INFO:tasks.rados.rados.0.smithi084.stdout:2157: delete oid 44 current snap is 232 2024-03-30T12:30:09.040 INFO:tasks.rados.rados.0.smithi084.stdout:2157: done (3 left) 2024-03-30T12:30:09.040 INFO:tasks.rados.rados.0.smithi084.stdout:2158: snap_remove snap 188 2024-03-30T12:30:09.095 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:09.095 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:09.095 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:09.095 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-mon[83709]: osdmap e525: 8 total, 7 up, 8 in 2024-03-30T12:30:09.095 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:09.096 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:09.096 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:09.096 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:09.096 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:09.096 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-mon[83709]: pgmap v472: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 38 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 468 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 5.0 MiB/s rd, 2.1 MiB/s wr, 16 op/s; 82/945 objects degraded (8.677%) 2024-03-30T12:30:09.096 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.864+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.096 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.881+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.096 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.897+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.096 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.913+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.096 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.929+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.096 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.949+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.096 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.970+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.097 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:08.988+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.097 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.009+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.097 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.054+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.097 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.071+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.097 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.090+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.097 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.853+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.097 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.869+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.097 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.893+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.097 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.927+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.097 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.959+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.097 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:08.980+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.097 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.005+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.097 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.075+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.098 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.103+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:08.956+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:09.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:08.957+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:09.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:08.950+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:09.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:08.950+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:09.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:08.950+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:09.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:08 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:09.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:09.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:09.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:08 smithi084 ceph-mon[91810]: osdmap e525: 8 total, 7 up, 8 in 2024-03-30T12:30:09.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:09.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:08 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:09.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:09.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:09.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:09.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:08 smithi084 ceph-mon[91810]: pgmap v472: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 38 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 468 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 5.0 MiB/s rd, 2.1 MiB/s wr, 16 op/s; 82/945 objects degraded (8.677%) 2024-03-30T12:30:09.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:08 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:09.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:09.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:09.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:08 smithi084 ceph-mon[89279]: osdmap e525: 8 total, 7 up, 8 in 2024-03-30T12:30:09.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:09.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:08 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:09.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:09.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:09.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:09.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:08 smithi084 ceph-mon[89279]: pgmap v472: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 38 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 468 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 5.0 MiB/s rd, 2.1 MiB/s wr, 16 op/s; 82/945 objects degraded (8.677%) 2024-03-30T12:30:09.350 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.137+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.350 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.164+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.351 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.264+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.351 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.296+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.351 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.324+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.351 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.346+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.106+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.121+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.137+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.155+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.170+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.257+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.273+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.351 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.289+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.352 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.305+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.352 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.321+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.352 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.342+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.352 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.358+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.610 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.375+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.390+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.406+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.422+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.439+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.455+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.472+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.490+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.508+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.527+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.547+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.565+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.585+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.611 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.604+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.612 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:09 smithi162 podman[103823]: 2024-03-30 12:30:09.525146504 +0000 UTC m=+1.976966026 container remove e9c1d890ae6744b160a8a96fa9d36cfa04600f0cdb67d4e16c91d4ac725eadef (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7-activate, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-03-30T12:30:09.612 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.374+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.612 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.403+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.612 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.437+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.612 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.466+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.612 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.495+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.612 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.523+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.612 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.556+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.612 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.587+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:30:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:30:09] "GET /metrics HTTP/1.1" 200 36330 "" "Prometheus/2.43.0" 2024-03-30T12:30:09.869 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:09 smithi162 podman[103875]: 2024-03-30 12:30:09.718251862 +0000 UTC m=+0.030776056 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:30:09.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:09 smithi162 podman[103875]: 2024-03-30 12:30:09.860392842 +0000 UTC m=+0.172917041 container create b83812c70d9a3f246b4cb567843ce422d155fbd2bc2c16180c08687979c5c371 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3) 2024-03-30T12:30:09.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.618+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.651+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.673+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.703+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.736+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.767+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.796+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.825+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.848+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:09.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.626+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.647+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.664+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.684+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.704+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.726+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.745+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.763+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.780+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.796+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.872 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.814+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.872 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.831+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.872 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.847+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.872 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.864+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:09.951 INFO:tasks.rados.rados.0.smithi084.stdout:2158: done (3 left) 2024-03-30T12:30:09.951 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 232 2024-03-30T12:30:09.951 INFO:tasks.rados.rados.0.smithi084.stdout:2159: seq_num 659 ranges {0=647168,647168=450560,1097728=352256} 2024-03-30T12:30:09.955 INFO:tasks.rados.rados.0.smithi084.stdout:2159: writing smithi08477944-41 from 0 to 647168 tid 1 2024-03-30T12:30:09.958 INFO:tasks.rados.rados.0.smithi084.stdout:2159: writing smithi08477944-41 from 647168 to 1097728 tid 2 2024-03-30T12:30:09.961 INFO:tasks.rados.rados.0.smithi084.stdout:2159: writing smithi08477944-41 from 1097728 to 1449984 tid 3 2024-03-30T12:30:09.961 INFO:tasks.rados.rados.0.smithi084.stdout:2160: snap_remove snap 222 2024-03-30T12:30:10.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:10.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-mon[83709]: osdmap e526: 8 total, 7 up, 8 in 2024-03-30T12:30:10.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:10.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:10.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:10.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:10.127 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:10 smithi162 podman[103875]: 2024-03-30 12:30:10.121480436 +0000 UTC m=+0.434004642 container init b83812c70d9a3f246b4cb567843ce422d155fbd2bc2c16180c08687979c5c371 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.license=GPLv2) 2024-03-30T12:30:10.127 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:10 smithi162 podman[103875]: 2024-03-30 12:30:10.126259163 +0000 UTC m=+0.438783363 container start b83812c70d9a3f246b4cb567843ce422d155fbd2bc2c16180c08687979c5c371 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True) 2024-03-30T12:30:10.127 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.880+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.127 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.901+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.127 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.923+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.127 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.952+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.127 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:09.988+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.128 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.022+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.128 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.056+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.128 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.077+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.128 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.096+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.128 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.123+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.128 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.880+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.128 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.900+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.128 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.918+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.128 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.934+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.128 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.952+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.128 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.975+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.128 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:09.993+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.128 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.013+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.129 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.030+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.129 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.046+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.129 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.064+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.129 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.080+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.129 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.097+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.129 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.113+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.129 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.133+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:09.959+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:10.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:09.959+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:10.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:10.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:09 smithi084 ceph-mon[91810]: osdmap e526: 8 total, 7 up, 8 in 2024-03-30T12:30:10.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:10.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:10.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:10.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:10.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:09.956+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:10.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:09.956+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:10.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:09.957+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:10.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:09.957+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:10.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:09.957+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:10.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:10.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:09 smithi084 ceph-mon[89279]: osdmap e526: 8 total, 7 up, 8 in 2024-03-30T12:30:10.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:10.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:10.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:10.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:10.386 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-osd[103893]: -- 172.21.15.162:0/1339802888 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559eb322d680 con 0x559eb31f6c00 2024-03-30T12:30:10.387 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:10 smithi162 bash[103875]: b83812c70d9a3f246b4cb567843ce422d155fbd2bc2c16180c08687979c5c371 2024-03-30T12:30:10.387 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:10 smithi162 systemd[1]: Started Ceph osd.7 for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:30:10.387 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.159+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.387 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.192+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.387 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.222+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.387 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.251+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.387 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.282+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.387 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.318+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.388 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.350+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.388 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.382+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.388 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.153+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.388 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.169+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.388 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.185+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.388 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.201+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.388 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.218+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.388 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.236+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.388 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.252+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.388 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.267+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.388 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.287+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.389 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.305+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.389 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.325+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.389 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.343+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.389 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.362+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.389 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.378+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.389 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.395+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.638 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.411+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.638 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.430+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.638 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.449+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.638 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.467+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.638 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.487+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.638 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.505+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.638 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.524+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.638 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.541+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.638 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.557+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.638 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.575+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.639 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.594+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.639 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.610+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.639 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.628+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.639 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.401+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.639 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.430+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.639 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.466+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.639 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.500+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.639 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.534+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.639 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.571+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.639 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.602+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.640 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.635+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.904 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.646+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.904 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.664+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.904 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.686+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.904 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.705+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.904 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.725+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.904 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.744+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.904 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.763+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.904 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.785+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.904 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.803+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.904 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.824+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.904 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.846+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.905 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.865+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.905 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.886+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.905 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.911+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:10.905 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:10.670+0000 7f9dee2327c0 -1 Falling back to public interface 2024-03-30T12:30:10.905 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.668+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.905 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.712+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.906 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.741+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.906 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.779+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.906 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.811+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.906 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.840+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.906 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.881+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:10.964 INFO:tasks.rados.rados.0.smithi084.stdout:2160: done (4 left) 2024-03-30T12:30:10.964 INFO:tasks.rados.rados.0.smithi084.stdout:2161: copy_from oid 19 from oid 20 current snap is 232 2024-03-30T12:30:10.964 INFO:tasks.rados.rados.0.smithi084.stdout:2162: read oid 45 snap 224 2024-03-30T12:30:10.964 INFO:tasks.rados.rados.0.smithi084.stdout:2162: expect (ObjNum 530 snap 178 seq_num 530) 2024-03-30T12:30:10.964 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 232 2024-03-30T12:30:10.964 INFO:tasks.rados.rados.0.smithi084.stdout:2163: seq_num 660 ranges {606208=663552,1269760=737280,2007040=65536} 2024-03-30T12:30:10.971 INFO:tasks.rados.rados.0.smithi084.stdout:2163: writing smithi08477944-7 from 606208 to 1269760 tid 1 2024-03-30T12:30:10.977 INFO:tasks.rados.rados.0.smithi084.stdout:2163: writing smithi08477944-7 from 1269760 to 2007040 tid 2 2024-03-30T12:30:10.977 INFO:tasks.rados.rados.0.smithi084.stdout:2163: writing smithi08477944-7 from 2007040 to 2072576 tid 3 2024-03-30T12:30:10.977 INFO:tasks.rados.rados.0.smithi084.stdout:2164: snap_remove snap 215 2024-03-30T12:30:11.169 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.915+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.169 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.944+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.169 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:10.976+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.169 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.009+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.169 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.049+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.170 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.083+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.170 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.112+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.170 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.148+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.170 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-mon[83709]: osdmap e527: 8 total, 7 up, 8 in 2024-03-30T12:30:11.170 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:11.170 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:11.170 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:11.170 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:11.170 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:11.171 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:11.171 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:11.171 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:30:11.171 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-mon[83709]: pgmap v475: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 38 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 470 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 3.7 MiB/s rd, 972 KiB/s wr, 5 op/s; 82/948 objects degraded (8.650%) 2024-03-30T12:30:11.171 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.933+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.171 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.953+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.171 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:10.988+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.171 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.012+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.171 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.031+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.171 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.052+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.171 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.073+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.172 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.093+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.172 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.115+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.172 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.135+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.172 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.153+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.172 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.177+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:10.975+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:11.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:10.976+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:11.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:10.968+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:11.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:10.968+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:11.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:10.969+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:11.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:10 smithi084 ceph-mon[89279]: osdmap e527: 8 total, 7 up, 8 in 2024-03-30T12:30:11.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:11.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:11.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:11.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:11.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:11.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:10 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:11.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:10 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:11.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:10 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:30:11.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:10 smithi084 ceph-mon[89279]: pgmap v475: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 38 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 470 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 3.7 MiB/s rd, 972 KiB/s wr, 5 op/s; 82/948 objects degraded (8.650%) 2024-03-30T12:30:11.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:10 smithi084 ceph-mon[91810]: osdmap e527: 8 total, 7 up, 8 in 2024-03-30T12:30:11.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:11.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:11.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:11.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:11.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:11.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:10 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:11.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:10 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:11.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:10 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:30:11.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:10 smithi084 ceph-mon[91810]: pgmap v475: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 38 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 470 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 3.7 MiB/s rd, 972 KiB/s wr, 5 op/s; 82/948 objects degraded (8.650%) 2024-03-30T12:30:11.436 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.182+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.436 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.212+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.436 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.249+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.436 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.285+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.436 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.322+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.436 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.353+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.436 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.390+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.436 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.422+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.198+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.218+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.239+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.258+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.278+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.298+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.317+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.338+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.357+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.375+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.437 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.392+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.438 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.409+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.438 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.426+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.690 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.444+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.690 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.460+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.690 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.475+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.690 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.491+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.691 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.511+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.691 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.527+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.691 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.542+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.691 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.559+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.691 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.577+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.691 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.596+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.691 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.617+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.691 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.639+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.691 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.658+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.691 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.678+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.692 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.449+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.692 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.482+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.692 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.512+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.692 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.544+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.692 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.576+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.692 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.606+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.692 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.634+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.692 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.666+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.692 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.698+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.956 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.698+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.956 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.721+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.956 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.741+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.956 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.765+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.957 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.785+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.957 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.803+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.957 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.823+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.957 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.840+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.957 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.857+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.957 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.875+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.957 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.895+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.957 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.912+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.957 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.930+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.957 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.947+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:11.957 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.727+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.958 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.768+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.958 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.800+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.958 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.829+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.958 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.861+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.958 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.888+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.958 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.918+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.958 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.944+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:11.983 INFO:tasks.rados.rados.0.smithi084.stdout:2156: finishing write tid 1 to smithi08477944-9 2024-03-30T12:30:11.983 INFO:tasks.rados.rados.0.smithi084.stdout:2156: finishing write tid 2 to smithi08477944-9 2024-03-30T12:30:11.983 INFO:tasks.rados.rados.0.smithi084.stdout:2156: finishing write tid 3 to smithi08477944-9 2024-03-30T12:30:11.983 INFO:tasks.rados.rados.0.smithi084.stdout:2156: finishing write tid 4 to smithi08477944-9 2024-03-30T12:30:11.983 INFO:tasks.rados.rados.0.smithi084.stdout:2153: finishing write tid 1 to smithi08477944-24 2024-03-30T12:30:11.983 INFO:tasks.rados.rados.0.smithi084.stdout:2153: finishing write tid 2 to smithi08477944-24 2024-03-30T12:30:11.983 INFO:tasks.rados.rados.0.smithi084.stdout:2153: finishing write tid 3 to smithi08477944-24 2024-03-30T12:30:11.983 INFO:tasks.rados.rados.0.smithi084.stdout:2153: finishing write tid 4 to smithi08477944-24 2024-03-30T12:30:11.983 INFO:tasks.rados.rados.0.smithi084.stdout:2156: finishing write tid 5 to smithi08477944-9 2024-03-30T12:30:11.983 INFO:tasks.rados.rados.0.smithi084.stdout:2156: oid 9 updating version 0 to 22487 2024-03-30T12:30:11.983 INFO:tasks.rados.rados.0.smithi084.stdout:2156: oid 9 updating version 22487 to 22490 2024-03-30T12:30:11.983 INFO:tasks.rados.rados.0.smithi084.stdout:2156: oid 9 version 22490 is already newer than 22489 2024-03-30T12:30:11.983 INFO:tasks.rados.rados.0.smithi084.stdout:2156: oid 9 version 22490 is already newer than 22488 2024-03-30T12:30:11.983 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 22490 (ObjNum 657 snap 232 seq_num 657) dirty exists 2024-03-30T12:30:11.983 INFO:tasks.rados.rados.0.smithi084.stdout:2156: left oid 9 (ObjNum 657 snap 232 seq_num 657) 2024-03-30T12:30:11.984 INFO:tasks.rados.rados.0.smithi084.stdout:2153: finishing write tid 5 to smithi08477944-24 2024-03-30T12:30:11.984 INFO:tasks.rados.rados.0.smithi084.stdout:2153: oid 24 updating version 0 to 8621 2024-03-30T12:30:11.984 INFO:tasks.rados.rados.0.smithi084.stdout:2153: oid 24 version 8621 is already newer than 8620 2024-03-30T12:30:11.984 INFO:tasks.rados.rados.0.smithi084.stdout:2153: oid 24 version 8621 is already newer than 8618 2024-03-30T12:30:11.984 INFO:tasks.rados.rados.0.smithi084.stdout:2153: oid 24 version 8621 is already newer than 8619 2024-03-30T12:30:11.984 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 8621 (ObjNum 655 snap 232 seq_num 655) dirty exists 2024-03-30T12:30:11.984 INFO:tasks.rados.rados.0.smithi084.stdout:2153: left oid 24 (ObjNum 655 snap 232 seq_num 655) 2024-03-30T12:30:11.984 INFO:tasks.rados.rados.0.smithi084.stdout:2154: finishing rollback tid 1 to smithi08477944-13 2024-03-30T12:30:11.984 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 8076 (ObjNum 289 snap 0 seq_num 1) dirty dne 2024-03-30T12:30:11.984 INFO:tasks.rados.rados.0.smithi084.stdout:2159: finishing write tid 1 to smithi08477944-41 2024-03-30T12:30:11.984 INFO:tasks.rados.rados.0.smithi084.stdout:2159: finishing write tid 2 to smithi08477944-41 2024-03-30T12:30:11.984 INFO:tasks.rados.rados.0.smithi084.stdout:2159: finishing write tid 3 to smithi08477944-41 2024-03-30T12:30:11.984 INFO:tasks.rados.rados.0.smithi084.stdout:2159: finishing write tid 4 to smithi08477944-41 2024-03-30T12:30:11.984 INFO:tasks.rados.rados.0.smithi084.stdout:2159: finishing write tid 5 to smithi08477944-41 2024-03-30T12:30:11.984 INFO:tasks.rados.rados.0.smithi084.stdout:2159: oid 41 updating version 0 to 965 2024-03-30T12:30:11.985 INFO:tasks.rados.rados.0.smithi084.stdout:2159: oid 41 version 965 is already newer than 964 2024-03-30T12:30:11.985 INFO:tasks.rados.rados.0.smithi084.stdout:2159: oid 41 version 965 is already newer than 962 2024-03-30T12:30:11.985 INFO:tasks.rados.rados.0.smithi084.stdout:2159: oid 41 version 965 is already newer than 963 2024-03-30T12:30:11.985 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 965 (ObjNum 659 snap 232 seq_num 659) dirty exists 2024-03-30T12:30:11.985 INFO:tasks.rados.rados.0.smithi084.stdout:2159: left oid 41 (ObjNum 659 snap 232 seq_num 659) 2024-03-30T12:30:11.985 INFO:tasks.rados.rados.0.smithi084.stdout:2163: finishing write tid 1 to smithi08477944-7 2024-03-30T12:30:11.985 INFO:tasks.rados.rados.0.smithi084.stdout:2163: finishing write tid 2 to smithi08477944-7 2024-03-30T12:30:11.985 INFO:tasks.rados.rados.0.smithi084.stdout:2163: finishing write tid 3 to smithi08477944-7 2024-03-30T12:30:11.985 INFO:tasks.rados.rados.0.smithi084.stdout:2163: finishing write tid 4 to smithi08477944-7 2024-03-30T12:30:11.985 INFO:tasks.rados.rados.0.smithi084.stdout:2163: finishing write tid 5 to smithi08477944-7 2024-03-30T12:30:11.985 INFO:tasks.rados.rados.0.smithi084.stdout:2163: oid 7 updating version 0 to 17496 2024-03-30T12:30:11.985 INFO:tasks.rados.rados.0.smithi084.stdout:2163: oid 7 version 17496 is already newer than 17495 2024-03-30T12:30:11.985 INFO:tasks.rados.rados.0.smithi084.stdout:2163: oid 7 updating version 17496 to 17497 2024-03-30T12:30:11.985 INFO:tasks.rados.rados.0.smithi084.stdout:2163: oid 7 updating version 17497 to 17498 2024-03-30T12:30:11.985 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 17498 (ObjNum 660 snap 232 seq_num 660) dirty exists 2024-03-30T12:30:11.986 INFO:tasks.rados.rados.0.smithi084.stdout:2163: left oid 7 (ObjNum 660 snap 232 seq_num 660) 2024-03-30T12:30:11.986 INFO:tasks.rados.rados.0.smithi084.stdout:2162: expect (ObjNum 530 snap 178 seq_num 530) 2024-03-30T12:30:12.214 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:11.974+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.214 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.004+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.214 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.036+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.214 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.069+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.214 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.099+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.214 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.142+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.214 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.179+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.215 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.205+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.215 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:12.215 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:12.215 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:12.215 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-mon[83709]: osdmap e528: 8 total, 7 up, 8 in 2024-03-30T12:30:12.215 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:12.215 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:12.216 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.964+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.216 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:11.984+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.216 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.007+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.216 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.024+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.216 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.046+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.216 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.066+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.216 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.086+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.216 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.111+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.216 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.134+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.216 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.153+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.216 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.177+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.217 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.198+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.217 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.222+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:11.989+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:12.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:11.991+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:12.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:11.987+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:12.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:11.987+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:12.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:11.987+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:12.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:11.989+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:12.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:11.989+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:12.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:12.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:12.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:12.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:11 smithi084 ceph-mon[91810]: osdmap e528: 8 total, 7 up, 8 in 2024-03-30T12:30:12.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:12.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:12.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 116=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:12.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:12.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:12.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:11 smithi084 ceph-mon[89279]: osdmap e528: 8 total, 7 up, 8 in 2024-03-30T12:30:12.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:12.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:12.478 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.241+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.478 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.260+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.478 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.278+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.478 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.301+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.478 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.320+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.479 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.340+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.479 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.359+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.479 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.382+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.479 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.405+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.479 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.425+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.479 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.445+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.479 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.465+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.479 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.233+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.479 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.268+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.480 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.295+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.480 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.330+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.480 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.364+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.480 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.394+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.480 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.425+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.480 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.461+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.544 INFO:tasks.rados.rados.0.smithi084.stdout:2161: finishing copy_from racing read to smithi08477944-19 2024-03-30T12:30:12.544 INFO:tasks.rados.rados.0.smithi084.stdout:2161: finishing copy_from to smithi08477944-19 2024-03-30T12:30:12.544 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 17490 (ObjNum 565 snap 194 seq_num 565) dirty exists 2024-03-30T12:30:12.544 INFO:tasks.rados.rados.0.smithi084.stdout:2153: done (7 left) 2024-03-30T12:30:12.545 INFO:tasks.rados.rados.0.smithi084.stdout:2154: done (6 left) 2024-03-30T12:30:12.545 INFO:tasks.rados.rados.0.smithi084.stdout:2156: done (5 left) 2024-03-30T12:30:12.545 INFO:tasks.rados.rados.0.smithi084.stdout:2159: done (4 left) 2024-03-30T12:30:12.545 INFO:tasks.rados.rados.0.smithi084.stdout:2161: done (3 left) 2024-03-30T12:30:12.545 INFO:tasks.rados.rados.0.smithi084.stdout:2162: done (2 left) 2024-03-30T12:30:12.545 INFO:tasks.rados.rados.0.smithi084.stdout:2163: done (1 left) 2024-03-30T12:30:12.545 INFO:tasks.rados.rados.0.smithi084.stdout:2164: done (0 left) 2024-03-30T12:30:12.545 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 232 2024-03-30T12:30:12.545 INFO:tasks.rados.rados.0.smithi084.stdout:2165: seq_num 661 ranges {0=679936,679936=622592,1302528=180224} 2024-03-30T12:30:12.547 INFO:tasks.rados.rados.0.smithi084.stdout:2165: writing smithi08477944-16 from 0 to 679936 tid 1 2024-03-30T12:30:12.551 INFO:tasks.rados.rados.0.smithi084.stdout:2165: writing smithi08477944-16 from 679936 to 1302528 tid 2 2024-03-30T12:30:12.553 INFO:tasks.rados.rados.0.smithi084.stdout:2165: writing smithi08477944-16 from 1302528 to 1482752 tid 3 2024-03-30T12:30:12.553 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 232 2024-03-30T12:30:12.553 INFO:tasks.rados.rados.0.smithi084.stdout:2166: seq_num 662 ranges {1769472=696320,2465792=557056,3022848=245760} 2024-03-30T12:30:12.567 INFO:tasks.rados.rados.0.smithi084.stdout:2166: writing smithi08477944-4 from 1769472 to 2465792 tid 1 2024-03-30T12:30:12.570 INFO:tasks.rados.rados.0.smithi084.stdout:2166: writing smithi08477944-4 from 2465792 to 3022848 tid 2 2024-03-30T12:30:12.574 INFO:tasks.rados.rados.0.smithi084.stdout:2166: writing smithi08477944-4 from 3022848 to 3268608 tid 3 2024-03-30T12:30:12.574 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 232 2024-03-30T12:30:12.574 INFO:tasks.rados.rados.0.smithi084.stdout:2165: finishing write tid 1 to smithi08477944-16 2024-03-30T12:30:12.574 INFO:tasks.rados.rados.0.smithi084.stdout:2165: finishing write tid 2 to smithi08477944-16 2024-03-30T12:30:12.574 INFO:tasks.rados.rados.0.smithi084.stdout:2165: finishing write tid 3 to smithi08477944-16 2024-03-30T12:30:12.574 INFO:tasks.rados.rados.0.smithi084.stdout:2165: finishing write tid 4 to smithi08477944-16 2024-03-30T12:30:12.575 INFO:tasks.rados.rados.0.smithi084.stdout:2165: finishing write tid 5 to smithi08477944-16 2024-03-30T12:30:12.575 INFO:tasks.rados.rados.0.smithi084.stdout:2165: oid 16 updating version 0 to 967 2024-03-30T12:30:12.575 INFO:tasks.rados.rados.0.smithi084.stdout:2165: oid 16 updating version 967 to 968 2024-03-30T12:30:12.575 INFO:tasks.rados.rados.0.smithi084.stdout:2165: oid 16 updating version 968 to 969 2024-03-30T12:30:12.575 INFO:tasks.rados.rados.0.smithi084.stdout:2165: oid 16 version 969 is already newer than 966 2024-03-30T12:30:12.575 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 969 (ObjNum 661 snap 232 seq_num 661) dirty exists 2024-03-30T12:30:12.575 INFO:tasks.rados.rados.0.smithi084.stdout:2165: left oid 16 (ObjNum 661 snap 232 seq_num 661) 2024-03-30T12:30:12.575 INFO:tasks.rados.rados.0.smithi084.stdout:2166: finishing write tid 1 to smithi08477944-4 2024-03-30T12:30:12.575 INFO:tasks.rados.rados.0.smithi084.stdout:2167: seq_num 663 ranges {11436032=712704,12148736=442368,12591104=360448} 2024-03-30T12:30:12.640 INFO:tasks.rados.rados.0.smithi084.stdout:2167: writing smithi08477944-25 from 11436032 to 12148736 tid 1 2024-03-30T12:30:12.643 INFO:tasks.rados.rados.0.smithi084.stdout:2167: writing smithi08477944-25 from 12148736 to 12591104 tid 2 2024-03-30T12:30:12.646 INFO:tasks.rados.rados.0.smithi084.stdout:2167: writing smithi08477944-25 from 12591104 to 12951552 tid 3 2024-03-30T12:30:12.646 INFO:tasks.rados.rados.0.smithi084.stdout:2165: done (2 left) 2024-03-30T12:30:12.646 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 232 2024-03-30T12:30:12.646 INFO:tasks.rados.rados.0.smithi084.stdout:2166: finishing write tid 2 to smithi08477944-4 2024-03-30T12:30:12.646 INFO:tasks.rados.rados.0.smithi084.stdout:2166: finishing write tid 3 to smithi08477944-4 2024-03-30T12:30:12.646 INFO:tasks.rados.rados.0.smithi084.stdout:2166: finishing write tid 4 to smithi08477944-4 2024-03-30T12:30:12.647 INFO:tasks.rados.rados.0.smithi084.stdout:2166: finishing write tid 5 to smithi08477944-4 2024-03-30T12:30:12.647 INFO:tasks.rados.rados.0.smithi084.stdout:2166: oid 4 updating version 0 to 17496 2024-03-30T12:30:12.647 INFO:tasks.rados.rados.0.smithi084.stdout:2166: oid 4 updating version 17496 to 17497 2024-03-30T12:30:12.647 INFO:tasks.rados.rados.0.smithi084.stdout:2166: oid 4 version 17497 is already newer than 17495 2024-03-30T12:30:12.647 INFO:tasks.rados.rados.0.smithi084.stdout:2166: oid 4 version 17497 is already newer than 17494 2024-03-30T12:30:12.647 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 17497 (ObjNum 662 snap 232 seq_num 662) dirty exists 2024-03-30T12:30:12.647 INFO:tasks.rados.rados.0.smithi084.stdout:2166: left oid 4 (ObjNum 662 snap 232 seq_num 662) 2024-03-30T12:30:12.647 INFO:tasks.rados.rados.0.smithi084.stdout:2168: seq_num 664 ranges {0=729088,729088=729088,1458176=73728} 2024-03-30T12:30:12.650 INFO:tasks.rados.rados.0.smithi084.stdout:2168: writing smithi08477944-45 from 0 to 729088 tid 1 2024-03-30T12:30:12.655 INFO:tasks.rados.rados.0.smithi084.stdout:2168: writing smithi08477944-45 from 729088 to 1458176 tid 2 2024-03-30T12:30:12.656 INFO:tasks.rados.rados.0.smithi084.stdout:2168: writing smithi08477944-45 from 1458176 to 1531904 tid 3 2024-03-30T12:30:12.656 INFO:tasks.rados.rados.0.smithi084.stdout:2166: done (2 left) 2024-03-30T12:30:12.656 INFO:tasks.rados.rados.0.smithi084.stdout:2169: rollback oid 16 current snap is 232 2024-03-30T12:30:12.657 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 16 to 204 2024-03-30T12:30:12.657 INFO:tasks.rados.rados.0.smithi084.stdout:2167: finishing write tid 1 to smithi08477944-25 2024-03-30T12:30:12.657 INFO:tasks.rados.rados.0.smithi084.stdout:2167: finishing write tid 2 to smithi08477944-25 2024-03-30T12:30:12.657 INFO:tasks.rados.rados.0.smithi084.stdout:2167: finishing write tid 3 to smithi08477944-25 2024-03-30T12:30:12.657 INFO:tasks.rados.rados.0.smithi084.stdout:2167: finishing write tid 4 to smithi08477944-25 2024-03-30T12:30:12.657 INFO:tasks.rados.rados.0.smithi084.stdout:2168: finishing write tid 1 to smithi08477944-45 2024-03-30T12:30:12.657 INFO:tasks.rados.rados.0.smithi084.stdout:2167: finishing write tid 5 to smithi08477944-25 2024-03-30T12:30:12.657 INFO:tasks.rados.rados.0.smithi084.stdout:2167: oid 25 updating version 0 to 957 2024-03-30T12:30:12.657 INFO:tasks.rados.rados.0.smithi084.stdout:2167: oid 25 updating version 957 to 959 2024-03-30T12:30:12.657 INFO:tasks.rados.rados.0.smithi084.stdout:2167: oid 25 updating version 959 to 960 2024-03-30T12:30:12.657 INFO:tasks.rados.rados.0.smithi084.stdout:2167: oid 25 version 960 is already newer than 958 2024-03-30T12:30:12.657 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 960 (ObjNum 663 snap 232 seq_num 663) dirty exists 2024-03-30T12:30:12.657 INFO:tasks.rados.rados.0.smithi084.stdout:2167: left oid 25 (ObjNum 663 snap 232 seq_num 663) 2024-03-30T12:30:12.657 INFO:tasks.rados.rados.0.smithi084.stdout:2167: done (2 left) 2024-03-30T12:30:12.658 INFO:tasks.rados.rados.0.smithi084.stdout:2170: snap_create 2024-03-30T12:30:12.661 INFO:tasks.rados.rados.0.smithi084.stdout:2168: finishing write tid 2 to smithi08477944-45 2024-03-30T12:30:12.662 INFO:tasks.rados.rados.0.smithi084.stdout:2168: finishing write tid 3 to smithi08477944-45 2024-03-30T12:30:12.662 INFO:tasks.rados.rados.0.smithi084.stdout:2168: finishing write tid 4 to smithi08477944-45 2024-03-30T12:30:12.662 INFO:tasks.rados.rados.0.smithi084.stdout:2169: finishing rollback tid 0 to smithi08477944-16 2024-03-30T12:30:12.663 INFO:tasks.rados.rados.0.smithi084.stdout:2169: finishing rollback tid 1 to smithi08477944-16 2024-03-30T12:30:12.663 INFO:tasks.rados.rados.0.smithi084.stdout:2169: finishing rollback tid 2 to smithi08477944-16 2024-03-30T12:30:12.663 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 976 (ObjNum 395 snap 125 seq_num 395) dirty exists 2024-03-30T12:30:12.664 INFO:tasks.rados.rados.0.smithi084.stdout:2168: finishing write tid 5 to smithi08477944-45 2024-03-30T12:30:12.664 INFO:tasks.rados.rados.0.smithi084.stdout:2168: oid 45 updating version 0 to 972 2024-03-30T12:30:12.665 INFO:tasks.rados.rados.0.smithi084.stdout:2168: oid 45 updating version 972 to 973 2024-03-30T12:30:12.665 INFO:tasks.rados.rados.0.smithi084.stdout:2168: oid 45 version 973 is already newer than 970 2024-03-30T12:30:12.665 INFO:tasks.rados.rados.0.smithi084.stdout:2168: oid 45 version 973 is already newer than 971 2024-03-30T12:30:12.665 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 973 (ObjNum 664 snap 232 seq_num 664) dirty exists 2024-03-30T12:30:12.665 INFO:tasks.rados.rados.0.smithi084.stdout:2168: left oid 45 (ObjNum 664 snap 232 seq_num 664) 2024-03-30T12:30:12.733 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.493+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.733 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.525+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.733 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.559+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.733 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.590+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.734 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.618+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.734 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.648+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.734 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.679+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.734 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.709+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.734 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.741+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.734 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.485+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.734 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.504+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.734 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.525+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.734 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.546+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.735 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.566+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.735 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.585+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.735 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.602+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.735 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.623+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.735 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.639+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.735 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.657+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.735 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.680+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.735 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.695+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.735 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.715+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.735 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.730+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.983 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.753+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.984 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.771+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.984 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.787+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.984 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.805+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.984 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.829+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.984 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.847+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.984 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.866+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.984 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.887+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.984 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.905+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.984 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.922+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.984 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.942+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.959+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.975+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:12.985 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-mon[83709]: osdmap e529: 8 total, 7 up, 8 in 2024-03-30T12:30:12.985 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.779+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.985 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.815+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.985 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.849+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.985 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.884+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.986 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.921+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.986 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.956+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:12.986 INFO:tasks.rados.rados.0.smithi084.stdout:2168: done (2 left) 2024-03-30T12:30:12.986 INFO:tasks.rados.rados.0.smithi084.stdout:2169: done (1 left) 2024-03-30T12:30:12.986 INFO:tasks.rados.rados.0.smithi084.stdout:2170: done (0 left) 2024-03-30T12:30:12.987 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 233 2024-03-30T12:30:12.987 INFO:tasks.rados.rados.0.smithi084.stdout:2171: seq_num 665 ranges {0=745472,745472=606208,1351680=196608} 2024-03-30T12:30:12.989 INFO:tasks.rados.rados.0.smithi084.stdout:2171: writing smithi08477944-10 from 0 to 745472 tid 1 2024-03-30T12:30:12.993 INFO:tasks.rados.rados.0.smithi084.stdout:2171: writing smithi08477944-10 from 745472 to 1351680 tid 2 2024-03-30T12:30:12.994 INFO:tasks.rados.rados.0.smithi084.stdout:2171: writing smithi08477944-10 from 1351680 to 1548288 tid 3 2024-03-30T12:30:12.994 INFO:tasks.rados.rados.0.smithi084.stdout:2172: read oid 21 snap -1 2024-03-30T12:30:12.995 INFO:tasks.rados.rados.0.smithi084.stdout:2172: expect deleted 2024-03-30T12:30:12.995 INFO:tasks.rados.rados.0.smithi084.stdout:2173: snap_remove snap 229 2024-03-30T12:30:13.248 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:13.248 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:13.248 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:13.248 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:13.248 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:13.248 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-mon[83709]: pgmap v478: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 38 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 477 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 255 B/s rd, 2.3 MiB/s wr, 2 op/s; 83/948 objects degraded (8.755%) 2024-03-30T12:30:13.249 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:12.990+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:13.249 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.021+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:13.249 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.044+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:13.249 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.069+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:13.249 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.106+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:13.249 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.140+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:13.249 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.171+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:13.249 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.203+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:13.249 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.234+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:13.249 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:12.995+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.250 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.018+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.250 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.034+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.250 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.055+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.250 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.071+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.250 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.093+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.250 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.115+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.250 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.134+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.250 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.153+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.250 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.176+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.250 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.195+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.250 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.216+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.250 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.235+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.251 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.256+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:12.992+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:13.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:12.992+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:13.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:12.989+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:13.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:12.989+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:13.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:12.989+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:13.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:12 smithi084 ceph-mon[91810]: osdmap e529: 8 total, 7 up, 8 in 2024-03-30T12:30:13.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:13.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:13.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:13.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:13.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:13.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:12 smithi084 ceph-mon[91810]: pgmap v478: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 38 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 477 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 255 B/s rd, 2.3 MiB/s wr, 2 op/s; 83/948 objects degraded (8.755%) 2024-03-30T12:30:13.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:12 smithi084 ceph-mon[89279]: osdmap e529: 8 total, 7 up, 8 in 2024-03-30T12:30:13.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:13.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:13.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:13.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:13.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:13.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:12 smithi084 ceph-mon[89279]: pgmap v478: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 38 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 477 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 255 B/s rd, 2.3 MiB/s wr, 2 op/s; 83/948 objects degraded (8.755%) 2024-03-30T12:30:13.500 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.280+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.500 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.302+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.500 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.329+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.500 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.351+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.500 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.376+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.500 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.403+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.500 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.431+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.500 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.454+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.500 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.480+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.500 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.500+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.501 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.267+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:13.501 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.309+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:13.501 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.350+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:13.501 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.392+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:13.501 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.434+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:13.501 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.474+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:13.770 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.529+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.770 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.550+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.770 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.572+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.770 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.594+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.770 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.614+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.770 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.634+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.770 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.652+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.770 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.675+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.770 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.697+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.770 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.726+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.771 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.753+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:13.771 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.507+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:13.771 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.539+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:13.771 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.573+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:13.771 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.610+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:13.771 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.650+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:13.771 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.692+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:13.771 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.736+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:13.772 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.777+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:13.995 INFO:tasks.rados.rados.0.smithi084.stdout:2173: done (2 left) 2024-03-30T12:30:13.995 INFO:tasks.rados.rados.0.smithi084.stdout:2174: read oid 23 snap -1 2024-03-30T12:30:13.995 INFO:tasks.rados.rados.0.smithi084.stdout:2174: expect deleted 2024-03-30T12:30:13.995 INFO:tasks.rados.rados.0.smithi084.stdout:2175: snap_create 2024-03-30T12:30:13.995 INFO:tasks.rados.rados.0.smithi084.stdout:2171: finishing write tid 1 to smithi08477944-10 2024-03-30T12:30:13.995 INFO:tasks.rados.rados.0.smithi084.stdout:2171: finishing write tid 2 to smithi08477944-10 2024-03-30T12:30:13.995 INFO:tasks.rados.rados.0.smithi084.stdout:2171: finishing write tid 3 to smithi08477944-10 2024-03-30T12:30:13.995 INFO:tasks.rados.rados.0.smithi084.stdout:2171: finishing write tid 4 to smithi08477944-10 2024-03-30T12:30:13.995 INFO:tasks.rados.rados.0.smithi084.stdout:2171: finishing write tid 5 to smithi08477944-10 2024-03-30T12:30:13.995 INFO:tasks.rados.rados.0.smithi084.stdout:2171: oid 10 updating version 0 to 23364 2024-03-30T12:30:13.995 INFO:tasks.rados.rados.0.smithi084.stdout:2171: oid 10 updating version 23364 to 23365 2024-03-30T12:30:13.996 INFO:tasks.rados.rados.0.smithi084.stdout:2171: oid 10 updating version 23365 to 23366 2024-03-30T12:30:13.996 INFO:tasks.rados.rados.0.smithi084.stdout:2171: oid 10 version 23366 is already newer than 23363 2024-03-30T12:30:13.996 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 23366 (ObjNum 665 snap 233 seq_num 665) dirty exists 2024-03-30T12:30:13.996 INFO:tasks.rados.rados.0.smithi084.stdout:2171: left oid 10 (ObjNum 665 snap 233 seq_num 665) 2024-03-30T12:30:14.034 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.779+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.034 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.806+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.034 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.833+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.035 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.858+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.035 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.883+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.035 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.903+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.035 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.923+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.035 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:13.990+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.035 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.021+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.035 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-mon[83709]: Health check update: Degraded data redundancy: 83/948 objects degraded (8.755%), 12 pgs degraded (PG_DEGRADED) 2024-03-30T12:30:14.035 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:14.035 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:14.035 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:14.035 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-mon[83709]: osdmap e530: 8 total, 7 up, 8 in 2024-03-30T12:30:14.036 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:14.036 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:14.036 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.815+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:14.036 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.851+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:14.036 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.888+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:14.036 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:13.925+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:14.036 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:14.017+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:14.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:14.004+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:14.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:14.004+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:14.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:13 smithi084 ceph-mon[89279]: Health check update: Degraded data redundancy: 83/948 objects degraded (8.755%), 12 pgs degraded (PG_DEGRADED) 2024-03-30T12:30:14.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:14.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:14.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:14.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:13 smithi084 ceph-mon[89279]: osdmap e530: 8 total, 7 up, 8 in 2024-03-30T12:30:14.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:14.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:14.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:13 smithi084 ceph-mon[91810]: Health check update: Degraded data redundancy: 83/948 objects degraded (8.755%), 12 pgs degraded (PG_DEGRADED) 2024-03-30T12:30:14.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:14.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:14.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:14.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:13 smithi084 ceph-mon[91810]: osdmap e530: 8 total, 7 up, 8 in 2024-03-30T12:30:14.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:14.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:14.296 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.042+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.296 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.066+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.296 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.087+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.296 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.108+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.296 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.131+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.296 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.152+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.297 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.173+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.297 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.192+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.297 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.218+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.297 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.238+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.297 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.259+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.297 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.280+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.297 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:14.052+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:14.297 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:14.088+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:14.297 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:14.122+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:14.297 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:14.165+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:14.298 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:14.206+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:14.298 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:14.243+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:14.298 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:14.280+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:14.566 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.304+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.566 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.327+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.566 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.345+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.567 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.367+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.567 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.423+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.567 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.445+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.567 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.467+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.567 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.489+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.567 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.512+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.567 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.532+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.567 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.554+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.567 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:14.317+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:14.567 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:14.349+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:14.567 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:14.414+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:14.568 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:14.440+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:14.568 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:14.480+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:14.568 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:14.515+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:14.568 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:14.548+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:14.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:14.583+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:14.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:14.645+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:14.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:14.679+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:14.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:14.719+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:14.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:14.755+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:14.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:14.787+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:14.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.574+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.593+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.641+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.662+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.680+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.705+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.724+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.742+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.763+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.783+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:14.996 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:14.592+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:14.996 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:14.592+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:14.996 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:14.592+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:14.996 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:14.593+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:14.996 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:14.593+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:15.001 INFO:tasks.rados.rados.0.smithi084.stdout:2171: done (3 left) 2024-03-30T12:30:15.001 INFO:tasks.rados.rados.0.smithi084.stdout:2172: done (2 left) 2024-03-30T12:30:15.001 INFO:tasks.rados.rados.0.smithi084.stdout:2174: done (1 left) 2024-03-30T12:30:15.001 INFO:tasks.rados.rados.0.smithi084.stdout:2175: done (0 left) 2024-03-30T12:30:15.001 INFO:tasks.rados.rados.0.smithi084.stdout:2176: rollback oid 30 current snap is 234 2024-03-30T12:30:15.002 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 30 to 219 2024-03-30T12:30:15.002 INFO:tasks.rados.rados.0.smithi084.stdout:2177: delete oid 21 current snap is 234 2024-03-30T12:30:15.009 INFO:tasks.rados.rados.0.smithi084.stdout:2176: finishing rollback tid 0 to smithi08477944-30 2024-03-30T12:30:15.009 INFO:tasks.rados.rados.0.smithi084.stdout:2176: finishing rollback tid 1 to smithi08477944-30 2024-03-30T12:30:15.009 INFO:tasks.rados.rados.0.smithi084.stdout:2176: finishing rollback tid 2 to smithi08477944-30 2024-03-30T12:30:15.009 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 1020 (ObjNum 536 snap 183 seq_num 536) dirty exists 2024-03-30T12:30:15.031 INFO:tasks.rados.rados.0.smithi084.stdout:2176: done (1 left) 2024-03-30T12:30:15.031 INFO:tasks.rados.rados.0.smithi084.stdout:2177: done (0 left) 2024-03-30T12:30:15.031 INFO:tasks.rados.rados.0.smithi084.stdout:2178: snap_create 2024-03-30T12:30:15.135 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-mon[83709]: osdmap e531: 8 total, 7 up, 8 in 2024-03-30T12:30:15.135 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:15.135 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:15.135 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:15.135 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:15.135 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:15.136 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-mon[83709]: pgmap v481: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 38 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 491 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 6.1 MiB/s rd, 5.1 MiB/s wr, 14 op/s; 86/963 objects degraded (8.930%) 2024-03-30T12:30:15.136 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:15.136 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:30:15.136 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.805+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.136 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.827+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.136 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.890+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.136 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.911+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.136 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.929+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.136 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.951+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.136 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.968+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.136 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:14.988+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.137 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.009+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.137 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.047+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.137 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.069+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.137 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.092+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.137 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.113+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.137 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.130+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.137 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:14.855+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.137 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:14.912+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.137 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:14.948+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.137 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:14.980+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.138 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.010+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.138 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.041+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.138 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.075+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.138 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.109+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.138 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.143+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:15.020+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:15.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:15.020+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:15.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:15.012+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:15.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:15.015+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:15.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:15.015+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:15.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:15 smithi084 ceph-mon[91810]: osdmap e531: 8 total, 7 up, 8 in 2024-03-30T12:30:15.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:15.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:15.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:15.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:15.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:15.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:15 smithi084 ceph-mon[91810]: pgmap v481: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 38 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 491 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 6.1 MiB/s rd, 5.1 MiB/s wr, 14 op/s; 86/963 objects degraded (8.930%) 2024-03-30T12:30:15.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:15 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:15.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:15 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:30:15.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:15 smithi084 ceph-mon[89279]: osdmap e531: 8 total, 7 up, 8 in 2024-03-30T12:30:15.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:15.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:15.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:15.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:15.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:15.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:15 smithi084 ceph-mon[89279]: pgmap v481: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 38 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 491 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 6.1 MiB/s rd, 5.1 MiB/s wr, 14 op/s; 86/963 objects degraded (8.930%) 2024-03-30T12:30:15.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:15 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:15.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:15 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:30:15.401 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.148+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.401 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.167+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.401 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.185+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.401 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.205+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.401 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.223+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.401 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.242+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.401 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.259+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.402 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.275+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.402 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.302+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.402 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.322+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.402 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.341+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.402 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.362+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.402 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.384+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.402 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.180+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.402 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.202+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.402 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.231+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.402 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.261+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.402 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.292+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.403 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.331+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.403 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.375+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.657 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.409+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.657 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.438+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.657 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.459+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.657 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.480+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.657 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.498+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.657 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.518+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.657 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.539+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.657 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.558+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.657 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.577+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.657 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.596+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.657 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.617+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.658 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.641+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.658 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.664+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.658 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.412+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.658 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.449+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.658 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.485+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.658 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.518+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.658 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.554+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.658 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.587+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.658 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.620+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.658 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.650+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.907 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.690+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.907 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.722+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.907 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.761+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.907 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.805+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.907 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.840+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.907 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.875+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.908 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.914+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:15.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.684+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.707+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.732+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.756+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.774+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.795+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.820+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.844+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.870+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:15.908 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.890+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.014 INFO:tasks.rados.rados.0.smithi084.stdout:2178: done (0 left) 2024-03-30T12:30:16.014 INFO:tasks.rados.rados.0.smithi084.stdout:2179: snap_create 2024-03-30T12:30:16.159 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-mon[83709]: osdmap e532: 8 total, 7 up, 8 in 2024-03-30T12:30:16.159 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:16.159 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:16.159 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:16.159 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:16.159 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:16.159 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.916+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.159 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.935+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.159 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.958+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.159 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:15.980+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.160 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.003+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.160 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.024+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.160 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.045+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.160 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.064+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.160 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.085+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.160 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.104+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.160 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.124+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.160 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.143+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.160 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.163+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.160 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.957+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.160 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:15.990+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.160 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.029+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.161 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.065+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.161 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.100+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.161 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.132+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.161 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.166+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:16.026+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:16.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:16.027+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:16.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:16 smithi084 ceph-mon[89279]: osdmap e532: 8 total, 7 up, 8 in 2024-03-30T12:30:16.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:16.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:16.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:16.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:16.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:16.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:16.019+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:16.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:16.019+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:16.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:16.019+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:16.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:16.019+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:16.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:16.019+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:16.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:16 smithi084 ceph-mon[91810]: osdmap e532: 8 total, 7 up, 8 in 2024-03-30T12:30:16.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:16.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:16.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:16.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:16.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:16.416 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.199+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.416 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.220+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.416 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.256+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.417 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.295+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.417 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.336+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.417 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.375+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.417 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.409+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.417 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.184+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.417 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.203+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.417 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.227+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.417 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.246+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.417 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.266+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.417 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.288+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.417 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.312+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.417 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.335+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.417 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.358+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.418 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.380+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.418 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.404+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.418 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.424+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.687 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.441+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.687 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.457+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.687 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.472+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.687 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.491+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.687 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.512+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.687 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.528+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.688 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.549+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.688 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.570+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.688 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.589+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.688 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.614+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.688 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.646+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.688 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.673+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.688 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.694+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.688 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.443+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.688 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.475+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.688 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.505+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.688 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.544+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.688 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.563+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.688 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.593+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.688 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.630+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.689 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.672+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.942 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.709+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.942 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.751+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.942 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.785+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.942 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.821+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.942 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.851+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.942 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.889+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.942 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.922+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:16.942 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.720+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.737+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.757+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.779+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.804+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.823+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.843+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.864+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.889+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.908+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.928+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:16.943 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.949+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.023 INFO:tasks.rados.rados.0.smithi084.stdout:2179: done (0 left) 2024-03-30T12:30:17.023 INFO:tasks.rados.rados.0.smithi084.stdout:2180: delete oid 36 current snap is 236 2024-03-30T12:30:17.031 INFO:tasks.rados.rados.0.smithi084.stdout:2180: done (0 left) 2024-03-30T12:30:17.032 INFO:tasks.rados.rados.0.smithi084.stdout:2181: delete oid 1 current snap is 236 2024-03-30T12:30:17.034 INFO:tasks.rados.rados.0.smithi084.stdout:2181: done (0 left) 2024-03-30T12:30:17.034 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 236 2024-03-30T12:30:17.034 INFO:tasks.rados.rados.0.smithi084.stdout:2182: seq_num 669 ranges {0=409600,409600=548864,958464=655360} 2024-03-30T12:30:17.036 INFO:tasks.rados.rados.0.smithi084.stdout:2182: writing smithi08477944-21 from 0 to 409600 tid 1 2024-03-30T12:30:17.039 INFO:tasks.rados.rados.0.smithi084.stdout:2182: writing smithi08477944-21 from 409600 to 958464 tid 2 2024-03-30T12:30:17.044 INFO:tasks.rados.rados.0.smithi084.stdout:2182: writing smithi08477944-21 from 958464 to 1613824 tid 3 2024-03-30T12:30:17.044 INFO:tasks.rados.rados.0.smithi084.stdout:2183: copy_from oid 19 from oid 49 current snap is 236 2024-03-30T12:30:17.044 INFO:tasks.rados.rados.0.smithi084.stdout:2184: read oid 9 snap -1 2024-03-30T12:30:17.044 INFO:tasks.rados.rados.0.smithi084.stdout:2184: expect (ObjNum 657 snap 232 seq_num 657) 2024-03-30T12:30:17.044 INFO:tasks.rados.rados.0.smithi084.stdout:2185: rmattr oid 25 current snap is 236 2024-03-30T12:30:17.044 INFO:tasks.rados.rados.0.smithi084.stdout:2186: read oid 32 snap -1 2024-03-30T12:30:17.044 INFO:tasks.rados.rados.0.smithi084.stdout:2186: expect (ObjNum 650 snap 230 seq_num 650) 2024-03-30T12:30:17.044 INFO:tasks.rados.rados.0.smithi084.stdout:2187: delete oid 10 current snap is 236 2024-03-30T12:30:17.058 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 961 (ObjNum 663 snap 232 seq_num 663) dirty exists 2024-03-30T12:30:17.060 INFO:tasks.rados.rados.0.smithi084.stdout:2184: expect (ObjNum 657 snap 232 seq_num 657) 2024-03-30T12:30:17.109 INFO:tasks.rados.rados.0.smithi084.stdout:2182: finishing write tid 1 to smithi08477944-21 2024-03-30T12:30:17.109 INFO:tasks.rados.rados.0.smithi084.stdout:2182: finishing write tid 2 to smithi08477944-21 2024-03-30T12:30:17.109 INFO:tasks.rados.rados.0.smithi084.stdout:2182: finishing write tid 3 to smithi08477944-21 2024-03-30T12:30:17.109 INFO:tasks.rados.rados.0.smithi084.stdout:2184: done (5 left) 2024-03-30T12:30:17.109 INFO:tasks.rados.rados.0.smithi084.stdout:2185: done (4 left) 2024-03-30T12:30:17.109 INFO:tasks.rados.rados.0.smithi084.stdout:2187: done (3 left) 2024-03-30T12:30:17.109 INFO:tasks.rados.rados.0.smithi084.stdout:2188: snap_remove snap 226 2024-03-30T12:30:17.198 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:17.198 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:17.198 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:17.199 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-mon[83709]: osdmap e533: 8 total, 7 up, 8 in 2024-03-30T12:30:17.199 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:17.199 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:17.199 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-mon[83709]: pgmap v484: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 38 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 491 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 6.0 MiB/s rd, 3.2 MiB/s wr, 13 op/s; 86/963 objects degraded (8.930%) 2024-03-30T12:30:17.200 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.969+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.200 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:16.991+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.200 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.011+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.200 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.034+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.200 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.073+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.201 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.096+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.201 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.118+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.201 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.142+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.201 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.165+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.201 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.186+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.201 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.206+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.202 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.955+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.202 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:16.983+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.202 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.019+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.202 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.054+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.202 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.090+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.202 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.133+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.203 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.162+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.203 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.198+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.448 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.234+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.448 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.276+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.448 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.318+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.448 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.353+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.449 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.394+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.449 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.427+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.449 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.228+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.449 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.251+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.449 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.272+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.449 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.294+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.449 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.315+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.449 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.341+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.449 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.369+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.449 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.387+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.449 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.408+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.449 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.431+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.450 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.455+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:17.033+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:17.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:17.035+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:17.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:17.054+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:17.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:17.054+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:17.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:17.055+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:17.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:17.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:17.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:17.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:17 smithi084 ceph-mon[91810]: osdmap e533: 8 total, 7 up, 8 in 2024-03-30T12:30:17.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:17.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:17.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:17 smithi084 ceph-mon[91810]: pgmap v484: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 38 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 491 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 6.0 MiB/s rd, 3.2 MiB/s wr, 13 op/s; 86/963 objects degraded (8.930%) 2024-03-30T12:30:17.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:17.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:17.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:17.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:17 smithi084 ceph-mon[89279]: osdmap e533: 8 total, 7 up, 8 in 2024-03-30T12:30:17.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:17.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:17.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:17 smithi084 ceph-mon[89279]: pgmap v484: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 38 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 491 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 6.0 MiB/s rd, 3.2 MiB/s wr, 13 op/s; 86/963 objects degraded (8.930%) 2024-03-30T12:30:17.707 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.475+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.707 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.517+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.707 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.551+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.707 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.592+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.707 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.632+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.707 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.668+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.707 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.705+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.708 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.477+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.708 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.504+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.708 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.527+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.708 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.548+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.708 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.573+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.708 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.597+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.708 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.615+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.708 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.641+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.708 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.664+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.708 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.689+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.708 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.715+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.741+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.763+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.788+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.810+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.830+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.855+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.882+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.907+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.932+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.961 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.956+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:17.962 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.743+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.962 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.781+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.962 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.818+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.962 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.857+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.962 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.894+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.962 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.930+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:17.962 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:17.968+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.029 INFO:tasks.rados.rados.0.smithi084.stdout:2188: done (3 left) 2024-03-30T12:30:18.029 INFO:tasks.rados.rados.0.smithi084.stdout:2189: rmattr oid 46 current snap is 236 2024-03-30T12:30:18.029 INFO:tasks.rados.rados.0.smithi084.stdout:2186: expect (ObjNum 650 snap 230 seq_num 650) 2024-03-30T12:30:18.214 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-mon[83709]: osdmap e534: 8 total, 7 up, 8 in 2024-03-30T12:30:18.214 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:18.215 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:18.215 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:18.215 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:18.215 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:18.215 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:18.215 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:18.215 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.980+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.215 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:17.999+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.215 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.021+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.215 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.053+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.216 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.078+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.216 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.103+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.216 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.123+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.216 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.147+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.216 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.170+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.216 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.006+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.216 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.046+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.216 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.075+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.216 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.114+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.216 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.147+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.216 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.185+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.216 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.222+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.435 INFO:tasks.rados.rados.0.smithi084.stdout:2182: finishing write tid 4 to smithi08477944-21 2024-03-30T12:30:18.435 INFO:tasks.rados.rados.0.smithi084.stdout:2182: finishing write tid 5 to smithi08477944-21 2024-03-30T12:30:18.435 INFO:tasks.rados.rados.0.smithi084.stdout:2182: oid 21 updating version 0 to 21579 2024-03-30T12:30:18.435 INFO:tasks.rados.rados.0.smithi084.stdout:2182: oid 21 updating version 21579 to 21581 2024-03-30T12:30:18.435 INFO:tasks.rados.rados.0.smithi084.stdout:2182: oid 21 version 21581 is already newer than 21578 2024-03-30T12:30:18.435 INFO:tasks.rados.rados.0.smithi084.stdout:2182: oid 21 version 21581 is already newer than 21580 2024-03-30T12:30:18.435 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 21581 (ObjNum 669 snap 236 seq_num 669) dirty exists 2024-03-30T12:30:18.435 INFO:tasks.rados.rados.0.smithi084.stdout:2182: left oid 21 (ObjNum 669 snap 236 seq_num 669) 2024-03-30T12:30:18.436 INFO:tasks.rados.rados.0.smithi084.stdout:2183: finishing copy_from racing read to smithi08477944-19 2024-03-30T12:30:18.436 INFO:tasks.rados.rados.0.smithi084.stdout:2183: finishing copy_from to smithi08477944-19 2024-03-30T12:30:18.436 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 953 (ObjNum 638 snap 226 seq_num 638) dirty exists 2024-03-30T12:30:18.436 INFO:tasks.rados.rados.0.smithi084.stdout:2182: done (3 left) 2024-03-30T12:30:18.436 INFO:tasks.rados.rados.0.smithi084.stdout:2183: done (2 left) 2024-03-30T12:30:18.436 INFO:tasks.rados.rados.0.smithi084.stdout:2186: done (1 left) 2024-03-30T12:30:18.436 INFO:tasks.rados.rados.0.smithi084.stdout:2190: read oid 45 snap -1 2024-03-30T12:30:18.436 INFO:tasks.rados.rados.0.smithi084.stdout:2190: expect (ObjNum 664 snap 232 seq_num 664) 2024-03-30T12:30:18.436 INFO:tasks.rados.rados.0.smithi084.stdout:2191: read oid 15 snap -1 2024-03-30T12:30:18.436 INFO:tasks.rados.rados.0.smithi084.stdout:2191: expect deleted 2024-03-30T12:30:18.436 INFO:tasks.rados.rados.0.smithi084.stdout:2192: snap_remove snap 204 2024-03-30T12:30:18.465 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:18.332+0000 7f9dee2327c0 -1 osd.7 516 log_to_monitors true 2024-03-30T12:30:18.466 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.199+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.466 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.219+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.466 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.254+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.466 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.274+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.466 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.304+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.466 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.335+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.466 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.355+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.466 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.377+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.467 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.398+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.467 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.419+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.467 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.439+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.467 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.459+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.467 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.274+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.467 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.324+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.467 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.359+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.467 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.389+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.467 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.413+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.467 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.438+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.467 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.474+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:18.037+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:18.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:18.039+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:18.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:18 smithi084 ceph-mon[89279]: osdmap e534: 8 total, 7 up, 8 in 2024-03-30T12:30:18.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:18.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:18.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:18.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:18.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:18.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:18 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:18.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:18 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:18.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:18 smithi084 ceph-mon[91810]: osdmap e534: 8 total, 7 up, 8 in 2024-03-30T12:30:18.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:18.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:18.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:18.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:18.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:18.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:18 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:18.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:18 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:18.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:18.034+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:18.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:18.034+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:18.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:18.034+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:18.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:18.035+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:18.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:18.035+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:18.721 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.479+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.721 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.502+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.721 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.522+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.721 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.544+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.721 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.564+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.721 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.584+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.721 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.605+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.722 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.625+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.722 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.644+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.722 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.671+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.722 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.693+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.722 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.712+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.722 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.729+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.722 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.502+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.722 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.535+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.722 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.566+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.722 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.587+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.722 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.617+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.722 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.646+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.723 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.682+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.723 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.716+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.981 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.749+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.981 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.769+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.981 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.786+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.982 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.809+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.982 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.828+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.982 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.847+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.982 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.865+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.982 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.883+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.982 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.901+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.982 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.924+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.982 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.943+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.982 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.961+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.982 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.977+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:18.983 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.756+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.983 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.792+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.983 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.824+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.983 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.864+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.983 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.896+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.983 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.923+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.983 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.957+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:18.983 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:18.989+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:19.034 INFO:tasks.rados.rados.0.smithi084.stdout:2192: done (3 left) 2024-03-30T12:30:19.034 INFO:tasks.rados.rados.0.smithi084.stdout:2193: delete oid 16 current snap is 236 2024-03-30T12:30:19.035 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 22932 (ObjNum 651 snap 230 seq_num 651) dirty exists 2024-03-30T12:30:19.035 INFO:tasks.rados.rados.0.smithi084.stdout:2190: expect (ObjNum 664 snap 232 seq_num 664) 2024-03-30T12:30:19.085 INFO:tasks.rados.rados.0.smithi084.stdout:2189: done (3 left) 2024-03-30T12:30:19.085 INFO:tasks.rados.rados.0.smithi084.stdout:2190: done (2 left) 2024-03-30T12:30:19.085 INFO:tasks.rados.rados.0.smithi084.stdout:2191: done (1 left) 2024-03-30T12:30:19.085 INFO:tasks.rados.rados.0.smithi084.stdout:2193: done (0 left) 2024-03-30T12:30:19.085 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 236 2024-03-30T12:30:19.085 INFO:tasks.rados.rados.0.smithi084.stdout:2194: seq_num 672 ranges {0=458752,458752=647168,1105920=466944,1572864=90112} 2024-03-30T12:30:19.087 INFO:tasks.rados.rados.0.smithi084.stdout:2194: writing smithi08477944-29 from 0 to 458752 tid 1 2024-03-30T12:30:19.091 INFO:tasks.rados.rados.0.smithi084.stdout:2194: writing smithi08477944-29 from 458752 to 1105920 tid 2 2024-03-30T12:30:19.094 INFO:tasks.rados.rados.0.smithi084.stdout:2194: writing smithi08477944-29 from 1105920 to 1572864 tid 3 2024-03-30T12:30:19.095 INFO:tasks.rados.rados.0.smithi084.stdout:2194: writing smithi08477944-29 from 1572864 to 1662976 tid 4 2024-03-30T12:30:19.095 INFO:tasks.rados.rados.0.smithi084.stdout:2195: copy_from oid 21 from oid 20 current snap is 236 2024-03-30T12:30:19.095 INFO:tasks.rados.rados.0.smithi084.stdout:2194: finishing write tid 1 to smithi08477944-29 2024-03-30T12:30:19.095 INFO:tasks.rados.rados.0.smithi084.stdout:2196: snap_create 2024-03-30T12:30:19.096 INFO:tasks.rados.rados.0.smithi084.stdout:2194: finishing write tid 2 to smithi08477944-29 2024-03-30T12:30:19.100 INFO:tasks.rados.rados.0.smithi084.stdout:2194: finishing write tid 3 to smithi08477944-29 2024-03-30T12:30:19.100 INFO:tasks.rados.rados.0.smithi084.stdout:2194: finishing write tid 4 to smithi08477944-29 2024-03-30T12:30:19.100 INFO:tasks.rados.rados.0.smithi084.stdout:2194: finishing write tid 5 to smithi08477944-29 2024-03-30T12:30:19.103 INFO:tasks.rados.rados.0.smithi084.stdout:2194: finishing write tid 6 to smithi08477944-29 2024-03-30T12:30:19.103 INFO:tasks.rados.rados.0.smithi084.stdout:2194: oid 29 updating version 0 to 17499 2024-03-30T12:30:19.103 INFO:tasks.rados.rados.0.smithi084.stdout:2194: oid 29 version 17499 is already newer than 17498 2024-03-30T12:30:19.103 INFO:tasks.rados.rados.0.smithi084.stdout:2194: oid 29 updating version 17499 to 17501 2024-03-30T12:30:19.103 INFO:tasks.rados.rados.0.smithi084.stdout:2194: oid 29 updating version 17501 to 17502 2024-03-30T12:30:19.103 INFO:tasks.rados.rados.0.smithi084.stdout:2194: oid 29 version 17502 is already newer than 17500 2024-03-30T12:30:19.103 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 17502 (ObjNum 672 snap 236 seq_num 672) dirty exists 2024-03-30T12:30:19.103 INFO:tasks.rados.rados.0.smithi084.stdout:2194: left oid 29 (ObjNum 672 snap 236 seq_num 672) 2024-03-30T12:30:19.149 INFO:tasks.rados.rados.0.smithi084.stdout:2195: finishing copy_from racing read to smithi08477944-21 2024-03-30T12:30:19.158 INFO:tasks.rados.rados.0.smithi084.stdout:2195: finishing copy_from to smithi08477944-21 2024-03-30T12:30:19.158 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 17490 (ObjNum 565 snap 194 seq_num 565) dirty exists 2024-03-30T12:30:19.234 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:18.996+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.234 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.014+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.234 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.034+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.234 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.059+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.234 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.083+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.234 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.103+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.234 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.123+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.235 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.171+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.235 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.193+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.235 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.214+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.235 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.238+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.235 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:19.076+0000 7f9ddf68a700 -1 osd.7 516 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T12:30:19.235 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-mon[83709]: osdmap e535: 8 total, 7 up, 8 in 2024-03-30T12:30:19.235 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:19.236 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:19.236 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:19.236 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:19.236 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:19.236 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-mon[83709]: from='osd.7 [v2:172.21.15.162:6824/1236604326,v1:172.21.15.162:6825/1236604326]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T12:30:19.236 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-mon[83709]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T12:30:19.236 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-mon[83709]: pgmap v487: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 38 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 494 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 1.0 MiB/s rd, 840 KiB/s wr, 11 op/s; 88/972 objects degraded (9.053%) 2024-03-30T12:30:19.236 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:19.236 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:19.236 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.022+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:19.236 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.073+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:19.236 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.104+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:19.236 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.137+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:19.237 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.174+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:19.237 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.207+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:19.295 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:19.047+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:19.295 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:19.048+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:19.295 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:19.045+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:19.295 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:19.045+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:19.295 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:19.046+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:19.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-mon[91810]: osdmap e535: 8 total, 7 up, 8 in 2024-03-30T12:30:19.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:19.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:19.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:19.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:19.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:19.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-mon[91810]: from='osd.7 [v2:172.21.15.162:6824/1236604326,v1:172.21.15.162:6825/1236604326]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T12:30:19.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-mon[91810]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T12:30:19.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-mon[91810]: pgmap v487: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 38 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 494 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 1.0 MiB/s rd, 840 KiB/s wr, 11 op/s; 88/972 objects degraded (9.053%) 2024-03-30T12:30:19.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:19.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:19.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-mon[89279]: osdmap e535: 8 total, 7 up, 8 in 2024-03-30T12:30:19.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:19.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:19.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:19.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:19.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:19.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-mon[89279]: from='osd.7 [v2:172.21.15.162:6824/1236604326,v1:172.21.15.162:6825/1236604326]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T12:30:19.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-mon[89279]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T12:30:19.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-mon[89279]: pgmap v487: 121 pgs: 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 38 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 494 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 1.0 MiB/s rd, 840 KiB/s wr, 11 op/s; 88/972 objects degraded (9.053%) 2024-03-30T12:30:19.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:19.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:19.491 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.257+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.491 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.276+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.491 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.298+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.491 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.318+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.491 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.340+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.491 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.366+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.491 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.388+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.491 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.410+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.491 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.428+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.491 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.448+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.491 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.468+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.491 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.488+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.492 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.242+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:19.492 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.283+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:19.492 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.314+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:19.492 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.350+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:19.492 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.388+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:19.492 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.424+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:19.492 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.460+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:19.492 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.498+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:19.744 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.508+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.744 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.529+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.744 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.550+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.744 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.573+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.744 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.593+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.744 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.621+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.744 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.642+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.745 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.662+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.745 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.684+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.745 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.709+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.745 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.730+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.745 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.752+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:19.745 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.535+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:19.745 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.569+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:19.745 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.600+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:19.745 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.629+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:19.745 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.667+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:19.745 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.704+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:19.746 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.737+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:19.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:30:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:30:19] "GET /metrics HTTP/1.1" 200 36331 "" "Prometheus/2.43.0" 2024-03-30T12:30:20.002 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.772+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.002 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.790+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.003 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.808+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.003 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.828+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.003 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.845+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.003 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.862+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.003 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.885+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.003 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.901+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.003 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.920+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.003 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.936+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.003 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.957+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.003 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:19.978+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.003 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.000+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.003 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.774+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.003 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.804+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.004 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.831+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.004 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.862+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.004 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.895+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.004 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.924+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.004 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.955+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.004 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:19.976+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.004 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.010+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.039 INFO:tasks.rados.rados.0.smithi084.stdout:2194: done (2 left) 2024-03-30T12:30:20.040 INFO:tasks.rados.rados.0.smithi084.stdout:2195: done (1 left) 2024-03-30T12:30:20.040 INFO:tasks.rados.rados.0.smithi084.stdout:2196: done (0 left) 2024-03-30T12:30:20.040 INFO:tasks.rados.rados.0.smithi084.stdout:2197: setattr oid 10 current snap is 237 2024-03-30T12:30:20.042 INFO:tasks.rados.rados.0.smithi084.stdout:2198: copy_from oid 36 from oid 20 current snap is 237 2024-03-30T12:30:20.042 INFO:tasks.rados.rados.0.smithi084.stdout:2199: copy_from oid 12 from oid 48 current snap is 237 2024-03-30T12:30:20.042 INFO:tasks.rados.rados.0.smithi084.stdout:2200: snap_create 2024-03-30T12:30:20.075 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 23368 (ObjNum 49 snap 0 seq_num 1953066355) dirty exists 2024-03-30T12:30:20.075 INFO:tasks.rados.rados.0.smithi084.stdout:2198: finishing copy_from racing read to smithi08477944-36 2024-03-30T12:30:20.086 INFO:tasks.rados.rados.0.smithi084.stdout:2198: finishing copy_from to smithi08477944-36 2024-03-30T12:30:20.086 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 17490 (ObjNum 565 snap 194 seq_num 565) dirty exists 2024-03-30T12:30:20.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-mon[83709]: Health check update: Degraded data redundancy: 88/972 objects degraded (9.053%), 12 pgs degraded (PG_DEGRADED) 2024-03-30T12:30:20.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-mon[83709]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-30T12:30:20.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-mon[83709]: osdmap e536: 8 total, 7 up, 8 in 2024-03-30T12:30:20.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-mon[83709]: from='osd.7 [v2:172.21.15.162:6824/1236604326,v1:172.21.15.162:6825/1236604326]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:30:20.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-mon[83709]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:30:20.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:20.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:20.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:20.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:20.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:20.263 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.018+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.263 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.036+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.264 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.070+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.264 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.106+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.264 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.142+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.264 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.160+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.264 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.179+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.264 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.198+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.264 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.216+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.264 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.236+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.264 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.253+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.264 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.270+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.264 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.042+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.264 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.082+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.265 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.138+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.265 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.167+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.265 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.193+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.265 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.223+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.265 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.251+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:20.058+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:20.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:20.059+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:20.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:20.042+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:20.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:20.042+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:20.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:20.043+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:20.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:20.043+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:20.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:20.043+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:20.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-mon[89279]: Health check update: Degraded data redundancy: 88/972 objects degraded (9.053%), 12 pgs degraded (PG_DEGRADED) 2024-03-30T12:30:20.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-mon[89279]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-30T12:30:20.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-mon[89279]: osdmap e536: 8 total, 7 up, 8 in 2024-03-30T12:30:20.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-mon[89279]: from='osd.7 [v2:172.21.15.162:6824/1236604326,v1:172.21.15.162:6825/1236604326]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:30:20.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-mon[89279]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:30:20.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:20.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:20.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:20.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:20.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:20.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-mon[91810]: Health check update: Degraded data redundancy: 88/972 objects degraded (9.053%), 12 pgs degraded (PG_DEGRADED) 2024-03-30T12:30:20.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-mon[91810]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-30T12:30:20.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-mon[91810]: osdmap e536: 8 total, 7 up, 8 in 2024-03-30T12:30:20.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-mon[91810]: from='osd.7 [v2:172.21.15.162:6824/1236604326,v1:172.21.15.162:6825/1236604326]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:30:20.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-mon[91810]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-03-30T12:30:20.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:20.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:20.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:20.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:20.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:20.517 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.285+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.517 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.314+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.517 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.330+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.517 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.364+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.517 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.394+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.517 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.423+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.517 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.455+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.517 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.486+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.517 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.513+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.517 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.289+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.517 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.307+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.517 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.328+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.518 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.345+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.518 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.364+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.518 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.381+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.518 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.398+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.518 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.414+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.518 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.430+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.518 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.447+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.518 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.464+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.518 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.484+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.518 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.505+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.518 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.525+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.778 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.542+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.778 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.569+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.778 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.602+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.778 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.631+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.778 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.662+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.779 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.687+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.779 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.720+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.779 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.750+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.779 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.767+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:20.779 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.544+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.779 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.566+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.779 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.582+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.779 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.602+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.779 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.619+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.779 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.641+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.779 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.658+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.779 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.675+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.779 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.694+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.780 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.712+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.780 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.731+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.780 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.748+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.780 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.770+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:20.780 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.786+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.032 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.804+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.032 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.822+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.032 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.838+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.032 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.856+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.032 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.873+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.032 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.893+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.032 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.915+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.032 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.932+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.033 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.948+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.033 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.965+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.033 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:20.984+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.033 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.002+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.033 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.020+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.033 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.039+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.033 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.794+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.033 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.820+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.033 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.853+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.033 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.883+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.033 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.908+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.034 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.939+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.034 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.972+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.034 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:20.995+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.034 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:21.026+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.040 INFO:tasks.rados.rados.0.smithi084.stdout:2197: done (3 left) 2024-03-30T12:30:21.040 INFO:tasks.rados.rados.0.smithi084.stdout:2198: done (2 left) 2024-03-30T12:30:21.040 INFO:tasks.rados.rados.0.smithi084.stdout:2200: done (1 left) 2024-03-30T12:30:21.040 INFO:tasks.rados.rados.0.smithi084.stdout:2201: rmattr oid 49 current snap is 238 2024-03-30T12:30:21.040 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 238 2024-03-30T12:30:21.040 INFO:tasks.rados.rados.0.smithi084.stdout:2202: seq_num 673 ranges {737280=475136,1212416=532480,1744896=671744} 2024-03-30T12:30:21.048 INFO:tasks.rados.rados.0.smithi084.stdout:2202: writing smithi08477944-39 from 737280 to 1212416 tid 1 2024-03-30T12:30:21.052 INFO:tasks.rados.rados.0.smithi084.stdout:2202: writing smithi08477944-39 from 1212416 to 1744896 tid 2 2024-03-30T12:30:21.055 INFO:tasks.rados.rados.0.smithi084.stdout:2202: writing smithi08477944-39 from 1744896 to 2416640 tid 3 2024-03-30T12:30:21.056 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 238 2024-03-30T12:30:21.056 INFO:tasks.rados.rados.0.smithi084.stdout:2203: seq_num 674 ranges {8257536=491520,8749056=417792,9166848=483328,9650176=303104} 2024-03-30T12:30:21.071 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-mon[83709]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T12:30:21.071 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:21.071 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:21.071 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:21.071 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-mon[83709]: osd.7 [v2:172.21.15.162:6824/1236604326,v1:172.21.15.162:6825/1236604326] boot 2024-03-30T12:30:21.071 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-mon[83709]: osdmap e537: 8 total, 8 up, 8 in 2024-03-30T12:30:21.071 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:30:21.071 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:21.071 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:21.104 INFO:tasks.rados.rados.0.smithi084.stdout:2203: writing smithi08477944-36 from 8257536 to 8749056 tid 1 2024-03-30T12:30:21.107 INFO:tasks.rados.rados.0.smithi084.stdout:2203: writing smithi08477944-36 from 8749056 to 9166848 tid 2 2024-03-30T12:30:21.110 INFO:tasks.rados.rados.0.smithi084.stdout:2203: writing smithi08477944-36 from 9166848 to 9650176 tid 3 2024-03-30T12:30:21.112 INFO:tasks.rados.rados.0.smithi084.stdout:2203: writing smithi08477944-36 from 9650176 to 9953280 tid 4 2024-03-30T12:30:21.112 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 238 2024-03-30T12:30:21.112 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 17491 (ObjNum 638 snap 226 seq_num 638) dirty exists 2024-03-30T12:30:21.112 INFO:tasks.rados.rados.0.smithi084.stdout:2202: finishing write tid 1 to smithi08477944-39 2024-03-30T12:30:21.112 INFO:tasks.rados.rados.0.smithi084.stdout:2202: finishing write tid 2 to smithi08477944-39 2024-03-30T12:30:21.112 INFO:tasks.rados.rados.0.smithi084.stdout:2202: finishing write tid 3 to smithi08477944-39 2024-03-30T12:30:21.113 INFO:tasks.rados.rados.0.smithi084.stdout:2202: finishing write tid 4 to smithi08477944-39 2024-03-30T12:30:21.113 INFO:tasks.rados.rados.0.smithi084.stdout:2202: finishing write tid 5 to smithi08477944-39 2024-03-30T12:30:21.113 INFO:tasks.rados.rados.0.smithi084.stdout:2202: oid 39 updating version 0 to 957 2024-03-30T12:30:21.113 INFO:tasks.rados.rados.0.smithi084.stdout:2202: oid 39 updating version 957 to 958 2024-03-30T12:30:21.113 INFO:tasks.rados.rados.0.smithi084.stdout:2202: oid 39 version 958 is already newer than 956 2024-03-30T12:30:21.113 INFO:tasks.rados.rados.0.smithi084.stdout:2202: oid 39 version 958 is already newer than 955 2024-03-30T12:30:21.113 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 958 (ObjNum 673 snap 238 seq_num 673) dirty exists 2024-03-30T12:30:21.113 INFO:tasks.rados.rados.0.smithi084.stdout:2202: left oid 39 (ObjNum 673 snap 238 seq_num 673) 2024-03-30T12:30:21.113 INFO:tasks.rados.rados.0.smithi084.stdout:2203: finishing write tid 1 to smithi08477944-36 2024-03-30T12:30:21.113 INFO:tasks.rados.rados.0.smithi084.stdout:2203: finishing write tid 2 to smithi08477944-36 2024-03-30T12:30:21.113 INFO:tasks.rados.rados.0.smithi084.stdout:2204: seq_num 675 ranges {0=507904,507904=704512,1212416=499712} 2024-03-30T12:30:21.115 INFO:tasks.rados.rados.0.smithi084.stdout:2204: writing smithi08477944-14 from 0 to 507904 tid 1 2024-03-30T12:30:21.120 INFO:tasks.rados.rados.0.smithi084.stdout:2204: writing smithi08477944-14 from 507904 to 1212416 tid 2 2024-03-30T12:30:21.124 INFO:tasks.rados.rados.0.smithi084.stdout:2204: writing smithi08477944-14 from 1212416 to 1712128 tid 3 2024-03-30T12:30:21.124 INFO:tasks.rados.rados.0.smithi084.stdout:2201: done (4 left) 2024-03-30T12:30:21.124 INFO:tasks.rados.rados.0.smithi084.stdout:2202: done (3 left) 2024-03-30T12:30:21.124 INFO:tasks.rados.rados.0.smithi084.stdout:2205: delete oid 32 current snap is 238 2024-03-30T12:30:21.124 INFO:tasks.rados.rados.0.smithi084.stdout:2199: finishing copy_from racing read to smithi08477944-12 2024-03-30T12:30:21.124 INFO:tasks.rados.rados.0.smithi084.stdout:2203: finishing write tid 3 to smithi08477944-36 2024-03-30T12:30:21.124 INFO:tasks.rados.rados.0.smithi084.stdout:2203: finishing write tid 4 to smithi08477944-36 2024-03-30T12:30:21.124 INFO:tasks.rados.rados.0.smithi084.stdout:2203: finishing write tid 5 to smithi08477944-36 2024-03-30T12:30:21.124 INFO:tasks.rados.rados.0.smithi084.stdout:2199: finishing copy_from to smithi08477944-12 2024-03-30T12:30:21.125 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 914 (ObjNum 649 snap 230 seq_num 649) dirty exists 2024-03-30T12:30:21.125 INFO:tasks.rados.rados.0.smithi084.stdout:2203: finishing write tid 6 to smithi08477944-36 2024-03-30T12:30:21.125 INFO:tasks.rados.rados.0.smithi084.stdout:2203: oid 36 updating version 0 to 17494 2024-03-30T12:30:21.125 INFO:tasks.rados.rados.0.smithi084.stdout:2203: oid 36 version 17494 is already newer than 17493 2024-03-30T12:30:21.125 INFO:tasks.rados.rados.0.smithi084.stdout:2203: oid 36 version 17494 is already newer than 17492 2024-03-30T12:30:21.125 INFO:tasks.rados.rados.0.smithi084.stdout:2203: oid 36 updating version 17494 to 17495 2024-03-30T12:30:21.125 INFO:tasks.rados.rados.0.smithi084.stdout:2203: oid 36 updating version 17495 to 17496 2024-03-30T12:30:21.125 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 17496 (ObjNum 674 snap 238 seq_num 674) dirty exists 2024-03-30T12:30:21.125 INFO:tasks.rados.rados.0.smithi084.stdout:2203: left oid 36 (ObjNum 674 snap 238 seq_num 674) 2024-03-30T12:30:21.126 INFO:tasks.rados.rados.0.smithi084.stdout:2199: done (3 left) 2024-03-30T12:30:21.126 INFO:tasks.rados.rados.0.smithi084.stdout:2203: done (2 left) 2024-03-30T12:30:21.126 INFO:tasks.rados.rados.0.smithi084.stdout:2205: done (1 left) 2024-03-30T12:30:21.126 INFO:tasks.rados.rados.0.smithi084.stdout:2206: snap_create 2024-03-30T12:30:21.156 INFO:tasks.rados.rados.0.smithi084.stdout:2204: finishing write tid 1 to smithi08477944-14 2024-03-30T12:30:21.156 INFO:tasks.rados.rados.0.smithi084.stdout:2204: finishing write tid 2 to smithi08477944-14 2024-03-30T12:30:21.156 INFO:tasks.rados.rados.0.smithi084.stdout:2204: finishing write tid 3 to smithi08477944-14 2024-03-30T12:30:21.156 INFO:tasks.rados.rados.0.smithi084.stdout:2204: finishing write tid 4 to smithi08477944-14 2024-03-30T12:30:21.158 INFO:tasks.rados.rados.0.smithi084.stdout:2204: finishing write tid 5 to smithi08477944-14 2024-03-30T12:30:21.158 INFO:tasks.rados.rados.0.smithi084.stdout:2204: oid 14 updating version 0 to 23369 2024-03-30T12:30:21.158 INFO:tasks.rados.rados.0.smithi084.stdout:2204: oid 14 updating version 23369 to 23372 2024-03-30T12:30:21.158 INFO:tasks.rados.rados.0.smithi084.stdout:2204: oid 14 version 23372 is already newer than 23370 2024-03-30T12:30:21.158 INFO:tasks.rados.rados.0.smithi084.stdout:2204: oid 14 version 23372 is already newer than 23371 2024-03-30T12:30:21.158 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 23372 (ObjNum 675 snap 238 seq_num 675) dirty exists 2024-03-30T12:30:21.158 INFO:tasks.rados.rados.0.smithi084.stdout:2204: left oid 14 (ObjNum 675 snap 238 seq_num 675) 2024-03-30T12:30:21.291 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-mon[83709]: pgmap v490: 121 pgs: 8 peering, 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 30 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 494 MiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 1.0 MiB/s rd, 840 KiB/s wr, 17 op/s; 88/978 objects degraded (8.998%) 2024-03-30T12:30:21.291 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-mon[83709]: osdmap e538: 8 total, 8 up, 8 in 2024-03-30T12:30:21.291 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.097+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.291 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.131+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.291 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.153+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.292 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.177+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.292 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.204+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.292 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.225+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.292 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.247+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.292 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.270+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.292 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:21.084+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.292 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:21.131+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.292 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:21.169+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.292 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:21.194+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.292 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:21.231+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.293 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:21.267+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:21.050+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:21.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:21.055+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:21.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:21.042+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:21.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:21.043+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:21.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:21.043+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:21.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:21.279+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:21.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:21.279+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:21.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-mon[91810]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T12:30:21.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:21.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:21.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:21.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-mon[91810]: osd.7 [v2:172.21.15.162:6824/1236604326,v1:172.21.15.162:6825/1236604326] boot 2024-03-30T12:30:21.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-mon[91810]: osdmap e537: 8 total, 8 up, 8 in 2024-03-30T12:30:21.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:30:21.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:21.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:21.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-mon[91810]: pgmap v490: 121 pgs: 8 peering, 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 30 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 494 MiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 1.0 MiB/s rd, 840 KiB/s wr, 17 op/s; 88/978 objects degraded (8.998%) 2024-03-30T12:30:21.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-mon[91810]: osdmap e538: 8 total, 8 up, 8 in 2024-03-30T12:30:21.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-mon[89279]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T12:30:21.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:21.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:21.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:21.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-mon[89279]: osd.7 [v2:172.21.15.162:6824/1236604326,v1:172.21.15.162:6825/1236604326] boot 2024-03-30T12:30:21.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-mon[89279]: osdmap e537: 8 total, 8 up, 8 in 2024-03-30T12:30:21.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T12:30:21.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:21.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:21.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-mon[89279]: pgmap v490: 121 pgs: 8 peering, 1 active+undersized+degraded+snaptrim_error, 11 active+undersized+degraded, 30 active+undersized, 4 active+clean+snaptrim, 62 active+clean, 5 active+clean+snaptrim_error; 494 MiB data, 6.7 GiB used, 709 GiB / 715 GiB avail; 1.0 MiB/s rd, 840 KiB/s wr, 17 op/s; 88/978 objects degraded (8.998%) 2024-03-30T12:30:21.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:21 smithi084 ceph-mon[89279]: osdmap e538: 8 total, 8 up, 8 in 2024-03-30T12:30:21.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.297+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.546 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.319+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.547 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.343+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.547 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.365+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.547 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.396+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.547 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.433+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.547 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.462+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.547 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.497+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.547 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.528+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.547 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:21.315+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.547 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:21.373+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.547 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:21.428+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.547 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:21.473+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.547 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:21.503+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:21.543+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.811 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:21.581+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.811 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:21.624+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.811 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:21.676+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.811 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:21.731+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.811 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:21.784+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:21.811 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.554+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.811 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.581+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.811 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.608+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.811 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.637+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.812 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.669+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.812 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.697+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.812 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.723+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.812 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.757+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.812 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.792+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:21.812 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.818+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.070 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.850+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.070 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.881+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.070 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.911+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.070 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.938+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.070 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.968+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.070 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:21.994+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.071 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.022+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.071 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.054+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.071 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:21.824+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:22.071 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:21.865+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:22.071 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:21.922+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:22.071 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:21.960+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:22.071 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:22.005+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:22.071 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:22.054+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:22.072 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:21.880+0000 7f9dc765a700 -1 osd.7 pg_epoch: 538 pg[5.4s0( v 538'729 (0'0,538'729] local-lis/les=537/538 n=13 ec=71/71 lis/c=537/537 les/c/f=538/538/0 sis=537) [7,2,5]p7(0) r=0 lpr=537 crt=538'729 lcod 538'727 mlcod 538'727 active+clean+snaptrim trimq=[10b~1,114~3,119~1,11d~1,120~2,123~2] ps=[97~1,99~1,9d~1,a0~2,a8~3f,e8~1f,108~3,10c~2,10f~4,117~2,11b~2]] update_snap_map remove_oid 5:2bd7b7a9:::smithi08477944-11:10d failed with -2 2024-03-30T12:30:22.072 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:21.884+0000 7f9dc765a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 10b after trimming was started 2024-03-30T12:30:22.072 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:21.884+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 121=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:22.082 INFO:tasks.rados.rados.0.smithi084.stdout:2204: done (1 left) 2024-03-30T12:30:22.082 INFO:tasks.rados.rados.0.smithi084.stdout:2206: done (0 left) 2024-03-30T12:30:22.082 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 239 2024-03-30T12:30:22.082 INFO:tasks.rados.rados.0.smithi084.stdout:2207: seq_num 677 ranges {3432448=540672,3973120=516096,4489216=655360,5144576=32768} 2024-03-30T12:30:22.104 INFO:tasks.rados.rados.0.smithi084.stdout:2207: writing smithi08477944-48 from 3432448 to 3973120 tid 1 2024-03-30T12:30:22.107 INFO:tasks.rados.rados.0.smithi084.stdout:2207: writing smithi08477944-48 from 3973120 to 4489216 tid 2 2024-03-30T12:30:22.112 INFO:tasks.rados.rados.0.smithi084.stdout:2207: writing smithi08477944-48 from 4489216 to 5144576 tid 3 2024-03-30T12:30:22.112 INFO:tasks.rados.rados.0.smithi084.stdout:2207: writing smithi08477944-48 from 5144576 to 5177344 tid 4 2024-03-30T12:30:22.112 INFO:tasks.rados.rados.0.smithi084.stdout:2208: delete oid 9 current snap is 239 2024-03-30T12:30:22.112 INFO:tasks.rados.rados.0.smithi084.stdout:2207: finishing write tid 1 to smithi08477944-48 2024-03-30T12:30:22.112 INFO:tasks.rados.rados.0.smithi084.stdout:2207: finishing write tid 2 to smithi08477944-48 2024-03-30T12:30:22.116 INFO:tasks.rados.rados.0.smithi084.stdout:2207: finishing write tid 3 to smithi08477944-48 2024-03-30T12:30:22.117 INFO:tasks.rados.rados.0.smithi084.stdout:2207: finishing write tid 4 to smithi08477944-48 2024-03-30T12:30:22.118 INFO:tasks.rados.rados.0.smithi084.stdout:2208: done (1 left) 2024-03-30T12:30:22.118 INFO:tasks.rados.rados.0.smithi084.stdout:2209: read oid 25 snap -1 2024-03-30T12:30:22.118 INFO:tasks.rados.rados.0.smithi084.stdout:2209: expect (ObjNum 663 snap 232 seq_num 663) 2024-03-30T12:30:22.118 INFO:tasks.rados.rados.0.smithi084.stdout:2210: read oid 13 snap -1 2024-03-30T12:30:22.118 INFO:tasks.rados.rados.0.smithi084.stdout:2210: expect deleted 2024-03-30T12:30:22.118 INFO:tasks.rados.rados.0.smithi084.stdout:2211: delete oid 11 current snap is 239 2024-03-30T12:30:22.118 INFO:tasks.rados.rados.0.smithi084.stdout:2207: finishing write tid 5 to smithi08477944-48 2024-03-30T12:30:22.119 INFO:tasks.rados.rados.0.smithi084.stdout:2207: finishing write tid 6 to smithi08477944-48 2024-03-30T12:30:22.119 INFO:tasks.rados.rados.0.smithi084.stdout:2207: oid 48 updating version 0 to 915 2024-03-30T12:30:22.119 INFO:tasks.rados.rados.0.smithi084.stdout:2207: oid 48 updating version 915 to 918 2024-03-30T12:30:22.120 INFO:tasks.rados.rados.0.smithi084.stdout:2207: oid 48 version 918 is already newer than 917 2024-03-30T12:30:22.120 INFO:tasks.rados.rados.0.smithi084.stdout:2207: oid 48 version 918 is already newer than 916 2024-03-30T12:30:22.120 INFO:tasks.rados.rados.0.smithi084.stdout:2207: oid 48 updating version 918 to 919 2024-03-30T12:30:22.120 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 919 (ObjNum 677 snap 239 seq_num 677) dirty exists 2024-03-30T12:30:22.120 INFO:tasks.rados.rados.0.smithi084.stdout:2207: left oid 48 (ObjNum 677 snap 239 seq_num 677) 2024-03-30T12:30:22.144 INFO:tasks.rados.rados.0.smithi084.stdout:2207: done (3 left) 2024-03-30T12:30:22.144 INFO:tasks.rados.rados.0.smithi084.stdout:2210: done (2 left) 2024-03-30T12:30:22.144 INFO:tasks.rados.rados.0.smithi084.stdout:2211: done (1 left) 2024-03-30T12:30:22.144 INFO:tasks.rados.rados.0.smithi084.stdout:2212: delete oid 20 current snap is 239 2024-03-30T12:30:22.148 INFO:tasks.rados.rados.0.smithi084.stdout:2212: done (1 left) 2024-03-30T12:30:22.148 INFO:tasks.rados.rados.0.smithi084.stdout:2213: read oid 48 snap -1 2024-03-30T12:30:22.149 INFO:tasks.rados.rados.0.smithi084.stdout:2213: expect (ObjNum 677 snap 239 seq_num 677) 2024-03-30T12:30:22.149 INFO:tasks.rados.rados.0.smithi084.stdout:2214: read oid 14 snap 238 2024-03-30T12:30:22.149 INFO:tasks.rados.rados.0.smithi084.stdout:2214: expect (ObjNum 675 snap 238 seq_num 675) 2024-03-30T12:30:22.149 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 239 2024-03-30T12:30:22.149 INFO:tasks.rados.rados.0.smithi084.stdout:2215: seq_num 681 ranges {9953280=614400,10567680=458752,11026432=638976,11665408=106496} 2024-03-30T12:30:22.211 INFO:tasks.rados.rados.0.smithi084.stdout:2215: writing smithi08477944-36 from 9953280 to 10567680 tid 1 2024-03-30T12:30:22.214 INFO:tasks.rados.rados.0.smithi084.stdout:2215: writing smithi08477944-36 from 10567680 to 11026432 tid 2 2024-03-30T12:30:22.218 INFO:tasks.rados.rados.0.smithi084.stdout:2215: writing smithi08477944-36 from 11026432 to 11665408 tid 3 2024-03-30T12:30:22.219 INFO:tasks.rados.rados.0.smithi084.stdout:2215: writing smithi08477944-36 from 11665408 to 11771904 tid 4 2024-03-30T12:30:22.219 INFO:tasks.rados.rados.0.smithi084.stdout:2216: copy_from oid 12 from oid 16 current snap is 239 2024-03-30T12:30:22.220 INFO:tasks.rados.rados.0.smithi084.stdout:2213: expect (ObjNum 677 snap 239 seq_num 677) 2024-03-30T12:30:22.324 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.088+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.324 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.131+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.324 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.160+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.324 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.213+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.324 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.247+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.324 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.276+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.324 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.301+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.325 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:22.094+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 121=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:22.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:22.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:22.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:22.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:22.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:22.325 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:22.326 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:22.092+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:22.326 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:22.135+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:22.326 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:22.182+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:22.326 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:22.238+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:22.326 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:22.280+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:22.326 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:22.323+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:22.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:22.089+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:22.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:22.089+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:22.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:22.089+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:22.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:22.089+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:22.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:22.089+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:22.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:22.089+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:22.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:22.102+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:22.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:22.102+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:22.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:22.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:22.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:22.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:22.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:22.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:22.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:22.518 INFO:tasks.rados.rados.0.smithi084.stdout:2214: expect (ObjNum 675 snap 238 seq_num 675) 2024-03-30T12:30:22.575 INFO:tasks.rados.rados.0.smithi084.stdout:2213: done (4 left) 2024-03-30T12:30:22.575 INFO:tasks.rados.rados.0.smithi084.stdout:2214: done (3 left) 2024-03-30T12:30:22.575 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 239 2024-03-30T12:30:22.575 INFO:tasks.rados.rados.0.smithi084.stdout:2215: finishing write tid 1 to smithi08477944-36 2024-03-30T12:30:22.575 INFO:tasks.rados.rados.0.smithi084.stdout:2215: finishing write tid 2 to smithi08477944-36 2024-03-30T12:30:22.575 INFO:tasks.rados.rados.0.smithi084.stdout:2217: seq_num 682 ranges {0=630784,630784=745472,1376256=442368,1818624=16384} 2024-03-30T12:30:22.579 INFO:tasks.rados.rados.0.smithi084.stdout:2217: writing smithi08477944-17 from 0 to 630784 tid 1 2024-03-30T12:30:22.583 INFO:tasks.rados.rados.0.smithi084.stdout:2217: writing smithi08477944-17 from 630784 to 1376256 tid 2 2024-03-30T12:30:22.587 INFO:tasks.rados.rados.0.smithi084.stdout:2217: writing smithi08477944-17 from 1376256 to 1818624 tid 3 2024-03-30T12:30:22.587 INFO:tasks.rados.rados.0.smithi084.stdout:2217: writing smithi08477944-17 from 1818624 to 1835008 tid 4 2024-03-30T12:30:22.587 INFO:tasks.rados.rados.0.smithi084.stdout:2218: delete oid 21 current snap is 239 2024-03-30T12:30:22.587 INFO:tasks.rados.rados.0.smithi084.stdout:2215: finishing write tid 3 to smithi08477944-36 2024-03-30T12:30:22.587 INFO:tasks.rados.rados.0.smithi084.stdout:2215: finishing write tid 4 to smithi08477944-36 2024-03-30T12:30:22.587 INFO:tasks.rados.rados.0.smithi084.stdout:2215: finishing write tid 5 to smithi08477944-36 2024-03-30T12:30:22.587 INFO:tasks.rados.rados.0.smithi084.stdout:2209: expect (ObjNum 663 snap 232 seq_num 663) 2024-03-30T12:30:22.600 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.332+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.360+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.386+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.414+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.439+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.469+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.492+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.524+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.549+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.601 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.578+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.603 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:22.374+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:22.603 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:22.416+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:22.603 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:22.459+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:22.603 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:22.496+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:22.603 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:22.538+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:22.603 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:22.580+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:22.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:22.626+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:22.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:22.650+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:22.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:22.696+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:22.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:22.727+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:22.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:22.761+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:22.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:22.800+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:22.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:22.840+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:22.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.609+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.632+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.664+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.697+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.723+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.751+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.778+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.804+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.828+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:22.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.857+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 121=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:23.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:23.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:23.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:23.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-mon[83709]: osdmap e539: 8 total, 8 up, 8 in 2024-03-30T12:30:23.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:23.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 121=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:23.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:23.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:23.126 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-mon[83709]: pgmap v493: 121 pgs: 13 peering, 1 active+undersized+degraded+snaptrim_error, 8 active+undersized+degraded, 20 active+undersized, 5 active+clean+snaptrim, 69 active+clean, 5 active+clean+snaptrim_error; 510 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 8.7 MiB/s rd, 4.4 MiB/s wr, 11 op/s; 61/984 objects degraded (6.199%); 2.4 MiB/s, 0 objects/s recovering 2024-03-30T12:30:23.127 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.890+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.127 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.916+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.127 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.941+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.127 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.966+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.127 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:22.987+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.127 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.009+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.127 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.035+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.127 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.057+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.127 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.081+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.128 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.109+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.128 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.131+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.128 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:22.882+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:23.128 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:22.922+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:23.128 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:22.968+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:23.128 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:23.012+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:23.128 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:23.052+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:23.128 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:23.090+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:23.128 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:23.131+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:23.379 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.154+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.379 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.181+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.379 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.201+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.379 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.223+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.379 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.249+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.379 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.283+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.380 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.306+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.380 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.331+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.380 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.358+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.380 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.382+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.380 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:23.178+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:23.380 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:23.218+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:23.380 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:23.257+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:23.380 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:23.296+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:23.380 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:23.338+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:23.381 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:23.387+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:23.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 121=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:23 smithi084 ceph-mon[89279]: osdmap e539: 8 total, 8 up, 8 in 2024-03-30T12:30:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 121=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:23 smithi084 ceph-mon[89279]: pgmap v493: 121 pgs: 13 peering, 1 active+undersized+degraded+snaptrim_error, 8 active+undersized+degraded, 20 active+undersized, 5 active+clean+snaptrim, 69 active+clean, 5 active+clean+snaptrim_error; 510 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 8.7 MiB/s rd, 4.4 MiB/s wr, 11 op/s; 61/984 objects degraded (6.199%); 2.4 MiB/s, 0 objects/s recovering 2024-03-30T12:30:23.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 121=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:23.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:23.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:23.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:23.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:23 smithi084 ceph-mon[91810]: osdmap e539: 8 total, 8 up, 8 in 2024-03-30T12:30:23.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:23.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 121=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:23.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:23.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:23.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:23 smithi084 ceph-mon[91810]: pgmap v493: 121 pgs: 13 peering, 1 active+undersized+degraded+snaptrim_error, 8 active+undersized+degraded, 20 active+undersized, 5 active+clean+snaptrim, 69 active+clean, 5 active+clean+snaptrim_error; 510 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 8.7 MiB/s rd, 4.4 MiB/s wr, 11 op/s; 61/984 objects degraded (6.199%); 2.4 MiB/s, 0 objects/s recovering 2024-03-30T12:30:23.633 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:23.440+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:23.633 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:23.479+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:23.634 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:23.534+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:23.634 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:23.585+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:23.634 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:23.632+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:23.634 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.407+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.634 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.428+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.634 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.455+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.634 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.479+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.634 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.510+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.634 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.540+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.634 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.568+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.594+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.617+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.635 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.641+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.794 INFO:tasks.rados.rados.0.smithi084.stdout:2215: finishing write tid 6 to smithi08477944-36 2024-03-30T12:30:23.794 INFO:tasks.rados.rados.0.smithi084.stdout:2215: oid 36 updating version 0 to 17499 2024-03-30T12:30:23.794 INFO:tasks.rados.rados.0.smithi084.stdout:2215: oid 36 updating version 17499 to 17502 2024-03-30T12:30:23.794 INFO:tasks.rados.rados.0.smithi084.stdout:2215: oid 36 version 17502 is already newer than 17500 2024-03-30T12:30:23.795 INFO:tasks.rados.rados.0.smithi084.stdout:2215: oid 36 version 17502 is already newer than 17498 2024-03-30T12:30:23.795 INFO:tasks.rados.rados.0.smithi084.stdout:2215: oid 36 version 17502 is already newer than 17501 2024-03-30T12:30:23.795 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 17502 (ObjNum 681 snap 239 seq_num 681) dirty exists 2024-03-30T12:30:23.795 INFO:tasks.rados.rados.0.smithi084.stdout:2215: left oid 36 (ObjNum 681 snap 239 seq_num 681) 2024-03-30T12:30:23.795 INFO:tasks.rados.rados.0.smithi084.stdout:2216: finishing copy_from to smithi08477944-12 2024-03-30T12:30:23.795 INFO:tasks.rados.rados.0.smithi084.stdout:2216: got expected ENOENT (src dne) 2024-03-30T12:30:23.795 INFO:tasks.rados.rados.0.smithi084.stdout:2216: finishing copy_from racing read to smithi08477944-12 2024-03-30T12:30:23.795 INFO:tasks.rados.rados.0.smithi084.stdout:2209: done (4 left) 2024-03-30T12:30:23.795 INFO:tasks.rados.rados.0.smithi084.stdout:2215: done (3 left) 2024-03-30T12:30:23.795 INFO:tasks.rados.rados.0.smithi084.stdout:2216: done (2 left) 2024-03-30T12:30:23.795 INFO:tasks.rados.rados.0.smithi084.stdout:2218: done (1 left) 2024-03-30T12:30:23.795 INFO:tasks.rados.rados.0.smithi084.stdout:2219: rollback oid 42 current snap is 239 2024-03-30T12:30:23.795 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 42 to 238 2024-03-30T12:30:23.795 INFO:tasks.rados.rados.0.smithi084.stdout:2217: finishing write tid 1 to smithi08477944-17 2024-03-30T12:30:23.795 INFO:tasks.rados.rados.0.smithi084.stdout:2217: finishing write tid 2 to smithi08477944-17 2024-03-30T12:30:23.795 INFO:tasks.rados.rados.0.smithi084.stdout:2217: finishing write tid 3 to smithi08477944-17 2024-03-30T12:30:23.796 INFO:tasks.rados.rados.0.smithi084.stdout:2217: finishing write tid 4 to smithi08477944-17 2024-03-30T12:30:23.796 INFO:tasks.rados.rados.0.smithi084.stdout:2217: finishing write tid 5 to smithi08477944-17 2024-03-30T12:30:23.796 INFO:tasks.rados.rados.0.smithi084.stdout:2217: finishing write tid 6 to smithi08477944-17 2024-03-30T12:30:23.796 INFO:tasks.rados.rados.0.smithi084.stdout:2217: oid 17 updating version 0 to 962 2024-03-30T12:30:23.796 INFO:tasks.rados.rados.0.smithi084.stdout:2217: oid 17 updating version 962 to 963 2024-03-30T12:30:23.796 INFO:tasks.rados.rados.0.smithi084.stdout:2217: oid 17 version 963 is already newer than 961 2024-03-30T12:30:23.796 INFO:tasks.rados.rados.0.smithi084.stdout:2217: oid 17 version 963 is already newer than 960 2024-03-30T12:30:23.796 INFO:tasks.rados.rados.0.smithi084.stdout:2217: oid 17 version 963 is already newer than 959 2024-03-30T12:30:23.796 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 963 (ObjNum 682 snap 239 seq_num 682) dirty exists 2024-03-30T12:30:23.796 INFO:tasks.rados.rados.0.smithi084.stdout:2217: left oid 17 (ObjNum 682 snap 239 seq_num 682) 2024-03-30T12:30:23.796 INFO:tasks.rados.rados.0.smithi084.stdout:2217: done (1 left) 2024-03-30T12:30:23.796 INFO:tasks.rados.rados.0.smithi084.stdout:2220: rollback oid 12 current snap is 239 2024-03-30T12:30:23.796 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 12 to 235 2024-03-30T12:30:23.796 INFO:tasks.rados.rados.0.smithi084.stdout:2221: rollback oid 50 current snap is 239 2024-03-30T12:30:23.796 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 50 to 219 2024-03-30T12:30:23.796 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 46 current snap is 239 2024-03-30T12:30:23.796 INFO:tasks.rados.rados.0.smithi084.stdout:2222: seq_num 684 ranges {9568256=663552,10231808=507904,10739712=409600,11149312=286720} 2024-03-30T12:30:23.851 INFO:tasks.rados.rados.0.smithi084.stdout:2222: writing smithi08477944-46 from 9568256 to 10231808 tid 1 2024-03-30T12:30:23.854 INFO:tasks.rados.rados.0.smithi084.stdout:2222: writing smithi08477944-46 from 10231808 to 10739712 tid 2 2024-03-30T12:30:23.856 INFO:tasks.rados.rados.0.smithi084.stdout:2222: writing smithi08477944-46 from 10739712 to 11149312 tid 3 2024-03-30T12:30:23.859 INFO:tasks.rados.rados.0.smithi084.stdout:2222: writing smithi08477944-46 from 11149312 to 11436032 tid 4 2024-03-30T12:30:23.859 INFO:tasks.rados.rados.0.smithi084.stdout:2223: snap_create 2024-03-30T12:30:23.859 INFO:tasks.rados.rados.0.smithi084.stdout:2219: finishing rollback tid 0 to smithi08477944-42 2024-03-30T12:30:23.859 INFO:tasks.rados.rados.0.smithi084.stdout:2219: finishing rollback tid 1 to smithi08477944-42 2024-03-30T12:30:23.859 INFO:tasks.rados.rados.0.smithi084.stdout:2219: finishing rollback tid 2 to smithi08477944-42 2024-03-30T12:30:23.859 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 966 (ObjNum 502 snap 157 seq_num 502) dirty exists 2024-03-30T12:30:23.859 INFO:tasks.rados.rados.0.smithi084.stdout:2221: finishing rollback tid 0 to smithi08477944-50 2024-03-30T12:30:23.859 INFO:tasks.rados.rados.0.smithi084.stdout:2221: finishing rollback tid 1 to smithi08477944-50 2024-03-30T12:30:23.859 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 981 (ObjNum 97 snap 0 seq_num 1429707712) dirty dne 2024-03-30T12:30:23.859 INFO:tasks.rados.rados.0.smithi084.stdout:2220: finishing rollback tid 0 to smithi08477944-12 2024-03-30T12:30:23.860 INFO:tasks.rados.rados.0.smithi084.stdout:2220: finishing rollback tid 1 to smithi08477944-12 2024-03-30T12:30:23.860 INFO:tasks.rados.rados.0.smithi084.stdout:2220: finishing rollback tid 2 to smithi08477944-12 2024-03-30T12:30:23.860 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 23366 (ObjNum 603 snap 215 seq_num 603) dirty exists 2024-03-30T12:30:23.874 INFO:tasks.rados.rados.0.smithi084.stdout:2222: finishing write tid 1 to smithi08477944-46 2024-03-30T12:30:23.884 INFO:tasks.rados.rados.0.smithi084.stdout:2222: finishing write tid 2 to smithi08477944-46 2024-03-30T12:30:23.890 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.676+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.890 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.701+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.890 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.731+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.890 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.755+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.890 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.778+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.890 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.810+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.890 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.839+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.890 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.861+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.890 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.888+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:23.891 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:23.666+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:23.891 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:23.703+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:23.891 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:23.744+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:23.891 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:23.784+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:23.891 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:23.827+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:23.892 INFO:tasks.rados.rados.0.smithi084.stdout:2222: finishing write tid 3 to smithi08477944-46 2024-03-30T12:30:23.892 INFO:tasks.rados.rados.0.smithi084.stdout:2222: finishing write tid 4 to smithi08477944-46 2024-03-30T12:30:23.893 INFO:tasks.rados.rados.0.smithi084.stdout:2222: finishing write tid 5 to smithi08477944-46 2024-03-30T12:30:23.903 INFO:tasks.rados.rados.0.smithi084.stdout:2222: finishing write tid 6 to smithi08477944-46 2024-03-30T12:30:23.903 INFO:tasks.rados.rados.0.smithi084.stdout:2222: oid 46 updating version 0 to 24185 2024-03-30T12:30:23.903 INFO:tasks.rados.rados.0.smithi084.stdout:2222: oid 46 version 24185 is already newer than 24184 2024-03-30T12:30:23.903 INFO:tasks.rados.rados.0.smithi084.stdout:2222: oid 46 version 24185 is already newer than 24182 2024-03-30T12:30:23.904 INFO:tasks.rados.rados.0.smithi084.stdout:2222: oid 46 updating version 24185 to 24186 2024-03-30T12:30:23.904 INFO:tasks.rados.rados.0.smithi084.stdout:2222: oid 46 version 24186 is already newer than 24183 2024-03-30T12:30:23.904 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 24186 (ObjNum 684 snap 239 seq_num 684) dirty exists 2024-03-30T12:30:23.904 INFO:tasks.rados.rados.0.smithi084.stdout:2222: left oid 46 (ObjNum 684 snap 239 seq_num 684) 2024-03-30T12:30:24.094 INFO:tasks.rados.rados.0.smithi084.stdout:2219: done (4 left) 2024-03-30T12:30:24.094 INFO:tasks.rados.rados.0.smithi084.stdout:2220: done (3 left) 2024-03-30T12:30:24.094 INFO:tasks.rados.rados.0.smithi084.stdout:2221: done (2 left) 2024-03-30T12:30:24.094 INFO:tasks.rados.rados.0.smithi084.stdout:2222: done (1 left) 2024-03-30T12:30:24.094 INFO:tasks.rados.rados.0.smithi084.stdout:2223: done (0 left) 2024-03-30T12:30:24.095 INFO:tasks.rados.rados.0.smithi084.stdout:2224: read oid 19 snap -1 2024-03-30T12:30:24.095 INFO:tasks.rados.rados.0.smithi084.stdout:2224: expect (ObjNum 638 snap 226 seq_num 638) 2024-03-30T12:30:24.095 INFO:tasks.rados.rados.0.smithi084.stdout:2225: copy_from oid 34 from oid 37 current snap is 240 2024-03-30T12:30:24.095 INFO:tasks.rados.rados.0.smithi084.stdout:2226: rollback oid 7 current snap is 240 2024-03-30T12:30:24.095 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 7 to 212 2024-03-30T12:30:24.095 INFO:tasks.rados.rados.0.smithi084.stdout:2227: read oid 26 snap -1 2024-03-30T12:30:24.095 INFO:tasks.rados.rados.0.smithi084.stdout:2227: expect (ObjNum 525 snap 171 seq_num 525) 2024-03-30T12:30:24.095 INFO:tasks.rados.rados.0.smithi084.stdout:2228: delete oid 10 current snap is 240 2024-03-30T12:30:24.099 INFO:tasks.rados.rados.0.smithi084.stdout:2226: finishing rollback tid 0 to smithi08477944-7 2024-03-30T12:30:24.099 INFO:tasks.rados.rados.0.smithi084.stdout:2226: finishing rollback tid 1 to smithi08477944-7 2024-03-30T12:30:24.103 INFO:tasks.rados.rados.0.smithi084.stdout:2226: finishing rollback tid 2 to smithi08477944-7 2024-03-30T12:30:24.104 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 17502 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:30:24.114 INFO:tasks.rados.rados.0.smithi084.stdout:2224: expect (ObjNum 638 snap 226 seq_num 638) 2024-03-30T12:30:24.155 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:24.105+0000 7f9dc765a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 10b after trimming was started 2024-03-30T12:30:24.155 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:24.105+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:24.155 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.912+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.155 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.937+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.155 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.959+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.155 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:23.982+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.155 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.005+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.156 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.031+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.156 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.058+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.156 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.085+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.156 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.118+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.156 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.162+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.156 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:23.898+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:24.156 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:23.935+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:24.156 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:23.973+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:24.156 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:24.016+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:24.156 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:24.052+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:24.156 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:24.090+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:24.195 INFO:tasks.rados.rados.0.smithi084.stdout:2225: finishing copy_from racing read to smithi08477944-34 2024-03-30T12:30:24.196 INFO:tasks.rados.rados.0.smithi084.stdout:2225: finishing copy_from to smithi08477944-34 2024-03-30T12:30:24.196 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 23362 (ObjNum 603 snap 215 seq_num 603) dirty exists 2024-03-30T12:30:24.196 INFO:tasks.rados.rados.0.smithi084.stdout:2224: done (4 left) 2024-03-30T12:30:24.196 INFO:tasks.rados.rados.0.smithi084.stdout:2225: done (3 left) 2024-03-30T12:30:24.196 INFO:tasks.rados.rados.0.smithi084.stdout:2226: done (2 left) 2024-03-30T12:30:24.196 INFO:tasks.rados.rados.0.smithi084.stdout:2228: done (1 left) 2024-03-30T12:30:24.196 INFO:tasks.rados.rados.0.smithi084.stdout:2229: copy_from oid 30 from oid 35 current snap is 240 2024-03-30T12:30:24.196 INFO:tasks.rados.rados.0.smithi084.stdout:2227: expect (ObjNum 525 snap 171 seq_num 525) 2024-03-30T12:30:24.411 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.188+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.411 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.218+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.411 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.239+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.411 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.280+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.411 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.319+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.411 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.343+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.411 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.373+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.411 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.398+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.412 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.419+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.412 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:24.183+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:24.412 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:24.217+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:24.412 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:24.259+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:24.412 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:24.311+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:24.412 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:24.351+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:24.412 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:24.389+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:24.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:24.109+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:24.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:24.110+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:24.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:24.100+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:24.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:24.101+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:24.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:24.101+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:24.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:24.101+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:24.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:24.101+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:24.679 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.450+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.679 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.478+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.679 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.506+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.679 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.542+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.679 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.569+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.679 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.592+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.679 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.613+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.679 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.640+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.679 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.661+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.680 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.685+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.680 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:24.435+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:24.680 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:24.473+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:24.680 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:24.515+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:24.680 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:24.566+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:24.680 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:24.607+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:24.680 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:24.652+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:24.680 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:24.686+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:24.935 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.711+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.936 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.751+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.936 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.777+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.936 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.802+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.936 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.826+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.936 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.848+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.936 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.875+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.936 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.896+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.936 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.921+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.936 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.943+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:24.936 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:24.729+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:24.937 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:24.758+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:24.937 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:24.785+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:24.937 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:24.832+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:24.937 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:24.873+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:24.937 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:24.912+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:2229: finishing copy_from racing read to smithi08477944-30 2024-03-30T12:30:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:2229: finishing copy_from to smithi08477944-30 2024-03-30T12:30:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 946 (ObjNum 502 snap 157 seq_num 502) dirty exists 2024-03-30T12:30:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:2227: done (1 left) 2024-03-30T12:30:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:2229: done (0 left) 2024-03-30T12:30:25.183 INFO:tasks.rados.rados.0.smithi084.stdout:2230: snap_create 2024-03-30T12:30:25.207 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.967+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.207 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:24.991+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.207 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.019+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.207 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.039+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.207 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.064+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.207 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.084+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.208 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.118+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.208 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.146+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.208 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.166+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.208 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.193+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.208 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.215+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.208 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:25.208 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: osdmap e540: 8 total, 8 up, 8 in 2024-03-30T12:30:25.208 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:25.208 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:25.208 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:25.209 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:25.209 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:25.209 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:25.209 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:25.209 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:25.209 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:30:25.209 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:30:25.209 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:25.209 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:30:25.209 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:25.209 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:25.209 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:25.209 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:25.210 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: Upgrade: Setting container_image for all osd 2024-03-30T12:30:25.210 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:25.210 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-03-30T12:30:25.210 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-03-30T12:30:25.210 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-03-30T12:30:25.210 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-03-30T12:30:25.210 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-03-30T12:30:25.210 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-03-30T12:30:25.210 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-03-30T12:30:25.210 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-03-30T12:30:25.210 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-03-30T12:30:25.210 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-03-30T12:30:25.210 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-03-30T12:30:25.210 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-03-30T12:30:25.211 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-03-30T12:30:25.211 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-03-30T12:30:25.211 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-03-30T12:30:25.211 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-03-30T12:30:25.211 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: Upgrade: Setting require_osd_release to 19 squid 2024-03-30T12:30:25.211 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-03-30T12:30:25.211 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: Health check update: Degraded data redundancy: 61/984 objects degraded (6.199%), 9 pgs degraded (PG_DEGRADED) 2024-03-30T12:30:25.211 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-mon[83709]: pgmap v495: 121 pgs: 13 peering, 6 active+clean+snaptrim, 95 active+clean, 7 active+clean+snaptrim_error; 512 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 17 MiB/s rd, 5.1 MiB/s wr, 21 op/s; 19 MiB/s, 4 objects/s recovering 2024-03-30T12:30:25.211 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:24.957+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.211 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:25.003+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.211 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:25.042+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.212 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:25.090+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.212 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:25.133+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.212 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:25.187+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.466 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.245+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.466 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.267+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.466 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.291+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.466 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.314+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.466 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.338+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.466 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.361+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.466 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.381+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.466 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.403+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.466 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.431+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.467 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.457+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.467 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:25.230+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.467 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:25.271+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.467 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:25.316+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.467 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:25.354+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.467 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:25.399+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.467 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:25.436+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.467 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:25.473+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:25.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: osdmap e540: 8 total, 8 up, 8 in 2024-03-30T12:30:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:30:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:30:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:30:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:25.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: Upgrade: Setting container_image for all osd 2024-03-30T12:30:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-03-30T12:30:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-03-30T12:30:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-03-30T12:30:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-03-30T12:30:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-03-30T12:30:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-03-30T12:30:25.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-03-30T12:30:25.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 126=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:25.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: osdmap e540: 8 total, 8 up, 8 in 2024-03-30T12:30:25.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:25.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:25.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:25.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:25.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:25.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:25.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:25.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:25.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:30:25.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:30:25.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:25.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:30:25.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:25.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:25.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:25.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:25.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: Upgrade: Setting container_image for all osd 2024-03-30T12:30:25.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:25.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-03-30T12:30:25.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-03-30T12:30:25.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-03-30T12:30:25.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-03-30T12:30:25.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-03-30T12:30:25.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-03-30T12:30:25.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-03-30T12:30:25.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-03-30T12:30:25.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-03-30T12:30:25.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-03-30T12:30:25.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-03-30T12:30:25.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-03-30T12:30:25.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-03-30T12:30:25.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-03-30T12:30:25.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-03-30T12:30:25.509 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-03-30T12:30:25.509 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: Upgrade: Setting require_osd_release to 19 squid 2024-03-30T12:30:25.509 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-03-30T12:30:25.509 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: Health check update: Degraded data redundancy: 61/984 objects degraded (6.199%), 9 pgs degraded (PG_DEGRADED) 2024-03-30T12:30:25.509 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[91810]: pgmap v495: 121 pgs: 13 peering, 6 active+clean+snaptrim, 95 active+clean, 7 active+clean+snaptrim_error; 512 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 17 MiB/s rd, 5.1 MiB/s wr, 21 op/s; 19 MiB/s, 4 objects/s recovering 2024-03-30T12:30:25.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-03-30T12:30:25.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-03-30T12:30:25.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-03-30T12:30:25.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-03-30T12:30:25.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-03-30T12:30:25.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-03-30T12:30:25.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-03-30T12:30:25.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-03-30T12:30:25.510 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-03-30T12:30:25.510 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: Upgrade: Setting require_osd_release to 19 squid 2024-03-30T12:30:25.510 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-03-30T12:30:25.510 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: Health check update: Degraded data redundancy: 61/984 objects degraded (6.199%), 9 pgs degraded (PG_DEGRADED) 2024-03-30T12:30:25.510 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-mon[89279]: pgmap v495: 121 pgs: 13 peering, 6 active+clean+snaptrim, 95 active+clean, 7 active+clean+snaptrim_error; 512 MiB data, 6.4 GiB used, 709 GiB / 715 GiB avail; 17 MiB/s rd, 5.1 MiB/s wr, 21 op/s; 19 MiB/s, 4 objects/s recovering 2024-03-30T12:30:25.556 INFO:tasks.rados.rados.0.smithi084.stdout:2230: done (0 left) 2024-03-30T12:30:25.556 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 241 2024-03-30T12:30:25.556 INFO:tasks.rados.rados.0.smithi084.stdout:2231: seq_num 686 ranges {507904=696320,1204224=729088,1933312=425984,2359296=49152} 2024-03-30T12:30:25.563 INFO:tasks.rados.rados.0.smithi084.stdout:2231: writing smithi08477944-12 from 507904 to 1204224 tid 1 2024-03-30T12:30:25.569 INFO:tasks.rados.rados.0.smithi084.stdout:2231: writing smithi08477944-12 from 1204224 to 1933312 tid 2 2024-03-30T12:30:25.571 INFO:tasks.rados.rados.0.smithi084.stdout:2231: writing smithi08477944-12 from 1933312 to 2359296 tid 3 2024-03-30T12:30:25.573 INFO:tasks.rados.rados.0.smithi084.stdout:2231: writing smithi08477944-12 from 2359296 to 2408448 tid 4 2024-03-30T12:30:25.573 INFO:tasks.rados.rados.0.smithi084.stdout:2232: read oid 33 snap -1 2024-03-30T12:30:25.573 INFO:tasks.rados.rados.0.smithi084.stdout:2232: expect (ObjNum 498 snap 156 seq_num 498) 2024-03-30T12:30:25.573 INFO:tasks.rados.rados.0.smithi084.stdout:2233: rmattr oid 38 current snap is 241 2024-03-30T12:30:25.574 INFO:tasks.rados.rados.0.smithi084.stdout:2234: rollback oid 10 current snap is 241 2024-03-30T12:30:25.574 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 10 to 227 2024-03-30T12:30:25.574 INFO:tasks.rados.rados.0.smithi084.stdout:2235: rollback oid 35 current snap is 241 2024-03-30T12:30:25.575 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 35 to 168 2024-03-30T12:30:25.575 INFO:tasks.rados.rados.0.smithi084.stdout:2236: rollback oid 2 current snap is 241 2024-03-30T12:30:25.575 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 2 to 219 2024-03-30T12:30:25.575 INFO:tasks.rados.rados.0.smithi084.stdout:2237: read oid 17 snap -1 2024-03-30T12:30:25.575 INFO:tasks.rados.rados.0.smithi084.stdout:2237: expect (ObjNum 682 snap 239 seq_num 682) 2024-03-30T12:30:25.576 INFO:tasks.rados.rados.0.smithi084.stdout:2238: rollback oid 31 current snap is 241 2024-03-30T12:30:25.576 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 31 to 212 2024-03-30T12:30:25.576 INFO:tasks.rados.rados.0.smithi084.stdout:2239: snap_remove snap 235 2024-03-30T12:30:25.718 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:25.568+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:25.718 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.477+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.718 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.504+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.719 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.534+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.719 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.557+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.719 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.595+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.719 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.622+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.719 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.650+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.719 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.673+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.719 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.701+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.719 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.726+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.719 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:25.513+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.719 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:25.557+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.719 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:25.604+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.720 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:25.631+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.720 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:25.660+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.720 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:25.702+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.975 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.750+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.975 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.778+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.975 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.810+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.975 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.835+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.976 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.858+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.976 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.882+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.976 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.904+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.976 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.924+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.976 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.948+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.976 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.971+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:25.977 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:25.736+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.977 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:25.778+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.977 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:25.820+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.977 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:25.853+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.977 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:25.897+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.977 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:25.938+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:25.977 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:25.982+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:26.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:25.574+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:26.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:25.574+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:26.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:30:25.693+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : Health check update: Possible data damage: 7 pgs snaptrim_error (PG_DAMAGED) 2024-03-30T12:30:26.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:25.589+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:26.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:25.590+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:26.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:25.591+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:26.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:25.591+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:26.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:25.591+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:26.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:25.591+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:26.229 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:25.994+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.229 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.021+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.229 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.043+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.229 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.068+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.229 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.089+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.229 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.117+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.229 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.143+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.229 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.165+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.229 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.188+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.230 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.216+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.230 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-mon[83709]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-03-30T12:30:26.230 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-03-30T12:30:26.230 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-mon[83709]: osdmap e541: 8 total, 8 up, 8 in 2024-03-30T12:30:26.230 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds ok-to-stop", "ids": ["a"]}]: dispatch 2024-03-30T12:30:26.230 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-mon[83709]: Upgrade: It appears safe to stop mds.a 2024-03-30T12:30:26.231 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:26.231 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:26.231 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:26.231 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:26.231 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:26.231 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:26.231 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-mon[83709]: Health check update: Possible data damage: 7 pgs snaptrim_error (PG_DAMAGED) 2024-03-30T12:30:26.231 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-mon[83709]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 61/984 objects degraded (6.199%), 9 pgs degraded) 2024-03-30T12:30:26.231 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:26.014+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:26.231 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:26.050+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:26.231 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:26.094+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:26.232 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:26.130+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:26.232 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:26.166+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:26.232 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:26.207+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:26.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[89279]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-03-30T12:30:26.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-03-30T12:30:26.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[89279]: osdmap e541: 8 total, 8 up, 8 in 2024-03-30T12:30:26.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds ok-to-stop", "ids": ["a"]}]: dispatch 2024-03-30T12:30:26.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[89279]: Upgrade: It appears safe to stop mds.a 2024-03-30T12:30:26.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:26.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:26.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:26.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:26.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:26.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:26.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[89279]: Health check update: Possible data damage: 7 pgs snaptrim_error (PG_DAMAGED) 2024-03-30T12:30:26.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[89279]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 61/984 objects degraded (6.199%), 9 pgs degraded) 2024-03-30T12:30:26.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[91810]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-03-30T12:30:26.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-03-30T12:30:26.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[91810]: osdmap e541: 8 total, 8 up, 8 in 2024-03-30T12:30:26.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds ok-to-stop", "ids": ["a"]}]: dispatch 2024-03-30T12:30:26.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[91810]: Upgrade: It appears safe to stop mds.a 2024-03-30T12:30:26.430 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:26.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:26.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:26.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:26.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:26.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:26.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[91810]: Health check update: Possible data damage: 7 pgs snaptrim_error (PG_DAMAGED) 2024-03-30T12:30:26.432 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-mon[91810]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 61/984 objects degraded (6.199%), 9 pgs degraded) 2024-03-30T12:30:26.485 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.237+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.485 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.263+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.485 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.284+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.486 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.307+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.486 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.330+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.486 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.359+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.486 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.383+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.486 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.405+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.487 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.432+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.487 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.455+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.487 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.480+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.487 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:26.257+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:26.487 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:26.298+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:26.488 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:26.339+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:26.488 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:26.378+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:26.488 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:26.413+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:26.488 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:26.457+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:26.488 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:26.493+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:26.559 INFO:tasks.rados.rados.0.smithi084.stdout:2239: done (8 left) 2024-03-30T12:30:26.559 INFO:tasks.rados.rados.0.smithi084.stdout:2240: delete oid 25 current snap is 241 2024-03-30T12:30:26.559 INFO:tasks.rados.rados.0.smithi084.stdout:2235: finishing rollback tid 0 to smithi08477944-35 2024-03-30T12:30:26.559 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1021 (ObjNum 525 snap 171 seq_num 525) dirty exists 2024-03-30T12:30:26.559 INFO:tasks.rados.rados.0.smithi084.stdout:2235: finishing rollback tid 1 to smithi08477944-35 2024-03-30T12:30:26.559 INFO:tasks.rados.rados.0.smithi084.stdout:2235: finishing rollback tid 2 to smithi08477944-35 2024-03-30T12:30:26.559 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 949 (ObjNum 501 snap 156 seq_num 501) dirty exists 2024-03-30T12:30:26.559 INFO:tasks.rados.rados.0.smithi084.stdout:2232: expect (ObjNum 498 snap 156 seq_num 498) 2024-03-30T12:30:26.607 INFO:tasks.rados.rados.0.smithi084.stdout:2237: expect (ObjNum 682 snap 239 seq_num 682) 2024-03-30T12:30:26.680 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:26.571+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:26.680 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:26.572+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:26.680 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:26.563+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:26.680 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:26.563+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:26.680 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:26.563+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:26.680 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:26.564+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:26.681 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:26.564+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:26.694 INFO:tasks.rados.rados.0.smithi084.stdout:2231: finishing write tid 1 to smithi08477944-12 2024-03-30T12:30:26.694 INFO:tasks.rados.rados.0.smithi084.stdout:2232: done (8 left) 2024-03-30T12:30:26.694 INFO:tasks.rados.rados.0.smithi084.stdout:2233: done (7 left) 2024-03-30T12:30:26.694 INFO:tasks.rados.rados.0.smithi084.stdout:2235: done (6 left) 2024-03-30T12:30:26.694 INFO:tasks.rados.rados.0.smithi084.stdout:2237: done (5 left) 2024-03-30T12:30:26.694 INFO:tasks.rados.rados.0.smithi084.stdout:2240: done (4 left) 2024-03-30T12:30:26.694 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 241 2024-03-30T12:30:26.694 INFO:tasks.rados.rados.0.smithi084.stdout:2238: finishing rollback tid 1 to smithi08477944-31 2024-03-30T12:30:26.695 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 810 (ObjNum 33 snap 0 seq_num 1394492664) dirty dne 2024-03-30T12:30:26.695 INFO:tasks.rados.rados.0.smithi084.stdout:2231: finishing write tid 2 to smithi08477944-12 2024-03-30T12:30:26.695 INFO:tasks.rados.rados.0.smithi084.stdout:2241: seq_num 688 ranges {1449984=729088,2179072=499712,2678784=704512} 2024-03-30T12:30:26.706 INFO:tasks.rados.rados.0.smithi084.stdout:2241: writing smithi08477944-41 from 1449984 to 2179072 tid 1 2024-03-30T12:30:26.709 INFO:tasks.rados.rados.0.smithi084.stdout:2241: writing smithi08477944-41 from 2179072 to 2678784 tid 2 2024-03-30T12:30:26.715 INFO:tasks.rados.rados.0.smithi084.stdout:2241: writing smithi08477944-41 from 2678784 to 3383296 tid 3 2024-03-30T12:30:26.715 INFO:tasks.rados.rados.0.smithi084.stdout:2238: done (4 left) 2024-03-30T12:30:26.715 INFO:tasks.rados.rados.0.smithi084.stdout:2242: snap_create 2024-03-30T12:30:26.715 INFO:tasks.rados.rados.0.smithi084.stdout:2234: finishing rollback tid 1 to smithi08477944-10 2024-03-30T12:30:26.715 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 23373 (ObjNum 256 snap 0 seq_num 304) dirty dne 2024-03-30T12:30:26.715 INFO:tasks.rados.rados.0.smithi084.stdout:2236: finishing rollback tid 1 to smithi08477944-2 2024-03-30T12:30:26.716 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 0 (ObjNum 5233 snap 0 seq_num 1532998432) dirty dne 2024-03-30T12:30:26.716 INFO:tasks.rados.rados.0.smithi084.stdout:2231: finishing write tid 3 to smithi08477944-12 2024-03-30T12:30:26.716 INFO:tasks.rados.rados.0.smithi084.stdout:2231: finishing write tid 4 to smithi08477944-12 2024-03-30T12:30:26.716 INFO:tasks.rados.rados.0.smithi084.stdout:2231: finishing write tid 5 to smithi08477944-12 2024-03-30T12:30:26.716 INFO:tasks.rados.rados.0.smithi084.stdout:2231: finishing write tid 6 to smithi08477944-12 2024-03-30T12:30:26.716 INFO:tasks.rados.rados.0.smithi084.stdout:2231: oid 12 updating version 0 to 23371 2024-03-30T12:30:26.716 INFO:tasks.rados.rados.0.smithi084.stdout:2231: oid 12 version 23371 is already newer than 23367 2024-03-30T12:30:26.716 INFO:tasks.rados.rados.0.smithi084.stdout:2231: oid 12 version 23371 is already newer than 23368 2024-03-30T12:30:26.716 INFO:tasks.rados.rados.0.smithi084.stdout:2231: oid 12 version 23371 is already newer than 23369 2024-03-30T12:30:26.716 INFO:tasks.rados.rados.0.smithi084.stdout:2231: oid 12 version 23371 is already newer than 23370 2024-03-30T12:30:26.716 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 23371 (ObjNum 686 snap 241 seq_num 686) dirty exists 2024-03-30T12:30:26.716 INFO:tasks.rados.rados.0.smithi084.stdout:2231: left oid 12 (ObjNum 686 snap 241 seq_num 686) 2024-03-30T12:30:26.721 INFO:tasks.rados.rados.0.smithi084.stdout:2241: finishing write tid 1 to smithi08477944-41 2024-03-30T12:30:26.721 INFO:tasks.rados.rados.0.smithi084.stdout:2241: finishing write tid 2 to smithi08477944-41 2024-03-30T12:30:26.721 INFO:tasks.rados.rados.0.smithi084.stdout:2241: finishing write tid 3 to smithi08477944-41 2024-03-30T12:30:26.722 INFO:tasks.rados.rados.0.smithi084.stdout:2241: finishing write tid 4 to smithi08477944-41 2024-03-30T12:30:26.724 INFO:tasks.rados.rados.0.smithi084.stdout:2241: finishing write tid 5 to smithi08477944-41 2024-03-30T12:30:26.724 INFO:tasks.rados.rados.0.smithi084.stdout:2241: oid 41 updating version 0 to 983 2024-03-30T12:30:26.724 INFO:tasks.rados.rados.0.smithi084.stdout:2241: oid 41 updating version 983 to 986 2024-03-30T12:30:26.724 INFO:tasks.rados.rados.0.smithi084.stdout:2241: oid 41 version 986 is already newer than 984 2024-03-30T12:30:26.724 INFO:tasks.rados.rados.0.smithi084.stdout:2241: oid 41 version 986 is already newer than 985 2024-03-30T12:30:26.725 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 986 (ObjNum 688 snap 241 seq_num 688) dirty exists 2024-03-30T12:30:26.725 INFO:tasks.rados.rados.0.smithi084.stdout:2241: left oid 41 (ObjNum 688 snap 241 seq_num 688) 2024-03-30T12:30:26.755 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:26.567+0000 7f9dcb662700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 10b after trimming was started 2024-03-30T12:30:26.755 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:26.567+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:26.756 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.507+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.756 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.530+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.756 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.554+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.756 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.588+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.756 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.620+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.756 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.642+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.756 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.666+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.756 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.686+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.756 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.709+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.757 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.732+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:26.757 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:26.532+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:26.757 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:26.567+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:26.757 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:26.613+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:26.757 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:26.656+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:26.757 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:26.697+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:26.757 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:26.738+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.022 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:26.784+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.023 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:26.834+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.023 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:26.881+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.023 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:26.917+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.023 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:26.961+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.023 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.004+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.023 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.760+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.023 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.783+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.023 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.807+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.023 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.830+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.023 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.858+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.023 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.880+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.023 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.901+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.024 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.922+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.024 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.942+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.024 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.963+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.024 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:26.985+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.024 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.008+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.024 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.030+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.273 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.053+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.274 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.077+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.274 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.098+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.274 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.124+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.274 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.147+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.274 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.172+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.274 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.197+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.274 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.214+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.274 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.235+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.274 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.260+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.275 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:27.275 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:27.275 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:27.275 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:27.275 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-mon[83709]: osdmap e542: 8 total, 8 up, 8 in 2024-03-30T12:30:27.275 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:27.275 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:27.275 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:27.275 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-mon[83709]: pgmap v498: 121 pgs: 6 active+clean+snaptrim, 108 active+clean, 7 active+clean+snaptrim_error; 520 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 22 MiB/s rd, 5.3 MiB/s wr, 26 op/s; 19 MiB/s, 4 objects/s recovering 2024-03-30T12:30:27.275 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.047+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.276 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.086+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.276 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.127+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.276 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.166+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.276 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.210+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.276 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.252+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.276 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.281+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:27.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:27.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:27.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:27.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-mon[89279]: osdmap e542: 8 total, 8 up, 8 in 2024-03-30T12:30:27.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:27.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:27.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:27.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-mon[89279]: pgmap v498: 121 pgs: 6 active+clean+snaptrim, 108 active+clean, 7 active+clean+snaptrim_error; 520 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 22 MiB/s rd, 5.3 MiB/s wr, 26 op/s; 19 MiB/s, 4 objects/s recovering 2024-03-30T12:30:27.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:27.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:27.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:27.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:27.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-mon[91810]: osdmap e542: 8 total, 8 up, 8 in 2024-03-30T12:30:27.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:27.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:27.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:27.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-mon[91810]: pgmap v498: 121 pgs: 6 active+clean+snaptrim, 108 active+clean, 7 active+clean+snaptrim_error; 520 MiB data, 5.1 GiB used, 710 GiB / 715 GiB avail; 22 MiB/s rd, 5.3 MiB/s wr, 26 op/s; 19 MiB/s, 4 objects/s recovering 2024-03-30T12:30:27.526 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.308+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.526 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.343+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.526 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.381+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.526 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.414+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.526 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.447+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.526 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.487+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.526 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.281+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.527 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.306+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.527 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.333+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.527 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.353+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.527 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.375+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.527 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.400+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.527 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.420+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.527 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.445+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.527 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.464+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.527 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.486+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.527 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.513+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.527 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.534+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.564 INFO:tasks.rados.rados.0.smithi084.stdout:2231: done (4 left) 2024-03-30T12:30:27.564 INFO:tasks.rados.rados.0.smithi084.stdout:2234: done (3 left) 2024-03-30T12:30:27.564 INFO:tasks.rados.rados.0.smithi084.stdout:2236: done (2 left) 2024-03-30T12:30:27.564 INFO:tasks.rados.rados.0.smithi084.stdout:2241: done (1 left) 2024-03-30T12:30:27.564 INFO:tasks.rados.rados.0.smithi084.stdout:2242: done (0 left) 2024-03-30T12:30:27.564 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 242 2024-03-30T12:30:27.564 INFO:tasks.rados.rados.0.smithi084.stdout:2243: seq_num 689 ranges {507904=745472,1253376=786432,2039808=417792} 2024-03-30T12:30:27.571 INFO:tasks.rados.rados.0.smithi084.stdout:2243: writing smithi08477944-37 from 507904 to 1253376 tid 1 2024-03-30T12:30:27.576 INFO:tasks.rados.rados.0.smithi084.stdout:2243: writing smithi08477944-37 from 1253376 to 2039808 tid 2 2024-03-30T12:30:27.579 INFO:tasks.rados.rados.0.smithi084.stdout:2243: writing smithi08477944-37 from 2039808 to 2457600 tid 3 2024-03-30T12:30:27.579 INFO:tasks.rados.rados.0.smithi084.stdout:2244: rollback oid 2 current snap is 242 2024-03-30T12:30:27.579 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 2 to 231 2024-03-30T12:30:27.579 INFO:tasks.rados.rados.0.smithi084.stdout:2245: delete oid 36 current snap is 242 2024-03-30T12:30:27.586 INFO:tasks.rados.rados.0.smithi084.stdout:2245: done (2 left) 2024-03-30T12:30:27.586 INFO:tasks.rados.rados.0.smithi084.stdout:2246: snap_remove snap 212 2024-03-30T12:30:27.795 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:27.579+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:27.796 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.541+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.796 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.580+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.796 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.618+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.796 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.658+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.796 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.702+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.796 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.744+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.796 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.778+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:27.796 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.556+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.796 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.594+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.796 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.618+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.796 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.642+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.797 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.666+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.797 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.693+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.797 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.718+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.797 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.738+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.797 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.763+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.797 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.783+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:27.797 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.803+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:27.582+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:28.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:27.582+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:28.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:27.570+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:28.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:27.570+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:28.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:27.570+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:28.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:27.570+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:28.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:27.570+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:28.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:27.571+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:28.049 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.815+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.049 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.852+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.049 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.890+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.050 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.934+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.050 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:27.974+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.050 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:28.016+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.050 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:28.057+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.050 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.823+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.050 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.843+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.050 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.865+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.050 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.890+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.050 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.916+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.050 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.942+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.050 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.962+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.050 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:27.986+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.051 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.011+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.051 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.034+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.051 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.057+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:28.304 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:28.304 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:28.304 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:28.304 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:28.304 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-mon[83709]: osdmap e543: 8 total, 8 up, 8 in 2024-03-30T12:30:28.304 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:28.304 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:28.304 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-mon[83709]: Upgrade: Updating mds.a 2024-03-30T12:30:28.304 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:28.304 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-30T12:30:28.304 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:30:28.304 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-mon[83709]: Deploying daemon mds.a on smithi084 2024-03-30T12:30:28.305 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.078+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.305 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.102+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.305 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.128+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.305 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.151+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.305 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.176+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.305 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.199+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.305 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.220+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.305 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.243+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.305 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.264+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.305 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.288+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.305 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:28.099+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.305 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:28.134+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.305 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:28.180+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.306 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:28.219+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.306 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:28.265+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.306 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:28.292+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.421 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:28.421 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:28.421 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:28.421 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:28.421 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:28.421 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[91810]: osdmap e543: 8 total, 8 up, 8 in 2024-03-30T12:30:28.421 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:28.421 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:28.421 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[91810]: Upgrade: Updating mds.a 2024-03-30T12:30:28.422 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:28.422 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-30T12:30:28.422 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:30:28.422 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[91810]: Deploying daemon mds.a on smithi084 2024-03-30T12:30:28.422 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:28.422 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:28.422 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:28.422 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:28.422 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:28.422 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[89279]: osdmap e543: 8 total, 8 up, 8 in 2024-03-30T12:30:28.422 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:28.423 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:28.423 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[89279]: Upgrade: Updating mds.a 2024-03-30T12:30:28.423 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:28.423 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-30T12:30:28.423 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:30:28.423 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-mon[89279]: Deploying daemon mds.a on smithi084 2024-03-30T12:30:28.556 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:28.340+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.556 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:28.379+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.556 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:28.420+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.556 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:28.451+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.556 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:28.490+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.556 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:28.525+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.556 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:28.564+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.556 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.311+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.556 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.333+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.557 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.357+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.557 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.380+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.557 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.406+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.557 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.429+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.557 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.455+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.557 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.477+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.557 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.502+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.557 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.527+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.557 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.550+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.567 INFO:tasks.rados.rados.0.smithi084.stdout:2246: done (2 left) 2024-03-30T12:30:28.567 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 242 2024-03-30T12:30:28.567 INFO:tasks.rados.rados.0.smithi084.stdout:2247: seq_num 691 ranges {0=778240,778240=548864,1327104=614400,1941504=40960} 2024-03-30T12:30:28.572 INFO:tasks.rados.rados.0.smithi084.stdout:2247: writing smithi08477944-40 from 0 to 778240 tid 1 2024-03-30T12:30:28.577 INFO:tasks.rados.rados.0.smithi084.stdout:2247: writing smithi08477944-40 from 778240 to 1327104 tid 2 2024-03-30T12:30:28.582 INFO:tasks.rados.rados.0.smithi084.stdout:2247: writing smithi08477944-40 from 1327104 to 1941504 tid 3 2024-03-30T12:30:28.582 INFO:tasks.rados.rados.0.smithi084.stdout:2247: writing smithi08477944-40 from 1941504 to 1982464 tid 4 2024-03-30T12:30:28.583 INFO:tasks.rados.rados.0.smithi084.stdout:2244: finishing rollback tid 1 to smithi08477944-2 2024-03-30T12:30:28.583 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 0 (ObjNum 97 snap 0 seq_num 1429278688) dirty dne 2024-03-30T12:30:28.583 INFO:tasks.rados.rados.0.smithi084.stdout:2243: finishing write tid 1 to smithi08477944-37 2024-03-30T12:30:28.583 INFO:tasks.rados.rados.0.smithi084.stdout:2243: finishing write tid 2 to smithi08477944-37 2024-03-30T12:30:28.583 INFO:tasks.rados.rados.0.smithi084.stdout:2243: finishing write tid 3 to smithi08477944-37 2024-03-30T12:30:28.583 INFO:tasks.rados.rados.0.smithi084.stdout:2243: finishing write tid 4 to smithi08477944-37 2024-03-30T12:30:28.583 INFO:tasks.rados.rados.0.smithi084.stdout:2243: finishing write tid 5 to smithi08477944-37 2024-03-30T12:30:28.583 INFO:tasks.rados.rados.0.smithi084.stdout:2243: oid 37 updating version 0 to 23377 2024-03-30T12:30:28.584 INFO:tasks.rados.rados.0.smithi084.stdout:2243: oid 37 version 23377 is already newer than 23375 2024-03-30T12:30:28.584 INFO:tasks.rados.rados.0.smithi084.stdout:2243: oid 37 version 23377 is already newer than 23374 2024-03-30T12:30:28.584 INFO:tasks.rados.rados.0.smithi084.stdout:2243: oid 37 version 23377 is already newer than 23376 2024-03-30T12:30:28.584 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 23377 (ObjNum 689 snap 242 seq_num 689) dirty exists 2024-03-30T12:30:28.584 INFO:tasks.rados.rados.0.smithi084.stdout:2243: left oid 37 (ObjNum 689 snap 242 seq_num 689) 2024-03-30T12:30:28.584 INFO:tasks.rados.rados.0.smithi084.stdout:2247: finishing write tid 1 to smithi08477944-40 2024-03-30T12:30:28.584 INFO:tasks.rados.rados.0.smithi084.stdout:2243: done (2 left) 2024-03-30T12:30:28.584 INFO:tasks.rados.rados.0.smithi084.stdout:2244: done (1 left) 2024-03-30T12:30:28.584 INFO:tasks.rados.rados.0.smithi084.stdout:2248: rollback oid 20 current snap is 242 2024-03-30T12:30:28.584 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 20 to 227 2024-03-30T12:30:28.584 INFO:tasks.rados.rados.0.smithi084.stdout:2249: snap_remove snap 200 2024-03-30T12:30:28.730 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:28.583+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:28.730 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:28.584+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:28.730 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:28.573+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:28.731 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:28.573+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:28.731 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:28.574+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:28.731 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:28.574+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:28.731 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:28.574+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:28.809 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:28.576+0000 7f9dc765a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 10b after trimming was started 2024-03-30T12:30:28.809 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:28.576+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:28.810 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:28.604+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.810 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:28.644+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.810 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:28.686+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.810 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:28.715+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.810 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:28.759+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.810 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:28.798+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:28.810 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.575+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.810 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.602+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.810 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.624+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.811 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.647+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.811 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.672+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.811 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.698+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.811 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.726+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.811 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.746+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.811 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.773+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.811 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.792+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:28.811 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.817+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:28.837+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:28.882+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:28.925+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:28.963+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.000+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.043+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.062 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.839+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.062 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.861+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.062 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.887+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.062 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.912+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.062 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.935+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.062 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.957+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.062 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:28.978+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.062 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.002+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.062 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.026+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.062 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.045+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.062 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.069+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:29.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-mon[83709]: osdmap e544: 8 total, 8 up, 8 in 2024-03-30T12:30:29.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:29.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:29.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:29.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:29.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:29.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:29.328 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-mon[83709]: pgmap v501: 121 pgs: 6 active+clean+snaptrim, 108 active+clean, 7 active+clean+snaptrim_error; 529 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 12 MiB/s rd, 4.4 MiB/s wr, 23 op/s 2024-03-30T12:30:29.329 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.095+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.329 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.118+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.329 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.141+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.329 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.162+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.329 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.186+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.329 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.211+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.329 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.234+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.329 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.262+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.329 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.286+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.329 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.311+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.329 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.334+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.329 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.085+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.330 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.124+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.330 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.162+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.330 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.202+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.330 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.241+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.330 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.280+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.330 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.315+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.465 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:30:29] "GET /metrics HTTP/1.1" 200 36331 "" "Prometheus/2.43.0" 2024-03-30T12:30:29.465 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:29.465 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-mon[91810]: osdmap e544: 8 total, 8 up, 8 in 2024-03-30T12:30:29.465 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:29.465 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:29.465 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:29.465 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:29.465 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:29.465 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:29.465 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-mon[91810]: pgmap v501: 121 pgs: 6 active+clean+snaptrim, 108 active+clean, 7 active+clean+snaptrim_error; 529 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 12 MiB/s rd, 4.4 MiB/s wr, 23 op/s 2024-03-30T12:30:29.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:29.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-mon[89279]: osdmap e544: 8 total, 8 up, 8 in 2024-03-30T12:30:29.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:29.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:29.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:29.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:29.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:29.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:29.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-mon[89279]: pgmap v501: 121 pgs: 6 active+clean+snaptrim, 108 active+clean, 7 active+clean+snaptrim_error; 529 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 12 MiB/s rd, 4.4 MiB/s wr, 23 op/s 2024-03-30T12:30:29.578 INFO:tasks.rados.rados.0.smithi084.stdout:2247: finishing write tid 2 to smithi08477944-40 2024-03-30T12:30:29.578 INFO:tasks.rados.rados.0.smithi084.stdout:2247: finishing write tid 3 to smithi08477944-40 2024-03-30T12:30:29.578 INFO:tasks.rados.rados.0.smithi084.stdout:2247: finishing write tid 4 to smithi08477944-40 2024-03-30T12:30:29.578 INFO:tasks.rados.rados.0.smithi084.stdout:2247: finishing write tid 5 to smithi08477944-40 2024-03-30T12:30:29.578 INFO:tasks.rados.rados.0.smithi084.stdout:2247: finishing write tid 6 to smithi08477944-40 2024-03-30T12:30:29.578 INFO:tasks.rados.rados.0.smithi084.stdout:2247: oid 40 updating version 0 to 17503 2024-03-30T12:30:29.578 INFO:tasks.rados.rados.0.smithi084.stdout:2247: oid 40 updating version 17503 to 17506 2024-03-30T12:30:29.578 INFO:tasks.rados.rados.0.smithi084.stdout:2247: oid 40 version 17506 is already newer than 17504 2024-03-30T12:30:29.579 INFO:tasks.rados.rados.0.smithi084.stdout:2247: oid 40 updating version 17506 to 17507 2024-03-30T12:30:29.579 INFO:tasks.rados.rados.0.smithi084.stdout:2247: oid 40 version 17507 is already newer than 17505 2024-03-30T12:30:29.579 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 17507 (ObjNum 691 snap 242 seq_num 691) dirty exists 2024-03-30T12:30:29.579 INFO:tasks.rados.rados.0.smithi084.stdout:2247: left oid 40 (ObjNum 691 snap 242 seq_num 691) 2024-03-30T12:30:29.579 INFO:tasks.rados.rados.0.smithi084.stdout:2248: finishing rollback tid 1 to smithi08477944-20 2024-03-30T12:30:29.579 INFO:tasks.rados.rados.0.smithi084.stdout:2248: finishing rollback tid 2 to smithi08477944-20 2024-03-30T12:30:29.579 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 17509 (ObjNum 565 snap 194 seq_num 565) dirty exists 2024-03-30T12:30:29.579 INFO:tasks.rados.rados.0.smithi084.stdout:2247: done (2 left) 2024-03-30T12:30:29.579 INFO:tasks.rados.rados.0.smithi084.stdout:2248: done (1 left) 2024-03-30T12:30:29.579 INFO:tasks.rados.rados.0.smithi084.stdout:2249: done (0 left) 2024-03-30T12:30:29.579 INFO:tasks.rados.rados.0.smithi084.stdout:2250: delete oid 8 current snap is 242 2024-03-30T12:30:29.587 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.355+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.587 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.390+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.587 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.432+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.587 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.480+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.587 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.516+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.588 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.546+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.588 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.593+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.588 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.356+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.588 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.386+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.588 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.406+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.588 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.428+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.588 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.451+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.588 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.474+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.588 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.496+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.588 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.520+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.588 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.545+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.588 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.568+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.599 INFO:tasks.rados.rados.0.smithi084.stdout:2250: done (0 left) 2024-03-30T12:30:29.599 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 242 2024-03-30T12:30:29.599 INFO:tasks.rados.rados.0.smithi084.stdout:2251: seq_num 693 ranges {0=409600,409600=770048,1179648=581632,1761280=253952} 2024-03-30T12:30:29.602 INFO:tasks.rados.rados.0.smithi084.stdout:2251: writing smithi08477944-10 from 0 to 409600 tid 1 2024-03-30T12:30:29.606 INFO:tasks.rados.rados.0.smithi084.stdout:2251: writing smithi08477944-10 from 409600 to 1179648 tid 2 2024-03-30T12:30:29.610 INFO:tasks.rados.rados.0.smithi084.stdout:2251: writing smithi08477944-10 from 1179648 to 1761280 tid 3 2024-03-30T12:30:29.612 INFO:tasks.rados.rados.0.smithi084.stdout:2251: writing smithi08477944-10 from 1761280 to 2015232 tid 4 2024-03-30T12:30:29.612 INFO:tasks.rados.rados.0.smithi084.stdout:2252: read oid 6 snap -1 2024-03-30T12:30:29.612 INFO:tasks.rados.rados.0.smithi084.stdout:2252: expect (ObjNum 589 snap 203 seq_num 589) 2024-03-30T12:30:29.612 INFO:tasks.rados.rados.0.smithi084.stdout:2253: rollback oid 37 current snap is 242 2024-03-30T12:30:29.612 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 37 to 227 2024-03-30T12:30:29.613 INFO:tasks.rados.rados.0.smithi084.stdout:2254: read oid 17 snap -1 2024-03-30T12:30:29.613 INFO:tasks.rados.rados.0.smithi084.stdout:2254: expect (ObjNum 682 snap 239 seq_num 682) 2024-03-30T12:30:29.613 INFO:tasks.rados.rados.0.smithi084.stdout:2255: snap_remove snap 241 2024-03-30T12:30:29.747 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:29.588+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:29.747 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:29.590+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:29.747 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:29.582+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:29.747 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:29.582+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:29.748 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:29.583+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:29.748 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:29.583+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:29.748 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:29.583+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:29.748 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:29.585+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:29.855 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:29.600+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:29.855 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:29.610+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:29.855 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.626+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.856 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.659+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.856 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.694+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.856 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.732+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.856 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.771+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.856 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.807+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.856 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.829+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:29.856 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.608+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.856 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.636+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.856 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.657+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.856 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.680+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.856 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.699+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.856 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.723+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.857 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.740+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.857 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.758+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.857 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.778+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.857 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.795+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.857 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.822+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.857 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.842+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:29.857 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.863+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.003 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:30:29 smithi084 systemd[1]: Stopping Ceph mds.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:30:30.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:30.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:30.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-mon[83709]: osdmap e545: 8 total, 8 up, 8 in 2024-03-30T12:30:30.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:30.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:30.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:30.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:30.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:30.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:30.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:30:30.114 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.871+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.114 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.910+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.114 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.932+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.115 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:29.971+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.115 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.001+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.115 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.021+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.115 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.055+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.115 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.080+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.115 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.884+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.115 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.904+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.115 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.931+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.115 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.950+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.115 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.968+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.115 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:29.988+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.116 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.012+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.116 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.036+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.116 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.059+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.116 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.081+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.116 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.103+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.369 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.120+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.151+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.189+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.208+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.241+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.271+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.304+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.340+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.121+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.145+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.165+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.187+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.210+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.231+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.259+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.280+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.302+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.320+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.344+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.370+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:30.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:30.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:30 smithi084 ceph-mon[91810]: osdmap e545: 8 total, 8 up, 8 in 2024-03-30T12:30:30.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:30.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:30.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:30.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:30.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:30.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:30 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:30.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:30 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:30:30.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:30.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:30.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:30 smithi084 ceph-mon[89279]: osdmap e545: 8 total, 8 up, 8 in 2024-03-30T12:30:30.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:30.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:30.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:30.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:30.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:30.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:30 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:30.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:30 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:30:30.505 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:30:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-a[64811]: 2024-03-30T12:30:30.303+0000 7fb68f670700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:30:30.505 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:30:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-a[64811]: 2024-03-30T12:30:30.303+0000 7fb68f670700 -1 mds.a *** got signal Terminated *** 2024-03-30T12:30:30.639 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.382+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.640 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.419+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.640 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.453+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.640 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.493+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.640 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.525+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.640 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.562+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.640 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.590+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.640 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.616+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.640 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.388+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.640 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.406+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.640 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.426+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.640 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.445+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.468+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.488+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.508+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.528+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.548+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.567+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.583+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.605+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.627+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.641 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.646+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.891 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.655+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.891 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.688+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.892 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.726+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.892 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.759+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.892 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.788+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.892 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.822+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.892 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.857+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.892 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.899+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:30.892 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.664+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.892 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.686+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.892 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.705+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.892 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.726+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.892 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.746+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.893 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.767+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.893 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.793+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.893 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.812+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.893 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.831+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.893 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.852+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.893 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.874+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:30.893 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.893+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.001 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-03-30T12:30:31.102 INFO:tasks.rados.rados.0.smithi084.stdout:2255: done (4 left) 2024-03-30T12:30:31.103 INFO:tasks.rados.rados.0.smithi084.stdout:2256: read oid 7 snap -1 2024-03-30T12:30:31.103 INFO:tasks.rados.rados.0.smithi084.stdout:2256: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:30:31.103 INFO:tasks.rados.rados.0.smithi084.stdout:2257: delete oid 50 current snap is 242 2024-03-30T12:30:31.103 INFO:tasks.rados.rados.0.smithi084.stdout:2251: finishing write tid 1 to smithi08477944-10 2024-03-30T12:30:31.103 INFO:tasks.rados.rados.0.smithi084.stdout:2254: expect (ObjNum 682 snap 239 seq_num 682) 2024-03-30T12:30:31.147 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:31.147 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:31.147 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-mon[83709]: pgmap v503: 121 pgs: 6 active+clean+snaptrim, 108 active+clean, 7 active+clean+snaptrim_error; 535 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 14 op/s 2024-03-30T12:30:31.148 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:31.111+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:31.148 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:31.113+0000 7f9dc765a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 10b after trimming was started 2024-03-30T12:30:31.148 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:31.113+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:31.148 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.926+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.148 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.955+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.148 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:30.996+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.148 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.030+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.148 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.067+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.148 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.116+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.149 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.155+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.149 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.913+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.149 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.935+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.149 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.956+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.149 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:30.979+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.149 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.000+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.149 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.023+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.149 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.043+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.149 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.065+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.149 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.085+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.149 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.104+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.149 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.133+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.186 INFO:tasks.rados.rados.0.smithi084.stdout:2251: finishing write tid 2 to smithi08477944-10 2024-03-30T12:30:31.186 INFO:tasks.rados.rados.0.smithi084.stdout:2251: finishing write tid 3 to smithi08477944-10 2024-03-30T12:30:31.187 INFO:tasks.rados.rados.0.smithi084.stdout:2251: finishing write tid 4 to smithi08477944-10 2024-03-30T12:30:31.187 INFO:tasks.rados.rados.0.smithi084.stdout:2251: finishing write tid 5 to smithi08477944-10 2024-03-30T12:30:31.187 INFO:tasks.rados.rados.0.smithi084.stdout:2254: done (5 left) 2024-03-30T12:30:31.187 INFO:tasks.rados.rados.0.smithi084.stdout:2257: done (4 left) 2024-03-30T12:30:31.187 INFO:tasks.rados.rados.0.smithi084.stdout:2258: copy_from oid 21 from oid 27 current snap is 242 2024-03-30T12:30:31.187 INFO:tasks.rados.rados.0.smithi084.stdout:2252: expect (ObjNum 589 snap 203 seq_num 589) 2024-03-30T12:30:31.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:31.107+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:31.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:31.107+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:31.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:31.108+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:31.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:31.108+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:31.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:31.108+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:31.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:31.118+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:31.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:31.118+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:31.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:31.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:31.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:31 smithi084 ceph-mon[91810]: pgmap v503: 121 pgs: 6 active+clean+snaptrim, 108 active+clean, 7 active+clean+snaptrim_error; 535 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 14 op/s 2024-03-30T12:30:31.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:31.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:31.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:31 smithi084 ceph-mon[89279]: pgmap v503: 121 pgs: 6 active+clean+snaptrim, 108 active+clean, 7 active+clean+snaptrim_error; 535 MiB data, 5.6 GiB used, 710 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 14 op/s 2024-03-30T12:30:31.404 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.156+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.404 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.174+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.404 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.193+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.404 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.218+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.404 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.237+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.404 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.259+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.404 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.281+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.404 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.300+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.404 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.320+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.404 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.340+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.404 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.363+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.404 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.384+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.405 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.196+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.405 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.232+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.405 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.268+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.405 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.302+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.405 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.341+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.405 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.379+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.432 INFO:tasks.rados.rados.0.smithi084.stdout:2251: finishing write tid 6 to smithi08477944-10 2024-03-30T12:30:31.432 INFO:tasks.rados.rados.0.smithi084.stdout:2251: oid 10 updating version 0 to 23381 2024-03-30T12:30:31.432 INFO:tasks.rados.rados.0.smithi084.stdout:2251: oid 10 version 23381 is already newer than 23378 2024-03-30T12:30:31.432 INFO:tasks.rados.rados.0.smithi084.stdout:2251: oid 10 version 23381 is already newer than 23380 2024-03-30T12:30:31.432 INFO:tasks.rados.rados.0.smithi084.stdout:2251: oid 10 updating version 23381 to 23382 2024-03-30T12:30:31.432 INFO:tasks.rados.rados.0.smithi084.stdout:2251: oid 10 version 23382 is already newer than 23379 2024-03-30T12:30:31.432 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 23382 (ObjNum 693 snap 242 seq_num 693) dirty exists 2024-03-30T12:30:31.432 INFO:tasks.rados.rados.0.smithi084.stdout:2251: left oid 10 (ObjNum 693 snap 242 seq_num 693) 2024-03-30T12:30:31.432 INFO:tasks.rados.rados.0.smithi084.stdout:2253: finishing rollback tid 0 to smithi08477944-37 2024-03-30T12:30:31.432 INFO:tasks.rados.rados.0.smithi084.stdout:2251: done (4 left) 2024-03-30T12:30:31.433 INFO:tasks.rados.rados.0.smithi084.stdout:2252: done (3 left) 2024-03-30T12:30:31.433 INFO:tasks.rados.rados.0.smithi084.stdout:2259: rollback oid 17 current snap is 242 2024-03-30T12:30:31.433 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 17 to 238 2024-03-30T12:30:31.433 INFO:tasks.rados.rados.0.smithi084.stdout:2253: finishing rollback tid 1 to smithi08477944-37 2024-03-30T12:30:31.433 INFO:tasks.rados.rados.0.smithi084.stdout:2253: finishing rollback tid 2 to smithi08477944-37 2024-03-30T12:30:31.433 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 23385 (ObjNum 603 snap 215 seq_num 603) dirty exists 2024-03-30T12:30:31.433 INFO:tasks.rados.rados.0.smithi084.stdout:2256: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:30:31.435 INFO:tasks.rados.rados.0.smithi084.stdout:2258: finishing copy_from to smithi08477944-21 2024-03-30T12:30:31.435 INFO:tasks.rados.rados.0.smithi084.stdout:2258: got expected ENOENT (src dne) 2024-03-30T12:30:31.435 INFO:tasks.rados.rados.0.smithi084.stdout:2258: finishing copy_from racing read to smithi08477944-21 2024-03-30T12:30:31.435 INFO:tasks.rados.rados.0.smithi084.stdout:2253: done (3 left) 2024-03-30T12:30:31.435 INFO:tasks.rados.rados.0.smithi084.stdout:2256: done (2 left) 2024-03-30T12:30:31.435 INFO:tasks.rados.rados.0.smithi084.stdout:2258: done (1 left) 2024-03-30T12:30:31.435 INFO:tasks.rados.rados.0.smithi084.stdout:2260: delete oid 2 current snap is 242 2024-03-30T12:30:31.435 INFO:tasks.rados.rados.0.smithi084.stdout:2259: finishing rollback tid 0 to smithi08477944-17 2024-03-30T12:30:31.436 INFO:tasks.rados.rados.0.smithi084.stdout:2259: finishing rollback tid 1 to smithi08477944-17 2024-03-30T12:30:31.436 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 968 (ObjNum 33 snap 0 seq_num 1394497328) dirty dne 2024-03-30T12:30:31.455 INFO:tasks.rados.rados.0.smithi084.stdout:2259: done (1 left) 2024-03-30T12:30:31.455 INFO:tasks.rados.rados.0.smithi084.stdout:2260: done (0 left) 2024-03-30T12:30:31.455 INFO:tasks.rados.rados.0.smithi084.stdout:2261: read oid 30 snap -1 2024-03-30T12:30:31.455 INFO:tasks.rados.rados.0.smithi084.stdout:2261: expect (ObjNum 502 snap 157 seq_num 502) 2024-03-30T12:30:31.456 INFO:tasks.rados.rados.0.smithi084.stdout:2262: snap_remove snap 238 2024-03-30T12:30:31.525 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T12:30:31.525 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (9m) 2m ago 10m 25.3M - 0.25.0 c8568f914cd2 6765ce007f39 2024-03-30T12:30:31.525 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi162 *:3000 running (10m) 14s ago 10m 93.5M - 9.4.7 954c08fa6188 ff2ec7518619 2024-03-30T12:30:31.525 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (11m) 2m ago 11m 15.1M - 18.2.2-1051-gf14b5682 c8fb09e16a7d a9c2e74ca2a3 2024-03-30T12:30:31.525 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi162 running (11m) 14s ago 11m 22.1M - 18.2.2-1051-gf14b5682 c8fb09e16a7d ee1770ef5edd 2024-03-30T12:30:31.525 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi162 *:8443,9283,8765 running (6m) 14s ago 15m 452M - 19.0.0-1864-g5dc2ea30 548196a1a838 eec968f3fcc6 2024-03-30T12:30:31.525 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (6m) 2m ago 16m 512M - 19.0.0-1864-g5dc2ea30 548196a1a838 9a2aba19dffc 2024-03-30T12:30:31.526 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (5m) 2m ago 16m 55.0M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 a0811f2ae47d 2024-03-30T12:30:31.526 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi162 running (5m) 14s ago 15m 52.8M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 149ae6649e0c 2024-03-30T12:30:31.526 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (5m) 2m ago 15m 47.4M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 f79eca93cddd 2024-03-30T12:30:31.526 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (10m) 2m ago 10m 16.9M - 1.5.0 0da6a335fe13 66844bed39e8 2024-03-30T12:30:31.526 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi162 *:9100 running (10m) 14s ago 10m 15.5M - 1.5.0 0da6a335fe13 3d6e28b2348d 2024-03-30T12:30:31.526 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (4m) 2m ago 14m 182M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 c91eea4f8484 2024-03-30T12:30:31.526 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (3m) 2m ago 14m 109M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 7518832f6b4a 2024-03-30T12:30:31.526 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (3m) 2m ago 13m 123M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 647dd862762d 2024-03-30T12:30:31.526 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (2m) 2m ago 13m 15.1M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 c088a701b71b 2024-03-30T12:30:31.526 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi162 running (2m) 14s ago 13m 389M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 4197b37d2bb8 2024-03-30T12:30:31.526 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi162 running (98s) 14s ago 12m 408M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 cd8795ac188a 2024-03-30T12:30:31.526 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi162 running (57s) 14s ago 12m 178M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 40ed6df81194 2024-03-30T12:30:31.526 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi162 running (21s) 14s ago 11m 15.2M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 b83812c70d9a 2024-03-30T12:30:31.526 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi162 *:9095 running (6m) 14s ago 11m 55.9M - 2.43.0 a07b618ecd1d bd7d323e4b47 2024-03-30T12:30:31.657 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.411+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.657 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.431+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.658 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.452+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.658 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.471+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.658 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.496+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.658 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.517+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.658 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.543+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.658 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.564+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.658 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.588+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.658 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.610+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.658 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.631+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.658 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.651+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.659 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.414+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.659 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.449+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.660 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.485+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.660 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.520+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.660 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.554+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.660 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.589+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.660 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.626+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.660 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.665+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.913 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.704+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.913 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.738+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.913 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.768+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.913 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.801+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.914 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.834+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.914 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.865+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.914 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.899+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:31.914 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.671+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.914 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.691+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.914 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.712+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.914 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.736+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.914 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.757+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.914 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.778+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.914 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.798+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.914 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.820+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.914 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.840+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.915 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.860+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.915 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.880+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.915 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.900+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:31.915 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.918+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.039 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-30T12:30:32.039 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-03-30T12:30:32.039 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 3 2024-03-30T12:30:32.039 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:30:32.039 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-03-30T12:30:32.039 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 2 2024-03-30T12:30:32.039 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:30:32.039 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-03-30T12:30:32.039 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 8 2024-03-30T12:30:32.040 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:30:32.040 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-03-30T12:30:32.040 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 1 2024-03-30T12:30:32.040 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:30:32.040 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-03-30T12:30:32.040 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 18.2.2-1051-gf14b5682 (f14b5682ac4f2d91bddebd76ffe4e49b8122e149) reef (stable)": 1, 2024-03-30T12:30:32.040 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 13 2024-03-30T12:30:32.040 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-30T12:30:32.040 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-30T12:30:32.125 INFO:tasks.rados.rados.0.smithi084.stdout:2262: done (1 left) 2024-03-30T12:30:32.125 INFO:tasks.rados.rados.0.smithi084.stdout:2263: rmattr oid 33 current snap is 242 2024-03-30T12:30:32.125 INFO:tasks.rados.rados.0.smithi084.stdout:2263: done (1 left) 2024-03-30T12:30:32.126 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 242 2024-03-30T12:30:32.126 INFO:tasks.rados.rados.0.smithi084.stdout:2264: seq_num 696 ranges {0=458752,458752=417792,876544=753664,1630208=434176} 2024-03-30T12:30:32.127 INFO:tasks.rados.rados.0.smithi084.stdout:2264: writing smithi08477944-47 from 0 to 458752 tid 1 2024-03-30T12:30:32.129 INFO:tasks.rados.rados.0.smithi084.stdout:2264: writing smithi08477944-47 from 458752 to 876544 tid 2 2024-03-30T12:30:32.134 INFO:tasks.rados.rados.0.smithi084.stdout:2264: writing smithi08477944-47 from 876544 to 1630208 tid 3 2024-03-30T12:30:32.138 INFO:tasks.rados.rados.0.smithi084.stdout:2264: writing smithi08477944-47 from 1630208 to 2064384 tid 4 2024-03-30T12:30:32.138 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 242 2024-03-30T12:30:32.138 INFO:tasks.rados.rados.0.smithi084.stdout:2265: seq_num 697 ranges {2015232=475136,2490368=704512,3194880=557056,3751936=344064} 2024-03-30T12:30:32.152 INFO:tasks.rados.rados.0.smithi084.stdout:2265: writing smithi08477944-10 from 2015232 to 2490368 tid 1 2024-03-30T12:30:32.157 INFO:tasks.rados.rados.0.smithi084.stdout:2265: writing smithi08477944-10 from 2490368 to 3194880 tid 2 2024-03-30T12:30:32.161 INFO:tasks.rados.rados.0.smithi084.stdout:2265: writing smithi08477944-10 from 3194880 to 3751936 tid 3 2024-03-30T12:30:32.163 INFO:tasks.rados.rados.0.smithi084.stdout:2265: writing smithi08477944-10 from 3751936 to 4096000 tid 4 2024-03-30T12:30:32.163 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 242 2024-03-30T12:30:32.163 INFO:tasks.rados.rados.0.smithi084.stdout:2266: seq_num 698 ranges {11436032=499712,11935744=589824,12525568=770048,13295616=245760} 2024-03-30T12:30:32.165 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:32.134+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:32.165 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:32.136+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:32.166 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.934+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.166 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:31.967+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.166 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.007+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.166 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.043+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.166 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.079+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.166 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.113+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.166 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.149+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.167 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-mon[83709]: from='client.44327 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:30:32.167 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:32.167 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:32.167 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:32.167 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:32.167 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-mon[83709]: osdmap e546: 8 total, 8 up, 8 in 2024-03-30T12:30:32.167 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:32.167 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:32.167 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-mon[83709]: fsmap cephfs:1 {0=b=up:active} 2024-03-30T12:30:32.167 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:32.167 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:32.168 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-mon[83709]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:30:32.168 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/2373062109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:32.168 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.940+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.168 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.963+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.168 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:31.986+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.168 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.004+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.168 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.026+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.168 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.050+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.168 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.071+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.168 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.091+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.168 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.109+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.168 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.130+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.169 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.158+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.229 INFO:tasks.rados.rados.0.smithi084.stdout:2266: writing smithi08477944-38 from 11436032 to 11935744 tid 1 2024-03-30T12:30:32.232 INFO:tasks.rados.rados.0.smithi084.stdout:2266: writing smithi08477944-38 from 11935744 to 12525568 tid 2 2024-03-30T12:30:32.237 INFO:tasks.rados.rados.0.smithi084.stdout:2266: writing smithi08477944-38 from 12525568 to 13295616 tid 3 2024-03-30T12:30:32.238 INFO:tasks.rados.rados.0.smithi084.stdout:2266: writing smithi08477944-38 from 13295616 to 13541376 tid 4 2024-03-30T12:30:32.238 INFO:tasks.rados.rados.0.smithi084.stdout:2267: copy_from oid 14 from oid 44 current snap is 242 2024-03-30T12:30:32.239 INFO:tasks.rados.rados.0.smithi084.stdout:2261: expect (ObjNum 502 snap 157 seq_num 502) 2024-03-30T12:30:32.433 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.174+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.433 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.207+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.433 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.240+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.433 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.277+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.433 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.319+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.433 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.351+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.434 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.385+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.434 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.421+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.434 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.182+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.434 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.201+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.434 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.222+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.434 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.243+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.434 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.266+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.434 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.290+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.434 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.310+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.434 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.332+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.434 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.356+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.435 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.376+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.435 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.395+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.435 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.416+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.435 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.441+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:32.139+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:32.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:32.140+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:32.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:32.130+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:32.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:32.130+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:32.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:32.130+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:32.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:32.131+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:32.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:32.131+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:32.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:32.131+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:32.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[89279]: from='client.44327 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:30:32.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:32.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:32.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:32.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:32.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[89279]: osdmap e546: 8 total, 8 up, 8 in 2024-03-30T12:30:32.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:32.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:32.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[89279]: fsmap cephfs:1 {0=b=up:active} 2024-03-30T12:30:32.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:32.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:32.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[89279]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:30:32.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/2373062109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:32.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[91810]: from='client.44327 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:30:32.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:32.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:32.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:32.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:32.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[91810]: osdmap e546: 8 total, 8 up, 8 in 2024-03-30T12:30:32.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:32.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:32.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[91810]: fsmap cephfs:1 {0=b=up:active} 2024-03-30T12:30:32.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:32.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:32.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[91810]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:30:32.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:32 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/2373062109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:32.695 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.459+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.696 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.499+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.696 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.535+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.696 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.569+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.696 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.603+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.696 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.639+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.696 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.672+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.696 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.462+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.696 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.480+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.696 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.497+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.696 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.517+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.696 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.535+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.697 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.560+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.697 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.585+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.697 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.606+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.697 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.624+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.697 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.642+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.697 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.659+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.697 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.681+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.697 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.703+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.879 INFO:tasks.rados.rados.0.smithi084.stdout:2264: finishing write tid 1 to smithi08477944-47 2024-03-30T12:30:32.879 INFO:tasks.rados.rados.0.smithi084.stdout:2264: finishing write tid 2 to smithi08477944-47 2024-03-30T12:30:32.879 INFO:tasks.rados.rados.0.smithi084.stdout:2264: finishing write tid 3 to smithi08477944-47 2024-03-30T12:30:32.879 INFO:tasks.rados.rados.0.smithi084.stdout:2264: finishing write tid 4 to smithi08477944-47 2024-03-30T12:30:32.879 INFO:tasks.rados.rados.0.smithi084.stdout:2264: finishing write tid 5 to smithi08477944-47 2024-03-30T12:30:32.879 INFO:tasks.rados.rados.0.smithi084.stdout:2264: finishing write tid 6 to smithi08477944-47 2024-03-30T12:30:32.879 INFO:tasks.rados.rados.0.smithi084.stdout:2264: oid 47 updating version 0 to 17510 2024-03-30T12:30:32.879 INFO:tasks.rados.rados.0.smithi084.stdout:2264: oid 47 updating version 17510 to 17511 2024-03-30T12:30:32.879 INFO:tasks.rados.rados.0.smithi084.stdout:2264: oid 47 updating version 17511 to 17512 2024-03-30T12:30:32.880 INFO:tasks.rados.rados.0.smithi084.stdout:2264: oid 47 updating version 17512 to 17513 2024-03-30T12:30:32.880 INFO:tasks.rados.rados.0.smithi084.stdout:2264: oid 47 updating version 17513 to 17514 2024-03-30T12:30:32.880 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 17514 (ObjNum 696 snap 242 seq_num 696) dirty exists 2024-03-30T12:30:32.880 INFO:tasks.rados.rados.0.smithi084.stdout:2264: left oid 47 (ObjNum 696 snap 242 seq_num 696) 2024-03-30T12:30:32.880 INFO:tasks.rados.rados.0.smithi084.stdout:2265: finishing write tid 1 to smithi08477944-10 2024-03-30T12:30:32.880 INFO:tasks.rados.rados.0.smithi084.stdout:2265: finishing write tid 2 to smithi08477944-10 2024-03-30T12:30:32.880 INFO:tasks.rados.rados.0.smithi084.stdout:2265: finishing write tid 3 to smithi08477944-10 2024-03-30T12:30:32.880 INFO:tasks.rados.rados.0.smithi084.stdout:2265: finishing write tid 4 to smithi08477944-10 2024-03-30T12:30:32.880 INFO:tasks.rados.rados.0.smithi084.stdout:2265: finishing write tid 5 to smithi08477944-10 2024-03-30T12:30:32.880 INFO:tasks.rados.rados.0.smithi084.stdout:2265: finishing write tid 6 to smithi08477944-10 2024-03-30T12:30:32.880 INFO:tasks.rados.rados.0.smithi084.stdout:2265: oid 10 updating version 0 to 23386 2024-03-30T12:30:32.880 INFO:tasks.rados.rados.0.smithi084.stdout:2265: oid 10 updating version 23386 to 23390 2024-03-30T12:30:32.880 INFO:tasks.rados.rados.0.smithi084.stdout:2265: oid 10 version 23390 is already newer than 23389 2024-03-30T12:30:32.880 INFO:tasks.rados.rados.0.smithi084.stdout:2265: oid 10 version 23390 is already newer than 23388 2024-03-30T12:30:32.880 INFO:tasks.rados.rados.0.smithi084.stdout:2265: oid 10 version 23390 is already newer than 23387 2024-03-30T12:30:32.881 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 23390 (ObjNum 697 snap 242 seq_num 697) dirty exists 2024-03-30T12:30:32.881 INFO:tasks.rados.rados.0.smithi084.stdout:2265: left oid 10 (ObjNum 697 snap 242 seq_num 697) 2024-03-30T12:30:32.882 INFO:tasks.rados.rados.0.smithi084.stdout:2266: finishing write tid 1 to smithi08477944-38 2024-03-30T12:30:32.882 INFO:tasks.rados.rados.0.smithi084.stdout:2266: finishing write tid 2 to smithi08477944-38 2024-03-30T12:30:32.882 INFO:tasks.rados.rados.0.smithi084.stdout:2266: finishing write tid 3 to smithi08477944-38 2024-03-30T12:30:32.882 INFO:tasks.rados.rados.0.smithi084.stdout:2266: finishing write tid 4 to smithi08477944-38 2024-03-30T12:30:32.883 INFO:tasks.rados.rados.0.smithi084.stdout:2266: finishing write tid 5 to smithi08477944-38 2024-03-30T12:30:32.883 INFO:tasks.rados.rados.0.smithi084.stdout:2266: finishing write tid 6 to smithi08477944-38 2024-03-30T12:30:32.883 INFO:tasks.rados.rados.0.smithi084.stdout:2266: oid 38 updating version 0 to 1025 2024-03-30T12:30:32.883 INFO:tasks.rados.rados.0.smithi084.stdout:2266: oid 38 updating version 1025 to 1026 2024-03-30T12:30:32.883 INFO:tasks.rados.rados.0.smithi084.stdout:2266: oid 38 version 1026 is already newer than 1024 2024-03-30T12:30:32.883 INFO:tasks.rados.rados.0.smithi084.stdout:2266: oid 38 version 1026 is already newer than 1022 2024-03-30T12:30:32.883 INFO:tasks.rados.rados.0.smithi084.stdout:2266: oid 38 version 1026 is already newer than 1023 2024-03-30T12:30:32.883 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1026 (ObjNum 698 snap 242 seq_num 698) dirty exists 2024-03-30T12:30:32.883 INFO:tasks.rados.rados.0.smithi084.stdout:2266: left oid 38 (ObjNum 698 snap 242 seq_num 698) 2024-03-30T12:30:32.883 INFO:tasks.rados.rados.0.smithi084.stdout:2267: finishing copy_from to smithi08477944-14 2024-03-30T12:30:32.883 INFO:tasks.rados.rados.0.smithi084.stdout:2267: got expected ENOENT (src dne) 2024-03-30T12:30:32.883 INFO:tasks.rados.rados.0.smithi084.stdout:2267: finishing copy_from racing read to smithi08477944-14 2024-03-30T12:30:32.883 INFO:tasks.rados.rados.0.smithi084.stdout:2261: done (4 left) 2024-03-30T12:30:32.883 INFO:tasks.rados.rados.0.smithi084.stdout:2264: done (3 left) 2024-03-30T12:30:32.883 INFO:tasks.rados.rados.0.smithi084.stdout:2265: done (2 left) 2024-03-30T12:30:32.884 INFO:tasks.rados.rados.0.smithi084.stdout:2266: done (1 left) 2024-03-30T12:30:32.884 INFO:tasks.rados.rados.0.smithi084.stdout:2267: done (0 left) 2024-03-30T12:30:32.884 INFO:tasks.rados.rados.0.smithi084.stdout:2268: setattr oid 4 current snap is 242 2024-03-30T12:30:32.884 INFO:tasks.rados.rados.0.smithi084.stdout:2269: read oid 41 snap -1 2024-03-30T12:30:32.884 INFO:tasks.rados.rados.0.smithi084.stdout:2269: expect (ObjNum 688 snap 241 seq_num 688) 2024-03-30T12:30:32.884 INFO:tasks.rados.rados.0.smithi084.stdout:2270: read oid 39 snap -1 2024-03-30T12:30:32.884 INFO:tasks.rados.rados.0.smithi084.stdout:2270: expect (ObjNum 673 snap 238 seq_num 673) 2024-03-30T12:30:32.884 INFO:tasks.rados.rados.0.smithi084.stdout:2271: delete oid 44 current snap is 242 2024-03-30T12:30:32.886 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 17503 (ObjNum 662 snap 232 seq_num 662) dirty exists 2024-03-30T12:30:32.887 INFO:tasks.rados.rados.0.smithi084.stdout:2270: expect (ObjNum 673 snap 238 seq_num 673) 2024-03-30T12:30:32.945 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.710+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.946 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.741+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.946 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.783+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.946 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.829+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.946 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.872+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.946 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.911+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.946 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.945+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:32.946 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.724+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.946 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.745+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.946 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.767+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.946 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.788+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.947 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.807+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.947 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.828+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.947 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.847+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.947 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.867+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.947 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.885+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.947 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.906+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.947 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.933+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.947 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.954+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:32.988 INFO:tasks.rados.rados.0.smithi084.stdout:2269: expect (ObjNum 688 snap 241 seq_num 688) 2024-03-30T12:30:33.125 INFO:tasks.rados.rados.0.smithi084.stdout:2268: done (3 left) 2024-03-30T12:30:33.125 INFO:tasks.rados.rados.0.smithi084.stdout:2269: done (2 left) 2024-03-30T12:30:33.125 INFO:tasks.rados.rados.0.smithi084.stdout:2270: done (1 left) 2024-03-30T12:30:33.125 INFO:tasks.rados.rados.0.smithi084.stdout:2271: done (0 left) 2024-03-30T12:30:33.125 INFO:tasks.rados.rados.0.smithi084.stdout:2272: copy_from oid 34 from oid 29 current snap is 242 2024-03-30T12:30:33.125 INFO:tasks.rados.rados.0.smithi084.stdout:2273: read oid 37 snap 230 2024-03-30T12:30:33.125 INFO:tasks.rados.rados.0.smithi084.stdout:2273: expect (ObjNum 603 snap 215 seq_num 603) 2024-03-30T12:30:33.126 INFO:tasks.rados.rados.0.smithi084.stdout:2274: read oid 22 snap -1 2024-03-30T12:30:33.126 INFO:tasks.rados.rados.0.smithi084.stdout:2274: expect (ObjNum 577 snap 197 seq_num 577) 2024-03-30T12:30:33.126 INFO:tasks.rados.rados.0.smithi084.stdout:2275: delete oid 24 current snap is 242 2024-03-30T12:30:33.138 INFO:tasks.rados.rados.0.smithi084.stdout:2273: expect (ObjNum 603 snap 215 seq_num 603) 2024-03-30T12:30:33.155 INFO:tasks.rados.rados.0.smithi084.stdout:2272: finishing copy_from racing read to smithi08477944-34 2024-03-30T12:30:33.155 INFO:tasks.rados.rados.0.smithi084.stdout:2272: finishing copy_from to smithi08477944-34 2024-03-30T12:30:33.155 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 17502 (ObjNum 672 snap 236 seq_num 672) dirty exists 2024-03-30T12:30:33.178 INFO:tasks.rados.rados.0.smithi084.stdout:2272: done (3 left) 2024-03-30T12:30:33.178 INFO:tasks.rados.rados.0.smithi084.stdout:2273: done (2 left) 2024-03-30T12:30:33.178 INFO:tasks.rados.rados.0.smithi084.stdout:2275: done (1 left) 2024-03-30T12:30:33.178 INFO:tasks.rados.rados.0.smithi084.stdout:2276: rollback oid 43 current snap is 242 2024-03-30T12:30:33.178 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 43 to 230 2024-03-30T12:30:33.178 INFO:tasks.rados.rados.0.smithi084.stdout:2277: copy_from oid 1 from oid 6 current snap is 242 2024-03-30T12:30:33.178 INFO:tasks.rados.rados.0.smithi084.stdout:2278: read oid 31 snap 168 2024-03-30T12:30:33.178 INFO:tasks.rados.rados.0.smithi084.stdout:2278: expect deleted 2024-03-30T12:30:33.178 INFO:tasks.rados.rados.0.smithi084.stdout:2279: delete oid 34 current snap is 242 2024-03-30T12:30:33.183 INFO:tasks.rados.rados.0.smithi084.stdout:2278: done (4 left) 2024-03-30T12:30:33.183 INFO:tasks.rados.rados.0.smithi084.stdout:2279: done (3 left) 2024-03-30T12:30:33.183 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 242 2024-03-30T12:30:33.183 INFO:tasks.rados.rados.0.smithi084.stdout:2280: seq_num 702 ranges {0=565248,565248=581632,1146880=745472,1892352=278528} 2024-03-30T12:30:33.186 INFO:tasks.rados.rados.0.smithi084.stdout:2280: writing smithi08477944-50 from 0 to 565248 tid 1 2024-03-30T12:30:33.190 INFO:tasks.rados.rados.0.smithi084.stdout:2280: writing smithi08477944-50 from 565248 to 1146880 tid 2 2024-03-30T12:30:33.195 INFO:tasks.rados.rados.0.smithi084.stdout:2280: writing smithi08477944-50 from 1146880 to 1892352 tid 3 2024-03-30T12:30:33.197 INFO:tasks.rados.rados.0.smithi084.stdout:2280: writing smithi08477944-50 from 1892352 to 2170880 tid 4 2024-03-30T12:30:33.197 INFO:tasks.rados.rados.0.smithi084.stdout:2281: delete oid 38 current snap is 242 2024-03-30T12:30:33.197 INFO:tasks.rados.rados.0.smithi084.stdout:2274: expect (ObjNum 577 snap 197 seq_num 577) 2024-03-30T12:30:33.203 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.976+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.204 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:32.996+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.204 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.017+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.204 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.038+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.204 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.059+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.204 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.079+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.204 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.100+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.204 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.121+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.204 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.146+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.204 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.184+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.205 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:32.980+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.205 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.018+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.205 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.050+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.205 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.084+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.205 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.120+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.205 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.195+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.205 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:33.205 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:33.205 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-mon[83709]: osdmap e547: 8 total, 8 up, 8 in 2024-03-30T12:30:33.205 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:33.205 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:33.206 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:33.206 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:33.206 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:33.206 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:33.206 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-mon[83709]: pgmap v506: 121 pgs: 6 active+clean+snaptrim, 108 active+clean, 7 active+clean+snaptrim_error; 535 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.0 MiB/s wr, 6 op/s 2024-03-30T12:30:33.472 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.231+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.473 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.270+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.473 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.305+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.473 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.344+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.473 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.382+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.473 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.422+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.473 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.453+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.473 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.210+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.473 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.231+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.473 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.250+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.474 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.271+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.474 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.290+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.474 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.315+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.474 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.335+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.474 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.356+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.474 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.378+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.474 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.397+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.474 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.416+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.474 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.436+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.474 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.459+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.474 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.480+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:33.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:33.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:33 smithi084 ceph-mon[91810]: osdmap e547: 8 total, 8 up, 8 in 2024-03-30T12:30:33.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:33.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:33.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:33.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:33.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:33.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:33.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:33 smithi084 ceph-mon[91810]: pgmap v506: 121 pgs: 6 active+clean+snaptrim, 108 active+clean, 7 active+clean+snaptrim_error; 535 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.0 MiB/s wr, 6 op/s 2024-03-30T12:30:33.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:33.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:33.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:33 smithi084 ceph-mon[89279]: osdmap e547: 8 total, 8 up, 8 in 2024-03-30T12:30:33.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:33.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:33.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:33.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:33.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:33.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:33.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:33 smithi084 ceph-mon[89279]: pgmap v506: 121 pgs: 6 active+clean+snaptrim, 108 active+clean, 7 active+clean+snaptrim_error; 535 MiB data, 5.9 GiB used, 709 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.0 MiB/s wr, 6 op/s 2024-03-30T12:30:33.725 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.489+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.725 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.520+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.725 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.554+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.726 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.591+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.726 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.631+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.726 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.663+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.726 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.698+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.726 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.733+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.726 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.499+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.726 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.520+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.726 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.541+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.726 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.561+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.727 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.580+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.727 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.600+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.727 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.620+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.727 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.641+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.727 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.661+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.727 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.681+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.727 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.700+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.727 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.723+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.971 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:30:33 smithi084 podman[116876]: 2024-03-30 12:30:33.677038186 +0000 UTC m=+3.509525445 container died a9c2e74ca2a3f661bdc4efff076b09b658b3124284317c40769bf98a3fefb221 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-a, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=reef-f14b568, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-03-30T12:30:33.984 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.774+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.984 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.812+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.984 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.845+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.984 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.880+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.984 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.914+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.984 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.948+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.984 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:33.981+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:33.984 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.742+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.984 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.763+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.984 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.783+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.802+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.823+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.846+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.864+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.886+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.906+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.927+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.950+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.972+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:33.985 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:33.992+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.051 INFO:tasks.rados.rados.0.smithi084.stdout:2280: finishing write tid 1 to smithi08477944-50 2024-03-30T12:30:34.052 INFO:tasks.rados.rados.0.smithi084.stdout:2280: finishing write tid 2 to smithi08477944-50 2024-03-30T12:30:34.052 INFO:tasks.rados.rados.0.smithi084.stdout:2276: finishing rollback tid 0 to smithi08477944-43 2024-03-30T12:30:34.052 INFO:tasks.rados.rados.0.smithi084.stdout:2276: finishing rollback tid 1 to smithi08477944-43 2024-03-30T12:30:34.052 INFO:tasks.rados.rados.0.smithi084.stdout:2274: done (4 left) 2024-03-30T12:30:34.052 INFO:tasks.rados.rados.0.smithi084.stdout:2281: done (3 left) 2024-03-30T12:30:34.052 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 242 2024-03-30T12:30:34.052 INFO:tasks.rados.rados.0.smithi084.stdout:2280: finishing write tid 3 to smithi08477944-50 2024-03-30T12:30:34.052 INFO:tasks.rados.rados.0.smithi084.stdout:2280: finishing write tid 4 to smithi08477944-50 2024-03-30T12:30:34.052 INFO:tasks.rados.rados.0.smithi084.stdout:2282: seq_num 704 ranges {0=598016,598016=745472,1343488=712704,2056192=147456} 2024-03-30T12:30:34.054 INFO:tasks.rados.rados.0.smithi084.stdout:2282: writing smithi08477944-13 from 0 to 598016 tid 1 2024-03-30T12:30:34.062 INFO:tasks.rados.rados.0.smithi084.stdout:2282: writing smithi08477944-13 from 598016 to 1343488 tid 2 2024-03-30T12:30:34.064 INFO:tasks.rados.rados.0.smithi084.stdout:2282: writing smithi08477944-13 from 1343488 to 2056192 tid 3 2024-03-30T12:30:34.065 INFO:tasks.rados.rados.0.smithi084.stdout:2282: writing smithi08477944-13 from 2056192 to 2203648 tid 4 2024-03-30T12:30:34.065 INFO:tasks.rados.rados.0.smithi084.stdout:2283: delete oid 38 current snap is 242 2024-03-30T12:30:34.065 INFO:tasks.rados.rados.0.smithi084.stdout:2280: finishing write tid 5 to smithi08477944-50 2024-03-30T12:30:34.065 INFO:tasks.rados.rados.0.smithi084.stdout:2276: finishing rollback tid 2 to smithi08477944-43 2024-03-30T12:30:34.066 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 34789 (ObjNum 603 snap 215 seq_num 603) dirty exists 2024-03-30T12:30:34.066 INFO:tasks.rados.rados.0.smithi084.stdout:2280: finishing write tid 6 to smithi08477944-50 2024-03-30T12:30:34.066 INFO:tasks.rados.rados.0.smithi084.stdout:2280: oid 50 updating version 0 to 990 2024-03-30T12:30:34.066 INFO:tasks.rados.rados.0.smithi084.stdout:2280: oid 50 version 990 is already newer than 989 2024-03-30T12:30:34.066 INFO:tasks.rados.rados.0.smithi084.stdout:2280: oid 50 version 990 is already newer than 988 2024-03-30T12:30:34.066 INFO:tasks.rados.rados.0.smithi084.stdout:2280: oid 50 updating version 990 to 992 2024-03-30T12:30:34.066 INFO:tasks.rados.rados.0.smithi084.stdout:2280: oid 50 version 992 is already newer than 991 2024-03-30T12:30:34.066 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 992 (ObjNum 702 snap 242 seq_num 702) dirty exists 2024-03-30T12:30:34.066 INFO:tasks.rados.rados.0.smithi084.stdout:2280: left oid 50 (ObjNum 702 snap 242 seq_num 702) 2024-03-30T12:30:34.066 INFO:tasks.rados.rados.0.smithi084.stdout:2277: finishing copy_from racing read to smithi08477944-1 2024-03-30T12:30:34.066 INFO:tasks.rados.rados.0.smithi084.stdout:2277: finishing copy_from to smithi08477944-1 2024-03-30T12:30:34.066 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 17482 (ObjNum 589 snap 203 seq_num 589) dirty exists 2024-03-30T12:30:34.067 INFO:tasks.rados.rados.0.smithi084.stdout:2276: done (4 left) 2024-03-30T12:30:34.067 INFO:tasks.rados.rados.0.smithi084.stdout:2277: done (3 left) 2024-03-30T12:30:34.068 INFO:tasks.rados.rados.0.smithi084.stdout:2280: done (2 left) 2024-03-30T12:30:34.068 INFO:tasks.rados.rados.0.smithi084.stdout:2283: done (1 left) 2024-03-30T12:30:34.068 INFO:tasks.rados.rados.0.smithi084.stdout:2284: snap_remove snap 232 2024-03-30T12:30:34.139 INFO:tasks.rados.rados.0.smithi084.stdout:2282: finishing write tid 1 to smithi08477944-13 2024-03-30T12:30:34.139 INFO:tasks.rados.rados.0.smithi084.stdout:2282: finishing write tid 2 to smithi08477944-13 2024-03-30T12:30:34.139 INFO:tasks.rados.rados.0.smithi084.stdout:2282: finishing write tid 3 to smithi08477944-13 2024-03-30T12:30:34.139 INFO:tasks.rados.rados.0.smithi084.stdout:2282: finishing write tid 4 to smithi08477944-13 2024-03-30T12:30:34.139 INFO:tasks.rados.rados.0.smithi084.stdout:2282: finishing write tid 5 to smithi08477944-13 2024-03-30T12:30:34.139 INFO:tasks.rados.rados.0.smithi084.stdout:2282: finishing write tid 6 to smithi08477944-13 2024-03-30T12:30:34.140 INFO:tasks.rados.rados.0.smithi084.stdout:2282: oid 13 updating version 0 to 11367 2024-03-30T12:30:34.140 INFO:tasks.rados.rados.0.smithi084.stdout:2282: oid 13 updating version 11367 to 11368 2024-03-30T12:30:34.140 INFO:tasks.rados.rados.0.smithi084.stdout:2282: oid 13 updating version 11368 to 11369 2024-03-30T12:30:34.140 INFO:tasks.rados.rados.0.smithi084.stdout:2282: oid 13 updating version 11369 to 11370 2024-03-30T12:30:34.140 INFO:tasks.rados.rados.0.smithi084.stdout:2282: oid 13 updating version 11370 to 11371 2024-03-30T12:30:34.140 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 11371 (ObjNum 704 snap 242 seq_num 704) dirty exists 2024-03-30T12:30:34.140 INFO:tasks.rados.rados.0.smithi084.stdout:2282: left oid 13 (ObjNum 704 snap 242 seq_num 704) 2024-03-30T12:30:34.140 INFO:tasks.rados.rados.0.smithi084.stdout:2282: done (1 left) 2024-03-30T12:30:34.140 INFO:tasks.rados.rados.0.smithi084.stdout:2284: done (0 left) 2024-03-30T12:30:34.140 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 242 2024-03-30T12:30:34.140 INFO:tasks.rados.rados.0.smithi084.stdout:2285: seq_num 706 ranges {8667136=630784,9297920=516096,9814016=729088,10543104=360448} 2024-03-30T12:30:34.190 INFO:tasks.rados.rados.0.smithi084.stdout:2285: writing smithi08477944-22 from 8667136 to 9297920 tid 1 2024-03-30T12:30:34.193 INFO:tasks.rados.rados.0.smithi084.stdout:2285: writing smithi08477944-22 from 9297920 to 9814016 tid 2 2024-03-30T12:30:34.198 INFO:tasks.rados.rados.0.smithi084.stdout:2285: writing smithi08477944-22 from 9814016 to 10543104 tid 3 2024-03-30T12:30:34.202 INFO:tasks.rados.rados.0.smithi084.stdout:2285: writing smithi08477944-22 from 10543104 to 10903552 tid 4 2024-03-30T12:30:34.202 INFO:tasks.rados.rados.0.smithi084.stdout:2286: read oid 40 snap -1 2024-03-30T12:30:34.202 INFO:tasks.rados.rados.0.smithi084.stdout:2286: expect (ObjNum 691 snap 242 seq_num 691) 2024-03-30T12:30:34.202 INFO:tasks.rados.rados.0.smithi084.stdout:2287: rollback oid 16 current snap is 242 2024-03-30T12:30:34.202 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 16 to 207 2024-03-30T12:30:34.202 INFO:tasks.rados.rados.0.smithi084.stdout:2288: read oid 15 snap -1 2024-03-30T12:30:34.202 INFO:tasks.rados.rados.0.smithi084.stdout:2288: expect deleted 2024-03-30T12:30:34.202 INFO:tasks.rados.rados.0.smithi084.stdout:2289: rmattr oid 3 current snap is 242 2024-03-30T12:30:34.202 INFO:tasks.rados.rados.0.smithi084.stdout:2289: done (4 left) 2024-03-30T12:30:34.202 INFO:tasks.rados.rados.0.smithi084.stdout:2290: copy_from oid 3 from oid 21 current snap is 242 2024-03-30T12:30:34.202 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 242 2024-03-30T12:30:34.202 INFO:tasks.rados.rados.0.smithi084.stdout:2291: seq_num 707 ranges {0=647168,647168=802816,1449984=532480,1982464=270336} 2024-03-30T12:30:34.205 INFO:tasks.rados.rados.0.smithi084.stdout:2291: writing smithi08477944-11 from 0 to 647168 tid 1 2024-03-30T12:30:34.211 INFO:tasks.rados.rados.0.smithi084.stdout:2291: writing smithi08477944-11 from 647168 to 1449984 tid 2 2024-03-30T12:30:34.215 INFO:tasks.rados.rados.0.smithi084.stdout:2291: writing smithi08477944-11 from 1449984 to 1982464 tid 3 2024-03-30T12:30:34.217 INFO:tasks.rados.rados.0.smithi084.stdout:2291: writing smithi08477944-11 from 1982464 to 2252800 tid 4 2024-03-30T12:30:34.217 INFO:tasks.rados.rados.0.smithi084.stdout:2292: delete oid 23 current snap is 242 2024-03-30T12:30:34.217 INFO:tasks.rados.rados.0.smithi084.stdout:2287: finishing rollback tid 1 to smithi08477944-16 2024-03-30T12:30:34.217 INFO:tasks.rados.rados.0.smithi084.stdout:2287: finishing rollback tid 2 to smithi08477944-16 2024-03-30T12:30:34.217 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 994 (ObjNum 395 snap 125 seq_num 395) dirty exists 2024-03-30T12:30:34.217 INFO:tasks.rados.rados.0.smithi084.stdout:2286: expect (ObjNum 691 snap 242 seq_num 691) 2024-03-30T12:30:34.234 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:34.149+0000 7f9dc765a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 10b after trimming was started 2024-03-30T12:30:34.234 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:34.149+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:34.235 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:34.151+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:34.235 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.021+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:34.235 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.044+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:34.235 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.091+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:34.235 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.114+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:34.235 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.153+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:34.235 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.195+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:34.235 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.013+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.235 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.033+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.235 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.055+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.236 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.077+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.236 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.102+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.236 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.120+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.236 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.140+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.236 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.170+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.236 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.195+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.236 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.219+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.236 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.242+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:34.146+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:34.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:34.147+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:34.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:34.138+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:34.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:34.139+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:34.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:34.139+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:34.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:34.139+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:34.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:34.140+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:34.254 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:30:34 smithi084 podman[116876]: 2024-03-30 12:30:34.179205443 +0000 UTC m=+4.011692695 container cleanup a9c2e74ca2a3f661bdc4efff076b09b658b3124284317c40769bf98a3fefb221 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-a, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=reef-f14b568, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-03-30T12:30:34.254 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:30:34 smithi084 bash[116876]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-a 2024-03-30T12:30:34.300 INFO:tasks.rados.rados.0.smithi084.stdout:2291: finishing write tid 1 to smithi08477944-11 2024-03-30T12:30:34.300 INFO:tasks.rados.rados.0.smithi084.stdout:2291: finishing write tid 2 to smithi08477944-11 2024-03-30T12:30:34.300 INFO:tasks.rados.rados.0.smithi084.stdout:2291: finishing write tid 3 to smithi08477944-11 2024-03-30T12:30:34.300 INFO:tasks.rados.rados.0.smithi084.stdout:2285: finishing write tid 1 to smithi08477944-22 2024-03-30T12:30:34.300 INFO:tasks.rados.rados.0.smithi084.stdout:2285: finishing write tid 2 to smithi08477944-22 2024-03-30T12:30:34.300 INFO:tasks.rados.rados.0.smithi084.stdout:2291: finishing write tid 4 to smithi08477944-11 2024-03-30T12:30:34.300 INFO:tasks.rados.rados.0.smithi084.stdout:2291: finishing write tid 5 to smithi08477944-11 2024-03-30T12:30:34.300 INFO:tasks.rados.rados.0.smithi084.stdout:2291: finishing write tid 6 to smithi08477944-11 2024-03-30T12:30:34.301 INFO:tasks.rados.rados.0.smithi084.stdout:2291: oid 11 updating version 0 to 966 2024-03-30T12:30:34.301 INFO:tasks.rados.rados.0.smithi084.stdout:2291: oid 11 updating version 966 to 967 2024-03-30T12:30:34.301 INFO:tasks.rados.rados.0.smithi084.stdout:2291: oid 11 version 967 is already newer than 964 2024-03-30T12:30:34.301 INFO:tasks.rados.rados.0.smithi084.stdout:2291: oid 11 updating version 967 to 968 2024-03-30T12:30:34.301 INFO:tasks.rados.rados.0.smithi084.stdout:2291: oid 11 version 968 is already newer than 965 2024-03-30T12:30:34.301 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 968 (ObjNum 707 snap 242 seq_num 707) dirty exists 2024-03-30T12:30:34.301 INFO:tasks.rados.rados.0.smithi084.stdout:2291: left oid 11 (ObjNum 707 snap 242 seq_num 707) 2024-03-30T12:30:34.301 INFO:tasks.rados.rados.0.smithi084.stdout:2285: finishing write tid 3 to smithi08477944-22 2024-03-30T12:30:34.301 INFO:tasks.rados.rados.0.smithi084.stdout:2285: finishing write tid 4 to smithi08477944-22 2024-03-30T12:30:34.301 INFO:tasks.rados.rados.0.smithi084.stdout:2286: done (6 left) 2024-03-30T12:30:34.301 INFO:tasks.rados.rados.0.smithi084.stdout:2287: done (5 left) 2024-03-30T12:30:34.302 INFO:tasks.rados.rados.0.smithi084.stdout:2288: done (4 left) 2024-03-30T12:30:34.302 INFO:tasks.rados.rados.0.smithi084.stdout:2291: done (3 left) 2024-03-30T12:30:34.302 INFO:tasks.rados.rados.0.smithi084.stdout:2292: done (2 left) 2024-03-30T12:30:34.302 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 242 2024-03-30T12:30:34.302 INFO:tasks.rados.rados.0.smithi084.stdout:2285: finishing write tid 5 to smithi08477944-22 2024-03-30T12:30:34.302 INFO:tasks.rados.rados.0.smithi084.stdout:2290: finishing copy_from to smithi08477944-3 2024-03-30T12:30:34.302 INFO:tasks.rados.rados.0.smithi084.stdout:2290: got expected ENOENT (src dne) 2024-03-30T12:30:34.302 INFO:tasks.rados.rados.0.smithi084.stdout:2290: finishing copy_from racing read to smithi08477944-3 2024-03-30T12:30:34.302 INFO:tasks.rados.rados.0.smithi084.stdout:2285: finishing write tid 6 to smithi08477944-22 2024-03-30T12:30:34.302 INFO:tasks.rados.rados.0.smithi084.stdout:2285: oid 22 updating version 0 to 26318 2024-03-30T12:30:34.302 INFO:tasks.rados.rados.0.smithi084.stdout:2285: oid 22 version 26318 is already newer than 26315 2024-03-30T12:30:34.302 INFO:tasks.rados.rados.0.smithi084.stdout:2285: oid 22 version 26318 is already newer than 26316 2024-03-30T12:30:34.303 INFO:tasks.rados.rados.0.smithi084.stdout:2285: oid 22 version 26318 is already newer than 26317 2024-03-30T12:30:34.303 INFO:tasks.rados.rados.0.smithi084.stdout:2285: oid 22 updating version 26318 to 26319 2024-03-30T12:30:34.303 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 26319 (ObjNum 706 snap 242 seq_num 706) dirty exists 2024-03-30T12:30:34.303 INFO:tasks.rados.rados.0.smithi084.stdout:2285: left oid 22 (ObjNum 706 snap 242 seq_num 706) 2024-03-30T12:30:34.303 INFO:tasks.rados.rados.0.smithi084.stdout:2293: seq_num 709 ranges {3399680=679936,4079616=614400,4694016=499712,5193728=491520} 2024-03-30T12:30:34.323 INFO:tasks.rados.rados.0.smithi084.stdout:2293: writing smithi08477944-1 from 3399680 to 4079616 tid 1 2024-03-30T12:30:34.328 INFO:tasks.rados.rados.0.smithi084.stdout:2293: writing smithi08477944-1 from 4079616 to 4694016 tid 2 2024-03-30T12:30:34.331 INFO:tasks.rados.rados.0.smithi084.stdout:2293: writing smithi08477944-1 from 4694016 to 5193728 tid 3 2024-03-30T12:30:34.335 INFO:tasks.rados.rados.0.smithi084.stdout:2293: writing smithi08477944-1 from 5193728 to 5685248 tid 4 2024-03-30T12:30:34.335 INFO:tasks.rados.rados.0.smithi084.stdout:2285: done (2 left) 2024-03-30T12:30:34.335 INFO:tasks.rados.rados.0.smithi084.stdout:2290: done (1 left) 2024-03-30T12:30:34.335 INFO:tasks.rados.rados.0.smithi084.stdout:2294: delete oid 15 current snap is 242 2024-03-30T12:30:34.336 INFO:tasks.rados.rados.0.smithi084.stdout:2293: finishing write tid 1 to smithi08477944-1 2024-03-30T12:30:34.336 INFO:tasks.rados.rados.0.smithi084.stdout:2293: finishing write tid 2 to smithi08477944-1 2024-03-30T12:30:34.340 INFO:tasks.rados.rados.0.smithi084.stdout:2294: done (1 left) 2024-03-30T12:30:34.340 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 242 2024-03-30T12:30:34.340 INFO:tasks.rados.rados.0.smithi084.stdout:2295: seq_num 711 ranges {0=712704,712704=786432,1499136=516096,2015232=303104} 2024-03-30T12:30:34.345 INFO:tasks.rados.rados.0.smithi084.stdout:2295: writing smithi08477944-38 from 0 to 712704 tid 1 2024-03-30T12:30:34.350 INFO:tasks.rados.rados.0.smithi084.stdout:2295: writing smithi08477944-38 from 712704 to 1499136 tid 2 2024-03-30T12:30:34.353 INFO:tasks.rados.rados.0.smithi084.stdout:2295: writing smithi08477944-38 from 1499136 to 2015232 tid 3 2024-03-30T12:30:34.357 INFO:tasks.rados.rados.0.smithi084.stdout:2295: writing smithi08477944-38 from 2015232 to 2318336 tid 4 2024-03-30T12:30:34.357 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 242 2024-03-30T12:30:34.357 INFO:tasks.rados.rados.0.smithi084.stdout:2293: finishing write tid 3 to smithi08477944-1 2024-03-30T12:30:34.357 INFO:tasks.rados.rados.0.smithi084.stdout:2293: finishing write tid 4 to smithi08477944-1 2024-03-30T12:30:34.357 INFO:tasks.rados.rados.0.smithi084.stdout:2293: finishing write tid 5 to smithi08477944-1 2024-03-30T12:30:34.357 INFO:tasks.rados.rados.0.smithi084.stdout:2293: finishing write tid 6 to smithi08477944-1 2024-03-30T12:30:34.357 INFO:tasks.rados.rados.0.smithi084.stdout:2293: oid 1 updating version 0 to 17487 2024-03-30T12:30:34.357 INFO:tasks.rados.rados.0.smithi084.stdout:2293: oid 1 version 17487 is already newer than 17485 2024-03-30T12:30:34.357 INFO:tasks.rados.rados.0.smithi084.stdout:2293: oid 1 version 17487 is already newer than 17483 2024-03-30T12:30:34.358 INFO:tasks.rados.rados.0.smithi084.stdout:2293: oid 1 version 17487 is already newer than 17486 2024-03-30T12:30:34.358 INFO:tasks.rados.rados.0.smithi084.stdout:2293: oid 1 version 17487 is already newer than 17484 2024-03-30T12:30:34.358 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 17487 (ObjNum 709 snap 242 seq_num 709) dirty exists 2024-03-30T12:30:34.358 INFO:tasks.rados.rados.0.smithi084.stdout:2293: left oid 1 (ObjNum 709 snap 242 seq_num 709) 2024-03-30T12:30:34.358 INFO:tasks.rados.rados.0.smithi084.stdout:2295: finishing write tid 1 to smithi08477944-38 2024-03-30T12:30:34.358 INFO:tasks.rados.rados.0.smithi084.stdout:2296: seq_num 712 ranges {2170880=729088,2899968=671744,3571712=671744,4243456=262144} 2024-03-30T12:30:34.372 INFO:tasks.rados.rados.0.smithi084.stdout:2296: writing smithi08477944-50 from 2170880 to 2899968 tid 1 2024-03-30T12:30:34.377 INFO:tasks.rados.rados.0.smithi084.stdout:2296: writing smithi08477944-50 from 2899968 to 3571712 tid 2 2024-03-30T12:30:34.381 INFO:tasks.rados.rados.0.smithi084.stdout:2296: writing smithi08477944-50 from 3571712 to 4243456 tid 3 2024-03-30T12:30:34.383 INFO:tasks.rados.rados.0.smithi084.stdout:2296: writing smithi08477944-50 from 4243456 to 4505600 tid 4 2024-03-30T12:30:34.384 INFO:tasks.rados.rados.0.smithi084.stdout:2293: done (2 left) 2024-03-30T12:30:34.384 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 242 2024-03-30T12:30:34.384 INFO:tasks.rados.rados.0.smithi084.stdout:2295: finishing write tid 2 to smithi08477944-38 2024-03-30T12:30:34.384 INFO:tasks.rados.rados.0.smithi084.stdout:2295: finishing write tid 3 to smithi08477944-38 2024-03-30T12:30:34.384 INFO:tasks.rados.rados.0.smithi084.stdout:2295: finishing write tid 4 to smithi08477944-38 2024-03-30T12:30:34.384 INFO:tasks.rados.rados.0.smithi084.stdout:2297: seq_num 713 ranges {0=745472,745472=557056,1302528=483328,1785856=565248} 2024-03-30T12:30:34.388 INFO:tasks.rados.rados.0.smithi084.stdout:2297: writing smithi08477944-17 from 0 to 745472 tid 1 2024-03-30T12:30:34.392 INFO:tasks.rados.rados.0.smithi084.stdout:2297: writing smithi08477944-17 from 745472 to 1302528 tid 2 2024-03-30T12:30:34.395 INFO:tasks.rados.rados.0.smithi084.stdout:2297: writing smithi08477944-17 from 1302528 to 1785856 tid 3 2024-03-30T12:30:34.399 INFO:tasks.rados.rados.0.smithi084.stdout:2297: writing smithi08477944-17 from 1785856 to 2351104 tid 4 2024-03-30T12:30:34.399 INFO:tasks.rados.rados.0.smithi084.stdout:2298: read oid 42 snap -1 2024-03-30T12:30:34.399 INFO:tasks.rados.rados.0.smithi084.stdout:2298: expect (ObjNum 502 snap 157 seq_num 502) 2024-03-30T12:30:34.399 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 242 2024-03-30T12:30:34.400 INFO:tasks.rados.rados.0.smithi084.stdout:2299: seq_num 714 ranges {1662976=761856,2424832=442368,2867200=688128,3555328=475136} 2024-03-30T12:30:34.413 INFO:tasks.rados.rados.0.smithi084.stdout:2299: writing smithi08477944-29 from 1662976 to 2424832 tid 1 2024-03-30T12:30:34.416 INFO:tasks.rados.rados.0.smithi084.stdout:2299: writing smithi08477944-29 from 2424832 to 2867200 tid 2 2024-03-30T12:30:34.421 INFO:tasks.rados.rados.0.smithi084.stdout:2299: writing smithi08477944-29 from 2867200 to 3555328 tid 3 2024-03-30T12:30:34.424 INFO:tasks.rados.rados.0.smithi084.stdout:2299: writing smithi08477944-29 from 3555328 to 4030464 tid 4 2024-03-30T12:30:34.424 INFO:tasks.rados.rados.0.smithi084.stdout:2300: snap_remove snap 233 2024-03-30T12:30:34.493 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.258+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:34.493 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.293+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:34.493 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.327+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:34.493 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.357+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:34.493 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.394+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:34.493 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.428+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:34.493 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.464+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:34.494 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.501+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:34.494 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.261+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.494 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.284+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.494 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.304+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.494 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.322+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.494 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.346+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.494 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.368+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.494 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.392+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.494 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.419+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.494 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.449+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.494 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.471+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.494 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.491+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.753 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:30:34 smithi084 podman[116960]: 2024-03-30 12:30:34.46437443 +0000 UTC m=+0.786682468 container remove a9c2e74ca2a3f661bdc4efff076b09b658b3124284317c40769bf98a3fefb221 (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, RELEASE=reef-f14b568, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5) 2024-03-30T12:30:34.754 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:30:34 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mds.a.service: Deactivated successfully. 2024-03-30T12:30:34.754 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:30:34 smithi084 systemd[1]: Stopped Ceph mds.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:30:34.754 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:30:34 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mds.a.service: Consumed 1.211s CPU time. 2024-03-30T12:30:34.755 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.529+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:34.755 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.559+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:34.755 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.595+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:34.755 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.632+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:34.755 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.674+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:34.756 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.704+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:34.756 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.741+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:34.756 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.509+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.756 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.532+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.756 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.555+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.756 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.573+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.756 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.599+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.756 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.620+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.756 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.638+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.757 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.659+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.757 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.681+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.757 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.700+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.757 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.720+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.757 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.743+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:34.757 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.762+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.019 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.784+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.020 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.816+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.020 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.851+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.020 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.888+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.020 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.925+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.020 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.961+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.020 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:34.986+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.020 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.781+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.020 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.802+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.020 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.823+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.021 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.841+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.021 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.862+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.021 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.886+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.021 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.909+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.021 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.929+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.021 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.949+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.021 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.969+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.021 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:34.988+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.021 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.007+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.021 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.026+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.128 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:30:34 smithi084 systemd[1]: Starting Ceph mds.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:30:35.128 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:30:35 smithi084 podman[117084]: 2024-03-30 12:30:35.025922405 +0000 UTC m=+0.024232724 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:30:35.145 INFO:tasks.rados.rados.0.smithi084.stdout:2300: done (5 left) 2024-03-30T12:30:35.145 INFO:tasks.rados.rados.0.smithi084.stdout:2301: snap_remove snap 219 2024-03-30T12:30:35.274 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:35.154+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 130=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:35.275 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:35.154+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:35.275 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:35.275 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:35.275 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:35.276 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-mon[83709]: osdmap e548: 8 total, 8 up, 8 in 2024-03-30T12:30:35.276 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:35.276 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:35.276 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:35.276 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:35.276 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:35.276 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-mon[83709]: pgmap v508: 121 pgs: 5 active+clean+snaptrim, 108 active+clean, 8 active+clean+snaptrim_error; 554 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 9.5 MiB/s rd, 3.3 MiB/s wr, 18 op/s 2024-03-30T12:30:35.276 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:35.277 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.027+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.277 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.074+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.277 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.113+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.277 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.149+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.277 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.190+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.277 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.228+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.278 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.264+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.278 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.047+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.278 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.067+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.278 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.088+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.278 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.109+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.278 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.130+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.278 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.155+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.279 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.174+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.279 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.197+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.279 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.217+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.279 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.240+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.279 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.261+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.279 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.281+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.393 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:35.155+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:35.393 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:35.155+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:35.393 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:35.147+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:35.393 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:35.147+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:35.393 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:35.147+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:35.393 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:35.147+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:35.393 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:35.147+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:35.394 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:35.147+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:35.394 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:35.394 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:35.394 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:35.394 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-mon[91810]: osdmap e548: 8 total, 8 up, 8 in 2024-03-30T12:30:35.394 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:35.394 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:35.394 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:35.394 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:35.395 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:35.395 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-mon[91810]: pgmap v508: 121 pgs: 5 active+clean+snaptrim, 108 active+clean, 8 active+clean+snaptrim_error; 554 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 9.5 MiB/s rd, 3.3 MiB/s wr, 18 op/s 2024-03-30T12:30:35.395 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:35.395 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:30:35 smithi084 podman[117084]: 2024-03-30 12:30:35.140774535 +0000 UTC m=+0.139084861 container create 74abe81e0b10ede0186a602aa16aa5937e0b31d3deae3dd16af129d928974fad (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-a, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-03-30T12:30:35.395 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:30:35.135+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : Health check update: Possible data damage: 8 pgs snaptrim_error (PG_DAMAGED) 2024-03-30T12:30:35.395 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:35.395 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:35.396 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:35.396 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-mon[89279]: osdmap e548: 8 total, 8 up, 8 in 2024-03-30T12:30:35.396 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:35.396 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:35.396 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:35.396 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12d=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:35.396 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:35.396 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-mon[89279]: pgmap v508: 121 pgs: 5 active+clean+snaptrim, 108 active+clean, 8 active+clean+snaptrim_error; 554 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 9.5 MiB/s rd, 3.3 MiB/s wr, 18 op/s 2024-03-30T12:30:35.396 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:35.538 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.295+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.539 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.325+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.539 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.358+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.539 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.379+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.539 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.413+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.539 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.447+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.539 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.485+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.539 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.520+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.539 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.301+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.539 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.317+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.539 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.335+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.540 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.355+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.540 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.377+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.540 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.397+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.540 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.418+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.540 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.438+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.540 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.457+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.540 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.480+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.540 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.503+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.540 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.525+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.540 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.545+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.753 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:30:35 smithi084 podman[117084]: 2024-03-30 12:30:35.402416575 +0000 UTC m=+0.400726905 container init 74abe81e0b10ede0186a602aa16aa5937e0b31d3deae3dd16af129d928974fad (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-a, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T12:30:35.754 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:30:35 smithi084 podman[117084]: 2024-03-30 12:30:35.406104856 +0000 UTC m=+0.404415176 container start 74abe81e0b10ede0186a602aa16aa5937e0b31d3deae3dd16af129d928974fad (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-a, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:30:35.754 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:30:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-a[117098]: starting mds.a at 2024-03-30T12:30:35.754 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:30:35 smithi084 bash[117084]: 74abe81e0b10ede0186a602aa16aa5937e0b31d3deae3dd16af129d928974fad 2024-03-30T12:30:35.754 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:30:35 smithi084 systemd[1]: Started Ceph mds.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:30:35.789 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.559+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.790 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.594+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.790 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.629+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.790 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.663+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.790 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.696+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.790 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.731+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.790 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.752+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.790 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.789+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:35.790 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.566+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.790 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.585+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.790 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.607+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.790 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.627+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.790 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.649+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.791 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.672+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.791 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.691+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.791 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.711+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.791 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.730+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.791 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.756+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.791 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.774+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:35.791 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.796+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.059 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.816+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.060 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.837+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.060 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.855+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.060 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.875+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.060 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.895+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.060 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.915+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.060 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.934+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.060 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.955+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.060 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:35.980+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.060 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.002+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.060 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.024+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.060 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.045+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.822+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.863+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.904+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.941+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:35.965+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.002+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.061 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.038+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.157 INFO:tasks.rados.rados.0.smithi084.stdout:2301: done (5 left) 2024-03-30T12:30:36.157 INFO:tasks.rados.rados.0.smithi084.stdout:2302: rmattr oid 19 current snap is 242 2024-03-30T12:30:36.157 INFO:tasks.rados.rados.0.smithi084.stdout:2295: finishing write tid 5 to smithi08477944-38 2024-03-30T12:30:36.157 INFO:tasks.rados.rados.0.smithi084.stdout:2295: finishing write tid 6 to smithi08477944-38 2024-03-30T12:30:36.157 INFO:tasks.rados.rados.0.smithi084.stdout:2295: oid 38 updating version 0 to 1029 2024-03-30T12:30:36.157 INFO:tasks.rados.rados.0.smithi084.stdout:2295: oid 38 updating version 1029 to 1030 2024-03-30T12:30:36.157 INFO:tasks.rados.rados.0.smithi084.stdout:2295: oid 38 version 1030 is already newer than 1028 2024-03-30T12:30:36.157 INFO:tasks.rados.rados.0.smithi084.stdout:2295: oid 38 updating version 1030 to 1031 2024-03-30T12:30:36.157 INFO:tasks.rados.rados.0.smithi084.stdout:2295: oid 38 updating version 1031 to 1032 2024-03-30T12:30:36.157 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1032 (ObjNum 711 snap 242 seq_num 711) dirty exists 2024-03-30T12:30:36.157 INFO:tasks.rados.rados.0.smithi084.stdout:2295: left oid 38 (ObjNum 711 snap 242 seq_num 711) 2024-03-30T12:30:36.157 INFO:tasks.rados.rados.0.smithi084.stdout:2296: finishing write tid 1 to smithi08477944-50 2024-03-30T12:30:36.157 INFO:tasks.rados.rados.0.smithi084.stdout:2296: finishing write tid 2 to smithi08477944-50 2024-03-30T12:30:36.158 INFO:tasks.rados.rados.0.smithi084.stdout:2296: finishing write tid 3 to smithi08477944-50 2024-03-30T12:30:36.158 INFO:tasks.rados.rados.0.smithi084.stdout:2296: finishing write tid 4 to smithi08477944-50 2024-03-30T12:30:36.158 INFO:tasks.rados.rados.0.smithi084.stdout:2296: finishing write tid 5 to smithi08477944-50 2024-03-30T12:30:36.158 INFO:tasks.rados.rados.0.smithi084.stdout:2297: finishing write tid 1 to smithi08477944-17 2024-03-30T12:30:36.158 INFO:tasks.rados.rados.0.smithi084.stdout:2296: finishing write tid 6 to smithi08477944-50 2024-03-30T12:30:36.158 INFO:tasks.rados.rados.0.smithi084.stdout:2296: oid 50 updating version 0 to 996 2024-03-30T12:30:36.158 INFO:tasks.rados.rados.0.smithi084.stdout:2296: oid 50 updating version 996 to 999 2024-03-30T12:30:36.158 INFO:tasks.rados.rados.0.smithi084.stdout:2296: oid 50 version 999 is already newer than 997 2024-03-30T12:30:36.158 INFO:tasks.rados.rados.0.smithi084.stdout:2296: oid 50 version 999 is already newer than 998 2024-03-30T12:30:36.158 INFO:tasks.rados.rados.0.smithi084.stdout:2296: oid 50 version 999 is already newer than 995 2024-03-30T12:30:36.158 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 999 (ObjNum 712 snap 242 seq_num 712) dirty exists 2024-03-30T12:30:36.158 INFO:tasks.rados.rados.0.smithi084.stdout:2296: left oid 50 (ObjNum 712 snap 242 seq_num 712) 2024-03-30T12:30:36.158 INFO:tasks.rados.rados.0.smithi084.stdout:2297: finishing write tid 2 to smithi08477944-17 2024-03-30T12:30:36.158 INFO:tasks.rados.rados.0.smithi084.stdout:2297: finishing write tid 3 to smithi08477944-17 2024-03-30T12:30:36.158 INFO:tasks.rados.rados.0.smithi084.stdout:2297: finishing write tid 4 to smithi08477944-17 2024-03-30T12:30:36.159 INFO:tasks.rados.rados.0.smithi084.stdout:2297: finishing write tid 5 to smithi08477944-17 2024-03-30T12:30:36.159 INFO:tasks.rados.rados.0.smithi084.stdout:2299: finishing write tid 1 to smithi08477944-29 2024-03-30T12:30:36.159 INFO:tasks.rados.rados.0.smithi084.stdout:2299: finishing write tid 2 to smithi08477944-29 2024-03-30T12:30:36.159 INFO:tasks.rados.rados.0.smithi084.stdout:2297: finishing write tid 6 to smithi08477944-17 2024-03-30T12:30:36.159 INFO:tasks.rados.rados.0.smithi084.stdout:2297: oid 17 updating version 0 to 970 2024-03-30T12:30:36.159 INFO:tasks.rados.rados.0.smithi084.stdout:2297: oid 17 updating version 970 to 972 2024-03-30T12:30:36.159 INFO:tasks.rados.rados.0.smithi084.stdout:2297: oid 17 updating version 972 to 973 2024-03-30T12:30:36.159 INFO:tasks.rados.rados.0.smithi084.stdout:2297: oid 17 version 973 is already newer than 971 2024-03-30T12:30:36.159 INFO:tasks.rados.rados.0.smithi084.stdout:2297: oid 17 version 973 is already newer than 969 2024-03-30T12:30:36.159 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 973 (ObjNum 713 snap 242 seq_num 713) dirty exists 2024-03-30T12:30:36.159 INFO:tasks.rados.rados.0.smithi084.stdout:2297: left oid 17 (ObjNum 713 snap 242 seq_num 713) 2024-03-30T12:30:36.159 INFO:tasks.rados.rados.0.smithi084.stdout:2299: finishing write tid 3 to smithi08477944-29 2024-03-30T12:30:36.159 INFO:tasks.rados.rados.0.smithi084.stdout:2299: finishing write tid 4 to smithi08477944-29 2024-03-30T12:30:36.160 INFO:tasks.rados.rados.0.smithi084.stdout:2299: finishing write tid 5 to smithi08477944-29 2024-03-30T12:30:36.160 INFO:tasks.rados.rados.0.smithi084.stdout:2299: finishing write tid 6 to smithi08477944-29 2024-03-30T12:30:36.160 INFO:tasks.rados.rados.0.smithi084.stdout:2299: oid 29 updating version 0 to 17504 2024-03-30T12:30:36.160 INFO:tasks.rados.rados.0.smithi084.stdout:2299: oid 29 updating version 17504 to 17507 2024-03-30T12:30:36.160 INFO:tasks.rados.rados.0.smithi084.stdout:2299: oid 29 updating version 17507 to 17508 2024-03-30T12:30:36.160 INFO:tasks.rados.rados.0.smithi084.stdout:2299: oid 29 version 17508 is already newer than 17505 2024-03-30T12:30:36.160 INFO:tasks.rados.rados.0.smithi084.stdout:2299: oid 29 version 17508 is already newer than 17506 2024-03-30T12:30:36.160 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 17508 (ObjNum 714 snap 242 seq_num 714) dirty exists 2024-03-30T12:30:36.160 INFO:tasks.rados.rados.0.smithi084.stdout:2299: left oid 29 (ObjNum 714 snap 242 seq_num 714) 2024-03-30T12:30:36.160 INFO:tasks.rados.rados.0.smithi084.stdout:2298: expect (ObjNum 502 snap 157 seq_num 502) 2024-03-30T12:30:36.316 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.066+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.316 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.084+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.316 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.104+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.316 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.124+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.316 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.148+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.316 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.174+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.316 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.200+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.316 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.222+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.316 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.239+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.317 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.260+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.317 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.281+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.317 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.303+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.317 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:36.174+0000 7f9dc765a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 10b after trimming was started 2024-03-30T12:30:36.317 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:36.174+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 130=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:36.317 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:36.175+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:36.318 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-mon[83709]: Health check update: Possible data damage: 8 pgs snaptrim_error (PG_DAMAGED) 2024-03-30T12:30:36.318 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:36.318 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:36.318 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:36.318 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:36.318 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-mon[83709]: osdmap e549: 8 total, 8 up, 8 in 2024-03-30T12:30:36.318 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 130=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:36.318 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:36.318 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:36.318 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:36.319 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:36.319 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:36.319 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:30:36.319 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.073+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.319 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.105+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.319 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.140+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.319 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.176+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.319 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.210+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.319 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.246+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.319 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.280+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:36.160+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:36.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:36.165+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:36.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:36.160+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:36.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:36.161+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:36.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:36.161+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:36.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:36.161+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:36.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:36.162+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:36.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[91810]: Health check update: Possible data damage: 8 pgs snaptrim_error (PG_DAMAGED) 2024-03-30T12:30:36.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:36.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:36.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:36.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:36.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[91810]: osdmap e549: 8 total, 8 up, 8 in 2024-03-30T12:30:36.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 130=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:36.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:36.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:36.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:36.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:36.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:36.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:30:36.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[89279]: Health check update: Possible data damage: 8 pgs snaptrim_error (PG_DAMAGED) 2024-03-30T12:30:36.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:36.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:36.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:36.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:36.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[89279]: osdmap e549: 8 total, 8 up, 8 in 2024-03-30T12:30:36.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 130=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:36.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:36.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:36.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:36.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:36.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:36.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:36 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:30:36.578 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.322+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.579 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.344+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.579 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.365+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.579 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.385+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.579 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.407+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.579 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.429+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.579 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.453+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.579 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.473+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.579 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.497+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.579 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.519+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.579 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.541+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.580 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.564+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.580 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.326+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.580 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.356+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.580 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.393+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.580 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.424+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.580 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.454+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.580 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.497+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.580 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.536+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.580 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.572+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.829 INFO:tasks.rados.rados.0.smithi084.stdout:2295: done (5 left) 2024-03-30T12:30:36.829 INFO:tasks.rados.rados.0.smithi084.stdout:2296: done (4 left) 2024-03-30T12:30:36.829 INFO:tasks.rados.rados.0.smithi084.stdout:2297: done (3 left) 2024-03-30T12:30:36.829 INFO:tasks.rados.rados.0.smithi084.stdout:2298: done (2 left) 2024-03-30T12:30:36.829 INFO:tasks.rados.rados.0.smithi084.stdout:2299: done (1 left) 2024-03-30T12:30:36.829 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 242 2024-03-30T12:30:36.829 INFO:tasks.rados.rados.0.smithi084.stdout:2303: seq_num 715 ranges {0=778240,778240=770048,1548288=499712,2048000=335872} 2024-03-30T12:30:36.833 INFO:tasks.rados.rados.0.smithi084.stdout:2303: writing smithi08477944-23 from 0 to 778240 tid 1 2024-03-30T12:30:36.839 INFO:tasks.rados.rados.0.smithi084.stdout:2303: writing smithi08477944-23 from 778240 to 1548288 tid 2 2024-03-30T12:30:36.843 INFO:tasks.rados.rados.0.smithi084.stdout:2303: writing smithi08477944-23 from 1548288 to 2048000 tid 3 2024-03-30T12:30:36.843 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.585+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.843 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.610+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.844 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.629+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.844 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.651+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.844 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.672+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.844 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.694+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.844 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.717+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.844 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.738+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.844 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.761+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.844 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.781+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.844 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.806+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.844 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.830+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.844 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.850+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:36.845 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.610+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.845 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.651+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.845 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.685+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.845 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.709+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.845 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.742+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.845 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.780+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.845 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.808+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.845 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.831+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:36.846 INFO:tasks.rados.rados.0.smithi084.stdout:2303: writing smithi08477944-23 from 2048000 to 2383872 tid 4 2024-03-30T12:30:36.846 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 242 2024-03-30T12:30:36.846 INFO:tasks.rados.rados.0.smithi084.stdout:2304: seq_num 716 ranges {4030464=794624,4825088=655360,5480448=704512,6184960=245760} 2024-03-30T12:30:36.875 INFO:tasks.rados.rados.0.smithi084.stdout:2304: writing smithi08477944-29 from 4030464 to 4825088 tid 1 2024-03-30T12:30:36.879 INFO:tasks.rados.rados.0.smithi084.stdout:2304: writing smithi08477944-29 from 4825088 to 5480448 tid 2 2024-03-30T12:30:36.884 INFO:tasks.rados.rados.0.smithi084.stdout:2304: writing smithi08477944-29 from 5480448 to 6184960 tid 3 2024-03-30T12:30:36.886 INFO:tasks.rados.rados.0.smithi084.stdout:2304: writing smithi08477944-29 from 6184960 to 6430720 tid 4 2024-03-30T12:30:36.887 INFO:tasks.rados.rados.0.smithi084.stdout:2305: read oid 28 snap -1 2024-03-30T12:30:36.887 INFO:tasks.rados.rados.0.smithi084.stdout:2305: expect deleted 2024-03-30T12:30:36.887 INFO:tasks.rados.rados.0.smithi084.stdout:2306: snap_remove snap 234 2024-03-30T12:30:37.107 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.866+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.107 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.909+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.107 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.950+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.107 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:36.987+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.107 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.036+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.107 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.064+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.108 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.097+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.108 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.874+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.108 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.894+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.108 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.913+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.108 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.933+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.108 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.954+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.108 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.973+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.108 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:36.996+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.109 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.016+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.109 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.035+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.109 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.067+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.109 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.092+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.109 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.113+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.175 INFO:tasks.rados.rados.0.smithi084.stdout:2306: done (4 left) 2024-03-30T12:30:37.175 INFO:tasks.rados.rados.0.smithi084.stdout:2307: setattr oid 48 current snap is 242 2024-03-30T12:30:37.175 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 35631 (ObjNum 638 snap 226 seq_num 638) dirty exists 2024-03-30T12:30:37.175 INFO:tasks.rados.rados.0.smithi084.stdout:2303: finishing write tid 1 to smithi08477944-23 2024-03-30T12:30:37.175 INFO:tasks.rados.rados.0.smithi084.stdout:2303: finishing write tid 2 to smithi08477944-23 2024-03-30T12:30:37.175 INFO:tasks.rados.rados.0.smithi084.stdout:2303: finishing write tid 3 to smithi08477944-23 2024-03-30T12:30:37.175 INFO:tasks.rados.rados.0.smithi084.stdout:2303: finishing write tid 4 to smithi08477944-23 2024-03-30T12:30:37.175 INFO:tasks.rados.rados.0.smithi084.stdout:2303: finishing write tid 5 to smithi08477944-23 2024-03-30T12:30:37.175 INFO:tasks.rados.rados.0.smithi084.stdout:2303: finishing write tid 6 to smithi08477944-23 2024-03-30T12:30:37.176 INFO:tasks.rados.rados.0.smithi084.stdout:2303: oid 23 updating version 0 to 17508 2024-03-30T12:30:37.176 INFO:tasks.rados.rados.0.smithi084.stdout:2303: oid 23 version 17508 is already newer than 17507 2024-03-30T12:30:37.176 INFO:tasks.rados.rados.0.smithi084.stdout:2303: oid 23 version 17508 is already newer than 17506 2024-03-30T12:30:37.176 INFO:tasks.rados.rados.0.smithi084.stdout:2303: oid 23 version 17508 is already newer than 17504 2024-03-30T12:30:37.176 INFO:tasks.rados.rados.0.smithi084.stdout:2303: oid 23 version 17508 is already newer than 17505 2024-03-30T12:30:37.176 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 17508 (ObjNum 715 snap 242 seq_num 715) dirty exists 2024-03-30T12:30:37.176 INFO:tasks.rados.rados.0.smithi084.stdout:2303: left oid 23 (ObjNum 715 snap 242 seq_num 715) 2024-03-30T12:30:37.176 INFO:tasks.rados.rados.0.smithi084.stdout:2304: finishing write tid 1 to smithi08477944-29 2024-03-30T12:30:37.176 INFO:tasks.rados.rados.0.smithi084.stdout:2304: finishing write tid 2 to smithi08477944-29 2024-03-30T12:30:37.176 INFO:tasks.rados.rados.0.smithi084.stdout:2304: finishing write tid 3 to smithi08477944-29 2024-03-30T12:30:37.176 INFO:tasks.rados.rados.0.smithi084.stdout:2304: finishing write tid 4 to smithi08477944-29 2024-03-30T12:30:37.176 INFO:tasks.rados.rados.0.smithi084.stdout:2304: finishing write tid 5 to smithi08477944-29 2024-03-30T12:30:37.177 INFO:tasks.rados.rados.0.smithi084.stdout:2304: finishing write tid 6 to smithi08477944-29 2024-03-30T12:30:37.177 INFO:tasks.rados.rados.0.smithi084.stdout:2304: oid 29 updating version 0 to 17509 2024-03-30T12:30:37.177 INFO:tasks.rados.rados.0.smithi084.stdout:2304: oid 29 updating version 17509 to 17512 2024-03-30T12:30:37.177 INFO:tasks.rados.rados.0.smithi084.stdout:2304: oid 29 updating version 17512 to 17513 2024-03-30T12:30:37.177 INFO:tasks.rados.rados.0.smithi084.stdout:2304: oid 29 version 17513 is already newer than 17511 2024-03-30T12:30:37.177 INFO:tasks.rados.rados.0.smithi084.stdout:2304: oid 29 version 17513 is already newer than 17510 2024-03-30T12:30:37.177 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 17513 (ObjNum 716 snap 242 seq_num 716) dirty exists 2024-03-30T12:30:37.177 INFO:tasks.rados.rados.0.smithi084.stdout:2304: left oid 29 (ObjNum 716 snap 242 seq_num 716) 2024-03-30T12:30:37.177 INFO:tasks.rados.rados.0.smithi084.stdout:2302: done (4 left) 2024-03-30T12:30:37.177 INFO:tasks.rados.rados.0.smithi084.stdout:2303: done (3 left) 2024-03-30T12:30:37.177 INFO:tasks.rados.rados.0.smithi084.stdout:2304: done (2 left) 2024-03-30T12:30:37.177 INFO:tasks.rados.rados.0.smithi084.stdout:2305: done (1 left) 2024-03-30T12:30:37.177 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 242 2024-03-30T12:30:37.177 INFO:tasks.rados.rados.0.smithi084.stdout:2308: seq_num 717 ranges {1826816=16384} 2024-03-30T12:30:37.186 INFO:tasks.rados.rados.0.smithi084.stdout:2308: writing smithi08477944-49 from 1826816 to 1843200 tid 1 2024-03-30T12:30:37.186 INFO:tasks.rados.rados.0.smithi084.stdout:2309: snap_remove snap 168 2024-03-30T12:30:37.366 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:37.177+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 130=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:37.366 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:37.178+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:37.366 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.136+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.367 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.155+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.367 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.183+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.367 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.210+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.367 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.230+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.367 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.250+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.367 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.270+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.367 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.291+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.367 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.310+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.367 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.331+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.367 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.352+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.367 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.374+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.368 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:37.368 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:37.368 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-mon[83709]: mds.? [v2:172.21.15.84:6834/3803840215,v1:172.21.15.84:6835/3803840215] up:boot 2024-03-30T12:30:37.368 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-mon[83709]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-30T12:30:37.368 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:37.368 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-mon[83709]: osdmap e550: 8 total, 8 up, 8 in 2024-03-30T12:30:37.368 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:37.368 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-30T12:30:37.368 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:37.368 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:37.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 130=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:37.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:37.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-mon[83709]: pgmap v511: 121 pgs: 5 active+clean+snaptrim, 108 active+clean, 8 active+clean+snaptrim_error; 561 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 21 MiB/s rd, 5.1 MiB/s wr, 26 op/s 2024-03-30T12:30:37.369 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.125+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.369 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.155+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.369 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.191+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.369 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.213+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.369 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.243+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.369 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.281+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.369 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.320+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.369 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.353+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:37.184+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:37.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:37.187+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:37.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:37.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:37.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[91810]: mds.? [v2:172.21.15.84:6834/3803840215,v1:172.21.15.84:6835/3803840215] up:boot 2024-03-30T12:30:37.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[91810]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-30T12:30:37.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:37.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[91810]: osdmap e550: 8 total, 8 up, 8 in 2024-03-30T12:30:37.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:37.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-30T12:30:37.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:37.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:37.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 130=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:37.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:37.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[91810]: pgmap v511: 121 pgs: 5 active+clean+snaptrim, 108 active+clean, 8 active+clean+snaptrim_error; 561 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 21 MiB/s rd, 5.1 MiB/s wr, 26 op/s 2024-03-30T12:30:37.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:37.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:37.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[89279]: mds.? [v2:172.21.15.84:6834/3803840215,v1:172.21.15.84:6835/3803840215] up:boot 2024-03-30T12:30:37.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[89279]: fsmap cephfs:1 {0=b=up:active} 1 up:standby 2024-03-30T12:30:37.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:37.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[89279]: osdmap e550: 8 total, 8 up, 8 in 2024-03-30T12:30:37.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:37.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-30T12:30:37.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:37.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:37.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 130=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:37.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:37.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-mon[89279]: pgmap v511: 121 pgs: 5 active+clean+snaptrim, 108 active+clean, 8 active+clean+snaptrim_error; 561 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 21 MiB/s rd, 5.1 MiB/s wr, 26 op/s 2024-03-30T12:30:37.507 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:37.193+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:37.507 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:37.193+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:37.507 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:37.194+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:37.507 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:37.195+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:37.507 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:37.197+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:37.507 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:37.198+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:37.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.394+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.418+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.439+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.460+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.479+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.502+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.524+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.545+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.568+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.588+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.609+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.388+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.409+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.447+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.486+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.529+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.562+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.596+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.623+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.887 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.660+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.887 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.698+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.888 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.728+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.888 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.772+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.888 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.815+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.888 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.856+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:37.888 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.632+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.888 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.654+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.888 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.676+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.888 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.695+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.889 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.719+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.889 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.743+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.889 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.764+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.889 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.785+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.889 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.807+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.889 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.828+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.889 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.851+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.889 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.875+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:37.889 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.895+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:38.145 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.920+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:38.145 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.940+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:38.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.957+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:38.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:37.981+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:38.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:38.002+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:38.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:38.020+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:38.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:38.041+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:38.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:38.059+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:38.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:38.080+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:38.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:38.100+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:38.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:38.122+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:38.146 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:38.140+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:38.147 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.898+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:38.147 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.937+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:38.147 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:37.977+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:38.147 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:38.015+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:38.147 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:38.046+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:38.147 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:38.082+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:38.147 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:38.118+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:38.147 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:38.153+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:38.171 INFO:tasks.rados.rados.0.smithi084.stdout:2309: done (2 left) 2024-03-30T12:30:38.171 INFO:tasks.rados.rados.0.smithi084.stdout:2310: snap_remove snap 239 2024-03-30T12:30:38.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:38.187+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:38.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:38.187+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:38.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:38.176+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:38.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:38.176+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:38.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:38.178+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:38.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:38.178+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:38.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:38.178+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:38.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:38 smithi084 ceph-mon[91810]: osdmap e551: 8 total, 8 up, 8 in 2024-03-30T12:30:38.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 130=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:38.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:38.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:38.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:38.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:38.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:38.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:38.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:38.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:38 smithi084 ceph-mon[89279]: osdmap e551: 8 total, 8 up, 8 in 2024-03-30T12:30:38.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 130=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:38.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:38.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:38.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:38.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:38.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:38.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:38.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:38.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:30:38.187+0000 7f5be10d4700 -1 osd.6 pg_epoch: 551 pg[5.9s1( v 552'3747 (0'0,552'3747] local-lis/les=537/538 n=11 ec=71/71 lis/c=537/537 les/c/f=538/538/0 sis=537) [7,6,1]p7(0) r=1 lpr=537 luod=0'0 crt=547'3745 lcod 547'3745 mlcod 547'3745 active mbc={} ps=[97~1,99~1,9d~1,a0~2,a8~3f,e8~13,fc~b,108~3,10c~2,10f~4,117~2,11b~2]] update_snap_map remove_oid 5:9de8ba35:::smithi08477944-34:e9 failed with -2 2024-03-30T12:30:38.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:30:38.212+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 130=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:38.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:38.161+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:38.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:38.180+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:38.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:38.205+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:38.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:38.212+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:38.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:38.214+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:38.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:38.199+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:38.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:38.216+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:38.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:38.218+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 11f=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:38.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-mon[83709]: osdmap e551: 8 total, 8 up, 8 in 2024-03-30T12:30:38.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 130=[]:{f0=[e7],118=[116,115,114,113,10e],121=[121,11f,11e,11d,11a],12d=[12d,12c,12b,12a,129,128,127,126,125,122]} for object 5:2bd7b7a9:::smithi08477944-11:10d 2024-03-30T12:30:38.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12f=[]:{ee=[e7],111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:10a 2024-03-30T12:30:38.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:38.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:38.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:38.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:38.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:38.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:38.622 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:38.179+0000 7f9dc8e5d700 -1 osd.7 pg_epoch: 552 pg[5.9s0( v 547'3745 (0'0,547'3745] local-lis/les=537/538 n=12 ec=71/71 lis/c=537/537 les/c/f=538/538/0 sis=537) [7,6,1]p7(0) r=0 lpr=537 crt=547'3745 lcod 547'3744 mlcod 547'3744 active+clean+snaptrim trimq=[e7~1,fb~1,107~1,10b~1,113~4,119~2,11d~1,120~2,123~2,127~4,12d~1,130~1] ps=[97~1,99~1,9d~1,a0~2,a8~3f,e8~13,fc~b,108~3,10c~2,10f~4,117~2,11b~2]] update_snap_map remove_oid 5:92aec2e7:::smithi08477944-12:ee failed with -2 2024-03-30T12:30:38.622 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:38.182+0000 7f9dc8e5d700 -1 osd.7 pg_epoch: 552 pg[5.9s0( v 552'3747 (0'0,552'3747] local-lis/les=537/538 n=11 ec=71/71 lis/c=537/537 les/c/f=538/538/0 sis=537) [7,6,1]p7(0) r=0 lpr=537 luod=547'3745 crt=547'3745 lcod 547'3744 mlcod 547'3744 active+clean+snaptrim trimq=[e7~1,fb~1,107~1,10b~1,113~4,119~2,11d~1,120~2,123~2,127~4,12d~1,130~1] ps=[97~1,99~1,9d~1,a0~2,a8~3f,e8~13,fc~b,108~3,10c~2,10f~4,117~2,11b~2]] update_snap_map remove_oid 5:9de8ba35:::smithi08477944-34:e9 failed with -2 2024-03-30T12:30:38.622 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:38.185+0000 7f9dcb662700 -1 osd.7 pg_epoch: 552 pg[5.4s0( v 548'744 (0'0,548'744] local-lis/les=537/538 n=14 ec=71/71 lis/c=537/537 les/c/f=538/538/0 sis=537) [7,2,5]p7(0) r=0 lpr=537 crt=548'744 lcod 548'743 mlcod 548'743 active+clean+snaptrim trimq=[e7~1,10b~1,113~4,119~2,11d~1,120~2,123~2,127~4,12d~1,130~1] ps=[97~1,99~1,9d~1,a0~2,a8~3f,e8~23,10c~2,10f~4,117~2,11b~2]] update_snap_map remove_oid 5:20369991:::smithi08477944-5:f9 failed with -2 2024-03-30T12:30:38.622 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:38.187+0000 7f9dcb662700 -1 osd.7 pg_epoch: 552 pg[5.4s0( v 552'746 (0'0,552'746] local-lis/les=537/538 n=13 ec=71/71 lis/c=537/537 les/c/f=538/538/0 sis=537) [7,2,5]p7(0) r=0 lpr=537 luod=548'744 crt=548'744 lcod 548'743 mlcod 548'743 active+clean+snaptrim trimq=[e7~1,10b~1,113~4,119~2,11d~1,120~2,123~2,127~4,12d~1,130~1] ps=[97~1,99~1,9d~1,a0~2,a8~3f,e8~23,10c~2,10f~4,117~2,11b~2]] update_snap_map remove_oid 5:249950ed:::smithi08477944-25:e9 failed with -2 2024-03-30T12:30:38.622 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:38.196+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:38.622 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:38.198+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:39.178 INFO:tasks.rados.rados.0.smithi084.stdout:2310: done (2 left) 2024-03-30T12:30:39.178 INFO:tasks.rados.rados.0.smithi084.stdout:2311: delete oid 31 current snap is 242 2024-03-30T12:30:39.178 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 920 (ObjNum 677 snap 239 seq_num 677) dirty exists 2024-03-30T12:30:39.179 INFO:tasks.rados.rados.0.smithi084.stdout:2308: finishing write tid 1 to smithi08477944-49 2024-03-30T12:30:39.179 INFO:tasks.rados.rados.0.smithi084.stdout:2308: finishing write tid 2 to smithi08477944-49 2024-03-30T12:30:39.179 INFO:tasks.rados.rados.0.smithi084.stdout:2308: finishing write tid 3 to smithi08477944-49 2024-03-30T12:30:39.179 INFO:tasks.rados.rados.0.smithi084.stdout:2308: oid 49 updating version 0 to 17509 2024-03-30T12:30:39.179 INFO:tasks.rados.rados.0.smithi084.stdout:2308: oid 49 updating version 17509 to 17510 2024-03-30T12:30:39.179 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 17510 (ObjNum 717 snap 242 seq_num 717) dirty exists 2024-03-30T12:30:39.179 INFO:tasks.rados.rados.0.smithi084.stdout:2308: left oid 49 (ObjNum 717 snap 242 seq_num 717) 2024-03-30T12:30:39.179 INFO:tasks.rados.rados.0.smithi084.stdout:2307: done (2 left) 2024-03-30T12:30:39.180 INFO:tasks.rados.rados.0.smithi084.stdout:2308: done (1 left) 2024-03-30T12:30:39.180 INFO:tasks.rados.rados.0.smithi084.stdout:2311: done (0 left) 2024-03-30T12:30:39.180 INFO:tasks.rados.rados.0.smithi084.stdout:2312: delete oid 19 current snap is 242 2024-03-30T12:30:39.186 INFO:tasks.rados.rados.0.smithi084.stdout:2312: done (0 left) 2024-03-30T12:30:39.186 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 242 2024-03-30T12:30:39.186 INFO:tasks.rados.rados.0.smithi084.stdout:2313: seq_num 720 ranges {2154496=65536} 2024-03-30T12:30:39.198 INFO:tasks.rados.rados.0.smithi084.stdout:2313: writing smithi08477944-18 from 2154496 to 2220032 tid 1 2024-03-30T12:30:39.198 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 242 2024-03-30T12:30:39.198 INFO:tasks.rados.rados.0.smithi084.stdout:2314: seq_num 721 ranges {1712128=81920} 2024-03-30T12:30:39.208 INFO:tasks.rados.rados.0.smithi084.stdout:2314: writing smithi08477944-14 from 1712128 to 1794048 tid 1 2024-03-30T12:30:39.208 INFO:tasks.rados.rados.0.smithi084.stdout:2315: delete oid 35 current snap is 242 2024-03-30T12:30:39.208 INFO:tasks.rados.rados.0.smithi084.stdout:2313: finishing write tid 1 to smithi08477944-18 2024-03-30T12:30:39.208 INFO:tasks.rados.rados.0.smithi084.stdout:2313: finishing write tid 2 to smithi08477944-18 2024-03-30T12:30:39.208 INFO:tasks.rados.rados.0.smithi084.stdout:2313: finishing write tid 3 to smithi08477944-18 2024-03-30T12:30:39.208 INFO:tasks.rados.rados.0.smithi084.stdout:2313: oid 18 updating version 0 to 1001 2024-03-30T12:30:39.209 INFO:tasks.rados.rados.0.smithi084.stdout:2313: oid 18 updating version 1001 to 1002 2024-03-30T12:30:39.209 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1002 (ObjNum 720 snap 242 seq_num 720) dirty exists 2024-03-30T12:30:39.209 INFO:tasks.rados.rados.0.smithi084.stdout:2313: left oid 18 (ObjNum 720 snap 242 seq_num 720) 2024-03-30T12:30:39.209 INFO:tasks.rados.rados.0.smithi084.stdout:2313: done (2 left) 2024-03-30T12:30:39.209 INFO:tasks.rados.rados.0.smithi084.stdout:2315: done (1 left) 2024-03-30T12:30:39.209 INFO:tasks.rados.rados.0.smithi084.stdout:2316: setattr oid 35 current snap is 242 2024-03-30T12:30:39.211 INFO:tasks.rados.rados.0.smithi084.stdout:2317: copy_from oid 26 from oid 1 current snap is 242 2024-03-30T12:30:39.211 INFO:tasks.rados.rados.0.smithi084.stdout:2318: copy_from oid 17 from oid 29 current snap is 242 2024-03-30T12:30:39.211 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 27 current snap is 242 2024-03-30T12:30:39.211 INFO:tasks.rados.rados.0.smithi084.stdout:2319: seq_num 723 ranges {0=114688} 2024-03-30T12:30:39.212 INFO:tasks.rados.rados.0.smithi084.stdout:2319: writing smithi08477944-27 from 0 to 114688 tid 1 2024-03-30T12:30:39.212 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 242 2024-03-30T12:30:39.212 INFO:tasks.rados.rados.0.smithi084.stdout:2320: seq_num 724 ranges {0=131072} 2024-03-30T12:30:39.214 INFO:tasks.rados.rados.0.smithi084.stdout:2320: writing smithi08477944-2 from 0 to 131072 tid 1 2024-03-30T12:30:39.214 INFO:tasks.rados.rados.0.smithi084.stdout:2321: read oid 9 snap -1 2024-03-30T12:30:39.214 INFO:tasks.rados.rados.0.smithi084.stdout:2321: expect deleted 2024-03-30T12:30:39.214 INFO:tasks.rados.rados.0.smithi084.stdout:2322: rmattr oid 28 current snap is 242 2024-03-30T12:30:39.215 INFO:tasks.rados.rados.0.smithi084.stdout:2322: done (7 left) 2024-03-30T12:30:39.215 INFO:tasks.rados.rados.0.smithi084.stdout:2323: rollback oid 44 current snap is 242 2024-03-30T12:30:39.215 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 44 to 230 2024-03-30T12:30:39.215 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 242 2024-03-30T12:30:39.215 INFO:tasks.rados.rados.0.smithi084.stdout:2324: seq_num 725 ranges {0=147456} 2024-03-30T12:30:39.215 INFO:tasks.rados.rados.0.smithi084.stdout:2324: writing smithi08477944-15 from 0 to 147456 tid 1 2024-03-30T12:30:39.215 INFO:tasks.rados.rados.0.smithi084.stdout:2325: read oid 46 snap -1 2024-03-30T12:30:39.215 INFO:tasks.rados.rados.0.smithi084.stdout:2325: expect (ObjNum 684 snap 239 seq_num 684) 2024-03-30T12:30:39.215 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 242 2024-03-30T12:30:39.215 INFO:tasks.rados.rados.0.smithi084.stdout:2326: seq_num 726 ranges {507904=163840} 2024-03-30T12:30:39.219 INFO:tasks.rados.rados.0.smithi084.stdout:2326: writing smithi08477944-37 from 507904 to 671744 tid 1 2024-03-30T12:30:39.219 INFO:tasks.rados.rados.0.smithi084.stdout:2327: copy_from oid 7 from oid 34 current snap is 242 2024-03-30T12:30:39.219 INFO:tasks.rados.rados.0.smithi084.stdout:2321: done (11 left) 2024-03-30T12:30:39.219 INFO:tasks.rados.rados.0.smithi084.stdout:2328: snap_remove snap 207 2024-03-30T12:30:39.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:30:39] "GET /metrics HTTP/1.1" 200 36326 "" "Prometheus/2.43.0" 2024-03-30T12:30:39.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:39.189+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:39.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:39.189+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:39.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:39.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:39.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[91810]: osdmap e552: 8 total, 8 up, 8 in 2024-03-30T12:30:39.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:39.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:39.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:39.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:39.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:39.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:39.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 130=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:39.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:39.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:39.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:39.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 11f=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:39.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[91810]: pgmap v514: 121 pgs: 5 active+clean+snaptrim, 108 active+clean, 8 active+clean+snaptrim_error; 572 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 15 MiB/s rd, 3.9 MiB/s wr, 23 op/s 2024-03-30T12:30:39.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:39.184+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:39.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:39.184+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:39.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:39.184+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:39.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:39.184+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:39.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:39.185+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:39.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:39.185+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:39.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:39.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:39.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[89279]: osdmap e552: 8 total, 8 up, 8 in 2024-03-30T12:30:39.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:39.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:39.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:39.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:39.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:39.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:39.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 130=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:39.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:39.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:39.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:39.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 11f=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:39.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:39 smithi084 ceph-mon[89279]: pgmap v514: 121 pgs: 5 active+clean+snaptrim, 108 active+clean, 8 active+clean+snaptrim_error; 572 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 15 MiB/s rd, 3.9 MiB/s wr, 23 op/s 2024-03-30T12:30:39.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:30:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:30:39.246+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 130=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:39.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:39.185+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:39.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:39.186+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:39.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:39.185+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:39.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:39.185+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:39.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:39.186+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:39.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:39.190+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:39.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:39.190+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:39.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:39.190+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 11f=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:39.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:39.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:39.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:39 smithi162 ceph-mon[83709]: osdmap e552: 8 total, 8 up, 8 in 2024-03-30T12:30:39.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:39.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:39.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:39.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:39.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:39.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:39.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 130=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:39.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:39.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:39.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:39.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 11f=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:39.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:39 smithi162 ceph-mon[83709]: pgmap v514: 121 pgs: 5 active+clean+snaptrim, 108 active+clean, 8 active+clean+snaptrim_error; 572 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 15 MiB/s rd, 3.9 MiB/s wr, 23 op/s 2024-03-30T12:30:40.187 INFO:tasks.rados.rados.0.smithi084.stdout:2328: done (11 left) 2024-03-30T12:30:40.187 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 242 2024-03-30T12:30:40.187 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 17489 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:30:40.187 INFO:tasks.rados.rados.0.smithi084.stdout:2329: seq_num 727 ranges {2220032=180224} 2024-03-30T12:30:40.202 INFO:tasks.rados.rados.0.smithi084.stdout:2329: writing smithi08477944-18 from 2220032 to 2400256 tid 1 2024-03-30T12:30:40.202 INFO:tasks.rados.rados.0.smithi084.stdout:2316: done (11 left) 2024-03-30T12:30:40.202 INFO:tasks.rados.rados.0.smithi084.stdout:2330: setattr oid 3 current snap is 242 2024-03-30T12:30:40.202 INFO:tasks.rados.rados.0.smithi084.stdout:2324: finishing write tid 1 to smithi08477944-15 2024-03-30T12:30:40.202 INFO:tasks.rados.rados.0.smithi084.stdout:2324: finishing write tid 2 to smithi08477944-15 2024-03-30T12:30:40.202 INFO:tasks.rados.rados.0.smithi084.stdout:2327: finishing copy_from to smithi08477944-7 2024-03-30T12:30:40.202 INFO:tasks.rados.rados.0.smithi084.stdout:2327: got expected ENOENT (src dne) 2024-03-30T12:30:40.202 INFO:tasks.rados.rados.0.smithi084.stdout:2327: finishing copy_from racing read to smithi08477944-7 2024-03-30T12:30:40.202 INFO:tasks.rados.rados.0.smithi084.stdout:2319: finishing write tid 1 to smithi08477944-27 2024-03-30T12:30:40.202 INFO:tasks.rados.rados.0.smithi084.stdout:2319: finishing write tid 2 to smithi08477944-27 2024-03-30T12:30:40.202 INFO:tasks.rados.rados.0.smithi084.stdout:2323: finishing rollback tid 1 to smithi08477944-44 2024-03-30T12:30:40.202 INFO:tasks.rados.rados.0.smithi084.stdout:2323: finishing rollback tid 2 to smithi08477944-44 2024-03-30T12:30:40.203 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 36214 (ObjNum 440 snap 141 seq_num 440) dirty exists 2024-03-30T12:30:40.203 INFO:tasks.rados.rados.0.smithi084.stdout:2319: finishing write tid 3 to smithi08477944-27 2024-03-30T12:30:40.203 INFO:tasks.rados.rados.0.smithi084.stdout:2319: oid 27 updating version 0 to 23373 2024-03-30T12:30:40.203 INFO:tasks.rados.rados.0.smithi084.stdout:2319: oid 27 updating version 23373 to 23374 2024-03-30T12:30:40.203 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 23374 (ObjNum 723 snap 242 seq_num 723) dirty exists 2024-03-30T12:30:40.203 INFO:tasks.rados.rados.0.smithi084.stdout:2319: left oid 27 (ObjNum 723 snap 242 seq_num 723) 2024-03-30T12:30:40.203 INFO:tasks.rados.rados.0.smithi084.stdout:2314: finishing write tid 1 to smithi08477944-14 2024-03-30T12:30:40.203 INFO:tasks.rados.rados.0.smithi084.stdout:2314: finishing write tid 2 to smithi08477944-14 2024-03-30T12:30:40.203 INFO:tasks.rados.rados.0.smithi084.stdout:2326: finishing write tid 1 to smithi08477944-37 2024-03-30T12:30:40.203 INFO:tasks.rados.rados.0.smithi084.stdout:2326: finishing write tid 2 to smithi08477944-37 2024-03-30T12:30:40.203 INFO:tasks.rados.rados.0.smithi084.stdout:2314: finishing write tid 3 to smithi08477944-14 2024-03-30T12:30:40.203 INFO:tasks.rados.rados.0.smithi084.stdout:2314: oid 14 updating version 0 to 23392 2024-03-30T12:30:40.203 INFO:tasks.rados.rados.0.smithi084.stdout:2314: oid 14 version 23392 is already newer than 23391 2024-03-30T12:30:40.204 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 23392 (ObjNum 721 snap 242 seq_num 721) dirty exists 2024-03-30T12:30:40.204 INFO:tasks.rados.rados.0.smithi084.stdout:2314: left oid 14 (ObjNum 721 snap 242 seq_num 721) 2024-03-30T12:30:40.204 INFO:tasks.rados.rados.0.smithi084.stdout:2318: finishing copy_from racing read to smithi08477944-17 2024-03-30T12:30:40.204 INFO:tasks.rados.rados.0.smithi084.stdout:2324: finishing write tid 3 to smithi08477944-15 2024-03-30T12:30:40.204 INFO:tasks.rados.rados.0.smithi084.stdout:2324: oid 15 updating version 0 to 975 2024-03-30T12:30:40.204 INFO:tasks.rados.rados.0.smithi084.stdout:2324: oid 15 version 975 is already newer than 974 2024-03-30T12:30:40.204 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 975 (ObjNum 725 snap 242 seq_num 725) dirty exists 2024-03-30T12:30:40.204 INFO:tasks.rados.rados.0.smithi084.stdout:2324: left oid 15 (ObjNum 725 snap 242 seq_num 725) 2024-03-30T12:30:40.204 INFO:tasks.rados.rados.0.smithi084.stdout:2326: finishing write tid 3 to smithi08477944-37 2024-03-30T12:30:40.204 INFO:tasks.rados.rados.0.smithi084.stdout:2326: oid 37 updating version 0 to 23394 2024-03-30T12:30:40.204 INFO:tasks.rados.rados.0.smithi084.stdout:2326: oid 37 version 23394 is already newer than 23393 2024-03-30T12:30:40.204 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 23394 (ObjNum 726 snap 242 seq_num 726) dirty exists 2024-03-30T12:30:40.204 INFO:tasks.rados.rados.0.smithi084.stdout:2326: left oid 37 (ObjNum 726 snap 242 seq_num 726) 2024-03-30T12:30:40.204 INFO:tasks.rados.rados.0.smithi084.stdout:2318: finishing copy_from to smithi08477944-17 2024-03-30T12:30:40.204 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 17513 (ObjNum 716 snap 242 seq_num 716) dirty exists 2024-03-30T12:30:40.205 INFO:tasks.rados.rados.0.smithi084.stdout:2317: finishing copy_from racing read to smithi08477944-26 2024-03-30T12:30:40.205 INFO:tasks.rados.rados.0.smithi084.stdout:2320: finishing write tid 1 to smithi08477944-2 2024-03-30T12:30:40.205 INFO:tasks.rados.rados.0.smithi084.stdout:2320: finishing write tid 2 to smithi08477944-2 2024-03-30T12:30:40.205 INFO:tasks.rados.rados.0.smithi084.stdout:2317: finishing copy_from to smithi08477944-26 2024-03-30T12:30:40.205 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 17487 (ObjNum 709 snap 242 seq_num 709) dirty exists 2024-03-30T12:30:40.205 INFO:tasks.rados.rados.0.smithi084.stdout:2325: expect (ObjNum 684 snap 239 seq_num 684) 2024-03-30T12:30:40.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:40.199+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:40.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:40.199+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:40.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:40.211+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:40.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:40.211+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:40.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:40.211+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:40.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:40.214+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:40.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:40.214+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:40.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:40.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:40.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:40.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:40.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:40.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:40.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[91810]: osdmap e553: 8 total, 8 up, 8 in 2024-03-30T12:30:40.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:40.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:40.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:40.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:40.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:40.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 11f=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:40.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 130=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:40.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:40.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:40.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:40.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:40.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:40.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:40.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:40.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:40.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[89279]: osdmap e553: 8 total, 8 up, 8 in 2024-03-30T12:30:40.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:40.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:40.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:40.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:40.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:40.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 11f=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:40.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 130=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:40.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:40.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:40 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:40.533 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:40.199+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:40.533 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:40.199+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:40.533 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:40.195+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:40.533 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:40.196+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:40.534 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:40.215+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:40.534 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:40.215+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 11f=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:40.534 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:40.534 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:40.534 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:40.534 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:40.534 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:40.534 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:40.535 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:40 smithi162 ceph-mon[83709]: osdmap e553: 8 total, 8 up, 8 in 2024-03-30T12:30:40.535 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:40.535 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:40.535 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:40.535 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:40.535 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:40.535 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 11f=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:40.535 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 130=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:40.535 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:40 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:40.535 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:40 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:40.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:30:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:30:40.541+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 130=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:41.094 INFO:tasks.rados.rados.0.smithi084.stdout:2320: finishing write tid 3 to smithi08477944-2 2024-03-30T12:30:41.094 INFO:tasks.rados.rados.0.smithi084.stdout:2320: oid 2 updating version 0 to 27180 2024-03-30T12:30:41.094 INFO:tasks.rados.rados.0.smithi084.stdout:2320: oid 2 updating version 27180 to 27181 2024-03-30T12:30:41.094 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 27181 (ObjNum 724 snap 242 seq_num 724) dirty exists 2024-03-30T12:30:41.094 INFO:tasks.rados.rados.0.smithi084.stdout:2320: left oid 2 (ObjNum 724 snap 242 seq_num 724) 2024-03-30T12:30:41.094 INFO:tasks.rados.rados.0.smithi084.stdout:2329: finishing write tid 1 to smithi08477944-18 2024-03-30T12:30:41.094 INFO:tasks.rados.rados.0.smithi084.stdout:2329: finishing write tid 2 to smithi08477944-18 2024-03-30T12:30:41.095 INFO:tasks.rados.rados.0.smithi084.stdout:2329: finishing write tid 3 to smithi08477944-18 2024-03-30T12:30:41.095 INFO:tasks.rados.rados.0.smithi084.stdout:2329: oid 18 updating version 0 to 1004 2024-03-30T12:30:41.095 INFO:tasks.rados.rados.0.smithi084.stdout:2329: oid 18 version 1004 is already newer than 1003 2024-03-30T12:30:41.095 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1004 (ObjNum 727 snap 242 seq_num 727) dirty exists 2024-03-30T12:30:41.095 INFO:tasks.rados.rados.0.smithi084.stdout:2329: left oid 18 (ObjNum 727 snap 242 seq_num 727) 2024-03-30T12:30:41.095 INFO:tasks.rados.rados.0.smithi084.stdout:2314: done (11 left) 2024-03-30T12:30:41.095 INFO:tasks.rados.rados.0.smithi084.stdout:2317: done (10 left) 2024-03-30T12:30:41.095 INFO:tasks.rados.rados.0.smithi084.stdout:2318: done (9 left) 2024-03-30T12:30:41.095 INFO:tasks.rados.rados.0.smithi084.stdout:2319: done (8 left) 2024-03-30T12:30:41.095 INFO:tasks.rados.rados.0.smithi084.stdout:2320: done (7 left) 2024-03-30T12:30:41.096 INFO:tasks.rados.rados.0.smithi084.stdout:2323: done (6 left) 2024-03-30T12:30:41.096 INFO:tasks.rados.rados.0.smithi084.stdout:2324: done (5 left) 2024-03-30T12:30:41.096 INFO:tasks.rados.rados.0.smithi084.stdout:2325: done (4 left) 2024-03-30T12:30:41.096 INFO:tasks.rados.rados.0.smithi084.stdout:2326: done (3 left) 2024-03-30T12:30:41.096 INFO:tasks.rados.rados.0.smithi084.stdout:2327: done (2 left) 2024-03-30T12:30:41.096 INFO:tasks.rados.rados.0.smithi084.stdout:2329: done (1 left) 2024-03-30T12:30:41.096 INFO:tasks.rados.rados.0.smithi084.stdout:2331: snap_create 2024-03-30T12:30:41.099 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 27184 (ObjNum 2241 snap 0 seq_num 1429208000) dirty exists 2024-03-30T12:30:41.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[89279]: osdmap e554: 8 total, 8 up, 8 in 2024-03-30T12:30:41.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:41.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:41.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:41.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:41.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:41.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:41.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:41.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:41.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:41.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:41.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:41.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 11f=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:41.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:41.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:41.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 130=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:41.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[89279]: pgmap v517: 121 pgs: 2 active+clean+snaptrim, 108 active+clean, 11 active+clean+snaptrim_error; 571 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 9.6 MiB/s rd, 4.8 MiB/s wr, 21 op/s 2024-03-30T12:30:41.406 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:30:41.413+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : Health check update: Possible data damage: 11 pgs snaptrim_error (PG_DAMAGED) 2024-03-30T12:30:41.406 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[91810]: osdmap e554: 8 total, 8 up, 8 in 2024-03-30T12:30:41.406 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:41.406 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:41.406 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:41.407 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:41.407 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:41.407 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:41.407 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:41.407 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:41.407 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:41.407 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:41.407 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:41.407 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 11f=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:41.407 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:41.407 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:41.407 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 130=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:41.407 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-mon[91810]: pgmap v517: 121 pgs: 2 active+clean+snaptrim, 108 active+clean, 11 active+clean+snaptrim_error; 571 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 9.6 MiB/s rd, 4.8 MiB/s wr, 21 op/s 2024-03-30T12:30:41.414 INFO:tasks.rados.rados.0.smithi084.stdout:2330: done (1 left) 2024-03-30T12:30:41.414 INFO:tasks.rados.rados.0.smithi084.stdout:2331: done (0 left) 2024-03-30T12:30:41.414 INFO:tasks.rados.rados.0.smithi084.stdout:2332: rollback oid 14 current snap is 243 2024-03-30T12:30:41.414 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 14 to 230 2024-03-30T12:30:41.414 INFO:tasks.rados.rados.0.smithi084.stdout:2333: snap_create 2024-03-30T12:30:41.425 INFO:tasks.rados.rados.0.smithi084.stdout:2332: finishing rollback tid 0 to smithi08477944-14 2024-03-30T12:30:41.425 INFO:tasks.rados.rados.0.smithi084.stdout:2332: finishing rollback tid 1 to smithi08477944-14 2024-03-30T12:30:41.425 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 23396 (ObjNum 129 snap 0 seq_num 199536701) dirty dne 2024-03-30T12:30:41.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:30:41.433+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 130=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:41.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:41.429+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:41.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:41.429+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:41.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:41.429+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 130=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:41.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:41.423+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:41.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:41.423+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:41.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:41.423+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:41.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:41.423+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:41.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:41.423+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:41.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-mon[83709]: osdmap e554: 8 total, 8 up, 8 in 2024-03-30T12:30:41.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:41.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:41.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:41.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:41.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:41.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:41.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:41.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:41.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:41.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:41.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:41.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 11f=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:41.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:41.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:41.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 130=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:41.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:41 smithi162 ceph-mon[83709]: pgmap v517: 121 pgs: 2 active+clean+snaptrim, 108 active+clean, 11 active+clean+snaptrim_error; 571 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 9.6 MiB/s rd, 4.8 MiB/s wr, 21 op/s 2024-03-30T12:30:41.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:41.429+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:41.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:41.429+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:41.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:41.421+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:41.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:41.422+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:41.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:41.422+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:41.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:41.422+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:41.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:41.422+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:41.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:41.422+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:42.417 INFO:tasks.rados.rados.0.smithi084.stdout:2332: done (1 left) 2024-03-30T12:30:42.417 INFO:tasks.rados.rados.0.smithi084.stdout:2333: done (0 left) 2024-03-30T12:30:42.417 INFO:tasks.rados.rados.0.smithi084.stdout:2334: read oid 49 snap -1 2024-03-30T12:30:42.417 INFO:tasks.rados.rados.0.smithi084.stdout:2334: expect (ObjNum 717 snap 242 seq_num 717) 2024-03-30T12:30:42.417 INFO:tasks.rados.rados.0.smithi084.stdout:2335: rmattr oid 41 current snap is 244 2024-03-30T12:30:42.417 INFO:tasks.rados.rados.0.smithi084.stdout:2335: done (1 left) 2024-03-30T12:30:42.417 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 244 2024-03-30T12:30:42.417 INFO:tasks.rados.rados.0.smithi084.stdout:2336: seq_num 728 ranges {2383872=196608} 2024-03-30T12:30:42.431 INFO:tasks.rados.rados.0.smithi084.stdout:2336: writing smithi08477944-23 from 2383872 to 2580480 tid 1 2024-03-30T12:30:42.431 INFO:tasks.rados.rados.0.smithi084.stdout:2337: copy_from oid 44 from oid 9 current snap is 244 2024-03-30T12:30:42.431 INFO:tasks.rados.rados.0.smithi084.stdout:2334: expect (ObjNum 717 snap 242 seq_num 717) 2024-03-30T12:30:42.464 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:42.428+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:42.464 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:42.430+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:42.464 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:42.443+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:42.464 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:42.444+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:42.464 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:42.444+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:42.464 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:42.444+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:42.464 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:42.444+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:42.465 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-mon[91810]: Health check update: Possible data damage: 11 pgs snaptrim_error (PG_DAMAGED) 2024-03-30T12:30:42.465 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:42.465 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:42.465 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:42.465 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:42.465 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-mon[91810]: osdmap e555: 8 total, 8 up, 8 in 2024-03-30T12:30:42.465 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:42.465 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:42.465 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:42.465 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:42.465 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 130=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:42.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-mon[89279]: Health check update: Possible data damage: 11 pgs snaptrim_error (PG_DAMAGED) 2024-03-30T12:30:42.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:42.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:42.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:42.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:42.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-mon[89279]: osdmap e555: 8 total, 8 up, 8 in 2024-03-30T12:30:42.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:42.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:42.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:42.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:42.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 130=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:42.491 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:42.425+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:42.491 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:42.425+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:42.492 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:42.424+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:42.492 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:42.425+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:42.492 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:42 smithi162 ceph-mon[83709]: Health check update: Possible data damage: 11 pgs snaptrim_error (PG_DAMAGED) 2024-03-30T12:30:42.492 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:42.492 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:42.492 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:42.492 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:42.492 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:42 smithi162 ceph-mon[83709]: osdmap e555: 8 total, 8 up, 8 in 2024-03-30T12:30:42.493 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:42.493 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:42.493 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:42.493 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:42.493 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 130=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:42.529 INFO:tasks.rados.rados.0.smithi084.stdout:2336: finishing write tid 1 to smithi08477944-23 2024-03-30T12:30:42.529 INFO:tasks.rados.rados.0.smithi084.stdout:2337: finishing copy_from to smithi08477944-44 2024-03-30T12:30:42.529 INFO:tasks.rados.rados.0.smithi084.stdout:2337: got expected ENOENT (src dne) 2024-03-30T12:30:42.529 INFO:tasks.rados.rados.0.smithi084.stdout:2336: finishing write tid 2 to smithi08477944-23 2024-03-30T12:30:42.529 INFO:tasks.rados.rados.0.smithi084.stdout:2337: finishing copy_from racing read to smithi08477944-44 2024-03-30T12:30:42.529 INFO:tasks.rados.rados.0.smithi084.stdout:2336: finishing write tid 3 to smithi08477944-23 2024-03-30T12:30:42.529 INFO:tasks.rados.rados.0.smithi084.stdout:2336: oid 23 updating version 0 to 17511 2024-03-30T12:30:42.529 INFO:tasks.rados.rados.0.smithi084.stdout:2336: oid 23 updating version 17511 to 17512 2024-03-30T12:30:42.530 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 17512 (ObjNum 728 snap 244 seq_num 728) dirty exists 2024-03-30T12:30:42.530 INFO:tasks.rados.rados.0.smithi084.stdout:2336: left oid 23 (ObjNum 728 snap 244 seq_num 728) 2024-03-30T12:30:42.530 INFO:tasks.rados.rados.0.smithi084.stdout:2334: done (2 left) 2024-03-30T12:30:42.530 INFO:tasks.rados.rados.0.smithi084.stdout:2336: done (1 left) 2024-03-30T12:30:42.530 INFO:tasks.rados.rados.0.smithi084.stdout:2337: done (0 left) 2024-03-30T12:30:42.530 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 244 2024-03-30T12:30:42.530 INFO:tasks.rados.rados.0.smithi084.stdout:2338: seq_num 729 ranges {0=212992} 2024-03-30T12:30:42.530 INFO:tasks.rados.rados.0.smithi084.stdout:2338: writing smithi08477944-3 from 0 to 212992 tid 1 2024-03-30T12:30:42.530 INFO:tasks.rados.rados.0.smithi084.stdout:2339: snap_remove snap 242 2024-03-30T12:30:42.776 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:42.499+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:42.776 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:42.499+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 130=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:43.428 INFO:tasks.rados.rados.0.smithi084.stdout:2339: done (1 left) 2024-03-30T12:30:43.428 INFO:tasks.rados.rados.0.smithi084.stdout:2340: delete oid 10 current snap is 244 2024-03-30T12:30:43.428 INFO:tasks.rados.rados.0.smithi084.stdout:2338: finishing write tid 1 to smithi08477944-3 2024-03-30T12:30:43.428 INFO:tasks.rados.rados.0.smithi084.stdout:2338: finishing write tid 2 to smithi08477944-3 2024-03-30T12:30:43.428 INFO:tasks.rados.rados.0.smithi084.stdout:2338: finishing write tid 3 to smithi08477944-3 2024-03-30T12:30:43.428 INFO:tasks.rados.rados.0.smithi084.stdout:2338: oid 3 updating version 0 to 27187 2024-03-30T12:30:43.428 INFO:tasks.rados.rados.0.smithi084.stdout:2338: oid 3 version 27187 is already newer than 27186 2024-03-30T12:30:43.428 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 27187 (ObjNum 729 snap 244 seq_num 729) dirty exists 2024-03-30T12:30:43.428 INFO:tasks.rados.rados.0.smithi084.stdout:2338: left oid 3 (ObjNum 729 snap 244 seq_num 729) 2024-03-30T12:30:43.435 INFO:tasks.rados.rados.0.smithi084.stdout:2338: done (1 left) 2024-03-30T12:30:43.435 INFO:tasks.rados.rados.0.smithi084.stdout:2340: done (0 left) 2024-03-30T12:30:43.435 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 244 2024-03-30T12:30:43.435 INFO:tasks.rados.rados.0.smithi084.stdout:2341: seq_num 731 ranges {507904=245760} 2024-03-30T12:30:43.439 INFO:tasks.rados.rados.0.smithi084.stdout:2341: writing smithi08477944-43 from 507904 to 753664 tid 1 2024-03-30T12:30:43.439 INFO:tasks.rados.rados.0.smithi084.stdout:2342: snap_remove snap 227 2024-03-30T12:30:43.477 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:43.442+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:43.477 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:43.442+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:43.477 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:43.434+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:43.478 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:43.434+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:43.478 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:43.435+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:43.478 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:43.435+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:43.478 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:43.435+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:43.478 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:43.435+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:43.478 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:43.478 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:43.478 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:43.478 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 130=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:43.478 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[91810]: osdmap e556: 8 total, 8 up, 8 in 2024-03-30T12:30:43.479 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:43.479 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:43.479 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:43.479 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:43.479 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:43.479 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:43.479 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:43.479 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:43.479 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[91810]: pgmap v520: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 578 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 8.2 MiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-03-30T12:30:43.479 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:43.479 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:43.479 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:43.479 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 130=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:43.479 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[89279]: osdmap e556: 8 total, 8 up, 8 in 2024-03-30T12:30:43.480 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:43.480 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:43.480 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:43.480 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:43.480 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:43.480 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:43.480 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:43.480 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:43.480 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:43 smithi084 ceph-mon[89279]: pgmap v520: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 578 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 8.2 MiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-03-30T12:30:43.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:30:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:30:43.443+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:43.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:43.434+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:43.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:43.434+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:43.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:43.432+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:43.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:43.432+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:43.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:43.432+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:43.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:43.442+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:43.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:43.442+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:43.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:43.443+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:43.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:43.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:43.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:43.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 130=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:43.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:43 smithi162 ceph-mon[83709]: osdmap e556: 8 total, 8 up, 8 in 2024-03-30T12:30:43.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:43.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:43.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:43.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:43.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:43.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:43.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:43.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:43.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:43 smithi162 ceph-mon[83709]: pgmap v520: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 578 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 8.2 MiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-03-30T12:30:44.429 INFO:tasks.rados.rados.0.smithi084.stdout:2342: done (1 left) 2024-03-30T12:30:44.429 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 244 2024-03-30T12:30:44.430 INFO:tasks.rados.rados.0.smithi084.stdout:2343: seq_num 732 ranges {0=262144} 2024-03-30T12:30:44.431 INFO:tasks.rados.rados.0.smithi084.stdout:2343: writing smithi08477944-21 from 0 to 262144 tid 1 2024-03-30T12:30:44.431 INFO:tasks.rados.rados.0.smithi084.stdout:2344: rmattr oid 39 current snap is 244 2024-03-30T12:30:44.431 INFO:tasks.rados.rados.0.smithi084.stdout:2341: finishing write tid 1 to smithi08477944-43 2024-03-30T12:30:44.431 INFO:tasks.rados.rados.0.smithi084.stdout:2341: finishing write tid 2 to smithi08477944-43 2024-03-30T12:30:44.431 INFO:tasks.rados.rados.0.smithi084.stdout:2341: finishing write tid 3 to smithi08477944-43 2024-03-30T12:30:44.431 INFO:tasks.rados.rados.0.smithi084.stdout:2341: oid 43 updating version 0 to 36216 2024-03-30T12:30:44.431 INFO:tasks.rados.rados.0.smithi084.stdout:2341: oid 43 updating version 36216 to 36217 2024-03-30T12:30:44.431 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 36217 (ObjNum 731 snap 244 seq_num 731) dirty exists 2024-03-30T12:30:44.431 INFO:tasks.rados.rados.0.smithi084.stdout:2341: left oid 43 (ObjNum 731 snap 244 seq_num 731) 2024-03-30T12:30:44.432 INFO:tasks.rados.rados.0.smithi084.stdout:2341: done (2 left) 2024-03-30T12:30:44.432 INFO:tasks.rados.rados.0.smithi084.stdout:2345: snap_remove snap 224 2024-03-30T12:30:44.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:44.442+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:44.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:44.443+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:44.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:44.436+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:44.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:44.436+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:44.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:44.436+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:44.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:44.436+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:44.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:44.436+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:44.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:44.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:44.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:44.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 130=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:44.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:44.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:44.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:44.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:44.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:44.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:44.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[91810]: osdmap e557: 8 total, 8 up, 8 in 2024-03-30T12:30:44.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:44.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:44.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:44.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:44.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:44.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:44.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 130=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:44.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:44.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:44.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:44.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:44.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:44.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:44.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[89279]: osdmap e557: 8 total, 8 up, 8 in 2024-03-30T12:30:44.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:44.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:44.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:44.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:44.434+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:44.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:44.434+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:44.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:44.436+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:44.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:44.436+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:44.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:44.439+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:44.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:44.439+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:44.620 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:30:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:30:44.444+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:44.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:44.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:44.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:44.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 130=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:44.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:44.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:44.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:44.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:44.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:44.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:44.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:44 smithi162 ceph-mon[83709]: osdmap e557: 8 total, 8 up, 8 in 2024-03-30T12:30:44.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:44.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:44.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:45.436 INFO:tasks.rados.rados.0.smithi084.stdout:2345: done (2 left) 2024-03-30T12:30:45.436 INFO:tasks.rados.rados.0.smithi084.stdout:2346: snap_remove snap 231 2024-03-30T12:30:45.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:45.443+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:45.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:45.443+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:45.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:45.449+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:45.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:45.449+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:45.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:45.449+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:45.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:45.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:45.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:45.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:45.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:45.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:45.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:30:45.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:30:45.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:45.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:30:45.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:45.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:45.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:45.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:45.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds ok-to-stop", "ids": ["b"]}]: dispatch 2024-03-30T12:30:45.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: Upgrade: It appears safe to stop mds.b 2024-03-30T12:30:45.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: osdmap e558: 8 total, 8 up, 8 in 2024-03-30T12:30:45.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:45.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:45.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:45.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:45.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:45.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:45.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:45.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:45.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:45.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: pgmap v523: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 576 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 MiB/s wr, 12 op/s 2024-03-30T12:30:45.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:30:45.623 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:45.441+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:45.623 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:45.441+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:45.623 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:45.441+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:45.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:45.449+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:45.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:45.449+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:45.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:45.443+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:45.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:45.443+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:45.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:45.444+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:45.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:45.444+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:45.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:45.444+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:45.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:45.444+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:45.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:45.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:45.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:45.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:45.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:45.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:45.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:30:45.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:30:45.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:45.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:30:45.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds ok-to-stop", "ids": ["b"]}]: dispatch 2024-03-30T12:30:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: Upgrade: It appears safe to stop mds.b 2024-03-30T12:30:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: osdmap e558: 8 total, 8 up, 8 in 2024-03-30T12:30:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:45.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: pgmap v523: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 576 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 MiB/s wr, 12 op/s 2024-03-30T12:30:45.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:30:45.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:45.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:45.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:45.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:45.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:45.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:45.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:30:45.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:30:45.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:45.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:30:45.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:45.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:45.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:45.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:30:45.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds ok-to-stop", "ids": ["b"]}]: dispatch 2024-03-30T12:30:45.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: Upgrade: It appears safe to stop mds.b 2024-03-30T12:30:45.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: osdmap e558: 8 total, 8 up, 8 in 2024-03-30T12:30:45.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:45.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:45.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:45.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:45.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:45.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:45.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:45.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:45.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:45.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: pgmap v523: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 576 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 MiB/s wr, 12 op/s 2024-03-30T12:30:45.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:30:46.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:30:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:30:45.841+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:46.438 INFO:tasks.rados.rados.0.smithi084.stdout:2346: done (2 left) 2024-03-30T12:30:46.438 INFO:tasks.rados.rados.0.smithi084.stdout:2347: rmattr oid 29 current snap is 244 2024-03-30T12:30:46.438 INFO:tasks.rados.rados.0.smithi084.stdout:2347: done (2 left) 2024-03-30T12:30:46.438 INFO:tasks.rados.rados.0.smithi084.stdout:2348: read oid 11 snap -1 2024-03-30T12:30:46.438 INFO:tasks.rados.rados.0.smithi084.stdout:2348: expect (ObjNum 707 snap 242 seq_num 707) 2024-03-30T12:30:46.438 INFO:tasks.rados.rados.0.smithi084.stdout:2349: read oid 41 snap -1 2024-03-30T12:30:46.438 INFO:tasks.rados.rados.0.smithi084.stdout:2349: expect (ObjNum 688 snap 241 seq_num 688) 2024-03-30T12:30:46.438 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 244 2024-03-30T12:30:46.438 INFO:tasks.rados.rados.0.smithi084.stdout:2350: seq_num 733 ranges {2400256=278528} 2024-03-30T12:30:46.452 INFO:tasks.rados.rados.0.smithi084.stdout:2350: writing smithi08477944-18 from 2400256 to 2678784 tid 1 2024-03-30T12:30:46.452 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 244 2024-03-30T12:30:46.452 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 17514 (ObjNum 673 snap 238 seq_num 673) dirty exists 2024-03-30T12:30:46.452 INFO:tasks.rados.rados.0.smithi084.stdout:2343: finishing write tid 1 to smithi08477944-21 2024-03-30T12:30:46.452 INFO:tasks.rados.rados.0.smithi084.stdout:2343: finishing write tid 2 to smithi08477944-21 2024-03-30T12:30:46.452 INFO:tasks.rados.rados.0.smithi084.stdout:2351: seq_num 734 ranges {0=294912} 2024-03-30T12:30:46.453 INFO:tasks.rados.rados.0.smithi084.stdout:2351: writing smithi08477944-7 from 0 to 294912 tid 1 2024-03-30T12:30:46.454 INFO:tasks.rados.rados.0.smithi084.stdout:2344: done (5 left) 2024-03-30T12:30:46.454 INFO:tasks.rados.rados.0.smithi084.stdout:2352: snap_remove snap 237 2024-03-30T12:30:46.619 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:46.443+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:46.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:46.444+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:46.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:46.445+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:46.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:46.445+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:46.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:46.456+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:46.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:46.456+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:46.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:46.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:46.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:46.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:46.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:46.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:46.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:46.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:46.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:46 smithi162 ceph-mon[83709]: osdmap e559: 8 total, 8 up, 8 in 2024-03-30T12:30:46.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:46.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:46.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:46.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:46.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:46.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:46 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:46.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:46 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-30T12:30:46.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:46 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:30:46.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:46.452+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:46.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:46.453+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:46.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:46.449+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:46.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:46.449+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:46.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:46.452+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:46.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:46.452+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:46.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:46.452+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:46.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:46.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:46.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:46.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:46.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:46.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:46.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:46.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:46.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[89279]: osdmap e559: 8 total, 8 up, 8 in 2024-03-30T12:30:46.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:46.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:46.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:46.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:46.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:46.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:46.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-30T12:30:46.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:30:46.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:46.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:46.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:46.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:46.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:46.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:46.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:46.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:46.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[91810]: osdmap e559: 8 total, 8 up, 8 in 2024-03-30T12:30:46.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:46.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:46.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:46.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:46.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:46.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:46.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-30T12:30:46.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:46 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:30:46.905 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:30:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:30:46.827+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:47.440 INFO:tasks.rados.rados.0.smithi084.stdout:2343: finishing write tid 3 to smithi08477944-21 2024-03-30T12:30:47.440 INFO:tasks.rados.rados.0.smithi084.stdout:2343: oid 21 updating version 0 to 25288 2024-03-30T12:30:47.441 INFO:tasks.rados.rados.0.smithi084.stdout:2343: oid 21 version 25288 is already newer than 25287 2024-03-30T12:30:47.441 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 25288 (ObjNum 732 snap 244 seq_num 732) dirty exists 2024-03-30T12:30:47.441 INFO:tasks.rados.rados.0.smithi084.stdout:2343: left oid 21 (ObjNum 732 snap 244 seq_num 732) 2024-03-30T12:30:47.441 INFO:tasks.rados.rados.0.smithi084.stdout:2348: expect (ObjNum 707 snap 242 seq_num 707) 2024-03-30T12:30:47.500 INFO:tasks.rados.rados.0.smithi084.stdout:2351: finishing write tid 1 to smithi08477944-7 2024-03-30T12:30:47.500 INFO:tasks.rados.rados.0.smithi084.stdout:2351: finishing write tid 2 to smithi08477944-7 2024-03-30T12:30:47.500 INFO:tasks.rados.rados.0.smithi084.stdout:2350: finishing write tid 1 to smithi08477944-18 2024-03-30T12:30:47.500 INFO:tasks.rados.rados.0.smithi084.stdout:2350: finishing write tid 2 to smithi08477944-18 2024-03-30T12:30:47.500 INFO:tasks.rados.rados.0.smithi084.stdout:2351: finishing write tid 3 to smithi08477944-7 2024-03-30T12:30:47.500 INFO:tasks.rados.rados.0.smithi084.stdout:2351: oid 7 updating version 0 to 17516 2024-03-30T12:30:47.500 INFO:tasks.rados.rados.0.smithi084.stdout:2351: oid 7 version 17516 is already newer than 17515 2024-03-30T12:30:47.500 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 17516 (ObjNum 734 snap 244 seq_num 734) dirty exists 2024-03-30T12:30:47.500 INFO:tasks.rados.rados.0.smithi084.stdout:2351: left oid 7 (ObjNum 734 snap 244 seq_num 734) 2024-03-30T12:30:47.500 INFO:tasks.rados.rados.0.smithi084.stdout:2349: expect (ObjNum 688 snap 241 seq_num 688) 2024-03-30T12:30:47.525 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:47.452+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:47.526 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:47.452+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:47.526 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:47.452+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:47.526 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:47.526 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:47.526 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:47.526 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:47.526 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-mon[83709]: Upgrade: Updating mds.b 2024-03-30T12:30:47.526 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-mon[83709]: Deploying daemon mds.b on smithi162 2024-03-30T12:30:47.527 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-mon[83709]: osdmap e560: 8 total, 8 up, 8 in 2024-03-30T12:30:47.527 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:47.527 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:47.527 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:47.527 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:47.527 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:47.527 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:47.527 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:47.527 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:47.527 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-mon[83709]: pgmap v526: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 577 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1.3 MiB/s rd, 188 KiB/s wr, 16 op/s 2024-03-30T12:30:47.527 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:47.528 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:47.449+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:47.528 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:47.449+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:47.528 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:47.450+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:47.609 INFO:tasks.rados.rados.0.smithi084.stdout:2350: finishing write tid 3 to smithi08477944-18 2024-03-30T12:30:47.609 INFO:tasks.rados.rados.0.smithi084.stdout:2350: oid 18 updating version 0 to 1006 2024-03-30T12:30:47.609 INFO:tasks.rados.rados.0.smithi084.stdout:2350: oid 18 updating version 1006 to 1007 2024-03-30T12:30:47.609 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1007 (ObjNum 733 snap 244 seq_num 733) dirty exists 2024-03-30T12:30:47.609 INFO:tasks.rados.rados.0.smithi084.stdout:2350: left oid 18 (ObjNum 733 snap 244 seq_num 733) 2024-03-30T12:30:47.610 INFO:tasks.rados.rados.0.smithi084.stdout:2343: done (5 left) 2024-03-30T12:30:47.610 INFO:tasks.rados.rados.0.smithi084.stdout:2348: done (4 left) 2024-03-30T12:30:47.610 INFO:tasks.rados.rados.0.smithi084.stdout:2349: done (3 left) 2024-03-30T12:30:47.610 INFO:tasks.rados.rados.0.smithi084.stdout:2350: done (2 left) 2024-03-30T12:30:47.610 INFO:tasks.rados.rados.0.smithi084.stdout:2351: done (1 left) 2024-03-30T12:30:47.610 INFO:tasks.rados.rados.0.smithi084.stdout:2352: done (0 left) 2024-03-30T12:30:47.610 INFO:tasks.rados.rados.0.smithi084.stdout:2353: copy_from oid 34 from oid 39 current snap is 244 2024-03-30T12:30:47.610 INFO:tasks.rados.rados.0.smithi084.stdout:2354: snap_remove snap 243 2024-03-30T12:30:47.646 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:47.454+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:47.646 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:47.454+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:47.647 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:47.448+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:47.647 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:47.448+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:47.647 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:47.449+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:47.647 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:47.449+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:47.647 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:47.449+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:47.647 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:47.451+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:47.648 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:47.648 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:47.648 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:47.648 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:47.648 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[89279]: Upgrade: Updating mds.b 2024-03-30T12:30:47.648 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[89279]: Deploying daemon mds.b on smithi162 2024-03-30T12:30:47.648 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[89279]: osdmap e560: 8 total, 8 up, 8 in 2024-03-30T12:30:47.648 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:47.648 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:47.648 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:47.648 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:47.649 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:47.649 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:47.649 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:47.649 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:47.649 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[89279]: pgmap v526: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 577 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1.3 MiB/s rd, 188 KiB/s wr, 16 op/s 2024-03-30T12:30:47.649 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:47.649 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:47.649 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:47.649 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:47.649 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:47.650 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[91810]: Upgrade: Updating mds.b 2024-03-30T12:30:47.650 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[91810]: Deploying daemon mds.b on smithi162 2024-03-30T12:30:47.650 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[91810]: osdmap e560: 8 total, 8 up, 8 in 2024-03-30T12:30:47.650 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:47.650 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:47.650 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:47.650 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:47.650 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12e=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:47.650 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:47.650 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:47.650 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:47.651 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[91810]: pgmap v526: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 577 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 1.3 MiB/s rd, 188 KiB/s wr, 16 op/s 2024-03-30T12:30:47.651 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:47.816 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:30:47.634+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:47.816 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:47.621+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:47.816 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:47.621+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:48.070 INFO:tasks.rados.rados.0.smithi084.stdout:2354: done (1 left) 2024-03-30T12:30:48.071 INFO:tasks.rados.rados.0.smithi084.stdout:2355: copy_from oid 5 from oid 16 current snap is 244 2024-03-30T12:30:48.071 INFO:tasks.rados.rados.0.smithi084.stdout:2353: finishing copy_from racing read to smithi08477944-34 2024-03-30T12:30:48.071 INFO:tasks.rados.rados.0.smithi084.stdout:2353: finishing copy_from to smithi08477944-34 2024-03-30T12:30:48.071 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 17514 (ObjNum 673 snap 238 seq_num 673) dirty exists 2024-03-30T12:30:48.071 INFO:tasks.rados.rados.0.smithi084.stdout:2353: done (1 left) 2024-03-30T12:30:48.071 INFO:tasks.rados.rados.0.smithi084.stdout:2356: read oid 18 snap -1 2024-03-30T12:30:48.071 INFO:tasks.rados.rados.0.smithi084.stdout:2356: expect (ObjNum 733 snap 244 seq_num 733) 2024-03-30T12:30:48.071 INFO:tasks.rados.rados.0.smithi084.stdout:2357: rmattr oid 1 current snap is 244 2024-03-30T12:30:48.071 INFO:tasks.rados.rados.0.smithi084.stdout:2357: done (2 left) 2024-03-30T12:30:48.071 INFO:tasks.rados.rados.0.smithi084.stdout:2358: read oid 20 snap 230 2024-03-30T12:30:48.071 INFO:tasks.rados.rados.0.smithi084.stdout:2358: expect (ObjNum 565 snap 194 seq_num 565) 2024-03-30T12:30:48.072 INFO:tasks.rados.rados.0.smithi084.stdout:2359: rmattr oid 21 current snap is 244 2024-03-30T12:30:48.072 INFO:tasks.rados.rados.0.smithi084.stdout:2359: done (3 left) 2024-03-30T12:30:48.072 INFO:tasks.rados.rados.0.smithi084.stdout:2360: copy_from oid 13 from oid 33 current snap is 244 2024-03-30T12:30:48.072 INFO:tasks.rados.rados.0.smithi084.stdout:2361: rmattr oid 28 current snap is 244 2024-03-30T12:30:48.072 INFO:tasks.rados.rados.0.smithi084.stdout:2361: done (4 left) 2024-03-30T12:30:48.072 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 46 current snap is 244 2024-03-30T12:30:48.072 INFO:tasks.rados.rados.0.smithi084.stdout:2362: seq_num 735 ranges {11436032=311296} 2024-03-30T12:30:48.072 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:30:47 smithi162 systemd[1]: Stopping Ceph mds.b for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:30:48.072 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-b[56700]: 2024-03-30T12:30:48.072+0000 7f4c56f76700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:30:48.073 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-b[56700]: 2024-03-30T12:30:48.072+0000 7f4c56f76700 -1 mds.b *** got signal Terminated *** 2024-03-30T12:30:48.135 INFO:tasks.rados.rados.0.smithi084.stdout:2362: writing smithi08477944-46 from 11436032 to 11747328 tid 1 2024-03-30T12:30:48.135 INFO:tasks.rados.rados.0.smithi084.stdout:2363: delete oid 21 current snap is 244 2024-03-30T12:30:48.135 INFO:tasks.rados.rados.0.smithi084.stdout:2356: expect (ObjNum 733 snap 244 seq_num 733) 2024-03-30T12:30:48.314 INFO:tasks.rados.rados.0.smithi084.stdout:2355: finishing copy_from racing read to smithi08477944-5 2024-03-30T12:30:48.314 INFO:tasks.rados.rados.0.smithi084.stdout:2358: expect (ObjNum 565 snap 194 seq_num 565) 2024-03-30T12:30:48.345 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:48.078+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:48.345 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:48.080+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:48.346 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:48.077+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:48.346 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:48.077+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:48.346 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:48.078+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:48.346 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:48.078+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:48.346 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:48.078+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:48.346 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:30:48.073+0000 7f10ffcf7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-30T12:30:48.347 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:48.347 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:48.347 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:48.347 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:48.347 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:48.347 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[89279]: osdmap e561: 8 total, 8 up, 8 in 2024-03-30T12:30:48.347 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:48.347 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:48.347 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:48.347 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:48.347 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:48.347 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:48.347 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:48.348 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:48.348 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[89279]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-30T12:30:48.348 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[89279]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-30T12:30:48.348 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[89279]: osdmap e562: 8 total, 8 up, 8 in 2024-03-30T12:30:48.348 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[89279]: Standby daemon mds.a assigned to filesystem cephfs as rank 0 2024-03-30T12:30:48.348 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[89279]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-30T12:30:48.348 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[89279]: fsmap cephfs:0/1 1 up:standby, 1 failed 2024-03-30T12:30:48.348 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[89279]: fsmap cephfs:1/1 {0=a=up:replay} 2024-03-30T12:30:48.348 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:48.348 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:48.348 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:48.348 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:48.349 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:48.349 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[91810]: osdmap e561: 8 total, 8 up, 8 in 2024-03-30T12:30:48.349 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:48.349 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:48.349 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:48.349 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:48.349 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:48.349 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:48.349 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:48.349 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:48.349 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[91810]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-30T12:30:48.349 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[91810]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-30T12:30:48.349 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[91810]: osdmap e562: 8 total, 8 up, 8 in 2024-03-30T12:30:48.349 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[91810]: Standby daemon mds.a assigned to filesystem cephfs as rank 0 2024-03-30T12:30:48.349 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[91810]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-30T12:30:48.350 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[91810]: fsmap cephfs:0/1 1 up:standby, 1 failed 2024-03-30T12:30:48.350 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:48 smithi084 ceph-mon[91810]: fsmap cephfs:1/1 {0=a=up:replay} 2024-03-30T12:30:48.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:30:48.090+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:48.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:48.082+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:48.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:48.083+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:48.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:48.081+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:48.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:48.082+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:48.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:48.077+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:48.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:48.077+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:48.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:48.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:48.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:48.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:48.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:48.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-mon[83709]: osdmap e561: 8 total, 8 up, 8 in 2024-03-30T12:30:48.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:48.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:48.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:48.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:48.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:48.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:48.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:48.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:48.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-mon[83709]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-30T12:30:48.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-mon[83709]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-30T12:30:48.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-mon[83709]: osdmap e562: 8 total, 8 up, 8 in 2024-03-30T12:30:48.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-mon[83709]: Standby daemon mds.a assigned to filesystem cephfs as rank 0 2024-03-30T12:30:48.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-mon[83709]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-30T12:30:48.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-mon[83709]: fsmap cephfs:0/1 1 up:standby, 1 failed 2024-03-30T12:30:48.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:48 smithi162 ceph-mon[83709]: fsmap cephfs:1/1 {0=a=up:replay} 2024-03-30T12:30:48.816 INFO:tasks.rados.rados.0.smithi084.stdout:2355: finishing copy_from to smithi08477944-5 2024-03-30T12:30:48.816 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 994 (ObjNum 395 snap 125 seq_num 395) dirty exists 2024-03-30T12:30:48.816 INFO:tasks.rados.rados.0.smithi084.stdout:2360: finishing copy_from racing read to smithi08477944-13 2024-03-30T12:30:48.816 INFO:tasks.rados.rados.0.smithi084.stdout:2360: finishing copy_from to smithi08477944-13 2024-03-30T12:30:48.816 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 17488 (ObjNum 498 snap 156 seq_num 498) dirty exists 2024-03-30T12:30:48.816 INFO:tasks.rados.rados.0.smithi084.stdout:2355: done (5 left) 2024-03-30T12:30:48.816 INFO:tasks.rados.rados.0.smithi084.stdout:2356: done (4 left) 2024-03-30T12:30:48.816 INFO:tasks.rados.rados.0.smithi084.stdout:2358: done (3 left) 2024-03-30T12:30:48.817 INFO:tasks.rados.rados.0.smithi084.stdout:2360: done (2 left) 2024-03-30T12:30:48.817 INFO:tasks.rados.rados.0.smithi084.stdout:2363: done (1 left) 2024-03-30T12:30:48.817 INFO:tasks.rados.rados.0.smithi084.stdout:2364: snap_remove snap 236 2024-03-30T12:30:49.299 INFO:tasks.rados.rados.0.smithi084.stdout:2364: done (1 left) 2024-03-30T12:30:49.299 INFO:tasks.rados.rados.0.smithi084.stdout:2365: read oid 39 snap -1 2024-03-30T12:30:49.299 INFO:tasks.rados.rados.0.smithi084.stdout:2365: expect (ObjNum 673 snap 238 seq_num 673) 2024-03-30T12:30:49.300 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 244 2024-03-30T12:30:49.300 INFO:tasks.rados.rados.0.smithi084.stdout:2362: finishing write tid 1 to smithi08477944-46 2024-03-30T12:30:49.300 INFO:tasks.rados.rados.0.smithi084.stdout:2362: finishing write tid 2 to smithi08477944-46 2024-03-30T12:30:49.300 INFO:tasks.rados.rados.0.smithi084.stdout:2362: finishing write tid 3 to smithi08477944-46 2024-03-30T12:30:49.300 INFO:tasks.rados.rados.0.smithi084.stdout:2362: oid 46 updating version 0 to 27189 2024-03-30T12:30:49.300 INFO:tasks.rados.rados.0.smithi084.stdout:2362: oid 46 updating version 27189 to 27190 2024-03-30T12:30:49.300 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 27190 (ObjNum 735 snap 244 seq_num 735) dirty exists 2024-03-30T12:30:49.300 INFO:tasks.rados.rados.0.smithi084.stdout:2362: left oid 46 (ObjNum 735 snap 244 seq_num 735) 2024-03-30T12:30:49.300 INFO:tasks.rados.rados.0.smithi084.stdout:2366: seq_num 737 ranges {3399680=352256} 2024-03-30T12:30:49.320 INFO:tasks.rados.rados.0.smithi084.stdout:2366: writing smithi08477944-6 from 3399680 to 3751936 tid 1 2024-03-30T12:30:49.320 INFO:tasks.rados.rados.0.smithi084.stdout:2362: done (2 left) 2024-03-30T12:30:49.320 INFO:tasks.rados.rados.0.smithi084.stdout:2367: setattr oid 14 current snap is 244 2024-03-30T12:30:49.320 INFO:tasks.rados.rados.0.smithi084.stdout:2365: expect (ObjNum 673 snap 238 seq_num 673) 2024-03-30T12:30:49.399 INFO:tasks.rados.rados.0.smithi084.stdout:2366: finishing write tid 1 to smithi08477944-6 2024-03-30T12:30:49.399 INFO:tasks.rados.rados.0.smithi084.stdout:2366: finishing write tid 2 to smithi08477944-6 2024-03-30T12:30:49.399 INFO:tasks.rados.rados.0.smithi084.stdout:2366: finishing write tid 3 to smithi08477944-6 2024-03-30T12:30:49.399 INFO:tasks.rados.rados.0.smithi084.stdout:2366: oid 6 updating version 0 to 36220 2024-03-30T12:30:49.399 INFO:tasks.rados.rados.0.smithi084.stdout:2366: oid 6 version 36220 is already newer than 36219 2024-03-30T12:30:49.399 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 36220 (ObjNum 737 snap 244 seq_num 737) dirty exists 2024-03-30T12:30:49.399 INFO:tasks.rados.rados.0.smithi084.stdout:2366: left oid 6 (ObjNum 737 snap 244 seq_num 737) 2024-03-30T12:30:49.399 INFO:tasks.rados.rados.0.smithi084.stdout:2365: done (2 left) 2024-03-30T12:30:49.399 INFO:tasks.rados.rados.0.smithi084.stdout:2366: done (1 left) 2024-03-30T12:30:49.399 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 244 2024-03-30T12:30:49.399 INFO:tasks.rados.rados.0.smithi084.stdout:2368: seq_num 738 ranges {5685248=368640} 2024-03-30T12:30:49.431 INFO:tasks.rados.rados.0.smithi084.stdout:2368: writing smithi08477944-26 from 5685248 to 6053888 tid 1 2024-03-30T12:30:49.431 INFO:tasks.rados.rados.0.smithi084.stdout:2369: copy_from oid 40 from oid 38 current snap is 244 2024-03-30T12:30:49.431 INFO:tasks.rados.rados.0.smithi084.stdout:2370: read oid 33 snap -1 2024-03-30T12:30:49.431 INFO:tasks.rados.rados.0.smithi084.stdout:2370: expect (ObjNum 498 snap 156 seq_num 498) 2024-03-30T12:30:49.431 INFO:tasks.rados.rados.0.smithi084.stdout:2371: read oid 4 snap -1 2024-03-30T12:30:49.432 INFO:tasks.rados.rados.0.smithi084.stdout:2371: expect (ObjNum 662 snap 232 seq_num 662) 2024-03-30T12:30:49.432 INFO:tasks.rados.rados.0.smithi084.stdout:2372: copy_from oid 46 from oid 24 current snap is 244 2024-03-30T12:30:49.432 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 23398 (ObjNum 49 snap 0 seq_num 1953066355) dirty exists 2024-03-30T12:30:49.432 INFO:tasks.rados.rados.0.smithi084.stdout:2367: done (5 left) 2024-03-30T12:30:49.432 INFO:tasks.rados.rados.0.smithi084.stdout:2373: read oid 16 snap -1 2024-03-30T12:30:49.432 INFO:tasks.rados.rados.0.smithi084.stdout:2373: expect (ObjNum 395 snap 125 seq_num 395) 2024-03-30T12:30:49.432 INFO:tasks.rados.rados.0.smithi084.stdout:2374: snap_create 2024-03-30T12:30:49.437 INFO:tasks.rados.rados.0.smithi084.stdout:2370: expect (ObjNum 498 snap 156 seq_num 498) 2024-03-30T12:30:49.472 INFO:tasks.rados.rados.0.smithi084.stdout:2368: finishing write tid 1 to smithi08477944-26 2024-03-30T12:30:49.472 INFO:tasks.rados.rados.0.smithi084.stdout:2372: finishing copy_from to smithi08477944-46 2024-03-30T12:30:49.472 INFO:tasks.rados.rados.0.smithi084.stdout:2372: got expected ENOENT (src dne) 2024-03-30T12:30:49.472 INFO:tasks.rados.rados.0.smithi084.stdout:2372: finishing copy_from racing read to smithi08477944-46 2024-03-30T12:30:49.472 INFO:tasks.rados.rados.0.smithi084.stdout:2368: finishing write tid 2 to smithi08477944-26 2024-03-30T12:30:49.472 INFO:tasks.rados.rados.0.smithi084.stdout:2368: finishing write tid 3 to smithi08477944-26 2024-03-30T12:30:49.472 INFO:tasks.rados.rados.0.smithi084.stdout:2368: oid 26 updating version 0 to 27192 2024-03-30T12:30:49.472 INFO:tasks.rados.rados.0.smithi084.stdout:2368: oid 26 version 27192 is already newer than 27191 2024-03-30T12:30:49.472 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 27192 (ObjNum 738 snap 244 seq_num 738) dirty exists 2024-03-30T12:30:49.472 INFO:tasks.rados.rados.0.smithi084.stdout:2368: left oid 26 (ObjNum 738 snap 244 seq_num 738) 2024-03-30T12:30:49.472 INFO:tasks.rados.rados.0.smithi084.stdout:2373: expect (ObjNum 395 snap 125 seq_num 395) 2024-03-30T12:30:49.538 INFO:tasks.rados.rados.0.smithi084.stdout:2371: expect (ObjNum 662 snap 232 seq_num 662) 2024-03-30T12:30:49.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:30:49.319+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:49.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:49.307+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:49.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:49.308+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:49.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:49.306+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:49.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:49.306+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:49.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:49.306+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:49.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:49.310+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:49.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:49.310+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:49.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:49.310+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:49.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:49.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:49.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:49.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:49.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:49.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:49.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:49.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:49.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:49.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:49.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:49.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:49.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:49.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:49.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:49.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:49.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:49.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-mon[83709]: pgmap v529: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 578 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 12 MiB/s rd, 364 KiB/s wr, 14 op/s 2024-03-30T12:30:49.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-mon[83709]: mds.? [v2:172.21.15.84:6834/3803840215,v1:172.21.15.84:6835/3803840215] up:reconnect 2024-03-30T12:30:49.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:49 smithi162 ceph-mon[83709]: fsmap cephfs:1/1 {0=a=up:reconnect} 2024-03-30T12:30:49.655 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:30:49] "GET /metrics HTTP/1.1" 200 36326 "" "Prometheus/2.43.0" 2024-03-30T12:30:49.655 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:49.312+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:49.655 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:49.320+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:49.655 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:49.306+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:49.655 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:49.306+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:49.655 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:49.306+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:49.656 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:49.306+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:49.656 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:49.306+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:49.656 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:49.306+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:49.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:49.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:49.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:49.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:49.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:49.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:49.658 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:49.658 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:49.658 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:49.658 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:49.658 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:49.658 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:49.658 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:49.658 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:49.658 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:49.658 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:49.658 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:49.659 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[91810]: pgmap v529: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 578 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 12 MiB/s rd, 364 KiB/s wr, 14 op/s 2024-03-30T12:30:49.659 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[91810]: mds.? [v2:172.21.15.84:6834/3803840215,v1:172.21.15.84:6835/3803840215] up:reconnect 2024-03-30T12:30:49.659 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[91810]: fsmap cephfs:1/1 {0=a=up:reconnect} 2024-03-30T12:30:49.659 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:49.659 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:49.659 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:49.659 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:49.659 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:49.659 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:49.660 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:49.660 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:49.660 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:49.660 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:49.660 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:49.660 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:49.660 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:49.660 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 126=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:49.660 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 130=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:49.660 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:49.660 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:49.660 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[89279]: pgmap v529: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 578 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 12 MiB/s rd, 364 KiB/s wr, 14 op/s 2024-03-30T12:30:49.660 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[89279]: mds.? [v2:172.21.15.84:6834/3803840215,v1:172.21.15.84:6835/3803840215] up:reconnect 2024-03-30T12:30:49.660 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-mon[89279]: fsmap cephfs:1/1 {0=a=up:reconnect} 2024-03-30T12:30:49.682 INFO:tasks.rados.rados.0.smithi084.stdout:2369: finishing copy_from racing read to smithi08477944-40 2024-03-30T12:30:49.682 INFO:tasks.rados.rados.0.smithi084.stdout:2369: finishing copy_from to smithi08477944-40 2024-03-30T12:30:49.682 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 1032 (ObjNum 711 snap 242 seq_num 711) dirty exists 2024-03-30T12:30:49.917 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:30:49.696+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : Health check update: Possible data damage: 13 pgs snaptrim_error (PG_DAMAGED) 2024-03-30T12:30:50.304 INFO:tasks.rados.rados.0.smithi084.stdout:2368: done (6 left) 2024-03-30T12:30:50.305 INFO:tasks.rados.rados.0.smithi084.stdout:2369: done (5 left) 2024-03-30T12:30:50.305 INFO:tasks.rados.rados.0.smithi084.stdout:2370: done (4 left) 2024-03-30T12:30:50.305 INFO:tasks.rados.rados.0.smithi084.stdout:2371: done (3 left) 2024-03-30T12:30:50.305 INFO:tasks.rados.rados.0.smithi084.stdout:2372: done (2 left) 2024-03-30T12:30:50.305 INFO:tasks.rados.rados.0.smithi084.stdout:2373: done (1 left) 2024-03-30T12:30:50.305 INFO:tasks.rados.rados.0.smithi084.stdout:2374: done (0 left) 2024-03-30T12:30:50.306 INFO:tasks.rados.rados.0.smithi084.stdout:2375: copy_from oid 2 from oid 19 current snap is 245 2024-03-30T12:30:50.306 INFO:tasks.rados.rados.0.smithi084.stdout:2376: snap_create 2024-03-30T12:30:50.308 INFO:tasks.rados.rados.0.smithi084.stdout:2375: finishing copy_from to smithi08477944-2 2024-03-30T12:30:50.309 INFO:tasks.rados.rados.0.smithi084.stdout:2375: got expected ENOENT (src dne) 2024-03-30T12:30:50.309 INFO:tasks.rados.rados.0.smithi084.stdout:2375: finishing copy_from racing read to smithi08477944-2 2024-03-30T12:30:50.619 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:50.313+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:50.619 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:50.313+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:50.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:50.316+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:50.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:50.317+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:50.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:50.314+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:50.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:50.314+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:50.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:50.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:50.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:50.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:50.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:50.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:50.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:50 smithi162 ceph-mon[83709]: osdmap e563: 8 total, 8 up, 8 in 2024-03-30T12:30:50.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:50.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:50.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:50.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:50.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:50.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:50.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:50.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:50 smithi162 ceph-mon[83709]: Health check update: Possible data damage: 13 pgs snaptrim_error (PG_DAMAGED) 2024-03-30T12:30:50.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:50 smithi162 ceph-mon[83709]: mds.? [v2:172.21.15.84:6834/3803840215,v1:172.21.15.84:6835/3803840215] up:rejoin 2024-03-30T12:30:50.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:50 smithi162 ceph-mon[83709]: fsmap cephfs:1/1 {0=a=up:rejoin} 2024-03-30T12:30:50.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:50 smithi162 ceph-mon[83709]: daemon mds.a is now active in filesystem cephfs as rank 0 2024-03-30T12:30:50.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:50.311+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:50.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:50.311+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:50.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:50.311+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:50.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:50.312+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:50.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:50.312+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:50.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:50.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:50.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:50.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:50.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:50.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:50.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[91810]: osdmap e563: 8 total, 8 up, 8 in 2024-03-30T12:30:50.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:50.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:50.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:50.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:50.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:50.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:50.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:50.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[91810]: Health check update: Possible data damage: 13 pgs snaptrim_error (PG_DAMAGED) 2024-03-30T12:30:50.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[91810]: mds.? [v2:172.21.15.84:6834/3803840215,v1:172.21.15.84:6835/3803840215] up:rejoin 2024-03-30T12:30:50.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[91810]: fsmap cephfs:1/1 {0=a=up:rejoin} 2024-03-30T12:30:50.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[91810]: daemon mds.a is now active in filesystem cephfs as rank 0 2024-03-30T12:30:50.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:50.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:50.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:50.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:50.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 109=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:50.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:50.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[89279]: osdmap e563: 8 total, 8 up, 8 in 2024-03-30T12:30:50.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:50.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:50.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:50.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:50.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:50.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:50.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:50.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[89279]: Health check update: Possible data damage: 13 pgs snaptrim_error (PG_DAMAGED) 2024-03-30T12:30:50.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[89279]: mds.? [v2:172.21.15.84:6834/3803840215,v1:172.21.15.84:6835/3803840215] up:rejoin 2024-03-30T12:30:50.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[89279]: fsmap cephfs:1/1 {0=a=up:rejoin} 2024-03-30T12:30:50.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:50 smithi084 ceph-mon[89279]: daemon mds.a is now active in filesystem cephfs as rank 0 2024-03-30T12:30:51.162 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:51.089+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:51.163 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:51.089+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:51.309 INFO:tasks.rados.rados.0.smithi084.stdout:2375: done (1 left) 2024-03-30T12:30:51.309 INFO:tasks.rados.rados.0.smithi084.stdout:2376: done (0 left) 2024-03-30T12:30:51.309 INFO:tasks.rados.rados.0.smithi084.stdout:2377: snap_remove snap 240 2024-03-30T12:30:51.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:30:51.096+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:51.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:51.317+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:51.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:51.317+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:51.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:51.318+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:51.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:51.318+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:51.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:51.318+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:51.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:51.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:51.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:51.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-mon[83709]: osdmap e564: 8 total, 8 up, 8 in 2024-03-30T12:30:51.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:51.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:51.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:51.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:51.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:51.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:51.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:51.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-30T12:30:51.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-mon[83709]: pgmap v532: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 582 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 12 MiB/s rd, 1.8 MiB/s wr, 17 op/s 2024-03-30T12:30:51.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-mon[83709]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-30T12:30:51.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-mon[83709]: mds.? [v2:172.21.15.84:6834/3803840215,v1:172.21.15.84:6835/3803840215] up:active 2024-03-30T12:30:51.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-mon[83709]: fsmap cephfs:1 {0=a=up:active} 2024-03-30T12:30:51.503 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-a[117098]: 2024-03-30T12:30:51.171+0000 7fd5c7d38700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-30T12:30:51.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:51.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:51.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:51.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[91810]: osdmap e564: 8 total, 8 up, 8 in 2024-03-30T12:30:51.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:51.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:51.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:51.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:51.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:51.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:51.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:51.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-30T12:30:51.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[91810]: pgmap v532: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 582 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 12 MiB/s rd, 1.8 MiB/s wr, 17 op/s 2024-03-30T12:30:51.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[91810]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-30T12:30:51.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[91810]: mds.? [v2:172.21.15.84:6834/3803840215,v1:172.21.15.84:6835/3803840215] up:active 2024-03-30T12:30:51.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[91810]: fsmap cephfs:1 {0=a=up:active} 2024-03-30T12:30:51.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:51.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:51.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:51.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[89279]: osdmap e564: 8 total, 8 up, 8 in 2024-03-30T12:30:51.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:51.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:51.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:51.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:51.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:51.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:51.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:51.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-30T12:30:51.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[89279]: pgmap v532: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 582 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 12 MiB/s rd, 1.8 MiB/s wr, 17 op/s 2024-03-30T12:30:51.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[89279]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-30T12:30:51.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[89279]: mds.? [v2:172.21.15.84:6834/3803840215,v1:172.21.15.84:6835/3803840215] up:active 2024-03-30T12:30:51.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-mon[89279]: fsmap cephfs:1 {0=a=up:active} 2024-03-30T12:30:52.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:51.702+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:52.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:51.704+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:52.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:51.704+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:52.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:51.704+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:52.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:51.704+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:52.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:51.704+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:52.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:51.704+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:52.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:51.704+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:52.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:30:51.701+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:52.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:51.701+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:52.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:51.702+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:52.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:51.702+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:52.319 INFO:tasks.rados.rados.0.smithi084.stdout:2377: done (0 left) 2024-03-30T12:30:52.319 INFO:tasks.rados.rados.0.smithi084.stdout:2378: snap_remove snap 230 2024-03-30T12:30:52.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:30:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:30:52.379+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:52.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:52.329+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:52.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:52.329+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:52.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:52.429+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:52.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:52.429+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:52.621 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:52.327+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:52.621 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:52.327+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:52.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:52.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:52.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:52.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:52 smithi162 ceph-mon[83709]: osdmap e565: 8 total, 8 up, 8 in 2024-03-30T12:30:52.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:52.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:52.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:52.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:52.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:52.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:52.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:52.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:52.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:52.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:52.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:52.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:52.431+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:52.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:52.431+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:52.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:52.327+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:52.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:52.327+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:52.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:52.327+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:52.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:52.328+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:52.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:52.328+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[91810]: osdmap e565: 8 total, 8 up, 8 in 2024-03-30T12:30:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:52.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:52.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:52.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:52.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:52.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:52.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:52.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[89279]: osdmap e565: 8 total, 8 up, 8 in 2024-03-30T12:30:52.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:52.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:52.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:52.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:52.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:52.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:52.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:52.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:52.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:52.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:52.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:53.329 INFO:tasks.rados.rados.0.smithi084.stdout:2378: done (0 left) 2024-03-30T12:30:53.329 INFO:tasks.rados.rados.0.smithi084.stdout:2379: rollback oid 35 current snap is 246 2024-03-30T12:30:53.329 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 35 to 245 2024-03-30T12:30:53.329 INFO:tasks.rados.rados.0.smithi084.stdout:2380: snap_remove snap 244 2024-03-30T12:30:53.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:53.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:53.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:53.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:53.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-mon[83709]: osdmap e566: 8 total, 8 up, 8 in 2024-03-30T12:30:53.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:53.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:53.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:53.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:53.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:53.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:53.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:53.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:53.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:53.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:53.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:53.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-mon[83709]: pgmap v535: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 582 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2024-03-30T12:30:53.622 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:53.332+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:53.622 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:53.332+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:53.622 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:53.332+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:53.622 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:53.337+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:53.623 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:53.337+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:53.623 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:53.337+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:53.623 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:53.335+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:53.623 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:53.335+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:53.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:53.341+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:53.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:53.341+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:53.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:53.334+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:53.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:53.334+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:53.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:53.334+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:53.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:53.335+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:53.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:53.335+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:53.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:53.335+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:53.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:53.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:53.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:53.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:53.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[91810]: osdmap e566: 8 total, 8 up, 8 in 2024-03-30T12:30:53.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:53.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:53.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:53.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:53.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:53.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:53.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:53.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:53.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:53.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:53.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:53.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[91810]: pgmap v535: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 582 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2024-03-30T12:30:53.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:53.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:53.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:53.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:53.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[89279]: osdmap e566: 8 total, 8 up, 8 in 2024-03-30T12:30:53.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:53.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:53.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:53.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:53.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:53.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:53.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:53.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:53.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:53.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:53.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:53.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:53 smithi084 ceph-mon[89279]: pgmap v535: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 582 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 3.3 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2024-03-30T12:30:54.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:30:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:30:53.687+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:54.331 INFO:tasks.rados.rados.0.smithi084.stdout:2379: finishing rollback tid 0 to smithi08477944-35 2024-03-30T12:30:54.331 INFO:tasks.rados.rados.0.smithi084.stdout:2379: finishing rollback tid 1 to smithi08477944-35 2024-03-30T12:30:54.331 INFO:tasks.rados.rados.0.smithi084.stdout:2379: finishing rollback tid 2 to smithi08477944-35 2024-03-30T12:30:54.331 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 17492 (ObjNum 33 snap 0 seq_num 1429847008) dirty exists 2024-03-30T12:30:54.331 INFO:tasks.rados.rados.0.smithi084.stdout:2379: done (1 left) 2024-03-30T12:30:54.331 INFO:tasks.rados.rados.0.smithi084.stdout:2380: done (0 left) 2024-03-30T12:30:54.331 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 33 current snap is 246 2024-03-30T12:30:54.331 INFO:tasks.rados.rados.0.smithi084.stdout:2381: seq_num 739 ranges {1146880=385024} 2024-03-30T12:30:54.341 INFO:tasks.rados.rados.0.smithi084.stdout:2381: writing smithi08477944-33 from 1146880 to 1531904 tid 1 2024-03-30T12:30:54.342 INFO:tasks.rados.rados.0.smithi084.stdout:2382: setattr oid 11 current snap is 246 2024-03-30T12:30:54.344 INFO:tasks.rados.rados.0.smithi084.stdout:2383: read oid 49 snap -1 2024-03-30T12:30:54.344 INFO:tasks.rados.rados.0.smithi084.stdout:2383: expect (ObjNum 717 snap 242 seq_num 717) 2024-03-30T12:30:54.344 INFO:tasks.rados.rados.0.smithi084.stdout:2384: read oid 17 snap -1 2024-03-30T12:30:54.344 INFO:tasks.rados.rados.0.smithi084.stdout:2384: expect (ObjNum 716 snap 242 seq_num 716) 2024-03-30T12:30:54.344 INFO:tasks.rados.rados.0.smithi084.stdout:2385: read oid 40 snap 223 2024-03-30T12:30:54.344 INFO:tasks.rados.rados.0.smithi084.stdout:2385: expect (ObjNum 599 snap 211 seq_num 599) 2024-03-30T12:30:54.344 INFO:tasks.rados.rados.0.smithi084.stdout:2386: snap_remove snap 245 2024-03-30T12:30:54.619 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:54.355+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:54.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:54.358+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:54.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:54.338+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:54.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:54.338+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:54.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:54.359+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:54.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:54.360+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:54.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:54.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:54.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:54.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:54.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:54.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:54.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:54.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:54.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:54 smithi162 ceph-mon[83709]: osdmap e567: 8 total, 8 up, 8 in 2024-03-30T12:30:54.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:54.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:54.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:54.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:54.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:54.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:54.342+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:54.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:54.342+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:54.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[91810]: osdmap e567: 8 total, 8 up, 8 in 2024-03-30T12:30:54.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:54.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:54.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:54.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:54.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:54.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:54.339+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:54.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:54.339+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:54.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:54.339+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:54.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:54.340+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:54.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:54.340+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:54.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:54.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:54.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:54.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:54.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:54.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:54.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:54.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:54.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[89279]: osdmap e567: 8 total, 8 up, 8 in 2024-03-30T12:30:54.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:54.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:54.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:54.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:54.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:55.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:30:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:30:54.631+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:55.337 INFO:tasks.rados.rados.0.smithi084.stdout:2386: done (5 left) 2024-03-30T12:30:55.337 INFO:tasks.rados.rados.0.smithi084.stdout:2387: rollback oid 24 current snap is 246 2024-03-30T12:30:55.338 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 24 to 223 2024-03-30T12:30:55.338 INFO:tasks.rados.rados.0.smithi084.stdout:2381: finishing write tid 1 to smithi08477944-33 2024-03-30T12:30:55.338 INFO:tasks.rados.rados.0.smithi084.stdout:2381: finishing write tid 2 to smithi08477944-33 2024-03-30T12:30:55.338 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 995 (ObjNum 707 snap 242 seq_num 707) dirty exists 2024-03-30T12:30:55.338 INFO:tasks.rados.rados.0.smithi084.stdout:2381: finishing write tid 3 to smithi08477944-33 2024-03-30T12:30:55.338 INFO:tasks.rados.rados.0.smithi084.stdout:2381: oid 33 updating version 0 to 17518 2024-03-30T12:30:55.338 INFO:tasks.rados.rados.0.smithi084.stdout:2381: oid 33 version 17518 is already newer than 17517 2024-03-30T12:30:55.338 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 17518 (ObjNum 739 snap 246 seq_num 739) dirty exists 2024-03-30T12:30:55.338 INFO:tasks.rados.rados.0.smithi084.stdout:2381: left oid 33 (ObjNum 739 snap 246 seq_num 739) 2024-03-30T12:30:55.338 INFO:tasks.rados.rados.0.smithi084.stdout:2383: expect (ObjNum 717 snap 242 seq_num 717) 2024-03-30T12:30:55.430 INFO:tasks.rados.rados.0.smithi084.stdout:2385: expect (ObjNum 599 snap 211 seq_num 599) 2024-03-30T12:30:55.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:30:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:30:55.356+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:55.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:55.354+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:55.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:55.354+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:55.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:55.354+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:55.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:55.344+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:55.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:55.344+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:55.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:55.347+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:55.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:55.347+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:55.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:55.347+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:55.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:55.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:55.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:55.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:55 smithi162 ceph-mon[83709]: osdmap e568: 8 total, 8 up, 8 in 2024-03-30T12:30:55.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:55.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:55.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:55.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:55.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:55.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:55.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:55.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:55.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:55 smithi162 ceph-mon[83709]: pgmap v538: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 573 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 6.5 MiB/s rd, 652 KiB/s wr, 21 op/s 2024-03-30T12:30:55.659 INFO:tasks.rados.rados.0.smithi084.stdout:2384: expect (ObjNum 716 snap 242 seq_num 716) 2024-03-30T12:30:55.746 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:55.746 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:55.746 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:55.746 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[89279]: osdmap e568: 8 total, 8 up, 8 in 2024-03-30T12:30:55.747 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:55.747 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:55.747 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:55.747 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:55.747 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:55.747 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:55.747 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:55.747 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:55.747 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[89279]: pgmap v538: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 573 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 6.5 MiB/s rd, 652 KiB/s wr, 21 op/s 2024-03-30T12:30:55.747 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:55.343+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:55.748 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:55.343+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:55.748 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:55.343+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:55.748 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:55.343+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:55.748 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:55.344+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:55.748 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:55.344+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:55.748 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:55.748 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:55.748 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:55.748 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[91810]: osdmap e568: 8 total, 8 up, 8 in 2024-03-30T12:30:55.748 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:55.748 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:55.748 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:55.749 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:55.749 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:55.749 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:55.749 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:55.749 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:55.749 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-mon[91810]: pgmap v538: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 573 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 6.5 MiB/s rd, 652 KiB/s wr, 21 op/s 2024-03-30T12:30:55.915 INFO:tasks.rados.rados.0.smithi084.stdout:2387: finishing rollback tid 1 to smithi08477944-24 2024-03-30T12:30:55.915 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 11264 (ObjNum 65 snap 0 seq_num 1633440097) dirty dne 2024-03-30T12:30:55.915 INFO:tasks.rados.rados.0.smithi084.stdout:2381: done (5 left) 2024-03-30T12:30:55.915 INFO:tasks.rados.rados.0.smithi084.stdout:2382: done (4 left) 2024-03-30T12:30:55.916 INFO:tasks.rados.rados.0.smithi084.stdout:2383: done (3 left) 2024-03-30T12:30:55.916 INFO:tasks.rados.rados.0.smithi084.stdout:2384: done (2 left) 2024-03-30T12:30:55.916 INFO:tasks.rados.rados.0.smithi084.stdout:2385: done (1 left) 2024-03-30T12:30:55.916 INFO:tasks.rados.rados.0.smithi084.stdout:2387: done (0 left) 2024-03-30T12:30:55.916 INFO:tasks.rados.rados.0.smithi084.stdout:2388: read oid 24 snap -1 2024-03-30T12:30:55.916 INFO:tasks.rados.rados.0.smithi084.stdout:2388: expect deleted 2024-03-30T12:30:55.916 INFO:tasks.rados.rados.0.smithi084.stdout:2389: snap_create 2024-03-30T12:30:56.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:55.754+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:56.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:55.754+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:56.338 INFO:tasks.rados.rados.0.smithi084.stdout:2388: done (1 left) 2024-03-30T12:30:56.338 INFO:tasks.rados.rados.0.smithi084.stdout:2389: done (0 left) 2024-03-30T12:30:56.338 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 247 2024-03-30T12:30:56.338 INFO:tasks.rados.rados.0.smithi084.stdout:2390: seq_num 740 ranges {2408448=401408} 2024-03-30T12:30:56.353 INFO:tasks.rados.rados.0.smithi084.stdout:2390: writing smithi08477944-12 from 2408448 to 2809856 tid 1 2024-03-30T12:30:56.353 INFO:tasks.rados.rados.0.smithi084.stdout:2391: rollback oid 47 current snap is 247 2024-03-30T12:30:56.353 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 246 2024-03-30T12:30:56.353 INFO:tasks.rados.rados.0.smithi084.stdout:2392: snap_create 2024-03-30T12:30:56.357 INFO:tasks.rados.rados.0.smithi084.stdout:2391: finishing rollback tid 0 to smithi08477944-47 2024-03-30T12:30:56.358 INFO:tasks.rados.rados.0.smithi084.stdout:2391: finishing rollback tid 1 to smithi08477944-47 2024-03-30T12:30:56.358 INFO:tasks.rados.rados.0.smithi084.stdout:2391: finishing rollback tid 2 to smithi08477944-47 2024-03-30T12:30:56.358 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 17521 (ObjNum 696 snap 242 seq_num 696) dirty exists 2024-03-30T12:30:56.363 INFO:tasks.rados.rados.0.smithi084.stdout:2390: finishing write tid 1 to smithi08477944-12 2024-03-30T12:30:56.363 INFO:tasks.rados.rados.0.smithi084.stdout:2390: finishing write tid 2 to smithi08477944-12 2024-03-30T12:30:56.366 INFO:tasks.rados.rados.0.smithi084.stdout:2390: finishing write tid 3 to smithi08477944-12 2024-03-30T12:30:56.366 INFO:tasks.rados.rados.0.smithi084.stdout:2390: oid 12 updating version 0 to 23376 2024-03-30T12:30:56.366 INFO:tasks.rados.rados.0.smithi084.stdout:2390: oid 12 version 23376 is already newer than 23375 2024-03-30T12:30:56.366 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 23376 (ObjNum 740 snap 247 seq_num 740) dirty exists 2024-03-30T12:30:56.366 INFO:tasks.rados.rados.0.smithi084.stdout:2390: left oid 12 (ObjNum 740 snap 247 seq_num 740) 2024-03-30T12:30:56.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:30:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:30:56.369+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:56.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:56.345+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:56.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:56.345+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:56.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:56.530+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:56.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:56.530+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:56.621 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:56.365+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:56.621 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:56.375+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 135=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:56.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:56.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:56.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:56.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:56.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:56.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:56.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:56 smithi162 ceph-mon[83709]: osdmap e569: 8 total, 8 up, 8 in 2024-03-30T12:30:56.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:56.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:56.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:56.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:56.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:56.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:56.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:56.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:56.366+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:56.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:56.366+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:56.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:56.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:56.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:56.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:56.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:56.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:56.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[89279]: osdmap e569: 8 total, 8 up, 8 in 2024-03-30T12:30:56.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:56.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:56.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:56.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:56.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:56.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:56.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:56.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:56.344+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:56.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:56.345+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:56.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:56.345+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:56.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:56.345+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:56.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:56.345+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:56.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:56.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:56.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:56.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:56.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:56.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:56.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[91810]: osdmap e569: 8 total, 8 up, 8 in 2024-03-30T12:30:56.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:56.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:56.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:56.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:56.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:56.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:56.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:57.345 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:30:57 smithi162 podman[108313]: 2024-03-30 12:30:57.079109201 +0000 UTC m=+9.112282522 container stop ee1770ef5eddfa99fcac5ef41bfc0e611b834f3930501dff2aca63b285c6675b (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-b, GIT_CLEAN=True, RELEASE=reef-f14b568, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:30:57.345 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:30:57 smithi162 podman[108313]: 2024-03-30 12:30:57.104766209 +0000 UTC m=+9.137939556 container died ee1770ef5eddfa99fcac5ef41bfc0e611b834f3930501dff2aca63b285c6675b (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-b, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=reef-f14b568, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5) 2024-03-30T12:30:57.350 INFO:tasks.rados.rados.0.smithi084.stdout:2390: done (2 left) 2024-03-30T12:30:57.350 INFO:tasks.rados.rados.0.smithi084.stdout:2391: done (1 left) 2024-03-30T12:30:57.350 INFO:tasks.rados.rados.0.smithi084.stdout:2392: done (0 left) 2024-03-30T12:30:57.351 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 248 2024-03-30T12:30:57.351 INFO:tasks.rados.rados.0.smithi084.stdout:2393: seq_num 741 ranges {8257536=417792} 2024-03-30T12:30:57.396 INFO:tasks.rados.rados.0.smithi084.stdout:2393: writing smithi08477944-20 from 8257536 to 8675328 tid 1 2024-03-30T12:30:57.396 INFO:tasks.rados.rados.0.smithi084.stdout:2394: read oid 17 snap 246 2024-03-30T12:30:57.396 INFO:tasks.rados.rados.0.smithi084.stdout:2394: expect (ObjNum 716 snap 242 seq_num 716) 2024-03-30T12:30:57.396 INFO:tasks.rados.rados.0.smithi084.stdout:2395: setattr oid 26 current snap is 248 2024-03-30T12:30:57.398 INFO:tasks.rados.rados.0.smithi084.stdout:2396: read oid 14 snap -1 2024-03-30T12:30:57.398 INFO:tasks.rados.rados.0.smithi084.stdout:2396: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:30:57.398 INFO:tasks.rados.rados.0.smithi084.stdout:2397: rollback oid 7 current snap is 248 2024-03-30T12:30:57.398 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 7 to 223 2024-03-30T12:30:57.398 INFO:tasks.rados.rados.0.smithi084.stdout:2398: delete oid 31 current snap is 248 2024-03-30T12:30:57.401 INFO:tasks.rados.rados.0.smithi084.stdout:2396: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:30:57.406 INFO:tasks.rados.rados.0.smithi084.stdout:2396: done (5 left) 2024-03-30T12:30:57.406 INFO:tasks.rados.rados.0.smithi084.stdout:2398: done (4 left) 2024-03-30T12:30:57.406 INFO:tasks.rados.rados.0.smithi084.stdout:2399: snap_remove snap 247 2024-03-30T12:30:57.620 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:30:57.410+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:57.620 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:30:57 smithi162 podman[108313]: 2024-03-30 12:30:57.505257614 +0000 UTC m=+9.538430976 container cleanup ee1770ef5eddfa99fcac5ef41bfc0e611b834f3930501dff2aca63b285c6675b (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-b, ceph=True, GIT_CLEAN=True, RELEASE=reef-f14b568, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T12:30:57.620 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:30:57 smithi162 bash[108313]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-b 2024-03-30T12:30:57.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:57.357+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 135=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:57.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:57.358+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:57.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:57.575+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:57.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:57.575+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:57.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:57.575+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:57.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:57.357+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:30:57.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:57.357+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:57.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:57.358+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:57.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:57.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:57.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:57.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:57.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:57.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:57.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-mon[83709]: osdmap e570: 8 total, 8 up, 8 in 2024-03-30T12:30:57.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:57.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:57.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:57.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:57.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:57.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:57.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 135=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:57.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:57.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:57.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:57 smithi162 ceph-mon[83709]: pgmap v541: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 573 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 11 MiB/s rd, 566 KiB/s wr, 22 op/s 2024-03-30T12:30:57.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:57.409+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:57.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:57.411+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:57.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:57.408+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:57.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:57.408+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:57.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:57.409+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:57.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:57.409+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:57.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:57.417+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:57.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:57.418+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:57.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:57.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:57.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:57.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:57.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:57.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:57.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[91810]: osdmap e570: 8 total, 8 up, 8 in 2024-03-30T12:30:57.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:57.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:57.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:57.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:57.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:57.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:57.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 135=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:57.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:57.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:57.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[91810]: pgmap v541: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 573 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 11 MiB/s rd, 566 KiB/s wr, 22 op/s 2024-03-30T12:30:57.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 12f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:57.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:57.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:57.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:57.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:57.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:57.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[89279]: osdmap e570: 8 total, 8 up, 8 in 2024-03-30T12:30:57.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:57.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:57.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:57.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:57.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:57.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:57.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 135=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:57.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:57.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:57.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:57 smithi084 ceph-mon[89279]: pgmap v541: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 573 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 11 MiB/s rd, 566 KiB/s wr, 22 op/s 2024-03-30T12:30:58.022 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:30:57 smithi162 podman[108328]: 2024-03-30 12:30:57.723232446 +0000 UTC m=+0.632685054 container remove ee1770ef5eddfa99fcac5ef41bfc0e611b834f3930501dff2aca63b285c6675b (image=quay.ceph.io/ceph-ci/ceph@sha256:4e1dce26ec1e5ea1ab3e444821623a00a9d983046df3fb77b8f4e7e48fb0b1f2, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-b, org.label-schema.build-date=20240326, RELEASE=reef-f14b568, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-03-30T12:30:58.022 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:30:57 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mds.b.service: Deactivated successfully. 2024-03-30T12:30:58.022 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:30:57 smithi162 systemd[1]: Stopped Ceph mds.b for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:30:58.022 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:30:57 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mds.b.service: Consumed 1.736s CPU time. 2024-03-30T12:30:58.273 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:30:58 smithi162 systemd[1]: Starting Ceph mds.b for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:30:58.273 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:30:58 smithi162 podman[108462]: 2024-03-30 12:30:58.150700294 +0000 UTC m=+0.018146770 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:30:58.273 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:30:58 smithi162 podman[108462]: 2024-03-30 12:30:58.282473977 +0000 UTC m=+0.149920443 container create 38620aa52c540d17217108594a33a441b9464275450bcc7d29e4e7ea1b8d3e43 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-b, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T12:30:58.355 INFO:tasks.rados.rados.0.smithi084.stdout:2399: done (4 left) 2024-03-30T12:30:58.356 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 248 2024-03-30T12:30:58.356 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 27194 (ObjNum 738 snap 244 seq_num 738) dirty exists 2024-03-30T12:30:58.356 INFO:tasks.rados.rados.0.smithi084.stdout:2400: seq_num 743 ranges {2809856=450560} 2024-03-30T12:30:58.373 INFO:tasks.rados.rados.0.smithi084.stdout:2400: writing smithi08477944-12 from 2809856 to 3260416 tid 1 2024-03-30T12:30:58.373 INFO:tasks.rados.rados.0.smithi084.stdout:2395: done (4 left) 2024-03-30T12:30:58.373 INFO:tasks.rados.rados.0.smithi084.stdout:2401: snap_create 2024-03-30T12:30:58.373 INFO:tasks.rados.rados.0.smithi084.stdout:2393: finishing write tid 1 to smithi08477944-20 2024-03-30T12:30:58.373 INFO:tasks.rados.rados.0.smithi084.stdout:2393: finishing write tid 2 to smithi08477944-20 2024-03-30T12:30:58.373 INFO:tasks.rados.rados.0.smithi084.stdout:2397: finishing rollback tid 0 to smithi08477944-7 2024-03-30T12:30:58.373 INFO:tasks.rados.rados.0.smithi084.stdout:2397: finishing rollback tid 1 to smithi08477944-7 2024-03-30T12:30:58.373 INFO:tasks.rados.rados.0.smithi084.stdout:2397: finishing rollback tid 2 to smithi08477944-7 2024-03-30T12:30:58.373 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 17526 (ObjNum 609 snap 216 seq_num 609) dirty exists 2024-03-30T12:30:58.373 INFO:tasks.rados.rados.0.smithi084.stdout:2393: finishing write tid 3 to smithi08477944-20 2024-03-30T12:30:58.373 INFO:tasks.rados.rados.0.smithi084.stdout:2393: oid 20 updating version 0 to 17522 2024-03-30T12:30:58.374 INFO:tasks.rados.rados.0.smithi084.stdout:2393: oid 20 updating version 17522 to 17523 2024-03-30T12:30:58.374 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 17523 (ObjNum 741 snap 248 seq_num 741) dirty exists 2024-03-30T12:30:58.374 INFO:tasks.rados.rados.0.smithi084.stdout:2393: left oid 20 (ObjNum 741 snap 248 seq_num 741) 2024-03-30T12:30:58.374 INFO:tasks.rados.rados.0.smithi084.stdout:2394: expect (ObjNum 716 snap 242 seq_num 716) 2024-03-30T12:30:58.532 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:30:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:30:58.397+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:58.533 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:58.394+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:58.533 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:58.395+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:58.533 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:58.394+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 135=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:58.533 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:58.395+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:58.533 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 135=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:58.534 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:58.534 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:58.534 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:58 smithi162 ceph-mon[83709]: osdmap e571: 8 total, 8 up, 8 in 2024-03-30T12:30:58.534 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:58.534 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:58.534 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:58.534 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:58.534 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:58.534 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:58.534 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:58.534 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:58.625 INFO:tasks.rados.rados.0.smithi084.stdout:2400: finishing write tid 1 to smithi08477944-12 2024-03-30T12:30:58.625 INFO:tasks.rados.rados.0.smithi084.stdout:2400: finishing write tid 2 to smithi08477944-12 2024-03-30T12:30:58.626 INFO:tasks.rados.rados.0.smithi084.stdout:2400: finishing write tid 3 to smithi08477944-12 2024-03-30T12:30:58.626 INFO:tasks.rados.rados.0.smithi084.stdout:2400: oid 12 updating version 0 to 23378 2024-03-30T12:30:58.626 INFO:tasks.rados.rados.0.smithi084.stdout:2400: oid 12 version 23378 is already newer than 23377 2024-03-30T12:30:58.626 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 23378 (ObjNum 743 snap 248 seq_num 743) dirty exists 2024-03-30T12:30:58.626 INFO:tasks.rados.rados.0.smithi084.stdout:2400: left oid 12 (ObjNum 743 snap 248 seq_num 743) 2024-03-30T12:30:58.673 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 135=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:58.673 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:58.674 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:58.674 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-mon[89279]: osdmap e571: 8 total, 8 up, 8 in 2024-03-30T12:30:58.674 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:58.674 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:58.674 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:58.674 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:58.674 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:58.674 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:58.674 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:58.674 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:58.674 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 135=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:58.675 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:58.675 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:58.675 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-mon[91810]: osdmap e571: 8 total, 8 up, 8 in 2024-03-30T12:30:58.675 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:58.675 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:58.675 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:58.675 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:58.675 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:58.675 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:58.675 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:58.675 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:58.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:58.602+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:58.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:58.602+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:58.870 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:30:58 smithi162 podman[108462]: 2024-03-30 12:30:58.668687347 +0000 UTC m=+0.536133821 container init 38620aa52c540d17217108594a33a441b9464275450bcc7d29e4e7ea1b8d3e43 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-b, maintainer=Guillaume Abrioux , RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-03-30T12:30:58.870 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:30:58 smithi162 podman[108462]: 2024-03-30 12:30:58.671390782 +0000 UTC m=+0.538837253 container start 38620aa52c540d17217108594a33a441b9464275450bcc7d29e4e7ea1b8d3e43 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, ceph=True, org.label-schema.license=GPLv2) 2024-03-30T12:30:58.870 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:30:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-b[108476]: starting mds.b at 2024-03-30T12:30:58.870 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:30:58 smithi162 bash[108462]: 38620aa52c540d17217108594a33a441b9464275450bcc7d29e4e7ea1b8d3e43 2024-03-30T12:30:58.870 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:30:58 smithi162 systemd[1]: Started Ceph mds.b for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:30:59.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:58.681+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:59.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:58.682+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:59.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:58.681+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:59.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:58.681+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:59.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:58.681+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:59.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:58.681+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:59.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:58.681+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:59.362 INFO:tasks.rados.rados.0.smithi084.stdout:2393: done (4 left) 2024-03-30T12:30:59.363 INFO:tasks.rados.rados.0.smithi084.stdout:2394: done (3 left) 2024-03-30T12:30:59.363 INFO:tasks.rados.rados.0.smithi084.stdout:2397: done (2 left) 2024-03-30T12:30:59.363 INFO:tasks.rados.rados.0.smithi084.stdout:2400: done (1 left) 2024-03-30T12:30:59.363 INFO:tasks.rados.rados.0.smithi084.stdout:2401: done (0 left) 2024-03-30T12:30:59.363 INFO:tasks.rados.rados.0.smithi084.stdout:2402: delete oid 33 current snap is 249 2024-03-30T12:30:59.368 INFO:tasks.rados.rados.0.smithi084.stdout:2402: done (0 left) 2024-03-30T12:30:59.368 INFO:tasks.rados.rados.0.smithi084.stdout:2403: snap_remove snap 246 2024-03-30T12:30:59.619 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:59.368+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 136=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:59.619 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:30:59.370+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:59.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:59.368+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:59.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:59.369+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:30:59.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:30:59.369+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:59.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:59.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:59.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-mon[83709]: osdmap e572: 8 total, 8 up, 8 in 2024-03-30T12:30:59.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 135=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:59.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:59.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:59.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:59.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:59.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:59.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:59.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:59.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:59.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:59.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:59.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:59.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:59.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-mon[83709]: pgmap v544: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 575 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 9.3 MiB/s rd, 196 KiB/s wr, 7 op/s 2024-03-30T12:30:59.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:59.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:59.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:30:59.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:30:59] "GET /metrics HTTP/1.1" 200 36326 "" "Prometheus/2.43.0" 2024-03-30T12:30:59.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:59.377+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:59.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:30:59.378+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:59.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:59.374+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:59.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:59.374+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:59.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:59.374+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:59.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:59.374+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:59.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:59.376+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:30:59.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:30:59.376+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[89279]: osdmap e572: 8 total, 8 up, 8 in 2024-03-30T12:30:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 135=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:59.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:59.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:59.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:59.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:59.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:59.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:59.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[89279]: pgmap v544: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 575 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 9.3 MiB/s rd, 196 KiB/s wr, 7 op/s 2024-03-30T12:30:59.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:59.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:59.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:30:59.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[91810]: osdmap e572: 8 total, 8 up, 8 in 2024-03-30T12:30:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 135=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:30:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:30:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:30:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:30:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:30:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:30:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:30:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:30:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:30:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:30:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:30:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:30:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:30:59.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[91810]: pgmap v544: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 575 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 9.3 MiB/s rd, 196 KiB/s wr, 7 op/s 2024-03-30T12:30:59.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:59.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:30:59.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:30:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:31:00.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:30:59.942+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:00.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:59.702+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:00.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:59.702+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:00.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:30:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:30:59.703+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:00.368 INFO:tasks.rados.rados.0.smithi084.stdout:2403: done (0 left) 2024-03-30T12:31:00.368 INFO:tasks.rados.rados.0.smithi084.stdout:2404: snap_remove snap 223 2024-03-30T12:31:00.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:00.374+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:00.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:00.374+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:00.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:00.597+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:00.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:00.597+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 136=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:00 smithi162 ceph-mon[83709]: mds.? [v2:172.21.15.162:6832/2413526060,v1:172.21.15.162:6833/2413526060] up:boot 2024-03-30T12:31:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:00 smithi162 ceph-mon[83709]: fsmap cephfs:1 {0=a=up:active} 1 up:standby 2024-03-30T12:31:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:00 smithi162 ceph-mon[83709]: osdmap e573: 8 total, 8 up, 8 in 2024-03-30T12:31:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:00 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-30T12:31:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:00.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:00.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:00.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:00.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:00.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:00.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:00.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:00.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:00 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:31:00.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:00.374+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:00.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:00.374+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:00.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:00.375+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:00.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:00.375+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:00.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:00.375+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:00.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:00.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 136=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:00.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:00.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[89279]: mds.? [v2:172.21.15.162:6832/2413526060,v1:172.21.15.162:6833/2413526060] up:boot 2024-03-30T12:31:00.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[89279]: fsmap cephfs:1 {0=a=up:active} 1 up:standby 2024-03-30T12:31:00.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:00.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[89279]: osdmap e573: 8 total, 8 up, 8 in 2024-03-30T12:31:00.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-30T12:31:00.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:00.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:00.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:00.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:00.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:00.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:00.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:00.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:00.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:31:00.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 136=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[91810]: mds.? [v2:172.21.15.162:6832/2413526060,v1:172.21.15.162:6833/2413526060] up:boot 2024-03-30T12:31:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[91810]: fsmap cephfs:1 {0=a=up:active} 1 up:standby 2024-03-30T12:31:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[91810]: osdmap e573: 8 total, 8 up, 8 in 2024-03-30T12:31:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-30T12:31:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:00.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:00.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:31:01.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:00.994+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:01.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:00.994+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:01.326 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:01.021+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:01.327 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:01.020+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 136=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:01.327 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:01.022+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:01.375 INFO:tasks.rados.rados.0.smithi084.stdout:2404: done (0 left) 2024-03-30T12:31:01.375 INFO:tasks.rados.rados.0.smithi084.stdout:2405: read oid 40 snap -1 2024-03-30T12:31:01.375 INFO:tasks.rados.rados.0.smithi084.stdout:2405: expect (ObjNum 711 snap 242 seq_num 711) 2024-03-30T12:31:01.375 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 249 2024-03-30T12:31:01.375 INFO:tasks.rados.rados.0.smithi084.stdout:2406: seq_num 745 ranges {2260992=483328} 2024-03-30T12:31:01.390 INFO:tasks.rados.rados.0.smithi084.stdout:2406: writing smithi08477944-16 from 2260992 to 2744320 tid 1 2024-03-30T12:31:01.390 INFO:tasks.rados.rados.0.smithi084.stdout:2407: delete oid 9 current snap is 249 2024-03-30T12:31:01.391 INFO:tasks.rados.rados.0.smithi084.stdout:2405: expect (ObjNum 711 snap 242 seq_num 711) 2024-03-30T12:31:01.454 INFO:tasks.rados.rados.0.smithi084.stdout:2406: finishing write tid 1 to smithi08477944-16 2024-03-30T12:31:01.454 INFO:tasks.rados.rados.0.smithi084.stdout:2406: finishing write tid 2 to smithi08477944-16 2024-03-30T12:31:01.454 INFO:tasks.rados.rados.0.smithi084.stdout:2406: finishing write tid 3 to smithi08477944-16 2024-03-30T12:31:01.455 INFO:tasks.rados.rados.0.smithi084.stdout:2406: oid 16 updating version 0 to 1010 2024-03-30T12:31:01.455 INFO:tasks.rados.rados.0.smithi084.stdout:2406: oid 16 version 1010 is already newer than 1009 2024-03-30T12:31:01.455 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 1010 (ObjNum 745 snap 249 seq_num 745) dirty exists 2024-03-30T12:31:01.455 INFO:tasks.rados.rados.0.smithi084.stdout:2406: left oid 16 (ObjNum 745 snap 249 seq_num 745) 2024-03-30T12:31:01.455 INFO:tasks.rados.rados.0.smithi084.stdout:2405: done (2 left) 2024-03-30T12:31:01.455 INFO:tasks.rados.rados.0.smithi084.stdout:2406: done (1 left) 2024-03-30T12:31:01.455 INFO:tasks.rados.rados.0.smithi084.stdout:2407: done (0 left) 2024-03-30T12:31:01.455 INFO:tasks.rados.rados.0.smithi084.stdout:2408: rollback oid 19 current snap is 249 2024-03-30T12:31:01.455 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 19 to 248 2024-03-30T12:31:01.455 INFO:tasks.rados.rados.0.smithi084.stdout:2409: rollback oid 47 current snap is 249 2024-03-30T12:31:01.455 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 248 2024-03-30T12:31:01.455 INFO:tasks.rados.rados.0.smithi084.stdout:2410: copy_from oid 40 from oid 5 current snap is 249 2024-03-30T12:31:01.455 INFO:tasks.rados.rados.0.smithi084.stdout:2411: copy_from oid 17 from oid 4 current snap is 249 2024-03-30T12:31:01.455 INFO:tasks.rados.rados.0.smithi084.stdout:2412: read oid 16 snap -1 2024-03-30T12:31:01.455 INFO:tasks.rados.rados.0.smithi084.stdout:2412: expect (ObjNum 745 snap 249 seq_num 745) 2024-03-30T12:31:01.455 INFO:tasks.rados.rados.0.smithi084.stdout:2413: setattr oid 37 current snap is 249 2024-03-30T12:31:01.456 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 249 2024-03-30T12:31:01.456 INFO:tasks.rados.rados.0.smithi084.stdout:2414: seq_num 747 ranges {4505600=516096} 2024-03-30T12:31:01.483 INFO:tasks.rados.rados.0.smithi084.stdout:2414: writing smithi08477944-50 from 4505600 to 5021696 tid 1 2024-03-30T12:31:01.484 INFO:tasks.rados.rados.0.smithi084.stdout:2415: delete oid 28 current snap is 249 2024-03-30T12:31:01.484 INFO:tasks.rados.rados.0.smithi084.stdout:2409: finishing rollback tid 0 to smithi08477944-47 2024-03-30T12:31:01.484 INFO:tasks.rados.rados.0.smithi084.stdout:2408: finishing rollback tid 1 to smithi08477944-19 2024-03-30T12:31:01.484 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 36212 (ObjNum 129 snap 0 seq_num 1429064776) dirty dne 2024-03-30T12:31:01.484 INFO:tasks.rados.rados.0.smithi084.stdout:2409: finishing rollback tid 1 to smithi08477944-47 2024-03-30T12:31:01.484 INFO:tasks.rados.rados.0.smithi084.stdout:2409: finishing rollback tid 2 to smithi08477944-47 2024-03-30T12:31:01.484 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 17530 (ObjNum 696 snap 242 seq_num 696) dirty exists 2024-03-30T12:31:01.484 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 23399 (ObjNum 726 snap 242 seq_num 726) dirty exists 2024-03-30T12:31:01.484 INFO:tasks.rados.rados.0.smithi084.stdout:2412: expect (ObjNum 745 snap 249 seq_num 745) 2024-03-30T12:31:01.601 INFO:tasks.rados.rados.0.smithi084.stdout:2411: finishing copy_from racing read to smithi08477944-17 2024-03-30T12:31:01.601 INFO:tasks.rados.rados.0.smithi084.stdout:2411: finishing copy_from to smithi08477944-17 2024-03-30T12:31:01.601 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 17503 (ObjNum 662 snap 232 seq_num 662) dirty exists 2024-03-30T12:31:01.601 INFO:tasks.rados.rados.0.smithi084.stdout:2410: finishing copy_from racing read to smithi08477944-40 2024-03-30T12:31:01.601 INFO:tasks.rados.rados.0.smithi084.stdout:2410: finishing copy_from to smithi08477944-40 2024-03-30T12:31:01.601 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 994 (ObjNum 395 snap 125 seq_num 395) dirty exists 2024-03-30T12:31:01.602 INFO:tasks.rados.rados.0.smithi084.stdout:2414: finishing write tid 1 to smithi08477944-50 2024-03-30T12:31:01.602 INFO:tasks.rados.rados.0.smithi084.stdout:2408: done (7 left) 2024-03-30T12:31:01.602 INFO:tasks.rados.rados.0.smithi084.stdout:2409: done (6 left) 2024-03-30T12:31:01.602 INFO:tasks.rados.rados.0.smithi084.stdout:2410: done (5 left) 2024-03-30T12:31:01.602 INFO:tasks.rados.rados.0.smithi084.stdout:2411: done (4 left) 2024-03-30T12:31:01.602 INFO:tasks.rados.rados.0.smithi084.stdout:2412: done (3 left) 2024-03-30T12:31:01.602 INFO:tasks.rados.rados.0.smithi084.stdout:2413: done (2 left) 2024-03-30T12:31:01.602 INFO:tasks.rados.rados.0.smithi084.stdout:2415: done (1 left) 2024-03-30T12:31:01.602 INFO:tasks.rados.rados.0.smithi084.stdout:2416: copy_from oid 12 from oid 5 current snap is 249 2024-03-30T12:31:01.602 INFO:tasks.rados.rados.0.smithi084.stdout:2414: finishing write tid 2 to smithi08477944-50 2024-03-30T12:31:01.602 INFO:tasks.rados.rados.0.smithi084.stdout:2414: finishing write tid 3 to smithi08477944-50 2024-03-30T12:31:01.602 INFO:tasks.rados.rados.0.smithi084.stdout:2414: oid 50 updating version 0 to 1012 2024-03-30T12:31:01.602 INFO:tasks.rados.rados.0.smithi084.stdout:2414: oid 50 updating version 1012 to 1013 2024-03-30T12:31:01.602 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 1013 (ObjNum 747 snap 249 seq_num 747) dirty exists 2024-03-30T12:31:01.602 INFO:tasks.rados.rados.0.smithi084.stdout:2414: left oid 50 (ObjNum 747 snap 249 seq_num 747) 2024-03-30T12:31:01.603 INFO:tasks.rados.rados.0.smithi084.stdout:2414: done (1 left) 2024-03-30T12:31:01.603 INFO:tasks.rados.rados.0.smithi084.stdout:2417: rollback oid 40 current snap is 249 2024-03-30T12:31:01.603 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 40 to 248 2024-03-30T12:31:01.603 INFO:tasks.rados.rados.0.smithi084.stdout:2418: snap_create 2024-03-30T12:31:01.604 INFO:tasks.rados.rados.0.smithi084.stdout:2417: finishing rollback tid 0 to smithi08477944-40 2024-03-30T12:31:01.604 INFO:tasks.rados.rados.0.smithi084.stdout:2417: finishing rollback tid 1 to smithi08477944-40 2024-03-30T12:31:01.604 INFO:tasks.rados.rados.0.smithi084.stdout:2417: finishing rollback tid 2 to smithi08477944-40 2024-03-30T12:31:01.604 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 17533 (ObjNum 711 snap 242 seq_num 711) dirty exists 2024-03-30T12:31:01.612 INFO:tasks.rados.rados.0.smithi084.stdout:2416: finishing copy_from racing read to smithi08477944-12 2024-03-30T12:31:01.612 INFO:tasks.rados.rados.0.smithi084.stdout:2416: finishing copy_from to smithi08477944-12 2024-03-30T12:31:01.612 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 994 (ObjNum 395 snap 125 seq_num 395) dirty exists 2024-03-30T12:31:01.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:01.406+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:01.619 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:01.403+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 136=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:01.619 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:01.406+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:01.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:01.381+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:01.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:01.381+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:01.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:01.381+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:01.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:01.387+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:01.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:01.387+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:01.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:01.388+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:01.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:01.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:01 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:01.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:01 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:01.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:01.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:01 smithi162 ceph-mon[83709]: osdmap e574: 8 total, 8 up, 8 in 2024-03-30T12:31:01.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:01.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:01 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:01.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:01.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:01.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:01.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:01 smithi162 ceph-mon[83709]: pgmap v547: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 576 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 3.4 MiB/s rd, 404 KiB/s wr, 15 op/s 2024-03-30T12:31:01.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 136=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:01.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:01.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:01.383+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:01.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:01.383+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:01.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:01.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:01.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:01.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:01.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[91810]: osdmap e574: 8 total, 8 up, 8 in 2024-03-30T12:31:01.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:01.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:01.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:01.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:01.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:01.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[91810]: pgmap v547: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 576 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 3.4 MiB/s rd, 404 KiB/s wr, 15 op/s 2024-03-30T12:31:01.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 136=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:01.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:01.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:01.380+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:01.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:01.380+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:01.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:01.380+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:01.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:01.381+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:01.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:01.381+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:01.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:01.382+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:01.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:01.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:01.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:01.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:01.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[89279]: osdmap e574: 8 total, 8 up, 8 in 2024-03-30T12:31:01.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:01.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:01.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:01.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:01.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:01.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[89279]: pgmap v547: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 576 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 3.4 MiB/s rd, 404 KiB/s wr, 15 op/s 2024-03-30T12:31:01.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 136=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:01.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:02.374 INFO:tasks.rados.rados.0.smithi084.stdout:2416: done (2 left) 2024-03-30T12:31:02.374 INFO:tasks.rados.rados.0.smithi084.stdout:2417: done (1 left) 2024-03-30T12:31:02.374 INFO:tasks.rados.rados.0.smithi084.stdout:2418: done (0 left) 2024-03-30T12:31:02.374 INFO:tasks.rados.rados.0.smithi084.stdout:2419: read oid 10 snap 248 2024-03-30T12:31:02.375 INFO:tasks.rados.rados.0.smithi084.stdout:2419: expect deleted 2024-03-30T12:31:02.375 INFO:tasks.rados.rados.0.smithi084.stdout:2420: snap_create 2024-03-30T12:31:02.396 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-03-30T12:31:02.707 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T12:31:02.707 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (10m) 23s ago 11m 24.9M - 0.25.0 c8568f914cd2 6765ce007f39 2024-03-30T12:31:02.707 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi162 *:3000 running (10m) 45s ago 10m 93.5M - 9.4.7 954c08fa6188 ff2ec7518619 2024-03-30T12:31:02.707 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (27s) 23s ago 12m 12.3M - 19.0.0-1864-g5dc2ea30 548196a1a838 74abe81e0b10 2024-03-30T12:31:02.707 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi162 starting - - - - 2024-03-30T12:31:02.707 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi162 *:8443,9283,8765 running (6m) 45s ago 15m 452M - 19.0.0-1864-g5dc2ea30 548196a1a838 eec968f3fcc6 2024-03-30T12:31:02.707 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (7m) 23s ago 17m 516M - 19.0.0-1864-g5dc2ea30 548196a1a838 9a2aba19dffc 2024-03-30T12:31:02.707 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (6m) 23s ago 17m 64.8M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 a0811f2ae47d 2024-03-30T12:31:02.708 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi162 running (5m) 45s ago 15m 52.8M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 149ae6649e0c 2024-03-30T12:31:02.708 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (6m) 23s ago 15m 54.8M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 f79eca93cddd 2024-03-30T12:31:02.708 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (10m) 23s ago 10m 17.6M - 1.5.0 0da6a335fe13 66844bed39e8 2024-03-30T12:31:02.708 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi162 *:9100 running (10m) 45s ago 10m 15.5M - 1.5.0 0da6a335fe13 3d6e28b2348d 2024-03-30T12:31:02.708 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (4m) 23s ago 15m 331M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 c91eea4f8484 2024-03-30T12:31:02.708 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (4m) 23s ago 14m 263M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 7518832f6b4a 2024-03-30T12:31:02.708 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (3m) 23s ago 14m 191M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 647dd862762d 2024-03-30T12:31:02.708 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (3m) 23s ago 14m 206M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 c088a701b71b 2024-03-30T12:31:02.708 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi162 running (2m) 45s ago 13m 389M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 4197b37d2bb8 2024-03-30T12:31:02.708 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi162 running (2m) 45s ago 13m 408M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 cd8795ac188a 2024-03-30T12:31:02.708 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi162 running (88s) 45s ago 12m 178M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 40ed6df81194 2024-03-30T12:31:02.708 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi162 running (52s) 45s ago 12m 15.2M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 b83812c70d9a 2024-03-30T12:31:02.708 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi162 *:9095 running (6m) 45s ago 11m 55.9M - 2.43.0 a07b618ecd1d bd7d323e4b47 2024-03-30T12:31:02.709 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:02.709 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:02.709 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:02.709 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:02.709 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:02.709 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:02.709 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:02.709 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:02.709 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[89279]: osdmap e575: 8 total, 8 up, 8 in 2024-03-30T12:31:02.710 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:02.710 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:02.710 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:02.710 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:02.710 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:02.710 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 136=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:02.710 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:02.710 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:02.710 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:02.710 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:02.711 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:02.711 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:02.711 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:02.711 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:02.711 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:02.711 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:02.711 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[91810]: osdmap e575: 8 total, 8 up, 8 in 2024-03-30T12:31:02.711 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:02.711 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:02.711 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:02.711 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:02.711 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:02.711 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 136=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:02.712 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:02.712 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:02.737 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:02.386+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:02.738 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:02.382+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:02.738 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:02.383+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:02.738 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:02.382+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:02.738 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:02.382+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:02.739 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:02.739 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:02.739 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:02.739 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:02.739 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:02.739 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:02.740 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:02.740 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:02.740 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:02 smithi162 ceph-mon[83709]: osdmap e575: 8 total, 8 up, 8 in 2024-03-30T12:31:02.740 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:02.740 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:02.740 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:02.740 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:02.740 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:02.740 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 136=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:02.740 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:02.740 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:03.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:02.744+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:03.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:02.744+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:03.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:02.743+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:03.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:02.743+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:03.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:02.743+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:03.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:02.743+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:03.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:02.743+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:03.101 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-30T12:31:03.101 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-03-30T12:31:03.101 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 3 2024-03-30T12:31:03.101 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:31:03.101 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-03-30T12:31:03.101 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 2 2024-03-30T12:31:03.101 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:31:03.101 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-03-30T12:31:03.101 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 8 2024-03-30T12:31:03.101 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:31:03.101 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-03-30T12:31:03.102 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 2 2024-03-30T12:31:03.102 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:31:03.102 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-03-30T12:31:03.102 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 15 2024-03-30T12:31:03.102 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-30T12:31:03.102 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-30T12:31:03.119 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:02.744+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:03.119 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:02.745+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:03.388 INFO:tasks.rados.rados.0.smithi084.stdout:2419: done (1 left) 2024-03-30T12:31:03.388 INFO:tasks.rados.rados.0.smithi084.stdout:2420: done (0 left) 2024-03-30T12:31:03.389 INFO:tasks.rados.rados.0.smithi084.stdout:2421: copy_from oid 43 from oid 41 current snap is 251 2024-03-30T12:31:03.389 INFO:tasks.rados.rados.0.smithi084.stdout:2422: delete oid 31 current snap is 251 2024-03-30T12:31:03.392 INFO:tasks.rados.rados.0.smithi084.stdout:2422: done (1 left) 2024-03-30T12:31:03.393 INFO:tasks.rados.rados.0.smithi084.stdout:2423: copy_from oid 10 from oid 31 current snap is 251 2024-03-30T12:31:03.393 INFO:tasks.rados.rados.0.smithi084.stdout:2424: read oid 4 snap -1 2024-03-30T12:31:03.393 INFO:tasks.rados.rados.0.smithi084.stdout:2424: expect (ObjNum 662 snap 232 seq_num 662) 2024-03-30T12:31:03.393 INFO:tasks.rados.rados.0.smithi084.stdout:2425: setattr oid 9 current snap is 251 2024-03-30T12:31:03.394 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 251 2024-03-30T12:31:03.394 INFO:tasks.rados.rados.0.smithi084.stdout:2426: seq_num 750 ranges {0=565248} 2024-03-30T12:31:03.398 INFO:tasks.rados.rados.0.smithi084.stdout:2426: writing smithi08477944-8 from 0 to 565248 tid 1 2024-03-30T12:31:03.398 INFO:tasks.rados.rados.0.smithi084.stdout:2427: copy_from oid 47 from oid 11 current snap is 251 2024-03-30T12:31:03.398 INFO:tasks.rados.rados.0.smithi084.stdout:2423: finishing copy_from to smithi08477944-10 2024-03-30T12:31:03.398 INFO:tasks.rados.rados.0.smithi084.stdout:2423: got expected ENOENT (src dne) 2024-03-30T12:31:03.399 INFO:tasks.rados.rados.0.smithi084.stdout:2423: finishing copy_from racing read to smithi08477944-10 2024-03-30T12:31:03.399 INFO:tasks.rados.rados.0.smithi084.stdout:2423: done (5 left) 2024-03-30T12:31:03.399 INFO:tasks.rados.rados.0.smithi084.stdout:2428: rollback oid 24 current snap is 251 2024-03-30T12:31:03.399 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 24 to 250 2024-03-30T12:31:03.399 INFO:tasks.rados.rados.0.smithi084.stdout:2429: setattr oid 37 current snap is 251 2024-03-30T12:31:03.399 INFO:tasks.rados.rados.0.smithi084.stdout:2430: snap_create 2024-03-30T12:31:03.400 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 22492 (ObjNum 33 snap 0 seq_num 1428915568) dirty exists 2024-03-30T12:31:03.405 INFO:tasks.rados.rados.0.smithi084.stdout:2424: expect (ObjNum 662 snap 232 seq_num 662) 2024-03-30T12:31:03.554 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 23400 (ObjNum 726 snap 242 seq_num 726) dirty exists 2024-03-30T12:31:03.554 INFO:tasks.rados.rados.0.smithi084.stdout:2426: finishing write tid 1 to smithi08477944-8 2024-03-30T12:31:03.554 INFO:tasks.rados.rados.0.smithi084.stdout:2426: finishing write tid 2 to smithi08477944-8 2024-03-30T12:31:03.554 INFO:tasks.rados.rados.0.smithi084.stdout:2427: finishing copy_from racing read to smithi08477944-47 2024-03-30T12:31:03.554 INFO:tasks.rados.rados.0.smithi084.stdout:2421: finishing copy_from racing read to smithi08477944-43 2024-03-30T12:31:03.554 INFO:tasks.rados.rados.0.smithi084.stdout:2427: finishing copy_from to smithi08477944-47 2024-03-30T12:31:03.554 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 995 (ObjNum 707 snap 242 seq_num 707) dirty exists 2024-03-30T12:31:03.554 INFO:tasks.rados.rados.0.smithi084.stdout:2421: finishing copy_from to smithi08477944-43 2024-03-30T12:31:03.554 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 986 (ObjNum 688 snap 241 seq_num 688) dirty exists 2024-03-30T12:31:03.554 INFO:tasks.rados.rados.0.smithi084.stdout:2428: finishing rollback tid 1 to smithi08477944-24 2024-03-30T12:31:03.554 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 11264 (ObjNum 33 snap 0 seq_num 1428957472) dirty dne 2024-03-30T12:31:03.555 INFO:tasks.rados.rados.0.smithi084.stdout:2426: finishing write tid 3 to smithi08477944-8 2024-03-30T12:31:03.555 INFO:tasks.rados.rados.0.smithi084.stdout:2426: oid 8 updating version 0 to 27196 2024-03-30T12:31:03.555 INFO:tasks.rados.rados.0.smithi084.stdout:2426: oid 8 version 27196 is already newer than 27195 2024-03-30T12:31:03.555 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 27196 (ObjNum 750 snap 251 seq_num 750) dirty exists 2024-03-30T12:31:03.555 INFO:tasks.rados.rados.0.smithi084.stdout:2426: left oid 8 (ObjNum 750 snap 251 seq_num 750) 2024-03-30T12:31:03.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:03.401+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:03.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:03.401+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:03.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:03.398+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:03.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:03.398+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:03.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:03.398+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:03.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:03.399+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:03.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:03.399+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:03.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:03.400+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:03.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 137=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:03.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:03.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[89279]: osdmap e576: 8 total, 8 up, 8 in 2024-03-30T12:31:03.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:03.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:03.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:03.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[89279]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:31:03.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[89279]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:31:03.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[89279]: pgmap v550: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 576 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 4.6 MiB/s rd, 208 KiB/s wr, 13 op/s 2024-03-30T12:31:03.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:03.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:03.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:03.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:03.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:03.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:03.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:03.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:03.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:03.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:03.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/1755256990' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:03.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 137=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:03.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:03.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[91810]: osdmap e576: 8 total, 8 up, 8 in 2024-03-30T12:31:03.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:03.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:03.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:03.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[91810]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:31:03.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[91810]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:31:03.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[91810]: pgmap v550: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 576 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 4.6 MiB/s rd, 208 KiB/s wr, 13 op/s 2024-03-30T12:31:03.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:03.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:03.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:03.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:03.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:03.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:03.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:03.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:03.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:03.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:03.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:03 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/1755256990' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:03.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:03.404+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:03.869 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:03.396+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:03.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:03.396+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:03.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:03.394+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:03.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:03.394+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:03.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:03.394+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:03.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:03.402+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:03.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:03.402+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:03.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:03.402+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:03.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 137=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:03.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:03.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-mon[83709]: osdmap e576: 8 total, 8 up, 8 in 2024-03-30T12:31:03.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:03.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:03.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:03.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-mon[83709]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:31:03.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-mon[83709]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:31:03.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-mon[83709]: pgmap v550: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 576 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 4.6 MiB/s rd, 208 KiB/s wr, 13 op/s 2024-03-30T12:31:03.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:03.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:03.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:03.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:03.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:03.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:03.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:03.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:03.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:03.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:03.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:03 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/1755256990' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:04.396 INFO:tasks.rados.rados.0.smithi084.stdout:2421: done (7 left) 2024-03-30T12:31:04.396 INFO:tasks.rados.rados.0.smithi084.stdout:2424: done (6 left) 2024-03-30T12:31:04.396 INFO:tasks.rados.rados.0.smithi084.stdout:2425: done (5 left) 2024-03-30T12:31:04.396 INFO:tasks.rados.rados.0.smithi084.stdout:2426: done (4 left) 2024-03-30T12:31:04.396 INFO:tasks.rados.rados.0.smithi084.stdout:2427: done (3 left) 2024-03-30T12:31:04.396 INFO:tasks.rados.rados.0.smithi084.stdout:2428: done (2 left) 2024-03-30T12:31:04.396 INFO:tasks.rados.rados.0.smithi084.stdout:2429: done (1 left) 2024-03-30T12:31:04.396 INFO:tasks.rados.rados.0.smithi084.stdout:2430: done (0 left) 2024-03-30T12:31:04.396 INFO:tasks.rados.rados.0.smithi084.stdout:2431: read oid 18 snap -1 2024-03-30T12:31:04.396 INFO:tasks.rados.rados.0.smithi084.stdout:2431: expect (ObjNum 733 snap 244 seq_num 733) 2024-03-30T12:31:04.396 INFO:tasks.rados.rados.0.smithi084.stdout:2432: delete oid 31 current snap is 252 2024-03-30T12:31:04.397 INFO:tasks.rados.rados.0.smithi084.stdout:2432: done (1 left) 2024-03-30T12:31:04.398 INFO:tasks.rados.rados.0.smithi084.stdout:2433: snap_create 2024-03-30T12:31:04.404 INFO:tasks.rados.rados.0.smithi084.stdout:2431: expect (ObjNum 733 snap 244 seq_num 733) 2024-03-30T12:31:04.719 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:04.400+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:04.720 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:04.400+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:04.720 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:04.580+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:04.720 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:04.402+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:04.720 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:04.402+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:04.721 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:04.407+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:04.721 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:04.408+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:04.721 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:04.721 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:04.721 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:04 smithi162 ceph-mon[83709]: osdmap e577: 8 total, 8 up, 8 in 2024-03-30T12:31:04.721 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:04.721 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 137=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:04.721 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:04.721 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:04.721 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:04.722 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:04.722 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:04.722 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:04.722 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:04.722 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:04.722 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:04.722 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:04 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:04.722 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:04 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:04.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:04.407+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:04.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:04.408+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:04.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:04.402+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:04.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:04.402+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:04.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:04.402+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:04.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:04.402+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:04.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:04.402+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:04.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:04.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:04.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[91810]: osdmap e577: 8 total, 8 up, 8 in 2024-03-30T12:31:04.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:04.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 137=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:04.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:04.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:04.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:04.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:04.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:04.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:04.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:04.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:04.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:04.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:04.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:04.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:04.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:04.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[89279]: osdmap e577: 8 total, 8 up, 8 in 2024-03-30T12:31:04.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:04.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 137=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:04.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:04.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:04.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:04.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:04.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:04.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:04.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:04.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:04.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:04.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:04.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:04 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:05.405 INFO:tasks.rados.rados.0.smithi084.stdout:2431: done (1 left) 2024-03-30T12:31:05.405 INFO:tasks.rados.rados.0.smithi084.stdout:2433: done (0 left) 2024-03-30T12:31:05.405 INFO:tasks.rados.rados.0.smithi084.stdout:2434: read oid 11 snap -1 2024-03-30T12:31:05.405 INFO:tasks.rados.rados.0.smithi084.stdout:2434: expect (ObjNum 707 snap 242 seq_num 707) 2024-03-30T12:31:05.405 INFO:tasks.rados.rados.0.smithi084.stdout:2435: rmattr oid 45 current snap is 253 2024-03-30T12:31:05.405 INFO:tasks.rados.rados.0.smithi084.stdout:2435: done (1 left) 2024-03-30T12:31:05.405 INFO:tasks.rados.rados.0.smithi084.stdout:2436: rmattr oid 6 current snap is 253 2024-03-30T12:31:05.405 INFO:tasks.rados.rados.0.smithi084.stdout:2436: done (1 left) 2024-03-30T12:31:05.406 INFO:tasks.rados.rados.0.smithi084.stdout:2437: read oid 18 snap 248 2024-03-30T12:31:05.406 INFO:tasks.rados.rados.0.smithi084.stdout:2437: expect (ObjNum 733 snap 244 seq_num 733) 2024-03-30T12:31:05.406 INFO:tasks.rados.rados.0.smithi084.stdout:2438: rollback oid 20 current snap is 253 2024-03-30T12:31:05.406 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 20 to 251 2024-03-30T12:31:05.406 INFO:tasks.rados.rados.0.smithi084.stdout:2439: setattr oid 27 current snap is 253 2024-03-30T12:31:05.408 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 42 current snap is 253 2024-03-30T12:31:05.408 INFO:tasks.rados.rados.0.smithi084.stdout:2440: seq_num 752 ranges {7741440=598016} 2024-03-30T12:31:05.453 INFO:tasks.rados.rados.0.smithi084.stdout:2440: writing smithi08477944-42 from 7741440 to 8339456 tid 1 2024-03-30T12:31:05.454 INFO:tasks.rados.rados.0.smithi084.stdout:2441: snap_remove snap 250 2024-03-30T12:31:05.673 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:05.422+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:05.674 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:05.412+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:05.674 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:05.412+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:05.674 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:05.413+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:05.674 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:05.413+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:05.674 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:05.413+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:05.674 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:05.674 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:05.675 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 137=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:05.675 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:05.675 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:05.675 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:05.675 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:05.675 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:05.675 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:05 smithi162 ceph-mon[83709]: osdmap e578: 8 total, 8 up, 8 in 2024-03-30T12:31:05.675 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:05.675 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:05.675 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:05.675 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:05.675 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:05.675 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:05 smithi162 ceph-mon[83709]: pgmap v553: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 577 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 8.2 MiB/s rd, 1.3 MiB/s wr, 16 op/s 2024-03-30T12:31:05.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:05.426+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:05.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:05.426+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:05.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:05.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:05.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 137=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:05.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:05.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:05.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:05.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:05.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:05.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[91810]: osdmap e578: 8 total, 8 up, 8 in 2024-03-30T12:31:05.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:05.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:05.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:05.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:05.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:05.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[91810]: pgmap v553: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 577 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 8.2 MiB/s rd, 1.3 MiB/s wr, 16 op/s 2024-03-30T12:31:05.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:05.415+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:05.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:05.415+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:05.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:05.415+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:05.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:05.418+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:05.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:05.421+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:05.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:05.421+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:05.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:05.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:05.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 137=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:05.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:05.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:05.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:05.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:05.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:05.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[89279]: osdmap e578: 8 total, 8 up, 8 in 2024-03-30T12:31:05.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:05.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:05.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:05.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:05.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:05.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:05 smithi084 ceph-mon[89279]: pgmap v553: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 577 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 8.2 MiB/s rd, 1.3 MiB/s wr, 16 op/s 2024-03-30T12:31:05.956 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:05.695+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:05.956 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:05.695+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:05.956 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:05.695+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:06.404 INFO:tasks.rados.rados.0.smithi084.stdout:2441: done (5 left) 2024-03-30T12:31:06.405 INFO:tasks.rados.rados.0.smithi084.stdout:2442: rmattr oid 24 current snap is 253 2024-03-30T12:31:06.405 INFO:tasks.rados.rados.0.smithi084.stdout:2442: done (5 left) 2024-03-30T12:31:06.405 INFO:tasks.rados.rados.0.smithi084.stdout:2443: read oid 33 snap 251 2024-03-30T12:31:06.405 INFO:tasks.rados.rados.0.smithi084.stdout:2443: expect deleted 2024-03-30T12:31:06.405 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 253 2024-03-30T12:31:06.405 INFO:tasks.rados.rados.0.smithi084.stdout:2444: seq_num 753 ranges {131072=614400} 2024-03-30T12:31:06.409 INFO:tasks.rados.rados.0.smithi084.stdout:2444: writing smithi08477944-2 from 131072 to 745472 tid 1 2024-03-30T12:31:06.409 INFO:tasks.rados.rados.0.smithi084.stdout:2445: rollback oid 49 current snap is 253 2024-03-30T12:31:06.409 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 49 to 249 2024-03-30T12:31:06.409 INFO:tasks.rados.rados.0.smithi084.stdout:2434: expect (ObjNum 707 snap 242 seq_num 707) 2024-03-30T12:31:06.475 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 23379 (ObjNum 723 snap 242 seq_num 723) dirty exists 2024-03-30T12:31:06.475 INFO:tasks.rados.rados.0.smithi084.stdout:2438: finishing rollback tid 0 to smithi08477944-20 2024-03-30T12:31:06.475 INFO:tasks.rados.rados.0.smithi084.stdout:2434: done (7 left) 2024-03-30T12:31:06.475 INFO:tasks.rados.rados.0.smithi084.stdout:2439: done (6 left) 2024-03-30T12:31:06.475 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 253 2024-03-30T12:31:06.475 INFO:tasks.rados.rados.0.smithi084.stdout:2438: finishing rollback tid 1 to smithi08477944-20 2024-03-30T12:31:06.475 INFO:tasks.rados.rados.0.smithi084.stdout:2446: seq_num 754 ranges {0=630784} 2024-03-30T12:31:06.478 INFO:tasks.rados.rados.0.smithi084.stdout:2446: writing smithi08477944-9 from 0 to 630784 tid 1 2024-03-30T12:31:06.478 INFO:tasks.rados.rados.0.smithi084.stdout:2447: delete oid 16 current snap is 253 2024-03-30T12:31:06.479 INFO:tasks.rados.rados.0.smithi084.stdout:2438: finishing rollback tid 2 to smithi08477944-20 2024-03-30T12:31:06.479 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 17536 (ObjNum 741 snap 248 seq_num 741) dirty exists 2024-03-30T12:31:06.479 INFO:tasks.rados.rados.0.smithi084.stdout:2437: expect (ObjNum 733 snap 244 seq_num 733) 2024-03-30T12:31:06.652 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:06.410+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:06.653 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:06.410+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:06.653 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:06.491+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:06.653 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:06.491+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 137=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:06.653 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:06.420+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:06.653 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:06.425+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:06.654 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:06.654 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 137=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:06.654 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:06 smithi162 ceph-mon[83709]: osdmap e579: 8 total, 8 up, 8 in 2024-03-30T12:31:06.654 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:06.654 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:06.654 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:06.654 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:06.654 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:06.654 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:06.654 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:06.654 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:06.654 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:06.654 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:06.654 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:06.658 INFO:tasks.rados.rados.0.smithi084.stdout:2440: finishing write tid 1 to smithi08477944-42 2024-03-30T12:31:06.658 INFO:tasks.rados.rados.0.smithi084.stdout:2437: done (7 left) 2024-03-30T12:31:06.658 INFO:tasks.rados.rados.0.smithi084.stdout:2438: done (6 left) 2024-03-30T12:31:06.658 INFO:tasks.rados.rados.0.smithi084.stdout:2447: done (5 left) 2024-03-30T12:31:06.659 INFO:tasks.rados.rados.0.smithi084.stdout:2448: setattr oid 26 current snap is 253 2024-03-30T12:31:06.659 INFO:tasks.rados.rados.0.smithi084.stdout:2440: finishing write tid 2 to smithi08477944-42 2024-03-30T12:31:06.659 INFO:tasks.rados.rados.0.smithi084.stdout:2440: finishing write tid 3 to smithi08477944-42 2024-03-30T12:31:06.659 INFO:tasks.rados.rados.0.smithi084.stdout:2440: oid 42 updating version 0 to 17515 2024-03-30T12:31:06.659 INFO:tasks.rados.rados.0.smithi084.stdout:2440: oid 42 updating version 17515 to 17516 2024-03-30T12:31:06.659 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 17516 (ObjNum 752 snap 253 seq_num 752) dirty exists 2024-03-30T12:31:06.659 INFO:tasks.rados.rados.0.smithi084.stdout:2440: left oid 42 (ObjNum 752 snap 253 seq_num 752) 2024-03-30T12:31:06.659 INFO:tasks.rados.rados.0.smithi084.stdout:2445: finishing rollback tid 0 to smithi08477944-49 2024-03-30T12:31:06.659 INFO:tasks.rados.rados.0.smithi084.stdout:2445: finishing rollback tid 1 to smithi08477944-49 2024-03-30T12:31:06.659 INFO:tasks.rados.rados.0.smithi084.stdout:2445: finishing rollback tid 2 to smithi08477944-49 2024-03-30T12:31:06.659 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 17515 (ObjNum 717 snap 242 seq_num 717) dirty exists 2024-03-30T12:31:06.659 INFO:tasks.rados.rados.0.smithi084.stdout:2444: finishing write tid 1 to smithi08477944-2 2024-03-30T12:31:06.659 INFO:tasks.rados.rados.0.smithi084.stdout:2444: finishing write tid 2 to smithi08477944-2 2024-03-30T12:31:06.659 INFO:tasks.rados.rados.0.smithi084.stdout:2444: finishing write tid 3 to smithi08477944-2 2024-03-30T12:31:06.659 INFO:tasks.rados.rados.0.smithi084.stdout:2444: oid 2 updating version 0 to 27199 2024-03-30T12:31:06.659 INFO:tasks.rados.rados.0.smithi084.stdout:2444: oid 2 version 27199 is already newer than 27198 2024-03-30T12:31:06.659 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 27199 (ObjNum 753 snap 253 seq_num 753) dirty exists 2024-03-30T12:31:06.660 INFO:tasks.rados.rados.0.smithi084.stdout:2444: left oid 2 (ObjNum 753 snap 253 seq_num 753) 2024-03-30T12:31:06.660 INFO:tasks.rados.rados.0.smithi084.stdout:2446: finishing write tid 1 to smithi08477944-9 2024-03-30T12:31:06.660 INFO:tasks.rados.rados.0.smithi084.stdout:2446: finishing write tid 2 to smithi08477944-9 2024-03-30T12:31:06.660 INFO:tasks.rados.rados.0.smithi084.stdout:2446: finishing write tid 3 to smithi08477944-9 2024-03-30T12:31:06.660 INFO:tasks.rados.rados.0.smithi084.stdout:2446: oid 9 updating version 0 to 22494 2024-03-30T12:31:06.660 INFO:tasks.rados.rados.0.smithi084.stdout:2446: oid 9 version 22494 is already newer than 22493 2024-03-30T12:31:06.660 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 22494 (ObjNum 754 snap 253 seq_num 754) dirty exists 2024-03-30T12:31:06.660 INFO:tasks.rados.rados.0.smithi084.stdout:2446: left oid 9 (ObjNum 754 snap 253 seq_num 754) 2024-03-30T12:31:06.660 INFO:tasks.rados.rados.0.smithi084.stdout:2440: done (5 left) 2024-03-30T12:31:06.660 INFO:tasks.rados.rados.0.smithi084.stdout:2443: done (4 left) 2024-03-30T12:31:06.660 INFO:tasks.rados.rados.0.smithi084.stdout:2444: done (3 left) 2024-03-30T12:31:06.660 INFO:tasks.rados.rados.0.smithi084.stdout:2445: done (2 left) 2024-03-30T12:31:06.660 INFO:tasks.rados.rados.0.smithi084.stdout:2446: done (1 left) 2024-03-30T12:31:06.660 INFO:tasks.rados.rados.0.smithi084.stdout:2449: read oid 22 snap -1 2024-03-30T12:31:06.660 INFO:tasks.rados.rados.0.smithi084.stdout:2449: expect (ObjNum 706 snap 242 seq_num 706) 2024-03-30T12:31:06.660 INFO:tasks.rados.rados.0.smithi084.stdout:2450: rmattr oid 4 current snap is 253 2024-03-30T12:31:06.661 INFO:tasks.rados.rados.0.smithi084.stdout:2451: copy_from oid 42 from oid 37 current snap is 253 2024-03-30T12:31:06.661 INFO:tasks.rados.rados.0.smithi084.stdout:2452: delete oid 11 current snap is 253 2024-03-30T12:31:06.661 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 17514 (ObjNum 662 snap 232 seq_num 662) dirty exists 2024-03-30T12:31:06.663 INFO:tasks.rados.rados.0.smithi084.stdout:2450: done (4 left) 2024-03-30T12:31:06.663 INFO:tasks.rados.rados.0.smithi084.stdout:2452: done (3 left) 2024-03-30T12:31:06.663 INFO:tasks.rados.rados.0.smithi084.stdout:2453: read oid 43 snap -1 2024-03-30T12:31:06.663 INFO:tasks.rados.rados.0.smithi084.stdout:2453: expect (ObjNum 688 snap 241 seq_num 688) 2024-03-30T12:31:06.663 INFO:tasks.rados.rados.0.smithi084.stdout:2454: copy_from oid 10 from oid 48 current snap is 253 2024-03-30T12:31:06.663 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 253 2024-03-30T12:31:06.663 INFO:tasks.rados.rados.0.smithi084.stdout:2455: seq_num 757 ranges {2252800=688128} 2024-03-30T12:31:06.680 INFO:tasks.rados.rados.0.smithi084.stdout:2455: writing smithi08477944-47 from 2252800 to 2940928 tid 1 2024-03-30T12:31:06.680 INFO:tasks.rados.rados.0.smithi084.stdout:2456: delete oid 6 current snap is 253 2024-03-30T12:31:06.680 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 27201 (ObjNum 738 snap 244 seq_num 738) dirty exists 2024-03-30T12:31:06.680 INFO:tasks.rados.rados.0.smithi084.stdout:2451: finishing copy_from racing read to smithi08477944-42 2024-03-30T12:31:06.680 INFO:tasks.rados.rados.0.smithi084.stdout:2451: finishing copy_from to smithi08477944-42 2024-03-30T12:31:06.680 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 23400 (ObjNum 726 snap 242 seq_num 726) dirty exists 2024-03-30T12:31:06.684 INFO:tasks.rados.rados.0.smithi084.stdout:2453: expect (ObjNum 688 snap 241 seq_num 688) 2024-03-30T12:31:06.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:06.420+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:06.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:06.425+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:06.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:06.409+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:06.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:06.411+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:06.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:06.411+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:06.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:06.411+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:06.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:06.412+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:06.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:06.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 137=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:06.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[89279]: osdmap e579: 8 total, 8 up, 8 in 2024-03-30T12:31:06.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:06.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:06.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:06.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:06.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:06.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:06.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:06.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:06.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:06.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:06.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:06.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:06.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 137=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:06.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[91810]: osdmap e579: 8 total, 8 up, 8 in 2024-03-30T12:31:06.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:06.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:06.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:06.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:06.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:06.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:06.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:06.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:06.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:06.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:06.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:06.796 INFO:tasks.rados.rados.0.smithi084.stdout:2455: finishing write tid 1 to smithi08477944-47 2024-03-30T12:31:06.797 INFO:tasks.rados.rados.0.smithi084.stdout:2455: finishing write tid 2 to smithi08477944-47 2024-03-30T12:31:06.797 INFO:tasks.rados.rados.0.smithi084.stdout:2455: finishing write tid 3 to smithi08477944-47 2024-03-30T12:31:06.797 INFO:tasks.rados.rados.0.smithi084.stdout:2455: oid 47 updating version 0 to 17538 2024-03-30T12:31:06.797 INFO:tasks.rados.rados.0.smithi084.stdout:2455: oid 47 version 17538 is already newer than 17537 2024-03-30T12:31:06.797 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 17538 (ObjNum 757 snap 253 seq_num 757) dirty exists 2024-03-30T12:31:06.797 INFO:tasks.rados.rados.0.smithi084.stdout:2455: left oid 47 (ObjNum 757 snap 253 seq_num 757) 2024-03-30T12:31:06.797 INFO:tasks.rados.rados.0.smithi084.stdout:2454: finishing copy_from racing read to smithi08477944-10 2024-03-30T12:31:06.797 INFO:tasks.rados.rados.0.smithi084.stdout:2454: finishing copy_from to smithi08477944-10 2024-03-30T12:31:06.797 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 920 (ObjNum 677 snap 239 seq_num 677) dirty exists 2024-03-30T12:31:06.797 INFO:tasks.rados.rados.0.smithi084.stdout:2449: expect (ObjNum 706 snap 242 seq_num 706) 2024-03-30T12:31:07.022 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:06.674+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:07.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:07.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:07.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:07.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:07 smithi162 ceph-mon[83709]: osdmap e580: 8 total, 8 up, 8 in 2024-03-30T12:31:07.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:07.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:07.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:07.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:07.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:07.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:07.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:07.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:07.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 137=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:07.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:07.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:07 smithi162 ceph-mon[83709]: pgmap v556: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 582 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 3.6 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2024-03-30T12:31:07.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:07 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:07.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:07 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:07.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:07 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:31:07.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:07 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:31:07.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:07 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:07.750 INFO:tasks.rados.rados.0.smithi084.stdout:2448: done (6 left) 2024-03-30T12:31:07.750 INFO:tasks.rados.rados.0.smithi084.stdout:2449: done (5 left) 2024-03-30T12:31:07.750 INFO:tasks.rados.rados.0.smithi084.stdout:2451: done (4 left) 2024-03-30T12:31:07.750 INFO:tasks.rados.rados.0.smithi084.stdout:2453: done (3 left) 2024-03-30T12:31:07.750 INFO:tasks.rados.rados.0.smithi084.stdout:2454: done (2 left) 2024-03-30T12:31:07.750 INFO:tasks.rados.rados.0.smithi084.stdout:2455: done (1 left) 2024-03-30T12:31:07.750 INFO:tasks.rados.rados.0.smithi084.stdout:2456: done (0 left) 2024-03-30T12:31:07.750 INFO:tasks.rados.rados.0.smithi084.stdout:2457: rollback oid 8 current snap is 253 2024-03-30T12:31:07.750 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 8 to 252 2024-03-30T12:31:07.750 INFO:tasks.rados.rados.0.smithi084.stdout:2458: copy_from oid 10 from oid 47 current snap is 253 2024-03-30T12:31:07.750 INFO:tasks.rados.rados.0.smithi084.stdout:2459: rollback oid 12 current snap is 253 2024-03-30T12:31:07.751 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 12 to 248 2024-03-30T12:31:07.751 INFO:tasks.rados.rados.0.smithi084.stdout:2460: delete oid 43 current snap is 253 2024-03-30T12:31:07.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:07.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:07.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:07.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[89279]: osdmap e580: 8 total, 8 up, 8 in 2024-03-30T12:31:07.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:07.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:07.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:07.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:07.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:07.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:07.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:07.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:07.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 137=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:07.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:07.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[89279]: pgmap v556: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 582 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 3.6 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2024-03-30T12:31:07.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:07.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:07.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:31:07.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:31:07.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:07.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:07.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:07.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:07.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[91810]: osdmap e580: 8 total, 8 up, 8 in 2024-03-30T12:31:07.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:07.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:07.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:07.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:07.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:07.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:07.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:07.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:07.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 137=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:07.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:07.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[91810]: pgmap v556: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 582 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 3.6 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2024-03-30T12:31:07.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:07.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:07.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:31:07.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:31:07.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:07 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:07.757 INFO:tasks.rados.rados.0.smithi084.stdout:2459: finishing rollback tid 0 to smithi08477944-12 2024-03-30T12:31:07.758 INFO:tasks.rados.rados.0.smithi084.stdout:2460: done (3 left) 2024-03-30T12:31:07.758 INFO:tasks.rados.rados.0.smithi084.stdout:2461: read oid 37 snap -1 2024-03-30T12:31:07.758 INFO:tasks.rados.rados.0.smithi084.stdout:2461: expect (ObjNum 726 snap 242 seq_num 726) 2024-03-30T12:31:07.758 INFO:tasks.rados.rados.0.smithi084.stdout:2462: delete oid 36 current snap is 253 2024-03-30T12:31:07.758 INFO:tasks.rados.rados.0.smithi084.stdout:2459: finishing rollback tid 1 to smithi08477944-12 2024-03-30T12:31:07.758 INFO:tasks.rados.rados.0.smithi084.stdout:2459: finishing rollback tid 2 to smithi08477944-12 2024-03-30T12:31:07.759 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 23382 (ObjNum 743 snap 248 seq_num 743) dirty exists 2024-03-30T12:31:07.760 INFO:tasks.rados.rados.0.smithi084.stdout:2459: done (4 left) 2024-03-30T12:31:07.760 INFO:tasks.rados.rados.0.smithi084.stdout:2462: done (3 left) 2024-03-30T12:31:07.760 INFO:tasks.rados.rados.0.smithi084.stdout:2463: copy_from oid 6 from oid 45 current snap is 253 2024-03-30T12:31:07.760 INFO:tasks.rados.rados.0.smithi084.stdout:2464: delete oid 46 current snap is 253 2024-03-30T12:31:07.763 INFO:tasks.rados.rados.0.smithi084.stdout:2457: finishing rollback tid 0 to smithi08477944-8 2024-03-30T12:31:07.763 INFO:tasks.rados.rados.0.smithi084.stdout:2457: finishing rollback tid 1 to smithi08477944-8 2024-03-30T12:31:07.763 INFO:tasks.rados.rados.0.smithi084.stdout:2457: finishing rollback tid 2 to smithi08477944-8 2024-03-30T12:31:07.763 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 27205 (ObjNum 750 snap 251 seq_num 750) dirty exists 2024-03-30T12:31:07.767 INFO:tasks.rados.rados.0.smithi084.stdout:2458: finishing copy_from racing read to smithi08477944-10 2024-03-30T12:31:07.773 INFO:tasks.rados.rados.0.smithi084.stdout:2457: done (4 left) 2024-03-30T12:31:07.773 INFO:tasks.rados.rados.0.smithi084.stdout:2464: done (3 left) 2024-03-30T12:31:07.773 INFO:tasks.rados.rados.0.smithi084.stdout:2465: setattr oid 13 current snap is 253 2024-03-30T12:31:07.773 INFO:tasks.rados.rados.0.smithi084.stdout:2461: expect (ObjNum 726 snap 242 seq_num 726) 2024-03-30T12:31:07.813 INFO:tasks.rados.rados.0.smithi084.stdout:2458: finishing copy_from to smithi08477944-10 2024-03-30T12:31:07.813 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 17538 (ObjNum 757 snap 253 seq_num 757) dirty exists 2024-03-30T12:31:07.813 INFO:tasks.rados.rados.0.smithi084.stdout:2463: finishing copy_from racing read to smithi08477944-6 2024-03-30T12:31:07.813 INFO:tasks.rados.rados.0.smithi084.stdout:2463: finishing copy_from to smithi08477944-6 2024-03-30T12:31:07.813 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 973 (ObjNum 664 snap 232 seq_num 664) dirty exists 2024-03-30T12:31:07.813 INFO:tasks.rados.rados.0.smithi084.stdout:2458: done (3 left) 2024-03-30T12:31:07.814 INFO:tasks.rados.rados.0.smithi084.stdout:2461: done (2 left) 2024-03-30T12:31:07.814 INFO:tasks.rados.rados.0.smithi084.stdout:2463: done (1 left) 2024-03-30T12:31:07.814 INFO:tasks.rados.rados.0.smithi084.stdout:2466: rollback oid 16 current snap is 253 2024-03-30T12:31:07.814 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 16 to 251 2024-03-30T12:31:07.814 INFO:tasks.rados.rados.0.smithi084.stdout:2467: copy_from oid 1 from oid 45 current snap is 253 2024-03-30T12:31:07.814 INFO:tasks.rados.rados.0.smithi084.stdout:2468: rollback oid 37 current snap is 253 2024-03-30T12:31:07.814 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 37 to 252 2024-03-30T12:31:07.814 INFO:tasks.rados.rados.0.smithi084.stdout:2469: read oid 3 snap -1 2024-03-30T12:31:07.814 INFO:tasks.rados.rados.0.smithi084.stdout:2469: expect (ObjNum 729 snap 244 seq_num 729) 2024-03-30T12:31:07.814 INFO:tasks.rados.rados.0.smithi084.stdout:2470: read oid 35 snap -1 2024-03-30T12:31:07.815 INFO:tasks.rados.rados.0.smithi084.stdout:2470: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:31:07.815 INFO:tasks.rados.rados.0.smithi084.stdout:2471: delete oid 23 current snap is 253 2024-03-30T12:31:07.815 INFO:tasks.rados.rados.0.smithi084.stdout:2470: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:31:07.817 INFO:tasks.rados.rados.0.smithi084.stdout:2466: finishing rollback tid 1 to smithi08477944-16 2024-03-30T12:31:07.817 INFO:tasks.rados.rados.0.smithi084.stdout:2470: done (6 left) 2024-03-30T12:31:07.817 INFO:tasks.rados.rados.0.smithi084.stdout:2471: done (5 left) 2024-03-30T12:31:07.817 INFO:tasks.rados.rados.0.smithi084.stdout:2472: copy_from oid 14 from oid 24 current snap is 253 2024-03-30T12:31:07.818 INFO:tasks.rados.rados.0.smithi084.stdout:2473: snap_remove snap 249 2024-03-30T12:31:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:31:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: Upgrade: Setting container_image for all mds 2024-03-30T12:31:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.a"}]: dispatch 2024-03-30T12:31:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.a"}]': finished 2024-03-30T12:31:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.b"}]: dispatch 2024-03-30T12:31:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.b"}]': finished 2024-03-30T12:31:08.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: Upgrade: Setting container_image for all rgw 2024-03-30T12:31:08.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:08.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: Upgrade: Setting container_image for all rbd-mirror 2024-03-30T12:31:08.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:08.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: Upgrade: Setting container_image for all ceph-exporter 2024-03-30T12:31:08.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:08.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: Upgrade: Setting container_image for all iscsi 2024-03-30T12:31:08.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:08.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: Upgrade: Setting container_image for all nfs 2024-03-30T12:31:08.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:08.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: Upgrade: Setting container_image for all nvmeof 2024-03-30T12:31:08.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:08.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:31:08.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: Upgrade: Setting container_image for all mds 2024-03-30T12:31:08.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:08.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.a"}]: dispatch 2024-03-30T12:31:08.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.a"}]': finished 2024-03-30T12:31:08.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.b"}]: dispatch 2024-03-30T12:31:08.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.b"}]': finished 2024-03-30T12:31:08.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: Upgrade: Setting container_image for all rgw 2024-03-30T12:31:08.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:08.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: Upgrade: Setting container_image for all rbd-mirror 2024-03-30T12:31:08.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:08.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: Upgrade: Setting container_image for all ceph-exporter 2024-03-30T12:31:08.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:08.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: Upgrade: Setting container_image for all iscsi 2024-03-30T12:31:08.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:08.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: Upgrade: Setting container_image for all nfs 2024-03-30T12:31:08.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:08.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: Upgrade: Setting container_image for all nvmeof 2024-03-30T12:31:08.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:08.606 INFO:tasks.rados.rados.0.smithi084.stdout:2473: done (6 left) 2024-03-30T12:31:08.606 INFO:tasks.rados.rados.0.smithi084.stdout:2474: setattr oid 19 current snap is 253 2024-03-30T12:31:08.606 INFO:tasks.rados.rados.0.smithi084.stdout:2466: finishing rollback tid 2 to smithi08477944-16 2024-03-30T12:31:08.606 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 1017 (ObjNum 745 snap 249 seq_num 745) dirty exists 2024-03-30T12:31:08.607 INFO:tasks.rados.rados.0.smithi084.stdout:2469: expect (ObjNum 729 snap 244 seq_num 729) 2024-03-30T12:31:08.615 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 17489 (ObjNum 498 snap 156 seq_num 498) dirty exists 2024-03-30T12:31:08.615 INFO:tasks.rados.rados.0.smithi084.stdout:2467: finishing copy_from racing read to smithi08477944-1 2024-03-30T12:31:08.615 INFO:tasks.rados.rados.0.smithi084.stdout:2467: finishing copy_from to smithi08477944-1 2024-03-30T12:31:08.615 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 973 (ObjNum 664 snap 232 seq_num 664) dirty exists 2024-03-30T12:31:08.615 INFO:tasks.rados.rados.0.smithi084.stdout:2468: finishing rollback tid 0 to smithi08477944-37 2024-03-30T12:31:08.615 INFO:tasks.rados.rados.0.smithi084.stdout:2468: finishing rollback tid 1 to smithi08477944-37 2024-03-30T12:31:08.615 INFO:tasks.rados.rados.0.smithi084.stdout:2472: finishing copy_from to smithi08477944-14 2024-03-30T12:31:08.615 INFO:tasks.rados.rados.0.smithi084.stdout:2472: got expected ENOENT (src dne) 2024-03-30T12:31:08.615 INFO:tasks.rados.rados.0.smithi084.stdout:2472: finishing copy_from racing read to smithi08477944-14 2024-03-30T12:31:08.615 INFO:tasks.rados.rados.0.smithi084.stdout:2468: finishing rollback tid 2 to smithi08477944-37 2024-03-30T12:31:08.615 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 23403 (ObjNum 726 snap 242 seq_num 726) dirty exists 2024-03-30T12:31:08.615 INFO:tasks.rados.rados.0.smithi084.stdout:2465: done (6 left) 2024-03-30T12:31:08.615 INFO:tasks.rados.rados.0.smithi084.stdout:2466: done (5 left) 2024-03-30T12:31:08.616 INFO:tasks.rados.rados.0.smithi084.stdout:2467: done (4 left) 2024-03-30T12:31:08.616 INFO:tasks.rados.rados.0.smithi084.stdout:2468: done (3 left) 2024-03-30T12:31:08.616 INFO:tasks.rados.rados.0.smithi084.stdout:2469: done (2 left) 2024-03-30T12:31:08.616 INFO:tasks.rados.rados.0.smithi084.stdout:2472: done (1 left) 2024-03-30T12:31:08.616 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 253 2024-03-30T12:31:08.616 INFO:tasks.rados.rados.0.smithi084.stdout:2475: seq_num 763 ranges {2940928=786432} 2024-03-30T12:31:08.634 INFO:tasks.rados.rados.0.smithi084.stdout:2475: writing smithi08477944-47 from 2940928 to 3727360 tid 1 2024-03-30T12:31:08.634 INFO:tasks.rados.rados.0.smithi084.stdout:2476: read oid 43 snap -1 2024-03-30T12:31:08.634 INFO:tasks.rados.rados.0.smithi084.stdout:2476: expect deleted 2024-03-30T12:31:08.634 INFO:tasks.rados.rados.0.smithi084.stdout:2477: snap_remove snap 252 2024-03-30T12:31:08.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:08.612+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:08.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:08.612+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:08.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:08.612+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:08.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:08.614+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:08.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:08.614+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:08.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:31:08.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: Upgrade: Setting container_image for all mds 2024-03-30T12:31:08.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:08.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.a"}]: dispatch 2024-03-30T12:31:08.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.a"}]': finished 2024-03-30T12:31:08.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.b"}]: dispatch 2024-03-30T12:31:08.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.b"}]': finished 2024-03-30T12:31:08.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: Upgrade: Setting container_image for all rgw 2024-03-30T12:31:08.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:08.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: Upgrade: Setting container_image for all rbd-mirror 2024-03-30T12:31:08.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:08.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: Upgrade: Setting container_image for all ceph-exporter 2024-03-30T12:31:08.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:08.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: Upgrade: Setting container_image for all iscsi 2024-03-30T12:31:08.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:08.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: Upgrade: Setting container_image for all nfs 2024-03-30T12:31:08.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:08.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:08.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: Upgrade: Setting container_image for all nvmeof 2024-03-30T12:31:08.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:08 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:09.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:08.647+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:09.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:08.647+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:09.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:08.612+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:09.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:08.612+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:09.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:08.612+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:09.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:08.612+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:09.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:08.613+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:09.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:08.613+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:09.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:09.098+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:09.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:09.099+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:09.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:09.099+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:09.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:09.099+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:09.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:31:09] "GET /metrics HTTP/1.1" 200 36329 "" "Prometheus/2.43.0" 2024-03-30T12:31:09.610 INFO:tasks.rados.rados.0.smithi084.stdout:2477: done (3 left) 2024-03-30T12:31:09.610 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 253 2024-03-30T12:31:09.610 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 36229 (ObjNum 65 snap 0 seq_num 1397648474) dirty exists 2024-03-30T12:31:09.610 INFO:tasks.rados.rados.0.smithi084.stdout:2478: seq_num 764 ranges {0=802816} 2024-03-30T12:31:09.614 INFO:tasks.rados.rados.0.smithi084.stdout:2478: writing smithi08477944-14 from 0 to 802816 tid 1 2024-03-30T12:31:09.614 INFO:tasks.rados.rados.0.smithi084.stdout:2474: done (3 left) 2024-03-30T12:31:09.614 INFO:tasks.rados.rados.0.smithi084.stdout:2479: snap_remove snap 251 2024-03-30T12:31:09.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:09.636+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:09.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:09.619+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:09.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:09.619+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:09.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:09.631+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:09.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:09.631+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:09.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:09.617+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:09.871 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:09.618+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:09.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:09 smithi162 ceph-mon[83709]: osdmap e581: 8 total, 8 up, 8 in 2024-03-30T12:31:09.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:09.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:09.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:09.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:09.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:09.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:09.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:09.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:09.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:09.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:09.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:09 smithi162 ceph-mon[83709]: pgmap v558: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 591 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 8.0 MiB/s rd, 2.5 MiB/s wr, 25 op/s 2024-03-30T12:31:09.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:09.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:10.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:09.629+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:10.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:09.629+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:10.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[91810]: osdmap e581: 8 total, 8 up, 8 in 2024-03-30T12:31:10.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:10.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:10.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:10.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:10.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:10.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:10.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:10.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:10.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:10.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:10.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[91810]: pgmap v558: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 591 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 8.0 MiB/s rd, 2.5 MiB/s wr, 25 op/s 2024-03-30T12:31:10.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:10.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:10.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[89279]: osdmap e581: 8 total, 8 up, 8 in 2024-03-30T12:31:10.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:10.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:10.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:10.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:10.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:10.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:10.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:10.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:10.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:10.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:10.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[89279]: pgmap v558: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 591 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 8.0 MiB/s rd, 2.5 MiB/s wr, 25 op/s 2024-03-30T12:31:10.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:10.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:10.381 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:10 smithi084 systemd[1]: Stopping Ceph node-exporter.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:31:10.407 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:10.030+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:10.407 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:10.030+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:10.407 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:10.030+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:10.407 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:10.030+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:10.407 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:10.030+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:10.616 INFO:tasks.rados.rados.0.smithi084.stdout:2479: done (3 left) 2024-03-30T12:31:10.616 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 253 2024-03-30T12:31:10.616 INFO:tasks.rados.rados.0.smithi084.stdout:2475: finishing write tid 1 to smithi08477944-47 2024-03-30T12:31:10.616 INFO:tasks.rados.rados.0.smithi084.stdout:2475: finishing write tid 2 to smithi08477944-47 2024-03-30T12:31:10.616 INFO:tasks.rados.rados.0.smithi084.stdout:2475: finishing write tid 3 to smithi08477944-47 2024-03-30T12:31:10.616 INFO:tasks.rados.rados.0.smithi084.stdout:2475: oid 47 updating version 0 to 17539 2024-03-30T12:31:10.617 INFO:tasks.rados.rados.0.smithi084.stdout:2475: oid 47 updating version 17539 to 17540 2024-03-30T12:31:10.617 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 17540 (ObjNum 763 snap 253 seq_num 763) dirty exists 2024-03-30T12:31:10.617 INFO:tasks.rados.rados.0.smithi084.stdout:2475: left oid 47 (ObjNum 763 snap 253 seq_num 763) 2024-03-30T12:31:10.617 INFO:tasks.rados.rados.0.smithi084.stdout:2478: finishing write tid 1 to smithi08477944-14 2024-03-30T12:31:10.617 INFO:tasks.rados.rados.0.smithi084.stdout:2478: finishing write tid 2 to smithi08477944-14 2024-03-30T12:31:10.617 INFO:tasks.rados.rados.0.smithi084.stdout:2478: finishing write tid 3 to smithi08477944-14 2024-03-30T12:31:10.617 INFO:tasks.rados.rados.0.smithi084.stdout:2478: oid 14 updating version 0 to 23405 2024-03-30T12:31:10.617 INFO:tasks.rados.rados.0.smithi084.stdout:2478: oid 14 version 23405 is already newer than 23404 2024-03-30T12:31:10.617 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 23405 (ObjNum 764 snap 253 seq_num 764) dirty exists 2024-03-30T12:31:10.617 INFO:tasks.rados.rados.0.smithi084.stdout:2478: left oid 14 (ObjNum 764 snap 253 seq_num 764) 2024-03-30T12:31:10.617 INFO:tasks.rados.rados.0.smithi084.stdout:2480: seq_num 765 ranges {565248=417792,983040=401408} 2024-03-30T12:31:10.621 INFO:tasks.rados.rados.0.smithi084.stdout:2480: writing smithi08477944-8 from 565248 to 983040 tid 1 2024-03-30T12:31:10.624 INFO:tasks.rados.rados.0.smithi084.stdout:2480: writing smithi08477944-8 from 983040 to 1384448 tid 2 2024-03-30T12:31:10.624 INFO:tasks.rados.rados.0.smithi084.stdout:2475: done (3 left) 2024-03-30T12:31:10.624 INFO:tasks.rados.rados.0.smithi084.stdout:2476: done (2 left) 2024-03-30T12:31:10.624 INFO:tasks.rados.rados.0.smithi084.stdout:2478: done (1 left) 2024-03-30T12:31:10.624 INFO:tasks.rados.rados.0.smithi084.stdout:2481: snap_create 2024-03-30T12:31:10.632 INFO:tasks.rados.rados.0.smithi084.stdout:2480: finishing write tid 1 to smithi08477944-8 2024-03-30T12:31:10.633 INFO:tasks.rados.rados.0.smithi084.stdout:2480: finishing write tid 2 to smithi08477944-8 2024-03-30T12:31:10.633 INFO:tasks.rados.rados.0.smithi084.stdout:2480: finishing write tid 3 to smithi08477944-8 2024-03-30T12:31:10.635 INFO:tasks.rados.rados.0.smithi084.stdout:2480: finishing write tid 4 to smithi08477944-8 2024-03-30T12:31:10.635 INFO:tasks.rados.rados.0.smithi084.stdout:2480: oid 8 updating version 0 to 27208 2024-03-30T12:31:10.635 INFO:tasks.rados.rados.0.smithi084.stdout:2480: oid 8 updating version 27208 to 27209 2024-03-30T12:31:10.635 INFO:tasks.rados.rados.0.smithi084.stdout:2480: oid 8 updating version 27209 to 27210 2024-03-30T12:31:10.635 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 27210 (ObjNum 765 snap 253 seq_num 765) dirty exists 2024-03-30T12:31:10.635 INFO:tasks.rados.rados.0.smithi084.stdout:2480: left oid 8 (ObjNum 765 snap 253 seq_num 765) 2024-03-30T12:31:10.672 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:10 smithi084 podman[121083]: 2024-03-30 12:31:10.390964852 +0000 UTC m=+0.132992358 container died 66844bed39e89e9176df3b27326031a73b452252863843e518998a2bcaadc294 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T12:31:10.672 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:10.629+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:10.672 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:10.629+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:10.673 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:10.622+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:10.673 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:10.622+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:10.673 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:10.623+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:10.673 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:10.623+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:10.673 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:10.623+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:10.673 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:10.623+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:10.673 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:10.674 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[91810]: Upgrade: Updating node-exporter.a (1/2) 2024-03-30T12:31:10.674 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[91810]: Deploying daemon node-exporter.a on smithi084 2024-03-30T12:31:10.674 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:10.674 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[91810]: osdmap e582: 8 total, 8 up, 8 in 2024-03-30T12:31:10.674 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:10.674 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:10.674 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:10.674 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:10.674 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:10.674 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:10.674 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:10.674 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:10.675 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:10.675 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[89279]: Upgrade: Updating node-exporter.a (1/2) 2024-03-30T12:31:10.675 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[89279]: Deploying daemon node-exporter.a on smithi084 2024-03-30T12:31:10.675 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:10.675 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[89279]: osdmap e582: 8 total, 8 up, 8 in 2024-03-30T12:31:10.675 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:10.675 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:10.675 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:10.675 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:10.675 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:10.675 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:10.675 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:10.675 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:10.869 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:10.625+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:10.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:10.625+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:10.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:10.623+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:10.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:10.623+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:10.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:10.624+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:10.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:10.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:10 smithi162 ceph-mon[83709]: Upgrade: Updating node-exporter.a (1/2) 2024-03-30T12:31:10.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:10 smithi162 ceph-mon[83709]: Deploying daemon node-exporter.a on smithi084 2024-03-30T12:31:10.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:10.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:10 smithi162 ceph-mon[83709]: osdmap e582: 8 total, 8 up, 8 in 2024-03-30T12:31:10.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:10.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:10.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:10.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:10.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:10.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:10.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:10.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:10.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:10.627+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:10.872 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:10.627+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:10.872 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:10.627+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:11.003 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:10 smithi084 podman[121083]: 2024-03-30 12:31:10.872616453 +0000 UTC m=+0.614644010 container cleanup 66844bed39e89e9176df3b27326031a73b452252863843e518998a2bcaadc294 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T12:31:11.003 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:10 smithi084 bash[121083]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a 2024-03-30T12:31:11.426 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 podman[121097]: 2024-03-30 12:31:11.032202111 +0000 UTC m=+0.643873794 container remove 66844bed39e89e9176df3b27326031a73b452252863843e518998a2bcaadc294 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T12:31:11.426 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-03-30T12:31:11.426 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@node-exporter.a.service: Failed with result 'exit-code'. 2024-03-30T12:31:11.427 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 systemd[1]: Stopped Ceph node-exporter.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:31:11.427 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@node-exporter.a.service: Consumed 2.772s CPU time. 2024-03-30T12:31:11.618 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:11.305+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:11.628 INFO:tasks.rados.rados.0.smithi084.stdout:2480: done (1 left) 2024-03-30T12:31:11.628 INFO:tasks.rados.rados.0.smithi084.stdout:2481: done (0 left) 2024-03-30T12:31:11.628 INFO:tasks.rados.rados.0.smithi084.stdout:2482: read oid 30 snap -1 2024-03-30T12:31:11.628 INFO:tasks.rados.rados.0.smithi084.stdout:2482: expect (ObjNum 502 snap 157 seq_num 502) 2024-03-30T12:31:11.628 INFO:tasks.rados.rados.0.smithi084.stdout:2483: read oid 3 snap -1 2024-03-30T12:31:11.628 INFO:tasks.rados.rados.0.smithi084.stdout:2483: expect (ObjNum 729 snap 244 seq_num 729) 2024-03-30T12:31:11.628 INFO:tasks.rados.rados.0.smithi084.stdout:2484: snap_remove snap 253 2024-03-30T12:31:11.753 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 systemd[1]: Starting Ceph node-exporter.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:31:11.754 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 podman[121224]: 2024-03-30 12:31:11.544358063 +0000 UTC m=+0.017261805 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-03-30T12:31:11.754 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 podman[121224]: 2024-03-30 12:31:11.666542771 +0000 UTC m=+0.139446539 container create c19e5ff6fa838037c45c72008e45fb93dc19a0de74081a9fd47192b5615e3a33 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T12:31:11.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:11.633+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:11.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:11.634+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:11.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:11.632+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:11.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:11.632+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:11.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:11.632+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:11.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:11.633+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:11.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:11.633+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:11.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:11.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:11.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:11.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:11.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:11.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:11.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:11.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:11.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:11.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[89279]: osdmap e583: 8 total, 8 up, 8 in 2024-03-30T12:31:11.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:11.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:11.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:11.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:11.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:11.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:11.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:11.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[89279]: pgmap v561: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 599 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 17 MiB/s rd, 3.8 MiB/s wr, 36 op/s 2024-03-30T12:31:11.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:11.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:11.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:11.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:11.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:11.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:11.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:11.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:11.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:11.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[91810]: osdmap e583: 8 total, 8 up, 8 in 2024-03-30T12:31:11.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:11.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:11.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:11.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:11.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:11.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:11.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:11.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-mon[91810]: pgmap v561: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 599 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 17 MiB/s rd, 3.8 MiB/s wr, 36 op/s 2024-03-30T12:31:11.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:11.629+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:11.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:11.629+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:11.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:11.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:11.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:11.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:11.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:11.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:11.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:11.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:11.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:11.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:11 smithi162 ceph-mon[83709]: osdmap e583: 8 total, 8 up, 8 in 2024-03-30T12:31:11.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:11.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:11.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:11.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:11.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:11.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:11.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:11.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:11 smithi162 ceph-mon[83709]: pgmap v561: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 599 MiB data, 7.0 GiB used, 708 GiB / 715 GiB avail; 17 MiB/s rd, 3.8 MiB/s wr, 36 op/s 2024-03-30T12:31:11.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:11.640+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:11.872 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:11.642+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:12.101 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 podman[121224]: 2024-03-30 12:31:11.910304298 +0000 UTC m=+0.383208024 container init c19e5ff6fa838037c45c72008e45fb93dc19a0de74081a9fd47192b5615e3a33 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T12:31:12.102 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 podman[121224]: 2024-03-30 12:31:11.912845864 +0000 UTC m=+0.385749590 container start c19e5ff6fa838037c45c72008e45fb93dc19a0de74081a9fd47192b5615e3a33 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T12:31:12.102 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.916Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-03-30T12:31:12.102 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.916Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-03-30T12:31:12.102 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.916Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-03-30T12:31:12.102 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.916Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-03-30T12:31:12.102 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-03-30T12:31:12.102 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-03-30T12:31:12.102 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-03-30T12:31:12.102 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=arp 2024-03-30T12:31:12.102 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=bcache 2024-03-30T12:31:12.102 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=bonding 2024-03-30T12:31:12.102 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=btrfs 2024-03-30T12:31:12.102 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=conntrack 2024-03-30T12:31:12.103 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=cpu 2024-03-30T12:31:12.103 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-03-30T12:31:12.103 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=diskstats 2024-03-30T12:31:12.103 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=dmi 2024-03-30T12:31:12.103 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=edac 2024-03-30T12:31:12.103 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=entropy 2024-03-30T12:31:12.103 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-03-30T12:31:12.104 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=filefd 2024-03-30T12:31:12.104 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=filesystem 2024-03-30T12:31:12.104 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=hwmon 2024-03-30T12:31:12.104 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=infiniband 2024-03-30T12:31:12.104 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=ipvs 2024-03-30T12:31:12.104 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=loadavg 2024-03-30T12:31:12.104 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=mdadm 2024-03-30T12:31:12.104 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=meminfo 2024-03-30T12:31:12.104 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=netclass 2024-03-30T12:31:12.104 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=netdev 2024-03-30T12:31:12.104 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=netstat 2024-03-30T12:31:12.104 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=nfs 2024-03-30T12:31:12.104 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=nfsd 2024-03-30T12:31:12.105 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=nvme 2024-03-30T12:31:12.105 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=os 2024-03-30T12:31:12.105 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-03-30T12:31:12.105 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=pressure 2024-03-30T12:31:12.105 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=rapl 2024-03-30T12:31:12.105 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=schedstat 2024-03-30T12:31:12.105 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=selinux 2024-03-30T12:31:12.105 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=sockstat 2024-03-30T12:31:12.105 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=softnet 2024-03-30T12:31:12.105 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=stat 2024-03-30T12:31:12.105 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=tapestats 2024-03-30T12:31:12.105 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=textfile 2024-03-30T12:31:12.105 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-03-30T12:31:12.105 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=time 2024-03-30T12:31:12.105 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-03-30T12:31:12.106 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=uname 2024-03-30T12:31:12.106 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=vmstat 2024-03-30T12:31:12.106 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=xfs 2024-03-30T12:31:12.106 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.917Z caller=node_exporter.go:117 level=info collector=zfs 2024-03-30T12:31:12.106 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.918Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-03-30T12:31:12.106 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a[121238]: ts=2024-03-30T12:31:11.918Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-03-30T12:31:12.106 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:12 smithi084 bash[121224]: c19e5ff6fa838037c45c72008e45fb93dc19a0de74081a9fd47192b5615e3a33 2024-03-30T12:31:12.503 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:31:12 smithi084 systemd[1]: Started Ceph node-exporter.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:31:12.625 INFO:tasks.rados.rados.0.smithi084.stdout:2484: done (2 left) 2024-03-30T12:31:12.625 INFO:tasks.rados.rados.0.smithi084.stdout:2485: delete oid 28 current snap is 254 2024-03-30T12:31:12.625 INFO:tasks.rados.rados.0.smithi084.stdout:2483: expect (ObjNum 729 snap 244 seq_num 729) 2024-03-30T12:31:12.636 INFO:tasks.rados.rados.0.smithi084.stdout:2482: expect (ObjNum 502 snap 157 seq_num 502) 2024-03-30T12:31:12.874 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:12.635+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:12.874 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:12.636+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:12.874 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:12.636+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:12.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:12.635+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:12.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:12.637+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:12.875 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:12.638+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:12.875 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:12.638+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:12.875 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:12.639+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:12.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:12.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:12.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:12.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:12.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:12.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:12.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:12.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:12.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:12 smithi162 ceph-mon[83709]: osdmap e584: 8 total, 8 up, 8 in 2024-03-30T12:31:12.876 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:12.876 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:12.876 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:12.876 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:12 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:12.876 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:12 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:13.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:12.637+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:13.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:12.637+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:13.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:13.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:13.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:13.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:13.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:13.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:13.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:13.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:13.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[89279]: osdmap e584: 8 total, 8 up, 8 in 2024-03-30T12:31:13.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:13.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:13.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:13.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:13.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:13.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:12.630+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:13.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:12.630+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:13.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:12.631+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:13.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:12.631+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:13.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:12.631+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:13.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:12.631+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:13.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:13.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:13.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:13.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:13.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:13.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:13.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:13.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:13.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[91810]: osdmap e584: 8 total, 8 up, 8 in 2024-03-30T12:31:13.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:13.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:13.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:13.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:13.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:12 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:13.192 INFO:tasks.rados.rados.0.smithi084.stdout:2482: done (2 left) 2024-03-30T12:31:13.192 INFO:tasks.rados.rados.0.smithi084.stdout:2483: done (1 left) 2024-03-30T12:31:13.192 INFO:tasks.rados.rados.0.smithi084.stdout:2485: done (0 left) 2024-03-30T12:31:13.192 INFO:tasks.rados.rados.0.smithi084.stdout:2486: snap_remove snap 248 2024-03-30T12:31:13.647 INFO:tasks.rados.rados.0.smithi084.stdout:2486: done (0 left) 2024-03-30T12:31:13.648 INFO:tasks.rados.rados.0.smithi084.stdout:2487: copy_from oid 37 from oid 2 current snap is 254 2024-03-30T12:31:13.648 INFO:tasks.rados.rados.0.smithi084.stdout:2488: read oid 12 snap -1 2024-03-30T12:31:13.648 INFO:tasks.rados.rados.0.smithi084.stdout:2488: expect (ObjNum 743 snap 248 seq_num 743) 2024-03-30T12:31:13.648 INFO:tasks.rados.rados.0.smithi084.stdout:2489: delete oid 13 current snap is 254 2024-03-30T12:31:13.658 INFO:tasks.rados.rados.0.smithi084.stdout:2489: done (2 left) 2024-03-30T12:31:13.658 INFO:tasks.rados.rados.0.smithi084.stdout:2490: read oid 30 snap -1 2024-03-30T12:31:13.658 INFO:tasks.rados.rados.0.smithi084.stdout:2490: expect (ObjNum 502 snap 157 seq_num 502) 2024-03-30T12:31:13.658 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 254 2024-03-30T12:31:13.658 INFO:tasks.rados.rados.0.smithi084.stdout:2491: seq_num 768 ranges {3727360=466944,4194304=401408} 2024-03-30T12:31:13.684 INFO:tasks.rados.rados.0.smithi084.stdout:2491: writing smithi08477944-47 from 3727360 to 4194304 tid 1 2024-03-30T12:31:13.687 INFO:tasks.rados.rados.0.smithi084.stdout:2491: writing smithi08477944-47 from 4194304 to 4595712 tid 2 2024-03-30T12:31:13.687 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 254 2024-03-30T12:31:13.687 INFO:tasks.rados.rados.0.smithi084.stdout:2492: seq_num 769 ranges {630784=483328,1114112=401408} 2024-03-30T12:31:13.693 INFO:tasks.rados.rados.0.smithi084.stdout:2492: writing smithi08477944-9 from 630784 to 1114112 tid 1 2024-03-30T12:31:13.696 INFO:tasks.rados.rados.0.smithi084.stdout:2492: writing smithi08477944-9 from 1114112 to 1515520 tid 2 2024-03-30T12:31:13.696 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 254 2024-03-30T12:31:13.696 INFO:tasks.rados.rados.0.smithi084.stdout:2487: finishing copy_from racing read to smithi08477944-37 2024-03-30T12:31:13.696 INFO:tasks.rados.rados.0.smithi084.stdout:2493: seq_num 770 ranges {6053888=499712,6553600=401408} 2024-03-30T12:31:13.731 INFO:tasks.rados.rados.0.smithi084.stdout:2493: writing smithi08477944-26 from 6053888 to 6553600 tid 1 2024-03-30T12:31:13.733 INFO:tasks.rados.rados.0.smithi084.stdout:2493: writing smithi08477944-26 from 6553600 to 6955008 tid 2 2024-03-30T12:31:13.734 INFO:tasks.rados.rados.0.smithi084.stdout:2494: copy_from oid 1 from oid 45 current snap is 254 2024-03-30T12:31:13.734 INFO:tasks.rados.rados.0.smithi084.stdout:2487: finishing copy_from to smithi08477944-37 2024-03-30T12:31:13.734 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 27199 (ObjNum 753 snap 253 seq_num 753) dirty exists 2024-03-30T12:31:13.734 INFO:tasks.rados.rados.0.smithi084.stdout:2488: expect (ObjNum 743 snap 248 seq_num 743) 2024-03-30T12:31:13.919 INFO:tasks.rados.rados.0.smithi084.stdout:2491: finishing write tid 1 to smithi08477944-47 2024-03-30T12:31:13.919 INFO:tasks.rados.rados.0.smithi084.stdout:2491: finishing write tid 2 to smithi08477944-47 2024-03-30T12:31:13.919 INFO:tasks.rados.rados.0.smithi084.stdout:2491: finishing write tid 3 to smithi08477944-47 2024-03-30T12:31:13.920 INFO:tasks.rados.rados.0.smithi084.stdout:2487: done (6 left) 2024-03-30T12:31:13.920 INFO:tasks.rados.rados.0.smithi084.stdout:2488: done (5 left) 2024-03-30T12:31:13.920 INFO:tasks.rados.rados.0.smithi084.stdout:2495: read oid 31 snap -1 2024-03-30T12:31:13.920 INFO:tasks.rados.rados.0.smithi084.stdout:2495: expect deleted 2024-03-30T12:31:13.920 INFO:tasks.rados.rados.0.smithi084.stdout:2496: snap_create 2024-03-30T12:31:13.920 INFO:tasks.rados.rados.0.smithi084.stdout:2490: expect (ObjNum 502 snap 157 seq_num 502) 2024-03-30T12:31:14.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:13.653+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:14.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:13.653+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:14.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:13.652+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:14.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:13.652+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:14.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:13.652+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:14.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:13.652+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:14.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:13.653+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:14.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[91810]: osdmap e585: 8 total, 8 up, 8 in 2024-03-30T12:31:14.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:14.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[91810]: pgmap v564: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 600 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 10 MiB/s rd, 3.0 MiB/s wr, 31 op/s 2024-03-30T12:31:14.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[89279]: osdmap e585: 8 total, 8 up, 8 in 2024-03-30T12:31:14.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:14.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:14.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:14.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:14.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:14.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:14.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:14.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:14.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:14.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:14.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:14.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:14.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:13 smithi084 ceph-mon[89279]: pgmap v564: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 600 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 10 MiB/s rd, 3.0 MiB/s wr, 31 op/s 2024-03-30T12:31:14.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:13.664+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:14.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:13.647+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:14.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:13.647+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:14.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:13.659+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:14.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:13.673+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:14.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:13.666+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:14.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:13.666+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:13 smithi162 ceph-mon[83709]: osdmap e585: 8 total, 8 up, 8 in 2024-03-30T12:31:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:14.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:13 smithi162 ceph-mon[83709]: pgmap v564: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 600 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 10 MiB/s rd, 3.0 MiB/s wr, 31 op/s 2024-03-30T12:31:14.494 INFO:tasks.rados.rados.0.smithi084.stdout:2491: finishing write tid 4 to smithi08477944-47 2024-03-30T12:31:14.494 INFO:tasks.rados.rados.0.smithi084.stdout:2491: oid 47 updating version 0 to 17541 2024-03-30T12:31:14.494 INFO:tasks.rados.rados.0.smithi084.stdout:2491: oid 47 updating version 17541 to 17542 2024-03-30T12:31:14.494 INFO:tasks.rados.rados.0.smithi084.stdout:2491: oid 47 updating version 17542 to 17543 2024-03-30T12:31:14.494 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 17543 (ObjNum 768 snap 254 seq_num 768) dirty exists 2024-03-30T12:31:14.494 INFO:tasks.rados.rados.0.smithi084.stdout:2491: left oid 47 (ObjNum 768 snap 254 seq_num 768) 2024-03-30T12:31:14.494 INFO:tasks.rados.rados.0.smithi084.stdout:2492: finishing write tid 1 to smithi08477944-9 2024-03-30T12:31:14.494 INFO:tasks.rados.rados.0.smithi084.stdout:2492: finishing write tid 2 to smithi08477944-9 2024-03-30T12:31:14.494 INFO:tasks.rados.rados.0.smithi084.stdout:2492: finishing write tid 3 to smithi08477944-9 2024-03-30T12:31:14.494 INFO:tasks.rados.rados.0.smithi084.stdout:2492: finishing write tid 4 to smithi08477944-9 2024-03-30T12:31:14.495 INFO:tasks.rados.rados.0.smithi084.stdout:2492: oid 9 updating version 0 to 22497 2024-03-30T12:31:14.495 INFO:tasks.rados.rados.0.smithi084.stdout:2492: oid 9 version 22497 is already newer than 22495 2024-03-30T12:31:14.495 INFO:tasks.rados.rados.0.smithi084.stdout:2492: oid 9 version 22497 is already newer than 22496 2024-03-30T12:31:14.495 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 22497 (ObjNum 769 snap 254 seq_num 769) dirty exists 2024-03-30T12:31:14.495 INFO:tasks.rados.rados.0.smithi084.stdout:2492: left oid 9 (ObjNum 769 snap 254 seq_num 769) 2024-03-30T12:31:14.495 INFO:tasks.rados.rados.0.smithi084.stdout:2494: finishing copy_from racing read to smithi08477944-1 2024-03-30T12:31:14.495 INFO:tasks.rados.rados.0.smithi084.stdout:2494: finishing copy_from to smithi08477944-1 2024-03-30T12:31:14.495 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 973 (ObjNum 664 snap 232 seq_num 664) dirty exists 2024-03-30T12:31:14.495 INFO:tasks.rados.rados.0.smithi084.stdout:2493: finishing write tid 1 to smithi08477944-26 2024-03-30T12:31:14.495 INFO:tasks.rados.rados.0.smithi084.stdout:2493: finishing write tid 2 to smithi08477944-26 2024-03-30T12:31:14.495 INFO:tasks.rados.rados.0.smithi084.stdout:2493: finishing write tid 3 to smithi08477944-26 2024-03-30T12:31:14.495 INFO:tasks.rados.rados.0.smithi084.stdout:2493: finishing write tid 4 to smithi08477944-26 2024-03-30T12:31:14.495 INFO:tasks.rados.rados.0.smithi084.stdout:2493: oid 26 updating version 0 to 27212 2024-03-30T12:31:14.496 INFO:tasks.rados.rados.0.smithi084.stdout:2493: oid 26 updating version 27212 to 27213 2024-03-30T12:31:14.496 INFO:tasks.rados.rados.0.smithi084.stdout:2493: oid 26 version 27213 is already newer than 27211 2024-03-30T12:31:14.496 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 27213 (ObjNum 770 snap 254 seq_num 770) dirty exists 2024-03-30T12:31:14.496 INFO:tasks.rados.rados.0.smithi084.stdout:2493: left oid 26 (ObjNum 770 snap 254 seq_num 770) 2024-03-30T12:31:14.622 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:14 smithi162 systemd[1]: Stopping Ceph node-exporter.b for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:31:14.640 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:14.640 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:14.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:14.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:14.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:14.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:14.641 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:14.641 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[89279]: osdmap e586: 8 total, 8 up, 8 in 2024-03-30T12:31:14.641 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:14.641 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:14.641 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:14.641 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:14.641 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:14.641 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:14.641 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:14.641 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:14.641 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[89279]: Upgrade: Updating node-exporter.b (2/2) 2024-03-30T12:31:14.641 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[89279]: Deploying daemon node-exporter.b on smithi162 2024-03-30T12:31:14.652 INFO:tasks.rados.rados.0.smithi084.stdout:2490: done (6 left) 2024-03-30T12:31:14.652 INFO:tasks.rados.rados.0.smithi084.stdout:2491: done (5 left) 2024-03-30T12:31:14.652 INFO:tasks.rados.rados.0.smithi084.stdout:2492: done (4 left) 2024-03-30T12:31:14.652 INFO:tasks.rados.rados.0.smithi084.stdout:2493: done (3 left) 2024-03-30T12:31:14.652 INFO:tasks.rados.rados.0.smithi084.stdout:2494: done (2 left) 2024-03-30T12:31:14.652 INFO:tasks.rados.rados.0.smithi084.stdout:2495: done (1 left) 2024-03-30T12:31:14.652 INFO:tasks.rados.rados.0.smithi084.stdout:2496: done (0 left) 2024-03-30T12:31:14.653 INFO:tasks.rados.rados.0.smithi084.stdout:2497: read oid 20 snap -1 2024-03-30T12:31:14.653 INFO:tasks.rados.rados.0.smithi084.stdout:2497: expect (ObjNum 741 snap 248 seq_num 741) 2024-03-30T12:31:14.653 INFO:tasks.rados.rados.0.smithi084.stdout:2498: read oid 14 snap -1 2024-03-30T12:31:14.653 INFO:tasks.rados.rados.0.smithi084.stdout:2498: expect (ObjNum 764 snap 253 seq_num 764) 2024-03-30T12:31:14.653 INFO:tasks.rados.rados.0.smithi084.stdout:2499: delete oid 30 current snap is 255 2024-03-30T12:31:14.657 INFO:tasks.rados.rados.0.smithi084.stdout:2499: done (2 left) 2024-03-30T12:31:14.657 INFO:tasks.rados.rados.0.smithi084.stdout:2500: rmattr oid 24 current snap is 255 2024-03-30T12:31:14.657 INFO:tasks.rados.rados.0.smithi084.stdout:2500: done (2 left) 2024-03-30T12:31:14.657 INFO:tasks.rados.rados.0.smithi084.stdout:2501: rollback oid 36 current snap is 255 2024-03-30T12:31:14.657 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 36 to 254 2024-03-30T12:31:14.657 INFO:tasks.rados.rados.0.smithi084.stdout:2502: rmattr oid 13 current snap is 255 2024-03-30T12:31:14.658 INFO:tasks.rados.rados.0.smithi084.stdout:2502: done (3 left) 2024-03-30T12:31:14.658 INFO:tasks.rados.rados.0.smithi084.stdout:2503: setattr oid 18 current snap is 255 2024-03-30T12:31:14.660 INFO:tasks.rados.rados.0.smithi084.stdout:2501: finishing rollback tid 1 to smithi08477944-36 2024-03-30T12:31:14.660 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 17503 (ObjNum 81 snap 0 seq_num 0) dirty dne 2024-03-30T12:31:14.660 INFO:tasks.rados.rados.0.smithi084.stdout:2501: done (3 left) 2024-03-30T12:31:14.660 INFO:tasks.rados.rados.0.smithi084.stdout:2504: setattr oid 38 current snap is 255 2024-03-30T12:31:14.662 INFO:tasks.rados.rados.0.smithi084.stdout:2505: read oid 22 snap 254 2024-03-30T12:31:14.662 INFO:tasks.rados.rados.0.smithi084.stdout:2505: expect (ObjNum 706 snap 242 seq_num 706) 2024-03-30T12:31:14.662 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 255 2024-03-30T12:31:14.662 INFO:tasks.rados.rados.0.smithi084.stdout:2506: seq_num 772 ranges {606208=532480,1138688=401408} 2024-03-30T12:31:14.669 INFO:tasks.rados.rados.0.smithi084.stdout:2506: writing smithi08477944-7 from 606208 to 1138688 tid 1 2024-03-30T12:31:14.671 INFO:tasks.rados.rados.0.smithi084.stdout:2506: writing smithi08477944-7 from 1138688 to 1540096 tid 2 2024-03-30T12:31:14.671 INFO:tasks.rados.rados.0.smithi084.stdout:2507: read oid 31 snap -1 2024-03-30T12:31:14.671 INFO:tasks.rados.rados.0.smithi084.stdout:2507: expect deleted 2024-03-30T12:31:14.672 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 255 2024-03-30T12:31:14.672 INFO:tasks.rados.rados.0.smithi084.stdout:2508: seq_num 773 ranges {1515520=548864,2064384=401408} 2024-03-30T12:31:14.683 INFO:tasks.rados.rados.0.smithi084.stdout:2508: writing smithi08477944-9 from 1515520 to 2064384 tid 1 2024-03-30T12:31:14.685 INFO:tasks.rados.rados.0.smithi084.stdout:2508: writing smithi08477944-9 from 2064384 to 2465792 tid 2 2024-03-30T12:31:14.685 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 33 current snap is 255 2024-03-30T12:31:14.685 INFO:tasks.rados.rados.0.smithi084.stdout:2498: expect (ObjNum 764 snap 253 seq_num 764) 2024-03-30T12:31:14.713 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1034 (ObjNum 711 snap 242 seq_num 711) dirty exists 2024-03-30T12:31:14.713 INFO:tasks.rados.rados.0.smithi084.stdout:2509: seq_num 774 ranges {0=565248,565248=401408} 2024-03-30T12:31:14.716 INFO:tasks.rados.rados.0.smithi084.stdout:2509: writing smithi08477944-33 from 0 to 565248 tid 1 2024-03-30T12:31:14.719 INFO:tasks.rados.rados.0.smithi084.stdout:2509: writing smithi08477944-33 from 565248 to 966656 tid 2 2024-03-30T12:31:14.719 INFO:tasks.rados.rados.0.smithi084.stdout:2498: done (8 left) 2024-03-30T12:31:14.720 INFO:tasks.rados.rados.0.smithi084.stdout:2504: done (7 left) 2024-03-30T12:31:14.720 INFO:tasks.rados.rados.0.smithi084.stdout:2510: snap_create 2024-03-30T12:31:14.720 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 1019 (ObjNum 733 snap 244 seq_num 733) dirty exists 2024-03-30T12:31:14.720 INFO:tasks.rados.rados.0.smithi084.stdout:2497: expect (ObjNum 741 snap 248 seq_num 741) 2024-03-30T12:31:15.000 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:14.665+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:15.000 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:14.681+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:15.000 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:14.681+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:15.001 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:14.664+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:15.001 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:14.664+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:15.001 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:14.664+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:15.001 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:14 smithi162 podman[111964]: 2024-03-30 12:31:14.769832487 +0000 UTC m=+0.137258704 container died 3d6e28b2348dea044954c4ea7f5fece91782c7d42e327b71674f8464b4f57f67 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T12:31:15.001 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:14.656+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:15.001 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:14.656+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:15.001 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:14.656+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:15.002 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:15.002 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:15.002 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:15.002 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:15.002 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:15.002 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:14 smithi162 ceph-mon[83709]: osdmap e586: 8 total, 8 up, 8 in 2024-03-30T12:31:15.002 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:15.002 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:15.002 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:15.002 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:15.002 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:15.003 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:15.003 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:15.003 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:15.003 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:14 smithi162 ceph-mon[83709]: Upgrade: Updating node-exporter.b (2/2) 2024-03-30T12:31:15.003 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:14 smithi162 ceph-mon[83709]: Deploying daemon node-exporter.b on smithi162 2024-03-30T12:31:15.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:14.658+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:15.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:14.659+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:15.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:14.658+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:15.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:14.658+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:15.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:14.659+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:15.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:14.660+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:15.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:14.660+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:15.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:14.660+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:15.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:15.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:15.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:15.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[91810]: osdmap e586: 8 total, 8 up, 8 in 2024-03-30T12:31:15.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:15.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:15.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:15.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:15.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:15.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:15.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:15.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:15.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[91810]: Upgrade: Updating node-exporter.b (2/2) 2024-03-30T12:31:15.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:14 smithi084 ceph-mon[91810]: Deploying daemon node-exporter.b on smithi162 2024-03-30T12:31:15.292 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:15 smithi162 podman[111964]: 2024-03-30 12:31:15.092326213 +0000 UTC m=+0.459752423 container cleanup 3d6e28b2348dea044954c4ea7f5fece91782c7d42e327b71674f8464b4f57f67 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T12:31:15.292 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:15 smithi162 bash[111964]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b 2024-03-30T12:31:15.360 INFO:tasks.rados.rados.0.smithi084.stdout:2506: finishing write tid 1 to smithi08477944-7 2024-03-30T12:31:15.360 INFO:tasks.rados.rados.0.smithi084.stdout:2506: finishing write tid 2 to smithi08477944-7 2024-03-30T12:31:15.360 INFO:tasks.rados.rados.0.smithi084.stdout:2508: finishing write tid 1 to smithi08477944-9 2024-03-30T12:31:15.360 INFO:tasks.rados.rados.0.smithi084.stdout:2506: finishing write tid 3 to smithi08477944-7 2024-03-30T12:31:15.360 INFO:tasks.rados.rados.0.smithi084.stdout:2508: finishing write tid 2 to smithi08477944-9 2024-03-30T12:31:15.360 INFO:tasks.rados.rados.0.smithi084.stdout:2506: finishing write tid 4 to smithi08477944-7 2024-03-30T12:31:15.360 INFO:tasks.rados.rados.0.smithi084.stdout:2506: oid 7 updating version 0 to 17545 2024-03-30T12:31:15.360 INFO:tasks.rados.rados.0.smithi084.stdout:2506: oid 7 version 17545 is already newer than 17544 2024-03-30T12:31:15.360 INFO:tasks.rados.rados.0.smithi084.stdout:2506: oid 7 updating version 17545 to 17546 2024-03-30T12:31:15.360 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 17546 (ObjNum 772 snap 255 seq_num 772) dirty exists 2024-03-30T12:31:15.360 INFO:tasks.rados.rados.0.smithi084.stdout:2506: left oid 7 (ObjNum 772 snap 255 seq_num 772) 2024-03-30T12:31:15.361 INFO:tasks.rados.rados.0.smithi084.stdout:2508: finishing write tid 3 to smithi08477944-9 2024-03-30T12:31:15.361 INFO:tasks.rados.rados.0.smithi084.stdout:2508: finishing write tid 4 to smithi08477944-9 2024-03-30T12:31:15.361 INFO:tasks.rados.rados.0.smithi084.stdout:2508: oid 9 updating version 0 to 22498 2024-03-30T12:31:15.361 INFO:tasks.rados.rados.0.smithi084.stdout:2508: oid 9 updating version 22498 to 22500 2024-03-30T12:31:15.361 INFO:tasks.rados.rados.0.smithi084.stdout:2508: oid 9 version 22500 is already newer than 22499 2024-03-30T12:31:15.361 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 22500 (ObjNum 773 snap 255 seq_num 773) dirty exists 2024-03-30T12:31:15.361 INFO:tasks.rados.rados.0.smithi084.stdout:2508: left oid 9 (ObjNum 773 snap 255 seq_num 773) 2024-03-30T12:31:15.361 INFO:tasks.rados.rados.0.smithi084.stdout:2505: expect (ObjNum 706 snap 242 seq_num 706) 2024-03-30T12:31:15.619 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:15 smithi162 podman[111976]: 2024-03-30 12:31:15.301780295 +0000 UTC m=+0.536304899 container remove 3d6e28b2348dea044954c4ea7f5fece91782c7d42e327b71674f8464b4f57f67 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T12:31:15.619 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:15 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-03-30T12:31:15.619 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:15 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@node-exporter.b.service: Failed with result 'exit-code'. 2024-03-30T12:31:15.619 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:15 smithi162 systemd[1]: Stopped Ceph node-exporter.b for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:31:15.619 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:15 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@node-exporter.b.service: Consumed 2.818s CPU time. 2024-03-30T12:31:15.920 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:15 smithi162 systemd[1]: Starting Ceph node-exporter.b for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:31:15.921 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:15.661+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:15.921 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:15.661+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:15.921 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:15.661+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:15.921 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:15.921 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:15.921 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:15.921 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:15.922 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:15 smithi162 ceph-mon[83709]: osdmap e587: 8 total, 8 up, 8 in 2024-03-30T12:31:15.922 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:15.922 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:15.922 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:15.922 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:15.922 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:15.922 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:15.922 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:15.922 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:15.922 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:15.922 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:15 smithi162 ceph-mon[83709]: pgmap v567: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 597 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 7.9 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2024-03-30T12:31:15.922 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:15 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:31:16.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:16.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[91810]: osdmap e587: 8 total, 8 up, 8 in 2024-03-30T12:31:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[91810]: pgmap v567: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 597 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 7.9 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2024-03-30T12:31:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:31:16.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:15.660+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:16.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:15.661+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:16.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:15.661+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:16.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:15.661+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:16.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:15.661+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:16.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:16.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:16.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 136=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:16.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:16.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[89279]: osdmap e587: 8 total, 8 up, 8 in 2024-03-30T12:31:16.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:16.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:16.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:16.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:16.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:16.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:16.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:16.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:16.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:16.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[89279]: pgmap v567: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 597 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 7.9 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2024-03-30T12:31:16.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:15 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:31:16.229 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:16.145+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:16.229 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:16.145+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:16.230 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:16.004+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:16.230 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:16.004+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:16.230 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:15 smithi162 podman[112109]: 2024-03-30 12:31:15.832166018 +0000 UTC m=+0.017524239 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-03-30T12:31:16.231 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:15 smithi162 podman[112109]: 2024-03-30 12:31:15.936346674 +0000 UTC m=+0.121704867 container create fcd914fcfd7830d9ddd22f575d738fcfb5d946cef1651083c567099d1797f992 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T12:31:16.231 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 podman[112109]: 2024-03-30 12:31:16.155417485 +0000 UTC m=+0.340775685 container init fcd914fcfd7830d9ddd22f575d738fcfb5d946cef1651083c567099d1797f992 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T12:31:16.231 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 podman[112109]: 2024-03-30 12:31:16.157970098 +0000 UTC m=+0.343328292 container start fcd914fcfd7830d9ddd22f575d738fcfb5d946cef1651083c567099d1797f992 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T12:31:16.231 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.161Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-03-30T12:31:16.231 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.161Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-03-30T12:31:16.231 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.161Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-03-30T12:31:16.231 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.161Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-03-30T12:31:16.231 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-03-30T12:31:16.231 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-03-30T12:31:16.231 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-03-30T12:31:16.231 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=arp 2024-03-30T12:31:16.231 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=bcache 2024-03-30T12:31:16.232 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=bonding 2024-03-30T12:31:16.232 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=btrfs 2024-03-30T12:31:16.232 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=conntrack 2024-03-30T12:31:16.232 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=cpu 2024-03-30T12:31:16.232 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-03-30T12:31:16.232 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=diskstats 2024-03-30T12:31:16.232 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=dmi 2024-03-30T12:31:16.232 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=edac 2024-03-30T12:31:16.232 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=entropy 2024-03-30T12:31:16.232 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-03-30T12:31:16.232 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=filefd 2024-03-30T12:31:16.232 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=filesystem 2024-03-30T12:31:16.232 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=hwmon 2024-03-30T12:31:16.232 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=infiniband 2024-03-30T12:31:16.233 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=ipvs 2024-03-30T12:31:16.233 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=loadavg 2024-03-30T12:31:16.233 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=mdadm 2024-03-30T12:31:16.233 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=meminfo 2024-03-30T12:31:16.233 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=netclass 2024-03-30T12:31:16.233 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=netdev 2024-03-30T12:31:16.233 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=netstat 2024-03-30T12:31:16.233 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=nfs 2024-03-30T12:31:16.233 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=nfsd 2024-03-30T12:31:16.233 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=nvme 2024-03-30T12:31:16.233 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=os 2024-03-30T12:31:16.233 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-03-30T12:31:16.233 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=pressure 2024-03-30T12:31:16.234 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=rapl 2024-03-30T12:31:16.234 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=schedstat 2024-03-30T12:31:16.234 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=selinux 2024-03-30T12:31:16.234 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=sockstat 2024-03-30T12:31:16.234 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=softnet 2024-03-30T12:31:16.234 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=stat 2024-03-30T12:31:16.234 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=tapestats 2024-03-30T12:31:16.234 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=textfile 2024-03-30T12:31:16.234 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-03-30T12:31:16.234 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=time 2024-03-30T12:31:16.234 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-03-30T12:31:16.234 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=uname 2024-03-30T12:31:16.234 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=vmstat 2024-03-30T12:31:16.234 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=xfs 2024-03-30T12:31:16.235 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.162Z caller=node_exporter.go:117 level=info collector=zfs 2024-03-30T12:31:16.235 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.163Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-03-30T12:31:16.235 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b[112123]: ts=2024-03-30T12:31:16.163Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-03-30T12:31:16.235 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 bash[112109]: fcd914fcfd7830d9ddd22f575d738fcfb5d946cef1651083c567099d1797f992 2024-03-30T12:31:16.306 INFO:tasks.rados.rados.0.smithi084.stdout:2509: finishing write tid 1 to smithi08477944-33 2024-03-30T12:31:16.306 INFO:tasks.rados.rados.0.smithi084.stdout:2509: finishing write tid 2 to smithi08477944-33 2024-03-30T12:31:16.306 INFO:tasks.rados.rados.0.smithi084.stdout:2509: finishing write tid 3 to smithi08477944-33 2024-03-30T12:31:16.306 INFO:tasks.rados.rados.0.smithi084.stdout:2509: finishing write tid 4 to smithi08477944-33 2024-03-30T12:31:16.306 INFO:tasks.rados.rados.0.smithi084.stdout:2509: oid 33 updating version 0 to 17547 2024-03-30T12:31:16.306 INFO:tasks.rados.rados.0.smithi084.stdout:2509: oid 33 updating version 17547 to 17548 2024-03-30T12:31:16.306 INFO:tasks.rados.rados.0.smithi084.stdout:2509: oid 33 updating version 17548 to 17549 2024-03-30T12:31:16.306 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 17549 (ObjNum 774 snap 255 seq_num 774) dirty exists 2024-03-30T12:31:16.306 INFO:tasks.rados.rados.0.smithi084.stdout:2509: left oid 33 (ObjNum 774 snap 255 seq_num 774) 2024-03-30T12:31:16.306 INFO:tasks.rados.rados.0.smithi084.stdout:2497: done (7 left) 2024-03-30T12:31:16.306 INFO:tasks.rados.rados.0.smithi084.stdout:2503: done (6 left) 2024-03-30T12:31:16.306 INFO:tasks.rados.rados.0.smithi084.stdout:2505: done (5 left) 2024-03-30T12:31:16.307 INFO:tasks.rados.rados.0.smithi084.stdout:2506: done (4 left) 2024-03-30T12:31:16.307 INFO:tasks.rados.rados.0.smithi084.stdout:2507: done (3 left) 2024-03-30T12:31:16.307 INFO:tasks.rados.rados.0.smithi084.stdout:2508: done (2 left) 2024-03-30T12:31:16.307 INFO:tasks.rados.rados.0.smithi084.stdout:2509: done (1 left) 2024-03-30T12:31:16.307 INFO:tasks.rados.rados.0.smithi084.stdout:2510: done (0 left) 2024-03-30T12:31:16.307 INFO:tasks.rados.rados.0.smithi084.stdout:2511: read oid 28 snap -1 2024-03-30T12:31:16.307 INFO:tasks.rados.rados.0.smithi084.stdout:2511: expect deleted 2024-03-30T12:31:16.307 INFO:tasks.rados.rados.0.smithi084.stdout:2512: snap_create 2024-03-30T12:31:16.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:16.096+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:16.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:16.096+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:16.619 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:31:16 smithi162 systemd[1]: Started Ceph node-exporter.b for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:31:17.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:17.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:17.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:17.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:17.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:17.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:17.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:17.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[91810]: osdmap e588: 8 total, 8 up, 8 in 2024-03-30T12:31:17.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:17.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:17.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:17.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:17.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:17.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:17.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:31:17.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:17.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:17.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:17.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:17.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:17.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:17.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:17.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[89279]: osdmap e588: 8 total, 8 up, 8 in 2024-03-30T12:31:17.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:17.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:17.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:17.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:17.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:17.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:17.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:16 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:31:17.086 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:17.086 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:17.086 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:17.086 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:17.086 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:17.086 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:17.086 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:17.086 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-mon[83709]: osdmap e588: 8 total, 8 up, 8 in 2024-03-30T12:31:17.086 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:17.086 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:17.086 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:17.087 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:17.087 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:17.087 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:17.087 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:16 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:31:17.285 INFO:tasks.rados.rados.0.smithi084.stdout:2511: done (1 left) 2024-03-30T12:31:17.285 INFO:tasks.rados.rados.0.smithi084.stdout:2512: done (0 left) 2024-03-30T12:31:17.285 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 46 current snap is 257 2024-03-30T12:31:17.285 INFO:tasks.rados.rados.0.smithi084.stdout:2513: seq_num 775 ranges {0=589824,589824=401408} 2024-03-30T12:31:17.287 INFO:tasks.rados.rados.0.smithi084.stdout:2513: writing smithi08477944-46 from 0 to 589824 tid 1 2024-03-30T12:31:17.290 INFO:tasks.rados.rados.0.smithi084.stdout:2513: writing smithi08477944-46 from 589824 to 991232 tid 2 2024-03-30T12:31:17.290 INFO:tasks.rados.rados.0.smithi084.stdout:2514: rollback oid 30 current snap is 257 2024-03-30T12:31:17.290 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 30 to 255 2024-03-30T12:31:17.291 INFO:tasks.rados.rados.0.smithi084.stdout:2515: read oid 45 snap 254 2024-03-30T12:31:17.291 INFO:tasks.rados.rados.0.smithi084.stdout:2515: expect (ObjNum 664 snap 232 seq_num 664) 2024-03-30T12:31:17.291 INFO:tasks.rados.rados.0.smithi084.stdout:2516: read oid 23 snap -1 2024-03-30T12:31:17.291 INFO:tasks.rados.rados.0.smithi084.stdout:2516: expect deleted 2024-03-30T12:31:17.291 INFO:tasks.rados.rados.0.smithi084.stdout:2517: rmattr oid 48 current snap is 257 2024-03-30T12:31:17.292 INFO:tasks.rados.rados.0.smithi084.stdout:2518: snap_create 2024-03-30T12:31:17.295 INFO:tasks.rados.rados.0.smithi084.stdout:2514: finishing rollback tid 1 to smithi08477944-30 2024-03-30T12:31:17.295 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 1033 (ObjNum 33 snap 0 seq_num 1429690304) dirty dne 2024-03-30T12:31:17.298 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 921 (ObjNum 677 snap 239 seq_num 677) dirty exists 2024-03-30T12:31:17.300 INFO:tasks.rados.rados.0.smithi084.stdout:2515: expect (ObjNum 664 snap 232 seq_num 664) 2024-03-30T12:31:17.342 INFO:tasks.rados.rados.0.smithi084.stdout:2513: finishing write tid 1 to smithi08477944-46 2024-03-30T12:31:17.342 INFO:tasks.rados.rados.0.smithi084.stdout:2513: finishing write tid 2 to smithi08477944-46 2024-03-30T12:31:17.342 INFO:tasks.rados.rados.0.smithi084.stdout:2513: finishing write tid 3 to smithi08477944-46 2024-03-30T12:31:17.342 INFO:tasks.rados.rados.0.smithi084.stdout:2513: finishing write tid 4 to smithi08477944-46 2024-03-30T12:31:17.342 INFO:tasks.rados.rados.0.smithi084.stdout:2513: oid 46 updating version 0 to 27214 2024-03-30T12:31:17.342 INFO:tasks.rados.rados.0.smithi084.stdout:2513: oid 46 updating version 27214 to 27216 2024-03-30T12:31:17.342 INFO:tasks.rados.rados.0.smithi084.stdout:2513: oid 46 version 27216 is already newer than 27215 2024-03-30T12:31:17.342 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 27216 (ObjNum 775 snap 257 seq_num 775) dirty exists 2024-03-30T12:31:17.342 INFO:tasks.rados.rados.0.smithi084.stdout:2513: left oid 46 (ObjNum 775 snap 257 seq_num 775) 2024-03-30T12:31:17.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:17.322+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:17.369 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:17.294+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:17.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:17.294+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:17.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:17.304+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:17.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:17.304+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:17.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:17.304+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:17.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:17.296+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:17.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:17.296+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:17.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:17.296+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:17.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:17.301+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:17.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:17.304+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:17.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:17.291+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:17.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:17.291+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:17.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:17.292+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:17.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:17.292+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:17.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:17.292+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:17.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:17.292+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:18.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-mon[91810]: pgmap v569: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 599 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 16 MiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-03-30T12:31:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-mon[91810]: osdmap e589: 8 total, 8 up, 8 in 2024-03-30T12:31:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:18.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:18.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:18.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-mon[89279]: pgmap v569: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 599 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 16 MiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-03-30T12:31:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-mon[89279]: osdmap e589: 8 total, 8 up, 8 in 2024-03-30T12:31:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:18.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:18.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:18.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:17 smithi162 ceph-mon[83709]: pgmap v569: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 599 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 16 MiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-03-30T12:31:18.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:17 smithi162 ceph-mon[83709]: osdmap e589: 8 total, 8 up, 8 in 2024-03-30T12:31:18.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:18.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:18.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:18.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:18.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:18.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:18.285 INFO:tasks.rados.rados.0.smithi084.stdout:2513: done (5 left) 2024-03-30T12:31:18.285 INFO:tasks.rados.rados.0.smithi084.stdout:2514: done (4 left) 2024-03-30T12:31:18.286 INFO:tasks.rados.rados.0.smithi084.stdout:2515: done (3 left) 2024-03-30T12:31:18.286 INFO:tasks.rados.rados.0.smithi084.stdout:2516: done (2 left) 2024-03-30T12:31:18.286 INFO:tasks.rados.rados.0.smithi084.stdout:2517: done (1 left) 2024-03-30T12:31:18.286 INFO:tasks.rados.rados.0.smithi084.stdout:2518: done (0 left) 2024-03-30T12:31:18.286 INFO:tasks.rados.rados.0.smithi084.stdout:2519: delete oid 8 current snap is 258 2024-03-30T12:31:18.293 INFO:tasks.rados.rados.0.smithi084.stdout:2519: done (0 left) 2024-03-30T12:31:18.293 INFO:tasks.rados.rados.0.smithi084.stdout:2520: snap_create 2024-03-30T12:31:18.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:18.300+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:18.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:18.300+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:18.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:18.292+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:18.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:18.293+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:18.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:18.293+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:18.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:18.293+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:18.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:18.293+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:18.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:18.294+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:18.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:18.294+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:18.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:18.293+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:18.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:18.294+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:18.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:18.296+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:18.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:18.299+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:18.989 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:18.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:18.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:18.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:18.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:18.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:18.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:18.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:18 smithi162 ceph-mon[83709]: osdmap e590: 8 total, 8 up, 8 in 2024-03-30T12:31:18.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:18.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:18.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:18.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:18.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:18.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:19.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:19.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:19.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:19.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:19.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:19.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:19.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:19.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[91810]: osdmap e590: 8 total, 8 up, 8 in 2024-03-30T12:31:19.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:19.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:19.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:19.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:19.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:19.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:19.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:19.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:19.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:19.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:19.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:19.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:19.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:19.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[89279]: osdmap e590: 8 total, 8 up, 8 in 2024-03-30T12:31:19.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:19.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:19.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:19.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:19.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:19.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:19.287 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:19.046+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:19.287 INFO:tasks.rados.rados.0.smithi084.stdout:2520: done (0 left) 2024-03-30T12:31:19.287 INFO:tasks.rados.rados.0.smithi084.stdout:2521: setattr oid 28 current snap is 259 2024-03-30T12:31:19.288 INFO:tasks.rados.rados.0.smithi084.stdout:2522: read oid 7 snap 255 2024-03-30T12:31:19.288 INFO:tasks.rados.rados.0.smithi084.stdout:2522: expect (ObjNum 772 snap 255 seq_num 772) 2024-03-30T12:31:19.289 INFO:tasks.rados.rados.0.smithi084.stdout:2523: delete oid 20 current snap is 259 2024-03-30T12:31:19.293 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 17515 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-03-30T12:31:19.296 INFO:tasks.rados.rados.0.smithi084.stdout:2521: done (2 left) 2024-03-30T12:31:19.296 INFO:tasks.rados.rados.0.smithi084.stdout:2523: done (1 left) 2024-03-30T12:31:19.296 INFO:tasks.rados.rados.0.smithi084.stdout:2524: read oid 32 snap 258 2024-03-30T12:31:19.296 INFO:tasks.rados.rados.0.smithi084.stdout:2524: expect deleted 2024-03-30T12:31:19.296 INFO:tasks.rados.rados.0.smithi084.stdout:2525: rmattr oid 37 current snap is 259 2024-03-30T12:31:19.296 INFO:tasks.rados.rados.0.smithi084.stdout:2525: done (2 left) 2024-03-30T12:31:19.296 INFO:tasks.rados.rados.0.smithi084.stdout:2526: copy_from oid 11 from oid 17 current snap is 259 2024-03-30T12:31:19.297 INFO:tasks.rados.rados.0.smithi084.stdout:2527: read oid 44 snap -1 2024-03-30T12:31:19.297 INFO:tasks.rados.rados.0.smithi084.stdout:2527: expect (ObjNum 440 snap 141 seq_num 440) 2024-03-30T12:31:19.297 INFO:tasks.rados.rados.0.smithi084.stdout:2528: copy_from oid 29 from oid 10 current snap is 259 2024-03-30T12:31:19.297 INFO:tasks.rados.rados.0.smithi084.stdout:2529: copy_from oid 16 from oid 9 current snap is 259 2024-03-30T12:31:19.297 INFO:tasks.rados.rados.0.smithi084.stdout:2530: read oid 39 snap -1 2024-03-30T12:31:19.297 INFO:tasks.rados.rados.0.smithi084.stdout:2530: expect (ObjNum 673 snap 238 seq_num 673) 2024-03-30T12:31:19.297 INFO:tasks.rados.rados.0.smithi084.stdout:2531: setattr oid 8 current snap is 259 2024-03-30T12:31:19.298 INFO:tasks.rados.rados.0.smithi084.stdout:2524: done (7 left) 2024-03-30T12:31:19.298 INFO:tasks.rados.rados.0.smithi084.stdout:2532: delete oid 25 current snap is 259 2024-03-30T12:31:19.299 INFO:tasks.rados.rados.0.smithi084.stdout:2522: expect (ObjNum 772 snap 255 seq_num 772) 2024-03-30T12:31:19.360 INFO:tasks.rados.rados.0.smithi084.stdout:2527: expect (ObjNum 440 snap 141 seq_num 440) 2024-03-30T12:31:19.365 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 27219 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:31:19.365 INFO:tasks.rados.rados.0.smithi084.stdout:2530: expect (ObjNum 673 snap 238 seq_num 673) 2024-03-30T12:31:19.443 INFO:tasks.rados.rados.0.smithi084.stdout:2529: finishing copy_from racing read to smithi08477944-16 2024-03-30T12:31:19.444 INFO:tasks.rados.rados.0.smithi084.stdout:2529: finishing copy_from to smithi08477944-16 2024-03-30T12:31:19.444 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 22500 (ObjNum 773 snap 255 seq_num 773) dirty exists 2024-03-30T12:31:19.444 INFO:tasks.rados.rados.0.smithi084.stdout:2528: finishing copy_from racing read to smithi08477944-29 2024-03-30T12:31:19.444 INFO:tasks.rados.rados.0.smithi084.stdout:2528: finishing copy_from to smithi08477944-29 2024-03-30T12:31:19.444 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 17538 (ObjNum 757 snap 253 seq_num 757) dirty exists 2024-03-30T12:31:19.444 INFO:tasks.rados.rados.0.smithi084.stdout:2526: finishing copy_from racing read to smithi08477944-11 2024-03-30T12:31:19.444 INFO:tasks.rados.rados.0.smithi084.stdout:2522: done (7 left) 2024-03-30T12:31:19.444 INFO:tasks.rados.rados.0.smithi084.stdout:2527: done (6 left) 2024-03-30T12:31:19.444 INFO:tasks.rados.rados.0.smithi084.stdout:2528: done (5 left) 2024-03-30T12:31:19.444 INFO:tasks.rados.rados.0.smithi084.stdout:2529: done (4 left) 2024-03-30T12:31:19.444 INFO:tasks.rados.rados.0.smithi084.stdout:2530: done (3 left) 2024-03-30T12:31:19.444 INFO:tasks.rados.rados.0.smithi084.stdout:2531: done (2 left) 2024-03-30T12:31:19.445 INFO:tasks.rados.rados.0.smithi084.stdout:2532: done (1 left) 2024-03-30T12:31:19.445 INFO:tasks.rados.rados.0.smithi084.stdout:2533: snap_create 2024-03-30T12:31:19.445 INFO:tasks.rados.rados.0.smithi084.stdout:2526: finishing copy_from to smithi08477944-11 2024-03-30T12:31:19.445 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 17503 (ObjNum 662 snap 232 seq_num 662) dirty exists 2024-03-30T12:31:19.616 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:19.310+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:19.617 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:19.308+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:19.617 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:19.309+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:19.617 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:19.295+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:19.617 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:19.295+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:19.617 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:19.295+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:19.618 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:19.301+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:19.618 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:19.301+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:19.618 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:19.301+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:19.662 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:31:19] "GET /metrics HTTP/1.1" 200 36330 "" "Prometheus/2.43.0" 2024-03-30T12:31:19.663 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:19.300+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:19.663 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:19.300+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:19.663 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:19.294+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:19.663 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:19.294+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:19.663 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:19.294+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:19.663 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:19.294+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:19.663 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:19.295+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:19.663 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:19.295+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:19.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:19.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:19.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:19.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:19.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:19.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:19.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-mon[83709]: pgmap v572: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 603 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 21 MiB/s rd, 1.5 MiB/s wr, 25 op/s 2024-03-30T12:31:19.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:19.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:19.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-mon[83709]: osdmap e591: 8 total, 8 up, 8 in 2024-03-30T12:31:19.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:19.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:19.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:19.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:19.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:19.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:19 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:20.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:20.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:20.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:20.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:20.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:20.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:20.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[89279]: pgmap v572: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 603 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 21 MiB/s rd, 1.5 MiB/s wr, 25 op/s 2024-03-30T12:31:20.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:20.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:20.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[89279]: osdmap e591: 8 total, 8 up, 8 in 2024-03-30T12:31:20.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:20.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:20.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:20.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:20.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:20.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[91810]: pgmap v572: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 603 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 21 MiB/s rd, 1.5 MiB/s wr, 25 op/s 2024-03-30T12:31:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:20.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[91810]: osdmap e591: 8 total, 8 up, 8 in 2024-03-30T12:31:20.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:20.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:20.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:20.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:20.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:20.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:19 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:20.293 INFO:tasks.rados.rados.0.smithi084.stdout:2526: done (1 left) 2024-03-30T12:31:20.293 INFO:tasks.rados.rados.0.smithi084.stdout:2533: done (0 left) 2024-03-30T12:31:20.293 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 260 2024-03-30T12:31:20.293 INFO:tasks.rados.rados.0.smithi084.stdout:2534: seq_num 779 ranges {2940928=655360,3596288=401408} 2024-03-30T12:31:20.314 INFO:tasks.rados.rados.0.smithi084.stdout:2534: writing smithi08477944-29 from 2940928 to 3596288 tid 1 2024-03-30T12:31:20.317 INFO:tasks.rados.rados.0.smithi084.stdout:2534: writing smithi08477944-29 from 3596288 to 3997696 tid 2 2024-03-30T12:31:20.317 INFO:tasks.rados.rados.0.smithi084.stdout:2535: read oid 15 snap -1 2024-03-30T12:31:20.317 INFO:tasks.rados.rados.0.smithi084.stdout:2535: expect (ObjNum 725 snap 242 seq_num 725) 2024-03-30T12:31:20.318 INFO:tasks.rados.rados.0.smithi084.stdout:2536: rollback oid 1 current snap is 260 2024-03-30T12:31:20.318 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 1 to 255 2024-03-30T12:31:20.318 INFO:tasks.rados.rados.0.smithi084.stdout:2537: read oid 33 snap -1 2024-03-30T12:31:20.318 INFO:tasks.rados.rados.0.smithi084.stdout:2537: expect (ObjNum 774 snap 255 seq_num 774) 2024-03-30T12:31:20.318 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 260 2024-03-30T12:31:20.318 INFO:tasks.rados.rados.0.smithi084.stdout:2538: seq_num 780 ranges {1843200=671744,2514944=401408} 2024-03-30T12:31:20.332 INFO:tasks.rados.rados.0.smithi084.stdout:2538: writing smithi08477944-49 from 1843200 to 2514944 tid 1 2024-03-30T12:31:20.334 INFO:tasks.rados.rados.0.smithi084.stdout:2538: writing smithi08477944-49 from 2514944 to 2916352 tid 2 2024-03-30T12:31:20.334 INFO:tasks.rados.rados.0.smithi084.stdout:2539: snap_create 2024-03-30T12:31:20.334 INFO:tasks.rados.rados.0.smithi084.stdout:2534: finishing write tid 1 to smithi08477944-29 2024-03-30T12:31:20.335 INFO:tasks.rados.rados.0.smithi084.stdout:2534: finishing write tid 2 to smithi08477944-29 2024-03-30T12:31:20.335 INFO:tasks.rados.rados.0.smithi084.stdout:2534: finishing write tid 3 to smithi08477944-29 2024-03-30T12:31:20.335 INFO:tasks.rados.rados.0.smithi084.stdout:2535: expect (ObjNum 725 snap 242 seq_num 725) 2024-03-30T12:31:20.340 INFO:tasks.rados.rados.0.smithi084.stdout:2537: expect (ObjNum 774 snap 255 seq_num 774) 2024-03-30T12:31:20.366 INFO:tasks.rados.rados.0.smithi084.stdout:2534: finishing write tid 4 to smithi08477944-29 2024-03-30T12:31:20.366 INFO:tasks.rados.rados.0.smithi084.stdout:2534: oid 29 updating version 0 to 17541 2024-03-30T12:31:20.366 INFO:tasks.rados.rados.0.smithi084.stdout:2534: oid 29 version 17541 is already newer than 17540 2024-03-30T12:31:20.366 INFO:tasks.rados.rados.0.smithi084.stdout:2534: oid 29 version 17541 is already newer than 17539 2024-03-30T12:31:20.366 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 17541 (ObjNum 779 snap 260 seq_num 779) dirty exists 2024-03-30T12:31:20.366 INFO:tasks.rados.rados.0.smithi084.stdout:2534: left oid 29 (ObjNum 779 snap 260 seq_num 779) 2024-03-30T12:31:20.366 INFO:tasks.rados.rados.0.smithi084.stdout:2536: finishing rollback tid 0 to smithi08477944-1 2024-03-30T12:31:20.367 INFO:tasks.rados.rados.0.smithi084.stdout:2536: finishing rollback tid 1 to smithi08477944-1 2024-03-30T12:31:20.367 INFO:tasks.rados.rados.0.smithi084.stdout:2536: finishing rollback tid 2 to smithi08477944-1 2024-03-30T12:31:20.367 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 17495 (ObjNum 664 snap 232 seq_num 664) dirty exists 2024-03-30T12:31:20.367 INFO:tasks.rados.rados.0.smithi084.stdout:2538: finishing write tid 1 to smithi08477944-49 2024-03-30T12:31:20.367 INFO:tasks.rados.rados.0.smithi084.stdout:2538: finishing write tid 2 to smithi08477944-49 2024-03-30T12:31:20.367 INFO:tasks.rados.rados.0.smithi084.stdout:2538: finishing write tid 3 to smithi08477944-49 2024-03-30T12:31:20.367 INFO:tasks.rados.rados.0.smithi084.stdout:2538: finishing write tid 4 to smithi08477944-49 2024-03-30T12:31:20.367 INFO:tasks.rados.rados.0.smithi084.stdout:2538: oid 49 updating version 0 to 17517 2024-03-30T12:31:20.367 INFO:tasks.rados.rados.0.smithi084.stdout:2538: oid 49 updating version 17517 to 17519 2024-03-30T12:31:20.367 INFO:tasks.rados.rados.0.smithi084.stdout:2538: oid 49 version 17519 is already newer than 17518 2024-03-30T12:31:20.367 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 17519 (ObjNum 780 snap 260 seq_num 780) dirty exists 2024-03-30T12:31:20.367 INFO:tasks.rados.rados.0.smithi084.stdout:2538: left oid 49 (ObjNum 780 snap 260 seq_num 780) 2024-03-30T12:31:20.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:20.298+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:20.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:20.298+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:20.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:20.326+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:20.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:20.327+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:20.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:20.300+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:20.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:20.300+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:20.663 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:20.326+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:20.664 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:20.327+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:20.664 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:20.299+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:20.664 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:20.299+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:20.664 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:20.300+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:20.664 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:20.300+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:20.664 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:20.300+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:21.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:21.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:21.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:21.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:21.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:21.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:21.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:21.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:21.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:21.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:21.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:21.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:21.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:21.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:21.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[91810]: osdmap e592: 8 total, 8 up, 8 in 2024-03-30T12:31:21.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:21.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:21.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:21.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:21.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:21.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:21.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:21.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:21.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:21.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:21.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:21.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:21.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:21.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:21.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:21.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:21.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[89279]: osdmap e592: 8 total, 8 up, 8 in 2024-03-30T12:31:21.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:21.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:20 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:21.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:20.746+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:21.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:21.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:21.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:21.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:21.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:21.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:21.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:21.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:21.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:20 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:21.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:20 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:21.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:21.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:21.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:21.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:21.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:20 smithi162 ceph-mon[83709]: osdmap e592: 8 total, 8 up, 8 in 2024-03-30T12:31:21.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:20 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:21.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:20 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:21.294 INFO:tasks.rados.rados.0.smithi084.stdout:2534: done (5 left) 2024-03-30T12:31:21.294 INFO:tasks.rados.rados.0.smithi084.stdout:2535: done (4 left) 2024-03-30T12:31:21.294 INFO:tasks.rados.rados.0.smithi084.stdout:2536: done (3 left) 2024-03-30T12:31:21.294 INFO:tasks.rados.rados.0.smithi084.stdout:2537: done (2 left) 2024-03-30T12:31:21.294 INFO:tasks.rados.rados.0.smithi084.stdout:2538: done (1 left) 2024-03-30T12:31:21.294 INFO:tasks.rados.rados.0.smithi084.stdout:2539: done (0 left) 2024-03-30T12:31:21.294 INFO:tasks.rados.rados.0.smithi084.stdout:2540: snap_remove snap 259 2024-03-30T12:31:21.583 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:21.301+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:21.583 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:21.301+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:21.583 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:21.301+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:21.583 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:21.301+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:21.583 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:21.301+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:21.583 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:21.301+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:21.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:21.302+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:21.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:21.304+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:21.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:21.304+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:21.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:21.303+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:21.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:21.303+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:21.902 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:21.903 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:21.903 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:21.903 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:21.903 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:21.903 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:21.903 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:21.903 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:21.903 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[89279]: pgmap v575: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 604 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 13 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2024-03-30T12:31:21.903 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:21.903 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:21.903 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:21.903 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[89279]: osdmap e593: 8 total, 8 up, 8 in 2024-03-30T12:31:21.903 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:21.904 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:21.904 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:21.904 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:21.904 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:21.904 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:21.904 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:21.904 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:21.904 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:21.904 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:21.904 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:21.904 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:21.904 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[91810]: pgmap v575: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 604 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 13 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2024-03-30T12:31:21.905 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:21.905 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:21.905 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:21.905 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[91810]: osdmap e593: 8 total, 8 up, 8 in 2024-03-30T12:31:21.905 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:21.905 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:21.905 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:21.905 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:21.970 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:21.905+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:21.970 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:21.905+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:21.970 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:21.905+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:21.970 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:21.970 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:21.971 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:21.971 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:21.971 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:21.971 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:21.971 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:21.971 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:21.971 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-mon[83709]: pgmap v575: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 604 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 13 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2024-03-30T12:31:21.971 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:21.971 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:21.971 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:21.971 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-mon[83709]: osdmap e593: 8 total, 8 up, 8 in 2024-03-30T12:31:21.971 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:21.971 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:21.971 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:21.972 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:22.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:21.909+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:22.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:21.909+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:22.296 INFO:tasks.rados.rados.0.smithi084.stdout:2540: done (0 left) 2024-03-30T12:31:22.296 INFO:tasks.rados.rados.0.smithi084.stdout:2541: copy_from oid 13 from oid 29 current snap is 261 2024-03-30T12:31:22.296 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 261 2024-03-30T12:31:22.296 INFO:tasks.rados.rados.0.smithi084.stdout:2542: seq_num 781 ranges {4595712=688128,5283840=401408} 2024-03-30T12:31:22.298 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:21.978+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:22.324 INFO:tasks.rados.rados.0.smithi084.stdout:2542: writing smithi08477944-47 from 4595712 to 5283840 tid 1 2024-03-30T12:31:22.327 INFO:tasks.rados.rados.0.smithi084.stdout:2542: writing smithi08477944-47 from 5283840 to 5685248 tid 2 2024-03-30T12:31:22.327 INFO:tasks.rados.rados.0.smithi084.stdout:2543: read oid 28 snap 255 2024-03-30T12:31:22.327 INFO:tasks.rados.rados.0.smithi084.stdout:2543: expect deleted 2024-03-30T12:31:22.328 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 261 2024-03-30T12:31:22.328 INFO:tasks.rados.rados.0.smithi084.stdout:2541: finishing copy_from racing read to smithi08477944-13 2024-03-30T12:31:22.328 INFO:tasks.rados.rados.0.smithi084.stdout:2541: finishing copy_from to smithi08477944-13 2024-03-30T12:31:22.328 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 17541 (ObjNum 779 snap 260 seq_num 779) dirty exists 2024-03-30T12:31:22.328 INFO:tasks.rados.rados.0.smithi084.stdout:2544: seq_num 782 ranges {0=704512,704512=401408} 2024-03-30T12:31:22.331 INFO:tasks.rados.rados.0.smithi084.stdout:2544: writing smithi08477944-21 from 0 to 704512 tid 1 2024-03-30T12:31:22.334 INFO:tasks.rados.rados.0.smithi084.stdout:2544: writing smithi08477944-21 from 704512 to 1105920 tid 2 2024-03-30T12:31:22.335 INFO:tasks.rados.rados.0.smithi084.stdout:2541: done (3 left) 2024-03-30T12:31:22.335 INFO:tasks.rados.rados.0.smithi084.stdout:2545: setattr oid 43 current snap is 261 2024-03-30T12:31:22.335 INFO:tasks.rados.rados.0.smithi084.stdout:2542: finishing write tid 1 to smithi08477944-47 2024-03-30T12:31:22.335 INFO:tasks.rados.rados.0.smithi084.stdout:2542: finishing write tid 2 to smithi08477944-47 2024-03-30T12:31:22.335 INFO:tasks.rados.rados.0.smithi084.stdout:2542: finishing write tid 3 to smithi08477944-47 2024-03-30T12:31:22.336 INFO:tasks.rados.rados.0.smithi084.stdout:2542: finishing write tid 4 to smithi08477944-47 2024-03-30T12:31:22.336 INFO:tasks.rados.rados.0.smithi084.stdout:2542: oid 47 updating version 0 to 17551 2024-03-30T12:31:22.336 INFO:tasks.rados.rados.0.smithi084.stdout:2542: oid 47 updating version 17551 to 17552 2024-03-30T12:31:22.336 INFO:tasks.rados.rados.0.smithi084.stdout:2542: oid 47 updating version 17552 to 17553 2024-03-30T12:31:22.336 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 17553 (ObjNum 781 snap 261 seq_num 781) dirty exists 2024-03-30T12:31:22.336 INFO:tasks.rados.rados.0.smithi084.stdout:2542: left oid 47 (ObjNum 781 snap 261 seq_num 781) 2024-03-30T12:31:22.336 INFO:tasks.rados.rados.0.smithi084.stdout:2542: done (3 left) 2024-03-30T12:31:22.336 INFO:tasks.rados.rados.0.smithi084.stdout:2543: done (2 left) 2024-03-30T12:31:22.337 INFO:tasks.rados.rados.0.smithi084.stdout:2546: rollback oid 24 current snap is 261 2024-03-30T12:31:22.337 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 24 to 255 2024-03-30T12:31:22.337 INFO:tasks.rados.rados.0.smithi084.stdout:2547: rmattr oid 19 current snap is 261 2024-03-30T12:31:22.337 INFO:tasks.rados.rados.0.smithi084.stdout:2548: copy_from oid 49 from oid 10 current snap is 261 2024-03-30T12:31:22.337 INFO:tasks.rados.rados.0.smithi084.stdout:2549: snap_create 2024-03-30T12:31:22.343 INFO:tasks.rados.rados.0.smithi084.stdout:2546: finishing rollback tid 1 to smithi08477944-24 2024-03-30T12:31:22.343 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 11264 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-03-30T12:31:22.345 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 36230 (ObjNum 129 snap 0 seq_num 1430207656) dirty exists 2024-03-30T12:31:22.346 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 36232 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:31:22.346 INFO:tasks.rados.rados.0.smithi084.stdout:2544: finishing write tid 1 to smithi08477944-21 2024-03-30T12:31:22.346 INFO:tasks.rados.rados.0.smithi084.stdout:2544: finishing write tid 2 to smithi08477944-21 2024-03-30T12:31:22.346 INFO:tasks.rados.rados.0.smithi084.stdout:2544: finishing write tid 3 to smithi08477944-21 2024-03-30T12:31:22.350 INFO:tasks.rados.rados.0.smithi084.stdout:2544: finishing write tid 4 to smithi08477944-21 2024-03-30T12:31:22.350 INFO:tasks.rados.rados.0.smithi084.stdout:2544: oid 21 updating version 0 to 25291 2024-03-30T12:31:22.350 INFO:tasks.rados.rados.0.smithi084.stdout:2544: oid 21 version 25291 is already newer than 25290 2024-03-30T12:31:22.350 INFO:tasks.rados.rados.0.smithi084.stdout:2544: oid 21 updating version 25291 to 25292 2024-03-30T12:31:22.350 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 25292 (ObjNum 782 snap 261 seq_num 782) dirty exists 2024-03-30T12:31:22.350 INFO:tasks.rados.rados.0.smithi084.stdout:2544: left oid 21 (ObjNum 782 snap 261 seq_num 782) 2024-03-30T12:31:22.354 INFO:tasks.rados.rados.0.smithi084.stdout:2548: finishing copy_from racing read to smithi08477944-49 2024-03-30T12:31:22.354 INFO:tasks.rados.rados.0.smithi084.stdout:2548: finishing copy_from to smithi08477944-49 2024-03-30T12:31:22.354 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 17538 (ObjNum 757 snap 253 seq_num 757) dirty exists 2024-03-30T12:31:22.540 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:22.312+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:22.540 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:22.313+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:22.541 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:22.303+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:22.541 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:22.303+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:22.541 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:22.303+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:22.541 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:22.303+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:22.541 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:22.303+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:22.624 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:22.325+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:22.624 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:22.307+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:22.625 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:22.307+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:22.625 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:22.309+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:22.625 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:22.309+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:22.625 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:22.305+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:22.625 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:22.306+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:22.816 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:22.816 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:22.816 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:22.816 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:22.816 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:22.817 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:22.817 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-mon[89279]: osdmap e594: 8 total, 8 up, 8 in 2024-03-30T12:31:22.817 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:22.817 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:22.817 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:22.817 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:22.817 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:22.817 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:22.817 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:22.817 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:22.817 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:22.817 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:22.818 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-mon[91810]: osdmap e594: 8 total, 8 up, 8 in 2024-03-30T12:31:22.818 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:22.818 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:22.818 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:22.818 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:22.947 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:22.948 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:22.948 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:22.948 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:22.948 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:22.948 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:22.948 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:22 smithi162 ceph-mon[83709]: osdmap e594: 8 total, 8 up, 8 in 2024-03-30T12:31:22.948 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:22.948 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:22.948 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:22.949 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:23.298 INFO:tasks.rados.rados.0.smithi084.stdout:2544: done (5 left) 2024-03-30T12:31:23.298 INFO:tasks.rados.rados.0.smithi084.stdout:2545: done (4 left) 2024-03-30T12:31:23.298 INFO:tasks.rados.rados.0.smithi084.stdout:2546: done (3 left) 2024-03-30T12:31:23.298 INFO:tasks.rados.rados.0.smithi084.stdout:2547: done (2 left) 2024-03-30T12:31:23.298 INFO:tasks.rados.rados.0.smithi084.stdout:2548: done (1 left) 2024-03-30T12:31:23.298 INFO:tasks.rados.rados.0.smithi084.stdout:2549: done (0 left) 2024-03-30T12:31:23.298 INFO:tasks.rados.rados.0.smithi084.stdout:2550: read oid 2 snap 254 2024-03-30T12:31:23.298 INFO:tasks.rados.rados.0.smithi084.stdout:2550: expect (ObjNum 753 snap 253 seq_num 753) 2024-03-30T12:31:23.299 INFO:tasks.rados.rados.0.smithi084.stdout:2551: copy_from oid 8 from oid 20 current snap is 262 2024-03-30T12:31:23.299 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 262 2024-03-30T12:31:23.299 INFO:tasks.rados.rados.0.smithi084.stdout:2552: seq_num 783 ranges {2260992=720896,2981888=401408} 2024-03-30T12:31:23.313 INFO:tasks.rados.rados.0.smithi084.stdout:2552: writing smithi08477944-5 from 2260992 to 2981888 tid 1 2024-03-30T12:31:23.316 INFO:tasks.rados.rados.0.smithi084.stdout:2552: writing smithi08477944-5 from 2981888 to 3383296 tid 2 2024-03-30T12:31:23.316 INFO:tasks.rados.rados.0.smithi084.stdout:2553: read oid 7 snap -1 2024-03-30T12:31:23.316 INFO:tasks.rados.rados.0.smithi084.stdout:2553: expect (ObjNum 772 snap 255 seq_num 772) 2024-03-30T12:31:23.316 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 262 2024-03-30T12:31:23.317 INFO:tasks.rados.rados.0.smithi084.stdout:2554: seq_num 784 ranges {0=737280,737280=401408} 2024-03-30T12:31:23.321 INFO:tasks.rados.rados.0.smithi084.stdout:2554: writing smithi08477944-24 from 0 to 737280 tid 1 2024-03-30T12:31:23.323 INFO:tasks.rados.rados.0.smithi084.stdout:2554: writing smithi08477944-24 from 737280 to 1138688 tid 2 2024-03-30T12:31:23.324 INFO:tasks.rados.rados.0.smithi084.stdout:2555: setattr oid 26 current snap is 262 2024-03-30T12:31:23.324 INFO:tasks.rados.rados.0.smithi084.stdout:2551: finishing copy_from to smithi08477944-8 2024-03-30T12:31:23.324 INFO:tasks.rados.rados.0.smithi084.stdout:2551: got expected ENOENT (src dne) 2024-03-30T12:31:23.324 INFO:tasks.rados.rados.0.smithi084.stdout:2551: finishing copy_from racing read to smithi08477944-8 2024-03-30T12:31:23.324 INFO:tasks.rados.rados.0.smithi084.stdout:2550: expect (ObjNum 753 snap 253 seq_num 753) 2024-03-30T12:31:23.352 INFO:tasks.rados.rados.0.smithi084.stdout:2552: finishing write tid 1 to smithi08477944-5 2024-03-30T12:31:23.352 INFO:tasks.rados.rados.0.smithi084.stdout:2552: finishing write tid 2 to smithi08477944-5 2024-03-30T12:31:23.352 INFO:tasks.rados.rados.0.smithi084.stdout:2552: finishing write tid 3 to smithi08477944-5 2024-03-30T12:31:23.353 INFO:tasks.rados.rados.0.smithi084.stdout:2553: expect (ObjNum 772 snap 255 seq_num 772) 2024-03-30T12:31:23.427 INFO:tasks.rados.rados.0.smithi084.stdout:2552: finishing write tid 4 to smithi08477944-5 2024-03-30T12:31:23.428 INFO:tasks.rados.rados.0.smithi084.stdout:2552: oid 5 updating version 0 to 17506 2024-03-30T12:31:23.428 INFO:tasks.rados.rados.0.smithi084.stdout:2552: oid 5 version 17506 is already newer than 17505 2024-03-30T12:31:23.428 INFO:tasks.rados.rados.0.smithi084.stdout:2552: oid 5 version 17506 is already newer than 17504 2024-03-30T12:31:23.428 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 17506 (ObjNum 783 snap 262 seq_num 783) dirty exists 2024-03-30T12:31:23.428 INFO:tasks.rados.rados.0.smithi084.stdout:2552: left oid 5 (ObjNum 783 snap 262 seq_num 783) 2024-03-30T12:31:23.428 INFO:tasks.rados.rados.0.smithi084.stdout:2554: finishing write tid 1 to smithi08477944-24 2024-03-30T12:31:23.428 INFO:tasks.rados.rados.0.smithi084.stdout:2554: finishing write tid 2 to smithi08477944-24 2024-03-30T12:31:23.428 INFO:tasks.rados.rados.0.smithi084.stdout:2550: done (5 left) 2024-03-30T12:31:23.428 INFO:tasks.rados.rados.0.smithi084.stdout:2551: done (4 left) 2024-03-30T12:31:23.428 INFO:tasks.rados.rados.0.smithi084.stdout:2552: done (3 left) 2024-03-30T12:31:23.428 INFO:tasks.rados.rados.0.smithi084.stdout:2553: done (2 left) 2024-03-30T12:31:23.429 INFO:tasks.rados.rados.0.smithi084.stdout:2556: copy_from oid 15 from oid 35 current snap is 262 2024-03-30T12:31:23.429 INFO:tasks.rados.rados.0.smithi084.stdout:2554: finishing write tid 3 to smithi08477944-24 2024-03-30T12:31:23.429 INFO:tasks.rados.rados.0.smithi084.stdout:2554: finishing write tid 4 to smithi08477944-24 2024-03-30T12:31:23.429 INFO:tasks.rados.rados.0.smithi084.stdout:2554: oid 24 updating version 0 to 17542 2024-03-30T12:31:23.429 INFO:tasks.rados.rados.0.smithi084.stdout:2554: oid 24 updating version 17542 to 17543 2024-03-30T12:31:23.429 INFO:tasks.rados.rados.0.smithi084.stdout:2554: oid 24 updating version 17543 to 17544 2024-03-30T12:31:23.429 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 17544 (ObjNum 784 snap 262 seq_num 784) dirty exists 2024-03-30T12:31:23.429 INFO:tasks.rados.rados.0.smithi084.stdout:2554: left oid 24 (ObjNum 784 snap 262 seq_num 784) 2024-03-30T12:31:23.429 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 27221 (ObjNum 770 snap 254 seq_num 770) dirty exists 2024-03-30T12:31:23.429 INFO:tasks.rados.rados.0.smithi084.stdout:2554: done (2 left) 2024-03-30T12:31:23.429 INFO:tasks.rados.rados.0.smithi084.stdout:2555: done (1 left) 2024-03-30T12:31:23.429 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 262 2024-03-30T12:31:23.429 INFO:tasks.rados.rados.0.smithi084.stdout:2557: seq_num 785 ranges {2416640=753664,3170304=401408} 2024-03-30T12:31:23.444 INFO:tasks.rados.rados.0.smithi084.stdout:2557: writing smithi08477944-39 from 2416640 to 3170304 tid 1 2024-03-30T12:31:23.447 INFO:tasks.rados.rados.0.smithi084.stdout:2557: writing smithi08477944-39 from 3170304 to 3571712 tid 2 2024-03-30T12:31:23.447 INFO:tasks.rados.rados.0.smithi084.stdout:2558: copy_from oid 16 from oid 17 current snap is 262 2024-03-30T12:31:23.447 INFO:tasks.rados.rados.0.smithi084.stdout:2556: finishing copy_from racing read to smithi08477944-15 2024-03-30T12:31:23.447 INFO:tasks.rados.rados.0.smithi084.stdout:2556: finishing copy_from to smithi08477944-15 2024-03-30T12:31:23.447 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 17492 (ObjNum 65 snap 0 seq_num 1532974936) dirty exists 2024-03-30T12:31:23.447 INFO:tasks.rados.rados.0.smithi084.stdout:2556: done (2 left) 2024-03-30T12:31:23.447 INFO:tasks.rados.rados.0.smithi084.stdout:2559: delete oid 48 current snap is 262 2024-03-30T12:31:23.449 INFO:tasks.rados.rados.0.smithi084.stdout:2557: finishing write tid 1 to smithi08477944-39 2024-03-30T12:31:23.450 INFO:tasks.rados.rados.0.smithi084.stdout:2559: done (2 left) 2024-03-30T12:31:23.450 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 262 2024-03-30T12:31:23.450 INFO:tasks.rados.rados.0.smithi084.stdout:2560: seq_num 787 ranges {5685248=786432,6471680=401408} 2024-03-30T12:31:23.485 INFO:tasks.rados.rados.0.smithi084.stdout:2560: writing smithi08477944-47 from 5685248 to 6471680 tid 1 2024-03-30T12:31:23.489 INFO:tasks.rados.rados.0.smithi084.stdout:2560: writing smithi08477944-47 from 6471680 to 6873088 tid 2 2024-03-30T12:31:23.489 INFO:tasks.rados.rados.0.smithi084.stdout:2561: read oid 3 snap -1 2024-03-30T12:31:23.489 INFO:tasks.rados.rados.0.smithi084.stdout:2561: expect (ObjNum 729 snap 244 seq_num 729) 2024-03-30T12:31:23.489 INFO:tasks.rados.rados.0.smithi084.stdout:2557: finishing write tid 2 to smithi08477944-39 2024-03-30T12:31:23.489 INFO:tasks.rados.rados.0.smithi084.stdout:2557: finishing write tid 3 to smithi08477944-39 2024-03-30T12:31:23.489 INFO:tasks.rados.rados.0.smithi084.stdout:2557: finishing write tid 4 to smithi08477944-39 2024-03-30T12:31:23.489 INFO:tasks.rados.rados.0.smithi084.stdout:2557: oid 39 updating version 0 to 23402 2024-03-30T12:31:23.489 INFO:tasks.rados.rados.0.smithi084.stdout:2557: oid 39 updating version 23402 to 23403 2024-03-30T12:31:23.490 INFO:tasks.rados.rados.0.smithi084.stdout:2557: oid 39 version 23403 is already newer than 23401 2024-03-30T12:31:23.490 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 23403 (ObjNum 785 snap 262 seq_num 785) dirty exists 2024-03-30T12:31:23.490 INFO:tasks.rados.rados.0.smithi084.stdout:2557: left oid 39 (ObjNum 785 snap 262 seq_num 785) 2024-03-30T12:31:23.490 INFO:tasks.rados.rados.0.smithi084.stdout:2558: finishing copy_from racing read to smithi08477944-16 2024-03-30T12:31:23.490 INFO:tasks.rados.rados.0.smithi084.stdout:2558: finishing copy_from to smithi08477944-16 2024-03-30T12:31:23.490 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 17503 (ObjNum 662 snap 232 seq_num 662) dirty exists 2024-03-30T12:31:23.490 INFO:tasks.rados.rados.0.smithi084.stdout:2557: done (3 left) 2024-03-30T12:31:23.490 INFO:tasks.rados.rados.0.smithi084.stdout:2558: done (2 left) 2024-03-30T12:31:23.490 INFO:tasks.rados.rados.0.smithi084.stdout:2562: rollback oid 10 current snap is 262 2024-03-30T12:31:23.490 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 10 to 255 2024-03-30T12:31:23.490 INFO:tasks.rados.rados.0.smithi084.stdout:2563: rmattr oid 32 current snap is 262 2024-03-30T12:31:23.490 INFO:tasks.rados.rados.0.smithi084.stdout:2563: done (3 left) 2024-03-30T12:31:23.490 INFO:tasks.rados.rados.0.smithi084.stdout:2564: snap_create 2024-03-30T12:31:23.491 INFO:tasks.rados.rados.0.smithi084.stdout:2560: finishing write tid 1 to smithi08477944-47 2024-03-30T12:31:23.492 INFO:tasks.rados.rados.0.smithi084.stdout:2560: finishing write tid 2 to smithi08477944-47 2024-03-30T12:31:23.492 INFO:tasks.rados.rados.0.smithi084.stdout:2560: finishing write tid 3 to smithi08477944-47 2024-03-30T12:31:23.492 INFO:tasks.rados.rados.0.smithi084.stdout:2561: expect (ObjNum 729 snap 244 seq_num 729) 2024-03-30T12:31:23.504 INFO:tasks.rados.rados.0.smithi084.stdout:2560: finishing write tid 4 to smithi08477944-47 2024-03-30T12:31:23.504 INFO:tasks.rados.rados.0.smithi084.stdout:2560: oid 47 updating version 0 to 17556 2024-03-30T12:31:23.504 INFO:tasks.rados.rados.0.smithi084.stdout:2560: oid 47 version 17556 is already newer than 17555 2024-03-30T12:31:23.504 INFO:tasks.rados.rados.0.smithi084.stdout:2560: oid 47 version 17556 is already newer than 17554 2024-03-30T12:31:23.504 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 17556 (ObjNum 787 snap 262 seq_num 787) dirty exists 2024-03-30T12:31:23.504 INFO:tasks.rados.rados.0.smithi084.stdout:2560: left oid 47 (ObjNum 787 snap 262 seq_num 787) 2024-03-30T12:31:23.504 INFO:tasks.rados.rados.0.smithi084.stdout:2562: finishing rollback tid 0 to smithi08477944-10 2024-03-30T12:31:23.504 INFO:tasks.rados.rados.0.smithi084.stdout:2562: finishing rollback tid 1 to smithi08477944-10 2024-03-30T12:31:23.504 INFO:tasks.rados.rados.0.smithi084.stdout:2562: finishing rollback tid 2 to smithi08477944-10 2024-03-30T12:31:23.504 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 27202 (ObjNum 757 snap 253 seq_num 757) dirty exists 2024-03-30T12:31:23.560 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:23.328+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:23.561 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:23.328+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:23.561 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:23.304+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:23.561 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:23.304+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:23.561 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:23.304+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:23.561 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:23.304+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:23.561 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:23.304+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:23.561 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:23.304+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:23.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:23.336+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:23.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:23.305+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:23.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:23.305+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:23.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:23.305+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:23.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:23.305+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:23.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:23.306+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:23.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:23.309+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:23.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:23.309+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:23.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:23.313+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:23.858 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:23.858 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:23.858 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:23.858 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:23.859 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:23.859 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:23.859 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:23.859 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:23.859 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:23.859 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:23.859 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:23.859 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:23.859 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[91810]: pgmap v578: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 605 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 2.6 MiB/s rd, 504 KiB/s wr, 11 op/s 2024-03-30T12:31:23.859 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:23.859 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:23.859 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[91810]: osdmap e595: 8 total, 8 up, 8 in 2024-03-30T12:31:23.859 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:23.859 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:23.860 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:23.860 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:23.860 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:23.860 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:23.860 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:23.860 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:23.860 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:23.860 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:23.860 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:23.860 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:23.860 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:23.860 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:23.861 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[89279]: pgmap v578: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 605 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 2.6 MiB/s rd, 504 KiB/s wr, 11 op/s 2024-03-30T12:31:23.861 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:23.861 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:23.861 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[89279]: osdmap e595: 8 total, 8 up, 8 in 2024-03-30T12:31:23.861 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:23.861 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:23.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:23.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:23.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:23.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:23.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:23.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:23.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:23.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:23.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:23.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:23.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:23.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:23.936 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-mon[83709]: pgmap v578: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 605 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 2.6 MiB/s rd, 504 KiB/s wr, 11 op/s 2024-03-30T12:31:23.936 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:23.936 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:23.936 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-mon[83709]: osdmap e595: 8 total, 8 up, 8 in 2024-03-30T12:31:23.936 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:23.936 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:24.301 INFO:tasks.rados.rados.0.smithi084.stdout:2560: done (3 left) 2024-03-30T12:31:24.301 INFO:tasks.rados.rados.0.smithi084.stdout:2561: done (2 left) 2024-03-30T12:31:24.301 INFO:tasks.rados.rados.0.smithi084.stdout:2562: done (1 left) 2024-03-30T12:31:24.301 INFO:tasks.rados.rados.0.smithi084.stdout:2564: done (0 left) 2024-03-30T12:31:24.301 INFO:tasks.rados.rados.0.smithi084.stdout:2565: snap_create 2024-03-30T12:31:24.583 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:24.306+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 144=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:24.679 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:24.308+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:24.680 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:24.309+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:24.680 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:24.307+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:24.680 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:24.307+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:24.680 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:24.307+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:24.680 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:24.307+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:24.680 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:24.307+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:24.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:24.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:24.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:24.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:24.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:24.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:24.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:24.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:24.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:24.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:24 smithi162 ceph-mon[83709]: osdmap e596: 8 total, 8 up, 8 in 2024-03-30T12:31:24.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:24 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:24.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:24 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:24.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:24 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:24.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:24 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:24.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:24 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:31:24.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:24 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:31:24.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:24 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[91810]: osdmap e596: 8 total, 8 up, 8 in 2024-03-30T12:31:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:25.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:25.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:31:25.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:31:25.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:25.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:25.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:25.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:25.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:25.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:25.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 132=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:25.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:25.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:25.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:25.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[89279]: osdmap e596: 8 total, 8 up, 8 in 2024-03-30T12:31:25.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:25.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:25.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:25.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:25.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:31:25.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:31:25.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:24 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:25.304 INFO:tasks.rados.rados.0.smithi084.stdout:2565: done (0 left) 2024-03-30T12:31:25.304 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 264 2024-03-30T12:31:25.304 INFO:tasks.rados.rados.0.smithi084.stdout:2566: seq_num 788 ranges {0=802816,802816=401408} 2024-03-30T12:31:25.308 INFO:tasks.rados.rados.0.smithi084.stdout:2566: writing smithi08477944-15 from 0 to 802816 tid 1 2024-03-30T12:31:25.311 INFO:tasks.rados.rados.0.smithi084.stdout:2566: writing smithi08477944-15 from 802816 to 1204224 tid 2 2024-03-30T12:31:25.311 INFO:tasks.rados.rados.0.smithi084.stdout:2567: rollback oid 3 current snap is 264 2024-03-30T12:31:25.311 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 3 to 258 2024-03-30T12:31:25.311 INFO:tasks.rados.rados.0.smithi084.stdout:2568: read oid 50 snap 261 2024-03-30T12:31:25.311 INFO:tasks.rados.rados.0.smithi084.stdout:2568: expect (ObjNum 747 snap 249 seq_num 747) 2024-03-30T12:31:25.311 INFO:tasks.rados.rados.0.smithi084.stdout:2569: snap_create 2024-03-30T12:31:25.320 INFO:tasks.rados.rados.0.smithi084.stdout:2566: finishing write tid 1 to smithi08477944-15 2024-03-30T12:31:25.320 INFO:tasks.rados.rados.0.smithi084.stdout:2566: finishing write tid 2 to smithi08477944-15 2024-03-30T12:31:25.320 INFO:tasks.rados.rados.0.smithi084.stdout:2566: finishing write tid 3 to smithi08477944-15 2024-03-30T12:31:25.322 INFO:tasks.rados.rados.0.smithi084.stdout:2566: finishing write tid 4 to smithi08477944-15 2024-03-30T12:31:25.322 INFO:tasks.rados.rados.0.smithi084.stdout:2566: oid 15 updating version 0 to 23405 2024-03-30T12:31:25.323 INFO:tasks.rados.rados.0.smithi084.stdout:2566: oid 15 updating version 23405 to 23406 2024-03-30T12:31:25.323 INFO:tasks.rados.rados.0.smithi084.stdout:2566: oid 15 version 23406 is already newer than 23404 2024-03-30T12:31:25.323 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 23406 (ObjNum 788 snap 264 seq_num 788) dirty exists 2024-03-30T12:31:25.323 INFO:tasks.rados.rados.0.smithi084.stdout:2566: left oid 15 (ObjNum 788 snap 264 seq_num 788) 2024-03-30T12:31:25.328 INFO:tasks.rados.rados.0.smithi084.stdout:2567: finishing rollback tid 0 to smithi08477944-3 2024-03-30T12:31:25.328 INFO:tasks.rados.rados.0.smithi084.stdout:2567: finishing rollback tid 1 to smithi08477944-3 2024-03-30T12:31:25.329 INFO:tasks.rados.rados.0.smithi084.stdout:2567: finishing rollback tid 2 to smithi08477944-3 2024-03-30T12:31:25.329 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 27225 (ObjNum 729 snap 244 seq_num 729) dirty exists 2024-03-30T12:31:25.334 INFO:tasks.rados.rados.0.smithi084.stdout:2568: expect (ObjNum 747 snap 249 seq_num 747) 2024-03-30T12:31:25.509 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:25.323+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 144=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:25.509 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:25.310+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:25.509 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:25.311+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:25.509 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:25.214+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:25.509 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:25.214+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:25.509 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:25.308+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:25.510 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:25.308+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:25.510 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:25.308+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:25.510 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:25.322+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:25.510 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:25.332+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 146=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:25.686 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:25.319+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:25.686 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:25.328+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:25.686 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:25.310+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:25.686 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:25.310+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:25.686 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:25.310+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:25.686 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:25.310+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:25.687 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:25.310+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:25.687 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:25.310+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:25.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 144=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:25.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:25.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:25.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:25.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:25.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:25.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:25.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: pgmap v581: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 617 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 4.9 MiB/s rd, 3.1 MiB/s wr, 17 op/s 2024-03-30T12:31:25.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:31:25.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:25.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:25.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:25.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:25.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:25.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:25.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:25.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:25.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:25.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:25.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:25.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:25.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:25.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:25.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:25.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: osdmap e597: 8 total, 8 up, 8 in 2024-03-30T12:31:25.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:25.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:25.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:25.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:26.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 144=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:26.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:26.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:26.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:26.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:26.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:26.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:26.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: pgmap v581: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 617 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 4.9 MiB/s rd, 3.1 MiB/s wr, 17 op/s 2024-03-30T12:31:26.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:31:26.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:26.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:26.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: osdmap e597: 8 total, 8 up, 8 in 2024-03-30T12:31:26.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 144=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:26.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:26.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:26.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:26.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:26.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:26.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:26.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: pgmap v581: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 617 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 4.9 MiB/s rd, 3.1 MiB/s wr, 17 op/s 2024-03-30T12:31:26.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:31:26.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.009 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.009 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.009 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.009 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.009 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.009 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.009 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.009 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:26.010 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:26.010 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:26.010 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: osdmap e597: 8 total, 8 up, 8 in 2024-03-30T12:31:26.010 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:26.010 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:26.010 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:26.010 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:26.010 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:26.010 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:26.011 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:26.011 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:26.305 INFO:tasks.rados.rados.0.smithi084.stdout:2566: done (3 left) 2024-03-30T12:31:26.305 INFO:tasks.rados.rados.0.smithi084.stdout:2567: done (2 left) 2024-03-30T12:31:26.305 INFO:tasks.rados.rados.0.smithi084.stdout:2568: done (1 left) 2024-03-30T12:31:26.305 INFO:tasks.rados.rados.0.smithi084.stdout:2569: done (0 left) 2024-03-30T12:31:26.305 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 265 2024-03-30T12:31:26.305 INFO:tasks.rados.rados.0.smithi084.stdout:2570: seq_num 789 ranges {1540096=417792,1957888=663552,2621440=139264} 2024-03-30T12:31:26.314 INFO:tasks.rados.rados.0.smithi084.stdout:2570: writing smithi08477944-7 from 1540096 to 1957888 tid 1 2024-03-30T12:31:26.318 INFO:tasks.rados.rados.0.smithi084.stdout:2570: writing smithi08477944-7 from 1957888 to 2621440 tid 2 2024-03-30T12:31:26.320 INFO:tasks.rados.rados.0.smithi084.stdout:2570: writing smithi08477944-7 from 2621440 to 2760704 tid 3 2024-03-30T12:31:26.320 INFO:tasks.rados.rados.0.smithi084.stdout:2571: rollback oid 44 current snap is 265 2024-03-30T12:31:26.320 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 44 to 254 2024-03-30T12:31:26.320 INFO:tasks.rados.rados.0.smithi084.stdout:2570: finishing write tid 1 to smithi08477944-7 2024-03-30T12:31:26.320 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 42 current snap is 265 2024-03-30T12:31:26.320 INFO:tasks.rados.rados.0.smithi084.stdout:2572: seq_num 790 ranges {671744=434176,1105920=548864,1654784=253952} 2024-03-30T12:31:26.326 INFO:tasks.rados.rados.0.smithi084.stdout:2572: writing smithi08477944-42 from 671744 to 1105920 tid 1 2024-03-30T12:31:26.330 INFO:tasks.rados.rados.0.smithi084.stdout:2572: writing smithi08477944-42 from 1105920 to 1654784 tid 2 2024-03-30T12:31:26.332 INFO:tasks.rados.rados.0.smithi084.stdout:2572: writing smithi08477944-42 from 1654784 to 1908736 tid 3 2024-03-30T12:31:26.332 INFO:tasks.rados.rados.0.smithi084.stdout:2573: rollback oid 9 current snap is 265 2024-03-30T12:31:26.333 INFO:tasks.rados.rados.0.smithi084.stdout:2570: finishing write tid 2 to smithi08477944-7 2024-03-30T12:31:26.333 INFO:tasks.rados.rados.0.smithi084.stdout:2570: finishing write tid 3 to smithi08477944-7 2024-03-30T12:31:26.333 INFO:tasks.rados.rados.0.smithi084.stdout:2570: finishing write tid 4 to smithi08477944-7 2024-03-30T12:31:26.333 INFO:tasks.rados.rados.0.smithi084.stdout:2570: finishing write tid 5 to smithi08477944-7 2024-03-30T12:31:26.333 INFO:tasks.rados.rados.0.smithi084.stdout:2570: oid 7 updating version 0 to 17557 2024-03-30T12:31:26.333 INFO:tasks.rados.rados.0.smithi084.stdout:2570: oid 7 updating version 17557 to 17560 2024-03-30T12:31:26.333 INFO:tasks.rados.rados.0.smithi084.stdout:2570: oid 7 version 17560 is already newer than 17558 2024-03-30T12:31:26.333 INFO:tasks.rados.rados.0.smithi084.stdout:2570: oid 7 version 17560 is already newer than 17559 2024-03-30T12:31:26.333 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 17560 (ObjNum 789 snap 265 seq_num 789) dirty exists 2024-03-30T12:31:26.333 INFO:tasks.rados.rados.0.smithi084.stdout:2570: left oid 7 (ObjNum 789 snap 265 seq_num 789) 2024-03-30T12:31:26.333 INFO:tasks.rados.rados.0.smithi084.stdout:2571: finishing rollback tid 0 to smithi08477944-44 2024-03-30T12:31:26.333 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 9 to 254 2024-03-30T12:31:26.333 INFO:tasks.rados.rados.0.smithi084.stdout:2570: done (3 left) 2024-03-30T12:31:26.333 INFO:tasks.rados.rados.0.smithi084.stdout:2574: read oid 28 snap -1 2024-03-30T12:31:26.334 INFO:tasks.rados.rados.0.smithi084.stdout:2574: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:31:26.334 INFO:tasks.rados.rados.0.smithi084.stdout:2575: read oid 2 snap -1 2024-03-30T12:31:26.334 INFO:tasks.rados.rados.0.smithi084.stdout:2575: expect (ObjNum 753 snap 253 seq_num 753) 2024-03-30T12:31:26.334 INFO:tasks.rados.rados.0.smithi084.stdout:2576: rollback oid 19 current snap is 265 2024-03-30T12:31:26.334 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 19 to 264 2024-03-30T12:31:26.334 INFO:tasks.rados.rados.0.smithi084.stdout:2577: setattr oid 10 current snap is 265 2024-03-30T12:31:26.334 INFO:tasks.rados.rados.0.smithi084.stdout:2571: finishing rollback tid 1 to smithi08477944-44 2024-03-30T12:31:26.334 INFO:tasks.rados.rados.0.smithi084.stdout:2571: finishing rollback tid 2 to smithi08477944-44 2024-03-30T12:31:26.334 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 36236 (ObjNum 440 snap 141 seq_num 440) dirty exists 2024-03-30T12:31:26.334 INFO:tasks.rados.rados.0.smithi084.stdout:2572: finishing write tid 1 to smithi08477944-42 2024-03-30T12:31:26.335 INFO:tasks.rados.rados.0.smithi084.stdout:2571: done (6 left) 2024-03-30T12:31:26.335 INFO:tasks.rados.rados.0.smithi084.stdout:2578: copy_from oid 43 from oid 22 current snap is 265 2024-03-30T12:31:26.335 INFO:tasks.rados.rados.0.smithi084.stdout:2579: rollback oid 8 current snap is 265 2024-03-30T12:31:26.335 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 8 to 260 2024-03-30T12:31:26.335 INFO:tasks.rados.rados.0.smithi084.stdout:2574: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:31:26.336 INFO:tasks.rados.rados.0.smithi084.stdout:2572: finishing write tid 2 to smithi08477944-42 2024-03-30T12:31:26.336 INFO:tasks.rados.rados.0.smithi084.stdout:2574: done (7 left) 2024-03-30T12:31:26.337 INFO:tasks.rados.rados.0.smithi084.stdout:2580: read oid 38 snap -1 2024-03-30T12:31:26.337 INFO:tasks.rados.rados.0.smithi084.stdout:2580: expect (ObjNum 711 snap 242 seq_num 711) 2024-03-30T12:31:26.337 INFO:tasks.rados.rados.0.smithi084.stdout:2581: snap_create 2024-03-30T12:31:26.337 INFO:tasks.rados.rados.0.smithi084.stdout:2573: finishing rollback tid 0 to smithi08477944-9 2024-03-30T12:31:26.337 INFO:tasks.rados.rados.0.smithi084.stdout:2573: finishing rollback tid 1 to smithi08477944-9 2024-03-30T12:31:26.337 INFO:tasks.rados.rados.0.smithi084.stdout:2573: finishing rollback tid 2 to smithi08477944-9 2024-03-30T12:31:26.337 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 22503 (ObjNum 769 snap 254 seq_num 769) dirty exists 2024-03-30T12:31:26.337 INFO:tasks.rados.rados.0.smithi084.stdout:2572: finishing write tid 3 to smithi08477944-42 2024-03-30T12:31:26.338 INFO:tasks.rados.rados.0.smithi084.stdout:2572: finishing write tid 4 to smithi08477944-42 2024-03-30T12:31:26.340 INFO:tasks.rados.rados.0.smithi084.stdout:2572: finishing write tid 5 to smithi08477944-42 2024-03-30T12:31:26.340 INFO:tasks.rados.rados.0.smithi084.stdout:2572: oid 42 updating version 0 to 23410 2024-03-30T12:31:26.340 INFO:tasks.rados.rados.0.smithi084.stdout:2572: oid 42 version 23410 is already newer than 23409 2024-03-30T12:31:26.340 INFO:tasks.rados.rados.0.smithi084.stdout:2572: oid 42 version 23410 is already newer than 23408 2024-03-30T12:31:26.340 INFO:tasks.rados.rados.0.smithi084.stdout:2572: oid 42 version 23410 is already newer than 23407 2024-03-30T12:31:26.340 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 23410 (ObjNum 790 snap 265 seq_num 790) dirty exists 2024-03-30T12:31:26.340 INFO:tasks.rados.rados.0.smithi084.stdout:2572: left oid 42 (ObjNum 790 snap 265 seq_num 790) 2024-03-30T12:31:26.343 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 27203 (ObjNum 757 snap 253 seq_num 757) dirty exists 2024-03-30T12:31:26.346 INFO:tasks.rados.rados.0.smithi084.stdout:2580: expect (ObjNum 711 snap 242 seq_num 711) 2024-03-30T12:31:26.412 INFO:tasks.rados.rados.0.smithi084.stdout:2579: finishing rollback tid 0 to smithi08477944-8 2024-03-30T12:31:26.412 INFO:tasks.rados.rados.0.smithi084.stdout:2576: finishing rollback tid 0 to smithi08477944-19 2024-03-30T12:31:26.412 INFO:tasks.rados.rados.0.smithi084.stdout:2576: finishing rollback tid 1 to smithi08477944-19 2024-03-30T12:31:26.412 INFO:tasks.rados.rados.0.smithi084.stdout:2576: finishing rollback tid 2 to smithi08477944-19 2024-03-30T12:31:26.412 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 36240 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:31:26.412 INFO:tasks.rados.rados.0.smithi084.stdout:2579: finishing rollback tid 1 to smithi08477944-8 2024-03-30T12:31:26.412 INFO:tasks.rados.rados.0.smithi084.stdout:2579: finishing rollback tid 2 to smithi08477944-8 2024-03-30T12:31:26.412 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 27229 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:31:26.412 INFO:tasks.rados.rados.0.smithi084.stdout:2575: expect (ObjNum 753 snap 253 seq_num 753) 2024-03-30T12:31:26.446 INFO:tasks.rados.rados.0.smithi084.stdout:2578: finishing copy_from racing read to smithi08477944-43 2024-03-30T12:31:26.446 INFO:tasks.rados.rados.0.smithi084.stdout:2578: finishing copy_from to smithi08477944-43 2024-03-30T12:31:26.447 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 26319 (ObjNum 706 snap 242 seq_num 706) dirty exists 2024-03-30T12:31:26.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:26.338+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 144=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:26.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:26.310+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:26.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:26.311+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:26.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:26.331+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:26.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:26.332+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:26.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:26.343+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:26.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:26.343+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:26.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:26.343+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 146=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:26.685 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:26.327+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:26.685 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:26.327+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:26.685 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:26.311+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:26.685 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:26.311+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:26.686 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:26.311+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:26.686 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:26.311+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:26.686 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:26.311+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:27.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:27.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:27.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:27.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:27.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:27.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:27.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 144=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:27.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:27.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 146=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:27.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:27.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[91810]: osdmap e598: 8 total, 8 up, 8 in 2024-03-30T12:31:27.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:27.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:27.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:27.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:27.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:27.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:27.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:27.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:27.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:27.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 144=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:27.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:27.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 146=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:27.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:27.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[89279]: osdmap e598: 8 total, 8 up, 8 in 2024-03-30T12:31:27.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:27.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:27.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:27.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:27.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:27.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:27.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:27.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:27.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:27.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 144=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:27.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:27.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 146=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:27.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:27.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:26 smithi162 ceph-mon[83709]: osdmap e598: 8 total, 8 up, 8 in 2024-03-30T12:31:27.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:27.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:27.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:27.307 INFO:tasks.rados.rados.0.smithi084.stdout:2572: done (8 left) 2024-03-30T12:31:27.307 INFO:tasks.rados.rados.0.smithi084.stdout:2573: done (7 left) 2024-03-30T12:31:27.307 INFO:tasks.rados.rados.0.smithi084.stdout:2575: done (6 left) 2024-03-30T12:31:27.307 INFO:tasks.rados.rados.0.smithi084.stdout:2576: done (5 left) 2024-03-30T12:31:27.307 INFO:tasks.rados.rados.0.smithi084.stdout:2577: done (4 left) 2024-03-30T12:31:27.307 INFO:tasks.rados.rados.0.smithi084.stdout:2578: done (3 left) 2024-03-30T12:31:27.307 INFO:tasks.rados.rados.0.smithi084.stdout:2579: done (2 left) 2024-03-30T12:31:27.307 INFO:tasks.rados.rados.0.smithi084.stdout:2580: done (1 left) 2024-03-30T12:31:27.307 INFO:tasks.rados.rados.0.smithi084.stdout:2581: done (0 left) 2024-03-30T12:31:27.307 INFO:tasks.rados.rados.0.smithi084.stdout:2582: read oid 8 snap -1 2024-03-30T12:31:27.307 INFO:tasks.rados.rados.0.smithi084.stdout:2582: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:31:27.308 INFO:tasks.rados.rados.0.smithi084.stdout:2583: delete oid 44 current snap is 266 2024-03-30T12:31:27.311 INFO:tasks.rados.rados.0.smithi084.stdout:2582: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:31:27.314 INFO:tasks.rados.rados.0.smithi084.stdout:2582: done (1 left) 2024-03-30T12:31:27.314 INFO:tasks.rados.rados.0.smithi084.stdout:2583: done (0 left) 2024-03-30T12:31:27.314 INFO:tasks.rados.rados.0.smithi084.stdout:2584: read oid 23 snap -1 2024-03-30T12:31:27.314 INFO:tasks.rados.rados.0.smithi084.stdout:2584: expect deleted 2024-03-30T12:31:27.314 INFO:tasks.rados.rados.0.smithi084.stdout:2585: snap_remove snap 255 2024-03-30T12:31:27.507 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:27.313+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:27.508 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:27.321+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:27.508 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:27.322+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:27.508 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:27.318+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:27.508 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:27.318+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:27.508 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:27.322+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:27.508 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:27.319+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:27.509 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:27.320+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 146=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:27.691 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:27.325+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:27.691 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:27.325+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:27.691 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:27.313+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:27.691 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:27.313+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:27.691 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:27.314+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:27.691 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:27.314+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:27.691 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:27.314+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:27.691 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:27.314+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:27.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:27.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:27.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:27.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:27.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:27.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:27.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 144=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:27.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:27.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 146=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:27.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:27 smithi162 ceph-mon[83709]: Upgrade: Updating prometheus.a 2024-03-30T12:31:27.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:27 smithi162 ceph-mon[83709]: Deploying daemon prometheus.a on smithi162 2024-03-30T12:31:27.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:27 smithi162 ceph-mon[83709]: pgmap v584: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 627 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 3.6 MiB/s rd, 5.3 MiB/s wr, 25 op/s 2024-03-30T12:31:27.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:27 smithi162 ceph-mon[83709]: osdmap e599: 8 total, 8 up, 8 in 2024-03-30T12:31:27.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:27.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:27.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:27.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:28.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:28.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:28.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:28.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:28.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:28.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:28.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 144=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:28.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:28.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 146=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:28.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[91810]: Upgrade: Updating prometheus.a 2024-03-30T12:31:28.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[91810]: Deploying daemon prometheus.a on smithi162 2024-03-30T12:31:28.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[91810]: pgmap v584: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 627 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 3.6 MiB/s rd, 5.3 MiB/s wr, 25 op/s 2024-03-30T12:31:28.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[91810]: osdmap e599: 8 total, 8 up, 8 in 2024-03-30T12:31:28.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:28.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:28.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:28.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:28.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:28.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13d=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:28.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:28.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:28.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:28.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:28.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 144=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:28.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:28.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 146=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:28.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[89279]: Upgrade: Updating prometheus.a 2024-03-30T12:31:28.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[89279]: Deploying daemon prometheus.a on smithi162 2024-03-30T12:31:28.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[89279]: pgmap v584: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 627 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 3.6 MiB/s rd, 5.3 MiB/s wr, 25 op/s 2024-03-30T12:31:28.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[89279]: osdmap e599: 8 total, 8 up, 8 in 2024-03-30T12:31:28.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:28.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:28.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:28.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:28.308 INFO:tasks.rados.rados.0.smithi084.stdout:2585: done (1 left) 2024-03-30T12:31:28.308 INFO:tasks.rados.rados.0.smithi084.stdout:2586: delete oid 19 current snap is 266 2024-03-30T12:31:28.315 INFO:tasks.rados.rados.0.smithi084.stdout:2584: done (1 left) 2024-03-30T12:31:28.315 INFO:tasks.rados.rados.0.smithi084.stdout:2586: done (0 left) 2024-03-30T12:31:28.315 INFO:tasks.rados.rados.0.smithi084.stdout:2587: snap_remove snap 263 2024-03-30T12:31:28.575 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:28.319+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:28.576 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:28.323+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:28.576 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:28.315+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:28.576 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:28.316+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:28.576 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:28.316+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:28.576 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:28.316+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:28.576 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:28.316+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 146=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:28.692 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:28.322+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:28.692 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:28.323+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:28.692 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:28.314+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:28.693 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:28.314+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:28.693 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:28.314+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:28.693 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:28.314+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:28.693 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:28.315+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:28.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:28.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:28.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:28.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:28.861 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:28.862 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:28.862 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 146=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:28.862 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:28.862 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:28.862 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:28 smithi162 ceph-mon[83709]: osdmap e600: 8 total, 8 up, 8 in 2024-03-30T12:31:28.862 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:28.862 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:28.862 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:28.862 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:29.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 146=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[91810]: osdmap e600: 8 total, 8 up, 8 in 2024-03-30T12:31:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:29.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:29.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:29.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:29.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:29.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:29.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:29.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:29.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 146=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:29.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:29.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:29.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[89279]: osdmap e600: 8 total, 8 up, 8 in 2024-03-30T12:31:29.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:29.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:29.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:29.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:29.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:28.899+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:29.310 INFO:tasks.rados.rados.0.smithi084.stdout:2587: done (0 left) 2024-03-30T12:31:29.310 INFO:tasks.rados.rados.0.smithi084.stdout:2588: copy_from oid 33 from oid 15 current snap is 266 2024-03-30T12:31:29.310 INFO:tasks.rados.rados.0.smithi084.stdout:2589: copy_from oid 16 from oid 12 current snap is 266 2024-03-30T12:31:29.310 INFO:tasks.rados.rados.0.smithi084.stdout:2590: rmattr oid 8 current snap is 266 2024-03-30T12:31:29.310 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 266 2024-03-30T12:31:29.311 INFO:tasks.rados.rados.0.smithi084.stdout:2591: seq_num 793 ranges {212992=483328,696320=647168,1343488=155648} 2024-03-30T12:31:29.315 INFO:tasks.rados.rados.0.smithi084.stdout:2591: writing smithi08477944-3 from 212992 to 696320 tid 1 2024-03-30T12:31:29.319 INFO:tasks.rados.rados.0.smithi084.stdout:2591: writing smithi08477944-3 from 696320 to 1343488 tid 2 2024-03-30T12:31:29.321 INFO:tasks.rados.rados.0.smithi084.stdout:2591: writing smithi08477944-3 from 1343488 to 1499136 tid 3 2024-03-30T12:31:29.321 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 266 2024-03-30T12:31:29.321 INFO:tasks.rados.rados.0.smithi084.stdout:2592: seq_num 794 ranges {0=499712,499712=532480,1032192=270336} 2024-03-30T12:31:29.323 INFO:tasks.rados.rados.0.smithi084.stdout:2592: writing smithi08477944-19 from 0 to 499712 tid 1 2024-03-30T12:31:29.327 INFO:tasks.rados.rados.0.smithi084.stdout:2592: writing smithi08477944-19 from 499712 to 1032192 tid 2 2024-03-30T12:31:29.329 INFO:tasks.rados.rados.0.smithi084.stdout:2592: writing smithi08477944-19 from 1032192 to 1302528 tid 3 2024-03-30T12:31:29.329 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 266 2024-03-30T12:31:29.329 INFO:tasks.rados.rados.0.smithi084.stdout:2588: finishing copy_from racing read to smithi08477944-33 2024-03-30T12:31:29.329 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 27231 (ObjNum 81 snap 0 seq_num 0) dirty exists 2024-03-30T12:31:29.329 INFO:tasks.rados.rados.0.smithi084.stdout:2593: seq_num 795 ranges {10903552=524288,11427840=417792,11845632=385024} 2024-03-30T12:31:29.391 INFO:tasks.rados.rados.0.smithi084.stdout:2593: writing smithi08477944-43 from 10903552 to 11427840 tid 1 2024-03-30T12:31:29.393 INFO:tasks.rados.rados.0.smithi084.stdout:2593: writing smithi08477944-43 from 11427840 to 11845632 tid 2 2024-03-30T12:31:29.396 INFO:tasks.rados.rados.0.smithi084.stdout:2593: writing smithi08477944-43 from 11845632 to 12230656 tid 3 2024-03-30T12:31:29.396 INFO:tasks.rados.rados.0.smithi084.stdout:2590: done (5 left) 2024-03-30T12:31:29.396 INFO:tasks.rados.rados.0.smithi084.stdout:2594: snap_create 2024-03-30T12:31:29.396 INFO:tasks.rados.rados.0.smithi084.stdout:2588: finishing copy_from to smithi08477944-33 2024-03-30T12:31:29.397 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 23406 (ObjNum 788 snap 264 seq_num 788) dirty exists 2024-03-30T12:31:29.397 INFO:tasks.rados.rados.0.smithi084.stdout:2592: finishing write tid 1 to smithi08477944-19 2024-03-30T12:31:29.397 INFO:tasks.rados.rados.0.smithi084.stdout:2589: finishing copy_from racing read to smithi08477944-16 2024-03-30T12:31:29.397 INFO:tasks.rados.rados.0.smithi084.stdout:2589: finishing copy_from to smithi08477944-16 2024-03-30T12:31:29.397 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 23382 (ObjNum 743 snap 248 seq_num 743) dirty exists 2024-03-30T12:31:29.397 INFO:tasks.rados.rados.0.smithi084.stdout:2591: finishing write tid 1 to smithi08477944-3 2024-03-30T12:31:29.397 INFO:tasks.rados.rados.0.smithi084.stdout:2591: finishing write tid 2 to smithi08477944-3 2024-03-30T12:31:29.397 INFO:tasks.rados.rados.0.smithi084.stdout:2591: finishing write tid 3 to smithi08477944-3 2024-03-30T12:31:29.397 INFO:tasks.rados.rados.0.smithi084.stdout:2591: finishing write tid 4 to smithi08477944-3 2024-03-30T12:31:29.397 INFO:tasks.rados.rados.0.smithi084.stdout:2592: finishing write tid 2 to smithi08477944-19 2024-03-30T12:31:29.397 INFO:tasks.rados.rados.0.smithi084.stdout:2592: finishing write tid 3 to smithi08477944-19 2024-03-30T12:31:29.397 INFO:tasks.rados.rados.0.smithi084.stdout:2592: finishing write tid 4 to smithi08477944-19 2024-03-30T12:31:29.397 INFO:tasks.rados.rados.0.smithi084.stdout:2591: finishing write tid 5 to smithi08477944-3 2024-03-30T12:31:29.397 INFO:tasks.rados.rados.0.smithi084.stdout:2591: oid 3 updating version 0 to 27233 2024-03-30T12:31:29.398 INFO:tasks.rados.rados.0.smithi084.stdout:2591: oid 3 updating version 27233 to 27234 2024-03-30T12:31:29.398 INFO:tasks.rados.rados.0.smithi084.stdout:2591: oid 3 updating version 27234 to 27235 2024-03-30T12:31:29.398 INFO:tasks.rados.rados.0.smithi084.stdout:2591: oid 3 updating version 27235 to 27236 2024-03-30T12:31:29.398 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 27236 (ObjNum 793 snap 266 seq_num 793) dirty exists 2024-03-30T12:31:29.398 INFO:tasks.rados.rados.0.smithi084.stdout:2591: left oid 3 (ObjNum 793 snap 266 seq_num 793) 2024-03-30T12:31:29.398 INFO:tasks.rados.rados.0.smithi084.stdout:2592: finishing write tid 5 to smithi08477944-19 2024-03-30T12:31:29.398 INFO:tasks.rados.rados.0.smithi084.stdout:2592: oid 19 updating version 0 to 36248 2024-03-30T12:31:29.398 INFO:tasks.rados.rados.0.smithi084.stdout:2592: oid 19 version 36248 is already newer than 36247 2024-03-30T12:31:29.398 INFO:tasks.rados.rados.0.smithi084.stdout:2592: oid 19 updating version 36248 to 36250 2024-03-30T12:31:29.398 INFO:tasks.rados.rados.0.smithi084.stdout:2592: oid 19 version 36250 is already newer than 36249 2024-03-30T12:31:29.398 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 36250 (ObjNum 794 snap 266 seq_num 794) dirty exists 2024-03-30T12:31:29.398 INFO:tasks.rados.rados.0.smithi084.stdout:2592: left oid 19 (ObjNum 794 snap 266 seq_num 794) 2024-03-30T12:31:29.405 INFO:tasks.rados.rados.0.smithi084.stdout:2593: finishing write tid 1 to smithi08477944-43 2024-03-30T12:31:29.405 INFO:tasks.rados.rados.0.smithi084.stdout:2593: finishing write tid 2 to smithi08477944-43 2024-03-30T12:31:29.406 INFO:tasks.rados.rados.0.smithi084.stdout:2593: finishing write tid 3 to smithi08477944-43 2024-03-30T12:31:29.412 INFO:tasks.rados.rados.0.smithi084.stdout:2593: finishing write tid 4 to smithi08477944-43 2024-03-30T12:31:29.416 INFO:tasks.rados.rados.0.smithi084.stdout:2593: finishing write tid 5 to smithi08477944-43 2024-03-30T12:31:29.416 INFO:tasks.rados.rados.0.smithi084.stdout:2593: oid 43 updating version 0 to 36254 2024-03-30T12:31:29.416 INFO:tasks.rados.rados.0.smithi084.stdout:2593: oid 43 updating version 36254 to 36255 2024-03-30T12:31:29.416 INFO:tasks.rados.rados.0.smithi084.stdout:2593: oid 43 version 36255 is already newer than 36252 2024-03-30T12:31:29.416 INFO:tasks.rados.rados.0.smithi084.stdout:2593: oid 43 version 36255 is already newer than 36253 2024-03-30T12:31:29.416 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 36255 (ObjNum 795 snap 266 seq_num 795) dirty exists 2024-03-30T12:31:29.416 INFO:tasks.rados.rados.0.smithi084.stdout:2593: left oid 43 (ObjNum 795 snap 266 seq_num 795) 2024-03-30T12:31:29.620 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:29.325+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:29.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:29.318+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:29.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:29.318+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:29.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:29.322+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:29.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:29.332+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 148=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:29.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:29.318+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:29.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:29.318+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:29.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:29.318+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:29.697 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:31:29] "GET /metrics HTTP/1.1" 200 36330 "" "Prometheus/2.43.0" 2024-03-30T12:31:29.698 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:29.324+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:29.698 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:29.326+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:29.698 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:29.320+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:29.698 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:29.320+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:29.698 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:29.321+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:29.698 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:29.321+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:29.699 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:29.321+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:29.699 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:29.321+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:29.994 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:29.994 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:29.994 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:29.994 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:29.994 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:29.994 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 146=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:29.994 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:29.994 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:29.995 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:29 smithi162 ceph-mon[83709]: pgmap v587: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 643 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.7 MiB/s wr, 28 op/s 2024-03-30T12:31:29.995 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:29.995 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:29 smithi162 ceph-mon[83709]: osdmap e601: 8 total, 8 up, 8 in 2024-03-30T12:31:29.995 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:29.995 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:29.995 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:29.995 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:30.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:30.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:30.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:30.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:30.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:30.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 146=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:30.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:30.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:30.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[91810]: pgmap v587: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 643 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.7 MiB/s wr, 28 op/s 2024-03-30T12:31:30.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:30.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[91810]: osdmap e601: 8 total, 8 up, 8 in 2024-03-30T12:31:30.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:30.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:30.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:30.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:30.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 146=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[89279]: pgmap v587: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 643 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.7 MiB/s wr, 28 op/s 2024-03-30T12:31:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[89279]: osdmap e601: 8 total, 8 up, 8 in 2024-03-30T12:31:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:30.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:30.289 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:30 smithi162 systemd[1]: Stopping Ceph prometheus.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:31:30.313 INFO:tasks.rados.rados.0.smithi084.stdout:2588: done (5 left) 2024-03-30T12:31:30.313 INFO:tasks.rados.rados.0.smithi084.stdout:2589: done (4 left) 2024-03-30T12:31:30.313 INFO:tasks.rados.rados.0.smithi084.stdout:2591: done (3 left) 2024-03-30T12:31:30.314 INFO:tasks.rados.rados.0.smithi084.stdout:2592: done (2 left) 2024-03-30T12:31:30.314 INFO:tasks.rados.rados.0.smithi084.stdout:2593: done (1 left) 2024-03-30T12:31:30.314 INFO:tasks.rados.rados.0.smithi084.stdout:2594: done (0 left) 2024-03-30T12:31:30.314 INFO:tasks.rados.rados.0.smithi084.stdout:2595: rmattr oid 44 current snap is 267 2024-03-30T12:31:30.314 INFO:tasks.rados.rados.0.smithi084.stdout:2595: done (0 left) 2024-03-30T12:31:30.314 INFO:tasks.rados.rados.0.smithi084.stdout:2596: rmattr oid 50 current snap is 267 2024-03-30T12:31:30.314 INFO:tasks.rados.rados.0.smithi084.stdout:2596: done (0 left) 2024-03-30T12:31:30.314 INFO:tasks.rados.rados.0.smithi084.stdout:2597: read oid 45 snap -1 2024-03-30T12:31:30.314 INFO:tasks.rados.rados.0.smithi084.stdout:2597: expect (ObjNum 664 snap 232 seq_num 664) 2024-03-30T12:31:30.314 INFO:tasks.rados.rados.0.smithi084.stdout:2598: rmattr oid 23 current snap is 267 2024-03-30T12:31:30.314 INFO:tasks.rados.rados.0.smithi084.stdout:2598: done (1 left) 2024-03-30T12:31:30.314 INFO:tasks.rados.rados.0.smithi084.stdout:2599: snap_create 2024-03-30T12:31:30.318 INFO:tasks.rados.rados.0.smithi084.stdout:2597: expect (ObjNum 664 snap 232 seq_num 664) 2024-03-30T12:31:30.544 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:30.318+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:30.545 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:30.318+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:30.545 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:30.325+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:30.545 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:30.325+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:30.699 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:30.321+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:30.699 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:30.321+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:30.700 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:30.320+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:30.700 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:30.320+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:30.700 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:30.320+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:30.700 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:30.320+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:30.700 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:30.320+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:30.804 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:30.805 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:30.805 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:30.805 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:30.805 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:30.805 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:30.805 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:30.805 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:30.805 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 148=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:30.805 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:31:30.805 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:30.805 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:30.805 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-mon[83709]: osdmap e602: 8 total, 8 up, 8 in 2024-03-30T12:31:30.806 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:30.806 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:30.806 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:31:30.553Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-03-30T12:31:30.806 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:31:30.554Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-03-30T12:31:30.806 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:31:30.554Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-03-30T12:31:30.806 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:31:30.554Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-03-30T12:31:30.806 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:31:30.554Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-03-30T12:31:30.806 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:31:30.554Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-03-30T12:31:30.806 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:31:30.554Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-03-30T12:31:30.806 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:31:30.554Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-03-30T12:31:30.806 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:31:30.554Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-03-30T12:31:30.807 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:31:30.554Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-03-30T12:31:30.807 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:31:30.554Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-03-30T12:31:30.807 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[74550]: ts=2024-03-30T12:31:30.554Z caller=main.go:1147 level=info msg="See you next time!" 2024-03-30T12:31:30.807 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:30 smithi162 podman[116097]: 2024-03-30 12:31:30.564323214 +0000 UTC m=+0.122094387 container died bd7d323e4b47f5b925fd0b03e0e115caf2c83241ec4d8f8755e483ac59be31a4 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:31:31.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:31.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:31.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:31.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:31.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:31.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:31.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:31.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:31.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 148=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:31.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:31:31.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:31.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:31.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[91810]: osdmap e602: 8 total, 8 up, 8 in 2024-03-30T12:31:31.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:31.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:31.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:31.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:31.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:31.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:31.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:31.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:31.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:31.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:31.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 148=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:31.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:31:31.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:31.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:31.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[89279]: osdmap e602: 8 total, 8 up, 8 in 2024-03-30T12:31:31.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:31.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:31.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:31.034+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:31.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:31.034+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:31.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:31.034+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:31.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:31.034+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 148=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:31.120 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:30 smithi162 podman[116097]: 2024-03-30 12:31:30.912095637 +0000 UTC m=+0.469866818 container cleanup bd7d323e4b47f5b925fd0b03e0e115caf2c83241ec4d8f8755e483ac59be31a4 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:31:31.120 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:30 smithi162 bash[116097]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a 2024-03-30T12:31:31.312 INFO:tasks.rados.rados.0.smithi084.stdout:2597: done (1 left) 2024-03-30T12:31:31.312 INFO:tasks.rados.rados.0.smithi084.stdout:2599: done (0 left) 2024-03-30T12:31:31.312 INFO:tasks.rados.rados.0.smithi084.stdout:2600: snap_remove snap 256 2024-03-30T12:31:31.527 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:31.320+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:31.527 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:31.320+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:31.527 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:31.320+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:31.527 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:31.320+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:31.528 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:31.320+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:31.528 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:31 smithi162 podman[116111]: 2024-03-30 12:31:31.213437434 +0000 UTC m=+0.651949500 container remove bd7d323e4b47f5b925fd0b03e0e115caf2c83241ec4d8f8755e483ac59be31a4 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:31:31.528 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:31 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@prometheus.a.service: Deactivated successfully. 2024-03-30T12:31:31.528 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:31 smithi162 systemd[1]: Stopped Ceph prometheus.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:31:31.528 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:31 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@prometheus.a.service: Consumed 2.663s CPU time. 2024-03-30T12:31:31.704 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:31.534+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:31.704 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:31.536+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:31.705 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:31.319+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:31.705 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:31.319+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:31.705 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:31.319+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:31.705 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:31.319+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:31.705 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:31.319+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:31.705 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:31.319+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:31.779 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:31.535+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:31.779 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:31 smithi162 systemd[1]: Starting Ceph prometheus.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:31:31.779 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:31.535+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:31.780 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:31.536+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 148=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:31.780 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:31.780 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:31.780 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:31.780 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:31.780 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:31.780 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:31.780 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-mon[83709]: pgmap v590: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 645 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 5.8 MiB/s rd, 4.5 MiB/s wr, 27 op/s 2024-03-30T12:31:31.780 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:31.780 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 148=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:31.780 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:31.780 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-mon[83709]: osdmap e603: 8 total, 8 up, 8 in 2024-03-30T12:31:31.780 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:31.781 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:31.781 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:32.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:32.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:32.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:32.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:32.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:32.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:32.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[91810]: pgmap v590: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 645 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 5.8 MiB/s rd, 4.5 MiB/s wr, 27 op/s 2024-03-30T12:31:32.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:32.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 148=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:32.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:32.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[91810]: osdmap e603: 8 total, 8 up, 8 in 2024-03-30T12:31:32.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:32.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:32.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:32.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:32.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:32.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:32.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:32.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:32.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:32.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[89279]: pgmap v590: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 645 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 5.8 MiB/s rd, 4.5 MiB/s wr, 27 op/s 2024-03-30T12:31:32.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:32.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 148=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:32.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:32.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[89279]: osdmap e603: 8 total, 8 up, 8 in 2024-03-30T12:31:32.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:32.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:32.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:32.030 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:31 smithi162 podman[116242]: 2024-03-30 12:31:31.692509637 +0000 UTC m=+0.018914463 image pull a07b618ecd1dce142bce4c52f0e80982eaf1f14265a2415c2d35978ccaa0a464 quay.io/prometheus/prometheus:v2.43.0 2024-03-30T12:31:32.031 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:31 smithi162 podman[116242]: 2024-03-30 12:31:31.822939369 +0000 UTC m=+0.149344182 container create bdbe25c7dd8b5ba6c7b2884e6a0527af953d7804ade51022f419c5da503e4773 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:31:32.031 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 podman[116242]: 2024-03-30 12:31:32.008689102 +0000 UTC m=+0.335093915 container init bdbe25c7dd8b5ba6c7b2884e6a0527af953d7804ade51022f419c5da503e4773 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:31:32.031 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 podman[116242]: 2024-03-30 12:31:32.011154054 +0000 UTC m=+0.337558868 container start bdbe25c7dd8b5ba6c7b2884e6a0527af953d7804ade51022f419c5da503e4773 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:31:32.031 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:31:32.034Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-03-30T12:31:32.031 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:31:32.034Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-03-30T12:31:32.031 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:31:32.034Z caller=main.go:570 level=info host_details="(Linux 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 x86_64 smithi162 (none))" 2024-03-30T12:31:32.031 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:31:32.035Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-03-30T12:31:32.031 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:31:32.035Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-03-30T12:31:32.031 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:31:32.036Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-03-30T12:31:32.031 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:31:32.036Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-03-30T12:31:32.031 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:31:32.038Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-03-30T12:31:32.031 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:31:32.038Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-03-30T12:31:32.031 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:31:32.039Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-03-30T12:31:32.032 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:31:32.039Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.18µs 2024-03-30T12:31:32.032 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:31:32.039Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-03-30T12:31:32.318 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:31:32.041Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=4 2024-03-30T12:31:32.318 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:31:32.048Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=4 2024-03-30T12:31:32.319 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:31:32.050Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=4 2024-03-30T12:31:32.319 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:31:32.054Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=4 2024-03-30T12:31:32.319 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:31:32.055Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=4 maxSegment=4 2024-03-30T12:31:32.319 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:31:32.055Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=31.492µs wal_replay_duration=15.189222ms wbl_replay_duration=95ns total_replay_duration=15.269723ms 2024-03-30T12:31:32.319 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:31:32.057Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-03-30T12:31:32.319 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:31:32.057Z caller=main.go:1029 level=info msg="TSDB started" 2024-03-30T12:31:32.319 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:31:32.057Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-03-30T12:31:32.319 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:31:32.076Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=19.468408ms db_storage=790ns remote_storage=1.048µs web_handler=474ns query_engine=624ns scrape=582.3µs scrape_sd=81.383µs notify=11.606µs notify_sd=10.8µs rules=18.462756ms tracing=4.874µs 2024-03-30T12:31:32.319 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:31:32.076Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-03-30T12:31:32.319 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:31:32.076Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-03-30T12:31:32.319 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 bash[116242]: bdbe25c7dd8b5ba6c7b2884e6a0527af953d7804ade51022f419c5da503e4773 2024-03-30T12:31:32.319 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:31:32 smithi162 systemd[1]: Started Ceph prometheus.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:31:32.320 INFO:tasks.rados.rados.0.smithi084.stdout:2600: done (0 left) 2024-03-30T12:31:32.320 INFO:tasks.rados.rados.0.smithi084.stdout:2601: read oid 1 snap -1 2024-03-30T12:31:32.321 INFO:tasks.rados.rados.0.smithi084.stdout:2601: expect (ObjNum 664 snap 232 seq_num 664) 2024-03-30T12:31:32.321 INFO:tasks.rados.rados.0.smithi084.stdout:2602: copy_from oid 12 from oid 10 current snap is 268 2024-03-30T12:31:32.321 INFO:tasks.rados.rados.0.smithi084.stdout:2603: read oid 45 snap -1 2024-03-30T12:31:32.321 INFO:tasks.rados.rados.0.smithi084.stdout:2603: expect (ObjNum 664 snap 232 seq_num 664) 2024-03-30T12:31:32.321 INFO:tasks.rados.rados.0.smithi084.stdout:2604: copy_from oid 28 from oid 16 current snap is 268 2024-03-30T12:31:32.321 INFO:tasks.rados.rados.0.smithi084.stdout:2605: read oid 2 snap 264 2024-03-30T12:31:32.321 INFO:tasks.rados.rados.0.smithi084.stdout:2605: expect (ObjNum 753 snap 253 seq_num 753) 2024-03-30T12:31:32.321 INFO:tasks.rados.rados.0.smithi084.stdout:2606: snap_create 2024-03-30T12:31:32.330 INFO:tasks.rados.rados.0.smithi084.stdout:2605: expect (ObjNum 753 snap 253 seq_num 753) 2024-03-30T12:31:32.355 INFO:tasks.rados.rados.0.smithi084.stdout:2603: expect (ObjNum 664 snap 232 seq_num 664) 2024-03-30T12:31:32.396 INFO:tasks.rados.rados.0.smithi084.stdout:2601: expect (ObjNum 664 snap 232 seq_num 664) 2024-03-30T12:31:32.435 INFO:tasks.rados.rados.0.smithi084.stdout:2602: finishing copy_from racing read to smithi08477944-12 2024-03-30T12:31:32.435 INFO:tasks.rados.rados.0.smithi084.stdout:2604: finishing copy_from racing read to smithi08477944-28 2024-03-30T12:31:32.435 INFO:tasks.rados.rados.0.smithi084.stdout:2604: finishing copy_from to smithi08477944-28 2024-03-30T12:31:32.435 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 23382 (ObjNum 743 snap 248 seq_num 743) dirty exists 2024-03-30T12:31:32.436 INFO:tasks.rados.rados.0.smithi084.stdout:2602: finishing copy_from to smithi08477944-12 2024-03-30T12:31:32.436 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 27203 (ObjNum 757 snap 253 seq_num 757) dirty exists 2024-03-30T12:31:32.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:32.334+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:32.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:32.325+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:32.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:32.325+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:32.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:32.327+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:32.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:32.327+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:32.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:32.330+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:32.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:32.330+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:32.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:32.332+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 148=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:32.705 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:32.335+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:32.705 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:32.335+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:32.706 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1[101951]: 2024-03-30T12:31:32.340+0000 7f4964649700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 13f after trimming was started 2024-03-30T12:31:32.706 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:32.325+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:32.706 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:32.325+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:32.706 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:32.325+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:32.706 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:32.326+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:32.706 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:32.326+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:33.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:33.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:33.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:33.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:33.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:33.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:33.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:33.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:33.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 148=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:33.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:33.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:33.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:33.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:31:33.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[89279]: osdmap e604: 8 total, 8 up, 8 in 2024-03-30T12:31:33.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:33.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:33.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:33.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:33.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:33.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:33.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:33.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:33.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:33.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:33.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:33.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:33.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 148=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:33.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:33.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:33.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:33.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:31:33.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[91810]: osdmap e604: 8 total, 8 up, 8 in 2024-03-30T12:31:33.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:33.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:33.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:33.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:33.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:33.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:33.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:33.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:33.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:33.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:33.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:33.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:33.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 148=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:33.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:33.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:33.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:33.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:31:33.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-mon[83709]: osdmap e604: 8 total, 8 up, 8 in 2024-03-30T12:31:33.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:33.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:33.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:33.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:33.320 INFO:tasks.rados.rados.0.smithi084.stdout:2601: done (5 left) 2024-03-30T12:31:33.320 INFO:tasks.rados.rados.0.smithi084.stdout:2602: done (4 left) 2024-03-30T12:31:33.320 INFO:tasks.rados.rados.0.smithi084.stdout:2603: done (3 left) 2024-03-30T12:31:33.320 INFO:tasks.rados.rados.0.smithi084.stdout:2604: done (2 left) 2024-03-30T12:31:33.320 INFO:tasks.rados.rados.0.smithi084.stdout:2605: done (1 left) 2024-03-30T12:31:33.320 INFO:tasks.rados.rados.0.smithi084.stdout:2606: done (0 left) 2024-03-30T12:31:33.320 INFO:tasks.rados.rados.0.smithi084.stdout:2607: setattr oid 18 current snap is 269 2024-03-30T12:31:33.322 INFO:tasks.rados.rados.0.smithi084.stdout:2608: copy_from oid 28 from oid 41 current snap is 269 2024-03-30T12:31:33.322 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 269 2024-03-30T12:31:33.322 INFO:tasks.rados.rados.0.smithi084.stdout:2609: seq_num 796 ranges {1499136=540672,2039808=704512,2744320=98304} 2024-03-30T12:31:33.333 INFO:tasks.rados.rados.0.smithi084.stdout:2609: writing smithi08477944-3 from 1499136 to 2039808 tid 1 2024-03-30T12:31:33.338 INFO:tasks.rados.rados.0.smithi084.stdout:2609: writing smithi08477944-3 from 2039808 to 2744320 tid 2 2024-03-30T12:31:33.339 INFO:tasks.rados.rados.0.smithi084.stdout:2609: writing smithi08477944-3 from 2744320 to 2842624 tid 3 2024-03-30T12:31:33.339 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 269 2024-03-30T12:31:33.339 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 23383 (ObjNum 733 snap 244 seq_num 733) dirty exists 2024-03-30T12:31:33.342 INFO:tasks.rados.rados.0.smithi084.stdout:2610: seq_num 797 ranges {3383296=557056,3940352=589824,4530176=212992} 2024-03-30T12:31:33.364 INFO:tasks.rados.rados.0.smithi084.stdout:2610: writing smithi08477944-5 from 3383296 to 3940352 tid 1 2024-03-30T12:31:33.367 INFO:tasks.rados.rados.0.smithi084.stdout:2610: writing smithi08477944-5 from 3940352 to 4530176 tid 2 2024-03-30T12:31:33.368 INFO:tasks.rados.rados.0.smithi084.stdout:2610: writing smithi08477944-5 from 4530176 to 4743168 tid 3 2024-03-30T12:31:33.368 INFO:tasks.rados.rados.0.smithi084.stdout:2607: done (3 left) 2024-03-30T12:31:33.368 INFO:tasks.rados.rados.0.smithi084.stdout:2611: snap_remove snap 266 2024-03-30T12:31:33.469 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-03-30T12:31:33.619 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:33.336+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:33.619 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:33.336+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:33.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:33.324+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:33.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:33.324+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:33.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:33.325+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:33.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:33.335+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:33.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:33.336+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 148=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:33.712 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:33.347+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:33.712 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:33.347+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:33.712 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:33.325+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:33.712 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:33.325+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:33.712 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:33.326+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:33.712 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:33.326+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:33.713 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:33.328+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:33.713 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:33.328+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:33.786 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T12:31:33.787 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (10m) 14s ago 11m 25.0M - 0.25.0 c8568f914cd2 6765ce007f39 2024-03-30T12:31:33.787 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi162 *:3000 running (11m) 13s ago 11m 91.8M - 9.4.7 954c08fa6188 ff2ec7518619 2024-03-30T12:31:33.787 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (58s) 14s ago 12m 13.8M - 19.0.0-1864-g5dc2ea30 548196a1a838 74abe81e0b10 2024-03-30T12:31:33.787 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi162 running (35s) 13s ago 12m 14.9M - 19.0.0-1864-g5dc2ea30 548196a1a838 38620aa52c54 2024-03-30T12:31:33.787 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi162 *:8443,9283,8765 running (7m) 13s ago 16m 452M - 19.0.0-1864-g5dc2ea30 548196a1a838 eec968f3fcc6 2024-03-30T12:31:33.787 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (7m) 14s ago 17m 518M - 19.0.0-1864-g5dc2ea30 548196a1a838 9a2aba19dffc 2024-03-30T12:31:33.787 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (6m) 14s ago 17m 69.0M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 a0811f2ae47d 2024-03-30T12:31:33.787 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi162 running (6m) 13s ago 16m 56.3M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 149ae6649e0c 2024-03-30T12:31:33.787 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (6m) 14s ago 16m 58.3M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 f79eca93cddd 2024-03-30T12:31:33.787 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (22s) 14s ago 11m 8002k - 1.5.0 0da6a335fe13 c19e5ff6fa83 2024-03-30T12:31:33.787 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi162 *:9100 running (17s) 13s ago 11m 3283k - 1.5.0 0da6a335fe13 fcd914fcfd78 2024-03-30T12:31:33.787 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (5m) 14s ago 15m 289M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 c91eea4f8484 2024-03-30T12:31:33.787 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (4m) 14s ago 15m 306M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 7518832f6b4a 2024-03-30T12:31:33.788 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (4m) 14s ago 14m 204M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 647dd862762d 2024-03-30T12:31:33.788 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (3m) 14s ago 14m 207M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 c088a701b71b 2024-03-30T12:31:33.788 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi162 running (3m) 13s ago 14m 293M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 4197b37d2bb8 2024-03-30T12:31:33.788 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi162 running (2m) 13s ago 13m 345M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 cd8795ac188a 2024-03-30T12:31:33.788 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi162 running (119s) 13s ago 13m 263M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 40ed6df81194 2024-03-30T12:31:33.788 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi162 running (84s) 13s ago 12m 217M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 b83812c70d9a 2024-03-30T12:31:33.788 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi162 *:9095 starting - - - - 2024-03-30T12:31:33.973 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:33.649+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:33.973 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:33.973 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:33.973 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:33.973 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:33.973 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:33.974 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 148=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:33.974 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:33.974 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:33.974 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:33.974 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:33 smithi162 ceph-mon[83709]: pgmap v593: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 648 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 565 KiB/s rd, 1.2 MiB/s wr, 15 op/s 2024-03-30T12:31:33.974 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:33.974 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:33.974 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:33 smithi162 ceph-mon[83709]: osdmap e605: 8 total, 8 up, 8 in 2024-03-30T12:31:33.974 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:33.974 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:34.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:34.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:34.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:34.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:34.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:34.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 148=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:34.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:34.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:34.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:34.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[91810]: pgmap v593: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 648 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 565 KiB/s rd, 1.2 MiB/s wr, 15 op/s 2024-03-30T12:31:34.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:34.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:34.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[91810]: osdmap e605: 8 total, 8 up, 8 in 2024-03-30T12:31:34.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:34.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:34.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:34.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:34.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:34.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:34.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:34.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 148=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:34.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:34.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:34.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:34.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[89279]: pgmap v593: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 648 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 565 KiB/s rd, 1.2 MiB/s wr, 15 op/s 2024-03-30T12:31:34.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:34.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:34.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[89279]: osdmap e605: 8 total, 8 up, 8 in 2024-03-30T12:31:34.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 144=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:34.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:34.177 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-30T12:31:34.177 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-03-30T12:31:34.177 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 3 2024-03-30T12:31:34.177 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:31:34.177 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-03-30T12:31:34.177 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 2 2024-03-30T12:31:34.177 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:31:34.177 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-03-30T12:31:34.177 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 8 2024-03-30T12:31:34.177 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:31:34.177 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-03-30T12:31:34.177 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 2 2024-03-30T12:31:34.178 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:31:34.178 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-03-30T12:31:34.178 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 15 2024-03-30T12:31:34.178 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-30T12:31:34.178 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-30T12:31:34.319 INFO:tasks.rados.rados.0.smithi084.stdout:2611: done (3 left) 2024-03-30T12:31:34.319 INFO:tasks.rados.rados.0.smithi084.stdout:2612: rollback oid 49 current snap is 269 2024-03-30T12:31:34.319 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 49 to 257 2024-03-30T12:31:34.319 INFO:tasks.rados.rados.0.smithi084.stdout:2608: finishing copy_from racing read to smithi08477944-28 2024-03-30T12:31:34.319 INFO:tasks.rados.rados.0.smithi084.stdout:2608: finishing copy_from to smithi08477944-28 2024-03-30T12:31:34.320 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 986 (ObjNum 688 snap 241 seq_num 688) dirty exists 2024-03-30T12:31:34.320 INFO:tasks.rados.rados.0.smithi084.stdout:2609: finishing write tid 1 to smithi08477944-3 2024-03-30T12:31:34.320 INFO:tasks.rados.rados.0.smithi084.stdout:2609: finishing write tid 2 to smithi08477944-3 2024-03-30T12:31:34.320 INFO:tasks.rados.rados.0.smithi084.stdout:2609: finishing write tid 3 to smithi08477944-3 2024-03-30T12:31:34.320 INFO:tasks.rados.rados.0.smithi084.stdout:2609: finishing write tid 4 to smithi08477944-3 2024-03-30T12:31:34.320 INFO:tasks.rados.rados.0.smithi084.stdout:2609: finishing write tid 5 to smithi08477944-3 2024-03-30T12:31:34.320 INFO:tasks.rados.rados.0.smithi084.stdout:2609: oid 3 updating version 0 to 27240 2024-03-30T12:31:34.320 INFO:tasks.rados.rados.0.smithi084.stdout:2609: oid 3 version 27240 is already newer than 27239 2024-03-30T12:31:34.320 INFO:tasks.rados.rados.0.smithi084.stdout:2609: oid 3 version 27240 is already newer than 27238 2024-03-30T12:31:34.320 INFO:tasks.rados.rados.0.smithi084.stdout:2609: oid 3 updating version 27240 to 27241 2024-03-30T12:31:34.320 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 27241 (ObjNum 796 snap 269 seq_num 796) dirty exists 2024-03-30T12:31:34.320 INFO:tasks.rados.rados.0.smithi084.stdout:2609: left oid 3 (ObjNum 796 snap 269 seq_num 796) 2024-03-30T12:31:34.320 INFO:tasks.rados.rados.0.smithi084.stdout:2610: finishing write tid 1 to smithi08477944-5 2024-03-30T12:31:34.320 INFO:tasks.rados.rados.0.smithi084.stdout:2610: finishing write tid 2 to smithi08477944-5 2024-03-30T12:31:34.320 INFO:tasks.rados.rados.0.smithi084.stdout:2610: finishing write tid 3 to smithi08477944-5 2024-03-30T12:31:34.321 INFO:tasks.rados.rados.0.smithi084.stdout:2608: done (3 left) 2024-03-30T12:31:34.321 INFO:tasks.rados.rados.0.smithi084.stdout:2609: done (2 left) 2024-03-30T12:31:34.321 INFO:tasks.rados.rados.0.smithi084.stdout:2613: setattr oid 42 current snap is 269 2024-03-30T12:31:34.321 INFO:tasks.rados.rados.0.smithi084.stdout:2610: finishing write tid 4 to smithi08477944-5 2024-03-30T12:31:34.321 INFO:tasks.rados.rados.0.smithi084.stdout:2610: finishing write tid 5 to smithi08477944-5 2024-03-30T12:31:34.321 INFO:tasks.rados.rados.0.smithi084.stdout:2610: oid 5 updating version 0 to 17509 2024-03-30T12:31:34.321 INFO:tasks.rados.rados.0.smithi084.stdout:2610: oid 5 updating version 17509 to 17510 2024-03-30T12:31:34.321 INFO:tasks.rados.rados.0.smithi084.stdout:2610: oid 5 version 17510 is already newer than 17508 2024-03-30T12:31:34.321 INFO:tasks.rados.rados.0.smithi084.stdout:2610: oid 5 version 17510 is already newer than 17507 2024-03-30T12:31:34.321 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 17510 (ObjNum 797 snap 269 seq_num 797) dirty exists 2024-03-30T12:31:34.321 INFO:tasks.rados.rados.0.smithi084.stdout:2610: left oid 5 (ObjNum 797 snap 269 seq_num 797) 2024-03-30T12:31:34.322 INFO:tasks.rados.rados.0.smithi084.stdout:2610: done (2 left) 2024-03-30T12:31:34.322 INFO:tasks.rados.rados.0.smithi084.stdout:2614: copy_from oid 44 from oid 33 current snap is 269 2024-03-30T12:31:34.322 INFO:tasks.rados.rados.0.smithi084.stdout:2615: read oid 15 snap -1 2024-03-30T12:31:34.322 INFO:tasks.rados.rados.0.smithi084.stdout:2615: expect (ObjNum 788 snap 264 seq_num 788) 2024-03-30T12:31:34.323 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 269 2024-03-30T12:31:34.323 INFO:tasks.rados.rados.0.smithi084.stdout:2616: seq_num 798 ranges {3997696=573440,4571136=466944,5038080=335872} 2024-03-30T12:31:34.346 INFO:tasks.rados.rados.0.smithi084.stdout:2616: writing smithi08477944-13 from 3997696 to 4571136 tid 1 2024-03-30T12:31:34.348 INFO:tasks.rados.rados.0.smithi084.stdout:2616: writing smithi08477944-13 from 4571136 to 5038080 tid 2 2024-03-30T12:31:34.351 INFO:tasks.rados.rados.0.smithi084.stdout:2616: writing smithi08477944-13 from 5038080 to 5373952 tid 3 2024-03-30T12:31:34.351 INFO:tasks.rados.rados.0.smithi084.stdout:2617: rollback oid 18 current snap is 269 2024-03-30T12:31:34.351 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 18 to 264 2024-03-30T12:31:34.351 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 23411 (ObjNum 790 snap 265 seq_num 790) dirty exists 2024-03-30T12:31:34.351 INFO:tasks.rados.rados.0.smithi084.stdout:2612: finishing rollback tid 0 to smithi08477944-49 2024-03-30T12:31:34.351 INFO:tasks.rados.rados.0.smithi084.stdout:2612: finishing rollback tid 1 to smithi08477944-49 2024-03-30T12:31:34.351 INFO:tasks.rados.rados.0.smithi084.stdout:2612: finishing rollback tid 2 to smithi08477944-49 2024-03-30T12:31:34.351 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 17541 (ObjNum 717 snap 242 seq_num 717) dirty exists 2024-03-30T12:31:34.351 INFO:tasks.rados.rados.0.smithi084.stdout:2615: expect (ObjNum 788 snap 264 seq_num 788) 2024-03-30T12:31:34.385 INFO:tasks.rados.rados.0.smithi084.stdout:2614: finishing copy_from racing read to smithi08477944-44 2024-03-30T12:31:34.386 INFO:tasks.rados.rados.0.smithi084.stdout:2614: finishing copy_from to smithi08477944-44 2024-03-30T12:31:34.386 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 23406 (ObjNum 788 snap 264 seq_num 788) dirty exists 2024-03-30T12:31:34.386 INFO:tasks.rados.rados.0.smithi084.stdout:2617: finishing rollback tid 0 to smithi08477944-18 2024-03-30T12:31:34.386 INFO:tasks.rados.rados.0.smithi084.stdout:2617: finishing rollback tid 1 to smithi08477944-18 2024-03-30T12:31:34.386 INFO:tasks.rados.rados.0.smithi084.stdout:2617: finishing rollback tid 2 to smithi08477944-18 2024-03-30T12:31:34.386 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 23386 (ObjNum 733 snap 244 seq_num 733) dirty exists 2024-03-30T12:31:34.386 INFO:tasks.rados.rados.0.smithi084.stdout:2616: finishing write tid 1 to smithi08477944-13 2024-03-30T12:31:34.386 INFO:tasks.rados.rados.0.smithi084.stdout:2612: done (5 left) 2024-03-30T12:31:34.386 INFO:tasks.rados.rados.0.smithi084.stdout:2613: done (4 left) 2024-03-30T12:31:34.386 INFO:tasks.rados.rados.0.smithi084.stdout:2614: done (3 left) 2024-03-30T12:31:34.386 INFO:tasks.rados.rados.0.smithi084.stdout:2615: done (2 left) 2024-03-30T12:31:34.386 INFO:tasks.rados.rados.0.smithi084.stdout:2617: done (1 left) 2024-03-30T12:31:34.386 INFO:tasks.rados.rados.0.smithi084.stdout:2618: read oid 8 snap -1 2024-03-30T12:31:34.387 INFO:tasks.rados.rados.0.smithi084.stdout:2618: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:31:34.387 INFO:tasks.rados.rados.0.smithi084.stdout:2616: finishing write tid 2 to smithi08477944-13 2024-03-30T12:31:34.387 INFO:tasks.rados.rados.0.smithi084.stdout:2616: finishing write tid 3 to smithi08477944-13 2024-03-30T12:31:34.387 INFO:tasks.rados.rados.0.smithi084.stdout:2616: finishing write tid 4 to smithi08477944-13 2024-03-30T12:31:34.387 INFO:tasks.rados.rados.0.smithi084.stdout:2616: finishing write tid 5 to smithi08477944-13 2024-03-30T12:31:34.387 INFO:tasks.rados.rados.0.smithi084.stdout:2616: oid 13 updating version 0 to 17546 2024-03-30T12:31:34.387 INFO:tasks.rados.rados.0.smithi084.stdout:2616: oid 13 updating version 17546 to 17547 2024-03-30T12:31:34.387 INFO:tasks.rados.rados.0.smithi084.stdout:2616: oid 13 version 17547 is already newer than 17545 2024-03-30T12:31:34.387 INFO:tasks.rados.rados.0.smithi084.stdout:2616: oid 13 updating version 17547 to 17548 2024-03-30T12:31:34.387 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 17548 (ObjNum 798 snap 269 seq_num 798) dirty exists 2024-03-30T12:31:34.387 INFO:tasks.rados.rados.0.smithi084.stdout:2616: left oid 13 (ObjNum 798 snap 269 seq_num 798) 2024-03-30T12:31:34.387 INFO:tasks.rados.rados.0.smithi084.stdout:2619: read oid 42 snap -1 2024-03-30T12:31:34.387 INFO:tasks.rados.rados.0.smithi084.stdout:2619: expect (ObjNum 790 snap 265 seq_num 790) 2024-03-30T12:31:34.387 INFO:tasks.rados.rados.0.smithi084.stdout:2616: done (2 left) 2024-03-30T12:31:34.387 INFO:tasks.rados.rados.0.smithi084.stdout:2620: read oid 24 snap -1 2024-03-30T12:31:34.388 INFO:tasks.rados.rados.0.smithi084.stdout:2620: expect (ObjNum 784 snap 262 seq_num 784) 2024-03-30T12:31:34.388 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 269 2024-03-30T12:31:34.388 INFO:tasks.rados.rados.0.smithi084.stdout:2621: seq_num 799 ranges {3260416=589824,3850240=802816} 2024-03-30T12:31:34.406 INFO:tasks.rados.rados.0.smithi084.stdout:2621: writing smithi08477944-16 from 3260416 to 3850240 tid 1 2024-03-30T12:31:34.410 INFO:tasks.rados.rados.0.smithi084.stdout:2621: writing smithi08477944-16 from 3850240 to 4653056 tid 2 2024-03-30T12:31:34.410 INFO:tasks.rados.rados.0.smithi084.stdout:2622: rollback oid 13 current snap is 269 2024-03-30T12:31:34.411 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 13 to 262 2024-03-30T12:31:34.411 INFO:tasks.rados.rados.0.smithi084.stdout:2618: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:31:34.412 INFO:tasks.rados.rados.0.smithi084.stdout:2620: expect (ObjNum 784 snap 262 seq_num 784) 2024-03-30T12:31:34.442 INFO:tasks.rados.rados.0.smithi084.stdout:2619: expect (ObjNum 790 snap 265 seq_num 790) 2024-03-30T12:31:34.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:34.329+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:34.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:34.335+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:34.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:34.325+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:34.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:34.325+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:34.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:34.325+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:34.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:34.325+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:34.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:34.325+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:34.516 INFO:tasks.rados.rados.0.smithi084.stdout:2621: finishing write tid 1 to smithi08477944-16 2024-03-30T12:31:34.517 INFO:tasks.rados.rados.0.smithi084.stdout:2621: finishing write tid 2 to smithi08477944-16 2024-03-30T12:31:34.517 INFO:tasks.rados.rados.0.smithi084.stdout:2621: finishing write tid 3 to smithi08477944-16 2024-03-30T12:31:34.517 INFO:tasks.rados.rados.0.smithi084.stdout:2621: finishing write tid 4 to smithi08477944-16 2024-03-30T12:31:34.517 INFO:tasks.rados.rados.0.smithi084.stdout:2621: oid 16 updating version 0 to 23389 2024-03-30T12:31:34.517 INFO:tasks.rados.rados.0.smithi084.stdout:2621: oid 16 version 23389 is already newer than 23388 2024-03-30T12:31:34.517 INFO:tasks.rados.rados.0.smithi084.stdout:2621: oid 16 version 23389 is already newer than 23387 2024-03-30T12:31:34.517 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 23389 (ObjNum 799 snap 269 seq_num 799) dirty exists 2024-03-30T12:31:34.517 INFO:tasks.rados.rados.0.smithi084.stdout:2621: left oid 16 (ObjNum 799 snap 269 seq_num 799) 2024-03-30T12:31:34.517 INFO:tasks.rados.rados.0.smithi084.stdout:2622: finishing rollback tid 0 to smithi08477944-13 2024-03-30T12:31:34.517 INFO:tasks.rados.rados.0.smithi084.stdout:2622: finishing rollback tid 1 to smithi08477944-13 2024-03-30T12:31:34.517 INFO:tasks.rados.rados.0.smithi084.stdout:2622: finishing rollback tid 2 to smithi08477944-13 2024-03-30T12:31:34.517 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 17551 (ObjNum 779 snap 260 seq_num 779) dirty exists 2024-03-30T12:31:34.517 INFO:tasks.rados.rados.0.smithi084.stdout:2618: done (4 left) 2024-03-30T12:31:34.518 INFO:tasks.rados.rados.0.smithi084.stdout:2619: done (3 left) 2024-03-30T12:31:34.518 INFO:tasks.rados.rados.0.smithi084.stdout:2620: done (2 left) 2024-03-30T12:31:34.518 INFO:tasks.rados.rados.0.smithi084.stdout:2621: done (1 left) 2024-03-30T12:31:34.518 INFO:tasks.rados.rados.0.smithi084.stdout:2622: done (0 left) 2024-03-30T12:31:34.518 INFO:tasks.rados.rados.0.smithi084.stdout:2623: read oid 26 snap 264 2024-03-30T12:31:34.518 INFO:tasks.rados.rados.0.smithi084.stdout:2623: expect (ObjNum 770 snap 254 seq_num 770) 2024-03-30T12:31:34.518 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 269 2024-03-30T12:31:34.518 INFO:tasks.rados.rados.0.smithi084.stdout:2624: seq_num 800 ranges {10903552=606208,11509760=688128,12197888=114688} 2024-03-30T12:31:34.527 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:34.333+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:34.527 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:34.326+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:34.527 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:34.327+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:34.527 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:34.327+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:34.528 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:34.327+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:34.528 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:34.375+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:34.528 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:34.375+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:34.528 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:34.376+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:34.577 INFO:tasks.rados.rados.0.smithi084.stdout:2624: writing smithi08477944-22 from 10903552 to 11509760 tid 1 2024-03-30T12:31:34.581 INFO:tasks.rados.rados.0.smithi084.stdout:2624: writing smithi08477944-22 from 11509760 to 12197888 tid 2 2024-03-30T12:31:34.582 INFO:tasks.rados.rados.0.smithi084.stdout:2624: writing smithi08477944-22 from 12197888 to 12312576 tid 3 2024-03-30T12:31:34.582 INFO:tasks.rados.rados.0.smithi084.stdout:2625: delete oid 31 current snap is 269 2024-03-30T12:31:34.582 INFO:tasks.rados.rados.0.smithi084.stdout:2623: expect (ObjNum 770 snap 254 seq_num 770) 2024-03-30T12:31:34.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:34.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:34.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:34.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:34.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:34.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 148=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:34.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:34.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:34.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:34 smithi162 ceph-mon[83709]: from='client.44375 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:31:34.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:34.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:34 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/1182539216' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:34.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:34 smithi162 ceph-mon[83709]: osdmap e606: 8 total, 8 up, 8 in 2024-03-30T12:31:34.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:34.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:34.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:34.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:35.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:35.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:35.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:35.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:35.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:35.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 148=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:35.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:35.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:35.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[91810]: from='client.44375 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:31:35.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:35.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/1182539216' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:35.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[91810]: osdmap e606: 8 total, 8 up, 8 in 2024-03-30T12:31:35.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:35.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:35.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:35.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:35.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:35.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:35.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:35.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:35.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:35.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 148=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:35.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:35.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:35.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[89279]: from='client.44375 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:31:35.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:35.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/1182539216' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:35.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[89279]: osdmap e606: 8 total, 8 up, 8 in 2024-03-30T12:31:35.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:35.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:35.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:35.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:35.071 INFO:tasks.rados.rados.0.smithi084.stdout:2624: finishing write tid 1 to smithi08477944-22 2024-03-30T12:31:35.072 INFO:tasks.rados.rados.0.smithi084.stdout:2624: finishing write tid 2 to smithi08477944-22 2024-03-30T12:31:35.072 INFO:tasks.rados.rados.0.smithi084.stdout:2624: finishing write tid 3 to smithi08477944-22 2024-03-30T12:31:35.072 INFO:tasks.rados.rados.0.smithi084.stdout:2624: finishing write tid 4 to smithi08477944-22 2024-03-30T12:31:35.072 INFO:tasks.rados.rados.0.smithi084.stdout:2624: finishing write tid 5 to smithi08477944-22 2024-03-30T12:31:35.072 INFO:tasks.rados.rados.0.smithi084.stdout:2624: oid 22 updating version 0 to 27244 2024-03-30T12:31:35.072 INFO:tasks.rados.rados.0.smithi084.stdout:2624: oid 22 updating version 27244 to 27245 2024-03-30T12:31:35.072 INFO:tasks.rados.rados.0.smithi084.stdout:2624: oid 22 updating version 27245 to 27246 2024-03-30T12:31:35.072 INFO:tasks.rados.rados.0.smithi084.stdout:2624: oid 22 version 27246 is already newer than 27243 2024-03-30T12:31:35.072 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 27246 (ObjNum 800 snap 269 seq_num 800) dirty exists 2024-03-30T12:31:35.072 INFO:tasks.rados.rados.0.smithi084.stdout:2624: left oid 22 (ObjNum 800 snap 269 seq_num 800) 2024-03-30T12:31:35.072 INFO:tasks.rados.rados.0.smithi084.stdout:2623: done (2 left) 2024-03-30T12:31:35.072 INFO:tasks.rados.rados.0.smithi084.stdout:2624: done (1 left) 2024-03-30T12:31:35.072 INFO:tasks.rados.rados.0.smithi084.stdout:2625: done (0 left) 2024-03-30T12:31:35.073 INFO:tasks.rados.rados.0.smithi084.stdout:2626: read oid 26 snap -1 2024-03-30T12:31:35.073 INFO:tasks.rados.rados.0.smithi084.stdout:2626: expect (ObjNum 770 snap 254 seq_num 770) 2024-03-30T12:31:35.073 INFO:tasks.rados.rados.0.smithi084.stdout:2627: copy_from oid 36 from oid 22 current snap is 269 2024-03-30T12:31:35.073 INFO:tasks.rados.rados.0.smithi084.stdout:2628: delete oid 17 current snap is 269 2024-03-30T12:31:35.074 INFO:tasks.rados.rados.0.smithi084.stdout:2628: done (2 left) 2024-03-30T12:31:35.074 INFO:tasks.rados.rados.0.smithi084.stdout:2629: read oid 16 snap 264 2024-03-30T12:31:35.074 INFO:tasks.rados.rados.0.smithi084.stdout:2629: expect (ObjNum 662 snap 232 seq_num 662) 2024-03-30T12:31:35.074 INFO:tasks.rados.rados.0.smithi084.stdout:2630: read oid 48 snap -1 2024-03-30T12:31:35.075 INFO:tasks.rados.rados.0.smithi084.stdout:2630: expect deleted 2024-03-30T12:31:35.075 INFO:tasks.rados.rados.0.smithi084.stdout:2631: setattr oid 28 current snap is 269 2024-03-30T12:31:35.076 INFO:tasks.rados.rados.0.smithi084.stdout:2630: done (4 left) 2024-03-30T12:31:35.076 INFO:tasks.rados.rados.0.smithi084.stdout:2632: delete oid 7 current snap is 269 2024-03-30T12:31:35.079 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 23383 (ObjNum 688 snap 241 seq_num 688) dirty exists 2024-03-30T12:31:35.079 INFO:tasks.rados.rados.0.smithi084.stdout:2631: done (4 left) 2024-03-30T12:31:35.079 INFO:tasks.rados.rados.0.smithi084.stdout:2632: done (3 left) 2024-03-30T12:31:35.079 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 269 2024-03-30T12:31:35.079 INFO:tasks.rados.rados.0.smithi084.stdout:2633: seq_num 804 ranges {12230656=671744,12902400=622592,13524992=180224} 2024-03-30T12:31:35.152 INFO:tasks.rados.rados.0.smithi084.stdout:2633: writing smithi08477944-43 from 12230656 to 12902400 tid 1 2024-03-30T12:31:35.156 INFO:tasks.rados.rados.0.smithi084.stdout:2633: writing smithi08477944-43 from 12902400 to 13524992 tid 2 2024-03-30T12:31:35.157 INFO:tasks.rados.rados.0.smithi084.stdout:2633: writing smithi08477944-43 from 13524992 to 13705216 tid 3 2024-03-30T12:31:35.157 INFO:tasks.rados.rados.0.smithi084.stdout:2634: delete oid 47 current snap is 269 2024-03-30T12:31:35.157 INFO:tasks.rados.rados.0.smithi084.stdout:2629: expect (ObjNum 662 snap 232 seq_num 662) 2024-03-30T12:31:35.304 INFO:tasks.rados.rados.0.smithi084.stdout:2626: expect (ObjNum 770 snap 254 seq_num 770) 2024-03-30T12:31:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:2627: finishing copy_from racing read to smithi08477944-36 2024-03-30T12:31:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:2627: finishing copy_from to smithi08477944-36 2024-03-30T12:31:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 27246 (ObjNum 800 snap 269 seq_num 800) dirty exists 2024-03-30T12:31:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:2633: finishing write tid 1 to smithi08477944-43 2024-03-30T12:31:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:2633: finishing write tid 2 to smithi08477944-43 2024-03-30T12:31:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:2626: done (4 left) 2024-03-30T12:31:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:2627: done (3 left) 2024-03-30T12:31:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:2629: done (2 left) 2024-03-30T12:31:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:2634: done (1 left) 2024-03-30T12:31:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:2635: rollback oid 27 current snap is 269 2024-03-30T12:31:35.796 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 27 to 264 2024-03-30T12:31:35.797 INFO:tasks.rados.rados.0.smithi084.stdout:2633: finishing write tid 3 to smithi08477944-43 2024-03-30T12:31:35.797 INFO:tasks.rados.rados.0.smithi084.stdout:2633: finishing write tid 4 to smithi08477944-43 2024-03-30T12:31:35.797 INFO:tasks.rados.rados.0.smithi084.stdout:2633: finishing write tid 5 to smithi08477944-43 2024-03-30T12:31:35.797 INFO:tasks.rados.rados.0.smithi084.stdout:2633: oid 43 updating version 0 to 36260 2024-03-30T12:31:35.797 INFO:tasks.rados.rados.0.smithi084.stdout:2633: oid 43 version 36260 is already newer than 36258 2024-03-30T12:31:35.797 INFO:tasks.rados.rados.0.smithi084.stdout:2633: oid 43 updating version 36260 to 36261 2024-03-30T12:31:35.797 INFO:tasks.rados.rados.0.smithi084.stdout:2633: oid 43 version 36261 is already newer than 36259 2024-03-30T12:31:35.797 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 36261 (ObjNum 804 snap 269 seq_num 804) dirty exists 2024-03-30T12:31:35.797 INFO:tasks.rados.rados.0.smithi084.stdout:2633: left oid 43 (ObjNum 804 snap 269 seq_num 804) 2024-03-30T12:31:35.797 INFO:tasks.rados.rados.0.smithi084.stdout:2633: done (1 left) 2024-03-30T12:31:35.797 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 269 2024-03-30T12:31:35.798 INFO:tasks.rados.rados.0.smithi084.stdout:2636: seq_num 806 ranges {0=704512,704512=442368,1146880=360448} 2024-03-30T12:31:35.798 INFO:tasks.rados.rados.0.smithi084.stdout:2636: writing smithi08477944-32 from 0 to 704512 tid 1 2024-03-30T12:31:35.801 INFO:tasks.rados.rados.0.smithi084.stdout:2636: writing smithi08477944-32 from 704512 to 1146880 tid 2 2024-03-30T12:31:35.804 INFO:tasks.rados.rados.0.smithi084.stdout:2636: writing smithi08477944-32 from 1146880 to 1507328 tid 3 2024-03-30T12:31:35.804 INFO:tasks.rados.rados.0.smithi084.stdout:2637: read oid 46 snap -1 2024-03-30T12:31:35.804 INFO:tasks.rados.rados.0.smithi084.stdout:2637: expect (ObjNum 775 snap 257 seq_num 775) 2024-03-30T12:31:35.804 INFO:tasks.rados.rados.0.smithi084.stdout:2638: snap_remove snap 265 2024-03-30T12:31:35.906 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:35 smithi162 ceph-mon[83709]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:31:35.906 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:35.907 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:35.907 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:35.907 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:35.907 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:35.907 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:35.907 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:35.907 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:35.907 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:35.907 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:35 smithi162 ceph-mon[83709]: pgmap v596: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 660 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 10 op/s 2024-03-30T12:31:36.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:35 smithi084 ceph-mon[91810]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:31:36.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:36.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:36.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:36.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:36.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:36.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:36.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:36.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:36.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:36.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:35 smithi084 ceph-mon[91810]: pgmap v596: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 660 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 10 op/s 2024-03-30T12:31:36.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:35 smithi084 ceph-mon[89279]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:31:36.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:36.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 147=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:36.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:36.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:36.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:36.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:36.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:36.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:36.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:36.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:35 smithi084 ceph-mon[89279]: pgmap v596: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 660 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 10 op/s 2024-03-30T12:31:36.724 INFO:tasks.rados.rados.0.smithi084.stdout:2638: done (3 left) 2024-03-30T12:31:36.725 INFO:tasks.rados.rados.0.smithi084.stdout:2639: read oid 22 snap -1 2024-03-30T12:31:36.725 INFO:tasks.rados.rados.0.smithi084.stdout:2639: expect (ObjNum 800 snap 269 seq_num 800) 2024-03-30T12:31:36.725 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 269 2024-03-30T12:31:36.725 INFO:tasks.rados.rados.0.smithi084.stdout:2636: finishing write tid 1 to smithi08477944-32 2024-03-30T12:31:36.725 INFO:tasks.rados.rados.0.smithi084.stdout:2640: seq_num 807 ranges {0=720896,720896=729088,1449984=73728} 2024-03-30T12:31:36.728 INFO:tasks.rados.rados.0.smithi084.stdout:2640: writing smithi08477944-35 from 0 to 720896 tid 1 2024-03-30T12:31:36.733 INFO:tasks.rados.rados.0.smithi084.stdout:2640: writing smithi08477944-35 from 720896 to 1449984 tid 2 2024-03-30T12:31:36.733 INFO:tasks.rados.rados.0.smithi084.stdout:2640: writing smithi08477944-35 from 1449984 to 1523712 tid 3 2024-03-30T12:31:36.734 INFO:tasks.rados.rados.0.smithi084.stdout:2641: snap_remove snap 257 2024-03-30T12:31:37.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:36.743+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:37.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:36.744+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:37.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:36.732+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:37.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:36.732+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:37.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:36.732+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:37.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:36.732+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:37.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:36.732+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:37.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:36.733+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:37.116 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:36.731+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:37.117 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:36.732+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:37.117 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:36.728+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:37.117 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:36.728+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:37.117 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:36.728+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:37.117 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:36.736+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:37.117 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:36.745+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:37.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:37.124+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:37.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:37 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:37.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:37 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:37.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:37 smithi162 ceph-mon[83709]: pgmap v597: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 677 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 13 MiB/s rd, 5.8 MiB/s wr, 21 op/s 2024-03-30T12:31:37.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:37.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:37.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:37.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:37 smithi162 ceph-mon[83709]: osdmap e607: 8 total, 8 up, 8 in 2024-03-30T12:31:37.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:37.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:37.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:37.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:37.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:37.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-mon[89279]: pgmap v597: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 677 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 13 MiB/s rd, 5.8 MiB/s wr, 21 op/s 2024-03-30T12:31:37.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:37.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:37.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:37.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-mon[89279]: osdmap e607: 8 total, 8 up, 8 in 2024-03-30T12:31:37.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:37.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:37.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:37.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:37.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:37.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-mon[91810]: pgmap v597: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 677 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 13 MiB/s rd, 5.8 MiB/s wr, 21 op/s 2024-03-30T12:31:37.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:37.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:37.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:37.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-mon[91810]: osdmap e607: 8 total, 8 up, 8 in 2024-03-30T12:31:37.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:37.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:37.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:37.723 INFO:tasks.rados.rados.0.smithi084.stdout:2641: done (5 left) 2024-03-30T12:31:37.724 INFO:tasks.rados.rados.0.smithi084.stdout:2642: read oid 12 snap -1 2024-03-30T12:31:37.724 INFO:tasks.rados.rados.0.smithi084.stdout:2642: expect (ObjNum 757 snap 253 seq_num 757) 2024-03-30T12:31:37.724 INFO:tasks.rados.rados.0.smithi084.stdout:2643: read oid 18 snap -1 2024-03-30T12:31:37.724 INFO:tasks.rados.rados.0.smithi084.stdout:2643: expect (ObjNum 733 snap 244 seq_num 733) 2024-03-30T12:31:37.724 INFO:tasks.rados.rados.0.smithi084.stdout:2644: delete oid 10 current snap is 269 2024-03-30T12:31:37.724 INFO:tasks.rados.rados.0.smithi084.stdout:2635: finishing rollback tid 0 to smithi08477944-27 2024-03-30T12:31:37.724 INFO:tasks.rados.rados.0.smithi084.stdout:2635: finishing rollback tid 1 to smithi08477944-27 2024-03-30T12:31:37.724 INFO:tasks.rados.rados.0.smithi084.stdout:2635: finishing rollback tid 2 to smithi08477944-27 2024-03-30T12:31:37.724 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 27206 (ObjNum 723 snap 242 seq_num 723) dirty exists 2024-03-30T12:31:37.724 INFO:tasks.rados.rados.0.smithi084.stdout:2636: finishing write tid 2 to smithi08477944-32 2024-03-30T12:31:37.724 INFO:tasks.rados.rados.0.smithi084.stdout:2636: finishing write tid 3 to smithi08477944-32 2024-03-30T12:31:37.724 INFO:tasks.rados.rados.0.smithi084.stdout:2636: finishing write tid 4 to smithi08477944-32 2024-03-30T12:31:37.724 INFO:tasks.rados.rados.0.smithi084.stdout:2636: finishing write tid 5 to smithi08477944-32 2024-03-30T12:31:37.725 INFO:tasks.rados.rados.0.smithi084.stdout:2636: oid 32 updating version 0 to 27248 2024-03-30T12:31:37.725 INFO:tasks.rados.rados.0.smithi084.stdout:2636: oid 32 updating version 27248 to 27250 2024-03-30T12:31:37.725 INFO:tasks.rados.rados.0.smithi084.stdout:2636: oid 32 version 27250 is already newer than 27249 2024-03-30T12:31:37.725 INFO:tasks.rados.rados.0.smithi084.stdout:2636: oid 32 version 27250 is already newer than 27247 2024-03-30T12:31:37.725 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 27250 (ObjNum 806 snap 269 seq_num 806) dirty exists 2024-03-30T12:31:37.725 INFO:tasks.rados.rados.0.smithi084.stdout:2636: left oid 32 (ObjNum 806 snap 269 seq_num 806) 2024-03-30T12:31:37.725 INFO:tasks.rados.rados.0.smithi084.stdout:2637: expect (ObjNum 775 snap 257 seq_num 775) 2024-03-30T12:31:37.754 INFO:tasks.rados.rados.0.smithi084.stdout:2640: finishing write tid 1 to smithi08477944-35 2024-03-30T12:31:37.754 INFO:tasks.rados.rados.0.smithi084.stdout:2640: finishing write tid 2 to smithi08477944-35 2024-03-30T12:31:37.754 INFO:tasks.rados.rados.0.smithi084.stdout:2640: finishing write tid 3 to smithi08477944-35 2024-03-30T12:31:37.754 INFO:tasks.rados.rados.0.smithi084.stdout:2640: finishing write tid 4 to smithi08477944-35 2024-03-30T12:31:37.755 INFO:tasks.rados.rados.0.smithi084.stdout:2640: finishing write tid 5 to smithi08477944-35 2024-03-30T12:31:37.755 INFO:tasks.rados.rados.0.smithi084.stdout:2640: oid 35 updating version 0 to 17498 2024-03-30T12:31:37.755 INFO:tasks.rados.rados.0.smithi084.stdout:2640: oid 35 version 17498 is already newer than 17497 2024-03-30T12:31:37.755 INFO:tasks.rados.rados.0.smithi084.stdout:2640: oid 35 version 17498 is already newer than 17496 2024-03-30T12:31:37.755 INFO:tasks.rados.rados.0.smithi084.stdout:2640: oid 35 updating version 17498 to 17499 2024-03-30T12:31:37.755 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 17499 (ObjNum 807 snap 269 seq_num 807) dirty exists 2024-03-30T12:31:37.755 INFO:tasks.rados.rados.0.smithi084.stdout:2640: left oid 35 (ObjNum 807 snap 269 seq_num 807) 2024-03-30T12:31:37.755 INFO:tasks.rados.rados.0.smithi084.stdout:2635: done (7 left) 2024-03-30T12:31:37.755 INFO:tasks.rados.rados.0.smithi084.stdout:2636: done (6 left) 2024-03-30T12:31:37.755 INFO:tasks.rados.rados.0.smithi084.stdout:2637: done (5 left) 2024-03-30T12:31:37.755 INFO:tasks.rados.rados.0.smithi084.stdout:2640: done (4 left) 2024-03-30T12:31:37.755 INFO:tasks.rados.rados.0.smithi084.stdout:2644: done (3 left) 2024-03-30T12:31:37.756 INFO:tasks.rados.rados.0.smithi084.stdout:2645: snap_create 2024-03-30T12:31:37.756 INFO:tasks.rados.rados.0.smithi084.stdout:2639: expect (ObjNum 800 snap 269 seq_num 800) 2024-03-30T12:31:37.973 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:37.741+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:37.974 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:37.730+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:37.974 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:37.730+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:37.974 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:37.730+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:37.974 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:37.730+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:37.975 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:37.735+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:37.975 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:37.735+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:37.975 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:37.736+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:38.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:37.739+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:38.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:37.739+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:38.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:37.730+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:38.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:37.730+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:38.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:37.730+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:38.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:37.730+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:38.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:37.730+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:38.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:38.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:38.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:38.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:38.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:38.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:38.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:38.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:38 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:38.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:38 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:38.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:38.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:38.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:38.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:38.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:38 smithi162 ceph-mon[83709]: osdmap e608: 8 total, 8 up, 8 in 2024-03-30T12:31:38.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:38.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:38.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:38.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:38.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:38.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:38.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:38.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:38.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:38.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:38.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:38.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:38.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:38.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:38.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:38.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:38.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[91810]: osdmap e608: 8 total, 8 up, 8 in 2024-03-30T12:31:38.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:38.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:38.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:38.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:38.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:38.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:38.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:38.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:38.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:38.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 147=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:38.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:38.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:38.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:38.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:38.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:38.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:38.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[89279]: osdmap e608: 8 total, 8 up, 8 in 2024-03-30T12:31:38.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:38.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:38.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:38.901 INFO:tasks.rados.rados.0.smithi084.stdout:2643: expect (ObjNum 733 snap 244 seq_num 733) 2024-03-30T12:31:39.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:38.730+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:39.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:38.730+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:39.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:38.730+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:39.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:38.730+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:39.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:38.731+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:39.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:38.731+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:39.028 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:38.731+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:39.029 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:38.731+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:39.029 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:38.732+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:39.029 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:38.731+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:39.029 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:38.732+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:39.081 INFO:tasks.rados.rados.0.smithi084.stdout:2642: expect (ObjNum 757 snap 253 seq_num 757) 2024-03-30T12:31:39.197 INFO:tasks.rados.rados.0.smithi084.stdout:2639: done (3 left) 2024-03-30T12:31:39.197 INFO:tasks.rados.rados.0.smithi084.stdout:2642: done (2 left) 2024-03-30T12:31:39.197 INFO:tasks.rados.rados.0.smithi084.stdout:2643: done (1 left) 2024-03-30T12:31:39.197 INFO:tasks.rados.rados.0.smithi084.stdout:2645: done (0 left) 2024-03-30T12:31:39.197 INFO:tasks.rados.rados.0.smithi084.stdout:2646: rollback oid 31 current snap is 270 2024-03-30T12:31:39.197 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 31 to 269 2024-03-30T12:31:39.197 INFO:tasks.rados.rados.0.smithi084.stdout:2647: read oid 45 snap -1 2024-03-30T12:31:39.198 INFO:tasks.rados.rados.0.smithi084.stdout:2647: expect (ObjNum 664 snap 232 seq_num 664) 2024-03-30T12:31:39.198 INFO:tasks.rados.rados.0.smithi084.stdout:2648: read oid 1 snap -1 2024-03-30T12:31:39.198 INFO:tasks.rados.rados.0.smithi084.stdout:2648: expect (ObjNum 664 snap 232 seq_num 664) 2024-03-30T12:31:39.198 INFO:tasks.rados.rados.0.smithi084.stdout:2649: snap_remove snap 268 2024-03-30T12:31:39.295 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:39.037+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:39.295 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:39.037+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:39.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:39.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:39.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:39.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:39.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:39.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:39.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-mon[89279]: pgmap v600: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 684 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 16 MiB/s rd, 6.6 MiB/s wr, 31 op/s 2024-03-30T12:31:39.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:39.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:39.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:39.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:39.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-mon[89279]: osdmap e609: 8 total, 8 up, 8 in 2024-03-30T12:31:39.297 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:39.297 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:39.297 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:39.297 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:39.298 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:39.298 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:39.298 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-mon[91810]: pgmap v600: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 684 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 16 MiB/s rd, 6.6 MiB/s wr, 31 op/s 2024-03-30T12:31:39.298 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:39.298 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:39.298 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:39.298 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:39.298 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-mon[91810]: osdmap e609: 8 total, 8 up, 8 in 2024-03-30T12:31:39.335 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:39.035+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:39.335 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:39.036+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:39.336 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:39.036+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:39.336 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:39.336 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:39.337 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:39.337 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:39.337 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:39.337 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:39.337 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:39 smithi162 ceph-mon[83709]: pgmap v600: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 684 MiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 16 MiB/s rd, 6.6 MiB/s wr, 31 op/s 2024-03-30T12:31:39.338 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:39.338 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:39.338 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:39.338 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:39.338 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:39 smithi162 ceph-mon[83709]: osdmap e609: 8 total, 8 up, 8 in 2024-03-30T12:31:39.725 INFO:tasks.rados.rados.0.smithi084.stdout:2649: done (3 left) 2024-03-30T12:31:39.725 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 270 2024-03-30T12:31:39.725 INFO:tasks.rados.rados.0.smithi084.stdout:2646: finishing rollback tid 1 to smithi08477944-31 2024-03-30T12:31:39.725 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 810 (ObjNum 145 snap 0 seq_num 1430145952) dirty dne 2024-03-30T12:31:39.725 INFO:tasks.rados.rados.0.smithi084.stdout:2650: seq_num 809 ranges {1204224=753664,1957888=499712,2457600=303104} 2024-03-30T12:31:39.726 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:31:39] "GET /metrics HTTP/1.1" 200 36327 "" "Prometheus/2.43.0" 2024-03-30T12:31:39.735 INFO:tasks.rados.rados.0.smithi084.stdout:2650: writing smithi08477944-15 from 1204224 to 1957888 tid 1 2024-03-30T12:31:39.738 INFO:tasks.rados.rados.0.smithi084.stdout:2650: writing smithi08477944-15 from 1957888 to 2457600 tid 2 2024-03-30T12:31:39.740 INFO:tasks.rados.rados.0.smithi084.stdout:2650: writing smithi08477944-15 from 2457600 to 2760704 tid 3 2024-03-30T12:31:39.740 INFO:tasks.rados.rados.0.smithi084.stdout:2646: done (3 left) 2024-03-30T12:31:39.740 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 270 2024-03-30T12:31:39.741 INFO:tasks.rados.rados.0.smithi084.stdout:2651: seq_num 810 ranges {2318336=770048,3088384=778240,3866624=24576} 2024-03-30T12:31:39.757 INFO:tasks.rados.rados.0.smithi084.stdout:2651: writing smithi08477944-40 from 2318336 to 3088384 tid 1 2024-03-30T12:31:39.762 INFO:tasks.rados.rados.0.smithi084.stdout:2651: writing smithi08477944-40 from 3088384 to 3866624 tid 2 2024-03-30T12:31:39.762 INFO:tasks.rados.rados.0.smithi084.stdout:2651: writing smithi08477944-40 from 3866624 to 3891200 tid 3 2024-03-30T12:31:39.762 INFO:tasks.rados.rados.0.smithi084.stdout:2652: rollback oid 22 current snap is 270 2024-03-30T12:31:39.762 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 22 to 264 2024-03-30T12:31:39.762 INFO:tasks.rados.rados.0.smithi084.stdout:2648: expect (ObjNum 664 snap 232 seq_num 664) 2024-03-30T12:31:39.805 INFO:tasks.rados.rados.0.smithi084.stdout:2647: expect (ObjNum 664 snap 232 seq_num 664) 2024-03-30T12:31:39.845 INFO:tasks.rados.rados.0.smithi084.stdout:2650: finishing write tid 1 to smithi08477944-15 2024-03-30T12:31:39.846 INFO:tasks.rados.rados.0.smithi084.stdout:2650: finishing write tid 2 to smithi08477944-15 2024-03-30T12:31:39.846 INFO:tasks.rados.rados.0.smithi084.stdout:2650: finishing write tid 3 to smithi08477944-15 2024-03-30T12:31:39.846 INFO:tasks.rados.rados.0.smithi084.stdout:2650: finishing write tid 4 to smithi08477944-15 2024-03-30T12:31:39.846 INFO:tasks.rados.rados.0.smithi084.stdout:2650: finishing write tid 5 to smithi08477944-15 2024-03-30T12:31:39.846 INFO:tasks.rados.rados.0.smithi084.stdout:2650: oid 15 updating version 0 to 23415 2024-03-30T12:31:39.846 INFO:tasks.rados.rados.0.smithi084.stdout:2650: oid 15 version 23415 is already newer than 23414 2024-03-30T12:31:39.846 INFO:tasks.rados.rados.0.smithi084.stdout:2650: oid 15 version 23415 is already newer than 23413 2024-03-30T12:31:39.846 INFO:tasks.rados.rados.0.smithi084.stdout:2650: oid 15 updating version 23415 to 23416 2024-03-30T12:31:39.846 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 23416 (ObjNum 809 snap 270 seq_num 809) dirty exists 2024-03-30T12:31:39.846 INFO:tasks.rados.rados.0.smithi084.stdout:2650: left oid 15 (ObjNum 809 snap 270 seq_num 809) 2024-03-30T12:31:39.846 INFO:tasks.rados.rados.0.smithi084.stdout:2651: finishing write tid 1 to smithi08477944-40 2024-03-30T12:31:39.846 INFO:tasks.rados.rados.0.smithi084.stdout:2651: finishing write tid 2 to smithi08477944-40 2024-03-30T12:31:39.846 INFO:tasks.rados.rados.0.smithi084.stdout:2651: finishing write tid 3 to smithi08477944-40 2024-03-30T12:31:39.847 INFO:tasks.rados.rados.0.smithi084.stdout:2647: done (4 left) 2024-03-30T12:31:39.847 INFO:tasks.rados.rados.0.smithi084.stdout:2648: done (3 left) 2024-03-30T12:31:39.847 INFO:tasks.rados.rados.0.smithi084.stdout:2650: done (2 left) 2024-03-30T12:31:39.847 INFO:tasks.rados.rados.0.smithi084.stdout:2653: read oid 16 snap -1 2024-03-30T12:31:39.847 INFO:tasks.rados.rados.0.smithi084.stdout:2653: expect (ObjNum 799 snap 269 seq_num 799) 2024-03-30T12:31:39.847 INFO:tasks.rados.rados.0.smithi084.stdout:2654: snap_remove snap 262 2024-03-30T12:31:40.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:39.737+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:40.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:39.738+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:40.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:39.733+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:40.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:39.733+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:40.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:39.733+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:40.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:39.734+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:40.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:39.734+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:40.015 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:39.749+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:40.016 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:39.734+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:40.016 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:39.734+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:40.016 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:39.856+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:40.016 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:39.856+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:40.016 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:39.773+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:40.017 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:39.773+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:40.017 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:39.782+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:40.355 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:40.355 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:40.355 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:40.355 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:40.355 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:40.355 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:40.355 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:40.355 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:40.355 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:40.356 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:40 smithi162 ceph-mon[83709]: osdmap e610: 8 total, 8 up, 8 in 2024-03-30T12:31:40.356 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:40.356 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:40.356 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:40.356 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:40.356 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:40.356 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:40.356 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:40.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:40.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:40.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:40.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:40.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:40.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:40.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:40.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:40.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:40.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[91810]: osdmap e610: 8 total, 8 up, 8 in 2024-03-30T12:31:40.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:40.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:40.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:40.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:40.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:40.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:40.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:40.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:40.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:40.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:40.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:40.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:40.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:40.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:40.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:40.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:40.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[89279]: osdmap e610: 8 total, 8 up, 8 in 2024-03-30T12:31:40.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:40.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:40.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:40.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:40.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:40.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:40.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:40.726 INFO:tasks.rados.rados.0.smithi084.stdout:2654: done (3 left) 2024-03-30T12:31:40.726 INFO:tasks.rados.rados.0.smithi084.stdout:2655: rollback oid 2 current snap is 270 2024-03-30T12:31:40.727 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 2 to 264 2024-03-30T12:31:40.727 INFO:tasks.rados.rados.0.smithi084.stdout:2651: finishing write tid 4 to smithi08477944-40 2024-03-30T12:31:40.727 INFO:tasks.rados.rados.0.smithi084.stdout:2651: finishing write tid 5 to smithi08477944-40 2024-03-30T12:31:40.727 INFO:tasks.rados.rados.0.smithi084.stdout:2651: oid 40 updating version 0 to 23412 2024-03-30T12:31:40.727 INFO:tasks.rados.rados.0.smithi084.stdout:2651: oid 40 version 23412 is already newer than 23410 2024-03-30T12:31:40.727 INFO:tasks.rados.rados.0.smithi084.stdout:2651: oid 40 version 23412 is already newer than 23411 2024-03-30T12:31:40.727 INFO:tasks.rados.rados.0.smithi084.stdout:2651: oid 40 version 23412 is already newer than 23409 2024-03-30T12:31:40.727 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 23412 (ObjNum 810 snap 270 seq_num 810) dirty exists 2024-03-30T12:31:40.727 INFO:tasks.rados.rados.0.smithi084.stdout:2651: left oid 40 (ObjNum 810 snap 270 seq_num 810) 2024-03-30T12:31:40.727 INFO:tasks.rados.rados.0.smithi084.stdout:2652: finishing rollback tid 0 to smithi08477944-22 2024-03-30T12:31:40.727 INFO:tasks.rados.rados.0.smithi084.stdout:2652: finishing rollback tid 1 to smithi08477944-22 2024-03-30T12:31:40.728 INFO:tasks.rados.rados.0.smithi084.stdout:2652: finishing rollback tid 2 to smithi08477944-22 2024-03-30T12:31:40.728 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 27250 (ObjNum 706 snap 242 seq_num 706) dirty exists 2024-03-30T12:31:40.728 INFO:tasks.rados.rados.0.smithi084.stdout:2653: expect (ObjNum 799 snap 269 seq_num 799) 2024-03-30T12:31:40.998 INFO:tasks.rados.rados.0.smithi084.stdout:2655: finishing rollback tid 0 to smithi08477944-2 2024-03-30T12:31:40.998 INFO:tasks.rados.rados.0.smithi084.stdout:2651: done (3 left) 2024-03-30T12:31:40.998 INFO:tasks.rados.rados.0.smithi084.stdout:2652: done (2 left) 2024-03-30T12:31:40.998 INFO:tasks.rados.rados.0.smithi084.stdout:2653: done (1 left) 2024-03-30T12:31:40.998 INFO:tasks.rados.rados.0.smithi084.stdout:2656: copy_from oid 33 from oid 15 current snap is 270 2024-03-30T12:31:40.998 INFO:tasks.rados.rados.0.smithi084.stdout:2655: finishing rollback tid 1 to smithi08477944-2 2024-03-30T12:31:40.999 INFO:tasks.rados.rados.0.smithi084.stdout:2655: finishing rollback tid 2 to smithi08477944-2 2024-03-30T12:31:40.999 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 27254 (ObjNum 753 snap 253 seq_num 753) dirty exists 2024-03-30T12:31:40.999 INFO:tasks.rados.rados.0.smithi084.stdout:2655: done (1 left) 2024-03-30T12:31:40.999 INFO:tasks.rados.rados.0.smithi084.stdout:2657: snap_remove snap 254 2024-03-30T12:31:41.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:40.742+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:41.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:40.742+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:41.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:40.733+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:41.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:40.733+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:41.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:40.733+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:41.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:40.734+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:41.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:40.734+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:41.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:40.734+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:41.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:40.733+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:41.124 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:40.733+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:41.124 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:40.733+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:41.125 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:40.734+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:41.125 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:40.734+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:41.125 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:40.736+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:41.125 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:40.744+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:41.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:41.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:41.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:41.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:41.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:41.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:41.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:41.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:41.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:31:41.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:31:41.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:41.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: pgmap v603: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 686 MiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 16 MiB/s rd, 2.1 MiB/s wr, 22 op/s 2024-03-30T12:31:41.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:41.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:41.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:41.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: osdmap e611: 8 total, 8 up, 8 in 2024-03-30T12:31:41.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:41.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:41.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:41.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T12:31:41.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:31:41.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:41.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:41.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:41.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:41.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:41.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:41.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:41.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:41.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:31:41.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:31:41.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:41.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: pgmap v603: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 686 MiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 16 MiB/s rd, 2.1 MiB/s wr, 22 op/s 2024-03-30T12:31:41.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:41.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:41.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:41.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: osdmap e611: 8 total, 8 up, 8 in 2024-03-30T12:31:41.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:41.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:41.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:41.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T12:31:41.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:31:41.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.509 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.509 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.509 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.509 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.509 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.509 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.509 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.509 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.509 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.509 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:41.181+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:41.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:41.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:41.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:41.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:41.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:41.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:41.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:41.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:41.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:31:41.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:31:41.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:41.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: pgmap v603: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 686 MiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 16 MiB/s rd, 2.1 MiB/s wr, 22 op/s 2024-03-30T12:31:41.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:41.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:41.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:41.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: osdmap e611: 8 total, 8 up, 8 in 2024-03-30T12:31:41.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:41.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:41.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:41.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T12:31:41.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:31:41.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:41.727 INFO:tasks.rados.rados.0.smithi084.stdout:2657: done (1 left) 2024-03-30T12:31:41.727 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 270 2024-03-30T12:31:41.728 INFO:tasks.rados.rados.0.smithi084.stdout:2658: seq_num 811 ranges {802816=786432,1589248=663552,2252800=139264} 2024-03-30T12:31:41.736 INFO:tasks.rados.rados.0.smithi084.stdout:2658: writing smithi08477944-14 from 802816 to 1589248 tid 1 2024-03-30T12:31:41.739 INFO:tasks.rados.rados.0.smithi084.stdout:2658: writing smithi08477944-14 from 1589248 to 2252800 tid 2 2024-03-30T12:31:41.740 INFO:tasks.rados.rados.0.smithi084.stdout:2658: writing smithi08477944-14 from 2252800 to 2392064 tid 3 2024-03-30T12:31:41.741 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 270 2024-03-30T12:31:41.741 INFO:tasks.rados.rados.0.smithi084.stdout:2656: finishing copy_from racing read to smithi08477944-33 2024-03-30T12:31:41.741 INFO:tasks.rados.rados.0.smithi084.stdout:2656: finishing copy_from to smithi08477944-33 2024-03-30T12:31:41.741 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 23416 (ObjNum 809 snap 270 seq_num 809) dirty exists 2024-03-30T12:31:41.741 INFO:tasks.rados.rados.0.smithi084.stdout:2659: seq_num 812 ranges {5021696=802816,5824512=548864,6373376=253952} 2024-03-30T12:31:41.772 INFO:tasks.rados.rados.0.smithi084.stdout:2659: writing smithi08477944-50 from 5021696 to 5824512 tid 1 2024-03-30T12:31:41.775 INFO:tasks.rados.rados.0.smithi084.stdout:2659: writing smithi08477944-50 from 5824512 to 6373376 tid 2 2024-03-30T12:31:41.778 INFO:tasks.rados.rados.0.smithi084.stdout:2659: writing smithi08477944-50 from 6373376 to 6627328 tid 3 2024-03-30T12:31:41.778 INFO:tasks.rados.rados.0.smithi084.stdout:2656: done (2 left) 2024-03-30T12:31:41.778 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 270 2024-03-30T12:31:41.778 INFO:tasks.rados.rados.0.smithi084.stdout:2660: seq_num 813 ranges {1507328=417792,1925120=434176,2359296=442368,2801664=327680} 2024-03-30T12:31:41.788 INFO:tasks.rados.rados.0.smithi084.stdout:2660: writing smithi08477944-32 from 1507328 to 1925120 tid 1 2024-03-30T12:31:41.791 INFO:tasks.rados.rados.0.smithi084.stdout:2660: writing smithi08477944-32 from 1925120 to 2359296 tid 2 2024-03-30T12:31:41.794 INFO:tasks.rados.rados.0.smithi084.stdout:2660: writing smithi08477944-32 from 2359296 to 2801664 tid 3 2024-03-30T12:31:41.797 INFO:tasks.rados.rados.0.smithi084.stdout:2660: writing smithi08477944-32 from 2801664 to 3129344 tid 4 2024-03-30T12:31:41.797 INFO:tasks.rados.rados.0.smithi084.stdout:2661: delete oid 36 current snap is 270 2024-03-30T12:31:41.797 INFO:tasks.rados.rados.0.smithi084.stdout:2658: finishing write tid 1 to smithi08477944-14 2024-03-30T12:31:41.797 INFO:tasks.rados.rados.0.smithi084.stdout:2658: finishing write tid 2 to smithi08477944-14 2024-03-30T12:31:41.797 INFO:tasks.rados.rados.0.smithi084.stdout:2658: finishing write tid 3 to smithi08477944-14 2024-03-30T12:31:41.797 INFO:tasks.rados.rados.0.smithi084.stdout:2658: finishing write tid 4 to smithi08477944-14 2024-03-30T12:31:41.797 INFO:tasks.rados.rados.0.smithi084.stdout:2658: finishing write tid 5 to smithi08477944-14 2024-03-30T12:31:41.797 INFO:tasks.rados.rados.0.smithi084.stdout:2658: oid 14 updating version 0 to 27205 2024-03-30T12:31:41.797 INFO:tasks.rados.rados.0.smithi084.stdout:2658: oid 14 updating version 27205 to 27208 2024-03-30T12:31:41.797 INFO:tasks.rados.rados.0.smithi084.stdout:2658: oid 14 version 27208 is already newer than 27207 2024-03-30T12:31:41.797 INFO:tasks.rados.rados.0.smithi084.stdout:2658: oid 14 version 27208 is already newer than 27206 2024-03-30T12:31:41.797 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 27208 (ObjNum 811 snap 270 seq_num 811) dirty exists 2024-03-30T12:31:41.798 INFO:tasks.rados.rados.0.smithi084.stdout:2658: left oid 14 (ObjNum 811 snap 270 seq_num 811) 2024-03-30T12:31:41.798 INFO:tasks.rados.rados.0.smithi084.stdout:2659: finishing write tid 1 to smithi08477944-50 2024-03-30T12:31:41.798 INFO:tasks.rados.rados.0.smithi084.stdout:2659: finishing write tid 2 to smithi08477944-50 2024-03-30T12:31:41.798 INFO:tasks.rados.rados.0.smithi084.stdout:2659: finishing write tid 3 to smithi08477944-50 2024-03-30T12:31:41.798 INFO:tasks.rados.rados.0.smithi084.stdout:2659: finishing write tid 4 to smithi08477944-50 2024-03-30T12:31:41.798 INFO:tasks.rados.rados.0.smithi084.stdout:2659: finishing write tid 5 to smithi08477944-50 2024-03-30T12:31:41.798 INFO:tasks.rados.rados.0.smithi084.stdout:2659: oid 50 updating version 0 to 23390 2024-03-30T12:31:41.798 INFO:tasks.rados.rados.0.smithi084.stdout:2659: oid 50 updating version 23390 to 23393 2024-03-30T12:31:41.798 INFO:tasks.rados.rados.0.smithi084.stdout:2659: oid 50 version 23393 is already newer than 23392 2024-03-30T12:31:41.798 INFO:tasks.rados.rados.0.smithi084.stdout:2659: oid 50 version 23393 is already newer than 23391 2024-03-30T12:31:41.798 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 23393 (ObjNum 812 snap 270 seq_num 812) dirty exists 2024-03-30T12:31:41.798 INFO:tasks.rados.rados.0.smithi084.stdout:2659: left oid 50 (ObjNum 812 snap 270 seq_num 812) 2024-03-30T12:31:41.798 INFO:tasks.rados.rados.0.smithi084.stdout:2660: finishing write tid 1 to smithi08477944-32 2024-03-30T12:31:41.798 INFO:tasks.rados.rados.0.smithi084.stdout:2660: finishing write tid 2 to smithi08477944-32 2024-03-30T12:31:41.799 INFO:tasks.rados.rados.0.smithi084.stdout:2660: finishing write tid 3 to smithi08477944-32 2024-03-30T12:31:41.799 INFO:tasks.rados.rados.0.smithi084.stdout:2660: finishing write tid 4 to smithi08477944-32 2024-03-30T12:31:41.799 INFO:tasks.rados.rados.0.smithi084.stdout:2660: finishing write tid 5 to smithi08477944-32 2024-03-30T12:31:41.802 INFO:tasks.rados.rados.0.smithi084.stdout:2660: finishing write tid 6 to smithi08477944-32 2024-03-30T12:31:41.802 INFO:tasks.rados.rados.0.smithi084.stdout:2660: oid 32 updating version 0 to 27255 2024-03-30T12:31:41.802 INFO:tasks.rados.rados.0.smithi084.stdout:2660: oid 32 version 27255 is already newer than 27254 2024-03-30T12:31:41.802 INFO:tasks.rados.rados.0.smithi084.stdout:2660: oid 32 version 27255 is already newer than 27252 2024-03-30T12:31:41.803 INFO:tasks.rados.rados.0.smithi084.stdout:2660: oid 32 version 27255 is already newer than 27251 2024-03-30T12:31:41.803 INFO:tasks.rados.rados.0.smithi084.stdout:2660: oid 32 version 27255 is already newer than 27253 2024-03-30T12:31:41.803 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 27255 (ObjNum 813 snap 270 seq_num 813) dirty exists 2024-03-30T12:31:41.803 INFO:tasks.rados.rados.0.smithi084.stdout:2660: left oid 32 (ObjNum 813 snap 270 seq_num 813) 2024-03-30T12:31:41.803 INFO:tasks.rados.rados.0.smithi084.stdout:2658: done (3 left) 2024-03-30T12:31:41.803 INFO:tasks.rados.rados.0.smithi084.stdout:2659: done (2 left) 2024-03-30T12:31:41.803 INFO:tasks.rados.rados.0.smithi084.stdout:2660: done (1 left) 2024-03-30T12:31:41.803 INFO:tasks.rados.rados.0.smithi084.stdout:2661: done (0 left) 2024-03-30T12:31:41.803 INFO:tasks.rados.rados.0.smithi084.stdout:2662: snap_create 2024-03-30T12:31:42.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:41.742+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:42.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:41.742+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:42.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:41.784+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:42.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:41.785+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:42.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:41.785+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:42.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:41.794+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:42.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:41.794+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:42.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:41.754+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:42.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:41.736+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:42.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:41.736+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:42.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:41.735+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:42.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:41.735+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:42.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:41.751+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:42.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:41.751+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:42.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:41.751+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:42.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:42.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:42.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:42.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:42.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:42.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:42.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[91810]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T12:31:42.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:42.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[91810]: osdmap e612: 8 total, 8 up, 8 in 2024-03-30T12:31:42.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:42.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:42.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:42.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:42.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:42.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:42.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:42.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:42.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:42.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:42.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:42.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:42.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:42.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[89279]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T12:31:42.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:42.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[89279]: osdmap e612: 8 total, 8 up, 8 in 2024-03-30T12:31:42.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:42.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:42.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:42.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:42.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:42.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:42.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:42.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:42.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:42.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:42.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:42.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:42.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:42.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:42 smithi162 ceph-mon[83709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T12:31:42.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:42.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:42 smithi162 ceph-mon[83709]: osdmap e612: 8 total, 8 up, 8 in 2024-03-30T12:31:42.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:42.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:42.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:42.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:42.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:42.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:42.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:42.734 INFO:tasks.rados.rados.0.smithi084.stdout:2662: done (0 left) 2024-03-30T12:31:42.734 INFO:tasks.rados.rados.0.smithi084.stdout:2663: read oid 21 snap 264 2024-03-30T12:31:42.734 INFO:tasks.rados.rados.0.smithi084.stdout:2663: expect (ObjNum 782 snap 261 seq_num 782) 2024-03-30T12:31:42.734 INFO:tasks.rados.rados.0.smithi084.stdout:2664: delete oid 3 current snap is 271 2024-03-30T12:31:42.742 INFO:tasks.rados.rados.0.smithi084.stdout:2663: expect (ObjNum 782 snap 261 seq_num 782) 2024-03-30T12:31:42.772 INFO:tasks.rados.rados.0.smithi084.stdout:2663: done (1 left) 2024-03-30T12:31:42.772 INFO:tasks.rados.rados.0.smithi084.stdout:2664: done (0 left) 2024-03-30T12:31:42.772 INFO:tasks.rados.rados.0.smithi084.stdout:2665: read oid 23 snap 261 2024-03-30T12:31:42.772 INFO:tasks.rados.rados.0.smithi084.stdout:2665: expect deleted 2024-03-30T12:31:42.772 INFO:tasks.rados.rados.0.smithi084.stdout:2666: setattr oid 29 current snap is 271 2024-03-30T12:31:42.773 INFO:tasks.rados.rados.0.smithi084.stdout:2665: done (1 left) 2024-03-30T12:31:42.773 INFO:tasks.rados.rados.0.smithi084.stdout:2667: copy_from oid 26 from oid 10 current snap is 271 2024-03-30T12:31:42.773 INFO:tasks.rados.rados.0.smithi084.stdout:2668: delete oid 9 current snap is 271 2024-03-30T12:31:42.776 INFO:tasks.rados.rados.0.smithi084.stdout:2668: done (2 left) 2024-03-30T12:31:42.776 INFO:tasks.rados.rados.0.smithi084.stdout:2669: snap_create 2024-03-30T12:31:42.778 INFO:tasks.rados.rados.0.smithi084.stdout:2667: finishing copy_from to smithi08477944-26 2024-03-30T12:31:42.778 INFO:tasks.rados.rados.0.smithi084.stdout:2667: got expected ENOENT (src dne) 2024-03-30T12:31:42.778 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 23384 (ObjNum 779 snap 260 seq_num 779) dirty exists 2024-03-30T12:31:42.778 INFO:tasks.rados.rados.0.smithi084.stdout:2667: finishing copy_from racing read to smithi08477944-26 2024-03-30T12:31:43.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:42.743+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:43.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:42.743+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:43.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:42.741+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:43.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:42.741+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:43.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:42.741+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:43.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:42.742+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:43.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:42.743+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:43.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:42.743+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:43.017 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:42.787+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:43.018 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:42.737+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:43.018 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:42.737+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:43.018 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:42.737+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:43.018 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:42.746+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:43.018 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:42.751+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:43.369 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:43.025+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:43.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:43.025+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:43.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:43.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:43.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:43.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:43.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:43.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:43.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-mon[83709]: Upgrade: Updating alertmanager.a 2024-03-30T12:31:43.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-mon[83709]: Deploying daemon alertmanager.a on smithi084 2024-03-30T12:31:43.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-mon[83709]: pgmap v606: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 687 MiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 12 MiB/s rd, 752 KiB/s wr, 6 op/s 2024-03-30T12:31:43.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:43.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:43.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:43.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-mon[83709]: osdmap e613: 8 total, 8 up, 8 in 2024-03-30T12:31:43.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:43.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:43.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:43.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:43.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:43.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:43.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:43.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:43.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:43.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:43.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[91810]: Upgrade: Updating alertmanager.a 2024-03-30T12:31:43.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[91810]: Deploying daemon alertmanager.a on smithi084 2024-03-30T12:31:43.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[91810]: pgmap v606: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 687 MiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 12 MiB/s rd, 752 KiB/s wr, 6 op/s 2024-03-30T12:31:43.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:43.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:43.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:43.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[91810]: osdmap e613: 8 total, 8 up, 8 in 2024-03-30T12:31:43.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:43.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:43.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:43.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:43.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:43.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:43.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:43.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:43.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:43.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:43.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[89279]: Upgrade: Updating alertmanager.a 2024-03-30T12:31:43.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[89279]: Deploying daemon alertmanager.a on smithi084 2024-03-30T12:31:43.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[89279]: pgmap v606: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 687 MiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 12 MiB/s rd, 752 KiB/s wr, 6 op/s 2024-03-30T12:31:43.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:43.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:43.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:43.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[89279]: osdmap e613: 8 total, 8 up, 8 in 2024-03-30T12:31:43.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:43.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:43.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:43.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:43.731 INFO:tasks.rados.rados.0.smithi084.stdout:2666: done (2 left) 2024-03-30T12:31:43.731 INFO:tasks.rados.rados.0.smithi084.stdout:2667: done (1 left) 2024-03-30T12:31:43.731 INFO:tasks.rados.rados.0.smithi084.stdout:2669: done (0 left) 2024-03-30T12:31:43.731 INFO:tasks.rados.rados.0.smithi084.stdout:2670: copy_from oid 14 from oid 19 current snap is 272 2024-03-30T12:31:43.731 INFO:tasks.rados.rados.0.smithi084.stdout:2671: rmattr oid 49 current snap is 272 2024-03-30T12:31:43.731 INFO:tasks.rados.rados.0.smithi084.stdout:2672: delete oid 31 current snap is 272 2024-03-30T12:31:43.733 INFO:tasks.rados.rados.0.smithi084.stdout:2672: done (2 left) 2024-03-30T12:31:43.733 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 272 2024-03-30T12:31:43.733 INFO:tasks.rados.rados.0.smithi084.stdout:2673: seq_num 818 ranges {1138688=507904,1646592=704512,2351104=499712} 2024-03-30T12:31:43.742 INFO:tasks.rados.rados.0.smithi084.stdout:2673: writing smithi08477944-24 from 1138688 to 1646592 tid 1 2024-03-30T12:31:43.746 INFO:tasks.rados.rados.0.smithi084.stdout:2673: writing smithi08477944-24 from 1646592 to 2351104 tid 2 2024-03-30T12:31:43.749 INFO:tasks.rados.rados.0.smithi084.stdout:2673: writing smithi08477944-24 from 2351104 to 2850816 tid 3 2024-03-30T12:31:43.750 INFO:tasks.rados.rados.0.smithi084.stdout:2674: delete oid 38 current snap is 272 2024-03-30T12:31:43.750 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 27257 (ObjNum 717 snap 242 seq_num 717) dirty exists 2024-03-30T12:31:43.750 INFO:tasks.rados.rados.0.smithi084.stdout:2670: finishing copy_from racing read to smithi08477944-14 2024-03-30T12:31:43.750 INFO:tasks.rados.rados.0.smithi084.stdout:2670: finishing copy_from to smithi08477944-14 2024-03-30T12:31:43.750 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 36250 (ObjNum 794 snap 266 seq_num 794) dirty exists 2024-03-30T12:31:43.752 INFO:tasks.rados.rados.0.smithi084.stdout:2670: done (3 left) 2024-03-30T12:31:43.752 INFO:tasks.rados.rados.0.smithi084.stdout:2671: done (2 left) 2024-03-30T12:31:43.752 INFO:tasks.rados.rados.0.smithi084.stdout:2674: done (1 left) 2024-03-30T12:31:43.752 INFO:tasks.rados.rados.0.smithi084.stdout:2675: rmattr oid 47 current snap is 272 2024-03-30T12:31:43.753 INFO:tasks.rados.rados.0.smithi084.stdout:2675: done (1 left) 2024-03-30T12:31:43.753 INFO:tasks.rados.rados.0.smithi084.stdout:2676: read oid 47 snap 258 2024-03-30T12:31:43.753 INFO:tasks.rados.rados.0.smithi084.stdout:2676: expect (ObjNum 768 snap 254 seq_num 768) 2024-03-30T12:31:43.753 INFO:tasks.rados.rados.0.smithi084.stdout:2677: delete oid 27 current snap is 272 2024-03-30T12:31:43.754 INFO:tasks.rados.rados.0.smithi084.stdout:2673: finishing write tid 1 to smithi08477944-24 2024-03-30T12:31:43.757 INFO:tasks.rados.rados.0.smithi084.stdout:2677: done (2 left) 2024-03-30T12:31:43.757 INFO:tasks.rados.rados.0.smithi084.stdout:2678: copy_from oid 44 from oid 15 current snap is 272 2024-03-30T12:31:43.757 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 272 2024-03-30T12:31:43.757 INFO:tasks.rados.rados.0.smithi084.stdout:2679: seq_num 821 ranges {0=557056,557056=761856,1318912=442368} 2024-03-30T12:31:43.760 INFO:tasks.rados.rados.0.smithi084.stdout:2679: writing smithi08477944-36 from 0 to 557056 tid 1 2024-03-30T12:31:43.765 INFO:tasks.rados.rados.0.smithi084.stdout:2679: writing smithi08477944-36 from 557056 to 1318912 tid 2 2024-03-30T12:31:43.768 INFO:tasks.rados.rados.0.smithi084.stdout:2679: writing smithi08477944-36 from 1318912 to 1761280 tid 3 2024-03-30T12:31:43.768 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 272 2024-03-30T12:31:43.768 INFO:tasks.rados.rados.0.smithi084.stdout:2673: finishing write tid 2 to smithi08477944-24 2024-03-30T12:31:43.768 INFO:tasks.rados.rados.0.smithi084.stdout:2673: finishing write tid 3 to smithi08477944-24 2024-03-30T12:31:43.769 INFO:tasks.rados.rados.0.smithi084.stdout:2673: finishing write tid 4 to smithi08477944-24 2024-03-30T12:31:43.769 INFO:tasks.rados.rados.0.smithi084.stdout:2679: finishing write tid 1 to smithi08477944-36 2024-03-30T12:31:43.769 INFO:tasks.rados.rados.0.smithi084.stdout:2680: seq_num 822 ranges {10903552=573440,11476992=696320,12173312=507904} 2024-03-30T12:31:43.830 INFO:tasks.rados.rados.0.smithi084.stdout:2680: writing smithi08477944-22 from 10903552 to 11476992 tid 1 2024-03-30T12:31:43.834 INFO:tasks.rados.rados.0.smithi084.stdout:2680: writing smithi08477944-22 from 11476992 to 12173312 tid 2 2024-03-30T12:31:43.837 INFO:tasks.rados.rados.0.smithi084.stdout:2680: writing smithi08477944-22 from 12173312 to 12681216 tid 3 2024-03-30T12:31:43.837 INFO:tasks.rados.rados.0.smithi084.stdout:2681: rollback oid 26 current snap is 272 2024-03-30T12:31:43.837 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 26 to 269 2024-03-30T12:31:43.837 INFO:tasks.rados.rados.0.smithi084.stdout:2673: finishing write tid 5 to smithi08477944-24 2024-03-30T12:31:43.837 INFO:tasks.rados.rados.0.smithi084.stdout:2673: oid 24 updating version 0 to 17552 2024-03-30T12:31:43.837 INFO:tasks.rados.rados.0.smithi084.stdout:2673: oid 24 updating version 17552 to 17553 2024-03-30T12:31:43.837 INFO:tasks.rados.rados.0.smithi084.stdout:2673: oid 24 updating version 17553 to 17555 2024-03-30T12:31:43.838 INFO:tasks.rados.rados.0.smithi084.stdout:2673: oid 24 version 17555 is already newer than 17554 2024-03-30T12:31:43.838 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 17555 (ObjNum 818 snap 272 seq_num 818) dirty exists 2024-03-30T12:31:43.838 INFO:tasks.rados.rados.0.smithi084.stdout:2673: left oid 24 (ObjNum 818 snap 272 seq_num 818) 2024-03-30T12:31:43.838 INFO:tasks.rados.rados.0.smithi084.stdout:2679: finishing write tid 2 to smithi08477944-36 2024-03-30T12:31:43.838 INFO:tasks.rados.rados.0.smithi084.stdout:2676: expect (ObjNum 768 snap 254 seq_num 768) 2024-03-30T12:31:44.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:43.743+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:44.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:43.744+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:44.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:43.738+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:44.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:43.738+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:44.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:43.738+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:44.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:43.739+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:44.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:43.739+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:44.109 INFO:tasks.rados.rados.0.smithi084.stdout:2679: finishing write tid 3 to smithi08477944-36 2024-03-30T12:31:44.109 INFO:tasks.rados.rados.0.smithi084.stdout:2679: finishing write tid 4 to smithi08477944-36 2024-03-30T12:31:44.109 INFO:tasks.rados.rados.0.smithi084.stdout:2673: done (5 left) 2024-03-30T12:31:44.109 INFO:tasks.rados.rados.0.smithi084.stdout:2676: done (4 left) 2024-03-30T12:31:44.109 INFO:tasks.rados.rados.0.smithi084.stdout:2682: rmattr oid 35 current snap is 272 2024-03-30T12:31:44.109 INFO:tasks.rados.rados.0.smithi084.stdout:2678: finishing copy_from racing read to smithi08477944-44 2024-03-30T12:31:44.110 INFO:tasks.rados.rados.0.smithi084.stdout:2679: finishing write tid 5 to smithi08477944-36 2024-03-30T12:31:44.110 INFO:tasks.rados.rados.0.smithi084.stdout:2679: oid 36 updating version 0 to 27258 2024-03-30T12:31:44.110 INFO:tasks.rados.rados.0.smithi084.stdout:2679: oid 36 updating version 27258 to 27259 2024-03-30T12:31:44.110 INFO:tasks.rados.rados.0.smithi084.stdout:2679: oid 36 updating version 27259 to 27260 2024-03-30T12:31:44.110 INFO:tasks.rados.rados.0.smithi084.stdout:2679: oid 36 updating version 27260 to 27261 2024-03-30T12:31:44.110 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 27261 (ObjNum 821 snap 272 seq_num 821) dirty exists 2024-03-30T12:31:44.110 INFO:tasks.rados.rados.0.smithi084.stdout:2679: left oid 36 (ObjNum 821 snap 272 seq_num 821) 2024-03-30T12:31:44.110 INFO:tasks.rados.rados.0.smithi084.stdout:2678: finishing copy_from to smithi08477944-44 2024-03-30T12:31:44.110 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 23416 (ObjNum 809 snap 270 seq_num 809) dirty exists 2024-03-30T12:31:44.110 INFO:tasks.rados.rados.0.smithi084.stdout:2680: finishing write tid 1 to smithi08477944-22 2024-03-30T12:31:44.110 INFO:tasks.rados.rados.0.smithi084.stdout:2680: finishing write tid 2 to smithi08477944-22 2024-03-30T12:31:44.110 INFO:tasks.rados.rados.0.smithi084.stdout:2680: finishing write tid 3 to smithi08477944-22 2024-03-30T12:31:44.110 INFO:tasks.rados.rados.0.smithi084.stdout:2680: finishing write tid 4 to smithi08477944-22 2024-03-30T12:31:44.110 INFO:tasks.rados.rados.0.smithi084.stdout:2681: finishing rollback tid 0 to smithi08477944-26 2024-03-30T12:31:44.111 INFO:tasks.rados.rados.0.smithi084.stdout:2681: finishing rollback tid 1 to smithi08477944-26 2024-03-30T12:31:44.111 INFO:tasks.rados.rados.0.smithi084.stdout:2681: finishing rollback tid 2 to smithi08477944-26 2024-03-30T12:31:44.111 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 27265 (ObjNum 770 snap 254 seq_num 770) dirty exists 2024-03-30T12:31:44.111 INFO:tasks.rados.rados.0.smithi084.stdout:2678: done (4 left) 2024-03-30T12:31:44.111 INFO:tasks.rados.rados.0.smithi084.stdout:2679: done (3 left) 2024-03-30T12:31:44.111 INFO:tasks.rados.rados.0.smithi084.stdout:2681: done (2 left) 2024-03-30T12:31:44.111 INFO:tasks.rados.rados.0.smithi084.stdout:2683: setattr oid 31 current snap is 272 2024-03-30T12:31:44.111 INFO:tasks.rados.rados.0.smithi084.stdout:2680: finishing write tid 5 to smithi08477944-22 2024-03-30T12:31:44.111 INFO:tasks.rados.rados.0.smithi084.stdout:2680: oid 22 updating version 0 to 27259 2024-03-30T12:31:44.111 INFO:tasks.rados.rados.0.smithi084.stdout:2680: oid 22 updating version 27259 to 27260 2024-03-30T12:31:44.111 INFO:tasks.rados.rados.0.smithi084.stdout:2680: oid 22 version 27260 is already newer than 27258 2024-03-30T12:31:44.111 INFO:tasks.rados.rados.0.smithi084.stdout:2680: oid 22 updating version 27260 to 27261 2024-03-30T12:31:44.111 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 27261 (ObjNum 822 snap 272 seq_num 822) dirty exists 2024-03-30T12:31:44.111 INFO:tasks.rados.rados.0.smithi084.stdout:2680: left oid 22 (ObjNum 822 snap 272 seq_num 822) 2024-03-30T12:31:44.112 INFO:tasks.rados.rados.0.smithi084.stdout:2680: done (2 left) 2024-03-30T12:31:44.112 INFO:tasks.rados.rados.0.smithi084.stdout:2684: snap_create 2024-03-30T12:31:44.112 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 17500 (ObjNum 807 snap 269 seq_num 807) dirty exists 2024-03-30T12:31:44.112 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 23385 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-03-30T12:31:44.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:43.744+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:44.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:43.738+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:44.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:43.739+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:44.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:43.740+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:44.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:43.740+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:44.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:43.744+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:44.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:43.744+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:44.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:43.744+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:44.476 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:44.476 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:44.476 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:44.476 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:44.476 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:44.476 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:44.476 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:44.477 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:44.477 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:44.477 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:44.477 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[89279]: osdmap e614: 8 total, 8 up, 8 in 2024-03-30T12:31:44.477 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:44.477 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:44.477 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:44.477 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:44.477 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:44.478 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:44.478 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:44.478 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:44.478 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:44.478 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:44.478 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:44.478 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:44.478 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:44.478 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[91810]: osdmap e614: 8 total, 8 up, 8 in 2024-03-30T12:31:44.478 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:44.478 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:44.479 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:44.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:44.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:44.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:44.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:44.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:44.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:44.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:44.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:44.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:44.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:44.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:44 smithi162 ceph-mon[83709]: osdmap e614: 8 total, 8 up, 8 in 2024-03-30T12:31:44.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:44.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:44.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:44.738 INFO:tasks.rados.rados.0.smithi084.stdout:2682: done (2 left) 2024-03-30T12:31:44.738 INFO:tasks.rados.rados.0.smithi084.stdout:2683: done (1 left) 2024-03-30T12:31:44.738 INFO:tasks.rados.rados.0.smithi084.stdout:2684: done (0 left) 2024-03-30T12:31:44.738 INFO:tasks.rados.rados.0.smithi084.stdout:2685: delete oid 42 current snap is 273 2024-03-30T12:31:44.743 INFO:tasks.rados.rados.0.smithi084.stdout:2685: done (0 left) 2024-03-30T12:31:44.743 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 273 2024-03-30T12:31:44.743 INFO:tasks.rados.rados.0.smithi084.stdout:2686: seq_num 824 ranges {6955008=606208,7561216=458752,8019968=573440,8593408=172032} 2024-03-30T12:31:44.784 INFO:tasks.rados.rados.0.smithi084.stdout:2686: writing smithi08477944-26 from 6955008 to 7561216 tid 1 2024-03-30T12:31:44.786 INFO:tasks.rados.rados.0.smithi084.stdout:2686: writing smithi08477944-26 from 7561216 to 8019968 tid 2 2024-03-30T12:31:44.790 INFO:tasks.rados.rados.0.smithi084.stdout:2686: writing smithi08477944-26 from 8019968 to 8593408 tid 3 2024-03-30T12:31:44.791 INFO:tasks.rados.rados.0.smithi084.stdout:2686: writing smithi08477944-26 from 8593408 to 8765440 tid 4 2024-03-30T12:31:44.791 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 42 current snap is 273 2024-03-30T12:31:44.791 INFO:tasks.rados.rados.0.smithi084.stdout:2687: seq_num 825 ranges {0=622592,622592=745472,1368064=458752} 2024-03-30T12:31:44.795 INFO:tasks.rados.rados.0.smithi084.stdout:2687: writing smithi08477944-42 from 0 to 622592 tid 1 2024-03-30T12:31:44.799 INFO:tasks.rados.rados.0.smithi084.stdout:2687: writing smithi08477944-42 from 622592 to 1368064 tid 2 2024-03-30T12:31:44.802 INFO:tasks.rados.rados.0.smithi084.stdout:2687: writing smithi08477944-42 from 1368064 to 1826816 tid 3 2024-03-30T12:31:44.803 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 273 2024-03-30T12:31:44.803 INFO:tasks.rados.rados.0.smithi084.stdout:2687: finishing write tid 1 to smithi08477944-42 2024-03-30T12:31:44.803 INFO:tasks.rados.rados.0.smithi084.stdout:2688: seq_num 826 ranges {12681216=638976,13320192=630784,13950976=573440} 2024-03-30T12:31:44.873 INFO:tasks.rados.rados.0.smithi084.stdout:2688: writing smithi08477944-22 from 12681216 to 13320192 tid 1 2024-03-30T12:31:44.876 INFO:tasks.rados.rados.0.smithi084.stdout:2688: writing smithi08477944-22 from 13320192 to 13950976 tid 2 2024-03-30T12:31:44.881 INFO:tasks.rados.rados.0.smithi084.stdout:2688: writing smithi08477944-22 from 13950976 to 14524416 tid 3 2024-03-30T12:31:44.881 INFO:tasks.rados.rados.0.smithi084.stdout:2689: delete oid 44 current snap is 273 2024-03-30T12:31:44.881 INFO:tasks.rados.rados.0.smithi084.stdout:2687: finishing write tid 2 to smithi08477944-42 2024-03-30T12:31:44.881 INFO:tasks.rados.rados.0.smithi084.stdout:2686: finishing write tid 1 to smithi08477944-26 2024-03-30T12:31:44.881 INFO:tasks.rados.rados.0.smithi084.stdout:2686: finishing write tid 2 to smithi08477944-26 2024-03-30T12:31:44.881 INFO:tasks.rados.rados.0.smithi084.stdout:2687: finishing write tid 3 to smithi08477944-42 2024-03-30T12:31:44.881 INFO:tasks.rados.rados.0.smithi084.stdout:2687: finishing write tid 4 to smithi08477944-42 2024-03-30T12:31:44.881 INFO:tasks.rados.rados.0.smithi084.stdout:2687: finishing write tid 5 to smithi08477944-42 2024-03-30T12:31:44.882 INFO:tasks.rados.rados.0.smithi084.stdout:2687: oid 42 updating version 0 to 23419 2024-03-30T12:31:44.882 INFO:tasks.rados.rados.0.smithi084.stdout:2687: oid 42 version 23419 is already newer than 23418 2024-03-30T12:31:44.882 INFO:tasks.rados.rados.0.smithi084.stdout:2687: oid 42 updating version 23419 to 23421 2024-03-30T12:31:44.882 INFO:tasks.rados.rados.0.smithi084.stdout:2687: oid 42 version 23421 is already newer than 23420 2024-03-30T12:31:44.882 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 23421 (ObjNum 825 snap 273 seq_num 825) dirty exists 2024-03-30T12:31:44.882 INFO:tasks.rados.rados.0.smithi084.stdout:2687: left oid 42 (ObjNum 825 snap 273 seq_num 825) 2024-03-30T12:31:44.882 INFO:tasks.rados.rados.0.smithi084.stdout:2686: finishing write tid 3 to smithi08477944-26 2024-03-30T12:31:44.882 INFO:tasks.rados.rados.0.smithi084.stdout:2686: finishing write tid 4 to smithi08477944-26 2024-03-30T12:31:44.882 INFO:tasks.rados.rados.0.smithi084.stdout:2686: finishing write tid 5 to smithi08477944-26 2024-03-30T12:31:44.882 INFO:tasks.rados.rados.0.smithi084.stdout:2686: finishing write tid 6 to smithi08477944-26 2024-03-30T12:31:44.882 INFO:tasks.rados.rados.0.smithi084.stdout:2686: oid 26 updating version 0 to 27270 2024-03-30T12:31:44.882 INFO:tasks.rados.rados.0.smithi084.stdout:2686: oid 26 version 27270 is already newer than 27269 2024-03-30T12:31:44.883 INFO:tasks.rados.rados.0.smithi084.stdout:2686: oid 26 version 27270 is already newer than 27268 2024-03-30T12:31:44.883 INFO:tasks.rados.rados.0.smithi084.stdout:2686: oid 26 updating version 27270 to 27271 2024-03-30T12:31:44.883 INFO:tasks.rados.rados.0.smithi084.stdout:2686: oid 26 version 27271 is already newer than 27267 2024-03-30T12:31:44.883 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 27271 (ObjNum 824 snap 273 seq_num 824) dirty exists 2024-03-30T12:31:44.883 INFO:tasks.rados.rados.0.smithi084.stdout:2686: left oid 26 (ObjNum 824 snap 273 seq_num 824) 2024-03-30T12:31:44.883 INFO:tasks.rados.rados.0.smithi084.stdout:2688: finishing write tid 1 to smithi08477944-22 2024-03-30T12:31:44.890 INFO:tasks.rados.rados.0.smithi084.stdout:2686: done (3 left) 2024-03-30T12:31:44.890 INFO:tasks.rados.rados.0.smithi084.stdout:2687: done (2 left) 2024-03-30T12:31:44.890 INFO:tasks.rados.rados.0.smithi084.stdout:2689: done (1 left) 2024-03-30T12:31:44.890 INFO:tasks.rados.rados.0.smithi084.stdout:2690: read oid 18 snap -1 2024-03-30T12:31:44.890 INFO:tasks.rados.rados.0.smithi084.stdout:2690: expect (ObjNum 733 snap 244 seq_num 733) 2024-03-30T12:31:44.891 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 273 2024-03-30T12:31:44.891 INFO:tasks.rados.rados.0.smithi084.stdout:2691: seq_num 828 ranges {4653056=671744,5324800=802816,6127616=401408} 2024-03-30T12:31:44.919 INFO:tasks.rados.rados.0.smithi084.stdout:2691: writing smithi08477944-16 from 4653056 to 5324800 tid 1 2024-03-30T12:31:44.924 INFO:tasks.rados.rados.0.smithi084.stdout:2691: writing smithi08477944-16 from 5324800 to 6127616 tid 2 2024-03-30T12:31:44.927 INFO:tasks.rados.rados.0.smithi084.stdout:2691: writing smithi08477944-16 from 6127616 to 6529024 tid 3 2024-03-30T12:31:44.927 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 273 2024-03-30T12:31:44.927 INFO:tasks.rados.rados.0.smithi084.stdout:2688: finishing write tid 2 to smithi08477944-22 2024-03-30T12:31:44.927 INFO:tasks.rados.rados.0.smithi084.stdout:2692: seq_num 829 ranges {0=688128,688128=729088,1417216=475136} 2024-03-30T12:31:44.930 INFO:tasks.rados.rados.0.smithi084.stdout:2692: writing smithi08477944-47 from 0 to 688128 tid 1 2024-03-30T12:31:44.934 INFO:tasks.rados.rados.0.smithi084.stdout:2692: writing smithi08477944-47 from 688128 to 1417216 tid 2 2024-03-30T12:31:44.938 INFO:tasks.rados.rados.0.smithi084.stdout:2692: writing smithi08477944-47 from 1417216 to 1892352 tid 3 2024-03-30T12:31:44.938 INFO:tasks.rados.rados.0.smithi084.stdout:2693: copy_from oid 5 from oid 6 current snap is 273 2024-03-30T12:31:44.938 INFO:tasks.rados.rados.0.smithi084.stdout:2688: finishing write tid 3 to smithi08477944-22 2024-03-30T12:31:44.938 INFO:tasks.rados.rados.0.smithi084.stdout:2688: finishing write tid 4 to smithi08477944-22 2024-03-30T12:31:44.938 INFO:tasks.rados.rados.0.smithi084.stdout:2688: finishing write tid 5 to smithi08477944-22 2024-03-30T12:31:44.938 INFO:tasks.rados.rados.0.smithi084.stdout:2688: oid 22 updating version 0 to 27273 2024-03-30T12:31:44.938 INFO:tasks.rados.rados.0.smithi084.stdout:2688: oid 22 updating version 27273 to 27276 2024-03-30T12:31:44.938 INFO:tasks.rados.rados.0.smithi084.stdout:2688: oid 22 version 27276 is already newer than 27275 2024-03-30T12:31:44.938 INFO:tasks.rados.rados.0.smithi084.stdout:2688: oid 22 version 27276 is already newer than 27274 2024-03-30T12:31:44.939 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 27276 (ObjNum 826 snap 273 seq_num 826) dirty exists 2024-03-30T12:31:44.939 INFO:tasks.rados.rados.0.smithi084.stdout:2688: left oid 22 (ObjNum 826 snap 273 seq_num 826) 2024-03-30T12:31:44.939 INFO:tasks.rados.rados.0.smithi084.stdout:2690: expect (ObjNum 733 snap 244 seq_num 733) 2024-03-30T12:31:44.986 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:44.749+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:44.986 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:44.751+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:44.987 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:44.902+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:44.987 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:44.902+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:44.987 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:44.902+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:44.987 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:44.902+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:44.987 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:44.902+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:44.987 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:44.908+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:45.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:44.744+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:45.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:44.892+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:45.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:44.892+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:45.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:44.898+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:45.122 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:44.797+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:45.122 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:44.818+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:45.122 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:44.745+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:45.122 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:44.746+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:45.123 INFO:tasks.rados.rados.0.smithi084.stdout:2691: finishing write tid 1 to smithi08477944-16 2024-03-30T12:31:45.123 INFO:tasks.rados.rados.0.smithi084.stdout:2688: done (4 left) 2024-03-30T12:31:45.123 INFO:tasks.rados.rados.0.smithi084.stdout:2690: done (3 left) 2024-03-30T12:31:45.123 INFO:tasks.rados.rados.0.smithi084.stdout:2694: snap_remove snap 260 2024-03-30T12:31:45.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:45.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:45.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:45.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:45.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:45.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:45.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:31:45.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[91810]: pgmap v609: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 696 MiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 5.5 MiB/s rd, 2.5 MiB/s wr, 14 op/s 2024-03-30T12:31:45.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:45.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[91810]: osdmap e615: 8 total, 8 up, 8 in 2024-03-30T12:31:45.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:45.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:45.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:45.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:45.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:45.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:45.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:45.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:31:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[89279]: pgmap v609: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 696 MiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 5.5 MiB/s rd, 2.5 MiB/s wr, 14 op/s 2024-03-30T12:31:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[89279]: osdmap e615: 8 total, 8 up, 8 in 2024-03-30T12:31:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:45.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:45.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:45.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:45.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:45.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:45.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:45.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:31:45.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:45 smithi162 ceph-mon[83709]: pgmap v609: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 696 MiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 5.5 MiB/s rd, 2.5 MiB/s wr, 14 op/s 2024-03-30T12:31:45.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:45.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:45 smithi162 ceph-mon[83709]: osdmap e615: 8 total, 8 up, 8 in 2024-03-30T12:31:45.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:45.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:45.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:45.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:45.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:45.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:45.741 INFO:tasks.rados.rados.0.smithi084.stdout:2694: done (3 left) 2024-03-30T12:31:45.742 INFO:tasks.rados.rados.0.smithi084.stdout:2695: rmattr oid 12 current snap is 273 2024-03-30T12:31:45.742 INFO:tasks.rados.rados.0.smithi084.stdout:2691: finishing write tid 2 to smithi08477944-16 2024-03-30T12:31:45.742 INFO:tasks.rados.rados.0.smithi084.stdout:2696: setattr oid 27 current snap is 273 2024-03-30T12:31:45.742 INFO:tasks.rados.rados.0.smithi084.stdout:2691: finishing write tid 3 to smithi08477944-16 2024-03-30T12:31:45.742 INFO:tasks.rados.rados.0.smithi084.stdout:2691: finishing write tid 4 to smithi08477944-16 2024-03-30T12:31:45.742 INFO:tasks.rados.rados.0.smithi084.stdout:2691: finishing write tid 5 to smithi08477944-16 2024-03-30T12:31:45.742 INFO:tasks.rados.rados.0.smithi084.stdout:2691: oid 16 updating version 0 to 23394 2024-03-30T12:31:45.743 INFO:tasks.rados.rados.0.smithi084.stdout:2691: oid 16 updating version 23394 to 23395 2024-03-30T12:31:45.743 INFO:tasks.rados.rados.0.smithi084.stdout:2691: oid 16 updating version 23395 to 23397 2024-03-30T12:31:45.743 INFO:tasks.rados.rados.0.smithi084.stdout:2691: oid 16 version 23397 is already newer than 23396 2024-03-30T12:31:45.743 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 23397 (ObjNum 828 snap 273 seq_num 828) dirty exists 2024-03-30T12:31:45.743 INFO:tasks.rados.rados.0.smithi084.stdout:2691: left oid 16 (ObjNum 828 snap 273 seq_num 828) 2024-03-30T12:31:45.743 INFO:tasks.rados.rados.0.smithi084.stdout:2692: finishing write tid 1 to smithi08477944-47 2024-03-30T12:31:45.743 INFO:tasks.rados.rados.0.smithi084.stdout:2692: finishing write tid 2 to smithi08477944-47 2024-03-30T12:31:45.743 INFO:tasks.rados.rados.0.smithi084.stdout:2692: finishing write tid 3 to smithi08477944-47 2024-03-30T12:31:45.743 INFO:tasks.rados.rados.0.smithi084.stdout:2692: finishing write tid 4 to smithi08477944-47 2024-03-30T12:31:45.743 INFO:tasks.rados.rados.0.smithi084.stdout:2692: finishing write tid 5 to smithi08477944-47 2024-03-30T12:31:45.743 INFO:tasks.rados.rados.0.smithi084.stdout:2692: oid 47 updating version 0 to 23417 2024-03-30T12:31:45.743 INFO:tasks.rados.rados.0.smithi084.stdout:2692: oid 47 updating version 23417 to 23420 2024-03-30T12:31:45.743 INFO:tasks.rados.rados.0.smithi084.stdout:2692: oid 47 version 23420 is already newer than 23418 2024-03-30T12:31:45.743 INFO:tasks.rados.rados.0.smithi084.stdout:2692: oid 47 version 23420 is already newer than 23419 2024-03-30T12:31:45.743 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 23420 (ObjNum 829 snap 273 seq_num 829) dirty exists 2024-03-30T12:31:45.743 INFO:tasks.rados.rados.0.smithi084.stdout:2692: left oid 47 (ObjNum 829 snap 273 seq_num 829) 2024-03-30T12:31:45.744 INFO:tasks.rados.rados.0.smithi084.stdout:2693: finishing copy_from racing read to smithi08477944-5 2024-03-30T12:31:45.744 INFO:tasks.rados.rados.0.smithi084.stdout:2693: finishing copy_from to smithi08477944-5 2024-03-30T12:31:45.744 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 973 (ObjNum 664 snap 232 seq_num 664) dirty exists 2024-03-30T12:31:45.744 INFO:tasks.rados.rados.0.smithi084.stdout:2691: done (4 left) 2024-03-30T12:31:45.744 INFO:tasks.rados.rados.0.smithi084.stdout:2692: done (3 left) 2024-03-30T12:31:45.744 INFO:tasks.rados.rados.0.smithi084.stdout:2693: done (2 left) 2024-03-30T12:31:45.744 INFO:tasks.rados.rados.0.smithi084.stdout:2697: read oid 36 snap -1 2024-03-30T12:31:45.744 INFO:tasks.rados.rados.0.smithi084.stdout:2697: expect (ObjNum 821 snap 272 seq_num 821) 2024-03-30T12:31:45.744 INFO:tasks.rados.rados.0.smithi084.stdout:2698: snap_remove snap 264 2024-03-30T12:31:46.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:45.755+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:46.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:45.757+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:46.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:45.748+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:46.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:45.748+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:46.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:45.748+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:46.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:45.748+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:46.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:45.748+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:46.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:45.754+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:46.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:45.744+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:46.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:45.745+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:46.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:45.749+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:46.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:45.749+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:46.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:45.752+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:46.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:45.752+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:46.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:45.752+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:46.497 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:46.497 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:46.497 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:46.497 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:46.497 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:46.497 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:46.498 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[91810]: osdmap e616: 8 total, 8 up, 8 in 2024-03-30T12:31:46.498 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:46.498 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:46.498 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:46.498 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:46.498 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:46.498 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:46.498 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:46.498 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:46.498 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:46.498 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:46.499 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:46.499 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:46.499 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:46.499 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[89279]: osdmap e616: 8 total, 8 up, 8 in 2024-03-30T12:31:46.499 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:46.499 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:46.499 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:46.499 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:46.499 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:46.499 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:46.499 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:46.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:46.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:46.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:46.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:46.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:46.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:46.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:46 smithi162 ceph-mon[83709]: osdmap e616: 8 total, 8 up, 8 in 2024-03-30T12:31:46.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:46.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:46.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:46.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:46.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:46.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:46.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:46.738 INFO:tasks.rados.rados.0.smithi084.stdout:2698: done (3 left) 2024-03-30T12:31:46.738 INFO:tasks.rados.rados.0.smithi084.stdout:2699: snap_remove snap 258 2024-03-30T12:31:46.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:46.751+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:46.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:46.751+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:46.753 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:46 smithi084 systemd[1]: Stopping Ceph alertmanager.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:31:46.754 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[73215]: ts=2024-03-30T12:31:46.724Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-03-30T12:31:46.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:46.745+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:46.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:46.745+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:46.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:46.745+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:46.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:46.745+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:46.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:46.745+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:46.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:46.745+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:47.048 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:46 smithi084 podman[124848]: 2024-03-30 12:31:46.766427176 +0000 UTC m=+0.120109155 container died 6765ce007f39388c4f91fccbe653cef958819434171420ca39a2fbb3767904ee (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T12:31:47.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:46.752+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:47.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:46.746+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:47.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:46.747+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:47.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:46.747+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:47.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:46.746+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:47.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:46.746+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:47.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:46.750+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:47.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:46.750+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:47.316 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:47 smithi084 podman[124848]: 2024-03-30 12:31:47.05815505 +0000 UTC m=+0.411837031 container cleanup 6765ce007f39388c4f91fccbe653cef958819434171420ca39a2fbb3767904ee (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T12:31:47.317 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:47 smithi084 bash[124848]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a 2024-03-30T12:31:47.317 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:47.317 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:47.317 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:47.317 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:47.317 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:47.317 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:47.318 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[91810]: pgmap v612: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 708 MiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 6.8 MiB/s rd, 5.0 MiB/s wr, 28 op/s 2024-03-30T12:31:47.318 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:47.318 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:47.318 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:47.318 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:47.318 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[91810]: osdmap e617: 8 total, 8 up, 8 in 2024-03-30T12:31:47.318 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:47.318 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:47.318 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:47.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:47.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:47.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:47.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:47.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:47.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:47.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[89279]: pgmap v612: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 708 MiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 6.8 MiB/s rd, 5.0 MiB/s wr, 28 op/s 2024-03-30T12:31:47.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:47.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:47.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:47.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:47.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[89279]: osdmap e617: 8 total, 8 up, 8 in 2024-03-30T12:31:47.320 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:47.320 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:47.320 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:47.604 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:47 smithi084 podman[124860]: 2024-03-30 12:31:47.326159952 +0000 UTC m=+0.562807633 container remove 6765ce007f39388c4f91fccbe653cef958819434171420ca39a2fbb3767904ee (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T12:31:47.604 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:47 smithi084 podman[124860]: 2024-03-30 12:31:47.435659064 +0000 UTC m=+0.672306744 volume remove 6477db064958914da150e6d24f901e90f5de3259639eb4a41d8395880a60e69f 2024-03-30T12:31:47.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:47.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:47.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:47.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:47.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:47.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:47.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:47 smithi162 ceph-mon[83709]: pgmap v612: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 708 MiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 6.8 MiB/s rd, 5.0 MiB/s wr, 28 op/s 2024-03-30T12:31:47.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:47.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:47.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:47.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:47.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:47 smithi162 ceph-mon[83709]: osdmap e617: 8 total, 8 up, 8 in 2024-03-30T12:31:47.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:47.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:47.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:47.740 INFO:tasks.rados.rados.0.smithi084.stdout:2699: done (3 left) 2024-03-30T12:31:47.740 INFO:tasks.rados.rados.0.smithi084.stdout:2700: copy_from oid 1 from oid 29 current snap is 273 2024-03-30T12:31:47.740 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 27208 (ObjNum 757 snap 253 seq_num 757) dirty exists 2024-03-30T12:31:47.740 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 27209 (ObjNum 65 snap 0 seq_num 1394492240) dirty exists 2024-03-30T12:31:47.740 INFO:tasks.rados.rados.0.smithi084.stdout:2697: expect (ObjNum 821 snap 272 seq_num 821) 2024-03-30T12:31:47.792 INFO:tasks.rados.rados.0.smithi084.stdout:2700: finishing copy_from racing read to smithi08477944-1 2024-03-30T12:31:47.792 INFO:tasks.rados.rados.0.smithi084.stdout:2700: finishing copy_from to smithi08477944-1 2024-03-30T12:31:47.792 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 23384 (ObjNum 779 snap 260 seq_num 779) dirty exists 2024-03-30T12:31:47.792 INFO:tasks.rados.rados.0.smithi084.stdout:2695: done (3 left) 2024-03-30T12:31:47.792 INFO:tasks.rados.rados.0.smithi084.stdout:2696: done (2 left) 2024-03-30T12:31:47.792 INFO:tasks.rados.rados.0.smithi084.stdout:2697: done (1 left) 2024-03-30T12:31:47.792 INFO:tasks.rados.rados.0.smithi084.stdout:2700: done (0 left) 2024-03-30T12:31:47.792 INFO:tasks.rados.rados.0.smithi084.stdout:2701: setattr oid 40 current snap is 273 2024-03-30T12:31:47.793 INFO:tasks.rados.rados.0.smithi084.stdout:2702: snap_remove snap 270 2024-03-30T12:31:48.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:47.755+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:48.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:47.757+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:48.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:47.754+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:48.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:47.756+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:48.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:47.758+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:48.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:47.758+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:48.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:47.758+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:48.005 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:47 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@alertmanager.a.service: Deactivated successfully. 2024-03-30T12:31:48.005 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:47 smithi084 systemd[1]: Stopped Ceph alertmanager.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:31:48.005 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:47 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@alertmanager.a.service: Consumed 1.436s CPU time. 2024-03-30T12:31:48.005 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:47 smithi084 systemd[1]: Starting Ceph alertmanager.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:31:48.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:47.852+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:48.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:47.751+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:48.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:47.751+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:48.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:47.749+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:48.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:47.749+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:48.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:47.749+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:48.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:47.750+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:48.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:47.751+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:48.359 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:48 smithi084 podman[124993]: 2024-03-30 12:31:47.951790974 +0000 UTC m=+0.018120180 image pull c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19 quay.io/prometheus/alertmanager:v0.25.0 2024-03-30T12:31:48.359 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:48 smithi084 podman[124993]: 2024-03-30 12:31:48.055900232 +0000 UTC m=+0.122229465 volume create 9346ee16342f86f5e3272b5376cc2de14f766ae756352697426bc0a38b2e5551 2024-03-30T12:31:48.359 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:48 smithi084 podman[124993]: 2024-03-30 12:31:48.145129622 +0000 UTC m=+0.211458856 container create d373ca331553e865c582de611c7fb0754a3752d1220313046191d868ad2456ee (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T12:31:48.359 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:48.359 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:48.359 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:48.359 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:48.359 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:48.360 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:48.360 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[91810]: osdmap e618: 8 total, 8 up, 8 in 2024-03-30T12:31:48.360 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:48.360 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:48.360 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:48.360 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:48.360 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:48.360 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:48.360 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:48.360 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:48.360 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:48.360 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:48.360 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:48.361 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:48.361 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:48.361 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[89279]: osdmap e618: 8 total, 8 up, 8 in 2024-03-30T12:31:48.361 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:48.361 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:48.361 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:48.361 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:48.361 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:48.361 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:48.361 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:48.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:48.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:48.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:48.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:48.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:48.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:48.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:48 smithi162 ceph-mon[83709]: osdmap e618: 8 total, 8 up, 8 in 2024-03-30T12:31:48.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:48.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:48.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:48.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:48.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:48.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:48.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:48.741 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:48 smithi084 podman[124993]: 2024-03-30 12:31:48.506501068 +0000 UTC m=+0.572830257 container init d373ca331553e865c582de611c7fb0754a3752d1220313046191d868ad2456ee (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T12:31:48.741 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:48 smithi084 podman[124993]: 2024-03-30 12:31:48.508971948 +0000 UTC m=+0.575301142 container start d373ca331553e865c582de611c7fb0754a3752d1220313046191d868ad2456ee (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T12:31:48.741 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:31:48.520Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-03-30T12:31:48.741 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:31:48.520Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-03-30T12:31:48.741 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:31:48.521Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.84 port=9094 2024-03-30T12:31:48.741 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:31:48.522Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-03-30T12:31:48.742 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:31:48.546Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-30T12:31:48.742 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:31:48.546Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-30T12:31:48.742 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:31:48.548Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-03-30T12:31:48.742 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:31:48.548Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-03-30T12:31:48.742 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:48 smithi084 bash[124993]: d373ca331553e865c582de611c7fb0754a3752d1220313046191d868ad2456ee 2024-03-30T12:31:48.742 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:48 smithi084 systemd[1]: Started Ceph alertmanager.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:31:48.745 INFO:tasks.rados.rados.0.smithi084.stdout:2702: done (1 left) 2024-03-30T12:31:48.745 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 273 2024-03-30T12:31:48.745 INFO:tasks.rados.rados.0.smithi084.stdout:2703: seq_num 830 ranges {0=704512,704512=614400,1318912=573440,1892352=16384} 2024-03-30T12:31:48.748 INFO:tasks.rados.rados.0.smithi084.stdout:2703: writing smithi08477944-23 from 0 to 704512 tid 1 2024-03-30T12:31:48.752 INFO:tasks.rados.rados.0.smithi084.stdout:2703: writing smithi08477944-23 from 704512 to 1318912 tid 2 2024-03-30T12:31:48.757 INFO:tasks.rados.rados.0.smithi084.stdout:2703: writing smithi08477944-23 from 1318912 to 1892352 tid 3 2024-03-30T12:31:48.757 INFO:tasks.rados.rados.0.smithi084.stdout:2703: writing smithi08477944-23 from 1892352 to 1908736 tid 4 2024-03-30T12:31:48.757 INFO:tasks.rados.rados.0.smithi084.stdout:2704: rollback oid 31 current snap is 273 2024-03-30T12:31:48.757 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 31 to 272 2024-03-30T12:31:48.757 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 23421 (ObjNum 810 snap 270 seq_num 810) dirty exists 2024-03-30T12:31:48.757 INFO:tasks.rados.rados.0.smithi084.stdout:2703: finishing write tid 1 to smithi08477944-23 2024-03-30T12:31:48.757 INFO:tasks.rados.rados.0.smithi084.stdout:2703: finishing write tid 2 to smithi08477944-23 2024-03-30T12:31:48.757 INFO:tasks.rados.rados.0.smithi084.stdout:2701: done (2 left) 2024-03-30T12:31:48.757 INFO:tasks.rados.rados.0.smithi084.stdout:2705: snap_remove snap 269 2024-03-30T12:31:49.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:48.754+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:49.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:48.754+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:49.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:48.749+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:49.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:48.749+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:49.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:48.749+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:49.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:48.749+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:49.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:48.749+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:49.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:48.749+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:49.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:48.782+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:49.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:48.753+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:49.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:48.753+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:49.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:48.783+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:49.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:48.783+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:49.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:48.749+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:49.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:48.749+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:49.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:48.749+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:49.295 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:49.295 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:49.295 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:49.295 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:49.295 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:49.295 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:49.295 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:49.295 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:49.295 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:31:49.295 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[91810]: pgmap v615: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 714 MiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 7.3 MiB/s rd, 4.5 MiB/s wr, 31 op/s 2024-03-30T12:31:49.295 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:49.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:49.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:49.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:49.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[91810]: osdmap e619: 8 total, 8 up, 8 in 2024-03-30T12:31:49.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:49.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:49.296 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:49.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:49.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:49.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:49.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:49.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:49.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:49.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:49.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:49.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:31:49.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[89279]: pgmap v615: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 714 MiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 7.3 MiB/s rd, 4.5 MiB/s wr, 31 op/s 2024-03-30T12:31:49.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:49.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:49.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:49.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:49.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[89279]: osdmap e619: 8 total, 8 up, 8 in 2024-03-30T12:31:49.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:49.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:49.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:49.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:49.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:49.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:49.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:49.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:49.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:49.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:49.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:49.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:31:49.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-mon[83709]: pgmap v615: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 714 MiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 7.3 MiB/s rd, 4.5 MiB/s wr, 31 op/s 2024-03-30T12:31:49.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:49.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:49.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:49.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:49.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-mon[83709]: osdmap e619: 8 total, 8 up, 8 in 2024-03-30T12:31:49.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:49.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:49.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:49.649 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:31:49] "GET /metrics HTTP/1.1" 200 36328 "" "Prometheus/2.43.0" 2024-03-30T12:31:49.742 INFO:tasks.rados.rados.0.smithi084.stdout:2705: done (2 left) 2024-03-30T12:31:49.743 INFO:tasks.rados.rados.0.smithi084.stdout:2706: delete oid 16 current snap is 273 2024-03-30T12:31:49.743 INFO:tasks.rados.rados.0.smithi084.stdout:2703: finishing write tid 3 to smithi08477944-23 2024-03-30T12:31:49.743 INFO:tasks.rados.rados.0.smithi084.stdout:2704: finishing rollback tid 0 to smithi08477944-31 2024-03-30T12:31:49.743 INFO:tasks.rados.rados.0.smithi084.stdout:2703: finishing write tid 4 to smithi08477944-23 2024-03-30T12:31:49.743 INFO:tasks.rados.rados.0.smithi084.stdout:2704: finishing rollback tid 1 to smithi08477944-31 2024-03-30T12:31:49.743 INFO:tasks.rados.rados.0.smithi084.stdout:2703: finishing write tid 5 to smithi08477944-23 2024-03-30T12:31:49.743 INFO:tasks.rados.rados.0.smithi084.stdout:2704: finishing rollback tid 2 to smithi08477944-31 2024-03-30T12:31:49.743 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 23388 (ObjNum 145 snap 0 seq_num 1430145952) dirty exists 2024-03-30T12:31:49.743 INFO:tasks.rados.rados.0.smithi084.stdout:2703: finishing write tid 6 to smithi08477944-23 2024-03-30T12:31:49.743 INFO:tasks.rados.rados.0.smithi084.stdout:2703: oid 23 updating version 0 to 27265 2024-03-30T12:31:49.743 INFO:tasks.rados.rados.0.smithi084.stdout:2703: oid 23 updating version 27265 to 27266 2024-03-30T12:31:49.743 INFO:tasks.rados.rados.0.smithi084.stdout:2703: oid 23 version 27266 is already newer than 27262 2024-03-30T12:31:49.744 INFO:tasks.rados.rados.0.smithi084.stdout:2703: oid 23 version 27266 is already newer than 27263 2024-03-30T12:31:49.744 INFO:tasks.rados.rados.0.smithi084.stdout:2703: oid 23 version 27266 is already newer than 27264 2024-03-30T12:31:49.744 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 27266 (ObjNum 830 snap 273 seq_num 830) dirty exists 2024-03-30T12:31:49.744 INFO:tasks.rados.rados.0.smithi084.stdout:2703: left oid 23 (ObjNum 830 snap 273 seq_num 830) 2024-03-30T12:31:49.750 INFO:tasks.rados.rados.0.smithi084.stdout:2703: done (2 left) 2024-03-30T12:31:49.750 INFO:tasks.rados.rados.0.smithi084.stdout:2704: done (1 left) 2024-03-30T12:31:49.750 INFO:tasks.rados.rados.0.smithi084.stdout:2706: done (0 left) 2024-03-30T12:31:49.750 INFO:tasks.rados.rados.0.smithi084.stdout:2707: copy_from oid 47 from oid 41 current snap is 273 2024-03-30T12:31:49.750 INFO:tasks.rados.rados.0.smithi084.stdout:2708: delete oid 4 current snap is 273 2024-03-30T12:31:49.752 INFO:tasks.rados.rados.0.smithi084.stdout:2708: done (1 left) 2024-03-30T12:31:49.753 INFO:tasks.rados.rados.0.smithi084.stdout:2709: copy_from oid 34 from oid 31 current snap is 273 2024-03-30T12:31:49.753 INFO:tasks.rados.rados.0.smithi084.stdout:2710: copy_from oid 35 from oid 6 current snap is 273 2024-03-30T12:31:49.753 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 273 2024-03-30T12:31:49.753 INFO:tasks.rados.rados.0.smithi084.stdout:2711: seq_num 833 ranges {745472=761856,1507328=671744,2179072=532480} 2024-03-30T12:31:49.761 INFO:tasks.rados.rados.0.smithi084.stdout:2711: writing smithi08477944-37 from 745472 to 1507328 tid 1 2024-03-30T12:31:49.766 INFO:tasks.rados.rados.0.smithi084.stdout:2711: writing smithi08477944-37 from 1507328 to 2179072 tid 2 2024-03-30T12:31:49.770 INFO:tasks.rados.rados.0.smithi084.stdout:2711: writing smithi08477944-37 from 2179072 to 2711552 tid 3 2024-03-30T12:31:49.770 INFO:tasks.rados.rados.0.smithi084.stdout:2712: rollback oid 38 current snap is 273 2024-03-30T12:31:49.770 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 38 to 272 2024-03-30T12:31:49.770 INFO:tasks.rados.rados.0.smithi084.stdout:2709: finishing copy_from racing read to smithi08477944-34 2024-03-30T12:31:49.770 INFO:tasks.rados.rados.0.smithi084.stdout:2709: finishing copy_from to smithi08477944-34 2024-03-30T12:31:49.770 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 23388 (ObjNum 1953 snap 0 seq_num 1429550960) dirty exists 2024-03-30T12:31:49.770 INFO:tasks.rados.rados.0.smithi084.stdout:2710: finishing copy_from racing read to smithi08477944-35 2024-03-30T12:31:49.770 INFO:tasks.rados.rados.0.smithi084.stdout:2710: finishing copy_from to smithi08477944-35 2024-03-30T12:31:49.770 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 973 (ObjNum 664 snap 232 seq_num 664) dirty exists 2024-03-30T12:31:49.770 INFO:tasks.rados.rados.0.smithi084.stdout:2707: finishing copy_from racing read to smithi08477944-47 2024-03-30T12:31:49.771 INFO:tasks.rados.rados.0.smithi084.stdout:2707: finishing copy_from to smithi08477944-47 2024-03-30T12:31:49.771 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 986 (ObjNum 688 snap 241 seq_num 688) dirty exists 2024-03-30T12:31:49.771 INFO:tasks.rados.rados.0.smithi084.stdout:2707: done (4 left) 2024-03-30T12:31:49.771 INFO:tasks.rados.rados.0.smithi084.stdout:2709: done (3 left) 2024-03-30T12:31:49.771 INFO:tasks.rados.rados.0.smithi084.stdout:2710: done (2 left) 2024-03-30T12:31:49.771 INFO:tasks.rados.rados.0.smithi084.stdout:2713: delete oid 43 current snap is 273 2024-03-30T12:31:49.771 INFO:tasks.rados.rados.0.smithi084.stdout:2712: finishing rollback tid 1 to smithi08477944-38 2024-03-30T12:31:49.771 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 1035 (ObjNum 177 snap 0 seq_num 0) dirty dne 2024-03-30T12:31:49.776 INFO:tasks.rados.rados.0.smithi084.stdout:2712: done (2 left) 2024-03-30T12:31:49.776 INFO:tasks.rados.rados.0.smithi084.stdout:2713: done (1 left) 2024-03-30T12:31:49.776 INFO:tasks.rados.rados.0.smithi084.stdout:2714: copy_from oid 38 from oid 22 current snap is 273 2024-03-30T12:31:49.776 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 273 2024-03-30T12:31:49.776 INFO:tasks.rados.rados.0.smithi084.stdout:2715: seq_num 835 ranges {1761280=794624,2555904=442368,2998272=712704,3710976=49152} 2024-03-30T12:31:49.791 INFO:tasks.rados.rados.0.smithi084.stdout:2715: writing smithi08477944-36 from 1761280 to 2555904 tid 1 2024-03-30T12:31:49.794 INFO:tasks.rados.rados.0.smithi084.stdout:2715: writing smithi08477944-36 from 2555904 to 2998272 tid 2 2024-03-30T12:31:49.799 INFO:tasks.rados.rados.0.smithi084.stdout:2715: writing smithi08477944-36 from 2998272 to 3710976 tid 3 2024-03-30T12:31:49.799 INFO:tasks.rados.rados.0.smithi084.stdout:2715: writing smithi08477944-36 from 3710976 to 3760128 tid 4 2024-03-30T12:31:49.799 INFO:tasks.rados.rados.0.smithi084.stdout:2716: rollback oid 24 current snap is 273 2024-03-30T12:31:49.799 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 24 to 272 2024-03-30T12:31:49.800 INFO:tasks.rados.rados.0.smithi084.stdout:2711: finishing write tid 1 to smithi08477944-37 2024-03-30T12:31:49.800 INFO:tasks.rados.rados.0.smithi084.stdout:2711: finishing write tid 2 to smithi08477944-37 2024-03-30T12:31:49.800 INFO:tasks.rados.rados.0.smithi084.stdout:2711: finishing write tid 3 to smithi08477944-37 2024-03-30T12:31:49.800 INFO:tasks.rados.rados.0.smithi084.stdout:2711: finishing write tid 4 to smithi08477944-37 2024-03-30T12:31:49.800 INFO:tasks.rados.rados.0.smithi084.stdout:2711: finishing write tid 5 to smithi08477944-37 2024-03-30T12:31:49.800 INFO:tasks.rados.rados.0.smithi084.stdout:2711: oid 37 updating version 0 to 36253 2024-03-30T12:31:49.800 INFO:tasks.rados.rados.0.smithi084.stdout:2711: oid 37 version 36253 is already newer than 36251 2024-03-30T12:31:49.800 INFO:tasks.rados.rados.0.smithi084.stdout:2711: oid 37 updating version 36253 to 36254 2024-03-30T12:31:49.800 INFO:tasks.rados.rados.0.smithi084.stdout:2711: oid 37 version 36254 is already newer than 36252 2024-03-30T12:31:49.800 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 36254 (ObjNum 833 snap 273 seq_num 833) dirty exists 2024-03-30T12:31:49.800 INFO:tasks.rados.rados.0.smithi084.stdout:2711: left oid 37 (ObjNum 833 snap 273 seq_num 833) 2024-03-30T12:31:49.800 INFO:tasks.rados.rados.0.smithi084.stdout:2715: finishing write tid 1 to smithi08477944-36 2024-03-30T12:31:49.800 INFO:tasks.rados.rados.0.smithi084.stdout:2715: finishing write tid 2 to smithi08477944-36 2024-03-30T12:31:49.800 INFO:tasks.rados.rados.0.smithi084.stdout:2711: done (3 left) 2024-03-30T12:31:49.800 INFO:tasks.rados.rados.0.smithi084.stdout:2717: rollback oid 23 current snap is 273 2024-03-30T12:31:49.801 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 23 to 272 2024-03-30T12:31:49.801 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 273 2024-03-30T12:31:49.801 INFO:tasks.rados.rados.0.smithi084.stdout:2718: seq_num 836 ranges {3997696=409600,4407296=720896,5128192=516096,5644288=368640} 2024-03-30T12:31:49.824 INFO:tasks.rados.rados.0.smithi084.stdout:2718: writing smithi08477944-29 from 3997696 to 4407296 tid 1 2024-03-30T12:31:49.828 INFO:tasks.rados.rados.0.smithi084.stdout:2718: writing smithi08477944-29 from 4407296 to 5128192 tid 2 2024-03-30T12:31:49.831 INFO:tasks.rados.rados.0.smithi084.stdout:2718: writing smithi08477944-29 from 5128192 to 5644288 tid 3 2024-03-30T12:31:49.834 INFO:tasks.rados.rados.0.smithi084.stdout:2718: writing smithi08477944-29 from 5644288 to 6012928 tid 4 2024-03-30T12:31:49.834 INFO:tasks.rados.rados.0.smithi084.stdout:2719: delete oid 49 current snap is 273 2024-03-30T12:31:49.834 INFO:tasks.rados.rados.0.smithi084.stdout:2715: finishing write tid 3 to smithi08477944-36 2024-03-30T12:31:49.834 INFO:tasks.rados.rados.0.smithi084.stdout:2715: finishing write tid 4 to smithi08477944-36 2024-03-30T12:31:49.834 INFO:tasks.rados.rados.0.smithi084.stdout:2715: finishing write tid 5 to smithi08477944-36 2024-03-30T12:31:49.834 INFO:tasks.rados.rados.0.smithi084.stdout:2717: finishing rollback tid 0 to smithi08477944-23 2024-03-30T12:31:49.834 INFO:tasks.rados.rados.0.smithi084.stdout:2716: finishing rollback tid 0 to smithi08477944-24 2024-03-30T12:31:49.834 INFO:tasks.rados.rados.0.smithi084.stdout:2715: finishing write tid 6 to smithi08477944-36 2024-03-30T12:31:49.834 INFO:tasks.rados.rados.0.smithi084.stdout:2715: oid 36 updating version 0 to 27268 2024-03-30T12:31:49.835 INFO:tasks.rados.rados.0.smithi084.stdout:2715: oid 36 version 27268 is already newer than 27267 2024-03-30T12:31:49.835 INFO:tasks.rados.rados.0.smithi084.stdout:2715: oid 36 updating version 27268 to 27270 2024-03-30T12:31:49.835 INFO:tasks.rados.rados.0.smithi084.stdout:2715: oid 36 updating version 27270 to 27271 2024-03-30T12:31:49.835 INFO:tasks.rados.rados.0.smithi084.stdout:2715: oid 36 version 27271 is already newer than 27269 2024-03-30T12:31:49.835 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 27271 (ObjNum 835 snap 273 seq_num 835) dirty exists 2024-03-30T12:31:49.835 INFO:tasks.rados.rados.0.smithi084.stdout:2715: left oid 36 (ObjNum 835 snap 273 seq_num 835) 2024-03-30T12:31:49.835 INFO:tasks.rados.rados.0.smithi084.stdout:2717: finishing rollback tid 1 to smithi08477944-23 2024-03-30T12:31:49.835 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 27273 (ObjNum 49 snap 0 seq_num 1428945472) dirty dne 2024-03-30T12:31:49.835 INFO:tasks.rados.rados.0.smithi084.stdout:2716: finishing rollback tid 1 to smithi08477944-24 2024-03-30T12:31:49.835 INFO:tasks.rados.rados.0.smithi084.stdout:2716: finishing rollback tid 2 to smithi08477944-24 2024-03-30T12:31:49.835 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 17558 (ObjNum 818 snap 272 seq_num 818) dirty exists 2024-03-30T12:31:49.835 INFO:tasks.rados.rados.0.smithi084.stdout:2718: finishing write tid 1 to smithi08477944-29 2024-03-30T12:31:49.835 INFO:tasks.rados.rados.0.smithi084.stdout:2718: finishing write tid 2 to smithi08477944-29 2024-03-30T12:31:49.837 INFO:tasks.rados.rados.0.smithi084.stdout:2715: done (5 left) 2024-03-30T12:31:49.837 INFO:tasks.rados.rados.0.smithi084.stdout:2716: done (4 left) 2024-03-30T12:31:49.837 INFO:tasks.rados.rados.0.smithi084.stdout:2717: done (3 left) 2024-03-30T12:31:49.837 INFO:tasks.rados.rados.0.smithi084.stdout:2719: done (2 left) 2024-03-30T12:31:49.837 INFO:tasks.rados.rados.0.smithi084.stdout:2720: read oid 36 snap -1 2024-03-30T12:31:49.837 INFO:tasks.rados.rados.0.smithi084.stdout:2720: expect (ObjNum 835 snap 273 seq_num 835) 2024-03-30T12:31:49.838 INFO:tasks.rados.rados.0.smithi084.stdout:2721: delete oid 8 current snap is 273 2024-03-30T12:31:49.838 INFO:tasks.rados.rados.0.smithi084.stdout:2718: finishing write tid 3 to smithi08477944-29 2024-03-30T12:31:49.838 INFO:tasks.rados.rados.0.smithi084.stdout:2718: finishing write tid 4 to smithi08477944-29 2024-03-30T12:31:49.839 INFO:tasks.rados.rados.0.smithi084.stdout:2718: finishing write tid 5 to smithi08477944-29 2024-03-30T12:31:49.842 INFO:tasks.rados.rados.0.smithi084.stdout:2718: finishing write tid 6 to smithi08477944-29 2024-03-30T12:31:49.842 INFO:tasks.rados.rados.0.smithi084.stdout:2718: oid 29 updating version 0 to 23392 2024-03-30T12:31:49.842 INFO:tasks.rados.rados.0.smithi084.stdout:2718: oid 29 updating version 23392 to 23393 2024-03-30T12:31:49.843 INFO:tasks.rados.rados.0.smithi084.stdout:2718: oid 29 updating version 23393 to 23394 2024-03-30T12:31:49.843 INFO:tasks.rados.rados.0.smithi084.stdout:2718: oid 29 version 23394 is already newer than 23390 2024-03-30T12:31:49.843 INFO:tasks.rados.rados.0.smithi084.stdout:2718: oid 29 version 23394 is already newer than 23391 2024-03-30T12:31:49.843 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 23394 (ObjNum 836 snap 273 seq_num 836) dirty exists 2024-03-30T12:31:49.843 INFO:tasks.rados.rados.0.smithi084.stdout:2718: left oid 29 (ObjNum 836 snap 273 seq_num 836) 2024-03-30T12:31:49.843 INFO:tasks.rados.rados.0.smithi084.stdout:2718: done (3 left) 2024-03-30T12:31:49.844 INFO:tasks.rados.rados.0.smithi084.stdout:2721: done (2 left) 2024-03-30T12:31:49.844 INFO:tasks.rados.rados.0.smithi084.stdout:2722: copy_from oid 14 from oid 29 current snap is 273 2024-03-30T12:31:49.844 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 273 2024-03-30T12:31:49.844 INFO:tasks.rados.rados.0.smithi084.stdout:2723: seq_num 839 ranges {0=458752,458752=425984,884736=688128,1572864=491520} 2024-03-30T12:31:49.846 INFO:tasks.rados.rados.0.smithi084.stdout:2723: writing smithi08477944-34 from 0 to 458752 tid 1 2024-03-30T12:31:49.849 INFO:tasks.rados.rados.0.smithi084.stdout:2723: writing smithi08477944-34 from 458752 to 884736 tid 2 2024-03-30T12:31:49.854 INFO:tasks.rados.rados.0.smithi084.stdout:2723: writing smithi08477944-34 from 884736 to 1572864 tid 3 2024-03-30T12:31:49.858 INFO:tasks.rados.rados.0.smithi084.stdout:2723: writing smithi08477944-34 from 1572864 to 2064384 tid 4 2024-03-30T12:31:49.858 INFO:tasks.rados.rados.0.smithi084.stdout:2724: read oid 3 snap -1 2024-03-30T12:31:49.858 INFO:tasks.rados.rados.0.smithi084.stdout:2724: expect deleted 2024-03-30T12:31:49.858 INFO:tasks.rados.rados.0.smithi084.stdout:2725: delete oid 48 current snap is 273 2024-03-30T12:31:49.858 INFO:tasks.rados.rados.0.smithi084.stdout:2714: finishing copy_from racing read to smithi08477944-38 2024-03-30T12:31:49.858 INFO:tasks.rados.rados.0.smithi084.stdout:2714: finishing copy_from to smithi08477944-38 2024-03-30T12:31:49.858 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 27276 (ObjNum 826 snap 273 seq_num 826) dirty exists 2024-03-30T12:31:49.858 INFO:tasks.rados.rados.0.smithi084.stdout:2720: expect (ObjNum 835 snap 273 seq_num 835) 2024-03-30T12:31:49.999 INFO:tasks.rados.rados.0.smithi084.stdout:2723: finishing write tid 1 to smithi08477944-34 2024-03-30T12:31:49.999 INFO:tasks.rados.rados.0.smithi084.stdout:2723: finishing write tid 2 to smithi08477944-34 2024-03-30T12:31:49.999 INFO:tasks.rados.rados.0.smithi084.stdout:2723: finishing write tid 3 to smithi08477944-34 2024-03-30T12:31:49.999 INFO:tasks.rados.rados.0.smithi084.stdout:2723: finishing write tid 4 to smithi08477944-34 2024-03-30T12:31:49.999 INFO:tasks.rados.rados.0.smithi084.stdout:2723: finishing write tid 5 to smithi08477944-34 2024-03-30T12:31:50.000 INFO:tasks.rados.rados.0.smithi084.stdout:2714: done (5 left) 2024-03-30T12:31:50.000 INFO:tasks.rados.rados.0.smithi084.stdout:2720: done (4 left) 2024-03-30T12:31:50.000 INFO:tasks.rados.rados.0.smithi084.stdout:2724: done (3 left) 2024-03-30T12:31:50.000 INFO:tasks.rados.rados.0.smithi084.stdout:2725: done (2 left) 2024-03-30T12:31:50.000 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 31 current snap is 273 2024-03-30T12:31:50.000 INFO:tasks.rados.rados.0.smithi084.stdout:2723: finishing write tid 6 to smithi08477944-34 2024-03-30T12:31:50.000 INFO:tasks.rados.rados.0.smithi084.stdout:2723: oid 34 updating version 0 to 27213 2024-03-30T12:31:50.000 INFO:tasks.rados.rados.0.smithi084.stdout:2723: oid 34 version 27213 is already newer than 27210 2024-03-30T12:31:50.000 INFO:tasks.rados.rados.0.smithi084.stdout:2723: oid 34 version 27213 is already newer than 27211 2024-03-30T12:31:50.000 INFO:tasks.rados.rados.0.smithi084.stdout:2723: oid 34 version 27213 is already newer than 27212 2024-03-30T12:31:50.000 INFO:tasks.rados.rados.0.smithi084.stdout:2723: oid 34 updating version 27213 to 27214 2024-03-30T12:31:50.000 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 27214 (ObjNum 839 snap 273 seq_num 839) dirty exists 2024-03-30T12:31:50.001 INFO:tasks.rados.rados.0.smithi084.stdout:2723: left oid 34 (ObjNum 839 snap 273 seq_num 839) 2024-03-30T12:31:50.001 INFO:tasks.rados.rados.0.smithi084.stdout:2722: finishing copy_from racing read to smithi08477944-14 2024-03-30T12:31:50.001 INFO:tasks.rados.rados.0.smithi084.stdout:2722: finishing copy_from to smithi08477944-14 2024-03-30T12:31:50.001 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 23394 (ObjNum 836 snap 273 seq_num 836) dirty exists 2024-03-30T12:31:50.001 INFO:tasks.rados.rados.0.smithi084.stdout:2726: seq_num 841 ranges {0=491520,491520=598016,1089536=704512,1794048=303104} 2024-03-30T12:31:50.001 INFO:tasks.rados.rados.0.smithi084.stdout:2726: writing smithi08477944-31 from 0 to 491520 tid 1 2024-03-30T12:31:50.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:49.756+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:50.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:49.756+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:50.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:49.749+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:50.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:49.749+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:50.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:49.751+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:50.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:49.751+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:50.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:49.751+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:50.005 INFO:tasks.rados.rados.0.smithi084.stdout:2726: writing smithi08477944-31 from 491520 to 1089536 tid 2 2024-03-30T12:31:50.009 INFO:tasks.rados.rados.0.smithi084.stdout:2726: writing smithi08477944-31 from 1089536 to 1794048 tid 3 2024-03-30T12:31:50.012 INFO:tasks.rados.rados.0.smithi084.stdout:2726: writing smithi08477944-31 from 1794048 to 2097152 tid 4 2024-03-30T12:31:50.012 INFO:tasks.rados.rados.0.smithi084.stdout:2722: done (2 left) 2024-03-30T12:31:50.012 INFO:tasks.rados.rados.0.smithi084.stdout:2723: done (1 left) 2024-03-30T12:31:50.012 INFO:tasks.rados.rados.0.smithi084.stdout:2727: rollback oid 13 current snap is 273 2024-03-30T12:31:50.012 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 13 to 267 2024-03-30T12:31:50.012 INFO:tasks.rados.rados.0.smithi084.stdout:2726: finishing write tid 1 to smithi08477944-31 2024-03-30T12:31:50.012 INFO:tasks.rados.rados.0.smithi084.stdout:2726: finishing write tid 2 to smithi08477944-31 2024-03-30T12:31:50.012 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 273 2024-03-30T12:31:50.012 INFO:tasks.rados.rados.0.smithi084.stdout:2728: seq_num 842 ranges {0=507904,507904=475136,983040=516096,1499136=499712,1998848=114688} 2024-03-30T12:31:50.014 INFO:tasks.rados.rados.0.smithi084.stdout:2728: writing smithi08477944-43 from 0 to 507904 tid 1 2024-03-30T12:31:50.017 INFO:tasks.rados.rados.0.smithi084.stdout:2728: writing smithi08477944-43 from 507904 to 983040 tid 2 2024-03-30T12:31:50.020 INFO:tasks.rados.rados.0.smithi084.stdout:2728: writing smithi08477944-43 from 983040 to 1499136 tid 3 2024-03-30T12:31:50.023 INFO:tasks.rados.rados.0.smithi084.stdout:2728: writing smithi08477944-43 from 1499136 to 1998848 tid 4 2024-03-30T12:31:50.024 INFO:tasks.rados.rados.0.smithi084.stdout:2728: writing smithi08477944-43 from 1998848 to 2113536 tid 5 2024-03-30T12:31:50.024 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 273 2024-03-30T12:31:50.024 INFO:tasks.rados.rados.0.smithi084.stdout:2726: finishing write tid 3 to smithi08477944-31 2024-03-30T12:31:50.024 INFO:tasks.rados.rados.0.smithi084.stdout:2729: seq_num 843 ranges {3891200=524288,4415488=761856,5177344=671744,5849088=172032} 2024-03-30T12:31:50.048 INFO:tasks.rados.rados.0.smithi084.stdout:2729: writing smithi08477944-40 from 3891200 to 4415488 tid 1 2024-03-30T12:31:50.053 INFO:tasks.rados.rados.0.smithi084.stdout:2729: writing smithi08477944-40 from 4415488 to 5177344 tid 2 2024-03-30T12:31:50.057 INFO:tasks.rados.rados.0.smithi084.stdout:2729: writing smithi08477944-40 from 5177344 to 5849088 tid 3 2024-03-30T12:31:50.059 INFO:tasks.rados.rados.0.smithi084.stdout:2729: writing smithi08477944-40 from 5849088 to 6021120 tid 4 2024-03-30T12:31:50.059 INFO:tasks.rados.rados.0.smithi084.stdout:2730: snap_create 2024-03-30T12:31:50.059 INFO:tasks.rados.rados.0.smithi084.stdout:2726: finishing write tid 4 to smithi08477944-31 2024-03-30T12:31:50.059 INFO:tasks.rados.rados.0.smithi084.stdout:2726: finishing write tid 5 to smithi08477944-31 2024-03-30T12:31:50.059 INFO:tasks.rados.rados.0.smithi084.stdout:2726: finishing write tid 6 to smithi08477944-31 2024-03-30T12:31:50.059 INFO:tasks.rados.rados.0.smithi084.stdout:2726: oid 31 updating version 0 to 23396 2024-03-30T12:31:50.059 INFO:tasks.rados.rados.0.smithi084.stdout:2726: oid 31 updating version 23396 to 23398 2024-03-30T12:31:50.059 INFO:tasks.rados.rados.0.smithi084.stdout:2726: oid 31 updating version 23398 to 23399 2024-03-30T12:31:50.059 INFO:tasks.rados.rados.0.smithi084.stdout:2726: oid 31 version 23399 is already newer than 23397 2024-03-30T12:31:50.060 INFO:tasks.rados.rados.0.smithi084.stdout:2726: oid 31 version 23399 is already newer than 23395 2024-03-30T12:31:50.060 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 23399 (ObjNum 841 snap 273 seq_num 841) dirty exists 2024-03-30T12:31:50.060 INFO:tasks.rados.rados.0.smithi084.stdout:2726: left oid 31 (ObjNum 841 snap 273 seq_num 841) 2024-03-30T12:31:50.060 INFO:tasks.rados.rados.0.smithi084.stdout:2727: finishing rollback tid 0 to smithi08477944-13 2024-03-30T12:31:50.060 INFO:tasks.rados.rados.0.smithi084.stdout:2727: finishing rollback tid 1 to smithi08477944-13 2024-03-30T12:31:50.060 INFO:tasks.rados.rados.0.smithi084.stdout:2728: finishing write tid 1 to smithi08477944-43 2024-03-30T12:31:50.060 INFO:tasks.rados.rados.0.smithi084.stdout:2727: finishing rollback tid 2 to smithi08477944-13 2024-03-30T12:31:50.060 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 17561 (ObjNum 779 snap 260 seq_num 779) dirty exists 2024-03-30T12:31:50.060 INFO:tasks.rados.rados.0.smithi084.stdout:2728: finishing write tid 2 to smithi08477944-43 2024-03-30T12:31:50.060 INFO:tasks.rados.rados.0.smithi084.stdout:2728: finishing write tid 3 to smithi08477944-43 2024-03-30T12:31:50.060 INFO:tasks.rados.rados.0.smithi084.stdout:2728: finishing write tid 4 to smithi08477944-43 2024-03-30T12:31:50.060 INFO:tasks.rados.rados.0.smithi084.stdout:2728: finishing write tid 5 to smithi08477944-43 2024-03-30T12:31:50.060 INFO:tasks.rados.rados.0.smithi084.stdout:2728: finishing write tid 6 to smithi08477944-43 2024-03-30T12:31:50.060 INFO:tasks.rados.rados.0.smithi084.stdout:2728: finishing write tid 7 to smithi08477944-43 2024-03-30T12:31:50.060 INFO:tasks.rados.rados.0.smithi084.stdout:2728: oid 43 updating version 0 to 36270 2024-03-30T12:31:50.060 INFO:tasks.rados.rados.0.smithi084.stdout:2728: oid 43 updating version 36270 to 36272 2024-03-30T12:31:50.061 INFO:tasks.rados.rados.0.smithi084.stdout:2728: oid 43 updating version 36272 to 36273 2024-03-30T12:31:50.061 INFO:tasks.rados.rados.0.smithi084.stdout:2728: oid 43 version 36273 is already newer than 36268 2024-03-30T12:31:50.061 INFO:tasks.rados.rados.0.smithi084.stdout:2728: oid 43 version 36273 is already newer than 36271 2024-03-30T12:31:50.061 INFO:tasks.rados.rados.0.smithi084.stdout:2728: oid 43 version 36273 is already newer than 36269 2024-03-30T12:31:50.061 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 36273 (ObjNum 842 snap 273 seq_num 842) dirty exists 2024-03-30T12:31:50.061 INFO:tasks.rados.rados.0.smithi084.stdout:2728: left oid 43 (ObjNum 842 snap 273 seq_num 842) 2024-03-30T12:31:50.061 INFO:tasks.rados.rados.0.smithi084.stdout:2729: finishing write tid 1 to smithi08477944-40 2024-03-30T12:31:50.061 INFO:tasks.rados.rados.0.smithi084.stdout:2729: finishing write tid 2 to smithi08477944-40 2024-03-30T12:31:50.063 INFO:tasks.rados.rados.0.smithi084.stdout:2729: finishing write tid 3 to smithi08477944-40 2024-03-30T12:31:50.063 INFO:tasks.rados.rados.0.smithi084.stdout:2729: finishing write tid 4 to smithi08477944-40 2024-03-30T12:31:50.063 INFO:tasks.rados.rados.0.smithi084.stdout:2729: finishing write tid 5 to smithi08477944-40 2024-03-30T12:31:50.065 INFO:tasks.rados.rados.0.smithi084.stdout:2729: finishing write tid 6 to smithi08477944-40 2024-03-30T12:31:50.065 INFO:tasks.rados.rados.0.smithi084.stdout:2729: oid 40 updating version 0 to 23423 2024-03-30T12:31:50.065 INFO:tasks.rados.rados.0.smithi084.stdout:2729: oid 40 version 23423 is already newer than 23422 2024-03-30T12:31:50.065 INFO:tasks.rados.rados.0.smithi084.stdout:2729: oid 40 updating version 23423 to 23424 2024-03-30T12:31:50.065 INFO:tasks.rados.rados.0.smithi084.stdout:2729: oid 40 updating version 23424 to 23425 2024-03-30T12:31:50.065 INFO:tasks.rados.rados.0.smithi084.stdout:2729: oid 40 updating version 23425 to 23426 2024-03-30T12:31:50.065 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 23426 (ObjNum 843 snap 273 seq_num 843) dirty exists 2024-03-30T12:31:50.065 INFO:tasks.rados.rados.0.smithi084.stdout:2729: left oid 40 (ObjNum 843 snap 273 seq_num 843) 2024-03-30T12:31:50.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:49.766+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:50.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:49.756+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:50.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:49.758+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:50.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:49.758+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:50.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:49.758+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:50.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:49.756+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:50.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:49.757+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:50.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:49.757+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:50.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:50.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:50.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:50.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:50.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:50.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:50.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:50.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[91810]: osdmap e620: 8 total, 8 up, 8 in 2024-03-30T12:31:50.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:50.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:50.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:50.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:50.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:50.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:50.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:50.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:50.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:50.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:50.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:50.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:50.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:50.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[89279]: osdmap e620: 8 total, 8 up, 8 in 2024-03-30T12:31:50.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:50.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:50.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:50.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:50.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:50.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:50.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:50.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:50.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:50.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:50.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:50.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:50.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:50.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:50 smithi162 ceph-mon[83709]: osdmap e620: 8 total, 8 up, 8 in 2024-03-30T12:31:50.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:50.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:50.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:50.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:50.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:50.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:50.748 INFO:tasks.rados.rados.0.smithi084.stdout:2726: done (4 left) 2024-03-30T12:31:50.748 INFO:tasks.rados.rados.0.smithi084.stdout:2727: done (3 left) 2024-03-30T12:31:50.748 INFO:tasks.rados.rados.0.smithi084.stdout:2728: done (2 left) 2024-03-30T12:31:50.748 INFO:tasks.rados.rados.0.smithi084.stdout:2729: done (1 left) 2024-03-30T12:31:50.748 INFO:tasks.rados.rados.0.smithi084.stdout:2730: done (0 left) 2024-03-30T12:31:50.748 INFO:tasks.rados.rados.0.smithi084.stdout:2731: delete oid 47 current snap is 274 2024-03-30T12:31:50.750 INFO:tasks.rados.rados.0.smithi084.stdout:2731: done (0 left) 2024-03-30T12:31:50.751 INFO:tasks.rados.rados.0.smithi084.stdout:2732: snap_create 2024-03-30T12:31:50.818 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:31:50.523Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.001063431s 2024-03-30T12:31:50.818 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:50.756+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:50.818 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:50.756+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:50.819 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:50.754+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:50.819 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:50.754+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:50.819 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:50.755+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:50.819 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:50.757+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:50.819 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:50.757+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:50.819 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:50.757+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:51.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:50.755+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:51.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:50.755+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:51.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:50.755+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:51.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:50.909+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:51.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:50.909+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:51.398 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:51.398 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:51.398 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:51.399 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:51.399 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:51.399 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:51.399 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[91810]: pgmap v618: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 719 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 6.1 MiB/s rd, 2.9 MiB/s wr, 27 op/s 2024-03-30T12:31:51.399 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[91810]: osdmap e621: 8 total, 8 up, 8 in 2024-03-30T12:31:51.399 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:51.399 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:51.399 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:51.399 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:51.399 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:51.399 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:51.400 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:51.400 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:51.400 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:51.400 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:51.400 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:51.400 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:51.400 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[89279]: pgmap v618: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 719 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 6.1 MiB/s rd, 2.9 MiB/s wr, 27 op/s 2024-03-30T12:31:51.400 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[89279]: osdmap e621: 8 total, 8 up, 8 in 2024-03-30T12:31:51.400 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:51.400 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:51.400 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:51.400 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:51.400 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:51.401 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:51.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:51 smithi162 ceph-mon[83709]: pgmap v618: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 719 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 6.1 MiB/s rd, 2.9 MiB/s wr, 27 op/s 2024-03-30T12:31:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:51 smithi162 ceph-mon[83709]: osdmap e621: 8 total, 8 up, 8 in 2024-03-30T12:31:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:51.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:51.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:51.747 INFO:tasks.rados.rados.0.smithi084.stdout:2732: done (0 left) 2024-03-30T12:31:51.747 INFO:tasks.rados.rados.0.smithi084.stdout:2733: read oid 39 snap -1 2024-03-30T12:31:51.747 INFO:tasks.rados.rados.0.smithi084.stdout:2733: expect (ObjNum 785 snap 262 seq_num 785) 2024-03-30T12:31:51.748 INFO:tasks.rados.rados.0.smithi084.stdout:2734: delete oid 37 current snap is 275 2024-03-30T12:31:51.755 INFO:tasks.rados.rados.0.smithi084.stdout:2734: done (1 left) 2024-03-30T12:31:51.755 INFO:tasks.rados.rados.0.smithi084.stdout:2735: setattr oid 25 current snap is 275 2024-03-30T12:31:51.756 INFO:tasks.rados.rados.0.smithi084.stdout:2736: rollback oid 23 current snap is 275 2024-03-30T12:31:51.756 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 23 to 272 2024-03-30T12:31:51.756 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 46 current snap is 275 2024-03-30T12:31:51.756 INFO:tasks.rados.rados.0.smithi084.stdout:2737: seq_num 846 ranges {991232=573440,1564672=466944,2031616=491520,2523136=548864,3072000=98304} 2024-03-30T12:31:51.765 INFO:tasks.rados.rados.0.smithi084.stdout:2737: writing smithi08477944-46 from 991232 to 1564672 tid 1 2024-03-30T12:31:51.767 INFO:tasks.rados.rados.0.smithi084.stdout:2737: writing smithi08477944-46 from 1564672 to 2031616 tid 2 2024-03-30T12:31:51.771 INFO:tasks.rados.rados.0.smithi084.stdout:2737: writing smithi08477944-46 from 2031616 to 2523136 tid 3 2024-03-30T12:31:51.774 INFO:tasks.rados.rados.0.smithi084.stdout:2737: writing smithi08477944-46 from 2523136 to 3072000 tid 4 2024-03-30T12:31:51.775 INFO:tasks.rados.rados.0.smithi084.stdout:2737: writing smithi08477944-46 from 3072000 to 3170304 tid 5 2024-03-30T12:31:51.775 INFO:tasks.rados.rados.0.smithi084.stdout:2738: copy_from oid 13 from oid 14 current snap is 275 2024-03-30T12:31:51.775 INFO:tasks.rados.rados.0.smithi084.stdout:2736: finishing rollback tid 1 to smithi08477944-23 2024-03-30T12:31:51.775 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 27273 (ObjNum 145 snap 0 seq_num 1429685712) dirty dne 2024-03-30T12:31:51.775 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 17511 (ObjNum 33 snap 0 seq_num 1430142912) dirty exists 2024-03-30T12:31:51.775 INFO:tasks.rados.rados.0.smithi084.stdout:2733: expect (ObjNum 785 snap 262 seq_num 785) 2024-03-30T12:31:51.926 INFO:tasks.rados.rados.0.smithi084.stdout:2737: finishing write tid 1 to smithi08477944-46 2024-03-30T12:31:51.926 INFO:tasks.rados.rados.0.smithi084.stdout:2737: finishing write tid 2 to smithi08477944-46 2024-03-30T12:31:51.926 INFO:tasks.rados.rados.0.smithi084.stdout:2737: finishing write tid 3 to smithi08477944-46 2024-03-30T12:31:51.926 INFO:tasks.rados.rados.0.smithi084.stdout:2733: done (4 left) 2024-03-30T12:31:51.926 INFO:tasks.rados.rados.0.smithi084.stdout:2735: done (3 left) 2024-03-30T12:31:51.926 INFO:tasks.rados.rados.0.smithi084.stdout:2736: done (2 left) 2024-03-30T12:31:51.926 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 275 2024-03-30T12:31:51.926 INFO:tasks.rados.rados.0.smithi084.stdout:2737: finishing write tid 4 to smithi08477944-46 2024-03-30T12:31:51.926 INFO:tasks.rados.rados.0.smithi084.stdout:2737: finishing write tid 5 to smithi08477944-46 2024-03-30T12:31:51.926 INFO:tasks.rados.rados.0.smithi084.stdout:2737: finishing write tid 6 to smithi08477944-46 2024-03-30T12:31:51.926 INFO:tasks.rados.rados.0.smithi084.stdout:2739: seq_num 847 ranges {2850816=589824,3440640=753664,4194304=655360,4849664=196608} 2024-03-30T12:31:51.944 INFO:tasks.rados.rados.0.smithi084.stdout:2739: writing smithi08477944-24 from 2850816 to 3440640 tid 1 2024-03-30T12:31:51.948 INFO:tasks.rados.rados.0.smithi084.stdout:2739: writing smithi08477944-24 from 3440640 to 4194304 tid 2 2024-03-30T12:31:51.951 INFO:tasks.rados.rados.0.smithi084.stdout:2739: writing smithi08477944-24 from 4194304 to 4849664 tid 3 2024-03-30T12:31:51.953 INFO:tasks.rados.rados.0.smithi084.stdout:2739: writing smithi08477944-24 from 4849664 to 5046272 tid 4 2024-03-30T12:31:51.953 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 275 2024-03-30T12:31:51.954 INFO:tasks.rados.rados.0.smithi084.stdout:2737: finishing write tid 7 to smithi08477944-46 2024-03-30T12:31:51.954 INFO:tasks.rados.rados.0.smithi084.stdout:2737: oid 46 updating version 0 to 27285 2024-03-30T12:31:51.954 INFO:tasks.rados.rados.0.smithi084.stdout:2737: oid 46 version 27285 is already newer than 27284 2024-03-30T12:31:51.954 INFO:tasks.rados.rados.0.smithi084.stdout:2737: oid 46 version 27285 is already newer than 27280 2024-03-30T12:31:51.954 INFO:tasks.rados.rados.0.smithi084.stdout:2737: oid 46 version 27285 is already newer than 27281 2024-03-30T12:31:51.954 INFO:tasks.rados.rados.0.smithi084.stdout:2737: oid 46 version 27285 is already newer than 27283 2024-03-30T12:31:51.954 INFO:tasks.rados.rados.0.smithi084.stdout:2737: oid 46 version 27285 is already newer than 27282 2024-03-30T12:31:51.954 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 27285 (ObjNum 846 snap 275 seq_num 846) dirty exists 2024-03-30T12:31:51.954 INFO:tasks.rados.rados.0.smithi084.stdout:2737: left oid 46 (ObjNum 846 snap 275 seq_num 846) 2024-03-30T12:31:51.954 INFO:tasks.rados.rados.0.smithi084.stdout:2738: finishing copy_from racing read to smithi08477944-13 2024-03-30T12:31:51.954 INFO:tasks.rados.rados.0.smithi084.stdout:2738: finishing copy_from to smithi08477944-13 2024-03-30T12:31:51.954 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 23394 (ObjNum 836 snap 273 seq_num 836) dirty exists 2024-03-30T12:31:51.954 INFO:tasks.rados.rados.0.smithi084.stdout:2740: seq_num 848 ranges {2113536=606208,2719744=630784,3350528=458752,3809280=516096} 2024-03-30T12:31:51.967 INFO:tasks.rados.rados.0.smithi084.stdout:2740: writing smithi08477944-43 from 2113536 to 2719744 tid 1 2024-03-30T12:31:51.971 INFO:tasks.rados.rados.0.smithi084.stdout:2740: writing smithi08477944-43 from 2719744 to 3350528 tid 2 2024-03-30T12:31:51.973 INFO:tasks.rados.rados.0.smithi084.stdout:2740: writing smithi08477944-43 from 3350528 to 3809280 tid 3 2024-03-30T12:31:51.978 INFO:tasks.rados.rados.0.smithi084.stdout:2740: writing smithi08477944-43 from 3809280 to 4325376 tid 4 2024-03-30T12:31:51.978 INFO:tasks.rados.rados.0.smithi084.stdout:2737: done (3 left) 2024-03-30T12:31:51.978 INFO:tasks.rados.rados.0.smithi084.stdout:2738: done (2 left) 2024-03-30T12:31:51.978 INFO:tasks.rados.rados.0.smithi084.stdout:2741: read oid 10 snap -1 2024-03-30T12:31:51.978 INFO:tasks.rados.rados.0.smithi084.stdout:2741: expect deleted 2024-03-30T12:31:51.978 INFO:tasks.rados.rados.0.smithi084.stdout:2742: read oid 50 snap 267 2024-03-30T12:31:51.978 INFO:tasks.rados.rados.0.smithi084.stdout:2742: expect (ObjNum 747 snap 249 seq_num 747) 2024-03-30T12:31:51.978 INFO:tasks.rados.rados.0.smithi084.stdout:2743: rmattr oid 8 current snap is 275 2024-03-30T12:31:51.978 INFO:tasks.rados.rados.0.smithi084.stdout:2739: finishing write tid 1 to smithi08477944-24 2024-03-30T12:31:51.978 INFO:tasks.rados.rados.0.smithi084.stdout:2739: finishing write tid 2 to smithi08477944-24 2024-03-30T12:31:51.979 INFO:tasks.rados.rados.0.smithi084.stdout:2743: done (4 left) 2024-03-30T12:31:51.979 INFO:tasks.rados.rados.0.smithi084.stdout:2744: rollback oid 44 current snap is 275 2024-03-30T12:31:51.979 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 44 to 267 2024-03-30T12:31:51.979 INFO:tasks.rados.rados.0.smithi084.stdout:2739: finishing write tid 3 to smithi08477944-24 2024-03-30T12:31:51.979 INFO:tasks.rados.rados.0.smithi084.stdout:2739: finishing write tid 4 to smithi08477944-24 2024-03-30T12:31:51.979 INFO:tasks.rados.rados.0.smithi084.stdout:2739: finishing write tid 5 to smithi08477944-24 2024-03-30T12:31:51.979 INFO:tasks.rados.rados.0.smithi084.stdout:2739: finishing write tid 6 to smithi08477944-24 2024-03-30T12:31:51.979 INFO:tasks.rados.rados.0.smithi084.stdout:2739: oid 24 updating version 0 to 23396 2024-03-30T12:31:51.979 INFO:tasks.rados.rados.0.smithi084.stdout:2739: oid 24 updating version 23396 to 23397 2024-03-30T12:31:51.979 INFO:tasks.rados.rados.0.smithi084.stdout:2739: oid 24 updating version 23397 to 23398 2024-03-30T12:31:51.979 INFO:tasks.rados.rados.0.smithi084.stdout:2739: oid 24 version 23398 is already newer than 23395 2024-03-30T12:31:51.979 INFO:tasks.rados.rados.0.smithi084.stdout:2739: oid 24 updating version 23398 to 23399 2024-03-30T12:31:51.979 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 23399 (ObjNum 847 snap 275 seq_num 847) dirty exists 2024-03-30T12:31:51.979 INFO:tasks.rados.rados.0.smithi084.stdout:2739: left oid 24 (ObjNum 847 snap 275 seq_num 847) 2024-03-30T12:31:51.979 INFO:tasks.rados.rados.0.smithi084.stdout:2740: finishing write tid 1 to smithi08477944-43 2024-03-30T12:31:51.980 INFO:tasks.rados.rados.0.smithi084.stdout:2739: done (4 left) 2024-03-30T12:31:51.980 INFO:tasks.rados.rados.0.smithi084.stdout:2745: snap_create 2024-03-30T12:31:51.981 INFO:tasks.rados.rados.0.smithi084.stdout:2740: finishing write tid 2 to smithi08477944-43 2024-03-30T12:31:51.988 INFO:tasks.rados.rados.0.smithi084.stdout:2740: finishing write tid 3 to smithi08477944-43 2024-03-30T12:31:51.988 INFO:tasks.rados.rados.0.smithi084.stdout:2740: finishing write tid 4 to smithi08477944-43 2024-03-30T12:31:51.990 INFO:tasks.rados.rados.0.smithi084.stdout:2740: finishing write tid 5 to smithi08477944-43 2024-03-30T12:31:51.995 INFO:tasks.rados.rados.0.smithi084.stdout:2742: expect (ObjNum 747 snap 249 seq_num 747) 2024-03-30T12:31:52.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:51.759+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:52.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:51.759+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:52.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:51.755+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:52.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:51.755+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:52.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:51.755+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:52.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:51.755+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:52.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:51.755+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:52.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:51.756+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:52.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:51.756+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:52.120 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:51.738+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:52.120 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:51.763+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:52.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:51.761+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:52.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:51.761+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:52.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:51.761+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:52.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:51.737+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:52.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:51.738+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:52.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:51.755+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:52.121 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:51.756+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:52.232 INFO:tasks.rados.rados.0.smithi084.stdout:2744: finishing rollback tid 1 to smithi08477944-44 2024-03-30T12:31:52.232 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 36265 (ObjNum 49 snap 0 seq_num 194845232) dirty dne 2024-03-30T12:31:52.232 INFO:tasks.rados.rados.0.smithi084.stdout:2740: finishing write tid 6 to smithi08477944-43 2024-03-30T12:31:52.233 INFO:tasks.rados.rados.0.smithi084.stdout:2740: oid 43 updating version 0 to 36279 2024-03-30T12:31:52.233 INFO:tasks.rados.rados.0.smithi084.stdout:2740: oid 43 version 36279 is already newer than 36277 2024-03-30T12:31:52.233 INFO:tasks.rados.rados.0.smithi084.stdout:2740: oid 43 version 36279 is already newer than 36275 2024-03-30T12:31:52.233 INFO:tasks.rados.rados.0.smithi084.stdout:2740: oid 43 version 36279 is already newer than 36278 2024-03-30T12:31:52.233 INFO:tasks.rados.rados.0.smithi084.stdout:2740: oid 43 version 36279 is already newer than 36276 2024-03-30T12:31:52.233 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 36279 (ObjNum 848 snap 275 seq_num 848) dirty exists 2024-03-30T12:31:52.233 INFO:tasks.rados.rados.0.smithi084.stdout:2740: left oid 43 (ObjNum 848 snap 275 seq_num 848) 2024-03-30T12:31:52.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:52.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:52.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:52.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:52.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:52.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:52.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:52.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:52.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:52.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[91810]: osdmap e622: 8 total, 8 up, 8 in 2024-03-30T12:31:52.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:52.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:52.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:52.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:52.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[89279]: osdmap e622: 8 total, 8 up, 8 in 2024-03-30T12:31:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:52.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:52.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:52.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:52.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:52.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:52.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:52 smithi162 ceph-mon[83709]: osdmap e622: 8 total, 8 up, 8 in 2024-03-30T12:31:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:52 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:52.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:52 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:52.933 INFO:tasks.rados.rados.0.smithi084.stdout:2740: done (4 left) 2024-03-30T12:31:52.933 INFO:tasks.rados.rados.0.smithi084.stdout:2741: done (3 left) 2024-03-30T12:31:52.934 INFO:tasks.rados.rados.0.smithi084.stdout:2742: done (2 left) 2024-03-30T12:31:52.934 INFO:tasks.rados.rados.0.smithi084.stdout:2744: done (1 left) 2024-03-30T12:31:52.934 INFO:tasks.rados.rados.0.smithi084.stdout:2745: done (0 left) 2024-03-30T12:31:52.934 INFO:tasks.rados.rados.0.smithi084.stdout:2746: delete oid 12 current snap is 276 2024-03-30T12:31:52.940 INFO:tasks.rados.rados.0.smithi084.stdout:2746: done (0 left) 2024-03-30T12:31:52.941 INFO:tasks.rados.rados.0.smithi084.stdout:2747: setattr oid 33 current snap is 276 2024-03-30T12:31:52.941 INFO:tasks.rados.rados.0.smithi084.stdout:2748: delete oid 45 current snap is 276 2024-03-30T12:31:52.948 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 23428 (ObjNum 809 snap 270 seq_num 809) dirty exists 2024-03-30T12:31:52.948 INFO:tasks.rados.rados.0.smithi084.stdout:2747: done (1 left) 2024-03-30T12:31:52.948 INFO:tasks.rados.rados.0.smithi084.stdout:2748: done (0 left) 2024-03-30T12:31:52.948 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 276 2024-03-30T12:31:52.948 INFO:tasks.rados.rados.0.smithi084.stdout:2749: seq_num 851 ranges {6012928=655360,6668288=688128,7356416=679936,8036352=237568} 2024-03-30T12:31:52.984 INFO:tasks.rados.rados.0.smithi084.stdout:2749: writing smithi08477944-14 from 6012928 to 6668288 tid 1 2024-03-30T12:31:52.988 INFO:tasks.rados.rados.0.smithi084.stdout:2749: writing smithi08477944-14 from 6668288 to 7356416 tid 2 2024-03-30T12:31:52.992 INFO:tasks.rados.rados.0.smithi084.stdout:2749: writing smithi08477944-14 from 7356416 to 8036352 tid 3 2024-03-30T12:31:52.993 INFO:tasks.rados.rados.0.smithi084.stdout:2749: writing smithi08477944-14 from 8036352 to 8273920 tid 4 2024-03-30T12:31:52.994 INFO:tasks.rados.rados.0.smithi084.stdout:2750: delete oid 48 current snap is 276 2024-03-30T12:31:52.995 INFO:tasks.rados.rados.0.smithi084.stdout:2750: done (1 left) 2024-03-30T12:31:52.995 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 276 2024-03-30T12:31:52.995 INFO:tasks.rados.rados.0.smithi084.stdout:2751: seq_num 853 ranges {1531904=696320,2228224=507904,2736128=647168,3383296=450560} 2024-03-30T12:31:53.008 INFO:tasks.rados.rados.0.smithi084.stdout:2751: writing smithi08477944-5 from 1531904 to 2228224 tid 1 2024-03-30T12:31:53.011 INFO:tasks.rados.rados.0.smithi084.stdout:2751: writing smithi08477944-5 from 2228224 to 2736128 tid 2 2024-03-30T12:31:53.015 INFO:tasks.rados.rados.0.smithi084.stdout:2751: writing smithi08477944-5 from 2736128 to 3383296 tid 3 2024-03-30T12:31:53.017 INFO:tasks.rados.rados.0.smithi084.stdout:2751: writing smithi08477944-5 from 3383296 to 3833856 tid 4 2024-03-30T12:31:53.017 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 276 2024-03-30T12:31:53.017 INFO:tasks.rados.rados.0.smithi084.stdout:2749: finishing write tid 1 to smithi08477944-14 2024-03-30T12:31:53.018 INFO:tasks.rados.rados.0.smithi084.stdout:2752: seq_num 854 ranges {0=712704,712704=794624,1507328=450560,1957888=360448} 2024-03-30T12:31:53.021 INFO:tasks.rados.rados.0.smithi084.stdout:2752: writing smithi08477944-48 from 0 to 712704 tid 1 2024-03-30T12:31:53.026 INFO:tasks.rados.rados.0.smithi084.stdout:2752: writing smithi08477944-48 from 712704 to 1507328 tid 2 2024-03-30T12:31:53.028 INFO:tasks.rados.rados.0.smithi084.stdout:2752: writing smithi08477944-48 from 1507328 to 1957888 tid 3 2024-03-30T12:31:53.032 INFO:tasks.rados.rados.0.smithi084.stdout:2752: writing smithi08477944-48 from 1957888 to 2318336 tid 4 2024-03-30T12:31:53.032 INFO:tasks.rados.rados.0.smithi084.stdout:2753: rollback oid 41 current snap is 276 2024-03-30T12:31:53.032 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 41 to 273 2024-03-30T12:31:53.032 INFO:tasks.rados.rados.0.smithi084.stdout:2749: finishing write tid 2 to smithi08477944-14 2024-03-30T12:31:53.032 INFO:tasks.rados.rados.0.smithi084.stdout:2749: finishing write tid 3 to smithi08477944-14 2024-03-30T12:31:53.032 INFO:tasks.rados.rados.0.smithi084.stdout:2749: finishing write tid 4 to smithi08477944-14 2024-03-30T12:31:53.032 INFO:tasks.rados.rados.0.smithi084.stdout:2749: finishing write tid 5 to smithi08477944-14 2024-03-30T12:31:53.032 INFO:tasks.rados.rados.0.smithi084.stdout:2751: finishing write tid 1 to smithi08477944-5 2024-03-30T12:31:53.032 INFO:tasks.rados.rados.0.smithi084.stdout:2751: finishing write tid 2 to smithi08477944-5 2024-03-30T12:31:53.032 INFO:tasks.rados.rados.0.smithi084.stdout:2749: finishing write tid 6 to smithi08477944-14 2024-03-30T12:31:53.032 INFO:tasks.rados.rados.0.smithi084.stdout:2749: oid 14 updating version 0 to 36257 2024-03-30T12:31:53.032 INFO:tasks.rados.rados.0.smithi084.stdout:2749: oid 14 updating version 36257 to 36258 2024-03-30T12:31:53.032 INFO:tasks.rados.rados.0.smithi084.stdout:2749: oid 14 updating version 36258 to 36260 2024-03-30T12:31:53.032 INFO:tasks.rados.rados.0.smithi084.stdout:2749: oid 14 version 36260 is already newer than 36259 2024-03-30T12:31:53.033 INFO:tasks.rados.rados.0.smithi084.stdout:2749: oid 14 version 36260 is already newer than 36256 2024-03-30T12:31:53.033 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 36260 (ObjNum 851 snap 276 seq_num 851) dirty exists 2024-03-30T12:31:53.033 INFO:tasks.rados.rados.0.smithi084.stdout:2749: left oid 14 (ObjNum 851 snap 276 seq_num 851) 2024-03-30T12:31:53.033 INFO:tasks.rados.rados.0.smithi084.stdout:2751: finishing write tid 3 to smithi08477944-5 2024-03-30T12:31:53.033 INFO:tasks.rados.rados.0.smithi084.stdout:2751: finishing write tid 4 to smithi08477944-5 2024-03-30T12:31:53.033 INFO:tasks.rados.rados.0.smithi084.stdout:2751: finishing write tid 5 to smithi08477944-5 2024-03-30T12:31:53.033 INFO:tasks.rados.rados.0.smithi084.stdout:2751: finishing write tid 6 to smithi08477944-5 2024-03-30T12:31:53.033 INFO:tasks.rados.rados.0.smithi084.stdout:2751: oid 5 updating version 0 to 17513 2024-03-30T12:31:53.033 INFO:tasks.rados.rados.0.smithi084.stdout:2751: oid 5 updating version 17513 to 17515 2024-03-30T12:31:53.033 INFO:tasks.rados.rados.0.smithi084.stdout:2751: oid 5 updating version 17515 to 17516 2024-03-30T12:31:53.033 INFO:tasks.rados.rados.0.smithi084.stdout:2751: oid 5 version 17516 is already newer than 17514 2024-03-30T12:31:53.033 INFO:tasks.rados.rados.0.smithi084.stdout:2751: oid 5 version 17516 is already newer than 17512 2024-03-30T12:31:53.033 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 17516 (ObjNum 853 snap 276 seq_num 853) dirty exists 2024-03-30T12:31:53.033 INFO:tasks.rados.rados.0.smithi084.stdout:2751: left oid 5 (ObjNum 853 snap 276 seq_num 853) 2024-03-30T12:31:53.034 INFO:tasks.rados.rados.0.smithi084.stdout:2752: finishing write tid 1 to smithi08477944-48 2024-03-30T12:31:53.034 INFO:tasks.rados.rados.0.smithi084.stdout:2752: finishing write tid 2 to smithi08477944-48 2024-03-30T12:31:53.034 INFO:tasks.rados.rados.0.smithi084.stdout:2752: finishing write tid 3 to smithi08477944-48 2024-03-30T12:31:53.034 INFO:tasks.rados.rados.0.smithi084.stdout:2749: done (3 left) 2024-03-30T12:31:53.034 INFO:tasks.rados.rados.0.smithi084.stdout:2751: done (2 left) 2024-03-30T12:31:53.034 INFO:tasks.rados.rados.0.smithi084.stdout:2754: delete oid 31 current snap is 276 2024-03-30T12:31:53.035 INFO:tasks.rados.rados.0.smithi084.stdout:2752: finishing write tid 4 to smithi08477944-48 2024-03-30T12:31:53.035 INFO:tasks.rados.rados.0.smithi084.stdout:2752: finishing write tid 5 to smithi08477944-48 2024-03-30T12:31:53.035 INFO:tasks.rados.rados.0.smithi084.stdout:2754: done (2 left) 2024-03-30T12:31:53.035 INFO:tasks.rados.rados.0.smithi084.stdout:2755: delete oid 32 current snap is 276 2024-03-30T12:31:53.036 INFO:tasks.rados.rados.0.smithi084.stdout:2753: finishing rollback tid 0 to smithi08477944-41 2024-03-30T12:31:53.036 INFO:tasks.rados.rados.0.smithi084.stdout:2753: finishing rollback tid 1 to smithi08477944-41 2024-03-30T12:31:53.037 INFO:tasks.rados.rados.0.smithi084.stdout:2753: finishing rollback tid 2 to smithi08477944-41 2024-03-30T12:31:53.037 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 23402 (ObjNum 688 snap 241 seq_num 688) dirty exists 2024-03-30T12:31:53.037 INFO:tasks.rados.rados.0.smithi084.stdout:2753: done (2 left) 2024-03-30T12:31:53.037 INFO:tasks.rados.rados.0.smithi084.stdout:2755: done (1 left) 2024-03-30T12:31:53.037 INFO:tasks.rados.rados.0.smithi084.stdout:2756: read oid 23 snap 273 2024-03-30T12:31:53.037 INFO:tasks.rados.rados.0.smithi084.stdout:2756: expect deleted 2024-03-30T12:31:53.037 INFO:tasks.rados.rados.0.smithi084.stdout:2757: snap_remove snap 271 2024-03-30T12:31:53.201 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:52.948+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:53.201 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:52.943+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:53.202 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:52.949+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 152=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:53.202 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:52.945+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:53.202 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:52.945+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:53.202 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:52.945+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:53.202 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:52.957+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:53.203 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:52.957+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:53.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:52.957+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:53.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:52.957+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:53.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:52.953+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:53.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:52.953+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:53.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:52.953+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:53.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:52.955+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:53.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:52.956+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:53.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:52.956+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:53.585 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:53.585 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:53.585 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:53.585 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:53.585 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:53.585 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:53.585 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:53.585 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:53.585 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-mon[89279]: pgmap v621: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 725 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 2.7 MiB/s rd, 3.3 MiB/s wr, 19 op/s 2024-03-30T12:31:53.585 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-mon[89279]: osdmap e623: 8 total, 8 up, 8 in 2024-03-30T12:31:53.585 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:53.586 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:53.586 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:53.586 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:53.586 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:53.586 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:53.586 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:53.586 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:53.586 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:53.586 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:53.586 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-mon[91810]: pgmap v621: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 725 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 2.7 MiB/s rd, 3.3 MiB/s wr, 19 op/s 2024-03-30T12:31:53.586 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-mon[91810]: osdmap e623: 8 total, 8 up, 8 in 2024-03-30T12:31:53.587 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:53.587 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:53.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:53.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:53.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:53.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:53.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14f=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:53.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:53.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:53.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:53.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:53 smithi162 ceph-mon[83709]: pgmap v621: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 725 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 2.7 MiB/s rd, 3.3 MiB/s wr, 19 op/s 2024-03-30T12:31:53.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:53 smithi162 ceph-mon[83709]: osdmap e623: 8 total, 8 up, 8 in 2024-03-30T12:31:53.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:53 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:53.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:53 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:53.980 INFO:tasks.rados.rados.0.smithi084.stdout:2757: done (2 left) 2024-03-30T12:31:53.980 INFO:tasks.rados.rados.0.smithi084.stdout:2758: delete oid 8 current snap is 276 2024-03-30T12:31:53.980 INFO:tasks.rados.rados.0.smithi084.stdout:2752: finishing write tid 6 to smithi08477944-48 2024-03-30T12:31:53.980 INFO:tasks.rados.rados.0.smithi084.stdout:2752: oid 48 updating version 0 to 924 2024-03-30T12:31:53.980 INFO:tasks.rados.rados.0.smithi084.stdout:2752: oid 48 updating version 924 to 926 2024-03-30T12:31:53.981 INFO:tasks.rados.rados.0.smithi084.stdout:2752: oid 48 version 926 is already newer than 925 2024-03-30T12:31:53.981 INFO:tasks.rados.rados.0.smithi084.stdout:2752: oid 48 updating version 926 to 927 2024-03-30T12:31:53.981 INFO:tasks.rados.rados.0.smithi084.stdout:2752: oid 48 version 927 is already newer than 923 2024-03-30T12:31:53.981 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 927 (ObjNum 854 snap 276 seq_num 854) dirty exists 2024-03-30T12:31:53.981 INFO:tasks.rados.rados.0.smithi084.stdout:2752: left oid 48 (ObjNum 854 snap 276 seq_num 854) 2024-03-30T12:31:53.990 INFO:tasks.rados.rados.0.smithi084.stdout:2752: done (2 left) 2024-03-30T12:31:53.991 INFO:tasks.rados.rados.0.smithi084.stdout:2756: done (1 left) 2024-03-30T12:31:53.991 INFO:tasks.rados.rados.0.smithi084.stdout:2758: done (0 left) 2024-03-30T12:31:53.991 INFO:tasks.rados.rados.0.smithi084.stdout:2759: delete oid 22 current snap is 276 2024-03-30T12:31:53.996 INFO:tasks.rados.rados.0.smithi084.stdout:2759: done (0 left) 2024-03-30T12:31:53.997 INFO:tasks.rados.rados.0.smithi084.stdout:2760: rollback oid 41 current snap is 276 2024-03-30T12:31:53.997 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 41 to 267 2024-03-30T12:31:53.997 INFO:tasks.rados.rados.0.smithi084.stdout:2761: rollback oid 19 current snap is 276 2024-03-30T12:31:53.997 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 19 to 275 2024-03-30T12:31:53.997 INFO:tasks.rados.rados.0.smithi084.stdout:2762: rollback oid 24 current snap is 276 2024-03-30T12:31:53.997 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 24 to 272 2024-03-30T12:31:53.997 INFO:tasks.rados.rados.0.smithi084.stdout:2763: snap_create 2024-03-30T12:31:54.003 INFO:tasks.rados.rados.0.smithi084.stdout:2760: finishing rollback tid 0 to smithi08477944-41 2024-03-30T12:31:54.004 INFO:tasks.rados.rados.0.smithi084.stdout:2760: finishing rollback tid 1 to smithi08477944-41 2024-03-30T12:31:54.004 INFO:tasks.rados.rados.0.smithi084.stdout:2760: finishing rollback tid 2 to smithi08477944-41 2024-03-30T12:31:54.004 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 23405 (ObjNum 688 snap 241 seq_num 688) dirty exists 2024-03-30T12:31:54.011 INFO:tasks.rados.rados.0.smithi084.stdout:2761: finishing rollback tid 0 to smithi08477944-19 2024-03-30T12:31:54.011 INFO:tasks.rados.rados.0.smithi084.stdout:2762: finishing rollback tid 0 to smithi08477944-24 2024-03-30T12:31:54.011 INFO:tasks.rados.rados.0.smithi084.stdout:2761: finishing rollback tid 1 to smithi08477944-19 2024-03-30T12:31:54.011 INFO:tasks.rados.rados.0.smithi084.stdout:2761: finishing rollback tid 2 to smithi08477944-19 2024-03-30T12:31:54.011 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 36284 (ObjNum 794 snap 266 seq_num 794) dirty exists 2024-03-30T12:31:54.011 INFO:tasks.rados.rados.0.smithi084.stdout:2762: finishing rollback tid 1 to smithi08477944-24 2024-03-30T12:31:54.012 INFO:tasks.rados.rados.0.smithi084.stdout:2762: finishing rollback tid 2 to smithi08477944-24 2024-03-30T12:31:54.012 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 23402 (ObjNum 818 snap 272 seq_num 818) dirty exists 2024-03-30T12:31:54.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:53.998+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:54.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:53.998+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:54.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:53.988+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:54.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:53.988+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:54.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:53.988+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:54.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:53.989+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:54.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:53.989+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:54.255 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:54.011+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:54.256 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:53.985+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:54.256 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:53.985+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:54.256 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:53.987+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 152=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:54.256 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:53.987+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:54.256 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:53.991+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:54.256 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:53.991+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:54.257 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:53.995+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:54.615 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:54.615 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:54.615 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:54.616 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:54.616 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 152=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:54.616 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:54.616 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:54.616 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:54.616 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:54.616 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:54.616 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:54.616 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:54.616 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:54.616 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[91810]: osdmap e624: 8 total, 8 up, 8 in 2024-03-30T12:31:54.616 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:54.617 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:54.617 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:54.617 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:54.617 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 152=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:54.617 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:54.617 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:54.617 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:54.617 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:54.617 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:54.617 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:54.617 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:54.617 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:54.617 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-mon[89279]: osdmap e624: 8 total, 8 up, 8 in 2024-03-30T12:31:54.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14f=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:54.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:54.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:54.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:54.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 152=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:54.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:54.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:54.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:54.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:54.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:54.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:54.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:54.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:54.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:54 smithi162 ceph-mon[83709]: osdmap e624: 8 total, 8 up, 8 in 2024-03-30T12:31:54.977 INFO:tasks.rados.rados.0.smithi084.stdout:2760: done (3 left) 2024-03-30T12:31:54.977 INFO:tasks.rados.rados.0.smithi084.stdout:2761: done (2 left) 2024-03-30T12:31:54.977 INFO:tasks.rados.rados.0.smithi084.stdout:2762: done (1 left) 2024-03-30T12:31:54.977 INFO:tasks.rados.rados.0.smithi084.stdout:2763: done (0 left) 2024-03-30T12:31:54.977 INFO:tasks.rados.rados.0.smithi084.stdout:2764: read oid 49 snap -1 2024-03-30T12:31:54.977 INFO:tasks.rados.rados.0.smithi084.stdout:2764: expect deleted 2024-03-30T12:31:54.977 INFO:tasks.rados.rados.0.smithi084.stdout:2765: snap_remove snap 275 2024-03-30T12:31:55.117 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:55.017+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:55.117 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:55.018+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:55.117 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:54.983+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:55.117 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:54.983+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:55.117 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:54.983+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:55.117 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:54.983+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:55.117 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:54.983+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:55.118 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:54.983+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:55.261 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:54.986+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 152=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:55.262 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:54.986+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:55.262 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:54.985+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:55.262 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:54.986+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:55.262 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:54.986+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:55.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:55.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:55.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:55.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 152=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:55.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:55.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:55.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:55.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:55.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:55.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:55.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:55.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:55.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:55.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[89279]: pgmap v624: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 760 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 6.3 MiB/s rd, 12 MiB/s wr, 35 op/s 2024-03-30T12:31:55.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[89279]: osdmap e625: 8 total, 8 up, 8 in 2024-03-30T12:31:55.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:55.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:55.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:55.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 152=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:55.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:55.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:55.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:55.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:55.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:55.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:55.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:55.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:55.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:55.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[91810]: pgmap v624: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 760 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 6.3 MiB/s rd, 12 MiB/s wr, 35 op/s 2024-03-30T12:31:55.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:55 smithi084 ceph-mon[91810]: osdmap e625: 8 total, 8 up, 8 in 2024-03-30T12:31:55.602 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:55.602 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:55.603 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:55.603 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 152=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:55.603 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:55.603 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:55.603 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:55.603 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:55.603 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:55.603 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:55.603 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:55.603 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:55.603 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:55.603 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:55 smithi162 ceph-mon[83709]: pgmap v624: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 760 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 6.3 MiB/s rd, 12 MiB/s wr, 35 op/s 2024-03-30T12:31:55.603 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:55 smithi162 ceph-mon[83709]: osdmap e625: 8 total, 8 up, 8 in 2024-03-30T12:31:55.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:55.610+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:55.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:55.610+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:55.978 INFO:tasks.rados.rados.0.smithi084.stdout:2765: done (1 left) 2024-03-30T12:31:55.978 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 277 2024-03-30T12:31:55.978 INFO:tasks.rados.rados.0.smithi084.stdout:2766: seq_num 859 ranges {0=794624,794624=614400,1409024=638976,2048000=352256} 2024-03-30T12:31:55.982 INFO:tasks.rados.rados.0.smithi084.stdout:2766: writing smithi08477944-12 from 0 to 794624 tid 1 2024-03-30T12:31:55.985 INFO:tasks.rados.rados.0.smithi084.stdout:2766: writing smithi08477944-12 from 794624 to 1409024 tid 2 2024-03-30T12:31:55.989 INFO:tasks.rados.rados.0.smithi084.stdout:2766: writing smithi08477944-12 from 1409024 to 2048000 tid 3 2024-03-30T12:31:55.992 INFO:tasks.rados.rados.0.smithi084.stdout:2766: writing smithi08477944-12 from 2048000 to 2400256 tid 4 2024-03-30T12:31:55.992 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 277 2024-03-30T12:31:55.992 INFO:tasks.rados.rados.0.smithi084.stdout:2766: finishing write tid 1 to smithi08477944-12 2024-03-30T12:31:55.992 INFO:tasks.rados.rados.0.smithi084.stdout:2767: seq_num 860 ranges {0=8192} 2024-03-30T12:31:55.992 INFO:tasks.rados.rados.0.smithi084.stdout:2767: writing smithi08477944-45 from 0 to 8192 tid 1 2024-03-30T12:31:55.992 INFO:tasks.rados.rados.0.smithi084.stdout:2764: done (2 left) 2024-03-30T12:31:55.992 INFO:tasks.rados.rados.0.smithi084.stdout:2768: snap_remove snap 261 2024-03-30T12:31:56.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:56.002+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:56.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:56.002+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:56.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:56.004+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:56.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:56.004+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:56.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:56.004+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:56.262 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:55.996+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:56.263 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:55.987+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:56.263 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:55.987+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:56.263 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:55.986+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 152=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:56.263 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:55.987+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:56.263 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:56.007+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:56.263 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:56.007+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:56.263 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:56.007+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:56.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:56.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:56.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:56.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:56.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:56.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:56.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 152=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:56.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:56.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:56.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:56.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:56 smithi162 ceph-mon[83709]: osdmap e626: 8 total, 8 up, 8 in 2024-03-30T12:31:56.639 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:56.369+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:56.639 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:56.369+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:56.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:56.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:56.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:56.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:56.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:56.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:56.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 152=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:56.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:56.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:56.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:56.641 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-mon[89279]: osdmap e626: 8 total, 8 up, 8 in 2024-03-30T12:31:56.641 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:56.641 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:56.641 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:56.641 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:56.641 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:56.641 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:56.641 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 152=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:56.641 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:56.641 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:56.641 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:56.641 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-mon[91810]: osdmap e626: 8 total, 8 up, 8 in 2024-03-30T12:31:56.979 INFO:tasks.rados.rados.0.smithi084.stdout:2768: done (2 left) 2024-03-30T12:31:56.979 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 277 2024-03-30T12:31:56.979 INFO:tasks.rados.rados.0.smithi084.stdout:2769: seq_num 861 ranges {2678784=24576} 2024-03-30T12:31:56.994 INFO:tasks.rados.rados.0.smithi084.stdout:2769: writing smithi08477944-18 from 2678784 to 2703360 tid 1 2024-03-30T12:31:56.994 INFO:tasks.rados.rados.0.smithi084.stdout:2770: rollback oid 39 current snap is 277 2024-03-30T12:31:56.994 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 39 to 274 2024-03-30T12:31:56.994 INFO:tasks.rados.rados.0.smithi084.stdout:2766: finishing write tid 2 to smithi08477944-12 2024-03-30T12:31:56.995 INFO:tasks.rados.rados.0.smithi084.stdout:2767: finishing write tid 1 to smithi08477944-45 2024-03-30T12:31:56.995 INFO:tasks.rados.rados.0.smithi084.stdout:2767: finishing write tid 2 to smithi08477944-45 2024-03-30T12:31:56.995 INFO:tasks.rados.rados.0.smithi084.stdout:2766: finishing write tid 3 to smithi08477944-12 2024-03-30T12:31:56.995 INFO:tasks.rados.rados.0.smithi084.stdout:2767: finishing write tid 3 to smithi08477944-45 2024-03-30T12:31:56.995 INFO:tasks.rados.rados.0.smithi084.stdout:2767: oid 45 updating version 0 to 23407 2024-03-30T12:31:56.995 INFO:tasks.rados.rados.0.smithi084.stdout:2767: oid 45 version 23407 is already newer than 23406 2024-03-30T12:31:56.995 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 23407 (ObjNum 860 snap 277 seq_num 860) dirty exists 2024-03-30T12:31:56.995 INFO:tasks.rados.rados.0.smithi084.stdout:2767: left oid 45 (ObjNum 860 snap 277 seq_num 860) 2024-03-30T12:31:56.995 INFO:tasks.rados.rados.0.smithi084.stdout:2766: finishing write tid 4 to smithi08477944-12 2024-03-30T12:31:56.995 INFO:tasks.rados.rados.0.smithi084.stdout:2766: finishing write tid 5 to smithi08477944-12 2024-03-30T12:31:56.995 INFO:tasks.rados.rados.0.smithi084.stdout:2766: finishing write tid 6 to smithi08477944-12 2024-03-30T12:31:56.995 INFO:tasks.rados.rados.0.smithi084.stdout:2766: oid 12 updating version 0 to 27220 2024-03-30T12:31:56.995 INFO:tasks.rados.rados.0.smithi084.stdout:2766: oid 12 version 27220 is already newer than 27218 2024-03-30T12:31:56.995 INFO:tasks.rados.rados.0.smithi084.stdout:2766: oid 12 version 27220 is already newer than 27216 2024-03-30T12:31:56.995 INFO:tasks.rados.rados.0.smithi084.stdout:2766: oid 12 version 27220 is already newer than 27217 2024-03-30T12:31:56.996 INFO:tasks.rados.rados.0.smithi084.stdout:2766: oid 12 version 27220 is already newer than 27219 2024-03-30T12:31:56.996 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 27220 (ObjNum 859 snap 277 seq_num 859) dirty exists 2024-03-30T12:31:56.996 INFO:tasks.rados.rados.0.smithi084.stdout:2766: left oid 12 (ObjNum 859 snap 277 seq_num 859) 2024-03-30T12:31:56.996 INFO:tasks.rados.rados.0.smithi084.stdout:2766: done (3 left) 2024-03-30T12:31:56.996 INFO:tasks.rados.rados.0.smithi084.stdout:2767: done (2 left) 2024-03-30T12:31:56.996 INFO:tasks.rados.rados.0.smithi084.stdout:2771: snap_remove snap 267 2024-03-30T12:31:57.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:56.993+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:57.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:56.994+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:57.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:56.986+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:57.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:56.986+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:57.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:56.986+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:57.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:56.986+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:57.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:56.986+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:57.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:56.986+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:57.263 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:57.006+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:57.264 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:56.988+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:57.264 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:56.988+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:57.264 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:56.991+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:57.264 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:56.992+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:57.264 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:56.994+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:57.265 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:56.994+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:57.265 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:56.994+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:57.587 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:57.587 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:57.587 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 152=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:57.587 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:57.587 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:57.587 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:57.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:57.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:57.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:57.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:57.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:57.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:57.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:57.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:57.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:57.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:57.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:57.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:31:57.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:31:57.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:57.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: pgmap v627: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 770 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 6.2 MiB/s rd, 12 MiB/s wr, 33 op/s 2024-03-30T12:31:57.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T12:31:57.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:31:57.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.590 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.590 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-mon[83709]: osdmap e627: 8 total, 8 up, 8 in 2024-03-30T12:31:57.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:57.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:57.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 152=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:57.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:57.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:57.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:57.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:57.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:57.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:57.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:57.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:57.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:57.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:57.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:57.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:57.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:57.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:57.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:57.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:57.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 152=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:57.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:57.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:57.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:57.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:57.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:57.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:57.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:57.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:57.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:57.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:57.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:57.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:57.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:57.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:57.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:31:57.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:31:57.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:57.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: pgmap v627: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 770 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 6.2 MiB/s rd, 12 MiB/s wr, 33 op/s 2024-03-30T12:31:57.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T12:31:57.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:31:57.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[91810]: osdmap e627: 8 total, 8 up, 8 in 2024-03-30T12:31:57.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:31:57.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:31:57.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:31:57.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: pgmap v627: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 770 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 6.2 MiB/s rd, 12 MiB/s wr, 33 op/s 2024-03-30T12:31:57.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T12:31:57.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:31:57.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:31:57.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-mon[89279]: osdmap e627: 8 total, 8 up, 8 in 2024-03-30T12:31:57.982 INFO:tasks.rados.rados.0.smithi084.stdout:2771: done (2 left) 2024-03-30T12:31:57.982 INFO:tasks.rados.rados.0.smithi084.stdout:2772: rmattr oid 14 current snap is 277 2024-03-30T12:31:57.982 INFO:tasks.rados.rados.0.smithi084.stdout:2770: finishing rollback tid 0 to smithi08477944-39 2024-03-30T12:31:57.982 INFO:tasks.rados.rados.0.smithi084.stdout:2769: finishing write tid 1 to smithi08477944-18 2024-03-30T12:31:57.982 INFO:tasks.rados.rados.0.smithi084.stdout:2769: finishing write tid 2 to smithi08477944-18 2024-03-30T12:31:57.982 INFO:tasks.rados.rados.0.smithi084.stdout:2770: finishing rollback tid 1 to smithi08477944-39 2024-03-30T12:31:57.983 INFO:tasks.rados.rados.0.smithi084.stdout:2770: finishing rollback tid 2 to smithi08477944-39 2024-03-30T12:31:57.983 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 23424 (ObjNum 785 snap 262 seq_num 785) dirty exists 2024-03-30T12:31:57.983 INFO:tasks.rados.rados.0.smithi084.stdout:2769: finishing write tid 3 to smithi08477944-18 2024-03-30T12:31:57.983 INFO:tasks.rados.rados.0.smithi084.stdout:2769: oid 18 updating version 0 to 23408 2024-03-30T12:31:57.983 INFO:tasks.rados.rados.0.smithi084.stdout:2769: oid 18 updating version 23408 to 23409 2024-03-30T12:31:57.983 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 23409 (ObjNum 861 snap 277 seq_num 861) dirty exists 2024-03-30T12:31:57.983 INFO:tasks.rados.rados.0.smithi084.stdout:2769: left oid 18 (ObjNum 861 snap 277 seq_num 861) 2024-03-30T12:31:57.983 INFO:tasks.rados.rados.0.smithi084.stdout:2769: done (2 left) 2024-03-30T12:31:57.983 INFO:tasks.rados.rados.0.smithi084.stdout:2770: done (1 left) 2024-03-30T12:31:57.983 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 277 2024-03-30T12:31:57.983 INFO:tasks.rados.rados.0.smithi084.stdout:2773: seq_num 862 ranges {0=40960} 2024-03-30T12:31:57.983 INFO:tasks.rados.rados.0.smithi084.stdout:2773: writing smithi08477944-47 from 0 to 40960 tid 1 2024-03-30T12:31:57.983 INFO:tasks.rados.rados.0.smithi084.stdout:2774: snap_remove snap 272 2024-03-30T12:31:58.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:57.995+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:58.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:57.995+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:58.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:57.988+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:58.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:57.988+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:58.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:57.988+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:58.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:57.989+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:58.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:57.989+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:58.265 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:57.999+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:58.265 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:57.993+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:58.265 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:57.994+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:58.266 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:57.988+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:31:58.266 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:57.988+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:58.266 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:57.989+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:58.516 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[91810]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T12:31:58.517 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:58.517 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:58.517 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:58.517 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:58.517 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:58.517 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 153=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:58.517 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:58.517 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:58.517 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:58.517 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:58.517 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:58.517 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:58.518 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:58.518 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[91810]: osdmap e628: 8 total, 8 up, 8 in 2024-03-30T12:31:58.518 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[89279]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T12:31:58.518 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:58.518 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:58.518 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:58.518 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:58.518 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:58.518 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 153=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:58.518 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:58.519 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:58.519 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:58.519 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:58.519 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:58.519 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:58.519 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:58.519 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-mon[89279]: osdmap e628: 8 total, 8 up, 8 in 2024-03-30T12:31:58.519 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:58 smithi162 ceph-mon[83709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T12:31:58.519 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:58.519 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:58.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:58.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:58.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:58.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 153=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:58.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:58.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:58.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:58.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:58.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:58.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:58.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:58.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:58 smithi162 ceph-mon[83709]: osdmap e628: 8 total, 8 up, 8 in 2024-03-30T12:31:58.869 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:58.703+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:58.869 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:58.703+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:58.983 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:31:58.525Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.003127591s 2024-03-30T12:31:58.985 INFO:tasks.rados.rados.0.smithi084.stdout:2774: done (2 left) 2024-03-30T12:31:58.985 INFO:tasks.rados.rados.0.smithi084.stdout:2775: copy_from oid 17 from oid 38 current snap is 277 2024-03-30T12:31:58.985 INFO:tasks.rados.rados.0.smithi084.stdout:2773: finishing write tid 1 to smithi08477944-47 2024-03-30T12:31:58.985 INFO:tasks.rados.rados.0.smithi084.stdout:2773: finishing write tid 2 to smithi08477944-47 2024-03-30T12:31:58.985 INFO:tasks.rados.rados.0.smithi084.stdout:2773: finishing write tid 3 to smithi08477944-47 2024-03-30T12:31:58.985 INFO:tasks.rados.rados.0.smithi084.stdout:2773: oid 47 updating version 0 to 23430 2024-03-30T12:31:58.985 INFO:tasks.rados.rados.0.smithi084.stdout:2773: oid 47 version 23430 is already newer than 23429 2024-03-30T12:31:58.985 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 23430 (ObjNum 862 snap 277 seq_num 862) dirty exists 2024-03-30T12:31:58.985 INFO:tasks.rados.rados.0.smithi084.stdout:2773: left oid 47 (ObjNum 862 snap 277 seq_num 862) 2024-03-30T12:31:58.985 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 36261 (ObjNum 851 snap 276 seq_num 851) dirty exists 2024-03-30T12:31:58.985 INFO:tasks.rados.rados.0.smithi084.stdout:2772: done (2 left) 2024-03-30T12:31:58.985 INFO:tasks.rados.rados.0.smithi084.stdout:2773: done (1 left) 2024-03-30T12:31:58.985 INFO:tasks.rados.rados.0.smithi084.stdout:2776: copy_from oid 34 from oid 5 current snap is 277 2024-03-30T12:31:58.986 INFO:tasks.rados.rados.0.smithi084.stdout:2777: setattr oid 12 current snap is 277 2024-03-30T12:31:58.986 INFO:tasks.rados.rados.0.smithi084.stdout:2778: delete oid 1 current snap is 277 2024-03-30T12:31:58.991 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 27221 (ObjNum 859 snap 277 seq_num 859) dirty exists 2024-03-30T12:31:58.995 INFO:tasks.rados.rados.0.smithi084.stdout:2777: done (3 left) 2024-03-30T12:31:58.995 INFO:tasks.rados.rados.0.smithi084.stdout:2778: done (2 left) 2024-03-30T12:31:58.995 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 277 2024-03-30T12:31:58.995 INFO:tasks.rados.rados.0.smithi084.stdout:2779: seq_num 864 ranges {0=73728} 2024-03-30T12:31:58.996 INFO:tasks.rados.rados.0.smithi084.stdout:2779: writing smithi08477944-22 from 0 to 73728 tid 1 2024-03-30T12:31:58.996 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 277 2024-03-30T12:31:58.996 INFO:tasks.rados.rados.0.smithi084.stdout:2780: seq_num 865 ranges {2760704=90112} 2024-03-30T12:31:59.012 INFO:tasks.rados.rados.0.smithi084.stdout:2780: writing smithi08477944-15 from 2760704 to 2850816 tid 1 2024-03-30T12:31:59.012 INFO:tasks.rados.rados.0.smithi084.stdout:2781: setattr oid 47 current snap is 277 2024-03-30T12:31:59.012 INFO:tasks.rados.rados.0.smithi084.stdout:2776: finishing copy_from racing read to smithi08477944-34 2024-03-30T12:31:59.012 INFO:tasks.rados.rados.0.smithi084.stdout:2776: finishing copy_from to smithi08477944-34 2024-03-30T12:31:59.012 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 17516 (ObjNum 853 snap 276 seq_num 853) dirty exists 2024-03-30T12:31:59.012 INFO:tasks.rados.rados.0.smithi084.stdout:2779: finishing write tid 1 to smithi08477944-22 2024-03-30T12:31:59.012 INFO:tasks.rados.rados.0.smithi084.stdout:2779: finishing write tid 2 to smithi08477944-22 2024-03-30T12:31:59.013 INFO:tasks.rados.rados.0.smithi084.stdout:2779: finishing write tid 3 to smithi08477944-22 2024-03-30T12:31:59.013 INFO:tasks.rados.rados.0.smithi084.stdout:2779: oid 22 updating version 0 to 27289 2024-03-30T12:31:59.013 INFO:tasks.rados.rados.0.smithi084.stdout:2779: oid 22 updating version 27289 to 27290 2024-03-30T12:31:59.013 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 27290 (ObjNum 864 snap 277 seq_num 864) dirty exists 2024-03-30T12:31:59.013 INFO:tasks.rados.rados.0.smithi084.stdout:2779: left oid 22 (ObjNum 864 snap 277 seq_num 864) 2024-03-30T12:31:59.013 INFO:tasks.rados.rados.0.smithi084.stdout:2776: done (4 left) 2024-03-30T12:31:59.014 INFO:tasks.rados.rados.0.smithi084.stdout:2779: done (3 left) 2024-03-30T12:31:59.014 INFO:tasks.rados.rados.0.smithi084.stdout:2782: rollback oid 30 current snap is 277 2024-03-30T12:31:59.014 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 30 to 276 2024-03-30T12:31:59.014 INFO:tasks.rados.rados.0.smithi084.stdout:2783: setattr oid 33 current snap is 277 2024-03-30T12:31:59.014 INFO:tasks.rados.rados.0.smithi084.stdout:2784: snap_create 2024-03-30T12:31:59.017 INFO:tasks.rados.rados.0.smithi084.stdout:2782: finishing rollback tid 1 to smithi08477944-30 2024-03-30T12:31:59.017 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 1033 (ObjNum 65 snap 0 seq_num 1517055840) dirty dne 2024-03-30T12:31:59.019 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 23431 (ObjNum 862 snap 277 seq_num 862) dirty exists 2024-03-30T12:31:59.019 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 23432 (ObjNum 809 snap 270 seq_num 809) dirty exists 2024-03-30T12:31:59.028 INFO:tasks.rados.rados.0.smithi084.stdout:2780: finishing write tid 1 to smithi08477944-15 2024-03-30T12:31:59.028 INFO:tasks.rados.rados.0.smithi084.stdout:2780: finishing write tid 2 to smithi08477944-15 2024-03-30T12:31:59.029 INFO:tasks.rados.rados.0.smithi084.stdout:2780: finishing write tid 3 to smithi08477944-15 2024-03-30T12:31:59.029 INFO:tasks.rados.rados.0.smithi084.stdout:2780: oid 15 updating version 0 to 23426 2024-03-30T12:31:59.030 INFO:tasks.rados.rados.0.smithi084.stdout:2780: oid 15 version 23426 is already newer than 23425 2024-03-30T12:31:59.030 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 23426 (ObjNum 865 snap 277 seq_num 865) dirty exists 2024-03-30T12:31:59.030 INFO:tasks.rados.rados.0.smithi084.stdout:2780: left oid 15 (ObjNum 865 snap 277 seq_num 865) 2024-03-30T12:31:59.051 INFO:tasks.rados.rados.0.smithi084.stdout:2775: finishing copy_from racing read to smithi08477944-17 2024-03-30T12:31:59.056 INFO:tasks.rados.rados.0.smithi084.stdout:2775: finishing copy_from to smithi08477944-17 2024-03-30T12:31:59.056 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 27276 (ObjNum 826 snap 273 seq_num 826) dirty exists 2024-03-30T12:31:59.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:58.996+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:59.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:31:58.996+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:59.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:58.990+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:59.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:58.990+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:59.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:58.990+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:59.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:58.991+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:31:59.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:58.991+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:59.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:58.991+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:59.271 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:31:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:31:58.998+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:59.271 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:58.991+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:31:59.272 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:58.992+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:31:59.272 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:58.991+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:59.272 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:58.991+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:31:59.272 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:58.991+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:59.272 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:59.008+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:59.272 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:31:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:59.015+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:59.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:59.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:59.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:59.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:59.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:59.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:59.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:59.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:59.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:59.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:59.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:59.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:59 smithi162 ceph-mon[83709]: Upgrade: Updating grafana.a 2024-03-30T12:31:59.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:59 smithi162 ceph-mon[83709]: Deploying daemon grafana.a on smithi162 2024-03-30T12:31:59.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:59 smithi162 ceph-mon[83709]: pgmap v630: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 765 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-03-30T12:31:59.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:31:59 smithi162 ceph-mon[83709]: osdmap e629: 8 total, 8 up, 8 in 2024-03-30T12:31:59.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:31:59] "GET /metrics HTTP/1.1" 200 36328 "" "Prometheus/2.43.0" 2024-03-30T12:31:59.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:59.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:59.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:59.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:59.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:59.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:59.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:59.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:59.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:59.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:59.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:59.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[91810]: Upgrade: Updating grafana.a 2024-03-30T12:31:59.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[91810]: Deploying daemon grafana.a on smithi162 2024-03-30T12:31:59.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[91810]: pgmap v630: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 765 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-03-30T12:31:59.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[91810]: osdmap e629: 8 total, 8 up, 8 in 2024-03-30T12:31:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:31:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:31:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:31:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:31:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:31:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:31:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:31:59.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:31:59.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:31:59.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:31:59.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:31:59.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[89279]: Upgrade: Updating grafana.a 2024-03-30T12:31:59.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[89279]: Deploying daemon grafana.a on smithi162 2024-03-30T12:31:59.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[89279]: pgmap v630: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 765 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-03-30T12:31:59.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-mon[89279]: osdmap e629: 8 total, 8 up, 8 in 2024-03-30T12:31:59.985 INFO:tasks.rados.rados.0.smithi084.stdout:2775: done (5 left) 2024-03-30T12:31:59.985 INFO:tasks.rados.rados.0.smithi084.stdout:2780: done (4 left) 2024-03-30T12:31:59.985 INFO:tasks.rados.rados.0.smithi084.stdout:2781: done (3 left) 2024-03-30T12:31:59.985 INFO:tasks.rados.rados.0.smithi084.stdout:2782: done (2 left) 2024-03-30T12:31:59.985 INFO:tasks.rados.rados.0.smithi084.stdout:2783: done (1 left) 2024-03-30T12:31:59.985 INFO:tasks.rados.rados.0.smithi084.stdout:2784: done (0 left) 2024-03-30T12:31:59.985 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 278 2024-03-30T12:31:59.985 INFO:tasks.rados.rados.0.smithi084.stdout:2785: seq_num 866 ranges {8192=106496} 2024-03-30T12:31:59.986 INFO:tasks.rados.rados.0.smithi084.stdout:2785: writing smithi08477944-45 from 8192 to 114688 tid 1 2024-03-30T12:31:59.986 INFO:tasks.rados.rados.0.smithi084.stdout:2786: read oid 41 snap 277 2024-03-30T12:31:59.986 INFO:tasks.rados.rados.0.smithi084.stdout:2786: expect (ObjNum 688 snap 241 seq_num 688) 2024-03-30T12:31:59.986 INFO:tasks.rados.rados.0.smithi084.stdout:2787: delete oid 6 current snap is 278 2024-03-30T12:31:59.989 INFO:tasks.rados.rados.0.smithi084.stdout:2785: finishing write tid 1 to smithi08477944-45 2024-03-30T12:31:59.990 INFO:tasks.rados.rados.0.smithi084.stdout:2787: done (2 left) 2024-03-30T12:31:59.991 INFO:tasks.rados.rados.0.smithi084.stdout:2788: copy_from oid 5 from oid 32 current snap is 278 2024-03-30T12:31:59.991 INFO:tasks.rados.rados.0.smithi084.stdout:2789: setattr oid 24 current snap is 278 2024-03-30T12:31:59.993 INFO:tasks.rados.rados.0.smithi084.stdout:2790: read oid 40 snap 276 2024-03-30T12:31:59.993 INFO:tasks.rados.rados.0.smithi084.stdout:2790: expect (ObjNum 843 snap 273 seq_num 843) 2024-03-30T12:31:59.993 INFO:tasks.rados.rados.0.smithi084.stdout:2791: copy_from oid 31 from oid 44 current snap is 278 2024-03-30T12:31:59.993 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 278 2024-03-30T12:31:59.993 INFO:tasks.rados.rados.0.smithi084.stdout:2792: seq_num 868 ranges {14524416=139264} 2024-03-30T12:32:00.073 INFO:tasks.rados.rados.0.smithi084.stdout:2792: writing smithi08477944-38 from 14524416 to 14663680 tid 1 2024-03-30T12:32:00.073 INFO:tasks.rados.rados.0.smithi084.stdout:2793: rollback oid 42 current snap is 278 2024-03-30T12:32:00.073 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 42 to 277 2024-03-30T12:32:00.073 INFO:tasks.rados.rados.0.smithi084.stdout:2791: finishing copy_from to smithi08477944-31 2024-03-30T12:32:00.074 INFO:tasks.rados.rados.0.smithi084.stdout:2791: got expected ENOENT (src dne) 2024-03-30T12:32:00.074 INFO:tasks.rados.rados.0.smithi084.stdout:2791: finishing copy_from racing read to smithi08477944-31 2024-03-30T12:32:00.074 INFO:tasks.rados.rados.0.smithi084.stdout:2788: finishing copy_from to smithi08477944-5 2024-03-30T12:32:00.074 INFO:tasks.rados.rados.0.smithi084.stdout:2788: got expected ENOENT (src dne) 2024-03-30T12:32:00.074 INFO:tasks.rados.rados.0.smithi084.stdout:2788: finishing copy_from racing read to smithi08477944-5 2024-03-30T12:32:00.074 INFO:tasks.rados.rados.0.smithi084.stdout:2785: finishing write tid 2 to smithi08477944-45 2024-03-30T12:32:00.074 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 23403 (ObjNum 818 snap 272 seq_num 818) dirty exists 2024-03-30T12:32:00.074 INFO:tasks.rados.rados.0.smithi084.stdout:2786: expect (ObjNum 688 snap 241 seq_num 688) 2024-03-30T12:32:00.185 INFO:tasks.rados.rados.0.smithi084.stdout:2785: finishing write tid 3 to smithi08477944-45 2024-03-30T12:32:00.185 INFO:tasks.rados.rados.0.smithi084.stdout:2785: oid 45 updating version 0 to 23410 2024-03-30T12:32:00.185 INFO:tasks.rados.rados.0.smithi084.stdout:2785: oid 45 updating version 23410 to 23411 2024-03-30T12:32:00.185 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 23411 (ObjNum 866 snap 278 seq_num 866) dirty exists 2024-03-30T12:32:00.185 INFO:tasks.rados.rados.0.smithi084.stdout:2785: left oid 45 (ObjNum 866 snap 278 seq_num 866) 2024-03-30T12:32:00.185 INFO:tasks.rados.rados.0.smithi084.stdout:2790: expect (ObjNum 843 snap 273 seq_num 843) 2024-03-30T12:32:00.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:00.004+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:00.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:00.004+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:00.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:59.991+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:00.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:59.991+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:00.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:59.992+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:00.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:59.992+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:00.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:31:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:31:59.992+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:00.273 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:00.005+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:00.273 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:59.994+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:00.274 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:31:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:31:59.994+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:00.274 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:59.994+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:00.274 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:31:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:31:59.994+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:00.274 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:59.998+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:00.274 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:59.998+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:00.274 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:31:59.998+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:00.438 INFO:tasks.rados.rados.0.smithi084.stdout:2793: finishing rollback tid 0 to smithi08477944-42 2024-03-30T12:32:00.439 INFO:tasks.rados.rados.0.smithi084.stdout:2792: finishing write tid 1 to smithi08477944-38 2024-03-30T12:32:00.439 INFO:tasks.rados.rados.0.smithi084.stdout:2793: finishing rollback tid 1 to smithi08477944-42 2024-03-30T12:32:00.439 INFO:tasks.rados.rados.0.smithi084.stdout:2793: finishing rollback tid 2 to smithi08477944-42 2024-03-30T12:32:00.439 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 27279 (ObjNum 825 snap 273 seq_num 825) dirty exists 2024-03-30T12:32:00.439 INFO:tasks.rados.rados.0.smithi084.stdout:2785: done (7 left) 2024-03-30T12:32:00.439 INFO:tasks.rados.rados.0.smithi084.stdout:2786: done (6 left) 2024-03-30T12:32:00.439 INFO:tasks.rados.rados.0.smithi084.stdout:2788: done (5 left) 2024-03-30T12:32:00.439 INFO:tasks.rados.rados.0.smithi084.stdout:2789: done (4 left) 2024-03-30T12:32:00.439 INFO:tasks.rados.rados.0.smithi084.stdout:2790: done (3 left) 2024-03-30T12:32:00.439 INFO:tasks.rados.rados.0.smithi084.stdout:2791: done (2 left) 2024-03-30T12:32:00.439 INFO:tasks.rados.rados.0.smithi084.stdout:2793: done (1 left) 2024-03-30T12:32:00.439 INFO:tasks.rados.rados.0.smithi084.stdout:2794: snap_remove snap 274 2024-03-30T12:32:00.549 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 153=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:00.549 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:00.549 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:00.549 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:00.549 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:00.549 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 153=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:00.549 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:00.549 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:00.549 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:00.550 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:00.550 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:00.550 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:00.550 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:00.550 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:00.550 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:00.550 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:32:00.550 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[89279]: osdmap e630: 8 total, 8 up, 8 in 2024-03-30T12:32:00.550 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 153=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:00.550 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:00.550 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:00.551 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:00.551 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:00.551 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 153=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:00.551 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:00.551 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:00.551 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:00.551 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:00.551 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:00.551 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:00.551 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:00.551 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:00.551 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:00.551 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:32:00.551 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:00 smithi084 ceph-mon[91810]: osdmap e630: 8 total, 8 up, 8 in 2024-03-30T12:32:00.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 153=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:00.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 153=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:00.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:00 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:32:00.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:00 smithi162 ceph-mon[83709]: osdmap e630: 8 total, 8 up, 8 in 2024-03-30T12:32:01.281 INFO:tasks.rados.rados.0.smithi084.stdout:2794: done (1 left) 2024-03-30T12:32:01.281 INFO:tasks.rados.rados.0.smithi084.stdout:2795: rollback oid 47 current snap is 278 2024-03-30T12:32:01.282 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 273 2024-03-30T12:32:01.282 INFO:tasks.rados.rados.0.smithi084.stdout:2792: finishing write tid 2 to smithi08477944-38 2024-03-30T12:32:01.282 INFO:tasks.rados.rados.0.smithi084.stdout:2792: finishing write tid 3 to smithi08477944-38 2024-03-30T12:32:01.282 INFO:tasks.rados.rados.0.smithi084.stdout:2792: oid 38 updating version 0 to 27277 2024-03-30T12:32:01.282 INFO:tasks.rados.rados.0.smithi084.stdout:2792: oid 38 updating version 27277 to 27278 2024-03-30T12:32:01.282 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 27278 (ObjNum 868 snap 278 seq_num 868) dirty exists 2024-03-30T12:32:01.282 INFO:tasks.rados.rados.0.smithi084.stdout:2792: left oid 38 (ObjNum 868 snap 278 seq_num 868) 2024-03-30T12:32:01.282 INFO:tasks.rados.rados.0.smithi084.stdout:2792: done (1 left) 2024-03-30T12:32:01.282 INFO:tasks.rados.rados.0.smithi084.stdout:2796: read oid 2 snap -1 2024-03-30T12:32:01.282 INFO:tasks.rados.rados.0.smithi084.stdout:2796: expect (ObjNum 753 snap 253 seq_num 753) 2024-03-30T12:32:01.282 INFO:tasks.rados.rados.0.smithi084.stdout:2797: delete oid 6 current snap is 278 2024-03-30T12:32:01.288 INFO:tasks.rados.rados.0.smithi084.stdout:2796: expect (ObjNum 753 snap 253 seq_num 753) 2024-03-30T12:32:01.311 INFO:tasks.rados.rados.0.smithi084.stdout:2795: finishing rollback tid 0 to smithi08477944-47 2024-03-30T12:32:01.311 INFO:tasks.rados.rados.0.smithi084.stdout:2795: finishing rollback tid 1 to smithi08477944-47 2024-03-30T12:32:01.311 INFO:tasks.rados.rados.0.smithi084.stdout:2795: finishing rollback tid 2 to smithi08477944-47 2024-03-30T12:32:01.311 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 23435 (ObjNum 688 snap 241 seq_num 688) dirty exists 2024-03-30T12:32:01.311 INFO:tasks.rados.rados.0.smithi084.stdout:2795: done (2 left) 2024-03-30T12:32:01.312 INFO:tasks.rados.rados.0.smithi084.stdout:2796: done (1 left) 2024-03-30T12:32:01.312 INFO:tasks.rados.rados.0.smithi084.stdout:2797: done (0 left) 2024-03-30T12:32:01.312 INFO:tasks.rados.rados.0.smithi084.stdout:2798: delete oid 12 current snap is 278 2024-03-30T12:32:01.315 INFO:tasks.rados.rados.0.smithi084.stdout:2798: done (0 left) 2024-03-30T12:32:01.315 INFO:tasks.rados.rados.0.smithi084.stdout:2799: read oid 45 snap -1 2024-03-30T12:32:01.316 INFO:tasks.rados.rados.0.smithi084.stdout:2799: expect (ObjNum 866 snap 278 seq_num 866) 2024-03-30T12:32:01.316 INFO:tasks.rados.rados.0.smithi084.stdout:2800: copy_from oid 44 from oid 31 current snap is 278 2024-03-30T12:32:01.316 INFO:tasks.rados.rados.0.smithi084.stdout:2801: rollback oid 4 current snap is 278 2024-03-30T12:32:01.316 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 4 to 276 2024-03-30T12:32:01.316 INFO:tasks.rados.rados.0.smithi084.stdout:2802: snap_create 2024-03-30T12:32:01.316 INFO:tasks.rados.rados.0.smithi084.stdout:2800: finishing copy_from to smithi08477944-44 2024-03-30T12:32:01.317 INFO:tasks.rados.rados.0.smithi084.stdout:2800: got expected ENOENT (src dne) 2024-03-30T12:32:01.317 INFO:tasks.rados.rados.0.smithi084.stdout:2800: finishing copy_from racing read to smithi08477944-44 2024-03-30T12:32:01.317 INFO:tasks.rados.rados.0.smithi084.stdout:2801: finishing rollback tid 1 to smithi08477944-4 2024-03-30T12:32:01.317 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 23389 (ObjNum 65 snap 0 seq_num 1884641892) dirty dne 2024-03-30T12:32:01.317 INFO:tasks.rados.rados.0.smithi084.stdout:2799: expect (ObjNum 866 snap 278 seq_num 866) 2024-03-30T12:32:01.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:01.298+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:01.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:01.298+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:01.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:01.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:01.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:01.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:01.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:01.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 153=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:01.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:01.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:01.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:01.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:01.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:01.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:01.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:01.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[91810]: pgmap v633: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 771 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.1 MiB/s wr, 19 op/s 2024-03-30T12:32:01.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:01.291+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:01.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:01.291+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:01.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:01.291+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:01.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:01.291+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:01.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:01.297+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:01.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:01.297+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:01.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:01.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:01.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:01.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:01.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:01.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 153=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:01.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:01.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:01.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:01.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:01.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:01.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:01.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:01.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:01 smithi084 ceph-mon[89279]: pgmap v633: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 771 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.1 MiB/s wr, 19 op/s 2024-03-30T12:32:01.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:01.323+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:01.619 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:01.289+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 153=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:01.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:01.289+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:01.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:01.292+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:01.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:01.294+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:01.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:01.287+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:01.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:01.287+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:01.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:01.287+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:01.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:01.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:01 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:01.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:01 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:01.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:01 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:01.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:01.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 153=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:01.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 13b=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:01.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:01.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:01.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:01.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:01 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:01.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:01 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:01.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:01.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:01 smithi162 ceph-mon[83709]: pgmap v633: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 771 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.1 MiB/s wr, 19 op/s 2024-03-30T12:32:02.290 INFO:tasks.rados.rados.0.smithi084.stdout:2799: done (3 left) 2024-03-30T12:32:02.290 INFO:tasks.rados.rados.0.smithi084.stdout:2800: done (2 left) 2024-03-30T12:32:02.291 INFO:tasks.rados.rados.0.smithi084.stdout:2801: done (1 left) 2024-03-30T12:32:02.291 INFO:tasks.rados.rados.0.smithi084.stdout:2802: done (0 left) 2024-03-30T12:32:02.291 INFO:tasks.rados.rados.0.smithi084.stdout:2803: snap_create 2024-03-30T12:32:02.602 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:02.293+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:02.603 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:02.603 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:02.603 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 153=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:02.603 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:02 smithi162 ceph-mon[83709]: osdmap e631: 8 total, 8 up, 8 in 2024-03-30T12:32:02.603 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:02.603 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:02.603 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:02.603 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:02.603 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:02.603 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:02.604 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:02.604 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:02.604 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:02.604 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:02.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:02.296+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:02.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:02.296+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:02.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:02.294+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:02.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:02.295+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:02.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:02.295+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:02.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:02.295+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:02.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:02.295+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:02.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:02.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:02.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 153=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:02.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[91810]: osdmap e631: 8 total, 8 up, 8 in 2024-03-30T12:32:02.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:02.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:02.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:02.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:02.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:02.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:02.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:02.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:02.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:02.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:02.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:02.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:02.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 153=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:02.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[89279]: osdmap e631: 8 total, 8 up, 8 in 2024-03-30T12:32:02.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:02.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:02.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:02.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:02.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:02.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:02.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:02.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:02.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:02.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:02.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:02.610+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:02.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:02.610+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:02.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:02.611+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:03.293 INFO:tasks.rados.rados.0.smithi084.stdout:2803: done (0 left) 2024-03-30T12:32:03.293 INFO:tasks.rados.rados.0.smithi084.stdout:2804: delete oid 22 current snap is 280 2024-03-30T12:32:03.302 INFO:tasks.rados.rados.0.smithi084.stdout:2804: done (0 left) 2024-03-30T12:32:03.302 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 280 2024-03-30T12:32:03.302 INFO:tasks.rados.rados.0.smithi084.stdout:2805: seq_num 872 ranges {3383296=212992} 2024-03-30T12:32:03.322 INFO:tasks.rados.rados.0.smithi084.stdout:2805: writing smithi08477944-47 from 3383296 to 3596288 tid 1 2024-03-30T12:32:03.322 INFO:tasks.rados.rados.0.smithi084.stdout:2806: setattr oid 7 current snap is 280 2024-03-30T12:32:03.323 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 280 2024-03-30T12:32:03.323 INFO:tasks.rados.rados.0.smithi084.stdout:2807: seq_num 873 ranges {745472=229376} 2024-03-30T12:32:03.329 INFO:tasks.rados.rados.0.smithi084.stdout:2807: writing smithi08477944-2 from 745472 to 974848 tid 1 2024-03-30T12:32:03.329 INFO:tasks.rados.rados.0.smithi084.stdout:2808: rmattr oid 28 current snap is 280 2024-03-30T12:32:03.329 INFO:tasks.rados.rados.0.smithi084.stdout:2805: finishing write tid 1 to smithi08477944-47 2024-03-30T12:32:03.329 INFO:tasks.rados.rados.0.smithi084.stdout:2805: finishing write tid 2 to smithi08477944-47 2024-03-30T12:32:03.329 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 23438 (ObjNum 65 snap 0 seq_num 1599235696) dirty exists 2024-03-30T12:32:03.329 INFO:tasks.rados.rados.0.smithi084.stdout:2805: finishing write tid 3 to smithi08477944-47 2024-03-30T12:32:03.330 INFO:tasks.rados.rados.0.smithi084.stdout:2805: oid 47 updating version 0 to 23437 2024-03-30T12:32:03.330 INFO:tasks.rados.rados.0.smithi084.stdout:2805: oid 47 version 23437 is already newer than 23436 2024-03-30T12:32:03.330 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 23437 (ObjNum 872 snap 280 seq_num 872) dirty exists 2024-03-30T12:32:03.330 INFO:tasks.rados.rados.0.smithi084.stdout:2805: left oid 47 (ObjNum 872 snap 280 seq_num 872) 2024-03-30T12:32:03.330 INFO:tasks.rados.rados.0.smithi084.stdout:2805: done (3 left) 2024-03-30T12:32:03.330 INFO:tasks.rados.rados.0.smithi084.stdout:2806: done (2 left) 2024-03-30T12:32:03.330 INFO:tasks.rados.rados.0.smithi084.stdout:2809: snap_create 2024-03-30T12:32:03.332 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 23401 (ObjNum 688 snap 241 seq_num 688) dirty exists 2024-03-30T12:32:03.336 INFO:tasks.rados.rados.0.smithi084.stdout:2807: finishing write tid 1 to smithi08477944-2 2024-03-30T12:32:03.336 INFO:tasks.rados.rados.0.smithi084.stdout:2807: finishing write tid 2 to smithi08477944-2 2024-03-30T12:32:03.339 INFO:tasks.rados.rados.0.smithi084.stdout:2807: finishing write tid 3 to smithi08477944-2 2024-03-30T12:32:03.339 INFO:tasks.rados.rados.0.smithi084.stdout:2807: oid 2 updating version 0 to 27294 2024-03-30T12:32:03.339 INFO:tasks.rados.rados.0.smithi084.stdout:2807: oid 2 updating version 27294 to 27295 2024-03-30T12:32:03.339 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 27295 (ObjNum 873 snap 280 seq_num 873) dirty exists 2024-03-30T12:32:03.339 INFO:tasks.rados.rados.0.smithi084.stdout:2807: left oid 2 (ObjNum 873 snap 280 seq_num 873) 2024-03-30T12:32:03.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:03.301+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:03.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:03.300+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:03.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:03.300+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:03.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:03.304+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:03.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:03.308+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:03.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:03.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:03 smithi162 ceph-mon[83709]: osdmap e632: 8 total, 8 up, 8 in 2024-03-30T12:32:03.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:03.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:03.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:03.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:03.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:03.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:03.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:03 smithi162 ceph-mon[83709]: pgmap v636: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 785 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 767 B/s rd, 5.0 MiB/s wr, 17 op/s 2024-03-30T12:32:03.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:03.308+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:03.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:03.308+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:03.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:03.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-mon[89279]: osdmap e632: 8 total, 8 up, 8 in 2024-03-30T12:32:03.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:03.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:03.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:03.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:03.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:03.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:03.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-mon[89279]: pgmap v636: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 785 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 767 B/s rd, 5.0 MiB/s wr, 17 op/s 2024-03-30T12:32:03.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:03.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-mon[91810]: osdmap e632: 8 total, 8 up, 8 in 2024-03-30T12:32:03.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:03.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:03.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:03.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:03.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:03.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:03.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-mon[91810]: pgmap v636: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 785 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 767 B/s rd, 5.0 MiB/s wr, 17 op/s 2024-03-30T12:32:03.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:03.299+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:03.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:03.299+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:03.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:03.299+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:03.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:03.299+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:03.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:03.300+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:03.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:03.300+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:04.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:03.711+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:04.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:03.711+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:04.301 INFO:tasks.rados.rados.0.smithi084.stdout:2807: done (2 left) 2024-03-30T12:32:04.301 INFO:tasks.rados.rados.0.smithi084.stdout:2808: done (1 left) 2024-03-30T12:32:04.301 INFO:tasks.rados.rados.0.smithi084.stdout:2809: done (0 left) 2024-03-30T12:32:04.301 INFO:tasks.rados.rados.0.smithi084.stdout:2810: copy_from oid 26 from oid 49 current snap is 281 2024-03-30T12:32:04.301 INFO:tasks.rados.rados.0.smithi084.stdout:2811: setattr oid 24 current snap is 281 2024-03-30T12:32:04.302 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 281 2024-03-30T12:32:04.302 INFO:tasks.rados.rados.0.smithi084.stdout:2812: seq_num 874 ranges {0=245760} 2024-03-30T12:32:04.303 INFO:tasks.rados.rados.0.smithi084.stdout:2812: writing smithi08477944-16 from 0 to 245760 tid 1 2024-03-30T12:32:04.303 INFO:tasks.rados.rados.0.smithi084.stdout:2813: delete oid 41 current snap is 281 2024-03-30T12:32:04.309 INFO:tasks.rados.rados.0.smithi084.stdout:2810: finishing copy_from to smithi08477944-26 2024-03-30T12:32:04.309 INFO:tasks.rados.rados.0.smithi084.stdout:2810: got expected ENOENT (src dne) 2024-03-30T12:32:04.309 INFO:tasks.rados.rados.0.smithi084.stdout:2810: finishing copy_from racing read to smithi08477944-26 2024-03-30T12:32:04.311 INFO:tasks.rados.rados.0.smithi084.stdout:2812: finishing write tid 1 to smithi08477944-16 2024-03-30T12:32:04.311 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 23404 (ObjNum 818 snap 272 seq_num 818) dirty exists 2024-03-30T12:32:04.311 INFO:tasks.rados.rados.0.smithi084.stdout:2812: finishing write tid 2 to smithi08477944-16 2024-03-30T12:32:04.312 INFO:tasks.rados.rados.0.smithi084.stdout:2810: done (3 left) 2024-03-30T12:32:04.312 INFO:tasks.rados.rados.0.smithi084.stdout:2811: done (2 left) 2024-03-30T12:32:04.312 INFO:tasks.rados.rados.0.smithi084.stdout:2813: done (1 left) 2024-03-30T12:32:04.312 INFO:tasks.rados.rados.0.smithi084.stdout:2814: rmattr oid 10 current snap is 281 2024-03-30T12:32:04.312 INFO:tasks.rados.rados.0.smithi084.stdout:2814: done (1 left) 2024-03-30T12:32:04.312 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 281 2024-03-30T12:32:04.312 INFO:tasks.rados.rados.0.smithi084.stdout:2815: seq_num 876 ranges {3833856=278528} 2024-03-30T12:32:04.334 INFO:tasks.rados.rados.0.smithi084.stdout:2815: writing smithi08477944-5 from 3833856 to 4112384 tid 1 2024-03-30T12:32:04.334 INFO:tasks.rados.rados.0.smithi084.stdout:2816: snap_create 2024-03-30T12:32:04.334 INFO:tasks.rados.rados.0.smithi084.stdout:2812: finishing write tid 3 to smithi08477944-16 2024-03-30T12:32:04.334 INFO:tasks.rados.rados.0.smithi084.stdout:2812: oid 16 updating version 0 to 23413 2024-03-30T12:32:04.334 INFO:tasks.rados.rados.0.smithi084.stdout:2812: oid 16 version 23413 is already newer than 23412 2024-03-30T12:32:04.334 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 23413 (ObjNum 874 snap 281 seq_num 874) dirty exists 2024-03-30T12:32:04.335 INFO:tasks.rados.rados.0.smithi084.stdout:2812: left oid 16 (ObjNum 874 snap 281 seq_num 874) 2024-03-30T12:32:04.337 INFO:tasks.rados.rados.0.smithi084.stdout:2815: finishing write tid 1 to smithi08477944-5 2024-03-30T12:32:04.338 INFO:tasks.rados.rados.0.smithi084.stdout:2815: finishing write tid 2 to smithi08477944-5 2024-03-30T12:32:04.339 INFO:tasks.rados.rados.0.smithi084.stdout:2815: finishing write tid 3 to smithi08477944-5 2024-03-30T12:32:04.339 INFO:tasks.rados.rados.0.smithi084.stdout:2815: oid 5 updating version 0 to 17518 2024-03-30T12:32:04.339 INFO:tasks.rados.rados.0.smithi084.stdout:2815: oid 5 version 17518 is already newer than 17517 2024-03-30T12:32:04.339 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 17518 (ObjNum 876 snap 281 seq_num 876) dirty exists 2024-03-30T12:32:04.339 INFO:tasks.rados.rados.0.smithi084.stdout:2815: left oid 5 (ObjNum 876 snap 281 seq_num 876) 2024-03-30T12:32:04.536 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-03-30T12:32:04.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:04.318+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:04.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:04.316+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:04.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:04.318+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:04.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:04.306+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:04.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:04.306+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:04.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:04.306+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:04.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:04.318+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:04.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:04.319+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:04.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:04.319+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:04.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:04.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:04.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:04.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:04.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:04.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:04.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:04.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:04.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:04.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:04 smithi162 ceph-mon[83709]: osdmap e633: 8 total, 8 up, 8 in 2024-03-30T12:32:04.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:04.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:04.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:04.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:04.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:04.315+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:04.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:04.316+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:04.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:04.307+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:04.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:04.307+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 156=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:04.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:04.308+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:04.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:04.308+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:04.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:04.308+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:04.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:04.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:04.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:04.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:04.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:04.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:04.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:04.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:04.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:04.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[89279]: osdmap e633: 8 total, 8 up, 8 in 2024-03-30T12:32:04.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:04.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:04.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:04.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:04.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:04.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:04.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:04.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:04.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:04.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:04.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:04.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:04.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:04.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[91810]: osdmap e633: 8 total, 8 up, 8 in 2024-03-30T12:32:04.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:04.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:04.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:04.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:04.849 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T12:32:04.850 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (16s) 12s ago 12m 15.9M - 0.25.0 c8568f914cd2 d373ca331553 2024-03-30T12:32:04.850 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi162 *:3000 running (11m) 28s ago 11m 92.0M - 9.4.7 954c08fa6188 ff2ec7518619 2024-03-30T12:32:04.850 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (89s) 12s ago 13m 14.1M - 19.0.0-1864-g5dc2ea30 548196a1a838 74abe81e0b10 2024-03-30T12:32:04.850 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi162 running (66s) 28s ago 13m 15.0M - 19.0.0-1864-g5dc2ea30 548196a1a838 38620aa52c54 2024-03-30T12:32:04.850 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi162 *:8443,9283,8765 running (7m) 28s ago 16m 452M - 19.0.0-1864-g5dc2ea30 548196a1a838 eec968f3fcc6 2024-03-30T12:32:04.850 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (8m) 12s ago 18m 520M - 19.0.0-1864-g5dc2ea30 548196a1a838 9a2aba19dffc 2024-03-30T12:32:04.850 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (7m) 12s ago 18m 71.8M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 a0811f2ae47d 2024-03-30T12:32:04.850 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi162 running (6m) 28s ago 17m 57.9M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 149ae6649e0c 2024-03-30T12:32:04.850 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (7m) 12s ago 16m 61.5M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 f79eca93cddd 2024-03-30T12:32:04.850 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (53s) 12s ago 11m 7675k - 1.5.0 0da6a335fe13 c19e5ff6fa83 2024-03-30T12:32:04.850 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi162 *:9100 running (49s) 28s ago 11m 7792k - 1.5.0 0da6a335fe13 fcd914fcfd78 2024-03-30T12:32:04.851 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (5m) 12s ago 16m 319M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 c91eea4f8484 2024-03-30T12:32:04.851 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (5m) 12s ago 15m 322M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 7518832f6b4a 2024-03-30T12:32:04.851 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (4m) 12s ago 15m 214M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 647dd862762d 2024-03-30T12:32:04.851 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (4m) 12s ago 15m 214M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 c088a701b71b 2024-03-30T12:32:04.851 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi162 running (3m) 28s ago 14m 301M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 4197b37d2bb8 2024-03-30T12:32:04.851 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi162 running (3m) 28s ago 14m 357M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 cd8795ac188a 2024-03-30T12:32:04.851 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi162 running (2m) 28s ago 13m 273M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 40ed6df81194 2024-03-30T12:32:04.851 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi162 running (115s) 28s ago 13m 226M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 b83812c70d9a 2024-03-30T12:32:04.851 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi162 *:9095 running (33s) 28s ago 12m 35.7M - 2.43.0 a07b618ecd1d bdbe25c7dd8b 2024-03-30T12:32:05.243 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-30T12:32:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-03-30T12:32:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 3 2024-03-30T12:32:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:32:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-03-30T12:32:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 2 2024-03-30T12:32:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:32:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-03-30T12:32:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 8 2024-03-30T12:32:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:32:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-03-30T12:32:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 2 2024-03-30T12:32:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:32:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-03-30T12:32:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 15 2024-03-30T12:32:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-30T12:32:05.244 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-30T12:32:05.309 INFO:tasks.rados.rados.0.smithi084.stdout:2812: done (2 left) 2024-03-30T12:32:05.309 INFO:tasks.rados.rados.0.smithi084.stdout:2815: done (1 left) 2024-03-30T12:32:05.309 INFO:tasks.rados.rados.0.smithi084.stdout:2816: done (0 left) 2024-03-30T12:32:05.309 INFO:tasks.rados.rados.0.smithi084.stdout:2817: delete oid 25 current snap is 282 2024-03-30T12:32:05.312 INFO:tasks.rados.rados.0.smithi084.stdout:2817: done (0 left) 2024-03-30T12:32:05.312 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 282 2024-03-30T12:32:05.312 INFO:tasks.rados.rados.0.smithi084.stdout:2818: seq_num 878 ranges {114688=311296} 2024-03-30T12:32:05.315 INFO:tasks.rados.rados.0.smithi084.stdout:2818: writing smithi08477944-45 from 114688 to 425984 tid 1 2024-03-30T12:32:05.315 INFO:tasks.rados.rados.0.smithi084.stdout:2819: read oid 17 snap -1 2024-03-30T12:32:05.315 INFO:tasks.rados.rados.0.smithi084.stdout:2819: expect (ObjNum 826 snap 273 seq_num 826) 2024-03-30T12:32:05.315 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 282 2024-03-30T12:32:05.315 INFO:tasks.rados.rados.0.smithi084.stdout:2820: seq_num 879 ranges {2318336=327680} 2024-03-30T12:32:05.330 INFO:tasks.rados.rados.0.smithi084.stdout:2820: writing smithi08477944-48 from 2318336 to 2646016 tid 1 2024-03-30T12:32:05.330 INFO:tasks.rados.rados.0.smithi084.stdout:2821: read oid 29 snap -1 2024-03-30T12:32:05.330 INFO:tasks.rados.rados.0.smithi084.stdout:2821: expect (ObjNum 836 snap 273 seq_num 836) 2024-03-30T12:32:05.330 INFO:tasks.rados.rados.0.smithi084.stdout:2822: copy_from oid 28 from oid 16 current snap is 282 2024-03-30T12:32:05.330 INFO:tasks.rados.rados.0.smithi084.stdout:2818: finishing write tid 1 to smithi08477944-45 2024-03-30T12:32:05.330 INFO:tasks.rados.rados.0.smithi084.stdout:2818: finishing write tid 2 to smithi08477944-45 2024-03-30T12:32:05.331 INFO:tasks.rados.rados.0.smithi084.stdout:2818: finishing write tid 3 to smithi08477944-45 2024-03-30T12:32:05.331 INFO:tasks.rados.rados.0.smithi084.stdout:2818: oid 45 updating version 0 to 23416 2024-03-30T12:32:05.331 INFO:tasks.rados.rados.0.smithi084.stdout:2818: oid 45 version 23416 is already newer than 23415 2024-03-30T12:32:05.331 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 23416 (ObjNum 878 snap 282 seq_num 878) dirty exists 2024-03-30T12:32:05.331 INFO:tasks.rados.rados.0.smithi084.stdout:2818: left oid 45 (ObjNum 878 snap 282 seq_num 878) 2024-03-30T12:32:05.331 INFO:tasks.rados.rados.0.smithi084.stdout:2818: done (4 left) 2024-03-30T12:32:05.331 INFO:tasks.rados.rados.0.smithi084.stdout:2823: delete oid 24 current snap is 282 2024-03-30T12:32:05.336 INFO:tasks.rados.rados.0.smithi084.stdout:2823: done (4 left) 2024-03-30T12:32:05.336 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 282 2024-03-30T12:32:05.336 INFO:tasks.rados.rados.0.smithi084.stdout:2820: finishing write tid 1 to smithi08477944-48 2024-03-30T12:32:05.336 INFO:tasks.rados.rados.0.smithi084.stdout:2824: seq_num 881 ranges {3596288=360448} 2024-03-30T12:32:05.359 INFO:tasks.rados.rados.0.smithi084.stdout:2824: writing smithi08477944-47 from 3596288 to 3956736 tid 1 2024-03-30T12:32:05.359 INFO:tasks.rados.rados.0.smithi084.stdout:2825: copy_from oid 43 from oid 40 current snap is 282 2024-03-30T12:32:05.359 INFO:tasks.rados.rados.0.smithi084.stdout:2820: finishing write tid 2 to smithi08477944-48 2024-03-30T12:32:05.359 INFO:tasks.rados.rados.0.smithi084.stdout:2820: finishing write tid 3 to smithi08477944-48 2024-03-30T12:32:05.359 INFO:tasks.rados.rados.0.smithi084.stdout:2820: oid 48 updating version 0 to 928 2024-03-30T12:32:05.359 INFO:tasks.rados.rados.0.smithi084.stdout:2820: oid 48 updating version 928 to 929 2024-03-30T12:32:05.359 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 929 (ObjNum 879 snap 282 seq_num 879) dirty exists 2024-03-30T12:32:05.359 INFO:tasks.rados.rados.0.smithi084.stdout:2820: left oid 48 (ObjNum 879 snap 282 seq_num 879) 2024-03-30T12:32:05.360 INFO:tasks.rados.rados.0.smithi084.stdout:2821: expect (ObjNum 836 snap 273 seq_num 836) 2024-03-30T12:32:05.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:05.325+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:05.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:05.326+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:05.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:05.313+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:05.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:05.313+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:05.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:05.314+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:05.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:05.314+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 156=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:05.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:05.314+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:05.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:05.314+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:05.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 156=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[91810]: osdmap e634: 8 total, 8 up, 8 in 2024-03-30T12:32:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[91810]: from='client.44393 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:32:05.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[91810]: pgmap v639: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 786 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 6.8 MiB/s rd, 3.6 MiB/s wr, 24 op/s 2024-03-30T12:32:05.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/3484627883' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:05.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:05.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:05.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:05.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:05.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:05.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 156=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:05.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[89279]: osdmap e634: 8 total, 8 up, 8 in 2024-03-30T12:32:05.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:05.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[89279]: from='client.44393 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:32:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[89279]: pgmap v639: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 786 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 6.8 MiB/s rd, 3.6 MiB/s wr, 24 op/s 2024-03-30T12:32:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:05 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/3484627883' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:05.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:05.342+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:05.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:05.315+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:05.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:05.316+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:05.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:05.315+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:05.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:05.316+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:05.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:05.321+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:05.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:05.321+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:05.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:05.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:05.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:05.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:05.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:05.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 156=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:05.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:05 smithi162 ceph-mon[83709]: osdmap e634: 8 total, 8 up, 8 in 2024-03-30T12:32:05.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:05.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:05.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:05.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:05.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:05.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 152=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:05.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:05.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:05 smithi162 ceph-mon[83709]: from='client.44393 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:32:05.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:05 smithi162 ceph-mon[83709]: pgmap v639: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 786 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 6.8 MiB/s rd, 3.6 MiB/s wr, 24 op/s 2024-03-30T12:32:05.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:05 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/3484627883' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:05.670 INFO:tasks.rados.rados.0.smithi084.stdout:2822: finishing copy_from racing read to smithi08477944-28 2024-03-30T12:32:05.670 INFO:tasks.rados.rados.0.smithi084.stdout:2822: finishing copy_from to smithi08477944-28 2024-03-30T12:32:05.670 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 23413 (ObjNum 874 snap 281 seq_num 874) dirty exists 2024-03-30T12:32:05.670 INFO:tasks.rados.rados.0.smithi084.stdout:2824: finishing write tid 1 to smithi08477944-47 2024-03-30T12:32:05.670 INFO:tasks.rados.rados.0.smithi084.stdout:2820: done (5 left) 2024-03-30T12:32:05.670 INFO:tasks.rados.rados.0.smithi084.stdout:2821: done (4 left) 2024-03-30T12:32:05.670 INFO:tasks.rados.rados.0.smithi084.stdout:2822: done (3 left) 2024-03-30T12:32:05.670 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 282 2024-03-30T12:32:05.671 INFO:tasks.rados.rados.0.smithi084.stdout:2824: finishing write tid 2 to smithi08477944-47 2024-03-30T12:32:05.671 INFO:tasks.rados.rados.0.smithi084.stdout:2824: finishing write tid 3 to smithi08477944-47 2024-03-30T12:32:05.671 INFO:tasks.rados.rados.0.smithi084.stdout:2824: oid 47 updating version 0 to 23439 2024-03-30T12:32:05.671 INFO:tasks.rados.rados.0.smithi084.stdout:2824: oid 47 updating version 23439 to 23440 2024-03-30T12:32:05.671 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 23440 (ObjNum 881 snap 282 seq_num 881) dirty exists 2024-03-30T12:32:05.671 INFO:tasks.rados.rados.0.smithi084.stdout:2824: left oid 47 (ObjNum 881 snap 282 seq_num 881) 2024-03-30T12:32:05.671 INFO:tasks.rados.rados.0.smithi084.stdout:2819: expect (ObjNum 826 snap 273 seq_num 826) 2024-03-30T12:32:06.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:06.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:06.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:06 smithi162 ceph-mon[83709]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:32:06.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:06.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:06.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 156=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:06.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:06.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:06 smithi162 ceph-mon[83709]: osdmap e635: 8 total, 8 up, 8 in 2024-03-30T12:32:06.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 157=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:06.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:06.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:06.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:06.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:06.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:06.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:06.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:06.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:06.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:06.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:06.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[91810]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:32:06.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:06.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:06.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 156=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:06.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:06.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[91810]: osdmap e635: 8 total, 8 up, 8 in 2024-03-30T12:32:06.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 157=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:06.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:06.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:06.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:06.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:06.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:06.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:06.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:06.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:06.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:06.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:06.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[89279]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:32:06.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:06.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:06.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 156=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:06.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:06.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[89279]: osdmap e635: 8 total, 8 up, 8 in 2024-03-30T12:32:06.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 157=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:06.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:06.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:06.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:06.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:06.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:06.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:06.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:06.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:07.067 INFO:tasks.rados.rados.0.smithi084.stdout:2825: finishing copy_from racing read to smithi08477944-43 2024-03-30T12:32:07.067 INFO:tasks.rados.rados.0.smithi084.stdout:2825: finishing copy_from to smithi08477944-43 2024-03-30T12:32:07.067 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 23426 (ObjNum 843 snap 273 seq_num 843) dirty exists 2024-03-30T12:32:07.067 INFO:tasks.rados.rados.0.smithi084.stdout:2826: seq_num 882 ranges {3268608=376832} 2024-03-30T12:32:07.086 INFO:tasks.rados.rados.0.smithi084.stdout:2826: writing smithi08477944-11 from 3268608 to 3645440 tid 1 2024-03-30T12:32:07.086 INFO:tasks.rados.rados.0.smithi084.stdout:2819: done (3 left) 2024-03-30T12:32:07.087 INFO:tasks.rados.rados.0.smithi084.stdout:2824: done (2 left) 2024-03-30T12:32:07.087 INFO:tasks.rados.rados.0.smithi084.stdout:2825: done (1 left) 2024-03-30T12:32:07.087 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 28 current snap is 282 2024-03-30T12:32:07.087 INFO:tasks.rados.rados.0.smithi084.stdout:2827: seq_num 883 ranges {245760=393216} 2024-03-30T12:32:07.090 INFO:tasks.rados.rados.0.smithi084.stdout:2827: writing smithi08477944-28 from 245760 to 638976 tid 1 2024-03-30T12:32:07.090 INFO:tasks.rados.rados.0.smithi084.stdout:2828: rmattr oid 40 current snap is 282 2024-03-30T12:32:07.090 INFO:tasks.rados.rados.0.smithi084.stdout:2829: snap_create 2024-03-30T12:32:07.091 INFO:tasks.rados.rados.0.smithi084.stdout:2826: finishing write tid 1 to smithi08477944-11 2024-03-30T12:32:07.091 INFO:tasks.rados.rados.0.smithi084.stdout:2826: finishing write tid 2 to smithi08477944-11 2024-03-30T12:32:07.093 INFO:tasks.rados.rados.0.smithi084.stdout:2827: finishing write tid 1 to smithi08477944-28 2024-03-30T12:32:07.093 INFO:tasks.rados.rados.0.smithi084.stdout:2826: finishing write tid 3 to smithi08477944-11 2024-03-30T12:32:07.094 INFO:tasks.rados.rados.0.smithi084.stdout:2826: oid 11 updating version 0 to 17520 2024-03-30T12:32:07.094 INFO:tasks.rados.rados.0.smithi084.stdout:2826: oid 11 updating version 17520 to 17521 2024-03-30T12:32:07.094 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 17521 (ObjNum 882 snap 282 seq_num 882) dirty exists 2024-03-30T12:32:07.094 INFO:tasks.rados.rados.0.smithi084.stdout:2826: left oid 11 (ObjNum 882 snap 282 seq_num 882) 2024-03-30T12:32:07.094 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 23441 (ObjNum 843 snap 273 seq_num 843) dirty exists 2024-03-30T12:32:07.094 INFO:tasks.rados.rados.0.smithi084.stdout:2827: finishing write tid 2 to smithi08477944-28 2024-03-30T12:32:07.094 INFO:tasks.rados.rados.0.smithi084.stdout:2827: finishing write tid 3 to smithi08477944-28 2024-03-30T12:32:07.095 INFO:tasks.rados.rados.0.smithi084.stdout:2827: oid 28 updating version 0 to 23414 2024-03-30T12:32:07.095 INFO:tasks.rados.rados.0.smithi084.stdout:2827: oid 28 updating version 23414 to 23415 2024-03-30T12:32:07.095 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 23415 (ObjNum 883 snap 282 seq_num 883) dirty exists 2024-03-30T12:32:07.095 INFO:tasks.rados.rados.0.smithi084.stdout:2827: left oid 28 (ObjNum 883 snap 282 seq_num 883) 2024-03-30T12:32:07.313 INFO:tasks.rados.rados.0.smithi084.stdout:2826: done (3 left) 2024-03-30T12:32:07.313 INFO:tasks.rados.rados.0.smithi084.stdout:2827: done (2 left) 2024-03-30T12:32:07.313 INFO:tasks.rados.rados.0.smithi084.stdout:2828: done (1 left) 2024-03-30T12:32:07.314 INFO:tasks.rados.rados.0.smithi084.stdout:2829: done (0 left) 2024-03-30T12:32:07.314 INFO:tasks.rados.rados.0.smithi084.stdout:2830: delete oid 7 current snap is 283 2024-03-30T12:32:07.317 INFO:tasks.rados.rados.0.smithi084.stdout:2830: done (0 left) 2024-03-30T12:32:07.317 INFO:tasks.rados.rados.0.smithi084.stdout:2831: snap_remove snap 280 2024-03-30T12:32:07.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:07 smithi162 ceph-mon[83709]: pgmap v641: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 786 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 16 MiB/s rd, 152 KiB/s wr, 27 op/s 2024-03-30T12:32:07.620 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:07.321+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:07.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:07.321+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:07.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:07.322+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:07.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:07 smithi084 ceph-mon[89279]: pgmap v641: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 786 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 16 MiB/s rd, 152 KiB/s wr, 27 op/s 2024-03-30T12:32:07.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:07 smithi084 ceph-mon[91810]: pgmap v641: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 786 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 16 MiB/s rd, 152 KiB/s wr, 27 op/s 2024-03-30T12:32:07.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:07.326+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:07.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:07.326+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:07.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:07.320+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 156=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:07.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:07.320+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:07.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:07.321+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:07.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:07.321+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:07.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:07.321+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:08.034 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:07.712+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:08.034 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:07.712+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:08.034 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:07.712+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:08.310 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:08.042+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:08.310 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:08.042+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:08.311 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:08.042+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:08.322 INFO:tasks.rados.rados.0.smithi084.stdout:2831: done (0 left) 2024-03-30T12:32:08.322 INFO:tasks.rados.rados.0.smithi084.stdout:2832: read oid 20 snap -1 2024-03-30T12:32:08.322 INFO:tasks.rados.rados.0.smithi084.stdout:2832: expect deleted 2024-03-30T12:32:08.322 INFO:tasks.rados.rados.0.smithi084.stdout:2833: read oid 12 snap -1 2024-03-30T12:32:08.322 INFO:tasks.rados.rados.0.smithi084.stdout:2833: expect deleted 2024-03-30T12:32:08.322 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 283 2024-03-30T12:32:08.322 INFO:tasks.rados.rados.0.smithi084.stdout:2834: seq_num 885 ranges {0=425984} 2024-03-30T12:32:08.325 INFO:tasks.rados.rados.0.smithi084.stdout:2834: writing smithi08477944-3 from 0 to 425984 tid 1 2024-03-30T12:32:08.325 INFO:tasks.rados.rados.0.smithi084.stdout:2835: read oid 24 snap 278 2024-03-30T12:32:08.325 INFO:tasks.rados.rados.0.smithi084.stdout:2835: expect (ObjNum 818 snap 272 seq_num 818) 2024-03-30T12:32:08.325 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 283 2024-03-30T12:32:08.325 INFO:tasks.rados.rados.0.smithi084.stdout:2836: seq_num 886 ranges {245760=442368} 2024-03-30T12:32:08.329 INFO:tasks.rados.rados.0.smithi084.stdout:2836: writing smithi08477944-16 from 245760 to 688128 tid 1 2024-03-30T12:32:08.329 INFO:tasks.rados.rados.0.smithi084.stdout:2837: read oid 31 snap -1 2024-03-30T12:32:08.329 INFO:tasks.rados.rados.0.smithi084.stdout:2837: expect deleted 2024-03-30T12:32:08.329 INFO:tasks.rados.rados.0.smithi084.stdout:2838: delete oid 38 current snap is 283 2024-03-30T12:32:08.334 INFO:tasks.rados.rados.0.smithi084.stdout:2836: finishing write tid 1 to smithi08477944-16 2024-03-30T12:32:08.335 INFO:tasks.rados.rados.0.smithi084.stdout:2836: finishing write tid 2 to smithi08477944-16 2024-03-30T12:32:08.335 INFO:tasks.rados.rados.0.smithi084.stdout:2832: done (6 left) 2024-03-30T12:32:08.336 INFO:tasks.rados.rados.0.smithi084.stdout:2833: done (5 left) 2024-03-30T12:32:08.336 INFO:tasks.rados.rados.0.smithi084.stdout:2837: done (4 left) 2024-03-30T12:32:08.336 INFO:tasks.rados.rados.0.smithi084.stdout:2838: done (3 left) 2024-03-30T12:32:08.336 INFO:tasks.rados.rados.0.smithi084.stdout:2839: read oid 40 snap 278 2024-03-30T12:32:08.336 INFO:tasks.rados.rados.0.smithi084.stdout:2839: expect (ObjNum 843 snap 273 seq_num 843) 2024-03-30T12:32:08.336 INFO:tasks.rados.rados.0.smithi084.stdout:2840: copy_from oid 29 from oid 44 current snap is 283 2024-03-30T12:32:08.336 INFO:tasks.rados.rados.0.smithi084.stdout:2841: read oid 33 snap 279 2024-03-30T12:32:08.337 INFO:tasks.rados.rados.0.smithi084.stdout:2841: expect (ObjNum 809 snap 270 seq_num 809) 2024-03-30T12:32:08.337 INFO:tasks.rados.rados.0.smithi084.stdout:2842: copy_from oid 5 from oid 13 current snap is 283 2024-03-30T12:32:08.337 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 283 2024-03-30T12:32:08.337 INFO:tasks.rados.rados.0.smithi084.stdout:2843: seq_num 888 ranges {0=475136} 2024-03-30T12:32:08.339 INFO:tasks.rados.rados.0.smithi084.stdout:2843: writing smithi08477944-22 from 0 to 475136 tid 1 2024-03-30T12:32:08.339 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 283 2024-03-30T12:32:08.340 INFO:tasks.rados.rados.0.smithi084.stdout:2840: finishing copy_from to smithi08477944-29 2024-03-30T12:32:08.340 INFO:tasks.rados.rados.0.smithi084.stdout:2840: got expected ENOENT (src dne) 2024-03-30T12:32:08.340 INFO:tasks.rados.rados.0.smithi084.stdout:2840: finishing copy_from racing read to smithi08477944-29 2024-03-30T12:32:08.340 INFO:tasks.rados.rados.0.smithi084.stdout:2836: finishing write tid 3 to smithi08477944-16 2024-03-30T12:32:08.340 INFO:tasks.rados.rados.0.smithi084.stdout:2836: oid 16 updating version 0 to 23418 2024-03-30T12:32:08.340 INFO:tasks.rados.rados.0.smithi084.stdout:2836: oid 16 version 23418 is already newer than 23417 2024-03-30T12:32:08.340 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 23418 (ObjNum 886 snap 283 seq_num 886) dirty exists 2024-03-30T12:32:08.340 INFO:tasks.rados.rados.0.smithi084.stdout:2836: left oid 16 (ObjNum 886 snap 283 seq_num 886) 2024-03-30T12:32:08.340 INFO:tasks.rados.rados.0.smithi084.stdout:2844: seq_num 889 ranges {0=491520} 2024-03-30T12:32:08.342 INFO:tasks.rados.rados.0.smithi084.stdout:2844: writing smithi08477944-37 from 0 to 491520 tid 1 2024-03-30T12:32:08.343 INFO:tasks.rados.rados.0.smithi084.stdout:2836: done (8 left) 2024-03-30T12:32:08.343 INFO:tasks.rados.rados.0.smithi084.stdout:2840: done (7 left) 2024-03-30T12:32:08.343 INFO:tasks.rados.rados.0.smithi084.stdout:2845: rollback oid 17 current snap is 283 2024-03-30T12:32:08.343 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 17 to 273 2024-03-30T12:32:08.343 INFO:tasks.rados.rados.0.smithi084.stdout:2834: finishing write tid 1 to smithi08477944-3 2024-03-30T12:32:08.343 INFO:tasks.rados.rados.0.smithi084.stdout:2834: finishing write tid 2 to smithi08477944-3 2024-03-30T12:32:08.343 INFO:tasks.rados.rados.0.smithi084.stdout:2846: copy_from oid 2 from oid 27 current snap is 283 2024-03-30T12:32:08.343 INFO:tasks.rados.rados.0.smithi084.stdout:2847: snap_create 2024-03-30T12:32:08.349 INFO:tasks.rados.rados.0.smithi084.stdout:2845: finishing rollback tid 0 to smithi08477944-17 2024-03-30T12:32:08.349 INFO:tasks.rados.rados.0.smithi084.stdout:2845: finishing rollback tid 1 to smithi08477944-17 2024-03-30T12:32:08.349 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 27281 (ObjNum 33 snap 0 seq_num 180241073) dirty dne 2024-03-30T12:32:08.350 INFO:tasks.rados.rados.0.smithi084.stdout:2843: finishing write tid 1 to smithi08477944-22 2024-03-30T12:32:08.356 INFO:tasks.rados.rados.0.smithi084.stdout:2844: finishing write tid 1 to smithi08477944-37 2024-03-30T12:32:08.357 INFO:tasks.rados.rados.0.smithi084.stdout:2844: finishing write tid 2 to smithi08477944-37 2024-03-30T12:32:08.362 INFO:tasks.rados.rados.0.smithi084.stdout:2835: expect (ObjNum 818 snap 272 seq_num 818) 2024-03-30T12:32:08.460 INFO:tasks.rados.rados.0.smithi084.stdout:2843: finishing write tid 2 to smithi08477944-22 2024-03-30T12:32:08.460 INFO:tasks.rados.rados.0.smithi084.stdout:2834: finishing write tid 3 to smithi08477944-3 2024-03-30T12:32:08.460 INFO:tasks.rados.rados.0.smithi084.stdout:2834: oid 3 updating version 0 to 27296 2024-03-30T12:32:08.460 INFO:tasks.rados.rados.0.smithi084.stdout:2834: oid 3 updating version 27296 to 27297 2024-03-30T12:32:08.461 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 27297 (ObjNum 885 snap 283 seq_num 885) dirty exists 2024-03-30T12:32:08.461 INFO:tasks.rados.rados.0.smithi084.stdout:2834: left oid 3 (ObjNum 885 snap 283 seq_num 885) 2024-03-30T12:32:08.461 INFO:tasks.rados.rados.0.smithi084.stdout:2843: finishing write tid 3 to smithi08477944-22 2024-03-30T12:32:08.461 INFO:tasks.rados.rados.0.smithi084.stdout:2843: oid 22 updating version 0 to 27299 2024-03-30T12:32:08.461 INFO:tasks.rados.rados.0.smithi084.stdout:2843: oid 22 version 27299 is already newer than 27298 2024-03-30T12:32:08.461 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 27299 (ObjNum 888 snap 283 seq_num 888) dirty exists 2024-03-30T12:32:08.461 INFO:tasks.rados.rados.0.smithi084.stdout:2843: left oid 22 (ObjNum 888 snap 283 seq_num 888) 2024-03-30T12:32:08.461 INFO:tasks.rados.rados.0.smithi084.stdout:2839: expect (ObjNum 843 snap 273 seq_num 843) 2024-03-30T12:32:08.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:08.365+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:08.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:08.328+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:08.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:08.329+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:08.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:08.373+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:08.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:08.374+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:08.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:08.329+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 157=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:08.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:08.330+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:08.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:08 smithi162 ceph-mon[83709]: No clone_snaps in snapset 156=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:08.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:08.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:08.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:08.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:08 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:08.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:08 smithi162 ceph-mon[83709]: osdmap e636: 8 total, 8 up, 8 in 2024-03-30T12:32:08.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:08 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:08.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:08 smithi162 ceph-mon[83709]: No clone_snaps in snapset 157=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:08.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:08.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:08.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:08 smithi162 ceph-mon[83709]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:08.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:08 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:08.712 INFO:tasks.rados.rados.0.smithi084.stdout:2844: finishing write tid 3 to smithi08477944-37 2024-03-30T12:32:08.713 INFO:tasks.rados.rados.0.smithi084.stdout:2844: oid 37 updating version 0 to 36263 2024-03-30T12:32:08.713 INFO:tasks.rados.rados.0.smithi084.stdout:2844: oid 37 version 36263 is already newer than 36262 2024-03-30T12:32:08.713 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 36263 (ObjNum 889 snap 283 seq_num 889) dirty exists 2024-03-30T12:32:08.713 INFO:tasks.rados.rados.0.smithi084.stdout:2844: left oid 37 (ObjNum 889 snap 283 seq_num 889) 2024-03-30T12:32:08.713 INFO:tasks.rados.rados.0.smithi084.stdout:2841: expect (ObjNum 809 snap 270 seq_num 809) 2024-03-30T12:32:08.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:08.341+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:08.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:08.341+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:08.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-mon[89279]: No clone_snaps in snapset 156=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:08.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:08.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:08.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:08.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:08.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-mon[89279]: osdmap e636: 8 total, 8 up, 8 in 2024-03-30T12:32:08.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:08.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-mon[89279]: No clone_snaps in snapset 157=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:08.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:08.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:08.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-mon[89279]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:08.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:08.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-mon[91810]: No clone_snaps in snapset 156=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:08.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:08.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:08.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:08.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:08.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-mon[91810]: osdmap e636: 8 total, 8 up, 8 in 2024-03-30T12:32:08.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:08.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-mon[91810]: No clone_snaps in snapset 157=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:08.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:08.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:08.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-mon[91810]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:08.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:08.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:08.334+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:08.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:08.334+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:08.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:08.334+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:08.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:08.334+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:08.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:08.334+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:08.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:08.334+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:08.807 INFO:tasks.rados.rados.0.smithi084.stdout:2846: finishing copy_from racing read to smithi08477944-2 2024-03-30T12:32:08.808 INFO:tasks.rados.rados.0.smithi084.stdout:2846: finishing copy_from to smithi08477944-2 2024-03-30T12:32:08.808 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 27209 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:32:08.808 INFO:tasks.rados.rados.0.smithi084.stdout:2842: finishing copy_from racing read to smithi08477944-5 2024-03-30T12:32:08.808 INFO:tasks.rados.rados.0.smithi084.stdout:2842: finishing copy_from to smithi08477944-5 2024-03-30T12:32:08.808 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 23394 (ObjNum 836 snap 273 seq_num 836) dirty exists 2024-03-30T12:32:09.327 INFO:tasks.rados.rados.0.smithi084.stdout:2834: done (9 left) 2024-03-30T12:32:09.327 INFO:tasks.rados.rados.0.smithi084.stdout:2835: done (8 left) 2024-03-30T12:32:09.327 INFO:tasks.rados.rados.0.smithi084.stdout:2839: done (7 left) 2024-03-30T12:32:09.327 INFO:tasks.rados.rados.0.smithi084.stdout:2841: done (6 left) 2024-03-30T12:32:09.327 INFO:tasks.rados.rados.0.smithi084.stdout:2842: done (5 left) 2024-03-30T12:32:09.327 INFO:tasks.rados.rados.0.smithi084.stdout:2843: done (4 left) 2024-03-30T12:32:09.327 INFO:tasks.rados.rados.0.smithi084.stdout:2844: done (3 left) 2024-03-30T12:32:09.327 INFO:tasks.rados.rados.0.smithi084.stdout:2845: done (2 left) 2024-03-30T12:32:09.327 INFO:tasks.rados.rados.0.smithi084.stdout:2846: done (1 left) 2024-03-30T12:32:09.327 INFO:tasks.rados.rados.0.smithi084.stdout:2847: done (0 left) 2024-03-30T12:32:09.328 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 284 2024-03-30T12:32:09.328 INFO:tasks.rados.rados.0.smithi084.stdout:2848: seq_num 890 ranges {0=507904} 2024-03-30T12:32:09.329 INFO:tasks.rados.rados.0.smithi084.stdout:2848: writing smithi08477944-2 from 0 to 507904 tid 1 2024-03-30T12:32:09.329 INFO:tasks.rados.rados.0.smithi084.stdout:2849: setattr oid 41 current snap is 284 2024-03-30T12:32:09.330 INFO:tasks.rados.rados.0.smithi084.stdout:2850: read oid 44 snap -1 2024-03-30T12:32:09.330 INFO:tasks.rados.rados.0.smithi084.stdout:2850: expect deleted 2024-03-30T12:32:09.330 INFO:tasks.rados.rados.0.smithi084.stdout:2851: read oid 6 snap -1 2024-03-30T12:32:09.330 INFO:tasks.rados.rados.0.smithi084.stdout:2851: expect deleted 2024-03-30T12:32:09.331 INFO:tasks.rados.rados.0.smithi084.stdout:2852: read oid 35 snap -1 2024-03-30T12:32:09.331 INFO:tasks.rados.rados.0.smithi084.stdout:2852: expect (ObjNum 664 snap 232 seq_num 664) 2024-03-30T12:32:09.331 INFO:tasks.rados.rados.0.smithi084.stdout:2853: delete oid 45 current snap is 284 2024-03-30T12:32:09.336 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 23419 (ObjNum 49 snap 0 seq_num 194350706) dirty exists 2024-03-30T12:32:09.336 INFO:tasks.rados.rados.0.smithi084.stdout:2849: done (5 left) 2024-03-30T12:32:09.336 INFO:tasks.rados.rados.0.smithi084.stdout:2850: done (4 left) 2024-03-30T12:32:09.336 INFO:tasks.rados.rados.0.smithi084.stdout:2851: done (3 left) 2024-03-30T12:32:09.336 INFO:tasks.rados.rados.0.smithi084.stdout:2853: done (2 left) 2024-03-30T12:32:09.336 INFO:tasks.rados.rados.0.smithi084.stdout:2854: read oid 43 snap -1 2024-03-30T12:32:09.336 INFO:tasks.rados.rados.0.smithi084.stdout:2854: expect (ObjNum 843 snap 273 seq_num 843) 2024-03-30T12:32:09.336 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 284 2024-03-30T12:32:09.336 INFO:tasks.rados.rados.0.smithi084.stdout:2855: seq_num 892 ranges {0=548864} 2024-03-30T12:32:09.339 INFO:tasks.rados.rados.0.smithi084.stdout:2855: writing smithi08477944-7 from 0 to 548864 tid 1 2024-03-30T12:32:09.339 INFO:tasks.rados.rados.0.smithi084.stdout:2856: delete oid 33 current snap is 284 2024-03-30T12:32:09.343 INFO:tasks.rados.rados.0.smithi084.stdout:2852: expect (ObjNum 664 snap 232 seq_num 664) 2024-03-30T12:32:09.387 INFO:tasks.rados.rados.0.smithi084.stdout:2848: finishing write tid 1 to smithi08477944-2 2024-03-30T12:32:09.387 INFO:tasks.rados.rados.0.smithi084.stdout:2848: finishing write tid 2 to smithi08477944-2 2024-03-30T12:32:09.388 INFO:tasks.rados.rados.0.smithi084.stdout:2855: finishing write tid 1 to smithi08477944-7 2024-03-30T12:32:09.388 INFO:tasks.rados.rados.0.smithi084.stdout:2855: finishing write tid 2 to smithi08477944-7 2024-03-30T12:32:09.388 INFO:tasks.rados.rados.0.smithi084.stdout:2855: finishing write tid 3 to smithi08477944-7 2024-03-30T12:32:09.388 INFO:tasks.rados.rados.0.smithi084.stdout:2855: oid 7 updating version 0 to 23444 2024-03-30T12:32:09.388 INFO:tasks.rados.rados.0.smithi084.stdout:2855: oid 7 version 23444 is already newer than 23443 2024-03-30T12:32:09.388 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 23444 (ObjNum 892 snap 284 seq_num 892) dirty exists 2024-03-30T12:32:09.388 INFO:tasks.rados.rados.0.smithi084.stdout:2855: left oid 7 (ObjNum 892 snap 284 seq_num 892) 2024-03-30T12:32:09.388 INFO:tasks.rados.rados.0.smithi084.stdout:2848: finishing write tid 3 to smithi08477944-2 2024-03-30T12:32:09.388 INFO:tasks.rados.rados.0.smithi084.stdout:2848: oid 2 updating version 0 to 27304 2024-03-30T12:32:09.388 INFO:tasks.rados.rados.0.smithi084.stdout:2848: oid 2 version 27304 is already newer than 27303 2024-03-30T12:32:09.388 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 27304 (ObjNum 890 snap 284 seq_num 890) dirty exists 2024-03-30T12:32:09.388 INFO:tasks.rados.rados.0.smithi084.stdout:2848: left oid 2 (ObjNum 890 snap 284 seq_num 890) 2024-03-30T12:32:09.388 INFO:tasks.rados.rados.0.smithi084.stdout:2848: done (4 left) 2024-03-30T12:32:09.388 INFO:tasks.rados.rados.0.smithi084.stdout:2852: done (3 left) 2024-03-30T12:32:09.388 INFO:tasks.rados.rados.0.smithi084.stdout:2855: done (2 left) 2024-03-30T12:32:09.389 INFO:tasks.rados.rados.0.smithi084.stdout:2856: done (1 left) 2024-03-30T12:32:09.389 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 284 2024-03-30T12:32:09.389 INFO:tasks.rados.rados.0.smithi084.stdout:2854: expect (ObjNum 843 snap 273 seq_num 843) 2024-03-30T12:32:09.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:09.335+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:09.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:09.335+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:09.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:09.335+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:09.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:09.341+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:09.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:09.342+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:09.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:09.352+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:09.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:09.342+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:09.621 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:09.343+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 157=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-mon[83709]: osdmap e637: 8 total, 8 up, 8 in 2024-03-30T12:32:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-mon[83709]: pgmap v644: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 793 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 14 MiB/s rd, 1.8 MiB/s wr, 17 op/s 2024-03-30T12:32:09.637 INFO:tasks.rados.rados.0.smithi084.stdout:2857: seq_num 894 ranges {0=581632} 2024-03-30T12:32:09.641 INFO:tasks.rados.rados.0.smithi084.stdout:2857: writing smithi08477944-10 from 0 to 581632 tid 1 2024-03-30T12:32:09.641 INFO:tasks.rados.rados.0.smithi084.stdout:2854: done (1 left) 2024-03-30T12:32:09.641 INFO:tasks.rados.rados.0.smithi084.stdout:2858: snap_create 2024-03-30T12:32:09.650 INFO:tasks.rados.rados.0.smithi084.stdout:2857: finishing write tid 1 to smithi08477944-10 2024-03-30T12:32:09.650 INFO:tasks.rados.rados.0.smithi084.stdout:2857: finishing write tid 2 to smithi08477944-10 2024-03-30T12:32:09.653 INFO:tasks.rados.rados.0.smithi084.stdout:2857: finishing write tid 3 to smithi08477944-10 2024-03-30T12:32:09.653 INFO:tasks.rados.rados.0.smithi084.stdout:2857: oid 10 updating version 0 to 36264 2024-03-30T12:32:09.654 INFO:tasks.rados.rados.0.smithi084.stdout:2857: oid 10 updating version 36264 to 36265 2024-03-30T12:32:09.654 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 36265 (ObjNum 894 snap 284 seq_num 894) dirty exists 2024-03-30T12:32:09.654 INFO:tasks.rados.rados.0.smithi084.stdout:2857: left oid 10 (ObjNum 894 snap 284 seq_num 894) 2024-03-30T12:32:09.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:32:09] "GET /metrics HTTP/1.1" 200 36330 "" "Prometheus/2.43.0" 2024-03-30T12:32:09.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:09.334+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:09.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:09.335+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:09.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:09.332+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:09.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:09.332+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:09.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:09.332+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:09.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:09.332+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:09.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:09.333+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:09.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:09.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:09.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:09.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:09.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 157=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:09.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[91810]: osdmap e637: 8 total, 8 up, 8 in 2024-03-30T12:32:09.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:09.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:09.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:09.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:09.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:09.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:09.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:09.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:09.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:09.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:09.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[91810]: pgmap v644: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 793 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 14 MiB/s rd, 1.8 MiB/s wr, 17 op/s 2024-03-30T12:32:09.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:09.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:09.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:09.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:09.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 157=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:09.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[89279]: osdmap e637: 8 total, 8 up, 8 in 2024-03-30T12:32:09.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:09.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:09.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:09.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:09.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:09.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:09.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:09.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 14b=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:09.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:09.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:09.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:09 smithi084 ceph-mon[89279]: pgmap v644: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 793 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 14 MiB/s rd, 1.8 MiB/s wr, 17 op/s 2024-03-30T12:32:10.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:09.662+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:10.335 INFO:tasks.rados.rados.0.smithi084.stdout:2857: done (1 left) 2024-03-30T12:32:10.335 INFO:tasks.rados.rados.0.smithi084.stdout:2858: done (0 left) 2024-03-30T12:32:10.335 INFO:tasks.rados.rados.0.smithi084.stdout:2859: read oid 2 snap 273 2024-03-30T12:32:10.335 INFO:tasks.rados.rados.0.smithi084.stdout:2859: expect (ObjNum 753 snap 253 seq_num 753) 2024-03-30T12:32:10.336 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 12 current snap is 285 2024-03-30T12:32:10.336 INFO:tasks.rados.rados.0.smithi084.stdout:2860: seq_num 895 ranges {0=598016} 2024-03-30T12:32:10.338 INFO:tasks.rados.rados.0.smithi084.stdout:2860: writing smithi08477944-12 from 0 to 598016 tid 1 2024-03-30T12:32:10.338 INFO:tasks.rados.rados.0.smithi084.stdout:2861: read oid 18 snap -1 2024-03-30T12:32:10.338 INFO:tasks.rados.rados.0.smithi084.stdout:2861: expect (ObjNum 861 snap 277 seq_num 861) 2024-03-30T12:32:10.339 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 285 2024-03-30T12:32:10.339 INFO:tasks.rados.rados.0.smithi084.stdout:2862: seq_num 896 ranges {0=614400} 2024-03-30T12:32:10.343 INFO:tasks.rados.rados.0.smithi084.stdout:2862: writing smithi08477944-24 from 0 to 614400 tid 1 2024-03-30T12:32:10.343 INFO:tasks.rados.rados.0.smithi084.stdout:2863: read oid 37 snap -1 2024-03-30T12:32:10.343 INFO:tasks.rados.rados.0.smithi084.stdout:2863: expect (ObjNum 889 snap 283 seq_num 889) 2024-03-30T12:32:10.343 INFO:tasks.rados.rados.0.smithi084.stdout:2864: rmattr oid 14 current snap is 285 2024-03-30T12:32:10.343 INFO:tasks.rados.rados.0.smithi084.stdout:2865: snap_remove snap 282 2024-03-30T12:32:10.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:10.352+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:10.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:10.342+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:10.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:10.342+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:10.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:10.343+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:10.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:10.343+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:10.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:10.346+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:10.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:10.349+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:10 smithi162 ceph-mon[83709]: osdmap e638: 8 total, 8 up, 8 in 2024-03-30T12:32:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:10.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:10.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:10.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:10.355+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:10.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:10.356+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:10.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:10.341+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:10.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:10.341+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:10.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:10.341+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:10.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:10.341+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:10.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:10.342+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:10.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:10.342+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:10.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:10.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:10.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:10.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:10.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[89279]: osdmap e638: 8 total, 8 up, 8 in 2024-03-30T12:32:10.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:10.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:10.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:10.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:10.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:10.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:10.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:10.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:10.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:10.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:10.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:10.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:10.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:10.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[91810]: osdmap e638: 8 total, 8 up, 8 in 2024-03-30T12:32:10.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:10.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:10.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:10.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:10.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:10.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:10.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:10.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:10.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:11.341 INFO:tasks.rados.rados.0.smithi084.stdout:2865: done (6 left) 2024-03-30T12:32:11.341 INFO:tasks.rados.rados.0.smithi084.stdout:2866: snap_remove snap 277 2024-03-30T12:32:11.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:11.584+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:11.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:11.347+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:11.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:11.347+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:11.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:11.346+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:11.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:11.346+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:11.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:11.347+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:11.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:11.527+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:11.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:11.528+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:11.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:11.528+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:11.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:11 smithi162 ceph-mon[83709]: osdmap e639: 8 total, 8 up, 8 in 2024-03-30T12:32:11.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:11.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:11.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:11.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:11.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:11.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:11.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:11.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:11.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:11.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:11.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:11.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:11.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:11.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:11 smithi162 ceph-mon[83709]: pgmap v647: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 802 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 6.4 MiB/s rd, 3.9 MiB/s wr, 18 op/s 2024-03-30T12:32:11.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:11.587+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:11.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:11.587+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:11.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:11.346+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:11.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:11.346+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:11.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:11.346+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:11.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:11.347+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:11.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:11.347+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:11.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[89279]: osdmap e639: 8 total, 8 up, 8 in 2024-03-30T12:32:11.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:11.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:11.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:11.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:11.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:11.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:11.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:11.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:11.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:11.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:11.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:11.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:11.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:11.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[89279]: pgmap v647: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 802 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 6.4 MiB/s rd, 3.9 MiB/s wr, 18 op/s 2024-03-30T12:32:11.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[91810]: osdmap e639: 8 total, 8 up, 8 in 2024-03-30T12:32:11.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:11.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:11.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:11.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:11.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:11.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:11.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:11.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:11.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:11.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:11.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:11.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:11.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:11.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:11 smithi084 ceph-mon[91810]: pgmap v647: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 802 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 6.4 MiB/s rd, 3.9 MiB/s wr, 18 op/s 2024-03-30T12:32:12.346 INFO:tasks.rados.rados.0.smithi084.stdout:2866: done (6 left) 2024-03-30T12:32:12.346 INFO:tasks.rados.rados.0.smithi084.stdout:2867: read oid 44 snap 278 2024-03-30T12:32:12.346 INFO:tasks.rados.rados.0.smithi084.stdout:2867: expect deleted 2024-03-30T12:32:12.346 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 285 2024-03-30T12:32:12.346 INFO:tasks.rados.rados.0.smithi084.stdout:2868: seq_num 897 ranges {1105920=630784} 2024-03-30T12:32:12.353 INFO:tasks.rados.rados.0.smithi084.stdout:2868: writing smithi08477944-21 from 1105920 to 1736704 tid 1 2024-03-30T12:32:12.353 INFO:tasks.rados.rados.0.smithi084.stdout:2869: read oid 35 snap 279 2024-03-30T12:32:12.353 INFO:tasks.rados.rados.0.smithi084.stdout:2869: expect (ObjNum 664 snap 232 seq_num 664) 2024-03-30T12:32:12.353 INFO:tasks.rados.rados.0.smithi084.stdout:2870: delete oid 17 current snap is 285 2024-03-30T12:32:12.353 INFO:tasks.rados.rados.0.smithi084.stdout:2859: expect (ObjNum 753 snap 253 seq_num 753) 2024-03-30T12:32:12.378 INFO:tasks.rados.rados.0.smithi084.stdout:2860: finishing write tid 1 to smithi08477944-12 2024-03-30T12:32:12.378 INFO:tasks.rados.rados.0.smithi084.stdout:2860: finishing write tid 2 to smithi08477944-12 2024-03-30T12:32:12.379 INFO:tasks.rados.rados.0.smithi084.stdout:2863: expect (ObjNum 889 snap 283 seq_num 889) 2024-03-30T12:32:12.391 INFO:tasks.rados.rados.0.smithi084.stdout:2861: expect (ObjNum 861 snap 277 seq_num 861) 2024-03-30T12:32:12.612 INFO:tasks.rados.rados.0.smithi084.stdout:2860: finishing write tid 3 to smithi08477944-12 2024-03-30T12:32:12.612 INFO:tasks.rados.rados.0.smithi084.stdout:2860: oid 12 updating version 0 to 27224 2024-03-30T12:32:12.612 INFO:tasks.rados.rados.0.smithi084.stdout:2860: oid 12 version 27224 is already newer than 27223 2024-03-30T12:32:12.612 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 27224 (ObjNum 895 snap 285 seq_num 895) dirty exists 2024-03-30T12:32:12.612 INFO:tasks.rados.rados.0.smithi084.stdout:2860: left oid 12 (ObjNum 895 snap 285 seq_num 895) 2024-03-30T12:32:12.612 INFO:tasks.rados.rados.0.smithi084.stdout:2862: finishing write tid 1 to smithi08477944-24 2024-03-30T12:32:12.612 INFO:tasks.rados.rados.0.smithi084.stdout:2862: finishing write tid 2 to smithi08477944-24 2024-03-30T12:32:12.613 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 36266 (ObjNum 851 snap 276 seq_num 851) dirty exists 2024-03-30T12:32:12.613 INFO:tasks.rados.rados.0.smithi084.stdout:2862: finishing write tid 3 to smithi08477944-24 2024-03-30T12:32:12.613 INFO:tasks.rados.rados.0.smithi084.stdout:2862: oid 24 updating version 0 to 23406 2024-03-30T12:32:12.613 INFO:tasks.rados.rados.0.smithi084.stdout:2862: oid 24 updating version 23406 to 23407 2024-03-30T12:32:12.613 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 23407 (ObjNum 896 snap 285 seq_num 896) dirty exists 2024-03-30T12:32:12.613 INFO:tasks.rados.rados.0.smithi084.stdout:2862: left oid 24 (ObjNum 896 snap 285 seq_num 896) 2024-03-30T12:32:12.613 INFO:tasks.rados.rados.0.smithi084.stdout:2859: done (9 left) 2024-03-30T12:32:12.613 INFO:tasks.rados.rados.0.smithi084.stdout:2860: done (8 left) 2024-03-30T12:32:12.613 INFO:tasks.rados.rados.0.smithi084.stdout:2861: done (7 left) 2024-03-30T12:32:12.613 INFO:tasks.rados.rados.0.smithi084.stdout:2862: done (6 left) 2024-03-30T12:32:12.613 INFO:tasks.rados.rados.0.smithi084.stdout:2863: done (5 left) 2024-03-30T12:32:12.613 INFO:tasks.rados.rados.0.smithi084.stdout:2864: done (4 left) 2024-03-30T12:32:12.613 INFO:tasks.rados.rados.0.smithi084.stdout:2870: done (3 left) 2024-03-30T12:32:12.613 INFO:tasks.rados.rados.0.smithi084.stdout:2871: read oid 38 snap -1 2024-03-30T12:32:12.613 INFO:tasks.rados.rados.0.smithi084.stdout:2871: expect deleted 2024-03-30T12:32:12.614 INFO:tasks.rados.rados.0.smithi084.stdout:2872: snap_remove snap 281 2024-03-30T12:32:12.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:12.368+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:12.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:12.348+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:12.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:12.348+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:12.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:12.367+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:12.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:12.367+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:12.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:12.349+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:12.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:12.349+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:12.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:12.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:12.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:12.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:12.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:12.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:12.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:12.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:12.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:12 smithi162 ceph-mon[83709]: osdmap e640: 8 total, 8 up, 8 in 2024-03-30T12:32:12.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:12.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:12.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:12.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:12.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:12.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:12.364+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:12.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:12.365+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:12.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:12.347+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:12.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:12.347+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:12.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:12.347+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:12.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:12.347+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:12.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:12.347+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:12.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:12.348+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:12.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:12.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:12.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:12.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:12.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:12.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:12.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:12.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:12.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[89279]: osdmap e640: 8 total, 8 up, 8 in 2024-03-30T12:32:12.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:12.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:12.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:12.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:12.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:12.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:12.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:12.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:12.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:12.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:12.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:12.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:12.760 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:12.760 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[91810]: osdmap e640: 8 total, 8 up, 8 in 2024-03-30T12:32:12.760 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:12.760 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:12.760 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:12.760 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:12.760 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:13.225 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:12 smithi162 systemd[1]: Stopping Ceph grafana.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:32:13.358 INFO:tasks.rados.rados.0.smithi084.stdout:2872: done (4 left) 2024-03-30T12:32:13.358 INFO:tasks.rados.rados.0.smithi084.stdout:2873: snap_remove snap 283 2024-03-30T12:32:13.490 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:13 smithi162 podman[119838]: 2024-03-30 12:32:13.234756556 +0000 UTC m=+0.126536184 container died ff2ec7518619faa0720c398aed5015153a48c711eefc804727ad4a3e662cfee2 (image=quay.io/ceph/ceph-grafana:9.4.7, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, name=ubi8, io.k8s.display-name=Red Hat Universal Base Image 8, version=8.5, io.openshift.tags=base rhel8, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, description=Ceph Grafana Container, release=239.1651231664, distribution-scope=public, io.openshift.expose-services=, vendor=Red Hat, Inc., com.redhat.component=ubi8-container, io.buildah.version=1.32.0, vcs-type=git, summary=Grafana Container configured for Ceph mgr/dashboard integration, architecture=x86_64, build-date=2022-04-29T11:48:11.055897, maintainer=Paul Cuzner ) 2024-03-30T12:32:13.491 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:13.365+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:13.491 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:13.365+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:13.491 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:13.365+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15b=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:13.491 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:13.491 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:13.491 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:13.491 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:13.492 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:13.492 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:13.492 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:13.492 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:13.492 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:13 smithi162 ceph-mon[83709]: osdmap e641: 8 total, 8 up, 8 in 2024-03-30T12:32:13.492 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:13.492 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:13.492 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:13.492 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:13.492 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:13.492 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:13 smithi162 ceph-mon[83709]: pgmap v650: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 802 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 6.4 MiB/s rd, 2.0 MiB/s wr, 8 op/s 2024-03-30T12:32:13.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:13.365+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:13.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:13.367+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:13.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:13.364+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:13.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:13.366+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:13.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:13.366+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:13.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:13.366+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:13.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:13.366+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:13.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:13.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:13.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:13.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:13.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:13.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:13.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:13.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:13.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[91810]: osdmap e641: 8 total, 8 up, 8 in 2024-03-30T12:32:13.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:13.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:13.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:13.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:13.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:13.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[91810]: pgmap v650: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 802 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 6.4 MiB/s rd, 2.0 MiB/s wr, 8 op/s 2024-03-30T12:32:13.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:13.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:13.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:13.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:13.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:13.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 143=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:13.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:13.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:13.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[89279]: osdmap e641: 8 total, 8 up, 8 in 2024-03-30T12:32:13.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:13.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:13.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:13.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:13.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:13.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:13 smithi084 ceph-mon[89279]: pgmap v650: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 802 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 6.4 MiB/s rd, 2.0 MiB/s wr, 8 op/s 2024-03-30T12:32:13.832 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:13.690+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:13.832 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:13 smithi162 podman[119838]: 2024-03-30 12:32:13.590615513 +0000 UTC m=+0.482395141 container cleanup ff2ec7518619faa0720c398aed5015153a48c711eefc804727ad4a3e662cfee2 (image=quay.io/ceph/ceph-grafana:9.4.7, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a, io.openshift.expose-services=, maintainer=Paul Cuzner , io.buildah.version=1.32.0, release=239.1651231664, distribution-scope=public, io.openshift.tags=base rhel8, architecture=x86_64, com.redhat.component=ubi8-container, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, description=Ceph Grafana Container, io.k8s.display-name=Red Hat Universal Base Image 8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, vcs-type=git, version=8.5, summary=Grafana Container configured for Ceph mgr/dashboard integration, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, build-date=2022-04-29T11:48:11.055897, vendor=Red Hat, Inc., io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., name=ubi8) 2024-03-30T12:32:13.832 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:13 smithi162 bash[119838]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a 2024-03-30T12:32:13.833 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:13.596+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:13.833 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:13.596+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:13.833 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:13.596+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:14.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:13.839+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:14.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:13.839+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:14.120 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:13 smithi162 podman[119853]: 2024-03-30 12:32:13.879375737 +0000 UTC m=+0.644326441 container remove ff2ec7518619faa0720c398aed5015153a48c711eefc804727ad4a3e662cfee2 (image=quay.io/ceph/ceph-grafana:9.4.7, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a, build-date=2022-04-29T11:48:11.055897, io.openshift.tags=base rhel8, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, description=Ceph Grafana Container, io.buildah.version=1.32.0, io.openshift.expose-services=, vcs-type=git, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, name=ubi8, io.k8s.display-name=Red Hat Universal Base Image 8, maintainer=Paul Cuzner , architecture=x86_64, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, release=239.1651231664, summary=Grafana Container configured for Ceph mgr/dashboard integration, com.redhat.component=ubi8-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., distribution-scope=public, version=8.5, vendor=Red Hat, Inc.) 2024-03-30T12:32:14.120 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:13 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@grafana.a.service: Main process exited, code=exited, status=143/n/a 2024-03-30T12:32:14.120 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@grafana.a.service: Failed with result 'exit-code'. 2024-03-30T12:32:14.120 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 systemd[1]: Stopped Ceph grafana.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:32:14.120 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@grafana.a.service: Consumed 11.004s CPU time. 2024-03-30T12:32:14.373 INFO:tasks.rados.rados.0.smithi084.stdout:2873: done (4 left) 2024-03-30T12:32:14.373 INFO:tasks.rados.rados.0.smithi084.stdout:2874: snap_create 2024-03-30T12:32:14.374 INFO:tasks.rados.rados.0.smithi084.stdout:2869: expect (ObjNum 664 snap 232 seq_num 664) 2024-03-30T12:32:14.413 INFO:tasks.rados.rados.0.smithi084.stdout:2868: finishing write tid 1 to smithi08477944-21 2024-03-30T12:32:14.413 INFO:tasks.rados.rados.0.smithi084.stdout:2868: finishing write tid 2 to smithi08477944-21 2024-03-30T12:32:14.413 INFO:tasks.rados.rados.0.smithi084.stdout:2868: finishing write tid 3 to smithi08477944-21 2024-03-30T12:32:14.413 INFO:tasks.rados.rados.0.smithi084.stdout:2868: oid 21 updating version 0 to 25295 2024-03-30T12:32:14.413 INFO:tasks.rados.rados.0.smithi084.stdout:2868: oid 21 version 25295 is already newer than 25294 2024-03-30T12:32:14.414 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 25295 (ObjNum 897 snap 285 seq_num 897) dirty exists 2024-03-30T12:32:14.414 INFO:tasks.rados.rados.0.smithi084.stdout:2868: left oid 21 (ObjNum 897 snap 285 seq_num 897) 2024-03-30T12:32:14.575 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:14.375+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:14.575 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:14.375+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15b=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:14.575 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:14.379+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:14.576 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:14.380+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:14.576 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:14.582+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:14.576 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:14.582+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:14.576 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 systemd[1]: Starting Ceph grafana.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:32:14.576 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 podman[119994]: 2024-03-30 12:32:14.373610595 +0000 UTC m=+0.019328316 image pull a0ea5e3c46d9434bd173d585b7c2638c7451eaf2543d1d22f9e78442615aaffb quay.io/ceph/ceph-grafana:9.4.12 2024-03-30T12:32:14.576 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 podman[119994]: 2024-03-30 12:32:14.48446733 +0000 UTC m=+0.130185034 container create 8cc7d12810a612fc13d34fdc9922a14ea7b8e836aa00bb27392d7291fb1d356f (image=quay.io/ceph/ceph-grafana:9.4.12, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, vendor=Red Hat, Inc., description=Ceph Grafana Container, maintainer=Paul Cuzner , com.redhat.component=ubi8-container, version=8.5, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.buildah.version=1.32.0, release=239.1651231664, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., build-date=2022-04-29T11:48:11.055897, vcs-type=git, name=ubi8, architecture=x86_64, distribution-scope=public, io.k8s.display-name=Red Hat Universal Base Image 8, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, io.openshift.expose-services=, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.openshift.tags=base rhel8, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com) 2024-03-30T12:32:14.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:14.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:14.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15b=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:14.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-mon[83709]: osdmap e642: 8 total, 8 up, 8 in 2024-03-30T12:32:14.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:14.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:14.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:14.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:14.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:14.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:14.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:14.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:14.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:14.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:14.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:14.503+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:14.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:14.503+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:14.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:14.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:14.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15b=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:14.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[91810]: osdmap e642: 8 total, 8 up, 8 in 2024-03-30T12:32:14.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:14.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:14.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:14.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:14.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:14.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:14.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:14.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:14.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:14.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:14.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:14.380+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:14.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:14.380+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:14.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:14.380+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:14.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:14.380+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:14.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:14.380+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:14.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:14.380+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:14.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:14.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:14.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15b=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:14.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[89279]: osdmap e642: 8 total, 8 up, 8 in 2024-03-30T12:32:14.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:14.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:14.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:14.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:14.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:14.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:14.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:14.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:14.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:14.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:14.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 podman[119994]: 2024-03-30 12:32:14.779256735 +0000 UTC m=+0.424974452 container init 8cc7d12810a612fc13d34fdc9922a14ea7b8e836aa00bb27392d7291fb1d356f (image=quay.io/ceph/ceph-grafana:9.4.12, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.buildah.version=1.32.0, vcs-type=git, name=ubi8, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, architecture=x86_64, version=8.5, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, io.openshift.tags=base rhel8, maintainer=Paul Cuzner , io.k8s.display-name=Red Hat Universal Base Image 8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, release=239.1651231664, vendor=Red Hat, Inc., summary=Grafana Container configured for Ceph mgr/dashboard integration, build-date=2022-04-29T11:48:11.055897, description=Ceph Grafana Container, distribution-scope=public, io.openshift.expose-services=, com.redhat.component=ubi8-container) 2024-03-30T12:32:14.845 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 podman[119994]: 2024-03-30 12:32:14.781945242 +0000 UTC m=+0.427662945 container start 8cc7d12810a612fc13d34fdc9922a14ea7b8e836aa00bb27392d7291fb1d356f (image=quay.io/ceph/ceph-grafana:9.4.12, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, io.openshift.expose-services=, vcs-type=git, name=ubi8, io.k8s.display-name=Red Hat Universal Base Image 8, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, release=239.1651231664, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., description=Ceph Grafana Container, build-date=2022-04-29T11:48:11.055897, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, distribution-scope=public, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.openshift.tags=base rhel8, com.redhat.component=ubi8-container, io.buildah.version=1.32.0, architecture=x86_64, version=8.5, vendor=Red Hat, Inc., maintainer=Paul Cuzner ) 2024-03-30T12:32:15.120 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 bash[119994]: 8cc7d12810a612fc13d34fdc9922a14ea7b8e836aa00bb27392d7291fb1d356f 2024-03-30T12:32:15.120 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 systemd[1]: Started Ceph grafana.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:32:15.120 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=settings t=2024-03-30T12:32:14.934599589Z level=info msg="Starting Grafana" version=9.4.12 commit=37ee25ba46 branch=HEAD compiled=2023-05-22T15:58:05Z 2024-03-30T12:32:15.120 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=settings t=2024-03-30T12:32:14.934786889Z level=warn msg="\"sentry\" frontend logging provider is deprecated and will be removed in the next major version. Use \"grafana\" provider instead." 2024-03-30T12:32:15.120 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=settings t=2024-03-30T12:32:14.934821206Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-03-30T12:32:15.120 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=settings t=2024-03-30T12:32:14.934828163Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-03-30T12:32:15.120 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=settings t=2024-03-30T12:32:14.934834372Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-03-30T12:32:15.120 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=settings t=2024-03-30T12:32:14.934840551Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-03-30T12:32:15.120 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=settings t=2024-03-30T12:32:14.934846273Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-03-30T12:32:15.120 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=settings t=2024-03-30T12:32:14.934852161Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-03-30T12:32:15.121 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=settings t=2024-03-30T12:32:14.934858052Z level=info msg="Path Home" path=/usr/share/grafana 2024-03-30T12:32:15.121 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=settings t=2024-03-30T12:32:14.934863775Z level=info msg="Path Data" path=/var/lib/grafana 2024-03-30T12:32:15.121 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=settings t=2024-03-30T12:32:14.934870021Z level=info msg="Path Logs" path=/var/log/grafana 2024-03-30T12:32:15.121 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=settings t=2024-03-30T12:32:14.934875569Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-03-30T12:32:15.121 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=settings t=2024-03-30T12:32:14.934881251Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-03-30T12:32:15.121 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=settings t=2024-03-30T12:32:14.934887089Z level=info msg="App mode production" 2024-03-30T12:32:15.121 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=sqlstore t=2024-03-30T12:32:14.9349289Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-03-30T12:32:15.121 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=sqlstore t=2024-03-30T12:32:14.934950645Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-03-30T12:32:15.121 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=migrator t=2024-03-30T12:32:14.948613279Z level=info msg="Starting DB migrations" 2024-03-30T12:32:15.121 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=migrator t=2024-03-30T12:32:14.953421351Z level=info msg="migrations completed" performed=0 skipped=481 duration=475.648µs 2024-03-30T12:32:15.121 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=sqlstore t=2024-03-30T12:32:14.95381184Z level=info msg="Created default organization" 2024-03-30T12:32:15.121 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=plugin.loader t=2024-03-30T12:32:15.011466343Z level=info msg="Plugin registered" pluginID=input 2024-03-30T12:32:15.121 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=plugin.loader t=2024-03-30T12:32:15.039686037Z level=info msg="Plugin registered" pluginID=vonage-status-panel 2024-03-30T12:32:15.121 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=plugin.loader t=2024-03-30T12:32:15.039734035Z level=info msg="Plugin registered" pluginID=grafana-piechart-panel 2024-03-30T12:32:15.122 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=secrets t=2024-03-30T12:32:15.039771772Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-03-30T12:32:15.122 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=query_data t=2024-03-30T12:32:15.043353417Z level=info msg="Query Service initialization" 2024-03-30T12:32:15.122 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=live.push_http t=2024-03-30T12:32:15.045947412Z level=info msg="Live Push Gateway initialization" 2024-03-30T12:32:15.378 INFO:tasks.rados.rados.0.smithi084.stdout:2867: done (4 left) 2024-03-30T12:32:15.378 INFO:tasks.rados.rados.0.smithi084.stdout:2868: done (3 left) 2024-03-30T12:32:15.378 INFO:tasks.rados.rados.0.smithi084.stdout:2869: done (2 left) 2024-03-30T12:32:15.378 INFO:tasks.rados.rados.0.smithi084.stdout:2871: done (1 left) 2024-03-30T12:32:15.378 INFO:tasks.rados.rados.0.smithi084.stdout:2874: done (0 left) 2024-03-30T12:32:15.378 INFO:tasks.rados.rados.0.smithi084.stdout:2875: delete oid 7 current snap is 286 2024-03-30T12:32:15.382 INFO:tasks.rados.rados.0.smithi084.stdout:2875: done (0 left) 2024-03-30T12:32:15.382 INFO:tasks.rados.rados.0.smithi084.stdout:2876: setattr oid 17 current snap is 286 2024-03-30T12:32:15.383 INFO:tasks.rados.rados.0.smithi084.stdout:2877: snap_remove snap 278 2024-03-30T12:32:15.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:15.255+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:15.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:15.382+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:15.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:15.384+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:15.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:15.384+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:15.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:15.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15b=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:15.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:15.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:15.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:15.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:15.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:15.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:15.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-mon[83709]: osdmap e643: 8 total, 8 up, 8 in 2024-03-30T12:32:15.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:15.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:15.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:15.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:15.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:32:15.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-mon[83709]: pgmap v653: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 804 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 15 MiB/s rd, 529 KiB/s wr, 18 op/s 2024-03-30T12:32:15.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:15.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:15.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:32:15.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:15.391+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:15.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:15.391+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:15.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:15.382+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:15.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:15.383+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:15.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:15.383+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:15.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:15.383+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:15.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:15.383+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:15.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:15.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15b=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:15.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:15.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:15.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:15.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:15.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:15.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:15.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[91810]: osdmap e643: 8 total, 8 up, 8 in 2024-03-30T12:32:15.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:15.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:15.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:15.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:15.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:32:15.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[91810]: pgmap v653: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 804 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 15 MiB/s rd, 529 KiB/s wr, 18 op/s 2024-03-30T12:32:15.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:15.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:15.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:32:15.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:15.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15b=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:15.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:15.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:15.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:15.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:15.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:15.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:15.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[89279]: osdmap e643: 8 total, 8 up, 8 in 2024-03-30T12:32:15.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:15.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:15.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:15.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:15.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:32:15.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[89279]: pgmap v653: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 804 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 15 MiB/s rd, 529 KiB/s wr, 18 op/s 2024-03-30T12:32:15.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:15.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:15.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:15 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:32:16.011 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:15.912+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:16.011 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:15.912+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:16.011 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:15.912+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:16.012 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=infra.usagestats.collector t=2024-03-30T12:32:15.712805101Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-03-30T12:32:16.012 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=provisioning.datasources t=2024-03-30T12:32:15.71488652Z level=info msg="deleted correlations based on configuration" ds_name=Dashboard1 2024-03-30T12:32:16.012 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=provisioning.datasources t=2024-03-30T12:32:15.714921051Z level=info msg="deleted datasource based on configuration" name=Dashboard1 2024-03-30T12:32:16.012 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=provisioning.datasources t=2024-03-30T12:32:15.71504318Z level=info msg="inserting datasource from configuration " name=Dashboard1 uid=P43CA22E17D0F9596 2024-03-30T12:32:16.012 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=provisioning.alerting t=2024-03-30T12:32:15.73662533Z level=info msg="starting to provision alerting" 2024-03-30T12:32:16.012 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=provisioning.alerting t=2024-03-30T12:32:15.736643153Z level=info msg="finished to provision alerting" 2024-03-30T12:32:16.012 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=grafanaStorageLogger t=2024-03-30T12:32:15.73694163Z level=info msg="storage starting" 2024-03-30T12:32:16.012 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=ngalert.state.manager t=2024-03-30T12:32:15.737081066Z level=info msg="Warming state cache for startup" 2024-03-30T12:32:16.012 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=ngalert.state.manager t=2024-03-30T12:32:15.737255606Z level=info msg="State cache has been initialized" states=0 duration=173.433µs 2024-03-30T12:32:16.012 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=ticker t=2024-03-30T12:32:15.737315906Z level=info msg=starting first_tick=2024-03-30T12:32:20Z 2024-03-30T12:32:16.012 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=ngalert.multiorg.alertmanager t=2024-03-30T12:32:15.737380481Z level=info msg="starting MultiOrg Alertmanager" 2024-03-30T12:32:16.012 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:32:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=http.server t=2024-03-30T12:32:15.739201438Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-03-30T12:32:16.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:16.143+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:16.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:16.143+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:16.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:16.143+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15b=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:16.382 INFO:tasks.rados.rados.0.smithi084.stdout:2877: done (1 left) 2024-03-30T12:32:16.382 INFO:tasks.rados.rados.0.smithi084.stdout:2878: snap_create 2024-03-30T12:32:16.383 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 27282 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:32:16.660 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:16.390+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:16.660 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:16.391+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:16.660 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:16.390+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:16.660 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:16.390+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:16.661 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:16.661 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:16.661 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:16.661 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:16.661 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:16.661 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:16.661 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:16.661 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:16.661 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:16 smithi162 ceph-mon[83709]: osdmap e644: 8 total, 8 up, 8 in 2024-03-30T12:32:16.661 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:16.661 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:16.661 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:16.662 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:16.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:16.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:16.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:16.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:16.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:16.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:16.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:16.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:16.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[91810]: osdmap e644: 8 total, 8 up, 8 in 2024-03-30T12:32:16.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:16.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:16.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:16.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:16.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:16.389+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:16.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:16.389+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:16.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:16.390+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:16.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:16.390+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:16.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:16.390+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:16.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:16.391+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:16.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:16.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:16.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:16.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:16.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:16.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:16.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:16.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:16.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[89279]: osdmap e644: 8 total, 8 up, 8 in 2024-03-30T12:32:16.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:16.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:16.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:16.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:17.389 INFO:tasks.rados.rados.0.smithi084.stdout:2876: done (1 left) 2024-03-30T12:32:17.389 INFO:tasks.rados.rados.0.smithi084.stdout:2878: done (0 left) 2024-03-30T12:32:17.389 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 46 current snap is 287 2024-03-30T12:32:17.389 INFO:tasks.rados.rados.0.smithi084.stdout:2879: seq_num 900 ranges {3170304=679936} 2024-03-30T12:32:17.410 INFO:tasks.rados.rados.0.smithi084.stdout:2879: writing smithi08477944-46 from 3170304 to 3850240 tid 1 2024-03-30T12:32:17.410 INFO:tasks.rados.rados.0.smithi084.stdout:2880: read oid 11 snap -1 2024-03-30T12:32:17.410 INFO:tasks.rados.rados.0.smithi084.stdout:2880: expect (ObjNum 882 snap 282 seq_num 882) 2024-03-30T12:32:17.410 INFO:tasks.rados.rados.0.smithi084.stdout:2881: rollback oid 3 current snap is 287 2024-03-30T12:32:17.410 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 3 to 273 2024-03-30T12:32:17.410 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 287 2024-03-30T12:32:17.410 INFO:tasks.rados.rados.0.smithi084.stdout:2882: seq_num 901 ranges {1736704=696320} 2024-03-30T12:32:17.423 INFO:tasks.rados.rados.0.smithi084.stdout:2882: writing smithi08477944-21 from 1736704 to 2433024 tid 1 2024-03-30T12:32:17.423 INFO:tasks.rados.rados.0.smithi084.stdout:2883: read oid 32 snap 279 2024-03-30T12:32:17.424 INFO:tasks.rados.rados.0.smithi084.stdout:2883: expect deleted 2024-03-30T12:32:17.424 INFO:tasks.rados.rados.0.smithi084.stdout:2884: setattr oid 42 current snap is 287 2024-03-30T12:32:17.424 INFO:tasks.rados.rados.0.smithi084.stdout:2879: finishing write tid 1 to smithi08477944-46 2024-03-30T12:32:17.425 INFO:tasks.rados.rados.0.smithi084.stdout:2883: done (5 left) 2024-03-30T12:32:17.425 INFO:tasks.rados.rados.0.smithi084.stdout:2885: rollback oid 24 current snap is 287 2024-03-30T12:32:17.425 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 24 to 284 2024-03-30T12:32:17.426 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 287 2024-03-30T12:32:17.426 INFO:tasks.rados.rados.0.smithi084.stdout:2886: seq_num 902 ranges {0=712704} 2024-03-30T12:32:17.431 INFO:tasks.rados.rados.0.smithi084.stdout:2886: writing smithi08477944-17 from 0 to 712704 tid 1 2024-03-30T12:32:17.431 INFO:tasks.rados.rados.0.smithi084.stdout:2887: copy_from oid 39 from oid 25 current snap is 287 2024-03-30T12:32:17.431 INFO:tasks.rados.rados.0.smithi084.stdout:2888: copy_from oid 5 from oid 7 current snap is 287 2024-03-30T12:32:17.431 INFO:tasks.rados.rados.0.smithi084.stdout:2889: read oid 12 snap 273 2024-03-30T12:32:17.431 INFO:tasks.rados.rados.0.smithi084.stdout:2889: expect (ObjNum 757 snap 253 seq_num 757) 2024-03-30T12:32:17.431 INFO:tasks.rados.rados.0.smithi084.stdout:2890: rollback oid 26 current snap is 287 2024-03-30T12:32:17.431 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 26 to 284 2024-03-30T12:32:17.431 INFO:tasks.rados.rados.0.smithi084.stdout:2891: rollback oid 13 current snap is 287 2024-03-30T12:32:17.431 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 13 to 285 2024-03-30T12:32:17.432 INFO:tasks.rados.rados.0.smithi084.stdout:2892: delete oid 49 current snap is 287 2024-03-30T12:32:17.432 INFO:tasks.rados.rados.0.smithi084.stdout:2880: expect (ObjNum 882 snap 282 seq_num 882) 2024-03-30T12:32:17.445 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:17.190+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:17.445 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:17.438+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:17.446 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:17.422+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:17.446 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:17.425+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:17.446 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:17.446 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15b=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:17.446 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:17.446 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:17.447 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:17.447 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:17.447 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:17.447 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:17.447 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:17.447 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:17 smithi162 ceph-mon[83709]: osdmap e645: 8 total, 8 up, 8 in 2024-03-30T12:32:17.447 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:17.447 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:17 smithi162 ceph-mon[83709]: pgmap v656: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 804 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 11 MiB/s rd, 679 KiB/s wr, 24 op/s 2024-03-30T12:32:17.447 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:17.233+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:17.447 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:17.233+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15b=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:17.447 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:17.394+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:17.448 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:17.394+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:17.448 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:17.394+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15b=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:17.448 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:17.422+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:17.448 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:17.422+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:17.448 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:17.452+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:17.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:17.166+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:17.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:17.166+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:17.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:17.397+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:17.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:17.397+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:17.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:17.394+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:17.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:17.394+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:17.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:17.394+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:17.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:17.395+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:17.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:17.395+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:17.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:17.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15b=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:17.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:17.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:17.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:17.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:17.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:17.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:17.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:17.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-mon[91810]: osdmap e645: 8 total, 8 up, 8 in 2024-03-30T12:32:17.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:17.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-mon[91810]: pgmap v656: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 804 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 11 MiB/s rd, 679 KiB/s wr, 24 op/s 2024-03-30T12:32:17.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:17.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15b=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:17.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:17.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:17.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:17.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:17.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:17.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:17.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:17.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-mon[89279]: osdmap e645: 8 total, 8 up, 8 in 2024-03-30T12:32:17.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:17.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:17 smithi084 ceph-mon[89279]: pgmap v656: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 804 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 11 MiB/s rd, 679 KiB/s wr, 24 op/s 2024-03-30T12:32:17.644 INFO:tasks.rados.rados.0.smithi084.stdout:2888: finishing copy_from to smithi08477944-5 2024-03-30T12:32:17.645 INFO:tasks.rados.rados.0.smithi084.stdout:2888: got expected ENOENT (src dne) 2024-03-30T12:32:17.645 INFO:tasks.rados.rados.0.smithi084.stdout:2888: finishing copy_from racing read to smithi08477944-5 2024-03-30T12:32:17.645 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 27283 (ObjNum 825 snap 273 seq_num 825) dirty exists 2024-03-30T12:32:17.645 INFO:tasks.rados.rados.0.smithi084.stdout:2879: finishing write tid 2 to smithi08477944-46 2024-03-30T12:32:17.645 INFO:tasks.rados.rados.0.smithi084.stdout:2881: finishing rollback tid 0 to smithi08477944-3 2024-03-30T12:32:17.645 INFO:tasks.rados.rados.0.smithi084.stdout:2881: finishing rollback tid 1 to smithi08477944-3 2024-03-30T12:32:17.645 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 27310 (ObjNum 609 snap 0 seq_num 1430097800) dirty dne 2024-03-30T12:32:17.645 INFO:tasks.rados.rados.0.smithi084.stdout:2882: finishing write tid 1 to smithi08477944-21 2024-03-30T12:32:17.645 INFO:tasks.rados.rados.0.smithi084.stdout:2882: finishing write tid 2 to smithi08477944-21 2024-03-30T12:32:17.645 INFO:tasks.rados.rados.0.smithi084.stdout:2886: finishing write tid 1 to smithi08477944-17 2024-03-30T12:32:17.645 INFO:tasks.rados.rados.0.smithi084.stdout:2880: done (12 left) 2024-03-30T12:32:17.645 INFO:tasks.rados.rados.0.smithi084.stdout:2881: done (11 left) 2024-03-30T12:32:17.645 INFO:tasks.rados.rados.0.smithi084.stdout:2884: done (10 left) 2024-03-30T12:32:17.645 INFO:tasks.rados.rados.0.smithi084.stdout:2888: done (9 left) 2024-03-30T12:32:17.646 INFO:tasks.rados.rados.0.smithi084.stdout:2892: done (8 left) 2024-03-30T12:32:17.646 INFO:tasks.rados.rados.0.smithi084.stdout:2893: copy_from oid 18 from oid 5 current snap is 287 2024-03-30T12:32:17.646 INFO:tasks.rados.rados.0.smithi084.stdout:2886: finishing write tid 2 to smithi08477944-17 2024-03-30T12:32:17.646 INFO:tasks.rados.rados.0.smithi084.stdout:2886: finishing write tid 3 to smithi08477944-17 2024-03-30T12:32:17.646 INFO:tasks.rados.rados.0.smithi084.stdout:2886: oid 17 updating version 0 to 27284 2024-03-30T12:32:17.646 INFO:tasks.rados.rados.0.smithi084.stdout:2886: oid 17 updating version 27284 to 27285 2024-03-30T12:32:17.646 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 27285 (ObjNum 902 snap 287 seq_num 902) dirty exists 2024-03-30T12:32:17.646 INFO:tasks.rados.rados.0.smithi084.stdout:2886: left oid 17 (ObjNum 902 snap 287 seq_num 902) 2024-03-30T12:32:17.646 INFO:tasks.rados.rados.0.smithi084.stdout:2882: finishing write tid 3 to smithi08477944-21 2024-03-30T12:32:17.646 INFO:tasks.rados.rados.0.smithi084.stdout:2882: oid 21 updating version 0 to 25298 2024-03-30T12:32:17.646 INFO:tasks.rados.rados.0.smithi084.stdout:2882: oid 21 version 25298 is already newer than 25297 2024-03-30T12:32:17.646 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 25298 (ObjNum 901 snap 287 seq_num 901) dirty exists 2024-03-30T12:32:17.646 INFO:tasks.rados.rados.0.smithi084.stdout:2882: left oid 21 (ObjNum 901 snap 287 seq_num 901) 2024-03-30T12:32:17.646 INFO:tasks.rados.rados.0.smithi084.stdout:2885: finishing rollback tid 0 to smithi08477944-24 2024-03-30T12:32:17.647 INFO:tasks.rados.rados.0.smithi084.stdout:2887: finishing copy_from to smithi08477944-39 2024-03-30T12:32:17.647 INFO:tasks.rados.rados.0.smithi084.stdout:2887: got expected ENOENT (src dne) 2024-03-30T12:32:17.647 INFO:tasks.rados.rados.0.smithi084.stdout:2887: finishing copy_from racing read to smithi08477944-39 2024-03-30T12:32:17.647 INFO:tasks.rados.rados.0.smithi084.stdout:2889: expect (ObjNum 757 snap 253 seq_num 757) 2024-03-30T12:32:17.768 INFO:tasks.rados.rados.0.smithi084.stdout:2885: finishing rollback tid 1 to smithi08477944-24 2024-03-30T12:32:17.768 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 23409 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-03-30T12:32:17.768 INFO:tasks.rados.rados.0.smithi084.stdout:2879: finishing write tid 3 to smithi08477944-46 2024-03-30T12:32:17.768 INFO:tasks.rados.rados.0.smithi084.stdout:2879: oid 46 updating version 0 to 27306 2024-03-30T12:32:17.768 INFO:tasks.rados.rados.0.smithi084.stdout:2879: oid 46 updating version 27306 to 27307 2024-03-30T12:32:17.768 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 27307 (ObjNum 900 snap 287 seq_num 900) dirty exists 2024-03-30T12:32:17.768 INFO:tasks.rados.rados.0.smithi084.stdout:2879: left oid 46 (ObjNum 900 snap 287 seq_num 900) 2024-03-30T12:32:17.769 INFO:tasks.rados.rados.0.smithi084.stdout:2890: finishing rollback tid 0 to smithi08477944-26 2024-03-30T12:32:17.769 INFO:tasks.rados.rados.0.smithi084.stdout:2890: finishing rollback tid 1 to smithi08477944-26 2024-03-30T12:32:17.769 INFO:tasks.rados.rados.0.smithi084.stdout:2890: finishing rollback tid 2 to smithi08477944-26 2024-03-30T12:32:17.769 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 27314 (ObjNum 824 snap 273 seq_num 824) dirty exists 2024-03-30T12:32:17.769 INFO:tasks.rados.rados.0.smithi084.stdout:2891: finishing rollback tid 0 to smithi08477944-13 2024-03-30T12:32:17.769 INFO:tasks.rados.rados.0.smithi084.stdout:2891: finishing rollback tid 1 to smithi08477944-13 2024-03-30T12:32:17.769 INFO:tasks.rados.rados.0.smithi084.stdout:2891: finishing rollback tid 2 to smithi08477944-13 2024-03-30T12:32:17.769 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 23412 (ObjNum 836 snap 273 seq_num 836) dirty exists 2024-03-30T12:32:17.769 INFO:tasks.rados.rados.0.smithi084.stdout:2879: done (8 left) 2024-03-30T12:32:17.769 INFO:tasks.rados.rados.0.smithi084.stdout:2882: done (7 left) 2024-03-30T12:32:17.769 INFO:tasks.rados.rados.0.smithi084.stdout:2885: done (6 left) 2024-03-30T12:32:17.769 INFO:tasks.rados.rados.0.smithi084.stdout:2886: done (5 left) 2024-03-30T12:32:17.769 INFO:tasks.rados.rados.0.smithi084.stdout:2887: done (4 left) 2024-03-30T12:32:17.769 INFO:tasks.rados.rados.0.smithi084.stdout:2889: done (3 left) 2024-03-30T12:32:17.769 INFO:tasks.rados.rados.0.smithi084.stdout:2890: done (2 left) 2024-03-30T12:32:17.770 INFO:tasks.rados.rados.0.smithi084.stdout:2891: done (1 left) 2024-03-30T12:32:17.770 INFO:tasks.rados.rados.0.smithi084.stdout:2894: rmattr oid 50 current snap is 287 2024-03-30T12:32:17.770 INFO:tasks.rados.rados.0.smithi084.stdout:2894: done (1 left) 2024-03-30T12:32:17.770 INFO:tasks.rados.rados.0.smithi084.stdout:2895: snap_remove snap 279 2024-03-30T12:32:18.388 INFO:tasks.rados.rados.0.smithi084.stdout:2895: done (1 left) 2024-03-30T12:32:18.388 INFO:tasks.rados.rados.0.smithi084.stdout:2896: setattr oid 41 current snap is 287 2024-03-30T12:32:18.388 INFO:tasks.rados.rados.0.smithi084.stdout:2893: finishing copy_from racing read to smithi08477944-18 2024-03-30T12:32:18.388 INFO:tasks.rados.rados.0.smithi084.stdout:2893: finishing copy_from to smithi08477944-18 2024-03-30T12:32:18.388 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 23394 (ObjNum 836 snap 273 seq_num 836) dirty exists 2024-03-30T12:32:18.390 INFO:tasks.rados.rados.0.smithi084.stdout:2893: done (1 left) 2024-03-30T12:32:18.390 INFO:tasks.rados.rados.0.smithi084.stdout:2897: copy_from oid 3 from oid 9 current snap is 287 2024-03-30T12:32:18.390 INFO:tasks.rados.rados.0.smithi084.stdout:2898: read oid 44 snap -1 2024-03-30T12:32:18.390 INFO:tasks.rados.rados.0.smithi084.stdout:2898: expect deleted 2024-03-30T12:32:18.390 INFO:tasks.rados.rados.0.smithi084.stdout:2899: read oid 49 snap 286 2024-03-30T12:32:18.390 INFO:tasks.rados.rados.0.smithi084.stdout:2899: expect deleted 2024-03-30T12:32:18.390 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 287 2024-03-30T12:32:18.390 INFO:tasks.rados.rados.0.smithi084.stdout:2900: seq_num 904 ranges {6012928=745472} 2024-03-30T12:32:18.427 INFO:tasks.rados.rados.0.smithi084.stdout:2900: writing smithi08477944-29 from 6012928 to 6758400 tid 1 2024-03-30T12:32:18.427 INFO:tasks.rados.rados.0.smithi084.stdout:2901: snap_remove snap 284 2024-03-30T12:32:18.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:18.403+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:18.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:18.404+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:18.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:18.394+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:18.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:18.394+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:18.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:18.394+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:18.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:18.394+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:18.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:18.395+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:18.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:18.395+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:18.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:18.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:18.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:18.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:18.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15b=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:18.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:18.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:18.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15b=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:18.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:18.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:18.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:18.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[89279]: osdmap e646: 8 total, 8 up, 8 in 2024-03-30T12:32:18.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:18.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:18.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:18.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:18.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:18.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:18.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:18.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:18.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:18.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15b=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:18.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:18.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:18.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15b=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:18.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:18.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:18.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:18.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[91810]: osdmap e646: 8 total, 8 up, 8 in 2024-03-30T12:32:18.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:18.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:18.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:18.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:18.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:18.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:18.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:18.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:18.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:18.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:18.397+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:18.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:18.404+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:18.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:18.405+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:18.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:18.396+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:18.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:18.396+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:18.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:18.403+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:18.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:18.404+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:18.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:18.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:18.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:18.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:18.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15b=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:18.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:18.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:18.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15b=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:18.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:18.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:18.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:18.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-mon[83709]: osdmap e646: 8 total, 8 up, 8 in 2024-03-30T12:32:18.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:18.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:18.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:18.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 151=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:18.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:18.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:18.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:19.404 INFO:tasks.rados.rados.0.smithi084.stdout:2901: done (5 left) 2024-03-30T12:32:19.404 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 33 current snap is 287 2024-03-30T12:32:19.404 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 23421 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-03-30T12:32:19.404 INFO:tasks.rados.rados.0.smithi084.stdout:2902: seq_num 905 ranges {0=761856} 2024-03-30T12:32:19.408 INFO:tasks.rados.rados.0.smithi084.stdout:2902: writing smithi08477944-33 from 0 to 761856 tid 1 2024-03-30T12:32:19.408 INFO:tasks.rados.rados.0.smithi084.stdout:2896: done (5 left) 2024-03-30T12:32:19.408 INFO:tasks.rados.rados.0.smithi084.stdout:2903: snap_create 2024-03-30T12:32:19.409 INFO:tasks.rados.rados.0.smithi084.stdout:2897: finishing copy_from to smithi08477944-3 2024-03-30T12:32:19.409 INFO:tasks.rados.rados.0.smithi084.stdout:2897: got expected ENOENT (src dne) 2024-03-30T12:32:19.409 INFO:tasks.rados.rados.0.smithi084.stdout:2897: finishing copy_from racing read to smithi08477944-3 2024-03-30T12:32:19.409 INFO:tasks.rados.rados.0.smithi084.stdout:2900: finishing write tid 1 to smithi08477944-29 2024-03-30T12:32:19.409 INFO:tasks.rados.rados.0.smithi084.stdout:2900: finishing write tid 2 to smithi08477944-29 2024-03-30T12:32:19.409 INFO:tasks.rados.rados.0.smithi084.stdout:2900: finishing write tid 3 to smithi08477944-29 2024-03-30T12:32:19.409 INFO:tasks.rados.rados.0.smithi084.stdout:2900: oid 29 updating version 0 to 23416 2024-03-30T12:32:19.409 INFO:tasks.rados.rados.0.smithi084.stdout:2900: oid 29 updating version 23416 to 23417 2024-03-30T12:32:19.409 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 23417 (ObjNum 904 snap 287 seq_num 904) dirty exists 2024-03-30T12:32:19.409 INFO:tasks.rados.rados.0.smithi084.stdout:2900: left oid 29 (ObjNum 904 snap 287 seq_num 904) 2024-03-30T12:32:19.412 INFO:tasks.rados.rados.0.smithi084.stdout:2902: finishing write tid 1 to smithi08477944-33 2024-03-30T12:32:19.412 INFO:tasks.rados.rados.0.smithi084.stdout:2902: finishing write tid 2 to smithi08477944-33 2024-03-30T12:32:19.414 INFO:tasks.rados.rados.0.smithi084.stdout:2902: finishing write tid 3 to smithi08477944-33 2024-03-30T12:32:19.414 INFO:tasks.rados.rados.0.smithi084.stdout:2902: oid 33 updating version 0 to 23448 2024-03-30T12:32:19.414 INFO:tasks.rados.rados.0.smithi084.stdout:2902: oid 33 version 23448 is already newer than 23447 2024-03-30T12:32:19.414 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 23448 (ObjNum 905 snap 287 seq_num 905) dirty exists 2024-03-30T12:32:19.414 INFO:tasks.rados.rados.0.smithi084.stdout:2902: left oid 33 (ObjNum 905 snap 287 seq_num 905) 2024-03-30T12:32:19.655 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:32:19] "GET /metrics HTTP/1.1" 200 36329 "" "Prometheus/2.43.0" 2024-03-30T12:32:19.655 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:19.412+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:19.655 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:19.412+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:19.655 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:19.410+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:19.656 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:19.410+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:19.656 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:19.410+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:19.656 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:19.410+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:19.656 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:19.411+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:19.656 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:19.656 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:19.656 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:19.656 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:19.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[91810]: osdmap e647: 8 total, 8 up, 8 in 2024-03-30T12:32:19.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:19.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:19.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:19.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:19.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:19.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:19.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:19.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:19.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:19.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:19.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:19.658 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[91810]: pgmap v659: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 811 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 547 KiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-03-30T12:32:19.658 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:19.658 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:19.658 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:19.658 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:19.658 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[89279]: osdmap e647: 8 total, 8 up, 8 in 2024-03-30T12:32:19.658 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:19.658 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:19.658 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:19.658 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:19.659 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:19.659 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:19.659 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:19.659 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:19.659 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:19.659 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:19.659 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:19.659 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:19 smithi084 ceph-mon[89279]: pgmap v659: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 811 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 547 KiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-03-30T12:32:19.823 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:19.408+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:19.823 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:19.409+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:19.823 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:19.409+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:19.823 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:19.629+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:19.823 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:19.629+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:19.823 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:19.629+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:19.824 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:19.824 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-mon[83709]: osdmap e647: 8 total, 8 up, 8 in 2024-03-30T12:32:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:19.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:19.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:19.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:19.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:19.826 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-mon[83709]: pgmap v659: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 811 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 547 KiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-03-30T12:32:20.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:19.831+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:20.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:19.831+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:20.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:19.831+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:20.408 INFO:tasks.rados.rados.0.smithi084.stdout:2897: done (5 left) 2024-03-30T12:32:20.409 INFO:tasks.rados.rados.0.smithi084.stdout:2898: done (4 left) 2024-03-30T12:32:20.409 INFO:tasks.rados.rados.0.smithi084.stdout:2899: done (3 left) 2024-03-30T12:32:20.409 INFO:tasks.rados.rados.0.smithi084.stdout:2900: done (2 left) 2024-03-30T12:32:20.409 INFO:tasks.rados.rados.0.smithi084.stdout:2902: done (1 left) 2024-03-30T12:32:20.409 INFO:tasks.rados.rados.0.smithi084.stdout:2903: done (0 left) 2024-03-30T12:32:20.409 INFO:tasks.rados.rados.0.smithi084.stdout:2904: read oid 3 snap -1 2024-03-30T12:32:20.409 INFO:tasks.rados.rados.0.smithi084.stdout:2904: expect deleted 2024-03-30T12:32:20.409 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 288 2024-03-30T12:32:20.409 INFO:tasks.rados.rados.0.smithi084.stdout:2905: seq_num 906 ranges {475136=778240} 2024-03-30T12:32:20.415 INFO:tasks.rados.rados.0.smithi084.stdout:2905: writing smithi08477944-22 from 475136 to 1253376 tid 1 2024-03-30T12:32:20.415 INFO:tasks.rados.rados.0.smithi084.stdout:2906: read oid 37 snap -1 2024-03-30T12:32:20.415 INFO:tasks.rados.rados.0.smithi084.stdout:2906: expect (ObjNum 889 snap 283 seq_num 889) 2024-03-30T12:32:20.415 INFO:tasks.rados.rados.0.smithi084.stdout:2907: read oid 40 snap -1 2024-03-30T12:32:20.415 INFO:tasks.rados.rados.0.smithi084.stdout:2907: expect (ObjNum 843 snap 273 seq_num 843) 2024-03-30T12:32:20.415 INFO:tasks.rados.rados.0.smithi084.stdout:2908: copy_from oid 36 from oid 14 current snap is 288 2024-03-30T12:32:20.416 INFO:tasks.rados.rados.0.smithi084.stdout:2904: done (4 left) 2024-03-30T12:32:20.416 INFO:tasks.rados.rados.0.smithi084.stdout:2909: snap_remove snap 285 2024-03-30T12:32:20.489 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:20.416+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:20.490 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:20.416+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:20.490 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:20.419+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:20.490 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:20.420+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:20.491 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:20.428+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:20.491 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:20.416+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:20.492 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:20.416+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:20.492 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:20 smithi162 ceph-mon[83709]: osdmap e648: 8 total, 8 up, 8 in 2024-03-30T12:32:20.492 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:20.493 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:20.493 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:20.493 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:20.493 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:20.493 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:20.493 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:20.493 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:20.494 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:20 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:20.494 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:20.494 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:20.494 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:20 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:20.494 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:20.494 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:20.495 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:20.667 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:20.428+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:20.667 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:20.428+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:20.667 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:20.415+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:20.667 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:20.415+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:20.667 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:20.415+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:20.668 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:20.415+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:20.668 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:20.415+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:20.668 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:20.415+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:20.668 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[91810]: osdmap e648: 8 total, 8 up, 8 in 2024-03-30T12:32:20.668 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:20.668 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:20.668 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:20.668 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:20.668 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:20.668 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:20.669 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:20.669 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:20.669 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:20.669 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:20.669 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:20.669 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:20.669 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:20.669 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:20.669 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:20.669 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[89279]: osdmap e648: 8 total, 8 up, 8 in 2024-03-30T12:32:20.669 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:20.670 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:20.670 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:20.670 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:20.670 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:20.670 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:20.670 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:20.670 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:20.670 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:20.670 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:20.670 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:20.670 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:20.670 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:20.670 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:20.670 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:21.413 INFO:tasks.rados.rados.0.smithi084.stdout:2909: done (4 left) 2024-03-30T12:32:21.413 INFO:tasks.rados.rados.0.smithi084.stdout:2910: rollback oid 23 current snap is 288 2024-03-30T12:32:21.414 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 23 to 286 2024-03-30T12:32:21.414 INFO:tasks.rados.rados.0.smithi084.stdout:2906: expect (ObjNum 889 snap 283 seq_num 889) 2024-03-30T12:32:21.428 INFO:tasks.rados.rados.0.smithi084.stdout:2905: finishing write tid 1 to smithi08477944-22 2024-03-30T12:32:21.428 INFO:tasks.rados.rados.0.smithi084.stdout:2905: finishing write tid 2 to smithi08477944-22 2024-03-30T12:32:21.428 INFO:tasks.rados.rados.0.smithi084.stdout:2906: done (4 left) 2024-03-30T12:32:21.428 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 288 2024-03-30T12:32:21.428 INFO:tasks.rados.rados.0.smithi084.stdout:2905: finishing write tid 3 to smithi08477944-22 2024-03-30T12:32:21.428 INFO:tasks.rados.rados.0.smithi084.stdout:2905: oid 22 updating version 0 to 27317 2024-03-30T12:32:21.428 INFO:tasks.rados.rados.0.smithi084.stdout:2905: oid 22 version 27317 is already newer than 27316 2024-03-30T12:32:21.429 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 27317 (ObjNum 906 snap 288 seq_num 906) dirty exists 2024-03-30T12:32:21.429 INFO:tasks.rados.rados.0.smithi084.stdout:2905: left oid 22 (ObjNum 906 snap 288 seq_num 906) 2024-03-30T12:32:21.429 INFO:tasks.rados.rados.0.smithi084.stdout:2911: seq_num 907 ranges {507904=794624} 2024-03-30T12:32:21.435 INFO:tasks.rados.rados.0.smithi084.stdout:2911: writing smithi08477944-2 from 507904 to 1302528 tid 1 2024-03-30T12:32:21.435 INFO:tasks.rados.rados.0.smithi084.stdout:2905: done (4 left) 2024-03-30T12:32:21.435 INFO:tasks.rados.rados.0.smithi084.stdout:2912: delete oid 15 current snap is 288 2024-03-30T12:32:21.435 INFO:tasks.rados.rados.0.smithi084.stdout:2907: expect (ObjNum 843 snap 273 seq_num 843) 2024-03-30T12:32:21.570 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:21.420+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:21.570 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:21.419+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:21.570 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:21.421+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:21.571 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:21.427+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:21.571 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:21.427+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:21.571 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:21.427+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:21.571 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:21.447+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:21.571 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:21.447+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:21.571 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:21.455+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:21.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:21.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:21.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:21.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:21.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:21 smithi162 ceph-mon[83709]: osdmap e649: 8 total, 8 up, 8 in 2024-03-30T12:32:21.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:21.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:21.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:21.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:21.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:21.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:21.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:21.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:21.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:21.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:21 smithi162 ceph-mon[83709]: pgmap v662: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 811 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.7 MiB/s wr, 6 op/s 2024-03-30T12:32:21.702 INFO:tasks.rados.rados.0.smithi084.stdout:2908: finishing copy_from racing read to smithi08477944-36 2024-03-30T12:32:21.702 INFO:tasks.rados.rados.0.smithi084.stdout:2908: finishing copy_from to smithi08477944-36 2024-03-30T12:32:21.702 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 36266 (ObjNum 851 snap 276 seq_num 851) dirty exists 2024-03-30T12:32:21.702 INFO:tasks.rados.rados.0.smithi084.stdout:2907: done (4 left) 2024-03-30T12:32:21.703 INFO:tasks.rados.rados.0.smithi084.stdout:2908: done (3 left) 2024-03-30T12:32:21.703 INFO:tasks.rados.rados.0.smithi084.stdout:2912: done (2 left) 2024-03-30T12:32:21.703 INFO:tasks.rados.rados.0.smithi084.stdout:2913: copy_from oid 44 from oid 29 current snap is 288 2024-03-30T12:32:21.703 INFO:tasks.rados.rados.0.smithi084.stdout:2910: finishing rollback tid 1 to smithi08477944-23 2024-03-30T12:32:21.703 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 27273 (ObjNum 225 snap 0 seq_num 1429326032) dirty dne 2024-03-30T12:32:21.703 INFO:tasks.rados.rados.0.smithi084.stdout:2911: finishing write tid 1 to smithi08477944-2 2024-03-30T12:32:21.703 INFO:tasks.rados.rados.0.smithi084.stdout:2911: finishing write tid 2 to smithi08477944-2 2024-03-30T12:32:21.703 INFO:tasks.rados.rados.0.smithi084.stdout:2911: finishing write tid 3 to smithi08477944-2 2024-03-30T12:32:21.703 INFO:tasks.rados.rados.0.smithi084.stdout:2911: oid 2 updating version 0 to 27319 2024-03-30T12:32:21.703 INFO:tasks.rados.rados.0.smithi084.stdout:2911: oid 2 updating version 27319 to 27320 2024-03-30T12:32:21.703 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 27320 (ObjNum 907 snap 288 seq_num 907) dirty exists 2024-03-30T12:32:21.703 INFO:tasks.rados.rados.0.smithi084.stdout:2911: left oid 2 (ObjNum 907 snap 288 seq_num 907) 2024-03-30T12:32:21.703 INFO:tasks.rados.rados.0.smithi084.stdout:2910: done (2 left) 2024-03-30T12:32:21.703 INFO:tasks.rados.rados.0.smithi084.stdout:2911: done (1 left) 2024-03-30T12:32:21.704 INFO:tasks.rados.rados.0.smithi084.stdout:2914: read oid 31 snap -1 2024-03-30T12:32:21.704 INFO:tasks.rados.rados.0.smithi084.stdout:2914: expect deleted 2024-03-30T12:32:21.704 INFO:tasks.rados.rados.0.smithi084.stdout:2915: copy_from oid 19 from oid 49 current snap is 288 2024-03-30T12:32:21.704 INFO:tasks.rados.rados.0.smithi084.stdout:2916: snap_remove snap 273 2024-03-30T12:32:21.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:21.424+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:21.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:21.424+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:21.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:21.418+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:21.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:21.419+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:21.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:21.419+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:21.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:21.419+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:21.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:21.419+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:21.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:21.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:21.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:21.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:21.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[89279]: osdmap e649: 8 total, 8 up, 8 in 2024-03-30T12:32:21.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:21.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:21.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:21.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:21.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:21.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:21.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:21.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:21.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:21.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[89279]: pgmap v662: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 811 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.7 MiB/s wr, 6 op/s 2024-03-30T12:32:21.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:21.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:21.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:21.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:21.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[91810]: osdmap e649: 8 total, 8 up, 8 in 2024-03-30T12:32:21.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:21.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:21.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:21.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:21.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:21.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:21.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:21.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:21.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:21.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:21 smithi084 ceph-mon[91810]: pgmap v662: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 811 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.7 MiB/s wr, 6 op/s 2024-03-30T12:32:22.418 INFO:tasks.rados.rados.0.smithi084.stdout:2916: done (3 left) 2024-03-30T12:32:22.418 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 288 2024-03-30T12:32:22.418 INFO:tasks.rados.rados.0.smithi084.stdout:2917: seq_num 909 ranges {688128=425984,1114112=401408} 2024-03-30T12:32:22.423 INFO:tasks.rados.rados.0.smithi084.stdout:2917: writing smithi08477944-16 from 688128 to 1114112 tid 1 2024-03-30T12:32:22.427 INFO:tasks.rados.rados.0.smithi084.stdout:2917: writing smithi08477944-16 from 1114112 to 1515520 tid 2 2024-03-30T12:32:22.427 INFO:tasks.rados.rados.0.smithi084.stdout:2918: snap_create 2024-03-30T12:32:22.427 INFO:tasks.rados.rados.0.smithi084.stdout:2915: finishing copy_from to smithi08477944-19 2024-03-30T12:32:22.427 INFO:tasks.rados.rados.0.smithi084.stdout:2915: got expected ENOENT (src dne) 2024-03-30T12:32:22.427 INFO:tasks.rados.rados.0.smithi084.stdout:2915: finishing copy_from racing read to smithi08477944-19 2024-03-30T12:32:22.427 INFO:tasks.rados.rados.0.smithi084.stdout:2913: finishing copy_from racing read to smithi08477944-44 2024-03-30T12:32:22.427 INFO:tasks.rados.rados.0.smithi084.stdout:2913: finishing copy_from to smithi08477944-44 2024-03-30T12:32:22.428 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 23417 (ObjNum 904 snap 287 seq_num 904) dirty exists 2024-03-30T12:32:22.429 INFO:tasks.rados.rados.0.smithi084.stdout:2917: finishing write tid 1 to smithi08477944-16 2024-03-30T12:32:22.429 INFO:tasks.rados.rados.0.smithi084.stdout:2917: finishing write tid 2 to smithi08477944-16 2024-03-30T12:32:22.429 INFO:tasks.rados.rados.0.smithi084.stdout:2917: finishing write tid 3 to smithi08477944-16 2024-03-30T12:32:22.430 INFO:tasks.rados.rados.0.smithi084.stdout:2917: finishing write tid 4 to smithi08477944-16 2024-03-30T12:32:22.431 INFO:tasks.rados.rados.0.smithi084.stdout:2917: oid 16 updating version 0 to 23424 2024-03-30T12:32:22.431 INFO:tasks.rados.rados.0.smithi084.stdout:2917: oid 16 version 23424 is already newer than 23423 2024-03-30T12:32:22.431 INFO:tasks.rados.rados.0.smithi084.stdout:2917: oid 16 version 23424 is already newer than 23422 2024-03-30T12:32:22.431 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 23424 (ObjNum 909 snap 288 seq_num 909) dirty exists 2024-03-30T12:32:22.431 INFO:tasks.rados.rados.0.smithi084.stdout:2917: left oid 16 (ObjNum 909 snap 288 seq_num 909) 2024-03-30T12:32:22.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:22.425+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:22.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:22.425+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:22.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:22.436+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:22.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:22.436+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:22.621 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:22.426+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:22.621 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:22.426+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:22.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:22.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:22.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:22.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:22.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:22.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:22.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:22.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:22 smithi162 ceph-mon[83709]: osdmap e650: 8 total, 8 up, 8 in 2024-03-30T12:32:22.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:22.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:22.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:22.624 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:22.624 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:22.624 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:22.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:22.642+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:22.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:22.642+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:22.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:22.424+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:22.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:22.424+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:22.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:22.424+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:22.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:22.425+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:22.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:22.425+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:22.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:22.425+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:22.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:22.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:22.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:22.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:22.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:22.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:22.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:22.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[89279]: osdmap e650: 8 total, 8 up, 8 in 2024-03-30T12:32:22.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:22.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:22.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:22.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:22.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:22.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:22.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:22.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:22.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:22.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:22.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:22.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:22.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:22.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[91810]: osdmap e650: 8 total, 8 up, 8 in 2024-03-30T12:32:22.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:22.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:22.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:22.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:22.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:22.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:23.009 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:22.640+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:23.433 INFO:tasks.rados.rados.0.smithi084.stdout:2913: done (4 left) 2024-03-30T12:32:23.434 INFO:tasks.rados.rados.0.smithi084.stdout:2914: done (3 left) 2024-03-30T12:32:23.434 INFO:tasks.rados.rados.0.smithi084.stdout:2915: done (2 left) 2024-03-30T12:32:23.434 INFO:tasks.rados.rados.0.smithi084.stdout:2917: done (1 left) 2024-03-30T12:32:23.434 INFO:tasks.rados.rados.0.smithi084.stdout:2918: done (0 left) 2024-03-30T12:32:23.434 INFO:tasks.rados.rados.0.smithi084.stdout:2919: rmattr oid 21 current snap is 289 2024-03-30T12:32:23.434 INFO:tasks.rados.rados.0.smithi084.stdout:2919: done (0 left) 2024-03-30T12:32:23.434 INFO:tasks.rados.rados.0.smithi084.stdout:2920: snap_remove snap 286 2024-03-30T12:32:23.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:23.436+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:23.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:23.437+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:23.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:23.437+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:23.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:23.437+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:23.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:23.437+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:23.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:23.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:23.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: osdmap e651: 8 total, 8 up, 8 in 2024-03-30T12:32:23.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:23.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:23.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:23.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:23.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:23.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:23.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:23.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:23.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:23.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:23.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:23.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: pgmap v665: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 827 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.1 MiB/s wr, 12 op/s 2024-03-30T12:32:23.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:23.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:23.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:32:23.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:23.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:23.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: osdmap e651: 8 total, 8 up, 8 in 2024-03-30T12:32:23.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:23.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:23.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:23.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:23.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:23.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:23.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:23.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:23.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:23.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:23.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:23.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: pgmap v665: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 827 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.1 MiB/s wr, 12 op/s 2024-03-30T12:32:23.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:23.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:23.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:32:23.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:32:23.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:23.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T12:32:23.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:32:23.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:23.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T12:32:23.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-30T12:32:23.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T12:32:23.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-30T12:32:23.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T12:32:23.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:32:23.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:23.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T12:32:23.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:32:23.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:23.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T12:32:23.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-30T12:32:23.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T12:32:23.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-30T12:32:23.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T12:32:23.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-30T12:32:23.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T12:32:23.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-03-30T12:32:23.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T12:32:23.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-30T12:32:23.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T12:32:23.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-03-30T12:32:23.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T12:32:23.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-30T12:32:23.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T12:32:23.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T12:32:23.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-30T12:32:23.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T12:32:23.763 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-03-30T12:32:23.763 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T12:32:23.763 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-30T12:32:23.763 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T12:32:23.763 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-30T12:32:23.763 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T12:32:23.763 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T12:32:23.763 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T12:32:23.763 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T12:32:23.763 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T12:32:23.763 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T12:32:23.763 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T12:32:23.763 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-30T12:32:23.763 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:32:23.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:32:23.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:32:23.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:23.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:32:23.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:32:23.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:32:23.764 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:23.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-30T12:32:23.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T12:32:23.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-03-30T12:32:23.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T12:32:23.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-30T12:32:23.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T12:32:23.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-03-30T12:32:23.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T12:32:23.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-30T12:32:23.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T12:32:23.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T12:32:23.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-30T12:32:23.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T12:32:23.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-03-30T12:32:23.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T12:32:23.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-30T12:32:23.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T12:32:23.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-30T12:32:23.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T12:32:23.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T12:32:23.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T12:32:23.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T12:32:23.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T12:32:23.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T12:32:23.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T12:32:23.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-30T12:32:23.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:32:23.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:32:23.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:32:23.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:23.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:32:23.767 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:32:23.767 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:32:23.767 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:23.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:23.434+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:23.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:23.434+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:23.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:23.435+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:23.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:23.436+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:23.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:23.436+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:23.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:23.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:23.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: osdmap e651: 8 total, 8 up, 8 in 2024-03-30T12:32:23.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:23.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:23.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:23.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:23.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:23.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:23.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:23.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:23.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:23.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:23.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:23.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: pgmap v665: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 827 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.1 MiB/s wr, 12 op/s 2024-03-30T12:32:23.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:23.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:23.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:32:23.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:32:23.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:23.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T12:32:23.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:32:23.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:23.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:23.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T12:32:23.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-30T12:32:23.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T12:32:23.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-30T12:32:23.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T12:32:23.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-30T12:32:23.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T12:32:23.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-03-30T12:32:23.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T12:32:23.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-30T12:32:23.876 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T12:32:23.876 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-03-30T12:32:23.876 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T12:32:23.876 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-30T12:32:23.876 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T12:32:23.876 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T12:32:23.876 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-30T12:32:23.876 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T12:32:23.876 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-03-30T12:32:23.876 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T12:32:23.876 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-30T12:32:23.876 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T12:32:23.877 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-30T12:32:23.877 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T12:32:23.877 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T12:32:23.877 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T12:32:23.877 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T12:32:23.877 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T12:32:23.877 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T12:32:23.877 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T12:32:23.877 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-30T12:32:23.877 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:32:23.877 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:32:23.877 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:32:23.877 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:23.878 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:32:23.878 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:32:23.878 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:32:23.878 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:24.434 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:24.078+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:24.434 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:24.078+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:24.434 INFO:tasks.rados.rados.0.smithi084.stdout:2920: done (0 left) 2024-03-30T12:32:24.434 INFO:tasks.rados.rados.0.smithi084.stdout:2921: rmattr oid 45 current snap is 289 2024-03-30T12:32:24.434 INFO:tasks.rados.rados.0.smithi084.stdout:2921: done (0 left) 2024-03-30T12:32:24.435 INFO:tasks.rados.rados.0.smithi084.stdout:2922: setattr oid 23 current snap is 289 2024-03-30T12:32:24.435 INFO:tasks.rados.rados.0.smithi084.stdout:2923: read oid 11 snap 288 2024-03-30T12:32:24.435 INFO:tasks.rados.rados.0.smithi084.stdout:2923: expect (ObjNum 882 snap 282 seq_num 882) 2024-03-30T12:32:24.435 INFO:tasks.rados.rados.0.smithi084.stdout:2924: read oid 6 snap 287 2024-03-30T12:32:24.435 INFO:tasks.rados.rados.0.smithi084.stdout:2924: expect deleted 2024-03-30T12:32:24.435 INFO:tasks.rados.rados.0.smithi084.stdout:2925: snap_create 2024-03-30T12:32:24.439 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 36267 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:32:24.464 INFO:tasks.rados.rados.0.smithi084.stdout:2923: expect (ObjNum 882 snap 282 seq_num 882) 2024-03-30T12:32:24.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:24.441+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:24.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:24.442+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:24.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-mon[91810]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T12:32:24.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-mon[91810]: Upgrade: Finalizing container_image settings 2024-03-30T12:32:24.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-mon[91810]: Upgrade: Complete! 2024-03-30T12:32:24.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:24.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:24.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:24.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:24.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:24.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:24.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:24.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:24.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-mon[91810]: osdmap e652: 8 total, 8 up, 8 in 2024-03-30T12:32:24.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-mon[89279]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T12:32:24.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-mon[89279]: Upgrade: Finalizing container_image settings 2024-03-30T12:32:24.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-mon[89279]: Upgrade: Complete! 2024-03-30T12:32:24.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:24.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:24.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:24.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:24.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:24.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:24.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:24.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:24.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-mon[89279]: osdmap e652: 8 total, 8 up, 8 in 2024-03-30T12:32:24.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:24.441+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:24.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:24.441+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:24.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:24.441+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:24.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:24.441+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:24.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:24.441+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:24.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:24.443+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:24.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:24.439+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:24.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:24.448+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:24.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:24.449+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:24.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:24.615+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:24.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:24.615+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:24.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:24.615+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:24.871 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:24.454+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:24.871 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:24.463+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:24.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:24 smithi162 ceph-mon[83709]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T12:32:24.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:24 smithi162 ceph-mon[83709]: Upgrade: Finalizing container_image settings 2024-03-30T12:32:24.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:24 smithi162 ceph-mon[83709]: Upgrade: Complete! 2024-03-30T12:32:24.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:24.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:24.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:24.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:24.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:24.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:24.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:24.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:24.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:24 smithi162 ceph-mon[83709]: osdmap e652: 8 total, 8 up, 8 in 2024-03-30T12:32:25.450 INFO:tasks.rados.rados.0.smithi084.stdout:2922: done (3 left) 2024-03-30T12:32:25.451 INFO:tasks.rados.rados.0.smithi084.stdout:2923: done (2 left) 2024-03-30T12:32:25.451 INFO:tasks.rados.rados.0.smithi084.stdout:2924: done (1 left) 2024-03-30T12:32:25.451 INFO:tasks.rados.rados.0.smithi084.stdout:2925: done (0 left) 2024-03-30T12:32:25.451 INFO:tasks.rados.rados.0.smithi084.stdout:2926: read oid 47 snap -1 2024-03-30T12:32:25.451 INFO:tasks.rados.rados.0.smithi084.stdout:2926: expect (ObjNum 881 snap 282 seq_num 881) 2024-03-30T12:32:25.451 INFO:tasks.rados.rados.0.smithi084.stdout:2927: delete oid 25 current snap is 290 2024-03-30T12:32:25.458 INFO:tasks.rados.rados.0.smithi084.stdout:2927: done (1 left) 2024-03-30T12:32:25.458 INFO:tasks.rados.rados.0.smithi084.stdout:2928: copy_from oid 40 from oid 42 current snap is 290 2024-03-30T12:32:25.458 INFO:tasks.rados.rados.0.smithi084.stdout:2929: copy_from oid 41 from oid 5 current snap is 290 2024-03-30T12:32:25.458 INFO:tasks.rados.rados.0.smithi084.stdout:2930: rollback oid 39 current snap is 290 2024-03-30T12:32:25.459 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 39 to 287 2024-03-30T12:32:25.459 INFO:tasks.rados.rados.0.smithi084.stdout:2931: copy_from oid 7 from oid 38 current snap is 290 2024-03-30T12:32:25.459 INFO:tasks.rados.rados.0.smithi084.stdout:2932: read oid 44 snap -1 2024-03-30T12:32:25.459 INFO:tasks.rados.rados.0.smithi084.stdout:2932: expect (ObjNum 904 snap 287 seq_num 904) 2024-03-30T12:32:25.459 INFO:tasks.rados.rados.0.smithi084.stdout:2933: read oid 4 snap 287 2024-03-30T12:32:25.459 INFO:tasks.rados.rados.0.smithi084.stdout:2933: expect deleted 2024-03-30T12:32:25.459 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 290 2024-03-30T12:32:25.459 INFO:tasks.rados.rados.0.smithi084.stdout:2934: seq_num 911 ranges {0=466944,466944=401408} 2024-03-30T12:32:25.461 INFO:tasks.rados.rados.0.smithi084.stdout:2934: writing smithi08477944-6 from 0 to 466944 tid 1 2024-03-30T12:32:25.464 INFO:tasks.rados.rados.0.smithi084.stdout:2934: writing smithi08477944-6 from 466944 to 868352 tid 2 2024-03-30T12:32:25.465 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 290 2024-03-30T12:32:25.465 INFO:tasks.rados.rados.0.smithi084.stdout:2935: seq_num 912 ranges {1302528=483328,1785856=401408} 2024-03-30T12:32:25.475 INFO:tasks.rados.rados.0.smithi084.stdout:2935: writing smithi08477944-19 from 1302528 to 1785856 tid 1 2024-03-30T12:32:25.478 INFO:tasks.rados.rados.0.smithi084.stdout:2935: writing smithi08477944-19 from 1785856 to 2187264 tid 2 2024-03-30T12:32:25.478 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 290 2024-03-30T12:32:25.478 INFO:tasks.rados.rados.0.smithi084.stdout:2936: seq_num 913 ranges {3833856=499712,4333568=401408} 2024-03-30T12:32:25.502 INFO:tasks.rados.rados.0.smithi084.stdout:2936: writing smithi08477944-34 from 3833856 to 4333568 tid 1 2024-03-30T12:32:25.504 INFO:tasks.rados.rados.0.smithi084.stdout:2936: writing smithi08477944-34 from 4333568 to 4734976 tid 2 2024-03-30T12:32:25.505 INFO:tasks.rados.rados.0.smithi084.stdout:2937: read oid 13 snap 287 2024-03-30T12:32:25.505 INFO:tasks.rados.rados.0.smithi084.stdout:2937: expect (ObjNum 836 snap 273 seq_num 836) 2024-03-30T12:32:25.505 INFO:tasks.rados.rados.0.smithi084.stdout:2938: delete oid 45 current snap is 290 2024-03-30T12:32:25.505 INFO:tasks.rados.rados.0.smithi084.stdout:2930: finishing rollback tid 0 to smithi08477944-39 2024-03-30T12:32:25.505 INFO:tasks.rados.rados.0.smithi084.stdout:2930: finishing rollback tid 1 to smithi08477944-39 2024-03-30T12:32:25.505 INFO:tasks.rados.rados.0.smithi084.stdout:2930: finishing rollback tid 2 to smithi08477944-39 2024-03-30T12:32:25.505 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 27289 (ObjNum 785 snap 262 seq_num 785) dirty exists 2024-03-30T12:32:25.505 INFO:tasks.rados.rados.0.smithi084.stdout:2926: expect (ObjNum 881 snap 282 seq_num 881) 2024-03-30T12:32:25.739 INFO:tasks.rados.rados.0.smithi084.stdout:2931: finishing copy_from to smithi08477944-7 2024-03-30T12:32:25.739 INFO:tasks.rados.rados.0.smithi084.stdout:2931: got expected ENOENT (src dne) 2024-03-30T12:32:25.739 INFO:tasks.rados.rados.0.smithi084.stdout:2931: finishing copy_from racing read to smithi08477944-7 2024-03-30T12:32:25.739 INFO:tasks.rados.rados.0.smithi084.stdout:2928: finishing copy_from racing read to smithi08477944-40 2024-03-30T12:32:25.739 INFO:tasks.rados.rados.0.smithi084.stdout:2928: finishing copy_from to smithi08477944-40 2024-03-30T12:32:25.739 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 27283 (ObjNum 825 snap 273 seq_num 825) dirty exists 2024-03-30T12:32:25.740 INFO:tasks.rados.rados.0.smithi084.stdout:2929: finishing copy_from racing read to smithi08477944-41 2024-03-30T12:32:25.740 INFO:tasks.rados.rados.0.smithi084.stdout:2932: expect (ObjNum 904 snap 287 seq_num 904) 2024-03-30T12:32:25.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:25.461+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:25.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:25.461+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:25.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:25.454+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:25.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:25.454+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:25.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:25.454+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:25.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:25.455+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:25.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:25.455+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:25.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:25.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:25.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:25.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:25.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[91810]: osdmap e653: 8 total, 8 up, 8 in 2024-03-30T12:32:25.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:25.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:25.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:25.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:25.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:25.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:25.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:25.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:25.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:25.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:25.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:25.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[91810]: pgmap v668: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 829 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 4.7 MiB/s rd, 4.5 MiB/s wr, 17 op/s 2024-03-30T12:32:25.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:25.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:25.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:25.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:25.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:25.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[89279]: osdmap e653: 8 total, 8 up, 8 in 2024-03-30T12:32:25.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:25.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:25.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:25.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:25.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:25.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:25.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:25.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:25.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:25.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:25.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:25.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[89279]: pgmap v668: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 829 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 4.7 MiB/s rd, 4.5 MiB/s wr, 17 op/s 2024-03-30T12:32:25.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:25.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:25.472+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:25.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:25.463+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:25.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:25.464+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:25.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:25.460+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:25.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:25.461+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:25.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:25.455+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:25.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:25.456+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:25.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:25.456+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:25.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:25.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:25.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:25.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:25.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-mon[83709]: osdmap e653: 8 total, 8 up, 8 in 2024-03-30T12:32:25.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:25.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:25.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:25.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:25.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:25.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:25.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:25.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:25.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:25.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:25.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:25.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-mon[83709]: pgmap v668: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 829 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 4.7 MiB/s rd, 4.5 MiB/s wr, 17 op/s 2024-03-30T12:32:25.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:32:26.158 INFO:tasks.rados.rados.0.smithi084.stdout:2934: finishing write tid 1 to smithi08477944-6 2024-03-30T12:32:26.158 INFO:tasks.rados.rados.0.smithi084.stdout:2934: finishing write tid 2 to smithi08477944-6 2024-03-30T12:32:26.158 INFO:tasks.rados.rados.0.smithi084.stdout:2929: finishing copy_from to smithi08477944-41 2024-03-30T12:32:26.158 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 23394 (ObjNum 836 snap 273 seq_num 836) dirty exists 2024-03-30T12:32:26.158 INFO:tasks.rados.rados.0.smithi084.stdout:2934: finishing write tid 3 to smithi08477944-6 2024-03-30T12:32:26.158 INFO:tasks.rados.rados.0.smithi084.stdout:2935: finishing write tid 1 to smithi08477944-19 2024-03-30T12:32:26.158 INFO:tasks.rados.rados.0.smithi084.stdout:2935: finishing write tid 2 to smithi08477944-19 2024-03-30T12:32:26.158 INFO:tasks.rados.rados.0.smithi084.stdout:2934: finishing write tid 4 to smithi08477944-6 2024-03-30T12:32:26.158 INFO:tasks.rados.rados.0.smithi084.stdout:2934: oid 6 updating version 0 to 36293 2024-03-30T12:32:26.159 INFO:tasks.rados.rados.0.smithi084.stdout:2934: oid 6 version 36293 is already newer than 36292 2024-03-30T12:32:26.159 INFO:tasks.rados.rados.0.smithi084.stdout:2934: oid 6 version 36293 is already newer than 36291 2024-03-30T12:32:26.159 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 36293 (ObjNum 911 snap 290 seq_num 911) dirty exists 2024-03-30T12:32:26.159 INFO:tasks.rados.rados.0.smithi084.stdout:2934: left oid 6 (ObjNum 911 snap 290 seq_num 911) 2024-03-30T12:32:26.159 INFO:tasks.rados.rados.0.smithi084.stdout:2935: finishing write tid 3 to smithi08477944-19 2024-03-30T12:32:26.159 INFO:tasks.rados.rados.0.smithi084.stdout:2926: done (11 left) 2024-03-30T12:32:26.159 INFO:tasks.rados.rados.0.smithi084.stdout:2928: done (10 left) 2024-03-30T12:32:26.159 INFO:tasks.rados.rados.0.smithi084.stdout:2929: done (9 left) 2024-03-30T12:32:26.159 INFO:tasks.rados.rados.0.smithi084.stdout:2930: done (8 left) 2024-03-30T12:32:26.159 INFO:tasks.rados.rados.0.smithi084.stdout:2931: done (7 left) 2024-03-30T12:32:26.159 INFO:tasks.rados.rados.0.smithi084.stdout:2932: done (6 left) 2024-03-30T12:32:26.159 INFO:tasks.rados.rados.0.smithi084.stdout:2933: done (5 left) 2024-03-30T12:32:26.159 INFO:tasks.rados.rados.0.smithi084.stdout:2934: done (4 left) 2024-03-30T12:32:26.159 INFO:tasks.rados.rados.0.smithi084.stdout:2938: done (3 left) 2024-03-30T12:32:26.159 INFO:tasks.rados.rados.0.smithi084.stdout:2939: rmattr oid 11 current snap is 290 2024-03-30T12:32:26.160 INFO:tasks.rados.rados.0.smithi084.stdout:2936: finishing write tid 1 to smithi08477944-34 2024-03-30T12:32:26.160 INFO:tasks.rados.rados.0.smithi084.stdout:2936: finishing write tid 2 to smithi08477944-34 2024-03-30T12:32:26.160 INFO:tasks.rados.rados.0.smithi084.stdout:2936: finishing write tid 3 to smithi08477944-34 2024-03-30T12:32:26.160 INFO:tasks.rados.rados.0.smithi084.stdout:2936: finishing write tid 4 to smithi08477944-34 2024-03-30T12:32:26.160 INFO:tasks.rados.rados.0.smithi084.stdout:2936: oid 34 updating version 0 to 27226 2024-03-30T12:32:26.160 INFO:tasks.rados.rados.0.smithi084.stdout:2936: oid 34 version 27226 is already newer than 27225 2024-03-30T12:32:26.160 INFO:tasks.rados.rados.0.smithi084.stdout:2936: oid 34 updating version 27226 to 27227 2024-03-30T12:32:26.160 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 27227 (ObjNum 913 snap 290 seq_num 913) dirty exists 2024-03-30T12:32:26.160 INFO:tasks.rados.rados.0.smithi084.stdout:2936: left oid 34 (ObjNum 913 snap 290 seq_num 913) 2024-03-30T12:32:26.160 INFO:tasks.rados.rados.0.smithi084.stdout:2935: finishing write tid 4 to smithi08477944-19 2024-03-30T12:32:26.160 INFO:tasks.rados.rados.0.smithi084.stdout:2935: oid 19 updating version 0 to 36297 2024-03-30T12:32:26.160 INFO:tasks.rados.rados.0.smithi084.stdout:2935: oid 19 version 36297 is already newer than 36295 2024-03-30T12:32:26.160 INFO:tasks.rados.rados.0.smithi084.stdout:2935: oid 19 version 36297 is already newer than 36296 2024-03-30T12:32:26.160 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 36297 (ObjNum 912 snap 290 seq_num 912) dirty exists 2024-03-30T12:32:26.160 INFO:tasks.rados.rados.0.smithi084.stdout:2935: left oid 19 (ObjNum 912 snap 290 seq_num 912) 2024-03-30T12:32:26.161 INFO:tasks.rados.rados.0.smithi084.stdout:2937: expect (ObjNum 836 snap 273 seq_num 836) 2024-03-30T12:32:26.460 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 23395 (ObjNum 882 snap 282 seq_num 882) dirty exists 2024-03-30T12:32:26.461 INFO:tasks.rados.rados.0.smithi084.stdout:2935: done (3 left) 2024-03-30T12:32:26.461 INFO:tasks.rados.rados.0.smithi084.stdout:2936: done (2 left) 2024-03-30T12:32:26.461 INFO:tasks.rados.rados.0.smithi084.stdout:2937: done (1 left) 2024-03-30T12:32:26.461 INFO:tasks.rados.rados.0.smithi084.stdout:2939: done (0 left) 2024-03-30T12:32:26.461 INFO:tasks.rados.rados.0.smithi084.stdout:2940: snap_remove snap 276 2024-03-30T12:32:26.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:26.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:26.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:26.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:26.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:26.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:26.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[91810]: osdmap e654: 8 total, 8 up, 8 in 2024-03-30T12:32:26.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:26.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:26.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:26.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:26.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:26.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:26.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:26.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:26.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:26.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:26.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:26.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:26.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:26.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[89279]: osdmap e654: 8 total, 8 up, 8 in 2024-03-30T12:32:26.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:26.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:26.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:26.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:26.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:26.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:26.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:26.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:26.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:26.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:26.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:26.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:26.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 154=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:26.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:26 smithi162 ceph-mon[83709]: osdmap e654: 8 total, 8 up, 8 in 2024-03-30T12:32:26.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:26.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:26.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:26.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:26.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:26.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:26.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:27.454 INFO:tasks.rados.rados.0.smithi084.stdout:2940: done (0 left) 2024-03-30T12:32:27.454 INFO:tasks.rados.rados.0.smithi084.stdout:2941: rollback oid 23 current snap is 290 2024-03-30T12:32:27.454 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 23 to 288 2024-03-30T12:32:27.454 INFO:tasks.rados.rados.0.smithi084.stdout:2942: read oid 4 snap 288 2024-03-30T12:32:27.455 INFO:tasks.rados.rados.0.smithi084.stdout:2942: expect deleted 2024-03-30T12:32:27.455 INFO:tasks.rados.rados.0.smithi084.stdout:2943: snap_remove snap 287 2024-03-30T12:32:27.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:27 smithi084 ceph-mon[91810]: pgmap v670: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 831 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 4.3 MiB/s rd, 885 KiB/s wr, 15 op/s 2024-03-30T12:32:27.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:27 smithi084 ceph-mon[89279]: pgmap v670: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 831 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 4.3 MiB/s rd, 885 KiB/s wr, 15 op/s 2024-03-30T12:32:27.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:27.461+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:27.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:27.462+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:27.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:27.461+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:27.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:27.461+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:27.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:27.461+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:27.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:27.461+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:27.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:27.461+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:27.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:27.461+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:27.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:27 smithi162 ceph-mon[83709]: pgmap v670: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 831 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 4.3 MiB/s rd, 885 KiB/s wr, 15 op/s 2024-03-30T12:32:27.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:27.463+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:27.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:27.463+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:27.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:27.515+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:27.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:27.515+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:27.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:27.515+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:28.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:28.086+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:28.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:28.087+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:28.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:28.087+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:28.454 INFO:tasks.rados.rados.0.smithi084.stdout:2943: done (2 left) 2024-03-30T12:32:28.454 INFO:tasks.rados.rados.0.smithi084.stdout:2944: snap_remove snap 289 2024-03-30T12:32:28.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[89279]: osdmap e655: 8 total, 8 up, 8 in 2024-03-30T12:32:28.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:28.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:28.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:28.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:28.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:28.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:28.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:28.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:28.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:28.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:28.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:28.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[91810]: osdmap e655: 8 total, 8 up, 8 in 2024-03-30T12:32:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:28.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:28.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:28.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:28.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:28.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:28.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:28.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:28.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:28.462+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:28.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:28.462+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:28.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:28.463+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:28.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:28 smithi162 ceph-mon[83709]: osdmap e655: 8 total, 8 up, 8 in 2024-03-30T12:32:28.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:28.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:28.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:28.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:28.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:28.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:28.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:28.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:28.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:28.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:28.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:28.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:29.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:28.946+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:29.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:28.946+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:29.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:28.945+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:29.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:28.946+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:29.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:28.946+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:29.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:28.946+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:29.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:28.946+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:29.369 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:28.947+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:29.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:28.947+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:29.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:28.946+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:29.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:28.947+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:29.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:28.947+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:29.471 INFO:tasks.rados.rados.0.smithi084.stdout:2944: done (2 left) 2024-03-30T12:32:29.471 INFO:tasks.rados.rados.0.smithi084.stdout:2945: delete oid 17 current snap is 290 2024-03-30T12:32:29.471 INFO:tasks.rados.rados.0.smithi084.stdout:2941: finishing rollback tid 0 to smithi08477944-23 2024-03-30T12:32:29.471 INFO:tasks.rados.rados.0.smithi084.stdout:2941: finishing rollback tid 1 to smithi08477944-23 2024-03-30T12:32:29.471 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 36269 (ObjNum 33 snap 0 seq_num 1428878592) dirty dne 2024-03-30T12:32:29.475 INFO:tasks.rados.rados.0.smithi084.stdout:2941: done (2 left) 2024-03-30T12:32:29.476 INFO:tasks.rados.rados.0.smithi084.stdout:2942: done (1 left) 2024-03-30T12:32:29.476 INFO:tasks.rados.rados.0.smithi084.stdout:2945: done (0 left) 2024-03-30T12:32:29.476 INFO:tasks.rados.rados.0.smithi084.stdout:2946: snap_remove snap 288 2024-03-30T12:32:29.755 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:32:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:32:29] "GET /metrics HTTP/1.1" 200 36329 "" "Prometheus/2.43.0" 2024-03-30T12:32:29.755 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:29.481+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:29.755 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:29.483+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:29.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:29.477+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:29.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:29.477+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:29.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:29.477+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:29.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:29.477+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:29.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:29.478+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:29.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:29.478+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:29.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:29.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:29.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:29 smithi084 ceph-mon[91810]: osdmap e656: 8 total, 8 up, 8 in 2024-03-30T12:32:29.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:29.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:29.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:29 smithi084 ceph-mon[91810]: pgmap v673: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 840 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 7.5 MiB/s rd, 2.5 MiB/s wr, 12 op/s 2024-03-30T12:32:29.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:29.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:29.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:29.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:29.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:29 smithi084 ceph-mon[89279]: osdmap e656: 8 total, 8 up, 8 in 2024-03-30T12:32:29.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:29.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:29.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:29 smithi084 ceph-mon[89279]: pgmap v673: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 840 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 7.5 MiB/s rd, 2.5 MiB/s wr, 12 op/s 2024-03-30T12:32:29.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:29.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:29.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:29.475+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:29.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:29.507+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:29.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:29.507+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:29.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:29.478+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:29.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:29.478+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:29.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:29.508+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:29.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:29.508+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:29.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:29.508+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:29.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:29.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:29.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:29 smithi162 ceph-mon[83709]: osdmap e656: 8 total, 8 up, 8 in 2024-03-30T12:32:29.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:29.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:29.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:29 smithi162 ceph-mon[83709]: pgmap v673: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 840 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 7.5 MiB/s rd, 2.5 MiB/s wr, 12 op/s 2024-03-30T12:32:29.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:29.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:30.480 INFO:tasks.rados.rados.0.smithi084.stdout:2946: done (0 left) 2024-03-30T12:32:30.481 INFO:tasks.rados.rados.0.smithi084.stdout:2947: copy_from oid 31 from oid 28 current snap is 290 2024-03-30T12:32:30.481 INFO:tasks.rados.rados.0.smithi084.stdout:2948: copy_from oid 40 from oid 24 current snap is 290 2024-03-30T12:32:30.481 INFO:tasks.rados.rados.0.smithi084.stdout:2949: read oid 17 snap -1 2024-03-30T12:32:30.481 INFO:tasks.rados.rados.0.smithi084.stdout:2949: expect deleted 2024-03-30T12:32:30.481 INFO:tasks.rados.rados.0.smithi084.stdout:2950: rmattr oid 35 current snap is 290 2024-03-30T12:32:30.481 INFO:tasks.rados.rados.0.smithi084.stdout:2950: done (3 left) 2024-03-30T12:32:30.481 INFO:tasks.rados.rados.0.smithi084.stdout:2951: delete oid 10 current snap is 290 2024-03-30T12:32:30.485 INFO:tasks.rados.rados.0.smithi084.stdout:2947: finishing copy_from racing read to smithi08477944-31 2024-03-30T12:32:30.488 INFO:tasks.rados.rados.0.smithi084.stdout:2947: finishing copy_from to smithi08477944-31 2024-03-30T12:32:30.488 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 23415 (ObjNum 883 snap 282 seq_num 883) dirty exists 2024-03-30T12:32:30.489 INFO:tasks.rados.rados.0.smithi084.stdout:2948: finishing copy_from to smithi08477944-40 2024-03-30T12:32:30.489 INFO:tasks.rados.rados.0.smithi084.stdout:2948: got expected ENOENT (src dne) 2024-03-30T12:32:30.489 INFO:tasks.rados.rados.0.smithi084.stdout:2948: finishing copy_from racing read to smithi08477944-40 2024-03-30T12:32:30.493 INFO:tasks.rados.rados.0.smithi084.stdout:2947: done (3 left) 2024-03-30T12:32:30.493 INFO:tasks.rados.rados.0.smithi084.stdout:2948: done (2 left) 2024-03-30T12:32:30.493 INFO:tasks.rados.rados.0.smithi084.stdout:2949: done (1 left) 2024-03-30T12:32:30.494 INFO:tasks.rados.rados.0.smithi084.stdout:2951: done (0 left) 2024-03-30T12:32:30.494 INFO:tasks.rados.rados.0.smithi084.stdout:2952: delete oid 40 current snap is 290 2024-03-30T12:32:30.497 INFO:tasks.rados.rados.0.smithi084.stdout:2952: done (0 left) 2024-03-30T12:32:30.497 INFO:tasks.rados.rados.0.smithi084.stdout:2953: delete oid 37 current snap is 290 2024-03-30T12:32:30.502 INFO:tasks.rados.rados.0.smithi084.stdout:2953: done (0 left) 2024-03-30T12:32:30.502 INFO:tasks.rados.rados.0.smithi084.stdout:2954: rmattr oid 49 current snap is 290 2024-03-30T12:32:30.502 INFO:tasks.rados.rados.0.smithi084.stdout:2954: done (0 left) 2024-03-30T12:32:30.502 INFO:tasks.rados.rados.0.smithi084.stdout:2955: setattr oid 46 current snap is 290 2024-03-30T12:32:30.505 INFO:tasks.rados.rados.0.smithi084.stdout:2956: rollback oid 31 current snap is 290 2024-03-30T12:32:30.505 INFO:tasks.rados.rados.0.smithi084.stdout:2956: done (1 left) 2024-03-30T12:32:30.505 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 290 2024-03-30T12:32:30.505 INFO:tasks.rados.rados.0.smithi084.stdout:2957: seq_num 919 ranges {0=598016,598016=401408} 2024-03-30T12:32:30.508 INFO:tasks.rados.rados.0.smithi084.stdout:2957: writing smithi08477944-38 from 0 to 598016 tid 1 2024-03-30T12:32:30.512 INFO:tasks.rados.rados.0.smithi084.stdout:2957: writing smithi08477944-38 from 598016 to 999424 tid 2 2024-03-30T12:32:30.512 INFO:tasks.rados.rados.0.smithi084.stdout:2958: rollback oid 2 current snap is 290 2024-03-30T12:32:30.512 INFO:tasks.rados.rados.0.smithi084.stdout:2958: done (2 left) 2024-03-30T12:32:30.512 INFO:tasks.rados.rados.0.smithi084.stdout:2959: setattr oid 48 current snap is 290 2024-03-30T12:32:30.512 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 27321 (ObjNum 900 snap 287 seq_num 900) dirty exists 2024-03-30T12:32:30.513 INFO:tasks.rados.rados.0.smithi084.stdout:2955: done (2 left) 2024-03-30T12:32:30.514 INFO:tasks.rados.rados.0.smithi084.stdout:2960: read oid 42 snap -1 2024-03-30T12:32:30.514 INFO:tasks.rados.rados.0.smithi084.stdout:2960: expect (ObjNum 825 snap 273 seq_num 825) 2024-03-30T12:32:30.514 INFO:tasks.rados.rados.0.smithi084.stdout:2961: rmattr oid 19 current snap is 290 2024-03-30T12:32:30.514 INFO:tasks.rados.rados.0.smithi084.stdout:2961: done (3 left) 2024-03-30T12:32:30.514 INFO:tasks.rados.rados.0.smithi084.stdout:2962: rollback oid 37 current snap is 290 2024-03-30T12:32:30.514 INFO:tasks.rados.rados.0.smithi084.stdout:2962: done (3 left) 2024-03-30T12:32:30.514 INFO:tasks.rados.rados.0.smithi084.stdout:2963: snap_create 2024-03-30T12:32:30.515 INFO:tasks.rados.rados.0.smithi084.stdout:2957: finishing write tid 1 to smithi08477944-38 2024-03-30T12:32:30.516 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 930 (ObjNum 879 snap 282 seq_num 879) dirty exists 2024-03-30T12:32:30.516 INFO:tasks.rados.rados.0.smithi084.stdout:2957: finishing write tid 2 to smithi08477944-38 2024-03-30T12:32:30.517 INFO:tasks.rados.rados.0.smithi084.stdout:2957: finishing write tid 3 to smithi08477944-38 2024-03-30T12:32:30.518 INFO:tasks.rados.rados.0.smithi084.stdout:2957: finishing write tid 4 to smithi08477944-38 2024-03-30T12:32:30.518 INFO:tasks.rados.rados.0.smithi084.stdout:2957: oid 38 updating version 0 to 27280 2024-03-30T12:32:30.518 INFO:tasks.rados.rados.0.smithi084.stdout:2957: oid 38 updating version 27280 to 27282 2024-03-30T12:32:30.518 INFO:tasks.rados.rados.0.smithi084.stdout:2957: oid 38 version 27282 is already newer than 27281 2024-03-30T12:32:30.519 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 27282 (ObjNum 919 snap 290 seq_num 919) dirty exists 2024-03-30T12:32:30.519 INFO:tasks.rados.rados.0.smithi084.stdout:2957: left oid 38 (ObjNum 919 snap 290 seq_num 919) 2024-03-30T12:32:30.520 INFO:tasks.rados.rados.0.smithi084.stdout:2960: expect (ObjNum 825 snap 273 seq_num 825) 2024-03-30T12:32:30.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:30.492+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:30.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:30.493+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:30.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:30.487+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:30.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:30.487+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:30.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:30.488+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:30.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:30.488+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:30.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:30.488+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:30.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:30.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:30.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:30.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:30.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:30.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[91810]: osdmap e657: 8 total, 8 up, 8 in 2024-03-30T12:32:30.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:30.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:30.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:30.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:30.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:32:30.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:30.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:30.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:30.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:30.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:30.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:30.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:30.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:30.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:30.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:30.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:30.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:30.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:30.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:30.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:30.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[89279]: osdmap e657: 8 total, 8 up, 8 in 2024-03-30T12:32:30.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:30.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:30.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:30.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:30.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:30 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:32:30.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:30.502+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:30.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:30.494+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:30.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:30.494+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:30.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:30.496+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:30.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:30.490+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:30.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:30.490+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:30.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:30.497+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:30.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:30.498+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:30.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:30.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:30.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:30.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:30.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:30.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:30.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:30.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:30.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15a=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:30.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:30.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:30.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:30.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:30.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:30.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:30.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-mon[83709]: osdmap e657: 8 total, 8 up, 8 in 2024-03-30T12:32:30.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:30.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:30.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:30.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:30.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:30 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:32:31.488 INFO:tasks.rados.rados.0.smithi084.stdout:2957: done (3 left) 2024-03-30T12:32:31.488 INFO:tasks.rados.rados.0.smithi084.stdout:2959: done (2 left) 2024-03-30T12:32:31.488 INFO:tasks.rados.rados.0.smithi084.stdout:2960: done (1 left) 2024-03-30T12:32:31.488 INFO:tasks.rados.rados.0.smithi084.stdout:2963: done (0 left) 2024-03-30T12:32:31.488 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 291 2024-03-30T12:32:31.488 INFO:tasks.rados.rados.0.smithi084.stdout:2964: seq_num 920 ranges {0=614400,614400=401408} 2024-03-30T12:32:31.491 INFO:tasks.rados.rados.0.smithi084.stdout:2964: writing smithi08477944-9 from 0 to 614400 tid 1 2024-03-30T12:32:31.494 INFO:tasks.rados.rados.0.smithi084.stdout:2964: writing smithi08477944-9 from 614400 to 1015808 tid 2 2024-03-30T12:32:31.494 INFO:tasks.rados.rados.0.smithi084.stdout:2965: copy_from oid 12 from oid 28 current snap is 291 2024-03-30T12:32:31.494 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 291 2024-03-30T12:32:31.494 INFO:tasks.rados.rados.0.smithi084.stdout:2966: seq_num 921 ranges {6627328=630784,7258112=401408} 2024-03-30T12:32:31.533 INFO:tasks.rados.rados.0.smithi084.stdout:2966: writing smithi08477944-50 from 6627328 to 7258112 tid 1 2024-03-30T12:32:31.535 INFO:tasks.rados.rados.0.smithi084.stdout:2966: writing smithi08477944-50 from 7258112 to 7659520 tid 2 2024-03-30T12:32:31.535 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 291 2024-03-30T12:32:31.535 INFO:tasks.rados.rados.0.smithi084.stdout:2964: finishing write tid 1 to smithi08477944-9 2024-03-30T12:32:31.535 INFO:tasks.rados.rados.0.smithi084.stdout:2967: seq_num 922 ranges {6012928=647168,6660096=401408} 2024-03-30T12:32:31.570 INFO:tasks.rados.rados.0.smithi084.stdout:2967: writing smithi08477944-13 from 6012928 to 6660096 tid 1 2024-03-30T12:32:31.573 INFO:tasks.rados.rados.0.smithi084.stdout:2967: writing smithi08477944-13 from 6660096 to 7061504 tid 2 2024-03-30T12:32:31.573 INFO:tasks.rados.rados.0.smithi084.stdout:2968: snap_create 2024-03-30T12:32:31.574 INFO:tasks.rados.rados.0.smithi084.stdout:2964: finishing write tid 2 to smithi08477944-9 2024-03-30T12:32:31.574 INFO:tasks.rados.rados.0.smithi084.stdout:2964: finishing write tid 3 to smithi08477944-9 2024-03-30T12:32:31.574 INFO:tasks.rados.rados.0.smithi084.stdout:2964: finishing write tid 4 to smithi08477944-9 2024-03-30T12:32:31.574 INFO:tasks.rados.rados.0.smithi084.stdout:2964: oid 9 updating version 0 to 22506 2024-03-30T12:32:31.574 INFO:tasks.rados.rados.0.smithi084.stdout:2964: oid 9 updating version 22506 to 22507 2024-03-30T12:32:31.574 INFO:tasks.rados.rados.0.smithi084.stdout:2964: oid 9 version 22507 is already newer than 22505 2024-03-30T12:32:31.574 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 22507 (ObjNum 920 snap 291 seq_num 920) dirty exists 2024-03-30T12:32:31.574 INFO:tasks.rados.rados.0.smithi084.stdout:2964: left oid 9 (ObjNum 920 snap 291 seq_num 920) 2024-03-30T12:32:31.574 INFO:tasks.rados.rados.0.smithi084.stdout:2965: finishing copy_from racing read to smithi08477944-12 2024-03-30T12:32:31.574 INFO:tasks.rados.rados.0.smithi084.stdout:2965: finishing copy_from to smithi08477944-12 2024-03-30T12:32:31.574 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 23415 (ObjNum 883 snap 282 seq_num 883) dirty exists 2024-03-30T12:32:31.574 INFO:tasks.rados.rados.0.smithi084.stdout:2966: finishing write tid 1 to smithi08477944-50 2024-03-30T12:32:31.574 INFO:tasks.rados.rados.0.smithi084.stdout:2966: finishing write tid 2 to smithi08477944-50 2024-03-30T12:32:31.574 INFO:tasks.rados.rados.0.smithi084.stdout:2966: finishing write tid 3 to smithi08477944-50 2024-03-30T12:32:31.575 INFO:tasks.rados.rados.0.smithi084.stdout:2966: finishing write tid 4 to smithi08477944-50 2024-03-30T12:32:31.575 INFO:tasks.rados.rados.0.smithi084.stdout:2966: oid 50 updating version 0 to 23427 2024-03-30T12:32:31.575 INFO:tasks.rados.rados.0.smithi084.stdout:2966: oid 50 version 23427 is already newer than 23425 2024-03-30T12:32:31.575 INFO:tasks.rados.rados.0.smithi084.stdout:2966: oid 50 version 23427 is already newer than 23426 2024-03-30T12:32:31.575 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 23427 (ObjNum 921 snap 291 seq_num 921) dirty exists 2024-03-30T12:32:31.575 INFO:tasks.rados.rados.0.smithi084.stdout:2966: left oid 50 (ObjNum 921 snap 291 seq_num 921) 2024-03-30T12:32:31.587 INFO:tasks.rados.rados.0.smithi084.stdout:2967: finishing write tid 1 to smithi08477944-13 2024-03-30T12:32:31.587 INFO:tasks.rados.rados.0.smithi084.stdout:2967: finishing write tid 2 to smithi08477944-13 2024-03-30T12:32:31.587 INFO:tasks.rados.rados.0.smithi084.stdout:2967: finishing write tid 3 to smithi08477944-13 2024-03-30T12:32:31.592 INFO:tasks.rados.rados.0.smithi084.stdout:2967: finishing write tid 4 to smithi08477944-13 2024-03-30T12:32:31.592 INFO:tasks.rados.rados.0.smithi084.stdout:2967: oid 13 updating version 0 to 23415 2024-03-30T12:32:31.592 INFO:tasks.rados.rados.0.smithi084.stdout:2967: oid 13 version 23415 is already newer than 23414 2024-03-30T12:32:31.592 INFO:tasks.rados.rados.0.smithi084.stdout:2967: oid 13 version 23415 is already newer than 23413 2024-03-30T12:32:31.592 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 23415 (ObjNum 922 snap 291 seq_num 922) dirty exists 2024-03-30T12:32:31.592 INFO:tasks.rados.rados.0.smithi084.stdout:2967: left oid 13 (ObjNum 922 snap 291 seq_num 922) 2024-03-30T12:32:31.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:31.497+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:31.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:31.497+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:31.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:31.494+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:31.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:31.494+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:31.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:31.494+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:31.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:31.494+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:31.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:31.495+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:31.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:31.495+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:31.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:31.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:31.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:31.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:31.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:31.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:31.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[91810]: osdmap e658: 8 total, 8 up, 8 in 2024-03-30T12:32:31.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:31.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:31.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:31.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:31.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:31.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:31.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:31.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:31.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:31.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[91810]: pgmap v676: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 837 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 15 MiB/s rd, 2.5 MiB/s wr, 10 op/s 2024-03-30T12:32:31.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:31.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:31.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:31.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:31.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:31.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:31.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[89279]: osdmap e658: 8 total, 8 up, 8 in 2024-03-30T12:32:31.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:31.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:31.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:31.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:31.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:31.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:31.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:31.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:31.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:31.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:31 smithi084 ceph-mon[89279]: pgmap v676: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 837 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 15 MiB/s rd, 2.5 MiB/s wr, 10 op/s 2024-03-30T12:32:31.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:31.512+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:31.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:31.494+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:31.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:31.495+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:31.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:31.505+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:31.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:31.506+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:31.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:31.506+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:31.871 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:31.506+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:31.871 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:31.506+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:31.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:31.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:31.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:31.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:31.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:31.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:31.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:31 smithi162 ceph-mon[83709]: osdmap e658: 8 total, 8 up, 8 in 2024-03-30T12:32:31.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:31.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:31.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:31.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:31.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:31.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:31.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:31.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:31.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:31.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:31 smithi162 ceph-mon[83709]: pgmap v676: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 837 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 15 MiB/s rd, 2.5 MiB/s wr, 10 op/s 2024-03-30T12:32:32.496 INFO:tasks.rados.rados.0.smithi084.stdout:2964: done (4 left) 2024-03-30T12:32:32.496 INFO:tasks.rados.rados.0.smithi084.stdout:2965: done (3 left) 2024-03-30T12:32:32.496 INFO:tasks.rados.rados.0.smithi084.stdout:2966: done (2 left) 2024-03-30T12:32:32.496 INFO:tasks.rados.rados.0.smithi084.stdout:2967: done (1 left) 2024-03-30T12:32:32.496 INFO:tasks.rados.rados.0.smithi084.stdout:2968: done (0 left) 2024-03-30T12:32:32.496 INFO:tasks.rados.rados.0.smithi084.stdout:2969: read oid 35 snap 290 2024-03-30T12:32:32.496 INFO:tasks.rados.rados.0.smithi084.stdout:2969: expect (ObjNum 664 snap 232 seq_num 664) 2024-03-30T12:32:32.496 INFO:tasks.rados.rados.0.smithi084.stdout:2970: read oid 5 snap 291 2024-03-30T12:32:32.496 INFO:tasks.rados.rados.0.smithi084.stdout:2970: expect (ObjNum 836 snap 273 seq_num 836) 2024-03-30T12:32:32.497 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 292 2024-03-30T12:32:32.497 INFO:tasks.rados.rados.0.smithi084.stdout:2971: seq_num 923 ranges {0=663552,663552=401408} 2024-03-30T12:32:32.499 INFO:tasks.rados.rados.0.smithi084.stdout:2971: writing smithi08477944-10 from 0 to 663552 tid 1 2024-03-30T12:32:32.502 INFO:tasks.rados.rados.0.smithi084.stdout:2971: writing smithi08477944-10 from 663552 to 1064960 tid 2 2024-03-30T12:32:32.502 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 292 2024-03-30T12:32:32.502 INFO:tasks.rados.rados.0.smithi084.stdout:2972: seq_num 924 ranges {0=679936,679936=401408} 2024-03-30T12:32:32.506 INFO:tasks.rados.rados.0.smithi084.stdout:2972: writing smithi08477944-3 from 0 to 679936 tid 1 2024-03-30T12:32:32.509 INFO:tasks.rados.rados.0.smithi084.stdout:2972: writing smithi08477944-3 from 679936 to 1081344 tid 2 2024-03-30T12:32:32.509 INFO:tasks.rados.rados.0.smithi084.stdout:2973: rmattr oid 28 current snap is 292 2024-03-30T12:32:32.509 INFO:tasks.rados.rados.0.smithi084.stdout:2973: done (4 left) 2024-03-30T12:32:32.509 INFO:tasks.rados.rados.0.smithi084.stdout:2974: rollback oid 47 current snap is 292 2024-03-30T12:32:32.509 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 290 2024-03-30T12:32:32.509 INFO:tasks.rados.rados.0.smithi084.stdout:2969: expect (ObjNum 664 snap 232 seq_num 664) 2024-03-30T12:32:32.556 INFO:tasks.rados.rados.0.smithi084.stdout:2974: finishing rollback tid 0 to smithi08477944-47 2024-03-30T12:32:32.556 INFO:tasks.rados.rados.0.smithi084.stdout:2974: finishing rollback tid 1 to smithi08477944-47 2024-03-30T12:32:32.556 INFO:tasks.rados.rados.0.smithi084.stdout:2974: finishing rollback tid 2 to smithi08477944-47 2024-03-30T12:32:32.557 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 27287 (ObjNum 881 snap 282 seq_num 881) dirty exists 2024-03-30T12:32:32.557 INFO:tasks.rados.rados.0.smithi084.stdout:2971: finishing write tid 1 to smithi08477944-10 2024-03-30T12:32:32.557 INFO:tasks.rados.rados.0.smithi084.stdout:2971: finishing write tid 2 to smithi08477944-10 2024-03-30T12:32:32.557 INFO:tasks.rados.rados.0.smithi084.stdout:2971: finishing write tid 3 to smithi08477944-10 2024-03-30T12:32:32.557 INFO:tasks.rados.rados.0.smithi084.stdout:2972: finishing write tid 1 to smithi08477944-3 2024-03-30T12:32:32.557 INFO:tasks.rados.rados.0.smithi084.stdout:2972: finishing write tid 2 to smithi08477944-3 2024-03-30T12:32:32.557 INFO:tasks.rados.rados.0.smithi084.stdout:2969: done (4 left) 2024-03-30T12:32:32.557 INFO:tasks.rados.rados.0.smithi084.stdout:2974: done (3 left) 2024-03-30T12:32:32.557 INFO:tasks.rados.rados.0.smithi084.stdout:2975: rmattr oid 20 current snap is 292 2024-03-30T12:32:32.557 INFO:tasks.rados.rados.0.smithi084.stdout:2975: done (3 left) 2024-03-30T12:32:32.557 INFO:tasks.rados.rados.0.smithi084.stdout:2976: rmattr oid 41 current snap is 292 2024-03-30T12:32:32.557 INFO:tasks.rados.rados.0.smithi084.stdout:2972: finishing write tid 3 to smithi08477944-3 2024-03-30T12:32:32.557 INFO:tasks.rados.rados.0.smithi084.stdout:2971: finishing write tid 4 to smithi08477944-10 2024-03-30T12:32:32.557 INFO:tasks.rados.rados.0.smithi084.stdout:2971: oid 10 updating version 0 to 36270 2024-03-30T12:32:32.557 INFO:tasks.rados.rados.0.smithi084.stdout:2971: oid 10 updating version 36270 to 36271 2024-03-30T12:32:32.558 INFO:tasks.rados.rados.0.smithi084.stdout:2971: oid 10 version 36271 is already newer than 36269 2024-03-30T12:32:32.558 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 36271 (ObjNum 923 snap 292 seq_num 923) dirty exists 2024-03-30T12:32:32.558 INFO:tasks.rados.rados.0.smithi084.stdout:2971: left oid 10 (ObjNum 923 snap 292 seq_num 923) 2024-03-30T12:32:32.558 INFO:tasks.rados.rados.0.smithi084.stdout:2970: expect (ObjNum 836 snap 273 seq_num 836) 2024-03-30T12:32:32.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:32.517+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:32.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:32.517+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:32.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:32.503+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:32.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:32.504+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:32.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:32.504+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:32.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:32.504+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:32.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:32.504+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:32.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:32.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:32.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:32.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:32.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:32.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:32.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[91810]: osdmap e659: 8 total, 8 up, 8 in 2024-03-30T12:32:32.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:32.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:32.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:32.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:32.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:32.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:32.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:32.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:32.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:32.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:32.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:32.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:32.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[89279]: osdmap e659: 8 total, 8 up, 8 in 2024-03-30T12:32:32.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:32.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:32.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:32.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:32.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:32.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:32.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:32.862 INFO:tasks.rados.rados.0.smithi084.stdout:2972: finishing write tid 4 to smithi08477944-3 2024-03-30T12:32:32.862 INFO:tasks.rados.rados.0.smithi084.stdout:2972: oid 3 updating version 0 to 27324 2024-03-30T12:32:32.862 INFO:tasks.rados.rados.0.smithi084.stdout:2972: oid 3 version 27324 is already newer than 27322 2024-03-30T12:32:32.862 INFO:tasks.rados.rados.0.smithi084.stdout:2972: oid 3 version 27324 is already newer than 27323 2024-03-30T12:32:32.863 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 27324 (ObjNum 924 snap 292 seq_num 924) dirty exists 2024-03-30T12:32:32.863 INFO:tasks.rados.rados.0.smithi084.stdout:2972: left oid 3 (ObjNum 924 snap 292 seq_num 924) 2024-03-30T12:32:32.863 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 23428 (ObjNum 836 snap 273 seq_num 836) dirty exists 2024-03-30T12:32:32.863 INFO:tasks.rados.rados.0.smithi084.stdout:2970: done (3 left) 2024-03-30T12:32:32.863 INFO:tasks.rados.rados.0.smithi084.stdout:2971: done (2 left) 2024-03-30T12:32:32.863 INFO:tasks.rados.rados.0.smithi084.stdout:2972: done (1 left) 2024-03-30T12:32:32.863 INFO:tasks.rados.rados.0.smithi084.stdout:2976: done (0 left) 2024-03-30T12:32:32.863 INFO:tasks.rados.rados.0.smithi084.stdout:2977: read oid 21 snap -1 2024-03-30T12:32:32.863 INFO:tasks.rados.rados.0.smithi084.stdout:2977: expect (ObjNum 901 snap 287 seq_num 901) 2024-03-30T12:32:32.863 INFO:tasks.rados.rados.0.smithi084.stdout:2978: rollback oid 3 current snap is 292 2024-03-30T12:32:32.863 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 3 to 291 2024-03-30T12:32:32.863 INFO:tasks.rados.rados.0.smithi084.stdout:2979: read oid 28 snap -1 2024-03-30T12:32:32.863 INFO:tasks.rados.rados.0.smithi084.stdout:2979: expect (ObjNum 883 snap 282 seq_num 883) 2024-03-30T12:32:32.863 INFO:tasks.rados.rados.0.smithi084.stdout:2980: setattr oid 47 current snap is 292 2024-03-30T12:32:32.864 INFO:tasks.rados.rados.0.smithi084.stdout:2981: rmattr oid 6 current snap is 292 2024-03-30T12:32:32.864 INFO:tasks.rados.rados.0.smithi084.stdout:2981: done (4 left) 2024-03-30T12:32:32.864 INFO:tasks.rados.rados.0.smithi084.stdout:2982: read oid 37 snap -1 2024-03-30T12:32:32.864 INFO:tasks.rados.rados.0.smithi084.stdout:2982: expect deleted 2024-03-30T12:32:32.864 INFO:tasks.rados.rados.0.smithi084.stdout:2983: read oid 46 snap -1 2024-03-30T12:32:32.864 INFO:tasks.rados.rados.0.smithi084.stdout:2983: expect (ObjNum 900 snap 287 seq_num 900) 2024-03-30T12:32:32.865 INFO:tasks.rados.rados.0.smithi084.stdout:2984: read oid 40 snap -1 2024-03-30T12:32:32.865 INFO:tasks.rados.rados.0.smithi084.stdout:2984: expect deleted 2024-03-30T12:32:32.865 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 292 2024-03-30T12:32:32.865 INFO:tasks.rados.rados.0.smithi084.stdout:2985: seq_num 925 ranges {1015808=696320,1712128=401408} 2024-03-30T12:32:32.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:32.518+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:32.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:32.503+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:32.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:32.503+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:32.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:32.501+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:32.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:32.501+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:32.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:32.501+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:32.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:32.518+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 161=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:32.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:32.532+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:32.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:32.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:32.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:32.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:32.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:32.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:32.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:32 smithi162 ceph-mon[83709]: osdmap e659: 8 total, 8 up, 8 in 2024-03-30T12:32:32.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:32.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:32.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:32.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:32.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:32.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15b=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:32.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:32.874 INFO:tasks.rados.rados.0.smithi084.stdout:2985: writing smithi08477944-9 from 1015808 to 1712128 tid 1 2024-03-30T12:32:32.877 INFO:tasks.rados.rados.0.smithi084.stdout:2985: writing smithi08477944-9 from 1712128 to 2113536 tid 2 2024-03-30T12:32:32.877 INFO:tasks.rados.rados.0.smithi084.stdout:2986: delete oid 8 current snap is 292 2024-03-30T12:32:32.877 INFO:tasks.rados.rados.0.smithi084.stdout:2979: expect (ObjNum 883 snap 282 seq_num 883) 2024-03-30T12:32:32.898 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 27288 (ObjNum 881 snap 282 seq_num 881) dirty exists 2024-03-30T12:32:32.898 INFO:tasks.rados.rados.0.smithi084.stdout:2978: finishing rollback tid 0 to smithi08477944-3 2024-03-30T12:32:32.899 INFO:tasks.rados.rados.0.smithi084.stdout:2977: expect (ObjNum 901 snap 287 seq_num 901) 2024-03-30T12:32:33.005 INFO:tasks.rados.rados.0.smithi084.stdout:2978: finishing rollback tid 1 to smithi08477944-3 2024-03-30T12:32:33.005 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 27326 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-03-30T12:32:33.005 INFO:tasks.rados.rados.0.smithi084.stdout:2985: finishing write tid 1 to smithi08477944-9 2024-03-30T12:32:33.005 INFO:tasks.rados.rados.0.smithi084.stdout:2985: finishing write tid 2 to smithi08477944-9 2024-03-30T12:32:33.005 INFO:tasks.rados.rados.0.smithi084.stdout:2985: finishing write tid 3 to smithi08477944-9 2024-03-30T12:32:33.005 INFO:tasks.rados.rados.0.smithi084.stdout:2985: finishing write tid 4 to smithi08477944-9 2024-03-30T12:32:33.005 INFO:tasks.rados.rados.0.smithi084.stdout:2985: oid 9 updating version 0 to 22509 2024-03-30T12:32:33.005 INFO:tasks.rados.rados.0.smithi084.stdout:2985: oid 9 updating version 22509 to 22510 2024-03-30T12:32:33.005 INFO:tasks.rados.rados.0.smithi084.stdout:2985: oid 9 version 22510 is already newer than 22508 2024-03-30T12:32:33.005 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 22510 (ObjNum 925 snap 292 seq_num 925) dirty exists 2024-03-30T12:32:33.005 INFO:tasks.rados.rados.0.smithi084.stdout:2985: left oid 9 (ObjNum 925 snap 292 seq_num 925) 2024-03-30T12:32:33.005 INFO:tasks.rados.rados.0.smithi084.stdout:2983: expect (ObjNum 900 snap 287 seq_num 900) 2024-03-30T12:32:33.171 INFO:tasks.rados.rados.0.smithi084.stdout:2977: done (8 left) 2024-03-30T12:32:33.171 INFO:tasks.rados.rados.0.smithi084.stdout:2978: done (7 left) 2024-03-30T12:32:33.171 INFO:tasks.rados.rados.0.smithi084.stdout:2979: done (6 left) 2024-03-30T12:32:33.171 INFO:tasks.rados.rados.0.smithi084.stdout:2980: done (5 left) 2024-03-30T12:32:33.171 INFO:tasks.rados.rados.0.smithi084.stdout:2982: done (4 left) 2024-03-30T12:32:33.171 INFO:tasks.rados.rados.0.smithi084.stdout:2983: done (3 left) 2024-03-30T12:32:33.171 INFO:tasks.rados.rados.0.smithi084.stdout:2984: done (2 left) 2024-03-30T12:32:33.172 INFO:tasks.rados.rados.0.smithi084.stdout:2985: done (1 left) 2024-03-30T12:32:33.172 INFO:tasks.rados.rados.0.smithi084.stdout:2986: done (0 left) 2024-03-30T12:32:33.172 INFO:tasks.rados.rados.0.smithi084.stdout:2987: rollback oid 20 current snap is 292 2024-03-30T12:32:33.172 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 20 to 290 2024-03-30T12:32:33.172 INFO:tasks.rados.rados.0.smithi084.stdout:2988: rollback oid 26 current snap is 292 2024-03-30T12:32:33.172 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 26 to 291 2024-03-30T12:32:33.172 INFO:tasks.rados.rados.0.smithi084.stdout:2989: read oid 1 snap 290 2024-03-30T12:32:33.172 INFO:tasks.rados.rados.0.smithi084.stdout:2989: expect deleted 2024-03-30T12:32:33.172 INFO:tasks.rados.rados.0.smithi084.stdout:2990: delete oid 27 current snap is 292 2024-03-30T12:32:33.172 INFO:tasks.rados.rados.0.smithi084.stdout:2987: finishing rollback tid 1 to smithi08477944-20 2024-03-30T12:32:33.173 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 17550 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-03-30T12:32:33.176 INFO:tasks.rados.rados.0.smithi084.stdout:2987: done (3 left) 2024-03-30T12:32:33.176 INFO:tasks.rados.rados.0.smithi084.stdout:2989: done (2 left) 2024-03-30T12:32:33.176 INFO:tasks.rados.rados.0.smithi084.stdout:2990: done (1 left) 2024-03-30T12:32:33.176 INFO:tasks.rados.rados.0.smithi084.stdout:2991: copy_from oid 48 from oid 44 current snap is 292 2024-03-30T12:32:33.176 INFO:tasks.rados.rados.0.smithi084.stdout:2992: delete oid 14 current snap is 292 2024-03-30T12:32:33.184 INFO:tasks.rados.rados.0.smithi084.stdout:2992: done (2 left) 2024-03-30T12:32:33.184 INFO:tasks.rados.rados.0.smithi084.stdout:2993: snap_create 2024-03-30T12:32:33.186 INFO:tasks.rados.rados.0.smithi084.stdout:2988: finishing rollback tid 0 to smithi08477944-26 2024-03-30T12:32:33.186 INFO:tasks.rados.rados.0.smithi084.stdout:2988: finishing rollback tid 1 to smithi08477944-26 2024-03-30T12:32:33.186 INFO:tasks.rados.rados.0.smithi084.stdout:2988: finishing rollback tid 2 to smithi08477944-26 2024-03-30T12:32:33.186 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 27331 (ObjNum 824 snap 273 seq_num 824) dirty exists 2024-03-30T12:32:33.207 INFO:tasks.rados.rados.0.smithi084.stdout:2991: finishing copy_from racing read to smithi08477944-48 2024-03-30T12:32:33.212 INFO:tasks.rados.rados.0.smithi084.stdout:2991: finishing copy_from to smithi08477944-48 2024-03-30T12:32:33.212 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 23417 (ObjNum 904 snap 287 seq_num 904) dirty exists 2024-03-30T12:32:33.499 INFO:tasks.rados.rados.0.smithi084.stdout:2988: done (2 left) 2024-03-30T12:32:33.499 INFO:tasks.rados.rados.0.smithi084.stdout:2991: done (1 left) 2024-03-30T12:32:33.499 INFO:tasks.rados.rados.0.smithi084.stdout:2993: done (0 left) 2024-03-30T12:32:33.499 INFO:tasks.rados.rados.0.smithi084.stdout:2994: snap_remove snap 290 2024-03-30T12:32:33.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:33.506+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:33.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:33.506+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:33.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:33.507+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:33.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:33.507+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:33.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:33.507+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:33.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:33.507+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:33.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:33.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:33.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:33.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:33.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:33.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:33.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:33.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[91810]: osdmap e660: 8 total, 8 up, 8 in 2024-03-30T12:32:33.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:33.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:33.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:33.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 161=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:33.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:33.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:33.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[91810]: pgmap v679: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 837 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 8.3 MiB/s rd, 220 KiB/s wr, 12 op/s 2024-03-30T12:32:33.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:33.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:33.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:33.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:33.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:33.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:33.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:33.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[89279]: osdmap e660: 8 total, 8 up, 8 in 2024-03-30T12:32:33.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:33.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:33.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:33.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 161=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:33.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:33.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:33.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:33 smithi084 ceph-mon[89279]: pgmap v679: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 837 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 8.3 MiB/s rd, 220 KiB/s wr, 12 op/s 2024-03-30T12:32:33.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:33.507+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:33.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:33.507+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:33.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:33.506+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:33.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:33.509+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:33.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:33.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:33.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:33.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:33.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:33.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:33.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:33.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:33 smithi162 ceph-mon[83709]: osdmap e660: 8 total, 8 up, 8 in 2024-03-30T12:32:33.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:33.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:33.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:33.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 161=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:33.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:33.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:33.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:33 smithi162 ceph-mon[83709]: pgmap v679: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 837 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 8.3 MiB/s rd, 220 KiB/s wr, 12 op/s 2024-03-30T12:32:34.500 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:34.147+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:34.501 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:34.149+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:34.501 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:34.149+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 161=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:34.501 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:34.149+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:34.501 INFO:tasks.rados.rados.0.smithi084.stdout:2994: done (0 left) 2024-03-30T12:32:34.502 INFO:tasks.rados.rados.0.smithi084.stdout:2995: read oid 8 snap -1 2024-03-30T12:32:34.502 INFO:tasks.rados.rados.0.smithi084.stdout:2995: expect deleted 2024-03-30T12:32:34.502 INFO:tasks.rados.rados.0.smithi084.stdout:2996: copy_from oid 2 from oid 5 current snap is 293 2024-03-30T12:32:34.502 INFO:tasks.rados.rados.0.smithi084.stdout:2997: copy_from oid 15 from oid 11 current snap is 293 2024-03-30T12:32:34.502 INFO:tasks.rados.rados.0.smithi084.stdout:2998: delete oid 22 current snap is 293 2024-03-30T12:32:34.502 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:34.142+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:34.502 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:34.143+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:34.513 INFO:tasks.rados.rados.0.smithi084.stdout:2995: done (3 left) 2024-03-30T12:32:34.513 INFO:tasks.rados.rados.0.smithi084.stdout:2998: done (2 left) 2024-03-30T12:32:34.513 INFO:tasks.rados.rados.0.smithi084.stdout:2999: rollback oid 17 current snap is 293 2024-03-30T12:32:34.514 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 17 to 291 2024-03-30T12:32:34.514 INFO:tasks.rados.rados.0.smithi084.stdout:3000: rollback oid 34 current snap is 293 2024-03-30T12:32:34.514 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 34 to 291 2024-03-30T12:32:34.514 INFO:tasks.rados.rados.0.smithi084.stdout:3001: delete oid 47 current snap is 293 2024-03-30T12:32:34.515 INFO:tasks.rados.rados.0.smithi084.stdout:2999: finishing rollback tid 1 to smithi08477944-17 2024-03-30T12:32:34.516 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 27290 (ObjNum 129 snap 0 seq_num 1429627632) dirty dne 2024-03-30T12:32:34.516 INFO:tasks.rados.rados.0.smithi084.stdout:2999: done (4 left) 2024-03-30T12:32:34.516 INFO:tasks.rados.rados.0.smithi084.stdout:3001: done (3 left) 2024-03-30T12:32:34.516 INFO:tasks.rados.rados.0.smithi084.stdout:3002: copy_from oid 33 from oid 25 current snap is 293 2024-03-30T12:32:34.516 INFO:tasks.rados.rados.0.smithi084.stdout:3003: snap_create 2024-03-30T12:32:34.519 INFO:tasks.rados.rados.0.smithi084.stdout:3002: finishing copy_from to smithi08477944-33 2024-03-30T12:32:34.519 INFO:tasks.rados.rados.0.smithi084.stdout:3002: got expected ENOENT (src dne) 2024-03-30T12:32:34.519 INFO:tasks.rados.rados.0.smithi084.stdout:3002: finishing copy_from racing read to smithi08477944-33 2024-03-30T12:32:34.523 INFO:tasks.rados.rados.0.smithi084.stdout:3000: finishing rollback tid 0 to smithi08477944-34 2024-03-30T12:32:34.523 INFO:tasks.rados.rados.0.smithi084.stdout:3000: finishing rollback tid 1 to smithi08477944-34 2024-03-30T12:32:34.523 INFO:tasks.rados.rados.0.smithi084.stdout:3000: finishing rollback tid 2 to smithi08477944-34 2024-03-30T12:32:34.523 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 27231 (ObjNum 913 snap 290 seq_num 913) dirty exists 2024-03-30T12:32:34.528 INFO:tasks.rados.rados.0.smithi084.stdout:2997: finishing copy_from racing read to smithi08477944-15 2024-03-30T12:32:34.530 INFO:tasks.rados.rados.0.smithi084.stdout:2997: finishing copy_from to smithi08477944-15 2024-03-30T12:32:34.530 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 23395 (ObjNum 882 snap 282 seq_num 882) dirty exists 2024-03-30T12:32:34.537 INFO:tasks.rados.rados.0.smithi084.stdout:2996: finishing copy_from racing read to smithi08477944-2 2024-03-30T12:32:34.545 INFO:tasks.rados.rados.0.smithi084.stdout:2996: finishing copy_from to smithi08477944-2 2024-03-30T12:32:34.546 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 23394 (ObjNum 836 snap 273 seq_num 836) dirty exists 2024-03-30T12:32:34.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:34.518+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:34.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:34.518+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:34.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:34.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:34.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:34.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:34.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:34.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:34.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:34.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-mon[91810]: osdmap e661: 8 total, 8 up, 8 in 2024-03-30T12:32:34.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:34.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 161=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:34.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:34.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:34.520+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:34.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:34.520+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:34.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:34.520+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:34.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:34.520+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:34.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:34.520+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:34.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:34.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:34.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:34.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:34.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:34.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:34.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:34.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-mon[89279]: osdmap e661: 8 total, 8 up, 8 in 2024-03-30T12:32:34.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:34.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 161=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:34.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:34.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:34.526+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:34.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:34.508+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:34.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:34.509+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:34.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:34.508+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:34.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:34.508+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:34.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:34.509+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:34.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:34.516+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 161=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:34.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:34.521+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:34.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:34.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:34.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:34.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:34.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:34.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:34.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:34.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:34 smithi162 ceph-mon[83709]: osdmap e661: 8 total, 8 up, 8 in 2024-03-30T12:32:34.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:34.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 161=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:34.875 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:35.515 INFO:tasks.rados.rados.0.smithi084.stdout:2996: done (4 left) 2024-03-30T12:32:35.515 INFO:tasks.rados.rados.0.smithi084.stdout:2997: done (3 left) 2024-03-30T12:32:35.515 INFO:tasks.rados.rados.0.smithi084.stdout:3000: done (2 left) 2024-03-30T12:32:35.515 INFO:tasks.rados.rados.0.smithi084.stdout:3002: done (1 left) 2024-03-30T12:32:35.515 INFO:tasks.rados.rados.0.smithi084.stdout:3003: done (0 left) 2024-03-30T12:32:35.515 INFO:tasks.rados.rados.0.smithi084.stdout:3004: delete oid 13 current snap is 294 2024-03-30T12:32:35.522 INFO:tasks.rados.rados.0.smithi084.stdout:3004: done (0 left) 2024-03-30T12:32:35.522 INFO:tasks.rados.rados.0.smithi084.stdout:3005: delete oid 2 current snap is 294 2024-03-30T12:32:35.528 INFO:tasks.rados.rados.0.smithi084.stdout:3005: done (0 left) 2024-03-30T12:32:35.529 INFO:tasks.rados.rados.0.smithi084.stdout:3006: snap_create 2024-03-30T12:32:35.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:35.527+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:35.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:35.528+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:35.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:35.529+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:35.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:35.522+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:35.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:35.522+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:35.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:35.518+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:35.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:35.518+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 161=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:35.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:35.518+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:35.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:35.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:35.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:35.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:35.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-mon[83709]: osdmap e662: 8 total, 8 up, 8 in 2024-03-30T12:32:35.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:35.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:35.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:35.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 161=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:35.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:35.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:35.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:35.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:35.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:35.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:35.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:35.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:35.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:35 smithi162 ceph-mon[83709]: pgmap v682: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 840 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 7.2 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2024-03-30T12:32:35.906 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:35.537+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:35.906 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:35.537+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:35.906 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:35.522+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:35.906 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:35.522+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:35.906 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:35.522+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:35.907 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:35.523+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:35.907 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:35.523+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:35.907 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:35.523+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:35.907 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:35.907 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:35.907 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:35.907 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:35.907 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[89279]: osdmap e662: 8 total, 8 up, 8 in 2024-03-30T12:32:35.908 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:35.908 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:35.908 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:35.908 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 161=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:35.908 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:35.908 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:35.908 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:35.908 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:35.908 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:35.908 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:35.908 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:35.908 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:35.909 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[89279]: pgmap v682: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 840 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 7.2 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2024-03-30T12:32:35.909 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:35.909 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:35.909 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:35.909 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:35.909 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[91810]: osdmap e662: 8 total, 8 up, 8 in 2024-03-30T12:32:35.909 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:35.909 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:35.909 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:35.910 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 161=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:35.910 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:35.910 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:35.910 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:35.910 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:35.910 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:35.910 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:35.910 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:35.910 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:35.910 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:35 smithi084 ceph-mon[91810]: pgmap v682: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 840 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 7.2 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2024-03-30T12:32:36.287 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -e sha1=5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc -- bash -c 'ceph orch ps' 2024-03-30T12:32:36.494 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:32:36.516 INFO:tasks.rados.rados.0.smithi084.stdout:3006: done (0 left) 2024-03-30T12:32:36.517 INFO:tasks.rados.rados.0.smithi084.stdout:3007: read oid 49 snap -1 2024-03-30T12:32:36.517 INFO:tasks.rados.rados.0.smithi084.stdout:3007: expect deleted 2024-03-30T12:32:36.517 INFO:tasks.rados.rados.0.smithi084.stdout:3008: snap_remove snap 294 2024-03-30T12:32:36.517 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:36.525+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:36.518 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 161=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:36.518 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:36.518 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:36.518 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:36.518 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:36.518 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:36.518 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:36.518 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:36.518 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[89279]: osdmap e663: 8 total, 8 up, 8 in 2024-03-30T12:32:36.518 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:36.518 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:36.519 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:36.519 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:36.519 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:36.519 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[89279]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:32:36.519 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 161=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:36.519 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:36.519 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:36.519 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:36.519 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:36.519 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:36.520 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:36.520 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:36.520 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[91810]: osdmap e663: 8 total, 8 up, 8 in 2024-03-30T12:32:36.520 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:36.520 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:36.520 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:36.520 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:36.520 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:36.520 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-mon[91810]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:32:36.772 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:36.526+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:36.772 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:36.524+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:36.772 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:36.525+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:36.772 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:36.526+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:36.772 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:36.526+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:36.772 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:36.526+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:36.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:36.526+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:36.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:36.526+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:36.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:36.526+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:36.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 161=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:36.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:36.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:36.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:36.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:36.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:36.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:36.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:36.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:36 smithi162 ceph-mon[83709]: osdmap e663: 8 total, 8 up, 8 in 2024-03-30T12:32:36.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:36.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:36.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:36.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:36.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:36.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:36 smithi162 ceph-mon[83709]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:32:37.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:37.094+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:37.524 INFO:tasks.rados.rados.0.smithi084.stdout:3008: done (1 left) 2024-03-30T12:32:37.525 INFO:tasks.rados.rados.0.smithi084.stdout:3009: snap_remove snap 293 2024-03-30T12:32:37.810 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:37.810 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-mon[89279]: osdmap e664: 8 total, 8 up, 8 in 2024-03-30T12:32:37.810 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:37.811 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:37.811 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:37.811 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:37.811 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:37.811 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:37.811 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:37.811 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-mon[89279]: pgmap v685: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 850 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 8.7 MiB/s rd, 4.4 MiB/s wr, 31 op/s 2024-03-30T12:32:37.811 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:37.811 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-mon[91810]: osdmap e664: 8 total, 8 up, 8 in 2024-03-30T12:32:37.812 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:37.812 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:37.812 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:37.812 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:37.812 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:37.812 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:37.812 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:37.812 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-mon[91810]: pgmap v685: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 850 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 8.7 MiB/s rd, 4.4 MiB/s wr, 31 op/s 2024-03-30T12:32:37.812 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:37.531+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:37.812 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:37.531+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:37.813 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:37.531+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:37.813 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:37.531+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:37.813 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:37.532+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:37.813 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:37.532+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:37.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:37.529+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:37.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:37.474+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:37.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:37.475+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:37.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:37.549+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:37.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:37.549+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:37.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:37.644+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:37.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:37.644+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:37.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:37.644+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:37.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:37.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:37 smithi162 ceph-mon[83709]: osdmap e664: 8 total, 8 up, 8 in 2024-03-30T12:32:37.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:37.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:37.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:37.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:37.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:37.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:37.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:37.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:37 smithi162 ceph-mon[83709]: pgmap v685: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 850 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 8.7 MiB/s rd, 4.4 MiB/s wr, 31 op/s 2024-03-30T12:32:38.247 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T12:32:38.247 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.a smithi084 *:9093,9094 running (50s) 46s ago 12m 15.9M - 0.25.0 c8568f914cd2 d373ca331553 2024-03-30T12:32:38.247 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.a smithi162 *:3000 running (23s) 19s ago 12m 54.6M - 9.4.12 a0ea5e3c46d9 8cc7d12810a6 2024-03-30T12:32:38.247 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (2m) 46s ago 13m 14.1M - 19.0.0-1864-g5dc2ea30 548196a1a838 74abe81e0b10 2024-03-30T12:32:38.247 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi162 running (100s) 19s ago 13m 15.2M - 19.0.0-1864-g5dc2ea30 548196a1a838 38620aa52c54 2024-03-30T12:32:38.247 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi162 *:8443,9283,8765 running (8m) 19s ago 17m 452M - 19.0.0-1864-g5dc2ea30 548196a1a838 eec968f3fcc6 2024-03-30T12:32:38.247 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi084 *:8443,9283,8765 running (8m) 46s ago 18m 520M - 19.0.0-1864-g5dc2ea30 548196a1a838 9a2aba19dffc 2024-03-30T12:32:38.247 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (8m) 46s ago 19m 71.8M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 a0811f2ae47d 2024-03-30T12:32:38.248 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi162 running (7m) 19s ago 17m 62.4M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 149ae6649e0c 2024-03-30T12:32:38.248 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi084 running (7m) 46s ago 17m 61.5M 2048M 19.0.0-1864-g5dc2ea30 548196a1a838 f79eca93cddd 2024-03-30T12:32:38.248 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.a smithi084 *:9100 running (86s) 46s ago 12m 7675k - 1.5.0 0da6a335fe13 c19e5ff6fa83 2024-03-30T12:32:38.248 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.b smithi162 *:9100 running (82s) 19s ago 12m 7994k - 1.5.0 0da6a335fe13 fcd914fcfd78 2024-03-30T12:32:38.248 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (6m) 46s ago 16m 319M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 c91eea4f8484 2024-03-30T12:32:38.248 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (5m) 46s ago 16m 322M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 7518832f6b4a 2024-03-30T12:32:38.248 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (5m) 46s ago 16m 214M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 647dd862762d 2024-03-30T12:32:38.248 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (4m) 46s ago 15m 214M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 c088a701b71b 2024-03-30T12:32:38.248 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi162 running (4m) 19s ago 15m 321M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 4197b37d2bb8 2024-03-30T12:32:38.248 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi162 running (3m) 19s ago 14m 376M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 cd8795ac188a 2024-03-30T12:32:38.248 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi162 running (3m) 19s ago 14m 287M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 40ed6df81194 2024-03-30T12:32:38.248 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi162 running (2m) 19s ago 14m 240M 2480M 19.0.0-1864-g5dc2ea30 548196a1a838 b83812c70d9a 2024-03-30T12:32:38.248 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.a smithi162 *:9095 running (66s) 19s ago 13m 42.6M - 2.43.0 a07b618ecd1d bdbe25c7dd8b 2024-03-30T12:32:38.249 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:38.024+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:38.249 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:38.024+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:38.527 INFO:tasks.rados.rados.0.smithi084.stdout:3009: done (1 left) 2024-03-30T12:32:38.527 INFO:tasks.rados.rados.0.smithi084.stdout:3010: delete oid 14 current snap is 295 2024-03-30T12:32:38.538 INFO:tasks.rados.rados.0.smithi084.stdout:3007: done (1 left) 2024-03-30T12:32:38.538 INFO:tasks.rados.rados.0.smithi084.stdout:3010: done (0 left) 2024-03-30T12:32:38.538 INFO:tasks.rados.rados.0.smithi084.stdout:3011: rollback oid 19 current snap is 295 2024-03-30T12:32:38.538 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 19 to 292 2024-03-30T12:32:38.538 INFO:tasks.rados.rados.0.smithi084.stdout:3012: copy_from oid 18 from oid 42 current snap is 295 2024-03-30T12:32:38.538 INFO:tasks.rados.rados.0.smithi084.stdout:3013: read oid 30 snap 291 2024-03-30T12:32:38.538 INFO:tasks.rados.rados.0.smithi084.stdout:3013: expect deleted 2024-03-30T12:32:38.538 INFO:tasks.rados.rados.0.smithi084.stdout:3014: read oid 10 snap -1 2024-03-30T12:32:38.538 INFO:tasks.rados.rados.0.smithi084.stdout:3014: expect (ObjNum 923 snap 292 seq_num 923) 2024-03-30T12:32:38.538 INFO:tasks.rados.rados.0.smithi084.stdout:3015: delete oid 21 current snap is 295 2024-03-30T12:32:38.545 INFO:tasks.rados.rados.0.smithi084.stdout:3014: expect (ObjNum 923 snap 292 seq_num 923) 2024-03-30T12:32:38.576 INFO:tasks.rados.rados.0.smithi084.stdout:3012: finishing copy_from racing read to smithi08477944-18 2024-03-30T12:32:38.576 INFO:tasks.rados.rados.0.smithi084.stdout:3013: done (4 left) 2024-03-30T12:32:38.576 INFO:tasks.rados.rados.0.smithi084.stdout:3014: done (3 left) 2024-03-30T12:32:38.576 INFO:tasks.rados.rados.0.smithi084.stdout:3015: done (2 left) 2024-03-30T12:32:38.576 INFO:tasks.rados.rados.0.smithi084.stdout:3016: rmattr oid 10 current snap is 295 2024-03-30T12:32:38.576 INFO:tasks.rados.rados.0.smithi084.stdout:3016: done (2 left) 2024-03-30T12:32:38.576 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 295 2024-03-30T12:32:38.576 INFO:tasks.rados.rados.0.smithi084.stdout:3012: finishing copy_from to smithi08477944-18 2024-03-30T12:32:38.576 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 27283 (ObjNum 825 snap 273 seq_num 825) dirty exists 2024-03-30T12:32:38.576 INFO:tasks.rados.rados.0.smithi084.stdout:3011: finishing rollback tid 0 to smithi08477944-19 2024-03-30T12:32:38.577 INFO:tasks.rados.rados.0.smithi084.stdout:3011: finishing rollback tid 1 to smithi08477944-19 2024-03-30T12:32:38.577 INFO:tasks.rados.rados.0.smithi084.stdout:3017: seq_num 935 ranges {3571712=466944,4038656=720896,4759552=81920} 2024-03-30T12:32:38.597 INFO:tasks.rados.rados.0.smithi084.stdout:3017: writing smithi08477944-39 from 3571712 to 4038656 tid 1 2024-03-30T12:32:38.602 INFO:tasks.rados.rados.0.smithi084.stdout:3017: writing smithi08477944-39 from 4038656 to 4759552 tid 2 2024-03-30T12:32:38.603 INFO:tasks.rados.rados.0.smithi084.stdout:3017: writing smithi08477944-39 from 4759552 to 4841472 tid 3 2024-03-30T12:32:38.603 INFO:tasks.rados.rados.0.smithi084.stdout:3012: done (2 left) 2024-03-30T12:32:38.603 INFO:tasks.rados.rados.0.smithi084.stdout:3018: rollback oid 3 current snap is 295 2024-03-30T12:32:38.603 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 3 to 291 2024-03-30T12:32:38.603 INFO:tasks.rados.rados.0.smithi084.stdout:3011: finishing rollback tid 2 to smithi08477944-19 2024-03-30T12:32:38.603 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 36301 (ObjNum 912 snap 290 seq_num 912) dirty exists 2024-03-30T12:32:38.603 INFO:tasks.rados.rados.0.smithi084.stdout:3017: finishing write tid 1 to smithi08477944-39 2024-03-30T12:32:38.603 INFO:tasks.rados.rados.0.smithi084.stdout:3011: done (2 left) 2024-03-30T12:32:38.604 INFO:tasks.rados.rados.0.smithi084.stdout:3019: rmattr oid 6 current snap is 295 2024-03-30T12:32:38.604 INFO:tasks.rados.rados.0.smithi084.stdout:3019: done (2 left) 2024-03-30T12:32:38.604 INFO:tasks.rados.rados.0.smithi084.stdout:3020: read oid 17 snap -1 2024-03-30T12:32:38.604 INFO:tasks.rados.rados.0.smithi084.stdout:3020: expect deleted 2024-03-30T12:32:38.604 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 295 2024-03-30T12:32:38.604 INFO:tasks.rados.rados.0.smithi084.stdout:3021: seq_num 936 ranges {6758400=483328,7241728=655360,7897088=147456} 2024-03-30T12:32:38.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:38.543+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:38.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:38.537+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:38.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:38.537+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:38.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:38.536+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:38.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:38.537+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:38.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:38.332+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:38.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:38.332+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:38.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:38.555+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:38.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:38.555+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:38.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:38.567+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:38.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:38.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:38.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:38.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:38.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:38.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:38.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:38.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:38.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:38 smithi162 ceph-mon[83709]: osdmap e665: 8 total, 8 up, 8 in 2024-03-30T12:32:38.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:38.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:38.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:38.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:38.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:38.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:38.642 INFO:tasks.rados.rados.0.smithi084.stdout:3021: writing smithi08477944-48 from 6758400 to 7241728 tid 1 2024-03-30T12:32:38.646 INFO:tasks.rados.rados.0.smithi084.stdout:3021: writing smithi08477944-48 from 7241728 to 7897088 tid 2 2024-03-30T12:32:38.647 INFO:tasks.rados.rados.0.smithi084.stdout:3021: writing smithi08477944-48 from 7897088 to 8044544 tid 3 2024-03-30T12:32:38.647 INFO:tasks.rados.rados.0.smithi084.stdout:3022: snap_create 2024-03-30T12:32:38.647 INFO:tasks.rados.rados.0.smithi084.stdout:3017: finishing write tid 2 to smithi08477944-39 2024-03-30T12:32:38.647 INFO:tasks.rados.rados.0.smithi084.stdout:3017: finishing write tid 3 to smithi08477944-39 2024-03-30T12:32:38.647 INFO:tasks.rados.rados.0.smithi084.stdout:3017: finishing write tid 4 to smithi08477944-39 2024-03-30T12:32:38.647 INFO:tasks.rados.rados.0.smithi084.stdout:3017: finishing write tid 5 to smithi08477944-39 2024-03-30T12:32:38.647 INFO:tasks.rados.rados.0.smithi084.stdout:3017: oid 39 updating version 0 to 27291 2024-03-30T12:32:38.647 INFO:tasks.rados.rados.0.smithi084.stdout:3017: oid 39 updating version 27291 to 27294 2024-03-30T12:32:38.648 INFO:tasks.rados.rados.0.smithi084.stdout:3017: oid 39 version 27294 is already newer than 27292 2024-03-30T12:32:38.648 INFO:tasks.rados.rados.0.smithi084.stdout:3017: oid 39 version 27294 is already newer than 27293 2024-03-30T12:32:38.648 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 27294 (ObjNum 935 snap 295 seq_num 935) dirty exists 2024-03-30T12:32:38.648 INFO:tasks.rados.rados.0.smithi084.stdout:3017: left oid 39 (ObjNum 935 snap 295 seq_num 935) 2024-03-30T12:32:38.648 INFO:tasks.rados.rados.0.smithi084.stdout:3018: finishing rollback tid 1 to smithi08477944-3 2024-03-30T12:32:38.648 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 27326 (ObjNum 33 snap 0 seq_num 1429505312) dirty dne 2024-03-30T12:32:38.648 INFO:tasks.rados.rados.0.smithi084.stdout:3021: finishing write tid 1 to smithi08477944-48 2024-03-30T12:32:38.650 INFO:tasks.rados.rados.0.smithi084.stdout:3021: finishing write tid 2 to smithi08477944-48 2024-03-30T12:32:38.651 INFO:tasks.rados.rados.0.smithi084.stdout:3021: finishing write tid 3 to smithi08477944-48 2024-03-30T12:32:38.651 INFO:tasks.rados.rados.0.smithi084.stdout:3021: finishing write tid 4 to smithi08477944-48 2024-03-30T12:32:38.653 INFO:tasks.rados.rados.0.smithi084.stdout:3021: finishing write tid 5 to smithi08477944-48 2024-03-30T12:32:38.653 INFO:tasks.rados.rados.0.smithi084.stdout:3021: oid 48 updating version 0 to 23421 2024-03-30T12:32:38.653 INFO:tasks.rados.rados.0.smithi084.stdout:3021: oid 48 version 23421 is already newer than 23420 2024-03-30T12:32:38.653 INFO:tasks.rados.rados.0.smithi084.stdout:3021: oid 48 version 23421 is already newer than 23419 2024-03-30T12:32:38.653 INFO:tasks.rados.rados.0.smithi084.stdout:3021: oid 48 version 23421 is already newer than 23418 2024-03-30T12:32:38.654 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 23421 (ObjNum 936 snap 295 seq_num 936) dirty exists 2024-03-30T12:32:38.654 INFO:tasks.rados.rados.0.smithi084.stdout:3021: left oid 48 (ObjNum 936 snap 295 seq_num 936) 2024-03-30T12:32:38.988 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:38.545+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:38.989 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:38.545+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:38.989 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:38.534+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:38.989 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:38.535+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:38.989 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:38.535+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:38.989 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:38.535+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:38.989 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:38.535+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:38.990 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:38.990 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:38.990 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:38.990 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:38.990 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:38.990 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:38.990 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:38.990 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:38.990 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[91810]: osdmap e665: 8 total, 8 up, 8 in 2024-03-30T12:32:38.990 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:38.990 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:38.990 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:38.991 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:38.991 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:38.991 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:38.991 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:38.991 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:38.991 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:38.991 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:38.991 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:38.991 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:38.991 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:38.991 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:38.991 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[89279]: osdmap e665: 8 total, 8 up, 8 in 2024-03-30T12:32:38.992 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:38.992 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:38.992 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:38.992 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:38.992 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15d=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:38.992 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:39.010 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -e sha1=5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc -- bash -c 'ceph versions' 2024-03-30T12:32:39.222 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:32:39.533 INFO:tasks.rados.rados.0.smithi084.stdout:3017: done (4 left) 2024-03-30T12:32:39.534 INFO:tasks.rados.rados.0.smithi084.stdout:3018: done (3 left) 2024-03-30T12:32:39.534 INFO:tasks.rados.rados.0.smithi084.stdout:3020: done (2 left) 2024-03-30T12:32:39.534 INFO:tasks.rados.rados.0.smithi084.stdout:3021: done (1 left) 2024-03-30T12:32:39.534 INFO:tasks.rados.rados.0.smithi084.stdout:3022: done (0 left) 2024-03-30T12:32:39.534 INFO:tasks.rados.rados.0.smithi084.stdout:3023: snap_create 2024-03-30T12:32:39.633 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:32:39] "GET /metrics HTTP/1.1" 200 36331 "" "Prometheus/2.43.0" 2024-03-30T12:32:39.633 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:39.539+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:39.633 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:39.539+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:39.633 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:39.540+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:39.634 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:39.540+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:39.634 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:39.540+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:39.634 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:39.540+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:39.634 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:39.634 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:39.634 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[91810]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:32:39.634 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:39.634 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:39.634 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:39.634 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:39.635 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[91810]: osdmap e666: 8 total, 8 up, 8 in 2024-03-30T12:32:39.635 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:39.635 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:39.635 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:39.635 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:39.635 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:39.635 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:39.635 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:39.635 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:39.635 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:39.635 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[91810]: pgmap v688: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 857 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 4.5 MiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-03-30T12:32:39.635 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:39.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:39.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[89279]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:32:39.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:39.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:39.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:39.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:39.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[89279]: osdmap e666: 8 total, 8 up, 8 in 2024-03-30T12:32:39.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:39.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:39.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:39.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:39.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:39.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:39.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:39.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:39.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:39.637 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:39 smithi084 ceph-mon[89279]: pgmap v688: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 857 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 4.5 MiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-03-30T12:32:39.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:39.544+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:39.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:39.544+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:39.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:39.541+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:39.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:39.541+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:39.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:39.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:39.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:39 smithi162 ceph-mon[83709]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T12:32:39.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:39.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:39.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:39.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:39.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:39 smithi162 ceph-mon[83709]: osdmap e666: 8 total, 8 up, 8 in 2024-03-30T12:32:39.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:39.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:39.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:39.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:39.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:39.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:39.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:39.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:39.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:39.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:39 smithi162 ceph-mon[83709]: pgmap v688: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 857 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 4.5 MiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-03-30T12:32:40.386 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:40.042+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:40.386 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:40.042+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:40.530 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:40.145+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:40.531 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:40.145+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:40.531 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:40.145+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:40.531 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:40.145+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:40.552 INFO:tasks.rados.rados.0.smithi084.stdout:3023: done (0 left) 2024-03-30T12:32:40.552 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 297 2024-03-30T12:32:40.552 INFO:tasks.rados.rados.0.smithi084.stdout:3024: seq_num 937 ranges {0=499712,499712=532480,1032192=270336} 2024-03-30T12:32:40.554 INFO:tasks.rados.rados.0.smithi084.stdout:3024: writing smithi08477944-32 from 0 to 499712 tid 1 2024-03-30T12:32:40.558 INFO:tasks.rados.rados.0.smithi084.stdout:3024: writing smithi08477944-32 from 499712 to 1032192 tid 2 2024-03-30T12:32:40.560 INFO:tasks.rados.rados.0.smithi084.stdout:3024: writing smithi08477944-32 from 1032192 to 1302528 tid 3 2024-03-30T12:32:40.561 INFO:tasks.rados.rados.0.smithi084.stdout:3025: read oid 50 snap 295 2024-03-30T12:32:40.561 INFO:tasks.rados.rados.0.smithi084.stdout:3025: expect (ObjNum 921 snap 291 seq_num 921) 2024-03-30T12:32:40.561 INFO:tasks.rados.rados.0.smithi084.stdout:3026: copy_from oid 45 from oid 16 current snap is 297 2024-03-30T12:32:40.561 INFO:tasks.rados.rados.0.smithi084.stdout:3027: snap_create 2024-03-30T12:32:40.561 INFO:tasks.rados.rados.0.smithi084.stdout:3024: finishing write tid 1 to smithi08477944-32 2024-03-30T12:32:40.562 INFO:tasks.rados.rados.0.smithi084.stdout:3024: finishing write tid 2 to smithi08477944-32 2024-03-30T12:32:40.564 INFO:tasks.rados.rados.0.smithi084.stdout:3024: finishing write tid 3 to smithi08477944-32 2024-03-30T12:32:40.564 INFO:tasks.rados.rados.0.smithi084.stdout:3024: finishing write tid 4 to smithi08477944-32 2024-03-30T12:32:40.565 INFO:tasks.rados.rados.0.smithi084.stdout:3024: finishing write tid 5 to smithi08477944-32 2024-03-30T12:32:40.565 INFO:tasks.rados.rados.0.smithi084.stdout:3024: oid 32 updating version 0 to 36270 2024-03-30T12:32:40.566 INFO:tasks.rados.rados.0.smithi084.stdout:3024: oid 32 updating version 36270 to 36273 2024-03-30T12:32:40.566 INFO:tasks.rados.rados.0.smithi084.stdout:3024: oid 32 version 36273 is already newer than 36272 2024-03-30T12:32:40.566 INFO:tasks.rados.rados.0.smithi084.stdout:3024: oid 32 version 36273 is already newer than 36271 2024-03-30T12:32:40.566 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 36273 (ObjNum 937 snap 297 seq_num 937) dirty exists 2024-03-30T12:32:40.566 INFO:tasks.rados.rados.0.smithi084.stdout:3024: left oid 32 (ObjNum 937 snap 297 seq_num 937) 2024-03-30T12:32:40.588 INFO:tasks.rados.rados.0.smithi084.stdout:3025: expect (ObjNum 921 snap 291 seq_num 921) 2024-03-30T12:32:40.698 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:40.698 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:40.698 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:40.698 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:40.698 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:40.698 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:40.699 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-mon[91810]: osdmap e667: 8 total, 8 up, 8 in 2024-03-30T12:32:40.699 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:40.699 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:40.699 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:40.699 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:40.699 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:40.567+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:40.699 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:40.568+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:40.699 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:40.560+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:40.700 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:40.561+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:40.700 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:40.561+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:40.700 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:40.561+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:40.700 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:40.561+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:40.700 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:40.700 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:40.700 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:40.700 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:40.700 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:40.700 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:40.700 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-mon[89279]: osdmap e667: 8 total, 8 up, 8 in 2024-03-30T12:32:40.700 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:40.700 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:40.701 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:40.701 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:40.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:40.601+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:40.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:40.602+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:40.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:40.561+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:40.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:40.561+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:40.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:40.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:40.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:40.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:40.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:40.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:40.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:40 smithi162 ceph-mon[83709]: osdmap e667: 8 total, 8 up, 8 in 2024-03-30T12:32:40.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:40.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:40.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:40.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:40.872 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:40.554+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:40.872 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:40.554+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:40.872 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:40.554+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:41.083 INFO:tasks.rados.rados.0.smithi084.stdout:3026: finishing copy_from racing read to smithi08477944-45 2024-03-30T12:32:41.083 INFO:tasks.rados.rados.0.smithi084.stdout:3026: finishing copy_from to smithi08477944-45 2024-03-30T12:32:41.083 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 23424 (ObjNum 909 snap 288 seq_num 909) dirty exists 2024-03-30T12:32:41.229 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-03-30T12:32:41.230 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-03-30T12:32:41.230 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 3 2024-03-30T12:32:41.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:32:41.230 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-03-30T12:32:41.230 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 2 2024-03-30T12:32:41.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:32:41.230 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-03-30T12:32:41.230 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 8 2024-03-30T12:32:41.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:32:41.230 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-03-30T12:32:41.230 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 2 2024-03-30T12:32:41.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-03-30T12:32:41.231 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-03-30T12:32:41.231 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)": 15 2024-03-30T12:32:41.231 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-03-30T12:32:41.231 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-03-30T12:32:41.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:40.958+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:41.553 INFO:tasks.rados.rados.0.smithi084.stdout:3024: done (3 left) 2024-03-30T12:32:41.553 INFO:tasks.rados.rados.0.smithi084.stdout:3025: done (2 left) 2024-03-30T12:32:41.553 INFO:tasks.rados.rados.0.smithi084.stdout:3026: done (1 left) 2024-03-30T12:32:41.553 INFO:tasks.rados.rados.0.smithi084.stdout:3027: done (0 left) 2024-03-30T12:32:41.553 INFO:tasks.rados.rados.0.smithi084.stdout:3028: read oid 34 snap -1 2024-03-30T12:32:41.553 INFO:tasks.rados.rados.0.smithi084.stdout:3028: expect (ObjNum 913 snap 290 seq_num 913) 2024-03-30T12:32:41.553 INFO:tasks.rados.rados.0.smithi084.stdout:3029: copy_from oid 11 from oid 38 current snap is 298 2024-03-30T12:32:41.553 INFO:tasks.rados.rados.0.smithi084.stdout:3030: snap_create 2024-03-30T12:32:41.564 INFO:tasks.rados.rados.0.smithi084.stdout:3029: finishing copy_from racing read to smithi08477944-11 2024-03-30T12:32:41.564 INFO:tasks.rados.rados.0.smithi084.stdout:3029: finishing copy_from to smithi08477944-11 2024-03-30T12:32:41.564 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 27282 (ObjNum 919 snap 290 seq_num 919) dirty exists 2024-03-30T12:32:41.579 INFO:tasks.rados.rados.0.smithi084.stdout:3028: expect (ObjNum 913 snap 290 seq_num 913) 2024-03-30T12:32:41.835 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:41.559+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:41.835 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:41.560+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:41.835 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:41.560+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:41.835 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:41.560+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:41.835 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:41.560+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:41.835 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:41.560+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:41.835 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:41.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:41.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:41.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:41.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:41.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:41.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:41.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:41.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[91810]: osdmap e668: 8 total, 8 up, 8 in 2024-03-30T12:32:41.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:41.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:41.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:41.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:41.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:41.836 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:41.837 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:41.837 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[91810]: pgmap v691: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 857 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 2.5 MiB/s rd, 1.6 MiB/s wr, 4 op/s 2024-03-30T12:32:41.837 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/4215149095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:41.837 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:41.837 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:41.837 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:41.837 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:41.837 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:41.837 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:41.837 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:41.837 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:41.837 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[89279]: osdmap e668: 8 total, 8 up, 8 in 2024-03-30T12:32:41.838 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:41.838 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:41.838 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:41.838 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:41.838 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:41.838 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:41.838 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:41.838 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[89279]: pgmap v691: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 857 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 2.5 MiB/s rd, 1.6 MiB/s wr, 4 op/s 2024-03-30T12:32:41.838 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/4215149095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:41.855 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -e sha1=5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-03-30T12:32:41.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:41.563+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:41.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:41.567+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:41.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:41.568+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:41.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:41.573+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:41.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:41.573+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:41.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:41.573+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:41.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:41.562+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:41.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:41.569+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:41.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:41.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:41.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:41.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:41.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:41.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:41.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:41.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:41.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-mon[83709]: osdmap e668: 8 total, 8 up, 8 in 2024-03-30T12:32:41.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:41.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:41.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:41.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:41.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:41.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:41.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:41.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-mon[83709]: pgmap v691: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 857 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 2.5 MiB/s rd, 1.6 MiB/s wr, 4 op/s 2024-03-30T12:32:41.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:41 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/4215149095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:42.063 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:32:42.184 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:41.959+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:42.184 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:41.960+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:42.554 INFO:tasks.rados.rados.0.smithi084.stdout:3028: done (2 left) 2024-03-30T12:32:42.554 INFO:tasks.rados.rados.0.smithi084.stdout:3029: done (1 left) 2024-03-30T12:32:42.554 INFO:tasks.rados.rados.0.smithi084.stdout:3030: done (0 left) 2024-03-30T12:32:42.554 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 299 2024-03-30T12:32:42.554 INFO:tasks.rados.rados.0.smithi084.stdout:3031: seq_num 938 ranges {8765440=516096,9281536=417792,9699328=385024} 2024-03-30T12:32:42.604 INFO:tasks.rados.rados.0.smithi084.stdout:3031: writing smithi08477944-26 from 8765440 to 9281536 tid 1 2024-03-30T12:32:42.606 INFO:tasks.rados.rados.0.smithi084.stdout:3031: writing smithi08477944-26 from 9281536 to 9699328 tid 2 2024-03-30T12:32:42.608 INFO:tasks.rados.rados.0.smithi084.stdout:3031: writing smithi08477944-26 from 9699328 to 10084352 tid 3 2024-03-30T12:32:42.608 INFO:tasks.rados.rados.0.smithi084.stdout:3032: rollback oid 10 current snap is 299 2024-03-30T12:32:42.608 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 10 to 296 2024-03-30T12:32:42.608 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 299 2024-03-30T12:32:42.609 INFO:tasks.rados.rados.0.smithi084.stdout:3033: seq_num 939 ranges {0=532480,532480=704512,1236992=98304} 2024-03-30T12:32:42.612 INFO:tasks.rados.rados.0.smithi084.stdout:3033: writing smithi08477944-49 from 0 to 532480 tid 1 2024-03-30T12:32:42.616 INFO:tasks.rados.rados.0.smithi084.stdout:3033: writing smithi08477944-49 from 532480 to 1236992 tid 2 2024-03-30T12:32:42.617 INFO:tasks.rados.rados.0.smithi084.stdout:3033: writing smithi08477944-49 from 1236992 to 1335296 tid 3 2024-03-30T12:32:42.618 INFO:tasks.rados.rados.0.smithi084.stdout:3034: read oid 25 snap -1 2024-03-30T12:32:42.618 INFO:tasks.rados.rados.0.smithi084.stdout:3034: expect deleted 2024-03-30T12:32:42.618 INFO:tasks.rados.rados.0.smithi084.stdout:3033: finishing write tid 1 to smithi08477944-49 2024-03-30T12:32:42.618 INFO:tasks.rados.rados.0.smithi084.stdout:3035: read oid 24 snap -1 2024-03-30T12:32:42.619 INFO:tasks.rados.rados.0.smithi084.stdout:3035: expect deleted 2024-03-30T12:32:42.619 INFO:tasks.rados.rados.0.smithi084.stdout:3036: snap_create 2024-03-30T12:32:42.620 INFO:tasks.rados.rados.0.smithi084.stdout:3033: finishing write tid 2 to smithi08477944-49 2024-03-30T12:32:42.621 INFO:tasks.rados.rados.0.smithi084.stdout:3033: finishing write tid 3 to smithi08477944-49 2024-03-30T12:32:42.621 INFO:tasks.rados.rados.0.smithi084.stdout:3033: finishing write tid 4 to smithi08477944-49 2024-03-30T12:32:42.624 INFO:tasks.rados.rados.0.smithi084.stdout:3033: finishing write tid 5 to smithi08477944-49 2024-03-30T12:32:42.624 INFO:tasks.rados.rados.0.smithi084.stdout:3033: oid 49 updating version 0 to 36275 2024-03-30T12:32:42.750 INFO:tasks.rados.rados.0.smithi084.stdout:3033: oid 49 updating version 36275 to 36276 2024-03-30T12:32:42.750 INFO:tasks.rados.rados.0.smithi084.stdout:3033: oid 49 updating version 36276 to 36277 2024-03-30T12:32:42.751 INFO:tasks.rados.rados.0.smithi084.stdout:3033: oid 49 version 36277 is already newer than 36274 2024-03-30T12:32:42.751 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 36277 (ObjNum 939 snap 299 seq_num 939) dirty exists 2024-03-30T12:32:42.751 INFO:tasks.rados.rados.0.smithi084.stdout:3033: left oid 49 (ObjNum 939 snap 299 seq_num 939) 2024-03-30T12:32:42.752 INFO:tasks.rados.rados.0.smithi084.stdout:3031: finishing write tid 1 to smithi08477944-26 2024-03-30T12:32:42.752 INFO:tasks.rados.rados.0.smithi084.stdout:3031: finishing write tid 2 to smithi08477944-26 2024-03-30T12:32:42.752 INFO:tasks.rados.rados.0.smithi084.stdout:3032: finishing rollback tid 0 to smithi08477944-10 2024-03-30T12:32:42.752 INFO:tasks.rados.rados.0.smithi084.stdout:3032: finishing rollback tid 1 to smithi08477944-10 2024-03-30T12:32:42.752 INFO:tasks.rados.rados.0.smithi084.stdout:3032: finishing rollback tid 2 to smithi08477944-10 2024-03-30T12:32:42.752 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 36275 (ObjNum 923 snap 292 seq_num 923) dirty exists 2024-03-30T12:32:42.753 INFO:tasks.rados.rados.0.smithi084.stdout:3031: finishing write tid 3 to smithi08477944-26 2024-03-30T12:32:42.753 INFO:tasks.rados.rados.0.smithi084.stdout:3031: finishing write tid 4 to smithi08477944-26 2024-03-30T12:32:42.753 INFO:tasks.rados.rados.0.smithi084.stdout:3031: finishing write tid 5 to smithi08477944-26 2024-03-30T12:32:42.753 INFO:tasks.rados.rados.0.smithi084.stdout:3031: oid 26 updating version 0 to 27342 2024-03-30T12:32:42.753 INFO:tasks.rados.rados.0.smithi084.stdout:3031: oid 26 updating version 27342 to 27343 2024-03-30T12:32:42.753 INFO:tasks.rados.rados.0.smithi084.stdout:3031: oid 26 version 27343 is already newer than 27340 2024-03-30T12:32:42.753 INFO:tasks.rados.rados.0.smithi084.stdout:3031: oid 26 version 27343 is already newer than 27341 2024-03-30T12:32:42.753 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 27343 (ObjNum 938 snap 299 seq_num 938) dirty exists 2024-03-30T12:32:42.753 INFO:tasks.rados.rados.0.smithi084.stdout:3031: left oid 26 (ObjNum 938 snap 299 seq_num 938) 2024-03-30T12:32:42.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:42.620+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:42.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:42.621+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:42.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:42.561+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:42.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:42.562+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:42.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:42.562+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:42.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:42.562+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:42.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:42.562+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:42.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:42.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:42.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:42.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:42.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:42.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[89279]: osdmap e669: 8 total, 8 up, 8 in 2024-03-30T12:32:42.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:42.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:42.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:42.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:42.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:42.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:42.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:42.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:42.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:42.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:42.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:42.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:42.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[91810]: osdmap e669: 8 total, 8 up, 8 in 2024-03-30T12:32:42.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:42.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:42.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:42.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:42.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:42.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:42.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:42.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:42.634+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:42.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:42.641+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:42.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:42.643+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:42.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:42.629+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:42.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:42.630+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:42.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:42.561+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:42.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:42.561+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:42.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:42.561+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:42.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:42.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:42.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:42.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:42.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:42.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:42 smithi162 ceph-mon[83709]: osdmap e669: 8 total, 8 up, 8 in 2024-03-30T12:32:42.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:42.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:42.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:42.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:42.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:42.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:42.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:43.565 INFO:tasks.rados.rados.0.smithi084.stdout:3031: done (5 left) 2024-03-30T12:32:43.565 INFO:tasks.rados.rados.0.smithi084.stdout:3032: done (4 left) 2024-03-30T12:32:43.565 INFO:tasks.rados.rados.0.smithi084.stdout:3033: done (3 left) 2024-03-30T12:32:43.565 INFO:tasks.rados.rados.0.smithi084.stdout:3034: done (2 left) 2024-03-30T12:32:43.565 INFO:tasks.rados.rados.0.smithi084.stdout:3035: done (1 left) 2024-03-30T12:32:43.565 INFO:tasks.rados.rados.0.smithi084.stdout:3036: done (0 left) 2024-03-30T12:32:43.565 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 300 2024-03-30T12:32:43.565 INFO:tasks.rados.rados.0.smithi084.stdout:3037: seq_num 940 ranges {0=548864,548864=589824,1138688=212992} 2024-03-30T12:32:43.568 INFO:tasks.rados.rados.0.smithi084.stdout:3037: writing smithi08477944-13 from 0 to 548864 tid 1 2024-03-30T12:32:43.571 INFO:tasks.rados.rados.0.smithi084.stdout:3037: writing smithi08477944-13 from 548864 to 1138688 tid 2 2024-03-30T12:32:43.572 INFO:tasks.rados.rados.0.smithi084.stdout:3037: writing smithi08477944-13 from 1138688 to 1351680 tid 3 2024-03-30T12:32:43.572 INFO:tasks.rados.rados.0.smithi084.stdout:3038: read oid 26 snap -1 2024-03-30T12:32:43.572 INFO:tasks.rados.rados.0.smithi084.stdout:3038: expect (ObjNum 938 snap 299 seq_num 938) 2024-03-30T12:32:43.572 INFO:tasks.rados.rados.0.smithi084.stdout:3039: delete oid 38 current snap is 300 2024-03-30T12:32:43.574 INFO:tasks.rados.rados.0.smithi084.stdout:3039: done (2 left) 2024-03-30T12:32:43.575 INFO:tasks.rados.rados.0.smithi084.stdout:3040: rollback oid 33 current snap is 300 2024-03-30T12:32:43.575 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 33 to 296 2024-03-30T12:32:43.575 INFO:tasks.rados.rados.0.smithi084.stdout:3041: rmattr oid 5 current snap is 300 2024-03-30T12:32:43.575 INFO:tasks.rados.rados.0.smithi084.stdout:3042: rollback oid 41 current snap is 300 2024-03-30T12:32:43.575 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 41 to 292 2024-03-30T12:32:43.575 INFO:tasks.rados.rados.0.smithi084.stdout:3043: delete oid 49 current snap is 300 2024-03-30T12:32:43.576 INFO:tasks.rados.rados.0.smithi084.stdout:3037: finishing write tid 1 to smithi08477944-13 2024-03-30T12:32:43.579 INFO:tasks.rados.rados.0.smithi084.stdout:3040: finishing rollback tid 0 to smithi08477944-33 2024-03-30T12:32:43.580 INFO:tasks.rados.rados.0.smithi084.stdout:3042: finishing rollback tid 0 to smithi08477944-41 2024-03-30T12:32:43.581 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 27283 (ObjNum 836 snap 273 seq_num 836) dirty exists 2024-03-30T12:32:43.581 INFO:tasks.rados.rados.0.smithi084.stdout:3040: finishing rollback tid 1 to smithi08477944-33 2024-03-30T12:32:43.581 INFO:tasks.rados.rados.0.smithi084.stdout:3042: finishing rollback tid 1 to smithi08477944-41 2024-03-30T12:32:43.581 INFO:tasks.rados.rados.0.smithi084.stdout:3040: finishing rollback tid 2 to smithi08477944-33 2024-03-30T12:32:43.581 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 27292 (ObjNum 905 snap 287 seq_num 905) dirty exists 2024-03-30T12:32:43.582 INFO:tasks.rados.rados.0.smithi084.stdout:3042: finishing rollback tid 2 to smithi08477944-41 2024-03-30T12:32:43.582 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 27286 (ObjNum 836 snap 273 seq_num 836) dirty exists 2024-03-30T12:32:43.583 INFO:tasks.rados.rados.0.smithi084.stdout:3040: done (5 left) 2024-03-30T12:32:43.583 INFO:tasks.rados.rados.0.smithi084.stdout:3041: done (4 left) 2024-03-30T12:32:43.583 INFO:tasks.rados.rados.0.smithi084.stdout:3042: done (3 left) 2024-03-30T12:32:43.583 INFO:tasks.rados.rados.0.smithi084.stdout:3043: done (2 left) 2024-03-30T12:32:43.583 INFO:tasks.rados.rados.0.smithi084.stdout:3044: delete oid 11 current snap is 300 2024-03-30T12:32:43.586 INFO:tasks.rados.rados.0.smithi084.stdout:3044: done (2 left) 2024-03-30T12:32:43.586 INFO:tasks.rados.rados.0.smithi084.stdout:3045: snap_remove snap 291 2024-03-30T12:32:43.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:43.588+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:43.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:43.592+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:43.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:43.571+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:43.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:43.571+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:43.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:43.571+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:43.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:43.571+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:43.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:43.571+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:43.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:43.572+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:43.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[89279]: osdmap e670: 8 total, 8 up, 8 in 2024-03-30T12:32:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:43.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:43.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:43.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[89279]: pgmap v694: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 861 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 781 KiB/s rd, 942 KiB/s wr, 6 op/s 2024-03-30T12:32:43.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:43.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:43.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:43.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:43.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:43.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[91810]: osdmap e670: 8 total, 8 up, 8 in 2024-03-30T12:32:43.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:43.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:43.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:43.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:43.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:43.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:43.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:43.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:43.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:43.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:43.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:43 smithi084 ceph-mon[91810]: pgmap v694: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 861 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 781 KiB/s rd, 942 KiB/s wr, 6 op/s 2024-03-30T12:32:43.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:43.584+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:43.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:43.571+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:43.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:43.572+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:43.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:43.572+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:43.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:43.572+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:43.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:43.585+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:43.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:43.585+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:43.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:43.589+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:43.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:43.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:43.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:43.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:43.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:43.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:43 smithi162 ceph-mon[83709]: osdmap e670: 8 total, 8 up, 8 in 2024-03-30T12:32:43.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:43.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:43.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:43.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:43.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:43.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:43.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:43.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:43.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 164=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:43.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:43.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:43 smithi162 ceph-mon[83709]: pgmap v694: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 861 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 781 KiB/s rd, 942 KiB/s wr, 6 op/s 2024-03-30T12:32:43.984 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-03-30T12:32:44.572 INFO:tasks.rados.rados.0.smithi084.stdout:3045: done (2 left) 2024-03-30T12:32:44.572 INFO:tasks.rados.rados.0.smithi084.stdout:3046: delete oid 2 current snap is 300 2024-03-30T12:32:44.572 INFO:tasks.rados.rados.0.smithi084.stdout:3037: finishing write tid 2 to smithi08477944-13 2024-03-30T12:32:44.572 INFO:tasks.rados.rados.0.smithi084.stdout:3037: finishing write tid 3 to smithi08477944-13 2024-03-30T12:32:44.572 INFO:tasks.rados.rados.0.smithi084.stdout:3037: finishing write tid 4 to smithi08477944-13 2024-03-30T12:32:44.572 INFO:tasks.rados.rados.0.smithi084.stdout:3037: finishing write tid 5 to smithi08477944-13 2024-03-30T12:32:44.572 INFO:tasks.rados.rados.0.smithi084.stdout:3037: oid 13 updating version 0 to 23419 2024-03-30T12:32:44.572 INFO:tasks.rados.rados.0.smithi084.stdout:3037: oid 13 updating version 23419 to 23420 2024-03-30T12:32:44.572 INFO:tasks.rados.rados.0.smithi084.stdout:3037: oid 13 version 23420 is already newer than 23418 2024-03-30T12:32:44.572 INFO:tasks.rados.rados.0.smithi084.stdout:3037: oid 13 version 23420 is already newer than 23417 2024-03-30T12:32:44.572 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 23420 (ObjNum 940 snap 300 seq_num 940) dirty exists 2024-03-30T12:32:44.573 INFO:tasks.rados.rados.0.smithi084.stdout:3037: left oid 13 (ObjNum 940 snap 300 seq_num 940) 2024-03-30T12:32:44.573 INFO:tasks.rados.rados.0.smithi084.stdout:3038: expect (ObjNum 938 snap 299 seq_num 938) 2024-03-30T12:32:44.752 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:44.590+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:44.752 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:44.590+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:44.752 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:44.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:44.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:44.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:44.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:44.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:44.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:44.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:44.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[91810]: osdmap e671: 8 total, 8 up, 8 in 2024-03-30T12:32:44.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:44.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:44.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:44.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:44.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:44.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/2718804014' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:44.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:44.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:44.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:44.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:44.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:44.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:44.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:44.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:44.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[89279]: osdmap e671: 8 total, 8 up, 8 in 2024-03-30T12:32:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/2718804014' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:44.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:44.760+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:44.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:44.585+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:44.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:44.588+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:44.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:44.579+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:44.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:44.579+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:44.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:44.582+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:44.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:44.582+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:44.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:44.582+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:44.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 159=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:44.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:44 smithi162 ceph-mon[83709]: osdmap e671: 8 total, 8 up, 8 in 2024-03-30T12:32:44.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:44.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:44.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:44.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:44.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:44.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:44 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/2718804014' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:44.885 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -e sha1=5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-03-30T12:32:45.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:44.760+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:45.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:44.760+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:45.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:44.760+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:45.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:44.760+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:45.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:44.760+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:45.097 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:32:45.423 INFO:tasks.rados.rados.0.smithi084.stdout:3037: done (2 left) 2024-03-30T12:32:45.423 INFO:tasks.rados.rados.0.smithi084.stdout:3038: done (1 left) 2024-03-30T12:32:45.423 INFO:tasks.rados.rados.0.smithi084.stdout:3046: done (0 left) 2024-03-30T12:32:45.423 INFO:tasks.rados.rados.0.smithi084.stdout:3047: snap_create 2024-03-30T12:32:45.577 INFO:tasks.rados.rados.0.smithi084.stdout:3047: done (0 left) 2024-03-30T12:32:45.577 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 301 2024-03-30T12:32:45.577 INFO:tasks.rados.rados.0.smithi084.stdout:3048: seq_num 945 ranges {0=630784,630784=458752,1089536=344064} 2024-03-30T12:32:45.580 INFO:tasks.rados.rados.0.smithi084.stdout:3048: writing smithi08477944-8 from 0 to 630784 tid 1 2024-03-30T12:32:45.582 INFO:tasks.rados.rados.0.smithi084.stdout:3048: writing smithi08477944-8 from 630784 to 1089536 tid 2 2024-03-30T12:32:45.585 INFO:tasks.rados.rados.0.smithi084.stdout:3048: writing smithi08477944-8 from 1089536 to 1433600 tid 3 2024-03-30T12:32:45.585 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 301 2024-03-30T12:32:45.585 INFO:tasks.rados.rados.0.smithi084.stdout:3049: seq_num 946 ranges {6758400=647168,7405568=745472,8151040=57344} 2024-03-30T12:32:45.625 INFO:tasks.rados.rados.0.smithi084.stdout:3049: writing smithi08477944-29 from 6758400 to 7405568 tid 1 2024-03-30T12:32:45.629 INFO:tasks.rados.rados.0.smithi084.stdout:3049: writing smithi08477944-29 from 7405568 to 8151040 tid 2 2024-03-30T12:32:45.630 INFO:tasks.rados.rados.0.smithi084.stdout:3049: writing smithi08477944-29 from 8151040 to 8208384 tid 3 2024-03-30T12:32:45.630 INFO:tasks.rados.rados.0.smithi084.stdout:3050: copy_from oid 12 from oid 17 current snap is 301 2024-03-30T12:32:45.630 INFO:tasks.rados.rados.0.smithi084.stdout:3048: finishing write tid 1 to smithi08477944-8 2024-03-30T12:32:45.630 INFO:tasks.rados.rados.0.smithi084.stdout:3048: finishing write tid 2 to smithi08477944-8 2024-03-30T12:32:45.630 INFO:tasks.rados.rados.0.smithi084.stdout:3048: finishing write tid 3 to smithi08477944-8 2024-03-30T12:32:45.630 INFO:tasks.rados.rados.0.smithi084.stdout:3048: finishing write tid 4 to smithi08477944-8 2024-03-30T12:32:45.630 INFO:tasks.rados.rados.0.smithi084.stdout:3048: finishing write tid 5 to smithi08477944-8 2024-03-30T12:32:45.630 INFO:tasks.rados.rados.0.smithi084.stdout:3048: oid 8 updating version 0 to 27347 2024-03-30T12:32:45.631 INFO:tasks.rados.rados.0.smithi084.stdout:3048: oid 8 version 27347 is already newer than 27346 2024-03-30T12:32:45.631 INFO:tasks.rados.rados.0.smithi084.stdout:3048: oid 8 updating version 27347 to 27348 2024-03-30T12:32:45.631 INFO:tasks.rados.rados.0.smithi084.stdout:3048: oid 8 version 27348 is already newer than 27345 2024-03-30T12:32:45.631 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 27348 (ObjNum 945 snap 301 seq_num 945) dirty exists 2024-03-30T12:32:45.631 INFO:tasks.rados.rados.0.smithi084.stdout:3048: left oid 8 (ObjNum 945 snap 301 seq_num 945) 2024-03-30T12:32:45.631 INFO:tasks.rados.rados.0.smithi084.stdout:3048: done (2 left) 2024-03-30T12:32:45.631 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 301 2024-03-30T12:32:45.631 INFO:tasks.rados.rados.0.smithi084.stdout:3051: seq_num 947 ranges {0=663552,663552=630784,1294336=172032} 2024-03-30T12:32:45.634 INFO:tasks.rados.rados.0.smithi084.stdout:3051: writing smithi08477944-22 from 0 to 663552 tid 1 2024-03-30T12:32:45.637 INFO:tasks.rados.rados.0.smithi084.stdout:3051: writing smithi08477944-22 from 663552 to 1294336 tid 2 2024-03-30T12:32:45.638 INFO:tasks.rados.rados.0.smithi084.stdout:3051: writing smithi08477944-22 from 1294336 to 1466368 tid 3 2024-03-30T12:32:45.639 INFO:tasks.rados.rados.0.smithi084.stdout:3052: snap_remove snap 297 2024-03-30T12:32:45.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:45.597+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:45.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:45.597+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:45.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:45.583+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:45.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:45.583+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:45.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:45.584+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:45.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:45.584+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:45.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:45.584+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:45.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:45.584+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:45.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:45.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:45.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[89279]: osdmap e672: 8 total, 8 up, 8 in 2024-03-30T12:32:45.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:45.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:45.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:45.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:45.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:45.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:45.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:32:45.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[89279]: pgmap v697: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 865 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 8.9 MiB/s rd, 2.0 MiB/s wr, 13 op/s 2024-03-30T12:32:45.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:45.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:45.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:45.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:45.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[91810]: osdmap e672: 8 total, 8 up, 8 in 2024-03-30T12:32:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:32:45.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[91810]: pgmap v697: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 865 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 8.9 MiB/s rd, 2.0 MiB/s wr, 13 op/s 2024-03-30T12:32:45.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:45.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:45.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:45.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:45.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:45.853 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:45.586+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:45.853 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:45.586+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:45.853 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:45.641+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:45.853 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:45.642+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:45.853 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:45.608+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:45.854 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:45.608+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:45.854 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:45.608+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:45.854 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:45.854 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:45.854 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:45 smithi162 ceph-mon[83709]: osdmap e672: 8 total, 8 up, 8 in 2024-03-30T12:32:45.854 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:45.854 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:45.854 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:45.854 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:45.854 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:45.854 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:45.855 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:32:45.855 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:45 smithi162 ceph-mon[83709]: pgmap v697: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 865 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 8.9 MiB/s rd, 2.0 MiB/s wr, 13 op/s 2024-03-30T12:32:45.855 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:45.855 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:45.855 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:45.855 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:45.855 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:46.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:45.860+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:46.577 INFO:tasks.rados.rados.0.smithi084.stdout:3052: done (3 left) 2024-03-30T12:32:46.577 INFO:tasks.rados.rados.0.smithi084.stdout:3053: rollback oid 40 current snap is 301 2024-03-30T12:32:46.577 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 40 to 299 2024-03-30T12:32:46.577 INFO:tasks.rados.rados.0.smithi084.stdout:3049: finishing write tid 1 to smithi08477944-29 2024-03-30T12:32:46.577 INFO:tasks.rados.rados.0.smithi084.stdout:3050: finishing copy_from to smithi08477944-12 2024-03-30T12:32:46.577 INFO:tasks.rados.rados.0.smithi084.stdout:3050: got expected ENOENT (src dne) 2024-03-30T12:32:46.577 INFO:tasks.rados.rados.0.smithi084.stdout:3050: finishing copy_from racing read to smithi08477944-12 2024-03-30T12:32:46.577 INFO:tasks.rados.rados.0.smithi084.stdout:3049: finishing write tid 2 to smithi08477944-29 2024-03-30T12:32:46.577 INFO:tasks.rados.rados.0.smithi084.stdout:3049: finishing write tid 3 to smithi08477944-29 2024-03-30T12:32:46.577 INFO:tasks.rados.rados.0.smithi084.stdout:3049: finishing write tid 4 to smithi08477944-29 2024-03-30T12:32:46.577 INFO:tasks.rados.rados.0.smithi084.stdout:3049: finishing write tid 5 to smithi08477944-29 2024-03-30T12:32:46.577 INFO:tasks.rados.rados.0.smithi084.stdout:3049: oid 29 updating version 0 to 23420 2024-03-30T12:32:46.577 INFO:tasks.rados.rados.0.smithi084.stdout:3049: oid 29 updating version 23420 to 23421 2024-03-30T12:32:46.578 INFO:tasks.rados.rados.0.smithi084.stdout:3049: oid 29 version 23421 is already newer than 23418 2024-03-30T12:32:46.578 INFO:tasks.rados.rados.0.smithi084.stdout:3049: oid 29 version 23421 is already newer than 23419 2024-03-30T12:32:46.578 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 23421 (ObjNum 946 snap 301 seq_num 946) dirty exists 2024-03-30T12:32:46.578 INFO:tasks.rados.rados.0.smithi084.stdout:3049: left oid 29 (ObjNum 946 snap 301 seq_num 946) 2024-03-30T12:32:46.578 INFO:tasks.rados.rados.0.smithi084.stdout:3051: finishing write tid 1 to smithi08477944-22 2024-03-30T12:32:46.578 INFO:tasks.rados.rados.0.smithi084.stdout:3051: finishing write tid 2 to smithi08477944-22 2024-03-30T12:32:46.578 INFO:tasks.rados.rados.0.smithi084.stdout:3051: finishing write tid 3 to smithi08477944-22 2024-03-30T12:32:46.578 INFO:tasks.rados.rados.0.smithi084.stdout:3051: finishing write tid 4 to smithi08477944-22 2024-03-30T12:32:46.578 INFO:tasks.rados.rados.0.smithi084.stdout:3051: finishing write tid 5 to smithi08477944-22 2024-03-30T12:32:46.578 INFO:tasks.rados.rados.0.smithi084.stdout:3051: oid 22 updating version 0 to 27351 2024-03-30T12:32:46.578 INFO:tasks.rados.rados.0.smithi084.stdout:3051: oid 22 version 27351 is already newer than 27349 2024-03-30T12:32:46.578 INFO:tasks.rados.rados.0.smithi084.stdout:3051: oid 22 version 27351 is already newer than 27350 2024-03-30T12:32:46.578 INFO:tasks.rados.rados.0.smithi084.stdout:3051: oid 22 updating version 27351 to 27352 2024-03-30T12:32:46.578 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 27352 (ObjNum 947 snap 301 seq_num 947) dirty exists 2024-03-30T12:32:46.579 INFO:tasks.rados.rados.0.smithi084.stdout:3051: left oid 22 (ObjNum 947 snap 301 seq_num 947) 2024-03-30T12:32:46.579 INFO:tasks.rados.rados.0.smithi084.stdout:3049: done (3 left) 2024-03-30T12:32:46.579 INFO:tasks.rados.rados.0.smithi084.stdout:3050: done (2 left) 2024-03-30T12:32:46.579 INFO:tasks.rados.rados.0.smithi084.stdout:3051: done (1 left) 2024-03-30T12:32:46.579 INFO:tasks.rados.rados.0.smithi084.stdout:3054: snap_remove snap 296 2024-03-30T12:32:46.700 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:46.592+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:46.700 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:46.592+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:46.700 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:46.587+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:46.701 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:46.588+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:46.701 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:46.588+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:46.701 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:46.588+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:46.701 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:46.589+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:46.701 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:46.701 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:46.701 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:46.701 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:46.701 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[91810]: osdmap e673: 8 total, 8 up, 8 in 2024-03-30T12:32:46.702 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:46.702 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:46.702 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:46.702 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:46.702 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:46.702 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:46.702 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:46.702 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:46.702 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:46.702 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:46.703 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:46.703 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:46.703 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:46.703 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[89279]: osdmap e673: 8 total, 8 up, 8 in 2024-03-30T12:32:46.703 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:46.703 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:46.703 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:46.703 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:46.703 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:46.703 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:46.703 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:46.703 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:46.703 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:46.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:46.587+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:46.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:46.635+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:46.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:46.635+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:46.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:46.585+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:46.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:46.585+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:46.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:46.689+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:46.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:46.689+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:46.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:46.689+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:46.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:46.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:46.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:46.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:46.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:46 smithi162 ceph-mon[83709]: osdmap e673: 8 total, 8 up, 8 in 2024-03-30T12:32:46.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:46.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:46.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:46.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:46.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:46.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:46.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:46.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:46.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:47.229 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 19.0.0-1864-g5dc2ea30 (5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc) squid (dev)" 2024-03-30T12:32:47.589 INFO:tasks.rados.rados.0.smithi084.stdout:3054: done (1 left) 2024-03-30T12:32:47.589 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 301 2024-03-30T12:32:47.589 INFO:tasks.rados.rados.0.smithi084.stdout:3053: finishing rollback tid 1 to smithi08477944-40 2024-03-30T12:32:47.589 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 27284 (ObjNum 33 snap 0 seq_num 1394497328) dirty dne 2024-03-30T12:32:47.589 INFO:tasks.rados.rados.0.smithi084.stdout:3055: seq_num 948 ranges {2113536=679936,2793472=516096,3309568=286720} 2024-03-30T12:32:47.604 INFO:tasks.rados.rados.0.smithi084.stdout:3055: writing smithi08477944-9 from 2113536 to 2793472 tid 1 2024-03-30T12:32:47.607 INFO:tasks.rados.rados.0.smithi084.stdout:3055: writing smithi08477944-9 from 2793472 to 3309568 tid 2 2024-03-30T12:32:47.609 INFO:tasks.rados.rados.0.smithi084.stdout:3055: writing smithi08477944-9 from 3309568 to 3596288 tid 3 2024-03-30T12:32:47.609 INFO:tasks.rados.rados.0.smithi084.stdout:3053: done (1 left) 2024-03-30T12:32:47.609 INFO:tasks.rados.rados.0.smithi084.stdout:3056: snap_create 2024-03-30T12:32:47.609 INFO:tasks.rados.rados.0.smithi084.stdout:3055: finishing write tid 1 to smithi08477944-9 2024-03-30T12:32:47.611 INFO:tasks.rados.rados.0.smithi084.stdout:3055: finishing write tid 2 to smithi08477944-9 2024-03-30T12:32:47.611 INFO:tasks.rados.rados.0.smithi084.stdout:3055: finishing write tid 3 to smithi08477944-9 2024-03-30T12:32:47.612 INFO:tasks.rados.rados.0.smithi084.stdout:3055: finishing write tid 4 to smithi08477944-9 2024-03-30T12:32:47.612 INFO:tasks.rados.rados.0.smithi084.stdout:3055: finishing write tid 5 to smithi08477944-9 2024-03-30T12:32:47.612 INFO:tasks.rados.rados.0.smithi084.stdout:3055: oid 9 updating version 0 to 22511 2024-03-30T12:32:47.612 INFO:tasks.rados.rados.0.smithi084.stdout:3055: oid 9 updating version 22511 to 22514 2024-03-30T12:32:47.613 INFO:tasks.rados.rados.0.smithi084.stdout:3055: oid 9 version 22514 is already newer than 22512 2024-03-30T12:32:47.613 INFO:tasks.rados.rados.0.smithi084.stdout:3055: oid 9 version 22514 is already newer than 22513 2024-03-30T12:32:47.613 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 22514 (ObjNum 948 snap 301 seq_num 948) dirty exists 2024-03-30T12:32:47.613 INFO:tasks.rados.rados.0.smithi084.stdout:3055: left oid 9 (ObjNum 948 snap 301 seq_num 948) 2024-03-30T12:32:47.833 INFO:teuthology.task.sequential:In sequential, running task print... 2024-03-30T12:32:47.833 INFO:teuthology.task.print:**** done end upgrade, wait... 2024-03-30T12:32:47.833 DEBUG:teuthology.parallel:result is None 2024-03-30T12:32:47.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:47.598+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:47.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:47.598+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:47.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:47.598+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:47.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:47 smithi162 ceph-mon[83709]: osdmap e674: 8 total, 8 up, 8 in 2024-03-30T12:32:47.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:47.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:47.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:47.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:47.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:47.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:47.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:47.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:47.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:47.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:47.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:47.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:47.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:47.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:47 smithi162 ceph-mon[83709]: pgmap v700: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 868 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 16 MiB/s rd, 2.0 MiB/s wr, 13 op/s 2024-03-30T12:32:47.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:47 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/2011497601' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:47.976 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:47.596+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:47.976 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:47.596+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:47.976 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:47.597+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:47.976 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:47.598+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:47.976 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:47.598+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:47.976 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:47.598+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:47.976 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[89279]: osdmap e674: 8 total, 8 up, 8 in 2024-03-30T12:32:47.976 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:47.977 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:47.977 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:47.977 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:47.977 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:47.977 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:47.977 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:47.977 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:47.977 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:47.977 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:47.977 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:47.977 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:47.977 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:47.977 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[89279]: pgmap v700: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 868 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 16 MiB/s rd, 2.0 MiB/s wr, 13 op/s 2024-03-30T12:32:47.978 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/2011497601' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:47.978 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[91810]: osdmap e674: 8 total, 8 up, 8 in 2024-03-30T12:32:47.978 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:47.978 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:47.978 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:47.978 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:47.978 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:47.978 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:47.978 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:47.978 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:47.978 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:47.978 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:47.979 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:47.979 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:47.979 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:47.979 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[91810]: pgmap v700: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 868 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 16 MiB/s rd, 2.0 MiB/s wr, 13 op/s 2024-03-30T12:32:47.979 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/2011497601' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T12:32:48.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:47.984+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:48.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:47.984+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:48.585 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:48.194+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:48.586 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:48.284+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:48.586 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:48.284+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:48.599 INFO:tasks.rados.rados.0.smithi084.stdout:3055: done (1 left) 2024-03-30T12:32:48.599 INFO:tasks.rados.rados.0.smithi084.stdout:3056: done (0 left) 2024-03-30T12:32:48.599 INFO:tasks.rados.rados.0.smithi084.stdout:3057: read oid 31 snap -1 2024-03-30T12:32:48.599 INFO:tasks.rados.rados.0.smithi084.stdout:3057: expect (ObjNum 883 snap 282 seq_num 883) 2024-03-30T12:32:48.599 INFO:tasks.rados.rados.0.smithi084.stdout:3058: read oid 45 snap -1 2024-03-30T12:32:48.599 INFO:tasks.rados.rados.0.smithi084.stdout:3058: expect (ObjNum 909 snap 288 seq_num 909) 2024-03-30T12:32:48.599 INFO:tasks.rados.rados.0.smithi084.stdout:3059: read oid 38 snap 301 2024-03-30T12:32:48.600 INFO:tasks.rados.rados.0.smithi084.stdout:3059: expect deleted 2024-03-30T12:32:48.600 INFO:tasks.rados.rados.0.smithi084.stdout:3060: delete oid 32 current snap is 302 2024-03-30T12:32:48.606 INFO:tasks.rados.rados.0.smithi084.stdout:3057: expect (ObjNum 883 snap 282 seq_num 883) 2024-03-30T12:32:48.627 INFO:tasks.rados.rados.0.smithi084.stdout:3058: expect (ObjNum 909 snap 288 seq_num 909) 2024-03-30T12:32:48.680 INFO:tasks.rados.rados.0.smithi084.stdout:3057: done (3 left) 2024-03-30T12:32:48.680 INFO:tasks.rados.rados.0.smithi084.stdout:3058: done (2 left) 2024-03-30T12:32:48.680 INFO:tasks.rados.rados.0.smithi084.stdout:3059: done (1 left) 2024-03-30T12:32:48.680 INFO:tasks.rados.rados.0.smithi084.stdout:3060: done (0 left) 2024-03-30T12:32:48.680 INFO:tasks.rados.rados.0.smithi084.stdout:3061: copy_from oid 47 from oid 48 current snap is 302 2024-03-30T12:32:48.681 INFO:tasks.rados.rados.0.smithi084.stdout:3062: snap_remove snap 295 2024-03-30T12:32:48.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:48.809+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:48.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:48.809+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:48.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:48.810+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:48.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:48.606+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:48.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:48.607+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:48.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:48.601+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:48.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:48.601+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:48.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:48.601+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:48.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:48.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:48.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:48 smithi162 ceph-mon[83709]: osdmap e675: 8 total, 8 up, 8 in 2024-03-30T12:32:48.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:48.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:48.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:48.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:48.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:48.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:48.972 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:48.612+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:48.972 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:48.615+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:48.973 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:48.607+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:48.973 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:48.607+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:48.973 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:48.607+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:48.973 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:48.607+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:48.973 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:48.608+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:48.974 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:48.974 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:48.974 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:48 smithi084 ceph-mon[91810]: osdmap e675: 8 total, 8 up, 8 in 2024-03-30T12:32:48.974 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:48.975 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:48.975 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:48.975 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:48.975 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:48.975 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:48.975 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:48.975 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:48.975 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:48 smithi084 ceph-mon[89279]: osdmap e675: 8 total, 8 up, 8 in 2024-03-30T12:32:48.975 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:48.975 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:48.975 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:48.976 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:48.976 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:48.976 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:49.581 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:32:49] "GET /metrics HTTP/1.1" 200 36333 "" "Prometheus/2.43.0" 2024-03-30T12:32:49.605 INFO:tasks.rados.rados.0.smithi084.stdout:3062: done (1 left) 2024-03-30T12:32:49.605 INFO:tasks.rados.rados.0.smithi084.stdout:3063: snap_remove snap 301 2024-03-30T12:32:49.850 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:49.608+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:49.850 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:49.609+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:49.850 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:49.609+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:49.850 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:49.609+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:49.850 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:49.609+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:49.851 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:49.609+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:49.851 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:49.851 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:49.851 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:49.851 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:49.851 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:49.851 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:49.851 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[91810]: osdmap e676: 8 total, 8 up, 8 in 2024-03-30T12:32:49.852 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:49.852 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:49.852 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:49.852 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:49.852 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:49.852 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:49.852 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:49.852 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[91810]: pgmap v703: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 869 MiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 7.3 MiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-03-30T12:32:49.852 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:49.852 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:49.852 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:49.853 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:49.853 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:49.853 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:49.853 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:49.853 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:49.853 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:49.853 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[89279]: osdmap e676: 8 total, 8 up, 8 in 2024-03-30T12:32:49.853 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:49.853 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:49.853 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:49.853 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:49.854 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:49.854 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:49.854 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:49.854 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[89279]: pgmap v703: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 869 MiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 7.3 MiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-03-30T12:32:49.854 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:49.854 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:49.854 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:49.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:49.612+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:49.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:49.612+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:49.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:49.612+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:49.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:49.609+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:49.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:49.609+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:49.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:49.606+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:49.871 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:49.607+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:49.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:49.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:49.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:49.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:49.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:49.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:49.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:49 smithi162 ceph-mon[83709]: osdmap e676: 8 total, 8 up, 8 in 2024-03-30T12:32:49.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:49.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:49.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:49.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:49.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:49.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:49.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:49.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:49 smithi162 ceph-mon[83709]: pgmap v703: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 869 MiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 7.3 MiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-03-30T12:32:49.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:49.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:49.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:50.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:49.939+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:50.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:49.939+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:50.605 INFO:tasks.rados.rados.0.smithi084.stdout:3063: done (1 left) 2024-03-30T12:32:50.605 INFO:tasks.rados.rados.0.smithi084.stdout:3064: rollback oid 46 current snap is 302 2024-03-30T12:32:50.605 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 46 to 298 2024-03-30T12:32:50.605 INFO:tasks.rados.rados.0.smithi084.stdout:3061: finishing copy_from racing read to smithi08477944-47 2024-03-30T12:32:50.605 INFO:tasks.rados.rados.0.smithi084.stdout:3061: finishing copy_from to smithi08477944-47 2024-03-30T12:32:50.605 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 23421 (ObjNum 936 snap 295 seq_num 936) dirty exists 2024-03-30T12:32:50.606 INFO:tasks.rados.rados.0.smithi084.stdout:3061: done (1 left) 2024-03-30T12:32:50.606 INFO:tasks.rados.rados.0.smithi084.stdout:3065: copy_from oid 23 from oid 29 current snap is 302 2024-03-30T12:32:50.606 INFO:tasks.rados.rados.0.smithi084.stdout:3066: read oid 17 snap 299 2024-03-30T12:32:50.606 INFO:tasks.rados.rados.0.smithi084.stdout:3066: expect deleted 2024-03-30T12:32:50.606 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 8 current snap is 302 2024-03-30T12:32:50.606 INFO:tasks.rados.rados.0.smithi084.stdout:3067: seq_num 950 ranges {1433600=720896,2154496=679936,2834432=122880} 2024-03-30T12:32:50.617 INFO:tasks.rados.rados.0.smithi084.stdout:3067: writing smithi08477944-8 from 1433600 to 2154496 tid 1 2024-03-30T12:32:50.621 INFO:tasks.rados.rados.0.smithi084.stdout:3067: writing smithi08477944-8 from 2154496 to 2834432 tid 2 2024-03-30T12:32:50.622 INFO:tasks.rados.rados.0.smithi084.stdout:3067: writing smithi08477944-8 from 2834432 to 2957312 tid 3 2024-03-30T12:32:50.622 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 302 2024-03-30T12:32:50.622 INFO:tasks.rados.rados.0.smithi084.stdout:3068: seq_num 951 ranges {0=737280,737280=614400,1351680=188416} 2024-03-30T12:32:50.627 INFO:tasks.rados.rados.0.smithi084.stdout:3068: writing smithi08477944-14 from 0 to 737280 tid 1 2024-03-30T12:32:50.631 INFO:tasks.rados.rados.0.smithi084.stdout:3068: writing smithi08477944-14 from 737280 to 1351680 tid 2 2024-03-30T12:32:50.632 INFO:tasks.rados.rados.0.smithi084.stdout:3068: writing smithi08477944-14 from 1351680 to 1540096 tid 3 2024-03-30T12:32:50.632 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 42 current snap is 302 2024-03-30T12:32:50.632 INFO:tasks.rados.rados.0.smithi084.stdout:3069: seq_num 952 ranges {1826816=753664,2580480=499712,3080192=303104} 2024-03-30T12:32:50.646 INFO:tasks.rados.rados.0.smithi084.stdout:3069: writing smithi08477944-42 from 1826816 to 2580480 tid 1 2024-03-30T12:32:50.649 INFO:tasks.rados.rados.0.smithi084.stdout:3069: writing smithi08477944-42 from 2580480 to 3080192 tid 2 2024-03-30T12:32:50.652 INFO:tasks.rados.rados.0.smithi084.stdout:3069: writing smithi08477944-42 from 3080192 to 3383296 tid 3 2024-03-30T12:32:50.652 INFO:tasks.rados.rados.0.smithi084.stdout:3070: delete oid 36 current snap is 302 2024-03-30T12:32:50.652 INFO:tasks.rados.rados.0.smithi084.stdout:3064: finishing rollback tid 0 to smithi08477944-46 2024-03-30T12:32:50.652 INFO:tasks.rados.rados.0.smithi084.stdout:3064: finishing rollback tid 1 to smithi08477944-46 2024-03-30T12:32:50.652 INFO:tasks.rados.rados.0.smithi084.stdout:3064: finishing rollback tid 2 to smithi08477944-46 2024-03-30T12:32:50.652 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 27356 (ObjNum 900 snap 287 seq_num 900) dirty exists 2024-03-30T12:32:50.652 INFO:tasks.rados.rados.0.smithi084.stdout:3067: finishing write tid 1 to smithi08477944-8 2024-03-30T12:32:50.652 INFO:tasks.rados.rados.0.smithi084.stdout:3067: finishing write tid 2 to smithi08477944-8 2024-03-30T12:32:50.652 INFO:tasks.rados.rados.0.smithi084.stdout:3067: finishing write tid 3 to smithi08477944-8 2024-03-30T12:32:50.652 INFO:tasks.rados.rados.0.smithi084.stdout:3067: finishing write tid 4 to smithi08477944-8 2024-03-30T12:32:50.653 INFO:tasks.rados.rados.0.smithi084.stdout:3067: finishing write tid 5 to smithi08477944-8 2024-03-30T12:32:50.653 INFO:tasks.rados.rados.0.smithi084.stdout:3067: oid 8 updating version 0 to 27360 2024-03-30T12:32:50.653 INFO:tasks.rados.rados.0.smithi084.stdout:3067: oid 8 version 27360 is already newer than 27359 2024-03-30T12:32:50.653 INFO:tasks.rados.rados.0.smithi084.stdout:3067: oid 8 version 27360 is already newer than 27358 2024-03-30T12:32:50.653 INFO:tasks.rados.rados.0.smithi084.stdout:3067: oid 8 version 27360 is already newer than 27357 2024-03-30T12:32:50.653 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 27360 (ObjNum 950 snap 302 seq_num 950) dirty exists 2024-03-30T12:32:50.653 INFO:tasks.rados.rados.0.smithi084.stdout:3067: left oid 8 (ObjNum 950 snap 302 seq_num 950) 2024-03-30T12:32:50.653 INFO:tasks.rados.rados.0.smithi084.stdout:3068: finishing write tid 1 to smithi08477944-14 2024-03-30T12:32:50.653 INFO:tasks.rados.rados.0.smithi084.stdout:3065: finishing copy_from racing read to smithi08477944-23 2024-03-30T12:32:50.653 INFO:tasks.rados.rados.0.smithi084.stdout:3068: finishing write tid 2 to smithi08477944-14 2024-03-30T12:32:50.654 INFO:tasks.rados.rados.0.smithi084.stdout:3068: finishing write tid 3 to smithi08477944-14 2024-03-30T12:32:50.655 INFO:tasks.rados.rados.0.smithi084.stdout:3068: finishing write tid 4 to smithi08477944-14 2024-03-30T12:32:50.655 INFO:tasks.rados.rados.0.smithi084.stdout:3065: finishing copy_from to smithi08477944-23 2024-03-30T12:32:50.655 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 23421 (ObjNum 946 snap 301 seq_num 946) dirty exists 2024-03-30T12:32:50.657 INFO:tasks.rados.rados.0.smithi084.stdout:3064: done (6 left) 2024-03-30T12:32:50.657 INFO:tasks.rados.rados.0.smithi084.stdout:3065: done (5 left) 2024-03-30T12:32:50.657 INFO:tasks.rados.rados.0.smithi084.stdout:3066: done (4 left) 2024-03-30T12:32:50.657 INFO:tasks.rados.rados.0.smithi084.stdout:3067: done (3 left) 2024-03-30T12:32:50.657 INFO:tasks.rados.rados.0.smithi084.stdout:3070: done (2 left) 2024-03-30T12:32:50.657 INFO:tasks.rados.rados.0.smithi084.stdout:3071: read oid 26 snap 299 2024-03-30T12:32:50.657 INFO:tasks.rados.rados.0.smithi084.stdout:3071: expect (ObjNum 938 snap 299 seq_num 938) 2024-03-30T12:32:50.657 INFO:tasks.rados.rados.0.smithi084.stdout:3072: snap_create 2024-03-30T12:32:50.657 INFO:tasks.rados.rados.0.smithi084.stdout:3069: finishing write tid 1 to smithi08477944-42 2024-03-30T12:32:50.658 INFO:tasks.rados.rados.0.smithi084.stdout:3069: finishing write tid 2 to smithi08477944-42 2024-03-30T12:32:50.658 INFO:tasks.rados.rados.0.smithi084.stdout:3069: finishing write tid 3 to smithi08477944-42 2024-03-30T12:32:50.658 INFO:tasks.rados.rados.0.smithi084.stdout:3069: finishing write tid 4 to smithi08477944-42 2024-03-30T12:32:50.659 INFO:tasks.rados.rados.0.smithi084.stdout:3069: finishing write tid 5 to smithi08477944-42 2024-03-30T12:32:50.659 INFO:tasks.rados.rados.0.smithi084.stdout:3069: oid 42 updating version 0 to 27298 2024-03-30T12:32:50.659 INFO:tasks.rados.rados.0.smithi084.stdout:3069: oid 42 version 27298 is already newer than 27295 2024-03-30T12:32:50.659 INFO:tasks.rados.rados.0.smithi084.stdout:3069: oid 42 version 27298 is already newer than 27297 2024-03-30T12:32:50.659 INFO:tasks.rados.rados.0.smithi084.stdout:3069: oid 42 version 27298 is already newer than 27296 2024-03-30T12:32:50.659 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 27298 (ObjNum 952 snap 302 seq_num 952) dirty exists 2024-03-30T12:32:50.659 INFO:tasks.rados.rados.0.smithi084.stdout:3069: left oid 42 (ObjNum 952 snap 302 seq_num 952) 2024-03-30T12:32:50.661 INFO:tasks.rados.rados.0.smithi084.stdout:3068: finishing write tid 5 to smithi08477944-14 2024-03-30T12:32:50.661 INFO:tasks.rados.rados.0.smithi084.stdout:3068: oid 14 updating version 0 to 36276 2024-03-30T12:32:50.661 INFO:tasks.rados.rados.0.smithi084.stdout:3068: oid 14 updating version 36276 to 36278 2024-03-30T12:32:50.661 INFO:tasks.rados.rados.0.smithi084.stdout:3068: oid 14 version 36278 is already newer than 36277 2024-03-30T12:32:50.661 INFO:tasks.rados.rados.0.smithi084.stdout:3068: oid 14 updating version 36278 to 36279 2024-03-30T12:32:50.661 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 36279 (ObjNum 951 snap 302 seq_num 951) dirty exists 2024-03-30T12:32:50.661 INFO:tasks.rados.rados.0.smithi084.stdout:3068: left oid 14 (ObjNum 951 snap 302 seq_num 951) 2024-03-30T12:32:50.702 INFO:tasks.rados.rados.0.smithi084.stdout:3071: expect (ObjNum 938 snap 299 seq_num 938) 2024-03-30T12:32:50.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:50.645+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:50.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:50.650+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:50.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:50.651+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:50.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:50.651+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:50.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:50.611+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:50.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:50.611+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:50.871 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:50.612+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:50.871 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:50.613+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:50.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:50.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:50.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:50.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:50.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:50.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:50.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:50.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:50.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:50.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:50.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:50 smithi162 ceph-mon[83709]: osdmap e677: 8 total, 8 up, 8 in 2024-03-30T12:32:51.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:50.620+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:51.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:50.622+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:51.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:50.611+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:51.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:50.611+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:51.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:50.611+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:51.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:50.612+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:51.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:50.612+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:51.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:51.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:51.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:51.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:51.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:51.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:51.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:51.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:51.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:51.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:51.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-mon[91810]: osdmap e677: 8 total, 8 up, 8 in 2024-03-30T12:32:51.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:51.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:51.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:51.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:51.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:51.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:51.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:51.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:51.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:51.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:51.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:50 smithi084 ceph-mon[89279]: osdmap e677: 8 total, 8 up, 8 in 2024-03-30T12:32:51.620 INFO:tasks.rados.rados.0.smithi084.stdout:3068: done (3 left) 2024-03-30T12:32:51.620 INFO:tasks.rados.rados.0.smithi084.stdout:3069: done (2 left) 2024-03-30T12:32:51.620 INFO:tasks.rados.rados.0.smithi084.stdout:3071: done (1 left) 2024-03-30T12:32:51.620 INFO:tasks.rados.rados.0.smithi084.stdout:3072: done (0 left) 2024-03-30T12:32:51.620 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 303 2024-03-30T12:32:51.620 INFO:tasks.rados.rados.0.smithi084.stdout:3073: seq_num 954 ranges {6012928=786432,6799360=671744,7471104=131072} 2024-03-30T12:32:51.656 INFO:tasks.rados.rados.0.smithi084.stdout:3073: writing smithi08477944-41 from 6012928 to 6799360 tid 1 2024-03-30T12:32:51.660 INFO:tasks.rados.rados.0.smithi084.stdout:3073: writing smithi08477944-41 from 6799360 to 7471104 tid 2 2024-03-30T12:32:51.660 INFO:tasks.rados.rados.0.smithi084.stdout:3073: writing smithi08477944-41 from 7471104 to 7602176 tid 3 2024-03-30T12:32:51.661 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 27 current snap is 303 2024-03-30T12:32:51.661 INFO:tasks.rados.rados.0.smithi084.stdout:3074: seq_num 955 ranges {0=802816,802816=557056,1359872=245760} 2024-03-30T12:32:51.665 INFO:tasks.rados.rados.0.smithi084.stdout:3074: writing smithi08477944-27 from 0 to 802816 tid 1 2024-03-30T12:32:51.668 INFO:tasks.rados.rados.0.smithi084.stdout:3074: writing smithi08477944-27 from 802816 to 1359872 tid 2 2024-03-30T12:32:51.671 INFO:tasks.rados.rados.0.smithi084.stdout:3074: writing smithi08477944-27 from 1359872 to 1605632 tid 3 2024-03-30T12:32:51.671 INFO:tasks.rados.rados.0.smithi084.stdout:3075: read oid 3 snap -1 2024-03-30T12:32:51.671 INFO:tasks.rados.rados.0.smithi084.stdout:3075: expect deleted 2024-03-30T12:32:51.671 INFO:tasks.rados.rados.0.smithi084.stdout:3076: read oid 6 snap -1 2024-03-30T12:32:51.671 INFO:tasks.rados.rados.0.smithi084.stdout:3076: expect (ObjNum 911 snap 290 seq_num 911) 2024-03-30T12:32:51.671 INFO:tasks.rados.rados.0.smithi084.stdout:3077: copy_from oid 44 from oid 36 current snap is 303 2024-03-30T12:32:51.671 INFO:tasks.rados.rados.0.smithi084.stdout:3073: finishing write tid 1 to smithi08477944-41 2024-03-30T12:32:51.671 INFO:tasks.rados.rados.0.smithi084.stdout:3073: finishing write tid 2 to smithi08477944-41 2024-03-30T12:32:51.671 INFO:tasks.rados.rados.0.smithi084.stdout:3073: finishing write tid 3 to smithi08477944-41 2024-03-30T12:32:51.671 INFO:tasks.rados.rados.0.smithi084.stdout:3073: finishing write tid 4 to smithi08477944-41 2024-03-30T12:32:51.671 INFO:tasks.rados.rados.0.smithi084.stdout:3073: finishing write tid 5 to smithi08477944-41 2024-03-30T12:32:51.671 INFO:tasks.rados.rados.0.smithi084.stdout:3073: oid 41 updating version 0 to 27288 2024-03-30T12:32:51.671 INFO:tasks.rados.rados.0.smithi084.stdout:3073: oid 41 updating version 27288 to 27290 2024-03-30T12:32:51.672 INFO:tasks.rados.rados.0.smithi084.stdout:3073: oid 41 version 27290 is already newer than 27287 2024-03-30T12:32:51.672 INFO:tasks.rados.rados.0.smithi084.stdout:3073: oid 41 version 27290 is already newer than 27289 2024-03-30T12:32:51.672 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 27290 (ObjNum 954 snap 303 seq_num 954) dirty exists 2024-03-30T12:32:51.672 INFO:tasks.rados.rados.0.smithi084.stdout:3073: left oid 41 (ObjNum 954 snap 303 seq_num 954) 2024-03-30T12:32:51.672 INFO:tasks.rados.rados.0.smithi084.stdout:3073: done (4 left) 2024-03-30T12:32:51.672 INFO:tasks.rados.rados.0.smithi084.stdout:3078: rmattr oid 5 current snap is 303 2024-03-30T12:32:51.672 INFO:tasks.rados.rados.0.smithi084.stdout:3079: delete oid 28 current snap is 303 2024-03-30T12:32:51.672 INFO:tasks.rados.rados.0.smithi084.stdout:3075: done (5 left) 2024-03-30T12:32:51.672 INFO:tasks.rados.rados.0.smithi084.stdout:3079: done (4 left) 2024-03-30T12:32:51.673 INFO:tasks.rados.rados.0.smithi084.stdout:3080: delete oid 12 current snap is 303 2024-03-30T12:32:51.673 INFO:tasks.rados.rados.0.smithi084.stdout:3074: finishing write tid 1 to smithi08477944-27 2024-03-30T12:32:51.674 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 27285 (ObjNum 836 snap 273 seq_num 836) dirty exists 2024-03-30T12:32:51.678 INFO:tasks.rados.rados.0.smithi084.stdout:3074: finishing write tid 2 to smithi08477944-27 2024-03-30T12:32:51.679 INFO:tasks.rados.rados.0.smithi084.stdout:3074: finishing write tid 3 to smithi08477944-27 2024-03-30T12:32:51.679 INFO:tasks.rados.rados.0.smithi084.stdout:3074: finishing write tid 4 to smithi08477944-27 2024-03-30T12:32:51.681 INFO:tasks.rados.rados.0.smithi084.stdout:3076: expect (ObjNum 911 snap 290 seq_num 911) 2024-03-30T12:32:51.704 INFO:tasks.rados.rados.0.smithi084.stdout:3077: finishing copy_from to smithi08477944-44 2024-03-30T12:32:51.704 INFO:tasks.rados.rados.0.smithi084.stdout:3077: got expected ENOENT (src dne) 2024-03-30T12:32:51.704 INFO:tasks.rados.rados.0.smithi084.stdout:3077: finishing copy_from racing read to smithi08477944-44 2024-03-30T12:32:51.704 INFO:tasks.rados.rados.0.smithi084.stdout:3074: finishing write tid 5 to smithi08477944-27 2024-03-30T12:32:51.704 INFO:tasks.rados.rados.0.smithi084.stdout:3074: oid 27 updating version 0 to 27233 2024-03-30T12:32:51.704 INFO:tasks.rados.rados.0.smithi084.stdout:3074: oid 27 updating version 27233 to 27235 2024-03-30T12:32:51.704 INFO:tasks.rados.rados.0.smithi084.stdout:3074: oid 27 version 27235 is already newer than 27234 2024-03-30T12:32:51.704 INFO:tasks.rados.rados.0.smithi084.stdout:3074: oid 27 version 27235 is already newer than 27232 2024-03-30T12:32:51.704 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 27235 (ObjNum 955 snap 303 seq_num 955) dirty exists 2024-03-30T12:32:51.705 INFO:tasks.rados.rados.0.smithi084.stdout:3074: left oid 27 (ObjNum 955 snap 303 seq_num 955) 2024-03-30T12:32:51.705 INFO:tasks.rados.rados.0.smithi084.stdout:3074: done (4 left) 2024-03-30T12:32:51.705 INFO:tasks.rados.rados.0.smithi084.stdout:3076: done (3 left) 2024-03-30T12:32:51.705 INFO:tasks.rados.rados.0.smithi084.stdout:3077: done (2 left) 2024-03-30T12:32:51.705 INFO:tasks.rados.rados.0.smithi084.stdout:3078: done (1 left) 2024-03-30T12:32:51.705 INFO:tasks.rados.rados.0.smithi084.stdout:3080: done (0 left) 2024-03-30T12:32:51.705 INFO:tasks.rados.rados.0.smithi084.stdout:3081: snap_create 2024-03-30T12:32:51.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:51.623+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:51.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:51.663+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:51.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:51.663+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:51.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:51.628+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:51.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:51.628+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:51.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:51.663+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:51.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:51.663+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:51.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:51.663+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:51.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:51.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:51.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:51.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:51.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:51.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:51.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:51.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:51.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:51.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:51 smithi162 ceph-mon[83709]: osdmap e678: 8 total, 8 up, 8 in 2024-03-30T12:32:51.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:51.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:51.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:51.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:51.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:51.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:51.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:51 smithi162 ceph-mon[83709]: pgmap v706: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 872 MiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 1.4 MiB/s wr, 6 op/s 2024-03-30T12:32:52.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:51.662+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:52.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:51.662+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:52.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:52.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:52.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:52.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:52.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:52.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:52.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:52.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:52.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:52.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[91810]: osdmap e678: 8 total, 8 up, 8 in 2024-03-30T12:32:52.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:52.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:52.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:52.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:52.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:52.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:52.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[91810]: pgmap v706: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 872 MiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 1.4 MiB/s wr, 6 op/s 2024-03-30T12:32:52.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:51.627+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:52.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:51.627+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:52.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:51.627+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:52.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:51.627+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:52.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:51.627+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:52.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:51.627+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:52.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:52.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:52.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:52.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:52.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:52.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:52.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:52.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:52.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:52.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[89279]: osdmap e678: 8 total, 8 up, 8 in 2024-03-30T12:32:52.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:52.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:52.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:52.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:52.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:52.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:52.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:51 smithi084 ceph-mon[89279]: pgmap v706: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 872 MiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 1.4 MiB/s wr, 6 op/s 2024-03-30T12:32:52.621 INFO:tasks.rados.rados.0.smithi084.stdout:3081: done (0 left) 2024-03-30T12:32:52.621 INFO:tasks.rados.rados.0.smithi084.stdout:3082: snap_remove snap 302 2024-03-30T12:32:52.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:52.629+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:52.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:52.629+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:52.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:52.629+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:52.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:52.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:52.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:52.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:52.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:52.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:52 smithi162 ceph-mon[83709]: osdmap e679: 8 total, 8 up, 8 in 2024-03-30T12:32:52.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:52.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:52.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:52.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:52.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:52.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:52.873 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:52.874 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:53.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:52.630+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:53.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:52.630+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:53.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:52.628+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:53.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:52.628+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:53.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:52.628+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:53.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:52.629+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:53.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:52.630+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:53.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:53.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:53.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:53.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:53.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:53.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[89279]: osdmap e679: 8 total, 8 up, 8 in 2024-03-30T12:32:53.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:53.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:53.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:53.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:53.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:53.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:53.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:53.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:53.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:53.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:53.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:53.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:53.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:53.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[91810]: osdmap e679: 8 total, 8 up, 8 in 2024-03-30T12:32:53.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 161=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:53.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16a=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:53.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:53.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:53.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:53.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:53.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:53.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:53.629 INFO:tasks.rados.rados.0.smithi084.stdout:3082: done (0 left) 2024-03-30T12:32:53.630 INFO:tasks.rados.rados.0.smithi084.stdout:3083: snap_create 2024-03-30T12:32:53.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:53.591+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:53.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:53.636+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:53.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:53.637+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:53.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:53.438+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:53.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:53.438+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:53.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:53.637+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:53.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:53.638+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:53.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:53.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:53.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:53.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:53 smithi162 ceph-mon[83709]: osdmap e680: 8 total, 8 up, 8 in 2024-03-30T12:32:53.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:53.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:53.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:53.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:53.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:53.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:53 smithi162 ceph-mon[83709]: pgmap v709: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 881 MiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 637 KiB/s rd, 3.0 MiB/s wr, 6 op/s 2024-03-30T12:32:53.872 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:53.592+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:53.872 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:53.592+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:53.872 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:53.686+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:53.872 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:53.686+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:53.872 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:53.687+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:53.955 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:53.956 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:53.956 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:53.956 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-mon[91810]: osdmap e680: 8 total, 8 up, 8 in 2024-03-30T12:32:53.956 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:53.956 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:53.956 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:53.956 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:53.956 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:53.956 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-mon[91810]: pgmap v709: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 881 MiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 637 KiB/s rd, 3.0 MiB/s wr, 6 op/s 2024-03-30T12:32:53.957 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:53.957 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:53.957 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:53.957 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-mon[89279]: osdmap e680: 8 total, 8 up, 8 in 2024-03-30T12:32:53.957 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:53.957 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:53.957 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:53.957 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:53.957 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:53.957 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-mon[89279]: pgmap v709: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 881 MiB data, 7.7 GiB used, 707 GiB / 715 GiB avail; 637 KiB/s rd, 3.0 MiB/s wr, 6 op/s 2024-03-30T12:32:53.957 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:53.635+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:53.957 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:53.635+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:53.958 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:53.635+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:53.958 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:53.635+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:53.958 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:53.636+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:53.958 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:53.636+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:54.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:53.963+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:54.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:53.963+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:54.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:53.962+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:54.630 INFO:tasks.rados.rados.0.smithi084.stdout:3083: done (0 left) 2024-03-30T12:32:54.630 INFO:tasks.rados.rados.0.smithi084.stdout:3084: copy_from oid 13 from oid 23 current snap is 305 2024-03-30T12:32:54.630 INFO:tasks.rados.rados.0.smithi084.stdout:3085: delete oid 7 current snap is 305 2024-03-30T12:32:54.639 INFO:tasks.rados.rados.0.smithi084.stdout:3085: done (1 left) 2024-03-30T12:32:54.639 INFO:tasks.rados.rados.0.smithi084.stdout:3086: snap_create 2024-03-30T12:32:54.684 INFO:tasks.rados.rados.0.smithi084.stdout:3084: finishing copy_from racing read to smithi08477944-13 2024-03-30T12:32:54.691 INFO:tasks.rados.rados.0.smithi084.stdout:3084: finishing copy_from to smithi08477944-13 2024-03-30T12:32:54.691 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 23421 (ObjNum 946 snap 301 seq_num 946) dirty exists 2024-03-30T12:32:55.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:54.646+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:55.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:54.653+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:55.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:54.645+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:55.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:54.646+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:55.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:54.646+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:55.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:54.646+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:55.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:54.646+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:55.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:55.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:55.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:55.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:55.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:55.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:55.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:55.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:55.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:55.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:55.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:55.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:55.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[91810]: osdmap e681: 8 total, 8 up, 8 in 2024-03-30T12:32:55.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:55.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:55.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:55.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:55.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:55.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:55.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:55.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:55.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:55.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:55.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:55.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:55.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[89279]: osdmap e681: 8 total, 8 up, 8 in 2024-03-30T12:32:55.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:55.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:55.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:55.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:55.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:55.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:55.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:54.683+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:55.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:54.639+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:55.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:54.639+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:55.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:54.637+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:55.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:54.638+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:55.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:54.638+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:55.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:54.642+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:55.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:54.642+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:55.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:55.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:55.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:55.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:55.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:55.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:55.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:55.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:55.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:55.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:55.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:55.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:55.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:54 smithi162 ceph-mon[83709]: osdmap e681: 8 total, 8 up, 8 in 2024-03-30T12:32:55.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:55.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:55.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:55.645 INFO:tasks.rados.rados.0.smithi084.stdout:3084: done (1 left) 2024-03-30T12:32:55.646 INFO:tasks.rados.rados.0.smithi084.stdout:3086: done (0 left) 2024-03-30T12:32:55.646 INFO:tasks.rados.rados.0.smithi084.stdout:3087: snap_create 2024-03-30T12:32:56.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:55.650+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:56.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:55.650+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:56.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:55.651+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:56.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:55.651+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:56.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:55.651+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:56.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:55.651+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:56.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:56.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:56.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[91810]: osdmap e682: 8 total, 8 up, 8 in 2024-03-30T12:32:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:56.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:56.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:56.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:56.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:56.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[89279]: osdmap e682: 8 total, 8 up, 8 in 2024-03-30T12:32:56.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:56.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:56.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:56.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:56.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:56.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:56.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:56.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:56.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:56.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:56.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:56.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:56.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:56.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[91810]: pgmap v712: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 893 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 12 op/s 2024-03-30T12:32:56.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:56.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:55 smithi084 ceph-mon[89279]: pgmap v712: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 893 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 12 op/s 2024-03-30T12:32:56.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:55.652+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:56.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:55.652+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:56.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:55.650+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:56.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:55.650+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:56.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:56.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:55 smithi162 ceph-mon[83709]: osdmap e682: 8 total, 8 up, 8 in 2024-03-30T12:32:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:56.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:56.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:56.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:55 smithi162 ceph-mon[83709]: pgmap v712: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 893 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 12 op/s 2024-03-30T12:32:56.644 INFO:tasks.rados.rados.0.smithi084.stdout:3087: done (0 left) 2024-03-30T12:32:56.644 INFO:tasks.rados.rados.0.smithi084.stdout:3088: snap_create 2024-03-30T12:32:56.903 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:56.903 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:56.903 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:56.903 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:56.903 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:56.903 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:56.903 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:56.904 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:56.904 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:56 smithi084 ceph-mon[91810]: osdmap e683: 8 total, 8 up, 8 in 2024-03-30T12:32:56.904 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:56.650+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:56.904 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:56.650+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:56.904 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:56.650+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:56.904 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:56.651+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:56.904 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:56.651+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:56.904 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:56.905 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:56.905 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:56.905 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:56.905 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:56.905 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:56.905 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:56.905 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:56.905 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:56 smithi084 ceph-mon[89279]: osdmap e683: 8 total, 8 up, 8 in 2024-03-30T12:32:56.988 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:56.652+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:56.988 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:56.653+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:56.989 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:56.651+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:56.989 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:56.652+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:56.989 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:56.652+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:56.989 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:56.718+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:56.989 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:56.718+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:56.989 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:56.718+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:56.989 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:56.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:56.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:56.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:56.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:56.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:56.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:56.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:56.990 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:56 smithi162 ceph-mon[83709]: osdmap e683: 8 total, 8 up, 8 in 2024-03-30T12:32:57.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:56.910+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:57.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:56.910+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:57.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:56.996+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:57.655 INFO:tasks.rados.rados.0.smithi084.stdout:3088: done (0 left) 2024-03-30T12:32:57.655 INFO:tasks.rados.rados.0.smithi084.stdout:3089: snap_create 2024-03-30T12:32:58.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:57.828+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:58.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:57.828+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:58.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:57.660+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:58.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:57.660+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:58.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:57.660+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:58.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:57.661+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:58.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:57.661+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:58.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:57.661+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:58.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:58.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:58.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:58.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:58.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:58.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-mon[89279]: osdmap e684: 8 total, 8 up, 8 in 2024-03-30T12:32:58.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:58.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:58.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:58.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:58.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:58.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-mon[89279]: pgmap v715: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 902 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 8.8 MiB/s rd, 5.4 MiB/s wr, 11 op/s 2024-03-30T12:32:58.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:58.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:58.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:58.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:58.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:58.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-mon[91810]: osdmap e684: 8 total, 8 up, 8 in 2024-03-30T12:32:58.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:58.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:58.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:58.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:58.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:58.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:57 smithi084 ceph-mon[91810]: pgmap v715: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 902 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 8.8 MiB/s rd, 5.4 MiB/s wr, 11 op/s 2024-03-30T12:32:58.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:57.662+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:58.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:57.662+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:58.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:58.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:58.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:58.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:58.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:58.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:57 smithi162 ceph-mon[83709]: osdmap e684: 8 total, 8 up, 8 in 2024-03-30T12:32:58.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:58.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:58.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:58.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:58.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:58.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:57 smithi162 ceph-mon[83709]: pgmap v715: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 902 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 8.8 MiB/s rd, 5.4 MiB/s wr, 11 op/s 2024-03-30T12:32:58.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:58.347+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:58.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:58.348+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:58.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:58.348+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:58.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:58.347+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:58.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:58.348+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:58.656 INFO:tasks.rados.rados.0.smithi084.stdout:3089: done (0 left) 2024-03-30T12:32:58.656 INFO:tasks.rados.rados.0.smithi084.stdout:3090: read oid 3 snap 307 2024-03-30T12:32:58.656 INFO:tasks.rados.rados.0.smithi084.stdout:3090: expect deleted 2024-03-30T12:32:58.656 INFO:tasks.rados.rados.0.smithi084.stdout:3091: delete oid 41 current snap is 309 2024-03-30T12:32:58.660 INFO:tasks.rados.rados.0.smithi084.stdout:3091: done (1 left) 2024-03-30T12:32:58.660 INFO:tasks.rados.rados.0.smithi084.stdout:3092: snap_remove snap 306 2024-03-30T12:32:59.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:58.892+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:59.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:58.892+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:59.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:58.662+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:59.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:58.662+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:59.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:58.662+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:59.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:58.662+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:32:59.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:58.663+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:59.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:59.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:59.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:59.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:59.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:59.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:59.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:59.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:59.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:59.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-mon[89279]: osdmap e685: 8 total, 8 up, 8 in 2024-03-30T12:32:59.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:59.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:59.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:59.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:59.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:59.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:59.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:59.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:59.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:59.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:59.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:59.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-mon[91810]: osdmap e685: 8 total, 8 up, 8 in 2024-03-30T12:32:59.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:59.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:59.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:32:58.890+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:59.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:58.664+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:59.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:58.664+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:59.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:58.669+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:32:59.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:58.669+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:32:59.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:58.670+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:32:59.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:58.663+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:32:59.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:58.663+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:59.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:58.663+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:59.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:32:59.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:32:59.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:32:59.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:32:59.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:32:59.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:32:59.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:32:59.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:32:59.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:32:59.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-mon[83709]: osdmap e685: 8 total, 8 up, 8 in 2024-03-30T12:32:59.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:32:59.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:32:59.663 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:32:59] "GET /metrics HTTP/1.1" 200 36333 "" "Prometheus/2.43.0" 2024-03-30T12:32:59.669 INFO:tasks.rados.rados.0.smithi084.stdout:3092: done (1 left) 2024-03-30T12:32:59.669 INFO:tasks.rados.rados.0.smithi084.stdout:3093: copy_from oid 36 from oid 33 current snap is 309 2024-03-30T12:32:59.669 INFO:tasks.rados.rados.0.smithi084.stdout:3090: done (1 left) 2024-03-30T12:32:59.669 INFO:tasks.rados.rados.0.smithi084.stdout:3094: delete oid 25 current snap is 309 2024-03-30T12:32:59.672 INFO:tasks.rados.rados.0.smithi084.stdout:3094: done (1 left) 2024-03-30T12:32:59.672 INFO:tasks.rados.rados.0.smithi084.stdout:3095: rmattr oid 47 current snap is 309 2024-03-30T12:32:59.672 INFO:tasks.rados.rados.0.smithi084.stdout:3096: read oid 40 snap -1 2024-03-30T12:32:59.672 INFO:tasks.rados.rados.0.smithi084.stdout:3096: expect deleted 2024-03-30T12:32:59.672 INFO:tasks.rados.rados.0.smithi084.stdout:3097: snap_create 2024-03-30T12:32:59.681 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 27293 (ObjNum 936 snap 295 seq_num 936) dirty exists 2024-03-30T12:32:59.685 INFO:tasks.rados.rados.0.smithi084.stdout:3093: finishing copy_from racing read to smithi08477944-36 2024-03-30T12:32:59.685 INFO:tasks.rados.rados.0.smithi084.stdout:3093: finishing copy_from to smithi08477944-36 2024-03-30T12:32:59.686 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 27292 (ObjNum 905 snap 287 seq_num 905) dirty exists 2024-03-30T12:33:00.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:59.681+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:00.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:32:59.681+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:00.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:59.674+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:00.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:59.674+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:00.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:59.675+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:00.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:59.675+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:00.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:59.675+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:00.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:32:59.675+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:00.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:00.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:00.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:00.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:00.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:00.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:00.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:00.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:00.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:00.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:00.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:00.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[89279]: osdmap e686: 8 total, 8 up, 8 in 2024-03-30T12:33:00.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:00.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:00.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:00.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:00.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:00.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:00.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:00.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:00.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:00.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:00.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:00.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:00.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:00.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:00.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[91810]: osdmap e686: 8 total, 8 up, 8 in 2024-03-30T12:33:00.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:00.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:00.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:00.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:00.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[89279]: pgmap v718: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 902 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 7.3 MiB/s rd, 2.3 MiB/s wr, 3 op/s 2024-03-30T12:33:00.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:00.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:00.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[91810]: pgmap v718: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 902 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 7.3 MiB/s rd, 2.3 MiB/s wr, 3 op/s 2024-03-30T12:33:00.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:32:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:00.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:59.675+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:00.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:32:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:32:59.676+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:00.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:59.675+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:00.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:32:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:32:59.677+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:00.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:59.682+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:00.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:32:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:32:59.682+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:00.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:00.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:00.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:00.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:00.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:00.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:00.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:00.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:00.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:00.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:00.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:00.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:59 smithi162 ceph-mon[83709]: osdmap e686: 8 total, 8 up, 8 in 2024-03-30T12:33:00.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:00.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:00.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:00.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:00.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:59 smithi162 ceph-mon[83709]: pgmap v718: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 902 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 7.3 MiB/s rd, 2.3 MiB/s wr, 3 op/s 2024-03-30T12:33:00.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:32:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:00.668 INFO:tasks.rados.rados.0.smithi084.stdout:3093: done (3 left) 2024-03-30T12:33:00.668 INFO:tasks.rados.rados.0.smithi084.stdout:3095: done (2 left) 2024-03-30T12:33:00.668 INFO:tasks.rados.rados.0.smithi084.stdout:3096: done (1 left) 2024-03-30T12:33:00.668 INFO:tasks.rados.rados.0.smithi084.stdout:3097: done (0 left) 2024-03-30T12:33:00.668 INFO:tasks.rados.rados.0.smithi084.stdout:3098: snap_remove snap 308 2024-03-30T12:33:01.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:00.674+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:01.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:00.674+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:01.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:00.675+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:01.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:00.675+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:01.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:00.675+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:01.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:01.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:01.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:01.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:01.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:01.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:01.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:01.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:01.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:01.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:01.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[91810]: osdmap e687: 8 total, 8 up, 8 in 2024-03-30T12:33:01.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:01.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:01.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:01.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:01.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:33:01.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:01.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:01.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:01.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:01.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:01.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:01.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:01.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:01.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:01.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:01.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[89279]: osdmap e687: 8 total, 8 up, 8 in 2024-03-30T12:33:01.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:01.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:01.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:01.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:01.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:00 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:33:01.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:00.676+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:01.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:00.677+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:01.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:00.676+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:01.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:00.676+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:01.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:00.676+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:01.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:01.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:01.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:01.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:01.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:01.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:01.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:01.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:01.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:01.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:01.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:00 smithi162 ceph-mon[83709]: osdmap e687: 8 total, 8 up, 8 in 2024-03-30T12:33:01.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:01.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:01.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:01.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:01.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:00 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:33:01.682 INFO:tasks.rados.rados.0.smithi084.stdout:3098: done (0 left) 2024-03-30T12:33:01.682 INFO:tasks.rados.rados.0.smithi084.stdout:3099: snap_create 2024-03-30T12:33:01.869 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:01.837+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:01.869 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:01.837+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:01.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:01.687+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:01.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:01.687+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:01.870 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:01.597+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:01.870 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:01.600+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:01.870 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:01.836+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:01.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:01.741+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:01.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:01.741+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:01.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:01.742+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:01.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:01 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:01.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:01.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:01 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:01.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:01 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:01.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:01 smithi162 ceph-mon[83709]: osdmap e688: 8 total, 8 up, 8 in 2024-03-30T12:33:01.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:01.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:01.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:01.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:01.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:01 smithi162 ceph-mon[83709]: pgmap v721: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 902 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail 2024-03-30T12:33:02.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:01.838+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:02.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:01.838+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:02.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:01.688+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:02.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:01.688+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:02.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:01.690+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:02.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:01.690+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:02.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:01.690+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:02.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:01.691+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:02.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:02.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:02.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:02.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:02.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-mon[91810]: osdmap e688: 8 total, 8 up, 8 in 2024-03-30T12:33:02.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:02.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:02.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:02.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:02.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-mon[91810]: pgmap v721: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 902 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail 2024-03-30T12:33:02.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:02.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:02.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:02.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:02.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-mon[89279]: osdmap e688: 8 total, 8 up, 8 in 2024-03-30T12:33:02.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:02.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:02.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:02.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:02.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:01 smithi084 ceph-mon[89279]: pgmap v721: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 902 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail 2024-03-30T12:33:02.683 INFO:tasks.rados.rados.0.smithi084.stdout:3099: done (0 left) 2024-03-30T12:33:02.683 INFO:tasks.rados.rados.0.smithi084.stdout:3100: read oid 23 snap -1 2024-03-30T12:33:02.683 INFO:tasks.rados.rados.0.smithi084.stdout:3100: expect (ObjNum 946 snap 301 seq_num 946) 2024-03-30T12:33:02.683 INFO:tasks.rados.rados.0.smithi084.stdout:3101: rmattr oid 10 current snap is 311 2024-03-30T12:33:02.683 INFO:tasks.rados.rados.0.smithi084.stdout:3101: done (1 left) 2024-03-30T12:33:02.683 INFO:tasks.rados.rados.0.smithi084.stdout:3102: copy_from oid 34 from oid 27 current snap is 311 2024-03-30T12:33:02.683 INFO:tasks.rados.rados.0.smithi084.stdout:3103: read oid 28 snap -1 2024-03-30T12:33:02.683 INFO:tasks.rados.rados.0.smithi084.stdout:3103: expect deleted 2024-03-30T12:33:02.684 INFO:tasks.rados.rados.0.smithi084.stdout:3104: snap_create 2024-03-30T12:33:02.694 INFO:tasks.rados.rados.0.smithi084.stdout:3102: finishing copy_from racing read to smithi08477944-34 2024-03-30T12:33:02.696 INFO:tasks.rados.rados.0.smithi084.stdout:3102: finishing copy_from to smithi08477944-34 2024-03-30T12:33:02.697 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 27235 (ObjNum 955 snap 303 seq_num 955) dirty exists 2024-03-30T12:33:02.712 INFO:tasks.rados.rados.0.smithi084.stdout:3100: expect (ObjNum 946 snap 301 seq_num 946) 2024-03-30T12:33:03.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:02.695+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:03.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:02.699+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:03.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:02.688+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:03.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:02.689+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:03.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:02.689+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:03.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:02.689+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:03.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:02.689+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:03.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[91810]: osdmap e689: 8 total, 8 up, 8 in 2024-03-30T12:33:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:03.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:03.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:03.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:03.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:03.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:03.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[89279]: osdmap e689: 8 total, 8 up, 8 in 2024-03-30T12:33:03.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:03.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:03.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:03.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:03.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:03.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:03.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:03.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:03.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:02.697+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:03.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:02.690+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:03.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:02.690+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:03.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:02.691+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:03.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:02.690+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:03.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:02.691+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:03.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:03.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:03.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:03.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:03.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:03.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:02 smithi162 ceph-mon[83709]: osdmap e689: 8 total, 8 up, 8 in 2024-03-30T12:33:03.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:03.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:03.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:03.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:03.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:03.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:03.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:03.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:03.122 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:02.936+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:03.122 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:02.936+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:3100: done (3 left) 2024-03-30T12:33:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:3102: done (2 left) 2024-03-30T12:33:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:3103: done (1 left) 2024-03-30T12:33:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:3104: done (0 left) 2024-03-30T12:33:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:3105: rollback oid 45 current snap is 312 2024-03-30T12:33:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 45 to 311 2024-03-30T12:33:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 46 current snap is 312 2024-03-30T12:33:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:3106: seq_num 961 ranges {3850240=499712,4349952=712704,5062656=491520} 2024-03-30T12:33:03.718 INFO:tasks.rados.rados.0.smithi084.stdout:3106: writing smithi08477944-46 from 3850240 to 4349952 tid 1 2024-03-30T12:33:03.722 INFO:tasks.rados.rados.0.smithi084.stdout:3106: writing smithi08477944-46 from 4349952 to 5062656 tid 2 2024-03-30T12:33:03.726 INFO:tasks.rados.rados.0.smithi084.stdout:3106: writing smithi08477944-46 from 5062656 to 5554176 tid 3 2024-03-30T12:33:03.726 INFO:tasks.rados.rados.0.smithi084.stdout:3107: rollback oid 12 current snap is 312 2024-03-30T12:33:03.726 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 12 to 298 2024-03-30T12:33:03.726 INFO:tasks.rados.rados.0.smithi084.stdout:3105: finishing rollback tid 0 to smithi08477944-45 2024-03-30T12:33:03.726 INFO:tasks.rados.rados.0.smithi084.stdout:3105: finishing rollback tid 1 to smithi08477944-45 2024-03-30T12:33:03.726 INFO:tasks.rados.rados.0.smithi084.stdout:3105: finishing rollback tid 2 to smithi08477944-45 2024-03-30T12:33:03.727 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 27294 (ObjNum 909 snap 288 seq_num 909) dirty exists 2024-03-30T12:33:03.727 INFO:tasks.rados.rados.0.smithi084.stdout:3105: done (2 left) 2024-03-30T12:33:03.727 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 312 2024-03-30T12:33:03.727 INFO:tasks.rados.rados.0.smithi084.stdout:3108: seq_num 962 ranges {0=516096,516096=589824,1105920=614400} 2024-03-30T12:33:03.728 INFO:tasks.rados.rados.0.smithi084.stdout:3108: writing smithi08477944-38 from 0 to 516096 tid 1 2024-03-30T12:33:03.732 INFO:tasks.rados.rados.0.smithi084.stdout:3108: writing smithi08477944-38 from 516096 to 1105920 tid 2 2024-03-30T12:33:03.736 INFO:tasks.rados.rados.0.smithi084.stdout:3108: writing smithi08477944-38 from 1105920 to 1720320 tid 3 2024-03-30T12:33:03.736 INFO:tasks.rados.rados.0.smithi084.stdout:3109: snap_create 2024-03-30T12:33:03.736 INFO:tasks.rados.rados.0.smithi084.stdout:3106: finishing write tid 1 to smithi08477944-46 2024-03-30T12:33:03.736 INFO:tasks.rados.rados.0.smithi084.stdout:3107: finishing rollback tid 1 to smithi08477944-12 2024-03-30T12:33:03.736 INFO:tasks.rados.rados.0.smithi084.stdout:3108: finishing write tid 1 to smithi08477944-38 2024-03-30T12:33:03.736 INFO:tasks.rados.rados.0.smithi084.stdout:3107: finishing rollback tid 2 to smithi08477944-12 2024-03-30T12:33:03.736 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 27238 (ObjNum 883 snap 282 seq_num 883) dirty exists 2024-03-30T12:33:03.736 INFO:tasks.rados.rados.0.smithi084.stdout:3106: finishing write tid 2 to smithi08477944-46 2024-03-30T12:33:03.736 INFO:tasks.rados.rados.0.smithi084.stdout:3108: finishing write tid 2 to smithi08477944-38 2024-03-30T12:33:03.739 INFO:tasks.rados.rados.0.smithi084.stdout:3106: finishing write tid 3 to smithi08477944-46 2024-03-30T12:33:03.739 INFO:tasks.rados.rados.0.smithi084.stdout:3108: finishing write tid 3 to smithi08477944-38 2024-03-30T12:33:03.739 INFO:tasks.rados.rados.0.smithi084.stdout:3106: finishing write tid 4 to smithi08477944-46 2024-03-30T12:33:03.739 INFO:tasks.rados.rados.0.smithi084.stdout:3108: finishing write tid 4 to smithi08477944-38 2024-03-30T12:33:03.741 INFO:tasks.rados.rados.0.smithi084.stdout:3108: finishing write tid 5 to smithi08477944-38 2024-03-30T12:33:03.742 INFO:tasks.rados.rados.0.smithi084.stdout:3108: oid 38 updating version 0 to 27285 2024-03-30T12:33:03.742 INFO:tasks.rados.rados.0.smithi084.stdout:3108: oid 38 updating version 27285 to 27287 2024-03-30T12:33:03.742 INFO:tasks.rados.rados.0.smithi084.stdout:3108: oid 38 version 27287 is already newer than 27284 2024-03-30T12:33:03.742 INFO:tasks.rados.rados.0.smithi084.stdout:3108: oid 38 version 27287 is already newer than 27286 2024-03-30T12:33:03.742 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 27287 (ObjNum 962 snap 312 seq_num 962) dirty exists 2024-03-30T12:33:03.742 INFO:tasks.rados.rados.0.smithi084.stdout:3108: left oid 38 (ObjNum 962 snap 312 seq_num 962) 2024-03-30T12:33:03.743 INFO:tasks.rados.rados.0.smithi084.stdout:3106: finishing write tid 5 to smithi08477944-46 2024-03-30T12:33:03.743 INFO:tasks.rados.rados.0.smithi084.stdout:3106: oid 46 updating version 0 to 27362 2024-03-30T12:33:03.743 INFO:tasks.rados.rados.0.smithi084.stdout:3106: oid 46 updating version 27362 to 27365 2024-03-30T12:33:03.744 INFO:tasks.rados.rados.0.smithi084.stdout:3106: oid 46 version 27365 is already newer than 27363 2024-03-30T12:33:03.744 INFO:tasks.rados.rados.0.smithi084.stdout:3106: oid 46 version 27365 is already newer than 27364 2024-03-30T12:33:03.744 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 27365 (ObjNum 961 snap 312 seq_num 961) dirty exists 2024-03-30T12:33:03.744 INFO:tasks.rados.rados.0.smithi084.stdout:3106: left oid 46 (ObjNum 961 snap 312 seq_num 961) 2024-03-30T12:33:04.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:03.701+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:04.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:03.702+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:04.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:03.702+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:04.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:03.702+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:04.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:03.702+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:04.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:03.702+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:04.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:03.702+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:04.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:03.702+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:04.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:04.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:04.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:04.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:04.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:04.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:04.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[91810]: osdmap e690: 8 total, 8 up, 8 in 2024-03-30T12:33:04.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:04.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:04.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:04.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:04.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:04.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:04.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:04.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[91810]: pgmap v724: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 903 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 0 B/s rd, 186 KiB/s wr, 0 op/s 2024-03-30T12:33:04.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:04.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:04.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:04.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:04.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:04.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:04.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:04.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:04.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[89279]: osdmap e690: 8 total, 8 up, 8 in 2024-03-30T12:33:04.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:04.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:04.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:04.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:04.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:04.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:04.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:04.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[89279]: pgmap v724: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 903 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 0 B/s rd, 186 KiB/s wr, 0 op/s 2024-03-30T12:33:04.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:04.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:04.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:03.737+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:04.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:03.706+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:04.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:03.707+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:04.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:03.703+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:04.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:03.703+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:04.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:03.708+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:04.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:03.708+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:04.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:03.708+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:04.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:04.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:04.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:04.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:04.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:04.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:04.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:03 smithi162 ceph-mon[83709]: osdmap e690: 8 total, 8 up, 8 in 2024-03-30T12:33:04.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:04.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:04.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:04.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:04.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:04.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:04.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:04.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:03 smithi162 ceph-mon[83709]: pgmap v724: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 903 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 0 B/s rd, 186 KiB/s wr, 0 op/s 2024-03-30T12:33:04.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:04.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:04.700 INFO:tasks.rados.rados.0.smithi084.stdout:3106: done (3 left) 2024-03-30T12:33:04.700 INFO:tasks.rados.rados.0.smithi084.stdout:3107: done (2 left) 2024-03-30T12:33:04.700 INFO:tasks.rados.rados.0.smithi084.stdout:3108: done (1 left) 2024-03-30T12:33:04.700 INFO:tasks.rados.rados.0.smithi084.stdout:3109: done (0 left) 2024-03-30T12:33:04.700 INFO:tasks.rados.rados.0.smithi084.stdout:3110: delete oid 49 current snap is 313 2024-03-30T12:33:04.704 INFO:tasks.rados.rados.0.smithi084.stdout:3110: done (0 left) 2024-03-30T12:33:04.705 INFO:tasks.rados.rados.0.smithi084.stdout:3111: snap_remove snap 304 2024-03-30T12:33:05.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:04.711+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:05.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:04.712+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:05.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:04.707+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:05.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:04.707+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:05.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:04.707+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:05.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:04.707+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:05.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:04.707+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:05.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:05.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:05.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:05.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:05.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[89279]: osdmap e691: 8 total, 8 up, 8 in 2024-03-30T12:33:05.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:05.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:05.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:05.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:05.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:05.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:05.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:05.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:05.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:05.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:05.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:05.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:05.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:05.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[91810]: osdmap e691: 8 total, 8 up, 8 in 2024-03-30T12:33:05.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:05.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:05.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:05.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:05.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:05.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:05.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:05.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:05.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:05.089 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:04.708+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:05.089 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:04.708+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:05.089 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:04.708+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:05.089 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:04.708+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:05.089 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:04.709+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:05.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:05.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:05.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:05.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:05.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:04 smithi162 ceph-mon[83709]: osdmap e691: 8 total, 8 up, 8 in 2024-03-30T12:33:05.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:05.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:05.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:05.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:05.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:05.090 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:05.091 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:05.091 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:05.091 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:05.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:05.096+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:05.711 INFO:tasks.rados.rados.0.smithi084.stdout:3111: done (0 left) 2024-03-30T12:33:05.711 INFO:tasks.rados.rados.0.smithi084.stdout:3112: rollback oid 20 current snap is 313 2024-03-30T12:33:05.711 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 20 to 312 2024-03-30T12:33:05.712 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 313 2024-03-30T12:33:05.712 INFO:tasks.rados.rados.0.smithi084.stdout:3113: seq_num 964 ranges {1064960=548864,1613824=761856,2375680=442368} 2024-03-30T12:33:05.720 INFO:tasks.rados.rados.0.smithi084.stdout:3113: writing smithi08477944-10 from 1064960 to 1613824 tid 1 2024-03-30T12:33:05.725 INFO:tasks.rados.rados.0.smithi084.stdout:3113: writing smithi08477944-10 from 1613824 to 2375680 tid 2 2024-03-30T12:33:05.728 INFO:tasks.rados.rados.0.smithi084.stdout:3113: writing smithi08477944-10 from 2375680 to 2818048 tid 3 2024-03-30T12:33:05.728 INFO:tasks.rados.rados.0.smithi084.stdout:3114: copy_from oid 24 from oid 49 current snap is 313 2024-03-30T12:33:05.728 INFO:tasks.rados.rados.0.smithi084.stdout:3112: finishing rollback tid 1 to smithi08477944-20 2024-03-30T12:33:05.728 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 17550 (ObjNum 1532996832 snap 32516 seq_num 304) dirty dne 2024-03-30T12:33:05.728 INFO:tasks.rados.rados.0.smithi084.stdout:3112: done (2 left) 2024-03-30T12:33:05.728 INFO:tasks.rados.rados.0.smithi084.stdout:3115: rollback oid 22 current snap is 313 2024-03-30T12:33:05.728 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 22 to 299 2024-03-30T12:33:05.728 INFO:tasks.rados.rados.0.smithi084.stdout:3116: snap_remove snap 310 2024-03-30T12:33:06.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:05.726+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:06.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:05.728+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:06.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:06.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:06.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:06.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:06.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-mon[89279]: osdmap e692: 8 total, 8 up, 8 in 2024-03-30T12:33:06.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:06.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:06.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:06.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:06.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:06.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:06.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-mon[89279]: pgmap v727: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 905 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 0 B/s rd, 578 KiB/s wr, 5 op/s 2024-03-30T12:33:06.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:05.722+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:06.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:05.722+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:06.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:05.722+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:06.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:05.722+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:06.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:05.724+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:06.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:05.724+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:06.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:06.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:06.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:06.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:06.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-mon[91810]: osdmap e692: 8 total, 8 up, 8 in 2024-03-30T12:33:06.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:06.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:06.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:06.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:06.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:06.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:06.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:05 smithi084 ceph-mon[91810]: pgmap v727: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 905 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 0 B/s rd, 578 KiB/s wr, 5 op/s 2024-03-30T12:33:06.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:05.737+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:06.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:05.715+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:06.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:05.716+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:06.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:05.718+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:06.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:05.718+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:06.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:05.745+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:06.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:05.745+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:06.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:06.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:06.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:06.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:06.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:05 smithi162 ceph-mon[83709]: osdmap e692: 8 total, 8 up, 8 in 2024-03-30T12:33:06.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:06.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:06.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:06.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:06.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:06.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:06.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:05 smithi162 ceph-mon[83709]: pgmap v727: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 905 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 0 B/s rd, 578 KiB/s wr, 5 op/s 2024-03-30T12:33:06.710 INFO:tasks.rados.rados.0.smithi084.stdout:3116: done (3 left) 2024-03-30T12:33:06.710 INFO:tasks.rados.rados.0.smithi084.stdout:3117: delete oid 30 current snap is 313 2024-03-30T12:33:06.710 INFO:tasks.rados.rados.0.smithi084.stdout:3114: finishing copy_from to smithi08477944-24 2024-03-30T12:33:06.710 INFO:tasks.rados.rados.0.smithi084.stdout:3114: got expected ENOENT (src dne) 2024-03-30T12:33:06.710 INFO:tasks.rados.rados.0.smithi084.stdout:3114: finishing copy_from racing read to smithi08477944-24 2024-03-30T12:33:06.711 INFO:tasks.rados.rados.0.smithi084.stdout:3115: finishing rollback tid 0 to smithi08477944-22 2024-03-30T12:33:06.711 INFO:tasks.rados.rados.0.smithi084.stdout:3115: finishing rollback tid 1 to smithi08477944-22 2024-03-30T12:33:06.711 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 27368 (ObjNum 0 snap 0 seq_num 304) dirty dne 2024-03-30T12:33:06.711 INFO:tasks.rados.rados.0.smithi084.stdout:3113: finishing write tid 1 to smithi08477944-10 2024-03-30T12:33:06.711 INFO:tasks.rados.rados.0.smithi084.stdout:3113: finishing write tid 2 to smithi08477944-10 2024-03-30T12:33:06.711 INFO:tasks.rados.rados.0.smithi084.stdout:3113: finishing write tid 3 to smithi08477944-10 2024-03-30T12:33:06.711 INFO:tasks.rados.rados.0.smithi084.stdout:3113: finishing write tid 4 to smithi08477944-10 2024-03-30T12:33:06.711 INFO:tasks.rados.rados.0.smithi084.stdout:3113: finishing write tid 5 to smithi08477944-10 2024-03-30T12:33:06.711 INFO:tasks.rados.rados.0.smithi084.stdout:3113: oid 10 updating version 0 to 36281 2024-03-30T12:33:06.711 INFO:tasks.rados.rados.0.smithi084.stdout:3113: oid 10 version 36281 is already newer than 36280 2024-03-30T12:33:06.711 INFO:tasks.rados.rados.0.smithi084.stdout:3113: oid 10 updating version 36281 to 36282 2024-03-30T12:33:06.711 INFO:tasks.rados.rados.0.smithi084.stdout:3113: oid 10 updating version 36282 to 36283 2024-03-30T12:33:06.711 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 36283 (ObjNum 964 snap 313 seq_num 964) dirty exists 2024-03-30T12:33:06.711 INFO:tasks.rados.rados.0.smithi084.stdout:3113: left oid 10 (ObjNum 964 snap 313 seq_num 964) 2024-03-30T12:33:06.714 INFO:tasks.rados.rados.0.smithi084.stdout:3113: done (3 left) 2024-03-30T12:33:06.714 INFO:tasks.rados.rados.0.smithi084.stdout:3114: done (2 left) 2024-03-30T12:33:06.714 INFO:tasks.rados.rados.0.smithi084.stdout:3115: done (1 left) 2024-03-30T12:33:06.714 INFO:tasks.rados.rados.0.smithi084.stdout:3117: done (0 left) 2024-03-30T12:33:06.714 INFO:tasks.rados.rados.0.smithi084.stdout:3118: read oid 27 snap -1 2024-03-30T12:33:06.714 INFO:tasks.rados.rados.0.smithi084.stdout:3118: expect (ObjNum 955 snap 303 seq_num 955) 2024-03-30T12:33:06.714 INFO:tasks.rados.rados.0.smithi084.stdout:3119: copy_from oid 25 from oid 17 current snap is 313 2024-03-30T12:33:06.714 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 313 2024-03-30T12:33:06.714 INFO:tasks.rados.rados.0.smithi084.stdout:3120: seq_num 966 ranges {2187264=581632,2768896=581632,3350528=622592} 2024-03-30T12:33:06.729 INFO:tasks.rados.rados.0.smithi084.stdout:3120: writing smithi08477944-19 from 2187264 to 2768896 tid 1 2024-03-30T12:33:06.733 INFO:tasks.rados.rados.0.smithi084.stdout:3120: writing smithi08477944-19 from 2768896 to 3350528 tid 2 2024-03-30T12:33:06.736 INFO:tasks.rados.rados.0.smithi084.stdout:3120: writing smithi08477944-19 from 3350528 to 3973120 tid 3 2024-03-30T12:33:06.737 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 42 current snap is 313 2024-03-30T12:33:06.737 INFO:tasks.rados.rados.0.smithi084.stdout:3121: seq_num 967 ranges {3383296=598016,3981312=466944,4448256=516096,4964352=221184} 2024-03-30T12:33:06.758 INFO:tasks.rados.rados.0.smithi084.stdout:3121: writing smithi08477944-42 from 3383296 to 3981312 tid 1 2024-03-30T12:33:06.761 INFO:tasks.rados.rados.0.smithi084.stdout:3121: writing smithi08477944-42 from 3981312 to 4448256 tid 2 2024-03-30T12:33:06.764 INFO:tasks.rados.rados.0.smithi084.stdout:3121: writing smithi08477944-42 from 4448256 to 4964352 tid 3 2024-03-30T12:33:06.766 INFO:tasks.rados.rados.0.smithi084.stdout:3121: writing smithi08477944-42 from 4964352 to 5185536 tid 4 2024-03-30T12:33:06.766 INFO:tasks.rados.rados.0.smithi084.stdout:3122: rollback oid 10 current snap is 313 2024-03-30T12:33:06.766 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 10 to 305 2024-03-30T12:33:06.766 INFO:tasks.rados.rados.0.smithi084.stdout:3118: expect (ObjNum 955 snap 303 seq_num 955) 2024-03-30T12:33:06.815 INFO:tasks.rados.rados.0.smithi084.stdout:3119: finishing copy_from to smithi08477944-25 2024-03-30T12:33:06.815 INFO:tasks.rados.rados.0.smithi084.stdout:3119: got expected ENOENT (src dne) 2024-03-30T12:33:06.815 INFO:tasks.rados.rados.0.smithi084.stdout:3119: finishing copy_from racing read to smithi08477944-25 2024-03-30T12:33:06.816 INFO:tasks.rados.rados.0.smithi084.stdout:3120: finishing write tid 1 to smithi08477944-19 2024-03-30T12:33:06.816 INFO:tasks.rados.rados.0.smithi084.stdout:3120: finishing write tid 2 to smithi08477944-19 2024-03-30T12:33:06.816 INFO:tasks.rados.rados.0.smithi084.stdout:3120: finishing write tid 3 to smithi08477944-19 2024-03-30T12:33:06.816 INFO:tasks.rados.rados.0.smithi084.stdout:3118: done (4 left) 2024-03-30T12:33:06.816 INFO:tasks.rados.rados.0.smithi084.stdout:3119: done (3 left) 2024-03-30T12:33:06.816 INFO:tasks.rados.rados.0.smithi084.stdout:3123: read oid 47 snap -1 2024-03-30T12:33:06.816 INFO:tasks.rados.rados.0.smithi084.stdout:3123: expect (ObjNum 936 snap 295 seq_num 936) 2024-03-30T12:33:06.816 INFO:tasks.rados.rados.0.smithi084.stdout:3124: read oid 8 snap -1 2024-03-30T12:33:06.816 INFO:tasks.rados.rados.0.smithi084.stdout:3124: expect (ObjNum 950 snap 302 seq_num 950) 2024-03-30T12:33:06.816 INFO:tasks.rados.rados.0.smithi084.stdout:3125: rollback oid 26 current snap is 313 2024-03-30T12:33:06.816 INFO:tasks.rados.rados.0.smithi084.stdout:3120: finishing write tid 4 to smithi08477944-19 2024-03-30T12:33:06.816 INFO:tasks.rados.rados.0.smithi084.stdout:3120: finishing write tid 5 to smithi08477944-19 2024-03-30T12:33:06.816 INFO:tasks.rados.rados.0.smithi084.stdout:3120: oid 19 updating version 0 to 36305 2024-03-30T12:33:06.816 INFO:tasks.rados.rados.0.smithi084.stdout:3120: oid 19 updating version 36305 to 36306 2024-03-30T12:33:06.817 INFO:tasks.rados.rados.0.smithi084.stdout:3120: oid 19 version 36306 is already newer than 36304 2024-03-30T12:33:06.817 INFO:tasks.rados.rados.0.smithi084.stdout:3120: oid 19 version 36306 is already newer than 36303 2024-03-30T12:33:06.817 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 36306 (ObjNum 966 snap 313 seq_num 966) dirty exists 2024-03-30T12:33:06.817 INFO:tasks.rados.rados.0.smithi084.stdout:3120: left oid 19 (ObjNum 966 snap 313 seq_num 966) 2024-03-30T12:33:06.817 INFO:tasks.rados.rados.0.smithi084.stdout:3121: finishing write tid 1 to smithi08477944-42 2024-03-30T12:33:06.817 INFO:tasks.rados.rados.0.smithi084.stdout:3121: finishing write tid 2 to smithi08477944-42 2024-03-30T12:33:06.817 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 26 to 292 2024-03-30T12:33:06.817 INFO:tasks.rados.rados.0.smithi084.stdout:3121: finishing write tid 3 to smithi08477944-42 2024-03-30T12:33:06.817 INFO:tasks.rados.rados.0.smithi084.stdout:3121: finishing write tid 4 to smithi08477944-42 2024-03-30T12:33:06.817 INFO:tasks.rados.rados.0.smithi084.stdout:3121: finishing write tid 5 to smithi08477944-42 2024-03-30T12:33:06.817 INFO:tasks.rados.rados.0.smithi084.stdout:3121: finishing write tid 6 to smithi08477944-42 2024-03-30T12:33:06.817 INFO:tasks.rados.rados.0.smithi084.stdout:3121: oid 42 updating version 0 to 27300 2024-03-30T12:33:06.817 INFO:tasks.rados.rados.0.smithi084.stdout:3121: oid 42 updating version 27300 to 27301 2024-03-30T12:33:06.817 INFO:tasks.rados.rados.0.smithi084.stdout:3121: oid 42 version 27301 is already newer than 27299 2024-03-30T12:33:06.817 INFO:tasks.rados.rados.0.smithi084.stdout:3121: oid 42 updating version 27301 to 27302 2024-03-30T12:33:06.817 INFO:tasks.rados.rados.0.smithi084.stdout:3121: oid 42 updating version 27302 to 27303 2024-03-30T12:33:06.818 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 27303 (ObjNum 967 snap 313 seq_num 967) dirty exists 2024-03-30T12:33:06.818 INFO:tasks.rados.rados.0.smithi084.stdout:3121: left oid 42 (ObjNum 967 snap 313 seq_num 967) 2024-03-30T12:33:06.818 INFO:tasks.rados.rados.0.smithi084.stdout:3122: finishing rollback tid 0 to smithi08477944-10 2024-03-30T12:33:06.818 INFO:tasks.rados.rados.0.smithi084.stdout:3122: finishing rollback tid 1 to smithi08477944-10 2024-03-30T12:33:06.818 INFO:tasks.rados.rados.0.smithi084.stdout:3122: finishing rollback tid 2 to smithi08477944-10 2024-03-30T12:33:06.818 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 36286 (ObjNum 923 snap 292 seq_num 923) dirty exists 2024-03-30T12:33:06.818 INFO:tasks.rados.rados.0.smithi084.stdout:3120: done (5 left) 2024-03-30T12:33:06.818 INFO:tasks.rados.rados.0.smithi084.stdout:3121: done (4 left) 2024-03-30T12:33:06.818 INFO:tasks.rados.rados.0.smithi084.stdout:3122: done (3 left) 2024-03-30T12:33:06.818 INFO:tasks.rados.rados.0.smithi084.stdout:3126: copy_from oid 33 from oid 28 current snap is 313 2024-03-30T12:33:06.818 INFO:tasks.rados.rados.0.smithi084.stdout:3127: copy_from oid 45 from oid 21 current snap is 313 2024-03-30T12:33:06.818 INFO:tasks.rados.rados.0.smithi084.stdout:3128: delete oid 49 current snap is 313 2024-03-30T12:33:06.818 INFO:tasks.rados.rados.0.smithi084.stdout:3127: finishing copy_from to smithi08477944-45 2024-03-30T12:33:06.818 INFO:tasks.rados.rados.0.smithi084.stdout:3127: got expected ENOENT (src dne) 2024-03-30T12:33:06.819 INFO:tasks.rados.rados.0.smithi084.stdout:3127: finishing copy_from racing read to smithi08477944-45 2024-03-30T12:33:06.819 INFO:tasks.rados.rados.0.smithi084.stdout:3127: done (5 left) 2024-03-30T12:33:06.819 INFO:tasks.rados.rados.0.smithi084.stdout:3128: done (4 left) 2024-03-30T12:33:06.819 INFO:tasks.rados.rados.0.smithi084.stdout:3129: read oid 32 snap -1 2024-03-30T12:33:06.819 INFO:tasks.rados.rados.0.smithi084.stdout:3129: expect deleted 2024-03-30T12:33:06.819 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 30 current snap is 313 2024-03-30T12:33:06.819 INFO:tasks.rados.rados.0.smithi084.stdout:3130: seq_num 969 ranges {0=638976,638976=630784,1269760=532480,1802240=40960} 2024-03-30T12:33:06.819 INFO:tasks.rados.rados.0.smithi084.stdout:3130: writing smithi08477944-30 from 0 to 638976 tid 1 2024-03-30T12:33:06.823 INFO:tasks.rados.rados.0.smithi084.stdout:3130: writing smithi08477944-30 from 638976 to 1269760 tid 2 2024-03-30T12:33:06.827 INFO:tasks.rados.rados.0.smithi084.stdout:3130: writing smithi08477944-30 from 1269760 to 1802240 tid 3 2024-03-30T12:33:06.827 INFO:tasks.rados.rados.0.smithi084.stdout:3130: writing smithi08477944-30 from 1802240 to 1843200 tid 4 2024-03-30T12:33:06.827 INFO:tasks.rados.rados.0.smithi084.stdout:3131: rmattr oid 12 current snap is 313 2024-03-30T12:33:06.827 INFO:tasks.rados.rados.0.smithi084.stdout:3131: done (6 left) 2024-03-30T12:33:06.827 INFO:tasks.rados.rados.0.smithi084.stdout:3132: delete oid 2 current snap is 313 2024-03-30T12:33:06.828 INFO:tasks.rados.rados.0.smithi084.stdout:3126: finishing copy_from to smithi08477944-33 2024-03-30T12:33:06.828 INFO:tasks.rados.rados.0.smithi084.stdout:3126: got expected ENOENT (src dne) 2024-03-30T12:33:06.828 INFO:tasks.rados.rados.0.smithi084.stdout:3126: finishing copy_from racing read to smithi08477944-33 2024-03-30T12:33:06.828 INFO:tasks.rados.rados.0.smithi084.stdout:3130: finishing write tid 1 to smithi08477944-30 2024-03-30T12:33:06.829 INFO:tasks.rados.rados.0.smithi084.stdout:3130: finishing write tid 2 to smithi08477944-30 2024-03-30T12:33:06.835 INFO:tasks.rados.rados.0.smithi084.stdout:3124: expect (ObjNum 950 snap 302 seq_num 950) 2024-03-30T12:33:06.937 INFO:tasks.rados.rados.0.smithi084.stdout:3125: finishing rollback tid 0 to smithi08477944-26 2024-03-30T12:33:06.938 INFO:tasks.rados.rados.0.smithi084.stdout:3125: finishing rollback tid 1 to smithi08477944-26 2024-03-30T12:33:06.938 INFO:tasks.rados.rados.0.smithi084.stdout:3125: finishing rollback tid 2 to smithi08477944-26 2024-03-30T12:33:06.938 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 27372 (ObjNum 824 snap 273 seq_num 824) dirty exists 2024-03-30T12:33:06.938 INFO:tasks.rados.rados.0.smithi084.stdout:3124: done (6 left) 2024-03-30T12:33:06.938 INFO:tasks.rados.rados.0.smithi084.stdout:3125: done (5 left) 2024-03-30T12:33:06.938 INFO:tasks.rados.rados.0.smithi084.stdout:3126: done (4 left) 2024-03-30T12:33:06.938 INFO:tasks.rados.rados.0.smithi084.stdout:3129: done (3 left) 2024-03-30T12:33:06.938 INFO:tasks.rados.rados.0.smithi084.stdout:3132: done (2 left) 2024-03-30T12:33:06.938 INFO:tasks.rados.rados.0.smithi084.stdout:3133: rmattr oid 8 current snap is 313 2024-03-30T12:33:06.938 INFO:tasks.rados.rados.0.smithi084.stdout:3133: done (2 left) 2024-03-30T12:33:06.938 INFO:tasks.rados.rados.0.smithi084.stdout:3134: copy_from oid 11 from oid 12 current snap is 313 2024-03-30T12:33:06.938 INFO:tasks.rados.rados.0.smithi084.stdout:3130: finishing write tid 3 to smithi08477944-30 2024-03-30T12:33:06.938 INFO:tasks.rados.rados.0.smithi084.stdout:3130: finishing write tid 4 to smithi08477944-30 2024-03-30T12:33:06.938 INFO:tasks.rados.rados.0.smithi084.stdout:3130: finishing write tid 5 to smithi08477944-30 2024-03-30T12:33:06.939 INFO:tasks.rados.rados.0.smithi084.stdout:3123: expect (ObjNum 936 snap 295 seq_num 936) 2024-03-30T12:33:07.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:06.728+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:07.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:06.729+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:07.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:06.716+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:07.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:06.716+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:07.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:06.716+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:07.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:06.716+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:07.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:06.717+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:07.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:07.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:07.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:07.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:07.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:07.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[91810]: osdmap e693: 8 total, 8 up, 8 in 2024-03-30T12:33:07.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:07.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:07.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:07.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:07.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:07.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:07.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:07.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:07.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:07.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:07.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:07.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:07.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:07.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[89279]: osdmap e693: 8 total, 8 up, 8 in 2024-03-30T12:33:07.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:07.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:07.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:07.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:07.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:07.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:07.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:07.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:07.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:07.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:06.727+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:07.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:06.719+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:07.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:06.719+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:07.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:06.720+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:07.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:06.717+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:07.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:06.718+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:07.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:06.722+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:07.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:06.722+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:07.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:06.722+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:07.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 169=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:07.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:07.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:07.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:07.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:07.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:06 smithi162 ceph-mon[83709]: osdmap e693: 8 total, 8 up, 8 in 2024-03-30T12:33:07.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:07.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:07.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:07.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:07.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:07.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:07.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:07.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:07.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:07.493 INFO:tasks.rados.rados.0.smithi084.stdout:3130: finishing write tid 6 to smithi08477944-30 2024-03-30T12:33:07.493 INFO:tasks.rados.rados.0.smithi084.stdout:3130: oid 30 updating version 0 to 27292 2024-03-30T12:33:07.493 INFO:tasks.rados.rados.0.smithi084.stdout:3130: oid 30 version 27292 is already newer than 27289 2024-03-30T12:33:07.493 INFO:tasks.rados.rados.0.smithi084.stdout:3130: oid 30 version 27292 is already newer than 27290 2024-03-30T12:33:07.493 INFO:tasks.rados.rados.0.smithi084.stdout:3130: oid 30 version 27292 is already newer than 27288 2024-03-30T12:33:07.493 INFO:tasks.rados.rados.0.smithi084.stdout:3130: oid 30 version 27292 is already newer than 27291 2024-03-30T12:33:07.494 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 27292 (ObjNum 969 snap 313 seq_num 969) dirty exists 2024-03-30T12:33:07.494 INFO:tasks.rados.rados.0.smithi084.stdout:3130: left oid 30 (ObjNum 969 snap 313 seq_num 969) 2024-03-30T12:33:07.494 INFO:tasks.rados.rados.0.smithi084.stdout:3123: done (2 left) 2024-03-30T12:33:07.494 INFO:tasks.rados.rados.0.smithi084.stdout:3130: done (1 left) 2024-03-30T12:33:07.494 INFO:tasks.rados.rados.0.smithi084.stdout:3135: rollback oid 16 current snap is 313 2024-03-30T12:33:07.494 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 16 to 292 2024-03-30T12:33:07.494 INFO:tasks.rados.rados.0.smithi084.stdout:3134: finishing copy_from racing read to smithi08477944-11 2024-03-30T12:33:07.494 INFO:tasks.rados.rados.0.smithi084.stdout:3134: finishing copy_from to smithi08477944-11 2024-03-30T12:33:07.494 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 27238 (ObjNum 883 snap 282 seq_num 883) dirty exists 2024-03-30T12:33:07.494 INFO:tasks.rados.rados.0.smithi084.stdout:3134: done (1 left) 2024-03-30T12:33:07.494 INFO:tasks.rados.rados.0.smithi084.stdout:3136: delete oid 20 current snap is 313 2024-03-30T12:33:07.495 INFO:tasks.rados.rados.0.smithi084.stdout:3136: done (1 left) 2024-03-30T12:33:07.495 INFO:tasks.rados.rados.0.smithi084.stdout:3137: read oid 7 snap 312 2024-03-30T12:33:07.495 INFO:tasks.rados.rados.0.smithi084.stdout:3137: expect deleted 2024-03-30T12:33:07.495 INFO:tasks.rados.rados.0.smithi084.stdout:3138: setattr oid 19 current snap is 313 2024-03-30T12:33:07.496 INFO:tasks.rados.rados.0.smithi084.stdout:3135: finishing rollback tid 0 to smithi08477944-16 2024-03-30T12:33:07.496 INFO:tasks.rados.rados.0.smithi084.stdout:3135: finishing rollback tid 1 to smithi08477944-16 2024-03-30T12:33:07.497 INFO:tasks.rados.rados.0.smithi084.stdout:3135: finishing rollback tid 2 to smithi08477944-16 2024-03-30T12:33:07.497 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 27297 (ObjNum 909 snap 288 seq_num 909) dirty exists 2024-03-30T12:33:07.498 INFO:tasks.rados.rados.0.smithi084.stdout:3135: done (2 left) 2024-03-30T12:33:07.498 INFO:tasks.rados.rados.0.smithi084.stdout:3137: done (1 left) 2024-03-30T12:33:07.498 INFO:tasks.rados.rados.0.smithi084.stdout:3139: snap_create 2024-03-30T12:33:07.504 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 36307 (ObjNum 966 snap 313 seq_num 966) dirty exists 2024-03-30T12:33:07.724 INFO:tasks.rados.rados.0.smithi084.stdout:3138: done (1 left) 2024-03-30T12:33:07.724 INFO:tasks.rados.rados.0.smithi084.stdout:3139: done (0 left) 2024-03-30T12:33:07.724 INFO:tasks.rados.rados.0.smithi084.stdout:3140: rmattr oid 41 current snap is 314 2024-03-30T12:33:07.724 INFO:tasks.rados.rados.0.smithi084.stdout:3140: done (0 left) 2024-03-30T12:33:07.725 INFO:tasks.rados.rados.0.smithi084.stdout:3141: read oid 41 snap -1 2024-03-30T12:33:07.725 INFO:tasks.rados.rados.0.smithi084.stdout:3141: expect deleted 2024-03-30T12:33:07.725 INFO:tasks.rados.rados.0.smithi084.stdout:3142: snap_remove snap 298 2024-03-30T12:33:08.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:07.730+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:08.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:07.731+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:08.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:07.731+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:08.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:07.731+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:08.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:07.731+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:08.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:07.731+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:08.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:08.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:08.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:08.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:08.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:08.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[91810]: osdmap e694: 8 total, 8 up, 8 in 2024-03-30T12:33:08.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:08.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:08.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:08.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:08.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:08.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:08.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:08.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:08.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[91810]: pgmap v730: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 907 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 5.9 MiB/s rd, 808 KiB/s wr, 7 op/s 2024-03-30T12:33:08.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:08.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:08.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:08.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:08.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:08.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[89279]: osdmap e694: 8 total, 8 up, 8 in 2024-03-30T12:33:08.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:08.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:08.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:08.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:08.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:08.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:08.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:08.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:08.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:07 smithi084 ceph-mon[89279]: pgmap v730: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 907 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 5.9 MiB/s rd, 808 KiB/s wr, 7 op/s 2024-03-30T12:33:08.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:07.732+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:08.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:07.733+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:08.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:07.729+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:08.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:07.729+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:08.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:08.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:08.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:08.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:08.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:08.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:07 smithi162 ceph-mon[83709]: osdmap e694: 8 total, 8 up, 8 in 2024-03-30T12:33:08.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:08.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:08.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:08.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:08.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:08.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:08.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:08.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:08.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:07 smithi162 ceph-mon[83709]: pgmap v730: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 907 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 5.9 MiB/s rd, 808 KiB/s wr, 7 op/s 2024-03-30T12:33:08.729 INFO:tasks.rados.rados.0.smithi084.stdout:3142: done (1 left) 2024-03-30T12:33:08.729 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 314 2024-03-30T12:33:08.729 INFO:tasks.rados.rados.0.smithi084.stdout:3143: seq_num 972 ranges {0=688128,688128=688128,1376256=516096} 2024-03-30T12:33:08.732 INFO:tasks.rados.rados.0.smithi084.stdout:3143: writing smithi08477944-4 from 0 to 688128 tid 1 2024-03-30T12:33:08.737 INFO:tasks.rados.rados.0.smithi084.stdout:3143: writing smithi08477944-4 from 688128 to 1376256 tid 2 2024-03-30T12:33:08.740 INFO:tasks.rados.rados.0.smithi084.stdout:3143: writing smithi08477944-4 from 1376256 to 1892352 tid 3 2024-03-30T12:33:08.740 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 314 2024-03-30T12:33:08.740 INFO:tasks.rados.rados.0.smithi084.stdout:3144: seq_num 973 ranges {1515520=704512,2220032=573440,2793472=507904,3301376=122880} 2024-03-30T12:33:08.752 INFO:tasks.rados.rados.0.smithi084.stdout:3144: writing smithi08477944-16 from 1515520 to 2220032 tid 1 2024-03-30T12:33:08.756 INFO:tasks.rados.rados.0.smithi084.stdout:3144: writing smithi08477944-16 from 2220032 to 2793472 tid 2 2024-03-30T12:33:08.758 INFO:tasks.rados.rados.0.smithi084.stdout:3144: writing smithi08477944-16 from 2793472 to 3301376 tid 3 2024-03-30T12:33:08.760 INFO:tasks.rados.rados.0.smithi084.stdout:3144: writing smithi08477944-16 from 3301376 to 3424256 tid 4 2024-03-30T12:33:08.760 INFO:tasks.rados.rados.0.smithi084.stdout:3141: done (2 left) 2024-03-30T12:33:08.760 INFO:tasks.rados.rados.0.smithi084.stdout:3145: read oid 40 snap 309 2024-03-30T12:33:08.760 INFO:tasks.rados.rados.0.smithi084.stdout:3145: expect deleted 2024-03-30T12:33:08.760 INFO:tasks.rados.rados.0.smithi084.stdout:3146: snap_create 2024-03-30T12:33:08.760 INFO:tasks.rados.rados.0.smithi084.stdout:3143: finishing write tid 1 to smithi08477944-4 2024-03-30T12:33:08.760 INFO:tasks.rados.rados.0.smithi084.stdout:3143: finishing write tid 2 to smithi08477944-4 2024-03-30T12:33:08.760 INFO:tasks.rados.rados.0.smithi084.stdout:3143: finishing write tid 3 to smithi08477944-4 2024-03-30T12:33:08.761 INFO:tasks.rados.rados.0.smithi084.stdout:3143: finishing write tid 4 to smithi08477944-4 2024-03-30T12:33:08.761 INFO:tasks.rados.rados.0.smithi084.stdout:3143: finishing write tid 5 to smithi08477944-4 2024-03-30T12:33:08.761 INFO:tasks.rados.rados.0.smithi084.stdout:3143: oid 4 updating version 0 to 23425 2024-03-30T12:33:08.761 INFO:tasks.rados.rados.0.smithi084.stdout:3143: oid 4 version 23425 is already newer than 23423 2024-03-30T12:33:08.761 INFO:tasks.rados.rados.0.smithi084.stdout:3143: oid 4 updating version 23425 to 23426 2024-03-30T12:33:08.761 INFO:tasks.rados.rados.0.smithi084.stdout:3143: oid 4 version 23426 is already newer than 23424 2024-03-30T12:33:08.761 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 23426 (ObjNum 972 snap 314 seq_num 972) dirty exists 2024-03-30T12:33:08.761 INFO:tasks.rados.rados.0.smithi084.stdout:3143: left oid 4 (ObjNum 972 snap 314 seq_num 972) 2024-03-30T12:33:08.761 INFO:tasks.rados.rados.0.smithi084.stdout:3144: finishing write tid 1 to smithi08477944-16 2024-03-30T12:33:08.761 INFO:tasks.rados.rados.0.smithi084.stdout:3144: finishing write tid 2 to smithi08477944-16 2024-03-30T12:33:08.763 INFO:tasks.rados.rados.0.smithi084.stdout:3144: finishing write tid 3 to smithi08477944-16 2024-03-30T12:33:08.763 INFO:tasks.rados.rados.0.smithi084.stdout:3144: finishing write tid 4 to smithi08477944-16 2024-03-30T12:33:08.763 INFO:tasks.rados.rados.0.smithi084.stdout:3144: finishing write tid 5 to smithi08477944-16 2024-03-30T12:33:08.765 INFO:tasks.rados.rados.0.smithi084.stdout:3144: finishing write tid 6 to smithi08477944-16 2024-03-30T12:33:08.765 INFO:tasks.rados.rados.0.smithi084.stdout:3144: oid 16 updating version 0 to 27299 2024-03-30T12:33:08.765 INFO:tasks.rados.rados.0.smithi084.stdout:3144: oid 16 updating version 27299 to 27300 2024-03-30T12:33:08.765 INFO:tasks.rados.rados.0.smithi084.stdout:3144: oid 16 updating version 27300 to 27302 2024-03-30T12:33:08.765 INFO:tasks.rados.rados.0.smithi084.stdout:3144: oid 16 version 27302 is already newer than 27298 2024-03-30T12:33:08.765 INFO:tasks.rados.rados.0.smithi084.stdout:3144: oid 16 version 27302 is already newer than 27301 2024-03-30T12:33:08.765 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 27302 (ObjNum 973 snap 314 seq_num 973) dirty exists 2024-03-30T12:33:08.765 INFO:tasks.rados.rados.0.smithi084.stdout:3144: left oid 16 (ObjNum 973 snap 314 seq_num 973) 2024-03-30T12:33:09.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:08.746+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:09.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:08.746+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:09.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:08 smithi084 ceph-mon[91810]: osdmap e695: 8 total, 8 up, 8 in 2024-03-30T12:33:09.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:08 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:09.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:08 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:09.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:09.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:09.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:09.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:08 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:09.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:08 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:09.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:08 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:09.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:08.735+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:09.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:08.735+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:09.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:08.735+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:09.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:08.735+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:09.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:08.735+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:09.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:08 smithi084 ceph-mon[89279]: osdmap e695: 8 total, 8 up, 8 in 2024-03-30T12:33:09.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:08 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:09.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:08 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:09.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:09.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:09.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:09.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:08 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:09.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:08 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:09.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:08 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:09.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:08.837+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:09.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:08.739+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:09.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:08.740+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:09.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:08.741+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:09.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:08.741+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:09.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:08.741+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:09.121 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:08.737+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:09.121 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:08.737+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:09.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:08 smithi162 ceph-mon[83709]: osdmap e695: 8 total, 8 up, 8 in 2024-03-30T12:33:09.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:08 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:09.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:08 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:09.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:09.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:09.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:09.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:08 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:09.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:08 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:09.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:08 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:09.726 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:33:09] "GET /metrics HTTP/1.1" 200 36333 "" "Prometheus/2.43.0" 2024-03-30T12:33:09.735 INFO:tasks.rados.rados.0.smithi084.stdout:3143: done (3 left) 2024-03-30T12:33:09.735 INFO:tasks.rados.rados.0.smithi084.stdout:3144: done (2 left) 2024-03-30T12:33:09.736 INFO:tasks.rados.rados.0.smithi084.stdout:3145: done (1 left) 2024-03-30T12:33:09.736 INFO:tasks.rados.rados.0.smithi084.stdout:3146: done (0 left) 2024-03-30T12:33:09.736 INFO:tasks.rados.rados.0.smithi084.stdout:3147: rollback oid 22 current snap is 315 2024-03-30T12:33:09.736 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 22 to 305 2024-03-30T12:33:09.736 INFO:tasks.rados.rados.0.smithi084.stdout:3148: snap_remove snap 299 2024-03-30T12:33:10.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:09.752+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:10.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:09.752+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:10.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:09.742+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:10.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:09.742+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:10.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:09.742+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:10.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:09.743+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:10.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:09.743+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:10.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:09.743+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:10.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:10.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:10.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:10.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:10.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[89279]: osdmap e696: 8 total, 8 up, 8 in 2024-03-30T12:33:10.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:10.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:10.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:10.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:10.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:10.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:10.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[89279]: pgmap v733: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 912 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 12 MiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-03-30T12:33:10.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:10.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:10.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:10.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:10.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:10.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:10.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:10.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[91810]: osdmap e696: 8 total, 8 up, 8 in 2024-03-30T12:33:10.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:10.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:10.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:10.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:10.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:10.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:10.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[91810]: pgmap v733: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 912 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 12 MiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-03-30T12:33:10.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:10.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:10.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:10.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:09.893+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:10.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:09.748+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:10.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:09.757+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:10.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:09.743+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:10.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:09.743+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:10.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:09.745+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:10.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:09.745+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:10.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:09.745+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:10.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:10.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:10.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:10.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:10.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:09 smithi162 ceph-mon[83709]: osdmap e696: 8 total, 8 up, 8 in 2024-03-30T12:33:10.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:10.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:10.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:10.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:10.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:10.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:10.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:09 smithi162 ceph-mon[83709]: pgmap v733: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 912 MiB data, 7.8 GiB used, 707 GiB / 715 GiB avail; 12 MiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-03-30T12:33:10.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:10.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:10.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:10.737 INFO:tasks.rados.rados.0.smithi084.stdout:3148: done (1 left) 2024-03-30T12:33:10.737 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 315 2024-03-30T12:33:10.737 INFO:tasks.rados.rados.0.smithi084.stdout:3149: seq_num 974 ranges {7659520=720896,8380416=507904,8888320=671744,9560064=24576} 2024-03-30T12:33:10.782 INFO:tasks.rados.rados.0.smithi084.stdout:3149: writing smithi08477944-50 from 7659520 to 8380416 tid 1 2024-03-30T12:33:10.785 INFO:tasks.rados.rados.0.smithi084.stdout:3149: writing smithi08477944-50 from 8380416 to 8888320 tid 2 2024-03-30T12:33:10.789 INFO:tasks.rados.rados.0.smithi084.stdout:3149: writing smithi08477944-50 from 8888320 to 9560064 tid 3 2024-03-30T12:33:10.790 INFO:tasks.rados.rados.0.smithi084.stdout:3149: writing smithi08477944-50 from 9560064 to 9584640 tid 4 2024-03-30T12:33:10.790 INFO:tasks.rados.rados.0.smithi084.stdout:3150: delete oid 17 current snap is 315 2024-03-30T12:33:10.790 INFO:tasks.rados.rados.0.smithi084.stdout:3147: finishing rollback tid 1 to smithi08477944-22 2024-03-30T12:33:10.790 INFO:tasks.rados.rados.0.smithi084.stdout:3147: finishing rollback tid 2 to smithi08477944-22 2024-03-30T12:33:10.790 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 27375 (ObjNum 947 snap 301 seq_num 947) dirty exists 2024-03-30T12:33:10.790 INFO:tasks.rados.rados.0.smithi084.stdout:3149: finishing write tid 1 to smithi08477944-50 2024-03-30T12:33:10.790 INFO:tasks.rados.rados.0.smithi084.stdout:3149: finishing write tid 2 to smithi08477944-50 2024-03-30T12:33:10.794 INFO:tasks.rados.rados.0.smithi084.stdout:3149: finishing write tid 3 to smithi08477944-50 2024-03-30T12:33:10.794 INFO:tasks.rados.rados.0.smithi084.stdout:3149: finishing write tid 4 to smithi08477944-50 2024-03-30T12:33:10.794 INFO:tasks.rados.rados.0.smithi084.stdout:3149: finishing write tid 5 to smithi08477944-50 2024-03-30T12:33:10.795 INFO:tasks.rados.rados.0.smithi084.stdout:3147: done (2 left) 2024-03-30T12:33:10.795 INFO:tasks.rados.rados.0.smithi084.stdout:3150: done (1 left) 2024-03-30T12:33:10.795 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 315 2024-03-30T12:33:10.795 INFO:tasks.rados.rados.0.smithi084.stdout:3151: seq_num 976 ranges {1540096=753664,2293760=671744,2965504=532480} 2024-03-30T12:33:10.807 INFO:tasks.rados.rados.0.smithi084.stdout:3151: writing smithi08477944-14 from 1540096 to 2293760 tid 1 2024-03-30T12:33:10.811 INFO:tasks.rados.rados.0.smithi084.stdout:3151: writing smithi08477944-14 from 2293760 to 2965504 tid 2 2024-03-30T12:33:10.814 INFO:tasks.rados.rados.0.smithi084.stdout:3151: writing smithi08477944-14 from 2965504 to 3497984 tid 3 2024-03-30T12:33:10.815 INFO:tasks.rados.rados.0.smithi084.stdout:3152: read oid 44 snap -1 2024-03-30T12:33:10.815 INFO:tasks.rados.rados.0.smithi084.stdout:3152: expect (ObjNum 904 snap 287 seq_num 904) 2024-03-30T12:33:10.815 INFO:tasks.rados.rados.0.smithi084.stdout:3153: setattr oid 35 current snap is 315 2024-03-30T12:33:10.815 INFO:tasks.rados.rados.0.smithi084.stdout:3149: finishing write tid 6 to smithi08477944-50 2024-03-30T12:33:10.815 INFO:tasks.rados.rados.0.smithi084.stdout:3149: oid 50 updating version 0 to 27303 2024-03-30T12:33:10.816 INFO:tasks.rados.rados.0.smithi084.stdout:3149: oid 50 updating version 27303 to 27307 2024-03-30T12:33:10.816 INFO:tasks.rados.rados.0.smithi084.stdout:3149: oid 50 version 27307 is already newer than 27304 2024-03-30T12:33:10.816 INFO:tasks.rados.rados.0.smithi084.stdout:3149: oid 50 version 27307 is already newer than 27306 2024-03-30T12:33:10.816 INFO:tasks.rados.rados.0.smithi084.stdout:3149: oid 50 version 27307 is already newer than 27305 2024-03-30T12:33:10.816 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 27307 (ObjNum 974 snap 315 seq_num 974) dirty exists 2024-03-30T12:33:10.816 INFO:tasks.rados.rados.0.smithi084.stdout:3149: left oid 50 (ObjNum 974 snap 315 seq_num 974) 2024-03-30T12:33:10.816 INFO:tasks.rados.rados.0.smithi084.stdout:3149: done (3 left) 2024-03-30T12:33:10.816 INFO:tasks.rados.rados.0.smithi084.stdout:3154: snap_create 2024-03-30T12:33:10.818 INFO:tasks.rados.rados.0.smithi084.stdout:3151: finishing write tid 1 to smithi08477944-14 2024-03-30T12:33:10.819 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 23386 (ObjNum 664 snap 232 seq_num 664) dirty exists 2024-03-30T12:33:10.828 INFO:tasks.rados.rados.0.smithi084.stdout:3151: finishing write tid 2 to smithi08477944-14 2024-03-30T12:33:10.828 INFO:tasks.rados.rados.0.smithi084.stdout:3151: finishing write tid 3 to smithi08477944-14 2024-03-30T12:33:10.828 INFO:tasks.rados.rados.0.smithi084.stdout:3151: finishing write tid 4 to smithi08477944-14 2024-03-30T12:33:10.833 INFO:tasks.rados.rados.0.smithi084.stdout:3151: finishing write tid 5 to smithi08477944-14 2024-03-30T12:33:10.834 INFO:tasks.rados.rados.0.smithi084.stdout:3151: oid 14 updating version 0 to 36289 2024-03-30T12:33:10.834 INFO:tasks.rados.rados.0.smithi084.stdout:3151: oid 14 updating version 36289 to 36290 2024-03-30T12:33:10.834 INFO:tasks.rados.rados.0.smithi084.stdout:3151: oid 14 version 36290 is already newer than 36288 2024-03-30T12:33:10.834 INFO:tasks.rados.rados.0.smithi084.stdout:3151: oid 14 version 36290 is already newer than 36287 2024-03-30T12:33:10.834 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 36290 (ObjNum 976 snap 315 seq_num 976) dirty exists 2024-03-30T12:33:10.834 INFO:tasks.rados.rados.0.smithi084.stdout:3151: left oid 14 (ObjNum 976 snap 315 seq_num 976) 2024-03-30T12:33:10.846 INFO:tasks.rados.rados.0.smithi084.stdout:3152: expect (ObjNum 904 snap 287 seq_num 904) 2024-03-30T12:33:11.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:10.800+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:11.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:10.802+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:11.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:10.743+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:11.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:10.743+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:11.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:10.744+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:11.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:10.744+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:11.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:10.744+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:11.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:11.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:11.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:11.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:11.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:11.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:11.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[89279]: osdmap e697: 8 total, 8 up, 8 in 2024-03-30T12:33:11.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:11.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:11.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:11.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:11.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:11.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:11.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:11.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:11.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:11.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:11.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:11.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:11.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:11.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[91810]: osdmap e697: 8 total, 8 up, 8 in 2024-03-30T12:33:11.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:11.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:11.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:11.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:11.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:11.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:11.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:11.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:10.804+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:11.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:10.745+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:11.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:10.745+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:11.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:10.745+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:11.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:10.745+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:11.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:10.748+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:11.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:10.748+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:11.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:10.748+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:11.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:11.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:11.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:11.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:11.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:11.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:11.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:10 smithi162 ceph-mon[83709]: osdmap e697: 8 total, 8 up, 8 in 2024-03-30T12:33:11.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:11.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:11.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:11.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:11.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:11.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:11.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:11.750 INFO:tasks.rados.rados.0.smithi084.stdout:3151: done (3 left) 2024-03-30T12:33:11.750 INFO:tasks.rados.rados.0.smithi084.stdout:3152: done (2 left) 2024-03-30T12:33:11.750 INFO:tasks.rados.rados.0.smithi084.stdout:3153: done (1 left) 2024-03-30T12:33:11.750 INFO:tasks.rados.rados.0.smithi084.stdout:3154: done (0 left) 2024-03-30T12:33:11.750 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 316 2024-03-30T12:33:11.751 INFO:tasks.rados.rados.0.smithi084.stdout:3155: seq_num 977 ranges {0=770048,770048=557056,1327104=491520,1818624=155648} 2024-03-30T12:33:11.754 INFO:tasks.rados.rados.0.smithi084.stdout:3155: writing smithi08477944-1 from 0 to 770048 tid 1 2024-03-30T12:33:11.757 INFO:tasks.rados.rados.0.smithi084.stdout:3155: writing smithi08477944-1 from 770048 to 1327104 tid 2 2024-03-30T12:33:11.760 INFO:tasks.rados.rados.0.smithi084.stdout:3155: writing smithi08477944-1 from 1327104 to 1818624 tid 3 2024-03-30T12:33:11.762 INFO:tasks.rados.rados.0.smithi084.stdout:3155: writing smithi08477944-1 from 1818624 to 1974272 tid 4 2024-03-30T12:33:11.762 INFO:tasks.rados.rados.0.smithi084.stdout:3156: copy_from oid 45 from oid 34 current snap is 316 2024-03-30T12:33:11.762 INFO:tasks.rados.rados.0.smithi084.stdout:3155: finishing write tid 1 to smithi08477944-1 2024-03-30T12:33:11.762 INFO:tasks.rados.rados.0.smithi084.stdout:3155: finishing write tid 2 to smithi08477944-1 2024-03-30T12:33:11.762 INFO:tasks.rados.rados.0.smithi084.stdout:3157: delete oid 29 current snap is 316 2024-03-30T12:33:11.764 INFO:tasks.rados.rados.0.smithi084.stdout:3155: finishing write tid 3 to smithi08477944-1 2024-03-30T12:33:11.764 INFO:tasks.rados.rados.0.smithi084.stdout:3155: finishing write tid 4 to smithi08477944-1 2024-03-30T12:33:11.765 INFO:tasks.rados.rados.0.smithi084.stdout:3155: finishing write tid 5 to smithi08477944-1 2024-03-30T12:33:11.767 INFO:tasks.rados.rados.0.smithi084.stdout:3157: done (2 left) 2024-03-30T12:33:11.767 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 316 2024-03-30T12:33:11.767 INFO:tasks.rados.rados.0.smithi084.stdout:3158: seq_num 979 ranges {8208384=802816,9011200=729088,9740288=458752,10199040=16384} 2024-03-30T12:33:11.816 INFO:tasks.rados.rados.0.smithi084.stdout:3158: writing smithi08477944-13 from 8208384 to 9011200 tid 1 2024-03-30T12:33:11.819 INFO:tasks.rados.rados.0.smithi084.stdout:3158: writing smithi08477944-13 from 9011200 to 9740288 tid 2 2024-03-30T12:33:11.822 INFO:tasks.rados.rados.0.smithi084.stdout:3158: writing smithi08477944-13 from 9740288 to 10199040 tid 3 2024-03-30T12:33:11.823 INFO:tasks.rados.rados.0.smithi084.stdout:3158: writing smithi08477944-13 from 10199040 to 10215424 tid 4 2024-03-30T12:33:11.823 INFO:tasks.rados.rados.0.smithi084.stdout:3159: snap_create 2024-03-30T12:33:11.823 INFO:tasks.rados.rados.0.smithi084.stdout:3155: finishing write tid 6 to smithi08477944-1 2024-03-30T12:33:11.823 INFO:tasks.rados.rados.0.smithi084.stdout:3155: oid 1 updating version 0 to 23390 2024-03-30T12:33:11.823 INFO:tasks.rados.rados.0.smithi084.stdout:3155: oid 1 version 23390 is already newer than 23387 2024-03-30T12:33:11.823 INFO:tasks.rados.rados.0.smithi084.stdout:3155: oid 1 updating version 23390 to 23391 2024-03-30T12:33:11.824 INFO:tasks.rados.rados.0.smithi084.stdout:3155: oid 1 version 23391 is already newer than 23388 2024-03-30T12:33:11.824 INFO:tasks.rados.rados.0.smithi084.stdout:3155: oid 1 version 23391 is already newer than 23389 2024-03-30T12:33:11.824 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 23391 (ObjNum 977 snap 316 seq_num 977) dirty exists 2024-03-30T12:33:11.824 INFO:tasks.rados.rados.0.smithi084.stdout:3155: left oid 1 (ObjNum 977 snap 316 seq_num 977) 2024-03-30T12:33:11.824 INFO:tasks.rados.rados.0.smithi084.stdout:3156: finishing copy_from racing read to smithi08477944-45 2024-03-30T12:33:11.824 INFO:tasks.rados.rados.0.smithi084.stdout:3156: finishing copy_from to smithi08477944-45 2024-03-30T12:33:11.825 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 27235 (ObjNum 955 snap 303 seq_num 955) dirty exists 2024-03-30T12:33:11.832 INFO:tasks.rados.rados.0.smithi084.stdout:3158: finishing write tid 1 to smithi08477944-13 2024-03-30T12:33:11.832 INFO:tasks.rados.rados.0.smithi084.stdout:3158: finishing write tid 2 to smithi08477944-13 2024-03-30T12:33:11.841 INFO:tasks.rados.rados.0.smithi084.stdout:3158: finishing write tid 3 to smithi08477944-13 2024-03-30T12:33:11.841 INFO:tasks.rados.rados.0.smithi084.stdout:3158: finishing write tid 4 to smithi08477944-13 2024-03-30T12:33:11.841 INFO:tasks.rados.rados.0.smithi084.stdout:3158: finishing write tid 5 to smithi08477944-13 2024-03-30T12:33:11.845 INFO:tasks.rados.rados.0.smithi084.stdout:3158: finishing write tid 6 to smithi08477944-13 2024-03-30T12:33:11.845 INFO:tasks.rados.rados.0.smithi084.stdout:3158: oid 13 updating version 0 to 23426 2024-03-30T12:33:11.845 INFO:tasks.rados.rados.0.smithi084.stdout:3158: oid 13 version 23426 is already newer than 23424 2024-03-30T12:33:11.845 INFO:tasks.rados.rados.0.smithi084.stdout:3158: oid 13 version 23426 is already newer than 23423 2024-03-30T12:33:11.845 INFO:tasks.rados.rados.0.smithi084.stdout:3158: oid 13 version 23426 is already newer than 23422 2024-03-30T12:33:11.845 INFO:tasks.rados.rados.0.smithi084.stdout:3158: oid 13 version 23426 is already newer than 23425 2024-03-30T12:33:11.846 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 23426 (ObjNum 979 snap 316 seq_num 979) dirty exists 2024-03-30T12:33:11.846 INFO:tasks.rados.rados.0.smithi084.stdout:3158: left oid 13 (ObjNum 979 snap 316 seq_num 979) 2024-03-30T12:33:12.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:11.767+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:12.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:11.767+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:12.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:11.756+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:12.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:11.756+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:12.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:11.756+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:12.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:11.757+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:12.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:11.758+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:12.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:11.758+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:12.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:12.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:12.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:12.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:12.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[91810]: osdmap e698: 8 total, 8 up, 8 in 2024-03-30T12:33:12.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:12.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:12.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:12.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:12.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[91810]: pgmap v736: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 914 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 9.0 MiB/s rd, 1.8 MiB/s wr, 11 op/s 2024-03-30T12:33:12.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:12.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:12.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:12.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:12.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:12.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:12.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:12.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:12.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:12.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[89279]: osdmap e698: 8 total, 8 up, 8 in 2024-03-30T12:33:12.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:12.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:12.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:12.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:12.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[89279]: pgmap v736: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 914 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 9.0 MiB/s rd, 1.8 MiB/s wr, 11 op/s 2024-03-30T12:33:12.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:12.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:12.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:12.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:12.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:12.020 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:11.778+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:12.020 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:11.775+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:12.020 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:11.776+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:12.021 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:11.758+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:12.021 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:11.758+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:12.021 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:11.758+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:12.021 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:11.776+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:12.021 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:11.776+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:12.021 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:12.021 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:12.021 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:12.022 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:12.022 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:11 smithi162 ceph-mon[83709]: osdmap e698: 8 total, 8 up, 8 in 2024-03-30T12:33:12.022 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:12.022 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:12.022 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:12.022 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:12.022 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:11 smithi162 ceph-mon[83709]: pgmap v736: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 914 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 9.0 MiB/s rd, 1.8 MiB/s wr, 11 op/s 2024-03-30T12:33:12.022 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:12.022 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:12.022 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:12.022 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:12.022 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:12.764 INFO:tasks.rados.rados.0.smithi084.stdout:3155: done (3 left) 2024-03-30T12:33:12.764 INFO:tasks.rados.rados.0.smithi084.stdout:3156: done (2 left) 2024-03-30T12:33:12.764 INFO:tasks.rados.rados.0.smithi084.stdout:3158: done (1 left) 2024-03-30T12:33:12.765 INFO:tasks.rados.rados.0.smithi084.stdout:3159: done (0 left) 2024-03-30T12:33:12.765 INFO:tasks.rados.rados.0.smithi084.stdout:3160: rmattr oid 27 current snap is 317 2024-03-30T12:33:12.765 INFO:tasks.rados.rados.0.smithi084.stdout:3160: done (0 left) 2024-03-30T12:33:12.765 INFO:tasks.rados.rados.0.smithi084.stdout:3161: copy_from oid 33 from oid 29 current snap is 317 2024-03-30T12:33:12.765 INFO:tasks.rados.rados.0.smithi084.stdout:3162: setattr oid 37 current snap is 317 2024-03-30T12:33:12.766 INFO:tasks.rados.rados.0.smithi084.stdout:3163: read oid 23 snap -1 2024-03-30T12:33:12.766 INFO:tasks.rados.rados.0.smithi084.stdout:3163: expect (ObjNum 946 snap 301 seq_num 946) 2024-03-30T12:33:12.766 INFO:tasks.rados.rados.0.smithi084.stdout:3164: delete oid 28 current snap is 317 2024-03-30T12:33:12.767 INFO:tasks.rados.rados.0.smithi084.stdout:3161: finishing copy_from to smithi08477944-33 2024-03-30T12:33:12.768 INFO:tasks.rados.rados.0.smithi084.stdout:3161: got expected ENOENT (src dne) 2024-03-30T12:33:12.768 INFO:tasks.rados.rados.0.smithi084.stdout:3161: finishing copy_from racing read to smithi08477944-33 2024-03-30T12:33:12.770 INFO:tasks.rados.rados.0.smithi084.stdout:3161: done (3 left) 2024-03-30T12:33:12.770 INFO:tasks.rados.rados.0.smithi084.stdout:3164: done (2 left) 2024-03-30T12:33:12.770 INFO:tasks.rados.rados.0.smithi084.stdout:3165: rollback oid 2 current snap is 317 2024-03-30T12:33:12.770 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 2 to 292 2024-03-30T12:33:12.771 INFO:tasks.rados.rados.0.smithi084.stdout:3166: rollback oid 39 current snap is 317 2024-03-30T12:33:12.771 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 39 to 309 2024-03-30T12:33:12.771 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 317 2024-03-30T12:33:12.771 INFO:tasks.rados.rados.0.smithi084.stdout:3167: seq_num 981 ranges {3596288=434176,4030464=540672,4571136=466944,5038080=524288,5562368=73728} 2024-03-30T12:33:12.792 INFO:tasks.rados.rados.0.smithi084.stdout:3167: writing smithi08477944-9 from 3596288 to 4030464 tid 1 2024-03-30T12:33:12.796 INFO:tasks.rados.rados.0.smithi084.stdout:3167: writing smithi08477944-9 from 4030464 to 4571136 tid 2 2024-03-30T12:33:12.799 INFO:tasks.rados.rados.0.smithi084.stdout:3167: writing smithi08477944-9 from 4571136 to 5038080 tid 3 2024-03-30T12:33:12.802 INFO:tasks.rados.rados.0.smithi084.stdout:3167: writing smithi08477944-9 from 5038080 to 5562368 tid 4 2024-03-30T12:33:12.803 INFO:tasks.rados.rados.0.smithi084.stdout:3167: writing smithi08477944-9 from 5562368 to 5636096 tid 5 2024-03-30T12:33:12.803 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 317 2024-03-30T12:33:12.803 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 36291 (ObjNum 49 snap 0 seq_num 1428895408) dirty exists 2024-03-30T12:33:12.803 INFO:tasks.rados.rados.0.smithi084.stdout:3168: seq_num 982 ranges {1605632=450560,2056192=425984,2482176=679936,3162112=466944,3629056=32768} 2024-03-30T12:33:12.815 INFO:tasks.rados.rados.0.smithi084.stdout:3168: writing smithi08477944-34 from 1605632 to 2056192 tid 1 2024-03-30T12:33:12.816 INFO:tasks.rados.rados.0.smithi084.stdout:3168: writing smithi08477944-34 from 2056192 to 2482176 tid 2 2024-03-30T12:33:12.820 INFO:tasks.rados.rados.0.smithi084.stdout:3168: writing smithi08477944-34 from 2482176 to 3162112 tid 3 2024-03-30T12:33:12.823 INFO:tasks.rados.rados.0.smithi084.stdout:3168: writing smithi08477944-34 from 3162112 to 3629056 tid 4 2024-03-30T12:33:12.824 INFO:tasks.rados.rados.0.smithi084.stdout:3168: writing smithi08477944-34 from 3629056 to 3661824 tid 5 2024-03-30T12:33:12.824 INFO:tasks.rados.rados.0.smithi084.stdout:3162: done (5 left) 2024-03-30T12:33:12.824 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 317 2024-03-30T12:33:12.824 INFO:tasks.rados.rados.0.smithi084.stdout:3166: finishing rollback tid 0 to smithi08477944-39 2024-03-30T12:33:12.824 INFO:tasks.rados.rados.0.smithi084.stdout:3166: finishing rollback tid 1 to smithi08477944-39 2024-03-30T12:33:12.824 INFO:tasks.rados.rados.0.smithi084.stdout:3169: seq_num 983 ranges {6758400=466944,7225344=712704,7938048=434176,8372224=458752} 2024-03-30T12:33:12.862 INFO:tasks.rados.rados.0.smithi084.stdout:3169: writing smithi08477944-44 from 6758400 to 7225344 tid 1 2024-03-30T12:33:12.866 INFO:tasks.rados.rados.0.smithi084.stdout:3169: writing smithi08477944-44 from 7225344 to 7938048 tid 2 2024-03-30T12:33:12.868 INFO:tasks.rados.rados.0.smithi084.stdout:3169: writing smithi08477944-44 from 7938048 to 8372224 tid 3 2024-03-30T12:33:12.871 INFO:tasks.rados.rados.0.smithi084.stdout:3169: writing smithi08477944-44 from 8372224 to 8830976 tid 4 2024-03-30T12:33:12.871 INFO:tasks.rados.rados.0.smithi084.stdout:3170: delete oid 27 current snap is 317 2024-03-30T12:33:12.871 INFO:tasks.rados.rados.0.smithi084.stdout:3166: finishing rollback tid 2 to smithi08477944-39 2024-03-30T12:33:12.871 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 27306 (ObjNum 935 snap 295 seq_num 935) dirty exists 2024-03-30T12:33:12.871 INFO:tasks.rados.rados.0.smithi084.stdout:3165: finishing rollback tid 1 to smithi08477944-2 2024-03-30T12:33:12.871 INFO:tasks.rados.rados.0.smithi084.stdout:3165: finishing rollback tid 2 to smithi08477944-2 2024-03-30T12:33:12.872 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 27377 (ObjNum 907 snap 288 seq_num 907) dirty exists 2024-03-30T12:33:12.872 INFO:tasks.rados.rados.0.smithi084.stdout:3167: finishing write tid 1 to smithi08477944-9 2024-03-30T12:33:12.872 INFO:tasks.rados.rados.0.smithi084.stdout:3167: finishing write tid 2 to smithi08477944-9 2024-03-30T12:33:12.872 INFO:tasks.rados.rados.0.smithi084.stdout:3163: expect (ObjNum 946 snap 301 seq_num 946) 2024-03-30T12:33:13.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:12.782+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:13.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:12.767+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:13.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:12.767+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:13.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:12.771+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:13.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:12.771+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:13.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:12.782+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:13.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:12.782+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:13.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:12.786+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:13.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:13.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:13.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:12 smithi162 ceph-mon[83709]: osdmap e699: 8 total, 8 up, 8 in 2024-03-30T12:33:13.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:13.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:13.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:13.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:13.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:13.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:13.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:13.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:13.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:13.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:13.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:13.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:12.778+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:13.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:12.780+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:13.274 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:12.775+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:13.274 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:12.776+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:13.274 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:12.776+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:13.275 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:12.776+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:13.275 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:12.777+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:13.275 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:13.275 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:13.275 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[89279]: osdmap e699: 8 total, 8 up, 8 in 2024-03-30T12:33:13.275 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:13.275 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:13.275 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:13.275 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:13.275 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:13.276 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:13.276 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:13.276 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:13.276 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:13.276 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:13.276 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:13.276 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:13.276 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:13.276 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[91810]: osdmap e699: 8 total, 8 up, 8 in 2024-03-30T12:33:13.276 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:13.276 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:13.276 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:13.277 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:13.277 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:13.277 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:13.277 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:13.277 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16f=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:13.277 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:13.277 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:13.277 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:13.434 INFO:tasks.rados.rados.0.smithi084.stdout:3167: finishing write tid 3 to smithi08477944-9 2024-03-30T12:33:13.434 INFO:tasks.rados.rados.0.smithi084.stdout:3167: finishing write tid 4 to smithi08477944-9 2024-03-30T12:33:13.434 INFO:tasks.rados.rados.0.smithi084.stdout:3167: finishing write tid 5 to smithi08477944-9 2024-03-30T12:33:13.434 INFO:tasks.rados.rados.0.smithi084.stdout:3167: finishing write tid 6 to smithi08477944-9 2024-03-30T12:33:13.434 INFO:tasks.rados.rados.0.smithi084.stdout:3167: finishing write tid 7 to smithi08477944-9 2024-03-30T12:33:13.434 INFO:tasks.rados.rados.0.smithi084.stdout:3167: oid 9 updating version 0 to 22516 2024-03-30T12:33:13.434 INFO:tasks.rados.rados.0.smithi084.stdout:3167: oid 9 updating version 22516 to 22519 2024-03-30T12:33:13.434 INFO:tasks.rados.rados.0.smithi084.stdout:3167: oid 9 version 22519 is already newer than 22518 2024-03-30T12:33:13.434 INFO:tasks.rados.rados.0.smithi084.stdout:3167: oid 9 version 22519 is already newer than 22515 2024-03-30T12:33:13.434 INFO:tasks.rados.rados.0.smithi084.stdout:3167: oid 9 updating version 22519 to 22520 2024-03-30T12:33:13.435 INFO:tasks.rados.rados.0.smithi084.stdout:3167: oid 9 version 22520 is already newer than 22517 2024-03-30T12:33:13.435 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 22520 (ObjNum 981 snap 317 seq_num 981) dirty exists 2024-03-30T12:33:13.435 INFO:tasks.rados.rados.0.smithi084.stdout:3167: left oid 9 (ObjNum 981 snap 317 seq_num 981) 2024-03-30T12:33:13.435 INFO:tasks.rados.rados.0.smithi084.stdout:3168: finishing write tid 1 to smithi08477944-34 2024-03-30T12:33:13.435 INFO:tasks.rados.rados.0.smithi084.stdout:3163: done (6 left) 2024-03-30T12:33:13.435 INFO:tasks.rados.rados.0.smithi084.stdout:3165: done (5 left) 2024-03-30T12:33:13.435 INFO:tasks.rados.rados.0.smithi084.stdout:3166: done (4 left) 2024-03-30T12:33:13.435 INFO:tasks.rados.rados.0.smithi084.stdout:3167: done (3 left) 2024-03-30T12:33:13.435 INFO:tasks.rados.rados.0.smithi084.stdout:3170: done (2 left) 2024-03-30T12:33:13.435 INFO:tasks.rados.rados.0.smithi084.stdout:3171: delete oid 46 current snap is 317 2024-03-30T12:33:13.435 INFO:tasks.rados.rados.0.smithi084.stdout:3168: finishing write tid 2 to smithi08477944-34 2024-03-30T12:33:13.435 INFO:tasks.rados.rados.0.smithi084.stdout:3168: finishing write tid 3 to smithi08477944-34 2024-03-30T12:33:13.435 INFO:tasks.rados.rados.0.smithi084.stdout:3168: finishing write tid 4 to smithi08477944-34 2024-03-30T12:33:13.436 INFO:tasks.rados.rados.0.smithi084.stdout:3168: finishing write tid 5 to smithi08477944-34 2024-03-30T12:33:13.436 INFO:tasks.rados.rados.0.smithi084.stdout:3168: finishing write tid 6 to smithi08477944-34 2024-03-30T12:33:13.436 INFO:tasks.rados.rados.0.smithi084.stdout:3168: finishing write tid 7 to smithi08477944-34 2024-03-30T12:33:13.436 INFO:tasks.rados.rados.0.smithi084.stdout:3168: oid 34 updating version 0 to 27240 2024-03-30T12:33:13.436 INFO:tasks.rados.rados.0.smithi084.stdout:3168: oid 34 updating version 27240 to 27242 2024-03-30T12:33:13.436 INFO:tasks.rados.rados.0.smithi084.stdout:3168: oid 34 version 27242 is already newer than 27241 2024-03-30T12:33:13.436 INFO:tasks.rados.rados.0.smithi084.stdout:3168: oid 34 version 27242 is already newer than 27239 2024-03-30T12:33:13.436 INFO:tasks.rados.rados.0.smithi084.stdout:3168: oid 34 updating version 27242 to 27244 2024-03-30T12:33:13.436 INFO:tasks.rados.rados.0.smithi084.stdout:3168: oid 34 version 27244 is already newer than 27243 2024-03-30T12:33:13.436 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 27244 (ObjNum 982 snap 317 seq_num 982) dirty exists 2024-03-30T12:33:13.436 INFO:tasks.rados.rados.0.smithi084.stdout:3168: left oid 34 (ObjNum 982 snap 317 seq_num 982) 2024-03-30T12:33:13.436 INFO:tasks.rados.rados.0.smithi084.stdout:3169: finishing write tid 1 to smithi08477944-44 2024-03-30T12:33:13.436 INFO:tasks.rados.rados.0.smithi084.stdout:3169: finishing write tid 2 to smithi08477944-44 2024-03-30T12:33:13.436 INFO:tasks.rados.rados.0.smithi084.stdout:3169: finishing write tid 3 to smithi08477944-44 2024-03-30T12:33:13.437 INFO:tasks.rados.rados.0.smithi084.stdout:3169: finishing write tid 4 to smithi08477944-44 2024-03-30T12:33:13.437 INFO:tasks.rados.rados.0.smithi084.stdout:3169: finishing write tid 5 to smithi08477944-44 2024-03-30T12:33:13.437 INFO:tasks.rados.rados.0.smithi084.stdout:3169: finishing write tid 6 to smithi08477944-44 2024-03-30T12:33:13.437 INFO:tasks.rados.rados.0.smithi084.stdout:3169: oid 44 updating version 0 to 36310 2024-03-30T12:33:13.437 INFO:tasks.rados.rados.0.smithi084.stdout:3169: oid 44 updating version 36310 to 36311 2024-03-30T12:33:13.437 INFO:tasks.rados.rados.0.smithi084.stdout:3169: oid 44 updating version 36311 to 36312 2024-03-30T12:33:13.437 INFO:tasks.rados.rados.0.smithi084.stdout:3169: oid 44 version 36312 is already newer than 36309 2024-03-30T12:33:13.437 INFO:tasks.rados.rados.0.smithi084.stdout:3169: oid 44 updating version 36312 to 36313 2024-03-30T12:33:13.437 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 36313 (ObjNum 983 snap 317 seq_num 983) dirty exists 2024-03-30T12:33:13.437 INFO:tasks.rados.rados.0.smithi084.stdout:3169: left oid 44 (ObjNum 983 snap 317 seq_num 983) 2024-03-30T12:33:13.438 INFO:tasks.rados.rados.0.smithi084.stdout:3168: done (2 left) 2024-03-30T12:33:13.438 INFO:tasks.rados.rados.0.smithi084.stdout:3169: done (1 left) 2024-03-30T12:33:13.439 INFO:tasks.rados.rados.0.smithi084.stdout:3171: done (0 left) 2024-03-30T12:33:13.439 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 317 2024-03-30T12:33:13.439 INFO:tasks.rados.rados.0.smithi084.stdout:3172: seq_num 986 ranges {0=516096,516096=770048,1286144=655360,1941504=180224} 2024-03-30T12:33:13.442 INFO:tasks.rados.rados.0.smithi084.stdout:3172: writing smithi08477944-37 from 0 to 516096 tid 1 2024-03-30T12:33:13.446 INFO:tasks.rados.rados.0.smithi084.stdout:3172: writing smithi08477944-37 from 516096 to 1286144 tid 2 2024-03-30T12:33:13.451 INFO:tasks.rados.rados.0.smithi084.stdout:3172: writing smithi08477944-37 from 1286144 to 1941504 tid 3 2024-03-30T12:33:13.452 INFO:tasks.rados.rados.0.smithi084.stdout:3172: writing smithi08477944-37 from 1941504 to 2121728 tid 4 2024-03-30T12:33:13.452 INFO:tasks.rados.rados.0.smithi084.stdout:3173: snap_create 2024-03-30T12:33:13.453 INFO:tasks.rados.rados.0.smithi084.stdout:3172: finishing write tid 1 to smithi08477944-37 2024-03-30T12:33:13.462 INFO:tasks.rados.rados.0.smithi084.stdout:3172: finishing write tid 2 to smithi08477944-37 2024-03-30T12:33:13.463 INFO:tasks.rados.rados.0.smithi084.stdout:3172: finishing write tid 3 to smithi08477944-37 2024-03-30T12:33:13.463 INFO:tasks.rados.rados.0.smithi084.stdout:3172: finishing write tid 4 to smithi08477944-37 2024-03-30T12:33:13.470 INFO:tasks.rados.rados.0.smithi084.stdout:3172: finishing write tid 5 to smithi08477944-37 2024-03-30T12:33:13.473 INFO:tasks.rados.rados.0.smithi084.stdout:3172: finishing write tid 6 to smithi08477944-37 2024-03-30T12:33:13.473 INFO:tasks.rados.rados.0.smithi084.stdout:3172: oid 37 updating version 0 to 36296 2024-03-30T12:33:13.473 INFO:tasks.rados.rados.0.smithi084.stdout:3172: oid 37 version 36296 is already newer than 36294 2024-03-30T12:33:13.473 INFO:tasks.rados.rados.0.smithi084.stdout:3172: oid 37 version 36296 is already newer than 36292 2024-03-30T12:33:13.473 INFO:tasks.rados.rados.0.smithi084.stdout:3172: oid 37 version 36296 is already newer than 36295 2024-03-30T12:33:13.474 INFO:tasks.rados.rados.0.smithi084.stdout:3172: oid 37 version 36296 is already newer than 36293 2024-03-30T12:33:13.474 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 36296 (ObjNum 986 snap 317 seq_num 986) dirty exists 2024-03-30T12:33:13.474 INFO:tasks.rados.rados.0.smithi084.stdout:3172: left oid 37 (ObjNum 986 snap 317 seq_num 986) 2024-03-30T12:33:13.770 INFO:tasks.rados.rados.0.smithi084.stdout:3172: done (1 left) 2024-03-30T12:33:13.770 INFO:tasks.rados.rados.0.smithi084.stdout:3173: done (0 left) 2024-03-30T12:33:13.770 INFO:tasks.rados.rados.0.smithi084.stdout:3174: read oid 25 snap -1 2024-03-30T12:33:13.770 INFO:tasks.rados.rados.0.smithi084.stdout:3174: expect deleted 2024-03-30T12:33:13.771 INFO:tasks.rados.rados.0.smithi084.stdout:3175: rollback oid 21 current snap is 318 2024-03-30T12:33:13.771 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 21 to 292 2024-03-30T12:33:13.771 INFO:tasks.rados.rados.0.smithi084.stdout:3176: read oid 35 snap 311 2024-03-30T12:33:13.771 INFO:tasks.rados.rados.0.smithi084.stdout:3176: expect (ObjNum 664 snap 232 seq_num 664) 2024-03-30T12:33:13.771 INFO:tasks.rados.rados.0.smithi084.stdout:3177: snap_create 2024-03-30T12:33:13.777 INFO:tasks.rados.rados.0.smithi084.stdout:3176: expect (ObjNum 664 snap 232 seq_num 664) 2024-03-30T12:33:13.818 INFO:tasks.rados.rados.0.smithi084.stdout:3175: finishing rollback tid 1 to smithi08477944-21 2024-03-30T12:33:13.818 INFO:tasks.rados.rados.0.smithi084.stdout:3175: finishing rollback tid 2 to smithi08477944-21 2024-03-30T12:33:13.819 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 25302 (ObjNum 901 snap 287 seq_num 901) dirty exists 2024-03-30T12:33:14.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:13.865+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:14.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:13.776+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:14.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:13.776+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:14.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:13.776+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:14.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:13.778+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:14.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:13.778+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:14.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:13.783+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:14.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:13.783+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:13 smithi162 ceph-mon[83709]: pgmap v738: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 916 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 8.1 MiB/s rd, 1021 KiB/s wr, 12 op/s 2024-03-30T12:33:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:13 smithi162 ceph-mon[83709]: osdmap e700: 8 total, 8 up, 8 in 2024-03-30T12:33:14.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:14.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:14.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:14.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:14.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:14.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:14.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:14.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:14.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:14.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:13.782+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:14.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:13.782+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:14.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[91810]: pgmap v738: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 916 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 8.1 MiB/s rd, 1021 KiB/s wr, 12 op/s 2024-03-30T12:33:14.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:14.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:14.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:14.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:14.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[91810]: osdmap e700: 8 total, 8 up, 8 in 2024-03-30T12:33:14.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:14.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:14.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:14.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:14.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:14.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:14.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:14.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:14.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:14.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:13.857+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:14.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:13.857+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:14.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:13.857+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:14.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:13.857+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:14.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:13.857+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:14.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:13.857+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:14.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[89279]: pgmap v738: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 916 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 8.1 MiB/s rd, 1021 KiB/s wr, 12 op/s 2024-03-30T12:33:14.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:14.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:14.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:14.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:14.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[89279]: osdmap e700: 8 total, 8 up, 8 in 2024-03-30T12:33:14.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:14.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:14.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:14.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:14.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:14.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:14.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:14.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:14.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:14.777 INFO:tasks.rados.rados.0.smithi084.stdout:3174: done (3 left) 2024-03-30T12:33:14.777 INFO:tasks.rados.rados.0.smithi084.stdout:3175: done (2 left) 2024-03-30T12:33:14.777 INFO:tasks.rados.rados.0.smithi084.stdout:3176: done (1 left) 2024-03-30T12:33:14.777 INFO:tasks.rados.rados.0.smithi084.stdout:3177: done (0 left) 2024-03-30T12:33:14.777 INFO:tasks.rados.rados.0.smithi084.stdout:3178: setattr oid 4 current snap is 319 2024-03-30T12:33:14.778 INFO:tasks.rados.rados.0.smithi084.stdout:3179: setattr oid 39 current snap is 319 2024-03-30T12:33:14.778 INFO:tasks.rados.rados.0.smithi084.stdout:3180: snap_create 2024-03-30T12:33:14.784 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 23428 (ObjNum 972 snap 314 seq_num 972) dirty exists 2024-03-30T12:33:14.786 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 27307 (ObjNum 935 snap 295 seq_num 935) dirty exists 2024-03-30T12:33:15.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:14.795+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:15.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:14.784+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17c=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:15.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:14.784+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:15.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:14.786+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:15.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:14.786+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:15.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:14.794+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:15.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:14.794+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:15.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:14.794+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:15.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:15.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:15.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:14 smithi162 ceph-mon[83709]: osdmap e701: 8 total, 8 up, 8 in 2024-03-30T12:33:15.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:15.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:15.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:15.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:15.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:15.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:15.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:15.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:15.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:15.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:15.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:15.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:14 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:33:15.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:14.791+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:15.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:14.792+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:15.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:14.788+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:15.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:14.789+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:15.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:14.789+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:15.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:14.789+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:15.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:14.791+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:15.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:15.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:15.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[91810]: osdmap e701: 8 total, 8 up, 8 in 2024-03-30T12:33:15.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:15.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:15.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:15.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:15.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:15.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:15.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:15.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:15.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:15.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:15.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:15.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:33:15.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:15.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 165=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:15.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[89279]: osdmap e701: 8 total, 8 up, 8 in 2024-03-30T12:33:15.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:15.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:15.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:15.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:15.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:15.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:15.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:15.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:15.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:15.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:15.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:15.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:14 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:33:15.787 INFO:tasks.rados.rados.0.smithi084.stdout:3178: done (2 left) 2024-03-30T12:33:15.788 INFO:tasks.rados.rados.0.smithi084.stdout:3179: done (1 left) 2024-03-30T12:33:15.788 INFO:tasks.rados.rados.0.smithi084.stdout:3180: done (0 left) 2024-03-30T12:33:15.788 INFO:tasks.rados.rados.0.smithi084.stdout:3181: rollback oid 29 current snap is 320 2024-03-30T12:33:15.788 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 29 to 307 2024-03-30T12:33:15.788 INFO:tasks.rados.rados.0.smithi084.stdout:3182: rollback oid 14 current snap is 320 2024-03-30T12:33:15.788 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 14 to 300 2024-03-30T12:33:15.788 INFO:tasks.rados.rados.0.smithi084.stdout:3183: snap_remove snap 316 2024-03-30T12:33:16.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:15.808+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:16.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:15.793+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:16.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:15.793+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17c=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:16.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:15.793+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:16.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:15.801+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:16.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:15.801+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:16.121 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:15.795+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:16.121 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:15.795+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:16.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:15 smithi162 ceph-mon[83709]: pgmap v741: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 932 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 6.0 MiB/s rd, 4.6 MiB/s wr, 31 op/s 2024-03-30T12:33:16.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17c=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:16.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:16.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:15 smithi162 ceph-mon[83709]: osdmap e702: 8 total, 8 up, 8 in 2024-03-30T12:33:16.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:16.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:16.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:16.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:16.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:16.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:16.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:16.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:16.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:16.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:16.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:16.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:15.799+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:16.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:15.799+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:16.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[91810]: pgmap v741: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 932 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 6.0 MiB/s rd, 4.6 MiB/s wr, 31 op/s 2024-03-30T12:33:16.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17c=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:16.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:16.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[91810]: osdmap e702: 8 total, 8 up, 8 in 2024-03-30T12:33:16.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:16.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:16.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:16.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:16.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:16.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:16.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:16.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:16.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:16.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:16.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:16.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:15.794+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:16.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:15.794+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:16.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:15.794+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:16.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:15.794+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:16.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:15.794+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:16.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:15.794+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:16.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[89279]: pgmap v741: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 932 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 6.0 MiB/s rd, 4.6 MiB/s wr, 31 op/s 2024-03-30T12:33:16.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17c=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:16.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:16.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[89279]: osdmap e702: 8 total, 8 up, 8 in 2024-03-30T12:33:16.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:16.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:16.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:16.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:16.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:16.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:16.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:16.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:16.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:16.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:16.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:16.795 INFO:tasks.rados.rados.0.smithi084.stdout:3183: done (2 left) 2024-03-30T12:33:16.795 INFO:tasks.rados.rados.0.smithi084.stdout:3184: rmattr oid 43 current snap is 320 2024-03-30T12:33:16.795 INFO:tasks.rados.rados.0.smithi084.stdout:3181: finishing rollback tid 1 to smithi08477944-29 2024-03-30T12:33:16.795 INFO:tasks.rados.rados.0.smithi084.stdout:3181: finishing rollback tid 2 to smithi08477944-29 2024-03-30T12:33:16.795 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 23430 (ObjNum 946 snap 301 seq_num 946) dirty exists 2024-03-30T12:33:16.795 INFO:tasks.rados.rados.0.smithi084.stdout:3182: finishing rollback tid 0 to smithi08477944-14 2024-03-30T12:33:16.795 INFO:tasks.rados.rados.0.smithi084.stdout:3182: finishing rollback tid 1 to smithi08477944-14 2024-03-30T12:33:16.795 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 36298 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-03-30T12:33:16.796 INFO:tasks.rados.rados.0.smithi084.stdout:3181: done (2 left) 2024-03-30T12:33:16.796 INFO:tasks.rados.rados.0.smithi084.stdout:3182: done (1 left) 2024-03-30T12:33:16.796 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 320 2024-03-30T12:33:16.796 INFO:tasks.rados.rados.0.smithi084.stdout:3185: seq_num 987 ranges {1892352=532480,2424832=647168,3072000=417792,3489792=409600,3899392=131072} 2024-03-30T12:33:16.807 INFO:tasks.rados.rados.0.smithi084.stdout:3185: writing smithi08477944-4 from 1892352 to 2424832 tid 1 2024-03-30T12:33:16.811 INFO:tasks.rados.rados.0.smithi084.stdout:3185: writing smithi08477944-4 from 2424832 to 3072000 tid 2 2024-03-30T12:33:16.814 INFO:tasks.rados.rados.0.smithi084.stdout:3185: writing smithi08477944-4 from 3072000 to 3489792 tid 3 2024-03-30T12:33:16.816 INFO:tasks.rados.rados.0.smithi084.stdout:3185: writing smithi08477944-4 from 3489792 to 3899392 tid 4 2024-03-30T12:33:16.818 INFO:tasks.rados.rados.0.smithi084.stdout:3185: writing smithi08477944-4 from 3899392 to 4030464 tid 5 2024-03-30T12:33:16.818 INFO:tasks.rados.rados.0.smithi084.stdout:3186: read oid 23 snap -1 2024-03-30T12:33:16.818 INFO:tasks.rados.rados.0.smithi084.stdout:3186: expect (ObjNum 946 snap 301 seq_num 946) 2024-03-30T12:33:16.818 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 320 2024-03-30T12:33:16.818 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 36315 (ObjNum 843 snap 273 seq_num 843) dirty exists 2024-03-30T12:33:16.818 INFO:tasks.rados.rados.0.smithi084.stdout:3185: finishing write tid 1 to smithi08477944-4 2024-03-30T12:33:16.818 INFO:tasks.rados.rados.0.smithi084.stdout:3185: finishing write tid 2 to smithi08477944-4 2024-03-30T12:33:16.818 INFO:tasks.rados.rados.0.smithi084.stdout:3187: seq_num 988 ranges {2433024=557056,2990080=532480,3522560=622592,4145152=450560} 2024-03-30T12:33:16.835 INFO:tasks.rados.rados.0.smithi084.stdout:3187: writing smithi08477944-21 from 2433024 to 2990080 tid 1 2024-03-30T12:33:16.838 INFO:tasks.rados.rados.0.smithi084.stdout:3187: writing smithi08477944-21 from 2990080 to 3522560 tid 2 2024-03-30T12:33:16.842 INFO:tasks.rados.rados.0.smithi084.stdout:3187: writing smithi08477944-21 from 3522560 to 4145152 tid 3 2024-03-30T12:33:16.845 INFO:tasks.rados.rados.0.smithi084.stdout:3187: writing smithi08477944-21 from 4145152 to 4595712 tid 4 2024-03-30T12:33:16.845 INFO:tasks.rados.rados.0.smithi084.stdout:3184: done (3 left) 2024-03-30T12:33:16.845 INFO:tasks.rados.rados.0.smithi084.stdout:3188: snap_remove snap 318 2024-03-30T12:33:17.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:16.801+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17c=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:17.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:16.801+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:17.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:16.805+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:17.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:16.805+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:17.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:16.805+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:17.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:16.800+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:17.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:16.801+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:17.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17c=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:17.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:17.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:17.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:17.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:17.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:17.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:17.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:17.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:16 smithi162 ceph-mon[83709]: osdmap e703: 8 total, 8 up, 8 in 2024-03-30T12:33:17.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:17.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:17.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:17.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:17.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:17.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:16.821+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:17.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:16.821+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:17.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17c=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:17.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:17.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:17.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:17.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:17.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:17.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:17.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:17.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[91810]: osdmap e703: 8 total, 8 up, 8 in 2024-03-30T12:33:17.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:17.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:17.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:17.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:17.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:17.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:16.799+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:17.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:16.799+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:17.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:16.800+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:17.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:16.800+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:17.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:16.800+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:17.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17c=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:17.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:17.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:17.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:17.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:17.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:17.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:17.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:17.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[89279]: osdmap e703: 8 total, 8 up, 8 in 2024-03-30T12:33:17.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:17.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:17.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:17.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:17.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:17.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:17.154+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:17.804 INFO:tasks.rados.rados.0.smithi084.stdout:3188: done (3 left) 2024-03-30T12:33:17.805 INFO:tasks.rados.rados.0.smithi084.stdout:3189: delete oid 49 current snap is 320 2024-03-30T12:33:17.805 INFO:tasks.rados.rados.0.smithi084.stdout:3185: finishing write tid 3 to smithi08477944-4 2024-03-30T12:33:17.805 INFO:tasks.rados.rados.0.smithi084.stdout:3185: finishing write tid 4 to smithi08477944-4 2024-03-30T12:33:17.805 INFO:tasks.rados.rados.0.smithi084.stdout:3185: finishing write tid 5 to smithi08477944-4 2024-03-30T12:33:17.805 INFO:tasks.rados.rados.0.smithi084.stdout:3185: finishing write tid 6 to smithi08477944-4 2024-03-30T12:33:17.805 INFO:tasks.rados.rados.0.smithi084.stdout:3185: finishing write tid 7 to smithi08477944-4 2024-03-30T12:33:17.805 INFO:tasks.rados.rados.0.smithi084.stdout:3185: oid 4 updating version 0 to 23433 2024-03-30T12:33:17.805 INFO:tasks.rados.rados.0.smithi084.stdout:3185: oid 4 updating version 23433 to 23436 2024-03-30T12:33:17.805 INFO:tasks.rados.rados.0.smithi084.stdout:3185: oid 4 version 23436 is already newer than 23432 2024-03-30T12:33:17.805 INFO:tasks.rados.rados.0.smithi084.stdout:3185: oid 4 version 23436 is already newer than 23431 2024-03-30T12:33:17.805 INFO:tasks.rados.rados.0.smithi084.stdout:3185: oid 4 version 23436 is already newer than 23434 2024-03-30T12:33:17.805 INFO:tasks.rados.rados.0.smithi084.stdout:3185: oid 4 version 23436 is already newer than 23435 2024-03-30T12:33:17.805 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 23436 (ObjNum 987 snap 320 seq_num 987) dirty exists 2024-03-30T12:33:17.805 INFO:tasks.rados.rados.0.smithi084.stdout:3185: left oid 4 (ObjNum 987 snap 320 seq_num 987) 2024-03-30T12:33:17.806 INFO:tasks.rados.rados.0.smithi084.stdout:3186: expect (ObjNum 946 snap 301 seq_num 946) 2024-03-30T12:33:18.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:17.812+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:18.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:17.812+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:18.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:17.808+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:18.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:17.809+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:18.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:17.809+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17e=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:18.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:17 smithi162 ceph-mon[83709]: pgmap v744: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 935 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 7.0 MiB/s rd, 4.6 MiB/s wr, 33 op/s 2024-03-30T12:33:18.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:18.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:18.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:18.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:18.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:18.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17c=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:18.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:18.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:18.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:17 smithi162 ceph-mon[83709]: osdmap e704: 8 total, 8 up, 8 in 2024-03-30T12:33:18.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:18.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:18.245 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:17.816+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:18.246 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:17.816+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:18.246 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-mon[89279]: pgmap v744: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 935 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 7.0 MiB/s rd, 4.6 MiB/s wr, 33 op/s 2024-03-30T12:33:18.246 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:18.246 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:18.246 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:18.247 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:18.247 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:18.247 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17c=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:18.247 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:18.247 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:18.247 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-mon[89279]: osdmap e704: 8 total, 8 up, 8 in 2024-03-30T12:33:18.247 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:18.247 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:18.247 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-mon[91810]: pgmap v744: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 935 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 7.0 MiB/s rd, 4.6 MiB/s wr, 33 op/s 2024-03-30T12:33:18.248 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:18.248 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:18.248 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:18.248 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:18.248 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:18.248 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17c=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:18.248 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:18.248 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:18.248 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-mon[91810]: osdmap e704: 8 total, 8 up, 8 in 2024-03-30T12:33:18.248 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:18.248 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:18.368 INFO:tasks.rados.rados.0.smithi084.stdout:3187: finishing write tid 1 to smithi08477944-21 2024-03-30T12:33:18.368 INFO:tasks.rados.rados.0.smithi084.stdout:3187: finishing write tid 2 to smithi08477944-21 2024-03-30T12:33:18.368 INFO:tasks.rados.rados.0.smithi084.stdout:3187: finishing write tid 3 to smithi08477944-21 2024-03-30T12:33:18.368 INFO:tasks.rados.rados.0.smithi084.stdout:3187: finishing write tid 4 to smithi08477944-21 2024-03-30T12:33:18.368 INFO:tasks.rados.rados.0.smithi084.stdout:3187: finishing write tid 5 to smithi08477944-21 2024-03-30T12:33:18.369 INFO:tasks.rados.rados.0.smithi084.stdout:3187: finishing write tid 6 to smithi08477944-21 2024-03-30T12:33:18.369 INFO:tasks.rados.rados.0.smithi084.stdout:3187: oid 21 updating version 0 to 25304 2024-03-30T12:33:18.369 INFO:tasks.rados.rados.0.smithi084.stdout:3187: oid 21 updating version 25304 to 25305 2024-03-30T12:33:18.369 INFO:tasks.rados.rados.0.smithi084.stdout:3187: oid 21 updating version 25305 to 25306 2024-03-30T12:33:18.369 INFO:tasks.rados.rados.0.smithi084.stdout:3187: oid 21 updating version 25306 to 25307 2024-03-30T12:33:18.369 INFO:tasks.rados.rados.0.smithi084.stdout:3187: oid 21 updating version 25307 to 25308 2024-03-30T12:33:18.369 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 25308 (ObjNum 988 snap 320 seq_num 988) dirty exists 2024-03-30T12:33:18.369 INFO:tasks.rados.rados.0.smithi084.stdout:3187: left oid 21 (ObjNum 988 snap 320 seq_num 988) 2024-03-30T12:33:18.369 INFO:tasks.rados.rados.0.smithi084.stdout:3185: done (3 left) 2024-03-30T12:33:18.369 INFO:tasks.rados.rados.0.smithi084.stdout:3186: done (2 left) 2024-03-30T12:33:18.369 INFO:tasks.rados.rados.0.smithi084.stdout:3187: done (1 left) 2024-03-30T12:33:18.370 INFO:tasks.rados.rados.0.smithi084.stdout:3189: done (0 left) 2024-03-30T12:33:18.370 INFO:tasks.rados.rados.0.smithi084.stdout:3190: rollback oid 8 current snap is 320 2024-03-30T12:33:18.370 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 8 to 305 2024-03-30T12:33:18.370 INFO:tasks.rados.rados.0.smithi084.stdout:3191: read oid 28 snap -1 2024-03-30T12:33:18.370 INFO:tasks.rados.rados.0.smithi084.stdout:3191: expect deleted 2024-03-30T12:33:18.370 INFO:tasks.rados.rados.0.smithi084.stdout:3192: delete oid 43 current snap is 320 2024-03-30T12:33:18.373 INFO:tasks.rados.rados.0.smithi084.stdout:3191: done (2 left) 2024-03-30T12:33:18.373 INFO:tasks.rados.rados.0.smithi084.stdout:3192: done (1 left) 2024-03-30T12:33:18.373 INFO:tasks.rados.rados.0.smithi084.stdout:3193: snap_remove snap 317 2024-03-30T12:33:18.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:18.252+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:18.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:18.253+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:18.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:18.253+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:18.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:18.253+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:18.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:18.253+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:18.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:18.253+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:18.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:18.254+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:18.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:18.221+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:18.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:18.221+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:18.808 INFO:tasks.rados.rados.0.smithi084.stdout:3193: done (1 left) 2024-03-30T12:33:18.809 INFO:tasks.rados.rados.0.smithi084.stdout:3194: rollback oid 26 current snap is 320 2024-03-30T12:33:18.809 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 26 to 312 2024-03-30T12:33:18.809 INFO:tasks.rados.rados.0.smithi084.stdout:3190: finishing rollback tid 0 to smithi08477944-8 2024-03-30T12:33:18.809 INFO:tasks.rados.rados.0.smithi084.stdout:3190: finishing rollback tid 1 to smithi08477944-8 2024-03-30T12:33:18.809 INFO:tasks.rados.rados.0.smithi084.stdout:3190: finishing rollback tid 2 to smithi08477944-8 2024-03-30T12:33:18.809 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 27383 (ObjNum 950 snap 302 seq_num 950) dirty exists 2024-03-30T12:33:18.809 INFO:tasks.rados.rados.0.smithi084.stdout:3190: done (1 left) 2024-03-30T12:33:18.809 INFO:tasks.rados.rados.0.smithi084.stdout:3195: rollback oid 7 current snap is 320 2024-03-30T12:33:18.809 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 7 to 313 2024-03-30T12:33:18.809 INFO:tasks.rados.rados.0.smithi084.stdout:3196: rollback oid 32 current snap is 320 2024-03-30T12:33:18.809 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 32 to 319 2024-03-30T12:33:18.809 INFO:tasks.rados.rados.0.smithi084.stdout:3197: delete oid 46 current snap is 320 2024-03-30T12:33:18.813 INFO:tasks.rados.rados.0.smithi084.stdout:3195: finishing rollback tid 1 to smithi08477944-7 2024-03-30T12:33:18.813 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 23446 (ObjNum 49 snap 0 seq_num 194723834) dirty dne 2024-03-30T12:33:18.813 INFO:tasks.rados.rados.0.smithi084.stdout:3196: finishing rollback tid 1 to smithi08477944-32 2024-03-30T12:33:18.813 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 36279 (ObjNum 65 snap 0 seq_num 1901490029) dirty dne 2024-03-30T12:33:18.822 INFO:tasks.rados.rados.0.smithi084.stdout:3194: finishing rollback tid 0 to smithi08477944-26 2024-03-30T12:33:18.824 INFO:tasks.rados.rados.0.smithi084.stdout:3194: finishing rollback tid 1 to smithi08477944-26 2024-03-30T12:33:18.824 INFO:tasks.rados.rados.0.smithi084.stdout:3194: finishing rollback tid 2 to smithi08477944-26 2024-03-30T12:33:18.825 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 27387 (ObjNum 938 snap 299 seq_num 938) dirty exists 2024-03-30T12:33:18.828 INFO:tasks.rados.rados.0.smithi084.stdout:3194: done (3 left) 2024-03-30T12:33:18.828 INFO:tasks.rados.rados.0.smithi084.stdout:3195: done (2 left) 2024-03-30T12:33:18.829 INFO:tasks.rados.rados.0.smithi084.stdout:3196: done (1 left) 2024-03-30T12:33:18.829 INFO:tasks.rados.rados.0.smithi084.stdout:3197: done (0 left) 2024-03-30T12:33:18.829 INFO:tasks.rados.rados.0.smithi084.stdout:3198: delete oid 28 current snap is 320 2024-03-30T12:33:18.831 INFO:tasks.rados.rados.0.smithi084.stdout:3198: done (0 left) 2024-03-30T12:33:18.831 INFO:tasks.rados.rados.0.smithi084.stdout:3199: rmattr oid 44 current snap is 320 2024-03-30T12:33:18.831 INFO:tasks.rados.rados.0.smithi084.stdout:3200: read oid 37 snap -1 2024-03-30T12:33:18.831 INFO:tasks.rados.rados.0.smithi084.stdout:3200: expect (ObjNum 986 snap 317 seq_num 986) 2024-03-30T12:33:18.831 INFO:tasks.rados.rados.0.smithi084.stdout:3201: snap_create 2024-03-30T12:33:18.838 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 36318 (ObjNum 983 snap 317 seq_num 983) dirty exists 2024-03-30T12:33:18.845 INFO:tasks.rados.rados.0.smithi084.stdout:3200: expect (ObjNum 986 snap 317 seq_num 986) 2024-03-30T12:33:19.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:18.849+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:19.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:18.817+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:19.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:18.817+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:19.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:18.823+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:19.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:18.823+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17e=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:19.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:18.817+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:19.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:18.817+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:19.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:18.831+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:19.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:19.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:19.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:19.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:19.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17e=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:19.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:18 smithi162 ceph-mon[83709]: osdmap e705: 8 total, 8 up, 8 in 2024-03-30T12:33:19.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:19.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:19.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:19.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:19.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:18 smithi162 ceph-mon[83709]: pgmap v747: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 952 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 5.9 MiB/s rd, 2.0 MiB/s wr, 20 op/s 2024-03-30T12:33:19.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:18.819+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:19.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:18.820+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:19.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:19.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:19.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:19.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:19.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17e=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:19.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-mon[91810]: osdmap e705: 8 total, 8 up, 8 in 2024-03-30T12:33:19.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:19.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:19.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:19.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:19.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-mon[91810]: pgmap v747: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 952 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 5.9 MiB/s rd, 2.0 MiB/s wr, 20 op/s 2024-03-30T12:33:19.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:18.814+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:19.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:18.814+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:19.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:18.815+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:19.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:18.815+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:19.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:18.815+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:19.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:19.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:19.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:19.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:19.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17e=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:19.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-mon[89279]: osdmap e705: 8 total, 8 up, 8 in 2024-03-30T12:33:19.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:19.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:19.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:19.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:19.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:18 smithi084 ceph-mon[89279]: pgmap v747: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 952 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 5.9 MiB/s rd, 2.0 MiB/s wr, 20 op/s 2024-03-30T12:33:19.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:33:19] "GET /metrics HTTP/1.1" 200 36329 "" "Prometheus/2.43.0" 2024-03-30T12:33:19.817 INFO:tasks.rados.rados.0.smithi084.stdout:3199: done (2 left) 2024-03-30T12:33:19.817 INFO:tasks.rados.rados.0.smithi084.stdout:3200: done (1 left) 2024-03-30T12:33:19.817 INFO:tasks.rados.rados.0.smithi084.stdout:3201: done (0 left) 2024-03-30T12:33:19.817 INFO:tasks.rados.rados.0.smithi084.stdout:3202: delete oid 10 current snap is 321 2024-03-30T12:33:19.826 INFO:tasks.rados.rados.0.smithi084.stdout:3202: done (0 left) 2024-03-30T12:33:19.826 INFO:tasks.rados.rados.0.smithi084.stdout:3203: copy_from oid 32 from oid 4 current snap is 321 2024-03-30T12:33:19.826 INFO:tasks.rados.rados.0.smithi084.stdout:3204: read oid 44 snap -1 2024-03-30T12:33:19.826 INFO:tasks.rados.rados.0.smithi084.stdout:3204: expect (ObjNum 983 snap 317 seq_num 983) 2024-03-30T12:33:19.826 INFO:tasks.rados.rados.0.smithi084.stdout:3205: rollback oid 19 current snap is 321 2024-03-30T12:33:19.826 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 19 to 300 2024-03-30T12:33:19.826 INFO:tasks.rados.rados.0.smithi084.stdout:3206: delete oid 27 current snap is 321 2024-03-30T12:33:19.833 INFO:tasks.rados.rados.0.smithi084.stdout:3206: done (3 left) 2024-03-30T12:33:19.833 INFO:tasks.rados.rados.0.smithi084.stdout:3207: read oid 36 snap -1 2024-03-30T12:33:19.833 INFO:tasks.rados.rados.0.smithi084.stdout:3207: expect (ObjNum 905 snap 287 seq_num 905) 2024-03-30T12:33:19.833 INFO:tasks.rados.rados.0.smithi084.stdout:3208: copy_from oid 28 from oid 22 current snap is 321 2024-03-30T12:33:19.834 INFO:tasks.rados.rados.0.smithi084.stdout:3209: snap_remove snap 309 2024-03-30T12:33:20.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:19.833+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17f=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:20.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:19.837+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:20.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:19.839+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:20.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:19.822+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:20.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:19.822+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:20.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:19.822+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17e=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:20.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:19.832+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:20.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:19.832+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-mon[83709]: osdmap e706: 8 total, 8 up, 8 in 2024-03-30T12:33:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17e=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:20.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:20.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:19.831+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:20.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:19.831+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:20.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:19.823+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:20.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:19.823+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:20.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:19.823+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:20.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:19.824+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:20.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:19.824+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:20.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:19.824+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:20.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:20.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:20.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:20.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:20.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:20.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:20.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:20.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:20.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:20.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:20.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:20.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[89279]: osdmap e706: 8 total, 8 up, 8 in 2024-03-30T12:33:20.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:20.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:20.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:20.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:20.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:20.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:20.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:20.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:20.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:20.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:20.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:20.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:20.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:20.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:20.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:20.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:20.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:20.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[91810]: osdmap e706: 8 total, 8 up, 8 in 2024-03-30T12:33:20.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:20.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:20.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:20.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:20.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:20.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:20.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17e=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:20.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:20.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:20.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17e=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:20.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:20.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 177=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:20.832 INFO:tasks.rados.rados.0.smithi084.stdout:3209: done (5 left) 2024-03-30T12:33:20.832 INFO:tasks.rados.rados.0.smithi084.stdout:3210: snap_remove snap 315 2024-03-30T12:33:21.114 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:20.836+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:21.114 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:20.836+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:21.114 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:20.833+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:21.114 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:20.833+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17e=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:21.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:21.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17e=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:21.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:21.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:21.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:20 smithi162 ceph-mon[83709]: osdmap e707: 8 total, 8 up, 8 in 2024-03-30T12:33:21.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:21.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:21.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:21.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:21.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:21.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:21.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17f=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:21.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:21.116 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:21.116 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:20 smithi162 ceph-mon[83709]: pgmap v750: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 953 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2024-03-30T12:33:21.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:20.942+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:21.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:20.943+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:21.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:21.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17e=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:21.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:21.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:21.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[91810]: osdmap e707: 8 total, 8 up, 8 in 2024-03-30T12:33:21.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:21.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:21.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:21.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:21.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:21.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:21.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17f=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:21.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:21.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:21.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[91810]: pgmap v750: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 953 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2024-03-30T12:33:21.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:21.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17e=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:21.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:21.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:21.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[89279]: osdmap e707: 8 total, 8 up, 8 in 2024-03-30T12:33:21.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:21.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:21.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:21.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:21.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:21.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:21.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17f=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:21.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:21.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:21.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:20 smithi084 ceph-mon[89279]: pgmap v750: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 953 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2024-03-30T12:33:21.369 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:21.121+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:21.369 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:21.122+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:21.369 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:21.122+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:21.833 INFO:tasks.rados.rados.0.smithi084.stdout:3210: done (5 left) 2024-03-30T12:33:21.833 INFO:tasks.rados.rados.0.smithi084.stdout:3211: rollback oid 42 current snap is 321 2024-03-30T12:33:21.833 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 42 to 300 2024-03-30T12:33:21.833 INFO:tasks.rados.rados.0.smithi084.stdout:3203: finishing copy_from racing read to smithi08477944-32 2024-03-30T12:33:21.833 INFO:tasks.rados.rados.0.smithi084.stdout:3207: expect (ObjNum 905 snap 287 seq_num 905) 2024-03-30T12:33:21.857 INFO:tasks.rados.rados.0.smithi084.stdout:3208: finishing copy_from racing read to smithi08477944-28 2024-03-30T12:33:21.857 INFO:tasks.rados.rados.0.smithi084.stdout:3208: finishing copy_from to smithi08477944-28 2024-03-30T12:33:21.857 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 27375 (ObjNum 947 snap 301 seq_num 947) dirty exists 2024-03-30T12:33:21.857 INFO:tasks.rados.rados.0.smithi084.stdout:3203: finishing copy_from to smithi08477944-32 2024-03-30T12:33:21.857 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 23436 (ObjNum 987 snap 320 seq_num 987) dirty exists 2024-03-30T12:33:21.857 INFO:tasks.rados.rados.0.smithi084.stdout:3205: finishing rollback tid 0 to smithi08477944-19 2024-03-30T12:33:21.857 INFO:tasks.rados.rados.0.smithi084.stdout:3204: expect (ObjNum 983 snap 317 seq_num 983) 2024-03-30T12:33:22.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:21.846+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:22.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:21.846+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:22.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:22.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17e=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:22.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:22.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:22.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-mon[89279]: osdmap e708: 8 total, 8 up, 8 in 2024-03-30T12:33:22.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:22.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:22.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:22.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:22.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:22.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17e=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:22.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:22.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:22.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-mon[91810]: osdmap e708: 8 total, 8 up, 8 in 2024-03-30T12:33:22.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:22.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:22.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:22.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:22.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:21.648+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:22.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:21.648+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:22.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:21.648+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:22.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:21.648+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:22.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:21.648+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:22.007 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:21.840+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:22.007 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:21.840+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:22.007 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:21.840+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:22.007 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:21.840+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:22.007 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:21.840+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:22.007 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:21.840+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:22.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:21.850+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17f=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:22.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:21.842+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:22.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:21.842+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17e=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:22.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:21.842+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:22.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:21.841+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:22.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:21.841+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:22.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:22.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17e=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:22.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:22.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:22.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:21 smithi162 ceph-mon[83709]: osdmap e708: 8 total, 8 up, 8 in 2024-03-30T12:33:22.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:22.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:22.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:22.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:22.122 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:21.844+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:22.122 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:21.845+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:22.432 INFO:tasks.rados.rados.0.smithi084.stdout:3205: finishing rollback tid 1 to smithi08477944-19 2024-03-30T12:33:22.432 INFO:tasks.rados.rados.0.smithi084.stdout:3205: finishing rollback tid 2 to smithi08477944-19 2024-03-30T12:33:22.432 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 36322 (ObjNum 912 snap 290 seq_num 912) dirty exists 2024-03-30T12:33:22.432 INFO:tasks.rados.rados.0.smithi084.stdout:3211: finishing rollback tid 0 to smithi08477944-42 2024-03-30T12:33:22.432 INFO:tasks.rados.rados.0.smithi084.stdout:3211: finishing rollback tid 1 to smithi08477944-42 2024-03-30T12:33:22.432 INFO:tasks.rados.rados.0.smithi084.stdout:3203: done (5 left) 2024-03-30T12:33:22.433 INFO:tasks.rados.rados.0.smithi084.stdout:3204: done (4 left) 2024-03-30T12:33:22.433 INFO:tasks.rados.rados.0.smithi084.stdout:3205: done (3 left) 2024-03-30T12:33:22.433 INFO:tasks.rados.rados.0.smithi084.stdout:3207: done (2 left) 2024-03-30T12:33:22.433 INFO:tasks.rados.rados.0.smithi084.stdout:3208: done (1 left) 2024-03-30T12:33:22.433 INFO:tasks.rados.rados.0.smithi084.stdout:3212: delete oid 21 current snap is 321 2024-03-30T12:33:22.433 INFO:tasks.rados.rados.0.smithi084.stdout:3211: finishing rollback tid 2 to smithi08477944-42 2024-03-30T12:33:22.433 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 27310 (ObjNum 825 snap 273 seq_num 825) dirty exists 2024-03-30T12:33:22.437 INFO:tasks.rados.rados.0.smithi084.stdout:3211: done (1 left) 2024-03-30T12:33:22.437 INFO:tasks.rados.rados.0.smithi084.stdout:3212: done (0 left) 2024-03-30T12:33:22.437 INFO:tasks.rados.rados.0.smithi084.stdout:3213: snap_create 2024-03-30T12:33:22.843 INFO:tasks.rados.rados.0.smithi084.stdout:3213: done (0 left) 2024-03-30T12:33:22.843 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 31 current snap is 322 2024-03-30T12:33:22.843 INFO:tasks.rados.rados.0.smithi084.stdout:3214: seq_num 996 ranges {638976=688128,1327104=507904,1835008=581632,2416640=516096} 2024-03-30T12:33:22.850 INFO:tasks.rados.rados.0.smithi084.stdout:3214: writing smithi08477944-31 from 638976 to 1327104 tid 1 2024-03-30T12:33:22.853 INFO:tasks.rados.rados.0.smithi084.stdout:3214: writing smithi08477944-31 from 1327104 to 1835008 tid 2 2024-03-30T12:33:22.856 INFO:tasks.rados.rados.0.smithi084.stdout:3214: writing smithi08477944-31 from 1835008 to 2416640 tid 3 2024-03-30T12:33:22.860 INFO:tasks.rados.rados.0.smithi084.stdout:3214: writing smithi08477944-31 from 2416640 to 2932736 tid 4 2024-03-30T12:33:22.860 INFO:tasks.rados.rados.0.smithi084.stdout:3215: delete oid 30 current snap is 322 2024-03-30T12:33:22.860 INFO:tasks.rados.rados.0.smithi084.stdout:3214: finishing write tid 1 to smithi08477944-31 2024-03-30T12:33:22.860 INFO:tasks.rados.rados.0.smithi084.stdout:3214: finishing write tid 2 to smithi08477944-31 2024-03-30T12:33:22.860 INFO:tasks.rados.rados.0.smithi084.stdout:3214: finishing write tid 3 to smithi08477944-31 2024-03-30T12:33:22.862 INFO:tasks.rados.rados.0.smithi084.stdout:3215: done (1 left) 2024-03-30T12:33:22.862 INFO:tasks.rados.rados.0.smithi084.stdout:3216: delete oid 22 current snap is 322 2024-03-30T12:33:22.862 INFO:tasks.rados.rados.0.smithi084.stdout:3214: finishing write tid 4 to smithi08477944-31 2024-03-30T12:33:22.863 INFO:tasks.rados.rados.0.smithi084.stdout:3214: finishing write tid 5 to smithi08477944-31 2024-03-30T12:33:22.864 INFO:tasks.rados.rados.0.smithi084.stdout:3214: finishing write tid 6 to smithi08477944-31 2024-03-30T12:33:22.864 INFO:tasks.rados.rados.0.smithi084.stdout:3214: oid 31 updating version 0 to 27380 2024-03-30T12:33:22.864 INFO:tasks.rados.rados.0.smithi084.stdout:3214: oid 31 version 27380 is already newer than 27378 2024-03-30T12:33:22.864 INFO:tasks.rados.rados.0.smithi084.stdout:3214: oid 31 version 27380 is already newer than 27379 2024-03-30T12:33:22.864 INFO:tasks.rados.rados.0.smithi084.stdout:3214: oid 31 version 27380 is already newer than 27376 2024-03-30T12:33:22.865 INFO:tasks.rados.rados.0.smithi084.stdout:3214: oid 31 version 27380 is already newer than 27377 2024-03-30T12:33:22.865 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 27380 (ObjNum 996 snap 322 seq_num 996) dirty exists 2024-03-30T12:33:22.865 INFO:tasks.rados.rados.0.smithi084.stdout:3214: left oid 31 (ObjNum 996 snap 322 seq_num 996) 2024-03-30T12:33:22.867 INFO:tasks.rados.rados.0.smithi084.stdout:3214: done (1 left) 2024-03-30T12:33:22.867 INFO:tasks.rados.rados.0.smithi084.stdout:3216: done (0 left) 2024-03-30T12:33:22.867 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 322 2024-03-30T12:33:22.867 INFO:tasks.rados.rados.0.smithi084.stdout:3217: seq_num 999 ranges {8830976=737280,9568256=565248,10133504=761856,10895360=278528} 2024-03-30T12:33:22.918 INFO:tasks.rados.rados.0.smithi084.stdout:3217: writing smithi08477944-44 from 8830976 to 9568256 tid 1 2024-03-30T12:33:22.921 INFO:tasks.rados.rados.0.smithi084.stdout:3217: writing smithi08477944-44 from 9568256 to 10133504 tid 2 2024-03-30T12:33:22.925 INFO:tasks.rados.rados.0.smithi084.stdout:3217: writing smithi08477944-44 from 10133504 to 10895360 tid 3 2024-03-30T12:33:22.927 INFO:tasks.rados.rados.0.smithi084.stdout:3217: writing smithi08477944-44 from 10895360 to 11173888 tid 4 2024-03-30T12:33:22.927 INFO:tasks.rados.rados.0.smithi084.stdout:3218: snap_remove snap 305 2024-03-30T12:33:23.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:22.848+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17f=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:23.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:22.848+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:23.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:22.851+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:23.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:22.851+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:23.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:22.865+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:23.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:22.865+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:23.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:22.866+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:23.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:23.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:23.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:23.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:23.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:23.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:23.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:23.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:23.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:23.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-mon[83709]: osdmap e709: 8 total, 8 up, 8 in 2024-03-30T12:33:23.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:23.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17e=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:23.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:23.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:23.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:23.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:23.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:23.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17f=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:23.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:22 smithi162 ceph-mon[83709]: pgmap v753: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 957 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 14 MiB/s rd, 984 KiB/s wr, 10 op/s 2024-03-30T12:33:23.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:22.865+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:23.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:22.865+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:23.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:22.861+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:23.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:22.861+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:23.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:22.863+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:23.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:22.863+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:23.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:22.865+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:23.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:23.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:23.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:23.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:23.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:23.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:23.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:23.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:23.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:23.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[91810]: osdmap e709: 8 total, 8 up, 8 in 2024-03-30T12:33:23.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:23.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17e=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:23.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:23.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:23.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:23.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:23.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:23.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:23.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:23.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:23.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:23.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:23.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:23.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:23.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:23.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[89279]: osdmap e709: 8 total, 8 up, 8 in 2024-03-30T12:33:23.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:23.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17e=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:23.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:23.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:23.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:23.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:23.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:23.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17f=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:23.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[91810]: pgmap v753: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 957 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 14 MiB/s rd, 984 KiB/s wr, 10 op/s 2024-03-30T12:33:23.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:23.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17f=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:23.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:22 smithi084 ceph-mon[89279]: pgmap v753: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 957 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 14 MiB/s rd, 984 KiB/s wr, 10 op/s 2024-03-30T12:33:23.849 INFO:tasks.rados.rados.0.smithi084.stdout:3218: done (1 left) 2024-03-30T12:33:23.850 INFO:tasks.rados.rados.0.smithi084.stdout:3219: snap_create 2024-03-30T12:33:23.850 INFO:tasks.rados.rados.0.smithi084.stdout:3217: finishing write tid 1 to smithi08477944-44 2024-03-30T12:33:23.850 INFO:tasks.rados.rados.0.smithi084.stdout:3217: finishing write tid 2 to smithi08477944-44 2024-03-30T12:33:23.850 INFO:tasks.rados.rados.0.smithi084.stdout:3217: finishing write tid 3 to smithi08477944-44 2024-03-30T12:33:23.850 INFO:tasks.rados.rados.0.smithi084.stdout:3217: finishing write tid 4 to smithi08477944-44 2024-03-30T12:33:23.850 INFO:tasks.rados.rados.0.smithi084.stdout:3217: finishing write tid 5 to smithi08477944-44 2024-03-30T12:33:23.850 INFO:tasks.rados.rados.0.smithi084.stdout:3217: finishing write tid 6 to smithi08477944-44 2024-03-30T12:33:23.850 INFO:tasks.rados.rados.0.smithi084.stdout:3217: oid 44 updating version 0 to 36325 2024-03-30T12:33:23.850 INFO:tasks.rados.rados.0.smithi084.stdout:3217: oid 44 updating version 36325 to 36328 2024-03-30T12:33:23.850 INFO:tasks.rados.rados.0.smithi084.stdout:3217: oid 44 version 36328 is already newer than 36324 2024-03-30T12:33:23.850 INFO:tasks.rados.rados.0.smithi084.stdout:3217: oid 44 version 36328 is already newer than 36327 2024-03-30T12:33:23.851 INFO:tasks.rados.rados.0.smithi084.stdout:3217: oid 44 version 36328 is already newer than 36326 2024-03-30T12:33:23.851 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 36328 (ObjNum 999 snap 322 seq_num 999) dirty exists 2024-03-30T12:33:23.851 INFO:tasks.rados.rados.0.smithi084.stdout:3217: left oid 44 (ObjNum 999 snap 322 seq_num 999) 2024-03-30T12:33:24.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:23.896+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17f=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:24.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:23.857+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:24.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:23.857+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:24.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:23.895+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:24.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:23.895+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:24.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:23.855+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:24.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:23.855+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:24.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:23.855+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17f=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:24.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17f=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:24.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:24.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:23 smithi162 ceph-mon[83709]: osdmap e710: 8 total, 8 up, 8 in 2024-03-30T12:33:24.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:24.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:24.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:24.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:24.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:24.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:24.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:24.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:24.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:24.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:24.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:23 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:33:24.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:23.895+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:24.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:23.896+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:24.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:23.894+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:24.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:23.895+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:24.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:23.895+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:24.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:23.896+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:24.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:23.896+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:24.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:23.896+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:24.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17f=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:24.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:24.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[89279]: osdmap e710: 8 total, 8 up, 8 in 2024-03-30T12:33:24.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:24.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:24.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:24.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:24.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:24.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:24.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:24.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:24.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:24.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:24.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:33:24.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17f=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:24.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:24.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[91810]: osdmap e710: 8 total, 8 up, 8 in 2024-03-30T12:33:24.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:24.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:24.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:24.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:24.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:24.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:24.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:24.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:24.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:24.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:24.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:23 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:33:24.863 INFO:tasks.rados.rados.0.smithi084.stdout:3217: done (1 left) 2024-03-30T12:33:24.863 INFO:tasks.rados.rados.0.smithi084.stdout:3219: done (0 left) 2024-03-30T12:33:24.863 INFO:tasks.rados.rados.0.smithi084.stdout:3220: rollback oid 21 current snap is 323 2024-03-30T12:33:24.863 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 21 to 319 2024-03-30T12:33:24.863 INFO:tasks.rados.rados.0.smithi084.stdout:3221: rollback oid 38 current snap is 323 2024-03-30T12:33:24.863 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 38 to 314 2024-03-30T12:33:24.864 INFO:tasks.rados.rados.0.smithi084.stdout:3222: snap_create 2024-03-30T12:33:24.868 INFO:tasks.rados.rados.0.smithi084.stdout:3221: finishing rollback tid 0 to smithi08477944-38 2024-03-30T12:33:24.869 INFO:tasks.rados.rados.0.smithi084.stdout:3221: finishing rollback tid 1 to smithi08477944-38 2024-03-30T12:33:24.870 INFO:tasks.rados.rados.0.smithi084.stdout:3221: finishing rollback tid 2 to smithi08477944-38 2024-03-30T12:33:24.870 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 27296 (ObjNum 962 snap 312 seq_num 962) dirty exists 2024-03-30T12:33:24.872 INFO:tasks.rados.rados.0.smithi084.stdout:3220: finishing rollback tid 1 to smithi08477944-21 2024-03-30T12:33:24.872 INFO:tasks.rados.rados.0.smithi084.stdout:3220: finishing rollback tid 2 to smithi08477944-21 2024-03-30T12:33:24.872 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 25312 (ObjNum 901 snap 287 seq_num 901) dirty exists 2024-03-30T12:33:25.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:24.874+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:25.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:24.880+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 181=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:25.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:24.870+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:25.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:24.870+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:25.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:24.866+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:25.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:24.866+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:25.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:24.867+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:25.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:25.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17f=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:25.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:25.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:25.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:24 smithi162 ceph-mon[83709]: osdmap e711: 8 total, 8 up, 8 in 2024-03-30T12:33:25.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:25.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:25.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:25.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:25.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:25.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:25.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17f=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:25.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:25.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:25.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:24 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:33:25.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:24 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:33:25.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:24 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:33:25.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:24 smithi162 ceph-mon[83709]: pgmap v756: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 960 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 13 MiB/s rd, 1.9 MiB/s wr, 11 op/s 2024-03-30T12:33:25.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:24.878+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:25.255 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:24.879+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:25.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:24.874+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:25.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:24.876+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:25.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:24.876+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:25.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:24.876+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:25.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:24.878+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:25.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:25.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17f=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:25.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:25.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:25.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[89279]: osdmap e711: 8 total, 8 up, 8 in 2024-03-30T12:33:25.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:25.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:25.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:25.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:25.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:25.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:25.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17f=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:25.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:25.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:25.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:33:25.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:33:25.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:33:25.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[89279]: pgmap v756: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 960 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 13 MiB/s rd, 1.9 MiB/s wr, 11 op/s 2024-03-30T12:33:25.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:25.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17f=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:25.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:25.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:25.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[91810]: osdmap e711: 8 total, 8 up, 8 in 2024-03-30T12:33:25.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:25.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:25.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:25.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:25.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:25.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:25.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17f=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:25.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:25.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:25.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:33:25.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:33:25.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:33:25.259 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:24 smithi084 ceph-mon[91810]: pgmap v756: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 960 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 13 MiB/s rd, 1.9 MiB/s wr, 11 op/s 2024-03-30T12:33:25.622 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:25.368+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17f=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:25.861 INFO:tasks.rados.rados.0.smithi084.stdout:3220: done (2 left) 2024-03-30T12:33:25.861 INFO:tasks.rados.rados.0.smithi084.stdout:3221: done (1 left) 2024-03-30T12:33:25.861 INFO:tasks.rados.rados.0.smithi084.stdout:3222: done (0 left) 2024-03-30T12:33:25.861 INFO:tasks.rados.rados.0.smithi084.stdout:3223: read oid 9 snap 292 2024-03-30T12:33:25.861 INFO:tasks.rados.rados.0.smithi084.stdout:3223: expect (ObjNum 925 snap 292 seq_num 925) 2024-03-30T12:33:25.861 INFO:tasks.rados.rados.0.smithi084.stdout:3224: delete oid 37 current snap is 324 2024-03-30T12:33:25.872 INFO:tasks.rados.rados.0.smithi084.stdout:3223: expect (ObjNum 925 snap 292 seq_num 925) 2024-03-30T12:33:25.942 INFO:tasks.rados.rados.0.smithi084.stdout:3223: done (1 left) 2024-03-30T12:33:25.943 INFO:tasks.rados.rados.0.smithi084.stdout:3224: done (0 left) 2024-03-30T12:33:25.943 INFO:tasks.rados.rados.0.smithi084.stdout:3225: rollback oid 10 current snap is 324 2024-03-30T12:33:25.943 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 10 to 292 2024-03-30T12:33:25.943 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 324 2024-03-30T12:33:25.943 INFO:tasks.rados.rados.0.smithi084.stdout:3226: seq_num 1001 ranges {1974272=770048,2744320=729088,3473408=770048,4243456=106496} 2024-03-30T12:33:25.957 INFO:tasks.rados.rados.0.smithi084.stdout:3226: writing smithi08477944-1 from 1974272 to 2744320 tid 1 2024-03-30T12:33:25.961 INFO:tasks.rados.rados.0.smithi084.stdout:3226: writing smithi08477944-1 from 2744320 to 3473408 tid 2 2024-03-30T12:33:25.965 INFO:tasks.rados.rados.0.smithi084.stdout:3226: writing smithi08477944-1 from 3473408 to 4243456 tid 3 2024-03-30T12:33:25.967 INFO:tasks.rados.rados.0.smithi084.stdout:3226: writing smithi08477944-1 from 4243456 to 4349952 tid 4 2024-03-30T12:33:25.967 INFO:tasks.rados.rados.0.smithi084.stdout:3227: rmattr oid 15 current snap is 324 2024-03-30T12:33:25.967 INFO:tasks.rados.rados.0.smithi084.stdout:3225: finishing rollback tid 1 to smithi08477944-10 2024-03-30T12:33:25.967 INFO:tasks.rados.rados.0.smithi084.stdout:3225: finishing rollback tid 2 to smithi08477944-10 2024-03-30T12:33:25.967 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 36302 (ObjNum 923 snap 292 seq_num 923) dirty exists 2024-03-30T12:33:25.967 INFO:tasks.rados.rados.0.smithi084.stdout:3226: finishing write tid 1 to smithi08477944-1 2024-03-30T12:33:25.967 INFO:tasks.rados.rados.0.smithi084.stdout:3226: finishing write tid 2 to smithi08477944-1 2024-03-30T12:33:25.967 INFO:tasks.rados.rados.0.smithi084.stdout:3225: done (2 left) 2024-03-30T12:33:25.967 INFO:tasks.rados.rados.0.smithi084.stdout:3228: copy_from oid 35 from oid 3 current snap is 324 2024-03-30T12:33:25.967 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 324 2024-03-30T12:33:25.967 INFO:tasks.rados.rados.0.smithi084.stdout:3229: seq_num 1002 ranges {11173888=786432,11960320=614400,12574720=581632,13156352=409600} 2024-03-30T12:33:26.034 INFO:tasks.rados.rados.0.smithi084.stdout:3229: writing smithi08477944-44 from 11173888 to 11960320 tid 1 2024-03-30T12:33:26.034 INFO:tasks.rados.rados.0.smithi084.stdout:3229: writing smithi08477944-44 from 11960320 to 12574720 tid 2 2024-03-30T12:33:26.038 INFO:tasks.rados.rados.0.smithi084.stdout:3229: writing smithi08477944-44 from 12574720 to 13156352 tid 3 2024-03-30T12:33:26.042 INFO:tasks.rados.rados.0.smithi084.stdout:3229: writing smithi08477944-44 from 13156352 to 13565952 tid 4 2024-03-30T12:33:26.042 INFO:tasks.rados.rados.0.smithi084.stdout:3230: read oid 37 snap -1 2024-03-30T12:33:26.042 INFO:tasks.rados.rados.0.smithi084.stdout:3230: expect deleted 2024-03-30T12:33:26.042 INFO:tasks.rados.rados.0.smithi084.stdout:3231: rmattr oid 50 current snap is 324 2024-03-30T12:33:26.042 INFO:tasks.rados.rados.0.smithi084.stdout:3231: done (5 left) 2024-03-30T12:33:26.042 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 33 current snap is 324 2024-03-30T12:33:26.042 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 27311 (ObjNum 882 snap 282 seq_num 882) dirty exists 2024-03-30T12:33:26.042 INFO:tasks.rados.rados.0.smithi084.stdout:3226: finishing write tid 3 to smithi08477944-1 2024-03-30T12:33:26.042 INFO:tasks.rados.rados.0.smithi084.stdout:3226: finishing write tid 4 to smithi08477944-1 2024-03-30T12:33:26.042 INFO:tasks.rados.rados.0.smithi084.stdout:3232: seq_num 1003 ranges {761856=802816,1564672=499712,2064384=737280,2801664=368640} 2024-03-30T12:33:26.050 INFO:tasks.rados.rados.0.smithi084.stdout:3232: writing smithi08477944-33 from 761856 to 1564672 tid 1 2024-03-30T12:33:26.053 INFO:tasks.rados.rados.0.smithi084.stdout:3232: writing smithi08477944-33 from 1564672 to 2064384 tid 2 2024-03-30T12:33:26.057 INFO:tasks.rados.rados.0.smithi084.stdout:3232: writing smithi08477944-33 from 2064384 to 2801664 tid 3 2024-03-30T12:33:26.060 INFO:tasks.rados.rados.0.smithi084.stdout:3232: writing smithi08477944-33 from 2801664 to 3170304 tid 4 2024-03-30T12:33:26.060 INFO:tasks.rados.rados.0.smithi084.stdout:3227: done (5 left) 2024-03-30T12:33:26.060 INFO:tasks.rados.rados.0.smithi084.stdout:3233: rmattr oid 11 current snap is 324 2024-03-30T12:33:26.061 INFO:tasks.rados.rados.0.smithi084.stdout:3233: done (5 left) 2024-03-30T12:33:26.061 INFO:tasks.rados.rados.0.smithi084.stdout:3234: snap_create 2024-03-30T12:33:26.061 INFO:tasks.rados.rados.0.smithi084.stdout:3226: finishing write tid 5 to smithi08477944-1 2024-03-30T12:33:26.061 INFO:tasks.rados.rados.0.smithi084.stdout:3228: finishing copy_from to smithi08477944-35 2024-03-30T12:33:26.061 INFO:tasks.rados.rados.0.smithi084.stdout:3228: got expected ENOENT (src dne) 2024-03-30T12:33:26.061 INFO:tasks.rados.rados.0.smithi084.stdout:3228: finishing copy_from racing read to smithi08477944-35 2024-03-30T12:33:26.061 INFO:tasks.rados.rados.0.smithi084.stdout:3226: finishing write tid 6 to smithi08477944-1 2024-03-30T12:33:26.061 INFO:tasks.rados.rados.0.smithi084.stdout:3226: oid 1 updating version 0 to 23392 2024-03-30T12:33:26.061 INFO:tasks.rados.rados.0.smithi084.stdout:3226: oid 1 updating version 23392 to 23396 2024-03-30T12:33:26.061 INFO:tasks.rados.rados.0.smithi084.stdout:3226: oid 1 version 23396 is already newer than 23394 2024-03-30T12:33:26.061 INFO:tasks.rados.rados.0.smithi084.stdout:3226: oid 1 version 23396 is already newer than 23393 2024-03-30T12:33:26.061 INFO:tasks.rados.rados.0.smithi084.stdout:3226: oid 1 version 23396 is already newer than 23395 2024-03-30T12:33:26.061 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 23396 (ObjNum 1001 snap 324 seq_num 1001) dirty exists 2024-03-30T12:33:26.062 INFO:tasks.rados.rados.0.smithi084.stdout:3226: left oid 1 (ObjNum 1001 snap 324 seq_num 1001) 2024-03-30T12:33:26.062 INFO:tasks.rados.rados.0.smithi084.stdout:3229: finishing write tid 1 to smithi08477944-44 2024-03-30T12:33:26.062 INFO:tasks.rados.rados.0.smithi084.stdout:3229: finishing write tid 2 to smithi08477944-44 2024-03-30T12:33:26.062 INFO:tasks.rados.rados.0.smithi084.stdout:3229: finishing write tid 3 to smithi08477944-44 2024-03-30T12:33:26.062 INFO:tasks.rados.rados.0.smithi084.stdout:3229: finishing write tid 4 to smithi08477944-44 2024-03-30T12:33:26.062 INFO:tasks.rados.rados.0.smithi084.stdout:3232: finishing write tid 1 to smithi08477944-33 2024-03-30T12:33:26.062 INFO:tasks.rados.rados.0.smithi084.stdout:3232: finishing write tid 2 to smithi08477944-33 2024-03-30T12:33:26.062 INFO:tasks.rados.rados.0.smithi084.stdout:3229: finishing write tid 5 to smithi08477944-44 2024-03-30T12:33:26.062 INFO:tasks.rados.rados.0.smithi084.stdout:3229: finishing write tid 6 to smithi08477944-44 2024-03-30T12:33:26.062 INFO:tasks.rados.rados.0.smithi084.stdout:3229: oid 44 updating version 0 to 36333 2024-03-30T12:33:26.062 INFO:tasks.rados.rados.0.smithi084.stdout:3229: oid 44 updating version 36333 to 36334 2024-03-30T12:33:26.063 INFO:tasks.rados.rados.0.smithi084.stdout:3229: oid 44 version 36334 is already newer than 36331 2024-03-30T12:33:26.063 INFO:tasks.rados.rados.0.smithi084.stdout:3229: oid 44 version 36334 is already newer than 36332 2024-03-30T12:33:26.063 INFO:tasks.rados.rados.0.smithi084.stdout:3229: oid 44 version 36334 is already newer than 36330 2024-03-30T12:33:26.063 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 36334 (ObjNum 1002 snap 324 seq_num 1002) dirty exists 2024-03-30T12:33:26.063 INFO:tasks.rados.rados.0.smithi084.stdout:3229: left oid 44 (ObjNum 1002 snap 324 seq_num 1002) 2024-03-30T12:33:26.064 INFO:tasks.rados.rados.0.smithi084.stdout:3232: finishing write tid 3 to smithi08477944-33 2024-03-30T12:33:26.064 INFO:tasks.rados.rados.0.smithi084.stdout:3232: finishing write tid 4 to smithi08477944-33 2024-03-30T12:33:26.064 INFO:tasks.rados.rados.0.smithi084.stdout:3232: finishing write tid 5 to smithi08477944-33 2024-03-30T12:33:26.064 INFO:tasks.rados.rados.0.smithi084.stdout:3232: finishing write tid 6 to smithi08477944-33 2024-03-30T12:33:26.064 INFO:tasks.rados.rados.0.smithi084.stdout:3232: oid 33 updating version 0 to 27296 2024-03-30T12:33:26.064 INFO:tasks.rados.rados.0.smithi084.stdout:3232: oid 33 updating version 27296 to 27297 2024-03-30T12:33:26.064 INFO:tasks.rados.rados.0.smithi084.stdout:3232: oid 33 version 27297 is already newer than 27295 2024-03-30T12:33:26.064 INFO:tasks.rados.rados.0.smithi084.stdout:3232: oid 33 updating version 27297 to 27298 2024-03-30T12:33:26.064 INFO:tasks.rados.rados.0.smithi084.stdout:3232: oid 33 version 27298 is already newer than 27294 2024-03-30T12:33:26.065 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 27298 (ObjNum 1003 snap 324 seq_num 1003) dirty exists 2024-03-30T12:33:26.065 INFO:tasks.rados.rados.0.smithi084.stdout:3232: left oid 33 (ObjNum 1003 snap 324 seq_num 1003) 2024-03-30T12:33:26.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:25.880+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17f=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:26.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:25.868+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:26.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:25.868+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:26.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:25.869+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:26.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:25.869+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 181=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:26.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:25.870+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:26.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:25.875+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:26.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:25.875+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:26.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:26.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:26.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:26.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:26.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:25 smithi162 ceph-mon[83709]: osdmap e712: 8 total, 8 up, 8 in 2024-03-30T12:33:26.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:26.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:26.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:26.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:26.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:26.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:26.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:26.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 181=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:26.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:25.879+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:26.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:25.881+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:26.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:25.868+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:26.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:25.868+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:26.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:25.868+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:26.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:25.868+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:26.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:25.868+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:26.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:25.868+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:26.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:26.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:26.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:26.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:26.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[91810]: osdmap e712: 8 total, 8 up, 8 in 2024-03-30T12:33:26.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:26.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:26.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:26.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:26.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:26.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:26.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:26.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 181=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:26.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:26.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:26.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:26.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:26.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[89279]: osdmap e712: 8 total, 8 up, 8 in 2024-03-30T12:33:26.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:26.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:26.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:26.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:26.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:26.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:26.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:26.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 181=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:26.876 INFO:tasks.rados.rados.0.smithi084.stdout:3226: done (5 left) 2024-03-30T12:33:26.876 INFO:tasks.rados.rados.0.smithi084.stdout:3228: done (4 left) 2024-03-30T12:33:26.876 INFO:tasks.rados.rados.0.smithi084.stdout:3229: done (3 left) 2024-03-30T12:33:26.876 INFO:tasks.rados.rados.0.smithi084.stdout:3230: done (2 left) 2024-03-30T12:33:26.876 INFO:tasks.rados.rados.0.smithi084.stdout:3232: done (1 left) 2024-03-30T12:33:26.877 INFO:tasks.rados.rados.0.smithi084.stdout:3234: done (0 left) 2024-03-30T12:33:26.877 INFO:tasks.rados.rados.0.smithi084.stdout:3235: rmattr oid 16 current snap is 325 2024-03-30T12:33:26.877 INFO:tasks.rados.rados.0.smithi084.stdout:3235: done (0 left) 2024-03-30T12:33:26.877 INFO:tasks.rados.rados.0.smithi084.stdout:3236: read oid 23 snap 313 2024-03-30T12:33:26.877 INFO:tasks.rados.rados.0.smithi084.stdout:3236: expect (ObjNum 946 snap 301 seq_num 946) 2024-03-30T12:33:26.877 INFO:tasks.rados.rados.0.smithi084.stdout:3237: rollback oid 37 current snap is 325 2024-03-30T12:33:26.878 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 37 to 303 2024-03-30T12:33:26.878 INFO:tasks.rados.rados.0.smithi084.stdout:3238: read oid 21 snap -1 2024-03-30T12:33:26.878 INFO:tasks.rados.rados.0.smithi084.stdout:3238: expect (ObjNum 901 snap 287 seq_num 901) 2024-03-30T12:33:26.878 INFO:tasks.rados.rados.0.smithi084.stdout:3239: read oid 8 snap -1 2024-03-30T12:33:26.878 INFO:tasks.rados.rados.0.smithi084.stdout:3239: expect (ObjNum 950 snap 302 seq_num 950) 2024-03-30T12:33:26.878 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 325 2024-03-30T12:33:26.879 INFO:tasks.rados.rados.0.smithi084.stdout:3240: seq_num 1004 ranges {8044544=16384} 2024-03-30T12:33:26.921 INFO:tasks.rados.rados.0.smithi084.stdout:3240: writing smithi08477944-47 from 8044544 to 8060928 tid 1 2024-03-30T12:33:26.921 INFO:tasks.rados.rados.0.smithi084.stdout:3241: read oid 13 snap -1 2024-03-30T12:33:26.921 INFO:tasks.rados.rados.0.smithi084.stdout:3241: expect (ObjNum 979 snap 316 seq_num 979) 2024-03-30T12:33:26.921 INFO:tasks.rados.rados.0.smithi084.stdout:3242: copy_from oid 4 from oid 10 current snap is 325 2024-03-30T12:33:26.921 INFO:tasks.rados.rados.0.smithi084.stdout:3238: expect (ObjNum 901 snap 287 seq_num 901) 2024-03-30T12:33:27.033 INFO:tasks.rados.rados.0.smithi084.stdout:3237: finishing rollback tid 1 to smithi08477944-37 2024-03-30T12:33:27.033 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 36300 (ObjNum 33 snap 0 seq_num 5) dirty dne 2024-03-30T12:33:27.033 INFO:tasks.rados.rados.0.smithi084.stdout:3239: expect (ObjNum 950 snap 302 seq_num 950) 2024-03-30T12:33:27.130 INFO:tasks.rados.rados.0.smithi084.stdout:3236: expect (ObjNum 946 snap 301 seq_num 946) 2024-03-30T12:33:27.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:26.886+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:27.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:26.891+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:27.258 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:26.932+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:27.258 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:26.932+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:27.258 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:26.932+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:27.258 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:26.933+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:27.258 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:26.936+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:27.259 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17f=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:27.259 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:27.260 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:27.260 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:27.260 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:27.260 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[91810]: osdmap e713: 8 total, 8 up, 8 in 2024-03-30T12:33:27.260 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:27.261 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:27.261 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 181=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:27.261 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:27.261 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:27.261 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:27.261 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:27.261 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17f=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:27.261 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:27.262 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[91810]: pgmap v759: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 960 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 918 KiB/s wr, 3 op/s 2024-03-30T12:33:27.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17f=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:27.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:27.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:27.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:27.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:27.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[89279]: osdmap e713: 8 total, 8 up, 8 in 2024-03-30T12:33:27.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:27.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:27.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 181=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:27.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:27.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:27.264 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:27.264 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:27.264 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17f=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:27.264 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:27.264 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:26 smithi084 ceph-mon[89279]: pgmap v759: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 960 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 918 KiB/s wr, 3 op/s 2024-03-30T12:33:27.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:26.892+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 182=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:27.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:26.882+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:27.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:26.882+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 181=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:27.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:26.881+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:27.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:26.882+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:27.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:26.887+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:27.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:26.887+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:27.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:26.892+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:27.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17f=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:27.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:27.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:27.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:27.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:27.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:26 smithi162 ceph-mon[83709]: osdmap e713: 8 total, 8 up, 8 in 2024-03-30T12:33:27.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:27.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:27.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 181=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:27.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:27.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:27.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:27.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:27.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17f=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:27.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:27.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:26 smithi162 ceph-mon[83709]: pgmap v759: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 960 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 918 KiB/s wr, 3 op/s 2024-03-30T12:33:27.689 INFO:tasks.rados.rados.0.smithi084.stdout:3240: finishing write tid 1 to smithi08477944-47 2024-03-30T12:33:27.689 INFO:tasks.rados.rados.0.smithi084.stdout:3240: finishing write tid 2 to smithi08477944-47 2024-03-30T12:33:27.689 INFO:tasks.rados.rados.0.smithi084.stdout:3240: finishing write tid 3 to smithi08477944-47 2024-03-30T12:33:27.689 INFO:tasks.rados.rados.0.smithi084.stdout:3240: oid 47 updating version 0 to 27300 2024-03-30T12:33:27.689 INFO:tasks.rados.rados.0.smithi084.stdout:3240: oid 47 version 27300 is already newer than 27299 2024-03-30T12:33:27.689 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 27300 (ObjNum 1004 snap 325 seq_num 1004) dirty exists 2024-03-30T12:33:27.689 INFO:tasks.rados.rados.0.smithi084.stdout:3240: left oid 47 (ObjNum 1004 snap 325 seq_num 1004) 2024-03-30T12:33:27.689 INFO:tasks.rados.rados.0.smithi084.stdout:3242: finishing copy_from racing read to smithi08477944-4 2024-03-30T12:33:27.689 INFO:tasks.rados.rados.0.smithi084.stdout:3242: finishing copy_from to smithi08477944-4 2024-03-30T12:33:27.689 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 36302 (ObjNum 923 snap 292 seq_num 923) dirty exists 2024-03-30T12:33:27.689 INFO:tasks.rados.rados.0.smithi084.stdout:3241: expect (ObjNum 979 snap 316 seq_num 979) 2024-03-30T12:33:28.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:28.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:28.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 181=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:28.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:28.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[89279]: osdmap e714: 8 total, 8 up, 8 in 2024-03-30T12:33:28.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:28.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:28.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:28.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:28.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 182=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:28.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:28.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:28.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:28.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:28.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:28.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:28.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 181=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:28.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:28.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[91810]: osdmap e714: 8 total, 8 up, 8 in 2024-03-30T12:33:28.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:28.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:28.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:28.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:28.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 182=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:28.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:28.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:28.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:28.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:28.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:28.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:28.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 181=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:28.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:28.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:27 smithi162 ceph-mon[83709]: osdmap e714: 8 total, 8 up, 8 in 2024-03-30T12:33:28.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:28.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:28.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:28.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:28.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 182=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:28.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:28.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:28.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:28.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:28.428 INFO:tasks.rados.rados.0.smithi084.stdout:3236: done (6 left) 2024-03-30T12:33:28.428 INFO:tasks.rados.rados.0.smithi084.stdout:3237: done (5 left) 2024-03-30T12:33:28.428 INFO:tasks.rados.rados.0.smithi084.stdout:3238: done (4 left) 2024-03-30T12:33:28.428 INFO:tasks.rados.rados.0.smithi084.stdout:3239: done (3 left) 2024-03-30T12:33:28.428 INFO:tasks.rados.rados.0.smithi084.stdout:3240: done (2 left) 2024-03-30T12:33:28.428 INFO:tasks.rados.rados.0.smithi084.stdout:3241: done (1 left) 2024-03-30T12:33:28.428 INFO:tasks.rados.rados.0.smithi084.stdout:3242: done (0 left) 2024-03-30T12:33:28.429 INFO:tasks.rados.rados.0.smithi084.stdout:3243: read oid 30 snap -1 2024-03-30T12:33:28.429 INFO:tasks.rados.rados.0.smithi084.stdout:3243: expect deleted 2024-03-30T12:33:28.429 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 325 2024-03-30T12:33:28.429 INFO:tasks.rados.rados.0.smithi084.stdout:3244: seq_num 1005 ranges {4841472=32768} 2024-03-30T12:33:28.454 INFO:tasks.rados.rados.0.smithi084.stdout:3244: writing smithi08477944-39 from 4841472 to 4874240 tid 1 2024-03-30T12:33:28.454 INFO:tasks.rados.rados.0.smithi084.stdout:3245: snap_remove snap 322 2024-03-30T12:33:28.883 INFO:tasks.rados.rados.0.smithi084.stdout:3245: done (2 left) 2024-03-30T12:33:28.883 INFO:tasks.rados.rados.0.smithi084.stdout:3246: read oid 3 snap -1 2024-03-30T12:33:28.883 INFO:tasks.rados.rados.0.smithi084.stdout:3246: expect deleted 2024-03-30T12:33:28.883 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 325 2024-03-30T12:33:28.883 INFO:tasks.rados.rados.0.smithi084.stdout:3247: seq_num 1006 ranges {3645440=49152} 2024-03-30T12:33:28.902 INFO:tasks.rados.rados.0.smithi084.stdout:3247: writing smithi08477944-15 from 3645440 to 3694592 tid 1 2024-03-30T12:33:28.903 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 325 2024-03-30T12:33:28.903 INFO:tasks.rados.rados.0.smithi084.stdout:3248: seq_num 1007 ranges {5636096=65536} 2024-03-30T12:33:28.934 INFO:tasks.rados.rados.0.smithi084.stdout:3248: writing smithi08477944-9 from 5636096 to 5701632 tid 1 2024-03-30T12:33:28.935 INFO:tasks.rados.rados.0.smithi084.stdout:3249: setattr oid 41 current snap is 325 2024-03-30T12:33:28.935 INFO:tasks.rados.rados.0.smithi084.stdout:3244: finishing write tid 1 to smithi08477944-39 2024-03-30T12:33:28.935 INFO:tasks.rados.rados.0.smithi084.stdout:3244: finishing write tid 2 to smithi08477944-39 2024-03-30T12:33:28.935 INFO:tasks.rados.rados.0.smithi084.stdout:3244: finishing write tid 3 to smithi08477944-39 2024-03-30T12:33:28.935 INFO:tasks.rados.rados.0.smithi084.stdout:3244: oid 39 updating version 0 to 27312 2024-03-30T12:33:28.935 INFO:tasks.rados.rados.0.smithi084.stdout:3244: oid 39 updating version 27312 to 27313 2024-03-30T12:33:28.935 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 27313 (ObjNum 1005 snap 325 seq_num 1005) dirty exists 2024-03-30T12:33:28.935 INFO:tasks.rados.rados.0.smithi084.stdout:3244: left oid 39 (ObjNum 1005 snap 325 seq_num 1005) 2024-03-30T12:33:28.935 INFO:tasks.rados.rados.0.smithi084.stdout:3247: finishing write tid 1 to smithi08477944-15 2024-03-30T12:33:28.935 INFO:tasks.rados.rados.0.smithi084.stdout:3247: finishing write tid 2 to smithi08477944-15 2024-03-30T12:33:28.935 INFO:tasks.rados.rados.0.smithi084.stdout:3247: finishing write tid 3 to smithi08477944-15 2024-03-30T12:33:28.935 INFO:tasks.rados.rados.0.smithi084.stdout:3247: oid 15 updating version 0 to 27315 2024-03-30T12:33:28.935 INFO:tasks.rados.rados.0.smithi084.stdout:3247: oid 15 version 27315 is already newer than 27314 2024-03-30T12:33:28.935 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 27315 (ObjNum 1006 snap 325 seq_num 1006) dirty exists 2024-03-30T12:33:28.935 INFO:tasks.rados.rados.0.smithi084.stdout:3247: left oid 15 (ObjNum 1006 snap 325 seq_num 1006) 2024-03-30T12:33:28.936 INFO:tasks.rados.rados.0.smithi084.stdout:3243: done (5 left) 2024-03-30T12:33:28.936 INFO:tasks.rados.rados.0.smithi084.stdout:3244: done (4 left) 2024-03-30T12:33:28.936 INFO:tasks.rados.rados.0.smithi084.stdout:3246: done (3 left) 2024-03-30T12:33:28.936 INFO:tasks.rados.rados.0.smithi084.stdout:3247: done (2 left) 2024-03-30T12:33:28.936 INFO:tasks.rados.rados.0.smithi084.stdout:3250: rollback oid 19 current snap is 325 2024-03-30T12:33:28.936 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 19 to 311 2024-03-30T12:33:28.936 INFO:tasks.rados.rados.0.smithi084.stdout:3251: snap_remove snap 323 2024-03-30T12:33:29.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:28 smithi084 ceph-mon[91810]: pgmap v761: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 971 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.6 MiB/s wr, 8 op/s 2024-03-30T12:33:29.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:28 smithi084 ceph-mon[89279]: pgmap v761: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 971 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.6 MiB/s wr, 8 op/s 2024-03-30T12:33:29.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:28.915+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:29.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:28.920+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:29.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:28.890+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:29.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:28.890+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:29.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:28.890+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:29.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:28.890+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:29.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:28.890+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:29.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:28.890+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:29.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:28 smithi162 ceph-mon[83709]: pgmap v761: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 971 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.6 MiB/s wr, 8 op/s 2024-03-30T12:33:29.370 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:28.918+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 182=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:29.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:28.895+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:29.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:28.896+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:29.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:28.890+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:29.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:28.891+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:29.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:28.891+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:29.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:28.891+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 181=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:29.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:28.892+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:29.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:33:29] "GET /metrics HTTP/1.1" 200 36329 "" "Prometheus/2.43.0" 2024-03-30T12:33:29.884 INFO:tasks.rados.rados.0.smithi084.stdout:3251: done (3 left) 2024-03-30T12:33:29.884 INFO:tasks.rados.rados.0.smithi084.stdout:3252: rmattr oid 26 current snap is 325 2024-03-30T12:33:29.884 INFO:tasks.rados.rados.0.smithi084.stdout:3248: finishing write tid 1 to smithi08477944-9 2024-03-30T12:33:29.884 INFO:tasks.rados.rados.0.smithi084.stdout:3248: finishing write tid 2 to smithi08477944-9 2024-03-30T12:33:29.884 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 27308 (ObjNum 289 snap 0 seq_num 1) dirty exists 2024-03-30T12:33:29.884 INFO:tasks.rados.rados.0.smithi084.stdout:3248: finishing write tid 3 to smithi08477944-9 2024-03-30T12:33:29.884 INFO:tasks.rados.rados.0.smithi084.stdout:3248: oid 9 updating version 0 to 22521 2024-03-30T12:33:29.884 INFO:tasks.rados.rados.0.smithi084.stdout:3248: oid 9 updating version 22521 to 22522 2024-03-30T12:33:29.884 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 22522 (ObjNum 1007 snap 325 seq_num 1007) dirty exists 2024-03-30T12:33:29.884 INFO:tasks.rados.rados.0.smithi084.stdout:3248: left oid 9 (ObjNum 1007 snap 325 seq_num 1007) 2024-03-30T12:33:29.885 INFO:tasks.rados.rados.0.smithi084.stdout:3250: finishing rollback tid 0 to smithi08477944-19 2024-03-30T12:33:29.885 INFO:tasks.rados.rados.0.smithi084.stdout:3250: finishing rollback tid 1 to smithi08477944-19 2024-03-30T12:33:29.885 INFO:tasks.rados.rados.0.smithi084.stdout:3250: finishing rollback tid 2 to smithi08477944-19 2024-03-30T12:33:29.885 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 36338 (ObjNum 912 snap 290 seq_num 912) dirty exists 2024-03-30T12:33:29.885 INFO:tasks.rados.rados.0.smithi084.stdout:3248: done (3 left) 2024-03-30T12:33:29.885 INFO:tasks.rados.rados.0.smithi084.stdout:3249: done (2 left) 2024-03-30T12:33:29.885 INFO:tasks.rados.rados.0.smithi084.stdout:3250: done (1 left) 2024-03-30T12:33:29.885 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 325 2024-03-30T12:33:29.885 INFO:tasks.rados.rados.0.smithi084.stdout:3253: seq_num 1008 ranges {1064960=90112} 2024-03-30T12:33:29.891 INFO:tasks.rados.rados.0.smithi084.stdout:3253: writing smithi08477944-10 from 1064960 to 1155072 tid 1 2024-03-30T12:33:29.891 INFO:tasks.rados.rados.0.smithi084.stdout:3254: rmattr oid 9 current snap is 325 2024-03-30T12:33:29.891 INFO:tasks.rados.rados.0.smithi084.stdout:3254: done (2 left) 2024-03-30T12:33:29.891 INFO:tasks.rados.rados.0.smithi084.stdout:3255: read oid 25 snap 314 2024-03-30T12:33:29.891 INFO:tasks.rados.rados.0.smithi084.stdout:3255: expect deleted 2024-03-30T12:33:29.891 INFO:tasks.rados.rados.0.smithi084.stdout:3256: read oid 13 snap -1 2024-03-30T12:33:29.891 INFO:tasks.rados.rados.0.smithi084.stdout:3256: expect (ObjNum 979 snap 316 seq_num 979) 2024-03-30T12:33:29.891 INFO:tasks.rados.rados.0.smithi084.stdout:3257: rmattr oid 48 current snap is 325 2024-03-30T12:33:29.891 INFO:tasks.rados.rados.0.smithi084.stdout:3258: read oid 30 snap 307 2024-03-30T12:33:29.891 INFO:tasks.rados.rados.0.smithi084.stdout:3258: expect deleted 2024-03-30T12:33:29.892 INFO:tasks.rados.rados.0.smithi084.stdout:3259: rollback oid 21 current snap is 325 2024-03-30T12:33:29.892 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 21 to 314 2024-03-30T12:33:29.892 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 325 2024-03-30T12:33:29.892 INFO:tasks.rados.rados.0.smithi084.stdout:3260: seq_num 1009 ranges {13565952=106496} 2024-03-30T12:33:29.972 INFO:tasks.rados.rados.0.smithi084.stdout:3260: writing smithi08477944-44 from 13565952 to 13672448 tid 1 2024-03-30T12:33:29.973 INFO:tasks.rados.rados.0.smithi084.stdout:3261: snap_create 2024-03-30T12:33:29.973 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 23422 (ObjNum 936 snap 295 seq_num 936) dirty exists 2024-03-30T12:33:29.973 INFO:tasks.rados.rados.0.smithi084.stdout:3259: finishing rollback tid 0 to smithi08477944-21 2024-03-30T12:33:29.973 INFO:tasks.rados.rados.0.smithi084.stdout:3253: finishing write tid 1 to smithi08477944-10 2024-03-30T12:33:29.973 INFO:tasks.rados.rados.0.smithi084.stdout:3253: finishing write tid 2 to smithi08477944-10 2024-03-30T12:33:29.973 INFO:tasks.rados.rados.0.smithi084.stdout:3253: finishing write tid 3 to smithi08477944-10 2024-03-30T12:33:29.973 INFO:tasks.rados.rados.0.smithi084.stdout:3253: oid 10 updating version 0 to 36304 2024-03-30T12:33:29.973 INFO:tasks.rados.rados.0.smithi084.stdout:3253: oid 10 version 36304 is already newer than 36303 2024-03-30T12:33:29.973 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 36304 (ObjNum 1008 snap 325 seq_num 1008) dirty exists 2024-03-30T12:33:29.973 INFO:tasks.rados.rados.0.smithi084.stdout:3253: left oid 10 (ObjNum 1008 snap 325 seq_num 1008) 2024-03-30T12:33:29.973 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 27392 (ObjNum 938 snap 299 seq_num 938) dirty exists 2024-03-30T12:33:29.973 INFO:tasks.rados.rados.0.smithi084.stdout:3259: finishing rollback tid 1 to smithi08477944-21 2024-03-30T12:33:29.974 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 25315 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-03-30T12:33:29.974 INFO:tasks.rados.rados.0.smithi084.stdout:3256: expect (ObjNum 979 snap 316 seq_num 979) 2024-03-30T12:33:30.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:29.906+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:30.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:29.906+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:30.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:29.906+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:30.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:29.906+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:30.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:29.907+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:30.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:29.908+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:30.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:29.909+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:30.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:30.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:30.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:30.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:30.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:30.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:30.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[91810]: osdmap e715: 8 total, 8 up, 8 in 2024-03-30T12:33:30.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 181=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:30.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:30.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:30.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:30.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:30.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 182=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:30.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:30.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:33:30.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:30.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:30.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:30.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:30.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:30.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:30.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[89279]: osdmap e715: 8 total, 8 up, 8 in 2024-03-30T12:33:30.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 181=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:30.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:30.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:30.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:30.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:30.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 182=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:30.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:30.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:29 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:33:30.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:29.913+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:30.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:29.892+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 181=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:30.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:29.893+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:30.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:29.892+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:30.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:29.893+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:30.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:30.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:30.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:30.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:30.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:30.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:30.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:29 smithi162 ceph-mon[83709]: osdmap e715: 8 total, 8 up, 8 in 2024-03-30T12:33:30.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 181=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:30.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:30.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:30.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:30.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:30.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 182=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:30.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:30.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:29 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:33:30.372 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:29.895+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:30.372 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:29.896+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:30.372 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:29.902+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:30.713 INFO:tasks.rados.rados.0.smithi084.stdout:3260: finishing write tid 1 to smithi08477944-44 2024-03-30T12:33:30.713 INFO:tasks.rados.rados.0.smithi084.stdout:3260: finishing write tid 2 to smithi08477944-44 2024-03-30T12:33:30.713 INFO:tasks.rados.rados.0.smithi084.stdout:3260: finishing write tid 3 to smithi08477944-44 2024-03-30T12:33:30.713 INFO:tasks.rados.rados.0.smithi084.stdout:3260: oid 44 updating version 0 to 36341 2024-03-30T12:33:30.713 INFO:tasks.rados.rados.0.smithi084.stdout:3260: oid 44 version 36341 is already newer than 36340 2024-03-30T12:33:30.713 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 36341 (ObjNum 1009 snap 325 seq_num 1009) dirty exists 2024-03-30T12:33:30.713 INFO:tasks.rados.rados.0.smithi084.stdout:3260: left oid 44 (ObjNum 1009 snap 325 seq_num 1009) 2024-03-30T12:33:30.897 INFO:tasks.rados.rados.0.smithi084.stdout:3252: done (8 left) 2024-03-30T12:33:30.897 INFO:tasks.rados.rados.0.smithi084.stdout:3253: done (7 left) 2024-03-30T12:33:30.897 INFO:tasks.rados.rados.0.smithi084.stdout:3255: done (6 left) 2024-03-30T12:33:30.897 INFO:tasks.rados.rados.0.smithi084.stdout:3256: done (5 left) 2024-03-30T12:33:30.897 INFO:tasks.rados.rados.0.smithi084.stdout:3257: done (4 left) 2024-03-30T12:33:30.897 INFO:tasks.rados.rados.0.smithi084.stdout:3258: done (3 left) 2024-03-30T12:33:30.897 INFO:tasks.rados.rados.0.smithi084.stdout:3259: done (2 left) 2024-03-30T12:33:30.897 INFO:tasks.rados.rados.0.smithi084.stdout:3260: done (1 left) 2024-03-30T12:33:30.897 INFO:tasks.rados.rados.0.smithi084.stdout:3261: done (0 left) 2024-03-30T12:33:30.897 INFO:tasks.rados.rados.0.smithi084.stdout:3262: copy_from oid 13 from oid 29 current snap is 326 2024-03-30T12:33:30.898 INFO:tasks.rados.rados.0.smithi084.stdout:3263: setattr oid 33 current snap is 326 2024-03-30T12:33:30.898 INFO:tasks.rados.rados.0.smithi084.stdout:3264: setattr oid 30 current snap is 326 2024-03-30T12:33:30.898 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 326 2024-03-30T12:33:30.899 INFO:tasks.rados.rados.0.smithi084.stdout:3265: seq_num 1010 ranges {0=122880} 2024-03-30T12:33:30.899 INFO:tasks.rados.rados.0.smithi084.stdout:3265: writing smithi08477944-7 from 0 to 122880 tid 1 2024-03-30T12:33:30.899 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 27 current snap is 326 2024-03-30T12:33:30.900 INFO:tasks.rados.rados.0.smithi084.stdout:3266: seq_num 1011 ranges {0=139264} 2024-03-30T12:33:30.900 INFO:tasks.rados.rados.0.smithi084.stdout:3266: writing smithi08477944-27 from 0 to 139264 tid 1 2024-03-30T12:33:30.901 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 326 2024-03-30T12:33:30.901 INFO:tasks.rados.rados.0.smithi084.stdout:3267: seq_num 1012 ranges {1302528=155648} 2024-03-30T12:33:30.910 INFO:tasks.rados.rados.0.smithi084.stdout:3267: writing smithi08477944-2 from 1302528 to 1458176 tid 1 2024-03-30T12:33:30.910 INFO:tasks.rados.rados.0.smithi084.stdout:3268: read oid 48 snap -1 2024-03-30T12:33:30.910 INFO:tasks.rados.rados.0.smithi084.stdout:3268: expect (ObjNum 936 snap 295 seq_num 936) 2024-03-30T12:33:30.910 INFO:tasks.rados.rados.0.smithi084.stdout:3269: snap_remove snap 314 2024-03-30T12:33:31.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:30.915+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:31.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:30.918+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:31.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:30.910+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:31.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:30.910+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:31.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:30.914+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:31.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:30.914+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:31.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:30.917+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:31.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:30.918+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:31.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[91810]: osdmap e716: 8 total, 8 up, 8 in 2024-03-30T12:33:31.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:31.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 181=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:31.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:31.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:31.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:31.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:31.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:31.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:31.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:31.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:31.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:31.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:31.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:31.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[91810]: pgmap v764: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 974 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 16 MiB/s rd, 2.1 MiB/s wr, 15 op/s 2024-03-30T12:33:31.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[89279]: osdmap e716: 8 total, 8 up, 8 in 2024-03-30T12:33:31.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:31.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 181=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:31.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:31.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:31.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:31.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:31.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:31.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:31.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:31.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:31.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:31.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:31.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:31.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:30 smithi084 ceph-mon[89279]: pgmap v764: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 974 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 16 MiB/s rd, 2.1 MiB/s wr, 15 op/s 2024-03-30T12:33:31.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:30.914+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:31.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:30.902+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:31.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:30.902+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:31.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:30.902+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:31.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:30.904+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:31.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:30.904+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:31.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:30.908+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:31.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:30.908+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:31.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:30 smithi162 ceph-mon[83709]: osdmap e716: 8 total, 8 up, 8 in 2024-03-30T12:33:31.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:31.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 181=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:31.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:31.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:31.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:31.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:31.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:31.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:31.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:31.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:31.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:31.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:31.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:31.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:30 smithi162 ceph-mon[83709]: pgmap v764: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 974 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 16 MiB/s rd, 2.1 MiB/s wr, 15 op/s 2024-03-30T12:33:31.908 INFO:tasks.rados.rados.0.smithi084.stdout:3269: done (7 left) 2024-03-30T12:33:31.908 INFO:tasks.rados.rados.0.smithi084.stdout:3270: rollback oid 21 current snap is 326 2024-03-30T12:33:31.908 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 21 to 321 2024-03-30T12:33:31.908 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 27297 (ObjNum 33 snap 0 seq_num 1430030320) dirty exists 2024-03-30T12:33:31.908 INFO:tasks.rados.rados.0.smithi084.stdout:3266: finishing write tid 1 to smithi08477944-27 2024-03-30T12:33:31.908 INFO:tasks.rados.rados.0.smithi084.stdout:3264: done (7 left) 2024-03-30T12:33:31.909 INFO:tasks.rados.rados.0.smithi084.stdout:3271: delete oid 42 current snap is 326 2024-03-30T12:33:31.909 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 27301 (ObjNum 1003 snap 324 seq_num 1003) dirty exists 2024-03-30T12:33:31.909 INFO:tasks.rados.rados.0.smithi084.stdout:3266: finishing write tid 2 to smithi08477944-27 2024-03-30T12:33:31.909 INFO:tasks.rados.rados.0.smithi084.stdout:3266: finishing write tid 3 to smithi08477944-27 2024-03-30T12:33:31.909 INFO:tasks.rados.rados.0.smithi084.stdout:3266: oid 27 updating version 0 to 27247 2024-03-30T12:33:31.909 INFO:tasks.rados.rados.0.smithi084.stdout:3266: oid 27 version 27247 is already newer than 27246 2024-03-30T12:33:31.909 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 27247 (ObjNum 1011 snap 326 seq_num 1011) dirty exists 2024-03-30T12:33:31.909 INFO:tasks.rados.rados.0.smithi084.stdout:3266: left oid 27 (ObjNum 1011 snap 326 seq_num 1011) 2024-03-30T12:33:31.909 INFO:tasks.rados.rados.0.smithi084.stdout:3265: finishing write tid 1 to smithi08477944-7 2024-03-30T12:33:31.909 INFO:tasks.rados.rados.0.smithi084.stdout:3265: finishing write tid 2 to smithi08477944-7 2024-03-30T12:33:31.909 INFO:tasks.rados.rados.0.smithi084.stdout:3265: finishing write tid 3 to smithi08477944-7 2024-03-30T12:33:31.909 INFO:tasks.rados.rados.0.smithi084.stdout:3265: oid 7 updating version 0 to 27303 2024-03-30T12:33:31.909 INFO:tasks.rados.rados.0.smithi084.stdout:3265: oid 7 version 27303 is already newer than 27302 2024-03-30T12:33:31.909 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 27303 (ObjNum 1010 snap 326 seq_num 1010) dirty exists 2024-03-30T12:33:31.909 INFO:tasks.rados.rados.0.smithi084.stdout:3265: left oid 7 (ObjNum 1010 snap 326 seq_num 1010) 2024-03-30T12:33:31.910 INFO:tasks.rados.rados.0.smithi084.stdout:3267: finishing write tid 1 to smithi08477944-2 2024-03-30T12:33:31.910 INFO:tasks.rados.rados.0.smithi084.stdout:3267: finishing write tid 2 to smithi08477944-2 2024-03-30T12:33:31.910 INFO:tasks.rados.rados.0.smithi084.stdout:3267: finishing write tid 3 to smithi08477944-2 2024-03-30T12:33:31.910 INFO:tasks.rados.rados.0.smithi084.stdout:3267: oid 2 updating version 0 to 27394 2024-03-30T12:33:31.910 INFO:tasks.rados.rados.0.smithi084.stdout:3267: oid 2 updating version 27394 to 27395 2024-03-30T12:33:31.910 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 27395 (ObjNum 1012 snap 326 seq_num 1012) dirty exists 2024-03-30T12:33:31.910 INFO:tasks.rados.rados.0.smithi084.stdout:3267: left oid 2 (ObjNum 1012 snap 326 seq_num 1012) 2024-03-30T12:33:31.910 INFO:tasks.rados.rados.0.smithi084.stdout:3268: expect (ObjNum 936 snap 295 seq_num 936) 2024-03-30T12:33:32.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:31.917+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:32.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:31.917+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:32.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:31.914+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:32.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:31.916+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:32.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:31.916+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:32.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:31.916+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:32.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:31.916+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:32.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:32.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:32.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:32.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:32.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[91810]: osdmap e717: 8 total, 8 up, 8 in 2024-03-30T12:33:32.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:32.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:32.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:32.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:32.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:32.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:32.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:32.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:32.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:32.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:32.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:32.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:32.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:32.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[89279]: osdmap e717: 8 total, 8 up, 8 in 2024-03-30T12:33:32.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:32.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:32.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:32.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:32.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:32.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:32.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:32.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:32.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:32.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:31.922+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:32.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:31.912+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:32.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:31.912+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:32.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:32.123+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:32.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:32.123+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:32.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:31.920+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:32.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:31.920+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 184=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:32.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:31.920+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:32.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:32.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:32.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:32.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:32.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:31 smithi162 ceph-mon[83709]: osdmap e717: 8 total, 8 up, 8 in 2024-03-30T12:33:32.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 17a=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:32.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:32.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:32.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:32.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 15c=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:32.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:32.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:32.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:32.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:32.463 INFO:tasks.rados.rados.0.smithi084.stdout:3262: finishing copy_from racing read to smithi08477944-13 2024-03-30T12:33:32.463 INFO:tasks.rados.rados.0.smithi084.stdout:3262: finishing copy_from to smithi08477944-13 2024-03-30T12:33:32.463 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 23430 (ObjNum 946 snap 301 seq_num 946) dirty exists 2024-03-30T12:33:32.463 INFO:tasks.rados.rados.0.smithi084.stdout:3270: finishing rollback tid 1 to smithi08477944-21 2024-03-30T12:33:32.463 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 25315 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-03-30T12:33:32.463 INFO:tasks.rados.rados.0.smithi084.stdout:3262: done (7 left) 2024-03-30T12:33:32.463 INFO:tasks.rados.rados.0.smithi084.stdout:3263: done (6 left) 2024-03-30T12:33:32.463 INFO:tasks.rados.rados.0.smithi084.stdout:3265: done (5 left) 2024-03-30T12:33:32.463 INFO:tasks.rados.rados.0.smithi084.stdout:3266: done (4 left) 2024-03-30T12:33:32.463 INFO:tasks.rados.rados.0.smithi084.stdout:3267: done (3 left) 2024-03-30T12:33:32.463 INFO:tasks.rados.rados.0.smithi084.stdout:3268: done (2 left) 2024-03-30T12:33:32.463 INFO:tasks.rados.rados.0.smithi084.stdout:3270: done (1 left) 2024-03-30T12:33:32.463 INFO:tasks.rados.rados.0.smithi084.stdout:3271: done (0 left) 2024-03-30T12:33:32.464 INFO:tasks.rados.rados.0.smithi084.stdout:3272: snap_create 2024-03-30T12:33:32.909 INFO:tasks.rados.rados.0.smithi084.stdout:3272: done (0 left) 2024-03-30T12:33:32.909 INFO:tasks.rados.rados.0.smithi084.stdout:3273: rollback oid 41 current snap is 327 2024-03-30T12:33:32.909 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 41 to 324 2024-03-30T12:33:32.909 INFO:tasks.rados.rados.0.smithi084.stdout:3274: rmattr oid 38 current snap is 327 2024-03-30T12:33:32.909 INFO:tasks.rados.rados.0.smithi084.stdout:3274: done (1 left) 2024-03-30T12:33:32.909 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 327 2024-03-30T12:33:32.909 INFO:tasks.rados.rados.0.smithi084.stdout:3275: seq_num 1014 ranges {8208384=188416} 2024-03-30T12:33:32.954 INFO:tasks.rados.rados.0.smithi084.stdout:3275: writing smithi08477944-13 from 8208384 to 8396800 tid 1 2024-03-30T12:33:32.954 INFO:tasks.rados.rados.0.smithi084.stdout:3276: rmattr oid 48 current snap is 327 2024-03-30T12:33:32.954 INFO:tasks.rados.rados.0.smithi084.stdout:3273: finishing rollback tid 0 to smithi08477944-41 2024-03-30T12:33:32.954 INFO:tasks.rados.rados.0.smithi084.stdout:3273: finishing rollback tid 1 to smithi08477944-41 2024-03-30T12:33:32.954 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 27310 (ObjNum 1633183085 snap 1751540054 seq_num 304) dirty dne 2024-03-30T12:33:32.954 INFO:tasks.rados.rados.0.smithi084.stdout:3273: done (2 left) 2024-03-30T12:33:32.954 INFO:tasks.rados.rados.0.smithi084.stdout:3277: read oid 42 snap -1 2024-03-30T12:33:32.955 INFO:tasks.rados.rados.0.smithi084.stdout:3277: expect deleted 2024-03-30T12:33:32.955 INFO:tasks.rados.rados.0.smithi084.stdout:3278: copy_from oid 15 from oid 35 current snap is 327 2024-03-30T12:33:32.955 INFO:tasks.rados.rados.0.smithi084.stdout:3279: setattr oid 10 current snap is 327 2024-03-30T12:33:32.955 INFO:tasks.rados.rados.0.smithi084.stdout:3280: delete oid 47 current snap is 327 2024-03-30T12:33:32.961 INFO:tasks.rados.rados.0.smithi084.stdout:3277: done (5 left) 2024-03-30T12:33:32.961 INFO:tasks.rados.rados.0.smithi084.stdout:3280: done (4 left) 2024-03-30T12:33:32.961 INFO:tasks.rados.rados.0.smithi084.stdout:3281: copy_from oid 31 from oid 23 current snap is 327 2024-03-30T12:33:32.961 INFO:tasks.rados.rados.0.smithi084.stdout:3282: copy_from oid 29 from oid 28 current snap is 327 2024-03-30T12:33:32.961 INFO:tasks.rados.rados.0.smithi084.stdout:3283: delete oid 14 current snap is 327 2024-03-30T12:33:32.965 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 23423 (ObjNum 936 snap 295 seq_num 936) dirty exists 2024-03-30T12:33:32.967 INFO:tasks.rados.rados.0.smithi084.stdout:3275: finishing write tid 1 to smithi08477944-13 2024-03-30T12:33:32.968 INFO:tasks.rados.rados.0.smithi084.stdout:3275: finishing write tid 2 to smithi08477944-13 2024-03-30T12:33:32.969 INFO:tasks.rados.rados.0.smithi084.stdout:3278: finishing copy_from racing read to smithi08477944-15 2024-03-30T12:33:32.970 INFO:tasks.rados.rados.0.smithi084.stdout:3278: finishing copy_from to smithi08477944-15 2024-03-30T12:33:32.970 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 23386 (ObjNum 664 snap 232 seq_num 664) dirty exists 2024-03-30T12:33:32.970 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 36305 (ObjNum 1008 snap 325 seq_num 1008) dirty exists 2024-03-30T12:33:32.974 INFO:tasks.rados.rados.0.smithi084.stdout:3282: finishing copy_from racing read to smithi08477944-29 2024-03-30T12:33:32.975 INFO:tasks.rados.rados.0.smithi084.stdout:3275: finishing write tid 3 to smithi08477944-13 2024-03-30T12:33:32.975 INFO:tasks.rados.rados.0.smithi084.stdout:3275: oid 13 updating version 0 to 23431 2024-03-30T12:33:32.975 INFO:tasks.rados.rados.0.smithi084.stdout:3275: oid 13 updating version 23431 to 23432 2024-03-30T12:33:32.975 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 23432 (ObjNum 1014 snap 327 seq_num 1014) dirty exists 2024-03-30T12:33:32.976 INFO:tasks.rados.rados.0.smithi084.stdout:3275: left oid 13 (ObjNum 1014 snap 327 seq_num 1014) 2024-03-30T12:33:32.977 INFO:tasks.rados.rados.0.smithi084.stdout:3275: done (6 left) 2024-03-30T12:33:32.977 INFO:tasks.rados.rados.0.smithi084.stdout:3276: done (5 left) 2024-03-30T12:33:32.977 INFO:tasks.rados.rados.0.smithi084.stdout:3278: done (4 left) 2024-03-30T12:33:32.977 INFO:tasks.rados.rados.0.smithi084.stdout:3279: done (3 left) 2024-03-30T12:33:32.977 INFO:tasks.rados.rados.0.smithi084.stdout:3283: done (2 left) 2024-03-30T12:33:32.977 INFO:tasks.rados.rados.0.smithi084.stdout:3284: snap_remove snap 311 2024-03-30T12:33:33.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:32.966+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:33.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:32.966+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:33.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:32.916+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:33.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:32.916+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:33.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:32.916+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:33.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:32.917+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:33.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:32.917+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:33.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:32.917+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:33.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:33.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:33.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:33.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[89279]: osdmap e718: 8 total, 8 up, 8 in 2024-03-30T12:33:33.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:33.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:33.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:33.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:33.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:33.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 184=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:33.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:33.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:33.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:33.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:33.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[89279]: pgmap v767: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 974 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 29 MiB/s rd, 626 KiB/s wr, 19 op/s 2024-03-30T12:33:33.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:33.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:33.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:33.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[91810]: osdmap e718: 8 total, 8 up, 8 in 2024-03-30T12:33:33.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:33.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:33.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:33.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:33.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:33.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 184=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:33.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:33.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:33.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:33.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:33.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:32 smithi084 ceph-mon[91810]: pgmap v767: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 974 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 29 MiB/s rd, 626 KiB/s wr, 19 op/s 2024-03-30T12:33:33.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:32.974+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:33.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:32.969+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:33.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:32.969+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:33.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:32.973+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:33.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:32.918+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 184=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:33.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:32.918+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:33.371 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:32.917+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:33.371 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:32.917+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:33.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:33.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:33.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:33.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:32 smithi162 ceph-mon[83709]: osdmap e718: 8 total, 8 up, 8 in 2024-03-30T12:33:33.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:33.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:33.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:33.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:33.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:33.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 184=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:33.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:33.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:33.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:33.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:33.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:32 smithi162 ceph-mon[83709]: pgmap v767: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 974 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 29 MiB/s rd, 626 KiB/s wr, 19 op/s 2024-03-30T12:33:33.918 INFO:tasks.rados.rados.0.smithi084.stdout:3284: done (2 left) 2024-03-30T12:33:33.918 INFO:tasks.rados.rados.0.smithi084.stdout:3285: setattr oid 9 current snap is 327 2024-03-30T12:33:33.918 INFO:tasks.rados.rados.0.smithi084.stdout:3281: finishing copy_from racing read to smithi08477944-31 2024-03-30T12:33:33.918 INFO:tasks.rados.rados.0.smithi084.stdout:3282: finishing copy_from to smithi08477944-29 2024-03-30T12:33:33.918 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 27375 (ObjNum 947 snap 301 seq_num 947) dirty exists 2024-03-30T12:33:33.918 INFO:tasks.rados.rados.0.smithi084.stdout:3281: finishing copy_from to smithi08477944-31 2024-03-30T12:33:33.918 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 23421 (ObjNum 946 snap 301 seq_num 946) dirty exists 2024-03-30T12:33:33.920 INFO:tasks.rados.rados.0.smithi084.stdout:3281: done (2 left) 2024-03-30T12:33:33.920 INFO:tasks.rados.rados.0.smithi084.stdout:3282: done (1 left) 2024-03-30T12:33:33.920 INFO:tasks.rados.rados.0.smithi084.stdout:3286: delete oid 33 current snap is 327 2024-03-30T12:33:33.923 INFO:tasks.rados.rados.0.smithi084.stdout:3286: done (1 left) 2024-03-30T12:33:33.923 INFO:tasks.rados.rados.0.smithi084.stdout:3287: read oid 48 snap -1 2024-03-30T12:33:33.923 INFO:tasks.rados.rados.0.smithi084.stdout:3287: expect (ObjNum 936 snap 295 seq_num 936) 2024-03-30T12:33:33.924 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 29 current snap is 327 2024-03-30T12:33:33.924 INFO:tasks.rados.rados.0.smithi084.stdout:3288: seq_num 1018 ranges {1466368=253952} 2024-03-30T12:33:33.934 INFO:tasks.rados.rados.0.smithi084.stdout:3288: writing smithi08477944-29 from 1466368 to 1720320 tid 1 2024-03-30T12:33:33.934 INFO:tasks.rados.rados.0.smithi084.stdout:3289: read oid 49 snap -1 2024-03-30T12:33:33.934 INFO:tasks.rados.rados.0.smithi084.stdout:3289: expect deleted 2024-03-30T12:33:33.934 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 327 2024-03-30T12:33:33.934 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 22523 (ObjNum 1007 snap 325 seq_num 1007) dirty exists 2024-03-30T12:33:33.934 INFO:tasks.rados.rados.0.smithi084.stdout:3290: seq_num 1019 ranges {1064960=270336} 2024-03-30T12:33:33.941 INFO:tasks.rados.rados.0.smithi084.stdout:3290: writing smithi08477944-4 from 1064960 to 1335296 tid 1 2024-03-30T12:33:33.942 INFO:tasks.rados.rados.0.smithi084.stdout:3285: done (4 left) 2024-03-30T12:33:33.942 INFO:tasks.rados.rados.0.smithi084.stdout:3291: copy_from oid 15 from oid 50 current snap is 327 2024-03-30T12:33:33.942 INFO:tasks.rados.rados.0.smithi084.stdout:3288: finishing write tid 1 to smithi08477944-29 2024-03-30T12:33:33.942 INFO:tasks.rados.rados.0.smithi084.stdout:3288: finishing write tid 2 to smithi08477944-29 2024-03-30T12:33:33.942 INFO:tasks.rados.rados.0.smithi084.stdout:3288: finishing write tid 3 to smithi08477944-29 2024-03-30T12:33:33.942 INFO:tasks.rados.rados.0.smithi084.stdout:3288: oid 29 updating version 0 to 36304 2024-03-30T12:33:33.942 INFO:tasks.rados.rados.0.smithi084.stdout:3288: oid 29 version 36304 is already newer than 36303 2024-03-30T12:33:33.942 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 36304 (ObjNum 1018 snap 327 seq_num 1018) dirty exists 2024-03-30T12:33:33.942 INFO:tasks.rados.rados.0.smithi084.stdout:3288: left oid 29 (ObjNum 1018 snap 327 seq_num 1018) 2024-03-30T12:33:33.942 INFO:tasks.rados.rados.0.smithi084.stdout:3288: done (4 left) 2024-03-30T12:33:33.942 INFO:tasks.rados.rados.0.smithi084.stdout:3289: done (3 left) 2024-03-30T12:33:33.942 INFO:tasks.rados.rados.0.smithi084.stdout:3292: copy_from oid 3 from oid 1 current snap is 327 2024-03-30T12:33:33.942 INFO:tasks.rados.rados.0.smithi084.stdout:3293: snap_create 2024-03-30T12:33:33.946 INFO:tasks.rados.rados.0.smithi084.stdout:3290: finishing write tid 1 to smithi08477944-4 2024-03-30T12:33:33.947 INFO:tasks.rados.rados.0.smithi084.stdout:3290: finishing write tid 2 to smithi08477944-4 2024-03-30T12:33:33.950 INFO:tasks.rados.rados.0.smithi084.stdout:3290: finishing write tid 3 to smithi08477944-4 2024-03-30T12:33:33.950 INFO:tasks.rados.rados.0.smithi084.stdout:3290: oid 4 updating version 0 to 36305 2024-03-30T12:33:33.950 INFO:tasks.rados.rados.0.smithi084.stdout:3290: oid 4 updating version 36305 to 36306 2024-03-30T12:33:33.950 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 36306 (ObjNum 1019 snap 327 seq_num 1019) dirty exists 2024-03-30T12:33:33.950 INFO:tasks.rados.rados.0.smithi084.stdout:3290: left oid 4 (ObjNum 1019 snap 327 seq_num 1019) 2024-03-30T12:33:33.953 INFO:tasks.rados.rados.0.smithi084.stdout:3287: expect (ObjNum 936 snap 295 seq_num 936) 2024-03-30T12:33:34.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:33.930+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:34.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:33.931+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:34.254 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3[111861]: 2024-03-30T12:33:33.958+0000 7fa6ff147700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 176 after trimming was started 2024-03-30T12:33:34.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:34.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:34.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:34.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:34.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[91810]: osdmap e719: 8 total, 8 up, 8 in 2024-03-30T12:33:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 184=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:34.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:33.923+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:34.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:33.923+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:34.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:33.924+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:34.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:33.924+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:34.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:33.924+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:34.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:34.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:34.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:34.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:34.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:34.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[89279]: osdmap e719: 8 total, 8 up, 8 in 2024-03-30T12:33:34.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:34.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 184=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:34.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:34.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:34.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:34.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:34.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:34.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:33.985+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:34.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:33.929+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:34.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:33.929+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:34.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:33.955+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:34.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:33.955+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:34.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:33.924+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:34.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:33.924+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:34.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:33.924+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:34.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:34.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:34.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:34.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:34.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:34.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:33 smithi162 ceph-mon[83709]: osdmap e719: 8 total, 8 up, 8 in 2024-03-30T12:33:34.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:34.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 184=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:34.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:34.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:34.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:34.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:34.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:34.513 INFO:tasks.rados.rados.0.smithi084.stdout:3292: finishing copy_from racing read to smithi08477944-3 2024-03-30T12:33:34.513 INFO:tasks.rados.rados.0.smithi084.stdout:3292: finishing copy_from to smithi08477944-3 2024-03-30T12:33:34.513 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 23396 (ObjNum 1001 snap 324 seq_num 1001) dirty exists 2024-03-30T12:33:34.513 INFO:tasks.rados.rados.0.smithi084.stdout:3291: finishing copy_from racing read to smithi08477944-15 2024-03-30T12:33:34.513 INFO:tasks.rados.rados.0.smithi084.stdout:3291: finishing copy_from to smithi08477944-15 2024-03-30T12:33:34.514 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 27307 (ObjNum 974 snap 315 seq_num 974) dirty exists 2024-03-30T12:33:34.923 INFO:tasks.rados.rados.0.smithi084.stdout:3287: done (4 left) 2024-03-30T12:33:34.923 INFO:tasks.rados.rados.0.smithi084.stdout:3290: done (3 left) 2024-03-30T12:33:34.923 INFO:tasks.rados.rados.0.smithi084.stdout:3291: done (2 left) 2024-03-30T12:33:34.923 INFO:tasks.rados.rados.0.smithi084.stdout:3292: done (1 left) 2024-03-30T12:33:34.923 INFO:tasks.rados.rados.0.smithi084.stdout:3293: done (0 left) 2024-03-30T12:33:34.923 INFO:tasks.rados.rados.0.smithi084.stdout:3294: rollback oid 36 current snap is 328 2024-03-30T12:33:34.923 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 36 to 320 2024-03-30T12:33:34.923 INFO:tasks.rados.rados.0.smithi084.stdout:3295: copy_from oid 39 from oid 26 current snap is 328 2024-03-30T12:33:34.923 INFO:tasks.rados.rados.0.smithi084.stdout:3296: rmattr oid 20 current snap is 328 2024-03-30T12:33:34.924 INFO:tasks.rados.rados.0.smithi084.stdout:3296: done (2 left) 2024-03-30T12:33:34.924 INFO:tasks.rados.rados.0.smithi084.stdout:3297: read oid 11 snap 326 2024-03-30T12:33:34.924 INFO:tasks.rados.rados.0.smithi084.stdout:3297: expect (ObjNum 883 snap 282 seq_num 883) 2024-03-30T12:33:34.924 INFO:tasks.rados.rados.0.smithi084.stdout:3298: rmattr oid 33 current snap is 328 2024-03-30T12:33:34.924 INFO:tasks.rados.rados.0.smithi084.stdout:3298: done (3 left) 2024-03-30T12:33:34.924 INFO:tasks.rados.rados.0.smithi084.stdout:3299: copy_from oid 6 from oid 28 current snap is 328 2024-03-30T12:33:34.924 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 328 2024-03-30T12:33:34.924 INFO:tasks.rados.rados.0.smithi084.stdout:3300: seq_num 1020 ranges {0=286720} 2024-03-30T12:33:34.925 INFO:tasks.rados.rados.0.smithi084.stdout:3300: writing smithi08477944-41 from 0 to 286720 tid 1 2024-03-30T12:33:34.925 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 328 2024-03-30T12:33:34.925 INFO:tasks.rados.rados.0.smithi084.stdout:3301: seq_num 1021 ranges {0=303104} 2024-03-30T12:33:34.926 INFO:tasks.rados.rados.0.smithi084.stdout:3301: writing smithi08477944-49 from 0 to 303104 tid 1 2024-03-30T12:33:34.926 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 27 current snap is 328 2024-03-30T12:33:34.926 INFO:tasks.rados.rados.0.smithi084.stdout:3302: seq_num 1022 ranges {139264=319488} 2024-03-30T12:33:34.929 INFO:tasks.rados.rados.0.smithi084.stdout:3302: writing smithi08477944-27 from 139264 to 458752 tid 1 2024-03-30T12:33:34.929 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 30 current snap is 328 2024-03-30T12:33:34.929 INFO:tasks.rados.rados.0.smithi084.stdout:3303: seq_num 1023 ranges {0=335872} 2024-03-30T12:33:34.932 INFO:tasks.rados.rados.0.smithi084.stdout:3303: writing smithi08477944-30 from 0 to 335872 tid 1 2024-03-30T12:33:34.932 INFO:tasks.rados.rados.0.smithi084.stdout:3304: read oid 1 snap -1 2024-03-30T12:33:34.932 INFO:tasks.rados.rados.0.smithi084.stdout:3304: expect (ObjNum 1001 snap 324 seq_num 1001) 2024-03-30T12:33:34.932 INFO:tasks.rados.rados.0.smithi084.stdout:3305: snap_create 2024-03-30T12:33:34.932 INFO:tasks.rados.rados.0.smithi084.stdout:3297: expect (ObjNum 883 snap 282 seq_num 883) 2024-03-30T12:33:34.960 INFO:tasks.rados.rados.0.smithi084.stdout:3300: finishing write tid 1 to smithi08477944-41 2024-03-30T12:33:34.960 INFO:tasks.rados.rados.0.smithi084.stdout:3300: finishing write tid 2 to smithi08477944-41 2024-03-30T12:33:34.960 INFO:tasks.rados.rados.0.smithi084.stdout:3300: finishing write tid 3 to smithi08477944-41 2024-03-30T12:33:34.960 INFO:tasks.rados.rados.0.smithi084.stdout:3300: oid 41 updating version 0 to 27312 2024-03-30T12:33:34.960 INFO:tasks.rados.rados.0.smithi084.stdout:3300: oid 41 version 27312 is already newer than 27311 2024-03-30T12:33:34.960 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 27312 (ObjNum 1020 snap 328 seq_num 1020) dirty exists 2024-03-30T12:33:34.960 INFO:tasks.rados.rados.0.smithi084.stdout:3300: left oid 41 (ObjNum 1020 snap 328 seq_num 1020) 2024-03-30T12:33:34.960 INFO:tasks.rados.rados.0.smithi084.stdout:3294: finishing rollback tid 0 to smithi08477944-36 2024-03-30T12:33:34.960 INFO:tasks.rados.rados.0.smithi084.stdout:3294: finishing rollback tid 1 to smithi08477944-36 2024-03-30T12:33:34.961 INFO:tasks.rados.rados.0.smithi084.stdout:3294: finishing rollback tid 2 to smithi08477944-36 2024-03-30T12:33:34.961 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 36283 (ObjNum 905 snap 287 seq_num 905) dirty exists 2024-03-30T12:33:34.961 INFO:tasks.rados.rados.0.smithi084.stdout:3301: finishing write tid 1 to smithi08477944-49 2024-03-30T12:33:34.961 INFO:tasks.rados.rados.0.smithi084.stdout:3301: finishing write tid 2 to smithi08477944-49 2024-03-30T12:33:34.961 INFO:tasks.rados.rados.0.smithi084.stdout:3302: finishing write tid 1 to smithi08477944-27 2024-03-30T12:33:34.961 INFO:tasks.rados.rados.0.smithi084.stdout:3303: finishing write tid 1 to smithi08477944-30 2024-03-30T12:33:34.961 INFO:tasks.rados.rados.0.smithi084.stdout:3303: finishing write tid 2 to smithi08477944-30 2024-03-30T12:33:34.961 INFO:tasks.rados.rados.0.smithi084.stdout:3301: finishing write tid 3 to smithi08477944-49 2024-03-30T12:33:34.961 INFO:tasks.rados.rados.0.smithi084.stdout:3301: oid 49 updating version 0 to 36285 2024-03-30T12:33:34.961 INFO:tasks.rados.rados.0.smithi084.stdout:3301: oid 49 version 36285 is already newer than 36284 2024-03-30T12:33:34.961 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 36285 (ObjNum 1021 snap 328 seq_num 1021) dirty exists 2024-03-30T12:33:34.961 INFO:tasks.rados.rados.0.smithi084.stdout:3301: left oid 49 (ObjNum 1021 snap 328 seq_num 1021) 2024-03-30T12:33:34.961 INFO:tasks.rados.rados.0.smithi084.stdout:3302: finishing write tid 2 to smithi08477944-27 2024-03-30T12:33:34.961 INFO:tasks.rados.rados.0.smithi084.stdout:3303: finishing write tid 3 to smithi08477944-30 2024-03-30T12:33:34.961 INFO:tasks.rados.rados.0.smithi084.stdout:3303: oid 30 updating version 0 to 27298 2024-03-30T12:33:34.962 INFO:tasks.rados.rados.0.smithi084.stdout:3303: oid 30 updating version 27298 to 27299 2024-03-30T12:33:34.962 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 27299 (ObjNum 1023 snap 328 seq_num 1023) dirty exists 2024-03-30T12:33:34.962 INFO:tasks.rados.rados.0.smithi084.stdout:3303: left oid 30 (ObjNum 1023 snap 328 seq_num 1023) 2024-03-30T12:33:34.962 INFO:tasks.rados.rados.0.smithi084.stdout:3302: finishing write tid 3 to smithi08477944-27 2024-03-30T12:33:34.962 INFO:tasks.rados.rados.0.smithi084.stdout:3302: oid 27 updating version 0 to 27248 2024-03-30T12:33:34.962 INFO:tasks.rados.rados.0.smithi084.stdout:3302: oid 27 updating version 27248 to 27249 2024-03-30T12:33:34.962 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 27249 (ObjNum 1022 snap 328 seq_num 1022) dirty exists 2024-03-30T12:33:34.962 INFO:tasks.rados.rados.0.smithi084.stdout:3302: left oid 27 (ObjNum 1022 snap 328 seq_num 1022) 2024-03-30T12:33:34.962 INFO:tasks.rados.rados.0.smithi084.stdout:3299: finishing copy_from racing read to smithi08477944-6 2024-03-30T12:33:34.962 INFO:tasks.rados.rados.0.smithi084.stdout:3299: finishing copy_from to smithi08477944-6 2024-03-30T12:33:34.962 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 27375 (ObjNum 947 snap 301 seq_num 947) dirty exists 2024-03-30T12:33:34.962 INFO:tasks.rados.rados.0.smithi084.stdout:3304: expect (ObjNum 1001 snap 324 seq_num 1001) 2024-03-30T12:33:35.106 INFO:tasks.rados.rados.0.smithi084.stdout:3295: finishing copy_from racing read to smithi08477944-39 2024-03-30T12:33:35.107 INFO:tasks.rados.rados.0.smithi084.stdout:3295: finishing copy_from to smithi08477944-39 2024-03-30T12:33:35.107 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 27392 (ObjNum 938 snap 299 seq_num 938) dirty exists 2024-03-30T12:33:35.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:34.935+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:35.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:34.943+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:35.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:34.929+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:35.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:34.929+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:35.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:34.929+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:35.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:34.929+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:35.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:34.929+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:35.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:34.929+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:35.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:35.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:35.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:35.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:35.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[91810]: osdmap e720: 8 total, 8 up, 8 in 2024-03-30T12:33:35.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:35.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:35.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:35.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:35.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:35.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:35.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:35.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:35.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:35.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[91810]: pgmap v770: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 984 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 12 MiB/s rd, 2.5 MiB/s wr, 34 op/s 2024-03-30T12:33:35.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:35.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:35.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:35.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:35.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[89279]: osdmap e720: 8 total, 8 up, 8 in 2024-03-30T12:33:35.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:35.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:35.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:35.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:35.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:35.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:35.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:35.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:35.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:35.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:34 smithi084 ceph-mon[89279]: pgmap v770: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 984 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 12 MiB/s rd, 2.5 MiB/s wr, 34 op/s 2024-03-30T12:33:35.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:34.943+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:35.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:34.931+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:35.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:34.931+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:35.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:34.934+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:35.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:34.934+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:35.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:34.935+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:35.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:34.930+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:35.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:34.930+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:35.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:35.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:35.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:35.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:35.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:34 smithi162 ceph-mon[83709]: osdmap e720: 8 total, 8 up, 8 in 2024-03-30T12:33:35.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:35.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:35.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 162=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:35.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:35.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:35.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:35.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:35.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:35.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:35.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:34 smithi162 ceph-mon[83709]: pgmap v770: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 984 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 12 MiB/s rd, 2.5 MiB/s wr, 34 op/s 2024-03-30T12:33:35.931 INFO:tasks.rados.rados.0.smithi084.stdout:3294: done (9 left) 2024-03-30T12:33:35.931 INFO:tasks.rados.rados.0.smithi084.stdout:3295: done (8 left) 2024-03-30T12:33:35.932 INFO:tasks.rados.rados.0.smithi084.stdout:3297: done (7 left) 2024-03-30T12:33:35.932 INFO:tasks.rados.rados.0.smithi084.stdout:3299: done (6 left) 2024-03-30T12:33:35.932 INFO:tasks.rados.rados.0.smithi084.stdout:3300: done (5 left) 2024-03-30T12:33:35.932 INFO:tasks.rados.rados.0.smithi084.stdout:3301: done (4 left) 2024-03-30T12:33:35.932 INFO:tasks.rados.rados.0.smithi084.stdout:3302: done (3 left) 2024-03-30T12:33:35.932 INFO:tasks.rados.rados.0.smithi084.stdout:3303: done (2 left) 2024-03-30T12:33:35.932 INFO:tasks.rados.rados.0.smithi084.stdout:3304: done (1 left) 2024-03-30T12:33:35.932 INFO:tasks.rados.rados.0.smithi084.stdout:3305: done (0 left) 2024-03-30T12:33:35.932 INFO:tasks.rados.rados.0.smithi084.stdout:3306: delete oid 39 current snap is 329 2024-03-30T12:33:35.938 INFO:tasks.rados.rados.0.smithi084.stdout:3306: done (0 left) 2024-03-30T12:33:35.938 INFO:tasks.rados.rados.0.smithi084.stdout:3307: read oid 44 snap 307 2024-03-30T12:33:35.938 INFO:tasks.rados.rados.0.smithi084.stdout:3307: expect (ObjNum 904 snap 287 seq_num 904) 2024-03-30T12:33:35.938 INFO:tasks.rados.rados.0.smithi084.stdout:3308: read oid 49 snap 324 2024-03-30T12:33:35.938 INFO:tasks.rados.rados.0.smithi084.stdout:3308: expect deleted 2024-03-30T12:33:35.938 INFO:tasks.rados.rados.0.smithi084.stdout:3309: copy_from oid 19 from oid 14 current snap is 329 2024-03-30T12:33:35.938 INFO:tasks.rados.rados.0.smithi084.stdout:3310: snap_create 2024-03-30T12:33:35.978 INFO:tasks.rados.rados.0.smithi084.stdout:3307: expect (ObjNum 904 snap 287 seq_num 904) 2024-03-30T12:33:36.188 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:35.946+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:36.188 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:35.937+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:36.188 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:35.937+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:36.189 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:35.939+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:36.189 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:35.939+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:36.189 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:36.189 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:36.189 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:36.189 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:36.189 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:36.189 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:35 smithi162 ceph-mon[83709]: osdmap e721: 8 total, 8 up, 8 in 2024-03-30T12:33:36.189 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:36.189 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:36.190 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:36.190 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:36.190 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:36.190 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:36.190 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:36.190 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:36.190 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:36.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:35.943+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:36.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:35.946+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:36.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:35.939+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:36.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:35.939+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:36.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:35.939+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:36.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:35.940+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:36.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:35.940+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:36.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[91810]: osdmap e721: 8 total, 8 up, 8 in 2024-03-30T12:33:36.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:36.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:36.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:36.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:36.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:36.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:36.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:36.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:36.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:36.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:36.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:36.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:36.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:36.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:36.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[89279]: osdmap e721: 8 total, 8 up, 8 in 2024-03-30T12:33:36.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:36.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:36.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:36.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:36.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:36.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:36.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 160=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:36.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:36.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:36.396 INFO:tasks.rados.rados.0.smithi084.stdout:3309: finishing copy_from to smithi08477944-19 2024-03-30T12:33:36.396 INFO:tasks.rados.rados.0.smithi084.stdout:3309: got expected ENOENT (src dne) 2024-03-30T12:33:36.396 INFO:tasks.rados.rados.0.smithi084.stdout:3309: finishing copy_from racing read to smithi08477944-19 2024-03-30T12:33:36.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:36.196+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:36.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:36.196+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:36.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:36.196+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:36.935 INFO:tasks.rados.rados.0.smithi084.stdout:3307: done (3 left) 2024-03-30T12:33:36.935 INFO:tasks.rados.rados.0.smithi084.stdout:3308: done (2 left) 2024-03-30T12:33:36.935 INFO:tasks.rados.rados.0.smithi084.stdout:3309: done (1 left) 2024-03-30T12:33:36.935 INFO:tasks.rados.rados.0.smithi084.stdout:3310: done (0 left) 2024-03-30T12:33:36.935 INFO:tasks.rados.rados.0.smithi084.stdout:3311: delete oid 8 current snap is 330 2024-03-30T12:33:36.943 INFO:tasks.rados.rados.0.smithi084.stdout:3311: done (0 left) 2024-03-30T12:33:36.943 INFO:tasks.rados.rados.0.smithi084.stdout:3312: snap_remove snap 292 2024-03-30T12:33:37.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:36.950+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:37.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:36.951+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:37.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:37.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:37.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:37.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:37.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:37.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:37.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[91810]: osdmap e722: 8 total, 8 up, 8 in 2024-03-30T12:33:37.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:37.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:37.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:37.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:37.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:37.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:37.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:37.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[91810]: pgmap v773: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1015 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 11 MiB/s wr, 30 op/s 2024-03-30T12:33:37.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:36.941+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:37.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:36.941+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:37.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:36.941+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:37.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:36.941+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:37.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:36.942+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:37.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:36.942+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:37.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:37.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:37.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:37.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:37.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:37.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:37.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[89279]: osdmap e722: 8 total, 8 up, 8 in 2024-03-30T12:33:37.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:37.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:37.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:37.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:37.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:37.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:37.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:37.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:36 smithi084 ceph-mon[89279]: pgmap v773: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1015 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 11 MiB/s wr, 30 op/s 2024-03-30T12:33:37.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:36.943+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:37.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:37.069+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:37.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:37.069+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:37.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:37.069+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:37.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:36.942+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:37.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:36.942+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:37.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:37.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:37.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:37.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:37.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:37.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:37.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:36 smithi162 ceph-mon[83709]: osdmap e722: 8 total, 8 up, 8 in 2024-03-30T12:33:37.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:37.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:37.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:37.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:37.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:37.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:37.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:37.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:36 smithi162 ceph-mon[83709]: pgmap v773: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1015 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 11 MiB/s wr, 30 op/s 2024-03-30T12:33:37.372 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:36.946+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:37.372 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:36.951+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:37.937 INFO:tasks.rados.rados.0.smithi084.stdout:3312: done (0 left) 2024-03-30T12:33:37.937 INFO:tasks.rados.rados.0.smithi084.stdout:3313: rmattr oid 5 current snap is 330 2024-03-30T12:33:37.937 INFO:tasks.rados.rados.0.smithi084.stdout:3314: snap_create 2024-03-30T12:33:37.943 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 27286 (ObjNum 836 snap 273 seq_num 836) dirty exists 2024-03-30T12:33:38.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:37.955+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:38.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:37.955+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:38.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:38.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:38.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:38.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:38.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:38.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:38.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[89279]: osdmap e723: 8 total, 8 up, 8 in 2024-03-30T12:33:38.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:38.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:38.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:38.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:38.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:38.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:38.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:38.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:37.951+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:38.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:37.951+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:38.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:37.951+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:38.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:37.952+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:38.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:37.952+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:38.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:38.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:38.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:38.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:38.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:38.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:38.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[91810]: osdmap e723: 8 total, 8 up, 8 in 2024-03-30T12:33:38.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:38.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:38.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:38.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:38.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:38.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:38.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:38.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:37.945+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:38.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:37.946+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:38.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:37.943+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:38.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:37.944+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:38.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:37.949+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:38.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:37.949+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:38.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:37.951+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:38.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:38.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:38.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:38.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:38.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:38.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:38.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:37 smithi162 ceph-mon[83709]: osdmap e723: 8 total, 8 up, 8 in 2024-03-30T12:33:38.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:38.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:38.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:38.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:38.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:38.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:38.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:38.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:38.557+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:38.949 INFO:tasks.rados.rados.0.smithi084.stdout:3313: done (1 left) 2024-03-30T12:33:38.950 INFO:tasks.rados.rados.0.smithi084.stdout:3314: done (0 left) 2024-03-30T12:33:38.950 INFO:tasks.rados.rados.0.smithi084.stdout:3315: snap_remove snap 300 2024-03-30T12:33:39.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:39.117+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:39.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:39.117+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:39.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:39.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:39.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[89279]: osdmap e724: 8 total, 8 up, 8 in 2024-03-30T12:33:39.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:39.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:39.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:39.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:39.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:39.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:39.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:39.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:39.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:39.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:39.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:39.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[89279]: pgmap v776: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1017 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 11 MiB/s rd, 8.8 MiB/s wr, 19 op/s 2024-03-30T12:33:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[91810]: osdmap e724: 8 total, 8 up, 8 in 2024-03-30T12:33:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:39.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:39.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:39.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:39.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:39.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:39.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:39.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:38 smithi084 ceph-mon[91810]: pgmap v776: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1017 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 11 MiB/s rd, 8.8 MiB/s wr, 19 op/s 2024-03-30T12:33:39.361 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:38.957+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:39.362 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:38.957+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:39.362 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:38.957+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:39.362 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:38.957+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:39.362 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:38.957+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:39.362 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:39.124+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:39.362 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:39.124+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:39.363 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:39.363 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 16d=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:39.363 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:38 smithi162 ceph-mon[83709]: osdmap e724: 8 total, 8 up, 8 in 2024-03-30T12:33:39.363 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:39.363 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:39.363 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:39.363 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:39.363 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:39.363 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:39.363 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:39.363 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:39.363 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:39.363 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:39.364 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:39.364 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:38 smithi162 ceph-mon[83709]: pgmap v776: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1017 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 11 MiB/s rd, 8.8 MiB/s wr, 19 op/s 2024-03-30T12:33:39.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:39.369+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:39.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:33:39] "GET /metrics HTTP/1.1" 200 36328 "" "Prometheus/2.43.0" 2024-03-30T12:33:39.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:39.370+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:39.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:39.370+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:39.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:39.370+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:39.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:39.370+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:39.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:39.370+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:39.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:39.371+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:39.956 INFO:tasks.rados.rados.0.smithi084.stdout:3315: done (0 left) 2024-03-30T12:33:39.956 INFO:tasks.rados.rados.0.smithi084.stdout:3316: snap_remove snap 319 2024-03-30T12:33:40.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:39.969+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:40.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:39.969+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:40.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:39.964+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:40.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:39.965+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:40.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:39.965+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:40.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:39.965+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:40.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:39.965+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:40.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-mon[89279]: osdmap e725: 8 total, 8 up, 8 in 2024-03-30T12:33:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:40.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:40.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:40.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:40.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:40.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-mon[91810]: osdmap e725: 8 total, 8 up, 8 in 2024-03-30T12:33:40.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:40.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:40.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:40.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:40.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:40.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:39.969+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:40.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:39.969+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:40.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:40.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:40.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:40.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:40.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:39 smithi162 ceph-mon[83709]: osdmap e725: 8 total, 8 up, 8 in 2024-03-30T12:33:40.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:40.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:40.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:40.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:40.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:40.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:39.963+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:40.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:39.964+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:40.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:39.964+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:40.789 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:40.502+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:40.969 INFO:tasks.rados.rados.0.smithi084.stdout:3316: done (0 left) 2024-03-30T12:33:40.969 INFO:tasks.rados.rados.0.smithi084.stdout:3317: snap_create 2024-03-30T12:33:41.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:41.003+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:41.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:40.980+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:41.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:40.980+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:41.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:40.977+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:41.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:40.977+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:41.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:40.977+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:41.121 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:40.797+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:41.121 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:40.797+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:41.121 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:40.978+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:41.121 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:40.978+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:41.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:41.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:41.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:41.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:41.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:41.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:41.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:40 smithi162 ceph-mon[83709]: osdmap e726: 8 total, 8 up, 8 in 2024-03-30T12:33:41.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:41.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:41.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:41.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:41.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:41.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:40 smithi162 ceph-mon[83709]: pgmap v779: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1018 MiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 14 MiB/s rd, 716 KiB/s wr, 18 op/s 2024-03-30T12:33:41.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:40.983+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:41.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:40.983+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:41.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:41.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:41.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:41.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:41.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:41.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:41.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[89279]: osdmap e726: 8 total, 8 up, 8 in 2024-03-30T12:33:41.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:41.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:41.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:41.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:41.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:41.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[89279]: pgmap v779: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1018 MiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 14 MiB/s rd, 716 KiB/s wr, 18 op/s 2024-03-30T12:33:41.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:40.976+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:41.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:40.976+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:41.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:40.976+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:41.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:40.976+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:41.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:40.976+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:41.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:40.976+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:41.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:41.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:41.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:41.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:41.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:41.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:41.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[91810]: osdmap e726: 8 total, 8 up, 8 in 2024-03-30T12:33:41.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:41.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:41.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:41.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:41.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:41.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:40 smithi084 ceph-mon[91810]: pgmap v779: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1018 MiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 14 MiB/s rd, 716 KiB/s wr, 18 op/s 2024-03-30T12:33:41.971 INFO:tasks.rados.rados.0.smithi084.stdout:3317: done (0 left) 2024-03-30T12:33:41.971 INFO:tasks.rados.rados.0.smithi084.stdout:3318: read oid 36 snap 327 2024-03-30T12:33:41.971 INFO:tasks.rados.rados.0.smithi084.stdout:3318: expect (ObjNum 905 snap 287 seq_num 905) 2024-03-30T12:33:41.971 INFO:tasks.rados.rados.0.smithi084.stdout:3319: setattr oid 19 current snap is 332 2024-03-30T12:33:41.972 INFO:tasks.rados.rados.0.smithi084.stdout:3320: copy_from oid 31 from oid 11 current snap is 332 2024-03-30T12:33:41.972 INFO:tasks.rados.rados.0.smithi084.stdout:3321: snap_remove snap 320 2024-03-30T12:33:42.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:41.983+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:42.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:41.989+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:42.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:42.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:42.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:42.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:42.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:42.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:42.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[89279]: osdmap e727: 8 total, 8 up, 8 in 2024-03-30T12:33:42.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:42.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:42.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:42.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:42.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:42.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:41.979+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:42.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:41.979+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:42.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:41.979+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:42.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:41.979+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:42.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:41.979+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:42.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:42.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:42.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:42.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:42.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:42.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:42.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:42.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:42.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:42.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:42.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[91810]: osdmap e727: 8 total, 8 up, 8 in 2024-03-30T12:33:42.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:42.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:42.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:42.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:42.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:42.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:42.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:42.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:42.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:42.369 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:41.978+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:42.369 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:41.978+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:42.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:41.976+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:42.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:41.976+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:42.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:41.991+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:42.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:41.991+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:42.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:41.991+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:42.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:42.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:42.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:42.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:42.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:42.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:42.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:41 smithi162 ceph-mon[83709]: osdmap e727: 8 total, 8 up, 8 in 2024-03-30T12:33:42.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:42.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:42.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:42.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:42.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:42.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:42.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:42.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:42.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:42.974 INFO:tasks.rados.rados.0.smithi084.stdout:3321: done (3 left) 2024-03-30T12:33:42.974 INFO:tasks.rados.rados.0.smithi084.stdout:3322: rmattr oid 15 current snap is 332 2024-03-30T12:33:42.974 INFO:tasks.rados.rados.0.smithi084.stdout:3322: done (3 left) 2024-03-30T12:33:42.974 INFO:tasks.rados.rados.0.smithi084.stdout:3323: rollback oid 12 current snap is 332 2024-03-30T12:33:42.974 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 12 to 321 2024-03-30T12:33:42.974 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 36345 (ObjNum 912 snap 290 seq_num 912) dirty exists 2024-03-30T12:33:42.974 INFO:tasks.rados.rados.0.smithi084.stdout:3320: finishing copy_from racing read to smithi08477944-31 2024-03-30T12:33:42.975 INFO:tasks.rados.rados.0.smithi084.stdout:3318: expect (ObjNum 905 snap 287 seq_num 905) 2024-03-30T12:33:42.996 INFO:tasks.rados.rados.0.smithi084.stdout:3320: finishing copy_from to smithi08477944-31 2024-03-30T12:33:42.996 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 27238 (ObjNum 883 snap 282 seq_num 883) dirty exists 2024-03-30T12:33:42.996 INFO:tasks.rados.rados.0.smithi084.stdout:3323: finishing rollback tid 0 to smithi08477944-12 2024-03-30T12:33:42.997 INFO:tasks.rados.rados.0.smithi084.stdout:3323: finishing rollback tid 1 to smithi08477944-12 2024-03-30T12:33:42.997 INFO:tasks.rados.rados.0.smithi084.stdout:3323: finishing rollback tid 2 to smithi08477944-12 2024-03-30T12:33:42.997 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 27252 (ObjNum 883 snap 282 seq_num 883) dirty exists 2024-03-30T12:33:42.997 INFO:tasks.rados.rados.0.smithi084.stdout:3318: done (3 left) 2024-03-30T12:33:42.997 INFO:tasks.rados.rados.0.smithi084.stdout:3319: done (2 left) 2024-03-30T12:33:42.997 INFO:tasks.rados.rados.0.smithi084.stdout:3320: done (1 left) 2024-03-30T12:33:42.997 INFO:tasks.rados.rados.0.smithi084.stdout:3323: done (0 left) 2024-03-30T12:33:42.997 INFO:tasks.rados.rados.0.smithi084.stdout:3324: snap_remove snap 331 2024-03-30T12:33:43.209 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:42.988+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:43.209 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:42.989+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:43.209 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:43.209 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:43.209 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:43.209 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:43.210 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:43.210 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:43.210 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:43.210 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:43.210 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:43.210 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:43.210 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[91810]: osdmap e728: 8 total, 8 up, 8 in 2024-03-30T12:33:43.210 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:43.210 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:43.210 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:43.210 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:43.210 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:43.210 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:43.210 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[91810]: pgmap v782: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1018 MiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 3.6 MiB/s rd, 78 KiB/s wr, 9 op/s 2024-03-30T12:33:43.211 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:43.211 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:43.211 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:43.211 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:43.211 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:43.211 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:43.211 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:43.211 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:43.211 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:43.212 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:43.212 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[89279]: osdmap e728: 8 total, 8 up, 8 in 2024-03-30T12:33:43.212 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:43.212 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:43.212 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:43.212 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:43.212 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:43.212 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:43.212 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:42 smithi084 ceph-mon[89279]: pgmap v782: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1018 MiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 3.6 MiB/s rd, 78 KiB/s wr, 9 op/s 2024-03-30T12:33:43.212 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:42.989+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:43.213 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:42.983+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:43.213 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:42.983+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:43.213 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:42.986+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:43.213 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:42.987+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:43.213 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:42.987+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:43.214 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:43.214 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:43.214 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:43.214 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:43.214 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:43.214 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:43.214 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:43.214 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:43.214 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:43.214 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:43.215 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:42 smithi162 ceph-mon[83709]: osdmap e728: 8 total, 8 up, 8 in 2024-03-30T12:33:43.215 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:43.215 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:43.215 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:43.215 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:43.215 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:43.215 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:43.215 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:42 smithi162 ceph-mon[83709]: pgmap v782: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1018 MiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 3.6 MiB/s rd, 78 KiB/s wr, 9 op/s 2024-03-30T12:33:43.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:43.217+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:43.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:43.217+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:43.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:43.217+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:43.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:43.217+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:43.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:43.217+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:43.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:43.218+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:43.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:43.218+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:43.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:43.218+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:43.978 INFO:tasks.rados.rados.0.smithi084.stdout:3324: done (0 left) 2024-03-30T12:33:44.054 INFO:tasks.rados.rados.0.smithi084.stdout:3325: snap_remove snap 312 2024-03-30T12:33:44.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[91810]: osdmap e729: 8 total, 8 up, 8 in 2024-03-30T12:33:44.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:44.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:44.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:44.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:44.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:44.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:44.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:44.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:44.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:44.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:44.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:44.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:44.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:44.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:43.983+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:44.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:43.983+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:44.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:43.984+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:44.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:43.984+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:44.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:43.984+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:44.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[89279]: osdmap e729: 8 total, 8 up, 8 in 2024-03-30T12:33:44.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:44.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:44.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:44.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:44.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:44.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:44.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:44.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:44.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:44.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:44.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:44.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:44.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:44.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:43.984+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:44.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:43.986+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:44.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:43.984+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:44.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:43.984+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:44.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:44.070+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:44.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:44.070+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:44.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:44.070+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:44.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:43 smithi162 ceph-mon[83709]: osdmap e729: 8 total, 8 up, 8 in 2024-03-30T12:33:44.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 176=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:44.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:44.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:44.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:44.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:44.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:44.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:44.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:44.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:44.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:44.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:44.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:44.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:44.984 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:44.669+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:44.984 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:44.670+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:44.985 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:44.670+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:44.987 INFO:tasks.rados.rados.0.smithi084.stdout:3325: done (0 left) 2024-03-30T12:33:44.987 INFO:tasks.rados.rados.0.smithi084.stdout:3326: copy_from oid 37 from oid 24 current snap is 332 2024-03-30T12:33:44.987 INFO:tasks.rados.rados.0.smithi084.stdout:3327: copy_from oid 28 from oid 12 current snap is 332 2024-03-30T12:33:44.987 INFO:tasks.rados.rados.0.smithi084.stdout:3328: snap_remove snap 313 2024-03-30T12:33:45.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:44.998+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:45.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:44.998+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:45.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:44.992+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:45.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:44.992+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:45.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:44.992+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:45.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:44.992+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:45.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:44.993+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:45.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:44.993+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[91810]: osdmap e730: 8 total, 8 up, 8 in 2024-03-30T12:33:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:45.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:45.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:33:45.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[91810]: pgmap v785: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1018 MiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 0 B/s rd, 156 KiB/s wr, 6 op/s 2024-03-30T12:33:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[89279]: osdmap e730: 8 total, 8 up, 8 in 2024-03-30T12:33:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:45.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:45.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:45.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:45.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:45.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:45.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:45.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:45.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:33:45.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:45 smithi084 ceph-mon[89279]: pgmap v785: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1018 MiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 0 B/s rd, 156 KiB/s wr, 6 op/s 2024-03-30T12:33:45.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:45.000+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:45.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:45.004+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:45.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:45.005+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:45.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:44.993+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:45.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:44.993+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:45.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:44.993+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:45.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:45.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:45.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:45.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:45.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:44 smithi162 ceph-mon[83709]: osdmap e730: 8 total, 8 up, 8 in 2024-03-30T12:33:45.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:45.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:45.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:45.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:45.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:45.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:45.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:45.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:45.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:45.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:44 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:33:45.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:44 smithi162 ceph-mon[83709]: pgmap v785: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1018 MiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 0 B/s rd, 156 KiB/s wr, 6 op/s 2024-03-30T12:33:45.372 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:44.997+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:45.373 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:44.997+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:46.002 INFO:tasks.rados.rados.0.smithi084.stdout:3328: done (2 left) 2024-03-30T12:33:46.002 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 332 2024-03-30T12:33:46.002 INFO:tasks.rados.rados.0.smithi084.stdout:3326: finishing copy_from to smithi08477944-37 2024-03-30T12:33:46.002 INFO:tasks.rados.rados.0.smithi084.stdout:3326: got expected ENOENT (src dne) 2024-03-30T12:33:46.002 INFO:tasks.rados.rados.0.smithi084.stdout:3329: seq_num 1026 ranges {0=385024} 2024-03-30T12:33:46.004 INFO:tasks.rados.rados.0.smithi084.stdout:3329: writing smithi08477944-43 from 0 to 385024 tid 1 2024-03-30T12:33:46.005 INFO:tasks.rados.rados.0.smithi084.stdout:3330: rmattr oid 35 current snap is 332 2024-03-30T12:33:46.005 INFO:tasks.rados.rados.0.smithi084.stdout:3326: finishing copy_from racing read to smithi08477944-37 2024-03-30T12:33:46.005 INFO:tasks.rados.rados.0.smithi084.stdout:3327: finishing copy_from racing read to smithi08477944-28 2024-03-30T12:33:46.005 INFO:tasks.rados.rados.0.smithi084.stdout:3327: finishing copy_from to smithi08477944-28 2024-03-30T12:33:46.005 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 27252 (ObjNum 883 snap 282 seq_num 883) dirty exists 2024-03-30T12:33:46.005 INFO:tasks.rados.rados.0.smithi084.stdout:3326: done (3 left) 2024-03-30T12:33:46.005 INFO:tasks.rados.rados.0.smithi084.stdout:3327: done (2 left) 2024-03-30T12:33:46.005 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 332 2024-03-30T12:33:46.005 INFO:tasks.rados.rados.0.smithi084.stdout:3331: seq_num 1027 ranges {0=409600} 2024-03-30T12:33:46.007 INFO:tasks.rados.rados.0.smithi084.stdout:3331: writing smithi08477944-20 from 0 to 409600 tid 1 2024-03-30T12:33:46.007 INFO:tasks.rados.rados.0.smithi084.stdout:3332: setattr oid 36 current snap is 332 2024-03-30T12:33:46.008 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 23397 (ObjNum 664 snap 232 seq_num 664) dirty exists 2024-03-30T12:33:46.014 INFO:tasks.rados.rados.0.smithi084.stdout:3331: finishing write tid 1 to smithi08477944-20 2024-03-30T12:33:46.014 INFO:tasks.rados.rados.0.smithi084.stdout:3329: finishing write tid 1 to smithi08477944-43 2024-03-30T12:33:46.015 INFO:tasks.rados.rados.0.smithi084.stdout:3329: finishing write tid 2 to smithi08477944-43 2024-03-30T12:33:46.015 INFO:tasks.rados.rados.0.smithi084.stdout:3330: done (3 left) 2024-03-30T12:33:46.015 INFO:tasks.rados.rados.0.smithi084.stdout:3333: read oid 33 snap -1 2024-03-30T12:33:46.015 INFO:tasks.rados.rados.0.smithi084.stdout:3333: expect deleted 2024-03-30T12:33:46.015 INFO:tasks.rados.rados.0.smithi084.stdout:3334: delete oid 7 current snap is 332 2024-03-30T12:33:46.015 INFO:tasks.rados.rados.0.smithi084.stdout:3331: finishing write tid 2 to smithi08477944-20 2024-03-30T12:33:46.019 INFO:tasks.rados.rados.0.smithi084.stdout:3329: finishing write tid 3 to smithi08477944-43 2024-03-30T12:33:46.019 INFO:tasks.rados.rados.0.smithi084.stdout:3329: oid 43 updating version 0 to 36347 2024-03-30T12:33:46.019 INFO:tasks.rados.rados.0.smithi084.stdout:3329: oid 43 version 36347 is already newer than 36346 2024-03-30T12:33:46.019 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 36347 (ObjNum 1026 snap 332 seq_num 1026) dirty exists 2024-03-30T12:33:46.019 INFO:tasks.rados.rados.0.smithi084.stdout:3329: left oid 43 (ObjNum 1026 snap 332 seq_num 1026) 2024-03-30T12:33:46.020 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 36286 (ObjNum 905 snap 287 seq_num 905) dirty exists 2024-03-30T12:33:46.020 INFO:tasks.rados.rados.0.smithi084.stdout:3331: finishing write tid 3 to smithi08477944-20 2024-03-30T12:33:46.020 INFO:tasks.rados.rados.0.smithi084.stdout:3331: oid 20 updating version 0 to 27306 2024-03-30T12:33:46.020 INFO:tasks.rados.rados.0.smithi084.stdout:3331: oid 20 updating version 27306 to 27307 2024-03-30T12:33:46.020 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 27307 (ObjNum 1027 snap 332 seq_num 1027) dirty exists 2024-03-30T12:33:46.020 INFO:tasks.rados.rados.0.smithi084.stdout:3331: left oid 20 (ObjNum 1027 snap 332 seq_num 1027) 2024-03-30T12:33:46.020 INFO:tasks.rados.rados.0.smithi084.stdout:3329: done (4 left) 2024-03-30T12:33:46.020 INFO:tasks.rados.rados.0.smithi084.stdout:3331: done (3 left) 2024-03-30T12:33:46.020 INFO:tasks.rados.rados.0.smithi084.stdout:3332: done (2 left) 2024-03-30T12:33:46.020 INFO:tasks.rados.rados.0.smithi084.stdout:3333: done (1 left) 2024-03-30T12:33:46.020 INFO:tasks.rados.rados.0.smithi084.stdout:3334: done (0 left) 2024-03-30T12:33:46.020 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 39 current snap is 332 2024-03-30T12:33:46.021 INFO:tasks.rados.rados.0.smithi084.stdout:3335: seq_num 1029 ranges {0=442368} 2024-03-30T12:33:46.022 INFO:tasks.rados.rados.0.smithi084.stdout:3335: writing smithi08477944-39 from 0 to 442368 tid 1 2024-03-30T12:33:46.022 INFO:tasks.rados.rados.0.smithi084.stdout:3336: rollback oid 45 current snap is 332 2024-03-30T12:33:46.022 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 45 to 325 2024-03-30T12:33:46.022 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 332 2024-03-30T12:33:46.023 INFO:tasks.rados.rados.0.smithi084.stdout:3337: seq_num 1030 ranges {385024=458752} 2024-03-30T12:33:46.027 INFO:tasks.rados.rados.0.smithi084.stdout:3337: writing smithi08477944-43 from 385024 to 843776 tid 1 2024-03-30T12:33:46.028 INFO:tasks.rados.rados.0.smithi084.stdout:3338: read oid 9 snap -1 2024-03-30T12:33:46.028 INFO:tasks.rados.rados.0.smithi084.stdout:3338: expect (ObjNum 1007 snap 325 seq_num 1007) 2024-03-30T12:33:46.028 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 332 2024-03-30T12:33:46.028 INFO:tasks.rados.rados.0.smithi084.stdout:3335: finishing write tid 1 to smithi08477944-39 2024-03-30T12:33:46.028 INFO:tasks.rados.rados.0.smithi084.stdout:3335: finishing write tid 2 to smithi08477944-39 2024-03-30T12:33:46.029 INFO:tasks.rados.rados.0.smithi084.stdout:3339: seq_num 1031 ranges {0=475136} 2024-03-30T12:33:46.032 INFO:tasks.rados.rados.0.smithi084.stdout:3339: writing smithi08477944-22 from 0 to 475136 tid 1 2024-03-30T12:33:46.032 INFO:tasks.rados.rados.0.smithi084.stdout:3340: rollback oid 24 current snap is 332 2024-03-30T12:33:46.032 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 24 to 326 2024-03-30T12:33:46.032 INFO:tasks.rados.rados.0.smithi084.stdout:3336: finishing rollback tid 0 to smithi08477944-45 2024-03-30T12:33:46.032 INFO:tasks.rados.rados.0.smithi084.stdout:3336: finishing rollback tid 1 to smithi08477944-45 2024-03-30T12:33:46.032 INFO:tasks.rados.rados.0.smithi084.stdout:3336: finishing rollback tid 2 to smithi08477944-45 2024-03-30T12:33:46.032 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 27315 (ObjNum 955 snap 303 seq_num 955) dirty exists 2024-03-30T12:33:46.032 INFO:tasks.rados.rados.0.smithi084.stdout:3336: done (5 left) 2024-03-30T12:33:46.032 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 332 2024-03-30T12:33:46.032 INFO:tasks.rados.rados.0.smithi084.stdout:3335: finishing write tid 3 to smithi08477944-39 2024-03-30T12:33:46.032 INFO:tasks.rados.rados.0.smithi084.stdout:3335: oid 39 updating version 0 to 27395 2024-03-30T12:33:46.032 INFO:tasks.rados.rados.0.smithi084.stdout:3335: oid 39 version 27395 is already newer than 27394 2024-03-30T12:33:46.032 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 27395 (ObjNum 1029 snap 332 seq_num 1029) dirty exists 2024-03-30T12:33:46.032 INFO:tasks.rados.rados.0.smithi084.stdout:3335: left oid 39 (ObjNum 1029 snap 332 seq_num 1029) 2024-03-30T12:33:46.033 INFO:tasks.rados.rados.0.smithi084.stdout:3341: seq_num 1032 ranges {638976=491520} 2024-03-30T12:33:46.038 INFO:tasks.rados.rados.0.smithi084.stdout:3341: writing smithi08477944-11 from 638976 to 1130496 tid 1 2024-03-30T12:33:46.038 INFO:tasks.rados.rados.0.smithi084.stdout:3335: done (5 left) 2024-03-30T12:33:46.038 INFO:tasks.rados.rados.0.smithi084.stdout:3342: copy_from oid 47 from oid 16 current snap is 332 2024-03-30T12:33:46.038 INFO:tasks.rados.rados.0.smithi084.stdout:3337: finishing write tid 1 to smithi08477944-43 2024-03-30T12:33:46.038 INFO:tasks.rados.rados.0.smithi084.stdout:3337: finishing write tid 2 to smithi08477944-43 2024-03-30T12:33:46.038 INFO:tasks.rados.rados.0.smithi084.stdout:3343: read oid 13 snap -1 2024-03-30T12:33:46.039 INFO:tasks.rados.rados.0.smithi084.stdout:3343: expect (ObjNum 1014 snap 327 seq_num 1014) 2024-03-30T12:33:46.039 INFO:tasks.rados.rados.0.smithi084.stdout:3344: snap_remove snap 327 2024-03-30T12:33:46.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:46.015+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:46.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:46.015+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:46.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:46.019+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:46.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:46.020+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:46.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:46.022+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:46.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:46.023+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:46.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:46.023+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:46.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[91810]: osdmap e731: 8 total, 8 up, 8 in 2024-03-30T12:33:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:46.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:46.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:46.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[89279]: osdmap e731: 8 total, 8 up, 8 in 2024-03-30T12:33:46.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:46.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:46.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:46.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:46.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:46.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:46.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:46.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:46.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:46.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:46.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:46.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:46.035+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:46.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:46.011+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:46.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:46.011+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:46.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:46.009+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:46.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:46.010+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:46.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:46.009+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:46.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:46.009+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:46.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:46.010+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:46.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:46.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:46.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:46 smithi162 ceph-mon[83709]: osdmap e731: 8 total, 8 up, 8 in 2024-03-30T12:33:46.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:46.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:46.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:46.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:46.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:46.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:46.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:46.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:46.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:46.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:46.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:47.008 INFO:tasks.rados.rados.0.smithi084.stdout:3344: done (7 left) 2024-03-30T12:33:47.009 INFO:tasks.rados.rados.0.smithi084.stdout:3345: rollback oid 20 current snap is 332 2024-03-30T12:33:47.009 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 20 to 303 2024-03-30T12:33:47.009 INFO:tasks.rados.rados.0.smithi084.stdout:3337: finishing write tid 3 to smithi08477944-43 2024-03-30T12:33:47.009 INFO:tasks.rados.rados.0.smithi084.stdout:3337: oid 43 updating version 0 to 36348 2024-03-30T12:33:47.009 INFO:tasks.rados.rados.0.smithi084.stdout:3337: oid 43 updating version 36348 to 36349 2024-03-30T12:33:47.009 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 36349 (ObjNum 1030 snap 332 seq_num 1030) dirty exists 2024-03-30T12:33:47.009 INFO:tasks.rados.rados.0.smithi084.stdout:3337: left oid 43 (ObjNum 1030 snap 332 seq_num 1030) 2024-03-30T12:33:47.009 INFO:tasks.rados.rados.0.smithi084.stdout:3339: finishing write tid 1 to smithi08477944-22 2024-03-30T12:33:47.009 INFO:tasks.rados.rados.0.smithi084.stdout:3341: finishing write tid 1 to smithi08477944-11 2024-03-30T12:33:47.009 INFO:tasks.rados.rados.0.smithi084.stdout:3341: finishing write tid 2 to smithi08477944-11 2024-03-30T12:33:47.009 INFO:tasks.rados.rados.0.smithi084.stdout:3339: finishing write tid 2 to smithi08477944-22 2024-03-30T12:33:47.009 INFO:tasks.rados.rados.0.smithi084.stdout:3341: finishing write tid 3 to smithi08477944-11 2024-03-30T12:33:47.009 INFO:tasks.rados.rados.0.smithi084.stdout:3341: oid 11 updating version 0 to 27287 2024-03-30T12:33:47.009 INFO:tasks.rados.rados.0.smithi084.stdout:3341: oid 11 updating version 27287 to 27288 2024-03-30T12:33:47.010 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 27288 (ObjNum 1032 snap 332 seq_num 1032) dirty exists 2024-03-30T12:33:47.010 INFO:tasks.rados.rados.0.smithi084.stdout:3341: left oid 11 (ObjNum 1032 snap 332 seq_num 1032) 2024-03-30T12:33:47.010 INFO:tasks.rados.rados.0.smithi084.stdout:3339: finishing write tid 3 to smithi08477944-22 2024-03-30T12:33:47.010 INFO:tasks.rados.rados.0.smithi084.stdout:3339: oid 22 updating version 0 to 27400 2024-03-30T12:33:47.010 INFO:tasks.rados.rados.0.smithi084.stdout:3339: oid 22 version 27400 is already newer than 27399 2024-03-30T12:33:47.010 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 27400 (ObjNum 1031 snap 332 seq_num 1031) dirty exists 2024-03-30T12:33:47.010 INFO:tasks.rados.rados.0.smithi084.stdout:3339: left oid 22 (ObjNum 1031 snap 332 seq_num 1031) 2024-03-30T12:33:47.010 INFO:tasks.rados.rados.0.smithi084.stdout:3342: finishing copy_from racing read to smithi08477944-47 2024-03-30T12:33:47.010 INFO:tasks.rados.rados.0.smithi084.stdout:3338: expect (ObjNum 1007 snap 325 seq_num 1007) 2024-03-30T12:33:47.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:47.021+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:47.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:47.023+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:47.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:47.013+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:47.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:47.013+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:47.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:47.013+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:47.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:47.014+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:47.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:47.014+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:47.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:47.014+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:47.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[91810]: osdmap e732: 8 total, 8 up, 8 in 2024-03-30T12:33:47.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:47.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:47.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:47.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:47.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:47.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:47.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:47.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:47.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:47.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:47.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:47.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:47.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:47.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[91810]: pgmap v788: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1018 MiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 558 KiB/s rd, 156 KiB/s wr, 1 op/s 2024-03-30T12:33:47.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[89279]: osdmap e732: 8 total, 8 up, 8 in 2024-03-30T12:33:47.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:47.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:47.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:47.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:47.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:47.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:47.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:47.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:47.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:47.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:47.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:47.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:47.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:47.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:47 smithi084 ceph-mon[89279]: pgmap v788: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1018 MiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 558 KiB/s rd, 156 KiB/s wr, 1 op/s 2024-03-30T12:33:47.354 INFO:tasks.rados.rados.0.smithi084.stdout:3342: finishing copy_from to smithi08477944-47 2024-03-30T12:33:47.355 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 27302 (ObjNum 973 snap 314 seq_num 973) dirty exists 2024-03-30T12:33:47.355 INFO:tasks.rados.rados.0.smithi084.stdout:3337: done (7 left) 2024-03-30T12:33:47.355 INFO:tasks.rados.rados.0.smithi084.stdout:3338: done (6 left) 2024-03-30T12:33:47.355 INFO:tasks.rados.rados.0.smithi084.stdout:3339: done (5 left) 2024-03-30T12:33:47.355 INFO:tasks.rados.rados.0.smithi084.stdout:3341: done (4 left) 2024-03-30T12:33:47.355 INFO:tasks.rados.rados.0.smithi084.stdout:3342: done (3 left) 2024-03-30T12:33:47.355 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 332 2024-03-30T12:33:47.355 INFO:tasks.rados.rados.0.smithi084.stdout:3340: finishing rollback tid 1 to smithi08477944-24 2024-03-30T12:33:47.355 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 23409 (ObjNum 65 snap 0 seq_num 1917802863) dirty dne 2024-03-30T12:33:47.355 INFO:tasks.rados.rados.0.smithi084.stdout:3343: expect (ObjNum 1014 snap 327 seq_num 1014) 2024-03-30T12:33:47.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:47.218+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:47.369 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:47.015+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:47.369 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:47.016+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:47.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:47.014+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:47.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:47.014+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:47.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:47.015+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:47.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:47.172+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:47.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:47.172+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:47.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:47 smithi162 ceph-mon[83709]: osdmap e732: 8 total, 8 up, 8 in 2024-03-30T12:33:47.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:47.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:47.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:47.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:47.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:47.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:47.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:47.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:47.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:47.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:47.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 184=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:47.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:47.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:47.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:47 smithi162 ceph-mon[83709]: pgmap v788: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1018 MiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 558 KiB/s rd, 156 KiB/s wr, 1 op/s 2024-03-30T12:33:48.044 INFO:tasks.rados.rados.0.smithi084.stdout:3345: finishing rollback tid 0 to smithi08477944-20 2024-03-30T12:33:48.044 INFO:tasks.rados.rados.0.smithi084.stdout:3345: finishing rollback tid 1 to smithi08477944-20 2024-03-30T12:33:48.044 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 27310 (ObjNum 49 snap 0 seq_num 1428945472) dirty dne 2024-03-30T12:33:48.044 INFO:tasks.rados.rados.0.smithi084.stdout:3346: seq_num 1033 ranges {8208384=507904} 2024-03-30T12:33:48.089 INFO:tasks.rados.rados.0.smithi084.stdout:3346: writing smithi08477944-23 from 8208384 to 8716288 tid 1 2024-03-30T12:33:48.090 INFO:tasks.rados.rados.0.smithi084.stdout:3340: done (3 left) 2024-03-30T12:33:48.090 INFO:tasks.rados.rados.0.smithi084.stdout:3343: done (2 left) 2024-03-30T12:33:48.090 INFO:tasks.rados.rados.0.smithi084.stdout:3345: done (1 left) 2024-03-30T12:33:48.090 INFO:tasks.rados.rados.0.smithi084.stdout:3347: snap_remove snap 326 2024-03-30T12:33:48.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:48 smithi162 ceph-mon[83709]: osdmap e733: 8 total, 8 up, 8 in 2024-03-30T12:33:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:48.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:48.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:48.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:48.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:48.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:48.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:48.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:48.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:48.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:48.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:48.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[91810]: osdmap e733: 8 total, 8 up, 8 in 2024-03-30T12:33:48.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:48.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:48.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:48.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:48.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:48.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:48.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:48.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:48.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:48.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:48.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:48.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:48.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:48.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[89279]: osdmap e733: 8 total, 8 up, 8 in 2024-03-30T12:33:48.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:48.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:48.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:48.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:48.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:49.019 INFO:tasks.rados.rados.0.smithi084.stdout:3347: done (1 left) 2024-03-30T12:33:49.019 INFO:tasks.rados.rados.0.smithi084.stdout:3348: read oid 6 snap -1 2024-03-30T12:33:49.020 INFO:tasks.rados.rados.0.smithi084.stdout:3348: expect (ObjNum 947 snap 301 seq_num 947) 2024-03-30T12:33:49.020 INFO:tasks.rados.rados.0.smithi084.stdout:3349: setattr oid 46 current snap is 332 2024-03-30T12:33:49.020 INFO:tasks.rados.rados.0.smithi084.stdout:3346: finishing write tid 1 to smithi08477944-23 2024-03-30T12:33:49.020 INFO:tasks.rados.rados.0.smithi084.stdout:3346: finishing write tid 2 to smithi08477944-23 2024-03-30T12:33:49.020 INFO:tasks.rados.rados.0.smithi084.stdout:3346: finishing write tid 3 to smithi08477944-23 2024-03-30T12:33:49.020 INFO:tasks.rados.rados.0.smithi084.stdout:3346: oid 23 updating version 0 to 36288 2024-03-30T12:33:49.020 INFO:tasks.rados.rados.0.smithi084.stdout:3346: oid 23 version 36288 is already newer than 36287 2024-03-30T12:33:49.020 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 36288 (ObjNum 1033 snap 332 seq_num 1033) dirty exists 2024-03-30T12:33:49.020 INFO:tasks.rados.rados.0.smithi084.stdout:3346: left oid 23 (ObjNum 1033 snap 332 seq_num 1033) 2024-03-30T12:33:49.022 INFO:tasks.rados.rados.0.smithi084.stdout:3346: done (2 left) 2024-03-30T12:33:49.022 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 332 2024-03-30T12:33:49.022 INFO:tasks.rados.rados.0.smithi084.stdout:3350: seq_num 1034 ranges {8044544=524288} 2024-03-30T12:33:49.068 INFO:tasks.rados.rados.0.smithi084.stdout:3350: writing smithi08477944-48 from 8044544 to 8568832 tid 1 2024-03-30T12:33:49.069 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 332 2024-03-30T12:33:49.069 INFO:tasks.rados.rados.0.smithi084.stdout:3351: seq_num 1035 ranges {10084352=540672} 2024-03-30T12:33:49.126 INFO:tasks.rados.rados.0.smithi084.stdout:3351: writing smithi08477944-26 from 10084352 to 10625024 tid 1 2024-03-30T12:33:49.126 INFO:tasks.rados.rados.0.smithi084.stdout:3352: copy_from oid 34 from oid 49 current snap is 332 2024-03-30T12:33:49.126 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 27401 (ObjNum 785 snap 0 seq_num 1532997600) dirty exists 2024-03-30T12:33:49.127 INFO:tasks.rados.rados.0.smithi084.stdout:3348: expect (ObjNum 947 snap 301 seq_num 947) 2024-03-30T12:33:49.167 INFO:tasks.rados.rados.0.smithi084.stdout:3350: finishing write tid 1 to smithi08477944-48 2024-03-30T12:33:49.167 INFO:tasks.rados.rados.0.smithi084.stdout:3350: finishing write tid 2 to smithi08477944-48 2024-03-30T12:33:49.167 INFO:tasks.rados.rados.0.smithi084.stdout:3350: finishing write tid 3 to smithi08477944-48 2024-03-30T12:33:49.167 INFO:tasks.rados.rados.0.smithi084.stdout:3350: oid 48 updating version 0 to 23424 2024-03-30T12:33:49.167 INFO:tasks.rados.rados.0.smithi084.stdout:3350: oid 48 updating version 23424 to 23425 2024-03-30T12:33:49.167 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 23425 (ObjNum 1034 snap 332 seq_num 1034) dirty exists 2024-03-30T12:33:49.168 INFO:tasks.rados.rados.0.smithi084.stdout:3350: left oid 48 (ObjNum 1034 snap 332 seq_num 1034) 2024-03-30T12:33:49.168 INFO:tasks.rados.rados.0.smithi084.stdout:3352: finishing copy_from racing read to smithi08477944-34 2024-03-30T12:33:49.168 INFO:tasks.rados.rados.0.smithi084.stdout:3348: done (4 left) 2024-03-30T12:33:49.168 INFO:tasks.rados.rados.0.smithi084.stdout:3349: done (3 left) 2024-03-30T12:33:49.168 INFO:tasks.rados.rados.0.smithi084.stdout:3350: done (2 left) 2024-03-30T12:33:49.168 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 332 2024-03-30T12:33:49.168 INFO:tasks.rados.rados.0.smithi084.stdout:3352: finishing copy_from to smithi08477944-34 2024-03-30T12:33:49.168 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 36285 (ObjNum 1021 snap 328 seq_num 1021) dirty exists 2024-03-30T12:33:49.168 INFO:tasks.rados.rados.0.smithi084.stdout:3351: finishing write tid 1 to smithi08477944-26 2024-03-30T12:33:49.168 INFO:tasks.rados.rados.0.smithi084.stdout:3351: finishing write tid 2 to smithi08477944-26 2024-03-30T12:33:49.168 INFO:tasks.rados.rados.0.smithi084.stdout:3353: seq_num 1036 ranges {475136=557056} 2024-03-30T12:33:49.172 INFO:tasks.rados.rados.0.smithi084.stdout:3353: writing smithi08477944-22 from 475136 to 1032192 tid 1 2024-03-30T12:33:49.173 INFO:tasks.rados.rados.0.smithi084.stdout:3352: done (2 left) 2024-03-30T12:33:49.173 INFO:tasks.rados.rados.0.smithi084.stdout:3354: copy_from oid 31 from oid 9 current snap is 332 2024-03-30T12:33:49.173 INFO:tasks.rados.rados.0.smithi084.stdout:3351: finishing write tid 3 to smithi08477944-26 2024-03-30T12:33:49.173 INFO:tasks.rados.rados.0.smithi084.stdout:3351: oid 26 updating version 0 to 27404 2024-03-30T12:33:49.173 INFO:tasks.rados.rados.0.smithi084.stdout:3351: oid 26 version 27404 is already newer than 27403 2024-03-30T12:33:49.173 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 27404 (ObjNum 1035 snap 332 seq_num 1035) dirty exists 2024-03-30T12:33:49.173 INFO:tasks.rados.rados.0.smithi084.stdout:3351: left oid 26 (ObjNum 1035 snap 332 seq_num 1035) 2024-03-30T12:33:49.173 INFO:tasks.rados.rados.0.smithi084.stdout:3351: done (2 left) 2024-03-30T12:33:49.173 INFO:tasks.rados.rados.0.smithi084.stdout:3355: snap_remove snap 303 2024-03-30T12:33:49.295 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:49 smithi084 ceph-mon[91810]: pgmap v790: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1023 MiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 3.9 MiB/s rd, 1.1 MiB/s wr, 6 op/s 2024-03-30T12:33:49.295 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:49 smithi084 ceph-mon[89279]: pgmap v790: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1023 MiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 3.9 MiB/s rd, 1.1 MiB/s wr, 6 op/s 2024-03-30T12:33:49.296 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:49.036+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:49.296 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:49.037+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:49.296 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:49.025+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:49.296 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:49.025+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:49.296 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:49.025+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:49.296 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:49.026+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:49.296 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:49.026+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:49.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:49 smithi162 ceph-mon[83709]: pgmap v790: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1023 MiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 3.9 MiB/s rd, 1.1 MiB/s wr, 6 op/s 2024-03-30T12:33:49.370 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:49.142+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:49.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:49.024+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:49.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:49.024+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:49.371 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:49.026+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:49.371 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:49.026+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:49.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:49.030+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:49.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:49.030+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:49.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:49.030+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:49.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:33:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:33:49] "GET /metrics HTTP/1.1" 200 36330 "" "Prometheus/2.43.0" 2024-03-30T12:33:50.027 INFO:tasks.rados.rados.0.smithi084.stdout:3353: finishing write tid 1 to smithi08477944-22 2024-03-30T12:33:50.027 INFO:tasks.rados.rados.0.smithi084.stdout:3353: finishing write tid 2 to smithi08477944-22 2024-03-30T12:33:50.027 INFO:tasks.rados.rados.0.smithi084.stdout:3353: finishing write tid 3 to smithi08477944-22 2024-03-30T12:33:50.027 INFO:tasks.rados.rados.0.smithi084.stdout:3353: oid 22 updating version 0 to 27406 2024-03-30T12:33:50.027 INFO:tasks.rados.rados.0.smithi084.stdout:3353: oid 22 version 27406 is already newer than 27405 2024-03-30T12:33:50.027 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 27406 (ObjNum 1036 snap 332 seq_num 1036) dirty exists 2024-03-30T12:33:50.027 INFO:tasks.rados.rados.0.smithi084.stdout:3353: left oid 22 (ObjNum 1036 snap 332 seq_num 1036) 2024-03-30T12:33:50.027 INFO:tasks.rados.rados.0.smithi084.stdout:3354: finishing copy_from racing read to smithi08477944-31 2024-03-30T12:33:50.027 INFO:tasks.rados.rados.0.smithi084.stdout:3354: finishing copy_from to smithi08477944-31 2024-03-30T12:33:50.027 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 22523 (ObjNum 1007 snap 325 seq_num 1007) dirty exists 2024-03-30T12:33:50.027 INFO:tasks.rados.rados.0.smithi084.stdout:3353: done (2 left) 2024-03-30T12:33:50.028 INFO:tasks.rados.rados.0.smithi084.stdout:3354: done (1 left) 2024-03-30T12:33:50.028 INFO:tasks.rados.rados.0.smithi084.stdout:3355: done (0 left) 2024-03-30T12:33:50.028 INFO:tasks.rados.rados.0.smithi084.stdout:3356: rollback oid 9 current snap is 332 2024-03-30T12:33:50.028 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 9 to 328 2024-03-30T12:33:50.028 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 332 2024-03-30T12:33:50.028 INFO:tasks.rados.rados.0.smithi084.stdout:3357: seq_num 1037 ranges {4030464=573440} 2024-03-30T12:33:50.052 INFO:tasks.rados.rados.0.smithi084.stdout:3357: writing smithi08477944-32 from 4030464 to 4603904 tid 1 2024-03-30T12:33:50.052 INFO:tasks.rados.rados.0.smithi084.stdout:3358: read oid 6 snap 325 2024-03-30T12:33:50.052 INFO:tasks.rados.rados.0.smithi084.stdout:3358: expect (ObjNum 911 snap 290 seq_num 911) 2024-03-30T12:33:50.052 INFO:tasks.rados.rados.0.smithi084.stdout:3359: snap_remove snap 307 2024-03-30T12:33:50.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:50.059+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:50.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:50.034+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:50.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:50.034+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:50.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:50.045+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:50.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:50.045+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:50.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:50.032+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:50.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:50.032+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:50.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:50.032+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:50.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:50.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:50.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:50.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:50.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:50.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:50.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:50.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:50.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:50 smithi162 ceph-mon[83709]: osdmap e734: 8 total, 8 up, 8 in 2024-03-30T12:33:50.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:50.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:50.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:50.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:50.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:50.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:50.042+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:50.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:50.042+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:50.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:50.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:50.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:50.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:50.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:50.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:50.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:50.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:50.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[91810]: osdmap e734: 8 total, 8 up, 8 in 2024-03-30T12:33:50.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:50.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:50.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:50.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:50.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:50.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:50.038+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:50.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:50.038+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:50.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:50.038+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:50.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:50.038+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:50.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:50.039+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:50.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:50.039+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:50.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:50.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:50.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:50.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:50.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:50.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:50.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:50.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:50.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[89279]: osdmap e734: 8 total, 8 up, 8 in 2024-03-30T12:33:50.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:50.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:50.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:50.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:50.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:51.030 INFO:tasks.rados.rados.0.smithi084.stdout:3359: done (3 left) 2024-03-30T12:33:51.031 INFO:tasks.rados.rados.0.smithi084.stdout:3360: copy_from oid 16 from oid 30 current snap is 332 2024-03-30T12:33:51.031 INFO:tasks.rados.rados.0.smithi084.stdout:3356: finishing rollback tid 0 to smithi08477944-9 2024-03-30T12:33:51.031 INFO:tasks.rados.rados.0.smithi084.stdout:3356: finishing rollback tid 1 to smithi08477944-9 2024-03-30T12:33:51.031 INFO:tasks.rados.rados.0.smithi084.stdout:3356: finishing rollback tid 2 to smithi08477944-9 2024-03-30T12:33:51.031 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 22526 (ObjNum 1007 snap 325 seq_num 1007) dirty exists 2024-03-30T12:33:51.031 INFO:tasks.rados.rados.0.smithi084.stdout:3357: finishing write tid 1 to smithi08477944-32 2024-03-30T12:33:51.031 INFO:tasks.rados.rados.0.smithi084.stdout:3357: finishing write tid 2 to smithi08477944-32 2024-03-30T12:33:51.031 INFO:tasks.rados.rados.0.smithi084.stdout:3358: expect (ObjNum 911 snap 290 seq_num 911) 2024-03-30T12:33:51.056 INFO:tasks.rados.rados.0.smithi084.stdout:3357: finishing write tid 3 to smithi08477944-32 2024-03-30T12:33:51.056 INFO:tasks.rados.rados.0.smithi084.stdout:3357: oid 32 updating version 0 to 36289 2024-03-30T12:33:51.056 INFO:tasks.rados.rados.0.smithi084.stdout:3357: oid 32 updating version 36289 to 36290 2024-03-30T12:33:51.056 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 36290 (ObjNum 1037 snap 332 seq_num 1037) dirty exists 2024-03-30T12:33:51.056 INFO:tasks.rados.rados.0.smithi084.stdout:3357: left oid 32 (ObjNum 1037 snap 332 seq_num 1037) 2024-03-30T12:33:51.056 INFO:tasks.rados.rados.0.smithi084.stdout:3356: done (3 left) 2024-03-30T12:33:51.056 INFO:tasks.rados.rados.0.smithi084.stdout:3357: done (2 left) 2024-03-30T12:33:51.056 INFO:tasks.rados.rados.0.smithi084.stdout:3358: done (1 left) 2024-03-30T12:33:51.056 INFO:tasks.rados.rados.0.smithi084.stdout:3361: snap_remove snap 324 2024-03-30T12:33:51.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:51.243+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:51.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:51.035+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:51.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:51.037+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:51.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:51.036+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:51.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:51.036+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:51.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:51.047+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:51.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:51.047+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:51.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:51.048+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:51.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:51.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:51.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:51.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:51.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:51 smithi162 ceph-mon[83709]: osdmap e735: 8 total, 8 up, 8 in 2024-03-30T12:33:51.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:51.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:51.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:51.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:51.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:51.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:51.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:51.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:51.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:51.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:51 smithi162 ceph-mon[83709]: pgmap v793: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 8.5 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2024-03-30T12:33:51.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:51.041+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:51.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:51.041+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:51.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:51.043+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:51.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:51.043+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:51.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:51.043+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:51.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:51.043+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:51.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:51.043+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:51.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:51.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:51.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:51.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:51.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[89279]: osdmap e735: 8 total, 8 up, 8 in 2024-03-30T12:33:51.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:51.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:51.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:51.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:51.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:51.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:51.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:51.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:51.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:51.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[89279]: pgmap v793: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 8.5 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2024-03-30T12:33:51.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:51.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:51.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:51.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:51.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[91810]: osdmap e735: 8 total, 8 up, 8 in 2024-03-30T12:33:51.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:51.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:51.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:51.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:51.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:51.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:51.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:51.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:51.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:51.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:51 smithi084 ceph-mon[91810]: pgmap v793: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 8.5 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2024-03-30T12:33:52.033 INFO:tasks.rados.rados.0.smithi084.stdout:3361: done (1 left) 2024-03-30T12:33:52.033 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 332 2024-03-30T12:33:52.033 INFO:tasks.rados.rados.0.smithi084.stdout:3362: seq_num 1038 ranges {843776=589824} 2024-03-30T12:33:52.041 INFO:tasks.rados.rados.0.smithi084.stdout:3362: writing smithi08477944-43 from 843776 to 1433600 tid 1 2024-03-30T12:33:52.041 INFO:tasks.rados.rados.0.smithi084.stdout:3363: snap_create 2024-03-30T12:33:52.041 INFO:tasks.rados.rados.0.smithi084.stdout:3360: finishing copy_from racing read to smithi08477944-16 2024-03-30T12:33:52.041 INFO:tasks.rados.rados.0.smithi084.stdout:3360: finishing copy_from to smithi08477944-16 2024-03-30T12:33:52.041 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 27299 (ObjNum 1023 snap 328 seq_num 1023) dirty exists 2024-03-30T12:33:52.050 INFO:tasks.rados.rados.0.smithi084.stdout:3362: finishing write tid 1 to smithi08477944-43 2024-03-30T12:33:52.051 INFO:tasks.rados.rados.0.smithi084.stdout:3362: finishing write tid 2 to smithi08477944-43 2024-03-30T12:33:52.054 INFO:tasks.rados.rados.0.smithi084.stdout:3362: finishing write tid 3 to smithi08477944-43 2024-03-30T12:33:52.054 INFO:tasks.rados.rados.0.smithi084.stdout:3362: oid 43 updating version 0 to 36350 2024-03-30T12:33:52.054 INFO:tasks.rados.rados.0.smithi084.stdout:3362: oid 43 updating version 36350 to 36351 2024-03-30T12:33:52.054 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 36351 (ObjNum 1038 snap 332 seq_num 1038) dirty exists 2024-03-30T12:33:52.054 INFO:tasks.rados.rados.0.smithi084.stdout:3362: left oid 43 (ObjNum 1038 snap 332 seq_num 1038) 2024-03-30T12:33:52.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:52.036+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:52.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:52.042+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:52.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:52.043+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:52.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:52.055+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:52.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:52.056+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:52.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:52.046+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:52.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:52.046+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:52.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:52.046+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:52.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:52.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:52.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:52 smithi162 ceph-mon[83709]: osdmap e736: 8 total, 8 up, 8 in 2024-03-30T12:33:52.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:52.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:52.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:52.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:52.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:52.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:52.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:52.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:52.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:52.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:52.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:52.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:52.041+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:52.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:52.042+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:52.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:52.037+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:52.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:52.037+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:52.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:52.037+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:52.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:52.037+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:52.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:52.038+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:52.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:52.038+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:52.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[89279]: osdmap e736: 8 total, 8 up, 8 in 2024-03-30T12:33:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:52.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:52.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:52.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:52.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[91810]: osdmap e736: 8 total, 8 up, 8 in 2024-03-30T12:33:52.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:52.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:52.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:52.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:52.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:52.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:52.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:52.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:52.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:52.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:52.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:53.048 INFO:tasks.rados.rados.0.smithi084.stdout:3360: done (2 left) 2024-03-30T12:33:53.048 INFO:tasks.rados.rados.0.smithi084.stdout:3362: done (1 left) 2024-03-30T12:33:53.048 INFO:tasks.rados.rados.0.smithi084.stdout:3363: done (0 left) 2024-03-30T12:33:53.048 INFO:tasks.rados.rados.0.smithi084.stdout:3364: snap_remove snap 332 2024-03-30T12:33:53.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:53.053+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:53.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:53.053+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:53.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:53.055+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:53.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:53.055+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:53.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:53 smithi162 ceph-mon[83709]: osdmap e737: 8 total, 8 up, 8 in 2024-03-30T12:33:53.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:53.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:53.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:53.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:53.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:53.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:53.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:53.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:53.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:53.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:53.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:53.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:53.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:53.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:53 smithi162 ceph-mon[83709]: pgmap v796: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 7.7 MiB/s rd, 1.1 MiB/s wr, 21 op/s 2024-03-30T12:33:53.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:53.054+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:53.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:53.054+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:53.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:53.054+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:53.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:53.054+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:53.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:53.054+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:53.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[89279]: osdmap e737: 8 total, 8 up, 8 in 2024-03-30T12:33:53.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:53.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:53.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:53.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:53.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:53.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:53.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:53.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:53.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:53.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:53.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:53.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:53.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:53.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[89279]: pgmap v796: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 7.7 MiB/s rd, 1.1 MiB/s wr, 21 op/s 2024-03-30T12:33:53.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[91810]: osdmap e737: 8 total, 8 up, 8 in 2024-03-30T12:33:53.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:53.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:53.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:53.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:53.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:53.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:53.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:53.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:53.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:53.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:53.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:53.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:53.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:53.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-mon[91810]: pgmap v796: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 7.7 MiB/s rd, 1.1 MiB/s wr, 21 op/s 2024-03-30T12:33:54.047 INFO:tasks.rados.rados.0.smithi084.stdout:3364: done (0 left) 2024-03-30T12:33:54.047 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 333 2024-03-30T12:33:54.047 INFO:tasks.rados.rados.0.smithi084.stdout:3365: seq_num 1039 ranges {0=606208} 2024-03-30T12:33:54.050 INFO:tasks.rados.rados.0.smithi084.stdout:3365: writing smithi08477944-20 from 0 to 606208 tid 1 2024-03-30T12:33:54.050 INFO:tasks.rados.rados.0.smithi084.stdout:3366: read oid 45 snap -1 2024-03-30T12:33:54.051 INFO:tasks.rados.rados.0.smithi084.stdout:3366: expect (ObjNum 955 snap 303 seq_num 955) 2024-03-30T12:33:54.051 INFO:tasks.rados.rados.0.smithi084.stdout:3367: snap_remove snap 330 2024-03-30T12:33:54.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:53.851+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:54.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:54.054+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:54.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:54.055+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:54.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:53.853+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:54.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:53.853+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:54.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:53.853+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:54.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:54.057+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:54.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:54.057+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:54.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:54.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:54.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:54.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:54.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:54.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:54.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:54.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:54.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:54 smithi162 ceph-mon[83709]: osdmap e738: 8 total, 8 up, 8 in 2024-03-30T12:33:54.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:54.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:53.852+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:54.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:53.853+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:54.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:54.066+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:54.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:54.066+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:54.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:54.053+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:54.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:54.053+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:54.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:54.053+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:54.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:54.053+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:54.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:54.053+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:54.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:54.054+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:54.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:54.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:54.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:54.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:54.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:54.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:54.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:54.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:54.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-mon[89279]: osdmap e738: 8 total, 8 up, 8 in 2024-03-30T12:33:54.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:54.259 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:54.260 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:54.260 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:54.260 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:54.260 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:54.260 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:54.260 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:54.261 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:54.261 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-mon[91810]: osdmap e738: 8 total, 8 up, 8 in 2024-03-30T12:33:54.261 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:54.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:54.571+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:54.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:54.571+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:54.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:54.571+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:54.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:54.571+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:55.057 INFO:tasks.rados.rados.0.smithi084.stdout:3367: done (2 left) 2024-03-30T12:33:55.057 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 333 2024-03-30T12:33:55.057 INFO:tasks.rados.rados.0.smithi084.stdout:3368: seq_num 1040 ranges {1032192=622592} 2024-03-30T12:33:55.066 INFO:tasks.rados.rados.0.smithi084.stdout:3368: writing smithi08477944-22 from 1032192 to 1654784 tid 1 2024-03-30T12:33:55.067 INFO:tasks.rados.rados.0.smithi084.stdout:3369: setattr oid 36 current snap is 333 2024-03-30T12:33:55.067 INFO:tasks.rados.rados.0.smithi084.stdout:3365: finishing write tid 1 to smithi08477944-20 2024-03-30T12:33:55.067 INFO:tasks.rados.rados.0.smithi084.stdout:3365: finishing write tid 2 to smithi08477944-20 2024-03-30T12:33:55.067 INFO:tasks.rados.rados.0.smithi084.stdout:3365: finishing write tid 3 to smithi08477944-20 2024-03-30T12:33:55.067 INFO:tasks.rados.rados.0.smithi084.stdout:3365: oid 20 updating version 0 to 27311 2024-03-30T12:33:55.068 INFO:tasks.rados.rados.0.smithi084.stdout:3365: oid 20 updating version 27311 to 27312 2024-03-30T12:33:55.068 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 27312 (ObjNum 1039 snap 333 seq_num 1039) dirty exists 2024-03-30T12:33:55.068 INFO:tasks.rados.rados.0.smithi084.stdout:3365: left oid 20 (ObjNum 1039 snap 333 seq_num 1039) 2024-03-30T12:33:55.068 INFO:tasks.rados.rados.0.smithi084.stdout:3366: expect (ObjNum 955 snap 303 seq_num 955) 2024-03-30T12:33:55.110 INFO:tasks.rados.rados.0.smithi084.stdout:3368: finishing write tid 1 to smithi08477944-22 2024-03-30T12:33:55.110 INFO:tasks.rados.rados.0.smithi084.stdout:3368: finishing write tid 2 to smithi08477944-22 2024-03-30T12:33:55.111 INFO:tasks.rados.rados.0.smithi084.stdout:3368: finishing write tid 3 to smithi08477944-22 2024-03-30T12:33:55.111 INFO:tasks.rados.rados.0.smithi084.stdout:3368: oid 22 updating version 0 to 27408 2024-03-30T12:33:55.111 INFO:tasks.rados.rados.0.smithi084.stdout:3368: oid 22 version 27408 is already newer than 27407 2024-03-30T12:33:55.111 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 27408 (ObjNum 1040 snap 333 seq_num 1040) dirty exists 2024-03-30T12:33:55.111 INFO:tasks.rados.rados.0.smithi084.stdout:3368: left oid 22 (ObjNum 1040 snap 333 seq_num 1040) 2024-03-30T12:33:55.111 INFO:tasks.rados.rados.0.smithi084.stdout:3365: done (3 left) 2024-03-30T12:33:55.111 INFO:tasks.rados.rados.0.smithi084.stdout:3366: done (2 left) 2024-03-30T12:33:55.111 INFO:tasks.rados.rados.0.smithi084.stdout:3368: done (1 left) 2024-03-30T12:33:55.111 INFO:tasks.rados.rados.0.smithi084.stdout:3370: snap_create 2024-03-30T12:33:55.114 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 36291 (ObjNum 905 snap 287 seq_num 905) dirty exists 2024-03-30T12:33:55.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:55.073+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:55.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:55.064+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:55.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:55.064+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:55.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:55.063+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:55.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:55.065+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:55.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:55.067+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:55.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:55.067+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:55.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:55.067+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:55.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:55.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:55.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:55.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:55.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:55.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:55.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:55.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:55.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:55 smithi162 ceph-mon[83709]: osdmap e739: 8 total, 8 up, 8 in 2024-03-30T12:33:55.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:55.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:55.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:55.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:55.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:55.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:55.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:55.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:55 smithi162 ceph-mon[83709]: pgmap v799: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2024-03-30T12:33:55.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:55.073+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:55.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:55.073+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:55.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:55.063+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:55.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:55.063+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:55.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:55.063+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:55.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:55.064+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:55.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:55.064+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:55.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:55.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:55.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:55.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:55.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:55.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:55.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:55.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:55.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[89279]: osdmap e739: 8 total, 8 up, 8 in 2024-03-30T12:33:55.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:55.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:55.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:55.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:55.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:55.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:55.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:55.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:55.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:55.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:55.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:55.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:55.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:55.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:55.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[91810]: osdmap e739: 8 total, 8 up, 8 in 2024-03-30T12:33:55.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:55.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:55.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:55.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:55.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:55.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:55.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:55.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[91810]: pgmap v799: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2024-03-30T12:33:55.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:55.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:55 smithi084 ceph-mon[89279]: pgmap v799: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2024-03-30T12:33:56.068 INFO:tasks.rados.rados.0.smithi084.stdout:3369: done (1 left) 2024-03-30T12:33:56.068 INFO:tasks.rados.rados.0.smithi084.stdout:3370: done (0 left) 2024-03-30T12:33:56.069 INFO:tasks.rados.rados.0.smithi084.stdout:3371: delete oid 11 current snap is 334 2024-03-30T12:33:56.071 INFO:tasks.rados.rados.0.smithi084.stdout:3371: done (0 left) 2024-03-30T12:33:56.071 INFO:tasks.rados.rados.0.smithi084.stdout:3372: snap_remove snap 325 2024-03-30T12:33:56.369 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:56.077+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:56.369 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:56.079+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:56.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:56.076+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:56.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:56.077+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:56.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:56.077+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:56.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:56.081+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:56.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:56.082+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:56 smithi162 ceph-mon[83709]: osdmap e740: 8 total, 8 up, 8 in 2024-03-30T12:33:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:56.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:56.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:56.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:56.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:56.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:56.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:56.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:56.075+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:56.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:56.075+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:56.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:56.075+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:56.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:56.075+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:56.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:56.075+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:56.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:56.076+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:56.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:56.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:56.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:56.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:56.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:56.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:56.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:56.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[91810]: osdmap e740: 8 total, 8 up, 8 in 2024-03-30T12:33:56.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:56.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:56.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:56.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:56.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:56.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:56.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:56.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:56.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:56.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:56.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:56.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:56.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[89279]: osdmap e740: 8 total, 8 up, 8 in 2024-03-30T12:33:56.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:56.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:56.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:56.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:56.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:56.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:56.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:56.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:56.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:56.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:56.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:57.076 INFO:tasks.rados.rados.0.smithi084.stdout:3372: done (0 left) 2024-03-30T12:33:57.076 INFO:tasks.rados.rados.0.smithi084.stdout:3373: read oid 26 snap -1 2024-03-30T12:33:57.076 INFO:tasks.rados.rados.0.smithi084.stdout:3373: expect (ObjNum 1035 snap 332 seq_num 1035) 2024-03-30T12:33:57.077 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 334 2024-03-30T12:33:57.077 INFO:tasks.rados.rados.0.smithi084.stdout:3374: seq_num 1042 ranges {1720320=655360} 2024-03-30T12:33:57.091 INFO:tasks.rados.rados.0.smithi084.stdout:3374: writing smithi08477944-38 from 1720320 to 2375680 tid 1 2024-03-30T12:33:57.091 INFO:tasks.rados.rados.0.smithi084.stdout:3375: rollback oid 45 current snap is 334 2024-03-30T12:33:57.091 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 45 to 328 2024-03-30T12:33:57.091 INFO:tasks.rados.rados.0.smithi084.stdout:3376: read oid 35 snap -1 2024-03-30T12:33:57.091 INFO:tasks.rados.rados.0.smithi084.stdout:3376: expect (ObjNum 664 snap 232 seq_num 664) 2024-03-30T12:33:57.091 INFO:tasks.rados.rados.0.smithi084.stdout:3377: rollback oid 47 current snap is 334 2024-03-30T12:33:57.092 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 328 2024-03-30T12:33:57.092 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 334 2024-03-30T12:33:57.092 INFO:tasks.rados.rados.0.smithi084.stdout:3378: seq_num 1043 ranges {303104=671744} 2024-03-30T12:33:57.097 INFO:tasks.rados.rados.0.smithi084.stdout:3378: writing smithi08477944-34 from 303104 to 974848 tid 1 2024-03-30T12:33:57.097 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 334 2024-03-30T12:33:57.098 INFO:tasks.rados.rados.0.smithi084.stdout:3379: seq_num 1044 ranges {4349952=688128} 2024-03-30T12:33:57.125 INFO:tasks.rados.rados.0.smithi084.stdout:3379: writing smithi08477944-3 from 4349952 to 5038080 tid 1 2024-03-30T12:33:57.126 INFO:tasks.rados.rados.0.smithi084.stdout:3380: rollback oid 29 current snap is 334 2024-03-30T12:33:57.126 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 29 to 321 2024-03-30T12:33:57.126 INFO:tasks.rados.rados.0.smithi084.stdout:3376: expect (ObjNum 664 snap 232 seq_num 664) 2024-03-30T12:33:57.171 INFO:tasks.rados.rados.0.smithi084.stdout:3374: finishing write tid 1 to smithi08477944-38 2024-03-30T12:33:57.171 INFO:tasks.rados.rados.0.smithi084.stdout:3374: finishing write tid 2 to smithi08477944-38 2024-03-30T12:33:57.172 INFO:tasks.rados.rados.0.smithi084.stdout:3376: done (7 left) 2024-03-30T12:33:57.172 INFO:tasks.rados.rados.0.smithi084.stdout:3381: rmattr oid 43 current snap is 334 2024-03-30T12:33:57.172 INFO:tasks.rados.rados.0.smithi084.stdout:3381: done (7 left) 2024-03-30T12:33:57.172 INFO:tasks.rados.rados.0.smithi084.stdout:3382: rollback oid 49 current snap is 334 2024-03-30T12:33:57.172 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 49 to 333 2024-03-30T12:33:57.172 INFO:tasks.rados.rados.0.smithi084.stdout:3375: finishing rollback tid 0 to smithi08477944-45 2024-03-30T12:33:57.172 INFO:tasks.rados.rados.0.smithi084.stdout:3377: finishing rollback tid 0 to smithi08477944-47 2024-03-30T12:33:57.172 INFO:tasks.rados.rados.0.smithi084.stdout:3377: finishing rollback tid 1 to smithi08477944-47 2024-03-30T12:33:57.172 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 27314 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-03-30T12:33:57.172 INFO:tasks.rados.rados.0.smithi084.stdout:3375: finishing rollback tid 1 to smithi08477944-45 2024-03-30T12:33:57.172 INFO:tasks.rados.rados.0.smithi084.stdout:3374: finishing write tid 3 to smithi08477944-38 2024-03-30T12:33:57.172 INFO:tasks.rados.rados.0.smithi084.stdout:3374: oid 38 updating version 0 to 27300 2024-03-30T12:33:57.172 INFO:tasks.rados.rados.0.smithi084.stdout:3374: oid 38 updating version 27300 to 27301 2024-03-30T12:33:57.172 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 27301 (ObjNum 1042 snap 334 seq_num 1042) dirty exists 2024-03-30T12:33:57.172 INFO:tasks.rados.rados.0.smithi084.stdout:3374: left oid 38 (ObjNum 1042 snap 334 seq_num 1042) 2024-03-30T12:33:57.173 INFO:tasks.rados.rados.0.smithi084.stdout:3375: finishing rollback tid 2 to smithi08477944-45 2024-03-30T12:33:57.173 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 27318 (ObjNum 955 snap 303 seq_num 955) dirty exists 2024-03-30T12:33:57.173 INFO:tasks.rados.rados.0.smithi084.stdout:3378: finishing write tid 1 to smithi08477944-34 2024-03-30T12:33:57.173 INFO:tasks.rados.rados.0.smithi084.stdout:3378: finishing write tid 2 to smithi08477944-34 2024-03-30T12:33:57.173 INFO:tasks.rados.rados.0.smithi084.stdout:3378: finishing write tid 3 to smithi08477944-34 2024-03-30T12:33:57.173 INFO:tasks.rados.rados.0.smithi084.stdout:3378: oid 34 updating version 0 to 36287 2024-03-30T12:33:57.173 INFO:tasks.rados.rados.0.smithi084.stdout:3378: oid 34 version 36287 is already newer than 36286 2024-03-30T12:33:57.173 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 36287 (ObjNum 1043 snap 334 seq_num 1043) dirty exists 2024-03-30T12:33:57.173 INFO:tasks.rados.rados.0.smithi084.stdout:3378: left oid 34 (ObjNum 1043 snap 334 seq_num 1043) 2024-03-30T12:33:57.173 INFO:tasks.rados.rados.0.smithi084.stdout:3374: done (7 left) 2024-03-30T12:33:57.173 INFO:tasks.rados.rados.0.smithi084.stdout:3375: done (6 left) 2024-03-30T12:33:57.173 INFO:tasks.rados.rados.0.smithi084.stdout:3377: done (5 left) 2024-03-30T12:33:57.173 INFO:tasks.rados.rados.0.smithi084.stdout:3378: done (4 left) 2024-03-30T12:33:57.173 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 334 2024-03-30T12:33:57.173 INFO:tasks.rados.rados.0.smithi084.stdout:3380: finishing rollback tid 0 to smithi08477944-29 2024-03-30T12:33:57.174 INFO:tasks.rados.rados.0.smithi084.stdout:3380: finishing rollback tid 1 to smithi08477944-29 2024-03-30T12:33:57.174 INFO:tasks.rados.rados.0.smithi084.stdout:3380: finishing rollback tid 2 to smithi08477944-29 2024-03-30T12:33:57.174 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 36309 (ObjNum 946 snap 301 seq_num 946) dirty exists 2024-03-30T12:33:57.174 INFO:tasks.rados.rados.0.smithi084.stdout:3373: expect (ObjNum 1035 snap 332 seq_num 1035) 2024-03-30T12:33:57.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:57.115+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:57.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:57.091+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:57.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:57.091+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:57.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:57.084+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:57.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:57.084+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:57.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:57.098+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:33:57.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:57.098+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:57.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:57.107+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:57.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:57.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:57.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:57.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:57.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:57 smithi162 ceph-mon[83709]: osdmap e741: 8 total, 8 up, 8 in 2024-03-30T12:33:57.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:57.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:57.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:57.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:57.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:57.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:57.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:57 smithi162 ceph-mon[83709]: pgmap v802: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 1.7 MiB/s wr, 7 op/s 2024-03-30T12:33:57.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:57.092+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:57.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:57.092+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:57.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:57.082+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:57.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:57.082+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:57.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:57.082+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:57.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:57.083+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:57.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:57.083+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:57.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:57.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:57.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:57.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:57.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-mon[89279]: osdmap e741: 8 total, 8 up, 8 in 2024-03-30T12:33:57.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:57.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:57.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:57.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:57.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:57.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:57.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-mon[89279]: pgmap v802: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 1.7 MiB/s wr, 7 op/s 2024-03-30T12:33:57.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:57.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:57.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:57.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:57.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-mon[91810]: osdmap e741: 8 total, 8 up, 8 in 2024-03-30T12:33:57.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:57.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:57.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:57.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:57.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:57.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:57.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:57 smithi084 ceph-mon[91810]: pgmap v802: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 1.7 MiB/s wr, 7 op/s 2024-03-30T12:33:58.158 INFO:tasks.rados.rados.0.smithi084.stdout:3379: finishing write tid 1 to smithi08477944-3 2024-03-30T12:33:58.158 INFO:tasks.rados.rados.0.smithi084.stdout:3379: finishing write tid 2 to smithi08477944-3 2024-03-30T12:33:58.159 INFO:tasks.rados.rados.0.smithi084.stdout:3379: finishing write tid 3 to smithi08477944-3 2024-03-30T12:33:58.159 INFO:tasks.rados.rados.0.smithi084.stdout:3379: oid 3 updating version 0 to 27411 2024-03-30T12:33:58.159 INFO:tasks.rados.rados.0.smithi084.stdout:3379: oid 3 version 27411 is already newer than 27410 2024-03-30T12:33:58.159 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 27411 (ObjNum 1044 snap 334 seq_num 1044) dirty exists 2024-03-30T12:33:58.159 INFO:tasks.rados.rados.0.smithi084.stdout:3379: left oid 3 (ObjNum 1044 snap 334 seq_num 1044) 2024-03-30T12:33:58.159 INFO:tasks.rados.rados.0.smithi084.stdout:3383: seq_num 1045 ranges {1531904=704512} 2024-03-30T12:33:58.171 INFO:tasks.rados.rados.0.smithi084.stdout:3383: writing smithi08477944-35 from 1531904 to 2236416 tid 1 2024-03-30T12:33:58.171 INFO:tasks.rados.rados.0.smithi084.stdout:3373: done (4 left) 2024-03-30T12:33:58.171 INFO:tasks.rados.rados.0.smithi084.stdout:3379: done (3 left) 2024-03-30T12:33:58.171 INFO:tasks.rados.rados.0.smithi084.stdout:3380: done (2 left) 2024-03-30T12:33:58.171 INFO:tasks.rados.rados.0.smithi084.stdout:3384: read oid 8 snap -1 2024-03-30T12:33:58.171 INFO:tasks.rados.rados.0.smithi084.stdout:3384: expect deleted 2024-03-30T12:33:58.172 INFO:tasks.rados.rados.0.smithi084.stdout:3385: delete oid 9 current snap is 334 2024-03-30T12:33:58.172 INFO:tasks.rados.rados.0.smithi084.stdout:3382: finishing rollback tid 0 to smithi08477944-49 2024-03-30T12:33:58.172 INFO:tasks.rados.rados.0.smithi084.stdout:3382: finishing rollback tid 1 to smithi08477944-49 2024-03-30T12:33:58.172 INFO:tasks.rados.rados.0.smithi084.stdout:3382: finishing rollback tid 2 to smithi08477944-49 2024-03-30T12:33:58.172 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 36294 (ObjNum 1021 snap 328 seq_num 1021) dirty exists 2024-03-30T12:33:58.173 INFO:tasks.rados.rados.0.smithi084.stdout:3382: done (3 left) 2024-03-30T12:33:58.173 INFO:tasks.rados.rados.0.smithi084.stdout:3384: done (2 left) 2024-03-30T12:33:58.173 INFO:tasks.rados.rados.0.smithi084.stdout:3385: done (1 left) 2024-03-30T12:33:58.173 INFO:tasks.rados.rados.0.smithi084.stdout:3386: delete oid 46 current snap is 334 2024-03-30T12:33:58.174 INFO:tasks.rados.rados.0.smithi084.stdout:3383: finishing write tid 1 to smithi08477944-35 2024-03-30T12:33:58.174 INFO:tasks.rados.rados.0.smithi084.stdout:3383: finishing write tid 2 to smithi08477944-35 2024-03-30T12:33:58.176 INFO:tasks.rados.rados.0.smithi084.stdout:3383: finishing write tid 3 to smithi08477944-35 2024-03-30T12:33:58.176 INFO:tasks.rados.rados.0.smithi084.stdout:3383: oid 35 updating version 0 to 23399 2024-03-30T12:33:58.176 INFO:tasks.rados.rados.0.smithi084.stdout:3383: oid 35 version 23399 is already newer than 23398 2024-03-30T12:33:58.176 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 23399 (ObjNum 1045 snap 334 seq_num 1045) dirty exists 2024-03-30T12:33:58.176 INFO:tasks.rados.rados.0.smithi084.stdout:3383: left oid 35 (ObjNum 1045 snap 334 seq_num 1045) 2024-03-30T12:33:58.178 INFO:tasks.rados.rados.0.smithi084.stdout:3383: done (1 left) 2024-03-30T12:33:58.178 INFO:tasks.rados.rados.0.smithi084.stdout:3386: done (0 left) 2024-03-30T12:33:58.178 INFO:tasks.rados.rados.0.smithi084.stdout:3387: snap_create 2024-03-30T12:33:58.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:58.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:58.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:58.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:58.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:58 smithi162 ceph-mon[83709]: osdmap e742: 8 total, 8 up, 8 in 2024-03-30T12:33:58.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:58.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:58.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:58.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:58.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:58.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:58.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:58.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:58.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:58.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:58.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:58.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:58.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:58.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[91810]: osdmap e742: 8 total, 8 up, 8 in 2024-03-30T12:33:58.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:58.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:58.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:58.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:58.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:58.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:58.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:58.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:58.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:58.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:58.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:58.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:58.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:33:58.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[89279]: osdmap e742: 8 total, 8 up, 8 in 2024-03-30T12:33:58.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:58.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:58.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:58.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:58.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:58.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:58.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:58.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:58.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:59.083 INFO:tasks.rados.rados.0.smithi084.stdout:3387: done (0 left) 2024-03-30T12:33:59.083 INFO:tasks.rados.rados.0.smithi084.stdout:3388: copy_from oid 50 from oid 35 current snap is 335 2024-03-30T12:33:59.083 INFO:tasks.rados.rados.0.smithi084.stdout:3389: snap_create 2024-03-30T12:33:59.092 INFO:tasks.rados.rados.0.smithi084.stdout:3388: finishing copy_from racing read to smithi08477944-50 2024-03-30T12:33:59.098 INFO:tasks.rados.rados.0.smithi084.stdout:3388: finishing copy_from to smithi08477944-50 2024-03-30T12:33:59.098 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 23399 (ObjNum 1045 snap 334 seq_num 1045) dirty exists 2024-03-30T12:33:59.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:33:59 smithi162 ceph-mon[83709]: pgmap v804: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 1000 KiB/s rd, 454 KiB/s wr, 9 op/s 2024-03-30T12:33:59.370 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:33:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:33:59.106+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:33:59.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:59.104+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:33:59.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:33:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:33:59.105+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:33:59.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:59.103+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:33:59.371 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:33:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:33:59.103+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:33:59.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:59.089+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:33:59.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:59.090+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:33:59.371 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:33:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:33:59.090+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:33:59.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:33:59 smithi084 ceph-mon[91810]: pgmap v804: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 1000 KiB/s rd, 454 KiB/s wr, 9 op/s 2024-03-30T12:33:59.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:33:59 smithi084 ceph-mon[89279]: pgmap v804: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 1000 KiB/s rd, 454 KiB/s wr, 9 op/s 2024-03-30T12:33:59.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:33:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:33:59] "GET /metrics HTTP/1.1" 200 36330 "" "Prometheus/2.43.0" 2024-03-30T12:33:59.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:59.171+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:33:59.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:33:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:33:59.171+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:33:59.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:59.089+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:59.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:59.089+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:33:59.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:59.089+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:33:59.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:59.090+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:33:59.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:59.090+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:33:59.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:33:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:33:59.090+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:00.091 INFO:tasks.rados.rados.0.smithi084.stdout:3388: done (1 left) 2024-03-30T12:34:00.091 INFO:tasks.rados.rados.0.smithi084.stdout:3389: done (0 left) 2024-03-30T12:34:00.091 INFO:tasks.rados.rados.0.smithi084.stdout:3390: read oid 23 snap -1 2024-03-30T12:34:00.091 INFO:tasks.rados.rados.0.smithi084.stdout:3390: expect (ObjNum 1033 snap 332 seq_num 1033) 2024-03-30T12:34:00.091 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 336 2024-03-30T12:34:00.091 INFO:tasks.rados.rados.0.smithi084.stdout:3391: seq_num 1048 ranges {4349952=761856} 2024-03-30T12:34:00.120 INFO:tasks.rados.rados.0.smithi084.stdout:3391: writing smithi08477944-1 from 4349952 to 5111808 tid 1 2024-03-30T12:34:00.120 INFO:tasks.rados.rados.0.smithi084.stdout:3392: read oid 50 snap -1 2024-03-30T12:34:00.120 INFO:tasks.rados.rados.0.smithi084.stdout:3392: expect (ObjNum 1045 snap 334 seq_num 1045) 2024-03-30T12:34:00.120 INFO:tasks.rados.rados.0.smithi084.stdout:3393: copy_from oid 10 from oid 37 current snap is 336 2024-03-30T12:34:00.120 INFO:tasks.rados.rados.0.smithi084.stdout:3394: read oid 15 snap 321 2024-03-30T12:34:00.120 INFO:tasks.rados.rados.0.smithi084.stdout:3394: expect (ObjNum 882 snap 282 seq_num 882) 2024-03-30T12:34:00.120 INFO:tasks.rados.rados.0.smithi084.stdout:3395: snap_create 2024-03-30T12:34:00.123 INFO:tasks.rados.rados.0.smithi084.stdout:3390: expect (ObjNum 1033 snap 332 seq_num 1033) 2024-03-30T12:34:00.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:00.132+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:00.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:00.101+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:00.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:00.102+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:00.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:00.100+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:00.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:00.100+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:00.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:00.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:00.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:00.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:00.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:00.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:00.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:00 smithi162 ceph-mon[83709]: osdmap e743: 8 total, 8 up, 8 in 2024-03-30T12:34:00.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:00.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:00.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:00.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:00.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:00.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:00.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:00.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:00 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:34:00.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:00.102+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:00.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:00.108+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:00.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:00.097+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:00.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:00.097+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:00.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:00.097+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:00.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:00.097+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:00.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:00.097+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:00.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:00.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:00.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:00.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:00.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:00.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:00.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[89279]: osdmap e743: 8 total, 8 up, 8 in 2024-03-30T12:34:00.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:00.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:00.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:00.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:00.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:00.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:00.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:00.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:34:00.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:00.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:00.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:00.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:00.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:00.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:00.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[91810]: osdmap e743: 8 total, 8 up, 8 in 2024-03-30T12:34:00.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:00.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:00.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:00.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:00.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:00.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:00.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:00.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:00 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:34:00.829 INFO:tasks.rados.rados.0.smithi084.stdout:3393: finishing copy_from to smithi08477944-10 2024-03-30T12:34:00.829 INFO:tasks.rados.rados.0.smithi084.stdout:3393: got expected ENOENT (src dne) 2024-03-30T12:34:00.829 INFO:tasks.rados.rados.0.smithi084.stdout:3393: finishing copy_from racing read to smithi08477944-10 2024-03-30T12:34:00.829 INFO:tasks.rados.rados.0.smithi084.stdout:3391: finishing write tid 1 to smithi08477944-1 2024-03-30T12:34:00.830 INFO:tasks.rados.rados.0.smithi084.stdout:3391: finishing write tid 2 to smithi08477944-1 2024-03-30T12:34:00.830 INFO:tasks.rados.rados.0.smithi084.stdout:3391: finishing write tid 3 to smithi08477944-1 2024-03-30T12:34:00.830 INFO:tasks.rados.rados.0.smithi084.stdout:3391: oid 1 updating version 0 to 23401 2024-03-30T12:34:00.830 INFO:tasks.rados.rados.0.smithi084.stdout:3391: oid 1 version 23401 is already newer than 23400 2024-03-30T12:34:00.830 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 23401 (ObjNum 1048 snap 336 seq_num 1048) dirty exists 2024-03-30T12:34:00.830 INFO:tasks.rados.rados.0.smithi084.stdout:3391: left oid 1 (ObjNum 1048 snap 336 seq_num 1048) 2024-03-30T12:34:00.830 INFO:tasks.rados.rados.0.smithi084.stdout:3392: expect (ObjNum 1045 snap 334 seq_num 1045) 2024-03-30T12:34:00.911 INFO:tasks.rados.rados.0.smithi084.stdout:3394: expect (ObjNum 882 snap 282 seq_num 882) 2024-03-30T12:34:01.114 INFO:tasks.rados.rados.0.smithi084.stdout:3390: done (5 left) 2024-03-30T12:34:01.114 INFO:tasks.rados.rados.0.smithi084.stdout:3391: done (4 left) 2024-03-30T12:34:01.114 INFO:tasks.rados.rados.0.smithi084.stdout:3392: done (3 left) 2024-03-30T12:34:01.114 INFO:tasks.rados.rados.0.smithi084.stdout:3393: done (2 left) 2024-03-30T12:34:01.115 INFO:tasks.rados.rados.0.smithi084.stdout:3394: done (1 left) 2024-03-30T12:34:01.115 INFO:tasks.rados.rados.0.smithi084.stdout:3395: done (0 left) 2024-03-30T12:34:01.115 INFO:tasks.rados.rados.0.smithi084.stdout:3396: delete oid 50 current snap is 337 2024-03-30T12:34:01.119 INFO:tasks.rados.rados.0.smithi084.stdout:3396: done (0 left) 2024-03-30T12:34:01.119 INFO:tasks.rados.rados.0.smithi084.stdout:3397: delete oid 11 current snap is 337 2024-03-30T12:34:01.121 INFO:tasks.rados.rados.0.smithi084.stdout:3397: done (0 left) 2024-03-30T12:34:01.121 INFO:tasks.rados.rados.0.smithi084.stdout:3398: read oid 33 snap -1 2024-03-30T12:34:01.122 INFO:tasks.rados.rados.0.smithi084.stdout:3398: expect deleted 2024-03-30T12:34:01.122 INFO:tasks.rados.rados.0.smithi084.stdout:3399: read oid 47 snap 328 2024-03-30T12:34:01.122 INFO:tasks.rados.rados.0.smithi084.stdout:3399: expect deleted 2024-03-30T12:34:01.122 INFO:tasks.rados.rados.0.smithi084.stdout:3400: delete oid 7 current snap is 337 2024-03-30T12:34:01.124 INFO:tasks.rados.rados.0.smithi084.stdout:3398: done (2 left) 2024-03-30T12:34:01.124 INFO:tasks.rados.rados.0.smithi084.stdout:3399: done (1 left) 2024-03-30T12:34:01.124 INFO:tasks.rados.rados.0.smithi084.stdout:3400: done (0 left) 2024-03-30T12:34:01.124 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 337 2024-03-30T12:34:01.124 INFO:tasks.rados.rados.0.smithi084.stdout:3401: seq_num 1052 ranges {286720=425984,712704=401408} 2024-03-30T12:34:01.127 INFO:tasks.rados.rados.0.smithi084.stdout:3401: writing smithi08477944-41 from 286720 to 712704 tid 1 2024-03-30T12:34:01.130 INFO:tasks.rados.rados.0.smithi084.stdout:3401: writing smithi08477944-41 from 712704 to 1114112 tid 2 2024-03-30T12:34:01.130 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 337 2024-03-30T12:34:01.130 INFO:tasks.rados.rados.0.smithi084.stdout:3402: seq_num 1053 ranges {1654784=442368,2097152=401408} 2024-03-30T12:34:01.141 INFO:tasks.rados.rados.0.smithi084.stdout:3402: writing smithi08477944-22 from 1654784 to 2097152 tid 1 2024-03-30T12:34:01.144 INFO:tasks.rados.rados.0.smithi084.stdout:3402: writing smithi08477944-22 from 2097152 to 2498560 tid 2 2024-03-30T12:34:01.144 INFO:tasks.rados.rados.0.smithi084.stdout:3403: rollback oid 11 current snap is 337 2024-03-30T12:34:01.144 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 11 to 329 2024-03-30T12:34:01.144 INFO:tasks.rados.rados.0.smithi084.stdout:3401: finishing write tid 1 to smithi08477944-41 2024-03-30T12:34:01.144 INFO:tasks.rados.rados.0.smithi084.stdout:3401: finishing write tid 2 to smithi08477944-41 2024-03-30T12:34:01.144 INFO:tasks.rados.rados.0.smithi084.stdout:3401: finishing write tid 3 to smithi08477944-41 2024-03-30T12:34:01.144 INFO:tasks.rados.rados.0.smithi084.stdout:3401: finishing write tid 4 to smithi08477944-41 2024-03-30T12:34:01.144 INFO:tasks.rados.rados.0.smithi084.stdout:3401: oid 41 updating version 0 to 27321 2024-03-30T12:34:01.144 INFO:tasks.rados.rados.0.smithi084.stdout:3401: oid 41 version 27321 is already newer than 27320 2024-03-30T12:34:01.144 INFO:tasks.rados.rados.0.smithi084.stdout:3401: oid 41 updating version 27321 to 27322 2024-03-30T12:34:01.144 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 27322 (ObjNum 1052 snap 337 seq_num 1052) dirty exists 2024-03-30T12:34:01.144 INFO:tasks.rados.rados.0.smithi084.stdout:3401: left oid 41 (ObjNum 1052 snap 337 seq_num 1052) 2024-03-30T12:34:01.145 INFO:tasks.rados.rados.0.smithi084.stdout:3401: done (2 left) 2024-03-30T12:34:01.145 INFO:tasks.rados.rados.0.smithi084.stdout:3404: read oid 30 snap -1 2024-03-30T12:34:01.145 INFO:tasks.rados.rados.0.smithi084.stdout:3404: expect (ObjNum 1023 snap 328 seq_num 1023) 2024-03-30T12:34:01.145 INFO:tasks.rados.rados.0.smithi084.stdout:3405: delete oid 34 current snap is 337 2024-03-30T12:34:01.146 INFO:tasks.rados.rados.0.smithi084.stdout:3404: expect (ObjNum 1023 snap 328 seq_num 1023) 2024-03-30T12:34:01.161 INFO:tasks.rados.rados.0.smithi084.stdout:3403: finishing rollback tid 1 to smithi08477944-11 2024-03-30T12:34:01.161 INFO:tasks.rados.rados.0.smithi084.stdout:3403: finishing rollback tid 2 to smithi08477944-11 2024-03-30T12:34:01.161 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 27291 (ObjNum 883 snap 282 seq_num 883) dirty exists 2024-03-30T12:34:01.161 INFO:tasks.rados.rados.0.smithi084.stdout:3402: finishing write tid 1 to smithi08477944-22 2024-03-30T12:34:01.161 INFO:tasks.rados.rados.0.smithi084.stdout:3402: finishing write tid 2 to smithi08477944-22 2024-03-30T12:34:01.161 INFO:tasks.rados.rados.0.smithi084.stdout:3403: done (3 left) 2024-03-30T12:34:01.161 INFO:tasks.rados.rados.0.smithi084.stdout:3404: done (2 left) 2024-03-30T12:34:01.161 INFO:tasks.rados.rados.0.smithi084.stdout:3405: done (1 left) 2024-03-30T12:34:01.161 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 337 2024-03-30T12:34:01.161 INFO:tasks.rados.rados.0.smithi084.stdout:3402: finishing write tid 3 to smithi08477944-22 2024-03-30T12:34:01.161 INFO:tasks.rados.rados.0.smithi084.stdout:3402: finishing write tid 4 to smithi08477944-22 2024-03-30T12:34:01.161 INFO:tasks.rados.rados.0.smithi084.stdout:3402: oid 22 updating version 0 to 27417 2024-03-30T12:34:01.162 INFO:tasks.rados.rados.0.smithi084.stdout:3402: oid 22 version 27417 is already newer than 27416 2024-03-30T12:34:01.162 INFO:tasks.rados.rados.0.smithi084.stdout:3402: oid 22 version 27417 is already newer than 27415 2024-03-30T12:34:01.162 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 27417 (ObjNum 1053 snap 337 seq_num 1053) dirty exists 2024-03-30T12:34:01.162 INFO:tasks.rados.rados.0.smithi084.stdout:3402: left oid 22 (ObjNum 1053 snap 337 seq_num 1053) 2024-03-30T12:34:01.162 INFO:tasks.rados.rados.0.smithi084.stdout:3406: seq_num 1055 ranges {0=475136,475136=401408} 2024-03-30T12:34:01.163 INFO:tasks.rados.rados.0.smithi084.stdout:3406: writing smithi08477944-17 from 0 to 475136 tid 1 2024-03-30T12:34:01.166 INFO:tasks.rados.rados.0.smithi084.stdout:3406: writing smithi08477944-17 from 475136 to 876544 tid 2 2024-03-30T12:34:01.166 INFO:tasks.rados.rados.0.smithi084.stdout:3402: done (1 left) 2024-03-30T12:34:01.166 INFO:tasks.rados.rados.0.smithi084.stdout:3407: read oid 14 snap -1 2024-03-30T12:34:01.166 INFO:tasks.rados.rados.0.smithi084.stdout:3407: expect deleted 2024-03-30T12:34:01.167 INFO:tasks.rados.rados.0.smithi084.stdout:3408: rollback oid 37 current snap is 337 2024-03-30T12:34:01.167 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 37 to 329 2024-03-30T12:34:01.167 INFO:tasks.rados.rados.0.smithi084.stdout:3409: read oid 38 snap -1 2024-03-30T12:34:01.167 INFO:tasks.rados.rados.0.smithi084.stdout:3409: expect (ObjNum 1042 snap 334 seq_num 1042) 2024-03-30T12:34:01.167 INFO:tasks.rados.rados.0.smithi084.stdout:3410: read oid 2 snap -1 2024-03-30T12:34:01.167 INFO:tasks.rados.rados.0.smithi084.stdout:3410: expect (ObjNum 1012 snap 326 seq_num 1012) 2024-03-30T12:34:01.167 INFO:tasks.rados.rados.0.smithi084.stdout:3411: rollback oid 10 current snap is 337 2024-03-30T12:34:01.167 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 10 to 329 2024-03-30T12:34:01.167 INFO:tasks.rados.rados.0.smithi084.stdout:3412: copy_from oid 26 from oid 6 current snap is 337 2024-03-30T12:34:01.167 INFO:tasks.rados.rados.0.smithi084.stdout:3413: snap_create 2024-03-30T12:34:01.167 INFO:tasks.rados.rados.0.smithi084.stdout:3406: finishing write tid 1 to smithi08477944-17 2024-03-30T12:34:01.170 INFO:tasks.rados.rados.0.smithi084.stdout:3406: finishing write tid 2 to smithi08477944-17 2024-03-30T12:34:01.170 INFO:tasks.rados.rados.0.smithi084.stdout:3406: finishing write tid 3 to smithi08477944-17 2024-03-30T12:34:01.172 INFO:tasks.rados.rados.0.smithi084.stdout:3406: finishing write tid 4 to smithi08477944-17 2024-03-30T12:34:01.173 INFO:tasks.rados.rados.0.smithi084.stdout:3406: oid 17 updating version 0 to 27397 2024-03-30T12:34:01.173 INFO:tasks.rados.rados.0.smithi084.stdout:3406: oid 17 updating version 27397 to 27398 2024-03-30T12:34:01.173 INFO:tasks.rados.rados.0.smithi084.stdout:3406: oid 17 version 27398 is already newer than 27396 2024-03-30T12:34:01.173 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 27398 (ObjNum 1055 snap 337 seq_num 1055) dirty exists 2024-03-30T12:34:01.173 INFO:tasks.rados.rados.0.smithi084.stdout:3406: left oid 17 (ObjNum 1055 snap 337 seq_num 1055) 2024-03-30T12:34:01.175 INFO:tasks.rados.rados.0.smithi084.stdout:3409: expect (ObjNum 1042 snap 334 seq_num 1042) 2024-03-30T12:34:01.266 INFO:tasks.rados.rados.0.smithi084.stdout:3410: expect (ObjNum 1012 snap 326 seq_num 1012) 2024-03-30T12:34:01.334 INFO:tasks.rados.rados.0.smithi084.stdout:3412: finishing copy_from racing read to smithi08477944-26 2024-03-30T12:34:01.334 INFO:tasks.rados.rados.0.smithi084.stdout:3412: finishing copy_from to smithi08477944-26 2024-03-30T12:34:01.334 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 27375 (ObjNum 947 snap 301 seq_num 947) dirty exists 2024-03-30T12:34:01.334 INFO:tasks.rados.rados.0.smithi084.stdout:3408: finishing rollback tid 1 to smithi08477944-37 2024-03-30T12:34:01.335 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 36300 (ObjNum 33 snap 0 seq_num 1394492664) dirty dne 2024-03-30T12:34:01.335 INFO:tasks.rados.rados.0.smithi084.stdout:3411: finishing rollback tid 0 to smithi08477944-10 2024-03-30T12:34:01.335 INFO:tasks.rados.rados.0.smithi084.stdout:3411: finishing rollback tid 1 to smithi08477944-10 2024-03-30T12:34:01.335 INFO:tasks.rados.rados.0.smithi084.stdout:3411: finishing rollback tid 2 to smithi08477944-10 2024-03-30T12:34:01.335 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 36308 (ObjNum 1008 snap 325 seq_num 1008) dirty exists 2024-03-30T12:34:01.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:01.158+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:01.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:01.105+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:01.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:01.105+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:01.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:01.105+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:01.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:01.127+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:01.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:01.127+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:01.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:01.129+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:01.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:01.129+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:01.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:01.129+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:01.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:01.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:01 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:01.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:01 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:01.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:01 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:01.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:01 smithi162 ceph-mon[83709]: osdmap e744: 8 total, 8 up, 8 in 2024-03-30T12:34:01.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:01.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:01.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:01.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:01.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:01 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:01.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:01 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:01.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:01.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:01 smithi162 ceph-mon[83709]: pgmap v807: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 8.4 MiB/s rd, 693 KiB/s wr, 8 op/s 2024-03-30T12:34:01.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:01.112+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:01.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:01.112+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:01.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:01.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:01.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:01.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:01.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[89279]: osdmap e744: 8 total, 8 up, 8 in 2024-03-30T12:34:01.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:01.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:01.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:01.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:01.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:01.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:01.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:01.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[89279]: pgmap v807: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 8.4 MiB/s rd, 693 KiB/s wr, 8 op/s 2024-03-30T12:34:01.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:01.109+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:01.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:01.109+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:01.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:01.109+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:01.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:01.109+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:01.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:01.110+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:01.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:01.110+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:01.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:01.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:01.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:01.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:01.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[91810]: osdmap e744: 8 total, 8 up, 8 in 2024-03-30T12:34:01.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:01.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:01.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:01.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:01.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:01.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:01.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:01.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:01 smithi084 ceph-mon[91810]: pgmap v807: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 8.4 MiB/s rd, 693 KiB/s wr, 8 op/s 2024-03-30T12:34:02.104 INFO:tasks.rados.rados.0.smithi084.stdout:3406: done (7 left) 2024-03-30T12:34:02.104 INFO:tasks.rados.rados.0.smithi084.stdout:3407: done (6 left) 2024-03-30T12:34:02.104 INFO:tasks.rados.rados.0.smithi084.stdout:3408: done (5 left) 2024-03-30T12:34:02.104 INFO:tasks.rados.rados.0.smithi084.stdout:3409: done (4 left) 2024-03-30T12:34:02.104 INFO:tasks.rados.rados.0.smithi084.stdout:3410: done (3 left) 2024-03-30T12:34:02.105 INFO:tasks.rados.rados.0.smithi084.stdout:3411: done (2 left) 2024-03-30T12:34:02.105 INFO:tasks.rados.rados.0.smithi084.stdout:3412: done (1 left) 2024-03-30T12:34:02.105 INFO:tasks.rados.rados.0.smithi084.stdout:3413: done (0 left) 2024-03-30T12:34:02.105 INFO:tasks.rados.rados.0.smithi084.stdout:3414: copy_from oid 10 from oid 6 current snap is 338 2024-03-30T12:34:02.105 INFO:tasks.rados.rados.0.smithi084.stdout:3415: snap_create 2024-03-30T12:34:02.118 INFO:tasks.rados.rados.0.smithi084.stdout:3414: finishing copy_from racing read to smithi08477944-10 2024-03-30T12:34:02.119 INFO:tasks.rados.rados.0.smithi084.stdout:3414: finishing copy_from to smithi08477944-10 2024-03-30T12:34:02.119 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 27375 (ObjNum 947 snap 301 seq_num 947) dirty exists 2024-03-30T12:34:02.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:02.116+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18f=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:02.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:02.111+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:02.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:02.111+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:02.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:02.124+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:02.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:02.124+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:02.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:02.112+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:02.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:02.112+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:02.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:02.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:02.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:02.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:02.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:02.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:02.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:02 smithi162 ceph-mon[83709]: osdmap e745: 8 total, 8 up, 8 in 2024-03-30T12:34:02.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:02.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:02.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:02.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:02.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:02.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:02.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:02.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:02.123+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:02.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:02.123+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:02.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:02.111+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:02.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:02.111+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:02.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:02.111+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:02.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:02.111+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:02.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:02.111+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:02.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:02.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:02.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:02.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:02.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:02.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:02.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[89279]: osdmap e745: 8 total, 8 up, 8 in 2024-03-30T12:34:02.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:02.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:02.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:02.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:02.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:02.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:02.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:02.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:02.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:02.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:02.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:02.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:02.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:02.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[91810]: osdmap e745: 8 total, 8 up, 8 in 2024-03-30T12:34:02.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:02.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:02.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:02.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:02.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:02.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:02.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:03.114 INFO:tasks.rados.rados.0.smithi084.stdout:3414: done (1 left) 2024-03-30T12:34:03.115 INFO:tasks.rados.rados.0.smithi084.stdout:3415: done (0 left) 2024-03-30T12:34:03.115 INFO:tasks.rados.rados.0.smithi084.stdout:3416: read oid 18 snap -1 2024-03-30T12:34:03.115 INFO:tasks.rados.rados.0.smithi084.stdout:3416: expect (ObjNum 825 snap 273 seq_num 825) 2024-03-30T12:34:03.115 INFO:tasks.rados.rados.0.smithi084.stdout:3417: delete oid 48 current snap is 339 2024-03-30T12:34:03.120 INFO:tasks.rados.rados.0.smithi084.stdout:3417: done (1 left) 2024-03-30T12:34:03.120 INFO:tasks.rados.rados.0.smithi084.stdout:3418: snap_create 2024-03-30T12:34:03.124 INFO:tasks.rados.rados.0.smithi084.stdout:3416: expect (ObjNum 825 snap 273 seq_num 825) 2024-03-30T12:34:03.369 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:03.123+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:03.369 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:03.123+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:03.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:03.129+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:03.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:03.129+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:03.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:03.129+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:03.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:03.119+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:03.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:03.119+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:03.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:03.119+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:03.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:03.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:03.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:03.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:03.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:03.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:03 smithi162 ceph-mon[83709]: osdmap e746: 8 total, 8 up, 8 in 2024-03-30T12:34:03.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:03.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:03.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:03.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18f=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:03.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:03.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:03.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:03.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:03.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:03 smithi162 ceph-mon[83709]: pgmap v810: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 18 MiB/s rd, 504 KiB/s wr, 7 op/s 2024-03-30T12:34:03.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:03.119+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:03.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:03.119+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:03.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:03.119+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:03.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:03.120+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:03.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:03.120+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:03.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:03.121+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:03.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:03.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:03.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:03.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:03.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:03.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[91810]: osdmap e746: 8 total, 8 up, 8 in 2024-03-30T12:34:03.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:03.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:03.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:03.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18f=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:03.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:03.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:03.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:03.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:03.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[91810]: pgmap v810: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 18 MiB/s rd, 504 KiB/s wr, 7 op/s 2024-03-30T12:34:03.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:03.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:03.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:03.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:03.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:03.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[89279]: osdmap e746: 8 total, 8 up, 8 in 2024-03-30T12:34:03.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:03.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:03.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:03.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18f=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:03.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:03.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:03.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:03.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:03.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-mon[89279]: pgmap v810: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.1 GiB used, 707 GiB / 715 GiB avail; 18 MiB/s rd, 504 KiB/s wr, 7 op/s 2024-03-30T12:34:03.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:03.528+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:04.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:03.528+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:04.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:03.528+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:04.122 INFO:tasks.rados.rados.0.smithi084.stdout:3416: done (1 left) 2024-03-30T12:34:04.122 INFO:tasks.rados.rados.0.smithi084.stdout:3418: done (0 left) 2024-03-30T12:34:04.122 INFO:tasks.rados.rados.0.smithi084.stdout:3419: setattr oid 5 current snap is 340 2024-03-30T12:34:04.123 INFO:tasks.rados.rados.0.smithi084.stdout:3420: snap_remove snap 333 2024-03-30T12:34:04.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:04.207+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:04.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:04.136+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:04.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:04.138+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:04.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:04.127+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:04.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:04.128+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:04.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:04.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:04.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:04.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:04.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:04.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:04.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:04 smithi162 ceph-mon[83709]: osdmap e747: 8 total, 8 up, 8 in 2024-03-30T12:34:04.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:04.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:04.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:04.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:04.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:04.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:04.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:04.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:04.130+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:04.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:04.131+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:04.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:04.128+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:04.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:04.129+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:04.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:04.129+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:04.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:04.130+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:04.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:04.130+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:04.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:04.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:04.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:04.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:04.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:04.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:04.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[91810]: osdmap e747: 8 total, 8 up, 8 in 2024-03-30T12:34:04.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:04.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:04.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:04.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:04.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:04.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:04.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:04.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:04.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:04.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:04.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:04.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:04.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:04.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[89279]: osdmap e747: 8 total, 8 up, 8 in 2024-03-30T12:34:04.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:04.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 188=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:04.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:04.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:04.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:04.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:04.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:04.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:04.453+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:04.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:04.453+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:05.130 INFO:tasks.rados.rados.0.smithi084.stdout:3420: done (1 left) 2024-03-30T12:34:05.131 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 340 2024-03-30T12:34:05.131 INFO:tasks.rados.rados.0.smithi084.stdout:3421: seq_num 1057 ranges {761856=507904,1269760=401408} 2024-03-30T12:34:05.138 INFO:tasks.rados.rados.0.smithi084.stdout:3421: writing smithi08477944-36 from 761856 to 1269760 tid 1 2024-03-30T12:34:05.140 INFO:tasks.rados.rados.0.smithi084.stdout:3421: writing smithi08477944-36 from 1269760 to 1671168 tid 2 2024-03-30T12:34:05.140 INFO:tasks.rados.rados.0.smithi084.stdout:3422: setattr oid 31 current snap is 340 2024-03-30T12:34:05.140 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 27292 (ObjNum 836 snap 273 seq_num 836) dirty exists 2024-03-30T12:34:05.141 INFO:tasks.rados.rados.0.smithi084.stdout:3419: done (2 left) 2024-03-30T12:34:05.141 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 340 2024-03-30T12:34:05.141 INFO:tasks.rados.rados.0.smithi084.stdout:3423: seq_num 1058 ranges {1466368=524288,1990656=401408} 2024-03-30T12:34:05.154 INFO:tasks.rados.rados.0.smithi084.stdout:3423: writing smithi08477944-26 from 1466368 to 1990656 tid 1 2024-03-30T12:34:05.155 INFO:tasks.rados.rados.0.smithi084.stdout:3423: writing smithi08477944-26 from 1990656 to 2392064 tid 2 2024-03-30T12:34:05.155 INFO:tasks.rados.rados.0.smithi084.stdout:3424: snap_create 2024-03-30T12:34:05.156 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 36310 (ObjNum 1007 snap 325 seq_num 1007) dirty exists 2024-03-30T12:34:05.156 INFO:tasks.rados.rados.0.smithi084.stdout:3421: finishing write tid 1 to smithi08477944-36 2024-03-30T12:34:05.156 INFO:tasks.rados.rados.0.smithi084.stdout:3421: finishing write tid 2 to smithi08477944-36 2024-03-30T12:34:05.156 INFO:tasks.rados.rados.0.smithi084.stdout:3421: finishing write tid 3 to smithi08477944-36 2024-03-30T12:34:05.156 INFO:tasks.rados.rados.0.smithi084.stdout:3421: finishing write tid 4 to smithi08477944-36 2024-03-30T12:34:05.156 INFO:tasks.rados.rados.0.smithi084.stdout:3421: oid 36 updating version 0 to 36297 2024-03-30T12:34:05.156 INFO:tasks.rados.rados.0.smithi084.stdout:3421: oid 36 version 36297 is already newer than 36295 2024-03-30T12:34:05.156 INFO:tasks.rados.rados.0.smithi084.stdout:3421: oid 36 version 36297 is already newer than 36296 2024-03-30T12:34:05.156 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 36297 (ObjNum 1057 snap 340 seq_num 1057) dirty exists 2024-03-30T12:34:05.156 INFO:tasks.rados.rados.0.smithi084.stdout:3421: left oid 36 (ObjNum 1057 snap 340 seq_num 1057) 2024-03-30T12:34:05.163 INFO:tasks.rados.rados.0.smithi084.stdout:3423: finishing write tid 1 to smithi08477944-26 2024-03-30T12:34:05.164 INFO:tasks.rados.rados.0.smithi084.stdout:3423: finishing write tid 2 to smithi08477944-26 2024-03-30T12:34:05.164 INFO:tasks.rados.rados.0.smithi084.stdout:3423: finishing write tid 3 to smithi08477944-26 2024-03-30T12:34:05.166 INFO:tasks.rados.rados.0.smithi084.stdout:3423: finishing write tid 4 to smithi08477944-26 2024-03-30T12:34:05.167 INFO:tasks.rados.rados.0.smithi084.stdout:3423: oid 26 updating version 0 to 27421 2024-03-30T12:34:05.167 INFO:tasks.rados.rados.0.smithi084.stdout:3423: oid 26 updating version 27421 to 27422 2024-03-30T12:34:05.167 INFO:tasks.rados.rados.0.smithi084.stdout:3423: oid 26 updating version 27422 to 27423 2024-03-30T12:34:05.167 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 27423 (ObjNum 1058 snap 340 seq_num 1058) dirty exists 2024-03-30T12:34:05.167 INFO:tasks.rados.rados.0.smithi084.stdout:3423: left oid 26 (ObjNum 1058 snap 340 seq_num 1058) 2024-03-30T12:34:05.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:05.143+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:05.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:05.143+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:05.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:05.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:05.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:05.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:05.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:05.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[91810]: osdmap e748: 8 total, 8 up, 8 in 2024-03-30T12:34:05.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:05.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:05.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:05.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:05.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:05.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[91810]: pgmap v813: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 14 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-03-30T12:34:05.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:05.134+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:05.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:05.134+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:05.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:05.134+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:05.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:05.134+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:05.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:05.134+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:05.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:05.135+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:05.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:05.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:05.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:05.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:05.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:05.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[89279]: osdmap e748: 8 total, 8 up, 8 in 2024-03-30T12:34:05.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:05.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:05.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:05.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:05.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:05 smithi084 ceph-mon[89279]: pgmap v813: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 14 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-03-30T12:34:05.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:05.307+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:05.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:05.136+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:05.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:05.137+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:05.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:05.135+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:05.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:05.135+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:05.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:05.135+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:05.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:05.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:05.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:05.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:05.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:05.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:05 smithi162 ceph-mon[83709]: osdmap e748: 8 total, 8 up, 8 in 2024-03-30T12:34:05.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:05.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:05.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:05.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:05.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:05.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:05.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:05.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:05.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:05 smithi162 ceph-mon[83709]: pgmap v813: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 14 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-03-30T12:34:05.622 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:05.139+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:05.622 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:05.139+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:05.623 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:05.139+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:06.133 INFO:tasks.rados.rados.0.smithi084.stdout:3421: done (3 left) 2024-03-30T12:34:06.133 INFO:tasks.rados.rados.0.smithi084.stdout:3422: done (2 left) 2024-03-30T12:34:06.133 INFO:tasks.rados.rados.0.smithi084.stdout:3423: done (1 left) 2024-03-30T12:34:06.133 INFO:tasks.rados.rados.0.smithi084.stdout:3424: done (0 left) 2024-03-30T12:34:06.134 INFO:tasks.rados.rados.0.smithi084.stdout:3425: rollback oid 46 current snap is 341 2024-03-30T12:34:06.134 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 46 to 337 2024-03-30T12:34:06.134 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 341 2024-03-30T12:34:06.134 INFO:tasks.rados.rados.0.smithi084.stdout:3426: seq_num 1059 ranges {0=540672,540672=401408} 2024-03-30T12:34:06.136 INFO:tasks.rados.rados.0.smithi084.stdout:3426: writing smithi08477944-48 from 0 to 540672 tid 1 2024-03-30T12:34:06.138 INFO:tasks.rados.rados.0.smithi084.stdout:3426: writing smithi08477944-48 from 540672 to 942080 tid 2 2024-03-30T12:34:06.138 INFO:tasks.rados.rados.0.smithi084.stdout:3427: read oid 33 snap -1 2024-03-30T12:34:06.139 INFO:tasks.rados.rados.0.smithi084.stdout:3427: expect deleted 2024-03-30T12:34:06.139 INFO:tasks.rados.rados.0.smithi084.stdout:3428: setattr oid 14 current snap is 341 2024-03-30T12:34:06.141 INFO:tasks.rados.rados.0.smithi084.stdout:3426: finishing write tid 1 to smithi08477944-48 2024-03-30T12:34:06.141 INFO:tasks.rados.rados.0.smithi084.stdout:3429: read oid 34 snap -1 2024-03-30T12:34:06.141 INFO:tasks.rados.rados.0.smithi084.stdout:3429: expect deleted 2024-03-30T12:34:06.142 INFO:tasks.rados.rados.0.smithi084.stdout:3430: rollback oid 12 current snap is 341 2024-03-30T12:34:06.142 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 12 to 340 2024-03-30T12:34:06.142 INFO:tasks.rados.rados.0.smithi084.stdout:3431: copy_from oid 47 from oid 22 current snap is 341 2024-03-30T12:34:06.142 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 341 2024-03-30T12:34:06.142 INFO:tasks.rados.rados.0.smithi084.stdout:3432: seq_num 1060 ranges {5111808=557056,5668864=401408} 2024-03-30T12:34:06.174 INFO:tasks.rados.rados.0.smithi084.stdout:3432: writing smithi08477944-1 from 5111808 to 5668864 tid 1 2024-03-30T12:34:06.176 INFO:tasks.rados.rados.0.smithi084.stdout:3432: writing smithi08477944-1 from 5668864 to 6070272 tid 2 2024-03-30T12:34:06.177 INFO:tasks.rados.rados.0.smithi084.stdout:3433: read oid 50 snap -1 2024-03-30T12:34:06.177 INFO:tasks.rados.rados.0.smithi084.stdout:3433: expect deleted 2024-03-30T12:34:06.177 INFO:tasks.rados.rados.0.smithi084.stdout:3434: rmattr oid 32 current snap is 341 2024-03-30T12:34:06.177 INFO:tasks.rados.rados.0.smithi084.stdout:3426: finishing write tid 2 to smithi08477944-48 2024-03-30T12:34:06.177 INFO:tasks.rados.rados.0.smithi084.stdout:3426: finishing write tid 3 to smithi08477944-48 2024-03-30T12:34:06.177 INFO:tasks.rados.rados.0.smithi084.stdout:3426: finishing write tid 4 to smithi08477944-48 2024-03-30T12:34:06.177 INFO:tasks.rados.rados.0.smithi084.stdout:3426: oid 48 updating version 0 to 23429 2024-03-30T12:34:06.177 INFO:tasks.rados.rados.0.smithi084.stdout:3426: oid 48 version 23429 is already newer than 23428 2024-03-30T12:34:06.177 INFO:tasks.rados.rados.0.smithi084.stdout:3426: oid 48 version 23429 is already newer than 23427 2024-03-30T12:34:06.177 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 23429 (ObjNum 1059 snap 341 seq_num 1059) dirty exists 2024-03-30T12:34:06.177 INFO:tasks.rados.rados.0.smithi084.stdout:3426: left oid 48 (ObjNum 1059 snap 341 seq_num 1059) 2024-03-30T12:34:06.177 INFO:tasks.rados.rados.0.smithi084.stdout:3425: finishing rollback tid 1 to smithi08477944-46 2024-03-30T12:34:06.177 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 27413 (ObjNum 49 snap 0 seq_num 1953066355) dirty dne 2024-03-30T12:34:06.177 INFO:tasks.rados.rados.0.smithi084.stdout:3430: finishing rollback tid 0 to smithi08477944-12 2024-03-30T12:34:06.178 INFO:tasks.rados.rados.0.smithi084.stdout:3430: finishing rollback tid 1 to smithi08477944-12 2024-03-30T12:34:06.178 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 36309 (ObjNum 225 snap 0 seq_num 1428961200) dirty exists 2024-03-30T12:34:06.178 INFO:tasks.rados.rados.0.smithi084.stdout:3430: finishing rollback tid 2 to smithi08477944-12 2024-03-30T12:34:06.178 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 36291 (ObjNum 883 snap 282 seq_num 883) dirty exists 2024-03-30T12:34:06.178 INFO:tasks.rados.rados.0.smithi084.stdout:3431: finishing copy_from racing read to smithi08477944-47 2024-03-30T12:34:06.178 INFO:tasks.rados.rados.0.smithi084.stdout:3425: done (9 left) 2024-03-30T12:34:06.178 INFO:tasks.rados.rados.0.smithi084.stdout:3426: done (8 left) 2024-03-30T12:34:06.178 INFO:tasks.rados.rados.0.smithi084.stdout:3427: done (7 left) 2024-03-30T12:34:06.178 INFO:tasks.rados.rados.0.smithi084.stdout:3428: done (6 left) 2024-03-30T12:34:06.178 INFO:tasks.rados.rados.0.smithi084.stdout:3429: done (5 left) 2024-03-30T12:34:06.178 INFO:tasks.rados.rados.0.smithi084.stdout:3430: done (4 left) 2024-03-30T12:34:06.178 INFO:tasks.rados.rados.0.smithi084.stdout:3435: copy_from oid 33 from oid 8 current snap is 341 2024-03-30T12:34:06.178 INFO:tasks.rados.rados.0.smithi084.stdout:3431: finishing copy_from to smithi08477944-47 2024-03-30T12:34:06.179 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 27417 (ObjNum 1053 snap 337 seq_num 1053) dirty exists 2024-03-30T12:34:06.179 INFO:tasks.rados.rados.0.smithi084.stdout:3431: done (4 left) 2024-03-30T12:34:06.179 INFO:tasks.rados.rados.0.smithi084.stdout:3436: copy_from oid 15 from oid 45 current snap is 341 2024-03-30T12:34:06.179 INFO:tasks.rados.rados.0.smithi084.stdout:3437: snap_create 2024-03-30T12:34:06.180 INFO:tasks.rados.rados.0.smithi084.stdout:3435: finishing copy_from to smithi08477944-33 2024-03-30T12:34:06.180 INFO:tasks.rados.rados.0.smithi084.stdout:3435: got expected ENOENT (src dne) 2024-03-30T12:34:06.180 INFO:tasks.rados.rados.0.smithi084.stdout:3435: finishing copy_from racing read to smithi08477944-33 2024-03-30T12:34:06.180 INFO:tasks.rados.rados.0.smithi084.stdout:3432: finishing write tid 1 to smithi08477944-1 2024-03-30T12:34:06.180 INFO:tasks.rados.rados.0.smithi084.stdout:3432: finishing write tid 2 to smithi08477944-1 2024-03-30T12:34:06.180 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 36298 (ObjNum 1037 snap 332 seq_num 1037) dirty exists 2024-03-30T12:34:06.180 INFO:tasks.rados.rados.0.smithi084.stdout:3432: finishing write tid 3 to smithi08477944-1 2024-03-30T12:34:06.183 INFO:tasks.rados.rados.0.smithi084.stdout:3432: finishing write tid 4 to smithi08477944-1 2024-03-30T12:34:06.183 INFO:tasks.rados.rados.0.smithi084.stdout:3432: oid 1 updating version 0 to 23404 2024-03-30T12:34:06.183 INFO:tasks.rados.rados.0.smithi084.stdout:3432: oid 1 version 23404 is already newer than 23403 2024-03-30T12:34:06.183 INFO:tasks.rados.rados.0.smithi084.stdout:3432: oid 1 version 23404 is already newer than 23402 2024-03-30T12:34:06.183 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 23404 (ObjNum 1060 snap 341 seq_num 1060) dirty exists 2024-03-30T12:34:06.184 INFO:tasks.rados.rados.0.smithi084.stdout:3432: left oid 1 (ObjNum 1060 snap 341 seq_num 1060) 2024-03-30T12:34:06.186 INFO:tasks.rados.rados.0.smithi084.stdout:3436: finishing copy_from racing read to smithi08477944-15 2024-03-30T12:34:06.187 INFO:tasks.rados.rados.0.smithi084.stdout:3436: finishing copy_from to smithi08477944-15 2024-03-30T12:34:06.187 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 27318 (ObjNum 955 snap 303 seq_num 955) dirty exists 2024-03-30T12:34:06.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:06.156+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:06.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:06.156+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:06.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:06.151+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:06.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:06.151+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:06.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:06.152+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:06.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:06.152+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:06.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:06.152+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:06.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:06.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:06.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:06.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:06.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:06.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:06.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[89279]: osdmap e749: 8 total, 8 up, 8 in 2024-03-30T12:34:06.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:06.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:06.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:06.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:06.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:06.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:06.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:06.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:06.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:06.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:06.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:06.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:06.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:06.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[91810]: osdmap e749: 8 total, 8 up, 8 in 2024-03-30T12:34:06.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:06.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:06.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:06.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:06.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:06.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:06.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:06.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:06.160+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:06.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:06.146+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:06.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:06.146+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:06.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:06.142+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:06.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:06.142+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:06.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:06.149+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:06.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:06.152+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:06.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:06.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:06.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:06.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:06.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:06.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:06.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:06 smithi162 ceph-mon[83709]: osdmap e749: 8 total, 8 up, 8 in 2024-03-30T12:34:06.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:06.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:06.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:06.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:06.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:06.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:06.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:07.141 INFO:tasks.rados.rados.0.smithi084.stdout:3432: done (5 left) 2024-03-30T12:34:07.141 INFO:tasks.rados.rados.0.smithi084.stdout:3433: done (4 left) 2024-03-30T12:34:07.141 INFO:tasks.rados.rados.0.smithi084.stdout:3434: done (3 left) 2024-03-30T12:34:07.141 INFO:tasks.rados.rados.0.smithi084.stdout:3435: done (2 left) 2024-03-30T12:34:07.141 INFO:tasks.rados.rados.0.smithi084.stdout:3436: done (1 left) 2024-03-30T12:34:07.141 INFO:tasks.rados.rados.0.smithi084.stdout:3437: done (0 left) 2024-03-30T12:34:07.141 INFO:tasks.rados.rados.0.smithi084.stdout:3438: snap_create 2024-03-30T12:34:07.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[89279]: osdmap e750: 8 total, 8 up, 8 in 2024-03-30T12:34:07.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:07.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:07.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:07.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:07.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:07.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:07.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:07.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:07.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:07.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:07.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:07.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:07.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:07.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[89279]: pgmap v816: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 5.9 MiB/s rd, 2.5 MiB/s wr, 13 op/s 2024-03-30T12:34:07.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:07.145+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:07.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:07.145+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:07.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:07.147+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:07.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:07.147+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:07.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:07.147+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:07.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:07.147+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:07.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[91810]: osdmap e750: 8 total, 8 up, 8 in 2024-03-30T12:34:07.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:07.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:07.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:07.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:07.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:07.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:07.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:07.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:07.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:07.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:07.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:07.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:07.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:07.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-mon[91810]: pgmap v816: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 5.9 MiB/s rd, 2.5 MiB/s wr, 13 op/s 2024-03-30T12:34:07.521 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:07.150+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:07.522 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:07.151+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:07.522 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:07.151+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:07.522 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:07 smithi162 ceph-mon[83709]: osdmap e750: 8 total, 8 up, 8 in 2024-03-30T12:34:07.522 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:07.522 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:07.523 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:07.523 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:07.523 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:07.523 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:07.523 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:07.523 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:07.523 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:07.524 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:07.524 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:07.524 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:07.524 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:07.524 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:07 smithi162 ceph-mon[83709]: pgmap v816: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 5.9 MiB/s rd, 2.5 MiB/s wr, 13 op/s 2024-03-30T12:34:07.793 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:07.530+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:07.793 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:07.530+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:07.793 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:07.530+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:08.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:07.801+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:08.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:07.801+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 193=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:08.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:07.801+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:08.141 INFO:tasks.rados.rados.0.smithi084.stdout:3438: done (0 left) 2024-03-30T12:34:08.141 INFO:tasks.rados.rados.0.smithi084.stdout:3439: read oid 16 snap -1 2024-03-30T12:34:08.141 INFO:tasks.rados.rados.0.smithi084.stdout:3439: expect (ObjNum 1023 snap 328 seq_num 1023) 2024-03-30T12:34:08.141 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:07.800+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:08.141 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:07.801+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:08.142 INFO:tasks.rados.rados.0.smithi084.stdout:3440: snap_remove snap 329 2024-03-30T12:34:08.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:08.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:08.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:08.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:08.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-mon[89279]: osdmap e751: 8 total, 8 up, 8 in 2024-03-30T12:34:08.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:08.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:08.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:08.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:08.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:08.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:08.147+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:08.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:08.147+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:08.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:08.147+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:08.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:08.147+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:08.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:08.147+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:08.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:08.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:08.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:08.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:08.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-mon[91810]: osdmap e751: 8 total, 8 up, 8 in 2024-03-30T12:34:08.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:08.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:08.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:08.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:08.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:08.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:08.148+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:08.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:08.148+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:08.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:08.153+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 193=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:08.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:08.153+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:08.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:08 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:08.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:08.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:08.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:08.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:08 smithi162 ceph-mon[83709]: osdmap e751: 8 total, 8 up, 8 in 2024-03-30T12:34:08.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:08 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:08.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:08 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:08.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:08.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:08 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:08.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:09.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:08.746+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:09.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:08.746+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:09.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:08.747+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:09.119 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:08.746+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:09.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:08.747+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:09.153 INFO:tasks.rados.rados.0.smithi084.stdout:3440: done (1 left) 2024-03-30T12:34:09.153 INFO:tasks.rados.rados.0.smithi084.stdout:3441: rollback oid 8 current snap is 343 2024-03-30T12:34:09.153 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 8 to 337 2024-03-30T12:34:09.153 INFO:tasks.rados.rados.0.smithi084.stdout:3439: expect (ObjNum 1023 snap 328 seq_num 1023) 2024-03-30T12:34:09.167 INFO:tasks.rados.rados.0.smithi084.stdout:3441: finishing rollback tid 1 to smithi08477944-8 2024-03-30T12:34:09.167 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 27398 (ObjNum 65 snap 0 seq_num 1532777301) dirty dne 2024-03-30T12:34:09.167 INFO:tasks.rados.rados.0.smithi084.stdout:3439: done (1 left) 2024-03-30T12:34:09.167 INFO:tasks.rados.rados.0.smithi084.stdout:3441: done (0 left) 2024-03-30T12:34:09.167 INFO:tasks.rados.rados.0.smithi084.stdout:3442: snap_remove snap 336 2024-03-30T12:34:09.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:34:09] "GET /metrics HTTP/1.1" 200 36332 "" "Prometheus/2.43.0" 2024-03-30T12:34:09.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:09.166+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:09.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:09.166+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:09.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:09.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:09.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 193=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:09.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:09.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:09.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:09.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:09.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:09.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:09.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:09.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[91810]: osdmap e752: 8 total, 8 up, 8 in 2024-03-30T12:34:09.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 193=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:09.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:09.158+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:09.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:09.158+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:09.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:09.158+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:09.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:09.158+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:09.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:09.158+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:09.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:09.159+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:09.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:09.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:09.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 193=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:09.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:09.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:09.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:09.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:09.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:09.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:09.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:09.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[89279]: osdmap e752: 8 total, 8 up, 8 in 2024-03-30T12:34:09.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 193=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:09.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:09.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:09.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:09.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:09.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[91810]: pgmap v819: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 13 op/s 2024-03-30T12:34:09.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:09.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:09.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:09.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:09.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:09 smithi084 ceph-mon[89279]: pgmap v819: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 13 op/s 2024-03-30T12:34:09.619 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:09.160+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 193=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:09.619 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:09.160+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:09.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:09.159+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:09.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:09.160+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:09.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:09.160+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:09.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:09.163+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:09.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:09.163+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:09.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:09.166+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 193=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:09.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:09 smithi162 ceph-mon[83709]: osdmap e752: 8 total, 8 up, 8 in 2024-03-30T12:34:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 193=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:09.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:09 smithi162 ceph-mon[83709]: pgmap v819: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 13 op/s 2024-03-30T12:34:10.161 INFO:tasks.rados.rados.0.smithi084.stdout:3442: done (0 left) 2024-03-30T12:34:10.161 INFO:tasks.rados.rados.0.smithi084.stdout:3443: setattr oid 47 current snap is 343 2024-03-30T12:34:10.161 INFO:tasks.rados.rados.0.smithi084.stdout:3444: rmattr oid 34 current snap is 343 2024-03-30T12:34:10.162 INFO:tasks.rados.rados.0.smithi084.stdout:3444: done (1 left) 2024-03-30T12:34:10.162 INFO:tasks.rados.rados.0.smithi084.stdout:3445: snap_remove snap 335 2024-03-30T12:34:10.506 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:10.176+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:10.506 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:10.176+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:10.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:10.167+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:10.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:10.168+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:10.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:10.168+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:10.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:10.168+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:10.507 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:10.168+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:10.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:10.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:10.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:10.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:10.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:10.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:10.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 193=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:10.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:10.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:10.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:10.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[91810]: osdmap e753: 8 total, 8 up, 8 in 2024-03-30T12:34:10.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:10.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:10.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:10.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:10.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:10.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:10.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:10.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:10.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:10.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:10.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 193=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:10.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:10.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:10.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:10.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[89279]: osdmap e753: 8 total, 8 up, 8 in 2024-03-30T12:34:10.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:10.509 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:10.510 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:10.510 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:10.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:10.169+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:10.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:10.169+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 193=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:10.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:10.170+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:10.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:10.180+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:10.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:10.180+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:10.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 193=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:10 smithi162 ceph-mon[83709]: osdmap e753: 8 total, 8 up, 8 in 2024-03-30T12:34:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:10.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:10.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:11.168 INFO:tasks.rados.rados.0.smithi084.stdout:3445: done (1 left) 2024-03-30T12:34:11.168 INFO:tasks.rados.rados.0.smithi084.stdout:3446: snap_remove snap 339 2024-03-30T12:34:11.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:11.173+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:11.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:11.209+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 193=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:11.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:11.209+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:11.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:11.180+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:11.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:11.180+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:11.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:11.180+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:11.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:11.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:11.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:11.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:11 smithi162 ceph-mon[83709]: osdmap e754: 8 total, 8 up, 8 in 2024-03-30T12:34:11.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:11.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:11.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 193=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:11.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:11.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:11.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:11.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:11.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:11.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:11 smithi162 ceph-mon[83709]: pgmap v822: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 259 KiB/s rd, 1.0 MiB/s wr, 19 op/s 2024-03-30T12:34:11.372 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:11.041+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:11.372 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:11.041+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:11.372 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:11.209+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:11.372 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:11.209+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:11.372 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:11.210+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:11.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:11.180+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:11.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:11.180+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:11.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:11.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:11.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:11.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[91810]: osdmap e754: 8 total, 8 up, 8 in 2024-03-30T12:34:11.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:11.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:11.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 193=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:11.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:11.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:11.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:11.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:11.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:11.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[91810]: pgmap v822: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 259 KiB/s rd, 1.0 MiB/s wr, 19 op/s 2024-03-30T12:34:11.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:11.172+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:11.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:11.172+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:11.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:11.173+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:11.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:11.173+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:11.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:11.173+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:11.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:11.173+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:11.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:11.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:11.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:11.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[89279]: osdmap e754: 8 total, 8 up, 8 in 2024-03-30T12:34:11.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:11.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:11.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 193=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:11.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:11.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:11.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:11.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:11.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:11.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:11 smithi084 ceph-mon[89279]: pgmap v822: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 259 KiB/s rd, 1.0 MiB/s wr, 19 op/s 2024-03-30T12:34:12.168 INFO:tasks.rados.rados.0.smithi084.stdout:3446: done (1 left) 2024-03-30T12:34:12.168 INFO:tasks.rados.rados.0.smithi084.stdout:3447: copy_from oid 25 from oid 30 current snap is 343 2024-03-30T12:34:12.168 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 27418 (ObjNum 1053 snap 337 seq_num 1053) dirty exists 2024-03-30T12:34:12.168 INFO:tasks.rados.rados.0.smithi084.stdout:3443: done (1 left) 2024-03-30T12:34:12.169 INFO:tasks.rados.rados.0.smithi084.stdout:3448: setattr oid 19 current snap is 343 2024-03-30T12:34:12.169 INFO:tasks.rados.rados.0.smithi084.stdout:3449: delete oid 12 current snap is 343 2024-03-30T12:34:12.176 INFO:tasks.rados.rados.0.smithi084.stdout:3447: finishing copy_from racing read to smithi08477944-25 2024-03-30T12:34:12.176 INFO:tasks.rados.rados.0.smithi084.stdout:3449: done (2 left) 2024-03-30T12:34:12.177 INFO:tasks.rados.rados.0.smithi084.stdout:3450: rollback oid 20 current snap is 343 2024-03-30T12:34:12.177 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 20 to 321 2024-03-30T12:34:12.177 INFO:tasks.rados.rados.0.smithi084.stdout:3451: read oid 14 snap -1 2024-03-30T12:34:12.177 INFO:tasks.rados.rados.0.smithi084.stdout:3451: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:34:12.177 INFO:tasks.rados.rados.0.smithi084.stdout:3452: snap_create 2024-03-30T12:34:12.178 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 36353 (ObjNum 912 snap 290 seq_num 912) dirty exists 2024-03-30T12:34:12.180 INFO:tasks.rados.rados.0.smithi084.stdout:3447: finishing copy_from to smithi08477944-25 2024-03-30T12:34:12.180 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 27299 (ObjNum 1023 snap 328 seq_num 1023) dirty exists 2024-03-30T12:34:12.181 INFO:tasks.rados.rados.0.smithi084.stdout:3451: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:34:12.184 INFO:tasks.rados.rados.0.smithi084.stdout:3450: finishing rollback tid 0 to smithi08477944-20 2024-03-30T12:34:12.185 INFO:tasks.rados.rados.0.smithi084.stdout:3450: finishing rollback tid 1 to smithi08477944-20 2024-03-30T12:34:12.185 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 27420 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-03-30T12:34:12.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:12.189+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:12.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:12.190+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:12.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:12.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:12.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:12.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:12.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:12.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:12.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:12.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[91810]: osdmap e755: 8 total, 8 up, 8 in 2024-03-30T12:34:12.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:12.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:12.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:12.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:12.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 193=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:12.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:12.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:12.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:12.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:12.173+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:12.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:12.174+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:12.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:12.174+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:12.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:12.174+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:12.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:12.174+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:12.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:12.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:12.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:12.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:12.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:12.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:12.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:12.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[89279]: osdmap e755: 8 total, 8 up, 8 in 2024-03-30T12:34:12.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:12.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:12.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:12.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:12.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 193=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:12.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:12.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:12.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:12.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:12.186+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:12.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:12.179+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:12.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:12.185+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:12.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:12.175+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 193=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:12.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:12.176+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:12.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:12.190+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:12.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:12.190+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:12.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:12.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:12.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:12.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:12.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:12.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:12.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:12.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:12 smithi162 ceph-mon[83709]: osdmap e755: 8 total, 8 up, 8 in 2024-03-30T12:34:12.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:12.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:12.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:12.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:12.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 193=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:12.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:12.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:12.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:13.186 INFO:tasks.rados.rados.0.smithi084.stdout:3447: done (4 left) 2024-03-30T12:34:13.186 INFO:tasks.rados.rados.0.smithi084.stdout:3448: done (3 left) 2024-03-30T12:34:13.187 INFO:tasks.rados.rados.0.smithi084.stdout:3450: done (2 left) 2024-03-30T12:34:13.187 INFO:tasks.rados.rados.0.smithi084.stdout:3451: done (1 left) 2024-03-30T12:34:13.187 INFO:tasks.rados.rados.0.smithi084.stdout:3452: done (0 left) 2024-03-30T12:34:13.187 INFO:tasks.rados.rados.0.smithi084.stdout:3453: read oid 6 snap -1 2024-03-30T12:34:13.187 INFO:tasks.rados.rados.0.smithi084.stdout:3453: expect (ObjNum 947 snap 301 seq_num 947) 2024-03-30T12:34:13.187 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 344 2024-03-30T12:34:13.187 INFO:tasks.rados.rados.0.smithi084.stdout:3454: seq_num 1062 ranges {1433600=589824,2023424=401408} 2024-03-30T12:34:13.197 INFO:tasks.rados.rados.0.smithi084.stdout:3454: writing smithi08477944-43 from 1433600 to 2023424 tid 1 2024-03-30T12:34:13.199 INFO:tasks.rados.rados.0.smithi084.stdout:3454: writing smithi08477944-43 from 2023424 to 2424832 tid 2 2024-03-30T12:34:13.199 INFO:tasks.rados.rados.0.smithi084.stdout:3455: read oid 10 snap -1 2024-03-30T12:34:13.200 INFO:tasks.rados.rados.0.smithi084.stdout:3455: expect (ObjNum 947 snap 301 seq_num 947) 2024-03-30T12:34:13.200 INFO:tasks.rados.rados.0.smithi084.stdout:3456: snap_create 2024-03-30T12:34:13.200 INFO:tasks.rados.rados.0.smithi084.stdout:3453: expect (ObjNum 947 snap 301 seq_num 947) 2024-03-30T12:34:13.239 INFO:tasks.rados.rados.0.smithi084.stdout:3454: finishing write tid 1 to smithi08477944-43 2024-03-30T12:34:13.240 INFO:tasks.rados.rados.0.smithi084.stdout:3454: finishing write tid 2 to smithi08477944-43 2024-03-30T12:34:13.240 INFO:tasks.rados.rados.0.smithi084.stdout:3454: finishing write tid 3 to smithi08477944-43 2024-03-30T12:34:13.240 INFO:tasks.rados.rados.0.smithi084.stdout:3455: expect (ObjNum 947 snap 301 seq_num 947) 2024-03-30T12:34:13.276 INFO:tasks.rados.rados.0.smithi084.stdout:3454: finishing write tid 4 to smithi08477944-43 2024-03-30T12:34:13.276 INFO:tasks.rados.rados.0.smithi084.stdout:3454: oid 43 updating version 0 to 36356 2024-03-30T12:34:13.276 INFO:tasks.rados.rados.0.smithi084.stdout:3454: oid 43 version 36356 is already newer than 36355 2024-03-30T12:34:13.277 INFO:tasks.rados.rados.0.smithi084.stdout:3454: oid 43 updating version 36356 to 36357 2024-03-30T12:34:13.277 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 36357 (ObjNum 1062 snap 344 seq_num 1062) dirty exists 2024-03-30T12:34:13.277 INFO:tasks.rados.rados.0.smithi084.stdout:3454: left oid 43 (ObjNum 1062 snap 344 seq_num 1062) 2024-03-30T12:34:13.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:13.214+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:13.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:13.215+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:13.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:13.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:13.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[91810]: osdmap e756: 8 total, 8 up, 8 in 2024-03-30T12:34:13.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:13.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:13.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 193=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:13.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:13.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:13.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:13.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:13.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:13.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:13.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:13.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:13.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[91810]: pgmap v825: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 626 KiB/s wr, 19 op/s 2024-03-30T12:34:13.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:13.362+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:13.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:13.362+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:13.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:13.363+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:13.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:13.363+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:13.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:13.363+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:13.506 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:13.364+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:13.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:13.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:13.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[89279]: osdmap e756: 8 total, 8 up, 8 in 2024-03-30T12:34:13.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:13.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:13.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 193=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:13.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:13.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:13.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:13.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:13.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:13.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:13.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:13.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:13.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:13 smithi084 ceph-mon[89279]: pgmap v825: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 626 KiB/s wr, 19 op/s 2024-03-30T12:34:13.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:13.221+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:13.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:13.193+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:13.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:13.193+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:13.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:13.189+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:13.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:13.189+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:13.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:13.189+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:13.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:13.364+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:13.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:13.364+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:13.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:13.364+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:13.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:13.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:13.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:13 smithi162 ceph-mon[83709]: osdmap e756: 8 total, 8 up, 8 in 2024-03-30T12:34:13.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:13.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:13.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 193=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:13.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:13.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:13.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:13.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:13.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:13.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:13.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:13.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:13.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:13 smithi162 ceph-mon[83709]: pgmap v825: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 626 KiB/s wr, 19 op/s 2024-03-30T12:34:14.192 INFO:tasks.rados.rados.0.smithi084.stdout:3453: done (3 left) 2024-03-30T12:34:14.192 INFO:tasks.rados.rados.0.smithi084.stdout:3454: done (2 left) 2024-03-30T12:34:14.192 INFO:tasks.rados.rados.0.smithi084.stdout:3455: done (1 left) 2024-03-30T12:34:14.192 INFO:tasks.rados.rados.0.smithi084.stdout:3456: done (0 left) 2024-03-30T12:34:14.192 INFO:tasks.rados.rados.0.smithi084.stdout:3457: setattr oid 34 current snap is 345 2024-03-30T12:34:14.192 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 345 2024-03-30T12:34:14.193 INFO:tasks.rados.rados.0.smithi084.stdout:3458: seq_num 1063 ranges {335872=606208,942080=401408} 2024-03-30T12:34:14.198 INFO:tasks.rados.rados.0.smithi084.stdout:3458: writing smithi08477944-25 from 335872 to 942080 tid 1 2024-03-30T12:34:14.201 INFO:tasks.rados.rados.0.smithi084.stdout:3458: writing smithi08477944-25 from 942080 to 1343488 tid 2 2024-03-30T12:34:14.201 INFO:tasks.rados.rados.0.smithi084.stdout:3459: delete oid 35 current snap is 345 2024-03-30T12:34:14.201 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 36293 (ObjNum 33 snap 0 seq_num 1430200056) dirty exists 2024-03-30T12:34:14.206 INFO:tasks.rados.rados.0.smithi084.stdout:3457: done (2 left) 2024-03-30T12:34:14.206 INFO:tasks.rados.rados.0.smithi084.stdout:3459: done (1 left) 2024-03-30T12:34:14.206 INFO:tasks.rados.rados.0.smithi084.stdout:3460: snap_remove snap 338 2024-03-30T12:34:14.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:14.213+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:14.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:14.214+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-mon[89279]: osdmap e757: 8 total, 8 up, 8 in 2024-03-30T12:34:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:14.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:14.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:14.198+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:14.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:14.198+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:14.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:14.198+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:14.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:14.198+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:14.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:14.198+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:14.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:14.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:14.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:14.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:14.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-mon[91810]: osdmap e757: 8 total, 8 up, 8 in 2024-03-30T12:34:14.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:14.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:14.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:14.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:14.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:14.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:14.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:14.622 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:14.195+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:14.622 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:14.215+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:14.623 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:14.215+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:14.623 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:14.213+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:14.623 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:14.213+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:14.623 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:14.199+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:14.623 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:14.200+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:14.624 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:14.624 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:14.624 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:14.624 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:14.624 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:14 smithi162 ceph-mon[83709]: osdmap e757: 8 total, 8 up, 8 in 2024-03-30T12:34:14.624 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:14.624 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:14.624 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:14.624 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:14.624 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:14.624 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:14.624 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:15.195 INFO:tasks.rados.rados.0.smithi084.stdout:3460: done (1 left) 2024-03-30T12:34:15.196 INFO:tasks.rados.rados.0.smithi084.stdout:3461: rollback oid 35 current snap is 345 2024-03-30T12:34:15.196 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 35 to 343 2024-03-30T12:34:15.196 INFO:tasks.rados.rados.0.smithi084.stdout:3458: finishing write tid 1 to smithi08477944-25 2024-03-30T12:34:15.196 INFO:tasks.rados.rados.0.smithi084.stdout:3458: finishing write tid 2 to smithi08477944-25 2024-03-30T12:34:15.196 INFO:tasks.rados.rados.0.smithi084.stdout:3458: finishing write tid 3 to smithi08477944-25 2024-03-30T12:34:15.196 INFO:tasks.rados.rados.0.smithi084.stdout:3458: finishing write tid 4 to smithi08477944-25 2024-03-30T12:34:15.196 INFO:tasks.rados.rados.0.smithi084.stdout:3458: oid 25 updating version 0 to 27300 2024-03-30T12:34:15.196 INFO:tasks.rados.rados.0.smithi084.stdout:3458: oid 25 updating version 27300 to 27302 2024-03-30T12:34:15.196 INFO:tasks.rados.rados.0.smithi084.stdout:3458: oid 25 version 27302 is already newer than 27301 2024-03-30T12:34:15.196 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 27302 (ObjNum 1063 snap 345 seq_num 1063) dirty exists 2024-03-30T12:34:15.196 INFO:tasks.rados.rados.0.smithi084.stdout:3458: left oid 25 (ObjNum 1063 snap 345 seq_num 1063) 2024-03-30T12:34:15.196 INFO:tasks.rados.rados.0.smithi084.stdout:3458: done (1 left) 2024-03-30T12:34:15.196 INFO:tasks.rados.rados.0.smithi084.stdout:3462: setattr oid 17 current snap is 345 2024-03-30T12:34:15.197 INFO:tasks.rados.rados.0.smithi084.stdout:3463: setattr oid 34 current snap is 345 2024-03-30T12:34:15.197 INFO:tasks.rados.rados.0.smithi084.stdout:3464: snap_create 2024-03-30T12:34:15.203 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 36294 (ObjNum 33 snap 0 seq_num 1429545720) dirty exists 2024-03-30T12:34:15.204 INFO:tasks.rados.rados.0.smithi084.stdout:3461: finishing rollback tid 1 to smithi08477944-35 2024-03-30T12:34:15.204 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 27399 (ObjNum 1055 snap 337 seq_num 1055) dirty exists 2024-03-30T12:34:15.205 INFO:tasks.rados.rados.0.smithi084.stdout:3461: finishing rollback tid 2 to smithi08477944-35 2024-03-30T12:34:15.205 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 23407 (ObjNum 1045 snap 334 seq_num 1045) dirty exists 2024-03-30T12:34:15.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:15.209+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:15.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:15.211+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:15.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:15.202+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:15.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:15.202+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:15.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:15.202+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:15.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:15.202+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:15.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:15.202+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:15.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:15.202+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:15.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:15.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:15.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:15.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[91810]: osdmap e758: 8 total, 8 up, 8 in 2024-03-30T12:34:15.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:15.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:15.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:15.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:15.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:15.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:15.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:15.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:15.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:15.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:15.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:15.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[89279]: osdmap e758: 8 total, 8 up, 8 in 2024-03-30T12:34:15.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:15.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:15.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:15.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:15.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:15.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:15.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:15.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:15.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:15.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:15.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:15.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:15.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:34:15.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[91810]: pgmap v828: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 1.1 MiB/s rd, 474 KiB/s wr, 16 op/s 2024-03-30T12:34:15.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:15.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:15.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:15.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:15.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:34:15.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:15 smithi084 ceph-mon[89279]: pgmap v828: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 1.1 MiB/s rd, 474 KiB/s wr, 16 op/s 2024-03-30T12:34:15.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:15.204+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:15.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:15.204+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:15.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:15.204+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:15.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:15.212+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:15.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:15.212+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:15.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:15.213+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:15.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:15.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:15.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:15.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-mon[83709]: osdmap e758: 8 total, 8 up, 8 in 2024-03-30T12:34:15.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:15.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:15.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:15.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:15.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:15.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:15.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:15.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:15.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:15.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:15.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:15.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:15.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:34:15.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-mon[83709]: pgmap v828: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 1.1 MiB/s rd, 474 KiB/s wr, 16 op/s 2024-03-30T12:34:16.119 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:15.665+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:16.119 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:15.665+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:16.119 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:15.665+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:16.196 INFO:tasks.rados.rados.0.smithi084.stdout:3461: done (3 left) 2024-03-30T12:34:16.196 INFO:tasks.rados.rados.0.smithi084.stdout:3462: done (2 left) 2024-03-30T12:34:16.196 INFO:tasks.rados.rados.0.smithi084.stdout:3463: done (1 left) 2024-03-30T12:34:16.196 INFO:tasks.rados.rados.0.smithi084.stdout:3464: done (0 left) 2024-03-30T12:34:16.197 INFO:tasks.rados.rados.0.smithi084.stdout:3465: snap_create 2024-03-30T12:34:16.501 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:16.208+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:16.501 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:16.209+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:16.501 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:16.209+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:16.501 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:16.209+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:16.502 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:16.502 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:16.502 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:16.502 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:16.502 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:16 smithi162 ceph-mon[83709]: osdmap e759: 8 total, 8 up, 8 in 2024-03-30T12:34:16.502 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:16.502 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:16.502 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:16.502 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:16.502 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:16.502 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:16.502 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:16.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:16.323+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:16.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:16.323+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:16.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:16.203+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:16.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:16.203+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:16.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:16.203+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:16.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:16.203+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:16.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:16.204+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:16.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:16.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:16.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:16.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:16.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-mon[91810]: osdmap e759: 8 total, 8 up, 8 in 2024-03-30T12:34:16.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:16.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:16.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:16.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:16.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:16.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:16.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:16.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:16.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:16.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:16.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:16.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-mon[89279]: osdmap e759: 8 total, 8 up, 8 in 2024-03-30T12:34:16.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:16.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:16.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:16.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:16.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:16.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:16.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:16.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:16.675+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:16.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:16.675+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:16.870 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:16.509+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:17.209 INFO:tasks.rados.rados.0.smithi084.stdout:3465: done (0 left) 2024-03-30T12:34:17.209 INFO:tasks.rados.rados.0.smithi084.stdout:3466: read oid 39 snap 346 2024-03-30T12:34:17.209 INFO:tasks.rados.rados.0.smithi084.stdout:3466: expect (ObjNum 1029 snap 332 seq_num 1029) 2024-03-30T12:34:17.209 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 347 2024-03-30T12:34:17.209 INFO:tasks.rados.rados.0.smithi084.stdout:3467: seq_num 1065 ranges {2375680=638976,3014656=401408} 2024-03-30T12:34:17.225 INFO:tasks.rados.rados.0.smithi084.stdout:3467: writing smithi08477944-38 from 2375680 to 3014656 tid 1 2024-03-30T12:34:17.228 INFO:tasks.rados.rados.0.smithi084.stdout:3467: writing smithi08477944-38 from 3014656 to 3416064 tid 2 2024-03-30T12:34:17.228 INFO:tasks.rados.rados.0.smithi084.stdout:3468: read oid 21 snap -1 2024-03-30T12:34:17.228 INFO:tasks.rados.rados.0.smithi084.stdout:3468: expect deleted 2024-03-30T12:34:17.228 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 28 current snap is 347 2024-03-30T12:34:17.228 INFO:tasks.rados.rados.0.smithi084.stdout:3469: seq_num 1066 ranges {638976=663552,1302528=401408} 2024-03-30T12:34:17.235 INFO:tasks.rados.rados.0.smithi084.stdout:3469: writing smithi08477944-28 from 638976 to 1302528 tid 1 2024-03-30T12:34:17.237 INFO:tasks.rados.rados.0.smithi084.stdout:3469: writing smithi08477944-28 from 1302528 to 1703936 tid 2 2024-03-30T12:34:17.238 INFO:tasks.rados.rados.0.smithi084.stdout:3470: snap_remove snap 344 2024-03-30T12:34:17.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:17.220+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:17.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:17.224+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:17.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:17.215+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:17.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:17.215+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:17.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:17.215+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:17.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:17.215+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:17.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:17.215+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:17.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:17.215+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:17.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:17.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:17.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:17.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:17.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:17.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[89279]: osdmap e760: 8 total, 8 up, 8 in 2024-03-30T12:34:17.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:17.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:17.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:17.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:17.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:17.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:17.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:17.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:17.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[89279]: pgmap v831: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 1.1 MiB/s rd, 82 KiB/s wr, 13 op/s 2024-03-30T12:34:17.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:17.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:17.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:17.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:17.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:17.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[91810]: osdmap e760: 8 total, 8 up, 8 in 2024-03-30T12:34:17.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:17.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:17.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:17.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:17.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:17.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:17.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:17.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:17.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:17 smithi084 ceph-mon[91810]: pgmap v831: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 1.1 MiB/s rd, 82 KiB/s wr, 13 op/s 2024-03-30T12:34:17.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:17.431+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:17.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:17.219+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:17.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:17.219+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:17.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:17.219+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:17.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:17.249+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:17.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:17.249+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:17.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:17.249+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:17.621 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:17.216+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:17.621 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:17.217+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:17.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:17.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:17.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:17.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:17.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:17.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:17 smithi162 ceph-mon[83709]: osdmap e760: 8 total, 8 up, 8 in 2024-03-30T12:34:17.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:17.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:17.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:17.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:17.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:17.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:17.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:17.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:17.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:17 smithi162 ceph-mon[83709]: pgmap v831: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 1.1 MiB/s rd, 82 KiB/s wr, 13 op/s 2024-03-30T12:34:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:3470: done (4 left) 2024-03-30T12:34:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:3471: read oid 29 snap 334 2024-03-30T12:34:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:3471: expect (ObjNum 946 snap 301 seq_num 946) 2024-03-30T12:34:18.219 INFO:tasks.rados.rados.0.smithi084.stdout:3472: delete oid 37 current snap is 347 2024-03-30T12:34:18.220 INFO:tasks.rados.rados.0.smithi084.stdout:3466: expect (ObjNum 1029 snap 332 seq_num 1029) 2024-03-30T12:34:18.236 INFO:tasks.rados.rados.0.smithi084.stdout:3467: finishing write tid 1 to smithi08477944-38 2024-03-30T12:34:18.236 INFO:tasks.rados.rados.0.smithi084.stdout:3467: finishing write tid 2 to smithi08477944-38 2024-03-30T12:34:18.237 INFO:tasks.rados.rados.0.smithi084.stdout:3467: finishing write tid 3 to smithi08477944-38 2024-03-30T12:34:18.237 INFO:tasks.rados.rados.0.smithi084.stdout:3467: finishing write tid 4 to smithi08477944-38 2024-03-30T12:34:18.237 INFO:tasks.rados.rados.0.smithi084.stdout:3467: oid 38 updating version 0 to 27302 2024-03-30T12:34:18.237 INFO:tasks.rados.rados.0.smithi084.stdout:3467: oid 38 updating version 27302 to 27304 2024-03-30T12:34:18.237 INFO:tasks.rados.rados.0.smithi084.stdout:3467: oid 38 version 27304 is already newer than 27303 2024-03-30T12:34:18.237 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 27304 (ObjNum 1065 snap 347 seq_num 1065) dirty exists 2024-03-30T12:34:18.237 INFO:tasks.rados.rados.0.smithi084.stdout:3467: left oid 38 (ObjNum 1065 snap 347 seq_num 1065) 2024-03-30T12:34:18.237 INFO:tasks.rados.rados.0.smithi084.stdout:3469: finishing write tid 1 to smithi08477944-28 2024-03-30T12:34:18.238 INFO:tasks.rados.rados.0.smithi084.stdout:3469: finishing write tid 2 to smithi08477944-28 2024-03-30T12:34:18.238 INFO:tasks.rados.rados.0.smithi084.stdout:3469: finishing write tid 3 to smithi08477944-28 2024-03-30T12:34:18.238 INFO:tasks.rados.rados.0.smithi084.stdout:3469: finishing write tid 4 to smithi08477944-28 2024-03-30T12:34:18.238 INFO:tasks.rados.rados.0.smithi084.stdout:3469: oid 28 updating version 0 to 36312 2024-03-30T12:34:18.238 INFO:tasks.rados.rados.0.smithi084.stdout:3469: oid 28 version 36312 is already newer than 36311 2024-03-30T12:34:18.238 INFO:tasks.rados.rados.0.smithi084.stdout:3469: oid 28 updating version 36312 to 36313 2024-03-30T12:34:18.238 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 36313 (ObjNum 1066 snap 347 seq_num 1066) dirty exists 2024-03-30T12:34:18.238 INFO:tasks.rados.rados.0.smithi084.stdout:3469: left oid 28 (ObjNum 1066 snap 347 seq_num 1066) 2024-03-30T12:34:18.239 INFO:tasks.rados.rados.0.smithi084.stdout:3466: done (5 left) 2024-03-30T12:34:18.239 INFO:tasks.rados.rados.0.smithi084.stdout:3467: done (4 left) 2024-03-30T12:34:18.239 INFO:tasks.rados.rados.0.smithi084.stdout:3468: done (3 left) 2024-03-30T12:34:18.239 INFO:tasks.rados.rados.0.smithi084.stdout:3469: done (2 left) 2024-03-30T12:34:18.239 INFO:tasks.rados.rados.0.smithi084.stdout:3472: done (1 left) 2024-03-30T12:34:18.239 INFO:tasks.rados.rados.0.smithi084.stdout:3473: read oid 31 snap 343 2024-03-30T12:34:18.239 INFO:tasks.rados.rados.0.smithi084.stdout:3473: expect (ObjNum 1007 snap 325 seq_num 1007) 2024-03-30T12:34:18.239 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 347 2024-03-30T12:34:18.239 INFO:tasks.rados.rados.0.smithi084.stdout:3474: seq_num 1068 ranges {638976=696320,1335296=401408} 2024-03-30T12:34:18.243 INFO:tasks.rados.rados.0.smithi084.stdout:3474: writing smithi08477944-11 from 638976 to 1335296 tid 1 2024-03-30T12:34:18.245 INFO:tasks.rados.rados.0.smithi084.stdout:3474: writing smithi08477944-11 from 1335296 to 1736704 tid 2 2024-03-30T12:34:18.245 INFO:tasks.rados.rados.0.smithi084.stdout:3475: snap_remove snap 337 2024-03-30T12:34:18.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:18.234+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:18.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:18.236+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:18.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:18.227+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:18.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:18.227+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:18.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:18.227+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:18.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:18.227+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:18.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:18.227+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:18.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:18.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:18.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:18.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:18.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:18.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:18.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:18.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[89279]: osdmap e761: 8 total, 8 up, 8 in 2024-03-30T12:34:18.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:18.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:18.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:18.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:18.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:18.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:18.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:18.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:18.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:18.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:18.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:18.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:18.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:18.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:18.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:18.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[91810]: osdmap e761: 8 total, 8 up, 8 in 2024-03-30T12:34:18.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:18.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:18.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:18.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:18.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:18.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:18.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:18.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:18.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:18.224+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:18.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:18.224+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:18.620 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:18.234+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:18.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:18.227+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:18.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:18.227+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:18.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:18.237+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:18.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:18.237+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:18.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:18.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:18.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:18.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:18.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:18.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:18.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:18.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:18 smithi162 ceph-mon[83709]: osdmap e761: 8 total, 8 up, 8 in 2024-03-30T12:34:18.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:18.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:18.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:18.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:18.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:18.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:18.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:18.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:19.223 INFO:tasks.rados.rados.0.smithi084.stdout:3475: done (3 left) 2024-03-30T12:34:19.223 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 347 2024-03-30T12:34:19.223 INFO:tasks.rados.rados.0.smithi084.stdout:3476: seq_num 1069 ranges {5038080=712704,5750784=401408} 2024-03-30T12:34:19.254 INFO:tasks.rados.rados.0.smithi084.stdout:3476: writing smithi08477944-3 from 5038080 to 5750784 tid 1 2024-03-30T12:34:19.256 INFO:tasks.rados.rados.0.smithi084.stdout:3476: writing smithi08477944-3 from 5750784 to 6152192 tid 2 2024-03-30T12:34:19.256 INFO:tasks.rados.rados.0.smithi084.stdout:3477: snap_remove snap 328 2024-03-30T12:34:19.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:34:19] "GET /metrics HTTP/1.1" 200 36327 "" "Prometheus/2.43.0" 2024-03-30T12:34:19.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:19.236+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:19.504 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:19.236+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:19.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:19.229+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:19.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:19.230+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:19.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:19.230+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:19.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:19.230+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:19.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:19.231+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:19.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:19.231+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:19.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:19.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:19.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[91810]: osdmap e762: 8 total, 8 up, 8 in 2024-03-30T12:34:19.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:19.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:19.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:19.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:19.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:19.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:19.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:19.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:19.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:19.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:19.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:19.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[91810]: pgmap v834: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 11 MiB/s rd, 756 KiB/s wr, 10 op/s 2024-03-30T12:34:19.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:19.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:19.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[89279]: osdmap e762: 8 total, 8 up, 8 in 2024-03-30T12:34:19.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:19.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:19.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:19.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:19.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:19.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:19.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:19.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:19.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:19.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:19.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:19.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:19 smithi084 ceph-mon[89279]: pgmap v834: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 11 MiB/s rd, 756 KiB/s wr, 10 op/s 2024-03-30T12:34:19.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:19.230+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:19.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:19.231+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:19.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:19.231+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:19.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:19.267+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:19.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:19.268+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:19.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:19.279+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:19.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:19.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:19.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:19 smithi162 ceph-mon[83709]: osdmap e762: 8 total, 8 up, 8 in 2024-03-30T12:34:19.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:19.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:19.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:19.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:19.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:19.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:19.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:19.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:19.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:19.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:19.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18c=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:19.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:19 smithi162 ceph-mon[83709]: pgmap v834: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 11 MiB/s rd, 756 KiB/s wr, 10 op/s 2024-03-30T12:34:20.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:19.656+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:20.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:19.657+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:20.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:19.657+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:20.224 INFO:tasks.rados.rados.0.smithi084.stdout:3477: done (4 left) 2024-03-30T12:34:20.225 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 347 2024-03-30T12:34:20.225 INFO:tasks.rados.rados.0.smithi084.stdout:3478: seq_num 1070 ranges {6070272=729088,6799360=401408} 2024-03-30T12:34:20.261 INFO:tasks.rados.rados.0.smithi084.stdout:3478: writing smithi08477944-1 from 6070272 to 6799360 tid 1 2024-03-30T12:34:20.264 INFO:tasks.rados.rados.0.smithi084.stdout:3478: writing smithi08477944-1 from 6799360 to 7200768 tid 2 2024-03-30T12:34:20.264 INFO:tasks.rados.rados.0.smithi084.stdout:3479: copy_from oid 5 from oid 8 current snap is 347 2024-03-30T12:34:20.264 INFO:tasks.rados.rados.0.smithi084.stdout:3474: finishing write tid 1 to smithi08477944-11 2024-03-30T12:34:20.264 INFO:tasks.rados.rados.0.smithi084.stdout:3474: finishing write tid 2 to smithi08477944-11 2024-03-30T12:34:20.265 INFO:tasks.rados.rados.0.smithi084.stdout:3474: finishing write tid 3 to smithi08477944-11 2024-03-30T12:34:20.265 INFO:tasks.rados.rados.0.smithi084.stdout:3471: expect (ObjNum 946 snap 301 seq_num 946) 2024-03-30T12:34:20.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:20.244+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:20.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:20.244+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-mon[91810]: osdmap e763: 8 total, 8 up, 8 in 2024-03-30T12:34:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:20.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:20.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:20.232+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:20.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:20.232+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:20.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:20.232+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:20.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:20.233+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:20.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:20.233+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:20.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:20.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:20.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:20.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:20.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:20.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-mon[89279]: osdmap e763: 8 total, 8 up, 8 in 2024-03-30T12:34:20.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:20.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:20.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:20.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:20.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:20.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:20.619 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:20.233+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:20.619 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:20.233+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:20.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:20.232+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:20.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:20.233+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:20.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:20.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:20.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:20.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:20.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:20.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:20 smithi162 ceph-mon[83709]: osdmap e763: 8 total, 8 up, 8 in 2024-03-30T12:34:20.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:20.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:20.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:20.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:20.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:20.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:20.622 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:20.237+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:20.622 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:20.237+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:20.829 INFO:tasks.rados.rados.0.smithi084.stdout:3474: finishing write tid 4 to smithi08477944-11 2024-03-30T12:34:20.829 INFO:tasks.rados.rados.0.smithi084.stdout:3474: oid 11 updating version 0 to 27304 2024-03-30T12:34:20.829 INFO:tasks.rados.rados.0.smithi084.stdout:3474: oid 11 updating version 27304 to 27305 2024-03-30T12:34:20.829 INFO:tasks.rados.rados.0.smithi084.stdout:3474: oid 11 version 27305 is already newer than 27303 2024-03-30T12:34:20.829 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 27305 (ObjNum 1068 snap 347 seq_num 1068) dirty exists 2024-03-30T12:34:20.829 INFO:tasks.rados.rados.0.smithi084.stdout:3474: left oid 11 (ObjNum 1068 snap 347 seq_num 1068) 2024-03-30T12:34:20.829 INFO:tasks.rados.rados.0.smithi084.stdout:3473: expect (ObjNum 1007 snap 325 seq_num 1007) 2024-03-30T12:34:21.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:20.702+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:21.172 INFO:tasks.rados.rados.0.smithi084.stdout:3476: finishing write tid 1 to smithi08477944-3 2024-03-30T12:34:21.172 INFO:tasks.rados.rados.0.smithi084.stdout:3476: finishing write tid 2 to smithi08477944-3 2024-03-30T12:34:21.172 INFO:tasks.rados.rados.0.smithi084.stdout:3471: done (5 left) 2024-03-30T12:34:21.172 INFO:tasks.rados.rados.0.smithi084.stdout:3473: done (4 left) 2024-03-30T12:34:21.172 INFO:tasks.rados.rados.0.smithi084.stdout:3474: done (3 left) 2024-03-30T12:34:21.172 INFO:tasks.rados.rados.0.smithi084.stdout:3480: rmattr oid 46 current snap is 347 2024-03-30T12:34:21.172 INFO:tasks.rados.rados.0.smithi084.stdout:3480: done (3 left) 2024-03-30T12:34:21.172 INFO:tasks.rados.rados.0.smithi084.stdout:3481: read oid 45 snap -1 2024-03-30T12:34:21.172 INFO:tasks.rados.rados.0.smithi084.stdout:3481: expect (ObjNum 955 snap 303 seq_num 955) 2024-03-30T12:34:21.173 INFO:tasks.rados.rados.0.smithi084.stdout:3482: read oid 35 snap -1 2024-03-30T12:34:21.173 INFO:tasks.rados.rados.0.smithi084.stdout:3482: expect (ObjNum 1045 snap 334 seq_num 1045) 2024-03-30T12:34:21.173 INFO:tasks.rados.rados.0.smithi084.stdout:3483: snap_remove snap 321 2024-03-30T12:34:21.242 INFO:tasks.rados.rados.0.smithi084.stdout:3483: done (5 left) 2024-03-30T12:34:21.243 INFO:tasks.rados.rados.0.smithi084.stdout:3484: rollback oid 18 current snap is 347 2024-03-30T12:34:21.243 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 18 to 341 2024-03-30T12:34:21.243 INFO:tasks.rados.rados.0.smithi084.stdout:3476: finishing write tid 3 to smithi08477944-3 2024-03-30T12:34:21.243 INFO:tasks.rados.rados.0.smithi084.stdout:3476: finishing write tid 4 to smithi08477944-3 2024-03-30T12:34:21.243 INFO:tasks.rados.rados.0.smithi084.stdout:3476: oid 3 updating version 0 to 27427 2024-03-30T12:34:21.243 INFO:tasks.rados.rados.0.smithi084.stdout:3476: oid 3 updating version 27427 to 27428 2024-03-30T12:34:21.243 INFO:tasks.rados.rados.0.smithi084.stdout:3476: oid 3 updating version 27428 to 27429 2024-03-30T12:34:21.243 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 27429 (ObjNum 1069 snap 347 seq_num 1069) dirty exists 2024-03-30T12:34:21.243 INFO:tasks.rados.rados.0.smithi084.stdout:3476: left oid 3 (ObjNum 1069 snap 347 seq_num 1069) 2024-03-30T12:34:21.243 INFO:tasks.rados.rados.0.smithi084.stdout:3479: finishing copy_from to smithi08477944-5 2024-03-30T12:34:21.243 INFO:tasks.rados.rados.0.smithi084.stdout:3479: got expected ENOENT (src dne) 2024-03-30T12:34:21.243 INFO:tasks.rados.rados.0.smithi084.stdout:3479: finishing copy_from racing read to smithi08477944-5 2024-03-30T12:34:21.243 INFO:tasks.rados.rados.0.smithi084.stdout:3478: finishing write tid 1 to smithi08477944-1 2024-03-30T12:34:21.244 INFO:tasks.rados.rados.0.smithi084.stdout:3476: done (5 left) 2024-03-30T12:34:21.244 INFO:tasks.rados.rados.0.smithi084.stdout:3479: done (4 left) 2024-03-30T12:34:21.244 INFO:tasks.rados.rados.0.smithi084.stdout:3485: copy_from oid 7 from oid 23 current snap is 347 2024-03-30T12:34:21.244 INFO:tasks.rados.rados.0.smithi084.stdout:3478: finishing write tid 2 to smithi08477944-1 2024-03-30T12:34:21.244 INFO:tasks.rados.rados.0.smithi084.stdout:3478: finishing write tid 3 to smithi08477944-1 2024-03-30T12:34:21.244 INFO:tasks.rados.rados.0.smithi084.stdout:3478: finishing write tid 4 to smithi08477944-1 2024-03-30T12:34:21.244 INFO:tasks.rados.rados.0.smithi084.stdout:3478: oid 1 updating version 0 to 23409 2024-03-30T12:34:21.244 INFO:tasks.rados.rados.0.smithi084.stdout:3478: oid 1 version 23409 is already newer than 23408 2024-03-30T12:34:21.244 INFO:tasks.rados.rados.0.smithi084.stdout:3478: oid 1 updating version 23409 to 23410 2024-03-30T12:34:21.244 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 23410 (ObjNum 1070 snap 347 seq_num 1070) dirty exists 2024-03-30T12:34:21.244 INFO:tasks.rados.rados.0.smithi084.stdout:3478: left oid 1 (ObjNum 1070 snap 347 seq_num 1070) 2024-03-30T12:34:21.244 INFO:tasks.rados.rados.0.smithi084.stdout:3478: done (4 left) 2024-03-30T12:34:21.244 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 33 current snap is 347 2024-03-30T12:34:21.245 INFO:tasks.rados.rados.0.smithi084.stdout:3486: seq_num 1071 ranges {0=745472,745472=401408} 2024-03-30T12:34:21.247 INFO:tasks.rados.rados.0.smithi084.stdout:3486: writing smithi08477944-33 from 0 to 745472 tid 1 2024-03-30T12:34:21.250 INFO:tasks.rados.rados.0.smithi084.stdout:3486: writing smithi08477944-33 from 745472 to 1146880 tid 2 2024-03-30T12:34:21.250 INFO:tasks.rados.rados.0.smithi084.stdout:3487: delete oid 3 current snap is 347 2024-03-30T12:34:21.250 INFO:tasks.rados.rados.0.smithi084.stdout:3481: expect (ObjNum 955 snap 303 seq_num 955) 2024-03-30T12:34:21.297 INFO:tasks.rados.rados.0.smithi084.stdout:3482: expect (ObjNum 1045 snap 334 seq_num 1045) 2024-03-30T12:34:21.381 INFO:tasks.rados.rados.0.smithi084.stdout:3484: finishing rollback tid 0 to smithi08477944-18 2024-03-30T12:34:21.381 INFO:tasks.rados.rados.0.smithi084.stdout:3484: finishing rollback tid 1 to smithi08477944-18 2024-03-30T12:34:21.381 INFO:tasks.rados.rados.0.smithi084.stdout:3484: finishing rollback tid 2 to smithi08477944-18 2024-03-30T12:34:21.381 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 27325 (ObjNum 825 snap 273 seq_num 825) dirty exists 2024-03-30T12:34:21.381 INFO:tasks.rados.rados.0.smithi084.stdout:3481: done (5 left) 2024-03-30T12:34:21.381 INFO:tasks.rados.rados.0.smithi084.stdout:3482: done (4 left) 2024-03-30T12:34:21.382 INFO:tasks.rados.rados.0.smithi084.stdout:3484: done (3 left) 2024-03-30T12:34:21.382 INFO:tasks.rados.rados.0.smithi084.stdout:3487: done (2 left) 2024-03-30T12:34:21.382 INFO:tasks.rados.rados.0.smithi084.stdout:3488: snap_create 2024-03-30T12:34:21.382 INFO:tasks.rados.rados.0.smithi084.stdout:3486: finishing write tid 1 to smithi08477944-33 2024-03-30T12:34:21.382 INFO:tasks.rados.rados.0.smithi084.stdout:3486: finishing write tid 2 to smithi08477944-33 2024-03-30T12:34:21.382 INFO:tasks.rados.rados.0.smithi084.stdout:3486: finishing write tid 3 to smithi08477944-33 2024-03-30T12:34:21.382 INFO:tasks.rados.rados.0.smithi084.stdout:3486: finishing write tid 4 to smithi08477944-33 2024-03-30T12:34:21.382 INFO:tasks.rados.rados.0.smithi084.stdout:3486: oid 33 updating version 0 to 27421 2024-03-30T12:34:21.382 INFO:tasks.rados.rados.0.smithi084.stdout:3486: oid 33 updating version 27421 to 27422 2024-03-30T12:34:21.382 INFO:tasks.rados.rados.0.smithi084.stdout:3486: oid 33 updating version 27422 to 27423 2024-03-30T12:34:21.382 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 27423 (ObjNum 1071 snap 347 seq_num 1071) dirty exists 2024-03-30T12:34:21.382 INFO:tasks.rados.rados.0.smithi084.stdout:3486: left oid 33 (ObjNum 1071 snap 347 seq_num 1071) 2024-03-30T12:34:21.382 INFO:tasks.rados.rados.0.smithi084.stdout:3485: finishing copy_from racing read to smithi08477944-7 2024-03-30T12:34:21.382 INFO:tasks.rados.rados.0.smithi084.stdout:3485: finishing copy_from to smithi08477944-7 2024-03-30T12:34:21.382 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 36288 (ObjNum 1033 snap 332 seq_num 1033) dirty exists 2024-03-30T12:34:21.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:21.251+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:21.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:21.251+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:21.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:21.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:21.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:21.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:21.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[89279]: osdmap e764: 8 total, 8 up, 8 in 2024-03-30T12:34:21.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:21.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:21.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:21.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:21.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:21.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:21.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:21.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:21.248+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:21.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:21.248+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:21.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:21.248+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:21.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:21.248+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:21.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:21.248+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:21.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:21.249+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:21.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:21.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:21.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:21.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:21.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[91810]: osdmap e764: 8 total, 8 up, 8 in 2024-03-30T12:34:21.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:21.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:21.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:21.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:21.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:21.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:21.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:21.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:21.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:21.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:21.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:21.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[89279]: pgmap v837: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 11 MiB/s rd, 1.5 MiB/s wr, 19 op/s 2024-03-30T12:34:21.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:21.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:21.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:21.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:21.508 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:21 smithi084 ceph-mon[91810]: pgmap v837: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 11 MiB/s rd, 1.5 MiB/s wr, 19 op/s 2024-03-30T12:34:21.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:21.356+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:21.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:21.248+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:21.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:21.248+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:21.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:21.249+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:21.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:21.257+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:21.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:21.257+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:21.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:21.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:21.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:21.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:21.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-mon[83709]: osdmap e764: 8 total, 8 up, 8 in 2024-03-30T12:34:21.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:21.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:21.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:21.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:21.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:21.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:21.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:21.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:21.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:21.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:21.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:21.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-mon[83709]: pgmap v837: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 11 MiB/s rd, 1.5 MiB/s wr, 19 op/s 2024-03-30T12:34:21.622 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:21.252+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:21.622 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:21.252+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:21.622 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:21.252+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:22.250 INFO:tasks.rados.rados.0.smithi084.stdout:3485: done (2 left) 2024-03-30T12:34:22.250 INFO:tasks.rados.rados.0.smithi084.stdout:3486: done (1 left) 2024-03-30T12:34:22.250 INFO:tasks.rados.rados.0.smithi084.stdout:3488: done (0 left) 2024-03-30T12:34:22.250 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 47 current snap is 348 2024-03-30T12:34:22.250 INFO:tasks.rados.rados.0.smithi084.stdout:3489: seq_num 1073 ranges {2498560=778240,3276800=401408} 2024-03-30T12:34:22.266 INFO:tasks.rados.rados.0.smithi084.stdout:3489: writing smithi08477944-47 from 2498560 to 3276800 tid 1 2024-03-30T12:34:22.269 INFO:tasks.rados.rados.0.smithi084.stdout:3489: writing smithi08477944-47 from 3276800 to 3678208 tid 2 2024-03-30T12:34:22.269 INFO:tasks.rados.rados.0.smithi084.stdout:3490: rmattr oid 41 current snap is 348 2024-03-30T12:34:22.269 INFO:tasks.rados.rados.0.smithi084.stdout:3490: done (1 left) 2024-03-30T12:34:22.269 INFO:tasks.rados.rados.0.smithi084.stdout:3491: rollback oid 26 current snap is 348 2024-03-30T12:34:22.269 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 26 to 345 2024-03-30T12:34:22.269 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 348 2024-03-30T12:34:22.269 INFO:tasks.rados.rados.0.smithi084.stdout:3492: seq_num 1074 ranges {0=794624,794624=401408} 2024-03-30T12:34:22.274 INFO:tasks.rados.rados.0.smithi084.stdout:3492: writing smithi08477944-40 from 0 to 794624 tid 1 2024-03-30T12:34:22.277 INFO:tasks.rados.rados.0.smithi084.stdout:3492: writing smithi08477944-40 from 794624 to 1196032 tid 2 2024-03-30T12:34:22.277 INFO:tasks.rados.rados.0.smithi084.stdout:3493: rollback oid 23 current snap is 348 2024-03-30T12:34:22.277 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 23 to 346 2024-03-30T12:34:22.277 INFO:tasks.rados.rados.0.smithi084.stdout:3489: finishing write tid 1 to smithi08477944-47 2024-03-30T12:34:22.277 INFO:tasks.rados.rados.0.smithi084.stdout:3494: snap_remove snap 342 2024-03-30T12:34:22.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:22.283+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:22.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:22.283+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:22.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:22.258+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:22.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:22.258+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:22.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:22.259+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:22.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:22.259+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:22.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:22.259+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:22.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[89279]: osdmap e765: 8 total, 8 up, 8 in 2024-03-30T12:34:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:22.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:22.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:22.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:22.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:22.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:22.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:22.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:22.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[91810]: osdmap e765: 8 total, 8 up, 8 in 2024-03-30T12:34:22.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:22.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:22.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:22.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:22.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:22.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:22.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:22.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:22.409+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:22.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:22.257+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:22.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:22.257+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:22.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:22.281+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:22.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:22.290+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:22.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:22.255+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:22.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:22.255+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:22.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 18a=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:22.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:22.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:22.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:22.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:22.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:22.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:22 smithi162 ceph-mon[83709]: osdmap e765: 8 total, 8 up, 8 in 2024-03-30T12:34:22.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:22.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:22.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:22.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:22.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:22.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:22.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:23.256 INFO:tasks.rados.rados.0.smithi084.stdout:3494: done (4 left) 2024-03-30T12:34:23.256 INFO:tasks.rados.rados.0.smithi084.stdout:3495: delete oid 25 current snap is 348 2024-03-30T12:34:23.257 INFO:tasks.rados.rados.0.smithi084.stdout:3489: finishing write tid 2 to smithi08477944-47 2024-03-30T12:34:23.257 INFO:tasks.rados.rados.0.smithi084.stdout:3489: finishing write tid 3 to smithi08477944-47 2024-03-30T12:34:23.257 INFO:tasks.rados.rados.0.smithi084.stdout:3492: finishing write tid 1 to smithi08477944-40 2024-03-30T12:34:23.257 INFO:tasks.rados.rados.0.smithi084.stdout:3489: finishing write tid 4 to smithi08477944-47 2024-03-30T12:34:23.257 INFO:tasks.rados.rados.0.smithi084.stdout:3489: oid 47 updating version 0 to 36291 2024-03-30T12:34:23.257 INFO:tasks.rados.rados.0.smithi084.stdout:3489: oid 47 version 36291 is already newer than 36290 2024-03-30T12:34:23.257 INFO:tasks.rados.rados.0.smithi084.stdout:3489: oid 47 version 36291 is already newer than 36289 2024-03-30T12:34:23.257 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 36291 (ObjNum 1073 snap 348 seq_num 1073) dirty exists 2024-03-30T12:34:23.257 INFO:tasks.rados.rados.0.smithi084.stdout:3489: left oid 47 (ObjNum 1073 snap 348 seq_num 1073) 2024-03-30T12:34:23.257 INFO:tasks.rados.rados.0.smithi084.stdout:3493: finishing rollback tid 0 to smithi08477944-23 2024-03-30T12:34:23.257 INFO:tasks.rados.rados.0.smithi084.stdout:3492: finishing write tid 2 to smithi08477944-40 2024-03-30T12:34:23.257 INFO:tasks.rados.rados.0.smithi084.stdout:3491: finishing rollback tid 0 to smithi08477944-26 2024-03-30T12:34:23.257 INFO:tasks.rados.rados.0.smithi084.stdout:3493: finishing rollback tid 1 to smithi08477944-23 2024-03-30T12:34:23.257 INFO:tasks.rados.rados.0.smithi084.stdout:3491: finishing rollback tid 1 to smithi08477944-26 2024-03-30T12:34:23.258 INFO:tasks.rados.rados.0.smithi084.stdout:3492: finishing write tid 3 to smithi08477944-40 2024-03-30T12:34:23.258 INFO:tasks.rados.rados.0.smithi084.stdout:3491: finishing rollback tid 2 to smithi08477944-26 2024-03-30T12:34:23.258 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 27434 (ObjNum 1058 snap 340 seq_num 1058) dirty exists 2024-03-30T12:34:23.258 INFO:tasks.rados.rados.0.smithi084.stdout:3493: finishing rollback tid 2 to smithi08477944-23 2024-03-30T12:34:23.258 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 36301 (ObjNum 1033 snap 332 seq_num 1033) dirty exists 2024-03-30T12:34:23.258 INFO:tasks.rados.rados.0.smithi084.stdout:3492: finishing write tid 4 to smithi08477944-40 2024-03-30T12:34:23.258 INFO:tasks.rados.rados.0.smithi084.stdout:3492: oid 40 updating version 0 to 36293 2024-03-30T12:34:23.258 INFO:tasks.rados.rados.0.smithi084.stdout:3492: oid 40 version 36293 is already newer than 36292 2024-03-30T12:34:23.258 INFO:tasks.rados.rados.0.smithi084.stdout:3492: oid 40 updating version 36293 to 36294 2024-03-30T12:34:23.258 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 36294 (ObjNum 1074 snap 348 seq_num 1074) dirty exists 2024-03-30T12:34:23.258 INFO:tasks.rados.rados.0.smithi084.stdout:3492: left oid 40 (ObjNum 1074 snap 348 seq_num 1074) 2024-03-30T12:34:23.259 INFO:tasks.rados.rados.0.smithi084.stdout:3489: done (4 left) 2024-03-30T12:34:23.259 INFO:tasks.rados.rados.0.smithi084.stdout:3491: done (3 left) 2024-03-30T12:34:23.259 INFO:tasks.rados.rados.0.smithi084.stdout:3492: done (2 left) 2024-03-30T12:34:23.259 INFO:tasks.rados.rados.0.smithi084.stdout:3493: done (1 left) 2024-03-30T12:34:23.259 INFO:tasks.rados.rados.0.smithi084.stdout:3495: done (0 left) 2024-03-30T12:34:23.259 INFO:tasks.rados.rados.0.smithi084.stdout:3496: read oid 6 snap 345 2024-03-30T12:34:23.260 INFO:tasks.rados.rados.0.smithi084.stdout:3496: expect (ObjNum 947 snap 301 seq_num 947) 2024-03-30T12:34:23.260 INFO:tasks.rados.rados.0.smithi084.stdout:3497: rollback oid 19 current snap is 348 2024-03-30T12:34:23.260 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 19 to 345 2024-03-30T12:34:23.260 INFO:tasks.rados.rados.0.smithi084.stdout:3498: delete oid 40 current snap is 348 2024-03-30T12:34:23.262 INFO:tasks.rados.rados.0.smithi084.stdout:3498: done (2 left) 2024-03-30T12:34:23.262 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 348 2024-03-30T12:34:23.262 INFO:tasks.rados.rados.0.smithi084.stdout:3499: seq_num 1077 ranges {4603904=442368,5046272=434176,5480448=368640} 2024-03-30T12:34:23.290 INFO:tasks.rados.rados.0.smithi084.stdout:3499: writing smithi08477944-32 from 4603904 to 5046272 tid 1 2024-03-30T12:34:23.292 INFO:tasks.rados.rados.0.smithi084.stdout:3499: writing smithi08477944-32 from 5046272 to 5480448 tid 2 2024-03-30T12:34:23.294 INFO:tasks.rados.rados.0.smithi084.stdout:3499: writing smithi08477944-32 from 5480448 to 5849088 tid 3 2024-03-30T12:34:23.295 INFO:tasks.rados.rados.0.smithi084.stdout:3500: snap_create 2024-03-30T12:34:23.295 INFO:tasks.rados.rados.0.smithi084.stdout:3497: finishing rollback tid 0 to smithi08477944-19 2024-03-30T12:34:23.295 INFO:tasks.rados.rados.0.smithi084.stdout:3497: finishing rollback tid 1 to smithi08477944-19 2024-03-30T12:34:23.295 INFO:tasks.rados.rados.0.smithi084.stdout:3496: expect (ObjNum 947 snap 301 seq_num 947) 2024-03-30T12:34:23.333 INFO:tasks.rados.rados.0.smithi084.stdout:3497: finishing rollback tid 2 to smithi08477944-19 2024-03-30T12:34:23.334 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 36361 (ObjNum 912 snap 290 seq_num 912) dirty exists 2024-03-30T12:34:23.334 INFO:tasks.rados.rados.0.smithi084.stdout:3499: finishing write tid 1 to smithi08477944-32 2024-03-30T12:34:23.334 INFO:tasks.rados.rados.0.smithi084.stdout:3499: finishing write tid 2 to smithi08477944-32 2024-03-30T12:34:23.334 INFO:tasks.rados.rados.0.smithi084.stdout:3499: finishing write tid 3 to smithi08477944-32 2024-03-30T12:34:23.334 INFO:tasks.rados.rados.0.smithi084.stdout:3499: finishing write tid 4 to smithi08477944-32 2024-03-30T12:34:23.334 INFO:tasks.rados.rados.0.smithi084.stdout:3499: finishing write tid 5 to smithi08477944-32 2024-03-30T12:34:23.334 INFO:tasks.rados.rados.0.smithi084.stdout:3499: oid 32 updating version 0 to 36304 2024-03-30T12:34:23.334 INFO:tasks.rados.rados.0.smithi084.stdout:3499: oid 32 version 36304 is already newer than 36302 2024-03-30T12:34:23.334 INFO:tasks.rados.rados.0.smithi084.stdout:3499: oid 32 updating version 36304 to 36305 2024-03-30T12:34:23.334 INFO:tasks.rados.rados.0.smithi084.stdout:3499: oid 32 version 36305 is already newer than 36303 2024-03-30T12:34:23.334 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 36305 (ObjNum 1077 snap 348 seq_num 1077) dirty exists 2024-03-30T12:34:23.334 INFO:tasks.rados.rados.0.smithi084.stdout:3499: left oid 32 (ObjNum 1077 snap 348 seq_num 1077) 2024-03-30T12:34:23.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:23.275+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:23.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:23.275+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[89279]: osdmap e766: 8 total, 8 up, 8 in 2024-03-30T12:34:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:23.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:23.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:23.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:23.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:23.263+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:23.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:23.263+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:23.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:23.264+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:23.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:23.264+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:23.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:23.264+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:23.505 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:23.264+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:23.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:23.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[89279]: pgmap v840: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 325 KiB/s rd, 786 KiB/s wr, 14 op/s 2024-03-30T12:34:23.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:23.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:23.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[91810]: osdmap e766: 8 total, 8 up, 8 in 2024-03-30T12:34:23.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:23.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:23.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:23.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:23.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:23.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:23.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:23.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:23.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:23.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:23.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:23.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:23 smithi084 ceph-mon[91810]: pgmap v840: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 325 KiB/s rd, 786 KiB/s wr, 14 op/s 2024-03-30T12:34:23.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:23.265+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:23.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:23.270+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:23.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:23.270+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:23.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:23.270+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:23.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:23.263+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:23.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:23.264+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:23.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:23.271+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:23.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:23.272+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:23.621 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:23.292+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:23.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:23.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:23.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:23 smithi162 ceph-mon[83709]: osdmap e766: 8 total, 8 up, 8 in 2024-03-30T12:34:23.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:23.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:23.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:23.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:23.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:23.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:23.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:23.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:23.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:23.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:23.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:23.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:23 smithi162 ceph-mon[83709]: pgmap v840: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.0 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 325 KiB/s rd, 786 KiB/s wr, 14 op/s 2024-03-30T12:34:24.264 INFO:tasks.rados.rados.0.smithi084.stdout:3496: done (3 left) 2024-03-30T12:34:24.264 INFO:tasks.rados.rados.0.smithi084.stdout:3497: done (2 left) 2024-03-30T12:34:24.264 INFO:tasks.rados.rados.0.smithi084.stdout:3499: done (1 left) 2024-03-30T12:34:24.264 INFO:tasks.rados.rados.0.smithi084.stdout:3500: done (0 left) 2024-03-30T12:34:24.264 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 42 current snap is 349 2024-03-30T12:34:24.264 INFO:tasks.rados.rados.0.smithi084.stdout:3501: seq_num 1078 ranges {0=458752,458752=720896,1179648=81920} 2024-03-30T12:34:24.266 INFO:tasks.rados.rados.0.smithi084.stdout:3501: writing smithi08477944-42 from 0 to 458752 tid 1 2024-03-30T12:34:24.271 INFO:tasks.rados.rados.0.smithi084.stdout:3501: writing smithi08477944-42 from 458752 to 1179648 tid 2 2024-03-30T12:34:24.271 INFO:tasks.rados.rados.0.smithi084.stdout:3501: writing smithi08477944-42 from 1179648 to 1261568 tid 3 2024-03-30T12:34:24.272 INFO:tasks.rados.rados.0.smithi084.stdout:3502: read oid 41 snap -1 2024-03-30T12:34:24.272 INFO:tasks.rados.rados.0.smithi084.stdout:3502: expect (ObjNum 1052 snap 337 seq_num 1052) 2024-03-30T12:34:24.272 INFO:tasks.rados.rados.0.smithi084.stdout:3503: snap_create 2024-03-30T12:34:24.272 INFO:tasks.rados.rados.0.smithi084.stdout:3501: finishing write tid 1 to smithi08477944-42 2024-03-30T12:34:24.277 INFO:tasks.rados.rados.0.smithi084.stdout:3501: finishing write tid 2 to smithi08477944-42 2024-03-30T12:34:24.277 INFO:tasks.rados.rados.0.smithi084.stdout:3501: finishing write tid 3 to smithi08477944-42 2024-03-30T12:34:24.278 INFO:tasks.rados.rados.0.smithi084.stdout:3502: expect (ObjNum 1052 snap 337 seq_num 1052) 2024-03-30T12:34:24.313 INFO:tasks.rados.rados.0.smithi084.stdout:3501: finishing write tid 4 to smithi08477944-42 2024-03-30T12:34:24.313 INFO:tasks.rados.rados.0.smithi084.stdout:3501: finishing write tid 5 to smithi08477944-42 2024-03-30T12:34:24.313 INFO:tasks.rados.rados.0.smithi084.stdout:3501: oid 42 updating version 0 to 27402 2024-03-30T12:34:24.313 INFO:tasks.rados.rados.0.smithi084.stdout:3501: oid 42 updating version 27402 to 27403 2024-03-30T12:34:24.313 INFO:tasks.rados.rados.0.smithi084.stdout:3501: oid 42 version 27403 is already newer than 27401 2024-03-30T12:34:24.313 INFO:tasks.rados.rados.0.smithi084.stdout:3501: oid 42 version 27403 is already newer than 27400 2024-03-30T12:34:24.313 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 27403 (ObjNum 1078 snap 349 seq_num 1078) dirty exists 2024-03-30T12:34:24.313 INFO:tasks.rados.rados.0.smithi084.stdout:3501: left oid 42 (ObjNum 1078 snap 349 seq_num 1078) 2024-03-30T12:34:24.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:24.272+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:24.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:24.273+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:24.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:24.271+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:24.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:24.272+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:24.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:24.272+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:24.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:24.272+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:24.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:24.272+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:24.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[91810]: osdmap e767: 8 total, 8 up, 8 in 2024-03-30T12:34:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:24.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:24.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:34:24.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:24.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:24.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:24.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:24.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:24.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:24.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[89279]: osdmap e767: 8 total, 8 up, 8 in 2024-03-30T12:34:24.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:24.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:24.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:24.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:24.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:24.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:24.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:24.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:24 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:34:24.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:24.279+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:24.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:24.276+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:24.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:24.276+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:24.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:24.285+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:24.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:24.285+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:24.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:24.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:24.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:24.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:24.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:24 smithi162 ceph-mon[83709]: osdmap e767: 8 total, 8 up, 8 in 2024-03-30T12:34:24.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:24.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:24.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:24.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:24.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:24.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:24.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:24.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:24 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:34:25.276 INFO:tasks.rados.rados.0.smithi084.stdout:3501: done (2 left) 2024-03-30T12:34:25.276 INFO:tasks.rados.rados.0.smithi084.stdout:3502: done (1 left) 2024-03-30T12:34:25.277 INFO:tasks.rados.rados.0.smithi084.stdout:3503: done (0 left) 2024-03-30T12:34:25.277 INFO:tasks.rados.rados.0.smithi084.stdout:3504: copy_from oid 39 from oid 30 current snap is 350 2024-03-30T12:34:25.277 INFO:tasks.rados.rados.0.smithi084.stdout:3505: read oid 40 snap -1 2024-03-30T12:34:25.277 INFO:tasks.rados.rados.0.smithi084.stdout:3505: expect deleted 2024-03-30T12:34:25.277 INFO:tasks.rados.rados.0.smithi084.stdout:3506: read oid 43 snap -1 2024-03-30T12:34:25.277 INFO:tasks.rados.rados.0.smithi084.stdout:3506: expect (ObjNum 1062 snap 344 seq_num 1062) 2024-03-30T12:34:25.277 INFO:tasks.rados.rados.0.smithi084.stdout:3507: delete oid 25 current snap is 350 2024-03-30T12:34:25.278 INFO:tasks.rados.rados.0.smithi084.stdout:3505: done (3 left) 2024-03-30T12:34:25.278 INFO:tasks.rados.rados.0.smithi084.stdout:3507: done (2 left) 2024-03-30T12:34:25.278 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 350 2024-03-30T12:34:25.279 INFO:tasks.rados.rados.0.smithi084.stdout:3508: seq_num 1080 ranges {8396800=491520,8888320=540672,9428992=262144} 2024-03-30T12:34:25.326 INFO:tasks.rados.rados.0.smithi084.stdout:3508: writing smithi08477944-13 from 8396800 to 8888320 tid 1 2024-03-30T12:34:25.329 INFO:tasks.rados.rados.0.smithi084.stdout:3508: writing smithi08477944-13 from 8888320 to 9428992 tid 2 2024-03-30T12:34:25.330 INFO:tasks.rados.rados.0.smithi084.stdout:3508: writing smithi08477944-13 from 9428992 to 9691136 tid 3 2024-03-30T12:34:25.330 INFO:tasks.rados.rados.0.smithi084.stdout:3509: setattr oid 5 current snap is 350 2024-03-30T12:34:25.331 INFO:tasks.rados.rados.0.smithi084.stdout:3504: finishing copy_from racing read to smithi08477944-39 2024-03-30T12:34:25.331 INFO:tasks.rados.rados.0.smithi084.stdout:3506: expect (ObjNum 1062 snap 344 seq_num 1062) 2024-03-30T12:34:25.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:25.299+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:25.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:25.282+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:25.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:25.282+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:25.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:25.283+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:25.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:25.281+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:25.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:25.282+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:25.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:25.065+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:25.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:25.065+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:25.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:25.289+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:25.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:25.289+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:25.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:25.289+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:25.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-mon[83709]: osdmap e768: 8 total, 8 up, 8 in 2024-03-30T12:34:25.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:25.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:25.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:25.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:25.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:25.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:25.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:25.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:25.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:25.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:25.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:25.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-mon[83709]: pgmap v843: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 8 op/s 2024-03-30T12:34:25.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:34:25.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:34:25.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:34:25.434 INFO:tasks.rados.rados.0.smithi084.stdout:3504: finishing copy_from to smithi08477944-39 2024-03-30T12:34:25.434 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 27299 (ObjNum 1023 snap 328 seq_num 1023) dirty exists 2024-03-30T12:34:25.434 INFO:tasks.rados.rados.0.smithi084.stdout:3508: finishing write tid 1 to smithi08477944-13 2024-03-30T12:34:25.434 INFO:tasks.rados.rados.0.smithi084.stdout:3508: finishing write tid 2 to smithi08477944-13 2024-03-30T12:34:25.434 INFO:tasks.rados.rados.0.smithi084.stdout:3508: finishing write tid 3 to smithi08477944-13 2024-03-30T12:34:25.434 INFO:tasks.rados.rados.0.smithi084.stdout:3508: finishing write tid 4 to smithi08477944-13 2024-03-30T12:34:25.434 INFO:tasks.rados.rados.0.smithi084.stdout:3508: finishing write tid 5 to smithi08477944-13 2024-03-30T12:34:25.435 INFO:tasks.rados.rados.0.smithi084.stdout:3508: oid 13 updating version 0 to 23433 2024-03-30T12:34:25.435 INFO:tasks.rados.rados.0.smithi084.stdout:3508: oid 13 updating version 23433 to 23434 2024-03-30T12:34:25.435 INFO:tasks.rados.rados.0.smithi084.stdout:3508: oid 13 updating version 23434 to 23436 2024-03-30T12:34:25.435 INFO:tasks.rados.rados.0.smithi084.stdout:3508: oid 13 version 23436 is already newer than 23435 2024-03-30T12:34:25.435 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 23436 (ObjNum 1080 snap 350 seq_num 1080) dirty exists 2024-03-30T12:34:25.435 INFO:tasks.rados.rados.0.smithi084.stdout:3508: left oid 13 (ObjNum 1080 snap 350 seq_num 1080) 2024-03-30T12:34:25.435 INFO:tasks.rados.rados.0.smithi084.stdout:3504: done (3 left) 2024-03-30T12:34:25.435 INFO:tasks.rados.rados.0.smithi084.stdout:3506: done (2 left) 2024-03-30T12:34:25.435 INFO:tasks.rados.rados.0.smithi084.stdout:3508: done (1 left) 2024-03-30T12:34:25.435 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 350 2024-03-30T12:34:25.435 INFO:tasks.rados.rados.0.smithi084.stdout:3510: seq_num 1081 ranges {942080=507904,1449984=425984,1875968=376832} 2024-03-30T12:34:25.441 INFO:tasks.rados.rados.0.smithi084.stdout:3510: writing smithi08477944-48 from 942080 to 1449984 tid 1 2024-03-30T12:34:25.444 INFO:tasks.rados.rados.0.smithi084.stdout:3510: writing smithi08477944-48 from 1449984 to 1875968 tid 2 2024-03-30T12:34:25.447 INFO:tasks.rados.rados.0.smithi084.stdout:3510: writing smithi08477944-48 from 1875968 to 2252800 tid 3 2024-03-30T12:34:25.447 INFO:tasks.rados.rados.0.smithi084.stdout:3511: read oid 47 snap -1 2024-03-30T12:34:25.447 INFO:tasks.rados.rados.0.smithi084.stdout:3511: expect (ObjNum 1073 snap 348 seq_num 1073) 2024-03-30T12:34:25.447 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 27307 (ObjNum 836 snap 273 seq_num 836) dirty exists 2024-03-30T12:34:25.447 INFO:tasks.rados.rados.0.smithi084.stdout:3510: finishing write tid 1 to smithi08477944-48 2024-03-30T12:34:25.447 INFO:tasks.rados.rados.0.smithi084.stdout:3510: finishing write tid 2 to smithi08477944-48 2024-03-30T12:34:25.447 INFO:tasks.rados.rados.0.smithi084.stdout:3509: done (2 left) 2024-03-30T12:34:25.447 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 350 2024-03-30T12:34:25.447 INFO:tasks.rados.rados.0.smithi084.stdout:3512: seq_num 1082 ranges {0=524288,524288=704512,1228800=98304} 2024-03-30T12:34:25.449 INFO:tasks.rados.rados.0.smithi084.stdout:3512: writing smithi08477944-24 from 0 to 524288 tid 1 2024-03-30T12:34:25.454 INFO:tasks.rados.rados.0.smithi084.stdout:3512: writing smithi08477944-24 from 524288 to 1228800 tid 2 2024-03-30T12:34:25.455 INFO:tasks.rados.rados.0.smithi084.stdout:3512: writing smithi08477944-24 from 1228800 to 1327104 tid 3 2024-03-30T12:34:25.455 INFO:tasks.rados.rados.0.smithi084.stdout:3513: rmattr oid 1 current snap is 350 2024-03-30T12:34:25.455 INFO:tasks.rados.rados.0.smithi084.stdout:3513: done (3 left) 2024-03-30T12:34:25.455 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 46 current snap is 350 2024-03-30T12:34:25.455 INFO:tasks.rados.rados.0.smithi084.stdout:3510: finishing write tid 3 to smithi08477944-48 2024-03-30T12:34:25.455 INFO:tasks.rados.rados.0.smithi084.stdout:3510: finishing write tid 4 to smithi08477944-48 2024-03-30T12:34:25.455 INFO:tasks.rados.rados.0.smithi084.stdout:3510: finishing write tid 5 to smithi08477944-48 2024-03-30T12:34:25.456 INFO:tasks.rados.rados.0.smithi084.stdout:3510: oid 48 updating version 0 to 23431 2024-03-30T12:34:25.456 INFO:tasks.rados.rados.0.smithi084.stdout:3510: oid 48 updating version 23431 to 23432 2024-03-30T12:34:25.456 INFO:tasks.rados.rados.0.smithi084.stdout:3510: oid 48 version 23432 is already newer than 23430 2024-03-30T12:34:25.456 INFO:tasks.rados.rados.0.smithi084.stdout:3510: oid 48 updating version 23432 to 23433 2024-03-30T12:34:25.456 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 23433 (ObjNum 1081 snap 350 seq_num 1081) dirty exists 2024-03-30T12:34:25.456 INFO:tasks.rados.rados.0.smithi084.stdout:3510: left oid 48 (ObjNum 1081 snap 350 seq_num 1081) 2024-03-30T12:34:25.456 INFO:tasks.rados.rados.0.smithi084.stdout:3514: seq_num 1083 ranges {0=540672,540672=589824,1130496=212992} 2024-03-30T12:34:25.458 INFO:tasks.rados.rados.0.smithi084.stdout:3514: writing smithi08477944-46 from 0 to 540672 tid 1 2024-03-30T12:34:25.461 INFO:tasks.rados.rados.0.smithi084.stdout:3514: writing smithi08477944-46 from 540672 to 1130496 tid 2 2024-03-30T12:34:25.463 INFO:tasks.rados.rados.0.smithi084.stdout:3514: writing smithi08477944-46 from 1130496 to 1343488 tid 3 2024-03-30T12:34:25.463 INFO:tasks.rados.rados.0.smithi084.stdout:3510: done (3 left) 2024-03-30T12:34:25.463 INFO:tasks.rados.rados.0.smithi084.stdout:3515: delete oid 21 current snap is 350 2024-03-30T12:34:25.463 INFO:tasks.rados.rados.0.smithi084.stdout:3512: finishing write tid 1 to smithi08477944-24 2024-03-30T12:34:25.463 INFO:tasks.rados.rados.0.smithi084.stdout:3511: expect (ObjNum 1073 snap 348 seq_num 1073) 2024-03-30T12:34:25.647 INFO:tasks.rados.rados.0.smithi084.stdout:3512: finishing write tid 2 to smithi08477944-24 2024-03-30T12:34:25.647 INFO:tasks.rados.rados.0.smithi084.stdout:3512: finishing write tid 3 to smithi08477944-24 2024-03-30T12:34:25.647 INFO:tasks.rados.rados.0.smithi084.stdout:3512: finishing write tid 4 to smithi08477944-24 2024-03-30T12:34:25.647 INFO:tasks.rados.rados.0.smithi084.stdout:3512: finishing write tid 5 to smithi08477944-24 2024-03-30T12:34:25.647 INFO:tasks.rados.rados.0.smithi084.stdout:3512: oid 24 updating version 0 to 23437 2024-03-30T12:34:25.647 INFO:tasks.rados.rados.0.smithi084.stdout:3512: oid 24 updating version 23437 to 23439 2024-03-30T12:34:25.647 INFO:tasks.rados.rados.0.smithi084.stdout:3512: oid 24 updating version 23439 to 23440 2024-03-30T12:34:25.647 INFO:tasks.rados.rados.0.smithi084.stdout:3512: oid 24 version 23440 is already newer than 23438 2024-03-30T12:34:25.647 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 23440 (ObjNum 1082 snap 350 seq_num 1082) dirty exists 2024-03-30T12:34:25.647 INFO:tasks.rados.rados.0.smithi084.stdout:3512: left oid 24 (ObjNum 1082 snap 350 seq_num 1082) 2024-03-30T12:34:25.648 INFO:tasks.rados.rados.0.smithi084.stdout:3514: finishing write tid 1 to smithi08477944-46 2024-03-30T12:34:25.648 INFO:tasks.rados.rados.0.smithi084.stdout:3514: finishing write tid 2 to smithi08477944-46 2024-03-30T12:34:25.648 INFO:tasks.rados.rados.0.smithi084.stdout:3514: finishing write tid 3 to smithi08477944-46 2024-03-30T12:34:25.648 INFO:tasks.rados.rados.0.smithi084.stdout:3514: finishing write tid 4 to smithi08477944-46 2024-03-30T12:34:25.648 INFO:tasks.rados.rados.0.smithi084.stdout:3514: finishing write tid 5 to smithi08477944-46 2024-03-30T12:34:25.648 INFO:tasks.rados.rados.0.smithi084.stdout:3514: oid 46 updating version 0 to 27436 2024-03-30T12:34:25.648 INFO:tasks.rados.rados.0.smithi084.stdout:3514: oid 46 updating version 27436 to 27437 2024-03-30T12:34:25.648 INFO:tasks.rados.rados.0.smithi084.stdout:3514: oid 46 version 27437 is already newer than 27435 2024-03-30T12:34:25.648 INFO:tasks.rados.rados.0.smithi084.stdout:3514: oid 46 updating version 27437 to 27438 2024-03-30T12:34:25.648 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 27438 (ObjNum 1083 snap 350 seq_num 1083) dirty exists 2024-03-30T12:34:25.648 INFO:tasks.rados.rados.0.smithi084.stdout:3514: left oid 46 (ObjNum 1083 snap 350 seq_num 1083) 2024-03-30T12:34:25.648 INFO:tasks.rados.rados.0.smithi084.stdout:3511: done (3 left) 2024-03-30T12:34:25.648 INFO:tasks.rados.rados.0.smithi084.stdout:3512: done (2 left) 2024-03-30T12:34:25.649 INFO:tasks.rados.rados.0.smithi084.stdout:3514: done (1 left) 2024-03-30T12:34:25.649 INFO:tasks.rados.rados.0.smithi084.stdout:3515: done (0 left) 2024-03-30T12:34:25.649 INFO:tasks.rados.rados.0.smithi084.stdout:3516: snap_remove snap 347 2024-03-30T12:34:25.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:25.289+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:25.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:25.290+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:25.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[89279]: osdmap e768: 8 total, 8 up, 8 in 2024-03-30T12:34:25.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:25.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:25.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:25.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:25.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:25.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:25.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:25.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:25.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:25.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:25.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:25.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[89279]: pgmap v843: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 8 op/s 2024-03-30T12:34:25.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:34:25.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:34:25.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:34:25.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:25.284+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:25.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:25.284+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:25.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:25.284+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:25.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:25.284+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:25.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:25.284+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:25.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:25.284+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:25.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[91810]: osdmap e768: 8 total, 8 up, 8 in 2024-03-30T12:34:25.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:25.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:25.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:25.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:25.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:25.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:25.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:25.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:25.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:25.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:25.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:25.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[91810]: pgmap v843: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 8 op/s 2024-03-30T12:34:25.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:34:25.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:34:25.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:34:26.277 INFO:tasks.rados.rados.0.smithi084.stdout:3516: done (0 left) 2024-03-30T12:34:26.277 INFO:tasks.rados.rados.0.smithi084.stdout:3517: rmattr oid 40 current snap is 350 2024-03-30T12:34:26.278 INFO:tasks.rados.rados.0.smithi084.stdout:3517: done (0 left) 2024-03-30T12:34:26.278 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 350 2024-03-30T12:34:26.278 INFO:tasks.rados.rados.0.smithi084.stdout:3518: seq_num 1085 ranges {1466368=581632,2048000=761856,2809856=40960} 2024-03-30T12:34:26.288 INFO:tasks.rados.rados.0.smithi084.stdout:3518: writing smithi08477944-6 from 1466368 to 2048000 tid 1 2024-03-30T12:34:26.292 INFO:tasks.rados.rados.0.smithi084.stdout:3518: writing smithi08477944-6 from 2048000 to 2809856 tid 2 2024-03-30T12:34:26.293 INFO:tasks.rados.rados.0.smithi084.stdout:3518: writing smithi08477944-6 from 2809856 to 2850816 tid 3 2024-03-30T12:34:26.293 INFO:tasks.rados.rados.0.smithi084.stdout:3519: rollback oid 28 current snap is 350 2024-03-30T12:34:26.293 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 28 to 345 2024-03-30T12:34:26.294 INFO:tasks.rados.rados.0.smithi084.stdout:3520: copy_from oid 50 from oid 35 current snap is 350 2024-03-30T12:34:26.294 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 27 current snap is 350 2024-03-30T12:34:26.294 INFO:tasks.rados.rados.0.smithi084.stdout:3521: seq_num 1086 ranges {458752=598016,1056768=647168,1703936=155648} 2024-03-30T12:34:26.300 INFO:tasks.rados.rados.0.smithi084.stdout:3521: writing smithi08477944-27 from 458752 to 1056768 tid 1 2024-03-30T12:34:26.304 INFO:tasks.rados.rados.0.smithi084.stdout:3521: writing smithi08477944-27 from 1056768 to 1703936 tid 2 2024-03-30T12:34:26.305 INFO:tasks.rados.rados.0.smithi084.stdout:3521: writing smithi08477944-27 from 1703936 to 1859584 tid 3 2024-03-30T12:34:26.305 INFO:tasks.rados.rados.0.smithi084.stdout:3522: delete oid 8 current snap is 350 2024-03-30T12:34:26.305 INFO:tasks.rados.rados.0.smithi084.stdout:3519: finishing rollback tid 0 to smithi08477944-28 2024-03-30T12:34:26.305 INFO:tasks.rados.rados.0.smithi084.stdout:3518: finishing write tid 1 to smithi08477944-6 2024-03-30T12:34:26.305 INFO:tasks.rados.rados.0.smithi084.stdout:3519: finishing rollback tid 1 to smithi08477944-28 2024-03-30T12:34:26.305 INFO:tasks.rados.rados.0.smithi084.stdout:3519: finishing rollback tid 2 to smithi08477944-28 2024-03-30T12:34:26.305 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 36316 (ObjNum 883 snap 282 seq_num 883) dirty exists 2024-03-30T12:34:26.309 INFO:tasks.rados.rados.0.smithi084.stdout:3520: finishing copy_from racing read to smithi08477944-50 2024-03-30T12:34:26.309 INFO:tasks.rados.rados.0.smithi084.stdout:3521: finishing write tid 1 to smithi08477944-27 2024-03-30T12:34:26.310 INFO:tasks.rados.rados.0.smithi084.stdout:3518: finishing write tid 2 to smithi08477944-6 2024-03-30T12:34:26.310 INFO:tasks.rados.rados.0.smithi084.stdout:3518: finishing write tid 3 to smithi08477944-6 2024-03-30T12:34:26.312 INFO:tasks.rados.rados.0.smithi084.stdout:3519: done (4 left) 2024-03-30T12:34:26.312 INFO:tasks.rados.rados.0.smithi084.stdout:3522: done (3 left) 2024-03-30T12:34:26.313 INFO:tasks.rados.rados.0.smithi084.stdout:3523: copy_from oid 22 from oid 4 current snap is 350 2024-03-30T12:34:26.313 INFO:tasks.rados.rados.0.smithi084.stdout:3524: snap_create 2024-03-30T12:34:26.313 INFO:tasks.rados.rados.0.smithi084.stdout:3520: finishing copy_from to smithi08477944-50 2024-03-30T12:34:26.313 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 23407 (ObjNum 1045 snap 334 seq_num 1045) dirty exists 2024-03-30T12:34:26.313 INFO:tasks.rados.rados.0.smithi084.stdout:3521: finishing write tid 2 to smithi08477944-27 2024-03-30T12:34:26.314 INFO:tasks.rados.rados.0.smithi084.stdout:3518: finishing write tid 4 to smithi08477944-6 2024-03-30T12:34:26.315 INFO:tasks.rados.rados.0.smithi084.stdout:3521: finishing write tid 3 to smithi08477944-27 2024-03-30T12:34:26.318 INFO:tasks.rados.rados.0.smithi084.stdout:3518: finishing write tid 5 to smithi08477944-6 2024-03-30T12:34:26.318 INFO:tasks.rados.rados.0.smithi084.stdout:3518: oid 6 updating version 0 to 36365 2024-03-30T12:34:26.318 INFO:tasks.rados.rados.0.smithi084.stdout:3518: oid 6 updating version 36365 to 36366 2024-03-30T12:34:26.318 INFO:tasks.rados.rados.0.smithi084.stdout:3518: oid 6 version 36366 is already newer than 36363 2024-03-30T12:34:26.318 INFO:tasks.rados.rados.0.smithi084.stdout:3518: oid 6 version 36366 is already newer than 36364 2024-03-30T12:34:26.318 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 36366 (ObjNum 1085 snap 350 seq_num 1085) dirty exists 2024-03-30T12:34:26.318 INFO:tasks.rados.rados.0.smithi084.stdout:3518: left oid 6 (ObjNum 1085 snap 350 seq_num 1085) 2024-03-30T12:34:26.318 INFO:tasks.rados.rados.0.smithi084.stdout:3521: finishing write tid 4 to smithi08477944-27 2024-03-30T12:34:26.322 INFO:tasks.rados.rados.0.smithi084.stdout:3521: finishing write tid 5 to smithi08477944-27 2024-03-30T12:34:26.322 INFO:tasks.rados.rados.0.smithi084.stdout:3521: oid 27 updating version 0 to 36296 2024-03-30T12:34:26.322 INFO:tasks.rados.rados.0.smithi084.stdout:3521: oid 27 version 36296 is already newer than 36295 2024-03-30T12:34:26.322 INFO:tasks.rados.rados.0.smithi084.stdout:3521: oid 27 updating version 36296 to 36298 2024-03-30T12:34:26.322 INFO:tasks.rados.rados.0.smithi084.stdout:3521: oid 27 version 36298 is already newer than 36297 2024-03-30T12:34:26.322 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 36298 (ObjNum 1086 snap 350 seq_num 1086) dirty exists 2024-03-30T12:34:26.322 INFO:tasks.rados.rados.0.smithi084.stdout:3521: left oid 27 (ObjNum 1086 snap 350 seq_num 1086) 2024-03-30T12:34:26.324 INFO:tasks.rados.rados.0.smithi084.stdout:3523: finishing copy_from racing read to smithi08477944-22 2024-03-30T12:34:26.324 INFO:tasks.rados.rados.0.smithi084.stdout:3523: finishing copy_from to smithi08477944-22 2024-03-30T12:34:26.324 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 36306 (ObjNum 1019 snap 327 seq_num 1019) dirty exists 2024-03-30T12:34:26.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:26.315+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:26.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:26.286+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:26.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:26.287+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:26.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:26.287+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:26.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:26.287+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:26.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:26.307+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:26.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:26.307+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:26.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:26.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:26.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:26.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:26.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:26.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:26.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:26.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:26.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:26.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:26.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:26 smithi162 ceph-mon[83709]: osdmap e769: 8 total, 8 up, 8 in 2024-03-30T12:34:26.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:26.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:26.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:26.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:26.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:26.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:26.309+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:26.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:26.309+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:26.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:26.286+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:26.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:26.286+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:26.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:26.286+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:26.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:26.286+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:26.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:26.287+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:26.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:26.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:26.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:26.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:26.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:26.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:26.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:26.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:26.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:26.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:26.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[91810]: osdmap e769: 8 total, 8 up, 8 in 2024-03-30T12:34:26.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:26.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:26.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:26.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:26.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 192=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:26.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:26.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:26.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:26.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:26.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:26.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:26.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[89279]: osdmap e769: 8 total, 8 up, 8 in 2024-03-30T12:34:26.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:26.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:26.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:26.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:26.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:26.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 185=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:26.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:26.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:26.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:27.287 INFO:tasks.rados.rados.0.smithi084.stdout:3518: done (4 left) 2024-03-30T12:34:27.287 INFO:tasks.rados.rados.0.smithi084.stdout:3520: done (3 left) 2024-03-30T12:34:27.287 INFO:tasks.rados.rados.0.smithi084.stdout:3521: done (2 left) 2024-03-30T12:34:27.287 INFO:tasks.rados.rados.0.smithi084.stdout:3523: done (1 left) 2024-03-30T12:34:27.287 INFO:tasks.rados.rados.0.smithi084.stdout:3524: done (0 left) 2024-03-30T12:34:27.287 INFO:tasks.rados.rados.0.smithi084.stdout:3525: rollback oid 35 current snap is 351 2024-03-30T12:34:27.287 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 35 to 349 2024-03-30T12:34:27.287 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 351 2024-03-30T12:34:27.287 INFO:tasks.rados.rados.0.smithi084.stdout:3526: seq_num 1088 ranges {1605632=630784,2236416=466944,2703360=335872} 2024-03-30T12:34:27.299 INFO:tasks.rados.rados.0.smithi084.stdout:3526: writing smithi08477944-45 from 1605632 to 2236416 tid 1 2024-03-30T12:34:27.301 INFO:tasks.rados.rados.0.smithi084.stdout:3526: writing smithi08477944-45 from 2236416 to 2703360 tid 2 2024-03-30T12:34:27.303 INFO:tasks.rados.rados.0.smithi084.stdout:3526: writing smithi08477944-45 from 2703360 to 3039232 tid 3 2024-03-30T12:34:27.304 INFO:tasks.rados.rados.0.smithi084.stdout:3527: snap_remove snap 345 2024-03-30T12:34:27.619 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:27.295+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:27.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:27.296+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:27.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:27.296+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:27.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:27.296+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:27.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:27.296+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:27.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:27.312+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:27.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:27.313+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:27.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:27.313+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:27.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:27 smithi162 ceph-mon[83709]: osdmap e770: 8 total, 8 up, 8 in 2024-03-30T12:34:27.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:27.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:27.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:27.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:27.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:27.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:27.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:27.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:27.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:27.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:27.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:27.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:27.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:27.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:27 smithi162 ceph-mon[83709]: pgmap v846: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 2.8 MiB/s rd, 3.9 MiB/s wr, 12 op/s 2024-03-30T12:34:27.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:27.302+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:27.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:27.302+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:27.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[91810]: osdmap e770: 8 total, 8 up, 8 in 2024-03-30T12:34:27.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:27.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:27.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:27.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:27.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:27.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:27.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:27.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:27.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:27.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:27.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:27.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:27.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:27.293+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:27.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:27.293+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:27.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:27.293+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:27.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:27.293+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:27.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:27.293+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:27.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:27.294+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:27.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:27.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[91810]: pgmap v846: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 2.8 MiB/s rd, 3.9 MiB/s wr, 12 op/s 2024-03-30T12:34:27.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[89279]: osdmap e770: 8 total, 8 up, 8 in 2024-03-30T12:34:27.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:27.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:27.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:27.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:27.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 186=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:27.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:27.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:27.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:27.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:27.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:27.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:27.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:27.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:27.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:27 smithi084 ceph-mon[89279]: pgmap v846: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 2.8 MiB/s rd, 3.9 MiB/s wr, 12 op/s 2024-03-30T12:34:28.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:27.776+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:28.293 INFO:tasks.rados.rados.0.smithi084.stdout:3527: done (2 left) 2024-03-30T12:34:28.293 INFO:tasks.rados.rados.0.smithi084.stdout:3528: snap_create 2024-03-30T12:34:28.293 INFO:tasks.rados.rados.0.smithi084.stdout:3525: finishing rollback tid 0 to smithi08477944-35 2024-03-30T12:34:28.293 INFO:tasks.rados.rados.0.smithi084.stdout:3525: finishing rollback tid 1 to smithi08477944-35 2024-03-30T12:34:28.294 INFO:tasks.rados.rados.0.smithi084.stdout:3525: finishing rollback tid 2 to smithi08477944-35 2024-03-30T12:34:28.294 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 23413 (ObjNum 1045 snap 334 seq_num 1045) dirty exists 2024-03-30T12:34:28.294 INFO:tasks.rados.rados.0.smithi084.stdout:3526: finishing write tid 1 to smithi08477944-45 2024-03-30T12:34:28.294 INFO:tasks.rados.rados.0.smithi084.stdout:3526: finishing write tid 2 to smithi08477944-45 2024-03-30T12:34:28.294 INFO:tasks.rados.rados.0.smithi084.stdout:3526: finishing write tid 3 to smithi08477944-45 2024-03-30T12:34:28.295 INFO:tasks.rados.rados.0.smithi084.stdout:3526: finishing write tid 4 to smithi08477944-45 2024-03-30T12:34:28.295 INFO:tasks.rados.rados.0.smithi084.stdout:3526: finishing write tid 5 to smithi08477944-45 2024-03-30T12:34:28.295 INFO:tasks.rados.rados.0.smithi084.stdout:3526: oid 45 updating version 0 to 27328 2024-03-30T12:34:28.295 INFO:tasks.rados.rados.0.smithi084.stdout:3526: oid 45 updating version 27328 to 27329 2024-03-30T12:34:28.295 INFO:tasks.rados.rados.0.smithi084.stdout:3526: oid 45 version 27329 is already newer than 27326 2024-03-30T12:34:28.296 INFO:tasks.rados.rados.0.smithi084.stdout:3526: oid 45 version 27329 is already newer than 27327 2024-03-30T12:34:28.296 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 27329 (ObjNum 1088 snap 351 seq_num 1088) dirty exists 2024-03-30T12:34:28.296 INFO:tasks.rados.rados.0.smithi084.stdout:3526: left oid 45 (ObjNum 1088 snap 351 seq_num 1088) 2024-03-30T12:34:28.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:28.425+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:28.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:28.370+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:28.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:28.370+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:28.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:28.300+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:28.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:28.300+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:28.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:28.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:28.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:28.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:28.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:28 smithi162 ceph-mon[83709]: osdmap e771: 8 total, 8 up, 8 in 2024-03-30T12:34:28.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:28.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:28.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:28.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:28.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:28.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:28.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:28.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:28.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:28.622 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:28.301+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:28.622 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:28.301+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:28.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:28.371+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:28.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:28.371+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:28.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:28.299+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:28.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:28.300+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:28.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:28.300+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:28.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:28.300+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:28.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:28.300+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[91810]: osdmap e771: 8 total, 8 up, 8 in 2024-03-30T12:34:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:28.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:28.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:28.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:28.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:28.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:28.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:28.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:28.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:28.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:28.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:28.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:28.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:28.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[89279]: osdmap e771: 8 total, 8 up, 8 in 2024-03-30T12:34:28.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:28.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:28.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:28.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:28.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:28.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:28.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:28.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:28.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:29.298 INFO:tasks.rados.rados.0.smithi084.stdout:3525: done (2 left) 2024-03-30T12:34:29.298 INFO:tasks.rados.rados.0.smithi084.stdout:3526: done (1 left) 2024-03-30T12:34:29.299 INFO:tasks.rados.rados.0.smithi084.stdout:3528: done (0 left) 2024-03-30T12:34:29.299 INFO:tasks.rados.rados.0.smithi084.stdout:3529: snap_remove snap 350 2024-03-30T12:34:29.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:29.378+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:29.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:29.305+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:29.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:29.305+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:29.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:29.305+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:29.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:29.379+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:29.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:29.379+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:29.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:29.380+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:29.621 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:29.306+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:29.621 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:29.306+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:29.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:29.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:29.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:29.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:29.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:29 smithi162 ceph-mon[83709]: osdmap e772: 8 total, 8 up, 8 in 2024-03-30T12:34:29.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:29.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:29.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:29.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:29.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:29.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:29.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:29.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:29.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:29.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:29 smithi162 ceph-mon[83709]: pgmap v849: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 6.2 MiB/s rd, 2.2 MiB/s wr, 13 op/s 2024-03-30T12:34:29.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:34:29] "GET /metrics HTTP/1.1" 200 36327 "" "Prometheus/2.43.0" 2024-03-30T12:34:29.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:29.379+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:29.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:29.381+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:29.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:29.304+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:29.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:29.304+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:29.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:29.305+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:29.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:29.305+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:29.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:29.305+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:29.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:29.305+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:29.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:29.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:29.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:29.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:29.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[91810]: osdmap e772: 8 total, 8 up, 8 in 2024-03-30T12:34:29.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:29.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:29.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:29.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:29.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:29.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:29.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:29.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:29.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:29.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[91810]: pgmap v849: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 6.2 MiB/s rd, 2.2 MiB/s wr, 13 op/s 2024-03-30T12:34:29.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:29.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:29.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:29.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:29.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[89279]: osdmap e772: 8 total, 8 up, 8 in 2024-03-30T12:34:29.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:29.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:29.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:29.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:29.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:29.759 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:29.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:29.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:29.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:29.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:29 smithi084 ceph-mon[89279]: pgmap v849: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 6.2 MiB/s rd, 2.2 MiB/s wr, 13 op/s 2024-03-30T12:34:30.299 INFO:tasks.rados.rados.0.smithi084.stdout:3529: done (0 left) 2024-03-30T12:34:30.299 INFO:tasks.rados.rados.0.smithi084.stdout:3530: rollback oid 37 current snap is 352 2024-03-30T12:34:30.299 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 37 to 343 2024-03-30T12:34:30.299 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 352 2024-03-30T12:34:30.299 INFO:tasks.rados.rados.0.smithi084.stdout:3531: seq_num 1089 ranges {1671168=647168,2318336=745472,3063808=57344} 2024-03-30T12:34:30.312 INFO:tasks.rados.rados.0.smithi084.stdout:3531: writing smithi08477944-36 from 1671168 to 2318336 tid 1 2024-03-30T12:34:30.317 INFO:tasks.rados.rados.0.smithi084.stdout:3531: writing smithi08477944-36 from 2318336 to 3063808 tid 2 2024-03-30T12:34:30.318 INFO:tasks.rados.rados.0.smithi084.stdout:3531: writing smithi08477944-36 from 3063808 to 3121152 tid 3 2024-03-30T12:34:30.318 INFO:tasks.rados.rados.0.smithi084.stdout:3532: read oid 21 snap -1 2024-03-30T12:34:30.318 INFO:tasks.rados.rados.0.smithi084.stdout:3532: expect deleted 2024-03-30T12:34:30.318 INFO:tasks.rados.rados.0.smithi084.stdout:3533: rollback oid 30 current snap is 352 2024-03-30T12:34:30.318 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 30 to 348 2024-03-30T12:34:30.318 INFO:tasks.rados.rados.0.smithi084.stdout:3530: finishing rollback tid 1 to smithi08477944-37 2024-03-30T12:34:30.319 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 36300 (ObjNum 161 snap 0 seq_num 0) dirty dne 2024-03-30T12:34:30.319 INFO:tasks.rados.rados.0.smithi084.stdout:3530: done (3 left) 2024-03-30T12:34:30.319 INFO:tasks.rados.rados.0.smithi084.stdout:3534: rmattr oid 47 current snap is 352 2024-03-30T12:34:30.319 INFO:tasks.rados.rados.0.smithi084.stdout:3535: rollback oid 8 current snap is 352 2024-03-30T12:34:30.319 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 8 to 349 2024-03-30T12:34:30.319 INFO:tasks.rados.rados.0.smithi084.stdout:3536: snap_create 2024-03-30T12:34:30.322 INFO:tasks.rados.rados.0.smithi084.stdout:3531: finishing write tid 1 to smithi08477944-36 2024-03-30T12:34:30.325 INFO:tasks.rados.rados.0.smithi084.stdout:3531: finishing write tid 2 to smithi08477944-36 2024-03-30T12:34:30.325 INFO:tasks.rados.rados.0.smithi084.stdout:3531: finishing write tid 3 to smithi08477944-36 2024-03-30T12:34:30.326 INFO:tasks.rados.rados.0.smithi084.stdout:3535: finishing rollback tid 1 to smithi08477944-8 2024-03-30T12:34:30.326 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 27398 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-03-30T12:34:30.327 INFO:tasks.rados.rados.0.smithi084.stdout:3533: finishing rollback tid 0 to smithi08477944-30 2024-03-30T12:34:30.328 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 36296 (ObjNum 1073 snap 348 seq_num 1073) dirty exists 2024-03-30T12:34:30.328 INFO:tasks.rados.rados.0.smithi084.stdout:3531: finishing write tid 4 to smithi08477944-36 2024-03-30T12:34:30.328 INFO:tasks.rados.rados.0.smithi084.stdout:3533: finishing rollback tid 1 to smithi08477944-30 2024-03-30T12:34:30.329 INFO:tasks.rados.rados.0.smithi084.stdout:3533: finishing rollback tid 2 to smithi08477944-30 2024-03-30T12:34:30.329 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 27307 (ObjNum 1023 snap 328 seq_num 1023) dirty exists 2024-03-30T12:34:30.330 INFO:tasks.rados.rados.0.smithi084.stdout:3531: finishing write tid 5 to smithi08477944-36 2024-03-30T12:34:30.330 INFO:tasks.rados.rados.0.smithi084.stdout:3531: oid 36 updating version 0 to 36307 2024-03-30T12:34:30.330 INFO:tasks.rados.rados.0.smithi084.stdout:3531: oid 36 version 36307 is already newer than 36306 2024-03-30T12:34:30.330 INFO:tasks.rados.rados.0.smithi084.stdout:3531: oid 36 updating version 36307 to 36309 2024-03-30T12:34:30.331 INFO:tasks.rados.rados.0.smithi084.stdout:3531: oid 36 version 36309 is already newer than 36308 2024-03-30T12:34:30.331 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 36309 (ObjNum 1089 snap 352 seq_num 1089) dirty exists 2024-03-30T12:34:30.331 INFO:tasks.rados.rados.0.smithi084.stdout:3531: left oid 36 (ObjNum 1089 snap 352 seq_num 1089) 2024-03-30T12:34:30.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:30.318+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:30.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:30.306+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:30.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:30.307+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:30.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:30.307+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:30.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:30.307+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:30.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:30.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:30.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:30.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:30.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:30.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:30.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:30.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:30.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:30 smithi162 ceph-mon[83709]: osdmap e773: 8 total, 8 up, 8 in 2024-03-30T12:34:30.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:30.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:30.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:30.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:30 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:34:30.622 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:30.320+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:30.622 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:30.320+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:30.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:30.320+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:30.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:30.320+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:30.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:30.306+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:30.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:30.306+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:30.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:30.306+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:30.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:30.307+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:30.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:30.307+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:30.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:30.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:30.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:30.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:30.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:30.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:30.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:30.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:30.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[89279]: osdmap e773: 8 total, 8 up, 8 in 2024-03-30T12:34:30.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:30.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:30.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:30.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:34:30.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:30.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:30.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:30.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:30.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:30.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:30.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:30.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:30.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[91810]: osdmap e773: 8 total, 8 up, 8 in 2024-03-30T12:34:30.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:30.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:30.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:30.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:30 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:34:31.312 INFO:tasks.rados.rados.0.smithi084.stdout:3531: done (5 left) 2024-03-30T12:34:31.312 INFO:tasks.rados.rados.0.smithi084.stdout:3532: done (4 left) 2024-03-30T12:34:31.312 INFO:tasks.rados.rados.0.smithi084.stdout:3533: done (3 left) 2024-03-30T12:34:31.313 INFO:tasks.rados.rados.0.smithi084.stdout:3534: done (2 left) 2024-03-30T12:34:31.313 INFO:tasks.rados.rados.0.smithi084.stdout:3535: done (1 left) 2024-03-30T12:34:31.313 INFO:tasks.rados.rados.0.smithi084.stdout:3536: done (0 left) 2024-03-30T12:34:31.313 INFO:tasks.rados.rados.0.smithi084.stdout:3537: delete oid 27 current snap is 353 2024-03-30T12:34:31.320 INFO:tasks.rados.rados.0.smithi084.stdout:3537: done (0 left) 2024-03-30T12:34:31.320 INFO:tasks.rados.rados.0.smithi084.stdout:3538: copy_from oid 7 from oid 11 current snap is 353 2024-03-30T12:34:31.321 INFO:tasks.rados.rados.0.smithi084.stdout:3539: snap_create 2024-03-30T12:34:31.333 INFO:tasks.rados.rados.0.smithi084.stdout:3538: finishing copy_from racing read to smithi08477944-7 2024-03-30T12:34:31.334 INFO:tasks.rados.rados.0.smithi084.stdout:3538: finishing copy_from to smithi08477944-7 2024-03-30T12:34:31.334 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 27305 (ObjNum 1068 snap 347 seq_num 1068) dirty exists 2024-03-30T12:34:31.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:31.326+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:31.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:31.316+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:31.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:31.316+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:31.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:31.317+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:31.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:31.325+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:31.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:31.328+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:31.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:31.328+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:31.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:31.328+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:31.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:31.328+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:31.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:31.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:31.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:31.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:31.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:31.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:31.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:31.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-mon[83709]: osdmap e774: 8 total, 8 up, 8 in 2024-03-30T12:34:31.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:31.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:31.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:31.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:31.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:31.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:31.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:31.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:31.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:31 smithi162 ceph-mon[83709]: pgmap v852: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 6.2 MiB/s rd, 3.1 MiB/s wr, 20 op/s 2024-03-30T12:34:31.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:31.320+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:31.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:31.321+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:31.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:31.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:31.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:31.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:31.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:31.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:31.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:31.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[91810]: osdmap e774: 8 total, 8 up, 8 in 2024-03-30T12:34:31.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:31.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:31.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:31.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:31.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:31.318+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:31.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:31.318+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:31.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:31.318+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:31.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:31.318+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:31.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:31.318+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:31.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:31.318+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:31.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:31.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:31.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:31.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:31.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[91810]: pgmap v852: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 6.2 MiB/s rd, 3.1 MiB/s wr, 20 op/s 2024-03-30T12:34:31.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:31.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:31.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:31.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:31.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:31.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:31.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:31.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[89279]: osdmap e774: 8 total, 8 up, 8 in 2024-03-30T12:34:31.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:31.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:31.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:31.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:31.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:31.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:31.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:31.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:31.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:31 smithi084 ceph-mon[89279]: pgmap v852: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 6.2 MiB/s rd, 3.1 MiB/s wr, 20 op/s 2024-03-30T12:34:32.317 INFO:tasks.rados.rados.0.smithi084.stdout:3538: done (1 left) 2024-03-30T12:34:32.317 INFO:tasks.rados.rados.0.smithi084.stdout:3539: done (0 left) 2024-03-30T12:34:32.317 INFO:tasks.rados.rados.0.smithi084.stdout:3540: rmattr oid 22 current snap is 354 2024-03-30T12:34:32.317 INFO:tasks.rados.rados.0.smithi084.stdout:3540: done (0 left) 2024-03-30T12:34:32.317 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 354 2024-03-30T12:34:32.317 INFO:tasks.rados.rados.0.smithi084.stdout:3541: seq_num 1091 ranges {2187264=679936,2867200=516096,3383296=286720} 2024-03-30T12:34:32.332 INFO:tasks.rados.rados.0.smithi084.stdout:3541: writing smithi08477944-19 from 2187264 to 2867200 tid 1 2024-03-30T12:34:32.335 INFO:tasks.rados.rados.0.smithi084.stdout:3541: writing smithi08477944-19 from 2867200 to 3383296 tid 2 2024-03-30T12:34:32.337 INFO:tasks.rados.rados.0.smithi084.stdout:3541: writing smithi08477944-19 from 3383296 to 3670016 tid 3 2024-03-30T12:34:32.337 INFO:tasks.rados.rados.0.smithi084.stdout:3542: copy_from oid 3 from oid 26 current snap is 354 2024-03-30T12:34:32.337 INFO:tasks.rados.rados.0.smithi084.stdout:3543: snap_create 2024-03-30T12:34:32.346 INFO:tasks.rados.rados.0.smithi084.stdout:3541: finishing write tid 1 to smithi08477944-19 2024-03-30T12:34:32.347 INFO:tasks.rados.rados.0.smithi084.stdout:3541: finishing write tid 2 to smithi08477944-19 2024-03-30T12:34:32.353 INFO:tasks.rados.rados.0.smithi084.stdout:3542: finishing copy_from racing read to smithi08477944-3 2024-03-30T12:34:32.356 INFO:tasks.rados.rados.0.smithi084.stdout:3542: finishing copy_from to smithi08477944-3 2024-03-30T12:34:32.356 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 27434 (ObjNum 1058 snap 340 seq_num 1058) dirty exists 2024-03-30T12:34:32.359 INFO:tasks.rados.rados.0.smithi084.stdout:3541: finishing write tid 3 to smithi08477944-19 2024-03-30T12:34:32.359 INFO:tasks.rados.rados.0.smithi084.stdout:3541: finishing write tid 4 to smithi08477944-19 2024-03-30T12:34:32.363 INFO:tasks.rados.rados.0.smithi084.stdout:3541: finishing write tid 5 to smithi08477944-19 2024-03-30T12:34:32.363 INFO:tasks.rados.rados.0.smithi084.stdout:3541: oid 19 updating version 0 to 36370 2024-03-30T12:34:32.364 INFO:tasks.rados.rados.0.smithi084.stdout:3541: oid 19 updating version 36370 to 36371 2024-03-30T12:34:32.364 INFO:tasks.rados.rados.0.smithi084.stdout:3541: oid 19 version 36371 is already newer than 36368 2024-03-30T12:34:32.364 INFO:tasks.rados.rados.0.smithi084.stdout:3541: oid 19 version 36371 is already newer than 36369 2024-03-30T12:34:32.364 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 36371 (ObjNum 1091 snap 354 seq_num 1091) dirty exists 2024-03-30T12:34:32.364 INFO:tasks.rados.rados.0.smithi084.stdout:3541: left oid 19 (ObjNum 1091 snap 354 seq_num 1091) 2024-03-30T12:34:32.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:32.345+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:32.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:32.350+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:32.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:32.324+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:32.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:32.324+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:32.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:32.320+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:32.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:32.320+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:32.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:32.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:32.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:32.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:32.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:32.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:32.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:32 smithi162 ceph-mon[83709]: osdmap e775: 8 total, 8 up, 8 in 2024-03-30T12:34:32.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:32.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:32.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:32.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:32.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:32.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:32.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:32.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:32.360+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:32.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:32.361+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:32.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:32.327+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:32.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:32.327+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:32.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:32.329+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:32.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:32.329+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:32.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:32.329+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:32.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[89279]: osdmap e775: 8 total, 8 up, 8 in 2024-03-30T12:34:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:32.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:32.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:32.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:32.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:32.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:32.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 199=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:32.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:32.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[91810]: osdmap e775: 8 total, 8 up, 8 in 2024-03-30T12:34:32.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:32.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:32.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:32.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:32.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:32.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:32.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:33.325 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:33.067+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:33.329 INFO:tasks.rados.rados.0.smithi084.stdout:3541: done (2 left) 2024-03-30T12:34:33.330 INFO:tasks.rados.rados.0.smithi084.stdout:3542: done (1 left) 2024-03-30T12:34:33.330 INFO:tasks.rados.rados.0.smithi084.stdout:3543: done (0 left) 2024-03-30T12:34:33.330 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 355 2024-03-30T12:34:33.330 INFO:tasks.rados.rados.0.smithi084.stdout:3544: seq_num 1092 ranges {0=696320,696320=802816} 2024-03-30T12:34:33.333 INFO:tasks.rados.rados.0.smithi084.stdout:3544: writing smithi08477944-20 from 0 to 696320 tid 1 2024-03-30T12:34:33.338 INFO:tasks.rados.rados.0.smithi084.stdout:3544: writing smithi08477944-20 from 696320 to 1499136 tid 2 2024-03-30T12:34:33.338 INFO:tasks.rados.rados.0.smithi084.stdout:3545: read oid 30 snap -1 2024-03-30T12:34:33.338 INFO:tasks.rados.rados.0.smithi084.stdout:3545: expect (ObjNum 1023 snap 328 seq_num 1023) 2024-03-30T12:34:33.339 INFO:tasks.rados.rados.0.smithi084.stdout:3546: snap_remove snap 354 2024-03-30T12:34:33.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:33.350+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:33.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:33.350+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:33.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:33.350+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:33.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:33.338+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:33.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:33.338+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:33.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:33.338+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:33.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:33.352+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:33.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:33.352+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:33.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:33.352+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:33.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:33.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:33.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:33 smithi162 ceph-mon[83709]: osdmap e776: 8 total, 8 up, 8 in 2024-03-30T12:34:33.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:33.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:33.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:33.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:33.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:33.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:33.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:33.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:33.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:33.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:33.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:33 smithi162 ceph-mon[83709]: pgmap v855: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 12 op/s 2024-03-30T12:34:33.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:33.347+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:33.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:33.347+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:33.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:33.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:33.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[89279]: osdmap e776: 8 total, 8 up, 8 in 2024-03-30T12:34:33.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:33.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:33.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:33.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:33.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:33.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:33.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:33.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:33.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:33.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:33.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[89279]: pgmap v855: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 12 op/s 2024-03-30T12:34:33.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:33.336+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:33.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:33.336+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:33.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:33.336+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:33.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:33.337+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:33.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:33.337+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:33.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:33.337+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:33.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:33.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 199=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:33.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[91810]: osdmap e776: 8 total, 8 up, 8 in 2024-03-30T12:34:33.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:33.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:33.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:33.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:33.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:33.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:33.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:33.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:33.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:33.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:33.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:33 smithi084 ceph-mon[91810]: pgmap v855: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 12 op/s 2024-03-30T12:34:34.335 INFO:tasks.rados.rados.0.smithi084.stdout:3546: done (2 left) 2024-03-30T12:34:34.335 INFO:tasks.rados.rados.0.smithi084.stdout:3547: snap_remove snap 343 2024-03-30T12:34:34.619 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:34.341+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:34.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:34.341+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:34.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:34.341+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:34.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:34.341+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:34.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:34.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:34.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:34.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:34.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:34.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:34 smithi162 ceph-mon[83709]: osdmap e777: 8 total, 8 up, 8 in 2024-03-30T12:34:34.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:34.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:34.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:34.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:34.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:34.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:34.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:34.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:34.432+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:34.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:34.433+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:34.715 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:34.340+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:34.715 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:34.340+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:34.715 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:34.340+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:34.715 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:34.340+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:34.715 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:34.340+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:34.715 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:34.716 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:34.716 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:34.716 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:34.716 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:34.716 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[89279]: osdmap e777: 8 total, 8 up, 8 in 2024-03-30T12:34:34.716 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:34.716 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:34.716 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:34.716 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:34.716 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:34.716 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:34.716 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:34.717 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:34.717 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:34.717 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:34.717 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:34.717 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:34.717 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[91810]: osdmap e777: 8 total, 8 up, 8 in 2024-03-30T12:34:34.717 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:34.717 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:34.717 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:34.717 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:34.717 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:34.717 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:34.717 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:35.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:34.723+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:35.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:34.723+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:35.357 INFO:tasks.rados.rados.0.smithi084.stdout:3547: done (2 left) 2024-03-30T12:34:35.357 INFO:tasks.rados.rados.0.smithi084.stdout:3548: copy_from oid 21 from oid 34 current snap is 355 2024-03-30T12:34:35.357 INFO:tasks.rados.rados.0.smithi084.stdout:3544: finishing write tid 1 to smithi08477944-20 2024-03-30T12:34:35.357 INFO:tasks.rados.rados.0.smithi084.stdout:3544: finishing write tid 2 to smithi08477944-20 2024-03-30T12:34:35.357 INFO:tasks.rados.rados.0.smithi084.stdout:3545: expect (ObjNum 1023 snap 328 seq_num 1023) 2024-03-30T12:34:35.371 INFO:tasks.rados.rados.0.smithi084.stdout:3544: finishing write tid 3 to smithi08477944-20 2024-03-30T12:34:35.371 INFO:tasks.rados.rados.0.smithi084.stdout:3544: finishing write tid 4 to smithi08477944-20 2024-03-30T12:34:35.371 INFO:tasks.rados.rados.0.smithi084.stdout:3544: oid 20 updating version 0 to 36299 2024-03-30T12:34:35.371 INFO:tasks.rados.rados.0.smithi084.stdout:3544: oid 20 version 36299 is already newer than 36298 2024-03-30T12:34:35.371 INFO:tasks.rados.rados.0.smithi084.stdout:3544: oid 20 version 36299 is already newer than 36297 2024-03-30T12:34:35.371 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 36299 (ObjNum 1092 snap 355 seq_num 1092) dirty exists 2024-03-30T12:34:35.371 INFO:tasks.rados.rados.0.smithi084.stdout:3544: left oid 20 (ObjNum 1092 snap 355 seq_num 1092) 2024-03-30T12:34:35.371 INFO:tasks.rados.rados.0.smithi084.stdout:3544: done (2 left) 2024-03-30T12:34:35.371 INFO:tasks.rados.rados.0.smithi084.stdout:3545: done (1 left) 2024-03-30T12:34:35.372 INFO:tasks.rados.rados.0.smithi084.stdout:3549: delete oid 42 current snap is 355 2024-03-30T12:34:35.372 INFO:tasks.rados.rados.0.smithi084.stdout:3548: finishing copy_from racing read to smithi08477944-21 2024-03-30T12:34:35.372 INFO:tasks.rados.rados.0.smithi084.stdout:3548: finishing copy_from to smithi08477944-21 2024-03-30T12:34:35.372 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 36294 (ObjNum 289 snap 0 seq_num 0) dirty exists 2024-03-30T12:34:35.373 INFO:tasks.rados.rados.0.smithi084.stdout:3548: done (1 left) 2024-03-30T12:34:35.373 INFO:tasks.rados.rados.0.smithi084.stdout:3549: done (0 left) 2024-03-30T12:34:35.373 INFO:tasks.rados.rados.0.smithi084.stdout:3550: rollback oid 33 current snap is 355 2024-03-30T12:34:35.373 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 33 to 349 2024-03-30T12:34:35.373 INFO:tasks.rados.rados.0.smithi084.stdout:3551: snap_create 2024-03-30T12:34:35.378 INFO:tasks.rados.rados.0.smithi084.stdout:3550: finishing rollback tid 0 to smithi08477944-33 2024-03-30T12:34:35.378 INFO:tasks.rados.rados.0.smithi084.stdout:3550: finishing rollback tid 1 to smithi08477944-33 2024-03-30T12:34:35.378 INFO:tasks.rados.rados.0.smithi084.stdout:3550: finishing rollback tid 2 to smithi08477944-33 2024-03-30T12:34:35.378 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 36302 (ObjNum 1071 snap 347 seq_num 1071) dirty exists 2024-03-30T12:34:35.619 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:35.362+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:35.619 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:35.363+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:35.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:35.358+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:35.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:35.358+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:35.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:35.358+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:35.620 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:35.278+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:35.620 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:35.383+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:35.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:35.370+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:35.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:35.371+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:35.621 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:35.371+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:35.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:35.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:35.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:35.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:35.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:35.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:35.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-mon[83709]: osdmap e778: 8 total, 8 up, 8 in 2024-03-30T12:34:35.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:35.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:35.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:35.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:35.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:35.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:35.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:35.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:35.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:35 smithi162 ceph-mon[83709]: pgmap v858: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 259 KiB/s rd, 1.1 MiB/s wr, 5 op/s 2024-03-30T12:34:35.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:35.371+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:35.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:35.372+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:35.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:35.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:35.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:35.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:35.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:35.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:35.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[89279]: osdmap e778: 8 total, 8 up, 8 in 2024-03-30T12:34:35.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:35.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:35.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:35.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:35.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:35.363+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:35.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:35.363+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:35.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:35.363+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:35.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:35.363+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:35.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:35.363+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:35.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:35.363+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:35.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:35.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:35.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:35.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:35.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:35.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:35.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[91810]: osdmap e778: 8 total, 8 up, 8 in 2024-03-30T12:34:35.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:35.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:35.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:35.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:35.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:35.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:35.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:35.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:35.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[89279]: pgmap v858: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 259 KiB/s rd, 1.1 MiB/s wr, 5 op/s 2024-03-30T12:34:35.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:35.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:35.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:35.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:35.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:35 smithi084 ceph-mon[91810]: pgmap v858: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 259 KiB/s rd, 1.1 MiB/s wr, 5 op/s 2024-03-30T12:34:36.361 INFO:tasks.rados.rados.0.smithi084.stdout:3550: done (1 left) 2024-03-30T12:34:36.361 INFO:tasks.rados.rados.0.smithi084.stdout:3551: done (0 left) 2024-03-30T12:34:36.361 INFO:tasks.rados.rados.0.smithi084.stdout:3552: setattr oid 49 current snap is 356 2024-03-30T12:34:36.362 INFO:tasks.rados.rados.0.smithi084.stdout:3553: rollback oid 23 current snap is 356 2024-03-30T12:34:36.362 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 23 to 351 2024-03-30T12:34:36.362 INFO:tasks.rados.rados.0.smithi084.stdout:3554: snap_remove snap 352 2024-03-30T12:34:36.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:36.377+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:36.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:36.377+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a1=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:36.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:36.371+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:36.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:36.371+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:36.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:36.372+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:36.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:36.372+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:36.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:36.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:36.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:36.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:36.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:36.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:36.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:36.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:36.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:36.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:36 smithi162 ceph-mon[83709]: osdmap e779: 8 total, 8 up, 8 in 2024-03-30T12:34:36.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:36.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:36.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:36.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:36.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:36.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:36.374+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:36.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:36.382+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:36.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:36.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:36.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:36.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:36.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:36.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:36.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:36.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:36.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:36.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[91810]: osdmap e779: 8 total, 8 up, 8 in 2024-03-30T12:34:36.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:36.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:36.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:36.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 183=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:36.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:36.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:36.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:36.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:36.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:36.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:36.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:36.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[89279]: osdmap e779: 8 total, 8 up, 8 in 2024-03-30T12:34:36.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:36.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:36.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:36.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:36.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:36.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:36.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:36.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:37.361 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:37.068+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:37.361 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:37.068+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:37.361 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:37.069+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:37.361 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:37.069+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:37.361 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:37.069+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:37.364 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:37.068+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:37.365 INFO:tasks.rados.rados.0.smithi084.stdout:3554: done (2 left) 2024-03-30T12:34:37.366 INFO:tasks.rados.rados.0.smithi084.stdout:3555: read oid 22 snap 346 2024-03-30T12:34:37.366 INFO:tasks.rados.rados.0.smithi084.stdout:3555: expect (ObjNum 1053 snap 337 seq_num 1053) 2024-03-30T12:34:37.366 INFO:tasks.rados.rados.0.smithi084.stdout:3556: snap_remove snap 348 2024-03-30T12:34:37.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:37.380+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:37.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:37.380+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:37.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:37.384+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:37.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:37.372+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:37.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:37.373+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:37.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:37.376+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:37.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:37.376+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:37.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:37.376+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a1=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:37.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:37 smithi162 ceph-mon[83709]: osdmap e780: 8 total, 8 up, 8 in 2024-03-30T12:34:37.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:37.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:37.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:37.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:37.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:37.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:37.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a1=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:37.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:37.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:37 smithi162 ceph-mon[83709]: pgmap v861: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 258 KiB/s rd, 1.3 MiB/s wr, 5 op/s 2024-03-30T12:34:37.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-mon[91810]: osdmap e780: 8 total, 8 up, 8 in 2024-03-30T12:34:37.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:37.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:37.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:37.741 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:37.742 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:37.742 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:37.742 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a1=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:37.742 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:37.742 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-mon[91810]: pgmap v861: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 258 KiB/s rd, 1.3 MiB/s wr, 5 op/s 2024-03-30T12:34:37.742 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:37.373+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:37.742 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:37.373+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:37.742 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:37.373+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:37.742 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:37.373+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:37.743 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:37.374+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:37.743 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:37.374+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:37.743 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-mon[89279]: osdmap e780: 8 total, 8 up, 8 in 2024-03-30T12:34:37.743 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:37.743 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:37.743 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:37.743 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:37.743 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:37.743 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:37.743 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a1=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:37.743 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:37.743 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-mon[89279]: pgmap v861: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 258 KiB/s rd, 1.3 MiB/s wr, 5 op/s 2024-03-30T12:34:38.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:37.749+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:38.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:37.749+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:38.366 INFO:tasks.rados.rados.0.smithi084.stdout:3556: done (3 left) 2024-03-30T12:34:38.367 INFO:tasks.rados.rados.0.smithi084.stdout:3557: read oid 27 snap 340 2024-03-30T12:34:38.367 INFO:tasks.rados.rados.0.smithi084.stdout:3557: expect (ObjNum 1022 snap 328 seq_num 1022) 2024-03-30T12:34:38.367 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 36310 (ObjNum 1021 snap 328 seq_num 1021) dirty exists 2024-03-30T12:34:38.367 INFO:tasks.rados.rados.0.smithi084.stdout:3553: finishing rollback tid 0 to smithi08477944-23 2024-03-30T12:34:38.367 INFO:tasks.rados.rados.0.smithi084.stdout:3553: finishing rollback tid 1 to smithi08477944-23 2024-03-30T12:34:38.367 INFO:tasks.rados.rados.0.smithi084.stdout:3553: finishing rollback tid 2 to smithi08477944-23 2024-03-30T12:34:38.367 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 36313 (ObjNum 1033 snap 332 seq_num 1033) dirty exists 2024-03-30T12:34:38.367 INFO:tasks.rados.rados.0.smithi084.stdout:3555: expect (ObjNum 1053 snap 337 seq_num 1053) 2024-03-30T12:34:38.368 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:38.112+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:38.482 INFO:tasks.rados.rados.0.smithi084.stdout:3552: done (3 left) 2024-03-30T12:34:38.482 INFO:tasks.rados.rados.0.smithi084.stdout:3553: done (2 left) 2024-03-30T12:34:38.483 INFO:tasks.rados.rados.0.smithi084.stdout:3555: done (1 left) 2024-03-30T12:34:38.483 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 356 2024-03-30T12:34:38.483 INFO:tasks.rados.rados.0.smithi084.stdout:3558: seq_num 1094 ranges {3670016=729088,4399104=573440,4972544=229376} 2024-03-30T12:34:38.506 INFO:tasks.rados.rados.0.smithi084.stdout:3558: writing smithi08477944-19 from 3670016 to 4399104 tid 1 2024-03-30T12:34:38.509 INFO:tasks.rados.rados.0.smithi084.stdout:3558: writing smithi08477944-19 from 4399104 to 4972544 tid 2 2024-03-30T12:34:38.511 INFO:tasks.rados.rados.0.smithi084.stdout:3558: writing smithi08477944-19 from 4972544 to 5201920 tid 3 2024-03-30T12:34:38.511 INFO:tasks.rados.rados.0.smithi084.stdout:3559: read oid 38 snap -1 2024-03-30T12:34:38.511 INFO:tasks.rados.rados.0.smithi084.stdout:3559: expect (ObjNum 1065 snap 347 seq_num 1065) 2024-03-30T12:34:38.511 INFO:tasks.rados.rados.0.smithi084.stdout:3560: read oid 3 snap -1 2024-03-30T12:34:38.511 INFO:tasks.rados.rados.0.smithi084.stdout:3560: expect (ObjNum 1058 snap 340 seq_num 1058) 2024-03-30T12:34:38.511 INFO:tasks.rados.rados.0.smithi084.stdout:3561: rmattr oid 42 current snap is 356 2024-03-30T12:34:38.511 INFO:tasks.rados.rados.0.smithi084.stdout:3561: done (4 left) 2024-03-30T12:34:38.511 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 30 current snap is 356 2024-03-30T12:34:38.511 INFO:tasks.rados.rados.0.smithi084.stdout:3562: seq_num 1095 ranges {335872=745472,1081344=499712,1581056=303104} 2024-03-30T12:34:38.516 INFO:tasks.rados.rados.0.smithi084.stdout:3562: writing smithi08477944-30 from 335872 to 1081344 tid 1 2024-03-30T12:34:38.519 INFO:tasks.rados.rados.0.smithi084.stdout:3562: writing smithi08477944-30 from 1081344 to 1581056 tid 2 2024-03-30T12:34:38.522 INFO:tasks.rados.rados.0.smithi084.stdout:3562: writing smithi08477944-30 from 1581056 to 1884160 tid 3 2024-03-30T12:34:38.522 INFO:tasks.rados.rados.0.smithi084.stdout:3563: read oid 43 snap 349 2024-03-30T12:34:38.522 INFO:tasks.rados.rados.0.smithi084.stdout:3563: expect (ObjNum 1062 snap 344 seq_num 1062) 2024-03-30T12:34:38.522 INFO:tasks.rados.rados.0.smithi084.stdout:3564: delete oid 5 current snap is 356 2024-03-30T12:34:38.522 INFO:tasks.rados.rados.0.smithi084.stdout:3557: expect (ObjNum 1022 snap 328 seq_num 1022) 2024-03-30T12:34:38.539 INFO:tasks.rados.rados.0.smithi084.stdout:3558: finishing write tid 1 to smithi08477944-19 2024-03-30T12:34:38.540 INFO:tasks.rados.rados.0.smithi084.stdout:3558: finishing write tid 2 to smithi08477944-19 2024-03-30T12:34:38.540 INFO:tasks.rados.rados.0.smithi084.stdout:3557: done (6 left) 2024-03-30T12:34:38.540 INFO:tasks.rados.rados.0.smithi084.stdout:3564: done (5 left) 2024-03-30T12:34:38.540 INFO:tasks.rados.rados.0.smithi084.stdout:3565: snap_remove snap 351 2024-03-30T12:34:38.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:38.495+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:38.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:38.374+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a1=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:38.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:38.374+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:38.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:38.523+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:38.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:38.526+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:38.621 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:38.374+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:38.621 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:38.375+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:38.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:38.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:38.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:38.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:38.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:38.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:38.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:38.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:38.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:38.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:38.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:38.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-mon[83709]: osdmap e781: 8 total, 8 up, 8 in 2024-03-30T12:34:38.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:38.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a1=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:38.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:38.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:38.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:38.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:38.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:38.382+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:38.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:38.383+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:38.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:38.522+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:38.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:38.522+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:38.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:38.522+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:38.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:38.523+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:38.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:38.525+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:38.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:38.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:38.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:38.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:38.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:38.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:38.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:38.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:38.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:38.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:38.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:38.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[89279]: osdmap e781: 8 total, 8 up, 8 in 2024-03-30T12:34:38.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:38.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a1=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:38.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:38.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:38.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:38.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:38.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:38.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:38.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:38.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:38.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:38.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:38.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:38.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:38.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:38.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:38.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:38.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[91810]: osdmap e781: 8 total, 8 up, 8 in 2024-03-30T12:34:38.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:38.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a1=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:38.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:38.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:38.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:38.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:39.380 INFO:tasks.rados.rados.0.smithi084.stdout:3565: done (5 left) 2024-03-30T12:34:39.380 INFO:tasks.rados.rados.0.smithi084.stdout:3566: rmattr oid 25 current snap is 356 2024-03-30T12:34:39.380 INFO:tasks.rados.rados.0.smithi084.stdout:3566: done (5 left) 2024-03-30T12:34:39.381 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 356 2024-03-30T12:34:39.381 INFO:tasks.rados.rados.0.smithi084.stdout:3562: finishing write tid 1 to smithi08477944-30 2024-03-30T12:34:39.381 INFO:tasks.rados.rados.0.smithi084.stdout:3560: expect (ObjNum 1058 snap 340 seq_num 1058) 2024-03-30T12:34:39.465 INFO:tasks.rados.rados.0.smithi084.stdout:3558: finishing write tid 3 to smithi08477944-19 2024-03-30T12:34:39.465 INFO:tasks.rados.rados.0.smithi084.stdout:3558: finishing write tid 4 to smithi08477944-19 2024-03-30T12:34:39.465 INFO:tasks.rados.rados.0.smithi084.stdout:3559: expect (ObjNum 1065 snap 347 seq_num 1065) 2024-03-30T12:34:39.616 INFO:tasks.rados.rados.0.smithi084.stdout:3562: finishing write tid 2 to smithi08477944-30 2024-03-30T12:34:39.617 INFO:tasks.rados.rados.0.smithi084.stdout:3562: finishing write tid 3 to smithi08477944-30 2024-03-30T12:34:39.617 INFO:tasks.rados.rados.0.smithi084.stdout:3562: finishing write tid 4 to smithi08477944-30 2024-03-30T12:34:39.617 INFO:tasks.rados.rados.0.smithi084.stdout:3567: seq_num 1097 ranges {0=778240,778240=671744,1449984=131072} 2024-03-30T12:34:39.620 INFO:tasks.rados.rados.0.smithi084.stdout:3567: writing smithi08477944-21 from 0 to 778240 tid 1 2024-03-30T12:34:39.624 INFO:tasks.rados.rados.0.smithi084.stdout:3567: writing smithi08477944-21 from 778240 to 1449984 tid 2 2024-03-30T12:34:39.626 INFO:tasks.rados.rados.0.smithi084.stdout:3567: writing smithi08477944-21 from 1449984 to 1581056 tid 3 2024-03-30T12:34:39.626 INFO:tasks.rados.rados.0.smithi084.stdout:3559: done (5 left) 2024-03-30T12:34:39.626 INFO:tasks.rados.rados.0.smithi084.stdout:3560: done (4 left) 2024-03-30T12:34:39.626 INFO:tasks.rados.rados.0.smithi084.stdout:3568: rollback oid 40 current snap is 356 2024-03-30T12:34:39.627 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 40 to 346 2024-03-30T12:34:39.627 INFO:tasks.rados.rados.0.smithi084.stdout:3562: finishing write tid 5 to smithi08477944-30 2024-03-30T12:34:39.627 INFO:tasks.rados.rados.0.smithi084.stdout:3562: oid 30 updating version 0 to 27311 2024-03-30T12:34:39.627 INFO:tasks.rados.rados.0.smithi084.stdout:3562: oid 30 version 27311 is already newer than 27309 2024-03-30T12:34:39.627 INFO:tasks.rados.rados.0.smithi084.stdout:3562: oid 30 version 27311 is already newer than 27308 2024-03-30T12:34:39.627 INFO:tasks.rados.rados.0.smithi084.stdout:3562: oid 30 version 27311 is already newer than 27310 2024-03-30T12:34:39.627 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 27311 (ObjNum 1095 snap 356 seq_num 1095) dirty exists 2024-03-30T12:34:39.627 INFO:tasks.rados.rados.0.smithi084.stdout:3562: left oid 30 (ObjNum 1095 snap 356 seq_num 1095) 2024-03-30T12:34:39.627 INFO:tasks.rados.rados.0.smithi084.stdout:3558: finishing write tid 5 to smithi08477944-19 2024-03-30T12:34:39.627 INFO:tasks.rados.rados.0.smithi084.stdout:3558: oid 19 updating version 0 to 36376 2024-03-30T12:34:39.627 INFO:tasks.rados.rados.0.smithi084.stdout:3558: oid 19 version 36376 is already newer than 36374 2024-03-30T12:34:39.628 INFO:tasks.rados.rados.0.smithi084.stdout:3558: oid 19 version 36376 is already newer than 36373 2024-03-30T12:34:39.628 INFO:tasks.rados.rados.0.smithi084.stdout:3558: oid 19 version 36376 is already newer than 36375 2024-03-30T12:34:39.628 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 36376 (ObjNum 1094 snap 356 seq_num 1094) dirty exists 2024-03-30T12:34:39.628 INFO:tasks.rados.rados.0.smithi084.stdout:3558: left oid 19 (ObjNum 1094 snap 356 seq_num 1094) 2024-03-30T12:34:39.628 INFO:tasks.rados.rados.0.smithi084.stdout:3558: done (4 left) 2024-03-30T12:34:39.628 INFO:tasks.rados.rados.0.smithi084.stdout:3562: done (3 left) 2024-03-30T12:34:39.628 INFO:tasks.rados.rados.0.smithi084.stdout:3569: rollback oid 38 current snap is 356 2024-03-30T12:34:39.628 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 38 to 355 2024-03-30T12:34:39.628 INFO:tasks.rados.rados.0.smithi084.stdout:3563: expect (ObjNum 1062 snap 344 seq_num 1062) 2024-03-30T12:34:39.736 INFO:tasks.rados.rados.0.smithi084.stdout:3569: finishing rollback tid 0 to smithi08477944-38 2024-03-30T12:34:39.736 INFO:tasks.rados.rados.0.smithi084.stdout:3568: finishing rollback tid 1 to smithi08477944-40 2024-03-30T12:34:39.736 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 36295 (ObjNum 33 snap 0 seq_num 1429038112) dirty dne 2024-03-30T12:34:39.736 INFO:tasks.rados.rados.0.smithi084.stdout:3569: finishing rollback tid 1 to smithi08477944-38 2024-03-30T12:34:39.736 INFO:tasks.rados.rados.0.smithi084.stdout:3569: finishing rollback tid 2 to smithi08477944-38 2024-03-30T12:34:39.736 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 27314 (ObjNum 1065 snap 347 seq_num 1065) dirty exists 2024-03-30T12:34:39.736 INFO:tasks.rados.rados.0.smithi084.stdout:3567: finishing write tid 1 to smithi08477944-21 2024-03-30T12:34:39.736 INFO:tasks.rados.rados.0.smithi084.stdout:3567: finishing write tid 2 to smithi08477944-21 2024-03-30T12:34:39.736 INFO:tasks.rados.rados.0.smithi084.stdout:3563: done (3 left) 2024-03-30T12:34:39.736 INFO:tasks.rados.rados.0.smithi084.stdout:3568: done (2 left) 2024-03-30T12:34:39.737 INFO:tasks.rados.rados.0.smithi084.stdout:3569: done (1 left) 2024-03-30T12:34:39.737 INFO:tasks.rados.rados.0.smithi084.stdout:3570: snap_create 2024-03-30T12:34:39.737 INFO:tasks.rados.rados.0.smithi084.stdout:3567: finishing write tid 3 to smithi08477944-21 2024-03-30T12:34:39.737 INFO:tasks.rados.rados.0.smithi084.stdout:3567: finishing write tid 4 to smithi08477944-21 2024-03-30T12:34:39.737 INFO:tasks.rados.rados.0.smithi084.stdout:3567: finishing write tid 5 to smithi08477944-21 2024-03-30T12:34:39.737 INFO:tasks.rados.rados.0.smithi084.stdout:3567: oid 21 updating version 0 to 36295 2024-03-30T12:34:39.737 INFO:tasks.rados.rados.0.smithi084.stdout:3567: oid 21 updating version 36295 to 36296 2024-03-30T12:34:39.737 INFO:tasks.rados.rados.0.smithi084.stdout:3567: oid 21 updating version 36296 to 36297 2024-03-30T12:34:39.737 INFO:tasks.rados.rados.0.smithi084.stdout:3567: oid 21 updating version 36297 to 36298 2024-03-30T12:34:39.737 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 36298 (ObjNum 1097 snap 356 seq_num 1097) dirty exists 2024-03-30T12:34:39.737 INFO:tasks.rados.rados.0.smithi084.stdout:3567: left oid 21 (ObjNum 1097 snap 356 seq_num 1097) 2024-03-30T12:34:39.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:34:39] "GET /metrics HTTP/1.1" 200 36329 "" "Prometheus/2.43.0" 2024-03-30T12:34:39.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:39.387+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:39.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:39.388+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:39.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:39.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:39.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[89279]: osdmap e782: 8 total, 8 up, 8 in 2024-03-30T12:34:39.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a1=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:39.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:39.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:39.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:39.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:39.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:39.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:39.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:39.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:39.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:39.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:39.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:39.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[89279]: pgmap v864: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 946 KiB/s wr, 2 op/s 2024-03-30T12:34:39.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:39.387+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:39.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:39.387+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:39.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:39.387+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:39.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:39.387+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:39.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:39.388+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:39.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:39.388+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:39.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:39.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:39.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[91810]: osdmap e782: 8 total, 8 up, 8 in 2024-03-30T12:34:39.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a1=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:39.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:39.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:39.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:39.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:39.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:39.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:39.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:39.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:39.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:39.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:39.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:39.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:39 smithi084 ceph-mon[91810]: pgmap v864: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 946 KiB/s wr, 2 op/s 2024-03-30T12:34:39.803 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:39.389+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:39.803 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:39.390+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:39.804 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:39.390+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a1=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:39.804 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:39.636+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:39.804 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:39.636+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:39.804 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:39.636+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:39.805 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:39.805 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:39.805 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:39 smithi162 ceph-mon[83709]: osdmap e782: 8 total, 8 up, 8 in 2024-03-30T12:34:39.805 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a1=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:39.805 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:39.805 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:39.805 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:39.805 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:39.806 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:39.806 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:39.806 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:39.806 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:39.806 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:39.806 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:39.806 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:39.806 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:39 smithi162 ceph-mon[83709]: pgmap v864: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 255 B/s rd, 946 KiB/s wr, 2 op/s 2024-03-30T12:34:40.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:39.811+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:40.380 INFO:tasks.rados.rados.0.smithi084.stdout:3567: done (1 left) 2024-03-30T12:34:40.380 INFO:tasks.rados.rados.0.smithi084.stdout:3570: done (0 left) 2024-03-30T12:34:40.380 INFO:tasks.rados.rados.0.smithi084.stdout:3571: copy_from oid 1 from oid 29 current snap is 357 2024-03-30T12:34:40.380 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 357 2024-03-30T12:34:40.381 INFO:tasks.rados.rados.0.smithi084.stdout:3572: seq_num 1098 ranges {303104=794624,1097728=557056,1654784=245760} 2024-03-30T12:34:40.386 INFO:tasks.rados.rados.0.smithi084.stdout:3572: writing smithi08477944-49 from 303104 to 1097728 tid 1 2024-03-30T12:34:40.390 INFO:tasks.rados.rados.0.smithi084.stdout:3572: writing smithi08477944-49 from 1097728 to 1654784 tid 2 2024-03-30T12:34:40.392 INFO:tasks.rados.rados.0.smithi084.stdout:3572: writing smithi08477944-49 from 1654784 to 1900544 tid 3 2024-03-30T12:34:40.392 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 357 2024-03-30T12:34:40.392 INFO:tasks.rados.rados.0.smithi084.stdout:3573: seq_num 1099 ranges {8716288=409600,9125888=442368,9568256=720896,10289152=40960} 2024-03-30T12:34:40.442 INFO:tasks.rados.rados.0.smithi084.stdout:3573: writing smithi08477944-23 from 8716288 to 9125888 tid 1 2024-03-30T12:34:40.445 INFO:tasks.rados.rados.0.smithi084.stdout:3573: writing smithi08477944-23 from 9125888 to 9568256 tid 2 2024-03-30T12:34:40.450 INFO:tasks.rados.rados.0.smithi084.stdout:3573: writing smithi08477944-23 from 9568256 to 10289152 tid 3 2024-03-30T12:34:40.450 INFO:tasks.rados.rados.0.smithi084.stdout:3573: writing smithi08477944-23 from 10289152 to 10330112 tid 4 2024-03-30T12:34:40.450 INFO:tasks.rados.rados.0.smithi084.stdout:3574: rmattr oid 37 current snap is 357 2024-03-30T12:34:40.450 INFO:tasks.rados.rados.0.smithi084.stdout:3574: done (3 left) 2024-03-30T12:34:40.450 INFO:tasks.rados.rados.0.smithi084.stdout:3575: snap_create 2024-03-30T12:34:40.450 INFO:tasks.rados.rados.0.smithi084.stdout:3572: finishing write tid 1 to smithi08477944-49 2024-03-30T12:34:40.450 INFO:tasks.rados.rados.0.smithi084.stdout:3572: finishing write tid 2 to smithi08477944-49 2024-03-30T12:34:40.450 INFO:tasks.rados.rados.0.smithi084.stdout:3572: finishing write tid 3 to smithi08477944-49 2024-03-30T12:34:40.450 INFO:tasks.rados.rados.0.smithi084.stdout:3572: finishing write tid 4 to smithi08477944-49 2024-03-30T12:34:40.450 INFO:tasks.rados.rados.0.smithi084.stdout:3572: finishing write tid 5 to smithi08477944-49 2024-03-30T12:34:40.450 INFO:tasks.rados.rados.0.smithi084.stdout:3572: oid 49 updating version 0 to 36315 2024-03-30T12:34:40.450 INFO:tasks.rados.rados.0.smithi084.stdout:3572: oid 49 updating version 36315 to 36317 2024-03-30T12:34:40.451 INFO:tasks.rados.rados.0.smithi084.stdout:3572: oid 49 version 36317 is already newer than 36316 2024-03-30T12:34:40.451 INFO:tasks.rados.rados.0.smithi084.stdout:3572: oid 49 version 36317 is already newer than 36314 2024-03-30T12:34:40.451 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 36317 (ObjNum 1098 snap 357 seq_num 1098) dirty exists 2024-03-30T12:34:40.451 INFO:tasks.rados.rados.0.smithi084.stdout:3572: left oid 49 (ObjNum 1098 snap 357 seq_num 1098) 2024-03-30T12:34:40.451 INFO:tasks.rados.rados.0.smithi084.stdout:3571: finishing copy_from racing read to smithi08477944-1 2024-03-30T12:34:40.451 INFO:tasks.rados.rados.0.smithi084.stdout:3571: finishing copy_from to smithi08477944-1 2024-03-30T12:34:40.451 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 36309 (ObjNum 946 snap 301 seq_num 946) dirty exists 2024-03-30T12:34:40.451 INFO:tasks.rados.rados.0.smithi084.stdout:3573: finishing write tid 1 to smithi08477944-23 2024-03-30T12:34:40.451 INFO:tasks.rados.rados.0.smithi084.stdout:3573: finishing write tid 2 to smithi08477944-23 2024-03-30T12:34:40.453 INFO:tasks.rados.rados.0.smithi084.stdout:3573: finishing write tid 3 to smithi08477944-23 2024-03-30T12:34:40.453 INFO:tasks.rados.rados.0.smithi084.stdout:3573: finishing write tid 4 to smithi08477944-23 2024-03-30T12:34:40.454 INFO:tasks.rados.rados.0.smithi084.stdout:3573: finishing write tid 5 to smithi08477944-23 2024-03-30T12:34:40.455 INFO:tasks.rados.rados.0.smithi084.stdout:3573: finishing write tid 6 to smithi08477944-23 2024-03-30T12:34:40.455 INFO:tasks.rados.rados.0.smithi084.stdout:3573: oid 23 updating version 0 to 36320 2024-03-30T12:34:40.456 INFO:tasks.rados.rados.0.smithi084.stdout:3573: oid 23 version 36320 is already newer than 36319 2024-03-30T12:34:40.456 INFO:tasks.rados.rados.0.smithi084.stdout:3573: oid 23 updating version 36320 to 36322 2024-03-30T12:34:40.456 INFO:tasks.rados.rados.0.smithi084.stdout:3573: oid 23 version 36322 is already newer than 36318 2024-03-30T12:34:40.456 INFO:tasks.rados.rados.0.smithi084.stdout:3573: oid 23 version 36322 is already newer than 36321 2024-03-30T12:34:40.456 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 36322 (ObjNum 1099 snap 357 seq_num 1099) dirty exists 2024-03-30T12:34:40.456 INFO:tasks.rados.rados.0.smithi084.stdout:3573: left oid 23 (ObjNum 1099 snap 357 seq_num 1099) 2024-03-30T12:34:40.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:40.400+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:40.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:40.404+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:40.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:40.399+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:40.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:40.403+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:40.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:40.403+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:40.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:40.403+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:40.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:40.404+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:40.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:40.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-mon[89279]: osdmap e783: 8 total, 8 up, 8 in 2024-03-30T12:34:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a1=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:40.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:40.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:40.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:40.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:40.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:40.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-mon[91810]: osdmap e783: 8 total, 8 up, 8 in 2024-03-30T12:34:40.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:40.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:40.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:40.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a1=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:40.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:40.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:40.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:40.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:40.390+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:40.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:40.406+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:40.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:40.406+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:40.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:40.390+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:40.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:40.391+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:40.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:40.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:40.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:40.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:40.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:40 smithi162 ceph-mon[83709]: osdmap e783: 8 total, 8 up, 8 in 2024-03-30T12:34:40.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:40.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:40.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:40.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a1=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:40.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:40.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:40.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:41.369 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:41.028+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:41.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:41.029+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:41.394 INFO:tasks.rados.rados.0.smithi084.stdout:3571: done (3 left) 2024-03-30T12:34:41.394 INFO:tasks.rados.rados.0.smithi084.stdout:3572: done (2 left) 2024-03-30T12:34:41.394 INFO:tasks.rados.rados.0.smithi084.stdout:3573: done (1 left) 2024-03-30T12:34:41.394 INFO:tasks.rados.rados.0.smithi084.stdout:3575: done (0 left) 2024-03-30T12:34:41.395 INFO:tasks.rados.rados.0.smithi084.stdout:3576: snap_create 2024-03-30T12:34:41.698 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:41.400+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:41.698 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:41.400+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:41.698 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:41.401+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:41.698 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:41.401+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:41.698 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:41.401+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:41.698 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:41.401+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:41.699 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[91810]: osdmap e784: 8 total, 8 up, 8 in 2024-03-30T12:34:41.699 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:41.699 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:41.699 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:41.699 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:41.699 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:41.699 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:41.699 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:41.699 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:41.699 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:41.700 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:41.700 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:41.700 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[91810]: pgmap v867: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 3.8 MiB/s rd, 362 KiB/s wr, 5 op/s 2024-03-30T12:34:41.700 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[89279]: osdmap e784: 8 total, 8 up, 8 in 2024-03-30T12:34:41.700 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:41.700 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:41.700 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:41.700 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:41.700 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:41.700 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:41.701 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:41.701 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:41.701 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:41.701 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:41.701 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:41.701 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[89279]: pgmap v867: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 3.8 MiB/s rd, 362 KiB/s wr, 5 op/s 2024-03-30T12:34:41.701 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:41.701 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:41.701 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:41.702 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:41.702 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:41.400+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:41.702 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:41.400+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:41.702 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:41.400+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:41.703 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-mon[83709]: osdmap e784: 8 total, 8 up, 8 in 2024-03-30T12:34:41.703 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:41.703 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:41.703 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:41.703 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:41.703 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:41.703 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:41.703 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:41.703 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:41.703 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:41.703 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:41.704 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:41.704 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-mon[83709]: pgmap v867: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 3.8 MiB/s rd, 362 KiB/s wr, 5 op/s 2024-03-30T12:34:41.704 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:41.704 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:42.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:41.705+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:42.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:41.706+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:42.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:41.706+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:42.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:41.706+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:42.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:41.706+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:42.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:41.707+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:42.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:41.707+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:42.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:41.708+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:42.401 INFO:tasks.rados.rados.0.smithi084.stdout:3576: done (0 left) 2024-03-30T12:34:42.401 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 359 2024-03-30T12:34:42.401 INFO:tasks.rados.rados.0.smithi084.stdout:3577: seq_num 1100 ranges {2252800=425984,2678784=729088,3407872=475136} 2024-03-30T12:34:42.415 INFO:tasks.rados.rados.0.smithi084.stdout:3577: writing smithi08477944-48 from 2252800 to 2678784 tid 1 2024-03-30T12:34:42.420 INFO:tasks.rados.rados.0.smithi084.stdout:3577: writing smithi08477944-48 from 2678784 to 3407872 tid 2 2024-03-30T12:34:42.423 INFO:tasks.rados.rados.0.smithi084.stdout:3577: writing smithi08477944-48 from 3407872 to 3883008 tid 3 2024-03-30T12:34:42.423 INFO:tasks.rados.rados.0.smithi084.stdout:3578: snap_create 2024-03-30T12:34:42.423 INFO:tasks.rados.rados.0.smithi084.stdout:3577: finishing write tid 1 to smithi08477944-48 2024-03-30T12:34:42.426 INFO:tasks.rados.rados.0.smithi084.stdout:3577: finishing write tid 2 to smithi08477944-48 2024-03-30T12:34:42.426 INFO:tasks.rados.rados.0.smithi084.stdout:3577: finishing write tid 3 to smithi08477944-48 2024-03-30T12:34:42.426 INFO:tasks.rados.rados.0.smithi084.stdout:3577: finishing write tid 4 to smithi08477944-48 2024-03-30T12:34:42.428 INFO:tasks.rados.rados.0.smithi084.stdout:3577: finishing write tid 5 to smithi08477944-48 2024-03-30T12:34:42.428 INFO:tasks.rados.rados.0.smithi084.stdout:3577: oid 48 updating version 0 to 23435 2024-03-30T12:34:42.428 INFO:tasks.rados.rados.0.smithi084.stdout:3577: oid 48 updating version 23435 to 23436 2024-03-30T12:34:42.428 INFO:tasks.rados.rados.0.smithi084.stdout:3577: oid 48 updating version 23436 to 23437 2024-03-30T12:34:42.428 INFO:tasks.rados.rados.0.smithi084.stdout:3577: oid 48 version 23437 is already newer than 23434 2024-03-30T12:34:42.428 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 23437 (ObjNum 1100 snap 359 seq_num 1100) dirty exists 2024-03-30T12:34:42.428 INFO:tasks.rados.rados.0.smithi084.stdout:3577: left oid 48 (ObjNum 1100 snap 359 seq_num 1100) 2024-03-30T12:34:42.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:42.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:42.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:42.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:42.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:42.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:42.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[89279]: osdmap e785: 8 total, 8 up, 8 in 2024-03-30T12:34:42.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:42.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:42.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:42.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:42.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:42.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:42.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:42.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:42.408+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:42.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:42.408+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:42.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:42.409+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:42.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:42.409+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:42.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:42.410+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:42.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:42.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:42.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:42.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:42.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:42.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:42.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[91810]: osdmap e785: 8 total, 8 up, 8 in 2024-03-30T12:34:42.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:42.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:42.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:42.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:42.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:42.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:42.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:42.798 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:42.413+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:42.799 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:42.413+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:42.799 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:42.799 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:42.799 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:42.799 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:42.799 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:42.799 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:42.800 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:42 smithi162 ceph-mon[83709]: osdmap e785: 8 total, 8 up, 8 in 2024-03-30T12:34:42.800 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:42.800 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:42.800 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:42.800 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:42.800 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:42.800 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:42.800 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:43.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:42.806+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:43.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:42.806+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:43.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:42.807+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:43.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:42.808+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:43.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:42.808+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:43.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:42.805+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:43.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:42.805+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:43.408 INFO:tasks.rados.rados.0.smithi084.stdout:3577: done (1 left) 2024-03-30T12:34:43.408 INFO:tasks.rados.rados.0.smithi084.stdout:3578: done (0 left) 2024-03-30T12:34:43.408 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 31 current snap is 360 2024-03-30T12:34:43.408 INFO:tasks.rados.rados.0.smithi084.stdout:3579: seq_num 1101 ranges {5701632=442368,6144000=606208,6750208=598016} 2024-03-30T12:34:43.441 INFO:tasks.rados.rados.0.smithi084.stdout:3579: writing smithi08477944-31 from 5701632 to 6144000 tid 1 2024-03-30T12:34:43.444 INFO:tasks.rados.rados.0.smithi084.stdout:3579: writing smithi08477944-31 from 6144000 to 6750208 tid 2 2024-03-30T12:34:43.449 INFO:tasks.rados.rados.0.smithi084.stdout:3579: writing smithi08477944-31 from 6750208 to 7348224 tid 3 2024-03-30T12:34:43.449 INFO:tasks.rados.rados.0.smithi084.stdout:3580: copy_from oid 50 from oid 15 current snap is 360 2024-03-30T12:34:43.449 INFO:tasks.rados.rados.0.smithi084.stdout:3581: snap_create 2024-03-30T12:34:43.450 INFO:tasks.rados.rados.0.smithi084.stdout:3579: finishing write tid 1 to smithi08477944-31 2024-03-30T12:34:43.457 INFO:tasks.rados.rados.0.smithi084.stdout:3579: finishing write tid 2 to smithi08477944-31 2024-03-30T12:34:43.457 INFO:tasks.rados.rados.0.smithi084.stdout:3579: finishing write tid 3 to smithi08477944-31 2024-03-30T12:34:43.457 INFO:tasks.rados.rados.0.smithi084.stdout:3579: finishing write tid 4 to smithi08477944-31 2024-03-30T12:34:43.459 INFO:tasks.rados.rados.0.smithi084.stdout:3579: finishing write tid 5 to smithi08477944-31 2024-03-30T12:34:43.459 INFO:tasks.rados.rados.0.smithi084.stdout:3579: oid 31 updating version 0 to 36317 2024-03-30T12:34:43.459 INFO:tasks.rados.rados.0.smithi084.stdout:3579: oid 31 updating version 36317 to 36320 2024-03-30T12:34:43.459 INFO:tasks.rados.rados.0.smithi084.stdout:3579: oid 31 version 36320 is already newer than 36319 2024-03-30T12:34:43.459 INFO:tasks.rados.rados.0.smithi084.stdout:3579: oid 31 version 36320 is already newer than 36318 2024-03-30T12:34:43.459 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 36320 (ObjNum 1101 snap 360 seq_num 1101) dirty exists 2024-03-30T12:34:43.459 INFO:tasks.rados.rados.0.smithi084.stdout:3579: left oid 31 (ObjNum 1101 snap 360 seq_num 1101) 2024-03-30T12:34:43.462 INFO:tasks.rados.rados.0.smithi084.stdout:3580: finishing copy_from racing read to smithi08477944-50 2024-03-30T12:34:43.465 INFO:tasks.rados.rados.0.smithi084.stdout:3580: finishing copy_from to smithi08477944-50 2024-03-30T12:34:43.465 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 27318 (ObjNum 955 snap 303 seq_num 955) dirty exists 2024-03-30T12:34:43.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:43.456+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:43.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:43.456+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:43.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:43.452+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:43.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:43.452+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:43.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:43.456+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:43.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:43.456+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:43.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:43.456+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:43.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:43.458+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[89279]: osdmap e786: 8 total, 8 up, 8 in 2024-03-30T12:34:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[89279]: pgmap v870: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 5.6 MiB/s rd, 1.9 MiB/s wr, 16 op/s 2024-03-30T12:34:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:43.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:43.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:43.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:43.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:43.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:43.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:43.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:43.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[91810]: osdmap e786: 8 total, 8 up, 8 in 2024-03-30T12:34:43.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:43.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:43.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:43.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:43.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[91810]: pgmap v870: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 5.6 MiB/s rd, 1.9 MiB/s wr, 16 op/s 2024-03-30T12:34:43.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:43.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:43.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:43.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:43.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:43.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:43.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:43.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:43.458+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:43.869 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:43.414+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:43.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:43.415+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:43.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:43.416+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:43.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:43.416+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:43.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:43.416+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:43.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:43.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:43.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:43 smithi162 ceph-mon[83709]: osdmap e786: 8 total, 8 up, 8 in 2024-03-30T12:34:43.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:43.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:43.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:43.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:43.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:43 smithi162 ceph-mon[83709]: pgmap v870: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 5.6 MiB/s rd, 1.9 MiB/s wr, 16 op/s 2024-03-30T12:34:43.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:43.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:43.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:43.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:43.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:43.872 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:43.455+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:43.872 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:43.455+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:43.872 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:43.456+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:43.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:43.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:44.412 INFO:tasks.rados.rados.0.smithi084.stdout:3579: done (2 left) 2024-03-30T12:34:44.412 INFO:tasks.rados.rados.0.smithi084.stdout:3580: done (1 left) 2024-03-30T12:34:44.412 INFO:tasks.rados.rados.0.smithi084.stdout:3581: done (0 left) 2024-03-30T12:34:44.412 INFO:tasks.rados.rados.0.smithi084.stdout:3582: rollback oid 31 current snap is 361 2024-03-30T12:34:44.412 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 31 to 341 2024-03-30T12:34:44.412 INFO:tasks.rados.rados.0.smithi084.stdout:3583: read oid 29 snap -1 2024-03-30T12:34:44.412 INFO:tasks.rados.rados.0.smithi084.stdout:3583: expect (ObjNum 946 snap 301 seq_num 946) 2024-03-30T12:34:44.412 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 30 current snap is 361 2024-03-30T12:34:44.412 INFO:tasks.rados.rados.0.smithi084.stdout:3584: seq_num 1102 ranges {1884160=458752,2342912=491520,2834432=491520,3325952=221184} 2024-03-30T12:34:44.425 INFO:tasks.rados.rados.0.smithi084.stdout:3584: writing smithi08477944-30 from 1884160 to 2342912 tid 1 2024-03-30T12:34:44.428 INFO:tasks.rados.rados.0.smithi084.stdout:3584: writing smithi08477944-30 from 2342912 to 2834432 tid 2 2024-03-30T12:34:44.431 INFO:tasks.rados.rados.0.smithi084.stdout:3584: writing smithi08477944-30 from 2834432 to 3325952 tid 3 2024-03-30T12:34:44.433 INFO:tasks.rados.rados.0.smithi084.stdout:3584: writing smithi08477944-30 from 3325952 to 3547136 tid 4 2024-03-30T12:34:44.433 INFO:tasks.rados.rados.0.smithi084.stdout:3585: copy_from oid 44 from oid 10 current snap is 361 2024-03-30T12:34:44.433 INFO:tasks.rados.rados.0.smithi084.stdout:3582: finishing rollback tid 0 to smithi08477944-31 2024-03-30T12:34:44.433 INFO:tasks.rados.rados.0.smithi084.stdout:3582: finishing rollback tid 1 to smithi08477944-31 2024-03-30T12:34:44.433 INFO:tasks.rados.rados.0.smithi084.stdout:3582: finishing rollback tid 2 to smithi08477944-31 2024-03-30T12:34:44.433 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 36323 (ObjNum 1007 snap 325 seq_num 1007) dirty exists 2024-03-30T12:34:44.433 INFO:tasks.rados.rados.0.smithi084.stdout:3582: done (3 left) 2024-03-30T12:34:44.433 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 361 2024-03-30T12:34:44.434 INFO:tasks.rados.rados.0.smithi084.stdout:3586: seq_num 1103 ranges {1335296=475136,1810432=425984,2236416=696320,2932736=81920} 2024-03-30T12:34:44.443 INFO:tasks.rados.rados.0.smithi084.stdout:3586: writing smithi08477944-22 from 1335296 to 1810432 tid 1 2024-03-30T12:34:44.446 INFO:tasks.rados.rados.0.smithi084.stdout:3586: writing smithi08477944-22 from 1810432 to 2236416 tid 2 2024-03-30T12:34:44.450 INFO:tasks.rados.rados.0.smithi084.stdout:3586: writing smithi08477944-22 from 2236416 to 2932736 tid 3 2024-03-30T12:34:44.451 INFO:tasks.rados.rados.0.smithi084.stdout:3586: writing smithi08477944-22 from 2932736 to 3014656 tid 4 2024-03-30T12:34:44.451 INFO:tasks.rados.rados.0.smithi084.stdout:3587: snap_remove snap 358 2024-03-30T12:34:44.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:44.419+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:44.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:44.419+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:44.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:44.417+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:44.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:44.418+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:44.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:44.418+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:44.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:44.418+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:44.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:44.418+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:44.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[89279]: osdmap e787: 8 total, 8 up, 8 in 2024-03-30T12:34:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:44.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:44.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:44.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[91810]: osdmap e787: 8 total, 8 up, 8 in 2024-03-30T12:34:44.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:44.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:44.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:44.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:44.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:44.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:44.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:44.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:44.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:44.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:44.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:44.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:44.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:44.447+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:44.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:44.415+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:44.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:44.415+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:44.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:44.424+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:44.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:44.424+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:44.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:44.455+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:44.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:44.457+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:44 smithi162 ceph-mon[83709]: osdmap e787: 8 total, 8 up, 8 in 2024-03-30T12:34:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:44.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:44.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:45.427 INFO:tasks.rados.rados.0.smithi084.stdout:3587: done (4 left) 2024-03-30T12:34:45.442 INFO:tasks.rados.rados.0.smithi084.stdout:3588: snap_remove snap 360 2024-03-30T12:34:45.673 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:45.434+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:45.673 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:45.434+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:45.674 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:45.434+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:45.674 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:45.434+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:45.674 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:45.434+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:45.674 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:45.434+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:45.674 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[91810]: osdmap e788: 8 total, 8 up, 8 in 2024-03-30T12:34:45.674 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:45.674 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:45.674 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:45.675 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:45.675 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:45.675 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:45.675 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:45.675 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:45.675 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:45.675 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:45.675 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:45.675 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:45.675 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:45.675 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:34:45.675 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[91810]: pgmap v873: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 4.2 MiB/s rd, 4.2 MiB/s wr, 16 op/s 2024-03-30T12:34:45.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[89279]: osdmap e788: 8 total, 8 up, 8 in 2024-03-30T12:34:45.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:45.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:45.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:45.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:45.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:45.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:45.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:45.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:45.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:45.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:45.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:45.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:45.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:45.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:34:45.677 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-mon[89279]: pgmap v873: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 4.2 MiB/s rd, 4.2 MiB/s wr, 16 op/s 2024-03-30T12:34:45.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:45.613+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:45.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:45.435+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:45.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:45.435+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:45.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:45.435+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:45.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:45.435+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:45.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:45.435+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:45.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:45.680+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:45.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:45.680+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:45.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:45.680+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:45.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:45 smithi162 ceph-mon[83709]: osdmap e788: 8 total, 8 up, 8 in 2024-03-30T12:34:45.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:45.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:45.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:45.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:45.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:45.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:45.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:45.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:45.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:45.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:45.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:45.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:45.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:45.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:34:45.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:45 smithi162 ceph-mon[83709]: pgmap v873: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 4.2 MiB/s rd, 4.2 MiB/s wr, 16 op/s 2024-03-30T12:34:46.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:45.680+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:46.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:45.680+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:46.441 INFO:tasks.rados.rados.0.smithi084.stdout:3588: done (4 left) 2024-03-30T12:34:46.441 INFO:tasks.rados.rados.0.smithi084.stdout:3589: read oid 9 snap -1 2024-03-30T12:34:46.442 INFO:tasks.rados.rados.0.smithi084.stdout:3589: expect deleted 2024-03-30T12:34:46.442 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 361 2024-03-30T12:34:46.442 INFO:tasks.rados.rados.0.smithi084.stdout:3584: finishing write tid 1 to smithi08477944-30 2024-03-30T12:34:46.442 INFO:tasks.rados.rados.0.smithi084.stdout:3590: seq_num 1104 ranges {8208384=499712,8708096=712704,9420800=491520} 2024-03-30T12:34:46.487 INFO:tasks.rados.rados.0.smithi084.stdout:3590: writing smithi08477944-1 from 8208384 to 8708096 tid 1 2024-03-30T12:34:46.491 INFO:tasks.rados.rados.0.smithi084.stdout:3590: writing smithi08477944-1 from 8708096 to 9420800 tid 2 2024-03-30T12:34:46.495 INFO:tasks.rados.rados.0.smithi084.stdout:3590: writing smithi08477944-1 from 9420800 to 9912320 tid 3 2024-03-30T12:34:46.495 INFO:tasks.rados.rados.0.smithi084.stdout:3591: snap_create 2024-03-30T12:34:46.495 INFO:tasks.rados.rados.0.smithi084.stdout:3584: finishing write tid 2 to smithi08477944-30 2024-03-30T12:34:46.495 INFO:tasks.rados.rados.0.smithi084.stdout:3584: finishing write tid 3 to smithi08477944-30 2024-03-30T12:34:46.495 INFO:tasks.rados.rados.0.smithi084.stdout:3585: finishing copy_from racing read to smithi08477944-44 2024-03-30T12:34:46.495 INFO:tasks.rados.rados.0.smithi084.stdout:3583: expect (ObjNum 946 snap 301 seq_num 946) 2024-03-30T12:34:46.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:46.502+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:46.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:46.502+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:46.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:46.447+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:46.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:46.447+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:46.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:46.448+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:46.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:46.448+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:46.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:46.448+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:46.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:46.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:46.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:46.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:46.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:46.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:46.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[91810]: osdmap e789: 8 total, 8 up, 8 in 2024-03-30T12:34:46.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:46.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:46.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:46.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:46.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:46.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:46.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:46.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:46.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:46.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:46.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:46.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[89279]: osdmap e789: 8 total, 8 up, 8 in 2024-03-30T12:34:46.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:46.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:46.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:46.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:46.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:46.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:46.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:46.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:46.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:46.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:46.444+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:46.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:46.444+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:46.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:46.448+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:46.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:46.448+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:46.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:46.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:46.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:46.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:46.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:46.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:46.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:46 smithi162 ceph-mon[83709]: osdmap e789: 8 total, 8 up, 8 in 2024-03-30T12:34:46.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:46.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:46.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:46.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:46.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:46.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:46.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:47.057 INFO:tasks.rados.rados.0.smithi084.stdout:3584: finishing write tid 4 to smithi08477944-30 2024-03-30T12:34:47.057 INFO:tasks.rados.rados.0.smithi084.stdout:3584: finishing write tid 5 to smithi08477944-30 2024-03-30T12:34:47.057 INFO:tasks.rados.rados.0.smithi084.stdout:3585: finishing copy_from to smithi08477944-44 2024-03-30T12:34:47.057 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 27375 (ObjNum 947 snap 301 seq_num 947) dirty exists 2024-03-30T12:34:47.057 INFO:tasks.rados.rados.0.smithi084.stdout:3584: finishing write tid 6 to smithi08477944-30 2024-03-30T12:34:47.057 INFO:tasks.rados.rados.0.smithi084.stdout:3584: oid 30 updating version 0 to 27317 2024-03-30T12:34:47.057 INFO:tasks.rados.rados.0.smithi084.stdout:3584: oid 30 version 27317 is already newer than 27316 2024-03-30T12:34:47.058 INFO:tasks.rados.rados.0.smithi084.stdout:3584: oid 30 updating version 27317 to 27318 2024-03-30T12:34:47.058 INFO:tasks.rados.rados.0.smithi084.stdout:3584: oid 30 updating version 27318 to 27319 2024-03-30T12:34:47.058 INFO:tasks.rados.rados.0.smithi084.stdout:3584: oid 30 version 27319 is already newer than 27315 2024-03-30T12:34:47.058 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 27319 (ObjNum 1102 snap 361 seq_num 1102) dirty exists 2024-03-30T12:34:47.058 INFO:tasks.rados.rados.0.smithi084.stdout:3584: left oid 30 (ObjNum 1102 snap 361 seq_num 1102) 2024-03-30T12:34:47.058 INFO:tasks.rados.rados.0.smithi084.stdout:3586: finishing write tid 1 to smithi08477944-22 2024-03-30T12:34:47.058 INFO:tasks.rados.rados.0.smithi084.stdout:3586: finishing write tid 2 to smithi08477944-22 2024-03-30T12:34:47.058 INFO:tasks.rados.rados.0.smithi084.stdout:3586: finishing write tid 3 to smithi08477944-22 2024-03-30T12:34:47.058 INFO:tasks.rados.rados.0.smithi084.stdout:3586: finishing write tid 4 to smithi08477944-22 2024-03-30T12:34:47.058 INFO:tasks.rados.rados.0.smithi084.stdout:3586: finishing write tid 5 to smithi08477944-22 2024-03-30T12:34:47.058 INFO:tasks.rados.rados.0.smithi084.stdout:3586: finishing write tid 6 to smithi08477944-22 2024-03-30T12:34:47.058 INFO:tasks.rados.rados.0.smithi084.stdout:3586: oid 22 updating version 0 to 36307 2024-03-30T12:34:47.058 INFO:tasks.rados.rados.0.smithi084.stdout:3586: oid 22 updating version 36307 to 36308 2024-03-30T12:34:47.059 INFO:tasks.rados.rados.0.smithi084.stdout:3586: oid 22 updating version 36308 to 36311 2024-03-30T12:34:47.059 INFO:tasks.rados.rados.0.smithi084.stdout:3586: oid 22 version 36311 is already newer than 36310 2024-03-30T12:34:47.059 INFO:tasks.rados.rados.0.smithi084.stdout:3586: oid 22 version 36311 is already newer than 36309 2024-03-30T12:34:47.059 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 36311 (ObjNum 1103 snap 361 seq_num 1103) dirty exists 2024-03-30T12:34:47.059 INFO:tasks.rados.rados.0.smithi084.stdout:3586: left oid 22 (ObjNum 1103 snap 361 seq_num 1103) 2024-03-30T12:34:47.059 INFO:tasks.rados.rados.0.smithi084.stdout:3590: finishing write tid 1 to smithi08477944-1 2024-03-30T12:34:47.059 INFO:tasks.rados.rados.0.smithi084.stdout:3590: finishing write tid 2 to smithi08477944-1 2024-03-30T12:34:47.059 INFO:tasks.rados.rados.0.smithi084.stdout:3590: finishing write tid 3 to smithi08477944-1 2024-03-30T12:34:47.059 INFO:tasks.rados.rados.0.smithi084.stdout:3590: finishing write tid 4 to smithi08477944-1 2024-03-30T12:34:47.059 INFO:tasks.rados.rados.0.smithi084.stdout:3590: finishing write tid 5 to smithi08477944-1 2024-03-30T12:34:47.059 INFO:tasks.rados.rados.0.smithi084.stdout:3590: oid 1 updating version 0 to 36312 2024-03-30T12:34:47.059 INFO:tasks.rados.rados.0.smithi084.stdout:3590: oid 1 version 36312 is already newer than 36311 2024-03-30T12:34:47.059 INFO:tasks.rados.rados.0.smithi084.stdout:3590: oid 1 updating version 36312 to 36313 2024-03-30T12:34:47.059 INFO:tasks.rados.rados.0.smithi084.stdout:3590: oid 1 version 36313 is already newer than 36310 2024-03-30T12:34:47.060 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 36313 (ObjNum 1104 snap 361 seq_num 1104) dirty exists 2024-03-30T12:34:47.060 INFO:tasks.rados.rados.0.smithi084.stdout:3590: left oid 1 (ObjNum 1104 snap 361 seq_num 1104) 2024-03-30T12:34:47.442 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:47.449+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:47.442 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:47.449+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:47.442 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:47.200+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:47.442 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:47.200+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:47.443 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:47.443 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:47.443 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:47.443 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:47.443 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:47.443 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:47.443 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:47.443 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:47.444 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:47 smithi162 ceph-mon[83709]: osdmap e790: 8 total, 8 up, 8 in 2024-03-30T12:34:47.444 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:47.444 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:47.444 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:47 smithi162 ceph-mon[83709]: pgmap v876: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-03-30T12:34:47.444 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:47.444 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:47.445 INFO:tasks.rados.rados.0.smithi084.stdout:3583: done (6 left) 2024-03-30T12:34:47.445 INFO:tasks.rados.rados.0.smithi084.stdout:3584: done (5 left) 2024-03-30T12:34:47.445 INFO:tasks.rados.rados.0.smithi084.stdout:3585: done (4 left) 2024-03-30T12:34:47.445 INFO:tasks.rados.rados.0.smithi084.stdout:3586: done (3 left) 2024-03-30T12:34:47.445 INFO:tasks.rados.rados.0.smithi084.stdout:3589: done (2 left) 2024-03-30T12:34:47.445 INFO:tasks.rados.rados.0.smithi084.stdout:3590: done (1 left) 2024-03-30T12:34:47.445 INFO:tasks.rados.rados.0.smithi084.stdout:3591: done (0 left) 2024-03-30T12:34:47.445 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 25 current snap is 362 2024-03-30T12:34:47.445 INFO:tasks.rados.rados.0.smithi084.stdout:3592: seq_num 1105 ranges {0=516096,516096=598016,1114112=606208} 2024-03-30T12:34:47.445 INFO:tasks.rados.rados.0.smithi084.stdout:3592: writing smithi08477944-25 from 0 to 516096 tid 1 2024-03-30T12:34:47.448 INFO:tasks.rados.rados.0.smithi084.stdout:3592: writing smithi08477944-25 from 516096 to 1114112 tid 2 2024-03-30T12:34:47.452 INFO:tasks.rados.rados.0.smithi084.stdout:3592: writing smithi08477944-25 from 1114112 to 1720320 tid 3 2024-03-30T12:34:47.453 INFO:tasks.rados.rados.0.smithi084.stdout:3593: read oid 17 snap -1 2024-03-30T12:34:47.453 INFO:tasks.rados.rados.0.smithi084.stdout:3593: expect (ObjNum 1055 snap 337 seq_num 1055) 2024-03-30T12:34:47.453 INFO:tasks.rados.rados.0.smithi084.stdout:3594: read oid 22 snap -1 2024-03-30T12:34:47.453 INFO:tasks.rados.rados.0.smithi084.stdout:3594: expect (ObjNum 1103 snap 361 seq_num 1103) 2024-03-30T12:34:47.453 INFO:tasks.rados.rados.0.smithi084.stdout:3595: snap_remove snap 334 2024-03-30T12:34:47.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:47.464+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:47.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:47.466+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:47.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:47.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:47.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:47.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:47.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:47.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:47.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:47.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:47.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[91810]: osdmap e790: 8 total, 8 up, 8 in 2024-03-30T12:34:47.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:47.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:47.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[91810]: pgmap v876: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-03-30T12:34:47.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:47.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:47.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:47.457+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:47.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:47.457+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:47.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:47.457+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:47.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:47.457+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:47.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:47.457+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:47.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:47.457+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:47.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:47.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:47.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:47.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:47.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:47.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:47.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:47.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:47.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[89279]: osdmap e790: 8 total, 8 up, 8 in 2024-03-30T12:34:47.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:47.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:47.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[89279]: pgmap v876: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 4 op/s 2024-03-30T12:34:47.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:47.758 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:47.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:47.449+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:47.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:47.450+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:47.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:47.451+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:47.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:47.458+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:47.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:47.459+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:47.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:47.459+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:48.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:47.934+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:48.454 INFO:tasks.rados.rados.0.smithi084.stdout:3595: done (3 left) 2024-03-30T12:34:48.454 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 362 2024-03-30T12:34:48.454 INFO:tasks.rados.rados.0.smithi084.stdout:3596: seq_num 1106 ranges {1499136=532480,2031616=483328,2514944=475136,2990080=245760} 2024-03-30T12:34:48.465 INFO:tasks.rados.rados.0.smithi084.stdout:3596: writing smithi08477944-20 from 1499136 to 2031616 tid 1 2024-03-30T12:34:48.467 INFO:tasks.rados.rados.0.smithi084.stdout:3596: writing smithi08477944-20 from 2031616 to 2514944 tid 2 2024-03-30T12:34:48.471 INFO:tasks.rados.rados.0.smithi084.stdout:3596: writing smithi08477944-20 from 2514944 to 2990080 tid 3 2024-03-30T12:34:48.473 INFO:tasks.rados.rados.0.smithi084.stdout:3596: writing smithi08477944-20 from 2990080 to 3235840 tid 4 2024-03-30T12:34:48.473 INFO:tasks.rados.rados.0.smithi084.stdout:3597: read oid 34 snap -1 2024-03-30T12:34:48.473 INFO:tasks.rados.rados.0.smithi084.stdout:3597: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:34:48.473 INFO:tasks.rados.rados.0.smithi084.stdout:3598: rollback oid 14 current snap is 362 2024-03-30T12:34:48.474 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 14 to 341 2024-03-30T12:34:48.474 INFO:tasks.rados.rados.0.smithi084.stdout:3592: finishing write tid 1 to smithi08477944-25 2024-03-30T12:34:48.474 INFO:tasks.rados.rados.0.smithi084.stdout:3592: finishing write tid 2 to smithi08477944-25 2024-03-30T12:34:48.474 INFO:tasks.rados.rados.0.smithi084.stdout:3592: finishing write tid 3 to smithi08477944-25 2024-03-30T12:34:48.474 INFO:tasks.rados.rados.0.smithi084.stdout:3592: finishing write tid 4 to smithi08477944-25 2024-03-30T12:34:48.474 INFO:tasks.rados.rados.0.smithi084.stdout:3592: finishing write tid 5 to smithi08477944-25 2024-03-30T12:34:48.474 INFO:tasks.rados.rados.0.smithi084.stdout:3592: oid 25 updating version 0 to 27311 2024-03-30T12:34:48.474 INFO:tasks.rados.rados.0.smithi084.stdout:3592: oid 25 version 27311 is already newer than 27310 2024-03-30T12:34:48.474 INFO:tasks.rados.rados.0.smithi084.stdout:3592: oid 25 updating version 27311 to 27312 2024-03-30T12:34:48.474 INFO:tasks.rados.rados.0.smithi084.stdout:3592: oid 25 version 27312 is already newer than 27309 2024-03-30T12:34:48.474 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 27312 (ObjNum 1105 snap 362 seq_num 1105) dirty exists 2024-03-30T12:34:48.474 INFO:tasks.rados.rados.0.smithi084.stdout:3592: left oid 25 (ObjNum 1105 snap 362 seq_num 1105) 2024-03-30T12:34:48.475 INFO:tasks.rados.rados.0.smithi084.stdout:3593: expect (ObjNum 1055 snap 337 seq_num 1055) 2024-03-30T12:34:48.503 INFO:tasks.rados.rados.0.smithi084.stdout:3594: expect (ObjNum 1103 snap 361 seq_num 1103) 2024-03-30T12:34:48.618 INFO:tasks.rados.rados.0.smithi084.stdout:3596: finishing write tid 1 to smithi08477944-20 2024-03-30T12:34:48.618 INFO:tasks.rados.rados.0.smithi084.stdout:3596: finishing write tid 2 to smithi08477944-20 2024-03-30T12:34:48.618 INFO:tasks.rados.rados.0.smithi084.stdout:3592: done (5 left) 2024-03-30T12:34:48.618 INFO:tasks.rados.rados.0.smithi084.stdout:3593: done (4 left) 2024-03-30T12:34:48.618 INFO:tasks.rados.rados.0.smithi084.stdout:3594: done (3 left) 2024-03-30T12:34:48.618 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 37 current snap is 362 2024-03-30T12:34:48.618 INFO:tasks.rados.rados.0.smithi084.stdout:3596: finishing write tid 3 to smithi08477944-20 2024-03-30T12:34:48.618 INFO:tasks.rados.rados.0.smithi084.stdout:3599: seq_num 1107 ranges {0=548864,548864=770048,1318912=434176} 2024-03-30T12:34:48.620 INFO:tasks.rados.rados.0.smithi084.stdout:3599: writing smithi08477944-37 from 0 to 548864 tid 1 2024-03-30T12:34:48.624 INFO:tasks.rados.rados.0.smithi084.stdout:3599: writing smithi08477944-37 from 548864 to 1318912 tid 2 2024-03-30T12:34:48.627 INFO:tasks.rados.rados.0.smithi084.stdout:3599: writing smithi08477944-37 from 1318912 to 1753088 tid 3 2024-03-30T12:34:48.627 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 362 2024-03-30T12:34:48.627 INFO:tasks.rados.rados.0.smithi084.stdout:3600: seq_num 1108 ranges {1327104=565248,1892352=647168,2539520=483328,3022848=73728} 2024-03-30T12:34:48.637 INFO:tasks.rados.rados.0.smithi084.stdout:3600: writing smithi08477944-24 from 1327104 to 1892352 tid 1 2024-03-30T12:34:48.640 INFO:tasks.rados.rados.0.smithi084.stdout:3600: writing smithi08477944-24 from 1892352 to 2539520 tid 2 2024-03-30T12:34:48.643 INFO:tasks.rados.rados.0.smithi084.stdout:3600: writing smithi08477944-24 from 2539520 to 3022848 tid 3 2024-03-30T12:34:48.644 INFO:tasks.rados.rados.0.smithi084.stdout:3600: writing smithi08477944-24 from 3022848 to 3096576 tid 4 2024-03-30T12:34:48.644 INFO:tasks.rados.rados.0.smithi084.stdout:3601: snap_create 2024-03-30T12:34:48.644 INFO:tasks.rados.rados.0.smithi084.stdout:3597: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:34:48.646 INFO:tasks.rados.rados.0.smithi084.stdout:3596: finishing write tid 4 to smithi08477944-20 2024-03-30T12:34:48.647 INFO:tasks.rados.rados.0.smithi084.stdout:3596: finishing write tid 5 to smithi08477944-20 2024-03-30T12:34:48.647 INFO:tasks.rados.rados.0.smithi084.stdout:3596: finishing write tid 6 to smithi08477944-20 2024-03-30T12:34:48.647 INFO:tasks.rados.rados.0.smithi084.stdout:3596: oid 20 updating version 0 to 36303 2024-03-30T12:34:48.647 INFO:tasks.rados.rados.0.smithi084.stdout:3596: oid 20 updating version 36303 to 36306 2024-03-30T12:34:48.647 INFO:tasks.rados.rados.0.smithi084.stdout:3596: oid 20 updating version 36306 to 36307 2024-03-30T12:34:48.647 INFO:tasks.rados.rados.0.smithi084.stdout:3596: oid 20 version 36307 is already newer than 36304 2024-03-30T12:34:48.647 INFO:tasks.rados.rados.0.smithi084.stdout:3596: oid 20 version 36307 is already newer than 36305 2024-03-30T12:34:48.647 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 36307 (ObjNum 1106 snap 362 seq_num 1106) dirty exists 2024-03-30T12:34:48.647 INFO:tasks.rados.rados.0.smithi084.stdout:3596: left oid 20 (ObjNum 1106 snap 362 seq_num 1106) 2024-03-30T12:34:48.647 INFO:tasks.rados.rados.0.smithi084.stdout:3598: finishing rollback tid 0 to smithi08477944-14 2024-03-30T12:34:48.647 INFO:tasks.rados.rados.0.smithi084.stdout:3598: finishing rollback tid 1 to smithi08477944-14 2024-03-30T12:34:48.647 INFO:tasks.rados.rados.0.smithi084.stdout:3598: finishing rollback tid 2 to smithi08477944-14 2024-03-30T12:34:48.648 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 36312 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:34:48.648 INFO:tasks.rados.rados.0.smithi084.stdout:3599: finishing write tid 1 to smithi08477944-37 2024-03-30T12:34:48.648 INFO:tasks.rados.rados.0.smithi084.stdout:3599: finishing write tid 2 to smithi08477944-37 2024-03-30T12:34:48.648 INFO:tasks.rados.rados.0.smithi084.stdout:3599: finishing write tid 3 to smithi08477944-37 2024-03-30T12:34:48.648 INFO:tasks.rados.rados.0.smithi084.stdout:3599: finishing write tid 4 to smithi08477944-37 2024-03-30T12:34:48.648 INFO:tasks.rados.rados.0.smithi084.stdout:3599: finishing write tid 5 to smithi08477944-37 2024-03-30T12:34:48.648 INFO:tasks.rados.rados.0.smithi084.stdout:3599: oid 37 updating version 0 to 36316 2024-03-30T12:34:48.648 INFO:tasks.rados.rados.0.smithi084.stdout:3599: oid 37 version 36316 is already newer than 36315 2024-03-30T12:34:48.648 INFO:tasks.rados.rados.0.smithi084.stdout:3599: oid 37 version 36316 is already newer than 36314 2024-03-30T12:34:48.648 INFO:tasks.rados.rados.0.smithi084.stdout:3599: oid 37 version 36316 is already newer than 36313 2024-03-30T12:34:48.648 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 36316 (ObjNum 1107 snap 362 seq_num 1107) dirty exists 2024-03-30T12:34:48.648 INFO:tasks.rados.rados.0.smithi084.stdout:3599: left oid 37 (ObjNum 1107 snap 362 seq_num 1107) 2024-03-30T12:34:48.653 INFO:tasks.rados.rados.0.smithi084.stdout:3600: finishing write tid 1 to smithi08477944-24 2024-03-30T12:34:48.653 INFO:tasks.rados.rados.0.smithi084.stdout:3600: finishing write tid 2 to smithi08477944-24 2024-03-30T12:34:48.653 INFO:tasks.rados.rados.0.smithi084.stdout:3600: finishing write tid 3 to smithi08477944-24 2024-03-30T12:34:48.661 INFO:tasks.rados.rados.0.smithi084.stdout:3600: finishing write tid 4 to smithi08477944-24 2024-03-30T12:34:48.662 INFO:tasks.rados.rados.0.smithi084.stdout:3600: finishing write tid 5 to smithi08477944-24 2024-03-30T12:34:48.665 INFO:tasks.rados.rados.0.smithi084.stdout:3600: finishing write tid 6 to smithi08477944-24 2024-03-30T12:34:48.665 INFO:tasks.rados.rados.0.smithi084.stdout:3600: oid 24 updating version 0 to 23443 2024-03-30T12:34:48.665 INFO:tasks.rados.rados.0.smithi084.stdout:3600: oid 24 updating version 23443 to 23445 2024-03-30T12:34:48.666 INFO:tasks.rados.rados.0.smithi084.stdout:3600: oid 24 version 23445 is already newer than 23442 2024-03-30T12:34:48.666 INFO:tasks.rados.rados.0.smithi084.stdout:3600: oid 24 version 23445 is already newer than 23444 2024-03-30T12:34:48.666 INFO:tasks.rados.rados.0.smithi084.stdout:3600: oid 24 version 23445 is already newer than 23441 2024-03-30T12:34:48.666 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 23445 (ObjNum 1108 snap 362 seq_num 1108) dirty exists 2024-03-30T12:34:48.666 INFO:tasks.rados.rados.0.smithi084.stdout:3600: left oid 24 (ObjNum 1108 snap 362 seq_num 1108) 2024-03-30T12:34:48.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:48.463+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:48.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:48.463+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:48.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:48.462+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:48.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:48.462+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:48.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:48.462+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:48.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:48.463+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:48.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:48.463+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:48.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:48.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:48.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[91810]: osdmap e791: 8 total, 8 up, 8 in 2024-03-30T12:34:48.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:48.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:48.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:48.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:48.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:48.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:48.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:48.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:48.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:48.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:48.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:48.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:48.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:48.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[89279]: osdmap e791: 8 total, 8 up, 8 in 2024-03-30T12:34:48.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:48.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:48.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:48.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:48.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:48.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:48.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:48.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:48.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:48.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:48.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:48.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:48.499+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:48.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:48.459+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:48.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:48.459+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:48.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:48.486+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:48.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:48.486+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:48.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:48.490+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:48.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:48.490+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:48.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:48.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:48.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:48 smithi162 ceph-mon[83709]: osdmap e791: 8 total, 8 up, 8 in 2024-03-30T12:34:48.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:48.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:48.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:48.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:48.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:48.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:48.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:48.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:48.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:48.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:48.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:49.465 INFO:tasks.rados.rados.0.smithi084.stdout:3596: done (5 left) 2024-03-30T12:34:49.465 INFO:tasks.rados.rados.0.smithi084.stdout:3597: done (4 left) 2024-03-30T12:34:49.465 INFO:tasks.rados.rados.0.smithi084.stdout:3598: done (3 left) 2024-03-30T12:34:49.465 INFO:tasks.rados.rados.0.smithi084.stdout:3599: done (2 left) 2024-03-30T12:34:49.465 INFO:tasks.rados.rados.0.smithi084.stdout:3600: done (1 left) 2024-03-30T12:34:49.465 INFO:tasks.rados.rados.0.smithi084.stdout:3601: done (0 left) 2024-03-30T12:34:49.465 INFO:tasks.rados.rados.0.smithi084.stdout:3602: snap_remove snap 341 2024-03-30T12:34:49.654 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:34:49] "GET /metrics HTTP/1.1" 200 36331 "" "Prometheus/2.43.0" 2024-03-30T12:34:49.655 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:49.470+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:49.655 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:49.470+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:49.655 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:49.470+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:49.655 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:49.471+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:49.655 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:49.471+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:49.655 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:49.471+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:49.656 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:49.656 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:49.656 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[89279]: osdmap e792: 8 total, 8 up, 8 in 2024-03-30T12:34:49.656 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:49.656 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:49.656 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:49.656 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:49.656 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:49.656 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:49.657 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:49.657 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:49.657 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:49.657 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:49.657 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:49.657 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[89279]: pgmap v879: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 5.9 MiB/s rd, 1.9 MiB/s wr, 6 op/s 2024-03-30T12:34:49.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:49.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:49.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[91810]: osdmap e792: 8 total, 8 up, 8 in 2024-03-30T12:34:49.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:49.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:49.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:49.657 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:49.658 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:49.658 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:49.658 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:49.658 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:49.658 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:49.658 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:49.658 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:49.658 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-mon[91810]: pgmap v879: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 5.9 MiB/s rd, 1.9 MiB/s wr, 6 op/s 2024-03-30T12:34:49.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:49.472+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:49.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:49.472+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:49.773 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:49.472+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:49.773 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:49.473+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:49.773 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:49.473+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:49.774 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:49.774 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:49.774 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:49 smithi162 ceph-mon[83709]: osdmap e792: 8 total, 8 up, 8 in 2024-03-30T12:34:49.774 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:49.774 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:49.774 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:49.774 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:49.774 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:49.774 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:49.774 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:49.775 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:49.775 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:49.775 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:49.775 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:49.775 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:49 smithi162 ceph-mon[83709]: pgmap v879: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 5.9 MiB/s rd, 1.9 MiB/s wr, 6 op/s 2024-03-30T12:34:50.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:49.782+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:50.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:49.783+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:50.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:49.781+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:50.119 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:49.782+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:50.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:49.782+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:50.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:49.782+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:50.468 INFO:tasks.rados.rados.0.smithi084.stdout:3602: done (0 left) 2024-03-30T12:34:50.468 INFO:tasks.rados.rados.0.smithi084.stdout:3603: read oid 22 snap 362 2024-03-30T12:34:50.468 INFO:tasks.rados.rados.0.smithi084.stdout:3603: expect (ObjNum 1103 snap 361 seq_num 1103) 2024-03-30T12:34:50.468 INFO:tasks.rados.rados.0.smithi084.stdout:3604: read oid 41 snap -1 2024-03-30T12:34:50.468 INFO:tasks.rados.rados.0.smithi084.stdout:3604: expect (ObjNum 1052 snap 337 seq_num 1052) 2024-03-30T12:34:50.469 INFO:tasks.rados.rados.0.smithi084.stdout:3605: snap_create 2024-03-30T12:34:50.473 INFO:tasks.rados.rados.0.smithi084.stdout:3604: expect (ObjNum 1052 snap 337 seq_num 1052) 2024-03-30T12:34:50.508 INFO:tasks.rados.rados.0.smithi084.stdout:3603: expect (ObjNum 1103 snap 361 seq_num 1103) 2024-03-30T12:34:50.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:50.487+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:50.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:50.487+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:50.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:50.474+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:50.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:50.475+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:50.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:50.475+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:50.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:50.475+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:50.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:50.475+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:50.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:50.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:50.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:50.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:50.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[91810]: osdmap e793: 8 total, 8 up, 8 in 2024-03-30T12:34:50.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:50.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:50.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:50.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:50.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:50.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:50.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:50.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:50.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:50.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:50.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:50.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[89279]: osdmap e793: 8 total, 8 up, 8 in 2024-03-30T12:34:50.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:50.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:50.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:50.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:50.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:50.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:50.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:50.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:50.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:50.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:50.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:50.869 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:50.476+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:50.869 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:50.477+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:50.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:50.475+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:50.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:50.476+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:50.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:50.480+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:50.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:50.482+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:50.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:50.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:50.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:50.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:50.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:50 smithi162 ceph-mon[83709]: osdmap e793: 8 total, 8 up, 8 in 2024-03-30T12:34:50.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:50.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:50.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:50.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:50.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:50.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:50.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:50.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:50.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:51.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:50.881+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:51.473 INFO:tasks.rados.rados.0.smithi084.stdout:3603: done (2 left) 2024-03-30T12:34:51.473 INFO:tasks.rados.rados.0.smithi084.stdout:3604: done (1 left) 2024-03-30T12:34:51.473 INFO:tasks.rados.rados.0.smithi084.stdout:3605: done (0 left) 2024-03-30T12:34:51.473 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 364 2024-03-30T12:34:51.474 INFO:tasks.rados.rados.0.smithi084.stdout:3606: seq_num 1109 ranges {2236416=581632,2818048=532480,3350528=647168,3997696=24576} 2024-03-30T12:34:51.488 INFO:tasks.rados.rados.0.smithi084.stdout:3606: writing smithi08477944-35 from 2236416 to 2818048 tid 1 2024-03-30T12:34:51.491 INFO:tasks.rados.rados.0.smithi084.stdout:3606: writing smithi08477944-35 from 2818048 to 3350528 tid 2 2024-03-30T12:34:51.495 INFO:tasks.rados.rados.0.smithi084.stdout:3606: writing smithi08477944-35 from 3350528 to 3997696 tid 3 2024-03-30T12:34:51.498 INFO:tasks.rados.rados.0.smithi084.stdout:3606: writing smithi08477944-35 from 3997696 to 4022272 tid 4 2024-03-30T12:34:51.498 INFO:tasks.rados.rados.0.smithi084.stdout:3607: delete oid 41 current snap is 364 2024-03-30T12:34:51.498 INFO:tasks.rados.rados.0.smithi084.stdout:3606: finishing write tid 1 to smithi08477944-35 2024-03-30T12:34:51.498 INFO:tasks.rados.rados.0.smithi084.stdout:3606: finishing write tid 2 to smithi08477944-35 2024-03-30T12:34:51.499 INFO:tasks.rados.rados.0.smithi084.stdout:3606: finishing write tid 3 to smithi08477944-35 2024-03-30T12:34:51.501 INFO:tasks.rados.rados.0.smithi084.stdout:3607: done (1 left) 2024-03-30T12:34:51.501 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 364 2024-03-30T12:34:51.501 INFO:tasks.rados.rados.0.smithi084.stdout:3608: seq_num 1111 ranges {0=614400,614400=753664,1368064=450560} 2024-03-30T12:34:51.504 INFO:tasks.rados.rados.0.smithi084.stdout:3608: writing smithi08477944-14 from 0 to 614400 tid 1 2024-03-30T12:34:51.508 INFO:tasks.rados.rados.0.smithi084.stdout:3608: writing smithi08477944-14 from 614400 to 1368064 tid 2 2024-03-30T12:34:51.511 INFO:tasks.rados.rados.0.smithi084.stdout:3608: writing smithi08477944-14 from 1368064 to 1818624 tid 3 2024-03-30T12:34:51.511 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 364 2024-03-30T12:34:51.511 INFO:tasks.rados.rados.0.smithi084.stdout:3606: finishing write tid 4 to smithi08477944-35 2024-03-30T12:34:51.511 INFO:tasks.rados.rados.0.smithi084.stdout:3609: seq_num 1112 ranges {876544=630784,1507328=638976,2146304=466944,2613248=98304} 2024-03-30T12:34:51.519 INFO:tasks.rados.rados.0.smithi084.stdout:3609: writing smithi08477944-17 from 876544 to 1507328 tid 1 2024-03-30T12:34:51.522 INFO:tasks.rados.rados.0.smithi084.stdout:3609: writing smithi08477944-17 from 1507328 to 2146304 tid 2 2024-03-30T12:34:51.525 INFO:tasks.rados.rados.0.smithi084.stdout:3609: writing smithi08477944-17 from 2146304 to 2613248 tid 3 2024-03-30T12:34:51.526 INFO:tasks.rados.rados.0.smithi084.stdout:3609: writing smithi08477944-17 from 2613248 to 2711552 tid 4 2024-03-30T12:34:51.527 INFO:tasks.rados.rados.0.smithi084.stdout:3610: delete oid 23 current snap is 364 2024-03-30T12:34:51.527 INFO:tasks.rados.rados.0.smithi084.stdout:3606: finishing write tid 5 to smithi08477944-35 2024-03-30T12:34:51.527 INFO:tasks.rados.rados.0.smithi084.stdout:3606: finishing write tid 6 to smithi08477944-35 2024-03-30T12:34:51.527 INFO:tasks.rados.rados.0.smithi084.stdout:3606: oid 35 updating version 0 to 36315 2024-03-30T12:34:51.527 INFO:tasks.rados.rados.0.smithi084.stdout:3606: oid 35 updating version 36315 to 36318 2024-03-30T12:34:51.527 INFO:tasks.rados.rados.0.smithi084.stdout:3606: oid 35 version 36318 is already newer than 36317 2024-03-30T12:34:51.527 INFO:tasks.rados.rados.0.smithi084.stdout:3606: oid 35 version 36318 is already newer than 36316 2024-03-30T12:34:51.527 INFO:tasks.rados.rados.0.smithi084.stdout:3606: oid 35 version 36318 is already newer than 36314 2024-03-30T12:34:51.527 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 36318 (ObjNum 1109 snap 364 seq_num 1109) dirty exists 2024-03-30T12:34:51.527 INFO:tasks.rados.rados.0.smithi084.stdout:3606: left oid 35 (ObjNum 1109 snap 364 seq_num 1109) 2024-03-30T12:34:51.527 INFO:tasks.rados.rados.0.smithi084.stdout:3608: finishing write tid 1 to smithi08477944-14 2024-03-30T12:34:51.527 INFO:tasks.rados.rados.0.smithi084.stdout:3608: finishing write tid 2 to smithi08477944-14 2024-03-30T12:34:51.528 INFO:tasks.rados.rados.0.smithi084.stdout:3609: finishing write tid 1 to smithi08477944-17 2024-03-30T12:34:51.528 INFO:tasks.rados.rados.0.smithi084.stdout:3608: finishing write tid 3 to smithi08477944-14 2024-03-30T12:34:51.528 INFO:tasks.rados.rados.0.smithi084.stdout:3608: finishing write tid 4 to smithi08477944-14 2024-03-30T12:34:51.528 INFO:tasks.rados.rados.0.smithi084.stdout:3609: finishing write tid 2 to smithi08477944-17 2024-03-30T12:34:51.529 INFO:tasks.rados.rados.0.smithi084.stdout:3609: finishing write tid 3 to smithi08477944-17 2024-03-30T12:34:51.531 INFO:tasks.rados.rados.0.smithi084.stdout:3606: done (3 left) 2024-03-30T12:34:51.531 INFO:tasks.rados.rados.0.smithi084.stdout:3610: done (2 left) 2024-03-30T12:34:51.531 INFO:tasks.rados.rados.0.smithi084.stdout:3611: read oid 25 snap -1 2024-03-30T12:34:51.531 INFO:tasks.rados.rados.0.smithi084.stdout:3611: expect (ObjNum 1105 snap 362 seq_num 1105) 2024-03-30T12:34:51.531 INFO:tasks.rados.rados.0.smithi084.stdout:3612: delete oid 27 current snap is 364 2024-03-30T12:34:51.531 INFO:tasks.rados.rados.0.smithi084.stdout:3609: finishing write tid 4 to smithi08477944-17 2024-03-30T12:34:51.531 INFO:tasks.rados.rados.0.smithi084.stdout:3609: finishing write tid 5 to smithi08477944-17 2024-03-30T12:34:51.532 INFO:tasks.rados.rados.0.smithi084.stdout:3609: finishing write tid 6 to smithi08477944-17 2024-03-30T12:34:51.532 INFO:tasks.rados.rados.0.smithi084.stdout:3609: oid 17 updating version 0 to 27408 2024-03-30T12:34:51.532 INFO:tasks.rados.rados.0.smithi084.stdout:3609: oid 17 updating version 27408 to 27409 2024-03-30T12:34:51.532 INFO:tasks.rados.rados.0.smithi084.stdout:3609: oid 17 version 27409 is already newer than 27406 2024-03-30T12:34:51.532 INFO:tasks.rados.rados.0.smithi084.stdout:3609: oid 17 version 27409 is already newer than 27405 2024-03-30T12:34:51.532 INFO:tasks.rados.rados.0.smithi084.stdout:3609: oid 17 version 27409 is already newer than 27407 2024-03-30T12:34:51.532 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 27409 (ObjNum 1112 snap 364 seq_num 1112) dirty exists 2024-03-30T12:34:51.532 INFO:tasks.rados.rados.0.smithi084.stdout:3609: left oid 17 (ObjNum 1112 snap 364 seq_num 1112) 2024-03-30T12:34:51.533 INFO:tasks.rados.rados.0.smithi084.stdout:3608: finishing write tid 5 to smithi08477944-14 2024-03-30T12:34:51.533 INFO:tasks.rados.rados.0.smithi084.stdout:3608: oid 14 updating version 0 to 36319 2024-03-30T12:34:51.533 INFO:tasks.rados.rados.0.smithi084.stdout:3608: oid 14 version 36319 is already newer than 36318 2024-03-30T12:34:51.533 INFO:tasks.rados.rados.0.smithi084.stdout:3608: oid 14 version 36319 is already newer than 36317 2024-03-30T12:34:51.533 INFO:tasks.rados.rados.0.smithi084.stdout:3608: oid 14 updating version 36319 to 36320 2024-03-30T12:34:51.533 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 36320 (ObjNum 1111 snap 364 seq_num 1111) dirty exists 2024-03-30T12:34:51.534 INFO:tasks.rados.rados.0.smithi084.stdout:3608: left oid 14 (ObjNum 1111 snap 364 seq_num 1111) 2024-03-30T12:34:51.534 INFO:tasks.rados.rados.0.smithi084.stdout:3608: done (3 left) 2024-03-30T12:34:51.534 INFO:tasks.rados.rados.0.smithi084.stdout:3609: done (2 left) 2024-03-30T12:34:51.534 INFO:tasks.rados.rados.0.smithi084.stdout:3612: done (1 left) 2024-03-30T12:34:51.535 INFO:tasks.rados.rados.0.smithi084.stdout:3613: delete oid 19 current snap is 364 2024-03-30T12:34:51.540 INFO:tasks.rados.rados.0.smithi084.stdout:3611: expect (ObjNum 1105 snap 362 seq_num 1105) 2024-03-30T12:34:51.586 INFO:tasks.rados.rados.0.smithi084.stdout:3611: done (1 left) 2024-03-30T12:34:51.586 INFO:tasks.rados.rados.0.smithi084.stdout:3613: done (0 left) 2024-03-30T12:34:51.586 INFO:tasks.rados.rados.0.smithi084.stdout:3614: snap_create 2024-03-30T12:34:51.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:51.503+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:51.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:51.503+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:51.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:51.506+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:51.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:51.506+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:51.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:51.506+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:51.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:51.506+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:51.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:51.507+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:51.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:51.508+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:51.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:51.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[89279]: osdmap e794: 8 total, 8 up, 8 in 2024-03-30T12:34:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:51.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:51.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:51.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:51.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:51.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:51.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[91810]: osdmap e794: 8 total, 8 up, 8 in 2024-03-30T12:34:51.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:51.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:51.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:51.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:51.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:51.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:51.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:51.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:51.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[89279]: pgmap v882: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 8.1 MiB/s rd, 3.2 MiB/s wr, 12 op/s 2024-03-30T12:34:51.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:51.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[91810]: pgmap v882: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 8.1 MiB/s rd, 3.2 MiB/s wr, 12 op/s 2024-03-30T12:34:51.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:51.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:51.521+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:51.869 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:51.481+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:51.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:51.482+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:51.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:51.482+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:51.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:51.482+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:51.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:51.482+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:51.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:51.510+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:51.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:51.510+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:51.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:51.511+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:51.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:51.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:51.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:51.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:51.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:51 smithi162 ceph-mon[83709]: osdmap e794: 8 total, 8 up, 8 in 2024-03-30T12:34:51.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:51.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:51.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:51.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:51.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:51.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:51.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:51.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:51.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:51 smithi162 ceph-mon[83709]: pgmap v882: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 8.1 MiB/s rd, 3.2 MiB/s wr, 12 op/s 2024-03-30T12:34:51.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:52.481 INFO:tasks.rados.rados.0.smithi084.stdout:3614: done (0 left) 2024-03-30T12:34:52.482 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 365 2024-03-30T12:34:52.482 INFO:tasks.rados.rados.0.smithi084.stdout:3615: seq_num 1116 ranges {1605632=696320,2301952=573440,2875392=450560,3325952=180224} 2024-03-30T12:34:52.494 INFO:tasks.rados.rados.0.smithi084.stdout:3615: writing smithi08477944-15 from 1605632 to 2301952 tid 1 2024-03-30T12:34:52.497 INFO:tasks.rados.rados.0.smithi084.stdout:3615: writing smithi08477944-15 from 2301952 to 2875392 tid 2 2024-03-30T12:34:52.500 INFO:tasks.rados.rados.0.smithi084.stdout:3615: writing smithi08477944-15 from 2875392 to 3325952 tid 3 2024-03-30T12:34:52.501 INFO:tasks.rados.rados.0.smithi084.stdout:3615: writing smithi08477944-15 from 3325952 to 3506176 tid 4 2024-03-30T12:34:52.502 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 36 current snap is 365 2024-03-30T12:34:52.502 INFO:tasks.rados.rados.0.smithi084.stdout:3616: seq_num 1117 ranges {3121152=712704,3833856=458752,4292608=655360,4947968=90112} 2024-03-30T12:34:52.522 INFO:tasks.rados.rados.0.smithi084.stdout:3616: writing smithi08477944-36 from 3121152 to 3833856 tid 1 2024-03-30T12:34:52.525 INFO:tasks.rados.rados.0.smithi084.stdout:3616: writing smithi08477944-36 from 3833856 to 4292608 tid 2 2024-03-30T12:34:52.529 INFO:tasks.rados.rados.0.smithi084.stdout:3616: writing smithi08477944-36 from 4292608 to 4947968 tid 3 2024-03-30T12:34:52.530 INFO:tasks.rados.rados.0.smithi084.stdout:3616: writing smithi08477944-36 from 4947968 to 5038080 tid 4 2024-03-30T12:34:52.530 INFO:tasks.rados.rados.0.smithi084.stdout:3617: delete oid 8 current snap is 365 2024-03-30T12:34:52.530 INFO:tasks.rados.rados.0.smithi084.stdout:3615: finishing write tid 1 to smithi08477944-15 2024-03-30T12:34:52.531 INFO:tasks.rados.rados.0.smithi084.stdout:3615: finishing write tid 2 to smithi08477944-15 2024-03-30T12:34:52.531 INFO:tasks.rados.rados.0.smithi084.stdout:3615: finishing write tid 3 to smithi08477944-15 2024-03-30T12:34:52.531 INFO:tasks.rados.rados.0.smithi084.stdout:3615: finishing write tid 4 to smithi08477944-15 2024-03-30T12:34:52.531 INFO:tasks.rados.rados.0.smithi084.stdout:3615: finishing write tid 5 to smithi08477944-15 2024-03-30T12:34:52.531 INFO:tasks.rados.rados.0.smithi084.stdout:3615: finishing write tid 6 to smithi08477944-15 2024-03-30T12:34:52.531 INFO:tasks.rados.rados.0.smithi084.stdout:3615: oid 15 updating version 0 to 27412 2024-03-30T12:34:52.531 INFO:tasks.rados.rados.0.smithi084.stdout:3615: oid 15 version 27412 is already newer than 27410 2024-03-30T12:34:52.531 INFO:tasks.rados.rados.0.smithi084.stdout:3615: oid 15 version 27412 is already newer than 27411 2024-03-30T12:34:52.531 INFO:tasks.rados.rados.0.smithi084.stdout:3615: oid 15 updating version 27412 to 27413 2024-03-30T12:34:52.531 INFO:tasks.rados.rados.0.smithi084.stdout:3615: oid 15 updating version 27413 to 27414 2024-03-30T12:34:52.531 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 27414 (ObjNum 1116 snap 365 seq_num 1116) dirty exists 2024-03-30T12:34:52.531 INFO:tasks.rados.rados.0.smithi084.stdout:3615: left oid 15 (ObjNum 1116 snap 365 seq_num 1116) 2024-03-30T12:34:52.531 INFO:tasks.rados.rados.0.smithi084.stdout:3616: finishing write tid 1 to smithi08477944-36 2024-03-30T12:34:52.531 INFO:tasks.rados.rados.0.smithi084.stdout:3616: finishing write tid 2 to smithi08477944-36 2024-03-30T12:34:52.534 INFO:tasks.rados.rados.0.smithi084.stdout:3616: finishing write tid 3 to smithi08477944-36 2024-03-30T12:34:52.534 INFO:tasks.rados.rados.0.smithi084.stdout:3616: finishing write tid 4 to smithi08477944-36 2024-03-30T12:34:52.535 INFO:tasks.rados.rados.0.smithi084.stdout:3616: finishing write tid 5 to smithi08477944-36 2024-03-30T12:34:52.536 INFO:tasks.rados.rados.0.smithi084.stdout:3616: finishing write tid 6 to smithi08477944-36 2024-03-30T12:34:52.536 INFO:tasks.rados.rados.0.smithi084.stdout:3616: oid 36 updating version 0 to 36324 2024-03-30T12:34:52.536 INFO:tasks.rados.rados.0.smithi084.stdout:3616: oid 36 updating version 36324 to 36328 2024-03-30T12:34:52.536 INFO:tasks.rados.rados.0.smithi084.stdout:3616: oid 36 version 36328 is already newer than 36327 2024-03-30T12:34:52.536 INFO:tasks.rados.rados.0.smithi084.stdout:3616: oid 36 version 36328 is already newer than 36325 2024-03-30T12:34:52.536 INFO:tasks.rados.rados.0.smithi084.stdout:3616: oid 36 version 36328 is already newer than 36326 2024-03-30T12:34:52.536 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 36 v 36328 (ObjNum 1117 snap 365 seq_num 1117) dirty exists 2024-03-30T12:34:52.536 INFO:tasks.rados.rados.0.smithi084.stdout:3616: left oid 36 (ObjNum 1117 snap 365 seq_num 1117) 2024-03-30T12:34:52.540 INFO:tasks.rados.rados.0.smithi084.stdout:3615: done (2 left) 2024-03-30T12:34:52.540 INFO:tasks.rados.rados.0.smithi084.stdout:3616: done (1 left) 2024-03-30T12:34:52.540 INFO:tasks.rados.rados.0.smithi084.stdout:3617: done (0 left) 2024-03-30T12:34:52.540 INFO:tasks.rados.rados.0.smithi084.stdout:3618: copy_from oid 28 from oid 19 current snap is 365 2024-03-30T12:34:52.540 INFO:tasks.rados.rados.0.smithi084.stdout:3619: snap_remove snap 356 2024-03-30T12:34:52.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:52.505+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:52.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:52.509+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:52.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:52.488+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:52.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:52.488+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:52.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:52.489+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:52.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:52.489+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:52.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:52.489+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:52.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[89279]: osdmap e795: 8 total, 8 up, 8 in 2024-03-30T12:34:52.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:52.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:52.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:52.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:52.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:52.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:52.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:52.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:52.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:52.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:52.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:52.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:52.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:52.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[91810]: osdmap e795: 8 total, 8 up, 8 in 2024-03-30T12:34:52.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:52.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:52.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:52.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:52.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:52.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:52.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:52.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:52.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:52.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:52.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:52.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:52.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:52.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:52.510+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:52.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:52.486+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:52.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:52.486+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:52.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:52.543+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:52.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:52.546+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:52.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:52.489+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:52.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:52.489+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:52.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:52 smithi162 ceph-mon[83709]: osdmap e795: 8 total, 8 up, 8 in 2024-03-30T12:34:52.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:52.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:52.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:52.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:52.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:52.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:52.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:52.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:52.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:52.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:52.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:52.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:52.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:53.494 INFO:tasks.rados.rados.0.smithi084.stdout:3619: done (1 left) 2024-03-30T12:34:53.494 INFO:tasks.rados.rados.0.smithi084.stdout:3620: setattr oid 40 current snap is 365 2024-03-30T12:34:53.494 INFO:tasks.rados.rados.0.smithi084.stdout:3618: finishing copy_from to smithi08477944-28 2024-03-30T12:34:53.494 INFO:tasks.rados.rados.0.smithi084.stdout:3618: got expected ENOENT (src dne) 2024-03-30T12:34:53.494 INFO:tasks.rados.rados.0.smithi084.stdout:3618: finishing copy_from racing read to smithi08477944-28 2024-03-30T12:34:53.495 INFO:tasks.rados.rados.0.smithi084.stdout:3618: done (1 left) 2024-03-30T12:34:53.495 INFO:tasks.rados.rados.0.smithi084.stdout:3621: read oid 41 snap 359 2024-03-30T12:34:53.495 INFO:tasks.rados.rados.0.smithi084.stdout:3621: expect (ObjNum 1052 snap 337 seq_num 1052) 2024-03-30T12:34:53.495 INFO:tasks.rados.rados.0.smithi084.stdout:3622: read oid 31 snap 353 2024-03-30T12:34:53.495 INFO:tasks.rados.rados.0.smithi084.stdout:3622: expect (ObjNum 1007 snap 325 seq_num 1007) 2024-03-30T12:34:53.495 INFO:tasks.rados.rados.0.smithi084.stdout:3623: read oid 15 snap 340 2024-03-30T12:34:53.495 INFO:tasks.rados.rados.0.smithi084.stdout:3623: expect (ObjNum 974 snap 315 seq_num 974) 2024-03-30T12:34:53.496 INFO:tasks.rados.rados.0.smithi084.stdout:3624: snap_create 2024-03-30T12:34:53.503 INFO:tasks.rados.rados.0.smithi084.stdout:3621: expect (ObjNum 1052 snap 337 seq_num 1052) 2024-03-30T12:34:53.548 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 36308 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:34:53.548 INFO:tasks.rados.rados.0.smithi084.stdout:3622: expect (ObjNum 1007 snap 325 seq_num 1007) 2024-03-30T12:34:53.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:53.504+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:53.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:53.544+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:53.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:53.500+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:53.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:53.500+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:53.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:53.500+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:53.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:53.500+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:53.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:53.500+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:53.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:53.500+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:53.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:53.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:53.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:53.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:53.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:53.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:53.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:53.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[89279]: osdmap e796: 8 total, 8 up, 8 in 2024-03-30T12:34:53.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:53.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:53.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:53.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:53.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:53.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:53.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[89279]: pgmap v885: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.7 MiB/s wr, 9 op/s 2024-03-30T12:34:53.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:53.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:53.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:53.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:53.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:53.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:53.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:53.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[91810]: osdmap e796: 8 total, 8 up, 8 in 2024-03-30T12:34:53.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:53.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:53.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:53.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:53.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:53.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:53.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:53 smithi084 ceph-mon[91810]: pgmap v885: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.7 MiB/s wr, 9 op/s 2024-03-30T12:34:53.845 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:53.495+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:53.845 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:53.495+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:53.845 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:53.495+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:53.845 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:53.508+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:53.845 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:53.508+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:53.846 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:53.846 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:53.846 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:53.846 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:53.846 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:53.846 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:53.846 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:53.847 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:53 smithi162 ceph-mon[83709]: osdmap e796: 8 total, 8 up, 8 in 2024-03-30T12:34:53.847 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:53.847 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:53.847 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:53.847 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:53.847 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:53.847 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:53.847 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:53 smithi162 ceph-mon[83709]: pgmap v885: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.8 MiB/s rd, 1.7 MiB/s wr, 9 op/s 2024-03-30T12:34:53.890 INFO:tasks.rados.rados.0.smithi084.stdout:3623: expect (ObjNum 974 snap 315 seq_num 974) 2024-03-30T12:34:54.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:53.853+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:54.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:53.852+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:54.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:53.852+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:54.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:53.853+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:54.541 INFO:tasks.rados.rados.0.smithi084.stdout:3620: done (4 left) 2024-03-30T12:34:54.542 INFO:tasks.rados.rados.0.smithi084.stdout:3621: done (3 left) 2024-03-30T12:34:54.542 INFO:tasks.rados.rados.0.smithi084.stdout:3622: done (2 left) 2024-03-30T12:34:54.542 INFO:tasks.rados.rados.0.smithi084.stdout:3623: done (1 left) 2024-03-30T12:34:54.542 INFO:tasks.rados.rados.0.smithi084.stdout:3624: done (0 left) 2024-03-30T12:34:54.542 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 366 2024-03-30T12:34:54.542 INFO:tasks.rados.rados.0.smithi084.stdout:3625: seq_num 1119 ranges {3096576=745472,3842048=679936,4521984=524288} 2024-03-30T12:34:54.561 INFO:tasks.rados.rados.0.smithi084.stdout:3625: writing smithi08477944-24 from 3096576 to 3842048 tid 1 2024-03-30T12:34:54.565 INFO:tasks.rados.rados.0.smithi084.stdout:3625: writing smithi08477944-24 from 3842048 to 4521984 tid 2 2024-03-30T12:34:54.568 INFO:tasks.rados.rados.0.smithi084.stdout:3625: writing smithi08477944-24 from 4521984 to 5046272 tid 3 2024-03-30T12:34:54.568 INFO:tasks.rados.rados.0.smithi084.stdout:3626: rollback oid 9 current snap is 366 2024-03-30T12:34:54.568 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 9 to 349 2024-03-30T12:34:54.568 INFO:tasks.rados.rados.0.smithi084.stdout:3627: snap_remove snap 364 2024-03-30T12:34:54.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:54.528+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:54.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:54.528+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:54.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:54.494+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:54.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:54.494+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:54.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:54.494+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:54.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:54.495+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:54.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:54.495+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:54.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:54.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:54.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:54.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:54.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:54.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:54.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[89279]: osdmap e797: 8 total, 8 up, 8 in 2024-03-30T12:34:54.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:54.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:54.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:54.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:54.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:54.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:54.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:54.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:54.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:54.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:54.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:54.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:54.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:54.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[91810]: osdmap e797: 8 total, 8 up, 8 in 2024-03-30T12:34:54.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:54.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:54.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:54.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:54.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:54.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:54.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:54.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:54.579+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:54.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:54.497+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:54.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:54.497+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:54.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:54.497+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:54.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:54.497+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:54.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:54.581+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:54.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:54.596+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:54.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:54.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:54.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:54.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:54.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:54.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:54.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:54 smithi162 ceph-mon[83709]: osdmap e797: 8 total, 8 up, 8 in 2024-03-30T12:34:54.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:54.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:54.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:54.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:54.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:54.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:54.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:55.503 INFO:tasks.rados.rados.0.smithi084.stdout:3627: done (2 left) 2024-03-30T12:34:55.503 INFO:tasks.rados.rados.0.smithi084.stdout:3628: delete oid 22 current snap is 366 2024-03-30T12:34:55.503 INFO:tasks.rados.rados.0.smithi084.stdout:3626: finishing rollback tid 1 to smithi08477944-9 2024-03-30T12:34:55.503 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 0 (ObjNum 33 snap 0 seq_num 1429383200) dirty dne 2024-03-30T12:34:55.503 INFO:tasks.rados.rados.0.smithi084.stdout:3625: finishing write tid 1 to smithi08477944-24 2024-03-30T12:34:55.503 INFO:tasks.rados.rados.0.smithi084.stdout:3625: finishing write tid 2 to smithi08477944-24 2024-03-30T12:34:55.503 INFO:tasks.rados.rados.0.smithi084.stdout:3625: finishing write tid 3 to smithi08477944-24 2024-03-30T12:34:55.503 INFO:tasks.rados.rados.0.smithi084.stdout:3625: finishing write tid 4 to smithi08477944-24 2024-03-30T12:34:55.503 INFO:tasks.rados.rados.0.smithi084.stdout:3625: finishing write tid 5 to smithi08477944-24 2024-03-30T12:34:55.504 INFO:tasks.rados.rados.0.smithi084.stdout:3625: oid 24 updating version 0 to 23448 2024-03-30T12:34:55.504 INFO:tasks.rados.rados.0.smithi084.stdout:3625: oid 24 version 23448 is already newer than 23446 2024-03-30T12:34:55.504 INFO:tasks.rados.rados.0.smithi084.stdout:3625: oid 24 version 23448 is already newer than 23447 2024-03-30T12:34:55.504 INFO:tasks.rados.rados.0.smithi084.stdout:3625: oid 24 updating version 23448 to 23449 2024-03-30T12:34:55.504 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 23449 (ObjNum 1119 snap 366 seq_num 1119) dirty exists 2024-03-30T12:34:55.504 INFO:tasks.rados.rados.0.smithi084.stdout:3625: left oid 24 (ObjNum 1119 snap 366 seq_num 1119) 2024-03-30T12:34:55.511 INFO:tasks.rados.rados.0.smithi084.stdout:3625: done (2 left) 2024-03-30T12:34:55.511 INFO:tasks.rados.rados.0.smithi084.stdout:3626: done (1 left) 2024-03-30T12:34:55.511 INFO:tasks.rados.rados.0.smithi084.stdout:3628: done (0 left) 2024-03-30T12:34:55.511 INFO:tasks.rados.rados.0.smithi084.stdout:3629: read oid 12 snap -1 2024-03-30T12:34:55.511 INFO:tasks.rados.rados.0.smithi084.stdout:3629: expect deleted 2024-03-30T12:34:55.512 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 366 2024-03-30T12:34:55.512 INFO:tasks.rados.rados.0.smithi084.stdout:3630: seq_num 1121 ranges {0=778240,778240=442368,1220608=638976,1859584=122880} 2024-03-30T12:34:55.516 INFO:tasks.rados.rados.0.smithi084.stdout:3630: writing smithi08477944-40 from 0 to 778240 tid 1 2024-03-30T12:34:55.518 INFO:tasks.rados.rados.0.smithi084.stdout:3630: writing smithi08477944-40 from 778240 to 1220608 tid 2 2024-03-30T12:34:55.522 INFO:tasks.rados.rados.0.smithi084.stdout:3630: writing smithi08477944-40 from 1220608 to 1859584 tid 3 2024-03-30T12:34:55.523 INFO:tasks.rados.rados.0.smithi084.stdout:3630: writing smithi08477944-40 from 1859584 to 1982464 tid 4 2024-03-30T12:34:55.524 INFO:tasks.rados.rados.0.smithi084.stdout:3631: rmattr oid 49 current snap is 366 2024-03-30T12:34:55.524 INFO:tasks.rados.rados.0.smithi084.stdout:3630: finishing write tid 1 to smithi08477944-40 2024-03-30T12:34:55.524 INFO:tasks.rados.rados.0.smithi084.stdout:3630: finishing write tid 2 to smithi08477944-40 2024-03-30T12:34:55.524 INFO:tasks.rados.rados.0.smithi084.stdout:3629: done (2 left) 2024-03-30T12:34:55.524 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 366 2024-03-30T12:34:55.524 INFO:tasks.rados.rados.0.smithi084.stdout:3632: seq_num 1122 ranges {0=794624,794624=729088,1523712=475136} 2024-03-30T12:34:55.528 INFO:tasks.rados.rados.0.smithi084.stdout:3632: writing smithi08477944-9 from 0 to 794624 tid 1 2024-03-30T12:34:55.533 INFO:tasks.rados.rados.0.smithi084.stdout:3632: writing smithi08477944-9 from 794624 to 1523712 tid 2 2024-03-30T12:34:55.536 INFO:tasks.rados.rados.0.smithi084.stdout:3632: writing smithi08477944-9 from 1523712 to 1998848 tid 3 2024-03-30T12:34:55.536 INFO:tasks.rados.rados.0.smithi084.stdout:3633: copy_from oid 6 from oid 43 current snap is 366 2024-03-30T12:34:55.537 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 36329 (ObjNum 1098 snap 357 seq_num 1098) dirty exists 2024-03-30T12:34:55.537 INFO:tasks.rados.rados.0.smithi084.stdout:3630: finishing write tid 3 to smithi08477944-40 2024-03-30T12:34:55.537 INFO:tasks.rados.rados.0.smithi084.stdout:3630: finishing write tid 4 to smithi08477944-40 2024-03-30T12:34:55.537 INFO:tasks.rados.rados.0.smithi084.stdout:3630: finishing write tid 5 to smithi08477944-40 2024-03-30T12:34:55.537 INFO:tasks.rados.rados.0.smithi084.stdout:3630: finishing write tid 6 to smithi08477944-40 2024-03-30T12:34:55.537 INFO:tasks.rados.rados.0.smithi084.stdout:3630: oid 40 updating version 0 to 36311 2024-03-30T12:34:55.537 INFO:tasks.rados.rados.0.smithi084.stdout:3630: oid 40 version 36311 is already newer than 36309 2024-03-30T12:34:55.537 INFO:tasks.rados.rados.0.smithi084.stdout:3630: oid 40 version 36311 is already newer than 36310 2024-03-30T12:34:55.537 INFO:tasks.rados.rados.0.smithi084.stdout:3630: oid 40 updating version 36311 to 36313 2024-03-30T12:34:55.537 INFO:tasks.rados.rados.0.smithi084.stdout:3630: oid 40 version 36313 is already newer than 36312 2024-03-30T12:34:55.537 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 36313 (ObjNum 1121 snap 366 seq_num 1121) dirty exists 2024-03-30T12:34:55.537 INFO:tasks.rados.rados.0.smithi084.stdout:3630: left oid 40 (ObjNum 1121 snap 366 seq_num 1121) 2024-03-30T12:34:55.537 INFO:tasks.rados.rados.0.smithi084.stdout:3632: finishing write tid 1 to smithi08477944-9 2024-03-30T12:34:55.537 INFO:tasks.rados.rados.0.smithi084.stdout:3632: finishing write tid 2 to smithi08477944-9 2024-03-30T12:34:55.537 INFO:tasks.rados.rados.0.smithi084.stdout:3630: done (3 left) 2024-03-30T12:34:55.538 INFO:tasks.rados.rados.0.smithi084.stdout:3631: done (2 left) 2024-03-30T12:34:55.538 INFO:tasks.rados.rados.0.smithi084.stdout:3634: read oid 19 snap -1 2024-03-30T12:34:55.538 INFO:tasks.rados.rados.0.smithi084.stdout:3634: expect deleted 2024-03-30T12:34:55.538 INFO:tasks.rados.rados.0.smithi084.stdout:3635: delete oid 4 current snap is 366 2024-03-30T12:34:55.540 INFO:tasks.rados.rados.0.smithi084.stdout:3634: done (3 left) 2024-03-30T12:34:55.540 INFO:tasks.rados.rados.0.smithi084.stdout:3635: done (2 left) 2024-03-30T12:34:55.541 INFO:tasks.rados.rados.0.smithi084.stdout:3636: rollback oid 29 current snap is 366 2024-03-30T12:34:55.541 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 29 to 361 2024-03-30T12:34:55.541 INFO:tasks.rados.rados.0.smithi084.stdout:3632: finishing write tid 3 to smithi08477944-9 2024-03-30T12:34:55.541 INFO:tasks.rados.rados.0.smithi084.stdout:3632: finishing write tid 4 to smithi08477944-9 2024-03-30T12:34:55.541 INFO:tasks.rados.rados.0.smithi084.stdout:3637: rmattr oid 21 current snap is 366 2024-03-30T12:34:55.541 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 2 current snap is 366 2024-03-30T12:34:55.541 INFO:tasks.rados.rados.0.smithi084.stdout:3638: seq_num 1124 ranges {1458176=434176,1892352=499712,2392064=409600,2801664=663552,3465216=32768} 2024-03-30T12:34:55.551 INFO:tasks.rados.rados.0.smithi084.stdout:3638: writing smithi08477944-2 from 1458176 to 1892352 tid 1 2024-03-30T12:34:55.554 INFO:tasks.rados.rados.0.smithi084.stdout:3638: writing smithi08477944-2 from 1892352 to 2392064 tid 2 2024-03-30T12:34:55.557 INFO:tasks.rados.rados.0.smithi084.stdout:3638: writing smithi08477944-2 from 2392064 to 2801664 tid 3 2024-03-30T12:34:55.561 INFO:tasks.rados.rados.0.smithi084.stdout:3638: writing smithi08477944-2 from 2801664 to 3465216 tid 4 2024-03-30T12:34:55.561 INFO:tasks.rados.rados.0.smithi084.stdout:3638: writing smithi08477944-2 from 3465216 to 3497984 tid 5 2024-03-30T12:34:55.562 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 366 2024-03-30T12:34:55.562 INFO:tasks.rados.rados.0.smithi084.stdout:3632: finishing write tid 5 to smithi08477944-9 2024-03-30T12:34:55.562 INFO:tasks.rados.rados.0.smithi084.stdout:3632: oid 9 updating version 0 to 22529 2024-03-30T12:34:55.562 INFO:tasks.rados.rados.0.smithi084.stdout:3632: oid 9 updating version 22529 to 22531 2024-03-30T12:34:55.562 INFO:tasks.rados.rados.0.smithi084.stdout:3632: oid 9 version 22531 is already newer than 22530 2024-03-30T12:34:55.562 INFO:tasks.rados.rados.0.smithi084.stdout:3632: oid 9 version 22531 is already newer than 22528 2024-03-30T12:34:55.562 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 22531 (ObjNum 1122 snap 366 seq_num 1122) dirty exists 2024-03-30T12:34:55.562 INFO:tasks.rados.rados.0.smithi084.stdout:3632: left oid 9 (ObjNum 1122 snap 366 seq_num 1122) 2024-03-30T12:34:55.562 INFO:tasks.rados.rados.0.smithi084.stdout:3639: seq_num 1125 ranges {2392064=450560,2842624=786432,3629056=614400,4243456=204800} 2024-03-30T12:34:55.578 INFO:tasks.rados.rados.0.smithi084.stdout:3639: writing smithi08477944-3 from 2392064 to 2842624 tid 1 2024-03-30T12:34:55.582 INFO:tasks.rados.rados.0.smithi084.stdout:3639: writing smithi08477944-3 from 2842624 to 3629056 tid 2 2024-03-30T12:34:55.585 INFO:tasks.rados.rados.0.smithi084.stdout:3639: writing smithi08477944-3 from 3629056 to 4243456 tid 3 2024-03-30T12:34:55.590 INFO:tasks.rados.rados.0.smithi084.stdout:3639: writing smithi08477944-3 from 4243456 to 4448256 tid 4 2024-03-30T12:34:55.590 INFO:tasks.rados.rados.0.smithi084.stdout:3632: done (5 left) 2024-03-30T12:34:55.591 INFO:tasks.rados.rados.0.smithi084.stdout:3640: snap_create 2024-03-30T12:34:55.591 INFO:tasks.rados.rados.0.smithi084.stdout:3636: finishing rollback tid 0 to smithi08477944-29 2024-03-30T12:34:55.591 INFO:tasks.rados.rados.0.smithi084.stdout:3636: finishing rollback tid 1 to smithi08477944-29 2024-03-30T12:34:55.591 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 36299 (ObjNum 1097 snap 356 seq_num 1097) dirty exists 2024-03-30T12:34:55.591 INFO:tasks.rados.rados.0.smithi084.stdout:3636: finishing rollback tid 2 to smithi08477944-29 2024-03-30T12:34:55.591 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 36327 (ObjNum 946 snap 301 seq_num 946) dirty exists 2024-03-30T12:34:55.591 INFO:tasks.rados.rados.0.smithi084.stdout:3633: finishing copy_from racing read to smithi08477944-6 2024-03-30T12:34:55.591 INFO:tasks.rados.rados.0.smithi084.stdout:3633: finishing copy_from to smithi08477944-6 2024-03-30T12:34:55.591 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 36357 (ObjNum 1062 snap 344 seq_num 1062) dirty exists 2024-03-30T12:34:55.591 INFO:tasks.rados.rados.0.smithi084.stdout:3638: finishing write tid 1 to smithi08477944-2 2024-03-30T12:34:55.591 INFO:tasks.rados.rados.0.smithi084.stdout:3638: finishing write tid 2 to smithi08477944-2 2024-03-30T12:34:55.591 INFO:tasks.rados.rados.0.smithi084.stdout:3638: finishing write tid 3 to smithi08477944-2 2024-03-30T12:34:55.592 INFO:tasks.rados.rados.0.smithi084.stdout:3638: finishing write tid 4 to smithi08477944-2 2024-03-30T12:34:55.592 INFO:tasks.rados.rados.0.smithi084.stdout:3638: finishing write tid 5 to smithi08477944-2 2024-03-30T12:34:55.592 INFO:tasks.rados.rados.0.smithi084.stdout:3638: finishing write tid 6 to smithi08477944-2 2024-03-30T12:34:55.592 INFO:tasks.rados.rados.0.smithi084.stdout:3638: finishing write tid 7 to smithi08477944-2 2024-03-30T12:34:55.592 INFO:tasks.rados.rados.0.smithi084.stdout:3638: oid 2 updating version 0 to 36313 2024-03-30T12:34:55.592 INFO:tasks.rados.rados.0.smithi084.stdout:3638: oid 2 updating version 36313 to 36317 2024-03-30T12:34:55.592 INFO:tasks.rados.rados.0.smithi084.stdout:3638: oid 2 updating version 36317 to 36318 2024-03-30T12:34:55.592 INFO:tasks.rados.rados.0.smithi084.stdout:3638: oid 2 version 36318 is already newer than 36315 2024-03-30T12:34:55.592 INFO:tasks.rados.rados.0.smithi084.stdout:3638: oid 2 version 36318 is already newer than 36314 2024-03-30T12:34:55.592 INFO:tasks.rados.rados.0.smithi084.stdout:3638: oid 2 version 36318 is already newer than 36316 2024-03-30T12:34:55.592 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 36318 (ObjNum 1124 snap 366 seq_num 1124) dirty exists 2024-03-30T12:34:55.592 INFO:tasks.rados.rados.0.smithi084.stdout:3638: left oid 2 (ObjNum 1124 snap 366 seq_num 1124) 2024-03-30T12:34:55.592 INFO:tasks.rados.rados.0.smithi084.stdout:3639: finishing write tid 1 to smithi08477944-3 2024-03-30T12:34:55.593 INFO:tasks.rados.rados.0.smithi084.stdout:3639: finishing write tid 2 to smithi08477944-3 2024-03-30T12:34:55.593 INFO:tasks.rados.rados.0.smithi084.stdout:3639: finishing write tid 3 to smithi08477944-3 2024-03-30T12:34:55.594 INFO:tasks.rados.rados.0.smithi084.stdout:3639: finishing write tid 4 to smithi08477944-3 2024-03-30T12:34:55.594 INFO:tasks.rados.rados.0.smithi084.stdout:3639: finishing write tid 5 to smithi08477944-3 2024-03-30T12:34:55.596 INFO:tasks.rados.rados.0.smithi084.stdout:3639: finishing write tid 6 to smithi08477944-3 2024-03-30T12:34:55.596 INFO:tasks.rados.rados.0.smithi084.stdout:3639: oid 3 updating version 0 to 36321 2024-03-30T12:34:55.596 INFO:tasks.rados.rados.0.smithi084.stdout:3639: oid 3 updating version 36321 to 36322 2024-03-30T12:34:55.596 INFO:tasks.rados.rados.0.smithi084.stdout:3639: oid 3 version 36322 is already newer than 36320 2024-03-30T12:34:55.596 INFO:tasks.rados.rados.0.smithi084.stdout:3639: oid 3 updating version 36322 to 36323 2024-03-30T12:34:55.596 INFO:tasks.rados.rados.0.smithi084.stdout:3639: oid 3 version 36323 is already newer than 36319 2024-03-30T12:34:55.596 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 36323 (ObjNum 1125 snap 366 seq_num 1125) dirty exists 2024-03-30T12:34:55.597 INFO:tasks.rados.rados.0.smithi084.stdout:3639: left oid 3 (ObjNum 1125 snap 366 seq_num 1125) 2024-03-30T12:34:55.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:55.518+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:55.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:55.518+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:55.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:55.507+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:55.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:55.508+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:55.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:55.509+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:55.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:55.509+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:55.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:55.509+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:55.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:55.509+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:55.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:55.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:55.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:55.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:55.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[89279]: osdmap e798: 8 total, 8 up, 8 in 2024-03-30T12:34:55.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:55.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:55.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:55.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:55.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:55.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:55.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:55.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:55.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:55.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[89279]: pgmap v888: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-03-30T12:34:55.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:55.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:55.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:55.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:55.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[91810]: osdmap e798: 8 total, 8 up, 8 in 2024-03-30T12:34:55.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:55.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:55.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:55.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:55.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:55.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:55.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:55.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:55.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:55.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:55 smithi084 ceph-mon[91810]: pgmap v888: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-03-30T12:34:55.828 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:55.510+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:55.829 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:55.510+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:55.829 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:55.510+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:55.829 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:55.510+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:55.829 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:55.510+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:55.829 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:55.515+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:55.829 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:55.515+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:55.830 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:55.518+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:55.830 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:55.830 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:55.830 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:55.830 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:55.830 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:55 smithi162 ceph-mon[83709]: osdmap e798: 8 total, 8 up, 8 in 2024-03-30T12:34:55.830 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:55.830 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:55.830 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:55.831 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:55.831 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:55.831 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:55.831 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:55.831 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:55.831 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:55.831 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:55 smithi162 ceph-mon[83709]: pgmap v888: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.3 GiB used, 707 GiB / 715 GiB avail; 2.7 MiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-03-30T12:34:56.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:55.837+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:56.513 INFO:tasks.rados.rados.0.smithi084.stdout:3633: done (5 left) 2024-03-30T12:34:56.513 INFO:tasks.rados.rados.0.smithi084.stdout:3636: done (4 left) 2024-03-30T12:34:56.513 INFO:tasks.rados.rados.0.smithi084.stdout:3637: done (3 left) 2024-03-30T12:34:56.513 INFO:tasks.rados.rados.0.smithi084.stdout:3638: done (2 left) 2024-03-30T12:34:56.514 INFO:tasks.rados.rados.0.smithi084.stdout:3639: done (1 left) 2024-03-30T12:34:56.514 INFO:tasks.rados.rados.0.smithi084.stdout:3640: done (0 left) 2024-03-30T12:34:56.514 INFO:tasks.rados.rados.0.smithi084.stdout:3641: setattr oid 21 current snap is 367 2024-03-30T12:34:56.515 INFO:tasks.rados.rados.0.smithi084.stdout:3642: snap_create 2024-03-30T12:34:56.524 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 36300 (ObjNum 1097 snap 356 seq_num 1097) dirty exists 2024-03-30T12:34:56.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:56.530+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:56.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:56.530+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:56.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:56.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:56.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:56.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:56.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[89279]: osdmap e799: 8 total, 8 up, 8 in 2024-03-30T12:34:56.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:56.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:56.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:56.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:56.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:56.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:56.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:56.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:56.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:56.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:56.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:56.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:56.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:56.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[91810]: osdmap e799: 8 total, 8 up, 8 in 2024-03-30T12:34:56.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:56.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:56.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:56.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:56.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:56.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:56.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:56.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:56.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:56.805 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:56.521+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:56.806 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:56.521+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:56.806 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:56.527+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:56.806 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:56.532+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:56.806 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:56.517+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:56.806 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:56.518+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:56.807 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:56.807 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:56.807 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:56.807 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:56.807 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:56 smithi162 ceph-mon[83709]: osdmap e799: 8 total, 8 up, 8 in 2024-03-30T12:34:56.807 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:56.807 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:56.807 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:56.807 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:56.807 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:56.807 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:56.807 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a0=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:56.808 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:56.808 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:57.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:56.813+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:57.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:57.108+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:57.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:57.109+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:57.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:57.109+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:57.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:57.109+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:57.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:57.109+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:57.519 INFO:tasks.rados.rados.0.smithi084.stdout:3641: done (1 left) 2024-03-30T12:34:57.519 INFO:tasks.rados.rados.0.smithi084.stdout:3642: done (0 left) 2024-03-30T12:34:57.520 INFO:tasks.rados.rados.0.smithi084.stdout:3643: read oid 4 snap -1 2024-03-30T12:34:57.520 INFO:tasks.rados.rados.0.smithi084.stdout:3643: expect deleted 2024-03-30T12:34:57.520 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 38 current snap is 368 2024-03-30T12:34:57.520 INFO:tasks.rados.rados.0.smithi084.stdout:3644: seq_num 1126 ranges {3416064=466944,3883008=720896,4603904=778240,5382144=106496} 2024-03-30T12:34:57.540 INFO:tasks.rados.rados.0.smithi084.stdout:3644: writing smithi08477944-38 from 3416064 to 3883008 tid 1 2024-03-30T12:34:57.544 INFO:tasks.rados.rados.0.smithi084.stdout:3644: writing smithi08477944-38 from 3883008 to 4603904 tid 2 2024-03-30T12:34:57.549 INFO:tasks.rados.rados.0.smithi084.stdout:3644: writing smithi08477944-38 from 4603904 to 5382144 tid 3 2024-03-30T12:34:57.550 INFO:tasks.rados.rados.0.smithi084.stdout:3644: writing smithi08477944-38 from 5382144 to 5488640 tid 4 2024-03-30T12:34:57.550 INFO:tasks.rados.rados.0.smithi084.stdout:3645: copy_from oid 32 from oid 34 current snap is 368 2024-03-30T12:34:57.550 INFO:tasks.rados.rados.0.smithi084.stdout:3644: finishing write tid 1 to smithi08477944-38 2024-03-30T12:34:57.550 INFO:tasks.rados.rados.0.smithi084.stdout:3643: done (2 left) 2024-03-30T12:34:57.550 INFO:tasks.rados.rados.0.smithi084.stdout:3646: rollback oid 47 current snap is 368 2024-03-30T12:34:57.550 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 47 to 340 2024-03-30T12:34:57.550 INFO:tasks.rados.rados.0.smithi084.stdout:3644: finishing write tid 2 to smithi08477944-38 2024-03-30T12:34:57.550 INFO:tasks.rados.rados.0.smithi084.stdout:3647: setattr oid 16 current snap is 368 2024-03-30T12:34:57.552 INFO:tasks.rados.rados.0.smithi084.stdout:3648: delete oid 29 current snap is 368 2024-03-30T12:34:57.556 INFO:tasks.rados.rados.0.smithi084.stdout:3644: finishing write tid 3 to smithi08477944-38 2024-03-30T12:34:57.556 INFO:tasks.rados.rados.0.smithi084.stdout:3644: finishing write tid 4 to smithi08477944-38 2024-03-30T12:34:57.556 INFO:tasks.rados.rados.0.smithi084.stdout:3644: finishing write tid 5 to smithi08477944-38 2024-03-30T12:34:57.556 INFO:tasks.rados.rados.0.smithi084.stdout:3646: finishing rollback tid 0 to smithi08477944-47 2024-03-30T12:34:57.558 INFO:tasks.rados.rados.0.smithi084.stdout:3644: finishing write tid 6 to smithi08477944-38 2024-03-30T12:34:57.558 INFO:tasks.rados.rados.0.smithi084.stdout:3644: oid 38 updating version 0 to 27321 2024-03-30T12:34:57.558 INFO:tasks.rados.rados.0.smithi084.stdout:3644: oid 38 version 27321 is already newer than 27320 2024-03-30T12:34:57.558 INFO:tasks.rados.rados.0.smithi084.stdout:3644: oid 38 updating version 27321 to 27323 2024-03-30T12:34:57.559 INFO:tasks.rados.rados.0.smithi084.stdout:3644: oid 38 version 27323 is already newer than 27322 2024-03-30T12:34:57.559 INFO:tasks.rados.rados.0.smithi084.stdout:3644: oid 38 updating version 27323 to 27324 2024-03-30T12:34:57.559 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 27324 (ObjNum 1126 snap 368 seq_num 1126) dirty exists 2024-03-30T12:34:57.559 INFO:tasks.rados.rados.0.smithi084.stdout:3644: left oid 38 (ObjNum 1126 snap 368 seq_num 1126) 2024-03-30T12:34:57.559 INFO:tasks.rados.rados.0.smithi084.stdout:3646: finishing rollback tid 1 to smithi08477944-47 2024-03-30T12:34:57.559 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 36315 (ObjNum 465 snap 0 seq_num 1587893060) dirty dne 2024-03-30T12:34:57.560 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 27331 (ObjNum 1023 snap 328 seq_num 1023) dirty exists 2024-03-30T12:34:57.560 INFO:tasks.rados.rados.0.smithi084.stdout:3644: done (4 left) 2024-03-30T12:34:57.560 INFO:tasks.rados.rados.0.smithi084.stdout:3646: done (3 left) 2024-03-30T12:34:57.561 INFO:tasks.rados.rados.0.smithi084.stdout:3647: done (2 left) 2024-03-30T12:34:57.561 INFO:tasks.rados.rados.0.smithi084.stdout:3648: done (1 left) 2024-03-30T12:34:57.561 INFO:tasks.rados.rados.0.smithi084.stdout:3649: rollback oid 9 current snap is 368 2024-03-30T12:34:57.561 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 9 to 346 2024-03-30T12:34:57.561 INFO:tasks.rados.rados.0.smithi084.stdout:3650: copy_from oid 50 from oid 3 current snap is 368 2024-03-30T12:34:57.561 INFO:tasks.rados.rados.0.smithi084.stdout:3651: read oid 48 snap -1 2024-03-30T12:34:57.561 INFO:tasks.rados.rados.0.smithi084.stdout:3651: expect (ObjNum 1100 snap 359 seq_num 1100) 2024-03-30T12:34:57.561 INFO:tasks.rados.rados.0.smithi084.stdout:3652: read oid 2 snap -1 2024-03-30T12:34:57.561 INFO:tasks.rados.rados.0.smithi084.stdout:3652: expect (ObjNum 1124 snap 366 seq_num 1124) 2024-03-30T12:34:57.561 INFO:tasks.rados.rados.0.smithi084.stdout:3653: copy_from oid 20 from oid 8 current snap is 368 2024-03-30T12:34:57.561 INFO:tasks.rados.rados.0.smithi084.stdout:3654: snap_create 2024-03-30T12:34:57.562 INFO:tasks.rados.rados.0.smithi084.stdout:3645: finishing copy_from racing read to smithi08477944-32 2024-03-30T12:34:57.562 INFO:tasks.rados.rados.0.smithi084.stdout:3645: finishing copy_from to smithi08477944-32 2024-03-30T12:34:57.562 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 36294 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:34:57.565 INFO:tasks.rados.rados.0.smithi084.stdout:3653: finishing copy_from to smithi08477944-20 2024-03-30T12:34:57.565 INFO:tasks.rados.rados.0.smithi084.stdout:3653: got expected ENOENT (src dne) 2024-03-30T12:34:57.565 INFO:tasks.rados.rados.0.smithi084.stdout:3649: finishing rollback tid 0 to smithi08477944-9 2024-03-30T12:34:57.566 INFO:tasks.rados.rados.0.smithi084.stdout:3653: finishing copy_from racing read to smithi08477944-20 2024-03-30T12:34:57.566 INFO:tasks.rados.rados.0.smithi084.stdout:3649: finishing rollback tid 1 to smithi08477944-9 2024-03-30T12:34:57.566 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 22533 (ObjNum 65 snap 0 seq_num 1394492240) dirty dne 2024-03-30T12:34:57.577 INFO:tasks.rados.rados.0.smithi084.stdout:3651: expect (ObjNum 1100 snap 359 seq_num 1100) 2024-03-30T12:34:57.727 INFO:tasks.rados.rados.0.smithi084.stdout:3652: expect (ObjNum 1124 snap 366 seq_num 1124) 2024-03-30T12:34:57.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:57.526+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:57.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:57.567+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:57.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:57.568+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:57.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:57.553+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:57.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:57.553+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:57.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:57.553+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:57.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:57.568+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:34:57.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:57.568+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:57.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:57.568+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:57.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:57.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:57.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:57.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:57.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:57 smithi162 ceph-mon[83709]: osdmap e800: 8 total, 8 up, 8 in 2024-03-30T12:34:57.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:57.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:57.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:57.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:57.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:57 smithi162 ceph-mon[83709]: pgmap v891: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 11 MiB/s rd, 3.1 MiB/s wr, 16 op/s 2024-03-30T12:34:57.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:57.872 INFO:tasks.rados.rados.0.smithi084.stdout:3650: finishing copy_from racing read to smithi08477944-50 2024-03-30T12:34:57.872 INFO:tasks.rados.rados.0.smithi084.stdout:3650: finishing copy_from to smithi08477944-50 2024-03-30T12:34:57.873 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 36323 (ObjNum 1125 snap 366 seq_num 1125) dirty exists 2024-03-30T12:34:58.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:57.562+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:58.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:57.563+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:58.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:57.525+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:58.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:57.525+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:58.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:57.525+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:58.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:57.525+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:58.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:57.525+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:58.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:57.526+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:58.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:58.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:58.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:58.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:58.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-mon[89279]: osdmap e800: 8 total, 8 up, 8 in 2024-03-30T12:34:58.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:58.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:58.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:58.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:58.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-mon[89279]: pgmap v891: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 11 MiB/s rd, 3.1 MiB/s wr, 16 op/s 2024-03-30T12:34:58.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:58.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:58.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:58.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:58.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:58.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-mon[91810]: osdmap e800: 8 total, 8 up, 8 in 2024-03-30T12:34:58.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:58.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:58.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:58.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:58.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-mon[91810]: pgmap v891: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 11 MiB/s rd, 3.1 MiB/s wr, 16 op/s 2024-03-30T12:34:58.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:58.527 INFO:tasks.rados.rados.0.smithi084.stdout:3645: done (6 left) 2024-03-30T12:34:58.527 INFO:tasks.rados.rados.0.smithi084.stdout:3649: done (5 left) 2024-03-30T12:34:58.527 INFO:tasks.rados.rados.0.smithi084.stdout:3650: done (4 left) 2024-03-30T12:34:58.527 INFO:tasks.rados.rados.0.smithi084.stdout:3651: done (3 left) 2024-03-30T12:34:58.527 INFO:tasks.rados.rados.0.smithi084.stdout:3652: done (2 left) 2024-03-30T12:34:58.527 INFO:tasks.rados.rados.0.smithi084.stdout:3653: done (1 left) 2024-03-30T12:34:58.527 INFO:tasks.rados.rados.0.smithi084.stdout:3654: done (0 left) 2024-03-30T12:34:58.527 INFO:tasks.rados.rados.0.smithi084.stdout:3655: rollback oid 50 current snap is 369 2024-03-30T12:34:58.527 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 50 to 357 2024-03-30T12:34:58.527 INFO:tasks.rados.rados.0.smithi084.stdout:3656: rollback oid 8 current snap is 369 2024-03-30T12:34:58.527 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 8 to 366 2024-03-30T12:34:58.528 INFO:tasks.rados.rados.0.smithi084.stdout:3657: snap_remove snap 359 2024-03-30T12:34:58.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:34:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:34:58.737+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:58.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:58.535+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:58.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:58.535+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:58.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:58.536+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:58.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:34:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:34:58.536+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:58.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:58.539+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:58.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:34:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:34:58.543+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:58.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:58.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:58.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:58.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:58.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:58.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:58.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:58.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:58.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:58.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:58 smithi162 ceph-mon[83709]: osdmap e801: 8 total, 8 up, 8 in 2024-03-30T12:34:58.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:58.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:58.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:58.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:58.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:58.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:59.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:58.545+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:59.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:58.545+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:59.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:58.533+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:59.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:58.533+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:59.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:58.533+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:59.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:58.533+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:59.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:58.533+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:59.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:59.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:59.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:59.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:59.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:59.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:59.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:59.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:59.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:59.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[89279]: osdmap e801: 8 total, 8 up, 8 in 2024-03-30T12:34:59.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:59.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:59.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:59.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:59.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:59.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:59.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:59.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:59.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:59.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:59.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:59.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:59.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:59.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:59.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:59.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[91810]: osdmap e801: 8 total, 8 up, 8 in 2024-03-30T12:34:59.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:59.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:59.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:59.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:59.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:59.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:59.532 INFO:tasks.rados.rados.0.smithi084.stdout:3657: done (2 left) 2024-03-30T12:34:59.533 INFO:tasks.rados.rados.0.smithi084.stdout:3658: snap_remove snap 362 2024-03-30T12:34:59.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:34:59] "GET /metrics HTTP/1.1" 200 36331 "" "Prometheus/2.43.0" 2024-03-30T12:34:59.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:59.543+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:59.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:34:59.543+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:59.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:59.537+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:59.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:59.537+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:59.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:59.538+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:34:59.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:59.538+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:59.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:59.539+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:59.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:34:59.539+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[89279]: osdmap e802: 8 total, 8 up, 8 in 2024-03-30T12:34:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:59.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:59.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:59.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:59.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:59.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:59.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:59.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:59.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[89279]: pgmap v894: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 17 MiB/s rd, 4.9 MiB/s wr, 40 op/s 2024-03-30T12:34:59.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[91810]: osdmap e802: 8 total, 8 up, 8 in 2024-03-30T12:34:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:59.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:59.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:34:59 smithi084 ceph-mon[91810]: pgmap v894: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 17 MiB/s rd, 4.9 MiB/s wr, 40 op/s 2024-03-30T12:34:59.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:59.538+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:59.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:59.538+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:34:59.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:34:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:34:59.538+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:59 smithi162 ceph-mon[83709]: osdmap e802: 8 total, 8 up, 8 in 2024-03-30T12:34:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:34:59.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:34:59.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:34:59.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:34:59.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:34:59.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:34:59.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:34:59.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:34:59.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:34:59.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:34:59.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:34:59.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:34:59.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:34:59.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:34:59 smithi162 ceph-mon[83709]: pgmap v894: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 17 MiB/s rd, 4.9 MiB/s wr, 40 op/s 2024-03-30T12:35:00.353 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:00.083+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:00.353 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:00.083+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:00.354 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:00.173+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:00.354 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:00.173+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:00.354 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:00.173+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:00.537 INFO:tasks.rados.rados.0.smithi084.stdout:3658: done (2 left) 2024-03-30T12:35:00.537 INFO:tasks.rados.rados.0.smithi084.stdout:3659: snap_create 2024-03-30T12:35:00.537 INFO:tasks.rados.rados.0.smithi084.stdout:3655: finishing rollback tid 0 to smithi08477944-50 2024-03-30T12:35:00.537 INFO:tasks.rados.rados.0.smithi084.stdout:3655: finishing rollback tid 1 to smithi08477944-50 2024-03-30T12:35:00.537 INFO:tasks.rados.rados.0.smithi084.stdout:3655: finishing rollback tid 2 to smithi08477944-50 2024-03-30T12:35:00.537 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 36326 (ObjNum 1045 snap 334 seq_num 1045) dirty exists 2024-03-30T12:35:00.537 INFO:tasks.rados.rados.0.smithi084.stdout:3656: finishing rollback tid 1 to smithi08477944-8 2024-03-30T12:35:00.537 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 27398 (ObjNum 65 snap 0 seq_num 1718643293) dirty dne 2024-03-30T12:35:00.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:00.361+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:00.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:00.545+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:00.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:00.545+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:00.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:00.545+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:00.620 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:00.545+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:00.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:00.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:00.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:00 smithi162 ceph-mon[83709]: osdmap e803: 8 total, 8 up, 8 in 2024-03-30T12:35:00.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:00.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:00 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:00.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:00 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:35:00.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:00.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:00.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:00.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:00 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:01.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:01.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:01.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:01.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:01.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:00 smithi084 ceph-mon[89279]: osdmap e803: 8 total, 8 up, 8 in 2024-03-30T12:35:01.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:01.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:00 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:01.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:00 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:35:01.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:01.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:01.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:01.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:00 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:01.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:01.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:01.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:01.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:01.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:00 smithi084 ceph-mon[91810]: osdmap e803: 8 total, 8 up, 8 in 2024-03-30T12:35:01.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:01.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:00 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:01.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:00 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:35:01.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:01.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:01.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:01.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:00 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:01.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:01.112+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:01.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:01.112+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:01.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:01.112+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:01.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:01.110+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:01.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:01.110+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:01.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:01.089+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:01.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:01.089+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:01.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:01.089+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:01.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:01.089+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:01.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:01.090+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:01.540 INFO:tasks.rados.rados.0.smithi084.stdout:3655: done (2 left) 2024-03-30T12:35:01.540 INFO:tasks.rados.rados.0.smithi084.stdout:3656: done (1 left) 2024-03-30T12:35:01.540 INFO:tasks.rados.rados.0.smithi084.stdout:3659: done (0 left) 2024-03-30T12:35:01.540 INFO:tasks.rados.rados.0.smithi084.stdout:3660: rmattr oid 26 current snap is 370 2024-03-30T12:35:01.541 INFO:tasks.rados.rados.0.smithi084.stdout:3660: done (0 left) 2024-03-30T12:35:01.541 INFO:tasks.rados.rados.0.smithi084.stdout:3661: snap_remove snap 363 2024-03-30T12:35:01.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:01.548+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:01.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:01.548+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:01.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:01.548+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:01.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:01.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:01.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:01.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:01 smithi162 ceph-mon[83709]: osdmap e804: 8 total, 8 up, 8 in 2024-03-30T12:35:01.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:01.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:01.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:01 smithi162 ceph-mon[83709]: pgmap v897: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 10 MiB/s rd, 4.1 MiB/s wr, 35 op/s 2024-03-30T12:35:01.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:01.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:02.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:01.548+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:02.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:01.548+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:02.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:02.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:02.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:02.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-mon[89279]: osdmap e804: 8 total, 8 up, 8 in 2024-03-30T12:35:02.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:02.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:02.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-mon[89279]: pgmap v897: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 10 MiB/s rd, 4.1 MiB/s wr, 35 op/s 2024-03-30T12:35:02.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:02.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:02.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:01.548+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:02.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:01.548+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:02.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:01.549+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:02.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:01.549+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:02.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:01.549+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:02.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:01.549+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:02.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:02.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:02.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:02.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-mon[91810]: osdmap e804: 8 total, 8 up, 8 in 2024-03-30T12:35:02.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:02.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:02.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-mon[91810]: pgmap v897: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 10 MiB/s rd, 4.1 MiB/s wr, 35 op/s 2024-03-30T12:35:02.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:02.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:02.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:02.065+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:02.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:02.064+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:02.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:02.064+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:02.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:02.064+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:02.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:02.063+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:02.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:02.063+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:02.541 INFO:tasks.rados.rados.0.smithi084.stdout:3661: done (0 left) 2024-03-30T12:35:02.541 INFO:tasks.rados.rados.0.smithi084.stdout:3662: snap_create 2024-03-30T12:35:02.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:02.550+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:02.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:02.550+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:02.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:02.550+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:02.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:02.550+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:02.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:02.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:02.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:02.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:02.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:02.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:02.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:02.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:02.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:02.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-mon[83709]: osdmap e805: 8 total, 8 up, 8 in 2024-03-30T12:35:02.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:02.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:02.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:02.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:02.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:02.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:02.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:02.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:02.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:02.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:02.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:02.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:03.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:02.548+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:03.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:02.548+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:03.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:02.548+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:03.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:02.549+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:03.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:02.549+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:03.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:03.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:03.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:03.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:03.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:03.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:03.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[91810]: osdmap e805: 8 total, 8 up, 8 in 2024-03-30T12:35:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:03.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:03.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:03.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:03.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:03.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:03.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:03.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:03.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:03.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:03.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:03.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[89279]: osdmap e805: 8 total, 8 up, 8 in 2024-03-30T12:35:03.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:03.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:03.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:03.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:03.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:03.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:03.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:03.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:03.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:03.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:03.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:03.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:03.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:03.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:03.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:03.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:03.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:03.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:03.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:03.546 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:03.438+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:03.546 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:03.207+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:03.546 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:03.207+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:03.554 INFO:tasks.rados.rados.0.smithi084.stdout:3662: done (0 left) 2024-03-30T12:35:03.555 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 371 2024-03-30T12:35:03.555 INFO:tasks.rados.rados.0.smithi084.stdout:3663: seq_num 1128 ranges {2236416=499712,2736128=483328,3219456=786432,4005888=335872} 2024-03-30T12:35:03.569 INFO:tasks.rados.rados.0.smithi084.stdout:3663: writing smithi08477944-50 from 2236416 to 2736128 tid 1 2024-03-30T12:35:03.572 INFO:tasks.rados.rados.0.smithi084.stdout:3663: writing smithi08477944-50 from 2736128 to 3219456 tid 2 2024-03-30T12:35:03.577 INFO:tasks.rados.rados.0.smithi084.stdout:3663: writing smithi08477944-50 from 3219456 to 4005888 tid 3 2024-03-30T12:35:03.580 INFO:tasks.rados.rados.0.smithi084.stdout:3663: writing smithi08477944-50 from 4005888 to 4341760 tid 4 2024-03-30T12:35:03.580 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 371 2024-03-30T12:35:03.580 INFO:tasks.rados.rados.0.smithi084.stdout:3663: finishing write tid 1 to smithi08477944-50 2024-03-30T12:35:03.580 INFO:tasks.rados.rados.0.smithi084.stdout:3664: seq_num 1129 ranges {1736704=516096,2252800=770048,3022848=598016,3620864=237568} 2024-03-30T12:35:03.591 INFO:tasks.rados.rados.0.smithi084.stdout:3664: writing smithi08477944-7 from 1736704 to 2252800 tid 1 2024-03-30T12:35:03.599 INFO:tasks.rados.rados.0.smithi084.stdout:3664: writing smithi08477944-7 from 2252800 to 3022848 tid 2 2024-03-30T12:35:03.601 INFO:tasks.rados.rados.0.smithi084.stdout:3664: writing smithi08477944-7 from 3022848 to 3620864 tid 3 2024-03-30T12:35:03.603 INFO:tasks.rados.rados.0.smithi084.stdout:3664: writing smithi08477944-7 from 3620864 to 3858432 tid 4 2024-03-30T12:35:03.603 INFO:tasks.rados.rados.0.smithi084.stdout:3665: rollback oid 43 current snap is 371 2024-03-30T12:35:03.603 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 43 to 349 2024-03-30T12:35:03.603 INFO:tasks.rados.rados.0.smithi084.stdout:3663: finishing write tid 2 to smithi08477944-50 2024-03-30T12:35:03.603 INFO:tasks.rados.rados.0.smithi084.stdout:3663: finishing write tid 3 to smithi08477944-50 2024-03-30T12:35:03.603 INFO:tasks.rados.rados.0.smithi084.stdout:3663: finishing write tid 4 to smithi08477944-50 2024-03-30T12:35:03.603 INFO:tasks.rados.rados.0.smithi084.stdout:3663: finishing write tid 5 to smithi08477944-50 2024-03-30T12:35:03.603 INFO:tasks.rados.rados.0.smithi084.stdout:3663: finishing write tid 6 to smithi08477944-50 2024-03-30T12:35:03.603 INFO:tasks.rados.rados.0.smithi084.stdout:3663: oid 50 updating version 0 to 36330 2024-03-30T12:35:03.603 INFO:tasks.rados.rados.0.smithi084.stdout:3663: oid 50 version 36330 is already newer than 36329 2024-03-30T12:35:03.603 INFO:tasks.rados.rados.0.smithi084.stdout:3663: oid 50 version 36330 is already newer than 36327 2024-03-30T12:35:03.604 INFO:tasks.rados.rados.0.smithi084.stdout:3663: oid 50 updating version 36330 to 36331 2024-03-30T12:35:03.604 INFO:tasks.rados.rados.0.smithi084.stdout:3663: oid 50 version 36331 is already newer than 36328 2024-03-30T12:35:03.604 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 36331 (ObjNum 1128 snap 371 seq_num 1128) dirty exists 2024-03-30T12:35:03.604 INFO:tasks.rados.rados.0.smithi084.stdout:3663: left oid 50 (ObjNum 1128 snap 371 seq_num 1128) 2024-03-30T12:35:03.604 INFO:tasks.rados.rados.0.smithi084.stdout:3664: finishing write tid 1 to smithi08477944-7 2024-03-30T12:35:03.604 INFO:tasks.rados.rados.0.smithi084.stdout:3663: done (2 left) 2024-03-30T12:35:03.604 INFO:tasks.rados.rados.0.smithi084.stdout:3666: delete oid 4 current snap is 371 2024-03-30T12:35:03.604 INFO:tasks.rados.rados.0.smithi084.stdout:3664: finishing write tid 2 to smithi08477944-7 2024-03-30T12:35:03.606 INFO:tasks.rados.rados.0.smithi084.stdout:3666: done (2 left) 2024-03-30T12:35:03.606 INFO:tasks.rados.rados.0.smithi084.stdout:3667: read oid 18 snap 346 2024-03-30T12:35:03.606 INFO:tasks.rados.rados.0.smithi084.stdout:3667: expect (ObjNum 825 snap 273 seq_num 825) 2024-03-30T12:35:03.607 INFO:tasks.rados.rados.0.smithi084.stdout:3668: copy_from oid 16 from oid 47 current snap is 371 2024-03-30T12:35:03.607 INFO:tasks.rados.rados.0.smithi084.stdout:3669: copy_from oid 3 from oid 20 current snap is 371 2024-03-30T12:35:03.607 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 48 current snap is 371 2024-03-30T12:35:03.607 INFO:tasks.rados.rados.0.smithi084.stdout:3670: seq_num 1131 ranges {3883008=548864,4431872=540672,4972544=565248,5537792=425984,5963776=73728} 2024-03-30T12:35:03.632 INFO:tasks.rados.rados.0.smithi084.stdout:3670: writing smithi08477944-48 from 3883008 to 4431872 tid 1 2024-03-30T12:35:03.635 INFO:tasks.rados.rados.0.smithi084.stdout:3670: writing smithi08477944-48 from 4431872 to 4972544 tid 2 2024-03-30T12:35:03.638 INFO:tasks.rados.rados.0.smithi084.stdout:3670: writing smithi08477944-48 from 4972544 to 5537792 tid 3 2024-03-30T12:35:03.641 INFO:tasks.rados.rados.0.smithi084.stdout:3670: writing smithi08477944-48 from 5537792 to 5963776 tid 4 2024-03-30T12:35:03.642 INFO:tasks.rados.rados.0.smithi084.stdout:3670: writing smithi08477944-48 from 5963776 to 6037504 tid 5 2024-03-30T12:35:03.642 INFO:tasks.rados.rados.0.smithi084.stdout:3671: delete oid 36 current snap is 371 2024-03-30T12:35:03.642 INFO:tasks.rados.rados.0.smithi084.stdout:3664: finishing write tid 3 to smithi08477944-7 2024-03-30T12:35:03.642 INFO:tasks.rados.rados.0.smithi084.stdout:3664: finishing write tid 4 to smithi08477944-7 2024-03-30T12:35:03.642 INFO:tasks.rados.rados.0.smithi084.stdout:3668: finishing copy_from to smithi08477944-16 2024-03-30T12:35:03.642 INFO:tasks.rados.rados.0.smithi084.stdout:3668: got expected ENOENT (src dne) 2024-03-30T12:35:03.642 INFO:tasks.rados.rados.0.smithi084.stdout:3668: finishing copy_from racing read to smithi08477944-16 2024-03-30T12:35:03.642 INFO:tasks.rados.rados.0.smithi084.stdout:3664: finishing write tid 5 to smithi08477944-7 2024-03-30T12:35:03.642 INFO:tasks.rados.rados.0.smithi084.stdout:3665: finishing rollback tid 0 to smithi08477944-43 2024-03-30T12:35:03.642 INFO:tasks.rados.rados.0.smithi084.stdout:3667: expect (ObjNum 825 snap 273 seq_num 825) 2024-03-30T12:35:03.694 INFO:tasks.rados.rados.0.smithi084.stdout:3664: finishing write tid 6 to smithi08477944-7 2024-03-30T12:35:03.694 INFO:tasks.rados.rados.0.smithi084.stdout:3664: oid 7 updating version 0 to 36320 2024-03-30T12:35:03.694 INFO:tasks.rados.rados.0.smithi084.stdout:3664: oid 7 version 36320 is already newer than 36317 2024-03-30T12:35:03.694 INFO:tasks.rados.rados.0.smithi084.stdout:3664: oid 7 version 36320 is already newer than 36318 2024-03-30T12:35:03.694 INFO:tasks.rados.rados.0.smithi084.stdout:3664: oid 7 version 36320 is already newer than 36316 2024-03-30T12:35:03.694 INFO:tasks.rados.rados.0.smithi084.stdout:3664: oid 7 version 36320 is already newer than 36319 2024-03-30T12:35:03.694 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 36320 (ObjNum 1129 snap 371 seq_num 1129) dirty exists 2024-03-30T12:35:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:3664: left oid 7 (ObjNum 1129 snap 371 seq_num 1129) 2024-03-30T12:35:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:3665: finishing rollback tid 1 to smithi08477944-43 2024-03-30T12:35:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:3665: finishing rollback tid 2 to smithi08477944-43 2024-03-30T12:35:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 36386 (ObjNum 1062 snap 344 seq_num 1062) dirty exists 2024-03-30T12:35:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:3669: finishing copy_from racing read to smithi08477944-3 2024-03-30T12:35:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:3669: finishing copy_from to smithi08477944-3 2024-03-30T12:35:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 36307 (ObjNum 1106 snap 362 seq_num 1106) dirty exists 2024-03-30T12:35:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:3670: finishing write tid 1 to smithi08477944-48 2024-03-30T12:35:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:3664: done (6 left) 2024-03-30T12:35:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:3665: done (5 left) 2024-03-30T12:35:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:3667: done (4 left) 2024-03-30T12:35:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:3668: done (3 left) 2024-03-30T12:35:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:3669: done (2 left) 2024-03-30T12:35:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:3671: done (1 left) 2024-03-30T12:35:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:3672: snap_create 2024-03-30T12:35:03.695 INFO:tasks.rados.rados.0.smithi084.stdout:3670: finishing write tid 2 to smithi08477944-48 2024-03-30T12:35:03.696 INFO:tasks.rados.rados.0.smithi084.stdout:3670: finishing write tid 3 to smithi08477944-48 2024-03-30T12:35:03.696 INFO:tasks.rados.rados.0.smithi084.stdout:3670: finishing write tid 4 to smithi08477944-48 2024-03-30T12:35:03.696 INFO:tasks.rados.rados.0.smithi084.stdout:3670: finishing write tid 5 to smithi08477944-48 2024-03-30T12:35:03.696 INFO:tasks.rados.rados.0.smithi084.stdout:3670: finishing write tid 6 to smithi08477944-48 2024-03-30T12:35:03.696 INFO:tasks.rados.rados.0.smithi084.stdout:3670: finishing write tid 7 to smithi08477944-48 2024-03-30T12:35:03.696 INFO:tasks.rados.rados.0.smithi084.stdout:3670: oid 48 updating version 0 to 23440 2024-03-30T12:35:03.696 INFO:tasks.rados.rados.0.smithi084.stdout:3670: oid 48 version 23440 is already newer than 23438 2024-03-30T12:35:03.696 INFO:tasks.rados.rados.0.smithi084.stdout:3670: oid 48 updating version 23440 to 23441 2024-03-30T12:35:03.696 INFO:tasks.rados.rados.0.smithi084.stdout:3670: oid 48 updating version 23441 to 23442 2024-03-30T12:35:03.696 INFO:tasks.rados.rados.0.smithi084.stdout:3670: oid 48 updating version 23442 to 23443 2024-03-30T12:35:03.696 INFO:tasks.rados.rados.0.smithi084.stdout:3670: oid 48 version 23443 is already newer than 23439 2024-03-30T12:35:03.696 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 23443 (ObjNum 1131 snap 371 seq_num 1131) dirty exists 2024-03-30T12:35:03.696 INFO:tasks.rados.rados.0.smithi084.stdout:3670: left oid 48 (ObjNum 1131 snap 371 seq_num 1131) 2024-03-30T12:35:03.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:03.439+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:03.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:03.439+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:03.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:03.606+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:03.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:03.606+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:03.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:03.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:03.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:03.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:03.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:03.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[89279]: osdmap e806: 8 total, 8 up, 8 in 2024-03-30T12:35:03.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:03.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:03.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:03.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:03.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[89279]: pgmap v900: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 2.5 MiB/s rd, 1000 KiB/s wr, 5 op/s 2024-03-30T12:35:03.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:03.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:03.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:03.560+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:03.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:03.560+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:03.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:03.560+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:03.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:03.560+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:03.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:03.560+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:03.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:03.561+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:03.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:03.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:03.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:03.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:03.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:03.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[91810]: osdmap e806: 8 total, 8 up, 8 in 2024-03-30T12:35:03.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:03.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:03.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:03.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:03.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[91810]: pgmap v900: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 2.5 MiB/s rd, 1000 KiB/s wr, 5 op/s 2024-03-30T12:35:03.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:03.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:03.822 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:03.557+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:03.822 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:03.557+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:03.822 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:03.557+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:03.823 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:03.583+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:03.823 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:03.583+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:03.823 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:03.583+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:03.823 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:03.561+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:03.823 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:03.561+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:03.824 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:03.824 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:03.824 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:03.824 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:03.824 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:03.824 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:03 smithi162 ceph-mon[83709]: osdmap e806: 8 total, 8 up, 8 in 2024-03-30T12:35:03.824 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:03.824 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:03.824 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:03.824 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:03.824 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:03 smithi162 ceph-mon[83709]: pgmap v900: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 2.5 MiB/s rd, 1000 KiB/s wr, 5 op/s 2024-03-30T12:35:03.824 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:03.825 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:04.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:03.830+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:04.562 INFO:tasks.rados.rados.0.smithi084.stdout:3670: done (1 left) 2024-03-30T12:35:04.562 INFO:tasks.rados.rados.0.smithi084.stdout:3672: done (0 left) 2024-03-30T12:35:04.562 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 42 current snap is 372 2024-03-30T12:35:04.562 INFO:tasks.rados.rados.0.smithi084.stdout:3673: seq_num 1133 ranges {0=581632,581632=753664,1335296=573440,1908736=278528} 2024-03-30T12:35:04.565 INFO:tasks.rados.rados.0.smithi084.stdout:3673: writing smithi08477944-42 from 0 to 581632 tid 1 2024-03-30T12:35:04.569 INFO:tasks.rados.rados.0.smithi084.stdout:3673: writing smithi08477944-42 from 581632 to 1335296 tid 2 2024-03-30T12:35:04.573 INFO:tasks.rados.rados.0.smithi084.stdout:3673: writing smithi08477944-42 from 1335296 to 1908736 tid 3 2024-03-30T12:35:04.575 INFO:tasks.rados.rados.0.smithi084.stdout:3673: writing smithi08477944-42 from 1908736 to 2187264 tid 4 2024-03-30T12:35:04.575 INFO:tasks.rados.rados.0.smithi084.stdout:3674: rmattr oid 22 current snap is 372 2024-03-30T12:35:04.575 INFO:tasks.rados.rados.0.smithi084.stdout:3674: done (1 left) 2024-03-30T12:35:04.575 INFO:tasks.rados.rados.0.smithi084.stdout:3675: read oid 49 snap 371 2024-03-30T12:35:04.575 INFO:tasks.rados.rados.0.smithi084.stdout:3675: expect (ObjNum 1098 snap 357 seq_num 1098) 2024-03-30T12:35:04.575 INFO:tasks.rados.rados.0.smithi084.stdout:3676: setattr oid 21 current snap is 372 2024-03-30T12:35:04.575 INFO:tasks.rados.rados.0.smithi084.stdout:3673: finishing write tid 1 to smithi08477944-42 2024-03-30T12:35:04.575 INFO:tasks.rados.rados.0.smithi084.stdout:3673: finishing write tid 2 to smithi08477944-42 2024-03-30T12:35:04.576 INFO:tasks.rados.rados.0.smithi084.stdout:3677: copy_from oid 40 from oid 15 current snap is 372 2024-03-30T12:35:04.576 INFO:tasks.rados.rados.0.smithi084.stdout:3678: rollback oid 48 current snap is 372 2024-03-30T12:35:04.576 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 48 to 368 2024-03-30T12:35:04.576 INFO:tasks.rados.rados.0.smithi084.stdout:3679: snap_remove snap 370 2024-03-30T12:35:04.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:04.580+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:04.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:04.567+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:04.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:04.567+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:04.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:04.570+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:04.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:04.570+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:04.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:04.591+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:04.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:04.591+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:04.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:04.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:04.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:04.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:04.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:04.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:04.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:04.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:04.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:04.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:04.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:04.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:04 smithi162 ceph-mon[83709]: osdmap e807: 8 total, 8 up, 8 in 2024-03-30T12:35:04.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:04.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:04.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:04.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:04.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:05.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:04.576+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:05.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:04.578+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:05.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:05.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:05.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:05.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:05.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:05.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:05.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:05.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:05.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:05.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:05.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:05.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[91810]: osdmap e807: 8 total, 8 up, 8 in 2024-03-30T12:35:05.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:05.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:04.569+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:05.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:04.569+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:05.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:04.569+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:05.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:04.569+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:05.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:04.569+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:05.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:05.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:05.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:05.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:05.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:05.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:05.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19f=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:05.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:05.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:05.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:05.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:05.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[89279]: osdmap e807: 8 total, 8 up, 8 in 2024-03-30T12:35:05.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:05.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:05.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:05.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:05.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:05.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ac=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:05.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:05.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:05.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:05.574 INFO:tasks.rados.rados.0.smithi084.stdout:3679: done (5 left) 2024-03-30T12:35:05.574 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 33 current snap is 372 2024-03-30T12:35:05.574 INFO:tasks.rados.rados.0.smithi084.stdout:3673: finishing write tid 3 to smithi08477944-42 2024-03-30T12:35:05.574 INFO:tasks.rados.rados.0.smithi084.stdout:3680: seq_num 1134 ranges {1146880=598016,1744896=638976,2383872=737280,3121152=229376} 2024-03-30T12:35:05.583 INFO:tasks.rados.rados.0.smithi084.stdout:3680: writing smithi08477944-33 from 1146880 to 1744896 tid 1 2024-03-30T12:35:05.587 INFO:tasks.rados.rados.0.smithi084.stdout:3680: writing smithi08477944-33 from 1744896 to 2383872 tid 2 2024-03-30T12:35:05.592 INFO:tasks.rados.rados.0.smithi084.stdout:3680: writing smithi08477944-33 from 2383872 to 3121152 tid 3 2024-03-30T12:35:05.594 INFO:tasks.rados.rados.0.smithi084.stdout:3680: writing smithi08477944-33 from 3121152 to 3350528 tid 4 2024-03-30T12:35:05.594 INFO:tasks.rados.rados.0.smithi084.stdout:3681: rollback oid 4 current snap is 372 2024-03-30T12:35:05.594 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 4 to 340 2024-03-30T12:35:05.594 INFO:tasks.rados.rados.0.smithi084.stdout:3673: finishing write tid 4 to smithi08477944-42 2024-03-30T12:35:05.594 INFO:tasks.rados.rados.0.smithi084.stdout:3678: finishing rollback tid 0 to smithi08477944-48 2024-03-30T12:35:05.594 INFO:tasks.rados.rados.0.smithi084.stdout:3678: finishing rollback tid 1 to smithi08477944-48 2024-03-30T12:35:05.594 INFO:tasks.rados.rados.0.smithi084.stdout:3673: finishing write tid 5 to smithi08477944-42 2024-03-30T12:35:05.594 INFO:tasks.rados.rados.0.smithi084.stdout:3678: finishing rollback tid 2 to smithi08477944-48 2024-03-30T12:35:05.594 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 48 v 23446 (ObjNum 1100 snap 359 seq_num 1100) dirty exists 2024-03-30T12:35:05.594 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 36301 (ObjNum 1097 snap 356 seq_num 1097) dirty exists 2024-03-30T12:35:05.594 INFO:tasks.rados.rados.0.smithi084.stdout:3675: expect (ObjNum 1098 snap 357 seq_num 1098) 2024-03-30T12:35:05.653 INFO:tasks.rados.rados.0.smithi084.stdout:3673: finishing write tid 6 to smithi08477944-42 2024-03-30T12:35:05.653 INFO:tasks.rados.rados.0.smithi084.stdout:3673: oid 42 updating version 0 to 27419 2024-03-30T12:35:05.653 INFO:tasks.rados.rados.0.smithi084.stdout:3673: oid 42 version 27419 is already newer than 27417 2024-03-30T12:35:05.653 INFO:tasks.rados.rados.0.smithi084.stdout:3673: oid 42 version 27419 is already newer than 27416 2024-03-30T12:35:05.653 INFO:tasks.rados.rados.0.smithi084.stdout:3673: oid 42 version 27419 is already newer than 27415 2024-03-30T12:35:05.653 INFO:tasks.rados.rados.0.smithi084.stdout:3673: oid 42 version 27419 is already newer than 27418 2024-03-30T12:35:05.653 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 27419 (ObjNum 1133 snap 372 seq_num 1133) dirty exists 2024-03-30T12:35:05.653 INFO:tasks.rados.rados.0.smithi084.stdout:3673: left oid 42 (ObjNum 1133 snap 372 seq_num 1133) 2024-03-30T12:35:05.653 INFO:tasks.rados.rados.0.smithi084.stdout:3677: finishing copy_from racing read to smithi08477944-40 2024-03-30T12:35:05.653 INFO:tasks.rados.rados.0.smithi084.stdout:3677: finishing copy_from to smithi08477944-40 2024-03-30T12:35:05.653 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 27414 (ObjNum 1116 snap 365 seq_num 1116) dirty exists 2024-03-30T12:35:05.654 INFO:tasks.rados.rados.0.smithi084.stdout:3673: done (6 left) 2024-03-30T12:35:05.654 INFO:tasks.rados.rados.0.smithi084.stdout:3675: done (5 left) 2024-03-30T12:35:05.654 INFO:tasks.rados.rados.0.smithi084.stdout:3676: done (4 left) 2024-03-30T12:35:05.654 INFO:tasks.rados.rados.0.smithi084.stdout:3677: done (3 left) 2024-03-30T12:35:05.654 INFO:tasks.rados.rados.0.smithi084.stdout:3678: done (2 left) 2024-03-30T12:35:05.654 INFO:tasks.rados.rados.0.smithi084.stdout:3682: read oid 45 snap -1 2024-03-30T12:35:05.654 INFO:tasks.rados.rados.0.smithi084.stdout:3682: expect (ObjNum 1088 snap 351 seq_num 1088) 2024-03-30T12:35:05.654 INFO:tasks.rados.rados.0.smithi084.stdout:3683: copy_from oid 46 from oid 16 current snap is 372 2024-03-30T12:35:05.654 INFO:tasks.rados.rados.0.smithi084.stdout:3680: finishing write tid 1 to smithi08477944-33 2024-03-30T12:35:05.654 INFO:tasks.rados.rados.0.smithi084.stdout:3680: finishing write tid 2 to smithi08477944-33 2024-03-30T12:35:05.654 INFO:tasks.rados.rados.0.smithi084.stdout:3681: finishing rollback tid 1 to smithi08477944-4 2024-03-30T12:35:05.654 INFO:tasks.rados.rados.0.smithi084.stdout:3681: finishing rollback tid 2 to smithi08477944-4 2024-03-30T12:35:05.655 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 36330 (ObjNum 1019 snap 327 seq_num 1019) dirty exists 2024-03-30T12:35:05.655 INFO:tasks.rados.rados.0.smithi084.stdout:3680: finishing write tid 3 to smithi08477944-33 2024-03-30T12:35:05.655 INFO:tasks.rados.rados.0.smithi084.stdout:3680: finishing write tid 4 to smithi08477944-33 2024-03-30T12:35:05.655 INFO:tasks.rados.rados.0.smithi084.stdout:3680: finishing write tid 5 to smithi08477944-33 2024-03-30T12:35:05.655 INFO:tasks.rados.rados.0.smithi084.stdout:3680: finishing write tid 6 to smithi08477944-33 2024-03-30T12:35:05.655 INFO:tasks.rados.rados.0.smithi084.stdout:3680: oid 33 updating version 0 to 36325 2024-03-30T12:35:05.655 INFO:tasks.rados.rados.0.smithi084.stdout:3680: oid 33 version 36325 is already newer than 36323 2024-03-30T12:35:05.655 INFO:tasks.rados.rados.0.smithi084.stdout:3680: oid 33 version 36325 is already newer than 36324 2024-03-30T12:35:05.655 INFO:tasks.rados.rados.0.smithi084.stdout:3680: oid 33 version 36325 is already newer than 36321 2024-03-30T12:35:05.655 INFO:tasks.rados.rados.0.smithi084.stdout:3680: oid 33 version 36325 is already newer than 36322 2024-03-30T12:35:05.655 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 36325 (ObjNum 1134 snap 372 seq_num 1134) dirty exists 2024-03-30T12:35:05.655 INFO:tasks.rados.rados.0.smithi084.stdout:3680: left oid 33 (ObjNum 1134 snap 372 seq_num 1134) 2024-03-30T12:35:05.655 INFO:tasks.rados.rados.0.smithi084.stdout:3680: done (3 left) 2024-03-30T12:35:05.656 INFO:tasks.rados.rados.0.smithi084.stdout:3681: done (2 left) 2024-03-30T12:35:05.656 INFO:tasks.rados.rados.0.smithi084.stdout:3684: copy_from oid 28 from oid 31 current snap is 372 2024-03-30T12:35:05.656 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 4 current snap is 372 2024-03-30T12:35:05.656 INFO:tasks.rados.rados.0.smithi084.stdout:3685: seq_num 1135 ranges {1335296=614400,1949696=524288,2473984=540672,3014656=483328,3497984=57344} 2024-03-30T12:35:05.663 INFO:tasks.rados.rados.0.smithi084.stdout:3685: writing smithi08477944-4 from 1335296 to 1949696 tid 1 2024-03-30T12:35:05.666 INFO:tasks.rados.rados.0.smithi084.stdout:3685: writing smithi08477944-4 from 1949696 to 2473984 tid 2 2024-03-30T12:35:05.669 INFO:tasks.rados.rados.0.smithi084.stdout:3685: writing smithi08477944-4 from 2473984 to 3014656 tid 3 2024-03-30T12:35:05.673 INFO:tasks.rados.rados.0.smithi084.stdout:3685: writing smithi08477944-4 from 3014656 to 3497984 tid 4 2024-03-30T12:35:05.673 INFO:tasks.rados.rados.0.smithi084.stdout:3685: writing smithi08477944-4 from 3497984 to 3555328 tid 5 2024-03-30T12:35:05.673 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 372 2024-03-30T12:35:05.673 INFO:tasks.rados.rados.0.smithi084.stdout:3686: seq_num 1136 ranges {1466368=630784,2097152=409600,2506752=753664,3260416=417792,3678208=24576} 2024-03-30T12:35:05.684 INFO:tasks.rados.rados.0.smithi084.stdout:3686: writing smithi08477944-44 from 1466368 to 2097152 tid 1 2024-03-30T12:35:05.687 INFO:tasks.rados.rados.0.smithi084.stdout:3686: writing smithi08477944-44 from 2097152 to 2506752 tid 2 2024-03-30T12:35:05.691 INFO:tasks.rados.rados.0.smithi084.stdout:3686: writing smithi08477944-44 from 2506752 to 3260416 tid 3 2024-03-30T12:35:05.694 INFO:tasks.rados.rados.0.smithi084.stdout:3686: writing smithi08477944-44 from 3260416 to 3678208 tid 4 2024-03-30T12:35:05.694 INFO:tasks.rados.rados.0.smithi084.stdout:3686: writing smithi08477944-44 from 3678208 to 3702784 tid 5 2024-03-30T12:35:05.694 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 372 2024-03-30T12:35:05.695 INFO:tasks.rados.rados.0.smithi084.stdout:3687: seq_num 1137 ranges {1818624=647168,2465792=696320,3162112=557056,3719168=352256} 2024-03-30T12:35:05.708 INFO:tasks.rados.rados.0.smithi084.stdout:3687: writing smithi08477944-14 from 1818624 to 2465792 tid 1 2024-03-30T12:35:05.711 INFO:tasks.rados.rados.0.smithi084.stdout:3687: writing smithi08477944-14 from 2465792 to 3162112 tid 2 2024-03-30T12:35:05.714 INFO:tasks.rados.rados.0.smithi084.stdout:3687: writing smithi08477944-14 from 3162112 to 3719168 tid 3 2024-03-30T12:35:05.717 INFO:tasks.rados.rados.0.smithi084.stdout:3687: writing smithi08477944-14 from 3719168 to 4071424 tid 4 2024-03-30T12:35:05.717 INFO:tasks.rados.rados.0.smithi084.stdout:3688: delete oid 38 current snap is 372 2024-03-30T12:35:05.717 INFO:tasks.rados.rados.0.smithi084.stdout:3682: expect (ObjNum 1088 snap 351 seq_num 1088) 2024-03-30T12:35:05.823 INFO:tasks.rados.rados.0.smithi084.stdout:3683: finishing copy_from racing read to smithi08477944-46 2024-03-30T12:35:05.824 INFO:tasks.rados.rados.0.smithi084.stdout:3683: finishing copy_from to smithi08477944-46 2024-03-30T12:35:05.824 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 27331 (ObjNum 1023 snap 328 seq_num 1023) dirty exists 2024-03-30T12:35:05.824 INFO:tasks.rados.rados.0.smithi084.stdout:3684: finishing copy_from racing read to smithi08477944-28 2024-03-30T12:35:05.824 INFO:tasks.rados.rados.0.smithi084.stdout:3684: finishing copy_from to smithi08477944-28 2024-03-30T12:35:05.824 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 36323 (ObjNum 1007 snap 325 seq_num 1007) dirty exists 2024-03-30T12:35:05.824 INFO:tasks.rados.rados.0.smithi084.stdout:3682: done (6 left) 2024-03-30T12:35:05.824 INFO:tasks.rados.rados.0.smithi084.stdout:3683: done (5 left) 2024-03-30T12:35:05.824 INFO:tasks.rados.rados.0.smithi084.stdout:3684: done (4 left) 2024-03-30T12:35:05.824 INFO:tasks.rados.rados.0.smithi084.stdout:3688: done (3 left) 2024-03-30T12:35:05.824 INFO:tasks.rados.rados.0.smithi084.stdout:3689: snap_remove snap 357 2024-03-30T12:35:05.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:05.614+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:05.869 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:05.578+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:05.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:05.578+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:05.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:05.575+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:05.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:05.575+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:05.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:05.575+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:05.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:05.606+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:05.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:05.606+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:05.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:05.607+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:05.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:05.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:05.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:05.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:05.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:05.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:05.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:05.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:05.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:05 smithi162 ceph-mon[83709]: osdmap e808: 8 total, 8 up, 8 in 2024-03-30T12:35:05.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:05.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:05 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:05.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:05.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:05.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:05 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:05.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:05 smithi162 ceph-mon[83709]: pgmap v903: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-03-30T12:35:06.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:05.599+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:06.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:05.599+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:06.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:05.576+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:06.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:05.577+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:06.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:05.577+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:06.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:05.577+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:06.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:05.577+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:06.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:05.577+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:06.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:06.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:06.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:06.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:06.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:06.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:06.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:06.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:06.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[91810]: osdmap e808: 8 total, 8 up, 8 in 2024-03-30T12:35:06.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:06.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:06.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:06.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:06.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ad=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:06.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:06.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:06.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:06.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:06.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:06.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:06.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:06.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[89279]: osdmap e808: 8 total, 8 up, 8 in 2024-03-30T12:35:06.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:06.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:06.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:06.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:06.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:06.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[91810]: pgmap v903: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-03-30T12:35:06.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:06.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:05 smithi084 ceph-mon[89279]: pgmap v903: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 8.4 GiB used, 707 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-03-30T12:35:06.581 INFO:tasks.rados.rados.0.smithi084.stdout:3689: done (3 left) 2024-03-30T12:35:06.581 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 30 current snap is 372 2024-03-30T12:35:06.581 INFO:tasks.rados.rados.0.smithi084.stdout:3690: seq_num 1139 ranges {3547136=679936,4227072=458752,4685824=524288,5210112=540672,5750784=81920} 2024-03-30T12:35:06.604 INFO:tasks.rados.rados.0.smithi084.stdout:3690: writing smithi08477944-30 from 3547136 to 4227072 tid 1 2024-03-30T12:35:06.606 INFO:tasks.rados.rados.0.smithi084.stdout:3690: writing smithi08477944-30 from 4227072 to 4685824 tid 2 2024-03-30T12:35:06.610 INFO:tasks.rados.rados.0.smithi084.stdout:3690: writing smithi08477944-30 from 4685824 to 5210112 tid 3 2024-03-30T12:35:06.613 INFO:tasks.rados.rados.0.smithi084.stdout:3690: writing smithi08477944-30 from 5210112 to 5750784 tid 4 2024-03-30T12:35:06.615 INFO:tasks.rados.rados.0.smithi084.stdout:3690: writing smithi08477944-30 from 5750784 to 5832704 tid 5 2024-03-30T12:35:06.615 INFO:tasks.rados.rados.0.smithi084.stdout:3691: read oid 39 snap -1 2024-03-30T12:35:06.615 INFO:tasks.rados.rados.0.smithi084.stdout:3691: expect (ObjNum 1023 snap 328 seq_num 1023) 2024-03-30T12:35:06.615 INFO:tasks.rados.rados.0.smithi084.stdout:3692: copy_from oid 37 from oid 25 current snap is 372 2024-03-30T12:35:06.615 INFO:tasks.rados.rados.0.smithi084.stdout:3685: finishing write tid 1 to smithi08477944-4 2024-03-30T12:35:06.615 INFO:tasks.rados.rados.0.smithi084.stdout:3685: finishing write tid 2 to smithi08477944-4 2024-03-30T12:35:06.615 INFO:tasks.rados.rados.0.smithi084.stdout:3685: finishing write tid 3 to smithi08477944-4 2024-03-30T12:35:06.615 INFO:tasks.rados.rados.0.smithi084.stdout:3685: finishing write tid 4 to smithi08477944-4 2024-03-30T12:35:06.615 INFO:tasks.rados.rados.0.smithi084.stdout:3685: finishing write tid 5 to smithi08477944-4 2024-03-30T12:35:06.615 INFO:tasks.rados.rados.0.smithi084.stdout:3685: finishing write tid 6 to smithi08477944-4 2024-03-30T12:35:06.615 INFO:tasks.rados.rados.0.smithi084.stdout:3685: finishing write tid 7 to smithi08477944-4 2024-03-30T12:35:06.615 INFO:tasks.rados.rados.0.smithi084.stdout:3685: oid 4 updating version 0 to 36336 2024-03-30T12:35:06.616 INFO:tasks.rados.rados.0.smithi084.stdout:3685: oid 4 version 36336 is already newer than 36332 2024-03-30T12:35:06.616 INFO:tasks.rados.rados.0.smithi084.stdout:3685: oid 4 version 36336 is already newer than 36334 2024-03-30T12:35:06.616 INFO:tasks.rados.rados.0.smithi084.stdout:3685: oid 4 version 36336 is already newer than 36331 2024-03-30T12:35:06.616 INFO:tasks.rados.rados.0.smithi084.stdout:3685: oid 4 version 36336 is already newer than 36333 2024-03-30T12:35:06.616 INFO:tasks.rados.rados.0.smithi084.stdout:3685: oid 4 version 36336 is already newer than 36335 2024-03-30T12:35:06.616 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 36336 (ObjNum 1135 snap 372 seq_num 1135) dirty exists 2024-03-30T12:35:06.616 INFO:tasks.rados.rados.0.smithi084.stdout:3685: left oid 4 (ObjNum 1135 snap 372 seq_num 1135) 2024-03-30T12:35:06.616 INFO:tasks.rados.rados.0.smithi084.stdout:3686: finishing write tid 1 to smithi08477944-44 2024-03-30T12:35:06.616 INFO:tasks.rados.rados.0.smithi084.stdout:3686: finishing write tid 2 to smithi08477944-44 2024-03-30T12:35:06.616 INFO:tasks.rados.rados.0.smithi084.stdout:3686: finishing write tid 3 to smithi08477944-44 2024-03-30T12:35:06.616 INFO:tasks.rados.rados.0.smithi084.stdout:3686: finishing write tid 4 to smithi08477944-44 2024-03-30T12:35:06.616 INFO:tasks.rados.rados.0.smithi084.stdout:3686: finishing write tid 5 to smithi08477944-44 2024-03-30T12:35:06.616 INFO:tasks.rados.rados.0.smithi084.stdout:3686: finishing write tid 6 to smithi08477944-44 2024-03-30T12:35:06.616 INFO:tasks.rados.rados.0.smithi084.stdout:3686: finishing write tid 7 to smithi08477944-44 2024-03-30T12:35:06.616 INFO:tasks.rados.rados.0.smithi084.stdout:3686: oid 44 updating version 0 to 36390 2024-03-30T12:35:06.617 INFO:tasks.rados.rados.0.smithi084.stdout:3686: oid 44 updating version 36390 to 36392 2024-03-30T12:35:06.617 INFO:tasks.rados.rados.0.smithi084.stdout:3686: oid 44 version 36392 is already newer than 36388 2024-03-30T12:35:06.617 INFO:tasks.rados.rados.0.smithi084.stdout:3686: oid 44 version 36392 is already newer than 36391 2024-03-30T12:35:06.617 INFO:tasks.rados.rados.0.smithi084.stdout:3686: oid 44 version 36392 is already newer than 36389 2024-03-30T12:35:06.617 INFO:tasks.rados.rados.0.smithi084.stdout:3686: oid 44 updating version 36392 to 36393 2024-03-30T12:35:06.617 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 36393 (ObjNum 1136 snap 372 seq_num 1136) dirty exists 2024-03-30T12:35:06.617 INFO:tasks.rados.rados.0.smithi084.stdout:3686: left oid 44 (ObjNum 1136 snap 372 seq_num 1136) 2024-03-30T12:35:06.617 INFO:tasks.rados.rados.0.smithi084.stdout:3687: finishing write tid 1 to smithi08477944-14 2024-03-30T12:35:06.617 INFO:tasks.rados.rados.0.smithi084.stdout:3687: finishing write tid 2 to smithi08477944-14 2024-03-30T12:35:06.617 INFO:tasks.rados.rados.0.smithi084.stdout:3687: finishing write tid 3 to smithi08477944-14 2024-03-30T12:35:06.617 INFO:tasks.rados.rados.0.smithi084.stdout:3687: finishing write tid 4 to smithi08477944-14 2024-03-30T12:35:06.617 INFO:tasks.rados.rados.0.smithi084.stdout:3687: finishing write tid 5 to smithi08477944-14 2024-03-30T12:35:06.617 INFO:tasks.rados.rados.0.smithi084.stdout:3687: finishing write tid 6 to smithi08477944-14 2024-03-30T12:35:06.617 INFO:tasks.rados.rados.0.smithi084.stdout:3687: oid 14 updating version 0 to 36325 2024-03-30T12:35:06.617 INFO:tasks.rados.rados.0.smithi084.stdout:3687: oid 14 version 36325 is already newer than 36322 2024-03-30T12:35:06.618 INFO:tasks.rados.rados.0.smithi084.stdout:3687: oid 14 version 36325 is already newer than 36324 2024-03-30T12:35:06.618 INFO:tasks.rados.rados.0.smithi084.stdout:3687: oid 14 version 36325 is already newer than 36321 2024-03-30T12:35:06.618 INFO:tasks.rados.rados.0.smithi084.stdout:3687: oid 14 version 36325 is already newer than 36323 2024-03-30T12:35:06.618 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 36325 (ObjNum 1137 snap 372 seq_num 1137) dirty exists 2024-03-30T12:35:06.618 INFO:tasks.rados.rados.0.smithi084.stdout:3687: left oid 14 (ObjNum 1137 snap 372 seq_num 1137) 2024-03-30T12:35:06.618 INFO:tasks.rados.rados.0.smithi084.stdout:3690: finishing write tid 1 to smithi08477944-30 2024-03-30T12:35:06.618 INFO:tasks.rados.rados.0.smithi084.stdout:3690: finishing write tid 2 to smithi08477944-30 2024-03-30T12:35:06.618 INFO:tasks.rados.rados.0.smithi084.stdout:3690: finishing write tid 3 to smithi08477944-30 2024-03-30T12:35:06.618 INFO:tasks.rados.rados.0.smithi084.stdout:3685: done (5 left) 2024-03-30T12:35:06.618 INFO:tasks.rados.rados.0.smithi084.stdout:3686: done (4 left) 2024-03-30T12:35:06.618 INFO:tasks.rados.rados.0.smithi084.stdout:3687: done (3 left) 2024-03-30T12:35:06.618 INFO:tasks.rados.rados.0.smithi084.stdout:3693: snap_create 2024-03-30T12:35:06.619 INFO:tasks.rados.rados.0.smithi084.stdout:3690: finishing write tid 4 to smithi08477944-30 2024-03-30T12:35:06.619 INFO:tasks.rados.rados.0.smithi084.stdout:3691: expect (ObjNum 1023 snap 328 seq_num 1023) 2024-03-30T12:35:06.632 INFO:tasks.rados.rados.0.smithi084.stdout:3690: finishing write tid 5 to smithi08477944-30 2024-03-30T12:35:06.632 INFO:tasks.rados.rados.0.smithi084.stdout:3690: finishing write tid 6 to smithi08477944-30 2024-03-30T12:35:06.632 INFO:tasks.rados.rados.0.smithi084.stdout:3690: finishing write tid 7 to smithi08477944-30 2024-03-30T12:35:06.632 INFO:tasks.rados.rados.0.smithi084.stdout:3690: oid 30 updating version 0 to 27327 2024-03-30T12:35:06.633 INFO:tasks.rados.rados.0.smithi084.stdout:3690: oid 30 updating version 27327 to 27330 2024-03-30T12:35:06.633 INFO:tasks.rados.rados.0.smithi084.stdout:3690: oid 30 version 27330 is already newer than 27326 2024-03-30T12:35:06.633 INFO:tasks.rados.rados.0.smithi084.stdout:3690: oid 30 version 27330 is already newer than 27328 2024-03-30T12:35:06.633 INFO:tasks.rados.rados.0.smithi084.stdout:3690: oid 30 version 27330 is already newer than 27329 2024-03-30T12:35:06.633 INFO:tasks.rados.rados.0.smithi084.stdout:3690: oid 30 updating version 27330 to 27331 2024-03-30T12:35:06.633 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 30 v 27331 (ObjNum 1139 snap 372 seq_num 1139) dirty exists 2024-03-30T12:35:06.633 INFO:tasks.rados.rados.0.smithi084.stdout:3690: left oid 30 (ObjNum 1139 snap 372 seq_num 1139) 2024-03-30T12:35:06.633 INFO:tasks.rados.rados.0.smithi084.stdout:3692: finishing copy_from racing read to smithi08477944-37 2024-03-30T12:35:06.634 INFO:tasks.rados.rados.0.smithi084.stdout:3692: finishing copy_from to smithi08477944-37 2024-03-30T12:35:06.634 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 27312 (ObjNum 1105 snap 362 seq_num 1105) dirty exists 2024-03-30T12:35:06.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:06.627+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:06.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:06.588+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:06.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:06.588+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:06.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:06.630+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:06.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:06.632+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:06.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:06.639+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:06.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:06.639+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:06.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:06.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:06.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:06.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:06.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:06.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:06.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:06.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:06.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:06 smithi162 ceph-mon[83709]: osdmap e809: 8 total, 8 up, 8 in 2024-03-30T12:35:06.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:06.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:06 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:06.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:06.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:06.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:06 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:07.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:06.588+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:07.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:06.589+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:07.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:07.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:07.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:07.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:07.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:07.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:07.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:07.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:07.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[89279]: osdmap e809: 8 total, 8 up, 8 in 2024-03-30T12:35:07.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:07.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:07.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:07.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:07.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:06.587+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:07.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:06.588+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:07.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:06.589+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:07.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:06.589+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:07.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:06.590+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[91810]: osdmap e809: 8 total, 8 up, 8 in 2024-03-30T12:35:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:07.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:07.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:06 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:07.586 INFO:tasks.rados.rados.0.smithi084.stdout:3690: done (3 left) 2024-03-30T12:35:07.586 INFO:tasks.rados.rados.0.smithi084.stdout:3691: done (2 left) 2024-03-30T12:35:07.586 INFO:tasks.rados.rados.0.smithi084.stdout:3692: done (1 left) 2024-03-30T12:35:07.586 INFO:tasks.rados.rados.0.smithi084.stdout:3693: done (0 left) 2024-03-30T12:35:07.586 INFO:tasks.rados.rados.0.smithi084.stdout:3694: snap_create 2024-03-30T12:35:07.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:07.596+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:07.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:07.596+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:07.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:07.596+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:07.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:07.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:07.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:07.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:07 smithi162 ceph-mon[83709]: osdmap e810: 8 total, 8 up, 8 in 2024-03-30T12:35:07.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:07.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:07.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:07.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:07.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:07 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:07.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:07.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:07.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:07.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:07.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:07 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:07.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:07 smithi162 ceph-mon[83709]: pgmap v906: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 3 op/s 2024-03-30T12:35:08.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:07.593+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:08.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:07.593+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:08.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:07.593+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:08.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:07.593+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:08.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:07.593+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:08.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:07.593+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:08.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:08.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:08.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:08.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[91810]: osdmap e810: 8 total, 8 up, 8 in 2024-03-30T12:35:08.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:08.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:08.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:08.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:08.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:08.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:08.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:08.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:08.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:08.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:08.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:08.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:08.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[89279]: osdmap e810: 8 total, 8 up, 8 in 2024-03-30T12:35:08.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:08.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:08.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:08.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:08.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:08.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:08.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:08.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:08.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:08.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:08.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[91810]: pgmap v906: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 3 op/s 2024-03-30T12:35:08.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:08.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:07 smithi084 ceph-mon[89279]: pgmap v906: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.1 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 3 op/s 2024-03-30T12:35:08.585 INFO:tasks.rados.rados.0.smithi084.stdout:3694: done (0 left) 2024-03-30T12:35:08.586 INFO:tasks.rados.rados.0.smithi084.stdout:3695: read oid 21 snap 365 2024-03-30T12:35:08.586 INFO:tasks.rados.rados.0.smithi084.stdout:3695: expect (ObjNum 1097 snap 356 seq_num 1097) 2024-03-30T12:35:08.586 INFO:tasks.rados.rados.0.smithi084.stdout:3696: delete oid 50 current snap is 374 2024-03-30T12:35:08.591 INFO:tasks.rados.rados.0.smithi084.stdout:3696: done (1 left) 2024-03-30T12:35:08.591 INFO:tasks.rados.rados.0.smithi084.stdout:3697: copy_from oid 29 from oid 24 current snap is 374 2024-03-30T12:35:08.591 INFO:tasks.rados.rados.0.smithi084.stdout:3698: copy_from oid 14 from oid 8 current snap is 374 2024-03-30T12:35:08.591 INFO:tasks.rados.rados.0.smithi084.stdout:3699: read oid 36 snap 346 2024-03-30T12:35:08.591 INFO:tasks.rados.rados.0.smithi084.stdout:3699: expect (ObjNum 1057 snap 340 seq_num 1057) 2024-03-30T12:35:08.591 INFO:tasks.rados.rados.0.smithi084.stdout:3700: read oid 26 snap -1 2024-03-30T12:35:08.591 INFO:tasks.rados.rados.0.smithi084.stdout:3700: expect (ObjNum 1058 snap 340 seq_num 1058) 2024-03-30T12:35:08.591 INFO:tasks.rados.rados.0.smithi084.stdout:3701: snap_remove snap 361 2024-03-30T12:35:08.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:08.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:08.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:08 smithi084 ceph-mon[89279]: osdmap e811: 8 total, 8 up, 8 in 2024-03-30T12:35:08.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:08 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:08.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:08 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:08.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:08 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:08.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:08 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:08.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:08.431+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:08.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:08.431+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:08.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:08.604+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:08.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:08.605+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:08.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:08.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:08.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:08 smithi084 ceph-mon[91810]: osdmap e811: 8 total, 8 up, 8 in 2024-03-30T12:35:08.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:08 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:08.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:08 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:08.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:08 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:08.755 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:08 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:08.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:08.591+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:08.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:08.591+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:08.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:08.591+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:08.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:08.592+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:08.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:08 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:08.592+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:08.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:08.599+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:08.869 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:08.599+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:08.870 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:08.515+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:08.870 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:08.604+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:08.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:08.593+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:08.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:08.603+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:08.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:08.603+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:08.871 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:08.594+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:08.871 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:08.595+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:08.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:08.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:08.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:08 smithi162 ceph-mon[83709]: osdmap e811: 8 total, 8 up, 8 in 2024-03-30T12:35:08.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:08 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:08.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:08 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:08.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:08 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:08.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:08 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:09.592 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:35:09] "GET /metrics HTTP/1.1" 200 36329 "" "Prometheus/2.43.0" 2024-03-30T12:35:09.597 INFO:tasks.rados.rados.0.smithi084.stdout:3701: done (5 left) 2024-03-30T12:35:09.597 INFO:tasks.rados.rados.0.smithi084.stdout:3702: rollback oid 40 current snap is 374 2024-03-30T12:35:09.597 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 40 to 372 2024-03-30T12:35:09.597 INFO:tasks.rados.rados.0.smithi084.stdout:3698: finishing copy_from to smithi08477944-14 2024-03-30T12:35:09.597 INFO:tasks.rados.rados.0.smithi084.stdout:3698: got expected ENOENT (src dne) 2024-03-30T12:35:09.597 INFO:tasks.rados.rados.0.smithi084.stdout:3698: finishing copy_from racing read to smithi08477944-14 2024-03-30T12:35:09.597 INFO:tasks.rados.rados.0.smithi084.stdout:3695: expect (ObjNum 1097 snap 356 seq_num 1097) 2024-03-30T12:35:09.643 INFO:tasks.rados.rados.0.smithi084.stdout:3699: expect (ObjNum 1057 snap 340 seq_num 1057) 2024-03-30T12:35:09.706 INFO:tasks.rados.rados.0.smithi084.stdout:3700: expect (ObjNum 1058 snap 340 seq_num 1058) 2024-03-30T12:35:09.792 INFO:tasks.rados.rados.0.smithi084.stdout:3697: finishing copy_from racing read to smithi08477944-29 2024-03-30T12:35:09.792 INFO:tasks.rados.rados.0.smithi084.stdout:3697: finishing copy_from to smithi08477944-29 2024-03-30T12:35:09.792 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 23449 (ObjNum 1119 snap 366 seq_num 1119) dirty exists 2024-03-30T12:35:09.792 INFO:tasks.rados.rados.0.smithi084.stdout:3695: done (5 left) 2024-03-30T12:35:09.792 INFO:tasks.rados.rados.0.smithi084.stdout:3697: done (4 left) 2024-03-30T12:35:09.792 INFO:tasks.rados.rados.0.smithi084.stdout:3698: done (3 left) 2024-03-30T12:35:09.792 INFO:tasks.rados.rados.0.smithi084.stdout:3699: done (2 left) 2024-03-30T12:35:09.792 INFO:tasks.rados.rados.0.smithi084.stdout:3700: done (1 left) 2024-03-30T12:35:09.792 INFO:tasks.rados.rados.0.smithi084.stdout:3703: snap_remove snap 373 2024-03-30T12:35:09.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:09.754+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:09.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:09.607+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:09.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:09.607+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:09.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:09.606+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:09.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:09.606+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:09.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:09.754+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:09.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:09.754+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:09.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:09.755+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:09.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:09.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:09.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:09.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:09.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:09.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:09.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:09.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-mon[83709]: osdmap e812: 8 total, 8 up, 8 in 2024-03-30T12:35:09.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:09.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:09.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:09.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:09.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:09.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:09.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:09.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:09.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:09.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:09 smithi162 ceph-mon[83709]: pgmap v909: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 4.9 MiB/s rd, 7.1 MiB/s wr, 24 op/s 2024-03-30T12:35:10.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:09.611+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:10.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:09.611+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:10.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:09.602+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:10.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:09.603+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:10.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:09.603+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:10.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:09.603+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:10.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:09.603+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:10.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:09.603+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:10.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:10.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:10.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:10.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:10.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:10.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:10.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:10.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[91810]: osdmap e812: 8 total, 8 up, 8 in 2024-03-30T12:35:10.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:10.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:10.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:10.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:10.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:10.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:10.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:10.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:10.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:10.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[91810]: pgmap v909: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 4.9 MiB/s rd, 7.1 MiB/s wr, 24 op/s 2024-03-30T12:35:10.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:10.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:10.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:10.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:10.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:10.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:10.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:10.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[89279]: osdmap e812: 8 total, 8 up, 8 in 2024-03-30T12:35:10.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:10.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:10.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:10.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:10.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:10.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:10.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:10.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:10.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:10.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:09 smithi084 ceph-mon[89279]: pgmap v909: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 4.9 MiB/s rd, 7.1 MiB/s wr, 24 op/s 2024-03-30T12:35:10.601 INFO:tasks.rados.rados.0.smithi084.stdout:3703: done (1 left) 2024-03-30T12:35:10.601 INFO:tasks.rados.rados.0.smithi084.stdout:3704: copy_from oid 18 from oid 2 current snap is 374 2024-03-30T12:35:10.601 INFO:tasks.rados.rados.0.smithi084.stdout:3702: finishing rollback tid 0 to smithi08477944-40 2024-03-30T12:35:10.601 INFO:tasks.rados.rados.0.smithi084.stdout:3702: finishing rollback tid 1 to smithi08477944-40 2024-03-30T12:35:10.601 INFO:tasks.rados.rados.0.smithi084.stdout:3702: finishing rollback tid 2 to smithi08477944-40 2024-03-30T12:35:10.602 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 36328 (ObjNum 1116 snap 365 seq_num 1116) dirty exists 2024-03-30T12:35:10.602 INFO:tasks.rados.rados.0.smithi084.stdout:3702: done (1 left) 2024-03-30T12:35:10.602 INFO:tasks.rados.rados.0.smithi084.stdout:3705: read oid 13 snap 340 2024-03-30T12:35:10.602 INFO:tasks.rados.rados.0.smithi084.stdout:3705: expect (ObjNum 1014 snap 327 seq_num 1014) 2024-03-30T12:35:10.602 INFO:tasks.rados.rados.0.smithi084.stdout:3706: copy_from oid 4 from oid 49 current snap is 374 2024-03-30T12:35:10.602 INFO:tasks.rados.rados.0.smithi084.stdout:3707: read oid 23 snap -1 2024-03-30T12:35:10.602 INFO:tasks.rados.rados.0.smithi084.stdout:3707: expect deleted 2024-03-30T12:35:10.602 INFO:tasks.rados.rados.0.smithi084.stdout:3708: read oid 8 snap -1 2024-03-30T12:35:10.602 INFO:tasks.rados.rados.0.smithi084.stdout:3708: expect deleted 2024-03-30T12:35:10.602 INFO:tasks.rados.rados.0.smithi084.stdout:3709: setattr oid 20 current snap is 374 2024-03-30T12:35:10.602 INFO:tasks.rados.rados.0.smithi084.stdout:3710: read oid 38 snap -1 2024-03-30T12:35:10.602 INFO:tasks.rados.rados.0.smithi084.stdout:3710: expect deleted 2024-03-30T12:35:10.602 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 374 2024-03-30T12:35:10.602 INFO:tasks.rados.rados.0.smithi084.stdout:3711: seq_num 1141 ranges {4071424=712704,4784128=679936,5464064=540672,6004736=385024} 2024-03-30T12:35:10.628 INFO:tasks.rados.rados.0.smithi084.stdout:3711: writing smithi08477944-14 from 4071424 to 4784128 tid 1 2024-03-30T12:35:10.632 INFO:tasks.rados.rados.0.smithi084.stdout:3711: writing smithi08477944-14 from 4784128 to 5464064 tid 2 2024-03-30T12:35:10.636 INFO:tasks.rados.rados.0.smithi084.stdout:3711: writing smithi08477944-14 from 5464064 to 6004736 tid 3 2024-03-30T12:35:10.642 INFO:tasks.rados.rados.0.smithi084.stdout:3711: writing smithi08477944-14 from 6004736 to 6389760 tid 4 2024-03-30T12:35:10.642 INFO:tasks.rados.rados.0.smithi084.stdout:3712: read oid 43 snap -1 2024-03-30T12:35:10.642 INFO:tasks.rados.rados.0.smithi084.stdout:3712: expect (ObjNum 1062 snap 344 seq_num 1062) 2024-03-30T12:35:10.643 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 36329 (ObjNum 1106 snap 362 seq_num 1106) dirty exists 2024-03-30T12:35:10.643 INFO:tasks.rados.rados.0.smithi084.stdout:3706: finishing copy_from racing read to smithi08477944-4 2024-03-30T12:35:10.643 INFO:tasks.rados.rados.0.smithi084.stdout:3706: finishing copy_from to smithi08477944-4 2024-03-30T12:35:10.643 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 36329 (ObjNum 1098 snap 357 seq_num 1098) dirty exists 2024-03-30T12:35:10.643 INFO:tasks.rados.rados.0.smithi084.stdout:3704: finishing copy_from racing read to smithi08477944-18 2024-03-30T12:35:10.643 INFO:tasks.rados.rados.0.smithi084.stdout:3704: finishing copy_from to smithi08477944-18 2024-03-30T12:35:10.643 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 36318 (ObjNum 1124 snap 366 seq_num 1124) dirty exists 2024-03-30T12:35:10.643 INFO:tasks.rados.rados.0.smithi084.stdout:3713: read oid 46 snap -1 2024-03-30T12:35:10.643 INFO:tasks.rados.rados.0.smithi084.stdout:3713: expect (ObjNum 1023 snap 328 seq_num 1023) 2024-03-30T12:35:10.643 INFO:tasks.rados.rados.0.smithi084.stdout:3704: done (9 left) 2024-03-30T12:35:10.643 INFO:tasks.rados.rados.0.smithi084.stdout:3706: done (8 left) 2024-03-30T12:35:10.643 INFO:tasks.rados.rados.0.smithi084.stdout:3707: done (7 left) 2024-03-30T12:35:10.644 INFO:tasks.rados.rados.0.smithi084.stdout:3708: done (6 left) 2024-03-30T12:35:10.644 INFO:tasks.rados.rados.0.smithi084.stdout:3709: done (5 left) 2024-03-30T12:35:10.644 INFO:tasks.rados.rados.0.smithi084.stdout:3710: done (4 left) 2024-03-30T12:35:10.644 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 5 current snap is 374 2024-03-30T12:35:10.644 INFO:tasks.rados.rados.0.smithi084.stdout:3714: seq_num 1142 ranges {0=729088,729088=565248,1294336=696320,1990656=344064} 2024-03-30T12:35:10.645 INFO:tasks.rados.rados.0.smithi084.stdout:3714: writing smithi08477944-5 from 0 to 729088 tid 1 2024-03-30T12:35:10.649 INFO:tasks.rados.rados.0.smithi084.stdout:3714: writing smithi08477944-5 from 729088 to 1294336 tid 2 2024-03-30T12:35:10.653 INFO:tasks.rados.rados.0.smithi084.stdout:3714: writing smithi08477944-5 from 1294336 to 1990656 tid 3 2024-03-30T12:35:10.655 INFO:tasks.rados.rados.0.smithi084.stdout:3714: writing smithi08477944-5 from 1990656 to 2334720 tid 4 2024-03-30T12:35:10.656 INFO:tasks.rados.rados.0.smithi084.stdout:3715: read oid 19 snap -1 2024-03-30T12:35:10.656 INFO:tasks.rados.rados.0.smithi084.stdout:3715: expect deleted 2024-03-30T12:35:10.656 INFO:tasks.rados.rados.0.smithi084.stdout:3716: delete oid 30 current snap is 374 2024-03-30T12:35:10.656 INFO:tasks.rados.rados.0.smithi084.stdout:3705: expect (ObjNum 1014 snap 327 seq_num 1014) 2024-03-30T12:35:10.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:10.648+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:10.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:10.607+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:10.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:10.607+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:10.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:10.607+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:10.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:10.632+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:10.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:10.632+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:10.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:10.619+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:10.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:10.620+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:10.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:10.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:10.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:10.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:10.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:10 smithi162 ceph-mon[83709]: osdmap e813: 8 total, 8 up, 8 in 2024-03-30T12:35:10.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:10.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:10.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:10.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:10.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:10.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:10 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:10.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:10.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:10.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:10 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:11.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:10.615+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:11.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:10.618+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:11.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:11.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:11.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:11.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:11.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[91810]: osdmap e813: 8 total, 8 up, 8 in 2024-03-30T12:35:11.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:11.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:11.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:11.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:11.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:11.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:11.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:11.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:11.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:11.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:11.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:11.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:11.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:11.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[89279]: osdmap e813: 8 total, 8 up, 8 in 2024-03-30T12:35:11.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:11.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:11.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:11.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:11.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:11.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:11.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:11.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:11.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:11.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:10.606+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:11.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:10.606+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:11.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:10.606+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:11.007 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:10.608+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:11.007 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:10.608+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:11.350 INFO:tasks.rados.rados.0.smithi084.stdout:3713: expect (ObjNum 1023 snap 328 seq_num 1023) 2024-03-30T12:35:11.362 INFO:tasks.rados.rados.0.smithi084.stdout:3711: finishing write tid 1 to smithi08477944-14 2024-03-30T12:35:11.363 INFO:tasks.rados.rados.0.smithi084.stdout:3714: finishing write tid 1 to smithi08477944-5 2024-03-30T12:35:11.363 INFO:tasks.rados.rados.0.smithi084.stdout:3714: finishing write tid 2 to smithi08477944-5 2024-03-30T12:35:11.363 INFO:tasks.rados.rados.0.smithi084.stdout:3712: expect (ObjNum 1062 snap 344 seq_num 1062) 2024-03-30T12:35:11.465 INFO:tasks.rados.rados.0.smithi084.stdout:3711: finishing write tid 2 to smithi08477944-14 2024-03-30T12:35:11.466 INFO:tasks.rados.rados.0.smithi084.stdout:3711: finishing write tid 3 to smithi08477944-14 2024-03-30T12:35:11.466 INFO:tasks.rados.rados.0.smithi084.stdout:3714: finishing write tid 3 to smithi08477944-5 2024-03-30T12:35:11.466 INFO:tasks.rados.rados.0.smithi084.stdout:3711: finishing write tid 4 to smithi08477944-14 2024-03-30T12:35:11.466 INFO:tasks.rados.rados.0.smithi084.stdout:3714: finishing write tid 4 to smithi08477944-5 2024-03-30T12:35:11.466 INFO:tasks.rados.rados.0.smithi084.stdout:3711: finishing write tid 5 to smithi08477944-14 2024-03-30T12:35:11.466 INFO:tasks.rados.rados.0.smithi084.stdout:3714: finishing write tid 5 to smithi08477944-5 2024-03-30T12:35:11.466 INFO:tasks.rados.rados.0.smithi084.stdout:3714: finishing write tid 6 to smithi08477944-5 2024-03-30T12:35:11.466 INFO:tasks.rados.rados.0.smithi084.stdout:3714: oid 5 updating version 0 to 27315 2024-03-30T12:35:11.466 INFO:tasks.rados.rados.0.smithi084.stdout:3714: oid 5 updating version 27315 to 27317 2024-03-30T12:35:11.466 INFO:tasks.rados.rados.0.smithi084.stdout:3714: oid 5 version 27317 is already newer than 27316 2024-03-30T12:35:11.466 INFO:tasks.rados.rados.0.smithi084.stdout:3714: oid 5 version 27317 is already newer than 27314 2024-03-30T12:35:11.466 INFO:tasks.rados.rados.0.smithi084.stdout:3714: oid 5 version 27317 is already newer than 27313 2024-03-30T12:35:11.467 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 5 v 27317 (ObjNum 1142 snap 374 seq_num 1142) dirty exists 2024-03-30T12:35:11.467 INFO:tasks.rados.rados.0.smithi084.stdout:3714: left oid 5 (ObjNum 1142 snap 374 seq_num 1142) 2024-03-30T12:35:11.467 INFO:tasks.rados.rados.0.smithi084.stdout:3711: finishing write tid 6 to smithi08477944-14 2024-03-30T12:35:11.467 INFO:tasks.rados.rados.0.smithi084.stdout:3711: oid 14 updating version 0 to 36326 2024-03-30T12:35:11.467 INFO:tasks.rados.rados.0.smithi084.stdout:3711: oid 14 updating version 36326 to 36329 2024-03-30T12:35:11.467 INFO:tasks.rados.rados.0.smithi084.stdout:3711: oid 14 version 36329 is already newer than 36328 2024-03-30T12:35:11.467 INFO:tasks.rados.rados.0.smithi084.stdout:3711: oid 14 updating version 36329 to 36330 2024-03-30T12:35:11.467 INFO:tasks.rados.rados.0.smithi084.stdout:3711: oid 14 version 36330 is already newer than 36327 2024-03-30T12:35:11.467 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 36330 (ObjNum 1141 snap 374 seq_num 1141) dirty exists 2024-03-30T12:35:11.467 INFO:tasks.rados.rados.0.smithi084.stdout:3711: left oid 14 (ObjNum 1141 snap 374 seq_num 1141) 2024-03-30T12:35:11.467 INFO:tasks.rados.rados.0.smithi084.stdout:3705: done (6 left) 2024-03-30T12:35:11.467 INFO:tasks.rados.rados.0.smithi084.stdout:3711: done (5 left) 2024-03-30T12:35:11.467 INFO:tasks.rados.rados.0.smithi084.stdout:3712: done (4 left) 2024-03-30T12:35:11.467 INFO:tasks.rados.rados.0.smithi084.stdout:3713: done (3 left) 2024-03-30T12:35:11.467 INFO:tasks.rados.rados.0.smithi084.stdout:3714: done (2 left) 2024-03-30T12:35:11.468 INFO:tasks.rados.rados.0.smithi084.stdout:3715: done (1 left) 2024-03-30T12:35:11.468 INFO:tasks.rados.rados.0.smithi084.stdout:3716: done (0 left) 2024-03-30T12:35:11.468 INFO:tasks.rados.rados.0.smithi084.stdout:3717: delete oid 28 current snap is 374 2024-03-30T12:35:11.468 INFO:tasks.rados.rados.0.smithi084.stdout:3717: done (0 left) 2024-03-30T12:35:11.469 INFO:tasks.rados.rados.0.smithi084.stdout:3718: copy_from oid 4 from oid 34 current snap is 374 2024-03-30T12:35:11.469 INFO:tasks.rados.rados.0.smithi084.stdout:3719: rollback oid 35 current snap is 374 2024-03-30T12:35:11.469 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 35 to 369 2024-03-30T12:35:11.469 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 43 current snap is 374 2024-03-30T12:35:11.469 INFO:tasks.rados.rados.0.smithi084.stdout:3720: seq_num 1145 ranges {2424832=786432,3211264=622592,3833856=516096,4349952=417792,4767744=49152} 2024-03-30T12:35:11.485 INFO:tasks.rados.rados.0.smithi084.stdout:3720: writing smithi08477944-43 from 2424832 to 3211264 tid 1 2024-03-30T12:35:11.489 INFO:tasks.rados.rados.0.smithi084.stdout:3720: writing smithi08477944-43 from 3211264 to 3833856 tid 2 2024-03-30T12:35:11.492 INFO:tasks.rados.rados.0.smithi084.stdout:3720: writing smithi08477944-43 from 3833856 to 4349952 tid 3 2024-03-30T12:35:11.494 INFO:tasks.rados.rados.0.smithi084.stdout:3720: writing smithi08477944-43 from 4349952 to 4767744 tid 4 2024-03-30T12:35:11.495 INFO:tasks.rados.rados.0.smithi084.stdout:3720: writing smithi08477944-43 from 4767744 to 4816896 tid 5 2024-03-30T12:35:11.495 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 374 2024-03-30T12:35:11.495 INFO:tasks.rados.rados.0.smithi084.stdout:3718: finishing copy_from racing read to smithi08477944-4 2024-03-30T12:35:11.495 INFO:tasks.rados.rados.0.smithi084.stdout:3721: seq_num 1146 ranges {3506176=802816,4308992=499712,4808704=679936,5488640=425984} 2024-03-30T12:35:11.518 INFO:tasks.rados.rados.0.smithi084.stdout:3721: writing smithi08477944-40 from 3506176 to 4308992 tid 1 2024-03-30T12:35:11.521 INFO:tasks.rados.rados.0.smithi084.stdout:3721: writing smithi08477944-40 from 4308992 to 4808704 tid 2 2024-03-30T12:35:11.525 INFO:tasks.rados.rados.0.smithi084.stdout:3721: writing smithi08477944-40 from 4808704 to 5488640 tid 3 2024-03-30T12:35:11.529 INFO:tasks.rados.rados.0.smithi084.stdout:3721: writing smithi08477944-40 from 5488640 to 5914624 tid 4 2024-03-30T12:35:11.529 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 374 2024-03-30T12:35:11.529 INFO:tasks.rados.rados.0.smithi084.stdout:3719: finishing rollback tid 0 to smithi08477944-35 2024-03-30T12:35:11.529 INFO:tasks.rados.rados.0.smithi084.stdout:3718: finishing copy_from to smithi08477944-4 2024-03-30T12:35:11.529 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 36294 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:35:11.529 INFO:tasks.rados.rados.0.smithi084.stdout:3719: finishing rollback tid 1 to smithi08477944-35 2024-03-30T12:35:11.529 INFO:tasks.rados.rados.0.smithi084.stdout:3719: finishing rollback tid 2 to smithi08477944-35 2024-03-30T12:35:11.529 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 36321 (ObjNum 1109 snap 364 seq_num 1109) dirty exists 2024-03-30T12:35:11.529 INFO:tasks.rados.rados.0.smithi084.stdout:3722: seq_num 1147 ranges {0=16384} 2024-03-30T12:35:11.529 INFO:tasks.rados.rados.0.smithi084.stdout:3722: writing smithi08477944-23 from 0 to 16384 tid 1 2024-03-30T12:35:11.529 INFO:tasks.rados.rados.0.smithi084.stdout:3718: done (4 left) 2024-03-30T12:35:11.530 INFO:tasks.rados.rados.0.smithi084.stdout:3719: done (3 left) 2024-03-30T12:35:11.530 INFO:tasks.rados.rados.0.smithi084.stdout:3723: copy_from oid 41 from oid 7 current snap is 374 2024-03-30T12:35:11.530 INFO:tasks.rados.rados.0.smithi084.stdout:3724: snap_create 2024-03-30T12:35:11.530 INFO:tasks.rados.rados.0.smithi084.stdout:3720: finishing write tid 1 to smithi08477944-43 2024-03-30T12:35:11.530 INFO:tasks.rados.rados.0.smithi084.stdout:3720: finishing write tid 2 to smithi08477944-43 2024-03-30T12:35:11.530 INFO:tasks.rados.rados.0.smithi084.stdout:3720: finishing write tid 3 to smithi08477944-43 2024-03-30T12:35:11.530 INFO:tasks.rados.rados.0.smithi084.stdout:3720: finishing write tid 4 to smithi08477944-43 2024-03-30T12:35:11.530 INFO:tasks.rados.rados.0.smithi084.stdout:3720: finishing write tid 5 to smithi08477944-43 2024-03-30T12:35:11.530 INFO:tasks.rados.rados.0.smithi084.stdout:3720: finishing write tid 6 to smithi08477944-43 2024-03-30T12:35:11.530 INFO:tasks.rados.rados.0.smithi084.stdout:3720: finishing write tid 7 to smithi08477944-43 2024-03-30T12:35:11.530 INFO:tasks.rados.rados.0.smithi084.stdout:3720: oid 43 updating version 0 to 36398 2024-03-30T12:35:11.530 INFO:tasks.rados.rados.0.smithi084.stdout:3720: oid 43 version 36398 is already newer than 36396 2024-03-30T12:35:11.530 INFO:tasks.rados.rados.0.smithi084.stdout:3720: oid 43 updating version 36398 to 36400 2024-03-30T12:35:11.530 INFO:tasks.rados.rados.0.smithi084.stdout:3720: oid 43 version 36400 is already newer than 36399 2024-03-30T12:35:11.530 INFO:tasks.rados.rados.0.smithi084.stdout:3720: oid 43 version 36400 is already newer than 36397 2024-03-30T12:35:11.531 INFO:tasks.rados.rados.0.smithi084.stdout:3720: oid 43 version 36400 is already newer than 36395 2024-03-30T12:35:11.531 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 36400 (ObjNum 1145 snap 374 seq_num 1145) dirty exists 2024-03-30T12:35:11.531 INFO:tasks.rados.rados.0.smithi084.stdout:3720: left oid 43 (ObjNum 1145 snap 374 seq_num 1145) 2024-03-30T12:35:11.531 INFO:tasks.rados.rados.0.smithi084.stdout:3721: finishing write tid 1 to smithi08477944-40 2024-03-30T12:35:11.531 INFO:tasks.rados.rados.0.smithi084.stdout:3721: finishing write tid 2 to smithi08477944-40 2024-03-30T12:35:11.531 INFO:tasks.rados.rados.0.smithi084.stdout:3721: finishing write tid 3 to smithi08477944-40 2024-03-30T12:35:11.531 INFO:tasks.rados.rados.0.smithi084.stdout:3722: finishing write tid 1 to smithi08477944-23 2024-03-30T12:35:11.531 INFO:tasks.rados.rados.0.smithi084.stdout:3722: finishing write tid 2 to smithi08477944-23 2024-03-30T12:35:11.532 INFO:tasks.rados.rados.0.smithi084.stdout:3721: finishing write tid 4 to smithi08477944-40 2024-03-30T12:35:11.533 INFO:tasks.rados.rados.0.smithi084.stdout:3722: finishing write tid 3 to smithi08477944-23 2024-03-30T12:35:11.533 INFO:tasks.rados.rados.0.smithi084.stdout:3722: oid 23 updating version 0 to 36331 2024-03-30T12:35:11.533 INFO:tasks.rados.rados.0.smithi084.stdout:3722: oid 23 updating version 36331 to 36332 2024-03-30T12:35:11.533 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 36332 (ObjNum 1147 snap 374 seq_num 1147) dirty exists 2024-03-30T12:35:11.534 INFO:tasks.rados.rados.0.smithi084.stdout:3722: left oid 23 (ObjNum 1147 snap 374 seq_num 1147) 2024-03-30T12:35:11.534 INFO:tasks.rados.rados.0.smithi084.stdout:3721: finishing write tid 5 to smithi08477944-40 2024-03-30T12:35:11.537 INFO:tasks.rados.rados.0.smithi084.stdout:3721: finishing write tid 6 to smithi08477944-40 2024-03-30T12:35:11.537 INFO:tasks.rados.rados.0.smithi084.stdout:3721: oid 40 updating version 0 to 36330 2024-03-30T12:35:11.537 INFO:tasks.rados.rados.0.smithi084.stdout:3721: oid 40 updating version 36330 to 36334 2024-03-30T12:35:11.538 INFO:tasks.rados.rados.0.smithi084.stdout:3721: oid 40 version 36334 is already newer than 36331 2024-03-30T12:35:11.538 INFO:tasks.rados.rados.0.smithi084.stdout:3721: oid 40 version 36334 is already newer than 36332 2024-03-30T12:35:11.538 INFO:tasks.rados.rados.0.smithi084.stdout:3721: oid 40 version 36334 is already newer than 36333 2024-03-30T12:35:11.538 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 36334 (ObjNum 1146 snap 374 seq_num 1146) dirty exists 2024-03-30T12:35:11.538 INFO:tasks.rados.rados.0.smithi084.stdout:3721: left oid 40 (ObjNum 1146 snap 374 seq_num 1146) 2024-03-30T12:35:11.544 INFO:tasks.rados.rados.0.smithi084.stdout:3723: finishing copy_from racing read to smithi08477944-41 2024-03-30T12:35:11.551 INFO:tasks.rados.rados.0.smithi084.stdout:3723: finishing copy_from to smithi08477944-41 2024-03-30T12:35:11.551 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 36320 (ObjNum 1129 snap 371 seq_num 1129) dirty exists 2024-03-30T12:35:11.614 INFO:tasks.rados.rados.0.smithi084.stdout:3720: done (4 left) 2024-03-30T12:35:11.614 INFO:tasks.rados.rados.0.smithi084.stdout:3721: done (3 left) 2024-03-30T12:35:11.614 INFO:tasks.rados.rados.0.smithi084.stdout:3722: done (2 left) 2024-03-30T12:35:11.614 INFO:tasks.rados.rados.0.smithi084.stdout:3723: done (1 left) 2024-03-30T12:35:11.614 INFO:tasks.rados.rados.0.smithi084.stdout:3724: done (0 left) 2024-03-30T12:35:11.614 INFO:tasks.rados.rados.0.smithi084.stdout:3725: rollback oid 41 current snap is 375 2024-03-30T12:35:11.614 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 41 to 353 2024-03-30T12:35:11.614 INFO:tasks.rados.rados.0.smithi084.stdout:3726: rollback oid 49 current snap is 375 2024-03-30T12:35:11.614 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 49 to 346 2024-03-30T12:35:11.615 INFO:tasks.rados.rados.0.smithi084.stdout:3727: rmattr oid 32 current snap is 375 2024-03-30T12:35:11.615 INFO:tasks.rados.rados.0.smithi084.stdout:3728: setattr oid 8 current snap is 375 2024-03-30T12:35:11.615 INFO:tasks.rados.rados.0.smithi084.stdout:3729: read oid 42 snap -1 2024-03-30T12:35:11.615 INFO:tasks.rados.rados.0.smithi084.stdout:3729: expect (ObjNum 1133 snap 372 seq_num 1133) 2024-03-30T12:35:11.615 INFO:tasks.rados.rados.0.smithi084.stdout:3730: snap_remove snap 366 2024-03-30T12:35:11.866 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:11.621+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:11.866 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:11.622+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:11.866 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:11.622+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:11.866 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:11.622+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:11.867 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:11.626+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:11.867 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:11.626+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:11.867 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:11.630+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:11.867 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:11 smithi162 ceph-mon[83709]: osdmap e814: 8 total, 8 up, 8 in 2024-03-30T12:35:11.867 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:11.867 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:11.868 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:11.868 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:11.868 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:11.868 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:11.868 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:11.868 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:11 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:11.868 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:11.868 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:11.868 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:11.868 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:11.868 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:11 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:11.868 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:11 smithi162 ceph-mon[83709]: pgmap v912: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 5.2 MiB/s rd, 6.9 MiB/s wr, 24 op/s 2024-03-30T12:35:12.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:11.632+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:12.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:11.633+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:12.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:11.620+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:12.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:11.620+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:12.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:11.620+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:12.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:11.620+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:12.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:11.621+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:12.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:11.621+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:12.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[89279]: osdmap e814: 8 total, 8 up, 8 in 2024-03-30T12:35:12.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:12.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:12.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:12.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:12.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:12.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:12.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:12.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:12.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:12.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:12.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:12.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[91810]: osdmap e814: 8 total, 8 up, 8 in 2024-03-30T12:35:12.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:12.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:12.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:12.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:12.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:12.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:12.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:12.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:12.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:12.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:12.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:12.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:12.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:12.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[89279]: pgmap v912: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 5.2 MiB/s rd, 6.9 MiB/s wr, 24 op/s 2024-03-30T12:35:12.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1a2=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:12.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:12.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:11 smithi084 ceph-mon[91810]: pgmap v912: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 5.2 MiB/s rd, 6.9 MiB/s wr, 24 op/s 2024-03-30T12:35:12.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:11.874+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:12.620 INFO:tasks.rados.rados.0.smithi084.stdout:3730: done (5 left) 2024-03-30T12:35:12.620 INFO:tasks.rados.rados.0.smithi084.stdout:3731: snap_remove snap 374 2024-03-30T12:35:12.869 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:12.628+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:12.869 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:12.628+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:12.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:12.629+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:12.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:12.629+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:12.870 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:12.629+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:12.870 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:12.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:12.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:12.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:12.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:12.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:12.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:12.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:12 smithi162 ceph-mon[83709]: osdmap e815: 8 total, 8 up, 8 in 2024-03-30T12:35:12.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:12.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:12.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:12.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:12.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:12.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:12.872 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:12.631+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:12.872 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:12.632+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:13.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:12.634+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:13.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:12.634+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:13.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:12.627+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:13.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:12.627+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:13.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:12.627+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:13.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:12.627+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:13.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:12.627+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:13.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:13.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:13.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:13.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:13.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:13.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:13.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:13.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[89279]: osdmap e815: 8 total, 8 up, 8 in 2024-03-30T12:35:13.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:13.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:13.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:13.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:13.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:13.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:13.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:13.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:13.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:13.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:13.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:13.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[91810]: osdmap e815: 8 total, 8 up, 8 in 2024-03-30T12:35:13.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:13.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:13.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:13.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:13.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:13.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:13.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:13.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:13.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:13.311+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:13.626 INFO:tasks.rados.rados.0.smithi084.stdout:3731: done (5 left) 2024-03-30T12:35:13.626 INFO:tasks.rados.rados.0.smithi084.stdout:3732: delete oid 6 current snap is 375 2024-03-30T12:35:13.626 INFO:tasks.rados.rados.0.smithi084.stdout:3725: finishing rollback tid 0 to smithi08477944-41 2024-03-30T12:35:13.626 INFO:tasks.rados.rados.0.smithi084.stdout:3725: finishing rollback tid 1 to smithi08477944-41 2024-03-30T12:35:13.626 INFO:tasks.rados.rados.0.smithi084.stdout:3725: finishing rollback tid 2 to smithi08477944-41 2024-03-30T12:35:13.626 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 36335 (ObjNum 1052 snap 337 seq_num 1052) dirty exists 2024-03-30T12:35:13.626 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 8 v 36324 (ObjNum 33 snap 0 seq_num 1430140592) dirty exists 2024-03-30T12:35:13.627 INFO:tasks.rados.rados.0.smithi084.stdout:3726: finishing rollback tid 0 to smithi08477944-49 2024-03-30T12:35:13.627 INFO:tasks.rados.rados.0.smithi084.stdout:3726: finishing rollback tid 1 to smithi08477944-49 2024-03-30T12:35:13.627 INFO:tasks.rados.rados.0.smithi084.stdout:3726: finishing rollback tid 2 to smithi08477944-49 2024-03-30T12:35:13.627 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 36335 (ObjNum 1021 snap 328 seq_num 1021) dirty exists 2024-03-30T12:35:13.627 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 36336 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-03-30T12:35:13.627 INFO:tasks.rados.rados.0.smithi084.stdout:3729: expect (ObjNum 1133 snap 372 seq_num 1133) 2024-03-30T12:35:13.682 INFO:tasks.rados.rados.0.smithi084.stdout:3725: done (5 left) 2024-03-30T12:35:13.682 INFO:tasks.rados.rados.0.smithi084.stdout:3726: done (4 left) 2024-03-30T12:35:13.682 INFO:tasks.rados.rados.0.smithi084.stdout:3727: done (3 left) 2024-03-30T12:35:13.682 INFO:tasks.rados.rados.0.smithi084.stdout:3728: done (2 left) 2024-03-30T12:35:13.682 INFO:tasks.rados.rados.0.smithi084.stdout:3729: done (1 left) 2024-03-30T12:35:13.683 INFO:tasks.rados.rados.0.smithi084.stdout:3732: done (0 left) 2024-03-30T12:35:13.683 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 375 2024-03-30T12:35:13.683 INFO:tasks.rados.rados.0.smithi084.stdout:3733: seq_num 1149 ranges {0=49152} 2024-03-30T12:35:13.683 INFO:tasks.rados.rados.0.smithi084.stdout:3733: writing smithi08477944-19 from 0 to 49152 tid 1 2024-03-30T12:35:13.683 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 375 2024-03-30T12:35:13.683 INFO:tasks.rados.rados.0.smithi084.stdout:3734: seq_num 1150 ranges {1581056=65536} 2024-03-30T12:35:13.692 INFO:tasks.rados.rados.0.smithi084.stdout:3734: writing smithi08477944-21 from 1581056 to 1646592 tid 1 2024-03-30T12:35:13.692 INFO:tasks.rados.rados.0.smithi084.stdout:3735: rollback oid 31 current snap is 375 2024-03-30T12:35:13.692 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 31 to 368 2024-03-30T12:35:13.692 INFO:tasks.rados.rados.0.smithi084.stdout:3733: finishing write tid 1 to smithi08477944-19 2024-03-30T12:35:13.692 INFO:tasks.rados.rados.0.smithi084.stdout:3733: finishing write tid 2 to smithi08477944-19 2024-03-30T12:35:13.692 INFO:tasks.rados.rados.0.smithi084.stdout:3736: rmattr oid 1 current snap is 375 2024-03-30T12:35:13.692 INFO:tasks.rados.rados.0.smithi084.stdout:3737: read oid 13 snap -1 2024-03-30T12:35:13.692 INFO:tasks.rados.rados.0.smithi084.stdout:3737: expect (ObjNum 1080 snap 350 seq_num 1080) 2024-03-30T12:35:13.692 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 15 current snap is 375 2024-03-30T12:35:13.692 INFO:tasks.rados.rados.0.smithi084.stdout:3738: seq_num 1151 ranges {3506176=81920} 2024-03-30T12:35:13.712 INFO:tasks.rados.rados.0.smithi084.stdout:3738: writing smithi08477944-15 from 3506176 to 3588096 tid 1 2024-03-30T12:35:13.712 INFO:tasks.rados.rados.0.smithi084.stdout:3739: snap_remove snap 365 2024-03-30T12:35:14.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:13.708+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:14.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:13.708+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:14.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:13.707+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:14.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:13.707+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:14.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:13.708+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:14.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:13.709+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:14.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:13.710+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:14.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:13.710+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:14.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:14.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[91810]: osdmap e816: 8 total, 8 up, 8 in 2024-03-30T12:35:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:14.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[91810]: pgmap v915: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 6.1 MiB/s rd, 1.6 MiB/s wr, 9 op/s 2024-03-30T12:35:14.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:14.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:14.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:14.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:14.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[89279]: osdmap e816: 8 total, 8 up, 8 in 2024-03-30T12:35:14.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:14.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:14.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:14.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:14.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:14.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:14.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:14.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:14.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:13 smithi084 ceph-mon[89279]: pgmap v915: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 6.1 MiB/s rd, 1.6 MiB/s wr, 9 op/s 2024-03-30T12:35:14.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:13.724+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:14.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:13.634+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:14.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:13.634+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:14.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:13.635+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:14.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:13.635+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:14.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:13.715+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:14.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:13.715+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:14.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:13.716+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:13 smithi162 ceph-mon[83709]: osdmap e816: 8 total, 8 up, 8 in 2024-03-30T12:35:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:14.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:14.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:14.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:14.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:14.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:14.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:13 smithi162 ceph-mon[83709]: pgmap v915: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 6.1 MiB/s rd, 1.6 MiB/s wr, 9 op/s 2024-03-30T12:35:14.636 INFO:tasks.rados.rados.0.smithi084.stdout:3739: done (6 left) 2024-03-30T12:35:14.636 INFO:tasks.rados.rados.0.smithi084.stdout:3740: read oid 40 snap -1 2024-03-30T12:35:14.636 INFO:tasks.rados.rados.0.smithi084.stdout:3740: expect (ObjNum 1146 snap 374 seq_num 1146) 2024-03-30T12:35:14.636 INFO:tasks.rados.rados.0.smithi084.stdout:3741: snap_create 2024-03-30T12:35:14.636 INFO:tasks.rados.rados.0.smithi084.stdout:3733: finishing write tid 3 to smithi08477944-19 2024-03-30T12:35:14.636 INFO:tasks.rados.rados.0.smithi084.stdout:3733: oid 19 updating version 0 to 36404 2024-03-30T12:35:14.636 INFO:tasks.rados.rados.0.smithi084.stdout:3733: oid 19 version 36404 is already newer than 36403 2024-03-30T12:35:14.637 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 36404 (ObjNum 1149 snap 375 seq_num 1149) dirty exists 2024-03-30T12:35:14.637 INFO:tasks.rados.rados.0.smithi084.stdout:3733: left oid 19 (ObjNum 1149 snap 375 seq_num 1149) 2024-03-30T12:35:14.637 INFO:tasks.rados.rados.0.smithi084.stdout:3735: finishing rollback tid 0 to smithi08477944-31 2024-03-30T12:35:14.637 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 36322 (ObjNum 1104 snap 361 seq_num 1104) dirty exists 2024-03-30T12:35:14.637 INFO:tasks.rados.rados.0.smithi084.stdout:3735: finishing rollback tid 1 to smithi08477944-31 2024-03-30T12:35:14.637 INFO:tasks.rados.rados.0.smithi084.stdout:3735: finishing rollback tid 2 to smithi08477944-31 2024-03-30T12:35:14.637 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 36340 (ObjNum 1007 snap 325 seq_num 1007) dirty exists 2024-03-30T12:35:14.637 INFO:tasks.rados.rados.0.smithi084.stdout:3734: finishing write tid 1 to smithi08477944-21 2024-03-30T12:35:14.637 INFO:tasks.rados.rados.0.smithi084.stdout:3734: finishing write tid 2 to smithi08477944-21 2024-03-30T12:35:14.637 INFO:tasks.rados.rados.0.smithi084.stdout:3734: finishing write tid 3 to smithi08477944-21 2024-03-30T12:35:14.637 INFO:tasks.rados.rados.0.smithi084.stdout:3734: oid 21 updating version 0 to 36303 2024-03-30T12:35:14.637 INFO:tasks.rados.rados.0.smithi084.stdout:3734: oid 21 version 36303 is already newer than 36302 2024-03-30T12:35:14.637 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 36303 (ObjNum 1150 snap 375 seq_num 1150) dirty exists 2024-03-30T12:35:14.637 INFO:tasks.rados.rados.0.smithi084.stdout:3734: left oid 21 (ObjNum 1150 snap 375 seq_num 1150) 2024-03-30T12:35:14.637 INFO:tasks.rados.rados.0.smithi084.stdout:3738: finishing write tid 1 to smithi08477944-15 2024-03-30T12:35:14.638 INFO:tasks.rados.rados.0.smithi084.stdout:3738: finishing write tid 2 to smithi08477944-15 2024-03-30T12:35:14.638 INFO:tasks.rados.rados.0.smithi084.stdout:3738: finishing write tid 3 to smithi08477944-15 2024-03-30T12:35:14.638 INFO:tasks.rados.rados.0.smithi084.stdout:3738: oid 15 updating version 0 to 27421 2024-03-30T12:35:14.638 INFO:tasks.rados.rados.0.smithi084.stdout:3738: oid 15 version 27421 is already newer than 27420 2024-03-30T12:35:14.638 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 27421 (ObjNum 1151 snap 375 seq_num 1151) dirty exists 2024-03-30T12:35:14.638 INFO:tasks.rados.rados.0.smithi084.stdout:3738: left oid 15 (ObjNum 1151 snap 375 seq_num 1151) 2024-03-30T12:35:14.638 INFO:tasks.rados.rados.0.smithi084.stdout:3737: expect (ObjNum 1080 snap 350 seq_num 1080) 2024-03-30T12:35:15.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:14.652+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:15.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:14.653+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:15.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:14.645+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:15.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:14.645+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:15.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:14.645+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:15.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:14.646+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:15.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:14.646+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:15.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:15.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:15.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:15.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[91810]: osdmap e817: 8 total, 8 up, 8 in 2024-03-30T12:35:15.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:15.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:15.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:15.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:15.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:15.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:15.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:15.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:15.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:15.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:15.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:15.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:15.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[89279]: osdmap e817: 8 total, 8 up, 8 in 2024-03-30T12:35:15.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:15.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:15.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:15.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:15.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:15.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:15.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:15.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:15.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:15.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:15.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:15.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:15.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:15.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:14.646+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:15.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:14.648+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:15.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:14.648+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:15.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:14.648+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:15.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:14.734+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:15.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:14.735+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:15.121 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:14.733+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:15.121 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:14.734+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:15.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:15.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b2=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:15.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ac=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:15.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:14 smithi162 ceph-mon[83709]: osdmap e817: 8 total, 8 up, 8 in 2024-03-30T12:35:15.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:15.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:15.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:15.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:15.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:15.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:15.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:15.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:15.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:15.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:15.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:15.501 INFO:tasks.rados.rados.0.smithi084.stdout:3740: expect (ObjNum 1146 snap 374 seq_num 1146) 2024-03-30T12:35:15.734 INFO:tasks.rados.rados.0.smithi084.stdout:3733: done (7 left) 2024-03-30T12:35:15.734 INFO:tasks.rados.rados.0.smithi084.stdout:3734: done (6 left) 2024-03-30T12:35:15.734 INFO:tasks.rados.rados.0.smithi084.stdout:3735: done (5 left) 2024-03-30T12:35:15.734 INFO:tasks.rados.rados.0.smithi084.stdout:3736: done (4 left) 2024-03-30T12:35:15.734 INFO:tasks.rados.rados.0.smithi084.stdout:3737: done (3 left) 2024-03-30T12:35:15.734 INFO:tasks.rados.rados.0.smithi084.stdout:3738: done (2 left) 2024-03-30T12:35:15.734 INFO:tasks.rados.rados.0.smithi084.stdout:3740: done (1 left) 2024-03-30T12:35:15.734 INFO:tasks.rados.rados.0.smithi084.stdout:3741: done (0 left) 2024-03-30T12:35:15.734 INFO:tasks.rados.rados.0.smithi084.stdout:3742: read oid 13 snap -1 2024-03-30T12:35:15.735 INFO:tasks.rados.rados.0.smithi084.stdout:3742: expect (ObjNum 1080 snap 350 seq_num 1080) 2024-03-30T12:35:15.735 INFO:tasks.rados.rados.0.smithi084.stdout:3743: rollback oid 27 current snap is 376 2024-03-30T12:35:15.735 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 27 to 369 2024-03-30T12:35:15.735 INFO:tasks.rados.rados.0.smithi084.stdout:3744: snap_remove snap 346 2024-03-30T12:35:16.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:15.645+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:16.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:15.645+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:16.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:15.645+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:16.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:15.645+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:16.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:15.646+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:16.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:15.646+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[91810]: osdmap e818: 8 total, 8 up, 8 in 2024-03-30T12:35:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:16.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:16.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:16.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:35:16.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:16.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:16.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[89279]: osdmap e818: 8 total, 8 up, 8 in 2024-03-30T12:35:16.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:16.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:16.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:16.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:16.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:16.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:16.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:16.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:16.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:16.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:35:16.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:16.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:16.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:16.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:16.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[89279]: pgmap v918: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 4.4 MiB/s rd, 5.7 MiB/s wr, 24 op/s 2024-03-30T12:35:16.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:16.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:16.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:15 smithi084 ceph-mon[91810]: pgmap v918: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 4.4 MiB/s rd, 5.7 MiB/s wr, 24 op/s 2024-03-30T12:35:16.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:15.750+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:16.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:15.747+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:16.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:15.747+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:16.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:15.647+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:16.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:15.647+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:16.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:15.650+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:16.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:15.650+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:16.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:15.651+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:16.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:15 smithi162 ceph-mon[83709]: osdmap e818: 8 total, 8 up, 8 in 2024-03-30T12:35:16.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:16.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:16.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:16.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:16.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:16.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:16.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:16.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:16.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:15 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:16.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:15 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:35:16.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:16.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:16.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:16.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:15 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:16.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:15 smithi162 ceph-mon[83709]: pgmap v918: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 4.4 MiB/s rd, 5.7 MiB/s wr, 24 op/s 2024-03-30T12:35:16.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:16.113+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:16.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:16.113+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:16.653 INFO:tasks.rados.rados.0.smithi084.stdout:3744: done (2 left) 2024-03-30T12:35:16.653 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 1 current snap is 376 2024-03-30T12:35:16.653 INFO:tasks.rados.rados.0.smithi084.stdout:3743: finishing rollback tid 1 to smithi08477944-27 2024-03-30T12:35:16.653 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 27 v 36299 (ObjNum 289 snap 0 seq_num 1) dirty dne 2024-03-30T12:35:16.653 INFO:tasks.rados.rados.0.smithi084.stdout:3742: expect (ObjNum 1080 snap 350 seq_num 1080) 2024-03-30T12:35:17.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:16.667+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:17.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:16.667+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:17.003 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:16.661+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:17.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:16.661+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:17.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:16.661+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:17.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:16.662+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:17.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:16.662+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:17.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:17.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:17.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:17.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:17.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-mon[91810]: osdmap e819: 8 total, 8 up, 8 in 2024-03-30T12:35:17.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:17.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:17.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:17.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:17.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:17.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:17.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:17.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:17.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:17.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:17.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:17.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-mon[89279]: osdmap e819: 8 total, 8 up, 8 in 2024-03-30T12:35:17.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:17.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:17.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:17.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:17.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:17.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:17.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:16 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:17.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:16.656+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:17.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:16.656+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:17.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:16.656+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:17.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:16 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:17.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:16 smithi162 ceph-mon[83709]: osdmap e819: 8 total, 8 up, 8 in 2024-03-30T12:35:17.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:17.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:17.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:17.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:17.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:17.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:17.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:16 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:17.516 INFO:tasks.rados.rados.0.smithi084.stdout:3745: seq_num 1152 ranges {9912320=98304} 2024-03-30T12:35:17.569 INFO:tasks.rados.rados.0.smithi084.stdout:3745: writing smithi08477944-1 from 9912320 to 10010624 tid 1 2024-03-30T12:35:17.569 INFO:tasks.rados.rados.0.smithi084.stdout:3742: done (2 left) 2024-03-30T12:35:17.569 INFO:tasks.rados.rados.0.smithi084.stdout:3743: done (1 left) 2024-03-30T12:35:17.569 INFO:tasks.rados.rados.0.smithi084.stdout:3746: read oid 50 snap -1 2024-03-30T12:35:17.569 INFO:tasks.rados.rados.0.smithi084.stdout:3746: expect deleted 2024-03-30T12:35:17.569 INFO:tasks.rados.rados.0.smithi084.stdout:3747: read oid 22 snap -1 2024-03-30T12:35:17.569 INFO:tasks.rados.rados.0.smithi084.stdout:3747: expect deleted 2024-03-30T12:35:17.569 INFO:tasks.rados.rados.0.smithi084.stdout:3748: rollback oid 13 current snap is 376 2024-03-30T12:35:17.569 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 13 to 368 2024-03-30T12:35:17.569 INFO:tasks.rados.rados.0.smithi084.stdout:3749: read oid 4 snap -1 2024-03-30T12:35:17.569 INFO:tasks.rados.rados.0.smithi084.stdout:3749: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:35:17.569 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 24 current snap is 376 2024-03-30T12:35:17.569 INFO:tasks.rados.rados.0.smithi084.stdout:3750: seq_num 1153 ranges {5046272=114688} 2024-03-30T12:35:17.570 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:17.216+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:17.570 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:17.216+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:17.570 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:17.399+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:17.570 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:17.400+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:17.595 INFO:tasks.rados.rados.0.smithi084.stdout:3750: writing smithi08477944-24 from 5046272 to 5160960 tid 1 2024-03-30T12:35:17.596 INFO:tasks.rados.rados.0.smithi084.stdout:3751: snap_create 2024-03-30T12:35:17.596 INFO:tasks.rados.rados.0.smithi084.stdout:3749: expect (ObjNum 0 snap 0 seq_num 0) 2024-03-30T12:35:17.598 INFO:tasks.rados.rados.0.smithi084.stdout:3745: finishing write tid 1 to smithi08477944-1 2024-03-30T12:35:17.598 INFO:tasks.rados.rados.0.smithi084.stdout:3745: finishing write tid 2 to smithi08477944-1 2024-03-30T12:35:17.598 INFO:tasks.rados.rados.0.smithi084.stdout:3745: finishing write tid 3 to smithi08477944-1 2024-03-30T12:35:17.598 INFO:tasks.rados.rados.0.smithi084.stdout:3745: oid 1 updating version 0 to 36324 2024-03-30T12:35:17.598 INFO:tasks.rados.rados.0.smithi084.stdout:3745: oid 1 version 36324 is already newer than 36323 2024-03-30T12:35:17.598 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 36324 (ObjNum 1152 snap 376 seq_num 1152) dirty exists 2024-03-30T12:35:17.598 INFO:tasks.rados.rados.0.smithi084.stdout:3745: left oid 1 (ObjNum 1152 snap 376 seq_num 1152) 2024-03-30T12:35:17.598 INFO:tasks.rados.rados.0.smithi084.stdout:3748: finishing rollback tid 0 to smithi08477944-13 2024-03-30T12:35:17.598 INFO:tasks.rados.rados.0.smithi084.stdout:3748: finishing rollback tid 1 to smithi08477944-13 2024-03-30T12:35:17.598 INFO:tasks.rados.rados.0.smithi084.stdout:3748: finishing rollback tid 2 to smithi08477944-13 2024-03-30T12:35:17.598 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 23452 (ObjNum 1080 snap 350 seq_num 1080) dirty exists 2024-03-30T12:35:17.604 INFO:tasks.rados.rados.0.smithi084.stdout:3750: finishing write tid 1 to smithi08477944-24 2024-03-30T12:35:17.604 INFO:tasks.rados.rados.0.smithi084.stdout:3750: finishing write tid 2 to smithi08477944-24 2024-03-30T12:35:17.607 INFO:tasks.rados.rados.0.smithi084.stdout:3750: finishing write tid 3 to smithi08477944-24 2024-03-30T12:35:17.608 INFO:tasks.rados.rados.0.smithi084.stdout:3750: oid 24 updating version 0 to 23454 2024-03-30T12:35:17.608 INFO:tasks.rados.rados.0.smithi084.stdout:3750: oid 24 version 23454 is already newer than 23453 2024-03-30T12:35:17.608 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 23454 (ObjNum 1153 snap 376 seq_num 1153) dirty exists 2024-03-30T12:35:17.608 INFO:tasks.rados.rados.0.smithi084.stdout:3750: left oid 24 (ObjNum 1153 snap 376 seq_num 1153) 2024-03-30T12:35:17.658 INFO:tasks.rados.rados.0.smithi084.stdout:3745: done (6 left) 2024-03-30T12:35:17.659 INFO:tasks.rados.rados.0.smithi084.stdout:3746: done (5 left) 2024-03-30T12:35:17.659 INFO:tasks.rados.rados.0.smithi084.stdout:3747: done (4 left) 2024-03-30T12:35:17.659 INFO:tasks.rados.rados.0.smithi084.stdout:3748: done (3 left) 2024-03-30T12:35:17.659 INFO:tasks.rados.rados.0.smithi084.stdout:3749: done (2 left) 2024-03-30T12:35:17.659 INFO:tasks.rados.rados.0.smithi084.stdout:3750: done (1 left) 2024-03-30T12:35:17.659 INFO:tasks.rados.rados.0.smithi084.stdout:3751: done (0 left) 2024-03-30T12:35:17.659 INFO:tasks.rados.rados.0.smithi084.stdout:3752: delete oid 29 current snap is 377 2024-03-30T12:35:17.662 INFO:tasks.rados.rados.0.smithi084.stdout:3752: done (0 left) 2024-03-30T12:35:17.663 INFO:tasks.rados.rados.0.smithi084.stdout:3753: rollback oid 10 current snap is 377 2024-03-30T12:35:17.663 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 10 to 349 2024-03-30T12:35:17.663 INFO:tasks.rados.rados.0.smithi084.stdout:3754: read oid 9 snap -1 2024-03-30T12:35:17.663 INFO:tasks.rados.rados.0.smithi084.stdout:3754: expect deleted 2024-03-30T12:35:17.663 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 44 current snap is 377 2024-03-30T12:35:17.663 INFO:tasks.rados.rados.0.smithi084.stdout:3755: seq_num 1155 ranges {3702784=147456} 2024-03-30T12:35:17.684 INFO:tasks.rados.rados.0.smithi084.stdout:3755: writing smithi08477944-44 from 3702784 to 3850240 tid 1 2024-03-30T12:35:17.684 INFO:tasks.rados.rados.0.smithi084.stdout:3756: copy_from oid 16 from oid 37 current snap is 377 2024-03-30T12:35:17.684 INFO:tasks.rados.rados.0.smithi084.stdout:3753: finishing rollback tid 0 to smithi08477944-10 2024-03-30T12:35:17.684 INFO:tasks.rados.rados.0.smithi084.stdout:3753: finishing rollback tid 1 to smithi08477944-10 2024-03-30T12:35:17.684 INFO:tasks.rados.rados.0.smithi084.stdout:3753: finishing rollback tid 2 to smithi08477944-10 2024-03-30T12:35:17.684 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 36333 (ObjNum 947 snap 301 seq_num 947) dirty exists 2024-03-30T12:35:17.684 INFO:tasks.rados.rados.0.smithi084.stdout:3753: done (3 left) 2024-03-30T12:35:17.684 INFO:tasks.rados.rados.0.smithi084.stdout:3754: done (2 left) 2024-03-30T12:35:17.684 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 377 2024-03-30T12:35:17.684 INFO:tasks.rados.rados.0.smithi084.stdout:3757: seq_num 1156 ranges {5914624=163840} 2024-03-30T12:35:17.717 INFO:tasks.rados.rados.0.smithi084.stdout:3757: writing smithi08477944-40 from 5914624 to 6078464 tid 1 2024-03-30T12:35:17.717 INFO:tasks.rados.rados.0.smithi084.stdout:3758: rollback oid 39 current snap is 377 2024-03-30T12:35:17.717 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 39 to 353 2024-03-30T12:35:17.717 INFO:tasks.rados.rados.0.smithi084.stdout:3756: finishing copy_from racing read to smithi08477944-16 2024-03-30T12:35:17.717 INFO:tasks.rados.rados.0.smithi084.stdout:3755: finishing write tid 1 to smithi08477944-44 2024-03-30T12:35:17.717 INFO:tasks.rados.rados.0.smithi084.stdout:3755: finishing write tid 2 to smithi08477944-44 2024-03-30T12:35:17.717 INFO:tasks.rados.rados.0.smithi084.stdout:3756: finishing copy_from to smithi08477944-16 2024-03-30T12:35:17.717 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 27312 (ObjNum 1105 snap 362 seq_num 1105) dirty exists 2024-03-30T12:35:17.718 INFO:tasks.rados.rados.0.smithi084.stdout:3755: finishing write tid 3 to smithi08477944-44 2024-03-30T12:35:17.718 INFO:tasks.rados.rados.0.smithi084.stdout:3755: oid 44 updating version 0 to 36407 2024-03-30T12:35:17.718 INFO:tasks.rados.rados.0.smithi084.stdout:3755: oid 44 version 36407 is already newer than 36406 2024-03-30T12:35:17.718 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 36407 (ObjNum 1155 snap 377 seq_num 1155) dirty exists 2024-03-30T12:35:17.718 INFO:tasks.rados.rados.0.smithi084.stdout:3755: left oid 44 (ObjNum 1155 snap 377 seq_num 1155) 2024-03-30T12:35:17.718 INFO:tasks.rados.rados.0.smithi084.stdout:3755: done (3 left) 2024-03-30T12:35:17.718 INFO:tasks.rados.rados.0.smithi084.stdout:3756: done (2 left) 2024-03-30T12:35:17.718 INFO:tasks.rados.rados.0.smithi084.stdout:3759: rollback oid 43 current snap is 377 2024-03-30T12:35:17.718 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 43 to 369 2024-03-30T12:35:17.718 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 377 2024-03-30T12:35:17.718 INFO:tasks.rados.rados.0.smithi084.stdout:3760: seq_num 1157 ranges {0=180224} 2024-03-30T12:35:17.719 INFO:tasks.rados.rados.0.smithi084.stdout:3760: writing smithi08477944-34 from 0 to 180224 tid 1 2024-03-30T12:35:17.719 INFO:tasks.rados.rados.0.smithi084.stdout:3761: read oid 49 snap -1 2024-03-30T12:35:17.719 INFO:tasks.rados.rados.0.smithi084.stdout:3761: expect (ObjNum 1021 snap 328 seq_num 1021) 2024-03-30T12:35:17.719 INFO:tasks.rados.rados.0.smithi084.stdout:3762: copy_from oid 31 from oid 11 current snap is 377 2024-03-30T12:35:17.719 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 377 2024-03-30T12:35:17.719 INFO:tasks.rados.rados.0.smithi084.stdout:3763: seq_num 1158 ranges {0=196608} 2024-03-30T12:35:17.720 INFO:tasks.rados.rados.0.smithi084.stdout:3763: writing smithi08477944-9 from 0 to 196608 tid 1 2024-03-30T12:35:17.720 INFO:tasks.rados.rados.0.smithi084.stdout:3764: snap_remove snap 355 2024-03-30T12:35:17.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:17.696+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:17.869 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:17.704+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:17.870 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:17.577+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:17.870 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:17.685+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:17.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:17.666+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:17.870 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:17.666+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:17.870 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:17.662+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:17.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:17.662+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:17.871 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:17.662+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:17.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:17.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:17.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:17.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:17.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:17.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:17.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-mon[83709]: osdmap e820: 8 total, 8 up, 8 in 2024-03-30T12:35:17.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:17.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:17.871 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:17.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:17.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-mon[83709]: pgmap v921: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 15 MiB/s rd, 5.1 MiB/s wr, 31 op/s 2024-03-30T12:35:17.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:17.872 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:17 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:18.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:17.673+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:18.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:17.673+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:18.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:17.670+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:18.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:17.670+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:18.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:17.670+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:18.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:17.670+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:18.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:17.671+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:18.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:17.671+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:18.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[89279]: osdmap e820: 8 total, 8 up, 8 in 2024-03-30T12:35:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[89279]: pgmap v921: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 15 MiB/s rd, 5.1 MiB/s wr, 31 op/s 2024-03-30T12:35:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:18.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:18.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:18.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:18.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:18.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:18.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:18.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:18.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[91810]: osdmap e820: 8 total, 8 up, 8 in 2024-03-30T12:35:18.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:18.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:18.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:18.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:18.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[91810]: pgmap v921: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 15 MiB/s rd, 5.1 MiB/s wr, 31 op/s 2024-03-30T12:35:18.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 19c=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:18.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:17 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:18.668 INFO:tasks.rados.rados.0.smithi084.stdout:3764: done (7 left) 2024-03-30T12:35:18.668 INFO:tasks.rados.rados.0.smithi084.stdout:3765: copy_from oid 48 from oid 27 current snap is 377 2024-03-30T12:35:18.668 INFO:tasks.rados.rados.0.smithi084.stdout:3758: finishing rollback tid 0 to smithi08477944-39 2024-03-30T12:35:18.668 INFO:tasks.rados.rados.0.smithi084.stdout:3758: finishing rollback tid 1 to smithi08477944-39 2024-03-30T12:35:18.668 INFO:tasks.rados.rados.0.smithi084.stdout:3758: finishing rollback tid 2 to smithi08477944-39 2024-03-30T12:35:18.668 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 27424 (ObjNum 1023 snap 328 seq_num 1023) dirty exists 2024-03-30T12:35:18.668 INFO:tasks.rados.rados.0.smithi084.stdout:3763: finishing write tid 1 to smithi08477944-9 2024-03-30T12:35:18.668 INFO:tasks.rados.rados.0.smithi084.stdout:3763: finishing write tid 2 to smithi08477944-9 2024-03-30T12:35:18.668 INFO:tasks.rados.rados.0.smithi084.stdout:3761: expect (ObjNum 1021 snap 328 seq_num 1021) 2024-03-30T12:35:18.679 INFO:tasks.rados.rados.0.smithi084.stdout:3760: finishing write tid 1 to smithi08477944-34 2024-03-30T12:35:18.680 INFO:tasks.rados.rados.0.smithi084.stdout:3757: finishing write tid 1 to smithi08477944-40 2024-03-30T12:35:18.680 INFO:tasks.rados.rados.0.smithi084.stdout:3757: finishing write tid 2 to smithi08477944-40 2024-03-30T12:35:18.680 INFO:tasks.rados.rados.0.smithi084.stdout:3758: done (7 left) 2024-03-30T12:35:18.680 INFO:tasks.rados.rados.0.smithi084.stdout:3761: done (6 left) 2024-03-30T12:35:18.680 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 377 2024-03-30T12:35:18.680 INFO:tasks.rados.rados.0.smithi084.stdout:3760: finishing write tid 2 to smithi08477944-34 2024-03-30T12:35:18.680 INFO:tasks.rados.rados.0.smithi084.stdout:3759: finishing rollback tid 0 to smithi08477944-43 2024-03-30T12:35:18.680 INFO:tasks.rados.rados.0.smithi084.stdout:3763: finishing write tid 3 to smithi08477944-9 2024-03-30T12:35:18.680 INFO:tasks.rados.rados.0.smithi084.stdout:3763: oid 9 updating version 0 to 22534 2024-03-30T12:35:18.680 INFO:tasks.rados.rados.0.smithi084.stdout:3763: oid 9 updating version 22534 to 22535 2024-03-30T12:35:18.680 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 22535 (ObjNum 1158 snap 377 seq_num 1158) dirty exists 2024-03-30T12:35:18.680 INFO:tasks.rados.rados.0.smithi084.stdout:3763: left oid 9 (ObjNum 1158 snap 377 seq_num 1158) 2024-03-30T12:35:18.680 INFO:tasks.rados.rados.0.smithi084.stdout:3757: finishing write tid 3 to smithi08477944-40 2024-03-30T12:35:18.681 INFO:tasks.rados.rados.0.smithi084.stdout:3757: oid 40 updating version 0 to 36335 2024-03-30T12:35:18.681 INFO:tasks.rados.rados.0.smithi084.stdout:3757: oid 40 updating version 36335 to 36336 2024-03-30T12:35:18.681 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 36336 (ObjNum 1156 snap 377 seq_num 1156) dirty exists 2024-03-30T12:35:18.681 INFO:tasks.rados.rados.0.smithi084.stdout:3757: left oid 40 (ObjNum 1156 snap 377 seq_num 1156) 2024-03-30T12:35:18.681 INFO:tasks.rados.rados.0.smithi084.stdout:3759: finishing rollback tid 1 to smithi08477944-43 2024-03-30T12:35:18.681 INFO:tasks.rados.rados.0.smithi084.stdout:3759: finishing rollback tid 2 to smithi08477944-43 2024-03-30T12:35:18.681 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 36411 (ObjNum 1062 snap 344 seq_num 1062) dirty exists 2024-03-30T12:35:18.681 INFO:tasks.rados.rados.0.smithi084.stdout:3760: finishing write tid 3 to smithi08477944-34 2024-03-30T12:35:18.681 INFO:tasks.rados.rados.0.smithi084.stdout:3760: oid 34 updating version 0 to 36300 2024-03-30T12:35:18.681 INFO:tasks.rados.rados.0.smithi084.stdout:3760: oid 34 updating version 36300 to 36301 2024-03-30T12:35:18.681 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 36301 (ObjNum 1157 snap 377 seq_num 1157) dirty exists 2024-03-30T12:35:18.681 INFO:tasks.rados.rados.0.smithi084.stdout:3760: left oid 34 (ObjNum 1157 snap 377 seq_num 1157) 2024-03-30T12:35:18.681 INFO:tasks.rados.rados.0.smithi084.stdout:3762: finishing copy_from racing read to smithi08477944-31 2024-03-30T12:35:18.681 INFO:tasks.rados.rados.0.smithi084.stdout:3762: finishing copy_from to smithi08477944-31 2024-03-30T12:35:18.681 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 27305 (ObjNum 1068 snap 347 seq_num 1068) dirty exists 2024-03-30T12:35:18.682 INFO:tasks.rados.rados.0.smithi084.stdout:3765: finishing copy_from to smithi08477944-48 2024-03-30T12:35:18.682 INFO:tasks.rados.rados.0.smithi084.stdout:3765: got expected ENOENT (src dne) 2024-03-30T12:35:18.682 INFO:tasks.rados.rados.0.smithi084.stdout:3765: finishing copy_from racing read to smithi08477944-48 2024-03-30T12:35:18.682 INFO:tasks.rados.rados.0.smithi084.stdout:3766: seq_num 1159 ranges {2392064=212992} 2024-03-30T12:35:18.693 INFO:tasks.rados.rados.0.smithi084.stdout:3766: writing smithi08477944-26 from 2392064 to 2605056 tid 1 2024-03-30T12:35:18.693 INFO:tasks.rados.rados.0.smithi084.stdout:3757: done (6 left) 2024-03-30T12:35:18.693 INFO:tasks.rados.rados.0.smithi084.stdout:3759: done (5 left) 2024-03-30T12:35:18.693 INFO:tasks.rados.rados.0.smithi084.stdout:3760: done (4 left) 2024-03-30T12:35:18.693 INFO:tasks.rados.rados.0.smithi084.stdout:3762: done (3 left) 2024-03-30T12:35:18.693 INFO:tasks.rados.rados.0.smithi084.stdout:3763: done (2 left) 2024-03-30T12:35:18.693 INFO:tasks.rados.rados.0.smithi084.stdout:3765: done (1 left) 2024-03-30T12:35:18.693 INFO:tasks.rados.rados.0.smithi084.stdout:3767: snap_create 2024-03-30T12:35:18.700 INFO:tasks.rados.rados.0.smithi084.stdout:3766: finishing write tid 1 to smithi08477944-26 2024-03-30T12:35:18.700 INFO:tasks.rados.rados.0.smithi084.stdout:3766: finishing write tid 2 to smithi08477944-26 2024-03-30T12:35:18.703 INFO:tasks.rados.rados.0.smithi084.stdout:3766: finishing write tid 3 to smithi08477944-26 2024-03-30T12:35:18.703 INFO:tasks.rados.rados.0.smithi084.stdout:3766: oid 26 updating version 0 to 36326 2024-03-30T12:35:18.703 INFO:tasks.rados.rados.0.smithi084.stdout:3766: oid 26 version 36326 is already newer than 36325 2024-03-30T12:35:18.704 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 36326 (ObjNum 1159 snap 377 seq_num 1159) dirty exists 2024-03-30T12:35:18.704 INFO:tasks.rados.rados.0.smithi084.stdout:3766: left oid 26 (ObjNum 1159 snap 377 seq_num 1159) 2024-03-30T12:35:18.905 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:18.685+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:18.906 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:18.685+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:18.906 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:18.672+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:18.906 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:18.672+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:18.906 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:18.680+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:18.906 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:18.680+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:18.907 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:18.680+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:18.907 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:18.907 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:18.907 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:18.907 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:18.907 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:18.907 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:18.907 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:18.907 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:18 smithi162 ceph-mon[83709]: osdmap e821: 8 total, 8 up, 8 in 2024-03-30T12:35:18.908 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:18.908 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:18.908 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:18.908 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:18.908 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:18.908 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:18 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:18.908 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:18.908 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:18.908 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:18 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:19.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:18.682+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:19.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:18.682+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:19.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:18.675+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:19.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:18.675+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:19.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:18.675+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:19.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:18.675+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:19.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:18.675+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:19.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:19.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:19.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:19.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:19.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:19.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:19.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:19.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[89279]: osdmap e821: 8 total, 8 up, 8 in 2024-03-30T12:35:19.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:19.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:19.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 190=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:19.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:19.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:19.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:19.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:19.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[91810]: osdmap e821: 8 total, 8 up, 8 in 2024-03-30T12:35:19.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:19.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:19.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:19.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:19.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:19.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:19.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:19.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:19.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:19.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:19.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:19.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:19.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:19.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:19.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:19.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:19.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:19.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:18 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:19.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:18.914+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:19.667 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:35:19] "GET /metrics HTTP/1.1" 200 36328 "" "Prometheus/2.43.0" 2024-03-30T12:35:19.674 INFO:tasks.rados.rados.0.smithi084.stdout:3766: done (1 left) 2024-03-30T12:35:19.674 INFO:tasks.rados.rados.0.smithi084.stdout:3767: done (0 left) 2024-03-30T12:35:19.674 INFO:tasks.rados.rados.0.smithi084.stdout:3768: setattr oid 9 current snap is 378 2024-03-30T12:35:19.676 INFO:tasks.rados.rados.0.smithi084.stdout:3769: snap_create 2024-03-30T12:35:19.680 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 22536 (ObjNum 1158 snap 377 seq_num 1158) dirty exists 2024-03-30T12:35:20.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:19.887+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:20.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:19.887+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:20.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:19.680+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:20.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:19.680+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:20.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:19.680+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:20.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:19.680+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:20.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:19.680+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:20.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:19.680+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[91810]: osdmap e822: 8 total, 8 up, 8 in 2024-03-30T12:35:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:20.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:20.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:20.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:20.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[91810]: pgmap v924: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 19 MiB/s rd, 984 KiB/s wr, 19 op/s 2024-03-30T12:35:20.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:20.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:20.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:20.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[89279]: osdmap e822: 8 total, 8 up, 8 in 2024-03-30T12:35:20.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:20.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:20.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:20.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:20.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:20.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:20.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:20.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:20.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:20.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:20.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[89279]: pgmap v924: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 19 MiB/s rd, 984 KiB/s wr, 19 op/s 2024-03-30T12:35:20.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:19 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:20.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:19.886+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:20.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:19.678+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:20.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:19.678+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:20.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:19.680+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:20.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:19.680+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:20.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:19.690+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:20.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:19.690+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:20.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:19.690+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:19 smithi162 ceph-mon[83709]: osdmap e822: 8 total, 8 up, 8 in 2024-03-30T12:35:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:20.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:19 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:19 smithi162 ceph-mon[83709]: pgmap v924: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 19 MiB/s rd, 984 KiB/s wr, 19 op/s 2024-03-30T12:35:20.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:19 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:20.678 INFO:tasks.rados.rados.0.smithi084.stdout:3768: done (1 left) 2024-03-30T12:35:20.678 INFO:tasks.rados.rados.0.smithi084.stdout:3769: done (0 left) 2024-03-30T12:35:20.679 INFO:tasks.rados.rados.0.smithi084.stdout:3770: snap_create 2024-03-30T12:35:21.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:20.855+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:21.005 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:20.856+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:21.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:20.687+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:21.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:20.688+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:21.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:20.688+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:21.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:20.688+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:21.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:20.688+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:21.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:21.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:21.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:21.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:21.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:21.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:21.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:21.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:21.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-mon[91810]: osdmap e823: 8 total, 8 up, 8 in 2024-03-30T12:35:21.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:21.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:21.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:21.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:21.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:21.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:21.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:21.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:21.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:21.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:21.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:21.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-mon[89279]: osdmap e823: 8 total, 8 up, 8 in 2024-03-30T12:35:21.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:21.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:21.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:20 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:21.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:20.854+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:21.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:20.685+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:21.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:20.685+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:21.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:20.685+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:21.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:20.856+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:21.121 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:20.857+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:21.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:20.856+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:21.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:20.856+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:21.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:21.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:21.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:21.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:21.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:21.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:20 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:21.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:21.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:21.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:20 smithi162 ceph-mon[83709]: osdmap e823: 8 total, 8 up, 8 in 2024-03-30T12:35:21.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:21.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:21.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:20 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:21.685 INFO:tasks.rados.rados.0.smithi084.stdout:3770: done (0 left) 2024-03-30T12:35:21.685 INFO:tasks.rados.rados.0.smithi084.stdout:3771: rollback oid 1 current snap is 380 2024-03-30T12:35:21.685 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 1 to 379 2024-03-30T12:35:21.685 INFO:tasks.rados.rados.0.smithi084.stdout:3772: read oid 41 snap -1 2024-03-30T12:35:21.685 INFO:tasks.rados.rados.0.smithi084.stdout:3772: expect (ObjNum 1052 snap 337 seq_num 1052) 2024-03-30T12:35:21.685 INFO:tasks.rados.rados.0.smithi084.stdout:3773: rmattr oid 10 current snap is 380 2024-03-30T12:35:21.685 INFO:tasks.rados.rados.0.smithi084.stdout:3773: done (2 left) 2024-03-30T12:35:21.685 INFO:tasks.rados.rados.0.smithi084.stdout:3774: delete oid 42 current snap is 380 2024-03-30T12:35:21.694 INFO:tasks.rados.rados.0.smithi084.stdout:3772: expect (ObjNum 1052 snap 337 seq_num 1052) 2024-03-30T12:35:21.729 INFO:tasks.rados.rados.0.smithi084.stdout:3771: finishing rollback tid 0 to smithi08477944-1 2024-03-30T12:35:21.729 INFO:tasks.rados.rados.0.smithi084.stdout:3771: finishing rollback tid 1 to smithi08477944-1 2024-03-30T12:35:21.730 INFO:tasks.rados.rados.0.smithi084.stdout:3772: done (2 left) 2024-03-30T12:35:21.730 INFO:tasks.rados.rados.0.smithi084.stdout:3774: done (1 left) 2024-03-30T12:35:21.730 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 10 current snap is 380 2024-03-30T12:35:21.730 INFO:tasks.rados.rados.0.smithi084.stdout:3771: finishing rollback tid 2 to smithi08477944-1 2024-03-30T12:35:21.730 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 36327 (ObjNum 1152 snap 376 seq_num 1152) dirty exists 2024-03-30T12:35:21.730 INFO:tasks.rados.rados.0.smithi084.stdout:3775: seq_num 1161 ranges {1466368=245760} 2024-03-30T12:35:21.739 INFO:tasks.rados.rados.0.smithi084.stdout:3775: writing smithi08477944-10 from 1466368 to 1712128 tid 1 2024-03-30T12:35:21.739 INFO:tasks.rados.rados.0.smithi084.stdout:3771: done (1 left) 2024-03-30T12:35:21.739 INFO:tasks.rados.rados.0.smithi084.stdout:3776: copy_from oid 2 from oid 39 current snap is 380 2024-03-30T12:35:21.739 INFO:tasks.rados.rados.0.smithi084.stdout:3777: rmattr oid 11 current snap is 380 2024-03-30T12:35:21.739 INFO:tasks.rados.rados.0.smithi084.stdout:3777: done (2 left) 2024-03-30T12:35:21.739 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 380 2024-03-30T12:35:21.739 INFO:tasks.rados.rados.0.smithi084.stdout:3778: seq_num 1162 ranges {0=270336} 2024-03-30T12:35:21.740 INFO:tasks.rados.rados.0.smithi084.stdout:3778: writing smithi08477944-6 from 0 to 270336 tid 1 2024-03-30T12:35:21.740 INFO:tasks.rados.rados.0.smithi084.stdout:3779: delete oid 40 current snap is 380 2024-03-30T12:35:21.743 INFO:tasks.rados.rados.0.smithi084.stdout:3779: done (3 left) 2024-03-30T12:35:21.743 INFO:tasks.rados.rados.0.smithi084.stdout:3780: read oid 20 snap -1 2024-03-30T12:35:21.743 INFO:tasks.rados.rados.0.smithi084.stdout:3780: expect (ObjNum 1106 snap 362 seq_num 1106) 2024-03-30T12:35:21.743 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 380 2024-03-30T12:35:21.743 INFO:tasks.rados.rados.0.smithi084.stdout:3781: seq_num 1164 ranges {0=303104} 2024-03-30T12:35:21.745 INFO:tasks.rados.rados.0.smithi084.stdout:3781: writing smithi08477944-22 from 0 to 303104 tid 1 2024-03-30T12:35:21.745 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 380 2024-03-30T12:35:21.745 INFO:tasks.rados.rados.0.smithi084.stdout:3782: seq_num 1165 ranges {2605056=319488} 2024-03-30T12:35:21.762 INFO:tasks.rados.rados.0.smithi084.stdout:3782: writing smithi08477944-26 from 2605056 to 2924544 tid 1 2024-03-30T12:35:21.762 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 49 current snap is 380 2024-03-30T12:35:21.762 INFO:tasks.rados.rados.0.smithi084.stdout:3775: finishing write tid 1 to smithi08477944-10 2024-03-30T12:35:21.762 INFO:tasks.rados.rados.0.smithi084.stdout:3783: seq_num 1166 ranges {303104=335872} 2024-03-30T12:35:21.766 INFO:tasks.rados.rados.0.smithi084.stdout:3783: writing smithi08477944-49 from 303104 to 638976 tid 1 2024-03-30T12:35:21.766 INFO:tasks.rados.rados.0.smithi084.stdout:3784: rollback oid 41 current snap is 380 2024-03-30T12:35:21.766 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 41 to 377 2024-03-30T12:35:21.766 INFO:tasks.rados.rados.0.smithi084.stdout:3775: finishing write tid 2 to smithi08477944-10 2024-03-30T12:35:21.766 INFO:tasks.rados.rados.0.smithi084.stdout:3778: finishing write tid 1 to smithi08477944-6 2024-03-30T12:35:21.766 INFO:tasks.rados.rados.0.smithi084.stdout:3778: finishing write tid 2 to smithi08477944-6 2024-03-30T12:35:21.766 INFO:tasks.rados.rados.0.smithi084.stdout:3775: finishing write tid 3 to smithi08477944-10 2024-03-30T12:35:21.766 INFO:tasks.rados.rados.0.smithi084.stdout:3775: oid 10 updating version 0 to 36334 2024-03-30T12:35:21.766 INFO:tasks.rados.rados.0.smithi084.stdout:3775: oid 10 updating version 36334 to 36335 2024-03-30T12:35:21.766 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 36335 (ObjNum 1161 snap 380 seq_num 1161) dirty exists 2024-03-30T12:35:21.767 INFO:tasks.rados.rados.0.smithi084.stdout:3775: left oid 10 (ObjNum 1161 snap 380 seq_num 1161) 2024-03-30T12:35:21.767 INFO:tasks.rados.rados.0.smithi084.stdout:3778: finishing write tid 3 to smithi08477944-6 2024-03-30T12:35:21.767 INFO:tasks.rados.rados.0.smithi084.stdout:3778: oid 6 updating version 0 to 36413 2024-03-30T12:35:21.767 INFO:tasks.rados.rados.0.smithi084.stdout:3778: oid 6 version 36413 is already newer than 36412 2024-03-30T12:35:21.767 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 36413 (ObjNum 1162 snap 380 seq_num 1162) dirty exists 2024-03-30T12:35:21.767 INFO:tasks.rados.rados.0.smithi084.stdout:3778: left oid 6 (ObjNum 1162 snap 380 seq_num 1162) 2024-03-30T12:35:21.767 INFO:tasks.rados.rados.0.smithi084.stdout:3776: finishing copy_from racing read to smithi08477944-2 2024-03-30T12:35:21.767 INFO:tasks.rados.rados.0.smithi084.stdout:3781: finishing write tid 1 to smithi08477944-22 2024-03-30T12:35:21.767 INFO:tasks.rados.rados.0.smithi084.stdout:3775: done (7 left) 2024-03-30T12:35:21.767 INFO:tasks.rados.rados.0.smithi084.stdout:3778: done (6 left) 2024-03-30T12:35:21.767 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 380 2024-03-30T12:35:21.767 INFO:tasks.rados.rados.0.smithi084.stdout:3785: seq_num 1167 ranges {16384=352256} 2024-03-30T12:35:21.768 INFO:tasks.rados.rados.0.smithi084.stdout:3785: writing smithi08477944-23 from 16384 to 368640 tid 1 2024-03-30T12:35:21.768 INFO:tasks.rados.rados.0.smithi084.stdout:3786: copy_from oid 31 from oid 38 current snap is 380 2024-03-30T12:35:21.768 INFO:tasks.rados.rados.0.smithi084.stdout:3781: finishing write tid 2 to smithi08477944-22 2024-03-30T12:35:21.768 INFO:tasks.rados.rados.0.smithi084.stdout:3780: expect (ObjNum 1106 snap 362 seq_num 1106) 2024-03-30T12:35:21.881 INFO:tasks.rados.rados.0.smithi084.stdout:3781: finishing write tid 3 to smithi08477944-22 2024-03-30T12:35:21.881 INFO:tasks.rados.rados.0.smithi084.stdout:3781: oid 22 updating version 0 to 36328 2024-03-30T12:35:21.881 INFO:tasks.rados.rados.0.smithi084.stdout:3781: oid 22 version 36328 is already newer than 36327 2024-03-30T12:35:21.881 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 36328 (ObjNum 1164 snap 380 seq_num 1164) dirty exists 2024-03-30T12:35:21.881 INFO:tasks.rados.rados.0.smithi084.stdout:3781: left oid 22 (ObjNum 1164 snap 380 seq_num 1164) 2024-03-30T12:35:21.881 INFO:tasks.rados.rados.0.smithi084.stdout:3780: done (7 left) 2024-03-30T12:35:21.881 INFO:tasks.rados.rados.0.smithi084.stdout:3781: done (6 left) 2024-03-30T12:35:21.881 INFO:tasks.rados.rados.0.smithi084.stdout:3787: copy_from oid 19 from oid 28 current snap is 380 2024-03-30T12:35:21.881 INFO:tasks.rados.rados.0.smithi084.stdout:3776: finishing copy_from to smithi08477944-2 2024-03-30T12:35:21.881 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 27424 (ObjNum 1023 snap 328 seq_num 1023) dirty exists 2024-03-30T12:35:21.881 INFO:tasks.rados.rados.0.smithi084.stdout:3786: finishing copy_from to smithi08477944-31 2024-03-30T12:35:21.882 INFO:tasks.rados.rados.0.smithi084.stdout:3786: got expected ENOENT (src dne) 2024-03-30T12:35:21.882 INFO:tasks.rados.rados.0.smithi084.stdout:3786: finishing copy_from racing read to smithi08477944-31 2024-03-30T12:35:21.882 INFO:tasks.rados.rados.0.smithi084.stdout:3784: finishing rollback tid 0 to smithi08477944-41 2024-03-30T12:35:21.882 INFO:tasks.rados.rados.0.smithi084.stdout:3783: finishing write tid 1 to smithi08477944-49 2024-03-30T12:35:21.882 INFO:tasks.rados.rados.0.smithi084.stdout:3784: finishing rollback tid 1 to smithi08477944-41 2024-03-30T12:35:21.882 INFO:tasks.rados.rados.0.smithi084.stdout:3783: finishing write tid 2 to smithi08477944-49 2024-03-30T12:35:21.882 INFO:tasks.rados.rados.0.smithi084.stdout:3784: finishing rollback tid 2 to smithi08477944-41 2024-03-30T12:35:21.882 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 36338 (ObjNum 1052 snap 337 seq_num 1052) dirty exists 2024-03-30T12:35:21.882 INFO:tasks.rados.rados.0.smithi084.stdout:3782: finishing write tid 1 to smithi08477944-26 2024-03-30T12:35:21.882 INFO:tasks.rados.rados.0.smithi084.stdout:3782: finishing write tid 2 to smithi08477944-26 2024-03-30T12:35:21.882 INFO:tasks.rados.rados.0.smithi084.stdout:3783: finishing write tid 3 to smithi08477944-49 2024-03-30T12:35:21.882 INFO:tasks.rados.rados.0.smithi084.stdout:3783: oid 49 updating version 0 to 36338 2024-03-30T12:35:21.882 INFO:tasks.rados.rados.0.smithi084.stdout:3783: oid 49 version 36338 is already newer than 36337 2024-03-30T12:35:21.882 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 36338 (ObjNum 1166 snap 380 seq_num 1166) dirty exists 2024-03-30T12:35:21.883 INFO:tasks.rados.rados.0.smithi084.stdout:3783: left oid 49 (ObjNum 1166 snap 380 seq_num 1166) 2024-03-30T12:35:21.883 INFO:tasks.rados.rados.0.smithi084.stdout:3785: finishing write tid 1 to smithi08477944-23 2024-03-30T12:35:21.883 INFO:tasks.rados.rados.0.smithi084.stdout:3776: done (6 left) 2024-03-30T12:35:21.883 INFO:tasks.rados.rados.0.smithi084.stdout:3783: done (5 left) 2024-03-30T12:35:21.883 INFO:tasks.rados.rados.0.smithi084.stdout:3784: done (4 left) 2024-03-30T12:35:21.883 INFO:tasks.rados.rados.0.smithi084.stdout:3786: done (3 left) 2024-03-30T12:35:21.883 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 46 current snap is 380 2024-03-30T12:35:21.883 INFO:tasks.rados.rados.0.smithi084.stdout:3785: finishing write tid 2 to smithi08477944-23 2024-03-30T12:35:21.883 INFO:tasks.rados.rados.0.smithi084.stdout:3788: seq_num 1168 ranges {335872=368640} 2024-03-30T12:35:21.884 INFO:tasks.rados.rados.0.smithi084.stdout:3788: writing smithi08477944-46 from 335872 to 704512 tid 1 2024-03-30T12:35:21.884 INFO:tasks.rados.rados.0.smithi084.stdout:3789: snap_create 2024-03-30T12:35:21.884 INFO:tasks.rados.rados.0.smithi084.stdout:3782: finishing write tid 3 to smithi08477944-26 2024-03-30T12:35:21.884 INFO:tasks.rados.rados.0.smithi084.stdout:3782: oid 26 updating version 0 to 36330 2024-03-30T12:35:21.884 INFO:tasks.rados.rados.0.smithi084.stdout:3782: oid 26 version 36330 is already newer than 36329 2024-03-30T12:35:21.884 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 36330 (ObjNum 1165 snap 380 seq_num 1165) dirty exists 2024-03-30T12:35:21.884 INFO:tasks.rados.rados.0.smithi084.stdout:3782: left oid 26 (ObjNum 1165 snap 380 seq_num 1165) 2024-03-30T12:35:21.884 INFO:tasks.rados.rados.0.smithi084.stdout:3785: finishing write tid 3 to smithi08477944-23 2024-03-30T12:35:21.884 INFO:tasks.rados.rados.0.smithi084.stdout:3785: oid 23 updating version 0 to 36339 2024-03-30T12:35:21.884 INFO:tasks.rados.rados.0.smithi084.stdout:3785: oid 23 updating version 36339 to 36340 2024-03-30T12:35:21.884 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 36340 (ObjNum 1167 snap 380 seq_num 1167) dirty exists 2024-03-30T12:35:21.885 INFO:tasks.rados.rados.0.smithi084.stdout:3785: left oid 23 (ObjNum 1167 snap 380 seq_num 1167) 2024-03-30T12:35:21.885 INFO:tasks.rados.rados.0.smithi084.stdout:3787: finishing copy_from to smithi08477944-19 2024-03-30T12:35:21.885 INFO:tasks.rados.rados.0.smithi084.stdout:3787: got expected ENOENT (src dne) 2024-03-30T12:35:21.885 INFO:tasks.rados.rados.0.smithi084.stdout:3787: finishing copy_from racing read to smithi08477944-19 2024-03-30T12:35:21.892 INFO:tasks.rados.rados.0.smithi084.stdout:3788: finishing write tid 1 to smithi08477944-46 2024-03-30T12:35:21.892 INFO:tasks.rados.rados.0.smithi084.stdout:3788: finishing write tid 2 to smithi08477944-46 2024-03-30T12:35:21.894 INFO:tasks.rados.rados.0.smithi084.stdout:3788: finishing write tid 3 to smithi08477944-46 2024-03-30T12:35:21.894 INFO:tasks.rados.rados.0.smithi084.stdout:3788: oid 46 updating version 0 to 36332 2024-03-30T12:35:21.895 INFO:tasks.rados.rados.0.smithi084.stdout:3788: oid 46 version 36332 is already newer than 36331 2024-03-30T12:35:21.895 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 36332 (ObjNum 1168 snap 380 seq_num 1168) dirty exists 2024-03-30T12:35:21.895 INFO:tasks.rados.rados.0.smithi084.stdout:3788: left oid 46 (ObjNum 1168 snap 380 seq_num 1168) 2024-03-30T12:35:22.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:21.701+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:22.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:21.702+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:22.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:21.691+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:22.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:21.691+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:22.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:21.691+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:22.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:21.692+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:22.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:21.692+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:22.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:21.692+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:22.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:22.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:22.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:22.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:22.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[91810]: osdmap e824: 8 total, 8 up, 8 in 2024-03-30T12:35:22.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:22.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:22.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:22.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:22.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[91810]: pgmap v927: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 11 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-03-30T12:35:22.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:22.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:22.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:22.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:22.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:22.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:22.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:22.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[89279]: osdmap e824: 8 total, 8 up, 8 in 2024-03-30T12:35:22.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:22.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:22.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:22.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:22.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[89279]: pgmap v927: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 11 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-03-30T12:35:22.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:22.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:22.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:22.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:22.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:22.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:22.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:21 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:22.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:21.695+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:22.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:21.701+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:22.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:21.701+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:22.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:21.693+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:22.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:21.693+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:22.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:21.752+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:22.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:21.752+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:22.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:21.752+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:22.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:22.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:22.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:22.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:22.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:21 smithi162 ceph-mon[83709]: osdmap e824: 8 total, 8 up, 8 in 2024-03-30T12:35:22.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:22.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:22.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:22.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:21 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:22.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:21 smithi162 ceph-mon[83709]: pgmap v927: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 11 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-03-30T12:35:22.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:22.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:22.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:22.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:22.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:21 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:22.686 INFO:tasks.rados.rados.0.smithi084.stdout:3782: done (4 left) 2024-03-30T12:35:22.686 INFO:tasks.rados.rados.0.smithi084.stdout:3785: done (3 left) 2024-03-30T12:35:22.687 INFO:tasks.rados.rados.0.smithi084.stdout:3787: done (2 left) 2024-03-30T12:35:22.687 INFO:tasks.rados.rados.0.smithi084.stdout:3788: done (1 left) 2024-03-30T12:35:22.687 INFO:tasks.rados.rados.0.smithi084.stdout:3789: done (0 left) 2024-03-30T12:35:22.687 INFO:tasks.rados.rados.0.smithi084.stdout:3790: rollback oid 20 current snap is 381 2024-03-30T12:35:22.687 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 20 to 369 2024-03-30T12:35:22.687 INFO:tasks.rados.rados.0.smithi084.stdout:3791: read oid 37 snap -1 2024-03-30T12:35:22.687 INFO:tasks.rados.rados.0.smithi084.stdout:3791: expect (ObjNum 1105 snap 362 seq_num 1105) 2024-03-30T12:35:22.687 INFO:tasks.rados.rados.0.smithi084.stdout:3792: read oid 29 snap -1 2024-03-30T12:35:22.687 INFO:tasks.rados.rados.0.smithi084.stdout:3792: expect deleted 2024-03-30T12:35:22.687 INFO:tasks.rados.rados.0.smithi084.stdout:3793: copy_from oid 43 from oid 3 current snap is 381 2024-03-30T12:35:22.687 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 18 current snap is 381 2024-03-30T12:35:22.687 INFO:tasks.rados.rados.0.smithi084.stdout:3794: seq_num 1169 ranges {3497984=385024} 2024-03-30T12:35:22.708 INFO:tasks.rados.rados.0.smithi084.stdout:3794: writing smithi08477944-18 from 3497984 to 3883008 tid 1 2024-03-30T12:35:22.708 INFO:tasks.rados.rados.0.smithi084.stdout:3795: read oid 28 snap -1 2024-03-30T12:35:22.708 INFO:tasks.rados.rados.0.smithi084.stdout:3795: expect deleted 2024-03-30T12:35:22.708 INFO:tasks.rados.rados.0.smithi084.stdout:3796: snap_remove snap 376 2024-03-30T12:35:23.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:22.703+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:23.004 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:22.703+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:23.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:23.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:23.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:23.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:23.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:23.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:23.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[91810]: osdmap e825: 8 total, 8 up, 8 in 2024-03-30T12:35:23.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:23.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:23.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:23.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:23.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:23.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:23.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:23.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:22.693+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:23.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:22.694+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:23.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:22.694+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:23.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:22.694+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:23.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:22.694+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:23.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:23.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:23.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:23.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:23.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:23.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:23.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:23.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:23.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[89279]: osdmap e825: 8 total, 8 up, 8 in 2024-03-30T12:35:23.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:23.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:23.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:23.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:23.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:23.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:23.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:23.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:23.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:22 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:23.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:22.700+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:23.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:22.694+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:23.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:22.694+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:23.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:22.694+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:23.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:22.718+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:23.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:22.722+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:23.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:22.704+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:23.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:22.706+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:23.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:23.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:23.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:23.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:23.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:23.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:23.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:22 smithi162 ceph-mon[83709]: osdmap e825: 8 total, 8 up, 8 in 2024-03-30T12:35:23.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:23.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:23.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:23.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:23.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:23.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b5=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:23.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:22 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:23.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:23.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:22 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:23.706 INFO:tasks.rados.rados.0.smithi084.stdout:3796: done (6 left) 2024-03-30T12:35:23.706 INFO:tasks.rados.rados.0.smithi084.stdout:3797: read oid 35 snap -1 2024-03-30T12:35:23.706 INFO:tasks.rados.rados.0.smithi084.stdout:3797: expect (ObjNum 1109 snap 364 seq_num 1109) 2024-03-30T12:35:23.706 INFO:tasks.rados.rados.0.smithi084.stdout:3798: read oid 46 snap -1 2024-03-30T12:35:23.706 INFO:tasks.rados.rados.0.smithi084.stdout:3798: expect (ObjNum 1168 snap 380 seq_num 1168) 2024-03-30T12:35:23.706 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 381 2024-03-30T12:35:23.706 INFO:tasks.rados.rados.0.smithi084.stdout:3790: finishing rollback tid 0 to smithi08477944-20 2024-03-30T12:35:23.706 INFO:tasks.rados.rados.0.smithi084.stdout:3790: finishing rollback tid 1 to smithi08477944-20 2024-03-30T12:35:23.706 INFO:tasks.rados.rados.0.smithi084.stdout:3790: finishing rollback tid 2 to smithi08477944-20 2024-03-30T12:35:23.706 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 36340 (ObjNum 1106 snap 362 seq_num 1106) dirty exists 2024-03-30T12:35:23.707 INFO:tasks.rados.rados.0.smithi084.stdout:3791: expect (ObjNum 1105 snap 362 seq_num 1105) 2024-03-30T12:35:23.755 INFO:tasks.rados.rados.0.smithi084.stdout:3794: finishing write tid 1 to smithi08477944-18 2024-03-30T12:35:23.755 INFO:tasks.rados.rados.0.smithi084.stdout:3794: finishing write tid 2 to smithi08477944-18 2024-03-30T12:35:23.755 INFO:tasks.rados.rados.0.smithi084.stdout:3793: finishing copy_from racing read to smithi08477944-43 2024-03-30T12:35:23.755 INFO:tasks.rados.rados.0.smithi084.stdout:3793: finishing copy_from to smithi08477944-43 2024-03-30T12:35:23.755 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 36307 (ObjNum 1106 snap 362 seq_num 1106) dirty exists 2024-03-30T12:35:23.755 INFO:tasks.rados.rados.0.smithi084.stdout:3794: finishing write tid 3 to smithi08477944-18 2024-03-30T12:35:23.755 INFO:tasks.rados.rados.0.smithi084.stdout:3794: oid 18 updating version 0 to 36340 2024-03-30T12:35:23.755 INFO:tasks.rados.rados.0.smithi084.stdout:3794: oid 18 version 36340 is already newer than 36339 2024-03-30T12:35:23.755 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 36340 (ObjNum 1169 snap 381 seq_num 1169) dirty exists 2024-03-30T12:35:23.756 INFO:tasks.rados.rados.0.smithi084.stdout:3794: left oid 18 (ObjNum 1169 snap 381 seq_num 1169) 2024-03-30T12:35:23.756 INFO:tasks.rados.rados.0.smithi084.stdout:3799: seq_num 1170 ranges {1736704=401408} 2024-03-30T12:35:23.766 INFO:tasks.rados.rados.0.smithi084.stdout:3799: writing smithi08477944-11 from 1736704 to 2138112 tid 1 2024-03-30T12:35:23.766 INFO:tasks.rados.rados.0.smithi084.stdout:3790: done (8 left) 2024-03-30T12:35:23.767 INFO:tasks.rados.rados.0.smithi084.stdout:3791: done (7 left) 2024-03-30T12:35:23.767 INFO:tasks.rados.rados.0.smithi084.stdout:3792: done (6 left) 2024-03-30T12:35:23.767 INFO:tasks.rados.rados.0.smithi084.stdout:3793: done (5 left) 2024-03-30T12:35:23.767 INFO:tasks.rados.rados.0.smithi084.stdout:3794: done (4 left) 2024-03-30T12:35:23.767 INFO:tasks.rados.rados.0.smithi084.stdout:3795: done (3 left) 2024-03-30T12:35:23.767 INFO:tasks.rados.rados.0.smithi084.stdout:3800: setattr oid 44 current snap is 381 2024-03-30T12:35:23.767 INFO:tasks.rados.rados.0.smithi084.stdout:3798: expect (ObjNum 1168 snap 380 seq_num 1168) 2024-03-30T12:35:23.794 INFO:tasks.rados.rados.0.smithi084.stdout:3797: expect (ObjNum 1109 snap 364 seq_num 1109) 2024-03-30T12:35:23.958 INFO:tasks.rados.rados.0.smithi084.stdout:3799: finishing write tid 1 to smithi08477944-11 2024-03-30T12:35:23.958 INFO:tasks.rados.rados.0.smithi084.stdout:3799: finishing write tid 2 to smithi08477944-11 2024-03-30T12:35:23.958 INFO:tasks.rados.rados.0.smithi084.stdout:3799: finishing write tid 3 to smithi08477944-11 2024-03-30T12:35:23.958 INFO:tasks.rados.rados.0.smithi084.stdout:3799: oid 11 updating version 0 to 27318 2024-03-30T12:35:23.958 INFO:tasks.rados.rados.0.smithi084.stdout:3799: oid 11 updating version 27318 to 27319 2024-03-30T12:35:23.958 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 27319 (ObjNum 1170 snap 381 seq_num 1170) dirty exists 2024-03-30T12:35:23.958 INFO:tasks.rados.rados.0.smithi084.stdout:3799: left oid 11 (ObjNum 1170 snap 381 seq_num 1170) 2024-03-30T12:35:23.958 INFO:tasks.rados.rados.0.smithi084.stdout:3797: done (3 left) 2024-03-30T12:35:23.958 INFO:tasks.rados.rados.0.smithi084.stdout:3798: done (2 left) 2024-03-30T12:35:23.959 INFO:tasks.rados.rados.0.smithi084.stdout:3799: done (1 left) 2024-03-30T12:35:23.959 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 17 current snap is 381 2024-03-30T12:35:23.959 INFO:tasks.rados.rados.0.smithi084.stdout:3801: seq_num 1171 ranges {2711552=417792} 2024-03-30T12:35:23.975 INFO:tasks.rados.rados.0.smithi084.stdout:3801: writing smithi08477944-17 from 2711552 to 3129344 tid 1 2024-03-30T12:35:23.975 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 16 current snap is 381 2024-03-30T12:35:23.975 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 36417 (ObjNum 1155 snap 377 seq_num 1155) dirty exists 2024-03-30T12:35:23.975 INFO:tasks.rados.rados.0.smithi084.stdout:3802: seq_num 1172 ranges {1720320=434176} 2024-03-30T12:35:23.979 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:23.707+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:23.979 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:23.707+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:23.979 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:23.711+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:23.980 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:23.711+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:23.980 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:23.718+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:23.980 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:23.718+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:23.980 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:23.722+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:23.981 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:23.981 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:23.981 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:23 smithi162 ceph-mon[83709]: osdmap e826: 8 total, 8 up, 8 in 2024-03-30T12:35:23.981 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:23.981 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:23.981 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:23.981 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:23.981 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:23.981 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:23.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:23 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:23.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:23.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:23.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:23.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:23 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:23.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:23 smithi162 ceph-mon[83709]: pgmap v930: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 7.2 MiB/s rd, 250 KiB/s wr, 8 op/s 2024-03-30T12:35:23.988 INFO:tasks.rados.rados.0.smithi084.stdout:3802: writing smithi08477944-16 from 1720320 to 2154496 tid 1 2024-03-30T12:35:23.988 INFO:tasks.rados.rados.0.smithi084.stdout:3800: done (2 left) 2024-03-30T12:35:23.988 INFO:tasks.rados.rados.0.smithi084.stdout:3803: read oid 11 snap 353 2024-03-30T12:35:23.988 INFO:tasks.rados.rados.0.smithi084.stdout:3803: expect (ObjNum 1068 snap 347 seq_num 1068) 2024-03-30T12:35:23.988 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 20 current snap is 381 2024-03-30T12:35:23.988 INFO:tasks.rados.rados.0.smithi084.stdout:3801: finishing write tid 1 to smithi08477944-17 2024-03-30T12:35:23.988 INFO:tasks.rados.rados.0.smithi084.stdout:3801: finishing write tid 2 to smithi08477944-17 2024-03-30T12:35:23.988 INFO:tasks.rados.rados.0.smithi084.stdout:3801: finishing write tid 3 to smithi08477944-17 2024-03-30T12:35:23.988 INFO:tasks.rados.rados.0.smithi084.stdout:3801: oid 17 updating version 0 to 27426 2024-03-30T12:35:23.988 INFO:tasks.rados.rados.0.smithi084.stdout:3801: oid 17 updating version 27426 to 27427 2024-03-30T12:35:23.988 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 27427 (ObjNum 1171 snap 381 seq_num 1171) dirty exists 2024-03-30T12:35:23.988 INFO:tasks.rados.rados.0.smithi084.stdout:3801: left oid 17 (ObjNum 1171 snap 381 seq_num 1171) 2024-03-30T12:35:23.988 INFO:tasks.rados.rados.0.smithi084.stdout:3804: seq_num 1173 ranges {3235840=450560} 2024-03-30T12:35:24.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:23.727+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:24.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:23.727+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:24.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:24.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:24.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[91810]: osdmap e826: 8 total, 8 up, 8 in 2024-03-30T12:35:24.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:24.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:24.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:24.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:24.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:24.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:24.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:24.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:24.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:24.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:24.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:24.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[91810]: pgmap v930: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 7.2 MiB/s rd, 250 KiB/s wr, 8 op/s 2024-03-30T12:35:24.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:24.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:24.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[89279]: osdmap e826: 8 total, 8 up, 8 in 2024-03-30T12:35:24.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:24.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:24.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:24.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:24.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:24.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:24.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:24.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:24.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:24.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:24.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:24.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-mon[89279]: pgmap v930: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 7.2 MiB/s rd, 250 KiB/s wr, 8 op/s 2024-03-30T12:35:24.008 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:23.779+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:24.008 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:23.779+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:24.008 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:23.779+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:24.008 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:23.779+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:24.008 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:23.780+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:24.008 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:23 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:23.780+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:24.009 INFO:tasks.rados.rados.0.smithi084.stdout:3804: writing smithi08477944-20 from 3235840 to 3686400 tid 1 2024-03-30T12:35:24.009 INFO:tasks.rados.rados.0.smithi084.stdout:3801: done (3 left) 2024-03-30T12:35:24.009 INFO:tasks.rados.rados.0.smithi084.stdout:3805: read oid 50 snap -1 2024-03-30T12:35:24.009 INFO:tasks.rados.rados.0.smithi084.stdout:3805: expect deleted 2024-03-30T12:35:24.009 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 381 2024-03-30T12:35:24.010 INFO:tasks.rados.rados.0.smithi084.stdout:3802: finishing write tid 1 to smithi08477944-16 2024-03-30T12:35:24.010 INFO:tasks.rados.rados.0.smithi084.stdout:3802: finishing write tid 2 to smithi08477944-16 2024-03-30T12:35:24.010 INFO:tasks.rados.rados.0.smithi084.stdout:3802: finishing write tid 3 to smithi08477944-16 2024-03-30T12:35:24.010 INFO:tasks.rados.rados.0.smithi084.stdout:3802: oid 16 updating version 0 to 36342 2024-03-30T12:35:24.010 INFO:tasks.rados.rados.0.smithi084.stdout:3802: oid 16 version 36342 is already newer than 36341 2024-03-30T12:35:24.010 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 36342 (ObjNum 1172 snap 381 seq_num 1172) dirty exists 2024-03-30T12:35:24.010 INFO:tasks.rados.rados.0.smithi084.stdout:3802: left oid 16 (ObjNum 1172 snap 381 seq_num 1172) 2024-03-30T12:35:24.010 INFO:tasks.rados.rados.0.smithi084.stdout:3803: expect (ObjNum 1068 snap 347 seq_num 1068) 2024-03-30T12:35:24.070 INFO:tasks.rados.rados.0.smithi084.stdout:3804: finishing write tid 1 to smithi08477944-20 2024-03-30T12:35:24.070 INFO:tasks.rados.rados.0.smithi084.stdout:3804: finishing write tid 2 to smithi08477944-20 2024-03-30T12:35:24.070 INFO:tasks.rados.rados.0.smithi084.stdout:3806: seq_num 1174 ranges {303104=466944} 2024-03-30T12:35:24.073 INFO:tasks.rados.rados.0.smithi084.stdout:3806: writing smithi08477944-22 from 303104 to 770048 tid 1 2024-03-30T12:35:24.074 INFO:tasks.rados.rados.0.smithi084.stdout:3802: done (4 left) 2024-03-30T12:35:24.074 INFO:tasks.rados.rados.0.smithi084.stdout:3803: done (3 left) 2024-03-30T12:35:24.074 INFO:tasks.rados.rados.0.smithi084.stdout:3805: done (2 left) 2024-03-30T12:35:24.074 INFO:tasks.rados.rados.0.smithi084.stdout:3807: read oid 39 snap 375 2024-03-30T12:35:24.074 INFO:tasks.rados.rados.0.smithi084.stdout:3807: expect (ObjNum 1023 snap 328 seq_num 1023) 2024-03-30T12:35:24.074 INFO:tasks.rados.rados.0.smithi084.stdout:3808: read oid 8 snap 371 2024-03-30T12:35:24.074 INFO:tasks.rados.rados.0.smithi084.stdout:3808: expect deleted 2024-03-30T12:35:24.074 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 7 current snap is 381 2024-03-30T12:35:24.074 INFO:tasks.rados.rados.0.smithi084.stdout:3804: finishing write tid 3 to smithi08477944-20 2024-03-30T12:35:24.074 INFO:tasks.rados.rados.0.smithi084.stdout:3804: oid 20 updating version 0 to 36341 2024-03-30T12:35:24.074 INFO:tasks.rados.rados.0.smithi084.stdout:3804: oid 20 updating version 36341 to 36342 2024-03-30T12:35:24.074 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 36342 (ObjNum 1173 snap 381 seq_num 1173) dirty exists 2024-03-30T12:35:24.074 INFO:tasks.rados.rados.0.smithi084.stdout:3804: left oid 20 (ObjNum 1173 snap 381 seq_num 1173) 2024-03-30T12:35:24.075 INFO:tasks.rados.rados.0.smithi084.stdout:3809: seq_num 1175 ranges {3858432=483328} 2024-03-30T12:35:24.097 INFO:tasks.rados.rados.0.smithi084.stdout:3809: writing smithi08477944-7 from 3858432 to 4341760 tid 1 2024-03-30T12:35:24.097 INFO:tasks.rados.rados.0.smithi084.stdout:3804: done (4 left) 2024-03-30T12:35:24.097 INFO:tasks.rados.rados.0.smithi084.stdout:3810: delete oid 1 current snap is 381 2024-03-30T12:35:24.098 INFO:tasks.rados.rados.0.smithi084.stdout:3807: expect (ObjNum 1023 snap 328 seq_num 1023) 2024-03-30T12:35:24.110 INFO:tasks.rados.rados.0.smithi084.stdout:3806: finishing write tid 1 to smithi08477944-22 2024-03-30T12:35:24.110 INFO:tasks.rados.rados.0.smithi084.stdout:3806: finishing write tid 2 to smithi08477944-22 2024-03-30T12:35:24.110 INFO:tasks.rados.rados.0.smithi084.stdout:3806: finishing write tid 3 to smithi08477944-22 2024-03-30T12:35:24.110 INFO:tasks.rados.rados.0.smithi084.stdout:3806: oid 22 updating version 0 to 36334 2024-03-30T12:35:24.110 INFO:tasks.rados.rados.0.smithi084.stdout:3806: oid 22 version 36334 is already newer than 36333 2024-03-30T12:35:24.110 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 36334 (ObjNum 1174 snap 381 seq_num 1174) dirty exists 2024-03-30T12:35:24.110 INFO:tasks.rados.rados.0.smithi084.stdout:3806: left oid 22 (ObjNum 1174 snap 381 seq_num 1174) 2024-03-30T12:35:24.110 INFO:tasks.rados.rados.0.smithi084.stdout:3806: done (4 left) 2024-03-30T12:35:24.111 INFO:tasks.rados.rados.0.smithi084.stdout:3807: done (3 left) 2024-03-30T12:35:24.111 INFO:tasks.rados.rados.0.smithi084.stdout:3808: done (2 left) 2024-03-30T12:35:24.111 INFO:tasks.rados.rados.0.smithi084.stdout:3810: done (1 left) 2024-03-30T12:35:24.111 INFO:tasks.rados.rados.0.smithi084.stdout:3811: setattr oid 24 current snap is 381 2024-03-30T12:35:24.111 INFO:tasks.rados.rados.0.smithi084.stdout:3809: finishing write tid 1 to smithi08477944-7 2024-03-30T12:35:24.111 INFO:tasks.rados.rados.0.smithi084.stdout:3809: finishing write tid 2 to smithi08477944-7 2024-03-30T12:35:24.111 INFO:tasks.rados.rados.0.smithi084.stdout:3809: finishing write tid 3 to smithi08477944-7 2024-03-30T12:35:24.111 INFO:tasks.rados.rados.0.smithi084.stdout:3809: oid 7 updating version 0 to 36343 2024-03-30T12:35:24.111 INFO:tasks.rados.rados.0.smithi084.stdout:3809: oid 7 updating version 36343 to 36344 2024-03-30T12:35:24.111 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 36344 (ObjNum 1175 snap 381 seq_num 1175) dirty exists 2024-03-30T12:35:24.111 INFO:tasks.rados.rados.0.smithi084.stdout:3809: left oid 7 (ObjNum 1175 snap 381 seq_num 1175) 2024-03-30T12:35:24.112 INFO:tasks.rados.rados.0.smithi084.stdout:3809: done (1 left) 2024-03-30T12:35:24.112 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 22 current snap is 381 2024-03-30T12:35:24.112 INFO:tasks.rados.rados.0.smithi084.stdout:3812: seq_num 1177 ranges {770048=516096} 2024-03-30T12:35:24.118 INFO:tasks.rados.rados.0.smithi084.stdout:3812: writing smithi08477944-22 from 770048 to 1286144 tid 1 2024-03-30T12:35:24.118 INFO:tasks.rados.rados.0.smithi084.stdout:3813: rollback oid 34 current snap is 381 2024-03-30T12:35:24.119 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 34 to 378 2024-03-30T12:35:24.119 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 23455 (ObjNum 1153 snap 376 seq_num 1153) dirty exists 2024-03-30T12:35:24.119 INFO:tasks.rados.rados.0.smithi084.stdout:3811: done (2 left) 2024-03-30T12:35:24.119 INFO:tasks.rados.rados.0.smithi084.stdout:3814: delete oid 11 current snap is 381 2024-03-30T12:35:24.121 INFO:tasks.rados.rados.0.smithi084.stdout:3814: done (2 left) 2024-03-30T12:35:24.121 INFO:tasks.rados.rados.0.smithi084.stdout:3815: snap_create 2024-03-30T12:35:24.128 INFO:tasks.rados.rados.0.smithi084.stdout:3813: finishing rollback tid 0 to smithi08477944-34 2024-03-30T12:35:24.129 INFO:tasks.rados.rados.0.smithi084.stdout:3812: finishing write tid 1 to smithi08477944-22 2024-03-30T12:35:24.129 INFO:tasks.rados.rados.0.smithi084.stdout:3813: finishing rollback tid 1 to smithi08477944-34 2024-03-30T12:35:24.129 INFO:tasks.rados.rados.0.smithi084.stdout:3812: finishing write tid 2 to smithi08477944-22 2024-03-30T12:35:24.129 INFO:tasks.rados.rados.0.smithi084.stdout:3813: finishing rollback tid 2 to smithi08477944-34 2024-03-30T12:35:24.129 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 36304 (ObjNum 1157 snap 377 seq_num 1157) dirty exists 2024-03-30T12:35:24.132 INFO:tasks.rados.rados.0.smithi084.stdout:3812: finishing write tid 3 to smithi08477944-22 2024-03-30T12:35:24.132 INFO:tasks.rados.rados.0.smithi084.stdout:3812: oid 22 updating version 0 to 36335 2024-03-30T12:35:24.132 INFO:tasks.rados.rados.0.smithi084.stdout:3812: oid 22 updating version 36335 to 36336 2024-03-30T12:35:24.132 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 36336 (ObjNum 1177 snap 381 seq_num 1177) dirty exists 2024-03-30T12:35:24.132 INFO:tasks.rados.rados.0.smithi084.stdout:3812: left oid 22 (ObjNum 1177 snap 381 seq_num 1177) 2024-03-30T12:35:24.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:23.987+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:24.709 INFO:tasks.rados.rados.0.smithi084.stdout:3812: done (2 left) 2024-03-30T12:35:24.709 INFO:tasks.rados.rados.0.smithi084.stdout:3813: done (1 left) 2024-03-30T12:35:24.709 INFO:tasks.rados.rados.0.smithi084.stdout:3815: done (0 left) 2024-03-30T12:35:24.709 INFO:tasks.rados.rados.0.smithi084.stdout:3816: read oid 10 snap -1 2024-03-30T12:35:24.709 INFO:tasks.rados.rados.0.smithi084.stdout:3816: expect (ObjNum 1161 snap 380 seq_num 1161) 2024-03-30T12:35:24.709 INFO:tasks.rados.rados.0.smithi084.stdout:3817: snap_remove snap 371 2024-03-30T12:35:25.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:24.723+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:25.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:24.723+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:25.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[91810]: osdmap e827: 8 total, 8 up, 8 in 2024-03-30T12:35:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:25.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:25.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:25.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:25.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:25.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:25.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[89279]: osdmap e827: 8 total, 8 up, 8 in 2024-03-30T12:35:25.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:25.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:25.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:25.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:25.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:25.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:25.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:25.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:24 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:25.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:24.723+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:25.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:24.714+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:25.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:24.714+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:25.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:24.714+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:25.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:24.716+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:25.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:24 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:24.716+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:25.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:25.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:25.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:25.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:25.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:24 smithi162 ceph-mon[83709]: osdmap e827: 8 total, 8 up, 8 in 2024-03-30T12:35:25.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:25.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:25.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:25.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:25.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:24 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:25.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:25.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:25.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:24 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:25.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:25.146+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:25.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:25.146+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:25.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:25.146+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:25.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:25.146+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:25.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:25.146+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:25.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:25.215+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:25.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:25.215+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:25.717 INFO:tasks.rados.rados.0.smithi084.stdout:3817: done (1 left) 2024-03-30T12:35:25.717 INFO:tasks.rados.rados.0.smithi084.stdout:3818: read oid 27 snap -1 2024-03-30T12:35:25.718 INFO:tasks.rados.rados.0.smithi084.stdout:3818: expect deleted 2024-03-30T12:35:25.718 INFO:tasks.rados.rados.0.smithi084.stdout:3819: read oid 15 snap 377 2024-03-30T12:35:25.718 INFO:tasks.rados.rados.0.smithi084.stdout:3819: expect (ObjNum 1151 snap 375 seq_num 1151) 2024-03-30T12:35:25.718 INFO:tasks.rados.rados.0.smithi084.stdout:3820: rmattr oid 16 current snap is 382 2024-03-30T12:35:25.718 INFO:tasks.rados.rados.0.smithi084.stdout:3820: done (3 left) 2024-03-30T12:35:25.718 INFO:tasks.rados.rados.0.smithi084.stdout:3821: delete oid 40 current snap is 382 2024-03-30T12:35:25.718 INFO:tasks.rados.rados.0.smithi084.stdout:3816: expect (ObjNum 1161 snap 380 seq_num 1161) 2024-03-30T12:35:25.792 INFO:tasks.rados.rados.0.smithi084.stdout:3819: expect (ObjNum 1151 snap 375 seq_num 1151) 2024-03-30T12:35:25.985 INFO:tasks.rados.rados.0.smithi084.stdout:3816: done (3 left) 2024-03-30T12:35:25.986 INFO:tasks.rados.rados.0.smithi084.stdout:3818: done (2 left) 2024-03-30T12:35:25.986 INFO:tasks.rados.rados.0.smithi084.stdout:3819: done (1 left) 2024-03-30T12:35:25.986 INFO:tasks.rados.rados.0.smithi084.stdout:3821: done (0 left) 2024-03-30T12:35:25.986 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 9 current snap is 382 2024-03-30T12:35:25.986 INFO:tasks.rados.rados.0.smithi084.stdout:3822: seq_num 1180 ranges {196608=565248} 2024-03-30T12:35:25.989 INFO:tasks.rados.rados.0.smithi084.stdout:3822: writing smithi08477944-9 from 196608 to 761856 tid 1 2024-03-30T12:35:25.989 INFO:tasks.rados.rados.0.smithi084.stdout:3823: read oid 38 snap -1 2024-03-30T12:35:25.990 INFO:tasks.rados.rados.0.smithi084.stdout:3823: expect deleted 2024-03-30T12:35:25.990 INFO:tasks.rados.rados.0.smithi084.stdout:3824: rmattr oid 49 current snap is 382 2024-03-30T12:35:25.990 INFO:tasks.rados.rados.0.smithi084.stdout:3824: done (2 left) 2024-03-30T12:35:25.990 INFO:tasks.rados.rados.0.smithi084.stdout:3825: snap_remove snap 353 2024-03-30T12:35:26.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:25.729+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:26.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:25.732+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:26.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:25.723+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:26.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:25.723+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:26.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:25.724+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:26.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:25.724+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:26.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:25.725+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:26.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:25.725+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:26.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:26.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:26.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:26.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:26.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:26.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[91810]: osdmap e828: 8 total, 8 up, 8 in 2024-03-30T12:35:26.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:26.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:26.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:26.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[91810]: pgmap v933: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 8.7 MiB/s rd, 354 KiB/s wr, 18 op/s 2024-03-30T12:35:26.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:35:26.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:26.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:26.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:35:26.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:35:26.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:35:26.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:35:26.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:26.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:26.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:26.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:26.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:26.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[89279]: osdmap e828: 8 total, 8 up, 8 in 2024-03-30T12:35:26.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:26.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:26.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:26.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[89279]: pgmap v933: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 8.7 MiB/s rd, 354 KiB/s wr, 18 op/s 2024-03-30T12:35:26.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:35:26.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:26.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:26.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:35:26.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:35:26.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:35:26.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:25 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:35:26.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:25.955+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:26.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:25.726+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:26.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:25.727+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:26.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:25.725+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:26.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:25.727+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:26.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:25.957+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:26.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:25.957+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:26.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:25.957+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:26.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:26.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:26.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:26.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:26.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:26.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-mon[83709]: osdmap e828: 8 total, 8 up, 8 in 2024-03-30T12:35:26.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:26.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:26.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:26.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-mon[83709]: pgmap v933: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 8.7 MiB/s rd, 354 KiB/s wr, 18 op/s 2024-03-30T12:35:26.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:35:26.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:26.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:26.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:35:26.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:35:26.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:35:26.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:25 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:35:26.728 INFO:tasks.rados.rados.0.smithi084.stdout:3825: done (2 left) 2024-03-30T12:35:26.728 INFO:tasks.rados.rados.0.smithi084.stdout:3826: read oid 6 snap -1 2024-03-30T12:35:26.728 INFO:tasks.rados.rados.0.smithi084.stdout:3826: expect (ObjNum 1162 snap 380 seq_num 1162) 2024-03-30T12:35:26.728 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 35 current snap is 382 2024-03-30T12:35:26.728 INFO:tasks.rados.rados.0.smithi084.stdout:3827: seq_num 1181 ranges {4022272=581632} 2024-03-30T12:35:26.754 INFO:tasks.rados.rados.0.smithi084.stdout:3827: writing smithi08477944-35 from 4022272 to 4603904 tid 1 2024-03-30T12:35:26.754 INFO:tasks.rados.rados.0.smithi084.stdout:3828: read oid 10 snap -1 2024-03-30T12:35:26.754 INFO:tasks.rados.rados.0.smithi084.stdout:3828: expect (ObjNum 1161 snap 380 seq_num 1161) 2024-03-30T12:35:26.754 INFO:tasks.rados.rados.0.smithi084.stdout:3829: read oid 39 snap -1 2024-03-30T12:35:26.754 INFO:tasks.rados.rados.0.smithi084.stdout:3829: expect (ObjNum 1023 snap 328 seq_num 1023) 2024-03-30T12:35:26.754 INFO:tasks.rados.rados.0.smithi084.stdout:3830: setattr oid 29 current snap is 382 2024-03-30T12:35:26.754 INFO:tasks.rados.rados.0.smithi084.stdout:3822: finishing write tid 1 to smithi08477944-9 2024-03-30T12:35:26.754 INFO:tasks.rados.rados.0.smithi084.stdout:3822: finishing write tid 2 to smithi08477944-9 2024-03-30T12:35:26.754 INFO:tasks.rados.rados.0.smithi084.stdout:3822: finishing write tid 3 to smithi08477944-9 2024-03-30T12:35:26.754 INFO:tasks.rados.rados.0.smithi084.stdout:3822: oid 9 updating version 0 to 22538 2024-03-30T12:35:26.754 INFO:tasks.rados.rados.0.smithi084.stdout:3822: oid 9 version 22538 is already newer than 22537 2024-03-30T12:35:26.755 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 22538 (ObjNum 1180 snap 382 seq_num 1180) dirty exists 2024-03-30T12:35:26.755 INFO:tasks.rados.rados.0.smithi084.stdout:3822: left oid 9 (ObjNum 1180 snap 382 seq_num 1180) 2024-03-30T12:35:26.755 INFO:tasks.rados.rados.0.smithi084.stdout:3826: expect (ObjNum 1162 snap 380 seq_num 1162) 2024-03-30T12:35:26.762 INFO:tasks.rados.rados.0.smithi084.stdout:3829: expect (ObjNum 1023 snap 328 seq_num 1023) 2024-03-30T12:35:26.773 INFO:tasks.rados.rados.0.smithi084.stdout:3827: finishing write tid 1 to smithi08477944-35 2024-03-30T12:35:26.773 INFO:tasks.rados.rados.0.smithi084.stdout:3827: finishing write tid 2 to smithi08477944-35 2024-03-30T12:35:26.773 INFO:tasks.rados.rados.0.smithi084.stdout:3827: finishing write tid 3 to smithi08477944-35 2024-03-30T12:35:26.773 INFO:tasks.rados.rados.0.smithi084.stdout:3827: oid 35 updating version 0 to 36329 2024-03-30T12:35:26.773 INFO:tasks.rados.rados.0.smithi084.stdout:3827: oid 35 updating version 36329 to 36330 2024-03-30T12:35:26.773 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 36330 (ObjNum 1181 snap 382 seq_num 1181) dirty exists 2024-03-30T12:35:26.773 INFO:tasks.rados.rados.0.smithi084.stdout:3827: left oid 35 (ObjNum 1181 snap 382 seq_num 1181) 2024-03-30T12:35:26.773 INFO:tasks.rados.rados.0.smithi084.stdout:3828: expect (ObjNum 1161 snap 380 seq_num 1161) 2024-03-30T12:35:26.840 INFO:tasks.rados.rados.0.smithi084.stdout:3822: done (6 left) 2024-03-30T12:35:26.841 INFO:tasks.rados.rados.0.smithi084.stdout:3823: done (5 left) 2024-03-30T12:35:26.841 INFO:tasks.rados.rados.0.smithi084.stdout:3826: done (4 left) 2024-03-30T12:35:26.841 INFO:tasks.rados.rados.0.smithi084.stdout:3827: done (3 left) 2024-03-30T12:35:26.841 INFO:tasks.rados.rados.0.smithi084.stdout:3828: done (2 left) 2024-03-30T12:35:26.841 INFO:tasks.rados.rados.0.smithi084.stdout:3829: done (1 left) 2024-03-30T12:35:26.841 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 13 current snap is 382 2024-03-30T12:35:26.841 INFO:tasks.rados.rados.0.smithi084.stdout:3831: seq_num 1182 ranges {9691136=606208} 2024-03-30T12:35:26.895 INFO:tasks.rados.rados.0.smithi084.stdout:3831: writing smithi08477944-13 from 9691136 to 10297344 tid 1 2024-03-30T12:35:26.895 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 28 current snap is 382 2024-03-30T12:35:26.895 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 36342 (ObjNum 129 snap 0 seq_num 1428998528) dirty exists 2024-03-30T12:35:26.895 INFO:tasks.rados.rados.0.smithi084.stdout:3832: seq_num 1183 ranges {0=622592} 2024-03-30T12:35:26.898 INFO:tasks.rados.rados.0.smithi084.stdout:3832: writing smithi08477944-28 from 0 to 622592 tid 1 2024-03-30T12:35:26.898 INFO:tasks.rados.rados.0.smithi084.stdout:3830: done (2 left) 2024-03-30T12:35:26.898 INFO:tasks.rados.rados.0.smithi084.stdout:3833: copy_from oid 15 from oid 25 current snap is 382 2024-03-30T12:35:26.898 INFO:tasks.rados.rados.0.smithi084.stdout:3834: copy_from oid 36 from oid 1 current snap is 382 2024-03-30T12:35:26.898 INFO:tasks.rados.rados.0.smithi084.stdout:3835: read oid 6 snap -1 2024-03-30T12:35:26.898 INFO:tasks.rados.rados.0.smithi084.stdout:3835: expect (ObjNum 1162 snap 380 seq_num 1162) 2024-03-30T12:35:26.898 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 382 2024-03-30T12:35:26.898 INFO:tasks.rados.rados.0.smithi084.stdout:3836: seq_num 1184 ranges {3039232=638976} 2024-03-30T12:35:26.920 INFO:tasks.rados.rados.0.smithi084.stdout:3836: writing smithi08477944-45 from 3039232 to 3678208 tid 1 2024-03-30T12:35:26.920 INFO:tasks.rados.rados.0.smithi084.stdout:3837: rollback oid 22 current snap is 382 2024-03-30T12:35:26.920 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 22 to 378 2024-03-30T12:35:26.920 INFO:tasks.rados.rados.0.smithi084.stdout:3834: finishing copy_from to smithi08477944-36 2024-03-30T12:35:26.921 INFO:tasks.rados.rados.0.smithi084.stdout:3834: got expected ENOENT (src dne) 2024-03-30T12:35:26.921 INFO:tasks.rados.rados.0.smithi084.stdout:3834: finishing copy_from racing read to smithi08477944-36 2024-03-30T12:35:26.921 INFO:tasks.rados.rados.0.smithi084.stdout:3832: finishing write tid 1 to smithi08477944-28 2024-03-30T12:35:26.921 INFO:tasks.rados.rados.0.smithi084.stdout:3834: done (6 left) 2024-03-30T12:35:26.921 INFO:tasks.rados.rados.0.smithi084.stdout:3838: rmattr oid 31 current snap is 382 2024-03-30T12:35:26.922 INFO:tasks.rados.rados.0.smithi084.stdout:3838: done (6 left) 2024-03-30T12:35:26.922 INFO:tasks.rados.rados.0.smithi084.stdout:3839: copy_from oid 21 from oid 19 current snap is 382 2024-03-30T12:35:26.922 INFO:tasks.rados.rados.0.smithi084.stdout:3832: finishing write tid 2 to smithi08477944-28 2024-03-30T12:35:26.922 INFO:tasks.rados.rados.0.smithi084.stdout:3835: expect (ObjNum 1162 snap 380 seq_num 1162) 2024-03-30T12:35:26.930 INFO:tasks.rados.rados.0.smithi084.stdout:3832: finishing write tid 3 to smithi08477944-28 2024-03-30T12:35:26.930 INFO:tasks.rados.rados.0.smithi084.stdout:3832: oid 28 updating version 0 to 36344 2024-03-30T12:35:26.930 INFO:tasks.rados.rados.0.smithi084.stdout:3832: oid 28 version 36344 is already newer than 36343 2024-03-30T12:35:26.930 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 36344 (ObjNum 1183 snap 382 seq_num 1183) dirty exists 2024-03-30T12:35:26.930 INFO:tasks.rados.rados.0.smithi084.stdout:3832: left oid 28 (ObjNum 1183 snap 382 seq_num 1183) 2024-03-30T12:35:26.930 INFO:tasks.rados.rados.0.smithi084.stdout:3831: finishing write tid 1 to smithi08477944-13 2024-03-30T12:35:26.930 INFO:tasks.rados.rados.0.smithi084.stdout:3832: done (6 left) 2024-03-30T12:35:26.930 INFO:tasks.rados.rados.0.smithi084.stdout:3835: done (5 left) 2024-03-30T12:35:26.930 INFO:tasks.rados.rados.0.smithi084.stdout:3840: rollback oid 49 current snap is 382 2024-03-30T12:35:26.930 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 49 to 379 2024-03-30T12:35:26.930 INFO:tasks.rados.rados.0.smithi084.stdout:3831: finishing write tid 2 to smithi08477944-13 2024-03-30T12:35:26.930 INFO:tasks.rados.rados.0.smithi084.stdout:3833: finishing copy_from racing read to smithi08477944-15 2024-03-30T12:35:26.931 INFO:tasks.rados.rados.0.smithi084.stdout:3833: finishing copy_from to smithi08477944-15 2024-03-30T12:35:26.931 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 27312 (ObjNum 1105 snap 362 seq_num 1105) dirty exists 2024-03-30T12:35:26.931 INFO:tasks.rados.rados.0.smithi084.stdout:3831: finishing write tid 3 to smithi08477944-13 2024-03-30T12:35:26.931 INFO:tasks.rados.rados.0.smithi084.stdout:3831: oid 13 updating version 0 to 23456 2024-03-30T12:35:26.931 INFO:tasks.rados.rados.0.smithi084.stdout:3831: oid 13 updating version 23456 to 23457 2024-03-30T12:35:26.931 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 13 v 23457 (ObjNum 1182 snap 382 seq_num 1182) dirty exists 2024-03-30T12:35:26.931 INFO:tasks.rados.rados.0.smithi084.stdout:3831: left oid 13 (ObjNum 1182 snap 382 seq_num 1182) 2024-03-30T12:35:26.931 INFO:tasks.rados.rados.0.smithi084.stdout:3831: done (5 left) 2024-03-30T12:35:26.931 INFO:tasks.rados.rados.0.smithi084.stdout:3833: done (4 left) 2024-03-30T12:35:26.931 INFO:tasks.rados.rados.0.smithi084.stdout:3841: snap_create 2024-03-30T12:35:26.931 INFO:tasks.rados.rados.0.smithi084.stdout:3836: finishing write tid 1 to smithi08477944-45 2024-03-30T12:35:26.932 INFO:tasks.rados.rados.0.smithi084.stdout:3836: finishing write tid 2 to smithi08477944-45 2024-03-30T12:35:26.932 INFO:tasks.rados.rados.0.smithi084.stdout:3836: finishing write tid 3 to smithi08477944-45 2024-03-30T12:35:26.932 INFO:tasks.rados.rados.0.smithi084.stdout:3836: oid 45 updating version 0 to 36343 2024-03-30T12:35:26.932 INFO:tasks.rados.rados.0.smithi084.stdout:3836: oid 45 updating version 36343 to 36344 2024-03-30T12:35:26.932 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 36344 (ObjNum 1184 snap 382 seq_num 1184) dirty exists 2024-03-30T12:35:26.932 INFO:tasks.rados.rados.0.smithi084.stdout:3836: left oid 45 (ObjNum 1184 snap 382 seq_num 1184) 2024-03-30T12:35:26.932 INFO:tasks.rados.rados.0.smithi084.stdout:3839: finishing copy_from racing read to smithi08477944-21 2024-03-30T12:35:26.932 INFO:tasks.rados.rados.0.smithi084.stdout:3839: finishing copy_from to smithi08477944-21 2024-03-30T12:35:26.932 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 36404 (ObjNum 1149 snap 375 seq_num 1149) dirty exists 2024-03-30T12:35:26.932 INFO:tasks.rados.rados.0.smithi084.stdout:3837: finishing rollback tid 0 to smithi08477944-22 2024-03-30T12:35:26.932 INFO:tasks.rados.rados.0.smithi084.stdout:3837: finishing rollback tid 1 to smithi08477944-22 2024-03-30T12:35:26.932 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 36338 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-03-30T12:35:26.933 INFO:tasks.rados.rados.0.smithi084.stdout:3840: finishing rollback tid 0 to smithi08477944-49 2024-03-30T12:35:26.933 INFO:tasks.rados.rados.0.smithi084.stdout:3840: finishing rollback tid 1 to smithi08477944-49 2024-03-30T12:35:26.933 INFO:tasks.rados.rados.0.smithi084.stdout:3840: finishing rollback tid 2 to smithi08477944-49 2024-03-30T12:35:26.933 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 36343 (ObjNum 1021 snap 328 seq_num 1021) dirty exists 2024-03-30T12:35:27.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:26.747+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:27.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:26.748+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:27.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:27.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:27.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:27.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:27.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:27.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:27.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:27.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:27.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[89279]: osdmap e829: 8 total, 8 up, 8 in 2024-03-30T12:35:27.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:27.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:27.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:27.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:27.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:27.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:26.735+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:27.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:26.735+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:27.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:26.736+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:27.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:26.736+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:27.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:26.736+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:27.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:27.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:27.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:27.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:35:27.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:35:27.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:35:27.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:27.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:27.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:27.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:27.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:27.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:27.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:27.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:27.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[91810]: osdmap e829: 8 total, 8 up, 8 in 2024-03-30T12:35:27.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:27.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:27.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:27.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:27.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:27.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:27.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:27.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:27.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:35:27.009 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:35:27.009 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:26 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:35:27.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:26.734+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:27.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:26.739+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:27.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:26.739+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:27.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:26.742+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:27.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:26.735+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:27.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:26.736+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:27.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:26.853+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:27.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:26.853+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:27.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:27.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:27.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:27.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:27.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:27.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:27.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:27.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:27.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-mon[83709]: osdmap e829: 8 total, 8 up, 8 in 2024-03-30T12:35:27.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:27.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:27.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:27.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:27.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:27.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:27.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:27.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:27.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:35:27.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:35:27.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:26 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:35:27.736 INFO:tasks.rados.rados.0.smithi084.stdout:3836: done (4 left) 2024-03-30T12:35:27.736 INFO:tasks.rados.rados.0.smithi084.stdout:3837: done (3 left) 2024-03-30T12:35:27.736 INFO:tasks.rados.rados.0.smithi084.stdout:3839: done (2 left) 2024-03-30T12:35:27.736 INFO:tasks.rados.rados.0.smithi084.stdout:3840: done (1 left) 2024-03-30T12:35:27.736 INFO:tasks.rados.rados.0.smithi084.stdout:3841: done (0 left) 2024-03-30T12:35:27.736 INFO:tasks.rados.rados.0.smithi084.stdout:3842: rollback oid 29 current snap is 383 2024-03-30T12:35:27.736 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 29 to 379 2024-03-30T12:35:27.736 INFO:tasks.rados.rados.0.smithi084.stdout:3843: snap_remove snap 380 2024-03-30T12:35:28.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:27.749+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:28.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:27.749+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:28.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:28.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[89279]: osdmap e830: 8 total, 8 up, 8 in 2024-03-30T12:35:28.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:28.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:28.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:28.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:28.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:28.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:28.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:28.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:28.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:28.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:28.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:27.743+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:28.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:27.743+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:28.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:27.743+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:28.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:27.743+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:28.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:27.743+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:28.005 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:27.743+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:28.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:28.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[91810]: osdmap e830: 8 total, 8 up, 8 in 2024-03-30T12:35:28.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:28.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:28.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:28.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:28.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:28.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:28.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:28.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:28.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:28.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:28.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:28.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[89279]: pgmap v936: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 12 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2024-03-30T12:35:28.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:28.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:28.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:28.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[91810]: pgmap v936: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 12 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2024-03-30T12:35:28.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:28.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:27 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:28.107 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:27.742+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:28.107 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:27.742+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:28.107 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:27.743+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:28.108 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:27.743+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:28.108 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:27.748+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:28.108 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:27.748+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:28.108 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:27 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:27.749+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:28.108 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:28.108 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:27 smithi162 ceph-mon[83709]: osdmap e830: 8 total, 8 up, 8 in 2024-03-30T12:35:28.109 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:28.109 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:28.109 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:28.109 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:28.109 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:28.109 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:28.109 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:28.109 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:28.109 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:28.109 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:28.109 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:27 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:28.109 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:27 smithi162 ceph-mon[83709]: pgmap v936: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 12 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2024-03-30T12:35:28.109 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b6=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:28.109 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:27 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:28.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:28.115+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:28.744 INFO:tasks.rados.rados.0.smithi084.stdout:3843: done (1 left) 2024-03-30T12:35:28.744 INFO:tasks.rados.rados.0.smithi084.stdout:3844: read oid 42 snap 372 2024-03-30T12:35:28.745 INFO:tasks.rados.rados.0.smithi084.stdout:3844: expect (ObjNum 1133 snap 372 seq_num 1133) 2024-03-30T12:35:28.745 INFO:tasks.rados.rados.0.smithi084.stdout:3845: snap_remove snap 378 2024-03-30T12:35:29.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:28.757+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:29.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:28.764+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[91810]: osdmap e831: 8 total, 8 up, 8 in 2024-03-30T12:35:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:29.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:29.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:29.005 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:29.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:29.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:29.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:29.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:29.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:29.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:29.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:29.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:29.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[89279]: osdmap e831: 8 total, 8 up, 8 in 2024-03-30T12:35:29.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:29.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:29.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:29.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:28 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:29.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:28.752+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:29.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:28.752+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:29.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:28.748+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:29.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:28.748+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:29.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:28.748+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:29.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:29.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:29.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:29.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:29.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:29.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:29.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:29.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:29.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:28 smithi162 ceph-mon[83709]: osdmap e831: 8 total, 8 up, 8 in 2024-03-30T12:35:29.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:29.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:28 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:29.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:29.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:28 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:29.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:35:29] "GET /metrics HTTP/1.1" 200 36328 "" "Prometheus/2.43.0" 2024-03-30T12:35:29.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:29.217+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:29.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:29.217+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:29.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:29.217+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:29.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:29.218+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:29.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:29.218+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:29.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:29.216+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:29.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:29.217+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:29.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:29.217+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:29.748 INFO:tasks.rados.rados.0.smithi084.stdout:3842: finishing rollback tid 0 to smithi08477944-29 2024-03-30T12:35:29.749 INFO:tasks.rados.rados.0.smithi084.stdout:3842: finishing rollback tid 1 to smithi08477944-29 2024-03-30T12:35:29.749 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 36346 (ObjNum 65 snap 0 seq_num 1632920688) dirty dne 2024-03-30T12:35:29.749 INFO:tasks.rados.rados.0.smithi084.stdout:3844: expect (ObjNum 1133 snap 372 seq_num 1133) 2024-03-30T12:35:29.806 INFO:tasks.rados.rados.0.smithi084.stdout:3842: done (2 left) 2024-03-30T12:35:29.806 INFO:tasks.rados.rados.0.smithi084.stdout:3844: done (1 left) 2024-03-30T12:35:29.807 INFO:tasks.rados.rados.0.smithi084.stdout:3845: done (0 left) 2024-03-30T12:35:29.807 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 40 current snap is 383 2024-03-30T12:35:29.807 INFO:tasks.rados.rados.0.smithi084.stdout:3846: seq_num 1185 ranges {0=655360} 2024-03-30T12:35:29.810 INFO:tasks.rados.rados.0.smithi084.stdout:3846: writing smithi08477944-40 from 0 to 655360 tid 1 2024-03-30T12:35:29.810 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 3 current snap is 383 2024-03-30T12:35:29.810 INFO:tasks.rados.rados.0.smithi084.stdout:3847: seq_num 1186 ranges {3235840=671744} 2024-03-30T12:35:29.831 INFO:tasks.rados.rados.0.smithi084.stdout:3847: writing smithi08477944-3 from 3235840 to 3907584 tid 1 2024-03-30T12:35:29.831 INFO:tasks.rados.rados.0.smithi084.stdout:3848: read oid 11 snap 369 2024-03-30T12:35:29.831 INFO:tasks.rados.rados.0.smithi084.stdout:3848: expect (ObjNum 1068 snap 347 seq_num 1068) 2024-03-30T12:35:29.831 INFO:tasks.rados.rados.0.smithi084.stdout:3849: delete oid 14 current snap is 383 2024-03-30T12:35:29.832 INFO:tasks.rados.rados.0.smithi084.stdout:3846: finishing write tid 1 to smithi08477944-40 2024-03-30T12:35:29.832 INFO:tasks.rados.rados.0.smithi084.stdout:3846: finishing write tid 2 to smithi08477944-40 2024-03-30T12:35:29.832 INFO:tasks.rados.rados.0.smithi084.stdout:3846: finishing write tid 3 to smithi08477944-40 2024-03-30T12:35:29.832 INFO:tasks.rados.rados.0.smithi084.stdout:3846: oid 40 updating version 0 to 36346 2024-03-30T12:35:29.832 INFO:tasks.rados.rados.0.smithi084.stdout:3846: oid 40 version 36346 is already newer than 36345 2024-03-30T12:35:29.832 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 36346 (ObjNum 1185 snap 383 seq_num 1185) dirty exists 2024-03-30T12:35:29.832 INFO:tasks.rados.rados.0.smithi084.stdout:3846: left oid 40 (ObjNum 1185 snap 383 seq_num 1185) 2024-03-30T12:35:29.843 INFO:tasks.rados.rados.0.smithi084.stdout:3846: done (3 left) 2024-03-30T12:35:29.843 INFO:tasks.rados.rados.0.smithi084.stdout:3849: done (2 left) 2024-03-30T12:35:29.844 INFO:tasks.rados.rados.0.smithi084.stdout:3850: delete oid 42 current snap is 383 2024-03-30T12:35:29.844 INFO:tasks.rados.rados.0.smithi084.stdout:3847: finishing write tid 1 to smithi08477944-3 2024-03-30T12:35:29.844 INFO:tasks.rados.rados.0.smithi084.stdout:3847: finishing write tid 2 to smithi08477944-3 2024-03-30T12:35:29.845 INFO:tasks.rados.rados.0.smithi084.stdout:3848: expect (ObjNum 1068 snap 347 seq_num 1068) 2024-03-30T12:35:29.905 INFO:tasks.rados.rados.0.smithi084.stdout:3847: finishing write tid 3 to smithi08477944-3 2024-03-30T12:35:29.905 INFO:tasks.rados.rados.0.smithi084.stdout:3847: oid 3 updating version 0 to 36340 2024-03-30T12:35:29.905 INFO:tasks.rados.rados.0.smithi084.stdout:3847: oid 3 version 36340 is already newer than 36339 2024-03-30T12:35:29.905 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 3 v 36340 (ObjNum 1186 snap 383 seq_num 1186) dirty exists 2024-03-30T12:35:29.905 INFO:tasks.rados.rados.0.smithi084.stdout:3847: left oid 3 (ObjNum 1186 snap 383 seq_num 1186) 2024-03-30T12:35:29.905 INFO:tasks.rados.rados.0.smithi084.stdout:3847: done (2 left) 2024-03-30T12:35:29.905 INFO:tasks.rados.rados.0.smithi084.stdout:3848: done (1 left) 2024-03-30T12:35:29.905 INFO:tasks.rados.rados.0.smithi084.stdout:3850: done (0 left) 2024-03-30T12:35:29.906 INFO:tasks.rados.rados.0.smithi084.stdout:3851: delete oid 32 current snap is 383 2024-03-30T12:35:29.908 INFO:tasks.rados.rados.0.smithi084.stdout:3851: done (0 left) 2024-03-30T12:35:29.908 INFO:tasks.rados.rados.0.smithi084.stdout:3852: read oid 35 snap 340 2024-03-30T12:35:29.908 INFO:tasks.rados.rados.0.smithi084.stdout:3852: expect (ObjNum 1045 snap 334 seq_num 1045) 2024-03-30T12:35:29.908 INFO:tasks.rados.rados.0.smithi084.stdout:3853: rollback oid 18 current snap is 383 2024-03-30T12:35:29.908 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 18 to 368 2024-03-30T12:35:29.908 INFO:tasks.rados.rados.0.smithi084.stdout:3854: setattr oid 20 current snap is 383 2024-03-30T12:35:29.909 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 383 2024-03-30T12:35:29.909 INFO:tasks.rados.rados.0.smithi084.stdout:3855: seq_num 1190 ranges {3678208=737280} 2024-03-30T12:35:29.934 INFO:tasks.rados.rados.0.smithi084.stdout:3855: writing smithi08477944-45 from 3678208 to 4415488 tid 1 2024-03-30T12:35:29.934 INFO:tasks.rados.rados.0.smithi084.stdout:3856: read oid 8 snap 369 2024-03-30T12:35:29.934 INFO:tasks.rados.rados.0.smithi084.stdout:3856: expect deleted 2024-03-30T12:35:29.934 INFO:tasks.rados.rados.0.smithi084.stdout:3857: snap_create 2024-03-30T12:35:29.934 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 36347 (ObjNum 1173 snap 381 seq_num 1173) dirty exists 2024-03-30T12:35:29.934 INFO:tasks.rados.rados.0.smithi084.stdout:3853: finishing rollback tid 0 to smithi08477944-18 2024-03-30T12:35:29.935 INFO:tasks.rados.rados.0.smithi084.stdout:3853: finishing rollback tid 1 to smithi08477944-18 2024-03-30T12:35:29.935 INFO:tasks.rados.rados.0.smithi084.stdout:3853: finishing rollback tid 2 to smithi08477944-18 2024-03-30T12:35:29.935 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 36347 (ObjNum 825 snap 273 seq_num 825) dirty exists 2024-03-30T12:35:29.935 INFO:tasks.rados.rados.0.smithi084.stdout:3852: expect (ObjNum 1045 snap 334 seq_num 1045) 2024-03-30T12:35:30.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:29.760+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:30.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:29.760+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:30.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:29.754+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:30.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:29.754+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:30.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:29.755+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:30.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:29.755+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:30.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:29.756+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:30.006 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:29.757+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:30.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:30.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:30.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:30.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:30.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:30.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-mon[91810]: osdmap e832: 8 total, 8 up, 8 in 2024-03-30T12:35:30.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:30.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:30.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-mon[91810]: pgmap v939: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 3.7 MiB/s rd, 2.4 MiB/s wr, 32 op/s 2024-03-30T12:35:30.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:30.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:30.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:35:30.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:30.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:30.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:30.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:30.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:30.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-mon[89279]: osdmap e832: 8 total, 8 up, 8 in 2024-03-30T12:35:30.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:30.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:30.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-mon[89279]: pgmap v939: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 3.7 MiB/s rd, 2.4 MiB/s wr, 32 op/s 2024-03-30T12:35:30.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:30.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:30.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:29 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:35:30.017 INFO:tasks.rados.rados.0.smithi084.stdout:3855: finishing write tid 1 to smithi08477944-45 2024-03-30T12:35:30.017 INFO:tasks.rados.rados.0.smithi084.stdout:3855: finishing write tid 2 to smithi08477944-45 2024-03-30T12:35:30.017 INFO:tasks.rados.rados.0.smithi084.stdout:3855: finishing write tid 3 to smithi08477944-45 2024-03-30T12:35:30.017 INFO:tasks.rados.rados.0.smithi084.stdout:3855: oid 45 updating version 0 to 36348 2024-03-30T12:35:30.017 INFO:tasks.rados.rados.0.smithi084.stdout:3855: oid 45 updating version 36348 to 36349 2024-03-30T12:35:30.017 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 36349 (ObjNum 1190 snap 383 seq_num 1190) dirty exists 2024-03-30T12:35:30.018 INFO:tasks.rados.rados.0.smithi084.stdout:3855: left oid 45 (ObjNum 1190 snap 383 seq_num 1190) 2024-03-30T12:35:30.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:29.851+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:30.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:29.753+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:30.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:29.753+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:30.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:29.844+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:30.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:29.852+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:30.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:29.760+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:30.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:29.760+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:30.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:29 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:29.760+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:30.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:30.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:30.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:30.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:30.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:30.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:29 smithi162 ceph-mon[83709]: osdmap e832: 8 total, 8 up, 8 in 2024-03-30T12:35:30.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:30.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:29 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:30.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:29 smithi162 ceph-mon[83709]: pgmap v939: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 3.7 MiB/s rd, 2.4 MiB/s wr, 32 op/s 2024-03-30T12:35:30.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:30.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:29 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:30.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:29 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:35:30.753 INFO:tasks.rados.rados.0.smithi084.stdout:3852: done (5 left) 2024-03-30T12:35:30.753 INFO:tasks.rados.rados.0.smithi084.stdout:3853: done (4 left) 2024-03-30T12:35:30.753 INFO:tasks.rados.rados.0.smithi084.stdout:3854: done (3 left) 2024-03-30T12:35:30.753 INFO:tasks.rados.rados.0.smithi084.stdout:3855: done (2 left) 2024-03-30T12:35:30.753 INFO:tasks.rados.rados.0.smithi084.stdout:3856: done (1 left) 2024-03-30T12:35:30.753 INFO:tasks.rados.rados.0.smithi084.stdout:3857: done (0 left) 2024-03-30T12:35:30.753 INFO:tasks.rados.rados.0.smithi084.stdout:3858: rollback oid 41 current snap is 384 2024-03-30T12:35:30.753 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 41 to 381 2024-03-30T12:35:30.753 INFO:tasks.rados.rados.0.smithi084.stdout:3859: snap_remove snap 382 2024-03-30T12:35:31.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:30.943+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:31.003 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:30.944+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:31.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:30.760+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:31.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:30.760+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:31.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:30.761+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:31.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:30.761+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:31.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:30.761+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:31.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:31.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:31.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:31.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:31.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:31.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:31.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:31.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:31.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:31.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[89279]: osdmap e833: 8 total, 8 up, 8 in 2024-03-30T12:35:31.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:31.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:31.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:31.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:31.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:31.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:31.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:31.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:31.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:31.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:31.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:31.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:31.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:31.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[91810]: osdmap e833: 8 total, 8 up, 8 in 2024-03-30T12:35:31.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:31.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:31.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:31.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:31.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:31.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:31.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:31.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:31.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:31.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:31.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:31.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:31.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:31.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:30 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:31.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:30.942+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:31.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:30.770+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:31.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:30.770+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:31.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:30.762+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:31.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:30.763+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:31.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:30.763+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:31.121 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:30.761+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:31.121 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:30.764+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:31.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:31.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:31.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:31.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:31.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:31.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:31.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:31.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:31.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:31.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-mon[83709]: osdmap e833: 8 total, 8 up, 8 in 2024-03-30T12:35:31.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:31.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:31.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:31.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:31.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:31.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b1=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:31.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:31.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:31.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:30 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:31.767 INFO:tasks.rados.rados.0.smithi084.stdout:3859: done (1 left) 2024-03-30T12:35:31.767 INFO:tasks.rados.rados.0.smithi084.stdout:3860: read oid 6 snap -1 2024-03-30T12:35:31.767 INFO:tasks.rados.rados.0.smithi084.stdout:3860: expect (ObjNum 1162 snap 380 seq_num 1162) 2024-03-30T12:35:31.767 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 14 current snap is 384 2024-03-30T12:35:31.767 INFO:tasks.rados.rados.0.smithi084.stdout:3858: finishing rollback tid 0 to smithi08477944-41 2024-03-30T12:35:31.767 INFO:tasks.rados.rados.0.smithi084.stdout:3861: seq_num 1191 ranges {0=753664} 2024-03-30T12:35:31.771 INFO:tasks.rados.rados.0.smithi084.stdout:3861: writing smithi08477944-14 from 0 to 753664 tid 1 2024-03-30T12:35:31.771 INFO:tasks.rados.rados.0.smithi084.stdout:3862: snap_create 2024-03-30T12:35:31.771 INFO:tasks.rados.rados.0.smithi084.stdout:3858: finishing rollback tid 1 to smithi08477944-41 2024-03-30T12:35:31.771 INFO:tasks.rados.rados.0.smithi084.stdout:3858: finishing rollback tid 2 to smithi08477944-41 2024-03-30T12:35:31.771 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 36352 (ObjNum 1052 snap 337 seq_num 1052) dirty exists 2024-03-30T12:35:31.771 INFO:tasks.rados.rados.0.smithi084.stdout:3860: expect (ObjNum 1162 snap 380 seq_num 1162) 2024-03-30T12:35:31.782 INFO:tasks.rados.rados.0.smithi084.stdout:3861: finishing write tid 1 to smithi08477944-14 2024-03-30T12:35:31.783 INFO:tasks.rados.rados.0.smithi084.stdout:3861: finishing write tid 2 to smithi08477944-14 2024-03-30T12:35:31.786 INFO:tasks.rados.rados.0.smithi084.stdout:3861: finishing write tid 3 to smithi08477944-14 2024-03-30T12:35:31.786 INFO:tasks.rados.rados.0.smithi084.stdout:3861: oid 14 updating version 0 to 36338 2024-03-30T12:35:31.786 INFO:tasks.rados.rados.0.smithi084.stdout:3861: oid 14 version 36338 is already newer than 36337 2024-03-30T12:35:31.786 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 36338 (ObjNum 1191 snap 384 seq_num 1191) dirty exists 2024-03-30T12:35:31.786 INFO:tasks.rados.rados.0.smithi084.stdout:3861: left oid 14 (ObjNum 1191 snap 384 seq_num 1191) 2024-03-30T12:35:32.035 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:31.787+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:32.035 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:31.787+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:32.036 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:32.036 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:32.036 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:32.036 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:32.036 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[91810]: osdmap e834: 8 total, 8 up, 8 in 2024-03-30T12:35:32.036 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:32.036 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:32.036 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:32.037 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:32.037 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:32.037 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:32.037 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[91810]: pgmap v942: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 23 op/s 2024-03-30T12:35:32.037 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:32.037 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:32.037 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:32.037 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:32.037 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:32.038 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[89279]: osdmap e834: 8 total, 8 up, 8 in 2024-03-30T12:35:32.038 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:32.038 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:32.038 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:32.038 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:32.038 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:32.038 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:32.038 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[89279]: pgmap v942: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 23 op/s 2024-03-30T12:35:32.038 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:31 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:32.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:31.792+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:32.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:31.771+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:32.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:31.772+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:32.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:31.786+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:32.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:31.786+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:32.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:31.787+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:32.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:31.773+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:32.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:31.774+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:32.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:32.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:32.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:32.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:31 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:32.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:31 smithi162 ceph-mon[83709]: osdmap e834: 8 total, 8 up, 8 in 2024-03-30T12:35:32.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:32.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:32.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:32.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:32.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:32.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:32.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:31 smithi162 ceph-mon[83709]: pgmap v942: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 23 op/s 2024-03-30T12:35:32.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:31 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:32.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:32.043+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:32.503 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:32.043+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:32.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:32.043+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:32.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:32.044+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:32.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:32.044+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:32.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:32.044+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:32.768 INFO:tasks.rados.rados.0.smithi084.stdout:3858: done (3 left) 2024-03-30T12:35:32.768 INFO:tasks.rados.rados.0.smithi084.stdout:3860: done (2 left) 2024-03-30T12:35:32.768 INFO:tasks.rados.rados.0.smithi084.stdout:3861: done (1 left) 2024-03-30T12:35:32.768 INFO:tasks.rados.rados.0.smithi084.stdout:3862: done (0 left) 2024-03-30T12:35:32.768 INFO:tasks.rados.rados.0.smithi084.stdout:3863: read oid 5 snap -1 2024-03-30T12:35:32.769 INFO:tasks.rados.rados.0.smithi084.stdout:3863: expect (ObjNum 1142 snap 374 seq_num 1142) 2024-03-30T12:35:32.769 INFO:tasks.rados.rados.0.smithi084.stdout:3864: snap_create 2024-03-30T12:35:32.781 INFO:tasks.rados.rados.0.smithi084.stdout:3863: expect (ObjNum 1142 snap 374 seq_num 1142) 2024-03-30T12:35:33.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:32.775+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:33.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:32.775+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:33.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:32.770+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:33.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:32.770+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:33.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:32.771+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:33.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:33.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:33.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:33.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:33.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:33.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:33.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:32 smithi162 ceph-mon[83709]: osdmap e835: 8 total, 8 up, 8 in 2024-03-30T12:35:33.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:33.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:33.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:32 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:33.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:33.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:32 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:33.228 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:33.228 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:33.228 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:33.228 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:33.228 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:33.228 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:33.228 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-mon[91810]: osdmap e835: 8 total, 8 up, 8 in 2024-03-30T12:35:33.229 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:33.229 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:33.229 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:33.229 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:33.229 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:33.229 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:33.229 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:33.230 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:33.230 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:33.230 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:33.230 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:33.230 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-mon[89279]: osdmap e835: 8 total, 8 up, 8 in 2024-03-30T12:35:33.230 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:33.230 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:33.230 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:33.230 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:33.230 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:33.231 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:32.775+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:33.231 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:32.775+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:33.231 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:32.776+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:33.231 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:32.776+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:33.231 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:32 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:32.776+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:33.231 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:33.236+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:33.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:33.236+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:33.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:33.447+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:33.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:33.346+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:33.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:33.347+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:33.784 INFO:tasks.rados.rados.0.smithi084.stdout:3863: done (1 left) 2024-03-30T12:35:33.784 INFO:tasks.rados.rados.0.smithi084.stdout:3864: done (0 left) 2024-03-30T12:35:33.784 INFO:tasks.rados.rados.0.smithi084.stdout:3865: rollback oid 2 current snap is 386 2024-03-30T12:35:33.784 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 2 to 379 2024-03-30T12:35:33.784 INFO:tasks.rados.rados.0.smithi084.stdout:3866: snap_remove snap 349 2024-03-30T12:35:34.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:33.915+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:34.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:33.790+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:34.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:33.790+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:34.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:33.789+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:34.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:33.791+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:34.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:33.802+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:34.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:33.802+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:34.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:33.805+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:34.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:34.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:34.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:34.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:34.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:34.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:34.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:34.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:34.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:34.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:34.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:34.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:34.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-mon[83709]: osdmap e836: 8 total, 8 up, 8 in 2024-03-30T12:35:34.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-mon[83709]: pgmap v945: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 4.5 MiB/s rd, 874 KiB/s wr, 10 op/s 2024-03-30T12:35:34.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:34.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:33 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:34.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:33.801+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:34.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:33.801+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:34.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:33.791+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:34.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:33.791+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:34.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:33.791+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:34.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:33.791+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:34.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:33.791+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:34.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:33.791+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:34.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[91810]: osdmap e836: 8 total, 8 up, 8 in 2024-03-30T12:35:34.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[91810]: pgmap v945: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 4.5 MiB/s rd, 874 KiB/s wr, 10 op/s 2024-03-30T12:35:34.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:34.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:34.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:34.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:34.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:34.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:34.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:34.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:34.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:34.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:34.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:34.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:34.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:34.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:34.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[89279]: osdmap e836: 8 total, 8 up, 8 in 2024-03-30T12:35:34.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[89279]: pgmap v945: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 4.5 MiB/s rd, 874 KiB/s wr, 10 op/s 2024-03-30T12:35:34.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:34.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:33 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:34.796 INFO:tasks.rados.rados.0.smithi084.stdout:3866: done (1 left) 2024-03-30T12:35:34.796 INFO:tasks.rados.rados.0.smithi084.stdout:3867: copy_from oid 40 from oid 18 current snap is 386 2024-03-30T12:35:34.796 INFO:tasks.rados.rados.0.smithi084.stdout:3865: finishing rollback tid 0 to smithi08477944-2 2024-03-30T12:35:34.797 INFO:tasks.rados.rados.0.smithi084.stdout:3865: finishing rollback tid 1 to smithi08477944-2 2024-03-30T12:35:34.797 INFO:tasks.rados.rados.0.smithi084.stdout:3865: finishing rollback tid 2 to smithi08477944-2 2024-03-30T12:35:34.797 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 2 v 36343 (ObjNum 1124 snap 366 seq_num 1124) dirty exists 2024-03-30T12:35:34.797 INFO:tasks.rados.rados.0.smithi084.stdout:3865: done (1 left) 2024-03-30T12:35:34.797 INFO:tasks.rados.rados.0.smithi084.stdout:3868: setattr oid 25 current snap is 386 2024-03-30T12:35:34.799 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 386 2024-03-30T12:35:34.799 INFO:tasks.rados.rados.0.smithi084.stdout:3869: seq_num 1192 ranges {2924544=770048} 2024-03-30T12:35:34.820 INFO:tasks.rados.rados.0.smithi084.stdout:3869: writing smithi08477944-26 from 2924544 to 3694592 tid 1 2024-03-30T12:35:34.821 INFO:tasks.rados.rados.0.smithi084.stdout:3870: rmattr oid 47 current snap is 386 2024-03-30T12:35:34.821 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 25 v 27321 (ObjNum 1105 snap 362 seq_num 1105) dirty exists 2024-03-30T12:35:34.821 INFO:tasks.rados.rados.0.smithi084.stdout:3867: finishing copy_from racing read to smithi08477944-40 2024-03-30T12:35:34.821 INFO:tasks.rados.rados.0.smithi084.stdout:3868: done (3 left) 2024-03-30T12:35:34.821 INFO:tasks.rados.rados.0.smithi084.stdout:3870: done (2 left) 2024-03-30T12:35:34.821 INFO:tasks.rados.rados.0.smithi084.stdout:3871: copy_from oid 37 from oid 5 current snap is 386 2024-03-30T12:35:34.821 INFO:tasks.rados.rados.0.smithi084.stdout:3867: finishing copy_from to smithi08477944-40 2024-03-30T12:35:34.821 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 36347 (ObjNum 825 snap 273 seq_num 825) dirty exists 2024-03-30T12:35:34.821 INFO:tasks.rados.rados.0.smithi084.stdout:3867: done (2 left) 2024-03-30T12:35:34.821 INFO:tasks.rados.rados.0.smithi084.stdout:3872: delete oid 41 current snap is 386 2024-03-30T12:35:34.822 INFO:tasks.rados.rados.0.smithi084.stdout:3872: done (2 left) 2024-03-30T12:35:34.822 INFO:tasks.rados.rados.0.smithi084.stdout:3873: snap_create 2024-03-30T12:35:34.832 INFO:tasks.rados.rados.0.smithi084.stdout:3869: finishing write tid 1 to smithi08477944-26 2024-03-30T12:35:34.832 INFO:tasks.rados.rados.0.smithi084.stdout:3869: finishing write tid 2 to smithi08477944-26 2024-03-30T12:35:34.836 INFO:tasks.rados.rados.0.smithi084.stdout:3869: finishing write tid 3 to smithi08477944-26 2024-03-30T12:35:34.836 INFO:tasks.rados.rados.0.smithi084.stdout:3869: oid 26 updating version 0 to 36345 2024-03-30T12:35:34.836 INFO:tasks.rados.rados.0.smithi084.stdout:3869: oid 26 version 36345 is already newer than 36344 2024-03-30T12:35:34.836 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 36345 (ObjNum 1192 snap 386 seq_num 1192) dirty exists 2024-03-30T12:35:34.836 INFO:tasks.rados.rados.0.smithi084.stdout:3869: left oid 26 (ObjNum 1192 snap 386 seq_num 1192) 2024-03-30T12:35:34.837 INFO:tasks.rados.rados.0.smithi084.stdout:3871: finishing copy_from racing read to smithi08477944-37 2024-03-30T12:35:34.838 INFO:tasks.rados.rados.0.smithi084.stdout:3871: finishing copy_from to smithi08477944-37 2024-03-30T12:35:34.838 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 27317 (ObjNum 1142 snap 374 seq_num 1142) dirty exists 2024-03-30T12:35:35.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:34.832+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:35.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:34.813+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:35.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:34.813+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:35.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:34.809+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:35.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:34.811+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:35.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:34.797+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:35.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:34.797+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:35.121 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:34 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:34.797+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:35.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:35.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:35.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:35.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:35.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:35.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:35.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:35.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:35.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:35.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:35.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:35.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:34 smithi162 ceph-mon[83709]: osdmap e837: 8 total, 8 up, 8 in 2024-03-30T12:35:35.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:35.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:34 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:35.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:35.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:35.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:34 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:35.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:34.807+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:35.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:34.807+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:35.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:34.797+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:35.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:34.797+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:35.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:34.797+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:35.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:34.797+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:35.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:34.797+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:35.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:35.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:35.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:35.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:35.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:35.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:35.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:35.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:35.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:35.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:35.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:35.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[91810]: osdmap e837: 8 total, 8 up, 8 in 2024-03-30T12:35:35.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:35.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:35.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:35.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:35.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:35.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:35.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:35.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:35.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:35.260 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:35.260 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:35.260 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:35.260 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:35.260 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:35.260 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:35.260 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:35.261 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[89279]: osdmap e837: 8 total, 8 up, 8 in 2024-03-30T12:35:35.261 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:35.261 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:35.261 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:35.261 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:35.261 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:34 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:35.801 INFO:tasks.rados.rados.0.smithi084.stdout:3869: done (2 left) 2024-03-30T12:35:35.801 INFO:tasks.rados.rados.0.smithi084.stdout:3871: done (1 left) 2024-03-30T12:35:35.801 INFO:tasks.rados.rados.0.smithi084.stdout:3873: done (0 left) 2024-03-30T12:35:35.801 INFO:tasks.rados.rados.0.smithi084.stdout:3874: snap_remove snap 377 2024-03-30T12:35:36.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:35.809+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:36.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:35.809+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:36.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:35.805+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:36.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:35 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:35.805+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:36.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:36.044+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:36.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:36.044+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:36.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:36.044+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:36.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:35 smithi162 ceph-mon[83709]: pgmap v947: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 6.5 MiB/s rd, 938 KiB/s wr, 16 op/s 2024-03-30T12:35:36.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:36.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:36.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:36.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:36.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:36.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:36.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:35 smithi162 ceph-mon[83709]: osdmap e838: 8 total, 8 up, 8 in 2024-03-30T12:35:36.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:36.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:35 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:36.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:36.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:36.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:36.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:36.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:35 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:36.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:35.807+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:36.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:35.807+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:36.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:35.807+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:36.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:35.807+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:36.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:35.808+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:36.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:35.808+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[91810]: pgmap v947: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 6.5 MiB/s rd, 938 KiB/s wr, 16 op/s 2024-03-30T12:35:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:36.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:36.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[91810]: osdmap e838: 8 total, 8 up, 8 in 2024-03-30T12:35:36.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:36.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:36.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:36.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:36.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:36.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[89279]: pgmap v947: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 6.5 MiB/s rd, 938 KiB/s wr, 16 op/s 2024-03-30T12:35:36.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:36.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:36.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:36.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:36.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:36.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:36.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[89279]: osdmap e838: 8 total, 8 up, 8 in 2024-03-30T12:35:36.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:36.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:36.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:36.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:36.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:36.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:36.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:36.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:36.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:35 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:36.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:36.288+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:36.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:36.289+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:36.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:36.289+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:36.805 INFO:tasks.rados.rados.0.smithi084.stdout:3874: done (0 left) 2024-03-30T12:35:36.805 INFO:tasks.rados.rados.0.smithi084.stdout:3875: read oid 19 snap -1 2024-03-30T12:35:36.805 INFO:tasks.rados.rados.0.smithi084.stdout:3875: expect (ObjNum 1149 snap 375 seq_num 1149) 2024-03-30T12:35:36.805 INFO:tasks.rados.rados.0.smithi084.stdout:3876: read oid 5 snap 340 2024-03-30T12:35:36.806 INFO:tasks.rados.rados.0.smithi084.stdout:3876: expect (ObjNum 836 snap 273 seq_num 836) 2024-03-30T12:35:36.806 INFO:tasks.rados.rados.0.smithi084.stdout:3877: snap_remove snap 381 2024-03-30T12:35:37.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:36.812+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:37.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:36.812+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:37.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:36.814+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:37.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:36.814+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:37.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:36.814+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:37.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:36.817+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:37.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:36 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:36.817+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:37.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:37.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:37.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:36 smithi162 ceph-mon[83709]: osdmap e839: 8 total, 8 up, 8 in 2024-03-30T12:35:37.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:37.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:37.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:37.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:36 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:37.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:37.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:37.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:37.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:36 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:37.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:36.818+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:37.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:36.819+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:37.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:36.809+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:37.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:36.809+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:37.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:36.809+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:37.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:36.809+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:37.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:36.809+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:37.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:37.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:37.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-mon[91810]: osdmap e839: 8 total, 8 up, 8 in 2024-03-30T12:35:37.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:37.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:37.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:37.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:37.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:37.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:37.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:37.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:37.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:37.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:37.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-mon[89279]: osdmap e839: 8 total, 8 up, 8 in 2024-03-30T12:35:37.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:37.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:37.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:37.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:37.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:37.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:37.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:37.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:36 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:37.800 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:37.417+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:37.809 INFO:tasks.rados.rados.0.smithi084.stdout:3877: done (2 left) 2024-03-30T12:35:37.809 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 23 current snap is 387 2024-03-30T12:35:37.810 INFO:tasks.rados.rados.0.smithi084.stdout:3878: seq_num 1194 ranges {368640=802816} 2024-03-30T12:35:37.816 INFO:tasks.rados.rados.0.smithi084.stdout:3878: writing smithi08477944-23 from 368640 to 1171456 tid 1 2024-03-30T12:35:37.817 INFO:tasks.rados.rados.0.smithi084.stdout:3879: setattr oid 4 current snap is 387 2024-03-30T12:35:37.817 INFO:tasks.rados.rados.0.smithi084.stdout:3875: expect (ObjNum 1149 snap 375 seq_num 1149) 2024-03-30T12:35:37.818 INFO:tasks.rados.rados.0.smithi084.stdout:3876: expect (ObjNum 836 snap 273 seq_num 836) 2024-03-30T12:35:38.050 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:38.058+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:38.051 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:37.816+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:38.051 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:37.816+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:38.051 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:37.821+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:38.051 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:37.821+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:38.051 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:37 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:37.821+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:38.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:38.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:38.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:38.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:37 smithi162 ceph-mon[83709]: pgmap v950: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 4.5 MiB/s rd, 710 KiB/s wr, 12 op/s 2024-03-30T12:35:38.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:38.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:38.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:38.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:38.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:37 smithi162 ceph-mon[83709]: osdmap e840: 8 total, 8 up, 8 in 2024-03-30T12:35:38.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:38.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:38.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:38.053 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:38.053 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:38.053 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:37 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:38.053 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:38.053 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:37 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:38.122 INFO:tasks.rados.rados.0.smithi084.stdout:3878: finishing write tid 1 to smithi08477944-23 2024-03-30T12:35:38.122 INFO:tasks.rados.rados.0.smithi084.stdout:3878: finishing write tid 2 to smithi08477944-23 2024-03-30T12:35:38.123 INFO:tasks.rados.rados.0.smithi084.stdout:3878: finishing write tid 3 to smithi08477944-23 2024-03-30T12:35:38.123 INFO:tasks.rados.rados.0.smithi084.stdout:3878: oid 23 updating version 0 to 36345 2024-03-30T12:35:38.123 INFO:tasks.rados.rados.0.smithi084.stdout:3878: oid 23 updating version 36345 to 36346 2024-03-30T12:35:38.123 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 36346 (ObjNum 1194 snap 387 seq_num 1194) dirty exists 2024-03-30T12:35:38.123 INFO:tasks.rados.rados.0.smithi084.stdout:3878: left oid 23 (ObjNum 1194 snap 387 seq_num 1194) 2024-03-30T12:35:38.123 INFO:tasks.rados.rados.0.smithi084.stdout:3875: done (3 left) 2024-03-30T12:35:38.123 INFO:tasks.rados.rados.0.smithi084.stdout:3876: done (2 left) 2024-03-30T12:35:38.123 INFO:tasks.rados.rados.0.smithi084.stdout:3878: done (1 left) 2024-03-30T12:35:38.123 INFO:tasks.rados.rados.0.smithi084.stdout:3880: read oid 22 snap -1 2024-03-30T12:35:38.123 INFO:tasks.rados.rados.0.smithi084.stdout:3880: expect deleted 2024-03-30T12:35:38.123 INFO:tasks.rados.rados.0.smithi084.stdout:3881: snap_remove snap 375 2024-03-30T12:35:38.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:37.821+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:38.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:37.823+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:38.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:37.815+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:38.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:37.815+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:38.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:37.816+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:38.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:37.816+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:38.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:37.816+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:38.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:37.818+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:38.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:38.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:38.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:38.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[89279]: pgmap v950: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 4.5 MiB/s rd, 710 KiB/s wr, 12 op/s 2024-03-30T12:35:38.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:38.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:38.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:38.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:38.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[89279]: osdmap e840: 8 total, 8 up, 8 in 2024-03-30T12:35:38.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:38.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:38.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:38.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:38.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:38.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:38.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:38.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[91810]: pgmap v950: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 4.5 MiB/s rd, 710 KiB/s wr, 12 op/s 2024-03-30T12:35:38.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:38.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:38.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:38.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:38.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[91810]: osdmap e840: 8 total, 8 up, 8 in 2024-03-30T12:35:38.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:38.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:38.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:38.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:38.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:38.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:38.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:38.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:38.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:38.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:38.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:38.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:37 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:38.369 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:38.058+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:38.369 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:38.058+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:38.822 INFO:tasks.rados.rados.0.smithi084.stdout:3881: done (2 left) 2024-03-30T12:35:38.823 INFO:tasks.rados.rados.0.smithi084.stdout:3882: setattr oid 47 current snap is 387 2024-03-30T12:35:38.823 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 4 v 36347 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:35:38.823 INFO:tasks.rados.rados.0.smithi084.stdout:3879: done (2 left) 2024-03-30T12:35:38.823 INFO:tasks.rados.rados.0.smithi084.stdout:3880: done (1 left) 2024-03-30T12:35:38.824 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 387 2024-03-30T12:35:38.824 INFO:tasks.rados.rados.0.smithi084.stdout:3883: seq_num 1195 ranges {3694592=417792,4112384=401408} 2024-03-30T12:35:38.846 INFO:tasks.rados.rados.0.smithi084.stdout:3883: writing smithi08477944-26 from 3694592 to 4112384 tid 1 2024-03-30T12:35:38.848 INFO:tasks.rados.rados.0.smithi084.stdout:3883: writing smithi08477944-26 from 4112384 to 4513792 tid 2 2024-03-30T12:35:38.848 INFO:tasks.rados.rados.0.smithi084.stdout:3884: copy_from oid 6 from oid 44 current snap is 387 2024-03-30T12:35:38.848 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 36348 (ObjNum 161 snap 0 seq_num 2) dirty exists 2024-03-30T12:35:38.849 INFO:tasks.rados.rados.0.smithi084.stdout:3882: done (2 left) 2024-03-30T12:35:38.849 INFO:tasks.rados.rados.0.smithi084.stdout:3885: copy_from oid 9 from oid 19 current snap is 387 2024-03-30T12:35:38.849 INFO:tasks.rados.rados.0.smithi084.stdout:3886: read oid 41 snap -1 2024-03-30T12:35:38.849 INFO:tasks.rados.rados.0.smithi084.stdout:3886: expect deleted 2024-03-30T12:35:38.849 INFO:tasks.rados.rados.0.smithi084.stdout:3887: snap_create 2024-03-30T12:35:38.855 INFO:tasks.rados.rados.0.smithi084.stdout:3885: finishing copy_from racing read to smithi08477944-9 2024-03-30T12:35:38.857 INFO:tasks.rados.rados.0.smithi084.stdout:3885: finishing copy_from to smithi08477944-9 2024-03-30T12:35:38.857 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 9 v 36404 (ObjNum 1149 snap 375 seq_num 1149) dirty exists 2024-03-30T12:35:38.864 INFO:tasks.rados.rados.0.smithi084.stdout:3883: finishing write tid 1 to smithi08477944-26 2024-03-30T12:35:38.864 INFO:tasks.rados.rados.0.smithi084.stdout:3883: finishing write tid 2 to smithi08477944-26 2024-03-30T12:35:38.864 INFO:tasks.rados.rados.0.smithi084.stdout:3883: finishing write tid 3 to smithi08477944-26 2024-03-30T12:35:38.869 INFO:tasks.rados.rados.0.smithi084.stdout:3883: finishing write tid 4 to smithi08477944-26 2024-03-30T12:35:38.869 INFO:tasks.rados.rados.0.smithi084.stdout:3883: oid 26 updating version 0 to 36347 2024-03-30T12:35:38.869 INFO:tasks.rados.rados.0.smithi084.stdout:3883: oid 26 version 36347 is already newer than 36346 2024-03-30T12:35:38.869 INFO:tasks.rados.rados.0.smithi084.stdout:3883: oid 26 updating version 36347 to 36348 2024-03-30T12:35:38.869 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 36348 (ObjNum 1195 snap 387 seq_num 1195) dirty exists 2024-03-30T12:35:38.869 INFO:tasks.rados.rados.0.smithi084.stdout:3883: left oid 26 (ObjNum 1195 snap 387 seq_num 1195) 2024-03-30T12:35:38.871 INFO:tasks.rados.rados.0.smithi084.stdout:3884: finishing copy_from racing read to smithi08477944-6 2024-03-30T12:35:38.871 INFO:tasks.rados.rados.0.smithi084.stdout:3884: finishing copy_from to smithi08477944-6 2024-03-30T12:35:38.871 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 36417 (ObjNum 1155 snap 377 seq_num 1155) dirty exists 2024-03-30T12:35:39.119 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:38.878+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:39.119 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:38.878+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:39.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:38.823+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:39.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:38.823+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:39.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:38.824+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:39.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:38.829+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:39.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:38 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:38.830+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:39.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:39.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:39.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:39.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:39.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:39.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:39.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:38 smithi162 ceph-mon[83709]: osdmap e841: 8 total, 8 up, 8 in 2024-03-30T12:35:39.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:39.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:39.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:39.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:39.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:38 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:39.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:39.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:38 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:39.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:38.836+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:39.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:38.837+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:39.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:38.828+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:39.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:38.828+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:39.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:38.828+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:39.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:38.829+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:39.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:38.829+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:39.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[91810]: osdmap e841: 8 total, 8 up, 8 in 2024-03-30T12:35:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:39.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:39.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:39.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:39.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:39.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:39.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:39.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:39.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[89279]: osdmap e841: 8 total, 8 up, 8 in 2024-03-30T12:35:39.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:39.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:39.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:39.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:39.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:39.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:39.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:38 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:39.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:39.179+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:39.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:35:39] "GET /metrics HTTP/1.1" 200 36325 "" "Prometheus/2.43.0" 2024-03-30T12:35:39.822 INFO:tasks.rados.rados.0.smithi084.stdout:3883: done (4 left) 2024-03-30T12:35:39.822 INFO:tasks.rados.rados.0.smithi084.stdout:3884: done (3 left) 2024-03-30T12:35:39.822 INFO:tasks.rados.rados.0.smithi084.stdout:3885: done (2 left) 2024-03-30T12:35:39.822 INFO:tasks.rados.rados.0.smithi084.stdout:3886: done (1 left) 2024-03-30T12:35:39.822 INFO:tasks.rados.rados.0.smithi084.stdout:3887: done (0 left) 2024-03-30T12:35:39.822 INFO:tasks.rados.rados.0.smithi084.stdout:3888: rollback oid 42 current snap is 388 2024-03-30T12:35:39.822 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 42 to 385 2024-03-30T12:35:39.823 INFO:tasks.rados.rados.0.smithi084.stdout:3889: delete oid 13 current snap is 388 2024-03-30T12:35:39.827 INFO:tasks.rados.rados.0.smithi084.stdout:3888: finishing rollback tid 1 to smithi08477944-42 2024-03-30T12:35:39.829 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 42 v 27425 (ObjNum 33 snap 0 seq_num 1430035056) dirty dne 2024-03-30T12:35:39.834 INFO:tasks.rados.rados.0.smithi084.stdout:3888: done (1 left) 2024-03-30T12:35:39.835 INFO:tasks.rados.rados.0.smithi084.stdout:3889: done (0 left) 2024-03-30T12:35:39.835 INFO:tasks.rados.rados.0.smithi084.stdout:3890: snap_remove snap 386 2024-03-30T12:35:40.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:39.837+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:40.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:39.833+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:40.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:39.833+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:40.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:39.843+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:40.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:39.843+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:40.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:39 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:39.843+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:39 smithi162 ceph-mon[83709]: pgmap v953: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 36 KiB/s rd, 634 KiB/s wr, 8 op/s 2024-03-30T12:35:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:39 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:39 smithi162 ceph-mon[83709]: osdmap e842: 8 total, 8 up, 8 in 2024-03-30T12:35:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:40.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:39 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:40.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:39.833+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:40.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:39.834+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:40.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:40.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[91810]: pgmap v953: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 36 KiB/s rd, 634 KiB/s wr, 8 op/s 2024-03-30T12:35:40.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:40.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:40.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:40.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:40.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:40.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:40.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:40.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:40.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[91810]: osdmap e842: 8 total, 8 up, 8 in 2024-03-30T12:35:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[89279]: pgmap v953: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 36 KiB/s rd, 634 KiB/s wr, 8 op/s 2024-03-30T12:35:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:40.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[89279]: osdmap e842: 8 total, 8 up, 8 in 2024-03-30T12:35:40.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:40.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:40.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:39.827+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:40.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:39.827+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:40.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:39.828+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:40.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:39.828+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:40.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:39.828+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:40.257 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:39.829+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:40.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:40.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:39 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:40.619 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:40.289+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:40.619 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:40.289+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:40.832 INFO:tasks.rados.rados.0.smithi084.stdout:3890: done (0 left) 2024-03-30T12:35:40.833 INFO:tasks.rados.rados.0.smithi084.stdout:3891: rollback oid 17 current snap is 388 2024-03-30T12:35:40.833 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 17 to 387 2024-03-30T12:35:40.833 INFO:tasks.rados.rados.0.smithi084.stdout:3892: read oid 31 snap -1 2024-03-30T12:35:40.833 INFO:tasks.rados.rados.0.smithi084.stdout:3892: expect (ObjNum 1068 snap 347 seq_num 1068) 2024-03-30T12:35:40.833 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 34 current snap is 388 2024-03-30T12:35:40.833 INFO:tasks.rados.rados.0.smithi084.stdout:3893: seq_num 1197 ranges {180224=450560,630784=401408} 2024-03-30T12:35:40.836 INFO:tasks.rados.rados.0.smithi084.stdout:3893: writing smithi08477944-34 from 180224 to 630784 tid 1 2024-03-30T12:35:40.839 INFO:tasks.rados.rados.0.smithi084.stdout:3893: writing smithi08477944-34 from 630784 to 1032192 tid 2 2024-03-30T12:35:40.839 INFO:tasks.rados.rados.0.smithi084.stdout:3894: delete oid 25 current snap is 388 2024-03-30T12:35:40.842 INFO:tasks.rados.rados.0.smithi084.stdout:3892: expect (ObjNum 1068 snap 347 seq_num 1068) 2024-03-30T12:35:40.904 INFO:tasks.rados.rados.0.smithi084.stdout:3891: finishing rollback tid 0 to smithi08477944-17 2024-03-30T12:35:40.904 INFO:tasks.rados.rados.0.smithi084.stdout:3891: finishing rollback tid 1 to smithi08477944-17 2024-03-30T12:35:40.904 INFO:tasks.rados.rados.0.smithi084.stdout:3891: finishing rollback tid 2 to smithi08477944-17 2024-03-30T12:35:40.904 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 27430 (ObjNum 1171 snap 381 seq_num 1171) dirty exists 2024-03-30T12:35:40.904 INFO:tasks.rados.rados.0.smithi084.stdout:3893: finishing write tid 1 to smithi08477944-34 2024-03-30T12:35:40.905 INFO:tasks.rados.rados.0.smithi084.stdout:3891: done (3 left) 2024-03-30T12:35:40.905 INFO:tasks.rados.rados.0.smithi084.stdout:3892: done (2 left) 2024-03-30T12:35:40.905 INFO:tasks.rados.rados.0.smithi084.stdout:3894: done (1 left) 2024-03-30T12:35:40.905 INFO:tasks.rados.rados.0.smithi084.stdout:3895: read oid 37 snap -1 2024-03-30T12:35:40.905 INFO:tasks.rados.rados.0.smithi084.stdout:3895: expect (ObjNum 1142 snap 374 seq_num 1142) 2024-03-30T12:35:40.905 INFO:tasks.rados.rados.0.smithi084.stdout:3896: rmattr oid 22 current snap is 388 2024-03-30T12:35:40.905 INFO:tasks.rados.rados.0.smithi084.stdout:3893: finishing write tid 2 to smithi08477944-34 2024-03-30T12:35:40.905 INFO:tasks.rados.rados.0.smithi084.stdout:3893: finishing write tid 3 to smithi08477944-34 2024-03-30T12:35:40.905 INFO:tasks.rados.rados.0.smithi084.stdout:3893: finishing write tid 4 to smithi08477944-34 2024-03-30T12:35:40.905 INFO:tasks.rados.rados.0.smithi084.stdout:3893: oid 34 updating version 0 to 36306 2024-03-30T12:35:40.905 INFO:tasks.rados.rados.0.smithi084.stdout:3893: oid 34 version 36306 is already newer than 36305 2024-03-30T12:35:40.905 INFO:tasks.rados.rados.0.smithi084.stdout:3893: oid 34 updating version 36306 to 36307 2024-03-30T12:35:40.905 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 36307 (ObjNum 1197 snap 388 seq_num 1197) dirty exists 2024-03-30T12:35:40.905 INFO:tasks.rados.rados.0.smithi084.stdout:3893: left oid 34 (ObjNum 1197 snap 388 seq_num 1197) 2024-03-30T12:35:40.906 INFO:tasks.rados.rados.0.smithi084.stdout:3893: done (2 left) 2024-03-30T12:35:40.906 INFO:tasks.rados.rados.0.smithi084.stdout:3897: snap_create 2024-03-30T12:35:40.906 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 22 v 0 (ObjNum 145 snap 0 seq_num 1430370320) dirty dne 2024-03-30T12:35:40.915 INFO:tasks.rados.rados.0.smithi084.stdout:3895: expect (ObjNum 1142 snap 374 seq_num 1142) 2024-03-30T12:35:41.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:40.849+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:41.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:40.838+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:41.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:40.838+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:41.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:40.836+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:41.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:40.836+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:41.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:40.837+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:41.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:40.842+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:41.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:40.842+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:41.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:41.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:41.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:41.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:41.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:41.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:41.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-mon[83709]: osdmap e843: 8 total, 8 up, 8 in 2024-03-30T12:35:41.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:41.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:41.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:41.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:41.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:41.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:41.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:41.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:41.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:40 smithi162 ceph-mon[83709]: pgmap v956: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 4.4 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2024-03-30T12:35:41.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:40.846+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:41.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:40.848+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:41.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:40.838+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:41.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:40.838+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:41.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:40.838+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:41.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:40.838+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:41.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:40.838+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:41.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:41.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:41.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:41.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:41.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:41.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:41.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[89279]: osdmap e843: 8 total, 8 up, 8 in 2024-03-30T12:35:41.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:41.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:41.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:41.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:41.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:41.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:41.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:41.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:41.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:41.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:41.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:41.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[91810]: osdmap e843: 8 total, 8 up, 8 in 2024-03-30T12:35:41.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:41.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:41.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:41.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:41.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:41.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:41.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:41.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:41.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[89279]: pgmap v956: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 4.4 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2024-03-30T12:35:41.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:41.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:41.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:41.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:40 smithi084 ceph-mon[91810]: pgmap v956: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 4.4 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2024-03-30T12:35:41.828 INFO:tasks.rados.rados.0.smithi084.stdout:3895: done (2 left) 2024-03-30T12:35:41.828 INFO:tasks.rados.rados.0.smithi084.stdout:3896: done (1 left) 2024-03-30T12:35:41.828 INFO:tasks.rados.rados.0.smithi084.stdout:3897: done (0 left) 2024-03-30T12:35:41.829 INFO:tasks.rados.rados.0.smithi084.stdout:3898: snap_create 2024-03-30T12:35:42.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:41.838+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:42.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:41.838+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:42.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:41.837+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:42.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:41 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:41.838+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:42.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:42.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:42.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:42.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:42.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:42.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:42.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:42.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:42.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:42.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:41 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:42.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:41 smithi162 ceph-mon[83709]: osdmap e844: 8 total, 8 up, 8 in 2024-03-30T12:35:42.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:42.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:42.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:41 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:42.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:42.060+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:42.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:42.060+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:42.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:41.835+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:42.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:41.835+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:42.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:41.835+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:42.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:41.836+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:42.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:41.836+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:42.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:41.836+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:42.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:42.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:42.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:42.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:42.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:42.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:42.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:42.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:42.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:42.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:42.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[89279]: osdmap e844: 8 total, 8 up, 8 in 2024-03-30T12:35:42.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:42.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:42.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:42.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:42.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:42.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:42.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:42.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:42.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:42.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:42.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:42.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:42.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:42.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[91810]: osdmap e844: 8 total, 8 up, 8 in 2024-03-30T12:35:42.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:42.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:42.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:41 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:42.619 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:42.277+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:42.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:42.278+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:42.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:42.278+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:42.842 INFO:tasks.rados.rados.0.smithi084.stdout:3898: done (0 left) 2024-03-30T12:35:42.842 INFO:tasks.rados.rados.0.smithi084.stdout:3899: read oid 29 snap 389 2024-03-30T12:35:42.842 INFO:tasks.rados.rados.0.smithi084.stdout:3899: expect deleted 2024-03-30T12:35:42.842 INFO:tasks.rados.rados.0.smithi084.stdout:3900: copy_from oid 31 from oid 11 current snap is 390 2024-03-30T12:35:42.842 INFO:tasks.rados.rados.0.smithi084.stdout:3901: copy_from oid 43 from oid 23 current snap is 390 2024-03-30T12:35:42.842 INFO:tasks.rados.rados.0.smithi084.stdout:3902: delete oid 13 current snap is 390 2024-03-30T12:35:42.843 INFO:tasks.rados.rados.0.smithi084.stdout:3900: finishing copy_from to smithi08477944-31 2024-03-30T12:35:42.843 INFO:tasks.rados.rados.0.smithi084.stdout:3900: got expected ENOENT (src dne) 2024-03-30T12:35:42.843 INFO:tasks.rados.rados.0.smithi084.stdout:3900: finishing copy_from racing read to smithi08477944-31 2024-03-30T12:35:42.852 INFO:tasks.rados.rados.0.smithi084.stdout:3899: done (3 left) 2024-03-30T12:35:42.852 INFO:tasks.rados.rados.0.smithi084.stdout:3900: done (2 left) 2024-03-30T12:35:42.852 INFO:tasks.rados.rados.0.smithi084.stdout:3902: done (1 left) 2024-03-30T12:35:42.852 INFO:tasks.rados.rados.0.smithi084.stdout:3903: snap_create 2024-03-30T12:35:42.859 INFO:tasks.rados.rados.0.smithi084.stdout:3901: finishing copy_from racing read to smithi08477944-43 2024-03-30T12:35:42.859 INFO:tasks.rados.rados.0.smithi084.stdout:3901: finishing copy_from to smithi08477944-43 2024-03-30T12:35:42.859 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 36346 (ObjNum 1194 snap 387 seq_num 1194) dirty exists 2024-03-30T12:35:43.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:42.845+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:43.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:42.845+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:43.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:42.845+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:43.120 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:42.680+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:43.120 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:42.860+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:43.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:42.849+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:43.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:42.849+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:43.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:42.857+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:43.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:42.858+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:43.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:43.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:43.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:43.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:43.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:43.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-mon[83709]: osdmap e845: 8 total, 8 up, 8 in 2024-03-30T12:35:43.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:43.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:43.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:43.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:43.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:43.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:43.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:43.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:43.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:43.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:42 smithi162 ceph-mon[83709]: pgmap v959: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 4.3 MiB/s rd, 1.9 MiB/s wr, 9 op/s 2024-03-30T12:35:43.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:42.856+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:43.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:42.857+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:43.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:42.848+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:43.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:42.848+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:43.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:42.849+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:43.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:42.849+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:43.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:42.849+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:43.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:43.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:43.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:43.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:43.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:43.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[91810]: osdmap e845: 8 total, 8 up, 8 in 2024-03-30T12:35:43.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:43.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:43.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:43.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:43.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:43.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:43.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:43.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:43.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:43.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:43.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:43.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:43.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:43.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[89279]: osdmap e845: 8 total, 8 up, 8 in 2024-03-30T12:35:43.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:43.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:43.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:43.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:43.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:43.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:43.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:43.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:43.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:43.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[91810]: pgmap v959: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 4.3 MiB/s rd, 1.9 MiB/s wr, 9 op/s 2024-03-30T12:35:43.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:43.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:42 smithi084 ceph-mon[89279]: pgmap v959: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 4.3 MiB/s rd, 1.9 MiB/s wr, 9 op/s 2024-03-30T12:35:43.851 INFO:tasks.rados.rados.0.smithi084.stdout:3901: done (1 left) 2024-03-30T12:35:43.851 INFO:tasks.rados.rados.0.smithi084.stdout:3903: done (0 left) 2024-03-30T12:35:43.851 INFO:tasks.rados.rados.0.smithi084.stdout:3904: copy_from oid 49 from oid 11 current snap is 391 2024-03-30T12:35:43.851 INFO:tasks.rados.rados.0.smithi084.stdout:3905: read oid 28 snap -1 2024-03-30T12:35:43.851 INFO:tasks.rados.rados.0.smithi084.stdout:3905: expect (ObjNum 1183 snap 382 seq_num 1183) 2024-03-30T12:35:43.851 INFO:tasks.rados.rados.0.smithi084.stdout:3906: snap_remove snap 379 2024-03-30T12:35:44.112 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:43.858+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:44.112 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:43.860+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:44.112 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:43.859+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:44.112 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:43 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:43.859+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:44.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:44.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:44.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:44.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:44.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:44.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:44.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:44.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:44.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:44.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:43 smithi162 ceph-mon[83709]: osdmap e846: 8 total, 8 up, 8 in 2024-03-30T12:35:44.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:44.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:44.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:43 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:44.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:44.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:43 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:44.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:43.862+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:44.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:43.863+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:44.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:44.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:44.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:44.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:44.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:44.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:44.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:44.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:44.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:44.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[91810]: osdmap e846: 8 total, 8 up, 8 in 2024-03-30T12:35:44.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:44.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:43.863+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:44.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:43.864+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:44.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:43.865+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:44.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:43.865+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:44.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:43.865+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:44.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:43.868+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:44.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:44.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:44.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:44.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:44.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:44.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:44.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:44.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:44.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:44.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:44.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:44.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:44.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:44.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[89279]: osdmap e846: 8 total, 8 up, 8 in 2024-03-30T12:35:44.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:44.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:44.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:44.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:44.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:43 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:44.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:44.120+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:44.369 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:44.145+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:44.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:44.145+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:44.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:44.145+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:44.868 INFO:tasks.rados.rados.0.smithi084.stdout:3906: done (2 left) 2024-03-30T12:35:44.868 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 21 current snap is 391 2024-03-30T12:35:44.868 INFO:tasks.rados.rados.0.smithi084.stdout:3904: finishing copy_from to smithi08477944-49 2024-03-30T12:35:44.869 INFO:tasks.rados.rados.0.smithi084.stdout:3904: got expected ENOENT (src dne) 2024-03-30T12:35:44.869 INFO:tasks.rados.rados.0.smithi084.stdout:3907: seq_num 1200 ranges {49152=499712,548864=401408} 2024-03-30T12:35:44.871 INFO:tasks.rados.rados.0.smithi084.stdout:3907: writing smithi08477944-21 from 49152 to 548864 tid 1 2024-03-30T12:35:44.874 INFO:tasks.rados.rados.0.smithi084.stdout:3907: writing smithi08477944-21 from 548864 to 950272 tid 2 2024-03-30T12:35:44.874 INFO:tasks.rados.rados.0.smithi084.stdout:3908: read oid 27 snap -1 2024-03-30T12:35:44.874 INFO:tasks.rados.rados.0.smithi084.stdout:3908: expect deleted 2024-03-30T12:35:44.874 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 41 current snap is 391 2024-03-30T12:35:44.875 INFO:tasks.rados.rados.0.smithi084.stdout:3904: finishing copy_from racing read to smithi08477944-49 2024-03-30T12:35:44.875 INFO:tasks.rados.rados.0.smithi084.stdout:3905: expect (ObjNum 1183 snap 382 seq_num 1183) 2024-03-30T12:35:44.894 INFO:tasks.rados.rados.0.smithi084.stdout:3907: finishing write tid 1 to smithi08477944-21 2024-03-30T12:35:44.894 INFO:tasks.rados.rados.0.smithi084.stdout:3907: finishing write tid 2 to smithi08477944-21 2024-03-30T12:35:44.894 INFO:tasks.rados.rados.0.smithi084.stdout:3907: finishing write tid 3 to smithi08477944-21 2024-03-30T12:35:44.894 INFO:tasks.rados.rados.0.smithi084.stdout:3909: seq_num 1201 ranges {0=524288,524288=401408} 2024-03-30T12:35:44.897 INFO:tasks.rados.rados.0.smithi084.stdout:3909: writing smithi08477944-41 from 0 to 524288 tid 1 2024-03-30T12:35:44.900 INFO:tasks.rados.rados.0.smithi084.stdout:3909: writing smithi08477944-41 from 524288 to 925696 tid 2 2024-03-30T12:35:44.900 INFO:tasks.rados.rados.0.smithi084.stdout:3904: done (4 left) 2024-03-30T12:35:44.900 INFO:tasks.rados.rados.0.smithi084.stdout:3905: done (3 left) 2024-03-30T12:35:44.900 INFO:tasks.rados.rados.0.smithi084.stdout:3908: done (2 left) 2024-03-30T12:35:44.900 INFO:tasks.rados.rados.0.smithi084.stdout:3910: snap_create 2024-03-30T12:35:44.900 INFO:tasks.rados.rados.0.smithi084.stdout:3907: finishing write tid 4 to smithi08477944-21 2024-03-30T12:35:44.900 INFO:tasks.rados.rados.0.smithi084.stdout:3907: oid 21 updating version 0 to 36405 2024-03-30T12:35:44.900 INFO:tasks.rados.rados.0.smithi084.stdout:3907: oid 21 updating version 36405 to 36407 2024-03-30T12:35:44.901 INFO:tasks.rados.rados.0.smithi084.stdout:3907: oid 21 version 36407 is already newer than 36406 2024-03-30T12:35:44.901 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 21 v 36407 (ObjNum 1200 snap 391 seq_num 1200) dirty exists 2024-03-30T12:35:44.901 INFO:tasks.rados.rados.0.smithi084.stdout:3907: left oid 21 (ObjNum 1200 snap 391 seq_num 1200) 2024-03-30T12:35:44.902 INFO:tasks.rados.rados.0.smithi084.stdout:3909: finishing write tid 1 to smithi08477944-41 2024-03-30T12:35:44.902 INFO:tasks.rados.rados.0.smithi084.stdout:3909: finishing write tid 2 to smithi08477944-41 2024-03-30T12:35:44.903 INFO:tasks.rados.rados.0.smithi084.stdout:3909: finishing write tid 3 to smithi08477944-41 2024-03-30T12:35:44.904 INFO:tasks.rados.rados.0.smithi084.stdout:3909: finishing write tid 4 to smithi08477944-41 2024-03-30T12:35:44.904 INFO:tasks.rados.rados.0.smithi084.stdout:3909: oid 41 updating version 0 to 36356 2024-03-30T12:35:44.904 INFO:tasks.rados.rados.0.smithi084.stdout:3909: oid 41 version 36356 is already newer than 36355 2024-03-30T12:35:44.904 INFO:tasks.rados.rados.0.smithi084.stdout:3909: oid 41 version 36356 is already newer than 36354 2024-03-30T12:35:44.904 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 41 v 36356 (ObjNum 1201 snap 391 seq_num 1201) dirty exists 2024-03-30T12:35:44.904 INFO:tasks.rados.rados.0.smithi084.stdout:3909: left oid 41 (ObjNum 1201 snap 391 seq_num 1201) 2024-03-30T12:35:45.119 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:45.058+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:45.119 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:44.886+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:45.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:44.887+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:45.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:44.873+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:45.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:44.873+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:45.120 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:44.873+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:45.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:44.878+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:45.120 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:44.879+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:45.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:45.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-mon[83709]: osdmap e847: 8 total, 8 up, 8 in 2024-03-30T12:35:45.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:45.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:45.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:45.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:45.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:45.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:45.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:45.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:45.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:45.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:45.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:45.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:35:45.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:44 smithi162 ceph-mon[83709]: pgmap v962: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 2.9 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-03-30T12:35:45.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:44.879+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:45.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:44.879+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:45.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:44.872+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:45.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:44.873+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:45.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:44.873+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:45.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:44.873+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:45.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:44.874+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[91810]: osdmap e847: 8 total, 8 up, 8 in 2024-03-30T12:35:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:45.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:45.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:35:45.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[91810]: pgmap v962: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 2.9 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-03-30T12:35:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[89279]: osdmap e847: 8 total, 8 up, 8 in 2024-03-30T12:35:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:45.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:45.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:45.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:45.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:45.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:45.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:45.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:35:45.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:44 smithi084 ceph-mon[89279]: pgmap v962: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 2.9 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-03-30T12:35:45.864 INFO:tasks.rados.rados.0.smithi084.stdout:3907: done (2 left) 2024-03-30T12:35:45.864 INFO:tasks.rados.rados.0.smithi084.stdout:3909: done (1 left) 2024-03-30T12:35:45.864 INFO:tasks.rados.rados.0.smithi084.stdout:3910: done (0 left) 2024-03-30T12:35:45.864 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 11 current snap is 392 2024-03-30T12:35:45.864 INFO:tasks.rados.rados.0.smithi084.stdout:3911: seq_num 1202 ranges {0=540672,540672=401408} 2024-03-30T12:35:45.866 INFO:tasks.rados.rados.0.smithi084.stdout:3911: writing smithi08477944-11 from 0 to 540672 tid 1 2024-03-30T12:35:45.869 INFO:tasks.rados.rados.0.smithi084.stdout:3911: writing smithi08477944-11 from 540672 to 942080 tid 2 2024-03-30T12:35:45.869 INFO:tasks.rados.rados.0.smithi084.stdout:3912: delete oid 48 current snap is 392 2024-03-30T12:35:45.874 INFO:tasks.rados.rados.0.smithi084.stdout:3911: finishing write tid 1 to smithi08477944-11 2024-03-30T12:35:45.874 INFO:tasks.rados.rados.0.smithi084.stdout:3911: finishing write tid 2 to smithi08477944-11 2024-03-30T12:35:45.874 INFO:tasks.rados.rados.0.smithi084.stdout:3912: done (1 left) 2024-03-30T12:35:45.874 INFO:tasks.rados.rados.0.smithi084.stdout:3913: copy_from oid 29 from oid 44 current snap is 392 2024-03-30T12:35:45.874 INFO:tasks.rados.rados.0.smithi084.stdout:3914: rollback oid 43 current snap is 392 2024-03-30T12:35:45.874 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 43 to 367 2024-03-30T12:35:45.874 INFO:tasks.rados.rados.0.smithi084.stdout:3915: copy_from oid 7 from oid 13 current snap is 392 2024-03-30T12:35:45.874 INFO:tasks.rados.rados.0.smithi084.stdout:3911: finishing write tid 3 to smithi08477944-11 2024-03-30T12:35:45.874 INFO:tasks.rados.rados.0.smithi084.stdout:3916: read oid 50 snap -1 2024-03-30T12:35:45.874 INFO:tasks.rados.rados.0.smithi084.stdout:3916: expect deleted 2024-03-30T12:35:45.874 INFO:tasks.rados.rados.0.smithi084.stdout:3917: snap_create 2024-03-30T12:35:45.875 INFO:tasks.rados.rados.0.smithi084.stdout:3915: finishing copy_from to smithi08477944-7 2024-03-30T12:35:45.875 INFO:tasks.rados.rados.0.smithi084.stdout:3915: got expected ENOENT (src dne) 2024-03-30T12:35:45.875 INFO:tasks.rados.rados.0.smithi084.stdout:3915: finishing copy_from racing read to smithi08477944-7 2024-03-30T12:35:45.875 INFO:tasks.rados.rados.0.smithi084.stdout:3911: finishing write tid 4 to smithi08477944-11 2024-03-30T12:35:45.875 INFO:tasks.rados.rados.0.smithi084.stdout:3911: oid 11 updating version 0 to 27325 2024-03-30T12:35:45.875 INFO:tasks.rados.rados.0.smithi084.stdout:3911: oid 11 version 27325 is already newer than 27324 2024-03-30T12:35:45.876 INFO:tasks.rados.rados.0.smithi084.stdout:3911: oid 11 version 27325 is already newer than 27323 2024-03-30T12:35:45.876 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 11 v 27325 (ObjNum 1202 snap 392 seq_num 1202) dirty exists 2024-03-30T12:35:45.876 INFO:tasks.rados.rados.0.smithi084.stdout:3911: left oid 11 (ObjNum 1202 snap 392 seq_num 1202) 2024-03-30T12:35:45.881 INFO:tasks.rados.rados.0.smithi084.stdout:3914: finishing rollback tid 0 to smithi08477944-43 2024-03-30T12:35:45.884 INFO:tasks.rados.rados.0.smithi084.stdout:3914: finishing rollback tid 1 to smithi08477944-43 2024-03-30T12:35:45.884 INFO:tasks.rados.rados.0.smithi084.stdout:3914: finishing rollback tid 2 to smithi08477944-43 2024-03-30T12:35:45.885 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 43 v 36425 (ObjNum 1062 snap 344 seq_num 1062) dirty exists 2024-03-30T12:35:45.903 INFO:tasks.rados.rados.0.smithi084.stdout:3913: finishing copy_from racing read to smithi08477944-29 2024-03-30T12:35:45.905 INFO:tasks.rados.rados.0.smithi084.stdout:3913: finishing copy_from to smithi08477944-29 2024-03-30T12:35:45.905 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 36417 (ObjNum 1155 snap 377 seq_num 1155) dirty exists 2024-03-30T12:35:46.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:45.871+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:46.119 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:45.872+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:46.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:45.872+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:46.120 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:45.872+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:46.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:46.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:46.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:45 smithi162 ceph-mon[83709]: osdmap e848: 8 total, 8 up, 8 in 2024-03-30T12:35:46.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:46.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:46.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:46.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:45 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:46.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:45.881+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:46.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:45.881+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:46.121 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:45 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:45.881+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:46.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:46.122 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:45 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:46.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:45.909+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:46.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:45.911+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:46.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:45.879+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:46.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:45.879+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:46.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:45.880+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:46.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:45.880+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:46.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:45.880+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:46.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:45.880+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:46.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[91810]: osdmap e848: 8 total, 8 up, 8 in 2024-03-30T12:35:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:46.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:46.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:46.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:46.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:46.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:46.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:46.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bc=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:46.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:46.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[89279]: osdmap e848: 8 total, 8 up, 8 in 2024-03-30T12:35:46.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:46.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:46.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:46.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:46.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:46.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:46.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:46.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:45 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:46.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:46.190+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:46.881 INFO:tasks.rados.rados.0.smithi084.stdout:3911: done (5 left) 2024-03-30T12:35:46.882 INFO:tasks.rados.rados.0.smithi084.stdout:3913: done (4 left) 2024-03-30T12:35:46.882 INFO:tasks.rados.rados.0.smithi084.stdout:3914: done (3 left) 2024-03-30T12:35:46.882 INFO:tasks.rados.rados.0.smithi084.stdout:3915: done (2 left) 2024-03-30T12:35:46.882 INFO:tasks.rados.rados.0.smithi084.stdout:3916: done (1 left) 2024-03-30T12:35:46.882 INFO:tasks.rados.rados.0.smithi084.stdout:3917: done (0 left) 2024-03-30T12:35:46.882 INFO:tasks.rados.rados.0.smithi084.stdout:3918: setattr oid 29 current snap is 393 2024-03-30T12:35:46.884 INFO:tasks.rados.rados.0.smithi084.stdout:3919: read oid 25 snap -1 2024-03-30T12:35:46.884 INFO:tasks.rados.rados.0.smithi084.stdout:3919: expect deleted 2024-03-30T12:35:46.884 INFO:tasks.rados.rados.0.smithi084.stdout:3920: copy_from oid 7 from oid 16 current snap is 393 2024-03-30T12:35:46.884 INFO:tasks.rados.rados.0.smithi084.stdout:3921: rmattr oid 40 current snap is 393 2024-03-30T12:35:46.884 INFO:tasks.rados.rados.0.smithi084.stdout:3922: copy_from oid 31 from oid 8 current snap is 393 2024-03-30T12:35:46.885 INFO:tasks.rados.rados.0.smithi084.stdout:3923: rollback oid 12 current snap is 393 2024-03-30T12:35:46.885 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 12 to 383 2024-03-30T12:35:46.885 INFO:tasks.rados.rados.0.smithi084.stdout:3924: snap_remove snap 340 2024-03-30T12:35:47.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:46.898+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:47.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:46.898+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:47.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:46.888+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:47.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:46.889+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:47.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:46.889+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:47.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:46.889+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:47.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:46.889+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:47.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:47.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:47.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[91810]: osdmap e849: 8 total, 8 up, 8 in 2024-03-30T12:35:47.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:47.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:47.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:47.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:47.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:47.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:47.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:47.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:47.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:47.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[89279]: osdmap e849: 8 total, 8 up, 8 in 2024-03-30T12:35:47.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:47.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:47.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:47.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:47.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:47.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:47.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:47.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:47.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:47.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:47.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:47.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[91810]: pgmap v965: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 2.9 MiB/s rd, 220 KiB/s wr, 9 op/s 2024-03-30T12:35:47.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:47.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:47.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:47.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:47.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:46 smithi084 ceph-mon[89279]: pgmap v965: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 2.9 MiB/s rd, 220 KiB/s wr, 9 op/s 2024-03-30T12:35:47.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:46.901+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:47.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:46.884+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:47.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:46.884+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:47.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:46.884+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:47.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:46.898+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:47.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:46.899+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:47.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:46.897+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:47.371 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:46 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:46.899+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:47.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:47.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:47.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:46 smithi162 ceph-mon[83709]: osdmap e849: 8 total, 8 up, 8 in 2024-03-30T12:35:47.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:47.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:47.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:47.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:47.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:47.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:47.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:47.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:47.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:46 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:47.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:47.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:46 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:47.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:46 smithi162 ceph-mon[83709]: pgmap v965: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 2.9 MiB/s rd, 220 KiB/s wr, 9 op/s 2024-03-30T12:35:47.878 INFO:tasks.rados.rados.0.smithi084.stdout:3924: done (6 left) 2024-03-30T12:35:47.879 INFO:tasks.rados.rados.0.smithi084.stdout:3925: delete oid 18 current snap is 393 2024-03-30T12:35:47.879 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 29 v 36418 (ObjNum 1155 snap 377 seq_num 1155) dirty exists 2024-03-30T12:35:47.879 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 40 v 36349 (ObjNum 825 snap 273 seq_num 825) dirty exists 2024-03-30T12:35:47.879 INFO:tasks.rados.rados.0.smithi084.stdout:3923: finishing rollback tid 1 to smithi08477944-12 2024-03-30T12:35:47.879 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 36292 (ObjNum 33 snap 0 seq_num 1430221680) dirty dne 2024-03-30T12:35:47.879 INFO:tasks.rados.rados.0.smithi084.stdout:3922: finishing copy_from racing read to smithi08477944-31 2024-03-30T12:35:47.879 INFO:tasks.rados.rados.0.smithi084.stdout:3922: finishing copy_from to smithi08477944-31 2024-03-30T12:35:47.879 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 36324 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-03-30T12:35:47.879 INFO:tasks.rados.rados.0.smithi084.stdout:3920: finishing copy_from racing read to smithi08477944-7 2024-03-30T12:35:47.879 INFO:tasks.rados.rados.0.smithi084.stdout:3920: finishing copy_from to smithi08477944-7 2024-03-30T12:35:47.879 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 7 v 36342 (ObjNum 1172 snap 381 seq_num 1172) dirty exists 2024-03-30T12:35:47.886 INFO:tasks.rados.rados.0.smithi084.stdout:3918: done (6 left) 2024-03-30T12:35:47.886 INFO:tasks.rados.rados.0.smithi084.stdout:3919: done (5 left) 2024-03-30T12:35:47.886 INFO:tasks.rados.rados.0.smithi084.stdout:3920: done (4 left) 2024-03-30T12:35:47.886 INFO:tasks.rados.rados.0.smithi084.stdout:3921: done (3 left) 2024-03-30T12:35:47.887 INFO:tasks.rados.rados.0.smithi084.stdout:3922: done (2 left) 2024-03-30T12:35:47.887 INFO:tasks.rados.rados.0.smithi084.stdout:3923: done (1 left) 2024-03-30T12:35:47.887 INFO:tasks.rados.rados.0.smithi084.stdout:3925: done (0 left) 2024-03-30T12:35:47.887 INFO:tasks.rados.rados.0.smithi084.stdout:3926: read oid 35 snap -1 2024-03-30T12:35:47.887 INFO:tasks.rados.rados.0.smithi084.stdout:3926: expect (ObjNum 1181 snap 382 seq_num 1181) 2024-03-30T12:35:47.887 INFO:tasks.rados.rados.0.smithi084.stdout:3927: copy_from oid 20 from oid 16 current snap is 393 2024-03-30T12:35:47.887 INFO:tasks.rados.rados.0.smithi084.stdout:3928: read oid 34 snap -1 2024-03-30T12:35:47.887 INFO:tasks.rados.rados.0.smithi084.stdout:3928: expect (ObjNum 1197 snap 388 seq_num 1197) 2024-03-30T12:35:47.887 INFO:tasks.rados.rados.0.smithi084.stdout:3929: rollback oid 49 current snap is 393 2024-03-30T12:35:47.887 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 49 to 389 2024-03-30T12:35:47.887 INFO:tasks.rados.rados.0.smithi084.stdout:3930: read oid 44 snap 391 2024-03-30T12:35:47.887 INFO:tasks.rados.rados.0.smithi084.stdout:3930: expect (ObjNum 1155 snap 377 seq_num 1155) 2024-03-30T12:35:47.887 INFO:tasks.rados.rados.0.smithi084.stdout:3931: read oid 19 snap 383 2024-03-30T12:35:47.887 INFO:tasks.rados.rados.0.smithi084.stdout:3931: expect (ObjNum 1149 snap 375 seq_num 1149) 2024-03-30T12:35:47.887 INFO:tasks.rados.rados.0.smithi084.stdout:3932: copy_from oid 10 from oid 29 current snap is 393 2024-03-30T12:35:47.888 INFO:tasks.rados.rados.0.smithi084.stdout:3933: rollback oid 38 current snap is 393 2024-03-30T12:35:47.888 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 38 to 387 2024-03-30T12:35:47.888 INFO:tasks.rados.rados.0.smithi084.stdout:3934: snap_create 2024-03-30T12:35:47.889 INFO:tasks.rados.rados.0.smithi084.stdout:3933: finishing rollback tid 1 to smithi08477944-38 2024-03-30T12:35:47.889 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 38 v 27325 (ObjNum 4113 snap 0 seq_num 3936521009) dirty dne 2024-03-30T12:35:47.896 INFO:tasks.rados.rados.0.smithi084.stdout:3928: expect (ObjNum 1197 snap 388 seq_num 1197) 2024-03-30T12:35:47.936 INFO:tasks.rados.rados.0.smithi084.stdout:3929: finishing rollback tid 0 to smithi08477944-49 2024-03-30T12:35:47.936 INFO:tasks.rados.rados.0.smithi084.stdout:3929: finishing rollback tid 1 to smithi08477944-49 2024-03-30T12:35:47.936 INFO:tasks.rados.rados.0.smithi084.stdout:3929: finishing rollback tid 2 to smithi08477944-49 2024-03-30T12:35:47.936 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 36349 (ObjNum 1021 snap 328 seq_num 1021) dirty exists 2024-03-30T12:35:47.936 INFO:tasks.rados.rados.0.smithi084.stdout:3927: finishing copy_from racing read to smithi08477944-20 2024-03-30T12:35:47.936 INFO:tasks.rados.rados.0.smithi084.stdout:3927: finishing copy_from to smithi08477944-20 2024-03-30T12:35:47.936 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 20 v 36342 (ObjNum 1172 snap 381 seq_num 1172) dirty exists 2024-03-30T12:35:47.937 INFO:tasks.rados.rados.0.smithi084.stdout:3930: expect (ObjNum 1155 snap 377 seq_num 1155) 2024-03-30T12:35:48.116 INFO:tasks.rados.rados.0.smithi084.stdout:3931: expect (ObjNum 1149 snap 375 seq_num 1149) 2024-03-30T12:35:48.117 INFO:tasks.rados.rados.0.smithi084.stdout:3926: expect (ObjNum 1181 snap 382 seq_num 1181) 2024-03-30T12:35:48.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:47.901+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:48.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:47.908+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:48.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:48.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:48.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:48.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:48.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:48.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[91810]: osdmap e850: 8 total, 8 up, 8 in 2024-03-30T12:35:48.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:48.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:48.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:48.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:48.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:48.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:48.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:48.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:48.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:48.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:48.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:48.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[89279]: osdmap e850: 8 total, 8 up, 8 in 2024-03-30T12:35:48.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:48.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:48.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:48.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:48.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:48.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:48.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:47.889+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:48.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:47.889+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:48.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:47.889+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:48.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:47.889+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:48.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:47.889+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:48.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:47.892+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:48.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:48.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:48.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:48.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:48.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:48.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:47 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:48.357 INFO:tasks.rados.rados.0.smithi084.stdout:3932: finishing copy_from racing read to smithi08477944-10 2024-03-30T12:35:48.357 INFO:tasks.rados.rados.0.smithi084.stdout:3932: finishing copy_from to smithi08477944-10 2024-03-30T12:35:48.357 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 10 v 36418 (ObjNum 1155 snap 377 seq_num 1155) dirty exists 2024-03-30T12:35:48.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:47.899+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:48.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:47.889+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:48.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:47.890+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:48.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:47.888+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:48.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:47.889+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:48.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:47.894+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:48.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:47.894+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:48.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:47.894+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:48.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:48.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:48.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:48.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bb=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:48.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:48.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:47 smithi162 ceph-mon[83709]: osdmap e850: 8 total, 8 up, 8 in 2024-03-30T12:35:48.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:48.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:48.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:48.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:48.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:48.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:47 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:48.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:48.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:48.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:47 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:48.899 INFO:tasks.rados.rados.0.smithi084.stdout:3926: done (8 left) 2024-03-30T12:35:48.899 INFO:tasks.rados.rados.0.smithi084.stdout:3927: done (7 left) 2024-03-30T12:35:48.899 INFO:tasks.rados.rados.0.smithi084.stdout:3928: done (6 left) 2024-03-30T12:35:48.899 INFO:tasks.rados.rados.0.smithi084.stdout:3929: done (5 left) 2024-03-30T12:35:48.899 INFO:tasks.rados.rados.0.smithi084.stdout:3930: done (4 left) 2024-03-30T12:35:48.899 INFO:tasks.rados.rados.0.smithi084.stdout:3931: done (3 left) 2024-03-30T12:35:48.899 INFO:tasks.rados.rados.0.smithi084.stdout:3932: done (2 left) 2024-03-30T12:35:48.899 INFO:tasks.rados.rados.0.smithi084.stdout:3933: done (1 left) 2024-03-30T12:35:48.899 INFO:tasks.rados.rados.0.smithi084.stdout:3934: done (0 left) 2024-03-30T12:35:48.899 INFO:tasks.rados.rados.0.smithi084.stdout:3935: snap_create 2024-03-30T12:35:49.155 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:48.905+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:49.155 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:48.905+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:49.155 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:48.905+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:49.155 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:48.905+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:49.155 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:48.905+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:49.156 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[91810]: osdmap e851: 8 total, 8 up, 8 in 2024-03-30T12:35:49.156 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:49.156 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:49.156 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:49.156 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:49.156 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:49.156 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:49.156 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:49.156 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:49.156 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:49.156 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:49.156 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:49.156 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:49.157 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:49.157 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[91810]: pgmap v968: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 457 KiB/s rd, 2.7 MiB/s wr, 14 op/s 2024-03-30T12:35:49.157 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[89279]: osdmap e851: 8 total, 8 up, 8 in 2024-03-30T12:35:49.157 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:49.157 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:49.157 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:49.157 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:49.157 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:49.157 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:49.158 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:49.158 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:49.158 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:49.158 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:49.158 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:49.158 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:49.158 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:49.158 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:48 smithi084 ceph-mon[89279]: pgmap v968: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 457 KiB/s rd, 2.7 MiB/s wr, 14 op/s 2024-03-30T12:35:49.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:49.118+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:49.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:49.118+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:49.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:49.119+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:49.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:48.904+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:49.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:48.904+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:49.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:48.902+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:49.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:48.902+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:49.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:48 smithi162 ceph-mon[83709]: osdmap e851: 8 total, 8 up, 8 in 2024-03-30T12:35:49.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:49.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:49.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:49.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:49.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:49.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:49.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:49.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:49.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:49.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:49.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:48 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1ba=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:49.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:49.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:48 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:49.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:48 smithi162 ceph-mon[83709]: pgmap v968: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.2 GiB used, 708 GiB / 715 GiB avail; 457 KiB/s rd, 2.7 MiB/s wr, 14 op/s 2024-03-30T12:35:49.440 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:35:49] "GET /metrics HTTP/1.1" 200 36325 "" "Prometheus/2.43.0" 2024-03-30T12:35:49.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:49.446+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:49.753 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:49.447+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:49.869 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:49.447+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:49.901 INFO:tasks.rados.rados.0.smithi084.stdout:3935: done (0 left) 2024-03-30T12:35:49.901 INFO:tasks.rados.rados.0.smithi084.stdout:3936: read oid 1 snap 385 2024-03-30T12:35:49.901 INFO:tasks.rados.rados.0.smithi084.stdout:3936: expect deleted 2024-03-30T12:35:49.901 INFO:tasks.rados.rados.0.smithi084.stdout:3937: rmattr oid 18 current snap is 395 2024-03-30T12:35:49.901 INFO:tasks.rados.rados.0.smithi084.stdout:3937: done (1 left) 2024-03-30T12:35:49.901 INFO:tasks.rados.rados.0.smithi084.stdout:3938: read oid 27 snap -1 2024-03-30T12:35:49.901 INFO:tasks.rados.rados.0.smithi084.stdout:3938: expect deleted 2024-03-30T12:35:49.901 INFO:tasks.rados.rados.0.smithi084.stdout:3939: copy_from oid 35 from oid 3 current snap is 395 2024-03-30T12:35:49.901 INFO:tasks.rados.rados.0.smithi084.stdout:3940: read oid 46 snap 384 2024-03-30T12:35:49.901 INFO:tasks.rados.rados.0.smithi084.stdout:3940: expect (ObjNum 1168 snap 380 seq_num 1168) 2024-03-30T12:35:49.901 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 28 current snap is 395 2024-03-30T12:35:49.901 INFO:tasks.rados.rados.0.smithi084.stdout:3941: seq_num 1205 ranges {622592=589824,1212416=401408} 2024-03-30T12:35:49.907 INFO:tasks.rados.rados.0.smithi084.stdout:3941: writing smithi08477944-28 from 622592 to 1212416 tid 1 2024-03-30T12:35:49.910 INFO:tasks.rados.rados.0.smithi084.stdout:3941: writing smithi08477944-28 from 1212416 to 1613824 tid 2 2024-03-30T12:35:49.910 INFO:tasks.rados.rados.0.smithi084.stdout:3942: delete oid 5 current snap is 395 2024-03-30T12:35:49.910 INFO:tasks.rados.rados.0.smithi084.stdout:3940: expect (ObjNum 1168 snap 380 seq_num 1168) 2024-03-30T12:35:49.945 INFO:tasks.rados.rados.0.smithi084.stdout:3941: finishing write tid 1 to smithi08477944-28 2024-03-30T12:35:49.946 INFO:tasks.rados.rados.0.smithi084.stdout:3936: done (5 left) 2024-03-30T12:35:49.946 INFO:tasks.rados.rados.0.smithi084.stdout:3938: done (4 left) 2024-03-30T12:35:49.946 INFO:tasks.rados.rados.0.smithi084.stdout:3940: done (3 left) 2024-03-30T12:35:49.946 INFO:tasks.rados.rados.0.smithi084.stdout:3942: done (2 left) 2024-03-30T12:35:49.946 INFO:tasks.rados.rados.0.smithi084.stdout:3943: read oid 42 snap -1 2024-03-30T12:35:49.946 INFO:tasks.rados.rados.0.smithi084.stdout:3943: expect deleted 2024-03-30T12:35:49.946 INFO:tasks.rados.rados.0.smithi084.stdout:3944: copy_from oid 34 from oid 24 current snap is 395 2024-03-30T12:35:49.946 INFO:tasks.rados.rados.0.smithi084.stdout:3941: finishing write tid 2 to smithi08477944-28 2024-03-30T12:35:49.946 INFO:tasks.rados.rados.0.smithi084.stdout:3941: finishing write tid 3 to smithi08477944-28 2024-03-30T12:35:49.946 INFO:tasks.rados.rados.0.smithi084.stdout:3941: finishing write tid 4 to smithi08477944-28 2024-03-30T12:35:49.946 INFO:tasks.rados.rados.0.smithi084.stdout:3941: oid 28 updating version 0 to 36421 2024-03-30T12:35:49.946 INFO:tasks.rados.rados.0.smithi084.stdout:3941: oid 28 version 36421 is already newer than 36420 2024-03-30T12:35:49.947 INFO:tasks.rados.rados.0.smithi084.stdout:3941: oid 28 version 36421 is already newer than 36419 2024-03-30T12:35:49.947 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 28 v 36421 (ObjNum 1205 snap 395 seq_num 1205) dirty exists 2024-03-30T12:35:49.947 INFO:tasks.rados.rados.0.smithi084.stdout:3941: left oid 28 (ObjNum 1205 snap 395 seq_num 1205) 2024-03-30T12:35:49.947 INFO:tasks.rados.rados.0.smithi084.stdout:3939: finishing copy_from racing read to smithi08477944-35 2024-03-30T12:35:49.947 INFO:tasks.rados.rados.0.smithi084.stdout:3939: finishing copy_from to smithi08477944-35 2024-03-30T12:35:49.947 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 35 v 36340 (ObjNum 1186 snap 383 seq_num 1186) dirty exists 2024-03-30T12:35:49.947 INFO:tasks.rados.rados.0.smithi084.stdout:3939: done (3 left) 2024-03-30T12:35:49.947 INFO:tasks.rados.rados.0.smithi084.stdout:3941: done (2 left) 2024-03-30T12:35:49.947 INFO:tasks.rados.rados.0.smithi084.stdout:3945: copy_from oid 33 from oid 43 current snap is 395 2024-03-30T12:35:49.947 INFO:tasks.rados.rados.0.smithi084.stdout:3946: copy_from oid 12 from oid 47 current snap is 395 2024-03-30T12:35:49.947 INFO:tasks.rados.rados.0.smithi084.stdout:3947: copy_from oid 38 from oid 18 current snap is 395 2024-03-30T12:35:49.947 INFO:tasks.rados.rados.0.smithi084.stdout:3948: snap_create 2024-03-30T12:35:49.947 INFO:tasks.rados.rados.0.smithi084.stdout:3947: finishing copy_from to smithi08477944-38 2024-03-30T12:35:49.948 INFO:tasks.rados.rados.0.smithi084.stdout:3947: got expected ENOENT (src dne) 2024-03-30T12:35:49.948 INFO:tasks.rados.rados.0.smithi084.stdout:3947: finishing copy_from racing read to smithi08477944-38 2024-03-30T12:35:49.950 INFO:tasks.rados.rados.0.smithi084.stdout:3946: finishing copy_from racing read to smithi08477944-12 2024-03-30T12:35:49.951 INFO:tasks.rados.rados.0.smithi084.stdout:3946: finishing copy_from to smithi08477944-12 2024-03-30T12:35:49.951 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 12 v 36348 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-03-30T12:35:49.959 INFO:tasks.rados.rados.0.smithi084.stdout:3945: finishing copy_from racing read to smithi08477944-33 2024-03-30T12:35:49.960 INFO:tasks.rados.rados.0.smithi084.stdout:3945: finishing copy_from to smithi08477944-33 2024-03-30T12:35:49.960 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 33 v 36425 (ObjNum 1062 snap 344 seq_num 1062) dirty exists 2024-03-30T12:35:49.969 INFO:tasks.rados.rados.0.smithi084.stdout:3944: finishing copy_from racing read to smithi08477944-34 2024-03-30T12:35:49.973 INFO:tasks.rados.rados.0.smithi084.stdout:3944: finishing copy_from to smithi08477944-34 2024-03-30T12:35:49.973 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 23455 (ObjNum 1153 snap 376 seq_num 1153) dirty exists 2024-03-30T12:35:50.170 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:49.921+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:50.170 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:49.922+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:50.170 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:49.907+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:50.170 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:49.907+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:50.171 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:49.907+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:50.171 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:49.907+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:50.171 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:49.908+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:50.171 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:49.908+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:50.171 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:50.171 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:50.171 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:50.171 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:50.172 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:50.172 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:50.172 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:50.172 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:50.172 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[89279]: osdmap e852: 8 total, 8 up, 8 in 2024-03-30T12:35:50.172 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:50.172 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:50.172 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:50.172 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:50.172 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:50.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:50.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:50.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:50.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:50.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:50.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:50.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:50.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[91810]: osdmap e852: 8 total, 8 up, 8 in 2024-03-30T12:35:50.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:50.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:50.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:50.173 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:49 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:50.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:49.961+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:50.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:49.934+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:50.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:49.934+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:50.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:49.907+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:50.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:49.908+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:50.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:49.903+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:50.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:49.903+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:50.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:49.904+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:50.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:50.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:50.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:50.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:50.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:50.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:50.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:50.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:50.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:49 smithi162 ceph-mon[83709]: osdmap e852: 8 total, 8 up, 8 in 2024-03-30T12:35:50.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:50.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:49 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:50.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:50.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:49 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:50.912 INFO:tasks.rados.rados.0.smithi084.stdout:3943: done (5 left) 2024-03-30T12:35:50.913 INFO:tasks.rados.rados.0.smithi084.stdout:3944: done (4 left) 2024-03-30T12:35:50.913 INFO:tasks.rados.rados.0.smithi084.stdout:3945: done (3 left) 2024-03-30T12:35:50.913 INFO:tasks.rados.rados.0.smithi084.stdout:3946: done (2 left) 2024-03-30T12:35:50.913 INFO:tasks.rados.rados.0.smithi084.stdout:3947: done (1 left) 2024-03-30T12:35:50.913 INFO:tasks.rados.rados.0.smithi084.stdout:3948: done (0 left) 2024-03-30T12:35:50.913 INFO:tasks.rados.rados.0.smithi084.stdout:3949: rollback oid 1 current snap is 396 2024-03-30T12:35:50.913 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 1 to 392 2024-03-30T12:35:50.913 INFO:tasks.rados.rados.0.smithi084.stdout:3950: delete oid 16 current snap is 396 2024-03-30T12:35:50.917 INFO:tasks.rados.rados.0.smithi084.stdout:3949: finishing rollback tid 1 to smithi08477944-1 2024-03-30T12:35:50.917 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 1 v 36328 (ObjNum 65 snap 0 seq_num 1634623313) dirty dne 2024-03-30T12:35:50.917 INFO:tasks.rados.rados.0.smithi084.stdout:3949: done (1 left) 2024-03-30T12:35:50.917 INFO:tasks.rados.rados.0.smithi084.stdout:3950: done (0 left) 2024-03-30T12:35:50.917 INFO:tasks.rados.rados.0.smithi084.stdout:3951: setattr oid 37 current snap is 396 2024-03-30T12:35:50.919 INFO:tasks.rados.rados.0.smithi084.stdout:3952: snap_create 2024-03-30T12:35:50.927 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 37 v 36419 (ObjNum 1142 snap 374 seq_num 1142) dirty exists 2024-03-30T12:35:51.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:50.926+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:51.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:50.926+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:51.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:50.919+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:51.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:50.919+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:51.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:50.919+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:51.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:50.919+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:51.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:50.919+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:51.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:51.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:51.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:51.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:51.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:51.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:51.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:51.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[91810]: osdmap e853: 8 total, 8 up, 8 in 2024-03-30T12:35:51.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:51.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:51.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:51.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:51.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:51.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:51.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[91810]: pgmap v971: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 5.0 MiB/s rd, 3.8 MiB/s wr, 18 op/s 2024-03-30T12:35:51.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:51.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:51.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:51.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:51.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:51.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:51.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:51.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[89279]: osdmap e853: 8 total, 8 up, 8 in 2024-03-30T12:35:51.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:51.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:51.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:51.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:51.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:51.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:51.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:50 smithi084 ceph-mon[89279]: pgmap v971: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 5.0 MiB/s rd, 3.8 MiB/s wr, 18 op/s 2024-03-30T12:35:51.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:50.935+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:51.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:50.924+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:51.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:50.925+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:51.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:50.925+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:51.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:50.920+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:51.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:50.921+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:51.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:50.927+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:51.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:50.927+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:51.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:51.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:51.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:51.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 195=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:51.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:51.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1b4=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:51.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:51.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:50 smithi162 ceph-mon[83709]: osdmap e853: 8 total, 8 up, 8 in 2024-03-30T12:35:51.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:51.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:51.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:51.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:50 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:51.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:51.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:50 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:51.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:50 smithi162 ceph-mon[83709]: pgmap v971: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 5.0 MiB/s rd, 3.8 MiB/s wr, 18 op/s 2024-03-30T12:35:51.921 INFO:tasks.rados.rados.0.smithi084.stdout:3951: done (1 left) 2024-03-30T12:35:51.921 INFO:tasks.rados.rados.0.smithi084.stdout:3952: done (0 left) 2024-03-30T12:35:51.921 INFO:tasks.rados.rados.0.smithi084.stdout:3953: read oid 14 snap -1 2024-03-30T12:35:51.921 INFO:tasks.rados.rados.0.smithi084.stdout:3953: expect (ObjNum 1191 snap 384 seq_num 1191) 2024-03-30T12:35:51.921 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 32 current snap is 397 2024-03-30T12:35:51.921 INFO:tasks.rados.rados.0.smithi084.stdout:3954: seq_num 1208 ranges {0=638976,638976=401408} 2024-03-30T12:35:51.923 INFO:tasks.rados.rados.0.smithi084.stdout:3954: writing smithi08477944-32 from 0 to 638976 tid 1 2024-03-30T12:35:51.926 INFO:tasks.rados.rados.0.smithi084.stdout:3954: writing smithi08477944-32 from 638976 to 1040384 tid 2 2024-03-30T12:35:51.926 INFO:tasks.rados.rados.0.smithi084.stdout:3955: read oid 19 snap -1 2024-03-30T12:35:51.927 INFO:tasks.rados.rados.0.smithi084.stdout:3955: expect (ObjNum 1149 snap 375 seq_num 1149) 2024-03-30T12:35:51.927 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 397 2024-03-30T12:35:51.927 INFO:tasks.rados.rados.0.smithi084.stdout:3956: seq_num 1209 ranges {4513792=655360,5169152=401408} 2024-03-30T12:35:51.955 INFO:tasks.rados.rados.0.smithi084.stdout:3956: writing smithi08477944-26 from 4513792 to 5169152 tid 1 2024-03-30T12:35:51.958 INFO:tasks.rados.rados.0.smithi084.stdout:3956: writing smithi08477944-26 from 5169152 to 5570560 tid 2 2024-03-30T12:35:51.958 INFO:tasks.rados.rados.0.smithi084.stdout:3957: snap_create 2024-03-30T12:35:51.958 INFO:tasks.rados.rados.0.smithi084.stdout:3953: expect (ObjNum 1191 snap 384 seq_num 1191) 2024-03-30T12:35:51.979 INFO:tasks.rados.rados.0.smithi084.stdout:3955: expect (ObjNum 1149 snap 375 seq_num 1149) 2024-03-30T12:35:51.980 INFO:tasks.rados.rados.0.smithi084.stdout:3954: finishing write tid 1 to smithi08477944-32 2024-03-30T12:35:51.980 INFO:tasks.rados.rados.0.smithi084.stdout:3954: finishing write tid 2 to smithi08477944-32 2024-03-30T12:35:51.980 INFO:tasks.rados.rados.0.smithi084.stdout:3954: finishing write tid 3 to smithi08477944-32 2024-03-30T12:35:51.980 INFO:tasks.rados.rados.0.smithi084.stdout:3954: finishing write tid 4 to smithi08477944-32 2024-03-30T12:35:51.980 INFO:tasks.rados.rados.0.smithi084.stdout:3954: oid 32 updating version 0 to 36351 2024-03-30T12:35:51.980 INFO:tasks.rados.rados.0.smithi084.stdout:3954: oid 32 version 36351 is already newer than 36350 2024-03-30T12:35:51.981 INFO:tasks.rados.rados.0.smithi084.stdout:3954: oid 32 updating version 36351 to 36352 2024-03-30T12:35:51.981 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 32 v 36352 (ObjNum 1208 snap 397 seq_num 1208) dirty exists 2024-03-30T12:35:51.981 INFO:tasks.rados.rados.0.smithi084.stdout:3954: left oid 32 (ObjNum 1208 snap 397 seq_num 1208) 2024-03-30T12:35:51.981 INFO:tasks.rados.rados.0.smithi084.stdout:3956: finishing write tid 1 to smithi08477944-26 2024-03-30T12:35:51.981 INFO:tasks.rados.rados.0.smithi084.stdout:3956: finishing write tid 2 to smithi08477944-26 2024-03-30T12:35:51.981 INFO:tasks.rados.rados.0.smithi084.stdout:3956: finishing write tid 3 to smithi08477944-26 2024-03-30T12:35:51.981 INFO:tasks.rados.rados.0.smithi084.stdout:3956: finishing write tid 4 to smithi08477944-26 2024-03-30T12:35:51.981 INFO:tasks.rados.rados.0.smithi084.stdout:3956: oid 26 updating version 0 to 36349 2024-03-30T12:35:51.981 INFO:tasks.rados.rados.0.smithi084.stdout:3956: oid 26 updating version 36349 to 36351 2024-03-30T12:35:51.981 INFO:tasks.rados.rados.0.smithi084.stdout:3956: oid 26 version 36351 is already newer than 36350 2024-03-30T12:35:51.981 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 36351 (ObjNum 1209 snap 397 seq_num 1209) dirty exists 2024-03-30T12:35:51.981 INFO:tasks.rados.rados.0.smithi084.stdout:3956: left oid 26 (ObjNum 1209 snap 397 seq_num 1209) 2024-03-30T12:35:52.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:51.936+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:52.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:51.943+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:52.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:52.058+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:52.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:52.058+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:52.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:52.058+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:52.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:52.058+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:52.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:52.058+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:52.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:52.058+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:52.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:52.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:52.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:52.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:52.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:52.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[91810]: osdmap e854: 8 total, 8 up, 8 in 2024-03-30T12:35:52.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:52.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:52.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:52.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:52.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:52.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:52.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:52.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:52.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:52.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:52.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:52.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:52.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:52.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:52.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[89279]: osdmap e854: 8 total, 8 up, 8 in 2024-03-30T12:35:52.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:52.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:52.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:52.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:52.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:52.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:52.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:52.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:52.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:51 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:52.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:51.939+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:52.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:51.932+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:52.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:51.932+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:52.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:51.929+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:52.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:51.929+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:52.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:51.979+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:52.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:51.979+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:52.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:51.979+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:52.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:52.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:52.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:52.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:52.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:52.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:51 smithi162 ceph-mon[83709]: osdmap e854: 8 total, 8 up, 8 in 2024-03-30T12:35:52.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:52.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:52.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:52.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:52.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:52.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:51 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:52.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:52.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:52.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:51 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:52.928 INFO:tasks.rados.rados.0.smithi084.stdout:3953: done (4 left) 2024-03-30T12:35:52.929 INFO:tasks.rados.rados.0.smithi084.stdout:3954: done (3 left) 2024-03-30T12:35:52.929 INFO:tasks.rados.rados.0.smithi084.stdout:3955: done (2 left) 2024-03-30T12:35:52.929 INFO:tasks.rados.rados.0.smithi084.stdout:3956: done (1 left) 2024-03-30T12:35:52.929 INFO:tasks.rados.rados.0.smithi084.stdout:3957: done (0 left) 2024-03-30T12:35:52.929 INFO:tasks.rados.rados.0.smithi084.stdout:3958: snap_create 2024-03-30T12:35:53.183 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:52.936+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:53.183 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:52.936+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:53.184 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:52.937+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:53.184 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:52.938+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:53.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:52 smithi162 ceph-mon[83709]: osdmap e855: 8 total, 8 up, 8 in 2024-03-30T12:35:53.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:53.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:53.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:53.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:53.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:53.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:53.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:52 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:53.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:53.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:52 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:53.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:52 smithi162 ceph-mon[83709]: pgmap v974: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 7.4 MiB/s rd, 1.1 MiB/s wr, 7 op/s 2024-03-30T12:35:53.185 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-mon[91810]: osdmap e855: 8 total, 8 up, 8 in 2024-03-30T12:35:53.185 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:53.185 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:53.185 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:53.185 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:53.185 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:53.186 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:53.186 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:53.186 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:53.186 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:53.186 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-mon[91810]: pgmap v974: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 7.4 MiB/s rd, 1.1 MiB/s wr, 7 op/s 2024-03-30T12:35:53.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-mon[89279]: osdmap e855: 8 total, 8 up, 8 in 2024-03-30T12:35:53.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:53.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:53.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:53.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:53.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:53.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:53.187 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:53.187 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:53.187 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:53.187 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:52 smithi084 ceph-mon[89279]: pgmap v974: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 7.4 MiB/s rd, 1.1 MiB/s wr, 7 op/s 2024-03-30T12:35:53.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:53.193+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:53.503 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:53.193+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:53.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:53.190+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:53.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:53.191+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:53.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:53.191+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:53.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:53.191+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:53.504 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:53.192+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:53.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:53.191+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:53.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:53.191+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:53.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:53.192+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:53.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:53.192+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:53.938 INFO:tasks.rados.rados.0.smithi084.stdout:3958: done (0 left) 2024-03-30T12:35:53.938 INFO:tasks.rados.rados.0.smithi084.stdout:3959: snap_create 2024-03-30T12:35:54.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:54.039+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:54.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:54.039+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:54.253 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:53.945+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:54.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:53.945+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:54.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:53.946+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:54.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:53.946+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:54.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:53.946+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:54.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:53.946+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:54.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:54.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:54.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:54.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:54.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:54.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:54.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[89279]: osdmap e856: 8 total, 8 up, 8 in 2024-03-30T12:35:54.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:54.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:54.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:54.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:54.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:54.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:54.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:54.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:54.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:54.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[91810]: osdmap e856: 8 total, 8 up, 8 in 2024-03-30T12:35:54.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:54.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:54.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:54.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:54.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:54.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:54.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:54.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:54.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:53 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:54.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:53.943+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:54.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:53.944+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:54.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:54.146+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:54.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:54.146+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:54.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:54.146+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:54.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:53.946+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:54.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:53.946+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:54.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:54.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:54.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:54.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:54.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:54.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:54.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:53 smithi162 ceph-mon[83709]: osdmap e856: 8 total, 8 up, 8 in 2024-03-30T12:35:54.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:54.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:54.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:54.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:53 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:54.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:54.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:53 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:54.946 INFO:tasks.rados.rados.0.smithi084.stdout:3959: done (0 left) 2024-03-30T12:35:54.946 INFO:tasks.rados.rados.0.smithi084.stdout:3960: copy_from oid 44 from oid 9 current snap is 400 2024-03-30T12:35:54.946 INFO:tasks.rados.rados.0.smithi084.stdout:3961: setattr oid 17 current snap is 400 2024-03-30T12:35:54.947 INFO:tasks.rados.rados.0.smithi084.stdout:3962: delete oid 14 current snap is 400 2024-03-30T12:35:54.954 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 17 v 27431 (ObjNum 1171 snap 381 seq_num 1171) dirty exists 2024-03-30T12:35:54.954 INFO:tasks.rados.rados.0.smithi084.stdout:3961: done (2 left) 2024-03-30T12:35:54.954 INFO:tasks.rados.rados.0.smithi084.stdout:3962: done (1 left) 2024-03-30T12:35:54.954 INFO:tasks.rados.rados.0.smithi084.stdout:3963: setattr oid 24 current snap is 400 2024-03-30T12:35:54.957 INFO:tasks.rados.rados.0.smithi084.stdout:3964: delete oid 31 current snap is 400 2024-03-30T12:35:54.958 INFO:tasks.rados.rados.0.smithi084.stdout:3960: finishing copy_from racing read to smithi08477944-44 2024-03-30T12:35:54.962 INFO:tasks.rados.rados.0.smithi084.stdout:3960: finishing copy_from to smithi08477944-44 2024-03-30T12:35:54.962 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 44 v 36404 (ObjNum 1149 snap 375 seq_num 1149) dirty exists 2024-03-30T12:35:54.962 INFO:tasks.rados.rados.0.smithi084.stdout:3960: done (2 left) 2024-03-30T12:35:54.963 INFO:tasks.rados.rados.0.smithi084.stdout:3964: done (1 left) 2024-03-30T12:35:54.963 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 46 current snap is 400 2024-03-30T12:35:54.963 INFO:tasks.rados.rados.0.smithi084.stdout:3965: seq_num 1212 ranges {704512=704512,1409024=401408} 2024-03-30T12:35:54.968 INFO:tasks.rados.rados.0.smithi084.stdout:3965: writing smithi08477944-46 from 704512 to 1409024 tid 1 2024-03-30T12:35:54.971 INFO:tasks.rados.rados.0.smithi084.stdout:3965: writing smithi08477944-46 from 1409024 to 1810432 tid 2 2024-03-30T12:35:54.971 INFO:tasks.rados.rados.0.smithi084.stdout:3966: setattr oid 19 current snap is 400 2024-03-30T12:35:54.971 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 24 v 23459 (ObjNum 1153 snap 376 seq_num 1153) dirty exists 2024-03-30T12:35:54.973 INFO:tasks.rados.rados.0.smithi084.stdout:3963: done (2 left) 2024-03-30T12:35:54.973 INFO:tasks.rados.rados.0.smithi084.stdout:3967: rollback oid 50 current snap is 400 2024-03-30T12:35:54.973 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 50 to 399 2024-03-30T12:35:54.973 INFO:tasks.rados.rados.0.smithi084.stdout:3968: rollback oid 39 current snap is 400 2024-03-30T12:35:54.973 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 39 to 385 2024-03-30T12:35:54.973 INFO:tasks.rados.rados.0.smithi084.stdout:3969: rollback oid 18 current snap is 400 2024-03-30T12:35:54.973 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 18 to 389 2024-03-30T12:35:54.973 INFO:tasks.rados.rados.0.smithi084.stdout:3970: delete oid 28 current snap is 400 2024-03-30T12:35:54.979 INFO:tasks.rados.rados.0.smithi084.stdout:3968: finishing rollback tid 0 to smithi08477944-39 2024-03-30T12:35:54.979 INFO:tasks.rados.rados.0.smithi084.stdout:3968: finishing rollback tid 1 to smithi08477944-39 2024-03-30T12:35:54.979 INFO:tasks.rados.rados.0.smithi084.stdout:3968: finishing rollback tid 2 to smithi08477944-39 2024-03-30T12:35:54.980 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 39 v 27434 (ObjNum 1023 snap 328 seq_num 1023) dirty exists 2024-03-30T12:35:54.980 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 36429 (ObjNum 1149 snap 375 seq_num 1149) dirty exists 2024-03-30T12:35:54.980 INFO:tasks.rados.rados.0.smithi084.stdout:3967: finishing rollback tid 1 to smithi08477944-50 2024-03-30T12:35:54.980 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 36332 (ObjNum 161 snap 0 seq_num 0) dirty dne 2024-03-30T12:35:54.980 INFO:tasks.rados.rados.0.smithi084.stdout:3969: finishing rollback tid 1 to smithi08477944-18 2024-03-30T12:35:54.981 INFO:tasks.rados.rados.0.smithi084.stdout:3966: done (5 left) 2024-03-30T12:35:54.981 INFO:tasks.rados.rados.0.smithi084.stdout:3967: done (4 left) 2024-03-30T12:35:54.981 INFO:tasks.rados.rados.0.smithi084.stdout:3968: done (3 left) 2024-03-30T12:35:54.981 INFO:tasks.rados.rados.0.smithi084.stdout:3970: done (2 left) 2024-03-30T12:35:54.981 INFO:tasks.rados.rados.0.smithi084.stdout:3971: setattr oid 31 current snap is 400 2024-03-30T12:35:54.981 INFO:tasks.rados.rados.0.smithi084.stdout:3969: finishing rollback tid 2 to smithi08477944-18 2024-03-30T12:35:54.981 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 18 v 36360 (ObjNum 825 snap 273 seq_num 825) dirty exists 2024-03-30T12:35:54.983 INFO:tasks.rados.rados.0.smithi084.stdout:3969: done (2 left) 2024-03-30T12:35:54.983 INFO:tasks.rados.rados.0.smithi084.stdout:3972: rollback oid 16 current snap is 400 2024-03-30T12:35:54.983 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 16 to 369 2024-03-30T12:35:54.983 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 19 current snap is 400 2024-03-30T12:35:54.983 INFO:tasks.rados.rados.0.smithi084.stdout:3973: seq_num 1214 ranges {49152=737280,786432=401408} 2024-03-30T12:35:54.988 INFO:tasks.rados.rados.0.smithi084.stdout:3973: writing smithi08477944-19 from 49152 to 786432 tid 1 2024-03-30T12:35:54.991 INFO:tasks.rados.rados.0.smithi084.stdout:3973: writing smithi08477944-19 from 786432 to 1187840 tid 2 2024-03-30T12:35:54.991 INFO:tasks.rados.rados.0.smithi084.stdout:3974: read oid 1 snap -1 2024-03-30T12:35:54.991 INFO:tasks.rados.rados.0.smithi084.stdout:3974: expect deleted 2024-03-30T12:35:54.991 INFO:tasks.rados.rados.0.smithi084.stdout:3975: snap_remove snap 385 2024-03-30T12:35:55.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:54.959+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:55.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:54.962+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:55.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:55.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:55.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:55.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:55.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:55.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:55.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:55.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:55.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:55.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:55.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:55.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:54.951+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:55.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:54.951+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:55.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:54.952+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:55.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:54.952+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:55.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:54.952+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:55.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:55.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[89279]: osdmap e857: 8 total, 8 up, 8 in 2024-03-30T12:35:55.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:55.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:55.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:55.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:55.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:55.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[89279]: pgmap v977: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 3.4 MiB/s rd, 3.0 MiB/s wr, 13 op/s 2024-03-30T12:35:55.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:55.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:55.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:55.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:55.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:55.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:55.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:55.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:55.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:55.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:55.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:55.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:55.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[91810]: osdmap e857: 8 total, 8 up, 8 in 2024-03-30T12:35:55.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:55.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:55.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:55.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:55.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:55.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:54 smithi084 ceph-mon[91810]: pgmap v977: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 3.4 MiB/s rd, 3.0 MiB/s wr, 13 op/s 2024-03-30T12:35:55.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:54.958+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:55.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:54.958+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:55.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:54.958+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:55.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:54.952+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:55.371 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:54.953+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:55.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:54.961+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:55.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:54.961+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:55.371 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:54.953+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:55.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:55.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:55.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:55.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:55.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:55.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:55.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:55.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:55.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:55.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:55.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:55.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:55.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-mon[83709]: osdmap e857: 8 total, 8 up, 8 in 2024-03-30T12:35:55.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:55.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:55.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:55.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:55.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:55.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:54 smithi162 ceph-mon[83709]: pgmap v977: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 3.4 MiB/s rd, 3.0 MiB/s wr, 13 op/s 2024-03-30T12:35:55.947 INFO:tasks.rados.rados.0.smithi084.stdout:3965: finishing write tid 1 to smithi08477944-46 2024-03-30T12:35:55.947 INFO:tasks.rados.rados.0.smithi084.stdout:3965: finishing write tid 2 to smithi08477944-46 2024-03-30T12:35:55.947 INFO:tasks.rados.rados.0.smithi084.stdout:3965: finishing write tid 3 to smithi08477944-46 2024-03-30T12:35:55.947 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 31 v 36424 (ObjNum 65 snap 0 seq_num 1432900191) dirty exists 2024-03-30T12:35:55.947 INFO:tasks.rados.rados.0.smithi084.stdout:3972: finishing rollback tid 1 to smithi08477944-16 2024-03-30T12:35:55.948 INFO:tasks.rados.rados.0.smithi084.stdout:3972: finishing rollback tid 2 to smithi08477944-16 2024-03-30T12:35:55.948 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 16 v 36362 (ObjNum 1023 snap 328 seq_num 1023) dirty exists 2024-03-30T12:35:55.948 INFO:tasks.rados.rados.0.smithi084.stdout:3965: finishing write tid 4 to smithi08477944-46 2024-03-30T12:35:55.948 INFO:tasks.rados.rados.0.smithi084.stdout:3965: oid 46 updating version 0 to 36352 2024-03-30T12:35:55.948 INFO:tasks.rados.rados.0.smithi084.stdout:3965: oid 46 updating version 36352 to 36353 2024-03-30T12:35:55.948 INFO:tasks.rados.rados.0.smithi084.stdout:3965: oid 46 updating version 36353 to 36354 2024-03-30T12:35:55.948 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 46 v 36354 (ObjNum 1212 snap 400 seq_num 1212) dirty exists 2024-03-30T12:35:55.948 INFO:tasks.rados.rados.0.smithi084.stdout:3965: left oid 46 (ObjNum 1212 snap 400 seq_num 1212) 2024-03-30T12:35:55.948 INFO:tasks.rados.rados.0.smithi084.stdout:3973: finishing write tid 1 to smithi08477944-19 2024-03-30T12:35:55.948 INFO:tasks.rados.rados.0.smithi084.stdout:3973: finishing write tid 2 to smithi08477944-19 2024-03-30T12:35:55.948 INFO:tasks.rados.rados.0.smithi084.stdout:3973: finishing write tid 3 to smithi08477944-19 2024-03-30T12:35:55.948 INFO:tasks.rados.rados.0.smithi084.stdout:3973: finishing write tid 4 to smithi08477944-19 2024-03-30T12:35:55.948 INFO:tasks.rados.rados.0.smithi084.stdout:3973: oid 19 updating version 0 to 36430 2024-03-30T12:35:55.948 INFO:tasks.rados.rados.0.smithi084.stdout:3973: oid 19 updating version 36430 to 36432 2024-03-30T12:35:55.949 INFO:tasks.rados.rados.0.smithi084.stdout:3973: oid 19 version 36432 is already newer than 36431 2024-03-30T12:35:55.949 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 19 v 36432 (ObjNum 1214 snap 400 seq_num 1214) dirty exists 2024-03-30T12:35:55.949 INFO:tasks.rados.rados.0.smithi084.stdout:3973: left oid 19 (ObjNum 1214 snap 400 seq_num 1214) 2024-03-30T12:35:55.949 INFO:tasks.rados.rados.0.smithi084.stdout:3965: done (5 left) 2024-03-30T12:35:55.949 INFO:tasks.rados.rados.0.smithi084.stdout:3971: done (4 left) 2024-03-30T12:35:55.949 INFO:tasks.rados.rados.0.smithi084.stdout:3972: done (3 left) 2024-03-30T12:35:55.949 INFO:tasks.rados.rados.0.smithi084.stdout:3973: done (2 left) 2024-03-30T12:35:55.949 INFO:tasks.rados.rados.0.smithi084.stdout:3974: done (1 left) 2024-03-30T12:35:55.949 INFO:tasks.rados.rados.0.smithi084.stdout:3975: done (0 left) 2024-03-30T12:35:55.949 INFO:tasks.rados.rados.0.smithi084.stdout:3976: copy_from oid 47 from oid 29 current snap is 400 2024-03-30T12:35:55.949 INFO:tasks.rados.rados.0.smithi084.stdout:3977: snap_create 2024-03-30T12:35:55.965 INFO:tasks.rados.rados.0.smithi084.stdout:3976: finishing copy_from racing read to smithi08477944-47 2024-03-30T12:35:55.971 INFO:tasks.rados.rados.0.smithi084.stdout:3976: finishing copy_from to smithi08477944-47 2024-03-30T12:35:55.971 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 47 v 36418 (ObjNum 1155 snap 377 seq_num 1155) dirty exists 2024-03-30T12:35:56.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:55.961+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:56.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:55.963+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:56.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:55.953+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:56.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:55.953+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:56.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:55.953+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:56.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:55.953+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:56.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:55.953+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:56.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:55.954+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[91810]: osdmap e858: 8 total, 8 up, 8 in 2024-03-30T12:35:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:56.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:56.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:56.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:56.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:56.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[89279]: osdmap e858: 8 total, 8 up, 8 in 2024-03-30T12:35:56.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:56.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:56.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:56.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:56.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:56.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:55 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:56.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:55.955+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:56.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:55.955+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:56.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:55.955+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:56.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:55.955+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:56.370 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:56.160+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:56.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:55.958+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:56.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:55.958+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:56.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:55.958+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:55 smithi162 ceph-mon[83709]: osdmap e858: 8 total, 8 up, 8 in 2024-03-30T12:35:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:56.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:56.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:56.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:56.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:55 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:56.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:55 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:56.959 INFO:tasks.rados.rados.0.smithi084.stdout:3976: done (1 left) 2024-03-30T12:35:56.959 INFO:tasks.rados.rados.0.smithi084.stdout:3977: done (0 left) 2024-03-30T12:35:56.959 INFO:tasks.rados.rados.0.smithi084.stdout:3978: snap_remove snap 396 2024-03-30T12:35:57.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[89279]: osdmap e859: 8 total, 8 up, 8 in 2024-03-30T12:35:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:57.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:57.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:56.964+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:57.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:56.964+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:57.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:56.965+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:57.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:56.965+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:57.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:56.965+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:57.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:57.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:57.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:57.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:57.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:57.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[91810]: osdmap e859: 8 total, 8 up, 8 in 2024-03-30T12:35:57.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:57.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:57.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:57.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:57.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:57.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:57.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:57.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:57.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:57.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[89279]: pgmap v980: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 553 KiB/s rd, 3.7 MiB/s wr, 23 op/s 2024-03-30T12:35:57.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:57.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:57.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:57.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:57.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:57.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:56 smithi084 ceph-mon[91810]: pgmap v980: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 553 KiB/s rd, 3.7 MiB/s wr, 23 op/s 2024-03-30T12:35:57.293 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:56.967+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:57.293 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:56.966+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:57.293 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:56.966+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:57.294 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:57.294 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:57.294 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:57.294 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:57.294 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:57.294 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:56 smithi162 ceph-mon[83709]: osdmap e859: 8 total, 8 up, 8 in 2024-03-30T12:35:57.294 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:57.294 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:57.294 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:57.295 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:57.295 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:57.295 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:57.295 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:57.295 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:56 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:57.295 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:56 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:57.295 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:56 smithi162 ceph-mon[83709]: pgmap v980: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 553 KiB/s rd, 3.7 MiB/s wr, 23 op/s 2024-03-30T12:35:57.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:57.300+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:57.619 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:57.301+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:57.620 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:57.301+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:57.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:57.339+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:57.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:57.339+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:57.965 INFO:tasks.rados.rados.0.smithi084.stdout:3978: done (0 left) 2024-03-30T12:35:57.965 INFO:tasks.rados.rados.0.smithi084.stdout:3979: rollback oid 34 current snap is 401 2024-03-30T12:35:57.965 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 34 to 389 2024-03-30T12:35:57.965 INFO:tasks.rados.rados.0.smithi084.stdout:3980: read oid 8 snap 391 2024-03-30T12:35:57.965 INFO:tasks.rados.rados.0.smithi084.stdout:3980: expect (ObjNum 1430033344 snap 21994 seq_num 1429558880) 2024-03-30T12:35:57.965 INFO:tasks.rados.rados.0.smithi084.stdout:3981: copy_from oid 45 from oid 7 current snap is 401 2024-03-30T12:35:57.965 INFO:tasks.rados.rados.0.smithi084.stdout:3982: read oid 42 snap -1 2024-03-30T12:35:57.965 INFO:tasks.rados.rados.0.smithi084.stdout:3982: expect deleted 2024-03-30T12:35:57.965 INFO:tasks.rados.rados.0.smithi084.stdout:3983: snap_create 2024-03-30T12:35:57.974 INFO:tasks.rados.rados.0.smithi084.stdout:3980: expect (ObjNum 1430033344 snap 21994 seq_num 1429558880) 2024-03-30T12:35:57.975 INFO:tasks.rados.rados.0.smithi084.stdout:3979: finishing rollback tid 0 to smithi08477944-34 2024-03-30T12:35:57.975 INFO:tasks.rados.rados.0.smithi084.stdout:3979: finishing rollback tid 1 to smithi08477944-34 2024-03-30T12:35:57.975 INFO:tasks.rados.rados.0.smithi084.stdout:3979: finishing rollback tid 2 to smithi08477944-34 2024-03-30T12:35:57.975 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 36351 (ObjNum 1197 snap 388 seq_num 1197) dirty exists 2024-03-30T12:35:57.978 INFO:tasks.rados.rados.0.smithi084.stdout:3981: finishing copy_from racing read to smithi08477944-45 2024-03-30T12:35:57.982 INFO:tasks.rados.rados.0.smithi084.stdout:3981: finishing copy_from to smithi08477944-45 2024-03-30T12:35:57.982 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 36342 (ObjNum 1172 snap 381 seq_num 1172) dirty exists 2024-03-30T12:35:58.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:57.782+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:58.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:57.783+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:58.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:57.981+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:58.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:57.982+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:58.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:58.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:58.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:58.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:58.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:58.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:58.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[91810]: osdmap e860: 8 total, 8 up, 8 in 2024-03-30T12:35:58.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:58.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:58.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:58.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:58.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:58.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:58.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:58.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:58.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:58.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[89279]: osdmap e860: 8 total, 8 up, 8 in 2024-03-30T12:35:58.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:58.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:58.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:58.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:57.969+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:58.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:57.969+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:58.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:57.970+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:58.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:57.970+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:58.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:57.970+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:58.256 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:57.971+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:58.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:58.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:58.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:58.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:58.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:58.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:58.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:58.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:57 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:58.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:57.967+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:58.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:57.967+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:58.370 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:57.978+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:58.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:57.969+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:58.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:57.969+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:58.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:57.982+0000 7f8307353700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:35:58.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:57.982+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:58.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:57.983+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:58.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:58.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:58.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:58.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:58.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:58.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:58.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-mon[83709]: osdmap e860: 8 total, 8 up, 8 in 2024-03-30T12:35:58.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:58.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:58.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:58.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:58.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:58.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:58.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:57 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:58.982 INFO:tasks.rados.rados.0.smithi084.stdout:3979: done (4 left) 2024-03-30T12:35:58.983 INFO:tasks.rados.rados.0.smithi084.stdout:3980: done (3 left) 2024-03-30T12:35:58.983 INFO:tasks.rados.rados.0.smithi084.stdout:3981: done (2 left) 2024-03-30T12:35:58.983 INFO:tasks.rados.rados.0.smithi084.stdout:3982: done (1 left) 2024-03-30T12:35:58.983 INFO:tasks.rados.rados.0.smithi084.stdout:3983: done (0 left) 2024-03-30T12:35:58.983 INFO:tasks.rados.rados.0.smithi084.stdout:3984: copy_from oid 49 from oid 44 current snap is 402 2024-03-30T12:35:58.983 INFO:tasks.rados.rados.0.smithi084.stdout:3985: copy_from oid 14 from oid 3 current snap is 402 2024-03-30T12:35:58.983 INFO:tasks.rados.rados.0.smithi084.stdout:3986: copy_from oid 15 from oid 7 current snap is 402 2024-03-30T12:35:58.983 INFO:tasks.rados.rados.0.smithi084.stdout:3987: snap_remove snap 368 2024-03-30T12:35:59.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:58.994+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:59.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:58.994+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:59.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:58.987+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:59.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:58.987+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:59.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:58.987+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:59.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:58.989+0000 7f134022f700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:35:59.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:35:58.989+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:59.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:59.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:59.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:59.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:59.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:59.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[91810]: osdmap e861: 8 total, 8 up, 8 in 2024-03-30T12:35:59.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:59.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:59.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:59.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:59.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:59.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:59.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:59.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:59.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:59.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:59.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[89279]: osdmap e861: 8 total, 8 up, 8 in 2024-03-30T12:35:59.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:59.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:59.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:59.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:59.259 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:59.260 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:59.260 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:59.260 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:59.260 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[91810]: pgmap v983: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 2.5 MiB/s wr, 26 op/s 2024-03-30T12:35:59.260 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:59.260 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:59.260 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:59.260 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:58 smithi084 ceph-mon[89279]: pgmap v983: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 2.5 MiB/s wr, 26 op/s 2024-03-30T12:35:59.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:35:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:35:58.994+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:59.369 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:59.091+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:59.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:59.091+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:59.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:58.984+0000 7f9e4a0b1700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:35:59.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:58.984+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:59.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:58.984+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:59.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:58.996+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:59.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:35:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:35:58.998+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:59.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:35:59.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:35:59.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:35:59.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:35:59.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:35:59.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:58 smithi162 ceph-mon[83709]: osdmap e861: 8 total, 8 up, 8 in 2024-03-30T12:35:59.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:35:59.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:35:59.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:35:59.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:35:59.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:35:59.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:35:59.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:58 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:35:59.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:58 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:35:59.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:58 smithi162 ceph-mon[83709]: pgmap v983: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 1023 B/s rd, 2.5 MiB/s wr, 26 op/s 2024-03-30T12:35:59.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:35:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:35:59] "GET /metrics HTTP/1.1" 200 36325 "" "Prometheus/2.43.0" 2024-03-30T12:35:59.983 INFO:tasks.rados.rados.0.smithi084.stdout:3987: done (3 left) 2024-03-30T12:35:59.983 INFO:tasks.rados.rados.0.smithi084.stdout:3988: snap_remove snap 390 2024-03-30T12:35:59.983 INFO:tasks.rados.rados.0.smithi084.stdout:3984: finishing copy_from racing read to smithi08477944-49 2024-03-30T12:35:59.983 INFO:tasks.rados.rados.0.smithi084.stdout:3984: finishing copy_from to smithi08477944-49 2024-03-30T12:35:59.983 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 49 v 36404 (ObjNum 1149 snap 375 seq_num 1149) dirty exists 2024-03-30T12:35:59.984 INFO:tasks.rados.rados.0.smithi084.stdout:3986: finishing copy_from racing read to smithi08477944-15 2024-03-30T12:35:59.984 INFO:tasks.rados.rados.0.smithi084.stdout:3986: finishing copy_from to smithi08477944-15 2024-03-30T12:35:59.984 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 15 v 36342 (ObjNum 1172 snap 381 seq_num 1172) dirty exists 2024-03-30T12:35:59.984 INFO:tasks.rados.rados.0.smithi084.stdout:3985: finishing copy_from racing read to smithi08477944-14 2024-03-30T12:35:59.984 INFO:tasks.rados.rados.0.smithi084.stdout:3985: finishing copy_from to smithi08477944-14 2024-03-30T12:35:59.984 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 36340 (ObjNum 1186 snap 383 seq_num 1186) dirty exists 2024-03-30T12:36:00.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:36:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:59.997+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:36:00.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:36:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:35:59.997+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:36:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:36:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:36:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:59 smithi084 ceph-mon[89279]: osdmap e862: 8 total, 8 up, 8 in 2024-03-30T12:36:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:36:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:36:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:59 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:36:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:36:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:36:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:36:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:59 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:36:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:35:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:36:00.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:36:00.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:36:00.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:59 smithi084 ceph-mon[91810]: osdmap e862: 8 total, 8 up, 8 in 2024-03-30T12:36:00.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:36:00.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:36:00.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:59 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:36:00.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:36:00.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:36:00.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:36:00.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:59 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:36:00.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:35:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:36:00.334 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:59.988+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:36:00.334 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:35:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:35:59.988+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:36:00.334 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:59.990+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:36:00.335 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:35:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:35:59.990+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:36:00.335 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:36:00.335 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:36:00.335 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:59 smithi162 ceph-mon[83709]: osdmap e862: 8 total, 8 up, 8 in 2024-03-30T12:36:00.335 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:36:00.335 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:36:00.335 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:59 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:36:00.335 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:36:00.335 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:36:00.335 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:36:00.335 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:59 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:36:00.336 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:35:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:36:00.619 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:36:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:36:00.342+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:36:00.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:36:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:36:00.342+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:36:00.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:36:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:36:00.342+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:36:00.620 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:36:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:36:00.343+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:36:00.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:36:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:36:00.340+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:36:00.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:36:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:36:00.340+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:36:00.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:36:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:36:00.340+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:36:00.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:36:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:36:00.341+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:36:00.753 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:36:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:36:00.341+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:36:00.754 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:36:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:36:00.341+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:36:00.999 INFO:tasks.rados.rados.0.smithi084.stdout:3984: done (3 left) 2024-03-30T12:36:01.000 INFO:tasks.rados.rados.0.smithi084.stdout:3985: done (2 left) 2024-03-30T12:36:01.000 INFO:tasks.rados.rados.0.smithi084.stdout:3986: done (1 left) 2024-03-30T12:36:01.000 INFO:tasks.rados.rados.0.smithi084.stdout:3988: done (0 left) 2024-03-30T12:36:01.000 INFO:tasks.rados.rados.0.smithi084.stdout:3989: rollback oid 14 current snap is 402 2024-03-30T12:36:01.000 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 14 to 398 2024-03-30T12:36:01.000 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 45 current snap is 402 2024-03-30T12:36:01.001 INFO:tasks.rados.rados.0.smithi084.stdout:3990: seq_num 1215 ranges {2154496=753664,2908160=401408} 2024-03-30T12:36:01.014 INFO:tasks.rados.rados.0.smithi084.stdout:3990: writing smithi08477944-45 from 2154496 to 2908160 tid 1 2024-03-30T12:36:01.017 INFO:tasks.rados.rados.0.smithi084.stdout:3990: writing smithi08477944-45 from 2908160 to 3309568 tid 2 2024-03-30T12:36:01.017 INFO:tasks.rados.rados.0.smithi084.stdout:3991: read oid 39 snap -1 2024-03-30T12:36:01.017 INFO:tasks.rados.rados.0.smithi084.stdout:3991: expect (ObjNum 1023 snap 328 seq_num 1023) 2024-03-30T12:36:01.017 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 50 current snap is 402 2024-03-30T12:36:01.017 INFO:tasks.rados.rados.0.smithi084.stdout:3989: finishing rollback tid 0 to smithi08477944-14 2024-03-30T12:36:01.017 INFO:tasks.rados.rados.0.smithi084.stdout:3992: seq_num 1216 ranges {0=770048,770048=401408} 2024-03-30T12:36:01.022 INFO:tasks.rados.rados.0.smithi084.stdout:3992: writing smithi08477944-50 from 0 to 770048 tid 1 2024-03-30T12:36:01.025 INFO:tasks.rados.rados.0.smithi084.stdout:3992: writing smithi08477944-50 from 770048 to 1171456 tid 2 2024-03-30T12:36:01.025 INFO:tasks.rados.rados.0.smithi084.stdout:3993: rmattr oid 34 current snap is 402 2024-03-30T12:36:01.025 INFO:tasks.rados.rados.0.smithi084.stdout:3989: finishing rollback tid 1 to smithi08477944-14 2024-03-30T12:36:01.025 INFO:tasks.rados.rados.0.smithi084.stdout:3989: finishing rollback tid 2 to smithi08477944-14 2024-03-30T12:36:01.025 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 14 v 36423 (ObjNum 1191 snap 384 seq_num 1191) dirty exists 2024-03-30T12:36:01.025 INFO:tasks.rados.rados.0.smithi084.stdout:3989: done (4 left) 2024-03-30T12:36:01.025 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 6 current snap is 402 2024-03-30T12:36:01.026 INFO:tasks.rados.rados.0.smithi084.stdout:3990: finishing write tid 1 to smithi08477944-45 2024-03-30T12:36:01.026 INFO:tasks.rados.rados.0.smithi084.stdout:3994: seq_num 1217 ranges {3850240=786432,4636672=401408} 2024-03-30T12:36:01.050 INFO:tasks.rados.rados.0.smithi084.stdout:3994: writing smithi08477944-6 from 3850240 to 4636672 tid 1 2024-03-30T12:36:01.052 INFO:tasks.rados.rados.0.smithi084.stdout:3994: writing smithi08477944-6 from 4636672 to 5038080 tid 2 2024-03-30T12:36:01.052 INFO:tasks.rados.rados.0.smithi084.stdout:3995: snap_create 2024-03-30T12:36:01.052 INFO:tasks.rados.rados.0.smithi084.stdout:3990: finishing write tid 2 to smithi08477944-45 2024-03-30T12:36:01.052 INFO:tasks.rados.rados.0.smithi084.stdout:3990: finishing write tid 3 to smithi08477944-45 2024-03-30T12:36:01.052 INFO:tasks.rados.rados.0.smithi084.stdout:3991: expect (ObjNum 1023 snap 328 seq_num 1023) 2024-03-30T12:36:01.063 INFO:tasks.rados.rados.0.smithi084.stdout:3992: finishing write tid 1 to smithi08477944-50 2024-03-30T12:36:01.063 INFO:tasks.rados.rados.0.smithi084.stdout:3990: finishing write tid 4 to smithi08477944-45 2024-03-30T12:36:01.064 INFO:tasks.rados.rados.0.smithi084.stdout:3990: oid 45 updating version 0 to 36363 2024-03-30T12:36:01.064 INFO:tasks.rados.rados.0.smithi084.stdout:3990: oid 45 updating version 36363 to 36365 2024-03-30T12:36:01.064 INFO:tasks.rados.rados.0.smithi084.stdout:3990: oid 45 version 36365 is already newer than 36364 2024-03-30T12:36:01.064 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 45 v 36365 (ObjNum 1215 snap 402 seq_num 1215) dirty exists 2024-03-30T12:36:01.064 INFO:tasks.rados.rados.0.smithi084.stdout:3990: left oid 45 (ObjNum 1215 snap 402 seq_num 1215) 2024-03-30T12:36:01.064 INFO:tasks.rados.rados.0.smithi084.stdout:3992: finishing write tid 2 to smithi08477944-50 2024-03-30T12:36:01.064 INFO:tasks.rados.rados.0.smithi084.stdout:3992: finishing write tid 3 to smithi08477944-50 2024-03-30T12:36:01.064 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 34 v 36352 (ObjNum 1197 snap 388 seq_num 1197) dirty exists 2024-03-30T12:36:01.064 INFO:tasks.rados.rados.0.smithi084.stdout:3992: finishing write tid 4 to smithi08477944-50 2024-03-30T12:36:01.064 INFO:tasks.rados.rados.0.smithi084.stdout:3992: oid 50 updating version 0 to 36367 2024-03-30T12:36:01.064 INFO:tasks.rados.rados.0.smithi084.stdout:3992: oid 50 version 36367 is already newer than 36366 2024-03-30T12:36:01.064 INFO:tasks.rados.rados.0.smithi084.stdout:3992: oid 50 updating version 36367 to 36368 2024-03-30T12:36:01.064 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 50 v 36368 (ObjNum 1216 snap 402 seq_num 1216) dirty exists 2024-03-30T12:36:01.064 INFO:tasks.rados.rados.0.smithi084.stdout:3992: left oid 50 (ObjNum 1216 snap 402 seq_num 1216) 2024-03-30T12:36:01.065 INFO:tasks.rados.rados.0.smithi084.stdout:3994: finishing write tid 1 to smithi08477944-6 2024-03-30T12:36:01.065 INFO:tasks.rados.rados.0.smithi084.stdout:3994: finishing write tid 2 to smithi08477944-6 2024-03-30T12:36:01.065 INFO:tasks.rados.rados.0.smithi084.stdout:3994: finishing write tid 3 to smithi08477944-6 2024-03-30T12:36:01.069 INFO:tasks.rados.rados.0.smithi084.stdout:3994: finishing write tid 4 to smithi08477944-6 2024-03-30T12:36:01.069 INFO:tasks.rados.rados.0.smithi084.stdout:3994: oid 6 updating version 0 to 36434 2024-03-30T12:36:01.069 INFO:tasks.rados.rados.0.smithi084.stdout:3994: oid 6 updating version 36434 to 36435 2024-03-30T12:36:01.069 INFO:tasks.rados.rados.0.smithi084.stdout:3994: oid 6 updating version 36435 to 36436 2024-03-30T12:36:01.069 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 6 v 36436 (ObjNum 1217 snap 402 seq_num 1217) dirty exists 2024-03-30T12:36:01.069 INFO:tasks.rados.rados.0.smithi084.stdout:3994: left oid 6 (ObjNum 1217 snap 402 seq_num 1217) 2024-03-30T12:36:01.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:36:01.009+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:36:01.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:36:01.009+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:36:01.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:36:01.003+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:36:01.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:36:01.003+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:36:01.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:36:01.004+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:36:01.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:36:01.004+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:36:01.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:36:01.004+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:36:01.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:36:01.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:36:01.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:36:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:36:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:36:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:36:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:36:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:36:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[91810]: osdmap e863: 8 total, 8 up, 8 in 2024-03-30T12:36:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:36:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:36:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:36:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:36:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:36:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:36:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:36:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:36:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:36:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:36:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:36:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:36:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[89279]: osdmap e863: 8 total, 8 up, 8 in 2024-03-30T12:36:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:36:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:36:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:36:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:36:01.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:36:01.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:36:01.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:36:01.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:36:01.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:36:01.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[91810]: pgmap v986: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 6.7 KiB/s rd, 2.6 MiB/s wr, 15 op/s 2024-03-30T12:36:01.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:36:01.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:36:01.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:36:01.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:36:01.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:36:01.258 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:01 smithi084 ceph-mon[89279]: pgmap v986: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 6.7 KiB/s rd, 2.6 MiB/s wr, 15 op/s 2024-03-30T12:36:01.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:36:01.021+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:36:01.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:36:01.009+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:36:01.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:36:01.009+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:36:01.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:36:01.009+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:36:01.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:36:01.005+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:36:01.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:36:01.005+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:36:01.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:36:01.028+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:36:01.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:36:01.028+0000 7f9dcb662700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:36:01.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:36:01.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:36:01.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:36:01.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:36:01.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:36:01.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:36:01.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:36:01.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:36:01.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-mon[83709]: osdmap e863: 8 total, 8 up, 8 in 2024-03-30T12:36:01.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:36:01.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:36:01.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:36:01.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:36:01.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:36:01.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:36:01.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:36:01.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:36:01.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:36:01.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:01 smithi162 ceph-mon[83709]: pgmap v986: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.2 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 6.7 KiB/s rd, 2.6 MiB/s wr, 15 op/s 2024-03-30T12:36:02.003 INFO:tasks.rados.rados.0.smithi084.stdout:3990: done (5 left) 2024-03-30T12:36:02.003 INFO:tasks.rados.rados.0.smithi084.stdout:3991: done (4 left) 2024-03-30T12:36:02.003 INFO:tasks.rados.rados.0.smithi084.stdout:3992: done (3 left) 2024-03-30T12:36:02.003 INFO:tasks.rados.rados.0.smithi084.stdout:3993: done (2 left) 2024-03-30T12:36:02.003 INFO:tasks.rados.rados.0.smithi084.stdout:3994: done (1 left) 2024-03-30T12:36:02.003 INFO:tasks.rados.rados.0.smithi084.stdout:3995: done (0 left) 2024-03-30T12:36:02.003 INFO:tasks.rados.rados.0.smithi084.stdout:append oid 26 current snap is 403 2024-03-30T12:36:02.003 INFO:tasks.rados.rados.0.smithi084.stdout:3996: seq_num 1218 ranges {5570560=802816,6373376=401408} 2024-03-30T12:36:02.035 INFO:tasks.rados.rados.0.smithi084.stdout:3996: writing smithi08477944-26 from 5570560 to 6373376 tid 1 2024-03-30T12:36:02.037 INFO:tasks.rados.rados.0.smithi084.stdout:3996: writing smithi08477944-26 from 6373376 to 6774784 tid 2 2024-03-30T12:36:02.038 INFO:tasks.rados.rados.0.smithi084.stdout:3997: rollback oid 23 current snap is 403 2024-03-30T12:36:02.038 INFO:tasks.rados.rados.0.smithi084.stdout:rollback oid 23 to 383 2024-03-30T12:36:02.038 INFO:tasks.rados.rados.0.smithi084.stdout:3998: delete oid 42 current snap is 403 2024-03-30T12:36:02.044 INFO:tasks.rados.rados.0.smithi084.stdout:3998: done (2 left) 2024-03-30T12:36:02.044 INFO:tasks.rados.rados.0.smithi084.stdout:3999: snap_create 2024-03-30T12:36:02.045 INFO:tasks.rados.rados.0.smithi084.stdout:3997: finishing rollback tid 0 to smithi08477944-23 2024-03-30T12:36:02.046 INFO:tasks.rados.rados.0.smithi084.stdout:3997: finishing rollback tid 1 to smithi08477944-23 2024-03-30T12:36:02.046 INFO:tasks.rados.rados.0.smithi084.stdout:3997: finishing rollback tid 2 to smithi08477944-23 2024-03-30T12:36:02.046 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 23 v 36407 (ObjNum 1167 snap 380 seq_num 1167) dirty exists 2024-03-30T12:36:02.052 INFO:tasks.rados.rados.0.smithi084.stdout:3996: finishing write tid 1 to smithi08477944-26 2024-03-30T12:36:02.053 INFO:tasks.rados.rados.0.smithi084.stdout:3996: finishing write tid 2 to smithi08477944-26 2024-03-30T12:36:02.053 INFO:tasks.rados.rados.0.smithi084.stdout:3996: finishing write tid 3 to smithi08477944-26 2024-03-30T12:36:02.056 INFO:tasks.rados.rados.0.smithi084.stdout:3996: finishing write tid 4 to smithi08477944-26 2024-03-30T12:36:02.056 INFO:tasks.rados.rados.0.smithi084.stdout:3996: oid 26 updating version 0 to 36356 2024-03-30T12:36:02.056 INFO:tasks.rados.rados.0.smithi084.stdout:3996: oid 26 updating version 36356 to 36357 2024-03-30T12:36:02.056 INFO:tasks.rados.rados.0.smithi084.stdout:3996: oid 26 version 36357 is already newer than 36355 2024-03-30T12:36:02.056 INFO:tasks.rados.rados.0.smithi084.stdout:update_object_version oid 26 v 36357 (ObjNum 1218 snap 403 seq_num 1218) dirty exists 2024-03-30T12:36:02.056 INFO:tasks.rados.rados.0.smithi084.stdout:3996: left oid 26 (ObjNum 1218 snap 403 seq_num 1218) 2024-03-30T12:36:02.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:36:02.049+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:36:02.253 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:36:02.053+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:36:02.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:36:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:36:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:36:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:36:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:36:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:36:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[91810]: osdmap e864: 8 total, 8 up, 8 in 2024-03-30T12:36:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:36:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:36:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:36:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:36:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:36:02.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:36:02.009+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:36:02.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:36:02.009+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:36:02.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:36:02.009+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:36:02.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:36:02.009+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:36:02.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:36:02.009+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:36:02.255 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:36:02.009+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:36:02.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:36:02.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:36:02.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:36:02.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:36:02.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:36:02.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:36:02.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:36:02.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:36:02.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[89279]: osdmap e864: 8 total, 8 up, 8 in 2024-03-30T12:36:02.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:36:02.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:36:02.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:36:02.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:36:02.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:36:02.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:36:02.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:02 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:36:02.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:36:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:36:02.052+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:36:02.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:36:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:36:02.015+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1d0=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be],1d0=[1d0,1cf,1ce,1cd,1cc,1ca,1c9,1c8,1c7,1c6,1c4,1c3,1c2]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:36:02.370 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:36:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:36:02.015+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:36:02.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:36:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:36:02.062+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:36:02.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:36:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:36:02.062+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:36:02.371 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:36:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:36:02.065+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:36:02.371 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:36:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:36:02.011+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:36:02.371 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:36:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:36:02.011+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:36:02.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:36:02.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:36:02.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:36:02.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:36:02.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:36:02.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:36:02.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:02 smithi162 ceph-mon[83709]: osdmap e864: 8 total, 8 up, 8 in 2024-03-30T12:36:02.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:36:02.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c1=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:36:02.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:36:02.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:02 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:36:02.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:36:02.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:36:02.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:02 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:36:03.009 INFO:tasks.rados.rados.0.smithi084.stdout:3996: done (2 left) 2024-03-30T12:36:03.009 INFO:tasks.rados.rados.0.smithi084.stdout:3997: done (1 left) 2024-03-30T12:36:03.009 INFO:tasks.rados.rados.0.smithi084.stdout:3999: done (0 left) 2024-03-30T12:36:03.011 INFO:tasks.rados.rados.0.smithi084.stderr:0 errors. 2024-03-30T12:36:03.012 INFO:tasks.rados.rados.0.smithi084.stderr: 2024-03-30T12:36:03.015 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-03-30T12:36:03.229 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:36:03.350 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:36:03.220+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:36:03.350 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:36:03.220+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:36:03.350 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:36:03.014+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:36:03.350 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:36:03.015+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:36:03.350 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:36:03.015+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:36:03.350 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:36:03.015+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:36:03.350 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:36:03.015+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:36:03.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:36:03.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:36:03.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:36:03.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:36:03.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[91810]: osdmap e865: 8 total, 8 up, 8 in 2024-03-30T12:36:03.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:36:03.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:36:03.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1d0=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be],1d0=[1d0,1cf,1ce,1cd,1cc,1ca,1c9,1c8,1c7,1c6,1c4,1c3,1c2]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:36:03.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:36:03.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:36:03.351 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:36:03.352 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:36:03.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:36:03.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:36:03.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:36:03.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:36:03.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[89279]: osdmap e865: 8 total, 8 up, 8 in 2024-03-30T12:36:03.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:36:03.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:36:03.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1d0=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be],1d0=[1d0,1cf,1ce,1cd,1cc,1ca,1c9,1c8,1c7,1c6,1c4,1c3,1c2]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:36:03.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:36:03.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:36:03.353 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:36:03.353 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:36:03.353 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:36:03.353 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:36:03.353 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[91810]: pgmap v989: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 6.7 KiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-03-30T12:36:03.353 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:36:03.353 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:36:03.353 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:03 smithi084 ceph-mon[89279]: pgmap v989: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 6.7 KiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-03-30T12:36:03.369 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:36:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:36:03.220+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:36:03.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:36:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:36:03.019+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:36:03.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:36:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:36:03.019+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:36:03.369 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:36:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:36:03.020+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1d0=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be],1d0=[1d0,1cf,1ce,1cd,1cc,1ca,1c9,1c8,1c7,1c6,1c4,1c3,1c2]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:36:03.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:36:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:36:03.222+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:36:03.370 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:36:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:36:03.222+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:36:03.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:36:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:36:03.017+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:36:03.370 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:36:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:36:03.018+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:36:03.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:36:03.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:36:03.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:36:03.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:36:03.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:03 smithi162 ceph-mon[83709]: osdmap e865: 8 total, 8 up, 8 in 2024-03-30T12:36:03.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:36:03.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:36:03.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1d0=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be],1d0=[1d0,1cf,1ce,1cd,1cc,1ca,1c9,1c8,1c7,1c6,1c4,1c3,1c2]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:36:03.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:36:03.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:36:03.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:36:03.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:03 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:36:03.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:36:03.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:03 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:36:03.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:03 smithi162 ceph-mon[83709]: pgmap v989: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 6.7 KiB/s rd, 1.7 MiB/s wr, 4 op/s 2024-03-30T12:36:04.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:36:04.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:36:04.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:36:04.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:36:04.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:04 smithi162 ceph-mon[83709]: osdmap e866: 8 total, 8 up, 8 in 2024-03-30T12:36:04.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:36:04.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:36:04.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:36:04.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1d0=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be],1d0=[1d0,1cf,1ce,1cd,1cc,1ca,1c9,1c8,1c7,1c6,1c4,1c3,1c2]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:36:04.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:36:04.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:36:04.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:04 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:36:04.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:36:04.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:04 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:36:04.443 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:36:04.443 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:36:04.443 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:36:04.443 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:36:04.443 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[89279]: osdmap e866: 8 total, 8 up, 8 in 2024-03-30T12:36:04.443 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:36:04.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:36:04.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:36:04.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1d0=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be],1d0=[1d0,1cf,1ce,1cd,1cc,1ca,1c9,1c8,1c7,1c6,1c4,1c3,1c2]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:36:04.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:36:04.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:36:04.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:36:04.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:36:04.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:36:04.445 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:36:04.445 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:36:04.445 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:36:04.445 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:36:04.445 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[91810]: osdmap e866: 8 total, 8 up, 8 in 2024-03-30T12:36:04.445 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:36:04.445 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:36:04.445 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:36:04.445 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1d0=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be],1d0=[1d0,1cf,1ce,1cd,1cc,1ca,1c9,1c8,1c7,1c6,1c4,1c3,1c2]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:36:04.445 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:36:04.445 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:36:04.446 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:36:04.446 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:36:04.446 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:04 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:36:05.191 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:36:05.191 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":866,"fsid":"d3450b00-ee8e-11ee-b647-cb9ed24678a4","created":"2024-03-30T12:13:37.956825+0000","modified":"2024-03-30T12:36:03.008662+0000","last_up_change":"2024-03-30T12:30:20.038583+0000","last_in_change":"2024-03-30T12:18:24.854304+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T12:16:43.434051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T12:18:59.012249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T12:18:59.975381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"rbd","create_time":"2024-03-30T12:19:33.989566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"unique_pool_0","create_time":"2024-03-30T12:22:11.282343+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"866","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":466,"snap_epoch":866,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"teuthologyprofile","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"0a5734fa-c269-449c-805f-0a42d3d90120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":286,"up_from":298,"up_thru":537,"down_at":287,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1465604312},{"type":"v1","addr":"172.21.15.84:6803","nonce":1465604312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1465604312},{"type":"v1","addr":"172.21.15.84:6805","nonce":1465604312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1465604312},{"type":"v1","addr":"172.21.15.84:6809","nonce":1465604312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1465604312},{"type":"v1","addr":"172.21.15.84:6807","nonce":1465604312}]},"public_addr":"172.21.15.84:6803/1465604312","cluster_addr":"172.21.15.84:6805/1465604312","heartbeat_back_addr":"172.21.15.84:6809/1465604312","heartbeat_front_addr":"172.21.15.84:6807/1465604312","state":["exists","up"]},{"osd":1,"uuid":"3ffe676e-9055-44f7-8b04-87974b854b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":320,"up_from":331,"up_thru":537,"down_at":321,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3267314044},{"type":"v1","addr":"172.21.15.84:6811","nonce":3267314044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3267314044},{"type":"v1","addr":"172.21.15.84:6813","nonce":3267314044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3267314044},{"type":"v1","addr":"172.21.15.84:6817","nonce":3267314044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3267314044},{"type":"v1","addr":"172.21.15.84:6815","nonce":3267314044}]},"public_addr":"172.21.15.84:6811/3267314044","cluster_addr":"172.21.15.84:6813/3267314044","heartbeat_back_addr":"172.21.15.84:6817/3267314044","heartbeat_front_addr":"172.21.15.84:6815/3267314044","state":["exists","up"]},{"osd":2,"uuid":"c21b4cb6-9ade-44d2-a7ba-33fe9b5dd3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":18,"last_clean_end":354,"up_from":365,"up_thru":537,"down_at":355,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3020788159},{"type":"v1","addr":"172.21.15.84:6819","nonce":3020788159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3020788159},{"type":"v1","addr":"172.21.15.84:6821","nonce":3020788159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3020788159},{"type":"v1","addr":"172.21.15.84:6825","nonce":3020788159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3020788159},{"type":"v1","addr":"172.21.15.84:6823","nonce":3020788159}]},"public_addr":"172.21.15.84:6819/3020788159","cluster_addr":"172.21.15.84:6821/3020788159","heartbeat_back_addr":"172.21.15.84:6825/3020788159","heartbeat_front_addr":"172.21.15.84:6823/3020788159","state":["exists","up"]},{"osd":3,"uuid":"d60cb7da-fc49-4cbf-855a-2957dcbf66b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":25,"last_clean_end":388,"up_from":399,"up_thru":537,"down_at":389,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":2970863287},{"type":"v1","addr":"172.21.15.84:6827","nonce":2970863287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2970863287},{"type":"v1","addr":"172.21.15.84:6829","nonce":2970863287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":2970863287},{"type":"v1","addr":"172.21.15.84:6833","nonce":2970863287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":2970863287},{"type":"v1","addr":"172.21.15.84:6831","nonce":2970863287}]},"public_addr":"172.21.15.84:6827/2970863287","cluster_addr":"172.21.15.84:6829/2970863287","heartbeat_back_addr":"172.21.15.84:6833/2970863287","heartbeat_front_addr":"172.21.15.84:6831/2970863287","state":["exists","up"]},{"osd":4,"uuid":"46a5087f-cf7c-4bb2-bace-6e04d57496ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":30,"last_clean_end":422,"up_from":433,"up_thru":537,"down_at":423,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2186427236},{"type":"v1","addr":"172.21.15.162:6801","nonce":2186427236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2186427236},{"type":"v1","addr":"172.21.15.162:6803","nonce":2186427236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2186427236},{"type":"v1","addr":"172.21.15.162:6807","nonce":2186427236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2186427236},{"type":"v1","addr":"172.21.15.162:6805","nonce":2186427236}]},"public_addr":"172.21.15.162:6801/2186427236","cluster_addr":"172.21.15.162:6803/2186427236","heartbeat_back_addr":"172.21.15.162:6807/2186427236","heartbeat_front_addr":"172.21.15.162:6805/2186427236","state":["exists","up"]},{"osd":5,"uuid":"2408494e-0472-4cde-aac6-e87d919b6d2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":38,"last_clean_end":445,"up_from":461,"up_thru":537,"down_at":446,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":360140107},{"type":"v1","addr":"172.21.15.162:6809","nonce":360140107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":360140107},{"type":"v1","addr":"172.21.15.162:6811","nonce":360140107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":360140107},{"type":"v1","addr":"172.21.15.162:6815","nonce":360140107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":360140107},{"type":"v1","addr":"172.21.15.162:6813","nonce":360140107}]},"public_addr":"172.21.15.162:6809/360140107","cluster_addr":"172.21.15.162:6811/360140107","heartbeat_back_addr":"172.21.15.162:6815/360140107","heartbeat_front_addr":"172.21.15.162:6813/360140107","state":["exists","up"]},{"osd":6,"uuid":"f86781fa-6cb4-4abd-b759-84ff6d7b36d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":46,"last_clean_end":487,"up_from":500,"up_thru":537,"down_at":488,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1765787761},{"type":"v1","addr":"172.21.15.162:6817","nonce":1765787761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1765787761},{"type":"v1","addr":"172.21.15.162:6819","nonce":1765787761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1765787761},{"type":"v1","addr":"172.21.15.162:6823","nonce":1765787761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1765787761},{"type":"v1","addr":"172.21.15.162:6821","nonce":1765787761}]},"public_addr":"172.21.15.162:6817/1765787761","cluster_addr":"172.21.15.162:6819/1765787761","heartbeat_back_addr":"172.21.15.162:6823/1765787761","heartbeat_front_addr":"172.21.15.162:6821/1765787761","state":["exists","up"]},{"osd":7,"uuid":"49a38087-ec6c-4ae8-b932-9c59ff7d4321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":54,"last_clean_end":516,"up_from":537,"up_thru":537,"down_at":517,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1236604326},{"type":"v1","addr":"172.21.15.162:6825","nonce":1236604326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1236604326},{"type":"v1","addr":"172.21.15.162:6827","nonce":1236604326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1236604326},{"type":"v1","addr":"172.21.15.162:6831","nonce":1236604326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1236604326},{"type":"v1","addr":"172.21.15.162:6829","nonce":1236604326}]},"public_addr":"172.21.15.162:6825/1236604326","cluster_addr":"172.21.15.162:6827/1236604326","heartbeat_back_addr":"172.21.15.162:6831/1236604326","heartbeat_front_addr":"172.21.15.162:6829/1236604326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:15:49.285912+0000","dead_epoch":286},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:14.234967+0000","dead_epoch":320},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:39.383506+0000","dead_epoch":354},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:03.790574+0000","dead_epoch":388},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:26.131317+0000","dead_epoch":421},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:50.385373+0000","dead_epoch":445},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:14.909835+0000","dead_epoch":487},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:40.707128+0000","dead_epoch":516}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.1d","mappings":[{"from":4,"to":1}]},{"pgid":"3.24","mappings":[{"from":4,"to":2}]},{"pgid":"3.3e","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.162:6833/1272121665":"2024-03-31T12:30:48.073411+0000","172.21.15.162:0/2095961342":"2024-03-31T12:23:58.950046+0000","172.21.15.84:0/3399313659":"2024-03-31T12:24:44.608044+0000","172.21.15.84:6801/767773944":"2024-03-31T12:24:44.608044+0000","172.21.15.84:0/4071895056":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3191408930":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/681092589":"2024-03-31T12:23:24.048347+0000","172.21.15.84:0/2743767955":"2024-03-31T12:19:35.808765+0000","172.21.15.84:0/707854941":"2024-03-31T12:23:24.048347+0000","172.21.15.162:0/839605232":"2024-03-31T12:23:58.950046+0000","172.21.15.162:0/3370752832":"2024-03-31T12:23:58.950046+0000","172.21.15.84:0/4263306021":"2024-03-31T12:24:44.608044+0000","172.21.15.84:0/729999192":"2024-03-31T12:24:44.608044+0000","172.21.15.84:6800/767773944":"2024-03-31T12:24:44.608044+0000","172.21.15.84:6800/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:6800/1623350439":"2024-03-31T12:23:24.048347+0000","172.21.15.162:6835/1232377246":"2024-03-31T12:23:58.950046+0000","172.21.15.162:0/3169470970":"2024-03-31T12:23:58.950046+0000","172.21.15.84:6801/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6800/2648486638":"2024-03-31T12:19:35.808765+0000","172.21.15.84:0/2147212239":"2024-03-31T12:19:35.808765+0000","172.21.15.84:6801/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/2856311587":"2024-03-31T12:23:24.048347+0000","172.21.15.84:0/1700950603":"2024-03-31T12:23:24.048347+0000","172.21.15.84:0/3429332545":"2024-03-31T12:24:44.608044+0000","172.21.15.84:0/411728501":"2024-03-31T12:24:44.608044+0000","172.21.15.162:0/31592453":"2024-03-31T12:23:58.950046+0000","172.21.15.162:0/42775605":"2024-03-31T12:23:58.950046+0000","172.21.15.162:0/1545453187":"2024-03-31T12:23:58.950046+0000","172.21.15.84:0/3135527830":"2024-03-31T12:14:31.125768+0000","172.21.15.162:6834/1232377246":"2024-03-31T12:23:58.950046+0000","172.21.15.162:6832/1272121665":"2024-03-31T12:30:48.073411+0000","172.21.15.84:0/576481138":"2024-03-31T12:23:24.048347+0000","172.21.15.84:6801/1623350439":"2024-03-31T12:23:24.048347+0000","172.21.15.84:0/1433254333":"2024-03-31T12:14:31.125768+0000","172.21.15.84:0/1374515169":"2024-03-31T12:14:31.125768+0000","172.21.15.84:0/1137676737":"2024-03-31T12:24:44.608044+0000","172.21.15.84:6800/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:0/3488008307":"2024-03-31T12:24:44.608044+0000","172.21.15.84:0/1692747755":"2024-03-31T12:19:35.808765+0000","172.21.15.84:0/1390761199":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3672833890":"2024-03-31T12:19:35.808765+0000","172.21.15.84:6801/2648486638":"2024-03-31T12:19:35.808765+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"teuthologyprofile":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":151,"length":1},{"begin":153,"length":1},{"begin":157,"length":1},{"begin":160,"length":2},{"begin":168,"length":262},{"begin":431,"length":1},{"begin":433,"length":2},{"begin":436,"length":10},{"begin":448,"length":2},{"begin":453,"length":1},{"begin":459,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T12:36:05.282 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:05 smithi084 ceph-mon[91810]: pgmap v991: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 6.0 KiB/s rd, 1.1 MiB/s wr, 6 op/s 2024-03-30T12:36:05.283 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:05 smithi084 ceph-mon[89279]: pgmap v991: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 6.0 KiB/s rd, 1.1 MiB/s wr, 6 op/s 2024-03-30T12:36:05.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:05 smithi162 ceph-mon[83709]: pgmap v991: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 6.0 KiB/s rd, 1.1 MiB/s wr, 6 op/s 2024-03-30T12:36:05.921 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:36:06.140 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:36:06.250 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:06 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/3183396801' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:36:06.250 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:06 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/3183396801' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:36:06.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:06 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/3183396801' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:36:07.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:07 smithi084 ceph-mon[91810]: pgmap v992: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 173 KiB/s rd, 1.1 MiB/s wr, 6 op/s 2024-03-30T12:36:07.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:07 smithi084 ceph-mon[89279]: pgmap v992: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 173 KiB/s rd, 1.1 MiB/s wr, 6 op/s 2024-03-30T12:36:07.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:07 smithi162 ceph-mon[83709]: pgmap v992: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 173 KiB/s rd, 1.1 MiB/s wr, 6 op/s 2024-03-30T12:36:08.019 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:36:08.021 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:36:08.742 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":992,"stamp":"2024-03-30T12:36:06.795414+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693264,"kb_used_data":1955656,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267952,"statfs":{"total":767960285184,"available":760082382848,"internally_reserved":0,"allocated":2002591744,"data_stored":4518515238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3768320,"num_objects":7,"num_object_clones":7,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":-1,"num_read":10,"num_read_kb":1037,"num_write":27,"num_write_kb":6760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001808"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018620+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:36:03.018620+0000","last_peered":"2024-03-30T12:36:03.018620+0000","last_clean":"2024-03-30T12:36:03.018620+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:36:03.018620+0000","last_undegraded":"2024-03-30T12:36:03.018620+0000","last_fullsized":"2024-03-30T12:36:03.018620+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1362,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221591+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:36:03.221591+0000","last_peered":"2024-03-30T12:36:03.221591+0000","last_clean":"2024-03-30T12:36:03.221591+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:36:03.221591+0000","last_undegraded":"2024-03-30T12:36:03.221591+0000","last_fullsized":"2024-03-30T12:36:03.221591+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221166+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:36:03.221166+0000","last_peered":"2024-03-30T12:36:03.221166+0000","last_clean":"2024-03-30T12:36:03.221166+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:36:03.221166+0000","last_undegraded":"2024-03-30T12:36:03.221166+0000","last_fullsized":"2024-03-30T12:36:03.221166+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222033+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:36:03.222033+0000","last_peered":"2024-03-30T12:36:03.222033+0000","last_clean":"2024-03-30T12:36:03.222033+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:36:03.222033+0000","last_undegraded":"2024-03-30T12:36:03.222033+0000","last_fullsized":"2024-03-30T12:36:03.222033+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016806+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:36:03.016806+0000","last_peered":"2024-03-30T12:36:03.016806+0000","last_clean":"2024-03-30T12:36:03.016806+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:36:03.016806+0000","last_undegraded":"2024-03-30T12:36:03.016806+0000","last_fullsized":"2024-03-30T12:36:03.016806+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1208,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222037+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:03.222037+0000","last_peered":"2024-03-30T12:36:03.222037+0000","last_clean":"2024-03-30T12:36:03.222037+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:03.222037+0000","last_undegraded":"2024-03-30T12:36:03.222037+0000","last_fullsized":"2024-03-30T12:36:03.222037+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017295+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:36:03.017295+0000","last_peered":"2024-03-30T12:36:03.017295+0000","last_clean":"2024-03-30T12:36:03.017295+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:36:03.017295+0000","last_undegraded":"2024-03-30T12:36:03.017295+0000","last_fullsized":"2024-03-30T12:36:03.017295+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1255,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-03-30T12:36:02.052963+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:36:02.052963+0000","last_peered":"2024-03-30T12:36:02.052963+0000","last_clean":"2024-03-30T12:36:02.052963+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:36:02.052963+0000","last_undegraded":"2024-03-30T12:36:02.052963+0000","last_fullsized":"2024-03-30T12:36:02.052963+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017862+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:36:03.017862+0000","last_peered":"2024-03-30T12:36:03.017862+0000","last_clean":"2024-03-30T12:36:03.017862+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:36:03.017862+0000","last_undegraded":"2024-03-30T12:36:03.017862+0000","last_fullsized":"2024-03-30T12:36:03.017862+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1167,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220710+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:03.220710+0000","last_peered":"2024-03-30T12:36:03.220710+0000","last_clean":"2024-03-30T12:36:03.220710+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:03.220710+0000","last_undegraded":"2024-03-30T12:36:03.220710+0000","last_fullsized":"2024-03-30T12:36:03.220710+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1167,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220416+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:03.220416+0000","last_peered":"2024-03-30T12:36:03.220416+0000","last_clean":"2024-03-30T12:36:03.220416+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:03.220416+0000","last_undegraded":"2024-03-30T12:36:03.220416+0000","last_fullsized":"2024-03-30T12:36:03.220416+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1267,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-03-30T12:36:02.015090+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:36:02.015090+0000","last_peered":"2024-03-30T12:36:02.015090+0000","last_clean":"2024-03-30T12:36:02.015090+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:36:02.015090+0000","last_undegraded":"2024-03-30T12:36:02.015090+0000","last_fullsized":"2024-03-30T12:36:02.015090+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1285,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-03-30T12:36:02.052799+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:36:02.052799+0000","last_peered":"2024-03-30T12:36:02.052799+0000","last_clean":"2024-03-30T12:36:02.052799+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:36:02.052799+0000","last_undegraded":"2024-03-30T12:36:02.052799+0000","last_fullsized":"2024-03-30T12:36:02.052799+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220445+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:36:03.220445+0000","last_peered":"2024-03-30T12:36:03.220445+0000","last_clean":"2024-03-30T12:36:03.220445+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:36:03.220445+0000","last_undegraded":"2024-03-30T12:36:03.220445+0000","last_fullsized":"2024-03-30T12:36:03.220445+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1346,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222485+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:36:03.222485+0000","last_peered":"2024-03-30T12:36:03.222485+0000","last_clean":"2024-03-30T12:36:03.222485+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:36:03.222485+0000","last_undegraded":"2024-03-30T12:36:03.222485+0000","last_fullsized":"2024-03-30T12:36:03.222485+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221410+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:36:03.221410+0000","last_peered":"2024-03-30T12:36:03.221410+0000","last_clean":"2024-03-30T12:36:03.221410+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:36:03.221410+0000","last_undegraded":"2024-03-30T12:36:03.221410+0000","last_fullsized":"2024-03-30T12:36:03.221410+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1223,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222946+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:36:03.222946+0000","last_peered":"2024-03-30T12:36:03.222946+0000","last_clean":"2024-03-30T12:36:03.222946+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:36:03.222946+0000","last_undegraded":"2024-03-30T12:36:03.222946+0000","last_fullsized":"2024-03-30T12:36:03.222946+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1330,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015944+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:36:03.015944+0000","last_peered":"2024-03-30T12:36:03.015944+0000","last_clean":"2024-03-30T12:36:03.015944+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:36:03.015944+0000","last_undegraded":"2024-03-30T12:36:03.015944+0000","last_fullsized":"2024-03-30T12:36:03.015944+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017890+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:36:03.017890+0000","last_peered":"2024-03-30T12:36:03.017890+0000","last_clean":"2024-03-30T12:36:03.017890+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:36:03.017890+0000","last_undegraded":"2024-03-30T12:36:03.017890+0000","last_fullsized":"2024-03-30T12:36:03.017890+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1386,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221029+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:36:03.221029+0000","last_peered":"2024-03-30T12:36:03.221029+0000","last_clean":"2024-03-30T12:36:03.221029+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:36:03.221029+0000","last_undegraded":"2024-03-30T12:36:03.221029+0000","last_fullsized":"2024-03-30T12:36:03.221029+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1279,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-03-30T12:36:02.053583+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:36:02.053583+0000","last_peered":"2024-03-30T12:36:02.053583+0000","last_clean":"2024-03-30T12:36:02.053583+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:36:02.053583+0000","last_undegraded":"2024-03-30T12:36:02.053583+0000","last_fullsized":"2024-03-30T12:36:02.053583+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1298,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-03-30T12:36:02.053741+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:36:02.053741+0000","last_peered":"2024-03-30T12:36:02.053741+0000","last_clean":"2024-03-30T12:36:02.053741+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:36:02.053741+0000","last_undegraded":"2024-03-30T12:36:02.053741+0000","last_fullsized":"2024-03-30T12:36:02.053741+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220308+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:36:03.220308+0000","last_peered":"2024-03-30T12:36:03.220308+0000","last_clean":"2024-03-30T12:36:03.220308+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:36:03.220308+0000","last_undegraded":"2024-03-30T12:36:03.220308+0000","last_fullsized":"2024-03-30T12:36:03.220308+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017887+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:36:03.017887+0000","last_peered":"2024-03-30T12:36:03.017887+0000","last_clean":"2024-03-30T12:36:03.017887+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:36:03.017887+0000","last_undegraded":"2024-03-30T12:36:03.017887+0000","last_fullsized":"2024-03-30T12:36:03.017887+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1227,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222664+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:03.222664+0000","last_peered":"2024-03-30T12:36:03.222664+0000","last_clean":"2024-03-30T12:36:03.222664+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:03.222664+0000","last_undegraded":"2024-03-30T12:36:03.222664+0000","last_fullsized":"2024-03-30T12:36:03.222664+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017639+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:36:03.017639+0000","last_peered":"2024-03-30T12:36:03.017639+0000","last_clean":"2024-03-30T12:36:03.017639+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:36:03.017639+0000","last_undegraded":"2024-03-30T12:36:03.017639+0000","last_fullsized":"2024-03-30T12:36:03.017639+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1211,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222188+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:03.222188+0000","last_peered":"2024-03-30T12:36:03.222188+0000","last_clean":"2024-03-30T12:36:03.222188+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:03.222188+0000","last_undegraded":"2024-03-30T12:36:03.222188+0000","last_fullsized":"2024-03-30T12:36:03.222188+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1258,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-03-30T12:36:02.053087+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:36:02.053087+0000","last_peered":"2024-03-30T12:36:02.053087+0000","last_clean":"2024-03-30T12:36:02.053087+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:36:02.053087+0000","last_undegraded":"2024-03-30T12:36:02.053087+0000","last_fullsized":"2024-03-30T12:36:02.053087+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1259,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-03-30T12:36:02.014770+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:36:02.014770+0000","last_peered":"2024-03-30T12:36:02.014770+0000","last_clean":"2024-03-30T12:36:02.014770+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:36:02.014770+0000","last_undegraded":"2024-03-30T12:36:02.014770+0000","last_fullsized":"2024-03-30T12:36:02.014770+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1178,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220485+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:36:03.220485+0000","last_peered":"2024-03-30T12:36:03.220485+0000","last_clean":"2024-03-30T12:36:03.220485+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:36:03.220485+0000","last_undegraded":"2024-03-30T12:36:03.220485+0000","last_fullsized":"2024-03-30T12:36:03.220485+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1376,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221533+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:36:03.221533+0000","last_peered":"2024-03-30T12:36:03.221533+0000","last_clean":"2024-03-30T12:36:03.221533+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:36:03.221533+0000","last_undegraded":"2024-03-30T12:36:03.221533+0000","last_fullsized":"2024-03-30T12:36:03.221533+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1294,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-03-30T12:36:02.052134+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:36:02.052134+0000","last_peered":"2024-03-30T12:36:02.052134+0000","last_clean":"2024-03-30T12:36:02.052134+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:36:02.052134+0000","last_undegraded":"2024-03-30T12:36:02.052134+0000","last_fullsized":"2024-03-30T12:36:02.052134+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1291,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-03-30T12:36:02.052097+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:36:02.052097+0000","last_peered":"2024-03-30T12:36:02.052097+0000","last_clean":"2024-03-30T12:36:02.052097+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:36:02.052097+0000","last_undegraded":"2024-03-30T12:36:02.052097+0000","last_fullsized":"2024-03-30T12:36:02.052097+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1222,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221695+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:36:03.221695+0000","last_peered":"2024-03-30T12:36:03.221695+0000","last_clean":"2024-03-30T12:36:03.221695+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:36:03.221695+0000","last_undegraded":"2024-03-30T12:36:03.221695+0000","last_fullsized":"2024-03-30T12:36:03.221695+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1346,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222924+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:36:03.222924+0000","last_peered":"2024-03-30T12:36:03.222924+0000","last_clean":"2024-03-30T12:36:03.222924+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:36:03.222924+0000","last_undegraded":"2024-03-30T12:36:03.222924+0000","last_fullsized":"2024-03-30T12:36:03.222924+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220706+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:03.220706+0000","last_peered":"2024-03-30T12:36:03.220706+0000","last_clean":"2024-03-30T12:36:03.220706+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:03.220706+0000","last_undegraded":"2024-03-30T12:36:03.220706+0000","last_fullsized":"2024-03-30T12:36:03.220706+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1202,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222259+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:36:03.222259+0000","last_peered":"2024-03-30T12:36:03.222259+0000","last_clean":"2024-03-30T12:36:03.222259+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:36:03.222259+0000","last_undegraded":"2024-03-30T12:36:03.222259+0000","last_fullsized":"2024-03-30T12:36:03.222259+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1196,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222007+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:36:03.222007+0000","last_peered":"2024-03-30T12:36:03.222007+0000","last_clean":"2024-03-30T12:36:03.222007+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:36:03.222007+0000","last_undegraded":"2024-03-30T12:36:03.222007+0000","last_fullsized":"2024-03-30T12:36:03.222007+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015689+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:36:03.015689+0000","last_peered":"2024-03-30T12:36:03.015689+0000","last_clean":"2024-03-30T12:36:03.015689+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:36:03.015689+0000","last_undegraded":"2024-03-30T12:36:03.015689+0000","last_fullsized":"2024-03-30T12:36:03.015689+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221226+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:36:03.221226+0000","last_peered":"2024-03-30T12:36:03.221226+0000","last_clean":"2024-03-30T12:36:03.221226+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:36:03.221226+0000","last_undegraded":"2024-03-30T12:36:03.221226+0000","last_fullsized":"2024-03-30T12:36:03.221226+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1229,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-03-30T12:36:02.015318+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:36:02.015318+0000","last_peered":"2024-03-30T12:36:02.015318+0000","last_clean":"2024-03-30T12:36:02.015318+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:36:02.015318+0000","last_undegraded":"2024-03-30T12:36:02.015318+0000","last_fullsized":"2024-03-30T12:36:02.015318+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1203,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220666+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:36:03.220666+0000","last_peered":"2024-03-30T12:36:03.220666+0000","last_clean":"2024-03-30T12:36:03.220666+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:36:03.220666+0000","last_undegraded":"2024-03-30T12:36:03.220666+0000","last_fullsized":"2024-03-30T12:36:03.220666+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017379+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:36:03.017379+0000","last_peered":"2024-03-30T12:36:03.017379+0000","last_clean":"2024-03-30T12:36:03.017379+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:36:03.017379+0000","last_undegraded":"2024-03-30T12:36:03.017379+0000","last_fullsized":"2024-03-30T12:36:03.017379+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221717+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:36:03.221717+0000","last_peered":"2024-03-30T12:36:03.221717+0000","last_clean":"2024-03-30T12:36:03.221717+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:36:03.221717+0000","last_undegraded":"2024-03-30T12:36:03.221717+0000","last_fullsized":"2024-03-30T12:36:03.221717+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220742+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:36:03.220742+0000","last_peered":"2024-03-30T12:36:03.220742+0000","last_clean":"2024-03-30T12:36:03.220742+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:36:03.220742+0000","last_undegraded":"2024-03-30T12:36:03.220742+0000","last_fullsized":"2024-03-30T12:36:03.220742+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221904+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:36:03.221904+0000","last_peered":"2024-03-30T12:36:03.221904+0000","last_clean":"2024-03-30T12:36:03.221904+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:36:03.221904+0000","last_undegraded":"2024-03-30T12:36:03.221904+0000","last_fullsized":"2024-03-30T12:36:03.221904+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017448+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:36:03.017448+0000","last_peered":"2024-03-30T12:36:03.017448+0000","last_clean":"2024-03-30T12:36:03.017448+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:36:03.017448+0000","last_undegraded":"2024-03-30T12:36:03.017448+0000","last_fullsized":"2024-03-30T12:36:03.017448+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220190+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:36:03.220190+0000","last_peered":"2024-03-30T12:36:03.220190+0000","last_clean":"2024-03-30T12:36:03.220190+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:36:03.220190+0000","last_undegraded":"2024-03-30T12:36:03.220190+0000","last_fullsized":"2024-03-30T12:36:03.220190+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1167,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220128+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:36:03.220128+0000","last_peered":"2024-03-30T12:36:03.220128+0000","last_clean":"2024-03-30T12:36:03.220128+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:36:03.220128+0000","last_undegraded":"2024-03-30T12:36:03.220128+0000","last_fullsized":"2024-03-30T12:36:03.220128+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1342,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015578+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:36:03.015578+0000","last_peered":"2024-03-30T12:36:03.015578+0000","last_clean":"2024-03-30T12:36:03.015578+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:36:03.015578+0000","last_undegraded":"2024-03-30T12:36:03.015578+0000","last_fullsized":"2024-03-30T12:36:03.015578+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016564+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:36:03.016564+0000","last_peered":"2024-03-30T12:36:03.016564+0000","last_clean":"2024-03-30T12:36:03.016564+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:36:03.016564+0000","last_undegraded":"2024-03-30T12:36:03.016564+0000","last_fullsized":"2024-03-30T12:36:03.016564+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5751,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.016013+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:36:03.016013+0000","last_peered":"2024-03-30T12:36:03.016013+0000","last_clean":"2024-03-30T12:36:03.016013+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:36:03.016013+0000","last_undegraded":"2024-03-30T12:36:03.016013+0000","last_fullsized":"2024-03-30T12:36:03.016013+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1271,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-03-30T12:36:02.015643+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:36:02.015643+0000","last_peered":"2024-03-30T12:36:02.015643+0000","last_clean":"2024-03-30T12:36:02.015643+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:36:02.015643+0000","last_undegraded":"2024-03-30T12:36:02.015643+0000","last_fullsized":"2024-03-30T12:36:02.015643+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018002+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:36:03.018002+0000","last_peered":"2024-03-30T12:36:03.018002+0000","last_clean":"2024-03-30T12:36:03.018002+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:36:03.018002+0000","last_undegraded":"2024-03-30T12:36:03.018002+0000","last_fullsized":"2024-03-30T12:36:03.018002+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5511,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.221420+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:36:03.221420+0000","last_peered":"2024-03-30T12:36:03.221420+0000","last_clean":"2024-03-30T12:36:03.221420+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:36:03.221420+0000","last_undegraded":"2024-03-30T12:36:03.221420+0000","last_fullsized":"2024-03-30T12:36:03.221420+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220564+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:36:03.220564+0000","last_peered":"2024-03-30T12:36:03.220564+0000","last_clean":"2024-03-30T12:36:03.220564+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:36:03.220564+0000","last_undegraded":"2024-03-30T12:36:03.220564+0000","last_fullsized":"2024-03-30T12:36:03.220564+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222416+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:36:03.222416+0000","last_peered":"2024-03-30T12:36:03.222416+0000","last_clean":"2024-03-30T12:36:03.222416+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:36:03.222416+0000","last_undegraded":"2024-03-30T12:36:03.222416+0000","last_fullsized":"2024-03-30T12:36:03.222416+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1237,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222091+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:36:03.222091+0000","last_peered":"2024-03-30T12:36:03.222091+0000","last_clean":"2024-03-30T12:36:03.222091+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:36:03.222091+0000","last_undegraded":"2024-03-30T12:36:03.222091+0000","last_fullsized":"2024-03-30T12:36:03.222091+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5456,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.221793+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:36:03.221793+0000","last_peered":"2024-03-30T12:36:03.221793+0000","last_clean":"2024-03-30T12:36:03.221793+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:36:03.221793+0000","last_undegraded":"2024-03-30T12:36:03.221793+0000","last_fullsized":"2024-03-30T12:36:03.221793+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222540+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:36:03.222540+0000","last_peered":"2024-03-30T12:36:03.222540+0000","last_clean":"2024-03-30T12:36:03.222540+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:36:03.222540+0000","last_undegraded":"2024-03-30T12:36:03.222540+0000","last_fullsized":"2024-03-30T12:36:03.222540+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221637+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:36:03.221637+0000","last_peered":"2024-03-30T12:36:03.221637+0000","last_clean":"2024-03-30T12:36:03.221637+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:36:03.221637+0000","last_undegraded":"2024-03-30T12:36:03.221637+0000","last_fullsized":"2024-03-30T12:36:03.221637+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1268,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-03-30T12:36:02.014936+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:36:02.014936+0000","last_peered":"2024-03-30T12:36:02.014936+0000","last_clean":"2024-03-30T12:36:02.014936+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:36:02.014936+0000","last_undegraded":"2024-03-30T12:36:02.014936+0000","last_fullsized":"2024-03-30T12:36:02.014936+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3802,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016632+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:36:03.016632+0000","last_peered":"2024-03-30T12:36:03.016632+0000","last_clean":"2024-03-30T12:36:03.016632+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:36:03.016632+0000","last_undegraded":"2024-03-30T12:36:03.016632+0000","last_fullsized":"2024-03-30T12:36:03.016632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1341,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222936+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:36:03.222936+0000","last_peered":"2024-03-30T12:36:03.222936+0000","last_clean":"2024-03-30T12:36:03.222936+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:36:03.222936+0000","last_undegraded":"2024-03-30T12:36:03.222936+0000","last_fullsized":"2024-03-30T12:36:03.222936+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221995+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:36:03.221995+0000","last_peered":"2024-03-30T12:36:03.221995+0000","last_clean":"2024-03-30T12:36:03.221995+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:36:03.221995+0000","last_undegraded":"2024-03-30T12:36:03.221995+0000","last_fullsized":"2024-03-30T12:36:03.221995+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1330,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015172+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:36:03.015172+0000","last_peered":"2024-03-30T12:36:03.015172+0000","last_clean":"2024-03-30T12:36:03.015172+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:36:03.015172+0000","last_undegraded":"2024-03-30T12:36:03.015172+0000","last_fullsized":"2024-03-30T12:36:03.015172+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4574,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.018860+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:36:03.018860+0000","last_peered":"2024-03-30T12:36:03.018860+0000","last_clean":"2024-03-30T12:36:03.018860+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:36:03.018860+0000","last_undegraded":"2024-03-30T12:36:03.018860+0000","last_fullsized":"2024-03-30T12:36:03.018860+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1173,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220732+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:36:03.220732+0000","last_peered":"2024-03-30T12:36:03.220732+0000","last_clean":"2024-03-30T12:36:03.220732+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:36:03.220732+0000","last_undegraded":"2024-03-30T12:36:03.220732+0000","last_fullsized":"2024-03-30T12:36:03.220732+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1255,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-03-30T12:36:02.052417+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:36:02.052417+0000","last_peered":"2024-03-30T12:36:02.052417+0000","last_clean":"2024-03-30T12:36:02.052417+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:36:02.052417+0000","last_undegraded":"2024-03-30T12:36:02.052417+0000","last_fullsized":"2024-03-30T12:36:02.052417+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1198,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221904+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:36:03.221904+0000","last_peered":"2024-03-30T12:36:03.221904+0000","last_clean":"2024-03-30T12:36:03.221904+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:36:03.221904+0000","last_undegraded":"2024-03-30T12:36:03.221904+0000","last_fullsized":"2024-03-30T12:36:03.221904+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1714,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016402+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:36:03.016402+0000","last_peered":"2024-03-30T12:36:03.016402+0000","last_clean":"2024-03-30T12:36:03.016402+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:36:03.016402+0000","last_undegraded":"2024-03-30T12:36:03.016402+0000","last_fullsized":"2024-03-30T12:36:03.016402+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24712,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223515+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:36:03.223515+0000","last_peered":"2024-03-30T12:36:03.223515+0000","last_clean":"2024-03-30T12:36:03.223515+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:36:03.223515+0000","last_undegraded":"2024-03-30T12:36:03.223515+0000","last_fullsized":"2024-03-30T12:36:03.223515+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220576+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:36:03.220576+0000","last_peered":"2024-03-30T12:36:03.220576+0000","last_clean":"2024-03-30T12:36:03.220576+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:36:03.220576+0000","last_undegraded":"2024-03-30T12:36:03.220576+0000","last_fullsized":"2024-03-30T12:36:03.220576+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220655+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:36:03.220655+0000","last_peered":"2024-03-30T12:36:03.220655+0000","last_clean":"2024-03-30T12:36:03.220655+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:36:03.220655+0000","last_undegraded":"2024-03-30T12:36:03.220655+0000","last_fullsized":"2024-03-30T12:36:03.220655+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1142,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016427+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:36:03.016427+0000","last_peered":"2024-03-30T12:36:03.016427+0000","last_clean":"2024-03-30T12:36:03.016427+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:36:03.016427+0000","last_undegraded":"2024-03-30T12:36:03.016427+0000","last_fullsized":"2024-03-30T12:36:03.016427+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16479,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.221375+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:36:03.221375+0000","last_peered":"2024-03-30T12:36:03.221375+0000","last_clean":"2024-03-30T12:36:03.221375+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:36:03.221375+0000","last_undegraded":"2024-03-30T12:36:03.221375+0000","last_fullsized":"2024-03-30T12:36:03.221375+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221403+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:36:03.221403+0000","last_peered":"2024-03-30T12:36:03.221403+0000","last_clean":"2024-03-30T12:36:03.221403+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:36:03.221403+0000","last_undegraded":"2024-03-30T12:36:03.221403+0000","last_fullsized":"2024-03-30T12:36:03.221403+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017689+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:36:03.017689+0000","last_peered":"2024-03-30T12:36:03.017689+0000","last_clean":"2024-03-30T12:36:03.017689+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:36:03.017689+0000","last_undegraded":"2024-03-30T12:36:03.017689+0000","last_fullsized":"2024-03-30T12:36:03.017689+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222632+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:36:03.222632+0000","last_peered":"2024-03-30T12:36:03.222632+0000","last_clean":"2024-03-30T12:36:03.222632+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:36:03.222632+0000","last_undegraded":"2024-03-30T12:36:03.222632+0000","last_fullsized":"2024-03-30T12:36:03.222632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31260,"reported_epoch":865,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:02.015779+0000","last_change":"2024-03-30T12:36:02.016096+0000","last_active":"2024-03-30T12:36:02.015779+0000","last_peered":"2024-03-30T12:36:02.015779+0000","last_clean":"2024-03-30T12:36:02.015779+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:36:02.015779+0000","last_undegraded":"2024-03-30T12:36:02.015779+0000","last_fullsized":"2024-03-30T12:36:02.015779+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:57:33.283205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1291,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-03-30T12:36:02.052648+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:36:02.052648+0000","last_peered":"2024-03-30T12:36:02.052648+0000","last_clean":"2024-03-30T12:36:02.052648+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:36:02.052648+0000","last_undegraded":"2024-03-30T12:36:02.052648+0000","last_fullsized":"2024-03-30T12:36:02.052648+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221685+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:36:03.221685+0000","last_peered":"2024-03-30T12:36:03.221685+0000","last_clean":"2024-03-30T12:36:03.221685+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:36:03.221685+0000","last_undegraded":"2024-03-30T12:36:03.221685+0000","last_fullsized":"2024-03-30T12:36:03.221685+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1293,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-03-30T12:36:02.053881+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:36:02.053881+0000","last_peered":"2024-03-30T12:36:02.053881+0000","last_clean":"2024-03-30T12:36:02.053881+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:36:02.053881+0000","last_undegraded":"2024-03-30T12:36:02.053881+0000","last_fullsized":"2024-03-30T12:36:02.053881+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3760,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-03-30T12:36:02.052334+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:36:02.052334+0000","last_peered":"2024-03-30T12:36:02.052334+0000","last_clean":"2024-03-30T12:36:02.052334+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:36:02.052334+0000","last_undegraded":"2024-03-30T12:36:02.052334+0000","last_fullsized":"2024-03-30T12:36:02.052334+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:15:34.945472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1229,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-03-30T12:36:02.014591+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:36:02.014591+0000","last_peered":"2024-03-30T12:36:02.014591+0000","last_clean":"2024-03-30T12:36:02.014591+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:36:02.014591+0000","last_undegraded":"2024-03-30T12:36:02.014591+0000","last_fullsized":"2024-03-30T12:36:02.014591+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220617+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:36:03.220617+0000","last_peered":"2024-03-30T12:36:03.220617+0000","last_clean":"2024-03-30T12:36:03.220617+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:36:03.220617+0000","last_undegraded":"2024-03-30T12:36:03.220617+0000","last_fullsized":"2024-03-30T12:36:03.220617+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220307+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:36:03.220307+0000","last_peered":"2024-03-30T12:36:03.220307+0000","last_clean":"2024-03-30T12:36:03.220307+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:36:03.220307+0000","last_undegraded":"2024-03-30T12:36:03.220307+0000","last_fullsized":"2024-03-30T12:36:03.220307+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15592,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223226+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:36:03.223226+0000","last_peered":"2024-03-30T12:36:03.223226+0000","last_clean":"2024-03-30T12:36:03.223226+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:36:03.223226+0000","last_undegraded":"2024-03-30T12:36:03.223226+0000","last_fullsized":"2024-03-30T12:36:03.223226+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1141,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016730+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:36:03.016730+0000","last_peered":"2024-03-30T12:36:03.016730+0000","last_clean":"2024-03-30T12:36:03.016730+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:36:03.016730+0000","last_undegraded":"2024-03-30T12:36:03.016730+0000","last_fullsized":"2024-03-30T12:36:03.016730+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1254,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-03-30T12:36:02.014581+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:36:02.014581+0000","last_peered":"2024-03-30T12:36:02.014581+0000","last_clean":"2024-03-30T12:36:02.014581+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:36:02.014581+0000","last_undegraded":"2024-03-30T12:36:02.014581+0000","last_fullsized":"2024-03-30T12:36:02.014581+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29011,"reported_epoch":865,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:02.015832+0000","last_change":"2024-03-30T12:36:02.016120+0000","last_active":"2024-03-30T12:36:02.015832+0000","last_peered":"2024-03-30T12:36:02.015832+0000","last_clean":"2024-03-30T12:36:02.015832+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:36:02.015832+0000","last_undegraded":"2024-03-30T12:36:02.015832+0000","last_fullsized":"2024-03-30T12:36:02.015832+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:28.478428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222640+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:36:03.222640+0000","last_peered":"2024-03-30T12:36:03.222640+0000","last_clean":"2024-03-30T12:36:03.222640+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:36:03.222640+0000","last_undegraded":"2024-03-30T12:36:03.222640+0000","last_fullsized":"2024-03-30T12:36:03.222640+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1285,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-03-30T12:36:02.052733+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:36:02.052733+0000","last_peered":"2024-03-30T12:36:02.052733+0000","last_clean":"2024-03-30T12:36:02.052733+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:36:02.052733+0000","last_undegraded":"2024-03-30T12:36:02.052733+0000","last_fullsized":"2024-03-30T12:36:02.052733+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5608,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.017067+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:36:03.017067+0000","last_peered":"2024-03-30T12:36:03.017067+0000","last_clean":"2024-03-30T12:36:03.017067+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:36:03.017067+0000","last_undegraded":"2024-03-30T12:36:03.017067+0000","last_fullsized":"2024-03-30T12:36:03.017067+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1363,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220405+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:36:03.220405+0000","last_peered":"2024-03-30T12:36:03.220405+0000","last_clean":"2024-03-30T12:36:03.220405+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:36:03.220405+0000","last_undegraded":"2024-03-30T12:36:03.220405+0000","last_fullsized":"2024-03-30T12:36:03.220405+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1293,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-03-30T12:36:02.052707+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:02.052707+0000","last_peered":"2024-03-30T12:36:02.052707+0000","last_clean":"2024-03-30T12:36:02.052707+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:02.052707+0000","last_undegraded":"2024-03-30T12:36:02.052707+0000","last_fullsized":"2024-03-30T12:36:02.052707+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222830+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:36:03.222830+0000","last_peered":"2024-03-30T12:36:03.222830+0000","last_clean":"2024-03-30T12:36:03.222830+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:36:03.222830+0000","last_undegraded":"2024-03-30T12:36:03.222830+0000","last_fullsized":"2024-03-30T12:36:03.222830+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017152+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:36:03.017152+0000","last_peered":"2024-03-30T12:36:03.017152+0000","last_clean":"2024-03-30T12:36:03.017152+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:36:03.017152+0000","last_undegraded":"2024-03-30T12:36:03.017152+0000","last_fullsized":"2024-03-30T12:36:03.017152+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1181,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220998+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:36:03.220998+0000","last_peered":"2024-03-30T12:36:03.220998+0000","last_clean":"2024-03-30T12:36:03.220998+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:36:03.220998+0000","last_undegraded":"2024-03-30T12:36:03.220998+0000","last_fullsized":"2024-03-30T12:36:03.220998+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5251,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.016853+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:36:03.016853+0000","last_peered":"2024-03-30T12:36:03.016853+0000","last_clean":"2024-03-30T12:36:03.016853+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:36:03.016853+0000","last_undegraded":"2024-03-30T12:36:03.016853+0000","last_fullsized":"2024-03-30T12:36:03.016853+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1329,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016013+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:36:03.016013+0000","last_peered":"2024-03-30T12:36:03.016013+0000","last_clean":"2024-03-30T12:36:03.016013+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:36:03.016013+0000","last_undegraded":"2024-03-30T12:36:03.016013+0000","last_fullsized":"2024-03-30T12:36:03.016013+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017739+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:36:03.017739+0000","last_peered":"2024-03-30T12:36:03.017739+0000","last_clean":"2024-03-30T12:36:03.017739+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:36:03.017739+0000","last_undegraded":"2024-03-30T12:36:03.017739+0000","last_fullsized":"2024-03-30T12:36:03.017739+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4809,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.016990+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:36:03.016990+0000","last_peered":"2024-03-30T12:36:03.016990+0000","last_clean":"2024-03-30T12:36:03.016990+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:36:03.016990+0000","last_undegraded":"2024-03-30T12:36:03.016990+0000","last_fullsized":"2024-03-30T12:36:03.016990+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220902+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:36:03.220902+0000","last_peered":"2024-03-30T12:36:03.220902+0000","last_clean":"2024-03-30T12:36:03.220902+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:36:03.220902+0000","last_undegraded":"2024-03-30T12:36:03.220902+0000","last_fullsized":"2024-03-30T12:36:03.220902+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222557+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:36:03.222557+0000","last_peered":"2024-03-30T12:36:03.222557+0000","last_clean":"2024-03-30T12:36:03.222557+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:36:03.222557+0000","last_undegraded":"2024-03-30T12:36:03.222557+0000","last_fullsized":"2024-03-30T12:36:03.222557+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6741,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.018460+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:36:03.018460+0000","last_peered":"2024-03-30T12:36:03.018460+0000","last_clean":"2024-03-30T12:36:03.018460+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:36:03.018460+0000","last_undegraded":"2024-03-30T12:36:03.018460+0000","last_fullsized":"2024-03-30T12:36:03.018460+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1335,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016305+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:36:03.016305+0000","last_peered":"2024-03-30T12:36:03.016305+0000","last_clean":"2024-03-30T12:36:03.016305+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:36:03.016305+0000","last_undegraded":"2024-03-30T12:36:03.016305+0000","last_fullsized":"2024-03-30T12:36:03.016305+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018870+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:36:03.018870+0000","last_peered":"2024-03-30T12:36:03.018870+0000","last_clean":"2024-03-30T12:36:03.018870+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:36:03.018870+0000","last_undegraded":"2024-03-30T12:36:03.018870+0000","last_fullsized":"2024-03-30T12:36:03.018870+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220120+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:36:03.220120+0000","last_peered":"2024-03-30T12:36:03.220120+0000","last_clean":"2024-03-30T12:36:03.220120+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:36:03.220120+0000","last_undegraded":"2024-03-30T12:36:03.220120+0000","last_fullsized":"2024-03-30T12:36:03.220120+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015273+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:36:03.015273+0000","last_peered":"2024-03-30T12:36:03.015273+0000","last_clean":"2024-03-30T12:36:03.015273+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:36:03.015273+0000","last_undegraded":"2024-03-30T12:36:03.015273+0000","last_fullsized":"2024-03-30T12:36:03.015273+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1237,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221900+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:36:03.221900+0000","last_peered":"2024-03-30T12:36:03.221900+0000","last_clean":"2024-03-30T12:36:03.221900+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:36:03.221900+0000","last_undegraded":"2024-03-30T12:36:03.221900+0000","last_fullsized":"2024-03-30T12:36:03.221900+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220998+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:36:03.220998+0000","last_peered":"2024-03-30T12:36:03.220998+0000","last_clean":"2024-03-30T12:36:03.220998+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:36:03.220998+0000","last_undegraded":"2024-03-30T12:36:03.220998+0000","last_fullsized":"2024-03-30T12:36:03.220998+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1292,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-03-30T12:36:02.052732+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:36:02.052732+0000","last_peered":"2024-03-30T12:36:02.052732+0000","last_clean":"2024-03-30T12:36:02.052732+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:36:02.052732+0000","last_undegraded":"2024-03-30T12:36:02.052732+0000","last_fullsized":"2024-03-30T12:36:02.052732+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221004+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:36:03.221004+0000","last_peered":"2024-03-30T12:36:03.221004+0000","last_clean":"2024-03-30T12:36:03.221004+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:36:03.221004+0000","last_undegraded":"2024-03-30T12:36:03.221004+0000","last_fullsized":"2024-03-30T12:36:03.221004+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1175,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221094+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:36:03.221094+0000","last_peered":"2024-03-30T12:36:03.221094+0000","last_clean":"2024-03-30T12:36:03.221094+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:36:03.221094+0000","last_undegraded":"2024-03-30T12:36:03.221094+0000","last_fullsized":"2024-03-30T12:36:03.221094+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1277,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-03-30T12:36:02.054027+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:36:02.054027+0000","last_peered":"2024-03-30T12:36:02.054027+0000","last_clean":"2024-03-30T12:36:02.054027+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:36:02.054027+0000","last_undegraded":"2024-03-30T12:36:02.054027+0000","last_fullsized":"2024-03-30T12:36:02.054027+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1237,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221506+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:36:03.221506+0000","last_peered":"2024-03-30T12:36:03.221506+0000","last_clean":"2024-03-30T12:36:03.221506+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:36:03.221506+0000","last_undegraded":"2024-03-30T12:36:03.221506+0000","last_fullsized":"2024-03-30T12:36:03.221506+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1285,"reported_epoch":865,"state":"active+clean","last_fresh":"2024-03-30T12:36:02.052621+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:02.052621+0000","last_peered":"2024-03-30T12:36:02.052621+0000","last_clean":"2024-03-30T12:36:02.052621+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:02.052621+0000","last_undegraded":"2024-03-30T12:36:02.052621+0000","last_fullsized":"2024-03-30T12:36:02.052621+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221549+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:36:03.221549+0000","last_peered":"2024-03-30T12:36:03.221549+0000","last_clean":"2024-03-30T12:36:03.221549+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:36:03.221549+0000","last_undegraded":"2024-03-30T12:36:03.221549+0000","last_fullsized":"2024-03-30T12:36:03.221549+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220884+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:36:03.220884+0000","last_peered":"2024-03-30T12:36:03.220884+0000","last_clean":"2024-03-30T12:36:03.220884+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:36:03.220884+0000","last_undegraded":"2024-03-30T12:36:03.220884+0000","last_fullsized":"2024-03-30T12:36:03.220884+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1181,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220468+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:36:03.220468+0000","last_peered":"2024-03-30T12:36:03.220468+0000","last_clean":"2024-03-30T12:36:03.220468+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:36:03.220468+0000","last_undegraded":"2024-03-30T12:36:03.220468+0000","last_fullsized":"2024-03-30T12:36:03.220468+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438022,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648078,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175088,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254327,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063145,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951202,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335396,"kb_used_data":165400,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409756,"statfs":{"total":95995035648,"available":94627590144,"internally_reserved":0,"allocated":169369600,"data_stored":388922172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839259,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380084,"kb_used_data":229224,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365068,"statfs":{"total":95995035648,"available":94581829632,"internally_reserved":0,"allocated":234725376,"data_stored":496879320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923542,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:36:08.748 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:08.748 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:08.748 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:08.748 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:08.748 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:08.748 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:08.748 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:08.748 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:08.748 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:08.748 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:08.748 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:08.749 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:08.749 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:08.749 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:36:09.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:08 smithi084 ceph-mon[91810]: from='client.44447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:36:09.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:08 smithi084 ceph-mon[91810]: pgmap v993: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 133 KiB/s rd, 591 KiB/s wr, 4 op/s 2024-03-30T12:36:09.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:08 smithi084 ceph-mon[89279]: from='client.44447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:36:09.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:08 smithi084 ceph-mon[89279]: pgmap v993: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 133 KiB/s rd, 591 KiB/s wr, 4 op/s 2024-03-30T12:36:09.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:08 smithi162 ceph-mon[83709]: from='client.44447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:36:09.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:08 smithi162 ceph-mon[83709]: pgmap v993: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 133 KiB/s rd, 591 KiB/s wr, 4 op/s 2024-03-30T12:36:09.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:36:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:36:09] "GET /metrics HTTP/1.1" 200 36326 "" "Prometheus/2.43.0" 2024-03-30T12:36:11.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:10 smithi162 ceph-mon[83709]: pgmap v994: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 118 KiB/s rd, 524 KiB/s wr, 3 op/s 2024-03-30T12:36:11.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:10 smithi084 ceph-mon[91810]: pgmap v994: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 118 KiB/s rd, 524 KiB/s wr, 3 op/s 2024-03-30T12:36:11.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:10 smithi084 ceph-mon[89279]: pgmap v994: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 118 KiB/s rd, 524 KiB/s wr, 3 op/s 2024-03-30T12:36:13.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:12 smithi162 ceph-mon[83709]: pgmap v995: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 104 KiB/s rd, 345 KiB/s wr, 2 op/s 2024-03-30T12:36:13.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:12 smithi084 ceph-mon[89279]: pgmap v995: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 104 KiB/s rd, 345 KiB/s wr, 2 op/s 2024-03-30T12:36:13.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:12 smithi084 ceph-mon[91810]: pgmap v995: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 104 KiB/s rd, 345 KiB/s wr, 2 op/s 2024-03-30T12:36:15.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:14 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:36:15.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:14 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:36:15.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:14 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:36:16.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:15 smithi084 ceph-mon[91810]: pgmap v996: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 88 KiB/s rd, 293 KiB/s wr, 2 op/s 2024-03-30T12:36:16.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:15 smithi084 ceph-mon[89279]: pgmap v996: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 88 KiB/s rd, 293 KiB/s wr, 2 op/s 2024-03-30T12:36:16.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:15 smithi162 ceph-mon[83709]: pgmap v996: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 88 KiB/s rd, 293 KiB/s wr, 2 op/s 2024-03-30T12:36:17.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:16 smithi162 ceph-mon[83709]: pgmap v997: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 86 KiB/s rd, 98 KiB/s wr, 0 op/s 2024-03-30T12:36:17.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:16 smithi084 ceph-mon[91810]: pgmap v997: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 86 KiB/s rd, 98 KiB/s wr, 0 op/s 2024-03-30T12:36:17.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:16 smithi084 ceph-mon[89279]: pgmap v997: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail; 86 KiB/s rd, 98 KiB/s wr, 0 op/s 2024-03-30T12:36:18.750 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:36:18.972 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:36:19.054 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:18 smithi084 ceph-mon[89279]: pgmap v998: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:19.055 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:18 smithi084 ceph-mon[91810]: pgmap v998: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:19.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:18 smithi162 ceph-mon[83709]: pgmap v998: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:19.331 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:36:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:36:19] "GET /metrics HTTP/1.1" 200 36329 "" "Prometheus/2.43.0" 2024-03-30T12:36:20.848 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:36:20.850 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:36:21.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:20 smithi162 ceph-mon[83709]: pgmap v999: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:21.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:20 smithi084 ceph-mon[91810]: pgmap v999: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:21.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:20 smithi084 ceph-mon[89279]: pgmap v999: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:21.629 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":999,"stamp":"2024-03-30T12:36:20.799984+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003891"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018620+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:36:03.018620+0000","last_peered":"2024-03-30T12:36:03.018620+0000","last_clean":"2024-03-30T12:36:03.018620+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:36:03.018620+0000","last_undegraded":"2024-03-30T12:36:03.018620+0000","last_fullsized":"2024-03-30T12:36:03.018620+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1362,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221591+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:36:03.221591+0000","last_peered":"2024-03-30T12:36:03.221591+0000","last_clean":"2024-03-30T12:36:03.221591+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:36:03.221591+0000","last_undegraded":"2024-03-30T12:36:03.221591+0000","last_fullsized":"2024-03-30T12:36:03.221591+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221166+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:36:03.221166+0000","last_peered":"2024-03-30T12:36:03.221166+0000","last_clean":"2024-03-30T12:36:03.221166+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:36:03.221166+0000","last_undegraded":"2024-03-30T12:36:03.221166+0000","last_fullsized":"2024-03-30T12:36:03.221166+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222033+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:36:03.222033+0000","last_peered":"2024-03-30T12:36:03.222033+0000","last_clean":"2024-03-30T12:36:03.222033+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:36:03.222033+0000","last_undegraded":"2024-03-30T12:36:03.222033+0000","last_fullsized":"2024-03-30T12:36:03.222033+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016806+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:36:03.016806+0000","last_peered":"2024-03-30T12:36:03.016806+0000","last_clean":"2024-03-30T12:36:03.016806+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:36:03.016806+0000","last_undegraded":"2024-03-30T12:36:03.016806+0000","last_fullsized":"2024-03-30T12:36:03.016806+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1208,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222037+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:03.222037+0000","last_peered":"2024-03-30T12:36:03.222037+0000","last_clean":"2024-03-30T12:36:03.222037+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:03.222037+0000","last_undegraded":"2024-03-30T12:36:03.222037+0000","last_fullsized":"2024-03-30T12:36:03.222037+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017295+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:36:03.017295+0000","last_peered":"2024-03-30T12:36:03.017295+0000","last_clean":"2024-03-30T12:36:03.017295+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:36:03.017295+0000","last_undegraded":"2024-03-30T12:36:03.017295+0000","last_fullsized":"2024-03-30T12:36:03.017295+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1257,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219724+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:36:03.219724+0000","last_peered":"2024-03-30T12:36:03.219724+0000","last_clean":"2024-03-30T12:36:03.219724+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:36:03.219724+0000","last_undegraded":"2024-03-30T12:36:03.219724+0000","last_fullsized":"2024-03-30T12:36:03.219724+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017862+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:36:03.017862+0000","last_peered":"2024-03-30T12:36:03.017862+0000","last_clean":"2024-03-30T12:36:03.017862+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:36:03.017862+0000","last_undegraded":"2024-03-30T12:36:03.017862+0000","last_fullsized":"2024-03-30T12:36:03.017862+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1167,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220710+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:03.220710+0000","last_peered":"2024-03-30T12:36:03.220710+0000","last_clean":"2024-03-30T12:36:03.220710+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:03.220710+0000","last_undegraded":"2024-03-30T12:36:03.220710+0000","last_fullsized":"2024-03-30T12:36:03.220710+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1167,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220416+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:03.220416+0000","last_peered":"2024-03-30T12:36:03.220416+0000","last_clean":"2024-03-30T12:36:03.220416+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:03.220416+0000","last_undegraded":"2024-03-30T12:36:03.220416+0000","last_fullsized":"2024-03-30T12:36:03.220416+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1269,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020196+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:36:03.020196+0000","last_peered":"2024-03-30T12:36:03.020196+0000","last_clean":"2024-03-30T12:36:03.020196+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:36:03.020196+0000","last_undegraded":"2024-03-30T12:36:03.020196+0000","last_fullsized":"2024-03-30T12:36:03.020196+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1287,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221647+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:36:03.221647+0000","last_peered":"2024-03-30T12:36:03.221647+0000","last_clean":"2024-03-30T12:36:03.221647+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:36:03.221647+0000","last_undegraded":"2024-03-30T12:36:03.221647+0000","last_fullsized":"2024-03-30T12:36:03.221647+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220445+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:36:03.220445+0000","last_peered":"2024-03-30T12:36:03.220445+0000","last_clean":"2024-03-30T12:36:03.220445+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:36:03.220445+0000","last_undegraded":"2024-03-30T12:36:03.220445+0000","last_fullsized":"2024-03-30T12:36:03.220445+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222534+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:36:03.222534+0000","last_peered":"2024-03-30T12:36:03.222534+0000","last_clean":"2024-03-30T12:36:03.222534+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:36:03.222534+0000","last_undegraded":"2024-03-30T12:36:03.222534+0000","last_fullsized":"2024-03-30T12:36:03.222534+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221410+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:36:03.221410+0000","last_peered":"2024-03-30T12:36:03.221410+0000","last_clean":"2024-03-30T12:36:03.221410+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:36:03.221410+0000","last_undegraded":"2024-03-30T12:36:03.221410+0000","last_fullsized":"2024-03-30T12:36:03.221410+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1223,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222946+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:36:03.222946+0000","last_peered":"2024-03-30T12:36:03.222946+0000","last_clean":"2024-03-30T12:36:03.222946+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:36:03.222946+0000","last_undegraded":"2024-03-30T12:36:03.222946+0000","last_fullsized":"2024-03-30T12:36:03.222946+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1330,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015944+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:36:03.015944+0000","last_peered":"2024-03-30T12:36:03.015944+0000","last_clean":"2024-03-30T12:36:03.015944+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:36:03.015944+0000","last_undegraded":"2024-03-30T12:36:03.015944+0000","last_fullsized":"2024-03-30T12:36:03.015944+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017890+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:36:03.017890+0000","last_peered":"2024-03-30T12:36:03.017890+0000","last_clean":"2024-03-30T12:36:03.017890+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:36:03.017890+0000","last_undegraded":"2024-03-30T12:36:03.017890+0000","last_fullsized":"2024-03-30T12:36:03.017890+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1386,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221029+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:36:03.221029+0000","last_peered":"2024-03-30T12:36:03.221029+0000","last_clean":"2024-03-30T12:36:03.221029+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:36:03.221029+0000","last_undegraded":"2024-03-30T12:36:03.221029+0000","last_fullsized":"2024-03-30T12:36:03.221029+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1281,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220779+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:36:03.220779+0000","last_peered":"2024-03-30T12:36:03.220779+0000","last_clean":"2024-03-30T12:36:03.220779+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:36:03.220779+0000","last_undegraded":"2024-03-30T12:36:03.220779+0000","last_fullsized":"2024-03-30T12:36:03.220779+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1300,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220968+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:36:03.220968+0000","last_peered":"2024-03-30T12:36:03.220968+0000","last_clean":"2024-03-30T12:36:03.220968+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:36:03.220968+0000","last_undegraded":"2024-03-30T12:36:03.220968+0000","last_fullsized":"2024-03-30T12:36:03.220968+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220308+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:36:03.220308+0000","last_peered":"2024-03-30T12:36:03.220308+0000","last_clean":"2024-03-30T12:36:03.220308+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:36:03.220308+0000","last_undegraded":"2024-03-30T12:36:03.220308+0000","last_fullsized":"2024-03-30T12:36:03.220308+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017887+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:36:03.017887+0000","last_peered":"2024-03-30T12:36:03.017887+0000","last_clean":"2024-03-30T12:36:03.017887+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:36:03.017887+0000","last_undegraded":"2024-03-30T12:36:03.017887+0000","last_fullsized":"2024-03-30T12:36:03.017887+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1227,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222664+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:03.222664+0000","last_peered":"2024-03-30T12:36:03.222664+0000","last_clean":"2024-03-30T12:36:03.222664+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:03.222664+0000","last_undegraded":"2024-03-30T12:36:03.222664+0000","last_fullsized":"2024-03-30T12:36:03.222664+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017639+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:36:03.017639+0000","last_peered":"2024-03-30T12:36:03.017639+0000","last_clean":"2024-03-30T12:36:03.017639+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:36:03.017639+0000","last_undegraded":"2024-03-30T12:36:03.017639+0000","last_fullsized":"2024-03-30T12:36:03.017639+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1211,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222188+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:03.222188+0000","last_peered":"2024-03-30T12:36:03.222188+0000","last_clean":"2024-03-30T12:36:03.222188+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:03.222188+0000","last_undegraded":"2024-03-30T12:36:03.222188+0000","last_fullsized":"2024-03-30T12:36:03.222188+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221804+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:36:03.221804+0000","last_peered":"2024-03-30T12:36:03.221804+0000","last_clean":"2024-03-30T12:36:03.221804+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:36:03.221804+0000","last_undegraded":"2024-03-30T12:36:03.221804+0000","last_fullsized":"2024-03-30T12:36:03.221804+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018855+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:36:03.018855+0000","last_peered":"2024-03-30T12:36:03.018855+0000","last_clean":"2024-03-30T12:36:03.018855+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:36:03.018855+0000","last_undegraded":"2024-03-30T12:36:03.018855+0000","last_fullsized":"2024-03-30T12:36:03.018855+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1178,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220485+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:36:03.220485+0000","last_peered":"2024-03-30T12:36:03.220485+0000","last_clean":"2024-03-30T12:36:03.220485+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:36:03.220485+0000","last_undegraded":"2024-03-30T12:36:03.220485+0000","last_fullsized":"2024-03-30T12:36:03.220485+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221577+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:36:03.221577+0000","last_peered":"2024-03-30T12:36:03.221577+0000","last_clean":"2024-03-30T12:36:03.221577+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:36:03.221577+0000","last_undegraded":"2024-03-30T12:36:03.221577+0000","last_fullsized":"2024-03-30T12:36:03.221577+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219793+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:36:03.219793+0000","last_peered":"2024-03-30T12:36:03.219793+0000","last_clean":"2024-03-30T12:36:03.219793+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:36:03.219793+0000","last_undegraded":"2024-03-30T12:36:03.219793+0000","last_fullsized":"2024-03-30T12:36:03.219793+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1293,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219776+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:36:03.219776+0000","last_peered":"2024-03-30T12:36:03.219776+0000","last_clean":"2024-03-30T12:36:03.219776+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:36:03.219776+0000","last_undegraded":"2024-03-30T12:36:03.219776+0000","last_fullsized":"2024-03-30T12:36:03.219776+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1223,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221769+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:36:03.221769+0000","last_peered":"2024-03-30T12:36:03.221769+0000","last_clean":"2024-03-30T12:36:03.221769+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:36:03.221769+0000","last_undegraded":"2024-03-30T12:36:03.221769+0000","last_fullsized":"2024-03-30T12:36:03.221769+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1346,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222924+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:36:03.222924+0000","last_peered":"2024-03-30T12:36:03.222924+0000","last_clean":"2024-03-30T12:36:03.222924+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:36:03.222924+0000","last_undegraded":"2024-03-30T12:36:03.222924+0000","last_fullsized":"2024-03-30T12:36:03.222924+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220706+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:03.220706+0000","last_peered":"2024-03-30T12:36:03.220706+0000","last_clean":"2024-03-30T12:36:03.220706+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:03.220706+0000","last_undegraded":"2024-03-30T12:36:03.220706+0000","last_fullsized":"2024-03-30T12:36:03.220706+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1203,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222317+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:36:03.222317+0000","last_peered":"2024-03-30T12:36:03.222317+0000","last_clean":"2024-03-30T12:36:03.222317+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:36:03.222317+0000","last_undegraded":"2024-03-30T12:36:03.222317+0000","last_fullsized":"2024-03-30T12:36:03.222317+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1197,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222067+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:36:03.222067+0000","last_peered":"2024-03-30T12:36:03.222067+0000","last_clean":"2024-03-30T12:36:03.222067+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:36:03.222067+0000","last_undegraded":"2024-03-30T12:36:03.222067+0000","last_fullsized":"2024-03-30T12:36:03.222067+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015689+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:36:03.015689+0000","last_peered":"2024-03-30T12:36:03.015689+0000","last_clean":"2024-03-30T12:36:03.015689+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:36:03.015689+0000","last_undegraded":"2024-03-30T12:36:03.015689+0000","last_fullsized":"2024-03-30T12:36:03.015689+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221226+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:36:03.221226+0000","last_peered":"2024-03-30T12:36:03.221226+0000","last_clean":"2024-03-30T12:36:03.221226+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:36:03.221226+0000","last_undegraded":"2024-03-30T12:36:03.221226+0000","last_fullsized":"2024-03-30T12:36:03.221226+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020038+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:36:03.020038+0000","last_peered":"2024-03-30T12:36:03.020038+0000","last_clean":"2024-03-30T12:36:03.020038+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:36:03.020038+0000","last_undegraded":"2024-03-30T12:36:03.020038+0000","last_fullsized":"2024-03-30T12:36:03.020038+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1203,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220666+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:36:03.220666+0000","last_peered":"2024-03-30T12:36:03.220666+0000","last_clean":"2024-03-30T12:36:03.220666+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:36:03.220666+0000","last_undegraded":"2024-03-30T12:36:03.220666+0000","last_fullsized":"2024-03-30T12:36:03.220666+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017379+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:36:03.017379+0000","last_peered":"2024-03-30T12:36:03.017379+0000","last_clean":"2024-03-30T12:36:03.017379+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:36:03.017379+0000","last_undegraded":"2024-03-30T12:36:03.017379+0000","last_fullsized":"2024-03-30T12:36:03.017379+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221717+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:36:03.221717+0000","last_peered":"2024-03-30T12:36:03.221717+0000","last_clean":"2024-03-30T12:36:03.221717+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:36:03.221717+0000","last_undegraded":"2024-03-30T12:36:03.221717+0000","last_fullsized":"2024-03-30T12:36:03.221717+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220742+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:36:03.220742+0000","last_peered":"2024-03-30T12:36:03.220742+0000","last_clean":"2024-03-30T12:36:03.220742+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:36:03.220742+0000","last_undegraded":"2024-03-30T12:36:03.220742+0000","last_fullsized":"2024-03-30T12:36:03.220742+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221904+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:36:03.221904+0000","last_peered":"2024-03-30T12:36:03.221904+0000","last_clean":"2024-03-30T12:36:03.221904+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:36:03.221904+0000","last_undegraded":"2024-03-30T12:36:03.221904+0000","last_fullsized":"2024-03-30T12:36:03.221904+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017448+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:36:03.017448+0000","last_peered":"2024-03-30T12:36:03.017448+0000","last_clean":"2024-03-30T12:36:03.017448+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:36:03.017448+0000","last_undegraded":"2024-03-30T12:36:03.017448+0000","last_fullsized":"2024-03-30T12:36:03.017448+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220190+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:36:03.220190+0000","last_peered":"2024-03-30T12:36:03.220190+0000","last_clean":"2024-03-30T12:36:03.220190+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:36:03.220190+0000","last_undegraded":"2024-03-30T12:36:03.220190+0000","last_fullsized":"2024-03-30T12:36:03.220190+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1167,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220128+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:36:03.220128+0000","last_peered":"2024-03-30T12:36:03.220128+0000","last_clean":"2024-03-30T12:36:03.220128+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:36:03.220128+0000","last_undegraded":"2024-03-30T12:36:03.220128+0000","last_fullsized":"2024-03-30T12:36:03.220128+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1342,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015578+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:36:03.015578+0000","last_peered":"2024-03-30T12:36:03.015578+0000","last_clean":"2024-03-30T12:36:03.015578+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:36:03.015578+0000","last_undegraded":"2024-03-30T12:36:03.015578+0000","last_fullsized":"2024-03-30T12:36:03.015578+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016564+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:36:03.016564+0000","last_peered":"2024-03-30T12:36:03.016564+0000","last_clean":"2024-03-30T12:36:03.016564+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:36:03.016564+0000","last_undegraded":"2024-03-30T12:36:03.016564+0000","last_fullsized":"2024-03-30T12:36:03.016564+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5751,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.016013+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:36:03.016013+0000","last_peered":"2024-03-30T12:36:03.016013+0000","last_clean":"2024-03-30T12:36:03.016013+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:36:03.016013+0000","last_undegraded":"2024-03-30T12:36:03.016013+0000","last_fullsized":"2024-03-30T12:36:03.016013+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020346+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:36:03.020346+0000","last_peered":"2024-03-30T12:36:03.020346+0000","last_clean":"2024-03-30T12:36:03.020346+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:36:03.020346+0000","last_undegraded":"2024-03-30T12:36:03.020346+0000","last_fullsized":"2024-03-30T12:36:03.020346+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018002+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:36:03.018002+0000","last_peered":"2024-03-30T12:36:03.018002+0000","last_clean":"2024-03-30T12:36:03.018002+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:36:03.018002+0000","last_undegraded":"2024-03-30T12:36:03.018002+0000","last_fullsized":"2024-03-30T12:36:03.018002+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5511,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.221420+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:36:03.221420+0000","last_peered":"2024-03-30T12:36:03.221420+0000","last_clean":"2024-03-30T12:36:03.221420+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:36:03.221420+0000","last_undegraded":"2024-03-30T12:36:03.221420+0000","last_fullsized":"2024-03-30T12:36:03.221420+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220564+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:36:03.220564+0000","last_peered":"2024-03-30T12:36:03.220564+0000","last_clean":"2024-03-30T12:36:03.220564+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:36:03.220564+0000","last_undegraded":"2024-03-30T12:36:03.220564+0000","last_fullsized":"2024-03-30T12:36:03.220564+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222416+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:36:03.222416+0000","last_peered":"2024-03-30T12:36:03.222416+0000","last_clean":"2024-03-30T12:36:03.222416+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:36:03.222416+0000","last_undegraded":"2024-03-30T12:36:03.222416+0000","last_fullsized":"2024-03-30T12:36:03.222416+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1237,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222091+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:36:03.222091+0000","last_peered":"2024-03-30T12:36:03.222091+0000","last_clean":"2024-03-30T12:36:03.222091+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:36:03.222091+0000","last_undegraded":"2024-03-30T12:36:03.222091+0000","last_fullsized":"2024-03-30T12:36:03.222091+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5456,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.221793+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:36:03.221793+0000","last_peered":"2024-03-30T12:36:03.221793+0000","last_clean":"2024-03-30T12:36:03.221793+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:36:03.221793+0000","last_undegraded":"2024-03-30T12:36:03.221793+0000","last_fullsized":"2024-03-30T12:36:03.221793+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222540+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:36:03.222540+0000","last_peered":"2024-03-30T12:36:03.222540+0000","last_clean":"2024-03-30T12:36:03.222540+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:36:03.222540+0000","last_undegraded":"2024-03-30T12:36:03.222540+0000","last_fullsized":"2024-03-30T12:36:03.222540+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221637+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:36:03.221637+0000","last_peered":"2024-03-30T12:36:03.221637+0000","last_clean":"2024-03-30T12:36:03.221637+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:36:03.221637+0000","last_undegraded":"2024-03-30T12:36:03.221637+0000","last_fullsized":"2024-03-30T12:36:03.221637+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1270,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019257+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:36:03.019257+0000","last_peered":"2024-03-30T12:36:03.019257+0000","last_clean":"2024-03-30T12:36:03.019257+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:36:03.019257+0000","last_undegraded":"2024-03-30T12:36:03.019257+0000","last_fullsized":"2024-03-30T12:36:03.019257+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3802,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016632+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:36:03.016632+0000","last_peered":"2024-03-30T12:36:03.016632+0000","last_clean":"2024-03-30T12:36:03.016632+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:36:03.016632+0000","last_undegraded":"2024-03-30T12:36:03.016632+0000","last_fullsized":"2024-03-30T12:36:03.016632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1341,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222936+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:36:03.222936+0000","last_peered":"2024-03-30T12:36:03.222936+0000","last_clean":"2024-03-30T12:36:03.222936+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:36:03.222936+0000","last_undegraded":"2024-03-30T12:36:03.222936+0000","last_fullsized":"2024-03-30T12:36:03.222936+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221995+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:36:03.221995+0000","last_peered":"2024-03-30T12:36:03.221995+0000","last_clean":"2024-03-30T12:36:03.221995+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:36:03.221995+0000","last_undegraded":"2024-03-30T12:36:03.221995+0000","last_fullsized":"2024-03-30T12:36:03.221995+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1330,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015172+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:36:03.015172+0000","last_peered":"2024-03-30T12:36:03.015172+0000","last_clean":"2024-03-30T12:36:03.015172+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:36:03.015172+0000","last_undegraded":"2024-03-30T12:36:03.015172+0000","last_fullsized":"2024-03-30T12:36:03.015172+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4574,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.018860+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:36:03.018860+0000","last_peered":"2024-03-30T12:36:03.018860+0000","last_clean":"2024-03-30T12:36:03.018860+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:36:03.018860+0000","last_undegraded":"2024-03-30T12:36:03.018860+0000","last_fullsized":"2024-03-30T12:36:03.018860+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1173,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220732+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:36:03.220732+0000","last_peered":"2024-03-30T12:36:03.220732+0000","last_clean":"2024-03-30T12:36:03.220732+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:36:03.220732+0000","last_undegraded":"2024-03-30T12:36:03.220732+0000","last_fullsized":"2024-03-30T12:36:03.220732+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221414+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:36:03.221414+0000","last_peered":"2024-03-30T12:36:03.221414+0000","last_clean":"2024-03-30T12:36:03.221414+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:36:03.221414+0000","last_undegraded":"2024-03-30T12:36:03.221414+0000","last_fullsized":"2024-03-30T12:36:03.221414+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1198,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221904+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:36:03.221904+0000","last_peered":"2024-03-30T12:36:03.221904+0000","last_clean":"2024-03-30T12:36:03.221904+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:36:03.221904+0000","last_undegraded":"2024-03-30T12:36:03.221904+0000","last_fullsized":"2024-03-30T12:36:03.221904+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1715,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016476+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:36:03.016476+0000","last_peered":"2024-03-30T12:36:03.016476+0000","last_clean":"2024-03-30T12:36:03.016476+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:36:03.016476+0000","last_undegraded":"2024-03-30T12:36:03.016476+0000","last_fullsized":"2024-03-30T12:36:03.016476+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24712,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223515+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:36:03.223515+0000","last_peered":"2024-03-30T12:36:03.223515+0000","last_clean":"2024-03-30T12:36:03.223515+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:36:03.223515+0000","last_undegraded":"2024-03-30T12:36:03.223515+0000","last_fullsized":"2024-03-30T12:36:03.223515+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220576+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:36:03.220576+0000","last_peered":"2024-03-30T12:36:03.220576+0000","last_clean":"2024-03-30T12:36:03.220576+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:36:03.220576+0000","last_undegraded":"2024-03-30T12:36:03.220576+0000","last_fullsized":"2024-03-30T12:36:03.220576+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220655+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:36:03.220655+0000","last_peered":"2024-03-30T12:36:03.220655+0000","last_clean":"2024-03-30T12:36:03.220655+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:36:03.220655+0000","last_undegraded":"2024-03-30T12:36:03.220655+0000","last_fullsized":"2024-03-30T12:36:03.220655+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1143,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016477+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:36:03.016477+0000","last_peered":"2024-03-30T12:36:03.016477+0000","last_clean":"2024-03-30T12:36:03.016477+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:36:03.016477+0000","last_undegraded":"2024-03-30T12:36:03.016477+0000","last_fullsized":"2024-03-30T12:36:03.016477+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16479,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.221375+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:36:03.221375+0000","last_peered":"2024-03-30T12:36:03.221375+0000","last_clean":"2024-03-30T12:36:03.221375+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:36:03.221375+0000","last_undegraded":"2024-03-30T12:36:03.221375+0000","last_fullsized":"2024-03-30T12:36:03.221375+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221403+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:36:03.221403+0000","last_peered":"2024-03-30T12:36:03.221403+0000","last_clean":"2024-03-30T12:36:03.221403+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:36:03.221403+0000","last_undegraded":"2024-03-30T12:36:03.221403+0000","last_fullsized":"2024-03-30T12:36:03.221403+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017689+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:36:03.017689+0000","last_peered":"2024-03-30T12:36:03.017689+0000","last_clean":"2024-03-30T12:36:03.017689+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:36:03.017689+0000","last_undegraded":"2024-03-30T12:36:03.017689+0000","last_fullsized":"2024-03-30T12:36:03.017689+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222632+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:36:03.222632+0000","last_peered":"2024-03-30T12:36:03.222632+0000","last_clean":"2024-03-30T12:36:03.222632+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:36:03.222632+0000","last_undegraded":"2024-03-30T12:36:03.222632+0000","last_fullsized":"2024-03-30T12:36:03.222632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31267,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.020769+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:36:03.020769+0000","last_peered":"2024-03-30T12:36:03.020769+0000","last_clean":"2024-03-30T12:36:03.020769+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:36:03.020769+0000","last_undegraded":"2024-03-30T12:36:03.020769+0000","last_fullsized":"2024-03-30T12:36:03.020769+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1293,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219877+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:36:03.219877+0000","last_peered":"2024-03-30T12:36:03.219877+0000","last_clean":"2024-03-30T12:36:03.219877+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:36:03.219877+0000","last_undegraded":"2024-03-30T12:36:03.219877+0000","last_fullsized":"2024-03-30T12:36:03.219877+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221685+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:36:03.221685+0000","last_peered":"2024-03-30T12:36:03.221685+0000","last_clean":"2024-03-30T12:36:03.221685+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:36:03.221685+0000","last_undegraded":"2024-03-30T12:36:03.221685+0000","last_fullsized":"2024-03-30T12:36:03.221685+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221082+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:36:03.221082+0000","last_peered":"2024-03-30T12:36:03.221082+0000","last_clean":"2024-03-30T12:36:03.221082+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:36:03.221082+0000","last_undegraded":"2024-03-30T12:36:03.221082+0000","last_fullsized":"2024-03-30T12:36:03.221082+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3763,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219946+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:36:03.219946+0000","last_peered":"2024-03-30T12:36:03.219946+0000","last_clean":"2024-03-30T12:36:03.219946+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:36:03.219946+0000","last_undegraded":"2024-03-30T12:36:03.219946+0000","last_fullsized":"2024-03-30T12:36:03.219946+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019106+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:36:03.019106+0000","last_peered":"2024-03-30T12:36:03.019106+0000","last_clean":"2024-03-30T12:36:03.019106+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:36:03.019106+0000","last_undegraded":"2024-03-30T12:36:03.019106+0000","last_fullsized":"2024-03-30T12:36:03.019106+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220680+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:36:03.220680+0000","last_peered":"2024-03-30T12:36:03.220680+0000","last_clean":"2024-03-30T12:36:03.220680+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:36:03.220680+0000","last_undegraded":"2024-03-30T12:36:03.220680+0000","last_fullsized":"2024-03-30T12:36:03.220680+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220307+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:36:03.220307+0000","last_peered":"2024-03-30T12:36:03.220307+0000","last_clean":"2024-03-30T12:36:03.220307+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:36:03.220307+0000","last_undegraded":"2024-03-30T12:36:03.220307+0000","last_fullsized":"2024-03-30T12:36:03.220307+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15592,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223226+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:36:03.223226+0000","last_peered":"2024-03-30T12:36:03.223226+0000","last_clean":"2024-03-30T12:36:03.223226+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:36:03.223226+0000","last_undegraded":"2024-03-30T12:36:03.223226+0000","last_fullsized":"2024-03-30T12:36:03.223226+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1141,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016730+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:36:03.016730+0000","last_peered":"2024-03-30T12:36:03.016730+0000","last_clean":"2024-03-30T12:36:03.016730+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:36:03.016730+0000","last_undegraded":"2024-03-30T12:36:03.016730+0000","last_fullsized":"2024-03-30T12:36:03.016730+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1256,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018912+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:36:03.018912+0000","last_peered":"2024-03-30T12:36:03.018912+0000","last_clean":"2024-03-30T12:36:03.018912+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:36:03.018912+0000","last_undegraded":"2024-03-30T12:36:03.018912+0000","last_fullsized":"2024-03-30T12:36:03.018912+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29018,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.020535+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:36:03.020535+0000","last_peered":"2024-03-30T12:36:03.020535+0000","last_clean":"2024-03-30T12:36:03.020535+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:36:03.020535+0000","last_undegraded":"2024-03-30T12:36:03.020535+0000","last_fullsized":"2024-03-30T12:36:03.020535+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222640+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:36:03.222640+0000","last_peered":"2024-03-30T12:36:03.222640+0000","last_clean":"2024-03-30T12:36:03.222640+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:36:03.222640+0000","last_undegraded":"2024-03-30T12:36:03.222640+0000","last_fullsized":"2024-03-30T12:36:03.222640+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1287,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220000+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:36:03.220000+0000","last_peered":"2024-03-30T12:36:03.220000+0000","last_clean":"2024-03-30T12:36:03.220000+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:36:03.220000+0000","last_undegraded":"2024-03-30T12:36:03.220000+0000","last_fullsized":"2024-03-30T12:36:03.220000+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5608,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.017067+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:36:03.017067+0000","last_peered":"2024-03-30T12:36:03.017067+0000","last_clean":"2024-03-30T12:36:03.017067+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:36:03.017067+0000","last_undegraded":"2024-03-30T12:36:03.017067+0000","last_fullsized":"2024-03-30T12:36:03.017067+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1363,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220405+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:36:03.220405+0000","last_peered":"2024-03-30T12:36:03.220405+0000","last_clean":"2024-03-30T12:36:03.220405+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:36:03.220405+0000","last_undegraded":"2024-03-30T12:36:03.220405+0000","last_fullsized":"2024-03-30T12:36:03.220405+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221542+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:03.221542+0000","last_peered":"2024-03-30T12:36:03.221542+0000","last_clean":"2024-03-30T12:36:03.221542+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:03.221542+0000","last_undegraded":"2024-03-30T12:36:03.221542+0000","last_fullsized":"2024-03-30T12:36:03.221542+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222830+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:36:03.222830+0000","last_peered":"2024-03-30T12:36:03.222830+0000","last_clean":"2024-03-30T12:36:03.222830+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:36:03.222830+0000","last_undegraded":"2024-03-30T12:36:03.222830+0000","last_fullsized":"2024-03-30T12:36:03.222830+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017152+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:36:03.017152+0000","last_peered":"2024-03-30T12:36:03.017152+0000","last_clean":"2024-03-30T12:36:03.017152+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:36:03.017152+0000","last_undegraded":"2024-03-30T12:36:03.017152+0000","last_fullsized":"2024-03-30T12:36:03.017152+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221062+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:36:03.221062+0000","last_peered":"2024-03-30T12:36:03.221062+0000","last_clean":"2024-03-30T12:36:03.221062+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:36:03.221062+0000","last_undegraded":"2024-03-30T12:36:03.221062+0000","last_fullsized":"2024-03-30T12:36:03.221062+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5251,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.016853+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:36:03.016853+0000","last_peered":"2024-03-30T12:36:03.016853+0000","last_clean":"2024-03-30T12:36:03.016853+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:36:03.016853+0000","last_undegraded":"2024-03-30T12:36:03.016853+0000","last_fullsized":"2024-03-30T12:36:03.016853+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1329,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016013+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:36:03.016013+0000","last_peered":"2024-03-30T12:36:03.016013+0000","last_clean":"2024-03-30T12:36:03.016013+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:36:03.016013+0000","last_undegraded":"2024-03-30T12:36:03.016013+0000","last_fullsized":"2024-03-30T12:36:03.016013+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017739+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:36:03.017739+0000","last_peered":"2024-03-30T12:36:03.017739+0000","last_clean":"2024-03-30T12:36:03.017739+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:36:03.017739+0000","last_undegraded":"2024-03-30T12:36:03.017739+0000","last_fullsized":"2024-03-30T12:36:03.017739+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4809,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.016990+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:36:03.016990+0000","last_peered":"2024-03-30T12:36:03.016990+0000","last_clean":"2024-03-30T12:36:03.016990+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:36:03.016990+0000","last_undegraded":"2024-03-30T12:36:03.016990+0000","last_fullsized":"2024-03-30T12:36:03.016990+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220902+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:36:03.220902+0000","last_peered":"2024-03-30T12:36:03.220902+0000","last_clean":"2024-03-30T12:36:03.220902+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:36:03.220902+0000","last_undegraded":"2024-03-30T12:36:03.220902+0000","last_fullsized":"2024-03-30T12:36:03.220902+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222557+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:36:03.222557+0000","last_peered":"2024-03-30T12:36:03.222557+0000","last_clean":"2024-03-30T12:36:03.222557+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:36:03.222557+0000","last_undegraded":"2024-03-30T12:36:03.222557+0000","last_fullsized":"2024-03-30T12:36:03.222557+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6741,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.018460+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:36:03.018460+0000","last_peered":"2024-03-30T12:36:03.018460+0000","last_clean":"2024-03-30T12:36:03.018460+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:36:03.018460+0000","last_undegraded":"2024-03-30T12:36:03.018460+0000","last_fullsized":"2024-03-30T12:36:03.018460+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1335,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016305+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:36:03.016305+0000","last_peered":"2024-03-30T12:36:03.016305+0000","last_clean":"2024-03-30T12:36:03.016305+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:36:03.016305+0000","last_undegraded":"2024-03-30T12:36:03.016305+0000","last_fullsized":"2024-03-30T12:36:03.016305+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018870+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:36:03.018870+0000","last_peered":"2024-03-30T12:36:03.018870+0000","last_clean":"2024-03-30T12:36:03.018870+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:36:03.018870+0000","last_undegraded":"2024-03-30T12:36:03.018870+0000","last_fullsized":"2024-03-30T12:36:03.018870+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220120+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:36:03.220120+0000","last_peered":"2024-03-30T12:36:03.220120+0000","last_clean":"2024-03-30T12:36:03.220120+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:36:03.220120+0000","last_undegraded":"2024-03-30T12:36:03.220120+0000","last_fullsized":"2024-03-30T12:36:03.220120+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015273+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:36:03.015273+0000","last_peered":"2024-03-30T12:36:03.015273+0000","last_clean":"2024-03-30T12:36:03.015273+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:36:03.015273+0000","last_undegraded":"2024-03-30T12:36:03.015273+0000","last_fullsized":"2024-03-30T12:36:03.015273+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1237,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221900+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:36:03.221900+0000","last_peered":"2024-03-30T12:36:03.221900+0000","last_clean":"2024-03-30T12:36:03.221900+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:36:03.221900+0000","last_undegraded":"2024-03-30T12:36:03.221900+0000","last_fullsized":"2024-03-30T12:36:03.221900+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220998+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:36:03.220998+0000","last_peered":"2024-03-30T12:36:03.220998+0000","last_clean":"2024-03-30T12:36:03.220998+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:36:03.220998+0000","last_undegraded":"2024-03-30T12:36:03.220998+0000","last_fullsized":"2024-03-30T12:36:03.220998+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1294,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220129+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:36:03.220129+0000","last_peered":"2024-03-30T12:36:03.220129+0000","last_clean":"2024-03-30T12:36:03.220129+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:36:03.220129+0000","last_undegraded":"2024-03-30T12:36:03.220129+0000","last_fullsized":"2024-03-30T12:36:03.220129+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221004+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:36:03.221004+0000","last_peered":"2024-03-30T12:36:03.221004+0000","last_clean":"2024-03-30T12:36:03.221004+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:36:03.221004+0000","last_undegraded":"2024-03-30T12:36:03.221004+0000","last_fullsized":"2024-03-30T12:36:03.221004+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1176,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221139+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:36:03.221139+0000","last_peered":"2024-03-30T12:36:03.221139+0000","last_clean":"2024-03-30T12:36:03.221139+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:36:03.221139+0000","last_undegraded":"2024-03-30T12:36:03.221139+0000","last_fullsized":"2024-03-30T12:36:03.221139+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1279,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221259+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:36:03.221259+0000","last_peered":"2024-03-30T12:36:03.221259+0000","last_clean":"2024-03-30T12:36:03.221259+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:36:03.221259+0000","last_undegraded":"2024-03-30T12:36:03.221259+0000","last_fullsized":"2024-03-30T12:36:03.221259+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1237,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221506+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:36:03.221506+0000","last_peered":"2024-03-30T12:36:03.221506+0000","last_clean":"2024-03-30T12:36:03.221506+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:36:03.221506+0000","last_undegraded":"2024-03-30T12:36:03.221506+0000","last_fullsized":"2024-03-30T12:36:03.221506+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1287,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220180+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:03.220180+0000","last_peered":"2024-03-30T12:36:03.220180+0000","last_clean":"2024-03-30T12:36:03.220180+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:03.220180+0000","last_undegraded":"2024-03-30T12:36:03.220180+0000","last_fullsized":"2024-03-30T12:36:03.220180+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221549+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:36:03.221549+0000","last_peered":"2024-03-30T12:36:03.221549+0000","last_clean":"2024-03-30T12:36:03.221549+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:36:03.221549+0000","last_undegraded":"2024-03-30T12:36:03.221549+0000","last_fullsized":"2024-03-30T12:36:03.221549+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220884+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:36:03.220884+0000","last_peered":"2024-03-30T12:36:03.220884+0000","last_clean":"2024-03-30T12:36:03.220884+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:36:03.220884+0000","last_undegraded":"2024-03-30T12:36:03.220884+0000","last_fullsized":"2024-03-30T12:36:03.220884+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1181,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220468+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:36:03.220468+0000","last_peered":"2024-03-30T12:36:03.220468+0000","last_clean":"2024-03-30T12:36:03.220468+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:36:03.220468+0000","last_undegraded":"2024-03-30T12:36:03.220468+0000","last_fullsized":"2024-03-30T12:36:03.220468+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438025,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648081,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175091,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254329,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063148,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951205,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839262,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923545,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:36:21.634 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:21.634 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:21.634 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:21.634 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:21.634 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:21.634 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:21.634 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:21.635 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:21.635 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:21.635 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:21.635 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:21.635 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:21.635 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:21.635 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:36:22.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:21 smithi162 ceph-mon[83709]: from='client.44453 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:36:22.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:21 smithi084 ceph-mon[91810]: from='client.44453 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:36:22.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:21 smithi084 ceph-mon[89279]: from='client.44453 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:36:23.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:22 smithi084 ceph-mon[91810]: pgmap v1000: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:23.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:22 smithi084 ceph-mon[89279]: pgmap v1000: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:23.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:22 smithi162 ceph-mon[83709]: pgmap v1000: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:25.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:24 smithi162 ceph-mon[83709]: pgmap v1001: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:25.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:24 smithi084 ceph-mon[91810]: pgmap v1001: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:25.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:24 smithi084 ceph-mon[89279]: pgmap v1001: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:26.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:26 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:36:26.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:26 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:36:26.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:26 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:36:27.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:27 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:36:27.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:27 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:36:27.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:27 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:36:27.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:27 smithi084 ceph-mon[91810]: pgmap v1002: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:27.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:27 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:36:27.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:27 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:36:27.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:27 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:36:27.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:27 smithi084 ceph-mon[89279]: pgmap v1002: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:27.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:27 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:36:27.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:27 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:36:27.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:27 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:36:27.619 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:27 smithi162 ceph-mon[83709]: pgmap v1002: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:29.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:28 smithi162 ceph-mon[83709]: pgmap v1003: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:29.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:28 smithi084 ceph-mon[91810]: pgmap v1003: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:29.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:28 smithi084 ceph-mon[89279]: pgmap v1003: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:29.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:36:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:36:29] "GET /metrics HTTP/1.1" 200 36329 "" "Prometheus/2.43.0" 2024-03-30T12:36:30.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:29 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:36:30.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:29 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:36:30.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:29 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:36:31.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:30 smithi084 ceph-mon[89279]: pgmap v1004: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:31.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:30 smithi084 ceph-mon[91810]: pgmap v1004: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:31.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:30 smithi162 ceph-mon[83709]: pgmap v1004: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:31.636 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:36:31.852 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:36:33.211 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:32 smithi084 ceph-mon[91810]: pgmap v1005: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:33.212 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:32 smithi084 ceph-mon[89279]: pgmap v1005: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:33.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:32 smithi162 ceph-mon[83709]: pgmap v1005: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:33.818 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:36:33.820 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:36:34.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:33 smithi162 ceph-mon[83709]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:36:34.137 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:33 smithi084 ceph-mon[91810]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:36:34.138 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:33 smithi084 ceph-mon[89279]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:36:34.469 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1005,"stamp":"2024-03-30T12:36:32.803816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003831"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018620+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:36:03.018620+0000","last_peered":"2024-03-30T12:36:03.018620+0000","last_clean":"2024-03-30T12:36:03.018620+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:36:03.018620+0000","last_undegraded":"2024-03-30T12:36:03.018620+0000","last_fullsized":"2024-03-30T12:36:03.018620+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1362,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221591+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:36:03.221591+0000","last_peered":"2024-03-30T12:36:03.221591+0000","last_clean":"2024-03-30T12:36:03.221591+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:36:03.221591+0000","last_undegraded":"2024-03-30T12:36:03.221591+0000","last_fullsized":"2024-03-30T12:36:03.221591+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221166+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:36:03.221166+0000","last_peered":"2024-03-30T12:36:03.221166+0000","last_clean":"2024-03-30T12:36:03.221166+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:36:03.221166+0000","last_undegraded":"2024-03-30T12:36:03.221166+0000","last_fullsized":"2024-03-30T12:36:03.221166+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222033+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:36:03.222033+0000","last_peered":"2024-03-30T12:36:03.222033+0000","last_clean":"2024-03-30T12:36:03.222033+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:36:03.222033+0000","last_undegraded":"2024-03-30T12:36:03.222033+0000","last_fullsized":"2024-03-30T12:36:03.222033+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016806+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:36:03.016806+0000","last_peered":"2024-03-30T12:36:03.016806+0000","last_clean":"2024-03-30T12:36:03.016806+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:36:03.016806+0000","last_undegraded":"2024-03-30T12:36:03.016806+0000","last_fullsized":"2024-03-30T12:36:03.016806+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1209,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222566+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:03.222566+0000","last_peered":"2024-03-30T12:36:03.222566+0000","last_clean":"2024-03-30T12:36:03.222566+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:03.222566+0000","last_undegraded":"2024-03-30T12:36:03.222566+0000","last_fullsized":"2024-03-30T12:36:03.222566+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017295+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:36:03.017295+0000","last_peered":"2024-03-30T12:36:03.017295+0000","last_clean":"2024-03-30T12:36:03.017295+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:36:03.017295+0000","last_undegraded":"2024-03-30T12:36:03.017295+0000","last_fullsized":"2024-03-30T12:36:03.017295+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1257,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219724+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:36:03.219724+0000","last_peered":"2024-03-30T12:36:03.219724+0000","last_clean":"2024-03-30T12:36:03.219724+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:36:03.219724+0000","last_undegraded":"2024-03-30T12:36:03.219724+0000","last_fullsized":"2024-03-30T12:36:03.219724+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017862+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:36:03.017862+0000","last_peered":"2024-03-30T12:36:03.017862+0000","last_clean":"2024-03-30T12:36:03.017862+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:36:03.017862+0000","last_undegraded":"2024-03-30T12:36:03.017862+0000","last_fullsized":"2024-03-30T12:36:03.017862+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1167,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220710+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:03.220710+0000","last_peered":"2024-03-30T12:36:03.220710+0000","last_clean":"2024-03-30T12:36:03.220710+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:03.220710+0000","last_undegraded":"2024-03-30T12:36:03.220710+0000","last_fullsized":"2024-03-30T12:36:03.220710+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1167,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220416+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:03.220416+0000","last_peered":"2024-03-30T12:36:03.220416+0000","last_clean":"2024-03-30T12:36:03.220416+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:03.220416+0000","last_undegraded":"2024-03-30T12:36:03.220416+0000","last_fullsized":"2024-03-30T12:36:03.220416+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1269,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020196+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:36:03.020196+0000","last_peered":"2024-03-30T12:36:03.020196+0000","last_clean":"2024-03-30T12:36:03.020196+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:36:03.020196+0000","last_undegraded":"2024-03-30T12:36:03.020196+0000","last_fullsized":"2024-03-30T12:36:03.020196+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1287,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221647+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:36:03.221647+0000","last_peered":"2024-03-30T12:36:03.221647+0000","last_clean":"2024-03-30T12:36:03.221647+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:36:03.221647+0000","last_undegraded":"2024-03-30T12:36:03.221647+0000","last_fullsized":"2024-03-30T12:36:03.221647+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220445+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:36:03.220445+0000","last_peered":"2024-03-30T12:36:03.220445+0000","last_clean":"2024-03-30T12:36:03.220445+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:36:03.220445+0000","last_undegraded":"2024-03-30T12:36:03.220445+0000","last_fullsized":"2024-03-30T12:36:03.220445+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222534+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:36:03.222534+0000","last_peered":"2024-03-30T12:36:03.222534+0000","last_clean":"2024-03-30T12:36:03.222534+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:36:03.222534+0000","last_undegraded":"2024-03-30T12:36:03.222534+0000","last_fullsized":"2024-03-30T12:36:03.222534+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221410+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:36:03.221410+0000","last_peered":"2024-03-30T12:36:03.221410+0000","last_clean":"2024-03-30T12:36:03.221410+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:36:03.221410+0000","last_undegraded":"2024-03-30T12:36:03.221410+0000","last_fullsized":"2024-03-30T12:36:03.221410+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1223,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222946+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:36:03.222946+0000","last_peered":"2024-03-30T12:36:03.222946+0000","last_clean":"2024-03-30T12:36:03.222946+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:36:03.222946+0000","last_undegraded":"2024-03-30T12:36:03.222946+0000","last_fullsized":"2024-03-30T12:36:03.222946+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1330,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015944+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:36:03.015944+0000","last_peered":"2024-03-30T12:36:03.015944+0000","last_clean":"2024-03-30T12:36:03.015944+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:36:03.015944+0000","last_undegraded":"2024-03-30T12:36:03.015944+0000","last_fullsized":"2024-03-30T12:36:03.015944+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017890+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:36:03.017890+0000","last_peered":"2024-03-30T12:36:03.017890+0000","last_clean":"2024-03-30T12:36:03.017890+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:36:03.017890+0000","last_undegraded":"2024-03-30T12:36:03.017890+0000","last_fullsized":"2024-03-30T12:36:03.017890+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1386,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221029+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:36:03.221029+0000","last_peered":"2024-03-30T12:36:03.221029+0000","last_clean":"2024-03-30T12:36:03.221029+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:36:03.221029+0000","last_undegraded":"2024-03-30T12:36:03.221029+0000","last_fullsized":"2024-03-30T12:36:03.221029+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1281,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220779+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:36:03.220779+0000","last_peered":"2024-03-30T12:36:03.220779+0000","last_clean":"2024-03-30T12:36:03.220779+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:36:03.220779+0000","last_undegraded":"2024-03-30T12:36:03.220779+0000","last_fullsized":"2024-03-30T12:36:03.220779+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1300,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220968+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:36:03.220968+0000","last_peered":"2024-03-30T12:36:03.220968+0000","last_clean":"2024-03-30T12:36:03.220968+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:36:03.220968+0000","last_undegraded":"2024-03-30T12:36:03.220968+0000","last_fullsized":"2024-03-30T12:36:03.220968+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220308+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:36:03.220308+0000","last_peered":"2024-03-30T12:36:03.220308+0000","last_clean":"2024-03-30T12:36:03.220308+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:36:03.220308+0000","last_undegraded":"2024-03-30T12:36:03.220308+0000","last_fullsized":"2024-03-30T12:36:03.220308+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017887+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:36:03.017887+0000","last_peered":"2024-03-30T12:36:03.017887+0000","last_clean":"2024-03-30T12:36:03.017887+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:36:03.017887+0000","last_undegraded":"2024-03-30T12:36:03.017887+0000","last_fullsized":"2024-03-30T12:36:03.017887+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1228,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222708+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:03.222708+0000","last_peered":"2024-03-30T12:36:03.222708+0000","last_clean":"2024-03-30T12:36:03.222708+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:03.222708+0000","last_undegraded":"2024-03-30T12:36:03.222708+0000","last_fullsized":"2024-03-30T12:36:03.222708+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017639+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:36:03.017639+0000","last_peered":"2024-03-30T12:36:03.017639+0000","last_clean":"2024-03-30T12:36:03.017639+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:36:03.017639+0000","last_undegraded":"2024-03-30T12:36:03.017639+0000","last_fullsized":"2024-03-30T12:36:03.017639+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222301+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:03.222301+0000","last_peered":"2024-03-30T12:36:03.222301+0000","last_clean":"2024-03-30T12:36:03.222301+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:03.222301+0000","last_undegraded":"2024-03-30T12:36:03.222301+0000","last_fullsized":"2024-03-30T12:36:03.222301+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221804+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:36:03.221804+0000","last_peered":"2024-03-30T12:36:03.221804+0000","last_clean":"2024-03-30T12:36:03.221804+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:36:03.221804+0000","last_undegraded":"2024-03-30T12:36:03.221804+0000","last_fullsized":"2024-03-30T12:36:03.221804+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018855+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:36:03.018855+0000","last_peered":"2024-03-30T12:36:03.018855+0000","last_clean":"2024-03-30T12:36:03.018855+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:36:03.018855+0000","last_undegraded":"2024-03-30T12:36:03.018855+0000","last_fullsized":"2024-03-30T12:36:03.018855+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1178,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220485+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:36:03.220485+0000","last_peered":"2024-03-30T12:36:03.220485+0000","last_clean":"2024-03-30T12:36:03.220485+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:36:03.220485+0000","last_undegraded":"2024-03-30T12:36:03.220485+0000","last_fullsized":"2024-03-30T12:36:03.220485+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221577+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:36:03.221577+0000","last_peered":"2024-03-30T12:36:03.221577+0000","last_clean":"2024-03-30T12:36:03.221577+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:36:03.221577+0000","last_undegraded":"2024-03-30T12:36:03.221577+0000","last_fullsized":"2024-03-30T12:36:03.221577+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219793+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:36:03.219793+0000","last_peered":"2024-03-30T12:36:03.219793+0000","last_clean":"2024-03-30T12:36:03.219793+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:36:03.219793+0000","last_undegraded":"2024-03-30T12:36:03.219793+0000","last_fullsized":"2024-03-30T12:36:03.219793+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1293,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219776+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:36:03.219776+0000","last_peered":"2024-03-30T12:36:03.219776+0000","last_clean":"2024-03-30T12:36:03.219776+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:36:03.219776+0000","last_undegraded":"2024-03-30T12:36:03.219776+0000","last_fullsized":"2024-03-30T12:36:03.219776+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1223,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221769+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:36:03.221769+0000","last_peered":"2024-03-30T12:36:03.221769+0000","last_clean":"2024-03-30T12:36:03.221769+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:36:03.221769+0000","last_undegraded":"2024-03-30T12:36:03.221769+0000","last_fullsized":"2024-03-30T12:36:03.221769+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222968+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:36:03.222968+0000","last_peered":"2024-03-30T12:36:03.222968+0000","last_clean":"2024-03-30T12:36:03.222968+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:36:03.222968+0000","last_undegraded":"2024-03-30T12:36:03.222968+0000","last_fullsized":"2024-03-30T12:36:03.222968+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220706+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:03.220706+0000","last_peered":"2024-03-30T12:36:03.220706+0000","last_clean":"2024-03-30T12:36:03.220706+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:03.220706+0000","last_undegraded":"2024-03-30T12:36:03.220706+0000","last_fullsized":"2024-03-30T12:36:03.220706+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1203,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222317+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:36:03.222317+0000","last_peered":"2024-03-30T12:36:03.222317+0000","last_clean":"2024-03-30T12:36:03.222317+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:36:03.222317+0000","last_undegraded":"2024-03-30T12:36:03.222317+0000","last_fullsized":"2024-03-30T12:36:03.222317+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1197,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222067+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:36:03.222067+0000","last_peered":"2024-03-30T12:36:03.222067+0000","last_clean":"2024-03-30T12:36:03.222067+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:36:03.222067+0000","last_undegraded":"2024-03-30T12:36:03.222067+0000","last_fullsized":"2024-03-30T12:36:03.222067+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015689+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:36:03.015689+0000","last_peered":"2024-03-30T12:36:03.015689+0000","last_clean":"2024-03-30T12:36:03.015689+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:36:03.015689+0000","last_undegraded":"2024-03-30T12:36:03.015689+0000","last_fullsized":"2024-03-30T12:36:03.015689+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221275+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:36:03.221275+0000","last_peered":"2024-03-30T12:36:03.221275+0000","last_clean":"2024-03-30T12:36:03.221275+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:36:03.221275+0000","last_undegraded":"2024-03-30T12:36:03.221275+0000","last_fullsized":"2024-03-30T12:36:03.221275+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020038+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:36:03.020038+0000","last_peered":"2024-03-30T12:36:03.020038+0000","last_clean":"2024-03-30T12:36:03.020038+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:36:03.020038+0000","last_undegraded":"2024-03-30T12:36:03.020038+0000","last_fullsized":"2024-03-30T12:36:03.020038+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1203,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220666+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:36:03.220666+0000","last_peered":"2024-03-30T12:36:03.220666+0000","last_clean":"2024-03-30T12:36:03.220666+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:36:03.220666+0000","last_undegraded":"2024-03-30T12:36:03.220666+0000","last_fullsized":"2024-03-30T12:36:03.220666+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017379+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:36:03.017379+0000","last_peered":"2024-03-30T12:36:03.017379+0000","last_clean":"2024-03-30T12:36:03.017379+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:36:03.017379+0000","last_undegraded":"2024-03-30T12:36:03.017379+0000","last_fullsized":"2024-03-30T12:36:03.017379+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221717+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:36:03.221717+0000","last_peered":"2024-03-30T12:36:03.221717+0000","last_clean":"2024-03-30T12:36:03.221717+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:36:03.221717+0000","last_undegraded":"2024-03-30T12:36:03.221717+0000","last_fullsized":"2024-03-30T12:36:03.221717+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220742+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:36:03.220742+0000","last_peered":"2024-03-30T12:36:03.220742+0000","last_clean":"2024-03-30T12:36:03.220742+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:36:03.220742+0000","last_undegraded":"2024-03-30T12:36:03.220742+0000","last_fullsized":"2024-03-30T12:36:03.220742+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221904+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:36:03.221904+0000","last_peered":"2024-03-30T12:36:03.221904+0000","last_clean":"2024-03-30T12:36:03.221904+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:36:03.221904+0000","last_undegraded":"2024-03-30T12:36:03.221904+0000","last_fullsized":"2024-03-30T12:36:03.221904+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017448+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:36:03.017448+0000","last_peered":"2024-03-30T12:36:03.017448+0000","last_clean":"2024-03-30T12:36:03.017448+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:36:03.017448+0000","last_undegraded":"2024-03-30T12:36:03.017448+0000","last_fullsized":"2024-03-30T12:36:03.017448+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220190+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:36:03.220190+0000","last_peered":"2024-03-30T12:36:03.220190+0000","last_clean":"2024-03-30T12:36:03.220190+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:36:03.220190+0000","last_undegraded":"2024-03-30T12:36:03.220190+0000","last_fullsized":"2024-03-30T12:36:03.220190+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1167,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220128+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:36:03.220128+0000","last_peered":"2024-03-30T12:36:03.220128+0000","last_clean":"2024-03-30T12:36:03.220128+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:36:03.220128+0000","last_undegraded":"2024-03-30T12:36:03.220128+0000","last_fullsized":"2024-03-30T12:36:03.220128+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1342,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015578+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:36:03.015578+0000","last_peered":"2024-03-30T12:36:03.015578+0000","last_clean":"2024-03-30T12:36:03.015578+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:36:03.015578+0000","last_undegraded":"2024-03-30T12:36:03.015578+0000","last_fullsized":"2024-03-30T12:36:03.015578+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016564+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:36:03.016564+0000","last_peered":"2024-03-30T12:36:03.016564+0000","last_clean":"2024-03-30T12:36:03.016564+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:36:03.016564+0000","last_undegraded":"2024-03-30T12:36:03.016564+0000","last_fullsized":"2024-03-30T12:36:03.016564+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5751,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.016013+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:36:03.016013+0000","last_peered":"2024-03-30T12:36:03.016013+0000","last_clean":"2024-03-30T12:36:03.016013+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:36:03.016013+0000","last_undegraded":"2024-03-30T12:36:03.016013+0000","last_fullsized":"2024-03-30T12:36:03.016013+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020346+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:36:03.020346+0000","last_peered":"2024-03-30T12:36:03.020346+0000","last_clean":"2024-03-30T12:36:03.020346+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:36:03.020346+0000","last_undegraded":"2024-03-30T12:36:03.020346+0000","last_fullsized":"2024-03-30T12:36:03.020346+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018002+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:36:03.018002+0000","last_peered":"2024-03-30T12:36:03.018002+0000","last_clean":"2024-03-30T12:36:03.018002+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:36:03.018002+0000","last_undegraded":"2024-03-30T12:36:03.018002+0000","last_fullsized":"2024-03-30T12:36:03.018002+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5511,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.221420+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:36:03.221420+0000","last_peered":"2024-03-30T12:36:03.221420+0000","last_clean":"2024-03-30T12:36:03.221420+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:36:03.221420+0000","last_undegraded":"2024-03-30T12:36:03.221420+0000","last_fullsized":"2024-03-30T12:36:03.221420+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220564+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:36:03.220564+0000","last_peered":"2024-03-30T12:36:03.220564+0000","last_clean":"2024-03-30T12:36:03.220564+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:36:03.220564+0000","last_undegraded":"2024-03-30T12:36:03.220564+0000","last_fullsized":"2024-03-30T12:36:03.220564+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222416+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:36:03.222416+0000","last_peered":"2024-03-30T12:36:03.222416+0000","last_clean":"2024-03-30T12:36:03.222416+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:36:03.222416+0000","last_undegraded":"2024-03-30T12:36:03.222416+0000","last_fullsized":"2024-03-30T12:36:03.222416+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1237,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222091+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:36:03.222091+0000","last_peered":"2024-03-30T12:36:03.222091+0000","last_clean":"2024-03-30T12:36:03.222091+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:36:03.222091+0000","last_undegraded":"2024-03-30T12:36:03.222091+0000","last_fullsized":"2024-03-30T12:36:03.222091+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5456,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.221793+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:36:03.221793+0000","last_peered":"2024-03-30T12:36:03.221793+0000","last_clean":"2024-03-30T12:36:03.221793+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:36:03.221793+0000","last_undegraded":"2024-03-30T12:36:03.221793+0000","last_fullsized":"2024-03-30T12:36:03.221793+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222540+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:36:03.222540+0000","last_peered":"2024-03-30T12:36:03.222540+0000","last_clean":"2024-03-30T12:36:03.222540+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:36:03.222540+0000","last_undegraded":"2024-03-30T12:36:03.222540+0000","last_fullsized":"2024-03-30T12:36:03.222540+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221637+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:36:03.221637+0000","last_peered":"2024-03-30T12:36:03.221637+0000","last_clean":"2024-03-30T12:36:03.221637+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:36:03.221637+0000","last_undegraded":"2024-03-30T12:36:03.221637+0000","last_fullsized":"2024-03-30T12:36:03.221637+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1270,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019257+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:36:03.019257+0000","last_peered":"2024-03-30T12:36:03.019257+0000","last_clean":"2024-03-30T12:36:03.019257+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:36:03.019257+0000","last_undegraded":"2024-03-30T12:36:03.019257+0000","last_fullsized":"2024-03-30T12:36:03.019257+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3802,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016632+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:36:03.016632+0000","last_peered":"2024-03-30T12:36:03.016632+0000","last_clean":"2024-03-30T12:36:03.016632+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:36:03.016632+0000","last_undegraded":"2024-03-30T12:36:03.016632+0000","last_fullsized":"2024-03-30T12:36:03.016632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1341,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222936+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:36:03.222936+0000","last_peered":"2024-03-30T12:36:03.222936+0000","last_clean":"2024-03-30T12:36:03.222936+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:36:03.222936+0000","last_undegraded":"2024-03-30T12:36:03.222936+0000","last_fullsized":"2024-03-30T12:36:03.222936+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221995+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:36:03.221995+0000","last_peered":"2024-03-30T12:36:03.221995+0000","last_clean":"2024-03-30T12:36:03.221995+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:36:03.221995+0000","last_undegraded":"2024-03-30T12:36:03.221995+0000","last_fullsized":"2024-03-30T12:36:03.221995+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1330,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015172+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:36:03.015172+0000","last_peered":"2024-03-30T12:36:03.015172+0000","last_clean":"2024-03-30T12:36:03.015172+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:36:03.015172+0000","last_undegraded":"2024-03-30T12:36:03.015172+0000","last_fullsized":"2024-03-30T12:36:03.015172+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4574,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.018860+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:36:03.018860+0000","last_peered":"2024-03-30T12:36:03.018860+0000","last_clean":"2024-03-30T12:36:03.018860+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:36:03.018860+0000","last_undegraded":"2024-03-30T12:36:03.018860+0000","last_fullsized":"2024-03-30T12:36:03.018860+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1173,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220732+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:36:03.220732+0000","last_peered":"2024-03-30T12:36:03.220732+0000","last_clean":"2024-03-30T12:36:03.220732+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:36:03.220732+0000","last_undegraded":"2024-03-30T12:36:03.220732+0000","last_fullsized":"2024-03-30T12:36:03.220732+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221414+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:36:03.221414+0000","last_peered":"2024-03-30T12:36:03.221414+0000","last_clean":"2024-03-30T12:36:03.221414+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:36:03.221414+0000","last_undegraded":"2024-03-30T12:36:03.221414+0000","last_fullsized":"2024-03-30T12:36:03.221414+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1198,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221904+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:36:03.221904+0000","last_peered":"2024-03-30T12:36:03.221904+0000","last_clean":"2024-03-30T12:36:03.221904+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:36:03.221904+0000","last_undegraded":"2024-03-30T12:36:03.221904+0000","last_fullsized":"2024-03-30T12:36:03.221904+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1715,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016476+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:36:03.016476+0000","last_peered":"2024-03-30T12:36:03.016476+0000","last_clean":"2024-03-30T12:36:03.016476+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:36:03.016476+0000","last_undegraded":"2024-03-30T12:36:03.016476+0000","last_fullsized":"2024-03-30T12:36:03.016476+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24712,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223515+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:36:03.223515+0000","last_peered":"2024-03-30T12:36:03.223515+0000","last_clean":"2024-03-30T12:36:03.223515+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:36:03.223515+0000","last_undegraded":"2024-03-30T12:36:03.223515+0000","last_fullsized":"2024-03-30T12:36:03.223515+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220576+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:36:03.220576+0000","last_peered":"2024-03-30T12:36:03.220576+0000","last_clean":"2024-03-30T12:36:03.220576+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:36:03.220576+0000","last_undegraded":"2024-03-30T12:36:03.220576+0000","last_fullsized":"2024-03-30T12:36:03.220576+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220655+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:36:03.220655+0000","last_peered":"2024-03-30T12:36:03.220655+0000","last_clean":"2024-03-30T12:36:03.220655+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:36:03.220655+0000","last_undegraded":"2024-03-30T12:36:03.220655+0000","last_fullsized":"2024-03-30T12:36:03.220655+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1143,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016477+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:36:03.016477+0000","last_peered":"2024-03-30T12:36:03.016477+0000","last_clean":"2024-03-30T12:36:03.016477+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:36:03.016477+0000","last_undegraded":"2024-03-30T12:36:03.016477+0000","last_fullsized":"2024-03-30T12:36:03.016477+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16479,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.221375+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:36:03.221375+0000","last_peered":"2024-03-30T12:36:03.221375+0000","last_clean":"2024-03-30T12:36:03.221375+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:36:03.221375+0000","last_undegraded":"2024-03-30T12:36:03.221375+0000","last_fullsized":"2024-03-30T12:36:03.221375+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221403+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:36:03.221403+0000","last_peered":"2024-03-30T12:36:03.221403+0000","last_clean":"2024-03-30T12:36:03.221403+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:36:03.221403+0000","last_undegraded":"2024-03-30T12:36:03.221403+0000","last_fullsized":"2024-03-30T12:36:03.221403+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017689+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:36:03.017689+0000","last_peered":"2024-03-30T12:36:03.017689+0000","last_clean":"2024-03-30T12:36:03.017689+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:36:03.017689+0000","last_undegraded":"2024-03-30T12:36:03.017689+0000","last_fullsized":"2024-03-30T12:36:03.017689+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222632+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:36:03.222632+0000","last_peered":"2024-03-30T12:36:03.222632+0000","last_clean":"2024-03-30T12:36:03.222632+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:36:03.222632+0000","last_undegraded":"2024-03-30T12:36:03.222632+0000","last_fullsized":"2024-03-30T12:36:03.222632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31267,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.020769+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:36:03.020769+0000","last_peered":"2024-03-30T12:36:03.020769+0000","last_clean":"2024-03-30T12:36:03.020769+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:36:03.020769+0000","last_undegraded":"2024-03-30T12:36:03.020769+0000","last_fullsized":"2024-03-30T12:36:03.020769+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1293,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219877+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:36:03.219877+0000","last_peered":"2024-03-30T12:36:03.219877+0000","last_clean":"2024-03-30T12:36:03.219877+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:36:03.219877+0000","last_undegraded":"2024-03-30T12:36:03.219877+0000","last_fullsized":"2024-03-30T12:36:03.219877+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221685+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:36:03.221685+0000","last_peered":"2024-03-30T12:36:03.221685+0000","last_clean":"2024-03-30T12:36:03.221685+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:36:03.221685+0000","last_undegraded":"2024-03-30T12:36:03.221685+0000","last_fullsized":"2024-03-30T12:36:03.221685+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221082+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:36:03.221082+0000","last_peered":"2024-03-30T12:36:03.221082+0000","last_clean":"2024-03-30T12:36:03.221082+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:36:03.221082+0000","last_undegraded":"2024-03-30T12:36:03.221082+0000","last_fullsized":"2024-03-30T12:36:03.221082+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3763,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219946+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:36:03.219946+0000","last_peered":"2024-03-30T12:36:03.219946+0000","last_clean":"2024-03-30T12:36:03.219946+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:36:03.219946+0000","last_undegraded":"2024-03-30T12:36:03.219946+0000","last_fullsized":"2024-03-30T12:36:03.219946+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019106+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:36:03.019106+0000","last_peered":"2024-03-30T12:36:03.019106+0000","last_clean":"2024-03-30T12:36:03.019106+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:36:03.019106+0000","last_undegraded":"2024-03-30T12:36:03.019106+0000","last_fullsized":"2024-03-30T12:36:03.019106+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220680+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:36:03.220680+0000","last_peered":"2024-03-30T12:36:03.220680+0000","last_clean":"2024-03-30T12:36:03.220680+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:36:03.220680+0000","last_undegraded":"2024-03-30T12:36:03.220680+0000","last_fullsized":"2024-03-30T12:36:03.220680+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220307+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:36:03.220307+0000","last_peered":"2024-03-30T12:36:03.220307+0000","last_clean":"2024-03-30T12:36:03.220307+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:36:03.220307+0000","last_undegraded":"2024-03-30T12:36:03.220307+0000","last_fullsized":"2024-03-30T12:36:03.220307+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15592,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223226+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:36:03.223226+0000","last_peered":"2024-03-30T12:36:03.223226+0000","last_clean":"2024-03-30T12:36:03.223226+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:36:03.223226+0000","last_undegraded":"2024-03-30T12:36:03.223226+0000","last_fullsized":"2024-03-30T12:36:03.223226+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1141,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016730+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:36:03.016730+0000","last_peered":"2024-03-30T12:36:03.016730+0000","last_clean":"2024-03-30T12:36:03.016730+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:36:03.016730+0000","last_undegraded":"2024-03-30T12:36:03.016730+0000","last_fullsized":"2024-03-30T12:36:03.016730+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1256,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018912+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:36:03.018912+0000","last_peered":"2024-03-30T12:36:03.018912+0000","last_clean":"2024-03-30T12:36:03.018912+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:36:03.018912+0000","last_undegraded":"2024-03-30T12:36:03.018912+0000","last_fullsized":"2024-03-30T12:36:03.018912+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29018,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.020535+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:36:03.020535+0000","last_peered":"2024-03-30T12:36:03.020535+0000","last_clean":"2024-03-30T12:36:03.020535+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:36:03.020535+0000","last_undegraded":"2024-03-30T12:36:03.020535+0000","last_fullsized":"2024-03-30T12:36:03.020535+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222640+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:36:03.222640+0000","last_peered":"2024-03-30T12:36:03.222640+0000","last_clean":"2024-03-30T12:36:03.222640+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:36:03.222640+0000","last_undegraded":"2024-03-30T12:36:03.222640+0000","last_fullsized":"2024-03-30T12:36:03.222640+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1287,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220000+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:36:03.220000+0000","last_peered":"2024-03-30T12:36:03.220000+0000","last_clean":"2024-03-30T12:36:03.220000+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:36:03.220000+0000","last_undegraded":"2024-03-30T12:36:03.220000+0000","last_fullsized":"2024-03-30T12:36:03.220000+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5609,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.017229+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:36:03.017229+0000","last_peered":"2024-03-30T12:36:03.017229+0000","last_clean":"2024-03-30T12:36:03.017229+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:36:03.017229+0000","last_undegraded":"2024-03-30T12:36:03.017229+0000","last_fullsized":"2024-03-30T12:36:03.017229+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1363,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220405+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:36:03.220405+0000","last_peered":"2024-03-30T12:36:03.220405+0000","last_clean":"2024-03-30T12:36:03.220405+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:36:03.220405+0000","last_undegraded":"2024-03-30T12:36:03.220405+0000","last_fullsized":"2024-03-30T12:36:03.220405+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221542+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:03.221542+0000","last_peered":"2024-03-30T12:36:03.221542+0000","last_clean":"2024-03-30T12:36:03.221542+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:03.221542+0000","last_undegraded":"2024-03-30T12:36:03.221542+0000","last_fullsized":"2024-03-30T12:36:03.221542+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222830+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:36:03.222830+0000","last_peered":"2024-03-30T12:36:03.222830+0000","last_clean":"2024-03-30T12:36:03.222830+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:36:03.222830+0000","last_undegraded":"2024-03-30T12:36:03.222830+0000","last_fullsized":"2024-03-30T12:36:03.222830+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017152+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:36:03.017152+0000","last_peered":"2024-03-30T12:36:03.017152+0000","last_clean":"2024-03-30T12:36:03.017152+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:36:03.017152+0000","last_undegraded":"2024-03-30T12:36:03.017152+0000","last_fullsized":"2024-03-30T12:36:03.017152+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221062+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:36:03.221062+0000","last_peered":"2024-03-30T12:36:03.221062+0000","last_clean":"2024-03-30T12:36:03.221062+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:36:03.221062+0000","last_undegraded":"2024-03-30T12:36:03.221062+0000","last_fullsized":"2024-03-30T12:36:03.221062+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5252,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.017068+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:36:03.017068+0000","last_peered":"2024-03-30T12:36:03.017068+0000","last_clean":"2024-03-30T12:36:03.017068+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:36:03.017068+0000","last_undegraded":"2024-03-30T12:36:03.017068+0000","last_fullsized":"2024-03-30T12:36:03.017068+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1330,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016069+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:36:03.016069+0000","last_peered":"2024-03-30T12:36:03.016069+0000","last_clean":"2024-03-30T12:36:03.016069+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:36:03.016069+0000","last_undegraded":"2024-03-30T12:36:03.016069+0000","last_fullsized":"2024-03-30T12:36:03.016069+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017739+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:36:03.017739+0000","last_peered":"2024-03-30T12:36:03.017739+0000","last_clean":"2024-03-30T12:36:03.017739+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:36:03.017739+0000","last_undegraded":"2024-03-30T12:36:03.017739+0000","last_fullsized":"2024-03-30T12:36:03.017739+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4809,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.016990+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:36:03.016990+0000","last_peered":"2024-03-30T12:36:03.016990+0000","last_clean":"2024-03-30T12:36:03.016990+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:36:03.016990+0000","last_undegraded":"2024-03-30T12:36:03.016990+0000","last_fullsized":"2024-03-30T12:36:03.016990+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220902+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:36:03.220902+0000","last_peered":"2024-03-30T12:36:03.220902+0000","last_clean":"2024-03-30T12:36:03.220902+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:36:03.220902+0000","last_undegraded":"2024-03-30T12:36:03.220902+0000","last_fullsized":"2024-03-30T12:36:03.220902+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222557+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:36:03.222557+0000","last_peered":"2024-03-30T12:36:03.222557+0000","last_clean":"2024-03-30T12:36:03.222557+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:36:03.222557+0000","last_undegraded":"2024-03-30T12:36:03.222557+0000","last_fullsized":"2024-03-30T12:36:03.222557+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6741,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.018460+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:36:03.018460+0000","last_peered":"2024-03-30T12:36:03.018460+0000","last_clean":"2024-03-30T12:36:03.018460+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:36:03.018460+0000","last_undegraded":"2024-03-30T12:36:03.018460+0000","last_fullsized":"2024-03-30T12:36:03.018460+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1336,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016373+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:36:03.016373+0000","last_peered":"2024-03-30T12:36:03.016373+0000","last_clean":"2024-03-30T12:36:03.016373+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:36:03.016373+0000","last_undegraded":"2024-03-30T12:36:03.016373+0000","last_fullsized":"2024-03-30T12:36:03.016373+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018870+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:36:03.018870+0000","last_peered":"2024-03-30T12:36:03.018870+0000","last_clean":"2024-03-30T12:36:03.018870+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:36:03.018870+0000","last_undegraded":"2024-03-30T12:36:03.018870+0000","last_fullsized":"2024-03-30T12:36:03.018870+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220120+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:36:03.220120+0000","last_peered":"2024-03-30T12:36:03.220120+0000","last_clean":"2024-03-30T12:36:03.220120+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:36:03.220120+0000","last_undegraded":"2024-03-30T12:36:03.220120+0000","last_fullsized":"2024-03-30T12:36:03.220120+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015273+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:36:03.015273+0000","last_peered":"2024-03-30T12:36:03.015273+0000","last_clean":"2024-03-30T12:36:03.015273+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:36:03.015273+0000","last_undegraded":"2024-03-30T12:36:03.015273+0000","last_fullsized":"2024-03-30T12:36:03.015273+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1237,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221900+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:36:03.221900+0000","last_peered":"2024-03-30T12:36:03.221900+0000","last_clean":"2024-03-30T12:36:03.221900+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:36:03.221900+0000","last_undegraded":"2024-03-30T12:36:03.221900+0000","last_fullsized":"2024-03-30T12:36:03.221900+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220998+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:36:03.220998+0000","last_peered":"2024-03-30T12:36:03.220998+0000","last_clean":"2024-03-30T12:36:03.220998+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:36:03.220998+0000","last_undegraded":"2024-03-30T12:36:03.220998+0000","last_fullsized":"2024-03-30T12:36:03.220998+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1294,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220129+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:36:03.220129+0000","last_peered":"2024-03-30T12:36:03.220129+0000","last_clean":"2024-03-30T12:36:03.220129+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:36:03.220129+0000","last_undegraded":"2024-03-30T12:36:03.220129+0000","last_fullsized":"2024-03-30T12:36:03.220129+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221004+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:36:03.221004+0000","last_peered":"2024-03-30T12:36:03.221004+0000","last_clean":"2024-03-30T12:36:03.221004+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:36:03.221004+0000","last_undegraded":"2024-03-30T12:36:03.221004+0000","last_fullsized":"2024-03-30T12:36:03.221004+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1176,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221139+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:36:03.221139+0000","last_peered":"2024-03-30T12:36:03.221139+0000","last_clean":"2024-03-30T12:36:03.221139+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:36:03.221139+0000","last_undegraded":"2024-03-30T12:36:03.221139+0000","last_fullsized":"2024-03-30T12:36:03.221139+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1279,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221259+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:36:03.221259+0000","last_peered":"2024-03-30T12:36:03.221259+0000","last_clean":"2024-03-30T12:36:03.221259+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:36:03.221259+0000","last_undegraded":"2024-03-30T12:36:03.221259+0000","last_fullsized":"2024-03-30T12:36:03.221259+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1237,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221506+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:36:03.221506+0000","last_peered":"2024-03-30T12:36:03.221506+0000","last_clean":"2024-03-30T12:36:03.221506+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:36:03.221506+0000","last_undegraded":"2024-03-30T12:36:03.221506+0000","last_fullsized":"2024-03-30T12:36:03.221506+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1287,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220180+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:03.220180+0000","last_peered":"2024-03-30T12:36:03.220180+0000","last_clean":"2024-03-30T12:36:03.220180+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:03.220180+0000","last_undegraded":"2024-03-30T12:36:03.220180+0000","last_fullsized":"2024-03-30T12:36:03.220180+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221549+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:36:03.221549+0000","last_peered":"2024-03-30T12:36:03.221549+0000","last_clean":"2024-03-30T12:36:03.221549+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:36:03.221549+0000","last_undegraded":"2024-03-30T12:36:03.221549+0000","last_fullsized":"2024-03-30T12:36:03.221549+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220884+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:36:03.220884+0000","last_peered":"2024-03-30T12:36:03.220884+0000","last_clean":"2024-03-30T12:36:03.220884+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:36:03.220884+0000","last_undegraded":"2024-03-30T12:36:03.220884+0000","last_fullsized":"2024-03-30T12:36:03.220884+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220599+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:36:03.220599+0000","last_peered":"2024-03-30T12:36:03.220599+0000","last_clean":"2024-03-30T12:36:03.220599+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:36:03.220599+0000","last_undegraded":"2024-03-30T12:36:03.220599+0000","last_fullsized":"2024-03-30T12:36:03.220599+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438027,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648083,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175093,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254332,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063150,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951208,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839265,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923547,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:36:34.475 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:34.475 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:34.475 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:34.475 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:34.475 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:34.475 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:34.475 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:34.475 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:34.475 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:34.475 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:34.475 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:34.475 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:34.476 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:34.476 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:36:35.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:34 smithi084 ceph-mon[89279]: pgmap v1006: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:35.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:34 smithi084 ceph-mon[91810]: pgmap v1006: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:35.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:34 smithi162 ceph-mon[83709]: pgmap v1006: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:37.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:36 smithi084 ceph-mon[89279]: pgmap v1007: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:37.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:36 smithi084 ceph-mon[91810]: pgmap v1007: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:37.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:36 smithi162 ceph-mon[83709]: pgmap v1007: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:39.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:38 smithi084 ceph-mon[89279]: pgmap v1008: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:39.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:38 smithi084 ceph-mon[91810]: pgmap v1008: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:39.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:38 smithi162 ceph-mon[83709]: pgmap v1008: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:39.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:36:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:36:39] "GET /metrics HTTP/1.1" 200 36322 "" "Prometheus/2.43.0" 2024-03-30T12:36:41.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:40 smithi084 ceph-mon[91810]: pgmap v1009: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:41.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:40 smithi084 ceph-mon[89279]: pgmap v1009: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:41.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:40 smithi162 ceph-mon[83709]: pgmap v1009: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:43.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:42 smithi084 ceph-mon[91810]: pgmap v1010: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:43.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:42 smithi084 ceph-mon[89279]: pgmap v1010: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:43.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:42 smithi162 ceph-mon[83709]: pgmap v1010: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:44.477 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:36:44.695 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:36:45.047 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:44 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:36:45.047 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:36:45.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:44 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:36:46.030 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:45 smithi084 ceph-mon[91810]: pgmap v1011: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:46.030 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:45 smithi084 ceph-mon[89279]: pgmap v1011: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:46.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:45 smithi162 ceph-mon[83709]: pgmap v1011: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:46.627 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:36:46.629 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:36:46.966 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:46 smithi084 ceph-mon[89279]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:36:46.966 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:46 smithi084 ceph-mon[89279]: pgmap v1012: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:46.966 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:46 smithi084 ceph-mon[91810]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:36:46.966 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:46 smithi084 ceph-mon[91810]: pgmap v1012: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:47.363 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1011,"stamp":"2024-03-30T12:36:44.808022+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004206"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018672+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:36:03.018672+0000","last_peered":"2024-03-30T12:36:03.018672+0000","last_clean":"2024-03-30T12:36:03.018672+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:36:03.018672+0000","last_undegraded":"2024-03-30T12:36:03.018672+0000","last_fullsized":"2024-03-30T12:36:03.018672+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1362,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221591+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:36:03.221591+0000","last_peered":"2024-03-30T12:36:03.221591+0000","last_clean":"2024-03-30T12:36:03.221591+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:36:03.221591+0000","last_undegraded":"2024-03-30T12:36:03.221591+0000","last_fullsized":"2024-03-30T12:36:03.221591+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221207+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:36:03.221207+0000","last_peered":"2024-03-30T12:36:03.221207+0000","last_clean":"2024-03-30T12:36:03.221207+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:36:03.221207+0000","last_undegraded":"2024-03-30T12:36:03.221207+0000","last_fullsized":"2024-03-30T12:36:03.221207+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222033+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:36:03.222033+0000","last_peered":"2024-03-30T12:36:03.222033+0000","last_clean":"2024-03-30T12:36:03.222033+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:36:03.222033+0000","last_undegraded":"2024-03-30T12:36:03.222033+0000","last_fullsized":"2024-03-30T12:36:03.222033+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016806+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:36:03.016806+0000","last_peered":"2024-03-30T12:36:03.016806+0000","last_clean":"2024-03-30T12:36:03.016806+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:36:03.016806+0000","last_undegraded":"2024-03-30T12:36:03.016806+0000","last_fullsized":"2024-03-30T12:36:03.016806+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1209,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222566+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:03.222566+0000","last_peered":"2024-03-30T12:36:03.222566+0000","last_clean":"2024-03-30T12:36:03.222566+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:03.222566+0000","last_undegraded":"2024-03-30T12:36:03.222566+0000","last_fullsized":"2024-03-30T12:36:03.222566+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017295+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:36:03.017295+0000","last_peered":"2024-03-30T12:36:03.017295+0000","last_clean":"2024-03-30T12:36:03.017295+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:36:03.017295+0000","last_undegraded":"2024-03-30T12:36:03.017295+0000","last_fullsized":"2024-03-30T12:36:03.017295+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1257,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219724+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:36:03.219724+0000","last_peered":"2024-03-30T12:36:03.219724+0000","last_clean":"2024-03-30T12:36:03.219724+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:36:03.219724+0000","last_undegraded":"2024-03-30T12:36:03.219724+0000","last_fullsized":"2024-03-30T12:36:03.219724+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017862+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:36:03.017862+0000","last_peered":"2024-03-30T12:36:03.017862+0000","last_clean":"2024-03-30T12:36:03.017862+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:36:03.017862+0000","last_undegraded":"2024-03-30T12:36:03.017862+0000","last_fullsized":"2024-03-30T12:36:03.017862+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1167,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220710+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:03.220710+0000","last_peered":"2024-03-30T12:36:03.220710+0000","last_clean":"2024-03-30T12:36:03.220710+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:03.220710+0000","last_undegraded":"2024-03-30T12:36:03.220710+0000","last_fullsized":"2024-03-30T12:36:03.220710+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1167,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220416+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:03.220416+0000","last_peered":"2024-03-30T12:36:03.220416+0000","last_clean":"2024-03-30T12:36:03.220416+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:03.220416+0000","last_undegraded":"2024-03-30T12:36:03.220416+0000","last_fullsized":"2024-03-30T12:36:03.220416+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1269,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020196+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:36:03.020196+0000","last_peered":"2024-03-30T12:36:03.020196+0000","last_clean":"2024-03-30T12:36:03.020196+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:36:03.020196+0000","last_undegraded":"2024-03-30T12:36:03.020196+0000","last_fullsized":"2024-03-30T12:36:03.020196+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1287,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221647+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:36:03.221647+0000","last_peered":"2024-03-30T12:36:03.221647+0000","last_clean":"2024-03-30T12:36:03.221647+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:36:03.221647+0000","last_undegraded":"2024-03-30T12:36:03.221647+0000","last_fullsized":"2024-03-30T12:36:03.221647+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220445+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:36:03.220445+0000","last_peered":"2024-03-30T12:36:03.220445+0000","last_clean":"2024-03-30T12:36:03.220445+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:36:03.220445+0000","last_undegraded":"2024-03-30T12:36:03.220445+0000","last_fullsized":"2024-03-30T12:36:03.220445+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222534+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:36:03.222534+0000","last_peered":"2024-03-30T12:36:03.222534+0000","last_clean":"2024-03-30T12:36:03.222534+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:36:03.222534+0000","last_undegraded":"2024-03-30T12:36:03.222534+0000","last_fullsized":"2024-03-30T12:36:03.222534+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221410+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:36:03.221410+0000","last_peered":"2024-03-30T12:36:03.221410+0000","last_clean":"2024-03-30T12:36:03.221410+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:36:03.221410+0000","last_undegraded":"2024-03-30T12:36:03.221410+0000","last_fullsized":"2024-03-30T12:36:03.221410+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1223,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222946+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:36:03.222946+0000","last_peered":"2024-03-30T12:36:03.222946+0000","last_clean":"2024-03-30T12:36:03.222946+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:36:03.222946+0000","last_undegraded":"2024-03-30T12:36:03.222946+0000","last_fullsized":"2024-03-30T12:36:03.222946+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015999+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:36:03.015999+0000","last_peered":"2024-03-30T12:36:03.015999+0000","last_clean":"2024-03-30T12:36:03.015999+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:36:03.015999+0000","last_undegraded":"2024-03-30T12:36:03.015999+0000","last_fullsized":"2024-03-30T12:36:03.015999+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017890+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:36:03.017890+0000","last_peered":"2024-03-30T12:36:03.017890+0000","last_clean":"2024-03-30T12:36:03.017890+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:36:03.017890+0000","last_undegraded":"2024-03-30T12:36:03.017890+0000","last_fullsized":"2024-03-30T12:36:03.017890+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1387,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221082+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:36:03.221082+0000","last_peered":"2024-03-30T12:36:03.221082+0000","last_clean":"2024-03-30T12:36:03.221082+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:36:03.221082+0000","last_undegraded":"2024-03-30T12:36:03.221082+0000","last_fullsized":"2024-03-30T12:36:03.221082+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1281,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220779+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:36:03.220779+0000","last_peered":"2024-03-30T12:36:03.220779+0000","last_clean":"2024-03-30T12:36:03.220779+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:36:03.220779+0000","last_undegraded":"2024-03-30T12:36:03.220779+0000","last_fullsized":"2024-03-30T12:36:03.220779+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1300,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220968+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:36:03.220968+0000","last_peered":"2024-03-30T12:36:03.220968+0000","last_clean":"2024-03-30T12:36:03.220968+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:36:03.220968+0000","last_undegraded":"2024-03-30T12:36:03.220968+0000","last_fullsized":"2024-03-30T12:36:03.220968+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220378+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:36:03.220378+0000","last_peered":"2024-03-30T12:36:03.220378+0000","last_clean":"2024-03-30T12:36:03.220378+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:36:03.220378+0000","last_undegraded":"2024-03-30T12:36:03.220378+0000","last_fullsized":"2024-03-30T12:36:03.220378+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017887+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:36:03.017887+0000","last_peered":"2024-03-30T12:36:03.017887+0000","last_clean":"2024-03-30T12:36:03.017887+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:36:03.017887+0000","last_undegraded":"2024-03-30T12:36:03.017887+0000","last_fullsized":"2024-03-30T12:36:03.017887+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1228,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222708+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:03.222708+0000","last_peered":"2024-03-30T12:36:03.222708+0000","last_clean":"2024-03-30T12:36:03.222708+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:03.222708+0000","last_undegraded":"2024-03-30T12:36:03.222708+0000","last_fullsized":"2024-03-30T12:36:03.222708+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017639+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:36:03.017639+0000","last_peered":"2024-03-30T12:36:03.017639+0000","last_clean":"2024-03-30T12:36:03.017639+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:36:03.017639+0000","last_undegraded":"2024-03-30T12:36:03.017639+0000","last_fullsized":"2024-03-30T12:36:03.017639+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222301+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:03.222301+0000","last_peered":"2024-03-30T12:36:03.222301+0000","last_clean":"2024-03-30T12:36:03.222301+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:03.222301+0000","last_undegraded":"2024-03-30T12:36:03.222301+0000","last_fullsized":"2024-03-30T12:36:03.222301+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221804+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:36:03.221804+0000","last_peered":"2024-03-30T12:36:03.221804+0000","last_clean":"2024-03-30T12:36:03.221804+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:36:03.221804+0000","last_undegraded":"2024-03-30T12:36:03.221804+0000","last_fullsized":"2024-03-30T12:36:03.221804+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018855+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:36:03.018855+0000","last_peered":"2024-03-30T12:36:03.018855+0000","last_clean":"2024-03-30T12:36:03.018855+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:36:03.018855+0000","last_undegraded":"2024-03-30T12:36:03.018855+0000","last_fullsized":"2024-03-30T12:36:03.018855+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1178,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220485+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:36:03.220485+0000","last_peered":"2024-03-30T12:36:03.220485+0000","last_clean":"2024-03-30T12:36:03.220485+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:36:03.220485+0000","last_undegraded":"2024-03-30T12:36:03.220485+0000","last_fullsized":"2024-03-30T12:36:03.220485+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221577+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:36:03.221577+0000","last_peered":"2024-03-30T12:36:03.221577+0000","last_clean":"2024-03-30T12:36:03.221577+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:36:03.221577+0000","last_undegraded":"2024-03-30T12:36:03.221577+0000","last_fullsized":"2024-03-30T12:36:03.221577+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219793+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:36:03.219793+0000","last_peered":"2024-03-30T12:36:03.219793+0000","last_clean":"2024-03-30T12:36:03.219793+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:36:03.219793+0000","last_undegraded":"2024-03-30T12:36:03.219793+0000","last_fullsized":"2024-03-30T12:36:03.219793+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1293,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219776+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:36:03.219776+0000","last_peered":"2024-03-30T12:36:03.219776+0000","last_clean":"2024-03-30T12:36:03.219776+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:36:03.219776+0000","last_undegraded":"2024-03-30T12:36:03.219776+0000","last_fullsized":"2024-03-30T12:36:03.219776+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1223,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221769+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:36:03.221769+0000","last_peered":"2024-03-30T12:36:03.221769+0000","last_clean":"2024-03-30T12:36:03.221769+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:36:03.221769+0000","last_undegraded":"2024-03-30T12:36:03.221769+0000","last_fullsized":"2024-03-30T12:36:03.221769+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222968+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:36:03.222968+0000","last_peered":"2024-03-30T12:36:03.222968+0000","last_clean":"2024-03-30T12:36:03.222968+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:36:03.222968+0000","last_undegraded":"2024-03-30T12:36:03.222968+0000","last_fullsized":"2024-03-30T12:36:03.222968+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220706+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:03.220706+0000","last_peered":"2024-03-30T12:36:03.220706+0000","last_clean":"2024-03-30T12:36:03.220706+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:03.220706+0000","last_undegraded":"2024-03-30T12:36:03.220706+0000","last_fullsized":"2024-03-30T12:36:03.220706+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1203,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222317+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:36:03.222317+0000","last_peered":"2024-03-30T12:36:03.222317+0000","last_clean":"2024-03-30T12:36:03.222317+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:36:03.222317+0000","last_undegraded":"2024-03-30T12:36:03.222317+0000","last_fullsized":"2024-03-30T12:36:03.222317+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1197,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222067+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:36:03.222067+0000","last_peered":"2024-03-30T12:36:03.222067+0000","last_clean":"2024-03-30T12:36:03.222067+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:36:03.222067+0000","last_undegraded":"2024-03-30T12:36:03.222067+0000","last_fullsized":"2024-03-30T12:36:03.222067+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015689+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:36:03.015689+0000","last_peered":"2024-03-30T12:36:03.015689+0000","last_clean":"2024-03-30T12:36:03.015689+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:36:03.015689+0000","last_undegraded":"2024-03-30T12:36:03.015689+0000","last_fullsized":"2024-03-30T12:36:03.015689+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221275+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:36:03.221275+0000","last_peered":"2024-03-30T12:36:03.221275+0000","last_clean":"2024-03-30T12:36:03.221275+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:36:03.221275+0000","last_undegraded":"2024-03-30T12:36:03.221275+0000","last_fullsized":"2024-03-30T12:36:03.221275+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020038+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:36:03.020038+0000","last_peered":"2024-03-30T12:36:03.020038+0000","last_clean":"2024-03-30T12:36:03.020038+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:36:03.020038+0000","last_undegraded":"2024-03-30T12:36:03.020038+0000","last_fullsized":"2024-03-30T12:36:03.020038+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1204,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220837+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:36:03.220837+0000","last_peered":"2024-03-30T12:36:03.220837+0000","last_clean":"2024-03-30T12:36:03.220837+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:36:03.220837+0000","last_undegraded":"2024-03-30T12:36:03.220837+0000","last_fullsized":"2024-03-30T12:36:03.220837+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017379+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:36:03.017379+0000","last_peered":"2024-03-30T12:36:03.017379+0000","last_clean":"2024-03-30T12:36:03.017379+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:36:03.017379+0000","last_undegraded":"2024-03-30T12:36:03.017379+0000","last_fullsized":"2024-03-30T12:36:03.017379+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221717+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:36:03.221717+0000","last_peered":"2024-03-30T12:36:03.221717+0000","last_clean":"2024-03-30T12:36:03.221717+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:36:03.221717+0000","last_undegraded":"2024-03-30T12:36:03.221717+0000","last_fullsized":"2024-03-30T12:36:03.221717+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220742+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:36:03.220742+0000","last_peered":"2024-03-30T12:36:03.220742+0000","last_clean":"2024-03-30T12:36:03.220742+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:36:03.220742+0000","last_undegraded":"2024-03-30T12:36:03.220742+0000","last_fullsized":"2024-03-30T12:36:03.220742+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221904+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:36:03.221904+0000","last_peered":"2024-03-30T12:36:03.221904+0000","last_clean":"2024-03-30T12:36:03.221904+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:36:03.221904+0000","last_undegraded":"2024-03-30T12:36:03.221904+0000","last_fullsized":"2024-03-30T12:36:03.221904+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017448+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:36:03.017448+0000","last_peered":"2024-03-30T12:36:03.017448+0000","last_clean":"2024-03-30T12:36:03.017448+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:36:03.017448+0000","last_undegraded":"2024-03-30T12:36:03.017448+0000","last_fullsized":"2024-03-30T12:36:03.017448+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220253+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:36:03.220253+0000","last_peered":"2024-03-30T12:36:03.220253+0000","last_clean":"2024-03-30T12:36:03.220253+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:36:03.220253+0000","last_undegraded":"2024-03-30T12:36:03.220253+0000","last_fullsized":"2024-03-30T12:36:03.220253+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220192+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:36:03.220192+0000","last_peered":"2024-03-30T12:36:03.220192+0000","last_clean":"2024-03-30T12:36:03.220192+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:36:03.220192+0000","last_undegraded":"2024-03-30T12:36:03.220192+0000","last_fullsized":"2024-03-30T12:36:03.220192+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1343,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015636+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:36:03.015636+0000","last_peered":"2024-03-30T12:36:03.015636+0000","last_clean":"2024-03-30T12:36:03.015636+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:36:03.015636+0000","last_undegraded":"2024-03-30T12:36:03.015636+0000","last_fullsized":"2024-03-30T12:36:03.015636+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016564+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:36:03.016564+0000","last_peered":"2024-03-30T12:36:03.016564+0000","last_clean":"2024-03-30T12:36:03.016564+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:36:03.016564+0000","last_undegraded":"2024-03-30T12:36:03.016564+0000","last_fullsized":"2024-03-30T12:36:03.016564+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5751,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.016013+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:36:03.016013+0000","last_peered":"2024-03-30T12:36:03.016013+0000","last_clean":"2024-03-30T12:36:03.016013+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:36:03.016013+0000","last_undegraded":"2024-03-30T12:36:03.016013+0000","last_fullsized":"2024-03-30T12:36:03.016013+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020346+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:36:03.020346+0000","last_peered":"2024-03-30T12:36:03.020346+0000","last_clean":"2024-03-30T12:36:03.020346+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:36:03.020346+0000","last_undegraded":"2024-03-30T12:36:03.020346+0000","last_fullsized":"2024-03-30T12:36:03.020346+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018002+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:36:03.018002+0000","last_peered":"2024-03-30T12:36:03.018002+0000","last_clean":"2024-03-30T12:36:03.018002+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:36:03.018002+0000","last_undegraded":"2024-03-30T12:36:03.018002+0000","last_fullsized":"2024-03-30T12:36:03.018002+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5512,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.222067+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:36:03.222067+0000","last_peered":"2024-03-30T12:36:03.222067+0000","last_clean":"2024-03-30T12:36:03.222067+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:36:03.222067+0000","last_undegraded":"2024-03-30T12:36:03.222067+0000","last_fullsized":"2024-03-30T12:36:03.222067+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220564+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:36:03.220564+0000","last_peered":"2024-03-30T12:36:03.220564+0000","last_clean":"2024-03-30T12:36:03.220564+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:36:03.220564+0000","last_undegraded":"2024-03-30T12:36:03.220564+0000","last_fullsized":"2024-03-30T12:36:03.220564+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222416+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:36:03.222416+0000","last_peered":"2024-03-30T12:36:03.222416+0000","last_clean":"2024-03-30T12:36:03.222416+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:36:03.222416+0000","last_undegraded":"2024-03-30T12:36:03.222416+0000","last_fullsized":"2024-03-30T12:36:03.222416+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1237,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222091+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:36:03.222091+0000","last_peered":"2024-03-30T12:36:03.222091+0000","last_clean":"2024-03-30T12:36:03.222091+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:36:03.222091+0000","last_undegraded":"2024-03-30T12:36:03.222091+0000","last_fullsized":"2024-03-30T12:36:03.222091+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5457,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.222052+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:36:03.222052+0000","last_peered":"2024-03-30T12:36:03.222052+0000","last_clean":"2024-03-30T12:36:03.222052+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:36:03.222052+0000","last_undegraded":"2024-03-30T12:36:03.222052+0000","last_fullsized":"2024-03-30T12:36:03.222052+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222540+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:36:03.222540+0000","last_peered":"2024-03-30T12:36:03.222540+0000","last_clean":"2024-03-30T12:36:03.222540+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:36:03.222540+0000","last_undegraded":"2024-03-30T12:36:03.222540+0000","last_fullsized":"2024-03-30T12:36:03.222540+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221637+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:36:03.221637+0000","last_peered":"2024-03-30T12:36:03.221637+0000","last_clean":"2024-03-30T12:36:03.221637+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:36:03.221637+0000","last_undegraded":"2024-03-30T12:36:03.221637+0000","last_fullsized":"2024-03-30T12:36:03.221637+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1270,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019257+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:36:03.019257+0000","last_peered":"2024-03-30T12:36:03.019257+0000","last_clean":"2024-03-30T12:36:03.019257+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:36:03.019257+0000","last_undegraded":"2024-03-30T12:36:03.019257+0000","last_fullsized":"2024-03-30T12:36:03.019257+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3802,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016632+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:36:03.016632+0000","last_peered":"2024-03-30T12:36:03.016632+0000","last_clean":"2024-03-30T12:36:03.016632+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:36:03.016632+0000","last_undegraded":"2024-03-30T12:36:03.016632+0000","last_fullsized":"2024-03-30T12:36:03.016632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1341,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222936+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:36:03.222936+0000","last_peered":"2024-03-30T12:36:03.222936+0000","last_clean":"2024-03-30T12:36:03.222936+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:36:03.222936+0000","last_undegraded":"2024-03-30T12:36:03.222936+0000","last_fullsized":"2024-03-30T12:36:03.222936+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221995+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:36:03.221995+0000","last_peered":"2024-03-30T12:36:03.221995+0000","last_clean":"2024-03-30T12:36:03.221995+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:36:03.221995+0000","last_undegraded":"2024-03-30T12:36:03.221995+0000","last_fullsized":"2024-03-30T12:36:03.221995+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1330,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015172+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:36:03.015172+0000","last_peered":"2024-03-30T12:36:03.015172+0000","last_clean":"2024-03-30T12:36:03.015172+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:36:03.015172+0000","last_undegraded":"2024-03-30T12:36:03.015172+0000","last_fullsized":"2024-03-30T12:36:03.015172+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4575,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.019196+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:36:03.019196+0000","last_peered":"2024-03-30T12:36:03.019196+0000","last_clean":"2024-03-30T12:36:03.019196+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:36:03.019196+0000","last_undegraded":"2024-03-30T12:36:03.019196+0000","last_fullsized":"2024-03-30T12:36:03.019196+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1173,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220732+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:36:03.220732+0000","last_peered":"2024-03-30T12:36:03.220732+0000","last_clean":"2024-03-30T12:36:03.220732+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:36:03.220732+0000","last_undegraded":"2024-03-30T12:36:03.220732+0000","last_fullsized":"2024-03-30T12:36:03.220732+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221414+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:36:03.221414+0000","last_peered":"2024-03-30T12:36:03.221414+0000","last_clean":"2024-03-30T12:36:03.221414+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:36:03.221414+0000","last_undegraded":"2024-03-30T12:36:03.221414+0000","last_fullsized":"2024-03-30T12:36:03.221414+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1198,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221904+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:36:03.221904+0000","last_peered":"2024-03-30T12:36:03.221904+0000","last_clean":"2024-03-30T12:36:03.221904+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:36:03.221904+0000","last_undegraded":"2024-03-30T12:36:03.221904+0000","last_fullsized":"2024-03-30T12:36:03.221904+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1715,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016476+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:36:03.016476+0000","last_peered":"2024-03-30T12:36:03.016476+0000","last_clean":"2024-03-30T12:36:03.016476+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:36:03.016476+0000","last_undegraded":"2024-03-30T12:36:03.016476+0000","last_fullsized":"2024-03-30T12:36:03.016476+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24712,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223515+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:36:03.223515+0000","last_peered":"2024-03-30T12:36:03.223515+0000","last_clean":"2024-03-30T12:36:03.223515+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:36:03.223515+0000","last_undegraded":"2024-03-30T12:36:03.223515+0000","last_fullsized":"2024-03-30T12:36:03.223515+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220576+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:36:03.220576+0000","last_peered":"2024-03-30T12:36:03.220576+0000","last_clean":"2024-03-30T12:36:03.220576+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:36:03.220576+0000","last_undegraded":"2024-03-30T12:36:03.220576+0000","last_fullsized":"2024-03-30T12:36:03.220576+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220696+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:36:03.220696+0000","last_peered":"2024-03-30T12:36:03.220696+0000","last_clean":"2024-03-30T12:36:03.220696+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:36:03.220696+0000","last_undegraded":"2024-03-30T12:36:03.220696+0000","last_fullsized":"2024-03-30T12:36:03.220696+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1143,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016477+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:36:03.016477+0000","last_peered":"2024-03-30T12:36:03.016477+0000","last_clean":"2024-03-30T12:36:03.016477+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:36:03.016477+0000","last_undegraded":"2024-03-30T12:36:03.016477+0000","last_fullsized":"2024-03-30T12:36:03.016477+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16479,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.221375+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:36:03.221375+0000","last_peered":"2024-03-30T12:36:03.221375+0000","last_clean":"2024-03-30T12:36:03.221375+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:36:03.221375+0000","last_undegraded":"2024-03-30T12:36:03.221375+0000","last_fullsized":"2024-03-30T12:36:03.221375+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221448+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:36:03.221448+0000","last_peered":"2024-03-30T12:36:03.221448+0000","last_clean":"2024-03-30T12:36:03.221448+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:36:03.221448+0000","last_undegraded":"2024-03-30T12:36:03.221448+0000","last_fullsized":"2024-03-30T12:36:03.221448+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017748+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:36:03.017748+0000","last_peered":"2024-03-30T12:36:03.017748+0000","last_clean":"2024-03-30T12:36:03.017748+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:36:03.017748+0000","last_undegraded":"2024-03-30T12:36:03.017748+0000","last_fullsized":"2024-03-30T12:36:03.017748+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222632+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:36:03.222632+0000","last_peered":"2024-03-30T12:36:03.222632+0000","last_clean":"2024-03-30T12:36:03.222632+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:36:03.222632+0000","last_undegraded":"2024-03-30T12:36:03.222632+0000","last_fullsized":"2024-03-30T12:36:03.222632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31267,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.020769+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:36:03.020769+0000","last_peered":"2024-03-30T12:36:03.020769+0000","last_clean":"2024-03-30T12:36:03.020769+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:36:03.020769+0000","last_undegraded":"2024-03-30T12:36:03.020769+0000","last_fullsized":"2024-03-30T12:36:03.020769+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1293,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219877+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:36:03.219877+0000","last_peered":"2024-03-30T12:36:03.219877+0000","last_clean":"2024-03-30T12:36:03.219877+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:36:03.219877+0000","last_undegraded":"2024-03-30T12:36:03.219877+0000","last_fullsized":"2024-03-30T12:36:03.219877+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221685+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:36:03.221685+0000","last_peered":"2024-03-30T12:36:03.221685+0000","last_clean":"2024-03-30T12:36:03.221685+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:36:03.221685+0000","last_undegraded":"2024-03-30T12:36:03.221685+0000","last_fullsized":"2024-03-30T12:36:03.221685+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221129+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:36:03.221129+0000","last_peered":"2024-03-30T12:36:03.221129+0000","last_clean":"2024-03-30T12:36:03.221129+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:36:03.221129+0000","last_undegraded":"2024-03-30T12:36:03.221129+0000","last_fullsized":"2024-03-30T12:36:03.221129+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3763,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219946+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:36:03.219946+0000","last_peered":"2024-03-30T12:36:03.219946+0000","last_clean":"2024-03-30T12:36:03.219946+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:36:03.219946+0000","last_undegraded":"2024-03-30T12:36:03.219946+0000","last_fullsized":"2024-03-30T12:36:03.219946+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019106+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:36:03.019106+0000","last_peered":"2024-03-30T12:36:03.019106+0000","last_clean":"2024-03-30T12:36:03.019106+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:36:03.019106+0000","last_undegraded":"2024-03-30T12:36:03.019106+0000","last_fullsized":"2024-03-30T12:36:03.019106+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220680+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:36:03.220680+0000","last_peered":"2024-03-30T12:36:03.220680+0000","last_clean":"2024-03-30T12:36:03.220680+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:36:03.220680+0000","last_undegraded":"2024-03-30T12:36:03.220680+0000","last_fullsized":"2024-03-30T12:36:03.220680+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220307+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:36:03.220307+0000","last_peered":"2024-03-30T12:36:03.220307+0000","last_clean":"2024-03-30T12:36:03.220307+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:36:03.220307+0000","last_undegraded":"2024-03-30T12:36:03.220307+0000","last_fullsized":"2024-03-30T12:36:03.220307+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15592,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223226+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:36:03.223226+0000","last_peered":"2024-03-30T12:36:03.223226+0000","last_clean":"2024-03-30T12:36:03.223226+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:36:03.223226+0000","last_undegraded":"2024-03-30T12:36:03.223226+0000","last_fullsized":"2024-03-30T12:36:03.223226+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1141,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016730+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:36:03.016730+0000","last_peered":"2024-03-30T12:36:03.016730+0000","last_clean":"2024-03-30T12:36:03.016730+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:36:03.016730+0000","last_undegraded":"2024-03-30T12:36:03.016730+0000","last_fullsized":"2024-03-30T12:36:03.016730+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1256,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018912+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:36:03.018912+0000","last_peered":"2024-03-30T12:36:03.018912+0000","last_clean":"2024-03-30T12:36:03.018912+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:36:03.018912+0000","last_undegraded":"2024-03-30T12:36:03.018912+0000","last_fullsized":"2024-03-30T12:36:03.018912+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29018,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.020535+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:36:03.020535+0000","last_peered":"2024-03-30T12:36:03.020535+0000","last_clean":"2024-03-30T12:36:03.020535+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:36:03.020535+0000","last_undegraded":"2024-03-30T12:36:03.020535+0000","last_fullsized":"2024-03-30T12:36:03.020535+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222640+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:36:03.222640+0000","last_peered":"2024-03-30T12:36:03.222640+0000","last_clean":"2024-03-30T12:36:03.222640+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:36:03.222640+0000","last_undegraded":"2024-03-30T12:36:03.222640+0000","last_fullsized":"2024-03-30T12:36:03.222640+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220045+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:36:03.220045+0000","last_peered":"2024-03-30T12:36:03.220045+0000","last_clean":"2024-03-30T12:36:03.220045+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:36:03.220045+0000","last_undegraded":"2024-03-30T12:36:03.220045+0000","last_fullsized":"2024-03-30T12:36:03.220045+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5609,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.017229+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:36:03.017229+0000","last_peered":"2024-03-30T12:36:03.017229+0000","last_clean":"2024-03-30T12:36:03.017229+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:36:03.017229+0000","last_undegraded":"2024-03-30T12:36:03.017229+0000","last_fullsized":"2024-03-30T12:36:03.017229+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1363,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220405+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:36:03.220405+0000","last_peered":"2024-03-30T12:36:03.220405+0000","last_clean":"2024-03-30T12:36:03.220405+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:36:03.220405+0000","last_undegraded":"2024-03-30T12:36:03.220405+0000","last_fullsized":"2024-03-30T12:36:03.220405+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221542+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:03.221542+0000","last_peered":"2024-03-30T12:36:03.221542+0000","last_clean":"2024-03-30T12:36:03.221542+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:03.221542+0000","last_undegraded":"2024-03-30T12:36:03.221542+0000","last_fullsized":"2024-03-30T12:36:03.221542+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222830+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:36:03.222830+0000","last_peered":"2024-03-30T12:36:03.222830+0000","last_clean":"2024-03-30T12:36:03.222830+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:36:03.222830+0000","last_undegraded":"2024-03-30T12:36:03.222830+0000","last_fullsized":"2024-03-30T12:36:03.222830+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017152+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:36:03.017152+0000","last_peered":"2024-03-30T12:36:03.017152+0000","last_clean":"2024-03-30T12:36:03.017152+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:36:03.017152+0000","last_undegraded":"2024-03-30T12:36:03.017152+0000","last_fullsized":"2024-03-30T12:36:03.017152+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221062+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:36:03.221062+0000","last_peered":"2024-03-30T12:36:03.221062+0000","last_clean":"2024-03-30T12:36:03.221062+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:36:03.221062+0000","last_undegraded":"2024-03-30T12:36:03.221062+0000","last_fullsized":"2024-03-30T12:36:03.221062+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5252,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.017068+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:36:03.017068+0000","last_peered":"2024-03-30T12:36:03.017068+0000","last_clean":"2024-03-30T12:36:03.017068+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:36:03.017068+0000","last_undegraded":"2024-03-30T12:36:03.017068+0000","last_fullsized":"2024-03-30T12:36:03.017068+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1330,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016069+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:36:03.016069+0000","last_peered":"2024-03-30T12:36:03.016069+0000","last_clean":"2024-03-30T12:36:03.016069+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:36:03.016069+0000","last_undegraded":"2024-03-30T12:36:03.016069+0000","last_fullsized":"2024-03-30T12:36:03.016069+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017739+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:36:03.017739+0000","last_peered":"2024-03-30T12:36:03.017739+0000","last_clean":"2024-03-30T12:36:03.017739+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:36:03.017739+0000","last_undegraded":"2024-03-30T12:36:03.017739+0000","last_fullsized":"2024-03-30T12:36:03.017739+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4809,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.016990+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:36:03.016990+0000","last_peered":"2024-03-30T12:36:03.016990+0000","last_clean":"2024-03-30T12:36:03.016990+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:36:03.016990+0000","last_undegraded":"2024-03-30T12:36:03.016990+0000","last_fullsized":"2024-03-30T12:36:03.016990+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220902+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:36:03.220902+0000","last_peered":"2024-03-30T12:36:03.220902+0000","last_clean":"2024-03-30T12:36:03.220902+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:36:03.220902+0000","last_undegraded":"2024-03-30T12:36:03.220902+0000","last_fullsized":"2024-03-30T12:36:03.220902+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222557+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:36:03.222557+0000","last_peered":"2024-03-30T12:36:03.222557+0000","last_clean":"2024-03-30T12:36:03.222557+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:36:03.222557+0000","last_undegraded":"2024-03-30T12:36:03.222557+0000","last_fullsized":"2024-03-30T12:36:03.222557+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6741,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.018460+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:36:03.018460+0000","last_peered":"2024-03-30T12:36:03.018460+0000","last_clean":"2024-03-30T12:36:03.018460+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:36:03.018460+0000","last_undegraded":"2024-03-30T12:36:03.018460+0000","last_fullsized":"2024-03-30T12:36:03.018460+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1336,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016373+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:36:03.016373+0000","last_peered":"2024-03-30T12:36:03.016373+0000","last_clean":"2024-03-30T12:36:03.016373+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:36:03.016373+0000","last_undegraded":"2024-03-30T12:36:03.016373+0000","last_fullsized":"2024-03-30T12:36:03.016373+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018870+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:36:03.018870+0000","last_peered":"2024-03-30T12:36:03.018870+0000","last_clean":"2024-03-30T12:36:03.018870+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:36:03.018870+0000","last_undegraded":"2024-03-30T12:36:03.018870+0000","last_fullsized":"2024-03-30T12:36:03.018870+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220120+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:36:03.220120+0000","last_peered":"2024-03-30T12:36:03.220120+0000","last_clean":"2024-03-30T12:36:03.220120+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:36:03.220120+0000","last_undegraded":"2024-03-30T12:36:03.220120+0000","last_fullsized":"2024-03-30T12:36:03.220120+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015273+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:36:03.015273+0000","last_peered":"2024-03-30T12:36:03.015273+0000","last_clean":"2024-03-30T12:36:03.015273+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:36:03.015273+0000","last_undegraded":"2024-03-30T12:36:03.015273+0000","last_fullsized":"2024-03-30T12:36:03.015273+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1237,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221900+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:36:03.221900+0000","last_peered":"2024-03-30T12:36:03.221900+0000","last_clean":"2024-03-30T12:36:03.221900+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:36:03.221900+0000","last_undegraded":"2024-03-30T12:36:03.221900+0000","last_fullsized":"2024-03-30T12:36:03.221900+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221038+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:36:03.221038+0000","last_peered":"2024-03-30T12:36:03.221038+0000","last_clean":"2024-03-30T12:36:03.221038+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:36:03.221038+0000","last_undegraded":"2024-03-30T12:36:03.221038+0000","last_fullsized":"2024-03-30T12:36:03.221038+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220172+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:36:03.220172+0000","last_peered":"2024-03-30T12:36:03.220172+0000","last_clean":"2024-03-30T12:36:03.220172+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:36:03.220172+0000","last_undegraded":"2024-03-30T12:36:03.220172+0000","last_fullsized":"2024-03-30T12:36:03.220172+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221004+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:36:03.221004+0000","last_peered":"2024-03-30T12:36:03.221004+0000","last_clean":"2024-03-30T12:36:03.221004+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:36:03.221004+0000","last_undegraded":"2024-03-30T12:36:03.221004+0000","last_fullsized":"2024-03-30T12:36:03.221004+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1176,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221139+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:36:03.221139+0000","last_peered":"2024-03-30T12:36:03.221139+0000","last_clean":"2024-03-30T12:36:03.221139+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:36:03.221139+0000","last_undegraded":"2024-03-30T12:36:03.221139+0000","last_fullsized":"2024-03-30T12:36:03.221139+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1280,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221301+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:36:03.221301+0000","last_peered":"2024-03-30T12:36:03.221301+0000","last_clean":"2024-03-30T12:36:03.221301+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:36:03.221301+0000","last_undegraded":"2024-03-30T12:36:03.221301+0000","last_fullsized":"2024-03-30T12:36:03.221301+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1237,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221506+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:36:03.221506+0000","last_peered":"2024-03-30T12:36:03.221506+0000","last_clean":"2024-03-30T12:36:03.221506+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:36:03.221506+0000","last_undegraded":"2024-03-30T12:36:03.221506+0000","last_fullsized":"2024-03-30T12:36:03.221506+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1287,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220180+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:03.220180+0000","last_peered":"2024-03-30T12:36:03.220180+0000","last_clean":"2024-03-30T12:36:03.220180+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:03.220180+0000","last_undegraded":"2024-03-30T12:36:03.220180+0000","last_fullsized":"2024-03-30T12:36:03.220180+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221549+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:36:03.221549+0000","last_peered":"2024-03-30T12:36:03.221549+0000","last_clean":"2024-03-30T12:36:03.221549+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:36:03.221549+0000","last_undegraded":"2024-03-30T12:36:03.221549+0000","last_fullsized":"2024-03-30T12:36:03.221549+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220884+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:36:03.220884+0000","last_peered":"2024-03-30T12:36:03.220884+0000","last_clean":"2024-03-30T12:36:03.220884+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:36:03.220884+0000","last_undegraded":"2024-03-30T12:36:03.220884+0000","last_fullsized":"2024-03-30T12:36:03.220884+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220599+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:36:03.220599+0000","last_peered":"2024-03-30T12:36:03.220599+0000","last_clean":"2024-03-30T12:36:03.220599+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:36:03.220599+0000","last_undegraded":"2024-03-30T12:36:03.220599+0000","last_fullsized":"2024-03-30T12:36:03.220599+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438030,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648086,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175096,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254334,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063153,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951210,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839267,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923549,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:36:47.368 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:47.368 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:47.368 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:47.368 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:47.368 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:47.368 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:47.368 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:47.369 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:47.369 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:47.369 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:47.369 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:47.369 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:47.369 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:36:47.369 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:36:47.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:46 smithi162 ceph-mon[83709]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:36:47.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:46 smithi162 ceph-mon[83709]: pgmap v1012: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:49.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:48 smithi084 ceph-mon[89279]: pgmap v1013: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:49.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:48 smithi084 ceph-mon[91810]: pgmap v1013: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:49.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:48 smithi162 ceph-mon[83709]: pgmap v1013: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:49.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:36:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:36:49] "GET /metrics HTTP/1.1" 200 36326 "" "Prometheus/2.43.0" 2024-03-30T12:36:51.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:50 smithi084 ceph-mon[89279]: pgmap v1014: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:51.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:50 smithi084 ceph-mon[91810]: pgmap v1014: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:51.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:50 smithi162 ceph-mon[83709]: pgmap v1014: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:53.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:52 smithi084 ceph-mon[91810]: pgmap v1015: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:53.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:52 smithi084 ceph-mon[89279]: pgmap v1015: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:53.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:52 smithi162 ceph-mon[83709]: pgmap v1015: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:55.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:54 smithi084 ceph-mon[91810]: pgmap v1016: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:55.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:54 smithi084 ceph-mon[89279]: pgmap v1016: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:55.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:54 smithi162 ceph-mon[83709]: pgmap v1016: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:57.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:56 smithi084 ceph-mon[91810]: pgmap v1017: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:57.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:56 smithi084 ceph-mon[89279]: pgmap v1017: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:57.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:56 smithi162 ceph-mon[83709]: pgmap v1017: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:57.370 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:36:57.589 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:36:59.158 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:58 smithi084 ceph-mon[91810]: pgmap v1018: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:59.158 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:58 smithi084 ceph-mon[89279]: pgmap v1018: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:59.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:58 smithi162 ceph-mon[83709]: pgmap v1018: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:36:59.465 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:36:59.466 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:36:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:36:59] "GET /metrics HTTP/1.1" 200 36326 "" "Prometheus/2.43.0" 2024-03-30T12:36:59.471 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:37:00.030 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:59 smithi084 ceph-mon[89279]: from='client.44471 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:37:00.030 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:36:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:37:00.031 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:59 smithi084 ceph-mon[91810]: from='client.44471 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:37:00.031 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:36:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:37:00.032 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1018,"stamp":"2024-03-30T12:36:58.812904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004140"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018672+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:36:03.018672+0000","last_peered":"2024-03-30T12:36:03.018672+0000","last_clean":"2024-03-30T12:36:03.018672+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:36:03.018672+0000","last_undegraded":"2024-03-30T12:36:03.018672+0000","last_fullsized":"2024-03-30T12:36:03.018672+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1362,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221591+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:36:03.221591+0000","last_peered":"2024-03-30T12:36:03.221591+0000","last_clean":"2024-03-30T12:36:03.221591+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:36:03.221591+0000","last_undegraded":"2024-03-30T12:36:03.221591+0000","last_fullsized":"2024-03-30T12:36:03.221591+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221207+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:36:03.221207+0000","last_peered":"2024-03-30T12:36:03.221207+0000","last_clean":"2024-03-30T12:36:03.221207+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:36:03.221207+0000","last_undegraded":"2024-03-30T12:36:03.221207+0000","last_fullsized":"2024-03-30T12:36:03.221207+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222033+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:36:03.222033+0000","last_peered":"2024-03-30T12:36:03.222033+0000","last_clean":"2024-03-30T12:36:03.222033+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:36:03.222033+0000","last_undegraded":"2024-03-30T12:36:03.222033+0000","last_fullsized":"2024-03-30T12:36:03.222033+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016806+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:36:03.016806+0000","last_peered":"2024-03-30T12:36:03.016806+0000","last_clean":"2024-03-30T12:36:03.016806+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:36:03.016806+0000","last_undegraded":"2024-03-30T12:36:03.016806+0000","last_fullsized":"2024-03-30T12:36:03.016806+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1209,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222566+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:03.222566+0000","last_peered":"2024-03-30T12:36:03.222566+0000","last_clean":"2024-03-30T12:36:03.222566+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:03.222566+0000","last_undegraded":"2024-03-30T12:36:03.222566+0000","last_fullsized":"2024-03-30T12:36:03.222566+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017295+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:36:03.017295+0000","last_peered":"2024-03-30T12:36:03.017295+0000","last_clean":"2024-03-30T12:36:03.017295+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:36:03.017295+0000","last_undegraded":"2024-03-30T12:36:03.017295+0000","last_fullsized":"2024-03-30T12:36:03.017295+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1257,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219724+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:36:03.219724+0000","last_peered":"2024-03-30T12:36:03.219724+0000","last_clean":"2024-03-30T12:36:03.219724+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:36:03.219724+0000","last_undegraded":"2024-03-30T12:36:03.219724+0000","last_fullsized":"2024-03-30T12:36:03.219724+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017862+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:36:03.017862+0000","last_peered":"2024-03-30T12:36:03.017862+0000","last_clean":"2024-03-30T12:36:03.017862+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:36:03.017862+0000","last_undegraded":"2024-03-30T12:36:03.017862+0000","last_fullsized":"2024-03-30T12:36:03.017862+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220774+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:03.220774+0000","last_peered":"2024-03-30T12:36:03.220774+0000","last_clean":"2024-03-30T12:36:03.220774+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:03.220774+0000","last_undegraded":"2024-03-30T12:36:03.220774+0000","last_fullsized":"2024-03-30T12:36:03.220774+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220468+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:03.220468+0000","last_peered":"2024-03-30T12:36:03.220468+0000","last_clean":"2024-03-30T12:36:03.220468+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:03.220468+0000","last_undegraded":"2024-03-30T12:36:03.220468+0000","last_fullsized":"2024-03-30T12:36:03.220468+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1269,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020196+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:36:03.020196+0000","last_peered":"2024-03-30T12:36:03.020196+0000","last_clean":"2024-03-30T12:36:03.020196+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:36:03.020196+0000","last_undegraded":"2024-03-30T12:36:03.020196+0000","last_fullsized":"2024-03-30T12:36:03.020196+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1287,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221647+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:36:03.221647+0000","last_peered":"2024-03-30T12:36:03.221647+0000","last_clean":"2024-03-30T12:36:03.221647+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:36:03.221647+0000","last_undegraded":"2024-03-30T12:36:03.221647+0000","last_fullsized":"2024-03-30T12:36:03.221647+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220445+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:36:03.220445+0000","last_peered":"2024-03-30T12:36:03.220445+0000","last_clean":"2024-03-30T12:36:03.220445+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:36:03.220445+0000","last_undegraded":"2024-03-30T12:36:03.220445+0000","last_fullsized":"2024-03-30T12:36:03.220445+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222534+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:36:03.222534+0000","last_peered":"2024-03-30T12:36:03.222534+0000","last_clean":"2024-03-30T12:36:03.222534+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:36:03.222534+0000","last_undegraded":"2024-03-30T12:36:03.222534+0000","last_fullsized":"2024-03-30T12:36:03.222534+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221410+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:36:03.221410+0000","last_peered":"2024-03-30T12:36:03.221410+0000","last_clean":"2024-03-30T12:36:03.221410+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:36:03.221410+0000","last_undegraded":"2024-03-30T12:36:03.221410+0000","last_fullsized":"2024-03-30T12:36:03.221410+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1223,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222946+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:36:03.222946+0000","last_peered":"2024-03-30T12:36:03.222946+0000","last_clean":"2024-03-30T12:36:03.222946+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:36:03.222946+0000","last_undegraded":"2024-03-30T12:36:03.222946+0000","last_fullsized":"2024-03-30T12:36:03.222946+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015999+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:36:03.015999+0000","last_peered":"2024-03-30T12:36:03.015999+0000","last_clean":"2024-03-30T12:36:03.015999+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:36:03.015999+0000","last_undegraded":"2024-03-30T12:36:03.015999+0000","last_fullsized":"2024-03-30T12:36:03.015999+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017890+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:36:03.017890+0000","last_peered":"2024-03-30T12:36:03.017890+0000","last_clean":"2024-03-30T12:36:03.017890+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:36:03.017890+0000","last_undegraded":"2024-03-30T12:36:03.017890+0000","last_fullsized":"2024-03-30T12:36:03.017890+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1387,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221082+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:36:03.221082+0000","last_peered":"2024-03-30T12:36:03.221082+0000","last_clean":"2024-03-30T12:36:03.221082+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:36:03.221082+0000","last_undegraded":"2024-03-30T12:36:03.221082+0000","last_fullsized":"2024-03-30T12:36:03.221082+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1281,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220779+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:36:03.220779+0000","last_peered":"2024-03-30T12:36:03.220779+0000","last_clean":"2024-03-30T12:36:03.220779+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:36:03.220779+0000","last_undegraded":"2024-03-30T12:36:03.220779+0000","last_fullsized":"2024-03-30T12:36:03.220779+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1300,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220968+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:36:03.220968+0000","last_peered":"2024-03-30T12:36:03.220968+0000","last_clean":"2024-03-30T12:36:03.220968+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:36:03.220968+0000","last_undegraded":"2024-03-30T12:36:03.220968+0000","last_fullsized":"2024-03-30T12:36:03.220968+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220378+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:36:03.220378+0000","last_peered":"2024-03-30T12:36:03.220378+0000","last_clean":"2024-03-30T12:36:03.220378+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:36:03.220378+0000","last_undegraded":"2024-03-30T12:36:03.220378+0000","last_fullsized":"2024-03-30T12:36:03.220378+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017887+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:36:03.017887+0000","last_peered":"2024-03-30T12:36:03.017887+0000","last_clean":"2024-03-30T12:36:03.017887+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:36:03.017887+0000","last_undegraded":"2024-03-30T12:36:03.017887+0000","last_fullsized":"2024-03-30T12:36:03.017887+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1228,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222708+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:03.222708+0000","last_peered":"2024-03-30T12:36:03.222708+0000","last_clean":"2024-03-30T12:36:03.222708+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:03.222708+0000","last_undegraded":"2024-03-30T12:36:03.222708+0000","last_fullsized":"2024-03-30T12:36:03.222708+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017639+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:36:03.017639+0000","last_peered":"2024-03-30T12:36:03.017639+0000","last_clean":"2024-03-30T12:36:03.017639+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:36:03.017639+0000","last_undegraded":"2024-03-30T12:36:03.017639+0000","last_fullsized":"2024-03-30T12:36:03.017639+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222301+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:03.222301+0000","last_peered":"2024-03-30T12:36:03.222301+0000","last_clean":"2024-03-30T12:36:03.222301+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:03.222301+0000","last_undegraded":"2024-03-30T12:36:03.222301+0000","last_fullsized":"2024-03-30T12:36:03.222301+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221804+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:36:03.221804+0000","last_peered":"2024-03-30T12:36:03.221804+0000","last_clean":"2024-03-30T12:36:03.221804+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:36:03.221804+0000","last_undegraded":"2024-03-30T12:36:03.221804+0000","last_fullsized":"2024-03-30T12:36:03.221804+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018855+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:36:03.018855+0000","last_peered":"2024-03-30T12:36:03.018855+0000","last_clean":"2024-03-30T12:36:03.018855+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:36:03.018855+0000","last_undegraded":"2024-03-30T12:36:03.018855+0000","last_fullsized":"2024-03-30T12:36:03.018855+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1178,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220485+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:36:03.220485+0000","last_peered":"2024-03-30T12:36:03.220485+0000","last_clean":"2024-03-30T12:36:03.220485+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:36:03.220485+0000","last_undegraded":"2024-03-30T12:36:03.220485+0000","last_fullsized":"2024-03-30T12:36:03.220485+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221577+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:36:03.221577+0000","last_peered":"2024-03-30T12:36:03.221577+0000","last_clean":"2024-03-30T12:36:03.221577+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:36:03.221577+0000","last_undegraded":"2024-03-30T12:36:03.221577+0000","last_fullsized":"2024-03-30T12:36:03.221577+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219793+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:36:03.219793+0000","last_peered":"2024-03-30T12:36:03.219793+0000","last_clean":"2024-03-30T12:36:03.219793+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:36:03.219793+0000","last_undegraded":"2024-03-30T12:36:03.219793+0000","last_fullsized":"2024-03-30T12:36:03.219793+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1293,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219776+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:36:03.219776+0000","last_peered":"2024-03-30T12:36:03.219776+0000","last_clean":"2024-03-30T12:36:03.219776+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:36:03.219776+0000","last_undegraded":"2024-03-30T12:36:03.219776+0000","last_fullsized":"2024-03-30T12:36:03.219776+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1223,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221769+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:36:03.221769+0000","last_peered":"2024-03-30T12:36:03.221769+0000","last_clean":"2024-03-30T12:36:03.221769+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:36:03.221769+0000","last_undegraded":"2024-03-30T12:36:03.221769+0000","last_fullsized":"2024-03-30T12:36:03.221769+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222968+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:36:03.222968+0000","last_peered":"2024-03-30T12:36:03.222968+0000","last_clean":"2024-03-30T12:36:03.222968+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:36:03.222968+0000","last_undegraded":"2024-03-30T12:36:03.222968+0000","last_fullsized":"2024-03-30T12:36:03.222968+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220821+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:03.220821+0000","last_peered":"2024-03-30T12:36:03.220821+0000","last_clean":"2024-03-30T12:36:03.220821+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:03.220821+0000","last_undegraded":"2024-03-30T12:36:03.220821+0000","last_fullsized":"2024-03-30T12:36:03.220821+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1203,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222317+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:36:03.222317+0000","last_peered":"2024-03-30T12:36:03.222317+0000","last_clean":"2024-03-30T12:36:03.222317+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:36:03.222317+0000","last_undegraded":"2024-03-30T12:36:03.222317+0000","last_fullsized":"2024-03-30T12:36:03.222317+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1197,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222067+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:36:03.222067+0000","last_peered":"2024-03-30T12:36:03.222067+0000","last_clean":"2024-03-30T12:36:03.222067+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:36:03.222067+0000","last_undegraded":"2024-03-30T12:36:03.222067+0000","last_fullsized":"2024-03-30T12:36:03.222067+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015689+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:36:03.015689+0000","last_peered":"2024-03-30T12:36:03.015689+0000","last_clean":"2024-03-30T12:36:03.015689+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:36:03.015689+0000","last_undegraded":"2024-03-30T12:36:03.015689+0000","last_fullsized":"2024-03-30T12:36:03.015689+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221275+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:36:03.221275+0000","last_peered":"2024-03-30T12:36:03.221275+0000","last_clean":"2024-03-30T12:36:03.221275+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:36:03.221275+0000","last_undegraded":"2024-03-30T12:36:03.221275+0000","last_fullsized":"2024-03-30T12:36:03.221275+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020038+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:36:03.020038+0000","last_peered":"2024-03-30T12:36:03.020038+0000","last_clean":"2024-03-30T12:36:03.020038+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:36:03.020038+0000","last_undegraded":"2024-03-30T12:36:03.020038+0000","last_fullsized":"2024-03-30T12:36:03.020038+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1204,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220837+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:36:03.220837+0000","last_peered":"2024-03-30T12:36:03.220837+0000","last_clean":"2024-03-30T12:36:03.220837+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:36:03.220837+0000","last_undegraded":"2024-03-30T12:36:03.220837+0000","last_fullsized":"2024-03-30T12:36:03.220837+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017379+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:36:03.017379+0000","last_peered":"2024-03-30T12:36:03.017379+0000","last_clean":"2024-03-30T12:36:03.017379+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:36:03.017379+0000","last_undegraded":"2024-03-30T12:36:03.017379+0000","last_fullsized":"2024-03-30T12:36:03.017379+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221717+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:36:03.221717+0000","last_peered":"2024-03-30T12:36:03.221717+0000","last_clean":"2024-03-30T12:36:03.221717+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:36:03.221717+0000","last_undegraded":"2024-03-30T12:36:03.221717+0000","last_fullsized":"2024-03-30T12:36:03.221717+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220742+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:36:03.220742+0000","last_peered":"2024-03-30T12:36:03.220742+0000","last_clean":"2024-03-30T12:36:03.220742+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:36:03.220742+0000","last_undegraded":"2024-03-30T12:36:03.220742+0000","last_fullsized":"2024-03-30T12:36:03.220742+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221904+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:36:03.221904+0000","last_peered":"2024-03-30T12:36:03.221904+0000","last_clean":"2024-03-30T12:36:03.221904+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:36:03.221904+0000","last_undegraded":"2024-03-30T12:36:03.221904+0000","last_fullsized":"2024-03-30T12:36:03.221904+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017448+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:36:03.017448+0000","last_peered":"2024-03-30T12:36:03.017448+0000","last_clean":"2024-03-30T12:36:03.017448+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:36:03.017448+0000","last_undegraded":"2024-03-30T12:36:03.017448+0000","last_fullsized":"2024-03-30T12:36:03.017448+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220253+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:36:03.220253+0000","last_peered":"2024-03-30T12:36:03.220253+0000","last_clean":"2024-03-30T12:36:03.220253+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:36:03.220253+0000","last_undegraded":"2024-03-30T12:36:03.220253+0000","last_fullsized":"2024-03-30T12:36:03.220253+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220192+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:36:03.220192+0000","last_peered":"2024-03-30T12:36:03.220192+0000","last_clean":"2024-03-30T12:36:03.220192+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:36:03.220192+0000","last_undegraded":"2024-03-30T12:36:03.220192+0000","last_fullsized":"2024-03-30T12:36:03.220192+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1343,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015636+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:36:03.015636+0000","last_peered":"2024-03-30T12:36:03.015636+0000","last_clean":"2024-03-30T12:36:03.015636+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:36:03.015636+0000","last_undegraded":"2024-03-30T12:36:03.015636+0000","last_fullsized":"2024-03-30T12:36:03.015636+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016564+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:36:03.016564+0000","last_peered":"2024-03-30T12:36:03.016564+0000","last_clean":"2024-03-30T12:36:03.016564+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:36:03.016564+0000","last_undegraded":"2024-03-30T12:36:03.016564+0000","last_fullsized":"2024-03-30T12:36:03.016564+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5751,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.016013+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:36:03.016013+0000","last_peered":"2024-03-30T12:36:03.016013+0000","last_clean":"2024-03-30T12:36:03.016013+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:36:03.016013+0000","last_undegraded":"2024-03-30T12:36:03.016013+0000","last_fullsized":"2024-03-30T12:36:03.016013+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020346+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:36:03.020346+0000","last_peered":"2024-03-30T12:36:03.020346+0000","last_clean":"2024-03-30T12:36:03.020346+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:36:03.020346+0000","last_undegraded":"2024-03-30T12:36:03.020346+0000","last_fullsized":"2024-03-30T12:36:03.020346+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018002+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:36:03.018002+0000","last_peered":"2024-03-30T12:36:03.018002+0000","last_clean":"2024-03-30T12:36:03.018002+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:36:03.018002+0000","last_undegraded":"2024-03-30T12:36:03.018002+0000","last_fullsized":"2024-03-30T12:36:03.018002+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5512,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.222067+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:36:03.222067+0000","last_peered":"2024-03-30T12:36:03.222067+0000","last_clean":"2024-03-30T12:36:03.222067+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:36:03.222067+0000","last_undegraded":"2024-03-30T12:36:03.222067+0000","last_fullsized":"2024-03-30T12:36:03.222067+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220564+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:36:03.220564+0000","last_peered":"2024-03-30T12:36:03.220564+0000","last_clean":"2024-03-30T12:36:03.220564+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:36:03.220564+0000","last_undegraded":"2024-03-30T12:36:03.220564+0000","last_fullsized":"2024-03-30T12:36:03.220564+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222416+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:36:03.222416+0000","last_peered":"2024-03-30T12:36:03.222416+0000","last_clean":"2024-03-30T12:36:03.222416+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:36:03.222416+0000","last_undegraded":"2024-03-30T12:36:03.222416+0000","last_fullsized":"2024-03-30T12:36:03.222416+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1237,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222091+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:36:03.222091+0000","last_peered":"2024-03-30T12:36:03.222091+0000","last_clean":"2024-03-30T12:36:03.222091+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:36:03.222091+0000","last_undegraded":"2024-03-30T12:36:03.222091+0000","last_fullsized":"2024-03-30T12:36:03.222091+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5457,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.222052+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:36:03.222052+0000","last_peered":"2024-03-30T12:36:03.222052+0000","last_clean":"2024-03-30T12:36:03.222052+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:36:03.222052+0000","last_undegraded":"2024-03-30T12:36:03.222052+0000","last_fullsized":"2024-03-30T12:36:03.222052+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222540+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:36:03.222540+0000","last_peered":"2024-03-30T12:36:03.222540+0000","last_clean":"2024-03-30T12:36:03.222540+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:36:03.222540+0000","last_undegraded":"2024-03-30T12:36:03.222540+0000","last_fullsized":"2024-03-30T12:36:03.222540+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221637+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:36:03.221637+0000","last_peered":"2024-03-30T12:36:03.221637+0000","last_clean":"2024-03-30T12:36:03.221637+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:36:03.221637+0000","last_undegraded":"2024-03-30T12:36:03.221637+0000","last_fullsized":"2024-03-30T12:36:03.221637+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1271,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019374+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:36:03.019374+0000","last_peered":"2024-03-30T12:36:03.019374+0000","last_clean":"2024-03-30T12:36:03.019374+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:36:03.019374+0000","last_undegraded":"2024-03-30T12:36:03.019374+0000","last_fullsized":"2024-03-30T12:36:03.019374+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3802,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016632+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:36:03.016632+0000","last_peered":"2024-03-30T12:36:03.016632+0000","last_clean":"2024-03-30T12:36:03.016632+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:36:03.016632+0000","last_undegraded":"2024-03-30T12:36:03.016632+0000","last_fullsized":"2024-03-30T12:36:03.016632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1341,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222936+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:36:03.222936+0000","last_peered":"2024-03-30T12:36:03.222936+0000","last_clean":"2024-03-30T12:36:03.222936+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:36:03.222936+0000","last_undegraded":"2024-03-30T12:36:03.222936+0000","last_fullsized":"2024-03-30T12:36:03.222936+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222036+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:36:03.222036+0000","last_peered":"2024-03-30T12:36:03.222036+0000","last_clean":"2024-03-30T12:36:03.222036+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:36:03.222036+0000","last_undegraded":"2024-03-30T12:36:03.222036+0000","last_fullsized":"2024-03-30T12:36:03.222036+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1330,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015172+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:36:03.015172+0000","last_peered":"2024-03-30T12:36:03.015172+0000","last_clean":"2024-03-30T12:36:03.015172+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:36:03.015172+0000","last_undegraded":"2024-03-30T12:36:03.015172+0000","last_fullsized":"2024-03-30T12:36:03.015172+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4575,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.019196+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:36:03.019196+0000","last_peered":"2024-03-30T12:36:03.019196+0000","last_clean":"2024-03-30T12:36:03.019196+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:36:03.019196+0000","last_undegraded":"2024-03-30T12:36:03.019196+0000","last_fullsized":"2024-03-30T12:36:03.019196+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1173,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220732+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:36:03.220732+0000","last_peered":"2024-03-30T12:36:03.220732+0000","last_clean":"2024-03-30T12:36:03.220732+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:36:03.220732+0000","last_undegraded":"2024-03-30T12:36:03.220732+0000","last_fullsized":"2024-03-30T12:36:03.220732+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221414+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:36:03.221414+0000","last_peered":"2024-03-30T12:36:03.221414+0000","last_clean":"2024-03-30T12:36:03.221414+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:36:03.221414+0000","last_undegraded":"2024-03-30T12:36:03.221414+0000","last_fullsized":"2024-03-30T12:36:03.221414+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1198,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221904+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:36:03.221904+0000","last_peered":"2024-03-30T12:36:03.221904+0000","last_clean":"2024-03-30T12:36:03.221904+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:36:03.221904+0000","last_undegraded":"2024-03-30T12:36:03.221904+0000","last_fullsized":"2024-03-30T12:36:03.221904+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1715,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016476+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:36:03.016476+0000","last_peered":"2024-03-30T12:36:03.016476+0000","last_clean":"2024-03-30T12:36:03.016476+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:36:03.016476+0000","last_undegraded":"2024-03-30T12:36:03.016476+0000","last_fullsized":"2024-03-30T12:36:03.016476+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24712,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223515+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:36:03.223515+0000","last_peered":"2024-03-30T12:36:03.223515+0000","last_clean":"2024-03-30T12:36:03.223515+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:36:03.223515+0000","last_undegraded":"2024-03-30T12:36:03.223515+0000","last_fullsized":"2024-03-30T12:36:03.223515+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220576+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:36:03.220576+0000","last_peered":"2024-03-30T12:36:03.220576+0000","last_clean":"2024-03-30T12:36:03.220576+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:36:03.220576+0000","last_undegraded":"2024-03-30T12:36:03.220576+0000","last_fullsized":"2024-03-30T12:36:03.220576+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220696+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:36:03.220696+0000","last_peered":"2024-03-30T12:36:03.220696+0000","last_clean":"2024-03-30T12:36:03.220696+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:36:03.220696+0000","last_undegraded":"2024-03-30T12:36:03.220696+0000","last_fullsized":"2024-03-30T12:36:03.220696+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1143,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016477+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:36:03.016477+0000","last_peered":"2024-03-30T12:36:03.016477+0000","last_clean":"2024-03-30T12:36:03.016477+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:36:03.016477+0000","last_undegraded":"2024-03-30T12:36:03.016477+0000","last_fullsized":"2024-03-30T12:36:03.016477+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16479,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.221375+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:36:03.221375+0000","last_peered":"2024-03-30T12:36:03.221375+0000","last_clean":"2024-03-30T12:36:03.221375+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:36:03.221375+0000","last_undegraded":"2024-03-30T12:36:03.221375+0000","last_fullsized":"2024-03-30T12:36:03.221375+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221448+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:36:03.221448+0000","last_peered":"2024-03-30T12:36:03.221448+0000","last_clean":"2024-03-30T12:36:03.221448+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:36:03.221448+0000","last_undegraded":"2024-03-30T12:36:03.221448+0000","last_fullsized":"2024-03-30T12:36:03.221448+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017748+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:36:03.017748+0000","last_peered":"2024-03-30T12:36:03.017748+0000","last_clean":"2024-03-30T12:36:03.017748+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:36:03.017748+0000","last_undegraded":"2024-03-30T12:36:03.017748+0000","last_fullsized":"2024-03-30T12:36:03.017748+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222632+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:36:03.222632+0000","last_peered":"2024-03-30T12:36:03.222632+0000","last_clean":"2024-03-30T12:36:03.222632+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:36:03.222632+0000","last_undegraded":"2024-03-30T12:36:03.222632+0000","last_fullsized":"2024-03-30T12:36:03.222632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31268,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.021096+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:36:03.021096+0000","last_peered":"2024-03-30T12:36:03.021096+0000","last_clean":"2024-03-30T12:36:03.021096+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:36:03.021096+0000","last_undegraded":"2024-03-30T12:36:03.021096+0000","last_fullsized":"2024-03-30T12:36:03.021096+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1293,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219877+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:36:03.219877+0000","last_peered":"2024-03-30T12:36:03.219877+0000","last_clean":"2024-03-30T12:36:03.219877+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:36:03.219877+0000","last_undegraded":"2024-03-30T12:36:03.219877+0000","last_fullsized":"2024-03-30T12:36:03.219877+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221685+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:36:03.221685+0000","last_peered":"2024-03-30T12:36:03.221685+0000","last_clean":"2024-03-30T12:36:03.221685+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:36:03.221685+0000","last_undegraded":"2024-03-30T12:36:03.221685+0000","last_fullsized":"2024-03-30T12:36:03.221685+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221129+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:36:03.221129+0000","last_peered":"2024-03-30T12:36:03.221129+0000","last_clean":"2024-03-30T12:36:03.221129+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:36:03.221129+0000","last_undegraded":"2024-03-30T12:36:03.221129+0000","last_fullsized":"2024-03-30T12:36:03.221129+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3763,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219946+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:36:03.219946+0000","last_peered":"2024-03-30T12:36:03.219946+0000","last_clean":"2024-03-30T12:36:03.219946+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:36:03.219946+0000","last_undegraded":"2024-03-30T12:36:03.219946+0000","last_fullsized":"2024-03-30T12:36:03.219946+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019149+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:36:03.019149+0000","last_peered":"2024-03-30T12:36:03.019149+0000","last_clean":"2024-03-30T12:36:03.019149+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:36:03.019149+0000","last_undegraded":"2024-03-30T12:36:03.019149+0000","last_fullsized":"2024-03-30T12:36:03.019149+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220680+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:36:03.220680+0000","last_peered":"2024-03-30T12:36:03.220680+0000","last_clean":"2024-03-30T12:36:03.220680+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:36:03.220680+0000","last_undegraded":"2024-03-30T12:36:03.220680+0000","last_fullsized":"2024-03-30T12:36:03.220680+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220307+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:36:03.220307+0000","last_peered":"2024-03-30T12:36:03.220307+0000","last_clean":"2024-03-30T12:36:03.220307+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:36:03.220307+0000","last_undegraded":"2024-03-30T12:36:03.220307+0000","last_fullsized":"2024-03-30T12:36:03.220307+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15592,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223226+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:36:03.223226+0000","last_peered":"2024-03-30T12:36:03.223226+0000","last_clean":"2024-03-30T12:36:03.223226+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:36:03.223226+0000","last_undegraded":"2024-03-30T12:36:03.223226+0000","last_fullsized":"2024-03-30T12:36:03.223226+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1142,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016783+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:36:03.016783+0000","last_peered":"2024-03-30T12:36:03.016783+0000","last_clean":"2024-03-30T12:36:03.016783+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:36:03.016783+0000","last_undegraded":"2024-03-30T12:36:03.016783+0000","last_fullsized":"2024-03-30T12:36:03.016783+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1256,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018912+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:36:03.018912+0000","last_peered":"2024-03-30T12:36:03.018912+0000","last_clean":"2024-03-30T12:36:03.018912+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:36:03.018912+0000","last_undegraded":"2024-03-30T12:36:03.018912+0000","last_fullsized":"2024-03-30T12:36:03.018912+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29018,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.020535+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:36:03.020535+0000","last_peered":"2024-03-30T12:36:03.020535+0000","last_clean":"2024-03-30T12:36:03.020535+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:36:03.020535+0000","last_undegraded":"2024-03-30T12:36:03.020535+0000","last_fullsized":"2024-03-30T12:36:03.020535+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222640+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:36:03.222640+0000","last_peered":"2024-03-30T12:36:03.222640+0000","last_clean":"2024-03-30T12:36:03.222640+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:36:03.222640+0000","last_undegraded":"2024-03-30T12:36:03.222640+0000","last_fullsized":"2024-03-30T12:36:03.222640+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220045+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:36:03.220045+0000","last_peered":"2024-03-30T12:36:03.220045+0000","last_clean":"2024-03-30T12:36:03.220045+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:36:03.220045+0000","last_undegraded":"2024-03-30T12:36:03.220045+0000","last_fullsized":"2024-03-30T12:36:03.220045+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5609,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.017229+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:36:03.017229+0000","last_peered":"2024-03-30T12:36:03.017229+0000","last_clean":"2024-03-30T12:36:03.017229+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:36:03.017229+0000","last_undegraded":"2024-03-30T12:36:03.017229+0000","last_fullsized":"2024-03-30T12:36:03.017229+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1363,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220405+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:36:03.220405+0000","last_peered":"2024-03-30T12:36:03.220405+0000","last_clean":"2024-03-30T12:36:03.220405+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:36:03.220405+0000","last_undegraded":"2024-03-30T12:36:03.220405+0000","last_fullsized":"2024-03-30T12:36:03.220405+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221588+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:03.221588+0000","last_peered":"2024-03-30T12:36:03.221588+0000","last_clean":"2024-03-30T12:36:03.221588+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:03.221588+0000","last_undegraded":"2024-03-30T12:36:03.221588+0000","last_fullsized":"2024-03-30T12:36:03.221588+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222830+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:36:03.222830+0000","last_peered":"2024-03-30T12:36:03.222830+0000","last_clean":"2024-03-30T12:36:03.222830+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:36:03.222830+0000","last_undegraded":"2024-03-30T12:36:03.222830+0000","last_fullsized":"2024-03-30T12:36:03.222830+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017152+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:36:03.017152+0000","last_peered":"2024-03-30T12:36:03.017152+0000","last_clean":"2024-03-30T12:36:03.017152+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:36:03.017152+0000","last_undegraded":"2024-03-30T12:36:03.017152+0000","last_fullsized":"2024-03-30T12:36:03.017152+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221062+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:36:03.221062+0000","last_peered":"2024-03-30T12:36:03.221062+0000","last_clean":"2024-03-30T12:36:03.221062+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:36:03.221062+0000","last_undegraded":"2024-03-30T12:36:03.221062+0000","last_fullsized":"2024-03-30T12:36:03.221062+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5252,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.017068+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:36:03.017068+0000","last_peered":"2024-03-30T12:36:03.017068+0000","last_clean":"2024-03-30T12:36:03.017068+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:36:03.017068+0000","last_undegraded":"2024-03-30T12:36:03.017068+0000","last_fullsized":"2024-03-30T12:36:03.017068+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1330,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016069+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:36:03.016069+0000","last_peered":"2024-03-30T12:36:03.016069+0000","last_clean":"2024-03-30T12:36:03.016069+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:36:03.016069+0000","last_undegraded":"2024-03-30T12:36:03.016069+0000","last_fullsized":"2024-03-30T12:36:03.016069+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017739+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:36:03.017739+0000","last_peered":"2024-03-30T12:36:03.017739+0000","last_clean":"2024-03-30T12:36:03.017739+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:36:03.017739+0000","last_undegraded":"2024-03-30T12:36:03.017739+0000","last_fullsized":"2024-03-30T12:36:03.017739+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4809,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.016990+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:36:03.016990+0000","last_peered":"2024-03-30T12:36:03.016990+0000","last_clean":"2024-03-30T12:36:03.016990+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:36:03.016990+0000","last_undegraded":"2024-03-30T12:36:03.016990+0000","last_fullsized":"2024-03-30T12:36:03.016990+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220902+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:36:03.220902+0000","last_peered":"2024-03-30T12:36:03.220902+0000","last_clean":"2024-03-30T12:36:03.220902+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:36:03.220902+0000","last_undegraded":"2024-03-30T12:36:03.220902+0000","last_fullsized":"2024-03-30T12:36:03.220902+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222557+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:36:03.222557+0000","last_peered":"2024-03-30T12:36:03.222557+0000","last_clean":"2024-03-30T12:36:03.222557+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:36:03.222557+0000","last_undegraded":"2024-03-30T12:36:03.222557+0000","last_fullsized":"2024-03-30T12:36:03.222557+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6742,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.018791+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:36:03.018791+0000","last_peered":"2024-03-30T12:36:03.018791+0000","last_clean":"2024-03-30T12:36:03.018791+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:36:03.018791+0000","last_undegraded":"2024-03-30T12:36:03.018791+0000","last_fullsized":"2024-03-30T12:36:03.018791+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1336,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016373+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:36:03.016373+0000","last_peered":"2024-03-30T12:36:03.016373+0000","last_clean":"2024-03-30T12:36:03.016373+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:36:03.016373+0000","last_undegraded":"2024-03-30T12:36:03.016373+0000","last_fullsized":"2024-03-30T12:36:03.016373+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018870+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:36:03.018870+0000","last_peered":"2024-03-30T12:36:03.018870+0000","last_clean":"2024-03-30T12:36:03.018870+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:36:03.018870+0000","last_undegraded":"2024-03-30T12:36:03.018870+0000","last_fullsized":"2024-03-30T12:36:03.018870+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220120+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:36:03.220120+0000","last_peered":"2024-03-30T12:36:03.220120+0000","last_clean":"2024-03-30T12:36:03.220120+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:36:03.220120+0000","last_undegraded":"2024-03-30T12:36:03.220120+0000","last_fullsized":"2024-03-30T12:36:03.220120+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015273+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:36:03.015273+0000","last_peered":"2024-03-30T12:36:03.015273+0000","last_clean":"2024-03-30T12:36:03.015273+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:36:03.015273+0000","last_undegraded":"2024-03-30T12:36:03.015273+0000","last_fullsized":"2024-03-30T12:36:03.015273+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1237,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221900+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:36:03.221900+0000","last_peered":"2024-03-30T12:36:03.221900+0000","last_clean":"2024-03-30T12:36:03.221900+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:36:03.221900+0000","last_undegraded":"2024-03-30T12:36:03.221900+0000","last_fullsized":"2024-03-30T12:36:03.221900+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221038+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:36:03.221038+0000","last_peered":"2024-03-30T12:36:03.221038+0000","last_clean":"2024-03-30T12:36:03.221038+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:36:03.221038+0000","last_undegraded":"2024-03-30T12:36:03.221038+0000","last_fullsized":"2024-03-30T12:36:03.221038+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220172+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:36:03.220172+0000","last_peered":"2024-03-30T12:36:03.220172+0000","last_clean":"2024-03-30T12:36:03.220172+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:36:03.220172+0000","last_undegraded":"2024-03-30T12:36:03.220172+0000","last_fullsized":"2024-03-30T12:36:03.220172+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221004+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:36:03.221004+0000","last_peered":"2024-03-30T12:36:03.221004+0000","last_clean":"2024-03-30T12:36:03.221004+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:36:03.221004+0000","last_undegraded":"2024-03-30T12:36:03.221004+0000","last_fullsized":"2024-03-30T12:36:03.221004+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1176,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221139+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:36:03.221139+0000","last_peered":"2024-03-30T12:36:03.221139+0000","last_clean":"2024-03-30T12:36:03.221139+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:36:03.221139+0000","last_undegraded":"2024-03-30T12:36:03.221139+0000","last_fullsized":"2024-03-30T12:36:03.221139+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1280,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221301+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:36:03.221301+0000","last_peered":"2024-03-30T12:36:03.221301+0000","last_clean":"2024-03-30T12:36:03.221301+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:36:03.221301+0000","last_undegraded":"2024-03-30T12:36:03.221301+0000","last_fullsized":"2024-03-30T12:36:03.221301+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1237,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221506+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:36:03.221506+0000","last_peered":"2024-03-30T12:36:03.221506+0000","last_clean":"2024-03-30T12:36:03.221506+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:36:03.221506+0000","last_undegraded":"2024-03-30T12:36:03.221506+0000","last_fullsized":"2024-03-30T12:36:03.221506+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220227+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:03.220227+0000","last_peered":"2024-03-30T12:36:03.220227+0000","last_clean":"2024-03-30T12:36:03.220227+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:03.220227+0000","last_undegraded":"2024-03-30T12:36:03.220227+0000","last_fullsized":"2024-03-30T12:36:03.220227+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221549+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:36:03.221549+0000","last_peered":"2024-03-30T12:36:03.221549+0000","last_clean":"2024-03-30T12:36:03.221549+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:36:03.221549+0000","last_undegraded":"2024-03-30T12:36:03.221549+0000","last_fullsized":"2024-03-30T12:36:03.221549+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220884+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:36:03.220884+0000","last_peered":"2024-03-30T12:36:03.220884+0000","last_clean":"2024-03-30T12:36:03.220884+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:36:03.220884+0000","last_undegraded":"2024-03-30T12:36:03.220884+0000","last_fullsized":"2024-03-30T12:36:03.220884+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220599+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:36:03.220599+0000","last_peered":"2024-03-30T12:36:03.220599+0000","last_clean":"2024-03-30T12:36:03.220599+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:36:03.220599+0000","last_undegraded":"2024-03-30T12:36:03.220599+0000","last_fullsized":"2024-03-30T12:36:03.220599+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438032,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648088,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175098,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254337,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063156,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951213,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839270,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923552,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:37:00.037 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:00.037 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:00.037 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:00.037 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:00.037 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:00.038 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:00.038 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:00.038 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:00.038 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:00.038 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:00.038 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:00.038 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:00.038 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:00.038 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:37:00.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:59 smithi162 ceph-mon[83709]: from='client.44471 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:37:00.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:36:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:37:01.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:00 smithi084 ceph-mon[89279]: pgmap v1019: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:01.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:00 smithi084 ceph-mon[91810]: pgmap v1019: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:01.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:00 smithi162 ceph-mon[83709]: pgmap v1019: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:03.171 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:02 smithi162 ceph-mon[83709]: pgmap v1020: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:03.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:02 smithi084 ceph-mon[89279]: pgmap v1020: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:03.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:02 smithi084 ceph-mon[91810]: pgmap v1020: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:05.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:04 smithi084 ceph-mon[91810]: pgmap v1021: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:05.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:04 smithi084 ceph-mon[89279]: pgmap v1021: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:05.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:04 smithi162 ceph-mon[83709]: pgmap v1021: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:07.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:06 smithi084 ceph-mon[89279]: pgmap v1022: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:07.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:06 smithi084 ceph-mon[91810]: pgmap v1022: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:07.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:06 smithi162 ceph-mon[83709]: pgmap v1022: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:09.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:08 smithi084 ceph-mon[91810]: pgmap v1023: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:09.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:08 smithi084 ceph-mon[89279]: pgmap v1023: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:09.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:08 smithi162 ceph-mon[83709]: pgmap v1023: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:09.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:37:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:37:09] "GET /metrics HTTP/1.1" 200 36327 "" "Prometheus/2.43.0" 2024-03-30T12:37:10.039 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:37:10.260 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:37:11.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:10 smithi084 ceph-mon[89279]: pgmap v1024: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:11.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:10 smithi084 ceph-mon[91810]: pgmap v1024: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:11.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:10 smithi162 ceph-mon[83709]: pgmap v1024: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:12.027 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:37:12.029 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:37:12.761 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1024,"stamp":"2024-03-30T12:37:10.816941+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004036"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018672+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:36:03.018672+0000","last_peered":"2024-03-30T12:36:03.018672+0000","last_clean":"2024-03-30T12:36:03.018672+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:36:03.018672+0000","last_undegraded":"2024-03-30T12:36:03.018672+0000","last_fullsized":"2024-03-30T12:36:03.018672+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1362,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221591+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:36:03.221591+0000","last_peered":"2024-03-30T12:36:03.221591+0000","last_clean":"2024-03-30T12:36:03.221591+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:36:03.221591+0000","last_undegraded":"2024-03-30T12:36:03.221591+0000","last_fullsized":"2024-03-30T12:36:03.221591+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221207+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:36:03.221207+0000","last_peered":"2024-03-30T12:36:03.221207+0000","last_clean":"2024-03-30T12:36:03.221207+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:36:03.221207+0000","last_undegraded":"2024-03-30T12:36:03.221207+0000","last_fullsized":"2024-03-30T12:36:03.221207+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222119+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:36:03.222119+0000","last_peered":"2024-03-30T12:36:03.222119+0000","last_clean":"2024-03-30T12:36:03.222119+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:36:03.222119+0000","last_undegraded":"2024-03-30T12:36:03.222119+0000","last_fullsized":"2024-03-30T12:36:03.222119+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016806+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:36:03.016806+0000","last_peered":"2024-03-30T12:36:03.016806+0000","last_clean":"2024-03-30T12:36:03.016806+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:36:03.016806+0000","last_undegraded":"2024-03-30T12:36:03.016806+0000","last_fullsized":"2024-03-30T12:36:03.016806+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1209,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222566+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:03.222566+0000","last_peered":"2024-03-30T12:36:03.222566+0000","last_clean":"2024-03-30T12:36:03.222566+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:03.222566+0000","last_undegraded":"2024-03-30T12:36:03.222566+0000","last_fullsized":"2024-03-30T12:36:03.222566+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017295+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:36:03.017295+0000","last_peered":"2024-03-30T12:36:03.017295+0000","last_clean":"2024-03-30T12:36:03.017295+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:36:03.017295+0000","last_undegraded":"2024-03-30T12:36:03.017295+0000","last_fullsized":"2024-03-30T12:36:03.017295+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1257,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219724+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:36:03.219724+0000","last_peered":"2024-03-30T12:36:03.219724+0000","last_clean":"2024-03-30T12:36:03.219724+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:36:03.219724+0000","last_undegraded":"2024-03-30T12:36:03.219724+0000","last_fullsized":"2024-03-30T12:36:03.219724+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017862+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:36:03.017862+0000","last_peered":"2024-03-30T12:36:03.017862+0000","last_clean":"2024-03-30T12:36:03.017862+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:36:03.017862+0000","last_undegraded":"2024-03-30T12:36:03.017862+0000","last_fullsized":"2024-03-30T12:36:03.017862+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220774+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:03.220774+0000","last_peered":"2024-03-30T12:36:03.220774+0000","last_clean":"2024-03-30T12:36:03.220774+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:03.220774+0000","last_undegraded":"2024-03-30T12:36:03.220774+0000","last_fullsized":"2024-03-30T12:36:03.220774+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220468+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:03.220468+0000","last_peered":"2024-03-30T12:36:03.220468+0000","last_clean":"2024-03-30T12:36:03.220468+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:03.220468+0000","last_undegraded":"2024-03-30T12:36:03.220468+0000","last_fullsized":"2024-03-30T12:36:03.220468+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1269,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020196+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:36:03.020196+0000","last_peered":"2024-03-30T12:36:03.020196+0000","last_clean":"2024-03-30T12:36:03.020196+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:36:03.020196+0000","last_undegraded":"2024-03-30T12:36:03.020196+0000","last_fullsized":"2024-03-30T12:36:03.020196+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1287,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221647+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:36:03.221647+0000","last_peered":"2024-03-30T12:36:03.221647+0000","last_clean":"2024-03-30T12:36:03.221647+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:36:03.221647+0000","last_undegraded":"2024-03-30T12:36:03.221647+0000","last_fullsized":"2024-03-30T12:36:03.221647+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220445+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:36:03.220445+0000","last_peered":"2024-03-30T12:36:03.220445+0000","last_clean":"2024-03-30T12:36:03.220445+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:36:03.220445+0000","last_undegraded":"2024-03-30T12:36:03.220445+0000","last_fullsized":"2024-03-30T12:36:03.220445+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222534+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:36:03.222534+0000","last_peered":"2024-03-30T12:36:03.222534+0000","last_clean":"2024-03-30T12:36:03.222534+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:36:03.222534+0000","last_undegraded":"2024-03-30T12:36:03.222534+0000","last_fullsized":"2024-03-30T12:36:03.222534+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221410+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:36:03.221410+0000","last_peered":"2024-03-30T12:36:03.221410+0000","last_clean":"2024-03-30T12:36:03.221410+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:36:03.221410+0000","last_undegraded":"2024-03-30T12:36:03.221410+0000","last_fullsized":"2024-03-30T12:36:03.221410+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1223,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222946+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:36:03.222946+0000","last_peered":"2024-03-30T12:36:03.222946+0000","last_clean":"2024-03-30T12:36:03.222946+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:36:03.222946+0000","last_undegraded":"2024-03-30T12:36:03.222946+0000","last_fullsized":"2024-03-30T12:36:03.222946+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015999+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:36:03.015999+0000","last_peered":"2024-03-30T12:36:03.015999+0000","last_clean":"2024-03-30T12:36:03.015999+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:36:03.015999+0000","last_undegraded":"2024-03-30T12:36:03.015999+0000","last_fullsized":"2024-03-30T12:36:03.015999+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017955+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:36:03.017955+0000","last_peered":"2024-03-30T12:36:03.017955+0000","last_clean":"2024-03-30T12:36:03.017955+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:36:03.017955+0000","last_undegraded":"2024-03-30T12:36:03.017955+0000","last_fullsized":"2024-03-30T12:36:03.017955+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1387,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221082+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:36:03.221082+0000","last_peered":"2024-03-30T12:36:03.221082+0000","last_clean":"2024-03-30T12:36:03.221082+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:36:03.221082+0000","last_undegraded":"2024-03-30T12:36:03.221082+0000","last_fullsized":"2024-03-30T12:36:03.221082+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1281,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220779+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:36:03.220779+0000","last_peered":"2024-03-30T12:36:03.220779+0000","last_clean":"2024-03-30T12:36:03.220779+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:36:03.220779+0000","last_undegraded":"2024-03-30T12:36:03.220779+0000","last_fullsized":"2024-03-30T12:36:03.220779+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1300,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220968+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:36:03.220968+0000","last_peered":"2024-03-30T12:36:03.220968+0000","last_clean":"2024-03-30T12:36:03.220968+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:36:03.220968+0000","last_undegraded":"2024-03-30T12:36:03.220968+0000","last_fullsized":"2024-03-30T12:36:03.220968+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220378+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:36:03.220378+0000","last_peered":"2024-03-30T12:36:03.220378+0000","last_clean":"2024-03-30T12:36:03.220378+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:36:03.220378+0000","last_undegraded":"2024-03-30T12:36:03.220378+0000","last_fullsized":"2024-03-30T12:36:03.220378+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017887+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:36:03.017887+0000","last_peered":"2024-03-30T12:36:03.017887+0000","last_clean":"2024-03-30T12:36:03.017887+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:36:03.017887+0000","last_undegraded":"2024-03-30T12:36:03.017887+0000","last_fullsized":"2024-03-30T12:36:03.017887+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1228,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222708+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:03.222708+0000","last_peered":"2024-03-30T12:36:03.222708+0000","last_clean":"2024-03-30T12:36:03.222708+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:03.222708+0000","last_undegraded":"2024-03-30T12:36:03.222708+0000","last_fullsized":"2024-03-30T12:36:03.222708+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017639+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:36:03.017639+0000","last_peered":"2024-03-30T12:36:03.017639+0000","last_clean":"2024-03-30T12:36:03.017639+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:36:03.017639+0000","last_undegraded":"2024-03-30T12:36:03.017639+0000","last_fullsized":"2024-03-30T12:36:03.017639+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222301+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:03.222301+0000","last_peered":"2024-03-30T12:36:03.222301+0000","last_clean":"2024-03-30T12:36:03.222301+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:03.222301+0000","last_undegraded":"2024-03-30T12:36:03.222301+0000","last_fullsized":"2024-03-30T12:36:03.222301+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221804+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:36:03.221804+0000","last_peered":"2024-03-30T12:36:03.221804+0000","last_clean":"2024-03-30T12:36:03.221804+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:36:03.221804+0000","last_undegraded":"2024-03-30T12:36:03.221804+0000","last_fullsized":"2024-03-30T12:36:03.221804+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018855+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:36:03.018855+0000","last_peered":"2024-03-30T12:36:03.018855+0000","last_clean":"2024-03-30T12:36:03.018855+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:36:03.018855+0000","last_undegraded":"2024-03-30T12:36:03.018855+0000","last_fullsized":"2024-03-30T12:36:03.018855+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1179,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220575+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:36:03.220575+0000","last_peered":"2024-03-30T12:36:03.220575+0000","last_clean":"2024-03-30T12:36:03.220575+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:36:03.220575+0000","last_undegraded":"2024-03-30T12:36:03.220575+0000","last_fullsized":"2024-03-30T12:36:03.220575+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221577+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:36:03.221577+0000","last_peered":"2024-03-30T12:36:03.221577+0000","last_clean":"2024-03-30T12:36:03.221577+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:36:03.221577+0000","last_undegraded":"2024-03-30T12:36:03.221577+0000","last_fullsized":"2024-03-30T12:36:03.221577+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219793+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:36:03.219793+0000","last_peered":"2024-03-30T12:36:03.219793+0000","last_clean":"2024-03-30T12:36:03.219793+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:36:03.219793+0000","last_undegraded":"2024-03-30T12:36:03.219793+0000","last_fullsized":"2024-03-30T12:36:03.219793+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1293,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219776+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:36:03.219776+0000","last_peered":"2024-03-30T12:36:03.219776+0000","last_clean":"2024-03-30T12:36:03.219776+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:36:03.219776+0000","last_undegraded":"2024-03-30T12:36:03.219776+0000","last_fullsized":"2024-03-30T12:36:03.219776+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1223,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221769+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:36:03.221769+0000","last_peered":"2024-03-30T12:36:03.221769+0000","last_clean":"2024-03-30T12:36:03.221769+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:36:03.221769+0000","last_undegraded":"2024-03-30T12:36:03.221769+0000","last_fullsized":"2024-03-30T12:36:03.221769+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222968+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:36:03.222968+0000","last_peered":"2024-03-30T12:36:03.222968+0000","last_clean":"2024-03-30T12:36:03.222968+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:36:03.222968+0000","last_undegraded":"2024-03-30T12:36:03.222968+0000","last_fullsized":"2024-03-30T12:36:03.222968+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220821+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:03.220821+0000","last_peered":"2024-03-30T12:36:03.220821+0000","last_clean":"2024-03-30T12:36:03.220821+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:03.220821+0000","last_undegraded":"2024-03-30T12:36:03.220821+0000","last_fullsized":"2024-03-30T12:36:03.220821+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1203,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222317+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:36:03.222317+0000","last_peered":"2024-03-30T12:36:03.222317+0000","last_clean":"2024-03-30T12:36:03.222317+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:36:03.222317+0000","last_undegraded":"2024-03-30T12:36:03.222317+0000","last_fullsized":"2024-03-30T12:36:03.222317+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1197,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222067+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:36:03.222067+0000","last_peered":"2024-03-30T12:36:03.222067+0000","last_clean":"2024-03-30T12:36:03.222067+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:36:03.222067+0000","last_undegraded":"2024-03-30T12:36:03.222067+0000","last_fullsized":"2024-03-30T12:36:03.222067+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015739+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:36:03.015739+0000","last_peered":"2024-03-30T12:36:03.015739+0000","last_clean":"2024-03-30T12:36:03.015739+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:36:03.015739+0000","last_undegraded":"2024-03-30T12:36:03.015739+0000","last_fullsized":"2024-03-30T12:36:03.015739+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221275+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:36:03.221275+0000","last_peered":"2024-03-30T12:36:03.221275+0000","last_clean":"2024-03-30T12:36:03.221275+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:36:03.221275+0000","last_undegraded":"2024-03-30T12:36:03.221275+0000","last_fullsized":"2024-03-30T12:36:03.221275+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020038+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:36:03.020038+0000","last_peered":"2024-03-30T12:36:03.020038+0000","last_clean":"2024-03-30T12:36:03.020038+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:36:03.020038+0000","last_undegraded":"2024-03-30T12:36:03.020038+0000","last_fullsized":"2024-03-30T12:36:03.020038+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1204,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220837+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:36:03.220837+0000","last_peered":"2024-03-30T12:36:03.220837+0000","last_clean":"2024-03-30T12:36:03.220837+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:36:03.220837+0000","last_undegraded":"2024-03-30T12:36:03.220837+0000","last_fullsized":"2024-03-30T12:36:03.220837+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017379+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:36:03.017379+0000","last_peered":"2024-03-30T12:36:03.017379+0000","last_clean":"2024-03-30T12:36:03.017379+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:36:03.017379+0000","last_undegraded":"2024-03-30T12:36:03.017379+0000","last_fullsized":"2024-03-30T12:36:03.017379+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221717+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:36:03.221717+0000","last_peered":"2024-03-30T12:36:03.221717+0000","last_clean":"2024-03-30T12:36:03.221717+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:36:03.221717+0000","last_undegraded":"2024-03-30T12:36:03.221717+0000","last_fullsized":"2024-03-30T12:36:03.221717+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220742+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:36:03.220742+0000","last_peered":"2024-03-30T12:36:03.220742+0000","last_clean":"2024-03-30T12:36:03.220742+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:36:03.220742+0000","last_undegraded":"2024-03-30T12:36:03.220742+0000","last_fullsized":"2024-03-30T12:36:03.220742+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221904+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:36:03.221904+0000","last_peered":"2024-03-30T12:36:03.221904+0000","last_clean":"2024-03-30T12:36:03.221904+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:36:03.221904+0000","last_undegraded":"2024-03-30T12:36:03.221904+0000","last_fullsized":"2024-03-30T12:36:03.221904+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017448+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:36:03.017448+0000","last_peered":"2024-03-30T12:36:03.017448+0000","last_clean":"2024-03-30T12:36:03.017448+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:36:03.017448+0000","last_undegraded":"2024-03-30T12:36:03.017448+0000","last_fullsized":"2024-03-30T12:36:03.017448+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220253+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:36:03.220253+0000","last_peered":"2024-03-30T12:36:03.220253+0000","last_clean":"2024-03-30T12:36:03.220253+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:36:03.220253+0000","last_undegraded":"2024-03-30T12:36:03.220253+0000","last_fullsized":"2024-03-30T12:36:03.220253+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220192+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:36:03.220192+0000","last_peered":"2024-03-30T12:36:03.220192+0000","last_clean":"2024-03-30T12:36:03.220192+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:36:03.220192+0000","last_undegraded":"2024-03-30T12:36:03.220192+0000","last_fullsized":"2024-03-30T12:36:03.220192+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1343,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015636+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:36:03.015636+0000","last_peered":"2024-03-30T12:36:03.015636+0000","last_clean":"2024-03-30T12:36:03.015636+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:36:03.015636+0000","last_undegraded":"2024-03-30T12:36:03.015636+0000","last_fullsized":"2024-03-30T12:36:03.015636+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016564+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:36:03.016564+0000","last_peered":"2024-03-30T12:36:03.016564+0000","last_clean":"2024-03-30T12:36:03.016564+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:36:03.016564+0000","last_undegraded":"2024-03-30T12:36:03.016564+0000","last_fullsized":"2024-03-30T12:36:03.016564+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5751,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.016013+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:36:03.016013+0000","last_peered":"2024-03-30T12:36:03.016013+0000","last_clean":"2024-03-30T12:36:03.016013+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:36:03.016013+0000","last_undegraded":"2024-03-30T12:36:03.016013+0000","last_fullsized":"2024-03-30T12:36:03.016013+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020346+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:36:03.020346+0000","last_peered":"2024-03-30T12:36:03.020346+0000","last_clean":"2024-03-30T12:36:03.020346+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:36:03.020346+0000","last_undegraded":"2024-03-30T12:36:03.020346+0000","last_fullsized":"2024-03-30T12:36:03.020346+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018051+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:36:03.018051+0000","last_peered":"2024-03-30T12:36:03.018051+0000","last_clean":"2024-03-30T12:36:03.018051+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:36:03.018051+0000","last_undegraded":"2024-03-30T12:36:03.018051+0000","last_fullsized":"2024-03-30T12:36:03.018051+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5512,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.222067+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:36:03.222067+0000","last_peered":"2024-03-30T12:36:03.222067+0000","last_clean":"2024-03-30T12:36:03.222067+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:36:03.222067+0000","last_undegraded":"2024-03-30T12:36:03.222067+0000","last_fullsized":"2024-03-30T12:36:03.222067+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220564+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:36:03.220564+0000","last_peered":"2024-03-30T12:36:03.220564+0000","last_clean":"2024-03-30T12:36:03.220564+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:36:03.220564+0000","last_undegraded":"2024-03-30T12:36:03.220564+0000","last_fullsized":"2024-03-30T12:36:03.220564+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222416+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:36:03.222416+0000","last_peered":"2024-03-30T12:36:03.222416+0000","last_clean":"2024-03-30T12:36:03.222416+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:36:03.222416+0000","last_undegraded":"2024-03-30T12:36:03.222416+0000","last_fullsized":"2024-03-30T12:36:03.222416+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1237,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222091+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:36:03.222091+0000","last_peered":"2024-03-30T12:36:03.222091+0000","last_clean":"2024-03-30T12:36:03.222091+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:36:03.222091+0000","last_undegraded":"2024-03-30T12:36:03.222091+0000","last_fullsized":"2024-03-30T12:36:03.222091+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5457,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.222052+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:36:03.222052+0000","last_peered":"2024-03-30T12:36:03.222052+0000","last_clean":"2024-03-30T12:36:03.222052+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:36:03.222052+0000","last_undegraded":"2024-03-30T12:36:03.222052+0000","last_fullsized":"2024-03-30T12:36:03.222052+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222540+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:36:03.222540+0000","last_peered":"2024-03-30T12:36:03.222540+0000","last_clean":"2024-03-30T12:36:03.222540+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:36:03.222540+0000","last_undegraded":"2024-03-30T12:36:03.222540+0000","last_fullsized":"2024-03-30T12:36:03.222540+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221637+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:36:03.221637+0000","last_peered":"2024-03-30T12:36:03.221637+0000","last_clean":"2024-03-30T12:36:03.221637+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:36:03.221637+0000","last_undegraded":"2024-03-30T12:36:03.221637+0000","last_fullsized":"2024-03-30T12:36:03.221637+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1271,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019374+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:36:03.019374+0000","last_peered":"2024-03-30T12:36:03.019374+0000","last_clean":"2024-03-30T12:36:03.019374+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:36:03.019374+0000","last_undegraded":"2024-03-30T12:36:03.019374+0000","last_fullsized":"2024-03-30T12:36:03.019374+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3802,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016632+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:36:03.016632+0000","last_peered":"2024-03-30T12:36:03.016632+0000","last_clean":"2024-03-30T12:36:03.016632+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:36:03.016632+0000","last_undegraded":"2024-03-30T12:36:03.016632+0000","last_fullsized":"2024-03-30T12:36:03.016632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1341,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222936+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:36:03.222936+0000","last_peered":"2024-03-30T12:36:03.222936+0000","last_clean":"2024-03-30T12:36:03.222936+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:36:03.222936+0000","last_undegraded":"2024-03-30T12:36:03.222936+0000","last_fullsized":"2024-03-30T12:36:03.222936+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222036+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:36:03.222036+0000","last_peered":"2024-03-30T12:36:03.222036+0000","last_clean":"2024-03-30T12:36:03.222036+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:36:03.222036+0000","last_undegraded":"2024-03-30T12:36:03.222036+0000","last_fullsized":"2024-03-30T12:36:03.222036+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1330,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015172+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:36:03.015172+0000","last_peered":"2024-03-30T12:36:03.015172+0000","last_clean":"2024-03-30T12:36:03.015172+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:36:03.015172+0000","last_undegraded":"2024-03-30T12:36:03.015172+0000","last_fullsized":"2024-03-30T12:36:03.015172+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4575,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.019196+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:36:03.019196+0000","last_peered":"2024-03-30T12:36:03.019196+0000","last_clean":"2024-03-30T12:36:03.019196+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:36:03.019196+0000","last_undegraded":"2024-03-30T12:36:03.019196+0000","last_fullsized":"2024-03-30T12:36:03.019196+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1173,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220732+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:36:03.220732+0000","last_peered":"2024-03-30T12:36:03.220732+0000","last_clean":"2024-03-30T12:36:03.220732+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:36:03.220732+0000","last_undegraded":"2024-03-30T12:36:03.220732+0000","last_fullsized":"2024-03-30T12:36:03.220732+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221414+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:36:03.221414+0000","last_peered":"2024-03-30T12:36:03.221414+0000","last_clean":"2024-03-30T12:36:03.221414+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:36:03.221414+0000","last_undegraded":"2024-03-30T12:36:03.221414+0000","last_fullsized":"2024-03-30T12:36:03.221414+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1198,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221904+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:36:03.221904+0000","last_peered":"2024-03-30T12:36:03.221904+0000","last_clean":"2024-03-30T12:36:03.221904+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:36:03.221904+0000","last_undegraded":"2024-03-30T12:36:03.221904+0000","last_fullsized":"2024-03-30T12:36:03.221904+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1715,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016476+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:36:03.016476+0000","last_peered":"2024-03-30T12:36:03.016476+0000","last_clean":"2024-03-30T12:36:03.016476+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:36:03.016476+0000","last_undegraded":"2024-03-30T12:36:03.016476+0000","last_fullsized":"2024-03-30T12:36:03.016476+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24712,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223515+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:36:03.223515+0000","last_peered":"2024-03-30T12:36:03.223515+0000","last_clean":"2024-03-30T12:36:03.223515+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:36:03.223515+0000","last_undegraded":"2024-03-30T12:36:03.223515+0000","last_fullsized":"2024-03-30T12:36:03.223515+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220614+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:36:03.220614+0000","last_peered":"2024-03-30T12:36:03.220614+0000","last_clean":"2024-03-30T12:36:03.220614+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:36:03.220614+0000","last_undegraded":"2024-03-30T12:36:03.220614+0000","last_fullsized":"2024-03-30T12:36:03.220614+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220696+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:36:03.220696+0000","last_peered":"2024-03-30T12:36:03.220696+0000","last_clean":"2024-03-30T12:36:03.220696+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:36:03.220696+0000","last_undegraded":"2024-03-30T12:36:03.220696+0000","last_fullsized":"2024-03-30T12:36:03.220696+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1143,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016477+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:36:03.016477+0000","last_peered":"2024-03-30T12:36:03.016477+0000","last_clean":"2024-03-30T12:36:03.016477+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:36:03.016477+0000","last_undegraded":"2024-03-30T12:36:03.016477+0000","last_fullsized":"2024-03-30T12:36:03.016477+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16479,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.221375+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:36:03.221375+0000","last_peered":"2024-03-30T12:36:03.221375+0000","last_clean":"2024-03-30T12:36:03.221375+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:36:03.221375+0000","last_undegraded":"2024-03-30T12:36:03.221375+0000","last_fullsized":"2024-03-30T12:36:03.221375+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221448+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:36:03.221448+0000","last_peered":"2024-03-30T12:36:03.221448+0000","last_clean":"2024-03-30T12:36:03.221448+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:36:03.221448+0000","last_undegraded":"2024-03-30T12:36:03.221448+0000","last_fullsized":"2024-03-30T12:36:03.221448+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017748+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:36:03.017748+0000","last_peered":"2024-03-30T12:36:03.017748+0000","last_clean":"2024-03-30T12:36:03.017748+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:36:03.017748+0000","last_undegraded":"2024-03-30T12:36:03.017748+0000","last_fullsized":"2024-03-30T12:36:03.017748+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222632+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:36:03.222632+0000","last_peered":"2024-03-30T12:36:03.222632+0000","last_clean":"2024-03-30T12:36:03.222632+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:36:03.222632+0000","last_undegraded":"2024-03-30T12:36:03.222632+0000","last_fullsized":"2024-03-30T12:36:03.222632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31268,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.021096+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:36:03.021096+0000","last_peered":"2024-03-30T12:36:03.021096+0000","last_clean":"2024-03-30T12:36:03.021096+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:36:03.021096+0000","last_undegraded":"2024-03-30T12:36:03.021096+0000","last_fullsized":"2024-03-30T12:36:03.021096+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1293,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219877+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:36:03.219877+0000","last_peered":"2024-03-30T12:36:03.219877+0000","last_clean":"2024-03-30T12:36:03.219877+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:36:03.219877+0000","last_undegraded":"2024-03-30T12:36:03.219877+0000","last_fullsized":"2024-03-30T12:36:03.219877+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221685+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:36:03.221685+0000","last_peered":"2024-03-30T12:36:03.221685+0000","last_clean":"2024-03-30T12:36:03.221685+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:36:03.221685+0000","last_undegraded":"2024-03-30T12:36:03.221685+0000","last_fullsized":"2024-03-30T12:36:03.221685+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221129+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:36:03.221129+0000","last_peered":"2024-03-30T12:36:03.221129+0000","last_clean":"2024-03-30T12:36:03.221129+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:36:03.221129+0000","last_undegraded":"2024-03-30T12:36:03.221129+0000","last_fullsized":"2024-03-30T12:36:03.221129+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3763,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219946+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:36:03.219946+0000","last_peered":"2024-03-30T12:36:03.219946+0000","last_clean":"2024-03-30T12:36:03.219946+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:36:03.219946+0000","last_undegraded":"2024-03-30T12:36:03.219946+0000","last_fullsized":"2024-03-30T12:36:03.219946+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019149+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:36:03.019149+0000","last_peered":"2024-03-30T12:36:03.019149+0000","last_clean":"2024-03-30T12:36:03.019149+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:36:03.019149+0000","last_undegraded":"2024-03-30T12:36:03.019149+0000","last_fullsized":"2024-03-30T12:36:03.019149+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220680+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:36:03.220680+0000","last_peered":"2024-03-30T12:36:03.220680+0000","last_clean":"2024-03-30T12:36:03.220680+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:36:03.220680+0000","last_undegraded":"2024-03-30T12:36:03.220680+0000","last_fullsized":"2024-03-30T12:36:03.220680+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220354+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:36:03.220354+0000","last_peered":"2024-03-30T12:36:03.220354+0000","last_clean":"2024-03-30T12:36:03.220354+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:36:03.220354+0000","last_undegraded":"2024-03-30T12:36:03.220354+0000","last_fullsized":"2024-03-30T12:36:03.220354+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15592,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223226+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:36:03.223226+0000","last_peered":"2024-03-30T12:36:03.223226+0000","last_clean":"2024-03-30T12:36:03.223226+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:36:03.223226+0000","last_undegraded":"2024-03-30T12:36:03.223226+0000","last_fullsized":"2024-03-30T12:36:03.223226+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1142,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016783+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:36:03.016783+0000","last_peered":"2024-03-30T12:36:03.016783+0000","last_clean":"2024-03-30T12:36:03.016783+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:36:03.016783+0000","last_undegraded":"2024-03-30T12:36:03.016783+0000","last_fullsized":"2024-03-30T12:36:03.016783+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1256,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018912+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:36:03.018912+0000","last_peered":"2024-03-30T12:36:03.018912+0000","last_clean":"2024-03-30T12:36:03.018912+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:36:03.018912+0000","last_undegraded":"2024-03-30T12:36:03.018912+0000","last_fullsized":"2024-03-30T12:36:03.018912+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29018,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.020535+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:36:03.020535+0000","last_peered":"2024-03-30T12:36:03.020535+0000","last_clean":"2024-03-30T12:36:03.020535+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:36:03.020535+0000","last_undegraded":"2024-03-30T12:36:03.020535+0000","last_fullsized":"2024-03-30T12:36:03.020535+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222640+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:36:03.222640+0000","last_peered":"2024-03-30T12:36:03.222640+0000","last_clean":"2024-03-30T12:36:03.222640+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:36:03.222640+0000","last_undegraded":"2024-03-30T12:36:03.222640+0000","last_fullsized":"2024-03-30T12:36:03.222640+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220045+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:36:03.220045+0000","last_peered":"2024-03-30T12:36:03.220045+0000","last_clean":"2024-03-30T12:36:03.220045+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:36:03.220045+0000","last_undegraded":"2024-03-30T12:36:03.220045+0000","last_fullsized":"2024-03-30T12:36:03.220045+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5609,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.017229+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:36:03.017229+0000","last_peered":"2024-03-30T12:36:03.017229+0000","last_clean":"2024-03-30T12:36:03.017229+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:36:03.017229+0000","last_undegraded":"2024-03-30T12:36:03.017229+0000","last_fullsized":"2024-03-30T12:36:03.017229+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1363,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220405+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:36:03.220405+0000","last_peered":"2024-03-30T12:36:03.220405+0000","last_clean":"2024-03-30T12:36:03.220405+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:36:03.220405+0000","last_undegraded":"2024-03-30T12:36:03.220405+0000","last_fullsized":"2024-03-30T12:36:03.220405+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221588+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:03.221588+0000","last_peered":"2024-03-30T12:36:03.221588+0000","last_clean":"2024-03-30T12:36:03.221588+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:03.221588+0000","last_undegraded":"2024-03-30T12:36:03.221588+0000","last_fullsized":"2024-03-30T12:36:03.221588+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222830+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:36:03.222830+0000","last_peered":"2024-03-30T12:36:03.222830+0000","last_clean":"2024-03-30T12:36:03.222830+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:36:03.222830+0000","last_undegraded":"2024-03-30T12:36:03.222830+0000","last_fullsized":"2024-03-30T12:36:03.222830+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017355+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:36:03.017355+0000","last_peered":"2024-03-30T12:36:03.017355+0000","last_clean":"2024-03-30T12:36:03.017355+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:36:03.017355+0000","last_undegraded":"2024-03-30T12:36:03.017355+0000","last_fullsized":"2024-03-30T12:36:03.017355+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221062+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:36:03.221062+0000","last_peered":"2024-03-30T12:36:03.221062+0000","last_clean":"2024-03-30T12:36:03.221062+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:36:03.221062+0000","last_undegraded":"2024-03-30T12:36:03.221062+0000","last_fullsized":"2024-03-30T12:36:03.221062+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5252,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.017068+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:36:03.017068+0000","last_peered":"2024-03-30T12:36:03.017068+0000","last_clean":"2024-03-30T12:36:03.017068+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:36:03.017068+0000","last_undegraded":"2024-03-30T12:36:03.017068+0000","last_fullsized":"2024-03-30T12:36:03.017068+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1330,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016069+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:36:03.016069+0000","last_peered":"2024-03-30T12:36:03.016069+0000","last_clean":"2024-03-30T12:36:03.016069+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:36:03.016069+0000","last_undegraded":"2024-03-30T12:36:03.016069+0000","last_fullsized":"2024-03-30T12:36:03.016069+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017799+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:36:03.017799+0000","last_peered":"2024-03-30T12:36:03.017799+0000","last_clean":"2024-03-30T12:36:03.017799+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:36:03.017799+0000","last_undegraded":"2024-03-30T12:36:03.017799+0000","last_fullsized":"2024-03-30T12:36:03.017799+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4809,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.016990+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:36:03.016990+0000","last_peered":"2024-03-30T12:36:03.016990+0000","last_clean":"2024-03-30T12:36:03.016990+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:36:03.016990+0000","last_undegraded":"2024-03-30T12:36:03.016990+0000","last_fullsized":"2024-03-30T12:36:03.016990+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220902+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:36:03.220902+0000","last_peered":"2024-03-30T12:36:03.220902+0000","last_clean":"2024-03-30T12:36:03.220902+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:36:03.220902+0000","last_undegraded":"2024-03-30T12:36:03.220902+0000","last_fullsized":"2024-03-30T12:36:03.220902+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222557+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:36:03.222557+0000","last_peered":"2024-03-30T12:36:03.222557+0000","last_clean":"2024-03-30T12:36:03.222557+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:36:03.222557+0000","last_undegraded":"2024-03-30T12:36:03.222557+0000","last_fullsized":"2024-03-30T12:36:03.222557+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6742,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.018791+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:36:03.018791+0000","last_peered":"2024-03-30T12:36:03.018791+0000","last_clean":"2024-03-30T12:36:03.018791+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:36:03.018791+0000","last_undegraded":"2024-03-30T12:36:03.018791+0000","last_fullsized":"2024-03-30T12:36:03.018791+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1336,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016373+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:36:03.016373+0000","last_peered":"2024-03-30T12:36:03.016373+0000","last_clean":"2024-03-30T12:36:03.016373+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:36:03.016373+0000","last_undegraded":"2024-03-30T12:36:03.016373+0000","last_fullsized":"2024-03-30T12:36:03.016373+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018917+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:36:03.018917+0000","last_peered":"2024-03-30T12:36:03.018917+0000","last_clean":"2024-03-30T12:36:03.018917+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:36:03.018917+0000","last_undegraded":"2024-03-30T12:36:03.018917+0000","last_fullsized":"2024-03-30T12:36:03.018917+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220120+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:36:03.220120+0000","last_peered":"2024-03-30T12:36:03.220120+0000","last_clean":"2024-03-30T12:36:03.220120+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:36:03.220120+0000","last_undegraded":"2024-03-30T12:36:03.220120+0000","last_fullsized":"2024-03-30T12:36:03.220120+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015273+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:36:03.015273+0000","last_peered":"2024-03-30T12:36:03.015273+0000","last_clean":"2024-03-30T12:36:03.015273+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:36:03.015273+0000","last_undegraded":"2024-03-30T12:36:03.015273+0000","last_fullsized":"2024-03-30T12:36:03.015273+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1237,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221900+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:36:03.221900+0000","last_peered":"2024-03-30T12:36:03.221900+0000","last_clean":"2024-03-30T12:36:03.221900+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:36:03.221900+0000","last_undegraded":"2024-03-30T12:36:03.221900+0000","last_fullsized":"2024-03-30T12:36:03.221900+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221038+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:36:03.221038+0000","last_peered":"2024-03-30T12:36:03.221038+0000","last_clean":"2024-03-30T12:36:03.221038+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:36:03.221038+0000","last_undegraded":"2024-03-30T12:36:03.221038+0000","last_fullsized":"2024-03-30T12:36:03.221038+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220172+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:36:03.220172+0000","last_peered":"2024-03-30T12:36:03.220172+0000","last_clean":"2024-03-30T12:36:03.220172+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:36:03.220172+0000","last_undegraded":"2024-03-30T12:36:03.220172+0000","last_fullsized":"2024-03-30T12:36:03.220172+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221004+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:36:03.221004+0000","last_peered":"2024-03-30T12:36:03.221004+0000","last_clean":"2024-03-30T12:36:03.221004+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:36:03.221004+0000","last_undegraded":"2024-03-30T12:36:03.221004+0000","last_fullsized":"2024-03-30T12:36:03.221004+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1176,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221139+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:36:03.221139+0000","last_peered":"2024-03-30T12:36:03.221139+0000","last_clean":"2024-03-30T12:36:03.221139+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:36:03.221139+0000","last_undegraded":"2024-03-30T12:36:03.221139+0000","last_fullsized":"2024-03-30T12:36:03.221139+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1280,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221301+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:36:03.221301+0000","last_peered":"2024-03-30T12:36:03.221301+0000","last_clean":"2024-03-30T12:36:03.221301+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:36:03.221301+0000","last_undegraded":"2024-03-30T12:36:03.221301+0000","last_fullsized":"2024-03-30T12:36:03.221301+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1237,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221506+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:36:03.221506+0000","last_peered":"2024-03-30T12:36:03.221506+0000","last_clean":"2024-03-30T12:36:03.221506+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:36:03.221506+0000","last_undegraded":"2024-03-30T12:36:03.221506+0000","last_fullsized":"2024-03-30T12:36:03.221506+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220227+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:03.220227+0000","last_peered":"2024-03-30T12:36:03.220227+0000","last_clean":"2024-03-30T12:36:03.220227+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:03.220227+0000","last_undegraded":"2024-03-30T12:36:03.220227+0000","last_fullsized":"2024-03-30T12:36:03.220227+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221549+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:36:03.221549+0000","last_peered":"2024-03-30T12:36:03.221549+0000","last_clean":"2024-03-30T12:36:03.221549+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:36:03.221549+0000","last_undegraded":"2024-03-30T12:36:03.221549+0000","last_fullsized":"2024-03-30T12:36:03.221549+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220884+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:36:03.220884+0000","last_peered":"2024-03-30T12:36:03.220884+0000","last_clean":"2024-03-30T12:36:03.220884+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:36:03.220884+0000","last_undegraded":"2024-03-30T12:36:03.220884+0000","last_fullsized":"2024-03-30T12:36:03.220884+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220599+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:36:03.220599+0000","last_peered":"2024-03-30T12:36:03.220599+0000","last_clean":"2024-03-30T12:36:03.220599+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:36:03.220599+0000","last_undegraded":"2024-03-30T12:36:03.220599+0000","last_fullsized":"2024-03-30T12:36:03.220599+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438035,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648091,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175101,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254339,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063158,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951215,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839272,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923555,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:37:12.771 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:12.771 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:12.771 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:12.771 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:12.771 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:12.772 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:12.772 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:12.772 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:12.772 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:12.772 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:12.772 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:12.773 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:12.773 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:12.773 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:37:13.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:12 smithi084 ceph-mon[91810]: from='client.44477 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:37:13.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:12 smithi084 ceph-mon[91810]: pgmap v1025: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:13.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:12 smithi084 ceph-mon[89279]: from='client.44477 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:37:13.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:12 smithi084 ceph-mon[89279]: pgmap v1025: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:13.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:12 smithi162 ceph-mon[83709]: from='client.44477 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:37:13.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:12 smithi162 ceph-mon[83709]: pgmap v1025: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:15.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:14 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:37:15.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:14 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:37:15.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:14 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:37:16.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:15 smithi162 ceph-mon[83709]: pgmap v1026: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:16.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:15 smithi084 ceph-mon[91810]: pgmap v1026: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:16.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:15 smithi084 ceph-mon[89279]: pgmap v1026: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:17.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:16 smithi084 ceph-mon[91810]: pgmap v1027: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:17.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:16 smithi084 ceph-mon[89279]: pgmap v1027: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:17.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:16 smithi162 ceph-mon[83709]: pgmap v1027: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:19.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:18 smithi084 ceph-mon[91810]: pgmap v1028: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:19.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:18 smithi084 ceph-mon[89279]: pgmap v1028: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:19.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:18 smithi162 ceph-mon[83709]: pgmap v1028: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:19.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:37:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:37:19] "GET /metrics HTTP/1.1" 200 36327 "" "Prometheus/2.43.0" 2024-03-30T12:37:21.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:20 smithi084 ceph-mon[89279]: pgmap v1029: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:21.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:20 smithi084 ceph-mon[91810]: pgmap v1029: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:21.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:20 smithi162 ceph-mon[83709]: pgmap v1029: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:22.774 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:37:22.996 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:37:23.114 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:22 smithi084 ceph-mon[91810]: pgmap v1030: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:23.114 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:22 smithi084 ceph-mon[89279]: pgmap v1030: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:23.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:22 smithi162 ceph-mon[83709]: pgmap v1030: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:24.842 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:37:24.845 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:37:25.159 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:24 smithi084 ceph-mon[91810]: pgmap v1031: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:25.160 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:24 smithi084 ceph-mon[89279]: pgmap v1031: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:25.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:24 smithi162 ceph-mon[83709]: pgmap v1031: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:25.538 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1031,"stamp":"2024-03-30T12:37:24.821422+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003896"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018672+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:36:03.018672+0000","last_peered":"2024-03-30T12:36:03.018672+0000","last_clean":"2024-03-30T12:36:03.018672+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:36:03.018672+0000","last_undegraded":"2024-03-30T12:36:03.018672+0000","last_fullsized":"2024-03-30T12:36:03.018672+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1363,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221634+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:36:03.221634+0000","last_peered":"2024-03-30T12:36:03.221634+0000","last_clean":"2024-03-30T12:36:03.221634+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:36:03.221634+0000","last_undegraded":"2024-03-30T12:36:03.221634+0000","last_fullsized":"2024-03-30T12:36:03.221634+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221207+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:36:03.221207+0000","last_peered":"2024-03-30T12:36:03.221207+0000","last_clean":"2024-03-30T12:36:03.221207+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:36:03.221207+0000","last_undegraded":"2024-03-30T12:36:03.221207+0000","last_fullsized":"2024-03-30T12:36:03.221207+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222119+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:36:03.222119+0000","last_peered":"2024-03-30T12:36:03.222119+0000","last_clean":"2024-03-30T12:36:03.222119+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:36:03.222119+0000","last_undegraded":"2024-03-30T12:36:03.222119+0000","last_fullsized":"2024-03-30T12:36:03.222119+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016806+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:36:03.016806+0000","last_peered":"2024-03-30T12:36:03.016806+0000","last_clean":"2024-03-30T12:36:03.016806+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:36:03.016806+0000","last_undegraded":"2024-03-30T12:36:03.016806+0000","last_fullsized":"2024-03-30T12:36:03.016806+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1209,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222566+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:03.222566+0000","last_peered":"2024-03-30T12:36:03.222566+0000","last_clean":"2024-03-30T12:36:03.222566+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:03.222566+0000","last_undegraded":"2024-03-30T12:36:03.222566+0000","last_fullsized":"2024-03-30T12:36:03.222566+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017295+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:36:03.017295+0000","last_peered":"2024-03-30T12:36:03.017295+0000","last_clean":"2024-03-30T12:36:03.017295+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:36:03.017295+0000","last_undegraded":"2024-03-30T12:36:03.017295+0000","last_fullsized":"2024-03-30T12:36:03.017295+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1257,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219724+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:36:03.219724+0000","last_peered":"2024-03-30T12:36:03.219724+0000","last_clean":"2024-03-30T12:36:03.219724+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:36:03.219724+0000","last_undegraded":"2024-03-30T12:36:03.219724+0000","last_fullsized":"2024-03-30T12:36:03.219724+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017862+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:36:03.017862+0000","last_peered":"2024-03-30T12:36:03.017862+0000","last_clean":"2024-03-30T12:36:03.017862+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:36:03.017862+0000","last_undegraded":"2024-03-30T12:36:03.017862+0000","last_fullsized":"2024-03-30T12:36:03.017862+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220774+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:03.220774+0000","last_peered":"2024-03-30T12:36:03.220774+0000","last_clean":"2024-03-30T12:36:03.220774+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:03.220774+0000","last_undegraded":"2024-03-30T12:36:03.220774+0000","last_fullsized":"2024-03-30T12:36:03.220774+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220468+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:03.220468+0000","last_peered":"2024-03-30T12:36:03.220468+0000","last_clean":"2024-03-30T12:36:03.220468+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:03.220468+0000","last_undegraded":"2024-03-30T12:36:03.220468+0000","last_fullsized":"2024-03-30T12:36:03.220468+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1269,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020196+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:36:03.020196+0000","last_peered":"2024-03-30T12:36:03.020196+0000","last_clean":"2024-03-30T12:36:03.020196+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:36:03.020196+0000","last_undegraded":"2024-03-30T12:36:03.020196+0000","last_fullsized":"2024-03-30T12:36:03.020196+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1287,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221647+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:36:03.221647+0000","last_peered":"2024-03-30T12:36:03.221647+0000","last_clean":"2024-03-30T12:36:03.221647+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:36:03.221647+0000","last_undegraded":"2024-03-30T12:36:03.221647+0000","last_fullsized":"2024-03-30T12:36:03.221647+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220445+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:36:03.220445+0000","last_peered":"2024-03-30T12:36:03.220445+0000","last_clean":"2024-03-30T12:36:03.220445+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:36:03.220445+0000","last_undegraded":"2024-03-30T12:36:03.220445+0000","last_fullsized":"2024-03-30T12:36:03.220445+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222534+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:36:03.222534+0000","last_peered":"2024-03-30T12:36:03.222534+0000","last_clean":"2024-03-30T12:36:03.222534+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:36:03.222534+0000","last_undegraded":"2024-03-30T12:36:03.222534+0000","last_fullsized":"2024-03-30T12:36:03.222534+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221410+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:36:03.221410+0000","last_peered":"2024-03-30T12:36:03.221410+0000","last_clean":"2024-03-30T12:36:03.221410+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:36:03.221410+0000","last_undegraded":"2024-03-30T12:36:03.221410+0000","last_fullsized":"2024-03-30T12:36:03.221410+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1223,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222946+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:36:03.222946+0000","last_peered":"2024-03-30T12:36:03.222946+0000","last_clean":"2024-03-30T12:36:03.222946+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:36:03.222946+0000","last_undegraded":"2024-03-30T12:36:03.222946+0000","last_fullsized":"2024-03-30T12:36:03.222946+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015999+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:36:03.015999+0000","last_peered":"2024-03-30T12:36:03.015999+0000","last_clean":"2024-03-30T12:36:03.015999+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:36:03.015999+0000","last_undegraded":"2024-03-30T12:36:03.015999+0000","last_fullsized":"2024-03-30T12:36:03.015999+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017955+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:36:03.017955+0000","last_peered":"2024-03-30T12:36:03.017955+0000","last_clean":"2024-03-30T12:36:03.017955+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:36:03.017955+0000","last_undegraded":"2024-03-30T12:36:03.017955+0000","last_fullsized":"2024-03-30T12:36:03.017955+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1387,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221082+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:36:03.221082+0000","last_peered":"2024-03-30T12:36:03.221082+0000","last_clean":"2024-03-30T12:36:03.221082+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:36:03.221082+0000","last_undegraded":"2024-03-30T12:36:03.221082+0000","last_fullsized":"2024-03-30T12:36:03.221082+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1281,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220779+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:36:03.220779+0000","last_peered":"2024-03-30T12:36:03.220779+0000","last_clean":"2024-03-30T12:36:03.220779+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:36:03.220779+0000","last_undegraded":"2024-03-30T12:36:03.220779+0000","last_fullsized":"2024-03-30T12:36:03.220779+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1300,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220968+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:36:03.220968+0000","last_peered":"2024-03-30T12:36:03.220968+0000","last_clean":"2024-03-30T12:36:03.220968+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:36:03.220968+0000","last_undegraded":"2024-03-30T12:36:03.220968+0000","last_fullsized":"2024-03-30T12:36:03.220968+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220378+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:36:03.220378+0000","last_peered":"2024-03-30T12:36:03.220378+0000","last_clean":"2024-03-30T12:36:03.220378+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:36:03.220378+0000","last_undegraded":"2024-03-30T12:36:03.220378+0000","last_fullsized":"2024-03-30T12:36:03.220378+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017887+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:36:03.017887+0000","last_peered":"2024-03-30T12:36:03.017887+0000","last_clean":"2024-03-30T12:36:03.017887+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:36:03.017887+0000","last_undegraded":"2024-03-30T12:36:03.017887+0000","last_fullsized":"2024-03-30T12:36:03.017887+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1228,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222708+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:03.222708+0000","last_peered":"2024-03-30T12:36:03.222708+0000","last_clean":"2024-03-30T12:36:03.222708+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:03.222708+0000","last_undegraded":"2024-03-30T12:36:03.222708+0000","last_fullsized":"2024-03-30T12:36:03.222708+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017639+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:36:03.017639+0000","last_peered":"2024-03-30T12:36:03.017639+0000","last_clean":"2024-03-30T12:36:03.017639+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:36:03.017639+0000","last_undegraded":"2024-03-30T12:36:03.017639+0000","last_fullsized":"2024-03-30T12:36:03.017639+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222301+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:03.222301+0000","last_peered":"2024-03-30T12:36:03.222301+0000","last_clean":"2024-03-30T12:36:03.222301+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:03.222301+0000","last_undegraded":"2024-03-30T12:36:03.222301+0000","last_fullsized":"2024-03-30T12:36:03.222301+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221804+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:36:03.221804+0000","last_peered":"2024-03-30T12:36:03.221804+0000","last_clean":"2024-03-30T12:36:03.221804+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:36:03.221804+0000","last_undegraded":"2024-03-30T12:36:03.221804+0000","last_fullsized":"2024-03-30T12:36:03.221804+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018855+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:36:03.018855+0000","last_peered":"2024-03-30T12:36:03.018855+0000","last_clean":"2024-03-30T12:36:03.018855+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:36:03.018855+0000","last_undegraded":"2024-03-30T12:36:03.018855+0000","last_fullsized":"2024-03-30T12:36:03.018855+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1179,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220575+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:36:03.220575+0000","last_peered":"2024-03-30T12:36:03.220575+0000","last_clean":"2024-03-30T12:36:03.220575+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:36:03.220575+0000","last_undegraded":"2024-03-30T12:36:03.220575+0000","last_fullsized":"2024-03-30T12:36:03.220575+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221577+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:36:03.221577+0000","last_peered":"2024-03-30T12:36:03.221577+0000","last_clean":"2024-03-30T12:36:03.221577+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:36:03.221577+0000","last_undegraded":"2024-03-30T12:36:03.221577+0000","last_fullsized":"2024-03-30T12:36:03.221577+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219793+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:36:03.219793+0000","last_peered":"2024-03-30T12:36:03.219793+0000","last_clean":"2024-03-30T12:36:03.219793+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:36:03.219793+0000","last_undegraded":"2024-03-30T12:36:03.219793+0000","last_fullsized":"2024-03-30T12:36:03.219793+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1293,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219776+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:36:03.219776+0000","last_peered":"2024-03-30T12:36:03.219776+0000","last_clean":"2024-03-30T12:36:03.219776+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:36:03.219776+0000","last_undegraded":"2024-03-30T12:36:03.219776+0000","last_fullsized":"2024-03-30T12:36:03.219776+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1223,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221769+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:36:03.221769+0000","last_peered":"2024-03-30T12:36:03.221769+0000","last_clean":"2024-03-30T12:36:03.221769+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:36:03.221769+0000","last_undegraded":"2024-03-30T12:36:03.221769+0000","last_fullsized":"2024-03-30T12:36:03.221769+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222968+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:36:03.222968+0000","last_peered":"2024-03-30T12:36:03.222968+0000","last_clean":"2024-03-30T12:36:03.222968+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:36:03.222968+0000","last_undegraded":"2024-03-30T12:36:03.222968+0000","last_fullsized":"2024-03-30T12:36:03.222968+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220821+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:03.220821+0000","last_peered":"2024-03-30T12:36:03.220821+0000","last_clean":"2024-03-30T12:36:03.220821+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:03.220821+0000","last_undegraded":"2024-03-30T12:36:03.220821+0000","last_fullsized":"2024-03-30T12:36:03.220821+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1203,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222317+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:36:03.222317+0000","last_peered":"2024-03-30T12:36:03.222317+0000","last_clean":"2024-03-30T12:36:03.222317+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:36:03.222317+0000","last_undegraded":"2024-03-30T12:36:03.222317+0000","last_fullsized":"2024-03-30T12:36:03.222317+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1197,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222067+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:36:03.222067+0000","last_peered":"2024-03-30T12:36:03.222067+0000","last_clean":"2024-03-30T12:36:03.222067+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:36:03.222067+0000","last_undegraded":"2024-03-30T12:36:03.222067+0000","last_fullsized":"2024-03-30T12:36:03.222067+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015739+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:36:03.015739+0000","last_peered":"2024-03-30T12:36:03.015739+0000","last_clean":"2024-03-30T12:36:03.015739+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:36:03.015739+0000","last_undegraded":"2024-03-30T12:36:03.015739+0000","last_fullsized":"2024-03-30T12:36:03.015739+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221275+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:36:03.221275+0000","last_peered":"2024-03-30T12:36:03.221275+0000","last_clean":"2024-03-30T12:36:03.221275+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:36:03.221275+0000","last_undegraded":"2024-03-30T12:36:03.221275+0000","last_fullsized":"2024-03-30T12:36:03.221275+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020038+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:36:03.020038+0000","last_peered":"2024-03-30T12:36:03.020038+0000","last_clean":"2024-03-30T12:36:03.020038+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:36:03.020038+0000","last_undegraded":"2024-03-30T12:36:03.020038+0000","last_fullsized":"2024-03-30T12:36:03.020038+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1204,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220837+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:36:03.220837+0000","last_peered":"2024-03-30T12:36:03.220837+0000","last_clean":"2024-03-30T12:36:03.220837+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:36:03.220837+0000","last_undegraded":"2024-03-30T12:36:03.220837+0000","last_fullsized":"2024-03-30T12:36:03.220837+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017379+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:36:03.017379+0000","last_peered":"2024-03-30T12:36:03.017379+0000","last_clean":"2024-03-30T12:36:03.017379+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:36:03.017379+0000","last_undegraded":"2024-03-30T12:36:03.017379+0000","last_fullsized":"2024-03-30T12:36:03.017379+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221717+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:36:03.221717+0000","last_peered":"2024-03-30T12:36:03.221717+0000","last_clean":"2024-03-30T12:36:03.221717+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:36:03.221717+0000","last_undegraded":"2024-03-30T12:36:03.221717+0000","last_fullsized":"2024-03-30T12:36:03.221717+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220742+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:36:03.220742+0000","last_peered":"2024-03-30T12:36:03.220742+0000","last_clean":"2024-03-30T12:36:03.220742+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:36:03.220742+0000","last_undegraded":"2024-03-30T12:36:03.220742+0000","last_fullsized":"2024-03-30T12:36:03.220742+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221904+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:36:03.221904+0000","last_peered":"2024-03-30T12:36:03.221904+0000","last_clean":"2024-03-30T12:36:03.221904+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:36:03.221904+0000","last_undegraded":"2024-03-30T12:36:03.221904+0000","last_fullsized":"2024-03-30T12:36:03.221904+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017508+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:36:03.017508+0000","last_peered":"2024-03-30T12:36:03.017508+0000","last_clean":"2024-03-30T12:36:03.017508+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:36:03.017508+0000","last_undegraded":"2024-03-30T12:36:03.017508+0000","last_fullsized":"2024-03-30T12:36:03.017508+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220253+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:36:03.220253+0000","last_peered":"2024-03-30T12:36:03.220253+0000","last_clean":"2024-03-30T12:36:03.220253+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:36:03.220253+0000","last_undegraded":"2024-03-30T12:36:03.220253+0000","last_fullsized":"2024-03-30T12:36:03.220253+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220192+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:36:03.220192+0000","last_peered":"2024-03-30T12:36:03.220192+0000","last_clean":"2024-03-30T12:36:03.220192+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:36:03.220192+0000","last_undegraded":"2024-03-30T12:36:03.220192+0000","last_fullsized":"2024-03-30T12:36:03.220192+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1343,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015636+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:36:03.015636+0000","last_peered":"2024-03-30T12:36:03.015636+0000","last_clean":"2024-03-30T12:36:03.015636+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:36:03.015636+0000","last_undegraded":"2024-03-30T12:36:03.015636+0000","last_fullsized":"2024-03-30T12:36:03.015636+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016619+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:36:03.016619+0000","last_peered":"2024-03-30T12:36:03.016619+0000","last_clean":"2024-03-30T12:36:03.016619+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:36:03.016619+0000","last_undegraded":"2024-03-30T12:36:03.016619+0000","last_fullsized":"2024-03-30T12:36:03.016619+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5751,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.016013+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:36:03.016013+0000","last_peered":"2024-03-30T12:36:03.016013+0000","last_clean":"2024-03-30T12:36:03.016013+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:36:03.016013+0000","last_undegraded":"2024-03-30T12:36:03.016013+0000","last_fullsized":"2024-03-30T12:36:03.016013+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020346+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:36:03.020346+0000","last_peered":"2024-03-30T12:36:03.020346+0000","last_clean":"2024-03-30T12:36:03.020346+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:36:03.020346+0000","last_undegraded":"2024-03-30T12:36:03.020346+0000","last_fullsized":"2024-03-30T12:36:03.020346+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018051+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:36:03.018051+0000","last_peered":"2024-03-30T12:36:03.018051+0000","last_clean":"2024-03-30T12:36:03.018051+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:36:03.018051+0000","last_undegraded":"2024-03-30T12:36:03.018051+0000","last_fullsized":"2024-03-30T12:36:03.018051+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5512,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.222067+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:36:03.222067+0000","last_peered":"2024-03-30T12:36:03.222067+0000","last_clean":"2024-03-30T12:36:03.222067+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:36:03.222067+0000","last_undegraded":"2024-03-30T12:36:03.222067+0000","last_fullsized":"2024-03-30T12:36:03.222067+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220604+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:36:03.220604+0000","last_peered":"2024-03-30T12:36:03.220604+0000","last_clean":"2024-03-30T12:36:03.220604+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:36:03.220604+0000","last_undegraded":"2024-03-30T12:36:03.220604+0000","last_fullsized":"2024-03-30T12:36:03.220604+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1346,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222463+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:36:03.222463+0000","last_peered":"2024-03-30T12:36:03.222463+0000","last_clean":"2024-03-30T12:36:03.222463+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:36:03.222463+0000","last_undegraded":"2024-03-30T12:36:03.222463+0000","last_fullsized":"2024-03-30T12:36:03.222463+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222511+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:36:03.222511+0000","last_peered":"2024-03-30T12:36:03.222511+0000","last_clean":"2024-03-30T12:36:03.222511+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:36:03.222511+0000","last_undegraded":"2024-03-30T12:36:03.222511+0000","last_fullsized":"2024-03-30T12:36:03.222511+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5457,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.222052+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:36:03.222052+0000","last_peered":"2024-03-30T12:36:03.222052+0000","last_clean":"2024-03-30T12:36:03.222052+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:36:03.222052+0000","last_undegraded":"2024-03-30T12:36:03.222052+0000","last_fullsized":"2024-03-30T12:36:03.222052+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222581+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:36:03.222581+0000","last_peered":"2024-03-30T12:36:03.222581+0000","last_clean":"2024-03-30T12:36:03.222581+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:36:03.222581+0000","last_undegraded":"2024-03-30T12:36:03.222581+0000","last_fullsized":"2024-03-30T12:36:03.222581+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221692+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:36:03.221692+0000","last_peered":"2024-03-30T12:36:03.221692+0000","last_clean":"2024-03-30T12:36:03.221692+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:36:03.221692+0000","last_undegraded":"2024-03-30T12:36:03.221692+0000","last_fullsized":"2024-03-30T12:36:03.221692+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1271,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019374+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:36:03.019374+0000","last_peered":"2024-03-30T12:36:03.019374+0000","last_clean":"2024-03-30T12:36:03.019374+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:36:03.019374+0000","last_undegraded":"2024-03-30T12:36:03.019374+0000","last_fullsized":"2024-03-30T12:36:03.019374+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3802,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016632+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:36:03.016632+0000","last_peered":"2024-03-30T12:36:03.016632+0000","last_clean":"2024-03-30T12:36:03.016632+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:36:03.016632+0000","last_undegraded":"2024-03-30T12:36:03.016632+0000","last_fullsized":"2024-03-30T12:36:03.016632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1341,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222936+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:36:03.222936+0000","last_peered":"2024-03-30T12:36:03.222936+0000","last_clean":"2024-03-30T12:36:03.222936+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:36:03.222936+0000","last_undegraded":"2024-03-30T12:36:03.222936+0000","last_fullsized":"2024-03-30T12:36:03.222936+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222036+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:36:03.222036+0000","last_peered":"2024-03-30T12:36:03.222036+0000","last_clean":"2024-03-30T12:36:03.222036+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:36:03.222036+0000","last_undegraded":"2024-03-30T12:36:03.222036+0000","last_fullsized":"2024-03-30T12:36:03.222036+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1330,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015172+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:36:03.015172+0000","last_peered":"2024-03-30T12:36:03.015172+0000","last_clean":"2024-03-30T12:36:03.015172+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:36:03.015172+0000","last_undegraded":"2024-03-30T12:36:03.015172+0000","last_fullsized":"2024-03-30T12:36:03.015172+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4575,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.019196+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:36:03.019196+0000","last_peered":"2024-03-30T12:36:03.019196+0000","last_clean":"2024-03-30T12:36:03.019196+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:36:03.019196+0000","last_undegraded":"2024-03-30T12:36:03.019196+0000","last_fullsized":"2024-03-30T12:36:03.019196+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1173,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220732+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:36:03.220732+0000","last_peered":"2024-03-30T12:36:03.220732+0000","last_clean":"2024-03-30T12:36:03.220732+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:36:03.220732+0000","last_undegraded":"2024-03-30T12:36:03.220732+0000","last_fullsized":"2024-03-30T12:36:03.220732+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221414+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:36:03.221414+0000","last_peered":"2024-03-30T12:36:03.221414+0000","last_clean":"2024-03-30T12:36:03.221414+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:36:03.221414+0000","last_undegraded":"2024-03-30T12:36:03.221414+0000","last_fullsized":"2024-03-30T12:36:03.221414+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1199,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222181+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:36:03.222181+0000","last_peered":"2024-03-30T12:36:03.222181+0000","last_clean":"2024-03-30T12:36:03.222181+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:36:03.222181+0000","last_undegraded":"2024-03-30T12:36:03.222181+0000","last_fullsized":"2024-03-30T12:36:03.222181+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1715,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016476+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:36:03.016476+0000","last_peered":"2024-03-30T12:36:03.016476+0000","last_clean":"2024-03-30T12:36:03.016476+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:36:03.016476+0000","last_undegraded":"2024-03-30T12:36:03.016476+0000","last_fullsized":"2024-03-30T12:36:03.016476+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24712,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223515+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:36:03.223515+0000","last_peered":"2024-03-30T12:36:03.223515+0000","last_clean":"2024-03-30T12:36:03.223515+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:36:03.223515+0000","last_undegraded":"2024-03-30T12:36:03.223515+0000","last_fullsized":"2024-03-30T12:36:03.223515+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220614+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:36:03.220614+0000","last_peered":"2024-03-30T12:36:03.220614+0000","last_clean":"2024-03-30T12:36:03.220614+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:36:03.220614+0000","last_undegraded":"2024-03-30T12:36:03.220614+0000","last_fullsized":"2024-03-30T12:36:03.220614+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220696+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:36:03.220696+0000","last_peered":"2024-03-30T12:36:03.220696+0000","last_clean":"2024-03-30T12:36:03.220696+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:36:03.220696+0000","last_undegraded":"2024-03-30T12:36:03.220696+0000","last_fullsized":"2024-03-30T12:36:03.220696+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1143,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016477+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:36:03.016477+0000","last_peered":"2024-03-30T12:36:03.016477+0000","last_clean":"2024-03-30T12:36:03.016477+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:36:03.016477+0000","last_undegraded":"2024-03-30T12:36:03.016477+0000","last_fullsized":"2024-03-30T12:36:03.016477+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16479,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.221375+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:36:03.221375+0000","last_peered":"2024-03-30T12:36:03.221375+0000","last_clean":"2024-03-30T12:36:03.221375+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:36:03.221375+0000","last_undegraded":"2024-03-30T12:36:03.221375+0000","last_fullsized":"2024-03-30T12:36:03.221375+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221448+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:36:03.221448+0000","last_peered":"2024-03-30T12:36:03.221448+0000","last_clean":"2024-03-30T12:36:03.221448+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:36:03.221448+0000","last_undegraded":"2024-03-30T12:36:03.221448+0000","last_fullsized":"2024-03-30T12:36:03.221448+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017748+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:36:03.017748+0000","last_peered":"2024-03-30T12:36:03.017748+0000","last_clean":"2024-03-30T12:36:03.017748+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:36:03.017748+0000","last_undegraded":"2024-03-30T12:36:03.017748+0000","last_fullsized":"2024-03-30T12:36:03.017748+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222675+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:36:03.222675+0000","last_peered":"2024-03-30T12:36:03.222675+0000","last_clean":"2024-03-30T12:36:03.222675+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:36:03.222675+0000","last_undegraded":"2024-03-30T12:36:03.222675+0000","last_fullsized":"2024-03-30T12:36:03.222675+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31268,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.021096+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:36:03.021096+0000","last_peered":"2024-03-30T12:36:03.021096+0000","last_clean":"2024-03-30T12:36:03.021096+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:36:03.021096+0000","last_undegraded":"2024-03-30T12:36:03.021096+0000","last_fullsized":"2024-03-30T12:36:03.021096+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1293,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219877+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:36:03.219877+0000","last_peered":"2024-03-30T12:36:03.219877+0000","last_clean":"2024-03-30T12:36:03.219877+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:36:03.219877+0000","last_undegraded":"2024-03-30T12:36:03.219877+0000","last_fullsized":"2024-03-30T12:36:03.219877+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221685+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:36:03.221685+0000","last_peered":"2024-03-30T12:36:03.221685+0000","last_clean":"2024-03-30T12:36:03.221685+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:36:03.221685+0000","last_undegraded":"2024-03-30T12:36:03.221685+0000","last_fullsized":"2024-03-30T12:36:03.221685+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221129+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:36:03.221129+0000","last_peered":"2024-03-30T12:36:03.221129+0000","last_clean":"2024-03-30T12:36:03.221129+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:36:03.221129+0000","last_undegraded":"2024-03-30T12:36:03.221129+0000","last_fullsized":"2024-03-30T12:36:03.221129+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3763,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219946+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:36:03.219946+0000","last_peered":"2024-03-30T12:36:03.219946+0000","last_clean":"2024-03-30T12:36:03.219946+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:36:03.219946+0000","last_undegraded":"2024-03-30T12:36:03.219946+0000","last_fullsized":"2024-03-30T12:36:03.219946+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019149+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:36:03.019149+0000","last_peered":"2024-03-30T12:36:03.019149+0000","last_clean":"2024-03-30T12:36:03.019149+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:36:03.019149+0000","last_undegraded":"2024-03-30T12:36:03.019149+0000","last_fullsized":"2024-03-30T12:36:03.019149+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220680+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:36:03.220680+0000","last_peered":"2024-03-30T12:36:03.220680+0000","last_clean":"2024-03-30T12:36:03.220680+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:36:03.220680+0000","last_undegraded":"2024-03-30T12:36:03.220680+0000","last_fullsized":"2024-03-30T12:36:03.220680+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220354+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:36:03.220354+0000","last_peered":"2024-03-30T12:36:03.220354+0000","last_clean":"2024-03-30T12:36:03.220354+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:36:03.220354+0000","last_undegraded":"2024-03-30T12:36:03.220354+0000","last_fullsized":"2024-03-30T12:36:03.220354+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15592,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223226+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:36:03.223226+0000","last_peered":"2024-03-30T12:36:03.223226+0000","last_clean":"2024-03-30T12:36:03.223226+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:36:03.223226+0000","last_undegraded":"2024-03-30T12:36:03.223226+0000","last_fullsized":"2024-03-30T12:36:03.223226+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1142,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016783+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:36:03.016783+0000","last_peered":"2024-03-30T12:36:03.016783+0000","last_clean":"2024-03-30T12:36:03.016783+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:36:03.016783+0000","last_undegraded":"2024-03-30T12:36:03.016783+0000","last_fullsized":"2024-03-30T12:36:03.016783+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1257,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018978+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:36:03.018978+0000","last_peered":"2024-03-30T12:36:03.018978+0000","last_clean":"2024-03-30T12:36:03.018978+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:36:03.018978+0000","last_undegraded":"2024-03-30T12:36:03.018978+0000","last_fullsized":"2024-03-30T12:36:03.018978+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29018,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.020535+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:36:03.020535+0000","last_peered":"2024-03-30T12:36:03.020535+0000","last_clean":"2024-03-30T12:36:03.020535+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:36:03.020535+0000","last_undegraded":"2024-03-30T12:36:03.020535+0000","last_fullsized":"2024-03-30T12:36:03.020535+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222640+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:36:03.222640+0000","last_peered":"2024-03-30T12:36:03.222640+0000","last_clean":"2024-03-30T12:36:03.222640+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:36:03.222640+0000","last_undegraded":"2024-03-30T12:36:03.222640+0000","last_fullsized":"2024-03-30T12:36:03.222640+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220045+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:36:03.220045+0000","last_peered":"2024-03-30T12:36:03.220045+0000","last_clean":"2024-03-30T12:36:03.220045+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:36:03.220045+0000","last_undegraded":"2024-03-30T12:36:03.220045+0000","last_fullsized":"2024-03-30T12:36:03.220045+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5609,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.017229+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:36:03.017229+0000","last_peered":"2024-03-30T12:36:03.017229+0000","last_clean":"2024-03-30T12:36:03.017229+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:36:03.017229+0000","last_undegraded":"2024-03-30T12:36:03.017229+0000","last_fullsized":"2024-03-30T12:36:03.017229+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1363,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220405+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:36:03.220405+0000","last_peered":"2024-03-30T12:36:03.220405+0000","last_clean":"2024-03-30T12:36:03.220405+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:36:03.220405+0000","last_undegraded":"2024-03-30T12:36:03.220405+0000","last_fullsized":"2024-03-30T12:36:03.220405+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221588+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:03.221588+0000","last_peered":"2024-03-30T12:36:03.221588+0000","last_clean":"2024-03-30T12:36:03.221588+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:03.221588+0000","last_undegraded":"2024-03-30T12:36:03.221588+0000","last_fullsized":"2024-03-30T12:36:03.221588+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222830+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:36:03.222830+0000","last_peered":"2024-03-30T12:36:03.222830+0000","last_clean":"2024-03-30T12:36:03.222830+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:36:03.222830+0000","last_undegraded":"2024-03-30T12:36:03.222830+0000","last_fullsized":"2024-03-30T12:36:03.222830+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017355+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:36:03.017355+0000","last_peered":"2024-03-30T12:36:03.017355+0000","last_clean":"2024-03-30T12:36:03.017355+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:36:03.017355+0000","last_undegraded":"2024-03-30T12:36:03.017355+0000","last_fullsized":"2024-03-30T12:36:03.017355+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221062+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:36:03.221062+0000","last_peered":"2024-03-30T12:36:03.221062+0000","last_clean":"2024-03-30T12:36:03.221062+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:36:03.221062+0000","last_undegraded":"2024-03-30T12:36:03.221062+0000","last_fullsized":"2024-03-30T12:36:03.221062+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5252,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.017068+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:36:03.017068+0000","last_peered":"2024-03-30T12:36:03.017068+0000","last_clean":"2024-03-30T12:36:03.017068+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:36:03.017068+0000","last_undegraded":"2024-03-30T12:36:03.017068+0000","last_fullsized":"2024-03-30T12:36:03.017068+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1330,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016069+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:36:03.016069+0000","last_peered":"2024-03-30T12:36:03.016069+0000","last_clean":"2024-03-30T12:36:03.016069+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:36:03.016069+0000","last_undegraded":"2024-03-30T12:36:03.016069+0000","last_fullsized":"2024-03-30T12:36:03.016069+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017799+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:36:03.017799+0000","last_peered":"2024-03-30T12:36:03.017799+0000","last_clean":"2024-03-30T12:36:03.017799+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:36:03.017799+0000","last_undegraded":"2024-03-30T12:36:03.017799+0000","last_fullsized":"2024-03-30T12:36:03.017799+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4809,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.016990+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:36:03.016990+0000","last_peered":"2024-03-30T12:36:03.016990+0000","last_clean":"2024-03-30T12:36:03.016990+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:36:03.016990+0000","last_undegraded":"2024-03-30T12:36:03.016990+0000","last_fullsized":"2024-03-30T12:36:03.016990+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220902+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:36:03.220902+0000","last_peered":"2024-03-30T12:36:03.220902+0000","last_clean":"2024-03-30T12:36:03.220902+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:36:03.220902+0000","last_undegraded":"2024-03-30T12:36:03.220902+0000","last_fullsized":"2024-03-30T12:36:03.220902+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222557+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:36:03.222557+0000","last_peered":"2024-03-30T12:36:03.222557+0000","last_clean":"2024-03-30T12:36:03.222557+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:36:03.222557+0000","last_undegraded":"2024-03-30T12:36:03.222557+0000","last_fullsized":"2024-03-30T12:36:03.222557+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6742,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.018791+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:36:03.018791+0000","last_peered":"2024-03-30T12:36:03.018791+0000","last_clean":"2024-03-30T12:36:03.018791+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:36:03.018791+0000","last_undegraded":"2024-03-30T12:36:03.018791+0000","last_fullsized":"2024-03-30T12:36:03.018791+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1336,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016373+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:36:03.016373+0000","last_peered":"2024-03-30T12:36:03.016373+0000","last_clean":"2024-03-30T12:36:03.016373+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:36:03.016373+0000","last_undegraded":"2024-03-30T12:36:03.016373+0000","last_fullsized":"2024-03-30T12:36:03.016373+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018917+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:36:03.018917+0000","last_peered":"2024-03-30T12:36:03.018917+0000","last_clean":"2024-03-30T12:36:03.018917+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:36:03.018917+0000","last_undegraded":"2024-03-30T12:36:03.018917+0000","last_fullsized":"2024-03-30T12:36:03.018917+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220120+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:36:03.220120+0000","last_peered":"2024-03-30T12:36:03.220120+0000","last_clean":"2024-03-30T12:36:03.220120+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:36:03.220120+0000","last_undegraded":"2024-03-30T12:36:03.220120+0000","last_fullsized":"2024-03-30T12:36:03.220120+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015273+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:36:03.015273+0000","last_peered":"2024-03-30T12:36:03.015273+0000","last_clean":"2024-03-30T12:36:03.015273+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:36:03.015273+0000","last_undegraded":"2024-03-30T12:36:03.015273+0000","last_fullsized":"2024-03-30T12:36:03.015273+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221954+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:36:03.221954+0000","last_peered":"2024-03-30T12:36:03.221954+0000","last_clean":"2024-03-30T12:36:03.221954+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:36:03.221954+0000","last_undegraded":"2024-03-30T12:36:03.221954+0000","last_fullsized":"2024-03-30T12:36:03.221954+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221038+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:36:03.221038+0000","last_peered":"2024-03-30T12:36:03.221038+0000","last_clean":"2024-03-30T12:36:03.221038+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:36:03.221038+0000","last_undegraded":"2024-03-30T12:36:03.221038+0000","last_fullsized":"2024-03-30T12:36:03.221038+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220172+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:36:03.220172+0000","last_peered":"2024-03-30T12:36:03.220172+0000","last_clean":"2024-03-30T12:36:03.220172+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:36:03.220172+0000","last_undegraded":"2024-03-30T12:36:03.220172+0000","last_fullsized":"2024-03-30T12:36:03.220172+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221004+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:36:03.221004+0000","last_peered":"2024-03-30T12:36:03.221004+0000","last_clean":"2024-03-30T12:36:03.221004+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:36:03.221004+0000","last_undegraded":"2024-03-30T12:36:03.221004+0000","last_fullsized":"2024-03-30T12:36:03.221004+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1176,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221139+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:36:03.221139+0000","last_peered":"2024-03-30T12:36:03.221139+0000","last_clean":"2024-03-30T12:36:03.221139+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:36:03.221139+0000","last_undegraded":"2024-03-30T12:36:03.221139+0000","last_fullsized":"2024-03-30T12:36:03.221139+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1280,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221301+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:36:03.221301+0000","last_peered":"2024-03-30T12:36:03.221301+0000","last_clean":"2024-03-30T12:36:03.221301+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:36:03.221301+0000","last_undegraded":"2024-03-30T12:36:03.221301+0000","last_fullsized":"2024-03-30T12:36:03.221301+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1237,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221506+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:36:03.221506+0000","last_peered":"2024-03-30T12:36:03.221506+0000","last_clean":"2024-03-30T12:36:03.221506+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:36:03.221506+0000","last_undegraded":"2024-03-30T12:36:03.221506+0000","last_fullsized":"2024-03-30T12:36:03.221506+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220227+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:03.220227+0000","last_peered":"2024-03-30T12:36:03.220227+0000","last_clean":"2024-03-30T12:36:03.220227+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:03.220227+0000","last_undegraded":"2024-03-30T12:36:03.220227+0000","last_fullsized":"2024-03-30T12:36:03.220227+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221549+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:36:03.221549+0000","last_peered":"2024-03-30T12:36:03.221549+0000","last_clean":"2024-03-30T12:36:03.221549+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:36:03.221549+0000","last_undegraded":"2024-03-30T12:36:03.221549+0000","last_fullsized":"2024-03-30T12:36:03.221549+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220884+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:36:03.220884+0000","last_peered":"2024-03-30T12:36:03.220884+0000","last_clean":"2024-03-30T12:36:03.220884+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:36:03.220884+0000","last_undegraded":"2024-03-30T12:36:03.220884+0000","last_fullsized":"2024-03-30T12:36:03.220884+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220599+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:36:03.220599+0000","last_peered":"2024-03-30T12:36:03.220599+0000","last_clean":"2024-03-30T12:36:03.220599+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:36:03.220599+0000","last_undegraded":"2024-03-30T12:36:03.220599+0000","last_fullsized":"2024-03-30T12:36:03.220599+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438038,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648094,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175104,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254342,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063161,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951218,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839275,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923557,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:37:25.544 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:25.544 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:25.544 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:25.544 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:25.544 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:25.544 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:25.544 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:25.544 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:25.544 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:25.545 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:25.545 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:25.545 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:25.545 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:25.545 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:37:26.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:25 smithi084 ceph-mon[91810]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:37:26.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:25 smithi084 ceph-mon[89279]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:37:26.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:25 smithi162 ceph-mon[83709]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:37:27.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:26 smithi084 ceph-mon[91810]: pgmap v1032: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:27.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:26 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:37:27.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:26 smithi084 ceph-mon[89279]: pgmap v1032: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:27.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:26 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:37:27.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:26 smithi162 ceph-mon[83709]: pgmap v1032: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:27.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:26 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:37:28.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:27 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:37:28.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:27 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:37:28.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:27 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:37:28.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:27 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:37:28.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:27 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:37:28.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:27 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:37:28.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:27 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:37:28.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:27 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:37:28.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:27 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:37:29.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:28 smithi084 ceph-mon[91810]: pgmap v1033: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:29.296 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:28 smithi084 ceph-mon[89279]: pgmap v1033: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:29.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:28 smithi162 ceph-mon[83709]: pgmap v1033: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:29.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:37:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:37:29] "GET /metrics HTTP/1.1" 200 36327 "" "Prometheus/2.43.0" 2024-03-30T12:37:30.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:29 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:37:30.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:29 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:37:30.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:29 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:37:31.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:30 smithi084 ceph-mon[91810]: pgmap v1034: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:31.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:30 smithi084 ceph-mon[89279]: pgmap v1034: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:31.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:30 smithi162 ceph-mon[83709]: pgmap v1034: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:33.171 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:32 smithi162 ceph-mon[83709]: pgmap v1035: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:33.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:32 smithi084 ceph-mon[91810]: pgmap v1035: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:33.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:32 smithi084 ceph-mon[89279]: pgmap v1035: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:35.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:34 smithi084 ceph-mon[91810]: pgmap v1036: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:35.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:34 smithi084 ceph-mon[89279]: pgmap v1036: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:35.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:34 smithi162 ceph-mon[83709]: pgmap v1036: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:35.546 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:37:35.765 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:37:37.149 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:36 smithi084 ceph-mon[91810]: pgmap v1037: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:37.150 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:36 smithi084 ceph-mon[89279]: pgmap v1037: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:37.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:36 smithi162 ceph-mon[83709]: pgmap v1037: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:37.704 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:37:37.706 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:37:38.072 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:37 smithi084 ceph-mon[89279]: from='client.34554 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:37:38.072 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:37 smithi084 ceph-mon[91810]: from='client.34554 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:37:38.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:37 smithi162 ceph-mon[83709]: from='client.34554 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:37:38.428 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1037,"stamp":"2024-03-30T12:37:36.825403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003980"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018672+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:36:03.018672+0000","last_peered":"2024-03-30T12:36:03.018672+0000","last_clean":"2024-03-30T12:36:03.018672+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:36:03.018672+0000","last_undegraded":"2024-03-30T12:36:03.018672+0000","last_fullsized":"2024-03-30T12:36:03.018672+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1363,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221634+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:36:03.221634+0000","last_peered":"2024-03-30T12:36:03.221634+0000","last_clean":"2024-03-30T12:36:03.221634+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:36:03.221634+0000","last_undegraded":"2024-03-30T12:36:03.221634+0000","last_fullsized":"2024-03-30T12:36:03.221634+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221207+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:36:03.221207+0000","last_peered":"2024-03-30T12:36:03.221207+0000","last_clean":"2024-03-30T12:36:03.221207+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:36:03.221207+0000","last_undegraded":"2024-03-30T12:36:03.221207+0000","last_fullsized":"2024-03-30T12:36:03.221207+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222119+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:36:03.222119+0000","last_peered":"2024-03-30T12:36:03.222119+0000","last_clean":"2024-03-30T12:36:03.222119+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:36:03.222119+0000","last_undegraded":"2024-03-30T12:36:03.222119+0000","last_fullsized":"2024-03-30T12:36:03.222119+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016806+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:36:03.016806+0000","last_peered":"2024-03-30T12:36:03.016806+0000","last_clean":"2024-03-30T12:36:03.016806+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:36:03.016806+0000","last_undegraded":"2024-03-30T12:36:03.016806+0000","last_fullsized":"2024-03-30T12:36:03.016806+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1209,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222566+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:03.222566+0000","last_peered":"2024-03-30T12:36:03.222566+0000","last_clean":"2024-03-30T12:36:03.222566+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:03.222566+0000","last_undegraded":"2024-03-30T12:36:03.222566+0000","last_fullsized":"2024-03-30T12:36:03.222566+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017295+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:36:03.017295+0000","last_peered":"2024-03-30T12:36:03.017295+0000","last_clean":"2024-03-30T12:36:03.017295+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:36:03.017295+0000","last_undegraded":"2024-03-30T12:36:03.017295+0000","last_fullsized":"2024-03-30T12:36:03.017295+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1257,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219724+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:36:03.219724+0000","last_peered":"2024-03-30T12:36:03.219724+0000","last_clean":"2024-03-30T12:36:03.219724+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:36:03.219724+0000","last_undegraded":"2024-03-30T12:36:03.219724+0000","last_fullsized":"2024-03-30T12:36:03.219724+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018011+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:36:03.018011+0000","last_peered":"2024-03-30T12:36:03.018011+0000","last_clean":"2024-03-30T12:36:03.018011+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:36:03.018011+0000","last_undegraded":"2024-03-30T12:36:03.018011+0000","last_fullsized":"2024-03-30T12:36:03.018011+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220774+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:03.220774+0000","last_peered":"2024-03-30T12:36:03.220774+0000","last_clean":"2024-03-30T12:36:03.220774+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:03.220774+0000","last_undegraded":"2024-03-30T12:36:03.220774+0000","last_fullsized":"2024-03-30T12:36:03.220774+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220468+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:03.220468+0000","last_peered":"2024-03-30T12:36:03.220468+0000","last_clean":"2024-03-30T12:36:03.220468+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:03.220468+0000","last_undegraded":"2024-03-30T12:36:03.220468+0000","last_fullsized":"2024-03-30T12:36:03.220468+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1269,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020196+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:36:03.020196+0000","last_peered":"2024-03-30T12:36:03.020196+0000","last_clean":"2024-03-30T12:36:03.020196+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:36:03.020196+0000","last_undegraded":"2024-03-30T12:36:03.020196+0000","last_fullsized":"2024-03-30T12:36:03.020196+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1287,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221647+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:36:03.221647+0000","last_peered":"2024-03-30T12:36:03.221647+0000","last_clean":"2024-03-30T12:36:03.221647+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:36:03.221647+0000","last_undegraded":"2024-03-30T12:36:03.221647+0000","last_fullsized":"2024-03-30T12:36:03.221647+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220445+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:36:03.220445+0000","last_peered":"2024-03-30T12:36:03.220445+0000","last_clean":"2024-03-30T12:36:03.220445+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:36:03.220445+0000","last_undegraded":"2024-03-30T12:36:03.220445+0000","last_fullsized":"2024-03-30T12:36:03.220445+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222534+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:36:03.222534+0000","last_peered":"2024-03-30T12:36:03.222534+0000","last_clean":"2024-03-30T12:36:03.222534+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:36:03.222534+0000","last_undegraded":"2024-03-30T12:36:03.222534+0000","last_fullsized":"2024-03-30T12:36:03.222534+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221410+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:36:03.221410+0000","last_peered":"2024-03-30T12:36:03.221410+0000","last_clean":"2024-03-30T12:36:03.221410+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:36:03.221410+0000","last_undegraded":"2024-03-30T12:36:03.221410+0000","last_fullsized":"2024-03-30T12:36:03.221410+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1223,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222946+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:36:03.222946+0000","last_peered":"2024-03-30T12:36:03.222946+0000","last_clean":"2024-03-30T12:36:03.222946+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:36:03.222946+0000","last_undegraded":"2024-03-30T12:36:03.222946+0000","last_fullsized":"2024-03-30T12:36:03.222946+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015999+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:36:03.015999+0000","last_peered":"2024-03-30T12:36:03.015999+0000","last_clean":"2024-03-30T12:36:03.015999+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:36:03.015999+0000","last_undegraded":"2024-03-30T12:36:03.015999+0000","last_fullsized":"2024-03-30T12:36:03.015999+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017955+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:36:03.017955+0000","last_peered":"2024-03-30T12:36:03.017955+0000","last_clean":"2024-03-30T12:36:03.017955+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:36:03.017955+0000","last_undegraded":"2024-03-30T12:36:03.017955+0000","last_fullsized":"2024-03-30T12:36:03.017955+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1387,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221082+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:36:03.221082+0000","last_peered":"2024-03-30T12:36:03.221082+0000","last_clean":"2024-03-30T12:36:03.221082+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:36:03.221082+0000","last_undegraded":"2024-03-30T12:36:03.221082+0000","last_fullsized":"2024-03-30T12:36:03.221082+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1281,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220779+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:36:03.220779+0000","last_peered":"2024-03-30T12:36:03.220779+0000","last_clean":"2024-03-30T12:36:03.220779+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:36:03.220779+0000","last_undegraded":"2024-03-30T12:36:03.220779+0000","last_fullsized":"2024-03-30T12:36:03.220779+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1300,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220968+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:36:03.220968+0000","last_peered":"2024-03-30T12:36:03.220968+0000","last_clean":"2024-03-30T12:36:03.220968+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:36:03.220968+0000","last_undegraded":"2024-03-30T12:36:03.220968+0000","last_fullsized":"2024-03-30T12:36:03.220968+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220378+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:36:03.220378+0000","last_peered":"2024-03-30T12:36:03.220378+0000","last_clean":"2024-03-30T12:36:03.220378+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:36:03.220378+0000","last_undegraded":"2024-03-30T12:36:03.220378+0000","last_fullsized":"2024-03-30T12:36:03.220378+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017887+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:36:03.017887+0000","last_peered":"2024-03-30T12:36:03.017887+0000","last_clean":"2024-03-30T12:36:03.017887+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:36:03.017887+0000","last_undegraded":"2024-03-30T12:36:03.017887+0000","last_fullsized":"2024-03-30T12:36:03.017887+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1228,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222708+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:03.222708+0000","last_peered":"2024-03-30T12:36:03.222708+0000","last_clean":"2024-03-30T12:36:03.222708+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:03.222708+0000","last_undegraded":"2024-03-30T12:36:03.222708+0000","last_fullsized":"2024-03-30T12:36:03.222708+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017639+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:36:03.017639+0000","last_peered":"2024-03-30T12:36:03.017639+0000","last_clean":"2024-03-30T12:36:03.017639+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:36:03.017639+0000","last_undegraded":"2024-03-30T12:36:03.017639+0000","last_fullsized":"2024-03-30T12:36:03.017639+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222301+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:03.222301+0000","last_peered":"2024-03-30T12:36:03.222301+0000","last_clean":"2024-03-30T12:36:03.222301+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:03.222301+0000","last_undegraded":"2024-03-30T12:36:03.222301+0000","last_fullsized":"2024-03-30T12:36:03.222301+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221804+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:36:03.221804+0000","last_peered":"2024-03-30T12:36:03.221804+0000","last_clean":"2024-03-30T12:36:03.221804+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:36:03.221804+0000","last_undegraded":"2024-03-30T12:36:03.221804+0000","last_fullsized":"2024-03-30T12:36:03.221804+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018855+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:36:03.018855+0000","last_peered":"2024-03-30T12:36:03.018855+0000","last_clean":"2024-03-30T12:36:03.018855+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:36:03.018855+0000","last_undegraded":"2024-03-30T12:36:03.018855+0000","last_fullsized":"2024-03-30T12:36:03.018855+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1179,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220575+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:36:03.220575+0000","last_peered":"2024-03-30T12:36:03.220575+0000","last_clean":"2024-03-30T12:36:03.220575+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:36:03.220575+0000","last_undegraded":"2024-03-30T12:36:03.220575+0000","last_fullsized":"2024-03-30T12:36:03.220575+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221577+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:36:03.221577+0000","last_peered":"2024-03-30T12:36:03.221577+0000","last_clean":"2024-03-30T12:36:03.221577+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:36:03.221577+0000","last_undegraded":"2024-03-30T12:36:03.221577+0000","last_fullsized":"2024-03-30T12:36:03.221577+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219793+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:36:03.219793+0000","last_peered":"2024-03-30T12:36:03.219793+0000","last_clean":"2024-03-30T12:36:03.219793+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:36:03.219793+0000","last_undegraded":"2024-03-30T12:36:03.219793+0000","last_fullsized":"2024-03-30T12:36:03.219793+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1293,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219776+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:36:03.219776+0000","last_peered":"2024-03-30T12:36:03.219776+0000","last_clean":"2024-03-30T12:36:03.219776+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:36:03.219776+0000","last_undegraded":"2024-03-30T12:36:03.219776+0000","last_fullsized":"2024-03-30T12:36:03.219776+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1223,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221769+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:36:03.221769+0000","last_peered":"2024-03-30T12:36:03.221769+0000","last_clean":"2024-03-30T12:36:03.221769+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:36:03.221769+0000","last_undegraded":"2024-03-30T12:36:03.221769+0000","last_fullsized":"2024-03-30T12:36:03.221769+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222968+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:36:03.222968+0000","last_peered":"2024-03-30T12:36:03.222968+0000","last_clean":"2024-03-30T12:36:03.222968+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:36:03.222968+0000","last_undegraded":"2024-03-30T12:36:03.222968+0000","last_fullsized":"2024-03-30T12:36:03.222968+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220821+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:03.220821+0000","last_peered":"2024-03-30T12:36:03.220821+0000","last_clean":"2024-03-30T12:36:03.220821+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:03.220821+0000","last_undegraded":"2024-03-30T12:36:03.220821+0000","last_fullsized":"2024-03-30T12:36:03.220821+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1203,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222317+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:36:03.222317+0000","last_peered":"2024-03-30T12:36:03.222317+0000","last_clean":"2024-03-30T12:36:03.222317+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:36:03.222317+0000","last_undegraded":"2024-03-30T12:36:03.222317+0000","last_fullsized":"2024-03-30T12:36:03.222317+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1197,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222067+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:36:03.222067+0000","last_peered":"2024-03-30T12:36:03.222067+0000","last_clean":"2024-03-30T12:36:03.222067+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:36:03.222067+0000","last_undegraded":"2024-03-30T12:36:03.222067+0000","last_fullsized":"2024-03-30T12:36:03.222067+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015739+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:36:03.015739+0000","last_peered":"2024-03-30T12:36:03.015739+0000","last_clean":"2024-03-30T12:36:03.015739+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:36:03.015739+0000","last_undegraded":"2024-03-30T12:36:03.015739+0000","last_fullsized":"2024-03-30T12:36:03.015739+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221275+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:36:03.221275+0000","last_peered":"2024-03-30T12:36:03.221275+0000","last_clean":"2024-03-30T12:36:03.221275+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:36:03.221275+0000","last_undegraded":"2024-03-30T12:36:03.221275+0000","last_fullsized":"2024-03-30T12:36:03.221275+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020038+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:36:03.020038+0000","last_peered":"2024-03-30T12:36:03.020038+0000","last_clean":"2024-03-30T12:36:03.020038+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:36:03.020038+0000","last_undegraded":"2024-03-30T12:36:03.020038+0000","last_fullsized":"2024-03-30T12:36:03.020038+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1204,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220837+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:36:03.220837+0000","last_peered":"2024-03-30T12:36:03.220837+0000","last_clean":"2024-03-30T12:36:03.220837+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:36:03.220837+0000","last_undegraded":"2024-03-30T12:36:03.220837+0000","last_fullsized":"2024-03-30T12:36:03.220837+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017435+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:36:03.017435+0000","last_peered":"2024-03-30T12:36:03.017435+0000","last_clean":"2024-03-30T12:36:03.017435+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:36:03.017435+0000","last_undegraded":"2024-03-30T12:36:03.017435+0000","last_fullsized":"2024-03-30T12:36:03.017435+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221717+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:36:03.221717+0000","last_peered":"2024-03-30T12:36:03.221717+0000","last_clean":"2024-03-30T12:36:03.221717+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:36:03.221717+0000","last_undegraded":"2024-03-30T12:36:03.221717+0000","last_fullsized":"2024-03-30T12:36:03.221717+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220742+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:36:03.220742+0000","last_peered":"2024-03-30T12:36:03.220742+0000","last_clean":"2024-03-30T12:36:03.220742+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:36:03.220742+0000","last_undegraded":"2024-03-30T12:36:03.220742+0000","last_fullsized":"2024-03-30T12:36:03.220742+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221904+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:36:03.221904+0000","last_peered":"2024-03-30T12:36:03.221904+0000","last_clean":"2024-03-30T12:36:03.221904+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:36:03.221904+0000","last_undegraded":"2024-03-30T12:36:03.221904+0000","last_fullsized":"2024-03-30T12:36:03.221904+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017508+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:36:03.017508+0000","last_peered":"2024-03-30T12:36:03.017508+0000","last_clean":"2024-03-30T12:36:03.017508+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:36:03.017508+0000","last_undegraded":"2024-03-30T12:36:03.017508+0000","last_fullsized":"2024-03-30T12:36:03.017508+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220253+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:36:03.220253+0000","last_peered":"2024-03-30T12:36:03.220253+0000","last_clean":"2024-03-30T12:36:03.220253+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:36:03.220253+0000","last_undegraded":"2024-03-30T12:36:03.220253+0000","last_fullsized":"2024-03-30T12:36:03.220253+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220192+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:36:03.220192+0000","last_peered":"2024-03-30T12:36:03.220192+0000","last_clean":"2024-03-30T12:36:03.220192+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:36:03.220192+0000","last_undegraded":"2024-03-30T12:36:03.220192+0000","last_fullsized":"2024-03-30T12:36:03.220192+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1343,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015636+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:36:03.015636+0000","last_peered":"2024-03-30T12:36:03.015636+0000","last_clean":"2024-03-30T12:36:03.015636+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:36:03.015636+0000","last_undegraded":"2024-03-30T12:36:03.015636+0000","last_fullsized":"2024-03-30T12:36:03.015636+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016619+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:36:03.016619+0000","last_peered":"2024-03-30T12:36:03.016619+0000","last_clean":"2024-03-30T12:36:03.016619+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:36:03.016619+0000","last_undegraded":"2024-03-30T12:36:03.016619+0000","last_fullsized":"2024-03-30T12:36:03.016619+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5751,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.016013+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:36:03.016013+0000","last_peered":"2024-03-30T12:36:03.016013+0000","last_clean":"2024-03-30T12:36:03.016013+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:36:03.016013+0000","last_undegraded":"2024-03-30T12:36:03.016013+0000","last_fullsized":"2024-03-30T12:36:03.016013+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020404+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:36:03.020404+0000","last_peered":"2024-03-30T12:36:03.020404+0000","last_clean":"2024-03-30T12:36:03.020404+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:36:03.020404+0000","last_undegraded":"2024-03-30T12:36:03.020404+0000","last_fullsized":"2024-03-30T12:36:03.020404+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018051+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:36:03.018051+0000","last_peered":"2024-03-30T12:36:03.018051+0000","last_clean":"2024-03-30T12:36:03.018051+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:36:03.018051+0000","last_undegraded":"2024-03-30T12:36:03.018051+0000","last_fullsized":"2024-03-30T12:36:03.018051+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5512,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.222067+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:36:03.222067+0000","last_peered":"2024-03-30T12:36:03.222067+0000","last_clean":"2024-03-30T12:36:03.222067+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:36:03.222067+0000","last_undegraded":"2024-03-30T12:36:03.222067+0000","last_fullsized":"2024-03-30T12:36:03.222067+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220604+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:36:03.220604+0000","last_peered":"2024-03-30T12:36:03.220604+0000","last_clean":"2024-03-30T12:36:03.220604+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:36:03.220604+0000","last_undegraded":"2024-03-30T12:36:03.220604+0000","last_fullsized":"2024-03-30T12:36:03.220604+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1346,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222463+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:36:03.222463+0000","last_peered":"2024-03-30T12:36:03.222463+0000","last_clean":"2024-03-30T12:36:03.222463+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:36:03.222463+0000","last_undegraded":"2024-03-30T12:36:03.222463+0000","last_fullsized":"2024-03-30T12:36:03.222463+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222511+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:36:03.222511+0000","last_peered":"2024-03-30T12:36:03.222511+0000","last_clean":"2024-03-30T12:36:03.222511+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:36:03.222511+0000","last_undegraded":"2024-03-30T12:36:03.222511+0000","last_fullsized":"2024-03-30T12:36:03.222511+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5457,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.222052+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:36:03.222052+0000","last_peered":"2024-03-30T12:36:03.222052+0000","last_clean":"2024-03-30T12:36:03.222052+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:36:03.222052+0000","last_undegraded":"2024-03-30T12:36:03.222052+0000","last_fullsized":"2024-03-30T12:36:03.222052+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222581+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:36:03.222581+0000","last_peered":"2024-03-30T12:36:03.222581+0000","last_clean":"2024-03-30T12:36:03.222581+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:36:03.222581+0000","last_undegraded":"2024-03-30T12:36:03.222581+0000","last_fullsized":"2024-03-30T12:36:03.222581+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221692+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:36:03.221692+0000","last_peered":"2024-03-30T12:36:03.221692+0000","last_clean":"2024-03-30T12:36:03.221692+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:36:03.221692+0000","last_undegraded":"2024-03-30T12:36:03.221692+0000","last_fullsized":"2024-03-30T12:36:03.221692+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1271,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019374+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:36:03.019374+0000","last_peered":"2024-03-30T12:36:03.019374+0000","last_clean":"2024-03-30T12:36:03.019374+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:36:03.019374+0000","last_undegraded":"2024-03-30T12:36:03.019374+0000","last_fullsized":"2024-03-30T12:36:03.019374+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3802,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016632+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:36:03.016632+0000","last_peered":"2024-03-30T12:36:03.016632+0000","last_clean":"2024-03-30T12:36:03.016632+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:36:03.016632+0000","last_undegraded":"2024-03-30T12:36:03.016632+0000","last_fullsized":"2024-03-30T12:36:03.016632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1341,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222936+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:36:03.222936+0000","last_peered":"2024-03-30T12:36:03.222936+0000","last_clean":"2024-03-30T12:36:03.222936+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:36:03.222936+0000","last_undegraded":"2024-03-30T12:36:03.222936+0000","last_fullsized":"2024-03-30T12:36:03.222936+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222036+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:36:03.222036+0000","last_peered":"2024-03-30T12:36:03.222036+0000","last_clean":"2024-03-30T12:36:03.222036+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:36:03.222036+0000","last_undegraded":"2024-03-30T12:36:03.222036+0000","last_fullsized":"2024-03-30T12:36:03.222036+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1330,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015172+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:36:03.015172+0000","last_peered":"2024-03-30T12:36:03.015172+0000","last_clean":"2024-03-30T12:36:03.015172+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:36:03.015172+0000","last_undegraded":"2024-03-30T12:36:03.015172+0000","last_fullsized":"2024-03-30T12:36:03.015172+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4575,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.019196+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:36:03.019196+0000","last_peered":"2024-03-30T12:36:03.019196+0000","last_clean":"2024-03-30T12:36:03.019196+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:36:03.019196+0000","last_undegraded":"2024-03-30T12:36:03.019196+0000","last_fullsized":"2024-03-30T12:36:03.019196+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1173,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220732+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:36:03.220732+0000","last_peered":"2024-03-30T12:36:03.220732+0000","last_clean":"2024-03-30T12:36:03.220732+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:36:03.220732+0000","last_undegraded":"2024-03-30T12:36:03.220732+0000","last_fullsized":"2024-03-30T12:36:03.220732+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221414+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:36:03.221414+0000","last_peered":"2024-03-30T12:36:03.221414+0000","last_clean":"2024-03-30T12:36:03.221414+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:36:03.221414+0000","last_undegraded":"2024-03-30T12:36:03.221414+0000","last_fullsized":"2024-03-30T12:36:03.221414+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1199,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222181+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:36:03.222181+0000","last_peered":"2024-03-30T12:36:03.222181+0000","last_clean":"2024-03-30T12:36:03.222181+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:36:03.222181+0000","last_undegraded":"2024-03-30T12:36:03.222181+0000","last_fullsized":"2024-03-30T12:36:03.222181+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1715,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016476+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:36:03.016476+0000","last_peered":"2024-03-30T12:36:03.016476+0000","last_clean":"2024-03-30T12:36:03.016476+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:36:03.016476+0000","last_undegraded":"2024-03-30T12:36:03.016476+0000","last_fullsized":"2024-03-30T12:36:03.016476+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24712,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223515+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:36:03.223515+0000","last_peered":"2024-03-30T12:36:03.223515+0000","last_clean":"2024-03-30T12:36:03.223515+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:36:03.223515+0000","last_undegraded":"2024-03-30T12:36:03.223515+0000","last_fullsized":"2024-03-30T12:36:03.223515+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220614+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:36:03.220614+0000","last_peered":"2024-03-30T12:36:03.220614+0000","last_clean":"2024-03-30T12:36:03.220614+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:36:03.220614+0000","last_undegraded":"2024-03-30T12:36:03.220614+0000","last_fullsized":"2024-03-30T12:36:03.220614+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220696+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:36:03.220696+0000","last_peered":"2024-03-30T12:36:03.220696+0000","last_clean":"2024-03-30T12:36:03.220696+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:36:03.220696+0000","last_undegraded":"2024-03-30T12:36:03.220696+0000","last_fullsized":"2024-03-30T12:36:03.220696+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1143,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016477+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:36:03.016477+0000","last_peered":"2024-03-30T12:36:03.016477+0000","last_clean":"2024-03-30T12:36:03.016477+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:36:03.016477+0000","last_undegraded":"2024-03-30T12:36:03.016477+0000","last_fullsized":"2024-03-30T12:36:03.016477+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16479,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.221375+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:36:03.221375+0000","last_peered":"2024-03-30T12:36:03.221375+0000","last_clean":"2024-03-30T12:36:03.221375+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:36:03.221375+0000","last_undegraded":"2024-03-30T12:36:03.221375+0000","last_fullsized":"2024-03-30T12:36:03.221375+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221448+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:36:03.221448+0000","last_peered":"2024-03-30T12:36:03.221448+0000","last_clean":"2024-03-30T12:36:03.221448+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:36:03.221448+0000","last_undegraded":"2024-03-30T12:36:03.221448+0000","last_fullsized":"2024-03-30T12:36:03.221448+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017748+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:36:03.017748+0000","last_peered":"2024-03-30T12:36:03.017748+0000","last_clean":"2024-03-30T12:36:03.017748+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:36:03.017748+0000","last_undegraded":"2024-03-30T12:36:03.017748+0000","last_fullsized":"2024-03-30T12:36:03.017748+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222675+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:36:03.222675+0000","last_peered":"2024-03-30T12:36:03.222675+0000","last_clean":"2024-03-30T12:36:03.222675+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:36:03.222675+0000","last_undegraded":"2024-03-30T12:36:03.222675+0000","last_fullsized":"2024-03-30T12:36:03.222675+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31268,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.021096+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:36:03.021096+0000","last_peered":"2024-03-30T12:36:03.021096+0000","last_clean":"2024-03-30T12:36:03.021096+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:36:03.021096+0000","last_undegraded":"2024-03-30T12:36:03.021096+0000","last_fullsized":"2024-03-30T12:36:03.021096+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1293,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219877+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:36:03.219877+0000","last_peered":"2024-03-30T12:36:03.219877+0000","last_clean":"2024-03-30T12:36:03.219877+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:36:03.219877+0000","last_undegraded":"2024-03-30T12:36:03.219877+0000","last_fullsized":"2024-03-30T12:36:03.219877+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221685+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:36:03.221685+0000","last_peered":"2024-03-30T12:36:03.221685+0000","last_clean":"2024-03-30T12:36:03.221685+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:36:03.221685+0000","last_undegraded":"2024-03-30T12:36:03.221685+0000","last_fullsized":"2024-03-30T12:36:03.221685+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221129+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:36:03.221129+0000","last_peered":"2024-03-30T12:36:03.221129+0000","last_clean":"2024-03-30T12:36:03.221129+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:36:03.221129+0000","last_undegraded":"2024-03-30T12:36:03.221129+0000","last_fullsized":"2024-03-30T12:36:03.221129+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3763,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219946+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:36:03.219946+0000","last_peered":"2024-03-30T12:36:03.219946+0000","last_clean":"2024-03-30T12:36:03.219946+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:36:03.219946+0000","last_undegraded":"2024-03-30T12:36:03.219946+0000","last_fullsized":"2024-03-30T12:36:03.219946+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019149+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:36:03.019149+0000","last_peered":"2024-03-30T12:36:03.019149+0000","last_clean":"2024-03-30T12:36:03.019149+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:36:03.019149+0000","last_undegraded":"2024-03-30T12:36:03.019149+0000","last_fullsized":"2024-03-30T12:36:03.019149+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220680+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:36:03.220680+0000","last_peered":"2024-03-30T12:36:03.220680+0000","last_clean":"2024-03-30T12:36:03.220680+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:36:03.220680+0000","last_undegraded":"2024-03-30T12:36:03.220680+0000","last_fullsized":"2024-03-30T12:36:03.220680+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220354+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:36:03.220354+0000","last_peered":"2024-03-30T12:36:03.220354+0000","last_clean":"2024-03-30T12:36:03.220354+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:36:03.220354+0000","last_undegraded":"2024-03-30T12:36:03.220354+0000","last_fullsized":"2024-03-30T12:36:03.220354+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15592,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223226+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:36:03.223226+0000","last_peered":"2024-03-30T12:36:03.223226+0000","last_clean":"2024-03-30T12:36:03.223226+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:36:03.223226+0000","last_undegraded":"2024-03-30T12:36:03.223226+0000","last_fullsized":"2024-03-30T12:36:03.223226+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1142,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016783+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:36:03.016783+0000","last_peered":"2024-03-30T12:36:03.016783+0000","last_clean":"2024-03-30T12:36:03.016783+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:36:03.016783+0000","last_undegraded":"2024-03-30T12:36:03.016783+0000","last_fullsized":"2024-03-30T12:36:03.016783+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1257,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018978+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:36:03.018978+0000","last_peered":"2024-03-30T12:36:03.018978+0000","last_clean":"2024-03-30T12:36:03.018978+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:36:03.018978+0000","last_undegraded":"2024-03-30T12:36:03.018978+0000","last_fullsized":"2024-03-30T12:36:03.018978+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29019,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.020881+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:36:03.020881+0000","last_peered":"2024-03-30T12:36:03.020881+0000","last_clean":"2024-03-30T12:36:03.020881+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:36:03.020881+0000","last_undegraded":"2024-03-30T12:36:03.020881+0000","last_fullsized":"2024-03-30T12:36:03.020881+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222640+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:36:03.222640+0000","last_peered":"2024-03-30T12:36:03.222640+0000","last_clean":"2024-03-30T12:36:03.222640+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:36:03.222640+0000","last_undegraded":"2024-03-30T12:36:03.222640+0000","last_fullsized":"2024-03-30T12:36:03.222640+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220045+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:36:03.220045+0000","last_peered":"2024-03-30T12:36:03.220045+0000","last_clean":"2024-03-30T12:36:03.220045+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:36:03.220045+0000","last_undegraded":"2024-03-30T12:36:03.220045+0000","last_fullsized":"2024-03-30T12:36:03.220045+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5609,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.017229+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:36:03.017229+0000","last_peered":"2024-03-30T12:36:03.017229+0000","last_clean":"2024-03-30T12:36:03.017229+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:36:03.017229+0000","last_undegraded":"2024-03-30T12:36:03.017229+0000","last_fullsized":"2024-03-30T12:36:03.017229+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1363,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220405+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:36:03.220405+0000","last_peered":"2024-03-30T12:36:03.220405+0000","last_clean":"2024-03-30T12:36:03.220405+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:36:03.220405+0000","last_undegraded":"2024-03-30T12:36:03.220405+0000","last_fullsized":"2024-03-30T12:36:03.220405+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221588+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:03.221588+0000","last_peered":"2024-03-30T12:36:03.221588+0000","last_clean":"2024-03-30T12:36:03.221588+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:03.221588+0000","last_undegraded":"2024-03-30T12:36:03.221588+0000","last_fullsized":"2024-03-30T12:36:03.221588+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222830+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:36:03.222830+0000","last_peered":"2024-03-30T12:36:03.222830+0000","last_clean":"2024-03-30T12:36:03.222830+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:36:03.222830+0000","last_undegraded":"2024-03-30T12:36:03.222830+0000","last_fullsized":"2024-03-30T12:36:03.222830+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017355+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:36:03.017355+0000","last_peered":"2024-03-30T12:36:03.017355+0000","last_clean":"2024-03-30T12:36:03.017355+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:36:03.017355+0000","last_undegraded":"2024-03-30T12:36:03.017355+0000","last_fullsized":"2024-03-30T12:36:03.017355+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221062+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:36:03.221062+0000","last_peered":"2024-03-30T12:36:03.221062+0000","last_clean":"2024-03-30T12:36:03.221062+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:36:03.221062+0000","last_undegraded":"2024-03-30T12:36:03.221062+0000","last_fullsized":"2024-03-30T12:36:03.221062+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5252,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.017068+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:36:03.017068+0000","last_peered":"2024-03-30T12:36:03.017068+0000","last_clean":"2024-03-30T12:36:03.017068+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:36:03.017068+0000","last_undegraded":"2024-03-30T12:36:03.017068+0000","last_fullsized":"2024-03-30T12:36:03.017068+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1330,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016069+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:36:03.016069+0000","last_peered":"2024-03-30T12:36:03.016069+0000","last_clean":"2024-03-30T12:36:03.016069+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:36:03.016069+0000","last_undegraded":"2024-03-30T12:36:03.016069+0000","last_fullsized":"2024-03-30T12:36:03.016069+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017799+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:36:03.017799+0000","last_peered":"2024-03-30T12:36:03.017799+0000","last_clean":"2024-03-30T12:36:03.017799+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:36:03.017799+0000","last_undegraded":"2024-03-30T12:36:03.017799+0000","last_fullsized":"2024-03-30T12:36:03.017799+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4809,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.016990+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:36:03.016990+0000","last_peered":"2024-03-30T12:36:03.016990+0000","last_clean":"2024-03-30T12:36:03.016990+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:36:03.016990+0000","last_undegraded":"2024-03-30T12:36:03.016990+0000","last_fullsized":"2024-03-30T12:36:03.016990+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220902+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:36:03.220902+0000","last_peered":"2024-03-30T12:36:03.220902+0000","last_clean":"2024-03-30T12:36:03.220902+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:36:03.220902+0000","last_undegraded":"2024-03-30T12:36:03.220902+0000","last_fullsized":"2024-03-30T12:36:03.220902+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222557+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:36:03.222557+0000","last_peered":"2024-03-30T12:36:03.222557+0000","last_clean":"2024-03-30T12:36:03.222557+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:36:03.222557+0000","last_undegraded":"2024-03-30T12:36:03.222557+0000","last_fullsized":"2024-03-30T12:36:03.222557+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6742,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.018791+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:36:03.018791+0000","last_peered":"2024-03-30T12:36:03.018791+0000","last_clean":"2024-03-30T12:36:03.018791+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:36:03.018791+0000","last_undegraded":"2024-03-30T12:36:03.018791+0000","last_fullsized":"2024-03-30T12:36:03.018791+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1336,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016373+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:36:03.016373+0000","last_peered":"2024-03-30T12:36:03.016373+0000","last_clean":"2024-03-30T12:36:03.016373+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:36:03.016373+0000","last_undegraded":"2024-03-30T12:36:03.016373+0000","last_fullsized":"2024-03-30T12:36:03.016373+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018917+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:36:03.018917+0000","last_peered":"2024-03-30T12:36:03.018917+0000","last_clean":"2024-03-30T12:36:03.018917+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:36:03.018917+0000","last_undegraded":"2024-03-30T12:36:03.018917+0000","last_fullsized":"2024-03-30T12:36:03.018917+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220120+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:36:03.220120+0000","last_peered":"2024-03-30T12:36:03.220120+0000","last_clean":"2024-03-30T12:36:03.220120+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:36:03.220120+0000","last_undegraded":"2024-03-30T12:36:03.220120+0000","last_fullsized":"2024-03-30T12:36:03.220120+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015273+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:36:03.015273+0000","last_peered":"2024-03-30T12:36:03.015273+0000","last_clean":"2024-03-30T12:36:03.015273+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:36:03.015273+0000","last_undegraded":"2024-03-30T12:36:03.015273+0000","last_fullsized":"2024-03-30T12:36:03.015273+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221954+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:36:03.221954+0000","last_peered":"2024-03-30T12:36:03.221954+0000","last_clean":"2024-03-30T12:36:03.221954+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:36:03.221954+0000","last_undegraded":"2024-03-30T12:36:03.221954+0000","last_fullsized":"2024-03-30T12:36:03.221954+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221038+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:36:03.221038+0000","last_peered":"2024-03-30T12:36:03.221038+0000","last_clean":"2024-03-30T12:36:03.221038+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:36:03.221038+0000","last_undegraded":"2024-03-30T12:36:03.221038+0000","last_fullsized":"2024-03-30T12:36:03.221038+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220172+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:36:03.220172+0000","last_peered":"2024-03-30T12:36:03.220172+0000","last_clean":"2024-03-30T12:36:03.220172+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:36:03.220172+0000","last_undegraded":"2024-03-30T12:36:03.220172+0000","last_fullsized":"2024-03-30T12:36:03.220172+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221004+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:36:03.221004+0000","last_peered":"2024-03-30T12:36:03.221004+0000","last_clean":"2024-03-30T12:36:03.221004+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:36:03.221004+0000","last_undegraded":"2024-03-30T12:36:03.221004+0000","last_fullsized":"2024-03-30T12:36:03.221004+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1176,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221139+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:36:03.221139+0000","last_peered":"2024-03-30T12:36:03.221139+0000","last_clean":"2024-03-30T12:36:03.221139+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:36:03.221139+0000","last_undegraded":"2024-03-30T12:36:03.221139+0000","last_fullsized":"2024-03-30T12:36:03.221139+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1280,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221301+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:36:03.221301+0000","last_peered":"2024-03-30T12:36:03.221301+0000","last_clean":"2024-03-30T12:36:03.221301+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:36:03.221301+0000","last_undegraded":"2024-03-30T12:36:03.221301+0000","last_fullsized":"2024-03-30T12:36:03.221301+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1237,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221506+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:36:03.221506+0000","last_peered":"2024-03-30T12:36:03.221506+0000","last_clean":"2024-03-30T12:36:03.221506+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:36:03.221506+0000","last_undegraded":"2024-03-30T12:36:03.221506+0000","last_fullsized":"2024-03-30T12:36:03.221506+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220227+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:03.220227+0000","last_peered":"2024-03-30T12:36:03.220227+0000","last_clean":"2024-03-30T12:36:03.220227+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:03.220227+0000","last_undegraded":"2024-03-30T12:36:03.220227+0000","last_fullsized":"2024-03-30T12:36:03.220227+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221549+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:36:03.221549+0000","last_peered":"2024-03-30T12:36:03.221549+0000","last_clean":"2024-03-30T12:36:03.221549+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:36:03.221549+0000","last_undegraded":"2024-03-30T12:36:03.221549+0000","last_fullsized":"2024-03-30T12:36:03.221549+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220926+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:36:03.220926+0000","last_peered":"2024-03-30T12:36:03.220926+0000","last_clean":"2024-03-30T12:36:03.220926+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:36:03.220926+0000","last_undegraded":"2024-03-30T12:36:03.220926+0000","last_fullsized":"2024-03-30T12:36:03.220926+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220599+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:36:03.220599+0000","last_peered":"2024-03-30T12:36:03.220599+0000","last_clean":"2024-03-30T12:36:03.220599+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:36:03.220599+0000","last_undegraded":"2024-03-30T12:36:03.220599+0000","last_fullsized":"2024-03-30T12:36:03.220599+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438040,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648096,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175106,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254345,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063163,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951220,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839277,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923560,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:37:38.434 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:38.434 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:38.434 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:38.434 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:38.434 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:38.434 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:38.434 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:38.434 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:38.434 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:38.435 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:38.435 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:38.435 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:38.435 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:38.435 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:37:39.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:38 smithi084 ceph-mon[89279]: pgmap v1038: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:39.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:38 smithi084 ceph-mon[91810]: pgmap v1038: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:39.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:38 smithi162 ceph-mon[83709]: pgmap v1038: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:39.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:37:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:37:39] "GET /metrics HTTP/1.1" 200 36328 "" "Prometheus/2.43.0" 2024-03-30T12:37:41.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:40 smithi084 ceph-mon[89279]: pgmap v1039: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:41.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:40 smithi084 ceph-mon[91810]: pgmap v1039: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:41.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:40 smithi162 ceph-mon[83709]: pgmap v1039: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:43.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:42 smithi084 ceph-mon[91810]: pgmap v1040: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:43.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:42 smithi084 ceph-mon[89279]: pgmap v1040: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:43.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:42 smithi162 ceph-mon[83709]: pgmap v1040: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:45.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:44 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:37:45.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:44 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:37:45.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:37:46.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:45 smithi162 ceph-mon[83709]: pgmap v1041: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:46.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:45 smithi084 ceph-mon[91810]: pgmap v1041: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:46.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:45 smithi084 ceph-mon[89279]: pgmap v1041: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:47.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:46 smithi084 ceph-mon[91810]: pgmap v1042: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:47.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:46 smithi084 ceph-mon[89279]: pgmap v1042: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:47.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:46 smithi162 ceph-mon[83709]: pgmap v1042: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:48.435 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:37:48.653 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:37:49.116 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:48 smithi084 ceph-mon[91810]: pgmap v1043: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:49.116 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:48 smithi084 ceph-mon[89279]: pgmap v1043: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:49.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:48 smithi162 ceph-mon[83709]: pgmap v1043: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:49.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:37:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:37:49] "GET /metrics HTTP/1.1" 200 36329 "" "Prometheus/2.43.0" 2024-03-30T12:37:50.593 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:37:50.595 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:37:51.201 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:50 smithi084 ceph-mon[89279]: from='client.44495 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:37:51.201 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:50 smithi084 ceph-mon[89279]: pgmap v1044: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:51.202 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:50 smithi084 ceph-mon[91810]: from='client.44495 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:37:51.202 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:50 smithi084 ceph-mon[91810]: pgmap v1044: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:51.223 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1043,"stamp":"2024-03-30T12:37:48.829442+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004038"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018672+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:36:03.018672+0000","last_peered":"2024-03-30T12:36:03.018672+0000","last_clean":"2024-03-30T12:36:03.018672+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:36:03.018672+0000","last_undegraded":"2024-03-30T12:36:03.018672+0000","last_fullsized":"2024-03-30T12:36:03.018672+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1363,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221634+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:36:03.221634+0000","last_peered":"2024-03-30T12:36:03.221634+0000","last_clean":"2024-03-30T12:36:03.221634+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:36:03.221634+0000","last_undegraded":"2024-03-30T12:36:03.221634+0000","last_fullsized":"2024-03-30T12:36:03.221634+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221207+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:36:03.221207+0000","last_peered":"2024-03-30T12:36:03.221207+0000","last_clean":"2024-03-30T12:36:03.221207+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:36:03.221207+0000","last_undegraded":"2024-03-30T12:36:03.221207+0000","last_fullsized":"2024-03-30T12:36:03.221207+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222119+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:36:03.222119+0000","last_peered":"2024-03-30T12:36:03.222119+0000","last_clean":"2024-03-30T12:36:03.222119+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:36:03.222119+0000","last_undegraded":"2024-03-30T12:36:03.222119+0000","last_fullsized":"2024-03-30T12:36:03.222119+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016806+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:36:03.016806+0000","last_peered":"2024-03-30T12:36:03.016806+0000","last_clean":"2024-03-30T12:36:03.016806+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:36:03.016806+0000","last_undegraded":"2024-03-30T12:36:03.016806+0000","last_fullsized":"2024-03-30T12:36:03.016806+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1209,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222566+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:03.222566+0000","last_peered":"2024-03-30T12:36:03.222566+0000","last_clean":"2024-03-30T12:36:03.222566+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:03.222566+0000","last_undegraded":"2024-03-30T12:36:03.222566+0000","last_fullsized":"2024-03-30T12:36:03.222566+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1159,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017295+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:36:03.017295+0000","last_peered":"2024-03-30T12:36:03.017295+0000","last_clean":"2024-03-30T12:36:03.017295+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:36:03.017295+0000","last_undegraded":"2024-03-30T12:36:03.017295+0000","last_fullsized":"2024-03-30T12:36:03.017295+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1257,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219724+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:36:03.219724+0000","last_peered":"2024-03-30T12:36:03.219724+0000","last_clean":"2024-03-30T12:36:03.219724+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:36:03.219724+0000","last_undegraded":"2024-03-30T12:36:03.219724+0000","last_fullsized":"2024-03-30T12:36:03.219724+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018011+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:36:03.018011+0000","last_peered":"2024-03-30T12:36:03.018011+0000","last_clean":"2024-03-30T12:36:03.018011+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:36:03.018011+0000","last_undegraded":"2024-03-30T12:36:03.018011+0000","last_fullsized":"2024-03-30T12:36:03.018011+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220774+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:03.220774+0000","last_peered":"2024-03-30T12:36:03.220774+0000","last_clean":"2024-03-30T12:36:03.220774+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:03.220774+0000","last_undegraded":"2024-03-30T12:36:03.220774+0000","last_fullsized":"2024-03-30T12:36:03.220774+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220468+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:03.220468+0000","last_peered":"2024-03-30T12:36:03.220468+0000","last_clean":"2024-03-30T12:36:03.220468+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:03.220468+0000","last_undegraded":"2024-03-30T12:36:03.220468+0000","last_fullsized":"2024-03-30T12:36:03.220468+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1269,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020196+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:36:03.020196+0000","last_peered":"2024-03-30T12:36:03.020196+0000","last_clean":"2024-03-30T12:36:03.020196+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:36:03.020196+0000","last_undegraded":"2024-03-30T12:36:03.020196+0000","last_fullsized":"2024-03-30T12:36:03.020196+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221688+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:36:03.221688+0000","last_peered":"2024-03-30T12:36:03.221688+0000","last_clean":"2024-03-30T12:36:03.221688+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:36:03.221688+0000","last_undegraded":"2024-03-30T12:36:03.221688+0000","last_fullsized":"2024-03-30T12:36:03.221688+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220445+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:36:03.220445+0000","last_peered":"2024-03-30T12:36:03.220445+0000","last_clean":"2024-03-30T12:36:03.220445+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:36:03.220445+0000","last_undegraded":"2024-03-30T12:36:03.220445+0000","last_fullsized":"2024-03-30T12:36:03.220445+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222534+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:36:03.222534+0000","last_peered":"2024-03-30T12:36:03.222534+0000","last_clean":"2024-03-30T12:36:03.222534+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:36:03.222534+0000","last_undegraded":"2024-03-30T12:36:03.222534+0000","last_fullsized":"2024-03-30T12:36:03.222534+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221410+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:36:03.221410+0000","last_peered":"2024-03-30T12:36:03.221410+0000","last_clean":"2024-03-30T12:36:03.221410+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:36:03.221410+0000","last_undegraded":"2024-03-30T12:36:03.221410+0000","last_fullsized":"2024-03-30T12:36:03.221410+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1223,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222946+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:36:03.222946+0000","last_peered":"2024-03-30T12:36:03.222946+0000","last_clean":"2024-03-30T12:36:03.222946+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:36:03.222946+0000","last_undegraded":"2024-03-30T12:36:03.222946+0000","last_fullsized":"2024-03-30T12:36:03.222946+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015999+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:36:03.015999+0000","last_peered":"2024-03-30T12:36:03.015999+0000","last_clean":"2024-03-30T12:36:03.015999+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:36:03.015999+0000","last_undegraded":"2024-03-30T12:36:03.015999+0000","last_fullsized":"2024-03-30T12:36:03.015999+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017955+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:36:03.017955+0000","last_peered":"2024-03-30T12:36:03.017955+0000","last_clean":"2024-03-30T12:36:03.017955+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:36:03.017955+0000","last_undegraded":"2024-03-30T12:36:03.017955+0000","last_fullsized":"2024-03-30T12:36:03.017955+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1387,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221082+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:36:03.221082+0000","last_peered":"2024-03-30T12:36:03.221082+0000","last_clean":"2024-03-30T12:36:03.221082+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:36:03.221082+0000","last_undegraded":"2024-03-30T12:36:03.221082+0000","last_fullsized":"2024-03-30T12:36:03.221082+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1281,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220779+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:36:03.220779+0000","last_peered":"2024-03-30T12:36:03.220779+0000","last_clean":"2024-03-30T12:36:03.220779+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:36:03.220779+0000","last_undegraded":"2024-03-30T12:36:03.220779+0000","last_fullsized":"2024-03-30T12:36:03.220779+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1300,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220968+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:36:03.220968+0000","last_peered":"2024-03-30T12:36:03.220968+0000","last_clean":"2024-03-30T12:36:03.220968+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:36:03.220968+0000","last_undegraded":"2024-03-30T12:36:03.220968+0000","last_fullsized":"2024-03-30T12:36:03.220968+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220378+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:36:03.220378+0000","last_peered":"2024-03-30T12:36:03.220378+0000","last_clean":"2024-03-30T12:36:03.220378+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:36:03.220378+0000","last_undegraded":"2024-03-30T12:36:03.220378+0000","last_fullsized":"2024-03-30T12:36:03.220378+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017887+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:36:03.017887+0000","last_peered":"2024-03-30T12:36:03.017887+0000","last_clean":"2024-03-30T12:36:03.017887+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:36:03.017887+0000","last_undegraded":"2024-03-30T12:36:03.017887+0000","last_fullsized":"2024-03-30T12:36:03.017887+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1228,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222708+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:03.222708+0000","last_peered":"2024-03-30T12:36:03.222708+0000","last_clean":"2024-03-30T12:36:03.222708+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:03.222708+0000","last_undegraded":"2024-03-30T12:36:03.222708+0000","last_fullsized":"2024-03-30T12:36:03.222708+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017639+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:36:03.017639+0000","last_peered":"2024-03-30T12:36:03.017639+0000","last_clean":"2024-03-30T12:36:03.017639+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:36:03.017639+0000","last_undegraded":"2024-03-30T12:36:03.017639+0000","last_fullsized":"2024-03-30T12:36:03.017639+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222301+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:03.222301+0000","last_peered":"2024-03-30T12:36:03.222301+0000","last_clean":"2024-03-30T12:36:03.222301+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:03.222301+0000","last_undegraded":"2024-03-30T12:36:03.222301+0000","last_fullsized":"2024-03-30T12:36:03.222301+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221804+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:36:03.221804+0000","last_peered":"2024-03-30T12:36:03.221804+0000","last_clean":"2024-03-30T12:36:03.221804+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:36:03.221804+0000","last_undegraded":"2024-03-30T12:36:03.221804+0000","last_fullsized":"2024-03-30T12:36:03.221804+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018855+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:36:03.018855+0000","last_peered":"2024-03-30T12:36:03.018855+0000","last_clean":"2024-03-30T12:36:03.018855+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:36:03.018855+0000","last_undegraded":"2024-03-30T12:36:03.018855+0000","last_fullsized":"2024-03-30T12:36:03.018855+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1179,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220575+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:36:03.220575+0000","last_peered":"2024-03-30T12:36:03.220575+0000","last_clean":"2024-03-30T12:36:03.220575+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:36:03.220575+0000","last_undegraded":"2024-03-30T12:36:03.220575+0000","last_fullsized":"2024-03-30T12:36:03.220575+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221577+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:36:03.221577+0000","last_peered":"2024-03-30T12:36:03.221577+0000","last_clean":"2024-03-30T12:36:03.221577+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:36:03.221577+0000","last_undegraded":"2024-03-30T12:36:03.221577+0000","last_fullsized":"2024-03-30T12:36:03.221577+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219839+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:36:03.219839+0000","last_peered":"2024-03-30T12:36:03.219839+0000","last_clean":"2024-03-30T12:36:03.219839+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:36:03.219839+0000","last_undegraded":"2024-03-30T12:36:03.219839+0000","last_fullsized":"2024-03-30T12:36:03.219839+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1294,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219823+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:36:03.219823+0000","last_peered":"2024-03-30T12:36:03.219823+0000","last_clean":"2024-03-30T12:36:03.219823+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:36:03.219823+0000","last_undegraded":"2024-03-30T12:36:03.219823+0000","last_fullsized":"2024-03-30T12:36:03.219823+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1223,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221769+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:36:03.221769+0000","last_peered":"2024-03-30T12:36:03.221769+0000","last_clean":"2024-03-30T12:36:03.221769+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:36:03.221769+0000","last_undegraded":"2024-03-30T12:36:03.221769+0000","last_fullsized":"2024-03-30T12:36:03.221769+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222968+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:36:03.222968+0000","last_peered":"2024-03-30T12:36:03.222968+0000","last_clean":"2024-03-30T12:36:03.222968+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:36:03.222968+0000","last_undegraded":"2024-03-30T12:36:03.222968+0000","last_fullsized":"2024-03-30T12:36:03.222968+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220821+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:03.220821+0000","last_peered":"2024-03-30T12:36:03.220821+0000","last_clean":"2024-03-30T12:36:03.220821+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:03.220821+0000","last_undegraded":"2024-03-30T12:36:03.220821+0000","last_fullsized":"2024-03-30T12:36:03.220821+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1203,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222317+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:36:03.222317+0000","last_peered":"2024-03-30T12:36:03.222317+0000","last_clean":"2024-03-30T12:36:03.222317+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:36:03.222317+0000","last_undegraded":"2024-03-30T12:36:03.222317+0000","last_fullsized":"2024-03-30T12:36:03.222317+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1197,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222067+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:36:03.222067+0000","last_peered":"2024-03-30T12:36:03.222067+0000","last_clean":"2024-03-30T12:36:03.222067+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:36:03.222067+0000","last_undegraded":"2024-03-30T12:36:03.222067+0000","last_fullsized":"2024-03-30T12:36:03.222067+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015739+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:36:03.015739+0000","last_peered":"2024-03-30T12:36:03.015739+0000","last_clean":"2024-03-30T12:36:03.015739+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:36:03.015739+0000","last_undegraded":"2024-03-30T12:36:03.015739+0000","last_fullsized":"2024-03-30T12:36:03.015739+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221275+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:36:03.221275+0000","last_peered":"2024-03-30T12:36:03.221275+0000","last_clean":"2024-03-30T12:36:03.221275+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:36:03.221275+0000","last_undegraded":"2024-03-30T12:36:03.221275+0000","last_fullsized":"2024-03-30T12:36:03.221275+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020038+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:36:03.020038+0000","last_peered":"2024-03-30T12:36:03.020038+0000","last_clean":"2024-03-30T12:36:03.020038+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:36:03.020038+0000","last_undegraded":"2024-03-30T12:36:03.020038+0000","last_fullsized":"2024-03-30T12:36:03.020038+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1204,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220837+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:36:03.220837+0000","last_peered":"2024-03-30T12:36:03.220837+0000","last_clean":"2024-03-30T12:36:03.220837+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:36:03.220837+0000","last_undegraded":"2024-03-30T12:36:03.220837+0000","last_fullsized":"2024-03-30T12:36:03.220837+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017435+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:36:03.017435+0000","last_peered":"2024-03-30T12:36:03.017435+0000","last_clean":"2024-03-30T12:36:03.017435+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:36:03.017435+0000","last_undegraded":"2024-03-30T12:36:03.017435+0000","last_fullsized":"2024-03-30T12:36:03.017435+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221717+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:36:03.221717+0000","last_peered":"2024-03-30T12:36:03.221717+0000","last_clean":"2024-03-30T12:36:03.221717+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:36:03.221717+0000","last_undegraded":"2024-03-30T12:36:03.221717+0000","last_fullsized":"2024-03-30T12:36:03.221717+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220742+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:36:03.220742+0000","last_peered":"2024-03-30T12:36:03.220742+0000","last_clean":"2024-03-30T12:36:03.220742+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:36:03.220742+0000","last_undegraded":"2024-03-30T12:36:03.220742+0000","last_fullsized":"2024-03-30T12:36:03.220742+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221904+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:36:03.221904+0000","last_peered":"2024-03-30T12:36:03.221904+0000","last_clean":"2024-03-30T12:36:03.221904+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:36:03.221904+0000","last_undegraded":"2024-03-30T12:36:03.221904+0000","last_fullsized":"2024-03-30T12:36:03.221904+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017508+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:36:03.017508+0000","last_peered":"2024-03-30T12:36:03.017508+0000","last_clean":"2024-03-30T12:36:03.017508+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:36:03.017508+0000","last_undegraded":"2024-03-30T12:36:03.017508+0000","last_fullsized":"2024-03-30T12:36:03.017508+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220253+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:36:03.220253+0000","last_peered":"2024-03-30T12:36:03.220253+0000","last_clean":"2024-03-30T12:36:03.220253+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:36:03.220253+0000","last_undegraded":"2024-03-30T12:36:03.220253+0000","last_fullsized":"2024-03-30T12:36:03.220253+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220192+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:36:03.220192+0000","last_peered":"2024-03-30T12:36:03.220192+0000","last_clean":"2024-03-30T12:36:03.220192+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:36:03.220192+0000","last_undegraded":"2024-03-30T12:36:03.220192+0000","last_fullsized":"2024-03-30T12:36:03.220192+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1343,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015636+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:36:03.015636+0000","last_peered":"2024-03-30T12:36:03.015636+0000","last_clean":"2024-03-30T12:36:03.015636+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:36:03.015636+0000","last_undegraded":"2024-03-30T12:36:03.015636+0000","last_fullsized":"2024-03-30T12:36:03.015636+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016619+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:36:03.016619+0000","last_peered":"2024-03-30T12:36:03.016619+0000","last_clean":"2024-03-30T12:36:03.016619+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:36:03.016619+0000","last_undegraded":"2024-03-30T12:36:03.016619+0000","last_fullsized":"2024-03-30T12:36:03.016619+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5751,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.016013+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:36:03.016013+0000","last_peered":"2024-03-30T12:36:03.016013+0000","last_clean":"2024-03-30T12:36:03.016013+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:36:03.016013+0000","last_undegraded":"2024-03-30T12:36:03.016013+0000","last_fullsized":"2024-03-30T12:36:03.016013+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020404+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:36:03.020404+0000","last_peered":"2024-03-30T12:36:03.020404+0000","last_clean":"2024-03-30T12:36:03.020404+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:36:03.020404+0000","last_undegraded":"2024-03-30T12:36:03.020404+0000","last_fullsized":"2024-03-30T12:36:03.020404+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018051+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:36:03.018051+0000","last_peered":"2024-03-30T12:36:03.018051+0000","last_clean":"2024-03-30T12:36:03.018051+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:36:03.018051+0000","last_undegraded":"2024-03-30T12:36:03.018051+0000","last_fullsized":"2024-03-30T12:36:03.018051+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5512,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.222067+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:36:03.222067+0000","last_peered":"2024-03-30T12:36:03.222067+0000","last_clean":"2024-03-30T12:36:03.222067+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:36:03.222067+0000","last_undegraded":"2024-03-30T12:36:03.222067+0000","last_fullsized":"2024-03-30T12:36:03.222067+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220604+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:36:03.220604+0000","last_peered":"2024-03-30T12:36:03.220604+0000","last_clean":"2024-03-30T12:36:03.220604+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:36:03.220604+0000","last_undegraded":"2024-03-30T12:36:03.220604+0000","last_fullsized":"2024-03-30T12:36:03.220604+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1346,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222463+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:36:03.222463+0000","last_peered":"2024-03-30T12:36:03.222463+0000","last_clean":"2024-03-30T12:36:03.222463+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:36:03.222463+0000","last_undegraded":"2024-03-30T12:36:03.222463+0000","last_fullsized":"2024-03-30T12:36:03.222463+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222511+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:36:03.222511+0000","last_peered":"2024-03-30T12:36:03.222511+0000","last_clean":"2024-03-30T12:36:03.222511+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:36:03.222511+0000","last_undegraded":"2024-03-30T12:36:03.222511+0000","last_fullsized":"2024-03-30T12:36:03.222511+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5457,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.222052+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:36:03.222052+0000","last_peered":"2024-03-30T12:36:03.222052+0000","last_clean":"2024-03-30T12:36:03.222052+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:36:03.222052+0000","last_undegraded":"2024-03-30T12:36:03.222052+0000","last_fullsized":"2024-03-30T12:36:03.222052+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222581+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:36:03.222581+0000","last_peered":"2024-03-30T12:36:03.222581+0000","last_clean":"2024-03-30T12:36:03.222581+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:36:03.222581+0000","last_undegraded":"2024-03-30T12:36:03.222581+0000","last_fullsized":"2024-03-30T12:36:03.222581+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221692+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:36:03.221692+0000","last_peered":"2024-03-30T12:36:03.221692+0000","last_clean":"2024-03-30T12:36:03.221692+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:36:03.221692+0000","last_undegraded":"2024-03-30T12:36:03.221692+0000","last_fullsized":"2024-03-30T12:36:03.221692+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1271,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019374+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:36:03.019374+0000","last_peered":"2024-03-30T12:36:03.019374+0000","last_clean":"2024-03-30T12:36:03.019374+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:36:03.019374+0000","last_undegraded":"2024-03-30T12:36:03.019374+0000","last_fullsized":"2024-03-30T12:36:03.019374+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3802,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016632+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:36:03.016632+0000","last_peered":"2024-03-30T12:36:03.016632+0000","last_clean":"2024-03-30T12:36:03.016632+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:36:03.016632+0000","last_undegraded":"2024-03-30T12:36:03.016632+0000","last_fullsized":"2024-03-30T12:36:03.016632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1342,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222978+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:36:03.222978+0000","last_peered":"2024-03-30T12:36:03.222978+0000","last_clean":"2024-03-30T12:36:03.222978+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:36:03.222978+0000","last_undegraded":"2024-03-30T12:36:03.222978+0000","last_fullsized":"2024-03-30T12:36:03.222978+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222036+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:36:03.222036+0000","last_peered":"2024-03-30T12:36:03.222036+0000","last_clean":"2024-03-30T12:36:03.222036+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:36:03.222036+0000","last_undegraded":"2024-03-30T12:36:03.222036+0000","last_fullsized":"2024-03-30T12:36:03.222036+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015232+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:36:03.015232+0000","last_peered":"2024-03-30T12:36:03.015232+0000","last_clean":"2024-03-30T12:36:03.015232+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:36:03.015232+0000","last_undegraded":"2024-03-30T12:36:03.015232+0000","last_fullsized":"2024-03-30T12:36:03.015232+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4575,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.019196+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:36:03.019196+0000","last_peered":"2024-03-30T12:36:03.019196+0000","last_clean":"2024-03-30T12:36:03.019196+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:36:03.019196+0000","last_undegraded":"2024-03-30T12:36:03.019196+0000","last_fullsized":"2024-03-30T12:36:03.019196+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1173,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220732+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:36:03.220732+0000","last_peered":"2024-03-30T12:36:03.220732+0000","last_clean":"2024-03-30T12:36:03.220732+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:36:03.220732+0000","last_undegraded":"2024-03-30T12:36:03.220732+0000","last_fullsized":"2024-03-30T12:36:03.220732+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221414+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:36:03.221414+0000","last_peered":"2024-03-30T12:36:03.221414+0000","last_clean":"2024-03-30T12:36:03.221414+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:36:03.221414+0000","last_undegraded":"2024-03-30T12:36:03.221414+0000","last_fullsized":"2024-03-30T12:36:03.221414+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1199,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222181+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:36:03.222181+0000","last_peered":"2024-03-30T12:36:03.222181+0000","last_clean":"2024-03-30T12:36:03.222181+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:36:03.222181+0000","last_undegraded":"2024-03-30T12:36:03.222181+0000","last_fullsized":"2024-03-30T12:36:03.222181+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1715,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016476+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:36:03.016476+0000","last_peered":"2024-03-30T12:36:03.016476+0000","last_clean":"2024-03-30T12:36:03.016476+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:36:03.016476+0000","last_undegraded":"2024-03-30T12:36:03.016476+0000","last_fullsized":"2024-03-30T12:36:03.016476+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24713,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223744+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:36:03.223744+0000","last_peered":"2024-03-30T12:36:03.223744+0000","last_clean":"2024-03-30T12:36:03.223744+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:36:03.223744+0000","last_undegraded":"2024-03-30T12:36:03.223744+0000","last_fullsized":"2024-03-30T12:36:03.223744+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220614+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:36:03.220614+0000","last_peered":"2024-03-30T12:36:03.220614+0000","last_clean":"2024-03-30T12:36:03.220614+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:36:03.220614+0000","last_undegraded":"2024-03-30T12:36:03.220614+0000","last_fullsized":"2024-03-30T12:36:03.220614+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220696+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:36:03.220696+0000","last_peered":"2024-03-30T12:36:03.220696+0000","last_clean":"2024-03-30T12:36:03.220696+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:36:03.220696+0000","last_undegraded":"2024-03-30T12:36:03.220696+0000","last_fullsized":"2024-03-30T12:36:03.220696+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1143,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016477+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:36:03.016477+0000","last_peered":"2024-03-30T12:36:03.016477+0000","last_clean":"2024-03-30T12:36:03.016477+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:36:03.016477+0000","last_undegraded":"2024-03-30T12:36:03.016477+0000","last_fullsized":"2024-03-30T12:36:03.016477+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16479,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.221375+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:36:03.221375+0000","last_peered":"2024-03-30T12:36:03.221375+0000","last_clean":"2024-03-30T12:36:03.221375+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:36:03.221375+0000","last_undegraded":"2024-03-30T12:36:03.221375+0000","last_fullsized":"2024-03-30T12:36:03.221375+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221448+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:36:03.221448+0000","last_peered":"2024-03-30T12:36:03.221448+0000","last_clean":"2024-03-30T12:36:03.221448+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:36:03.221448+0000","last_undegraded":"2024-03-30T12:36:03.221448+0000","last_fullsized":"2024-03-30T12:36:03.221448+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017748+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:36:03.017748+0000","last_peered":"2024-03-30T12:36:03.017748+0000","last_clean":"2024-03-30T12:36:03.017748+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:36:03.017748+0000","last_undegraded":"2024-03-30T12:36:03.017748+0000","last_fullsized":"2024-03-30T12:36:03.017748+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222675+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:36:03.222675+0000","last_peered":"2024-03-30T12:36:03.222675+0000","last_clean":"2024-03-30T12:36:03.222675+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:36:03.222675+0000","last_undegraded":"2024-03-30T12:36:03.222675+0000","last_fullsized":"2024-03-30T12:36:03.222675+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31268,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.021096+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:36:03.021096+0000","last_peered":"2024-03-30T12:36:03.021096+0000","last_clean":"2024-03-30T12:36:03.021096+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:36:03.021096+0000","last_undegraded":"2024-03-30T12:36:03.021096+0000","last_fullsized":"2024-03-30T12:36:03.021096+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1293,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219877+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:36:03.219877+0000","last_peered":"2024-03-30T12:36:03.219877+0000","last_clean":"2024-03-30T12:36:03.219877+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:36:03.219877+0000","last_undegraded":"2024-03-30T12:36:03.219877+0000","last_fullsized":"2024-03-30T12:36:03.219877+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221733+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:36:03.221733+0000","last_peered":"2024-03-30T12:36:03.221733+0000","last_clean":"2024-03-30T12:36:03.221733+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:36:03.221733+0000","last_undegraded":"2024-03-30T12:36:03.221733+0000","last_fullsized":"2024-03-30T12:36:03.221733+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221129+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:36:03.221129+0000","last_peered":"2024-03-30T12:36:03.221129+0000","last_clean":"2024-03-30T12:36:03.221129+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:36:03.221129+0000","last_undegraded":"2024-03-30T12:36:03.221129+0000","last_fullsized":"2024-03-30T12:36:03.221129+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3763,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219946+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:36:03.219946+0000","last_peered":"2024-03-30T12:36:03.219946+0000","last_clean":"2024-03-30T12:36:03.219946+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:36:03.219946+0000","last_undegraded":"2024-03-30T12:36:03.219946+0000","last_fullsized":"2024-03-30T12:36:03.219946+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019149+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:36:03.019149+0000","last_peered":"2024-03-30T12:36:03.019149+0000","last_clean":"2024-03-30T12:36:03.019149+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:36:03.019149+0000","last_undegraded":"2024-03-30T12:36:03.019149+0000","last_fullsized":"2024-03-30T12:36:03.019149+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220680+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:36:03.220680+0000","last_peered":"2024-03-30T12:36:03.220680+0000","last_clean":"2024-03-30T12:36:03.220680+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:36:03.220680+0000","last_undegraded":"2024-03-30T12:36:03.220680+0000","last_fullsized":"2024-03-30T12:36:03.220680+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220354+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:36:03.220354+0000","last_peered":"2024-03-30T12:36:03.220354+0000","last_clean":"2024-03-30T12:36:03.220354+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:36:03.220354+0000","last_undegraded":"2024-03-30T12:36:03.220354+0000","last_fullsized":"2024-03-30T12:36:03.220354+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15592,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223226+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:36:03.223226+0000","last_peered":"2024-03-30T12:36:03.223226+0000","last_clean":"2024-03-30T12:36:03.223226+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:36:03.223226+0000","last_undegraded":"2024-03-30T12:36:03.223226+0000","last_fullsized":"2024-03-30T12:36:03.223226+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1142,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016783+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:36:03.016783+0000","last_peered":"2024-03-30T12:36:03.016783+0000","last_clean":"2024-03-30T12:36:03.016783+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:36:03.016783+0000","last_undegraded":"2024-03-30T12:36:03.016783+0000","last_fullsized":"2024-03-30T12:36:03.016783+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1257,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018978+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:36:03.018978+0000","last_peered":"2024-03-30T12:36:03.018978+0000","last_clean":"2024-03-30T12:36:03.018978+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:36:03.018978+0000","last_undegraded":"2024-03-30T12:36:03.018978+0000","last_fullsized":"2024-03-30T12:36:03.018978+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29019,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.020881+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:36:03.020881+0000","last_peered":"2024-03-30T12:36:03.020881+0000","last_clean":"2024-03-30T12:36:03.020881+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:36:03.020881+0000","last_undegraded":"2024-03-30T12:36:03.020881+0000","last_fullsized":"2024-03-30T12:36:03.020881+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222681+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:36:03.222681+0000","last_peered":"2024-03-30T12:36:03.222681+0000","last_clean":"2024-03-30T12:36:03.222681+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:36:03.222681+0000","last_undegraded":"2024-03-30T12:36:03.222681+0000","last_fullsized":"2024-03-30T12:36:03.222681+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220045+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:36:03.220045+0000","last_peered":"2024-03-30T12:36:03.220045+0000","last_clean":"2024-03-30T12:36:03.220045+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:36:03.220045+0000","last_undegraded":"2024-03-30T12:36:03.220045+0000","last_fullsized":"2024-03-30T12:36:03.220045+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5609,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.017229+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:36:03.017229+0000","last_peered":"2024-03-30T12:36:03.017229+0000","last_clean":"2024-03-30T12:36:03.017229+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:36:03.017229+0000","last_undegraded":"2024-03-30T12:36:03.017229+0000","last_fullsized":"2024-03-30T12:36:03.017229+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1364,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220455+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:36:03.220455+0000","last_peered":"2024-03-30T12:36:03.220455+0000","last_clean":"2024-03-30T12:36:03.220455+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:36:03.220455+0000","last_undegraded":"2024-03-30T12:36:03.220455+0000","last_fullsized":"2024-03-30T12:36:03.220455+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221588+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:03.221588+0000","last_peered":"2024-03-30T12:36:03.221588+0000","last_clean":"2024-03-30T12:36:03.221588+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:03.221588+0000","last_undegraded":"2024-03-30T12:36:03.221588+0000","last_fullsized":"2024-03-30T12:36:03.221588+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222830+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:36:03.222830+0000","last_peered":"2024-03-30T12:36:03.222830+0000","last_clean":"2024-03-30T12:36:03.222830+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:36:03.222830+0000","last_undegraded":"2024-03-30T12:36:03.222830+0000","last_fullsized":"2024-03-30T12:36:03.222830+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017355+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:36:03.017355+0000","last_peered":"2024-03-30T12:36:03.017355+0000","last_clean":"2024-03-30T12:36:03.017355+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:36:03.017355+0000","last_undegraded":"2024-03-30T12:36:03.017355+0000","last_fullsized":"2024-03-30T12:36:03.017355+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221062+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:36:03.221062+0000","last_peered":"2024-03-30T12:36:03.221062+0000","last_clean":"2024-03-30T12:36:03.221062+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:36:03.221062+0000","last_undegraded":"2024-03-30T12:36:03.221062+0000","last_fullsized":"2024-03-30T12:36:03.221062+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5252,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.017068+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:36:03.017068+0000","last_peered":"2024-03-30T12:36:03.017068+0000","last_clean":"2024-03-30T12:36:03.017068+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:36:03.017068+0000","last_undegraded":"2024-03-30T12:36:03.017068+0000","last_fullsized":"2024-03-30T12:36:03.017068+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1330,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016069+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:36:03.016069+0000","last_peered":"2024-03-30T12:36:03.016069+0000","last_clean":"2024-03-30T12:36:03.016069+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:36:03.016069+0000","last_undegraded":"2024-03-30T12:36:03.016069+0000","last_fullsized":"2024-03-30T12:36:03.016069+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017799+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:36:03.017799+0000","last_peered":"2024-03-30T12:36:03.017799+0000","last_clean":"2024-03-30T12:36:03.017799+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:36:03.017799+0000","last_undegraded":"2024-03-30T12:36:03.017799+0000","last_fullsized":"2024-03-30T12:36:03.017799+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4809,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.016990+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:36:03.016990+0000","last_peered":"2024-03-30T12:36:03.016990+0000","last_clean":"2024-03-30T12:36:03.016990+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:36:03.016990+0000","last_undegraded":"2024-03-30T12:36:03.016990+0000","last_fullsized":"2024-03-30T12:36:03.016990+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220902+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:36:03.220902+0000","last_peered":"2024-03-30T12:36:03.220902+0000","last_clean":"2024-03-30T12:36:03.220902+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:36:03.220902+0000","last_undegraded":"2024-03-30T12:36:03.220902+0000","last_fullsized":"2024-03-30T12:36:03.220902+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222557+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:36:03.222557+0000","last_peered":"2024-03-30T12:36:03.222557+0000","last_clean":"2024-03-30T12:36:03.222557+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:36:03.222557+0000","last_undegraded":"2024-03-30T12:36:03.222557+0000","last_fullsized":"2024-03-30T12:36:03.222557+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6742,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.018791+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:36:03.018791+0000","last_peered":"2024-03-30T12:36:03.018791+0000","last_clean":"2024-03-30T12:36:03.018791+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:36:03.018791+0000","last_undegraded":"2024-03-30T12:36:03.018791+0000","last_fullsized":"2024-03-30T12:36:03.018791+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1336,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016373+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:36:03.016373+0000","last_peered":"2024-03-30T12:36:03.016373+0000","last_clean":"2024-03-30T12:36:03.016373+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:36:03.016373+0000","last_undegraded":"2024-03-30T12:36:03.016373+0000","last_fullsized":"2024-03-30T12:36:03.016373+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018917+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:36:03.018917+0000","last_peered":"2024-03-30T12:36:03.018917+0000","last_clean":"2024-03-30T12:36:03.018917+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:36:03.018917+0000","last_undegraded":"2024-03-30T12:36:03.018917+0000","last_fullsized":"2024-03-30T12:36:03.018917+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220120+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:36:03.220120+0000","last_peered":"2024-03-30T12:36:03.220120+0000","last_clean":"2024-03-30T12:36:03.220120+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:36:03.220120+0000","last_undegraded":"2024-03-30T12:36:03.220120+0000","last_fullsized":"2024-03-30T12:36:03.220120+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015330+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:36:03.015330+0000","last_peered":"2024-03-30T12:36:03.015330+0000","last_clean":"2024-03-30T12:36:03.015330+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:36:03.015330+0000","last_undegraded":"2024-03-30T12:36:03.015330+0000","last_fullsized":"2024-03-30T12:36:03.015330+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221954+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:36:03.221954+0000","last_peered":"2024-03-30T12:36:03.221954+0000","last_clean":"2024-03-30T12:36:03.221954+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:36:03.221954+0000","last_undegraded":"2024-03-30T12:36:03.221954+0000","last_fullsized":"2024-03-30T12:36:03.221954+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221038+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:36:03.221038+0000","last_peered":"2024-03-30T12:36:03.221038+0000","last_clean":"2024-03-30T12:36:03.221038+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:36:03.221038+0000","last_undegraded":"2024-03-30T12:36:03.221038+0000","last_fullsized":"2024-03-30T12:36:03.221038+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220172+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:36:03.220172+0000","last_peered":"2024-03-30T12:36:03.220172+0000","last_clean":"2024-03-30T12:36:03.220172+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:36:03.220172+0000","last_undegraded":"2024-03-30T12:36:03.220172+0000","last_fullsized":"2024-03-30T12:36:03.220172+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221044+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:36:03.221044+0000","last_peered":"2024-03-30T12:36:03.221044+0000","last_clean":"2024-03-30T12:36:03.221044+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:36:03.221044+0000","last_undegraded":"2024-03-30T12:36:03.221044+0000","last_fullsized":"2024-03-30T12:36:03.221044+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1176,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221139+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:36:03.221139+0000","last_peered":"2024-03-30T12:36:03.221139+0000","last_clean":"2024-03-30T12:36:03.221139+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:36:03.221139+0000","last_undegraded":"2024-03-30T12:36:03.221139+0000","last_fullsized":"2024-03-30T12:36:03.221139+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1280,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221301+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:36:03.221301+0000","last_peered":"2024-03-30T12:36:03.221301+0000","last_clean":"2024-03-30T12:36:03.221301+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:36:03.221301+0000","last_undegraded":"2024-03-30T12:36:03.221301+0000","last_fullsized":"2024-03-30T12:36:03.221301+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221612+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:36:03.221612+0000","last_peered":"2024-03-30T12:36:03.221612+0000","last_clean":"2024-03-30T12:36:03.221612+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:36:03.221612+0000","last_undegraded":"2024-03-30T12:36:03.221612+0000","last_fullsized":"2024-03-30T12:36:03.221612+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220227+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:03.220227+0000","last_peered":"2024-03-30T12:36:03.220227+0000","last_clean":"2024-03-30T12:36:03.220227+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:03.220227+0000","last_undegraded":"2024-03-30T12:36:03.220227+0000","last_fullsized":"2024-03-30T12:36:03.220227+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221549+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:36:03.221549+0000","last_peered":"2024-03-30T12:36:03.221549+0000","last_clean":"2024-03-30T12:36:03.221549+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:36:03.221549+0000","last_undegraded":"2024-03-30T12:36:03.221549+0000","last_fullsized":"2024-03-30T12:36:03.221549+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220926+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:36:03.220926+0000","last_peered":"2024-03-30T12:36:03.220926+0000","last_clean":"2024-03-30T12:36:03.220926+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:36:03.220926+0000","last_undegraded":"2024-03-30T12:36:03.220926+0000","last_fullsized":"2024-03-30T12:36:03.220926+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220599+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:36:03.220599+0000","last_peered":"2024-03-30T12:36:03.220599+0000","last_clean":"2024-03-30T12:36:03.220599+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:36:03.220599+0000","last_undegraded":"2024-03-30T12:36:03.220599+0000","last_fullsized":"2024-03-30T12:36:03.220599+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438042,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648098,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175108,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254347,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063166,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951223,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839280,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923562,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:37:51.228 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:51.228 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:51.228 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:51.229 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:51.229 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:51.229 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:51.229 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:51.229 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:51.229 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:51.229 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:51.229 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:51.229 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:51.229 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:37:51.229 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:37:51.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:50 smithi162 ceph-mon[83709]: from='client.44495 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:37:51.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:50 smithi162 ceph-mon[83709]: pgmap v1044: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:53.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:52 smithi084 ceph-mon[91810]: pgmap v1045: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:53.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:52 smithi084 ceph-mon[89279]: pgmap v1045: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:53.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:52 smithi162 ceph-mon[83709]: pgmap v1045: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:55.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:54 smithi084 ceph-mon[91810]: pgmap v1046: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:55.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:54 smithi084 ceph-mon[89279]: pgmap v1046: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:55.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:54 smithi162 ceph-mon[83709]: pgmap v1046: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:57.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:56 smithi084 ceph-mon[91810]: pgmap v1047: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:57.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:56 smithi084 ceph-mon[89279]: pgmap v1047: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:57.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:56 smithi162 ceph-mon[83709]: pgmap v1047: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:59.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:58 smithi084 ceph-mon[91810]: pgmap v1048: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:59.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:58 smithi084 ceph-mon[89279]: pgmap v1048: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:59.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:58 smithi162 ceph-mon[83709]: pgmap v1048: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:37:59.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:37:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:37:59] "GET /metrics HTTP/1.1" 200 36329 "" "Prometheus/2.43.0" 2024-03-30T12:38:00.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:37:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:38:00.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:37:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:38:00.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:37:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:38:01.230 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:38:01.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:00 smithi084 ceph-mon[91810]: pgmap v1049: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:01.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:00 smithi084 ceph-mon[89279]: pgmap v1049: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:01.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:00 smithi162 ceph-mon[83709]: pgmap v1049: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:01.449 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:38:03.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:02 smithi084 ceph-mon[91810]: pgmap v1050: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:03.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:02 smithi084 ceph-mon[89279]: pgmap v1050: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:03.171 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:02 smithi162 ceph-mon[83709]: pgmap v1050: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:03.322 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:38:03.324 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:38:04.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:03 smithi084 ceph-mon[91810]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:38:04.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:03 smithi084 ceph-mon[89279]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:38:04.041 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1050,"stamp":"2024-03-30T12:38:02.834095+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004019"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018672+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:36:03.018672+0000","last_peered":"2024-03-30T12:36:03.018672+0000","last_clean":"2024-03-30T12:36:03.018672+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:36:03.018672+0000","last_undegraded":"2024-03-30T12:36:03.018672+0000","last_fullsized":"2024-03-30T12:36:03.018672+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1363,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221634+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:36:03.221634+0000","last_peered":"2024-03-30T12:36:03.221634+0000","last_clean":"2024-03-30T12:36:03.221634+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:36:03.221634+0000","last_undegraded":"2024-03-30T12:36:03.221634+0000","last_fullsized":"2024-03-30T12:36:03.221634+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221207+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:36:03.221207+0000","last_peered":"2024-03-30T12:36:03.221207+0000","last_clean":"2024-03-30T12:36:03.221207+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:36:03.221207+0000","last_undegraded":"2024-03-30T12:36:03.221207+0000","last_fullsized":"2024-03-30T12:36:03.221207+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222119+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:36:03.222119+0000","last_peered":"2024-03-30T12:36:03.222119+0000","last_clean":"2024-03-30T12:36:03.222119+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:36:03.222119+0000","last_undegraded":"2024-03-30T12:36:03.222119+0000","last_fullsized":"2024-03-30T12:36:03.222119+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016863+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:36:03.016863+0000","last_peered":"2024-03-30T12:36:03.016863+0000","last_clean":"2024-03-30T12:36:03.016863+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:36:03.016863+0000","last_undegraded":"2024-03-30T12:36:03.016863+0000","last_fullsized":"2024-03-30T12:36:03.016863+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1209,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222566+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:03.222566+0000","last_peered":"2024-03-30T12:36:03.222566+0000","last_clean":"2024-03-30T12:36:03.222566+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:03.222566+0000","last_undegraded":"2024-03-30T12:36:03.222566+0000","last_fullsized":"2024-03-30T12:36:03.222566+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017365+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:36:03.017365+0000","last_peered":"2024-03-30T12:36:03.017365+0000","last_clean":"2024-03-30T12:36:03.017365+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:36:03.017365+0000","last_undegraded":"2024-03-30T12:36:03.017365+0000","last_fullsized":"2024-03-30T12:36:03.017365+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219781+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:36:03.219781+0000","last_peered":"2024-03-30T12:36:03.219781+0000","last_clean":"2024-03-30T12:36:03.219781+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:36:03.219781+0000","last_undegraded":"2024-03-30T12:36:03.219781+0000","last_fullsized":"2024-03-30T12:36:03.219781+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018011+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:36:03.018011+0000","last_peered":"2024-03-30T12:36:03.018011+0000","last_clean":"2024-03-30T12:36:03.018011+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:36:03.018011+0000","last_undegraded":"2024-03-30T12:36:03.018011+0000","last_fullsized":"2024-03-30T12:36:03.018011+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220774+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:03.220774+0000","last_peered":"2024-03-30T12:36:03.220774+0000","last_clean":"2024-03-30T12:36:03.220774+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:03.220774+0000","last_undegraded":"2024-03-30T12:36:03.220774+0000","last_fullsized":"2024-03-30T12:36:03.220774+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220468+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:03.220468+0000","last_peered":"2024-03-30T12:36:03.220468+0000","last_clean":"2024-03-30T12:36:03.220468+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:03.220468+0000","last_undegraded":"2024-03-30T12:36:03.220468+0000","last_fullsized":"2024-03-30T12:36:03.220468+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1269,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020196+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:36:03.020196+0000","last_peered":"2024-03-30T12:36:03.020196+0000","last_clean":"2024-03-30T12:36:03.020196+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:36:03.020196+0000","last_undegraded":"2024-03-30T12:36:03.020196+0000","last_fullsized":"2024-03-30T12:36:03.020196+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221688+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:36:03.221688+0000","last_peered":"2024-03-30T12:36:03.221688+0000","last_clean":"2024-03-30T12:36:03.221688+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:36:03.221688+0000","last_undegraded":"2024-03-30T12:36:03.221688+0000","last_fullsized":"2024-03-30T12:36:03.221688+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220487+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:36:03.220487+0000","last_peered":"2024-03-30T12:36:03.220487+0000","last_clean":"2024-03-30T12:36:03.220487+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:36:03.220487+0000","last_undegraded":"2024-03-30T12:36:03.220487+0000","last_fullsized":"2024-03-30T12:36:03.220487+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222534+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:36:03.222534+0000","last_peered":"2024-03-30T12:36:03.222534+0000","last_clean":"2024-03-30T12:36:03.222534+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:36:03.222534+0000","last_undegraded":"2024-03-30T12:36:03.222534+0000","last_fullsized":"2024-03-30T12:36:03.222534+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221410+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:36:03.221410+0000","last_peered":"2024-03-30T12:36:03.221410+0000","last_clean":"2024-03-30T12:36:03.221410+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:36:03.221410+0000","last_undegraded":"2024-03-30T12:36:03.221410+0000","last_fullsized":"2024-03-30T12:36:03.221410+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1223,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222946+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:36:03.222946+0000","last_peered":"2024-03-30T12:36:03.222946+0000","last_clean":"2024-03-30T12:36:03.222946+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:36:03.222946+0000","last_undegraded":"2024-03-30T12:36:03.222946+0000","last_fullsized":"2024-03-30T12:36:03.222946+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015999+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:36:03.015999+0000","last_peered":"2024-03-30T12:36:03.015999+0000","last_clean":"2024-03-30T12:36:03.015999+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:36:03.015999+0000","last_undegraded":"2024-03-30T12:36:03.015999+0000","last_fullsized":"2024-03-30T12:36:03.015999+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017955+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:36:03.017955+0000","last_peered":"2024-03-30T12:36:03.017955+0000","last_clean":"2024-03-30T12:36:03.017955+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:36:03.017955+0000","last_undegraded":"2024-03-30T12:36:03.017955+0000","last_fullsized":"2024-03-30T12:36:03.017955+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1387,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221082+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:36:03.221082+0000","last_peered":"2024-03-30T12:36:03.221082+0000","last_clean":"2024-03-30T12:36:03.221082+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:36:03.221082+0000","last_undegraded":"2024-03-30T12:36:03.221082+0000","last_fullsized":"2024-03-30T12:36:03.221082+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1282,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220823+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:36:03.220823+0000","last_peered":"2024-03-30T12:36:03.220823+0000","last_clean":"2024-03-30T12:36:03.220823+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:36:03.220823+0000","last_undegraded":"2024-03-30T12:36:03.220823+0000","last_fullsized":"2024-03-30T12:36:03.220823+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1301,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221016+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:36:03.221016+0000","last_peered":"2024-03-30T12:36:03.221016+0000","last_clean":"2024-03-30T12:36:03.221016+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:36:03.221016+0000","last_undegraded":"2024-03-30T12:36:03.221016+0000","last_fullsized":"2024-03-30T12:36:03.221016+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220378+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:36:03.220378+0000","last_peered":"2024-03-30T12:36:03.220378+0000","last_clean":"2024-03-30T12:36:03.220378+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:36:03.220378+0000","last_undegraded":"2024-03-30T12:36:03.220378+0000","last_fullsized":"2024-03-30T12:36:03.220378+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018097+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:36:03.018097+0000","last_peered":"2024-03-30T12:36:03.018097+0000","last_clean":"2024-03-30T12:36:03.018097+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:36:03.018097+0000","last_undegraded":"2024-03-30T12:36:03.018097+0000","last_fullsized":"2024-03-30T12:36:03.018097+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1228,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222708+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:03.222708+0000","last_peered":"2024-03-30T12:36:03.222708+0000","last_clean":"2024-03-30T12:36:03.222708+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:03.222708+0000","last_undegraded":"2024-03-30T12:36:03.222708+0000","last_fullsized":"2024-03-30T12:36:03.222708+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017698+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:36:03.017698+0000","last_peered":"2024-03-30T12:36:03.017698+0000","last_clean":"2024-03-30T12:36:03.017698+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:36:03.017698+0000","last_undegraded":"2024-03-30T12:36:03.017698+0000","last_fullsized":"2024-03-30T12:36:03.017698+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222301+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:03.222301+0000","last_peered":"2024-03-30T12:36:03.222301+0000","last_clean":"2024-03-30T12:36:03.222301+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:03.222301+0000","last_undegraded":"2024-03-30T12:36:03.222301+0000","last_fullsized":"2024-03-30T12:36:03.222301+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221852+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:36:03.221852+0000","last_peered":"2024-03-30T12:36:03.221852+0000","last_clean":"2024-03-30T12:36:03.221852+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:36:03.221852+0000","last_undegraded":"2024-03-30T12:36:03.221852+0000","last_fullsized":"2024-03-30T12:36:03.221852+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018855+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:36:03.018855+0000","last_peered":"2024-03-30T12:36:03.018855+0000","last_clean":"2024-03-30T12:36:03.018855+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:36:03.018855+0000","last_undegraded":"2024-03-30T12:36:03.018855+0000","last_fullsized":"2024-03-30T12:36:03.018855+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1179,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220575+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:36:03.220575+0000","last_peered":"2024-03-30T12:36:03.220575+0000","last_clean":"2024-03-30T12:36:03.220575+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:36:03.220575+0000","last_undegraded":"2024-03-30T12:36:03.220575+0000","last_fullsized":"2024-03-30T12:36:03.220575+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221577+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:36:03.221577+0000","last_peered":"2024-03-30T12:36:03.221577+0000","last_clean":"2024-03-30T12:36:03.221577+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:36:03.221577+0000","last_undegraded":"2024-03-30T12:36:03.221577+0000","last_fullsized":"2024-03-30T12:36:03.221577+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219839+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:36:03.219839+0000","last_peered":"2024-03-30T12:36:03.219839+0000","last_clean":"2024-03-30T12:36:03.219839+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:36:03.219839+0000","last_undegraded":"2024-03-30T12:36:03.219839+0000","last_fullsized":"2024-03-30T12:36:03.219839+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1294,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219823+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:36:03.219823+0000","last_peered":"2024-03-30T12:36:03.219823+0000","last_clean":"2024-03-30T12:36:03.219823+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:36:03.219823+0000","last_undegraded":"2024-03-30T12:36:03.219823+0000","last_fullsized":"2024-03-30T12:36:03.219823+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1223,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221769+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:36:03.221769+0000","last_peered":"2024-03-30T12:36:03.221769+0000","last_clean":"2024-03-30T12:36:03.221769+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:36:03.221769+0000","last_undegraded":"2024-03-30T12:36:03.221769+0000","last_fullsized":"2024-03-30T12:36:03.221769+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222968+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:36:03.222968+0000","last_peered":"2024-03-30T12:36:03.222968+0000","last_clean":"2024-03-30T12:36:03.222968+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:36:03.222968+0000","last_undegraded":"2024-03-30T12:36:03.222968+0000","last_fullsized":"2024-03-30T12:36:03.222968+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220821+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:03.220821+0000","last_peered":"2024-03-30T12:36:03.220821+0000","last_clean":"2024-03-30T12:36:03.220821+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:03.220821+0000","last_undegraded":"2024-03-30T12:36:03.220821+0000","last_fullsized":"2024-03-30T12:36:03.220821+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1203,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222317+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:36:03.222317+0000","last_peered":"2024-03-30T12:36:03.222317+0000","last_clean":"2024-03-30T12:36:03.222317+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:36:03.222317+0000","last_undegraded":"2024-03-30T12:36:03.222317+0000","last_fullsized":"2024-03-30T12:36:03.222317+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1197,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222067+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:36:03.222067+0000","last_peered":"2024-03-30T12:36:03.222067+0000","last_clean":"2024-03-30T12:36:03.222067+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:36:03.222067+0000","last_undegraded":"2024-03-30T12:36:03.222067+0000","last_fullsized":"2024-03-30T12:36:03.222067+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015739+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:36:03.015739+0000","last_peered":"2024-03-30T12:36:03.015739+0000","last_clean":"2024-03-30T12:36:03.015739+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:36:03.015739+0000","last_undegraded":"2024-03-30T12:36:03.015739+0000","last_fullsized":"2024-03-30T12:36:03.015739+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221275+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:36:03.221275+0000","last_peered":"2024-03-30T12:36:03.221275+0000","last_clean":"2024-03-30T12:36:03.221275+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:36:03.221275+0000","last_undegraded":"2024-03-30T12:36:03.221275+0000","last_fullsized":"2024-03-30T12:36:03.221275+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020091+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:36:03.020091+0000","last_peered":"2024-03-30T12:36:03.020091+0000","last_clean":"2024-03-30T12:36:03.020091+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:36:03.020091+0000","last_undegraded":"2024-03-30T12:36:03.020091+0000","last_fullsized":"2024-03-30T12:36:03.020091+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1204,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220837+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:36:03.220837+0000","last_peered":"2024-03-30T12:36:03.220837+0000","last_clean":"2024-03-30T12:36:03.220837+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:36:03.220837+0000","last_undegraded":"2024-03-30T12:36:03.220837+0000","last_fullsized":"2024-03-30T12:36:03.220837+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017435+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:36:03.017435+0000","last_peered":"2024-03-30T12:36:03.017435+0000","last_clean":"2024-03-30T12:36:03.017435+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:36:03.017435+0000","last_undegraded":"2024-03-30T12:36:03.017435+0000","last_fullsized":"2024-03-30T12:36:03.017435+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221769+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:36:03.221769+0000","last_peered":"2024-03-30T12:36:03.221769+0000","last_clean":"2024-03-30T12:36:03.221769+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:36:03.221769+0000","last_undegraded":"2024-03-30T12:36:03.221769+0000","last_fullsized":"2024-03-30T12:36:03.221769+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220786+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:36:03.220786+0000","last_peered":"2024-03-30T12:36:03.220786+0000","last_clean":"2024-03-30T12:36:03.220786+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:36:03.220786+0000","last_undegraded":"2024-03-30T12:36:03.220786+0000","last_fullsized":"2024-03-30T12:36:03.220786+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221904+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:36:03.221904+0000","last_peered":"2024-03-30T12:36:03.221904+0000","last_clean":"2024-03-30T12:36:03.221904+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:36:03.221904+0000","last_undegraded":"2024-03-30T12:36:03.221904+0000","last_fullsized":"2024-03-30T12:36:03.221904+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017508+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:36:03.017508+0000","last_peered":"2024-03-30T12:36:03.017508+0000","last_clean":"2024-03-30T12:36:03.017508+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:36:03.017508+0000","last_undegraded":"2024-03-30T12:36:03.017508+0000","last_fullsized":"2024-03-30T12:36:03.017508+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220253+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:36:03.220253+0000","last_peered":"2024-03-30T12:36:03.220253+0000","last_clean":"2024-03-30T12:36:03.220253+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:36:03.220253+0000","last_undegraded":"2024-03-30T12:36:03.220253+0000","last_fullsized":"2024-03-30T12:36:03.220253+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220192+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:36:03.220192+0000","last_peered":"2024-03-30T12:36:03.220192+0000","last_clean":"2024-03-30T12:36:03.220192+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:36:03.220192+0000","last_undegraded":"2024-03-30T12:36:03.220192+0000","last_fullsized":"2024-03-30T12:36:03.220192+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1343,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015636+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:36:03.015636+0000","last_peered":"2024-03-30T12:36:03.015636+0000","last_clean":"2024-03-30T12:36:03.015636+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:36:03.015636+0000","last_undegraded":"2024-03-30T12:36:03.015636+0000","last_fullsized":"2024-03-30T12:36:03.015636+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016619+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:36:03.016619+0000","last_peered":"2024-03-30T12:36:03.016619+0000","last_clean":"2024-03-30T12:36:03.016619+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:36:03.016619+0000","last_undegraded":"2024-03-30T12:36:03.016619+0000","last_fullsized":"2024-03-30T12:36:03.016619+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5751,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.016013+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:36:03.016013+0000","last_peered":"2024-03-30T12:36:03.016013+0000","last_clean":"2024-03-30T12:36:03.016013+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:36:03.016013+0000","last_undegraded":"2024-03-30T12:36:03.016013+0000","last_fullsized":"2024-03-30T12:36:03.016013+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020404+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:36:03.020404+0000","last_peered":"2024-03-30T12:36:03.020404+0000","last_clean":"2024-03-30T12:36:03.020404+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:36:03.020404+0000","last_undegraded":"2024-03-30T12:36:03.020404+0000","last_fullsized":"2024-03-30T12:36:03.020404+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018051+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:36:03.018051+0000","last_peered":"2024-03-30T12:36:03.018051+0000","last_clean":"2024-03-30T12:36:03.018051+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:36:03.018051+0000","last_undegraded":"2024-03-30T12:36:03.018051+0000","last_fullsized":"2024-03-30T12:36:03.018051+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5512,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.222067+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:36:03.222067+0000","last_peered":"2024-03-30T12:36:03.222067+0000","last_clean":"2024-03-30T12:36:03.222067+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:36:03.222067+0000","last_undegraded":"2024-03-30T12:36:03.222067+0000","last_fullsized":"2024-03-30T12:36:03.222067+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220604+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:36:03.220604+0000","last_peered":"2024-03-30T12:36:03.220604+0000","last_clean":"2024-03-30T12:36:03.220604+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:36:03.220604+0000","last_undegraded":"2024-03-30T12:36:03.220604+0000","last_fullsized":"2024-03-30T12:36:03.220604+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1346,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222463+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:36:03.222463+0000","last_peered":"2024-03-30T12:36:03.222463+0000","last_clean":"2024-03-30T12:36:03.222463+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:36:03.222463+0000","last_undegraded":"2024-03-30T12:36:03.222463+0000","last_fullsized":"2024-03-30T12:36:03.222463+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222511+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:36:03.222511+0000","last_peered":"2024-03-30T12:36:03.222511+0000","last_clean":"2024-03-30T12:36:03.222511+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:36:03.222511+0000","last_undegraded":"2024-03-30T12:36:03.222511+0000","last_fullsized":"2024-03-30T12:36:03.222511+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5457,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.222052+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:36:03.222052+0000","last_peered":"2024-03-30T12:36:03.222052+0000","last_clean":"2024-03-30T12:36:03.222052+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:36:03.222052+0000","last_undegraded":"2024-03-30T12:36:03.222052+0000","last_fullsized":"2024-03-30T12:36:03.222052+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222581+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:36:03.222581+0000","last_peered":"2024-03-30T12:36:03.222581+0000","last_clean":"2024-03-30T12:36:03.222581+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:36:03.222581+0000","last_undegraded":"2024-03-30T12:36:03.222581+0000","last_fullsized":"2024-03-30T12:36:03.222581+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221692+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:36:03.221692+0000","last_peered":"2024-03-30T12:36:03.221692+0000","last_clean":"2024-03-30T12:36:03.221692+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:36:03.221692+0000","last_undegraded":"2024-03-30T12:36:03.221692+0000","last_fullsized":"2024-03-30T12:36:03.221692+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1271,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019374+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:36:03.019374+0000","last_peered":"2024-03-30T12:36:03.019374+0000","last_clean":"2024-03-30T12:36:03.019374+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:36:03.019374+0000","last_undegraded":"2024-03-30T12:36:03.019374+0000","last_fullsized":"2024-03-30T12:36:03.019374+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3802,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016632+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:36:03.016632+0000","last_peered":"2024-03-30T12:36:03.016632+0000","last_clean":"2024-03-30T12:36:03.016632+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:36:03.016632+0000","last_undegraded":"2024-03-30T12:36:03.016632+0000","last_fullsized":"2024-03-30T12:36:03.016632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1342,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222978+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:36:03.222978+0000","last_peered":"2024-03-30T12:36:03.222978+0000","last_clean":"2024-03-30T12:36:03.222978+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:36:03.222978+0000","last_undegraded":"2024-03-30T12:36:03.222978+0000","last_fullsized":"2024-03-30T12:36:03.222978+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222036+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:36:03.222036+0000","last_peered":"2024-03-30T12:36:03.222036+0000","last_clean":"2024-03-30T12:36:03.222036+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:36:03.222036+0000","last_undegraded":"2024-03-30T12:36:03.222036+0000","last_fullsized":"2024-03-30T12:36:03.222036+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015232+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:36:03.015232+0000","last_peered":"2024-03-30T12:36:03.015232+0000","last_clean":"2024-03-30T12:36:03.015232+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:36:03.015232+0000","last_undegraded":"2024-03-30T12:36:03.015232+0000","last_fullsized":"2024-03-30T12:36:03.015232+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4575,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.019196+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:36:03.019196+0000","last_peered":"2024-03-30T12:36:03.019196+0000","last_clean":"2024-03-30T12:36:03.019196+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:36:03.019196+0000","last_undegraded":"2024-03-30T12:36:03.019196+0000","last_fullsized":"2024-03-30T12:36:03.019196+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1174,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220771+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:36:03.220771+0000","last_peered":"2024-03-30T12:36:03.220771+0000","last_clean":"2024-03-30T12:36:03.220771+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:36:03.220771+0000","last_undegraded":"2024-03-30T12:36:03.220771+0000","last_fullsized":"2024-03-30T12:36:03.220771+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221414+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:36:03.221414+0000","last_peered":"2024-03-30T12:36:03.221414+0000","last_clean":"2024-03-30T12:36:03.221414+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:36:03.221414+0000","last_undegraded":"2024-03-30T12:36:03.221414+0000","last_fullsized":"2024-03-30T12:36:03.221414+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1199,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222181+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:36:03.222181+0000","last_peered":"2024-03-30T12:36:03.222181+0000","last_clean":"2024-03-30T12:36:03.222181+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:36:03.222181+0000","last_undegraded":"2024-03-30T12:36:03.222181+0000","last_fullsized":"2024-03-30T12:36:03.222181+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1715,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016476+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:36:03.016476+0000","last_peered":"2024-03-30T12:36:03.016476+0000","last_clean":"2024-03-30T12:36:03.016476+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:36:03.016476+0000","last_undegraded":"2024-03-30T12:36:03.016476+0000","last_fullsized":"2024-03-30T12:36:03.016476+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24713,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223744+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:36:03.223744+0000","last_peered":"2024-03-30T12:36:03.223744+0000","last_clean":"2024-03-30T12:36:03.223744+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:36:03.223744+0000","last_undegraded":"2024-03-30T12:36:03.223744+0000","last_fullsized":"2024-03-30T12:36:03.223744+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220614+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:36:03.220614+0000","last_peered":"2024-03-30T12:36:03.220614+0000","last_clean":"2024-03-30T12:36:03.220614+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:36:03.220614+0000","last_undegraded":"2024-03-30T12:36:03.220614+0000","last_fullsized":"2024-03-30T12:36:03.220614+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220696+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:36:03.220696+0000","last_peered":"2024-03-30T12:36:03.220696+0000","last_clean":"2024-03-30T12:36:03.220696+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:36:03.220696+0000","last_undegraded":"2024-03-30T12:36:03.220696+0000","last_fullsized":"2024-03-30T12:36:03.220696+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1143,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016477+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:36:03.016477+0000","last_peered":"2024-03-30T12:36:03.016477+0000","last_clean":"2024-03-30T12:36:03.016477+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:36:03.016477+0000","last_undegraded":"2024-03-30T12:36:03.016477+0000","last_fullsized":"2024-03-30T12:36:03.016477+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16480,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.221717+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:36:03.221717+0000","last_peered":"2024-03-30T12:36:03.221717+0000","last_clean":"2024-03-30T12:36:03.221717+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:36:03.221717+0000","last_undegraded":"2024-03-30T12:36:03.221717+0000","last_fullsized":"2024-03-30T12:36:03.221717+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221448+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:36:03.221448+0000","last_peered":"2024-03-30T12:36:03.221448+0000","last_clean":"2024-03-30T12:36:03.221448+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:36:03.221448+0000","last_undegraded":"2024-03-30T12:36:03.221448+0000","last_fullsized":"2024-03-30T12:36:03.221448+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017748+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:36:03.017748+0000","last_peered":"2024-03-30T12:36:03.017748+0000","last_clean":"2024-03-30T12:36:03.017748+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:36:03.017748+0000","last_undegraded":"2024-03-30T12:36:03.017748+0000","last_fullsized":"2024-03-30T12:36:03.017748+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222675+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:36:03.222675+0000","last_peered":"2024-03-30T12:36:03.222675+0000","last_clean":"2024-03-30T12:36:03.222675+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:36:03.222675+0000","last_undegraded":"2024-03-30T12:36:03.222675+0000","last_fullsized":"2024-03-30T12:36:03.222675+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31268,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.021096+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:36:03.021096+0000","last_peered":"2024-03-30T12:36:03.021096+0000","last_clean":"2024-03-30T12:36:03.021096+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:36:03.021096+0000","last_undegraded":"2024-03-30T12:36:03.021096+0000","last_fullsized":"2024-03-30T12:36:03.021096+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1294,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219916+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:36:03.219916+0000","last_peered":"2024-03-30T12:36:03.219916+0000","last_clean":"2024-03-30T12:36:03.219916+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:36:03.219916+0000","last_undegraded":"2024-03-30T12:36:03.219916+0000","last_fullsized":"2024-03-30T12:36:03.219916+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221733+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:36:03.221733+0000","last_peered":"2024-03-30T12:36:03.221733+0000","last_clean":"2024-03-30T12:36:03.221733+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:36:03.221733+0000","last_undegraded":"2024-03-30T12:36:03.221733+0000","last_fullsized":"2024-03-30T12:36:03.221733+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221129+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:36:03.221129+0000","last_peered":"2024-03-30T12:36:03.221129+0000","last_clean":"2024-03-30T12:36:03.221129+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:36:03.221129+0000","last_undegraded":"2024-03-30T12:36:03.221129+0000","last_fullsized":"2024-03-30T12:36:03.221129+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3764,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220021+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:36:03.220021+0000","last_peered":"2024-03-30T12:36:03.220021+0000","last_clean":"2024-03-30T12:36:03.220021+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:36:03.220021+0000","last_undegraded":"2024-03-30T12:36:03.220021+0000","last_fullsized":"2024-03-30T12:36:03.220021+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019149+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:36:03.019149+0000","last_peered":"2024-03-30T12:36:03.019149+0000","last_clean":"2024-03-30T12:36:03.019149+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:36:03.019149+0000","last_undegraded":"2024-03-30T12:36:03.019149+0000","last_fullsized":"2024-03-30T12:36:03.019149+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220680+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:36:03.220680+0000","last_peered":"2024-03-30T12:36:03.220680+0000","last_clean":"2024-03-30T12:36:03.220680+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:36:03.220680+0000","last_undegraded":"2024-03-30T12:36:03.220680+0000","last_fullsized":"2024-03-30T12:36:03.220680+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220354+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:36:03.220354+0000","last_peered":"2024-03-30T12:36:03.220354+0000","last_clean":"2024-03-30T12:36:03.220354+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:36:03.220354+0000","last_undegraded":"2024-03-30T12:36:03.220354+0000","last_fullsized":"2024-03-30T12:36:03.220354+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15593,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223541+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:36:03.223541+0000","last_peered":"2024-03-30T12:36:03.223541+0000","last_clean":"2024-03-30T12:36:03.223541+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:36:03.223541+0000","last_undegraded":"2024-03-30T12:36:03.223541+0000","last_fullsized":"2024-03-30T12:36:03.223541+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1142,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016783+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:36:03.016783+0000","last_peered":"2024-03-30T12:36:03.016783+0000","last_clean":"2024-03-30T12:36:03.016783+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:36:03.016783+0000","last_undegraded":"2024-03-30T12:36:03.016783+0000","last_fullsized":"2024-03-30T12:36:03.016783+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1257,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018978+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:36:03.018978+0000","last_peered":"2024-03-30T12:36:03.018978+0000","last_clean":"2024-03-30T12:36:03.018978+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:36:03.018978+0000","last_undegraded":"2024-03-30T12:36:03.018978+0000","last_fullsized":"2024-03-30T12:36:03.018978+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29019,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.020881+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:36:03.020881+0000","last_peered":"2024-03-30T12:36:03.020881+0000","last_clean":"2024-03-30T12:36:03.020881+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:36:03.020881+0000","last_undegraded":"2024-03-30T12:36:03.020881+0000","last_fullsized":"2024-03-30T12:36:03.020881+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222681+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:36:03.222681+0000","last_peered":"2024-03-30T12:36:03.222681+0000","last_clean":"2024-03-30T12:36:03.222681+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:36:03.222681+0000","last_undegraded":"2024-03-30T12:36:03.222681+0000","last_fullsized":"2024-03-30T12:36:03.222681+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220045+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:36:03.220045+0000","last_peered":"2024-03-30T12:36:03.220045+0000","last_clean":"2024-03-30T12:36:03.220045+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:36:03.220045+0000","last_undegraded":"2024-03-30T12:36:03.220045+0000","last_fullsized":"2024-03-30T12:36:03.220045+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5609,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.017229+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:36:03.017229+0000","last_peered":"2024-03-30T12:36:03.017229+0000","last_clean":"2024-03-30T12:36:03.017229+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:36:03.017229+0000","last_undegraded":"2024-03-30T12:36:03.017229+0000","last_fullsized":"2024-03-30T12:36:03.017229+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1364,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220455+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:36:03.220455+0000","last_peered":"2024-03-30T12:36:03.220455+0000","last_clean":"2024-03-30T12:36:03.220455+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:36:03.220455+0000","last_undegraded":"2024-03-30T12:36:03.220455+0000","last_fullsized":"2024-03-30T12:36:03.220455+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221588+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:03.221588+0000","last_peered":"2024-03-30T12:36:03.221588+0000","last_clean":"2024-03-30T12:36:03.221588+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:03.221588+0000","last_undegraded":"2024-03-30T12:36:03.221588+0000","last_fullsized":"2024-03-30T12:36:03.221588+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222830+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:36:03.222830+0000","last_peered":"2024-03-30T12:36:03.222830+0000","last_clean":"2024-03-30T12:36:03.222830+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:36:03.222830+0000","last_undegraded":"2024-03-30T12:36:03.222830+0000","last_fullsized":"2024-03-30T12:36:03.222830+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017355+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:36:03.017355+0000","last_peered":"2024-03-30T12:36:03.017355+0000","last_clean":"2024-03-30T12:36:03.017355+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:36:03.017355+0000","last_undegraded":"2024-03-30T12:36:03.017355+0000","last_fullsized":"2024-03-30T12:36:03.017355+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221062+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:36:03.221062+0000","last_peered":"2024-03-30T12:36:03.221062+0000","last_clean":"2024-03-30T12:36:03.221062+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:36:03.221062+0000","last_undegraded":"2024-03-30T12:36:03.221062+0000","last_fullsized":"2024-03-30T12:36:03.221062+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5252,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.017068+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:36:03.017068+0000","last_peered":"2024-03-30T12:36:03.017068+0000","last_clean":"2024-03-30T12:36:03.017068+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:36:03.017068+0000","last_undegraded":"2024-03-30T12:36:03.017068+0000","last_fullsized":"2024-03-30T12:36:03.017068+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1330,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016069+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:36:03.016069+0000","last_peered":"2024-03-30T12:36:03.016069+0000","last_clean":"2024-03-30T12:36:03.016069+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:36:03.016069+0000","last_undegraded":"2024-03-30T12:36:03.016069+0000","last_fullsized":"2024-03-30T12:36:03.016069+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017799+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:36:03.017799+0000","last_peered":"2024-03-30T12:36:03.017799+0000","last_clean":"2024-03-30T12:36:03.017799+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:36:03.017799+0000","last_undegraded":"2024-03-30T12:36:03.017799+0000","last_fullsized":"2024-03-30T12:36:03.017799+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4809,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.016990+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:36:03.016990+0000","last_peered":"2024-03-30T12:36:03.016990+0000","last_clean":"2024-03-30T12:36:03.016990+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:36:03.016990+0000","last_undegraded":"2024-03-30T12:36:03.016990+0000","last_fullsized":"2024-03-30T12:36:03.016990+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220902+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:36:03.220902+0000","last_peered":"2024-03-30T12:36:03.220902+0000","last_clean":"2024-03-30T12:36:03.220902+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:36:03.220902+0000","last_undegraded":"2024-03-30T12:36:03.220902+0000","last_fullsized":"2024-03-30T12:36:03.220902+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222608+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:36:03.222608+0000","last_peered":"2024-03-30T12:36:03.222608+0000","last_clean":"2024-03-30T12:36:03.222608+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:36:03.222608+0000","last_undegraded":"2024-03-30T12:36:03.222608+0000","last_fullsized":"2024-03-30T12:36:03.222608+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6742,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.018791+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:36:03.018791+0000","last_peered":"2024-03-30T12:36:03.018791+0000","last_clean":"2024-03-30T12:36:03.018791+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:36:03.018791+0000","last_undegraded":"2024-03-30T12:36:03.018791+0000","last_fullsized":"2024-03-30T12:36:03.018791+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1336,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016373+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:36:03.016373+0000","last_peered":"2024-03-30T12:36:03.016373+0000","last_clean":"2024-03-30T12:36:03.016373+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:36:03.016373+0000","last_undegraded":"2024-03-30T12:36:03.016373+0000","last_fullsized":"2024-03-30T12:36:03.016373+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018917+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:36:03.018917+0000","last_peered":"2024-03-30T12:36:03.018917+0000","last_clean":"2024-03-30T12:36:03.018917+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:36:03.018917+0000","last_undegraded":"2024-03-30T12:36:03.018917+0000","last_fullsized":"2024-03-30T12:36:03.018917+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220179+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:36:03.220179+0000","last_peered":"2024-03-30T12:36:03.220179+0000","last_clean":"2024-03-30T12:36:03.220179+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:36:03.220179+0000","last_undegraded":"2024-03-30T12:36:03.220179+0000","last_fullsized":"2024-03-30T12:36:03.220179+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015330+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:36:03.015330+0000","last_peered":"2024-03-30T12:36:03.015330+0000","last_clean":"2024-03-30T12:36:03.015330+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:36:03.015330+0000","last_undegraded":"2024-03-30T12:36:03.015330+0000","last_fullsized":"2024-03-30T12:36:03.015330+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221954+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:36:03.221954+0000","last_peered":"2024-03-30T12:36:03.221954+0000","last_clean":"2024-03-30T12:36:03.221954+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:36:03.221954+0000","last_undegraded":"2024-03-30T12:36:03.221954+0000","last_fullsized":"2024-03-30T12:36:03.221954+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221038+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:36:03.221038+0000","last_peered":"2024-03-30T12:36:03.221038+0000","last_clean":"2024-03-30T12:36:03.221038+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:36:03.221038+0000","last_undegraded":"2024-03-30T12:36:03.221038+0000","last_fullsized":"2024-03-30T12:36:03.221038+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220172+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:36:03.220172+0000","last_peered":"2024-03-30T12:36:03.220172+0000","last_clean":"2024-03-30T12:36:03.220172+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:36:03.220172+0000","last_undegraded":"2024-03-30T12:36:03.220172+0000","last_fullsized":"2024-03-30T12:36:03.220172+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221044+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:36:03.221044+0000","last_peered":"2024-03-30T12:36:03.221044+0000","last_clean":"2024-03-30T12:36:03.221044+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:36:03.221044+0000","last_undegraded":"2024-03-30T12:36:03.221044+0000","last_fullsized":"2024-03-30T12:36:03.221044+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1176,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221139+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:36:03.221139+0000","last_peered":"2024-03-30T12:36:03.221139+0000","last_clean":"2024-03-30T12:36:03.221139+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:36:03.221139+0000","last_undegraded":"2024-03-30T12:36:03.221139+0000","last_fullsized":"2024-03-30T12:36:03.221139+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1280,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221301+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:36:03.221301+0000","last_peered":"2024-03-30T12:36:03.221301+0000","last_clean":"2024-03-30T12:36:03.221301+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:36:03.221301+0000","last_undegraded":"2024-03-30T12:36:03.221301+0000","last_fullsized":"2024-03-30T12:36:03.221301+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221612+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:36:03.221612+0000","last_peered":"2024-03-30T12:36:03.221612+0000","last_clean":"2024-03-30T12:36:03.221612+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:36:03.221612+0000","last_undegraded":"2024-03-30T12:36:03.221612+0000","last_fullsized":"2024-03-30T12:36:03.221612+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220227+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:03.220227+0000","last_peered":"2024-03-30T12:36:03.220227+0000","last_clean":"2024-03-30T12:36:03.220227+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:03.220227+0000","last_undegraded":"2024-03-30T12:36:03.220227+0000","last_fullsized":"2024-03-30T12:36:03.220227+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221610+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:36:03.221610+0000","last_peered":"2024-03-30T12:36:03.221610+0000","last_clean":"2024-03-30T12:36:03.221610+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:36:03.221610+0000","last_undegraded":"2024-03-30T12:36:03.221610+0000","last_fullsized":"2024-03-30T12:36:03.221610+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220926+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:36:03.220926+0000","last_peered":"2024-03-30T12:36:03.220926+0000","last_clean":"2024-03-30T12:36:03.220926+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:36:03.220926+0000","last_undegraded":"2024-03-30T12:36:03.220926+0000","last_fullsized":"2024-03-30T12:36:03.220926+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220599+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:36:03.220599+0000","last_peered":"2024-03-30T12:36:03.220599+0000","last_clean":"2024-03-30T12:36:03.220599+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:36:03.220599+0000","last_undegraded":"2024-03-30T12:36:03.220599+0000","last_fullsized":"2024-03-30T12:36:03.220599+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438045,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648101,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175111,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254350,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063168,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951226,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839283,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923565,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:38:04.047 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:04.047 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:04.047 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:04.047 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:04.047 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:04.047 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:04.047 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:04.047 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:04.047 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:04.047 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:04.048 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:04.048 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:04.048 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:04.048 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:38:04.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:03 smithi162 ceph-mon[83709]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:38:05.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:04 smithi084 ceph-mon[91810]: pgmap v1051: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:05.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:04 smithi084 ceph-mon[89279]: pgmap v1051: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:05.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:04 smithi162 ceph-mon[83709]: pgmap v1051: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:07.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:06 smithi084 ceph-mon[91810]: pgmap v1052: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:07.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:06 smithi084 ceph-mon[89279]: pgmap v1052: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:07.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:06 smithi162 ceph-mon[83709]: pgmap v1052: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:09.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:08 smithi084 ceph-mon[89279]: pgmap v1053: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:09.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:08 smithi084 ceph-mon[91810]: pgmap v1053: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:09.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:08 smithi162 ceph-mon[83709]: pgmap v1053: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:09.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:38:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:38:09] "GET /metrics HTTP/1.1" 200 36325 "" "Prometheus/2.43.0" 2024-03-30T12:38:11.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:10 smithi084 ceph-mon[89279]: pgmap v1054: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:11.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:10 smithi084 ceph-mon[91810]: pgmap v1054: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:11.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:10 smithi162 ceph-mon[83709]: pgmap v1054: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:14.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:13 smithi084 ceph-mon[91810]: pgmap v1055: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:14.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:13 smithi084 ceph-mon[89279]: pgmap v1055: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:14.049 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:38:14.268 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:38:14.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:13 smithi162 ceph-mon[83709]: pgmap v1055: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:15.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:14 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:38:15.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:14 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:38:15.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:14 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:38:16.195 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:38:16.195 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:15 smithi084 ceph-mon[89279]: pgmap v1056: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:16.196 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:15 smithi084 ceph-mon[91810]: pgmap v1056: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:16.201 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:38:16.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:15 smithi162 ceph-mon[83709]: pgmap v1056: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:16.889 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1056,"stamp":"2024-03-30T12:38:14.838162+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004066"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018672+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:36:03.018672+0000","last_peered":"2024-03-30T12:36:03.018672+0000","last_clean":"2024-03-30T12:36:03.018672+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:36:03.018672+0000","last_undegraded":"2024-03-30T12:36:03.018672+0000","last_fullsized":"2024-03-30T12:36:03.018672+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1363,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221634+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:36:03.221634+0000","last_peered":"2024-03-30T12:36:03.221634+0000","last_clean":"2024-03-30T12:36:03.221634+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:36:03.221634+0000","last_undegraded":"2024-03-30T12:36:03.221634+0000","last_fullsized":"2024-03-30T12:36:03.221634+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221207+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:36:03.221207+0000","last_peered":"2024-03-30T12:36:03.221207+0000","last_clean":"2024-03-30T12:36:03.221207+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:36:03.221207+0000","last_undegraded":"2024-03-30T12:36:03.221207+0000","last_fullsized":"2024-03-30T12:36:03.221207+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222119+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:36:03.222119+0000","last_peered":"2024-03-30T12:36:03.222119+0000","last_clean":"2024-03-30T12:36:03.222119+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:36:03.222119+0000","last_undegraded":"2024-03-30T12:36:03.222119+0000","last_fullsized":"2024-03-30T12:36:03.222119+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016863+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:36:03.016863+0000","last_peered":"2024-03-30T12:36:03.016863+0000","last_clean":"2024-03-30T12:36:03.016863+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:36:03.016863+0000","last_undegraded":"2024-03-30T12:36:03.016863+0000","last_fullsized":"2024-03-30T12:36:03.016863+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1209,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222566+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:03.222566+0000","last_peered":"2024-03-30T12:36:03.222566+0000","last_clean":"2024-03-30T12:36:03.222566+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:03.222566+0000","last_undegraded":"2024-03-30T12:36:03.222566+0000","last_fullsized":"2024-03-30T12:36:03.222566+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017365+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:36:03.017365+0000","last_peered":"2024-03-30T12:36:03.017365+0000","last_clean":"2024-03-30T12:36:03.017365+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:36:03.017365+0000","last_undegraded":"2024-03-30T12:36:03.017365+0000","last_fullsized":"2024-03-30T12:36:03.017365+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219781+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:36:03.219781+0000","last_peered":"2024-03-30T12:36:03.219781+0000","last_clean":"2024-03-30T12:36:03.219781+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:36:03.219781+0000","last_undegraded":"2024-03-30T12:36:03.219781+0000","last_fullsized":"2024-03-30T12:36:03.219781+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018011+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:36:03.018011+0000","last_peered":"2024-03-30T12:36:03.018011+0000","last_clean":"2024-03-30T12:36:03.018011+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:36:03.018011+0000","last_undegraded":"2024-03-30T12:36:03.018011+0000","last_fullsized":"2024-03-30T12:36:03.018011+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220774+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:03.220774+0000","last_peered":"2024-03-30T12:36:03.220774+0000","last_clean":"2024-03-30T12:36:03.220774+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:03.220774+0000","last_undegraded":"2024-03-30T12:36:03.220774+0000","last_fullsized":"2024-03-30T12:36:03.220774+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220468+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:03.220468+0000","last_peered":"2024-03-30T12:36:03.220468+0000","last_clean":"2024-03-30T12:36:03.220468+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:03.220468+0000","last_undegraded":"2024-03-30T12:36:03.220468+0000","last_fullsized":"2024-03-30T12:36:03.220468+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1270,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020253+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:36:03.020253+0000","last_peered":"2024-03-30T12:36:03.020253+0000","last_clean":"2024-03-30T12:36:03.020253+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:36:03.020253+0000","last_undegraded":"2024-03-30T12:36:03.020253+0000","last_fullsized":"2024-03-30T12:36:03.020253+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221688+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:36:03.221688+0000","last_peered":"2024-03-30T12:36:03.221688+0000","last_clean":"2024-03-30T12:36:03.221688+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:36:03.221688+0000","last_undegraded":"2024-03-30T12:36:03.221688+0000","last_fullsized":"2024-03-30T12:36:03.221688+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220487+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:36:03.220487+0000","last_peered":"2024-03-30T12:36:03.220487+0000","last_clean":"2024-03-30T12:36:03.220487+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:36:03.220487+0000","last_undegraded":"2024-03-30T12:36:03.220487+0000","last_fullsized":"2024-03-30T12:36:03.220487+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222534+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:36:03.222534+0000","last_peered":"2024-03-30T12:36:03.222534+0000","last_clean":"2024-03-30T12:36:03.222534+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:36:03.222534+0000","last_undegraded":"2024-03-30T12:36:03.222534+0000","last_fullsized":"2024-03-30T12:36:03.222534+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221410+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:36:03.221410+0000","last_peered":"2024-03-30T12:36:03.221410+0000","last_clean":"2024-03-30T12:36:03.221410+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:36:03.221410+0000","last_undegraded":"2024-03-30T12:36:03.221410+0000","last_fullsized":"2024-03-30T12:36:03.221410+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1223,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222946+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:36:03.222946+0000","last_peered":"2024-03-30T12:36:03.222946+0000","last_clean":"2024-03-30T12:36:03.222946+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:36:03.222946+0000","last_undegraded":"2024-03-30T12:36:03.222946+0000","last_fullsized":"2024-03-30T12:36:03.222946+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015999+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:36:03.015999+0000","last_peered":"2024-03-30T12:36:03.015999+0000","last_clean":"2024-03-30T12:36:03.015999+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:36:03.015999+0000","last_undegraded":"2024-03-30T12:36:03.015999+0000","last_fullsized":"2024-03-30T12:36:03.015999+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017955+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:36:03.017955+0000","last_peered":"2024-03-30T12:36:03.017955+0000","last_clean":"2024-03-30T12:36:03.017955+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:36:03.017955+0000","last_undegraded":"2024-03-30T12:36:03.017955+0000","last_fullsized":"2024-03-30T12:36:03.017955+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1387,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221082+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:36:03.221082+0000","last_peered":"2024-03-30T12:36:03.221082+0000","last_clean":"2024-03-30T12:36:03.221082+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:36:03.221082+0000","last_undegraded":"2024-03-30T12:36:03.221082+0000","last_fullsized":"2024-03-30T12:36:03.221082+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1282,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220823+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:36:03.220823+0000","last_peered":"2024-03-30T12:36:03.220823+0000","last_clean":"2024-03-30T12:36:03.220823+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:36:03.220823+0000","last_undegraded":"2024-03-30T12:36:03.220823+0000","last_fullsized":"2024-03-30T12:36:03.220823+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1301,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221016+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:36:03.221016+0000","last_peered":"2024-03-30T12:36:03.221016+0000","last_clean":"2024-03-30T12:36:03.221016+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:36:03.221016+0000","last_undegraded":"2024-03-30T12:36:03.221016+0000","last_fullsized":"2024-03-30T12:36:03.221016+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220378+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:36:03.220378+0000","last_peered":"2024-03-30T12:36:03.220378+0000","last_clean":"2024-03-30T12:36:03.220378+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:36:03.220378+0000","last_undegraded":"2024-03-30T12:36:03.220378+0000","last_fullsized":"2024-03-30T12:36:03.220378+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018097+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:36:03.018097+0000","last_peered":"2024-03-30T12:36:03.018097+0000","last_clean":"2024-03-30T12:36:03.018097+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:36:03.018097+0000","last_undegraded":"2024-03-30T12:36:03.018097+0000","last_fullsized":"2024-03-30T12:36:03.018097+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1228,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222708+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:03.222708+0000","last_peered":"2024-03-30T12:36:03.222708+0000","last_clean":"2024-03-30T12:36:03.222708+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:03.222708+0000","last_undegraded":"2024-03-30T12:36:03.222708+0000","last_fullsized":"2024-03-30T12:36:03.222708+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017698+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:36:03.017698+0000","last_peered":"2024-03-30T12:36:03.017698+0000","last_clean":"2024-03-30T12:36:03.017698+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:36:03.017698+0000","last_undegraded":"2024-03-30T12:36:03.017698+0000","last_fullsized":"2024-03-30T12:36:03.017698+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222301+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:03.222301+0000","last_peered":"2024-03-30T12:36:03.222301+0000","last_clean":"2024-03-30T12:36:03.222301+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:03.222301+0000","last_undegraded":"2024-03-30T12:36:03.222301+0000","last_fullsized":"2024-03-30T12:36:03.222301+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221852+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:36:03.221852+0000","last_peered":"2024-03-30T12:36:03.221852+0000","last_clean":"2024-03-30T12:36:03.221852+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:36:03.221852+0000","last_undegraded":"2024-03-30T12:36:03.221852+0000","last_fullsized":"2024-03-30T12:36:03.221852+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018855+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:36:03.018855+0000","last_peered":"2024-03-30T12:36:03.018855+0000","last_clean":"2024-03-30T12:36:03.018855+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:36:03.018855+0000","last_undegraded":"2024-03-30T12:36:03.018855+0000","last_fullsized":"2024-03-30T12:36:03.018855+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1179,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220575+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:36:03.220575+0000","last_peered":"2024-03-30T12:36:03.220575+0000","last_clean":"2024-03-30T12:36:03.220575+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:36:03.220575+0000","last_undegraded":"2024-03-30T12:36:03.220575+0000","last_fullsized":"2024-03-30T12:36:03.220575+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221577+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:36:03.221577+0000","last_peered":"2024-03-30T12:36:03.221577+0000","last_clean":"2024-03-30T12:36:03.221577+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:36:03.221577+0000","last_undegraded":"2024-03-30T12:36:03.221577+0000","last_fullsized":"2024-03-30T12:36:03.221577+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219839+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:36:03.219839+0000","last_peered":"2024-03-30T12:36:03.219839+0000","last_clean":"2024-03-30T12:36:03.219839+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:36:03.219839+0000","last_undegraded":"2024-03-30T12:36:03.219839+0000","last_fullsized":"2024-03-30T12:36:03.219839+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1294,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219823+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:36:03.219823+0000","last_peered":"2024-03-30T12:36:03.219823+0000","last_clean":"2024-03-30T12:36:03.219823+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:36:03.219823+0000","last_undegraded":"2024-03-30T12:36:03.219823+0000","last_fullsized":"2024-03-30T12:36:03.219823+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1223,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221769+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:36:03.221769+0000","last_peered":"2024-03-30T12:36:03.221769+0000","last_clean":"2024-03-30T12:36:03.221769+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:36:03.221769+0000","last_undegraded":"2024-03-30T12:36:03.221769+0000","last_fullsized":"2024-03-30T12:36:03.221769+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222968+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:36:03.222968+0000","last_peered":"2024-03-30T12:36:03.222968+0000","last_clean":"2024-03-30T12:36:03.222968+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:36:03.222968+0000","last_undegraded":"2024-03-30T12:36:03.222968+0000","last_fullsized":"2024-03-30T12:36:03.222968+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220821+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:03.220821+0000","last_peered":"2024-03-30T12:36:03.220821+0000","last_clean":"2024-03-30T12:36:03.220821+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:03.220821+0000","last_undegraded":"2024-03-30T12:36:03.220821+0000","last_fullsized":"2024-03-30T12:36:03.220821+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1203,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222317+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:36:03.222317+0000","last_peered":"2024-03-30T12:36:03.222317+0000","last_clean":"2024-03-30T12:36:03.222317+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:36:03.222317+0000","last_undegraded":"2024-03-30T12:36:03.222317+0000","last_fullsized":"2024-03-30T12:36:03.222317+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1197,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222067+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:36:03.222067+0000","last_peered":"2024-03-30T12:36:03.222067+0000","last_clean":"2024-03-30T12:36:03.222067+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:36:03.222067+0000","last_undegraded":"2024-03-30T12:36:03.222067+0000","last_fullsized":"2024-03-30T12:36:03.222067+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015739+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:36:03.015739+0000","last_peered":"2024-03-30T12:36:03.015739+0000","last_clean":"2024-03-30T12:36:03.015739+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:36:03.015739+0000","last_undegraded":"2024-03-30T12:36:03.015739+0000","last_fullsized":"2024-03-30T12:36:03.015739+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221275+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:36:03.221275+0000","last_peered":"2024-03-30T12:36:03.221275+0000","last_clean":"2024-03-30T12:36:03.221275+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:36:03.221275+0000","last_undegraded":"2024-03-30T12:36:03.221275+0000","last_fullsized":"2024-03-30T12:36:03.221275+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020091+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:36:03.020091+0000","last_peered":"2024-03-30T12:36:03.020091+0000","last_clean":"2024-03-30T12:36:03.020091+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:36:03.020091+0000","last_undegraded":"2024-03-30T12:36:03.020091+0000","last_fullsized":"2024-03-30T12:36:03.020091+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1204,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220837+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:36:03.220837+0000","last_peered":"2024-03-30T12:36:03.220837+0000","last_clean":"2024-03-30T12:36:03.220837+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:36:03.220837+0000","last_undegraded":"2024-03-30T12:36:03.220837+0000","last_fullsized":"2024-03-30T12:36:03.220837+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017435+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:36:03.017435+0000","last_peered":"2024-03-30T12:36:03.017435+0000","last_clean":"2024-03-30T12:36:03.017435+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:36:03.017435+0000","last_undegraded":"2024-03-30T12:36:03.017435+0000","last_fullsized":"2024-03-30T12:36:03.017435+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221769+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:36:03.221769+0000","last_peered":"2024-03-30T12:36:03.221769+0000","last_clean":"2024-03-30T12:36:03.221769+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:36:03.221769+0000","last_undegraded":"2024-03-30T12:36:03.221769+0000","last_fullsized":"2024-03-30T12:36:03.221769+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220786+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:36:03.220786+0000","last_peered":"2024-03-30T12:36:03.220786+0000","last_clean":"2024-03-30T12:36:03.220786+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:36:03.220786+0000","last_undegraded":"2024-03-30T12:36:03.220786+0000","last_fullsized":"2024-03-30T12:36:03.220786+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221904+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:36:03.221904+0000","last_peered":"2024-03-30T12:36:03.221904+0000","last_clean":"2024-03-30T12:36:03.221904+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:36:03.221904+0000","last_undegraded":"2024-03-30T12:36:03.221904+0000","last_fullsized":"2024-03-30T12:36:03.221904+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017508+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:36:03.017508+0000","last_peered":"2024-03-30T12:36:03.017508+0000","last_clean":"2024-03-30T12:36:03.017508+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:36:03.017508+0000","last_undegraded":"2024-03-30T12:36:03.017508+0000","last_fullsized":"2024-03-30T12:36:03.017508+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220253+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:36:03.220253+0000","last_peered":"2024-03-30T12:36:03.220253+0000","last_clean":"2024-03-30T12:36:03.220253+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:36:03.220253+0000","last_undegraded":"2024-03-30T12:36:03.220253+0000","last_fullsized":"2024-03-30T12:36:03.220253+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220192+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:36:03.220192+0000","last_peered":"2024-03-30T12:36:03.220192+0000","last_clean":"2024-03-30T12:36:03.220192+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:36:03.220192+0000","last_undegraded":"2024-03-30T12:36:03.220192+0000","last_fullsized":"2024-03-30T12:36:03.220192+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1343,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015636+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:36:03.015636+0000","last_peered":"2024-03-30T12:36:03.015636+0000","last_clean":"2024-03-30T12:36:03.015636+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:36:03.015636+0000","last_undegraded":"2024-03-30T12:36:03.015636+0000","last_fullsized":"2024-03-30T12:36:03.015636+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016619+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:36:03.016619+0000","last_peered":"2024-03-30T12:36:03.016619+0000","last_clean":"2024-03-30T12:36:03.016619+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:36:03.016619+0000","last_undegraded":"2024-03-30T12:36:03.016619+0000","last_fullsized":"2024-03-30T12:36:03.016619+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5752,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.367799+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:36:03.367799+0000","last_peered":"2024-03-30T12:36:03.367799+0000","last_clean":"2024-03-30T12:36:03.367799+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:36:03.367799+0000","last_undegraded":"2024-03-30T12:36:03.367799+0000","last_fullsized":"2024-03-30T12:36:03.367799+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020404+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:36:03.020404+0000","last_peered":"2024-03-30T12:36:03.020404+0000","last_clean":"2024-03-30T12:36:03.020404+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:36:03.020404+0000","last_undegraded":"2024-03-30T12:36:03.020404+0000","last_fullsized":"2024-03-30T12:36:03.020404+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018051+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:36:03.018051+0000","last_peered":"2024-03-30T12:36:03.018051+0000","last_clean":"2024-03-30T12:36:03.018051+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:36:03.018051+0000","last_undegraded":"2024-03-30T12:36:03.018051+0000","last_fullsized":"2024-03-30T12:36:03.018051+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5512,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.222067+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:36:03.222067+0000","last_peered":"2024-03-30T12:36:03.222067+0000","last_clean":"2024-03-30T12:36:03.222067+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:36:03.222067+0000","last_undegraded":"2024-03-30T12:36:03.222067+0000","last_fullsized":"2024-03-30T12:36:03.222067+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220604+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:36:03.220604+0000","last_peered":"2024-03-30T12:36:03.220604+0000","last_clean":"2024-03-30T12:36:03.220604+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:36:03.220604+0000","last_undegraded":"2024-03-30T12:36:03.220604+0000","last_fullsized":"2024-03-30T12:36:03.220604+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1346,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222463+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:36:03.222463+0000","last_peered":"2024-03-30T12:36:03.222463+0000","last_clean":"2024-03-30T12:36:03.222463+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:36:03.222463+0000","last_undegraded":"2024-03-30T12:36:03.222463+0000","last_fullsized":"2024-03-30T12:36:03.222463+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222511+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:36:03.222511+0000","last_peered":"2024-03-30T12:36:03.222511+0000","last_clean":"2024-03-30T12:36:03.222511+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:36:03.222511+0000","last_undegraded":"2024-03-30T12:36:03.222511+0000","last_fullsized":"2024-03-30T12:36:03.222511+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5457,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.222052+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:36:03.222052+0000","last_peered":"2024-03-30T12:36:03.222052+0000","last_clean":"2024-03-30T12:36:03.222052+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:36:03.222052+0000","last_undegraded":"2024-03-30T12:36:03.222052+0000","last_fullsized":"2024-03-30T12:36:03.222052+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222581+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:36:03.222581+0000","last_peered":"2024-03-30T12:36:03.222581+0000","last_clean":"2024-03-30T12:36:03.222581+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:36:03.222581+0000","last_undegraded":"2024-03-30T12:36:03.222581+0000","last_fullsized":"2024-03-30T12:36:03.222581+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221692+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:36:03.221692+0000","last_peered":"2024-03-30T12:36:03.221692+0000","last_clean":"2024-03-30T12:36:03.221692+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:36:03.221692+0000","last_undegraded":"2024-03-30T12:36:03.221692+0000","last_fullsized":"2024-03-30T12:36:03.221692+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1271,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019374+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:36:03.019374+0000","last_peered":"2024-03-30T12:36:03.019374+0000","last_clean":"2024-03-30T12:36:03.019374+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:36:03.019374+0000","last_undegraded":"2024-03-30T12:36:03.019374+0000","last_fullsized":"2024-03-30T12:36:03.019374+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3803,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.367883+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:36:03.367883+0000","last_peered":"2024-03-30T12:36:03.367883+0000","last_clean":"2024-03-30T12:36:03.367883+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:36:03.367883+0000","last_undegraded":"2024-03-30T12:36:03.367883+0000","last_fullsized":"2024-03-30T12:36:03.367883+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1342,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222978+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:36:03.222978+0000","last_peered":"2024-03-30T12:36:03.222978+0000","last_clean":"2024-03-30T12:36:03.222978+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:36:03.222978+0000","last_undegraded":"2024-03-30T12:36:03.222978+0000","last_fullsized":"2024-03-30T12:36:03.222978+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222036+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:36:03.222036+0000","last_peered":"2024-03-30T12:36:03.222036+0000","last_clean":"2024-03-30T12:36:03.222036+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:36:03.222036+0000","last_undegraded":"2024-03-30T12:36:03.222036+0000","last_fullsized":"2024-03-30T12:36:03.222036+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015232+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:36:03.015232+0000","last_peered":"2024-03-30T12:36:03.015232+0000","last_clean":"2024-03-30T12:36:03.015232+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:36:03.015232+0000","last_undegraded":"2024-03-30T12:36:03.015232+0000","last_fullsized":"2024-03-30T12:36:03.015232+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4575,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.019196+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:36:03.019196+0000","last_peered":"2024-03-30T12:36:03.019196+0000","last_clean":"2024-03-30T12:36:03.019196+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:36:03.019196+0000","last_undegraded":"2024-03-30T12:36:03.019196+0000","last_fullsized":"2024-03-30T12:36:03.019196+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1174,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220771+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:36:03.220771+0000","last_peered":"2024-03-30T12:36:03.220771+0000","last_clean":"2024-03-30T12:36:03.220771+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:36:03.220771+0000","last_undegraded":"2024-03-30T12:36:03.220771+0000","last_fullsized":"2024-03-30T12:36:03.220771+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221414+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:36:03.221414+0000","last_peered":"2024-03-30T12:36:03.221414+0000","last_clean":"2024-03-30T12:36:03.221414+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:36:03.221414+0000","last_undegraded":"2024-03-30T12:36:03.221414+0000","last_fullsized":"2024-03-30T12:36:03.221414+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1199,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222181+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:36:03.222181+0000","last_peered":"2024-03-30T12:36:03.222181+0000","last_clean":"2024-03-30T12:36:03.222181+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:36:03.222181+0000","last_undegraded":"2024-03-30T12:36:03.222181+0000","last_fullsized":"2024-03-30T12:36:03.222181+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1715,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016476+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:36:03.016476+0000","last_peered":"2024-03-30T12:36:03.016476+0000","last_clean":"2024-03-30T12:36:03.016476+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:36:03.016476+0000","last_undegraded":"2024-03-30T12:36:03.016476+0000","last_fullsized":"2024-03-30T12:36:03.016476+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24713,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223744+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:36:03.223744+0000","last_peered":"2024-03-30T12:36:03.223744+0000","last_clean":"2024-03-30T12:36:03.223744+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:36:03.223744+0000","last_undegraded":"2024-03-30T12:36:03.223744+0000","last_fullsized":"2024-03-30T12:36:03.223744+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220614+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:36:03.220614+0000","last_peered":"2024-03-30T12:36:03.220614+0000","last_clean":"2024-03-30T12:36:03.220614+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:36:03.220614+0000","last_undegraded":"2024-03-30T12:36:03.220614+0000","last_fullsized":"2024-03-30T12:36:03.220614+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220696+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:36:03.220696+0000","last_peered":"2024-03-30T12:36:03.220696+0000","last_clean":"2024-03-30T12:36:03.220696+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:36:03.220696+0000","last_undegraded":"2024-03-30T12:36:03.220696+0000","last_fullsized":"2024-03-30T12:36:03.220696+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1143,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016477+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:36:03.016477+0000","last_peered":"2024-03-30T12:36:03.016477+0000","last_clean":"2024-03-30T12:36:03.016477+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:36:03.016477+0000","last_undegraded":"2024-03-30T12:36:03.016477+0000","last_fullsized":"2024-03-30T12:36:03.016477+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16480,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.221717+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:36:03.221717+0000","last_peered":"2024-03-30T12:36:03.221717+0000","last_clean":"2024-03-30T12:36:03.221717+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:36:03.221717+0000","last_undegraded":"2024-03-30T12:36:03.221717+0000","last_fullsized":"2024-03-30T12:36:03.221717+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221448+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:36:03.221448+0000","last_peered":"2024-03-30T12:36:03.221448+0000","last_clean":"2024-03-30T12:36:03.221448+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:36:03.221448+0000","last_undegraded":"2024-03-30T12:36:03.221448+0000","last_fullsized":"2024-03-30T12:36:03.221448+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017748+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:36:03.017748+0000","last_peered":"2024-03-30T12:36:03.017748+0000","last_clean":"2024-03-30T12:36:03.017748+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:36:03.017748+0000","last_undegraded":"2024-03-30T12:36:03.017748+0000","last_fullsized":"2024-03-30T12:36:03.017748+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222675+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:36:03.222675+0000","last_peered":"2024-03-30T12:36:03.222675+0000","last_clean":"2024-03-30T12:36:03.222675+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:36:03.222675+0000","last_undegraded":"2024-03-30T12:36:03.222675+0000","last_fullsized":"2024-03-30T12:36:03.222675+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31268,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.021096+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:36:03.021096+0000","last_peered":"2024-03-30T12:36:03.021096+0000","last_clean":"2024-03-30T12:36:03.021096+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:36:03.021096+0000","last_undegraded":"2024-03-30T12:36:03.021096+0000","last_fullsized":"2024-03-30T12:36:03.021096+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1294,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219916+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:36:03.219916+0000","last_peered":"2024-03-30T12:36:03.219916+0000","last_clean":"2024-03-30T12:36:03.219916+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:36:03.219916+0000","last_undegraded":"2024-03-30T12:36:03.219916+0000","last_fullsized":"2024-03-30T12:36:03.219916+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221733+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:36:03.221733+0000","last_peered":"2024-03-30T12:36:03.221733+0000","last_clean":"2024-03-30T12:36:03.221733+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:36:03.221733+0000","last_undegraded":"2024-03-30T12:36:03.221733+0000","last_fullsized":"2024-03-30T12:36:03.221733+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221129+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:36:03.221129+0000","last_peered":"2024-03-30T12:36:03.221129+0000","last_clean":"2024-03-30T12:36:03.221129+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:36:03.221129+0000","last_undegraded":"2024-03-30T12:36:03.221129+0000","last_fullsized":"2024-03-30T12:36:03.221129+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3764,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220021+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:36:03.220021+0000","last_peered":"2024-03-30T12:36:03.220021+0000","last_clean":"2024-03-30T12:36:03.220021+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:36:03.220021+0000","last_undegraded":"2024-03-30T12:36:03.220021+0000","last_fullsized":"2024-03-30T12:36:03.220021+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019149+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:36:03.019149+0000","last_peered":"2024-03-30T12:36:03.019149+0000","last_clean":"2024-03-30T12:36:03.019149+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:36:03.019149+0000","last_undegraded":"2024-03-30T12:36:03.019149+0000","last_fullsized":"2024-03-30T12:36:03.019149+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220680+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:36:03.220680+0000","last_peered":"2024-03-30T12:36:03.220680+0000","last_clean":"2024-03-30T12:36:03.220680+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:36:03.220680+0000","last_undegraded":"2024-03-30T12:36:03.220680+0000","last_fullsized":"2024-03-30T12:36:03.220680+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220354+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:36:03.220354+0000","last_peered":"2024-03-30T12:36:03.220354+0000","last_clean":"2024-03-30T12:36:03.220354+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:36:03.220354+0000","last_undegraded":"2024-03-30T12:36:03.220354+0000","last_fullsized":"2024-03-30T12:36:03.220354+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15593,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223541+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:36:03.223541+0000","last_peered":"2024-03-30T12:36:03.223541+0000","last_clean":"2024-03-30T12:36:03.223541+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:36:03.223541+0000","last_undegraded":"2024-03-30T12:36:03.223541+0000","last_fullsized":"2024-03-30T12:36:03.223541+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1142,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016783+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:36:03.016783+0000","last_peered":"2024-03-30T12:36:03.016783+0000","last_clean":"2024-03-30T12:36:03.016783+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:36:03.016783+0000","last_undegraded":"2024-03-30T12:36:03.016783+0000","last_fullsized":"2024-03-30T12:36:03.016783+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1257,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018978+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:36:03.018978+0000","last_peered":"2024-03-30T12:36:03.018978+0000","last_clean":"2024-03-30T12:36:03.018978+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:36:03.018978+0000","last_undegraded":"2024-03-30T12:36:03.018978+0000","last_fullsized":"2024-03-30T12:36:03.018978+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29019,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.020881+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:36:03.020881+0000","last_peered":"2024-03-30T12:36:03.020881+0000","last_clean":"2024-03-30T12:36:03.020881+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:36:03.020881+0000","last_undegraded":"2024-03-30T12:36:03.020881+0000","last_fullsized":"2024-03-30T12:36:03.020881+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222681+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:36:03.222681+0000","last_peered":"2024-03-30T12:36:03.222681+0000","last_clean":"2024-03-30T12:36:03.222681+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:36:03.222681+0000","last_undegraded":"2024-03-30T12:36:03.222681+0000","last_fullsized":"2024-03-30T12:36:03.222681+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220045+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:36:03.220045+0000","last_peered":"2024-03-30T12:36:03.220045+0000","last_clean":"2024-03-30T12:36:03.220045+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:36:03.220045+0000","last_undegraded":"2024-03-30T12:36:03.220045+0000","last_fullsized":"2024-03-30T12:36:03.220045+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5609,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.017229+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:36:03.017229+0000","last_peered":"2024-03-30T12:36:03.017229+0000","last_clean":"2024-03-30T12:36:03.017229+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:36:03.017229+0000","last_undegraded":"2024-03-30T12:36:03.017229+0000","last_fullsized":"2024-03-30T12:36:03.017229+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1364,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220455+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:36:03.220455+0000","last_peered":"2024-03-30T12:36:03.220455+0000","last_clean":"2024-03-30T12:36:03.220455+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:36:03.220455+0000","last_undegraded":"2024-03-30T12:36:03.220455+0000","last_fullsized":"2024-03-30T12:36:03.220455+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221588+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:03.221588+0000","last_peered":"2024-03-30T12:36:03.221588+0000","last_clean":"2024-03-30T12:36:03.221588+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:03.221588+0000","last_undegraded":"2024-03-30T12:36:03.221588+0000","last_fullsized":"2024-03-30T12:36:03.221588+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222932+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:36:03.222932+0000","last_peered":"2024-03-30T12:36:03.222932+0000","last_clean":"2024-03-30T12:36:03.222932+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:36:03.222932+0000","last_undegraded":"2024-03-30T12:36:03.222932+0000","last_fullsized":"2024-03-30T12:36:03.222932+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017355+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:36:03.017355+0000","last_peered":"2024-03-30T12:36:03.017355+0000","last_clean":"2024-03-30T12:36:03.017355+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:36:03.017355+0000","last_undegraded":"2024-03-30T12:36:03.017355+0000","last_fullsized":"2024-03-30T12:36:03.017355+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221062+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:36:03.221062+0000","last_peered":"2024-03-30T12:36:03.221062+0000","last_clean":"2024-03-30T12:36:03.221062+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:36:03.221062+0000","last_undegraded":"2024-03-30T12:36:03.221062+0000","last_fullsized":"2024-03-30T12:36:03.221062+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5252,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.017068+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:36:03.017068+0000","last_peered":"2024-03-30T12:36:03.017068+0000","last_clean":"2024-03-30T12:36:03.017068+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:36:03.017068+0000","last_undegraded":"2024-03-30T12:36:03.017068+0000","last_fullsized":"2024-03-30T12:36:03.017068+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1330,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016069+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:36:03.016069+0000","last_peered":"2024-03-30T12:36:03.016069+0000","last_clean":"2024-03-30T12:36:03.016069+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:36:03.016069+0000","last_undegraded":"2024-03-30T12:36:03.016069+0000","last_fullsized":"2024-03-30T12:36:03.016069+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017799+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:36:03.017799+0000","last_peered":"2024-03-30T12:36:03.017799+0000","last_clean":"2024-03-30T12:36:03.017799+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:36:03.017799+0000","last_undegraded":"2024-03-30T12:36:03.017799+0000","last_fullsized":"2024-03-30T12:36:03.017799+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4810,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.367842+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:36:03.367842+0000","last_peered":"2024-03-30T12:36:03.367842+0000","last_clean":"2024-03-30T12:36:03.367842+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:36:03.367842+0000","last_undegraded":"2024-03-30T12:36:03.367842+0000","last_fullsized":"2024-03-30T12:36:03.367842+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220953+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:36:03.220953+0000","last_peered":"2024-03-30T12:36:03.220953+0000","last_clean":"2024-03-30T12:36:03.220953+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:36:03.220953+0000","last_undegraded":"2024-03-30T12:36:03.220953+0000","last_fullsized":"2024-03-30T12:36:03.220953+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222608+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:36:03.222608+0000","last_peered":"2024-03-30T12:36:03.222608+0000","last_clean":"2024-03-30T12:36:03.222608+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:36:03.222608+0000","last_undegraded":"2024-03-30T12:36:03.222608+0000","last_fullsized":"2024-03-30T12:36:03.222608+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6742,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.018791+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:36:03.018791+0000","last_peered":"2024-03-30T12:36:03.018791+0000","last_clean":"2024-03-30T12:36:03.018791+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:36:03.018791+0000","last_undegraded":"2024-03-30T12:36:03.018791+0000","last_fullsized":"2024-03-30T12:36:03.018791+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1336,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016373+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:36:03.016373+0000","last_peered":"2024-03-30T12:36:03.016373+0000","last_clean":"2024-03-30T12:36:03.016373+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:36:03.016373+0000","last_undegraded":"2024-03-30T12:36:03.016373+0000","last_fullsized":"2024-03-30T12:36:03.016373+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018917+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:36:03.018917+0000","last_peered":"2024-03-30T12:36:03.018917+0000","last_clean":"2024-03-30T12:36:03.018917+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:36:03.018917+0000","last_undegraded":"2024-03-30T12:36:03.018917+0000","last_fullsized":"2024-03-30T12:36:03.018917+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220179+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:36:03.220179+0000","last_peered":"2024-03-30T12:36:03.220179+0000","last_clean":"2024-03-30T12:36:03.220179+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:36:03.220179+0000","last_undegraded":"2024-03-30T12:36:03.220179+0000","last_fullsized":"2024-03-30T12:36:03.220179+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015330+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:36:03.015330+0000","last_peered":"2024-03-30T12:36:03.015330+0000","last_clean":"2024-03-30T12:36:03.015330+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:36:03.015330+0000","last_undegraded":"2024-03-30T12:36:03.015330+0000","last_fullsized":"2024-03-30T12:36:03.015330+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221954+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:36:03.221954+0000","last_peered":"2024-03-30T12:36:03.221954+0000","last_clean":"2024-03-30T12:36:03.221954+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:36:03.221954+0000","last_undegraded":"2024-03-30T12:36:03.221954+0000","last_fullsized":"2024-03-30T12:36:03.221954+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221038+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:36:03.221038+0000","last_peered":"2024-03-30T12:36:03.221038+0000","last_clean":"2024-03-30T12:36:03.221038+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:36:03.221038+0000","last_undegraded":"2024-03-30T12:36:03.221038+0000","last_fullsized":"2024-03-30T12:36:03.221038+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220172+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:36:03.220172+0000","last_peered":"2024-03-30T12:36:03.220172+0000","last_clean":"2024-03-30T12:36:03.220172+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:36:03.220172+0000","last_undegraded":"2024-03-30T12:36:03.220172+0000","last_fullsized":"2024-03-30T12:36:03.220172+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221044+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:36:03.221044+0000","last_peered":"2024-03-30T12:36:03.221044+0000","last_clean":"2024-03-30T12:36:03.221044+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:36:03.221044+0000","last_undegraded":"2024-03-30T12:36:03.221044+0000","last_fullsized":"2024-03-30T12:36:03.221044+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1176,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221139+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:36:03.221139+0000","last_peered":"2024-03-30T12:36:03.221139+0000","last_clean":"2024-03-30T12:36:03.221139+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:36:03.221139+0000","last_undegraded":"2024-03-30T12:36:03.221139+0000","last_fullsized":"2024-03-30T12:36:03.221139+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1280,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221301+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:36:03.221301+0000","last_peered":"2024-03-30T12:36:03.221301+0000","last_clean":"2024-03-30T12:36:03.221301+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:36:03.221301+0000","last_undegraded":"2024-03-30T12:36:03.221301+0000","last_fullsized":"2024-03-30T12:36:03.221301+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221612+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:36:03.221612+0000","last_peered":"2024-03-30T12:36:03.221612+0000","last_clean":"2024-03-30T12:36:03.221612+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:36:03.221612+0000","last_undegraded":"2024-03-30T12:36:03.221612+0000","last_fullsized":"2024-03-30T12:36:03.221612+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220227+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:03.220227+0000","last_peered":"2024-03-30T12:36:03.220227+0000","last_clean":"2024-03-30T12:36:03.220227+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:03.220227+0000","last_undegraded":"2024-03-30T12:36:03.220227+0000","last_fullsized":"2024-03-30T12:36:03.220227+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221610+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:36:03.221610+0000","last_peered":"2024-03-30T12:36:03.221610+0000","last_clean":"2024-03-30T12:36:03.221610+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:36:03.221610+0000","last_undegraded":"2024-03-30T12:36:03.221610+0000","last_fullsized":"2024-03-30T12:36:03.221610+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220926+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:36:03.220926+0000","last_peered":"2024-03-30T12:36:03.220926+0000","last_clean":"2024-03-30T12:36:03.220926+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:36:03.220926+0000","last_undegraded":"2024-03-30T12:36:03.220926+0000","last_fullsized":"2024-03-30T12:36:03.220926+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220599+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:36:03.220599+0000","last_peered":"2024-03-30T12:36:03.220599+0000","last_clean":"2024-03-30T12:36:03.220599+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:36:03.220599+0000","last_undegraded":"2024-03-30T12:36:03.220599+0000","last_fullsized":"2024-03-30T12:36:03.220599+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438048,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648104,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175114,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254352,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063171,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951228,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839285,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923567,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:38:16.928 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:16.928 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:16.928 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:16.928 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:16.929 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:16.929 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:16.929 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:16.929 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:16.929 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:16.929 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:16.929 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:16.929 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:16.929 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:16.929 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:38:17.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:16 smithi084 ceph-mon[91810]: from='client.34572 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:38:17.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:16 smithi084 ceph-mon[89279]: from='client.34572 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:38:17.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:16 smithi162 ceph-mon[83709]: from='client.34572 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:38:18.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:17 smithi084 ceph-mon[89279]: pgmap v1057: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:18.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:17 smithi084 ceph-mon[91810]: pgmap v1057: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:18.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:17 smithi162 ceph-mon[83709]: pgmap v1057: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:19.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:38:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:38:19] "GET /metrics HTTP/1.1" 200 36328 "" "Prometheus/2.43.0" 2024-03-30T12:38:20.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:19 smithi084 ceph-mon[91810]: pgmap v1058: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:20.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:19 smithi084 ceph-mon[89279]: pgmap v1058: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:20.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:19 smithi162 ceph-mon[83709]: pgmap v1058: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:22.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:21 smithi084 ceph-mon[89279]: pgmap v1059: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:22.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:21 smithi084 ceph-mon[91810]: pgmap v1059: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:22.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:21 smithi162 ceph-mon[83709]: pgmap v1059: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:24.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:23 smithi084 ceph-mon[91810]: pgmap v1060: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:24.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:23 smithi084 ceph-mon[89279]: pgmap v1060: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:24.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:23 smithi162 ceph-mon[83709]: pgmap v1060: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:26.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:25 smithi084 ceph-mon[91810]: pgmap v1061: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:26.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:25 smithi084 ceph-mon[89279]: pgmap v1061: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:26.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:25 smithi162 ceph-mon[83709]: pgmap v1061: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:26.930 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:38:27.149 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:38:28.213 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:27 smithi084 ceph-mon[89279]: pgmap v1062: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:28.214 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:27 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:38:28.214 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:27 smithi084 ceph-mon[91810]: pgmap v1062: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:28.214 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:27 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:38:28.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:27 smithi162 ceph-mon[83709]: pgmap v1062: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:28.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:27 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:38:28.937 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:38:28.939 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:38:29.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:28 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:38:29.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:28 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:38:29.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:28 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:38:29.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:28 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:38:29.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:28 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:38:29.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:28 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:38:29.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:28 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:38:29.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:28 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:38:29.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:28 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:38:29.579 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:38:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:38:29] "GET /metrics HTTP/1.1" 200 36328 "" "Prometheus/2.43.0" 2024-03-30T12:38:29.599 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1063,"stamp":"2024-03-30T12:38:28.842681+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003947"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018672+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:36:03.018672+0000","last_peered":"2024-03-30T12:36:03.018672+0000","last_clean":"2024-03-30T12:36:03.018672+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:36:03.018672+0000","last_undegraded":"2024-03-30T12:36:03.018672+0000","last_fullsized":"2024-03-30T12:36:03.018672+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1363,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221634+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:36:03.221634+0000","last_peered":"2024-03-30T12:36:03.221634+0000","last_clean":"2024-03-30T12:36:03.221634+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:36:03.221634+0000","last_undegraded":"2024-03-30T12:36:03.221634+0000","last_fullsized":"2024-03-30T12:36:03.221634+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221207+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:36:03.221207+0000","last_peered":"2024-03-30T12:36:03.221207+0000","last_clean":"2024-03-30T12:36:03.221207+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:36:03.221207+0000","last_undegraded":"2024-03-30T12:36:03.221207+0000","last_fullsized":"2024-03-30T12:36:03.221207+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222119+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:36:03.222119+0000","last_peered":"2024-03-30T12:36:03.222119+0000","last_clean":"2024-03-30T12:36:03.222119+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:36:03.222119+0000","last_undegraded":"2024-03-30T12:36:03.222119+0000","last_fullsized":"2024-03-30T12:36:03.222119+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016863+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:36:03.016863+0000","last_peered":"2024-03-30T12:36:03.016863+0000","last_clean":"2024-03-30T12:36:03.016863+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:36:03.016863+0000","last_undegraded":"2024-03-30T12:36:03.016863+0000","last_fullsized":"2024-03-30T12:36:03.016863+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1209,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222566+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:03.222566+0000","last_peered":"2024-03-30T12:36:03.222566+0000","last_clean":"2024-03-30T12:36:03.222566+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:03.222566+0000","last_undegraded":"2024-03-30T12:36:03.222566+0000","last_fullsized":"2024-03-30T12:36:03.222566+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017365+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:36:03.017365+0000","last_peered":"2024-03-30T12:36:03.017365+0000","last_clean":"2024-03-30T12:36:03.017365+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:36:03.017365+0000","last_undegraded":"2024-03-30T12:36:03.017365+0000","last_fullsized":"2024-03-30T12:36:03.017365+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219781+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:36:03.219781+0000","last_peered":"2024-03-30T12:36:03.219781+0000","last_clean":"2024-03-30T12:36:03.219781+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:36:03.219781+0000","last_undegraded":"2024-03-30T12:36:03.219781+0000","last_fullsized":"2024-03-30T12:36:03.219781+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018011+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:36:03.018011+0000","last_peered":"2024-03-30T12:36:03.018011+0000","last_clean":"2024-03-30T12:36:03.018011+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:36:03.018011+0000","last_undegraded":"2024-03-30T12:36:03.018011+0000","last_fullsized":"2024-03-30T12:36:03.018011+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220774+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:03.220774+0000","last_peered":"2024-03-30T12:36:03.220774+0000","last_clean":"2024-03-30T12:36:03.220774+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:03.220774+0000","last_undegraded":"2024-03-30T12:36:03.220774+0000","last_fullsized":"2024-03-30T12:36:03.220774+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220468+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:03.220468+0000","last_peered":"2024-03-30T12:36:03.220468+0000","last_clean":"2024-03-30T12:36:03.220468+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:03.220468+0000","last_undegraded":"2024-03-30T12:36:03.220468+0000","last_fullsized":"2024-03-30T12:36:03.220468+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1270,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020253+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:36:03.020253+0000","last_peered":"2024-03-30T12:36:03.020253+0000","last_clean":"2024-03-30T12:36:03.020253+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:36:03.020253+0000","last_undegraded":"2024-03-30T12:36:03.020253+0000","last_fullsized":"2024-03-30T12:36:03.020253+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221688+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:36:03.221688+0000","last_peered":"2024-03-30T12:36:03.221688+0000","last_clean":"2024-03-30T12:36:03.221688+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:36:03.221688+0000","last_undegraded":"2024-03-30T12:36:03.221688+0000","last_fullsized":"2024-03-30T12:36:03.221688+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220487+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:36:03.220487+0000","last_peered":"2024-03-30T12:36:03.220487+0000","last_clean":"2024-03-30T12:36:03.220487+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:36:03.220487+0000","last_undegraded":"2024-03-30T12:36:03.220487+0000","last_fullsized":"2024-03-30T12:36:03.220487+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222534+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:36:03.222534+0000","last_peered":"2024-03-30T12:36:03.222534+0000","last_clean":"2024-03-30T12:36:03.222534+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:36:03.222534+0000","last_undegraded":"2024-03-30T12:36:03.222534+0000","last_fullsized":"2024-03-30T12:36:03.222534+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1213,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221481+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:36:03.221481+0000","last_peered":"2024-03-30T12:36:03.221481+0000","last_clean":"2024-03-30T12:36:03.221481+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:36:03.221481+0000","last_undegraded":"2024-03-30T12:36:03.221481+0000","last_fullsized":"2024-03-30T12:36:03.221481+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1224,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.223011+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:36:03.223011+0000","last_peered":"2024-03-30T12:36:03.223011+0000","last_clean":"2024-03-30T12:36:03.223011+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:36:03.223011+0000","last_undegraded":"2024-03-30T12:36:03.223011+0000","last_fullsized":"2024-03-30T12:36:03.223011+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015999+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:36:03.015999+0000","last_peered":"2024-03-30T12:36:03.015999+0000","last_clean":"2024-03-30T12:36:03.015999+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:36:03.015999+0000","last_undegraded":"2024-03-30T12:36:03.015999+0000","last_fullsized":"2024-03-30T12:36:03.015999+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017955+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:36:03.017955+0000","last_peered":"2024-03-30T12:36:03.017955+0000","last_clean":"2024-03-30T12:36:03.017955+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:36:03.017955+0000","last_undegraded":"2024-03-30T12:36:03.017955+0000","last_fullsized":"2024-03-30T12:36:03.017955+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1387,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221082+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:36:03.221082+0000","last_peered":"2024-03-30T12:36:03.221082+0000","last_clean":"2024-03-30T12:36:03.221082+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:36:03.221082+0000","last_undegraded":"2024-03-30T12:36:03.221082+0000","last_fullsized":"2024-03-30T12:36:03.221082+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1282,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220823+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:36:03.220823+0000","last_peered":"2024-03-30T12:36:03.220823+0000","last_clean":"2024-03-30T12:36:03.220823+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:36:03.220823+0000","last_undegraded":"2024-03-30T12:36:03.220823+0000","last_fullsized":"2024-03-30T12:36:03.220823+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1301,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221016+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:36:03.221016+0000","last_peered":"2024-03-30T12:36:03.221016+0000","last_clean":"2024-03-30T12:36:03.221016+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:36:03.221016+0000","last_undegraded":"2024-03-30T12:36:03.221016+0000","last_fullsized":"2024-03-30T12:36:03.221016+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220378+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:36:03.220378+0000","last_peered":"2024-03-30T12:36:03.220378+0000","last_clean":"2024-03-30T12:36:03.220378+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:36:03.220378+0000","last_undegraded":"2024-03-30T12:36:03.220378+0000","last_fullsized":"2024-03-30T12:36:03.220378+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018097+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:36:03.018097+0000","last_peered":"2024-03-30T12:36:03.018097+0000","last_clean":"2024-03-30T12:36:03.018097+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:36:03.018097+0000","last_undegraded":"2024-03-30T12:36:03.018097+0000","last_fullsized":"2024-03-30T12:36:03.018097+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1228,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222708+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:03.222708+0000","last_peered":"2024-03-30T12:36:03.222708+0000","last_clean":"2024-03-30T12:36:03.222708+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:03.222708+0000","last_undegraded":"2024-03-30T12:36:03.222708+0000","last_fullsized":"2024-03-30T12:36:03.222708+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017698+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:36:03.017698+0000","last_peered":"2024-03-30T12:36:03.017698+0000","last_clean":"2024-03-30T12:36:03.017698+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:36:03.017698+0000","last_undegraded":"2024-03-30T12:36:03.017698+0000","last_fullsized":"2024-03-30T12:36:03.017698+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222301+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:03.222301+0000","last_peered":"2024-03-30T12:36:03.222301+0000","last_clean":"2024-03-30T12:36:03.222301+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:03.222301+0000","last_undegraded":"2024-03-30T12:36:03.222301+0000","last_fullsized":"2024-03-30T12:36:03.222301+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221852+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:36:03.221852+0000","last_peered":"2024-03-30T12:36:03.221852+0000","last_clean":"2024-03-30T12:36:03.221852+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:36:03.221852+0000","last_undegraded":"2024-03-30T12:36:03.221852+0000","last_fullsized":"2024-03-30T12:36:03.221852+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018855+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:36:03.018855+0000","last_peered":"2024-03-30T12:36:03.018855+0000","last_clean":"2024-03-30T12:36:03.018855+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:36:03.018855+0000","last_undegraded":"2024-03-30T12:36:03.018855+0000","last_fullsized":"2024-03-30T12:36:03.018855+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1179,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220575+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:36:03.220575+0000","last_peered":"2024-03-30T12:36:03.220575+0000","last_clean":"2024-03-30T12:36:03.220575+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:36:03.220575+0000","last_undegraded":"2024-03-30T12:36:03.220575+0000","last_fullsized":"2024-03-30T12:36:03.220575+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221577+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:36:03.221577+0000","last_peered":"2024-03-30T12:36:03.221577+0000","last_clean":"2024-03-30T12:36:03.221577+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:36:03.221577+0000","last_undegraded":"2024-03-30T12:36:03.221577+0000","last_fullsized":"2024-03-30T12:36:03.221577+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219839+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:36:03.219839+0000","last_peered":"2024-03-30T12:36:03.219839+0000","last_clean":"2024-03-30T12:36:03.219839+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:36:03.219839+0000","last_undegraded":"2024-03-30T12:36:03.219839+0000","last_fullsized":"2024-03-30T12:36:03.219839+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1294,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219823+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:36:03.219823+0000","last_peered":"2024-03-30T12:36:03.219823+0000","last_clean":"2024-03-30T12:36:03.219823+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:36:03.219823+0000","last_undegraded":"2024-03-30T12:36:03.219823+0000","last_fullsized":"2024-03-30T12:36:03.219823+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1223,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221769+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:36:03.221769+0000","last_peered":"2024-03-30T12:36:03.221769+0000","last_clean":"2024-03-30T12:36:03.221769+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:36:03.221769+0000","last_undegraded":"2024-03-30T12:36:03.221769+0000","last_fullsized":"2024-03-30T12:36:03.221769+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222968+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:36:03.222968+0000","last_peered":"2024-03-30T12:36:03.222968+0000","last_clean":"2024-03-30T12:36:03.222968+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:36:03.222968+0000","last_undegraded":"2024-03-30T12:36:03.222968+0000","last_fullsized":"2024-03-30T12:36:03.222968+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220821+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:03.220821+0000","last_peered":"2024-03-30T12:36:03.220821+0000","last_clean":"2024-03-30T12:36:03.220821+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:03.220821+0000","last_undegraded":"2024-03-30T12:36:03.220821+0000","last_fullsized":"2024-03-30T12:36:03.220821+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1203,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222317+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:36:03.222317+0000","last_peered":"2024-03-30T12:36:03.222317+0000","last_clean":"2024-03-30T12:36:03.222317+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:36:03.222317+0000","last_undegraded":"2024-03-30T12:36:03.222317+0000","last_fullsized":"2024-03-30T12:36:03.222317+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1197,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222067+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:36:03.222067+0000","last_peered":"2024-03-30T12:36:03.222067+0000","last_clean":"2024-03-30T12:36:03.222067+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:36:03.222067+0000","last_undegraded":"2024-03-30T12:36:03.222067+0000","last_fullsized":"2024-03-30T12:36:03.222067+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015739+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:36:03.015739+0000","last_peered":"2024-03-30T12:36:03.015739+0000","last_clean":"2024-03-30T12:36:03.015739+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:36:03.015739+0000","last_undegraded":"2024-03-30T12:36:03.015739+0000","last_fullsized":"2024-03-30T12:36:03.015739+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221275+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:36:03.221275+0000","last_peered":"2024-03-30T12:36:03.221275+0000","last_clean":"2024-03-30T12:36:03.221275+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:36:03.221275+0000","last_undegraded":"2024-03-30T12:36:03.221275+0000","last_fullsized":"2024-03-30T12:36:03.221275+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020091+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:36:03.020091+0000","last_peered":"2024-03-30T12:36:03.020091+0000","last_clean":"2024-03-30T12:36:03.020091+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:36:03.020091+0000","last_undegraded":"2024-03-30T12:36:03.020091+0000","last_fullsized":"2024-03-30T12:36:03.020091+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1204,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220837+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:36:03.220837+0000","last_peered":"2024-03-30T12:36:03.220837+0000","last_clean":"2024-03-30T12:36:03.220837+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:36:03.220837+0000","last_undegraded":"2024-03-30T12:36:03.220837+0000","last_fullsized":"2024-03-30T12:36:03.220837+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017435+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:36:03.017435+0000","last_peered":"2024-03-30T12:36:03.017435+0000","last_clean":"2024-03-30T12:36:03.017435+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:36:03.017435+0000","last_undegraded":"2024-03-30T12:36:03.017435+0000","last_fullsized":"2024-03-30T12:36:03.017435+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221769+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:36:03.221769+0000","last_peered":"2024-03-30T12:36:03.221769+0000","last_clean":"2024-03-30T12:36:03.221769+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:36:03.221769+0000","last_undegraded":"2024-03-30T12:36:03.221769+0000","last_fullsized":"2024-03-30T12:36:03.221769+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220786+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:36:03.220786+0000","last_peered":"2024-03-30T12:36:03.220786+0000","last_clean":"2024-03-30T12:36:03.220786+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:36:03.220786+0000","last_undegraded":"2024-03-30T12:36:03.220786+0000","last_fullsized":"2024-03-30T12:36:03.220786+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221971+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:36:03.221971+0000","last_peered":"2024-03-30T12:36:03.221971+0000","last_clean":"2024-03-30T12:36:03.221971+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:36:03.221971+0000","last_undegraded":"2024-03-30T12:36:03.221971+0000","last_fullsized":"2024-03-30T12:36:03.221971+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017508+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:36:03.017508+0000","last_peered":"2024-03-30T12:36:03.017508+0000","last_clean":"2024-03-30T12:36:03.017508+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:36:03.017508+0000","last_undegraded":"2024-03-30T12:36:03.017508+0000","last_fullsized":"2024-03-30T12:36:03.017508+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220253+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:36:03.220253+0000","last_peered":"2024-03-30T12:36:03.220253+0000","last_clean":"2024-03-30T12:36:03.220253+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:36:03.220253+0000","last_undegraded":"2024-03-30T12:36:03.220253+0000","last_fullsized":"2024-03-30T12:36:03.220253+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220192+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:36:03.220192+0000","last_peered":"2024-03-30T12:36:03.220192+0000","last_clean":"2024-03-30T12:36:03.220192+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:36:03.220192+0000","last_undegraded":"2024-03-30T12:36:03.220192+0000","last_fullsized":"2024-03-30T12:36:03.220192+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1343,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015636+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:36:03.015636+0000","last_peered":"2024-03-30T12:36:03.015636+0000","last_clean":"2024-03-30T12:36:03.015636+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:36:03.015636+0000","last_undegraded":"2024-03-30T12:36:03.015636+0000","last_fullsized":"2024-03-30T12:36:03.015636+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016619+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:36:03.016619+0000","last_peered":"2024-03-30T12:36:03.016619+0000","last_clean":"2024-03-30T12:36:03.016619+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:36:03.016619+0000","last_undegraded":"2024-03-30T12:36:03.016619+0000","last_fullsized":"2024-03-30T12:36:03.016619+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5752,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.367799+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:36:03.367799+0000","last_peered":"2024-03-30T12:36:03.367799+0000","last_clean":"2024-03-30T12:36:03.367799+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:36:03.367799+0000","last_undegraded":"2024-03-30T12:36:03.367799+0000","last_fullsized":"2024-03-30T12:36:03.367799+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020404+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:36:03.020404+0000","last_peered":"2024-03-30T12:36:03.020404+0000","last_clean":"2024-03-30T12:36:03.020404+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:36:03.020404+0000","last_undegraded":"2024-03-30T12:36:03.020404+0000","last_fullsized":"2024-03-30T12:36:03.020404+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018051+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:36:03.018051+0000","last_peered":"2024-03-30T12:36:03.018051+0000","last_clean":"2024-03-30T12:36:03.018051+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:36:03.018051+0000","last_undegraded":"2024-03-30T12:36:03.018051+0000","last_fullsized":"2024-03-30T12:36:03.018051+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5512,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.222067+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:36:03.222067+0000","last_peered":"2024-03-30T12:36:03.222067+0000","last_clean":"2024-03-30T12:36:03.222067+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:36:03.222067+0000","last_undegraded":"2024-03-30T12:36:03.222067+0000","last_fullsized":"2024-03-30T12:36:03.222067+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220604+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:36:03.220604+0000","last_peered":"2024-03-30T12:36:03.220604+0000","last_clean":"2024-03-30T12:36:03.220604+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:36:03.220604+0000","last_undegraded":"2024-03-30T12:36:03.220604+0000","last_fullsized":"2024-03-30T12:36:03.220604+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1346,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222463+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:36:03.222463+0000","last_peered":"2024-03-30T12:36:03.222463+0000","last_clean":"2024-03-30T12:36:03.222463+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:36:03.222463+0000","last_undegraded":"2024-03-30T12:36:03.222463+0000","last_fullsized":"2024-03-30T12:36:03.222463+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222511+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:36:03.222511+0000","last_peered":"2024-03-30T12:36:03.222511+0000","last_clean":"2024-03-30T12:36:03.222511+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:36:03.222511+0000","last_undegraded":"2024-03-30T12:36:03.222511+0000","last_fullsized":"2024-03-30T12:36:03.222511+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5457,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.222052+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:36:03.222052+0000","last_peered":"2024-03-30T12:36:03.222052+0000","last_clean":"2024-03-30T12:36:03.222052+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:36:03.222052+0000","last_undegraded":"2024-03-30T12:36:03.222052+0000","last_fullsized":"2024-03-30T12:36:03.222052+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222581+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:36:03.222581+0000","last_peered":"2024-03-30T12:36:03.222581+0000","last_clean":"2024-03-30T12:36:03.222581+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:36:03.222581+0000","last_undegraded":"2024-03-30T12:36:03.222581+0000","last_fullsized":"2024-03-30T12:36:03.222581+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221692+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:36:03.221692+0000","last_peered":"2024-03-30T12:36:03.221692+0000","last_clean":"2024-03-30T12:36:03.221692+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:36:03.221692+0000","last_undegraded":"2024-03-30T12:36:03.221692+0000","last_fullsized":"2024-03-30T12:36:03.221692+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1271,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019374+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:36:03.019374+0000","last_peered":"2024-03-30T12:36:03.019374+0000","last_clean":"2024-03-30T12:36:03.019374+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:36:03.019374+0000","last_undegraded":"2024-03-30T12:36:03.019374+0000","last_fullsized":"2024-03-30T12:36:03.019374+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3803,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.367883+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:36:03.367883+0000","last_peered":"2024-03-30T12:36:03.367883+0000","last_clean":"2024-03-30T12:36:03.367883+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:36:03.367883+0000","last_undegraded":"2024-03-30T12:36:03.367883+0000","last_fullsized":"2024-03-30T12:36:03.367883+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1342,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222978+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:36:03.222978+0000","last_peered":"2024-03-30T12:36:03.222978+0000","last_clean":"2024-03-30T12:36:03.222978+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:36:03.222978+0000","last_undegraded":"2024-03-30T12:36:03.222978+0000","last_fullsized":"2024-03-30T12:36:03.222978+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222036+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:36:03.222036+0000","last_peered":"2024-03-30T12:36:03.222036+0000","last_clean":"2024-03-30T12:36:03.222036+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:36:03.222036+0000","last_undegraded":"2024-03-30T12:36:03.222036+0000","last_fullsized":"2024-03-30T12:36:03.222036+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015232+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:36:03.015232+0000","last_peered":"2024-03-30T12:36:03.015232+0000","last_clean":"2024-03-30T12:36:03.015232+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:36:03.015232+0000","last_undegraded":"2024-03-30T12:36:03.015232+0000","last_fullsized":"2024-03-30T12:36:03.015232+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4575,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.019196+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:36:03.019196+0000","last_peered":"2024-03-30T12:36:03.019196+0000","last_clean":"2024-03-30T12:36:03.019196+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:36:03.019196+0000","last_undegraded":"2024-03-30T12:36:03.019196+0000","last_fullsized":"2024-03-30T12:36:03.019196+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1174,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220771+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:36:03.220771+0000","last_peered":"2024-03-30T12:36:03.220771+0000","last_clean":"2024-03-30T12:36:03.220771+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:36:03.220771+0000","last_undegraded":"2024-03-30T12:36:03.220771+0000","last_fullsized":"2024-03-30T12:36:03.220771+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:17.636728+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:36:17.636728+0000","last_peered":"2024-03-30T12:36:17.636728+0000","last_clean":"2024-03-30T12:36:17.636728+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:36:17.636728+0000","last_undegraded":"2024-03-30T12:36:17.636728+0000","last_fullsized":"2024-03-30T12:36:17.636728+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1199,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222181+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:36:03.222181+0000","last_peered":"2024-03-30T12:36:03.222181+0000","last_clean":"2024-03-30T12:36:03.222181+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:36:03.222181+0000","last_undegraded":"2024-03-30T12:36:03.222181+0000","last_fullsized":"2024-03-30T12:36:03.222181+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1716,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:19.123078+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:36:19.123078+0000","last_peered":"2024-03-30T12:36:19.123078+0000","last_clean":"2024-03-30T12:36:19.123078+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:36:19.123078+0000","last_undegraded":"2024-03-30T12:36:19.123078+0000","last_fullsized":"2024-03-30T12:36:19.123078+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24713,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223744+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:36:03.223744+0000","last_peered":"2024-03-30T12:36:03.223744+0000","last_clean":"2024-03-30T12:36:03.223744+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:36:03.223744+0000","last_undegraded":"2024-03-30T12:36:03.223744+0000","last_fullsized":"2024-03-30T12:36:03.223744+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220614+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:36:03.220614+0000","last_peered":"2024-03-30T12:36:03.220614+0000","last_clean":"2024-03-30T12:36:03.220614+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:36:03.220614+0000","last_undegraded":"2024-03-30T12:36:03.220614+0000","last_fullsized":"2024-03-30T12:36:03.220614+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220696+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:36:03.220696+0000","last_peered":"2024-03-30T12:36:03.220696+0000","last_clean":"2024-03-30T12:36:03.220696+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:36:03.220696+0000","last_undegraded":"2024-03-30T12:36:03.220696+0000","last_fullsized":"2024-03-30T12:36:03.220696+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:19.123052+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:36:19.123052+0000","last_peered":"2024-03-30T12:36:19.123052+0000","last_clean":"2024-03-30T12:36:19.123052+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:36:19.123052+0000","last_undegraded":"2024-03-30T12:36:19.123052+0000","last_fullsized":"2024-03-30T12:36:19.123052+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16480,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.221717+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:36:03.221717+0000","last_peered":"2024-03-30T12:36:03.221717+0000","last_clean":"2024-03-30T12:36:03.221717+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:36:03.221717+0000","last_undegraded":"2024-03-30T12:36:03.221717+0000","last_fullsized":"2024-03-30T12:36:03.221717+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221448+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:36:03.221448+0000","last_peered":"2024-03-30T12:36:03.221448+0000","last_clean":"2024-03-30T12:36:03.221448+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:36:03.221448+0000","last_undegraded":"2024-03-30T12:36:03.221448+0000","last_fullsized":"2024-03-30T12:36:03.221448+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017748+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:36:03.017748+0000","last_peered":"2024-03-30T12:36:03.017748+0000","last_clean":"2024-03-30T12:36:03.017748+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:36:03.017748+0000","last_undegraded":"2024-03-30T12:36:03.017748+0000","last_fullsized":"2024-03-30T12:36:03.017748+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222675+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:36:03.222675+0000","last_peered":"2024-03-30T12:36:03.222675+0000","last_clean":"2024-03-30T12:36:03.222675+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:36:03.222675+0000","last_undegraded":"2024-03-30T12:36:03.222675+0000","last_fullsized":"2024-03-30T12:36:03.222675+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31268,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.021096+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:36:03.021096+0000","last_peered":"2024-03-30T12:36:03.021096+0000","last_clean":"2024-03-30T12:36:03.021096+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:36:03.021096+0000","last_undegraded":"2024-03-30T12:36:03.021096+0000","last_fullsized":"2024-03-30T12:36:03.021096+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1294,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219916+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:36:03.219916+0000","last_peered":"2024-03-30T12:36:03.219916+0000","last_clean":"2024-03-30T12:36:03.219916+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:36:03.219916+0000","last_undegraded":"2024-03-30T12:36:03.219916+0000","last_fullsized":"2024-03-30T12:36:03.219916+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221733+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:36:03.221733+0000","last_peered":"2024-03-30T12:36:03.221733+0000","last_clean":"2024-03-30T12:36:03.221733+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:36:03.221733+0000","last_undegraded":"2024-03-30T12:36:03.221733+0000","last_fullsized":"2024-03-30T12:36:03.221733+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221129+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:36:03.221129+0000","last_peered":"2024-03-30T12:36:03.221129+0000","last_clean":"2024-03-30T12:36:03.221129+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:36:03.221129+0000","last_undegraded":"2024-03-30T12:36:03.221129+0000","last_fullsized":"2024-03-30T12:36:03.221129+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3764,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220021+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:36:03.220021+0000","last_peered":"2024-03-30T12:36:03.220021+0000","last_clean":"2024-03-30T12:36:03.220021+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:36:03.220021+0000","last_undegraded":"2024-03-30T12:36:03.220021+0000","last_fullsized":"2024-03-30T12:36:03.220021+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019149+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:36:03.019149+0000","last_peered":"2024-03-30T12:36:03.019149+0000","last_clean":"2024-03-30T12:36:03.019149+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:36:03.019149+0000","last_undegraded":"2024-03-30T12:36:03.019149+0000","last_fullsized":"2024-03-30T12:36:03.019149+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544094+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:36:09.544094+0000","last_peered":"2024-03-30T12:36:09.544094+0000","last_clean":"2024-03-30T12:36:09.544094+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:36:09.544094+0000","last_undegraded":"2024-03-30T12:36:09.544094+0000","last_fullsized":"2024-03-30T12:36:09.544094+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220354+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:36:03.220354+0000","last_peered":"2024-03-30T12:36:03.220354+0000","last_clean":"2024-03-30T12:36:03.220354+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:36:03.220354+0000","last_undegraded":"2024-03-30T12:36:03.220354+0000","last_fullsized":"2024-03-30T12:36:03.220354+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15593,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223541+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:36:03.223541+0000","last_peered":"2024-03-30T12:36:03.223541+0000","last_clean":"2024-03-30T12:36:03.223541+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:36:03.223541+0000","last_undegraded":"2024-03-30T12:36:03.223541+0000","last_fullsized":"2024-03-30T12:36:03.223541+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1142,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016783+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:36:03.016783+0000","last_peered":"2024-03-30T12:36:03.016783+0000","last_clean":"2024-03-30T12:36:03.016783+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:36:03.016783+0000","last_undegraded":"2024-03-30T12:36:03.016783+0000","last_fullsized":"2024-03-30T12:36:03.016783+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1257,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018978+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:36:03.018978+0000","last_peered":"2024-03-30T12:36:03.018978+0000","last_clean":"2024-03-30T12:36:03.018978+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:36:03.018978+0000","last_undegraded":"2024-03-30T12:36:03.018978+0000","last_fullsized":"2024-03-30T12:36:03.018978+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29019,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.020881+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:36:03.020881+0000","last_peered":"2024-03-30T12:36:03.020881+0000","last_clean":"2024-03-30T12:36:03.020881+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:36:03.020881+0000","last_undegraded":"2024-03-30T12:36:03.020881+0000","last_fullsized":"2024-03-30T12:36:03.020881+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222681+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:36:03.222681+0000","last_peered":"2024-03-30T12:36:03.222681+0000","last_clean":"2024-03-30T12:36:03.222681+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:36:03.222681+0000","last_undegraded":"2024-03-30T12:36:03.222681+0000","last_fullsized":"2024-03-30T12:36:03.222681+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220045+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:36:03.220045+0000","last_peered":"2024-03-30T12:36:03.220045+0000","last_clean":"2024-03-30T12:36:03.220045+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:36:03.220045+0000","last_undegraded":"2024-03-30T12:36:03.220045+0000","last_fullsized":"2024-03-30T12:36:03.220045+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5609,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.017229+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:36:03.017229+0000","last_peered":"2024-03-30T12:36:03.017229+0000","last_clean":"2024-03-30T12:36:03.017229+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:36:03.017229+0000","last_undegraded":"2024-03-30T12:36:03.017229+0000","last_fullsized":"2024-03-30T12:36:03.017229+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1364,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220455+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:36:03.220455+0000","last_peered":"2024-03-30T12:36:03.220455+0000","last_clean":"2024-03-30T12:36:03.220455+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:36:03.220455+0000","last_undegraded":"2024-03-30T12:36:03.220455+0000","last_fullsized":"2024-03-30T12:36:03.220455+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221588+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:03.221588+0000","last_peered":"2024-03-30T12:36:03.221588+0000","last_clean":"2024-03-30T12:36:03.221588+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:03.221588+0000","last_undegraded":"2024-03-30T12:36:03.221588+0000","last_fullsized":"2024-03-30T12:36:03.221588+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222932+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:36:03.222932+0000","last_peered":"2024-03-30T12:36:03.222932+0000","last_clean":"2024-03-30T12:36:03.222932+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:36:03.222932+0000","last_undegraded":"2024-03-30T12:36:03.222932+0000","last_fullsized":"2024-03-30T12:36:03.222932+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017355+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:36:03.017355+0000","last_peered":"2024-03-30T12:36:03.017355+0000","last_clean":"2024-03-30T12:36:03.017355+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:36:03.017355+0000","last_undegraded":"2024-03-30T12:36:03.017355+0000","last_fullsized":"2024-03-30T12:36:03.017355+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544025+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:36:09.544025+0000","last_peered":"2024-03-30T12:36:09.544025+0000","last_clean":"2024-03-30T12:36:09.544025+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:36:09.544025+0000","last_undegraded":"2024-03-30T12:36:09.544025+0000","last_fullsized":"2024-03-30T12:36:09.544025+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5252,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.017068+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:36:03.017068+0000","last_peered":"2024-03-30T12:36:03.017068+0000","last_clean":"2024-03-30T12:36:03.017068+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:36:03.017068+0000","last_undegraded":"2024-03-30T12:36:03.017068+0000","last_fullsized":"2024-03-30T12:36:03.017068+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1330,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016069+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:36:03.016069+0000","last_peered":"2024-03-30T12:36:03.016069+0000","last_clean":"2024-03-30T12:36:03.016069+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:36:03.016069+0000","last_undegraded":"2024-03-30T12:36:03.016069+0000","last_fullsized":"2024-03-30T12:36:03.016069+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017799+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:36:03.017799+0000","last_peered":"2024-03-30T12:36:03.017799+0000","last_clean":"2024-03-30T12:36:03.017799+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:36:03.017799+0000","last_undegraded":"2024-03-30T12:36:03.017799+0000","last_fullsized":"2024-03-30T12:36:03.017799+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4810,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.367842+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:36:03.367842+0000","last_peered":"2024-03-30T12:36:03.367842+0000","last_clean":"2024-03-30T12:36:03.367842+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:36:03.367842+0000","last_undegraded":"2024-03-30T12:36:03.367842+0000","last_fullsized":"2024-03-30T12:36:03.367842+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220953+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:36:03.220953+0000","last_peered":"2024-03-30T12:36:03.220953+0000","last_clean":"2024-03-30T12:36:03.220953+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:36:03.220953+0000","last_undegraded":"2024-03-30T12:36:03.220953+0000","last_fullsized":"2024-03-30T12:36:03.220953+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222608+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:36:03.222608+0000","last_peered":"2024-03-30T12:36:03.222608+0000","last_clean":"2024-03-30T12:36:03.222608+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:36:03.222608+0000","last_undegraded":"2024-03-30T12:36:03.222608+0000","last_fullsized":"2024-03-30T12:36:03.222608+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6742,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.018791+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:36:03.018791+0000","last_peered":"2024-03-30T12:36:03.018791+0000","last_clean":"2024-03-30T12:36:03.018791+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:36:03.018791+0000","last_undegraded":"2024-03-30T12:36:03.018791+0000","last_fullsized":"2024-03-30T12:36:03.018791+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1336,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016373+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:36:03.016373+0000","last_peered":"2024-03-30T12:36:03.016373+0000","last_clean":"2024-03-30T12:36:03.016373+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:36:03.016373+0000","last_undegraded":"2024-03-30T12:36:03.016373+0000","last_fullsized":"2024-03-30T12:36:03.016373+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018917+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:36:03.018917+0000","last_peered":"2024-03-30T12:36:03.018917+0000","last_clean":"2024-03-30T12:36:03.018917+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:36:03.018917+0000","last_undegraded":"2024-03-30T12:36:03.018917+0000","last_fullsized":"2024-03-30T12:36:03.018917+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220179+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:36:03.220179+0000","last_peered":"2024-03-30T12:36:03.220179+0000","last_clean":"2024-03-30T12:36:03.220179+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:36:03.220179+0000","last_undegraded":"2024-03-30T12:36:03.220179+0000","last_fullsized":"2024-03-30T12:36:03.220179+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015330+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:36:03.015330+0000","last_peered":"2024-03-30T12:36:03.015330+0000","last_clean":"2024-03-30T12:36:03.015330+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:36:03.015330+0000","last_undegraded":"2024-03-30T12:36:03.015330+0000","last_fullsized":"2024-03-30T12:36:03.015330+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221954+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:36:03.221954+0000","last_peered":"2024-03-30T12:36:03.221954+0000","last_clean":"2024-03-30T12:36:03.221954+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:36:03.221954+0000","last_undegraded":"2024-03-30T12:36:03.221954+0000","last_fullsized":"2024-03-30T12:36:03.221954+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221038+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:36:03.221038+0000","last_peered":"2024-03-30T12:36:03.221038+0000","last_clean":"2024-03-30T12:36:03.221038+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:36:03.221038+0000","last_undegraded":"2024-03-30T12:36:03.221038+0000","last_fullsized":"2024-03-30T12:36:03.221038+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220172+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:36:03.220172+0000","last_peered":"2024-03-30T12:36:03.220172+0000","last_clean":"2024-03-30T12:36:03.220172+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:36:03.220172+0000","last_undegraded":"2024-03-30T12:36:03.220172+0000","last_fullsized":"2024-03-30T12:36:03.220172+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221044+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:36:03.221044+0000","last_peered":"2024-03-30T12:36:03.221044+0000","last_clean":"2024-03-30T12:36:03.221044+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:36:03.221044+0000","last_undegraded":"2024-03-30T12:36:03.221044+0000","last_fullsized":"2024-03-30T12:36:03.221044+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1177,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544079+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:36:09.544079+0000","last_peered":"2024-03-30T12:36:09.544079+0000","last_clean":"2024-03-30T12:36:09.544079+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:36:09.544079+0000","last_undegraded":"2024-03-30T12:36:09.544079+0000","last_fullsized":"2024-03-30T12:36:09.544079+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1280,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221301+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:36:03.221301+0000","last_peered":"2024-03-30T12:36:03.221301+0000","last_clean":"2024-03-30T12:36:03.221301+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:36:03.221301+0000","last_undegraded":"2024-03-30T12:36:03.221301+0000","last_fullsized":"2024-03-30T12:36:03.221301+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221612+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:36:03.221612+0000","last_peered":"2024-03-30T12:36:03.221612+0000","last_clean":"2024-03-30T12:36:03.221612+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:36:03.221612+0000","last_undegraded":"2024-03-30T12:36:03.221612+0000","last_fullsized":"2024-03-30T12:36:03.221612+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220227+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:03.220227+0000","last_peered":"2024-03-30T12:36:03.220227+0000","last_clean":"2024-03-30T12:36:03.220227+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:03.220227+0000","last_undegraded":"2024-03-30T12:36:03.220227+0000","last_fullsized":"2024-03-30T12:36:03.220227+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221610+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:36:03.221610+0000","last_peered":"2024-03-30T12:36:03.221610+0000","last_clean":"2024-03-30T12:36:03.221610+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:36:03.221610+0000","last_undegraded":"2024-03-30T12:36:03.221610+0000","last_fullsized":"2024-03-30T12:36:03.221610+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220926+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:36:03.220926+0000","last_peered":"2024-03-30T12:36:03.220926+0000","last_clean":"2024-03-30T12:36:03.220926+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:36:03.220926+0000","last_undegraded":"2024-03-30T12:36:03.220926+0000","last_fullsized":"2024-03-30T12:36:03.220926+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220599+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:36:03.220599+0000","last_peered":"2024-03-30T12:36:03.220599+0000","last_clean":"2024-03-30T12:36:03.220599+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:36:03.220599+0000","last_undegraded":"2024-03-30T12:36:03.220599+0000","last_fullsized":"2024-03-30T12:36:03.220599+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438050,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648106,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175116,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254355,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063174,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951231,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839288,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923570,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:38:29.605 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:29.605 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:29.605 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:29.605 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:29.605 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:29.606 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:29.606 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:29.606 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:29.606 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:29.606 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:29.606 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:29.606 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:29.607 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:29.607 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:38:30.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:30 smithi084 ceph-mon[89279]: pgmap v1063: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:30.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:30 smithi084 ceph-mon[89279]: from='client.34578 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:38:30.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:30 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:38:30.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:30 smithi084 ceph-mon[91810]: pgmap v1063: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:30.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:30 smithi084 ceph-mon[91810]: from='client.34578 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:38:30.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:30 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:38:30.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:30 smithi162 ceph-mon[83709]: pgmap v1063: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:30.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:30 smithi162 ceph-mon[83709]: from='client.34578 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:38:30.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:30 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:38:32.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:32 smithi084 ceph-mon[91810]: pgmap v1064: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:32.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:32 smithi084 ceph-mon[89279]: pgmap v1064: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:32.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:32 smithi162 ceph-mon[83709]: pgmap v1064: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:34.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:34 smithi084 ceph-mon[89279]: pgmap v1065: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:34.754 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:34 smithi084 ceph-mon[91810]: pgmap v1065: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:34.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:34 smithi162 ceph-mon[83709]: pgmap v1065: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:36.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:36 smithi084 ceph-mon[91810]: pgmap v1066: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:36.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:36 smithi084 ceph-mon[89279]: pgmap v1066: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:36.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:36 smithi162 ceph-mon[83709]: pgmap v1066: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:38.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:38 smithi084 ceph-mon[91810]: pgmap v1067: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:38.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:38 smithi084 ceph-mon[89279]: pgmap v1067: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:38.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:38 smithi162 ceph-mon[83709]: pgmap v1067: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:39.608 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:38:39.639 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:38:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:38:39] "GET /metrics HTTP/1.1" 200 36325 "" "Prometheus/2.43.0" 2024-03-30T12:38:39.826 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:38:40.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:40 smithi084 ceph-mon[89279]: pgmap v1068: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:40.503 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:40 smithi084 ceph-mon[91810]: pgmap v1068: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:40.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:40 smithi162 ceph-mon[83709]: pgmap v1068: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:41.766 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:38:41.768 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:38:42.441 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1069,"stamp":"2024-03-30T12:38:40.846581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003899"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:34.124688+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:36:34.124688+0000","last_peered":"2024-03-30T12:36:34.124688+0000","last_clean":"2024-03-30T12:36:34.124688+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:36:34.124688+0000","last_undegraded":"2024-03-30T12:36:34.124688+0000","last_fullsized":"2024-03-30T12:36:34.124688+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1363,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221634+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:36:03.221634+0000","last_peered":"2024-03-30T12:36:03.221634+0000","last_clean":"2024-03-30T12:36:03.221634+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:36:03.221634+0000","last_undegraded":"2024-03-30T12:36:03.221634+0000","last_fullsized":"2024-03-30T12:36:03.221634+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221207+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:36:03.221207+0000","last_peered":"2024-03-30T12:36:03.221207+0000","last_clean":"2024-03-30T12:36:03.221207+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:36:03.221207+0000","last_undegraded":"2024-03-30T12:36:03.221207+0000","last_fullsized":"2024-03-30T12:36:03.221207+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222119+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:36:03.222119+0000","last_peered":"2024-03-30T12:36:03.222119+0000","last_clean":"2024-03-30T12:36:03.222119+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:36:03.222119+0000","last_undegraded":"2024-03-30T12:36:03.222119+0000","last_fullsized":"2024-03-30T12:36:03.222119+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016863+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:36:03.016863+0000","last_peered":"2024-03-30T12:36:03.016863+0000","last_clean":"2024-03-30T12:36:03.016863+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:36:03.016863+0000","last_undegraded":"2024-03-30T12:36:03.016863+0000","last_fullsized":"2024-03-30T12:36:03.016863+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1209,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222566+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:03.222566+0000","last_peered":"2024-03-30T12:36:03.222566+0000","last_clean":"2024-03-30T12:36:03.222566+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:03.222566+0000","last_undegraded":"2024-03-30T12:36:03.222566+0000","last_fullsized":"2024-03-30T12:36:03.222566+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017365+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:36:03.017365+0000","last_peered":"2024-03-30T12:36:03.017365+0000","last_clean":"2024-03-30T12:36:03.017365+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:36:03.017365+0000","last_undegraded":"2024-03-30T12:36:03.017365+0000","last_fullsized":"2024-03-30T12:36:03.017365+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219781+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:36:03.219781+0000","last_peered":"2024-03-30T12:36:03.219781+0000","last_clean":"2024-03-30T12:36:03.219781+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:36:03.219781+0000","last_undegraded":"2024-03-30T12:36:03.219781+0000","last_fullsized":"2024-03-30T12:36:03.219781+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018011+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:36:03.018011+0000","last_peered":"2024-03-30T12:36:03.018011+0000","last_clean":"2024-03-30T12:36:03.018011+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:36:03.018011+0000","last_undegraded":"2024-03-30T12:36:03.018011+0000","last_fullsized":"2024-03-30T12:36:03.018011+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220774+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:03.220774+0000","last_peered":"2024-03-30T12:36:03.220774+0000","last_clean":"2024-03-30T12:36:03.220774+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:03.220774+0000","last_undegraded":"2024-03-30T12:36:03.220774+0000","last_fullsized":"2024-03-30T12:36:03.220774+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220468+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:03.220468+0000","last_peered":"2024-03-30T12:36:03.220468+0000","last_clean":"2024-03-30T12:36:03.220468+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:03.220468+0000","last_undegraded":"2024-03-30T12:36:03.220468+0000","last_fullsized":"2024-03-30T12:36:03.220468+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1270,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020253+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:36:03.020253+0000","last_peered":"2024-03-30T12:36:03.020253+0000","last_clean":"2024-03-30T12:36:03.020253+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:36:03.020253+0000","last_undegraded":"2024-03-30T12:36:03.020253+0000","last_fullsized":"2024-03-30T12:36:03.020253+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221688+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:36:03.221688+0000","last_peered":"2024-03-30T12:36:03.221688+0000","last_clean":"2024-03-30T12:36:03.221688+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:36:03.221688+0000","last_undegraded":"2024-03-30T12:36:03.221688+0000","last_fullsized":"2024-03-30T12:36:03.221688+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220487+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:36:03.220487+0000","last_peered":"2024-03-30T12:36:03.220487+0000","last_clean":"2024-03-30T12:36:03.220487+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:36:03.220487+0000","last_undegraded":"2024-03-30T12:36:03.220487+0000","last_fullsized":"2024-03-30T12:36:03.220487+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:08.897219+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:36:08.897219+0000","last_peered":"2024-03-30T12:36:08.897219+0000","last_clean":"2024-03-30T12:36:08.897219+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:36:08.897219+0000","last_undegraded":"2024-03-30T12:36:08.897219+0000","last_fullsized":"2024-03-30T12:36:08.897219+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1213,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221481+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:36:03.221481+0000","last_peered":"2024-03-30T12:36:03.221481+0000","last_clean":"2024-03-30T12:36:03.221481+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:36:03.221481+0000","last_undegraded":"2024-03-30T12:36:03.221481+0000","last_fullsized":"2024-03-30T12:36:03.221481+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1224,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.223011+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:36:03.223011+0000","last_peered":"2024-03-30T12:36:03.223011+0000","last_clean":"2024-03-30T12:36:03.223011+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:36:03.223011+0000","last_undegraded":"2024-03-30T12:36:03.223011+0000","last_fullsized":"2024-03-30T12:36:03.223011+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015999+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:36:03.015999+0000","last_peered":"2024-03-30T12:36:03.015999+0000","last_clean":"2024-03-30T12:36:03.015999+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:36:03.015999+0000","last_undegraded":"2024-03-30T12:36:03.015999+0000","last_fullsized":"2024-03-30T12:36:03.015999+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017955+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:36:03.017955+0000","last_peered":"2024-03-30T12:36:03.017955+0000","last_clean":"2024-03-30T12:36:03.017955+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:36:03.017955+0000","last_undegraded":"2024-03-30T12:36:03.017955+0000","last_fullsized":"2024-03-30T12:36:03.017955+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1387,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221082+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:36:03.221082+0000","last_peered":"2024-03-30T12:36:03.221082+0000","last_clean":"2024-03-30T12:36:03.221082+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:36:03.221082+0000","last_undegraded":"2024-03-30T12:36:03.221082+0000","last_fullsized":"2024-03-30T12:36:03.221082+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1282,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220823+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:36:03.220823+0000","last_peered":"2024-03-30T12:36:03.220823+0000","last_clean":"2024-03-30T12:36:03.220823+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:36:03.220823+0000","last_undegraded":"2024-03-30T12:36:03.220823+0000","last_fullsized":"2024-03-30T12:36:03.220823+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1301,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221016+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:36:03.221016+0000","last_peered":"2024-03-30T12:36:03.221016+0000","last_clean":"2024-03-30T12:36:03.221016+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:36:03.221016+0000","last_undegraded":"2024-03-30T12:36:03.221016+0000","last_fullsized":"2024-03-30T12:36:03.221016+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220378+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:36:03.220378+0000","last_peered":"2024-03-30T12:36:03.220378+0000","last_clean":"2024-03-30T12:36:03.220378+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:36:03.220378+0000","last_undegraded":"2024-03-30T12:36:03.220378+0000","last_fullsized":"2024-03-30T12:36:03.220378+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018097+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:36:03.018097+0000","last_peered":"2024-03-30T12:36:03.018097+0000","last_clean":"2024-03-30T12:36:03.018097+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:36:03.018097+0000","last_undegraded":"2024-03-30T12:36:03.018097+0000","last_fullsized":"2024-03-30T12:36:03.018097+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1228,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222708+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:03.222708+0000","last_peered":"2024-03-30T12:36:03.222708+0000","last_clean":"2024-03-30T12:36:03.222708+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:03.222708+0000","last_undegraded":"2024-03-30T12:36:03.222708+0000","last_fullsized":"2024-03-30T12:36:03.222708+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017698+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:36:03.017698+0000","last_peered":"2024-03-30T12:36:03.017698+0000","last_clean":"2024-03-30T12:36:03.017698+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:36:03.017698+0000","last_undegraded":"2024-03-30T12:36:03.017698+0000","last_fullsized":"2024-03-30T12:36:03.017698+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222301+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:03.222301+0000","last_peered":"2024-03-30T12:36:03.222301+0000","last_clean":"2024-03-30T12:36:03.222301+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:03.222301+0000","last_undegraded":"2024-03-30T12:36:03.222301+0000","last_fullsized":"2024-03-30T12:36:03.222301+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221852+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:36:03.221852+0000","last_peered":"2024-03-30T12:36:03.221852+0000","last_clean":"2024-03-30T12:36:03.221852+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:36:03.221852+0000","last_undegraded":"2024-03-30T12:36:03.221852+0000","last_fullsized":"2024-03-30T12:36:03.221852+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018910+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:36:03.018910+0000","last_peered":"2024-03-30T12:36:03.018910+0000","last_clean":"2024-03-30T12:36:03.018910+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:36:03.018910+0000","last_undegraded":"2024-03-30T12:36:03.018910+0000","last_fullsized":"2024-03-30T12:36:03.018910+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1179,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220575+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:36:03.220575+0000","last_peered":"2024-03-30T12:36:03.220575+0000","last_clean":"2024-03-30T12:36:03.220575+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:36:03.220575+0000","last_undegraded":"2024-03-30T12:36:03.220575+0000","last_fullsized":"2024-03-30T12:36:03.220575+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1377,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221577+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:36:03.221577+0000","last_peered":"2024-03-30T12:36:03.221577+0000","last_clean":"2024-03-30T12:36:03.221577+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:36:03.221577+0000","last_undegraded":"2024-03-30T12:36:03.221577+0000","last_fullsized":"2024-03-30T12:36:03.221577+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219839+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:36:03.219839+0000","last_peered":"2024-03-30T12:36:03.219839+0000","last_clean":"2024-03-30T12:36:03.219839+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:36:03.219839+0000","last_undegraded":"2024-03-30T12:36:03.219839+0000","last_fullsized":"2024-03-30T12:36:03.219839+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1294,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219823+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:36:03.219823+0000","last_peered":"2024-03-30T12:36:03.219823+0000","last_clean":"2024-03-30T12:36:03.219823+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:36:03.219823+0000","last_undegraded":"2024-03-30T12:36:03.219823+0000","last_fullsized":"2024-03-30T12:36:03.219823+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1224,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288884+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:36:15.288884+0000","last_peered":"2024-03-30T12:36:15.288884+0000","last_clean":"2024-03-30T12:36:15.288884+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:36:15.288884+0000","last_undegraded":"2024-03-30T12:36:15.288884+0000","last_fullsized":"2024-03-30T12:36:15.288884+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222968+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:36:03.222968+0000","last_peered":"2024-03-30T12:36:03.222968+0000","last_clean":"2024-03-30T12:36:03.222968+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:36:03.222968+0000","last_undegraded":"2024-03-30T12:36:03.222968+0000","last_fullsized":"2024-03-30T12:36:03.222968+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220821+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:03.220821+0000","last_peered":"2024-03-30T12:36:03.220821+0000","last_clean":"2024-03-30T12:36:03.220821+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:03.220821+0000","last_undegraded":"2024-03-30T12:36:03.220821+0000","last_fullsized":"2024-03-30T12:36:03.220821+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1204,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288944+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:36:15.288944+0000","last_peered":"2024-03-30T12:36:15.288944+0000","last_clean":"2024-03-30T12:36:15.288944+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:36:15.288944+0000","last_undegraded":"2024-03-30T12:36:15.288944+0000","last_fullsized":"2024-03-30T12:36:15.288944+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1198,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288933+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:36:15.288933+0000","last_peered":"2024-03-30T12:36:15.288933+0000","last_clean":"2024-03-30T12:36:15.288933+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:36:15.288933+0000","last_undegraded":"2024-03-30T12:36:15.288933+0000","last_fullsized":"2024-03-30T12:36:15.288933+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015739+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:36:03.015739+0000","last_peered":"2024-03-30T12:36:03.015739+0000","last_clean":"2024-03-30T12:36:03.015739+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:36:03.015739+0000","last_undegraded":"2024-03-30T12:36:03.015739+0000","last_fullsized":"2024-03-30T12:36:03.015739+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221275+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:36:03.221275+0000","last_peered":"2024-03-30T12:36:03.221275+0000","last_clean":"2024-03-30T12:36:03.221275+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:36:03.221275+0000","last_undegraded":"2024-03-30T12:36:03.221275+0000","last_fullsized":"2024-03-30T12:36:03.221275+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020091+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:36:03.020091+0000","last_peered":"2024-03-30T12:36:03.020091+0000","last_clean":"2024-03-30T12:36:03.020091+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:36:03.020091+0000","last_undegraded":"2024-03-30T12:36:03.020091+0000","last_fullsized":"2024-03-30T12:36:03.020091+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1204,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220837+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:36:03.220837+0000","last_peered":"2024-03-30T12:36:03.220837+0000","last_clean":"2024-03-30T12:36:03.220837+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:36:03.220837+0000","last_undegraded":"2024-03-30T12:36:03.220837+0000","last_fullsized":"2024-03-30T12:36:03.220837+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017435+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:36:03.017435+0000","last_peered":"2024-03-30T12:36:03.017435+0000","last_clean":"2024-03-30T12:36:03.017435+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:36:03.017435+0000","last_undegraded":"2024-03-30T12:36:03.017435+0000","last_fullsized":"2024-03-30T12:36:03.017435+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221769+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:36:03.221769+0000","last_peered":"2024-03-30T12:36:03.221769+0000","last_clean":"2024-03-30T12:36:03.221769+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:36:03.221769+0000","last_undegraded":"2024-03-30T12:36:03.221769+0000","last_fullsized":"2024-03-30T12:36:03.221769+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220786+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:36:03.220786+0000","last_peered":"2024-03-30T12:36:03.220786+0000","last_clean":"2024-03-30T12:36:03.220786+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:36:03.220786+0000","last_undegraded":"2024-03-30T12:36:03.220786+0000","last_fullsized":"2024-03-30T12:36:03.220786+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221971+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:36:03.221971+0000","last_peered":"2024-03-30T12:36:03.221971+0000","last_clean":"2024-03-30T12:36:03.221971+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:36:03.221971+0000","last_undegraded":"2024-03-30T12:36:03.221971+0000","last_fullsized":"2024-03-30T12:36:03.221971+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017508+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:36:03.017508+0000","last_peered":"2024-03-30T12:36:03.017508+0000","last_clean":"2024-03-30T12:36:03.017508+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:36:03.017508+0000","last_undegraded":"2024-03-30T12:36:03.017508+0000","last_fullsized":"2024-03-30T12:36:03.017508+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220253+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:36:03.220253+0000","last_peered":"2024-03-30T12:36:03.220253+0000","last_clean":"2024-03-30T12:36:03.220253+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:36:03.220253+0000","last_undegraded":"2024-03-30T12:36:03.220253+0000","last_fullsized":"2024-03-30T12:36:03.220253+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220192+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:36:03.220192+0000","last_peered":"2024-03-30T12:36:03.220192+0000","last_clean":"2024-03-30T12:36:03.220192+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:36:03.220192+0000","last_undegraded":"2024-03-30T12:36:03.220192+0000","last_fullsized":"2024-03-30T12:36:03.220192+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1343,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015636+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:36:03.015636+0000","last_peered":"2024-03-30T12:36:03.015636+0000","last_clean":"2024-03-30T12:36:03.015636+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:36:03.015636+0000","last_undegraded":"2024-03-30T12:36:03.015636+0000","last_fullsized":"2024-03-30T12:36:03.015636+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016619+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:36:03.016619+0000","last_peered":"2024-03-30T12:36:03.016619+0000","last_clean":"2024-03-30T12:36:03.016619+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:36:03.016619+0000","last_undegraded":"2024-03-30T12:36:03.016619+0000","last_fullsized":"2024-03-30T12:36:03.016619+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5752,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.367799+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:36:03.367799+0000","last_peered":"2024-03-30T12:36:03.367799+0000","last_clean":"2024-03-30T12:36:03.367799+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:36:03.367799+0000","last_undegraded":"2024-03-30T12:36:03.367799+0000","last_fullsized":"2024-03-30T12:36:03.367799+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020404+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:36:03.020404+0000","last_peered":"2024-03-30T12:36:03.020404+0000","last_clean":"2024-03-30T12:36:03.020404+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:36:03.020404+0000","last_undegraded":"2024-03-30T12:36:03.020404+0000","last_fullsized":"2024-03-30T12:36:03.020404+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018051+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:36:03.018051+0000","last_peered":"2024-03-30T12:36:03.018051+0000","last_clean":"2024-03-30T12:36:03.018051+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:36:03.018051+0000","last_undegraded":"2024-03-30T12:36:03.018051+0000","last_fullsized":"2024-03-30T12:36:03.018051+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5512,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.222067+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:36:03.222067+0000","last_peered":"2024-03-30T12:36:03.222067+0000","last_clean":"2024-03-30T12:36:03.222067+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:36:03.222067+0000","last_undegraded":"2024-03-30T12:36:03.222067+0000","last_fullsized":"2024-03-30T12:36:03.222067+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220604+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:36:03.220604+0000","last_peered":"2024-03-30T12:36:03.220604+0000","last_clean":"2024-03-30T12:36:03.220604+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:36:03.220604+0000","last_undegraded":"2024-03-30T12:36:03.220604+0000","last_fullsized":"2024-03-30T12:36:03.220604+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1346,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222463+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:36:03.222463+0000","last_peered":"2024-03-30T12:36:03.222463+0000","last_clean":"2024-03-30T12:36:03.222463+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:36:03.222463+0000","last_undegraded":"2024-03-30T12:36:03.222463+0000","last_fullsized":"2024-03-30T12:36:03.222463+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222511+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:36:03.222511+0000","last_peered":"2024-03-30T12:36:03.222511+0000","last_clean":"2024-03-30T12:36:03.222511+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:36:03.222511+0000","last_undegraded":"2024-03-30T12:36:03.222511+0000","last_fullsized":"2024-03-30T12:36:03.222511+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5457,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.222052+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:36:03.222052+0000","last_peered":"2024-03-30T12:36:03.222052+0000","last_clean":"2024-03-30T12:36:03.222052+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:36:03.222052+0000","last_undegraded":"2024-03-30T12:36:03.222052+0000","last_fullsized":"2024-03-30T12:36:03.222052+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222581+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:36:03.222581+0000","last_peered":"2024-03-30T12:36:03.222581+0000","last_clean":"2024-03-30T12:36:03.222581+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:36:03.222581+0000","last_undegraded":"2024-03-30T12:36:03.222581+0000","last_fullsized":"2024-03-30T12:36:03.222581+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221692+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:36:03.221692+0000","last_peered":"2024-03-30T12:36:03.221692+0000","last_clean":"2024-03-30T12:36:03.221692+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:36:03.221692+0000","last_undegraded":"2024-03-30T12:36:03.221692+0000","last_fullsized":"2024-03-30T12:36:03.221692+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1271,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019374+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:36:03.019374+0000","last_peered":"2024-03-30T12:36:03.019374+0000","last_clean":"2024-03-30T12:36:03.019374+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:36:03.019374+0000","last_undegraded":"2024-03-30T12:36:03.019374+0000","last_fullsized":"2024-03-30T12:36:03.019374+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3803,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.367883+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:36:03.367883+0000","last_peered":"2024-03-30T12:36:03.367883+0000","last_clean":"2024-03-30T12:36:03.367883+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:36:03.367883+0000","last_undegraded":"2024-03-30T12:36:03.367883+0000","last_fullsized":"2024-03-30T12:36:03.367883+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1342,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222978+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:36:03.222978+0000","last_peered":"2024-03-30T12:36:03.222978+0000","last_clean":"2024-03-30T12:36:03.222978+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:36:03.222978+0000","last_undegraded":"2024-03-30T12:36:03.222978+0000","last_fullsized":"2024-03-30T12:36:03.222978+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222036+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:36:03.222036+0000","last_peered":"2024-03-30T12:36:03.222036+0000","last_clean":"2024-03-30T12:36:03.222036+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:36:03.222036+0000","last_undegraded":"2024-03-30T12:36:03.222036+0000","last_fullsized":"2024-03-30T12:36:03.222036+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015232+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:36:03.015232+0000","last_peered":"2024-03-30T12:36:03.015232+0000","last_clean":"2024-03-30T12:36:03.015232+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:36:03.015232+0000","last_undegraded":"2024-03-30T12:36:03.015232+0000","last_fullsized":"2024-03-30T12:36:03.015232+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4576,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:34.124620+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:36:34.124620+0000","last_peered":"2024-03-30T12:36:34.124620+0000","last_clean":"2024-03-30T12:36:34.124620+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:36:34.124620+0000","last_undegraded":"2024-03-30T12:36:34.124620+0000","last_fullsized":"2024-03-30T12:36:34.124620+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1174,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220771+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:36:03.220771+0000","last_peered":"2024-03-30T12:36:03.220771+0000","last_clean":"2024-03-30T12:36:03.220771+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:36:03.220771+0000","last_undegraded":"2024-03-30T12:36:03.220771+0000","last_fullsized":"2024-03-30T12:36:03.220771+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:17.636728+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:36:17.636728+0000","last_peered":"2024-03-30T12:36:17.636728+0000","last_clean":"2024-03-30T12:36:17.636728+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:36:17.636728+0000","last_undegraded":"2024-03-30T12:36:17.636728+0000","last_fullsized":"2024-03-30T12:36:17.636728+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1199,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222181+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:36:03.222181+0000","last_peered":"2024-03-30T12:36:03.222181+0000","last_clean":"2024-03-30T12:36:03.222181+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:36:03.222181+0000","last_undegraded":"2024-03-30T12:36:03.222181+0000","last_fullsized":"2024-03-30T12:36:03.222181+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1716,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:19.123078+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:36:19.123078+0000","last_peered":"2024-03-30T12:36:19.123078+0000","last_clean":"2024-03-30T12:36:19.123078+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:36:19.123078+0000","last_undegraded":"2024-03-30T12:36:19.123078+0000","last_fullsized":"2024-03-30T12:36:19.123078+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24713,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223744+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:36:03.223744+0000","last_peered":"2024-03-30T12:36:03.223744+0000","last_clean":"2024-03-30T12:36:03.223744+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:36:03.223744+0000","last_undegraded":"2024-03-30T12:36:03.223744+0000","last_fullsized":"2024-03-30T12:36:03.223744+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220614+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:36:03.220614+0000","last_peered":"2024-03-30T12:36:03.220614+0000","last_clean":"2024-03-30T12:36:03.220614+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:36:03.220614+0000","last_undegraded":"2024-03-30T12:36:03.220614+0000","last_fullsized":"2024-03-30T12:36:03.220614+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220696+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:36:03.220696+0000","last_peered":"2024-03-30T12:36:03.220696+0000","last_clean":"2024-03-30T12:36:03.220696+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:36:03.220696+0000","last_undegraded":"2024-03-30T12:36:03.220696+0000","last_fullsized":"2024-03-30T12:36:03.220696+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:19.123052+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:36:19.123052+0000","last_peered":"2024-03-30T12:36:19.123052+0000","last_clean":"2024-03-30T12:36:19.123052+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:36:19.123052+0000","last_undegraded":"2024-03-30T12:36:19.123052+0000","last_fullsized":"2024-03-30T12:36:19.123052+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16480,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.221717+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:36:03.221717+0000","last_peered":"2024-03-30T12:36:03.221717+0000","last_clean":"2024-03-30T12:36:03.221717+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:36:03.221717+0000","last_undegraded":"2024-03-30T12:36:03.221717+0000","last_fullsized":"2024-03-30T12:36:03.221717+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221448+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:36:03.221448+0000","last_peered":"2024-03-30T12:36:03.221448+0000","last_clean":"2024-03-30T12:36:03.221448+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:36:03.221448+0000","last_undegraded":"2024-03-30T12:36:03.221448+0000","last_fullsized":"2024-03-30T12:36:03.221448+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:34.124667+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:36:34.124667+0000","last_peered":"2024-03-30T12:36:34.124667+0000","last_clean":"2024-03-30T12:36:34.124667+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:36:34.124667+0000","last_undegraded":"2024-03-30T12:36:34.124667+0000","last_fullsized":"2024-03-30T12:36:34.124667+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222675+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:36:03.222675+0000","last_peered":"2024-03-30T12:36:03.222675+0000","last_clean":"2024-03-30T12:36:03.222675+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:36:03.222675+0000","last_undegraded":"2024-03-30T12:36:03.222675+0000","last_fullsized":"2024-03-30T12:36:03.222675+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31268,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.021096+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:36:03.021096+0000","last_peered":"2024-03-30T12:36:03.021096+0000","last_clean":"2024-03-30T12:36:03.021096+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:36:03.021096+0000","last_undegraded":"2024-03-30T12:36:03.021096+0000","last_fullsized":"2024-03-30T12:36:03.021096+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1294,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219916+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:36:03.219916+0000","last_peered":"2024-03-30T12:36:03.219916+0000","last_clean":"2024-03-30T12:36:03.219916+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:36:03.219916+0000","last_undegraded":"2024-03-30T12:36:03.219916+0000","last_fullsized":"2024-03-30T12:36:03.219916+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221733+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:36:03.221733+0000","last_peered":"2024-03-30T12:36:03.221733+0000","last_clean":"2024-03-30T12:36:03.221733+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:36:03.221733+0000","last_undegraded":"2024-03-30T12:36:03.221733+0000","last_fullsized":"2024-03-30T12:36:03.221733+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221129+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:36:03.221129+0000","last_peered":"2024-03-30T12:36:03.221129+0000","last_clean":"2024-03-30T12:36:03.221129+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:36:03.221129+0000","last_undegraded":"2024-03-30T12:36:03.221129+0000","last_fullsized":"2024-03-30T12:36:03.221129+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3764,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220021+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:36:03.220021+0000","last_peered":"2024-03-30T12:36:03.220021+0000","last_clean":"2024-03-30T12:36:03.220021+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:36:03.220021+0000","last_undegraded":"2024-03-30T12:36:03.220021+0000","last_fullsized":"2024-03-30T12:36:03.220021+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019149+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:36:03.019149+0000","last_peered":"2024-03-30T12:36:03.019149+0000","last_clean":"2024-03-30T12:36:03.019149+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:36:03.019149+0000","last_undegraded":"2024-03-30T12:36:03.019149+0000","last_fullsized":"2024-03-30T12:36:03.019149+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544094+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:36:09.544094+0000","last_peered":"2024-03-30T12:36:09.544094+0000","last_clean":"2024-03-30T12:36:09.544094+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:36:09.544094+0000","last_undegraded":"2024-03-30T12:36:09.544094+0000","last_fullsized":"2024-03-30T12:36:09.544094+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220354+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:36:03.220354+0000","last_peered":"2024-03-30T12:36:03.220354+0000","last_clean":"2024-03-30T12:36:03.220354+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:36:03.220354+0000","last_undegraded":"2024-03-30T12:36:03.220354+0000","last_fullsized":"2024-03-30T12:36:03.220354+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15593,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223541+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:36:03.223541+0000","last_peered":"2024-03-30T12:36:03.223541+0000","last_clean":"2024-03-30T12:36:03.223541+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:36:03.223541+0000","last_undegraded":"2024-03-30T12:36:03.223541+0000","last_fullsized":"2024-03-30T12:36:03.223541+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1142,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016783+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:36:03.016783+0000","last_peered":"2024-03-30T12:36:03.016783+0000","last_clean":"2024-03-30T12:36:03.016783+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:36:03.016783+0000","last_undegraded":"2024-03-30T12:36:03.016783+0000","last_fullsized":"2024-03-30T12:36:03.016783+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1257,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018978+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:36:03.018978+0000","last_peered":"2024-03-30T12:36:03.018978+0000","last_clean":"2024-03-30T12:36:03.018978+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:36:03.018978+0000","last_undegraded":"2024-03-30T12:36:03.018978+0000","last_fullsized":"2024-03-30T12:36:03.018978+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29019,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.020881+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:36:03.020881+0000","last_peered":"2024-03-30T12:36:03.020881+0000","last_clean":"2024-03-30T12:36:03.020881+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:36:03.020881+0000","last_undegraded":"2024-03-30T12:36:03.020881+0000","last_fullsized":"2024-03-30T12:36:03.020881+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222681+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:36:03.222681+0000","last_peered":"2024-03-30T12:36:03.222681+0000","last_clean":"2024-03-30T12:36:03.222681+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:36:03.222681+0000","last_undegraded":"2024-03-30T12:36:03.222681+0000","last_fullsized":"2024-03-30T12:36:03.222681+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220045+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:36:03.220045+0000","last_peered":"2024-03-30T12:36:03.220045+0000","last_clean":"2024-03-30T12:36:03.220045+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:36:03.220045+0000","last_undegraded":"2024-03-30T12:36:03.220045+0000","last_fullsized":"2024-03-30T12:36:03.220045+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5610,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:23.370279+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:36:23.370279+0000","last_peered":"2024-03-30T12:36:23.370279+0000","last_clean":"2024-03-30T12:36:23.370279+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:36:23.370279+0000","last_undegraded":"2024-03-30T12:36:23.370279+0000","last_fullsized":"2024-03-30T12:36:23.370279+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1364,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220455+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:36:03.220455+0000","last_peered":"2024-03-30T12:36:03.220455+0000","last_clean":"2024-03-30T12:36:03.220455+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:36:03.220455+0000","last_undegraded":"2024-03-30T12:36:03.220455+0000","last_fullsized":"2024-03-30T12:36:03.220455+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221588+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:03.221588+0000","last_peered":"2024-03-30T12:36:03.221588+0000","last_clean":"2024-03-30T12:36:03.221588+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:03.221588+0000","last_undegraded":"2024-03-30T12:36:03.221588+0000","last_fullsized":"2024-03-30T12:36:03.221588+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222932+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:36:03.222932+0000","last_peered":"2024-03-30T12:36:03.222932+0000","last_clean":"2024-03-30T12:36:03.222932+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:36:03.222932+0000","last_undegraded":"2024-03-30T12:36:03.222932+0000","last_fullsized":"2024-03-30T12:36:03.222932+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017355+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:36:03.017355+0000","last_peered":"2024-03-30T12:36:03.017355+0000","last_clean":"2024-03-30T12:36:03.017355+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:36:03.017355+0000","last_undegraded":"2024-03-30T12:36:03.017355+0000","last_fullsized":"2024-03-30T12:36:03.017355+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544025+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:36:09.544025+0000","last_peered":"2024-03-30T12:36:09.544025+0000","last_clean":"2024-03-30T12:36:09.544025+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:36:09.544025+0000","last_undegraded":"2024-03-30T12:36:09.544025+0000","last_fullsized":"2024-03-30T12:36:09.544025+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5253,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:23.370200+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:36:23.370200+0000","last_peered":"2024-03-30T12:36:23.370200+0000","last_clean":"2024-03-30T12:36:23.370200+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:36:23.370200+0000","last_undegraded":"2024-03-30T12:36:23.370200+0000","last_fullsized":"2024-03-30T12:36:23.370200+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:23.370243+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:36:23.370243+0000","last_peered":"2024-03-30T12:36:23.370243+0000","last_clean":"2024-03-30T12:36:23.370243+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:36:23.370243+0000","last_undegraded":"2024-03-30T12:36:23.370243+0000","last_fullsized":"2024-03-30T12:36:23.370243+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017799+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:36:03.017799+0000","last_peered":"2024-03-30T12:36:03.017799+0000","last_clean":"2024-03-30T12:36:03.017799+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:36:03.017799+0000","last_undegraded":"2024-03-30T12:36:03.017799+0000","last_fullsized":"2024-03-30T12:36:03.017799+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4810,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.367842+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:36:03.367842+0000","last_peered":"2024-03-30T12:36:03.367842+0000","last_clean":"2024-03-30T12:36:03.367842+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:36:03.367842+0000","last_undegraded":"2024-03-30T12:36:03.367842+0000","last_fullsized":"2024-03-30T12:36:03.367842+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220953+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:36:03.220953+0000","last_peered":"2024-03-30T12:36:03.220953+0000","last_clean":"2024-03-30T12:36:03.220953+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:36:03.220953+0000","last_undegraded":"2024-03-30T12:36:03.220953+0000","last_fullsized":"2024-03-30T12:36:03.220953+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222608+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:36:03.222608+0000","last_peered":"2024-03-30T12:36:03.222608+0000","last_clean":"2024-03-30T12:36:03.222608+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:36:03.222608+0000","last_undegraded":"2024-03-30T12:36:03.222608+0000","last_fullsized":"2024-03-30T12:36:03.222608+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6742,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.018791+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:36:03.018791+0000","last_peered":"2024-03-30T12:36:03.018791+0000","last_clean":"2024-03-30T12:36:03.018791+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:36:03.018791+0000","last_undegraded":"2024-03-30T12:36:03.018791+0000","last_fullsized":"2024-03-30T12:36:03.018791+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1337,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:23.370314+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:36:23.370314+0000","last_peered":"2024-03-30T12:36:23.370314+0000","last_clean":"2024-03-30T12:36:23.370314+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:36:23.370314+0000","last_undegraded":"2024-03-30T12:36:23.370314+0000","last_fullsized":"2024-03-30T12:36:23.370314+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018917+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:36:03.018917+0000","last_peered":"2024-03-30T12:36:03.018917+0000","last_clean":"2024-03-30T12:36:03.018917+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:36:03.018917+0000","last_undegraded":"2024-03-30T12:36:03.018917+0000","last_fullsized":"2024-03-30T12:36:03.018917+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220179+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:36:03.220179+0000","last_peered":"2024-03-30T12:36:03.220179+0000","last_clean":"2024-03-30T12:36:03.220179+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:36:03.220179+0000","last_undegraded":"2024-03-30T12:36:03.220179+0000","last_fullsized":"2024-03-30T12:36:03.220179+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015330+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:36:03.015330+0000","last_peered":"2024-03-30T12:36:03.015330+0000","last_clean":"2024-03-30T12:36:03.015330+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:36:03.015330+0000","last_undegraded":"2024-03-30T12:36:03.015330+0000","last_fullsized":"2024-03-30T12:36:03.015330+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221954+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:36:03.221954+0000","last_peered":"2024-03-30T12:36:03.221954+0000","last_clean":"2024-03-30T12:36:03.221954+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:36:03.221954+0000","last_undegraded":"2024-03-30T12:36:03.221954+0000","last_fullsized":"2024-03-30T12:36:03.221954+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221038+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:36:03.221038+0000","last_peered":"2024-03-30T12:36:03.221038+0000","last_clean":"2024-03-30T12:36:03.221038+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:36:03.221038+0000","last_undegraded":"2024-03-30T12:36:03.221038+0000","last_fullsized":"2024-03-30T12:36:03.221038+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220172+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:36:03.220172+0000","last_peered":"2024-03-30T12:36:03.220172+0000","last_clean":"2024-03-30T12:36:03.220172+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:36:03.220172+0000","last_undegraded":"2024-03-30T12:36:03.220172+0000","last_fullsized":"2024-03-30T12:36:03.220172+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221044+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:36:03.221044+0000","last_peered":"2024-03-30T12:36:03.221044+0000","last_clean":"2024-03-30T12:36:03.221044+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:36:03.221044+0000","last_undegraded":"2024-03-30T12:36:03.221044+0000","last_fullsized":"2024-03-30T12:36:03.221044+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1177,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544079+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:36:09.544079+0000","last_peered":"2024-03-30T12:36:09.544079+0000","last_clean":"2024-03-30T12:36:09.544079+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:36:09.544079+0000","last_undegraded":"2024-03-30T12:36:09.544079+0000","last_fullsized":"2024-03-30T12:36:09.544079+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1280,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221301+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:36:03.221301+0000","last_peered":"2024-03-30T12:36:03.221301+0000","last_clean":"2024-03-30T12:36:03.221301+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:36:03.221301+0000","last_undegraded":"2024-03-30T12:36:03.221301+0000","last_fullsized":"2024-03-30T12:36:03.221301+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221612+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:36:03.221612+0000","last_peered":"2024-03-30T12:36:03.221612+0000","last_clean":"2024-03-30T12:36:03.221612+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:36:03.221612+0000","last_undegraded":"2024-03-30T12:36:03.221612+0000","last_fullsized":"2024-03-30T12:36:03.221612+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220227+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:03.220227+0000","last_peered":"2024-03-30T12:36:03.220227+0000","last_clean":"2024-03-30T12:36:03.220227+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:03.220227+0000","last_undegraded":"2024-03-30T12:36:03.220227+0000","last_fullsized":"2024-03-30T12:36:03.220227+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221610+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:36:03.221610+0000","last_peered":"2024-03-30T12:36:03.221610+0000","last_clean":"2024-03-30T12:36:03.221610+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:36:03.221610+0000","last_undegraded":"2024-03-30T12:36:03.221610+0000","last_fullsized":"2024-03-30T12:36:03.221610+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220926+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:36:03.220926+0000","last_peered":"2024-03-30T12:36:03.220926+0000","last_clean":"2024-03-30T12:36:03.220926+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:36:03.220926+0000","last_undegraded":"2024-03-30T12:36:03.220926+0000","last_fullsized":"2024-03-30T12:36:03.220926+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:24.545379+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:36:24.545379+0000","last_peered":"2024-03-30T12:36:24.545379+0000","last_clean":"2024-03-30T12:36:24.545379+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:36:24.545379+0000","last_undegraded":"2024-03-30T12:36:24.545379+0000","last_fullsized":"2024-03-30T12:36:24.545379+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438053,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648109,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175119,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254357,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063176,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951233,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839290,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923573,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:38:42.447 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:42.447 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:42.447 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:42.447 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:42.447 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:42.447 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:42.447 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:42.447 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:42.447 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:42.447 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:42.447 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:42.447 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:42.447 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:42.447 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:38:42.703 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:42 smithi084 ceph-mon[89279]: pgmap v1069: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:42.703 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:42 smithi084 ceph-mon[89279]: from='client.44519 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:38:42.704 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:42 smithi084 ceph-mon[91810]: pgmap v1069: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:42.704 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:42 smithi084 ceph-mon[91810]: from='client.44519 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:38:42.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:42 smithi162 ceph-mon[83709]: pgmap v1069: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:42.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:42 smithi162 ceph-mon[83709]: from='client.44519 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:38:44.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:44 smithi084 ceph-mon[89279]: pgmap v1070: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:44.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:44 smithi084 ceph-mon[91810]: pgmap v1070: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:44.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:44 smithi162 ceph-mon[83709]: pgmap v1070: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:45.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:38:45.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:38:45.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:38:46.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:46 smithi084 ceph-mon[89279]: pgmap v1071: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:46.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:46 smithi084 ceph-mon[91810]: pgmap v1071: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:46.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:46 smithi162 ceph-mon[83709]: pgmap v1071: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:48.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:48 smithi084 ceph-mon[91810]: pgmap v1072: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:48.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:48 smithi084 ceph-mon[89279]: pgmap v1072: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:48.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:48 smithi162 ceph-mon[83709]: pgmap v1072: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:49.654 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:38:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:38:49] "GET /metrics HTTP/1.1" 200 36328 "" "Prometheus/2.43.0" 2024-03-30T12:38:50.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:50 smithi084 ceph-mon[91810]: pgmap v1073: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:50.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:50 smithi084 ceph-mon[89279]: pgmap v1073: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:50.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:50 smithi162 ceph-mon[83709]: pgmap v1073: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:52.448 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:38:52.668 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:38:52.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:52 smithi084 ceph-mon[91810]: pgmap v1074: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:52.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:52 smithi084 ceph-mon[89279]: pgmap v1074: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:52.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:52 smithi162 ceph-mon[83709]: pgmap v1074: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:54.540 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:38:54.542 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:38:54.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:54 smithi084 ceph-mon[89279]: pgmap v1075: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:54.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:54 smithi084 ceph-mon[91810]: pgmap v1075: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:54.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:54 smithi162 ceph-mon[83709]: pgmap v1075: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:55.187 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1075,"stamp":"2024-03-30T12:38:52.850746+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004165"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:34.124688+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:36:34.124688+0000","last_peered":"2024-03-30T12:36:34.124688+0000","last_clean":"2024-03-30T12:36:34.124688+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:36:34.124688+0000","last_undegraded":"2024-03-30T12:36:34.124688+0000","last_fullsized":"2024-03-30T12:36:34.124688+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1363,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221634+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:36:03.221634+0000","last_peered":"2024-03-30T12:36:03.221634+0000","last_clean":"2024-03-30T12:36:03.221634+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:36:03.221634+0000","last_undegraded":"2024-03-30T12:36:03.221634+0000","last_fullsized":"2024-03-30T12:36:03.221634+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862523+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:36:40.862523+0000","last_peered":"2024-03-30T12:36:40.862523+0000","last_clean":"2024-03-30T12:36:40.862523+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:36:40.862523+0000","last_undegraded":"2024-03-30T12:36:40.862523+0000","last_fullsized":"2024-03-30T12:36:40.862523+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222119+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:36:03.222119+0000","last_peered":"2024-03-30T12:36:03.222119+0000","last_clean":"2024-03-30T12:36:03.222119+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:36:03.222119+0000","last_undegraded":"2024-03-30T12:36:03.222119+0000","last_fullsized":"2024-03-30T12:36:03.222119+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016863+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:36:03.016863+0000","last_peered":"2024-03-30T12:36:03.016863+0000","last_clean":"2024-03-30T12:36:03.016863+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:36:03.016863+0000","last_undegraded":"2024-03-30T12:36:03.016863+0000","last_fullsized":"2024-03-30T12:36:03.016863+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1209,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222566+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:03.222566+0000","last_peered":"2024-03-30T12:36:03.222566+0000","last_clean":"2024-03-30T12:36:03.222566+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:03.222566+0000","last_undegraded":"2024-03-30T12:36:03.222566+0000","last_fullsized":"2024-03-30T12:36:03.222566+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017365+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:36:03.017365+0000","last_peered":"2024-03-30T12:36:03.017365+0000","last_clean":"2024-03-30T12:36:03.017365+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:36:03.017365+0000","last_undegraded":"2024-03-30T12:36:03.017365+0000","last_fullsized":"2024-03-30T12:36:03.017365+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219781+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:36:03.219781+0000","last_peered":"2024-03-30T12:36:03.219781+0000","last_clean":"2024-03-30T12:36:03.219781+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:36:03.219781+0000","last_undegraded":"2024-03-30T12:36:03.219781+0000","last_fullsized":"2024-03-30T12:36:03.219781+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018011+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:36:03.018011+0000","last_peered":"2024-03-30T12:36:03.018011+0000","last_clean":"2024-03-30T12:36:03.018011+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:36:03.018011+0000","last_undegraded":"2024-03-30T12:36:03.018011+0000","last_fullsized":"2024-03-30T12:36:03.018011+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220774+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:03.220774+0000","last_peered":"2024-03-30T12:36:03.220774+0000","last_clean":"2024-03-30T12:36:03.220774+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:03.220774+0000","last_undegraded":"2024-03-30T12:36:03.220774+0000","last_fullsized":"2024-03-30T12:36:03.220774+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220468+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:03.220468+0000","last_peered":"2024-03-30T12:36:03.220468+0000","last_clean":"2024-03-30T12:36:03.220468+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:03.220468+0000","last_undegraded":"2024-03-30T12:36:03.220468+0000","last_fullsized":"2024-03-30T12:36:03.220468+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1270,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020253+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:36:03.020253+0000","last_peered":"2024-03-30T12:36:03.020253+0000","last_clean":"2024-03-30T12:36:03.020253+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:36:03.020253+0000","last_undegraded":"2024-03-30T12:36:03.020253+0000","last_fullsized":"2024-03-30T12:36:03.020253+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221688+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:36:03.221688+0000","last_peered":"2024-03-30T12:36:03.221688+0000","last_clean":"2024-03-30T12:36:03.221688+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:36:03.221688+0000","last_undegraded":"2024-03-30T12:36:03.221688+0000","last_fullsized":"2024-03-30T12:36:03.221688+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220487+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:36:03.220487+0000","last_peered":"2024-03-30T12:36:03.220487+0000","last_clean":"2024-03-30T12:36:03.220487+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:36:03.220487+0000","last_undegraded":"2024-03-30T12:36:03.220487+0000","last_fullsized":"2024-03-30T12:36:03.220487+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:08.897219+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:36:08.897219+0000","last_peered":"2024-03-30T12:36:08.897219+0000","last_clean":"2024-03-30T12:36:08.897219+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:36:08.897219+0000","last_undegraded":"2024-03-30T12:36:08.897219+0000","last_fullsized":"2024-03-30T12:36:08.897219+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1213,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221481+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:36:03.221481+0000","last_peered":"2024-03-30T12:36:03.221481+0000","last_clean":"2024-03-30T12:36:03.221481+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:36:03.221481+0000","last_undegraded":"2024-03-30T12:36:03.221481+0000","last_fullsized":"2024-03-30T12:36:03.221481+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1224,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.223011+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:36:03.223011+0000","last_peered":"2024-03-30T12:36:03.223011+0000","last_clean":"2024-03-30T12:36:03.223011+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:36:03.223011+0000","last_undegraded":"2024-03-30T12:36:03.223011+0000","last_fullsized":"2024-03-30T12:36:03.223011+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015999+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:36:03.015999+0000","last_peered":"2024-03-30T12:36:03.015999+0000","last_clean":"2024-03-30T12:36:03.015999+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:36:03.015999+0000","last_undegraded":"2024-03-30T12:36:03.015999+0000","last_fullsized":"2024-03-30T12:36:03.015999+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017955+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:36:03.017955+0000","last_peered":"2024-03-30T12:36:03.017955+0000","last_clean":"2024-03-30T12:36:03.017955+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:36:03.017955+0000","last_undegraded":"2024-03-30T12:36:03.017955+0000","last_fullsized":"2024-03-30T12:36:03.017955+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1388,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862565+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:36:40.862565+0000","last_peered":"2024-03-30T12:36:40.862565+0000","last_clean":"2024-03-30T12:36:40.862565+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:36:40.862565+0000","last_undegraded":"2024-03-30T12:36:40.862565+0000","last_fullsized":"2024-03-30T12:36:40.862565+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1282,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220823+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:36:03.220823+0000","last_peered":"2024-03-30T12:36:03.220823+0000","last_clean":"2024-03-30T12:36:03.220823+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:36:03.220823+0000","last_undegraded":"2024-03-30T12:36:03.220823+0000","last_fullsized":"2024-03-30T12:36:03.220823+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1301,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221016+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:36:03.221016+0000","last_peered":"2024-03-30T12:36:03.221016+0000","last_clean":"2024-03-30T12:36:03.221016+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:36:03.221016+0000","last_undegraded":"2024-03-30T12:36:03.221016+0000","last_fullsized":"2024-03-30T12:36:03.221016+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862552+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:36:40.862552+0000","last_peered":"2024-03-30T12:36:40.862552+0000","last_clean":"2024-03-30T12:36:40.862552+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:36:40.862552+0000","last_undegraded":"2024-03-30T12:36:40.862552+0000","last_fullsized":"2024-03-30T12:36:40.862552+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018097+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:36:03.018097+0000","last_peered":"2024-03-30T12:36:03.018097+0000","last_clean":"2024-03-30T12:36:03.018097+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:36:03.018097+0000","last_undegraded":"2024-03-30T12:36:03.018097+0000","last_fullsized":"2024-03-30T12:36:03.018097+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1228,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222708+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:03.222708+0000","last_peered":"2024-03-30T12:36:03.222708+0000","last_clean":"2024-03-30T12:36:03.222708+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:03.222708+0000","last_undegraded":"2024-03-30T12:36:03.222708+0000","last_fullsized":"2024-03-30T12:36:03.222708+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017698+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:36:03.017698+0000","last_peered":"2024-03-30T12:36:03.017698+0000","last_clean":"2024-03-30T12:36:03.017698+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:36:03.017698+0000","last_undegraded":"2024-03-30T12:36:03.017698+0000","last_fullsized":"2024-03-30T12:36:03.017698+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222301+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:03.222301+0000","last_peered":"2024-03-30T12:36:03.222301+0000","last_clean":"2024-03-30T12:36:03.222301+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:03.222301+0000","last_undegraded":"2024-03-30T12:36:03.222301+0000","last_fullsized":"2024-03-30T12:36:03.222301+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221852+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:36:03.221852+0000","last_peered":"2024-03-30T12:36:03.221852+0000","last_clean":"2024-03-30T12:36:03.221852+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:36:03.221852+0000","last_undegraded":"2024-03-30T12:36:03.221852+0000","last_fullsized":"2024-03-30T12:36:03.221852+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018910+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:36:03.018910+0000","last_peered":"2024-03-30T12:36:03.018910+0000","last_clean":"2024-03-30T12:36:03.018910+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:36:03.018910+0000","last_undegraded":"2024-03-30T12:36:03.018910+0000","last_fullsized":"2024-03-30T12:36:03.018910+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1179,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220575+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:36:03.220575+0000","last_peered":"2024-03-30T12:36:03.220575+0000","last_clean":"2024-03-30T12:36:03.220575+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:36:03.220575+0000","last_undegraded":"2024-03-30T12:36:03.220575+0000","last_fullsized":"2024-03-30T12:36:03.220575+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.860010+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:36:15.860010+0000","last_peered":"2024-03-30T12:36:15.860010+0000","last_clean":"2024-03-30T12:36:15.860010+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:36:15.860010+0000","last_undegraded":"2024-03-30T12:36:15.860010+0000","last_fullsized":"2024-03-30T12:36:15.860010+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219839+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:36:03.219839+0000","last_peered":"2024-03-30T12:36:03.219839+0000","last_clean":"2024-03-30T12:36:03.219839+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:36:03.219839+0000","last_undegraded":"2024-03-30T12:36:03.219839+0000","last_fullsized":"2024-03-30T12:36:03.219839+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1294,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219823+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:36:03.219823+0000","last_peered":"2024-03-30T12:36:03.219823+0000","last_clean":"2024-03-30T12:36:03.219823+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:36:03.219823+0000","last_undegraded":"2024-03-30T12:36:03.219823+0000","last_fullsized":"2024-03-30T12:36:03.219823+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1224,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288884+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:36:15.288884+0000","last_peered":"2024-03-30T12:36:15.288884+0000","last_clean":"2024-03-30T12:36:15.288884+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:36:15.288884+0000","last_undegraded":"2024-03-30T12:36:15.288884+0000","last_fullsized":"2024-03-30T12:36:15.288884+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222968+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:36:03.222968+0000","last_peered":"2024-03-30T12:36:03.222968+0000","last_clean":"2024-03-30T12:36:03.222968+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:36:03.222968+0000","last_undegraded":"2024-03-30T12:36:03.222968+0000","last_fullsized":"2024-03-30T12:36:03.222968+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220821+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:03.220821+0000","last_peered":"2024-03-30T12:36:03.220821+0000","last_clean":"2024-03-30T12:36:03.220821+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:03.220821+0000","last_undegraded":"2024-03-30T12:36:03.220821+0000","last_fullsized":"2024-03-30T12:36:03.220821+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1204,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288944+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:36:15.288944+0000","last_peered":"2024-03-30T12:36:15.288944+0000","last_clean":"2024-03-30T12:36:15.288944+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:36:15.288944+0000","last_undegraded":"2024-03-30T12:36:15.288944+0000","last_fullsized":"2024-03-30T12:36:15.288944+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1198,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288933+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:36:15.288933+0000","last_peered":"2024-03-30T12:36:15.288933+0000","last_clean":"2024-03-30T12:36:15.288933+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:36:15.288933+0000","last_undegraded":"2024-03-30T12:36:15.288933+0000","last_fullsized":"2024-03-30T12:36:15.288933+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015739+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:36:03.015739+0000","last_peered":"2024-03-30T12:36:03.015739+0000","last_clean":"2024-03-30T12:36:03.015739+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:36:03.015739+0000","last_undegraded":"2024-03-30T12:36:03.015739+0000","last_fullsized":"2024-03-30T12:36:03.015739+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221275+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:36:03.221275+0000","last_peered":"2024-03-30T12:36:03.221275+0000","last_clean":"2024-03-30T12:36:03.221275+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:36:03.221275+0000","last_undegraded":"2024-03-30T12:36:03.221275+0000","last_fullsized":"2024-03-30T12:36:03.221275+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020091+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:36:03.020091+0000","last_peered":"2024-03-30T12:36:03.020091+0000","last_clean":"2024-03-30T12:36:03.020091+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:36:03.020091+0000","last_undegraded":"2024-03-30T12:36:03.020091+0000","last_fullsized":"2024-03-30T12:36:03.020091+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1204,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220837+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:36:03.220837+0000","last_peered":"2024-03-30T12:36:03.220837+0000","last_clean":"2024-03-30T12:36:03.220837+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:36:03.220837+0000","last_undegraded":"2024-03-30T12:36:03.220837+0000","last_fullsized":"2024-03-30T12:36:03.220837+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017435+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:36:03.017435+0000","last_peered":"2024-03-30T12:36:03.017435+0000","last_clean":"2024-03-30T12:36:03.017435+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:36:03.017435+0000","last_undegraded":"2024-03-30T12:36:03.017435+0000","last_fullsized":"2024-03-30T12:36:03.017435+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221769+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:36:03.221769+0000","last_peered":"2024-03-30T12:36:03.221769+0000","last_clean":"2024-03-30T12:36:03.221769+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:36:03.221769+0000","last_undegraded":"2024-03-30T12:36:03.221769+0000","last_fullsized":"2024-03-30T12:36:03.221769+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220786+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:36:03.220786+0000","last_peered":"2024-03-30T12:36:03.220786+0000","last_clean":"2024-03-30T12:36:03.220786+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:36:03.220786+0000","last_undegraded":"2024-03-30T12:36:03.220786+0000","last_fullsized":"2024-03-30T12:36:03.220786+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221971+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:36:03.221971+0000","last_peered":"2024-03-30T12:36:03.221971+0000","last_clean":"2024-03-30T12:36:03.221971+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:36:03.221971+0000","last_undegraded":"2024-03-30T12:36:03.221971+0000","last_fullsized":"2024-03-30T12:36:03.221971+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017508+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:36:03.017508+0000","last_peered":"2024-03-30T12:36:03.017508+0000","last_clean":"2024-03-30T12:36:03.017508+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:36:03.017508+0000","last_undegraded":"2024-03-30T12:36:03.017508+0000","last_fullsized":"2024-03-30T12:36:03.017508+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220253+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:36:03.220253+0000","last_peered":"2024-03-30T12:36:03.220253+0000","last_clean":"2024-03-30T12:36:03.220253+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:36:03.220253+0000","last_undegraded":"2024-03-30T12:36:03.220253+0000","last_fullsized":"2024-03-30T12:36:03.220253+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220192+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:36:03.220192+0000","last_peered":"2024-03-30T12:36:03.220192+0000","last_clean":"2024-03-30T12:36:03.220192+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:36:03.220192+0000","last_undegraded":"2024-03-30T12:36:03.220192+0000","last_fullsized":"2024-03-30T12:36:03.220192+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1343,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015636+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:36:03.015636+0000","last_peered":"2024-03-30T12:36:03.015636+0000","last_clean":"2024-03-30T12:36:03.015636+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:36:03.015636+0000","last_undegraded":"2024-03-30T12:36:03.015636+0000","last_fullsized":"2024-03-30T12:36:03.015636+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016619+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:36:03.016619+0000","last_peered":"2024-03-30T12:36:03.016619+0000","last_clean":"2024-03-30T12:36:03.016619+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:36:03.016619+0000","last_undegraded":"2024-03-30T12:36:03.016619+0000","last_fullsized":"2024-03-30T12:36:03.016619+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5752,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.367799+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:36:03.367799+0000","last_peered":"2024-03-30T12:36:03.367799+0000","last_clean":"2024-03-30T12:36:03.367799+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:36:03.367799+0000","last_undegraded":"2024-03-30T12:36:03.367799+0000","last_fullsized":"2024-03-30T12:36:03.367799+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020404+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:36:03.020404+0000","last_peered":"2024-03-30T12:36:03.020404+0000","last_clean":"2024-03-30T12:36:03.020404+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:36:03.020404+0000","last_undegraded":"2024-03-30T12:36:03.020404+0000","last_fullsized":"2024-03-30T12:36:03.020404+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018051+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:36:03.018051+0000","last_peered":"2024-03-30T12:36:03.018051+0000","last_clean":"2024-03-30T12:36:03.018051+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:36:03.018051+0000","last_undegraded":"2024-03-30T12:36:03.018051+0000","last_fullsized":"2024-03-30T12:36:03.018051+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5513,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:40.862481+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:36:40.862481+0000","last_peered":"2024-03-30T12:36:40.862481+0000","last_clean":"2024-03-30T12:36:40.862481+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:36:40.862481+0000","last_undegraded":"2024-03-30T12:36:40.862481+0000","last_fullsized":"2024-03-30T12:36:40.862481+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220604+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:36:03.220604+0000","last_peered":"2024-03-30T12:36:03.220604+0000","last_clean":"2024-03-30T12:36:03.220604+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:36:03.220604+0000","last_undegraded":"2024-03-30T12:36:03.220604+0000","last_fullsized":"2024-03-30T12:36:03.220604+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1346,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222463+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:36:03.222463+0000","last_peered":"2024-03-30T12:36:03.222463+0000","last_clean":"2024-03-30T12:36:03.222463+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:36:03.222463+0000","last_undegraded":"2024-03-30T12:36:03.222463+0000","last_fullsized":"2024-03-30T12:36:03.222463+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222511+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:36:03.222511+0000","last_peered":"2024-03-30T12:36:03.222511+0000","last_clean":"2024-03-30T12:36:03.222511+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:36:03.222511+0000","last_undegraded":"2024-03-30T12:36:03.222511+0000","last_fullsized":"2024-03-30T12:36:03.222511+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5458,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:40.862535+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:36:40.862535+0000","last_peered":"2024-03-30T12:36:40.862535+0000","last_clean":"2024-03-30T12:36:40.862535+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:36:40.862535+0000","last_undegraded":"2024-03-30T12:36:40.862535+0000","last_fullsized":"2024-03-30T12:36:40.862535+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222581+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:36:03.222581+0000","last_peered":"2024-03-30T12:36:03.222581+0000","last_clean":"2024-03-30T12:36:03.222581+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:36:03.222581+0000","last_undegraded":"2024-03-30T12:36:03.222581+0000","last_fullsized":"2024-03-30T12:36:03.222581+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221692+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:36:03.221692+0000","last_peered":"2024-03-30T12:36:03.221692+0000","last_clean":"2024-03-30T12:36:03.221692+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:36:03.221692+0000","last_undegraded":"2024-03-30T12:36:03.221692+0000","last_fullsized":"2024-03-30T12:36:03.221692+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1271,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019374+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:36:03.019374+0000","last_peered":"2024-03-30T12:36:03.019374+0000","last_clean":"2024-03-30T12:36:03.019374+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:36:03.019374+0000","last_undegraded":"2024-03-30T12:36:03.019374+0000","last_fullsized":"2024-03-30T12:36:03.019374+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3803,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.367883+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:36:03.367883+0000","last_peered":"2024-03-30T12:36:03.367883+0000","last_clean":"2024-03-30T12:36:03.367883+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:36:03.367883+0000","last_undegraded":"2024-03-30T12:36:03.367883+0000","last_fullsized":"2024-03-30T12:36:03.367883+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1342,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222978+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:36:03.222978+0000","last_peered":"2024-03-30T12:36:03.222978+0000","last_clean":"2024-03-30T12:36:03.222978+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:36:03.222978+0000","last_undegraded":"2024-03-30T12:36:03.222978+0000","last_fullsized":"2024-03-30T12:36:03.222978+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:48.901383+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:36:48.901383+0000","last_peered":"2024-03-30T12:36:48.901383+0000","last_clean":"2024-03-30T12:36:48.901383+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:36:48.901383+0000","last_undegraded":"2024-03-30T12:36:48.901383+0000","last_fullsized":"2024-03-30T12:36:48.901383+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015232+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:36:03.015232+0000","last_peered":"2024-03-30T12:36:03.015232+0000","last_clean":"2024-03-30T12:36:03.015232+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:36:03.015232+0000","last_undegraded":"2024-03-30T12:36:03.015232+0000","last_fullsized":"2024-03-30T12:36:03.015232+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4576,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:34.124620+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:36:34.124620+0000","last_peered":"2024-03-30T12:36:34.124620+0000","last_clean":"2024-03-30T12:36:34.124620+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:36:34.124620+0000","last_undegraded":"2024-03-30T12:36:34.124620+0000","last_fullsized":"2024-03-30T12:36:34.124620+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1174,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220771+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:36:03.220771+0000","last_peered":"2024-03-30T12:36:03.220771+0000","last_clean":"2024-03-30T12:36:03.220771+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:36:03.220771+0000","last_undegraded":"2024-03-30T12:36:03.220771+0000","last_fullsized":"2024-03-30T12:36:03.220771+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:17.636728+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:36:17.636728+0000","last_peered":"2024-03-30T12:36:17.636728+0000","last_clean":"2024-03-30T12:36:17.636728+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:36:17.636728+0000","last_undegraded":"2024-03-30T12:36:17.636728+0000","last_fullsized":"2024-03-30T12:36:17.636728+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1199,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222181+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:36:03.222181+0000","last_peered":"2024-03-30T12:36:03.222181+0000","last_clean":"2024-03-30T12:36:03.222181+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:36:03.222181+0000","last_undegraded":"2024-03-30T12:36:03.222181+0000","last_fullsized":"2024-03-30T12:36:03.222181+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1716,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:19.123078+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:36:19.123078+0000","last_peered":"2024-03-30T12:36:19.123078+0000","last_clean":"2024-03-30T12:36:19.123078+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:36:19.123078+0000","last_undegraded":"2024-03-30T12:36:19.123078+0000","last_fullsized":"2024-03-30T12:36:19.123078+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24713,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223744+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:36:03.223744+0000","last_peered":"2024-03-30T12:36:03.223744+0000","last_clean":"2024-03-30T12:36:03.223744+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:36:03.223744+0000","last_undegraded":"2024-03-30T12:36:03.223744+0000","last_fullsized":"2024-03-30T12:36:03.223744+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220614+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:36:03.220614+0000","last_peered":"2024-03-30T12:36:03.220614+0000","last_clean":"2024-03-30T12:36:03.220614+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:36:03.220614+0000","last_undegraded":"2024-03-30T12:36:03.220614+0000","last_fullsized":"2024-03-30T12:36:03.220614+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862413+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:36:40.862413+0000","last_peered":"2024-03-30T12:36:40.862413+0000","last_clean":"2024-03-30T12:36:40.862413+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:36:40.862413+0000","last_undegraded":"2024-03-30T12:36:40.862413+0000","last_fullsized":"2024-03-30T12:36:40.862413+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:19.123052+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:36:19.123052+0000","last_peered":"2024-03-30T12:36:19.123052+0000","last_clean":"2024-03-30T12:36:19.123052+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:36:19.123052+0000","last_undegraded":"2024-03-30T12:36:19.123052+0000","last_fullsized":"2024-03-30T12:36:19.123052+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16480,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.221717+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:36:03.221717+0000","last_peered":"2024-03-30T12:36:03.221717+0000","last_clean":"2024-03-30T12:36:03.221717+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:36:03.221717+0000","last_undegraded":"2024-03-30T12:36:03.221717+0000","last_fullsized":"2024-03-30T12:36:03.221717+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862510+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:36:40.862510+0000","last_peered":"2024-03-30T12:36:40.862510+0000","last_clean":"2024-03-30T12:36:40.862510+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:36:40.862510+0000","last_undegraded":"2024-03-30T12:36:40.862510+0000","last_fullsized":"2024-03-30T12:36:40.862510+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:34.124667+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:36:34.124667+0000","last_peered":"2024-03-30T12:36:34.124667+0000","last_clean":"2024-03-30T12:36:34.124667+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:36:34.124667+0000","last_undegraded":"2024-03-30T12:36:34.124667+0000","last_fullsized":"2024-03-30T12:36:34.124667+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222675+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:36:03.222675+0000","last_peered":"2024-03-30T12:36:03.222675+0000","last_clean":"2024-03-30T12:36:03.222675+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:36:03.222675+0000","last_undegraded":"2024-03-30T12:36:03.222675+0000","last_fullsized":"2024-03-30T12:36:03.222675+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31268,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.021096+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:36:03.021096+0000","last_peered":"2024-03-30T12:36:03.021096+0000","last_clean":"2024-03-30T12:36:03.021096+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:36:03.021096+0000","last_undegraded":"2024-03-30T12:36:03.021096+0000","last_fullsized":"2024-03-30T12:36:03.021096+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1294,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219916+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:36:03.219916+0000","last_peered":"2024-03-30T12:36:03.219916+0000","last_clean":"2024-03-30T12:36:03.219916+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:36:03.219916+0000","last_undegraded":"2024-03-30T12:36:03.219916+0000","last_fullsized":"2024-03-30T12:36:03.219916+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221733+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:36:03.221733+0000","last_peered":"2024-03-30T12:36:03.221733+0000","last_clean":"2024-03-30T12:36:03.221733+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:36:03.221733+0000","last_undegraded":"2024-03-30T12:36:03.221733+0000","last_fullsized":"2024-03-30T12:36:03.221733+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638999+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:36:37.638999+0000","last_peered":"2024-03-30T12:36:37.638999+0000","last_clean":"2024-03-30T12:36:37.638999+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:36:37.638999+0000","last_undegraded":"2024-03-30T12:36:37.638999+0000","last_fullsized":"2024-03-30T12:36:37.638999+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3764,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220021+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:36:03.220021+0000","last_peered":"2024-03-30T12:36:03.220021+0000","last_clean":"2024-03-30T12:36:03.220021+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:36:03.220021+0000","last_undegraded":"2024-03-30T12:36:03.220021+0000","last_fullsized":"2024-03-30T12:36:03.220021+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.019149+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:36:03.019149+0000","last_peered":"2024-03-30T12:36:03.019149+0000","last_clean":"2024-03-30T12:36:03.019149+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:36:03.019149+0000","last_undegraded":"2024-03-30T12:36:03.019149+0000","last_fullsized":"2024-03-30T12:36:03.019149+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544094+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:36:09.544094+0000","last_peered":"2024-03-30T12:36:09.544094+0000","last_clean":"2024-03-30T12:36:09.544094+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:36:09.544094+0000","last_undegraded":"2024-03-30T12:36:09.544094+0000","last_fullsized":"2024-03-30T12:36:09.544094+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220354+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:36:03.220354+0000","last_peered":"2024-03-30T12:36:03.220354+0000","last_clean":"2024-03-30T12:36:03.220354+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:36:03.220354+0000","last_undegraded":"2024-03-30T12:36:03.220354+0000","last_fullsized":"2024-03-30T12:36:03.220354+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15593,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223541+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:36:03.223541+0000","last_peered":"2024-03-30T12:36:03.223541+0000","last_clean":"2024-03-30T12:36:03.223541+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:36:03.223541+0000","last_undegraded":"2024-03-30T12:36:03.223541+0000","last_fullsized":"2024-03-30T12:36:03.223541+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1142,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016783+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:36:03.016783+0000","last_peered":"2024-03-30T12:36:03.016783+0000","last_clean":"2024-03-30T12:36:03.016783+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:36:03.016783+0000","last_undegraded":"2024-03-30T12:36:03.016783+0000","last_fullsized":"2024-03-30T12:36:03.016783+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1257,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018978+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:36:03.018978+0000","last_peered":"2024-03-30T12:36:03.018978+0000","last_clean":"2024-03-30T12:36:03.018978+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:36:03.018978+0000","last_undegraded":"2024-03-30T12:36:03.018978+0000","last_fullsized":"2024-03-30T12:36:03.018978+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29019,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.020881+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:36:03.020881+0000","last_peered":"2024-03-30T12:36:03.020881+0000","last_clean":"2024-03-30T12:36:03.020881+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:36:03.020881+0000","last_undegraded":"2024-03-30T12:36:03.020881+0000","last_fullsized":"2024-03-30T12:36:03.020881+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222681+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:36:03.222681+0000","last_peered":"2024-03-30T12:36:03.222681+0000","last_clean":"2024-03-30T12:36:03.222681+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:36:03.222681+0000","last_undegraded":"2024-03-30T12:36:03.222681+0000","last_fullsized":"2024-03-30T12:36:03.222681+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638944+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:36:37.638944+0000","last_peered":"2024-03-30T12:36:37.638944+0000","last_clean":"2024-03-30T12:36:37.638944+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:36:37.638944+0000","last_undegraded":"2024-03-30T12:36:37.638944+0000","last_fullsized":"2024-03-30T12:36:37.638944+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5610,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:23.370279+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:36:23.370279+0000","last_peered":"2024-03-30T12:36:23.370279+0000","last_clean":"2024-03-30T12:36:23.370279+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:36:23.370279+0000","last_undegraded":"2024-03-30T12:36:23.370279+0000","last_fullsized":"2024-03-30T12:36:23.370279+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1364,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220455+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:36:03.220455+0000","last_peered":"2024-03-30T12:36:03.220455+0000","last_clean":"2024-03-30T12:36:03.220455+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:36:03.220455+0000","last_undegraded":"2024-03-30T12:36:03.220455+0000","last_fullsized":"2024-03-30T12:36:03.220455+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221588+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:03.221588+0000","last_peered":"2024-03-30T12:36:03.221588+0000","last_clean":"2024-03-30T12:36:03.221588+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:03.221588+0000","last_undegraded":"2024-03-30T12:36:03.221588+0000","last_fullsized":"2024-03-30T12:36:03.221588+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222932+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:36:03.222932+0000","last_peered":"2024-03-30T12:36:03.222932+0000","last_clean":"2024-03-30T12:36:03.222932+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:36:03.222932+0000","last_undegraded":"2024-03-30T12:36:03.222932+0000","last_fullsized":"2024-03-30T12:36:03.222932+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017355+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:36:03.017355+0000","last_peered":"2024-03-30T12:36:03.017355+0000","last_clean":"2024-03-30T12:36:03.017355+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:36:03.017355+0000","last_undegraded":"2024-03-30T12:36:03.017355+0000","last_fullsized":"2024-03-30T12:36:03.017355+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544025+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:36:09.544025+0000","last_peered":"2024-03-30T12:36:09.544025+0000","last_clean":"2024-03-30T12:36:09.544025+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:36:09.544025+0000","last_undegraded":"2024-03-30T12:36:09.544025+0000","last_fullsized":"2024-03-30T12:36:09.544025+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5253,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:23.370200+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:36:23.370200+0000","last_peered":"2024-03-30T12:36:23.370200+0000","last_clean":"2024-03-30T12:36:23.370200+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:36:23.370200+0000","last_undegraded":"2024-03-30T12:36:23.370200+0000","last_fullsized":"2024-03-30T12:36:23.370200+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:23.370243+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:36:23.370243+0000","last_peered":"2024-03-30T12:36:23.370243+0000","last_clean":"2024-03-30T12:36:23.370243+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:36:23.370243+0000","last_undegraded":"2024-03-30T12:36:23.370243+0000","last_fullsized":"2024-03-30T12:36:23.370243+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017799+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:36:03.017799+0000","last_peered":"2024-03-30T12:36:03.017799+0000","last_clean":"2024-03-30T12:36:03.017799+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:36:03.017799+0000","last_undegraded":"2024-03-30T12:36:03.017799+0000","last_fullsized":"2024-03-30T12:36:03.017799+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4810,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.367842+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:36:03.367842+0000","last_peered":"2024-03-30T12:36:03.367842+0000","last_clean":"2024-03-30T12:36:03.367842+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:36:03.367842+0000","last_undegraded":"2024-03-30T12:36:03.367842+0000","last_fullsized":"2024-03-30T12:36:03.367842+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220953+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:36:03.220953+0000","last_peered":"2024-03-30T12:36:03.220953+0000","last_clean":"2024-03-30T12:36:03.220953+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:36:03.220953+0000","last_undegraded":"2024-03-30T12:36:03.220953+0000","last_fullsized":"2024-03-30T12:36:03.220953+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222608+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:36:03.222608+0000","last_peered":"2024-03-30T12:36:03.222608+0000","last_clean":"2024-03-30T12:36:03.222608+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:36:03.222608+0000","last_undegraded":"2024-03-30T12:36:03.222608+0000","last_fullsized":"2024-03-30T12:36:03.222608+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6742,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.018791+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:36:03.018791+0000","last_peered":"2024-03-30T12:36:03.018791+0000","last_clean":"2024-03-30T12:36:03.018791+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:36:03.018791+0000","last_undegraded":"2024-03-30T12:36:03.018791+0000","last_fullsized":"2024-03-30T12:36:03.018791+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1337,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:23.370314+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:36:23.370314+0000","last_peered":"2024-03-30T12:36:23.370314+0000","last_clean":"2024-03-30T12:36:23.370314+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:36:23.370314+0000","last_undegraded":"2024-03-30T12:36:23.370314+0000","last_fullsized":"2024-03-30T12:36:23.370314+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018917+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:36:03.018917+0000","last_peered":"2024-03-30T12:36:03.018917+0000","last_clean":"2024-03-30T12:36:03.018917+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:36:03.018917+0000","last_undegraded":"2024-03-30T12:36:03.018917+0000","last_fullsized":"2024-03-30T12:36:03.018917+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220179+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:36:03.220179+0000","last_peered":"2024-03-30T12:36:03.220179+0000","last_clean":"2024-03-30T12:36:03.220179+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:36:03.220179+0000","last_undegraded":"2024-03-30T12:36:03.220179+0000","last_fullsized":"2024-03-30T12:36:03.220179+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015330+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:36:03.015330+0000","last_peered":"2024-03-30T12:36:03.015330+0000","last_clean":"2024-03-30T12:36:03.015330+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:36:03.015330+0000","last_undegraded":"2024-03-30T12:36:03.015330+0000","last_fullsized":"2024-03-30T12:36:03.015330+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221954+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:36:03.221954+0000","last_peered":"2024-03-30T12:36:03.221954+0000","last_clean":"2024-03-30T12:36:03.221954+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:36:03.221954+0000","last_undegraded":"2024-03-30T12:36:03.221954+0000","last_fullsized":"2024-03-30T12:36:03.221954+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862462+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:36:40.862462+0000","last_peered":"2024-03-30T12:36:40.862462+0000","last_clean":"2024-03-30T12:36:40.862462+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:36:40.862462+0000","last_undegraded":"2024-03-30T12:36:40.862462+0000","last_fullsized":"2024-03-30T12:36:40.862462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638978+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:36:37.638978+0000","last_peered":"2024-03-30T12:36:37.638978+0000","last_clean":"2024-03-30T12:36:37.638978+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:36:37.638978+0000","last_undegraded":"2024-03-30T12:36:37.638978+0000","last_fullsized":"2024-03-30T12:36:37.638978+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221044+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:36:03.221044+0000","last_peered":"2024-03-30T12:36:03.221044+0000","last_clean":"2024-03-30T12:36:03.221044+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:36:03.221044+0000","last_undegraded":"2024-03-30T12:36:03.221044+0000","last_fullsized":"2024-03-30T12:36:03.221044+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1177,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544079+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:36:09.544079+0000","last_peered":"2024-03-30T12:36:09.544079+0000","last_clean":"2024-03-30T12:36:09.544079+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:36:09.544079+0000","last_undegraded":"2024-03-30T12:36:09.544079+0000","last_fullsized":"2024-03-30T12:36:09.544079+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1281,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.639015+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:36:37.639015+0000","last_peered":"2024-03-30T12:36:37.639015+0000","last_clean":"2024-03-30T12:36:37.639015+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:36:37.639015+0000","last_undegraded":"2024-03-30T12:36:37.639015+0000","last_fullsized":"2024-03-30T12:36:37.639015+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221612+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:36:03.221612+0000","last_peered":"2024-03-30T12:36:03.221612+0000","last_clean":"2024-03-30T12:36:03.221612+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:36:03.221612+0000","last_undegraded":"2024-03-30T12:36:03.221612+0000","last_fullsized":"2024-03-30T12:36:03.221612+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220227+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:03.220227+0000","last_peered":"2024-03-30T12:36:03.220227+0000","last_clean":"2024-03-30T12:36:03.220227+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:03.220227+0000","last_undegraded":"2024-03-30T12:36:03.220227+0000","last_fullsized":"2024-03-30T12:36:03.220227+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221610+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:36:03.221610+0000","last_peered":"2024-03-30T12:36:03.221610+0000","last_clean":"2024-03-30T12:36:03.221610+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:36:03.221610+0000","last_undegraded":"2024-03-30T12:36:03.221610+0000","last_fullsized":"2024-03-30T12:36:03.221610+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220926+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:36:03.220926+0000","last_peered":"2024-03-30T12:36:03.220926+0000","last_clean":"2024-03-30T12:36:03.220926+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:36:03.220926+0000","last_undegraded":"2024-03-30T12:36:03.220926+0000","last_fullsized":"2024-03-30T12:36:03.220926+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:24.545379+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:36:24.545379+0000","last_peered":"2024-03-30T12:36:24.545379+0000","last_clean":"2024-03-30T12:36:24.545379+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:36:24.545379+0000","last_undegraded":"2024-03-30T12:36:24.545379+0000","last_fullsized":"2024-03-30T12:36:24.545379+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438055,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648111,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175121,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254360,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063178,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951236,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839293,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923575,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:38:55.192 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:55.192 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:55.192 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:55.192 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:55.192 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:55.192 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:55.192 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:55.192 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:55.193 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:55.193 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:55.193 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:55.193 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:55.193 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:38:55.193 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:38:55.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:55 smithi084 ceph-mon[89279]: from='client.44525 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:38:55.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:55 smithi084 ceph-mon[91810]: from='client.44525 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:38:55.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:55 smithi162 ceph-mon[83709]: from='client.44525 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:38:56.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:56 smithi084 ceph-mon[89279]: pgmap v1076: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:56.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:56 smithi084 ceph-mon[91810]: pgmap v1076: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:56.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:56 smithi162 ceph-mon[83709]: pgmap v1076: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:58.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:38:58 smithi084 ceph-mon[91810]: pgmap v1077: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:58.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:38:58 smithi084 ceph-mon[89279]: pgmap v1077: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:58.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:38:58 smithi162 ceph-mon[83709]: pgmap v1077: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:38:59.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:38:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:38:59] "GET /metrics HTTP/1.1" 200 36328 "" "Prometheus/2.43.0" 2024-03-30T12:39:00.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:00 smithi162 ceph-mon[83709]: pgmap v1078: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:00.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:00 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:39:01.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:00 smithi084 ceph-mon[91810]: pgmap v1078: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:01.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:00 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:39:01.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:00 smithi084 ceph-mon[89279]: pgmap v1078: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:01.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:00 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:39:02.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:02 smithi162 ceph-mon[83709]: pgmap v1079: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:03.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:02 smithi084 ceph-mon[91810]: pgmap v1079: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:03.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:02 smithi084 ceph-mon[89279]: pgmap v1079: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:04.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:04 smithi162 ceph-mon[83709]: pgmap v1080: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:05.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:04 smithi084 ceph-mon[91810]: pgmap v1080: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:05.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:04 smithi084 ceph-mon[89279]: pgmap v1080: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:05.194 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:39:05.410 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:39:06.601 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:06 smithi084 ceph-mon[91810]: pgmap v1081: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:06.601 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:06 smithi084 ceph-mon[89279]: pgmap v1081: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:06.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:06 smithi162 ceph-mon[83709]: pgmap v1081: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:39:07.359 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:39:07.987 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1082,"stamp":"2024-03-30T12:39:06.855782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004353"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:34.124688+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:36:34.124688+0000","last_peered":"2024-03-30T12:36:34.124688+0000","last_clean":"2024-03-30T12:36:34.124688+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:36:34.124688+0000","last_undegraded":"2024-03-30T12:36:34.124688+0000","last_fullsized":"2024-03-30T12:36:34.124688+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1363,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221634+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:36:03.221634+0000","last_peered":"2024-03-30T12:36:03.221634+0000","last_clean":"2024-03-30T12:36:03.221634+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:36:03.221634+0000","last_undegraded":"2024-03-30T12:36:03.221634+0000","last_fullsized":"2024-03-30T12:36:03.221634+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862523+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:36:40.862523+0000","last_peered":"2024-03-30T12:36:40.862523+0000","last_clean":"2024-03-30T12:36:40.862523+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:36:40.862523+0000","last_undegraded":"2024-03-30T12:36:40.862523+0000","last_fullsized":"2024-03-30T12:36:40.862523+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:00.294130+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:37:00.294130+0000","last_peered":"2024-03-30T12:37:00.294130+0000","last_clean":"2024-03-30T12:37:00.294130+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:37:00.294130+0000","last_undegraded":"2024-03-30T12:37:00.294130+0000","last_fullsized":"2024-03-30T12:37:00.294130+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016863+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:36:03.016863+0000","last_peered":"2024-03-30T12:36:03.016863+0000","last_clean":"2024-03-30T12:36:03.016863+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:36:03.016863+0000","last_undegraded":"2024-03-30T12:36:03.016863+0000","last_fullsized":"2024-03-30T12:36:03.016863+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1210,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290374+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:30.290374+0000","last_peered":"2024-03-30T12:36:30.290374+0000","last_clean":"2024-03-30T12:36:30.290374+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:30.290374+0000","last_undegraded":"2024-03-30T12:36:30.290374+0000","last_fullsized":"2024-03-30T12:36:30.290374+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017365+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:36:03.017365+0000","last_peered":"2024-03-30T12:36:03.017365+0000","last_clean":"2024-03-30T12:36:03.017365+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:36:03.017365+0000","last_undegraded":"2024-03-30T12:36:03.017365+0000","last_fullsized":"2024-03-30T12:36:03.017365+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219781+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:36:03.219781+0000","last_peered":"2024-03-30T12:36:03.219781+0000","last_clean":"2024-03-30T12:36:03.219781+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:36:03.219781+0000","last_undegraded":"2024-03-30T12:36:03.219781+0000","last_fullsized":"2024-03-30T12:36:03.219781+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018011+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:36:03.018011+0000","last_peered":"2024-03-30T12:36:03.018011+0000","last_clean":"2024-03-30T12:36:03.018011+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:36:03.018011+0000","last_undegraded":"2024-03-30T12:36:03.018011+0000","last_fullsized":"2024-03-30T12:36:03.018011+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220774+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:03.220774+0000","last_peered":"2024-03-30T12:36:03.220774+0000","last_clean":"2024-03-30T12:36:03.220774+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:03.220774+0000","last_undegraded":"2024-03-30T12:36:03.220774+0000","last_fullsized":"2024-03-30T12:36:03.220774+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220468+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:03.220468+0000","last_peered":"2024-03-30T12:36:03.220468+0000","last_clean":"2024-03-30T12:36:03.220468+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:03.220468+0000","last_undegraded":"2024-03-30T12:36:03.220468+0000","last_fullsized":"2024-03-30T12:36:03.220468+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1270,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020253+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:36:03.020253+0000","last_peered":"2024-03-30T12:36:03.020253+0000","last_clean":"2024-03-30T12:36:03.020253+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:36:03.020253+0000","last_undegraded":"2024-03-30T12:36:03.020253+0000","last_fullsized":"2024-03-30T12:36:03.020253+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221688+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:36:03.221688+0000","last_peered":"2024-03-30T12:36:03.221688+0000","last_clean":"2024-03-30T12:36:03.221688+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:36:03.221688+0000","last_undegraded":"2024-03-30T12:36:03.221688+0000","last_fullsized":"2024-03-30T12:36:03.221688+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220487+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:36:03.220487+0000","last_peered":"2024-03-30T12:36:03.220487+0000","last_clean":"2024-03-30T12:36:03.220487+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:36:03.220487+0000","last_undegraded":"2024-03-30T12:36:03.220487+0000","last_fullsized":"2024-03-30T12:36:03.220487+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:08.897219+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:36:08.897219+0000","last_peered":"2024-03-30T12:36:08.897219+0000","last_clean":"2024-03-30T12:36:08.897219+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:36:08.897219+0000","last_undegraded":"2024-03-30T12:36:08.897219+0000","last_fullsized":"2024-03-30T12:36:08.897219+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1213,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221481+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:36:03.221481+0000","last_peered":"2024-03-30T12:36:03.221481+0000","last_clean":"2024-03-30T12:36:03.221481+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:36:03.221481+0000","last_undegraded":"2024-03-30T12:36:03.221481+0000","last_fullsized":"2024-03-30T12:36:03.221481+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1224,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.223011+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:36:03.223011+0000","last_peered":"2024-03-30T12:36:03.223011+0000","last_clean":"2024-03-30T12:36:03.223011+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:36:03.223011+0000","last_undegraded":"2024-03-30T12:36:03.223011+0000","last_fullsized":"2024-03-30T12:36:03.223011+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:43.372790+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:36:43.372790+0000","last_peered":"2024-03-30T12:36:43.372790+0000","last_clean":"2024-03-30T12:36:43.372790+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:36:43.372790+0000","last_undegraded":"2024-03-30T12:36:43.372790+0000","last_fullsized":"2024-03-30T12:36:43.372790+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017955+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:36:03.017955+0000","last_peered":"2024-03-30T12:36:03.017955+0000","last_clean":"2024-03-30T12:36:03.017955+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:36:03.017955+0000","last_undegraded":"2024-03-30T12:36:03.017955+0000","last_fullsized":"2024-03-30T12:36:03.017955+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1388,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862565+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:36:40.862565+0000","last_peered":"2024-03-30T12:36:40.862565+0000","last_clean":"2024-03-30T12:36:40.862565+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:36:40.862565+0000","last_undegraded":"2024-03-30T12:36:40.862565+0000","last_fullsized":"2024-03-30T12:36:40.862565+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1282,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220823+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:36:03.220823+0000","last_peered":"2024-03-30T12:36:03.220823+0000","last_clean":"2024-03-30T12:36:03.220823+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:36:03.220823+0000","last_undegraded":"2024-03-30T12:36:03.220823+0000","last_fullsized":"2024-03-30T12:36:03.220823+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1301,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221016+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:36:03.221016+0000","last_peered":"2024-03-30T12:36:03.221016+0000","last_clean":"2024-03-30T12:36:03.221016+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:36:03.221016+0000","last_undegraded":"2024-03-30T12:36:03.221016+0000","last_fullsized":"2024-03-30T12:36:03.221016+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862552+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:36:40.862552+0000","last_peered":"2024-03-30T12:36:40.862552+0000","last_clean":"2024-03-30T12:36:40.862552+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:36:40.862552+0000","last_undegraded":"2024-03-30T12:36:40.862552+0000","last_fullsized":"2024-03-30T12:36:40.862552+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018097+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:36:03.018097+0000","last_peered":"2024-03-30T12:36:03.018097+0000","last_clean":"2024-03-30T12:36:03.018097+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:36:03.018097+0000","last_undegraded":"2024-03-30T12:36:03.018097+0000","last_fullsized":"2024-03-30T12:36:03.018097+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1229,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290400+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:30.290400+0000","last_peered":"2024-03-30T12:36:30.290400+0000","last_clean":"2024-03-30T12:36:30.290400+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:30.290400+0000","last_undegraded":"2024-03-30T12:36:30.290400+0000","last_fullsized":"2024-03-30T12:36:30.290400+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017698+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:36:03.017698+0000","last_peered":"2024-03-30T12:36:03.017698+0000","last_clean":"2024-03-30T12:36:03.017698+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:36:03.017698+0000","last_undegraded":"2024-03-30T12:36:03.017698+0000","last_fullsized":"2024-03-30T12:36:03.017698+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1213,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290416+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:30.290416+0000","last_peered":"2024-03-30T12:36:30.290416+0000","last_clean":"2024-03-30T12:36:30.290416+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:30.290416+0000","last_undegraded":"2024-03-30T12:36:30.290416+0000","last_fullsized":"2024-03-30T12:36:30.290416+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221852+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:36:03.221852+0000","last_peered":"2024-03-30T12:36:03.221852+0000","last_clean":"2024-03-30T12:36:03.221852+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:36:03.221852+0000","last_undegraded":"2024-03-30T12:36:03.221852+0000","last_fullsized":"2024-03-30T12:36:03.221852+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018910+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:36:03.018910+0000","last_peered":"2024-03-30T12:36:03.018910+0000","last_clean":"2024-03-30T12:36:03.018910+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:36:03.018910+0000","last_undegraded":"2024-03-30T12:36:03.018910+0000","last_fullsized":"2024-03-30T12:36:03.018910+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1179,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220575+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:36:03.220575+0000","last_peered":"2024-03-30T12:36:03.220575+0000","last_clean":"2024-03-30T12:36:03.220575+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:36:03.220575+0000","last_undegraded":"2024-03-30T12:36:03.220575+0000","last_fullsized":"2024-03-30T12:36:03.220575+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.860010+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:36:15.860010+0000","last_peered":"2024-03-30T12:36:15.860010+0000","last_clean":"2024-03-30T12:36:15.860010+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:36:15.860010+0000","last_undegraded":"2024-03-30T12:36:15.860010+0000","last_fullsized":"2024-03-30T12:36:15.860010+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219839+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:36:03.219839+0000","last_peered":"2024-03-30T12:36:03.219839+0000","last_clean":"2024-03-30T12:36:03.219839+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:36:03.219839+0000","last_undegraded":"2024-03-30T12:36:03.219839+0000","last_fullsized":"2024-03-30T12:36:03.219839+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1294,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219823+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:36:03.219823+0000","last_peered":"2024-03-30T12:36:03.219823+0000","last_clean":"2024-03-30T12:36:03.219823+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:36:03.219823+0000","last_undegraded":"2024-03-30T12:36:03.219823+0000","last_fullsized":"2024-03-30T12:36:03.219823+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1224,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288884+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:36:15.288884+0000","last_peered":"2024-03-30T12:36:15.288884+0000","last_clean":"2024-03-30T12:36:15.288884+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:36:15.288884+0000","last_undegraded":"2024-03-30T12:36:15.288884+0000","last_fullsized":"2024-03-30T12:36:15.288884+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:28.899208+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:36:28.899208+0000","last_peered":"2024-03-30T12:36:28.899208+0000","last_clean":"2024-03-30T12:36:28.899208+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:36:28.899208+0000","last_undegraded":"2024-03-30T12:36:28.899208+0000","last_fullsized":"2024-03-30T12:36:28.899208+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220821+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:03.220821+0000","last_peered":"2024-03-30T12:36:03.220821+0000","last_clean":"2024-03-30T12:36:03.220821+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:03.220821+0000","last_undegraded":"2024-03-30T12:36:03.220821+0000","last_fullsized":"2024-03-30T12:36:03.220821+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1204,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288944+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:36:15.288944+0000","last_peered":"2024-03-30T12:36:15.288944+0000","last_clean":"2024-03-30T12:36:15.288944+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:36:15.288944+0000","last_undegraded":"2024-03-30T12:36:15.288944+0000","last_fullsized":"2024-03-30T12:36:15.288944+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1198,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288933+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:36:15.288933+0000","last_peered":"2024-03-30T12:36:15.288933+0000","last_clean":"2024-03-30T12:36:15.288933+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:36:15.288933+0000","last_undegraded":"2024-03-30T12:36:15.288933+0000","last_fullsized":"2024-03-30T12:36:15.288933+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015739+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:36:03.015739+0000","last_peered":"2024-03-30T12:36:03.015739+0000","last_clean":"2024-03-30T12:36:03.015739+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:36:03.015739+0000","last_undegraded":"2024-03-30T12:36:03.015739+0000","last_fullsized":"2024-03-30T12:36:03.015739+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:28.899251+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:36:28.899251+0000","last_peered":"2024-03-30T12:36:28.899251+0000","last_clean":"2024-03-30T12:36:28.899251+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:36:28.899251+0000","last_undegraded":"2024-03-30T12:36:28.899251+0000","last_fullsized":"2024-03-30T12:36:28.899251+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020091+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:36:03.020091+0000","last_peered":"2024-03-30T12:36:03.020091+0000","last_clean":"2024-03-30T12:36:03.020091+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:36:03.020091+0000","last_undegraded":"2024-03-30T12:36:03.020091+0000","last_fullsized":"2024-03-30T12:36:03.020091+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546935+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:36:39.546935+0000","last_peered":"2024-03-30T12:36:39.546935+0000","last_clean":"2024-03-30T12:36:39.546935+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:36:39.546935+0000","last_undegraded":"2024-03-30T12:36:39.546935+0000","last_fullsized":"2024-03-30T12:36:39.546935+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017435+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:36:03.017435+0000","last_peered":"2024-03-30T12:36:03.017435+0000","last_clean":"2024-03-30T12:36:03.017435+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:36:03.017435+0000","last_undegraded":"2024-03-30T12:36:03.017435+0000","last_fullsized":"2024-03-30T12:36:03.017435+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221769+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:36:03.221769+0000","last_peered":"2024-03-30T12:36:03.221769+0000","last_clean":"2024-03-30T12:36:03.221769+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:36:03.221769+0000","last_undegraded":"2024-03-30T12:36:03.221769+0000","last_fullsized":"2024-03-30T12:36:03.221769+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220786+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:36:03.220786+0000","last_peered":"2024-03-30T12:36:03.220786+0000","last_clean":"2024-03-30T12:36:03.220786+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:36:03.220786+0000","last_undegraded":"2024-03-30T12:36:03.220786+0000","last_fullsized":"2024-03-30T12:36:03.220786+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221971+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:36:03.221971+0000","last_peered":"2024-03-30T12:36:03.221971+0000","last_clean":"2024-03-30T12:36:03.221971+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:36:03.221971+0000","last_undegraded":"2024-03-30T12:36:03.221971+0000","last_fullsized":"2024-03-30T12:36:03.221971+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017508+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:36:03.017508+0000","last_peered":"2024-03-30T12:36:03.017508+0000","last_clean":"2024-03-30T12:36:03.017508+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:36:03.017508+0000","last_undegraded":"2024-03-30T12:36:03.017508+0000","last_fullsized":"2024-03-30T12:36:03.017508+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546908+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:36:39.546908+0000","last_peered":"2024-03-30T12:36:39.546908+0000","last_clean":"2024-03-30T12:36:39.546908+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:36:39.546908+0000","last_undegraded":"2024-03-30T12:36:39.546908+0000","last_fullsized":"2024-03-30T12:36:39.546908+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546882+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:36:39.546882+0000","last_peered":"2024-03-30T12:36:39.546882+0000","last_clean":"2024-03-30T12:36:39.546882+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:36:39.546882+0000","last_undegraded":"2024-03-30T12:36:39.546882+0000","last_fullsized":"2024-03-30T12:36:39.546882+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1344,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:43.372738+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:36:43.372738+0000","last_peered":"2024-03-30T12:36:43.372738+0000","last_clean":"2024-03-30T12:36:43.372738+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:36:43.372738+0000","last_undegraded":"2024-03-30T12:36:43.372738+0000","last_fullsized":"2024-03-30T12:36:43.372738+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016619+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:36:03.016619+0000","last_peered":"2024-03-30T12:36:03.016619+0000","last_clean":"2024-03-30T12:36:03.016619+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:36:03.016619+0000","last_undegraded":"2024-03-30T12:36:03.016619+0000","last_fullsized":"2024-03-30T12:36:03.016619+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5752,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.367799+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:36:03.367799+0000","last_peered":"2024-03-30T12:36:03.367799+0000","last_clean":"2024-03-30T12:36:03.367799+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:36:03.367799+0000","last_undegraded":"2024-03-30T12:36:03.367799+0000","last_fullsized":"2024-03-30T12:36:03.367799+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020404+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:36:03.020404+0000","last_peered":"2024-03-30T12:36:03.020404+0000","last_clean":"2024-03-30T12:36:03.020404+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:36:03.020404+0000","last_undegraded":"2024-03-30T12:36:03.020404+0000","last_fullsized":"2024-03-30T12:36:03.020404+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018051+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:36:03.018051+0000","last_peered":"2024-03-30T12:36:03.018051+0000","last_clean":"2024-03-30T12:36:03.018051+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:36:03.018051+0000","last_undegraded":"2024-03-30T12:36:03.018051+0000","last_fullsized":"2024-03-30T12:36:03.018051+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5513,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:40.862481+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:36:40.862481+0000","last_peered":"2024-03-30T12:36:40.862481+0000","last_clean":"2024-03-30T12:36:40.862481+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:36:40.862481+0000","last_undegraded":"2024-03-30T12:36:40.862481+0000","last_fullsized":"2024-03-30T12:36:40.862481+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220604+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:36:03.220604+0000","last_peered":"2024-03-30T12:36:03.220604+0000","last_clean":"2024-03-30T12:36:03.220604+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:36:03.220604+0000","last_undegraded":"2024-03-30T12:36:03.220604+0000","last_fullsized":"2024-03-30T12:36:03.220604+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1346,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222463+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:36:03.222463+0000","last_peered":"2024-03-30T12:36:03.222463+0000","last_clean":"2024-03-30T12:36:03.222463+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:36:03.222463+0000","last_undegraded":"2024-03-30T12:36:03.222463+0000","last_fullsized":"2024-03-30T12:36:03.222463+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222511+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:36:03.222511+0000","last_peered":"2024-03-30T12:36:03.222511+0000","last_clean":"2024-03-30T12:36:03.222511+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:36:03.222511+0000","last_undegraded":"2024-03-30T12:36:03.222511+0000","last_fullsized":"2024-03-30T12:36:03.222511+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5458,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:40.862535+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:36:40.862535+0000","last_peered":"2024-03-30T12:36:40.862535+0000","last_clean":"2024-03-30T12:36:40.862535+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:36:40.862535+0000","last_undegraded":"2024-03-30T12:36:40.862535+0000","last_fullsized":"2024-03-30T12:36:40.862535+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222581+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:36:03.222581+0000","last_peered":"2024-03-30T12:36:03.222581+0000","last_clean":"2024-03-30T12:36:03.222581+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:36:03.222581+0000","last_undegraded":"2024-03-30T12:36:03.222581+0000","last_fullsized":"2024-03-30T12:36:03.222581+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221692+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:36:03.221692+0000","last_peered":"2024-03-30T12:36:03.221692+0000","last_clean":"2024-03-30T12:36:03.221692+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:36:03.221692+0000","last_undegraded":"2024-03-30T12:36:03.221692+0000","last_fullsized":"2024-03-30T12:36:03.221692+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1272,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:52.276088+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:36:52.276088+0000","last_peered":"2024-03-30T12:36:52.276088+0000","last_clean":"2024-03-30T12:36:52.276088+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:36:52.276088+0000","last_undegraded":"2024-03-30T12:36:52.276088+0000","last_fullsized":"2024-03-30T12:36:52.276088+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3803,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.367883+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:36:03.367883+0000","last_peered":"2024-03-30T12:36:03.367883+0000","last_clean":"2024-03-30T12:36:03.367883+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:36:03.367883+0000","last_undegraded":"2024-03-30T12:36:03.367883+0000","last_fullsized":"2024-03-30T12:36:03.367883+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1342,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222978+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:36:03.222978+0000","last_peered":"2024-03-30T12:36:03.222978+0000","last_clean":"2024-03-30T12:36:03.222978+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:36:03.222978+0000","last_undegraded":"2024-03-30T12:36:03.222978+0000","last_fullsized":"2024-03-30T12:36:03.222978+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:48.901383+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:36:48.901383+0000","last_peered":"2024-03-30T12:36:48.901383+0000","last_clean":"2024-03-30T12:36:48.901383+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:36:48.901383+0000","last_undegraded":"2024-03-30T12:36:48.901383+0000","last_fullsized":"2024-03-30T12:36:48.901383+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015232+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:36:03.015232+0000","last_peered":"2024-03-30T12:36:03.015232+0000","last_clean":"2024-03-30T12:36:03.015232+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:36:03.015232+0000","last_undegraded":"2024-03-30T12:36:03.015232+0000","last_fullsized":"2024-03-30T12:36:03.015232+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4576,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:34.124620+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:36:34.124620+0000","last_peered":"2024-03-30T12:36:34.124620+0000","last_clean":"2024-03-30T12:36:34.124620+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:36:34.124620+0000","last_undegraded":"2024-03-30T12:36:34.124620+0000","last_fullsized":"2024-03-30T12:36:34.124620+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1174,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220771+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:36:03.220771+0000","last_peered":"2024-03-30T12:36:03.220771+0000","last_clean":"2024-03-30T12:36:03.220771+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:36:03.220771+0000","last_undegraded":"2024-03-30T12:36:03.220771+0000","last_fullsized":"2024-03-30T12:36:03.220771+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:17.636728+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:36:17.636728+0000","last_peered":"2024-03-30T12:36:17.636728+0000","last_clean":"2024-03-30T12:36:17.636728+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:36:17.636728+0000","last_undegraded":"2024-03-30T12:36:17.636728+0000","last_fullsized":"2024-03-30T12:36:17.636728+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1199,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222181+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:36:03.222181+0000","last_peered":"2024-03-30T12:36:03.222181+0000","last_clean":"2024-03-30T12:36:03.222181+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:36:03.222181+0000","last_undegraded":"2024-03-30T12:36:03.222181+0000","last_fullsized":"2024-03-30T12:36:03.222181+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1716,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:19.123078+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:36:19.123078+0000","last_peered":"2024-03-30T12:36:19.123078+0000","last_clean":"2024-03-30T12:36:19.123078+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:36:19.123078+0000","last_undegraded":"2024-03-30T12:36:19.123078+0000","last_fullsized":"2024-03-30T12:36:19.123078+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24713,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223744+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:36:03.223744+0000","last_peered":"2024-03-30T12:36:03.223744+0000","last_clean":"2024-03-30T12:36:03.223744+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:36:03.223744+0000","last_undegraded":"2024-03-30T12:36:03.223744+0000","last_fullsized":"2024-03-30T12:36:03.223744+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220614+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:36:03.220614+0000","last_peered":"2024-03-30T12:36:03.220614+0000","last_clean":"2024-03-30T12:36:03.220614+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:36:03.220614+0000","last_undegraded":"2024-03-30T12:36:03.220614+0000","last_fullsized":"2024-03-30T12:36:03.220614+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862413+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:36:40.862413+0000","last_peered":"2024-03-30T12:36:40.862413+0000","last_clean":"2024-03-30T12:36:40.862413+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:36:40.862413+0000","last_undegraded":"2024-03-30T12:36:40.862413+0000","last_fullsized":"2024-03-30T12:36:40.862413+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:19.123052+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:36:19.123052+0000","last_peered":"2024-03-30T12:36:19.123052+0000","last_clean":"2024-03-30T12:36:19.123052+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:36:19.123052+0000","last_undegraded":"2024-03-30T12:36:19.123052+0000","last_fullsized":"2024-03-30T12:36:19.123052+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16480,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.221717+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:36:03.221717+0000","last_peered":"2024-03-30T12:36:03.221717+0000","last_clean":"2024-03-30T12:36:03.221717+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:36:03.221717+0000","last_undegraded":"2024-03-30T12:36:03.221717+0000","last_fullsized":"2024-03-30T12:36:03.221717+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862510+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:36:40.862510+0000","last_peered":"2024-03-30T12:36:40.862510+0000","last_clean":"2024-03-30T12:36:40.862510+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:36:40.862510+0000","last_undegraded":"2024-03-30T12:36:40.862510+0000","last_fullsized":"2024-03-30T12:36:40.862510+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:34.124667+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:36:34.124667+0000","last_peered":"2024-03-30T12:36:34.124667+0000","last_clean":"2024-03-30T12:36:34.124667+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:36:34.124667+0000","last_undegraded":"2024-03-30T12:36:34.124667+0000","last_fullsized":"2024-03-30T12:36:34.124667+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222675+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:36:03.222675+0000","last_peered":"2024-03-30T12:36:03.222675+0000","last_clean":"2024-03-30T12:36:03.222675+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:36:03.222675+0000","last_undegraded":"2024-03-30T12:36:03.222675+0000","last_fullsized":"2024-03-30T12:36:03.222675+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31269,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:52.276052+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:36:52.276052+0000","last_peered":"2024-03-30T12:36:52.276052+0000","last_clean":"2024-03-30T12:36:52.276052+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:36:52.276052+0000","last_undegraded":"2024-03-30T12:36:52.276052+0000","last_fullsized":"2024-03-30T12:36:52.276052+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1294,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219916+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:36:03.219916+0000","last_peered":"2024-03-30T12:36:03.219916+0000","last_clean":"2024-03-30T12:36:03.219916+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:36:03.219916+0000","last_undegraded":"2024-03-30T12:36:03.219916+0000","last_fullsized":"2024-03-30T12:36:03.219916+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221733+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:36:03.221733+0000","last_peered":"2024-03-30T12:36:03.221733+0000","last_clean":"2024-03-30T12:36:03.221733+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:36:03.221733+0000","last_undegraded":"2024-03-30T12:36:03.221733+0000","last_fullsized":"2024-03-30T12:36:03.221733+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638999+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:36:37.638999+0000","last_peered":"2024-03-30T12:36:37.638999+0000","last_clean":"2024-03-30T12:36:37.638999+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:36:37.638999+0000","last_undegraded":"2024-03-30T12:36:37.638999+0000","last_fullsized":"2024-03-30T12:36:37.638999+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3764,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220021+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:36:03.220021+0000","last_peered":"2024-03-30T12:36:03.220021+0000","last_clean":"2024-03-30T12:36:03.220021+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:36:03.220021+0000","last_undegraded":"2024-03-30T12:36:03.220021+0000","last_fullsized":"2024-03-30T12:36:03.220021+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:52.276014+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:36:52.276014+0000","last_peered":"2024-03-30T12:36:52.276014+0000","last_clean":"2024-03-30T12:36:52.276014+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:36:52.276014+0000","last_undegraded":"2024-03-30T12:36:52.276014+0000","last_fullsized":"2024-03-30T12:36:52.276014+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544094+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:36:09.544094+0000","last_peered":"2024-03-30T12:36:09.544094+0000","last_clean":"2024-03-30T12:36:09.544094+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:36:09.544094+0000","last_undegraded":"2024-03-30T12:36:09.544094+0000","last_fullsized":"2024-03-30T12:36:09.544094+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220354+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:36:03.220354+0000","last_peered":"2024-03-30T12:36:03.220354+0000","last_clean":"2024-03-30T12:36:03.220354+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:36:03.220354+0000","last_undegraded":"2024-03-30T12:36:03.220354+0000","last_fullsized":"2024-03-30T12:36:03.220354+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15593,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223541+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:36:03.223541+0000","last_peered":"2024-03-30T12:36:03.223541+0000","last_clean":"2024-03-30T12:36:03.223541+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:36:03.223541+0000","last_undegraded":"2024-03-30T12:36:03.223541+0000","last_fullsized":"2024-03-30T12:36:03.223541+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1143,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:49.126219+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:36:49.126219+0000","last_peered":"2024-03-30T12:36:49.126219+0000","last_clean":"2024-03-30T12:36:49.126219+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:36:49.126219+0000","last_undegraded":"2024-03-30T12:36:49.126219+0000","last_fullsized":"2024-03-30T12:36:49.126219+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1257,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018978+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:36:03.018978+0000","last_peered":"2024-03-30T12:36:03.018978+0000","last_clean":"2024-03-30T12:36:03.018978+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:36:03.018978+0000","last_undegraded":"2024-03-30T12:36:03.018978+0000","last_fullsized":"2024-03-30T12:36:03.018978+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29019,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.020881+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:36:03.020881+0000","last_peered":"2024-03-30T12:36:03.020881+0000","last_clean":"2024-03-30T12:36:03.020881+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:36:03.020881+0000","last_undegraded":"2024-03-30T12:36:03.020881+0000","last_fullsized":"2024-03-30T12:36:03.020881+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222681+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:36:03.222681+0000","last_peered":"2024-03-30T12:36:03.222681+0000","last_clean":"2024-03-30T12:36:03.222681+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:36:03.222681+0000","last_undegraded":"2024-03-30T12:36:03.222681+0000","last_fullsized":"2024-03-30T12:36:03.222681+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638944+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:36:37.638944+0000","last_peered":"2024-03-30T12:36:37.638944+0000","last_clean":"2024-03-30T12:36:37.638944+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:36:37.638944+0000","last_undegraded":"2024-03-30T12:36:37.638944+0000","last_fullsized":"2024-03-30T12:36:37.638944+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5610,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:23.370279+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:36:23.370279+0000","last_peered":"2024-03-30T12:36:23.370279+0000","last_clean":"2024-03-30T12:36:23.370279+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:36:23.370279+0000","last_undegraded":"2024-03-30T12:36:23.370279+0000","last_fullsized":"2024-03-30T12:36:23.370279+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1364,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220455+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:36:03.220455+0000","last_peered":"2024-03-30T12:36:03.220455+0000","last_clean":"2024-03-30T12:36:03.220455+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:36:03.220455+0000","last_undegraded":"2024-03-30T12:36:03.220455+0000","last_fullsized":"2024-03-30T12:36:03.220455+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221588+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:03.221588+0000","last_peered":"2024-03-30T12:36:03.221588+0000","last_clean":"2024-03-30T12:36:03.221588+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:03.221588+0000","last_undegraded":"2024-03-30T12:36:03.221588+0000","last_fullsized":"2024-03-30T12:36:03.221588+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222932+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:36:03.222932+0000","last_peered":"2024-03-30T12:36:03.222932+0000","last_clean":"2024-03-30T12:36:03.222932+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:36:03.222932+0000","last_undegraded":"2024-03-30T12:36:03.222932+0000","last_fullsized":"2024-03-30T12:36:03.222932+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017355+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:36:03.017355+0000","last_peered":"2024-03-30T12:36:03.017355+0000","last_clean":"2024-03-30T12:36:03.017355+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:36:03.017355+0000","last_undegraded":"2024-03-30T12:36:03.017355+0000","last_fullsized":"2024-03-30T12:36:03.017355+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544025+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:36:09.544025+0000","last_peered":"2024-03-30T12:36:09.544025+0000","last_clean":"2024-03-30T12:36:09.544025+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:36:09.544025+0000","last_undegraded":"2024-03-30T12:36:09.544025+0000","last_fullsized":"2024-03-30T12:36:09.544025+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5253,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:23.370200+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:36:23.370200+0000","last_peered":"2024-03-30T12:36:23.370200+0000","last_clean":"2024-03-30T12:36:23.370200+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:36:23.370200+0000","last_undegraded":"2024-03-30T12:36:23.370200+0000","last_fullsized":"2024-03-30T12:36:23.370200+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:23.370243+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:36:23.370243+0000","last_peered":"2024-03-30T12:36:23.370243+0000","last_clean":"2024-03-30T12:36:23.370243+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:36:23.370243+0000","last_undegraded":"2024-03-30T12:36:23.370243+0000","last_fullsized":"2024-03-30T12:36:23.370243+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017799+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:36:03.017799+0000","last_peered":"2024-03-30T12:36:03.017799+0000","last_clean":"2024-03-30T12:36:03.017799+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:36:03.017799+0000","last_undegraded":"2024-03-30T12:36:03.017799+0000","last_fullsized":"2024-03-30T12:36:03.017799+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4810,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.367842+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:36:03.367842+0000","last_peered":"2024-03-30T12:36:03.367842+0000","last_clean":"2024-03-30T12:36:03.367842+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:36:03.367842+0000","last_undegraded":"2024-03-30T12:36:03.367842+0000","last_fullsized":"2024-03-30T12:36:03.367842+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220953+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:36:03.220953+0000","last_peered":"2024-03-30T12:36:03.220953+0000","last_clean":"2024-03-30T12:36:03.220953+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:36:03.220953+0000","last_undegraded":"2024-03-30T12:36:03.220953+0000","last_fullsized":"2024-03-30T12:36:03.220953+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222608+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:36:03.222608+0000","last_peered":"2024-03-30T12:36:03.222608+0000","last_clean":"2024-03-30T12:36:03.222608+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:36:03.222608+0000","last_undegraded":"2024-03-30T12:36:03.222608+0000","last_fullsized":"2024-03-30T12:36:03.222608+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6743,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:49.126256+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:36:49.126256+0000","last_peered":"2024-03-30T12:36:49.126256+0000","last_clean":"2024-03-30T12:36:49.126256+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:36:49.126256+0000","last_undegraded":"2024-03-30T12:36:49.126256+0000","last_fullsized":"2024-03-30T12:36:49.126256+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1337,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:23.370314+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:36:23.370314+0000","last_peered":"2024-03-30T12:36:23.370314+0000","last_clean":"2024-03-30T12:36:23.370314+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:36:23.370314+0000","last_undegraded":"2024-03-30T12:36:23.370314+0000","last_fullsized":"2024-03-30T12:36:23.370314+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018917+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:36:03.018917+0000","last_peered":"2024-03-30T12:36:03.018917+0000","last_clean":"2024-03-30T12:36:03.018917+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:36:03.018917+0000","last_undegraded":"2024-03-30T12:36:03.018917+0000","last_fullsized":"2024-03-30T12:36:03.018917+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220179+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:36:03.220179+0000","last_peered":"2024-03-30T12:36:03.220179+0000","last_clean":"2024-03-30T12:36:03.220179+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:36:03.220179+0000","last_undegraded":"2024-03-30T12:36:03.220179+0000","last_fullsized":"2024-03-30T12:36:03.220179+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015330+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:36:03.015330+0000","last_peered":"2024-03-30T12:36:03.015330+0000","last_clean":"2024-03-30T12:36:03.015330+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:36:03.015330+0000","last_undegraded":"2024-03-30T12:36:03.015330+0000","last_fullsized":"2024-03-30T12:36:03.015330+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221954+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:36:03.221954+0000","last_peered":"2024-03-30T12:36:03.221954+0000","last_clean":"2024-03-30T12:36:03.221954+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:36:03.221954+0000","last_undegraded":"2024-03-30T12:36:03.221954+0000","last_fullsized":"2024-03-30T12:36:03.221954+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862462+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:36:40.862462+0000","last_peered":"2024-03-30T12:36:40.862462+0000","last_clean":"2024-03-30T12:36:40.862462+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:36:40.862462+0000","last_undegraded":"2024-03-30T12:36:40.862462+0000","last_fullsized":"2024-03-30T12:36:40.862462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638978+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:36:37.638978+0000","last_peered":"2024-03-30T12:36:37.638978+0000","last_clean":"2024-03-30T12:36:37.638978+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:36:37.638978+0000","last_undegraded":"2024-03-30T12:36:37.638978+0000","last_fullsized":"2024-03-30T12:36:37.638978+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221044+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:36:03.221044+0000","last_peered":"2024-03-30T12:36:03.221044+0000","last_clean":"2024-03-30T12:36:03.221044+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:36:03.221044+0000","last_undegraded":"2024-03-30T12:36:03.221044+0000","last_fullsized":"2024-03-30T12:36:03.221044+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1177,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544079+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:36:09.544079+0000","last_peered":"2024-03-30T12:36:09.544079+0000","last_clean":"2024-03-30T12:36:09.544079+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:36:09.544079+0000","last_undegraded":"2024-03-30T12:36:09.544079+0000","last_fullsized":"2024-03-30T12:36:09.544079+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1281,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.639015+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:36:37.639015+0000","last_peered":"2024-03-30T12:36:37.639015+0000","last_clean":"2024-03-30T12:36:37.639015+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:36:37.639015+0000","last_undegraded":"2024-03-30T12:36:37.639015+0000","last_fullsized":"2024-03-30T12:36:37.639015+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221612+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:36:03.221612+0000","last_peered":"2024-03-30T12:36:03.221612+0000","last_clean":"2024-03-30T12:36:03.221612+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:36:03.221612+0000","last_undegraded":"2024-03-30T12:36:03.221612+0000","last_fullsized":"2024-03-30T12:36:03.221612+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220227+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:03.220227+0000","last_peered":"2024-03-30T12:36:03.220227+0000","last_clean":"2024-03-30T12:36:03.220227+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:03.220227+0000","last_undegraded":"2024-03-30T12:36:03.220227+0000","last_fullsized":"2024-03-30T12:36:03.220227+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221610+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:36:03.221610+0000","last_peered":"2024-03-30T12:36:03.221610+0000","last_clean":"2024-03-30T12:36:03.221610+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:36:03.221610+0000","last_undegraded":"2024-03-30T12:36:03.221610+0000","last_fullsized":"2024-03-30T12:36:03.221610+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220926+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:36:03.220926+0000","last_peered":"2024-03-30T12:36:03.220926+0000","last_clean":"2024-03-30T12:36:03.220926+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:36:03.220926+0000","last_undegraded":"2024-03-30T12:36:03.220926+0000","last_fullsized":"2024-03-30T12:36:03.220926+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:24.545379+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:36:24.545379+0000","last_peered":"2024-03-30T12:36:24.545379+0000","last_clean":"2024-03-30T12:36:24.545379+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:36:24.545379+0000","last_undegraded":"2024-03-30T12:36:24.545379+0000","last_fullsized":"2024-03-30T12:36:24.545379+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438058,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648114,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175124,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254363,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063181,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951238,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839295,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923578,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:39:07.992 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:07.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:07.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:07.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:07.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:07.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:07.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:07.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:07.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:07.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:07.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:07.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:07.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:07.994 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:39:08.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:08 smithi162 ceph-mon[83709]: pgmap v1082: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:08.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:08 smithi162 ceph-mon[83709]: from='client.34596 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:39:09.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:08 smithi084 ceph-mon[91810]: pgmap v1082: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:09.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:08 smithi084 ceph-mon[91810]: from='client.34596 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:39:09.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:08 smithi084 ceph-mon[89279]: pgmap v1082: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:09.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:08 smithi084 ceph-mon[89279]: from='client.34596 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:39:09.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:39:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:39:09] "GET /metrics HTTP/1.1" 200 36325 "" "Prometheus/2.43.0" 2024-03-30T12:39:10.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:10 smithi162 ceph-mon[83709]: pgmap v1083: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:11.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:10 smithi084 ceph-mon[91810]: pgmap v1083: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:11.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:10 smithi084 ceph-mon[89279]: pgmap v1083: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:12.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:12 smithi162 ceph-mon[83709]: pgmap v1084: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:13.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:12 smithi084 ceph-mon[91810]: pgmap v1084: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:13.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:12 smithi084 ceph-mon[89279]: pgmap v1084: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:14.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:14 smithi162 ceph-mon[83709]: pgmap v1085: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:15.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:14 smithi084 ceph-mon[91810]: pgmap v1085: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:15.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:14 smithi084 ceph-mon[89279]: pgmap v1085: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:15.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:15 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:39:16.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:15 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:39:16.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:15 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:39:16.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:16 smithi162 ceph-mon[83709]: pgmap v1086: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:17.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:16 smithi084 ceph-mon[91810]: pgmap v1086: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:17.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:16 smithi084 ceph-mon[89279]: pgmap v1086: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:17.994 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:39:18.213 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:39:18.586 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:18 smithi084 ceph-mon[89279]: pgmap v1087: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:18.586 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:18 smithi084 ceph-mon[91810]: pgmap v1087: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:18.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:18 smithi162 ceph-mon[83709]: pgmap v1087: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:19.597 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:39:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:39:19] "GET /metrics HTTP/1.1" 200 36322 "" "Prometheus/2.43.0" 2024-03-30T12:39:20.219 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:39:20.221 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:39:20.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:20 smithi162 ceph-mon[83709]: pgmap v1088: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:20.903 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:20 smithi084 ceph-mon[91810]: pgmap v1088: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:20.904 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:20 smithi084 ceph-mon[89279]: pgmap v1088: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:20.925 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1088,"stamp":"2024-03-30T12:39:18.859834+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004052"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:34.124688+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:36:34.124688+0000","last_peered":"2024-03-30T12:36:34.124688+0000","last_clean":"2024-03-30T12:36:34.124688+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:36:34.124688+0000","last_undegraded":"2024-03-30T12:36:34.124688+0000","last_fullsized":"2024-03-30T12:36:34.124688+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1363,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221634+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:36:03.221634+0000","last_peered":"2024-03-30T12:36:03.221634+0000","last_clean":"2024-03-30T12:36:03.221634+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:36:03.221634+0000","last_undegraded":"2024-03-30T12:36:03.221634+0000","last_fullsized":"2024-03-30T12:36:03.221634+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862523+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:36:40.862523+0000","last_peered":"2024-03-30T12:36:40.862523+0000","last_clean":"2024-03-30T12:36:40.862523+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:36:40.862523+0000","last_undegraded":"2024-03-30T12:36:40.862523+0000","last_fullsized":"2024-03-30T12:36:40.862523+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:00.294130+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:37:00.294130+0000","last_peered":"2024-03-30T12:37:00.294130+0000","last_clean":"2024-03-30T12:37:00.294130+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:37:00.294130+0000","last_undegraded":"2024-03-30T12:37:00.294130+0000","last_fullsized":"2024-03-30T12:37:00.294130+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016863+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:36:03.016863+0000","last_peered":"2024-03-30T12:36:03.016863+0000","last_clean":"2024-03-30T12:36:03.016863+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:36:03.016863+0000","last_undegraded":"2024-03-30T12:36:03.016863+0000","last_fullsized":"2024-03-30T12:36:03.016863+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1210,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290374+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:30.290374+0000","last_peered":"2024-03-30T12:36:30.290374+0000","last_clean":"2024-03-30T12:36:30.290374+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:30.290374+0000","last_undegraded":"2024-03-30T12:36:30.290374+0000","last_fullsized":"2024-03-30T12:36:30.290374+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017365+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:36:03.017365+0000","last_peered":"2024-03-30T12:36:03.017365+0000","last_clean":"2024-03-30T12:36:03.017365+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:36:03.017365+0000","last_undegraded":"2024-03-30T12:36:03.017365+0000","last_fullsized":"2024-03-30T12:36:03.017365+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219781+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:36:03.219781+0000","last_peered":"2024-03-30T12:36:03.219781+0000","last_clean":"2024-03-30T12:36:03.219781+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:36:03.219781+0000","last_undegraded":"2024-03-30T12:36:03.219781+0000","last_fullsized":"2024-03-30T12:36:03.219781+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018011+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:36:03.018011+0000","last_peered":"2024-03-30T12:36:03.018011+0000","last_clean":"2024-03-30T12:36:03.018011+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:36:03.018011+0000","last_undegraded":"2024-03-30T12:36:03.018011+0000","last_fullsized":"2024-03-30T12:36:03.018011+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220774+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:03.220774+0000","last_peered":"2024-03-30T12:36:03.220774+0000","last_clean":"2024-03-30T12:36:03.220774+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:03.220774+0000","last_undegraded":"2024-03-30T12:36:03.220774+0000","last_fullsized":"2024-03-30T12:36:03.220774+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1168,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220468+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:03.220468+0000","last_peered":"2024-03-30T12:36:03.220468+0000","last_clean":"2024-03-30T12:36:03.220468+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:03.220468+0000","last_undegraded":"2024-03-30T12:36:03.220468+0000","last_fullsized":"2024-03-30T12:36:03.220468+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1270,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020253+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:36:03.020253+0000","last_peered":"2024-03-30T12:36:03.020253+0000","last_clean":"2024-03-30T12:36:03.020253+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:36:03.020253+0000","last_undegraded":"2024-03-30T12:36:03.020253+0000","last_fullsized":"2024-03-30T12:36:03.020253+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221688+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:36:03.221688+0000","last_peered":"2024-03-30T12:36:03.221688+0000","last_clean":"2024-03-30T12:36:03.221688+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:36:03.221688+0000","last_undegraded":"2024-03-30T12:36:03.221688+0000","last_fullsized":"2024-03-30T12:36:03.221688+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220487+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:36:03.220487+0000","last_peered":"2024-03-30T12:36:03.220487+0000","last_clean":"2024-03-30T12:36:03.220487+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:36:03.220487+0000","last_undegraded":"2024-03-30T12:36:03.220487+0000","last_fullsized":"2024-03-30T12:36:03.220487+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:08.897219+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:36:08.897219+0000","last_peered":"2024-03-30T12:36:08.897219+0000","last_clean":"2024-03-30T12:36:08.897219+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:36:08.897219+0000","last_undegraded":"2024-03-30T12:36:08.897219+0000","last_fullsized":"2024-03-30T12:36:08.897219+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1213,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221481+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:36:03.221481+0000","last_peered":"2024-03-30T12:36:03.221481+0000","last_clean":"2024-03-30T12:36:03.221481+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:36:03.221481+0000","last_undegraded":"2024-03-30T12:36:03.221481+0000","last_fullsized":"2024-03-30T12:36:03.221481+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1224,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.223011+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:36:03.223011+0000","last_peered":"2024-03-30T12:36:03.223011+0000","last_clean":"2024-03-30T12:36:03.223011+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:36:03.223011+0000","last_undegraded":"2024-03-30T12:36:03.223011+0000","last_fullsized":"2024-03-30T12:36:03.223011+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:43.372790+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:36:43.372790+0000","last_peered":"2024-03-30T12:36:43.372790+0000","last_clean":"2024-03-30T12:36:43.372790+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:36:43.372790+0000","last_undegraded":"2024-03-30T12:36:43.372790+0000","last_fullsized":"2024-03-30T12:36:43.372790+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017955+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:36:03.017955+0000","last_peered":"2024-03-30T12:36:03.017955+0000","last_clean":"2024-03-30T12:36:03.017955+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:36:03.017955+0000","last_undegraded":"2024-03-30T12:36:03.017955+0000","last_fullsized":"2024-03-30T12:36:03.017955+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1388,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862565+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:36:40.862565+0000","last_peered":"2024-03-30T12:36:40.862565+0000","last_clean":"2024-03-30T12:36:40.862565+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:36:40.862565+0000","last_undegraded":"2024-03-30T12:36:40.862565+0000","last_fullsized":"2024-03-30T12:36:40.862565+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1282,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220823+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:36:03.220823+0000","last_peered":"2024-03-30T12:36:03.220823+0000","last_clean":"2024-03-30T12:36:03.220823+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:36:03.220823+0000","last_undegraded":"2024-03-30T12:36:03.220823+0000","last_fullsized":"2024-03-30T12:36:03.220823+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1301,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221016+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:36:03.221016+0000","last_peered":"2024-03-30T12:36:03.221016+0000","last_clean":"2024-03-30T12:36:03.221016+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:36:03.221016+0000","last_undegraded":"2024-03-30T12:36:03.221016+0000","last_fullsized":"2024-03-30T12:36:03.221016+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862552+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:36:40.862552+0000","last_peered":"2024-03-30T12:36:40.862552+0000","last_clean":"2024-03-30T12:36:40.862552+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:36:40.862552+0000","last_undegraded":"2024-03-30T12:36:40.862552+0000","last_fullsized":"2024-03-30T12:36:40.862552+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018097+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:36:03.018097+0000","last_peered":"2024-03-30T12:36:03.018097+0000","last_clean":"2024-03-30T12:36:03.018097+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:36:03.018097+0000","last_undegraded":"2024-03-30T12:36:03.018097+0000","last_fullsized":"2024-03-30T12:36:03.018097+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1229,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290400+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:30.290400+0000","last_peered":"2024-03-30T12:36:30.290400+0000","last_clean":"2024-03-30T12:36:30.290400+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:30.290400+0000","last_undegraded":"2024-03-30T12:36:30.290400+0000","last_fullsized":"2024-03-30T12:36:30.290400+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017698+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:36:03.017698+0000","last_peered":"2024-03-30T12:36:03.017698+0000","last_clean":"2024-03-30T12:36:03.017698+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:36:03.017698+0000","last_undegraded":"2024-03-30T12:36:03.017698+0000","last_fullsized":"2024-03-30T12:36:03.017698+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1213,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290416+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:30.290416+0000","last_peered":"2024-03-30T12:36:30.290416+0000","last_clean":"2024-03-30T12:36:30.290416+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:30.290416+0000","last_undegraded":"2024-03-30T12:36:30.290416+0000","last_fullsized":"2024-03-30T12:36:30.290416+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221852+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:36:03.221852+0000","last_peered":"2024-03-30T12:36:03.221852+0000","last_clean":"2024-03-30T12:36:03.221852+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:36:03.221852+0000","last_undegraded":"2024-03-30T12:36:03.221852+0000","last_fullsized":"2024-03-30T12:36:03.221852+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018910+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:36:03.018910+0000","last_peered":"2024-03-30T12:36:03.018910+0000","last_clean":"2024-03-30T12:36:03.018910+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:36:03.018910+0000","last_undegraded":"2024-03-30T12:36:03.018910+0000","last_fullsized":"2024-03-30T12:36:03.018910+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1179,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220575+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:36:03.220575+0000","last_peered":"2024-03-30T12:36:03.220575+0000","last_clean":"2024-03-30T12:36:03.220575+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:36:03.220575+0000","last_undegraded":"2024-03-30T12:36:03.220575+0000","last_fullsized":"2024-03-30T12:36:03.220575+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.860010+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:36:15.860010+0000","last_peered":"2024-03-30T12:36:15.860010+0000","last_clean":"2024-03-30T12:36:15.860010+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:36:15.860010+0000","last_undegraded":"2024-03-30T12:36:15.860010+0000","last_fullsized":"2024-03-30T12:36:15.860010+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219839+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:36:03.219839+0000","last_peered":"2024-03-30T12:36:03.219839+0000","last_clean":"2024-03-30T12:36:03.219839+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:36:03.219839+0000","last_undegraded":"2024-03-30T12:36:03.219839+0000","last_fullsized":"2024-03-30T12:36:03.219839+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1294,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219823+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:36:03.219823+0000","last_peered":"2024-03-30T12:36:03.219823+0000","last_clean":"2024-03-30T12:36:03.219823+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:36:03.219823+0000","last_undegraded":"2024-03-30T12:36:03.219823+0000","last_fullsized":"2024-03-30T12:36:03.219823+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1224,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288884+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:36:15.288884+0000","last_peered":"2024-03-30T12:36:15.288884+0000","last_clean":"2024-03-30T12:36:15.288884+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:36:15.288884+0000","last_undegraded":"2024-03-30T12:36:15.288884+0000","last_fullsized":"2024-03-30T12:36:15.288884+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:28.899208+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:36:28.899208+0000","last_peered":"2024-03-30T12:36:28.899208+0000","last_clean":"2024-03-30T12:36:28.899208+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:36:28.899208+0000","last_undegraded":"2024-03-30T12:36:28.899208+0000","last_fullsized":"2024-03-30T12:36:28.899208+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220821+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:03.220821+0000","last_peered":"2024-03-30T12:36:03.220821+0000","last_clean":"2024-03-30T12:36:03.220821+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:03.220821+0000","last_undegraded":"2024-03-30T12:36:03.220821+0000","last_fullsized":"2024-03-30T12:36:03.220821+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1204,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288944+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:36:15.288944+0000","last_peered":"2024-03-30T12:36:15.288944+0000","last_clean":"2024-03-30T12:36:15.288944+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:36:15.288944+0000","last_undegraded":"2024-03-30T12:36:15.288944+0000","last_fullsized":"2024-03-30T12:36:15.288944+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1198,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288933+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:36:15.288933+0000","last_peered":"2024-03-30T12:36:15.288933+0000","last_clean":"2024-03-30T12:36:15.288933+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:36:15.288933+0000","last_undegraded":"2024-03-30T12:36:15.288933+0000","last_fullsized":"2024-03-30T12:36:15.288933+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015739+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:36:03.015739+0000","last_peered":"2024-03-30T12:36:03.015739+0000","last_clean":"2024-03-30T12:36:03.015739+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:36:03.015739+0000","last_undegraded":"2024-03-30T12:36:03.015739+0000","last_fullsized":"2024-03-30T12:36:03.015739+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:28.899251+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:36:28.899251+0000","last_peered":"2024-03-30T12:36:28.899251+0000","last_clean":"2024-03-30T12:36:28.899251+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:36:28.899251+0000","last_undegraded":"2024-03-30T12:36:28.899251+0000","last_fullsized":"2024-03-30T12:36:28.899251+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020091+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:36:03.020091+0000","last_peered":"2024-03-30T12:36:03.020091+0000","last_clean":"2024-03-30T12:36:03.020091+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:36:03.020091+0000","last_undegraded":"2024-03-30T12:36:03.020091+0000","last_fullsized":"2024-03-30T12:36:03.020091+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546935+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:36:39.546935+0000","last_peered":"2024-03-30T12:36:39.546935+0000","last_clean":"2024-03-30T12:36:39.546935+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:36:39.546935+0000","last_undegraded":"2024-03-30T12:36:39.546935+0000","last_fullsized":"2024-03-30T12:36:39.546935+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017435+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:36:03.017435+0000","last_peered":"2024-03-30T12:36:03.017435+0000","last_clean":"2024-03-30T12:36:03.017435+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:36:03.017435+0000","last_undegraded":"2024-03-30T12:36:03.017435+0000","last_fullsized":"2024-03-30T12:36:03.017435+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221769+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:36:03.221769+0000","last_peered":"2024-03-30T12:36:03.221769+0000","last_clean":"2024-03-30T12:36:03.221769+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:36:03.221769+0000","last_undegraded":"2024-03-30T12:36:03.221769+0000","last_fullsized":"2024-03-30T12:36:03.221769+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220786+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:36:03.220786+0000","last_peered":"2024-03-30T12:36:03.220786+0000","last_clean":"2024-03-30T12:36:03.220786+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:36:03.220786+0000","last_undegraded":"2024-03-30T12:36:03.220786+0000","last_fullsized":"2024-03-30T12:36:03.220786+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221971+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:36:03.221971+0000","last_peered":"2024-03-30T12:36:03.221971+0000","last_clean":"2024-03-30T12:36:03.221971+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:36:03.221971+0000","last_undegraded":"2024-03-30T12:36:03.221971+0000","last_fullsized":"2024-03-30T12:36:03.221971+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017508+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:36:03.017508+0000","last_peered":"2024-03-30T12:36:03.017508+0000","last_clean":"2024-03-30T12:36:03.017508+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:36:03.017508+0000","last_undegraded":"2024-03-30T12:36:03.017508+0000","last_fullsized":"2024-03-30T12:36:03.017508+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546908+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:36:39.546908+0000","last_peered":"2024-03-30T12:36:39.546908+0000","last_clean":"2024-03-30T12:36:39.546908+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:36:39.546908+0000","last_undegraded":"2024-03-30T12:36:39.546908+0000","last_fullsized":"2024-03-30T12:36:39.546908+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546882+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:36:39.546882+0000","last_peered":"2024-03-30T12:36:39.546882+0000","last_clean":"2024-03-30T12:36:39.546882+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:36:39.546882+0000","last_undegraded":"2024-03-30T12:36:39.546882+0000","last_fullsized":"2024-03-30T12:36:39.546882+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1344,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:43.372738+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:36:43.372738+0000","last_peered":"2024-03-30T12:36:43.372738+0000","last_clean":"2024-03-30T12:36:43.372738+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:36:43.372738+0000","last_undegraded":"2024-03-30T12:36:43.372738+0000","last_fullsized":"2024-03-30T12:36:43.372738+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016619+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:36:03.016619+0000","last_peered":"2024-03-30T12:36:03.016619+0000","last_clean":"2024-03-30T12:36:03.016619+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:36:03.016619+0000","last_undegraded":"2024-03-30T12:36:03.016619+0000","last_fullsized":"2024-03-30T12:36:03.016619+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5752,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.367799+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:36:03.367799+0000","last_peered":"2024-03-30T12:36:03.367799+0000","last_clean":"2024-03-30T12:36:03.367799+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:36:03.367799+0000","last_undegraded":"2024-03-30T12:36:03.367799+0000","last_fullsized":"2024-03-30T12:36:03.367799+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020404+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:36:03.020404+0000","last_peered":"2024-03-30T12:36:03.020404+0000","last_clean":"2024-03-30T12:36:03.020404+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:36:03.020404+0000","last_undegraded":"2024-03-30T12:36:03.020404+0000","last_fullsized":"2024-03-30T12:36:03.020404+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018051+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:36:03.018051+0000","last_peered":"2024-03-30T12:36:03.018051+0000","last_clean":"2024-03-30T12:36:03.018051+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:36:03.018051+0000","last_undegraded":"2024-03-30T12:36:03.018051+0000","last_fullsized":"2024-03-30T12:36:03.018051+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5513,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:40.862481+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:36:40.862481+0000","last_peered":"2024-03-30T12:36:40.862481+0000","last_clean":"2024-03-30T12:36:40.862481+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:36:40.862481+0000","last_undegraded":"2024-03-30T12:36:40.862481+0000","last_fullsized":"2024-03-30T12:36:40.862481+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220604+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:36:03.220604+0000","last_peered":"2024-03-30T12:36:03.220604+0000","last_clean":"2024-03-30T12:36:03.220604+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:36:03.220604+0000","last_undegraded":"2024-03-30T12:36:03.220604+0000","last_fullsized":"2024-03-30T12:36:03.220604+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1346,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222463+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:36:03.222463+0000","last_peered":"2024-03-30T12:36:03.222463+0000","last_clean":"2024-03-30T12:36:03.222463+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:36:03.222463+0000","last_undegraded":"2024-03-30T12:36:03.222463+0000","last_fullsized":"2024-03-30T12:36:03.222463+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222511+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:36:03.222511+0000","last_peered":"2024-03-30T12:36:03.222511+0000","last_clean":"2024-03-30T12:36:03.222511+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:36:03.222511+0000","last_undegraded":"2024-03-30T12:36:03.222511+0000","last_fullsized":"2024-03-30T12:36:03.222511+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5458,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:40.862535+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:36:40.862535+0000","last_peered":"2024-03-30T12:36:40.862535+0000","last_clean":"2024-03-30T12:36:40.862535+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:36:40.862535+0000","last_undegraded":"2024-03-30T12:36:40.862535+0000","last_fullsized":"2024-03-30T12:36:40.862535+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222581+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:36:03.222581+0000","last_peered":"2024-03-30T12:36:03.222581+0000","last_clean":"2024-03-30T12:36:03.222581+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:36:03.222581+0000","last_undegraded":"2024-03-30T12:36:03.222581+0000","last_fullsized":"2024-03-30T12:36:03.222581+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221692+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:36:03.221692+0000","last_peered":"2024-03-30T12:36:03.221692+0000","last_clean":"2024-03-30T12:36:03.221692+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:36:03.221692+0000","last_undegraded":"2024-03-30T12:36:03.221692+0000","last_fullsized":"2024-03-30T12:36:03.221692+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1272,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:52.276088+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:36:52.276088+0000","last_peered":"2024-03-30T12:36:52.276088+0000","last_clean":"2024-03-30T12:36:52.276088+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:36:52.276088+0000","last_undegraded":"2024-03-30T12:36:52.276088+0000","last_fullsized":"2024-03-30T12:36:52.276088+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3803,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.367883+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:36:03.367883+0000","last_peered":"2024-03-30T12:36:03.367883+0000","last_clean":"2024-03-30T12:36:03.367883+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:36:03.367883+0000","last_undegraded":"2024-03-30T12:36:03.367883+0000","last_fullsized":"2024-03-30T12:36:03.367883+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1342,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222978+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:36:03.222978+0000","last_peered":"2024-03-30T12:36:03.222978+0000","last_clean":"2024-03-30T12:36:03.222978+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:36:03.222978+0000","last_undegraded":"2024-03-30T12:36:03.222978+0000","last_fullsized":"2024-03-30T12:36:03.222978+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:48.901383+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:36:48.901383+0000","last_peered":"2024-03-30T12:36:48.901383+0000","last_clean":"2024-03-30T12:36:48.901383+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:36:48.901383+0000","last_undegraded":"2024-03-30T12:36:48.901383+0000","last_fullsized":"2024-03-30T12:36:48.901383+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015232+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:36:03.015232+0000","last_peered":"2024-03-30T12:36:03.015232+0000","last_clean":"2024-03-30T12:36:03.015232+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:36:03.015232+0000","last_undegraded":"2024-03-30T12:36:03.015232+0000","last_fullsized":"2024-03-30T12:36:03.015232+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4576,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:34.124620+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:36:34.124620+0000","last_peered":"2024-03-30T12:36:34.124620+0000","last_clean":"2024-03-30T12:36:34.124620+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:36:34.124620+0000","last_undegraded":"2024-03-30T12:36:34.124620+0000","last_fullsized":"2024-03-30T12:36:34.124620+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1174,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220771+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:36:03.220771+0000","last_peered":"2024-03-30T12:36:03.220771+0000","last_clean":"2024-03-30T12:36:03.220771+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:36:03.220771+0000","last_undegraded":"2024-03-30T12:36:03.220771+0000","last_fullsized":"2024-03-30T12:36:03.220771+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:17.636728+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:36:17.636728+0000","last_peered":"2024-03-30T12:36:17.636728+0000","last_clean":"2024-03-30T12:36:17.636728+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:36:17.636728+0000","last_undegraded":"2024-03-30T12:36:17.636728+0000","last_fullsized":"2024-03-30T12:36:17.636728+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1199,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222181+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:36:03.222181+0000","last_peered":"2024-03-30T12:36:03.222181+0000","last_clean":"2024-03-30T12:36:03.222181+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:36:03.222181+0000","last_undegraded":"2024-03-30T12:36:03.222181+0000","last_fullsized":"2024-03-30T12:36:03.222181+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1716,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:19.123078+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:36:19.123078+0000","last_peered":"2024-03-30T12:36:19.123078+0000","last_clean":"2024-03-30T12:36:19.123078+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:36:19.123078+0000","last_undegraded":"2024-03-30T12:36:19.123078+0000","last_fullsized":"2024-03-30T12:36:19.123078+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24713,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223744+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:36:03.223744+0000","last_peered":"2024-03-30T12:36:03.223744+0000","last_clean":"2024-03-30T12:36:03.223744+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:36:03.223744+0000","last_undegraded":"2024-03-30T12:36:03.223744+0000","last_fullsized":"2024-03-30T12:36:03.223744+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:05.865263+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:37:05.865263+0000","last_peered":"2024-03-30T12:37:05.865263+0000","last_clean":"2024-03-30T12:37:05.865263+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:37:05.865263+0000","last_undegraded":"2024-03-30T12:37:05.865263+0000","last_fullsized":"2024-03-30T12:37:05.865263+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862413+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:36:40.862413+0000","last_peered":"2024-03-30T12:36:40.862413+0000","last_clean":"2024-03-30T12:36:40.862413+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:36:40.862413+0000","last_undegraded":"2024-03-30T12:36:40.862413+0000","last_fullsized":"2024-03-30T12:36:40.862413+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:19.123052+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:36:19.123052+0000","last_peered":"2024-03-30T12:36:19.123052+0000","last_clean":"2024-03-30T12:36:19.123052+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:36:19.123052+0000","last_undegraded":"2024-03-30T12:36:19.123052+0000","last_fullsized":"2024-03-30T12:36:19.123052+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16480,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.221717+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:36:03.221717+0000","last_peered":"2024-03-30T12:36:03.221717+0000","last_clean":"2024-03-30T12:36:03.221717+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:36:03.221717+0000","last_undegraded":"2024-03-30T12:36:03.221717+0000","last_fullsized":"2024-03-30T12:36:03.221717+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862510+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:36:40.862510+0000","last_peered":"2024-03-30T12:36:40.862510+0000","last_clean":"2024-03-30T12:36:40.862510+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:36:40.862510+0000","last_undegraded":"2024-03-30T12:36:40.862510+0000","last_fullsized":"2024-03-30T12:36:40.862510+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:34.124667+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:36:34.124667+0000","last_peered":"2024-03-30T12:36:34.124667+0000","last_clean":"2024-03-30T12:36:34.124667+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:36:34.124667+0000","last_undegraded":"2024-03-30T12:36:34.124667+0000","last_fullsized":"2024-03-30T12:36:34.124667+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222675+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:36:03.222675+0000","last_peered":"2024-03-30T12:36:03.222675+0000","last_clean":"2024-03-30T12:36:03.222675+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:36:03.222675+0000","last_undegraded":"2024-03-30T12:36:03.222675+0000","last_fullsized":"2024-03-30T12:36:03.222675+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31269,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:52.276052+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:36:52.276052+0000","last_peered":"2024-03-30T12:36:52.276052+0000","last_clean":"2024-03-30T12:36:52.276052+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:36:52.276052+0000","last_undegraded":"2024-03-30T12:36:52.276052+0000","last_fullsized":"2024-03-30T12:36:52.276052+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1294,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219916+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:36:03.219916+0000","last_peered":"2024-03-30T12:36:03.219916+0000","last_clean":"2024-03-30T12:36:03.219916+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:36:03.219916+0000","last_undegraded":"2024-03-30T12:36:03.219916+0000","last_fullsized":"2024-03-30T12:36:03.219916+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221733+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:36:03.221733+0000","last_peered":"2024-03-30T12:36:03.221733+0000","last_clean":"2024-03-30T12:36:03.221733+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:36:03.221733+0000","last_undegraded":"2024-03-30T12:36:03.221733+0000","last_fullsized":"2024-03-30T12:36:03.221733+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638999+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:36:37.638999+0000","last_peered":"2024-03-30T12:36:37.638999+0000","last_clean":"2024-03-30T12:36:37.638999+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:36:37.638999+0000","last_undegraded":"2024-03-30T12:36:37.638999+0000","last_fullsized":"2024-03-30T12:36:37.638999+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3764,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220021+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:36:03.220021+0000","last_peered":"2024-03-30T12:36:03.220021+0000","last_clean":"2024-03-30T12:36:03.220021+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:36:03.220021+0000","last_undegraded":"2024-03-30T12:36:03.220021+0000","last_fullsized":"2024-03-30T12:36:03.220021+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:52.276014+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:36:52.276014+0000","last_peered":"2024-03-30T12:36:52.276014+0000","last_clean":"2024-03-30T12:36:52.276014+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:36:52.276014+0000","last_undegraded":"2024-03-30T12:36:52.276014+0000","last_fullsized":"2024-03-30T12:36:52.276014+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544094+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:36:09.544094+0000","last_peered":"2024-03-30T12:36:09.544094+0000","last_clean":"2024-03-30T12:36:09.544094+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:36:09.544094+0000","last_undegraded":"2024-03-30T12:36:09.544094+0000","last_fullsized":"2024-03-30T12:36:09.544094+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:05.865242+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:37:05.865242+0000","last_peered":"2024-03-30T12:37:05.865242+0000","last_clean":"2024-03-30T12:37:05.865242+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:37:05.865242+0000","last_undegraded":"2024-03-30T12:37:05.865242+0000","last_fullsized":"2024-03-30T12:37:05.865242+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15593,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223541+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:36:03.223541+0000","last_peered":"2024-03-30T12:36:03.223541+0000","last_clean":"2024-03-30T12:36:03.223541+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:36:03.223541+0000","last_undegraded":"2024-03-30T12:36:03.223541+0000","last_fullsized":"2024-03-30T12:36:03.223541+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1143,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:49.126219+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:36:49.126219+0000","last_peered":"2024-03-30T12:36:49.126219+0000","last_clean":"2024-03-30T12:36:49.126219+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:36:49.126219+0000","last_undegraded":"2024-03-30T12:36:49.126219+0000","last_fullsized":"2024-03-30T12:36:49.126219+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1257,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018978+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:36:03.018978+0000","last_peered":"2024-03-30T12:36:03.018978+0000","last_clean":"2024-03-30T12:36:03.018978+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:36:03.018978+0000","last_undegraded":"2024-03-30T12:36:03.018978+0000","last_fullsized":"2024-03-30T12:36:03.018978+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29019,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.020881+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:36:03.020881+0000","last_peered":"2024-03-30T12:36:03.020881+0000","last_clean":"2024-03-30T12:36:03.020881+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:36:03.020881+0000","last_undegraded":"2024-03-30T12:36:03.020881+0000","last_fullsized":"2024-03-30T12:36:03.020881+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222681+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:36:03.222681+0000","last_peered":"2024-03-30T12:36:03.222681+0000","last_clean":"2024-03-30T12:36:03.222681+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:36:03.222681+0000","last_undegraded":"2024-03-30T12:36:03.222681+0000","last_fullsized":"2024-03-30T12:36:03.222681+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638944+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:36:37.638944+0000","last_peered":"2024-03-30T12:36:37.638944+0000","last_clean":"2024-03-30T12:36:37.638944+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:36:37.638944+0000","last_undegraded":"2024-03-30T12:36:37.638944+0000","last_fullsized":"2024-03-30T12:36:37.638944+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5610,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:23.370279+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:36:23.370279+0000","last_peered":"2024-03-30T12:36:23.370279+0000","last_clean":"2024-03-30T12:36:23.370279+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:36:23.370279+0000","last_undegraded":"2024-03-30T12:36:23.370279+0000","last_fullsized":"2024-03-30T12:36:23.370279+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1364,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220455+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:36:03.220455+0000","last_peered":"2024-03-30T12:36:03.220455+0000","last_clean":"2024-03-30T12:36:03.220455+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:36:03.220455+0000","last_undegraded":"2024-03-30T12:36:03.220455+0000","last_fullsized":"2024-03-30T12:36:03.220455+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:57.641061+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:57.641061+0000","last_peered":"2024-03-30T12:36:57.641061+0000","last_clean":"2024-03-30T12:36:57.641061+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:57.641061+0000","last_undegraded":"2024-03-30T12:36:57.641061+0000","last_fullsized":"2024-03-30T12:36:57.641061+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222932+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:36:03.222932+0000","last_peered":"2024-03-30T12:36:03.222932+0000","last_clean":"2024-03-30T12:36:03.222932+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:36:03.222932+0000","last_undegraded":"2024-03-30T12:36:03.222932+0000","last_fullsized":"2024-03-30T12:36:03.222932+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017355+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:36:03.017355+0000","last_peered":"2024-03-30T12:36:03.017355+0000","last_clean":"2024-03-30T12:36:03.017355+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:36:03.017355+0000","last_undegraded":"2024-03-30T12:36:03.017355+0000","last_fullsized":"2024-03-30T12:36:03.017355+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544025+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:36:09.544025+0000","last_peered":"2024-03-30T12:36:09.544025+0000","last_clean":"2024-03-30T12:36:09.544025+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:36:09.544025+0000","last_undegraded":"2024-03-30T12:36:09.544025+0000","last_fullsized":"2024-03-30T12:36:09.544025+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5253,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:23.370200+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:36:23.370200+0000","last_peered":"2024-03-30T12:36:23.370200+0000","last_clean":"2024-03-30T12:36:23.370200+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:36:23.370200+0000","last_undegraded":"2024-03-30T12:36:23.370200+0000","last_fullsized":"2024-03-30T12:36:23.370200+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:23.370243+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:36:23.370243+0000","last_peered":"2024-03-30T12:36:23.370243+0000","last_clean":"2024-03-30T12:36:23.370243+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:36:23.370243+0000","last_undegraded":"2024-03-30T12:36:23.370243+0000","last_fullsized":"2024-03-30T12:36:23.370243+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017799+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:36:03.017799+0000","last_peered":"2024-03-30T12:36:03.017799+0000","last_clean":"2024-03-30T12:36:03.017799+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:36:03.017799+0000","last_undegraded":"2024-03-30T12:36:03.017799+0000","last_fullsized":"2024-03-30T12:36:03.017799+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4810,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.367842+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:36:03.367842+0000","last_peered":"2024-03-30T12:36:03.367842+0000","last_clean":"2024-03-30T12:36:03.367842+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:36:03.367842+0000","last_undegraded":"2024-03-30T12:36:03.367842+0000","last_fullsized":"2024-03-30T12:36:03.367842+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220953+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:36:03.220953+0000","last_peered":"2024-03-30T12:36:03.220953+0000","last_clean":"2024-03-30T12:36:03.220953+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:36:03.220953+0000","last_undegraded":"2024-03-30T12:36:03.220953+0000","last_fullsized":"2024-03-30T12:36:03.220953+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222608+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:36:03.222608+0000","last_peered":"2024-03-30T12:36:03.222608+0000","last_clean":"2024-03-30T12:36:03.222608+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:36:03.222608+0000","last_undegraded":"2024-03-30T12:36:03.222608+0000","last_fullsized":"2024-03-30T12:36:03.222608+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6743,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:49.126256+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:36:49.126256+0000","last_peered":"2024-03-30T12:36:49.126256+0000","last_clean":"2024-03-30T12:36:49.126256+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:36:49.126256+0000","last_undegraded":"2024-03-30T12:36:49.126256+0000","last_fullsized":"2024-03-30T12:36:49.126256+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1337,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:23.370314+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:36:23.370314+0000","last_peered":"2024-03-30T12:36:23.370314+0000","last_clean":"2024-03-30T12:36:23.370314+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:36:23.370314+0000","last_undegraded":"2024-03-30T12:36:23.370314+0000","last_fullsized":"2024-03-30T12:36:23.370314+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018917+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:36:03.018917+0000","last_peered":"2024-03-30T12:36:03.018917+0000","last_clean":"2024-03-30T12:36:03.018917+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:36:03.018917+0000","last_undegraded":"2024-03-30T12:36:03.018917+0000","last_fullsized":"2024-03-30T12:36:03.018917+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220179+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:36:03.220179+0000","last_peered":"2024-03-30T12:36:03.220179+0000","last_clean":"2024-03-30T12:36:03.220179+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:36:03.220179+0000","last_undegraded":"2024-03-30T12:36:03.220179+0000","last_fullsized":"2024-03-30T12:36:03.220179+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015330+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:36:03.015330+0000","last_peered":"2024-03-30T12:36:03.015330+0000","last_clean":"2024-03-30T12:36:03.015330+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:36:03.015330+0000","last_undegraded":"2024-03-30T12:36:03.015330+0000","last_fullsized":"2024-03-30T12:36:03.015330+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221954+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:36:03.221954+0000","last_peered":"2024-03-30T12:36:03.221954+0000","last_clean":"2024-03-30T12:36:03.221954+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:36:03.221954+0000","last_undegraded":"2024-03-30T12:36:03.221954+0000","last_fullsized":"2024-03-30T12:36:03.221954+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862462+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:36:40.862462+0000","last_peered":"2024-03-30T12:36:40.862462+0000","last_clean":"2024-03-30T12:36:40.862462+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:36:40.862462+0000","last_undegraded":"2024-03-30T12:36:40.862462+0000","last_fullsized":"2024-03-30T12:36:40.862462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638978+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:36:37.638978+0000","last_peered":"2024-03-30T12:36:37.638978+0000","last_clean":"2024-03-30T12:36:37.638978+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:36:37.638978+0000","last_undegraded":"2024-03-30T12:36:37.638978+0000","last_fullsized":"2024-03-30T12:36:37.638978+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221044+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:36:03.221044+0000","last_peered":"2024-03-30T12:36:03.221044+0000","last_clean":"2024-03-30T12:36:03.221044+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:36:03.221044+0000","last_undegraded":"2024-03-30T12:36:03.221044+0000","last_fullsized":"2024-03-30T12:36:03.221044+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1177,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544079+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:36:09.544079+0000","last_peered":"2024-03-30T12:36:09.544079+0000","last_clean":"2024-03-30T12:36:09.544079+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:36:09.544079+0000","last_undegraded":"2024-03-30T12:36:09.544079+0000","last_fullsized":"2024-03-30T12:36:09.544079+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1281,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.639015+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:36:37.639015+0000","last_peered":"2024-03-30T12:36:37.639015+0000","last_clean":"2024-03-30T12:36:37.639015+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:36:37.639015+0000","last_undegraded":"2024-03-30T12:36:37.639015+0000","last_fullsized":"2024-03-30T12:36:37.639015+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221612+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:36:03.221612+0000","last_peered":"2024-03-30T12:36:03.221612+0000","last_clean":"2024-03-30T12:36:03.221612+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:36:03.221612+0000","last_undegraded":"2024-03-30T12:36:03.221612+0000","last_fullsized":"2024-03-30T12:36:03.221612+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:57.641040+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:57.641040+0000","last_peered":"2024-03-30T12:36:57.641040+0000","last_clean":"2024-03-30T12:36:57.641040+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:57.641040+0000","last_undegraded":"2024-03-30T12:36:57.641040+0000","last_fullsized":"2024-03-30T12:36:57.641040+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221610+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:36:03.221610+0000","last_peered":"2024-03-30T12:36:03.221610+0000","last_clean":"2024-03-30T12:36:03.221610+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:36:03.221610+0000","last_undegraded":"2024-03-30T12:36:03.221610+0000","last_fullsized":"2024-03-30T12:36:03.221610+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220926+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:36:03.220926+0000","last_peered":"2024-03-30T12:36:03.220926+0000","last_clean":"2024-03-30T12:36:03.220926+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:36:03.220926+0000","last_undegraded":"2024-03-30T12:36:03.220926+0000","last_fullsized":"2024-03-30T12:36:03.220926+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:24.545379+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:36:24.545379+0000","last_peered":"2024-03-30T12:36:24.545379+0000","last_clean":"2024-03-30T12:36:24.545379+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:36:24.545379+0000","last_undegraded":"2024-03-30T12:36:24.545379+0000","last_fullsized":"2024-03-30T12:36:24.545379+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438060,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648116,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175126,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254365,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063184,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951241,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839298,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923580,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:39:20.931 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:20.931 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:20.931 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:20.931 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:20.932 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:20.932 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:20.932 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:20.932 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:20.932 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:20.932 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:20.932 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:20.932 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:20.932 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:20.932 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:39:21.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:21 smithi084 ceph-mon[89279]: from='client.34602 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:39:21.753 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:21 smithi084 ceph-mon[91810]: from='client.34602 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:39:21.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:21 smithi162 ceph-mon[83709]: from='client.34602 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:39:22.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:22 smithi162 ceph-mon[83709]: pgmap v1089: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:23.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:22 smithi084 ceph-mon[91810]: pgmap v1089: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:23.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:22 smithi084 ceph-mon[89279]: pgmap v1089: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:24.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:24 smithi162 ceph-mon[83709]: pgmap v1090: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:25.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:24 smithi084 ceph-mon[91810]: pgmap v1090: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:25.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:24 smithi084 ceph-mon[89279]: pgmap v1090: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:27.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:26 smithi162 ceph-mon[83709]: pgmap v1091: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:27.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:26 smithi084 ceph-mon[91810]: pgmap v1091: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:27.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:26 smithi084 ceph-mon[89279]: pgmap v1091: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:29.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:28 smithi162 ceph-mon[83709]: pgmap v1092: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:29.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:28 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:39:29.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:28 smithi084 ceph-mon[89279]: pgmap v1092: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:29.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:28 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:39:29.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:28 smithi084 ceph-mon[91810]: pgmap v1092: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:29.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:28 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:39:29.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:39:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:39:29] "GET /metrics HTTP/1.1" 200 36322 "" "Prometheus/2.43.0" 2024-03-30T12:39:30.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:29 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:39:30.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:29 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:39:30.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:29 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:39:30.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:29 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:39:30.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:29 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:39:30.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:29 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:39:30.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:29 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:39:30.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:29 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:39:30.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:29 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:39:30.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:29 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:39:30.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:29 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:39:30.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:29 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:39:30.933 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:39:31.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:30 smithi162 ceph-mon[83709]: pgmap v1093: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:31.150 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:39:31.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:30 smithi084 ceph-mon[91810]: pgmap v1093: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:31.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:30 smithi084 ceph-mon[89279]: pgmap v1093: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:33.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:32 smithi084 ceph-mon[91810]: pgmap v1094: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:33.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:32 smithi084 ceph-mon[89279]: pgmap v1094: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:33.061 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:39:33.064 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:39:33.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:32 smithi162 ceph-mon[83709]: pgmap v1094: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:33.821 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1095,"stamp":"2024-03-30T12:39:32.864157+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003823"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:34.124688+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:36:34.124688+0000","last_peered":"2024-03-30T12:36:34.124688+0000","last_clean":"2024-03-30T12:36:34.124688+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:36:34.124688+0000","last_undegraded":"2024-03-30T12:36:34.124688+0000","last_fullsized":"2024-03-30T12:36:34.124688+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1364,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904373+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:37:13.904373+0000","last_peered":"2024-03-30T12:37:13.904373+0000","last_clean":"2024-03-30T12:37:13.904373+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:37:13.904373+0000","last_undegraded":"2024-03-30T12:37:13.904373+0000","last_fullsized":"2024-03-30T12:37:13.904373+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862523+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:36:40.862523+0000","last_peered":"2024-03-30T12:36:40.862523+0000","last_clean":"2024-03-30T12:36:40.862523+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:36:40.862523+0000","last_undegraded":"2024-03-30T12:36:40.862523+0000","last_fullsized":"2024-03-30T12:36:40.862523+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:00.294130+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:37:00.294130+0000","last_peered":"2024-03-30T12:37:00.294130+0000","last_clean":"2024-03-30T12:37:00.294130+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:37:00.294130+0000","last_undegraded":"2024-03-30T12:37:00.294130+0000","last_fullsized":"2024-03-30T12:37:00.294130+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016863+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:36:03.016863+0000","last_peered":"2024-03-30T12:36:03.016863+0000","last_clean":"2024-03-30T12:36:03.016863+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:36:03.016863+0000","last_undegraded":"2024-03-30T12:36:03.016863+0000","last_fullsized":"2024-03-30T12:36:03.016863+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1210,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290374+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:30.290374+0000","last_peered":"2024-03-30T12:36:30.290374+0000","last_clean":"2024-03-30T12:36:30.290374+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:30.290374+0000","last_undegraded":"2024-03-30T12:36:30.290374+0000","last_fullsized":"2024-03-30T12:36:30.290374+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017365+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:36:03.017365+0000","last_peered":"2024-03-30T12:36:03.017365+0000","last_clean":"2024-03-30T12:36:03.017365+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:36:03.017365+0000","last_undegraded":"2024-03-30T12:36:03.017365+0000","last_fullsized":"2024-03-30T12:36:03.017365+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219781+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:36:03.219781+0000","last_peered":"2024-03-30T12:36:03.219781+0000","last_clean":"2024-03-30T12:36:03.219781+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:36:03.219781+0000","last_undegraded":"2024-03-30T12:36:03.219781+0000","last_fullsized":"2024-03-30T12:36:03.219781+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018011+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:36:03.018011+0000","last_peered":"2024-03-30T12:36:03.018011+0000","last_clean":"2024-03-30T12:36:03.018011+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:36:03.018011+0000","last_undegraded":"2024-03-30T12:36:03.018011+0000","last_fullsized":"2024-03-30T12:36:03.018011+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548505+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:54.548505+0000","last_peered":"2024-03-30T12:36:54.548505+0000","last_clean":"2024-03-30T12:36:54.548505+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:54.548505+0000","last_undegraded":"2024-03-30T12:36:54.548505+0000","last_fullsized":"2024-03-30T12:36:54.548505+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548476+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:54.548476+0000","last_peered":"2024-03-30T12:36:54.548476+0000","last_clean":"2024-03-30T12:36:54.548476+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:54.548476+0000","last_undegraded":"2024-03-30T12:36:54.548476+0000","last_fullsized":"2024-03-30T12:36:54.548476+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1270,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020253+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:36:03.020253+0000","last_peered":"2024-03-30T12:36:03.020253+0000","last_clean":"2024-03-30T12:36:03.020253+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:36:03.020253+0000","last_undegraded":"2024-03-30T12:36:03.020253+0000","last_fullsized":"2024-03-30T12:36:03.020253+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221688+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:36:03.221688+0000","last_peered":"2024-03-30T12:36:03.221688+0000","last_clean":"2024-03-30T12:36:03.221688+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:36:03.221688+0000","last_undegraded":"2024-03-30T12:36:03.221688+0000","last_fullsized":"2024-03-30T12:36:03.221688+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220487+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:36:03.220487+0000","last_peered":"2024-03-30T12:36:03.220487+0000","last_clean":"2024-03-30T12:36:03.220487+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:36:03.220487+0000","last_undegraded":"2024-03-30T12:36:03.220487+0000","last_fullsized":"2024-03-30T12:36:03.220487+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:08.897219+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:36:08.897219+0000","last_peered":"2024-03-30T12:36:08.897219+0000","last_clean":"2024-03-30T12:36:08.897219+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:36:08.897219+0000","last_undegraded":"2024-03-30T12:36:08.897219+0000","last_fullsized":"2024-03-30T12:36:08.897219+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1213,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221481+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:36:03.221481+0000","last_peered":"2024-03-30T12:36:03.221481+0000","last_clean":"2024-03-30T12:36:03.221481+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:36:03.221481+0000","last_undegraded":"2024-03-30T12:36:03.221481+0000","last_fullsized":"2024-03-30T12:36:03.221481+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1224,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.223011+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:36:03.223011+0000","last_peered":"2024-03-30T12:36:03.223011+0000","last_clean":"2024-03-30T12:36:03.223011+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:36:03.223011+0000","last_undegraded":"2024-03-30T12:36:03.223011+0000","last_fullsized":"2024-03-30T12:36:03.223011+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:43.372790+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:36:43.372790+0000","last_peered":"2024-03-30T12:36:43.372790+0000","last_clean":"2024-03-30T12:36:43.372790+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:36:43.372790+0000","last_undegraded":"2024-03-30T12:36:43.372790+0000","last_fullsized":"2024-03-30T12:36:43.372790+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128028+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:37:04.128028+0000","last_peered":"2024-03-30T12:37:04.128028+0000","last_clean":"2024-03-30T12:37:04.128028+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:37:04.128028+0000","last_undegraded":"2024-03-30T12:37:04.128028+0000","last_fullsized":"2024-03-30T12:37:04.128028+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1388,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862565+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:36:40.862565+0000","last_peered":"2024-03-30T12:36:40.862565+0000","last_clean":"2024-03-30T12:36:40.862565+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:36:40.862565+0000","last_undegraded":"2024-03-30T12:36:40.862565+0000","last_fullsized":"2024-03-30T12:36:40.862565+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1282,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220823+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:36:03.220823+0000","last_peered":"2024-03-30T12:36:03.220823+0000","last_clean":"2024-03-30T12:36:03.220823+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:36:03.220823+0000","last_undegraded":"2024-03-30T12:36:03.220823+0000","last_fullsized":"2024-03-30T12:36:03.220823+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1301,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221016+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:36:03.221016+0000","last_peered":"2024-03-30T12:36:03.221016+0000","last_clean":"2024-03-30T12:36:03.221016+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:36:03.221016+0000","last_undegraded":"2024-03-30T12:36:03.221016+0000","last_fullsized":"2024-03-30T12:36:03.221016+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862552+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:36:40.862552+0000","last_peered":"2024-03-30T12:36:40.862552+0000","last_clean":"2024-03-30T12:36:40.862552+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:36:40.862552+0000","last_undegraded":"2024-03-30T12:36:40.862552+0000","last_fullsized":"2024-03-30T12:36:40.862552+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018097+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:36:03.018097+0000","last_peered":"2024-03-30T12:36:03.018097+0000","last_clean":"2024-03-30T12:36:03.018097+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:36:03.018097+0000","last_undegraded":"2024-03-30T12:36:03.018097+0000","last_fullsized":"2024-03-30T12:36:03.018097+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1229,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290400+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:30.290400+0000","last_peered":"2024-03-30T12:36:30.290400+0000","last_clean":"2024-03-30T12:36:30.290400+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:30.290400+0000","last_undegraded":"2024-03-30T12:36:30.290400+0000","last_fullsized":"2024-03-30T12:36:30.290400+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017698+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:36:03.017698+0000","last_peered":"2024-03-30T12:36:03.017698+0000","last_clean":"2024-03-30T12:36:03.017698+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:36:03.017698+0000","last_undegraded":"2024-03-30T12:36:03.017698+0000","last_fullsized":"2024-03-30T12:36:03.017698+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1213,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290416+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:30.290416+0000","last_peered":"2024-03-30T12:36:30.290416+0000","last_clean":"2024-03-30T12:36:30.290416+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:30.290416+0000","last_undegraded":"2024-03-30T12:36:30.290416+0000","last_fullsized":"2024-03-30T12:36:30.290416+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221852+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:36:03.221852+0000","last_peered":"2024-03-30T12:36:03.221852+0000","last_clean":"2024-03-30T12:36:03.221852+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:36:03.221852+0000","last_undegraded":"2024-03-30T12:36:03.221852+0000","last_fullsized":"2024-03-30T12:36:03.221852+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018910+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:36:03.018910+0000","last_peered":"2024-03-30T12:36:03.018910+0000","last_clean":"2024-03-30T12:36:03.018910+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:36:03.018910+0000","last_undegraded":"2024-03-30T12:36:03.018910+0000","last_fullsized":"2024-03-30T12:36:03.018910+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1179,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220575+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:36:03.220575+0000","last_peered":"2024-03-30T12:36:03.220575+0000","last_clean":"2024-03-30T12:36:03.220575+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:36:03.220575+0000","last_undegraded":"2024-03-30T12:36:03.220575+0000","last_fullsized":"2024-03-30T12:36:03.220575+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.860010+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:36:15.860010+0000","last_peered":"2024-03-30T12:36:15.860010+0000","last_clean":"2024-03-30T12:36:15.860010+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:36:15.860010+0000","last_undegraded":"2024-03-30T12:36:15.860010+0000","last_fullsized":"2024-03-30T12:36:15.860010+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219839+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:36:03.219839+0000","last_peered":"2024-03-30T12:36:03.219839+0000","last_clean":"2024-03-30T12:36:03.219839+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:36:03.219839+0000","last_undegraded":"2024-03-30T12:36:03.219839+0000","last_fullsized":"2024-03-30T12:36:03.219839+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1294,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219823+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:36:03.219823+0000","last_peered":"2024-03-30T12:36:03.219823+0000","last_clean":"2024-03-30T12:36:03.219823+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:36:03.219823+0000","last_undegraded":"2024-03-30T12:36:03.219823+0000","last_fullsized":"2024-03-30T12:36:03.219823+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1224,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288884+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:36:15.288884+0000","last_peered":"2024-03-30T12:36:15.288884+0000","last_clean":"2024-03-30T12:36:15.288884+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:36:15.288884+0000","last_undegraded":"2024-03-30T12:36:15.288884+0000","last_fullsized":"2024-03-30T12:36:15.288884+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:28.899208+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:36:28.899208+0000","last_peered":"2024-03-30T12:36:28.899208+0000","last_clean":"2024-03-30T12:36:28.899208+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:36:28.899208+0000","last_undegraded":"2024-03-30T12:36:28.899208+0000","last_fullsized":"2024-03-30T12:36:28.899208+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548518+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:54.548518+0000","last_peered":"2024-03-30T12:36:54.548518+0000","last_clean":"2024-03-30T12:36:54.548518+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:54.548518+0000","last_undegraded":"2024-03-30T12:36:54.548518+0000","last_fullsized":"2024-03-30T12:36:54.548518+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1204,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288944+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:36:15.288944+0000","last_peered":"2024-03-30T12:36:15.288944+0000","last_clean":"2024-03-30T12:36:15.288944+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:36:15.288944+0000","last_undegraded":"2024-03-30T12:36:15.288944+0000","last_fullsized":"2024-03-30T12:36:15.288944+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1198,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288933+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:36:15.288933+0000","last_peered":"2024-03-30T12:36:15.288933+0000","last_clean":"2024-03-30T12:36:15.288933+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:36:15.288933+0000","last_undegraded":"2024-03-30T12:36:15.288933+0000","last_fullsized":"2024-03-30T12:36:15.288933+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:03.374890+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:37:03.374890+0000","last_peered":"2024-03-30T12:37:03.374890+0000","last_clean":"2024-03-30T12:37:03.374890+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:37:03.374890+0000","last_undegraded":"2024-03-30T12:37:03.374890+0000","last_fullsized":"2024-03-30T12:37:03.374890+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:28.899251+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:36:28.899251+0000","last_peered":"2024-03-30T12:36:28.899251+0000","last_clean":"2024-03-30T12:36:28.899251+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:36:28.899251+0000","last_undegraded":"2024-03-30T12:36:28.899251+0000","last_fullsized":"2024-03-30T12:36:28.899251+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020091+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:36:03.020091+0000","last_peered":"2024-03-30T12:36:03.020091+0000","last_clean":"2024-03-30T12:36:03.020091+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:36:03.020091+0000","last_undegraded":"2024-03-30T12:36:03.020091+0000","last_fullsized":"2024-03-30T12:36:03.020091+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546935+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:36:39.546935+0000","last_peered":"2024-03-30T12:36:39.546935+0000","last_clean":"2024-03-30T12:36:39.546935+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:36:39.546935+0000","last_undegraded":"2024-03-30T12:36:39.546935+0000","last_fullsized":"2024-03-30T12:36:39.546935+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017435+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:36:03.017435+0000","last_peered":"2024-03-30T12:36:03.017435+0000","last_clean":"2024-03-30T12:36:03.017435+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:36:03.017435+0000","last_undegraded":"2024-03-30T12:36:03.017435+0000","last_fullsized":"2024-03-30T12:36:03.017435+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221769+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:36:03.221769+0000","last_peered":"2024-03-30T12:36:03.221769+0000","last_clean":"2024-03-30T12:36:03.221769+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:36:03.221769+0000","last_undegraded":"2024-03-30T12:36:03.221769+0000","last_fullsized":"2024-03-30T12:36:03.221769+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220786+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:36:03.220786+0000","last_peered":"2024-03-30T12:36:03.220786+0000","last_clean":"2024-03-30T12:36:03.220786+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:36:03.220786+0000","last_undegraded":"2024-03-30T12:36:03.220786+0000","last_fullsized":"2024-03-30T12:36:03.220786+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221971+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:36:03.221971+0000","last_peered":"2024-03-30T12:36:03.221971+0000","last_clean":"2024-03-30T12:36:03.221971+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:36:03.221971+0000","last_undegraded":"2024-03-30T12:36:03.221971+0000","last_fullsized":"2024-03-30T12:36:03.221971+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017508+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:36:03.017508+0000","last_peered":"2024-03-30T12:36:03.017508+0000","last_clean":"2024-03-30T12:36:03.017508+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:36:03.017508+0000","last_undegraded":"2024-03-30T12:36:03.017508+0000","last_fullsized":"2024-03-30T12:36:03.017508+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546908+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:36:39.546908+0000","last_peered":"2024-03-30T12:36:39.546908+0000","last_clean":"2024-03-30T12:36:39.546908+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:36:39.546908+0000","last_undegraded":"2024-03-30T12:36:39.546908+0000","last_fullsized":"2024-03-30T12:36:39.546908+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546882+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:36:39.546882+0000","last_peered":"2024-03-30T12:36:39.546882+0000","last_clean":"2024-03-30T12:36:39.546882+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:36:39.546882+0000","last_undegraded":"2024-03-30T12:36:39.546882+0000","last_fullsized":"2024-03-30T12:36:39.546882+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1344,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:43.372738+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:36:43.372738+0000","last_peered":"2024-03-30T12:36:43.372738+0000","last_clean":"2024-03-30T12:36:43.372738+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:36:43.372738+0000","last_undegraded":"2024-03-30T12:36:43.372738+0000","last_fullsized":"2024-03-30T12:36:43.372738+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016619+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:36:03.016619+0000","last_peered":"2024-03-30T12:36:03.016619+0000","last_clean":"2024-03-30T12:36:03.016619+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:36:03.016619+0000","last_undegraded":"2024-03-30T12:36:03.016619+0000","last_fullsized":"2024-03-30T12:36:03.016619+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5752,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.367799+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:36:03.367799+0000","last_peered":"2024-03-30T12:36:03.367799+0000","last_clean":"2024-03-30T12:36:03.367799+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:36:03.367799+0000","last_undegraded":"2024-03-30T12:36:03.367799+0000","last_fullsized":"2024-03-30T12:36:03.367799+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020404+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:36:03.020404+0000","last_peered":"2024-03-30T12:36:03.020404+0000","last_clean":"2024-03-30T12:36:03.020404+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:36:03.020404+0000","last_undegraded":"2024-03-30T12:36:03.020404+0000","last_fullsized":"2024-03-30T12:36:03.020404+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128039+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:37:04.128039+0000","last_peered":"2024-03-30T12:37:04.128039+0000","last_clean":"2024-03-30T12:37:04.128039+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:37:04.128039+0000","last_undegraded":"2024-03-30T12:37:04.128039+0000","last_fullsized":"2024-03-30T12:37:04.128039+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5513,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:40.862481+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:36:40.862481+0000","last_peered":"2024-03-30T12:36:40.862481+0000","last_clean":"2024-03-30T12:36:40.862481+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:36:40.862481+0000","last_undegraded":"2024-03-30T12:36:40.862481+0000","last_fullsized":"2024-03-30T12:36:40.862481+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904270+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:37:13.904270+0000","last_peered":"2024-03-30T12:37:13.904270+0000","last_clean":"2024-03-30T12:37:13.904270+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:37:13.904270+0000","last_undegraded":"2024-03-30T12:37:13.904270+0000","last_fullsized":"2024-03-30T12:37:13.904270+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904297+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:37:13.904297+0000","last_peered":"2024-03-30T12:37:13.904297+0000","last_clean":"2024-03-30T12:37:13.904297+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:37:13.904297+0000","last_undegraded":"2024-03-30T12:37:13.904297+0000","last_fullsized":"2024-03-30T12:37:13.904297+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296466+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:37:20.296466+0000","last_peered":"2024-03-30T12:37:20.296466+0000","last_clean":"2024-03-30T12:37:20.296466+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:37:20.296466+0000","last_undegraded":"2024-03-30T12:37:20.296466+0000","last_fullsized":"2024-03-30T12:37:20.296466+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5458,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:40.862535+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:36:40.862535+0000","last_peered":"2024-03-30T12:36:40.862535+0000","last_clean":"2024-03-30T12:36:40.862535+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:36:40.862535+0000","last_undegraded":"2024-03-30T12:36:40.862535+0000","last_fullsized":"2024-03-30T12:36:40.862535+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904314+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:37:13.904314+0000","last_peered":"2024-03-30T12:37:13.904314+0000","last_clean":"2024-03-30T12:37:13.904314+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:37:13.904314+0000","last_undegraded":"2024-03-30T12:37:13.904314+0000","last_fullsized":"2024-03-30T12:37:13.904314+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1207,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296362+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:37:20.296362+0000","last_peered":"2024-03-30T12:37:20.296362+0000","last_clean":"2024-03-30T12:37:20.296362+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:37:20.296362+0000","last_undegraded":"2024-03-30T12:37:20.296362+0000","last_fullsized":"2024-03-30T12:37:20.296362+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1272,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:52.276088+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:36:52.276088+0000","last_peered":"2024-03-30T12:36:52.276088+0000","last_clean":"2024-03-30T12:36:52.276088+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:36:52.276088+0000","last_undegraded":"2024-03-30T12:36:52.276088+0000","last_fullsized":"2024-03-30T12:36:52.276088+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3803,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.367883+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:36:03.367883+0000","last_peered":"2024-03-30T12:36:03.367883+0000","last_clean":"2024-03-30T12:36:03.367883+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:36:03.367883+0000","last_undegraded":"2024-03-30T12:36:03.367883+0000","last_fullsized":"2024-03-30T12:36:03.367883+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1342,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222978+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:36:03.222978+0000","last_peered":"2024-03-30T12:36:03.222978+0000","last_clean":"2024-03-30T12:36:03.222978+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:36:03.222978+0000","last_undegraded":"2024-03-30T12:36:03.222978+0000","last_fullsized":"2024-03-30T12:36:03.222978+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:48.901383+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:36:48.901383+0000","last_peered":"2024-03-30T12:36:48.901383+0000","last_clean":"2024-03-30T12:36:48.901383+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:36:48.901383+0000","last_undegraded":"2024-03-30T12:36:48.901383+0000","last_fullsized":"2024-03-30T12:36:48.901383+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015232+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:36:03.015232+0000","last_peered":"2024-03-30T12:36:03.015232+0000","last_clean":"2024-03-30T12:36:03.015232+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:36:03.015232+0000","last_undegraded":"2024-03-30T12:36:03.015232+0000","last_fullsized":"2024-03-30T12:36:03.015232+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4576,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:34.124620+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:36:34.124620+0000","last_peered":"2024-03-30T12:36:34.124620+0000","last_clean":"2024-03-30T12:36:34.124620+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:36:34.124620+0000","last_undegraded":"2024-03-30T12:36:34.124620+0000","last_fullsized":"2024-03-30T12:36:34.124620+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1174,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220771+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:36:03.220771+0000","last_peered":"2024-03-30T12:36:03.220771+0000","last_clean":"2024-03-30T12:36:03.220771+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:36:03.220771+0000","last_undegraded":"2024-03-30T12:36:03.220771+0000","last_fullsized":"2024-03-30T12:36:03.220771+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:17.636728+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:36:17.636728+0000","last_peered":"2024-03-30T12:36:17.636728+0000","last_clean":"2024-03-30T12:36:17.636728+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:36:17.636728+0000","last_undegraded":"2024-03-30T12:36:17.636728+0000","last_fullsized":"2024-03-30T12:36:17.636728+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1200,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296444+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:37:20.296444+0000","last_peered":"2024-03-30T12:37:20.296444+0000","last_clean":"2024-03-30T12:37:20.296444+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:37:20.296444+0000","last_undegraded":"2024-03-30T12:37:20.296444+0000","last_fullsized":"2024-03-30T12:37:20.296444+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1716,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:19.123078+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:36:19.123078+0000","last_peered":"2024-03-30T12:36:19.123078+0000","last_clean":"2024-03-30T12:36:19.123078+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:36:19.123078+0000","last_undegraded":"2024-03-30T12:36:19.123078+0000","last_fullsized":"2024-03-30T12:36:19.123078+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24713,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223744+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:36:03.223744+0000","last_peered":"2024-03-30T12:36:03.223744+0000","last_clean":"2024-03-30T12:36:03.223744+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:36:03.223744+0000","last_undegraded":"2024-03-30T12:36:03.223744+0000","last_fullsized":"2024-03-30T12:36:03.223744+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:05.865263+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:37:05.865263+0000","last_peered":"2024-03-30T12:37:05.865263+0000","last_clean":"2024-03-30T12:37:05.865263+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:37:05.865263+0000","last_undegraded":"2024-03-30T12:37:05.865263+0000","last_fullsized":"2024-03-30T12:37:05.865263+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862413+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:36:40.862413+0000","last_peered":"2024-03-30T12:36:40.862413+0000","last_clean":"2024-03-30T12:36:40.862413+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:36:40.862413+0000","last_undegraded":"2024-03-30T12:36:40.862413+0000","last_fullsized":"2024-03-30T12:36:40.862413+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:19.123052+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:36:19.123052+0000","last_peered":"2024-03-30T12:36:19.123052+0000","last_clean":"2024-03-30T12:36:19.123052+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:36:19.123052+0000","last_undegraded":"2024-03-30T12:36:19.123052+0000","last_fullsized":"2024-03-30T12:36:19.123052+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16480,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.221717+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:36:03.221717+0000","last_peered":"2024-03-30T12:36:03.221717+0000","last_clean":"2024-03-30T12:36:03.221717+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:36:03.221717+0000","last_undegraded":"2024-03-30T12:36:03.221717+0000","last_fullsized":"2024-03-30T12:36:03.221717+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862510+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:36:40.862510+0000","last_peered":"2024-03-30T12:36:40.862510+0000","last_clean":"2024-03-30T12:36:40.862510+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:36:40.862510+0000","last_undegraded":"2024-03-30T12:36:40.862510+0000","last_fullsized":"2024-03-30T12:36:40.862510+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:34.124667+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:36:34.124667+0000","last_peered":"2024-03-30T12:36:34.124667+0000","last_clean":"2024-03-30T12:36:34.124667+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:36:34.124667+0000","last_undegraded":"2024-03-30T12:36:34.124667+0000","last_fullsized":"2024-03-30T12:36:34.124667+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904330+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:37:13.904330+0000","last_peered":"2024-03-30T12:37:13.904330+0000","last_clean":"2024-03-30T12:37:13.904330+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:37:13.904330+0000","last_undegraded":"2024-03-30T12:37:13.904330+0000","last_fullsized":"2024-03-30T12:37:13.904330+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31269,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:52.276052+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:36:52.276052+0000","last_peered":"2024-03-30T12:36:52.276052+0000","last_clean":"2024-03-30T12:36:52.276052+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:36:52.276052+0000","last_undegraded":"2024-03-30T12:36:52.276052+0000","last_fullsized":"2024-03-30T12:36:52.276052+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1294,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219916+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:36:03.219916+0000","last_peered":"2024-03-30T12:36:03.219916+0000","last_clean":"2024-03-30T12:36:03.219916+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:36:03.219916+0000","last_undegraded":"2024-03-30T12:36:03.219916+0000","last_fullsized":"2024-03-30T12:36:03.219916+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221733+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:36:03.221733+0000","last_peered":"2024-03-30T12:36:03.221733+0000","last_clean":"2024-03-30T12:36:03.221733+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:36:03.221733+0000","last_undegraded":"2024-03-30T12:36:03.221733+0000","last_fullsized":"2024-03-30T12:36:03.221733+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638999+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:36:37.638999+0000","last_peered":"2024-03-30T12:36:37.638999+0000","last_clean":"2024-03-30T12:36:37.638999+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:36:37.638999+0000","last_undegraded":"2024-03-30T12:36:37.638999+0000","last_fullsized":"2024-03-30T12:36:37.638999+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3764,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220021+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:36:03.220021+0000","last_peered":"2024-03-30T12:36:03.220021+0000","last_clean":"2024-03-30T12:36:03.220021+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:36:03.220021+0000","last_undegraded":"2024-03-30T12:36:03.220021+0000","last_fullsized":"2024-03-30T12:36:03.220021+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:52.276014+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:36:52.276014+0000","last_peered":"2024-03-30T12:36:52.276014+0000","last_clean":"2024-03-30T12:36:52.276014+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:36:52.276014+0000","last_undegraded":"2024-03-30T12:36:52.276014+0000","last_fullsized":"2024-03-30T12:36:52.276014+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544094+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:36:09.544094+0000","last_peered":"2024-03-30T12:36:09.544094+0000","last_clean":"2024-03-30T12:36:09.544094+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:36:09.544094+0000","last_undegraded":"2024-03-30T12:36:09.544094+0000","last_fullsized":"2024-03-30T12:36:09.544094+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:05.865242+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:37:05.865242+0000","last_peered":"2024-03-30T12:37:05.865242+0000","last_clean":"2024-03-30T12:37:05.865242+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:37:05.865242+0000","last_undegraded":"2024-03-30T12:37:05.865242+0000","last_fullsized":"2024-03-30T12:37:05.865242+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15593,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223541+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:36:03.223541+0000","last_peered":"2024-03-30T12:36:03.223541+0000","last_clean":"2024-03-30T12:36:03.223541+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:36:03.223541+0000","last_undegraded":"2024-03-30T12:36:03.223541+0000","last_fullsized":"2024-03-30T12:36:03.223541+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1143,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:49.126219+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:36:49.126219+0000","last_peered":"2024-03-30T12:36:49.126219+0000","last_clean":"2024-03-30T12:36:49.126219+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:36:49.126219+0000","last_undegraded":"2024-03-30T12:36:49.126219+0000","last_fullsized":"2024-03-30T12:36:49.126219+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:12.278399+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:37:12.278399+0000","last_peered":"2024-03-30T12:37:12.278399+0000","last_clean":"2024-03-30T12:37:12.278399+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:37:12.278399+0000","last_undegraded":"2024-03-30T12:37:12.278399+0000","last_fullsized":"2024-03-30T12:37:12.278399+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29019,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.020881+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:36:03.020881+0000","last_peered":"2024-03-30T12:36:03.020881+0000","last_clean":"2024-03-30T12:36:03.020881+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:36:03.020881+0000","last_undegraded":"2024-03-30T12:36:03.020881+0000","last_fullsized":"2024-03-30T12:36:03.020881+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222681+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:36:03.222681+0000","last_peered":"2024-03-30T12:36:03.222681+0000","last_clean":"2024-03-30T12:36:03.222681+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:36:03.222681+0000","last_undegraded":"2024-03-30T12:36:03.222681+0000","last_fullsized":"2024-03-30T12:36:03.222681+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638944+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:36:37.638944+0000","last_peered":"2024-03-30T12:36:37.638944+0000","last_clean":"2024-03-30T12:36:37.638944+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:36:37.638944+0000","last_undegraded":"2024-03-30T12:36:37.638944+0000","last_fullsized":"2024-03-30T12:36:37.638944+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5610,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:23.370279+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:36:23.370279+0000","last_peered":"2024-03-30T12:36:23.370279+0000","last_clean":"2024-03-30T12:36:23.370279+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:36:23.370279+0000","last_undegraded":"2024-03-30T12:36:23.370279+0000","last_fullsized":"2024-03-30T12:36:23.370279+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1364,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220455+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:36:03.220455+0000","last_peered":"2024-03-30T12:36:03.220455+0000","last_clean":"2024-03-30T12:36:03.220455+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:36:03.220455+0000","last_undegraded":"2024-03-30T12:36:03.220455+0000","last_fullsized":"2024-03-30T12:36:03.220455+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:57.641061+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:57.641061+0000","last_peered":"2024-03-30T12:36:57.641061+0000","last_clean":"2024-03-30T12:36:57.641061+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:57.641061+0000","last_undegraded":"2024-03-30T12:36:57.641061+0000","last_fullsized":"2024-03-30T12:36:57.641061+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222932+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:36:03.222932+0000","last_peered":"2024-03-30T12:36:03.222932+0000","last_clean":"2024-03-30T12:36:03.222932+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:36:03.222932+0000","last_undegraded":"2024-03-30T12:36:03.222932+0000","last_fullsized":"2024-03-30T12:36:03.222932+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.127976+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:37:04.127976+0000","last_peered":"2024-03-30T12:37:04.127976+0000","last_clean":"2024-03-30T12:37:04.127976+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:37:04.127976+0000","last_undegraded":"2024-03-30T12:37:04.127976+0000","last_fullsized":"2024-03-30T12:37:04.127976+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544025+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:36:09.544025+0000","last_peered":"2024-03-30T12:36:09.544025+0000","last_clean":"2024-03-30T12:36:09.544025+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:36:09.544025+0000","last_undegraded":"2024-03-30T12:36:09.544025+0000","last_fullsized":"2024-03-30T12:36:09.544025+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5253,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:23.370200+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:36:23.370200+0000","last_peered":"2024-03-30T12:36:23.370200+0000","last_clean":"2024-03-30T12:36:23.370200+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:36:23.370200+0000","last_undegraded":"2024-03-30T12:36:23.370200+0000","last_fullsized":"2024-03-30T12:36:23.370200+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:23.370243+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:36:23.370243+0000","last_peered":"2024-03-30T12:36:23.370243+0000","last_clean":"2024-03-30T12:36:23.370243+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:36:23.370243+0000","last_undegraded":"2024-03-30T12:36:23.370243+0000","last_fullsized":"2024-03-30T12:36:23.370243+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128016+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:37:04.128016+0000","last_peered":"2024-03-30T12:37:04.128016+0000","last_clean":"2024-03-30T12:37:04.128016+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:37:04.128016+0000","last_undegraded":"2024-03-30T12:37:04.128016+0000","last_fullsized":"2024-03-30T12:37:04.128016+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4810,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.367842+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:36:03.367842+0000","last_peered":"2024-03-30T12:36:03.367842+0000","last_clean":"2024-03-30T12:36:03.367842+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:36:03.367842+0000","last_undegraded":"2024-03-30T12:36:03.367842+0000","last_fullsized":"2024-03-30T12:36:03.367842+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220953+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:36:03.220953+0000","last_peered":"2024-03-30T12:36:03.220953+0000","last_clean":"2024-03-30T12:36:03.220953+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:36:03.220953+0000","last_undegraded":"2024-03-30T12:36:03.220953+0000","last_fullsized":"2024-03-30T12:36:03.220953+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222608+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:36:03.222608+0000","last_peered":"2024-03-30T12:36:03.222608+0000","last_clean":"2024-03-30T12:36:03.222608+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:36:03.222608+0000","last_undegraded":"2024-03-30T12:36:03.222608+0000","last_fullsized":"2024-03-30T12:36:03.222608+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6743,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:49.126256+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:36:49.126256+0000","last_peered":"2024-03-30T12:36:49.126256+0000","last_clean":"2024-03-30T12:36:49.126256+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:36:49.126256+0000","last_undegraded":"2024-03-30T12:36:49.126256+0000","last_fullsized":"2024-03-30T12:36:49.126256+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1337,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:23.370314+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:36:23.370314+0000","last_peered":"2024-03-30T12:36:23.370314+0000","last_clean":"2024-03-30T12:36:23.370314+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:36:23.370314+0000","last_undegraded":"2024-03-30T12:36:23.370314+0000","last_fullsized":"2024-03-30T12:36:23.370314+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128054+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:37:04.128054+0000","last_peered":"2024-03-30T12:37:04.128054+0000","last_clean":"2024-03-30T12:37:04.128054+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:37:04.128054+0000","last_undegraded":"2024-03-30T12:37:04.128054+0000","last_fullsized":"2024-03-30T12:37:04.128054+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220179+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:36:03.220179+0000","last_peered":"2024-03-30T12:36:03.220179+0000","last_clean":"2024-03-30T12:36:03.220179+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:36:03.220179+0000","last_undegraded":"2024-03-30T12:36:03.220179+0000","last_fullsized":"2024-03-30T12:36:03.220179+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015330+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:36:03.015330+0000","last_peered":"2024-03-30T12:36:03.015330+0000","last_clean":"2024-03-30T12:36:03.015330+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:36:03.015330+0000","last_undegraded":"2024-03-30T12:36:03.015330+0000","last_fullsized":"2024-03-30T12:36:03.015330+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296394+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:37:20.296394+0000","last_peered":"2024-03-30T12:37:20.296394+0000","last_clean":"2024-03-30T12:37:20.296394+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:37:20.296394+0000","last_undegraded":"2024-03-30T12:37:20.296394+0000","last_fullsized":"2024-03-30T12:37:20.296394+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862462+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:36:40.862462+0000","last_peered":"2024-03-30T12:36:40.862462+0000","last_clean":"2024-03-30T12:36:40.862462+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:36:40.862462+0000","last_undegraded":"2024-03-30T12:36:40.862462+0000","last_fullsized":"2024-03-30T12:36:40.862462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638978+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:36:37.638978+0000","last_peered":"2024-03-30T12:36:37.638978+0000","last_clean":"2024-03-30T12:36:37.638978+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:36:37.638978+0000","last_undegraded":"2024-03-30T12:36:37.638978+0000","last_fullsized":"2024-03-30T12:36:37.638978+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221044+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:36:03.221044+0000","last_peered":"2024-03-30T12:36:03.221044+0000","last_clean":"2024-03-30T12:36:03.221044+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:36:03.221044+0000","last_undegraded":"2024-03-30T12:36:03.221044+0000","last_fullsized":"2024-03-30T12:36:03.221044+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1177,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544079+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:36:09.544079+0000","last_peered":"2024-03-30T12:36:09.544079+0000","last_clean":"2024-03-30T12:36:09.544079+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:36:09.544079+0000","last_undegraded":"2024-03-30T12:36:09.544079+0000","last_fullsized":"2024-03-30T12:36:09.544079+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1281,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.639015+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:36:37.639015+0000","last_peered":"2024-03-30T12:36:37.639015+0000","last_clean":"2024-03-30T12:36:37.639015+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:36:37.639015+0000","last_undegraded":"2024-03-30T12:36:37.639015+0000","last_fullsized":"2024-03-30T12:36:37.639015+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221612+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:36:03.221612+0000","last_peered":"2024-03-30T12:36:03.221612+0000","last_clean":"2024-03-30T12:36:03.221612+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:36:03.221612+0000","last_undegraded":"2024-03-30T12:36:03.221612+0000","last_fullsized":"2024-03-30T12:36:03.221612+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:57.641040+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:57.641040+0000","last_peered":"2024-03-30T12:36:57.641040+0000","last_clean":"2024-03-30T12:36:57.641040+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:57.641040+0000","last_undegraded":"2024-03-30T12:36:57.641040+0000","last_fullsized":"2024-03-30T12:36:57.641040+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221610+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:36:03.221610+0000","last_peered":"2024-03-30T12:36:03.221610+0000","last_clean":"2024-03-30T12:36:03.221610+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:36:03.221610+0000","last_undegraded":"2024-03-30T12:36:03.221610+0000","last_fullsized":"2024-03-30T12:36:03.221610+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220926+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:36:03.220926+0000","last_peered":"2024-03-30T12:36:03.220926+0000","last_clean":"2024-03-30T12:36:03.220926+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:36:03.220926+0000","last_undegraded":"2024-03-30T12:36:03.220926+0000","last_fullsized":"2024-03-30T12:36:03.220926+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:24.545379+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:36:24.545379+0000","last_peered":"2024-03-30T12:36:24.545379+0000","last_clean":"2024-03-30T12:36:24.545379+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:36:24.545379+0000","last_undegraded":"2024-03-30T12:36:24.545379+0000","last_fullsized":"2024-03-30T12:36:24.545379+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438063,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648119,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175129,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254368,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063186,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951244,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839301,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923583,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:39:33.827 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:33.827 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:33.828 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:33.828 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:33.828 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:33.828 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:33.828 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:33.828 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:33.828 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:33.828 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:33.828 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:33.828 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:33.829 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:33.830 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:39:35.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:34 smithi162 ceph-mon[83709]: pgmap v1095: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:35.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:34 smithi162 ceph-mon[83709]: from='client.44543 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:39:35.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:34 smithi084 ceph-mon[91810]: pgmap v1095: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:35.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:34 smithi084 ceph-mon[91810]: from='client.44543 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:39:35.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:34 smithi084 ceph-mon[89279]: pgmap v1095: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:35.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:34 smithi084 ceph-mon[89279]: from='client.44543 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:39:37.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:36 smithi162 ceph-mon[83709]: pgmap v1096: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:37.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:36 smithi084 ceph-mon[91810]: pgmap v1096: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:37.327 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:36 smithi084 ceph-mon[89279]: pgmap v1096: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:39.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:38 smithi162 ceph-mon[83709]: pgmap v1097: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:39.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:38 smithi084 ceph-mon[91810]: pgmap v1097: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:39.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:38 smithi084 ceph-mon[89279]: pgmap v1097: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:39.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:39:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:39:39] "GET /metrics HTTP/1.1" 200 36325 "" "Prometheus/2.43.0" 2024-03-30T12:39:41.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:40 smithi162 ceph-mon[83709]: pgmap v1098: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:41.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:40 smithi084 ceph-mon[91810]: pgmap v1098: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:41.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:40 smithi084 ceph-mon[89279]: pgmap v1098: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:43.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:42 smithi162 ceph-mon[83709]: pgmap v1099: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:43.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:42 smithi084 ceph-mon[91810]: pgmap v1099: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:43.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:42 smithi084 ceph-mon[89279]: pgmap v1099: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:43.830 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:39:44.051 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:39:45.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:44 smithi162 ceph-mon[83709]: pgmap v1100: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:45.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:44 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:39:45.153 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:44 smithi084 ceph-mon[91810]: pgmap v1100: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:45.153 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:44 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:39:45.153 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:44 smithi084 ceph-mon[89279]: pgmap v1100: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:45.153 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:39:45.879 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:39:45.881 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:39:46.532 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1101,"stamp":"2024-03-30T12:39:44.867870+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003712"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:34.124688+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:36:34.124688+0000","last_peered":"2024-03-30T12:36:34.124688+0000","last_clean":"2024-03-30T12:36:34.124688+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:36:34.124688+0000","last_undegraded":"2024-03-30T12:36:34.124688+0000","last_fullsized":"2024-03-30T12:36:34.124688+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1364,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904373+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:37:13.904373+0000","last_peered":"2024-03-30T12:37:13.904373+0000","last_clean":"2024-03-30T12:37:13.904373+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:37:13.904373+0000","last_undegraded":"2024-03-30T12:37:13.904373+0000","last_fullsized":"2024-03-30T12:37:13.904373+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862523+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:36:40.862523+0000","last_peered":"2024-03-30T12:36:40.862523+0000","last_clean":"2024-03-30T12:36:40.862523+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:36:40.862523+0000","last_undegraded":"2024-03-30T12:36:40.862523+0000","last_fullsized":"2024-03-30T12:36:40.862523+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:00.294130+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:37:00.294130+0000","last_peered":"2024-03-30T12:37:00.294130+0000","last_clean":"2024-03-30T12:37:00.294130+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:37:00.294130+0000","last_undegraded":"2024-03-30T12:37:00.294130+0000","last_fullsized":"2024-03-30T12:37:00.294130+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016863+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:36:03.016863+0000","last_peered":"2024-03-30T12:36:03.016863+0000","last_clean":"2024-03-30T12:36:03.016863+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:36:03.016863+0000","last_undegraded":"2024-03-30T12:36:03.016863+0000","last_fullsized":"2024-03-30T12:36:03.016863+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1210,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290374+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:30.290374+0000","last_peered":"2024-03-30T12:36:30.290374+0000","last_clean":"2024-03-30T12:36:30.290374+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:30.290374+0000","last_undegraded":"2024-03-30T12:36:30.290374+0000","last_fullsized":"2024-03-30T12:36:30.290374+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017365+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:36:03.017365+0000","last_peered":"2024-03-30T12:36:03.017365+0000","last_clean":"2024-03-30T12:36:03.017365+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:36:03.017365+0000","last_undegraded":"2024-03-30T12:36:03.017365+0000","last_fullsized":"2024-03-30T12:36:03.017365+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219781+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:36:03.219781+0000","last_peered":"2024-03-30T12:36:03.219781+0000","last_clean":"2024-03-30T12:36:03.219781+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:36:03.219781+0000","last_undegraded":"2024-03-30T12:36:03.219781+0000","last_fullsized":"2024-03-30T12:36:03.219781+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018011+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:36:03.018011+0000","last_peered":"2024-03-30T12:36:03.018011+0000","last_clean":"2024-03-30T12:36:03.018011+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:36:03.018011+0000","last_undegraded":"2024-03-30T12:36:03.018011+0000","last_fullsized":"2024-03-30T12:36:03.018011+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548505+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:54.548505+0000","last_peered":"2024-03-30T12:36:54.548505+0000","last_clean":"2024-03-30T12:36:54.548505+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:54.548505+0000","last_undegraded":"2024-03-30T12:36:54.548505+0000","last_fullsized":"2024-03-30T12:36:54.548505+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548476+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:54.548476+0000","last_peered":"2024-03-30T12:36:54.548476+0000","last_clean":"2024-03-30T12:36:54.548476+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:54.548476+0000","last_undegraded":"2024-03-30T12:36:54.548476+0000","last_fullsized":"2024-03-30T12:36:54.548476+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1270,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020253+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:36:03.020253+0000","last_peered":"2024-03-30T12:36:03.020253+0000","last_clean":"2024-03-30T12:36:03.020253+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:36:03.020253+0000","last_undegraded":"2024-03-30T12:36:03.020253+0000","last_fullsized":"2024-03-30T12:36:03.020253+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221688+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:36:03.221688+0000","last_peered":"2024-03-30T12:36:03.221688+0000","last_clean":"2024-03-30T12:36:03.221688+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:36:03.221688+0000","last_undegraded":"2024-03-30T12:36:03.221688+0000","last_fullsized":"2024-03-30T12:36:03.221688+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220487+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:36:03.220487+0000","last_peered":"2024-03-30T12:36:03.220487+0000","last_clean":"2024-03-30T12:36:03.220487+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:36:03.220487+0000","last_undegraded":"2024-03-30T12:36:03.220487+0000","last_fullsized":"2024-03-30T12:36:03.220487+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:08.897219+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:36:08.897219+0000","last_peered":"2024-03-30T12:36:08.897219+0000","last_clean":"2024-03-30T12:36:08.897219+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:36:08.897219+0000","last_undegraded":"2024-03-30T12:36:08.897219+0000","last_fullsized":"2024-03-30T12:36:08.897219+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1213,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221481+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:36:03.221481+0000","last_peered":"2024-03-30T12:36:03.221481+0000","last_clean":"2024-03-30T12:36:03.221481+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:36:03.221481+0000","last_undegraded":"2024-03-30T12:36:03.221481+0000","last_fullsized":"2024-03-30T12:36:03.221481+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1224,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.223011+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:36:03.223011+0000","last_peered":"2024-03-30T12:36:03.223011+0000","last_clean":"2024-03-30T12:36:03.223011+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:36:03.223011+0000","last_undegraded":"2024-03-30T12:36:03.223011+0000","last_fullsized":"2024-03-30T12:36:03.223011+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:43.372790+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:36:43.372790+0000","last_peered":"2024-03-30T12:36:43.372790+0000","last_clean":"2024-03-30T12:36:43.372790+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:36:43.372790+0000","last_undegraded":"2024-03-30T12:36:43.372790+0000","last_fullsized":"2024-03-30T12:36:43.372790+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128028+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:37:04.128028+0000","last_peered":"2024-03-30T12:37:04.128028+0000","last_clean":"2024-03-30T12:37:04.128028+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:37:04.128028+0000","last_undegraded":"2024-03-30T12:37:04.128028+0000","last_fullsized":"2024-03-30T12:37:04.128028+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1388,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862565+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:36:40.862565+0000","last_peered":"2024-03-30T12:36:40.862565+0000","last_clean":"2024-03-30T12:36:40.862565+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:36:40.862565+0000","last_undegraded":"2024-03-30T12:36:40.862565+0000","last_fullsized":"2024-03-30T12:36:40.862565+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1282,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220823+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:36:03.220823+0000","last_peered":"2024-03-30T12:36:03.220823+0000","last_clean":"2024-03-30T12:36:03.220823+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:36:03.220823+0000","last_undegraded":"2024-03-30T12:36:03.220823+0000","last_fullsized":"2024-03-30T12:36:03.220823+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1301,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221016+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:36:03.221016+0000","last_peered":"2024-03-30T12:36:03.221016+0000","last_clean":"2024-03-30T12:36:03.221016+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:36:03.221016+0000","last_undegraded":"2024-03-30T12:36:03.221016+0000","last_fullsized":"2024-03-30T12:36:03.221016+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862552+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:36:40.862552+0000","last_peered":"2024-03-30T12:36:40.862552+0000","last_clean":"2024-03-30T12:36:40.862552+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:36:40.862552+0000","last_undegraded":"2024-03-30T12:36:40.862552+0000","last_fullsized":"2024-03-30T12:36:40.862552+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018097+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:36:03.018097+0000","last_peered":"2024-03-30T12:36:03.018097+0000","last_clean":"2024-03-30T12:36:03.018097+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:36:03.018097+0000","last_undegraded":"2024-03-30T12:36:03.018097+0000","last_fullsized":"2024-03-30T12:36:03.018097+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1229,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290400+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:30.290400+0000","last_peered":"2024-03-30T12:36:30.290400+0000","last_clean":"2024-03-30T12:36:30.290400+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:30.290400+0000","last_undegraded":"2024-03-30T12:36:30.290400+0000","last_fullsized":"2024-03-30T12:36:30.290400+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017698+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:36:03.017698+0000","last_peered":"2024-03-30T12:36:03.017698+0000","last_clean":"2024-03-30T12:36:03.017698+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:36:03.017698+0000","last_undegraded":"2024-03-30T12:36:03.017698+0000","last_fullsized":"2024-03-30T12:36:03.017698+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1213,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290416+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:30.290416+0000","last_peered":"2024-03-30T12:36:30.290416+0000","last_clean":"2024-03-30T12:36:30.290416+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:30.290416+0000","last_undegraded":"2024-03-30T12:36:30.290416+0000","last_fullsized":"2024-03-30T12:36:30.290416+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221852+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:36:03.221852+0000","last_peered":"2024-03-30T12:36:03.221852+0000","last_clean":"2024-03-30T12:36:03.221852+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:36:03.221852+0000","last_undegraded":"2024-03-30T12:36:03.221852+0000","last_fullsized":"2024-03-30T12:36:03.221852+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018910+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:36:03.018910+0000","last_peered":"2024-03-30T12:36:03.018910+0000","last_clean":"2024-03-30T12:36:03.018910+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:36:03.018910+0000","last_undegraded":"2024-03-30T12:36:03.018910+0000","last_fullsized":"2024-03-30T12:36:03.018910+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1180,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:09.550388+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:37:09.550388+0000","last_peered":"2024-03-30T12:37:09.550388+0000","last_clean":"2024-03-30T12:37:09.550388+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:37:09.550388+0000","last_undegraded":"2024-03-30T12:37:09.550388+0000","last_fullsized":"2024-03-30T12:37:09.550388+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.860010+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:36:15.860010+0000","last_peered":"2024-03-30T12:36:15.860010+0000","last_clean":"2024-03-30T12:36:15.860010+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:36:15.860010+0000","last_undegraded":"2024-03-30T12:36:15.860010+0000","last_fullsized":"2024-03-30T12:36:15.860010+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219839+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:36:03.219839+0000","last_peered":"2024-03-30T12:36:03.219839+0000","last_clean":"2024-03-30T12:36:03.219839+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:36:03.219839+0000","last_undegraded":"2024-03-30T12:36:03.219839+0000","last_fullsized":"2024-03-30T12:36:03.219839+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1294,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219823+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:36:03.219823+0000","last_peered":"2024-03-30T12:36:03.219823+0000","last_clean":"2024-03-30T12:36:03.219823+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:36:03.219823+0000","last_undegraded":"2024-03-30T12:36:03.219823+0000","last_fullsized":"2024-03-30T12:36:03.219823+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1224,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288884+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:36:15.288884+0000","last_peered":"2024-03-30T12:36:15.288884+0000","last_clean":"2024-03-30T12:36:15.288884+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:36:15.288884+0000","last_undegraded":"2024-03-30T12:36:15.288884+0000","last_fullsized":"2024-03-30T12:36:15.288884+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:28.899208+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:36:28.899208+0000","last_peered":"2024-03-30T12:36:28.899208+0000","last_clean":"2024-03-30T12:36:28.899208+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:36:28.899208+0000","last_undegraded":"2024-03-30T12:36:28.899208+0000","last_fullsized":"2024-03-30T12:36:28.899208+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548518+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:54.548518+0000","last_peered":"2024-03-30T12:36:54.548518+0000","last_clean":"2024-03-30T12:36:54.548518+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:54.548518+0000","last_undegraded":"2024-03-30T12:36:54.548518+0000","last_fullsized":"2024-03-30T12:36:54.548518+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1204,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288944+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:36:15.288944+0000","last_peered":"2024-03-30T12:36:15.288944+0000","last_clean":"2024-03-30T12:36:15.288944+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:36:15.288944+0000","last_undegraded":"2024-03-30T12:36:15.288944+0000","last_fullsized":"2024-03-30T12:36:15.288944+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1198,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288933+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:36:15.288933+0000","last_peered":"2024-03-30T12:36:15.288933+0000","last_clean":"2024-03-30T12:36:15.288933+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:36:15.288933+0000","last_undegraded":"2024-03-30T12:36:15.288933+0000","last_fullsized":"2024-03-30T12:36:15.288933+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:03.374890+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:37:03.374890+0000","last_peered":"2024-03-30T12:37:03.374890+0000","last_clean":"2024-03-30T12:37:03.374890+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:37:03.374890+0000","last_undegraded":"2024-03-30T12:37:03.374890+0000","last_fullsized":"2024-03-30T12:37:03.374890+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:28.899251+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:36:28.899251+0000","last_peered":"2024-03-30T12:36:28.899251+0000","last_clean":"2024-03-30T12:36:28.899251+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:36:28.899251+0000","last_undegraded":"2024-03-30T12:36:28.899251+0000","last_fullsized":"2024-03-30T12:36:28.899251+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020091+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:36:03.020091+0000","last_peered":"2024-03-30T12:36:03.020091+0000","last_clean":"2024-03-30T12:36:03.020091+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:36:03.020091+0000","last_undegraded":"2024-03-30T12:36:03.020091+0000","last_fullsized":"2024-03-30T12:36:03.020091+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546935+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:36:39.546935+0000","last_peered":"2024-03-30T12:36:39.546935+0000","last_clean":"2024-03-30T12:36:39.546935+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:36:39.546935+0000","last_undegraded":"2024-03-30T12:36:39.546935+0000","last_fullsized":"2024-03-30T12:36:39.546935+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017435+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:36:03.017435+0000","last_peered":"2024-03-30T12:36:03.017435+0000","last_clean":"2024-03-30T12:36:03.017435+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:36:03.017435+0000","last_undegraded":"2024-03-30T12:36:03.017435+0000","last_fullsized":"2024-03-30T12:36:03.017435+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221769+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:36:03.221769+0000","last_peered":"2024-03-30T12:36:03.221769+0000","last_clean":"2024-03-30T12:36:03.221769+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:36:03.221769+0000","last_undegraded":"2024-03-30T12:36:03.221769+0000","last_fullsized":"2024-03-30T12:36:03.221769+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220786+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:36:03.220786+0000","last_peered":"2024-03-30T12:36:03.220786+0000","last_clean":"2024-03-30T12:36:03.220786+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:36:03.220786+0000","last_undegraded":"2024-03-30T12:36:03.220786+0000","last_fullsized":"2024-03-30T12:36:03.220786+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221971+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:36:03.221971+0000","last_peered":"2024-03-30T12:36:03.221971+0000","last_clean":"2024-03-30T12:36:03.221971+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:36:03.221971+0000","last_undegraded":"2024-03-30T12:36:03.221971+0000","last_fullsized":"2024-03-30T12:36:03.221971+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:19.129793+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:37:19.129793+0000","last_peered":"2024-03-30T12:37:19.129793+0000","last_clean":"2024-03-30T12:37:19.129793+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:37:19.129793+0000","last_undegraded":"2024-03-30T12:37:19.129793+0000","last_fullsized":"2024-03-30T12:37:19.129793+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546908+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:36:39.546908+0000","last_peered":"2024-03-30T12:36:39.546908+0000","last_clean":"2024-03-30T12:36:39.546908+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:36:39.546908+0000","last_undegraded":"2024-03-30T12:36:39.546908+0000","last_fullsized":"2024-03-30T12:36:39.546908+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546882+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:36:39.546882+0000","last_peered":"2024-03-30T12:36:39.546882+0000","last_clean":"2024-03-30T12:36:39.546882+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:36:39.546882+0000","last_undegraded":"2024-03-30T12:36:39.546882+0000","last_fullsized":"2024-03-30T12:36:39.546882+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1344,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:43.372738+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:36:43.372738+0000","last_peered":"2024-03-30T12:36:43.372738+0000","last_clean":"2024-03-30T12:36:43.372738+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:36:43.372738+0000","last_undegraded":"2024-03-30T12:36:43.372738+0000","last_fullsized":"2024-03-30T12:36:43.372738+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:19.129759+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:37:19.129759+0000","last_peered":"2024-03-30T12:37:19.129759+0000","last_clean":"2024-03-30T12:37:19.129759+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:37:19.129759+0000","last_undegraded":"2024-03-30T12:37:19.129759+0000","last_fullsized":"2024-03-30T12:37:19.129759+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5752,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.367799+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:36:03.367799+0000","last_peered":"2024-03-30T12:36:03.367799+0000","last_clean":"2024-03-30T12:36:03.367799+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:36:03.367799+0000","last_undegraded":"2024-03-30T12:36:03.367799+0000","last_fullsized":"2024-03-30T12:36:03.367799+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020404+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:36:03.020404+0000","last_peered":"2024-03-30T12:36:03.020404+0000","last_clean":"2024-03-30T12:36:03.020404+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:36:03.020404+0000","last_undegraded":"2024-03-30T12:36:03.020404+0000","last_fullsized":"2024-03-30T12:36:03.020404+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128039+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:37:04.128039+0000","last_peered":"2024-03-30T12:37:04.128039+0000","last_clean":"2024-03-30T12:37:04.128039+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:37:04.128039+0000","last_undegraded":"2024-03-30T12:37:04.128039+0000","last_fullsized":"2024-03-30T12:37:04.128039+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5513,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:40.862481+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:36:40.862481+0000","last_peered":"2024-03-30T12:36:40.862481+0000","last_clean":"2024-03-30T12:36:40.862481+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:36:40.862481+0000","last_undegraded":"2024-03-30T12:36:40.862481+0000","last_fullsized":"2024-03-30T12:36:40.862481+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904270+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:37:13.904270+0000","last_peered":"2024-03-30T12:37:13.904270+0000","last_clean":"2024-03-30T12:37:13.904270+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:37:13.904270+0000","last_undegraded":"2024-03-30T12:37:13.904270+0000","last_fullsized":"2024-03-30T12:37:13.904270+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904297+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:37:13.904297+0000","last_peered":"2024-03-30T12:37:13.904297+0000","last_clean":"2024-03-30T12:37:13.904297+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:37:13.904297+0000","last_undegraded":"2024-03-30T12:37:13.904297+0000","last_fullsized":"2024-03-30T12:37:13.904297+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296466+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:37:20.296466+0000","last_peered":"2024-03-30T12:37:20.296466+0000","last_clean":"2024-03-30T12:37:20.296466+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:37:20.296466+0000","last_undegraded":"2024-03-30T12:37:20.296466+0000","last_fullsized":"2024-03-30T12:37:20.296466+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5458,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:40.862535+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:36:40.862535+0000","last_peered":"2024-03-30T12:36:40.862535+0000","last_clean":"2024-03-30T12:36:40.862535+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:36:40.862535+0000","last_undegraded":"2024-03-30T12:36:40.862535+0000","last_fullsized":"2024-03-30T12:36:40.862535+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904314+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:37:13.904314+0000","last_peered":"2024-03-30T12:37:13.904314+0000","last_clean":"2024-03-30T12:37:13.904314+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:37:13.904314+0000","last_undegraded":"2024-03-30T12:37:13.904314+0000","last_fullsized":"2024-03-30T12:37:13.904314+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1207,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296362+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:37:20.296362+0000","last_peered":"2024-03-30T12:37:20.296362+0000","last_clean":"2024-03-30T12:37:20.296362+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:37:20.296362+0000","last_undegraded":"2024-03-30T12:37:20.296362+0000","last_fullsized":"2024-03-30T12:37:20.296362+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1272,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:52.276088+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:36:52.276088+0000","last_peered":"2024-03-30T12:36:52.276088+0000","last_clean":"2024-03-30T12:36:52.276088+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:36:52.276088+0000","last_undegraded":"2024-03-30T12:36:52.276088+0000","last_fullsized":"2024-03-30T12:36:52.276088+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3803,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.367883+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:36:03.367883+0000","last_peered":"2024-03-30T12:36:03.367883+0000","last_clean":"2024-03-30T12:36:03.367883+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:36:03.367883+0000","last_undegraded":"2024-03-30T12:36:03.367883+0000","last_fullsized":"2024-03-30T12:36:03.367883+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1342,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222978+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:36:03.222978+0000","last_peered":"2024-03-30T12:36:03.222978+0000","last_clean":"2024-03-30T12:36:03.222978+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:36:03.222978+0000","last_undegraded":"2024-03-30T12:36:03.222978+0000","last_fullsized":"2024-03-30T12:36:03.222978+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:48.901383+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:36:48.901383+0000","last_peered":"2024-03-30T12:36:48.901383+0000","last_clean":"2024-03-30T12:36:48.901383+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:36:48.901383+0000","last_undegraded":"2024-03-30T12:36:48.901383+0000","last_fullsized":"2024-03-30T12:36:48.901383+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015232+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:36:03.015232+0000","last_peered":"2024-03-30T12:36:03.015232+0000","last_clean":"2024-03-30T12:36:03.015232+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:36:03.015232+0000","last_undegraded":"2024-03-30T12:36:03.015232+0000","last_fullsized":"2024-03-30T12:36:03.015232+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4576,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:34.124620+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:36:34.124620+0000","last_peered":"2024-03-30T12:36:34.124620+0000","last_clean":"2024-03-30T12:36:34.124620+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:36:34.124620+0000","last_undegraded":"2024-03-30T12:36:34.124620+0000","last_fullsized":"2024-03-30T12:36:34.124620+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1174,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220771+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:36:03.220771+0000","last_peered":"2024-03-30T12:36:03.220771+0000","last_clean":"2024-03-30T12:36:03.220771+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:36:03.220771+0000","last_undegraded":"2024-03-30T12:36:03.220771+0000","last_fullsized":"2024-03-30T12:36:03.220771+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:17.636728+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:36:17.636728+0000","last_peered":"2024-03-30T12:36:17.636728+0000","last_clean":"2024-03-30T12:36:17.636728+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:36:17.636728+0000","last_undegraded":"2024-03-30T12:36:17.636728+0000","last_fullsized":"2024-03-30T12:36:17.636728+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1200,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296444+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:37:20.296444+0000","last_peered":"2024-03-30T12:37:20.296444+0000","last_clean":"2024-03-30T12:37:20.296444+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:37:20.296444+0000","last_undegraded":"2024-03-30T12:37:20.296444+0000","last_fullsized":"2024-03-30T12:37:20.296444+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1716,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:19.123078+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:36:19.123078+0000","last_peered":"2024-03-30T12:36:19.123078+0000","last_clean":"2024-03-30T12:36:19.123078+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:36:19.123078+0000","last_undegraded":"2024-03-30T12:36:19.123078+0000","last_fullsized":"2024-03-30T12:36:19.123078+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24713,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223744+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:36:03.223744+0000","last_peered":"2024-03-30T12:36:03.223744+0000","last_clean":"2024-03-30T12:36:03.223744+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:36:03.223744+0000","last_undegraded":"2024-03-30T12:36:03.223744+0000","last_fullsized":"2024-03-30T12:36:03.223744+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:05.865263+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:37:05.865263+0000","last_peered":"2024-03-30T12:37:05.865263+0000","last_clean":"2024-03-30T12:37:05.865263+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:37:05.865263+0000","last_undegraded":"2024-03-30T12:37:05.865263+0000","last_fullsized":"2024-03-30T12:37:05.865263+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862413+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:36:40.862413+0000","last_peered":"2024-03-30T12:36:40.862413+0000","last_clean":"2024-03-30T12:36:40.862413+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:36:40.862413+0000","last_undegraded":"2024-03-30T12:36:40.862413+0000","last_fullsized":"2024-03-30T12:36:40.862413+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:19.123052+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:36:19.123052+0000","last_peered":"2024-03-30T12:36:19.123052+0000","last_clean":"2024-03-30T12:36:19.123052+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:36:19.123052+0000","last_undegraded":"2024-03-30T12:36:19.123052+0000","last_fullsized":"2024-03-30T12:36:19.123052+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16480,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.221717+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:36:03.221717+0000","last_peered":"2024-03-30T12:36:03.221717+0000","last_clean":"2024-03-30T12:36:03.221717+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:36:03.221717+0000","last_undegraded":"2024-03-30T12:36:03.221717+0000","last_fullsized":"2024-03-30T12:36:03.221717+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862510+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:36:40.862510+0000","last_peered":"2024-03-30T12:36:40.862510+0000","last_clean":"2024-03-30T12:36:40.862510+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:36:40.862510+0000","last_undegraded":"2024-03-30T12:36:40.862510+0000","last_fullsized":"2024-03-30T12:36:40.862510+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:34.124667+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:36:34.124667+0000","last_peered":"2024-03-30T12:36:34.124667+0000","last_clean":"2024-03-30T12:36:34.124667+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:36:34.124667+0000","last_undegraded":"2024-03-30T12:36:34.124667+0000","last_fullsized":"2024-03-30T12:36:34.124667+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904330+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:37:13.904330+0000","last_peered":"2024-03-30T12:37:13.904330+0000","last_clean":"2024-03-30T12:37:13.904330+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:37:13.904330+0000","last_undegraded":"2024-03-30T12:37:13.904330+0000","last_fullsized":"2024-03-30T12:37:13.904330+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31269,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:52.276052+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:36:52.276052+0000","last_peered":"2024-03-30T12:36:52.276052+0000","last_clean":"2024-03-30T12:36:52.276052+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:36:52.276052+0000","last_undegraded":"2024-03-30T12:36:52.276052+0000","last_fullsized":"2024-03-30T12:36:52.276052+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1294,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219916+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:36:03.219916+0000","last_peered":"2024-03-30T12:36:03.219916+0000","last_clean":"2024-03-30T12:36:03.219916+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:36:03.219916+0000","last_undegraded":"2024-03-30T12:36:03.219916+0000","last_fullsized":"2024-03-30T12:36:03.219916+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221733+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:36:03.221733+0000","last_peered":"2024-03-30T12:36:03.221733+0000","last_clean":"2024-03-30T12:36:03.221733+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:36:03.221733+0000","last_undegraded":"2024-03-30T12:36:03.221733+0000","last_fullsized":"2024-03-30T12:36:03.221733+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638999+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:36:37.638999+0000","last_peered":"2024-03-30T12:36:37.638999+0000","last_clean":"2024-03-30T12:36:37.638999+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:36:37.638999+0000","last_undegraded":"2024-03-30T12:36:37.638999+0000","last_fullsized":"2024-03-30T12:36:37.638999+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3764,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220021+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:36:03.220021+0000","last_peered":"2024-03-30T12:36:03.220021+0000","last_clean":"2024-03-30T12:36:03.220021+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:36:03.220021+0000","last_undegraded":"2024-03-30T12:36:03.220021+0000","last_fullsized":"2024-03-30T12:36:03.220021+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:52.276014+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:36:52.276014+0000","last_peered":"2024-03-30T12:36:52.276014+0000","last_clean":"2024-03-30T12:36:52.276014+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:36:52.276014+0000","last_undegraded":"2024-03-30T12:36:52.276014+0000","last_fullsized":"2024-03-30T12:36:52.276014+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544094+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:36:09.544094+0000","last_peered":"2024-03-30T12:36:09.544094+0000","last_clean":"2024-03-30T12:36:09.544094+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:36:09.544094+0000","last_undegraded":"2024-03-30T12:36:09.544094+0000","last_fullsized":"2024-03-30T12:36:09.544094+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:05.865242+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:37:05.865242+0000","last_peered":"2024-03-30T12:37:05.865242+0000","last_clean":"2024-03-30T12:37:05.865242+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:37:05.865242+0000","last_undegraded":"2024-03-30T12:37:05.865242+0000","last_fullsized":"2024-03-30T12:37:05.865242+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15593,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223541+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:36:03.223541+0000","last_peered":"2024-03-30T12:36:03.223541+0000","last_clean":"2024-03-30T12:36:03.223541+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:36:03.223541+0000","last_undegraded":"2024-03-30T12:36:03.223541+0000","last_fullsized":"2024-03-30T12:36:03.223541+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1143,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:49.126219+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:36:49.126219+0000","last_peered":"2024-03-30T12:36:49.126219+0000","last_clean":"2024-03-30T12:36:49.126219+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:36:49.126219+0000","last_undegraded":"2024-03-30T12:36:49.126219+0000","last_fullsized":"2024-03-30T12:36:49.126219+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:12.278399+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:37:12.278399+0000","last_peered":"2024-03-30T12:37:12.278399+0000","last_clean":"2024-03-30T12:37:12.278399+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:37:12.278399+0000","last_undegraded":"2024-03-30T12:37:12.278399+0000","last_fullsized":"2024-03-30T12:37:12.278399+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29019,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.020881+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:36:03.020881+0000","last_peered":"2024-03-30T12:36:03.020881+0000","last_clean":"2024-03-30T12:36:03.020881+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:36:03.020881+0000","last_undegraded":"2024-03-30T12:36:03.020881+0000","last_fullsized":"2024-03-30T12:36:03.020881+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222681+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:36:03.222681+0000","last_peered":"2024-03-30T12:36:03.222681+0000","last_clean":"2024-03-30T12:36:03.222681+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:36:03.222681+0000","last_undegraded":"2024-03-30T12:36:03.222681+0000","last_fullsized":"2024-03-30T12:36:03.222681+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638944+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:36:37.638944+0000","last_peered":"2024-03-30T12:36:37.638944+0000","last_clean":"2024-03-30T12:36:37.638944+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:36:37.638944+0000","last_undegraded":"2024-03-30T12:36:37.638944+0000","last_fullsized":"2024-03-30T12:36:37.638944+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5610,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:23.370279+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:36:23.370279+0000","last_peered":"2024-03-30T12:36:23.370279+0000","last_clean":"2024-03-30T12:36:23.370279+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:36:23.370279+0000","last_undegraded":"2024-03-30T12:36:23.370279+0000","last_fullsized":"2024-03-30T12:36:23.370279+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1364,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220455+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:36:03.220455+0000","last_peered":"2024-03-30T12:36:03.220455+0000","last_clean":"2024-03-30T12:36:03.220455+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:36:03.220455+0000","last_undegraded":"2024-03-30T12:36:03.220455+0000","last_fullsized":"2024-03-30T12:36:03.220455+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:57.641061+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:57.641061+0000","last_peered":"2024-03-30T12:36:57.641061+0000","last_clean":"2024-03-30T12:36:57.641061+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:57.641061+0000","last_undegraded":"2024-03-30T12:36:57.641061+0000","last_fullsized":"2024-03-30T12:36:57.641061+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222932+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:36:03.222932+0000","last_peered":"2024-03-30T12:36:03.222932+0000","last_clean":"2024-03-30T12:36:03.222932+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:36:03.222932+0000","last_undegraded":"2024-03-30T12:36:03.222932+0000","last_fullsized":"2024-03-30T12:36:03.222932+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.127976+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:37:04.127976+0000","last_peered":"2024-03-30T12:37:04.127976+0000","last_clean":"2024-03-30T12:37:04.127976+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:37:04.127976+0000","last_undegraded":"2024-03-30T12:37:04.127976+0000","last_fullsized":"2024-03-30T12:37:04.127976+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544025+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:36:09.544025+0000","last_peered":"2024-03-30T12:36:09.544025+0000","last_clean":"2024-03-30T12:36:09.544025+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:36:09.544025+0000","last_undegraded":"2024-03-30T12:36:09.544025+0000","last_fullsized":"2024-03-30T12:36:09.544025+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5253,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:23.370200+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:36:23.370200+0000","last_peered":"2024-03-30T12:36:23.370200+0000","last_clean":"2024-03-30T12:36:23.370200+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:36:23.370200+0000","last_undegraded":"2024-03-30T12:36:23.370200+0000","last_fullsized":"2024-03-30T12:36:23.370200+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:23.370243+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:36:23.370243+0000","last_peered":"2024-03-30T12:36:23.370243+0000","last_clean":"2024-03-30T12:36:23.370243+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:36:23.370243+0000","last_undegraded":"2024-03-30T12:36:23.370243+0000","last_fullsized":"2024-03-30T12:36:23.370243+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128016+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:37:04.128016+0000","last_peered":"2024-03-30T12:37:04.128016+0000","last_clean":"2024-03-30T12:37:04.128016+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:37:04.128016+0000","last_undegraded":"2024-03-30T12:37:04.128016+0000","last_fullsized":"2024-03-30T12:37:04.128016+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4810,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.367842+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:36:03.367842+0000","last_peered":"2024-03-30T12:36:03.367842+0000","last_clean":"2024-03-30T12:36:03.367842+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:36:03.367842+0000","last_undegraded":"2024-03-30T12:36:03.367842+0000","last_fullsized":"2024-03-30T12:36:03.367842+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220953+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:36:03.220953+0000","last_peered":"2024-03-30T12:36:03.220953+0000","last_clean":"2024-03-30T12:36:03.220953+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:36:03.220953+0000","last_undegraded":"2024-03-30T12:36:03.220953+0000","last_fullsized":"2024-03-30T12:36:03.220953+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222608+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:36:03.222608+0000","last_peered":"2024-03-30T12:36:03.222608+0000","last_clean":"2024-03-30T12:36:03.222608+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:36:03.222608+0000","last_undegraded":"2024-03-30T12:36:03.222608+0000","last_fullsized":"2024-03-30T12:36:03.222608+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6743,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:49.126256+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:36:49.126256+0000","last_peered":"2024-03-30T12:36:49.126256+0000","last_clean":"2024-03-30T12:36:49.126256+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:36:49.126256+0000","last_undegraded":"2024-03-30T12:36:49.126256+0000","last_fullsized":"2024-03-30T12:36:49.126256+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1337,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:23.370314+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:36:23.370314+0000","last_peered":"2024-03-30T12:36:23.370314+0000","last_clean":"2024-03-30T12:36:23.370314+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:36:23.370314+0000","last_undegraded":"2024-03-30T12:36:23.370314+0000","last_fullsized":"2024-03-30T12:36:23.370314+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128054+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:37:04.128054+0000","last_peered":"2024-03-30T12:37:04.128054+0000","last_clean":"2024-03-30T12:37:04.128054+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:37:04.128054+0000","last_undegraded":"2024-03-30T12:37:04.128054+0000","last_fullsized":"2024-03-30T12:37:04.128054+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220179+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:36:03.220179+0000","last_peered":"2024-03-30T12:36:03.220179+0000","last_clean":"2024-03-30T12:36:03.220179+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:36:03.220179+0000","last_undegraded":"2024-03-30T12:36:03.220179+0000","last_fullsized":"2024-03-30T12:36:03.220179+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.015330+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:36:03.015330+0000","last_peered":"2024-03-30T12:36:03.015330+0000","last_clean":"2024-03-30T12:36:03.015330+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:36:03.015330+0000","last_undegraded":"2024-03-30T12:36:03.015330+0000","last_fullsized":"2024-03-30T12:36:03.015330+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296394+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:37:20.296394+0000","last_peered":"2024-03-30T12:37:20.296394+0000","last_clean":"2024-03-30T12:37:20.296394+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:37:20.296394+0000","last_undegraded":"2024-03-30T12:37:20.296394+0000","last_fullsized":"2024-03-30T12:37:20.296394+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862462+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:36:40.862462+0000","last_peered":"2024-03-30T12:36:40.862462+0000","last_clean":"2024-03-30T12:36:40.862462+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:36:40.862462+0000","last_undegraded":"2024-03-30T12:36:40.862462+0000","last_fullsized":"2024-03-30T12:36:40.862462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638978+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:36:37.638978+0000","last_peered":"2024-03-30T12:36:37.638978+0000","last_clean":"2024-03-30T12:36:37.638978+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:36:37.638978+0000","last_undegraded":"2024-03-30T12:36:37.638978+0000","last_fullsized":"2024-03-30T12:36:37.638978+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221044+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:36:03.221044+0000","last_peered":"2024-03-30T12:36:03.221044+0000","last_clean":"2024-03-30T12:36:03.221044+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:36:03.221044+0000","last_undegraded":"2024-03-30T12:36:03.221044+0000","last_fullsized":"2024-03-30T12:36:03.221044+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1177,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544079+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:36:09.544079+0000","last_peered":"2024-03-30T12:36:09.544079+0000","last_clean":"2024-03-30T12:36:09.544079+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:36:09.544079+0000","last_undegraded":"2024-03-30T12:36:09.544079+0000","last_fullsized":"2024-03-30T12:36:09.544079+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1281,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.639015+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:36:37.639015+0000","last_peered":"2024-03-30T12:36:37.639015+0000","last_clean":"2024-03-30T12:36:37.639015+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:36:37.639015+0000","last_undegraded":"2024-03-30T12:36:37.639015+0000","last_fullsized":"2024-03-30T12:36:37.639015+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1238,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221612+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:36:03.221612+0000","last_peered":"2024-03-30T12:36:03.221612+0000","last_clean":"2024-03-30T12:36:03.221612+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:36:03.221612+0000","last_undegraded":"2024-03-30T12:36:03.221612+0000","last_fullsized":"2024-03-30T12:36:03.221612+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:57.641040+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:57.641040+0000","last_peered":"2024-03-30T12:36:57.641040+0000","last_clean":"2024-03-30T12:36:57.641040+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:57.641040+0000","last_undegraded":"2024-03-30T12:36:57.641040+0000","last_fullsized":"2024-03-30T12:36:57.641040+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221610+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:36:03.221610+0000","last_peered":"2024-03-30T12:36:03.221610+0000","last_clean":"2024-03-30T12:36:03.221610+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:36:03.221610+0000","last_undegraded":"2024-03-30T12:36:03.221610+0000","last_fullsized":"2024-03-30T12:36:03.221610+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220926+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:36:03.220926+0000","last_peered":"2024-03-30T12:36:03.220926+0000","last_clean":"2024-03-30T12:36:03.220926+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:36:03.220926+0000","last_undegraded":"2024-03-30T12:36:03.220926+0000","last_fullsized":"2024-03-30T12:36:03.220926+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:24.545379+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:36:24.545379+0000","last_peered":"2024-03-30T12:36:24.545379+0000","last_clean":"2024-03-30T12:36:24.545379+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:36:24.545379+0000","last_undegraded":"2024-03-30T12:36:24.545379+0000","last_fullsized":"2024-03-30T12:36:24.545379+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438066,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648122,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175132,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254370,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063189,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951246,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839303,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923585,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:39:46.538 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:46.538 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:46.539 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:46.539 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:46.539 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:46.539 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:46.539 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:46.539 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:46.539 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:46.539 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:46.539 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:46.539 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:46.539 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:46.539 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:39:47.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:46 smithi162 ceph-mon[83709]: pgmap v1101: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:47.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:46 smithi084 ceph-mon[89279]: pgmap v1101: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:47.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:46 smithi084 ceph-mon[91810]: pgmap v1101: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:48.124 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:47 smithi162 ceph-mon[83709]: from='client.34614 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:39:48.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:47 smithi084 ceph-mon[91810]: from='client.34614 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:39:48.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:47 smithi084 ceph-mon[89279]: from='client.34614 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:39:49.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:48 smithi162 ceph-mon[83709]: pgmap v1102: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:49.154 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:48 smithi084 ceph-mon[91810]: pgmap v1102: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:49.154 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:48 smithi084 ceph-mon[89279]: pgmap v1102: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:49.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:39:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:39:49] "GET /metrics HTTP/1.1" 200 36327 "" "Prometheus/2.43.0" 2024-03-30T12:39:51.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:50 smithi162 ceph-mon[83709]: pgmap v1103: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:51.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:50 smithi084 ceph-mon[89279]: pgmap v1103: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:51.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:50 smithi084 ceph-mon[91810]: pgmap v1103: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:53.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:52 smithi162 ceph-mon[83709]: pgmap v1104: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:53.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:52 smithi084 ceph-mon[91810]: pgmap v1104: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:53.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:52 smithi084 ceph-mon[89279]: pgmap v1104: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:55.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:54 smithi162 ceph-mon[83709]: pgmap v1105: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:55.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:54 smithi084 ceph-mon[91810]: pgmap v1105: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:55.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:54 smithi084 ceph-mon[89279]: pgmap v1105: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:56.541 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:39:56.761 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:39:57.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:56 smithi162 ceph-mon[83709]: pgmap v1106: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:57.170 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:56 smithi084 ceph-mon[89279]: pgmap v1106: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:57.170 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:56 smithi084 ceph-mon[91810]: pgmap v1106: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:58.553 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:39:58.555 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:39:59.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:58 smithi162 ceph-mon[83709]: pgmap v1107: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:59.138 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:58 smithi084 ceph-mon[91810]: pgmap v1107: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:59.138 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:58 smithi084 ceph-mon[89279]: pgmap v1107: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:39:59.159 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1107,"stamp":"2024-03-30T12:39:56.871918+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004047"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:34.124688+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:36:34.124688+0000","last_peered":"2024-03-30T12:36:34.124688+0000","last_clean":"2024-03-30T12:36:34.124688+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:36:34.124688+0000","last_undegraded":"2024-03-30T12:36:34.124688+0000","last_fullsized":"2024-03-30T12:36:34.124688+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1364,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904373+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:37:13.904373+0000","last_peered":"2024-03-30T12:37:13.904373+0000","last_clean":"2024-03-30T12:37:13.904373+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:37:13.904373+0000","last_undegraded":"2024-03-30T12:37:13.904373+0000","last_fullsized":"2024-03-30T12:37:13.904373+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862523+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:36:40.862523+0000","last_peered":"2024-03-30T12:36:40.862523+0000","last_clean":"2024-03-30T12:36:40.862523+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:36:40.862523+0000","last_undegraded":"2024-03-30T12:36:40.862523+0000","last_fullsized":"2024-03-30T12:36:40.862523+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:00.294130+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:37:00.294130+0000","last_peered":"2024-03-30T12:37:00.294130+0000","last_clean":"2024-03-30T12:37:00.294130+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:37:00.294130+0000","last_undegraded":"2024-03-30T12:37:00.294130+0000","last_fullsized":"2024-03-30T12:37:00.294130+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016863+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:36:03.016863+0000","last_peered":"2024-03-30T12:36:03.016863+0000","last_clean":"2024-03-30T12:36:03.016863+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:36:03.016863+0000","last_undegraded":"2024-03-30T12:36:03.016863+0000","last_fullsized":"2024-03-30T12:36:03.016863+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1210,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290374+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:30.290374+0000","last_peered":"2024-03-30T12:36:30.290374+0000","last_clean":"2024-03-30T12:36:30.290374+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:30.290374+0000","last_undegraded":"2024-03-30T12:36:30.290374+0000","last_fullsized":"2024-03-30T12:36:30.290374+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017365+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:36:03.017365+0000","last_peered":"2024-03-30T12:36:03.017365+0000","last_clean":"2024-03-30T12:36:03.017365+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:36:03.017365+0000","last_undegraded":"2024-03-30T12:36:03.017365+0000","last_fullsized":"2024-03-30T12:36:03.017365+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219781+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:36:03.219781+0000","last_peered":"2024-03-30T12:36:03.219781+0000","last_clean":"2024-03-30T12:36:03.219781+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:36:03.219781+0000","last_undegraded":"2024-03-30T12:36:03.219781+0000","last_fullsized":"2024-03-30T12:36:03.219781+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018011+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:36:03.018011+0000","last_peered":"2024-03-30T12:36:03.018011+0000","last_clean":"2024-03-30T12:36:03.018011+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:36:03.018011+0000","last_undegraded":"2024-03-30T12:36:03.018011+0000","last_fullsized":"2024-03-30T12:36:03.018011+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548505+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:54.548505+0000","last_peered":"2024-03-30T12:36:54.548505+0000","last_clean":"2024-03-30T12:36:54.548505+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:54.548505+0000","last_undegraded":"2024-03-30T12:36:54.548505+0000","last_fullsized":"2024-03-30T12:36:54.548505+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548476+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:54.548476+0000","last_peered":"2024-03-30T12:36:54.548476+0000","last_clean":"2024-03-30T12:36:54.548476+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:54.548476+0000","last_undegraded":"2024-03-30T12:36:54.548476+0000","last_fullsized":"2024-03-30T12:36:54.548476+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1270,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020253+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:36:03.020253+0000","last_peered":"2024-03-30T12:36:03.020253+0000","last_clean":"2024-03-30T12:36:03.020253+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:36:03.020253+0000","last_undegraded":"2024-03-30T12:36:03.020253+0000","last_fullsized":"2024-03-30T12:36:03.020253+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1288,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221688+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:36:03.221688+0000","last_peered":"2024-03-30T12:36:03.221688+0000","last_clean":"2024-03-30T12:36:03.221688+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:36:03.221688+0000","last_undegraded":"2024-03-30T12:36:03.221688+0000","last_fullsized":"2024-03-30T12:36:03.221688+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220487+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:36:03.220487+0000","last_peered":"2024-03-30T12:36:03.220487+0000","last_clean":"2024-03-30T12:36:03.220487+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:36:03.220487+0000","last_undegraded":"2024-03-30T12:36:03.220487+0000","last_fullsized":"2024-03-30T12:36:03.220487+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:08.897219+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:36:08.897219+0000","last_peered":"2024-03-30T12:36:08.897219+0000","last_clean":"2024-03-30T12:36:08.897219+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:36:08.897219+0000","last_undegraded":"2024-03-30T12:36:08.897219+0000","last_fullsized":"2024-03-30T12:36:08.897219+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1213,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221481+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:36:03.221481+0000","last_peered":"2024-03-30T12:36:03.221481+0000","last_clean":"2024-03-30T12:36:03.221481+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:36:03.221481+0000","last_undegraded":"2024-03-30T12:36:03.221481+0000","last_fullsized":"2024-03-30T12:36:03.221481+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1224,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.223011+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:36:03.223011+0000","last_peered":"2024-03-30T12:36:03.223011+0000","last_clean":"2024-03-30T12:36:03.223011+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:36:03.223011+0000","last_undegraded":"2024-03-30T12:36:03.223011+0000","last_fullsized":"2024-03-30T12:36:03.223011+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:43.372790+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:36:43.372790+0000","last_peered":"2024-03-30T12:36:43.372790+0000","last_clean":"2024-03-30T12:36:43.372790+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:36:43.372790+0000","last_undegraded":"2024-03-30T12:36:43.372790+0000","last_fullsized":"2024-03-30T12:36:43.372790+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128028+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:37:04.128028+0000","last_peered":"2024-03-30T12:37:04.128028+0000","last_clean":"2024-03-30T12:37:04.128028+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:37:04.128028+0000","last_undegraded":"2024-03-30T12:37:04.128028+0000","last_fullsized":"2024-03-30T12:37:04.128028+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1388,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862565+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:36:40.862565+0000","last_peered":"2024-03-30T12:36:40.862565+0000","last_clean":"2024-03-30T12:36:40.862565+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:36:40.862565+0000","last_undegraded":"2024-03-30T12:36:40.862565+0000","last_fullsized":"2024-03-30T12:36:40.862565+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1282,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220823+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:36:03.220823+0000","last_peered":"2024-03-30T12:36:03.220823+0000","last_clean":"2024-03-30T12:36:03.220823+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:36:03.220823+0000","last_undegraded":"2024-03-30T12:36:03.220823+0000","last_fullsized":"2024-03-30T12:36:03.220823+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1301,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221016+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:36:03.221016+0000","last_peered":"2024-03-30T12:36:03.221016+0000","last_clean":"2024-03-30T12:36:03.221016+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:36:03.221016+0000","last_undegraded":"2024-03-30T12:36:03.221016+0000","last_fullsized":"2024-03-30T12:36:03.221016+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862552+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:36:40.862552+0000","last_peered":"2024-03-30T12:36:40.862552+0000","last_clean":"2024-03-30T12:36:40.862552+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:36:40.862552+0000","last_undegraded":"2024-03-30T12:36:40.862552+0000","last_fullsized":"2024-03-30T12:36:40.862552+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018097+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:36:03.018097+0000","last_peered":"2024-03-30T12:36:03.018097+0000","last_clean":"2024-03-30T12:36:03.018097+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:36:03.018097+0000","last_undegraded":"2024-03-30T12:36:03.018097+0000","last_fullsized":"2024-03-30T12:36:03.018097+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1229,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290400+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:30.290400+0000","last_peered":"2024-03-30T12:36:30.290400+0000","last_clean":"2024-03-30T12:36:30.290400+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:30.290400+0000","last_undegraded":"2024-03-30T12:36:30.290400+0000","last_fullsized":"2024-03-30T12:36:30.290400+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017698+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:36:03.017698+0000","last_peered":"2024-03-30T12:36:03.017698+0000","last_clean":"2024-03-30T12:36:03.017698+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:36:03.017698+0000","last_undegraded":"2024-03-30T12:36:03.017698+0000","last_fullsized":"2024-03-30T12:36:03.017698+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1213,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290416+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:30.290416+0000","last_peered":"2024-03-30T12:36:30.290416+0000","last_clean":"2024-03-30T12:36:30.290416+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:30.290416+0000","last_undegraded":"2024-03-30T12:36:30.290416+0000","last_fullsized":"2024-03-30T12:36:30.290416+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221852+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:36:03.221852+0000","last_peered":"2024-03-30T12:36:03.221852+0000","last_clean":"2024-03-30T12:36:03.221852+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:36:03.221852+0000","last_undegraded":"2024-03-30T12:36:03.221852+0000","last_fullsized":"2024-03-30T12:36:03.221852+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018910+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:36:03.018910+0000","last_peered":"2024-03-30T12:36:03.018910+0000","last_clean":"2024-03-30T12:36:03.018910+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:36:03.018910+0000","last_undegraded":"2024-03-30T12:36:03.018910+0000","last_fullsized":"2024-03-30T12:36:03.018910+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1180,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:09.550388+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:37:09.550388+0000","last_peered":"2024-03-30T12:37:09.550388+0000","last_clean":"2024-03-30T12:37:09.550388+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:37:09.550388+0000","last_undegraded":"2024-03-30T12:37:09.550388+0000","last_fullsized":"2024-03-30T12:37:09.550388+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.860010+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:36:15.860010+0000","last_peered":"2024-03-30T12:36:15.860010+0000","last_clean":"2024-03-30T12:36:15.860010+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:36:15.860010+0000","last_undegraded":"2024-03-30T12:36:15.860010+0000","last_fullsized":"2024-03-30T12:36:15.860010+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219839+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:36:03.219839+0000","last_peered":"2024-03-30T12:36:03.219839+0000","last_clean":"2024-03-30T12:36:03.219839+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:36:03.219839+0000","last_undegraded":"2024-03-30T12:36:03.219839+0000","last_fullsized":"2024-03-30T12:36:03.219839+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1294,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219823+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:36:03.219823+0000","last_peered":"2024-03-30T12:36:03.219823+0000","last_clean":"2024-03-30T12:36:03.219823+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:36:03.219823+0000","last_undegraded":"2024-03-30T12:36:03.219823+0000","last_fullsized":"2024-03-30T12:36:03.219823+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1224,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288884+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:36:15.288884+0000","last_peered":"2024-03-30T12:36:15.288884+0000","last_clean":"2024-03-30T12:36:15.288884+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:36:15.288884+0000","last_undegraded":"2024-03-30T12:36:15.288884+0000","last_fullsized":"2024-03-30T12:36:15.288884+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:28.899208+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:36:28.899208+0000","last_peered":"2024-03-30T12:36:28.899208+0000","last_clean":"2024-03-30T12:36:28.899208+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:36:28.899208+0000","last_undegraded":"2024-03-30T12:36:28.899208+0000","last_fullsized":"2024-03-30T12:36:28.899208+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548518+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:54.548518+0000","last_peered":"2024-03-30T12:36:54.548518+0000","last_clean":"2024-03-30T12:36:54.548518+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:54.548518+0000","last_undegraded":"2024-03-30T12:36:54.548518+0000","last_fullsized":"2024-03-30T12:36:54.548518+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1204,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288944+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:36:15.288944+0000","last_peered":"2024-03-30T12:36:15.288944+0000","last_clean":"2024-03-30T12:36:15.288944+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:36:15.288944+0000","last_undegraded":"2024-03-30T12:36:15.288944+0000","last_fullsized":"2024-03-30T12:36:15.288944+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1198,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288933+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:36:15.288933+0000","last_peered":"2024-03-30T12:36:15.288933+0000","last_clean":"2024-03-30T12:36:15.288933+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:36:15.288933+0000","last_undegraded":"2024-03-30T12:36:15.288933+0000","last_fullsized":"2024-03-30T12:36:15.288933+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:03.374890+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:37:03.374890+0000","last_peered":"2024-03-30T12:37:03.374890+0000","last_clean":"2024-03-30T12:37:03.374890+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:37:03.374890+0000","last_undegraded":"2024-03-30T12:37:03.374890+0000","last_fullsized":"2024-03-30T12:37:03.374890+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:28.899251+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:36:28.899251+0000","last_peered":"2024-03-30T12:36:28.899251+0000","last_clean":"2024-03-30T12:36:28.899251+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:36:28.899251+0000","last_undegraded":"2024-03-30T12:36:28.899251+0000","last_fullsized":"2024-03-30T12:36:28.899251+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020091+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:36:03.020091+0000","last_peered":"2024-03-30T12:36:03.020091+0000","last_clean":"2024-03-30T12:36:03.020091+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:36:03.020091+0000","last_undegraded":"2024-03-30T12:36:03.020091+0000","last_fullsized":"2024-03-30T12:36:03.020091+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546935+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:36:39.546935+0000","last_peered":"2024-03-30T12:36:39.546935+0000","last_clean":"2024-03-30T12:36:39.546935+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:36:39.546935+0000","last_undegraded":"2024-03-30T12:36:39.546935+0000","last_fullsized":"2024-03-30T12:36:39.546935+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017435+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:36:03.017435+0000","last_peered":"2024-03-30T12:36:03.017435+0000","last_clean":"2024-03-30T12:36:03.017435+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:36:03.017435+0000","last_undegraded":"2024-03-30T12:36:03.017435+0000","last_fullsized":"2024-03-30T12:36:03.017435+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221769+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:36:03.221769+0000","last_peered":"2024-03-30T12:36:03.221769+0000","last_clean":"2024-03-30T12:36:03.221769+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:36:03.221769+0000","last_undegraded":"2024-03-30T12:36:03.221769+0000","last_fullsized":"2024-03-30T12:36:03.221769+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220786+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:36:03.220786+0000","last_peered":"2024-03-30T12:36:03.220786+0000","last_clean":"2024-03-30T12:36:03.220786+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:36:03.220786+0000","last_undegraded":"2024-03-30T12:36:03.220786+0000","last_fullsized":"2024-03-30T12:36:03.220786+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221971+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:36:03.221971+0000","last_peered":"2024-03-30T12:36:03.221971+0000","last_clean":"2024-03-30T12:36:03.221971+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:36:03.221971+0000","last_undegraded":"2024-03-30T12:36:03.221971+0000","last_fullsized":"2024-03-30T12:36:03.221971+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:19.129793+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:37:19.129793+0000","last_peered":"2024-03-30T12:37:19.129793+0000","last_clean":"2024-03-30T12:37:19.129793+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:37:19.129793+0000","last_undegraded":"2024-03-30T12:37:19.129793+0000","last_fullsized":"2024-03-30T12:37:19.129793+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546908+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:36:39.546908+0000","last_peered":"2024-03-30T12:36:39.546908+0000","last_clean":"2024-03-30T12:36:39.546908+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:36:39.546908+0000","last_undegraded":"2024-03-30T12:36:39.546908+0000","last_fullsized":"2024-03-30T12:36:39.546908+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546882+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:36:39.546882+0000","last_peered":"2024-03-30T12:36:39.546882+0000","last_clean":"2024-03-30T12:36:39.546882+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:36:39.546882+0000","last_undegraded":"2024-03-30T12:36:39.546882+0000","last_fullsized":"2024-03-30T12:36:39.546882+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1344,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:43.372738+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:36:43.372738+0000","last_peered":"2024-03-30T12:36:43.372738+0000","last_clean":"2024-03-30T12:36:43.372738+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:36:43.372738+0000","last_undegraded":"2024-03-30T12:36:43.372738+0000","last_fullsized":"2024-03-30T12:36:43.372738+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:19.129759+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:37:19.129759+0000","last_peered":"2024-03-30T12:37:19.129759+0000","last_clean":"2024-03-30T12:37:19.129759+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:37:19.129759+0000","last_undegraded":"2024-03-30T12:37:19.129759+0000","last_fullsized":"2024-03-30T12:37:19.129759+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5752,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.367799+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:36:03.367799+0000","last_peered":"2024-03-30T12:36:03.367799+0000","last_clean":"2024-03-30T12:36:03.367799+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:36:03.367799+0000","last_undegraded":"2024-03-30T12:36:03.367799+0000","last_fullsized":"2024-03-30T12:36:03.367799+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1275,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:32.280622+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:37:32.280622+0000","last_peered":"2024-03-30T12:37:32.280622+0000","last_clean":"2024-03-30T12:37:32.280622+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:37:32.280622+0000","last_undegraded":"2024-03-30T12:37:32.280622+0000","last_fullsized":"2024-03-30T12:37:32.280622+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128039+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:37:04.128039+0000","last_peered":"2024-03-30T12:37:04.128039+0000","last_clean":"2024-03-30T12:37:04.128039+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:37:04.128039+0000","last_undegraded":"2024-03-30T12:37:04.128039+0000","last_fullsized":"2024-03-30T12:37:04.128039+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5513,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:40.862481+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:36:40.862481+0000","last_peered":"2024-03-30T12:36:40.862481+0000","last_clean":"2024-03-30T12:36:40.862481+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:36:40.862481+0000","last_undegraded":"2024-03-30T12:36:40.862481+0000","last_fullsized":"2024-03-30T12:36:40.862481+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904270+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:37:13.904270+0000","last_peered":"2024-03-30T12:37:13.904270+0000","last_clean":"2024-03-30T12:37:13.904270+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:37:13.904270+0000","last_undegraded":"2024-03-30T12:37:13.904270+0000","last_fullsized":"2024-03-30T12:37:13.904270+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904297+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:37:13.904297+0000","last_peered":"2024-03-30T12:37:13.904297+0000","last_clean":"2024-03-30T12:37:13.904297+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:37:13.904297+0000","last_undegraded":"2024-03-30T12:37:13.904297+0000","last_fullsized":"2024-03-30T12:37:13.904297+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296466+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:37:20.296466+0000","last_peered":"2024-03-30T12:37:20.296466+0000","last_clean":"2024-03-30T12:37:20.296466+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:37:20.296466+0000","last_undegraded":"2024-03-30T12:37:20.296466+0000","last_fullsized":"2024-03-30T12:37:20.296466+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5458,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:40.862535+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:36:40.862535+0000","last_peered":"2024-03-30T12:36:40.862535+0000","last_clean":"2024-03-30T12:36:40.862535+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:36:40.862535+0000","last_undegraded":"2024-03-30T12:36:40.862535+0000","last_fullsized":"2024-03-30T12:36:40.862535+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904314+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:37:13.904314+0000","last_peered":"2024-03-30T12:37:13.904314+0000","last_clean":"2024-03-30T12:37:13.904314+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:37:13.904314+0000","last_undegraded":"2024-03-30T12:37:13.904314+0000","last_fullsized":"2024-03-30T12:37:13.904314+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1207,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296362+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:37:20.296362+0000","last_peered":"2024-03-30T12:37:20.296362+0000","last_clean":"2024-03-30T12:37:20.296362+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:37:20.296362+0000","last_undegraded":"2024-03-30T12:37:20.296362+0000","last_fullsized":"2024-03-30T12:37:20.296362+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1272,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:52.276088+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:36:52.276088+0000","last_peered":"2024-03-30T12:36:52.276088+0000","last_clean":"2024-03-30T12:36:52.276088+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:36:52.276088+0000","last_undegraded":"2024-03-30T12:36:52.276088+0000","last_fullsized":"2024-03-30T12:36:52.276088+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3803,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.367883+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:36:03.367883+0000","last_peered":"2024-03-30T12:36:03.367883+0000","last_clean":"2024-03-30T12:36:03.367883+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:36:03.367883+0000","last_undegraded":"2024-03-30T12:36:03.367883+0000","last_fullsized":"2024-03-30T12:36:03.367883+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1343,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906884+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:37:38.906884+0000","last_peered":"2024-03-30T12:37:38.906884+0000","last_clean":"2024-03-30T12:37:38.906884+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:37:38.906884+0000","last_undegraded":"2024-03-30T12:37:38.906884+0000","last_fullsized":"2024-03-30T12:37:38.906884+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:48.901383+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:36:48.901383+0000","last_peered":"2024-03-30T12:36:48.901383+0000","last_clean":"2024-03-30T12:36:48.901383+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:36:48.901383+0000","last_undegraded":"2024-03-30T12:36:48.901383+0000","last_fullsized":"2024-03-30T12:36:48.901383+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:48.380185+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:37:48.380185+0000","last_peered":"2024-03-30T12:37:48.380185+0000","last_clean":"2024-03-30T12:37:48.380185+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:37:48.380185+0000","last_undegraded":"2024-03-30T12:37:48.380185+0000","last_fullsized":"2024-03-30T12:37:48.380185+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4576,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:34.124620+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:36:34.124620+0000","last_peered":"2024-03-30T12:36:34.124620+0000","last_clean":"2024-03-30T12:36:34.124620+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:36:34.124620+0000","last_undegraded":"2024-03-30T12:36:34.124620+0000","last_fullsized":"2024-03-30T12:36:34.124620+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1174,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220771+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:36:03.220771+0000","last_peered":"2024-03-30T12:36:03.220771+0000","last_clean":"2024-03-30T12:36:03.220771+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:36:03.220771+0000","last_undegraded":"2024-03-30T12:36:03.220771+0000","last_fullsized":"2024-03-30T12:36:03.220771+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:17.636728+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:36:17.636728+0000","last_peered":"2024-03-30T12:36:17.636728+0000","last_clean":"2024-03-30T12:36:17.636728+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:36:17.636728+0000","last_undegraded":"2024-03-30T12:36:17.636728+0000","last_fullsized":"2024-03-30T12:36:17.636728+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1200,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296444+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:37:20.296444+0000","last_peered":"2024-03-30T12:37:20.296444+0000","last_clean":"2024-03-30T12:37:20.296444+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:37:20.296444+0000","last_undegraded":"2024-03-30T12:37:20.296444+0000","last_fullsized":"2024-03-30T12:37:20.296444+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1716,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:19.123078+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:36:19.123078+0000","last_peered":"2024-03-30T12:36:19.123078+0000","last_clean":"2024-03-30T12:36:19.123078+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:36:19.123078+0000","last_undegraded":"2024-03-30T12:36:19.123078+0000","last_fullsized":"2024-03-30T12:36:19.123078+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24714,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:40.298683+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:37:40.298683+0000","last_peered":"2024-03-30T12:37:40.298683+0000","last_clean":"2024-03-30T12:37:40.298683+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:37:40.298683+0000","last_undegraded":"2024-03-30T12:37:40.298683+0000","last_fullsized":"2024-03-30T12:37:40.298683+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:05.865263+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:37:05.865263+0000","last_peered":"2024-03-30T12:37:05.865263+0000","last_clean":"2024-03-30T12:37:05.865263+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:37:05.865263+0000","last_undegraded":"2024-03-30T12:37:05.865263+0000","last_fullsized":"2024-03-30T12:37:05.865263+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862413+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:36:40.862413+0000","last_peered":"2024-03-30T12:36:40.862413+0000","last_clean":"2024-03-30T12:36:40.862413+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:36:40.862413+0000","last_undegraded":"2024-03-30T12:36:40.862413+0000","last_fullsized":"2024-03-30T12:36:40.862413+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:19.123052+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:36:19.123052+0000","last_peered":"2024-03-30T12:36:19.123052+0000","last_clean":"2024-03-30T12:36:19.123052+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:36:19.123052+0000","last_undegraded":"2024-03-30T12:36:19.123052+0000","last_fullsized":"2024-03-30T12:36:19.123052+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16480,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.221717+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:36:03.221717+0000","last_peered":"2024-03-30T12:36:03.221717+0000","last_clean":"2024-03-30T12:36:03.221717+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:36:03.221717+0000","last_undegraded":"2024-03-30T12:36:03.221717+0000","last_fullsized":"2024-03-30T12:36:03.221717+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862510+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:36:40.862510+0000","last_peered":"2024-03-30T12:36:40.862510+0000","last_clean":"2024-03-30T12:36:40.862510+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:36:40.862510+0000","last_undegraded":"2024-03-30T12:36:40.862510+0000","last_fullsized":"2024-03-30T12:36:40.862510+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:34.124667+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:36:34.124667+0000","last_peered":"2024-03-30T12:36:34.124667+0000","last_clean":"2024-03-30T12:36:34.124667+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:36:34.124667+0000","last_undegraded":"2024-03-30T12:36:34.124667+0000","last_fullsized":"2024-03-30T12:36:34.124667+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904330+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:37:13.904330+0000","last_peered":"2024-03-30T12:37:13.904330+0000","last_clean":"2024-03-30T12:37:13.904330+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:37:13.904330+0000","last_undegraded":"2024-03-30T12:37:13.904330+0000","last_fullsized":"2024-03-30T12:37:13.904330+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31269,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:52.276052+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:36:52.276052+0000","last_peered":"2024-03-30T12:36:52.276052+0000","last_clean":"2024-03-30T12:36:52.276052+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:36:52.276052+0000","last_undegraded":"2024-03-30T12:36:52.276052+0000","last_fullsized":"2024-03-30T12:36:52.276052+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1294,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219916+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:36:03.219916+0000","last_peered":"2024-03-30T12:36:03.219916+0000","last_clean":"2024-03-30T12:36:03.219916+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:36:03.219916+0000","last_undegraded":"2024-03-30T12:36:03.219916+0000","last_fullsized":"2024-03-30T12:36:03.219916+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906874+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:37:38.906874+0000","last_peered":"2024-03-30T12:37:38.906874+0000","last_clean":"2024-03-30T12:37:38.906874+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:37:38.906874+0000","last_undegraded":"2024-03-30T12:37:38.906874+0000","last_fullsized":"2024-03-30T12:37:38.906874+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638999+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:36:37.638999+0000","last_peered":"2024-03-30T12:36:37.638999+0000","last_clean":"2024-03-30T12:36:37.638999+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:36:37.638999+0000","last_undegraded":"2024-03-30T12:36:37.638999+0000","last_fullsized":"2024-03-30T12:36:37.638999+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3764,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220021+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:36:03.220021+0000","last_peered":"2024-03-30T12:36:03.220021+0000","last_clean":"2024-03-30T12:36:03.220021+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:36:03.220021+0000","last_undegraded":"2024-03-30T12:36:03.220021+0000","last_fullsized":"2024-03-30T12:36:03.220021+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:52.276014+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:36:52.276014+0000","last_peered":"2024-03-30T12:36:52.276014+0000","last_clean":"2024-03-30T12:36:52.276014+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:36:52.276014+0000","last_undegraded":"2024-03-30T12:36:52.276014+0000","last_fullsized":"2024-03-30T12:36:52.276014+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544094+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:36:09.544094+0000","last_peered":"2024-03-30T12:36:09.544094+0000","last_clean":"2024-03-30T12:36:09.544094+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:36:09.544094+0000","last_undegraded":"2024-03-30T12:36:09.544094+0000","last_fullsized":"2024-03-30T12:36:09.544094+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:05.865242+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:37:05.865242+0000","last_peered":"2024-03-30T12:37:05.865242+0000","last_clean":"2024-03-30T12:37:05.865242+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:37:05.865242+0000","last_undegraded":"2024-03-30T12:37:05.865242+0000","last_fullsized":"2024-03-30T12:37:05.865242+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15593,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223541+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:36:03.223541+0000","last_peered":"2024-03-30T12:36:03.223541+0000","last_clean":"2024-03-30T12:36:03.223541+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:36:03.223541+0000","last_undegraded":"2024-03-30T12:36:03.223541+0000","last_fullsized":"2024-03-30T12:36:03.223541+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1143,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:49.126219+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:36:49.126219+0000","last_peered":"2024-03-30T12:36:49.126219+0000","last_clean":"2024-03-30T12:36:49.126219+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:36:49.126219+0000","last_undegraded":"2024-03-30T12:36:49.126219+0000","last_fullsized":"2024-03-30T12:36:49.126219+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:12.278399+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:37:12.278399+0000","last_peered":"2024-03-30T12:37:12.278399+0000","last_clean":"2024-03-30T12:37:12.278399+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:37:12.278399+0000","last_undegraded":"2024-03-30T12:37:12.278399+0000","last_fullsized":"2024-03-30T12:37:12.278399+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29020,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:32.280556+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:37:32.280556+0000","last_peered":"2024-03-30T12:37:32.280556+0000","last_clean":"2024-03-30T12:37:32.280556+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:37:32.280556+0000","last_undegraded":"2024-03-30T12:37:32.280556+0000","last_fullsized":"2024-03-30T12:37:32.280556+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906809+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:37:38.906809+0000","last_peered":"2024-03-30T12:37:38.906809+0000","last_clean":"2024-03-30T12:37:38.906809+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:37:38.906809+0000","last_undegraded":"2024-03-30T12:37:38.906809+0000","last_fullsized":"2024-03-30T12:37:38.906809+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638944+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:36:37.638944+0000","last_peered":"2024-03-30T12:36:37.638944+0000","last_clean":"2024-03-30T12:36:37.638944+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:36:37.638944+0000","last_undegraded":"2024-03-30T12:36:37.638944+0000","last_fullsized":"2024-03-30T12:36:37.638944+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5610,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:23.370279+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:36:23.370279+0000","last_peered":"2024-03-30T12:36:23.370279+0000","last_clean":"2024-03-30T12:36:23.370279+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:36:23.370279+0000","last_undegraded":"2024-03-30T12:36:23.370279+0000","last_fullsized":"2024-03-30T12:36:23.370279+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1365,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906835+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:37:38.906835+0000","last_peered":"2024-03-30T12:37:38.906835+0000","last_clean":"2024-03-30T12:37:38.906835+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:37:38.906835+0000","last_undegraded":"2024-03-30T12:37:38.906835+0000","last_fullsized":"2024-03-30T12:37:38.906835+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:57.641061+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:57.641061+0000","last_peered":"2024-03-30T12:36:57.641061+0000","last_clean":"2024-03-30T12:36:57.641061+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:57.641061+0000","last_undegraded":"2024-03-30T12:36:57.641061+0000","last_fullsized":"2024-03-30T12:36:57.641061+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222932+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:36:03.222932+0000","last_peered":"2024-03-30T12:36:03.222932+0000","last_clean":"2024-03-30T12:36:03.222932+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:36:03.222932+0000","last_undegraded":"2024-03-30T12:36:03.222932+0000","last_fullsized":"2024-03-30T12:36:03.222932+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.127976+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:37:04.127976+0000","last_peered":"2024-03-30T12:37:04.127976+0000","last_clean":"2024-03-30T12:37:04.127976+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:37:04.127976+0000","last_undegraded":"2024-03-30T12:37:04.127976+0000","last_fullsized":"2024-03-30T12:37:04.127976+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544025+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:36:09.544025+0000","last_peered":"2024-03-30T12:36:09.544025+0000","last_clean":"2024-03-30T12:36:09.544025+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:36:09.544025+0000","last_undegraded":"2024-03-30T12:36:09.544025+0000","last_fullsized":"2024-03-30T12:36:09.544025+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5253,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:23.370200+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:36:23.370200+0000","last_peered":"2024-03-30T12:36:23.370200+0000","last_clean":"2024-03-30T12:36:23.370200+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:36:23.370200+0000","last_undegraded":"2024-03-30T12:36:23.370200+0000","last_fullsized":"2024-03-30T12:36:23.370200+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:23.370243+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:36:23.370243+0000","last_peered":"2024-03-30T12:36:23.370243+0000","last_clean":"2024-03-30T12:36:23.370243+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:36:23.370243+0000","last_undegraded":"2024-03-30T12:36:23.370243+0000","last_fullsized":"2024-03-30T12:36:23.370243+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128016+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:37:04.128016+0000","last_peered":"2024-03-30T12:37:04.128016+0000","last_clean":"2024-03-30T12:37:04.128016+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:37:04.128016+0000","last_undegraded":"2024-03-30T12:37:04.128016+0000","last_fullsized":"2024-03-30T12:37:04.128016+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4810,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.367842+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:36:03.367842+0000","last_peered":"2024-03-30T12:36:03.367842+0000","last_clean":"2024-03-30T12:36:03.367842+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:36:03.367842+0000","last_undegraded":"2024-03-30T12:36:03.367842+0000","last_fullsized":"2024-03-30T12:36:03.367842+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220953+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:36:03.220953+0000","last_peered":"2024-03-30T12:36:03.220953+0000","last_clean":"2024-03-30T12:36:03.220953+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:36:03.220953+0000","last_undegraded":"2024-03-30T12:36:03.220953+0000","last_fullsized":"2024-03-30T12:36:03.220953+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222608+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:36:03.222608+0000","last_peered":"2024-03-30T12:36:03.222608+0000","last_clean":"2024-03-30T12:36:03.222608+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:36:03.222608+0000","last_undegraded":"2024-03-30T12:36:03.222608+0000","last_fullsized":"2024-03-30T12:36:03.222608+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6743,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:49.126256+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:36:49.126256+0000","last_peered":"2024-03-30T12:36:49.126256+0000","last_clean":"2024-03-30T12:36:49.126256+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:36:49.126256+0000","last_undegraded":"2024-03-30T12:36:49.126256+0000","last_fullsized":"2024-03-30T12:36:49.126256+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1337,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:23.370314+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:36:23.370314+0000","last_peered":"2024-03-30T12:36:23.370314+0000","last_clean":"2024-03-30T12:36:23.370314+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:36:23.370314+0000","last_undegraded":"2024-03-30T12:36:23.370314+0000","last_fullsized":"2024-03-30T12:36:23.370314+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128054+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:37:04.128054+0000","last_peered":"2024-03-30T12:37:04.128054+0000","last_clean":"2024-03-30T12:37:04.128054+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:37:04.128054+0000","last_undegraded":"2024-03-30T12:37:04.128054+0000","last_fullsized":"2024-03-30T12:37:04.128054+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220179+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:36:03.220179+0000","last_peered":"2024-03-30T12:36:03.220179+0000","last_clean":"2024-03-30T12:36:03.220179+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:36:03.220179+0000","last_undegraded":"2024-03-30T12:36:03.220179+0000","last_fullsized":"2024-03-30T12:36:03.220179+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:48.380210+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:37:48.380210+0000","last_peered":"2024-03-30T12:37:48.380210+0000","last_clean":"2024-03-30T12:37:48.380210+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:37:48.380210+0000","last_undegraded":"2024-03-30T12:37:48.380210+0000","last_fullsized":"2024-03-30T12:37:48.380210+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296394+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:37:20.296394+0000","last_peered":"2024-03-30T12:37:20.296394+0000","last_clean":"2024-03-30T12:37:20.296394+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:37:20.296394+0000","last_undegraded":"2024-03-30T12:37:20.296394+0000","last_fullsized":"2024-03-30T12:37:20.296394+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862462+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:36:40.862462+0000","last_peered":"2024-03-30T12:36:40.862462+0000","last_clean":"2024-03-30T12:36:40.862462+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:36:40.862462+0000","last_undegraded":"2024-03-30T12:36:40.862462+0000","last_fullsized":"2024-03-30T12:36:40.862462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638978+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:36:37.638978+0000","last_peered":"2024-03-30T12:36:37.638978+0000","last_clean":"2024-03-30T12:36:37.638978+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:36:37.638978+0000","last_undegraded":"2024-03-30T12:36:37.638978+0000","last_fullsized":"2024-03-30T12:36:37.638978+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906859+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:37:38.906859+0000","last_peered":"2024-03-30T12:37:38.906859+0000","last_clean":"2024-03-30T12:37:38.906859+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:37:38.906859+0000","last_undegraded":"2024-03-30T12:37:38.906859+0000","last_fullsized":"2024-03-30T12:37:38.906859+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1177,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544079+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:36:09.544079+0000","last_peered":"2024-03-30T12:36:09.544079+0000","last_clean":"2024-03-30T12:36:09.544079+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:36:09.544079+0000","last_undegraded":"2024-03-30T12:36:09.544079+0000","last_fullsized":"2024-03-30T12:36:09.544079+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1281,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.639015+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:36:37.639015+0000","last_peered":"2024-03-30T12:36:37.639015+0000","last_clean":"2024-03-30T12:36:37.639015+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:36:37.639015+0000","last_undegraded":"2024-03-30T12:36:37.639015+0000","last_fullsized":"2024-03-30T12:36:37.639015+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:40.298625+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:37:40.298625+0000","last_peered":"2024-03-30T12:37:40.298625+0000","last_clean":"2024-03-30T12:37:40.298625+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:37:40.298625+0000","last_undegraded":"2024-03-30T12:37:40.298625+0000","last_fullsized":"2024-03-30T12:37:40.298625+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:57.641040+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:57.641040+0000","last_peered":"2024-03-30T12:36:57.641040+0000","last_clean":"2024-03-30T12:36:57.641040+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:57.641040+0000","last_undegraded":"2024-03-30T12:36:57.641040+0000","last_fullsized":"2024-03-30T12:36:57.641040+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221610+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:36:03.221610+0000","last_peered":"2024-03-30T12:36:03.221610+0000","last_clean":"2024-03-30T12:36:03.221610+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:36:03.221610+0000","last_undegraded":"2024-03-30T12:36:03.221610+0000","last_fullsized":"2024-03-30T12:36:03.221610+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:30.867819+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:37:30.867819+0000","last_peered":"2024-03-30T12:37:30.867819+0000","last_clean":"2024-03-30T12:37:30.867819+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:37:30.867819+0000","last_undegraded":"2024-03-30T12:37:30.867819+0000","last_fullsized":"2024-03-30T12:37:30.867819+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:24.545379+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:36:24.545379+0000","last_peered":"2024-03-30T12:36:24.545379+0000","last_clean":"2024-03-30T12:36:24.545379+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:36:24.545379+0000","last_undegraded":"2024-03-30T12:36:24.545379+0000","last_fullsized":"2024-03-30T12:36:24.545379+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438068,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648124,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175134,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254373,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063191,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951248,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839305,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923588,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:39:59.165 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:59.165 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:59.165 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:59.165 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:59.165 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:59.165 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:59.165 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:59.165 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:59.165 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:59.165 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:59.165 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:59.165 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:59.165 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:39:59.166 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:39:59.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:39:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:39:59] "GET /metrics HTTP/1.1" 200 36327 "" "Prometheus/2.43.0" 2024-03-30T12:40:00.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:59 smithi162 ceph-mon[83709]: from='client.44555 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:40:00.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:39:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:40:00.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:59 smithi084 ceph-mon[91810]: from='client.44555 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:40:00.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:39:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:40:00.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:59 smithi084 ceph-mon[89279]: from='client.44555 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:40:00.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:39:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:40:00.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:39:59.999+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR Possible data damage: 13 pgs snaptrim_error 2024-03-30T12:40:00.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:39:59.999+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : [ERR] PG_DAMAGED: Possible data damage: 13 pgs snaptrim_error 2024-03-30T12:40:00.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:39:59.999+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : pg 5.1 is active+clean+snaptrim_error, acting [4,3,7] 2024-03-30T12:40:00.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:39:59.999+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : pg 5.2 is active+clean+snaptrim_error, acting [6,0,5] 2024-03-30T12:40:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:39:59.999+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : pg 5.3 is active+clean+snaptrim_error, acting [0,3,6] 2024-03-30T12:40:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:39:59.999+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : pg 5.4 is active+clean+snaptrim_error, acting [7,2,5] 2024-03-30T12:40:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:40:00.000+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : pg 5.5 is active+clean+snaptrim_error, acting [0,1,4] 2024-03-30T12:40:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:40:00.000+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : pg 5.7 is active+clean+snaptrim_error, acting [5,1,0] 2024-03-30T12:40:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:40:00.000+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : pg 5.8 is active+clean+snaptrim_error, acting [2,0,1] 2024-03-30T12:40:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:40:00.000+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : pg 5.9 is active+clean+snaptrim_error, acting [7,6,1] 2024-03-30T12:40:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:40:00.000+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : pg 5.a is active+clean+snaptrim_error, acting [2,4,3] 2024-03-30T12:40:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:40:00.000+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : pg 5.b is active+clean+snaptrim_error, acting [2,0,5] 2024-03-30T12:40:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:40:00.000+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : pg 5.d is active+clean+snaptrim_error, acting [2,7,5] 2024-03-30T12:40:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:40:00.000+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : pg 5.e is active+clean+snaptrim_error, acting [4,5,0] 2024-03-30T12:40:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:40:00.000+0000 7f11024fc700 -1 log_channel(cluster) log [ERR] : pg 5.f is active+clean+snaptrim_error, acting [5,4,6] 2024-03-30T12:40:01.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:00 smithi162 ceph-mon[83709]: pgmap v1108: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:01.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:00 smithi162 ceph-mon[83709]: Health detail: HEALTH_ERR Possible data damage: 13 pgs snaptrim_error 2024-03-30T12:40:01.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:00 smithi162 ceph-mon[83709]: [ERR] PG_DAMAGED: Possible data damage: 13 pgs snaptrim_error 2024-03-30T12:40:01.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:00 smithi162 ceph-mon[83709]: pg 5.1 is active+clean+snaptrim_error, acting [4,3,7] 2024-03-30T12:40:01.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:00 smithi162 ceph-mon[83709]: pg 5.2 is active+clean+snaptrim_error, acting [6,0,5] 2024-03-30T12:40:01.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:00 smithi162 ceph-mon[83709]: pg 5.3 is active+clean+snaptrim_error, acting [0,3,6] 2024-03-30T12:40:01.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:00 smithi162 ceph-mon[83709]: pg 5.4 is active+clean+snaptrim_error, acting [7,2,5] 2024-03-30T12:40:01.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:00 smithi162 ceph-mon[83709]: pg 5.5 is active+clean+snaptrim_error, acting [0,1,4] 2024-03-30T12:40:01.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:00 smithi162 ceph-mon[83709]: pg 5.7 is active+clean+snaptrim_error, acting [5,1,0] 2024-03-30T12:40:01.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:00 smithi162 ceph-mon[83709]: pg 5.8 is active+clean+snaptrim_error, acting [2,0,1] 2024-03-30T12:40:01.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:00 smithi162 ceph-mon[83709]: pg 5.9 is active+clean+snaptrim_error, acting [7,6,1] 2024-03-30T12:40:01.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:00 smithi162 ceph-mon[83709]: pg 5.a is active+clean+snaptrim_error, acting [2,4,3] 2024-03-30T12:40:01.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:00 smithi162 ceph-mon[83709]: pg 5.b is active+clean+snaptrim_error, acting [2,0,5] 2024-03-30T12:40:01.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:00 smithi162 ceph-mon[83709]: pg 5.d is active+clean+snaptrim_error, acting [2,7,5] 2024-03-30T12:40:01.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:00 smithi162 ceph-mon[83709]: pg 5.e is active+clean+snaptrim_error, acting [4,5,0] 2024-03-30T12:40:01.121 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:00 smithi162 ceph-mon[83709]: pg 5.f is active+clean+snaptrim_error, acting [5,4,6] 2024-03-30T12:40:01.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[91810]: pgmap v1108: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:01.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[91810]: Health detail: HEALTH_ERR Possible data damage: 13 pgs snaptrim_error 2024-03-30T12:40:01.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[91810]: [ERR] PG_DAMAGED: Possible data damage: 13 pgs snaptrim_error 2024-03-30T12:40:01.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[91810]: pg 5.1 is active+clean+snaptrim_error, acting [4,3,7] 2024-03-30T12:40:01.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[91810]: pg 5.2 is active+clean+snaptrim_error, acting [6,0,5] 2024-03-30T12:40:01.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[91810]: pg 5.3 is active+clean+snaptrim_error, acting [0,3,6] 2024-03-30T12:40:01.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[91810]: pg 5.4 is active+clean+snaptrim_error, acting [7,2,5] 2024-03-30T12:40:01.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[91810]: pg 5.5 is active+clean+snaptrim_error, acting [0,1,4] 2024-03-30T12:40:01.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[91810]: pg 5.7 is active+clean+snaptrim_error, acting [5,1,0] 2024-03-30T12:40:01.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[91810]: pg 5.8 is active+clean+snaptrim_error, acting [2,0,1] 2024-03-30T12:40:01.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[91810]: pg 5.9 is active+clean+snaptrim_error, acting [7,6,1] 2024-03-30T12:40:01.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[91810]: pg 5.a is active+clean+snaptrim_error, acting [2,4,3] 2024-03-30T12:40:01.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[91810]: pg 5.b is active+clean+snaptrim_error, acting [2,0,5] 2024-03-30T12:40:01.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[91810]: pg 5.d is active+clean+snaptrim_error, acting [2,7,5] 2024-03-30T12:40:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[91810]: pg 5.e is active+clean+snaptrim_error, acting [4,5,0] 2024-03-30T12:40:01.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[91810]: pg 5.f is active+clean+snaptrim_error, acting [5,4,6] 2024-03-30T12:40:01.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[89279]: pgmap v1108: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:01.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[89279]: Health detail: HEALTH_ERR Possible data damage: 13 pgs snaptrim_error 2024-03-30T12:40:01.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[89279]: [ERR] PG_DAMAGED: Possible data damage: 13 pgs snaptrim_error 2024-03-30T12:40:01.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[89279]: pg 5.1 is active+clean+snaptrim_error, acting [4,3,7] 2024-03-30T12:40:01.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[89279]: pg 5.2 is active+clean+snaptrim_error, acting [6,0,5] 2024-03-30T12:40:01.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[89279]: pg 5.3 is active+clean+snaptrim_error, acting [0,3,6] 2024-03-30T12:40:01.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[89279]: pg 5.4 is active+clean+snaptrim_error, acting [7,2,5] 2024-03-30T12:40:01.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[89279]: pg 5.5 is active+clean+snaptrim_error, acting [0,1,4] 2024-03-30T12:40:01.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[89279]: pg 5.7 is active+clean+snaptrim_error, acting [5,1,0] 2024-03-30T12:40:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[89279]: pg 5.8 is active+clean+snaptrim_error, acting [2,0,1] 2024-03-30T12:40:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[89279]: pg 5.9 is active+clean+snaptrim_error, acting [7,6,1] 2024-03-30T12:40:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[89279]: pg 5.a is active+clean+snaptrim_error, acting [2,4,3] 2024-03-30T12:40:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[89279]: pg 5.b is active+clean+snaptrim_error, acting [2,0,5] 2024-03-30T12:40:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[89279]: pg 5.d is active+clean+snaptrim_error, acting [2,7,5] 2024-03-30T12:40:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[89279]: pg 5.e is active+clean+snaptrim_error, acting [4,5,0] 2024-03-30T12:40:01.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:00 smithi084 ceph-mon[89279]: pg 5.f is active+clean+snaptrim_error, acting [5,4,6] 2024-03-30T12:40:02.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:01 smithi162 ceph-mon[83709]: pgmap v1109: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:02.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:01 smithi084 ceph-mon[91810]: pgmap v1109: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:02.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:01 smithi084 ceph-mon[89279]: pgmap v1109: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:04.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:03 smithi084 ceph-mon[91810]: pgmap v1110: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:04.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:03 smithi084 ceph-mon[89279]: pgmap v1110: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:04.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:03 smithi162 ceph-mon[83709]: pgmap v1110: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:06.172 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:05 smithi162 ceph-mon[83709]: pgmap v1111: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:06.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:05 smithi084 ceph-mon[91810]: pgmap v1111: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:06.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:05 smithi084 ceph-mon[89279]: pgmap v1111: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:08.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:07 smithi084 ceph-mon[91810]: pgmap v1112: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:08.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:07 smithi084 ceph-mon[89279]: pgmap v1112: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:08.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:07 smithi162 ceph-mon[83709]: pgmap v1112: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:09.167 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:40:09.389 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:40:09.503 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:40:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:40:09] "GET /metrics HTTP/1.1" 200 36324 "" "Prometheus/2.43.0" 2024-03-30T12:40:10.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:09 smithi084 ceph-mon[91810]: pgmap v1113: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:10.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:09 smithi084 ceph-mon[89279]: pgmap v1113: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:10.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:09 smithi162 ceph-mon[83709]: pgmap v1113: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:11.333 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:40:11.335 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:40:11.987 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1114,"stamp":"2024-03-30T12:40:10.876427+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004041"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:34.124688+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:36:34.124688+0000","last_peered":"2024-03-30T12:36:34.124688+0000","last_clean":"2024-03-30T12:36:34.124688+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:36:34.124688+0000","last_undegraded":"2024-03-30T12:36:34.124688+0000","last_fullsized":"2024-03-30T12:36:34.124688+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1364,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904373+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:37:13.904373+0000","last_peered":"2024-03-30T12:37:13.904373+0000","last_clean":"2024-03-30T12:37:13.904373+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:37:13.904373+0000","last_undegraded":"2024-03-30T12:37:13.904373+0000","last_fullsized":"2024-03-30T12:37:13.904373+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862523+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:36:40.862523+0000","last_peered":"2024-03-30T12:36:40.862523+0000","last_clean":"2024-03-30T12:36:40.862523+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:36:40.862523+0000","last_undegraded":"2024-03-30T12:36:40.862523+0000","last_fullsized":"2024-03-30T12:36:40.862523+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:00.294130+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:37:00.294130+0000","last_peered":"2024-03-30T12:37:00.294130+0000","last_clean":"2024-03-30T12:37:00.294130+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:37:00.294130+0000","last_undegraded":"2024-03-30T12:37:00.294130+0000","last_fullsized":"2024-03-30T12:37:00.294130+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.016863+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:36:03.016863+0000","last_peered":"2024-03-30T12:36:03.016863+0000","last_clean":"2024-03-30T12:36:03.016863+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:36:03.016863+0000","last_undegraded":"2024-03-30T12:36:03.016863+0000","last_fullsized":"2024-03-30T12:36:03.016863+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1210,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290374+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:30.290374+0000","last_peered":"2024-03-30T12:36:30.290374+0000","last_clean":"2024-03-30T12:36:30.290374+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:30.290374+0000","last_undegraded":"2024-03-30T12:36:30.290374+0000","last_fullsized":"2024-03-30T12:36:30.290374+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1160,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017365+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:36:03.017365+0000","last_peered":"2024-03-30T12:36:03.017365+0000","last_clean":"2024-03-30T12:36:03.017365+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:36:03.017365+0000","last_undegraded":"2024-03-30T12:36:03.017365+0000","last_fullsized":"2024-03-30T12:36:03.017365+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219781+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:36:03.219781+0000","last_peered":"2024-03-30T12:36:03.219781+0000","last_clean":"2024-03-30T12:36:03.219781+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:36:03.219781+0000","last_undegraded":"2024-03-30T12:36:03.219781+0000","last_fullsized":"2024-03-30T12:36:03.219781+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:34.131337+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:37:34.131337+0000","last_peered":"2024-03-30T12:37:34.131337+0000","last_clean":"2024-03-30T12:37:34.131337+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:37:34.131337+0000","last_undegraded":"2024-03-30T12:37:34.131337+0000","last_fullsized":"2024-03-30T12:37:34.131337+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548505+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:54.548505+0000","last_peered":"2024-03-30T12:36:54.548505+0000","last_clean":"2024-03-30T12:36:54.548505+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:54.548505+0000","last_undegraded":"2024-03-30T12:36:54.548505+0000","last_fullsized":"2024-03-30T12:36:54.548505+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548476+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:54.548476+0000","last_peered":"2024-03-30T12:36:54.548476+0000","last_clean":"2024-03-30T12:36:54.548476+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:54.548476+0000","last_undegraded":"2024-03-30T12:36:54.548476+0000","last_fullsized":"2024-03-30T12:36:54.548476+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1270,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020253+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:36:03.020253+0000","last_peered":"2024-03-30T12:36:03.020253+0000","last_clean":"2024-03-30T12:36:03.020253+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:36:03.020253+0000","last_undegraded":"2024-03-30T12:36:03.020253+0000","last_fullsized":"2024-03-30T12:36:03.020253+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645098+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:37:37.645098+0000","last_peered":"2024-03-30T12:37:37.645098+0000","last_clean":"2024-03-30T12:37:37.645098+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:37:37.645098+0000","last_undegraded":"2024-03-30T12:37:37.645098+0000","last_fullsized":"2024-03-30T12:37:37.645098+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220487+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:36:03.220487+0000","last_peered":"2024-03-30T12:36:03.220487+0000","last_clean":"2024-03-30T12:36:03.220487+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:36:03.220487+0000","last_undegraded":"2024-03-30T12:36:03.220487+0000","last_fullsized":"2024-03-30T12:36:03.220487+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:08.897219+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:36:08.897219+0000","last_peered":"2024-03-30T12:36:08.897219+0000","last_clean":"2024-03-30T12:36:08.897219+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:36:08.897219+0000","last_undegraded":"2024-03-30T12:36:08.897219+0000","last_fullsized":"2024-03-30T12:36:08.897219+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1213,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221481+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:36:03.221481+0000","last_peered":"2024-03-30T12:36:03.221481+0000","last_clean":"2024-03-30T12:36:03.221481+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:36:03.221481+0000","last_undegraded":"2024-03-30T12:36:03.221481+0000","last_fullsized":"2024-03-30T12:36:03.221481+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1224,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.223011+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:36:03.223011+0000","last_peered":"2024-03-30T12:36:03.223011+0000","last_clean":"2024-03-30T12:36:03.223011+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:36:03.223011+0000","last_undegraded":"2024-03-30T12:36:03.223011+0000","last_fullsized":"2024-03-30T12:36:03.223011+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:43.372790+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:36:43.372790+0000","last_peered":"2024-03-30T12:36:43.372790+0000","last_clean":"2024-03-30T12:36:43.372790+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:36:43.372790+0000","last_undegraded":"2024-03-30T12:36:43.372790+0000","last_fullsized":"2024-03-30T12:36:43.372790+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128028+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:37:04.128028+0000","last_peered":"2024-03-30T12:37:04.128028+0000","last_clean":"2024-03-30T12:37:04.128028+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:37:04.128028+0000","last_undegraded":"2024-03-30T12:37:04.128028+0000","last_fullsized":"2024-03-30T12:37:04.128028+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1388,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862565+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:36:40.862565+0000","last_peered":"2024-03-30T12:36:40.862565+0000","last_clean":"2024-03-30T12:36:40.862565+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:36:40.862565+0000","last_undegraded":"2024-03-30T12:36:40.862565+0000","last_fullsized":"2024-03-30T12:36:40.862565+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1283,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647447+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:37:57.647447+0000","last_peered":"2024-03-30T12:37:57.647447+0000","last_clean":"2024-03-30T12:37:57.647447+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:37:57.647447+0000","last_undegraded":"2024-03-30T12:37:57.647447+0000","last_fullsized":"2024-03-30T12:37:57.647447+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1302,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647455+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:37:57.647455+0000","last_peered":"2024-03-30T12:37:57.647455+0000","last_clean":"2024-03-30T12:37:57.647455+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:37:57.647455+0000","last_undegraded":"2024-03-30T12:37:57.647455+0000","last_fullsized":"2024-03-30T12:37:57.647455+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862552+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:36:40.862552+0000","last_peered":"2024-03-30T12:36:40.862552+0000","last_clean":"2024-03-30T12:36:40.862552+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:36:40.862552+0000","last_undegraded":"2024-03-30T12:36:40.862552+0000","last_fullsized":"2024-03-30T12:36:40.862552+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018097+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:36:03.018097+0000","last_peered":"2024-03-30T12:36:03.018097+0000","last_clean":"2024-03-30T12:36:03.018097+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:36:03.018097+0000","last_undegraded":"2024-03-30T12:36:03.018097+0000","last_fullsized":"2024-03-30T12:36:03.018097+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1229,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290400+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:30.290400+0000","last_peered":"2024-03-30T12:36:30.290400+0000","last_clean":"2024-03-30T12:36:30.290400+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:30.290400+0000","last_undegraded":"2024-03-30T12:36:30.290400+0000","last_fullsized":"2024-03-30T12:36:30.290400+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.017698+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:36:03.017698+0000","last_peered":"2024-03-30T12:36:03.017698+0000","last_clean":"2024-03-30T12:36:03.017698+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:36:03.017698+0000","last_undegraded":"2024-03-30T12:36:03.017698+0000","last_fullsized":"2024-03-30T12:36:03.017698+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1213,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290416+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:30.290416+0000","last_peered":"2024-03-30T12:36:30.290416+0000","last_clean":"2024-03-30T12:36:30.290416+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:30.290416+0000","last_undegraded":"2024-03-30T12:36:30.290416+0000","last_fullsized":"2024-03-30T12:36:30.290416+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221852+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:36:03.221852+0000","last_peered":"2024-03-30T12:36:03.221852+0000","last_clean":"2024-03-30T12:36:03.221852+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:36:03.221852+0000","last_undegraded":"2024-03-30T12:36:03.221852+0000","last_fullsized":"2024-03-30T12:36:03.221852+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018910+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:36:03.018910+0000","last_peered":"2024-03-30T12:36:03.018910+0000","last_clean":"2024-03-30T12:36:03.018910+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:36:03.018910+0000","last_undegraded":"2024-03-30T12:36:03.018910+0000","last_fullsized":"2024-03-30T12:36:03.018910+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1180,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:09.550388+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:37:09.550388+0000","last_peered":"2024-03-30T12:37:09.550388+0000","last_clean":"2024-03-30T12:37:09.550388+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:37:09.550388+0000","last_undegraded":"2024-03-30T12:37:09.550388+0000","last_fullsized":"2024-03-30T12:37:09.550388+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.860010+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:36:15.860010+0000","last_peered":"2024-03-30T12:36:15.860010+0000","last_clean":"2024-03-30T12:36:15.860010+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:36:15.860010+0000","last_undegraded":"2024-03-30T12:36:15.860010+0000","last_fullsized":"2024-03-30T12:36:15.860010+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645072+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:37:37.645072+0000","last_peered":"2024-03-30T12:37:37.645072+0000","last_clean":"2024-03-30T12:37:37.645072+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:37:37.645072+0000","last_undegraded":"2024-03-30T12:37:37.645072+0000","last_fullsized":"2024-03-30T12:37:37.645072+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645031+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:37:37.645031+0000","last_peered":"2024-03-30T12:37:37.645031+0000","last_clean":"2024-03-30T12:37:37.645031+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:37:37.645031+0000","last_undegraded":"2024-03-30T12:37:37.645031+0000","last_fullsized":"2024-03-30T12:37:37.645031+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1224,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288884+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:36:15.288884+0000","last_peered":"2024-03-30T12:36:15.288884+0000","last_clean":"2024-03-30T12:36:15.288884+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:36:15.288884+0000","last_undegraded":"2024-03-30T12:36:15.288884+0000","last_fullsized":"2024-03-30T12:36:15.288884+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:28.899208+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:36:28.899208+0000","last_peered":"2024-03-30T12:36:28.899208+0000","last_clean":"2024-03-30T12:36:28.899208+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:36:28.899208+0000","last_undegraded":"2024-03-30T12:36:28.899208+0000","last_fullsized":"2024-03-30T12:36:28.899208+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548518+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:54.548518+0000","last_peered":"2024-03-30T12:36:54.548518+0000","last_clean":"2024-03-30T12:36:54.548518+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:54.548518+0000","last_undegraded":"2024-03-30T12:36:54.548518+0000","last_fullsized":"2024-03-30T12:36:54.548518+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1204,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288944+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:36:15.288944+0000","last_peered":"2024-03-30T12:36:15.288944+0000","last_clean":"2024-03-30T12:36:15.288944+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:36:15.288944+0000","last_undegraded":"2024-03-30T12:36:15.288944+0000","last_fullsized":"2024-03-30T12:36:15.288944+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1198,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288933+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:36:15.288933+0000","last_peered":"2024-03-30T12:36:15.288933+0000","last_clean":"2024-03-30T12:36:15.288933+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:36:15.288933+0000","last_undegraded":"2024-03-30T12:36:15.288933+0000","last_fullsized":"2024-03-30T12:36:15.288933+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:03.374890+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:37:03.374890+0000","last_peered":"2024-03-30T12:37:03.374890+0000","last_clean":"2024-03-30T12:37:03.374890+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:37:03.374890+0000","last_undegraded":"2024-03-30T12:37:03.374890+0000","last_fullsized":"2024-03-30T12:37:03.374890+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:28.899251+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:36:28.899251+0000","last_peered":"2024-03-30T12:36:28.899251+0000","last_clean":"2024-03-30T12:36:28.899251+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:36:28.899251+0000","last_undegraded":"2024-03-30T12:36:28.899251+0000","last_fullsized":"2024-03-30T12:36:28.899251+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020091+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:36:03.020091+0000","last_peered":"2024-03-30T12:36:03.020091+0000","last_clean":"2024-03-30T12:36:03.020091+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:36:03.020091+0000","last_undegraded":"2024-03-30T12:36:03.020091+0000","last_fullsized":"2024-03-30T12:36:03.020091+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546935+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:36:39.546935+0000","last_peered":"2024-03-30T12:36:39.546935+0000","last_clean":"2024-03-30T12:36:39.546935+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:36:39.546935+0000","last_undegraded":"2024-03-30T12:36:39.546935+0000","last_fullsized":"2024-03-30T12:36:39.546935+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:34.131303+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:37:34.131303+0000","last_peered":"2024-03-30T12:37:34.131303+0000","last_clean":"2024-03-30T12:37:34.131303+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:37:34.131303+0000","last_undegraded":"2024-03-30T12:37:34.131303+0000","last_fullsized":"2024-03-30T12:37:34.131303+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221769+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:36:03.221769+0000","last_peered":"2024-03-30T12:36:03.221769+0000","last_clean":"2024-03-30T12:36:03.221769+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:36:03.221769+0000","last_undegraded":"2024-03-30T12:36:03.221769+0000","last_fullsized":"2024-03-30T12:36:03.221769+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220786+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:36:03.220786+0000","last_peered":"2024-03-30T12:36:03.220786+0000","last_clean":"2024-03-30T12:36:03.220786+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:36:03.220786+0000","last_undegraded":"2024-03-30T12:36:03.220786+0000","last_fullsized":"2024-03-30T12:36:03.220786+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221971+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:36:03.221971+0000","last_peered":"2024-03-30T12:36:03.221971+0000","last_clean":"2024-03-30T12:36:03.221971+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:36:03.221971+0000","last_undegraded":"2024-03-30T12:36:03.221971+0000","last_fullsized":"2024-03-30T12:36:03.221971+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:19.129793+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:37:19.129793+0000","last_peered":"2024-03-30T12:37:19.129793+0000","last_clean":"2024-03-30T12:37:19.129793+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:37:19.129793+0000","last_undegraded":"2024-03-30T12:37:19.129793+0000","last_fullsized":"2024-03-30T12:37:19.129793+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546908+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:36:39.546908+0000","last_peered":"2024-03-30T12:36:39.546908+0000","last_clean":"2024-03-30T12:36:39.546908+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:36:39.546908+0000","last_undegraded":"2024-03-30T12:36:39.546908+0000","last_fullsized":"2024-03-30T12:36:39.546908+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546882+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:36:39.546882+0000","last_peered":"2024-03-30T12:36:39.546882+0000","last_clean":"2024-03-30T12:36:39.546882+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:36:39.546882+0000","last_undegraded":"2024-03-30T12:36:39.546882+0000","last_fullsized":"2024-03-30T12:36:39.546882+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1344,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:43.372738+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:36:43.372738+0000","last_peered":"2024-03-30T12:36:43.372738+0000","last_clean":"2024-03-30T12:36:43.372738+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:36:43.372738+0000","last_undegraded":"2024-03-30T12:36:43.372738+0000","last_fullsized":"2024-03-30T12:36:43.372738+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:19.129759+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:37:19.129759+0000","last_peered":"2024-03-30T12:37:19.129759+0000","last_clean":"2024-03-30T12:37:19.129759+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:37:19.129759+0000","last_undegraded":"2024-03-30T12:37:19.129759+0000","last_fullsized":"2024-03-30T12:37:19.129759+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5752,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.367799+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:36:03.367799+0000","last_peered":"2024-03-30T12:36:03.367799+0000","last_clean":"2024-03-30T12:36:03.367799+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:36:03.367799+0000","last_undegraded":"2024-03-30T12:36:03.367799+0000","last_fullsized":"2024-03-30T12:36:03.367799+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1275,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:32.280622+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:37:32.280622+0000","last_peered":"2024-03-30T12:37:32.280622+0000","last_clean":"2024-03-30T12:37:32.280622+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:37:32.280622+0000","last_undegraded":"2024-03-30T12:37:32.280622+0000","last_fullsized":"2024-03-30T12:37:32.280622+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128039+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:37:04.128039+0000","last_peered":"2024-03-30T12:37:04.128039+0000","last_clean":"2024-03-30T12:37:04.128039+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:37:04.128039+0000","last_undegraded":"2024-03-30T12:37:04.128039+0000","last_fullsized":"2024-03-30T12:37:04.128039+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5513,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:40.862481+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:36:40.862481+0000","last_peered":"2024-03-30T12:36:40.862481+0000","last_clean":"2024-03-30T12:36:40.862481+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:36:40.862481+0000","last_undegraded":"2024-03-30T12:36:40.862481+0000","last_fullsized":"2024-03-30T12:36:40.862481+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904270+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:37:13.904270+0000","last_peered":"2024-03-30T12:37:13.904270+0000","last_clean":"2024-03-30T12:37:13.904270+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:37:13.904270+0000","last_undegraded":"2024-03-30T12:37:13.904270+0000","last_fullsized":"2024-03-30T12:37:13.904270+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904297+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:37:13.904297+0000","last_peered":"2024-03-30T12:37:13.904297+0000","last_clean":"2024-03-30T12:37:13.904297+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:37:13.904297+0000","last_undegraded":"2024-03-30T12:37:13.904297+0000","last_fullsized":"2024-03-30T12:37:13.904297+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296466+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:37:20.296466+0000","last_peered":"2024-03-30T12:37:20.296466+0000","last_clean":"2024-03-30T12:37:20.296466+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:37:20.296466+0000","last_undegraded":"2024-03-30T12:37:20.296466+0000","last_fullsized":"2024-03-30T12:37:20.296466+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5458,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:40.862535+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:36:40.862535+0000","last_peered":"2024-03-30T12:36:40.862535+0000","last_clean":"2024-03-30T12:36:40.862535+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:36:40.862535+0000","last_undegraded":"2024-03-30T12:36:40.862535+0000","last_fullsized":"2024-03-30T12:36:40.862535+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904314+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:37:13.904314+0000","last_peered":"2024-03-30T12:37:13.904314+0000","last_clean":"2024-03-30T12:37:13.904314+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:37:13.904314+0000","last_undegraded":"2024-03-30T12:37:13.904314+0000","last_fullsized":"2024-03-30T12:37:13.904314+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1207,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296362+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:37:20.296362+0000","last_peered":"2024-03-30T12:37:20.296362+0000","last_clean":"2024-03-30T12:37:20.296362+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:37:20.296362+0000","last_undegraded":"2024-03-30T12:37:20.296362+0000","last_fullsized":"2024-03-30T12:37:20.296362+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1272,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:52.276088+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:36:52.276088+0000","last_peered":"2024-03-30T12:36:52.276088+0000","last_clean":"2024-03-30T12:36:52.276088+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:36:52.276088+0000","last_undegraded":"2024-03-30T12:36:52.276088+0000","last_fullsized":"2024-03-30T12:36:52.276088+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3803,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.367883+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:36:03.367883+0000","last_peered":"2024-03-30T12:36:03.367883+0000","last_clean":"2024-03-30T12:36:03.367883+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:36:03.367883+0000","last_undegraded":"2024-03-30T12:36:03.367883+0000","last_fullsized":"2024-03-30T12:36:03.367883+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1343,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906884+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:37:38.906884+0000","last_peered":"2024-03-30T12:37:38.906884+0000","last_clean":"2024-03-30T12:37:38.906884+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:37:38.906884+0000","last_undegraded":"2024-03-30T12:37:38.906884+0000","last_fullsized":"2024-03-30T12:37:38.906884+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:48.901383+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:36:48.901383+0000","last_peered":"2024-03-30T12:36:48.901383+0000","last_clean":"2024-03-30T12:36:48.901383+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:36:48.901383+0000","last_undegraded":"2024-03-30T12:36:48.901383+0000","last_fullsized":"2024-03-30T12:36:48.901383+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:48.380185+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:37:48.380185+0000","last_peered":"2024-03-30T12:37:48.380185+0000","last_clean":"2024-03-30T12:37:48.380185+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:37:48.380185+0000","last_undegraded":"2024-03-30T12:37:48.380185+0000","last_fullsized":"2024-03-30T12:37:48.380185+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4576,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:34.124620+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:36:34.124620+0000","last_peered":"2024-03-30T12:36:34.124620+0000","last_clean":"2024-03-30T12:36:34.124620+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:36:34.124620+0000","last_undegraded":"2024-03-30T12:36:34.124620+0000","last_fullsized":"2024-03-30T12:36:34.124620+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1175,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:59.555994+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:37:59.555994+0000","last_peered":"2024-03-30T12:37:59.555994+0000","last_clean":"2024-03-30T12:37:59.555994+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:37:59.555994+0000","last_undegraded":"2024-03-30T12:37:59.555994+0000","last_fullsized":"2024-03-30T12:37:59.555994+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:17.636728+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:36:17.636728+0000","last_peered":"2024-03-30T12:36:17.636728+0000","last_clean":"2024-03-30T12:36:17.636728+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:36:17.636728+0000","last_undegraded":"2024-03-30T12:36:17.636728+0000","last_fullsized":"2024-03-30T12:36:17.636728+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1200,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296444+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:37:20.296444+0000","last_peered":"2024-03-30T12:37:20.296444+0000","last_clean":"2024-03-30T12:37:20.296444+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:37:20.296444+0000","last_undegraded":"2024-03-30T12:37:20.296444+0000","last_fullsized":"2024-03-30T12:37:20.296444+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1716,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:19.123078+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:36:19.123078+0000","last_peered":"2024-03-30T12:36:19.123078+0000","last_clean":"2024-03-30T12:36:19.123078+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:36:19.123078+0000","last_undegraded":"2024-03-30T12:36:19.123078+0000","last_fullsized":"2024-03-30T12:36:19.123078+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24714,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:40.298683+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:37:40.298683+0000","last_peered":"2024-03-30T12:37:40.298683+0000","last_clean":"2024-03-30T12:37:40.298683+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:37:40.298683+0000","last_undegraded":"2024-03-30T12:37:40.298683+0000","last_fullsized":"2024-03-30T12:37:40.298683+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:05.865263+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:37:05.865263+0000","last_peered":"2024-03-30T12:37:05.865263+0000","last_clean":"2024-03-30T12:37:05.865263+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:37:05.865263+0000","last_undegraded":"2024-03-30T12:37:05.865263+0000","last_fullsized":"2024-03-30T12:37:05.865263+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862413+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:36:40.862413+0000","last_peered":"2024-03-30T12:36:40.862413+0000","last_clean":"2024-03-30T12:36:40.862413+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:36:40.862413+0000","last_undegraded":"2024-03-30T12:36:40.862413+0000","last_fullsized":"2024-03-30T12:36:40.862413+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:19.123052+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:36:19.123052+0000","last_peered":"2024-03-30T12:36:19.123052+0000","last_clean":"2024-03-30T12:36:19.123052+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:36:19.123052+0000","last_undegraded":"2024-03-30T12:36:19.123052+0000","last_fullsized":"2024-03-30T12:36:19.123052+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16481,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:59.555949+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:37:59.555949+0000","last_peered":"2024-03-30T12:37:59.555949+0000","last_clean":"2024-03-30T12:37:59.555949+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:37:59.555949+0000","last_undegraded":"2024-03-30T12:37:59.555949+0000","last_fullsized":"2024-03-30T12:37:59.555949+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862510+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:36:40.862510+0000","last_peered":"2024-03-30T12:36:40.862510+0000","last_clean":"2024-03-30T12:36:40.862510+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:36:40.862510+0000","last_undegraded":"2024-03-30T12:36:40.862510+0000","last_fullsized":"2024-03-30T12:36:40.862510+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:34.124667+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:36:34.124667+0000","last_peered":"2024-03-30T12:36:34.124667+0000","last_clean":"2024-03-30T12:36:34.124667+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:36:34.124667+0000","last_undegraded":"2024-03-30T12:36:34.124667+0000","last_fullsized":"2024-03-30T12:36:34.124667+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904330+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:37:13.904330+0000","last_peered":"2024-03-30T12:37:13.904330+0000","last_clean":"2024-03-30T12:37:13.904330+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:37:13.904330+0000","last_undegraded":"2024-03-30T12:37:13.904330+0000","last_fullsized":"2024-03-30T12:37:13.904330+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31269,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:52.276052+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:36:52.276052+0000","last_peered":"2024-03-30T12:36:52.276052+0000","last_clean":"2024-03-30T12:36:52.276052+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:36:52.276052+0000","last_undegraded":"2024-03-30T12:36:52.276052+0000","last_fullsized":"2024-03-30T12:36:52.276052+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647394+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:37:57.647394+0000","last_peered":"2024-03-30T12:37:57.647394+0000","last_clean":"2024-03-30T12:37:57.647394+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:37:57.647394+0000","last_undegraded":"2024-03-30T12:37:57.647394+0000","last_fullsized":"2024-03-30T12:37:57.647394+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906874+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:37:38.906874+0000","last_peered":"2024-03-30T12:37:38.906874+0000","last_clean":"2024-03-30T12:37:38.906874+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:37:38.906874+0000","last_undegraded":"2024-03-30T12:37:38.906874+0000","last_fullsized":"2024-03-30T12:37:38.906874+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638999+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:36:37.638999+0000","last_peered":"2024-03-30T12:36:37.638999+0000","last_clean":"2024-03-30T12:36:37.638999+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:36:37.638999+0000","last_undegraded":"2024-03-30T12:36:37.638999+0000","last_fullsized":"2024-03-30T12:36:37.638999+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3765,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647332+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:37:57.647332+0000","last_peered":"2024-03-30T12:37:57.647332+0000","last_clean":"2024-03-30T12:37:57.647332+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:37:57.647332+0000","last_undegraded":"2024-03-30T12:37:57.647332+0000","last_fullsized":"2024-03-30T12:37:57.647332+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:52.276014+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:36:52.276014+0000","last_peered":"2024-03-30T12:36:52.276014+0000","last_clean":"2024-03-30T12:36:52.276014+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:36:52.276014+0000","last_undegraded":"2024-03-30T12:36:52.276014+0000","last_fullsized":"2024-03-30T12:36:52.276014+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544094+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:36:09.544094+0000","last_peered":"2024-03-30T12:36:09.544094+0000","last_clean":"2024-03-30T12:36:09.544094+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:36:09.544094+0000","last_undegraded":"2024-03-30T12:36:09.544094+0000","last_fullsized":"2024-03-30T12:36:09.544094+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:05.865242+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:37:05.865242+0000","last_peered":"2024-03-30T12:37:05.865242+0000","last_clean":"2024-03-30T12:37:05.865242+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:37:05.865242+0000","last_undegraded":"2024-03-30T12:37:05.865242+0000","last_fullsized":"2024-03-30T12:37:05.865242+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15593,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.223541+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:36:03.223541+0000","last_peered":"2024-03-30T12:36:03.223541+0000","last_clean":"2024-03-30T12:36:03.223541+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:36:03.223541+0000","last_undegraded":"2024-03-30T12:36:03.223541+0000","last_fullsized":"2024-03-30T12:36:03.223541+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1143,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:49.126219+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:36:49.126219+0000","last_peered":"2024-03-30T12:36:49.126219+0000","last_clean":"2024-03-30T12:36:49.126219+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:36:49.126219+0000","last_undegraded":"2024-03-30T12:36:49.126219+0000","last_fullsized":"2024-03-30T12:36:49.126219+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:12.278399+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:37:12.278399+0000","last_peered":"2024-03-30T12:37:12.278399+0000","last_clean":"2024-03-30T12:37:12.278399+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:37:12.278399+0000","last_undegraded":"2024-03-30T12:37:12.278399+0000","last_fullsized":"2024-03-30T12:37:12.278399+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29020,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:32.280556+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:37:32.280556+0000","last_peered":"2024-03-30T12:37:32.280556+0000","last_clean":"2024-03-30T12:37:32.280556+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:37:32.280556+0000","last_undegraded":"2024-03-30T12:37:32.280556+0000","last_fullsized":"2024-03-30T12:37:32.280556+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906809+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:37:38.906809+0000","last_peered":"2024-03-30T12:37:38.906809+0000","last_clean":"2024-03-30T12:37:38.906809+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:37:38.906809+0000","last_undegraded":"2024-03-30T12:37:38.906809+0000","last_fullsized":"2024-03-30T12:37:38.906809+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638944+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:36:37.638944+0000","last_peered":"2024-03-30T12:36:37.638944+0000","last_clean":"2024-03-30T12:36:37.638944+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:36:37.638944+0000","last_undegraded":"2024-03-30T12:36:37.638944+0000","last_fullsized":"2024-03-30T12:36:37.638944+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5610,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:23.370279+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:36:23.370279+0000","last_peered":"2024-03-30T12:36:23.370279+0000","last_clean":"2024-03-30T12:36:23.370279+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:36:23.370279+0000","last_undegraded":"2024-03-30T12:36:23.370279+0000","last_fullsized":"2024-03-30T12:36:23.370279+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1365,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906835+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:37:38.906835+0000","last_peered":"2024-03-30T12:37:38.906835+0000","last_clean":"2024-03-30T12:37:38.906835+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:37:38.906835+0000","last_undegraded":"2024-03-30T12:37:38.906835+0000","last_fullsized":"2024-03-30T12:37:38.906835+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:57.641061+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:57.641061+0000","last_peered":"2024-03-30T12:36:57.641061+0000","last_clean":"2024-03-30T12:36:57.641061+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:57.641061+0000","last_undegraded":"2024-03-30T12:36:57.641061+0000","last_fullsized":"2024-03-30T12:36:57.641061+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222932+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:36:03.222932+0000","last_peered":"2024-03-30T12:36:03.222932+0000","last_clean":"2024-03-30T12:36:03.222932+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:36:03.222932+0000","last_undegraded":"2024-03-30T12:36:03.222932+0000","last_fullsized":"2024-03-30T12:36:03.222932+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.127976+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:37:04.127976+0000","last_peered":"2024-03-30T12:37:04.127976+0000","last_clean":"2024-03-30T12:37:04.127976+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:37:04.127976+0000","last_undegraded":"2024-03-30T12:37:04.127976+0000","last_fullsized":"2024-03-30T12:37:04.127976+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544025+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:36:09.544025+0000","last_peered":"2024-03-30T12:36:09.544025+0000","last_clean":"2024-03-30T12:36:09.544025+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:36:09.544025+0000","last_undegraded":"2024-03-30T12:36:09.544025+0000","last_fullsized":"2024-03-30T12:36:09.544025+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5253,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:23.370200+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:36:23.370200+0000","last_peered":"2024-03-30T12:36:23.370200+0000","last_clean":"2024-03-30T12:36:23.370200+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:36:23.370200+0000","last_undegraded":"2024-03-30T12:36:23.370200+0000","last_fullsized":"2024-03-30T12:36:23.370200+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:23.370243+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:36:23.370243+0000","last_peered":"2024-03-30T12:36:23.370243+0000","last_clean":"2024-03-30T12:36:23.370243+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:36:23.370243+0000","last_undegraded":"2024-03-30T12:36:23.370243+0000","last_fullsized":"2024-03-30T12:36:23.370243+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128016+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:37:04.128016+0000","last_peered":"2024-03-30T12:37:04.128016+0000","last_clean":"2024-03-30T12:37:04.128016+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:37:04.128016+0000","last_undegraded":"2024-03-30T12:37:04.128016+0000","last_fullsized":"2024-03-30T12:37:04.128016+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4810,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.367842+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:36:03.367842+0000","last_peered":"2024-03-30T12:36:03.367842+0000","last_clean":"2024-03-30T12:36:03.367842+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:36:03.367842+0000","last_undegraded":"2024-03-30T12:36:03.367842+0000","last_fullsized":"2024-03-30T12:36:03.367842+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.220953+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:36:03.220953+0000","last_peered":"2024-03-30T12:36:03.220953+0000","last_clean":"2024-03-30T12:36:03.220953+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:36:03.220953+0000","last_undegraded":"2024-03-30T12:36:03.220953+0000","last_fullsized":"2024-03-30T12:36:03.220953+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1232,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.222608+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:36:03.222608+0000","last_peered":"2024-03-30T12:36:03.222608+0000","last_clean":"2024-03-30T12:36:03.222608+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:36:03.222608+0000","last_undegraded":"2024-03-30T12:36:03.222608+0000","last_fullsized":"2024-03-30T12:36:03.222608+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6743,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:49.126256+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:36:49.126256+0000","last_peered":"2024-03-30T12:36:49.126256+0000","last_clean":"2024-03-30T12:36:49.126256+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:36:49.126256+0000","last_undegraded":"2024-03-30T12:36:49.126256+0000","last_fullsized":"2024-03-30T12:36:49.126256+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1337,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:23.370314+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:36:23.370314+0000","last_peered":"2024-03-30T12:36:23.370314+0000","last_clean":"2024-03-30T12:36:23.370314+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:36:23.370314+0000","last_undegraded":"2024-03-30T12:36:23.370314+0000","last_fullsized":"2024-03-30T12:36:23.370314+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128054+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:37:04.128054+0000","last_peered":"2024-03-30T12:37:04.128054+0000","last_clean":"2024-03-30T12:37:04.128054+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:37:04.128054+0000","last_undegraded":"2024-03-30T12:37:04.128054+0000","last_fullsized":"2024-03-30T12:37:04.128054+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:59.555915+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:37:59.555915+0000","last_peered":"2024-03-30T12:37:59.555915+0000","last_clean":"2024-03-30T12:37:59.555915+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:37:59.555915+0000","last_undegraded":"2024-03-30T12:37:59.555915+0000","last_fullsized":"2024-03-30T12:37:59.555915+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:48.380210+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:37:48.380210+0000","last_peered":"2024-03-30T12:37:48.380210+0000","last_clean":"2024-03-30T12:37:48.380210+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:37:48.380210+0000","last_undegraded":"2024-03-30T12:37:48.380210+0000","last_fullsized":"2024-03-30T12:37:48.380210+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296394+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:37:20.296394+0000","last_peered":"2024-03-30T12:37:20.296394+0000","last_clean":"2024-03-30T12:37:20.296394+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:37:20.296394+0000","last_undegraded":"2024-03-30T12:37:20.296394+0000","last_fullsized":"2024-03-30T12:37:20.296394+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862462+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:36:40.862462+0000","last_peered":"2024-03-30T12:36:40.862462+0000","last_clean":"2024-03-30T12:36:40.862462+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:36:40.862462+0000","last_undegraded":"2024-03-30T12:36:40.862462+0000","last_fullsized":"2024-03-30T12:36:40.862462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638978+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:36:37.638978+0000","last_peered":"2024-03-30T12:36:37.638978+0000","last_clean":"2024-03-30T12:36:37.638978+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:36:37.638978+0000","last_undegraded":"2024-03-30T12:36:37.638978+0000","last_fullsized":"2024-03-30T12:36:37.638978+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906859+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:37:38.906859+0000","last_peered":"2024-03-30T12:37:38.906859+0000","last_clean":"2024-03-30T12:37:38.906859+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:37:38.906859+0000","last_undegraded":"2024-03-30T12:37:38.906859+0000","last_fullsized":"2024-03-30T12:37:38.906859+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1177,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544079+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:36:09.544079+0000","last_peered":"2024-03-30T12:36:09.544079+0000","last_clean":"2024-03-30T12:36:09.544079+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:36:09.544079+0000","last_undegraded":"2024-03-30T12:36:09.544079+0000","last_fullsized":"2024-03-30T12:36:09.544079+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1281,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.639015+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:36:37.639015+0000","last_peered":"2024-03-30T12:36:37.639015+0000","last_clean":"2024-03-30T12:36:37.639015+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:36:37.639015+0000","last_undegraded":"2024-03-30T12:36:37.639015+0000","last_fullsized":"2024-03-30T12:36:37.639015+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:40.298625+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:37:40.298625+0000","last_peered":"2024-03-30T12:37:40.298625+0000","last_clean":"2024-03-30T12:37:40.298625+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:37:40.298625+0000","last_undegraded":"2024-03-30T12:37:40.298625+0000","last_fullsized":"2024-03-30T12:37:40.298625+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:57.641040+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:57.641040+0000","last_peered":"2024-03-30T12:36:57.641040+0000","last_clean":"2024-03-30T12:36:57.641040+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:57.641040+0000","last_undegraded":"2024-03-30T12:36:57.641040+0000","last_fullsized":"2024-03-30T12:36:57.641040+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221610+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:36:03.221610+0000","last_peered":"2024-03-30T12:36:03.221610+0000","last_clean":"2024-03-30T12:36:03.221610+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:36:03.221610+0000","last_undegraded":"2024-03-30T12:36:03.221610+0000","last_fullsized":"2024-03-30T12:36:03.221610+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:30.867819+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:37:30.867819+0000","last_peered":"2024-03-30T12:37:30.867819+0000","last_clean":"2024-03-30T12:37:30.867819+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:37:30.867819+0000","last_undegraded":"2024-03-30T12:37:30.867819+0000","last_fullsized":"2024-03-30T12:37:30.867819+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:24.545379+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:36:24.545379+0000","last_peered":"2024-03-30T12:36:24.545379+0000","last_clean":"2024-03-30T12:36:24.545379+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:36:24.545379+0000","last_undegraded":"2024-03-30T12:36:24.545379+0000","last_fullsized":"2024-03-30T12:36:24.545379+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438071,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648127,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175137,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254375,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063194,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951251,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839308,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923591,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:40:11.994 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:11.994 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:11.995 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:11.995 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:11.995 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:11.995 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:11.995 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:11.995 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:11.995 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:11.995 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:11.995 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:11.995 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:11.995 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:11.995 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:40:12.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:11 smithi084 ceph-mon[91810]: pgmap v1114: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:12.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:11 smithi084 ceph-mon[91810]: from='client.34626 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:40:12.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:11 smithi084 ceph-mon[89279]: pgmap v1114: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:12.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:11 smithi084 ceph-mon[89279]: from='client.34626 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:40:12.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:11 smithi162 ceph-mon[83709]: pgmap v1114: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:12.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:11 smithi162 ceph-mon[83709]: from='client.34626 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:40:14.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:13 smithi084 ceph-mon[91810]: pgmap v1115: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:14.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:13 smithi084 ceph-mon[89279]: pgmap v1115: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:14.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:13 smithi162 ceph-mon[83709]: pgmap v1115: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:15.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:14 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:40:15.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:14 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:40:15.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:14 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:40:16.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:15 smithi084 ceph-mon[91810]: pgmap v1116: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:16.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:15 smithi084 ceph-mon[89279]: pgmap v1116: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:16.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:15 smithi162 ceph-mon[83709]: pgmap v1116: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:18.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:17 smithi084 ceph-mon[91810]: pgmap v1117: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:18.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:17 smithi084 ceph-mon[89279]: pgmap v1117: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:18.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:17 smithi162 ceph-mon[83709]: pgmap v1117: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:19.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:40:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:40:19] "GET /metrics HTTP/1.1" 200 36327 "" "Prometheus/2.43.0" 2024-03-30T12:40:20.027 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:19 smithi084 ceph-mon[91810]: pgmap v1118: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:20.030 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:19 smithi084 ceph-mon[89279]: pgmap v1118: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:20.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:19 smithi162 ceph-mon[83709]: pgmap v1118: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:21.996 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:40:22.216 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:40:22.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:21 smithi084 ceph-mon[91810]: pgmap v1119: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:22.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:21 smithi084 ceph-mon[89279]: pgmap v1119: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:22.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:21 smithi162 ceph-mon[83709]: pgmap v1119: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:24.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:23 smithi084 ceph-mon[91810]: pgmap v1120: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:24.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:23 smithi084 ceph-mon[89279]: pgmap v1120: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:24.177 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:40:24.179 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:40:24.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:23 smithi162 ceph-mon[83709]: pgmap v1120: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:24.816 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1120,"stamp":"2024-03-30T12:40:22.880517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004090"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:34.124688+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:36:34.124688+0000","last_peered":"2024-03-30T12:36:34.124688+0000","last_clean":"2024-03-30T12:36:34.124688+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:36:34.124688+0000","last_undegraded":"2024-03-30T12:36:34.124688+0000","last_fullsized":"2024-03-30T12:36:34.124688+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1364,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904373+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:37:13.904373+0000","last_peered":"2024-03-30T12:37:13.904373+0000","last_clean":"2024-03-30T12:37:13.904373+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:37:13.904373+0000","last_undegraded":"2024-03-30T12:37:13.904373+0000","last_fullsized":"2024-03-30T12:37:13.904373+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862523+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:36:40.862523+0000","last_peered":"2024-03-30T12:36:40.862523+0000","last_clean":"2024-03-30T12:36:40.862523+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:36:40.862523+0000","last_undegraded":"2024-03-30T12:36:40.862523+0000","last_fullsized":"2024-03-30T12:36:40.862523+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:00.294130+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:37:00.294130+0000","last_peered":"2024-03-30T12:37:00.294130+0000","last_clean":"2024-03-30T12:37:00.294130+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:37:00.294130+0000","last_undegraded":"2024-03-30T12:37:00.294130+0000","last_fullsized":"2024-03-30T12:37:00.294130+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133062+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:37:49.133062+0000","last_peered":"2024-03-30T12:37:49.133062+0000","last_clean":"2024-03-30T12:37:49.133062+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:37:49.133062+0000","last_undegraded":"2024-03-30T12:37:49.133062+0000","last_fullsized":"2024-03-30T12:37:49.133062+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1210,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290374+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:30.290374+0000","last_peered":"2024-03-30T12:36:30.290374+0000","last_clean":"2024-03-30T12:36:30.290374+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:30.290374+0000","last_undegraded":"2024-03-30T12:36:30.290374+0000","last_fullsized":"2024-03-30T12:36:30.290374+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133035+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:37:49.133035+0000","last_peered":"2024-03-30T12:37:49.133035+0000","last_clean":"2024-03-30T12:37:49.133035+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:37:49.133035+0000","last_undegraded":"2024-03-30T12:37:49.133035+0000","last_fullsized":"2024-03-30T12:37:49.133035+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.219781+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:36:03.219781+0000","last_peered":"2024-03-30T12:36:03.219781+0000","last_clean":"2024-03-30T12:36:03.219781+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:36:03.219781+0000","last_undegraded":"2024-03-30T12:36:03.219781+0000","last_fullsized":"2024-03-30T12:36:03.219781+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:34.131337+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:37:34.131337+0000","last_peered":"2024-03-30T12:37:34.131337+0000","last_clean":"2024-03-30T12:37:34.131337+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:37:34.131337+0000","last_undegraded":"2024-03-30T12:37:34.131337+0000","last_fullsized":"2024-03-30T12:37:34.131337+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548505+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:54.548505+0000","last_peered":"2024-03-30T12:36:54.548505+0000","last_clean":"2024-03-30T12:36:54.548505+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:54.548505+0000","last_undegraded":"2024-03-30T12:36:54.548505+0000","last_fullsized":"2024-03-30T12:36:54.548505+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548476+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:54.548476+0000","last_peered":"2024-03-30T12:36:54.548476+0000","last_clean":"2024-03-30T12:36:54.548476+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:54.548476+0000","last_undegraded":"2024-03-30T12:36:54.548476+0000","last_fullsized":"2024-03-30T12:36:54.548476+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1270,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020253+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:36:03.020253+0000","last_peered":"2024-03-30T12:36:03.020253+0000","last_clean":"2024-03-30T12:36:03.020253+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:36:03.020253+0000","last_undegraded":"2024-03-30T12:36:03.020253+0000","last_fullsized":"2024-03-30T12:36:03.020253+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645098+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:37:37.645098+0000","last_peered":"2024-03-30T12:37:37.645098+0000","last_clean":"2024-03-30T12:37:37.645098+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:37:37.645098+0000","last_undegraded":"2024-03-30T12:37:37.645098+0000","last_fullsized":"2024-03-30T12:37:37.645098+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870430+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:37:55.870430+0000","last_peered":"2024-03-30T12:37:55.870430+0000","last_clean":"2024-03-30T12:37:55.870430+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:37:55.870430+0000","last_undegraded":"2024-03-30T12:37:55.870430+0000","last_fullsized":"2024-03-30T12:37:55.870430+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:08.897219+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:36:08.897219+0000","last_peered":"2024-03-30T12:36:08.897219+0000","last_clean":"2024-03-30T12:36:08.897219+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:36:08.897219+0000","last_undegraded":"2024-03-30T12:36:08.897219+0000","last_fullsized":"2024-03-30T12:36:08.897219+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1213,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221481+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:36:03.221481+0000","last_peered":"2024-03-30T12:36:03.221481+0000","last_clean":"2024-03-30T12:36:03.221481+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:36:03.221481+0000","last_undegraded":"2024-03-30T12:36:03.221481+0000","last_fullsized":"2024-03-30T12:36:03.221481+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1224,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.223011+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:36:03.223011+0000","last_peered":"2024-03-30T12:36:03.223011+0000","last_clean":"2024-03-30T12:36:03.223011+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:36:03.223011+0000","last_undegraded":"2024-03-30T12:36:03.223011+0000","last_fullsized":"2024-03-30T12:36:03.223011+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:43.372790+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:36:43.372790+0000","last_peered":"2024-03-30T12:36:43.372790+0000","last_clean":"2024-03-30T12:36:43.372790+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:36:43.372790+0000","last_undegraded":"2024-03-30T12:36:43.372790+0000","last_fullsized":"2024-03-30T12:36:43.372790+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128028+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:37:04.128028+0000","last_peered":"2024-03-30T12:37:04.128028+0000","last_clean":"2024-03-30T12:37:04.128028+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:37:04.128028+0000","last_undegraded":"2024-03-30T12:37:04.128028+0000","last_fullsized":"2024-03-30T12:37:04.128028+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1388,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862565+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:36:40.862565+0000","last_peered":"2024-03-30T12:36:40.862565+0000","last_clean":"2024-03-30T12:36:40.862565+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:36:40.862565+0000","last_undegraded":"2024-03-30T12:36:40.862565+0000","last_fullsized":"2024-03-30T12:36:40.862565+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1283,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647447+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:37:57.647447+0000","last_peered":"2024-03-30T12:37:57.647447+0000","last_clean":"2024-03-30T12:37:57.647447+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:37:57.647447+0000","last_undegraded":"2024-03-30T12:37:57.647447+0000","last_fullsized":"2024-03-30T12:37:57.647447+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1302,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647455+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:37:57.647455+0000","last_peered":"2024-03-30T12:37:57.647455+0000","last_clean":"2024-03-30T12:37:57.647455+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:37:57.647455+0000","last_undegraded":"2024-03-30T12:37:57.647455+0000","last_fullsized":"2024-03-30T12:37:57.647455+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862552+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:36:40.862552+0000","last_peered":"2024-03-30T12:36:40.862552+0000","last_clean":"2024-03-30T12:36:40.862552+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:36:40.862552+0000","last_undegraded":"2024-03-30T12:36:40.862552+0000","last_fullsized":"2024-03-30T12:36:40.862552+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1151,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133095+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:37:49.133095+0000","last_peered":"2024-03-30T12:37:49.133095+0000","last_clean":"2024-03-30T12:37:49.133095+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:37:49.133095+0000","last_undegraded":"2024-03-30T12:37:49.133095+0000","last_fullsized":"2024-03-30T12:37:49.133095+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1229,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290400+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:30.290400+0000","last_peered":"2024-03-30T12:36:30.290400+0000","last_clean":"2024-03-30T12:36:30.290400+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:30.290400+0000","last_undegraded":"2024-03-30T12:36:30.290400+0000","last_fullsized":"2024-03-30T12:36:30.290400+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133077+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:37:49.133077+0000","last_peered":"2024-03-30T12:37:49.133077+0000","last_clean":"2024-03-30T12:37:49.133077+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:37:49.133077+0000","last_undegraded":"2024-03-30T12:37:49.133077+0000","last_fullsized":"2024-03-30T12:37:49.133077+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1213,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290416+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:30.290416+0000","last_peered":"2024-03-30T12:36:30.290416+0000","last_clean":"2024-03-30T12:36:30.290416+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:30.290416+0000","last_undegraded":"2024-03-30T12:36:30.290416+0000","last_fullsized":"2024-03-30T12:36:30.290416+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221852+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:36:03.221852+0000","last_peered":"2024-03-30T12:36:03.221852+0000","last_clean":"2024-03-30T12:36:03.221852+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:36:03.221852+0000","last_undegraded":"2024-03-30T12:36:03.221852+0000","last_fullsized":"2024-03-30T12:36:03.221852+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018910+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:36:03.018910+0000","last_peered":"2024-03-30T12:36:03.018910+0000","last_clean":"2024-03-30T12:36:03.018910+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:36:03.018910+0000","last_undegraded":"2024-03-30T12:36:03.018910+0000","last_fullsized":"2024-03-30T12:36:03.018910+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1180,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:09.550388+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:37:09.550388+0000","last_peered":"2024-03-30T12:37:09.550388+0000","last_clean":"2024-03-30T12:37:09.550388+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:37:09.550388+0000","last_undegraded":"2024-03-30T12:37:09.550388+0000","last_fullsized":"2024-03-30T12:37:09.550388+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.860010+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:36:15.860010+0000","last_peered":"2024-03-30T12:36:15.860010+0000","last_clean":"2024-03-30T12:36:15.860010+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:36:15.860010+0000","last_undegraded":"2024-03-30T12:36:15.860010+0000","last_fullsized":"2024-03-30T12:36:15.860010+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645072+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:37:37.645072+0000","last_peered":"2024-03-30T12:37:37.645072+0000","last_clean":"2024-03-30T12:37:37.645072+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:37:37.645072+0000","last_undegraded":"2024-03-30T12:37:37.645072+0000","last_fullsized":"2024-03-30T12:37:37.645072+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645031+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:37:37.645031+0000","last_peered":"2024-03-30T12:37:37.645031+0000","last_clean":"2024-03-30T12:37:37.645031+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:37:37.645031+0000","last_undegraded":"2024-03-30T12:37:37.645031+0000","last_fullsized":"2024-03-30T12:37:37.645031+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1224,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288884+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:36:15.288884+0000","last_peered":"2024-03-30T12:36:15.288884+0000","last_clean":"2024-03-30T12:36:15.288884+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:36:15.288884+0000","last_undegraded":"2024-03-30T12:36:15.288884+0000","last_fullsized":"2024-03-30T12:36:15.288884+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:28.899208+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:36:28.899208+0000","last_peered":"2024-03-30T12:36:28.899208+0000","last_clean":"2024-03-30T12:36:28.899208+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:36:28.899208+0000","last_undegraded":"2024-03-30T12:36:28.899208+0000","last_fullsized":"2024-03-30T12:36:28.899208+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548518+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:54.548518+0000","last_peered":"2024-03-30T12:36:54.548518+0000","last_clean":"2024-03-30T12:36:54.548518+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:54.548518+0000","last_undegraded":"2024-03-30T12:36:54.548518+0000","last_fullsized":"2024-03-30T12:36:54.548518+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1204,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288944+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:36:15.288944+0000","last_peered":"2024-03-30T12:36:15.288944+0000","last_clean":"2024-03-30T12:36:15.288944+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:36:15.288944+0000","last_undegraded":"2024-03-30T12:36:15.288944+0000","last_fullsized":"2024-03-30T12:36:15.288944+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1198,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288933+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:36:15.288933+0000","last_peered":"2024-03-30T12:36:15.288933+0000","last_clean":"2024-03-30T12:36:15.288933+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:36:15.288933+0000","last_undegraded":"2024-03-30T12:36:15.288933+0000","last_fullsized":"2024-03-30T12:36:15.288933+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:03.374890+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:37:03.374890+0000","last_peered":"2024-03-30T12:37:03.374890+0000","last_clean":"2024-03-30T12:37:03.374890+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:37:03.374890+0000","last_undegraded":"2024-03-30T12:37:03.374890+0000","last_fullsized":"2024-03-30T12:37:03.374890+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:28.899251+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:36:28.899251+0000","last_peered":"2024-03-30T12:36:28.899251+0000","last_clean":"2024-03-30T12:36:28.899251+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:36:28.899251+0000","last_undegraded":"2024-03-30T12:36:28.899251+0000","last_fullsized":"2024-03-30T12:36:28.899251+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:52.282667+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:37:52.282667+0000","last_peered":"2024-03-30T12:37:52.282667+0000","last_clean":"2024-03-30T12:37:52.282667+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:37:52.282667+0000","last_undegraded":"2024-03-30T12:37:52.282667+0000","last_fullsized":"2024-03-30T12:37:52.282667+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546935+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:36:39.546935+0000","last_peered":"2024-03-30T12:36:39.546935+0000","last_clean":"2024-03-30T12:36:39.546935+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:36:39.546935+0000","last_undegraded":"2024-03-30T12:36:39.546935+0000","last_fullsized":"2024-03-30T12:36:39.546935+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:34.131303+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:37:34.131303+0000","last_peered":"2024-03-30T12:37:34.131303+0000","last_clean":"2024-03-30T12:37:34.131303+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:37:34.131303+0000","last_undegraded":"2024-03-30T12:37:34.131303+0000","last_fullsized":"2024-03-30T12:37:34.131303+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1384,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870514+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:37:55.870514+0000","last_peered":"2024-03-30T12:37:55.870514+0000","last_clean":"2024-03-30T12:37:55.870514+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:37:55.870514+0000","last_undegraded":"2024-03-30T12:37:55.870514+0000","last_fullsized":"2024-03-30T12:37:55.870514+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870486+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:37:55.870486+0000","last_peered":"2024-03-30T12:37:55.870486+0000","last_clean":"2024-03-30T12:37:55.870486+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:37:55.870486+0000","last_undegraded":"2024-03-30T12:37:55.870486+0000","last_fullsized":"2024-03-30T12:37:55.870486+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221971+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:36:03.221971+0000","last_peered":"2024-03-30T12:36:03.221971+0000","last_clean":"2024-03-30T12:36:03.221971+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:36:03.221971+0000","last_undegraded":"2024-03-30T12:36:03.221971+0000","last_fullsized":"2024-03-30T12:36:03.221971+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:19.129793+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:37:19.129793+0000","last_peered":"2024-03-30T12:37:19.129793+0000","last_clean":"2024-03-30T12:37:19.129793+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:37:19.129793+0000","last_undegraded":"2024-03-30T12:37:19.129793+0000","last_fullsized":"2024-03-30T12:37:19.129793+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546908+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:36:39.546908+0000","last_peered":"2024-03-30T12:36:39.546908+0000","last_clean":"2024-03-30T12:36:39.546908+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:36:39.546908+0000","last_undegraded":"2024-03-30T12:36:39.546908+0000","last_fullsized":"2024-03-30T12:36:39.546908+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546882+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:36:39.546882+0000","last_peered":"2024-03-30T12:36:39.546882+0000","last_clean":"2024-03-30T12:36:39.546882+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:36:39.546882+0000","last_undegraded":"2024-03-30T12:36:39.546882+0000","last_fullsized":"2024-03-30T12:36:39.546882+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1344,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:43.372738+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:36:43.372738+0000","last_peered":"2024-03-30T12:36:43.372738+0000","last_clean":"2024-03-30T12:36:43.372738+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:36:43.372738+0000","last_undegraded":"2024-03-30T12:36:43.372738+0000","last_fullsized":"2024-03-30T12:36:43.372738+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:19.129759+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:37:19.129759+0000","last_peered":"2024-03-30T12:37:19.129759+0000","last_clean":"2024-03-30T12:37:19.129759+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:37:19.129759+0000","last_undegraded":"2024-03-30T12:37:19.129759+0000","last_fullsized":"2024-03-30T12:37:19.129759+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5752,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.367799+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:36:03.367799+0000","last_peered":"2024-03-30T12:36:03.367799+0000","last_clean":"2024-03-30T12:36:03.367799+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:36:03.367799+0000","last_undegraded":"2024-03-30T12:36:03.367799+0000","last_fullsized":"2024-03-30T12:36:03.367799+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1275,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:32.280622+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:37:32.280622+0000","last_peered":"2024-03-30T12:37:32.280622+0000","last_clean":"2024-03-30T12:37:32.280622+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:37:32.280622+0000","last_undegraded":"2024-03-30T12:37:32.280622+0000","last_fullsized":"2024-03-30T12:37:32.280622+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128039+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:37:04.128039+0000","last_peered":"2024-03-30T12:37:04.128039+0000","last_clean":"2024-03-30T12:37:04.128039+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:37:04.128039+0000","last_undegraded":"2024-03-30T12:37:04.128039+0000","last_fullsized":"2024-03-30T12:37:04.128039+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5513,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:40.862481+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:36:40.862481+0000","last_peered":"2024-03-30T12:36:40.862481+0000","last_clean":"2024-03-30T12:36:40.862481+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:36:40.862481+0000","last_undegraded":"2024-03-30T12:36:40.862481+0000","last_fullsized":"2024-03-30T12:36:40.862481+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904270+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:37:13.904270+0000","last_peered":"2024-03-30T12:37:13.904270+0000","last_clean":"2024-03-30T12:37:13.904270+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:37:13.904270+0000","last_undegraded":"2024-03-30T12:37:13.904270+0000","last_fullsized":"2024-03-30T12:37:13.904270+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904297+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:37:13.904297+0000","last_peered":"2024-03-30T12:37:13.904297+0000","last_clean":"2024-03-30T12:37:13.904297+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:37:13.904297+0000","last_undegraded":"2024-03-30T12:37:13.904297+0000","last_fullsized":"2024-03-30T12:37:13.904297+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296466+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:37:20.296466+0000","last_peered":"2024-03-30T12:37:20.296466+0000","last_clean":"2024-03-30T12:37:20.296466+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:37:20.296466+0000","last_undegraded":"2024-03-30T12:37:20.296466+0000","last_fullsized":"2024-03-30T12:37:20.296466+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5458,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:40.862535+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:36:40.862535+0000","last_peered":"2024-03-30T12:36:40.862535+0000","last_clean":"2024-03-30T12:36:40.862535+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:36:40.862535+0000","last_undegraded":"2024-03-30T12:36:40.862535+0000","last_fullsized":"2024-03-30T12:36:40.862535+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904314+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:37:13.904314+0000","last_peered":"2024-03-30T12:37:13.904314+0000","last_clean":"2024-03-30T12:37:13.904314+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:37:13.904314+0000","last_undegraded":"2024-03-30T12:37:13.904314+0000","last_fullsized":"2024-03-30T12:37:13.904314+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1207,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296362+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:37:20.296362+0000","last_peered":"2024-03-30T12:37:20.296362+0000","last_clean":"2024-03-30T12:37:20.296362+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:37:20.296362+0000","last_undegraded":"2024-03-30T12:37:20.296362+0000","last_fullsized":"2024-03-30T12:37:20.296362+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1272,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:52.276088+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:36:52.276088+0000","last_peered":"2024-03-30T12:36:52.276088+0000","last_clean":"2024-03-30T12:36:52.276088+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:36:52.276088+0000","last_undegraded":"2024-03-30T12:36:52.276088+0000","last_fullsized":"2024-03-30T12:36:52.276088+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3803,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.367883+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:36:03.367883+0000","last_peered":"2024-03-30T12:36:03.367883+0000","last_clean":"2024-03-30T12:36:03.367883+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:36:03.367883+0000","last_undegraded":"2024-03-30T12:36:03.367883+0000","last_fullsized":"2024-03-30T12:36:03.367883+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1343,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906884+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:37:38.906884+0000","last_peered":"2024-03-30T12:37:38.906884+0000","last_clean":"2024-03-30T12:37:38.906884+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:37:38.906884+0000","last_undegraded":"2024-03-30T12:37:38.906884+0000","last_fullsized":"2024-03-30T12:37:38.906884+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:48.901383+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:36:48.901383+0000","last_peered":"2024-03-30T12:36:48.901383+0000","last_clean":"2024-03-30T12:36:48.901383+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:36:48.901383+0000","last_undegraded":"2024-03-30T12:36:48.901383+0000","last_fullsized":"2024-03-30T12:36:48.901383+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:48.380185+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:37:48.380185+0000","last_peered":"2024-03-30T12:37:48.380185+0000","last_clean":"2024-03-30T12:37:48.380185+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:37:48.380185+0000","last_undegraded":"2024-03-30T12:37:48.380185+0000","last_fullsized":"2024-03-30T12:37:48.380185+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4576,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:34.124620+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:36:34.124620+0000","last_peered":"2024-03-30T12:36:34.124620+0000","last_clean":"2024-03-30T12:36:34.124620+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:36:34.124620+0000","last_undegraded":"2024-03-30T12:36:34.124620+0000","last_fullsized":"2024-03-30T12:36:34.124620+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1175,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:59.555994+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:37:59.555994+0000","last_peered":"2024-03-30T12:37:59.555994+0000","last_clean":"2024-03-30T12:37:59.555994+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:37:59.555994+0000","last_undegraded":"2024-03-30T12:37:59.555994+0000","last_fullsized":"2024-03-30T12:37:59.555994+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:17.636728+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:36:17.636728+0000","last_peered":"2024-03-30T12:36:17.636728+0000","last_clean":"2024-03-30T12:36:17.636728+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:36:17.636728+0000","last_undegraded":"2024-03-30T12:36:17.636728+0000","last_fullsized":"2024-03-30T12:36:17.636728+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1200,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296444+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:37:20.296444+0000","last_peered":"2024-03-30T12:37:20.296444+0000","last_clean":"2024-03-30T12:37:20.296444+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:37:20.296444+0000","last_undegraded":"2024-03-30T12:37:20.296444+0000","last_fullsized":"2024-03-30T12:37:20.296444+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1717,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.136726+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:38:19.136726+0000","last_peered":"2024-03-30T12:38:19.136726+0000","last_clean":"2024-03-30T12:38:19.136726+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:38:19.136726+0000","last_undegraded":"2024-03-30T12:38:19.136726+0000","last_fullsized":"2024-03-30T12:38:19.136726+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24714,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:40.298683+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:37:40.298683+0000","last_peered":"2024-03-30T12:37:40.298683+0000","last_clean":"2024-03-30T12:37:40.298683+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:37:40.298683+0000","last_undegraded":"2024-03-30T12:37:40.298683+0000","last_fullsized":"2024-03-30T12:37:40.298683+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:05.865263+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:37:05.865263+0000","last_peered":"2024-03-30T12:37:05.865263+0000","last_clean":"2024-03-30T12:37:05.865263+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:37:05.865263+0000","last_undegraded":"2024-03-30T12:37:05.865263+0000","last_fullsized":"2024-03-30T12:37:05.865263+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862413+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:36:40.862413+0000","last_peered":"2024-03-30T12:36:40.862413+0000","last_clean":"2024-03-30T12:36:40.862413+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:36:40.862413+0000","last_undegraded":"2024-03-30T12:36:40.862413+0000","last_fullsized":"2024-03-30T12:36:40.862413+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.136697+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:38:19.136697+0000","last_peered":"2024-03-30T12:38:19.136697+0000","last_clean":"2024-03-30T12:38:19.136697+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:38:19.136697+0000","last_undegraded":"2024-03-30T12:38:19.136697+0000","last_fullsized":"2024-03-30T12:38:19.136697+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16481,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:59.555949+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:37:59.555949+0000","last_peered":"2024-03-30T12:37:59.555949+0000","last_clean":"2024-03-30T12:37:59.555949+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:37:59.555949+0000","last_undegraded":"2024-03-30T12:37:59.555949+0000","last_fullsized":"2024-03-30T12:37:59.555949+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862510+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:36:40.862510+0000","last_peered":"2024-03-30T12:36:40.862510+0000","last_clean":"2024-03-30T12:36:40.862510+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:36:40.862510+0000","last_undegraded":"2024-03-30T12:36:40.862510+0000","last_fullsized":"2024-03-30T12:36:40.862510+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:34.124667+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:36:34.124667+0000","last_peered":"2024-03-30T12:36:34.124667+0000","last_clean":"2024-03-30T12:36:34.124667+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:36:34.124667+0000","last_undegraded":"2024-03-30T12:36:34.124667+0000","last_fullsized":"2024-03-30T12:36:34.124667+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904330+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:37:13.904330+0000","last_peered":"2024-03-30T12:37:13.904330+0000","last_clean":"2024-03-30T12:37:13.904330+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:37:13.904330+0000","last_undegraded":"2024-03-30T12:37:13.904330+0000","last_fullsized":"2024-03-30T12:37:13.904330+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31269,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:52.276052+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:36:52.276052+0000","last_peered":"2024-03-30T12:36:52.276052+0000","last_clean":"2024-03-30T12:36:52.276052+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:36:52.276052+0000","last_undegraded":"2024-03-30T12:36:52.276052+0000","last_fullsized":"2024-03-30T12:36:52.276052+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647394+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:37:57.647394+0000","last_peered":"2024-03-30T12:37:57.647394+0000","last_clean":"2024-03-30T12:37:57.647394+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:37:57.647394+0000","last_undegraded":"2024-03-30T12:37:57.647394+0000","last_fullsized":"2024-03-30T12:37:57.647394+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906874+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:37:38.906874+0000","last_peered":"2024-03-30T12:37:38.906874+0000","last_clean":"2024-03-30T12:37:38.906874+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:37:38.906874+0000","last_undegraded":"2024-03-30T12:37:38.906874+0000","last_fullsized":"2024-03-30T12:37:38.906874+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638999+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:36:37.638999+0000","last_peered":"2024-03-30T12:36:37.638999+0000","last_clean":"2024-03-30T12:36:37.638999+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:36:37.638999+0000","last_undegraded":"2024-03-30T12:36:37.638999+0000","last_fullsized":"2024-03-30T12:36:37.638999+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3765,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647332+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:37:57.647332+0000","last_peered":"2024-03-30T12:37:57.647332+0000","last_clean":"2024-03-30T12:37:57.647332+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:37:57.647332+0000","last_undegraded":"2024-03-30T12:37:57.647332+0000","last_fullsized":"2024-03-30T12:37:57.647332+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:52.276014+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:36:52.276014+0000","last_peered":"2024-03-30T12:36:52.276014+0000","last_clean":"2024-03-30T12:36:52.276014+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:36:52.276014+0000","last_undegraded":"2024-03-30T12:36:52.276014+0000","last_fullsized":"2024-03-30T12:36:52.276014+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544094+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:36:09.544094+0000","last_peered":"2024-03-30T12:36:09.544094+0000","last_clean":"2024-03-30T12:36:09.544094+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:36:09.544094+0000","last_undegraded":"2024-03-30T12:36:09.544094+0000","last_fullsized":"2024-03-30T12:36:09.544094+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:05.865242+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:37:05.865242+0000","last_peered":"2024-03-30T12:37:05.865242+0000","last_clean":"2024-03-30T12:37:05.865242+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:37:05.865242+0000","last_undegraded":"2024-03-30T12:37:05.865242+0000","last_fullsized":"2024-03-30T12:37:05.865242+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15594,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:00.301062+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:38:00.301062+0000","last_peered":"2024-03-30T12:38:00.301062+0000","last_clean":"2024-03-30T12:38:00.301062+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:38:00.301062+0000","last_undegraded":"2024-03-30T12:38:00.301062+0000","last_fullsized":"2024-03-30T12:38:00.301062+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1143,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:49.126219+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:36:49.126219+0000","last_peered":"2024-03-30T12:36:49.126219+0000","last_clean":"2024-03-30T12:36:49.126219+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:36:49.126219+0000","last_undegraded":"2024-03-30T12:36:49.126219+0000","last_fullsized":"2024-03-30T12:36:49.126219+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:12.278399+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:37:12.278399+0000","last_peered":"2024-03-30T12:37:12.278399+0000","last_clean":"2024-03-30T12:37:12.278399+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:37:12.278399+0000","last_undegraded":"2024-03-30T12:37:12.278399+0000","last_fullsized":"2024-03-30T12:37:12.278399+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29020,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:32.280556+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:37:32.280556+0000","last_peered":"2024-03-30T12:37:32.280556+0000","last_clean":"2024-03-30T12:37:32.280556+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:37:32.280556+0000","last_undegraded":"2024-03-30T12:37:32.280556+0000","last_fullsized":"2024-03-30T12:37:32.280556+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906809+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:37:38.906809+0000","last_peered":"2024-03-30T12:37:38.906809+0000","last_clean":"2024-03-30T12:37:38.906809+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:37:38.906809+0000","last_undegraded":"2024-03-30T12:37:38.906809+0000","last_fullsized":"2024-03-30T12:37:38.906809+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638944+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:36:37.638944+0000","last_peered":"2024-03-30T12:36:37.638944+0000","last_clean":"2024-03-30T12:36:37.638944+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:36:37.638944+0000","last_undegraded":"2024-03-30T12:36:37.638944+0000","last_fullsized":"2024-03-30T12:36:37.638944+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5610,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:23.370279+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:36:23.370279+0000","last_peered":"2024-03-30T12:36:23.370279+0000","last_clean":"2024-03-30T12:36:23.370279+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:36:23.370279+0000","last_undegraded":"2024-03-30T12:36:23.370279+0000","last_fullsized":"2024-03-30T12:36:23.370279+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1365,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906835+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:37:38.906835+0000","last_peered":"2024-03-30T12:37:38.906835+0000","last_clean":"2024-03-30T12:37:38.906835+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:37:38.906835+0000","last_undegraded":"2024-03-30T12:37:38.906835+0000","last_fullsized":"2024-03-30T12:37:38.906835+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:57.641061+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:57.641061+0000","last_peered":"2024-03-30T12:36:57.641061+0000","last_clean":"2024-03-30T12:36:57.641061+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:57.641061+0000","last_undegraded":"2024-03-30T12:36:57.641061+0000","last_fullsized":"2024-03-30T12:36:57.641061+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4275,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:03.909427+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:38:03.909427+0000","last_peered":"2024-03-30T12:38:03.909427+0000","last_clean":"2024-03-30T12:38:03.909427+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:38:03.909427+0000","last_undegraded":"2024-03-30T12:38:03.909427+0000","last_fullsized":"2024-03-30T12:38:03.909427+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.127976+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:37:04.127976+0000","last_peered":"2024-03-30T12:37:04.127976+0000","last_clean":"2024-03-30T12:37:04.127976+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:37:04.127976+0000","last_undegraded":"2024-03-30T12:37:04.127976+0000","last_fullsized":"2024-03-30T12:37:04.127976+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544025+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:36:09.544025+0000","last_peered":"2024-03-30T12:36:09.544025+0000","last_clean":"2024-03-30T12:36:09.544025+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:36:09.544025+0000","last_undegraded":"2024-03-30T12:36:09.544025+0000","last_fullsized":"2024-03-30T12:36:09.544025+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5253,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:23.370200+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:36:23.370200+0000","last_peered":"2024-03-30T12:36:23.370200+0000","last_clean":"2024-03-30T12:36:23.370200+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:36:23.370200+0000","last_undegraded":"2024-03-30T12:36:23.370200+0000","last_fullsized":"2024-03-30T12:36:23.370200+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:23.370243+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:36:23.370243+0000","last_peered":"2024-03-30T12:36:23.370243+0000","last_clean":"2024-03-30T12:36:23.370243+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:36:23.370243+0000","last_undegraded":"2024-03-30T12:36:23.370243+0000","last_fullsized":"2024-03-30T12:36:23.370243+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128016+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:37:04.128016+0000","last_peered":"2024-03-30T12:37:04.128016+0000","last_clean":"2024-03-30T12:37:04.128016+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:37:04.128016+0000","last_undegraded":"2024-03-30T12:37:04.128016+0000","last_fullsized":"2024-03-30T12:37:04.128016+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4810,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:03.367842+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:36:03.367842+0000","last_peered":"2024-03-30T12:36:03.367842+0000","last_clean":"2024-03-30T12:36:03.367842+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:36:03.367842+0000","last_undegraded":"2024-03-30T12:36:03.367842+0000","last_fullsized":"2024-03-30T12:36:03.367842+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:03.909462+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:38:03.909462+0000","last_peered":"2024-03-30T12:38:03.909462+0000","last_clean":"2024-03-30T12:38:03.909462+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:38:03.909462+0000","last_undegraded":"2024-03-30T12:38:03.909462+0000","last_fullsized":"2024-03-30T12:38:03.909462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:00.301034+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:38:00.301034+0000","last_peered":"2024-03-30T12:38:00.301034+0000","last_clean":"2024-03-30T12:38:00.301034+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:38:00.301034+0000","last_undegraded":"2024-03-30T12:38:00.301034+0000","last_fullsized":"2024-03-30T12:38:00.301034+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6743,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:49.126256+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:36:49.126256+0000","last_peered":"2024-03-30T12:36:49.126256+0000","last_clean":"2024-03-30T12:36:49.126256+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:36:49.126256+0000","last_undegraded":"2024-03-30T12:36:49.126256+0000","last_fullsized":"2024-03-30T12:36:49.126256+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1337,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:23.370314+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:36:23.370314+0000","last_peered":"2024-03-30T12:36:23.370314+0000","last_clean":"2024-03-30T12:36:23.370314+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:36:23.370314+0000","last_undegraded":"2024-03-30T12:36:23.370314+0000","last_fullsized":"2024-03-30T12:36:23.370314+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128054+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:37:04.128054+0000","last_peered":"2024-03-30T12:37:04.128054+0000","last_clean":"2024-03-30T12:37:04.128054+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:37:04.128054+0000","last_undegraded":"2024-03-30T12:37:04.128054+0000","last_fullsized":"2024-03-30T12:37:04.128054+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:59.555915+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:37:59.555915+0000","last_peered":"2024-03-30T12:37:59.555915+0000","last_clean":"2024-03-30T12:37:59.555915+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:37:59.555915+0000","last_undegraded":"2024-03-30T12:37:59.555915+0000","last_fullsized":"2024-03-30T12:37:59.555915+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:48.380210+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:37:48.380210+0000","last_peered":"2024-03-30T12:37:48.380210+0000","last_clean":"2024-03-30T12:37:48.380210+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:37:48.380210+0000","last_undegraded":"2024-03-30T12:37:48.380210+0000","last_fullsized":"2024-03-30T12:37:48.380210+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296394+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:37:20.296394+0000","last_peered":"2024-03-30T12:37:20.296394+0000","last_clean":"2024-03-30T12:37:20.296394+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:37:20.296394+0000","last_undegraded":"2024-03-30T12:37:20.296394+0000","last_fullsized":"2024-03-30T12:37:20.296394+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862462+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:36:40.862462+0000","last_peered":"2024-03-30T12:36:40.862462+0000","last_clean":"2024-03-30T12:36:40.862462+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:36:40.862462+0000","last_undegraded":"2024-03-30T12:36:40.862462+0000","last_fullsized":"2024-03-30T12:36:40.862462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638978+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:36:37.638978+0000","last_peered":"2024-03-30T12:36:37.638978+0000","last_clean":"2024-03-30T12:36:37.638978+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:36:37.638978+0000","last_undegraded":"2024-03-30T12:36:37.638978+0000","last_fullsized":"2024-03-30T12:36:37.638978+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906859+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:37:38.906859+0000","last_peered":"2024-03-30T12:37:38.906859+0000","last_clean":"2024-03-30T12:37:38.906859+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:37:38.906859+0000","last_undegraded":"2024-03-30T12:37:38.906859+0000","last_fullsized":"2024-03-30T12:37:38.906859+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1177,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:09.544079+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:36:09.544079+0000","last_peered":"2024-03-30T12:36:09.544079+0000","last_clean":"2024-03-30T12:36:09.544079+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:36:09.544079+0000","last_undegraded":"2024-03-30T12:36:09.544079+0000","last_fullsized":"2024-03-30T12:36:09.544079+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1281,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.639015+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:36:37.639015+0000","last_peered":"2024-03-30T12:36:37.639015+0000","last_clean":"2024-03-30T12:36:37.639015+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:36:37.639015+0000","last_undegraded":"2024-03-30T12:36:37.639015+0000","last_fullsized":"2024-03-30T12:36:37.639015+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:40.298625+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:37:40.298625+0000","last_peered":"2024-03-30T12:37:40.298625+0000","last_clean":"2024-03-30T12:37:40.298625+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:37:40.298625+0000","last_undegraded":"2024-03-30T12:37:40.298625+0000","last_fullsized":"2024-03-30T12:37:40.298625+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:57.641040+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:57.641040+0000","last_peered":"2024-03-30T12:36:57.641040+0000","last_clean":"2024-03-30T12:36:57.641040+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:57.641040+0000","last_undegraded":"2024-03-30T12:36:57.641040+0000","last_fullsized":"2024-03-30T12:36:57.641040+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1216,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:00.300996+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:38:00.300996+0000","last_peered":"2024-03-30T12:38:00.300996+0000","last_clean":"2024-03-30T12:38:00.300996+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:38:00.300996+0000","last_undegraded":"2024-03-30T12:38:00.300996+0000","last_fullsized":"2024-03-30T12:38:00.300996+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:30.867819+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:37:30.867819+0000","last_peered":"2024-03-30T12:37:30.867819+0000","last_clean":"2024-03-30T12:37:30.867819+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:37:30.867819+0000","last_undegraded":"2024-03-30T12:37:30.867819+0000","last_fullsized":"2024-03-30T12:37:30.867819+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:24.545379+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:36:24.545379+0000","last_peered":"2024-03-30T12:36:24.545379+0000","last_clean":"2024-03-30T12:36:24.545379+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:36:24.545379+0000","last_undegraded":"2024-03-30T12:36:24.545379+0000","last_fullsized":"2024-03-30T12:36:24.545379+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438073,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648129,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175139,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254378,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063196,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951254,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839311,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923593,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:40:24.821 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:24.821 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:24.821 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:24.821 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:24.821 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:24.821 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:24.822 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:24.822 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:24.822 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:24.822 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:24.822 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:24.822 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:24.822 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:24.823 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:40:25.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:24 smithi084 ceph-mon[89279]: from='client.44567 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:40:25.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:24 smithi084 ceph-mon[91810]: from='client.44567 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:40:25.368 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:24 smithi162 ceph-mon[83709]: from='client.44567 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:40:26.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:25 smithi084 ceph-mon[91810]: pgmap v1121: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:26.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:25 smithi084 ceph-mon[89279]: pgmap v1121: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:26.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:25 smithi162 ceph-mon[83709]: pgmap v1121: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:28.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:27 smithi084 ceph-mon[91810]: pgmap v1122: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:28.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:27 smithi084 ceph-mon[89279]: pgmap v1122: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:28.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:27 smithi162 ceph-mon[83709]: pgmap v1122: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:29.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:40:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:40:29] "GET /metrics HTTP/1.1" 200 36327 "" "Prometheus/2.43.0" 2024-03-30T12:40:30.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:29 smithi084 ceph-mon[91810]: pgmap v1123: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:30.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:29 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:40:30.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:29 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:40:30.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:29 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:40:30.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:29 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:40:30.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:29 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:40:30.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:29 smithi084 ceph-mon[89279]: pgmap v1123: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:30.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:29 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:40:30.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:29 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:40:30.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:29 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:40:30.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:29 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:40:30.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:29 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:40:30.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:29 smithi162 ceph-mon[83709]: pgmap v1123: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:30.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:29 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:40:30.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:29 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:40:30.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:29 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:40:30.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:29 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:40:30.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:29 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:40:32.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:31 smithi084 ceph-mon[91810]: pgmap v1124: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:32.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:31 smithi084 ceph-mon[89279]: pgmap v1124: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:32.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:31 smithi162 ceph-mon[83709]: pgmap v1124: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:34.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:33 smithi084 ceph-mon[91810]: pgmap v1125: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:34.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:33 smithi084 ceph-mon[89279]: pgmap v1125: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:34.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:33 smithi162 ceph-mon[83709]: pgmap v1125: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:34.825 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:40:35.042 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:40:36.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:35 smithi084 ceph-mon[91810]: pgmap v1126: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:36.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:35 smithi084 ceph-mon[89279]: pgmap v1126: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:36.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:35 smithi162 ceph-mon[83709]: pgmap v1126: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:37.050 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:40:37.052 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:40:37.748 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1127,"stamp":"2024-03-30T12:40:36.885018+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003936"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:34.124688+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:36:34.124688+0000","last_peered":"2024-03-30T12:36:34.124688+0000","last_clean":"2024-03-30T12:36:34.124688+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:36:34.124688+0000","last_undegraded":"2024-03-30T12:36:34.124688+0000","last_fullsized":"2024-03-30T12:36:34.124688+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1364,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904373+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:37:13.904373+0000","last_peered":"2024-03-30T12:37:13.904373+0000","last_clean":"2024-03-30T12:37:13.904373+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:37:13.904373+0000","last_undegraded":"2024-03-30T12:37:13.904373+0000","last_fullsized":"2024-03-30T12:37:13.904373+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862523+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:36:40.862523+0000","last_peered":"2024-03-30T12:36:40.862523+0000","last_clean":"2024-03-30T12:36:40.862523+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:36:40.862523+0000","last_undegraded":"2024-03-30T12:36:40.862523+0000","last_fullsized":"2024-03-30T12:36:40.862523+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:00.294130+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:37:00.294130+0000","last_peered":"2024-03-30T12:37:00.294130+0000","last_clean":"2024-03-30T12:37:00.294130+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:37:00.294130+0000","last_undegraded":"2024-03-30T12:37:00.294130+0000","last_fullsized":"2024-03-30T12:37:00.294130+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133062+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:37:49.133062+0000","last_peered":"2024-03-30T12:37:49.133062+0000","last_clean":"2024-03-30T12:37:49.133062+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:37:49.133062+0000","last_undegraded":"2024-03-30T12:37:49.133062+0000","last_fullsized":"2024-03-30T12:37:49.133062+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1210,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290374+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:30.290374+0000","last_peered":"2024-03-30T12:36:30.290374+0000","last_clean":"2024-03-30T12:36:30.290374+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:30.290374+0000","last_undegraded":"2024-03-30T12:36:30.290374+0000","last_fullsized":"2024-03-30T12:36:30.290374+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133035+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:37:49.133035+0000","last_peered":"2024-03-30T12:37:49.133035+0000","last_clean":"2024-03-30T12:37:49.133035+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:37:49.133035+0000","last_undegraded":"2024-03-30T12:37:49.133035+0000","last_fullsized":"2024-03-30T12:37:49.133035+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647301+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:37:57.647301+0000","last_peered":"2024-03-30T12:37:57.647301+0000","last_clean":"2024-03-30T12:37:57.647301+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:37:57.647301+0000","last_undegraded":"2024-03-30T12:37:57.647301+0000","last_fullsized":"2024-03-30T12:37:57.647301+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:34.131337+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:37:34.131337+0000","last_peered":"2024-03-30T12:37:34.131337+0000","last_clean":"2024-03-30T12:37:34.131337+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:37:34.131337+0000","last_undegraded":"2024-03-30T12:37:34.131337+0000","last_fullsized":"2024-03-30T12:37:34.131337+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548505+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:54.548505+0000","last_peered":"2024-03-30T12:36:54.548505+0000","last_clean":"2024-03-30T12:36:54.548505+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:54.548505+0000","last_undegraded":"2024-03-30T12:36:54.548505+0000","last_fullsized":"2024-03-30T12:36:54.548505+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548476+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:54.548476+0000","last_peered":"2024-03-30T12:36:54.548476+0000","last_clean":"2024-03-30T12:36:54.548476+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:54.548476+0000","last_undegraded":"2024-03-30T12:36:54.548476+0000","last_fullsized":"2024-03-30T12:36:54.548476+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1270,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.020253+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:36:03.020253+0000","last_peered":"2024-03-30T12:36:03.020253+0000","last_clean":"2024-03-30T12:36:03.020253+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:36:03.020253+0000","last_undegraded":"2024-03-30T12:36:03.020253+0000","last_fullsized":"2024-03-30T12:36:03.020253+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645098+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:37:37.645098+0000","last_peered":"2024-03-30T12:37:37.645098+0000","last_clean":"2024-03-30T12:37:37.645098+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:37:37.645098+0000","last_undegraded":"2024-03-30T12:37:37.645098+0000","last_fullsized":"2024-03-30T12:37:37.645098+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870430+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:37:55.870430+0000","last_peered":"2024-03-30T12:37:55.870430+0000","last_clean":"2024-03-30T12:37:55.870430+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:37:55.870430+0000","last_undegraded":"2024-03-30T12:37:55.870430+0000","last_fullsized":"2024-03-30T12:37:55.870430+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:08.897219+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:36:08.897219+0000","last_peered":"2024-03-30T12:36:08.897219+0000","last_clean":"2024-03-30T12:36:08.897219+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:36:08.897219+0000","last_undegraded":"2024-03-30T12:36:08.897219+0000","last_fullsized":"2024-03-30T12:36:08.897219+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1213,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221481+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:36:03.221481+0000","last_peered":"2024-03-30T12:36:03.221481+0000","last_clean":"2024-03-30T12:36:03.221481+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:36:03.221481+0000","last_undegraded":"2024-03-30T12:36:03.221481+0000","last_fullsized":"2024-03-30T12:36:03.221481+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1224,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.223011+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:36:03.223011+0000","last_peered":"2024-03-30T12:36:03.223011+0000","last_clean":"2024-03-30T12:36:03.223011+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:36:03.223011+0000","last_undegraded":"2024-03-30T12:36:03.223011+0000","last_fullsized":"2024-03-30T12:36:03.223011+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:43.372790+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:36:43.372790+0000","last_peered":"2024-03-30T12:36:43.372790+0000","last_clean":"2024-03-30T12:36:43.372790+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:36:43.372790+0000","last_undegraded":"2024-03-30T12:36:43.372790+0000","last_fullsized":"2024-03-30T12:36:43.372790+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128028+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:37:04.128028+0000","last_peered":"2024-03-30T12:37:04.128028+0000","last_clean":"2024-03-30T12:37:04.128028+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:37:04.128028+0000","last_undegraded":"2024-03-30T12:37:04.128028+0000","last_fullsized":"2024-03-30T12:37:04.128028+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1388,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862565+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:36:40.862565+0000","last_peered":"2024-03-30T12:36:40.862565+0000","last_clean":"2024-03-30T12:36:40.862565+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:36:40.862565+0000","last_undegraded":"2024-03-30T12:36:40.862565+0000","last_fullsized":"2024-03-30T12:36:40.862565+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1283,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647447+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:37:57.647447+0000","last_peered":"2024-03-30T12:37:57.647447+0000","last_clean":"2024-03-30T12:37:57.647447+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:37:57.647447+0000","last_undegraded":"2024-03-30T12:37:57.647447+0000","last_fullsized":"2024-03-30T12:37:57.647447+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1302,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647455+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:37:57.647455+0000","last_peered":"2024-03-30T12:37:57.647455+0000","last_clean":"2024-03-30T12:37:57.647455+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:37:57.647455+0000","last_undegraded":"2024-03-30T12:37:57.647455+0000","last_fullsized":"2024-03-30T12:37:57.647455+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862552+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:36:40.862552+0000","last_peered":"2024-03-30T12:36:40.862552+0000","last_clean":"2024-03-30T12:36:40.862552+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:36:40.862552+0000","last_undegraded":"2024-03-30T12:36:40.862552+0000","last_fullsized":"2024-03-30T12:36:40.862552+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1151,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133095+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:37:49.133095+0000","last_peered":"2024-03-30T12:37:49.133095+0000","last_clean":"2024-03-30T12:37:49.133095+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:37:49.133095+0000","last_undegraded":"2024-03-30T12:37:49.133095+0000","last_fullsized":"2024-03-30T12:37:49.133095+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1229,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290400+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:30.290400+0000","last_peered":"2024-03-30T12:36:30.290400+0000","last_clean":"2024-03-30T12:36:30.290400+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:30.290400+0000","last_undegraded":"2024-03-30T12:36:30.290400+0000","last_fullsized":"2024-03-30T12:36:30.290400+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133077+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:37:49.133077+0000","last_peered":"2024-03-30T12:37:49.133077+0000","last_clean":"2024-03-30T12:37:49.133077+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:37:49.133077+0000","last_undegraded":"2024-03-30T12:37:49.133077+0000","last_fullsized":"2024-03-30T12:37:49.133077+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1213,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290416+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:30.290416+0000","last_peered":"2024-03-30T12:36:30.290416+0000","last_clean":"2024-03-30T12:36:30.290416+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:30.290416+0000","last_undegraded":"2024-03-30T12:36:30.290416+0000","last_fullsized":"2024-03-30T12:36:30.290416+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647433+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:37:57.647433+0000","last_peered":"2024-03-30T12:37:57.647433+0000","last_clean":"2024-03-30T12:37:57.647433+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:37:57.647433+0000","last_undegraded":"2024-03-30T12:37:57.647433+0000","last_fullsized":"2024-03-30T12:37:57.647433+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018910+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:36:03.018910+0000","last_peered":"2024-03-30T12:36:03.018910+0000","last_clean":"2024-03-30T12:36:03.018910+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:36:03.018910+0000","last_undegraded":"2024-03-30T12:36:03.018910+0000","last_fullsized":"2024-03-30T12:36:03.018910+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1180,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:09.550388+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:37:09.550388+0000","last_peered":"2024-03-30T12:37:09.550388+0000","last_clean":"2024-03-30T12:37:09.550388+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:37:09.550388+0000","last_undegraded":"2024-03-30T12:37:09.550388+0000","last_fullsized":"2024-03-30T12:37:09.550388+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.860010+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:36:15.860010+0000","last_peered":"2024-03-30T12:36:15.860010+0000","last_clean":"2024-03-30T12:36:15.860010+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:36:15.860010+0000","last_undegraded":"2024-03-30T12:36:15.860010+0000","last_fullsized":"2024-03-30T12:36:15.860010+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645072+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:37:37.645072+0000","last_peered":"2024-03-30T12:37:37.645072+0000","last_clean":"2024-03-30T12:37:37.645072+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:37:37.645072+0000","last_undegraded":"2024-03-30T12:37:37.645072+0000","last_fullsized":"2024-03-30T12:37:37.645072+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645031+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:37:37.645031+0000","last_peered":"2024-03-30T12:37:37.645031+0000","last_clean":"2024-03-30T12:37:37.645031+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:37:37.645031+0000","last_undegraded":"2024-03-30T12:37:37.645031+0000","last_fullsized":"2024-03-30T12:37:37.645031+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1224,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288884+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:36:15.288884+0000","last_peered":"2024-03-30T12:36:15.288884+0000","last_clean":"2024-03-30T12:36:15.288884+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:36:15.288884+0000","last_undegraded":"2024-03-30T12:36:15.288884+0000","last_fullsized":"2024-03-30T12:36:15.288884+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:28.899208+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:36:28.899208+0000","last_peered":"2024-03-30T12:36:28.899208+0000","last_clean":"2024-03-30T12:36:28.899208+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:36:28.899208+0000","last_undegraded":"2024-03-30T12:36:28.899208+0000","last_fullsized":"2024-03-30T12:36:28.899208+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548518+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:54.548518+0000","last_peered":"2024-03-30T12:36:54.548518+0000","last_clean":"2024-03-30T12:36:54.548518+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:54.548518+0000","last_undegraded":"2024-03-30T12:36:54.548518+0000","last_fullsized":"2024-03-30T12:36:54.548518+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1204,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288944+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:36:15.288944+0000","last_peered":"2024-03-30T12:36:15.288944+0000","last_clean":"2024-03-30T12:36:15.288944+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:36:15.288944+0000","last_undegraded":"2024-03-30T12:36:15.288944+0000","last_fullsized":"2024-03-30T12:36:15.288944+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1198,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288933+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:36:15.288933+0000","last_peered":"2024-03-30T12:36:15.288933+0000","last_clean":"2024-03-30T12:36:15.288933+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:36:15.288933+0000","last_undegraded":"2024-03-30T12:36:15.288933+0000","last_fullsized":"2024-03-30T12:36:15.288933+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:03.374890+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:37:03.374890+0000","last_peered":"2024-03-30T12:37:03.374890+0000","last_clean":"2024-03-30T12:37:03.374890+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:37:03.374890+0000","last_undegraded":"2024-03-30T12:37:03.374890+0000","last_fullsized":"2024-03-30T12:37:03.374890+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:28.899251+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:36:28.899251+0000","last_peered":"2024-03-30T12:36:28.899251+0000","last_clean":"2024-03-30T12:36:28.899251+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:36:28.899251+0000","last_undegraded":"2024-03-30T12:36:28.899251+0000","last_fullsized":"2024-03-30T12:36:28.899251+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:52.282667+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:37:52.282667+0000","last_peered":"2024-03-30T12:37:52.282667+0000","last_clean":"2024-03-30T12:37:52.282667+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:37:52.282667+0000","last_undegraded":"2024-03-30T12:37:52.282667+0000","last_fullsized":"2024-03-30T12:37:52.282667+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546935+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:36:39.546935+0000","last_peered":"2024-03-30T12:36:39.546935+0000","last_clean":"2024-03-30T12:36:39.546935+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:36:39.546935+0000","last_undegraded":"2024-03-30T12:36:39.546935+0000","last_fullsized":"2024-03-30T12:36:39.546935+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:34.131303+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:37:34.131303+0000","last_peered":"2024-03-30T12:37:34.131303+0000","last_clean":"2024-03-30T12:37:34.131303+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:37:34.131303+0000","last_undegraded":"2024-03-30T12:37:34.131303+0000","last_fullsized":"2024-03-30T12:37:34.131303+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1384,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870514+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:37:55.870514+0000","last_peered":"2024-03-30T12:37:55.870514+0000","last_clean":"2024-03-30T12:37:55.870514+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:37:55.870514+0000","last_undegraded":"2024-03-30T12:37:55.870514+0000","last_fullsized":"2024-03-30T12:37:55.870514+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870486+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:37:55.870486+0000","last_peered":"2024-03-30T12:37:55.870486+0000","last_clean":"2024-03-30T12:37:55.870486+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:37:55.870486+0000","last_undegraded":"2024-03-30T12:37:55.870486+0000","last_fullsized":"2024-03-30T12:37:55.870486+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.221971+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:36:03.221971+0000","last_peered":"2024-03-30T12:36:03.221971+0000","last_clean":"2024-03-30T12:36:03.221971+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:36:03.221971+0000","last_undegraded":"2024-03-30T12:36:03.221971+0000","last_fullsized":"2024-03-30T12:36:03.221971+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:19.129793+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:37:19.129793+0000","last_peered":"2024-03-30T12:37:19.129793+0000","last_clean":"2024-03-30T12:37:19.129793+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:37:19.129793+0000","last_undegraded":"2024-03-30T12:37:19.129793+0000","last_fullsized":"2024-03-30T12:37:19.129793+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546908+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:36:39.546908+0000","last_peered":"2024-03-30T12:36:39.546908+0000","last_clean":"2024-03-30T12:36:39.546908+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:36:39.546908+0000","last_undegraded":"2024-03-30T12:36:39.546908+0000","last_fullsized":"2024-03-30T12:36:39.546908+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546882+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:36:39.546882+0000","last_peered":"2024-03-30T12:36:39.546882+0000","last_clean":"2024-03-30T12:36:39.546882+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:36:39.546882+0000","last_undegraded":"2024-03-30T12:36:39.546882+0000","last_fullsized":"2024-03-30T12:36:39.546882+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1344,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:43.372738+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:36:43.372738+0000","last_peered":"2024-03-30T12:36:43.372738+0000","last_clean":"2024-03-30T12:36:43.372738+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:36:43.372738+0000","last_undegraded":"2024-03-30T12:36:43.372738+0000","last_fullsized":"2024-03-30T12:36:43.372738+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:19.129759+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:37:19.129759+0000","last_peered":"2024-03-30T12:37:19.129759+0000","last_clean":"2024-03-30T12:37:19.129759+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:37:19.129759+0000","last_undegraded":"2024-03-30T12:37:19.129759+0000","last_fullsized":"2024-03-30T12:37:19.129759+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5753,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:13.383127+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:38:13.383127+0000","last_peered":"2024-03-30T12:38:13.383127+0000","last_clean":"2024-03-30T12:38:13.383127+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:38:13.383127+0000","last_undegraded":"2024-03-30T12:38:13.383127+0000","last_fullsized":"2024-03-30T12:38:13.383127+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1275,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:32.280622+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:37:32.280622+0000","last_peered":"2024-03-30T12:37:32.280622+0000","last_clean":"2024-03-30T12:37:32.280622+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:37:32.280622+0000","last_undegraded":"2024-03-30T12:37:32.280622+0000","last_fullsized":"2024-03-30T12:37:32.280622+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128039+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:37:04.128039+0000","last_peered":"2024-03-30T12:37:04.128039+0000","last_clean":"2024-03-30T12:37:04.128039+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:37:04.128039+0000","last_undegraded":"2024-03-30T12:37:04.128039+0000","last_fullsized":"2024-03-30T12:37:04.128039+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5513,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:40.862481+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:36:40.862481+0000","last_peered":"2024-03-30T12:36:40.862481+0000","last_clean":"2024-03-30T12:36:40.862481+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:36:40.862481+0000","last_undegraded":"2024-03-30T12:36:40.862481+0000","last_fullsized":"2024-03-30T12:36:40.862481+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904270+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:37:13.904270+0000","last_peered":"2024-03-30T12:37:13.904270+0000","last_clean":"2024-03-30T12:37:13.904270+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:37:13.904270+0000","last_undegraded":"2024-03-30T12:37:13.904270+0000","last_fullsized":"2024-03-30T12:37:13.904270+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904297+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:37:13.904297+0000","last_peered":"2024-03-30T12:37:13.904297+0000","last_clean":"2024-03-30T12:37:13.904297+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:37:13.904297+0000","last_undegraded":"2024-03-30T12:37:13.904297+0000","last_fullsized":"2024-03-30T12:37:13.904297+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296466+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:37:20.296466+0000","last_peered":"2024-03-30T12:37:20.296466+0000","last_clean":"2024-03-30T12:37:20.296466+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:37:20.296466+0000","last_undegraded":"2024-03-30T12:37:20.296466+0000","last_fullsized":"2024-03-30T12:37:20.296466+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5458,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:40.862535+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:36:40.862535+0000","last_peered":"2024-03-30T12:36:40.862535+0000","last_clean":"2024-03-30T12:36:40.862535+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:36:40.862535+0000","last_undegraded":"2024-03-30T12:36:40.862535+0000","last_fullsized":"2024-03-30T12:36:40.862535+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904314+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:37:13.904314+0000","last_peered":"2024-03-30T12:37:13.904314+0000","last_clean":"2024-03-30T12:37:13.904314+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:37:13.904314+0000","last_undegraded":"2024-03-30T12:37:13.904314+0000","last_fullsized":"2024-03-30T12:37:13.904314+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1207,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296362+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:37:20.296362+0000","last_peered":"2024-03-30T12:37:20.296362+0000","last_clean":"2024-03-30T12:37:20.296362+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:37:20.296362+0000","last_undegraded":"2024-03-30T12:37:20.296362+0000","last_fullsized":"2024-03-30T12:37:20.296362+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1272,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:52.276088+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:36:52.276088+0000","last_peered":"2024-03-30T12:36:52.276088+0000","last_clean":"2024-03-30T12:36:52.276088+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:36:52.276088+0000","last_undegraded":"2024-03-30T12:36:52.276088+0000","last_fullsized":"2024-03-30T12:36:52.276088+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3804,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:13.383237+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:38:13.383237+0000","last_peered":"2024-03-30T12:38:13.383237+0000","last_clean":"2024-03-30T12:38:13.383237+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:38:13.383237+0000","last_undegraded":"2024-03-30T12:38:13.383237+0000","last_fullsized":"2024-03-30T12:38:13.383237+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1343,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906884+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:37:38.906884+0000","last_peered":"2024-03-30T12:37:38.906884+0000","last_clean":"2024-03-30T12:37:38.906884+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:37:38.906884+0000","last_undegraded":"2024-03-30T12:37:38.906884+0000","last_fullsized":"2024-03-30T12:37:38.906884+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:48.901383+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:36:48.901383+0000","last_peered":"2024-03-30T12:36:48.901383+0000","last_clean":"2024-03-30T12:36:48.901383+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:36:48.901383+0000","last_undegraded":"2024-03-30T12:36:48.901383+0000","last_fullsized":"2024-03-30T12:36:48.901383+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:48.380185+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:37:48.380185+0000","last_peered":"2024-03-30T12:37:48.380185+0000","last_clean":"2024-03-30T12:37:48.380185+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:37:48.380185+0000","last_undegraded":"2024-03-30T12:37:48.380185+0000","last_fullsized":"2024-03-30T12:37:48.380185+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4576,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:34.124620+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:36:34.124620+0000","last_peered":"2024-03-30T12:36:34.124620+0000","last_clean":"2024-03-30T12:36:34.124620+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:36:34.124620+0000","last_undegraded":"2024-03-30T12:36:34.124620+0000","last_fullsized":"2024-03-30T12:36:34.124620+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1175,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:59.555994+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:37:59.555994+0000","last_peered":"2024-03-30T12:37:59.555994+0000","last_clean":"2024-03-30T12:37:59.555994+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:37:59.555994+0000","last_undegraded":"2024-03-30T12:37:59.555994+0000","last_fullsized":"2024-03-30T12:37:59.555994+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:22.649643+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:38:22.649643+0000","last_peered":"2024-03-30T12:38:22.649643+0000","last_clean":"2024-03-30T12:38:22.649643+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:38:22.649643+0000","last_undegraded":"2024-03-30T12:38:22.649643+0000","last_fullsized":"2024-03-30T12:38:22.649643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1200,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296444+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:37:20.296444+0000","last_peered":"2024-03-30T12:37:20.296444+0000","last_clean":"2024-03-30T12:37:20.296444+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:37:20.296444+0000","last_undegraded":"2024-03-30T12:37:20.296444+0000","last_fullsized":"2024-03-30T12:37:20.296444+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1717,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.136726+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:38:19.136726+0000","last_peered":"2024-03-30T12:38:19.136726+0000","last_clean":"2024-03-30T12:38:19.136726+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:38:19.136726+0000","last_undegraded":"2024-03-30T12:38:19.136726+0000","last_fullsized":"2024-03-30T12:38:19.136726+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24714,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:40.298683+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:37:40.298683+0000","last_peered":"2024-03-30T12:37:40.298683+0000","last_clean":"2024-03-30T12:37:40.298683+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:37:40.298683+0000","last_undegraded":"2024-03-30T12:37:40.298683+0000","last_fullsized":"2024-03-30T12:37:40.298683+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:05.865263+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:37:05.865263+0000","last_peered":"2024-03-30T12:37:05.865263+0000","last_clean":"2024-03-30T12:37:05.865263+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:37:05.865263+0000","last_undegraded":"2024-03-30T12:37:05.865263+0000","last_fullsized":"2024-03-30T12:37:05.865263+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862413+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:36:40.862413+0000","last_peered":"2024-03-30T12:36:40.862413+0000","last_clean":"2024-03-30T12:36:40.862413+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:36:40.862413+0000","last_undegraded":"2024-03-30T12:36:40.862413+0000","last_fullsized":"2024-03-30T12:36:40.862413+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.136697+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:38:19.136697+0000","last_peered":"2024-03-30T12:38:19.136697+0000","last_clean":"2024-03-30T12:38:19.136697+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:38:19.136697+0000","last_undegraded":"2024-03-30T12:38:19.136697+0000","last_fullsized":"2024-03-30T12:38:19.136697+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16481,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:59.555949+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:37:59.555949+0000","last_peered":"2024-03-30T12:37:59.555949+0000","last_clean":"2024-03-30T12:37:59.555949+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:37:59.555949+0000","last_undegraded":"2024-03-30T12:37:59.555949+0000","last_fullsized":"2024-03-30T12:37:59.555949+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862510+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:36:40.862510+0000","last_peered":"2024-03-30T12:36:40.862510+0000","last_clean":"2024-03-30T12:36:40.862510+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:36:40.862510+0000","last_undegraded":"2024-03-30T12:36:40.862510+0000","last_fullsized":"2024-03-30T12:36:40.862510+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:34.124667+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:36:34.124667+0000","last_peered":"2024-03-30T12:36:34.124667+0000","last_clean":"2024-03-30T12:36:34.124667+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:36:34.124667+0000","last_undegraded":"2024-03-30T12:36:34.124667+0000","last_fullsized":"2024-03-30T12:36:34.124667+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904330+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:37:13.904330+0000","last_peered":"2024-03-30T12:37:13.904330+0000","last_clean":"2024-03-30T12:37:13.904330+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:37:13.904330+0000","last_undegraded":"2024-03-30T12:37:13.904330+0000","last_fullsized":"2024-03-30T12:37:13.904330+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31269,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:52.276052+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:36:52.276052+0000","last_peered":"2024-03-30T12:36:52.276052+0000","last_clean":"2024-03-30T12:36:52.276052+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:36:52.276052+0000","last_undegraded":"2024-03-30T12:36:52.276052+0000","last_fullsized":"2024-03-30T12:36:52.276052+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647394+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:37:57.647394+0000","last_peered":"2024-03-30T12:37:57.647394+0000","last_clean":"2024-03-30T12:37:57.647394+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:37:57.647394+0000","last_undegraded":"2024-03-30T12:37:57.647394+0000","last_fullsized":"2024-03-30T12:37:57.647394+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906874+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:37:38.906874+0000","last_peered":"2024-03-30T12:37:38.906874+0000","last_clean":"2024-03-30T12:37:38.906874+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:37:38.906874+0000","last_undegraded":"2024-03-30T12:37:38.906874+0000","last_fullsized":"2024-03-30T12:37:38.906874+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638999+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:36:37.638999+0000","last_peered":"2024-03-30T12:36:37.638999+0000","last_clean":"2024-03-30T12:36:37.638999+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:36:37.638999+0000","last_undegraded":"2024-03-30T12:36:37.638999+0000","last_fullsized":"2024-03-30T12:36:37.638999+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3765,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647332+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:37:57.647332+0000","last_peered":"2024-03-30T12:37:57.647332+0000","last_clean":"2024-03-30T12:37:57.647332+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:37:57.647332+0000","last_undegraded":"2024-03-30T12:37:57.647332+0000","last_fullsized":"2024-03-30T12:37:57.647332+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:52.276014+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:36:52.276014+0000","last_peered":"2024-03-30T12:36:52.276014+0000","last_clean":"2024-03-30T12:36:52.276014+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:36:52.276014+0000","last_undegraded":"2024-03-30T12:36:52.276014+0000","last_fullsized":"2024-03-30T12:36:52.276014+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1156,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558186+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:38:19.558186+0000","last_peered":"2024-03-30T12:38:19.558186+0000","last_clean":"2024-03-30T12:38:19.558186+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:38:19.558186+0000","last_undegraded":"2024-03-30T12:38:19.558186+0000","last_fullsized":"2024-03-30T12:38:19.558186+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:05.865242+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:37:05.865242+0000","last_peered":"2024-03-30T12:37:05.865242+0000","last_clean":"2024-03-30T12:37:05.865242+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:37:05.865242+0000","last_undegraded":"2024-03-30T12:37:05.865242+0000","last_fullsized":"2024-03-30T12:37:05.865242+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15594,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:00.301062+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:38:00.301062+0000","last_peered":"2024-03-30T12:38:00.301062+0000","last_clean":"2024-03-30T12:38:00.301062+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:38:00.301062+0000","last_undegraded":"2024-03-30T12:38:00.301062+0000","last_fullsized":"2024-03-30T12:38:00.301062+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1143,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:49.126219+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:36:49.126219+0000","last_peered":"2024-03-30T12:36:49.126219+0000","last_clean":"2024-03-30T12:36:49.126219+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:36:49.126219+0000","last_undegraded":"2024-03-30T12:36:49.126219+0000","last_fullsized":"2024-03-30T12:36:49.126219+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:12.278399+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:37:12.278399+0000","last_peered":"2024-03-30T12:37:12.278399+0000","last_clean":"2024-03-30T12:37:12.278399+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:37:12.278399+0000","last_undegraded":"2024-03-30T12:37:12.278399+0000","last_fullsized":"2024-03-30T12:37:12.278399+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29020,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:32.280556+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:37:32.280556+0000","last_peered":"2024-03-30T12:37:32.280556+0000","last_clean":"2024-03-30T12:37:32.280556+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:37:32.280556+0000","last_undegraded":"2024-03-30T12:37:32.280556+0000","last_fullsized":"2024-03-30T12:37:32.280556+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906809+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:37:38.906809+0000","last_peered":"2024-03-30T12:37:38.906809+0000","last_clean":"2024-03-30T12:37:38.906809+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:37:38.906809+0000","last_undegraded":"2024-03-30T12:37:38.906809+0000","last_fullsized":"2024-03-30T12:37:38.906809+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638944+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:36:37.638944+0000","last_peered":"2024-03-30T12:36:37.638944+0000","last_clean":"2024-03-30T12:36:37.638944+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:36:37.638944+0000","last_undegraded":"2024-03-30T12:36:37.638944+0000","last_fullsized":"2024-03-30T12:36:37.638944+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5610,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:23.370279+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:36:23.370279+0000","last_peered":"2024-03-30T12:36:23.370279+0000","last_clean":"2024-03-30T12:36:23.370279+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:36:23.370279+0000","last_undegraded":"2024-03-30T12:36:23.370279+0000","last_fullsized":"2024-03-30T12:36:23.370279+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1365,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906835+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:37:38.906835+0000","last_peered":"2024-03-30T12:37:38.906835+0000","last_clean":"2024-03-30T12:37:38.906835+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:37:38.906835+0000","last_undegraded":"2024-03-30T12:37:38.906835+0000","last_fullsized":"2024-03-30T12:37:38.906835+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:57.641061+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:57.641061+0000","last_peered":"2024-03-30T12:36:57.641061+0000","last_clean":"2024-03-30T12:36:57.641061+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:57.641061+0000","last_undegraded":"2024-03-30T12:36:57.641061+0000","last_fullsized":"2024-03-30T12:36:57.641061+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4275,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:03.909427+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:38:03.909427+0000","last_peered":"2024-03-30T12:38:03.909427+0000","last_clean":"2024-03-30T12:38:03.909427+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:38:03.909427+0000","last_undegraded":"2024-03-30T12:38:03.909427+0000","last_fullsized":"2024-03-30T12:38:03.909427+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.127976+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:37:04.127976+0000","last_peered":"2024-03-30T12:37:04.127976+0000","last_clean":"2024-03-30T12:37:04.127976+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:37:04.127976+0000","last_undegraded":"2024-03-30T12:37:04.127976+0000","last_fullsized":"2024-03-30T12:37:04.127976+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558134+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:38:19.558134+0000","last_peered":"2024-03-30T12:38:19.558134+0000","last_clean":"2024-03-30T12:38:19.558134+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:38:19.558134+0000","last_undegraded":"2024-03-30T12:38:19.558134+0000","last_fullsized":"2024-03-30T12:38:19.558134+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5253,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:23.370200+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:36:23.370200+0000","last_peered":"2024-03-30T12:36:23.370200+0000","last_clean":"2024-03-30T12:36:23.370200+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:36:23.370200+0000","last_undegraded":"2024-03-30T12:36:23.370200+0000","last_fullsized":"2024-03-30T12:36:23.370200+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:23.370243+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:36:23.370243+0000","last_peered":"2024-03-30T12:36:23.370243+0000","last_clean":"2024-03-30T12:36:23.370243+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:36:23.370243+0000","last_undegraded":"2024-03-30T12:36:23.370243+0000","last_fullsized":"2024-03-30T12:36:23.370243+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128016+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:37:04.128016+0000","last_peered":"2024-03-30T12:37:04.128016+0000","last_clean":"2024-03-30T12:37:04.128016+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:37:04.128016+0000","last_undegraded":"2024-03-30T12:37:04.128016+0000","last_fullsized":"2024-03-30T12:37:04.128016+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4811,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:13.383202+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:38:13.383202+0000","last_peered":"2024-03-30T12:38:13.383202+0000","last_clean":"2024-03-30T12:38:13.383202+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:38:13.383202+0000","last_undegraded":"2024-03-30T12:38:13.383202+0000","last_fullsized":"2024-03-30T12:38:13.383202+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:03.909462+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:38:03.909462+0000","last_peered":"2024-03-30T12:38:03.909462+0000","last_clean":"2024-03-30T12:38:03.909462+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:38:03.909462+0000","last_undegraded":"2024-03-30T12:38:03.909462+0000","last_fullsized":"2024-03-30T12:38:03.909462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:00.301034+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:38:00.301034+0000","last_peered":"2024-03-30T12:38:00.301034+0000","last_clean":"2024-03-30T12:38:00.301034+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:38:00.301034+0000","last_undegraded":"2024-03-30T12:38:00.301034+0000","last_fullsized":"2024-03-30T12:38:00.301034+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6743,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:49.126256+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:36:49.126256+0000","last_peered":"2024-03-30T12:36:49.126256+0000","last_clean":"2024-03-30T12:36:49.126256+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:36:49.126256+0000","last_undegraded":"2024-03-30T12:36:49.126256+0000","last_fullsized":"2024-03-30T12:36:49.126256+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1337,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:23.370314+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:36:23.370314+0000","last_peered":"2024-03-30T12:36:23.370314+0000","last_clean":"2024-03-30T12:36:23.370314+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:36:23.370314+0000","last_undegraded":"2024-03-30T12:36:23.370314+0000","last_fullsized":"2024-03-30T12:36:23.370314+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128054+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:37:04.128054+0000","last_peered":"2024-03-30T12:37:04.128054+0000","last_clean":"2024-03-30T12:37:04.128054+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:37:04.128054+0000","last_undegraded":"2024-03-30T12:37:04.128054+0000","last_fullsized":"2024-03-30T12:37:04.128054+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:59.555915+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:37:59.555915+0000","last_peered":"2024-03-30T12:37:59.555915+0000","last_clean":"2024-03-30T12:37:59.555915+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:37:59.555915+0000","last_undegraded":"2024-03-30T12:37:59.555915+0000","last_fullsized":"2024-03-30T12:37:59.555915+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:48.380210+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:37:48.380210+0000","last_peered":"2024-03-30T12:37:48.380210+0000","last_clean":"2024-03-30T12:37:48.380210+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:37:48.380210+0000","last_undegraded":"2024-03-30T12:37:48.380210+0000","last_fullsized":"2024-03-30T12:37:48.380210+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296394+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:37:20.296394+0000","last_peered":"2024-03-30T12:37:20.296394+0000","last_clean":"2024-03-30T12:37:20.296394+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:37:20.296394+0000","last_undegraded":"2024-03-30T12:37:20.296394+0000","last_fullsized":"2024-03-30T12:37:20.296394+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862462+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:36:40.862462+0000","last_peered":"2024-03-30T12:36:40.862462+0000","last_clean":"2024-03-30T12:36:40.862462+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:36:40.862462+0000","last_undegraded":"2024-03-30T12:36:40.862462+0000","last_fullsized":"2024-03-30T12:36:40.862462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638978+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:36:37.638978+0000","last_peered":"2024-03-30T12:36:37.638978+0000","last_clean":"2024-03-30T12:36:37.638978+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:36:37.638978+0000","last_undegraded":"2024-03-30T12:36:37.638978+0000","last_fullsized":"2024-03-30T12:36:37.638978+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906859+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:37:38.906859+0000","last_peered":"2024-03-30T12:37:38.906859+0000","last_clean":"2024-03-30T12:37:38.906859+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:37:38.906859+0000","last_undegraded":"2024-03-30T12:37:38.906859+0000","last_fullsized":"2024-03-30T12:37:38.906859+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1178,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558174+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:38:19.558174+0000","last_peered":"2024-03-30T12:38:19.558174+0000","last_clean":"2024-03-30T12:38:19.558174+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:38:19.558174+0000","last_undegraded":"2024-03-30T12:38:19.558174+0000","last_fullsized":"2024-03-30T12:38:19.558174+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1281,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.639015+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:36:37.639015+0000","last_peered":"2024-03-30T12:36:37.639015+0000","last_clean":"2024-03-30T12:36:37.639015+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:36:37.639015+0000","last_undegraded":"2024-03-30T12:36:37.639015+0000","last_fullsized":"2024-03-30T12:36:37.639015+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:40.298625+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:37:40.298625+0000","last_peered":"2024-03-30T12:37:40.298625+0000","last_clean":"2024-03-30T12:37:40.298625+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:37:40.298625+0000","last_undegraded":"2024-03-30T12:37:40.298625+0000","last_fullsized":"2024-03-30T12:37:40.298625+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:57.641040+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:57.641040+0000","last_peered":"2024-03-30T12:36:57.641040+0000","last_clean":"2024-03-30T12:36:57.641040+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:57.641040+0000","last_undegraded":"2024-03-30T12:36:57.641040+0000","last_fullsized":"2024-03-30T12:36:57.641040+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1216,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:00.300996+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:38:00.300996+0000","last_peered":"2024-03-30T12:38:00.300996+0000","last_clean":"2024-03-30T12:38:00.300996+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:38:00.300996+0000","last_undegraded":"2024-03-30T12:38:00.300996+0000","last_fullsized":"2024-03-30T12:38:00.300996+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:30.867819+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:37:30.867819+0000","last_peered":"2024-03-30T12:37:30.867819+0000","last_clean":"2024-03-30T12:37:30.867819+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:37:30.867819+0000","last_undegraded":"2024-03-30T12:37:30.867819+0000","last_fullsized":"2024-03-30T12:37:30.867819+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:24.545379+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:36:24.545379+0000","last_peered":"2024-03-30T12:36:24.545379+0000","last_clean":"2024-03-30T12:36:24.545379+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:36:24.545379+0000","last_undegraded":"2024-03-30T12:36:24.545379+0000","last_fullsized":"2024-03-30T12:36:24.545379+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438076,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648132,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175142,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254381,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063199,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951256,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839313,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923596,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:40:37.754 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:37.754 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:37.754 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:37.754 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:37.754 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:37.754 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:37.754 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:37.754 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:37.754 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:37.754 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:37.754 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:37.755 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:37.755 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:37.755 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:40:38.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:37 smithi084 ceph-mon[91810]: pgmap v1127: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:38.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:37 smithi084 ceph-mon[91810]: from='client.44573 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:40:38.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:37 smithi084 ceph-mon[89279]: pgmap v1127: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:38.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:37 smithi084 ceph-mon[89279]: from='client.44573 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:40:38.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:37 smithi162 ceph-mon[83709]: pgmap v1127: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:38.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:37 smithi162 ceph-mon[83709]: from='client.44573 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:40:39.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:40:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:40:39] "GET /metrics HTTP/1.1" 200 36327 "" "Prometheus/2.43.0" 2024-03-30T12:40:41.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:40 smithi162 ceph-mon[83709]: pgmap v1128: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:41.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:40 smithi084 ceph-mon[89279]: pgmap v1128: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:41.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:40 smithi084 ceph-mon[91810]: pgmap v1128: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:43.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:42 smithi162 ceph-mon[83709]: pgmap v1129: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:43.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:42 smithi084 ceph-mon[89279]: pgmap v1129: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:43.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:42 smithi084 ceph-mon[91810]: pgmap v1129: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:45.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:44 smithi162 ceph-mon[83709]: pgmap v1130: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:45.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:44 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:40:45.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:44 smithi084 ceph-mon[89279]: pgmap v1130: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:45.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:40:45.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:44 smithi084 ceph-mon[91810]: pgmap v1130: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:45.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:44 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:40:47.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:46 smithi162 ceph-mon[83709]: pgmap v1131: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:47.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:46 smithi084 ceph-mon[89279]: pgmap v1131: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:47.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:46 smithi084 ceph-mon[91810]: pgmap v1131: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:47.756 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:40:47.970 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:40:49.093 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:48 smithi084 ceph-mon[89279]: pgmap v1132: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:49.093 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:48 smithi084 ceph-mon[91810]: pgmap v1132: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:49.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:48 smithi162 ceph-mon[83709]: pgmap v1132: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:49.456 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:40:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:40:49] "GET /metrics HTTP/1.1" 200 36328 "" "Prometheus/2.43.0" 2024-03-30T12:40:49.767 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:40:49.769 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:40:50.431 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1133,"stamp":"2024-03-30T12:40:48.888783+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003765"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.138971+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:38:39.138971+0000","last_peered":"2024-03-30T12:38:39.138971+0000","last_clean":"2024-03-30T12:38:39.138971+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:38:39.138971+0000","last_undegraded":"2024-03-30T12:38:39.138971+0000","last_fullsized":"2024-03-30T12:38:39.138971+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1364,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904373+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:37:13.904373+0000","last_peered":"2024-03-30T12:37:13.904373+0000","last_clean":"2024-03-30T12:37:13.904373+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:37:13.904373+0000","last_undegraded":"2024-03-30T12:37:13.904373+0000","last_fullsized":"2024-03-30T12:37:13.904373+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862523+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:36:40.862523+0000","last_peered":"2024-03-30T12:36:40.862523+0000","last_clean":"2024-03-30T12:36:40.862523+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:36:40.862523+0000","last_undegraded":"2024-03-30T12:36:40.862523+0000","last_fullsized":"2024-03-30T12:36:40.862523+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:00.294130+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:37:00.294130+0000","last_peered":"2024-03-30T12:37:00.294130+0000","last_clean":"2024-03-30T12:37:00.294130+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:37:00.294130+0000","last_undegraded":"2024-03-30T12:37:00.294130+0000","last_fullsized":"2024-03-30T12:37:00.294130+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133062+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:37:49.133062+0000","last_peered":"2024-03-30T12:37:49.133062+0000","last_clean":"2024-03-30T12:37:49.133062+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:37:49.133062+0000","last_undegraded":"2024-03-30T12:37:49.133062+0000","last_fullsized":"2024-03-30T12:37:49.133062+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1210,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290374+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:30.290374+0000","last_peered":"2024-03-30T12:36:30.290374+0000","last_clean":"2024-03-30T12:36:30.290374+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:30.290374+0000","last_undegraded":"2024-03-30T12:36:30.290374+0000","last_fullsized":"2024-03-30T12:36:30.290374+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133035+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:37:49.133035+0000","last_peered":"2024-03-30T12:37:49.133035+0000","last_clean":"2024-03-30T12:37:49.133035+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:37:49.133035+0000","last_undegraded":"2024-03-30T12:37:49.133035+0000","last_fullsized":"2024-03-30T12:37:49.133035+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647301+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:37:57.647301+0000","last_peered":"2024-03-30T12:37:57.647301+0000","last_clean":"2024-03-30T12:37:57.647301+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:37:57.647301+0000","last_undegraded":"2024-03-30T12:37:57.647301+0000","last_fullsized":"2024-03-30T12:37:57.647301+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:34.131337+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:37:34.131337+0000","last_peered":"2024-03-30T12:37:34.131337+0000","last_clean":"2024-03-30T12:37:34.131337+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:37:34.131337+0000","last_undegraded":"2024-03-30T12:37:34.131337+0000","last_fullsized":"2024-03-30T12:37:34.131337+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548505+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:54.548505+0000","last_peered":"2024-03-30T12:36:54.548505+0000","last_clean":"2024-03-30T12:36:54.548505+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:54.548505+0000","last_undegraded":"2024-03-30T12:36:54.548505+0000","last_fullsized":"2024-03-30T12:36:54.548505+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548476+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:54.548476+0000","last_peered":"2024-03-30T12:36:54.548476+0000","last_clean":"2024-03-30T12:36:54.548476+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:54.548476+0000","last_undegraded":"2024-03-30T12:36:54.548476+0000","last_fullsized":"2024-03-30T12:36:54.548476+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1271,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:12.285006+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:38:12.285006+0000","last_peered":"2024-03-30T12:38:12.285006+0000","last_clean":"2024-03-30T12:38:12.285006+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:38:12.285006+0000","last_undegraded":"2024-03-30T12:38:12.285006+0000","last_fullsized":"2024-03-30T12:38:12.285006+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645098+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:37:37.645098+0000","last_peered":"2024-03-30T12:37:37.645098+0000","last_clean":"2024-03-30T12:37:37.645098+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:37:37.645098+0000","last_undegraded":"2024-03-30T12:37:37.645098+0000","last_fullsized":"2024-03-30T12:37:37.645098+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870430+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:37:55.870430+0000","last_peered":"2024-03-30T12:37:55.870430+0000","last_clean":"2024-03-30T12:37:55.870430+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:37:55.870430+0000","last_undegraded":"2024-03-30T12:37:55.870430+0000","last_fullsized":"2024-03-30T12:37:55.870430+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:08.897219+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:36:08.897219+0000","last_peered":"2024-03-30T12:36:08.897219+0000","last_clean":"2024-03-30T12:36:08.897219+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:36:08.897219+0000","last_undegraded":"2024-03-30T12:36:08.897219+0000","last_fullsized":"2024-03-30T12:36:08.897219+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303373+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:38:20.303373+0000","last_peered":"2024-03-30T12:38:20.303373+0000","last_clean":"2024-03-30T12:38:20.303373+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:38:20.303373+0000","last_undegraded":"2024-03-30T12:38:20.303373+0000","last_fullsized":"2024-03-30T12:38:20.303373+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1225,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303460+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:38:20.303460+0000","last_peered":"2024-03-30T12:38:20.303460+0000","last_clean":"2024-03-30T12:38:20.303460+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:38:20.303460+0000","last_undegraded":"2024-03-30T12:38:20.303460+0000","last_fullsized":"2024-03-30T12:38:20.303460+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:43.372790+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:36:43.372790+0000","last_peered":"2024-03-30T12:36:43.372790+0000","last_clean":"2024-03-30T12:36:43.372790+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:36:43.372790+0000","last_undegraded":"2024-03-30T12:36:43.372790+0000","last_fullsized":"2024-03-30T12:36:43.372790+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128028+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:37:04.128028+0000","last_peered":"2024-03-30T12:37:04.128028+0000","last_clean":"2024-03-30T12:37:04.128028+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:37:04.128028+0000","last_undegraded":"2024-03-30T12:37:04.128028+0000","last_fullsized":"2024-03-30T12:37:04.128028+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1388,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862565+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:36:40.862565+0000","last_peered":"2024-03-30T12:36:40.862565+0000","last_clean":"2024-03-30T12:36:40.862565+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:36:40.862565+0000","last_undegraded":"2024-03-30T12:36:40.862565+0000","last_fullsized":"2024-03-30T12:36:40.862565+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1283,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647447+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:37:57.647447+0000","last_peered":"2024-03-30T12:37:57.647447+0000","last_clean":"2024-03-30T12:37:57.647447+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:37:57.647447+0000","last_undegraded":"2024-03-30T12:37:57.647447+0000","last_fullsized":"2024-03-30T12:37:57.647447+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1302,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647455+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:37:57.647455+0000","last_peered":"2024-03-30T12:37:57.647455+0000","last_clean":"2024-03-30T12:37:57.647455+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:37:57.647455+0000","last_undegraded":"2024-03-30T12:37:57.647455+0000","last_fullsized":"2024-03-30T12:37:57.647455+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862552+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:36:40.862552+0000","last_peered":"2024-03-30T12:36:40.862552+0000","last_clean":"2024-03-30T12:36:40.862552+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:36:40.862552+0000","last_undegraded":"2024-03-30T12:36:40.862552+0000","last_fullsized":"2024-03-30T12:36:40.862552+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1151,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133095+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:37:49.133095+0000","last_peered":"2024-03-30T12:37:49.133095+0000","last_clean":"2024-03-30T12:37:49.133095+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:37:49.133095+0000","last_undegraded":"2024-03-30T12:37:49.133095+0000","last_fullsized":"2024-03-30T12:37:49.133095+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1229,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290400+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:30.290400+0000","last_peered":"2024-03-30T12:36:30.290400+0000","last_clean":"2024-03-30T12:36:30.290400+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:30.290400+0000","last_undegraded":"2024-03-30T12:36:30.290400+0000","last_fullsized":"2024-03-30T12:36:30.290400+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133077+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:37:49.133077+0000","last_peered":"2024-03-30T12:37:49.133077+0000","last_clean":"2024-03-30T12:37:49.133077+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:37:49.133077+0000","last_undegraded":"2024-03-30T12:37:49.133077+0000","last_fullsized":"2024-03-30T12:37:49.133077+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1213,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290416+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:30.290416+0000","last_peered":"2024-03-30T12:36:30.290416+0000","last_clean":"2024-03-30T12:36:30.290416+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:30.290416+0000","last_undegraded":"2024-03-30T12:36:30.290416+0000","last_fullsized":"2024-03-30T12:36:30.290416+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647433+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:37:57.647433+0000","last_peered":"2024-03-30T12:37:57.647433+0000","last_clean":"2024-03-30T12:37:57.647433+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:37:57.647433+0000","last_undegraded":"2024-03-30T12:37:57.647433+0000","last_fullsized":"2024-03-30T12:37:57.647433+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018910+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:36:03.018910+0000","last_peered":"2024-03-30T12:36:03.018910+0000","last_clean":"2024-03-30T12:36:03.018910+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:36:03.018910+0000","last_undegraded":"2024-03-30T12:36:03.018910+0000","last_fullsized":"2024-03-30T12:36:03.018910+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1180,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:09.550388+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:37:09.550388+0000","last_peered":"2024-03-30T12:37:09.550388+0000","last_clean":"2024-03-30T12:37:09.550388+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:37:09.550388+0000","last_undegraded":"2024-03-30T12:37:09.550388+0000","last_fullsized":"2024-03-30T12:37:09.550388+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.860010+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:36:15.860010+0000","last_peered":"2024-03-30T12:36:15.860010+0000","last_clean":"2024-03-30T12:36:15.860010+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:36:15.860010+0000","last_undegraded":"2024-03-30T12:36:15.860010+0000","last_fullsized":"2024-03-30T12:36:15.860010+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645072+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:37:37.645072+0000","last_peered":"2024-03-30T12:37:37.645072+0000","last_clean":"2024-03-30T12:37:37.645072+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:37:37.645072+0000","last_undegraded":"2024-03-30T12:37:37.645072+0000","last_fullsized":"2024-03-30T12:37:37.645072+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645031+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:37:37.645031+0000","last_peered":"2024-03-30T12:37:37.645031+0000","last_clean":"2024-03-30T12:37:37.645031+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:37:37.645031+0000","last_undegraded":"2024-03-30T12:37:37.645031+0000","last_fullsized":"2024-03-30T12:37:37.645031+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1224,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288884+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:36:15.288884+0000","last_peered":"2024-03-30T12:36:15.288884+0000","last_clean":"2024-03-30T12:36:15.288884+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:36:15.288884+0000","last_undegraded":"2024-03-30T12:36:15.288884+0000","last_fullsized":"2024-03-30T12:36:15.288884+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:28.899208+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:36:28.899208+0000","last_peered":"2024-03-30T12:36:28.899208+0000","last_clean":"2024-03-30T12:36:28.899208+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:36:28.899208+0000","last_undegraded":"2024-03-30T12:36:28.899208+0000","last_fullsized":"2024-03-30T12:36:28.899208+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548518+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:54.548518+0000","last_peered":"2024-03-30T12:36:54.548518+0000","last_clean":"2024-03-30T12:36:54.548518+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:54.548518+0000","last_undegraded":"2024-03-30T12:36:54.548518+0000","last_fullsized":"2024-03-30T12:36:54.548518+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1204,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288944+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:36:15.288944+0000","last_peered":"2024-03-30T12:36:15.288944+0000","last_clean":"2024-03-30T12:36:15.288944+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:36:15.288944+0000","last_undegraded":"2024-03-30T12:36:15.288944+0000","last_fullsized":"2024-03-30T12:36:15.288944+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1198,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288933+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:36:15.288933+0000","last_peered":"2024-03-30T12:36:15.288933+0000","last_clean":"2024-03-30T12:36:15.288933+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:36:15.288933+0000","last_undegraded":"2024-03-30T12:36:15.288933+0000","last_fullsized":"2024-03-30T12:36:15.288933+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:03.374890+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:37:03.374890+0000","last_peered":"2024-03-30T12:37:03.374890+0000","last_clean":"2024-03-30T12:37:03.374890+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:37:03.374890+0000","last_undegraded":"2024-03-30T12:37:03.374890+0000","last_fullsized":"2024-03-30T12:37:03.374890+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:28.899251+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:36:28.899251+0000","last_peered":"2024-03-30T12:36:28.899251+0000","last_clean":"2024-03-30T12:36:28.899251+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:36:28.899251+0000","last_undegraded":"2024-03-30T12:36:28.899251+0000","last_fullsized":"2024-03-30T12:36:28.899251+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:52.282667+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:37:52.282667+0000","last_peered":"2024-03-30T12:37:52.282667+0000","last_clean":"2024-03-30T12:37:52.282667+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:37:52.282667+0000","last_undegraded":"2024-03-30T12:37:52.282667+0000","last_fullsized":"2024-03-30T12:37:52.282667+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546935+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:36:39.546935+0000","last_peered":"2024-03-30T12:36:39.546935+0000","last_clean":"2024-03-30T12:36:39.546935+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:36:39.546935+0000","last_undegraded":"2024-03-30T12:36:39.546935+0000","last_fullsized":"2024-03-30T12:36:39.546935+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:34.131303+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:37:34.131303+0000","last_peered":"2024-03-30T12:37:34.131303+0000","last_clean":"2024-03-30T12:37:34.131303+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:37:34.131303+0000","last_undegraded":"2024-03-30T12:37:34.131303+0000","last_fullsized":"2024-03-30T12:37:34.131303+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1384,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870514+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:37:55.870514+0000","last_peered":"2024-03-30T12:37:55.870514+0000","last_clean":"2024-03-30T12:37:55.870514+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:37:55.870514+0000","last_undegraded":"2024-03-30T12:37:55.870514+0000","last_fullsized":"2024-03-30T12:37:55.870514+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870486+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:37:55.870486+0000","last_peered":"2024-03-30T12:37:55.870486+0000","last_clean":"2024-03-30T12:37:55.870486+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:37:55.870486+0000","last_undegraded":"2024-03-30T12:37:55.870486+0000","last_fullsized":"2024-03-30T12:37:55.870486+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303405+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:38:20.303405+0000","last_peered":"2024-03-30T12:38:20.303405+0000","last_clean":"2024-03-30T12:38:20.303405+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:38:20.303405+0000","last_undegraded":"2024-03-30T12:38:20.303405+0000","last_fullsized":"2024-03-30T12:38:20.303405+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:19.129793+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:37:19.129793+0000","last_peered":"2024-03-30T12:37:19.129793+0000","last_clean":"2024-03-30T12:37:19.129793+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:37:19.129793+0000","last_undegraded":"2024-03-30T12:37:19.129793+0000","last_fullsized":"2024-03-30T12:37:19.129793+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546908+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:36:39.546908+0000","last_peered":"2024-03-30T12:36:39.546908+0000","last_clean":"2024-03-30T12:36:39.546908+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:36:39.546908+0000","last_undegraded":"2024-03-30T12:36:39.546908+0000","last_fullsized":"2024-03-30T12:36:39.546908+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546882+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:36:39.546882+0000","last_peered":"2024-03-30T12:36:39.546882+0000","last_clean":"2024-03-30T12:36:39.546882+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:36:39.546882+0000","last_undegraded":"2024-03-30T12:36:39.546882+0000","last_fullsized":"2024-03-30T12:36:39.546882+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1344,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:43.372738+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:36:43.372738+0000","last_peered":"2024-03-30T12:36:43.372738+0000","last_clean":"2024-03-30T12:36:43.372738+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:36:43.372738+0000","last_undegraded":"2024-03-30T12:36:43.372738+0000","last_fullsized":"2024-03-30T12:36:43.372738+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:19.129759+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:37:19.129759+0000","last_peered":"2024-03-30T12:37:19.129759+0000","last_clean":"2024-03-30T12:37:19.129759+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:37:19.129759+0000","last_undegraded":"2024-03-30T12:37:19.129759+0000","last_fullsized":"2024-03-30T12:37:19.129759+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5753,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:13.383127+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:38:13.383127+0000","last_peered":"2024-03-30T12:38:13.383127+0000","last_clean":"2024-03-30T12:38:13.383127+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:38:13.383127+0000","last_undegraded":"2024-03-30T12:38:13.383127+0000","last_fullsized":"2024-03-30T12:38:13.383127+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1275,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:32.280622+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:37:32.280622+0000","last_peered":"2024-03-30T12:37:32.280622+0000","last_clean":"2024-03-30T12:37:32.280622+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:37:32.280622+0000","last_undegraded":"2024-03-30T12:37:32.280622+0000","last_fullsized":"2024-03-30T12:37:32.280622+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128039+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:37:04.128039+0000","last_peered":"2024-03-30T12:37:04.128039+0000","last_clean":"2024-03-30T12:37:04.128039+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:37:04.128039+0000","last_undegraded":"2024-03-30T12:37:04.128039+0000","last_fullsized":"2024-03-30T12:37:04.128039+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5513,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:40.862481+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:36:40.862481+0000","last_peered":"2024-03-30T12:36:40.862481+0000","last_clean":"2024-03-30T12:36:40.862481+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:36:40.862481+0000","last_undegraded":"2024-03-30T12:36:40.862481+0000","last_fullsized":"2024-03-30T12:36:40.862481+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904270+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:37:13.904270+0000","last_peered":"2024-03-30T12:37:13.904270+0000","last_clean":"2024-03-30T12:37:13.904270+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:37:13.904270+0000","last_undegraded":"2024-03-30T12:37:13.904270+0000","last_fullsized":"2024-03-30T12:37:13.904270+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904297+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:37:13.904297+0000","last_peered":"2024-03-30T12:37:13.904297+0000","last_clean":"2024-03-30T12:37:13.904297+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:37:13.904297+0000","last_undegraded":"2024-03-30T12:37:13.904297+0000","last_fullsized":"2024-03-30T12:37:13.904297+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296466+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:37:20.296466+0000","last_peered":"2024-03-30T12:37:20.296466+0000","last_clean":"2024-03-30T12:37:20.296466+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:37:20.296466+0000","last_undegraded":"2024-03-30T12:37:20.296466+0000","last_fullsized":"2024-03-30T12:37:20.296466+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5458,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:40.862535+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:36:40.862535+0000","last_peered":"2024-03-30T12:36:40.862535+0000","last_clean":"2024-03-30T12:36:40.862535+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:36:40.862535+0000","last_undegraded":"2024-03-30T12:36:40.862535+0000","last_fullsized":"2024-03-30T12:36:40.862535+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904314+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:37:13.904314+0000","last_peered":"2024-03-30T12:37:13.904314+0000","last_clean":"2024-03-30T12:37:13.904314+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:37:13.904314+0000","last_undegraded":"2024-03-30T12:37:13.904314+0000","last_fullsized":"2024-03-30T12:37:13.904314+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1207,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296362+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:37:20.296362+0000","last_peered":"2024-03-30T12:37:20.296362+0000","last_clean":"2024-03-30T12:37:20.296362+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:37:20.296362+0000","last_undegraded":"2024-03-30T12:37:20.296362+0000","last_fullsized":"2024-03-30T12:37:20.296362+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1272,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:52.276088+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:36:52.276088+0000","last_peered":"2024-03-30T12:36:52.276088+0000","last_clean":"2024-03-30T12:36:52.276088+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:36:52.276088+0000","last_undegraded":"2024-03-30T12:36:52.276088+0000","last_fullsized":"2024-03-30T12:36:52.276088+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3804,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:13.383237+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:38:13.383237+0000","last_peered":"2024-03-30T12:38:13.383237+0000","last_clean":"2024-03-30T12:38:13.383237+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:38:13.383237+0000","last_undegraded":"2024-03-30T12:38:13.383237+0000","last_fullsized":"2024-03-30T12:38:13.383237+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1343,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906884+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:37:38.906884+0000","last_peered":"2024-03-30T12:37:38.906884+0000","last_clean":"2024-03-30T12:37:38.906884+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:37:38.906884+0000","last_undegraded":"2024-03-30T12:37:38.906884+0000","last_fullsized":"2024-03-30T12:37:38.906884+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:48.901383+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:36:48.901383+0000","last_peered":"2024-03-30T12:36:48.901383+0000","last_clean":"2024-03-30T12:36:48.901383+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:36:48.901383+0000","last_undegraded":"2024-03-30T12:36:48.901383+0000","last_fullsized":"2024-03-30T12:36:48.901383+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:48.380185+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:37:48.380185+0000","last_peered":"2024-03-30T12:37:48.380185+0000","last_clean":"2024-03-30T12:37:48.380185+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:37:48.380185+0000","last_undegraded":"2024-03-30T12:37:48.380185+0000","last_fullsized":"2024-03-30T12:37:48.380185+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4577,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:39.138875+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:38:39.138875+0000","last_peered":"2024-03-30T12:38:39.138875+0000","last_clean":"2024-03-30T12:38:39.138875+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:38:39.138875+0000","last_undegraded":"2024-03-30T12:38:39.138875+0000","last_fullsized":"2024-03-30T12:38:39.138875+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1175,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:59.555994+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:37:59.555994+0000","last_peered":"2024-03-30T12:37:59.555994+0000","last_clean":"2024-03-30T12:37:59.555994+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:37:59.555994+0000","last_undegraded":"2024-03-30T12:37:59.555994+0000","last_fullsized":"2024-03-30T12:37:59.555994+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:22.649643+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:38:22.649643+0000","last_peered":"2024-03-30T12:38:22.649643+0000","last_clean":"2024-03-30T12:38:22.649643+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:38:22.649643+0000","last_undegraded":"2024-03-30T12:38:22.649643+0000","last_fullsized":"2024-03-30T12:38:22.649643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1200,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296444+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:37:20.296444+0000","last_peered":"2024-03-30T12:37:20.296444+0000","last_clean":"2024-03-30T12:37:20.296444+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:37:20.296444+0000","last_undegraded":"2024-03-30T12:37:20.296444+0000","last_fullsized":"2024-03-30T12:37:20.296444+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1717,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.136726+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:38:19.136726+0000","last_peered":"2024-03-30T12:38:19.136726+0000","last_clean":"2024-03-30T12:38:19.136726+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:38:19.136726+0000","last_undegraded":"2024-03-30T12:38:19.136726+0000","last_fullsized":"2024-03-30T12:38:19.136726+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24714,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:40.298683+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:37:40.298683+0000","last_peered":"2024-03-30T12:37:40.298683+0000","last_clean":"2024-03-30T12:37:40.298683+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:37:40.298683+0000","last_undegraded":"2024-03-30T12:37:40.298683+0000","last_fullsized":"2024-03-30T12:37:40.298683+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:05.865263+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:37:05.865263+0000","last_peered":"2024-03-30T12:37:05.865263+0000","last_clean":"2024-03-30T12:37:05.865263+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:37:05.865263+0000","last_undegraded":"2024-03-30T12:37:05.865263+0000","last_fullsized":"2024-03-30T12:37:05.865263+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862413+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:36:40.862413+0000","last_peered":"2024-03-30T12:36:40.862413+0000","last_clean":"2024-03-30T12:36:40.862413+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:36:40.862413+0000","last_undegraded":"2024-03-30T12:36:40.862413+0000","last_fullsized":"2024-03-30T12:36:40.862413+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.136697+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:38:19.136697+0000","last_peered":"2024-03-30T12:38:19.136697+0000","last_clean":"2024-03-30T12:38:19.136697+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:38:19.136697+0000","last_undegraded":"2024-03-30T12:38:19.136697+0000","last_fullsized":"2024-03-30T12:38:19.136697+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16481,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:59.555949+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:37:59.555949+0000","last_peered":"2024-03-30T12:37:59.555949+0000","last_clean":"2024-03-30T12:37:59.555949+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:37:59.555949+0000","last_undegraded":"2024-03-30T12:37:59.555949+0000","last_fullsized":"2024-03-30T12:37:59.555949+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862510+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:36:40.862510+0000","last_peered":"2024-03-30T12:36:40.862510+0000","last_clean":"2024-03-30T12:36:40.862510+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:36:40.862510+0000","last_undegraded":"2024-03-30T12:36:40.862510+0000","last_fullsized":"2024-03-30T12:36:40.862510+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1164,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.138928+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:38:39.138928+0000","last_peered":"2024-03-30T12:38:39.138928+0000","last_clean":"2024-03-30T12:38:39.138928+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:38:39.138928+0000","last_undegraded":"2024-03-30T12:38:39.138928+0000","last_fullsized":"2024-03-30T12:38:39.138928+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904330+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:37:13.904330+0000","last_peered":"2024-03-30T12:37:13.904330+0000","last_clean":"2024-03-30T12:37:13.904330+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:37:13.904330+0000","last_undegraded":"2024-03-30T12:37:13.904330+0000","last_fullsized":"2024-03-30T12:37:13.904330+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31269,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:52.276052+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:36:52.276052+0000","last_peered":"2024-03-30T12:36:52.276052+0000","last_clean":"2024-03-30T12:36:52.276052+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:36:52.276052+0000","last_undegraded":"2024-03-30T12:36:52.276052+0000","last_fullsized":"2024-03-30T12:36:52.276052+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647394+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:37:57.647394+0000","last_peered":"2024-03-30T12:37:57.647394+0000","last_clean":"2024-03-30T12:37:57.647394+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:37:57.647394+0000","last_undegraded":"2024-03-30T12:37:57.647394+0000","last_fullsized":"2024-03-30T12:37:57.647394+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906874+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:37:38.906874+0000","last_peered":"2024-03-30T12:37:38.906874+0000","last_clean":"2024-03-30T12:37:38.906874+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:37:38.906874+0000","last_undegraded":"2024-03-30T12:37:38.906874+0000","last_fullsized":"2024-03-30T12:37:38.906874+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638999+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:36:37.638999+0000","last_peered":"2024-03-30T12:36:37.638999+0000","last_clean":"2024-03-30T12:36:37.638999+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:36:37.638999+0000","last_undegraded":"2024-03-30T12:36:37.638999+0000","last_fullsized":"2024-03-30T12:36:37.638999+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3765,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647332+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:37:57.647332+0000","last_peered":"2024-03-30T12:37:57.647332+0000","last_clean":"2024-03-30T12:37:57.647332+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:37:57.647332+0000","last_undegraded":"2024-03-30T12:37:57.647332+0000","last_fullsized":"2024-03-30T12:37:57.647332+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:52.276014+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:36:52.276014+0000","last_peered":"2024-03-30T12:36:52.276014+0000","last_clean":"2024-03-30T12:36:52.276014+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:36:52.276014+0000","last_undegraded":"2024-03-30T12:36:52.276014+0000","last_fullsized":"2024-03-30T12:36:52.276014+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1156,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558186+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:38:19.558186+0000","last_peered":"2024-03-30T12:38:19.558186+0000","last_clean":"2024-03-30T12:38:19.558186+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:38:19.558186+0000","last_undegraded":"2024-03-30T12:38:19.558186+0000","last_fullsized":"2024-03-30T12:38:19.558186+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:05.865242+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:37:05.865242+0000","last_peered":"2024-03-30T12:37:05.865242+0000","last_clean":"2024-03-30T12:37:05.865242+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:37:05.865242+0000","last_undegraded":"2024-03-30T12:37:05.865242+0000","last_fullsized":"2024-03-30T12:37:05.865242+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15594,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:00.301062+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:38:00.301062+0000","last_peered":"2024-03-30T12:38:00.301062+0000","last_clean":"2024-03-30T12:38:00.301062+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:38:00.301062+0000","last_undegraded":"2024-03-30T12:38:00.301062+0000","last_fullsized":"2024-03-30T12:38:00.301062+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1143,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:49.126219+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:36:49.126219+0000","last_peered":"2024-03-30T12:36:49.126219+0000","last_clean":"2024-03-30T12:36:49.126219+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:36:49.126219+0000","last_undegraded":"2024-03-30T12:36:49.126219+0000","last_fullsized":"2024-03-30T12:36:49.126219+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:12.278399+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:37:12.278399+0000","last_peered":"2024-03-30T12:37:12.278399+0000","last_clean":"2024-03-30T12:37:12.278399+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:37:12.278399+0000","last_undegraded":"2024-03-30T12:37:12.278399+0000","last_fullsized":"2024-03-30T12:37:12.278399+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29020,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:32.280556+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:37:32.280556+0000","last_peered":"2024-03-30T12:37:32.280556+0000","last_clean":"2024-03-30T12:37:32.280556+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:37:32.280556+0000","last_undegraded":"2024-03-30T12:37:32.280556+0000","last_fullsized":"2024-03-30T12:37:32.280556+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906809+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:37:38.906809+0000","last_peered":"2024-03-30T12:37:38.906809+0000","last_clean":"2024-03-30T12:37:38.906809+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:37:38.906809+0000","last_undegraded":"2024-03-30T12:37:38.906809+0000","last_fullsized":"2024-03-30T12:37:38.906809+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638944+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:36:37.638944+0000","last_peered":"2024-03-30T12:36:37.638944+0000","last_clean":"2024-03-30T12:36:37.638944+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:36:37.638944+0000","last_undegraded":"2024-03-30T12:36:37.638944+0000","last_fullsized":"2024-03-30T12:36:37.638944+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5610,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:23.370279+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:36:23.370279+0000","last_peered":"2024-03-30T12:36:23.370279+0000","last_clean":"2024-03-30T12:36:23.370279+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:36:23.370279+0000","last_undegraded":"2024-03-30T12:36:23.370279+0000","last_fullsized":"2024-03-30T12:36:23.370279+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1365,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906835+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:37:38.906835+0000","last_peered":"2024-03-30T12:37:38.906835+0000","last_clean":"2024-03-30T12:37:38.906835+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:37:38.906835+0000","last_undegraded":"2024-03-30T12:37:38.906835+0000","last_fullsized":"2024-03-30T12:37:38.906835+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:57.641061+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:57.641061+0000","last_peered":"2024-03-30T12:36:57.641061+0000","last_clean":"2024-03-30T12:36:57.641061+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:57.641061+0000","last_undegraded":"2024-03-30T12:36:57.641061+0000","last_fullsized":"2024-03-30T12:36:57.641061+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4275,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:03.909427+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:38:03.909427+0000","last_peered":"2024-03-30T12:38:03.909427+0000","last_clean":"2024-03-30T12:38:03.909427+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:38:03.909427+0000","last_undegraded":"2024-03-30T12:38:03.909427+0000","last_fullsized":"2024-03-30T12:38:03.909427+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.127976+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:37:04.127976+0000","last_peered":"2024-03-30T12:37:04.127976+0000","last_clean":"2024-03-30T12:37:04.127976+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:37:04.127976+0000","last_undegraded":"2024-03-30T12:37:04.127976+0000","last_fullsized":"2024-03-30T12:37:04.127976+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558134+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:38:19.558134+0000","last_peered":"2024-03-30T12:38:19.558134+0000","last_clean":"2024-03-30T12:38:19.558134+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:38:19.558134+0000","last_undegraded":"2024-03-30T12:38:19.558134+0000","last_fullsized":"2024-03-30T12:38:19.558134+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5253,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:23.370200+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:36:23.370200+0000","last_peered":"2024-03-30T12:36:23.370200+0000","last_clean":"2024-03-30T12:36:23.370200+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:36:23.370200+0000","last_undegraded":"2024-03-30T12:36:23.370200+0000","last_fullsized":"2024-03-30T12:36:23.370200+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1331,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:23.370243+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:36:23.370243+0000","last_peered":"2024-03-30T12:36:23.370243+0000","last_clean":"2024-03-30T12:36:23.370243+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:36:23.370243+0000","last_undegraded":"2024-03-30T12:36:23.370243+0000","last_fullsized":"2024-03-30T12:36:23.370243+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128016+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:37:04.128016+0000","last_peered":"2024-03-30T12:37:04.128016+0000","last_clean":"2024-03-30T12:37:04.128016+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:37:04.128016+0000","last_undegraded":"2024-03-30T12:37:04.128016+0000","last_fullsized":"2024-03-30T12:37:04.128016+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4811,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:13.383202+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:38:13.383202+0000","last_peered":"2024-03-30T12:38:13.383202+0000","last_clean":"2024-03-30T12:38:13.383202+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:38:13.383202+0000","last_undegraded":"2024-03-30T12:38:13.383202+0000","last_fullsized":"2024-03-30T12:38:13.383202+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:03.909462+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:38:03.909462+0000","last_peered":"2024-03-30T12:38:03.909462+0000","last_clean":"2024-03-30T12:38:03.909462+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:38:03.909462+0000","last_undegraded":"2024-03-30T12:38:03.909462+0000","last_fullsized":"2024-03-30T12:38:03.909462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:00.301034+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:38:00.301034+0000","last_peered":"2024-03-30T12:38:00.301034+0000","last_clean":"2024-03-30T12:38:00.301034+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:38:00.301034+0000","last_undegraded":"2024-03-30T12:38:00.301034+0000","last_fullsized":"2024-03-30T12:38:00.301034+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6743,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:49.126256+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:36:49.126256+0000","last_peered":"2024-03-30T12:36:49.126256+0000","last_clean":"2024-03-30T12:36:49.126256+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:36:49.126256+0000","last_undegraded":"2024-03-30T12:36:49.126256+0000","last_fullsized":"2024-03-30T12:36:49.126256+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1337,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:23.370314+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:36:23.370314+0000","last_peered":"2024-03-30T12:36:23.370314+0000","last_clean":"2024-03-30T12:36:23.370314+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:36:23.370314+0000","last_undegraded":"2024-03-30T12:36:23.370314+0000","last_fullsized":"2024-03-30T12:36:23.370314+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128054+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:37:04.128054+0000","last_peered":"2024-03-30T12:37:04.128054+0000","last_clean":"2024-03-30T12:37:04.128054+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:37:04.128054+0000","last_undegraded":"2024-03-30T12:37:04.128054+0000","last_fullsized":"2024-03-30T12:37:04.128054+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:59.555915+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:37:59.555915+0000","last_peered":"2024-03-30T12:37:59.555915+0000","last_clean":"2024-03-30T12:37:59.555915+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:37:59.555915+0000","last_undegraded":"2024-03-30T12:37:59.555915+0000","last_fullsized":"2024-03-30T12:37:59.555915+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:48.380210+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:37:48.380210+0000","last_peered":"2024-03-30T12:37:48.380210+0000","last_clean":"2024-03-30T12:37:48.380210+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:37:48.380210+0000","last_undegraded":"2024-03-30T12:37:48.380210+0000","last_fullsized":"2024-03-30T12:37:48.380210+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296394+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:37:20.296394+0000","last_peered":"2024-03-30T12:37:20.296394+0000","last_clean":"2024-03-30T12:37:20.296394+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:37:20.296394+0000","last_undegraded":"2024-03-30T12:37:20.296394+0000","last_fullsized":"2024-03-30T12:37:20.296394+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:40.862462+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:36:40.862462+0000","last_peered":"2024-03-30T12:36:40.862462+0000","last_clean":"2024-03-30T12:36:40.862462+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:36:40.862462+0000","last_undegraded":"2024-03-30T12:36:40.862462+0000","last_fullsized":"2024-03-30T12:36:40.862462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.638978+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:36:37.638978+0000","last_peered":"2024-03-30T12:36:37.638978+0000","last_clean":"2024-03-30T12:36:37.638978+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:36:37.638978+0000","last_undegraded":"2024-03-30T12:36:37.638978+0000","last_fullsized":"2024-03-30T12:36:37.638978+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906859+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:37:38.906859+0000","last_peered":"2024-03-30T12:37:38.906859+0000","last_clean":"2024-03-30T12:37:38.906859+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:37:38.906859+0000","last_undegraded":"2024-03-30T12:37:38.906859+0000","last_fullsized":"2024-03-30T12:37:38.906859+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1178,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558174+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:38:19.558174+0000","last_peered":"2024-03-30T12:38:19.558174+0000","last_clean":"2024-03-30T12:38:19.558174+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:38:19.558174+0000","last_undegraded":"2024-03-30T12:38:19.558174+0000","last_fullsized":"2024-03-30T12:38:19.558174+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1281,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:37.639015+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:36:37.639015+0000","last_peered":"2024-03-30T12:36:37.639015+0000","last_clean":"2024-03-30T12:36:37.639015+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:36:37.639015+0000","last_undegraded":"2024-03-30T12:36:37.639015+0000","last_fullsized":"2024-03-30T12:36:37.639015+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:40.298625+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:37:40.298625+0000","last_peered":"2024-03-30T12:37:40.298625+0000","last_clean":"2024-03-30T12:37:40.298625+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:37:40.298625+0000","last_undegraded":"2024-03-30T12:37:40.298625+0000","last_fullsized":"2024-03-30T12:37:40.298625+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:57.641040+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:57.641040+0000","last_peered":"2024-03-30T12:36:57.641040+0000","last_clean":"2024-03-30T12:36:57.641040+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:57.641040+0000","last_undegraded":"2024-03-30T12:36:57.641040+0000","last_fullsized":"2024-03-30T12:36:57.641040+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1216,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:00.300996+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:38:00.300996+0000","last_peered":"2024-03-30T12:38:00.300996+0000","last_clean":"2024-03-30T12:38:00.300996+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:38:00.300996+0000","last_undegraded":"2024-03-30T12:38:00.300996+0000","last_fullsized":"2024-03-30T12:38:00.300996+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:30.867819+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:37:30.867819+0000","last_peered":"2024-03-30T12:37:30.867819+0000","last_clean":"2024-03-30T12:37:30.867819+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:37:30.867819+0000","last_undegraded":"2024-03-30T12:37:30.867819+0000","last_fullsized":"2024-03-30T12:37:30.867819+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1183,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:24.545379+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:36:24.545379+0000","last_peered":"2024-03-30T12:36:24.545379+0000","last_clean":"2024-03-30T12:36:24.545379+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:36:24.545379+0000","last_undegraded":"2024-03-30T12:36:24.545379+0000","last_fullsized":"2024-03-30T12:36:24.545379+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438078,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648134,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175144,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254383,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063202,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951259,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839316,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923598,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:40:50.437 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:50.437 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:50.437 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:50.437 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:50.437 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:50.437 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:50.437 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:50.437 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:50.438 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:50.438 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:50.438 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:50.438 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:50.438 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:40:50.438 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:40:51.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:50 smithi084 ceph-mon[91810]: pgmap v1133: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:51.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:50 smithi084 ceph-mon[91810]: from='client.34644 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:40:51.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:50 smithi084 ceph-mon[89279]: pgmap v1133: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:51.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:50 smithi084 ceph-mon[89279]: from='client.34644 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:40:51.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:50 smithi162 ceph-mon[83709]: pgmap v1133: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:51.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:50 smithi162 ceph-mon[83709]: from='client.34644 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:40:53.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:52 smithi162 ceph-mon[83709]: pgmap v1134: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:53.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:52 smithi084 ceph-mon[89279]: pgmap v1134: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:53.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:52 smithi084 ceph-mon[91810]: pgmap v1134: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:55.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:54 smithi162 ceph-mon[83709]: pgmap v1135: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:55.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:54 smithi084 ceph-mon[91810]: pgmap v1135: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:55.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:54 smithi084 ceph-mon[89279]: pgmap v1135: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:57.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:56 smithi162 ceph-mon[83709]: pgmap v1136: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:57.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:56 smithi084 ceph-mon[91810]: pgmap v1136: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:57.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:56 smithi084 ceph-mon[89279]: pgmap v1136: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:59.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:58 smithi162 ceph-mon[83709]: pgmap v1137: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:59.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:58 smithi084 ceph-mon[89279]: pgmap v1137: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:59.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:58 smithi084 ceph-mon[91810]: pgmap v1137: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:40:59.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:40:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:40:59] "GET /metrics HTTP/1.1" 200 36328 "" "Prometheus/2.43.0" 2024-03-30T12:41:00.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:40:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:41:00.252 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:40:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:41:00.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:40:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:41:00.439 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:41:00.658 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:41:01.044 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:00 smithi084 ceph-mon[91810]: pgmap v1138: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:01.045 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:00 smithi084 ceph-mon[89279]: pgmap v1138: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:01.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:00 smithi162 ceph-mon[83709]: pgmap v1138: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:02.645 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:41:02.647 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:41:03.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:02 smithi084 ceph-mon[91810]: pgmap v1139: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:03.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:02 smithi084 ceph-mon[89279]: pgmap v1139: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:03.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:02 smithi162 ceph-mon[83709]: pgmap v1139: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:03.411 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1139,"stamp":"2024-03-30T12:41:00.892201+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003417"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.138971+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:38:39.138971+0000","last_peered":"2024-03-30T12:38:39.138971+0000","last_clean":"2024-03-30T12:38:39.138971+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:38:39.138971+0000","last_undegraded":"2024-03-30T12:38:39.138971+0000","last_fullsized":"2024-03-30T12:38:39.138971+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1364,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904373+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:37:13.904373+0000","last_peered":"2024-03-30T12:37:13.904373+0000","last_clean":"2024-03-30T12:37:13.904373+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:37:13.904373+0000","last_undegraded":"2024-03-30T12:37:13.904373+0000","last_fullsized":"2024-03-30T12:37:13.904373+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876244+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:38:45.876244+0000","last_peered":"2024-03-30T12:38:45.876244+0000","last_clean":"2024-03-30T12:38:45.876244+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:38:45.876244+0000","last_undegraded":"2024-03-30T12:38:45.876244+0000","last_fullsized":"2024-03-30T12:38:45.876244+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308618+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:39:00.308618+0000","last_peered":"2024-03-30T12:39:00.308618+0000","last_clean":"2024-03-30T12:39:00.308618+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:39:00.308618+0000","last_undegraded":"2024-03-30T12:39:00.308618+0000","last_fullsized":"2024-03-30T12:39:00.308618+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133062+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:37:49.133062+0000","last_peered":"2024-03-30T12:37:49.133062+0000","last_clean":"2024-03-30T12:37:49.133062+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:37:49.133062+0000","last_undegraded":"2024-03-30T12:37:49.133062+0000","last_fullsized":"2024-03-30T12:37:49.133062+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1210,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290374+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:30.290374+0000","last_peered":"2024-03-30T12:36:30.290374+0000","last_clean":"2024-03-30T12:36:30.290374+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:30.290374+0000","last_undegraded":"2024-03-30T12:36:30.290374+0000","last_fullsized":"2024-03-30T12:36:30.290374+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133035+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:37:49.133035+0000","last_peered":"2024-03-30T12:37:49.133035+0000","last_clean":"2024-03-30T12:37:49.133035+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:37:49.133035+0000","last_undegraded":"2024-03-30T12:37:49.133035+0000","last_fullsized":"2024-03-30T12:37:49.133035+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647301+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:37:57.647301+0000","last_peered":"2024-03-30T12:37:57.647301+0000","last_clean":"2024-03-30T12:37:57.647301+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:37:57.647301+0000","last_undegraded":"2024-03-30T12:37:57.647301+0000","last_fullsized":"2024-03-30T12:37:57.647301+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:34.131337+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:37:34.131337+0000","last_peered":"2024-03-30T12:37:34.131337+0000","last_clean":"2024-03-30T12:37:34.131337+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:37:34.131337+0000","last_undegraded":"2024-03-30T12:37:34.131337+0000","last_fullsized":"2024-03-30T12:37:34.131337+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548505+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:54.548505+0000","last_peered":"2024-03-30T12:36:54.548505+0000","last_clean":"2024-03-30T12:36:54.548505+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:54.548505+0000","last_undegraded":"2024-03-30T12:36:54.548505+0000","last_fullsized":"2024-03-30T12:36:54.548505+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548476+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:54.548476+0000","last_peered":"2024-03-30T12:36:54.548476+0000","last_clean":"2024-03-30T12:36:54.548476+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:54.548476+0000","last_undegraded":"2024-03-30T12:36:54.548476+0000","last_fullsized":"2024-03-30T12:36:54.548476+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1271,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:12.285006+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:38:12.285006+0000","last_peered":"2024-03-30T12:38:12.285006+0000","last_clean":"2024-03-30T12:38:12.285006+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:38:12.285006+0000","last_undegraded":"2024-03-30T12:38:12.285006+0000","last_fullsized":"2024-03-30T12:38:12.285006+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645098+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:37:37.645098+0000","last_peered":"2024-03-30T12:37:37.645098+0000","last_clean":"2024-03-30T12:37:37.645098+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:37:37.645098+0000","last_undegraded":"2024-03-30T12:37:37.645098+0000","last_fullsized":"2024-03-30T12:37:37.645098+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870430+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:37:55.870430+0000","last_peered":"2024-03-30T12:37:55.870430+0000","last_clean":"2024-03-30T12:37:55.870430+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:37:55.870430+0000","last_undegraded":"2024-03-30T12:37:55.870430+0000","last_fullsized":"2024-03-30T12:37:55.870430+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:28.912065+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:38:28.912065+0000","last_peered":"2024-03-30T12:38:28.912065+0000","last_clean":"2024-03-30T12:38:28.912065+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:38:28.912065+0000","last_undegraded":"2024-03-30T12:38:28.912065+0000","last_fullsized":"2024-03-30T12:38:28.912065+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303373+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:38:20.303373+0000","last_peered":"2024-03-30T12:38:20.303373+0000","last_clean":"2024-03-30T12:38:20.303373+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:38:20.303373+0000","last_undegraded":"2024-03-30T12:38:20.303373+0000","last_fullsized":"2024-03-30T12:38:20.303373+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1225,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303460+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:38:20.303460+0000","last_peered":"2024-03-30T12:38:20.303460+0000","last_clean":"2024-03-30T12:38:20.303460+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:38:20.303460+0000","last_undegraded":"2024-03-30T12:38:20.303460+0000","last_fullsized":"2024-03-30T12:38:20.303460+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:43.372790+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:36:43.372790+0000","last_peered":"2024-03-30T12:36:43.372790+0000","last_clean":"2024-03-30T12:36:43.372790+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:36:43.372790+0000","last_undegraded":"2024-03-30T12:36:43.372790+0000","last_fullsized":"2024-03-30T12:36:43.372790+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128028+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:37:04.128028+0000","last_peered":"2024-03-30T12:37:04.128028+0000","last_clean":"2024-03-30T12:37:04.128028+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:37:04.128028+0000","last_undegraded":"2024-03-30T12:37:04.128028+0000","last_fullsized":"2024-03-30T12:37:04.128028+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1389,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876285+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:38:45.876285+0000","last_peered":"2024-03-30T12:38:45.876285+0000","last_clean":"2024-03-30T12:38:45.876285+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:38:45.876285+0000","last_undegraded":"2024-03-30T12:38:45.876285+0000","last_fullsized":"2024-03-30T12:38:45.876285+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1283,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647447+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:37:57.647447+0000","last_peered":"2024-03-30T12:37:57.647447+0000","last_clean":"2024-03-30T12:37:57.647447+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:37:57.647447+0000","last_undegraded":"2024-03-30T12:37:57.647447+0000","last_fullsized":"2024-03-30T12:37:57.647447+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1302,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647455+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:37:57.647455+0000","last_peered":"2024-03-30T12:37:57.647455+0000","last_clean":"2024-03-30T12:37:57.647455+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:37:57.647455+0000","last_undegraded":"2024-03-30T12:37:57.647455+0000","last_fullsized":"2024-03-30T12:37:57.647455+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876275+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:38:45.876275+0000","last_peered":"2024-03-30T12:38:45.876275+0000","last_clean":"2024-03-30T12:38:45.876275+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:38:45.876275+0000","last_undegraded":"2024-03-30T12:38:45.876275+0000","last_fullsized":"2024-03-30T12:38:45.876275+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1151,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133095+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:37:49.133095+0000","last_peered":"2024-03-30T12:37:49.133095+0000","last_clean":"2024-03-30T12:37:49.133095+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:37:49.133095+0000","last_undegraded":"2024-03-30T12:37:49.133095+0000","last_fullsized":"2024-03-30T12:37:49.133095+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1229,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290400+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:30.290400+0000","last_peered":"2024-03-30T12:36:30.290400+0000","last_clean":"2024-03-30T12:36:30.290400+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:30.290400+0000","last_undegraded":"2024-03-30T12:36:30.290400+0000","last_fullsized":"2024-03-30T12:36:30.290400+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133077+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:37:49.133077+0000","last_peered":"2024-03-30T12:37:49.133077+0000","last_clean":"2024-03-30T12:37:49.133077+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:37:49.133077+0000","last_undegraded":"2024-03-30T12:37:49.133077+0000","last_fullsized":"2024-03-30T12:37:49.133077+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1213,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290416+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:30.290416+0000","last_peered":"2024-03-30T12:36:30.290416+0000","last_clean":"2024-03-30T12:36:30.290416+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:30.290416+0000","last_undegraded":"2024-03-30T12:36:30.290416+0000","last_fullsized":"2024-03-30T12:36:30.290416+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647433+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:37:57.647433+0000","last_peered":"2024-03-30T12:37:57.647433+0000","last_clean":"2024-03-30T12:37:57.647433+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:37:57.647433+0000","last_undegraded":"2024-03-30T12:37:57.647433+0000","last_fullsized":"2024-03-30T12:37:57.647433+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:03.018910+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:36:03.018910+0000","last_peered":"2024-03-30T12:36:03.018910+0000","last_clean":"2024-03-30T12:36:03.018910+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:36:03.018910+0000","last_undegraded":"2024-03-30T12:36:03.018910+0000","last_fullsized":"2024-03-30T12:36:03.018910+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1180,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:09.550388+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:37:09.550388+0000","last_peered":"2024-03-30T12:37:09.550388+0000","last_clean":"2024-03-30T12:37:09.550388+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:37:09.550388+0000","last_undegraded":"2024-03-30T12:37:09.550388+0000","last_fullsized":"2024-03-30T12:37:09.550388+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.860010+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:36:15.860010+0000","last_peered":"2024-03-30T12:36:15.860010+0000","last_clean":"2024-03-30T12:36:15.860010+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:36:15.860010+0000","last_undegraded":"2024-03-30T12:36:15.860010+0000","last_fullsized":"2024-03-30T12:36:15.860010+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645072+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:37:37.645072+0000","last_peered":"2024-03-30T12:37:37.645072+0000","last_clean":"2024-03-30T12:37:37.645072+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:37:37.645072+0000","last_undegraded":"2024-03-30T12:37:37.645072+0000","last_fullsized":"2024-03-30T12:37:37.645072+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645031+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:37:37.645031+0000","last_peered":"2024-03-30T12:37:37.645031+0000","last_clean":"2024-03-30T12:37:37.645031+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:37:37.645031+0000","last_undegraded":"2024-03-30T12:37:37.645031+0000","last_fullsized":"2024-03-30T12:37:37.645031+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1224,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288884+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:36:15.288884+0000","last_peered":"2024-03-30T12:36:15.288884+0000","last_clean":"2024-03-30T12:36:15.288884+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:36:15.288884+0000","last_undegraded":"2024-03-30T12:36:15.288884+0000","last_fullsized":"2024-03-30T12:36:15.288884+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:28.899208+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:36:28.899208+0000","last_peered":"2024-03-30T12:36:28.899208+0000","last_clean":"2024-03-30T12:36:28.899208+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:36:28.899208+0000","last_undegraded":"2024-03-30T12:36:28.899208+0000","last_fullsized":"2024-03-30T12:36:28.899208+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548518+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:54.548518+0000","last_peered":"2024-03-30T12:36:54.548518+0000","last_clean":"2024-03-30T12:36:54.548518+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:54.548518+0000","last_undegraded":"2024-03-30T12:36:54.548518+0000","last_fullsized":"2024-03-30T12:36:54.548518+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1204,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288944+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:36:15.288944+0000","last_peered":"2024-03-30T12:36:15.288944+0000","last_clean":"2024-03-30T12:36:15.288944+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:36:15.288944+0000","last_undegraded":"2024-03-30T12:36:15.288944+0000","last_fullsized":"2024-03-30T12:36:15.288944+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1198,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.288933+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:36:15.288933+0000","last_peered":"2024-03-30T12:36:15.288933+0000","last_clean":"2024-03-30T12:36:15.288933+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:36:15.288933+0000","last_undegraded":"2024-03-30T12:36:15.288933+0000","last_fullsized":"2024-03-30T12:36:15.288933+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:03.374890+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:37:03.374890+0000","last_peered":"2024-03-30T12:37:03.374890+0000","last_clean":"2024-03-30T12:37:03.374890+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:37:03.374890+0000","last_undegraded":"2024-03-30T12:37:03.374890+0000","last_fullsized":"2024-03-30T12:37:03.374890+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:28.899251+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:36:28.899251+0000","last_peered":"2024-03-30T12:36:28.899251+0000","last_clean":"2024-03-30T12:36:28.899251+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:36:28.899251+0000","last_undegraded":"2024-03-30T12:36:28.899251+0000","last_fullsized":"2024-03-30T12:36:28.899251+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:52.282667+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:37:52.282667+0000","last_peered":"2024-03-30T12:37:52.282667+0000","last_clean":"2024-03-30T12:37:52.282667+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:37:52.282667+0000","last_undegraded":"2024-03-30T12:37:52.282667+0000","last_fullsized":"2024-03-30T12:37:52.282667+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546935+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:36:39.546935+0000","last_peered":"2024-03-30T12:36:39.546935+0000","last_clean":"2024-03-30T12:36:39.546935+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:36:39.546935+0000","last_undegraded":"2024-03-30T12:36:39.546935+0000","last_fullsized":"2024-03-30T12:36:39.546935+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:34.131303+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:37:34.131303+0000","last_peered":"2024-03-30T12:37:34.131303+0000","last_clean":"2024-03-30T12:37:34.131303+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:37:34.131303+0000","last_undegraded":"2024-03-30T12:37:34.131303+0000","last_fullsized":"2024-03-30T12:37:34.131303+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1384,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870514+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:37:55.870514+0000","last_peered":"2024-03-30T12:37:55.870514+0000","last_clean":"2024-03-30T12:37:55.870514+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:37:55.870514+0000","last_undegraded":"2024-03-30T12:37:55.870514+0000","last_fullsized":"2024-03-30T12:37:55.870514+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870486+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:37:55.870486+0000","last_peered":"2024-03-30T12:37:55.870486+0000","last_clean":"2024-03-30T12:37:55.870486+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:37:55.870486+0000","last_undegraded":"2024-03-30T12:37:55.870486+0000","last_fullsized":"2024-03-30T12:37:55.870486+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303405+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:38:20.303405+0000","last_peered":"2024-03-30T12:38:20.303405+0000","last_clean":"2024-03-30T12:38:20.303405+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:38:20.303405+0000","last_undegraded":"2024-03-30T12:38:20.303405+0000","last_fullsized":"2024-03-30T12:38:20.303405+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:19.129793+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:37:19.129793+0000","last_peered":"2024-03-30T12:37:19.129793+0000","last_clean":"2024-03-30T12:37:19.129793+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:37:19.129793+0000","last_undegraded":"2024-03-30T12:37:19.129793+0000","last_fullsized":"2024-03-30T12:37:19.129793+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546908+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:36:39.546908+0000","last_peered":"2024-03-30T12:36:39.546908+0000","last_clean":"2024-03-30T12:36:39.546908+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:36:39.546908+0000","last_undegraded":"2024-03-30T12:36:39.546908+0000","last_fullsized":"2024-03-30T12:36:39.546908+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546882+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:36:39.546882+0000","last_peered":"2024-03-30T12:36:39.546882+0000","last_clean":"2024-03-30T12:36:39.546882+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:36:39.546882+0000","last_undegraded":"2024-03-30T12:36:39.546882+0000","last_fullsized":"2024-03-30T12:36:39.546882+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1344,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:43.372738+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:36:43.372738+0000","last_peered":"2024-03-30T12:36:43.372738+0000","last_clean":"2024-03-30T12:36:43.372738+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:36:43.372738+0000","last_undegraded":"2024-03-30T12:36:43.372738+0000","last_fullsized":"2024-03-30T12:36:43.372738+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:19.129759+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:37:19.129759+0000","last_peered":"2024-03-30T12:37:19.129759+0000","last_clean":"2024-03-30T12:37:19.129759+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:37:19.129759+0000","last_undegraded":"2024-03-30T12:37:19.129759+0000","last_fullsized":"2024-03-30T12:37:19.129759+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5753,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:13.383127+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:38:13.383127+0000","last_peered":"2024-03-30T12:38:13.383127+0000","last_clean":"2024-03-30T12:38:13.383127+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:38:13.383127+0000","last_undegraded":"2024-03-30T12:38:13.383127+0000","last_fullsized":"2024-03-30T12:38:13.383127+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1275,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:32.280622+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:37:32.280622+0000","last_peered":"2024-03-30T12:37:32.280622+0000","last_clean":"2024-03-30T12:37:32.280622+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:37:32.280622+0000","last_undegraded":"2024-03-30T12:37:32.280622+0000","last_fullsized":"2024-03-30T12:37:32.280622+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128039+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:37:04.128039+0000","last_peered":"2024-03-30T12:37:04.128039+0000","last_clean":"2024-03-30T12:37:04.128039+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:37:04.128039+0000","last_undegraded":"2024-03-30T12:37:04.128039+0000","last_fullsized":"2024-03-30T12:37:04.128039+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5514,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:45.876204+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:38:45.876204+0000","last_peered":"2024-03-30T12:38:45.876204+0000","last_clean":"2024-03-30T12:38:45.876204+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:38:45.876204+0000","last_undegraded":"2024-03-30T12:38:45.876204+0000","last_fullsized":"2024-03-30T12:38:45.876204+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904270+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:37:13.904270+0000","last_peered":"2024-03-30T12:37:13.904270+0000","last_clean":"2024-03-30T12:37:13.904270+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:37:13.904270+0000","last_undegraded":"2024-03-30T12:37:13.904270+0000","last_fullsized":"2024-03-30T12:37:13.904270+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904297+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:37:13.904297+0000","last_peered":"2024-03-30T12:37:13.904297+0000","last_clean":"2024-03-30T12:37:13.904297+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:37:13.904297+0000","last_undegraded":"2024-03-30T12:37:13.904297+0000","last_fullsized":"2024-03-30T12:37:13.904297+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296466+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:37:20.296466+0000","last_peered":"2024-03-30T12:37:20.296466+0000","last_clean":"2024-03-30T12:37:20.296466+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:37:20.296466+0000","last_undegraded":"2024-03-30T12:37:20.296466+0000","last_fullsized":"2024-03-30T12:37:20.296466+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5459,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:45.876257+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:38:45.876257+0000","last_peered":"2024-03-30T12:38:45.876257+0000","last_clean":"2024-03-30T12:38:45.876257+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:38:45.876257+0000","last_undegraded":"2024-03-30T12:38:45.876257+0000","last_fullsized":"2024-03-30T12:38:45.876257+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904314+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:37:13.904314+0000","last_peered":"2024-03-30T12:37:13.904314+0000","last_clean":"2024-03-30T12:37:13.904314+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:37:13.904314+0000","last_undegraded":"2024-03-30T12:37:13.904314+0000","last_fullsized":"2024-03-30T12:37:13.904314+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1207,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296362+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:37:20.296362+0000","last_peered":"2024-03-30T12:37:20.296362+0000","last_clean":"2024-03-30T12:37:20.296362+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:37:20.296362+0000","last_undegraded":"2024-03-30T12:37:20.296362+0000","last_fullsized":"2024-03-30T12:37:20.296362+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1272,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:52.276088+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:36:52.276088+0000","last_peered":"2024-03-30T12:36:52.276088+0000","last_clean":"2024-03-30T12:36:52.276088+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:36:52.276088+0000","last_undegraded":"2024-03-30T12:36:52.276088+0000","last_fullsized":"2024-03-30T12:36:52.276088+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3804,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:13.383237+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:38:13.383237+0000","last_peered":"2024-03-30T12:38:13.383237+0000","last_clean":"2024-03-30T12:38:13.383237+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:38:13.383237+0000","last_undegraded":"2024-03-30T12:38:13.383237+0000","last_fullsized":"2024-03-30T12:38:13.383237+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1343,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906884+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:37:38.906884+0000","last_peered":"2024-03-30T12:37:38.906884+0000","last_clean":"2024-03-30T12:37:38.906884+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:37:38.906884+0000","last_undegraded":"2024-03-30T12:37:38.906884+0000","last_fullsized":"2024-03-30T12:37:38.906884+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:48.914183+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:38:48.914183+0000","last_peered":"2024-03-30T12:38:48.914183+0000","last_clean":"2024-03-30T12:38:48.914183+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:38:48.914183+0000","last_undegraded":"2024-03-30T12:38:48.914183+0000","last_fullsized":"2024-03-30T12:38:48.914183+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:48.380185+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:37:48.380185+0000","last_peered":"2024-03-30T12:37:48.380185+0000","last_clean":"2024-03-30T12:37:48.380185+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:37:48.380185+0000","last_undegraded":"2024-03-30T12:37:48.380185+0000","last_fullsized":"2024-03-30T12:37:48.380185+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4577,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:39.138875+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:38:39.138875+0000","last_peered":"2024-03-30T12:38:39.138875+0000","last_clean":"2024-03-30T12:38:39.138875+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:38:39.138875+0000","last_undegraded":"2024-03-30T12:38:39.138875+0000","last_fullsized":"2024-03-30T12:38:39.138875+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1175,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:59.555994+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:37:59.555994+0000","last_peered":"2024-03-30T12:37:59.555994+0000","last_clean":"2024-03-30T12:37:59.555994+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:37:59.555994+0000","last_undegraded":"2024-03-30T12:37:59.555994+0000","last_fullsized":"2024-03-30T12:37:59.555994+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:22.649643+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:38:22.649643+0000","last_peered":"2024-03-30T12:38:22.649643+0000","last_clean":"2024-03-30T12:38:22.649643+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:38:22.649643+0000","last_undegraded":"2024-03-30T12:38:22.649643+0000","last_fullsized":"2024-03-30T12:38:22.649643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1200,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296444+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:37:20.296444+0000","last_peered":"2024-03-30T12:37:20.296444+0000","last_clean":"2024-03-30T12:37:20.296444+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:37:20.296444+0000","last_undegraded":"2024-03-30T12:37:20.296444+0000","last_fullsized":"2024-03-30T12:37:20.296444+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1717,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.136726+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:38:19.136726+0000","last_peered":"2024-03-30T12:38:19.136726+0000","last_clean":"2024-03-30T12:38:19.136726+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:38:19.136726+0000","last_undegraded":"2024-03-30T12:38:19.136726+0000","last_fullsized":"2024-03-30T12:38:19.136726+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24714,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:40.298683+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:37:40.298683+0000","last_peered":"2024-03-30T12:37:40.298683+0000","last_clean":"2024-03-30T12:37:40.298683+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:37:40.298683+0000","last_undegraded":"2024-03-30T12:37:40.298683+0000","last_fullsized":"2024-03-30T12:37:40.298683+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:05.865263+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:37:05.865263+0000","last_peered":"2024-03-30T12:37:05.865263+0000","last_clean":"2024-03-30T12:37:05.865263+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:37:05.865263+0000","last_undegraded":"2024-03-30T12:37:05.865263+0000","last_fullsized":"2024-03-30T12:37:05.865263+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876163+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:38:45.876163+0000","last_peered":"2024-03-30T12:38:45.876163+0000","last_clean":"2024-03-30T12:38:45.876163+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:38:45.876163+0000","last_undegraded":"2024-03-30T12:38:45.876163+0000","last_fullsized":"2024-03-30T12:38:45.876163+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.136697+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:38:19.136697+0000","last_peered":"2024-03-30T12:38:19.136697+0000","last_clean":"2024-03-30T12:38:19.136697+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:38:19.136697+0000","last_undegraded":"2024-03-30T12:38:19.136697+0000","last_fullsized":"2024-03-30T12:38:19.136697+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16481,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:59.555949+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:37:59.555949+0000","last_peered":"2024-03-30T12:37:59.555949+0000","last_clean":"2024-03-30T12:37:59.555949+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:37:59.555949+0000","last_undegraded":"2024-03-30T12:37:59.555949+0000","last_fullsized":"2024-03-30T12:37:59.555949+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876223+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:38:45.876223+0000","last_peered":"2024-03-30T12:38:45.876223+0000","last_clean":"2024-03-30T12:38:45.876223+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:38:45.876223+0000","last_undegraded":"2024-03-30T12:38:45.876223+0000","last_fullsized":"2024-03-30T12:38:45.876223+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1164,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.138928+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:38:39.138928+0000","last_peered":"2024-03-30T12:38:39.138928+0000","last_clean":"2024-03-30T12:38:39.138928+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:38:39.138928+0000","last_undegraded":"2024-03-30T12:38:39.138928+0000","last_fullsized":"2024-03-30T12:38:39.138928+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904330+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:37:13.904330+0000","last_peered":"2024-03-30T12:37:13.904330+0000","last_clean":"2024-03-30T12:37:13.904330+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:37:13.904330+0000","last_undegraded":"2024-03-30T12:37:13.904330+0000","last_fullsized":"2024-03-30T12:37:13.904330+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31269,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:52.276052+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:36:52.276052+0000","last_peered":"2024-03-30T12:36:52.276052+0000","last_clean":"2024-03-30T12:36:52.276052+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:36:52.276052+0000","last_undegraded":"2024-03-30T12:36:52.276052+0000","last_fullsized":"2024-03-30T12:36:52.276052+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647394+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:37:57.647394+0000","last_peered":"2024-03-30T12:37:57.647394+0000","last_clean":"2024-03-30T12:37:57.647394+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:37:57.647394+0000","last_undegraded":"2024-03-30T12:37:57.647394+0000","last_fullsized":"2024-03-30T12:37:57.647394+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906874+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:37:38.906874+0000","last_peered":"2024-03-30T12:37:38.906874+0000","last_clean":"2024-03-30T12:37:38.906874+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:37:38.906874+0000","last_undegraded":"2024-03-30T12:37:38.906874+0000","last_fullsized":"2024-03-30T12:37:38.906874+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651932+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:38:47.651932+0000","last_peered":"2024-03-30T12:38:47.651932+0000","last_clean":"2024-03-30T12:38:47.651932+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:38:47.651932+0000","last_undegraded":"2024-03-30T12:38:47.651932+0000","last_fullsized":"2024-03-30T12:38:47.651932+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3765,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647332+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:37:57.647332+0000","last_peered":"2024-03-30T12:37:57.647332+0000","last_clean":"2024-03-30T12:37:57.647332+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:37:57.647332+0000","last_undegraded":"2024-03-30T12:37:57.647332+0000","last_fullsized":"2024-03-30T12:37:57.647332+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:52.276014+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:36:52.276014+0000","last_peered":"2024-03-30T12:36:52.276014+0000","last_clean":"2024-03-30T12:36:52.276014+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:36:52.276014+0000","last_undegraded":"2024-03-30T12:36:52.276014+0000","last_fullsized":"2024-03-30T12:36:52.276014+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1156,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558186+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:38:19.558186+0000","last_peered":"2024-03-30T12:38:19.558186+0000","last_clean":"2024-03-30T12:38:19.558186+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:38:19.558186+0000","last_undegraded":"2024-03-30T12:38:19.558186+0000","last_fullsized":"2024-03-30T12:38:19.558186+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:05.865242+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:37:05.865242+0000","last_peered":"2024-03-30T12:37:05.865242+0000","last_clean":"2024-03-30T12:37:05.865242+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:37:05.865242+0000","last_undegraded":"2024-03-30T12:37:05.865242+0000","last_fullsized":"2024-03-30T12:37:05.865242+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15594,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:00.301062+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:38:00.301062+0000","last_peered":"2024-03-30T12:38:00.301062+0000","last_clean":"2024-03-30T12:38:00.301062+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:38:00.301062+0000","last_undegraded":"2024-03-30T12:38:00.301062+0000","last_fullsized":"2024-03-30T12:38:00.301062+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1143,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:49.126219+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:36:49.126219+0000","last_peered":"2024-03-30T12:36:49.126219+0000","last_clean":"2024-03-30T12:36:49.126219+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:36:49.126219+0000","last_undegraded":"2024-03-30T12:36:49.126219+0000","last_fullsized":"2024-03-30T12:36:49.126219+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:12.278399+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:37:12.278399+0000","last_peered":"2024-03-30T12:37:12.278399+0000","last_clean":"2024-03-30T12:37:12.278399+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:37:12.278399+0000","last_undegraded":"2024-03-30T12:37:12.278399+0000","last_fullsized":"2024-03-30T12:37:12.278399+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29020,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:32.280556+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:37:32.280556+0000","last_peered":"2024-03-30T12:37:32.280556+0000","last_clean":"2024-03-30T12:37:32.280556+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:37:32.280556+0000","last_undegraded":"2024-03-30T12:37:32.280556+0000","last_fullsized":"2024-03-30T12:37:32.280556+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906809+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:37:38.906809+0000","last_peered":"2024-03-30T12:37:38.906809+0000","last_clean":"2024-03-30T12:37:38.906809+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:37:38.906809+0000","last_undegraded":"2024-03-30T12:37:38.906809+0000","last_fullsized":"2024-03-30T12:37:38.906809+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651850+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:38:47.651850+0000","last_peered":"2024-03-30T12:38:47.651850+0000","last_clean":"2024-03-30T12:38:47.651850+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:38:47.651850+0000","last_undegraded":"2024-03-30T12:38:47.651850+0000","last_fullsized":"2024-03-30T12:38:47.651850+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5611,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:38.385807+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:38:38.385807+0000","last_peered":"2024-03-30T12:38:38.385807+0000","last_clean":"2024-03-30T12:38:38.385807+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:38:38.385807+0000","last_undegraded":"2024-03-30T12:38:38.385807+0000","last_fullsized":"2024-03-30T12:38:38.385807+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1365,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906835+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:37:38.906835+0000","last_peered":"2024-03-30T12:37:38.906835+0000","last_clean":"2024-03-30T12:37:38.906835+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:37:38.906835+0000","last_undegraded":"2024-03-30T12:37:38.906835+0000","last_fullsized":"2024-03-30T12:37:38.906835+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:57.641061+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:57.641061+0000","last_peered":"2024-03-30T12:36:57.641061+0000","last_clean":"2024-03-30T12:36:57.641061+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:57.641061+0000","last_undegraded":"2024-03-30T12:36:57.641061+0000","last_fullsized":"2024-03-30T12:36:57.641061+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4275,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:03.909427+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:38:03.909427+0000","last_peered":"2024-03-30T12:38:03.909427+0000","last_clean":"2024-03-30T12:38:03.909427+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:38:03.909427+0000","last_undegraded":"2024-03-30T12:38:03.909427+0000","last_fullsized":"2024-03-30T12:38:03.909427+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.127976+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:37:04.127976+0000","last_peered":"2024-03-30T12:37:04.127976+0000","last_clean":"2024-03-30T12:37:04.127976+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:37:04.127976+0000","last_undegraded":"2024-03-30T12:37:04.127976+0000","last_fullsized":"2024-03-30T12:37:04.127976+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558134+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:38:19.558134+0000","last_peered":"2024-03-30T12:38:19.558134+0000","last_clean":"2024-03-30T12:38:19.558134+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:38:19.558134+0000","last_undegraded":"2024-03-30T12:38:19.558134+0000","last_fullsized":"2024-03-30T12:38:19.558134+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5254,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:38.385765+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:38:38.385765+0000","last_peered":"2024-03-30T12:38:38.385765+0000","last_clean":"2024-03-30T12:38:38.385765+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:38:38.385765+0000","last_undegraded":"2024-03-30T12:38:38.385765+0000","last_fullsized":"2024-03-30T12:38:38.385765+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:38.385797+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:38:38.385797+0000","last_peered":"2024-03-30T12:38:38.385797+0000","last_clean":"2024-03-30T12:38:38.385797+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:38:38.385797+0000","last_undegraded":"2024-03-30T12:38:38.385797+0000","last_fullsized":"2024-03-30T12:38:38.385797+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128016+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:37:04.128016+0000","last_peered":"2024-03-30T12:37:04.128016+0000","last_clean":"2024-03-30T12:37:04.128016+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:37:04.128016+0000","last_undegraded":"2024-03-30T12:37:04.128016+0000","last_fullsized":"2024-03-30T12:37:04.128016+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4811,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:13.383202+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:38:13.383202+0000","last_peered":"2024-03-30T12:38:13.383202+0000","last_clean":"2024-03-30T12:38:13.383202+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:38:13.383202+0000","last_undegraded":"2024-03-30T12:38:13.383202+0000","last_fullsized":"2024-03-30T12:38:13.383202+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:03.909462+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:38:03.909462+0000","last_peered":"2024-03-30T12:38:03.909462+0000","last_clean":"2024-03-30T12:38:03.909462+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:38:03.909462+0000","last_undegraded":"2024-03-30T12:38:03.909462+0000","last_fullsized":"2024-03-30T12:38:03.909462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:00.301034+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:38:00.301034+0000","last_peered":"2024-03-30T12:38:00.301034+0000","last_clean":"2024-03-30T12:38:00.301034+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:38:00.301034+0000","last_undegraded":"2024-03-30T12:38:00.301034+0000","last_fullsized":"2024-03-30T12:38:00.301034+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6743,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:36:49.126256+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:36:49.126256+0000","last_peered":"2024-03-30T12:36:49.126256+0000","last_clean":"2024-03-30T12:36:49.126256+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:36:49.126256+0000","last_undegraded":"2024-03-30T12:36:49.126256+0000","last_fullsized":"2024-03-30T12:36:49.126256+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1338,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:38.385827+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:38:38.385827+0000","last_peered":"2024-03-30T12:38:38.385827+0000","last_clean":"2024-03-30T12:38:38.385827+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:38:38.385827+0000","last_undegraded":"2024-03-30T12:38:38.385827+0000","last_fullsized":"2024-03-30T12:38:38.385827+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128054+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:37:04.128054+0000","last_peered":"2024-03-30T12:37:04.128054+0000","last_clean":"2024-03-30T12:37:04.128054+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:37:04.128054+0000","last_undegraded":"2024-03-30T12:37:04.128054+0000","last_fullsized":"2024-03-30T12:37:04.128054+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:59.555915+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:37:59.555915+0000","last_peered":"2024-03-30T12:37:59.555915+0000","last_clean":"2024-03-30T12:37:59.555915+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:37:59.555915+0000","last_undegraded":"2024-03-30T12:37:59.555915+0000","last_fullsized":"2024-03-30T12:37:59.555915+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:48.380210+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:37:48.380210+0000","last_peered":"2024-03-30T12:37:48.380210+0000","last_clean":"2024-03-30T12:37:48.380210+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:37:48.380210+0000","last_undegraded":"2024-03-30T12:37:48.380210+0000","last_fullsized":"2024-03-30T12:37:48.380210+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296394+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:37:20.296394+0000","last_peered":"2024-03-30T12:37:20.296394+0000","last_clean":"2024-03-30T12:37:20.296394+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:37:20.296394+0000","last_undegraded":"2024-03-30T12:37:20.296394+0000","last_fullsized":"2024-03-30T12:37:20.296394+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876194+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:38:45.876194+0000","last_peered":"2024-03-30T12:38:45.876194+0000","last_clean":"2024-03-30T12:38:45.876194+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:38:45.876194+0000","last_undegraded":"2024-03-30T12:38:45.876194+0000","last_fullsized":"2024-03-30T12:38:45.876194+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651915+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:38:47.651915+0000","last_peered":"2024-03-30T12:38:47.651915+0000","last_clean":"2024-03-30T12:38:47.651915+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:38:47.651915+0000","last_undegraded":"2024-03-30T12:38:47.651915+0000","last_fullsized":"2024-03-30T12:38:47.651915+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906859+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:37:38.906859+0000","last_peered":"2024-03-30T12:37:38.906859+0000","last_clean":"2024-03-30T12:37:38.906859+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:37:38.906859+0000","last_undegraded":"2024-03-30T12:37:38.906859+0000","last_fullsized":"2024-03-30T12:37:38.906859+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1178,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558174+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:38:19.558174+0000","last_peered":"2024-03-30T12:38:19.558174+0000","last_clean":"2024-03-30T12:38:19.558174+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:38:19.558174+0000","last_undegraded":"2024-03-30T12:38:19.558174+0000","last_fullsized":"2024-03-30T12:38:19.558174+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1282,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651943+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:38:47.651943+0000","last_peered":"2024-03-30T12:38:47.651943+0000","last_clean":"2024-03-30T12:38:47.651943+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:38:47.651943+0000","last_undegraded":"2024-03-30T12:38:47.651943+0000","last_fullsized":"2024-03-30T12:38:47.651943+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:40.298625+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:37:40.298625+0000","last_peered":"2024-03-30T12:37:40.298625+0000","last_clean":"2024-03-30T12:37:40.298625+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:37:40.298625+0000","last_undegraded":"2024-03-30T12:37:40.298625+0000","last_fullsized":"2024-03-30T12:37:40.298625+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:57.641040+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:57.641040+0000","last_peered":"2024-03-30T12:36:57.641040+0000","last_clean":"2024-03-30T12:36:57.641040+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:57.641040+0000","last_undegraded":"2024-03-30T12:36:57.641040+0000","last_fullsized":"2024-03-30T12:36:57.641040+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1216,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:00.300996+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:38:00.300996+0000","last_peered":"2024-03-30T12:38:00.300996+0000","last_clean":"2024-03-30T12:38:00.300996+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:38:00.300996+0000","last_undegraded":"2024-03-30T12:38:00.300996+0000","last_fullsized":"2024-03-30T12:38:00.300996+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:30.867819+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:37:30.867819+0000","last_peered":"2024-03-30T12:37:30.867819+0000","last_clean":"2024-03-30T12:37:30.867819+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:37:30.867819+0000","last_undegraded":"2024-03-30T12:37:30.867819+0000","last_fullsized":"2024-03-30T12:37:30.867819+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.560418+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:38:39.560418+0000","last_peered":"2024-03-30T12:38:39.560418+0000","last_clean":"2024-03-30T12:38:39.560418+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:38:39.560418+0000","last_undegraded":"2024-03-30T12:38:39.560418+0000","last_fullsized":"2024-03-30T12:38:39.560418+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438081,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648137,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175147,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254386,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063204,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951261,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839318,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923601,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:41:03.417 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:03.417 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:03.417 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:03.417 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:03.417 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:03.417 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:03.417 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:03.417 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:03.417 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:03.417 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:03.417 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:03.417 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:03.417 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:03.417 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:41:04.118 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:03 smithi162 ceph-mon[83709]: from='client.34650 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:41:04.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:03 smithi084 ceph-mon[91810]: from='client.34650 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:41:04.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:03 smithi084 ceph-mon[89279]: from='client.34650 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:41:05.118 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:04 smithi162 ceph-mon[83709]: pgmap v1140: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:05.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:04 smithi084 ceph-mon[91810]: pgmap v1140: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:05.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:04 smithi084 ceph-mon[89279]: pgmap v1140: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:06.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:05 smithi084 ceph-mon[91810]: pgmap v1141: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:06.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:05 smithi084 ceph-mon[89279]: pgmap v1141: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:06.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:05 smithi162 ceph-mon[83709]: pgmap v1141: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:08.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:07 smithi084 ceph-mon[91810]: pgmap v1142: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:08.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:07 smithi084 ceph-mon[89279]: pgmap v1142: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:08.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:07 smithi162 ceph-mon[83709]: pgmap v1142: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:09.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:41:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:41:09] "GET /metrics HTTP/1.1" 200 36328 "" "Prometheus/2.43.0" 2024-03-30T12:41:10.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:09 smithi084 ceph-mon[91810]: pgmap v1143: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:10.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:09 smithi084 ceph-mon[89279]: pgmap v1143: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:10.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:09 smithi162 ceph-mon[83709]: pgmap v1143: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:12.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:11 smithi084 ceph-mon[91810]: pgmap v1144: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:12.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:11 smithi084 ceph-mon[89279]: pgmap v1144: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:12.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:11 smithi162 ceph-mon[83709]: pgmap v1144: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:13.418 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:41:13.637 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:41:14.025 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:13 smithi084 ceph-mon[91810]: pgmap v1145: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:14.025 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:13 smithi084 ceph-mon[89279]: pgmap v1145: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:14.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:13 smithi162 ceph-mon[83709]: pgmap v1145: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:15.138 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:14 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:41:15.138 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:14 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:41:15.368 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:14 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:41:15.561 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:41:15.563 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:41:16.252 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:15 smithi084 ceph-mon[89279]: pgmap v1146: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:16.252 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:15 smithi084 ceph-mon[89279]: from='client.44591 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:41:16.252 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:15 smithi084 ceph-mon[91810]: pgmap v1146: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:16.252 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:15 smithi084 ceph-mon[91810]: from='client.44591 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:41:16.280 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1146,"stamp":"2024-03-30T12:41:14.896748+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003871"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.138971+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:38:39.138971+0000","last_peered":"2024-03-30T12:38:39.138971+0000","last_clean":"2024-03-30T12:38:39.138971+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:38:39.138971+0000","last_undegraded":"2024-03-30T12:38:39.138971+0000","last_fullsized":"2024-03-30T12:38:39.138971+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1364,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904373+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:37:13.904373+0000","last_peered":"2024-03-30T12:37:13.904373+0000","last_clean":"2024-03-30T12:37:13.904373+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:37:13.904373+0000","last_undegraded":"2024-03-30T12:37:13.904373+0000","last_fullsized":"2024-03-30T12:37:13.904373+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876244+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:38:45.876244+0000","last_peered":"2024-03-30T12:38:45.876244+0000","last_clean":"2024-03-30T12:38:45.876244+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:38:45.876244+0000","last_undegraded":"2024-03-30T12:38:45.876244+0000","last_fullsized":"2024-03-30T12:38:45.876244+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308618+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:39:00.308618+0000","last_peered":"2024-03-30T12:39:00.308618+0000","last_clean":"2024-03-30T12:39:00.308618+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:39:00.308618+0000","last_undegraded":"2024-03-30T12:39:00.308618+0000","last_fullsized":"2024-03-30T12:39:00.308618+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133062+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:37:49.133062+0000","last_peered":"2024-03-30T12:37:49.133062+0000","last_clean":"2024-03-30T12:37:49.133062+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:37:49.133062+0000","last_undegraded":"2024-03-30T12:37:49.133062+0000","last_fullsized":"2024-03-30T12:37:49.133062+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1210,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290374+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:30.290374+0000","last_peered":"2024-03-30T12:36:30.290374+0000","last_clean":"2024-03-30T12:36:30.290374+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:30.290374+0000","last_undegraded":"2024-03-30T12:36:30.290374+0000","last_fullsized":"2024-03-30T12:36:30.290374+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133035+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:37:49.133035+0000","last_peered":"2024-03-30T12:37:49.133035+0000","last_clean":"2024-03-30T12:37:49.133035+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:37:49.133035+0000","last_undegraded":"2024-03-30T12:37:49.133035+0000","last_fullsized":"2024-03-30T12:37:49.133035+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647301+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:37:57.647301+0000","last_peered":"2024-03-30T12:37:57.647301+0000","last_clean":"2024-03-30T12:37:57.647301+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:37:57.647301+0000","last_undegraded":"2024-03-30T12:37:57.647301+0000","last_fullsized":"2024-03-30T12:37:57.647301+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:34.131337+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:37:34.131337+0000","last_peered":"2024-03-30T12:37:34.131337+0000","last_clean":"2024-03-30T12:37:34.131337+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:37:34.131337+0000","last_undegraded":"2024-03-30T12:37:34.131337+0000","last_fullsized":"2024-03-30T12:37:34.131337+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548505+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:54.548505+0000","last_peered":"2024-03-30T12:36:54.548505+0000","last_clean":"2024-03-30T12:36:54.548505+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:54.548505+0000","last_undegraded":"2024-03-30T12:36:54.548505+0000","last_fullsized":"2024-03-30T12:36:54.548505+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548476+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:54.548476+0000","last_peered":"2024-03-30T12:36:54.548476+0000","last_clean":"2024-03-30T12:36:54.548476+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:54.548476+0000","last_undegraded":"2024-03-30T12:36:54.548476+0000","last_fullsized":"2024-03-30T12:36:54.548476+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1271,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:12.285006+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:38:12.285006+0000","last_peered":"2024-03-30T12:38:12.285006+0000","last_clean":"2024-03-30T12:38:12.285006+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:38:12.285006+0000","last_undegraded":"2024-03-30T12:38:12.285006+0000","last_fullsized":"2024-03-30T12:38:12.285006+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645098+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:37:37.645098+0000","last_peered":"2024-03-30T12:37:37.645098+0000","last_clean":"2024-03-30T12:37:37.645098+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:37:37.645098+0000","last_undegraded":"2024-03-30T12:37:37.645098+0000","last_fullsized":"2024-03-30T12:37:37.645098+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870430+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:37:55.870430+0000","last_peered":"2024-03-30T12:37:55.870430+0000","last_clean":"2024-03-30T12:37:55.870430+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:37:55.870430+0000","last_undegraded":"2024-03-30T12:37:55.870430+0000","last_fullsized":"2024-03-30T12:37:55.870430+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:28.912065+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:38:28.912065+0000","last_peered":"2024-03-30T12:38:28.912065+0000","last_clean":"2024-03-30T12:38:28.912065+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:38:28.912065+0000","last_undegraded":"2024-03-30T12:38:28.912065+0000","last_fullsized":"2024-03-30T12:38:28.912065+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303373+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:38:20.303373+0000","last_peered":"2024-03-30T12:38:20.303373+0000","last_clean":"2024-03-30T12:38:20.303373+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:38:20.303373+0000","last_undegraded":"2024-03-30T12:38:20.303373+0000","last_fullsized":"2024-03-30T12:38:20.303373+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1225,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303460+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:38:20.303460+0000","last_peered":"2024-03-30T12:38:20.303460+0000","last_clean":"2024-03-30T12:38:20.303460+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:38:20.303460+0000","last_undegraded":"2024-03-30T12:38:20.303460+0000","last_fullsized":"2024-03-30T12:38:20.303460+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:43.372790+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:36:43.372790+0000","last_peered":"2024-03-30T12:36:43.372790+0000","last_clean":"2024-03-30T12:36:43.372790+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:36:43.372790+0000","last_undegraded":"2024-03-30T12:36:43.372790+0000","last_fullsized":"2024-03-30T12:36:43.372790+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128028+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:37:04.128028+0000","last_peered":"2024-03-30T12:37:04.128028+0000","last_clean":"2024-03-30T12:37:04.128028+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:37:04.128028+0000","last_undegraded":"2024-03-30T12:37:04.128028+0000","last_fullsized":"2024-03-30T12:37:04.128028+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1389,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876285+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:38:45.876285+0000","last_peered":"2024-03-30T12:38:45.876285+0000","last_clean":"2024-03-30T12:38:45.876285+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:38:45.876285+0000","last_undegraded":"2024-03-30T12:38:45.876285+0000","last_fullsized":"2024-03-30T12:38:45.876285+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1283,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647447+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:37:57.647447+0000","last_peered":"2024-03-30T12:37:57.647447+0000","last_clean":"2024-03-30T12:37:57.647447+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:37:57.647447+0000","last_undegraded":"2024-03-30T12:37:57.647447+0000","last_fullsized":"2024-03-30T12:37:57.647447+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1302,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647455+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:37:57.647455+0000","last_peered":"2024-03-30T12:37:57.647455+0000","last_clean":"2024-03-30T12:37:57.647455+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:37:57.647455+0000","last_undegraded":"2024-03-30T12:37:57.647455+0000","last_fullsized":"2024-03-30T12:37:57.647455+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876275+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:38:45.876275+0000","last_peered":"2024-03-30T12:38:45.876275+0000","last_clean":"2024-03-30T12:38:45.876275+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:38:45.876275+0000","last_undegraded":"2024-03-30T12:38:45.876275+0000","last_fullsized":"2024-03-30T12:38:45.876275+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1151,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133095+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:37:49.133095+0000","last_peered":"2024-03-30T12:37:49.133095+0000","last_clean":"2024-03-30T12:37:49.133095+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:37:49.133095+0000","last_undegraded":"2024-03-30T12:37:49.133095+0000","last_fullsized":"2024-03-30T12:37:49.133095+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1229,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290400+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:30.290400+0000","last_peered":"2024-03-30T12:36:30.290400+0000","last_clean":"2024-03-30T12:36:30.290400+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:30.290400+0000","last_undegraded":"2024-03-30T12:36:30.290400+0000","last_fullsized":"2024-03-30T12:36:30.290400+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133077+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:37:49.133077+0000","last_peered":"2024-03-30T12:37:49.133077+0000","last_clean":"2024-03-30T12:37:49.133077+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:37:49.133077+0000","last_undegraded":"2024-03-30T12:37:49.133077+0000","last_fullsized":"2024-03-30T12:37:49.133077+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1213,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290416+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:30.290416+0000","last_peered":"2024-03-30T12:36:30.290416+0000","last_clean":"2024-03-30T12:36:30.290416+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:30.290416+0000","last_undegraded":"2024-03-30T12:36:30.290416+0000","last_fullsized":"2024-03-30T12:36:30.290416+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647433+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:37:57.647433+0000","last_peered":"2024-03-30T12:37:57.647433+0000","last_clean":"2024-03-30T12:37:57.647433+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:37:57.647433+0000","last_undegraded":"2024-03-30T12:37:57.647433+0000","last_fullsized":"2024-03-30T12:37:57.647433+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1263,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:32.286955+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:38:32.286955+0000","last_peered":"2024-03-30T12:38:32.286955+0000","last_clean":"2024-03-30T12:38:32.286955+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:38:32.286955+0000","last_undegraded":"2024-03-30T12:38:32.286955+0000","last_fullsized":"2024-03-30T12:38:32.286955+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1180,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:09.550388+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:37:09.550388+0000","last_peered":"2024-03-30T12:37:09.550388+0000","last_clean":"2024-03-30T12:37:09.550388+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:37:09.550388+0000","last_undegraded":"2024-03-30T12:37:09.550388+0000","last_fullsized":"2024-03-30T12:37:09.550388+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1378,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:15.860010+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:36:15.860010+0000","last_peered":"2024-03-30T12:36:15.860010+0000","last_clean":"2024-03-30T12:36:15.860010+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:36:15.860010+0000","last_undegraded":"2024-03-30T12:36:15.860010+0000","last_fullsized":"2024-03-30T12:36:15.860010+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645072+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:37:37.645072+0000","last_peered":"2024-03-30T12:37:37.645072+0000","last_clean":"2024-03-30T12:37:37.645072+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:37:37.645072+0000","last_undegraded":"2024-03-30T12:37:37.645072+0000","last_fullsized":"2024-03-30T12:37:37.645072+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645031+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:37:37.645031+0000","last_peered":"2024-03-30T12:37:37.645031+0000","last_clean":"2024-03-30T12:37:37.645031+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:37:37.645031+0000","last_undegraded":"2024-03-30T12:37:37.645031+0000","last_fullsized":"2024-03-30T12:37:37.645031+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1225,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306130+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:38:40.306130+0000","last_peered":"2024-03-30T12:38:40.306130+0000","last_clean":"2024-03-30T12:38:40.306130+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:38:40.306130+0000","last_undegraded":"2024-03-30T12:38:40.306130+0000","last_fullsized":"2024-03-30T12:38:40.306130+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:28.899208+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:36:28.899208+0000","last_peered":"2024-03-30T12:36:28.899208+0000","last_clean":"2024-03-30T12:36:28.899208+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:36:28.899208+0000","last_undegraded":"2024-03-30T12:36:28.899208+0000","last_fullsized":"2024-03-30T12:36:28.899208+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548518+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:54.548518+0000","last_peered":"2024-03-30T12:36:54.548518+0000","last_clean":"2024-03-30T12:36:54.548518+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:54.548518+0000","last_undegraded":"2024-03-30T12:36:54.548518+0000","last_fullsized":"2024-03-30T12:36:54.548518+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306212+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:38:40.306212+0000","last_peered":"2024-03-30T12:38:40.306212+0000","last_clean":"2024-03-30T12:38:40.306212+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:38:40.306212+0000","last_undegraded":"2024-03-30T12:38:40.306212+0000","last_fullsized":"2024-03-30T12:38:40.306212+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1199,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306200+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:38:40.306200+0000","last_peered":"2024-03-30T12:38:40.306200+0000","last_clean":"2024-03-30T12:38:40.306200+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:38:40.306200+0000","last_undegraded":"2024-03-30T12:38:40.306200+0000","last_fullsized":"2024-03-30T12:38:40.306200+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:03.374890+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:37:03.374890+0000","last_peered":"2024-03-30T12:37:03.374890+0000","last_clean":"2024-03-30T12:37:03.374890+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:37:03.374890+0000","last_undegraded":"2024-03-30T12:37:03.374890+0000","last_fullsized":"2024-03-30T12:37:03.374890+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:28.899251+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:36:28.899251+0000","last_peered":"2024-03-30T12:36:28.899251+0000","last_clean":"2024-03-30T12:36:28.899251+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:36:28.899251+0000","last_undegraded":"2024-03-30T12:36:28.899251+0000","last_fullsized":"2024-03-30T12:36:28.899251+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:52.282667+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:37:52.282667+0000","last_peered":"2024-03-30T12:37:52.282667+0000","last_clean":"2024-03-30T12:37:52.282667+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:37:52.282667+0000","last_undegraded":"2024-03-30T12:37:52.282667+0000","last_fullsized":"2024-03-30T12:37:52.282667+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546935+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:36:39.546935+0000","last_peered":"2024-03-30T12:36:39.546935+0000","last_clean":"2024-03-30T12:36:39.546935+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:36:39.546935+0000","last_undegraded":"2024-03-30T12:36:39.546935+0000","last_fullsized":"2024-03-30T12:36:39.546935+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:34.131303+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:37:34.131303+0000","last_peered":"2024-03-30T12:37:34.131303+0000","last_clean":"2024-03-30T12:37:34.131303+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:37:34.131303+0000","last_undegraded":"2024-03-30T12:37:34.131303+0000","last_fullsized":"2024-03-30T12:37:34.131303+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1384,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870514+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:37:55.870514+0000","last_peered":"2024-03-30T12:37:55.870514+0000","last_clean":"2024-03-30T12:37:55.870514+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:37:55.870514+0000","last_undegraded":"2024-03-30T12:37:55.870514+0000","last_fullsized":"2024-03-30T12:37:55.870514+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870486+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:37:55.870486+0000","last_peered":"2024-03-30T12:37:55.870486+0000","last_clean":"2024-03-30T12:37:55.870486+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:37:55.870486+0000","last_undegraded":"2024-03-30T12:37:55.870486+0000","last_fullsized":"2024-03-30T12:37:55.870486+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303405+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:38:20.303405+0000","last_peered":"2024-03-30T12:38:20.303405+0000","last_clean":"2024-03-30T12:38:20.303405+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:38:20.303405+0000","last_undegraded":"2024-03-30T12:38:20.303405+0000","last_fullsized":"2024-03-30T12:38:20.303405+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:19.129793+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:37:19.129793+0000","last_peered":"2024-03-30T12:37:19.129793+0000","last_clean":"2024-03-30T12:37:19.129793+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:37:19.129793+0000","last_undegraded":"2024-03-30T12:37:19.129793+0000","last_fullsized":"2024-03-30T12:37:19.129793+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546908+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:36:39.546908+0000","last_peered":"2024-03-30T12:36:39.546908+0000","last_clean":"2024-03-30T12:36:39.546908+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:36:39.546908+0000","last_undegraded":"2024-03-30T12:36:39.546908+0000","last_fullsized":"2024-03-30T12:36:39.546908+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:39.546882+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:36:39.546882+0000","last_peered":"2024-03-30T12:36:39.546882+0000","last_clean":"2024-03-30T12:36:39.546882+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:36:39.546882+0000","last_undegraded":"2024-03-30T12:36:39.546882+0000","last_fullsized":"2024-03-30T12:36:39.546882+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1344,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:43.372738+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:36:43.372738+0000","last_peered":"2024-03-30T12:36:43.372738+0000","last_clean":"2024-03-30T12:36:43.372738+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:36:43.372738+0000","last_undegraded":"2024-03-30T12:36:43.372738+0000","last_fullsized":"2024-03-30T12:36:43.372738+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:19.129759+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:37:19.129759+0000","last_peered":"2024-03-30T12:37:19.129759+0000","last_clean":"2024-03-30T12:37:19.129759+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:37:19.129759+0000","last_undegraded":"2024-03-30T12:37:19.129759+0000","last_fullsized":"2024-03-30T12:37:19.129759+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5753,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:13.383127+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:38:13.383127+0000","last_peered":"2024-03-30T12:38:13.383127+0000","last_clean":"2024-03-30T12:38:13.383127+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:38:13.383127+0000","last_undegraded":"2024-03-30T12:38:13.383127+0000","last_fullsized":"2024-03-30T12:38:13.383127+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1275,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:32.280622+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:37:32.280622+0000","last_peered":"2024-03-30T12:37:32.280622+0000","last_clean":"2024-03-30T12:37:32.280622+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:37:32.280622+0000","last_undegraded":"2024-03-30T12:37:32.280622+0000","last_fullsized":"2024-03-30T12:37:32.280622+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128039+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:37:04.128039+0000","last_peered":"2024-03-30T12:37:04.128039+0000","last_clean":"2024-03-30T12:37:04.128039+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:37:04.128039+0000","last_undegraded":"2024-03-30T12:37:04.128039+0000","last_fullsized":"2024-03-30T12:37:04.128039+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5514,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:45.876204+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:38:45.876204+0000","last_peered":"2024-03-30T12:38:45.876204+0000","last_clean":"2024-03-30T12:38:45.876204+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:38:45.876204+0000","last_undegraded":"2024-03-30T12:38:45.876204+0000","last_fullsized":"2024-03-30T12:38:45.876204+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904270+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:37:13.904270+0000","last_peered":"2024-03-30T12:37:13.904270+0000","last_clean":"2024-03-30T12:37:13.904270+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:37:13.904270+0000","last_undegraded":"2024-03-30T12:37:13.904270+0000","last_fullsized":"2024-03-30T12:37:13.904270+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1347,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904297+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:37:13.904297+0000","last_peered":"2024-03-30T12:37:13.904297+0000","last_clean":"2024-03-30T12:37:13.904297+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:37:13.904297+0000","last_undegraded":"2024-03-30T12:37:13.904297+0000","last_fullsized":"2024-03-30T12:37:13.904297+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296466+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:37:20.296466+0000","last_peered":"2024-03-30T12:37:20.296466+0000","last_clean":"2024-03-30T12:37:20.296466+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:37:20.296466+0000","last_undegraded":"2024-03-30T12:37:20.296466+0000","last_fullsized":"2024-03-30T12:37:20.296466+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5459,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:45.876257+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:38:45.876257+0000","last_peered":"2024-03-30T12:38:45.876257+0000","last_clean":"2024-03-30T12:38:45.876257+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:38:45.876257+0000","last_undegraded":"2024-03-30T12:38:45.876257+0000","last_fullsized":"2024-03-30T12:38:45.876257+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904314+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:37:13.904314+0000","last_peered":"2024-03-30T12:37:13.904314+0000","last_clean":"2024-03-30T12:37:13.904314+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:37:13.904314+0000","last_undegraded":"2024-03-30T12:37:13.904314+0000","last_fullsized":"2024-03-30T12:37:13.904314+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1207,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296362+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:37:20.296362+0000","last_peered":"2024-03-30T12:37:20.296362+0000","last_clean":"2024-03-30T12:37:20.296362+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:37:20.296362+0000","last_undegraded":"2024-03-30T12:37:20.296362+0000","last_fullsized":"2024-03-30T12:37:20.296362+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:57.289543+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:38:57.289543+0000","last_peered":"2024-03-30T12:38:57.289543+0000","last_clean":"2024-03-30T12:38:57.289543+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:38:57.289543+0000","last_undegraded":"2024-03-30T12:38:57.289543+0000","last_fullsized":"2024-03-30T12:38:57.289543+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3804,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:13.383237+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:38:13.383237+0000","last_peered":"2024-03-30T12:38:13.383237+0000","last_clean":"2024-03-30T12:38:13.383237+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:38:13.383237+0000","last_undegraded":"2024-03-30T12:38:13.383237+0000","last_fullsized":"2024-03-30T12:38:13.383237+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1343,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906884+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:37:38.906884+0000","last_peered":"2024-03-30T12:37:38.906884+0000","last_clean":"2024-03-30T12:37:38.906884+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:37:38.906884+0000","last_undegraded":"2024-03-30T12:37:38.906884+0000","last_fullsized":"2024-03-30T12:37:38.906884+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:48.914183+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:38:48.914183+0000","last_peered":"2024-03-30T12:38:48.914183+0000","last_clean":"2024-03-30T12:38:48.914183+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:38:48.914183+0000","last_undegraded":"2024-03-30T12:38:48.914183+0000","last_fullsized":"2024-03-30T12:38:48.914183+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:48.380185+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:37:48.380185+0000","last_peered":"2024-03-30T12:37:48.380185+0000","last_clean":"2024-03-30T12:37:48.380185+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:37:48.380185+0000","last_undegraded":"2024-03-30T12:37:48.380185+0000","last_fullsized":"2024-03-30T12:37:48.380185+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4577,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:39.138875+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:38:39.138875+0000","last_peered":"2024-03-30T12:38:39.138875+0000","last_clean":"2024-03-30T12:38:39.138875+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:38:39.138875+0000","last_undegraded":"2024-03-30T12:38:39.138875+0000","last_fullsized":"2024-03-30T12:38:39.138875+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1175,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:59.555994+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:37:59.555994+0000","last_peered":"2024-03-30T12:37:59.555994+0000","last_clean":"2024-03-30T12:37:59.555994+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:37:59.555994+0000","last_undegraded":"2024-03-30T12:37:59.555994+0000","last_fullsized":"2024-03-30T12:37:59.555994+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:22.649643+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:38:22.649643+0000","last_peered":"2024-03-30T12:38:22.649643+0000","last_clean":"2024-03-30T12:38:22.649643+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:38:22.649643+0000","last_undegraded":"2024-03-30T12:38:22.649643+0000","last_fullsized":"2024-03-30T12:38:22.649643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1200,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296444+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:37:20.296444+0000","last_peered":"2024-03-30T12:37:20.296444+0000","last_clean":"2024-03-30T12:37:20.296444+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:37:20.296444+0000","last_undegraded":"2024-03-30T12:37:20.296444+0000","last_fullsized":"2024-03-30T12:37:20.296444+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1717,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.136726+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:38:19.136726+0000","last_peered":"2024-03-30T12:38:19.136726+0000","last_clean":"2024-03-30T12:38:19.136726+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:38:19.136726+0000","last_undegraded":"2024-03-30T12:38:19.136726+0000","last_fullsized":"2024-03-30T12:38:19.136726+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24714,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:40.298683+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:37:40.298683+0000","last_peered":"2024-03-30T12:37:40.298683+0000","last_clean":"2024-03-30T12:37:40.298683+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:37:40.298683+0000","last_undegraded":"2024-03-30T12:37:40.298683+0000","last_fullsized":"2024-03-30T12:37:40.298683+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:05.865263+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:37:05.865263+0000","last_peered":"2024-03-30T12:37:05.865263+0000","last_clean":"2024-03-30T12:37:05.865263+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:37:05.865263+0000","last_undegraded":"2024-03-30T12:37:05.865263+0000","last_fullsized":"2024-03-30T12:37:05.865263+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876163+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:38:45.876163+0000","last_peered":"2024-03-30T12:38:45.876163+0000","last_clean":"2024-03-30T12:38:45.876163+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:38:45.876163+0000","last_undegraded":"2024-03-30T12:38:45.876163+0000","last_fullsized":"2024-03-30T12:38:45.876163+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.136697+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:38:19.136697+0000","last_peered":"2024-03-30T12:38:19.136697+0000","last_clean":"2024-03-30T12:38:19.136697+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:38:19.136697+0000","last_undegraded":"2024-03-30T12:38:19.136697+0000","last_fullsized":"2024-03-30T12:38:19.136697+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16481,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:59.555949+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:37:59.555949+0000","last_peered":"2024-03-30T12:37:59.555949+0000","last_clean":"2024-03-30T12:37:59.555949+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:37:59.555949+0000","last_undegraded":"2024-03-30T12:37:59.555949+0000","last_fullsized":"2024-03-30T12:37:59.555949+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876223+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:38:45.876223+0000","last_peered":"2024-03-30T12:38:45.876223+0000","last_clean":"2024-03-30T12:38:45.876223+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:38:45.876223+0000","last_undegraded":"2024-03-30T12:38:45.876223+0000","last_fullsized":"2024-03-30T12:38:45.876223+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1164,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.138928+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:38:39.138928+0000","last_peered":"2024-03-30T12:38:39.138928+0000","last_clean":"2024-03-30T12:38:39.138928+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:38:39.138928+0000","last_undegraded":"2024-03-30T12:38:39.138928+0000","last_fullsized":"2024-03-30T12:38:39.138928+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:13.904330+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:37:13.904330+0000","last_peered":"2024-03-30T12:37:13.904330+0000","last_clean":"2024-03-30T12:37:13.904330+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:37:13.904330+0000","last_undegraded":"2024-03-30T12:37:13.904330+0000","last_fullsized":"2024-03-30T12:37:13.904330+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31270,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:57.289492+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:38:57.289492+0000","last_peered":"2024-03-30T12:38:57.289492+0000","last_clean":"2024-03-30T12:38:57.289492+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:38:57.289492+0000","last_undegraded":"2024-03-30T12:38:57.289492+0000","last_fullsized":"2024-03-30T12:38:57.289492+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647394+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:37:57.647394+0000","last_peered":"2024-03-30T12:37:57.647394+0000","last_clean":"2024-03-30T12:37:57.647394+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:37:57.647394+0000","last_undegraded":"2024-03-30T12:37:57.647394+0000","last_fullsized":"2024-03-30T12:37:57.647394+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906874+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:37:38.906874+0000","last_peered":"2024-03-30T12:37:38.906874+0000","last_clean":"2024-03-30T12:37:38.906874+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:37:38.906874+0000","last_undegraded":"2024-03-30T12:37:38.906874+0000","last_fullsized":"2024-03-30T12:37:38.906874+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651932+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:38:47.651932+0000","last_peered":"2024-03-30T12:38:47.651932+0000","last_clean":"2024-03-30T12:38:47.651932+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:38:47.651932+0000","last_undegraded":"2024-03-30T12:38:47.651932+0000","last_fullsized":"2024-03-30T12:38:47.651932+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3765,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647332+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:37:57.647332+0000","last_peered":"2024-03-30T12:37:57.647332+0000","last_clean":"2024-03-30T12:37:57.647332+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:37:57.647332+0000","last_undegraded":"2024-03-30T12:37:57.647332+0000","last_fullsized":"2024-03-30T12:37:57.647332+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:57.289460+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:38:57.289460+0000","last_peered":"2024-03-30T12:38:57.289460+0000","last_clean":"2024-03-30T12:38:57.289460+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:38:57.289460+0000","last_undegraded":"2024-03-30T12:38:57.289460+0000","last_fullsized":"2024-03-30T12:38:57.289460+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1156,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558186+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:38:19.558186+0000","last_peered":"2024-03-30T12:38:19.558186+0000","last_clean":"2024-03-30T12:38:19.558186+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:38:19.558186+0000","last_undegraded":"2024-03-30T12:38:19.558186+0000","last_fullsized":"2024-03-30T12:38:19.558186+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:05.865242+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:37:05.865242+0000","last_peered":"2024-03-30T12:37:05.865242+0000","last_clean":"2024-03-30T12:37:05.865242+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:37:05.865242+0000","last_undegraded":"2024-03-30T12:37:05.865242+0000","last_fullsized":"2024-03-30T12:37:05.865242+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15594,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:00.301062+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:38:00.301062+0000","last_peered":"2024-03-30T12:38:00.301062+0000","last_clean":"2024-03-30T12:38:00.301062+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:38:00.301062+0000","last_undegraded":"2024-03-30T12:38:00.301062+0000","last_fullsized":"2024-03-30T12:38:00.301062+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.141061+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:38:59.141061+0000","last_peered":"2024-03-30T12:38:59.141061+0000","last_clean":"2024-03-30T12:38:59.141061+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:38:59.141061+0000","last_undegraded":"2024-03-30T12:38:59.141061+0000","last_fullsized":"2024-03-30T12:38:59.141061+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:12.278399+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:37:12.278399+0000","last_peered":"2024-03-30T12:37:12.278399+0000","last_clean":"2024-03-30T12:37:12.278399+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:37:12.278399+0000","last_undegraded":"2024-03-30T12:37:12.278399+0000","last_fullsized":"2024-03-30T12:37:12.278399+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29020,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:32.280556+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:37:32.280556+0000","last_peered":"2024-03-30T12:37:32.280556+0000","last_clean":"2024-03-30T12:37:32.280556+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:37:32.280556+0000","last_undegraded":"2024-03-30T12:37:32.280556+0000","last_fullsized":"2024-03-30T12:37:32.280556+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906809+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:37:38.906809+0000","last_peered":"2024-03-30T12:37:38.906809+0000","last_clean":"2024-03-30T12:37:38.906809+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:37:38.906809+0000","last_undegraded":"2024-03-30T12:37:38.906809+0000","last_fullsized":"2024-03-30T12:37:38.906809+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651850+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:38:47.651850+0000","last_peered":"2024-03-30T12:38:47.651850+0000","last_clean":"2024-03-30T12:38:47.651850+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:38:47.651850+0000","last_undegraded":"2024-03-30T12:38:47.651850+0000","last_fullsized":"2024-03-30T12:38:47.651850+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5611,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:38.385807+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:38:38.385807+0000","last_peered":"2024-03-30T12:38:38.385807+0000","last_clean":"2024-03-30T12:38:38.385807+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:38:38.385807+0000","last_undegraded":"2024-03-30T12:38:38.385807+0000","last_fullsized":"2024-03-30T12:38:38.385807+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1365,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906835+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:37:38.906835+0000","last_peered":"2024-03-30T12:37:38.906835+0000","last_clean":"2024-03-30T12:37:38.906835+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:37:38.906835+0000","last_undegraded":"2024-03-30T12:37:38.906835+0000","last_fullsized":"2024-03-30T12:37:38.906835+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:57.641061+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:57.641061+0000","last_peered":"2024-03-30T12:36:57.641061+0000","last_clean":"2024-03-30T12:36:57.641061+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:57.641061+0000","last_undegraded":"2024-03-30T12:36:57.641061+0000","last_fullsized":"2024-03-30T12:36:57.641061+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4275,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:03.909427+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:38:03.909427+0000","last_peered":"2024-03-30T12:38:03.909427+0000","last_clean":"2024-03-30T12:38:03.909427+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:38:03.909427+0000","last_undegraded":"2024-03-30T12:38:03.909427+0000","last_fullsized":"2024-03-30T12:38:03.909427+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.127976+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:37:04.127976+0000","last_peered":"2024-03-30T12:37:04.127976+0000","last_clean":"2024-03-30T12:37:04.127976+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:37:04.127976+0000","last_undegraded":"2024-03-30T12:37:04.127976+0000","last_fullsized":"2024-03-30T12:37:04.127976+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558134+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:38:19.558134+0000","last_peered":"2024-03-30T12:38:19.558134+0000","last_clean":"2024-03-30T12:38:19.558134+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:38:19.558134+0000","last_undegraded":"2024-03-30T12:38:19.558134+0000","last_fullsized":"2024-03-30T12:38:19.558134+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5254,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:38.385765+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:38:38.385765+0000","last_peered":"2024-03-30T12:38:38.385765+0000","last_clean":"2024-03-30T12:38:38.385765+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:38:38.385765+0000","last_undegraded":"2024-03-30T12:38:38.385765+0000","last_fullsized":"2024-03-30T12:38:38.385765+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:38.385797+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:38:38.385797+0000","last_peered":"2024-03-30T12:38:38.385797+0000","last_clean":"2024-03-30T12:38:38.385797+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:38:38.385797+0000","last_undegraded":"2024-03-30T12:38:38.385797+0000","last_fullsized":"2024-03-30T12:38:38.385797+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128016+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:37:04.128016+0000","last_peered":"2024-03-30T12:37:04.128016+0000","last_clean":"2024-03-30T12:37:04.128016+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:37:04.128016+0000","last_undegraded":"2024-03-30T12:37:04.128016+0000","last_fullsized":"2024-03-30T12:37:04.128016+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4811,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:13.383202+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:38:13.383202+0000","last_peered":"2024-03-30T12:38:13.383202+0000","last_clean":"2024-03-30T12:38:13.383202+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:38:13.383202+0000","last_undegraded":"2024-03-30T12:38:13.383202+0000","last_fullsized":"2024-03-30T12:38:13.383202+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:03.909462+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:38:03.909462+0000","last_peered":"2024-03-30T12:38:03.909462+0000","last_clean":"2024-03-30T12:38:03.909462+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:38:03.909462+0000","last_undegraded":"2024-03-30T12:38:03.909462+0000","last_fullsized":"2024-03-30T12:38:03.909462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:00.301034+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:38:00.301034+0000","last_peered":"2024-03-30T12:38:00.301034+0000","last_clean":"2024-03-30T12:38:00.301034+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:38:00.301034+0000","last_undegraded":"2024-03-30T12:38:00.301034+0000","last_fullsized":"2024-03-30T12:38:00.301034+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6744,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:59.141086+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:38:59.141086+0000","last_peered":"2024-03-30T12:38:59.141086+0000","last_clean":"2024-03-30T12:38:59.141086+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:38:59.141086+0000","last_undegraded":"2024-03-30T12:38:59.141086+0000","last_fullsized":"2024-03-30T12:38:59.141086+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1338,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:38.385827+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:38:38.385827+0000","last_peered":"2024-03-30T12:38:38.385827+0000","last_clean":"2024-03-30T12:38:38.385827+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:38:38.385827+0000","last_undegraded":"2024-03-30T12:38:38.385827+0000","last_fullsized":"2024-03-30T12:38:38.385827+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128054+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:37:04.128054+0000","last_peered":"2024-03-30T12:37:04.128054+0000","last_clean":"2024-03-30T12:37:04.128054+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:37:04.128054+0000","last_undegraded":"2024-03-30T12:37:04.128054+0000","last_fullsized":"2024-03-30T12:37:04.128054+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:59.555915+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:37:59.555915+0000","last_peered":"2024-03-30T12:37:59.555915+0000","last_clean":"2024-03-30T12:37:59.555915+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:37:59.555915+0000","last_undegraded":"2024-03-30T12:37:59.555915+0000","last_fullsized":"2024-03-30T12:37:59.555915+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:48.380210+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:37:48.380210+0000","last_peered":"2024-03-30T12:37:48.380210+0000","last_clean":"2024-03-30T12:37:48.380210+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:37:48.380210+0000","last_undegraded":"2024-03-30T12:37:48.380210+0000","last_fullsized":"2024-03-30T12:37:48.380210+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296394+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:37:20.296394+0000","last_peered":"2024-03-30T12:37:20.296394+0000","last_clean":"2024-03-30T12:37:20.296394+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:37:20.296394+0000","last_undegraded":"2024-03-30T12:37:20.296394+0000","last_fullsized":"2024-03-30T12:37:20.296394+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876194+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:38:45.876194+0000","last_peered":"2024-03-30T12:38:45.876194+0000","last_clean":"2024-03-30T12:38:45.876194+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:38:45.876194+0000","last_undegraded":"2024-03-30T12:38:45.876194+0000","last_fullsized":"2024-03-30T12:38:45.876194+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651915+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:38:47.651915+0000","last_peered":"2024-03-30T12:38:47.651915+0000","last_clean":"2024-03-30T12:38:47.651915+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:38:47.651915+0000","last_undegraded":"2024-03-30T12:38:47.651915+0000","last_fullsized":"2024-03-30T12:38:47.651915+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906859+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:37:38.906859+0000","last_peered":"2024-03-30T12:37:38.906859+0000","last_clean":"2024-03-30T12:37:38.906859+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:37:38.906859+0000","last_undegraded":"2024-03-30T12:37:38.906859+0000","last_fullsized":"2024-03-30T12:37:38.906859+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1178,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558174+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:38:19.558174+0000","last_peered":"2024-03-30T12:38:19.558174+0000","last_clean":"2024-03-30T12:38:19.558174+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:38:19.558174+0000","last_undegraded":"2024-03-30T12:38:19.558174+0000","last_fullsized":"2024-03-30T12:38:19.558174+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1282,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651943+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:38:47.651943+0000","last_peered":"2024-03-30T12:38:47.651943+0000","last_clean":"2024-03-30T12:38:47.651943+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:38:47.651943+0000","last_undegraded":"2024-03-30T12:38:47.651943+0000","last_fullsized":"2024-03-30T12:38:47.651943+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:40.298625+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:37:40.298625+0000","last_peered":"2024-03-30T12:37:40.298625+0000","last_clean":"2024-03-30T12:37:40.298625+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:37:40.298625+0000","last_undegraded":"2024-03-30T12:37:40.298625+0000","last_fullsized":"2024-03-30T12:37:40.298625+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:57.641040+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:57.641040+0000","last_peered":"2024-03-30T12:36:57.641040+0000","last_clean":"2024-03-30T12:36:57.641040+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:57.641040+0000","last_undegraded":"2024-03-30T12:36:57.641040+0000","last_fullsized":"2024-03-30T12:36:57.641040+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1216,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:00.300996+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:38:00.300996+0000","last_peered":"2024-03-30T12:38:00.300996+0000","last_clean":"2024-03-30T12:38:00.300996+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:38:00.300996+0000","last_undegraded":"2024-03-30T12:38:00.300996+0000","last_fullsized":"2024-03-30T12:38:00.300996+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:30.867819+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:37:30.867819+0000","last_peered":"2024-03-30T12:37:30.867819+0000","last_clean":"2024-03-30T12:37:30.867819+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:37:30.867819+0000","last_undegraded":"2024-03-30T12:37:30.867819+0000","last_fullsized":"2024-03-30T12:37:30.867819+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.560418+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:38:39.560418+0000","last_peered":"2024-03-30T12:38:39.560418+0000","last_clean":"2024-03-30T12:38:39.560418+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:38:39.560418+0000","last_undegraded":"2024-03-30T12:38:39.560418+0000","last_fullsized":"2024-03-30T12:38:39.560418+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438084,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648140,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175150,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254388,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063207,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951264,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839321,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923603,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:41:16.285 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:16.285 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:16.285 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:16.285 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:16.286 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:16.286 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:16.286 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:16.286 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:16.286 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:16.286 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:16.286 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:16.286 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:16.286 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:16.286 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:41:16.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:15 smithi162 ceph-mon[83709]: pgmap v1146: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:16.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:15 smithi162 ceph-mon[83709]: from='client.44591 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:41:18.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:17 smithi084 ceph-mon[89279]: pgmap v1147: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:18.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:17 smithi084 ceph-mon[91810]: pgmap v1147: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:18.368 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:17 smithi162 ceph-mon[83709]: pgmap v1147: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:19.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:41:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:41:19] "GET /metrics HTTP/1.1" 200 36327 "" "Prometheus/2.43.0" 2024-03-30T12:41:20.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:19 smithi084 ceph-mon[89279]: pgmap v1148: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:20.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:19 smithi084 ceph-mon[91810]: pgmap v1148: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:20.368 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:19 smithi162 ceph-mon[83709]: pgmap v1148: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:22.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:21 smithi084 ceph-mon[91810]: pgmap v1149: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:22.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:21 smithi084 ceph-mon[89279]: pgmap v1149: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:22.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:21 smithi162 ceph-mon[83709]: pgmap v1149: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:24.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:23 smithi084 ceph-mon[91810]: pgmap v1150: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:24.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:23 smithi084 ceph-mon[89279]: pgmap v1150: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:24.368 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:23 smithi162 ceph-mon[83709]: pgmap v1150: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:26.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:25 smithi084 ceph-mon[91810]: pgmap v1151: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:26.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:25 smithi084 ceph-mon[89279]: pgmap v1151: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:26.287 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:41:26.368 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:25 smithi162 ceph-mon[83709]: pgmap v1151: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:26.508 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:41:28.161 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:27 smithi084 ceph-mon[91810]: pgmap v1152: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:28.161 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:27 smithi084 ceph-mon[89279]: pgmap v1152: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:28.371 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:41:28.373 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:41:28.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:27 smithi162 ceph-mon[83709]: pgmap v1152: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:29.020 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1152,"stamp":"2024-03-30T12:41:26.900864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004116"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.138971+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:38:39.138971+0000","last_peered":"2024-03-30T12:38:39.138971+0000","last_clean":"2024-03-30T12:38:39.138971+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:38:39.138971+0000","last_undegraded":"2024-03-30T12:38:39.138971+0000","last_fullsized":"2024-03-30T12:38:39.138971+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1365,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917695+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:39:18.917695+0000","last_peered":"2024-03-30T12:39:18.917695+0000","last_clean":"2024-03-30T12:39:18.917695+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:39:18.917695+0000","last_undegraded":"2024-03-30T12:39:18.917695+0000","last_fullsized":"2024-03-30T12:39:18.917695+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876244+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:38:45.876244+0000","last_peered":"2024-03-30T12:38:45.876244+0000","last_clean":"2024-03-30T12:38:45.876244+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:38:45.876244+0000","last_undegraded":"2024-03-30T12:38:45.876244+0000","last_fullsized":"2024-03-30T12:38:45.876244+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308618+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:39:00.308618+0000","last_peered":"2024-03-30T12:39:00.308618+0000","last_clean":"2024-03-30T12:39:00.308618+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:39:00.308618+0000","last_undegraded":"2024-03-30T12:39:00.308618+0000","last_fullsized":"2024-03-30T12:39:00.308618+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133062+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:37:49.133062+0000","last_peered":"2024-03-30T12:37:49.133062+0000","last_clean":"2024-03-30T12:37:49.133062+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:37:49.133062+0000","last_undegraded":"2024-03-30T12:37:49.133062+0000","last_fullsized":"2024-03-30T12:37:49.133062+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1210,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290374+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:36:30.290374+0000","last_peered":"2024-03-30T12:36:30.290374+0000","last_clean":"2024-03-30T12:36:30.290374+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:36:30.290374+0000","last_undegraded":"2024-03-30T12:36:30.290374+0000","last_fullsized":"2024-03-30T12:36:30.290374+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133035+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:37:49.133035+0000","last_peered":"2024-03-30T12:37:49.133035+0000","last_clean":"2024-03-30T12:37:49.133035+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:37:49.133035+0000","last_undegraded":"2024-03-30T12:37:49.133035+0000","last_fullsized":"2024-03-30T12:37:49.133035+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647301+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:37:57.647301+0000","last_peered":"2024-03-30T12:37:57.647301+0000","last_clean":"2024-03-30T12:37:57.647301+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:37:57.647301+0000","last_undegraded":"2024-03-30T12:37:57.647301+0000","last_fullsized":"2024-03-30T12:37:57.647301+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:34.131337+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:37:34.131337+0000","last_peered":"2024-03-30T12:37:34.131337+0000","last_clean":"2024-03-30T12:37:34.131337+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:37:34.131337+0000","last_undegraded":"2024-03-30T12:37:34.131337+0000","last_fullsized":"2024-03-30T12:37:34.131337+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548505+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:54.548505+0000","last_peered":"2024-03-30T12:36:54.548505+0000","last_clean":"2024-03-30T12:36:54.548505+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:54.548505+0000","last_undegraded":"2024-03-30T12:36:54.548505+0000","last_fullsized":"2024-03-30T12:36:54.548505+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548476+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:54.548476+0000","last_peered":"2024-03-30T12:36:54.548476+0000","last_clean":"2024-03-30T12:36:54.548476+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:54.548476+0000","last_undegraded":"2024-03-30T12:36:54.548476+0000","last_fullsized":"2024-03-30T12:36:54.548476+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1271,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:12.285006+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:38:12.285006+0000","last_peered":"2024-03-30T12:38:12.285006+0000","last_clean":"2024-03-30T12:38:12.285006+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:38:12.285006+0000","last_undegraded":"2024-03-30T12:38:12.285006+0000","last_fullsized":"2024-03-30T12:38:12.285006+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645098+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:37:37.645098+0000","last_peered":"2024-03-30T12:37:37.645098+0000","last_clean":"2024-03-30T12:37:37.645098+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:37:37.645098+0000","last_undegraded":"2024-03-30T12:37:37.645098+0000","last_fullsized":"2024-03-30T12:37:37.645098+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870430+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:37:55.870430+0000","last_peered":"2024-03-30T12:37:55.870430+0000","last_clean":"2024-03-30T12:37:55.870430+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:37:55.870430+0000","last_undegraded":"2024-03-30T12:37:55.870430+0000","last_fullsized":"2024-03-30T12:37:55.870430+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:28.912065+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:38:28.912065+0000","last_peered":"2024-03-30T12:38:28.912065+0000","last_clean":"2024-03-30T12:38:28.912065+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:38:28.912065+0000","last_undegraded":"2024-03-30T12:38:28.912065+0000","last_fullsized":"2024-03-30T12:38:28.912065+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303373+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:38:20.303373+0000","last_peered":"2024-03-30T12:38:20.303373+0000","last_clean":"2024-03-30T12:38:20.303373+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:38:20.303373+0000","last_undegraded":"2024-03-30T12:38:20.303373+0000","last_fullsized":"2024-03-30T12:38:20.303373+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1225,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303460+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:38:20.303460+0000","last_peered":"2024-03-30T12:38:20.303460+0000","last_clean":"2024-03-30T12:38:20.303460+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:38:20.303460+0000","last_undegraded":"2024-03-30T12:38:20.303460+0000","last_fullsized":"2024-03-30T12:38:20.303460+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:03.388264+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:39:03.388264+0000","last_peered":"2024-03-30T12:39:03.388264+0000","last_clean":"2024-03-30T12:39:03.388264+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:39:03.388264+0000","last_undegraded":"2024-03-30T12:39:03.388264+0000","last_fullsized":"2024-03-30T12:39:03.388264+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128028+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:37:04.128028+0000","last_peered":"2024-03-30T12:37:04.128028+0000","last_clean":"2024-03-30T12:37:04.128028+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:37:04.128028+0000","last_undegraded":"2024-03-30T12:37:04.128028+0000","last_fullsized":"2024-03-30T12:37:04.128028+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1389,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876285+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:38:45.876285+0000","last_peered":"2024-03-30T12:38:45.876285+0000","last_clean":"2024-03-30T12:38:45.876285+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:38:45.876285+0000","last_undegraded":"2024-03-30T12:38:45.876285+0000","last_fullsized":"2024-03-30T12:38:45.876285+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1283,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647447+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:37:57.647447+0000","last_peered":"2024-03-30T12:37:57.647447+0000","last_clean":"2024-03-30T12:37:57.647447+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:37:57.647447+0000","last_undegraded":"2024-03-30T12:37:57.647447+0000","last_fullsized":"2024-03-30T12:37:57.647447+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1302,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647455+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:37:57.647455+0000","last_peered":"2024-03-30T12:37:57.647455+0000","last_clean":"2024-03-30T12:37:57.647455+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:37:57.647455+0000","last_undegraded":"2024-03-30T12:37:57.647455+0000","last_fullsized":"2024-03-30T12:37:57.647455+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876275+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:38:45.876275+0000","last_peered":"2024-03-30T12:38:45.876275+0000","last_clean":"2024-03-30T12:38:45.876275+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:38:45.876275+0000","last_undegraded":"2024-03-30T12:38:45.876275+0000","last_fullsized":"2024-03-30T12:38:45.876275+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1151,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133095+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:37:49.133095+0000","last_peered":"2024-03-30T12:37:49.133095+0000","last_clean":"2024-03-30T12:37:49.133095+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:37:49.133095+0000","last_undegraded":"2024-03-30T12:37:49.133095+0000","last_fullsized":"2024-03-30T12:37:49.133095+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1229,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290400+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:36:30.290400+0000","last_peered":"2024-03-30T12:36:30.290400+0000","last_clean":"2024-03-30T12:36:30.290400+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:36:30.290400+0000","last_undegraded":"2024-03-30T12:36:30.290400+0000","last_fullsized":"2024-03-30T12:36:30.290400+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133077+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:37:49.133077+0000","last_peered":"2024-03-30T12:37:49.133077+0000","last_clean":"2024-03-30T12:37:49.133077+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:37:49.133077+0000","last_undegraded":"2024-03-30T12:37:49.133077+0000","last_fullsized":"2024-03-30T12:37:49.133077+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1213,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:30.290416+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:36:30.290416+0000","last_peered":"2024-03-30T12:36:30.290416+0000","last_clean":"2024-03-30T12:36:30.290416+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:36:30.290416+0000","last_undegraded":"2024-03-30T12:36:30.290416+0000","last_fullsized":"2024-03-30T12:36:30.290416+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647433+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:37:57.647433+0000","last_peered":"2024-03-30T12:37:57.647433+0000","last_clean":"2024-03-30T12:37:57.647433+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:37:57.647433+0000","last_undegraded":"2024-03-30T12:37:57.647433+0000","last_fullsized":"2024-03-30T12:37:57.647433+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1263,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:32.286955+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:38:32.286955+0000","last_peered":"2024-03-30T12:38:32.286955+0000","last_clean":"2024-03-30T12:38:32.286955+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:38:32.286955+0000","last_undegraded":"2024-03-30T12:38:32.286955+0000","last_fullsized":"2024-03-30T12:38:32.286955+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1180,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:09.550388+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:37:09.550388+0000","last_peered":"2024-03-30T12:37:09.550388+0000","last_clean":"2024-03-30T12:37:09.550388+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:37:09.550388+0000","last_undegraded":"2024-03-30T12:37:09.550388+0000","last_fullsized":"2024-03-30T12:37:09.550388+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876233+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:38:45.876233+0000","last_peered":"2024-03-30T12:38:45.876233+0000","last_clean":"2024-03-30T12:38:45.876233+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:38:45.876233+0000","last_undegraded":"2024-03-30T12:38:45.876233+0000","last_fullsized":"2024-03-30T12:38:45.876233+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645072+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:37:37.645072+0000","last_peered":"2024-03-30T12:37:37.645072+0000","last_clean":"2024-03-30T12:37:37.645072+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:37:37.645072+0000","last_undegraded":"2024-03-30T12:37:37.645072+0000","last_fullsized":"2024-03-30T12:37:37.645072+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645031+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:37:37.645031+0000","last_peered":"2024-03-30T12:37:37.645031+0000","last_clean":"2024-03-30T12:37:37.645031+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:37:37.645031+0000","last_undegraded":"2024-03-30T12:37:37.645031+0000","last_fullsized":"2024-03-30T12:37:37.645031+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1225,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306130+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:38:40.306130+0000","last_peered":"2024-03-30T12:38:40.306130+0000","last_clean":"2024-03-30T12:38:40.306130+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:38:40.306130+0000","last_undegraded":"2024-03-30T12:38:40.306130+0000","last_fullsized":"2024-03-30T12:38:40.306130+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:53.914730+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:38:53.914730+0000","last_peered":"2024-03-30T12:38:53.914730+0000","last_clean":"2024-03-30T12:38:53.914730+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:38:53.914730+0000","last_undegraded":"2024-03-30T12:38:53.914730+0000","last_fullsized":"2024-03-30T12:38:53.914730+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548518+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:54.548518+0000","last_peered":"2024-03-30T12:36:54.548518+0000","last_clean":"2024-03-30T12:36:54.548518+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:54.548518+0000","last_undegraded":"2024-03-30T12:36:54.548518+0000","last_fullsized":"2024-03-30T12:36:54.548518+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306212+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:38:40.306212+0000","last_peered":"2024-03-30T12:38:40.306212+0000","last_clean":"2024-03-30T12:38:40.306212+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:38:40.306212+0000","last_undegraded":"2024-03-30T12:38:40.306212+0000","last_fullsized":"2024-03-30T12:38:40.306212+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1199,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306200+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:38:40.306200+0000","last_peered":"2024-03-30T12:38:40.306200+0000","last_clean":"2024-03-30T12:38:40.306200+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:38:40.306200+0000","last_undegraded":"2024-03-30T12:38:40.306200+0000","last_fullsized":"2024-03-30T12:38:40.306200+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:03.374890+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:37:03.374890+0000","last_peered":"2024-03-30T12:37:03.374890+0000","last_clean":"2024-03-30T12:37:03.374890+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:37:03.374890+0000","last_undegraded":"2024-03-30T12:37:03.374890+0000","last_fullsized":"2024-03-30T12:37:03.374890+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:53.914770+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:38:53.914770+0000","last_peered":"2024-03-30T12:38:53.914770+0000","last_clean":"2024-03-30T12:38:53.914770+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:38:53.914770+0000","last_undegraded":"2024-03-30T12:38:53.914770+0000","last_fullsized":"2024-03-30T12:38:53.914770+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:52.282667+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:37:52.282667+0000","last_peered":"2024-03-30T12:37:52.282667+0000","last_clean":"2024-03-30T12:37:52.282667+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:37:52.282667+0000","last_undegraded":"2024-03-30T12:37:52.282667+0000","last_fullsized":"2024-03-30T12:37:52.282667+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562847+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:38:59.562847+0000","last_peered":"2024-03-30T12:38:59.562847+0000","last_clean":"2024-03-30T12:38:59.562847+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:38:59.562847+0000","last_undegraded":"2024-03-30T12:38:59.562847+0000","last_fullsized":"2024-03-30T12:38:59.562847+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:34.131303+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:37:34.131303+0000","last_peered":"2024-03-30T12:37:34.131303+0000","last_clean":"2024-03-30T12:37:34.131303+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:37:34.131303+0000","last_undegraded":"2024-03-30T12:37:34.131303+0000","last_fullsized":"2024-03-30T12:37:34.131303+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1384,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870514+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:37:55.870514+0000","last_peered":"2024-03-30T12:37:55.870514+0000","last_clean":"2024-03-30T12:37:55.870514+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:37:55.870514+0000","last_undegraded":"2024-03-30T12:37:55.870514+0000","last_fullsized":"2024-03-30T12:37:55.870514+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870486+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:37:55.870486+0000","last_peered":"2024-03-30T12:37:55.870486+0000","last_clean":"2024-03-30T12:37:55.870486+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:37:55.870486+0000","last_undegraded":"2024-03-30T12:37:55.870486+0000","last_fullsized":"2024-03-30T12:37:55.870486+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303405+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:38:20.303405+0000","last_peered":"2024-03-30T12:38:20.303405+0000","last_clean":"2024-03-30T12:38:20.303405+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:38:20.303405+0000","last_undegraded":"2024-03-30T12:38:20.303405+0000","last_fullsized":"2024-03-30T12:38:20.303405+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:19.129793+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:37:19.129793+0000","last_peered":"2024-03-30T12:37:19.129793+0000","last_clean":"2024-03-30T12:37:19.129793+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:37:19.129793+0000","last_undegraded":"2024-03-30T12:37:19.129793+0000","last_fullsized":"2024-03-30T12:37:19.129793+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562815+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:38:59.562815+0000","last_peered":"2024-03-30T12:38:59.562815+0000","last_clean":"2024-03-30T12:38:59.562815+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:38:59.562815+0000","last_undegraded":"2024-03-30T12:38:59.562815+0000","last_fullsized":"2024-03-30T12:38:59.562815+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562788+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:38:59.562788+0000","last_peered":"2024-03-30T12:38:59.562788+0000","last_clean":"2024-03-30T12:38:59.562788+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:38:59.562788+0000","last_undegraded":"2024-03-30T12:38:59.562788+0000","last_fullsized":"2024-03-30T12:38:59.562788+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:03.388191+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:39:03.388191+0000","last_peered":"2024-03-30T12:39:03.388191+0000","last_clean":"2024-03-30T12:39:03.388191+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:39:03.388191+0000","last_undegraded":"2024-03-30T12:39:03.388191+0000","last_fullsized":"2024-03-30T12:39:03.388191+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:19.129759+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:37:19.129759+0000","last_peered":"2024-03-30T12:37:19.129759+0000","last_clean":"2024-03-30T12:37:19.129759+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:37:19.129759+0000","last_undegraded":"2024-03-30T12:37:19.129759+0000","last_fullsized":"2024-03-30T12:37:19.129759+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5753,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:13.383127+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:38:13.383127+0000","last_peered":"2024-03-30T12:38:13.383127+0000","last_clean":"2024-03-30T12:38:13.383127+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:38:13.383127+0000","last_undegraded":"2024-03-30T12:38:13.383127+0000","last_fullsized":"2024-03-30T12:38:13.383127+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1275,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:32.280622+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:37:32.280622+0000","last_peered":"2024-03-30T12:37:32.280622+0000","last_clean":"2024-03-30T12:37:32.280622+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:37:32.280622+0000","last_undegraded":"2024-03-30T12:37:32.280622+0000","last_fullsized":"2024-03-30T12:37:32.280622+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128039+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:37:04.128039+0000","last_peered":"2024-03-30T12:37:04.128039+0000","last_clean":"2024-03-30T12:37:04.128039+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:37:04.128039+0000","last_undegraded":"2024-03-30T12:37:04.128039+0000","last_fullsized":"2024-03-30T12:37:04.128039+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5514,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:45.876204+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:38:45.876204+0000","last_peered":"2024-03-30T12:38:45.876204+0000","last_clean":"2024-03-30T12:38:45.876204+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:38:45.876204+0000","last_undegraded":"2024-03-30T12:38:45.876204+0000","last_fullsized":"2024-03-30T12:38:45.876204+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917640+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:39:18.917640+0000","last_peered":"2024-03-30T12:39:18.917640+0000","last_clean":"2024-03-30T12:39:18.917640+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:39:18.917640+0000","last_undegraded":"2024-03-30T12:39:18.917640+0000","last_fullsized":"2024-03-30T12:39:18.917640+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917662+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:39:18.917662+0000","last_peered":"2024-03-30T12:39:18.917662+0000","last_clean":"2024-03-30T12:39:18.917662+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:39:18.917662+0000","last_undegraded":"2024-03-30T12:39:18.917662+0000","last_fullsized":"2024-03-30T12:39:18.917662+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296466+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:37:20.296466+0000","last_peered":"2024-03-30T12:37:20.296466+0000","last_clean":"2024-03-30T12:37:20.296466+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:37:20.296466+0000","last_undegraded":"2024-03-30T12:37:20.296466+0000","last_fullsized":"2024-03-30T12:37:20.296466+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5459,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:45.876257+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:38:45.876257+0000","last_peered":"2024-03-30T12:38:45.876257+0000","last_clean":"2024-03-30T12:38:45.876257+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:38:45.876257+0000","last_undegraded":"2024-03-30T12:38:45.876257+0000","last_fullsized":"2024-03-30T12:38:45.876257+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917672+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:39:18.917672+0000","last_peered":"2024-03-30T12:39:18.917672+0000","last_clean":"2024-03-30T12:39:18.917672+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:39:18.917672+0000","last_undegraded":"2024-03-30T12:39:18.917672+0000","last_fullsized":"2024-03-30T12:39:18.917672+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1207,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296362+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:37:20.296362+0000","last_peered":"2024-03-30T12:37:20.296362+0000","last_clean":"2024-03-30T12:37:20.296362+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:37:20.296362+0000","last_undegraded":"2024-03-30T12:37:20.296362+0000","last_fullsized":"2024-03-30T12:37:20.296362+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:57.289543+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:38:57.289543+0000","last_peered":"2024-03-30T12:38:57.289543+0000","last_clean":"2024-03-30T12:38:57.289543+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:38:57.289543+0000","last_undegraded":"2024-03-30T12:38:57.289543+0000","last_fullsized":"2024-03-30T12:38:57.289543+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3804,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:13.383237+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:38:13.383237+0000","last_peered":"2024-03-30T12:38:13.383237+0000","last_clean":"2024-03-30T12:38:13.383237+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:38:13.383237+0000","last_undegraded":"2024-03-30T12:38:13.383237+0000","last_fullsized":"2024-03-30T12:38:13.383237+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1343,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906884+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:37:38.906884+0000","last_peered":"2024-03-30T12:37:38.906884+0000","last_clean":"2024-03-30T12:37:38.906884+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:37:38.906884+0000","last_undegraded":"2024-03-30T12:37:38.906884+0000","last_fullsized":"2024-03-30T12:37:38.906884+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:48.914183+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:38:48.914183+0000","last_peered":"2024-03-30T12:38:48.914183+0000","last_clean":"2024-03-30T12:38:48.914183+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:38:48.914183+0000","last_undegraded":"2024-03-30T12:38:48.914183+0000","last_fullsized":"2024-03-30T12:38:48.914183+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:48.380185+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:37:48.380185+0000","last_peered":"2024-03-30T12:37:48.380185+0000","last_clean":"2024-03-30T12:37:48.380185+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:37:48.380185+0000","last_undegraded":"2024-03-30T12:37:48.380185+0000","last_fullsized":"2024-03-30T12:37:48.380185+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4577,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:39.138875+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:38:39.138875+0000","last_peered":"2024-03-30T12:38:39.138875+0000","last_clean":"2024-03-30T12:38:39.138875+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:38:39.138875+0000","last_undegraded":"2024-03-30T12:38:39.138875+0000","last_fullsized":"2024-03-30T12:38:39.138875+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1175,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:59.555994+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:37:59.555994+0000","last_peered":"2024-03-30T12:37:59.555994+0000","last_clean":"2024-03-30T12:37:59.555994+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:37:59.555994+0000","last_undegraded":"2024-03-30T12:37:59.555994+0000","last_fullsized":"2024-03-30T12:37:59.555994+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:22.649643+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:38:22.649643+0000","last_peered":"2024-03-30T12:38:22.649643+0000","last_clean":"2024-03-30T12:38:22.649643+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:38:22.649643+0000","last_undegraded":"2024-03-30T12:38:22.649643+0000","last_fullsized":"2024-03-30T12:38:22.649643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1200,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296444+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:37:20.296444+0000","last_peered":"2024-03-30T12:37:20.296444+0000","last_clean":"2024-03-30T12:37:20.296444+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:37:20.296444+0000","last_undegraded":"2024-03-30T12:37:20.296444+0000","last_fullsized":"2024-03-30T12:37:20.296444+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1717,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.136726+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:38:19.136726+0000","last_peered":"2024-03-30T12:38:19.136726+0000","last_clean":"2024-03-30T12:38:19.136726+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:38:19.136726+0000","last_undegraded":"2024-03-30T12:38:19.136726+0000","last_fullsized":"2024-03-30T12:38:19.136726+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24714,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:40.298683+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:37:40.298683+0000","last_peered":"2024-03-30T12:37:40.298683+0000","last_clean":"2024-03-30T12:37:40.298683+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:37:40.298683+0000","last_undegraded":"2024-03-30T12:37:40.298683+0000","last_fullsized":"2024-03-30T12:37:40.298683+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:15.879816+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:39:15.879816+0000","last_peered":"2024-03-30T12:39:15.879816+0000","last_clean":"2024-03-30T12:39:15.879816+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:39:15.879816+0000","last_undegraded":"2024-03-30T12:39:15.879816+0000","last_fullsized":"2024-03-30T12:39:15.879816+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876163+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:38:45.876163+0000","last_peered":"2024-03-30T12:38:45.876163+0000","last_clean":"2024-03-30T12:38:45.876163+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:38:45.876163+0000","last_undegraded":"2024-03-30T12:38:45.876163+0000","last_fullsized":"2024-03-30T12:38:45.876163+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.136697+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:38:19.136697+0000","last_peered":"2024-03-30T12:38:19.136697+0000","last_clean":"2024-03-30T12:38:19.136697+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:38:19.136697+0000","last_undegraded":"2024-03-30T12:38:19.136697+0000","last_fullsized":"2024-03-30T12:38:19.136697+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16481,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:59.555949+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:37:59.555949+0000","last_peered":"2024-03-30T12:37:59.555949+0000","last_clean":"2024-03-30T12:37:59.555949+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:37:59.555949+0000","last_undegraded":"2024-03-30T12:37:59.555949+0000","last_fullsized":"2024-03-30T12:37:59.555949+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876223+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:38:45.876223+0000","last_peered":"2024-03-30T12:38:45.876223+0000","last_clean":"2024-03-30T12:38:45.876223+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:38:45.876223+0000","last_undegraded":"2024-03-30T12:38:45.876223+0000","last_fullsized":"2024-03-30T12:38:45.876223+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1164,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.138928+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:38:39.138928+0000","last_peered":"2024-03-30T12:38:39.138928+0000","last_clean":"2024-03-30T12:38:39.138928+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:38:39.138928+0000","last_undegraded":"2024-03-30T12:38:39.138928+0000","last_fullsized":"2024-03-30T12:38:39.138928+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917681+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:39:18.917681+0000","last_peered":"2024-03-30T12:39:18.917681+0000","last_clean":"2024-03-30T12:39:18.917681+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:39:18.917681+0000","last_undegraded":"2024-03-30T12:39:18.917681+0000","last_fullsized":"2024-03-30T12:39:18.917681+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31270,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:57.289492+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:38:57.289492+0000","last_peered":"2024-03-30T12:38:57.289492+0000","last_clean":"2024-03-30T12:38:57.289492+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:38:57.289492+0000","last_undegraded":"2024-03-30T12:38:57.289492+0000","last_fullsized":"2024-03-30T12:38:57.289492+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647394+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:37:57.647394+0000","last_peered":"2024-03-30T12:37:57.647394+0000","last_clean":"2024-03-30T12:37:57.647394+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:37:57.647394+0000","last_undegraded":"2024-03-30T12:37:57.647394+0000","last_fullsized":"2024-03-30T12:37:57.647394+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906874+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:37:38.906874+0000","last_peered":"2024-03-30T12:37:38.906874+0000","last_clean":"2024-03-30T12:37:38.906874+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:37:38.906874+0000","last_undegraded":"2024-03-30T12:37:38.906874+0000","last_fullsized":"2024-03-30T12:37:38.906874+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651932+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:38:47.651932+0000","last_peered":"2024-03-30T12:38:47.651932+0000","last_clean":"2024-03-30T12:38:47.651932+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:38:47.651932+0000","last_undegraded":"2024-03-30T12:38:47.651932+0000","last_fullsized":"2024-03-30T12:38:47.651932+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3765,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647332+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:37:57.647332+0000","last_peered":"2024-03-30T12:37:57.647332+0000","last_clean":"2024-03-30T12:37:57.647332+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:37:57.647332+0000","last_undegraded":"2024-03-30T12:37:57.647332+0000","last_fullsized":"2024-03-30T12:37:57.647332+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:57.289460+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:38:57.289460+0000","last_peered":"2024-03-30T12:38:57.289460+0000","last_clean":"2024-03-30T12:38:57.289460+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:38:57.289460+0000","last_undegraded":"2024-03-30T12:38:57.289460+0000","last_fullsized":"2024-03-30T12:38:57.289460+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1156,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558186+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:38:19.558186+0000","last_peered":"2024-03-30T12:38:19.558186+0000","last_clean":"2024-03-30T12:38:19.558186+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:38:19.558186+0000","last_undegraded":"2024-03-30T12:38:19.558186+0000","last_fullsized":"2024-03-30T12:38:19.558186+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:15.879792+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:39:15.879792+0000","last_peered":"2024-03-30T12:39:15.879792+0000","last_clean":"2024-03-30T12:39:15.879792+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:39:15.879792+0000","last_undegraded":"2024-03-30T12:39:15.879792+0000","last_fullsized":"2024-03-30T12:39:15.879792+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15594,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:00.301062+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:38:00.301062+0000","last_peered":"2024-03-30T12:38:00.301062+0000","last_clean":"2024-03-30T12:38:00.301062+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:38:00.301062+0000","last_undegraded":"2024-03-30T12:38:00.301062+0000","last_fullsized":"2024-03-30T12:38:00.301062+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.141061+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:38:59.141061+0000","last_peered":"2024-03-30T12:38:59.141061+0000","last_clean":"2024-03-30T12:38:59.141061+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:38:59.141061+0000","last_undegraded":"2024-03-30T12:38:59.141061+0000","last_fullsized":"2024-03-30T12:38:59.141061+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1258,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:12.278399+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:37:12.278399+0000","last_peered":"2024-03-30T12:37:12.278399+0000","last_clean":"2024-03-30T12:37:12.278399+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:37:12.278399+0000","last_undegraded":"2024-03-30T12:37:12.278399+0000","last_fullsized":"2024-03-30T12:37:12.278399+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29020,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:32.280556+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:37:32.280556+0000","last_peered":"2024-03-30T12:37:32.280556+0000","last_clean":"2024-03-30T12:37:32.280556+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:37:32.280556+0000","last_undegraded":"2024-03-30T12:37:32.280556+0000","last_fullsized":"2024-03-30T12:37:32.280556+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906809+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:37:38.906809+0000","last_peered":"2024-03-30T12:37:38.906809+0000","last_clean":"2024-03-30T12:37:38.906809+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:37:38.906809+0000","last_undegraded":"2024-03-30T12:37:38.906809+0000","last_fullsized":"2024-03-30T12:37:38.906809+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651850+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:38:47.651850+0000","last_peered":"2024-03-30T12:38:47.651850+0000","last_clean":"2024-03-30T12:38:47.651850+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:38:47.651850+0000","last_undegraded":"2024-03-30T12:38:47.651850+0000","last_fullsized":"2024-03-30T12:38:47.651850+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5611,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:38.385807+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:38:38.385807+0000","last_peered":"2024-03-30T12:38:38.385807+0000","last_clean":"2024-03-30T12:38:38.385807+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:38:38.385807+0000","last_undegraded":"2024-03-30T12:38:38.385807+0000","last_fullsized":"2024-03-30T12:38:38.385807+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1365,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906835+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:37:38.906835+0000","last_peered":"2024-03-30T12:37:38.906835+0000","last_clean":"2024-03-30T12:37:38.906835+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:37:38.906835+0000","last_undegraded":"2024-03-30T12:37:38.906835+0000","last_fullsized":"2024-03-30T12:37:38.906835+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:57.641061+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:36:57.641061+0000","last_peered":"2024-03-30T12:36:57.641061+0000","last_clean":"2024-03-30T12:36:57.641061+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:36:57.641061+0000","last_undegraded":"2024-03-30T12:36:57.641061+0000","last_fullsized":"2024-03-30T12:36:57.641061+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4275,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:03.909427+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:38:03.909427+0000","last_peered":"2024-03-30T12:38:03.909427+0000","last_clean":"2024-03-30T12:38:03.909427+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:38:03.909427+0000","last_undegraded":"2024-03-30T12:38:03.909427+0000","last_fullsized":"2024-03-30T12:38:03.909427+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.127976+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:37:04.127976+0000","last_peered":"2024-03-30T12:37:04.127976+0000","last_clean":"2024-03-30T12:37:04.127976+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:37:04.127976+0000","last_undegraded":"2024-03-30T12:37:04.127976+0000","last_fullsized":"2024-03-30T12:37:04.127976+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558134+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:38:19.558134+0000","last_peered":"2024-03-30T12:38:19.558134+0000","last_clean":"2024-03-30T12:38:19.558134+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:38:19.558134+0000","last_undegraded":"2024-03-30T12:38:19.558134+0000","last_fullsized":"2024-03-30T12:38:19.558134+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5254,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:38.385765+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:38:38.385765+0000","last_peered":"2024-03-30T12:38:38.385765+0000","last_clean":"2024-03-30T12:38:38.385765+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:38:38.385765+0000","last_undegraded":"2024-03-30T12:38:38.385765+0000","last_fullsized":"2024-03-30T12:38:38.385765+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:38.385797+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:38:38.385797+0000","last_peered":"2024-03-30T12:38:38.385797+0000","last_clean":"2024-03-30T12:38:38.385797+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:38:38.385797+0000","last_undegraded":"2024-03-30T12:38:38.385797+0000","last_fullsized":"2024-03-30T12:38:38.385797+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128016+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:37:04.128016+0000","last_peered":"2024-03-30T12:37:04.128016+0000","last_clean":"2024-03-30T12:37:04.128016+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:37:04.128016+0000","last_undegraded":"2024-03-30T12:37:04.128016+0000","last_fullsized":"2024-03-30T12:37:04.128016+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4811,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:13.383202+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:38:13.383202+0000","last_peered":"2024-03-30T12:38:13.383202+0000","last_clean":"2024-03-30T12:38:13.383202+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:38:13.383202+0000","last_undegraded":"2024-03-30T12:38:13.383202+0000","last_fullsized":"2024-03-30T12:38:13.383202+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:03.909462+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:38:03.909462+0000","last_peered":"2024-03-30T12:38:03.909462+0000","last_clean":"2024-03-30T12:38:03.909462+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:38:03.909462+0000","last_undegraded":"2024-03-30T12:38:03.909462+0000","last_fullsized":"2024-03-30T12:38:03.909462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:00.301034+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:38:00.301034+0000","last_peered":"2024-03-30T12:38:00.301034+0000","last_clean":"2024-03-30T12:38:00.301034+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:38:00.301034+0000","last_undegraded":"2024-03-30T12:38:00.301034+0000","last_fullsized":"2024-03-30T12:38:00.301034+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6744,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:59.141086+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:38:59.141086+0000","last_peered":"2024-03-30T12:38:59.141086+0000","last_clean":"2024-03-30T12:38:59.141086+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:38:59.141086+0000","last_undegraded":"2024-03-30T12:38:59.141086+0000","last_fullsized":"2024-03-30T12:38:59.141086+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1338,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:38.385827+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:38:38.385827+0000","last_peered":"2024-03-30T12:38:38.385827+0000","last_clean":"2024-03-30T12:38:38.385827+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:38:38.385827+0000","last_undegraded":"2024-03-30T12:38:38.385827+0000","last_fullsized":"2024-03-30T12:38:38.385827+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:04.128054+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:37:04.128054+0000","last_peered":"2024-03-30T12:37:04.128054+0000","last_clean":"2024-03-30T12:37:04.128054+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:37:04.128054+0000","last_undegraded":"2024-03-30T12:37:04.128054+0000","last_fullsized":"2024-03-30T12:37:04.128054+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:59.555915+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:37:59.555915+0000","last_peered":"2024-03-30T12:37:59.555915+0000","last_clean":"2024-03-30T12:37:59.555915+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:37:59.555915+0000","last_undegraded":"2024-03-30T12:37:59.555915+0000","last_fullsized":"2024-03-30T12:37:59.555915+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:48.380210+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:37:48.380210+0000","last_peered":"2024-03-30T12:37:48.380210+0000","last_clean":"2024-03-30T12:37:48.380210+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:37:48.380210+0000","last_undegraded":"2024-03-30T12:37:48.380210+0000","last_fullsized":"2024-03-30T12:37:48.380210+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:20.296394+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:37:20.296394+0000","last_peered":"2024-03-30T12:37:20.296394+0000","last_clean":"2024-03-30T12:37:20.296394+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:37:20.296394+0000","last_undegraded":"2024-03-30T12:37:20.296394+0000","last_fullsized":"2024-03-30T12:37:20.296394+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876194+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:38:45.876194+0000","last_peered":"2024-03-30T12:38:45.876194+0000","last_clean":"2024-03-30T12:38:45.876194+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:38:45.876194+0000","last_undegraded":"2024-03-30T12:38:45.876194+0000","last_fullsized":"2024-03-30T12:38:45.876194+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651915+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:38:47.651915+0000","last_peered":"2024-03-30T12:38:47.651915+0000","last_clean":"2024-03-30T12:38:47.651915+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:38:47.651915+0000","last_undegraded":"2024-03-30T12:38:47.651915+0000","last_fullsized":"2024-03-30T12:38:47.651915+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906859+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:37:38.906859+0000","last_peered":"2024-03-30T12:37:38.906859+0000","last_clean":"2024-03-30T12:37:38.906859+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:37:38.906859+0000","last_undegraded":"2024-03-30T12:37:38.906859+0000","last_fullsized":"2024-03-30T12:37:38.906859+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1178,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558174+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:38:19.558174+0000","last_peered":"2024-03-30T12:38:19.558174+0000","last_clean":"2024-03-30T12:38:19.558174+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:38:19.558174+0000","last_undegraded":"2024-03-30T12:38:19.558174+0000","last_fullsized":"2024-03-30T12:38:19.558174+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1282,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651943+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:38:47.651943+0000","last_peered":"2024-03-30T12:38:47.651943+0000","last_clean":"2024-03-30T12:38:47.651943+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:38:47.651943+0000","last_undegraded":"2024-03-30T12:38:47.651943+0000","last_fullsized":"2024-03-30T12:38:47.651943+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:40.298625+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:37:40.298625+0000","last_peered":"2024-03-30T12:37:40.298625+0000","last_clean":"2024-03-30T12:37:40.298625+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:37:40.298625+0000","last_undegraded":"2024-03-30T12:37:40.298625+0000","last_fullsized":"2024-03-30T12:37:40.298625+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:57.641040+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:36:57.641040+0000","last_peered":"2024-03-30T12:36:57.641040+0000","last_clean":"2024-03-30T12:36:57.641040+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:36:57.641040+0000","last_undegraded":"2024-03-30T12:36:57.641040+0000","last_fullsized":"2024-03-30T12:36:57.641040+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1216,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:00.300996+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:38:00.300996+0000","last_peered":"2024-03-30T12:38:00.300996+0000","last_clean":"2024-03-30T12:38:00.300996+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:38:00.300996+0000","last_undegraded":"2024-03-30T12:38:00.300996+0000","last_fullsized":"2024-03-30T12:38:00.300996+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:30.867819+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:37:30.867819+0000","last_peered":"2024-03-30T12:37:30.867819+0000","last_clean":"2024-03-30T12:37:30.867819+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:37:30.867819+0000","last_undegraded":"2024-03-30T12:37:30.867819+0000","last_fullsized":"2024-03-30T12:37:30.867819+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.560418+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:38:39.560418+0000","last_peered":"2024-03-30T12:38:39.560418+0000","last_clean":"2024-03-30T12:38:39.560418+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:38:39.560418+0000","last_undegraded":"2024-03-30T12:38:39.560418+0000","last_fullsized":"2024-03-30T12:38:39.560418+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438086,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648142,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175152,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254391,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063209,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951266,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839323,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923606,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:41:29.026 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:29.026 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:29.026 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:29.026 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:29.026 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:29.026 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:29.026 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:29.026 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:29.026 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:29.026 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:29.026 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:29.027 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:29.027 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:29.027 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:41:29.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:28 smithi084 ceph-mon[89279]: from='client.34662 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:41:29.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:28 smithi084 ceph-mon[91810]: from='client.34662 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:41:29.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:28 smithi162 ceph-mon[83709]: from='client.34662 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:41:29.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:41:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:41:29] "GET /metrics HTTP/1.1" 200 36327 "" "Prometheus/2.43.0" 2024-03-30T12:41:30.252 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:29 smithi084 ceph-mon[91810]: pgmap v1153: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:30.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:29 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:41:30.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:29 smithi084 ceph-mon[89279]: pgmap v1153: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:30.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:29 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:41:30.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:29 smithi162 ceph-mon[83709]: pgmap v1153: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:30.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:29 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:41:31.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:30 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:41:31.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:30 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:41:31.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:30 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:41:31.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:30 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:41:31.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:30 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:41:31.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:30 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:41:31.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:30 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:41:31.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:30 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:41:31.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:30 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:41:31.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:30 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:41:31.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:30 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:41:31.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:30 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:41:32.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:32 smithi162 ceph-mon[83709]: pgmap v1154: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:33.002 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:32 smithi084 ceph-mon[89279]: pgmap v1154: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:33.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:32 smithi084 ceph-mon[91810]: pgmap v1154: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:34.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:34 smithi162 ceph-mon[83709]: pgmap v1155: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:35.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:34 smithi084 ceph-mon[89279]: pgmap v1155: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:35.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:34 smithi084 ceph-mon[91810]: pgmap v1155: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:36.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:36 smithi162 ceph-mon[83709]: pgmap v1156: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:37.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:36 smithi084 ceph-mon[89279]: pgmap v1156: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:37.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:36 smithi084 ceph-mon[91810]: pgmap v1156: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:38.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:38 smithi162 ceph-mon[83709]: pgmap v1157: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:39.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:38 smithi084 ceph-mon[91810]: pgmap v1157: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:39.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:38 smithi084 ceph-mon[89279]: pgmap v1157: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:39.028 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:41:39.246 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:41:39.368 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:41:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:41:39] "GET /metrics HTTP/1.1" 200 36327 "" "Prometheus/2.43.0" 2024-03-30T12:41:40.652 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:40 smithi084 ceph-mon[89279]: pgmap v1158: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:40.738 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:40 smithi084 ceph-mon[91810]: pgmap v1158: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:40.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:40 smithi162 ceph-mon[83709]: pgmap v1158: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:41.229 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:41:41.231 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:41:41.940 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1159,"stamp":"2024-03-30T12:41:40.905997+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004547"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.138971+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:38:39.138971+0000","last_peered":"2024-03-30T12:38:39.138971+0000","last_clean":"2024-03-30T12:38:39.138971+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:38:39.138971+0000","last_undegraded":"2024-03-30T12:38:39.138971+0000","last_fullsized":"2024-03-30T12:38:39.138971+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1365,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917695+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:39:18.917695+0000","last_peered":"2024-03-30T12:39:18.917695+0000","last_clean":"2024-03-30T12:39:18.917695+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:39:18.917695+0000","last_undegraded":"2024-03-30T12:39:18.917695+0000","last_fullsized":"2024-03-30T12:39:18.917695+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876244+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:38:45.876244+0000","last_peered":"2024-03-30T12:38:45.876244+0000","last_clean":"2024-03-30T12:38:45.876244+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:38:45.876244+0000","last_undegraded":"2024-03-30T12:38:45.876244+0000","last_fullsized":"2024-03-30T12:38:45.876244+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308618+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:39:00.308618+0000","last_peered":"2024-03-30T12:39:00.308618+0000","last_clean":"2024-03-30T12:39:00.308618+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:39:00.308618+0000","last_undegraded":"2024-03-30T12:39:00.308618+0000","last_fullsized":"2024-03-30T12:39:00.308618+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133062+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:37:49.133062+0000","last_peered":"2024-03-30T12:37:49.133062+0000","last_clean":"2024-03-30T12:37:49.133062+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:37:49.133062+0000","last_undegraded":"2024-03-30T12:37:49.133062+0000","last_fullsized":"2024-03-30T12:37:49.133062+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1211,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308563+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:39:00.308563+0000","last_peered":"2024-03-30T12:39:00.308563+0000","last_clean":"2024-03-30T12:39:00.308563+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:39:00.308563+0000","last_undegraded":"2024-03-30T12:39:00.308563+0000","last_fullsized":"2024-03-30T12:39:00.308563+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133035+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:37:49.133035+0000","last_peered":"2024-03-30T12:37:49.133035+0000","last_clean":"2024-03-30T12:37:49.133035+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:37:49.133035+0000","last_undegraded":"2024-03-30T12:37:49.133035+0000","last_fullsized":"2024-03-30T12:37:49.133035+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647301+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:37:57.647301+0000","last_peered":"2024-03-30T12:37:57.647301+0000","last_clean":"2024-03-30T12:37:57.647301+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:37:57.647301+0000","last_undegraded":"2024-03-30T12:37:57.647301+0000","last_fullsized":"2024-03-30T12:37:57.647301+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:34.131337+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:37:34.131337+0000","last_peered":"2024-03-30T12:37:34.131337+0000","last_clean":"2024-03-30T12:37:34.131337+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:37:34.131337+0000","last_undegraded":"2024-03-30T12:37:34.131337+0000","last_fullsized":"2024-03-30T12:37:34.131337+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548505+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:36:54.548505+0000","last_peered":"2024-03-30T12:36:54.548505+0000","last_clean":"2024-03-30T12:36:54.548505+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:36:54.548505+0000","last_undegraded":"2024-03-30T12:36:54.548505+0000","last_fullsized":"2024-03-30T12:36:54.548505+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1169,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548476+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:36:54.548476+0000","last_peered":"2024-03-30T12:36:54.548476+0000","last_clean":"2024-03-30T12:36:54.548476+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:36:54.548476+0000","last_undegraded":"2024-03-30T12:36:54.548476+0000","last_fullsized":"2024-03-30T12:36:54.548476+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1271,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:12.285006+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:38:12.285006+0000","last_peered":"2024-03-30T12:38:12.285006+0000","last_clean":"2024-03-30T12:38:12.285006+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:38:12.285006+0000","last_undegraded":"2024-03-30T12:38:12.285006+0000","last_fullsized":"2024-03-30T12:38:12.285006+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645098+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:37:37.645098+0000","last_peered":"2024-03-30T12:37:37.645098+0000","last_clean":"2024-03-30T12:37:37.645098+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:37:37.645098+0000","last_undegraded":"2024-03-30T12:37:37.645098+0000","last_fullsized":"2024-03-30T12:37:37.645098+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870430+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:37:55.870430+0000","last_peered":"2024-03-30T12:37:55.870430+0000","last_clean":"2024-03-30T12:37:55.870430+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:37:55.870430+0000","last_undegraded":"2024-03-30T12:37:55.870430+0000","last_fullsized":"2024-03-30T12:37:55.870430+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:28.912065+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:38:28.912065+0000","last_peered":"2024-03-30T12:38:28.912065+0000","last_clean":"2024-03-30T12:38:28.912065+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:38:28.912065+0000","last_undegraded":"2024-03-30T12:38:28.912065+0000","last_fullsized":"2024-03-30T12:38:28.912065+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303373+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:38:20.303373+0000","last_peered":"2024-03-30T12:38:20.303373+0000","last_clean":"2024-03-30T12:38:20.303373+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:38:20.303373+0000","last_undegraded":"2024-03-30T12:38:20.303373+0000","last_fullsized":"2024-03-30T12:38:20.303373+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1225,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303460+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:38:20.303460+0000","last_peered":"2024-03-30T12:38:20.303460+0000","last_clean":"2024-03-30T12:38:20.303460+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:38:20.303460+0000","last_undegraded":"2024-03-30T12:38:20.303460+0000","last_fullsized":"2024-03-30T12:38:20.303460+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:03.388264+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:39:03.388264+0000","last_peered":"2024-03-30T12:39:03.388264+0000","last_clean":"2024-03-30T12:39:03.388264+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:39:03.388264+0000","last_undegraded":"2024-03-30T12:39:03.388264+0000","last_fullsized":"2024-03-30T12:39:03.388264+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143278+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:39:19.143278+0000","last_peered":"2024-03-30T12:39:19.143278+0000","last_clean":"2024-03-30T12:39:19.143278+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:39:19.143278+0000","last_undegraded":"2024-03-30T12:39:19.143278+0000","last_fullsized":"2024-03-30T12:39:19.143278+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1389,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876285+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:38:45.876285+0000","last_peered":"2024-03-30T12:38:45.876285+0000","last_clean":"2024-03-30T12:38:45.876285+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:38:45.876285+0000","last_undegraded":"2024-03-30T12:38:45.876285+0000","last_fullsized":"2024-03-30T12:38:45.876285+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1283,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647447+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:37:57.647447+0000","last_peered":"2024-03-30T12:37:57.647447+0000","last_clean":"2024-03-30T12:37:57.647447+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:37:57.647447+0000","last_undegraded":"2024-03-30T12:37:57.647447+0000","last_fullsized":"2024-03-30T12:37:57.647447+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1302,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647455+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:37:57.647455+0000","last_peered":"2024-03-30T12:37:57.647455+0000","last_clean":"2024-03-30T12:37:57.647455+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:37:57.647455+0000","last_undegraded":"2024-03-30T12:37:57.647455+0000","last_fullsized":"2024-03-30T12:37:57.647455+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876275+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:38:45.876275+0000","last_peered":"2024-03-30T12:38:45.876275+0000","last_clean":"2024-03-30T12:38:45.876275+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:38:45.876275+0000","last_undegraded":"2024-03-30T12:38:45.876275+0000","last_fullsized":"2024-03-30T12:38:45.876275+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1151,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133095+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:37:49.133095+0000","last_peered":"2024-03-30T12:37:49.133095+0000","last_clean":"2024-03-30T12:37:49.133095+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:37:49.133095+0000","last_undegraded":"2024-03-30T12:37:49.133095+0000","last_fullsized":"2024-03-30T12:37:49.133095+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1230,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308632+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:39:00.308632+0000","last_peered":"2024-03-30T12:39:00.308632+0000","last_clean":"2024-03-30T12:39:00.308632+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:39:00.308632+0000","last_undegraded":"2024-03-30T12:39:00.308632+0000","last_fullsized":"2024-03-30T12:39:00.308632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133077+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:37:49.133077+0000","last_peered":"2024-03-30T12:37:49.133077+0000","last_clean":"2024-03-30T12:37:49.133077+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:37:49.133077+0000","last_undegraded":"2024-03-30T12:37:49.133077+0000","last_fullsized":"2024-03-30T12:37:49.133077+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308643+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:39:00.308643+0000","last_peered":"2024-03-30T12:39:00.308643+0000","last_clean":"2024-03-30T12:39:00.308643+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:39:00.308643+0000","last_undegraded":"2024-03-30T12:39:00.308643+0000","last_fullsized":"2024-03-30T12:39:00.308643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647433+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:37:57.647433+0000","last_peered":"2024-03-30T12:37:57.647433+0000","last_clean":"2024-03-30T12:37:57.647433+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:37:57.647433+0000","last_undegraded":"2024-03-30T12:37:57.647433+0000","last_fullsized":"2024-03-30T12:37:57.647433+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1263,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:32.286955+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:38:32.286955+0000","last_peered":"2024-03-30T12:38:32.286955+0000","last_clean":"2024-03-30T12:38:32.286955+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:38:32.286955+0000","last_undegraded":"2024-03-30T12:38:32.286955+0000","last_fullsized":"2024-03-30T12:38:32.286955+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1180,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:09.550388+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:37:09.550388+0000","last_peered":"2024-03-30T12:37:09.550388+0000","last_clean":"2024-03-30T12:37:09.550388+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:37:09.550388+0000","last_undegraded":"2024-03-30T12:37:09.550388+0000","last_fullsized":"2024-03-30T12:37:09.550388+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876233+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:38:45.876233+0000","last_peered":"2024-03-30T12:38:45.876233+0000","last_clean":"2024-03-30T12:38:45.876233+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:38:45.876233+0000","last_undegraded":"2024-03-30T12:38:45.876233+0000","last_fullsized":"2024-03-30T12:38:45.876233+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645072+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:37:37.645072+0000","last_peered":"2024-03-30T12:37:37.645072+0000","last_clean":"2024-03-30T12:37:37.645072+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:37:37.645072+0000","last_undegraded":"2024-03-30T12:37:37.645072+0000","last_fullsized":"2024-03-30T12:37:37.645072+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645031+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:37:37.645031+0000","last_peered":"2024-03-30T12:37:37.645031+0000","last_clean":"2024-03-30T12:37:37.645031+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:37:37.645031+0000","last_undegraded":"2024-03-30T12:37:37.645031+0000","last_fullsized":"2024-03-30T12:37:37.645031+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1225,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306130+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:38:40.306130+0000","last_peered":"2024-03-30T12:38:40.306130+0000","last_clean":"2024-03-30T12:38:40.306130+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:38:40.306130+0000","last_undegraded":"2024-03-30T12:38:40.306130+0000","last_fullsized":"2024-03-30T12:38:40.306130+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:53.914730+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:38:53.914730+0000","last_peered":"2024-03-30T12:38:53.914730+0000","last_clean":"2024-03-30T12:38:53.914730+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:38:53.914730+0000","last_undegraded":"2024-03-30T12:38:53.914730+0000","last_fullsized":"2024-03-30T12:38:53.914730+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:36:54.548518+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:36:54.548518+0000","last_peered":"2024-03-30T12:36:54.548518+0000","last_clean":"2024-03-30T12:36:54.548518+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:36:54.548518+0000","last_undegraded":"2024-03-30T12:36:54.548518+0000","last_fullsized":"2024-03-30T12:36:54.548518+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306212+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:38:40.306212+0000","last_peered":"2024-03-30T12:38:40.306212+0000","last_clean":"2024-03-30T12:38:40.306212+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:38:40.306212+0000","last_undegraded":"2024-03-30T12:38:40.306212+0000","last_fullsized":"2024-03-30T12:38:40.306212+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1199,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306200+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:38:40.306200+0000","last_peered":"2024-03-30T12:38:40.306200+0000","last_clean":"2024-03-30T12:38:40.306200+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:38:40.306200+0000","last_undegraded":"2024-03-30T12:38:40.306200+0000","last_fullsized":"2024-03-30T12:38:40.306200+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:03.374890+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:37:03.374890+0000","last_peered":"2024-03-30T12:37:03.374890+0000","last_clean":"2024-03-30T12:37:03.374890+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:37:03.374890+0000","last_undegraded":"2024-03-30T12:37:03.374890+0000","last_fullsized":"2024-03-30T12:37:03.374890+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:53.914770+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:38:53.914770+0000","last_peered":"2024-03-30T12:38:53.914770+0000","last_clean":"2024-03-30T12:38:53.914770+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:38:53.914770+0000","last_undegraded":"2024-03-30T12:38:53.914770+0000","last_fullsized":"2024-03-30T12:38:53.914770+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:52.282667+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:37:52.282667+0000","last_peered":"2024-03-30T12:37:52.282667+0000","last_clean":"2024-03-30T12:37:52.282667+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:37:52.282667+0000","last_undegraded":"2024-03-30T12:37:52.282667+0000","last_fullsized":"2024-03-30T12:37:52.282667+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562847+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:38:59.562847+0000","last_peered":"2024-03-30T12:38:59.562847+0000","last_clean":"2024-03-30T12:38:59.562847+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:38:59.562847+0000","last_undegraded":"2024-03-30T12:38:59.562847+0000","last_fullsized":"2024-03-30T12:38:59.562847+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:34.131303+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:37:34.131303+0000","last_peered":"2024-03-30T12:37:34.131303+0000","last_clean":"2024-03-30T12:37:34.131303+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:37:34.131303+0000","last_undegraded":"2024-03-30T12:37:34.131303+0000","last_fullsized":"2024-03-30T12:37:34.131303+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1384,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870514+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:37:55.870514+0000","last_peered":"2024-03-30T12:37:55.870514+0000","last_clean":"2024-03-30T12:37:55.870514+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:37:55.870514+0000","last_undegraded":"2024-03-30T12:37:55.870514+0000","last_fullsized":"2024-03-30T12:37:55.870514+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870486+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:37:55.870486+0000","last_peered":"2024-03-30T12:37:55.870486+0000","last_clean":"2024-03-30T12:37:55.870486+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:37:55.870486+0000","last_undegraded":"2024-03-30T12:37:55.870486+0000","last_fullsized":"2024-03-30T12:37:55.870486+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303405+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:38:20.303405+0000","last_peered":"2024-03-30T12:38:20.303405+0000","last_clean":"2024-03-30T12:38:20.303405+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:38:20.303405+0000","last_undegraded":"2024-03-30T12:38:20.303405+0000","last_fullsized":"2024-03-30T12:38:20.303405+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:19.129793+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:37:19.129793+0000","last_peered":"2024-03-30T12:37:19.129793+0000","last_clean":"2024-03-30T12:37:19.129793+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:37:19.129793+0000","last_undegraded":"2024-03-30T12:37:19.129793+0000","last_fullsized":"2024-03-30T12:37:19.129793+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562815+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:38:59.562815+0000","last_peered":"2024-03-30T12:38:59.562815+0000","last_clean":"2024-03-30T12:38:59.562815+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:38:59.562815+0000","last_undegraded":"2024-03-30T12:38:59.562815+0000","last_fullsized":"2024-03-30T12:38:59.562815+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562788+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:38:59.562788+0000","last_peered":"2024-03-30T12:38:59.562788+0000","last_clean":"2024-03-30T12:38:59.562788+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:38:59.562788+0000","last_undegraded":"2024-03-30T12:38:59.562788+0000","last_fullsized":"2024-03-30T12:38:59.562788+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:03.388191+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:39:03.388191+0000","last_peered":"2024-03-30T12:39:03.388191+0000","last_clean":"2024-03-30T12:39:03.388191+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:39:03.388191+0000","last_undegraded":"2024-03-30T12:39:03.388191+0000","last_fullsized":"2024-03-30T12:39:03.388191+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:19.129759+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:37:19.129759+0000","last_peered":"2024-03-30T12:37:19.129759+0000","last_clean":"2024-03-30T12:37:19.129759+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:37:19.129759+0000","last_undegraded":"2024-03-30T12:37:19.129759+0000","last_fullsized":"2024-03-30T12:37:19.129759+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5753,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:13.383127+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:38:13.383127+0000","last_peered":"2024-03-30T12:38:13.383127+0000","last_clean":"2024-03-30T12:38:13.383127+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:38:13.383127+0000","last_undegraded":"2024-03-30T12:38:13.383127+0000","last_fullsized":"2024-03-30T12:38:13.383127+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1275,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:32.280622+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:37:32.280622+0000","last_peered":"2024-03-30T12:37:32.280622+0000","last_clean":"2024-03-30T12:37:32.280622+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:37:32.280622+0000","last_undegraded":"2024-03-30T12:37:32.280622+0000","last_fullsized":"2024-03-30T12:37:32.280622+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143289+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:39:19.143289+0000","last_peered":"2024-03-30T12:39:19.143289+0000","last_clean":"2024-03-30T12:39:19.143289+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:39:19.143289+0000","last_undegraded":"2024-03-30T12:39:19.143289+0000","last_fullsized":"2024-03-30T12:39:19.143289+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5514,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:45.876204+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:38:45.876204+0000","last_peered":"2024-03-30T12:38:45.876204+0000","last_clean":"2024-03-30T12:38:45.876204+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:38:45.876204+0000","last_undegraded":"2024-03-30T12:38:45.876204+0000","last_fullsized":"2024-03-30T12:38:45.876204+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917640+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:39:18.917640+0000","last_peered":"2024-03-30T12:39:18.917640+0000","last_clean":"2024-03-30T12:39:18.917640+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:39:18.917640+0000","last_undegraded":"2024-03-30T12:39:18.917640+0000","last_fullsized":"2024-03-30T12:39:18.917640+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917662+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:39:18.917662+0000","last_peered":"2024-03-30T12:39:18.917662+0000","last_clean":"2024-03-30T12:39:18.917662+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:39:18.917662+0000","last_undegraded":"2024-03-30T12:39:18.917662+0000","last_fullsized":"2024-03-30T12:39:18.917662+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311465+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:39:25.311465+0000","last_peered":"2024-03-30T12:39:25.311465+0000","last_clean":"2024-03-30T12:39:25.311465+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:39:25.311465+0000","last_undegraded":"2024-03-30T12:39:25.311465+0000","last_fullsized":"2024-03-30T12:39:25.311465+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5459,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:45.876257+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:38:45.876257+0000","last_peered":"2024-03-30T12:38:45.876257+0000","last_clean":"2024-03-30T12:38:45.876257+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:38:45.876257+0000","last_undegraded":"2024-03-30T12:38:45.876257+0000","last_fullsized":"2024-03-30T12:38:45.876257+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917672+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:39:18.917672+0000","last_peered":"2024-03-30T12:39:18.917672+0000","last_clean":"2024-03-30T12:39:18.917672+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:39:18.917672+0000","last_undegraded":"2024-03-30T12:39:18.917672+0000","last_fullsized":"2024-03-30T12:39:18.917672+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1208,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311386+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:39:25.311386+0000","last_peered":"2024-03-30T12:39:25.311386+0000","last_clean":"2024-03-30T12:39:25.311386+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:39:25.311386+0000","last_undegraded":"2024-03-30T12:39:25.311386+0000","last_fullsized":"2024-03-30T12:39:25.311386+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:57.289543+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:38:57.289543+0000","last_peered":"2024-03-30T12:38:57.289543+0000","last_clean":"2024-03-30T12:38:57.289543+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:38:57.289543+0000","last_undegraded":"2024-03-30T12:38:57.289543+0000","last_fullsized":"2024-03-30T12:38:57.289543+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3804,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:13.383237+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:38:13.383237+0000","last_peered":"2024-03-30T12:38:13.383237+0000","last_clean":"2024-03-30T12:38:13.383237+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:38:13.383237+0000","last_undegraded":"2024-03-30T12:38:13.383237+0000","last_fullsized":"2024-03-30T12:38:13.383237+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1343,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906884+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:37:38.906884+0000","last_peered":"2024-03-30T12:37:38.906884+0000","last_clean":"2024-03-30T12:37:38.906884+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:37:38.906884+0000","last_undegraded":"2024-03-30T12:37:38.906884+0000","last_fullsized":"2024-03-30T12:37:38.906884+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:48.914183+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:38:48.914183+0000","last_peered":"2024-03-30T12:38:48.914183+0000","last_clean":"2024-03-30T12:38:48.914183+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:38:48.914183+0000","last_undegraded":"2024-03-30T12:38:48.914183+0000","last_fullsized":"2024-03-30T12:38:48.914183+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:48.380185+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:37:48.380185+0000","last_peered":"2024-03-30T12:37:48.380185+0000","last_clean":"2024-03-30T12:37:48.380185+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:37:48.380185+0000","last_undegraded":"2024-03-30T12:37:48.380185+0000","last_fullsized":"2024-03-30T12:37:48.380185+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4577,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:39.138875+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:38:39.138875+0000","last_peered":"2024-03-30T12:38:39.138875+0000","last_clean":"2024-03-30T12:38:39.138875+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:38:39.138875+0000","last_undegraded":"2024-03-30T12:38:39.138875+0000","last_fullsized":"2024-03-30T12:38:39.138875+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1175,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:59.555994+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:37:59.555994+0000","last_peered":"2024-03-30T12:37:59.555994+0000","last_clean":"2024-03-30T12:37:59.555994+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:37:59.555994+0000","last_undegraded":"2024-03-30T12:37:59.555994+0000","last_fullsized":"2024-03-30T12:37:59.555994+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:22.649643+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:38:22.649643+0000","last_peered":"2024-03-30T12:38:22.649643+0000","last_clean":"2024-03-30T12:38:22.649643+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:38:22.649643+0000","last_undegraded":"2024-03-30T12:38:22.649643+0000","last_fullsized":"2024-03-30T12:38:22.649643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1201,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311442+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:39:25.311442+0000","last_peered":"2024-03-30T12:39:25.311442+0000","last_clean":"2024-03-30T12:39:25.311442+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:39:25.311442+0000","last_undegraded":"2024-03-30T12:39:25.311442+0000","last_fullsized":"2024-03-30T12:39:25.311442+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1717,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.136726+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:38:19.136726+0000","last_peered":"2024-03-30T12:38:19.136726+0000","last_clean":"2024-03-30T12:38:19.136726+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:38:19.136726+0000","last_undegraded":"2024-03-30T12:38:19.136726+0000","last_fullsized":"2024-03-30T12:38:19.136726+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24714,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:40.298683+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:37:40.298683+0000","last_peered":"2024-03-30T12:37:40.298683+0000","last_clean":"2024-03-30T12:37:40.298683+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:37:40.298683+0000","last_undegraded":"2024-03-30T12:37:40.298683+0000","last_fullsized":"2024-03-30T12:37:40.298683+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:15.879816+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:39:15.879816+0000","last_peered":"2024-03-30T12:39:15.879816+0000","last_clean":"2024-03-30T12:39:15.879816+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:39:15.879816+0000","last_undegraded":"2024-03-30T12:39:15.879816+0000","last_fullsized":"2024-03-30T12:39:15.879816+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876163+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:38:45.876163+0000","last_peered":"2024-03-30T12:38:45.876163+0000","last_clean":"2024-03-30T12:38:45.876163+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:38:45.876163+0000","last_undegraded":"2024-03-30T12:38:45.876163+0000","last_fullsized":"2024-03-30T12:38:45.876163+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.136697+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:38:19.136697+0000","last_peered":"2024-03-30T12:38:19.136697+0000","last_clean":"2024-03-30T12:38:19.136697+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:38:19.136697+0000","last_undegraded":"2024-03-30T12:38:19.136697+0000","last_fullsized":"2024-03-30T12:38:19.136697+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16481,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:59.555949+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:37:59.555949+0000","last_peered":"2024-03-30T12:37:59.555949+0000","last_clean":"2024-03-30T12:37:59.555949+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:37:59.555949+0000","last_undegraded":"2024-03-30T12:37:59.555949+0000","last_fullsized":"2024-03-30T12:37:59.555949+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876223+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:38:45.876223+0000","last_peered":"2024-03-30T12:38:45.876223+0000","last_clean":"2024-03-30T12:38:45.876223+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:38:45.876223+0000","last_undegraded":"2024-03-30T12:38:45.876223+0000","last_fullsized":"2024-03-30T12:38:45.876223+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1164,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.138928+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:38:39.138928+0000","last_peered":"2024-03-30T12:38:39.138928+0000","last_clean":"2024-03-30T12:38:39.138928+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:38:39.138928+0000","last_undegraded":"2024-03-30T12:38:39.138928+0000","last_fullsized":"2024-03-30T12:38:39.138928+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917681+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:39:18.917681+0000","last_peered":"2024-03-30T12:39:18.917681+0000","last_clean":"2024-03-30T12:39:18.917681+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:39:18.917681+0000","last_undegraded":"2024-03-30T12:39:18.917681+0000","last_fullsized":"2024-03-30T12:39:18.917681+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31270,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:57.289492+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:38:57.289492+0000","last_peered":"2024-03-30T12:38:57.289492+0000","last_clean":"2024-03-30T12:38:57.289492+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:38:57.289492+0000","last_undegraded":"2024-03-30T12:38:57.289492+0000","last_fullsized":"2024-03-30T12:38:57.289492+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647394+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:37:57.647394+0000","last_peered":"2024-03-30T12:37:57.647394+0000","last_clean":"2024-03-30T12:37:57.647394+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:37:57.647394+0000","last_undegraded":"2024-03-30T12:37:57.647394+0000","last_fullsized":"2024-03-30T12:37:57.647394+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906874+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:37:38.906874+0000","last_peered":"2024-03-30T12:37:38.906874+0000","last_clean":"2024-03-30T12:37:38.906874+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:37:38.906874+0000","last_undegraded":"2024-03-30T12:37:38.906874+0000","last_fullsized":"2024-03-30T12:37:38.906874+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651932+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:38:47.651932+0000","last_peered":"2024-03-30T12:38:47.651932+0000","last_clean":"2024-03-30T12:38:47.651932+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:38:47.651932+0000","last_undegraded":"2024-03-30T12:38:47.651932+0000","last_fullsized":"2024-03-30T12:38:47.651932+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3765,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647332+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:37:57.647332+0000","last_peered":"2024-03-30T12:37:57.647332+0000","last_clean":"2024-03-30T12:37:57.647332+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:37:57.647332+0000","last_undegraded":"2024-03-30T12:37:57.647332+0000","last_fullsized":"2024-03-30T12:37:57.647332+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:57.289460+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:38:57.289460+0000","last_peered":"2024-03-30T12:38:57.289460+0000","last_clean":"2024-03-30T12:38:57.289460+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:38:57.289460+0000","last_undegraded":"2024-03-30T12:38:57.289460+0000","last_fullsized":"2024-03-30T12:38:57.289460+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1156,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558186+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:38:19.558186+0000","last_peered":"2024-03-30T12:38:19.558186+0000","last_clean":"2024-03-30T12:38:19.558186+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:38:19.558186+0000","last_undegraded":"2024-03-30T12:38:19.558186+0000","last_fullsized":"2024-03-30T12:38:19.558186+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:15.879792+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:39:15.879792+0000","last_peered":"2024-03-30T12:39:15.879792+0000","last_clean":"2024-03-30T12:39:15.879792+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:39:15.879792+0000","last_undegraded":"2024-03-30T12:39:15.879792+0000","last_fullsized":"2024-03-30T12:39:15.879792+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15594,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:00.301062+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:38:00.301062+0000","last_peered":"2024-03-30T12:38:00.301062+0000","last_clean":"2024-03-30T12:38:00.301062+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:38:00.301062+0000","last_undegraded":"2024-03-30T12:38:00.301062+0000","last_fullsized":"2024-03-30T12:38:00.301062+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.141061+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:38:59.141061+0000","last_peered":"2024-03-30T12:38:59.141061+0000","last_clean":"2024-03-30T12:38:59.141061+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:38:59.141061+0000","last_undegraded":"2024-03-30T12:38:59.141061+0000","last_fullsized":"2024-03-30T12:38:59.141061+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:22.292071+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:39:22.292071+0000","last_peered":"2024-03-30T12:39:22.292071+0000","last_clean":"2024-03-30T12:39:22.292071+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:39:22.292071+0000","last_undegraded":"2024-03-30T12:39:22.292071+0000","last_fullsized":"2024-03-30T12:39:22.292071+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29020,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:32.280556+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:37:32.280556+0000","last_peered":"2024-03-30T12:37:32.280556+0000","last_clean":"2024-03-30T12:37:32.280556+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:37:32.280556+0000","last_undegraded":"2024-03-30T12:37:32.280556+0000","last_fullsized":"2024-03-30T12:37:32.280556+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906809+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:37:38.906809+0000","last_peered":"2024-03-30T12:37:38.906809+0000","last_clean":"2024-03-30T12:37:38.906809+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:37:38.906809+0000","last_undegraded":"2024-03-30T12:37:38.906809+0000","last_fullsized":"2024-03-30T12:37:38.906809+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651850+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:38:47.651850+0000","last_peered":"2024-03-30T12:38:47.651850+0000","last_clean":"2024-03-30T12:38:47.651850+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:38:47.651850+0000","last_undegraded":"2024-03-30T12:38:47.651850+0000","last_fullsized":"2024-03-30T12:38:47.651850+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5611,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:38.385807+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:38:38.385807+0000","last_peered":"2024-03-30T12:38:38.385807+0000","last_clean":"2024-03-30T12:38:38.385807+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:38:38.385807+0000","last_undegraded":"2024-03-30T12:38:38.385807+0000","last_fullsized":"2024-03-30T12:38:38.385807+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1365,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906835+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:37:38.906835+0000","last_peered":"2024-03-30T12:37:38.906835+0000","last_clean":"2024-03-30T12:37:38.906835+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:37:38.906835+0000","last_undegraded":"2024-03-30T12:37:38.906835+0000","last_fullsized":"2024-03-30T12:37:38.906835+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:12.654884+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:39:12.654884+0000","last_peered":"2024-03-30T12:39:12.654884+0000","last_clean":"2024-03-30T12:39:12.654884+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:39:12.654884+0000","last_undegraded":"2024-03-30T12:39:12.654884+0000","last_fullsized":"2024-03-30T12:39:12.654884+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4275,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:03.909427+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:38:03.909427+0000","last_peered":"2024-03-30T12:38:03.909427+0000","last_clean":"2024-03-30T12:38:03.909427+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:38:03.909427+0000","last_undegraded":"2024-03-30T12:38:03.909427+0000","last_fullsized":"2024-03-30T12:38:03.909427+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143221+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:39:19.143221+0000","last_peered":"2024-03-30T12:39:19.143221+0000","last_clean":"2024-03-30T12:39:19.143221+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:39:19.143221+0000","last_undegraded":"2024-03-30T12:39:19.143221+0000","last_fullsized":"2024-03-30T12:39:19.143221+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558134+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:38:19.558134+0000","last_peered":"2024-03-30T12:38:19.558134+0000","last_clean":"2024-03-30T12:38:19.558134+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:38:19.558134+0000","last_undegraded":"2024-03-30T12:38:19.558134+0000","last_fullsized":"2024-03-30T12:38:19.558134+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5254,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:38.385765+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:38:38.385765+0000","last_peered":"2024-03-30T12:38:38.385765+0000","last_clean":"2024-03-30T12:38:38.385765+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:38:38.385765+0000","last_undegraded":"2024-03-30T12:38:38.385765+0000","last_fullsized":"2024-03-30T12:38:38.385765+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:38.385797+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:38:38.385797+0000","last_peered":"2024-03-30T12:38:38.385797+0000","last_clean":"2024-03-30T12:38:38.385797+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:38:38.385797+0000","last_undegraded":"2024-03-30T12:38:38.385797+0000","last_fullsized":"2024-03-30T12:38:38.385797+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143264+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:39:19.143264+0000","last_peered":"2024-03-30T12:39:19.143264+0000","last_clean":"2024-03-30T12:39:19.143264+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:39:19.143264+0000","last_undegraded":"2024-03-30T12:39:19.143264+0000","last_fullsized":"2024-03-30T12:39:19.143264+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4811,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:13.383202+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:38:13.383202+0000","last_peered":"2024-03-30T12:38:13.383202+0000","last_clean":"2024-03-30T12:38:13.383202+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:38:13.383202+0000","last_undegraded":"2024-03-30T12:38:13.383202+0000","last_fullsized":"2024-03-30T12:38:13.383202+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:03.909462+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:38:03.909462+0000","last_peered":"2024-03-30T12:38:03.909462+0000","last_clean":"2024-03-30T12:38:03.909462+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:38:03.909462+0000","last_undegraded":"2024-03-30T12:38:03.909462+0000","last_fullsized":"2024-03-30T12:38:03.909462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:00.301034+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:38:00.301034+0000","last_peered":"2024-03-30T12:38:00.301034+0000","last_clean":"2024-03-30T12:38:00.301034+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:38:00.301034+0000","last_undegraded":"2024-03-30T12:38:00.301034+0000","last_fullsized":"2024-03-30T12:38:00.301034+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6744,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:59.141086+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:38:59.141086+0000","last_peered":"2024-03-30T12:38:59.141086+0000","last_clean":"2024-03-30T12:38:59.141086+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:38:59.141086+0000","last_undegraded":"2024-03-30T12:38:59.141086+0000","last_fullsized":"2024-03-30T12:38:59.141086+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1338,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:38.385827+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:38:38.385827+0000","last_peered":"2024-03-30T12:38:38.385827+0000","last_clean":"2024-03-30T12:38:38.385827+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:38:38.385827+0000","last_undegraded":"2024-03-30T12:38:38.385827+0000","last_fullsized":"2024-03-30T12:38:38.385827+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143303+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:39:19.143303+0000","last_peered":"2024-03-30T12:39:19.143303+0000","last_clean":"2024-03-30T12:39:19.143303+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:39:19.143303+0000","last_undegraded":"2024-03-30T12:39:19.143303+0000","last_fullsized":"2024-03-30T12:39:19.143303+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:59.555915+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:37:59.555915+0000","last_peered":"2024-03-30T12:37:59.555915+0000","last_clean":"2024-03-30T12:37:59.555915+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:37:59.555915+0000","last_undegraded":"2024-03-30T12:37:59.555915+0000","last_fullsized":"2024-03-30T12:37:59.555915+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:48.380210+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:37:48.380210+0000","last_peered":"2024-03-30T12:37:48.380210+0000","last_clean":"2024-03-30T12:37:48.380210+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:37:48.380210+0000","last_undegraded":"2024-03-30T12:37:48.380210+0000","last_fullsized":"2024-03-30T12:37:48.380210+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311414+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:39:25.311414+0000","last_peered":"2024-03-30T12:39:25.311414+0000","last_clean":"2024-03-30T12:39:25.311414+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:39:25.311414+0000","last_undegraded":"2024-03-30T12:39:25.311414+0000","last_fullsized":"2024-03-30T12:39:25.311414+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876194+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:38:45.876194+0000","last_peered":"2024-03-30T12:38:45.876194+0000","last_clean":"2024-03-30T12:38:45.876194+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:38:45.876194+0000","last_undegraded":"2024-03-30T12:38:45.876194+0000","last_fullsized":"2024-03-30T12:38:45.876194+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651915+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:38:47.651915+0000","last_peered":"2024-03-30T12:38:47.651915+0000","last_clean":"2024-03-30T12:38:47.651915+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:38:47.651915+0000","last_undegraded":"2024-03-30T12:38:47.651915+0000","last_fullsized":"2024-03-30T12:38:47.651915+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906859+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:37:38.906859+0000","last_peered":"2024-03-30T12:37:38.906859+0000","last_clean":"2024-03-30T12:37:38.906859+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:37:38.906859+0000","last_undegraded":"2024-03-30T12:37:38.906859+0000","last_fullsized":"2024-03-30T12:37:38.906859+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1178,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558174+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:38:19.558174+0000","last_peered":"2024-03-30T12:38:19.558174+0000","last_clean":"2024-03-30T12:38:19.558174+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:38:19.558174+0000","last_undegraded":"2024-03-30T12:38:19.558174+0000","last_fullsized":"2024-03-30T12:38:19.558174+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1282,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651943+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:38:47.651943+0000","last_peered":"2024-03-30T12:38:47.651943+0000","last_clean":"2024-03-30T12:38:47.651943+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:38:47.651943+0000","last_undegraded":"2024-03-30T12:38:47.651943+0000","last_fullsized":"2024-03-30T12:38:47.651943+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:40.298625+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:37:40.298625+0000","last_peered":"2024-03-30T12:37:40.298625+0000","last_clean":"2024-03-30T12:37:40.298625+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:37:40.298625+0000","last_undegraded":"2024-03-30T12:37:40.298625+0000","last_fullsized":"2024-03-30T12:37:40.298625+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:12.654857+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:39:12.654857+0000","last_peered":"2024-03-30T12:39:12.654857+0000","last_clean":"2024-03-30T12:39:12.654857+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:39:12.654857+0000","last_undegraded":"2024-03-30T12:39:12.654857+0000","last_fullsized":"2024-03-30T12:39:12.654857+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1216,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:00.300996+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:38:00.300996+0000","last_peered":"2024-03-30T12:38:00.300996+0000","last_clean":"2024-03-30T12:38:00.300996+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:38:00.300996+0000","last_undegraded":"2024-03-30T12:38:00.300996+0000","last_fullsized":"2024-03-30T12:38:00.300996+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:30.867819+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:37:30.867819+0000","last_peered":"2024-03-30T12:37:30.867819+0000","last_clean":"2024-03-30T12:37:30.867819+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:37:30.867819+0000","last_undegraded":"2024-03-30T12:37:30.867819+0000","last_fullsized":"2024-03-30T12:37:30.867819+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.560418+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:38:39.560418+0000","last_peered":"2024-03-30T12:38:39.560418+0000","last_clean":"2024-03-30T12:38:39.560418+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:38:39.560418+0000","last_undegraded":"2024-03-30T12:38:39.560418+0000","last_fullsized":"2024-03-30T12:38:39.560418+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438089,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648145,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175155,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254394,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063212,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951269,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839326,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923609,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:41:41.947 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:41.947 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:41.947 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:41.947 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:41.947 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:41.947 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:41.948 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:41.948 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:41.948 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:41.948 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:41.948 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:41.948 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:41.948 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:41.948 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:41:42.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:42 smithi162 ceph-mon[83709]: pgmap v1159: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:42.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:42 smithi162 ceph-mon[83709]: from='client.34668 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:41:43.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:42 smithi084 ceph-mon[89279]: pgmap v1159: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:43.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:42 smithi084 ceph-mon[89279]: from='client.34668 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:41:43.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:42 smithi084 ceph-mon[91810]: pgmap v1159: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:43.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:42 smithi084 ceph-mon[91810]: from='client.34668 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:41:44.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:44 smithi162 ceph-mon[83709]: pgmap v1160: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:45.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:44 smithi084 ceph-mon[89279]: pgmap v1160: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:45.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:44 smithi084 ceph-mon[91810]: pgmap v1160: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:45.869 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:41:46.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:41:46.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:41:47.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:46 smithi162 ceph-mon[83709]: pgmap v1161: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:47.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:46 smithi084 ceph-mon[91810]: pgmap v1161: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:47.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:46 smithi084 ceph-mon[89279]: pgmap v1161: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:49.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:48 smithi162 ceph-mon[83709]: pgmap v1162: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:49.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:48 smithi084 ceph-mon[91810]: pgmap v1162: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:49.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:48 smithi084 ceph-mon[89279]: pgmap v1162: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:49.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:41:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:41:49] "GET /metrics HTTP/1.1" 200 36325 "" "Prometheus/2.43.0" 2024-03-30T12:41:51.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:50 smithi162 ceph-mon[83709]: pgmap v1163: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:51.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:50 smithi084 ceph-mon[89279]: pgmap v1163: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:51.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:50 smithi084 ceph-mon[91810]: pgmap v1163: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:51.949 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:41:52.161 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:41:53.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:52 smithi084 ceph-mon[91810]: pgmap v1164: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:53.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:52 smithi084 ceph-mon[89279]: pgmap v1164: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:53.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:52 smithi162 ceph-mon[83709]: pgmap v1164: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:54.098 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:41:54.101 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:41:54.746 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1165,"stamp":"2024-03-30T12:41:52.909561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003563"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.138971+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:38:39.138971+0000","last_peered":"2024-03-30T12:38:39.138971+0000","last_clean":"2024-03-30T12:38:39.138971+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:38:39.138971+0000","last_undegraded":"2024-03-30T12:38:39.138971+0000","last_fullsized":"2024-03-30T12:38:39.138971+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1365,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917695+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:39:18.917695+0000","last_peered":"2024-03-30T12:39:18.917695+0000","last_clean":"2024-03-30T12:39:18.917695+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:39:18.917695+0000","last_undegraded":"2024-03-30T12:39:18.917695+0000","last_fullsized":"2024-03-30T12:39:18.917695+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876244+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:38:45.876244+0000","last_peered":"2024-03-30T12:38:45.876244+0000","last_clean":"2024-03-30T12:38:45.876244+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:38:45.876244+0000","last_undegraded":"2024-03-30T12:38:45.876244+0000","last_fullsized":"2024-03-30T12:38:45.876244+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308618+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:39:00.308618+0000","last_peered":"2024-03-30T12:39:00.308618+0000","last_clean":"2024-03-30T12:39:00.308618+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:39:00.308618+0000","last_undegraded":"2024-03-30T12:39:00.308618+0000","last_fullsized":"2024-03-30T12:39:00.308618+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133062+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:37:49.133062+0000","last_peered":"2024-03-30T12:37:49.133062+0000","last_clean":"2024-03-30T12:37:49.133062+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:37:49.133062+0000","last_undegraded":"2024-03-30T12:37:49.133062+0000","last_fullsized":"2024-03-30T12:37:49.133062+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1211,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308563+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:39:00.308563+0000","last_peered":"2024-03-30T12:39:00.308563+0000","last_clean":"2024-03-30T12:39:00.308563+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:39:00.308563+0000","last_undegraded":"2024-03-30T12:39:00.308563+0000","last_fullsized":"2024-03-30T12:39:00.308563+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133035+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:37:49.133035+0000","last_peered":"2024-03-30T12:37:49.133035+0000","last_clean":"2024-03-30T12:37:49.133035+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:37:49.133035+0000","last_undegraded":"2024-03-30T12:37:49.133035+0000","last_fullsized":"2024-03-30T12:37:49.133035+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647301+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:37:57.647301+0000","last_peered":"2024-03-30T12:37:57.647301+0000","last_clean":"2024-03-30T12:37:57.647301+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:37:57.647301+0000","last_undegraded":"2024-03-30T12:37:57.647301+0000","last_fullsized":"2024-03-30T12:37:57.647301+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:34.131337+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:37:34.131337+0000","last_peered":"2024-03-30T12:37:34.131337+0000","last_clean":"2024-03-30T12:37:34.131337+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:37:34.131337+0000","last_undegraded":"2024-03-30T12:37:34.131337+0000","last_fullsized":"2024-03-30T12:37:34.131337+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565540+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:39:19.565540+0000","last_peered":"2024-03-30T12:39:19.565540+0000","last_clean":"2024-03-30T12:39:19.565540+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:39:19.565540+0000","last_undegraded":"2024-03-30T12:39:19.565540+0000","last_fullsized":"2024-03-30T12:39:19.565540+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565513+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:39:19.565513+0000","last_peered":"2024-03-30T12:39:19.565513+0000","last_clean":"2024-03-30T12:39:19.565513+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:39:19.565513+0000","last_undegraded":"2024-03-30T12:39:19.565513+0000","last_fullsized":"2024-03-30T12:39:19.565513+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1271,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:12.285006+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:38:12.285006+0000","last_peered":"2024-03-30T12:38:12.285006+0000","last_clean":"2024-03-30T12:38:12.285006+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:38:12.285006+0000","last_undegraded":"2024-03-30T12:38:12.285006+0000","last_fullsized":"2024-03-30T12:38:12.285006+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645098+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:37:37.645098+0000","last_peered":"2024-03-30T12:37:37.645098+0000","last_clean":"2024-03-30T12:37:37.645098+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:37:37.645098+0000","last_undegraded":"2024-03-30T12:37:37.645098+0000","last_fullsized":"2024-03-30T12:37:37.645098+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870430+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:37:55.870430+0000","last_peered":"2024-03-30T12:37:55.870430+0000","last_clean":"2024-03-30T12:37:55.870430+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:37:55.870430+0000","last_undegraded":"2024-03-30T12:37:55.870430+0000","last_fullsized":"2024-03-30T12:37:55.870430+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:28.912065+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:38:28.912065+0000","last_peered":"2024-03-30T12:38:28.912065+0000","last_clean":"2024-03-30T12:38:28.912065+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:38:28.912065+0000","last_undegraded":"2024-03-30T12:38:28.912065+0000","last_fullsized":"2024-03-30T12:38:28.912065+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303373+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:38:20.303373+0000","last_peered":"2024-03-30T12:38:20.303373+0000","last_clean":"2024-03-30T12:38:20.303373+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:38:20.303373+0000","last_undegraded":"2024-03-30T12:38:20.303373+0000","last_fullsized":"2024-03-30T12:38:20.303373+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1225,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303460+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:38:20.303460+0000","last_peered":"2024-03-30T12:38:20.303460+0000","last_clean":"2024-03-30T12:38:20.303460+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:38:20.303460+0000","last_undegraded":"2024-03-30T12:38:20.303460+0000","last_fullsized":"2024-03-30T12:38:20.303460+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:03.388264+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:39:03.388264+0000","last_peered":"2024-03-30T12:39:03.388264+0000","last_clean":"2024-03-30T12:39:03.388264+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:39:03.388264+0000","last_undegraded":"2024-03-30T12:39:03.388264+0000","last_fullsized":"2024-03-30T12:39:03.388264+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143278+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:39:19.143278+0000","last_peered":"2024-03-30T12:39:19.143278+0000","last_clean":"2024-03-30T12:39:19.143278+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:39:19.143278+0000","last_undegraded":"2024-03-30T12:39:19.143278+0000","last_fullsized":"2024-03-30T12:39:19.143278+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1389,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876285+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:38:45.876285+0000","last_peered":"2024-03-30T12:38:45.876285+0000","last_clean":"2024-03-30T12:38:45.876285+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:38:45.876285+0000","last_undegraded":"2024-03-30T12:38:45.876285+0000","last_fullsized":"2024-03-30T12:38:45.876285+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1283,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647447+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:37:57.647447+0000","last_peered":"2024-03-30T12:37:57.647447+0000","last_clean":"2024-03-30T12:37:57.647447+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:37:57.647447+0000","last_undegraded":"2024-03-30T12:37:57.647447+0000","last_fullsized":"2024-03-30T12:37:57.647447+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1302,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647455+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:37:57.647455+0000","last_peered":"2024-03-30T12:37:57.647455+0000","last_clean":"2024-03-30T12:37:57.647455+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:37:57.647455+0000","last_undegraded":"2024-03-30T12:37:57.647455+0000","last_fullsized":"2024-03-30T12:37:57.647455+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876275+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:38:45.876275+0000","last_peered":"2024-03-30T12:38:45.876275+0000","last_clean":"2024-03-30T12:38:45.876275+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:38:45.876275+0000","last_undegraded":"2024-03-30T12:38:45.876275+0000","last_fullsized":"2024-03-30T12:38:45.876275+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1151,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133095+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:37:49.133095+0000","last_peered":"2024-03-30T12:37:49.133095+0000","last_clean":"2024-03-30T12:37:49.133095+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:37:49.133095+0000","last_undegraded":"2024-03-30T12:37:49.133095+0000","last_fullsized":"2024-03-30T12:37:49.133095+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1230,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308632+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:39:00.308632+0000","last_peered":"2024-03-30T12:39:00.308632+0000","last_clean":"2024-03-30T12:39:00.308632+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:39:00.308632+0000","last_undegraded":"2024-03-30T12:39:00.308632+0000","last_fullsized":"2024-03-30T12:39:00.308632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133077+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:37:49.133077+0000","last_peered":"2024-03-30T12:37:49.133077+0000","last_clean":"2024-03-30T12:37:49.133077+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:37:49.133077+0000","last_undegraded":"2024-03-30T12:37:49.133077+0000","last_fullsized":"2024-03-30T12:37:49.133077+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308643+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:39:00.308643+0000","last_peered":"2024-03-30T12:39:00.308643+0000","last_clean":"2024-03-30T12:39:00.308643+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:39:00.308643+0000","last_undegraded":"2024-03-30T12:39:00.308643+0000","last_fullsized":"2024-03-30T12:39:00.308643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647433+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:37:57.647433+0000","last_peered":"2024-03-30T12:37:57.647433+0000","last_clean":"2024-03-30T12:37:57.647433+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:37:57.647433+0000","last_undegraded":"2024-03-30T12:37:57.647433+0000","last_fullsized":"2024-03-30T12:37:57.647433+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1263,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:32.286955+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:38:32.286955+0000","last_peered":"2024-03-30T12:38:32.286955+0000","last_clean":"2024-03-30T12:38:32.286955+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:38:32.286955+0000","last_undegraded":"2024-03-30T12:38:32.286955+0000","last_fullsized":"2024-03-30T12:38:32.286955+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1180,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:09.550388+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:37:09.550388+0000","last_peered":"2024-03-30T12:37:09.550388+0000","last_clean":"2024-03-30T12:37:09.550388+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:37:09.550388+0000","last_undegraded":"2024-03-30T12:37:09.550388+0000","last_fullsized":"2024-03-30T12:37:09.550388+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876233+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:38:45.876233+0000","last_peered":"2024-03-30T12:38:45.876233+0000","last_clean":"2024-03-30T12:38:45.876233+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:38:45.876233+0000","last_undegraded":"2024-03-30T12:38:45.876233+0000","last_fullsized":"2024-03-30T12:38:45.876233+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645072+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:37:37.645072+0000","last_peered":"2024-03-30T12:37:37.645072+0000","last_clean":"2024-03-30T12:37:37.645072+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:37:37.645072+0000","last_undegraded":"2024-03-30T12:37:37.645072+0000","last_fullsized":"2024-03-30T12:37:37.645072+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645031+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:37:37.645031+0000","last_peered":"2024-03-30T12:37:37.645031+0000","last_clean":"2024-03-30T12:37:37.645031+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:37:37.645031+0000","last_undegraded":"2024-03-30T12:37:37.645031+0000","last_fullsized":"2024-03-30T12:37:37.645031+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1225,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306130+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:38:40.306130+0000","last_peered":"2024-03-30T12:38:40.306130+0000","last_clean":"2024-03-30T12:38:40.306130+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:38:40.306130+0000","last_undegraded":"2024-03-30T12:38:40.306130+0000","last_fullsized":"2024-03-30T12:38:40.306130+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:53.914730+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:38:53.914730+0000","last_peered":"2024-03-30T12:38:53.914730+0000","last_clean":"2024-03-30T12:38:53.914730+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:38:53.914730+0000","last_undegraded":"2024-03-30T12:38:53.914730+0000","last_fullsized":"2024-03-30T12:38:53.914730+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565553+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:39:19.565553+0000","last_peered":"2024-03-30T12:39:19.565553+0000","last_clean":"2024-03-30T12:39:19.565553+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:39:19.565553+0000","last_undegraded":"2024-03-30T12:39:19.565553+0000","last_fullsized":"2024-03-30T12:39:19.565553+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306212+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:38:40.306212+0000","last_peered":"2024-03-30T12:38:40.306212+0000","last_clean":"2024-03-30T12:38:40.306212+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:38:40.306212+0000","last_undegraded":"2024-03-30T12:38:40.306212+0000","last_fullsized":"2024-03-30T12:38:40.306212+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1199,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306200+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:38:40.306200+0000","last_peered":"2024-03-30T12:38:40.306200+0000","last_clean":"2024-03-30T12:38:40.306200+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:38:40.306200+0000","last_undegraded":"2024-03-30T12:38:40.306200+0000","last_fullsized":"2024-03-30T12:38:40.306200+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:03.374890+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:37:03.374890+0000","last_peered":"2024-03-30T12:37:03.374890+0000","last_clean":"2024-03-30T12:37:03.374890+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:37:03.374890+0000","last_undegraded":"2024-03-30T12:37:03.374890+0000","last_fullsized":"2024-03-30T12:37:03.374890+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:53.914770+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:38:53.914770+0000","last_peered":"2024-03-30T12:38:53.914770+0000","last_clean":"2024-03-30T12:38:53.914770+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:38:53.914770+0000","last_undegraded":"2024-03-30T12:38:53.914770+0000","last_fullsized":"2024-03-30T12:38:53.914770+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:52.282667+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:37:52.282667+0000","last_peered":"2024-03-30T12:37:52.282667+0000","last_clean":"2024-03-30T12:37:52.282667+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:37:52.282667+0000","last_undegraded":"2024-03-30T12:37:52.282667+0000","last_fullsized":"2024-03-30T12:37:52.282667+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562847+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:38:59.562847+0000","last_peered":"2024-03-30T12:38:59.562847+0000","last_clean":"2024-03-30T12:38:59.562847+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:38:59.562847+0000","last_undegraded":"2024-03-30T12:38:59.562847+0000","last_fullsized":"2024-03-30T12:38:59.562847+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:34.131303+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:37:34.131303+0000","last_peered":"2024-03-30T12:37:34.131303+0000","last_clean":"2024-03-30T12:37:34.131303+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:37:34.131303+0000","last_undegraded":"2024-03-30T12:37:34.131303+0000","last_fullsized":"2024-03-30T12:37:34.131303+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1384,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870514+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:37:55.870514+0000","last_peered":"2024-03-30T12:37:55.870514+0000","last_clean":"2024-03-30T12:37:55.870514+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:37:55.870514+0000","last_undegraded":"2024-03-30T12:37:55.870514+0000","last_fullsized":"2024-03-30T12:37:55.870514+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870486+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:37:55.870486+0000","last_peered":"2024-03-30T12:37:55.870486+0000","last_clean":"2024-03-30T12:37:55.870486+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:37:55.870486+0000","last_undegraded":"2024-03-30T12:37:55.870486+0000","last_fullsized":"2024-03-30T12:37:55.870486+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303405+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:38:20.303405+0000","last_peered":"2024-03-30T12:38:20.303405+0000","last_clean":"2024-03-30T12:38:20.303405+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:38:20.303405+0000","last_undegraded":"2024-03-30T12:38:20.303405+0000","last_fullsized":"2024-03-30T12:38:20.303405+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:19.129793+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:37:19.129793+0000","last_peered":"2024-03-30T12:37:19.129793+0000","last_clean":"2024-03-30T12:37:19.129793+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:37:19.129793+0000","last_undegraded":"2024-03-30T12:37:19.129793+0000","last_fullsized":"2024-03-30T12:37:19.129793+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562815+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:38:59.562815+0000","last_peered":"2024-03-30T12:38:59.562815+0000","last_clean":"2024-03-30T12:38:59.562815+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:38:59.562815+0000","last_undegraded":"2024-03-30T12:38:59.562815+0000","last_fullsized":"2024-03-30T12:38:59.562815+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562788+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:38:59.562788+0000","last_peered":"2024-03-30T12:38:59.562788+0000","last_clean":"2024-03-30T12:38:59.562788+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:38:59.562788+0000","last_undegraded":"2024-03-30T12:38:59.562788+0000","last_fullsized":"2024-03-30T12:38:59.562788+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:03.388191+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:39:03.388191+0000","last_peered":"2024-03-30T12:39:03.388191+0000","last_clean":"2024-03-30T12:39:03.388191+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:39:03.388191+0000","last_undegraded":"2024-03-30T12:39:03.388191+0000","last_fullsized":"2024-03-30T12:39:03.388191+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:19.129759+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:37:19.129759+0000","last_peered":"2024-03-30T12:37:19.129759+0000","last_clean":"2024-03-30T12:37:19.129759+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:37:19.129759+0000","last_undegraded":"2024-03-30T12:37:19.129759+0000","last_fullsized":"2024-03-30T12:37:19.129759+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5753,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:13.383127+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:38:13.383127+0000","last_peered":"2024-03-30T12:38:13.383127+0000","last_clean":"2024-03-30T12:38:13.383127+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:38:13.383127+0000","last_undegraded":"2024-03-30T12:38:13.383127+0000","last_fullsized":"2024-03-30T12:38:13.383127+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1275,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:32.280622+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:37:32.280622+0000","last_peered":"2024-03-30T12:37:32.280622+0000","last_clean":"2024-03-30T12:37:32.280622+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:37:32.280622+0000","last_undegraded":"2024-03-30T12:37:32.280622+0000","last_fullsized":"2024-03-30T12:37:32.280622+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143289+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:39:19.143289+0000","last_peered":"2024-03-30T12:39:19.143289+0000","last_clean":"2024-03-30T12:39:19.143289+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:39:19.143289+0000","last_undegraded":"2024-03-30T12:39:19.143289+0000","last_fullsized":"2024-03-30T12:39:19.143289+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5514,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:45.876204+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:38:45.876204+0000","last_peered":"2024-03-30T12:38:45.876204+0000","last_clean":"2024-03-30T12:38:45.876204+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:38:45.876204+0000","last_undegraded":"2024-03-30T12:38:45.876204+0000","last_fullsized":"2024-03-30T12:38:45.876204+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917640+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:39:18.917640+0000","last_peered":"2024-03-30T12:39:18.917640+0000","last_clean":"2024-03-30T12:39:18.917640+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:39:18.917640+0000","last_undegraded":"2024-03-30T12:39:18.917640+0000","last_fullsized":"2024-03-30T12:39:18.917640+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917662+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:39:18.917662+0000","last_peered":"2024-03-30T12:39:18.917662+0000","last_clean":"2024-03-30T12:39:18.917662+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:39:18.917662+0000","last_undegraded":"2024-03-30T12:39:18.917662+0000","last_fullsized":"2024-03-30T12:39:18.917662+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311465+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:39:25.311465+0000","last_peered":"2024-03-30T12:39:25.311465+0000","last_clean":"2024-03-30T12:39:25.311465+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:39:25.311465+0000","last_undegraded":"2024-03-30T12:39:25.311465+0000","last_fullsized":"2024-03-30T12:39:25.311465+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5459,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:45.876257+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:38:45.876257+0000","last_peered":"2024-03-30T12:38:45.876257+0000","last_clean":"2024-03-30T12:38:45.876257+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:38:45.876257+0000","last_undegraded":"2024-03-30T12:38:45.876257+0000","last_fullsized":"2024-03-30T12:38:45.876257+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917672+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:39:18.917672+0000","last_peered":"2024-03-30T12:39:18.917672+0000","last_clean":"2024-03-30T12:39:18.917672+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:39:18.917672+0000","last_undegraded":"2024-03-30T12:39:18.917672+0000","last_fullsized":"2024-03-30T12:39:18.917672+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1208,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311386+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:39:25.311386+0000","last_peered":"2024-03-30T12:39:25.311386+0000","last_clean":"2024-03-30T12:39:25.311386+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:39:25.311386+0000","last_undegraded":"2024-03-30T12:39:25.311386+0000","last_fullsized":"2024-03-30T12:39:25.311386+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:57.289543+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:38:57.289543+0000","last_peered":"2024-03-30T12:38:57.289543+0000","last_clean":"2024-03-30T12:38:57.289543+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:38:57.289543+0000","last_undegraded":"2024-03-30T12:38:57.289543+0000","last_fullsized":"2024-03-30T12:38:57.289543+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3804,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:13.383237+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:38:13.383237+0000","last_peered":"2024-03-30T12:38:13.383237+0000","last_clean":"2024-03-30T12:38:13.383237+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:38:13.383237+0000","last_undegraded":"2024-03-30T12:38:13.383237+0000","last_fullsized":"2024-03-30T12:38:13.383237+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1343,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906884+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:37:38.906884+0000","last_peered":"2024-03-30T12:37:38.906884+0000","last_clean":"2024-03-30T12:37:38.906884+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:37:38.906884+0000","last_undegraded":"2024-03-30T12:37:38.906884+0000","last_fullsized":"2024-03-30T12:37:38.906884+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:48.914183+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:38:48.914183+0000","last_peered":"2024-03-30T12:38:48.914183+0000","last_clean":"2024-03-30T12:38:48.914183+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:38:48.914183+0000","last_undegraded":"2024-03-30T12:38:48.914183+0000","last_fullsized":"2024-03-30T12:38:48.914183+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:48.380185+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:37:48.380185+0000","last_peered":"2024-03-30T12:37:48.380185+0000","last_clean":"2024-03-30T12:37:48.380185+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:37:48.380185+0000","last_undegraded":"2024-03-30T12:37:48.380185+0000","last_fullsized":"2024-03-30T12:37:48.380185+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4577,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:39.138875+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:38:39.138875+0000","last_peered":"2024-03-30T12:38:39.138875+0000","last_clean":"2024-03-30T12:38:39.138875+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:38:39.138875+0000","last_undegraded":"2024-03-30T12:38:39.138875+0000","last_fullsized":"2024-03-30T12:38:39.138875+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1175,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:59.555994+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:37:59.555994+0000","last_peered":"2024-03-30T12:37:59.555994+0000","last_clean":"2024-03-30T12:37:59.555994+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:37:59.555994+0000","last_undegraded":"2024-03-30T12:37:59.555994+0000","last_fullsized":"2024-03-30T12:37:59.555994+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:22.649643+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:38:22.649643+0000","last_peered":"2024-03-30T12:38:22.649643+0000","last_clean":"2024-03-30T12:38:22.649643+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:38:22.649643+0000","last_undegraded":"2024-03-30T12:38:22.649643+0000","last_fullsized":"2024-03-30T12:38:22.649643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1201,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311442+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:39:25.311442+0000","last_peered":"2024-03-30T12:39:25.311442+0000","last_clean":"2024-03-30T12:39:25.311442+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:39:25.311442+0000","last_undegraded":"2024-03-30T12:39:25.311442+0000","last_fullsized":"2024-03-30T12:39:25.311442+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1717,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.136726+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:38:19.136726+0000","last_peered":"2024-03-30T12:38:19.136726+0000","last_clean":"2024-03-30T12:38:19.136726+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:38:19.136726+0000","last_undegraded":"2024-03-30T12:38:19.136726+0000","last_fullsized":"2024-03-30T12:38:19.136726+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24714,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:40.298683+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:37:40.298683+0000","last_peered":"2024-03-30T12:37:40.298683+0000","last_clean":"2024-03-30T12:37:40.298683+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:37:40.298683+0000","last_undegraded":"2024-03-30T12:37:40.298683+0000","last_fullsized":"2024-03-30T12:37:40.298683+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:15.879816+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:39:15.879816+0000","last_peered":"2024-03-30T12:39:15.879816+0000","last_clean":"2024-03-30T12:39:15.879816+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:39:15.879816+0000","last_undegraded":"2024-03-30T12:39:15.879816+0000","last_fullsized":"2024-03-30T12:39:15.879816+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876163+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:38:45.876163+0000","last_peered":"2024-03-30T12:38:45.876163+0000","last_clean":"2024-03-30T12:38:45.876163+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:38:45.876163+0000","last_undegraded":"2024-03-30T12:38:45.876163+0000","last_fullsized":"2024-03-30T12:38:45.876163+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.136697+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:38:19.136697+0000","last_peered":"2024-03-30T12:38:19.136697+0000","last_clean":"2024-03-30T12:38:19.136697+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:38:19.136697+0000","last_undegraded":"2024-03-30T12:38:19.136697+0000","last_fullsized":"2024-03-30T12:38:19.136697+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16481,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:59.555949+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:37:59.555949+0000","last_peered":"2024-03-30T12:37:59.555949+0000","last_clean":"2024-03-30T12:37:59.555949+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:37:59.555949+0000","last_undegraded":"2024-03-30T12:37:59.555949+0000","last_fullsized":"2024-03-30T12:37:59.555949+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876223+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:38:45.876223+0000","last_peered":"2024-03-30T12:38:45.876223+0000","last_clean":"2024-03-30T12:38:45.876223+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:38:45.876223+0000","last_undegraded":"2024-03-30T12:38:45.876223+0000","last_fullsized":"2024-03-30T12:38:45.876223+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1164,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.138928+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:38:39.138928+0000","last_peered":"2024-03-30T12:38:39.138928+0000","last_clean":"2024-03-30T12:38:39.138928+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:38:39.138928+0000","last_undegraded":"2024-03-30T12:38:39.138928+0000","last_fullsized":"2024-03-30T12:38:39.138928+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917681+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:39:18.917681+0000","last_peered":"2024-03-30T12:39:18.917681+0000","last_clean":"2024-03-30T12:39:18.917681+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:39:18.917681+0000","last_undegraded":"2024-03-30T12:39:18.917681+0000","last_fullsized":"2024-03-30T12:39:18.917681+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31270,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:57.289492+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:38:57.289492+0000","last_peered":"2024-03-30T12:38:57.289492+0000","last_clean":"2024-03-30T12:38:57.289492+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:38:57.289492+0000","last_undegraded":"2024-03-30T12:38:57.289492+0000","last_fullsized":"2024-03-30T12:38:57.289492+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647394+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:37:57.647394+0000","last_peered":"2024-03-30T12:37:57.647394+0000","last_clean":"2024-03-30T12:37:57.647394+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:37:57.647394+0000","last_undegraded":"2024-03-30T12:37:57.647394+0000","last_fullsized":"2024-03-30T12:37:57.647394+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906874+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:37:38.906874+0000","last_peered":"2024-03-30T12:37:38.906874+0000","last_clean":"2024-03-30T12:37:38.906874+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:37:38.906874+0000","last_undegraded":"2024-03-30T12:37:38.906874+0000","last_fullsized":"2024-03-30T12:37:38.906874+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651932+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:38:47.651932+0000","last_peered":"2024-03-30T12:38:47.651932+0000","last_clean":"2024-03-30T12:38:47.651932+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:38:47.651932+0000","last_undegraded":"2024-03-30T12:38:47.651932+0000","last_fullsized":"2024-03-30T12:38:47.651932+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3765,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647332+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:37:57.647332+0000","last_peered":"2024-03-30T12:37:57.647332+0000","last_clean":"2024-03-30T12:37:57.647332+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:37:57.647332+0000","last_undegraded":"2024-03-30T12:37:57.647332+0000","last_fullsized":"2024-03-30T12:37:57.647332+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:57.289460+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:38:57.289460+0000","last_peered":"2024-03-30T12:38:57.289460+0000","last_clean":"2024-03-30T12:38:57.289460+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:38:57.289460+0000","last_undegraded":"2024-03-30T12:38:57.289460+0000","last_fullsized":"2024-03-30T12:38:57.289460+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1156,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558186+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:38:19.558186+0000","last_peered":"2024-03-30T12:38:19.558186+0000","last_clean":"2024-03-30T12:38:19.558186+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:38:19.558186+0000","last_undegraded":"2024-03-30T12:38:19.558186+0000","last_fullsized":"2024-03-30T12:38:19.558186+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:15.879792+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:39:15.879792+0000","last_peered":"2024-03-30T12:39:15.879792+0000","last_clean":"2024-03-30T12:39:15.879792+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:39:15.879792+0000","last_undegraded":"2024-03-30T12:39:15.879792+0000","last_fullsized":"2024-03-30T12:39:15.879792+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15594,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:00.301062+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:38:00.301062+0000","last_peered":"2024-03-30T12:38:00.301062+0000","last_clean":"2024-03-30T12:38:00.301062+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:38:00.301062+0000","last_undegraded":"2024-03-30T12:38:00.301062+0000","last_fullsized":"2024-03-30T12:38:00.301062+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.141061+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:38:59.141061+0000","last_peered":"2024-03-30T12:38:59.141061+0000","last_clean":"2024-03-30T12:38:59.141061+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:38:59.141061+0000","last_undegraded":"2024-03-30T12:38:59.141061+0000","last_fullsized":"2024-03-30T12:38:59.141061+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:22.292071+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:39:22.292071+0000","last_peered":"2024-03-30T12:39:22.292071+0000","last_clean":"2024-03-30T12:39:22.292071+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:39:22.292071+0000","last_undegraded":"2024-03-30T12:39:22.292071+0000","last_fullsized":"2024-03-30T12:39:22.292071+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29020,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:32.280556+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:37:32.280556+0000","last_peered":"2024-03-30T12:37:32.280556+0000","last_clean":"2024-03-30T12:37:32.280556+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:37:32.280556+0000","last_undegraded":"2024-03-30T12:37:32.280556+0000","last_fullsized":"2024-03-30T12:37:32.280556+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906809+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:37:38.906809+0000","last_peered":"2024-03-30T12:37:38.906809+0000","last_clean":"2024-03-30T12:37:38.906809+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:37:38.906809+0000","last_undegraded":"2024-03-30T12:37:38.906809+0000","last_fullsized":"2024-03-30T12:37:38.906809+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651850+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:38:47.651850+0000","last_peered":"2024-03-30T12:38:47.651850+0000","last_clean":"2024-03-30T12:38:47.651850+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:38:47.651850+0000","last_undegraded":"2024-03-30T12:38:47.651850+0000","last_fullsized":"2024-03-30T12:38:47.651850+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5611,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:38.385807+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:38:38.385807+0000","last_peered":"2024-03-30T12:38:38.385807+0000","last_clean":"2024-03-30T12:38:38.385807+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:38:38.385807+0000","last_undegraded":"2024-03-30T12:38:38.385807+0000","last_fullsized":"2024-03-30T12:38:38.385807+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1365,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906835+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:37:38.906835+0000","last_peered":"2024-03-30T12:37:38.906835+0000","last_clean":"2024-03-30T12:37:38.906835+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:37:38.906835+0000","last_undegraded":"2024-03-30T12:37:38.906835+0000","last_fullsized":"2024-03-30T12:37:38.906835+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:12.654884+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:39:12.654884+0000","last_peered":"2024-03-30T12:39:12.654884+0000","last_clean":"2024-03-30T12:39:12.654884+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:39:12.654884+0000","last_undegraded":"2024-03-30T12:39:12.654884+0000","last_fullsized":"2024-03-30T12:39:12.654884+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4275,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:03.909427+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:38:03.909427+0000","last_peered":"2024-03-30T12:38:03.909427+0000","last_clean":"2024-03-30T12:38:03.909427+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:38:03.909427+0000","last_undegraded":"2024-03-30T12:38:03.909427+0000","last_fullsized":"2024-03-30T12:38:03.909427+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143221+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:39:19.143221+0000","last_peered":"2024-03-30T12:39:19.143221+0000","last_clean":"2024-03-30T12:39:19.143221+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:39:19.143221+0000","last_undegraded":"2024-03-30T12:39:19.143221+0000","last_fullsized":"2024-03-30T12:39:19.143221+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558134+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:38:19.558134+0000","last_peered":"2024-03-30T12:38:19.558134+0000","last_clean":"2024-03-30T12:38:19.558134+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:38:19.558134+0000","last_undegraded":"2024-03-30T12:38:19.558134+0000","last_fullsized":"2024-03-30T12:38:19.558134+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5254,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:38.385765+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:38:38.385765+0000","last_peered":"2024-03-30T12:38:38.385765+0000","last_clean":"2024-03-30T12:38:38.385765+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:38:38.385765+0000","last_undegraded":"2024-03-30T12:38:38.385765+0000","last_fullsized":"2024-03-30T12:38:38.385765+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:38.385797+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:38:38.385797+0000","last_peered":"2024-03-30T12:38:38.385797+0000","last_clean":"2024-03-30T12:38:38.385797+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:38:38.385797+0000","last_undegraded":"2024-03-30T12:38:38.385797+0000","last_fullsized":"2024-03-30T12:38:38.385797+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143264+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:39:19.143264+0000","last_peered":"2024-03-30T12:39:19.143264+0000","last_clean":"2024-03-30T12:39:19.143264+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:39:19.143264+0000","last_undegraded":"2024-03-30T12:39:19.143264+0000","last_fullsized":"2024-03-30T12:39:19.143264+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4811,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:13.383202+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:38:13.383202+0000","last_peered":"2024-03-30T12:38:13.383202+0000","last_clean":"2024-03-30T12:38:13.383202+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:38:13.383202+0000","last_undegraded":"2024-03-30T12:38:13.383202+0000","last_fullsized":"2024-03-30T12:38:13.383202+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:03.909462+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:38:03.909462+0000","last_peered":"2024-03-30T12:38:03.909462+0000","last_clean":"2024-03-30T12:38:03.909462+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:38:03.909462+0000","last_undegraded":"2024-03-30T12:38:03.909462+0000","last_fullsized":"2024-03-30T12:38:03.909462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:00.301034+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:38:00.301034+0000","last_peered":"2024-03-30T12:38:00.301034+0000","last_clean":"2024-03-30T12:38:00.301034+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:38:00.301034+0000","last_undegraded":"2024-03-30T12:38:00.301034+0000","last_fullsized":"2024-03-30T12:38:00.301034+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6744,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:59.141086+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:38:59.141086+0000","last_peered":"2024-03-30T12:38:59.141086+0000","last_clean":"2024-03-30T12:38:59.141086+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:38:59.141086+0000","last_undegraded":"2024-03-30T12:38:59.141086+0000","last_fullsized":"2024-03-30T12:38:59.141086+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1338,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:38.385827+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:38:38.385827+0000","last_peered":"2024-03-30T12:38:38.385827+0000","last_clean":"2024-03-30T12:38:38.385827+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:38:38.385827+0000","last_undegraded":"2024-03-30T12:38:38.385827+0000","last_fullsized":"2024-03-30T12:38:38.385827+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143303+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:39:19.143303+0000","last_peered":"2024-03-30T12:39:19.143303+0000","last_clean":"2024-03-30T12:39:19.143303+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:39:19.143303+0000","last_undegraded":"2024-03-30T12:39:19.143303+0000","last_fullsized":"2024-03-30T12:39:19.143303+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:59.555915+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:37:59.555915+0000","last_peered":"2024-03-30T12:37:59.555915+0000","last_clean":"2024-03-30T12:37:59.555915+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:37:59.555915+0000","last_undegraded":"2024-03-30T12:37:59.555915+0000","last_fullsized":"2024-03-30T12:37:59.555915+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:48.380210+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:37:48.380210+0000","last_peered":"2024-03-30T12:37:48.380210+0000","last_clean":"2024-03-30T12:37:48.380210+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:37:48.380210+0000","last_undegraded":"2024-03-30T12:37:48.380210+0000","last_fullsized":"2024-03-30T12:37:48.380210+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311414+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:39:25.311414+0000","last_peered":"2024-03-30T12:39:25.311414+0000","last_clean":"2024-03-30T12:39:25.311414+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:39:25.311414+0000","last_undegraded":"2024-03-30T12:39:25.311414+0000","last_fullsized":"2024-03-30T12:39:25.311414+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876194+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:38:45.876194+0000","last_peered":"2024-03-30T12:38:45.876194+0000","last_clean":"2024-03-30T12:38:45.876194+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:38:45.876194+0000","last_undegraded":"2024-03-30T12:38:45.876194+0000","last_fullsized":"2024-03-30T12:38:45.876194+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651915+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:38:47.651915+0000","last_peered":"2024-03-30T12:38:47.651915+0000","last_clean":"2024-03-30T12:38:47.651915+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:38:47.651915+0000","last_undegraded":"2024-03-30T12:38:47.651915+0000","last_fullsized":"2024-03-30T12:38:47.651915+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:38.906859+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:37:38.906859+0000","last_peered":"2024-03-30T12:37:38.906859+0000","last_clean":"2024-03-30T12:37:38.906859+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:37:38.906859+0000","last_undegraded":"2024-03-30T12:37:38.906859+0000","last_fullsized":"2024-03-30T12:37:38.906859+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1178,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558174+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:38:19.558174+0000","last_peered":"2024-03-30T12:38:19.558174+0000","last_clean":"2024-03-30T12:38:19.558174+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:38:19.558174+0000","last_undegraded":"2024-03-30T12:38:19.558174+0000","last_fullsized":"2024-03-30T12:38:19.558174+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1282,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651943+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:38:47.651943+0000","last_peered":"2024-03-30T12:38:47.651943+0000","last_clean":"2024-03-30T12:38:47.651943+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:38:47.651943+0000","last_undegraded":"2024-03-30T12:38:47.651943+0000","last_fullsized":"2024-03-30T12:38:47.651943+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1239,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:40.298625+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:37:40.298625+0000","last_peered":"2024-03-30T12:37:40.298625+0000","last_clean":"2024-03-30T12:37:40.298625+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:37:40.298625+0000","last_undegraded":"2024-03-30T12:37:40.298625+0000","last_fullsized":"2024-03-30T12:37:40.298625+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:12.654857+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:39:12.654857+0000","last_peered":"2024-03-30T12:39:12.654857+0000","last_clean":"2024-03-30T12:39:12.654857+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:39:12.654857+0000","last_undegraded":"2024-03-30T12:39:12.654857+0000","last_fullsized":"2024-03-30T12:39:12.654857+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1216,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:00.300996+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:38:00.300996+0000","last_peered":"2024-03-30T12:38:00.300996+0000","last_clean":"2024-03-30T12:38:00.300996+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:38:00.300996+0000","last_undegraded":"2024-03-30T12:38:00.300996+0000","last_fullsized":"2024-03-30T12:38:00.300996+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:30.867819+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:37:30.867819+0000","last_peered":"2024-03-30T12:37:30.867819+0000","last_clean":"2024-03-30T12:37:30.867819+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:37:30.867819+0000","last_undegraded":"2024-03-30T12:37:30.867819+0000","last_fullsized":"2024-03-30T12:37:30.867819+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.560418+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:38:39.560418+0000","last_peered":"2024-03-30T12:38:39.560418+0000","last_clean":"2024-03-30T12:38:39.560418+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:38:39.560418+0000","last_undegraded":"2024-03-30T12:38:39.560418+0000","last_fullsized":"2024-03-30T12:38:39.560418+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438091,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648147,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175157,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254396,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063214,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951272,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839329,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923611,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:41:54.752 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:54.752 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:54.752 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:54.752 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:54.752 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:54.752 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:54.753 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:54.753 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:54.753 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:54.753 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:54.753 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:54.753 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:54.753 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:41:54.753 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:41:55.003 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:54 smithi084 ceph-mon[91810]: pgmap v1165: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:55.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:54 smithi084 ceph-mon[89279]: pgmap v1165: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:55.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:54 smithi162 ceph-mon[83709]: pgmap v1165: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:56.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:55 smithi162 ceph-mon[83709]: from='client.34674 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:41:56.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:55 smithi084 ceph-mon[91810]: from='client.34674 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:41:56.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:55 smithi084 ceph-mon[89279]: from='client.34674 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:41:57.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:56 smithi162 ceph-mon[83709]: pgmap v1166: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:57.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:56 smithi084 ceph-mon[91810]: pgmap v1166: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:57.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:56 smithi084 ceph-mon[89279]: pgmap v1166: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:59.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:58 smithi162 ceph-mon[83709]: pgmap v1167: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:59.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:58 smithi084 ceph-mon[91810]: pgmap v1167: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:59.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:58 smithi084 ceph-mon[89279]: pgmap v1167: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:41:59.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:41:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:41:59] "GET /metrics HTTP/1.1" 200 36325 "" "Prometheus/2.43.0" 2024-03-30T12:42:00.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:41:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:42:00.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:41:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:42:00.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:41:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:42:01.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:00 smithi162 ceph-mon[83709]: pgmap v1168: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:01.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:00 smithi084 ceph-mon[91810]: pgmap v1168: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:01.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:00 smithi084 ceph-mon[89279]: pgmap v1168: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:03.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:02 smithi162 ceph-mon[83709]: pgmap v1169: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:03.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:02 smithi084 ceph-mon[91810]: pgmap v1169: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:03.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:02 smithi084 ceph-mon[89279]: pgmap v1169: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:04.754 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:42:04.977 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:42:05.098 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:04 smithi084 ceph-mon[91810]: pgmap v1170: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:05.099 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:04 smithi084 ceph-mon[89279]: pgmap v1170: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:05.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:04 smithi162 ceph-mon[83709]: pgmap v1170: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:06.968 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:42:06.968 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:06 smithi084 ceph-mon[89279]: pgmap v1171: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:06.969 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:06 smithi084 ceph-mon[91810]: pgmap v1171: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:06.974 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:42:07.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:06 smithi162 ceph-mon[83709]: pgmap v1171: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:07.599 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1172,"stamp":"2024-03-30T12:42:06.913994+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003899"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.138971+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:38:39.138971+0000","last_peered":"2024-03-30T12:38:39.138971+0000","last_clean":"2024-03-30T12:38:39.138971+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:38:39.138971+0000","last_undegraded":"2024-03-30T12:38:39.138971+0000","last_fullsized":"2024-03-30T12:38:39.138971+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1365,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917695+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:39:18.917695+0000","last_peered":"2024-03-30T12:39:18.917695+0000","last_clean":"2024-03-30T12:39:18.917695+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:39:18.917695+0000","last_undegraded":"2024-03-30T12:39:18.917695+0000","last_fullsized":"2024-03-30T12:39:18.917695+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876244+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:38:45.876244+0000","last_peered":"2024-03-30T12:38:45.876244+0000","last_clean":"2024-03-30T12:38:45.876244+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:38:45.876244+0000","last_undegraded":"2024-03-30T12:38:45.876244+0000","last_fullsized":"2024-03-30T12:38:45.876244+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308618+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:39:00.308618+0000","last_peered":"2024-03-30T12:39:00.308618+0000","last_clean":"2024-03-30T12:39:00.308618+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:39:00.308618+0000","last_undegraded":"2024-03-30T12:39:00.308618+0000","last_fullsized":"2024-03-30T12:39:00.308618+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133062+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:37:49.133062+0000","last_peered":"2024-03-30T12:37:49.133062+0000","last_clean":"2024-03-30T12:37:49.133062+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:37:49.133062+0000","last_undegraded":"2024-03-30T12:37:49.133062+0000","last_fullsized":"2024-03-30T12:37:49.133062+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1211,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308563+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:39:00.308563+0000","last_peered":"2024-03-30T12:39:00.308563+0000","last_clean":"2024-03-30T12:39:00.308563+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:39:00.308563+0000","last_undegraded":"2024-03-30T12:39:00.308563+0000","last_fullsized":"2024-03-30T12:39:00.308563+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133035+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:37:49.133035+0000","last_peered":"2024-03-30T12:37:49.133035+0000","last_clean":"2024-03-30T12:37:49.133035+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:37:49.133035+0000","last_undegraded":"2024-03-30T12:37:49.133035+0000","last_fullsized":"2024-03-30T12:37:49.133035+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647301+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:37:57.647301+0000","last_peered":"2024-03-30T12:37:57.647301+0000","last_clean":"2024-03-30T12:37:57.647301+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:37:57.647301+0000","last_undegraded":"2024-03-30T12:37:57.647301+0000","last_fullsized":"2024-03-30T12:37:57.647301+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:34.131337+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:37:34.131337+0000","last_peered":"2024-03-30T12:37:34.131337+0000","last_clean":"2024-03-30T12:37:34.131337+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:37:34.131337+0000","last_undegraded":"2024-03-30T12:37:34.131337+0000","last_fullsized":"2024-03-30T12:37:34.131337+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565540+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:39:19.565540+0000","last_peered":"2024-03-30T12:39:19.565540+0000","last_clean":"2024-03-30T12:39:19.565540+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:39:19.565540+0000","last_undegraded":"2024-03-30T12:39:19.565540+0000","last_fullsized":"2024-03-30T12:39:19.565540+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565513+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:39:19.565513+0000","last_peered":"2024-03-30T12:39:19.565513+0000","last_clean":"2024-03-30T12:39:19.565513+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:39:19.565513+0000","last_undegraded":"2024-03-30T12:39:19.565513+0000","last_fullsized":"2024-03-30T12:39:19.565513+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1271,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:12.285006+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:38:12.285006+0000","last_peered":"2024-03-30T12:38:12.285006+0000","last_clean":"2024-03-30T12:38:12.285006+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:38:12.285006+0000","last_undegraded":"2024-03-30T12:38:12.285006+0000","last_fullsized":"2024-03-30T12:38:12.285006+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645098+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:37:37.645098+0000","last_peered":"2024-03-30T12:37:37.645098+0000","last_clean":"2024-03-30T12:37:37.645098+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:37:37.645098+0000","last_undegraded":"2024-03-30T12:37:37.645098+0000","last_fullsized":"2024-03-30T12:37:37.645098+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870430+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:37:55.870430+0000","last_peered":"2024-03-30T12:37:55.870430+0000","last_clean":"2024-03-30T12:37:55.870430+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:37:55.870430+0000","last_undegraded":"2024-03-30T12:37:55.870430+0000","last_fullsized":"2024-03-30T12:37:55.870430+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:28.912065+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:38:28.912065+0000","last_peered":"2024-03-30T12:38:28.912065+0000","last_clean":"2024-03-30T12:38:28.912065+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:38:28.912065+0000","last_undegraded":"2024-03-30T12:38:28.912065+0000","last_fullsized":"2024-03-30T12:38:28.912065+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303373+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:38:20.303373+0000","last_peered":"2024-03-30T12:38:20.303373+0000","last_clean":"2024-03-30T12:38:20.303373+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:38:20.303373+0000","last_undegraded":"2024-03-30T12:38:20.303373+0000","last_fullsized":"2024-03-30T12:38:20.303373+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1225,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303460+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:38:20.303460+0000","last_peered":"2024-03-30T12:38:20.303460+0000","last_clean":"2024-03-30T12:38:20.303460+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:38:20.303460+0000","last_undegraded":"2024-03-30T12:38:20.303460+0000","last_fullsized":"2024-03-30T12:38:20.303460+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:03.388264+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:39:03.388264+0000","last_peered":"2024-03-30T12:39:03.388264+0000","last_clean":"2024-03-30T12:39:03.388264+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:39:03.388264+0000","last_undegraded":"2024-03-30T12:39:03.388264+0000","last_fullsized":"2024-03-30T12:39:03.388264+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143278+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:39:19.143278+0000","last_peered":"2024-03-30T12:39:19.143278+0000","last_clean":"2024-03-30T12:39:19.143278+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:39:19.143278+0000","last_undegraded":"2024-03-30T12:39:19.143278+0000","last_fullsized":"2024-03-30T12:39:19.143278+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1389,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876285+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:38:45.876285+0000","last_peered":"2024-03-30T12:38:45.876285+0000","last_clean":"2024-03-30T12:38:45.876285+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:38:45.876285+0000","last_undegraded":"2024-03-30T12:38:45.876285+0000","last_fullsized":"2024-03-30T12:38:45.876285+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1284,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659610+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:39:57.659610+0000","last_peered":"2024-03-30T12:39:57.659610+0000","last_clean":"2024-03-30T12:39:57.659610+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:39:57.659610+0000","last_undegraded":"2024-03-30T12:39:57.659610+0000","last_fullsized":"2024-03-30T12:39:57.659610+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1303,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659620+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:39:57.659620+0000","last_peered":"2024-03-30T12:39:57.659620+0000","last_clean":"2024-03-30T12:39:57.659620+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:39:57.659620+0000","last_undegraded":"2024-03-30T12:39:57.659620+0000","last_fullsized":"2024-03-30T12:39:57.659620+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876275+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:38:45.876275+0000","last_peered":"2024-03-30T12:38:45.876275+0000","last_clean":"2024-03-30T12:38:45.876275+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:38:45.876275+0000","last_undegraded":"2024-03-30T12:38:45.876275+0000","last_fullsized":"2024-03-30T12:38:45.876275+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1151,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133095+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:37:49.133095+0000","last_peered":"2024-03-30T12:37:49.133095+0000","last_clean":"2024-03-30T12:37:49.133095+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:37:49.133095+0000","last_undegraded":"2024-03-30T12:37:49.133095+0000","last_fullsized":"2024-03-30T12:37:49.133095+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1230,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308632+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:39:00.308632+0000","last_peered":"2024-03-30T12:39:00.308632+0000","last_clean":"2024-03-30T12:39:00.308632+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:39:00.308632+0000","last_undegraded":"2024-03-30T12:39:00.308632+0000","last_fullsized":"2024-03-30T12:39:00.308632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133077+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:37:49.133077+0000","last_peered":"2024-03-30T12:37:49.133077+0000","last_clean":"2024-03-30T12:37:49.133077+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:37:49.133077+0000","last_undegraded":"2024-03-30T12:37:49.133077+0000","last_fullsized":"2024-03-30T12:37:49.133077+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308643+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:39:00.308643+0000","last_peered":"2024-03-30T12:39:00.308643+0000","last_clean":"2024-03-30T12:39:00.308643+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:39:00.308643+0000","last_undegraded":"2024-03-30T12:39:00.308643+0000","last_fullsized":"2024-03-30T12:39:00.308643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647433+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:37:57.647433+0000","last_peered":"2024-03-30T12:37:57.647433+0000","last_clean":"2024-03-30T12:37:57.647433+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:37:57.647433+0000","last_undegraded":"2024-03-30T12:37:57.647433+0000","last_fullsized":"2024-03-30T12:37:57.647433+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1263,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:32.286955+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:38:32.286955+0000","last_peered":"2024-03-30T12:38:32.286955+0000","last_clean":"2024-03-30T12:38:32.286955+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:38:32.286955+0000","last_undegraded":"2024-03-30T12:38:32.286955+0000","last_fullsized":"2024-03-30T12:38:32.286955+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1180,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:09.550388+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:37:09.550388+0000","last_peered":"2024-03-30T12:37:09.550388+0000","last_clean":"2024-03-30T12:37:09.550388+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:37:09.550388+0000","last_undegraded":"2024-03-30T12:37:09.550388+0000","last_fullsized":"2024-03-30T12:37:09.550388+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876233+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:38:45.876233+0000","last_peered":"2024-03-30T12:38:45.876233+0000","last_clean":"2024-03-30T12:38:45.876233+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:38:45.876233+0000","last_undegraded":"2024-03-30T12:38:45.876233+0000","last_fullsized":"2024-03-30T12:38:45.876233+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645072+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:37:37.645072+0000","last_peered":"2024-03-30T12:37:37.645072+0000","last_clean":"2024-03-30T12:37:37.645072+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:37:37.645072+0000","last_undegraded":"2024-03-30T12:37:37.645072+0000","last_fullsized":"2024-03-30T12:37:37.645072+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645031+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:37:37.645031+0000","last_peered":"2024-03-30T12:37:37.645031+0000","last_clean":"2024-03-30T12:37:37.645031+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:37:37.645031+0000","last_undegraded":"2024-03-30T12:37:37.645031+0000","last_fullsized":"2024-03-30T12:37:37.645031+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1225,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306130+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:38:40.306130+0000","last_peered":"2024-03-30T12:38:40.306130+0000","last_clean":"2024-03-30T12:38:40.306130+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:38:40.306130+0000","last_undegraded":"2024-03-30T12:38:40.306130+0000","last_fullsized":"2024-03-30T12:38:40.306130+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:53.914730+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:38:53.914730+0000","last_peered":"2024-03-30T12:38:53.914730+0000","last_clean":"2024-03-30T12:38:53.914730+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:38:53.914730+0000","last_undegraded":"2024-03-30T12:38:53.914730+0000","last_fullsized":"2024-03-30T12:38:53.914730+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565553+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:39:19.565553+0000","last_peered":"2024-03-30T12:39:19.565553+0000","last_clean":"2024-03-30T12:39:19.565553+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:39:19.565553+0000","last_undegraded":"2024-03-30T12:39:19.565553+0000","last_fullsized":"2024-03-30T12:39:19.565553+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306212+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:38:40.306212+0000","last_peered":"2024-03-30T12:38:40.306212+0000","last_clean":"2024-03-30T12:38:40.306212+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:38:40.306212+0000","last_undegraded":"2024-03-30T12:38:40.306212+0000","last_fullsized":"2024-03-30T12:38:40.306212+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1199,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306200+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:38:40.306200+0000","last_peered":"2024-03-30T12:38:40.306200+0000","last_clean":"2024-03-30T12:38:40.306200+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:38:40.306200+0000","last_undegraded":"2024-03-30T12:38:40.306200+0000","last_fullsized":"2024-03-30T12:38:40.306200+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1292,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:28.391470+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:39:28.391470+0000","last_peered":"2024-03-30T12:39:28.391470+0000","last_clean":"2024-03-30T12:39:28.391470+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:39:28.391470+0000","last_undegraded":"2024-03-30T12:39:28.391470+0000","last_fullsized":"2024-03-30T12:39:28.391470+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:53.914770+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:38:53.914770+0000","last_peered":"2024-03-30T12:38:53.914770+0000","last_clean":"2024-03-30T12:38:53.914770+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:38:53.914770+0000","last_undegraded":"2024-03-30T12:38:53.914770+0000","last_fullsized":"2024-03-30T12:38:53.914770+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:52.282667+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:37:52.282667+0000","last_peered":"2024-03-30T12:37:52.282667+0000","last_clean":"2024-03-30T12:37:52.282667+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:37:52.282667+0000","last_undegraded":"2024-03-30T12:37:52.282667+0000","last_fullsized":"2024-03-30T12:37:52.282667+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562847+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:38:59.562847+0000","last_peered":"2024-03-30T12:38:59.562847+0000","last_clean":"2024-03-30T12:38:59.562847+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:38:59.562847+0000","last_undegraded":"2024-03-30T12:38:59.562847+0000","last_fullsized":"2024-03-30T12:38:59.562847+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:34.131303+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:37:34.131303+0000","last_peered":"2024-03-30T12:37:34.131303+0000","last_clean":"2024-03-30T12:37:34.131303+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:37:34.131303+0000","last_undegraded":"2024-03-30T12:37:34.131303+0000","last_fullsized":"2024-03-30T12:37:34.131303+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1384,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870514+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:37:55.870514+0000","last_peered":"2024-03-30T12:37:55.870514+0000","last_clean":"2024-03-30T12:37:55.870514+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:37:55.870514+0000","last_undegraded":"2024-03-30T12:37:55.870514+0000","last_fullsized":"2024-03-30T12:37:55.870514+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870486+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:37:55.870486+0000","last_peered":"2024-03-30T12:37:55.870486+0000","last_clean":"2024-03-30T12:37:55.870486+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:37:55.870486+0000","last_undegraded":"2024-03-30T12:37:55.870486+0000","last_fullsized":"2024-03-30T12:37:55.870486+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303405+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:38:20.303405+0000","last_peered":"2024-03-30T12:38:20.303405+0000","last_clean":"2024-03-30T12:38:20.303405+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:38:20.303405+0000","last_undegraded":"2024-03-30T12:38:20.303405+0000","last_fullsized":"2024-03-30T12:38:20.303405+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.145725+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:39:39.145725+0000","last_peered":"2024-03-30T12:39:39.145725+0000","last_clean":"2024-03-30T12:39:39.145725+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:39:39.145725+0000","last_undegraded":"2024-03-30T12:39:39.145725+0000","last_fullsized":"2024-03-30T12:39:39.145725+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562815+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:38:59.562815+0000","last_peered":"2024-03-30T12:38:59.562815+0000","last_clean":"2024-03-30T12:38:59.562815+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:38:59.562815+0000","last_undegraded":"2024-03-30T12:38:59.562815+0000","last_fullsized":"2024-03-30T12:38:59.562815+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562788+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:38:59.562788+0000","last_peered":"2024-03-30T12:38:59.562788+0000","last_clean":"2024-03-30T12:38:59.562788+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:38:59.562788+0000","last_undegraded":"2024-03-30T12:38:59.562788+0000","last_fullsized":"2024-03-30T12:38:59.562788+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:03.388191+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:39:03.388191+0000","last_peered":"2024-03-30T12:39:03.388191+0000","last_clean":"2024-03-30T12:39:03.388191+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:39:03.388191+0000","last_undegraded":"2024-03-30T12:39:03.388191+0000","last_fullsized":"2024-03-30T12:39:03.388191+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.145661+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:39:39.145661+0000","last_peered":"2024-03-30T12:39:39.145661+0000","last_clean":"2024-03-30T12:39:39.145661+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:39:39.145661+0000","last_undegraded":"2024-03-30T12:39:39.145661+0000","last_fullsized":"2024-03-30T12:39:39.145661+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5753,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:13.383127+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:38:13.383127+0000","last_peered":"2024-03-30T12:38:13.383127+0000","last_clean":"2024-03-30T12:38:13.383127+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:38:13.383127+0000","last_undegraded":"2024-03-30T12:38:13.383127+0000","last_fullsized":"2024-03-30T12:38:13.383127+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1276,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:47.295052+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:39:47.295052+0000","last_peered":"2024-03-30T12:39:47.295052+0000","last_clean":"2024-03-30T12:39:47.295052+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:39:47.295052+0000","last_undegraded":"2024-03-30T12:39:47.295052+0000","last_fullsized":"2024-03-30T12:39:47.295052+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143289+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:39:19.143289+0000","last_peered":"2024-03-30T12:39:19.143289+0000","last_clean":"2024-03-30T12:39:19.143289+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:39:19.143289+0000","last_undegraded":"2024-03-30T12:39:19.143289+0000","last_fullsized":"2024-03-30T12:39:19.143289+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5514,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:45.876204+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:38:45.876204+0000","last_peered":"2024-03-30T12:38:45.876204+0000","last_clean":"2024-03-30T12:38:45.876204+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:38:45.876204+0000","last_undegraded":"2024-03-30T12:38:45.876204+0000","last_fullsized":"2024-03-30T12:38:45.876204+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917640+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:39:18.917640+0000","last_peered":"2024-03-30T12:39:18.917640+0000","last_clean":"2024-03-30T12:39:18.917640+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:39:18.917640+0000","last_undegraded":"2024-03-30T12:39:18.917640+0000","last_fullsized":"2024-03-30T12:39:18.917640+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917662+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:39:18.917662+0000","last_peered":"2024-03-30T12:39:18.917662+0000","last_clean":"2024-03-30T12:39:18.917662+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:39:18.917662+0000","last_undegraded":"2024-03-30T12:39:18.917662+0000","last_fullsized":"2024-03-30T12:39:18.917662+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311465+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:39:25.311465+0000","last_peered":"2024-03-30T12:39:25.311465+0000","last_clean":"2024-03-30T12:39:25.311465+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:39:25.311465+0000","last_undegraded":"2024-03-30T12:39:25.311465+0000","last_fullsized":"2024-03-30T12:39:25.311465+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5459,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:45.876257+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:38:45.876257+0000","last_peered":"2024-03-30T12:38:45.876257+0000","last_clean":"2024-03-30T12:38:45.876257+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:38:45.876257+0000","last_undegraded":"2024-03-30T12:38:45.876257+0000","last_fullsized":"2024-03-30T12:38:45.876257+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917672+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:39:18.917672+0000","last_peered":"2024-03-30T12:39:18.917672+0000","last_clean":"2024-03-30T12:39:18.917672+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:39:18.917672+0000","last_undegraded":"2024-03-30T12:39:18.917672+0000","last_fullsized":"2024-03-30T12:39:18.917672+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1208,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311386+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:39:25.311386+0000","last_peered":"2024-03-30T12:39:25.311386+0000","last_clean":"2024-03-30T12:39:25.311386+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:39:25.311386+0000","last_undegraded":"2024-03-30T12:39:25.311386+0000","last_fullsized":"2024-03-30T12:39:25.311386+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:57.289543+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:38:57.289543+0000","last_peered":"2024-03-30T12:38:57.289543+0000","last_clean":"2024-03-30T12:38:57.289543+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:38:57.289543+0000","last_undegraded":"2024-03-30T12:38:57.289543+0000","last_fullsized":"2024-03-30T12:38:57.289543+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3804,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:13.383237+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:38:13.383237+0000","last_peered":"2024-03-30T12:38:13.383237+0000","last_clean":"2024-03-30T12:38:13.383237+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:38:13.383237+0000","last_undegraded":"2024-03-30T12:38:13.383237+0000","last_fullsized":"2024-03-30T12:38:13.383237+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1344,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920990+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:39:48.920990+0000","last_peered":"2024-03-30T12:39:48.920990+0000","last_clean":"2024-03-30T12:39:48.920990+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:39:48.920990+0000","last_undegraded":"2024-03-30T12:39:48.920990+0000","last_fullsized":"2024-03-30T12:39:48.920990+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:48.914183+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:38:48.914183+0000","last_peered":"2024-03-30T12:38:48.914183+0000","last_clean":"2024-03-30T12:38:48.914183+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:38:48.914183+0000","last_undegraded":"2024-03-30T12:38:48.914183+0000","last_fullsized":"2024-03-30T12:38:48.914183+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:53.394025+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:39:53.394025+0000","last_peered":"2024-03-30T12:39:53.394025+0000","last_clean":"2024-03-30T12:39:53.394025+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:39:53.394025+0000","last_undegraded":"2024-03-30T12:39:53.394025+0000","last_fullsized":"2024-03-30T12:39:53.394025+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4577,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:39.138875+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:38:39.138875+0000","last_peered":"2024-03-30T12:38:39.138875+0000","last_clean":"2024-03-30T12:38:39.138875+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:38:39.138875+0000","last_undegraded":"2024-03-30T12:38:39.138875+0000","last_fullsized":"2024-03-30T12:38:39.138875+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1175,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:59.555994+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:37:59.555994+0000","last_peered":"2024-03-30T12:37:59.555994+0000","last_clean":"2024-03-30T12:37:59.555994+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:37:59.555994+0000","last_undegraded":"2024-03-30T12:37:59.555994+0000","last_fullsized":"2024-03-30T12:37:59.555994+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:22.649643+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:38:22.649643+0000","last_peered":"2024-03-30T12:38:22.649643+0000","last_clean":"2024-03-30T12:38:22.649643+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:38:22.649643+0000","last_undegraded":"2024-03-30T12:38:22.649643+0000","last_fullsized":"2024-03-30T12:38:22.649643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1201,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311442+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:39:25.311442+0000","last_peered":"2024-03-30T12:39:25.311442+0000","last_clean":"2024-03-30T12:39:25.311442+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:39:25.311442+0000","last_undegraded":"2024-03-30T12:39:25.311442+0000","last_fullsized":"2024-03-30T12:39:25.311442+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1717,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.136726+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:38:19.136726+0000","last_peered":"2024-03-30T12:38:19.136726+0000","last_clean":"2024-03-30T12:38:19.136726+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:38:19.136726+0000","last_undegraded":"2024-03-30T12:38:19.136726+0000","last_fullsized":"2024-03-30T12:38:19.136726+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24715,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:39:50.314565+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:39:50.314565+0000","last_peered":"2024-03-30T12:39:50.314565+0000","last_clean":"2024-03-30T12:39:50.314565+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:39:50.314565+0000","last_undegraded":"2024-03-30T12:39:50.314565+0000","last_fullsized":"2024-03-30T12:39:50.314565+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:15.879816+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:39:15.879816+0000","last_peered":"2024-03-30T12:39:15.879816+0000","last_clean":"2024-03-30T12:39:15.879816+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:39:15.879816+0000","last_undegraded":"2024-03-30T12:39:15.879816+0000","last_fullsized":"2024-03-30T12:39:15.879816+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876163+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:38:45.876163+0000","last_peered":"2024-03-30T12:38:45.876163+0000","last_clean":"2024-03-30T12:38:45.876163+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:38:45.876163+0000","last_undegraded":"2024-03-30T12:38:45.876163+0000","last_fullsized":"2024-03-30T12:38:45.876163+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.136697+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:38:19.136697+0000","last_peered":"2024-03-30T12:38:19.136697+0000","last_clean":"2024-03-30T12:38:19.136697+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:38:19.136697+0000","last_undegraded":"2024-03-30T12:38:19.136697+0000","last_fullsized":"2024-03-30T12:38:19.136697+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16481,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:37:59.555949+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:37:59.555949+0000","last_peered":"2024-03-30T12:37:59.555949+0000","last_clean":"2024-03-30T12:37:59.555949+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:37:59.555949+0000","last_undegraded":"2024-03-30T12:37:59.555949+0000","last_fullsized":"2024-03-30T12:37:59.555949+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876223+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:38:45.876223+0000","last_peered":"2024-03-30T12:38:45.876223+0000","last_clean":"2024-03-30T12:38:45.876223+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:38:45.876223+0000","last_undegraded":"2024-03-30T12:38:45.876223+0000","last_fullsized":"2024-03-30T12:38:45.876223+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1164,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.138928+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:38:39.138928+0000","last_peered":"2024-03-30T12:38:39.138928+0000","last_clean":"2024-03-30T12:38:39.138928+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:38:39.138928+0000","last_undegraded":"2024-03-30T12:38:39.138928+0000","last_fullsized":"2024-03-30T12:38:39.138928+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917681+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:39:18.917681+0000","last_peered":"2024-03-30T12:39:18.917681+0000","last_clean":"2024-03-30T12:39:18.917681+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:39:18.917681+0000","last_undegraded":"2024-03-30T12:39:18.917681+0000","last_fullsized":"2024-03-30T12:39:18.917681+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31270,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:57.289492+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:38:57.289492+0000","last_peered":"2024-03-30T12:38:57.289492+0000","last_clean":"2024-03-30T12:38:57.289492+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:38:57.289492+0000","last_undegraded":"2024-03-30T12:38:57.289492+0000","last_fullsized":"2024-03-30T12:38:57.289492+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659585+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:39:57.659585+0000","last_peered":"2024-03-30T12:39:57.659585+0000","last_clean":"2024-03-30T12:39:57.659585+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:39:57.659585+0000","last_undegraded":"2024-03-30T12:39:57.659585+0000","last_fullsized":"2024-03-30T12:39:57.659585+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1355,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920979+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:39:48.920979+0000","last_peered":"2024-03-30T12:39:48.920979+0000","last_clean":"2024-03-30T12:39:48.920979+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:39:48.920979+0000","last_undegraded":"2024-03-30T12:39:48.920979+0000","last_fullsized":"2024-03-30T12:39:48.920979+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651932+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:38:47.651932+0000","last_peered":"2024-03-30T12:38:47.651932+0000","last_clean":"2024-03-30T12:38:47.651932+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:38:47.651932+0000","last_undegraded":"2024-03-30T12:38:47.651932+0000","last_fullsized":"2024-03-30T12:38:47.651932+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3766,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659555+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:39:57.659555+0000","last_peered":"2024-03-30T12:39:57.659555+0000","last_clean":"2024-03-30T12:39:57.659555+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:39:57.659555+0000","last_undegraded":"2024-03-30T12:39:57.659555+0000","last_fullsized":"2024-03-30T12:39:57.659555+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:57.289460+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:38:57.289460+0000","last_peered":"2024-03-30T12:38:57.289460+0000","last_clean":"2024-03-30T12:38:57.289460+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:38:57.289460+0000","last_undegraded":"2024-03-30T12:38:57.289460+0000","last_fullsized":"2024-03-30T12:38:57.289460+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1156,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558186+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:38:19.558186+0000","last_peered":"2024-03-30T12:38:19.558186+0000","last_clean":"2024-03-30T12:38:19.558186+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:38:19.558186+0000","last_undegraded":"2024-03-30T12:38:19.558186+0000","last_fullsized":"2024-03-30T12:38:19.558186+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:15.879792+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:39:15.879792+0000","last_peered":"2024-03-30T12:39:15.879792+0000","last_clean":"2024-03-30T12:39:15.879792+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:39:15.879792+0000","last_undegraded":"2024-03-30T12:39:15.879792+0000","last_fullsized":"2024-03-30T12:39:15.879792+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15594,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:00.301062+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:38:00.301062+0000","last_peered":"2024-03-30T12:38:00.301062+0000","last_clean":"2024-03-30T12:38:00.301062+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:38:00.301062+0000","last_undegraded":"2024-03-30T12:38:00.301062+0000","last_fullsized":"2024-03-30T12:38:00.301062+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.141061+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:38:59.141061+0000","last_peered":"2024-03-30T12:38:59.141061+0000","last_clean":"2024-03-30T12:38:59.141061+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:38:59.141061+0000","last_undegraded":"2024-03-30T12:38:59.141061+0000","last_fullsized":"2024-03-30T12:38:59.141061+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:22.292071+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:39:22.292071+0000","last_peered":"2024-03-30T12:39:22.292071+0000","last_clean":"2024-03-30T12:39:22.292071+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:39:22.292071+0000","last_undegraded":"2024-03-30T12:39:22.292071+0000","last_fullsized":"2024-03-30T12:39:22.292071+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29021,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:39:47.295005+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:39:47.295005+0000","last_peered":"2024-03-30T12:39:47.295005+0000","last_clean":"2024-03-30T12:39:47.295005+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:39:47.295005+0000","last_undegraded":"2024-03-30T12:39:47.295005+0000","last_fullsized":"2024-03-30T12:39:47.295005+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920913+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:39:48.920913+0000","last_peered":"2024-03-30T12:39:48.920913+0000","last_clean":"2024-03-30T12:39:48.920913+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:39:48.920913+0000","last_undegraded":"2024-03-30T12:39:48.920913+0000","last_fullsized":"2024-03-30T12:39:48.920913+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651850+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:38:47.651850+0000","last_peered":"2024-03-30T12:38:47.651850+0000","last_clean":"2024-03-30T12:38:47.651850+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:38:47.651850+0000","last_undegraded":"2024-03-30T12:38:47.651850+0000","last_fullsized":"2024-03-30T12:38:47.651850+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5611,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:38.385807+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:38:38.385807+0000","last_peered":"2024-03-30T12:38:38.385807+0000","last_clean":"2024-03-30T12:38:38.385807+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:38:38.385807+0000","last_undegraded":"2024-03-30T12:38:38.385807+0000","last_fullsized":"2024-03-30T12:38:38.385807+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1366,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920941+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:39:48.920941+0000","last_peered":"2024-03-30T12:39:48.920941+0000","last_clean":"2024-03-30T12:39:48.920941+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:39:48.920941+0000","last_undegraded":"2024-03-30T12:39:48.920941+0000","last_fullsized":"2024-03-30T12:39:48.920941+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:12.654884+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:39:12.654884+0000","last_peered":"2024-03-30T12:39:12.654884+0000","last_clean":"2024-03-30T12:39:12.654884+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:39:12.654884+0000","last_undegraded":"2024-03-30T12:39:12.654884+0000","last_fullsized":"2024-03-30T12:39:12.654884+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4275,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:03.909427+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:38:03.909427+0000","last_peered":"2024-03-30T12:38:03.909427+0000","last_clean":"2024-03-30T12:38:03.909427+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:38:03.909427+0000","last_undegraded":"2024-03-30T12:38:03.909427+0000","last_fullsized":"2024-03-30T12:38:03.909427+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143221+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:39:19.143221+0000","last_peered":"2024-03-30T12:39:19.143221+0000","last_clean":"2024-03-30T12:39:19.143221+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:39:19.143221+0000","last_undegraded":"2024-03-30T12:39:19.143221+0000","last_fullsized":"2024-03-30T12:39:19.143221+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558134+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:38:19.558134+0000","last_peered":"2024-03-30T12:38:19.558134+0000","last_clean":"2024-03-30T12:38:19.558134+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:38:19.558134+0000","last_undegraded":"2024-03-30T12:38:19.558134+0000","last_fullsized":"2024-03-30T12:38:19.558134+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5254,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:38.385765+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:38:38.385765+0000","last_peered":"2024-03-30T12:38:38.385765+0000","last_clean":"2024-03-30T12:38:38.385765+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:38:38.385765+0000","last_undegraded":"2024-03-30T12:38:38.385765+0000","last_fullsized":"2024-03-30T12:38:38.385765+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:38.385797+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:38:38.385797+0000","last_peered":"2024-03-30T12:38:38.385797+0000","last_clean":"2024-03-30T12:38:38.385797+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:38:38.385797+0000","last_undegraded":"2024-03-30T12:38:38.385797+0000","last_fullsized":"2024-03-30T12:38:38.385797+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143264+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:39:19.143264+0000","last_peered":"2024-03-30T12:39:19.143264+0000","last_clean":"2024-03-30T12:39:19.143264+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:39:19.143264+0000","last_undegraded":"2024-03-30T12:39:19.143264+0000","last_fullsized":"2024-03-30T12:39:19.143264+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4811,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:13.383202+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:38:13.383202+0000","last_peered":"2024-03-30T12:38:13.383202+0000","last_clean":"2024-03-30T12:38:13.383202+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:38:13.383202+0000","last_undegraded":"2024-03-30T12:38:13.383202+0000","last_fullsized":"2024-03-30T12:38:13.383202+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:03.909462+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:38:03.909462+0000","last_peered":"2024-03-30T12:38:03.909462+0000","last_clean":"2024-03-30T12:38:03.909462+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:38:03.909462+0000","last_undegraded":"2024-03-30T12:38:03.909462+0000","last_fullsized":"2024-03-30T12:38:03.909462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:00.301034+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:38:00.301034+0000","last_peered":"2024-03-30T12:38:00.301034+0000","last_clean":"2024-03-30T12:38:00.301034+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:38:00.301034+0000","last_undegraded":"2024-03-30T12:38:00.301034+0000","last_fullsized":"2024-03-30T12:38:00.301034+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6744,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:59.141086+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:38:59.141086+0000","last_peered":"2024-03-30T12:38:59.141086+0000","last_clean":"2024-03-30T12:38:59.141086+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:38:59.141086+0000","last_undegraded":"2024-03-30T12:38:59.141086+0000","last_fullsized":"2024-03-30T12:38:59.141086+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1338,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:38.385827+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:38:38.385827+0000","last_peered":"2024-03-30T12:38:38.385827+0000","last_clean":"2024-03-30T12:38:38.385827+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:38:38.385827+0000","last_undegraded":"2024-03-30T12:38:38.385827+0000","last_fullsized":"2024-03-30T12:38:38.385827+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143303+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:39:19.143303+0000","last_peered":"2024-03-30T12:39:19.143303+0000","last_clean":"2024-03-30T12:39:19.143303+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:39:19.143303+0000","last_undegraded":"2024-03-30T12:39:19.143303+0000","last_fullsized":"2024-03-30T12:39:19.143303+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:59.555915+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:37:59.555915+0000","last_peered":"2024-03-30T12:37:59.555915+0000","last_clean":"2024-03-30T12:37:59.555915+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:37:59.555915+0000","last_undegraded":"2024-03-30T12:37:59.555915+0000","last_fullsized":"2024-03-30T12:37:59.555915+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:53.394048+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:39:53.394048+0000","last_peered":"2024-03-30T12:39:53.394048+0000","last_clean":"2024-03-30T12:39:53.394048+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:39:53.394048+0000","last_undegraded":"2024-03-30T12:39:53.394048+0000","last_fullsized":"2024-03-30T12:39:53.394048+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311414+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:39:25.311414+0000","last_peered":"2024-03-30T12:39:25.311414+0000","last_clean":"2024-03-30T12:39:25.311414+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:39:25.311414+0000","last_undegraded":"2024-03-30T12:39:25.311414+0000","last_fullsized":"2024-03-30T12:39:25.311414+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876194+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:38:45.876194+0000","last_peered":"2024-03-30T12:38:45.876194+0000","last_clean":"2024-03-30T12:38:45.876194+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:38:45.876194+0000","last_undegraded":"2024-03-30T12:38:45.876194+0000","last_fullsized":"2024-03-30T12:38:45.876194+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651915+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:38:47.651915+0000","last_peered":"2024-03-30T12:38:47.651915+0000","last_clean":"2024-03-30T12:38:47.651915+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:38:47.651915+0000","last_undegraded":"2024-03-30T12:38:47.651915+0000","last_fullsized":"2024-03-30T12:38:47.651915+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920964+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:39:48.920964+0000","last_peered":"2024-03-30T12:39:48.920964+0000","last_clean":"2024-03-30T12:39:48.920964+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:39:48.920964+0000","last_undegraded":"2024-03-30T12:39:48.920964+0000","last_fullsized":"2024-03-30T12:39:48.920964+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1178,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558174+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:38:19.558174+0000","last_peered":"2024-03-30T12:38:19.558174+0000","last_clean":"2024-03-30T12:38:19.558174+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:38:19.558174+0000","last_undegraded":"2024-03-30T12:38:19.558174+0000","last_fullsized":"2024-03-30T12:38:19.558174+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1282,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651943+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:38:47.651943+0000","last_peered":"2024-03-30T12:38:47.651943+0000","last_clean":"2024-03-30T12:38:47.651943+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:38:47.651943+0000","last_undegraded":"2024-03-30T12:38:47.651943+0000","last_fullsized":"2024-03-30T12:38:47.651943+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:50.314509+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:39:50.314509+0000","last_peered":"2024-03-30T12:39:50.314509+0000","last_clean":"2024-03-30T12:39:50.314509+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:39:50.314509+0000","last_undegraded":"2024-03-30T12:39:50.314509+0000","last_fullsized":"2024-03-30T12:39:50.314509+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:12.654857+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:39:12.654857+0000","last_peered":"2024-03-30T12:39:12.654857+0000","last_clean":"2024-03-30T12:39:12.654857+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:39:12.654857+0000","last_undegraded":"2024-03-30T12:39:12.654857+0000","last_fullsized":"2024-03-30T12:39:12.654857+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1216,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:00.300996+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:38:00.300996+0000","last_peered":"2024-03-30T12:38:00.300996+0000","last_clean":"2024-03-30T12:38:00.300996+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:38:00.300996+0000","last_undegraded":"2024-03-30T12:38:00.300996+0000","last_fullsized":"2024-03-30T12:38:00.300996+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:45.883156+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:39:45.883156+0000","last_peered":"2024-03-30T12:39:45.883156+0000","last_clean":"2024-03-30T12:39:45.883156+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:39:45.883156+0000","last_undegraded":"2024-03-30T12:39:45.883156+0000","last_fullsized":"2024-03-30T12:39:45.883156+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.560418+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:38:39.560418+0000","last_peered":"2024-03-30T12:38:39.560418+0000","last_clean":"2024-03-30T12:38:39.560418+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:38:39.560418+0000","last_undegraded":"2024-03-30T12:38:39.560418+0000","last_fullsized":"2024-03-30T12:38:39.560418+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438094,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648150,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175160,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254399,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063217,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951274,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839331,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923614,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:42:07.605 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:07.605 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:07.605 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:07.605 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:07.605 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:07.605 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:07.605 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:07.605 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:07.605 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:07.605 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:07.605 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:07.605 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:07.606 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:07.606 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:42:09.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:08 smithi162 ceph-mon[83709]: pgmap v1172: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:09.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:08 smithi162 ceph-mon[83709]: from='client.44615 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:42:09.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:08 smithi084 ceph-mon[91810]: pgmap v1172: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:09.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:08 smithi084 ceph-mon[91810]: from='client.44615 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:42:09.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:08 smithi084 ceph-mon[89279]: pgmap v1172: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:09.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:08 smithi084 ceph-mon[89279]: from='client.44615 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:42:09.753 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:42:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:42:09] "GET /metrics HTTP/1.1" 200 36324 "" "Prometheus/2.43.0" 2024-03-30T12:42:11.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:10 smithi162 ceph-mon[83709]: pgmap v1173: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:11.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:10 smithi084 ceph-mon[91810]: pgmap v1173: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:11.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:10 smithi084 ceph-mon[89279]: pgmap v1173: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:13.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:12 smithi162 ceph-mon[83709]: pgmap v1174: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:13.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:12 smithi084 ceph-mon[91810]: pgmap v1174: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:13.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:12 smithi084 ceph-mon[89279]: pgmap v1174: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:15.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:14 smithi162 ceph-mon[83709]: pgmap v1175: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:15.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:14 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:42:15.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:14 smithi084 ceph-mon[89279]: pgmap v1175: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:15.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:14 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:42:15.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:14 smithi084 ceph-mon[91810]: pgmap v1175: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:15.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:14 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:42:16.119 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:15 smithi162 ceph-mon[83709]: pgmap v1176: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:16.120 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:42:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=cleanup t=2024-03-30T12:42:15.741059261Z level=info msg="Completed cleanup jobs" duration=3.251769ms 2024-03-30T12:42:16.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:15 smithi084 ceph-mon[89279]: pgmap v1176: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:16.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:15 smithi084 ceph-mon[91810]: pgmap v1176: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:17.607 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:42:17.827 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:42:18.200 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:17 smithi084 ceph-mon[91810]: pgmap v1177: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:18.201 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:17 smithi084 ceph-mon[89279]: pgmap v1177: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:18.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:17 smithi162 ceph-mon[83709]: pgmap v1177: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:19.508 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:42:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:42:19] "GET /metrics HTTP/1.1" 200 36318 "" "Prometheus/2.43.0" 2024-03-30T12:42:19.816 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:42:19.819 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:42:20.132 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:19 smithi084 ceph-mon[89279]: pgmap v1178: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:20.132 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:19 smithi084 ceph-mon[89279]: from='client.44621 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:42:20.132 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:19 smithi084 ceph-mon[91810]: pgmap v1178: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:20.132 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:19 smithi084 ceph-mon[91810]: from='client.44621 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:42:20.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:19 smithi162 ceph-mon[83709]: pgmap v1178: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:20.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:19 smithi162 ceph-mon[83709]: from='client.44621 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:42:20.504 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1178,"stamp":"2024-03-30T12:42:18.918481+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004486"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.138971+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:38:39.138971+0000","last_peered":"2024-03-30T12:38:39.138971+0000","last_clean":"2024-03-30T12:38:39.138971+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:38:39.138971+0000","last_undegraded":"2024-03-30T12:38:39.138971+0000","last_fullsized":"2024-03-30T12:38:39.138971+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1365,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917695+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:39:18.917695+0000","last_peered":"2024-03-30T12:39:18.917695+0000","last_clean":"2024-03-30T12:39:18.917695+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:39:18.917695+0000","last_undegraded":"2024-03-30T12:39:18.917695+0000","last_fullsized":"2024-03-30T12:39:18.917695+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876244+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:38:45.876244+0000","last_peered":"2024-03-30T12:38:45.876244+0000","last_clean":"2024-03-30T12:38:45.876244+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:38:45.876244+0000","last_undegraded":"2024-03-30T12:38:45.876244+0000","last_fullsized":"2024-03-30T12:38:45.876244+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308618+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:39:00.308618+0000","last_peered":"2024-03-30T12:39:00.308618+0000","last_clean":"2024-03-30T12:39:00.308618+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:39:00.308618+0000","last_undegraded":"2024-03-30T12:39:00.308618+0000","last_fullsized":"2024-03-30T12:39:00.308618+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133062+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:37:49.133062+0000","last_peered":"2024-03-30T12:37:49.133062+0000","last_clean":"2024-03-30T12:37:49.133062+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:37:49.133062+0000","last_undegraded":"2024-03-30T12:37:49.133062+0000","last_fullsized":"2024-03-30T12:37:49.133062+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1211,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308563+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:39:00.308563+0000","last_peered":"2024-03-30T12:39:00.308563+0000","last_clean":"2024-03-30T12:39:00.308563+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:39:00.308563+0000","last_undegraded":"2024-03-30T12:39:00.308563+0000","last_fullsized":"2024-03-30T12:39:00.308563+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133035+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:37:49.133035+0000","last_peered":"2024-03-30T12:37:49.133035+0000","last_clean":"2024-03-30T12:37:49.133035+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:37:49.133035+0000","last_undegraded":"2024-03-30T12:37:49.133035+0000","last_fullsized":"2024-03-30T12:37:49.133035+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647301+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:37:57.647301+0000","last_peered":"2024-03-30T12:37:57.647301+0000","last_clean":"2024-03-30T12:37:57.647301+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:37:57.647301+0000","last_undegraded":"2024-03-30T12:37:57.647301+0000","last_fullsized":"2024-03-30T12:37:57.647301+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:34.131337+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:37:34.131337+0000","last_peered":"2024-03-30T12:37:34.131337+0000","last_clean":"2024-03-30T12:37:34.131337+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:37:34.131337+0000","last_undegraded":"2024-03-30T12:37:34.131337+0000","last_fullsized":"2024-03-30T12:37:34.131337+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565540+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:39:19.565540+0000","last_peered":"2024-03-30T12:39:19.565540+0000","last_clean":"2024-03-30T12:39:19.565540+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:39:19.565540+0000","last_undegraded":"2024-03-30T12:39:19.565540+0000","last_fullsized":"2024-03-30T12:39:19.565540+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565513+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:39:19.565513+0000","last_peered":"2024-03-30T12:39:19.565513+0000","last_clean":"2024-03-30T12:39:19.565513+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:39:19.565513+0000","last_undegraded":"2024-03-30T12:39:19.565513+0000","last_fullsized":"2024-03-30T12:39:19.565513+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1271,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:12.285006+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:38:12.285006+0000","last_peered":"2024-03-30T12:38:12.285006+0000","last_clean":"2024-03-30T12:38:12.285006+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:38:12.285006+0000","last_undegraded":"2024-03-30T12:38:12.285006+0000","last_fullsized":"2024-03-30T12:38:12.285006+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1289,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645098+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:37:37.645098+0000","last_peered":"2024-03-30T12:37:37.645098+0000","last_clean":"2024-03-30T12:37:37.645098+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:37:37.645098+0000","last_undegraded":"2024-03-30T12:37:37.645098+0000","last_fullsized":"2024-03-30T12:37:37.645098+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870430+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:37:55.870430+0000","last_peered":"2024-03-30T12:37:55.870430+0000","last_clean":"2024-03-30T12:37:55.870430+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:37:55.870430+0000","last_undegraded":"2024-03-30T12:37:55.870430+0000","last_fullsized":"2024-03-30T12:37:55.870430+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:28.912065+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:38:28.912065+0000","last_peered":"2024-03-30T12:38:28.912065+0000","last_clean":"2024-03-30T12:38:28.912065+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:38:28.912065+0000","last_undegraded":"2024-03-30T12:38:28.912065+0000","last_fullsized":"2024-03-30T12:38:28.912065+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303373+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:38:20.303373+0000","last_peered":"2024-03-30T12:38:20.303373+0000","last_clean":"2024-03-30T12:38:20.303373+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:38:20.303373+0000","last_undegraded":"2024-03-30T12:38:20.303373+0000","last_fullsized":"2024-03-30T12:38:20.303373+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1225,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303460+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:38:20.303460+0000","last_peered":"2024-03-30T12:38:20.303460+0000","last_clean":"2024-03-30T12:38:20.303460+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:38:20.303460+0000","last_undegraded":"2024-03-30T12:38:20.303460+0000","last_fullsized":"2024-03-30T12:38:20.303460+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:03.388264+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:39:03.388264+0000","last_peered":"2024-03-30T12:39:03.388264+0000","last_clean":"2024-03-30T12:39:03.388264+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:39:03.388264+0000","last_undegraded":"2024-03-30T12:39:03.388264+0000","last_fullsized":"2024-03-30T12:39:03.388264+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143278+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:39:19.143278+0000","last_peered":"2024-03-30T12:39:19.143278+0000","last_clean":"2024-03-30T12:39:19.143278+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:39:19.143278+0000","last_undegraded":"2024-03-30T12:39:19.143278+0000","last_fullsized":"2024-03-30T12:39:19.143278+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1389,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876285+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:38:45.876285+0000","last_peered":"2024-03-30T12:38:45.876285+0000","last_clean":"2024-03-30T12:38:45.876285+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:38:45.876285+0000","last_undegraded":"2024-03-30T12:38:45.876285+0000","last_fullsized":"2024-03-30T12:38:45.876285+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1284,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659610+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:39:57.659610+0000","last_peered":"2024-03-30T12:39:57.659610+0000","last_clean":"2024-03-30T12:39:57.659610+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:39:57.659610+0000","last_undegraded":"2024-03-30T12:39:57.659610+0000","last_fullsized":"2024-03-30T12:39:57.659610+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1303,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659620+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:39:57.659620+0000","last_peered":"2024-03-30T12:39:57.659620+0000","last_clean":"2024-03-30T12:39:57.659620+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:39:57.659620+0000","last_undegraded":"2024-03-30T12:39:57.659620+0000","last_fullsized":"2024-03-30T12:39:57.659620+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876275+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:38:45.876275+0000","last_peered":"2024-03-30T12:38:45.876275+0000","last_clean":"2024-03-30T12:38:45.876275+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:38:45.876275+0000","last_undegraded":"2024-03-30T12:38:45.876275+0000","last_fullsized":"2024-03-30T12:38:45.876275+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1151,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133095+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:37:49.133095+0000","last_peered":"2024-03-30T12:37:49.133095+0000","last_clean":"2024-03-30T12:37:49.133095+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:37:49.133095+0000","last_undegraded":"2024-03-30T12:37:49.133095+0000","last_fullsized":"2024-03-30T12:37:49.133095+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1230,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308632+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:39:00.308632+0000","last_peered":"2024-03-30T12:39:00.308632+0000","last_clean":"2024-03-30T12:39:00.308632+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:39:00.308632+0000","last_undegraded":"2024-03-30T12:39:00.308632+0000","last_fullsized":"2024-03-30T12:39:00.308632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133077+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:37:49.133077+0000","last_peered":"2024-03-30T12:37:49.133077+0000","last_clean":"2024-03-30T12:37:49.133077+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:37:49.133077+0000","last_undegraded":"2024-03-30T12:37:49.133077+0000","last_fullsized":"2024-03-30T12:37:49.133077+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308643+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:39:00.308643+0000","last_peered":"2024-03-30T12:39:00.308643+0000","last_clean":"2024-03-30T12:39:00.308643+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:39:00.308643+0000","last_undegraded":"2024-03-30T12:39:00.308643+0000","last_fullsized":"2024-03-30T12:39:00.308643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647433+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:37:57.647433+0000","last_peered":"2024-03-30T12:37:57.647433+0000","last_clean":"2024-03-30T12:37:57.647433+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:37:57.647433+0000","last_undegraded":"2024-03-30T12:37:57.647433+0000","last_fullsized":"2024-03-30T12:37:57.647433+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1263,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:32.286955+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:38:32.286955+0000","last_peered":"2024-03-30T12:38:32.286955+0000","last_clean":"2024-03-30T12:38:32.286955+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:38:32.286955+0000","last_undegraded":"2024-03-30T12:38:32.286955+0000","last_fullsized":"2024-03-30T12:38:32.286955+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1181,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.567808+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:39:39.567808+0000","last_peered":"2024-03-30T12:39:39.567808+0000","last_clean":"2024-03-30T12:39:39.567808+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:39:39.567808+0000","last_undegraded":"2024-03-30T12:39:39.567808+0000","last_fullsized":"2024-03-30T12:39:39.567808+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876233+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:38:45.876233+0000","last_peered":"2024-03-30T12:38:45.876233+0000","last_clean":"2024-03-30T12:38:45.876233+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:38:45.876233+0000","last_undegraded":"2024-03-30T12:38:45.876233+0000","last_fullsized":"2024-03-30T12:38:45.876233+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645072+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:37:37.645072+0000","last_peered":"2024-03-30T12:37:37.645072+0000","last_clean":"2024-03-30T12:37:37.645072+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:37:37.645072+0000","last_undegraded":"2024-03-30T12:37:37.645072+0000","last_fullsized":"2024-03-30T12:37:37.645072+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1295,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:37.645031+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:37:37.645031+0000","last_peered":"2024-03-30T12:37:37.645031+0000","last_clean":"2024-03-30T12:37:37.645031+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:37:37.645031+0000","last_undegraded":"2024-03-30T12:37:37.645031+0000","last_fullsized":"2024-03-30T12:37:37.645031+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1225,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306130+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:38:40.306130+0000","last_peered":"2024-03-30T12:38:40.306130+0000","last_clean":"2024-03-30T12:38:40.306130+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:38:40.306130+0000","last_undegraded":"2024-03-30T12:38:40.306130+0000","last_fullsized":"2024-03-30T12:38:40.306130+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:53.914730+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:38:53.914730+0000","last_peered":"2024-03-30T12:38:53.914730+0000","last_clean":"2024-03-30T12:38:53.914730+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:38:53.914730+0000","last_undegraded":"2024-03-30T12:38:53.914730+0000","last_fullsized":"2024-03-30T12:38:53.914730+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565553+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:39:19.565553+0000","last_peered":"2024-03-30T12:39:19.565553+0000","last_clean":"2024-03-30T12:39:19.565553+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:39:19.565553+0000","last_undegraded":"2024-03-30T12:39:19.565553+0000","last_fullsized":"2024-03-30T12:39:19.565553+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306212+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:38:40.306212+0000","last_peered":"2024-03-30T12:38:40.306212+0000","last_clean":"2024-03-30T12:38:40.306212+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:38:40.306212+0000","last_undegraded":"2024-03-30T12:38:40.306212+0000","last_fullsized":"2024-03-30T12:38:40.306212+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1199,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306200+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:38:40.306200+0000","last_peered":"2024-03-30T12:38:40.306200+0000","last_clean":"2024-03-30T12:38:40.306200+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:38:40.306200+0000","last_undegraded":"2024-03-30T12:38:40.306200+0000","last_fullsized":"2024-03-30T12:38:40.306200+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1292,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:28.391470+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:39:28.391470+0000","last_peered":"2024-03-30T12:39:28.391470+0000","last_clean":"2024-03-30T12:39:28.391470+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:39:28.391470+0000","last_undegraded":"2024-03-30T12:39:28.391470+0000","last_fullsized":"2024-03-30T12:39:28.391470+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:53.914770+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:38:53.914770+0000","last_peered":"2024-03-30T12:38:53.914770+0000","last_clean":"2024-03-30T12:38:53.914770+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:38:53.914770+0000","last_undegraded":"2024-03-30T12:38:53.914770+0000","last_fullsized":"2024-03-30T12:38:53.914770+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:52.282667+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:37:52.282667+0000","last_peered":"2024-03-30T12:37:52.282667+0000","last_clean":"2024-03-30T12:37:52.282667+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:37:52.282667+0000","last_undegraded":"2024-03-30T12:37:52.282667+0000","last_fullsized":"2024-03-30T12:37:52.282667+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562847+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:38:59.562847+0000","last_peered":"2024-03-30T12:38:59.562847+0000","last_clean":"2024-03-30T12:38:59.562847+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:38:59.562847+0000","last_undegraded":"2024-03-30T12:38:59.562847+0000","last_fullsized":"2024-03-30T12:38:59.562847+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:34.131303+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:37:34.131303+0000","last_peered":"2024-03-30T12:37:34.131303+0000","last_clean":"2024-03-30T12:37:34.131303+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:37:34.131303+0000","last_undegraded":"2024-03-30T12:37:34.131303+0000","last_fullsized":"2024-03-30T12:37:34.131303+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1384,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870514+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:37:55.870514+0000","last_peered":"2024-03-30T12:37:55.870514+0000","last_clean":"2024-03-30T12:37:55.870514+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:37:55.870514+0000","last_undegraded":"2024-03-30T12:37:55.870514+0000","last_fullsized":"2024-03-30T12:37:55.870514+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870486+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:37:55.870486+0000","last_peered":"2024-03-30T12:37:55.870486+0000","last_clean":"2024-03-30T12:37:55.870486+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:37:55.870486+0000","last_undegraded":"2024-03-30T12:37:55.870486+0000","last_fullsized":"2024-03-30T12:37:55.870486+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303405+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:38:20.303405+0000","last_peered":"2024-03-30T12:38:20.303405+0000","last_clean":"2024-03-30T12:38:20.303405+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:38:20.303405+0000","last_undegraded":"2024-03-30T12:38:20.303405+0000","last_fullsized":"2024-03-30T12:38:20.303405+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.145725+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:39:39.145725+0000","last_peered":"2024-03-30T12:39:39.145725+0000","last_clean":"2024-03-30T12:39:39.145725+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:39:39.145725+0000","last_undegraded":"2024-03-30T12:39:39.145725+0000","last_fullsized":"2024-03-30T12:39:39.145725+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562815+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:38:59.562815+0000","last_peered":"2024-03-30T12:38:59.562815+0000","last_clean":"2024-03-30T12:38:59.562815+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:38:59.562815+0000","last_undegraded":"2024-03-30T12:38:59.562815+0000","last_fullsized":"2024-03-30T12:38:59.562815+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562788+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:38:59.562788+0000","last_peered":"2024-03-30T12:38:59.562788+0000","last_clean":"2024-03-30T12:38:59.562788+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:38:59.562788+0000","last_undegraded":"2024-03-30T12:38:59.562788+0000","last_fullsized":"2024-03-30T12:38:59.562788+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:03.388191+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:39:03.388191+0000","last_peered":"2024-03-30T12:39:03.388191+0000","last_clean":"2024-03-30T12:39:03.388191+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:39:03.388191+0000","last_undegraded":"2024-03-30T12:39:03.388191+0000","last_fullsized":"2024-03-30T12:39:03.388191+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.145661+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:39:39.145661+0000","last_peered":"2024-03-30T12:39:39.145661+0000","last_clean":"2024-03-30T12:39:39.145661+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:39:39.145661+0000","last_undegraded":"2024-03-30T12:39:39.145661+0000","last_fullsized":"2024-03-30T12:39:39.145661+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5753,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:13.383127+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:38:13.383127+0000","last_peered":"2024-03-30T12:38:13.383127+0000","last_clean":"2024-03-30T12:38:13.383127+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:38:13.383127+0000","last_undegraded":"2024-03-30T12:38:13.383127+0000","last_fullsized":"2024-03-30T12:38:13.383127+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1276,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:47.295052+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:39:47.295052+0000","last_peered":"2024-03-30T12:39:47.295052+0000","last_clean":"2024-03-30T12:39:47.295052+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:39:47.295052+0000","last_undegraded":"2024-03-30T12:39:47.295052+0000","last_fullsized":"2024-03-30T12:39:47.295052+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143289+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:39:19.143289+0000","last_peered":"2024-03-30T12:39:19.143289+0000","last_clean":"2024-03-30T12:39:19.143289+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:39:19.143289+0000","last_undegraded":"2024-03-30T12:39:19.143289+0000","last_fullsized":"2024-03-30T12:39:19.143289+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5514,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:45.876204+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:38:45.876204+0000","last_peered":"2024-03-30T12:38:45.876204+0000","last_clean":"2024-03-30T12:38:45.876204+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:38:45.876204+0000","last_undegraded":"2024-03-30T12:38:45.876204+0000","last_fullsized":"2024-03-30T12:38:45.876204+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917640+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:39:18.917640+0000","last_peered":"2024-03-30T12:39:18.917640+0000","last_clean":"2024-03-30T12:39:18.917640+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:39:18.917640+0000","last_undegraded":"2024-03-30T12:39:18.917640+0000","last_fullsized":"2024-03-30T12:39:18.917640+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917662+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:39:18.917662+0000","last_peered":"2024-03-30T12:39:18.917662+0000","last_clean":"2024-03-30T12:39:18.917662+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:39:18.917662+0000","last_undegraded":"2024-03-30T12:39:18.917662+0000","last_fullsized":"2024-03-30T12:39:18.917662+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311465+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:39:25.311465+0000","last_peered":"2024-03-30T12:39:25.311465+0000","last_clean":"2024-03-30T12:39:25.311465+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:39:25.311465+0000","last_undegraded":"2024-03-30T12:39:25.311465+0000","last_fullsized":"2024-03-30T12:39:25.311465+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5459,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:45.876257+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:38:45.876257+0000","last_peered":"2024-03-30T12:38:45.876257+0000","last_clean":"2024-03-30T12:38:45.876257+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:38:45.876257+0000","last_undegraded":"2024-03-30T12:38:45.876257+0000","last_fullsized":"2024-03-30T12:38:45.876257+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917672+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:39:18.917672+0000","last_peered":"2024-03-30T12:39:18.917672+0000","last_clean":"2024-03-30T12:39:18.917672+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:39:18.917672+0000","last_undegraded":"2024-03-30T12:39:18.917672+0000","last_fullsized":"2024-03-30T12:39:18.917672+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1208,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311386+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:39:25.311386+0000","last_peered":"2024-03-30T12:39:25.311386+0000","last_clean":"2024-03-30T12:39:25.311386+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:39:25.311386+0000","last_undegraded":"2024-03-30T12:39:25.311386+0000","last_fullsized":"2024-03-30T12:39:25.311386+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:57.289543+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:38:57.289543+0000","last_peered":"2024-03-30T12:38:57.289543+0000","last_clean":"2024-03-30T12:38:57.289543+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:38:57.289543+0000","last_undegraded":"2024-03-30T12:38:57.289543+0000","last_fullsized":"2024-03-30T12:38:57.289543+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3804,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:13.383237+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:38:13.383237+0000","last_peered":"2024-03-30T12:38:13.383237+0000","last_clean":"2024-03-30T12:38:13.383237+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:38:13.383237+0000","last_undegraded":"2024-03-30T12:38:13.383237+0000","last_fullsized":"2024-03-30T12:38:13.383237+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1344,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920990+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:39:48.920990+0000","last_peered":"2024-03-30T12:39:48.920990+0000","last_clean":"2024-03-30T12:39:48.920990+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:39:48.920990+0000","last_undegraded":"2024-03-30T12:39:48.920990+0000","last_fullsized":"2024-03-30T12:39:48.920990+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:48.914183+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:38:48.914183+0000","last_peered":"2024-03-30T12:38:48.914183+0000","last_clean":"2024-03-30T12:38:48.914183+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:38:48.914183+0000","last_undegraded":"2024-03-30T12:38:48.914183+0000","last_fullsized":"2024-03-30T12:38:48.914183+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:53.394025+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:39:53.394025+0000","last_peered":"2024-03-30T12:39:53.394025+0000","last_clean":"2024-03-30T12:39:53.394025+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:39:53.394025+0000","last_undegraded":"2024-03-30T12:39:53.394025+0000","last_fullsized":"2024-03-30T12:39:53.394025+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4577,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:39.138875+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:38:39.138875+0000","last_peered":"2024-03-30T12:38:39.138875+0000","last_clean":"2024-03-30T12:38:39.138875+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:38:39.138875+0000","last_undegraded":"2024-03-30T12:38:39.138875+0000","last_fullsized":"2024-03-30T12:38:39.138875+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1176,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:04.570573+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:40:04.570573+0000","last_peered":"2024-03-30T12:40:04.570573+0000","last_clean":"2024-03-30T12:40:04.570573+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:40:04.570573+0000","last_undegraded":"2024-03-30T12:40:04.570573+0000","last_fullsized":"2024-03-30T12:40:04.570573+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:22.649643+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:38:22.649643+0000","last_peered":"2024-03-30T12:38:22.649643+0000","last_clean":"2024-03-30T12:38:22.649643+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:38:22.649643+0000","last_undegraded":"2024-03-30T12:38:22.649643+0000","last_fullsized":"2024-03-30T12:38:22.649643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1201,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311442+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:39:25.311442+0000","last_peered":"2024-03-30T12:39:25.311442+0000","last_clean":"2024-03-30T12:39:25.311442+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:39:25.311442+0000","last_undegraded":"2024-03-30T12:39:25.311442+0000","last_fullsized":"2024-03-30T12:39:25.311442+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1717,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.136726+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:38:19.136726+0000","last_peered":"2024-03-30T12:38:19.136726+0000","last_clean":"2024-03-30T12:38:19.136726+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:38:19.136726+0000","last_undegraded":"2024-03-30T12:38:19.136726+0000","last_fullsized":"2024-03-30T12:38:19.136726+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24715,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:39:50.314565+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:39:50.314565+0000","last_peered":"2024-03-30T12:39:50.314565+0000","last_clean":"2024-03-30T12:39:50.314565+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:39:50.314565+0000","last_undegraded":"2024-03-30T12:39:50.314565+0000","last_fullsized":"2024-03-30T12:39:50.314565+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:15.879816+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:39:15.879816+0000","last_peered":"2024-03-30T12:39:15.879816+0000","last_clean":"2024-03-30T12:39:15.879816+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:39:15.879816+0000","last_undegraded":"2024-03-30T12:39:15.879816+0000","last_fullsized":"2024-03-30T12:39:15.879816+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876163+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:38:45.876163+0000","last_peered":"2024-03-30T12:38:45.876163+0000","last_clean":"2024-03-30T12:38:45.876163+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:38:45.876163+0000","last_undegraded":"2024-03-30T12:38:45.876163+0000","last_fullsized":"2024-03-30T12:38:45.876163+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.136697+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:38:19.136697+0000","last_peered":"2024-03-30T12:38:19.136697+0000","last_clean":"2024-03-30T12:38:19.136697+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:38:19.136697+0000","last_undegraded":"2024-03-30T12:38:19.136697+0000","last_fullsized":"2024-03-30T12:38:19.136697+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16482,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:04.570536+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:40:04.570536+0000","last_peered":"2024-03-30T12:40:04.570536+0000","last_clean":"2024-03-30T12:40:04.570536+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:40:04.570536+0000","last_undegraded":"2024-03-30T12:40:04.570536+0000","last_fullsized":"2024-03-30T12:40:04.570536+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876223+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:38:45.876223+0000","last_peered":"2024-03-30T12:38:45.876223+0000","last_clean":"2024-03-30T12:38:45.876223+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:38:45.876223+0000","last_undegraded":"2024-03-30T12:38:45.876223+0000","last_fullsized":"2024-03-30T12:38:45.876223+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1164,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.138928+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:38:39.138928+0000","last_peered":"2024-03-30T12:38:39.138928+0000","last_clean":"2024-03-30T12:38:39.138928+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:38:39.138928+0000","last_undegraded":"2024-03-30T12:38:39.138928+0000","last_fullsized":"2024-03-30T12:38:39.138928+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917681+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:39:18.917681+0000","last_peered":"2024-03-30T12:39:18.917681+0000","last_clean":"2024-03-30T12:39:18.917681+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:39:18.917681+0000","last_undegraded":"2024-03-30T12:39:18.917681+0000","last_fullsized":"2024-03-30T12:39:18.917681+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31270,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:57.289492+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:38:57.289492+0000","last_peered":"2024-03-30T12:38:57.289492+0000","last_clean":"2024-03-30T12:38:57.289492+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:38:57.289492+0000","last_undegraded":"2024-03-30T12:38:57.289492+0000","last_fullsized":"2024-03-30T12:38:57.289492+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659585+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:39:57.659585+0000","last_peered":"2024-03-30T12:39:57.659585+0000","last_clean":"2024-03-30T12:39:57.659585+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:39:57.659585+0000","last_undegraded":"2024-03-30T12:39:57.659585+0000","last_fullsized":"2024-03-30T12:39:57.659585+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1355,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920979+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:39:48.920979+0000","last_peered":"2024-03-30T12:39:48.920979+0000","last_clean":"2024-03-30T12:39:48.920979+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:39:48.920979+0000","last_undegraded":"2024-03-30T12:39:48.920979+0000","last_fullsized":"2024-03-30T12:39:48.920979+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651932+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:38:47.651932+0000","last_peered":"2024-03-30T12:38:47.651932+0000","last_clean":"2024-03-30T12:38:47.651932+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:38:47.651932+0000","last_undegraded":"2024-03-30T12:38:47.651932+0000","last_fullsized":"2024-03-30T12:38:47.651932+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3766,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659555+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:39:57.659555+0000","last_peered":"2024-03-30T12:39:57.659555+0000","last_clean":"2024-03-30T12:39:57.659555+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:39:57.659555+0000","last_undegraded":"2024-03-30T12:39:57.659555+0000","last_fullsized":"2024-03-30T12:39:57.659555+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:57.289460+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:38:57.289460+0000","last_peered":"2024-03-30T12:38:57.289460+0000","last_clean":"2024-03-30T12:38:57.289460+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:38:57.289460+0000","last_undegraded":"2024-03-30T12:38:57.289460+0000","last_fullsized":"2024-03-30T12:38:57.289460+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1156,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558186+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:38:19.558186+0000","last_peered":"2024-03-30T12:38:19.558186+0000","last_clean":"2024-03-30T12:38:19.558186+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:38:19.558186+0000","last_undegraded":"2024-03-30T12:38:19.558186+0000","last_fullsized":"2024-03-30T12:38:19.558186+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:15.879792+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:39:15.879792+0000","last_peered":"2024-03-30T12:39:15.879792+0000","last_clean":"2024-03-30T12:39:15.879792+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:39:15.879792+0000","last_undegraded":"2024-03-30T12:39:15.879792+0000","last_fullsized":"2024-03-30T12:39:15.879792+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15594,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:00.301062+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:38:00.301062+0000","last_peered":"2024-03-30T12:38:00.301062+0000","last_clean":"2024-03-30T12:38:00.301062+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:38:00.301062+0000","last_undegraded":"2024-03-30T12:38:00.301062+0000","last_fullsized":"2024-03-30T12:38:00.301062+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.141061+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:38:59.141061+0000","last_peered":"2024-03-30T12:38:59.141061+0000","last_clean":"2024-03-30T12:38:59.141061+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:38:59.141061+0000","last_undegraded":"2024-03-30T12:38:59.141061+0000","last_fullsized":"2024-03-30T12:38:59.141061+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:22.292071+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:39:22.292071+0000","last_peered":"2024-03-30T12:39:22.292071+0000","last_clean":"2024-03-30T12:39:22.292071+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:39:22.292071+0000","last_undegraded":"2024-03-30T12:39:22.292071+0000","last_fullsized":"2024-03-30T12:39:22.292071+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29021,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:39:47.295005+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:39:47.295005+0000","last_peered":"2024-03-30T12:39:47.295005+0000","last_clean":"2024-03-30T12:39:47.295005+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:39:47.295005+0000","last_undegraded":"2024-03-30T12:39:47.295005+0000","last_fullsized":"2024-03-30T12:39:47.295005+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920913+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:39:48.920913+0000","last_peered":"2024-03-30T12:39:48.920913+0000","last_clean":"2024-03-30T12:39:48.920913+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:39:48.920913+0000","last_undegraded":"2024-03-30T12:39:48.920913+0000","last_fullsized":"2024-03-30T12:39:48.920913+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651850+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:38:47.651850+0000","last_peered":"2024-03-30T12:38:47.651850+0000","last_clean":"2024-03-30T12:38:47.651850+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:38:47.651850+0000","last_undegraded":"2024-03-30T12:38:47.651850+0000","last_fullsized":"2024-03-30T12:38:47.651850+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5611,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:38.385807+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:38:38.385807+0000","last_peered":"2024-03-30T12:38:38.385807+0000","last_clean":"2024-03-30T12:38:38.385807+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:38:38.385807+0000","last_undegraded":"2024-03-30T12:38:38.385807+0000","last_fullsized":"2024-03-30T12:38:38.385807+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1366,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920941+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:39:48.920941+0000","last_peered":"2024-03-30T12:39:48.920941+0000","last_clean":"2024-03-30T12:39:48.920941+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:39:48.920941+0000","last_undegraded":"2024-03-30T12:39:48.920941+0000","last_fullsized":"2024-03-30T12:39:48.920941+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:12.654884+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:39:12.654884+0000","last_peered":"2024-03-30T12:39:12.654884+0000","last_clean":"2024-03-30T12:39:12.654884+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:39:12.654884+0000","last_undegraded":"2024-03-30T12:39:12.654884+0000","last_fullsized":"2024-03-30T12:39:12.654884+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4275,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:03.909427+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:38:03.909427+0000","last_peered":"2024-03-30T12:38:03.909427+0000","last_clean":"2024-03-30T12:38:03.909427+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:38:03.909427+0000","last_undegraded":"2024-03-30T12:38:03.909427+0000","last_fullsized":"2024-03-30T12:38:03.909427+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143221+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:39:19.143221+0000","last_peered":"2024-03-30T12:39:19.143221+0000","last_clean":"2024-03-30T12:39:19.143221+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:39:19.143221+0000","last_undegraded":"2024-03-30T12:39:19.143221+0000","last_fullsized":"2024-03-30T12:39:19.143221+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558134+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:38:19.558134+0000","last_peered":"2024-03-30T12:38:19.558134+0000","last_clean":"2024-03-30T12:38:19.558134+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:38:19.558134+0000","last_undegraded":"2024-03-30T12:38:19.558134+0000","last_fullsized":"2024-03-30T12:38:19.558134+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5254,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:38.385765+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:38:38.385765+0000","last_peered":"2024-03-30T12:38:38.385765+0000","last_clean":"2024-03-30T12:38:38.385765+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:38:38.385765+0000","last_undegraded":"2024-03-30T12:38:38.385765+0000","last_fullsized":"2024-03-30T12:38:38.385765+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:38.385797+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:38:38.385797+0000","last_peered":"2024-03-30T12:38:38.385797+0000","last_clean":"2024-03-30T12:38:38.385797+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:38:38.385797+0000","last_undegraded":"2024-03-30T12:38:38.385797+0000","last_fullsized":"2024-03-30T12:38:38.385797+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143264+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:39:19.143264+0000","last_peered":"2024-03-30T12:39:19.143264+0000","last_clean":"2024-03-30T12:39:19.143264+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:39:19.143264+0000","last_undegraded":"2024-03-30T12:39:19.143264+0000","last_fullsized":"2024-03-30T12:39:19.143264+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4811,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:13.383202+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:38:13.383202+0000","last_peered":"2024-03-30T12:38:13.383202+0000","last_clean":"2024-03-30T12:38:13.383202+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:38:13.383202+0000","last_undegraded":"2024-03-30T12:38:13.383202+0000","last_fullsized":"2024-03-30T12:38:13.383202+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:03.909462+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:38:03.909462+0000","last_peered":"2024-03-30T12:38:03.909462+0000","last_clean":"2024-03-30T12:38:03.909462+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:38:03.909462+0000","last_undegraded":"2024-03-30T12:38:03.909462+0000","last_fullsized":"2024-03-30T12:38:03.909462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:00.301034+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:38:00.301034+0000","last_peered":"2024-03-30T12:38:00.301034+0000","last_clean":"2024-03-30T12:38:00.301034+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:38:00.301034+0000","last_undegraded":"2024-03-30T12:38:00.301034+0000","last_fullsized":"2024-03-30T12:38:00.301034+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6744,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:59.141086+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:38:59.141086+0000","last_peered":"2024-03-30T12:38:59.141086+0000","last_clean":"2024-03-30T12:38:59.141086+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:38:59.141086+0000","last_undegraded":"2024-03-30T12:38:59.141086+0000","last_fullsized":"2024-03-30T12:38:59.141086+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1338,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:38.385827+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:38:38.385827+0000","last_peered":"2024-03-30T12:38:38.385827+0000","last_clean":"2024-03-30T12:38:38.385827+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:38:38.385827+0000","last_undegraded":"2024-03-30T12:38:38.385827+0000","last_fullsized":"2024-03-30T12:38:38.385827+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143303+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:39:19.143303+0000","last_peered":"2024-03-30T12:39:19.143303+0000","last_clean":"2024-03-30T12:39:19.143303+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:39:19.143303+0000","last_undegraded":"2024-03-30T12:39:19.143303+0000","last_fullsized":"2024-03-30T12:39:19.143303+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:04.570502+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:40:04.570502+0000","last_peered":"2024-03-30T12:40:04.570502+0000","last_clean":"2024-03-30T12:40:04.570502+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:40:04.570502+0000","last_undegraded":"2024-03-30T12:40:04.570502+0000","last_fullsized":"2024-03-30T12:40:04.570502+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:53.394048+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:39:53.394048+0000","last_peered":"2024-03-30T12:39:53.394048+0000","last_clean":"2024-03-30T12:39:53.394048+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:39:53.394048+0000","last_undegraded":"2024-03-30T12:39:53.394048+0000","last_fullsized":"2024-03-30T12:39:53.394048+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311414+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:39:25.311414+0000","last_peered":"2024-03-30T12:39:25.311414+0000","last_clean":"2024-03-30T12:39:25.311414+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:39:25.311414+0000","last_undegraded":"2024-03-30T12:39:25.311414+0000","last_fullsized":"2024-03-30T12:39:25.311414+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876194+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:38:45.876194+0000","last_peered":"2024-03-30T12:38:45.876194+0000","last_clean":"2024-03-30T12:38:45.876194+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:38:45.876194+0000","last_undegraded":"2024-03-30T12:38:45.876194+0000","last_fullsized":"2024-03-30T12:38:45.876194+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651915+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:38:47.651915+0000","last_peered":"2024-03-30T12:38:47.651915+0000","last_clean":"2024-03-30T12:38:47.651915+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:38:47.651915+0000","last_undegraded":"2024-03-30T12:38:47.651915+0000","last_fullsized":"2024-03-30T12:38:47.651915+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920964+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:39:48.920964+0000","last_peered":"2024-03-30T12:39:48.920964+0000","last_clean":"2024-03-30T12:39:48.920964+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:39:48.920964+0000","last_undegraded":"2024-03-30T12:39:48.920964+0000","last_fullsized":"2024-03-30T12:39:48.920964+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1178,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558174+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:38:19.558174+0000","last_peered":"2024-03-30T12:38:19.558174+0000","last_clean":"2024-03-30T12:38:19.558174+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:38:19.558174+0000","last_undegraded":"2024-03-30T12:38:19.558174+0000","last_fullsized":"2024-03-30T12:38:19.558174+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1282,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651943+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:38:47.651943+0000","last_peered":"2024-03-30T12:38:47.651943+0000","last_clean":"2024-03-30T12:38:47.651943+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:38:47.651943+0000","last_undegraded":"2024-03-30T12:38:47.651943+0000","last_fullsized":"2024-03-30T12:38:47.651943+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:50.314509+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:39:50.314509+0000","last_peered":"2024-03-30T12:39:50.314509+0000","last_clean":"2024-03-30T12:39:50.314509+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:39:50.314509+0000","last_undegraded":"2024-03-30T12:39:50.314509+0000","last_fullsized":"2024-03-30T12:39:50.314509+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:12.654857+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:39:12.654857+0000","last_peered":"2024-03-30T12:39:12.654857+0000","last_clean":"2024-03-30T12:39:12.654857+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:39:12.654857+0000","last_undegraded":"2024-03-30T12:39:12.654857+0000","last_fullsized":"2024-03-30T12:39:12.654857+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1216,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:00.300996+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:38:00.300996+0000","last_peered":"2024-03-30T12:38:00.300996+0000","last_clean":"2024-03-30T12:38:00.300996+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:38:00.300996+0000","last_undegraded":"2024-03-30T12:38:00.300996+0000","last_fullsized":"2024-03-30T12:38:00.300996+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:45.883156+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:39:45.883156+0000","last_peered":"2024-03-30T12:39:45.883156+0000","last_clean":"2024-03-30T12:39:45.883156+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:39:45.883156+0000","last_undegraded":"2024-03-30T12:39:45.883156+0000","last_fullsized":"2024-03-30T12:39:45.883156+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.560418+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:38:39.560418+0000","last_peered":"2024-03-30T12:38:39.560418+0000","last_clean":"2024-03-30T12:38:39.560418+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:38:39.560418+0000","last_undegraded":"2024-03-30T12:38:39.560418+0000","last_fullsized":"2024-03-30T12:38:39.560418+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438096,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648152,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175162,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254401,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063220,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951277,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839334,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923616,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:42:20.509 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:20.509 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:20.509 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:20.510 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:20.510 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:20.510 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:20.510 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:20.510 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:20.510 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:20.510 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:20.510 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:20.510 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:20.510 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:20.510 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:42:22.004 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:21 smithi084 ceph-mon[89279]: pgmap v1179: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:22.004 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:21 smithi084 ceph-mon[91810]: pgmap v1179: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:22.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:21 smithi162 ceph-mon[83709]: pgmap v1179: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:24.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:23 smithi084 ceph-mon[89279]: pgmap v1180: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:24.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:23 smithi084 ceph-mon[91810]: pgmap v1180: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:24.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:23 smithi162 ceph-mon[83709]: pgmap v1180: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:26.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:25 smithi084 ceph-mon[89279]: pgmap v1181: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:26.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:25 smithi084 ceph-mon[91810]: pgmap v1181: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:26.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:25 smithi162 ceph-mon[83709]: pgmap v1181: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:28.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:27 smithi084 ceph-mon[91810]: pgmap v1182: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:28.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:27 smithi084 ceph-mon[89279]: pgmap v1182: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:28.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:27 smithi162 ceph-mon[83709]: pgmap v1182: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:29.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:42:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:42:29] "GET /metrics HTTP/1.1" 200 36318 "" "Prometheus/2.43.0" 2024-03-30T12:42:30.253 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:29 smithi084 ceph-mon[91810]: pgmap v1183: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:30.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:29 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:42:30.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:29 smithi084 ceph-mon[89279]: pgmap v1183: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:30.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:29 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:42:30.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:29 smithi162 ceph-mon[83709]: pgmap v1183: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:30.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:29 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:42:30.511 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:42:30.747 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:42:31.184 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:30 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:42:31.184 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:30 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:42:31.369 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:30 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:42:32.073 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:31 smithi084 ceph-mon[89279]: pgmap v1184: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:32.073 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:31 smithi084 ceph-mon[91810]: pgmap v1184: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:32.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:31 smithi162 ceph-mon[83709]: pgmap v1184: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:32.820 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:42:32.822 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:42:33.006 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:32 smithi084 ceph-mon[91810]: from='client.44627 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:42:33.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:32 smithi084 ceph-mon[89279]: from='client.44627 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:42:33.284 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:32 smithi162 ceph-mon[83709]: from='client.44627 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:42:33.987 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1184,"stamp":"2024-03-30T12:42:30.922508+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004026"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.138971+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:38:39.138971+0000","last_peered":"2024-03-30T12:38:39.138971+0000","last_clean":"2024-03-30T12:38:39.138971+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:38:39.138971+0000","last_undegraded":"2024-03-30T12:38:39.138971+0000","last_fullsized":"2024-03-30T12:38:39.138971+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1365,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917695+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:39:18.917695+0000","last_peered":"2024-03-30T12:39:18.917695+0000","last_clean":"2024-03-30T12:39:18.917695+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:39:18.917695+0000","last_undegraded":"2024-03-30T12:39:18.917695+0000","last_fullsized":"2024-03-30T12:39:18.917695+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876244+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:38:45.876244+0000","last_peered":"2024-03-30T12:38:45.876244+0000","last_clean":"2024-03-30T12:38:45.876244+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:38:45.876244+0000","last_undegraded":"2024-03-30T12:38:45.876244+0000","last_fullsized":"2024-03-30T12:38:45.876244+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308618+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:39:00.308618+0000","last_peered":"2024-03-30T12:39:00.308618+0000","last_clean":"2024-03-30T12:39:00.308618+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:39:00.308618+0000","last_undegraded":"2024-03-30T12:39:00.308618+0000","last_fullsized":"2024-03-30T12:39:00.308618+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133062+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:37:49.133062+0000","last_peered":"2024-03-30T12:37:49.133062+0000","last_clean":"2024-03-30T12:37:49.133062+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:37:49.133062+0000","last_undegraded":"2024-03-30T12:37:49.133062+0000","last_fullsized":"2024-03-30T12:37:49.133062+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1211,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308563+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:39:00.308563+0000","last_peered":"2024-03-30T12:39:00.308563+0000","last_clean":"2024-03-30T12:39:00.308563+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:39:00.308563+0000","last_undegraded":"2024-03-30T12:39:00.308563+0000","last_fullsized":"2024-03-30T12:39:00.308563+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133035+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:37:49.133035+0000","last_peered":"2024-03-30T12:37:49.133035+0000","last_clean":"2024-03-30T12:37:49.133035+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:37:49.133035+0000","last_undegraded":"2024-03-30T12:37:49.133035+0000","last_fullsized":"2024-03-30T12:37:49.133035+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647301+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:37:57.647301+0000","last_peered":"2024-03-30T12:37:57.647301+0000","last_clean":"2024-03-30T12:37:57.647301+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:37:57.647301+0000","last_undegraded":"2024-03-30T12:37:57.647301+0000","last_fullsized":"2024-03-30T12:37:57.647301+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:59.148225+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:39:59.148225+0000","last_peered":"2024-03-30T12:39:59.148225+0000","last_clean":"2024-03-30T12:39:59.148225+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:39:59.148225+0000","last_undegraded":"2024-03-30T12:39:59.148225+0000","last_fullsized":"2024-03-30T12:39:59.148225+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565540+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:39:19.565540+0000","last_peered":"2024-03-30T12:39:19.565540+0000","last_clean":"2024-03-30T12:39:19.565540+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:39:19.565540+0000","last_undegraded":"2024-03-30T12:39:19.565540+0000","last_fullsized":"2024-03-30T12:39:19.565540+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565513+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:39:19.565513+0000","last_peered":"2024-03-30T12:39:19.565513+0000","last_clean":"2024-03-30T12:39:19.565513+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:39:19.565513+0000","last_undegraded":"2024-03-30T12:39:19.565513+0000","last_fullsized":"2024-03-30T12:39:19.565513+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1271,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:12.285006+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:38:12.285006+0000","last_peered":"2024-03-30T12:38:12.285006+0000","last_clean":"2024-03-30T12:38:12.285006+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:38:12.285006+0000","last_undegraded":"2024-03-30T12:38:12.285006+0000","last_fullsized":"2024-03-30T12:38:12.285006+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660090+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:40:02.660090+0000","last_peered":"2024-03-30T12:40:02.660090+0000","last_clean":"2024-03-30T12:40:02.660090+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:40:02.660090+0000","last_undegraded":"2024-03-30T12:40:02.660090+0000","last_fullsized":"2024-03-30T12:40:02.660090+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870430+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:37:55.870430+0000","last_peered":"2024-03-30T12:37:55.870430+0000","last_clean":"2024-03-30T12:37:55.870430+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:37:55.870430+0000","last_undegraded":"2024-03-30T12:37:55.870430+0000","last_fullsized":"2024-03-30T12:37:55.870430+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:28.912065+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:38:28.912065+0000","last_peered":"2024-03-30T12:38:28.912065+0000","last_clean":"2024-03-30T12:38:28.912065+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:38:28.912065+0000","last_undegraded":"2024-03-30T12:38:28.912065+0000","last_fullsized":"2024-03-30T12:38:28.912065+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303373+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:38:20.303373+0000","last_peered":"2024-03-30T12:38:20.303373+0000","last_clean":"2024-03-30T12:38:20.303373+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:38:20.303373+0000","last_undegraded":"2024-03-30T12:38:20.303373+0000","last_fullsized":"2024-03-30T12:38:20.303373+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1225,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303460+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:38:20.303460+0000","last_peered":"2024-03-30T12:38:20.303460+0000","last_clean":"2024-03-30T12:38:20.303460+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:38:20.303460+0000","last_undegraded":"2024-03-30T12:38:20.303460+0000","last_fullsized":"2024-03-30T12:38:20.303460+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:03.388264+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:39:03.388264+0000","last_peered":"2024-03-30T12:39:03.388264+0000","last_clean":"2024-03-30T12:39:03.388264+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:39:03.388264+0000","last_undegraded":"2024-03-30T12:39:03.388264+0000","last_fullsized":"2024-03-30T12:39:03.388264+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143278+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:39:19.143278+0000","last_peered":"2024-03-30T12:39:19.143278+0000","last_clean":"2024-03-30T12:39:19.143278+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:39:19.143278+0000","last_undegraded":"2024-03-30T12:39:19.143278+0000","last_fullsized":"2024-03-30T12:39:19.143278+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1389,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876285+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:38:45.876285+0000","last_peered":"2024-03-30T12:38:45.876285+0000","last_clean":"2024-03-30T12:38:45.876285+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:38:45.876285+0000","last_undegraded":"2024-03-30T12:38:45.876285+0000","last_fullsized":"2024-03-30T12:38:45.876285+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1284,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659610+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:39:57.659610+0000","last_peered":"2024-03-30T12:39:57.659610+0000","last_clean":"2024-03-30T12:39:57.659610+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:39:57.659610+0000","last_undegraded":"2024-03-30T12:39:57.659610+0000","last_fullsized":"2024-03-30T12:39:57.659610+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1303,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659620+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:39:57.659620+0000","last_peered":"2024-03-30T12:39:57.659620+0000","last_clean":"2024-03-30T12:39:57.659620+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:39:57.659620+0000","last_undegraded":"2024-03-30T12:39:57.659620+0000","last_fullsized":"2024-03-30T12:39:57.659620+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876275+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:38:45.876275+0000","last_peered":"2024-03-30T12:38:45.876275+0000","last_clean":"2024-03-30T12:38:45.876275+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:38:45.876275+0000","last_undegraded":"2024-03-30T12:38:45.876275+0000","last_fullsized":"2024-03-30T12:38:45.876275+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1151,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133095+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:37:49.133095+0000","last_peered":"2024-03-30T12:37:49.133095+0000","last_clean":"2024-03-30T12:37:49.133095+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:37:49.133095+0000","last_undegraded":"2024-03-30T12:37:49.133095+0000","last_fullsized":"2024-03-30T12:37:49.133095+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1230,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308632+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:39:00.308632+0000","last_peered":"2024-03-30T12:39:00.308632+0000","last_clean":"2024-03-30T12:39:00.308632+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:39:00.308632+0000","last_undegraded":"2024-03-30T12:39:00.308632+0000","last_fullsized":"2024-03-30T12:39:00.308632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133077+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:37:49.133077+0000","last_peered":"2024-03-30T12:37:49.133077+0000","last_clean":"2024-03-30T12:37:49.133077+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:37:49.133077+0000","last_undegraded":"2024-03-30T12:37:49.133077+0000","last_fullsized":"2024-03-30T12:37:49.133077+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308643+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:39:00.308643+0000","last_peered":"2024-03-30T12:39:00.308643+0000","last_clean":"2024-03-30T12:39:00.308643+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:39:00.308643+0000","last_undegraded":"2024-03-30T12:39:00.308643+0000","last_fullsized":"2024-03-30T12:39:00.308643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647433+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:37:57.647433+0000","last_peered":"2024-03-30T12:37:57.647433+0000","last_clean":"2024-03-30T12:37:57.647433+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:37:57.647433+0000","last_undegraded":"2024-03-30T12:37:57.647433+0000","last_fullsized":"2024-03-30T12:37:57.647433+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1263,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:32.286955+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:38:32.286955+0000","last_peered":"2024-03-30T12:38:32.286955+0000","last_clean":"2024-03-30T12:38:32.286955+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:38:32.286955+0000","last_undegraded":"2024-03-30T12:38:32.286955+0000","last_fullsized":"2024-03-30T12:38:32.286955+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1181,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.567808+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:39:39.567808+0000","last_peered":"2024-03-30T12:39:39.567808+0000","last_clean":"2024-03-30T12:39:39.567808+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:39:39.567808+0000","last_undegraded":"2024-03-30T12:39:39.567808+0000","last_fullsized":"2024-03-30T12:39:39.567808+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876233+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:38:45.876233+0000","last_peered":"2024-03-30T12:38:45.876233+0000","last_clean":"2024-03-30T12:38:45.876233+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:38:45.876233+0000","last_undegraded":"2024-03-30T12:38:45.876233+0000","last_fullsized":"2024-03-30T12:38:45.876233+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660073+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:40:02.660073+0000","last_peered":"2024-03-30T12:40:02.660073+0000","last_clean":"2024-03-30T12:40:02.660073+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:40:02.660073+0000","last_undegraded":"2024-03-30T12:40:02.660073+0000","last_fullsized":"2024-03-30T12:40:02.660073+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660041+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:40:02.660041+0000","last_peered":"2024-03-30T12:40:02.660041+0000","last_clean":"2024-03-30T12:40:02.660041+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:40:02.660041+0000","last_undegraded":"2024-03-30T12:40:02.660041+0000","last_fullsized":"2024-03-30T12:40:02.660041+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1225,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306130+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:38:40.306130+0000","last_peered":"2024-03-30T12:38:40.306130+0000","last_clean":"2024-03-30T12:38:40.306130+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:38:40.306130+0000","last_undegraded":"2024-03-30T12:38:40.306130+0000","last_fullsized":"2024-03-30T12:38:40.306130+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:53.914730+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:38:53.914730+0000","last_peered":"2024-03-30T12:38:53.914730+0000","last_clean":"2024-03-30T12:38:53.914730+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:38:53.914730+0000","last_undegraded":"2024-03-30T12:38:53.914730+0000","last_fullsized":"2024-03-30T12:38:53.914730+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565553+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:39:19.565553+0000","last_peered":"2024-03-30T12:39:19.565553+0000","last_clean":"2024-03-30T12:39:19.565553+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:39:19.565553+0000","last_undegraded":"2024-03-30T12:39:19.565553+0000","last_fullsized":"2024-03-30T12:39:19.565553+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306212+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:38:40.306212+0000","last_peered":"2024-03-30T12:38:40.306212+0000","last_clean":"2024-03-30T12:38:40.306212+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:38:40.306212+0000","last_undegraded":"2024-03-30T12:38:40.306212+0000","last_fullsized":"2024-03-30T12:38:40.306212+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1199,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306200+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:38:40.306200+0000","last_peered":"2024-03-30T12:38:40.306200+0000","last_clean":"2024-03-30T12:38:40.306200+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:38:40.306200+0000","last_undegraded":"2024-03-30T12:38:40.306200+0000","last_fullsized":"2024-03-30T12:38:40.306200+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1292,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:28.391470+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:39:28.391470+0000","last_peered":"2024-03-30T12:39:28.391470+0000","last_clean":"2024-03-30T12:39:28.391470+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:39:28.391470+0000","last_undegraded":"2024-03-30T12:39:28.391470+0000","last_fullsized":"2024-03-30T12:39:28.391470+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:53.914770+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:38:53.914770+0000","last_peered":"2024-03-30T12:38:53.914770+0000","last_clean":"2024-03-30T12:38:53.914770+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:38:53.914770+0000","last_undegraded":"2024-03-30T12:38:53.914770+0000","last_fullsized":"2024-03-30T12:38:53.914770+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1233,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:52.282667+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:37:52.282667+0000","last_peered":"2024-03-30T12:37:52.282667+0000","last_clean":"2024-03-30T12:37:52.282667+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:37:52.282667+0000","last_undegraded":"2024-03-30T12:37:52.282667+0000","last_fullsized":"2024-03-30T12:37:52.282667+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562847+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:38:59.562847+0000","last_peered":"2024-03-30T12:38:59.562847+0000","last_clean":"2024-03-30T12:38:59.562847+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:38:59.562847+0000","last_undegraded":"2024-03-30T12:38:59.562847+0000","last_fullsized":"2024-03-30T12:38:59.562847+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:59.148189+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:39:59.148189+0000","last_peered":"2024-03-30T12:39:59.148189+0000","last_clean":"2024-03-30T12:39:59.148189+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:39:59.148189+0000","last_undegraded":"2024-03-30T12:39:59.148189+0000","last_fullsized":"2024-03-30T12:39:59.148189+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1384,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870514+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:37:55.870514+0000","last_peered":"2024-03-30T12:37:55.870514+0000","last_clean":"2024-03-30T12:37:55.870514+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:37:55.870514+0000","last_undegraded":"2024-03-30T12:37:55.870514+0000","last_fullsized":"2024-03-30T12:37:55.870514+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:55.870486+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:37:55.870486+0000","last_peered":"2024-03-30T12:37:55.870486+0000","last_clean":"2024-03-30T12:37:55.870486+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:37:55.870486+0000","last_undegraded":"2024-03-30T12:37:55.870486+0000","last_fullsized":"2024-03-30T12:37:55.870486+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303405+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:38:20.303405+0000","last_peered":"2024-03-30T12:38:20.303405+0000","last_clean":"2024-03-30T12:38:20.303405+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:38:20.303405+0000","last_undegraded":"2024-03-30T12:38:20.303405+0000","last_fullsized":"2024-03-30T12:38:20.303405+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.145725+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:39:39.145725+0000","last_peered":"2024-03-30T12:39:39.145725+0000","last_clean":"2024-03-30T12:39:39.145725+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:39:39.145725+0000","last_undegraded":"2024-03-30T12:39:39.145725+0000","last_fullsized":"2024-03-30T12:39:39.145725+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562815+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:38:59.562815+0000","last_peered":"2024-03-30T12:38:59.562815+0000","last_clean":"2024-03-30T12:38:59.562815+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:38:59.562815+0000","last_undegraded":"2024-03-30T12:38:59.562815+0000","last_fullsized":"2024-03-30T12:38:59.562815+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562788+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:38:59.562788+0000","last_peered":"2024-03-30T12:38:59.562788+0000","last_clean":"2024-03-30T12:38:59.562788+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:38:59.562788+0000","last_undegraded":"2024-03-30T12:38:59.562788+0000","last_fullsized":"2024-03-30T12:38:59.562788+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:03.388191+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:39:03.388191+0000","last_peered":"2024-03-30T12:39:03.388191+0000","last_clean":"2024-03-30T12:39:03.388191+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:39:03.388191+0000","last_undegraded":"2024-03-30T12:39:03.388191+0000","last_fullsized":"2024-03-30T12:39:03.388191+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.145661+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:39:39.145661+0000","last_peered":"2024-03-30T12:39:39.145661+0000","last_clean":"2024-03-30T12:39:39.145661+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:39:39.145661+0000","last_undegraded":"2024-03-30T12:39:39.145661+0000","last_fullsized":"2024-03-30T12:39:39.145661+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5753,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:13.383127+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:38:13.383127+0000","last_peered":"2024-03-30T12:38:13.383127+0000","last_clean":"2024-03-30T12:38:13.383127+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:38:13.383127+0000","last_undegraded":"2024-03-30T12:38:13.383127+0000","last_fullsized":"2024-03-30T12:38:13.383127+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1276,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:47.295052+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:39:47.295052+0000","last_peered":"2024-03-30T12:39:47.295052+0000","last_clean":"2024-03-30T12:39:47.295052+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:39:47.295052+0000","last_undegraded":"2024-03-30T12:39:47.295052+0000","last_fullsized":"2024-03-30T12:39:47.295052+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143289+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:39:19.143289+0000","last_peered":"2024-03-30T12:39:19.143289+0000","last_clean":"2024-03-30T12:39:19.143289+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:39:19.143289+0000","last_undegraded":"2024-03-30T12:39:19.143289+0000","last_fullsized":"2024-03-30T12:39:19.143289+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5514,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:45.876204+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:38:45.876204+0000","last_peered":"2024-03-30T12:38:45.876204+0000","last_clean":"2024-03-30T12:38:45.876204+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:38:45.876204+0000","last_undegraded":"2024-03-30T12:38:45.876204+0000","last_fullsized":"2024-03-30T12:38:45.876204+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917640+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:39:18.917640+0000","last_peered":"2024-03-30T12:39:18.917640+0000","last_clean":"2024-03-30T12:39:18.917640+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:39:18.917640+0000","last_undegraded":"2024-03-30T12:39:18.917640+0000","last_fullsized":"2024-03-30T12:39:18.917640+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917662+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:39:18.917662+0000","last_peered":"2024-03-30T12:39:18.917662+0000","last_clean":"2024-03-30T12:39:18.917662+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:39:18.917662+0000","last_undegraded":"2024-03-30T12:39:18.917662+0000","last_fullsized":"2024-03-30T12:39:18.917662+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311465+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:39:25.311465+0000","last_peered":"2024-03-30T12:39:25.311465+0000","last_clean":"2024-03-30T12:39:25.311465+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:39:25.311465+0000","last_undegraded":"2024-03-30T12:39:25.311465+0000","last_fullsized":"2024-03-30T12:39:25.311465+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5459,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:45.876257+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:38:45.876257+0000","last_peered":"2024-03-30T12:38:45.876257+0000","last_clean":"2024-03-30T12:38:45.876257+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:38:45.876257+0000","last_undegraded":"2024-03-30T12:38:45.876257+0000","last_fullsized":"2024-03-30T12:38:45.876257+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917672+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:39:18.917672+0000","last_peered":"2024-03-30T12:39:18.917672+0000","last_clean":"2024-03-30T12:39:18.917672+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:39:18.917672+0000","last_undegraded":"2024-03-30T12:39:18.917672+0000","last_fullsized":"2024-03-30T12:39:18.917672+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1208,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311386+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:39:25.311386+0000","last_peered":"2024-03-30T12:39:25.311386+0000","last_clean":"2024-03-30T12:39:25.311386+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:39:25.311386+0000","last_undegraded":"2024-03-30T12:39:25.311386+0000","last_fullsized":"2024-03-30T12:39:25.311386+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:57.289543+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:38:57.289543+0000","last_peered":"2024-03-30T12:38:57.289543+0000","last_clean":"2024-03-30T12:38:57.289543+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:38:57.289543+0000","last_undegraded":"2024-03-30T12:38:57.289543+0000","last_fullsized":"2024-03-30T12:38:57.289543+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3804,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:13.383237+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:38:13.383237+0000","last_peered":"2024-03-30T12:38:13.383237+0000","last_clean":"2024-03-30T12:38:13.383237+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:38:13.383237+0000","last_undegraded":"2024-03-30T12:38:13.383237+0000","last_fullsized":"2024-03-30T12:38:13.383237+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1344,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920990+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:39:48.920990+0000","last_peered":"2024-03-30T12:39:48.920990+0000","last_clean":"2024-03-30T12:39:48.920990+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:39:48.920990+0000","last_undegraded":"2024-03-30T12:39:48.920990+0000","last_fullsized":"2024-03-30T12:39:48.920990+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:48.914183+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:38:48.914183+0000","last_peered":"2024-03-30T12:38:48.914183+0000","last_clean":"2024-03-30T12:38:48.914183+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:38:48.914183+0000","last_undegraded":"2024-03-30T12:38:48.914183+0000","last_fullsized":"2024-03-30T12:38:48.914183+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:53.394025+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:39:53.394025+0000","last_peered":"2024-03-30T12:39:53.394025+0000","last_clean":"2024-03-30T12:39:53.394025+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:39:53.394025+0000","last_undegraded":"2024-03-30T12:39:53.394025+0000","last_fullsized":"2024-03-30T12:39:53.394025+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4577,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:39.138875+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:38:39.138875+0000","last_peered":"2024-03-30T12:38:39.138875+0000","last_clean":"2024-03-30T12:38:39.138875+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:38:39.138875+0000","last_undegraded":"2024-03-30T12:38:39.138875+0000","last_fullsized":"2024-03-30T12:38:39.138875+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1176,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:04.570573+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:40:04.570573+0000","last_peered":"2024-03-30T12:40:04.570573+0000","last_clean":"2024-03-30T12:40:04.570573+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:40:04.570573+0000","last_undegraded":"2024-03-30T12:40:04.570573+0000","last_fullsized":"2024-03-30T12:40:04.570573+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:22.649643+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:38:22.649643+0000","last_peered":"2024-03-30T12:38:22.649643+0000","last_clean":"2024-03-30T12:38:22.649643+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:38:22.649643+0000","last_undegraded":"2024-03-30T12:38:22.649643+0000","last_fullsized":"2024-03-30T12:38:22.649643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1201,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311442+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:39:25.311442+0000","last_peered":"2024-03-30T12:39:25.311442+0000","last_clean":"2024-03-30T12:39:25.311442+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:39:25.311442+0000","last_undegraded":"2024-03-30T12:39:25.311442+0000","last_fullsized":"2024-03-30T12:39:25.311442+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1718,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150538+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:40:19.150538+0000","last_peered":"2024-03-30T12:40:19.150538+0000","last_clean":"2024-03-30T12:40:19.150538+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:40:19.150538+0000","last_undegraded":"2024-03-30T12:40:19.150538+0000","last_fullsized":"2024-03-30T12:40:19.150538+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24715,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:39:50.314565+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:39:50.314565+0000","last_peered":"2024-03-30T12:39:50.314565+0000","last_clean":"2024-03-30T12:39:50.314565+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:39:50.314565+0000","last_undegraded":"2024-03-30T12:39:50.314565+0000","last_fullsized":"2024-03-30T12:39:50.314565+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:15.879816+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:39:15.879816+0000","last_peered":"2024-03-30T12:39:15.879816+0000","last_clean":"2024-03-30T12:39:15.879816+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:39:15.879816+0000","last_undegraded":"2024-03-30T12:39:15.879816+0000","last_fullsized":"2024-03-30T12:39:15.879816+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876163+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:38:45.876163+0000","last_peered":"2024-03-30T12:38:45.876163+0000","last_clean":"2024-03-30T12:38:45.876163+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:38:45.876163+0000","last_undegraded":"2024-03-30T12:38:45.876163+0000","last_fullsized":"2024-03-30T12:38:45.876163+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150500+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:40:19.150500+0000","last_peered":"2024-03-30T12:40:19.150500+0000","last_clean":"2024-03-30T12:40:19.150500+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:40:19.150500+0000","last_undegraded":"2024-03-30T12:40:19.150500+0000","last_fullsized":"2024-03-30T12:40:19.150500+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16482,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:04.570536+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:40:04.570536+0000","last_peered":"2024-03-30T12:40:04.570536+0000","last_clean":"2024-03-30T12:40:04.570536+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:40:04.570536+0000","last_undegraded":"2024-03-30T12:40:04.570536+0000","last_fullsized":"2024-03-30T12:40:04.570536+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876223+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:38:45.876223+0000","last_peered":"2024-03-30T12:38:45.876223+0000","last_clean":"2024-03-30T12:38:45.876223+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:38:45.876223+0000","last_undegraded":"2024-03-30T12:38:45.876223+0000","last_fullsized":"2024-03-30T12:38:45.876223+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1164,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.138928+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:38:39.138928+0000","last_peered":"2024-03-30T12:38:39.138928+0000","last_clean":"2024-03-30T12:38:39.138928+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:38:39.138928+0000","last_undegraded":"2024-03-30T12:38:39.138928+0000","last_fullsized":"2024-03-30T12:38:39.138928+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917681+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:39:18.917681+0000","last_peered":"2024-03-30T12:39:18.917681+0000","last_clean":"2024-03-30T12:39:18.917681+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:39:18.917681+0000","last_undegraded":"2024-03-30T12:39:18.917681+0000","last_fullsized":"2024-03-30T12:39:18.917681+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31270,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:57.289492+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:38:57.289492+0000","last_peered":"2024-03-30T12:38:57.289492+0000","last_clean":"2024-03-30T12:38:57.289492+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:38:57.289492+0000","last_undegraded":"2024-03-30T12:38:57.289492+0000","last_fullsized":"2024-03-30T12:38:57.289492+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659585+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:39:57.659585+0000","last_peered":"2024-03-30T12:39:57.659585+0000","last_clean":"2024-03-30T12:39:57.659585+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:39:57.659585+0000","last_undegraded":"2024-03-30T12:39:57.659585+0000","last_fullsized":"2024-03-30T12:39:57.659585+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1355,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920979+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:39:48.920979+0000","last_peered":"2024-03-30T12:39:48.920979+0000","last_clean":"2024-03-30T12:39:48.920979+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:39:48.920979+0000","last_undegraded":"2024-03-30T12:39:48.920979+0000","last_fullsized":"2024-03-30T12:39:48.920979+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651932+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:38:47.651932+0000","last_peered":"2024-03-30T12:38:47.651932+0000","last_clean":"2024-03-30T12:38:47.651932+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:38:47.651932+0000","last_undegraded":"2024-03-30T12:38:47.651932+0000","last_fullsized":"2024-03-30T12:38:47.651932+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3766,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659555+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:39:57.659555+0000","last_peered":"2024-03-30T12:39:57.659555+0000","last_clean":"2024-03-30T12:39:57.659555+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:39:57.659555+0000","last_undegraded":"2024-03-30T12:39:57.659555+0000","last_fullsized":"2024-03-30T12:39:57.659555+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:57.289460+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:38:57.289460+0000","last_peered":"2024-03-30T12:38:57.289460+0000","last_clean":"2024-03-30T12:38:57.289460+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:38:57.289460+0000","last_undegraded":"2024-03-30T12:38:57.289460+0000","last_fullsized":"2024-03-30T12:38:57.289460+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1156,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558186+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:38:19.558186+0000","last_peered":"2024-03-30T12:38:19.558186+0000","last_clean":"2024-03-30T12:38:19.558186+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:38:19.558186+0000","last_undegraded":"2024-03-30T12:38:19.558186+0000","last_fullsized":"2024-03-30T12:38:19.558186+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:15.879792+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:39:15.879792+0000","last_peered":"2024-03-30T12:39:15.879792+0000","last_clean":"2024-03-30T12:39:15.879792+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:39:15.879792+0000","last_undegraded":"2024-03-30T12:39:15.879792+0000","last_fullsized":"2024-03-30T12:39:15.879792+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15595,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:15.317660+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:40:15.317660+0000","last_peered":"2024-03-30T12:40:15.317660+0000","last_clean":"2024-03-30T12:40:15.317660+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:40:15.317660+0000","last_undegraded":"2024-03-30T12:40:15.317660+0000","last_fullsized":"2024-03-30T12:40:15.317660+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.141061+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:38:59.141061+0000","last_peered":"2024-03-30T12:38:59.141061+0000","last_clean":"2024-03-30T12:38:59.141061+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:38:59.141061+0000","last_undegraded":"2024-03-30T12:38:59.141061+0000","last_fullsized":"2024-03-30T12:38:59.141061+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:22.292071+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:39:22.292071+0000","last_peered":"2024-03-30T12:39:22.292071+0000","last_clean":"2024-03-30T12:39:22.292071+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:39:22.292071+0000","last_undegraded":"2024-03-30T12:39:22.292071+0000","last_fullsized":"2024-03-30T12:39:22.292071+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29021,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:39:47.295005+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:39:47.295005+0000","last_peered":"2024-03-30T12:39:47.295005+0000","last_clean":"2024-03-30T12:39:47.295005+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:39:47.295005+0000","last_undegraded":"2024-03-30T12:39:47.295005+0000","last_fullsized":"2024-03-30T12:39:47.295005+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920913+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:39:48.920913+0000","last_peered":"2024-03-30T12:39:48.920913+0000","last_clean":"2024-03-30T12:39:48.920913+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:39:48.920913+0000","last_undegraded":"2024-03-30T12:39:48.920913+0000","last_fullsized":"2024-03-30T12:39:48.920913+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651850+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:38:47.651850+0000","last_peered":"2024-03-30T12:38:47.651850+0000","last_clean":"2024-03-30T12:38:47.651850+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:38:47.651850+0000","last_undegraded":"2024-03-30T12:38:47.651850+0000","last_fullsized":"2024-03-30T12:38:47.651850+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5611,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:38.385807+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:38:38.385807+0000","last_peered":"2024-03-30T12:38:38.385807+0000","last_clean":"2024-03-30T12:38:38.385807+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:38:38.385807+0000","last_undegraded":"2024-03-30T12:38:38.385807+0000","last_fullsized":"2024-03-30T12:38:38.385807+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1366,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920941+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:39:48.920941+0000","last_peered":"2024-03-30T12:39:48.920941+0000","last_clean":"2024-03-30T12:39:48.920941+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:39:48.920941+0000","last_undegraded":"2024-03-30T12:39:48.920941+0000","last_fullsized":"2024-03-30T12:39:48.920941+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:12.654884+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:39:12.654884+0000","last_peered":"2024-03-30T12:39:12.654884+0000","last_clean":"2024-03-30T12:39:12.654884+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:39:12.654884+0000","last_undegraded":"2024-03-30T12:39:12.654884+0000","last_fullsized":"2024-03-30T12:39:12.654884+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4275,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:03.909427+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:38:03.909427+0000","last_peered":"2024-03-30T12:38:03.909427+0000","last_clean":"2024-03-30T12:38:03.909427+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:38:03.909427+0000","last_undegraded":"2024-03-30T12:38:03.909427+0000","last_fullsized":"2024-03-30T12:38:03.909427+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143221+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:39:19.143221+0000","last_peered":"2024-03-30T12:39:19.143221+0000","last_clean":"2024-03-30T12:39:19.143221+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:39:19.143221+0000","last_undegraded":"2024-03-30T12:39:19.143221+0000","last_fullsized":"2024-03-30T12:39:19.143221+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558134+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:38:19.558134+0000","last_peered":"2024-03-30T12:38:19.558134+0000","last_clean":"2024-03-30T12:38:19.558134+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:38:19.558134+0000","last_undegraded":"2024-03-30T12:38:19.558134+0000","last_fullsized":"2024-03-30T12:38:19.558134+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5254,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:38.385765+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:38:38.385765+0000","last_peered":"2024-03-30T12:38:38.385765+0000","last_clean":"2024-03-30T12:38:38.385765+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:38:38.385765+0000","last_undegraded":"2024-03-30T12:38:38.385765+0000","last_fullsized":"2024-03-30T12:38:38.385765+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:38.385797+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:38:38.385797+0000","last_peered":"2024-03-30T12:38:38.385797+0000","last_clean":"2024-03-30T12:38:38.385797+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:38:38.385797+0000","last_undegraded":"2024-03-30T12:38:38.385797+0000","last_fullsized":"2024-03-30T12:38:38.385797+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143264+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:39:19.143264+0000","last_peered":"2024-03-30T12:39:19.143264+0000","last_clean":"2024-03-30T12:39:19.143264+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:39:19.143264+0000","last_undegraded":"2024-03-30T12:39:19.143264+0000","last_fullsized":"2024-03-30T12:39:19.143264+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4811,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:13.383202+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:38:13.383202+0000","last_peered":"2024-03-30T12:38:13.383202+0000","last_clean":"2024-03-30T12:38:13.383202+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:38:13.383202+0000","last_undegraded":"2024-03-30T12:38:13.383202+0000","last_fullsized":"2024-03-30T12:38:13.383202+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:03.909462+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:38:03.909462+0000","last_peered":"2024-03-30T12:38:03.909462+0000","last_clean":"2024-03-30T12:38:03.909462+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:38:03.909462+0000","last_undegraded":"2024-03-30T12:38:03.909462+0000","last_fullsized":"2024-03-30T12:38:03.909462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.317641+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:40:15.317641+0000","last_peered":"2024-03-30T12:40:15.317641+0000","last_clean":"2024-03-30T12:40:15.317641+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:40:15.317641+0000","last_undegraded":"2024-03-30T12:40:15.317641+0000","last_fullsized":"2024-03-30T12:40:15.317641+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6744,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:59.141086+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:38:59.141086+0000","last_peered":"2024-03-30T12:38:59.141086+0000","last_clean":"2024-03-30T12:38:59.141086+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:38:59.141086+0000","last_undegraded":"2024-03-30T12:38:59.141086+0000","last_fullsized":"2024-03-30T12:38:59.141086+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1338,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:38.385827+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:38:38.385827+0000","last_peered":"2024-03-30T12:38:38.385827+0000","last_clean":"2024-03-30T12:38:38.385827+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:38:38.385827+0000","last_undegraded":"2024-03-30T12:38:38.385827+0000","last_fullsized":"2024-03-30T12:38:38.385827+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143303+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:39:19.143303+0000","last_peered":"2024-03-30T12:39:19.143303+0000","last_clean":"2024-03-30T12:39:19.143303+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:39:19.143303+0000","last_undegraded":"2024-03-30T12:39:19.143303+0000","last_fullsized":"2024-03-30T12:39:19.143303+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:04.570502+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:40:04.570502+0000","last_peered":"2024-03-30T12:40:04.570502+0000","last_clean":"2024-03-30T12:40:04.570502+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:40:04.570502+0000","last_undegraded":"2024-03-30T12:40:04.570502+0000","last_fullsized":"2024-03-30T12:40:04.570502+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:53.394048+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:39:53.394048+0000","last_peered":"2024-03-30T12:39:53.394048+0000","last_clean":"2024-03-30T12:39:53.394048+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:39:53.394048+0000","last_undegraded":"2024-03-30T12:39:53.394048+0000","last_fullsized":"2024-03-30T12:39:53.394048+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311414+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:39:25.311414+0000","last_peered":"2024-03-30T12:39:25.311414+0000","last_clean":"2024-03-30T12:39:25.311414+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:39:25.311414+0000","last_undegraded":"2024-03-30T12:39:25.311414+0000","last_fullsized":"2024-03-30T12:39:25.311414+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876194+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:38:45.876194+0000","last_peered":"2024-03-30T12:38:45.876194+0000","last_clean":"2024-03-30T12:38:45.876194+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:38:45.876194+0000","last_undegraded":"2024-03-30T12:38:45.876194+0000","last_fullsized":"2024-03-30T12:38:45.876194+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651915+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:38:47.651915+0000","last_peered":"2024-03-30T12:38:47.651915+0000","last_clean":"2024-03-30T12:38:47.651915+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:38:47.651915+0000","last_undegraded":"2024-03-30T12:38:47.651915+0000","last_fullsized":"2024-03-30T12:38:47.651915+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920964+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:39:48.920964+0000","last_peered":"2024-03-30T12:39:48.920964+0000","last_clean":"2024-03-30T12:39:48.920964+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:39:48.920964+0000","last_undegraded":"2024-03-30T12:39:48.920964+0000","last_fullsized":"2024-03-30T12:39:48.920964+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1178,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:19.558174+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:38:19.558174+0000","last_peered":"2024-03-30T12:38:19.558174+0000","last_clean":"2024-03-30T12:38:19.558174+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:38:19.558174+0000","last_undegraded":"2024-03-30T12:38:19.558174+0000","last_fullsized":"2024-03-30T12:38:19.558174+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1282,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651943+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:38:47.651943+0000","last_peered":"2024-03-30T12:38:47.651943+0000","last_clean":"2024-03-30T12:38:47.651943+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:38:47.651943+0000","last_undegraded":"2024-03-30T12:38:47.651943+0000","last_fullsized":"2024-03-30T12:38:47.651943+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:50.314509+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:39:50.314509+0000","last_peered":"2024-03-30T12:39:50.314509+0000","last_clean":"2024-03-30T12:39:50.314509+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:39:50.314509+0000","last_undegraded":"2024-03-30T12:39:50.314509+0000","last_fullsized":"2024-03-30T12:39:50.314509+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:12.654857+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:39:12.654857+0000","last_peered":"2024-03-30T12:39:12.654857+0000","last_clean":"2024-03-30T12:39:12.654857+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:39:12.654857+0000","last_undegraded":"2024-03-30T12:39:12.654857+0000","last_fullsized":"2024-03-30T12:39:12.654857+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1217,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.317602+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:40:15.317602+0000","last_peered":"2024-03-30T12:40:15.317602+0000","last_clean":"2024-03-30T12:40:15.317602+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:40:15.317602+0000","last_undegraded":"2024-03-30T12:40:15.317602+0000","last_fullsized":"2024-03-30T12:40:15.317602+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:45.883156+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:39:45.883156+0000","last_peered":"2024-03-30T12:39:45.883156+0000","last_clean":"2024-03-30T12:39:45.883156+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:39:45.883156+0000","last_undegraded":"2024-03-30T12:39:45.883156+0000","last_fullsized":"2024-03-30T12:39:45.883156+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.560418+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:38:39.560418+0000","last_peered":"2024-03-30T12:38:39.560418+0000","last_clean":"2024-03-30T12:38:39.560418+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:38:39.560418+0000","last_undegraded":"2024-03-30T12:38:39.560418+0000","last_fullsized":"2024-03-30T12:38:39.560418+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438099,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648155,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175165,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254404,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063222,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951279,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839336,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923619,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:42:33.992 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:33.992 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:33.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:33.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:33.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:33.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:33.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:33.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:33.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:33.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:33.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:33.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:33.993 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:33.994 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:42:34.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:33 smithi162 ceph-mon[83709]: pgmap v1185: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:34.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:33 smithi084 ceph-mon[89279]: pgmap v1185: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:34.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:33 smithi084 ceph-mon[91810]: pgmap v1185: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:35.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:35 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:42:35.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:35 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:42:35.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:35 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:42:35.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:35 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:42:35.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:35 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:42:35.620 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:35 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:42:37.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:36 smithi162 ceph-mon[83709]: pgmap v1186: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:37.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:36 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:42:37.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:36 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:42:37.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:36 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:42:37.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:36 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:42:37.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:36 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:42:37.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:36 smithi084 ceph-mon[91810]: pgmap v1186: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:37.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:36 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:42:37.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:36 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:42:37.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:36 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:42:37.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:36 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:42:37.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:36 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:42:37.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:36 smithi084 ceph-mon[89279]: pgmap v1186: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:37.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:36 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:42:37.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:36 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:42:37.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:36 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:42:37.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:36 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:42:37.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:36 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:42:39.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:38 smithi162 ceph-mon[83709]: pgmap v1187: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:39.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:38 smithi084 ceph-mon[91810]: pgmap v1187: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:39.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:38 smithi084 ceph-mon[89279]: pgmap v1187: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:39.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:42:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:42:39] "GET /metrics HTTP/1.1" 200 36327 "" "Prometheus/2.43.0" 2024-03-30T12:42:41.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:40 smithi162 ceph-mon[83709]: pgmap v1188: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:41.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:40 smithi084 ceph-mon[91810]: pgmap v1188: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:41.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:40 smithi084 ceph-mon[89279]: pgmap v1188: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:43.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:42 smithi162 ceph-mon[83709]: pgmap v1189: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:43.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:42 smithi084 ceph-mon[91810]: pgmap v1189: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:43.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:42 smithi084 ceph-mon[89279]: pgmap v1189: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:43.994 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:42:44.207 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:42:45.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:44 smithi162 ceph-mon[83709]: pgmap v1190: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:45.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:44 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:42:45.180 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:44 smithi084 ceph-mon[91810]: pgmap v1190: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:45.181 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:44 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:42:45.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:44 smithi084 ceph-mon[89279]: pgmap v1190: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:45.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:44 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:42:46.271 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:42:46.273 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:42:46.960 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1191,"stamp":"2024-03-30T12:42:44.926812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003738"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.138971+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:38:39.138971+0000","last_peered":"2024-03-30T12:38:39.138971+0000","last_clean":"2024-03-30T12:38:39.138971+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:38:39.138971+0000","last_undegraded":"2024-03-30T12:38:39.138971+0000","last_fullsized":"2024-03-30T12:38:39.138971+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1365,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917695+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:39:18.917695+0000","last_peered":"2024-03-30T12:39:18.917695+0000","last_clean":"2024-03-30T12:39:18.917695+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:39:18.917695+0000","last_undegraded":"2024-03-30T12:39:18.917695+0000","last_fullsized":"2024-03-30T12:39:18.917695+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876244+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:38:45.876244+0000","last_peered":"2024-03-30T12:38:45.876244+0000","last_clean":"2024-03-30T12:38:45.876244+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:38:45.876244+0000","last_undegraded":"2024-03-30T12:38:45.876244+0000","last_fullsized":"2024-03-30T12:38:45.876244+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308618+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:39:00.308618+0000","last_peered":"2024-03-30T12:39:00.308618+0000","last_clean":"2024-03-30T12:39:00.308618+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:39:00.308618+0000","last_undegraded":"2024-03-30T12:39:00.308618+0000","last_fullsized":"2024-03-30T12:39:00.308618+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133062+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:37:49.133062+0000","last_peered":"2024-03-30T12:37:49.133062+0000","last_clean":"2024-03-30T12:37:49.133062+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:37:49.133062+0000","last_undegraded":"2024-03-30T12:37:49.133062+0000","last_fullsized":"2024-03-30T12:37:49.133062+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1211,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308563+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:39:00.308563+0000","last_peered":"2024-03-30T12:39:00.308563+0000","last_clean":"2024-03-30T12:39:00.308563+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:39:00.308563+0000","last_undegraded":"2024-03-30T12:39:00.308563+0000","last_fullsized":"2024-03-30T12:39:00.308563+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1161,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133035+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:37:49.133035+0000","last_peered":"2024-03-30T12:37:49.133035+0000","last_clean":"2024-03-30T12:37:49.133035+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:37:49.133035+0000","last_undegraded":"2024-03-30T12:37:49.133035+0000","last_fullsized":"2024-03-30T12:37:49.133035+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647301+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:37:57.647301+0000","last_peered":"2024-03-30T12:37:57.647301+0000","last_clean":"2024-03-30T12:37:57.647301+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:37:57.647301+0000","last_undegraded":"2024-03-30T12:37:57.647301+0000","last_fullsized":"2024-03-30T12:37:57.647301+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:59.148225+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:39:59.148225+0000","last_peered":"2024-03-30T12:39:59.148225+0000","last_clean":"2024-03-30T12:39:59.148225+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:39:59.148225+0000","last_undegraded":"2024-03-30T12:39:59.148225+0000","last_fullsized":"2024-03-30T12:39:59.148225+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565540+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:39:19.565540+0000","last_peered":"2024-03-30T12:39:19.565540+0000","last_clean":"2024-03-30T12:39:19.565540+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:39:19.565540+0000","last_undegraded":"2024-03-30T12:39:19.565540+0000","last_fullsized":"2024-03-30T12:39:19.565540+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565513+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:39:19.565513+0000","last_peered":"2024-03-30T12:39:19.565513+0000","last_clean":"2024-03-30T12:39:19.565513+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:39:19.565513+0000","last_undegraded":"2024-03-30T12:39:19.565513+0000","last_fullsized":"2024-03-30T12:39:19.565513+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1271,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:12.285006+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:38:12.285006+0000","last_peered":"2024-03-30T12:38:12.285006+0000","last_clean":"2024-03-30T12:38:12.285006+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:38:12.285006+0000","last_undegraded":"2024-03-30T12:38:12.285006+0000","last_fullsized":"2024-03-30T12:38:12.285006+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660090+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:40:02.660090+0000","last_peered":"2024-03-30T12:40:02.660090+0000","last_clean":"2024-03-30T12:40:02.660090+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:40:02.660090+0000","last_undegraded":"2024-03-30T12:40:02.660090+0000","last_fullsized":"2024-03-30T12:40:02.660090+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886008+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:40:15.886008+0000","last_peered":"2024-03-30T12:40:15.886008+0000","last_clean":"2024-03-30T12:40:15.886008+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:40:15.886008+0000","last_undegraded":"2024-03-30T12:40:15.886008+0000","last_fullsized":"2024-03-30T12:40:15.886008+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:28.912065+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:38:28.912065+0000","last_peered":"2024-03-30T12:38:28.912065+0000","last_clean":"2024-03-30T12:38:28.912065+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:38:28.912065+0000","last_undegraded":"2024-03-30T12:38:28.912065+0000","last_fullsized":"2024-03-30T12:38:28.912065+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303373+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:38:20.303373+0000","last_peered":"2024-03-30T12:38:20.303373+0000","last_clean":"2024-03-30T12:38:20.303373+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:38:20.303373+0000","last_undegraded":"2024-03-30T12:38:20.303373+0000","last_fullsized":"2024-03-30T12:38:20.303373+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1225,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303460+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:38:20.303460+0000","last_peered":"2024-03-30T12:38:20.303460+0000","last_clean":"2024-03-30T12:38:20.303460+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:38:20.303460+0000","last_undegraded":"2024-03-30T12:38:20.303460+0000","last_fullsized":"2024-03-30T12:38:20.303460+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:03.388264+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:39:03.388264+0000","last_peered":"2024-03-30T12:39:03.388264+0000","last_clean":"2024-03-30T12:39:03.388264+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:39:03.388264+0000","last_undegraded":"2024-03-30T12:39:03.388264+0000","last_fullsized":"2024-03-30T12:39:03.388264+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143278+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:39:19.143278+0000","last_peered":"2024-03-30T12:39:19.143278+0000","last_clean":"2024-03-30T12:39:19.143278+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:39:19.143278+0000","last_undegraded":"2024-03-30T12:39:19.143278+0000","last_fullsized":"2024-03-30T12:39:19.143278+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1389,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876285+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:38:45.876285+0000","last_peered":"2024-03-30T12:38:45.876285+0000","last_clean":"2024-03-30T12:38:45.876285+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:38:45.876285+0000","last_undegraded":"2024-03-30T12:38:45.876285+0000","last_fullsized":"2024-03-30T12:38:45.876285+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1284,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659610+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:39:57.659610+0000","last_peered":"2024-03-30T12:39:57.659610+0000","last_clean":"2024-03-30T12:39:57.659610+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:39:57.659610+0000","last_undegraded":"2024-03-30T12:39:57.659610+0000","last_fullsized":"2024-03-30T12:39:57.659610+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1303,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659620+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:39:57.659620+0000","last_peered":"2024-03-30T12:39:57.659620+0000","last_clean":"2024-03-30T12:39:57.659620+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:39:57.659620+0000","last_undegraded":"2024-03-30T12:39:57.659620+0000","last_fullsized":"2024-03-30T12:39:57.659620+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876275+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:38:45.876275+0000","last_peered":"2024-03-30T12:38:45.876275+0000","last_clean":"2024-03-30T12:38:45.876275+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:38:45.876275+0000","last_undegraded":"2024-03-30T12:38:45.876275+0000","last_fullsized":"2024-03-30T12:38:45.876275+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1151,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133095+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:37:49.133095+0000","last_peered":"2024-03-30T12:37:49.133095+0000","last_clean":"2024-03-30T12:37:49.133095+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:37:49.133095+0000","last_undegraded":"2024-03-30T12:37:49.133095+0000","last_fullsized":"2024-03-30T12:37:49.133095+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1230,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308632+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:39:00.308632+0000","last_peered":"2024-03-30T12:39:00.308632+0000","last_clean":"2024-03-30T12:39:00.308632+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:39:00.308632+0000","last_undegraded":"2024-03-30T12:39:00.308632+0000","last_fullsized":"2024-03-30T12:39:00.308632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1154,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:49.133077+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:37:49.133077+0000","last_peered":"2024-03-30T12:37:49.133077+0000","last_clean":"2024-03-30T12:37:49.133077+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:37:49.133077+0000","last_undegraded":"2024-03-30T12:37:49.133077+0000","last_fullsized":"2024-03-30T12:37:49.133077+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308643+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:39:00.308643+0000","last_peered":"2024-03-30T12:39:00.308643+0000","last_clean":"2024-03-30T12:39:00.308643+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:39:00.308643+0000","last_undegraded":"2024-03-30T12:39:00.308643+0000","last_fullsized":"2024-03-30T12:39:00.308643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:37:57.647433+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:37:57.647433+0000","last_peered":"2024-03-30T12:37:57.647433+0000","last_clean":"2024-03-30T12:37:57.647433+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:37:57.647433+0000","last_undegraded":"2024-03-30T12:37:57.647433+0000","last_fullsized":"2024-03-30T12:37:57.647433+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1263,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:32.286955+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:38:32.286955+0000","last_peered":"2024-03-30T12:38:32.286955+0000","last_clean":"2024-03-30T12:38:32.286955+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:38:32.286955+0000","last_undegraded":"2024-03-30T12:38:32.286955+0000","last_fullsized":"2024-03-30T12:38:32.286955+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1181,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.567808+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:39:39.567808+0000","last_peered":"2024-03-30T12:39:39.567808+0000","last_clean":"2024-03-30T12:39:39.567808+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:39:39.567808+0000","last_undegraded":"2024-03-30T12:39:39.567808+0000","last_fullsized":"2024-03-30T12:39:39.567808+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876233+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:38:45.876233+0000","last_peered":"2024-03-30T12:38:45.876233+0000","last_clean":"2024-03-30T12:38:45.876233+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:38:45.876233+0000","last_undegraded":"2024-03-30T12:38:45.876233+0000","last_fullsized":"2024-03-30T12:38:45.876233+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660073+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:40:02.660073+0000","last_peered":"2024-03-30T12:40:02.660073+0000","last_clean":"2024-03-30T12:40:02.660073+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:40:02.660073+0000","last_undegraded":"2024-03-30T12:40:02.660073+0000","last_fullsized":"2024-03-30T12:40:02.660073+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660041+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:40:02.660041+0000","last_peered":"2024-03-30T12:40:02.660041+0000","last_clean":"2024-03-30T12:40:02.660041+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:40:02.660041+0000","last_undegraded":"2024-03-30T12:40:02.660041+0000","last_fullsized":"2024-03-30T12:40:02.660041+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1225,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306130+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:38:40.306130+0000","last_peered":"2024-03-30T12:38:40.306130+0000","last_clean":"2024-03-30T12:38:40.306130+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:38:40.306130+0000","last_undegraded":"2024-03-30T12:38:40.306130+0000","last_fullsized":"2024-03-30T12:38:40.306130+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:53.914730+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:38:53.914730+0000","last_peered":"2024-03-30T12:38:53.914730+0000","last_clean":"2024-03-30T12:38:53.914730+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:38:53.914730+0000","last_undegraded":"2024-03-30T12:38:53.914730+0000","last_fullsized":"2024-03-30T12:38:53.914730+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565553+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:39:19.565553+0000","last_peered":"2024-03-30T12:39:19.565553+0000","last_clean":"2024-03-30T12:39:19.565553+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:39:19.565553+0000","last_undegraded":"2024-03-30T12:39:19.565553+0000","last_fullsized":"2024-03-30T12:39:19.565553+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306212+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:38:40.306212+0000","last_peered":"2024-03-30T12:38:40.306212+0000","last_clean":"2024-03-30T12:38:40.306212+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:38:40.306212+0000","last_undegraded":"2024-03-30T12:38:40.306212+0000","last_fullsized":"2024-03-30T12:38:40.306212+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1199,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306200+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:38:40.306200+0000","last_peered":"2024-03-30T12:38:40.306200+0000","last_clean":"2024-03-30T12:38:40.306200+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:38:40.306200+0000","last_undegraded":"2024-03-30T12:38:40.306200+0000","last_fullsized":"2024-03-30T12:38:40.306200+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1292,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:28.391470+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:39:28.391470+0000","last_peered":"2024-03-30T12:39:28.391470+0000","last_clean":"2024-03-30T12:39:28.391470+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:39:28.391470+0000","last_undegraded":"2024-03-30T12:39:28.391470+0000","last_fullsized":"2024-03-30T12:39:28.391470+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:53.914770+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:38:53.914770+0000","last_peered":"2024-03-30T12:38:53.914770+0000","last_clean":"2024-03-30T12:38:53.914770+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:38:53.914770+0000","last_undegraded":"2024-03-30T12:38:53.914770+0000","last_fullsized":"2024-03-30T12:38:53.914770+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:12.297292+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:40:12.297292+0000","last_peered":"2024-03-30T12:40:12.297292+0000","last_clean":"2024-03-30T12:40:12.297292+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:40:12.297292+0000","last_undegraded":"2024-03-30T12:40:12.297292+0000","last_fullsized":"2024-03-30T12:40:12.297292+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562847+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:38:59.562847+0000","last_peered":"2024-03-30T12:38:59.562847+0000","last_clean":"2024-03-30T12:38:59.562847+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:38:59.562847+0000","last_undegraded":"2024-03-30T12:38:59.562847+0000","last_fullsized":"2024-03-30T12:38:59.562847+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:59.148189+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:39:59.148189+0000","last_peered":"2024-03-30T12:39:59.148189+0000","last_clean":"2024-03-30T12:39:59.148189+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:39:59.148189+0000","last_undegraded":"2024-03-30T12:39:59.148189+0000","last_fullsized":"2024-03-30T12:39:59.148189+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1385,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886047+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:40:15.886047+0000","last_peered":"2024-03-30T12:40:15.886047+0000","last_clean":"2024-03-30T12:40:15.886047+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:40:15.886047+0000","last_undegraded":"2024-03-30T12:40:15.886047+0000","last_fullsized":"2024-03-30T12:40:15.886047+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886029+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:40:15.886029+0000","last_peered":"2024-03-30T12:40:15.886029+0000","last_clean":"2024-03-30T12:40:15.886029+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:40:15.886029+0000","last_undegraded":"2024-03-30T12:40:15.886029+0000","last_fullsized":"2024-03-30T12:40:15.886029+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303405+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:38:20.303405+0000","last_peered":"2024-03-30T12:38:20.303405+0000","last_clean":"2024-03-30T12:38:20.303405+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:38:20.303405+0000","last_undegraded":"2024-03-30T12:38:20.303405+0000","last_fullsized":"2024-03-30T12:38:20.303405+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.145725+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:39:39.145725+0000","last_peered":"2024-03-30T12:39:39.145725+0000","last_clean":"2024-03-30T12:39:39.145725+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:39:39.145725+0000","last_undegraded":"2024-03-30T12:39:39.145725+0000","last_fullsized":"2024-03-30T12:39:39.145725+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562815+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:38:59.562815+0000","last_peered":"2024-03-30T12:38:59.562815+0000","last_clean":"2024-03-30T12:38:59.562815+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:38:59.562815+0000","last_undegraded":"2024-03-30T12:38:59.562815+0000","last_fullsized":"2024-03-30T12:38:59.562815+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562788+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:38:59.562788+0000","last_peered":"2024-03-30T12:38:59.562788+0000","last_clean":"2024-03-30T12:38:59.562788+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:38:59.562788+0000","last_undegraded":"2024-03-30T12:38:59.562788+0000","last_fullsized":"2024-03-30T12:38:59.562788+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:03.388191+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:39:03.388191+0000","last_peered":"2024-03-30T12:39:03.388191+0000","last_clean":"2024-03-30T12:39:03.388191+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:39:03.388191+0000","last_undegraded":"2024-03-30T12:39:03.388191+0000","last_fullsized":"2024-03-30T12:39:03.388191+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.145661+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:39:39.145661+0000","last_peered":"2024-03-30T12:39:39.145661+0000","last_clean":"2024-03-30T12:39:39.145661+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:39:39.145661+0000","last_undegraded":"2024-03-30T12:39:39.145661+0000","last_fullsized":"2024-03-30T12:39:39.145661+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5754,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:23.397042+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:40:23.397042+0000","last_peered":"2024-03-30T12:40:23.397042+0000","last_clean":"2024-03-30T12:40:23.397042+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:40:23.397042+0000","last_undegraded":"2024-03-30T12:40:23.397042+0000","last_fullsized":"2024-03-30T12:40:23.397042+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1276,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:47.295052+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:39:47.295052+0000","last_peered":"2024-03-30T12:39:47.295052+0000","last_clean":"2024-03-30T12:39:47.295052+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:39:47.295052+0000","last_undegraded":"2024-03-30T12:39:47.295052+0000","last_fullsized":"2024-03-30T12:39:47.295052+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143289+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:39:19.143289+0000","last_peered":"2024-03-30T12:39:19.143289+0000","last_clean":"2024-03-30T12:39:19.143289+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:39:19.143289+0000","last_undegraded":"2024-03-30T12:39:19.143289+0000","last_fullsized":"2024-03-30T12:39:19.143289+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5514,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:45.876204+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:38:45.876204+0000","last_peered":"2024-03-30T12:38:45.876204+0000","last_clean":"2024-03-30T12:38:45.876204+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:38:45.876204+0000","last_undegraded":"2024-03-30T12:38:45.876204+0000","last_fullsized":"2024-03-30T12:38:45.876204+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917640+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:39:18.917640+0000","last_peered":"2024-03-30T12:39:18.917640+0000","last_clean":"2024-03-30T12:39:18.917640+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:39:18.917640+0000","last_undegraded":"2024-03-30T12:39:18.917640+0000","last_fullsized":"2024-03-30T12:39:18.917640+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917662+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:39:18.917662+0000","last_peered":"2024-03-30T12:39:18.917662+0000","last_clean":"2024-03-30T12:39:18.917662+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:39:18.917662+0000","last_undegraded":"2024-03-30T12:39:18.917662+0000","last_fullsized":"2024-03-30T12:39:18.917662+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311465+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:39:25.311465+0000","last_peered":"2024-03-30T12:39:25.311465+0000","last_clean":"2024-03-30T12:39:25.311465+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:39:25.311465+0000","last_undegraded":"2024-03-30T12:39:25.311465+0000","last_fullsized":"2024-03-30T12:39:25.311465+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5459,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:45.876257+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:38:45.876257+0000","last_peered":"2024-03-30T12:38:45.876257+0000","last_clean":"2024-03-30T12:38:45.876257+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:38:45.876257+0000","last_undegraded":"2024-03-30T12:38:45.876257+0000","last_fullsized":"2024-03-30T12:38:45.876257+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917672+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:39:18.917672+0000","last_peered":"2024-03-30T12:39:18.917672+0000","last_clean":"2024-03-30T12:39:18.917672+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:39:18.917672+0000","last_undegraded":"2024-03-30T12:39:18.917672+0000","last_fullsized":"2024-03-30T12:39:18.917672+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1208,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311386+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:39:25.311386+0000","last_peered":"2024-03-30T12:39:25.311386+0000","last_clean":"2024-03-30T12:39:25.311386+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:39:25.311386+0000","last_undegraded":"2024-03-30T12:39:25.311386+0000","last_fullsized":"2024-03-30T12:39:25.311386+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:57.289543+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:38:57.289543+0000","last_peered":"2024-03-30T12:38:57.289543+0000","last_clean":"2024-03-30T12:38:57.289543+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:38:57.289543+0000","last_undegraded":"2024-03-30T12:38:57.289543+0000","last_fullsized":"2024-03-30T12:38:57.289543+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3805,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:23.397156+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:40:23.397156+0000","last_peered":"2024-03-30T12:40:23.397156+0000","last_clean":"2024-03-30T12:40:23.397156+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:40:23.397156+0000","last_undegraded":"2024-03-30T12:40:23.397156+0000","last_fullsized":"2024-03-30T12:40:23.397156+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1344,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920990+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:39:48.920990+0000","last_peered":"2024-03-30T12:39:48.920990+0000","last_clean":"2024-03-30T12:39:48.920990+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:39:48.920990+0000","last_undegraded":"2024-03-30T12:39:48.920990+0000","last_fullsized":"2024-03-30T12:39:48.920990+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:48.914183+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:38:48.914183+0000","last_peered":"2024-03-30T12:38:48.914183+0000","last_clean":"2024-03-30T12:38:48.914183+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:38:48.914183+0000","last_undegraded":"2024-03-30T12:38:48.914183+0000","last_fullsized":"2024-03-30T12:38:48.914183+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:53.394025+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:39:53.394025+0000","last_peered":"2024-03-30T12:39:53.394025+0000","last_clean":"2024-03-30T12:39:53.394025+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:39:53.394025+0000","last_undegraded":"2024-03-30T12:39:53.394025+0000","last_fullsized":"2024-03-30T12:39:53.394025+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4577,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:39.138875+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:38:39.138875+0000","last_peered":"2024-03-30T12:38:39.138875+0000","last_clean":"2024-03-30T12:38:39.138875+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:38:39.138875+0000","last_undegraded":"2024-03-30T12:38:39.138875+0000","last_fullsized":"2024-03-30T12:38:39.138875+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1176,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:04.570573+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:40:04.570573+0000","last_peered":"2024-03-30T12:40:04.570573+0000","last_clean":"2024-03-30T12:40:04.570573+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:40:04.570573+0000","last_undegraded":"2024-03-30T12:40:04.570573+0000","last_fullsized":"2024-03-30T12:40:04.570573+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662799+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:40:27.662799+0000","last_peered":"2024-03-30T12:40:27.662799+0000","last_clean":"2024-03-30T12:40:27.662799+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:40:27.662799+0000","last_undegraded":"2024-03-30T12:40:27.662799+0000","last_fullsized":"2024-03-30T12:40:27.662799+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1201,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311442+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:39:25.311442+0000","last_peered":"2024-03-30T12:39:25.311442+0000","last_clean":"2024-03-30T12:39:25.311442+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:39:25.311442+0000","last_undegraded":"2024-03-30T12:39:25.311442+0000","last_fullsized":"2024-03-30T12:39:25.311442+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1718,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150538+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:40:19.150538+0000","last_peered":"2024-03-30T12:40:19.150538+0000","last_clean":"2024-03-30T12:40:19.150538+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:40:19.150538+0000","last_undegraded":"2024-03-30T12:40:19.150538+0000","last_fullsized":"2024-03-30T12:40:19.150538+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24715,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:39:50.314565+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:39:50.314565+0000","last_peered":"2024-03-30T12:39:50.314565+0000","last_clean":"2024-03-30T12:39:50.314565+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:39:50.314565+0000","last_undegraded":"2024-03-30T12:39:50.314565+0000","last_fullsized":"2024-03-30T12:39:50.314565+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:15.879816+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:39:15.879816+0000","last_peered":"2024-03-30T12:39:15.879816+0000","last_clean":"2024-03-30T12:39:15.879816+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:39:15.879816+0000","last_undegraded":"2024-03-30T12:39:15.879816+0000","last_fullsized":"2024-03-30T12:39:15.879816+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876163+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:38:45.876163+0000","last_peered":"2024-03-30T12:38:45.876163+0000","last_clean":"2024-03-30T12:38:45.876163+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:38:45.876163+0000","last_undegraded":"2024-03-30T12:38:45.876163+0000","last_fullsized":"2024-03-30T12:38:45.876163+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150500+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:40:19.150500+0000","last_peered":"2024-03-30T12:40:19.150500+0000","last_clean":"2024-03-30T12:40:19.150500+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:40:19.150500+0000","last_undegraded":"2024-03-30T12:40:19.150500+0000","last_fullsized":"2024-03-30T12:40:19.150500+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16482,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:04.570536+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:40:04.570536+0000","last_peered":"2024-03-30T12:40:04.570536+0000","last_clean":"2024-03-30T12:40:04.570536+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:40:04.570536+0000","last_undegraded":"2024-03-30T12:40:04.570536+0000","last_fullsized":"2024-03-30T12:40:04.570536+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876223+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:38:45.876223+0000","last_peered":"2024-03-30T12:38:45.876223+0000","last_clean":"2024-03-30T12:38:45.876223+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:38:45.876223+0000","last_undegraded":"2024-03-30T12:38:45.876223+0000","last_fullsized":"2024-03-30T12:38:45.876223+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1164,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.138928+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:38:39.138928+0000","last_peered":"2024-03-30T12:38:39.138928+0000","last_clean":"2024-03-30T12:38:39.138928+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:38:39.138928+0000","last_undegraded":"2024-03-30T12:38:39.138928+0000","last_fullsized":"2024-03-30T12:38:39.138928+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917681+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:39:18.917681+0000","last_peered":"2024-03-30T12:39:18.917681+0000","last_clean":"2024-03-30T12:39:18.917681+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:39:18.917681+0000","last_undegraded":"2024-03-30T12:39:18.917681+0000","last_fullsized":"2024-03-30T12:39:18.917681+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31270,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:57.289492+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:38:57.289492+0000","last_peered":"2024-03-30T12:38:57.289492+0000","last_clean":"2024-03-30T12:38:57.289492+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:38:57.289492+0000","last_undegraded":"2024-03-30T12:38:57.289492+0000","last_fullsized":"2024-03-30T12:38:57.289492+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659585+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:39:57.659585+0000","last_peered":"2024-03-30T12:39:57.659585+0000","last_clean":"2024-03-30T12:39:57.659585+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:39:57.659585+0000","last_undegraded":"2024-03-30T12:39:57.659585+0000","last_fullsized":"2024-03-30T12:39:57.659585+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1355,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920979+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:39:48.920979+0000","last_peered":"2024-03-30T12:39:48.920979+0000","last_clean":"2024-03-30T12:39:48.920979+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:39:48.920979+0000","last_undegraded":"2024-03-30T12:39:48.920979+0000","last_fullsized":"2024-03-30T12:39:48.920979+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651932+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:38:47.651932+0000","last_peered":"2024-03-30T12:38:47.651932+0000","last_clean":"2024-03-30T12:38:47.651932+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:38:47.651932+0000","last_undegraded":"2024-03-30T12:38:47.651932+0000","last_fullsized":"2024-03-30T12:38:47.651932+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3766,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659555+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:39:57.659555+0000","last_peered":"2024-03-30T12:39:57.659555+0000","last_clean":"2024-03-30T12:39:57.659555+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:39:57.659555+0000","last_undegraded":"2024-03-30T12:39:57.659555+0000","last_fullsized":"2024-03-30T12:39:57.659555+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:57.289460+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:38:57.289460+0000","last_peered":"2024-03-30T12:38:57.289460+0000","last_clean":"2024-03-30T12:38:57.289460+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:38:57.289460+0000","last_undegraded":"2024-03-30T12:38:57.289460+0000","last_fullsized":"2024-03-30T12:38:57.289460+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1157,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573285+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:40:29.573285+0000","last_peered":"2024-03-30T12:40:29.573285+0000","last_clean":"2024-03-30T12:40:29.573285+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:40:29.573285+0000","last_undegraded":"2024-03-30T12:40:29.573285+0000","last_fullsized":"2024-03-30T12:40:29.573285+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:15.879792+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:39:15.879792+0000","last_peered":"2024-03-30T12:39:15.879792+0000","last_clean":"2024-03-30T12:39:15.879792+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:39:15.879792+0000","last_undegraded":"2024-03-30T12:39:15.879792+0000","last_fullsized":"2024-03-30T12:39:15.879792+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15595,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:15.317660+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:40:15.317660+0000","last_peered":"2024-03-30T12:40:15.317660+0000","last_clean":"2024-03-30T12:40:15.317660+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:40:15.317660+0000","last_undegraded":"2024-03-30T12:40:15.317660+0000","last_fullsized":"2024-03-30T12:40:15.317660+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.141061+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:38:59.141061+0000","last_peered":"2024-03-30T12:38:59.141061+0000","last_clean":"2024-03-30T12:38:59.141061+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:38:59.141061+0000","last_undegraded":"2024-03-30T12:38:59.141061+0000","last_fullsized":"2024-03-30T12:38:59.141061+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:22.292071+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:39:22.292071+0000","last_peered":"2024-03-30T12:39:22.292071+0000","last_clean":"2024-03-30T12:39:22.292071+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:39:22.292071+0000","last_undegraded":"2024-03-30T12:39:22.292071+0000","last_fullsized":"2024-03-30T12:39:22.292071+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29021,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:39:47.295005+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:39:47.295005+0000","last_peered":"2024-03-30T12:39:47.295005+0000","last_clean":"2024-03-30T12:39:47.295005+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:39:47.295005+0000","last_undegraded":"2024-03-30T12:39:47.295005+0000","last_fullsized":"2024-03-30T12:39:47.295005+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920913+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:39:48.920913+0000","last_peered":"2024-03-30T12:39:48.920913+0000","last_clean":"2024-03-30T12:39:48.920913+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:39:48.920913+0000","last_undegraded":"2024-03-30T12:39:48.920913+0000","last_fullsized":"2024-03-30T12:39:48.920913+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651850+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:38:47.651850+0000","last_peered":"2024-03-30T12:38:47.651850+0000","last_clean":"2024-03-30T12:38:47.651850+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:38:47.651850+0000","last_undegraded":"2024-03-30T12:38:47.651850+0000","last_fullsized":"2024-03-30T12:38:47.651850+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5611,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:38.385807+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:38:38.385807+0000","last_peered":"2024-03-30T12:38:38.385807+0000","last_clean":"2024-03-30T12:38:38.385807+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:38:38.385807+0000","last_undegraded":"2024-03-30T12:38:38.385807+0000","last_fullsized":"2024-03-30T12:38:38.385807+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1366,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920941+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:39:48.920941+0000","last_peered":"2024-03-30T12:39:48.920941+0000","last_clean":"2024-03-30T12:39:48.920941+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:39:48.920941+0000","last_undegraded":"2024-03-30T12:39:48.920941+0000","last_fullsized":"2024-03-30T12:39:48.920941+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:12.654884+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:39:12.654884+0000","last_peered":"2024-03-30T12:39:12.654884+0000","last_clean":"2024-03-30T12:39:12.654884+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:39:12.654884+0000","last_undegraded":"2024-03-30T12:39:12.654884+0000","last_fullsized":"2024-03-30T12:39:12.654884+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4276,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:18.924042+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:40:18.924042+0000","last_peered":"2024-03-30T12:40:18.924042+0000","last_clean":"2024-03-30T12:40:18.924042+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:40:18.924042+0000","last_undegraded":"2024-03-30T12:40:18.924042+0000","last_fullsized":"2024-03-30T12:40:18.924042+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143221+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:39:19.143221+0000","last_peered":"2024-03-30T12:39:19.143221+0000","last_clean":"2024-03-30T12:39:19.143221+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:39:19.143221+0000","last_undegraded":"2024-03-30T12:39:19.143221+0000","last_fullsized":"2024-03-30T12:39:19.143221+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573205+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:40:29.573205+0000","last_peered":"2024-03-30T12:40:29.573205+0000","last_clean":"2024-03-30T12:40:29.573205+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:40:29.573205+0000","last_undegraded":"2024-03-30T12:40:29.573205+0000","last_fullsized":"2024-03-30T12:40:29.573205+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5254,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:38.385765+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:38:38.385765+0000","last_peered":"2024-03-30T12:38:38.385765+0000","last_clean":"2024-03-30T12:38:38.385765+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:38:38.385765+0000","last_undegraded":"2024-03-30T12:38:38.385765+0000","last_fullsized":"2024-03-30T12:38:38.385765+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:38.385797+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:38:38.385797+0000","last_peered":"2024-03-30T12:38:38.385797+0000","last_clean":"2024-03-30T12:38:38.385797+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:38:38.385797+0000","last_undegraded":"2024-03-30T12:38:38.385797+0000","last_fullsized":"2024-03-30T12:38:38.385797+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143264+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:39:19.143264+0000","last_peered":"2024-03-30T12:39:19.143264+0000","last_clean":"2024-03-30T12:39:19.143264+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:39:19.143264+0000","last_undegraded":"2024-03-30T12:39:19.143264+0000","last_fullsized":"2024-03-30T12:39:19.143264+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4812,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:23.397123+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:40:23.397123+0000","last_peered":"2024-03-30T12:40:23.397123+0000","last_clean":"2024-03-30T12:40:23.397123+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:40:23.397123+0000","last_undegraded":"2024-03-30T12:40:23.397123+0000","last_fullsized":"2024-03-30T12:40:23.397123+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:18.924078+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:40:18.924078+0000","last_peered":"2024-03-30T12:40:18.924078+0000","last_clean":"2024-03-30T12:40:18.924078+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:40:18.924078+0000","last_undegraded":"2024-03-30T12:40:18.924078+0000","last_fullsized":"2024-03-30T12:40:18.924078+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.317641+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:40:15.317641+0000","last_peered":"2024-03-30T12:40:15.317641+0000","last_clean":"2024-03-30T12:40:15.317641+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:40:15.317641+0000","last_undegraded":"2024-03-30T12:40:15.317641+0000","last_fullsized":"2024-03-30T12:40:15.317641+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6744,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:59.141086+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:38:59.141086+0000","last_peered":"2024-03-30T12:38:59.141086+0000","last_clean":"2024-03-30T12:38:59.141086+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:38:59.141086+0000","last_undegraded":"2024-03-30T12:38:59.141086+0000","last_fullsized":"2024-03-30T12:38:59.141086+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1338,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:38.385827+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:38:38.385827+0000","last_peered":"2024-03-30T12:38:38.385827+0000","last_clean":"2024-03-30T12:38:38.385827+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:38:38.385827+0000","last_undegraded":"2024-03-30T12:38:38.385827+0000","last_fullsized":"2024-03-30T12:38:38.385827+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143303+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:39:19.143303+0000","last_peered":"2024-03-30T12:39:19.143303+0000","last_clean":"2024-03-30T12:39:19.143303+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:39:19.143303+0000","last_undegraded":"2024-03-30T12:39:19.143303+0000","last_fullsized":"2024-03-30T12:39:19.143303+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:04.570502+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:40:04.570502+0000","last_peered":"2024-03-30T12:40:04.570502+0000","last_clean":"2024-03-30T12:40:04.570502+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:40:04.570502+0000","last_undegraded":"2024-03-30T12:40:04.570502+0000","last_fullsized":"2024-03-30T12:40:04.570502+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:53.394048+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:39:53.394048+0000","last_peered":"2024-03-30T12:39:53.394048+0000","last_clean":"2024-03-30T12:39:53.394048+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:39:53.394048+0000","last_undegraded":"2024-03-30T12:39:53.394048+0000","last_fullsized":"2024-03-30T12:39:53.394048+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311414+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:39:25.311414+0000","last_peered":"2024-03-30T12:39:25.311414+0000","last_clean":"2024-03-30T12:39:25.311414+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:39:25.311414+0000","last_undegraded":"2024-03-30T12:39:25.311414+0000","last_fullsized":"2024-03-30T12:39:25.311414+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876194+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:38:45.876194+0000","last_peered":"2024-03-30T12:38:45.876194+0000","last_clean":"2024-03-30T12:38:45.876194+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:38:45.876194+0000","last_undegraded":"2024-03-30T12:38:45.876194+0000","last_fullsized":"2024-03-30T12:38:45.876194+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651915+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:38:47.651915+0000","last_peered":"2024-03-30T12:38:47.651915+0000","last_clean":"2024-03-30T12:38:47.651915+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:38:47.651915+0000","last_undegraded":"2024-03-30T12:38:47.651915+0000","last_fullsized":"2024-03-30T12:38:47.651915+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920964+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:39:48.920964+0000","last_peered":"2024-03-30T12:39:48.920964+0000","last_clean":"2024-03-30T12:39:48.920964+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:39:48.920964+0000","last_undegraded":"2024-03-30T12:39:48.920964+0000","last_fullsized":"2024-03-30T12:39:48.920964+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1179,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573267+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:40:29.573267+0000","last_peered":"2024-03-30T12:40:29.573267+0000","last_clean":"2024-03-30T12:40:29.573267+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:40:29.573267+0000","last_undegraded":"2024-03-30T12:40:29.573267+0000","last_fullsized":"2024-03-30T12:40:29.573267+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1282,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651943+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:38:47.651943+0000","last_peered":"2024-03-30T12:38:47.651943+0000","last_clean":"2024-03-30T12:38:47.651943+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:38:47.651943+0000","last_undegraded":"2024-03-30T12:38:47.651943+0000","last_fullsized":"2024-03-30T12:38:47.651943+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:50.314509+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:39:50.314509+0000","last_peered":"2024-03-30T12:39:50.314509+0000","last_clean":"2024-03-30T12:39:50.314509+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:39:50.314509+0000","last_undegraded":"2024-03-30T12:39:50.314509+0000","last_fullsized":"2024-03-30T12:39:50.314509+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:12.654857+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:39:12.654857+0000","last_peered":"2024-03-30T12:39:12.654857+0000","last_clean":"2024-03-30T12:39:12.654857+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:39:12.654857+0000","last_undegraded":"2024-03-30T12:39:12.654857+0000","last_fullsized":"2024-03-30T12:39:12.654857+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1217,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.317602+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:40:15.317602+0000","last_peered":"2024-03-30T12:40:15.317602+0000","last_clean":"2024-03-30T12:40:15.317602+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:40:15.317602+0000","last_undegraded":"2024-03-30T12:40:15.317602+0000","last_fullsized":"2024-03-30T12:40:15.317602+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:45.883156+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:39:45.883156+0000","last_peered":"2024-03-30T12:39:45.883156+0000","last_clean":"2024-03-30T12:39:45.883156+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:39:45.883156+0000","last_undegraded":"2024-03-30T12:39:45.883156+0000","last_fullsized":"2024-03-30T12:39:45.883156+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.560418+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:38:39.560418+0000","last_peered":"2024-03-30T12:38:39.560418+0000","last_clean":"2024-03-30T12:38:39.560418+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:38:39.560418+0000","last_undegraded":"2024-03-30T12:38:39.560418+0000","last_fullsized":"2024-03-30T12:38:39.560418+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438102,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648158,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175168,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254406,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063225,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951282,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839339,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923621,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:42:46.966 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:46.966 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:46.966 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:46.966 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:46.966 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:46.966 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:46.967 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:46.967 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:46.967 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:46.967 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:46.967 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:46.967 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:46.967 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:46.967 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:42:47.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:46 smithi162 ceph-mon[83709]: pgmap v1191: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:47.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:46 smithi084 ceph-mon[91810]: pgmap v1191: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:47.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:46 smithi084 ceph-mon[89279]: pgmap v1191: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:48.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:47 smithi162 ceph-mon[83709]: from='client.34698 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:42:48.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:47 smithi084 ceph-mon[91810]: from='client.34698 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:42:48.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:47 smithi084 ceph-mon[89279]: from='client.34698 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:42:49.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:48 smithi162 ceph-mon[83709]: pgmap v1192: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:49.155 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:48 smithi084 ceph-mon[91810]: pgmap v1192: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:49.156 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:48 smithi084 ceph-mon[89279]: pgmap v1192: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:49.504 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:42:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:42:49] "GET /metrics HTTP/1.1" 200 36326 "" "Prometheus/2.43.0" 2024-03-30T12:42:51.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:50 smithi162 ceph-mon[83709]: pgmap v1193: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:51.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:50 smithi084 ceph-mon[89279]: pgmap v1193: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:51.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:50 smithi084 ceph-mon[91810]: pgmap v1193: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:53.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:52 smithi162 ceph-mon[83709]: pgmap v1194: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:53.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:52 smithi084 ceph-mon[89279]: pgmap v1194: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:53.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:52 smithi084 ceph-mon[91810]: pgmap v1194: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:55.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:54 smithi162 ceph-mon[83709]: pgmap v1195: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:55.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:54 smithi084 ceph-mon[91810]: pgmap v1195: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:55.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:54 smithi084 ceph-mon[89279]: pgmap v1195: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:56.968 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:42:57.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:56 smithi162 ceph-mon[83709]: pgmap v1196: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:57.187 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:42:57.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:56 smithi084 ceph-mon[91810]: pgmap v1196: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:57.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:56 smithi084 ceph-mon[89279]: pgmap v1196: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:58.920 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:58 smithi084 ceph-mon[91810]: pgmap v1197: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:58.921 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:58 smithi084 ceph-mon[89279]: pgmap v1197: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:59.120 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:58 smithi162 ceph-mon[83709]: pgmap v1197: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:42:59.230 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:42:59.232 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:42:59.505 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:42:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:42:59] "GET /metrics HTTP/1.1" 200 36326 "" "Prometheus/2.43.0" 2024-03-30T12:42:59.896 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1198,"stamp":"2024-03-30T12:42:58.931896+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004314"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:44.153566+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:40:44.153566+0000","last_peered":"2024-03-30T12:40:44.153566+0000","last_clean":"2024-03-30T12:40:44.153566+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:40:44.153566+0000","last_undegraded":"2024-03-30T12:40:44.153566+0000","last_fullsized":"2024-03-30T12:40:44.153566+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1365,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917695+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:39:18.917695+0000","last_peered":"2024-03-30T12:39:18.917695+0000","last_clean":"2024-03-30T12:39:18.917695+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:39:18.917695+0000","last_undegraded":"2024-03-30T12:39:18.917695+0000","last_fullsized":"2024-03-30T12:39:18.917695+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889238+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:40:50.889238+0000","last_peered":"2024-03-30T12:40:50.889238+0000","last_clean":"2024-03-30T12:40:50.889238+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:40:50.889238+0000","last_undegraded":"2024-03-30T12:40:50.889238+0000","last_fullsized":"2024-03-30T12:40:50.889238+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308618+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:39:00.308618+0000","last_peered":"2024-03-30T12:39:00.308618+0000","last_clean":"2024-03-30T12:39:00.308618+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:39:00.308618+0000","last_undegraded":"2024-03-30T12:39:00.308618+0000","last_fullsized":"2024-03-30T12:39:00.308618+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150593+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:40:19.150593+0000","last_peered":"2024-03-30T12:40:19.150593+0000","last_clean":"2024-03-30T12:40:19.150593+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:40:19.150593+0000","last_undegraded":"2024-03-30T12:40:19.150593+0000","last_fullsized":"2024-03-30T12:40:19.150593+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1211,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308563+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:39:00.308563+0000","last_peered":"2024-03-30T12:39:00.308563+0000","last_clean":"2024-03-30T12:39:00.308563+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:39:00.308563+0000","last_undegraded":"2024-03-30T12:39:00.308563+0000","last_fullsized":"2024-03-30T12:39:00.308563+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150576+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:40:19.150576+0000","last_peered":"2024-03-30T12:40:19.150576+0000","last_clean":"2024-03-30T12:40:19.150576+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:40:19.150576+0000","last_undegraded":"2024-03-30T12:40:19.150576+0000","last_fullsized":"2024-03-30T12:40:19.150576+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662744+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:40:27.662744+0000","last_peered":"2024-03-30T12:40:27.662744+0000","last_clean":"2024-03-30T12:40:27.662744+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:40:27.662744+0000","last_undegraded":"2024-03-30T12:40:27.662744+0000","last_fullsized":"2024-03-30T12:40:27.662744+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:59.148225+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:39:59.148225+0000","last_peered":"2024-03-30T12:39:59.148225+0000","last_clean":"2024-03-30T12:39:59.148225+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:39:59.148225+0000","last_undegraded":"2024-03-30T12:39:59.148225+0000","last_fullsized":"2024-03-30T12:39:59.148225+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565540+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:39:19.565540+0000","last_peered":"2024-03-30T12:39:19.565540+0000","last_clean":"2024-03-30T12:39:19.565540+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:39:19.565540+0000","last_undegraded":"2024-03-30T12:39:19.565540+0000","last_fullsized":"2024-03-30T12:39:19.565540+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565513+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:39:19.565513+0000","last_peered":"2024-03-30T12:39:19.565513+0000","last_clean":"2024-03-30T12:39:19.565513+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:39:19.565513+0000","last_undegraded":"2024-03-30T12:39:19.565513+0000","last_fullsized":"2024-03-30T12:39:19.565513+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1271,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:12.285006+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:38:12.285006+0000","last_peered":"2024-03-30T12:38:12.285006+0000","last_clean":"2024-03-30T12:38:12.285006+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:38:12.285006+0000","last_undegraded":"2024-03-30T12:38:12.285006+0000","last_fullsized":"2024-03-30T12:38:12.285006+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660090+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:40:02.660090+0000","last_peered":"2024-03-30T12:40:02.660090+0000","last_clean":"2024-03-30T12:40:02.660090+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:40:02.660090+0000","last_undegraded":"2024-03-30T12:40:02.660090+0000","last_fullsized":"2024-03-30T12:40:02.660090+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886008+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:40:15.886008+0000","last_peered":"2024-03-30T12:40:15.886008+0000","last_clean":"2024-03-30T12:40:15.886008+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:40:15.886008+0000","last_undegraded":"2024-03-30T12:40:15.886008+0000","last_fullsized":"2024-03-30T12:40:15.886008+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:28.912065+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:38:28.912065+0000","last_peered":"2024-03-30T12:38:28.912065+0000","last_clean":"2024-03-30T12:38:28.912065+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:38:28.912065+0000","last_undegraded":"2024-03-30T12:38:28.912065+0000","last_fullsized":"2024-03-30T12:38:28.912065+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303373+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:38:20.303373+0000","last_peered":"2024-03-30T12:38:20.303373+0000","last_clean":"2024-03-30T12:38:20.303373+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:38:20.303373+0000","last_undegraded":"2024-03-30T12:38:20.303373+0000","last_fullsized":"2024-03-30T12:38:20.303373+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1225,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303460+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:38:20.303460+0000","last_peered":"2024-03-30T12:38:20.303460+0000","last_clean":"2024-03-30T12:38:20.303460+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:38:20.303460+0000","last_undegraded":"2024-03-30T12:38:20.303460+0000","last_fullsized":"2024-03-30T12:38:20.303460+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:03.388264+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:39:03.388264+0000","last_peered":"2024-03-30T12:39:03.388264+0000","last_clean":"2024-03-30T12:39:03.388264+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:39:03.388264+0000","last_undegraded":"2024-03-30T12:39:03.388264+0000","last_fullsized":"2024-03-30T12:39:03.388264+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143278+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:39:19.143278+0000","last_peered":"2024-03-30T12:39:19.143278+0000","last_clean":"2024-03-30T12:39:19.143278+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:39:19.143278+0000","last_undegraded":"2024-03-30T12:39:19.143278+0000","last_fullsized":"2024-03-30T12:39:19.143278+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1390,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889293+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:40:50.889293+0000","last_peered":"2024-03-30T12:40:50.889293+0000","last_clean":"2024-03-30T12:40:50.889293+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:40:50.889293+0000","last_undegraded":"2024-03-30T12:40:50.889293+0000","last_fullsized":"2024-03-30T12:40:50.889293+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1284,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659610+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:39:57.659610+0000","last_peered":"2024-03-30T12:39:57.659610+0000","last_clean":"2024-03-30T12:39:57.659610+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:39:57.659610+0000","last_undegraded":"2024-03-30T12:39:57.659610+0000","last_fullsized":"2024-03-30T12:39:57.659610+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1303,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659620+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:39:57.659620+0000","last_peered":"2024-03-30T12:39:57.659620+0000","last_clean":"2024-03-30T12:39:57.659620+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:39:57.659620+0000","last_undegraded":"2024-03-30T12:39:57.659620+0000","last_fullsized":"2024-03-30T12:39:57.659620+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889279+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:40:50.889279+0000","last_peered":"2024-03-30T12:40:50.889279+0000","last_clean":"2024-03-30T12:40:50.889279+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:40:50.889279+0000","last_undegraded":"2024-03-30T12:40:50.889279+0000","last_fullsized":"2024-03-30T12:40:50.889279+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150628+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:40:19.150628+0000","last_peered":"2024-03-30T12:40:19.150628+0000","last_clean":"2024-03-30T12:40:19.150628+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:40:19.150628+0000","last_undegraded":"2024-03-30T12:40:19.150628+0000","last_fullsized":"2024-03-30T12:40:19.150628+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1230,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308632+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:39:00.308632+0000","last_peered":"2024-03-30T12:39:00.308632+0000","last_clean":"2024-03-30T12:39:00.308632+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:39:00.308632+0000","last_undegraded":"2024-03-30T12:39:00.308632+0000","last_fullsized":"2024-03-30T12:39:00.308632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150608+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:40:19.150608+0000","last_peered":"2024-03-30T12:40:19.150608+0000","last_clean":"2024-03-30T12:40:19.150608+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:40:19.150608+0000","last_undegraded":"2024-03-30T12:40:19.150608+0000","last_fullsized":"2024-03-30T12:40:19.150608+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308643+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:39:00.308643+0000","last_peered":"2024-03-30T12:39:00.308643+0000","last_clean":"2024-03-30T12:39:00.308643+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:39:00.308643+0000","last_undegraded":"2024-03-30T12:39:00.308643+0000","last_fullsized":"2024-03-30T12:39:00.308643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1263,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662819+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:40:27.662819+0000","last_peered":"2024-03-30T12:40:27.662819+0000","last_clean":"2024-03-30T12:40:27.662819+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:40:27.662819+0000","last_undegraded":"2024-03-30T12:40:27.662819+0000","last_fullsized":"2024-03-30T12:40:27.662819+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1263,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:32.286955+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:38:32.286955+0000","last_peered":"2024-03-30T12:38:32.286955+0000","last_clean":"2024-03-30T12:38:32.286955+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:38:32.286955+0000","last_undegraded":"2024-03-30T12:38:32.286955+0000","last_fullsized":"2024-03-30T12:38:32.286955+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1181,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.567808+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:39:39.567808+0000","last_peered":"2024-03-30T12:39:39.567808+0000","last_clean":"2024-03-30T12:39:39.567808+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:39:39.567808+0000","last_undegraded":"2024-03-30T12:39:39.567808+0000","last_fullsized":"2024-03-30T12:39:39.567808+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876233+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:38:45.876233+0000","last_peered":"2024-03-30T12:38:45.876233+0000","last_clean":"2024-03-30T12:38:45.876233+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:38:45.876233+0000","last_undegraded":"2024-03-30T12:38:45.876233+0000","last_fullsized":"2024-03-30T12:38:45.876233+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660073+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:40:02.660073+0000","last_peered":"2024-03-30T12:40:02.660073+0000","last_clean":"2024-03-30T12:40:02.660073+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:40:02.660073+0000","last_undegraded":"2024-03-30T12:40:02.660073+0000","last_fullsized":"2024-03-30T12:40:02.660073+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660041+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:40:02.660041+0000","last_peered":"2024-03-30T12:40:02.660041+0000","last_clean":"2024-03-30T12:40:02.660041+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:40:02.660041+0000","last_undegraded":"2024-03-30T12:40:02.660041+0000","last_fullsized":"2024-03-30T12:40:02.660041+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1225,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306130+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:38:40.306130+0000","last_peered":"2024-03-30T12:38:40.306130+0000","last_clean":"2024-03-30T12:38:40.306130+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:38:40.306130+0000","last_undegraded":"2024-03-30T12:38:40.306130+0000","last_fullsized":"2024-03-30T12:38:40.306130+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:53.914730+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:38:53.914730+0000","last_peered":"2024-03-30T12:38:53.914730+0000","last_clean":"2024-03-30T12:38:53.914730+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:38:53.914730+0000","last_undegraded":"2024-03-30T12:38:53.914730+0000","last_fullsized":"2024-03-30T12:38:53.914730+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565553+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:39:19.565553+0000","last_peered":"2024-03-30T12:39:19.565553+0000","last_clean":"2024-03-30T12:39:19.565553+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:39:19.565553+0000","last_undegraded":"2024-03-30T12:39:19.565553+0000","last_fullsized":"2024-03-30T12:39:19.565553+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306212+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:38:40.306212+0000","last_peered":"2024-03-30T12:38:40.306212+0000","last_clean":"2024-03-30T12:38:40.306212+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:38:40.306212+0000","last_undegraded":"2024-03-30T12:38:40.306212+0000","last_fullsized":"2024-03-30T12:38:40.306212+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1199,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306200+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:38:40.306200+0000","last_peered":"2024-03-30T12:38:40.306200+0000","last_clean":"2024-03-30T12:38:40.306200+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:38:40.306200+0000","last_undegraded":"2024-03-30T12:38:40.306200+0000","last_fullsized":"2024-03-30T12:38:40.306200+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1292,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:28.391470+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:39:28.391470+0000","last_peered":"2024-03-30T12:39:28.391470+0000","last_clean":"2024-03-30T12:39:28.391470+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:39:28.391470+0000","last_undegraded":"2024-03-30T12:39:28.391470+0000","last_fullsized":"2024-03-30T12:39:28.391470+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:53.914770+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:38:53.914770+0000","last_peered":"2024-03-30T12:38:53.914770+0000","last_clean":"2024-03-30T12:38:53.914770+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:38:53.914770+0000","last_undegraded":"2024-03-30T12:38:53.914770+0000","last_fullsized":"2024-03-30T12:38:53.914770+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:12.297292+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:40:12.297292+0000","last_peered":"2024-03-30T12:40:12.297292+0000","last_clean":"2024-03-30T12:40:12.297292+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:40:12.297292+0000","last_undegraded":"2024-03-30T12:40:12.297292+0000","last_fullsized":"2024-03-30T12:40:12.297292+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562847+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:38:59.562847+0000","last_peered":"2024-03-30T12:38:59.562847+0000","last_clean":"2024-03-30T12:38:59.562847+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:38:59.562847+0000","last_undegraded":"2024-03-30T12:38:59.562847+0000","last_fullsized":"2024-03-30T12:38:59.562847+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:59.148189+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:39:59.148189+0000","last_peered":"2024-03-30T12:39:59.148189+0000","last_clean":"2024-03-30T12:39:59.148189+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:39:59.148189+0000","last_undegraded":"2024-03-30T12:39:59.148189+0000","last_fullsized":"2024-03-30T12:39:59.148189+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1385,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886047+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:40:15.886047+0000","last_peered":"2024-03-30T12:40:15.886047+0000","last_clean":"2024-03-30T12:40:15.886047+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:40:15.886047+0000","last_undegraded":"2024-03-30T12:40:15.886047+0000","last_fullsized":"2024-03-30T12:40:15.886047+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886029+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:40:15.886029+0000","last_peered":"2024-03-30T12:40:15.886029+0000","last_clean":"2024-03-30T12:40:15.886029+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:40:15.886029+0000","last_undegraded":"2024-03-30T12:40:15.886029+0000","last_fullsized":"2024-03-30T12:40:15.886029+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:20.303405+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:38:20.303405+0000","last_peered":"2024-03-30T12:38:20.303405+0000","last_clean":"2024-03-30T12:38:20.303405+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:38:20.303405+0000","last_undegraded":"2024-03-30T12:38:20.303405+0000","last_fullsized":"2024-03-30T12:38:20.303405+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.145725+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:39:39.145725+0000","last_peered":"2024-03-30T12:39:39.145725+0000","last_clean":"2024-03-30T12:39:39.145725+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:39:39.145725+0000","last_undegraded":"2024-03-30T12:39:39.145725+0000","last_fullsized":"2024-03-30T12:39:39.145725+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562815+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:38:59.562815+0000","last_peered":"2024-03-30T12:38:59.562815+0000","last_clean":"2024-03-30T12:38:59.562815+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:38:59.562815+0000","last_undegraded":"2024-03-30T12:38:59.562815+0000","last_fullsized":"2024-03-30T12:38:59.562815+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562788+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:38:59.562788+0000","last_peered":"2024-03-30T12:38:59.562788+0000","last_clean":"2024-03-30T12:38:59.562788+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:38:59.562788+0000","last_undegraded":"2024-03-30T12:38:59.562788+0000","last_fullsized":"2024-03-30T12:38:59.562788+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:03.388191+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:39:03.388191+0000","last_peered":"2024-03-30T12:39:03.388191+0000","last_clean":"2024-03-30T12:39:03.388191+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:39:03.388191+0000","last_undegraded":"2024-03-30T12:39:03.388191+0000","last_fullsized":"2024-03-30T12:39:03.388191+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.145661+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:39:39.145661+0000","last_peered":"2024-03-30T12:39:39.145661+0000","last_clean":"2024-03-30T12:39:39.145661+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:39:39.145661+0000","last_undegraded":"2024-03-30T12:39:39.145661+0000","last_fullsized":"2024-03-30T12:39:39.145661+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5754,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:23.397042+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:40:23.397042+0000","last_peered":"2024-03-30T12:40:23.397042+0000","last_clean":"2024-03-30T12:40:23.397042+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:40:23.397042+0000","last_undegraded":"2024-03-30T12:40:23.397042+0000","last_fullsized":"2024-03-30T12:40:23.397042+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1276,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:47.295052+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:39:47.295052+0000","last_peered":"2024-03-30T12:39:47.295052+0000","last_clean":"2024-03-30T12:39:47.295052+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:39:47.295052+0000","last_undegraded":"2024-03-30T12:39:47.295052+0000","last_fullsized":"2024-03-30T12:39:47.295052+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143289+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:39:19.143289+0000","last_peered":"2024-03-30T12:39:19.143289+0000","last_clean":"2024-03-30T12:39:19.143289+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:39:19.143289+0000","last_undegraded":"2024-03-30T12:39:19.143289+0000","last_fullsized":"2024-03-30T12:39:19.143289+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5515,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:50.889213+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:40:50.889213+0000","last_peered":"2024-03-30T12:40:50.889213+0000","last_clean":"2024-03-30T12:40:50.889213+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:40:50.889213+0000","last_undegraded":"2024-03-30T12:40:50.889213+0000","last_fullsized":"2024-03-30T12:40:50.889213+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917640+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:39:18.917640+0000","last_peered":"2024-03-30T12:39:18.917640+0000","last_clean":"2024-03-30T12:39:18.917640+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:39:18.917640+0000","last_undegraded":"2024-03-30T12:39:18.917640+0000","last_fullsized":"2024-03-30T12:39:18.917640+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917662+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:39:18.917662+0000","last_peered":"2024-03-30T12:39:18.917662+0000","last_clean":"2024-03-30T12:39:18.917662+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:39:18.917662+0000","last_undegraded":"2024-03-30T12:39:18.917662+0000","last_fullsized":"2024-03-30T12:39:18.917662+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311465+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:39:25.311465+0000","last_peered":"2024-03-30T12:39:25.311465+0000","last_clean":"2024-03-30T12:39:25.311465+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:39:25.311465+0000","last_undegraded":"2024-03-30T12:39:25.311465+0000","last_fullsized":"2024-03-30T12:39:25.311465+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5459,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:45.876257+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:38:45.876257+0000","last_peered":"2024-03-30T12:38:45.876257+0000","last_clean":"2024-03-30T12:38:45.876257+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:38:45.876257+0000","last_undegraded":"2024-03-30T12:38:45.876257+0000","last_fullsized":"2024-03-30T12:38:45.876257+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917672+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:39:18.917672+0000","last_peered":"2024-03-30T12:39:18.917672+0000","last_clean":"2024-03-30T12:39:18.917672+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:39:18.917672+0000","last_undegraded":"2024-03-30T12:39:18.917672+0000","last_fullsized":"2024-03-30T12:39:18.917672+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1208,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311386+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:39:25.311386+0000","last_peered":"2024-03-30T12:39:25.311386+0000","last_clean":"2024-03-30T12:39:25.311386+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:39:25.311386+0000","last_undegraded":"2024-03-30T12:39:25.311386+0000","last_fullsized":"2024-03-30T12:39:25.311386+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:57.289543+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:38:57.289543+0000","last_peered":"2024-03-30T12:38:57.289543+0000","last_clean":"2024-03-30T12:38:57.289543+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:38:57.289543+0000","last_undegraded":"2024-03-30T12:38:57.289543+0000","last_fullsized":"2024-03-30T12:38:57.289543+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3805,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:23.397156+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:40:23.397156+0000","last_peered":"2024-03-30T12:40:23.397156+0000","last_clean":"2024-03-30T12:40:23.397156+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:40:23.397156+0000","last_undegraded":"2024-03-30T12:40:23.397156+0000","last_fullsized":"2024-03-30T12:40:23.397156+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1344,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920990+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:39:48.920990+0000","last_peered":"2024-03-30T12:39:48.920990+0000","last_clean":"2024-03-30T12:39:48.920990+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:39:48.920990+0000","last_undegraded":"2024-03-30T12:39:48.920990+0000","last_fullsized":"2024-03-30T12:39:48.920990+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:48.927559+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:40:48.927559+0000","last_peered":"2024-03-30T12:40:48.927559+0000","last_clean":"2024-03-30T12:40:48.927559+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:40:48.927559+0000","last_undegraded":"2024-03-30T12:40:48.927559+0000","last_fullsized":"2024-03-30T12:40:48.927559+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:53.394025+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:39:53.394025+0000","last_peered":"2024-03-30T12:39:53.394025+0000","last_clean":"2024-03-30T12:39:53.394025+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:39:53.394025+0000","last_undegraded":"2024-03-30T12:39:53.394025+0000","last_fullsized":"2024-03-30T12:39:53.394025+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4578,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:44.153464+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:40:44.153464+0000","last_peered":"2024-03-30T12:40:44.153464+0000","last_clean":"2024-03-30T12:40:44.153464+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:40:44.153464+0000","last_undegraded":"2024-03-30T12:40:44.153464+0000","last_fullsized":"2024-03-30T12:40:44.153464+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1176,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:04.570573+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:40:04.570573+0000","last_peered":"2024-03-30T12:40:04.570573+0000","last_clean":"2024-03-30T12:40:04.570573+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:40:04.570573+0000","last_undegraded":"2024-03-30T12:40:04.570573+0000","last_fullsized":"2024-03-30T12:40:04.570573+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662799+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:40:27.662799+0000","last_peered":"2024-03-30T12:40:27.662799+0000","last_clean":"2024-03-30T12:40:27.662799+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:40:27.662799+0000","last_undegraded":"2024-03-30T12:40:27.662799+0000","last_fullsized":"2024-03-30T12:40:27.662799+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1201,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311442+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:39:25.311442+0000","last_peered":"2024-03-30T12:39:25.311442+0000","last_clean":"2024-03-30T12:39:25.311442+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:39:25.311442+0000","last_undegraded":"2024-03-30T12:39:25.311442+0000","last_fullsized":"2024-03-30T12:39:25.311442+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1718,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150538+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:40:19.150538+0000","last_peered":"2024-03-30T12:40:19.150538+0000","last_clean":"2024-03-30T12:40:19.150538+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:40:19.150538+0000","last_undegraded":"2024-03-30T12:40:19.150538+0000","last_fullsized":"2024-03-30T12:40:19.150538+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24715,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:39:50.314565+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:39:50.314565+0000","last_peered":"2024-03-30T12:39:50.314565+0000","last_clean":"2024-03-30T12:39:50.314565+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:39:50.314565+0000","last_undegraded":"2024-03-30T12:39:50.314565+0000","last_fullsized":"2024-03-30T12:39:50.314565+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:15.879816+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:39:15.879816+0000","last_peered":"2024-03-30T12:39:15.879816+0000","last_clean":"2024-03-30T12:39:15.879816+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:39:15.879816+0000","last_undegraded":"2024-03-30T12:39:15.879816+0000","last_fullsized":"2024-03-30T12:39:15.879816+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889177+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:40:50.889177+0000","last_peered":"2024-03-30T12:40:50.889177+0000","last_clean":"2024-03-30T12:40:50.889177+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:40:50.889177+0000","last_undegraded":"2024-03-30T12:40:50.889177+0000","last_fullsized":"2024-03-30T12:40:50.889177+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150500+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:40:19.150500+0000","last_peered":"2024-03-30T12:40:19.150500+0000","last_clean":"2024-03-30T12:40:19.150500+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:40:19.150500+0000","last_undegraded":"2024-03-30T12:40:19.150500+0000","last_fullsized":"2024-03-30T12:40:19.150500+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16482,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:04.570536+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:40:04.570536+0000","last_peered":"2024-03-30T12:40:04.570536+0000","last_clean":"2024-03-30T12:40:04.570536+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:40:04.570536+0000","last_undegraded":"2024-03-30T12:40:04.570536+0000","last_fullsized":"2024-03-30T12:40:04.570536+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889228+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:40:50.889228+0000","last_peered":"2024-03-30T12:40:50.889228+0000","last_clean":"2024-03-30T12:40:50.889228+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:40:50.889228+0000","last_undegraded":"2024-03-30T12:40:50.889228+0000","last_fullsized":"2024-03-30T12:40:50.889228+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1165,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:44.153535+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:40:44.153535+0000","last_peered":"2024-03-30T12:40:44.153535+0000","last_clean":"2024-03-30T12:40:44.153535+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:40:44.153535+0000","last_undegraded":"2024-03-30T12:40:44.153535+0000","last_fullsized":"2024-03-30T12:40:44.153535+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917681+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:39:18.917681+0000","last_peered":"2024-03-30T12:39:18.917681+0000","last_clean":"2024-03-30T12:39:18.917681+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:39:18.917681+0000","last_undegraded":"2024-03-30T12:39:18.917681+0000","last_fullsized":"2024-03-30T12:39:18.917681+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31270,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:57.289492+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:38:57.289492+0000","last_peered":"2024-03-30T12:38:57.289492+0000","last_clean":"2024-03-30T12:38:57.289492+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:38:57.289492+0000","last_undegraded":"2024-03-30T12:38:57.289492+0000","last_fullsized":"2024-03-30T12:38:57.289492+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659585+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:39:57.659585+0000","last_peered":"2024-03-30T12:39:57.659585+0000","last_clean":"2024-03-30T12:39:57.659585+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:39:57.659585+0000","last_undegraded":"2024-03-30T12:39:57.659585+0000","last_fullsized":"2024-03-30T12:39:57.659585+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1355,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920979+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:39:48.920979+0000","last_peered":"2024-03-30T12:39:48.920979+0000","last_clean":"2024-03-30T12:39:48.920979+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:39:48.920979+0000","last_undegraded":"2024-03-30T12:39:48.920979+0000","last_fullsized":"2024-03-30T12:39:48.920979+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651932+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:38:47.651932+0000","last_peered":"2024-03-30T12:38:47.651932+0000","last_clean":"2024-03-30T12:38:47.651932+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:38:47.651932+0000","last_undegraded":"2024-03-30T12:38:47.651932+0000","last_fullsized":"2024-03-30T12:38:47.651932+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3766,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659555+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:39:57.659555+0000","last_peered":"2024-03-30T12:39:57.659555+0000","last_clean":"2024-03-30T12:39:57.659555+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:39:57.659555+0000","last_undegraded":"2024-03-30T12:39:57.659555+0000","last_fullsized":"2024-03-30T12:39:57.659555+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:57.289460+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:38:57.289460+0000","last_peered":"2024-03-30T12:38:57.289460+0000","last_clean":"2024-03-30T12:38:57.289460+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:38:57.289460+0000","last_undegraded":"2024-03-30T12:38:57.289460+0000","last_fullsized":"2024-03-30T12:38:57.289460+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1157,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573285+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:40:29.573285+0000","last_peered":"2024-03-30T12:40:29.573285+0000","last_clean":"2024-03-30T12:40:29.573285+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:40:29.573285+0000","last_undegraded":"2024-03-30T12:40:29.573285+0000","last_fullsized":"2024-03-30T12:40:29.573285+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:15.879792+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:39:15.879792+0000","last_peered":"2024-03-30T12:39:15.879792+0000","last_clean":"2024-03-30T12:39:15.879792+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:39:15.879792+0000","last_undegraded":"2024-03-30T12:39:15.879792+0000","last_fullsized":"2024-03-30T12:39:15.879792+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15595,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:15.317660+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:40:15.317660+0000","last_peered":"2024-03-30T12:40:15.317660+0000","last_clean":"2024-03-30T12:40:15.317660+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:40:15.317660+0000","last_undegraded":"2024-03-30T12:40:15.317660+0000","last_fullsized":"2024-03-30T12:40:15.317660+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.141061+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:38:59.141061+0000","last_peered":"2024-03-30T12:38:59.141061+0000","last_clean":"2024-03-30T12:38:59.141061+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:38:59.141061+0000","last_undegraded":"2024-03-30T12:38:59.141061+0000","last_fullsized":"2024-03-30T12:38:59.141061+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:22.292071+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:39:22.292071+0000","last_peered":"2024-03-30T12:39:22.292071+0000","last_clean":"2024-03-30T12:39:22.292071+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:39:22.292071+0000","last_undegraded":"2024-03-30T12:39:22.292071+0000","last_fullsized":"2024-03-30T12:39:22.292071+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29021,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:39:47.295005+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:39:47.295005+0000","last_peered":"2024-03-30T12:39:47.295005+0000","last_clean":"2024-03-30T12:39:47.295005+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:39:47.295005+0000","last_undegraded":"2024-03-30T12:39:47.295005+0000","last_fullsized":"2024-03-30T12:39:47.295005+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920913+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:39:48.920913+0000","last_peered":"2024-03-30T12:39:48.920913+0000","last_clean":"2024-03-30T12:39:48.920913+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:39:48.920913+0000","last_undegraded":"2024-03-30T12:39:48.920913+0000","last_fullsized":"2024-03-30T12:39:48.920913+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651850+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:38:47.651850+0000","last_peered":"2024-03-30T12:38:47.651850+0000","last_clean":"2024-03-30T12:38:47.651850+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:38:47.651850+0000","last_undegraded":"2024-03-30T12:38:47.651850+0000","last_fullsized":"2024-03-30T12:38:47.651850+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5611,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:38.385807+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:38:38.385807+0000","last_peered":"2024-03-30T12:38:38.385807+0000","last_clean":"2024-03-30T12:38:38.385807+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:38:38.385807+0000","last_undegraded":"2024-03-30T12:38:38.385807+0000","last_fullsized":"2024-03-30T12:38:38.385807+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1366,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920941+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:39:48.920941+0000","last_peered":"2024-03-30T12:39:48.920941+0000","last_clean":"2024-03-30T12:39:48.920941+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:39:48.920941+0000","last_undegraded":"2024-03-30T12:39:48.920941+0000","last_fullsized":"2024-03-30T12:39:48.920941+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:12.654884+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:39:12.654884+0000","last_peered":"2024-03-30T12:39:12.654884+0000","last_clean":"2024-03-30T12:39:12.654884+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:39:12.654884+0000","last_undegraded":"2024-03-30T12:39:12.654884+0000","last_fullsized":"2024-03-30T12:39:12.654884+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4276,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:18.924042+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:40:18.924042+0000","last_peered":"2024-03-30T12:40:18.924042+0000","last_clean":"2024-03-30T12:40:18.924042+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:40:18.924042+0000","last_undegraded":"2024-03-30T12:40:18.924042+0000","last_fullsized":"2024-03-30T12:40:18.924042+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143221+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:39:19.143221+0000","last_peered":"2024-03-30T12:39:19.143221+0000","last_clean":"2024-03-30T12:39:19.143221+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:39:19.143221+0000","last_undegraded":"2024-03-30T12:39:19.143221+0000","last_fullsized":"2024-03-30T12:39:19.143221+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573205+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:40:29.573205+0000","last_peered":"2024-03-30T12:40:29.573205+0000","last_clean":"2024-03-30T12:40:29.573205+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:40:29.573205+0000","last_undegraded":"2024-03-30T12:40:29.573205+0000","last_fullsized":"2024-03-30T12:40:29.573205+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5254,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:38.385765+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:38:38.385765+0000","last_peered":"2024-03-30T12:38:38.385765+0000","last_clean":"2024-03-30T12:38:38.385765+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:38:38.385765+0000","last_undegraded":"2024-03-30T12:38:38.385765+0000","last_fullsized":"2024-03-30T12:38:38.385765+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1332,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:38.385797+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:38:38.385797+0000","last_peered":"2024-03-30T12:38:38.385797+0000","last_clean":"2024-03-30T12:38:38.385797+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:38:38.385797+0000","last_undegraded":"2024-03-30T12:38:38.385797+0000","last_fullsized":"2024-03-30T12:38:38.385797+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143264+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:39:19.143264+0000","last_peered":"2024-03-30T12:39:19.143264+0000","last_clean":"2024-03-30T12:39:19.143264+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:39:19.143264+0000","last_undegraded":"2024-03-30T12:39:19.143264+0000","last_fullsized":"2024-03-30T12:39:19.143264+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4812,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:23.397123+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:40:23.397123+0000","last_peered":"2024-03-30T12:40:23.397123+0000","last_clean":"2024-03-30T12:40:23.397123+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:40:23.397123+0000","last_undegraded":"2024-03-30T12:40:23.397123+0000","last_fullsized":"2024-03-30T12:40:23.397123+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:18.924078+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:40:18.924078+0000","last_peered":"2024-03-30T12:40:18.924078+0000","last_clean":"2024-03-30T12:40:18.924078+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:40:18.924078+0000","last_undegraded":"2024-03-30T12:40:18.924078+0000","last_fullsized":"2024-03-30T12:40:18.924078+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.317641+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:40:15.317641+0000","last_peered":"2024-03-30T12:40:15.317641+0000","last_clean":"2024-03-30T12:40:15.317641+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:40:15.317641+0000","last_undegraded":"2024-03-30T12:40:15.317641+0000","last_fullsized":"2024-03-30T12:40:15.317641+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6744,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:59.141086+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:38:59.141086+0000","last_peered":"2024-03-30T12:38:59.141086+0000","last_clean":"2024-03-30T12:38:59.141086+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:38:59.141086+0000","last_undegraded":"2024-03-30T12:38:59.141086+0000","last_fullsized":"2024-03-30T12:38:59.141086+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1338,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:38.385827+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:38:38.385827+0000","last_peered":"2024-03-30T12:38:38.385827+0000","last_clean":"2024-03-30T12:38:38.385827+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:38:38.385827+0000","last_undegraded":"2024-03-30T12:38:38.385827+0000","last_fullsized":"2024-03-30T12:38:38.385827+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143303+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:39:19.143303+0000","last_peered":"2024-03-30T12:39:19.143303+0000","last_clean":"2024-03-30T12:39:19.143303+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:39:19.143303+0000","last_undegraded":"2024-03-30T12:39:19.143303+0000","last_fullsized":"2024-03-30T12:39:19.143303+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:04.570502+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:40:04.570502+0000","last_peered":"2024-03-30T12:40:04.570502+0000","last_clean":"2024-03-30T12:40:04.570502+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:40:04.570502+0000","last_undegraded":"2024-03-30T12:40:04.570502+0000","last_fullsized":"2024-03-30T12:40:04.570502+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:53.394048+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:39:53.394048+0000","last_peered":"2024-03-30T12:39:53.394048+0000","last_clean":"2024-03-30T12:39:53.394048+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:39:53.394048+0000","last_undegraded":"2024-03-30T12:39:53.394048+0000","last_fullsized":"2024-03-30T12:39:53.394048+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311414+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:39:25.311414+0000","last_peered":"2024-03-30T12:39:25.311414+0000","last_clean":"2024-03-30T12:39:25.311414+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:39:25.311414+0000","last_undegraded":"2024-03-30T12:39:25.311414+0000","last_fullsized":"2024-03-30T12:39:25.311414+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876194+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:38:45.876194+0000","last_peered":"2024-03-30T12:38:45.876194+0000","last_clean":"2024-03-30T12:38:45.876194+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:38:45.876194+0000","last_undegraded":"2024-03-30T12:38:45.876194+0000","last_fullsized":"2024-03-30T12:38:45.876194+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651915+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:38:47.651915+0000","last_peered":"2024-03-30T12:38:47.651915+0000","last_clean":"2024-03-30T12:38:47.651915+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:38:47.651915+0000","last_undegraded":"2024-03-30T12:38:47.651915+0000","last_fullsized":"2024-03-30T12:38:47.651915+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920964+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:39:48.920964+0000","last_peered":"2024-03-30T12:39:48.920964+0000","last_clean":"2024-03-30T12:39:48.920964+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:39:48.920964+0000","last_undegraded":"2024-03-30T12:39:48.920964+0000","last_fullsized":"2024-03-30T12:39:48.920964+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1179,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573267+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:40:29.573267+0000","last_peered":"2024-03-30T12:40:29.573267+0000","last_clean":"2024-03-30T12:40:29.573267+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:40:29.573267+0000","last_undegraded":"2024-03-30T12:40:29.573267+0000","last_fullsized":"2024-03-30T12:40:29.573267+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1282,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:47.651943+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:38:47.651943+0000","last_peered":"2024-03-30T12:38:47.651943+0000","last_clean":"2024-03-30T12:38:47.651943+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:38:47.651943+0000","last_undegraded":"2024-03-30T12:38:47.651943+0000","last_fullsized":"2024-03-30T12:38:47.651943+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:50.314509+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:39:50.314509+0000","last_peered":"2024-03-30T12:39:50.314509+0000","last_clean":"2024-03-30T12:39:50.314509+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:39:50.314509+0000","last_undegraded":"2024-03-30T12:39:50.314509+0000","last_fullsized":"2024-03-30T12:39:50.314509+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:12.654857+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:39:12.654857+0000","last_peered":"2024-03-30T12:39:12.654857+0000","last_clean":"2024-03-30T12:39:12.654857+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:39:12.654857+0000","last_undegraded":"2024-03-30T12:39:12.654857+0000","last_fullsized":"2024-03-30T12:39:12.654857+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1217,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.317602+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:40:15.317602+0000","last_peered":"2024-03-30T12:40:15.317602+0000","last_clean":"2024-03-30T12:40:15.317602+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:40:15.317602+0000","last_undegraded":"2024-03-30T12:40:15.317602+0000","last_fullsized":"2024-03-30T12:40:15.317602+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:45.883156+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:39:45.883156+0000","last_peered":"2024-03-30T12:39:45.883156+0000","last_clean":"2024-03-30T12:39:45.883156+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:39:45.883156+0000","last_undegraded":"2024-03-30T12:39:45.883156+0000","last_fullsized":"2024-03-30T12:39:45.883156+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1184,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:39.560418+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:38:39.560418+0000","last_peered":"2024-03-30T12:38:39.560418+0000","last_clean":"2024-03-30T12:38:39.560418+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:38:39.560418+0000","last_undegraded":"2024-03-30T12:38:39.560418+0000","last_fullsized":"2024-03-30T12:38:39.560418+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438104,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648160,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175170,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254409,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063228,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951285,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839342,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923624,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:42:59.902 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:59.902 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:59.902 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:59.902 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:59.902 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:59.902 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:59.902 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:59.902 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:59.902 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:59.902 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:59.902 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:59.903 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:59.903 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:42:59.903 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:43:00.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:42:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:43:00.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:42:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:43:00.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:42:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:43:01.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:00 smithi084 ceph-mon[91810]: pgmap v1198: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:01.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:00 smithi084 ceph-mon[91810]: from='client.44639 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:43:01.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:00 smithi084 ceph-mon[89279]: pgmap v1198: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:01.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:00 smithi084 ceph-mon[89279]: from='client.44639 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:43:01.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:00 smithi162 ceph-mon[83709]: pgmap v1198: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:01.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:00 smithi162 ceph-mon[83709]: from='client.44639 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:43:02.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:01 smithi084 ceph-mon[91810]: pgmap v1199: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:02.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:01 smithi084 ceph-mon[89279]: pgmap v1199: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:02.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:01 smithi162 ceph-mon[83709]: pgmap v1199: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:04.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:03 smithi084 ceph-mon[91810]: pgmap v1200: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:04.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:03 smithi084 ceph-mon[89279]: pgmap v1200: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:04.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:03 smithi162 ceph-mon[83709]: pgmap v1200: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:06.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:05 smithi084 ceph-mon[91810]: pgmap v1201: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:06.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:05 smithi084 ceph-mon[89279]: pgmap v1201: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:06.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:05 smithi162 ceph-mon[83709]: pgmap v1201: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:08.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:07 smithi084 ceph-mon[91810]: pgmap v1202: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:08.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:07 smithi084 ceph-mon[89279]: pgmap v1202: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:08.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:07 smithi162 ceph-mon[83709]: pgmap v1202: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:09.755 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:43:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:43:09] "GET /metrics HTTP/1.1" 200 36323 "" "Prometheus/2.43.0" 2024-03-30T12:43:09.904 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:43:10.126 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:43:10.249 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:09 smithi084 ceph-mon[91810]: pgmap v1203: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:10.249 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:09 smithi084 ceph-mon[89279]: pgmap v1203: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:10.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:09 smithi162 ceph-mon[83709]: pgmap v1203: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:12.165 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:43:12.167 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:43:12.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:11 smithi084 ceph-mon[91810]: pgmap v1204: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:12.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:11 smithi084 ceph-mon[89279]: pgmap v1204: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:12.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:11 smithi162 ceph-mon[83709]: pgmap v1204: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:12.810 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1204,"stamp":"2024-03-30T12:43:10.935976+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004079"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:44.153566+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:40:44.153566+0000","last_peered":"2024-03-30T12:40:44.153566+0000","last_clean":"2024-03-30T12:40:44.153566+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:40:44.153566+0000","last_undegraded":"2024-03-30T12:40:44.153566+0000","last_fullsized":"2024-03-30T12:40:44.153566+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1365,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917695+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:39:18.917695+0000","last_peered":"2024-03-30T12:39:18.917695+0000","last_clean":"2024-03-30T12:39:18.917695+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:39:18.917695+0000","last_undegraded":"2024-03-30T12:39:18.917695+0000","last_fullsized":"2024-03-30T12:39:18.917695+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889238+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:40:50.889238+0000","last_peered":"2024-03-30T12:40:50.889238+0000","last_clean":"2024-03-30T12:40:50.889238+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:40:50.889238+0000","last_undegraded":"2024-03-30T12:40:50.889238+0000","last_fullsized":"2024-03-30T12:40:50.889238+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:00.322650+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:41:00.322650+0000","last_peered":"2024-03-30T12:41:00.322650+0000","last_clean":"2024-03-30T12:41:00.322650+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:41:00.322650+0000","last_undegraded":"2024-03-30T12:41:00.322650+0000","last_fullsized":"2024-03-30T12:41:00.322650+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150593+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:40:19.150593+0000","last_peered":"2024-03-30T12:40:19.150593+0000","last_clean":"2024-03-30T12:40:19.150593+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:40:19.150593+0000","last_undegraded":"2024-03-30T12:40:19.150593+0000","last_fullsized":"2024-03-30T12:40:19.150593+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1211,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308563+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:39:00.308563+0000","last_peered":"2024-03-30T12:39:00.308563+0000","last_clean":"2024-03-30T12:39:00.308563+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:39:00.308563+0000","last_undegraded":"2024-03-30T12:39:00.308563+0000","last_fullsized":"2024-03-30T12:39:00.308563+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150576+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:40:19.150576+0000","last_peered":"2024-03-30T12:40:19.150576+0000","last_clean":"2024-03-30T12:40:19.150576+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:40:19.150576+0000","last_undegraded":"2024-03-30T12:40:19.150576+0000","last_fullsized":"2024-03-30T12:40:19.150576+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662744+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:40:27.662744+0000","last_peered":"2024-03-30T12:40:27.662744+0000","last_clean":"2024-03-30T12:40:27.662744+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:40:27.662744+0000","last_undegraded":"2024-03-30T12:40:27.662744+0000","last_fullsized":"2024-03-30T12:40:27.662744+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:59.148225+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:39:59.148225+0000","last_peered":"2024-03-30T12:39:59.148225+0000","last_clean":"2024-03-30T12:39:59.148225+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:39:59.148225+0000","last_undegraded":"2024-03-30T12:39:59.148225+0000","last_fullsized":"2024-03-30T12:39:59.148225+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565540+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:39:19.565540+0000","last_peered":"2024-03-30T12:39:19.565540+0000","last_clean":"2024-03-30T12:39:19.565540+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:39:19.565540+0000","last_undegraded":"2024-03-30T12:39:19.565540+0000","last_fullsized":"2024-03-30T12:39:19.565540+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565513+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:39:19.565513+0000","last_peered":"2024-03-30T12:39:19.565513+0000","last_clean":"2024-03-30T12:39:19.565513+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:39:19.565513+0000","last_undegraded":"2024-03-30T12:39:19.565513+0000","last_fullsized":"2024-03-30T12:39:19.565513+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1272,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:37.299828+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:40:37.299828+0000","last_peered":"2024-03-30T12:40:37.299828+0000","last_clean":"2024-03-30T12:40:37.299828+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:40:37.299828+0000","last_undegraded":"2024-03-30T12:40:37.299828+0000","last_fullsized":"2024-03-30T12:40:37.299828+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660090+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:40:02.660090+0000","last_peered":"2024-03-30T12:40:02.660090+0000","last_clean":"2024-03-30T12:40:02.660090+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:40:02.660090+0000","last_undegraded":"2024-03-30T12:40:02.660090+0000","last_fullsized":"2024-03-30T12:40:02.660090+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886008+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:40:15.886008+0000","last_peered":"2024-03-30T12:40:15.886008+0000","last_clean":"2024-03-30T12:40:15.886008+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:40:15.886008+0000","last_undegraded":"2024-03-30T12:40:15.886008+0000","last_fullsized":"2024-03-30T12:40:15.886008+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:48.927583+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:40:48.927583+0000","last_peered":"2024-03-30T12:40:48.927583+0000","last_clean":"2024-03-30T12:40:48.927583+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:40:48.927583+0000","last_undegraded":"2024-03-30T12:40:48.927583+0000","last_fullsized":"2024-03-30T12:40:48.927583+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320117+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:40:40.320117+0000","last_peered":"2024-03-30T12:40:40.320117+0000","last_clean":"2024-03-30T12:40:40.320117+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:40:40.320117+0000","last_undegraded":"2024-03-30T12:40:40.320117+0000","last_fullsized":"2024-03-30T12:40:40.320117+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1226,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320196+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:40:40.320196+0000","last_peered":"2024-03-30T12:40:40.320196+0000","last_clean":"2024-03-30T12:40:40.320196+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:40:40.320196+0000","last_undegraded":"2024-03-30T12:40:40.320196+0000","last_fullsized":"2024-03-30T12:40:40.320196+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:03.388264+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:39:03.388264+0000","last_peered":"2024-03-30T12:39:03.388264+0000","last_clean":"2024-03-30T12:39:03.388264+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:39:03.388264+0000","last_undegraded":"2024-03-30T12:39:03.388264+0000","last_fullsized":"2024-03-30T12:39:03.388264+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143278+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:39:19.143278+0000","last_peered":"2024-03-30T12:39:19.143278+0000","last_clean":"2024-03-30T12:39:19.143278+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:39:19.143278+0000","last_undegraded":"2024-03-30T12:39:19.143278+0000","last_fullsized":"2024-03-30T12:39:19.143278+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1390,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889293+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:40:50.889293+0000","last_peered":"2024-03-30T12:40:50.889293+0000","last_clean":"2024-03-30T12:40:50.889293+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:40:50.889293+0000","last_undegraded":"2024-03-30T12:40:50.889293+0000","last_fullsized":"2024-03-30T12:40:50.889293+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1284,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659610+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:39:57.659610+0000","last_peered":"2024-03-30T12:39:57.659610+0000","last_clean":"2024-03-30T12:39:57.659610+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:39:57.659610+0000","last_undegraded":"2024-03-30T12:39:57.659610+0000","last_fullsized":"2024-03-30T12:39:57.659610+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1303,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659620+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:39:57.659620+0000","last_peered":"2024-03-30T12:39:57.659620+0000","last_clean":"2024-03-30T12:39:57.659620+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:39:57.659620+0000","last_undegraded":"2024-03-30T12:39:57.659620+0000","last_fullsized":"2024-03-30T12:39:57.659620+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889279+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:40:50.889279+0000","last_peered":"2024-03-30T12:40:50.889279+0000","last_clean":"2024-03-30T12:40:50.889279+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:40:50.889279+0000","last_undegraded":"2024-03-30T12:40:50.889279+0000","last_fullsized":"2024-03-30T12:40:50.889279+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150628+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:40:19.150628+0000","last_peered":"2024-03-30T12:40:19.150628+0000","last_clean":"2024-03-30T12:40:19.150628+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:40:19.150628+0000","last_undegraded":"2024-03-30T12:40:19.150628+0000","last_fullsized":"2024-03-30T12:40:19.150628+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1230,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308632+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:39:00.308632+0000","last_peered":"2024-03-30T12:39:00.308632+0000","last_clean":"2024-03-30T12:39:00.308632+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:39:00.308632+0000","last_undegraded":"2024-03-30T12:39:00.308632+0000","last_fullsized":"2024-03-30T12:39:00.308632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150608+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:40:19.150608+0000","last_peered":"2024-03-30T12:40:19.150608+0000","last_clean":"2024-03-30T12:40:19.150608+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:40:19.150608+0000","last_undegraded":"2024-03-30T12:40:19.150608+0000","last_fullsized":"2024-03-30T12:40:19.150608+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308643+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:39:00.308643+0000","last_peered":"2024-03-30T12:39:00.308643+0000","last_clean":"2024-03-30T12:39:00.308643+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:39:00.308643+0000","last_undegraded":"2024-03-30T12:39:00.308643+0000","last_fullsized":"2024-03-30T12:39:00.308643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1263,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662819+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:40:27.662819+0000","last_peered":"2024-03-30T12:40:27.662819+0000","last_clean":"2024-03-30T12:40:27.662819+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:40:27.662819+0000","last_undegraded":"2024-03-30T12:40:27.662819+0000","last_fullsized":"2024-03-30T12:40:27.662819+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1263,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:32.286955+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:38:32.286955+0000","last_peered":"2024-03-30T12:38:32.286955+0000","last_clean":"2024-03-30T12:38:32.286955+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:38:32.286955+0000","last_undegraded":"2024-03-30T12:38:32.286955+0000","last_fullsized":"2024-03-30T12:38:32.286955+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1181,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.567808+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:39:39.567808+0000","last_peered":"2024-03-30T12:39:39.567808+0000","last_clean":"2024-03-30T12:39:39.567808+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:39:39.567808+0000","last_undegraded":"2024-03-30T12:39:39.567808+0000","last_fullsized":"2024-03-30T12:39:39.567808+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876233+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:38:45.876233+0000","last_peered":"2024-03-30T12:38:45.876233+0000","last_clean":"2024-03-30T12:38:45.876233+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:38:45.876233+0000","last_undegraded":"2024-03-30T12:38:45.876233+0000","last_fullsized":"2024-03-30T12:38:45.876233+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660073+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:40:02.660073+0000","last_peered":"2024-03-30T12:40:02.660073+0000","last_clean":"2024-03-30T12:40:02.660073+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:40:02.660073+0000","last_undegraded":"2024-03-30T12:40:02.660073+0000","last_fullsized":"2024-03-30T12:40:02.660073+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660041+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:40:02.660041+0000","last_peered":"2024-03-30T12:40:02.660041+0000","last_clean":"2024-03-30T12:40:02.660041+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:40:02.660041+0000","last_undegraded":"2024-03-30T12:40:02.660041+0000","last_fullsized":"2024-03-30T12:40:02.660041+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1225,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306130+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:38:40.306130+0000","last_peered":"2024-03-30T12:38:40.306130+0000","last_clean":"2024-03-30T12:38:40.306130+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:38:40.306130+0000","last_undegraded":"2024-03-30T12:38:40.306130+0000","last_fullsized":"2024-03-30T12:38:40.306130+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:53.914730+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:38:53.914730+0000","last_peered":"2024-03-30T12:38:53.914730+0000","last_clean":"2024-03-30T12:38:53.914730+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:38:53.914730+0000","last_undegraded":"2024-03-30T12:38:53.914730+0000","last_fullsized":"2024-03-30T12:38:53.914730+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565553+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:39:19.565553+0000","last_peered":"2024-03-30T12:39:19.565553+0000","last_clean":"2024-03-30T12:39:19.565553+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:39:19.565553+0000","last_undegraded":"2024-03-30T12:39:19.565553+0000","last_fullsized":"2024-03-30T12:39:19.565553+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306212+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:38:40.306212+0000","last_peered":"2024-03-30T12:38:40.306212+0000","last_clean":"2024-03-30T12:38:40.306212+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:38:40.306212+0000","last_undegraded":"2024-03-30T12:38:40.306212+0000","last_fullsized":"2024-03-30T12:38:40.306212+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1199,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306200+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:38:40.306200+0000","last_peered":"2024-03-30T12:38:40.306200+0000","last_clean":"2024-03-30T12:38:40.306200+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:38:40.306200+0000","last_undegraded":"2024-03-30T12:38:40.306200+0000","last_fullsized":"2024-03-30T12:38:40.306200+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1292,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:28.391470+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:39:28.391470+0000","last_peered":"2024-03-30T12:39:28.391470+0000","last_clean":"2024-03-30T12:39:28.391470+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:39:28.391470+0000","last_undegraded":"2024-03-30T12:39:28.391470+0000","last_fullsized":"2024-03-30T12:39:28.391470+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:53.914770+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:38:53.914770+0000","last_peered":"2024-03-30T12:38:53.914770+0000","last_clean":"2024-03-30T12:38:53.914770+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:38:53.914770+0000","last_undegraded":"2024-03-30T12:38:53.914770+0000","last_fullsized":"2024-03-30T12:38:53.914770+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:12.297292+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:40:12.297292+0000","last_peered":"2024-03-30T12:40:12.297292+0000","last_clean":"2024-03-30T12:40:12.297292+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:40:12.297292+0000","last_undegraded":"2024-03-30T12:40:12.297292+0000","last_fullsized":"2024-03-30T12:40:12.297292+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562847+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:38:59.562847+0000","last_peered":"2024-03-30T12:38:59.562847+0000","last_clean":"2024-03-30T12:38:59.562847+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:38:59.562847+0000","last_undegraded":"2024-03-30T12:38:59.562847+0000","last_fullsized":"2024-03-30T12:38:59.562847+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:59.148189+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:39:59.148189+0000","last_peered":"2024-03-30T12:39:59.148189+0000","last_clean":"2024-03-30T12:39:59.148189+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:39:59.148189+0000","last_undegraded":"2024-03-30T12:39:59.148189+0000","last_fullsized":"2024-03-30T12:39:59.148189+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1385,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886047+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:40:15.886047+0000","last_peered":"2024-03-30T12:40:15.886047+0000","last_clean":"2024-03-30T12:40:15.886047+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:40:15.886047+0000","last_undegraded":"2024-03-30T12:40:15.886047+0000","last_fullsized":"2024-03-30T12:40:15.886047+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886029+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:40:15.886029+0000","last_peered":"2024-03-30T12:40:15.886029+0000","last_clean":"2024-03-30T12:40:15.886029+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:40:15.886029+0000","last_undegraded":"2024-03-30T12:40:15.886029+0000","last_fullsized":"2024-03-30T12:40:15.886029+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320162+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:40:40.320162+0000","last_peered":"2024-03-30T12:40:40.320162+0000","last_clean":"2024-03-30T12:40:40.320162+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:40:40.320162+0000","last_undegraded":"2024-03-30T12:40:40.320162+0000","last_fullsized":"2024-03-30T12:40:40.320162+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.145725+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:39:39.145725+0000","last_peered":"2024-03-30T12:39:39.145725+0000","last_clean":"2024-03-30T12:39:39.145725+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:39:39.145725+0000","last_undegraded":"2024-03-30T12:39:39.145725+0000","last_fullsized":"2024-03-30T12:39:39.145725+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562815+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:38:59.562815+0000","last_peered":"2024-03-30T12:38:59.562815+0000","last_clean":"2024-03-30T12:38:59.562815+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:38:59.562815+0000","last_undegraded":"2024-03-30T12:38:59.562815+0000","last_fullsized":"2024-03-30T12:38:59.562815+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562788+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:38:59.562788+0000","last_peered":"2024-03-30T12:38:59.562788+0000","last_clean":"2024-03-30T12:38:59.562788+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:38:59.562788+0000","last_undegraded":"2024-03-30T12:38:59.562788+0000","last_fullsized":"2024-03-30T12:38:59.562788+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:03.388191+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:39:03.388191+0000","last_peered":"2024-03-30T12:39:03.388191+0000","last_clean":"2024-03-30T12:39:03.388191+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:39:03.388191+0000","last_undegraded":"2024-03-30T12:39:03.388191+0000","last_fullsized":"2024-03-30T12:39:03.388191+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.145661+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:39:39.145661+0000","last_peered":"2024-03-30T12:39:39.145661+0000","last_clean":"2024-03-30T12:39:39.145661+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:39:39.145661+0000","last_undegraded":"2024-03-30T12:39:39.145661+0000","last_fullsized":"2024-03-30T12:39:39.145661+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5754,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:23.397042+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:40:23.397042+0000","last_peered":"2024-03-30T12:40:23.397042+0000","last_clean":"2024-03-30T12:40:23.397042+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:40:23.397042+0000","last_undegraded":"2024-03-30T12:40:23.397042+0000","last_fullsized":"2024-03-30T12:40:23.397042+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1276,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:47.295052+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:39:47.295052+0000","last_peered":"2024-03-30T12:39:47.295052+0000","last_clean":"2024-03-30T12:39:47.295052+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:39:47.295052+0000","last_undegraded":"2024-03-30T12:39:47.295052+0000","last_fullsized":"2024-03-30T12:39:47.295052+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143289+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:39:19.143289+0000","last_peered":"2024-03-30T12:39:19.143289+0000","last_clean":"2024-03-30T12:39:19.143289+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:39:19.143289+0000","last_undegraded":"2024-03-30T12:39:19.143289+0000","last_fullsized":"2024-03-30T12:39:19.143289+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5515,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:50.889213+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:40:50.889213+0000","last_peered":"2024-03-30T12:40:50.889213+0000","last_clean":"2024-03-30T12:40:50.889213+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:40:50.889213+0000","last_undegraded":"2024-03-30T12:40:50.889213+0000","last_fullsized":"2024-03-30T12:40:50.889213+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917640+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:39:18.917640+0000","last_peered":"2024-03-30T12:39:18.917640+0000","last_clean":"2024-03-30T12:39:18.917640+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:39:18.917640+0000","last_undegraded":"2024-03-30T12:39:18.917640+0000","last_fullsized":"2024-03-30T12:39:18.917640+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917662+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:39:18.917662+0000","last_peered":"2024-03-30T12:39:18.917662+0000","last_clean":"2024-03-30T12:39:18.917662+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:39:18.917662+0000","last_undegraded":"2024-03-30T12:39:18.917662+0000","last_fullsized":"2024-03-30T12:39:18.917662+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311465+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:39:25.311465+0000","last_peered":"2024-03-30T12:39:25.311465+0000","last_clean":"2024-03-30T12:39:25.311465+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:39:25.311465+0000","last_undegraded":"2024-03-30T12:39:25.311465+0000","last_fullsized":"2024-03-30T12:39:25.311465+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5460,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:50.889251+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:40:50.889251+0000","last_peered":"2024-03-30T12:40:50.889251+0000","last_clean":"2024-03-30T12:40:50.889251+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:40:50.889251+0000","last_undegraded":"2024-03-30T12:40:50.889251+0000","last_fullsized":"2024-03-30T12:40:50.889251+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917672+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:39:18.917672+0000","last_peered":"2024-03-30T12:39:18.917672+0000","last_clean":"2024-03-30T12:39:18.917672+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:39:18.917672+0000","last_undegraded":"2024-03-30T12:39:18.917672+0000","last_fullsized":"2024-03-30T12:39:18.917672+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1208,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311386+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:39:25.311386+0000","last_peered":"2024-03-30T12:39:25.311386+0000","last_clean":"2024-03-30T12:39:25.311386+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:39:25.311386+0000","last_undegraded":"2024-03-30T12:39:25.311386+0000","last_fullsized":"2024-03-30T12:39:25.311386+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302515+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:41:02.302515+0000","last_peered":"2024-03-30T12:41:02.302515+0000","last_clean":"2024-03-30T12:41:02.302515+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:41:02.302515+0000","last_undegraded":"2024-03-30T12:41:02.302515+0000","last_fullsized":"2024-03-30T12:41:02.302515+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3805,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:23.397156+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:40:23.397156+0000","last_peered":"2024-03-30T12:40:23.397156+0000","last_clean":"2024-03-30T12:40:23.397156+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:40:23.397156+0000","last_undegraded":"2024-03-30T12:40:23.397156+0000","last_fullsized":"2024-03-30T12:40:23.397156+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1344,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920990+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:39:48.920990+0000","last_peered":"2024-03-30T12:39:48.920990+0000","last_clean":"2024-03-30T12:39:48.920990+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:39:48.920990+0000","last_undegraded":"2024-03-30T12:39:48.920990+0000","last_fullsized":"2024-03-30T12:39:48.920990+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:48.927559+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:40:48.927559+0000","last_peered":"2024-03-30T12:40:48.927559+0000","last_clean":"2024-03-30T12:40:48.927559+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:40:48.927559+0000","last_undegraded":"2024-03-30T12:40:48.927559+0000","last_fullsized":"2024-03-30T12:40:48.927559+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:53.394025+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:39:53.394025+0000","last_peered":"2024-03-30T12:39:53.394025+0000","last_clean":"2024-03-30T12:39:53.394025+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:39:53.394025+0000","last_undegraded":"2024-03-30T12:39:53.394025+0000","last_fullsized":"2024-03-30T12:39:53.394025+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4578,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:44.153464+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:40:44.153464+0000","last_peered":"2024-03-30T12:40:44.153464+0000","last_clean":"2024-03-30T12:40:44.153464+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:40:44.153464+0000","last_undegraded":"2024-03-30T12:40:44.153464+0000","last_fullsized":"2024-03-30T12:40:44.153464+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1176,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:04.570573+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:40:04.570573+0000","last_peered":"2024-03-30T12:40:04.570573+0000","last_clean":"2024-03-30T12:40:04.570573+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:40:04.570573+0000","last_undegraded":"2024-03-30T12:40:04.570573+0000","last_fullsized":"2024-03-30T12:40:04.570573+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662799+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:40:27.662799+0000","last_peered":"2024-03-30T12:40:27.662799+0000","last_clean":"2024-03-30T12:40:27.662799+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:40:27.662799+0000","last_undegraded":"2024-03-30T12:40:27.662799+0000","last_fullsized":"2024-03-30T12:40:27.662799+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1201,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311442+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:39:25.311442+0000","last_peered":"2024-03-30T12:39:25.311442+0000","last_clean":"2024-03-30T12:39:25.311442+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:39:25.311442+0000","last_undegraded":"2024-03-30T12:39:25.311442+0000","last_fullsized":"2024-03-30T12:39:25.311442+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1718,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150538+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:40:19.150538+0000","last_peered":"2024-03-30T12:40:19.150538+0000","last_clean":"2024-03-30T12:40:19.150538+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:40:19.150538+0000","last_undegraded":"2024-03-30T12:40:19.150538+0000","last_fullsized":"2024-03-30T12:40:19.150538+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24715,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:39:50.314565+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:39:50.314565+0000","last_peered":"2024-03-30T12:39:50.314565+0000","last_clean":"2024-03-30T12:39:50.314565+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:39:50.314565+0000","last_undegraded":"2024-03-30T12:39:50.314565+0000","last_fullsized":"2024-03-30T12:39:50.314565+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:15.879816+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:39:15.879816+0000","last_peered":"2024-03-30T12:39:15.879816+0000","last_clean":"2024-03-30T12:39:15.879816+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:39:15.879816+0000","last_undegraded":"2024-03-30T12:39:15.879816+0000","last_fullsized":"2024-03-30T12:39:15.879816+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889177+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:40:50.889177+0000","last_peered":"2024-03-30T12:40:50.889177+0000","last_clean":"2024-03-30T12:40:50.889177+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:40:50.889177+0000","last_undegraded":"2024-03-30T12:40:50.889177+0000","last_fullsized":"2024-03-30T12:40:50.889177+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150500+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:40:19.150500+0000","last_peered":"2024-03-30T12:40:19.150500+0000","last_clean":"2024-03-30T12:40:19.150500+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:40:19.150500+0000","last_undegraded":"2024-03-30T12:40:19.150500+0000","last_fullsized":"2024-03-30T12:40:19.150500+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16482,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:04.570536+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:40:04.570536+0000","last_peered":"2024-03-30T12:40:04.570536+0000","last_clean":"2024-03-30T12:40:04.570536+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:40:04.570536+0000","last_undegraded":"2024-03-30T12:40:04.570536+0000","last_fullsized":"2024-03-30T12:40:04.570536+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889228+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:40:50.889228+0000","last_peered":"2024-03-30T12:40:50.889228+0000","last_clean":"2024-03-30T12:40:50.889228+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:40:50.889228+0000","last_undegraded":"2024-03-30T12:40:50.889228+0000","last_fullsized":"2024-03-30T12:40:50.889228+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1165,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:44.153535+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:40:44.153535+0000","last_peered":"2024-03-30T12:40:44.153535+0000","last_clean":"2024-03-30T12:40:44.153535+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:40:44.153535+0000","last_undegraded":"2024-03-30T12:40:44.153535+0000","last_fullsized":"2024-03-30T12:40:44.153535+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917681+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:39:18.917681+0000","last_peered":"2024-03-30T12:39:18.917681+0000","last_clean":"2024-03-30T12:39:18.917681+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:39:18.917681+0000","last_undegraded":"2024-03-30T12:39:18.917681+0000","last_fullsized":"2024-03-30T12:39:18.917681+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31271,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:41:02.302474+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:41:02.302474+0000","last_peered":"2024-03-30T12:41:02.302474+0000","last_clean":"2024-03-30T12:41:02.302474+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:41:02.302474+0000","last_undegraded":"2024-03-30T12:41:02.302474+0000","last_fullsized":"2024-03-30T12:41:02.302474+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659585+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:39:57.659585+0000","last_peered":"2024-03-30T12:39:57.659585+0000","last_clean":"2024-03-30T12:39:57.659585+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:39:57.659585+0000","last_undegraded":"2024-03-30T12:39:57.659585+0000","last_fullsized":"2024-03-30T12:39:57.659585+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1355,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920979+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:39:48.920979+0000","last_peered":"2024-03-30T12:39:48.920979+0000","last_clean":"2024-03-30T12:39:48.920979+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:39:48.920979+0000","last_undegraded":"2024-03-30T12:39:48.920979+0000","last_fullsized":"2024-03-30T12:39:48.920979+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666291+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:40:57.666291+0000","last_peered":"2024-03-30T12:40:57.666291+0000","last_clean":"2024-03-30T12:40:57.666291+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:40:57.666291+0000","last_undegraded":"2024-03-30T12:40:57.666291+0000","last_fullsized":"2024-03-30T12:40:57.666291+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3766,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659555+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:39:57.659555+0000","last_peered":"2024-03-30T12:39:57.659555+0000","last_clean":"2024-03-30T12:39:57.659555+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:39:57.659555+0000","last_undegraded":"2024-03-30T12:39:57.659555+0000","last_fullsized":"2024-03-30T12:39:57.659555+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302452+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:41:02.302452+0000","last_peered":"2024-03-30T12:41:02.302452+0000","last_clean":"2024-03-30T12:41:02.302452+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:41:02.302452+0000","last_undegraded":"2024-03-30T12:41:02.302452+0000","last_fullsized":"2024-03-30T12:41:02.302452+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1157,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573285+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:40:29.573285+0000","last_peered":"2024-03-30T12:40:29.573285+0000","last_clean":"2024-03-30T12:40:29.573285+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:40:29.573285+0000","last_undegraded":"2024-03-30T12:40:29.573285+0000","last_fullsized":"2024-03-30T12:40:29.573285+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:15.879792+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:39:15.879792+0000","last_peered":"2024-03-30T12:39:15.879792+0000","last_clean":"2024-03-30T12:39:15.879792+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:39:15.879792+0000","last_undegraded":"2024-03-30T12:39:15.879792+0000","last_fullsized":"2024-03-30T12:39:15.879792+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15595,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:15.317660+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:40:15.317660+0000","last_peered":"2024-03-30T12:40:15.317660+0000","last_clean":"2024-03-30T12:40:15.317660+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:40:15.317660+0000","last_undegraded":"2024-03-30T12:40:15.317660+0000","last_fullsized":"2024-03-30T12:40:15.317660+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1144,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.141061+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:38:59.141061+0000","last_peered":"2024-03-30T12:38:59.141061+0000","last_clean":"2024-03-30T12:38:59.141061+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:38:59.141061+0000","last_undegraded":"2024-03-30T12:38:59.141061+0000","last_fullsized":"2024-03-30T12:38:59.141061+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:22.292071+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:39:22.292071+0000","last_peered":"2024-03-30T12:39:22.292071+0000","last_clean":"2024-03-30T12:39:22.292071+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:39:22.292071+0000","last_undegraded":"2024-03-30T12:39:22.292071+0000","last_fullsized":"2024-03-30T12:39:22.292071+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29021,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:39:47.295005+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:39:47.295005+0000","last_peered":"2024-03-30T12:39:47.295005+0000","last_clean":"2024-03-30T12:39:47.295005+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:39:47.295005+0000","last_undegraded":"2024-03-30T12:39:47.295005+0000","last_fullsized":"2024-03-30T12:39:47.295005+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920913+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:39:48.920913+0000","last_peered":"2024-03-30T12:39:48.920913+0000","last_clean":"2024-03-30T12:39:48.920913+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:39:48.920913+0000","last_undegraded":"2024-03-30T12:39:48.920913+0000","last_fullsized":"2024-03-30T12:39:48.920913+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666241+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:40:57.666241+0000","last_peered":"2024-03-30T12:40:57.666241+0000","last_clean":"2024-03-30T12:40:57.666241+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:40:57.666241+0000","last_undegraded":"2024-03-30T12:40:57.666241+0000","last_fullsized":"2024-03-30T12:40:57.666241+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5612,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:53.400722+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:40:53.400722+0000","last_peered":"2024-03-30T12:40:53.400722+0000","last_clean":"2024-03-30T12:40:53.400722+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:40:53.400722+0000","last_undegraded":"2024-03-30T12:40:53.400722+0000","last_fullsized":"2024-03-30T12:40:53.400722+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1366,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920941+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:39:48.920941+0000","last_peered":"2024-03-30T12:39:48.920941+0000","last_clean":"2024-03-30T12:39:48.920941+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:39:48.920941+0000","last_undegraded":"2024-03-30T12:39:48.920941+0000","last_fullsized":"2024-03-30T12:39:48.920941+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:12.654884+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:39:12.654884+0000","last_peered":"2024-03-30T12:39:12.654884+0000","last_clean":"2024-03-30T12:39:12.654884+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:39:12.654884+0000","last_undegraded":"2024-03-30T12:39:12.654884+0000","last_fullsized":"2024-03-30T12:39:12.654884+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4276,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:18.924042+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:40:18.924042+0000","last_peered":"2024-03-30T12:40:18.924042+0000","last_clean":"2024-03-30T12:40:18.924042+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:40:18.924042+0000","last_undegraded":"2024-03-30T12:40:18.924042+0000","last_fullsized":"2024-03-30T12:40:18.924042+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143221+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:39:19.143221+0000","last_peered":"2024-03-30T12:39:19.143221+0000","last_clean":"2024-03-30T12:39:19.143221+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:39:19.143221+0000","last_undegraded":"2024-03-30T12:39:19.143221+0000","last_fullsized":"2024-03-30T12:39:19.143221+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573205+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:40:29.573205+0000","last_peered":"2024-03-30T12:40:29.573205+0000","last_clean":"2024-03-30T12:40:29.573205+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:40:29.573205+0000","last_undegraded":"2024-03-30T12:40:29.573205+0000","last_fullsized":"2024-03-30T12:40:29.573205+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5255,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:53.400674+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:40:53.400674+0000","last_peered":"2024-03-30T12:40:53.400674+0000","last_clean":"2024-03-30T12:40:53.400674+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:40:53.400674+0000","last_undegraded":"2024-03-30T12:40:53.400674+0000","last_fullsized":"2024-03-30T12:40:53.400674+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:53.400708+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:40:53.400708+0000","last_peered":"2024-03-30T12:40:53.400708+0000","last_clean":"2024-03-30T12:40:53.400708+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:40:53.400708+0000","last_undegraded":"2024-03-30T12:40:53.400708+0000","last_fullsized":"2024-03-30T12:40:53.400708+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143264+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:39:19.143264+0000","last_peered":"2024-03-30T12:39:19.143264+0000","last_clean":"2024-03-30T12:39:19.143264+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:39:19.143264+0000","last_undegraded":"2024-03-30T12:39:19.143264+0000","last_fullsized":"2024-03-30T12:39:19.143264+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4812,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:23.397123+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:40:23.397123+0000","last_peered":"2024-03-30T12:40:23.397123+0000","last_clean":"2024-03-30T12:40:23.397123+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:40:23.397123+0000","last_undegraded":"2024-03-30T12:40:23.397123+0000","last_fullsized":"2024-03-30T12:40:23.397123+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:18.924078+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:40:18.924078+0000","last_peered":"2024-03-30T12:40:18.924078+0000","last_clean":"2024-03-30T12:40:18.924078+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:40:18.924078+0000","last_undegraded":"2024-03-30T12:40:18.924078+0000","last_fullsized":"2024-03-30T12:40:18.924078+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.317641+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:40:15.317641+0000","last_peered":"2024-03-30T12:40:15.317641+0000","last_clean":"2024-03-30T12:40:15.317641+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:40:15.317641+0000","last_undegraded":"2024-03-30T12:40:15.317641+0000","last_fullsized":"2024-03-30T12:40:15.317641+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6744,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:38:59.141086+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:38:59.141086+0000","last_peered":"2024-03-30T12:38:59.141086+0000","last_clean":"2024-03-30T12:38:59.141086+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:38:59.141086+0000","last_undegraded":"2024-03-30T12:38:59.141086+0000","last_fullsized":"2024-03-30T12:38:59.141086+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1339,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:53.400753+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:40:53.400753+0000","last_peered":"2024-03-30T12:40:53.400753+0000","last_clean":"2024-03-30T12:40:53.400753+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:40:53.400753+0000","last_undegraded":"2024-03-30T12:40:53.400753+0000","last_fullsized":"2024-03-30T12:40:53.400753+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143303+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:39:19.143303+0000","last_peered":"2024-03-30T12:39:19.143303+0000","last_clean":"2024-03-30T12:39:19.143303+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:39:19.143303+0000","last_undegraded":"2024-03-30T12:39:19.143303+0000","last_fullsized":"2024-03-30T12:39:19.143303+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:04.570502+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:40:04.570502+0000","last_peered":"2024-03-30T12:40:04.570502+0000","last_clean":"2024-03-30T12:40:04.570502+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:40:04.570502+0000","last_undegraded":"2024-03-30T12:40:04.570502+0000","last_fullsized":"2024-03-30T12:40:04.570502+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:53.394048+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:39:53.394048+0000","last_peered":"2024-03-30T12:39:53.394048+0000","last_clean":"2024-03-30T12:39:53.394048+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:39:53.394048+0000","last_undegraded":"2024-03-30T12:39:53.394048+0000","last_fullsized":"2024-03-30T12:39:53.394048+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311414+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:39:25.311414+0000","last_peered":"2024-03-30T12:39:25.311414+0000","last_clean":"2024-03-30T12:39:25.311414+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:39:25.311414+0000","last_undegraded":"2024-03-30T12:39:25.311414+0000","last_fullsized":"2024-03-30T12:39:25.311414+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889204+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:40:50.889204+0000","last_peered":"2024-03-30T12:40:50.889204+0000","last_clean":"2024-03-30T12:40:50.889204+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:40:50.889204+0000","last_undegraded":"2024-03-30T12:40:50.889204+0000","last_fullsized":"2024-03-30T12:40:50.889204+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666276+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:40:57.666276+0000","last_peered":"2024-03-30T12:40:57.666276+0000","last_clean":"2024-03-30T12:40:57.666276+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:40:57.666276+0000","last_undegraded":"2024-03-30T12:40:57.666276+0000","last_fullsized":"2024-03-30T12:40:57.666276+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920964+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:39:48.920964+0000","last_peered":"2024-03-30T12:39:48.920964+0000","last_clean":"2024-03-30T12:39:48.920964+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:39:48.920964+0000","last_undegraded":"2024-03-30T12:39:48.920964+0000","last_fullsized":"2024-03-30T12:39:48.920964+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1179,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573267+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:40:29.573267+0000","last_peered":"2024-03-30T12:40:29.573267+0000","last_clean":"2024-03-30T12:40:29.573267+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:40:29.573267+0000","last_undegraded":"2024-03-30T12:40:29.573267+0000","last_fullsized":"2024-03-30T12:40:29.573267+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1283,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666301+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:40:57.666301+0000","last_peered":"2024-03-30T12:40:57.666301+0000","last_clean":"2024-03-30T12:40:57.666301+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:40:57.666301+0000","last_undegraded":"2024-03-30T12:40:57.666301+0000","last_fullsized":"2024-03-30T12:40:57.666301+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:50.314509+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:39:50.314509+0000","last_peered":"2024-03-30T12:39:50.314509+0000","last_clean":"2024-03-30T12:39:50.314509+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:39:50.314509+0000","last_undegraded":"2024-03-30T12:39:50.314509+0000","last_fullsized":"2024-03-30T12:39:50.314509+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:12.654857+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:39:12.654857+0000","last_peered":"2024-03-30T12:39:12.654857+0000","last_clean":"2024-03-30T12:39:12.654857+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:39:12.654857+0000","last_undegraded":"2024-03-30T12:39:12.654857+0000","last_fullsized":"2024-03-30T12:39:12.654857+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1217,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.317602+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:40:15.317602+0000","last_peered":"2024-03-30T12:40:15.317602+0000","last_clean":"2024-03-30T12:40:15.317602+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:40:15.317602+0000","last_undegraded":"2024-03-30T12:40:15.317602+0000","last_fullsized":"2024-03-30T12:40:15.317602+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:45.883156+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:39:45.883156+0000","last_peered":"2024-03-30T12:39:45.883156+0000","last_clean":"2024-03-30T12:39:45.883156+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:39:45.883156+0000","last_undegraded":"2024-03-30T12:39:45.883156+0000","last_fullsized":"2024-03-30T12:39:45.883156+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:54.576179+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:40:54.576179+0000","last_peered":"2024-03-30T12:40:54.576179+0000","last_clean":"2024-03-30T12:40:54.576179+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:40:54.576179+0000","last_undegraded":"2024-03-30T12:40:54.576179+0000","last_fullsized":"2024-03-30T12:40:54.576179+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438107,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648163,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175173,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254412,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063230,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951287,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839344,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923627,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:43:12.816 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:12.816 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:12.816 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:12.816 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:12.816 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:12.816 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:12.816 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:12.817 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:12.817 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:12.817 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:12.817 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:12.817 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:12.817 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:12.817 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:43:13.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:13 smithi084 ceph-mon[91810]: from='client.34710 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:43:13.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:13 smithi084 ceph-mon[89279]: from='client.34710 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:43:13.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:13 smithi162 ceph-mon[83709]: from='client.34710 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:43:14.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:14 smithi084 ceph-mon[89279]: pgmap v1205: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:14.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:14 smithi084 ceph-mon[91810]: pgmap v1205: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:14.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:14 smithi162 ceph-mon[83709]: pgmap v1205: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:15.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:15 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:43:15.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:15 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:43:15.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:15 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:43:16.254 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:16 smithi084 ceph-mon[91810]: pgmap v1206: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:16.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:16 smithi084 ceph-mon[89279]: pgmap v1206: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:16.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:16 smithi162 ceph-mon[83709]: pgmap v1206: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:18.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:18 smithi162 ceph-mon[83709]: pgmap v1207: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:18.504 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:18 smithi084 ceph-mon[91810]: pgmap v1207: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:18.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:18 smithi084 ceph-mon[89279]: pgmap v1207: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:19.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:43:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:43:19] "GET /metrics HTTP/1.1" 200 36325 "" "Prometheus/2.43.0" 2024-03-30T12:43:20.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:20 smithi162 ceph-mon[83709]: pgmap v1208: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:20.417 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:20 smithi084 ceph-mon[91810]: pgmap v1208: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:20.417 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:20 smithi084 ceph-mon[89279]: pgmap v1208: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:22.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:22 smithi162 ceph-mon[83709]: pgmap v1209: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:22.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:22 smithi084 ceph-mon[91810]: pgmap v1209: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:22.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:22 smithi084 ceph-mon[89279]: pgmap v1209: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:22.817 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:43:23.040 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:43:24.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:24 smithi162 ceph-mon[83709]: pgmap v1210: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:24.387 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:24 smithi084 ceph-mon[91810]: pgmap v1210: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:24.387 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:24 smithi084 ceph-mon[89279]: pgmap v1210: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:24.957 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:43:24.960 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:43:25.605 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1211,"stamp":"2024-03-30T12:43:24.940674+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003981"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:44.153566+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:40:44.153566+0000","last_peered":"2024-03-30T12:40:44.153566+0000","last_clean":"2024-03-30T12:40:44.153566+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:40:44.153566+0000","last_undegraded":"2024-03-30T12:40:44.153566+0000","last_fullsized":"2024-03-30T12:40:44.153566+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1365,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917695+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:39:18.917695+0000","last_peered":"2024-03-30T12:39:18.917695+0000","last_clean":"2024-03-30T12:39:18.917695+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:39:18.917695+0000","last_undegraded":"2024-03-30T12:39:18.917695+0000","last_fullsized":"2024-03-30T12:39:18.917695+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889238+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:40:50.889238+0000","last_peered":"2024-03-30T12:40:50.889238+0000","last_clean":"2024-03-30T12:40:50.889238+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:40:50.889238+0000","last_undegraded":"2024-03-30T12:40:50.889238+0000","last_fullsized":"2024-03-30T12:40:50.889238+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:00.322650+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:41:00.322650+0000","last_peered":"2024-03-30T12:41:00.322650+0000","last_clean":"2024-03-30T12:41:00.322650+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:41:00.322650+0000","last_undegraded":"2024-03-30T12:41:00.322650+0000","last_fullsized":"2024-03-30T12:41:00.322650+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150593+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:40:19.150593+0000","last_peered":"2024-03-30T12:40:19.150593+0000","last_clean":"2024-03-30T12:40:19.150593+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:40:19.150593+0000","last_undegraded":"2024-03-30T12:40:19.150593+0000","last_fullsized":"2024-03-30T12:40:19.150593+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1211,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308563+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:39:00.308563+0000","last_peered":"2024-03-30T12:39:00.308563+0000","last_clean":"2024-03-30T12:39:00.308563+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:39:00.308563+0000","last_undegraded":"2024-03-30T12:39:00.308563+0000","last_fullsized":"2024-03-30T12:39:00.308563+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150576+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:40:19.150576+0000","last_peered":"2024-03-30T12:40:19.150576+0000","last_clean":"2024-03-30T12:40:19.150576+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:40:19.150576+0000","last_undegraded":"2024-03-30T12:40:19.150576+0000","last_fullsized":"2024-03-30T12:40:19.150576+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662744+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:40:27.662744+0000","last_peered":"2024-03-30T12:40:27.662744+0000","last_clean":"2024-03-30T12:40:27.662744+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:40:27.662744+0000","last_undegraded":"2024-03-30T12:40:27.662744+0000","last_fullsized":"2024-03-30T12:40:27.662744+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:59.148225+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:39:59.148225+0000","last_peered":"2024-03-30T12:39:59.148225+0000","last_clean":"2024-03-30T12:39:59.148225+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:39:59.148225+0000","last_undegraded":"2024-03-30T12:39:59.148225+0000","last_fullsized":"2024-03-30T12:39:59.148225+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565540+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:39:19.565540+0000","last_peered":"2024-03-30T12:39:19.565540+0000","last_clean":"2024-03-30T12:39:19.565540+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:39:19.565540+0000","last_undegraded":"2024-03-30T12:39:19.565540+0000","last_fullsized":"2024-03-30T12:39:19.565540+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565513+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:39:19.565513+0000","last_peered":"2024-03-30T12:39:19.565513+0000","last_clean":"2024-03-30T12:39:19.565513+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:39:19.565513+0000","last_undegraded":"2024-03-30T12:39:19.565513+0000","last_fullsized":"2024-03-30T12:39:19.565513+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1272,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:37.299828+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:40:37.299828+0000","last_peered":"2024-03-30T12:40:37.299828+0000","last_clean":"2024-03-30T12:40:37.299828+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:40:37.299828+0000","last_undegraded":"2024-03-30T12:40:37.299828+0000","last_fullsized":"2024-03-30T12:40:37.299828+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660090+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:40:02.660090+0000","last_peered":"2024-03-30T12:40:02.660090+0000","last_clean":"2024-03-30T12:40:02.660090+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:40:02.660090+0000","last_undegraded":"2024-03-30T12:40:02.660090+0000","last_fullsized":"2024-03-30T12:40:02.660090+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886008+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:40:15.886008+0000","last_peered":"2024-03-30T12:40:15.886008+0000","last_clean":"2024-03-30T12:40:15.886008+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:40:15.886008+0000","last_undegraded":"2024-03-30T12:40:15.886008+0000","last_fullsized":"2024-03-30T12:40:15.886008+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:48.927583+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:40:48.927583+0000","last_peered":"2024-03-30T12:40:48.927583+0000","last_clean":"2024-03-30T12:40:48.927583+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:40:48.927583+0000","last_undegraded":"2024-03-30T12:40:48.927583+0000","last_fullsized":"2024-03-30T12:40:48.927583+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320117+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:40:40.320117+0000","last_peered":"2024-03-30T12:40:40.320117+0000","last_clean":"2024-03-30T12:40:40.320117+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:40:40.320117+0000","last_undegraded":"2024-03-30T12:40:40.320117+0000","last_fullsized":"2024-03-30T12:40:40.320117+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1226,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320196+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:40:40.320196+0000","last_peered":"2024-03-30T12:40:40.320196+0000","last_clean":"2024-03-30T12:40:40.320196+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:40:40.320196+0000","last_undegraded":"2024-03-30T12:40:40.320196+0000","last_fullsized":"2024-03-30T12:40:40.320196+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:03.388264+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:39:03.388264+0000","last_peered":"2024-03-30T12:39:03.388264+0000","last_clean":"2024-03-30T12:39:03.388264+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:39:03.388264+0000","last_undegraded":"2024-03-30T12:39:03.388264+0000","last_fullsized":"2024-03-30T12:39:03.388264+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143278+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:39:19.143278+0000","last_peered":"2024-03-30T12:39:19.143278+0000","last_clean":"2024-03-30T12:39:19.143278+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:39:19.143278+0000","last_undegraded":"2024-03-30T12:39:19.143278+0000","last_fullsized":"2024-03-30T12:39:19.143278+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1390,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889293+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:40:50.889293+0000","last_peered":"2024-03-30T12:40:50.889293+0000","last_clean":"2024-03-30T12:40:50.889293+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:40:50.889293+0000","last_undegraded":"2024-03-30T12:40:50.889293+0000","last_fullsized":"2024-03-30T12:40:50.889293+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1284,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659610+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:39:57.659610+0000","last_peered":"2024-03-30T12:39:57.659610+0000","last_clean":"2024-03-30T12:39:57.659610+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:39:57.659610+0000","last_undegraded":"2024-03-30T12:39:57.659610+0000","last_fullsized":"2024-03-30T12:39:57.659610+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1303,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659620+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:39:57.659620+0000","last_peered":"2024-03-30T12:39:57.659620+0000","last_clean":"2024-03-30T12:39:57.659620+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:39:57.659620+0000","last_undegraded":"2024-03-30T12:39:57.659620+0000","last_fullsized":"2024-03-30T12:39:57.659620+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889279+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:40:50.889279+0000","last_peered":"2024-03-30T12:40:50.889279+0000","last_clean":"2024-03-30T12:40:50.889279+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:40:50.889279+0000","last_undegraded":"2024-03-30T12:40:50.889279+0000","last_fullsized":"2024-03-30T12:40:50.889279+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150628+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:40:19.150628+0000","last_peered":"2024-03-30T12:40:19.150628+0000","last_clean":"2024-03-30T12:40:19.150628+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:40:19.150628+0000","last_undegraded":"2024-03-30T12:40:19.150628+0000","last_fullsized":"2024-03-30T12:40:19.150628+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1230,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308632+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:39:00.308632+0000","last_peered":"2024-03-30T12:39:00.308632+0000","last_clean":"2024-03-30T12:39:00.308632+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:39:00.308632+0000","last_undegraded":"2024-03-30T12:39:00.308632+0000","last_fullsized":"2024-03-30T12:39:00.308632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150608+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:40:19.150608+0000","last_peered":"2024-03-30T12:40:19.150608+0000","last_clean":"2024-03-30T12:40:19.150608+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:40:19.150608+0000","last_undegraded":"2024-03-30T12:40:19.150608+0000","last_fullsized":"2024-03-30T12:40:19.150608+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308643+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:39:00.308643+0000","last_peered":"2024-03-30T12:39:00.308643+0000","last_clean":"2024-03-30T12:39:00.308643+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:39:00.308643+0000","last_undegraded":"2024-03-30T12:39:00.308643+0000","last_fullsized":"2024-03-30T12:39:00.308643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1263,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662819+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:40:27.662819+0000","last_peered":"2024-03-30T12:40:27.662819+0000","last_clean":"2024-03-30T12:40:27.662819+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:40:27.662819+0000","last_undegraded":"2024-03-30T12:40:27.662819+0000","last_fullsized":"2024-03-30T12:40:27.662819+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1263,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:32.286955+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:38:32.286955+0000","last_peered":"2024-03-30T12:38:32.286955+0000","last_clean":"2024-03-30T12:38:32.286955+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:38:32.286955+0000","last_undegraded":"2024-03-30T12:38:32.286955+0000","last_fullsized":"2024-03-30T12:38:32.286955+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1181,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.567808+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:39:39.567808+0000","last_peered":"2024-03-30T12:39:39.567808+0000","last_clean":"2024-03-30T12:39:39.567808+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:39:39.567808+0000","last_undegraded":"2024-03-30T12:39:39.567808+0000","last_fullsized":"2024-03-30T12:39:39.567808+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876233+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:38:45.876233+0000","last_peered":"2024-03-30T12:38:45.876233+0000","last_clean":"2024-03-30T12:38:45.876233+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:38:45.876233+0000","last_undegraded":"2024-03-30T12:38:45.876233+0000","last_fullsized":"2024-03-30T12:38:45.876233+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660073+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:40:02.660073+0000","last_peered":"2024-03-30T12:40:02.660073+0000","last_clean":"2024-03-30T12:40:02.660073+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:40:02.660073+0000","last_undegraded":"2024-03-30T12:40:02.660073+0000","last_fullsized":"2024-03-30T12:40:02.660073+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660041+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:40:02.660041+0000","last_peered":"2024-03-30T12:40:02.660041+0000","last_clean":"2024-03-30T12:40:02.660041+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:40:02.660041+0000","last_undegraded":"2024-03-30T12:40:02.660041+0000","last_fullsized":"2024-03-30T12:40:02.660041+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1225,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306130+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:38:40.306130+0000","last_peered":"2024-03-30T12:38:40.306130+0000","last_clean":"2024-03-30T12:38:40.306130+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:38:40.306130+0000","last_undegraded":"2024-03-30T12:38:40.306130+0000","last_fullsized":"2024-03-30T12:38:40.306130+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:53.914730+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:38:53.914730+0000","last_peered":"2024-03-30T12:38:53.914730+0000","last_clean":"2024-03-30T12:38:53.914730+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:38:53.914730+0000","last_undegraded":"2024-03-30T12:38:53.914730+0000","last_fullsized":"2024-03-30T12:38:53.914730+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565553+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:39:19.565553+0000","last_peered":"2024-03-30T12:39:19.565553+0000","last_clean":"2024-03-30T12:39:19.565553+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:39:19.565553+0000","last_undegraded":"2024-03-30T12:39:19.565553+0000","last_fullsized":"2024-03-30T12:39:19.565553+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1205,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306212+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:38:40.306212+0000","last_peered":"2024-03-30T12:38:40.306212+0000","last_clean":"2024-03-30T12:38:40.306212+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:38:40.306212+0000","last_undegraded":"2024-03-30T12:38:40.306212+0000","last_fullsized":"2024-03-30T12:38:40.306212+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1199,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:40.306200+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:38:40.306200+0000","last_peered":"2024-03-30T12:38:40.306200+0000","last_clean":"2024-03-30T12:38:40.306200+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:38:40.306200+0000","last_undegraded":"2024-03-30T12:38:40.306200+0000","last_fullsized":"2024-03-30T12:38:40.306200+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1292,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:28.391470+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:39:28.391470+0000","last_peered":"2024-03-30T12:39:28.391470+0000","last_clean":"2024-03-30T12:39:28.391470+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:39:28.391470+0000","last_undegraded":"2024-03-30T12:39:28.391470+0000","last_fullsized":"2024-03-30T12:39:28.391470+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:53.914770+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:38:53.914770+0000","last_peered":"2024-03-30T12:38:53.914770+0000","last_clean":"2024-03-30T12:38:53.914770+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:38:53.914770+0000","last_undegraded":"2024-03-30T12:38:53.914770+0000","last_fullsized":"2024-03-30T12:38:53.914770+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:12.297292+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:40:12.297292+0000","last_peered":"2024-03-30T12:40:12.297292+0000","last_clean":"2024-03-30T12:40:12.297292+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:40:12.297292+0000","last_undegraded":"2024-03-30T12:40:12.297292+0000","last_fullsized":"2024-03-30T12:40:12.297292+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562847+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:38:59.562847+0000","last_peered":"2024-03-30T12:38:59.562847+0000","last_clean":"2024-03-30T12:38:59.562847+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:38:59.562847+0000","last_undegraded":"2024-03-30T12:38:59.562847+0000","last_fullsized":"2024-03-30T12:38:59.562847+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:59.148189+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:39:59.148189+0000","last_peered":"2024-03-30T12:39:59.148189+0000","last_clean":"2024-03-30T12:39:59.148189+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:39:59.148189+0000","last_undegraded":"2024-03-30T12:39:59.148189+0000","last_fullsized":"2024-03-30T12:39:59.148189+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1385,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886047+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:40:15.886047+0000","last_peered":"2024-03-30T12:40:15.886047+0000","last_clean":"2024-03-30T12:40:15.886047+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:40:15.886047+0000","last_undegraded":"2024-03-30T12:40:15.886047+0000","last_fullsized":"2024-03-30T12:40:15.886047+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886029+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:40:15.886029+0000","last_peered":"2024-03-30T12:40:15.886029+0000","last_clean":"2024-03-30T12:40:15.886029+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:40:15.886029+0000","last_undegraded":"2024-03-30T12:40:15.886029+0000","last_fullsized":"2024-03-30T12:40:15.886029+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320162+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:40:40.320162+0000","last_peered":"2024-03-30T12:40:40.320162+0000","last_clean":"2024-03-30T12:40:40.320162+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:40:40.320162+0000","last_undegraded":"2024-03-30T12:40:40.320162+0000","last_fullsized":"2024-03-30T12:40:40.320162+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.145725+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:39:39.145725+0000","last_peered":"2024-03-30T12:39:39.145725+0000","last_clean":"2024-03-30T12:39:39.145725+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:39:39.145725+0000","last_undegraded":"2024-03-30T12:39:39.145725+0000","last_fullsized":"2024-03-30T12:39:39.145725+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562815+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:38:59.562815+0000","last_peered":"2024-03-30T12:38:59.562815+0000","last_clean":"2024-03-30T12:38:59.562815+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:38:59.562815+0000","last_undegraded":"2024-03-30T12:38:59.562815+0000","last_fullsized":"2024-03-30T12:38:59.562815+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562788+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:38:59.562788+0000","last_peered":"2024-03-30T12:38:59.562788+0000","last_clean":"2024-03-30T12:38:59.562788+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:38:59.562788+0000","last_undegraded":"2024-03-30T12:38:59.562788+0000","last_fullsized":"2024-03-30T12:38:59.562788+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:03.388191+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:39:03.388191+0000","last_peered":"2024-03-30T12:39:03.388191+0000","last_clean":"2024-03-30T12:39:03.388191+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:39:03.388191+0000","last_undegraded":"2024-03-30T12:39:03.388191+0000","last_fullsized":"2024-03-30T12:39:03.388191+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.145661+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:39:39.145661+0000","last_peered":"2024-03-30T12:39:39.145661+0000","last_clean":"2024-03-30T12:39:39.145661+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:39:39.145661+0000","last_undegraded":"2024-03-30T12:39:39.145661+0000","last_fullsized":"2024-03-30T12:39:39.145661+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5754,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:23.397042+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:40:23.397042+0000","last_peered":"2024-03-30T12:40:23.397042+0000","last_clean":"2024-03-30T12:40:23.397042+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:40:23.397042+0000","last_undegraded":"2024-03-30T12:40:23.397042+0000","last_fullsized":"2024-03-30T12:40:23.397042+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1276,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:47.295052+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:39:47.295052+0000","last_peered":"2024-03-30T12:39:47.295052+0000","last_clean":"2024-03-30T12:39:47.295052+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:39:47.295052+0000","last_undegraded":"2024-03-30T12:39:47.295052+0000","last_fullsized":"2024-03-30T12:39:47.295052+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143289+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:39:19.143289+0000","last_peered":"2024-03-30T12:39:19.143289+0000","last_clean":"2024-03-30T12:39:19.143289+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:39:19.143289+0000","last_undegraded":"2024-03-30T12:39:19.143289+0000","last_fullsized":"2024-03-30T12:39:19.143289+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5515,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:50.889213+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:40:50.889213+0000","last_peered":"2024-03-30T12:40:50.889213+0000","last_clean":"2024-03-30T12:40:50.889213+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:40:50.889213+0000","last_undegraded":"2024-03-30T12:40:50.889213+0000","last_fullsized":"2024-03-30T12:40:50.889213+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917640+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:39:18.917640+0000","last_peered":"2024-03-30T12:39:18.917640+0000","last_clean":"2024-03-30T12:39:18.917640+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:39:18.917640+0000","last_undegraded":"2024-03-30T12:39:18.917640+0000","last_fullsized":"2024-03-30T12:39:18.917640+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1348,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917662+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:39:18.917662+0000","last_peered":"2024-03-30T12:39:18.917662+0000","last_clean":"2024-03-30T12:39:18.917662+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:39:18.917662+0000","last_undegraded":"2024-03-30T12:39:18.917662+0000","last_fullsized":"2024-03-30T12:39:18.917662+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311465+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:39:25.311465+0000","last_peered":"2024-03-30T12:39:25.311465+0000","last_clean":"2024-03-30T12:39:25.311465+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:39:25.311465+0000","last_undegraded":"2024-03-30T12:39:25.311465+0000","last_fullsized":"2024-03-30T12:39:25.311465+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5460,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:50.889251+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:40:50.889251+0000","last_peered":"2024-03-30T12:40:50.889251+0000","last_clean":"2024-03-30T12:40:50.889251+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:40:50.889251+0000","last_undegraded":"2024-03-30T12:40:50.889251+0000","last_fullsized":"2024-03-30T12:40:50.889251+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917672+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:39:18.917672+0000","last_peered":"2024-03-30T12:39:18.917672+0000","last_clean":"2024-03-30T12:39:18.917672+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:39:18.917672+0000","last_undegraded":"2024-03-30T12:39:18.917672+0000","last_fullsized":"2024-03-30T12:39:18.917672+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1208,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311386+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:39:25.311386+0000","last_peered":"2024-03-30T12:39:25.311386+0000","last_clean":"2024-03-30T12:39:25.311386+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:39:25.311386+0000","last_undegraded":"2024-03-30T12:39:25.311386+0000","last_fullsized":"2024-03-30T12:39:25.311386+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302515+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:41:02.302515+0000","last_peered":"2024-03-30T12:41:02.302515+0000","last_clean":"2024-03-30T12:41:02.302515+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:41:02.302515+0000","last_undegraded":"2024-03-30T12:41:02.302515+0000","last_fullsized":"2024-03-30T12:41:02.302515+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3805,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:23.397156+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:40:23.397156+0000","last_peered":"2024-03-30T12:40:23.397156+0000","last_clean":"2024-03-30T12:40:23.397156+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:40:23.397156+0000","last_undegraded":"2024-03-30T12:40:23.397156+0000","last_fullsized":"2024-03-30T12:40:23.397156+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1344,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920990+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:39:48.920990+0000","last_peered":"2024-03-30T12:39:48.920990+0000","last_clean":"2024-03-30T12:39:48.920990+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:39:48.920990+0000","last_undegraded":"2024-03-30T12:39:48.920990+0000","last_fullsized":"2024-03-30T12:39:48.920990+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:48.927559+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:40:48.927559+0000","last_peered":"2024-03-30T12:40:48.927559+0000","last_clean":"2024-03-30T12:40:48.927559+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:40:48.927559+0000","last_undegraded":"2024-03-30T12:40:48.927559+0000","last_fullsized":"2024-03-30T12:40:48.927559+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:53.394025+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:39:53.394025+0000","last_peered":"2024-03-30T12:39:53.394025+0000","last_clean":"2024-03-30T12:39:53.394025+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:39:53.394025+0000","last_undegraded":"2024-03-30T12:39:53.394025+0000","last_fullsized":"2024-03-30T12:39:53.394025+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4578,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:44.153464+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:40:44.153464+0000","last_peered":"2024-03-30T12:40:44.153464+0000","last_clean":"2024-03-30T12:40:44.153464+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:40:44.153464+0000","last_undegraded":"2024-03-30T12:40:44.153464+0000","last_fullsized":"2024-03-30T12:40:44.153464+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1176,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:04.570573+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:40:04.570573+0000","last_peered":"2024-03-30T12:40:04.570573+0000","last_clean":"2024-03-30T12:40:04.570573+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:40:04.570573+0000","last_undegraded":"2024-03-30T12:40:04.570573+0000","last_fullsized":"2024-03-30T12:40:04.570573+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662799+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:40:27.662799+0000","last_peered":"2024-03-30T12:40:27.662799+0000","last_clean":"2024-03-30T12:40:27.662799+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:40:27.662799+0000","last_undegraded":"2024-03-30T12:40:27.662799+0000","last_fullsized":"2024-03-30T12:40:27.662799+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1201,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311442+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:39:25.311442+0000","last_peered":"2024-03-30T12:39:25.311442+0000","last_clean":"2024-03-30T12:39:25.311442+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:39:25.311442+0000","last_undegraded":"2024-03-30T12:39:25.311442+0000","last_fullsized":"2024-03-30T12:39:25.311442+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1718,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150538+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:40:19.150538+0000","last_peered":"2024-03-30T12:40:19.150538+0000","last_clean":"2024-03-30T12:40:19.150538+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:40:19.150538+0000","last_undegraded":"2024-03-30T12:40:19.150538+0000","last_fullsized":"2024-03-30T12:40:19.150538+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24715,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:39:50.314565+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:39:50.314565+0000","last_peered":"2024-03-30T12:39:50.314565+0000","last_clean":"2024-03-30T12:39:50.314565+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:39:50.314565+0000","last_undegraded":"2024-03-30T12:39:50.314565+0000","last_fullsized":"2024-03-30T12:39:50.314565+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:15.879816+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:39:15.879816+0000","last_peered":"2024-03-30T12:39:15.879816+0000","last_clean":"2024-03-30T12:39:15.879816+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:39:15.879816+0000","last_undegraded":"2024-03-30T12:39:15.879816+0000","last_fullsized":"2024-03-30T12:39:15.879816+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889177+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:40:50.889177+0000","last_peered":"2024-03-30T12:40:50.889177+0000","last_clean":"2024-03-30T12:40:50.889177+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:40:50.889177+0000","last_undegraded":"2024-03-30T12:40:50.889177+0000","last_fullsized":"2024-03-30T12:40:50.889177+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150500+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:40:19.150500+0000","last_peered":"2024-03-30T12:40:19.150500+0000","last_clean":"2024-03-30T12:40:19.150500+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:40:19.150500+0000","last_undegraded":"2024-03-30T12:40:19.150500+0000","last_fullsized":"2024-03-30T12:40:19.150500+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16482,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:04.570536+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:40:04.570536+0000","last_peered":"2024-03-30T12:40:04.570536+0000","last_clean":"2024-03-30T12:40:04.570536+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:40:04.570536+0000","last_undegraded":"2024-03-30T12:40:04.570536+0000","last_fullsized":"2024-03-30T12:40:04.570536+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889228+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:40:50.889228+0000","last_peered":"2024-03-30T12:40:50.889228+0000","last_clean":"2024-03-30T12:40:50.889228+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:40:50.889228+0000","last_undegraded":"2024-03-30T12:40:50.889228+0000","last_fullsized":"2024-03-30T12:40:50.889228+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1165,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:44.153535+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:40:44.153535+0000","last_peered":"2024-03-30T12:40:44.153535+0000","last_clean":"2024-03-30T12:40:44.153535+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:40:44.153535+0000","last_undegraded":"2024-03-30T12:40:44.153535+0000","last_fullsized":"2024-03-30T12:40:44.153535+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:18.917681+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:39:18.917681+0000","last_peered":"2024-03-30T12:39:18.917681+0000","last_clean":"2024-03-30T12:39:18.917681+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:39:18.917681+0000","last_undegraded":"2024-03-30T12:39:18.917681+0000","last_fullsized":"2024-03-30T12:39:18.917681+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31271,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:41:02.302474+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:41:02.302474+0000","last_peered":"2024-03-30T12:41:02.302474+0000","last_clean":"2024-03-30T12:41:02.302474+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:41:02.302474+0000","last_undegraded":"2024-03-30T12:41:02.302474+0000","last_fullsized":"2024-03-30T12:41:02.302474+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659585+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:39:57.659585+0000","last_peered":"2024-03-30T12:39:57.659585+0000","last_clean":"2024-03-30T12:39:57.659585+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:39:57.659585+0000","last_undegraded":"2024-03-30T12:39:57.659585+0000","last_fullsized":"2024-03-30T12:39:57.659585+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1355,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920979+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:39:48.920979+0000","last_peered":"2024-03-30T12:39:48.920979+0000","last_clean":"2024-03-30T12:39:48.920979+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:39:48.920979+0000","last_undegraded":"2024-03-30T12:39:48.920979+0000","last_fullsized":"2024-03-30T12:39:48.920979+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666291+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:40:57.666291+0000","last_peered":"2024-03-30T12:40:57.666291+0000","last_clean":"2024-03-30T12:40:57.666291+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:40:57.666291+0000","last_undegraded":"2024-03-30T12:40:57.666291+0000","last_fullsized":"2024-03-30T12:40:57.666291+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3766,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659555+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:39:57.659555+0000","last_peered":"2024-03-30T12:39:57.659555+0000","last_clean":"2024-03-30T12:39:57.659555+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:39:57.659555+0000","last_undegraded":"2024-03-30T12:39:57.659555+0000","last_fullsized":"2024-03-30T12:39:57.659555+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302452+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:41:02.302452+0000","last_peered":"2024-03-30T12:41:02.302452+0000","last_clean":"2024-03-30T12:41:02.302452+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:41:02.302452+0000","last_undegraded":"2024-03-30T12:41:02.302452+0000","last_fullsized":"2024-03-30T12:41:02.302452+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1157,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573285+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:40:29.573285+0000","last_peered":"2024-03-30T12:40:29.573285+0000","last_clean":"2024-03-30T12:40:29.573285+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:40:29.573285+0000","last_undegraded":"2024-03-30T12:40:29.573285+0000","last_fullsized":"2024-03-30T12:40:29.573285+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:15.879792+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:39:15.879792+0000","last_peered":"2024-03-30T12:39:15.879792+0000","last_clean":"2024-03-30T12:39:15.879792+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:39:15.879792+0000","last_undegraded":"2024-03-30T12:39:15.879792+0000","last_fullsized":"2024-03-30T12:39:15.879792+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15595,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:15.317660+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:40:15.317660+0000","last_peered":"2024-03-30T12:40:15.317660+0000","last_clean":"2024-03-30T12:40:15.317660+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:40:15.317660+0000","last_undegraded":"2024-03-30T12:40:15.317660+0000","last_fullsized":"2024-03-30T12:40:15.317660+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:09.156570+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:41:09.156570+0000","last_peered":"2024-03-30T12:41:09.156570+0000","last_clean":"2024-03-30T12:41:09.156570+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:41:09.156570+0000","last_undegraded":"2024-03-30T12:41:09.156570+0000","last_fullsized":"2024-03-30T12:41:09.156570+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:22.292071+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:39:22.292071+0000","last_peered":"2024-03-30T12:39:22.292071+0000","last_clean":"2024-03-30T12:39:22.292071+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:39:22.292071+0000","last_undegraded":"2024-03-30T12:39:22.292071+0000","last_fullsized":"2024-03-30T12:39:22.292071+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29021,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:39:47.295005+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:39:47.295005+0000","last_peered":"2024-03-30T12:39:47.295005+0000","last_clean":"2024-03-30T12:39:47.295005+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:39:47.295005+0000","last_undegraded":"2024-03-30T12:39:47.295005+0000","last_fullsized":"2024-03-30T12:39:47.295005+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920913+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:39:48.920913+0000","last_peered":"2024-03-30T12:39:48.920913+0000","last_clean":"2024-03-30T12:39:48.920913+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:39:48.920913+0000","last_undegraded":"2024-03-30T12:39:48.920913+0000","last_fullsized":"2024-03-30T12:39:48.920913+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666241+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:40:57.666241+0000","last_peered":"2024-03-30T12:40:57.666241+0000","last_clean":"2024-03-30T12:40:57.666241+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:40:57.666241+0000","last_undegraded":"2024-03-30T12:40:57.666241+0000","last_fullsized":"2024-03-30T12:40:57.666241+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5612,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:53.400722+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:40:53.400722+0000","last_peered":"2024-03-30T12:40:53.400722+0000","last_clean":"2024-03-30T12:40:53.400722+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:40:53.400722+0000","last_undegraded":"2024-03-30T12:40:53.400722+0000","last_fullsized":"2024-03-30T12:40:53.400722+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1366,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920941+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:39:48.920941+0000","last_peered":"2024-03-30T12:39:48.920941+0000","last_clean":"2024-03-30T12:39:48.920941+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:39:48.920941+0000","last_undegraded":"2024-03-30T12:39:48.920941+0000","last_fullsized":"2024-03-30T12:39:48.920941+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:12.654884+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:39:12.654884+0000","last_peered":"2024-03-30T12:39:12.654884+0000","last_clean":"2024-03-30T12:39:12.654884+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:39:12.654884+0000","last_undegraded":"2024-03-30T12:39:12.654884+0000","last_fullsized":"2024-03-30T12:39:12.654884+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4276,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:18.924042+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:40:18.924042+0000","last_peered":"2024-03-30T12:40:18.924042+0000","last_clean":"2024-03-30T12:40:18.924042+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:40:18.924042+0000","last_undegraded":"2024-03-30T12:40:18.924042+0000","last_fullsized":"2024-03-30T12:40:18.924042+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143221+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:39:19.143221+0000","last_peered":"2024-03-30T12:39:19.143221+0000","last_clean":"2024-03-30T12:39:19.143221+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:39:19.143221+0000","last_undegraded":"2024-03-30T12:39:19.143221+0000","last_fullsized":"2024-03-30T12:39:19.143221+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573205+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:40:29.573205+0000","last_peered":"2024-03-30T12:40:29.573205+0000","last_clean":"2024-03-30T12:40:29.573205+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:40:29.573205+0000","last_undegraded":"2024-03-30T12:40:29.573205+0000","last_fullsized":"2024-03-30T12:40:29.573205+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5255,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:53.400674+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:40:53.400674+0000","last_peered":"2024-03-30T12:40:53.400674+0000","last_clean":"2024-03-30T12:40:53.400674+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:40:53.400674+0000","last_undegraded":"2024-03-30T12:40:53.400674+0000","last_fullsized":"2024-03-30T12:40:53.400674+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:53.400708+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:40:53.400708+0000","last_peered":"2024-03-30T12:40:53.400708+0000","last_clean":"2024-03-30T12:40:53.400708+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:40:53.400708+0000","last_undegraded":"2024-03-30T12:40:53.400708+0000","last_fullsized":"2024-03-30T12:40:53.400708+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143264+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:39:19.143264+0000","last_peered":"2024-03-30T12:39:19.143264+0000","last_clean":"2024-03-30T12:39:19.143264+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:39:19.143264+0000","last_undegraded":"2024-03-30T12:39:19.143264+0000","last_fullsized":"2024-03-30T12:39:19.143264+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4812,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:23.397123+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:40:23.397123+0000","last_peered":"2024-03-30T12:40:23.397123+0000","last_clean":"2024-03-30T12:40:23.397123+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:40:23.397123+0000","last_undegraded":"2024-03-30T12:40:23.397123+0000","last_fullsized":"2024-03-30T12:40:23.397123+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:18.924078+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:40:18.924078+0000","last_peered":"2024-03-30T12:40:18.924078+0000","last_clean":"2024-03-30T12:40:18.924078+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:40:18.924078+0000","last_undegraded":"2024-03-30T12:40:18.924078+0000","last_fullsized":"2024-03-30T12:40:18.924078+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.317641+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:40:15.317641+0000","last_peered":"2024-03-30T12:40:15.317641+0000","last_clean":"2024-03-30T12:40:15.317641+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:40:15.317641+0000","last_undegraded":"2024-03-30T12:40:15.317641+0000","last_fullsized":"2024-03-30T12:40:15.317641+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6745,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:41:09.156602+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:41:09.156602+0000","last_peered":"2024-03-30T12:41:09.156602+0000","last_clean":"2024-03-30T12:41:09.156602+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:41:09.156602+0000","last_undegraded":"2024-03-30T12:41:09.156602+0000","last_fullsized":"2024-03-30T12:41:09.156602+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1339,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:53.400753+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:40:53.400753+0000","last_peered":"2024-03-30T12:40:53.400753+0000","last_clean":"2024-03-30T12:40:53.400753+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:40:53.400753+0000","last_undegraded":"2024-03-30T12:40:53.400753+0000","last_fullsized":"2024-03-30T12:40:53.400753+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143303+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:39:19.143303+0000","last_peered":"2024-03-30T12:39:19.143303+0000","last_clean":"2024-03-30T12:39:19.143303+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:39:19.143303+0000","last_undegraded":"2024-03-30T12:39:19.143303+0000","last_fullsized":"2024-03-30T12:39:19.143303+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:04.570502+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:40:04.570502+0000","last_peered":"2024-03-30T12:40:04.570502+0000","last_clean":"2024-03-30T12:40:04.570502+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:40:04.570502+0000","last_undegraded":"2024-03-30T12:40:04.570502+0000","last_fullsized":"2024-03-30T12:40:04.570502+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:53.394048+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:39:53.394048+0000","last_peered":"2024-03-30T12:39:53.394048+0000","last_clean":"2024-03-30T12:39:53.394048+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:39:53.394048+0000","last_undegraded":"2024-03-30T12:39:53.394048+0000","last_fullsized":"2024-03-30T12:39:53.394048+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:25.311414+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:39:25.311414+0000","last_peered":"2024-03-30T12:39:25.311414+0000","last_clean":"2024-03-30T12:39:25.311414+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:39:25.311414+0000","last_undegraded":"2024-03-30T12:39:25.311414+0000","last_fullsized":"2024-03-30T12:39:25.311414+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889204+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:40:50.889204+0000","last_peered":"2024-03-30T12:40:50.889204+0000","last_clean":"2024-03-30T12:40:50.889204+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:40:50.889204+0000","last_undegraded":"2024-03-30T12:40:50.889204+0000","last_fullsized":"2024-03-30T12:40:50.889204+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666276+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:40:57.666276+0000","last_peered":"2024-03-30T12:40:57.666276+0000","last_clean":"2024-03-30T12:40:57.666276+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:40:57.666276+0000","last_undegraded":"2024-03-30T12:40:57.666276+0000","last_fullsized":"2024-03-30T12:40:57.666276+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920964+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:39:48.920964+0000","last_peered":"2024-03-30T12:39:48.920964+0000","last_clean":"2024-03-30T12:39:48.920964+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:39:48.920964+0000","last_undegraded":"2024-03-30T12:39:48.920964+0000","last_fullsized":"2024-03-30T12:39:48.920964+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1179,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573267+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:40:29.573267+0000","last_peered":"2024-03-30T12:40:29.573267+0000","last_clean":"2024-03-30T12:40:29.573267+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:40:29.573267+0000","last_undegraded":"2024-03-30T12:40:29.573267+0000","last_fullsized":"2024-03-30T12:40:29.573267+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1283,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666301+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:40:57.666301+0000","last_peered":"2024-03-30T12:40:57.666301+0000","last_clean":"2024-03-30T12:40:57.666301+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:40:57.666301+0000","last_undegraded":"2024-03-30T12:40:57.666301+0000","last_fullsized":"2024-03-30T12:40:57.666301+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:50.314509+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:39:50.314509+0000","last_peered":"2024-03-30T12:39:50.314509+0000","last_clean":"2024-03-30T12:39:50.314509+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:39:50.314509+0000","last_undegraded":"2024-03-30T12:39:50.314509+0000","last_fullsized":"2024-03-30T12:39:50.314509+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:12.654857+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:39:12.654857+0000","last_peered":"2024-03-30T12:39:12.654857+0000","last_clean":"2024-03-30T12:39:12.654857+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:39:12.654857+0000","last_undegraded":"2024-03-30T12:39:12.654857+0000","last_fullsized":"2024-03-30T12:39:12.654857+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1217,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.317602+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:40:15.317602+0000","last_peered":"2024-03-30T12:40:15.317602+0000","last_clean":"2024-03-30T12:40:15.317602+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:40:15.317602+0000","last_undegraded":"2024-03-30T12:40:15.317602+0000","last_fullsized":"2024-03-30T12:40:15.317602+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:45.883156+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:39:45.883156+0000","last_peered":"2024-03-30T12:39:45.883156+0000","last_clean":"2024-03-30T12:39:45.883156+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:39:45.883156+0000","last_undegraded":"2024-03-30T12:39:45.883156+0000","last_fullsized":"2024-03-30T12:39:45.883156+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:54.576179+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:40:54.576179+0000","last_peered":"2024-03-30T12:40:54.576179+0000","last_clean":"2024-03-30T12:40:54.576179+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:40:54.576179+0000","last_undegraded":"2024-03-30T12:40:54.576179+0000","last_fullsized":"2024-03-30T12:40:54.576179+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438110,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648166,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175176,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254414,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063233,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951290,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839347,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923629,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:43:25.611 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:25.611 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:25.612 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:25.612 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:25.612 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:25.612 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:25.612 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:25.612 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:25.612 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:25.612 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:25.612 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:25.612 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:25.612 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:25.612 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:43:26.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:26 smithi162 ceph-mon[83709]: pgmap v1211: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:26.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:26 smithi162 ceph-mon[83709]: from='client.34716 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:43:26.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:26 smithi084 ceph-mon[91810]: pgmap v1211: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:26.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:26 smithi084 ceph-mon[91810]: from='client.34716 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:43:26.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:26 smithi084 ceph-mon[89279]: pgmap v1211: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:26.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:26 smithi084 ceph-mon[89279]: from='client.34716 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:43:28.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:28 smithi162 ceph-mon[83709]: pgmap v1212: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:28.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:28 smithi084 ceph-mon[89279]: pgmap v1212: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:28.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:28 smithi084 ceph-mon[91810]: pgmap v1212: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:29.754 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:43:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:43:29] "GET /metrics HTTP/1.1" 200 36325 "" "Prometheus/2.43.0" 2024-03-30T12:43:30.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:30 smithi162 ceph-mon[83709]: pgmap v1213: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:30.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:30 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:43:30.456 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:30 smithi084 ceph-mon[91810]: pgmap v1213: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:30.456 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:30 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:43:30.456 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:30 smithi084 ceph-mon[89279]: pgmap v1213: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:30.456 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:30 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:43:32.370 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:32 smithi162 ceph-mon[83709]: pgmap v1214: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:32.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:32 smithi084 ceph-mon[91810]: pgmap v1214: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:32.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:32 smithi084 ceph-mon[89279]: pgmap v1214: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:34.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:34 smithi162 ceph-mon[83709]: pgmap v1215: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:34.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:34 smithi084 ceph-mon[89279]: pgmap v1215: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:34.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:34 smithi084 ceph-mon[91810]: pgmap v1215: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:35.613 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:43:35.832 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:43:36.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:36 smithi084 ceph-mon[89279]: pgmap v1216: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:36.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:36 smithi084 ceph-mon[91810]: pgmap v1216: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:36.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:36 smithi162 ceph-mon[83709]: pgmap v1216: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:37.304 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:37 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:43:37.305 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:37 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:43:37.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:37 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:43:37.884 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:43:37.886 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:43:38.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:38 smithi084 ceph-mon[91810]: pgmap v1217: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:38.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:38 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:43:38.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:38 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:43:38.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:38 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:43:38.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:38 smithi084 ceph-mon[91810]: from='client.34722 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:43:38.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:38 smithi084 ceph-mon[89279]: pgmap v1217: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:38.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:38 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:43:38.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:38 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:43:38.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:38 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:43:38.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:38 smithi084 ceph-mon[89279]: from='client.34722 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:43:38.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:38 smithi162 ceph-mon[83709]: pgmap v1217: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:38.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:38 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:43:38.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:38 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:43:38.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:38 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:43:38.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:38 smithi162 ceph-mon[83709]: from='client.34722 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:43:38.544 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1217,"stamp":"2024-03-30T12:43:36.944696+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004022"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:44.153566+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:40:44.153566+0000","last_peered":"2024-03-30T12:40:44.153566+0000","last_clean":"2024-03-30T12:40:44.153566+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:40:44.153566+0000","last_undegraded":"2024-03-30T12:40:44.153566+0000","last_fullsized":"2024-03-30T12:40:44.153566+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1366,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931469+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:41:23.931469+0000","last_peered":"2024-03-30T12:41:23.931469+0000","last_clean":"2024-03-30T12:41:23.931469+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:41:23.931469+0000","last_undegraded":"2024-03-30T12:41:23.931469+0000","last_fullsized":"2024-03-30T12:41:23.931469+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889238+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:40:50.889238+0000","last_peered":"2024-03-30T12:40:50.889238+0000","last_clean":"2024-03-30T12:40:50.889238+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:40:50.889238+0000","last_undegraded":"2024-03-30T12:40:50.889238+0000","last_fullsized":"2024-03-30T12:40:50.889238+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:00.322650+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:41:00.322650+0000","last_peered":"2024-03-30T12:41:00.322650+0000","last_clean":"2024-03-30T12:41:00.322650+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:41:00.322650+0000","last_undegraded":"2024-03-30T12:41:00.322650+0000","last_fullsized":"2024-03-30T12:41:00.322650+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150593+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:40:19.150593+0000","last_peered":"2024-03-30T12:40:19.150593+0000","last_clean":"2024-03-30T12:40:19.150593+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:40:19.150593+0000","last_undegraded":"2024-03-30T12:40:19.150593+0000","last_fullsized":"2024-03-30T12:40:19.150593+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1211,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308563+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:39:00.308563+0000","last_peered":"2024-03-30T12:39:00.308563+0000","last_clean":"2024-03-30T12:39:00.308563+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:39:00.308563+0000","last_undegraded":"2024-03-30T12:39:00.308563+0000","last_fullsized":"2024-03-30T12:39:00.308563+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150576+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:40:19.150576+0000","last_peered":"2024-03-30T12:40:19.150576+0000","last_clean":"2024-03-30T12:40:19.150576+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:40:19.150576+0000","last_undegraded":"2024-03-30T12:40:19.150576+0000","last_fullsized":"2024-03-30T12:40:19.150576+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662744+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:40:27.662744+0000","last_peered":"2024-03-30T12:40:27.662744+0000","last_clean":"2024-03-30T12:40:27.662744+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:40:27.662744+0000","last_undegraded":"2024-03-30T12:40:27.662744+0000","last_fullsized":"2024-03-30T12:40:27.662744+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:59.148225+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:39:59.148225+0000","last_peered":"2024-03-30T12:39:59.148225+0000","last_clean":"2024-03-30T12:39:59.148225+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:39:59.148225+0000","last_undegraded":"2024-03-30T12:39:59.148225+0000","last_fullsized":"2024-03-30T12:39:59.148225+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565540+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:39:19.565540+0000","last_peered":"2024-03-30T12:39:19.565540+0000","last_clean":"2024-03-30T12:39:19.565540+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:39:19.565540+0000","last_undegraded":"2024-03-30T12:39:19.565540+0000","last_fullsized":"2024-03-30T12:39:19.565540+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565513+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:39:19.565513+0000","last_peered":"2024-03-30T12:39:19.565513+0000","last_clean":"2024-03-30T12:39:19.565513+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:39:19.565513+0000","last_undegraded":"2024-03-30T12:39:19.565513+0000","last_fullsized":"2024-03-30T12:39:19.565513+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1272,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:37.299828+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:40:37.299828+0000","last_peered":"2024-03-30T12:40:37.299828+0000","last_clean":"2024-03-30T12:40:37.299828+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:40:37.299828+0000","last_undegraded":"2024-03-30T12:40:37.299828+0000","last_fullsized":"2024-03-30T12:40:37.299828+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660090+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:40:02.660090+0000","last_peered":"2024-03-30T12:40:02.660090+0000","last_clean":"2024-03-30T12:40:02.660090+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:40:02.660090+0000","last_undegraded":"2024-03-30T12:40:02.660090+0000","last_fullsized":"2024-03-30T12:40:02.660090+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886008+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:40:15.886008+0000","last_peered":"2024-03-30T12:40:15.886008+0000","last_clean":"2024-03-30T12:40:15.886008+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:40:15.886008+0000","last_undegraded":"2024-03-30T12:40:15.886008+0000","last_fullsized":"2024-03-30T12:40:15.886008+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:48.927583+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:40:48.927583+0000","last_peered":"2024-03-30T12:40:48.927583+0000","last_clean":"2024-03-30T12:40:48.927583+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:40:48.927583+0000","last_undegraded":"2024-03-30T12:40:48.927583+0000","last_fullsized":"2024-03-30T12:40:48.927583+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320117+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:40:40.320117+0000","last_peered":"2024-03-30T12:40:40.320117+0000","last_clean":"2024-03-30T12:40:40.320117+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:40:40.320117+0000","last_undegraded":"2024-03-30T12:40:40.320117+0000","last_fullsized":"2024-03-30T12:40:40.320117+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1226,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320196+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:40:40.320196+0000","last_peered":"2024-03-30T12:40:40.320196+0000","last_clean":"2024-03-30T12:40:40.320196+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:40:40.320196+0000","last_undegraded":"2024-03-30T12:40:40.320196+0000","last_fullsized":"2024-03-30T12:40:40.320196+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:03.388264+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:39:03.388264+0000","last_peered":"2024-03-30T12:39:03.388264+0000","last_clean":"2024-03-30T12:39:03.388264+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:39:03.388264+0000","last_undegraded":"2024-03-30T12:39:03.388264+0000","last_fullsized":"2024-03-30T12:39:03.388264+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143278+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:39:19.143278+0000","last_peered":"2024-03-30T12:39:19.143278+0000","last_clean":"2024-03-30T12:39:19.143278+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:39:19.143278+0000","last_undegraded":"2024-03-30T12:39:19.143278+0000","last_fullsized":"2024-03-30T12:39:19.143278+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1390,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889293+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:40:50.889293+0000","last_peered":"2024-03-30T12:40:50.889293+0000","last_clean":"2024-03-30T12:40:50.889293+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:40:50.889293+0000","last_undegraded":"2024-03-30T12:40:50.889293+0000","last_fullsized":"2024-03-30T12:40:50.889293+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1284,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659610+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:39:57.659610+0000","last_peered":"2024-03-30T12:39:57.659610+0000","last_clean":"2024-03-30T12:39:57.659610+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:39:57.659610+0000","last_undegraded":"2024-03-30T12:39:57.659610+0000","last_fullsized":"2024-03-30T12:39:57.659610+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1303,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659620+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:39:57.659620+0000","last_peered":"2024-03-30T12:39:57.659620+0000","last_clean":"2024-03-30T12:39:57.659620+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:39:57.659620+0000","last_undegraded":"2024-03-30T12:39:57.659620+0000","last_fullsized":"2024-03-30T12:39:57.659620+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889279+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:40:50.889279+0000","last_peered":"2024-03-30T12:40:50.889279+0000","last_clean":"2024-03-30T12:40:50.889279+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:40:50.889279+0000","last_undegraded":"2024-03-30T12:40:50.889279+0000","last_fullsized":"2024-03-30T12:40:50.889279+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150628+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:40:19.150628+0000","last_peered":"2024-03-30T12:40:19.150628+0000","last_clean":"2024-03-30T12:40:19.150628+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:40:19.150628+0000","last_undegraded":"2024-03-30T12:40:19.150628+0000","last_fullsized":"2024-03-30T12:40:19.150628+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1230,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308632+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:39:00.308632+0000","last_peered":"2024-03-30T12:39:00.308632+0000","last_clean":"2024-03-30T12:39:00.308632+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:39:00.308632+0000","last_undegraded":"2024-03-30T12:39:00.308632+0000","last_fullsized":"2024-03-30T12:39:00.308632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150608+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:40:19.150608+0000","last_peered":"2024-03-30T12:40:19.150608+0000","last_clean":"2024-03-30T12:40:19.150608+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:40:19.150608+0000","last_undegraded":"2024-03-30T12:40:19.150608+0000","last_fullsized":"2024-03-30T12:40:19.150608+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308643+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:39:00.308643+0000","last_peered":"2024-03-30T12:39:00.308643+0000","last_clean":"2024-03-30T12:39:00.308643+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:39:00.308643+0000","last_undegraded":"2024-03-30T12:39:00.308643+0000","last_fullsized":"2024-03-30T12:39:00.308643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1263,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662819+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:40:27.662819+0000","last_peered":"2024-03-30T12:40:27.662819+0000","last_clean":"2024-03-30T12:40:27.662819+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:40:27.662819+0000","last_undegraded":"2024-03-30T12:40:27.662819+0000","last_fullsized":"2024-03-30T12:40:27.662819+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1264,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302503+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:41:02.302503+0000","last_peered":"2024-03-30T12:41:02.302503+0000","last_clean":"2024-03-30T12:41:02.302503+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:41:02.302503+0000","last_undegraded":"2024-03-30T12:41:02.302503+0000","last_fullsized":"2024-03-30T12:41:02.302503+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1181,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.567808+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:39:39.567808+0000","last_peered":"2024-03-30T12:39:39.567808+0000","last_clean":"2024-03-30T12:39:39.567808+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:39:39.567808+0000","last_undegraded":"2024-03-30T12:39:39.567808+0000","last_fullsized":"2024-03-30T12:39:39.567808+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1379,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:45.876233+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:38:45.876233+0000","last_peered":"2024-03-30T12:38:45.876233+0000","last_clean":"2024-03-30T12:38:45.876233+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:38:45.876233+0000","last_undegraded":"2024-03-30T12:38:45.876233+0000","last_fullsized":"2024-03-30T12:38:45.876233+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660073+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:40:02.660073+0000","last_peered":"2024-03-30T12:40:02.660073+0000","last_clean":"2024-03-30T12:40:02.660073+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:40:02.660073+0000","last_undegraded":"2024-03-30T12:40:02.660073+0000","last_fullsized":"2024-03-30T12:40:02.660073+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660041+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:40:02.660041+0000","last_peered":"2024-03-30T12:40:02.660041+0000","last_clean":"2024-03-30T12:40:02.660041+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:40:02.660041+0000","last_undegraded":"2024-03-30T12:40:02.660041+0000","last_fullsized":"2024-03-30T12:40:02.660041+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1226,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323325+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:41:05.323325+0000","last_peered":"2024-03-30T12:41:05.323325+0000","last_clean":"2024-03-30T12:41:05.323325+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:41:05.323325+0000","last_undegraded":"2024-03-30T12:41:05.323325+0000","last_fullsized":"2024-03-30T12:41:05.323325+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:53.914730+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:38:53.914730+0000","last_peered":"2024-03-30T12:38:53.914730+0000","last_clean":"2024-03-30T12:38:53.914730+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:38:53.914730+0000","last_undegraded":"2024-03-30T12:38:53.914730+0000","last_fullsized":"2024-03-30T12:38:53.914730+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565553+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:39:19.565553+0000","last_peered":"2024-03-30T12:39:19.565553+0000","last_clean":"2024-03-30T12:39:19.565553+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:39:19.565553+0000","last_undegraded":"2024-03-30T12:39:19.565553+0000","last_fullsized":"2024-03-30T12:39:19.565553+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323382+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:41:05.323382+0000","last_peered":"2024-03-30T12:41:05.323382+0000","last_clean":"2024-03-30T12:41:05.323382+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:41:05.323382+0000","last_undegraded":"2024-03-30T12:41:05.323382+0000","last_fullsized":"2024-03-30T12:41:05.323382+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1200,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323370+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:41:05.323370+0000","last_peered":"2024-03-30T12:41:05.323370+0000","last_clean":"2024-03-30T12:41:05.323370+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:41:05.323370+0000","last_undegraded":"2024-03-30T12:41:05.323370+0000","last_fullsized":"2024-03-30T12:41:05.323370+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1292,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:28.391470+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:39:28.391470+0000","last_peered":"2024-03-30T12:39:28.391470+0000","last_clean":"2024-03-30T12:39:28.391470+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:39:28.391470+0000","last_undegraded":"2024-03-30T12:39:28.391470+0000","last_fullsized":"2024-03-30T12:39:28.391470+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:53.914770+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:38:53.914770+0000","last_peered":"2024-03-30T12:38:53.914770+0000","last_clean":"2024-03-30T12:38:53.914770+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:38:53.914770+0000","last_undegraded":"2024-03-30T12:38:53.914770+0000","last_fullsized":"2024-03-30T12:38:53.914770+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:12.297292+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:40:12.297292+0000","last_peered":"2024-03-30T12:40:12.297292+0000","last_clean":"2024-03-30T12:40:12.297292+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:40:12.297292+0000","last_undegraded":"2024-03-30T12:40:12.297292+0000","last_fullsized":"2024-03-30T12:40:12.297292+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562847+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:38:59.562847+0000","last_peered":"2024-03-30T12:38:59.562847+0000","last_clean":"2024-03-30T12:38:59.562847+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:38:59.562847+0000","last_undegraded":"2024-03-30T12:38:59.562847+0000","last_fullsized":"2024-03-30T12:38:59.562847+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:59.148189+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:39:59.148189+0000","last_peered":"2024-03-30T12:39:59.148189+0000","last_clean":"2024-03-30T12:39:59.148189+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:39:59.148189+0000","last_undegraded":"2024-03-30T12:39:59.148189+0000","last_fullsized":"2024-03-30T12:39:59.148189+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1385,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886047+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:40:15.886047+0000","last_peered":"2024-03-30T12:40:15.886047+0000","last_clean":"2024-03-30T12:40:15.886047+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:40:15.886047+0000","last_undegraded":"2024-03-30T12:40:15.886047+0000","last_fullsized":"2024-03-30T12:40:15.886047+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886029+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:40:15.886029+0000","last_peered":"2024-03-30T12:40:15.886029+0000","last_clean":"2024-03-30T12:40:15.886029+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:40:15.886029+0000","last_undegraded":"2024-03-30T12:40:15.886029+0000","last_fullsized":"2024-03-30T12:40:15.886029+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320162+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:40:40.320162+0000","last_peered":"2024-03-30T12:40:40.320162+0000","last_clean":"2024-03-30T12:40:40.320162+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:40:40.320162+0000","last_undegraded":"2024-03-30T12:40:40.320162+0000","last_fullsized":"2024-03-30T12:40:40.320162+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.145725+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:39:39.145725+0000","last_peered":"2024-03-30T12:39:39.145725+0000","last_clean":"2024-03-30T12:39:39.145725+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:39:39.145725+0000","last_undegraded":"2024-03-30T12:39:39.145725+0000","last_fullsized":"2024-03-30T12:39:39.145725+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562815+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:38:59.562815+0000","last_peered":"2024-03-30T12:38:59.562815+0000","last_clean":"2024-03-30T12:38:59.562815+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:38:59.562815+0000","last_undegraded":"2024-03-30T12:38:59.562815+0000","last_fullsized":"2024-03-30T12:38:59.562815+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:38:59.562788+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:38:59.562788+0000","last_peered":"2024-03-30T12:38:59.562788+0000","last_clean":"2024-03-30T12:38:59.562788+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:38:59.562788+0000","last_undegraded":"2024-03-30T12:38:59.562788+0000","last_fullsized":"2024-03-30T12:38:59.562788+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:03.388191+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:39:03.388191+0000","last_peered":"2024-03-30T12:39:03.388191+0000","last_clean":"2024-03-30T12:39:03.388191+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:39:03.388191+0000","last_undegraded":"2024-03-30T12:39:03.388191+0000","last_fullsized":"2024-03-30T12:39:03.388191+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.145661+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:39:39.145661+0000","last_peered":"2024-03-30T12:39:39.145661+0000","last_clean":"2024-03-30T12:39:39.145661+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:39:39.145661+0000","last_undegraded":"2024-03-30T12:39:39.145661+0000","last_fullsized":"2024-03-30T12:39:39.145661+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5754,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:23.397042+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:40:23.397042+0000","last_peered":"2024-03-30T12:40:23.397042+0000","last_clean":"2024-03-30T12:40:23.397042+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:40:23.397042+0000","last_undegraded":"2024-03-30T12:40:23.397042+0000","last_fullsized":"2024-03-30T12:40:23.397042+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1276,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:47.295052+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:39:47.295052+0000","last_peered":"2024-03-30T12:39:47.295052+0000","last_clean":"2024-03-30T12:39:47.295052+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:39:47.295052+0000","last_undegraded":"2024-03-30T12:39:47.295052+0000","last_fullsized":"2024-03-30T12:39:47.295052+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143289+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:39:19.143289+0000","last_peered":"2024-03-30T12:39:19.143289+0000","last_clean":"2024-03-30T12:39:19.143289+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:39:19.143289+0000","last_undegraded":"2024-03-30T12:39:19.143289+0000","last_fullsized":"2024-03-30T12:39:19.143289+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5515,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:50.889213+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:40:50.889213+0000","last_peered":"2024-03-30T12:40:50.889213+0000","last_clean":"2024-03-30T12:40:50.889213+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:40:50.889213+0000","last_undegraded":"2024-03-30T12:40:50.889213+0000","last_fullsized":"2024-03-30T12:40:50.889213+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931401+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:41:23.931401+0000","last_peered":"2024-03-30T12:41:23.931401+0000","last_clean":"2024-03-30T12:41:23.931401+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:41:23.931401+0000","last_undegraded":"2024-03-30T12:41:23.931401+0000","last_fullsized":"2024-03-30T12:41:23.931401+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931427+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:41:23.931427+0000","last_peered":"2024-03-30T12:41:23.931427+0000","last_clean":"2024-03-30T12:41:23.931427+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:41:23.931427+0000","last_undegraded":"2024-03-30T12:41:23.931427+0000","last_fullsized":"2024-03-30T12:41:23.931427+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326520+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:41:30.326520+0000","last_peered":"2024-03-30T12:41:30.326520+0000","last_clean":"2024-03-30T12:41:30.326520+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:41:30.326520+0000","last_undegraded":"2024-03-30T12:41:30.326520+0000","last_fullsized":"2024-03-30T12:41:30.326520+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5460,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:50.889251+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:40:50.889251+0000","last_peered":"2024-03-30T12:40:50.889251+0000","last_clean":"2024-03-30T12:40:50.889251+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:40:50.889251+0000","last_undegraded":"2024-03-30T12:40:50.889251+0000","last_fullsized":"2024-03-30T12:40:50.889251+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931438+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:41:23.931438+0000","last_peered":"2024-03-30T12:41:23.931438+0000","last_clean":"2024-03-30T12:41:23.931438+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:41:23.931438+0000","last_undegraded":"2024-03-30T12:41:23.931438+0000","last_fullsized":"2024-03-30T12:41:23.931438+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1209,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326461+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:41:30.326461+0000","last_peered":"2024-03-30T12:41:30.326461+0000","last_clean":"2024-03-30T12:41:30.326461+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:41:30.326461+0000","last_undegraded":"2024-03-30T12:41:30.326461+0000","last_fullsized":"2024-03-30T12:41:30.326461+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302515+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:41:02.302515+0000","last_peered":"2024-03-30T12:41:02.302515+0000","last_clean":"2024-03-30T12:41:02.302515+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:41:02.302515+0000","last_undegraded":"2024-03-30T12:41:02.302515+0000","last_fullsized":"2024-03-30T12:41:02.302515+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3805,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:23.397156+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:40:23.397156+0000","last_peered":"2024-03-30T12:40:23.397156+0000","last_clean":"2024-03-30T12:40:23.397156+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:40:23.397156+0000","last_undegraded":"2024-03-30T12:40:23.397156+0000","last_fullsized":"2024-03-30T12:40:23.397156+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1344,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920990+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:39:48.920990+0000","last_peered":"2024-03-30T12:39:48.920990+0000","last_clean":"2024-03-30T12:39:48.920990+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:39:48.920990+0000","last_undegraded":"2024-03-30T12:39:48.920990+0000","last_fullsized":"2024-03-30T12:39:48.920990+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:48.927559+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:40:48.927559+0000","last_peered":"2024-03-30T12:40:48.927559+0000","last_clean":"2024-03-30T12:40:48.927559+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:40:48.927559+0000","last_undegraded":"2024-03-30T12:40:48.927559+0000","last_fullsized":"2024-03-30T12:40:48.927559+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:53.394025+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:39:53.394025+0000","last_peered":"2024-03-30T12:39:53.394025+0000","last_clean":"2024-03-30T12:39:53.394025+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:39:53.394025+0000","last_undegraded":"2024-03-30T12:39:53.394025+0000","last_fullsized":"2024-03-30T12:39:53.394025+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4578,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:44.153464+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:40:44.153464+0000","last_peered":"2024-03-30T12:40:44.153464+0000","last_clean":"2024-03-30T12:40:44.153464+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:40:44.153464+0000","last_undegraded":"2024-03-30T12:40:44.153464+0000","last_fullsized":"2024-03-30T12:40:44.153464+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1176,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:04.570573+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:40:04.570573+0000","last_peered":"2024-03-30T12:40:04.570573+0000","last_clean":"2024-03-30T12:40:04.570573+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:40:04.570573+0000","last_undegraded":"2024-03-30T12:40:04.570573+0000","last_fullsized":"2024-03-30T12:40:04.570573+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662799+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:40:27.662799+0000","last_peered":"2024-03-30T12:40:27.662799+0000","last_clean":"2024-03-30T12:40:27.662799+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:40:27.662799+0000","last_undegraded":"2024-03-30T12:40:27.662799+0000","last_fullsized":"2024-03-30T12:40:27.662799+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1202,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326500+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:41:30.326500+0000","last_peered":"2024-03-30T12:41:30.326500+0000","last_clean":"2024-03-30T12:41:30.326500+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:41:30.326500+0000","last_undegraded":"2024-03-30T12:41:30.326500+0000","last_fullsized":"2024-03-30T12:41:30.326500+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1718,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150538+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:40:19.150538+0000","last_peered":"2024-03-30T12:40:19.150538+0000","last_clean":"2024-03-30T12:40:19.150538+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:40:19.150538+0000","last_undegraded":"2024-03-30T12:40:19.150538+0000","last_fullsized":"2024-03-30T12:40:19.150538+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24715,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:39:50.314565+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:39:50.314565+0000","last_peered":"2024-03-30T12:39:50.314565+0000","last_clean":"2024-03-30T12:39:50.314565+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:39:50.314565+0000","last_undegraded":"2024-03-30T12:39:50.314565+0000","last_fullsized":"2024-03-30T12:39:50.314565+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:25.764684+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:41:25.764684+0000","last_peered":"2024-03-30T12:41:25.764684+0000","last_clean":"2024-03-30T12:41:25.764684+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:41:25.764684+0000","last_undegraded":"2024-03-30T12:41:25.764684+0000","last_fullsized":"2024-03-30T12:41:25.764684+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889177+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:40:50.889177+0000","last_peered":"2024-03-30T12:40:50.889177+0000","last_clean":"2024-03-30T12:40:50.889177+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:40:50.889177+0000","last_undegraded":"2024-03-30T12:40:50.889177+0000","last_fullsized":"2024-03-30T12:40:50.889177+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150500+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:40:19.150500+0000","last_peered":"2024-03-30T12:40:19.150500+0000","last_clean":"2024-03-30T12:40:19.150500+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:40:19.150500+0000","last_undegraded":"2024-03-30T12:40:19.150500+0000","last_fullsized":"2024-03-30T12:40:19.150500+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16482,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:04.570536+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:40:04.570536+0000","last_peered":"2024-03-30T12:40:04.570536+0000","last_clean":"2024-03-30T12:40:04.570536+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:40:04.570536+0000","last_undegraded":"2024-03-30T12:40:04.570536+0000","last_fullsized":"2024-03-30T12:40:04.570536+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889228+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:40:50.889228+0000","last_peered":"2024-03-30T12:40:50.889228+0000","last_clean":"2024-03-30T12:40:50.889228+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:40:50.889228+0000","last_undegraded":"2024-03-30T12:40:50.889228+0000","last_fullsized":"2024-03-30T12:40:50.889228+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1165,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:44.153535+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:40:44.153535+0000","last_peered":"2024-03-30T12:40:44.153535+0000","last_clean":"2024-03-30T12:40:44.153535+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:40:44.153535+0000","last_undegraded":"2024-03-30T12:40:44.153535+0000","last_fullsized":"2024-03-30T12:40:44.153535+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931449+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:41:23.931449+0000","last_peered":"2024-03-30T12:41:23.931449+0000","last_clean":"2024-03-30T12:41:23.931449+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:41:23.931449+0000","last_undegraded":"2024-03-30T12:41:23.931449+0000","last_fullsized":"2024-03-30T12:41:23.931449+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31271,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:41:02.302474+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:41:02.302474+0000","last_peered":"2024-03-30T12:41:02.302474+0000","last_clean":"2024-03-30T12:41:02.302474+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:41:02.302474+0000","last_undegraded":"2024-03-30T12:41:02.302474+0000","last_fullsized":"2024-03-30T12:41:02.302474+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659585+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:39:57.659585+0000","last_peered":"2024-03-30T12:39:57.659585+0000","last_clean":"2024-03-30T12:39:57.659585+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:39:57.659585+0000","last_undegraded":"2024-03-30T12:39:57.659585+0000","last_fullsized":"2024-03-30T12:39:57.659585+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1355,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920979+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:39:48.920979+0000","last_peered":"2024-03-30T12:39:48.920979+0000","last_clean":"2024-03-30T12:39:48.920979+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:39:48.920979+0000","last_undegraded":"2024-03-30T12:39:48.920979+0000","last_fullsized":"2024-03-30T12:39:48.920979+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666291+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:40:57.666291+0000","last_peered":"2024-03-30T12:40:57.666291+0000","last_clean":"2024-03-30T12:40:57.666291+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:40:57.666291+0000","last_undegraded":"2024-03-30T12:40:57.666291+0000","last_fullsized":"2024-03-30T12:40:57.666291+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3766,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659555+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:39:57.659555+0000","last_peered":"2024-03-30T12:39:57.659555+0000","last_clean":"2024-03-30T12:39:57.659555+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:39:57.659555+0000","last_undegraded":"2024-03-30T12:39:57.659555+0000","last_fullsized":"2024-03-30T12:39:57.659555+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302452+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:41:02.302452+0000","last_peered":"2024-03-30T12:41:02.302452+0000","last_clean":"2024-03-30T12:41:02.302452+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:41:02.302452+0000","last_undegraded":"2024-03-30T12:41:02.302452+0000","last_fullsized":"2024-03-30T12:41:02.302452+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1157,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573285+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:40:29.573285+0000","last_peered":"2024-03-30T12:40:29.573285+0000","last_clean":"2024-03-30T12:40:29.573285+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:40:29.573285+0000","last_undegraded":"2024-03-30T12:40:29.573285+0000","last_fullsized":"2024-03-30T12:40:29.573285+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:25.764656+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:41:25.764656+0000","last_peered":"2024-03-30T12:41:25.764656+0000","last_clean":"2024-03-30T12:41:25.764656+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:41:25.764656+0000","last_undegraded":"2024-03-30T12:41:25.764656+0000","last_fullsized":"2024-03-30T12:41:25.764656+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15595,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:15.317660+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:40:15.317660+0000","last_peered":"2024-03-30T12:40:15.317660+0000","last_clean":"2024-03-30T12:40:15.317660+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:40:15.317660+0000","last_undegraded":"2024-03-30T12:40:15.317660+0000","last_fullsized":"2024-03-30T12:40:15.317660+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:09.156570+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:41:09.156570+0000","last_peered":"2024-03-30T12:41:09.156570+0000","last_clean":"2024-03-30T12:41:09.156570+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:41:09.156570+0000","last_undegraded":"2024-03-30T12:41:09.156570+0000","last_fullsized":"2024-03-30T12:41:09.156570+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1259,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:22.292071+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:39:22.292071+0000","last_peered":"2024-03-30T12:39:22.292071+0000","last_clean":"2024-03-30T12:39:22.292071+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:39:22.292071+0000","last_undegraded":"2024-03-30T12:39:22.292071+0000","last_fullsized":"2024-03-30T12:39:22.292071+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29021,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:39:47.295005+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:39:47.295005+0000","last_peered":"2024-03-30T12:39:47.295005+0000","last_clean":"2024-03-30T12:39:47.295005+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:39:47.295005+0000","last_undegraded":"2024-03-30T12:39:47.295005+0000","last_fullsized":"2024-03-30T12:39:47.295005+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920913+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:39:48.920913+0000","last_peered":"2024-03-30T12:39:48.920913+0000","last_clean":"2024-03-30T12:39:48.920913+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:39:48.920913+0000","last_undegraded":"2024-03-30T12:39:48.920913+0000","last_fullsized":"2024-03-30T12:39:48.920913+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666241+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:40:57.666241+0000","last_peered":"2024-03-30T12:40:57.666241+0000","last_clean":"2024-03-30T12:40:57.666241+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:40:57.666241+0000","last_undegraded":"2024-03-30T12:40:57.666241+0000","last_fullsized":"2024-03-30T12:40:57.666241+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5612,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:53.400722+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:40:53.400722+0000","last_peered":"2024-03-30T12:40:53.400722+0000","last_clean":"2024-03-30T12:40:53.400722+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:40:53.400722+0000","last_undegraded":"2024-03-30T12:40:53.400722+0000","last_fullsized":"2024-03-30T12:40:53.400722+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1366,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920941+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:39:48.920941+0000","last_peered":"2024-03-30T12:39:48.920941+0000","last_clean":"2024-03-30T12:39:48.920941+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:39:48.920941+0000","last_undegraded":"2024-03-30T12:39:48.920941+0000","last_fullsized":"2024-03-30T12:39:48.920941+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:12.654884+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:39:12.654884+0000","last_peered":"2024-03-30T12:39:12.654884+0000","last_clean":"2024-03-30T12:39:12.654884+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:39:12.654884+0000","last_undegraded":"2024-03-30T12:39:12.654884+0000","last_fullsized":"2024-03-30T12:39:12.654884+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4276,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:18.924042+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:40:18.924042+0000","last_peered":"2024-03-30T12:40:18.924042+0000","last_clean":"2024-03-30T12:40:18.924042+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:40:18.924042+0000","last_undegraded":"2024-03-30T12:40:18.924042+0000","last_fullsized":"2024-03-30T12:40:18.924042+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143221+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:39:19.143221+0000","last_peered":"2024-03-30T12:39:19.143221+0000","last_clean":"2024-03-30T12:39:19.143221+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:39:19.143221+0000","last_undegraded":"2024-03-30T12:39:19.143221+0000","last_fullsized":"2024-03-30T12:39:19.143221+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573205+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:40:29.573205+0000","last_peered":"2024-03-30T12:40:29.573205+0000","last_clean":"2024-03-30T12:40:29.573205+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:40:29.573205+0000","last_undegraded":"2024-03-30T12:40:29.573205+0000","last_fullsized":"2024-03-30T12:40:29.573205+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5255,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:53.400674+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:40:53.400674+0000","last_peered":"2024-03-30T12:40:53.400674+0000","last_clean":"2024-03-30T12:40:53.400674+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:40:53.400674+0000","last_undegraded":"2024-03-30T12:40:53.400674+0000","last_fullsized":"2024-03-30T12:40:53.400674+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:53.400708+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:40:53.400708+0000","last_peered":"2024-03-30T12:40:53.400708+0000","last_clean":"2024-03-30T12:40:53.400708+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:40:53.400708+0000","last_undegraded":"2024-03-30T12:40:53.400708+0000","last_fullsized":"2024-03-30T12:40:53.400708+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143264+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:39:19.143264+0000","last_peered":"2024-03-30T12:39:19.143264+0000","last_clean":"2024-03-30T12:39:19.143264+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:39:19.143264+0000","last_undegraded":"2024-03-30T12:39:19.143264+0000","last_fullsized":"2024-03-30T12:39:19.143264+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4812,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:23.397123+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:40:23.397123+0000","last_peered":"2024-03-30T12:40:23.397123+0000","last_clean":"2024-03-30T12:40:23.397123+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:40:23.397123+0000","last_undegraded":"2024-03-30T12:40:23.397123+0000","last_fullsized":"2024-03-30T12:40:23.397123+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:18.924078+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:40:18.924078+0000","last_peered":"2024-03-30T12:40:18.924078+0000","last_clean":"2024-03-30T12:40:18.924078+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:40:18.924078+0000","last_undegraded":"2024-03-30T12:40:18.924078+0000","last_fullsized":"2024-03-30T12:40:18.924078+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.317641+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:40:15.317641+0000","last_peered":"2024-03-30T12:40:15.317641+0000","last_clean":"2024-03-30T12:40:15.317641+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:40:15.317641+0000","last_undegraded":"2024-03-30T12:40:15.317641+0000","last_fullsized":"2024-03-30T12:40:15.317641+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6745,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:41:09.156602+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:41:09.156602+0000","last_peered":"2024-03-30T12:41:09.156602+0000","last_clean":"2024-03-30T12:41:09.156602+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:41:09.156602+0000","last_undegraded":"2024-03-30T12:41:09.156602+0000","last_fullsized":"2024-03-30T12:41:09.156602+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1339,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:53.400753+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:40:53.400753+0000","last_peered":"2024-03-30T12:40:53.400753+0000","last_clean":"2024-03-30T12:40:53.400753+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:40:53.400753+0000","last_undegraded":"2024-03-30T12:40:53.400753+0000","last_fullsized":"2024-03-30T12:40:53.400753+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143303+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:39:19.143303+0000","last_peered":"2024-03-30T12:39:19.143303+0000","last_clean":"2024-03-30T12:39:19.143303+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:39:19.143303+0000","last_undegraded":"2024-03-30T12:39:19.143303+0000","last_fullsized":"2024-03-30T12:39:19.143303+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:04.570502+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:40:04.570502+0000","last_peered":"2024-03-30T12:40:04.570502+0000","last_clean":"2024-03-30T12:40:04.570502+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:40:04.570502+0000","last_undegraded":"2024-03-30T12:40:04.570502+0000","last_fullsized":"2024-03-30T12:40:04.570502+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:53.394048+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:39:53.394048+0000","last_peered":"2024-03-30T12:39:53.394048+0000","last_clean":"2024-03-30T12:39:53.394048+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:39:53.394048+0000","last_undegraded":"2024-03-30T12:39:53.394048+0000","last_fullsized":"2024-03-30T12:39:53.394048+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326484+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:41:30.326484+0000","last_peered":"2024-03-30T12:41:30.326484+0000","last_clean":"2024-03-30T12:41:30.326484+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:41:30.326484+0000","last_undegraded":"2024-03-30T12:41:30.326484+0000","last_fullsized":"2024-03-30T12:41:30.326484+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889204+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:40:50.889204+0000","last_peered":"2024-03-30T12:40:50.889204+0000","last_clean":"2024-03-30T12:40:50.889204+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:40:50.889204+0000","last_undegraded":"2024-03-30T12:40:50.889204+0000","last_fullsized":"2024-03-30T12:40:50.889204+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666276+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:40:57.666276+0000","last_peered":"2024-03-30T12:40:57.666276+0000","last_clean":"2024-03-30T12:40:57.666276+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:40:57.666276+0000","last_undegraded":"2024-03-30T12:40:57.666276+0000","last_fullsized":"2024-03-30T12:40:57.666276+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920964+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:39:48.920964+0000","last_peered":"2024-03-30T12:39:48.920964+0000","last_clean":"2024-03-30T12:39:48.920964+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:39:48.920964+0000","last_undegraded":"2024-03-30T12:39:48.920964+0000","last_fullsized":"2024-03-30T12:39:48.920964+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1179,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573267+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:40:29.573267+0000","last_peered":"2024-03-30T12:40:29.573267+0000","last_clean":"2024-03-30T12:40:29.573267+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:40:29.573267+0000","last_undegraded":"2024-03-30T12:40:29.573267+0000","last_fullsized":"2024-03-30T12:40:29.573267+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1283,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666301+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:40:57.666301+0000","last_peered":"2024-03-30T12:40:57.666301+0000","last_clean":"2024-03-30T12:40:57.666301+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:40:57.666301+0000","last_undegraded":"2024-03-30T12:40:57.666301+0000","last_fullsized":"2024-03-30T12:40:57.666301+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:50.314509+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:39:50.314509+0000","last_peered":"2024-03-30T12:39:50.314509+0000","last_clean":"2024-03-30T12:39:50.314509+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:39:50.314509+0000","last_undegraded":"2024-03-30T12:39:50.314509+0000","last_fullsized":"2024-03-30T12:39:50.314509+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:12.654857+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:39:12.654857+0000","last_peered":"2024-03-30T12:39:12.654857+0000","last_clean":"2024-03-30T12:39:12.654857+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:39:12.654857+0000","last_undegraded":"2024-03-30T12:39:12.654857+0000","last_fullsized":"2024-03-30T12:39:12.654857+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1217,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.317602+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:40:15.317602+0000","last_peered":"2024-03-30T12:40:15.317602+0000","last_clean":"2024-03-30T12:40:15.317602+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:40:15.317602+0000","last_undegraded":"2024-03-30T12:40:15.317602+0000","last_fullsized":"2024-03-30T12:40:15.317602+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:45.883156+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:39:45.883156+0000","last_peered":"2024-03-30T12:39:45.883156+0000","last_clean":"2024-03-30T12:39:45.883156+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:39:45.883156+0000","last_undegraded":"2024-03-30T12:39:45.883156+0000","last_fullsized":"2024-03-30T12:39:45.883156+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:54.576179+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:40:54.576179+0000","last_peered":"2024-03-30T12:40:54.576179+0000","last_clean":"2024-03-30T12:40:54.576179+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:40:54.576179+0000","last_undegraded":"2024-03-30T12:40:54.576179+0000","last_fullsized":"2024-03-30T12:40:54.576179+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438112,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648168,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175178,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254417,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063235,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951292,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839349,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923632,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:43:38.549 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:38.549 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:38.550 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:38.550 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:38.550 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:38.550 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:38.550 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:38.550 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:38.550 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:38.550 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:38.550 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:38.550 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:38.550 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:38.550 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:43:39.755 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:43:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:43:39] "GET /metrics HTTP/1.1" 200 36326 "" "Prometheus/2.43.0" 2024-03-30T12:43:40.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:40 smithi162 ceph-mon[83709]: pgmap v1218: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:40.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:40 smithi084 ceph-mon[89279]: pgmap v1218: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:40.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:40 smithi084 ceph-mon[91810]: pgmap v1218: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:42.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:42 smithi162 ceph-mon[83709]: pgmap v1219: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:42.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:42 smithi084 ceph-mon[91810]: pgmap v1219: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:42.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:42 smithi084 ceph-mon[89279]: pgmap v1219: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:44.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:44 smithi162 ceph-mon[83709]: pgmap v1220: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:44.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:44 smithi084 ceph-mon[91810]: pgmap v1220: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:44.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:44 smithi084 ceph-mon[89279]: pgmap v1220: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:45.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:43:45.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:43:45.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:43:46.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:46 smithi162 ceph-mon[83709]: pgmap v1221: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:46.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:46 smithi084 ceph-mon[91810]: pgmap v1221: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:46.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:46 smithi084 ceph-mon[89279]: pgmap v1221: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:48.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:48 smithi162 ceph-mon[83709]: pgmap v1222: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:48.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:48 smithi084 ceph-mon[91810]: pgmap v1222: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:48.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:48 smithi084 ceph-mon[89279]: pgmap v1222: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:48.551 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:43:48.768 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:43:49.420 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:43:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:43:49] "GET /metrics HTTP/1.1" 200 36325 "" "Prometheus/2.43.0" 2024-03-30T12:43:50.246 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:50 smithi084 ceph-mon[89279]: pgmap v1223: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:50.246 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:50 smithi084 ceph-mon[91810]: pgmap v1223: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:50.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:50 smithi162 ceph-mon[83709]: pgmap v1223: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:50.695 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:43:50.697 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:43:51.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:51 smithi084 ceph-mon[89279]: from='client.34728 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:43:51.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:51 smithi084 ceph-mon[91810]: from='client.34728 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:43:51.351 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1223,"stamp":"2024-03-30T12:43:48.948563+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003867"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:44.153566+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:40:44.153566+0000","last_peered":"2024-03-30T12:40:44.153566+0000","last_clean":"2024-03-30T12:40:44.153566+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:40:44.153566+0000","last_undegraded":"2024-03-30T12:40:44.153566+0000","last_fullsized":"2024-03-30T12:40:44.153566+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1366,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931469+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:41:23.931469+0000","last_peered":"2024-03-30T12:41:23.931469+0000","last_clean":"2024-03-30T12:41:23.931469+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:41:23.931469+0000","last_undegraded":"2024-03-30T12:41:23.931469+0000","last_fullsized":"2024-03-30T12:41:23.931469+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889238+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:40:50.889238+0000","last_peered":"2024-03-30T12:40:50.889238+0000","last_clean":"2024-03-30T12:40:50.889238+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:40:50.889238+0000","last_undegraded":"2024-03-30T12:40:50.889238+0000","last_fullsized":"2024-03-30T12:40:50.889238+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:00.322650+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:41:00.322650+0000","last_peered":"2024-03-30T12:41:00.322650+0000","last_clean":"2024-03-30T12:41:00.322650+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:41:00.322650+0000","last_undegraded":"2024-03-30T12:41:00.322650+0000","last_fullsized":"2024-03-30T12:41:00.322650+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150593+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:40:19.150593+0000","last_peered":"2024-03-30T12:40:19.150593+0000","last_clean":"2024-03-30T12:40:19.150593+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:40:19.150593+0000","last_undegraded":"2024-03-30T12:40:19.150593+0000","last_fullsized":"2024-03-30T12:40:19.150593+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1211,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308563+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:39:00.308563+0000","last_peered":"2024-03-30T12:39:00.308563+0000","last_clean":"2024-03-30T12:39:00.308563+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:39:00.308563+0000","last_undegraded":"2024-03-30T12:39:00.308563+0000","last_fullsized":"2024-03-30T12:39:00.308563+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150576+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:40:19.150576+0000","last_peered":"2024-03-30T12:40:19.150576+0000","last_clean":"2024-03-30T12:40:19.150576+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:40:19.150576+0000","last_undegraded":"2024-03-30T12:40:19.150576+0000","last_fullsized":"2024-03-30T12:40:19.150576+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662744+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:40:27.662744+0000","last_peered":"2024-03-30T12:40:27.662744+0000","last_clean":"2024-03-30T12:40:27.662744+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:40:27.662744+0000","last_undegraded":"2024-03-30T12:40:27.662744+0000","last_fullsized":"2024-03-30T12:40:27.662744+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:59.148225+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:39:59.148225+0000","last_peered":"2024-03-30T12:39:59.148225+0000","last_clean":"2024-03-30T12:39:59.148225+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:39:59.148225+0000","last_undegraded":"2024-03-30T12:39:59.148225+0000","last_fullsized":"2024-03-30T12:39:59.148225+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565540+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:39:19.565540+0000","last_peered":"2024-03-30T12:39:19.565540+0000","last_clean":"2024-03-30T12:39:19.565540+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:39:19.565540+0000","last_undegraded":"2024-03-30T12:39:19.565540+0000","last_fullsized":"2024-03-30T12:39:19.565540+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565513+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:39:19.565513+0000","last_peered":"2024-03-30T12:39:19.565513+0000","last_clean":"2024-03-30T12:39:19.565513+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:39:19.565513+0000","last_undegraded":"2024-03-30T12:39:19.565513+0000","last_fullsized":"2024-03-30T12:39:19.565513+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1272,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:37.299828+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:40:37.299828+0000","last_peered":"2024-03-30T12:40:37.299828+0000","last_clean":"2024-03-30T12:40:37.299828+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:40:37.299828+0000","last_undegraded":"2024-03-30T12:40:37.299828+0000","last_fullsized":"2024-03-30T12:40:37.299828+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660090+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:40:02.660090+0000","last_peered":"2024-03-30T12:40:02.660090+0000","last_clean":"2024-03-30T12:40:02.660090+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:40:02.660090+0000","last_undegraded":"2024-03-30T12:40:02.660090+0000","last_fullsized":"2024-03-30T12:40:02.660090+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886008+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:40:15.886008+0000","last_peered":"2024-03-30T12:40:15.886008+0000","last_clean":"2024-03-30T12:40:15.886008+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:40:15.886008+0000","last_undegraded":"2024-03-30T12:40:15.886008+0000","last_fullsized":"2024-03-30T12:40:15.886008+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:48.927583+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:40:48.927583+0000","last_peered":"2024-03-30T12:40:48.927583+0000","last_clean":"2024-03-30T12:40:48.927583+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:40:48.927583+0000","last_undegraded":"2024-03-30T12:40:48.927583+0000","last_fullsized":"2024-03-30T12:40:48.927583+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320117+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:40:40.320117+0000","last_peered":"2024-03-30T12:40:40.320117+0000","last_clean":"2024-03-30T12:40:40.320117+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:40:40.320117+0000","last_undegraded":"2024-03-30T12:40:40.320117+0000","last_fullsized":"2024-03-30T12:40:40.320117+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1226,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320196+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:40:40.320196+0000","last_peered":"2024-03-30T12:40:40.320196+0000","last_clean":"2024-03-30T12:40:40.320196+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:40:40.320196+0000","last_undegraded":"2024-03-30T12:40:40.320196+0000","last_fullsized":"2024-03-30T12:40:40.320196+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.403697+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:41:23.403697+0000","last_peered":"2024-03-30T12:41:23.403697+0000","last_clean":"2024-03-30T12:41:23.403697+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:41:23.403697+0000","last_undegraded":"2024-03-30T12:41:23.403697+0000","last_fullsized":"2024-03-30T12:41:23.403697+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143278+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:39:19.143278+0000","last_peered":"2024-03-30T12:39:19.143278+0000","last_clean":"2024-03-30T12:39:19.143278+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:39:19.143278+0000","last_undegraded":"2024-03-30T12:39:19.143278+0000","last_fullsized":"2024-03-30T12:39:19.143278+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1390,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889293+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:40:50.889293+0000","last_peered":"2024-03-30T12:40:50.889293+0000","last_clean":"2024-03-30T12:40:50.889293+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:40:50.889293+0000","last_undegraded":"2024-03-30T12:40:50.889293+0000","last_fullsized":"2024-03-30T12:40:50.889293+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1284,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659610+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:39:57.659610+0000","last_peered":"2024-03-30T12:39:57.659610+0000","last_clean":"2024-03-30T12:39:57.659610+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:39:57.659610+0000","last_undegraded":"2024-03-30T12:39:57.659610+0000","last_fullsized":"2024-03-30T12:39:57.659610+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1303,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659620+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:39:57.659620+0000","last_peered":"2024-03-30T12:39:57.659620+0000","last_clean":"2024-03-30T12:39:57.659620+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:39:57.659620+0000","last_undegraded":"2024-03-30T12:39:57.659620+0000","last_fullsized":"2024-03-30T12:39:57.659620+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889279+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:40:50.889279+0000","last_peered":"2024-03-30T12:40:50.889279+0000","last_clean":"2024-03-30T12:40:50.889279+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:40:50.889279+0000","last_undegraded":"2024-03-30T12:40:50.889279+0000","last_fullsized":"2024-03-30T12:40:50.889279+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150628+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:40:19.150628+0000","last_peered":"2024-03-30T12:40:19.150628+0000","last_clean":"2024-03-30T12:40:19.150628+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:40:19.150628+0000","last_undegraded":"2024-03-30T12:40:19.150628+0000","last_fullsized":"2024-03-30T12:40:19.150628+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1230,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308632+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:39:00.308632+0000","last_peered":"2024-03-30T12:39:00.308632+0000","last_clean":"2024-03-30T12:39:00.308632+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:39:00.308632+0000","last_undegraded":"2024-03-30T12:39:00.308632+0000","last_fullsized":"2024-03-30T12:39:00.308632+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150608+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:40:19.150608+0000","last_peered":"2024-03-30T12:40:19.150608+0000","last_clean":"2024-03-30T12:40:19.150608+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:40:19.150608+0000","last_undegraded":"2024-03-30T12:40:19.150608+0000","last_fullsized":"2024-03-30T12:40:19.150608+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1214,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:00.308643+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:39:00.308643+0000","last_peered":"2024-03-30T12:39:00.308643+0000","last_clean":"2024-03-30T12:39:00.308643+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:39:00.308643+0000","last_undegraded":"2024-03-30T12:39:00.308643+0000","last_fullsized":"2024-03-30T12:39:00.308643+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1263,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662819+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:40:27.662819+0000","last_peered":"2024-03-30T12:40:27.662819+0000","last_clean":"2024-03-30T12:40:27.662819+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:40:27.662819+0000","last_undegraded":"2024-03-30T12:40:27.662819+0000","last_fullsized":"2024-03-30T12:40:27.662819+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1264,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302503+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:41:02.302503+0000","last_peered":"2024-03-30T12:41:02.302503+0000","last_clean":"2024-03-30T12:41:02.302503+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:41:02.302503+0000","last_undegraded":"2024-03-30T12:41:02.302503+0000","last_fullsized":"2024-03-30T12:41:02.302503+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1181,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.567808+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:39:39.567808+0000","last_peered":"2024-03-30T12:39:39.567808+0000","last_clean":"2024-03-30T12:39:39.567808+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:39:39.567808+0000","last_undegraded":"2024-03-30T12:39:39.567808+0000","last_fullsized":"2024-03-30T12:39:39.567808+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:15.763333+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:41:15.763333+0000","last_peered":"2024-03-30T12:41:15.763333+0000","last_clean":"2024-03-30T12:41:15.763333+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:41:15.763333+0000","last_undegraded":"2024-03-30T12:41:15.763333+0000","last_fullsized":"2024-03-30T12:41:15.763333+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660073+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:40:02.660073+0000","last_peered":"2024-03-30T12:40:02.660073+0000","last_clean":"2024-03-30T12:40:02.660073+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:40:02.660073+0000","last_undegraded":"2024-03-30T12:40:02.660073+0000","last_fullsized":"2024-03-30T12:40:02.660073+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660041+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:40:02.660041+0000","last_peered":"2024-03-30T12:40:02.660041+0000","last_clean":"2024-03-30T12:40:02.660041+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:40:02.660041+0000","last_undegraded":"2024-03-30T12:40:02.660041+0000","last_fullsized":"2024-03-30T12:40:02.660041+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1226,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323325+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:41:05.323325+0000","last_peered":"2024-03-30T12:41:05.323325+0000","last_clean":"2024-03-30T12:41:05.323325+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:41:05.323325+0000","last_undegraded":"2024-03-30T12:41:05.323325+0000","last_fullsized":"2024-03-30T12:41:05.323325+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:18.930743+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:41:18.930743+0000","last_peered":"2024-03-30T12:41:18.930743+0000","last_clean":"2024-03-30T12:41:18.930743+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:41:18.930743+0000","last_undegraded":"2024-03-30T12:41:18.930743+0000","last_fullsized":"2024-03-30T12:41:18.930743+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565553+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:39:19.565553+0000","last_peered":"2024-03-30T12:39:19.565553+0000","last_clean":"2024-03-30T12:39:19.565553+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:39:19.565553+0000","last_undegraded":"2024-03-30T12:39:19.565553+0000","last_fullsized":"2024-03-30T12:39:19.565553+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323382+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:41:05.323382+0000","last_peered":"2024-03-30T12:41:05.323382+0000","last_clean":"2024-03-30T12:41:05.323382+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:41:05.323382+0000","last_undegraded":"2024-03-30T12:41:05.323382+0000","last_fullsized":"2024-03-30T12:41:05.323382+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1200,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323370+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:41:05.323370+0000","last_peered":"2024-03-30T12:41:05.323370+0000","last_clean":"2024-03-30T12:41:05.323370+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:41:05.323370+0000","last_undegraded":"2024-03-30T12:41:05.323370+0000","last_fullsized":"2024-03-30T12:41:05.323370+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1292,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:28.391470+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:39:28.391470+0000","last_peered":"2024-03-30T12:39:28.391470+0000","last_clean":"2024-03-30T12:39:28.391470+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:39:28.391470+0000","last_undegraded":"2024-03-30T12:39:28.391470+0000","last_fullsized":"2024-03-30T12:39:28.391470+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:18.930787+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:41:18.930787+0000","last_peered":"2024-03-30T12:41:18.930787+0000","last_clean":"2024-03-30T12:41:18.930787+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:41:18.930787+0000","last_undegraded":"2024-03-30T12:41:18.930787+0000","last_fullsized":"2024-03-30T12:41:18.930787+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:12.297292+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:40:12.297292+0000","last_peered":"2024-03-30T12:40:12.297292+0000","last_clean":"2024-03-30T12:40:12.297292+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:40:12.297292+0000","last_undegraded":"2024-03-30T12:40:12.297292+0000","last_fullsized":"2024-03-30T12:40:12.297292+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1207,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579099+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:41:19.579099+0000","last_peered":"2024-03-30T12:41:19.579099+0000","last_clean":"2024-03-30T12:41:19.579099+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:41:19.579099+0000","last_undegraded":"2024-03-30T12:41:19.579099+0000","last_fullsized":"2024-03-30T12:41:19.579099+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:59.148189+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:39:59.148189+0000","last_peered":"2024-03-30T12:39:59.148189+0000","last_clean":"2024-03-30T12:39:59.148189+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:39:59.148189+0000","last_undegraded":"2024-03-30T12:39:59.148189+0000","last_fullsized":"2024-03-30T12:39:59.148189+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1385,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886047+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:40:15.886047+0000","last_peered":"2024-03-30T12:40:15.886047+0000","last_clean":"2024-03-30T12:40:15.886047+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:40:15.886047+0000","last_undegraded":"2024-03-30T12:40:15.886047+0000","last_fullsized":"2024-03-30T12:40:15.886047+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886029+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:40:15.886029+0000","last_peered":"2024-03-30T12:40:15.886029+0000","last_clean":"2024-03-30T12:40:15.886029+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:40:15.886029+0000","last_undegraded":"2024-03-30T12:40:15.886029+0000","last_fullsized":"2024-03-30T12:40:15.886029+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320162+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:40:40.320162+0000","last_peered":"2024-03-30T12:40:40.320162+0000","last_clean":"2024-03-30T12:40:40.320162+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:40:40.320162+0000","last_undegraded":"2024-03-30T12:40:40.320162+0000","last_fullsized":"2024-03-30T12:40:40.320162+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.145725+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:39:39.145725+0000","last_peered":"2024-03-30T12:39:39.145725+0000","last_clean":"2024-03-30T12:39:39.145725+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:39:39.145725+0000","last_undegraded":"2024-03-30T12:39:39.145725+0000","last_fullsized":"2024-03-30T12:39:39.145725+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1186,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579076+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:41:19.579076+0000","last_peered":"2024-03-30T12:41:19.579076+0000","last_clean":"2024-03-30T12:41:19.579076+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:41:19.579076+0000","last_undegraded":"2024-03-30T12:41:19.579076+0000","last_fullsized":"2024-03-30T12:41:19.579076+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579050+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:41:19.579050+0000","last_peered":"2024-03-30T12:41:19.579050+0000","last_clean":"2024-03-30T12:41:19.579050+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:41:19.579050+0000","last_undegraded":"2024-03-30T12:41:19.579050+0000","last_fullsized":"2024-03-30T12:41:19.579050+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1346,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.403657+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:41:23.403657+0000","last_peered":"2024-03-30T12:41:23.403657+0000","last_clean":"2024-03-30T12:41:23.403657+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:41:23.403657+0000","last_undegraded":"2024-03-30T12:41:23.403657+0000","last_fullsized":"2024-03-30T12:41:23.403657+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.145661+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:39:39.145661+0000","last_peered":"2024-03-30T12:39:39.145661+0000","last_clean":"2024-03-30T12:39:39.145661+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:39:39.145661+0000","last_undegraded":"2024-03-30T12:39:39.145661+0000","last_fullsized":"2024-03-30T12:39:39.145661+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5754,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:23.397042+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:40:23.397042+0000","last_peered":"2024-03-30T12:40:23.397042+0000","last_clean":"2024-03-30T12:40:23.397042+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:40:23.397042+0000","last_undegraded":"2024-03-30T12:40:23.397042+0000","last_fullsized":"2024-03-30T12:40:23.397042+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1276,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:47.295052+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:39:47.295052+0000","last_peered":"2024-03-30T12:39:47.295052+0000","last_clean":"2024-03-30T12:39:47.295052+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:39:47.295052+0000","last_undegraded":"2024-03-30T12:39:47.295052+0000","last_fullsized":"2024-03-30T12:39:47.295052+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143289+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:39:19.143289+0000","last_peered":"2024-03-30T12:39:19.143289+0000","last_clean":"2024-03-30T12:39:19.143289+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:39:19.143289+0000","last_undegraded":"2024-03-30T12:39:19.143289+0000","last_fullsized":"2024-03-30T12:39:19.143289+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5515,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:50.889213+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:40:50.889213+0000","last_peered":"2024-03-30T12:40:50.889213+0000","last_clean":"2024-03-30T12:40:50.889213+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:40:50.889213+0000","last_undegraded":"2024-03-30T12:40:50.889213+0000","last_fullsized":"2024-03-30T12:40:50.889213+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931401+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:41:23.931401+0000","last_peered":"2024-03-30T12:41:23.931401+0000","last_clean":"2024-03-30T12:41:23.931401+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:41:23.931401+0000","last_undegraded":"2024-03-30T12:41:23.931401+0000","last_fullsized":"2024-03-30T12:41:23.931401+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931427+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:41:23.931427+0000","last_peered":"2024-03-30T12:41:23.931427+0000","last_clean":"2024-03-30T12:41:23.931427+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:41:23.931427+0000","last_undegraded":"2024-03-30T12:41:23.931427+0000","last_fullsized":"2024-03-30T12:41:23.931427+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326520+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:41:30.326520+0000","last_peered":"2024-03-30T12:41:30.326520+0000","last_clean":"2024-03-30T12:41:30.326520+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:41:30.326520+0000","last_undegraded":"2024-03-30T12:41:30.326520+0000","last_fullsized":"2024-03-30T12:41:30.326520+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5460,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:50.889251+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:40:50.889251+0000","last_peered":"2024-03-30T12:40:50.889251+0000","last_clean":"2024-03-30T12:40:50.889251+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:40:50.889251+0000","last_undegraded":"2024-03-30T12:40:50.889251+0000","last_fullsized":"2024-03-30T12:40:50.889251+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931438+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:41:23.931438+0000","last_peered":"2024-03-30T12:41:23.931438+0000","last_clean":"2024-03-30T12:41:23.931438+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:41:23.931438+0000","last_undegraded":"2024-03-30T12:41:23.931438+0000","last_fullsized":"2024-03-30T12:41:23.931438+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1209,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326461+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:41:30.326461+0000","last_peered":"2024-03-30T12:41:30.326461+0000","last_clean":"2024-03-30T12:41:30.326461+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:41:30.326461+0000","last_undegraded":"2024-03-30T12:41:30.326461+0000","last_fullsized":"2024-03-30T12:41:30.326461+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302515+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:41:02.302515+0000","last_peered":"2024-03-30T12:41:02.302515+0000","last_clean":"2024-03-30T12:41:02.302515+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:41:02.302515+0000","last_undegraded":"2024-03-30T12:41:02.302515+0000","last_fullsized":"2024-03-30T12:41:02.302515+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3805,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:23.397156+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:40:23.397156+0000","last_peered":"2024-03-30T12:40:23.397156+0000","last_clean":"2024-03-30T12:40:23.397156+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:40:23.397156+0000","last_undegraded":"2024-03-30T12:40:23.397156+0000","last_fullsized":"2024-03-30T12:40:23.397156+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1344,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920990+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:39:48.920990+0000","last_peered":"2024-03-30T12:39:48.920990+0000","last_clean":"2024-03-30T12:39:48.920990+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:39:48.920990+0000","last_undegraded":"2024-03-30T12:39:48.920990+0000","last_fullsized":"2024-03-30T12:39:48.920990+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:48.927559+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:40:48.927559+0000","last_peered":"2024-03-30T12:40:48.927559+0000","last_clean":"2024-03-30T12:40:48.927559+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:40:48.927559+0000","last_undegraded":"2024-03-30T12:40:48.927559+0000","last_fullsized":"2024-03-30T12:40:48.927559+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:53.394025+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:39:53.394025+0000","last_peered":"2024-03-30T12:39:53.394025+0000","last_clean":"2024-03-30T12:39:53.394025+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:39:53.394025+0000","last_undegraded":"2024-03-30T12:39:53.394025+0000","last_fullsized":"2024-03-30T12:39:53.394025+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4578,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:44.153464+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:40:44.153464+0000","last_peered":"2024-03-30T12:40:44.153464+0000","last_clean":"2024-03-30T12:40:44.153464+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:40:44.153464+0000","last_undegraded":"2024-03-30T12:40:44.153464+0000","last_fullsized":"2024-03-30T12:40:44.153464+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1176,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:04.570573+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:40:04.570573+0000","last_peered":"2024-03-30T12:40:04.570573+0000","last_clean":"2024-03-30T12:40:04.570573+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:40:04.570573+0000","last_undegraded":"2024-03-30T12:40:04.570573+0000","last_fullsized":"2024-03-30T12:40:04.570573+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662799+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:40:27.662799+0000","last_peered":"2024-03-30T12:40:27.662799+0000","last_clean":"2024-03-30T12:40:27.662799+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:40:27.662799+0000","last_undegraded":"2024-03-30T12:40:27.662799+0000","last_fullsized":"2024-03-30T12:40:27.662799+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1202,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326500+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:41:30.326500+0000","last_peered":"2024-03-30T12:41:30.326500+0000","last_clean":"2024-03-30T12:41:30.326500+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:41:30.326500+0000","last_undegraded":"2024-03-30T12:41:30.326500+0000","last_fullsized":"2024-03-30T12:41:30.326500+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1718,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150538+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:40:19.150538+0000","last_peered":"2024-03-30T12:40:19.150538+0000","last_clean":"2024-03-30T12:40:19.150538+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:40:19.150538+0000","last_undegraded":"2024-03-30T12:40:19.150538+0000","last_fullsized":"2024-03-30T12:40:19.150538+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24715,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:39:50.314565+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:39:50.314565+0000","last_peered":"2024-03-30T12:39:50.314565+0000","last_clean":"2024-03-30T12:39:50.314565+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:39:50.314565+0000","last_undegraded":"2024-03-30T12:39:50.314565+0000","last_fullsized":"2024-03-30T12:39:50.314565+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:25.764684+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:41:25.764684+0000","last_peered":"2024-03-30T12:41:25.764684+0000","last_clean":"2024-03-30T12:41:25.764684+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:41:25.764684+0000","last_undegraded":"2024-03-30T12:41:25.764684+0000","last_fullsized":"2024-03-30T12:41:25.764684+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889177+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:40:50.889177+0000","last_peered":"2024-03-30T12:40:50.889177+0000","last_clean":"2024-03-30T12:40:50.889177+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:40:50.889177+0000","last_undegraded":"2024-03-30T12:40:50.889177+0000","last_fullsized":"2024-03-30T12:40:50.889177+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150500+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:40:19.150500+0000","last_peered":"2024-03-30T12:40:19.150500+0000","last_clean":"2024-03-30T12:40:19.150500+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:40:19.150500+0000","last_undegraded":"2024-03-30T12:40:19.150500+0000","last_fullsized":"2024-03-30T12:40:19.150500+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16482,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:04.570536+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:40:04.570536+0000","last_peered":"2024-03-30T12:40:04.570536+0000","last_clean":"2024-03-30T12:40:04.570536+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:40:04.570536+0000","last_undegraded":"2024-03-30T12:40:04.570536+0000","last_fullsized":"2024-03-30T12:40:04.570536+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889228+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:40:50.889228+0000","last_peered":"2024-03-30T12:40:50.889228+0000","last_clean":"2024-03-30T12:40:50.889228+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:40:50.889228+0000","last_undegraded":"2024-03-30T12:40:50.889228+0000","last_fullsized":"2024-03-30T12:40:50.889228+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1165,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:44.153535+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:40:44.153535+0000","last_peered":"2024-03-30T12:40:44.153535+0000","last_clean":"2024-03-30T12:40:44.153535+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:40:44.153535+0000","last_undegraded":"2024-03-30T12:40:44.153535+0000","last_fullsized":"2024-03-30T12:40:44.153535+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931449+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:41:23.931449+0000","last_peered":"2024-03-30T12:41:23.931449+0000","last_clean":"2024-03-30T12:41:23.931449+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:41:23.931449+0000","last_undegraded":"2024-03-30T12:41:23.931449+0000","last_fullsized":"2024-03-30T12:41:23.931449+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31271,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:41:02.302474+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:41:02.302474+0000","last_peered":"2024-03-30T12:41:02.302474+0000","last_clean":"2024-03-30T12:41:02.302474+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:41:02.302474+0000","last_undegraded":"2024-03-30T12:41:02.302474+0000","last_fullsized":"2024-03-30T12:41:02.302474+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659585+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:39:57.659585+0000","last_peered":"2024-03-30T12:39:57.659585+0000","last_clean":"2024-03-30T12:39:57.659585+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:39:57.659585+0000","last_undegraded":"2024-03-30T12:39:57.659585+0000","last_fullsized":"2024-03-30T12:39:57.659585+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1355,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920979+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:39:48.920979+0000","last_peered":"2024-03-30T12:39:48.920979+0000","last_clean":"2024-03-30T12:39:48.920979+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:39:48.920979+0000","last_undegraded":"2024-03-30T12:39:48.920979+0000","last_fullsized":"2024-03-30T12:39:48.920979+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666291+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:40:57.666291+0000","last_peered":"2024-03-30T12:40:57.666291+0000","last_clean":"2024-03-30T12:40:57.666291+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:40:57.666291+0000","last_undegraded":"2024-03-30T12:40:57.666291+0000","last_fullsized":"2024-03-30T12:40:57.666291+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3766,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:57.659555+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:39:57.659555+0000","last_peered":"2024-03-30T12:39:57.659555+0000","last_clean":"2024-03-30T12:39:57.659555+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:39:57.659555+0000","last_undegraded":"2024-03-30T12:39:57.659555+0000","last_fullsized":"2024-03-30T12:39:57.659555+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302452+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:41:02.302452+0000","last_peered":"2024-03-30T12:41:02.302452+0000","last_clean":"2024-03-30T12:41:02.302452+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:41:02.302452+0000","last_undegraded":"2024-03-30T12:41:02.302452+0000","last_fullsized":"2024-03-30T12:41:02.302452+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1157,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573285+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:40:29.573285+0000","last_peered":"2024-03-30T12:40:29.573285+0000","last_clean":"2024-03-30T12:40:29.573285+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:40:29.573285+0000","last_undegraded":"2024-03-30T12:40:29.573285+0000","last_fullsized":"2024-03-30T12:40:29.573285+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:25.764656+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:41:25.764656+0000","last_peered":"2024-03-30T12:41:25.764656+0000","last_clean":"2024-03-30T12:41:25.764656+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:41:25.764656+0000","last_undegraded":"2024-03-30T12:41:25.764656+0000","last_fullsized":"2024-03-30T12:41:25.764656+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15595,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:15.317660+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:40:15.317660+0000","last_peered":"2024-03-30T12:40:15.317660+0000","last_clean":"2024-03-30T12:40:15.317660+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:40:15.317660+0000","last_undegraded":"2024-03-30T12:40:15.317660+0000","last_fullsized":"2024-03-30T12:40:15.317660+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:09.156570+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:41:09.156570+0000","last_peered":"2024-03-30T12:41:09.156570+0000","last_clean":"2024-03-30T12:41:09.156570+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:41:09.156570+0000","last_undegraded":"2024-03-30T12:41:09.156570+0000","last_fullsized":"2024-03-30T12:41:09.156570+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:32.306064+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:41:32.306064+0000","last_peered":"2024-03-30T12:41:32.306064+0000","last_clean":"2024-03-30T12:41:32.306064+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:41:32.306064+0000","last_undegraded":"2024-03-30T12:41:32.306064+0000","last_fullsized":"2024-03-30T12:41:32.306064+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29021,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:39:47.295005+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:39:47.295005+0000","last_peered":"2024-03-30T12:39:47.295005+0000","last_clean":"2024-03-30T12:39:47.295005+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:39:47.295005+0000","last_undegraded":"2024-03-30T12:39:47.295005+0000","last_fullsized":"2024-03-30T12:39:47.295005+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920913+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:39:48.920913+0000","last_peered":"2024-03-30T12:39:48.920913+0000","last_clean":"2024-03-30T12:39:48.920913+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:39:48.920913+0000","last_undegraded":"2024-03-30T12:39:48.920913+0000","last_fullsized":"2024-03-30T12:39:48.920913+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666241+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:40:57.666241+0000","last_peered":"2024-03-30T12:40:57.666241+0000","last_clean":"2024-03-30T12:40:57.666241+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:40:57.666241+0000","last_undegraded":"2024-03-30T12:40:57.666241+0000","last_fullsized":"2024-03-30T12:40:57.666241+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5612,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:53.400722+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:40:53.400722+0000","last_peered":"2024-03-30T12:40:53.400722+0000","last_clean":"2024-03-30T12:40:53.400722+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:40:53.400722+0000","last_undegraded":"2024-03-30T12:40:53.400722+0000","last_fullsized":"2024-03-30T12:40:53.400722+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1366,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920941+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:39:48.920941+0000","last_peered":"2024-03-30T12:39:48.920941+0000","last_clean":"2024-03-30T12:39:48.920941+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:39:48.920941+0000","last_undegraded":"2024-03-30T12:39:48.920941+0000","last_fullsized":"2024-03-30T12:39:48.920941+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:27.669397+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:41:27.669397+0000","last_peered":"2024-03-30T12:41:27.669397+0000","last_clean":"2024-03-30T12:41:27.669397+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:41:27.669397+0000","last_undegraded":"2024-03-30T12:41:27.669397+0000","last_fullsized":"2024-03-30T12:41:27.669397+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4276,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:18.924042+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:40:18.924042+0000","last_peered":"2024-03-30T12:40:18.924042+0000","last_clean":"2024-03-30T12:40:18.924042+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:40:18.924042+0000","last_undegraded":"2024-03-30T12:40:18.924042+0000","last_fullsized":"2024-03-30T12:40:18.924042+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143221+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:39:19.143221+0000","last_peered":"2024-03-30T12:39:19.143221+0000","last_clean":"2024-03-30T12:39:19.143221+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:39:19.143221+0000","last_undegraded":"2024-03-30T12:39:19.143221+0000","last_fullsized":"2024-03-30T12:39:19.143221+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573205+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:40:29.573205+0000","last_peered":"2024-03-30T12:40:29.573205+0000","last_clean":"2024-03-30T12:40:29.573205+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:40:29.573205+0000","last_undegraded":"2024-03-30T12:40:29.573205+0000","last_fullsized":"2024-03-30T12:40:29.573205+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5255,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:53.400674+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:40:53.400674+0000","last_peered":"2024-03-30T12:40:53.400674+0000","last_clean":"2024-03-30T12:40:53.400674+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:40:53.400674+0000","last_undegraded":"2024-03-30T12:40:53.400674+0000","last_fullsized":"2024-03-30T12:40:53.400674+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:53.400708+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:40:53.400708+0000","last_peered":"2024-03-30T12:40:53.400708+0000","last_clean":"2024-03-30T12:40:53.400708+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:40:53.400708+0000","last_undegraded":"2024-03-30T12:40:53.400708+0000","last_fullsized":"2024-03-30T12:40:53.400708+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143264+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:39:19.143264+0000","last_peered":"2024-03-30T12:39:19.143264+0000","last_clean":"2024-03-30T12:39:19.143264+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:39:19.143264+0000","last_undegraded":"2024-03-30T12:39:19.143264+0000","last_fullsized":"2024-03-30T12:39:19.143264+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4812,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:23.397123+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:40:23.397123+0000","last_peered":"2024-03-30T12:40:23.397123+0000","last_clean":"2024-03-30T12:40:23.397123+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:40:23.397123+0000","last_undegraded":"2024-03-30T12:40:23.397123+0000","last_fullsized":"2024-03-30T12:40:23.397123+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:18.924078+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:40:18.924078+0000","last_peered":"2024-03-30T12:40:18.924078+0000","last_clean":"2024-03-30T12:40:18.924078+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:40:18.924078+0000","last_undegraded":"2024-03-30T12:40:18.924078+0000","last_fullsized":"2024-03-30T12:40:18.924078+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.317641+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:40:15.317641+0000","last_peered":"2024-03-30T12:40:15.317641+0000","last_clean":"2024-03-30T12:40:15.317641+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:40:15.317641+0000","last_undegraded":"2024-03-30T12:40:15.317641+0000","last_fullsized":"2024-03-30T12:40:15.317641+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6745,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:41:09.156602+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:41:09.156602+0000","last_peered":"2024-03-30T12:41:09.156602+0000","last_clean":"2024-03-30T12:41:09.156602+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:41:09.156602+0000","last_undegraded":"2024-03-30T12:41:09.156602+0000","last_fullsized":"2024-03-30T12:41:09.156602+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1339,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:53.400753+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:40:53.400753+0000","last_peered":"2024-03-30T12:40:53.400753+0000","last_clean":"2024-03-30T12:40:53.400753+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:40:53.400753+0000","last_undegraded":"2024-03-30T12:40:53.400753+0000","last_fullsized":"2024-03-30T12:40:53.400753+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.143303+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:39:19.143303+0000","last_peered":"2024-03-30T12:39:19.143303+0000","last_clean":"2024-03-30T12:39:19.143303+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:39:19.143303+0000","last_undegraded":"2024-03-30T12:39:19.143303+0000","last_fullsized":"2024-03-30T12:39:19.143303+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:04.570502+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:40:04.570502+0000","last_peered":"2024-03-30T12:40:04.570502+0000","last_clean":"2024-03-30T12:40:04.570502+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:40:04.570502+0000","last_undegraded":"2024-03-30T12:40:04.570502+0000","last_fullsized":"2024-03-30T12:40:04.570502+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:53.394048+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:39:53.394048+0000","last_peered":"2024-03-30T12:39:53.394048+0000","last_clean":"2024-03-30T12:39:53.394048+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:39:53.394048+0000","last_undegraded":"2024-03-30T12:39:53.394048+0000","last_fullsized":"2024-03-30T12:39:53.394048+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326484+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:41:30.326484+0000","last_peered":"2024-03-30T12:41:30.326484+0000","last_clean":"2024-03-30T12:41:30.326484+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:41:30.326484+0000","last_undegraded":"2024-03-30T12:41:30.326484+0000","last_fullsized":"2024-03-30T12:41:30.326484+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889204+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:40:50.889204+0000","last_peered":"2024-03-30T12:40:50.889204+0000","last_clean":"2024-03-30T12:40:50.889204+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:40:50.889204+0000","last_undegraded":"2024-03-30T12:40:50.889204+0000","last_fullsized":"2024-03-30T12:40:50.889204+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666276+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:40:57.666276+0000","last_peered":"2024-03-30T12:40:57.666276+0000","last_clean":"2024-03-30T12:40:57.666276+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:40:57.666276+0000","last_undegraded":"2024-03-30T12:40:57.666276+0000","last_fullsized":"2024-03-30T12:40:57.666276+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920964+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:39:48.920964+0000","last_peered":"2024-03-30T12:39:48.920964+0000","last_clean":"2024-03-30T12:39:48.920964+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:39:48.920964+0000","last_undegraded":"2024-03-30T12:39:48.920964+0000","last_fullsized":"2024-03-30T12:39:48.920964+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1179,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573267+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:40:29.573267+0000","last_peered":"2024-03-30T12:40:29.573267+0000","last_clean":"2024-03-30T12:40:29.573267+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:40:29.573267+0000","last_undegraded":"2024-03-30T12:40:29.573267+0000","last_fullsized":"2024-03-30T12:40:29.573267+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1283,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666301+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:40:57.666301+0000","last_peered":"2024-03-30T12:40:57.666301+0000","last_clean":"2024-03-30T12:40:57.666301+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:40:57.666301+0000","last_undegraded":"2024-03-30T12:40:57.666301+0000","last_fullsized":"2024-03-30T12:40:57.666301+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:50.314509+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:39:50.314509+0000","last_peered":"2024-03-30T12:39:50.314509+0000","last_clean":"2024-03-30T12:39:50.314509+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:39:50.314509+0000","last_undegraded":"2024-03-30T12:39:50.314509+0000","last_fullsized":"2024-03-30T12:39:50.314509+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:27.669378+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:41:27.669378+0000","last_peered":"2024-03-30T12:41:27.669378+0000","last_clean":"2024-03-30T12:41:27.669378+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:41:27.669378+0000","last_undegraded":"2024-03-30T12:41:27.669378+0000","last_fullsized":"2024-03-30T12:41:27.669378+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1217,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.317602+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:40:15.317602+0000","last_peered":"2024-03-30T12:40:15.317602+0000","last_clean":"2024-03-30T12:40:15.317602+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:40:15.317602+0000","last_undegraded":"2024-03-30T12:40:15.317602+0000","last_fullsized":"2024-03-30T12:40:15.317602+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:45.883156+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:39:45.883156+0000","last_peered":"2024-03-30T12:39:45.883156+0000","last_clean":"2024-03-30T12:39:45.883156+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:39:45.883156+0000","last_undegraded":"2024-03-30T12:39:45.883156+0000","last_fullsized":"2024-03-30T12:39:45.883156+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:54.576179+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:40:54.576179+0000","last_peered":"2024-03-30T12:40:54.576179+0000","last_clean":"2024-03-30T12:40:54.576179+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:40:54.576179+0000","last_undegraded":"2024-03-30T12:40:54.576179+0000","last_fullsized":"2024-03-30T12:40:54.576179+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438114,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648170,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175181,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254419,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063238,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951295,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839352,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923634,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:43:51.356 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:51.356 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:51.356 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:51.356 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:51.357 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:51.357 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:51.357 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:51.357 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:51.357 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:51.357 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:51.357 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:51.357 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:51.357 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:43:51.357 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:43:51.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:51 smithi162 ceph-mon[83709]: from='client.34728 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:43:52.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:52 smithi162 ceph-mon[83709]: pgmap v1224: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:52.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:52 smithi084 ceph-mon[91810]: pgmap v1224: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:52.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:52 smithi084 ceph-mon[89279]: pgmap v1224: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:54.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:54 smithi162 ceph-mon[83709]: pgmap v1225: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:54.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:54 smithi084 ceph-mon[89279]: pgmap v1225: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:54.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:54 smithi084 ceph-mon[91810]: pgmap v1225: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:56.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:56 smithi162 ceph-mon[83709]: pgmap v1226: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:56.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:56 smithi084 ceph-mon[89279]: pgmap v1226: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:56.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:56 smithi084 ceph-mon[91810]: pgmap v1226: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:58.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:43:58 smithi162 ceph-mon[83709]: pgmap v1227: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:58.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:43:58 smithi084 ceph-mon[91810]: pgmap v1227: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:58.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:43:58 smithi084 ceph-mon[89279]: pgmap v1227: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:43:59.755 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:43:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:43:59] "GET /metrics HTTP/1.1" 200 36325 "" "Prometheus/2.43.0" 2024-03-30T12:44:00.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:00 smithi162 ceph-mon[83709]: pgmap v1228: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:00.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:00 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:44:00.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:00 smithi084 ceph-mon[89279]: pgmap v1228: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:00.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:00 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:44:00.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:00 smithi084 ceph-mon[91810]: pgmap v1228: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:00.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:00 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:44:01.358 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:44:01.597 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:44:02.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:02 smithi162 ceph-mon[83709]: pgmap v1229: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:02.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:02 smithi084 ceph-mon[91810]: pgmap v1229: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:02.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:02 smithi084 ceph-mon[89279]: pgmap v1229: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:03.524 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:44:03.527 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:44:04.215 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:04 smithi084 ceph-mon[91810]: pgmap v1230: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:04.216 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:04 smithi084 ceph-mon[91810]: from='client.34734 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:44:04.216 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:04 smithi084 ceph-mon[89279]: pgmap v1230: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:04.216 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:04 smithi084 ceph-mon[89279]: from='client.34734 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:44:04.238 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1230,"stamp":"2024-03-30T12:44:02.953459+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004338"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:44.153566+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:40:44.153566+0000","last_peered":"2024-03-30T12:40:44.153566+0000","last_clean":"2024-03-30T12:40:44.153566+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:40:44.153566+0000","last_undegraded":"2024-03-30T12:40:44.153566+0000","last_fullsized":"2024-03-30T12:40:44.153566+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1366,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931469+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:41:23.931469+0000","last_peered":"2024-03-30T12:41:23.931469+0000","last_clean":"2024-03-30T12:41:23.931469+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:41:23.931469+0000","last_undegraded":"2024-03-30T12:41:23.931469+0000","last_fullsized":"2024-03-30T12:41:23.931469+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889238+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:40:50.889238+0000","last_peered":"2024-03-30T12:40:50.889238+0000","last_clean":"2024-03-30T12:40:50.889238+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:40:50.889238+0000","last_undegraded":"2024-03-30T12:40:50.889238+0000","last_fullsized":"2024-03-30T12:40:50.889238+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:00.322650+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:41:00.322650+0000","last_peered":"2024-03-30T12:41:00.322650+0000","last_clean":"2024-03-30T12:41:00.322650+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:41:00.322650+0000","last_undegraded":"2024-03-30T12:41:00.322650+0000","last_fullsized":"2024-03-30T12:41:00.322650+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150593+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:40:19.150593+0000","last_peered":"2024-03-30T12:40:19.150593+0000","last_clean":"2024-03-30T12:40:19.150593+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:40:19.150593+0000","last_undegraded":"2024-03-30T12:40:19.150593+0000","last_fullsized":"2024-03-30T12:40:19.150593+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326493+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:41:30.326493+0000","last_peered":"2024-03-30T12:41:30.326493+0000","last_clean":"2024-03-30T12:41:30.326493+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:41:30.326493+0000","last_undegraded":"2024-03-30T12:41:30.326493+0000","last_fullsized":"2024-03-30T12:41:30.326493+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150576+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:40:19.150576+0000","last_peered":"2024-03-30T12:40:19.150576+0000","last_clean":"2024-03-30T12:40:19.150576+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:40:19.150576+0000","last_undegraded":"2024-03-30T12:40:19.150576+0000","last_fullsized":"2024-03-30T12:40:19.150576+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662744+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:40:27.662744+0000","last_peered":"2024-03-30T12:40:27.662744+0000","last_clean":"2024-03-30T12:40:27.662744+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:40:27.662744+0000","last_undegraded":"2024-03-30T12:40:27.662744+0000","last_fullsized":"2024-03-30T12:40:27.662744+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:59.148225+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:39:59.148225+0000","last_peered":"2024-03-30T12:39:59.148225+0000","last_clean":"2024-03-30T12:39:59.148225+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:39:59.148225+0000","last_undegraded":"2024-03-30T12:39:59.148225+0000","last_fullsized":"2024-03-30T12:39:59.148225+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565540+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:39:19.565540+0000","last_peered":"2024-03-30T12:39:19.565540+0000","last_clean":"2024-03-30T12:39:19.565540+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:39:19.565540+0000","last_undegraded":"2024-03-30T12:39:19.565540+0000","last_fullsized":"2024-03-30T12:39:19.565540+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1170,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565513+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:39:19.565513+0000","last_peered":"2024-03-30T12:39:19.565513+0000","last_clean":"2024-03-30T12:39:19.565513+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:39:19.565513+0000","last_undegraded":"2024-03-30T12:39:19.565513+0000","last_fullsized":"2024-03-30T12:39:19.565513+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1272,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:37.299828+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:40:37.299828+0000","last_peered":"2024-03-30T12:40:37.299828+0000","last_clean":"2024-03-30T12:40:37.299828+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:40:37.299828+0000","last_undegraded":"2024-03-30T12:40:37.299828+0000","last_fullsized":"2024-03-30T12:40:37.299828+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660090+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:40:02.660090+0000","last_peered":"2024-03-30T12:40:02.660090+0000","last_clean":"2024-03-30T12:40:02.660090+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:40:02.660090+0000","last_undegraded":"2024-03-30T12:40:02.660090+0000","last_fullsized":"2024-03-30T12:40:02.660090+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886008+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:40:15.886008+0000","last_peered":"2024-03-30T12:40:15.886008+0000","last_clean":"2024-03-30T12:40:15.886008+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:40:15.886008+0000","last_undegraded":"2024-03-30T12:40:15.886008+0000","last_fullsized":"2024-03-30T12:40:15.886008+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:48.927583+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:40:48.927583+0000","last_peered":"2024-03-30T12:40:48.927583+0000","last_clean":"2024-03-30T12:40:48.927583+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:40:48.927583+0000","last_undegraded":"2024-03-30T12:40:48.927583+0000","last_fullsized":"2024-03-30T12:40:48.927583+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320117+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:40:40.320117+0000","last_peered":"2024-03-30T12:40:40.320117+0000","last_clean":"2024-03-30T12:40:40.320117+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:40:40.320117+0000","last_undegraded":"2024-03-30T12:40:40.320117+0000","last_fullsized":"2024-03-30T12:40:40.320117+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1226,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320196+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:40:40.320196+0000","last_peered":"2024-03-30T12:40:40.320196+0000","last_clean":"2024-03-30T12:40:40.320196+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:40:40.320196+0000","last_undegraded":"2024-03-30T12:40:40.320196+0000","last_fullsized":"2024-03-30T12:40:40.320196+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.403697+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:41:23.403697+0000","last_peered":"2024-03-30T12:41:23.403697+0000","last_clean":"2024-03-30T12:41:23.403697+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:41:23.403697+0000","last_undegraded":"2024-03-30T12:41:23.403697+0000","last_fullsized":"2024-03-30T12:41:23.403697+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159632+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:41:34.159632+0000","last_peered":"2024-03-30T12:41:34.159632+0000","last_clean":"2024-03-30T12:41:34.159632+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:41:34.159632+0000","last_undegraded":"2024-03-30T12:41:34.159632+0000","last_fullsized":"2024-03-30T12:41:34.159632+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1390,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889293+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:40:50.889293+0000","last_peered":"2024-03-30T12:40:50.889293+0000","last_clean":"2024-03-30T12:40:50.889293+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:40:50.889293+0000","last_undegraded":"2024-03-30T12:40:50.889293+0000","last_fullsized":"2024-03-30T12:40:50.889293+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1285,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672522+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:41:57.672522+0000","last_peered":"2024-03-30T12:41:57.672522+0000","last_clean":"2024-03-30T12:41:57.672522+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:41:57.672522+0000","last_undegraded":"2024-03-30T12:41:57.672522+0000","last_fullsized":"2024-03-30T12:41:57.672522+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1304,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672534+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:41:57.672534+0000","last_peered":"2024-03-30T12:41:57.672534+0000","last_clean":"2024-03-30T12:41:57.672534+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:41:57.672534+0000","last_undegraded":"2024-03-30T12:41:57.672534+0000","last_fullsized":"2024-03-30T12:41:57.672534+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889279+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:40:50.889279+0000","last_peered":"2024-03-30T12:40:50.889279+0000","last_clean":"2024-03-30T12:40:50.889279+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:40:50.889279+0000","last_undegraded":"2024-03-30T12:40:50.889279+0000","last_fullsized":"2024-03-30T12:40:50.889279+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150628+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:40:19.150628+0000","last_peered":"2024-03-30T12:40:19.150628+0000","last_clean":"2024-03-30T12:40:19.150628+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:40:19.150628+0000","last_undegraded":"2024-03-30T12:40:19.150628+0000","last_fullsized":"2024-03-30T12:40:19.150628+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326512+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:41:30.326512+0000","last_peered":"2024-03-30T12:41:30.326512+0000","last_clean":"2024-03-30T12:41:30.326512+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:41:30.326512+0000","last_undegraded":"2024-03-30T12:41:30.326512+0000","last_fullsized":"2024-03-30T12:41:30.326512+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150608+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:40:19.150608+0000","last_peered":"2024-03-30T12:40:19.150608+0000","last_clean":"2024-03-30T12:40:19.150608+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:40:19.150608+0000","last_undegraded":"2024-03-30T12:40:19.150608+0000","last_fullsized":"2024-03-30T12:40:19.150608+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326527+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:41:30.326527+0000","last_peered":"2024-03-30T12:41:30.326527+0000","last_clean":"2024-03-30T12:41:30.326527+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:41:30.326527+0000","last_undegraded":"2024-03-30T12:41:30.326527+0000","last_fullsized":"2024-03-30T12:41:30.326527+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1263,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662819+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:40:27.662819+0000","last_peered":"2024-03-30T12:40:27.662819+0000","last_clean":"2024-03-30T12:40:27.662819+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:40:27.662819+0000","last_undegraded":"2024-03-30T12:40:27.662819+0000","last_fullsized":"2024-03-30T12:40:27.662819+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1264,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302503+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:41:02.302503+0000","last_peered":"2024-03-30T12:41:02.302503+0000","last_clean":"2024-03-30T12:41:02.302503+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:41:02.302503+0000","last_undegraded":"2024-03-30T12:41:02.302503+0000","last_fullsized":"2024-03-30T12:41:02.302503+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1181,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.567808+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:39:39.567808+0000","last_peered":"2024-03-30T12:39:39.567808+0000","last_clean":"2024-03-30T12:39:39.567808+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:39:39.567808+0000","last_undegraded":"2024-03-30T12:39:39.567808+0000","last_fullsized":"2024-03-30T12:39:39.567808+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:15.763333+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:41:15.763333+0000","last_peered":"2024-03-30T12:41:15.763333+0000","last_clean":"2024-03-30T12:41:15.763333+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:41:15.763333+0000","last_undegraded":"2024-03-30T12:41:15.763333+0000","last_fullsized":"2024-03-30T12:41:15.763333+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660073+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:40:02.660073+0000","last_peered":"2024-03-30T12:40:02.660073+0000","last_clean":"2024-03-30T12:40:02.660073+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:40:02.660073+0000","last_undegraded":"2024-03-30T12:40:02.660073+0000","last_fullsized":"2024-03-30T12:40:02.660073+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660041+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:40:02.660041+0000","last_peered":"2024-03-30T12:40:02.660041+0000","last_clean":"2024-03-30T12:40:02.660041+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:40:02.660041+0000","last_undegraded":"2024-03-30T12:40:02.660041+0000","last_fullsized":"2024-03-30T12:40:02.660041+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1226,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323325+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:41:05.323325+0000","last_peered":"2024-03-30T12:41:05.323325+0000","last_clean":"2024-03-30T12:41:05.323325+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:41:05.323325+0000","last_undegraded":"2024-03-30T12:41:05.323325+0000","last_fullsized":"2024-03-30T12:41:05.323325+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:18.930743+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:41:18.930743+0000","last_peered":"2024-03-30T12:41:18.930743+0000","last_clean":"2024-03-30T12:41:18.930743+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:41:18.930743+0000","last_undegraded":"2024-03-30T12:41:18.930743+0000","last_fullsized":"2024-03-30T12:41:18.930743+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:19.565553+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:39:19.565553+0000","last_peered":"2024-03-30T12:39:19.565553+0000","last_clean":"2024-03-30T12:39:19.565553+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:39:19.565553+0000","last_undegraded":"2024-03-30T12:39:19.565553+0000","last_fullsized":"2024-03-30T12:39:19.565553+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323382+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:41:05.323382+0000","last_peered":"2024-03-30T12:41:05.323382+0000","last_clean":"2024-03-30T12:41:05.323382+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:41:05.323382+0000","last_undegraded":"2024-03-30T12:41:05.323382+0000","last_fullsized":"2024-03-30T12:41:05.323382+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1200,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323370+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:41:05.323370+0000","last_peered":"2024-03-30T12:41:05.323370+0000","last_clean":"2024-03-30T12:41:05.323370+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:41:05.323370+0000","last_undegraded":"2024-03-30T12:41:05.323370+0000","last_fullsized":"2024-03-30T12:41:05.323370+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1292,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:28.391470+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:39:28.391470+0000","last_peered":"2024-03-30T12:39:28.391470+0000","last_clean":"2024-03-30T12:39:28.391470+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:39:28.391470+0000","last_undegraded":"2024-03-30T12:39:28.391470+0000","last_fullsized":"2024-03-30T12:39:28.391470+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:18.930787+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:41:18.930787+0000","last_peered":"2024-03-30T12:41:18.930787+0000","last_clean":"2024-03-30T12:41:18.930787+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:41:18.930787+0000","last_undegraded":"2024-03-30T12:41:18.930787+0000","last_fullsized":"2024-03-30T12:41:18.930787+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:12.297292+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:40:12.297292+0000","last_peered":"2024-03-30T12:40:12.297292+0000","last_clean":"2024-03-30T12:40:12.297292+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:40:12.297292+0000","last_undegraded":"2024-03-30T12:40:12.297292+0000","last_fullsized":"2024-03-30T12:40:12.297292+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1207,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579099+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:41:19.579099+0000","last_peered":"2024-03-30T12:41:19.579099+0000","last_clean":"2024-03-30T12:41:19.579099+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:41:19.579099+0000","last_undegraded":"2024-03-30T12:41:19.579099+0000","last_fullsized":"2024-03-30T12:41:19.579099+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:59.148189+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:39:59.148189+0000","last_peered":"2024-03-30T12:39:59.148189+0000","last_clean":"2024-03-30T12:39:59.148189+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:39:59.148189+0000","last_undegraded":"2024-03-30T12:39:59.148189+0000","last_fullsized":"2024-03-30T12:39:59.148189+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1385,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886047+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:40:15.886047+0000","last_peered":"2024-03-30T12:40:15.886047+0000","last_clean":"2024-03-30T12:40:15.886047+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:40:15.886047+0000","last_undegraded":"2024-03-30T12:40:15.886047+0000","last_fullsized":"2024-03-30T12:40:15.886047+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886029+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:40:15.886029+0000","last_peered":"2024-03-30T12:40:15.886029+0000","last_clean":"2024-03-30T12:40:15.886029+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:40:15.886029+0000","last_undegraded":"2024-03-30T12:40:15.886029+0000","last_fullsized":"2024-03-30T12:40:15.886029+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320162+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:40:40.320162+0000","last_peered":"2024-03-30T12:40:40.320162+0000","last_clean":"2024-03-30T12:40:40.320162+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:40:40.320162+0000","last_undegraded":"2024-03-30T12:40:40.320162+0000","last_fullsized":"2024-03-30T12:40:40.320162+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.145725+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:39:39.145725+0000","last_peered":"2024-03-30T12:39:39.145725+0000","last_clean":"2024-03-30T12:39:39.145725+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:39:39.145725+0000","last_undegraded":"2024-03-30T12:39:39.145725+0000","last_fullsized":"2024-03-30T12:39:39.145725+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1186,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579076+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:41:19.579076+0000","last_peered":"2024-03-30T12:41:19.579076+0000","last_clean":"2024-03-30T12:41:19.579076+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:41:19.579076+0000","last_undegraded":"2024-03-30T12:41:19.579076+0000","last_fullsized":"2024-03-30T12:41:19.579076+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579050+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:41:19.579050+0000","last_peered":"2024-03-30T12:41:19.579050+0000","last_clean":"2024-03-30T12:41:19.579050+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:41:19.579050+0000","last_undegraded":"2024-03-30T12:41:19.579050+0000","last_fullsized":"2024-03-30T12:41:19.579050+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1346,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.403657+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:41:23.403657+0000","last_peered":"2024-03-30T12:41:23.403657+0000","last_clean":"2024-03-30T12:41:23.403657+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:41:23.403657+0000","last_undegraded":"2024-03-30T12:41:23.403657+0000","last_fullsized":"2024-03-30T12:41:23.403657+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.145661+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:39:39.145661+0000","last_peered":"2024-03-30T12:39:39.145661+0000","last_clean":"2024-03-30T12:39:39.145661+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:39:39.145661+0000","last_undegraded":"2024-03-30T12:39:39.145661+0000","last_fullsized":"2024-03-30T12:39:39.145661+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5754,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:23.397042+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:40:23.397042+0000","last_peered":"2024-03-30T12:40:23.397042+0000","last_clean":"2024-03-30T12:40:23.397042+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:40:23.397042+0000","last_undegraded":"2024-03-30T12:40:23.397042+0000","last_fullsized":"2024-03-30T12:40:23.397042+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1276,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:47.295052+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:39:47.295052+0000","last_peered":"2024-03-30T12:39:47.295052+0000","last_clean":"2024-03-30T12:39:47.295052+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:39:47.295052+0000","last_undegraded":"2024-03-30T12:39:47.295052+0000","last_fullsized":"2024-03-30T12:39:47.295052+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159642+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:41:34.159642+0000","last_peered":"2024-03-30T12:41:34.159642+0000","last_clean":"2024-03-30T12:41:34.159642+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:41:34.159642+0000","last_undegraded":"2024-03-30T12:41:34.159642+0000","last_fullsized":"2024-03-30T12:41:34.159642+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5515,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:50.889213+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:40:50.889213+0000","last_peered":"2024-03-30T12:40:50.889213+0000","last_clean":"2024-03-30T12:40:50.889213+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:40:50.889213+0000","last_undegraded":"2024-03-30T12:40:50.889213+0000","last_fullsized":"2024-03-30T12:40:50.889213+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931401+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:41:23.931401+0000","last_peered":"2024-03-30T12:41:23.931401+0000","last_clean":"2024-03-30T12:41:23.931401+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:41:23.931401+0000","last_undegraded":"2024-03-30T12:41:23.931401+0000","last_fullsized":"2024-03-30T12:41:23.931401+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931427+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:41:23.931427+0000","last_peered":"2024-03-30T12:41:23.931427+0000","last_clean":"2024-03-30T12:41:23.931427+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:41:23.931427+0000","last_undegraded":"2024-03-30T12:41:23.931427+0000","last_fullsized":"2024-03-30T12:41:23.931427+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326520+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:41:30.326520+0000","last_peered":"2024-03-30T12:41:30.326520+0000","last_clean":"2024-03-30T12:41:30.326520+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:41:30.326520+0000","last_undegraded":"2024-03-30T12:41:30.326520+0000","last_fullsized":"2024-03-30T12:41:30.326520+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5460,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:50.889251+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:40:50.889251+0000","last_peered":"2024-03-30T12:40:50.889251+0000","last_clean":"2024-03-30T12:40:50.889251+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:40:50.889251+0000","last_undegraded":"2024-03-30T12:40:50.889251+0000","last_fullsized":"2024-03-30T12:40:50.889251+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931438+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:41:23.931438+0000","last_peered":"2024-03-30T12:41:23.931438+0000","last_clean":"2024-03-30T12:41:23.931438+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:41:23.931438+0000","last_undegraded":"2024-03-30T12:41:23.931438+0000","last_fullsized":"2024-03-30T12:41:23.931438+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1209,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326461+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:41:30.326461+0000","last_peered":"2024-03-30T12:41:30.326461+0000","last_clean":"2024-03-30T12:41:30.326461+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:41:30.326461+0000","last_undegraded":"2024-03-30T12:41:30.326461+0000","last_fullsized":"2024-03-30T12:41:30.326461+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302515+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:41:02.302515+0000","last_peered":"2024-03-30T12:41:02.302515+0000","last_clean":"2024-03-30T12:41:02.302515+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:41:02.302515+0000","last_undegraded":"2024-03-30T12:41:02.302515+0000","last_fullsized":"2024-03-30T12:41:02.302515+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3805,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:23.397156+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:40:23.397156+0000","last_peered":"2024-03-30T12:40:23.397156+0000","last_clean":"2024-03-30T12:40:23.397156+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:40:23.397156+0000","last_undegraded":"2024-03-30T12:40:23.397156+0000","last_fullsized":"2024-03-30T12:40:23.397156+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1344,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920990+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:39:48.920990+0000","last_peered":"2024-03-30T12:39:48.920990+0000","last_clean":"2024-03-30T12:39:48.920990+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:39:48.920990+0000","last_undegraded":"2024-03-30T12:39:48.920990+0000","last_fullsized":"2024-03-30T12:39:48.920990+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:48.927559+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:40:48.927559+0000","last_peered":"2024-03-30T12:40:48.927559+0000","last_clean":"2024-03-30T12:40:48.927559+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:40:48.927559+0000","last_undegraded":"2024-03-30T12:40:48.927559+0000","last_fullsized":"2024-03-30T12:40:48.927559+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:53.394025+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:39:53.394025+0000","last_peered":"2024-03-30T12:39:53.394025+0000","last_clean":"2024-03-30T12:39:53.394025+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:39:53.394025+0000","last_undegraded":"2024-03-30T12:39:53.394025+0000","last_fullsized":"2024-03-30T12:39:53.394025+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4578,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:44.153464+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:40:44.153464+0000","last_peered":"2024-03-30T12:40:44.153464+0000","last_clean":"2024-03-30T12:40:44.153464+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:40:44.153464+0000","last_undegraded":"2024-03-30T12:40:44.153464+0000","last_fullsized":"2024-03-30T12:40:44.153464+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1176,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:04.570573+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:40:04.570573+0000","last_peered":"2024-03-30T12:40:04.570573+0000","last_clean":"2024-03-30T12:40:04.570573+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:40:04.570573+0000","last_undegraded":"2024-03-30T12:40:04.570573+0000","last_fullsized":"2024-03-30T12:40:04.570573+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662799+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:40:27.662799+0000","last_peered":"2024-03-30T12:40:27.662799+0000","last_clean":"2024-03-30T12:40:27.662799+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:40:27.662799+0000","last_undegraded":"2024-03-30T12:40:27.662799+0000","last_fullsized":"2024-03-30T12:40:27.662799+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1202,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326500+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:41:30.326500+0000","last_peered":"2024-03-30T12:41:30.326500+0000","last_clean":"2024-03-30T12:41:30.326500+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:41:30.326500+0000","last_undegraded":"2024-03-30T12:41:30.326500+0000","last_fullsized":"2024-03-30T12:41:30.326500+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1718,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150538+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:40:19.150538+0000","last_peered":"2024-03-30T12:40:19.150538+0000","last_clean":"2024-03-30T12:40:19.150538+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:40:19.150538+0000","last_undegraded":"2024-03-30T12:40:19.150538+0000","last_fullsized":"2024-03-30T12:40:19.150538+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24715,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:39:50.314565+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:39:50.314565+0000","last_peered":"2024-03-30T12:39:50.314565+0000","last_clean":"2024-03-30T12:39:50.314565+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:39:50.314565+0000","last_undegraded":"2024-03-30T12:39:50.314565+0000","last_fullsized":"2024-03-30T12:39:50.314565+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:25.764684+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:41:25.764684+0000","last_peered":"2024-03-30T12:41:25.764684+0000","last_clean":"2024-03-30T12:41:25.764684+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:41:25.764684+0000","last_undegraded":"2024-03-30T12:41:25.764684+0000","last_fullsized":"2024-03-30T12:41:25.764684+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889177+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:40:50.889177+0000","last_peered":"2024-03-30T12:40:50.889177+0000","last_clean":"2024-03-30T12:40:50.889177+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:40:50.889177+0000","last_undegraded":"2024-03-30T12:40:50.889177+0000","last_fullsized":"2024-03-30T12:40:50.889177+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150500+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:40:19.150500+0000","last_peered":"2024-03-30T12:40:19.150500+0000","last_clean":"2024-03-30T12:40:19.150500+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:40:19.150500+0000","last_undegraded":"2024-03-30T12:40:19.150500+0000","last_fullsized":"2024-03-30T12:40:19.150500+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16482,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:04.570536+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:40:04.570536+0000","last_peered":"2024-03-30T12:40:04.570536+0000","last_clean":"2024-03-30T12:40:04.570536+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:40:04.570536+0000","last_undegraded":"2024-03-30T12:40:04.570536+0000","last_fullsized":"2024-03-30T12:40:04.570536+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889228+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:40:50.889228+0000","last_peered":"2024-03-30T12:40:50.889228+0000","last_clean":"2024-03-30T12:40:50.889228+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:40:50.889228+0000","last_undegraded":"2024-03-30T12:40:50.889228+0000","last_fullsized":"2024-03-30T12:40:50.889228+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1165,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:44.153535+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:40:44.153535+0000","last_peered":"2024-03-30T12:40:44.153535+0000","last_clean":"2024-03-30T12:40:44.153535+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:40:44.153535+0000","last_undegraded":"2024-03-30T12:40:44.153535+0000","last_fullsized":"2024-03-30T12:40:44.153535+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931449+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:41:23.931449+0000","last_peered":"2024-03-30T12:41:23.931449+0000","last_clean":"2024-03-30T12:41:23.931449+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:41:23.931449+0000","last_undegraded":"2024-03-30T12:41:23.931449+0000","last_fullsized":"2024-03-30T12:41:23.931449+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31271,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:41:02.302474+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:41:02.302474+0000","last_peered":"2024-03-30T12:41:02.302474+0000","last_clean":"2024-03-30T12:41:02.302474+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:41:02.302474+0000","last_undegraded":"2024-03-30T12:41:02.302474+0000","last_fullsized":"2024-03-30T12:41:02.302474+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672495+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:41:57.672495+0000","last_peered":"2024-03-30T12:41:57.672495+0000","last_clean":"2024-03-30T12:41:57.672495+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:41:57.672495+0000","last_undegraded":"2024-03-30T12:41:57.672495+0000","last_fullsized":"2024-03-30T12:41:57.672495+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1355,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920979+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:39:48.920979+0000","last_peered":"2024-03-30T12:39:48.920979+0000","last_clean":"2024-03-30T12:39:48.920979+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:39:48.920979+0000","last_undegraded":"2024-03-30T12:39:48.920979+0000","last_fullsized":"2024-03-30T12:39:48.920979+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666291+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:40:57.666291+0000","last_peered":"2024-03-30T12:40:57.666291+0000","last_clean":"2024-03-30T12:40:57.666291+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:40:57.666291+0000","last_undegraded":"2024-03-30T12:40:57.666291+0000","last_fullsized":"2024-03-30T12:40:57.666291+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3767,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672462+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:41:57.672462+0000","last_peered":"2024-03-30T12:41:57.672462+0000","last_clean":"2024-03-30T12:41:57.672462+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:41:57.672462+0000","last_undegraded":"2024-03-30T12:41:57.672462+0000","last_fullsized":"2024-03-30T12:41:57.672462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302452+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:41:02.302452+0000","last_peered":"2024-03-30T12:41:02.302452+0000","last_clean":"2024-03-30T12:41:02.302452+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:41:02.302452+0000","last_undegraded":"2024-03-30T12:41:02.302452+0000","last_fullsized":"2024-03-30T12:41:02.302452+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1157,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573285+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:40:29.573285+0000","last_peered":"2024-03-30T12:40:29.573285+0000","last_clean":"2024-03-30T12:40:29.573285+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:40:29.573285+0000","last_undegraded":"2024-03-30T12:40:29.573285+0000","last_fullsized":"2024-03-30T12:40:29.573285+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:25.764656+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:41:25.764656+0000","last_peered":"2024-03-30T12:41:25.764656+0000","last_clean":"2024-03-30T12:41:25.764656+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:41:25.764656+0000","last_undegraded":"2024-03-30T12:41:25.764656+0000","last_fullsized":"2024-03-30T12:41:25.764656+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15595,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:15.317660+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:40:15.317660+0000","last_peered":"2024-03-30T12:40:15.317660+0000","last_clean":"2024-03-30T12:40:15.317660+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:40:15.317660+0000","last_undegraded":"2024-03-30T12:40:15.317660+0000","last_fullsized":"2024-03-30T12:40:15.317660+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:09.156570+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:41:09.156570+0000","last_peered":"2024-03-30T12:41:09.156570+0000","last_clean":"2024-03-30T12:41:09.156570+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:41:09.156570+0000","last_undegraded":"2024-03-30T12:41:09.156570+0000","last_fullsized":"2024-03-30T12:41:09.156570+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:32.306064+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:41:32.306064+0000","last_peered":"2024-03-30T12:41:32.306064+0000","last_clean":"2024-03-30T12:41:32.306064+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:41:32.306064+0000","last_undegraded":"2024-03-30T12:41:32.306064+0000","last_fullsized":"2024-03-30T12:41:32.306064+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29021,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:39:47.295005+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:39:47.295005+0000","last_peered":"2024-03-30T12:39:47.295005+0000","last_clean":"2024-03-30T12:39:47.295005+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:39:47.295005+0000","last_undegraded":"2024-03-30T12:39:47.295005+0000","last_fullsized":"2024-03-30T12:39:47.295005+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920913+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:39:48.920913+0000","last_peered":"2024-03-30T12:39:48.920913+0000","last_clean":"2024-03-30T12:39:48.920913+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:39:48.920913+0000","last_undegraded":"2024-03-30T12:39:48.920913+0000","last_fullsized":"2024-03-30T12:39:48.920913+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666241+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:40:57.666241+0000","last_peered":"2024-03-30T12:40:57.666241+0000","last_clean":"2024-03-30T12:40:57.666241+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:40:57.666241+0000","last_undegraded":"2024-03-30T12:40:57.666241+0000","last_fullsized":"2024-03-30T12:40:57.666241+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5612,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:53.400722+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:40:53.400722+0000","last_peered":"2024-03-30T12:40:53.400722+0000","last_clean":"2024-03-30T12:40:53.400722+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:40:53.400722+0000","last_undegraded":"2024-03-30T12:40:53.400722+0000","last_fullsized":"2024-03-30T12:40:53.400722+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1366,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920941+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:39:48.920941+0000","last_peered":"2024-03-30T12:39:48.920941+0000","last_clean":"2024-03-30T12:39:48.920941+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:39:48.920941+0000","last_undegraded":"2024-03-30T12:39:48.920941+0000","last_fullsized":"2024-03-30T12:39:48.920941+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:27.669397+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:41:27.669397+0000","last_peered":"2024-03-30T12:41:27.669397+0000","last_clean":"2024-03-30T12:41:27.669397+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:41:27.669397+0000","last_undegraded":"2024-03-30T12:41:27.669397+0000","last_fullsized":"2024-03-30T12:41:27.669397+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4276,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:18.924042+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:40:18.924042+0000","last_peered":"2024-03-30T12:40:18.924042+0000","last_clean":"2024-03-30T12:40:18.924042+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:40:18.924042+0000","last_undegraded":"2024-03-30T12:40:18.924042+0000","last_fullsized":"2024-03-30T12:40:18.924042+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1156,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159584+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:41:34.159584+0000","last_peered":"2024-03-30T12:41:34.159584+0000","last_clean":"2024-03-30T12:41:34.159584+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:41:34.159584+0000","last_undegraded":"2024-03-30T12:41:34.159584+0000","last_fullsized":"2024-03-30T12:41:34.159584+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573205+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:40:29.573205+0000","last_peered":"2024-03-30T12:40:29.573205+0000","last_clean":"2024-03-30T12:40:29.573205+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:40:29.573205+0000","last_undegraded":"2024-03-30T12:40:29.573205+0000","last_fullsized":"2024-03-30T12:40:29.573205+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5255,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:53.400674+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:40:53.400674+0000","last_peered":"2024-03-30T12:40:53.400674+0000","last_clean":"2024-03-30T12:40:53.400674+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:40:53.400674+0000","last_undegraded":"2024-03-30T12:40:53.400674+0000","last_fullsized":"2024-03-30T12:40:53.400674+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:53.400708+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:40:53.400708+0000","last_peered":"2024-03-30T12:40:53.400708+0000","last_clean":"2024-03-30T12:40:53.400708+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:40:53.400708+0000","last_undegraded":"2024-03-30T12:40:53.400708+0000","last_fullsized":"2024-03-30T12:40:53.400708+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159619+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:41:34.159619+0000","last_peered":"2024-03-30T12:41:34.159619+0000","last_clean":"2024-03-30T12:41:34.159619+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:41:34.159619+0000","last_undegraded":"2024-03-30T12:41:34.159619+0000","last_fullsized":"2024-03-30T12:41:34.159619+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4812,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:23.397123+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:40:23.397123+0000","last_peered":"2024-03-30T12:40:23.397123+0000","last_clean":"2024-03-30T12:40:23.397123+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:40:23.397123+0000","last_undegraded":"2024-03-30T12:40:23.397123+0000","last_fullsized":"2024-03-30T12:40:23.397123+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:18.924078+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:40:18.924078+0000","last_peered":"2024-03-30T12:40:18.924078+0000","last_clean":"2024-03-30T12:40:18.924078+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:40:18.924078+0000","last_undegraded":"2024-03-30T12:40:18.924078+0000","last_fullsized":"2024-03-30T12:40:18.924078+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.317641+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:40:15.317641+0000","last_peered":"2024-03-30T12:40:15.317641+0000","last_clean":"2024-03-30T12:40:15.317641+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:40:15.317641+0000","last_undegraded":"2024-03-30T12:40:15.317641+0000","last_fullsized":"2024-03-30T12:40:15.317641+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6745,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:41:09.156602+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:41:09.156602+0000","last_peered":"2024-03-30T12:41:09.156602+0000","last_clean":"2024-03-30T12:41:09.156602+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:41:09.156602+0000","last_undegraded":"2024-03-30T12:41:09.156602+0000","last_fullsized":"2024-03-30T12:41:09.156602+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1339,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:53.400753+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:40:53.400753+0000","last_peered":"2024-03-30T12:40:53.400753+0000","last_clean":"2024-03-30T12:40:53.400753+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:40:53.400753+0000","last_undegraded":"2024-03-30T12:40:53.400753+0000","last_fullsized":"2024-03-30T12:40:53.400753+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159657+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:41:34.159657+0000","last_peered":"2024-03-30T12:41:34.159657+0000","last_clean":"2024-03-30T12:41:34.159657+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:41:34.159657+0000","last_undegraded":"2024-03-30T12:41:34.159657+0000","last_fullsized":"2024-03-30T12:41:34.159657+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:04.570502+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:40:04.570502+0000","last_peered":"2024-03-30T12:40:04.570502+0000","last_clean":"2024-03-30T12:40:04.570502+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:40:04.570502+0000","last_undegraded":"2024-03-30T12:40:04.570502+0000","last_fullsized":"2024-03-30T12:40:04.570502+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:53.394048+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:39:53.394048+0000","last_peered":"2024-03-30T12:39:53.394048+0000","last_clean":"2024-03-30T12:39:53.394048+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:39:53.394048+0000","last_undegraded":"2024-03-30T12:39:53.394048+0000","last_fullsized":"2024-03-30T12:39:53.394048+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326484+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:41:30.326484+0000","last_peered":"2024-03-30T12:41:30.326484+0000","last_clean":"2024-03-30T12:41:30.326484+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:41:30.326484+0000","last_undegraded":"2024-03-30T12:41:30.326484+0000","last_fullsized":"2024-03-30T12:41:30.326484+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889204+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:40:50.889204+0000","last_peered":"2024-03-30T12:40:50.889204+0000","last_clean":"2024-03-30T12:40:50.889204+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:40:50.889204+0000","last_undegraded":"2024-03-30T12:40:50.889204+0000","last_fullsized":"2024-03-30T12:40:50.889204+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666276+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:40:57.666276+0000","last_peered":"2024-03-30T12:40:57.666276+0000","last_clean":"2024-03-30T12:40:57.666276+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:40:57.666276+0000","last_undegraded":"2024-03-30T12:40:57.666276+0000","last_fullsized":"2024-03-30T12:40:57.666276+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:48.920964+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:39:48.920964+0000","last_peered":"2024-03-30T12:39:48.920964+0000","last_clean":"2024-03-30T12:39:48.920964+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:39:48.920964+0000","last_undegraded":"2024-03-30T12:39:48.920964+0000","last_fullsized":"2024-03-30T12:39:48.920964+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1179,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573267+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:40:29.573267+0000","last_peered":"2024-03-30T12:40:29.573267+0000","last_clean":"2024-03-30T12:40:29.573267+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:40:29.573267+0000","last_undegraded":"2024-03-30T12:40:29.573267+0000","last_fullsized":"2024-03-30T12:40:29.573267+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1283,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666301+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:40:57.666301+0000","last_peered":"2024-03-30T12:40:57.666301+0000","last_clean":"2024-03-30T12:40:57.666301+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:40:57.666301+0000","last_undegraded":"2024-03-30T12:40:57.666301+0000","last_fullsized":"2024-03-30T12:40:57.666301+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:50.314509+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:39:50.314509+0000","last_peered":"2024-03-30T12:39:50.314509+0000","last_clean":"2024-03-30T12:39:50.314509+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:39:50.314509+0000","last_undegraded":"2024-03-30T12:39:50.314509+0000","last_fullsized":"2024-03-30T12:39:50.314509+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:27.669378+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:41:27.669378+0000","last_peered":"2024-03-30T12:41:27.669378+0000","last_clean":"2024-03-30T12:41:27.669378+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:41:27.669378+0000","last_undegraded":"2024-03-30T12:41:27.669378+0000","last_fullsized":"2024-03-30T12:41:27.669378+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1217,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.317602+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:40:15.317602+0000","last_peered":"2024-03-30T12:40:15.317602+0000","last_clean":"2024-03-30T12:40:15.317602+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:40:15.317602+0000","last_undegraded":"2024-03-30T12:40:15.317602+0000","last_fullsized":"2024-03-30T12:40:15.317602+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:45.883156+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:39:45.883156+0000","last_peered":"2024-03-30T12:39:45.883156+0000","last_clean":"2024-03-30T12:39:45.883156+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:39:45.883156+0000","last_undegraded":"2024-03-30T12:39:45.883156+0000","last_fullsized":"2024-03-30T12:39:45.883156+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:54.576179+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:40:54.576179+0000","last_peered":"2024-03-30T12:40:54.576179+0000","last_clean":"2024-03-30T12:40:54.576179+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:40:54.576179+0000","last_undegraded":"2024-03-30T12:40:54.576179+0000","last_fullsized":"2024-03-30T12:40:54.576179+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438117,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648173,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175183,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254422,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063240,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951298,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839355,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923637,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:44:04.244 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:04.244 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:04.244 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:04.244 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:04.244 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:04.244 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:04.244 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:04.244 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:04.244 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:04.244 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:04.244 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:04.244 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:04.244 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:04.245 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:44:04.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:04 smithi162 ceph-mon[83709]: pgmap v1230: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:04.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:04 smithi162 ceph-mon[83709]: from='client.34734 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:44:06.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:06 smithi162 ceph-mon[83709]: pgmap v1231: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:06.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:06 smithi084 ceph-mon[89279]: pgmap v1231: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:06.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:06 smithi084 ceph-mon[91810]: pgmap v1231: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:08.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:08 smithi162 ceph-mon[83709]: pgmap v1232: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:08.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:08 smithi084 ceph-mon[89279]: pgmap v1232: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:08.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:08 smithi084 ceph-mon[91810]: pgmap v1232: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:09.755 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:44:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:44:09] "GET /metrics HTTP/1.1" 200 36319 "" "Prometheus/2.43.0" 2024-03-30T12:44:10.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:10 smithi162 ceph-mon[83709]: pgmap v1233: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:10.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:10 smithi084 ceph-mon[89279]: pgmap v1233: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:10.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:10 smithi084 ceph-mon[91810]: pgmap v1233: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:12.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:12 smithi162 ceph-mon[83709]: pgmap v1234: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:12.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:12 smithi084 ceph-mon[89279]: pgmap v1234: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:12.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:12 smithi084 ceph-mon[91810]: pgmap v1234: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:14.246 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:44:14.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:14 smithi162 ceph-mon[83709]: pgmap v1235: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:14.464 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:44:14.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:14 smithi084 ceph-mon[91810]: pgmap v1235: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:14.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:14 smithi084 ceph-mon[89279]: pgmap v1235: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:15.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:15 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:44:15.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:15 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:44:15.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:15 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:44:16.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:16 smithi084 ceph-mon[91810]: pgmap v1236: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:16.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:16 smithi084 ceph-mon[89279]: pgmap v1236: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:16.327 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:44:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:44:16.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:16 smithi162 ceph-mon[83709]: pgmap v1236: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:16.965 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1236,"stamp":"2024-03-30T12:44:14.957556+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004096"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:44.153566+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:40:44.153566+0000","last_peered":"2024-03-30T12:40:44.153566+0000","last_clean":"2024-03-30T12:40:44.153566+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:40:44.153566+0000","last_undegraded":"2024-03-30T12:40:44.153566+0000","last_fullsized":"2024-03-30T12:40:44.153566+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1366,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931469+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:41:23.931469+0000","last_peered":"2024-03-30T12:41:23.931469+0000","last_clean":"2024-03-30T12:41:23.931469+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:41:23.931469+0000","last_undegraded":"2024-03-30T12:41:23.931469+0000","last_fullsized":"2024-03-30T12:41:23.931469+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889238+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:40:50.889238+0000","last_peered":"2024-03-30T12:40:50.889238+0000","last_clean":"2024-03-30T12:40:50.889238+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:40:50.889238+0000","last_undegraded":"2024-03-30T12:40:50.889238+0000","last_fullsized":"2024-03-30T12:40:50.889238+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:00.322650+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:41:00.322650+0000","last_peered":"2024-03-30T12:41:00.322650+0000","last_clean":"2024-03-30T12:41:00.322650+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:41:00.322650+0000","last_undegraded":"2024-03-30T12:41:00.322650+0000","last_fullsized":"2024-03-30T12:41:00.322650+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150593+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:40:19.150593+0000","last_peered":"2024-03-30T12:40:19.150593+0000","last_clean":"2024-03-30T12:40:19.150593+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:40:19.150593+0000","last_undegraded":"2024-03-30T12:40:19.150593+0000","last_fullsized":"2024-03-30T12:40:19.150593+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326493+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:41:30.326493+0000","last_peered":"2024-03-30T12:41:30.326493+0000","last_clean":"2024-03-30T12:41:30.326493+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:41:30.326493+0000","last_undegraded":"2024-03-30T12:41:30.326493+0000","last_fullsized":"2024-03-30T12:41:30.326493+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150576+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:40:19.150576+0000","last_peered":"2024-03-30T12:40:19.150576+0000","last_clean":"2024-03-30T12:40:19.150576+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:40:19.150576+0000","last_undegraded":"2024-03-30T12:40:19.150576+0000","last_fullsized":"2024-03-30T12:40:19.150576+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662744+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:40:27.662744+0000","last_peered":"2024-03-30T12:40:27.662744+0000","last_clean":"2024-03-30T12:40:27.662744+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:40:27.662744+0000","last_undegraded":"2024-03-30T12:40:27.662744+0000","last_fullsized":"2024-03-30T12:40:27.662744+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:59.148225+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:39:59.148225+0000","last_peered":"2024-03-30T12:39:59.148225+0000","last_clean":"2024-03-30T12:39:59.148225+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:39:59.148225+0000","last_undegraded":"2024-03-30T12:39:59.148225+0000","last_fullsized":"2024-03-30T12:39:59.148225+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581772+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:41:44.581772+0000","last_peered":"2024-03-30T12:41:44.581772+0000","last_clean":"2024-03-30T12:41:44.581772+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:41:44.581772+0000","last_undegraded":"2024-03-30T12:41:44.581772+0000","last_fullsized":"2024-03-30T12:41:44.581772+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581745+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:41:44.581745+0000","last_peered":"2024-03-30T12:41:44.581745+0000","last_clean":"2024-03-30T12:41:44.581745+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:41:44.581745+0000","last_undegraded":"2024-03-30T12:41:44.581745+0000","last_fullsized":"2024-03-30T12:41:44.581745+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1272,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:37.299828+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:40:37.299828+0000","last_peered":"2024-03-30T12:40:37.299828+0000","last_clean":"2024-03-30T12:40:37.299828+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:40:37.299828+0000","last_undegraded":"2024-03-30T12:40:37.299828+0000","last_fullsized":"2024-03-30T12:40:37.299828+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660090+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:40:02.660090+0000","last_peered":"2024-03-30T12:40:02.660090+0000","last_clean":"2024-03-30T12:40:02.660090+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:40:02.660090+0000","last_undegraded":"2024-03-30T12:40:02.660090+0000","last_fullsized":"2024-03-30T12:40:02.660090+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886008+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:40:15.886008+0000","last_peered":"2024-03-30T12:40:15.886008+0000","last_clean":"2024-03-30T12:40:15.886008+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:40:15.886008+0000","last_undegraded":"2024-03-30T12:40:15.886008+0000","last_fullsized":"2024-03-30T12:40:15.886008+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:48.927583+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:40:48.927583+0000","last_peered":"2024-03-30T12:40:48.927583+0000","last_clean":"2024-03-30T12:40:48.927583+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:40:48.927583+0000","last_undegraded":"2024-03-30T12:40:48.927583+0000","last_fullsized":"2024-03-30T12:40:48.927583+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320117+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:40:40.320117+0000","last_peered":"2024-03-30T12:40:40.320117+0000","last_clean":"2024-03-30T12:40:40.320117+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:40:40.320117+0000","last_undegraded":"2024-03-30T12:40:40.320117+0000","last_fullsized":"2024-03-30T12:40:40.320117+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1226,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320196+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:40:40.320196+0000","last_peered":"2024-03-30T12:40:40.320196+0000","last_clean":"2024-03-30T12:40:40.320196+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:40:40.320196+0000","last_undegraded":"2024-03-30T12:40:40.320196+0000","last_fullsized":"2024-03-30T12:40:40.320196+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.403697+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:41:23.403697+0000","last_peered":"2024-03-30T12:41:23.403697+0000","last_clean":"2024-03-30T12:41:23.403697+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:41:23.403697+0000","last_undegraded":"2024-03-30T12:41:23.403697+0000","last_fullsized":"2024-03-30T12:41:23.403697+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159632+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:41:34.159632+0000","last_peered":"2024-03-30T12:41:34.159632+0000","last_clean":"2024-03-30T12:41:34.159632+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:41:34.159632+0000","last_undegraded":"2024-03-30T12:41:34.159632+0000","last_fullsized":"2024-03-30T12:41:34.159632+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1390,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889293+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:40:50.889293+0000","last_peered":"2024-03-30T12:40:50.889293+0000","last_clean":"2024-03-30T12:40:50.889293+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:40:50.889293+0000","last_undegraded":"2024-03-30T12:40:50.889293+0000","last_fullsized":"2024-03-30T12:40:50.889293+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1285,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672522+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:41:57.672522+0000","last_peered":"2024-03-30T12:41:57.672522+0000","last_clean":"2024-03-30T12:41:57.672522+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:41:57.672522+0000","last_undegraded":"2024-03-30T12:41:57.672522+0000","last_fullsized":"2024-03-30T12:41:57.672522+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1304,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672534+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:41:57.672534+0000","last_peered":"2024-03-30T12:41:57.672534+0000","last_clean":"2024-03-30T12:41:57.672534+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:41:57.672534+0000","last_undegraded":"2024-03-30T12:41:57.672534+0000","last_fullsized":"2024-03-30T12:41:57.672534+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889279+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:40:50.889279+0000","last_peered":"2024-03-30T12:40:50.889279+0000","last_clean":"2024-03-30T12:40:50.889279+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:40:50.889279+0000","last_undegraded":"2024-03-30T12:40:50.889279+0000","last_fullsized":"2024-03-30T12:40:50.889279+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150628+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:40:19.150628+0000","last_peered":"2024-03-30T12:40:19.150628+0000","last_clean":"2024-03-30T12:40:19.150628+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:40:19.150628+0000","last_undegraded":"2024-03-30T12:40:19.150628+0000","last_fullsized":"2024-03-30T12:40:19.150628+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326512+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:41:30.326512+0000","last_peered":"2024-03-30T12:41:30.326512+0000","last_clean":"2024-03-30T12:41:30.326512+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:41:30.326512+0000","last_undegraded":"2024-03-30T12:41:30.326512+0000","last_fullsized":"2024-03-30T12:41:30.326512+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150608+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:40:19.150608+0000","last_peered":"2024-03-30T12:40:19.150608+0000","last_clean":"2024-03-30T12:40:19.150608+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:40:19.150608+0000","last_undegraded":"2024-03-30T12:40:19.150608+0000","last_fullsized":"2024-03-30T12:40:19.150608+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326527+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:41:30.326527+0000","last_peered":"2024-03-30T12:41:30.326527+0000","last_clean":"2024-03-30T12:41:30.326527+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:41:30.326527+0000","last_undegraded":"2024-03-30T12:41:30.326527+0000","last_fullsized":"2024-03-30T12:41:30.326527+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1263,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662819+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:40:27.662819+0000","last_peered":"2024-03-30T12:40:27.662819+0000","last_clean":"2024-03-30T12:40:27.662819+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:40:27.662819+0000","last_undegraded":"2024-03-30T12:40:27.662819+0000","last_fullsized":"2024-03-30T12:40:27.662819+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1264,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302503+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:41:02.302503+0000","last_peered":"2024-03-30T12:41:02.302503+0000","last_clean":"2024-03-30T12:41:02.302503+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:41:02.302503+0000","last_undegraded":"2024-03-30T12:41:02.302503+0000","last_fullsized":"2024-03-30T12:41:02.302503+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1181,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.567808+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:39:39.567808+0000","last_peered":"2024-03-30T12:39:39.567808+0000","last_clean":"2024-03-30T12:39:39.567808+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:39:39.567808+0000","last_undegraded":"2024-03-30T12:39:39.567808+0000","last_fullsized":"2024-03-30T12:39:39.567808+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:15.763333+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:41:15.763333+0000","last_peered":"2024-03-30T12:41:15.763333+0000","last_clean":"2024-03-30T12:41:15.763333+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:41:15.763333+0000","last_undegraded":"2024-03-30T12:41:15.763333+0000","last_fullsized":"2024-03-30T12:41:15.763333+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660073+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:40:02.660073+0000","last_peered":"2024-03-30T12:40:02.660073+0000","last_clean":"2024-03-30T12:40:02.660073+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:40:02.660073+0000","last_undegraded":"2024-03-30T12:40:02.660073+0000","last_fullsized":"2024-03-30T12:40:02.660073+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660041+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:40:02.660041+0000","last_peered":"2024-03-30T12:40:02.660041+0000","last_clean":"2024-03-30T12:40:02.660041+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:40:02.660041+0000","last_undegraded":"2024-03-30T12:40:02.660041+0000","last_fullsized":"2024-03-30T12:40:02.660041+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1226,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323325+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:41:05.323325+0000","last_peered":"2024-03-30T12:41:05.323325+0000","last_clean":"2024-03-30T12:41:05.323325+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:41:05.323325+0000","last_undegraded":"2024-03-30T12:41:05.323325+0000","last_fullsized":"2024-03-30T12:41:05.323325+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:18.930743+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:41:18.930743+0000","last_peered":"2024-03-30T12:41:18.930743+0000","last_clean":"2024-03-30T12:41:18.930743+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:41:18.930743+0000","last_undegraded":"2024-03-30T12:41:18.930743+0000","last_fullsized":"2024-03-30T12:41:18.930743+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1172,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581788+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:41:44.581788+0000","last_peered":"2024-03-30T12:41:44.581788+0000","last_clean":"2024-03-30T12:41:44.581788+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:41:44.581788+0000","last_undegraded":"2024-03-30T12:41:44.581788+0000","last_fullsized":"2024-03-30T12:41:44.581788+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323382+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:41:05.323382+0000","last_peered":"2024-03-30T12:41:05.323382+0000","last_clean":"2024-03-30T12:41:05.323382+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:41:05.323382+0000","last_undegraded":"2024-03-30T12:41:05.323382+0000","last_fullsized":"2024-03-30T12:41:05.323382+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1200,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323370+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:41:05.323370+0000","last_peered":"2024-03-30T12:41:05.323370+0000","last_clean":"2024-03-30T12:41:05.323370+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:41:05.323370+0000","last_undegraded":"2024-03-30T12:41:05.323370+0000","last_fullsized":"2024-03-30T12:41:05.323370+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1292,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:28.391470+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:39:28.391470+0000","last_peered":"2024-03-30T12:39:28.391470+0000","last_clean":"2024-03-30T12:39:28.391470+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:39:28.391470+0000","last_undegraded":"2024-03-30T12:39:28.391470+0000","last_fullsized":"2024-03-30T12:39:28.391470+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:18.930787+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:41:18.930787+0000","last_peered":"2024-03-30T12:41:18.930787+0000","last_clean":"2024-03-30T12:41:18.930787+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:41:18.930787+0000","last_undegraded":"2024-03-30T12:41:18.930787+0000","last_fullsized":"2024-03-30T12:41:18.930787+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:12.297292+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:40:12.297292+0000","last_peered":"2024-03-30T12:40:12.297292+0000","last_clean":"2024-03-30T12:40:12.297292+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:40:12.297292+0000","last_undegraded":"2024-03-30T12:40:12.297292+0000","last_fullsized":"2024-03-30T12:40:12.297292+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1207,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579099+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:41:19.579099+0000","last_peered":"2024-03-30T12:41:19.579099+0000","last_clean":"2024-03-30T12:41:19.579099+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:41:19.579099+0000","last_undegraded":"2024-03-30T12:41:19.579099+0000","last_fullsized":"2024-03-30T12:41:19.579099+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:59.148189+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:39:59.148189+0000","last_peered":"2024-03-30T12:39:59.148189+0000","last_clean":"2024-03-30T12:39:59.148189+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:39:59.148189+0000","last_undegraded":"2024-03-30T12:39:59.148189+0000","last_fullsized":"2024-03-30T12:39:59.148189+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1385,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886047+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:40:15.886047+0000","last_peered":"2024-03-30T12:40:15.886047+0000","last_clean":"2024-03-30T12:40:15.886047+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:40:15.886047+0000","last_undegraded":"2024-03-30T12:40:15.886047+0000","last_fullsized":"2024-03-30T12:40:15.886047+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886029+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:40:15.886029+0000","last_peered":"2024-03-30T12:40:15.886029+0000","last_clean":"2024-03-30T12:40:15.886029+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:40:15.886029+0000","last_undegraded":"2024-03-30T12:40:15.886029+0000","last_fullsized":"2024-03-30T12:40:15.886029+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320162+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:40:40.320162+0000","last_peered":"2024-03-30T12:40:40.320162+0000","last_clean":"2024-03-30T12:40:40.320162+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:40:40.320162+0000","last_undegraded":"2024-03-30T12:40:40.320162+0000","last_fullsized":"2024-03-30T12:40:40.320162+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.145725+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:39:39.145725+0000","last_peered":"2024-03-30T12:39:39.145725+0000","last_clean":"2024-03-30T12:39:39.145725+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:39:39.145725+0000","last_undegraded":"2024-03-30T12:39:39.145725+0000","last_fullsized":"2024-03-30T12:39:39.145725+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1186,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579076+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:41:19.579076+0000","last_peered":"2024-03-30T12:41:19.579076+0000","last_clean":"2024-03-30T12:41:19.579076+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:41:19.579076+0000","last_undegraded":"2024-03-30T12:41:19.579076+0000","last_fullsized":"2024-03-30T12:41:19.579076+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579050+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:41:19.579050+0000","last_peered":"2024-03-30T12:41:19.579050+0000","last_clean":"2024-03-30T12:41:19.579050+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:41:19.579050+0000","last_undegraded":"2024-03-30T12:41:19.579050+0000","last_fullsized":"2024-03-30T12:41:19.579050+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1346,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.403657+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:41:23.403657+0000","last_peered":"2024-03-30T12:41:23.403657+0000","last_clean":"2024-03-30T12:41:23.403657+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:41:23.403657+0000","last_undegraded":"2024-03-30T12:41:23.403657+0000","last_fullsized":"2024-03-30T12:41:23.403657+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.145661+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:39:39.145661+0000","last_peered":"2024-03-30T12:39:39.145661+0000","last_clean":"2024-03-30T12:39:39.145661+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:39:39.145661+0000","last_undegraded":"2024-03-30T12:39:39.145661+0000","last_fullsized":"2024-03-30T12:39:39.145661+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5754,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:23.397042+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:40:23.397042+0000","last_peered":"2024-03-30T12:40:23.397042+0000","last_clean":"2024-03-30T12:40:23.397042+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:40:23.397042+0000","last_undegraded":"2024-03-30T12:40:23.397042+0000","last_fullsized":"2024-03-30T12:40:23.397042+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1276,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:47.295052+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:39:47.295052+0000","last_peered":"2024-03-30T12:39:47.295052+0000","last_clean":"2024-03-30T12:39:47.295052+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:39:47.295052+0000","last_undegraded":"2024-03-30T12:39:47.295052+0000","last_fullsized":"2024-03-30T12:39:47.295052+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159642+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:41:34.159642+0000","last_peered":"2024-03-30T12:41:34.159642+0000","last_clean":"2024-03-30T12:41:34.159642+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:41:34.159642+0000","last_undegraded":"2024-03-30T12:41:34.159642+0000","last_fullsized":"2024-03-30T12:41:34.159642+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5515,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:50.889213+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:40:50.889213+0000","last_peered":"2024-03-30T12:40:50.889213+0000","last_clean":"2024-03-30T12:40:50.889213+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:40:50.889213+0000","last_undegraded":"2024-03-30T12:40:50.889213+0000","last_fullsized":"2024-03-30T12:40:50.889213+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931401+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:41:23.931401+0000","last_peered":"2024-03-30T12:41:23.931401+0000","last_clean":"2024-03-30T12:41:23.931401+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:41:23.931401+0000","last_undegraded":"2024-03-30T12:41:23.931401+0000","last_fullsized":"2024-03-30T12:41:23.931401+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931427+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:41:23.931427+0000","last_peered":"2024-03-30T12:41:23.931427+0000","last_clean":"2024-03-30T12:41:23.931427+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:41:23.931427+0000","last_undegraded":"2024-03-30T12:41:23.931427+0000","last_fullsized":"2024-03-30T12:41:23.931427+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326520+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:41:30.326520+0000","last_peered":"2024-03-30T12:41:30.326520+0000","last_clean":"2024-03-30T12:41:30.326520+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:41:30.326520+0000","last_undegraded":"2024-03-30T12:41:30.326520+0000","last_fullsized":"2024-03-30T12:41:30.326520+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5460,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:50.889251+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:40:50.889251+0000","last_peered":"2024-03-30T12:40:50.889251+0000","last_clean":"2024-03-30T12:40:50.889251+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:40:50.889251+0000","last_undegraded":"2024-03-30T12:40:50.889251+0000","last_fullsized":"2024-03-30T12:40:50.889251+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931438+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:41:23.931438+0000","last_peered":"2024-03-30T12:41:23.931438+0000","last_clean":"2024-03-30T12:41:23.931438+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:41:23.931438+0000","last_undegraded":"2024-03-30T12:41:23.931438+0000","last_fullsized":"2024-03-30T12:41:23.931438+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1209,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326461+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:41:30.326461+0000","last_peered":"2024-03-30T12:41:30.326461+0000","last_clean":"2024-03-30T12:41:30.326461+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:41:30.326461+0000","last_undegraded":"2024-03-30T12:41:30.326461+0000","last_fullsized":"2024-03-30T12:41:30.326461+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302515+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:41:02.302515+0000","last_peered":"2024-03-30T12:41:02.302515+0000","last_clean":"2024-03-30T12:41:02.302515+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:41:02.302515+0000","last_undegraded":"2024-03-30T12:41:02.302515+0000","last_fullsized":"2024-03-30T12:41:02.302515+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3805,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:23.397156+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:40:23.397156+0000","last_peered":"2024-03-30T12:40:23.397156+0000","last_clean":"2024-03-30T12:40:23.397156+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:40:23.397156+0000","last_undegraded":"2024-03-30T12:40:23.397156+0000","last_fullsized":"2024-03-30T12:40:23.397156+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935569+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:41:58.935569+0000","last_peered":"2024-03-30T12:41:58.935569+0000","last_clean":"2024-03-30T12:41:58.935569+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:41:58.935569+0000","last_undegraded":"2024-03-30T12:41:58.935569+0000","last_fullsized":"2024-03-30T12:41:58.935569+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:48.927559+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:40:48.927559+0000","last_peered":"2024-03-30T12:40:48.927559+0000","last_clean":"2024-03-30T12:40:48.927559+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:40:48.927559+0000","last_undegraded":"2024-03-30T12:40:48.927559+0000","last_fullsized":"2024-03-30T12:40:48.927559+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.407376+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:41:58.407376+0000","last_peered":"2024-03-30T12:41:58.407376+0000","last_clean":"2024-03-30T12:41:58.407376+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:41:58.407376+0000","last_undegraded":"2024-03-30T12:41:58.407376+0000","last_fullsized":"2024-03-30T12:41:58.407376+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4578,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:44.153464+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:40:44.153464+0000","last_peered":"2024-03-30T12:40:44.153464+0000","last_clean":"2024-03-30T12:40:44.153464+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:40:44.153464+0000","last_undegraded":"2024-03-30T12:40:44.153464+0000","last_fullsized":"2024-03-30T12:40:44.153464+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1177,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:09.584340+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:42:09.584340+0000","last_peered":"2024-03-30T12:42:09.584340+0000","last_clean":"2024-03-30T12:42:09.584340+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:42:09.584340+0000","last_undegraded":"2024-03-30T12:42:09.584340+0000","last_fullsized":"2024-03-30T12:42:09.584340+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662799+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:40:27.662799+0000","last_peered":"2024-03-30T12:40:27.662799+0000","last_clean":"2024-03-30T12:40:27.662799+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:40:27.662799+0000","last_undegraded":"2024-03-30T12:40:27.662799+0000","last_fullsized":"2024-03-30T12:40:27.662799+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1202,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326500+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:41:30.326500+0000","last_peered":"2024-03-30T12:41:30.326500+0000","last_clean":"2024-03-30T12:41:30.326500+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:41:30.326500+0000","last_undegraded":"2024-03-30T12:41:30.326500+0000","last_fullsized":"2024-03-30T12:41:30.326500+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1718,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150538+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:40:19.150538+0000","last_peered":"2024-03-30T12:40:19.150538+0000","last_clean":"2024-03-30T12:40:19.150538+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:40:19.150538+0000","last_undegraded":"2024-03-30T12:40:19.150538+0000","last_fullsized":"2024-03-30T12:40:19.150538+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24716,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:00.329951+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:42:00.329951+0000","last_peered":"2024-03-30T12:42:00.329951+0000","last_clean":"2024-03-30T12:42:00.329951+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:42:00.329951+0000","last_undegraded":"2024-03-30T12:42:00.329951+0000","last_fullsized":"2024-03-30T12:42:00.329951+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:25.764684+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:41:25.764684+0000","last_peered":"2024-03-30T12:41:25.764684+0000","last_clean":"2024-03-30T12:41:25.764684+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:41:25.764684+0000","last_undegraded":"2024-03-30T12:41:25.764684+0000","last_fullsized":"2024-03-30T12:41:25.764684+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889177+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:40:50.889177+0000","last_peered":"2024-03-30T12:40:50.889177+0000","last_clean":"2024-03-30T12:40:50.889177+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:40:50.889177+0000","last_undegraded":"2024-03-30T12:40:50.889177+0000","last_fullsized":"2024-03-30T12:40:50.889177+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150500+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:40:19.150500+0000","last_peered":"2024-03-30T12:40:19.150500+0000","last_clean":"2024-03-30T12:40:19.150500+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:40:19.150500+0000","last_undegraded":"2024-03-30T12:40:19.150500+0000","last_fullsized":"2024-03-30T12:40:19.150500+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16483,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:09.584304+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:42:09.584304+0000","last_peered":"2024-03-30T12:42:09.584304+0000","last_clean":"2024-03-30T12:42:09.584304+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:42:09.584304+0000","last_undegraded":"2024-03-30T12:42:09.584304+0000","last_fullsized":"2024-03-30T12:42:09.584304+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889228+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:40:50.889228+0000","last_peered":"2024-03-30T12:40:50.889228+0000","last_clean":"2024-03-30T12:40:50.889228+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:40:50.889228+0000","last_undegraded":"2024-03-30T12:40:50.889228+0000","last_fullsized":"2024-03-30T12:40:50.889228+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1165,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:44.153535+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:40:44.153535+0000","last_peered":"2024-03-30T12:40:44.153535+0000","last_clean":"2024-03-30T12:40:44.153535+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:40:44.153535+0000","last_undegraded":"2024-03-30T12:40:44.153535+0000","last_fullsized":"2024-03-30T12:40:44.153535+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931449+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:41:23.931449+0000","last_peered":"2024-03-30T12:41:23.931449+0000","last_clean":"2024-03-30T12:41:23.931449+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:41:23.931449+0000","last_undegraded":"2024-03-30T12:41:23.931449+0000","last_fullsized":"2024-03-30T12:41:23.931449+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31271,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:41:02.302474+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:41:02.302474+0000","last_peered":"2024-03-30T12:41:02.302474+0000","last_clean":"2024-03-30T12:41:02.302474+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:41:02.302474+0000","last_undegraded":"2024-03-30T12:41:02.302474+0000","last_fullsized":"2024-03-30T12:41:02.302474+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672495+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:41:57.672495+0000","last_peered":"2024-03-30T12:41:57.672495+0000","last_clean":"2024-03-30T12:41:57.672495+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:41:57.672495+0000","last_undegraded":"2024-03-30T12:41:57.672495+0000","last_fullsized":"2024-03-30T12:41:57.672495+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1356,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935556+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:41:58.935556+0000","last_peered":"2024-03-30T12:41:58.935556+0000","last_clean":"2024-03-30T12:41:58.935556+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:41:58.935556+0000","last_undegraded":"2024-03-30T12:41:58.935556+0000","last_fullsized":"2024-03-30T12:41:58.935556+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666291+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:40:57.666291+0000","last_peered":"2024-03-30T12:40:57.666291+0000","last_clean":"2024-03-30T12:40:57.666291+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:40:57.666291+0000","last_undegraded":"2024-03-30T12:40:57.666291+0000","last_fullsized":"2024-03-30T12:40:57.666291+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3767,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672462+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:41:57.672462+0000","last_peered":"2024-03-30T12:41:57.672462+0000","last_clean":"2024-03-30T12:41:57.672462+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:41:57.672462+0000","last_undegraded":"2024-03-30T12:41:57.672462+0000","last_fullsized":"2024-03-30T12:41:57.672462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302452+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:41:02.302452+0000","last_peered":"2024-03-30T12:41:02.302452+0000","last_clean":"2024-03-30T12:41:02.302452+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:41:02.302452+0000","last_undegraded":"2024-03-30T12:41:02.302452+0000","last_fullsized":"2024-03-30T12:41:02.302452+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1157,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573285+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:40:29.573285+0000","last_peered":"2024-03-30T12:40:29.573285+0000","last_clean":"2024-03-30T12:40:29.573285+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:40:29.573285+0000","last_undegraded":"2024-03-30T12:40:29.573285+0000","last_fullsized":"2024-03-30T12:40:29.573285+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:25.764656+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:41:25.764656+0000","last_peered":"2024-03-30T12:41:25.764656+0000","last_clean":"2024-03-30T12:41:25.764656+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:41:25.764656+0000","last_undegraded":"2024-03-30T12:41:25.764656+0000","last_fullsized":"2024-03-30T12:41:25.764656+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15595,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:15.317660+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:40:15.317660+0000","last_peered":"2024-03-30T12:40:15.317660+0000","last_clean":"2024-03-30T12:40:15.317660+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:40:15.317660+0000","last_undegraded":"2024-03-30T12:40:15.317660+0000","last_fullsized":"2024-03-30T12:40:15.317660+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:09.156570+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:41:09.156570+0000","last_peered":"2024-03-30T12:41:09.156570+0000","last_clean":"2024-03-30T12:41:09.156570+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:41:09.156570+0000","last_undegraded":"2024-03-30T12:41:09.156570+0000","last_fullsized":"2024-03-30T12:41:09.156570+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:32.306064+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:41:32.306064+0000","last_peered":"2024-03-30T12:41:32.306064+0000","last_clean":"2024-03-30T12:41:32.306064+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:41:32.306064+0000","last_undegraded":"2024-03-30T12:41:32.306064+0000","last_fullsized":"2024-03-30T12:41:32.306064+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29021,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:39:47.295005+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:39:47.295005+0000","last_peered":"2024-03-30T12:39:47.295005+0000","last_clean":"2024-03-30T12:39:47.295005+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:39:47.295005+0000","last_undegraded":"2024-03-30T12:39:47.295005+0000","last_fullsized":"2024-03-30T12:39:47.295005+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935491+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:41:58.935491+0000","last_peered":"2024-03-30T12:41:58.935491+0000","last_clean":"2024-03-30T12:41:58.935491+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:41:58.935491+0000","last_undegraded":"2024-03-30T12:41:58.935491+0000","last_fullsized":"2024-03-30T12:41:58.935491+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666241+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:40:57.666241+0000","last_peered":"2024-03-30T12:40:57.666241+0000","last_clean":"2024-03-30T12:40:57.666241+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:40:57.666241+0000","last_undegraded":"2024-03-30T12:40:57.666241+0000","last_fullsized":"2024-03-30T12:40:57.666241+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5612,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:53.400722+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:40:53.400722+0000","last_peered":"2024-03-30T12:40:53.400722+0000","last_clean":"2024-03-30T12:40:53.400722+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:40:53.400722+0000","last_undegraded":"2024-03-30T12:40:53.400722+0000","last_fullsized":"2024-03-30T12:40:53.400722+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1367,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935518+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:41:58.935518+0000","last_peered":"2024-03-30T12:41:58.935518+0000","last_clean":"2024-03-30T12:41:58.935518+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:41:58.935518+0000","last_undegraded":"2024-03-30T12:41:58.935518+0000","last_fullsized":"2024-03-30T12:41:58.935518+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:27.669397+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:41:27.669397+0000","last_peered":"2024-03-30T12:41:27.669397+0000","last_clean":"2024-03-30T12:41:27.669397+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:41:27.669397+0000","last_undegraded":"2024-03-30T12:41:27.669397+0000","last_fullsized":"2024-03-30T12:41:27.669397+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4276,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:18.924042+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:40:18.924042+0000","last_peered":"2024-03-30T12:40:18.924042+0000","last_clean":"2024-03-30T12:40:18.924042+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:40:18.924042+0000","last_undegraded":"2024-03-30T12:40:18.924042+0000","last_fullsized":"2024-03-30T12:40:18.924042+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1156,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159584+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:41:34.159584+0000","last_peered":"2024-03-30T12:41:34.159584+0000","last_clean":"2024-03-30T12:41:34.159584+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:41:34.159584+0000","last_undegraded":"2024-03-30T12:41:34.159584+0000","last_fullsized":"2024-03-30T12:41:34.159584+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573205+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:40:29.573205+0000","last_peered":"2024-03-30T12:40:29.573205+0000","last_clean":"2024-03-30T12:40:29.573205+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:40:29.573205+0000","last_undegraded":"2024-03-30T12:40:29.573205+0000","last_fullsized":"2024-03-30T12:40:29.573205+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5255,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:53.400674+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:40:53.400674+0000","last_peered":"2024-03-30T12:40:53.400674+0000","last_clean":"2024-03-30T12:40:53.400674+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:40:53.400674+0000","last_undegraded":"2024-03-30T12:40:53.400674+0000","last_fullsized":"2024-03-30T12:40:53.400674+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:53.400708+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:40:53.400708+0000","last_peered":"2024-03-30T12:40:53.400708+0000","last_clean":"2024-03-30T12:40:53.400708+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:40:53.400708+0000","last_undegraded":"2024-03-30T12:40:53.400708+0000","last_fullsized":"2024-03-30T12:40:53.400708+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159619+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:41:34.159619+0000","last_peered":"2024-03-30T12:41:34.159619+0000","last_clean":"2024-03-30T12:41:34.159619+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:41:34.159619+0000","last_undegraded":"2024-03-30T12:41:34.159619+0000","last_fullsized":"2024-03-30T12:41:34.159619+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4812,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:23.397123+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:40:23.397123+0000","last_peered":"2024-03-30T12:40:23.397123+0000","last_clean":"2024-03-30T12:40:23.397123+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:40:23.397123+0000","last_undegraded":"2024-03-30T12:40:23.397123+0000","last_fullsized":"2024-03-30T12:40:23.397123+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:18.924078+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:40:18.924078+0000","last_peered":"2024-03-30T12:40:18.924078+0000","last_clean":"2024-03-30T12:40:18.924078+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:40:18.924078+0000","last_undegraded":"2024-03-30T12:40:18.924078+0000","last_fullsized":"2024-03-30T12:40:18.924078+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.317641+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:40:15.317641+0000","last_peered":"2024-03-30T12:40:15.317641+0000","last_clean":"2024-03-30T12:40:15.317641+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:40:15.317641+0000","last_undegraded":"2024-03-30T12:40:15.317641+0000","last_fullsized":"2024-03-30T12:40:15.317641+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6745,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:41:09.156602+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:41:09.156602+0000","last_peered":"2024-03-30T12:41:09.156602+0000","last_clean":"2024-03-30T12:41:09.156602+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:41:09.156602+0000","last_undegraded":"2024-03-30T12:41:09.156602+0000","last_fullsized":"2024-03-30T12:41:09.156602+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1339,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:53.400753+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:40:53.400753+0000","last_peered":"2024-03-30T12:40:53.400753+0000","last_clean":"2024-03-30T12:40:53.400753+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:40:53.400753+0000","last_undegraded":"2024-03-30T12:40:53.400753+0000","last_fullsized":"2024-03-30T12:40:53.400753+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159657+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:41:34.159657+0000","last_peered":"2024-03-30T12:41:34.159657+0000","last_clean":"2024-03-30T12:41:34.159657+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:41:34.159657+0000","last_undegraded":"2024-03-30T12:41:34.159657+0000","last_fullsized":"2024-03-30T12:41:34.159657+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1172,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:09.584262+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:42:09.584262+0000","last_peered":"2024-03-30T12:42:09.584262+0000","last_clean":"2024-03-30T12:42:09.584262+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:42:09.584262+0000","last_undegraded":"2024-03-30T12:42:09.584262+0000","last_fullsized":"2024-03-30T12:42:09.584262+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1335,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.407397+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:41:58.407397+0000","last_peered":"2024-03-30T12:41:58.407397+0000","last_clean":"2024-03-30T12:41:58.407397+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:41:58.407397+0000","last_undegraded":"2024-03-30T12:41:58.407397+0000","last_fullsized":"2024-03-30T12:41:58.407397+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326484+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:41:30.326484+0000","last_peered":"2024-03-30T12:41:30.326484+0000","last_clean":"2024-03-30T12:41:30.326484+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:41:30.326484+0000","last_undegraded":"2024-03-30T12:41:30.326484+0000","last_fullsized":"2024-03-30T12:41:30.326484+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889204+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:40:50.889204+0000","last_peered":"2024-03-30T12:40:50.889204+0000","last_clean":"2024-03-30T12:40:50.889204+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:40:50.889204+0000","last_undegraded":"2024-03-30T12:40:50.889204+0000","last_fullsized":"2024-03-30T12:40:50.889204+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666276+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:40:57.666276+0000","last_peered":"2024-03-30T12:40:57.666276+0000","last_clean":"2024-03-30T12:40:57.666276+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:40:57.666276+0000","last_undegraded":"2024-03-30T12:40:57.666276+0000","last_fullsized":"2024-03-30T12:40:57.666276+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935541+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:41:58.935541+0000","last_peered":"2024-03-30T12:41:58.935541+0000","last_clean":"2024-03-30T12:41:58.935541+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:41:58.935541+0000","last_undegraded":"2024-03-30T12:41:58.935541+0000","last_fullsized":"2024-03-30T12:41:58.935541+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1179,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573267+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:40:29.573267+0000","last_peered":"2024-03-30T12:40:29.573267+0000","last_clean":"2024-03-30T12:40:29.573267+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:40:29.573267+0000","last_undegraded":"2024-03-30T12:40:29.573267+0000","last_fullsized":"2024-03-30T12:40:29.573267+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1283,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666301+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:40:57.666301+0000","last_peered":"2024-03-30T12:40:57.666301+0000","last_clean":"2024-03-30T12:40:57.666301+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:40:57.666301+0000","last_undegraded":"2024-03-30T12:40:57.666301+0000","last_fullsized":"2024-03-30T12:40:57.666301+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1240,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:50.314509+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:39:50.314509+0000","last_peered":"2024-03-30T12:39:50.314509+0000","last_clean":"2024-03-30T12:39:50.314509+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:39:50.314509+0000","last_undegraded":"2024-03-30T12:39:50.314509+0000","last_fullsized":"2024-03-30T12:39:50.314509+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:27.669378+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:41:27.669378+0000","last_peered":"2024-03-30T12:41:27.669378+0000","last_clean":"2024-03-30T12:41:27.669378+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:41:27.669378+0000","last_undegraded":"2024-03-30T12:41:27.669378+0000","last_fullsized":"2024-03-30T12:41:27.669378+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1217,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.317602+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:40:15.317602+0000","last_peered":"2024-03-30T12:40:15.317602+0000","last_clean":"2024-03-30T12:40:15.317602+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:40:15.317602+0000","last_undegraded":"2024-03-30T12:40:15.317602+0000","last_fullsized":"2024-03-30T12:40:15.317602+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:45.883156+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:39:45.883156+0000","last_peered":"2024-03-30T12:39:45.883156+0000","last_clean":"2024-03-30T12:39:45.883156+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:39:45.883156+0000","last_undegraded":"2024-03-30T12:39:45.883156+0000","last_fullsized":"2024-03-30T12:39:45.883156+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:54.576179+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:40:54.576179+0000","last_peered":"2024-03-30T12:40:54.576179+0000","last_clean":"2024-03-30T12:40:54.576179+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:40:54.576179+0000","last_undegraded":"2024-03-30T12:40:54.576179+0000","last_fullsized":"2024-03-30T12:40:54.576179+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438120,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648176,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175186,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254424,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063243,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951300,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839357,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923639,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:44:16.970 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:16.970 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:16.970 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:16.970 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:16.970 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:16.970 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:16.971 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:16.971 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:16.971 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:16.971 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:16.971 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:16.971 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:16.971 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:16.971 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:44:17.255 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:17 smithi084 ceph-mon[91810]: from='client.34740 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:44:17.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:17 smithi084 ceph-mon[89279]: from='client.34740 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:44:17.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:17 smithi162 ceph-mon[83709]: from='client.34740 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:44:18.371 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:18 smithi162 ceph-mon[83709]: pgmap v1237: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:18.505 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:18 smithi084 ceph-mon[91810]: pgmap v1237: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:18.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:18 smithi084 ceph-mon[89279]: pgmap v1237: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:19.756 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:44:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:44:19] "GET /metrics HTTP/1.1" 200 36322 "" "Prometheus/2.43.0" 2024-03-30T12:44:20.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:20 smithi162 ceph-mon[83709]: pgmap v1238: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:20.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:20 smithi084 ceph-mon[89279]: pgmap v1238: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:20.431 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:20 smithi084 ceph-mon[91810]: pgmap v1238: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:22.372 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:22 smithi162 ceph-mon[83709]: pgmap v1239: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:22.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:22 smithi084 ceph-mon[89279]: pgmap v1239: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:22.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:22 smithi084 ceph-mon[91810]: pgmap v1239: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:24.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:24 smithi084 ceph-mon[91810]: pgmap v1240: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:24.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:24 smithi084 ceph-mon[89279]: pgmap v1240: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:24.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:24 smithi162 ceph-mon[83709]: pgmap v1240: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:26.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:26 smithi084 ceph-mon[89279]: pgmap v1241: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:26.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:26 smithi084 ceph-mon[91810]: pgmap v1241: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:26.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:26 smithi162 ceph-mon[83709]: pgmap v1241: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:26.972 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:44:27.192 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:44:28.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:28 smithi084 ceph-mon[89279]: pgmap v1242: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:28.448 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:28 smithi084 ceph-mon[91810]: pgmap v1242: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:28.621 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:28 smithi162 ceph-mon[83709]: pgmap v1242: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:29.011 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:44:29.014 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:44:29.632 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:44:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:44:29] "GET /metrics HTTP/1.1" 200 36322 "" "Prometheus/2.43.0" 2024-03-30T12:44:29.652 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1243,"stamp":"2024-03-30T12:44:28.961896+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003590"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:44.153566+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:40:44.153566+0000","last_peered":"2024-03-30T12:40:44.153566+0000","last_clean":"2024-03-30T12:40:44.153566+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:40:44.153566+0000","last_undegraded":"2024-03-30T12:40:44.153566+0000","last_fullsized":"2024-03-30T12:40:44.153566+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1366,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931469+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:41:23.931469+0000","last_peered":"2024-03-30T12:41:23.931469+0000","last_clean":"2024-03-30T12:41:23.931469+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:41:23.931469+0000","last_undegraded":"2024-03-30T12:41:23.931469+0000","last_fullsized":"2024-03-30T12:41:23.931469+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889238+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:40:50.889238+0000","last_peered":"2024-03-30T12:40:50.889238+0000","last_clean":"2024-03-30T12:40:50.889238+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:40:50.889238+0000","last_undegraded":"2024-03-30T12:40:50.889238+0000","last_fullsized":"2024-03-30T12:40:50.889238+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:00.322650+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:41:00.322650+0000","last_peered":"2024-03-30T12:41:00.322650+0000","last_clean":"2024-03-30T12:41:00.322650+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:41:00.322650+0000","last_undegraded":"2024-03-30T12:41:00.322650+0000","last_fullsized":"2024-03-30T12:41:00.322650+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150593+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:40:19.150593+0000","last_peered":"2024-03-30T12:40:19.150593+0000","last_clean":"2024-03-30T12:40:19.150593+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:40:19.150593+0000","last_undegraded":"2024-03-30T12:40:19.150593+0000","last_fullsized":"2024-03-30T12:40:19.150593+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326493+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:41:30.326493+0000","last_peered":"2024-03-30T12:41:30.326493+0000","last_clean":"2024-03-30T12:41:30.326493+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:41:30.326493+0000","last_undegraded":"2024-03-30T12:41:30.326493+0000","last_fullsized":"2024-03-30T12:41:30.326493+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150576+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:40:19.150576+0000","last_peered":"2024-03-30T12:40:19.150576+0000","last_clean":"2024-03-30T12:40:19.150576+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:40:19.150576+0000","last_undegraded":"2024-03-30T12:40:19.150576+0000","last_fullsized":"2024-03-30T12:40:19.150576+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662744+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:40:27.662744+0000","last_peered":"2024-03-30T12:40:27.662744+0000","last_clean":"2024-03-30T12:40:27.662744+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:40:27.662744+0000","last_undegraded":"2024-03-30T12:40:27.662744+0000","last_fullsized":"2024-03-30T12:40:27.662744+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:59.148225+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:39:59.148225+0000","last_peered":"2024-03-30T12:39:59.148225+0000","last_clean":"2024-03-30T12:39:59.148225+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:39:59.148225+0000","last_undegraded":"2024-03-30T12:39:59.148225+0000","last_fullsized":"2024-03-30T12:39:59.148225+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581772+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:41:44.581772+0000","last_peered":"2024-03-30T12:41:44.581772+0000","last_clean":"2024-03-30T12:41:44.581772+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:41:44.581772+0000","last_undegraded":"2024-03-30T12:41:44.581772+0000","last_fullsized":"2024-03-30T12:41:44.581772+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581745+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:41:44.581745+0000","last_peered":"2024-03-30T12:41:44.581745+0000","last_clean":"2024-03-30T12:41:44.581745+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:41:44.581745+0000","last_undegraded":"2024-03-30T12:41:44.581745+0000","last_fullsized":"2024-03-30T12:41:44.581745+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1272,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:37.299828+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:40:37.299828+0000","last_peered":"2024-03-30T12:40:37.299828+0000","last_clean":"2024-03-30T12:40:37.299828+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:40:37.299828+0000","last_undegraded":"2024-03-30T12:40:37.299828+0000","last_fullsized":"2024-03-30T12:40:37.299828+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660090+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:40:02.660090+0000","last_peered":"2024-03-30T12:40:02.660090+0000","last_clean":"2024-03-30T12:40:02.660090+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:40:02.660090+0000","last_undegraded":"2024-03-30T12:40:02.660090+0000","last_fullsized":"2024-03-30T12:40:02.660090+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886008+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:40:15.886008+0000","last_peered":"2024-03-30T12:40:15.886008+0000","last_clean":"2024-03-30T12:40:15.886008+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:40:15.886008+0000","last_undegraded":"2024-03-30T12:40:15.886008+0000","last_fullsized":"2024-03-30T12:40:15.886008+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:48.927583+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:40:48.927583+0000","last_peered":"2024-03-30T12:40:48.927583+0000","last_clean":"2024-03-30T12:40:48.927583+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:40:48.927583+0000","last_undegraded":"2024-03-30T12:40:48.927583+0000","last_fullsized":"2024-03-30T12:40:48.927583+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320117+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:40:40.320117+0000","last_peered":"2024-03-30T12:40:40.320117+0000","last_clean":"2024-03-30T12:40:40.320117+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:40:40.320117+0000","last_undegraded":"2024-03-30T12:40:40.320117+0000","last_fullsized":"2024-03-30T12:40:40.320117+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1226,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320196+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:40:40.320196+0000","last_peered":"2024-03-30T12:40:40.320196+0000","last_clean":"2024-03-30T12:40:40.320196+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:40:40.320196+0000","last_undegraded":"2024-03-30T12:40:40.320196+0000","last_fullsized":"2024-03-30T12:40:40.320196+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.403697+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:41:23.403697+0000","last_peered":"2024-03-30T12:41:23.403697+0000","last_clean":"2024-03-30T12:41:23.403697+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:41:23.403697+0000","last_undegraded":"2024-03-30T12:41:23.403697+0000","last_fullsized":"2024-03-30T12:41:23.403697+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159632+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:41:34.159632+0000","last_peered":"2024-03-30T12:41:34.159632+0000","last_clean":"2024-03-30T12:41:34.159632+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:41:34.159632+0000","last_undegraded":"2024-03-30T12:41:34.159632+0000","last_fullsized":"2024-03-30T12:41:34.159632+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1390,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889293+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:40:50.889293+0000","last_peered":"2024-03-30T12:40:50.889293+0000","last_clean":"2024-03-30T12:40:50.889293+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:40:50.889293+0000","last_undegraded":"2024-03-30T12:40:50.889293+0000","last_fullsized":"2024-03-30T12:40:50.889293+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1285,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672522+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:41:57.672522+0000","last_peered":"2024-03-30T12:41:57.672522+0000","last_clean":"2024-03-30T12:41:57.672522+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:41:57.672522+0000","last_undegraded":"2024-03-30T12:41:57.672522+0000","last_fullsized":"2024-03-30T12:41:57.672522+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1304,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672534+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:41:57.672534+0000","last_peered":"2024-03-30T12:41:57.672534+0000","last_clean":"2024-03-30T12:41:57.672534+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:41:57.672534+0000","last_undegraded":"2024-03-30T12:41:57.672534+0000","last_fullsized":"2024-03-30T12:41:57.672534+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889279+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:40:50.889279+0000","last_peered":"2024-03-30T12:40:50.889279+0000","last_clean":"2024-03-30T12:40:50.889279+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:40:50.889279+0000","last_undegraded":"2024-03-30T12:40:50.889279+0000","last_fullsized":"2024-03-30T12:40:50.889279+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150628+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:40:19.150628+0000","last_peered":"2024-03-30T12:40:19.150628+0000","last_clean":"2024-03-30T12:40:19.150628+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:40:19.150628+0000","last_undegraded":"2024-03-30T12:40:19.150628+0000","last_fullsized":"2024-03-30T12:40:19.150628+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326512+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:41:30.326512+0000","last_peered":"2024-03-30T12:41:30.326512+0000","last_clean":"2024-03-30T12:41:30.326512+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:41:30.326512+0000","last_undegraded":"2024-03-30T12:41:30.326512+0000","last_fullsized":"2024-03-30T12:41:30.326512+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150608+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:40:19.150608+0000","last_peered":"2024-03-30T12:40:19.150608+0000","last_clean":"2024-03-30T12:40:19.150608+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:40:19.150608+0000","last_undegraded":"2024-03-30T12:40:19.150608+0000","last_fullsized":"2024-03-30T12:40:19.150608+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326527+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:41:30.326527+0000","last_peered":"2024-03-30T12:41:30.326527+0000","last_clean":"2024-03-30T12:41:30.326527+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:41:30.326527+0000","last_undegraded":"2024-03-30T12:41:30.326527+0000","last_fullsized":"2024-03-30T12:41:30.326527+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1263,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662819+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:40:27.662819+0000","last_peered":"2024-03-30T12:40:27.662819+0000","last_clean":"2024-03-30T12:40:27.662819+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:40:27.662819+0000","last_undegraded":"2024-03-30T12:40:27.662819+0000","last_fullsized":"2024-03-30T12:40:27.662819+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1264,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302503+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:41:02.302503+0000","last_peered":"2024-03-30T12:41:02.302503+0000","last_clean":"2024-03-30T12:41:02.302503+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:41:02.302503+0000","last_undegraded":"2024-03-30T12:41:02.302503+0000","last_fullsized":"2024-03-30T12:41:02.302503+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1181,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:39.567808+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:39:39.567808+0000","last_peered":"2024-03-30T12:39:39.567808+0000","last_clean":"2024-03-30T12:39:39.567808+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:39:39.567808+0000","last_undegraded":"2024-03-30T12:39:39.567808+0000","last_fullsized":"2024-03-30T12:39:39.567808+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:15.763333+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:41:15.763333+0000","last_peered":"2024-03-30T12:41:15.763333+0000","last_clean":"2024-03-30T12:41:15.763333+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:41:15.763333+0000","last_undegraded":"2024-03-30T12:41:15.763333+0000","last_fullsized":"2024-03-30T12:41:15.763333+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660073+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:40:02.660073+0000","last_peered":"2024-03-30T12:40:02.660073+0000","last_clean":"2024-03-30T12:40:02.660073+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:40:02.660073+0000","last_undegraded":"2024-03-30T12:40:02.660073+0000","last_fullsized":"2024-03-30T12:40:02.660073+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660041+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:40:02.660041+0000","last_peered":"2024-03-30T12:40:02.660041+0000","last_clean":"2024-03-30T12:40:02.660041+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:40:02.660041+0000","last_undegraded":"2024-03-30T12:40:02.660041+0000","last_fullsized":"2024-03-30T12:40:02.660041+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1226,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323325+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:41:05.323325+0000","last_peered":"2024-03-30T12:41:05.323325+0000","last_clean":"2024-03-30T12:41:05.323325+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:41:05.323325+0000","last_undegraded":"2024-03-30T12:41:05.323325+0000","last_fullsized":"2024-03-30T12:41:05.323325+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:18.930743+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:41:18.930743+0000","last_peered":"2024-03-30T12:41:18.930743+0000","last_clean":"2024-03-30T12:41:18.930743+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:41:18.930743+0000","last_undegraded":"2024-03-30T12:41:18.930743+0000","last_fullsized":"2024-03-30T12:41:18.930743+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1172,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581788+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:41:44.581788+0000","last_peered":"2024-03-30T12:41:44.581788+0000","last_clean":"2024-03-30T12:41:44.581788+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:41:44.581788+0000","last_undegraded":"2024-03-30T12:41:44.581788+0000","last_fullsized":"2024-03-30T12:41:44.581788+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323382+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:41:05.323382+0000","last_peered":"2024-03-30T12:41:05.323382+0000","last_clean":"2024-03-30T12:41:05.323382+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:41:05.323382+0000","last_undegraded":"2024-03-30T12:41:05.323382+0000","last_fullsized":"2024-03-30T12:41:05.323382+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1200,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323370+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:41:05.323370+0000","last_peered":"2024-03-30T12:41:05.323370+0000","last_clean":"2024-03-30T12:41:05.323370+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:41:05.323370+0000","last_undegraded":"2024-03-30T12:41:05.323370+0000","last_fullsized":"2024-03-30T12:41:05.323370+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1293,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:53.406703+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:41:53.406703+0000","last_peered":"2024-03-30T12:41:53.406703+0000","last_clean":"2024-03-30T12:41:53.406703+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:41:53.406703+0000","last_undegraded":"2024-03-30T12:41:53.406703+0000","last_fullsized":"2024-03-30T12:41:53.406703+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:18.930787+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:41:18.930787+0000","last_peered":"2024-03-30T12:41:18.930787+0000","last_clean":"2024-03-30T12:41:18.930787+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:41:18.930787+0000","last_undegraded":"2024-03-30T12:41:18.930787+0000","last_fullsized":"2024-03-30T12:41:18.930787+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:12.297292+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:40:12.297292+0000","last_peered":"2024-03-30T12:40:12.297292+0000","last_clean":"2024-03-30T12:40:12.297292+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:40:12.297292+0000","last_undegraded":"2024-03-30T12:40:12.297292+0000","last_fullsized":"2024-03-30T12:40:12.297292+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1207,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579099+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:41:19.579099+0000","last_peered":"2024-03-30T12:41:19.579099+0000","last_clean":"2024-03-30T12:41:19.579099+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:41:19.579099+0000","last_undegraded":"2024-03-30T12:41:19.579099+0000","last_fullsized":"2024-03-30T12:41:19.579099+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:59.148189+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:39:59.148189+0000","last_peered":"2024-03-30T12:39:59.148189+0000","last_clean":"2024-03-30T12:39:59.148189+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:39:59.148189+0000","last_undegraded":"2024-03-30T12:39:59.148189+0000","last_fullsized":"2024-03-30T12:39:59.148189+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1385,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886047+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:40:15.886047+0000","last_peered":"2024-03-30T12:40:15.886047+0000","last_clean":"2024-03-30T12:40:15.886047+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:40:15.886047+0000","last_undegraded":"2024-03-30T12:40:15.886047+0000","last_fullsized":"2024-03-30T12:40:15.886047+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886029+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:40:15.886029+0000","last_peered":"2024-03-30T12:40:15.886029+0000","last_clean":"2024-03-30T12:40:15.886029+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:40:15.886029+0000","last_undegraded":"2024-03-30T12:40:15.886029+0000","last_fullsized":"2024-03-30T12:40:15.886029+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320162+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:40:40.320162+0000","last_peered":"2024-03-30T12:40:40.320162+0000","last_clean":"2024-03-30T12:40:40.320162+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:40:40.320162+0000","last_undegraded":"2024-03-30T12:40:40.320162+0000","last_fullsized":"2024-03-30T12:40:40.320162+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:59.162782+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:41:59.162782+0000","last_peered":"2024-03-30T12:41:59.162782+0000","last_clean":"2024-03-30T12:41:59.162782+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:41:59.162782+0000","last_undegraded":"2024-03-30T12:41:59.162782+0000","last_fullsized":"2024-03-30T12:41:59.162782+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1186,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579076+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:41:19.579076+0000","last_peered":"2024-03-30T12:41:19.579076+0000","last_clean":"2024-03-30T12:41:19.579076+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:41:19.579076+0000","last_undegraded":"2024-03-30T12:41:19.579076+0000","last_fullsized":"2024-03-30T12:41:19.579076+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579050+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:41:19.579050+0000","last_peered":"2024-03-30T12:41:19.579050+0000","last_clean":"2024-03-30T12:41:19.579050+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:41:19.579050+0000","last_undegraded":"2024-03-30T12:41:19.579050+0000","last_fullsized":"2024-03-30T12:41:19.579050+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1346,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.403657+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:41:23.403657+0000","last_peered":"2024-03-30T12:41:23.403657+0000","last_clean":"2024-03-30T12:41:23.403657+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:41:23.403657+0000","last_undegraded":"2024-03-30T12:41:23.403657+0000","last_fullsized":"2024-03-30T12:41:23.403657+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:59.162732+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:41:59.162732+0000","last_peered":"2024-03-30T12:41:59.162732+0000","last_clean":"2024-03-30T12:41:59.162732+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:41:59.162732+0000","last_undegraded":"2024-03-30T12:41:59.162732+0000","last_fullsized":"2024-03-30T12:41:59.162732+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5754,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:23.397042+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:40:23.397042+0000","last_peered":"2024-03-30T12:40:23.397042+0000","last_clean":"2024-03-30T12:40:23.397042+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:40:23.397042+0000","last_undegraded":"2024-03-30T12:40:23.397042+0000","last_fullsized":"2024-03-30T12:40:23.397042+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1277,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:02.309177+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:42:02.309177+0000","last_peered":"2024-03-30T12:42:02.309177+0000","last_clean":"2024-03-30T12:42:02.309177+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:42:02.309177+0000","last_undegraded":"2024-03-30T12:42:02.309177+0000","last_fullsized":"2024-03-30T12:42:02.309177+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159642+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:41:34.159642+0000","last_peered":"2024-03-30T12:41:34.159642+0000","last_clean":"2024-03-30T12:41:34.159642+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:41:34.159642+0000","last_undegraded":"2024-03-30T12:41:34.159642+0000","last_fullsized":"2024-03-30T12:41:34.159642+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5515,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:50.889213+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:40:50.889213+0000","last_peered":"2024-03-30T12:40:50.889213+0000","last_clean":"2024-03-30T12:40:50.889213+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:40:50.889213+0000","last_undegraded":"2024-03-30T12:40:50.889213+0000","last_fullsized":"2024-03-30T12:40:50.889213+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931401+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:41:23.931401+0000","last_peered":"2024-03-30T12:41:23.931401+0000","last_clean":"2024-03-30T12:41:23.931401+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:41:23.931401+0000","last_undegraded":"2024-03-30T12:41:23.931401+0000","last_fullsized":"2024-03-30T12:41:23.931401+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931427+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:41:23.931427+0000","last_peered":"2024-03-30T12:41:23.931427+0000","last_clean":"2024-03-30T12:41:23.931427+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:41:23.931427+0000","last_undegraded":"2024-03-30T12:41:23.931427+0000","last_fullsized":"2024-03-30T12:41:23.931427+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326520+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:41:30.326520+0000","last_peered":"2024-03-30T12:41:30.326520+0000","last_clean":"2024-03-30T12:41:30.326520+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:41:30.326520+0000","last_undegraded":"2024-03-30T12:41:30.326520+0000","last_fullsized":"2024-03-30T12:41:30.326520+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5460,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:50.889251+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:40:50.889251+0000","last_peered":"2024-03-30T12:40:50.889251+0000","last_clean":"2024-03-30T12:40:50.889251+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:40:50.889251+0000","last_undegraded":"2024-03-30T12:40:50.889251+0000","last_fullsized":"2024-03-30T12:40:50.889251+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931438+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:41:23.931438+0000","last_peered":"2024-03-30T12:41:23.931438+0000","last_clean":"2024-03-30T12:41:23.931438+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:41:23.931438+0000","last_undegraded":"2024-03-30T12:41:23.931438+0000","last_fullsized":"2024-03-30T12:41:23.931438+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1209,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326461+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:41:30.326461+0000","last_peered":"2024-03-30T12:41:30.326461+0000","last_clean":"2024-03-30T12:41:30.326461+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:41:30.326461+0000","last_undegraded":"2024-03-30T12:41:30.326461+0000","last_fullsized":"2024-03-30T12:41:30.326461+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302515+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:41:02.302515+0000","last_peered":"2024-03-30T12:41:02.302515+0000","last_clean":"2024-03-30T12:41:02.302515+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:41:02.302515+0000","last_undegraded":"2024-03-30T12:41:02.302515+0000","last_fullsized":"2024-03-30T12:41:02.302515+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3805,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:23.397156+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:40:23.397156+0000","last_peered":"2024-03-30T12:40:23.397156+0000","last_clean":"2024-03-30T12:40:23.397156+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:40:23.397156+0000","last_undegraded":"2024-03-30T12:40:23.397156+0000","last_fullsized":"2024-03-30T12:40:23.397156+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935569+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:41:58.935569+0000","last_peered":"2024-03-30T12:41:58.935569+0000","last_clean":"2024-03-30T12:41:58.935569+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:41:58.935569+0000","last_undegraded":"2024-03-30T12:41:58.935569+0000","last_fullsized":"2024-03-30T12:41:58.935569+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:48.927559+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:40:48.927559+0000","last_peered":"2024-03-30T12:40:48.927559+0000","last_clean":"2024-03-30T12:40:48.927559+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:40:48.927559+0000","last_undegraded":"2024-03-30T12:40:48.927559+0000","last_fullsized":"2024-03-30T12:40:48.927559+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.407376+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:41:58.407376+0000","last_peered":"2024-03-30T12:41:58.407376+0000","last_clean":"2024-03-30T12:41:58.407376+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:41:58.407376+0000","last_undegraded":"2024-03-30T12:41:58.407376+0000","last_fullsized":"2024-03-30T12:41:58.407376+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4578,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:44.153464+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:40:44.153464+0000","last_peered":"2024-03-30T12:40:44.153464+0000","last_clean":"2024-03-30T12:40:44.153464+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:40:44.153464+0000","last_undegraded":"2024-03-30T12:40:44.153464+0000","last_fullsized":"2024-03-30T12:40:44.153464+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1177,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:09.584340+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:42:09.584340+0000","last_peered":"2024-03-30T12:42:09.584340+0000","last_clean":"2024-03-30T12:42:09.584340+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:42:09.584340+0000","last_undegraded":"2024-03-30T12:42:09.584340+0000","last_fullsized":"2024-03-30T12:42:09.584340+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662799+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:40:27.662799+0000","last_peered":"2024-03-30T12:40:27.662799+0000","last_clean":"2024-03-30T12:40:27.662799+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:40:27.662799+0000","last_undegraded":"2024-03-30T12:40:27.662799+0000","last_fullsized":"2024-03-30T12:40:27.662799+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1202,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326500+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:41:30.326500+0000","last_peered":"2024-03-30T12:41:30.326500+0000","last_clean":"2024-03-30T12:41:30.326500+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:41:30.326500+0000","last_undegraded":"2024-03-30T12:41:30.326500+0000","last_fullsized":"2024-03-30T12:41:30.326500+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1719,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:19.165060+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:42:19.165060+0000","last_peered":"2024-03-30T12:42:19.165060+0000","last_clean":"2024-03-30T12:42:19.165060+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:42:19.165060+0000","last_undegraded":"2024-03-30T12:42:19.165060+0000","last_fullsized":"2024-03-30T12:42:19.165060+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24716,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:00.329951+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:42:00.329951+0000","last_peered":"2024-03-30T12:42:00.329951+0000","last_clean":"2024-03-30T12:42:00.329951+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:42:00.329951+0000","last_undegraded":"2024-03-30T12:42:00.329951+0000","last_fullsized":"2024-03-30T12:42:00.329951+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:25.764684+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:41:25.764684+0000","last_peered":"2024-03-30T12:41:25.764684+0000","last_clean":"2024-03-30T12:41:25.764684+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:41:25.764684+0000","last_undegraded":"2024-03-30T12:41:25.764684+0000","last_fullsized":"2024-03-30T12:41:25.764684+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889177+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:40:50.889177+0000","last_peered":"2024-03-30T12:40:50.889177+0000","last_clean":"2024-03-30T12:40:50.889177+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:40:50.889177+0000","last_undegraded":"2024-03-30T12:40:50.889177+0000","last_fullsized":"2024-03-30T12:40:50.889177+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:19.165034+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:42:19.165034+0000","last_peered":"2024-03-30T12:42:19.165034+0000","last_clean":"2024-03-30T12:42:19.165034+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:42:19.165034+0000","last_undegraded":"2024-03-30T12:42:19.165034+0000","last_fullsized":"2024-03-30T12:42:19.165034+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16483,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:09.584304+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:42:09.584304+0000","last_peered":"2024-03-30T12:42:09.584304+0000","last_clean":"2024-03-30T12:42:09.584304+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:42:09.584304+0000","last_undegraded":"2024-03-30T12:42:09.584304+0000","last_fullsized":"2024-03-30T12:42:09.584304+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889228+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:40:50.889228+0000","last_peered":"2024-03-30T12:40:50.889228+0000","last_clean":"2024-03-30T12:40:50.889228+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:40:50.889228+0000","last_undegraded":"2024-03-30T12:40:50.889228+0000","last_fullsized":"2024-03-30T12:40:50.889228+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1165,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:44.153535+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:40:44.153535+0000","last_peered":"2024-03-30T12:40:44.153535+0000","last_clean":"2024-03-30T12:40:44.153535+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:40:44.153535+0000","last_undegraded":"2024-03-30T12:40:44.153535+0000","last_fullsized":"2024-03-30T12:40:44.153535+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931449+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:41:23.931449+0000","last_peered":"2024-03-30T12:41:23.931449+0000","last_clean":"2024-03-30T12:41:23.931449+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:41:23.931449+0000","last_undegraded":"2024-03-30T12:41:23.931449+0000","last_fullsized":"2024-03-30T12:41:23.931449+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31271,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:41:02.302474+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:41:02.302474+0000","last_peered":"2024-03-30T12:41:02.302474+0000","last_clean":"2024-03-30T12:41:02.302474+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:41:02.302474+0000","last_undegraded":"2024-03-30T12:41:02.302474+0000","last_fullsized":"2024-03-30T12:41:02.302474+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672495+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:41:57.672495+0000","last_peered":"2024-03-30T12:41:57.672495+0000","last_clean":"2024-03-30T12:41:57.672495+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:41:57.672495+0000","last_undegraded":"2024-03-30T12:41:57.672495+0000","last_fullsized":"2024-03-30T12:41:57.672495+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1356,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935556+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:41:58.935556+0000","last_peered":"2024-03-30T12:41:58.935556+0000","last_clean":"2024-03-30T12:41:58.935556+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:41:58.935556+0000","last_undegraded":"2024-03-30T12:41:58.935556+0000","last_fullsized":"2024-03-30T12:41:58.935556+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666291+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:40:57.666291+0000","last_peered":"2024-03-30T12:40:57.666291+0000","last_clean":"2024-03-30T12:40:57.666291+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:40:57.666291+0000","last_undegraded":"2024-03-30T12:40:57.666291+0000","last_fullsized":"2024-03-30T12:40:57.666291+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3767,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672462+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:41:57.672462+0000","last_peered":"2024-03-30T12:41:57.672462+0000","last_clean":"2024-03-30T12:41:57.672462+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:41:57.672462+0000","last_undegraded":"2024-03-30T12:41:57.672462+0000","last_fullsized":"2024-03-30T12:41:57.672462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302452+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:41:02.302452+0000","last_peered":"2024-03-30T12:41:02.302452+0000","last_clean":"2024-03-30T12:41:02.302452+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:41:02.302452+0000","last_undegraded":"2024-03-30T12:41:02.302452+0000","last_fullsized":"2024-03-30T12:41:02.302452+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1157,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573285+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:40:29.573285+0000","last_peered":"2024-03-30T12:40:29.573285+0000","last_clean":"2024-03-30T12:40:29.573285+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:40:29.573285+0000","last_undegraded":"2024-03-30T12:40:29.573285+0000","last_fullsized":"2024-03-30T12:40:29.573285+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:25.764656+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:41:25.764656+0000","last_peered":"2024-03-30T12:41:25.764656+0000","last_clean":"2024-03-30T12:41:25.764656+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:41:25.764656+0000","last_undegraded":"2024-03-30T12:41:25.764656+0000","last_fullsized":"2024-03-30T12:41:25.764656+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15595,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:15.317660+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:40:15.317660+0000","last_peered":"2024-03-30T12:40:15.317660+0000","last_clean":"2024-03-30T12:40:15.317660+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:40:15.317660+0000","last_undegraded":"2024-03-30T12:40:15.317660+0000","last_fullsized":"2024-03-30T12:40:15.317660+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:09.156570+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:41:09.156570+0000","last_peered":"2024-03-30T12:41:09.156570+0000","last_clean":"2024-03-30T12:41:09.156570+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:41:09.156570+0000","last_undegraded":"2024-03-30T12:41:09.156570+0000","last_fullsized":"2024-03-30T12:41:09.156570+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:32.306064+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:41:32.306064+0000","last_peered":"2024-03-30T12:41:32.306064+0000","last_clean":"2024-03-30T12:41:32.306064+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:41:32.306064+0000","last_undegraded":"2024-03-30T12:41:32.306064+0000","last_fullsized":"2024-03-30T12:41:32.306064+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29022,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:02.309140+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:42:02.309140+0000","last_peered":"2024-03-30T12:42:02.309140+0000","last_clean":"2024-03-30T12:42:02.309140+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:42:02.309140+0000","last_undegraded":"2024-03-30T12:42:02.309140+0000","last_fullsized":"2024-03-30T12:42:02.309140+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935491+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:41:58.935491+0000","last_peered":"2024-03-30T12:41:58.935491+0000","last_clean":"2024-03-30T12:41:58.935491+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:41:58.935491+0000","last_undegraded":"2024-03-30T12:41:58.935491+0000","last_fullsized":"2024-03-30T12:41:58.935491+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666241+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:40:57.666241+0000","last_peered":"2024-03-30T12:40:57.666241+0000","last_clean":"2024-03-30T12:40:57.666241+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:40:57.666241+0000","last_undegraded":"2024-03-30T12:40:57.666241+0000","last_fullsized":"2024-03-30T12:40:57.666241+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5612,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:53.400722+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:40:53.400722+0000","last_peered":"2024-03-30T12:40:53.400722+0000","last_clean":"2024-03-30T12:40:53.400722+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:40:53.400722+0000","last_undegraded":"2024-03-30T12:40:53.400722+0000","last_fullsized":"2024-03-30T12:40:53.400722+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1367,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935518+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:41:58.935518+0000","last_peered":"2024-03-30T12:41:58.935518+0000","last_clean":"2024-03-30T12:41:58.935518+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:41:58.935518+0000","last_undegraded":"2024-03-30T12:41:58.935518+0000","last_fullsized":"2024-03-30T12:41:58.935518+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:27.669397+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:41:27.669397+0000","last_peered":"2024-03-30T12:41:27.669397+0000","last_clean":"2024-03-30T12:41:27.669397+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:41:27.669397+0000","last_undegraded":"2024-03-30T12:41:27.669397+0000","last_fullsized":"2024-03-30T12:41:27.669397+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4276,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:18.924042+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:40:18.924042+0000","last_peered":"2024-03-30T12:40:18.924042+0000","last_clean":"2024-03-30T12:40:18.924042+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:40:18.924042+0000","last_undegraded":"2024-03-30T12:40:18.924042+0000","last_fullsized":"2024-03-30T12:40:18.924042+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1156,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159584+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:41:34.159584+0000","last_peered":"2024-03-30T12:41:34.159584+0000","last_clean":"2024-03-30T12:41:34.159584+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:41:34.159584+0000","last_undegraded":"2024-03-30T12:41:34.159584+0000","last_fullsized":"2024-03-30T12:41:34.159584+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573205+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:40:29.573205+0000","last_peered":"2024-03-30T12:40:29.573205+0000","last_clean":"2024-03-30T12:40:29.573205+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:40:29.573205+0000","last_undegraded":"2024-03-30T12:40:29.573205+0000","last_fullsized":"2024-03-30T12:40:29.573205+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5255,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:53.400674+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:40:53.400674+0000","last_peered":"2024-03-30T12:40:53.400674+0000","last_clean":"2024-03-30T12:40:53.400674+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:40:53.400674+0000","last_undegraded":"2024-03-30T12:40:53.400674+0000","last_fullsized":"2024-03-30T12:40:53.400674+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:53.400708+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:40:53.400708+0000","last_peered":"2024-03-30T12:40:53.400708+0000","last_clean":"2024-03-30T12:40:53.400708+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:40:53.400708+0000","last_undegraded":"2024-03-30T12:40:53.400708+0000","last_fullsized":"2024-03-30T12:40:53.400708+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159619+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:41:34.159619+0000","last_peered":"2024-03-30T12:41:34.159619+0000","last_clean":"2024-03-30T12:41:34.159619+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:41:34.159619+0000","last_undegraded":"2024-03-30T12:41:34.159619+0000","last_fullsized":"2024-03-30T12:41:34.159619+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4812,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:23.397123+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:40:23.397123+0000","last_peered":"2024-03-30T12:40:23.397123+0000","last_clean":"2024-03-30T12:40:23.397123+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:40:23.397123+0000","last_undegraded":"2024-03-30T12:40:23.397123+0000","last_fullsized":"2024-03-30T12:40:23.397123+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:18.924078+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:40:18.924078+0000","last_peered":"2024-03-30T12:40:18.924078+0000","last_clean":"2024-03-30T12:40:18.924078+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:40:18.924078+0000","last_undegraded":"2024-03-30T12:40:18.924078+0000","last_fullsized":"2024-03-30T12:40:18.924078+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.317641+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:40:15.317641+0000","last_peered":"2024-03-30T12:40:15.317641+0000","last_clean":"2024-03-30T12:40:15.317641+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:40:15.317641+0000","last_undegraded":"2024-03-30T12:40:15.317641+0000","last_fullsized":"2024-03-30T12:40:15.317641+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6745,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:41:09.156602+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:41:09.156602+0000","last_peered":"2024-03-30T12:41:09.156602+0000","last_clean":"2024-03-30T12:41:09.156602+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:41:09.156602+0000","last_undegraded":"2024-03-30T12:41:09.156602+0000","last_fullsized":"2024-03-30T12:41:09.156602+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1339,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:53.400753+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:40:53.400753+0000","last_peered":"2024-03-30T12:40:53.400753+0000","last_clean":"2024-03-30T12:40:53.400753+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:40:53.400753+0000","last_undegraded":"2024-03-30T12:40:53.400753+0000","last_fullsized":"2024-03-30T12:40:53.400753+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159657+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:41:34.159657+0000","last_peered":"2024-03-30T12:41:34.159657+0000","last_clean":"2024-03-30T12:41:34.159657+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:41:34.159657+0000","last_undegraded":"2024-03-30T12:41:34.159657+0000","last_fullsized":"2024-03-30T12:41:34.159657+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1172,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:09.584262+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:42:09.584262+0000","last_peered":"2024-03-30T12:42:09.584262+0000","last_clean":"2024-03-30T12:42:09.584262+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:42:09.584262+0000","last_undegraded":"2024-03-30T12:42:09.584262+0000","last_fullsized":"2024-03-30T12:42:09.584262+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1335,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.407397+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:41:58.407397+0000","last_peered":"2024-03-30T12:41:58.407397+0000","last_clean":"2024-03-30T12:41:58.407397+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:41:58.407397+0000","last_undegraded":"2024-03-30T12:41:58.407397+0000","last_fullsized":"2024-03-30T12:41:58.407397+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326484+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:41:30.326484+0000","last_peered":"2024-03-30T12:41:30.326484+0000","last_clean":"2024-03-30T12:41:30.326484+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:41:30.326484+0000","last_undegraded":"2024-03-30T12:41:30.326484+0000","last_fullsized":"2024-03-30T12:41:30.326484+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889204+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:40:50.889204+0000","last_peered":"2024-03-30T12:40:50.889204+0000","last_clean":"2024-03-30T12:40:50.889204+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:40:50.889204+0000","last_undegraded":"2024-03-30T12:40:50.889204+0000","last_fullsized":"2024-03-30T12:40:50.889204+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666276+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:40:57.666276+0000","last_peered":"2024-03-30T12:40:57.666276+0000","last_clean":"2024-03-30T12:40:57.666276+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:40:57.666276+0000","last_undegraded":"2024-03-30T12:40:57.666276+0000","last_fullsized":"2024-03-30T12:40:57.666276+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935541+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:41:58.935541+0000","last_peered":"2024-03-30T12:41:58.935541+0000","last_clean":"2024-03-30T12:41:58.935541+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:41:58.935541+0000","last_undegraded":"2024-03-30T12:41:58.935541+0000","last_fullsized":"2024-03-30T12:41:58.935541+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1179,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573267+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:40:29.573267+0000","last_peered":"2024-03-30T12:40:29.573267+0000","last_clean":"2024-03-30T12:40:29.573267+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:40:29.573267+0000","last_undegraded":"2024-03-30T12:40:29.573267+0000","last_fullsized":"2024-03-30T12:40:29.573267+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1283,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666301+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:40:57.666301+0000","last_peered":"2024-03-30T12:40:57.666301+0000","last_clean":"2024-03-30T12:40:57.666301+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:40:57.666301+0000","last_undegraded":"2024-03-30T12:40:57.666301+0000","last_fullsized":"2024-03-30T12:40:57.666301+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:00.329894+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:42:00.329894+0000","last_peered":"2024-03-30T12:42:00.329894+0000","last_clean":"2024-03-30T12:42:00.329894+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:42:00.329894+0000","last_undegraded":"2024-03-30T12:42:00.329894+0000","last_fullsized":"2024-03-30T12:42:00.329894+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:27.669378+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:41:27.669378+0000","last_peered":"2024-03-30T12:41:27.669378+0000","last_clean":"2024-03-30T12:41:27.669378+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:41:27.669378+0000","last_undegraded":"2024-03-30T12:41:27.669378+0000","last_fullsized":"2024-03-30T12:41:27.669378+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1217,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.317602+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:40:15.317602+0000","last_peered":"2024-03-30T12:40:15.317602+0000","last_clean":"2024-03-30T12:40:15.317602+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:40:15.317602+0000","last_undegraded":"2024-03-30T12:40:15.317602+0000","last_fullsized":"2024-03-30T12:40:15.317602+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:00.768614+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:42:00.768614+0000","last_peered":"2024-03-30T12:42:00.768614+0000","last_clean":"2024-03-30T12:42:00.768614+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:42:00.768614+0000","last_undegraded":"2024-03-30T12:42:00.768614+0000","last_fullsized":"2024-03-30T12:42:00.768614+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:54.576179+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:40:54.576179+0000","last_peered":"2024-03-30T12:40:54.576179+0000","last_clean":"2024-03-30T12:40:54.576179+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:40:54.576179+0000","last_undegraded":"2024-03-30T12:40:54.576179+0000","last_fullsized":"2024-03-30T12:40:54.576179+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438122,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648178,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175189,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254427,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063246,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951303,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839360,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923642,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:44:29.658 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:29.658 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:29.658 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:29.658 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:29.658 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:29.658 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:29.658 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:29.658 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:29.658 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:29.658 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:29.659 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:29.659 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:29.659 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:29.659 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:44:30.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:30 smithi084 ceph-mon[89279]: pgmap v1243: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:30.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:30 smithi084 ceph-mon[89279]: from='client.44681 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:44:30.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:30 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:44:30.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:30 smithi084 ceph-mon[91810]: pgmap v1243: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:30.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:30 smithi084 ceph-mon[91810]: from='client.44681 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:44:30.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:30 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:44:30.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:30 smithi162 ceph-mon[83709]: pgmap v1243: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:30.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:30 smithi162 ceph-mon[83709]: from='client.44681 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:44:30.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:30 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:44:32.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:32 smithi084 ceph-mon[91810]: pgmap v1244: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:32.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:32 smithi084 ceph-mon[89279]: pgmap v1244: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:32.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:32 smithi162 ceph-mon[83709]: pgmap v1244: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:34.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:34 smithi084 ceph-mon[89279]: pgmap v1245: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:34.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:34 smithi084 ceph-mon[91810]: pgmap v1245: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:34.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:34 smithi162 ceph-mon[83709]: pgmap v1245: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:36.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:36 smithi084 ceph-mon[91810]: pgmap v1246: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:36.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:36 smithi084 ceph-mon[89279]: pgmap v1246: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:36.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:36 smithi162 ceph-mon[83709]: pgmap v1246: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:38.424 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:38 smithi162 ceph-mon[83709]: pgmap v1247: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:38.424 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:38 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:44:38.425 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:38 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:44:38.425 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:38 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:44:38.425 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:38 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:44:38.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:38 smithi084 ceph-mon[91810]: pgmap v1247: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:38.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:38 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:44:38.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:38 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:44:38.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:38 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:44:38.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:38 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:44:38.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:38 smithi084 ceph-mon[89279]: pgmap v1247: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:38.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:38 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:44:38.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:38 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:44:38.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:38 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:44:38.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:38 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:44:39.506 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:44:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:44:39] "GET /metrics HTTP/1.1" 200 36326 "" "Prometheus/2.43.0" 2024-03-30T12:44:39.660 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:44:39.866 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:44:40.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:40 smithi084 ceph-mon[91810]: pgmap v1248: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:40.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:40 smithi084 ceph-mon[89279]: pgmap v1248: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:40.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:40 smithi162 ceph-mon[83709]: pgmap v1248: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:41.921 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:44:41.923 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:44:42.236 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:42 smithi084 ceph-mon[89279]: pgmap v1249: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:42.236 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:42 smithi084 ceph-mon[91810]: pgmap v1249: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:42.525 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1249,"stamp":"2024-03-30T12:44:40.965645+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003748"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:44.153566+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:40:44.153566+0000","last_peered":"2024-03-30T12:40:44.153566+0000","last_clean":"2024-03-30T12:40:44.153566+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:40:44.153566+0000","last_undegraded":"2024-03-30T12:40:44.153566+0000","last_fullsized":"2024-03-30T12:40:44.153566+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1366,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931469+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:41:23.931469+0000","last_peered":"2024-03-30T12:41:23.931469+0000","last_clean":"2024-03-30T12:41:23.931469+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:41:23.931469+0000","last_undegraded":"2024-03-30T12:41:23.931469+0000","last_fullsized":"2024-03-30T12:41:23.931469+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889238+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:40:50.889238+0000","last_peered":"2024-03-30T12:40:50.889238+0000","last_clean":"2024-03-30T12:40:50.889238+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:40:50.889238+0000","last_undegraded":"2024-03-30T12:40:50.889238+0000","last_fullsized":"2024-03-30T12:40:50.889238+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:00.322650+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:41:00.322650+0000","last_peered":"2024-03-30T12:41:00.322650+0000","last_clean":"2024-03-30T12:41:00.322650+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:41:00.322650+0000","last_undegraded":"2024-03-30T12:41:00.322650+0000","last_fullsized":"2024-03-30T12:41:00.322650+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150593+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:40:19.150593+0000","last_peered":"2024-03-30T12:40:19.150593+0000","last_clean":"2024-03-30T12:40:19.150593+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:40:19.150593+0000","last_undegraded":"2024-03-30T12:40:19.150593+0000","last_fullsized":"2024-03-30T12:40:19.150593+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326493+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:41:30.326493+0000","last_peered":"2024-03-30T12:41:30.326493+0000","last_clean":"2024-03-30T12:41:30.326493+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:41:30.326493+0000","last_undegraded":"2024-03-30T12:41:30.326493+0000","last_fullsized":"2024-03-30T12:41:30.326493+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150576+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:40:19.150576+0000","last_peered":"2024-03-30T12:40:19.150576+0000","last_clean":"2024-03-30T12:40:19.150576+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:40:19.150576+0000","last_undegraded":"2024-03-30T12:40:19.150576+0000","last_fullsized":"2024-03-30T12:40:19.150576+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662744+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:40:27.662744+0000","last_peered":"2024-03-30T12:40:27.662744+0000","last_clean":"2024-03-30T12:40:27.662744+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:40:27.662744+0000","last_undegraded":"2024-03-30T12:40:27.662744+0000","last_fullsized":"2024-03-30T12:40:27.662744+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:59.148225+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:39:59.148225+0000","last_peered":"2024-03-30T12:39:59.148225+0000","last_clean":"2024-03-30T12:39:59.148225+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:39:59.148225+0000","last_undegraded":"2024-03-30T12:39:59.148225+0000","last_fullsized":"2024-03-30T12:39:59.148225+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581772+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:41:44.581772+0000","last_peered":"2024-03-30T12:41:44.581772+0000","last_clean":"2024-03-30T12:41:44.581772+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:41:44.581772+0000","last_undegraded":"2024-03-30T12:41:44.581772+0000","last_fullsized":"2024-03-30T12:41:44.581772+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581745+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:41:44.581745+0000","last_peered":"2024-03-30T12:41:44.581745+0000","last_clean":"2024-03-30T12:41:44.581745+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:41:44.581745+0000","last_undegraded":"2024-03-30T12:41:44.581745+0000","last_fullsized":"2024-03-30T12:41:44.581745+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1272,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:37.299828+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:40:37.299828+0000","last_peered":"2024-03-30T12:40:37.299828+0000","last_clean":"2024-03-30T12:40:37.299828+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:40:37.299828+0000","last_undegraded":"2024-03-30T12:40:37.299828+0000","last_fullsized":"2024-03-30T12:40:37.299828+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1290,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660090+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:40:02.660090+0000","last_peered":"2024-03-30T12:40:02.660090+0000","last_clean":"2024-03-30T12:40:02.660090+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:40:02.660090+0000","last_undegraded":"2024-03-30T12:40:02.660090+0000","last_fullsized":"2024-03-30T12:40:02.660090+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886008+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:40:15.886008+0000","last_peered":"2024-03-30T12:40:15.886008+0000","last_clean":"2024-03-30T12:40:15.886008+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:40:15.886008+0000","last_undegraded":"2024-03-30T12:40:15.886008+0000","last_fullsized":"2024-03-30T12:40:15.886008+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:48.927583+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:40:48.927583+0000","last_peered":"2024-03-30T12:40:48.927583+0000","last_clean":"2024-03-30T12:40:48.927583+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:40:48.927583+0000","last_undegraded":"2024-03-30T12:40:48.927583+0000","last_fullsized":"2024-03-30T12:40:48.927583+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320117+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:40:40.320117+0000","last_peered":"2024-03-30T12:40:40.320117+0000","last_clean":"2024-03-30T12:40:40.320117+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:40:40.320117+0000","last_undegraded":"2024-03-30T12:40:40.320117+0000","last_fullsized":"2024-03-30T12:40:40.320117+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1226,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320196+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:40:40.320196+0000","last_peered":"2024-03-30T12:40:40.320196+0000","last_clean":"2024-03-30T12:40:40.320196+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:40:40.320196+0000","last_undegraded":"2024-03-30T12:40:40.320196+0000","last_fullsized":"2024-03-30T12:40:40.320196+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.403697+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:41:23.403697+0000","last_peered":"2024-03-30T12:41:23.403697+0000","last_clean":"2024-03-30T12:41:23.403697+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:41:23.403697+0000","last_undegraded":"2024-03-30T12:41:23.403697+0000","last_fullsized":"2024-03-30T12:41:23.403697+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159632+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:41:34.159632+0000","last_peered":"2024-03-30T12:41:34.159632+0000","last_clean":"2024-03-30T12:41:34.159632+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:41:34.159632+0000","last_undegraded":"2024-03-30T12:41:34.159632+0000","last_fullsized":"2024-03-30T12:41:34.159632+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1390,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889293+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:40:50.889293+0000","last_peered":"2024-03-30T12:40:50.889293+0000","last_clean":"2024-03-30T12:40:50.889293+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:40:50.889293+0000","last_undegraded":"2024-03-30T12:40:50.889293+0000","last_fullsized":"2024-03-30T12:40:50.889293+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1285,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672522+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:41:57.672522+0000","last_peered":"2024-03-30T12:41:57.672522+0000","last_clean":"2024-03-30T12:41:57.672522+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:41:57.672522+0000","last_undegraded":"2024-03-30T12:41:57.672522+0000","last_fullsized":"2024-03-30T12:41:57.672522+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1304,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672534+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:41:57.672534+0000","last_peered":"2024-03-30T12:41:57.672534+0000","last_clean":"2024-03-30T12:41:57.672534+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:41:57.672534+0000","last_undegraded":"2024-03-30T12:41:57.672534+0000","last_fullsized":"2024-03-30T12:41:57.672534+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889279+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:40:50.889279+0000","last_peered":"2024-03-30T12:40:50.889279+0000","last_clean":"2024-03-30T12:40:50.889279+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:40:50.889279+0000","last_undegraded":"2024-03-30T12:40:50.889279+0000","last_fullsized":"2024-03-30T12:40:50.889279+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150628+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:40:19.150628+0000","last_peered":"2024-03-30T12:40:19.150628+0000","last_clean":"2024-03-30T12:40:19.150628+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:40:19.150628+0000","last_undegraded":"2024-03-30T12:40:19.150628+0000","last_fullsized":"2024-03-30T12:40:19.150628+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326512+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:41:30.326512+0000","last_peered":"2024-03-30T12:41:30.326512+0000","last_clean":"2024-03-30T12:41:30.326512+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:41:30.326512+0000","last_undegraded":"2024-03-30T12:41:30.326512+0000","last_fullsized":"2024-03-30T12:41:30.326512+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150608+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:40:19.150608+0000","last_peered":"2024-03-30T12:40:19.150608+0000","last_clean":"2024-03-30T12:40:19.150608+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:40:19.150608+0000","last_undegraded":"2024-03-30T12:40:19.150608+0000","last_fullsized":"2024-03-30T12:40:19.150608+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326527+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:41:30.326527+0000","last_peered":"2024-03-30T12:41:30.326527+0000","last_clean":"2024-03-30T12:41:30.326527+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:41:30.326527+0000","last_undegraded":"2024-03-30T12:41:30.326527+0000","last_fullsized":"2024-03-30T12:41:30.326527+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1263,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662819+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:40:27.662819+0000","last_peered":"2024-03-30T12:40:27.662819+0000","last_clean":"2024-03-30T12:40:27.662819+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:40:27.662819+0000","last_undegraded":"2024-03-30T12:40:27.662819+0000","last_fullsized":"2024-03-30T12:40:27.662819+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1264,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302503+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:41:02.302503+0000","last_peered":"2024-03-30T12:41:02.302503+0000","last_clean":"2024-03-30T12:41:02.302503+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:41:02.302503+0000","last_undegraded":"2024-03-30T12:41:02.302503+0000","last_fullsized":"2024-03-30T12:41:02.302503+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:09.584292+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:42:09.584292+0000","last_peered":"2024-03-30T12:42:09.584292+0000","last_clean":"2024-03-30T12:42:09.584292+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:42:09.584292+0000","last_undegraded":"2024-03-30T12:42:09.584292+0000","last_fullsized":"2024-03-30T12:42:09.584292+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:15.763333+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:41:15.763333+0000","last_peered":"2024-03-30T12:41:15.763333+0000","last_clean":"2024-03-30T12:41:15.763333+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:41:15.763333+0000","last_undegraded":"2024-03-30T12:41:15.763333+0000","last_fullsized":"2024-03-30T12:41:15.763333+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660073+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:40:02.660073+0000","last_peered":"2024-03-30T12:40:02.660073+0000","last_clean":"2024-03-30T12:40:02.660073+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:40:02.660073+0000","last_undegraded":"2024-03-30T12:40:02.660073+0000","last_fullsized":"2024-03-30T12:40:02.660073+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1296,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:02.660041+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:40:02.660041+0000","last_peered":"2024-03-30T12:40:02.660041+0000","last_clean":"2024-03-30T12:40:02.660041+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:40:02.660041+0000","last_undegraded":"2024-03-30T12:40:02.660041+0000","last_fullsized":"2024-03-30T12:40:02.660041+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1226,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323325+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:41:05.323325+0000","last_peered":"2024-03-30T12:41:05.323325+0000","last_clean":"2024-03-30T12:41:05.323325+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:41:05.323325+0000","last_undegraded":"2024-03-30T12:41:05.323325+0000","last_fullsized":"2024-03-30T12:41:05.323325+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:18.930743+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:41:18.930743+0000","last_peered":"2024-03-30T12:41:18.930743+0000","last_clean":"2024-03-30T12:41:18.930743+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:41:18.930743+0000","last_undegraded":"2024-03-30T12:41:18.930743+0000","last_fullsized":"2024-03-30T12:41:18.930743+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1172,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581788+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:41:44.581788+0000","last_peered":"2024-03-30T12:41:44.581788+0000","last_clean":"2024-03-30T12:41:44.581788+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:41:44.581788+0000","last_undegraded":"2024-03-30T12:41:44.581788+0000","last_fullsized":"2024-03-30T12:41:44.581788+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323382+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:41:05.323382+0000","last_peered":"2024-03-30T12:41:05.323382+0000","last_clean":"2024-03-30T12:41:05.323382+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:41:05.323382+0000","last_undegraded":"2024-03-30T12:41:05.323382+0000","last_fullsized":"2024-03-30T12:41:05.323382+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1200,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323370+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:41:05.323370+0000","last_peered":"2024-03-30T12:41:05.323370+0000","last_clean":"2024-03-30T12:41:05.323370+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:41:05.323370+0000","last_undegraded":"2024-03-30T12:41:05.323370+0000","last_fullsized":"2024-03-30T12:41:05.323370+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1293,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:53.406703+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:41:53.406703+0000","last_peered":"2024-03-30T12:41:53.406703+0000","last_clean":"2024-03-30T12:41:53.406703+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:41:53.406703+0000","last_undegraded":"2024-03-30T12:41:53.406703+0000","last_fullsized":"2024-03-30T12:41:53.406703+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:18.930787+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:41:18.930787+0000","last_peered":"2024-03-30T12:41:18.930787+0000","last_clean":"2024-03-30T12:41:18.930787+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:41:18.930787+0000","last_undegraded":"2024-03-30T12:41:18.930787+0000","last_fullsized":"2024-03-30T12:41:18.930787+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:12.297292+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:40:12.297292+0000","last_peered":"2024-03-30T12:40:12.297292+0000","last_clean":"2024-03-30T12:40:12.297292+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:40:12.297292+0000","last_undegraded":"2024-03-30T12:40:12.297292+0000","last_fullsized":"2024-03-30T12:40:12.297292+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1207,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579099+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:41:19.579099+0000","last_peered":"2024-03-30T12:41:19.579099+0000","last_clean":"2024-03-30T12:41:19.579099+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:41:19.579099+0000","last_undegraded":"2024-03-30T12:41:19.579099+0000","last_fullsized":"2024-03-30T12:41:19.579099+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:39:59.148189+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:39:59.148189+0000","last_peered":"2024-03-30T12:39:59.148189+0000","last_clean":"2024-03-30T12:39:59.148189+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:39:59.148189+0000","last_undegraded":"2024-03-30T12:39:59.148189+0000","last_fullsized":"2024-03-30T12:39:59.148189+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1385,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886047+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:40:15.886047+0000","last_peered":"2024-03-30T12:40:15.886047+0000","last_clean":"2024-03-30T12:40:15.886047+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:40:15.886047+0000","last_undegraded":"2024-03-30T12:40:15.886047+0000","last_fullsized":"2024-03-30T12:40:15.886047+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886029+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:40:15.886029+0000","last_peered":"2024-03-30T12:40:15.886029+0000","last_clean":"2024-03-30T12:40:15.886029+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:40:15.886029+0000","last_undegraded":"2024-03-30T12:40:15.886029+0000","last_fullsized":"2024-03-30T12:40:15.886029+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320162+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:40:40.320162+0000","last_peered":"2024-03-30T12:40:40.320162+0000","last_clean":"2024-03-30T12:40:40.320162+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:40:40.320162+0000","last_undegraded":"2024-03-30T12:40:40.320162+0000","last_fullsized":"2024-03-30T12:40:40.320162+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:59.162782+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:41:59.162782+0000","last_peered":"2024-03-30T12:41:59.162782+0000","last_clean":"2024-03-30T12:41:59.162782+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:41:59.162782+0000","last_undegraded":"2024-03-30T12:41:59.162782+0000","last_fullsized":"2024-03-30T12:41:59.162782+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1186,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579076+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:41:19.579076+0000","last_peered":"2024-03-30T12:41:19.579076+0000","last_clean":"2024-03-30T12:41:19.579076+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:41:19.579076+0000","last_undegraded":"2024-03-30T12:41:19.579076+0000","last_fullsized":"2024-03-30T12:41:19.579076+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579050+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:41:19.579050+0000","last_peered":"2024-03-30T12:41:19.579050+0000","last_clean":"2024-03-30T12:41:19.579050+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:41:19.579050+0000","last_undegraded":"2024-03-30T12:41:19.579050+0000","last_fullsized":"2024-03-30T12:41:19.579050+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1346,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.403657+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:41:23.403657+0000","last_peered":"2024-03-30T12:41:23.403657+0000","last_clean":"2024-03-30T12:41:23.403657+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:41:23.403657+0000","last_undegraded":"2024-03-30T12:41:23.403657+0000","last_fullsized":"2024-03-30T12:41:23.403657+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:59.162732+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:41:59.162732+0000","last_peered":"2024-03-30T12:41:59.162732+0000","last_clean":"2024-03-30T12:41:59.162732+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:41:59.162732+0000","last_undegraded":"2024-03-30T12:41:59.162732+0000","last_fullsized":"2024-03-30T12:41:59.162732+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5754,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:23.397042+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:40:23.397042+0000","last_peered":"2024-03-30T12:40:23.397042+0000","last_clean":"2024-03-30T12:40:23.397042+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:40:23.397042+0000","last_undegraded":"2024-03-30T12:40:23.397042+0000","last_fullsized":"2024-03-30T12:40:23.397042+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1277,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:02.309177+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:42:02.309177+0000","last_peered":"2024-03-30T12:42:02.309177+0000","last_clean":"2024-03-30T12:42:02.309177+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:42:02.309177+0000","last_undegraded":"2024-03-30T12:42:02.309177+0000","last_fullsized":"2024-03-30T12:42:02.309177+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159642+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:41:34.159642+0000","last_peered":"2024-03-30T12:41:34.159642+0000","last_clean":"2024-03-30T12:41:34.159642+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:41:34.159642+0000","last_undegraded":"2024-03-30T12:41:34.159642+0000","last_fullsized":"2024-03-30T12:41:34.159642+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5515,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:50.889213+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:40:50.889213+0000","last_peered":"2024-03-30T12:40:50.889213+0000","last_clean":"2024-03-30T12:40:50.889213+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:40:50.889213+0000","last_undegraded":"2024-03-30T12:40:50.889213+0000","last_fullsized":"2024-03-30T12:40:50.889213+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931401+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:41:23.931401+0000","last_peered":"2024-03-30T12:41:23.931401+0000","last_clean":"2024-03-30T12:41:23.931401+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:41:23.931401+0000","last_undegraded":"2024-03-30T12:41:23.931401+0000","last_fullsized":"2024-03-30T12:41:23.931401+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931427+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:41:23.931427+0000","last_peered":"2024-03-30T12:41:23.931427+0000","last_clean":"2024-03-30T12:41:23.931427+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:41:23.931427+0000","last_undegraded":"2024-03-30T12:41:23.931427+0000","last_fullsized":"2024-03-30T12:41:23.931427+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326520+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:41:30.326520+0000","last_peered":"2024-03-30T12:41:30.326520+0000","last_clean":"2024-03-30T12:41:30.326520+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:41:30.326520+0000","last_undegraded":"2024-03-30T12:41:30.326520+0000","last_fullsized":"2024-03-30T12:41:30.326520+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5460,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:50.889251+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:40:50.889251+0000","last_peered":"2024-03-30T12:40:50.889251+0000","last_clean":"2024-03-30T12:40:50.889251+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:40:50.889251+0000","last_undegraded":"2024-03-30T12:40:50.889251+0000","last_fullsized":"2024-03-30T12:40:50.889251+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931438+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:41:23.931438+0000","last_peered":"2024-03-30T12:41:23.931438+0000","last_clean":"2024-03-30T12:41:23.931438+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:41:23.931438+0000","last_undegraded":"2024-03-30T12:41:23.931438+0000","last_fullsized":"2024-03-30T12:41:23.931438+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1209,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326461+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:41:30.326461+0000","last_peered":"2024-03-30T12:41:30.326461+0000","last_clean":"2024-03-30T12:41:30.326461+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:41:30.326461+0000","last_undegraded":"2024-03-30T12:41:30.326461+0000","last_fullsized":"2024-03-30T12:41:30.326461+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302515+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:41:02.302515+0000","last_peered":"2024-03-30T12:41:02.302515+0000","last_clean":"2024-03-30T12:41:02.302515+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:41:02.302515+0000","last_undegraded":"2024-03-30T12:41:02.302515+0000","last_fullsized":"2024-03-30T12:41:02.302515+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3805,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:23.397156+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:40:23.397156+0000","last_peered":"2024-03-30T12:40:23.397156+0000","last_clean":"2024-03-30T12:40:23.397156+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:40:23.397156+0000","last_undegraded":"2024-03-30T12:40:23.397156+0000","last_fullsized":"2024-03-30T12:40:23.397156+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935569+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:41:58.935569+0000","last_peered":"2024-03-30T12:41:58.935569+0000","last_clean":"2024-03-30T12:41:58.935569+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:41:58.935569+0000","last_undegraded":"2024-03-30T12:41:58.935569+0000","last_fullsized":"2024-03-30T12:41:58.935569+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:48.927559+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:40:48.927559+0000","last_peered":"2024-03-30T12:40:48.927559+0000","last_clean":"2024-03-30T12:40:48.927559+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:40:48.927559+0000","last_undegraded":"2024-03-30T12:40:48.927559+0000","last_fullsized":"2024-03-30T12:40:48.927559+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.407376+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:41:58.407376+0000","last_peered":"2024-03-30T12:41:58.407376+0000","last_clean":"2024-03-30T12:41:58.407376+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:41:58.407376+0000","last_undegraded":"2024-03-30T12:41:58.407376+0000","last_fullsized":"2024-03-30T12:41:58.407376+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4578,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:44.153464+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:40:44.153464+0000","last_peered":"2024-03-30T12:40:44.153464+0000","last_clean":"2024-03-30T12:40:44.153464+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:40:44.153464+0000","last_undegraded":"2024-03-30T12:40:44.153464+0000","last_fullsized":"2024-03-30T12:40:44.153464+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1177,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:09.584340+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:42:09.584340+0000","last_peered":"2024-03-30T12:42:09.584340+0000","last_clean":"2024-03-30T12:42:09.584340+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:42:09.584340+0000","last_undegraded":"2024-03-30T12:42:09.584340+0000","last_fullsized":"2024-03-30T12:42:09.584340+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:32.676053+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:42:32.676053+0000","last_peered":"2024-03-30T12:42:32.676053+0000","last_clean":"2024-03-30T12:42:32.676053+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:42:32.676053+0000","last_undegraded":"2024-03-30T12:42:32.676053+0000","last_fullsized":"2024-03-30T12:42:32.676053+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1202,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326500+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:41:30.326500+0000","last_peered":"2024-03-30T12:41:30.326500+0000","last_clean":"2024-03-30T12:41:30.326500+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:41:30.326500+0000","last_undegraded":"2024-03-30T12:41:30.326500+0000","last_fullsized":"2024-03-30T12:41:30.326500+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1719,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:19.165060+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:42:19.165060+0000","last_peered":"2024-03-30T12:42:19.165060+0000","last_clean":"2024-03-30T12:42:19.165060+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:42:19.165060+0000","last_undegraded":"2024-03-30T12:42:19.165060+0000","last_fullsized":"2024-03-30T12:42:19.165060+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24716,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:00.329951+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:42:00.329951+0000","last_peered":"2024-03-30T12:42:00.329951+0000","last_clean":"2024-03-30T12:42:00.329951+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:42:00.329951+0000","last_undegraded":"2024-03-30T12:42:00.329951+0000","last_fullsized":"2024-03-30T12:42:00.329951+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:25.764684+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:41:25.764684+0000","last_peered":"2024-03-30T12:41:25.764684+0000","last_clean":"2024-03-30T12:41:25.764684+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:41:25.764684+0000","last_undegraded":"2024-03-30T12:41:25.764684+0000","last_fullsized":"2024-03-30T12:41:25.764684+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889177+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:40:50.889177+0000","last_peered":"2024-03-30T12:40:50.889177+0000","last_clean":"2024-03-30T12:40:50.889177+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:40:50.889177+0000","last_undegraded":"2024-03-30T12:40:50.889177+0000","last_fullsized":"2024-03-30T12:40:50.889177+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:19.165034+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:42:19.165034+0000","last_peered":"2024-03-30T12:42:19.165034+0000","last_clean":"2024-03-30T12:42:19.165034+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:42:19.165034+0000","last_undegraded":"2024-03-30T12:42:19.165034+0000","last_fullsized":"2024-03-30T12:42:19.165034+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16483,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:09.584304+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:42:09.584304+0000","last_peered":"2024-03-30T12:42:09.584304+0000","last_clean":"2024-03-30T12:42:09.584304+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:42:09.584304+0000","last_undegraded":"2024-03-30T12:42:09.584304+0000","last_fullsized":"2024-03-30T12:42:09.584304+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889228+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:40:50.889228+0000","last_peered":"2024-03-30T12:40:50.889228+0000","last_clean":"2024-03-30T12:40:50.889228+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:40:50.889228+0000","last_undegraded":"2024-03-30T12:40:50.889228+0000","last_fullsized":"2024-03-30T12:40:50.889228+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1165,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:44.153535+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:40:44.153535+0000","last_peered":"2024-03-30T12:40:44.153535+0000","last_clean":"2024-03-30T12:40:44.153535+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:40:44.153535+0000","last_undegraded":"2024-03-30T12:40:44.153535+0000","last_fullsized":"2024-03-30T12:40:44.153535+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931449+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:41:23.931449+0000","last_peered":"2024-03-30T12:41:23.931449+0000","last_clean":"2024-03-30T12:41:23.931449+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:41:23.931449+0000","last_undegraded":"2024-03-30T12:41:23.931449+0000","last_fullsized":"2024-03-30T12:41:23.931449+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31271,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:41:02.302474+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:41:02.302474+0000","last_peered":"2024-03-30T12:41:02.302474+0000","last_clean":"2024-03-30T12:41:02.302474+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:41:02.302474+0000","last_undegraded":"2024-03-30T12:41:02.302474+0000","last_fullsized":"2024-03-30T12:41:02.302474+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672495+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:41:57.672495+0000","last_peered":"2024-03-30T12:41:57.672495+0000","last_clean":"2024-03-30T12:41:57.672495+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:41:57.672495+0000","last_undegraded":"2024-03-30T12:41:57.672495+0000","last_fullsized":"2024-03-30T12:41:57.672495+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1356,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935556+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:41:58.935556+0000","last_peered":"2024-03-30T12:41:58.935556+0000","last_clean":"2024-03-30T12:41:58.935556+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:41:58.935556+0000","last_undegraded":"2024-03-30T12:41:58.935556+0000","last_fullsized":"2024-03-30T12:41:58.935556+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666291+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:40:57.666291+0000","last_peered":"2024-03-30T12:40:57.666291+0000","last_clean":"2024-03-30T12:40:57.666291+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:40:57.666291+0000","last_undegraded":"2024-03-30T12:40:57.666291+0000","last_fullsized":"2024-03-30T12:40:57.666291+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3767,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672462+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:41:57.672462+0000","last_peered":"2024-03-30T12:41:57.672462+0000","last_clean":"2024-03-30T12:41:57.672462+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:41:57.672462+0000","last_undegraded":"2024-03-30T12:41:57.672462+0000","last_fullsized":"2024-03-30T12:41:57.672462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302452+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:41:02.302452+0000","last_peered":"2024-03-30T12:41:02.302452+0000","last_clean":"2024-03-30T12:41:02.302452+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:41:02.302452+0000","last_undegraded":"2024-03-30T12:41:02.302452+0000","last_fullsized":"2024-03-30T12:41:02.302452+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1157,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573285+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:40:29.573285+0000","last_peered":"2024-03-30T12:40:29.573285+0000","last_clean":"2024-03-30T12:40:29.573285+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:40:29.573285+0000","last_undegraded":"2024-03-30T12:40:29.573285+0000","last_fullsized":"2024-03-30T12:40:29.573285+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:25.764656+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:41:25.764656+0000","last_peered":"2024-03-30T12:41:25.764656+0000","last_clean":"2024-03-30T12:41:25.764656+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:41:25.764656+0000","last_undegraded":"2024-03-30T12:41:25.764656+0000","last_fullsized":"2024-03-30T12:41:25.764656+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15595,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:15.317660+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:40:15.317660+0000","last_peered":"2024-03-30T12:40:15.317660+0000","last_clean":"2024-03-30T12:40:15.317660+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:40:15.317660+0000","last_undegraded":"2024-03-30T12:40:15.317660+0000","last_fullsized":"2024-03-30T12:40:15.317660+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:09.156570+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:41:09.156570+0000","last_peered":"2024-03-30T12:41:09.156570+0000","last_clean":"2024-03-30T12:41:09.156570+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:41:09.156570+0000","last_undegraded":"2024-03-30T12:41:09.156570+0000","last_fullsized":"2024-03-30T12:41:09.156570+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:32.306064+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:41:32.306064+0000","last_peered":"2024-03-30T12:41:32.306064+0000","last_clean":"2024-03-30T12:41:32.306064+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:41:32.306064+0000","last_undegraded":"2024-03-30T12:41:32.306064+0000","last_fullsized":"2024-03-30T12:41:32.306064+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29022,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:02.309140+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:42:02.309140+0000","last_peered":"2024-03-30T12:42:02.309140+0000","last_clean":"2024-03-30T12:42:02.309140+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:42:02.309140+0000","last_undegraded":"2024-03-30T12:42:02.309140+0000","last_fullsized":"2024-03-30T12:42:02.309140+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935491+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:41:58.935491+0000","last_peered":"2024-03-30T12:41:58.935491+0000","last_clean":"2024-03-30T12:41:58.935491+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:41:58.935491+0000","last_undegraded":"2024-03-30T12:41:58.935491+0000","last_fullsized":"2024-03-30T12:41:58.935491+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666241+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:40:57.666241+0000","last_peered":"2024-03-30T12:40:57.666241+0000","last_clean":"2024-03-30T12:40:57.666241+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:40:57.666241+0000","last_undegraded":"2024-03-30T12:40:57.666241+0000","last_fullsized":"2024-03-30T12:40:57.666241+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5612,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:53.400722+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:40:53.400722+0000","last_peered":"2024-03-30T12:40:53.400722+0000","last_clean":"2024-03-30T12:40:53.400722+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:40:53.400722+0000","last_undegraded":"2024-03-30T12:40:53.400722+0000","last_fullsized":"2024-03-30T12:40:53.400722+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1367,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935518+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:41:58.935518+0000","last_peered":"2024-03-30T12:41:58.935518+0000","last_clean":"2024-03-30T12:41:58.935518+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:41:58.935518+0000","last_undegraded":"2024-03-30T12:41:58.935518+0000","last_fullsized":"2024-03-30T12:41:58.935518+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:27.669397+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:41:27.669397+0000","last_peered":"2024-03-30T12:41:27.669397+0000","last_clean":"2024-03-30T12:41:27.669397+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:41:27.669397+0000","last_undegraded":"2024-03-30T12:41:27.669397+0000","last_fullsized":"2024-03-30T12:41:27.669397+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4276,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:18.924042+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:40:18.924042+0000","last_peered":"2024-03-30T12:40:18.924042+0000","last_clean":"2024-03-30T12:40:18.924042+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:40:18.924042+0000","last_undegraded":"2024-03-30T12:40:18.924042+0000","last_fullsized":"2024-03-30T12:40:18.924042+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1156,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159584+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:41:34.159584+0000","last_peered":"2024-03-30T12:41:34.159584+0000","last_clean":"2024-03-30T12:41:34.159584+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:41:34.159584+0000","last_undegraded":"2024-03-30T12:41:34.159584+0000","last_fullsized":"2024-03-30T12:41:34.159584+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573205+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:40:29.573205+0000","last_peered":"2024-03-30T12:40:29.573205+0000","last_clean":"2024-03-30T12:40:29.573205+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:40:29.573205+0000","last_undegraded":"2024-03-30T12:40:29.573205+0000","last_fullsized":"2024-03-30T12:40:29.573205+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5255,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:53.400674+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:40:53.400674+0000","last_peered":"2024-03-30T12:40:53.400674+0000","last_clean":"2024-03-30T12:40:53.400674+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:40:53.400674+0000","last_undegraded":"2024-03-30T12:40:53.400674+0000","last_fullsized":"2024-03-30T12:40:53.400674+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:53.400708+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:40:53.400708+0000","last_peered":"2024-03-30T12:40:53.400708+0000","last_clean":"2024-03-30T12:40:53.400708+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:40:53.400708+0000","last_undegraded":"2024-03-30T12:40:53.400708+0000","last_fullsized":"2024-03-30T12:40:53.400708+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159619+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:41:34.159619+0000","last_peered":"2024-03-30T12:41:34.159619+0000","last_clean":"2024-03-30T12:41:34.159619+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:41:34.159619+0000","last_undegraded":"2024-03-30T12:41:34.159619+0000","last_fullsized":"2024-03-30T12:41:34.159619+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4812,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:23.397123+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:40:23.397123+0000","last_peered":"2024-03-30T12:40:23.397123+0000","last_clean":"2024-03-30T12:40:23.397123+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:40:23.397123+0000","last_undegraded":"2024-03-30T12:40:23.397123+0000","last_fullsized":"2024-03-30T12:40:23.397123+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1353,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:18.924078+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:40:18.924078+0000","last_peered":"2024-03-30T12:40:18.924078+0000","last_clean":"2024-03-30T12:40:18.924078+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:40:18.924078+0000","last_undegraded":"2024-03-30T12:40:18.924078+0000","last_fullsized":"2024-03-30T12:40:18.924078+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1234,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.317641+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:40:15.317641+0000","last_peered":"2024-03-30T12:40:15.317641+0000","last_clean":"2024-03-30T12:40:15.317641+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:40:15.317641+0000","last_undegraded":"2024-03-30T12:40:15.317641+0000","last_fullsized":"2024-03-30T12:40:15.317641+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6745,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:41:09.156602+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:41:09.156602+0000","last_peered":"2024-03-30T12:41:09.156602+0000","last_clean":"2024-03-30T12:41:09.156602+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:41:09.156602+0000","last_undegraded":"2024-03-30T12:41:09.156602+0000","last_fullsized":"2024-03-30T12:41:09.156602+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1339,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:53.400753+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:40:53.400753+0000","last_peered":"2024-03-30T12:40:53.400753+0000","last_clean":"2024-03-30T12:40:53.400753+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:40:53.400753+0000","last_undegraded":"2024-03-30T12:40:53.400753+0000","last_fullsized":"2024-03-30T12:40:53.400753+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159657+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:41:34.159657+0000","last_peered":"2024-03-30T12:41:34.159657+0000","last_clean":"2024-03-30T12:41:34.159657+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:41:34.159657+0000","last_undegraded":"2024-03-30T12:41:34.159657+0000","last_fullsized":"2024-03-30T12:41:34.159657+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1172,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:09.584262+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:42:09.584262+0000","last_peered":"2024-03-30T12:42:09.584262+0000","last_clean":"2024-03-30T12:42:09.584262+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:42:09.584262+0000","last_undegraded":"2024-03-30T12:42:09.584262+0000","last_fullsized":"2024-03-30T12:42:09.584262+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1335,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.407397+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:41:58.407397+0000","last_peered":"2024-03-30T12:41:58.407397+0000","last_clean":"2024-03-30T12:41:58.407397+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:41:58.407397+0000","last_undegraded":"2024-03-30T12:41:58.407397+0000","last_fullsized":"2024-03-30T12:41:58.407397+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326484+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:41:30.326484+0000","last_peered":"2024-03-30T12:41:30.326484+0000","last_clean":"2024-03-30T12:41:30.326484+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:41:30.326484+0000","last_undegraded":"2024-03-30T12:41:30.326484+0000","last_fullsized":"2024-03-30T12:41:30.326484+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889204+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:40:50.889204+0000","last_peered":"2024-03-30T12:40:50.889204+0000","last_clean":"2024-03-30T12:40:50.889204+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:40:50.889204+0000","last_undegraded":"2024-03-30T12:40:50.889204+0000","last_fullsized":"2024-03-30T12:40:50.889204+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666276+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:40:57.666276+0000","last_peered":"2024-03-30T12:40:57.666276+0000","last_clean":"2024-03-30T12:40:57.666276+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:40:57.666276+0000","last_undegraded":"2024-03-30T12:40:57.666276+0000","last_fullsized":"2024-03-30T12:40:57.666276+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935541+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:41:58.935541+0000","last_peered":"2024-03-30T12:41:58.935541+0000","last_clean":"2024-03-30T12:41:58.935541+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:41:58.935541+0000","last_undegraded":"2024-03-30T12:41:58.935541+0000","last_fullsized":"2024-03-30T12:41:58.935541+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1179,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:29.573267+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:40:29.573267+0000","last_peered":"2024-03-30T12:40:29.573267+0000","last_clean":"2024-03-30T12:40:29.573267+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:40:29.573267+0000","last_undegraded":"2024-03-30T12:40:29.573267+0000","last_fullsized":"2024-03-30T12:40:29.573267+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1283,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666301+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:40:57.666301+0000","last_peered":"2024-03-30T12:40:57.666301+0000","last_clean":"2024-03-30T12:40:57.666301+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:40:57.666301+0000","last_undegraded":"2024-03-30T12:40:57.666301+0000","last_fullsized":"2024-03-30T12:40:57.666301+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:00.329894+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:42:00.329894+0000","last_peered":"2024-03-30T12:42:00.329894+0000","last_clean":"2024-03-30T12:42:00.329894+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:42:00.329894+0000","last_undegraded":"2024-03-30T12:42:00.329894+0000","last_fullsized":"2024-03-30T12:42:00.329894+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:27.669378+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:41:27.669378+0000","last_peered":"2024-03-30T12:41:27.669378+0000","last_clean":"2024-03-30T12:41:27.669378+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:41:27.669378+0000","last_undegraded":"2024-03-30T12:41:27.669378+0000","last_fullsized":"2024-03-30T12:41:27.669378+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1217,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.317602+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:40:15.317602+0000","last_peered":"2024-03-30T12:40:15.317602+0000","last_clean":"2024-03-30T12:40:15.317602+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:40:15.317602+0000","last_undegraded":"2024-03-30T12:40:15.317602+0000","last_fullsized":"2024-03-30T12:40:15.317602+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:00.768614+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:42:00.768614+0000","last_peered":"2024-03-30T12:42:00.768614+0000","last_clean":"2024-03-30T12:42:00.768614+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:42:00.768614+0000","last_undegraded":"2024-03-30T12:42:00.768614+0000","last_fullsized":"2024-03-30T12:42:00.768614+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:54.576179+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:40:54.576179+0000","last_peered":"2024-03-30T12:40:54.576179+0000","last_clean":"2024-03-30T12:40:54.576179+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:40:54.576179+0000","last_undegraded":"2024-03-30T12:40:54.576179+0000","last_fullsized":"2024-03-30T12:40:54.576179+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438125,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648181,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175191,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254430,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063248,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951305,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839362,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923645,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:44:42.531 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:42.531 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:42.531 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:42.531 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:42.531 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:42.531 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:42.532 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:42.532 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:42.532 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:42.532 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:42.532 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:42.532 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:42.532 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:42.532 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:44:42.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:42 smithi162 ceph-mon[83709]: pgmap v1249: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:43.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:43 smithi084 ceph-mon[91810]: from='client.34752 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:44:43.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:43 smithi084 ceph-mon[89279]: from='client.34752 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:44:43.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:43 smithi162 ceph-mon[83709]: from='client.34752 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:44:44.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:44 smithi084 ceph-mon[91810]: pgmap v1250: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:44.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:44 smithi084 ceph-mon[89279]: pgmap v1250: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:44.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:44 smithi162 ceph-mon[83709]: pgmap v1250: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:45.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:44:45.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:44:45.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:44:46.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:46 smithi084 ceph-mon[91810]: pgmap v1251: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:46.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:46 smithi084 ceph-mon[89279]: pgmap v1251: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:46.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:46 smithi162 ceph-mon[83709]: pgmap v1251: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:48.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:48 smithi084 ceph-mon[91810]: pgmap v1252: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:48.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:48 smithi084 ceph-mon[89279]: pgmap v1252: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:48.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:48 smithi162 ceph-mon[83709]: pgmap v1252: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:49.756 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:44:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:44:49] "GET /metrics HTTP/1.1" 200 36324 "" "Prometheus/2.43.0" 2024-03-30T12:44:50.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:50 smithi084 ceph-mon[89279]: pgmap v1253: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:50.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:50 smithi084 ceph-mon[91810]: pgmap v1253: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:50.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:50 smithi162 ceph-mon[83709]: pgmap v1253: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:52.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:52 smithi084 ceph-mon[91810]: pgmap v1254: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:52.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:52 smithi084 ceph-mon[89279]: pgmap v1254: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:52.533 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:44:52.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:52 smithi162 ceph-mon[83709]: pgmap v1254: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:52.753 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:44:54.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:54 smithi084 ceph-mon[89279]: pgmap v1255: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:54.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:54 smithi084 ceph-mon[91810]: pgmap v1255: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:54.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:54 smithi162 ceph-mon[83709]: pgmap v1255: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:54.648 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:44:54.650 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:44:55.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:55 smithi084 ceph-mon[89279]: from='client.34758 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:44:55.256 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:55 smithi084 ceph-mon[91810]: from='client.34758 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:44:55.353 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1255,"stamp":"2024-03-30T12:44:52.969502+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003857"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1149,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:44.153566+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:40:44.153566+0000","last_peered":"2024-03-30T12:40:44.153566+0000","last_clean":"2024-03-30T12:40:44.153566+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:40:44.153566+0000","last_undegraded":"2024-03-30T12:40:44.153566+0000","last_fullsized":"2024-03-30T12:40:44.153566+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1366,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931469+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:41:23.931469+0000","last_peered":"2024-03-30T12:41:23.931469+0000","last_clean":"2024-03-30T12:41:23.931469+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:41:23.931469+0000","last_undegraded":"2024-03-30T12:41:23.931469+0000","last_fullsized":"2024-03-30T12:41:23.931469+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889238+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:40:50.889238+0000","last_peered":"2024-03-30T12:40:50.889238+0000","last_clean":"2024-03-30T12:40:50.889238+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:40:50.889238+0000","last_undegraded":"2024-03-30T12:40:50.889238+0000","last_fullsized":"2024-03-30T12:40:50.889238+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:00.322650+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:41:00.322650+0000","last_peered":"2024-03-30T12:41:00.322650+0000","last_clean":"2024-03-30T12:41:00.322650+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:41:00.322650+0000","last_undegraded":"2024-03-30T12:41:00.322650+0000","last_fullsized":"2024-03-30T12:41:00.322650+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150593+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:40:19.150593+0000","last_peered":"2024-03-30T12:40:19.150593+0000","last_clean":"2024-03-30T12:40:19.150593+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:40:19.150593+0000","last_undegraded":"2024-03-30T12:40:19.150593+0000","last_fullsized":"2024-03-30T12:40:19.150593+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326493+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:41:30.326493+0000","last_peered":"2024-03-30T12:41:30.326493+0000","last_clean":"2024-03-30T12:41:30.326493+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:41:30.326493+0000","last_undegraded":"2024-03-30T12:41:30.326493+0000","last_fullsized":"2024-03-30T12:41:30.326493+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150576+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:40:19.150576+0000","last_peered":"2024-03-30T12:40:19.150576+0000","last_clean":"2024-03-30T12:40:19.150576+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:40:19.150576+0000","last_undegraded":"2024-03-30T12:40:19.150576+0000","last_fullsized":"2024-03-30T12:40:19.150576+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662744+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:40:27.662744+0000","last_peered":"2024-03-30T12:40:27.662744+0000","last_clean":"2024-03-30T12:40:27.662744+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:40:27.662744+0000","last_undegraded":"2024-03-30T12:40:27.662744+0000","last_fullsized":"2024-03-30T12:40:27.662744+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1151,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:24.165680+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:42:24.165680+0000","last_peered":"2024-03-30T12:42:24.165680+0000","last_clean":"2024-03-30T12:42:24.165680+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:42:24.165680+0000","last_undegraded":"2024-03-30T12:42:24.165680+0000","last_fullsized":"2024-03-30T12:42:24.165680+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581772+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:41:44.581772+0000","last_peered":"2024-03-30T12:41:44.581772+0000","last_clean":"2024-03-30T12:41:44.581772+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:41:44.581772+0000","last_undegraded":"2024-03-30T12:41:44.581772+0000","last_fullsized":"2024-03-30T12:41:44.581772+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581745+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:41:44.581745+0000","last_peered":"2024-03-30T12:41:44.581745+0000","last_clean":"2024-03-30T12:41:44.581745+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:41:44.581745+0000","last_undegraded":"2024-03-30T12:41:44.581745+0000","last_fullsized":"2024-03-30T12:41:44.581745+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1272,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:37.299828+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:40:37.299828+0000","last_peered":"2024-03-30T12:40:37.299828+0000","last_clean":"2024-03-30T12:40:37.299828+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:40:37.299828+0000","last_undegraded":"2024-03-30T12:40:37.299828+0000","last_fullsized":"2024-03-30T12:40:37.299828+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:27.675670+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:42:27.675670+0000","last_peered":"2024-03-30T12:42:27.675670+0000","last_clean":"2024-03-30T12:42:27.675670+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:42:27.675670+0000","last_undegraded":"2024-03-30T12:42:27.675670+0000","last_fullsized":"2024-03-30T12:42:27.675670+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886008+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:40:15.886008+0000","last_peered":"2024-03-30T12:40:15.886008+0000","last_clean":"2024-03-30T12:40:15.886008+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:40:15.886008+0000","last_undegraded":"2024-03-30T12:40:15.886008+0000","last_fullsized":"2024-03-30T12:40:15.886008+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:48.927583+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:40:48.927583+0000","last_peered":"2024-03-30T12:40:48.927583+0000","last_clean":"2024-03-30T12:40:48.927583+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:40:48.927583+0000","last_undegraded":"2024-03-30T12:40:48.927583+0000","last_fullsized":"2024-03-30T12:40:48.927583+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320117+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:40:40.320117+0000","last_peered":"2024-03-30T12:40:40.320117+0000","last_clean":"2024-03-30T12:40:40.320117+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:40:40.320117+0000","last_undegraded":"2024-03-30T12:40:40.320117+0000","last_fullsized":"2024-03-30T12:40:40.320117+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1226,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320196+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:40:40.320196+0000","last_peered":"2024-03-30T12:40:40.320196+0000","last_clean":"2024-03-30T12:40:40.320196+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:40:40.320196+0000","last_undegraded":"2024-03-30T12:40:40.320196+0000","last_fullsized":"2024-03-30T12:40:40.320196+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.403697+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:41:23.403697+0000","last_peered":"2024-03-30T12:41:23.403697+0000","last_clean":"2024-03-30T12:41:23.403697+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:41:23.403697+0000","last_undegraded":"2024-03-30T12:41:23.403697+0000","last_fullsized":"2024-03-30T12:41:23.403697+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159632+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:41:34.159632+0000","last_peered":"2024-03-30T12:41:34.159632+0000","last_clean":"2024-03-30T12:41:34.159632+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:41:34.159632+0000","last_undegraded":"2024-03-30T12:41:34.159632+0000","last_fullsized":"2024-03-30T12:41:34.159632+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1390,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889293+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:40:50.889293+0000","last_peered":"2024-03-30T12:40:50.889293+0000","last_clean":"2024-03-30T12:40:50.889293+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:40:50.889293+0000","last_undegraded":"2024-03-30T12:40:50.889293+0000","last_fullsized":"2024-03-30T12:40:50.889293+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1285,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672522+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:41:57.672522+0000","last_peered":"2024-03-30T12:41:57.672522+0000","last_clean":"2024-03-30T12:41:57.672522+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:41:57.672522+0000","last_undegraded":"2024-03-30T12:41:57.672522+0000","last_fullsized":"2024-03-30T12:41:57.672522+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1304,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672534+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:41:57.672534+0000","last_peered":"2024-03-30T12:41:57.672534+0000","last_clean":"2024-03-30T12:41:57.672534+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:41:57.672534+0000","last_undegraded":"2024-03-30T12:41:57.672534+0000","last_fullsized":"2024-03-30T12:41:57.672534+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889279+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:40:50.889279+0000","last_peered":"2024-03-30T12:40:50.889279+0000","last_clean":"2024-03-30T12:40:50.889279+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:40:50.889279+0000","last_undegraded":"2024-03-30T12:40:50.889279+0000","last_fullsized":"2024-03-30T12:40:50.889279+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150628+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:40:19.150628+0000","last_peered":"2024-03-30T12:40:19.150628+0000","last_clean":"2024-03-30T12:40:19.150628+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:40:19.150628+0000","last_undegraded":"2024-03-30T12:40:19.150628+0000","last_fullsized":"2024-03-30T12:40:19.150628+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326512+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:41:30.326512+0000","last_peered":"2024-03-30T12:41:30.326512+0000","last_clean":"2024-03-30T12:41:30.326512+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:41:30.326512+0000","last_undegraded":"2024-03-30T12:41:30.326512+0000","last_fullsized":"2024-03-30T12:41:30.326512+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150608+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:40:19.150608+0000","last_peered":"2024-03-30T12:40:19.150608+0000","last_clean":"2024-03-30T12:40:19.150608+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:40:19.150608+0000","last_undegraded":"2024-03-30T12:40:19.150608+0000","last_fullsized":"2024-03-30T12:40:19.150608+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326527+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:41:30.326527+0000","last_peered":"2024-03-30T12:41:30.326527+0000","last_clean":"2024-03-30T12:41:30.326527+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:41:30.326527+0000","last_undegraded":"2024-03-30T12:41:30.326527+0000","last_fullsized":"2024-03-30T12:41:30.326527+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1263,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662819+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:40:27.662819+0000","last_peered":"2024-03-30T12:40:27.662819+0000","last_clean":"2024-03-30T12:40:27.662819+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:40:27.662819+0000","last_undegraded":"2024-03-30T12:40:27.662819+0000","last_fullsized":"2024-03-30T12:40:27.662819+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1264,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302503+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:41:02.302503+0000","last_peered":"2024-03-30T12:41:02.302503+0000","last_clean":"2024-03-30T12:41:02.302503+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:41:02.302503+0000","last_undegraded":"2024-03-30T12:41:02.302503+0000","last_fullsized":"2024-03-30T12:41:02.302503+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:09.584292+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:42:09.584292+0000","last_peered":"2024-03-30T12:42:09.584292+0000","last_clean":"2024-03-30T12:42:09.584292+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:42:09.584292+0000","last_undegraded":"2024-03-30T12:42:09.584292+0000","last_fullsized":"2024-03-30T12:42:09.584292+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:15.763333+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:41:15.763333+0000","last_peered":"2024-03-30T12:41:15.763333+0000","last_clean":"2024-03-30T12:41:15.763333+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:41:15.763333+0000","last_undegraded":"2024-03-30T12:41:15.763333+0000","last_fullsized":"2024-03-30T12:41:15.763333+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1300,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:27.675651+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:42:27.675651+0000","last_peered":"2024-03-30T12:42:27.675651+0000","last_clean":"2024-03-30T12:42:27.675651+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:42:27.675651+0000","last_undegraded":"2024-03-30T12:42:27.675651+0000","last_fullsized":"2024-03-30T12:42:27.675651+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:27.675619+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:42:27.675619+0000","last_peered":"2024-03-30T12:42:27.675619+0000","last_clean":"2024-03-30T12:42:27.675619+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:42:27.675619+0000","last_undegraded":"2024-03-30T12:42:27.675619+0000","last_fullsized":"2024-03-30T12:42:27.675619+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1226,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323325+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:41:05.323325+0000","last_peered":"2024-03-30T12:41:05.323325+0000","last_clean":"2024-03-30T12:41:05.323325+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:41:05.323325+0000","last_undegraded":"2024-03-30T12:41:05.323325+0000","last_fullsized":"2024-03-30T12:41:05.323325+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:18.930743+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:41:18.930743+0000","last_peered":"2024-03-30T12:41:18.930743+0000","last_clean":"2024-03-30T12:41:18.930743+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:41:18.930743+0000","last_undegraded":"2024-03-30T12:41:18.930743+0000","last_fullsized":"2024-03-30T12:41:18.930743+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1172,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581788+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:41:44.581788+0000","last_peered":"2024-03-30T12:41:44.581788+0000","last_clean":"2024-03-30T12:41:44.581788+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:41:44.581788+0000","last_undegraded":"2024-03-30T12:41:44.581788+0000","last_fullsized":"2024-03-30T12:41:44.581788+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323382+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:41:05.323382+0000","last_peered":"2024-03-30T12:41:05.323382+0000","last_clean":"2024-03-30T12:41:05.323382+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:41:05.323382+0000","last_undegraded":"2024-03-30T12:41:05.323382+0000","last_fullsized":"2024-03-30T12:41:05.323382+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1200,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323370+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:41:05.323370+0000","last_peered":"2024-03-30T12:41:05.323370+0000","last_clean":"2024-03-30T12:41:05.323370+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:41:05.323370+0000","last_undegraded":"2024-03-30T12:41:05.323370+0000","last_fullsized":"2024-03-30T12:41:05.323370+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1293,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:53.406703+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:41:53.406703+0000","last_peered":"2024-03-30T12:41:53.406703+0000","last_clean":"2024-03-30T12:41:53.406703+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:41:53.406703+0000","last_undegraded":"2024-03-30T12:41:53.406703+0000","last_fullsized":"2024-03-30T12:41:53.406703+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:18.930787+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:41:18.930787+0000","last_peered":"2024-03-30T12:41:18.930787+0000","last_clean":"2024-03-30T12:41:18.930787+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:41:18.930787+0000","last_undegraded":"2024-03-30T12:41:18.930787+0000","last_fullsized":"2024-03-30T12:41:18.930787+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:32.312127+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:42:32.312127+0000","last_peered":"2024-03-30T12:42:32.312127+0000","last_clean":"2024-03-30T12:42:32.312127+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:42:32.312127+0000","last_undegraded":"2024-03-30T12:42:32.312127+0000","last_fullsized":"2024-03-30T12:42:32.312127+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1207,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579099+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:41:19.579099+0000","last_peered":"2024-03-30T12:41:19.579099+0000","last_clean":"2024-03-30T12:41:19.579099+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:41:19.579099+0000","last_undegraded":"2024-03-30T12:41:19.579099+0000","last_fullsized":"2024-03-30T12:41:19.579099+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:24.165645+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:42:24.165645+0000","last_peered":"2024-03-30T12:42:24.165645+0000","last_clean":"2024-03-30T12:42:24.165645+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:42:24.165645+0000","last_undegraded":"2024-03-30T12:42:24.165645+0000","last_fullsized":"2024-03-30T12:42:24.165645+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1385,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886047+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:40:15.886047+0000","last_peered":"2024-03-30T12:40:15.886047+0000","last_clean":"2024-03-30T12:40:15.886047+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:40:15.886047+0000","last_undegraded":"2024-03-30T12:40:15.886047+0000","last_fullsized":"2024-03-30T12:40:15.886047+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:15.886029+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:40:15.886029+0000","last_peered":"2024-03-30T12:40:15.886029+0000","last_clean":"2024-03-30T12:40:15.886029+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:40:15.886029+0000","last_undegraded":"2024-03-30T12:40:15.886029+0000","last_fullsized":"2024-03-30T12:40:15.886029+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320162+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:40:40.320162+0000","last_peered":"2024-03-30T12:40:40.320162+0000","last_clean":"2024-03-30T12:40:40.320162+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:40:40.320162+0000","last_undegraded":"2024-03-30T12:40:40.320162+0000","last_fullsized":"2024-03-30T12:40:40.320162+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:59.162782+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:41:59.162782+0000","last_peered":"2024-03-30T12:41:59.162782+0000","last_clean":"2024-03-30T12:41:59.162782+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:41:59.162782+0000","last_undegraded":"2024-03-30T12:41:59.162782+0000","last_fullsized":"2024-03-30T12:41:59.162782+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1186,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579076+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:41:19.579076+0000","last_peered":"2024-03-30T12:41:19.579076+0000","last_clean":"2024-03-30T12:41:19.579076+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:41:19.579076+0000","last_undegraded":"2024-03-30T12:41:19.579076+0000","last_fullsized":"2024-03-30T12:41:19.579076+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579050+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:41:19.579050+0000","last_peered":"2024-03-30T12:41:19.579050+0000","last_clean":"2024-03-30T12:41:19.579050+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:41:19.579050+0000","last_undegraded":"2024-03-30T12:41:19.579050+0000","last_fullsized":"2024-03-30T12:41:19.579050+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1346,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.403657+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:41:23.403657+0000","last_peered":"2024-03-30T12:41:23.403657+0000","last_clean":"2024-03-30T12:41:23.403657+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:41:23.403657+0000","last_undegraded":"2024-03-30T12:41:23.403657+0000","last_fullsized":"2024-03-30T12:41:23.403657+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:59.162732+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:41:59.162732+0000","last_peered":"2024-03-30T12:41:59.162732+0000","last_clean":"2024-03-30T12:41:59.162732+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:41:59.162732+0000","last_undegraded":"2024-03-30T12:41:59.162732+0000","last_fullsized":"2024-03-30T12:41:59.162732+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5755,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:33.411173+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:42:33.411173+0000","last_peered":"2024-03-30T12:42:33.411173+0000","last_clean":"2024-03-30T12:42:33.411173+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:42:33.411173+0000","last_undegraded":"2024-03-30T12:42:33.411173+0000","last_fullsized":"2024-03-30T12:42:33.411173+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1277,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:02.309177+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:42:02.309177+0000","last_peered":"2024-03-30T12:42:02.309177+0000","last_clean":"2024-03-30T12:42:02.309177+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:42:02.309177+0000","last_undegraded":"2024-03-30T12:42:02.309177+0000","last_fullsized":"2024-03-30T12:42:02.309177+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159642+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:41:34.159642+0000","last_peered":"2024-03-30T12:41:34.159642+0000","last_clean":"2024-03-30T12:41:34.159642+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:41:34.159642+0000","last_undegraded":"2024-03-30T12:41:34.159642+0000","last_fullsized":"2024-03-30T12:41:34.159642+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5515,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:50.889213+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:40:50.889213+0000","last_peered":"2024-03-30T12:40:50.889213+0000","last_clean":"2024-03-30T12:40:50.889213+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:40:50.889213+0000","last_undegraded":"2024-03-30T12:40:50.889213+0000","last_fullsized":"2024-03-30T12:40:50.889213+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931401+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:41:23.931401+0000","last_peered":"2024-03-30T12:41:23.931401+0000","last_clean":"2024-03-30T12:41:23.931401+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:41:23.931401+0000","last_undegraded":"2024-03-30T12:41:23.931401+0000","last_fullsized":"2024-03-30T12:41:23.931401+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931427+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:41:23.931427+0000","last_peered":"2024-03-30T12:41:23.931427+0000","last_clean":"2024-03-30T12:41:23.931427+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:41:23.931427+0000","last_undegraded":"2024-03-30T12:41:23.931427+0000","last_fullsized":"2024-03-30T12:41:23.931427+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326520+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:41:30.326520+0000","last_peered":"2024-03-30T12:41:30.326520+0000","last_clean":"2024-03-30T12:41:30.326520+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:41:30.326520+0000","last_undegraded":"2024-03-30T12:41:30.326520+0000","last_fullsized":"2024-03-30T12:41:30.326520+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5460,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:50.889251+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:40:50.889251+0000","last_peered":"2024-03-30T12:40:50.889251+0000","last_clean":"2024-03-30T12:40:50.889251+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:40:50.889251+0000","last_undegraded":"2024-03-30T12:40:50.889251+0000","last_fullsized":"2024-03-30T12:40:50.889251+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931438+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:41:23.931438+0000","last_peered":"2024-03-30T12:41:23.931438+0000","last_clean":"2024-03-30T12:41:23.931438+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:41:23.931438+0000","last_undegraded":"2024-03-30T12:41:23.931438+0000","last_fullsized":"2024-03-30T12:41:23.931438+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1209,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326461+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:41:30.326461+0000","last_peered":"2024-03-30T12:41:30.326461+0000","last_clean":"2024-03-30T12:41:30.326461+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:41:30.326461+0000","last_undegraded":"2024-03-30T12:41:30.326461+0000","last_fullsized":"2024-03-30T12:41:30.326461+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302515+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:41:02.302515+0000","last_peered":"2024-03-30T12:41:02.302515+0000","last_clean":"2024-03-30T12:41:02.302515+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:41:02.302515+0000","last_undegraded":"2024-03-30T12:41:02.302515+0000","last_fullsized":"2024-03-30T12:41:02.302515+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3806,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:33.411258+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:42:33.411258+0000","last_peered":"2024-03-30T12:42:33.411258+0000","last_clean":"2024-03-30T12:42:33.411258+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:42:33.411258+0000","last_undegraded":"2024-03-30T12:42:33.411258+0000","last_fullsized":"2024-03-30T12:42:33.411258+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935569+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:41:58.935569+0000","last_peered":"2024-03-30T12:41:58.935569+0000","last_clean":"2024-03-30T12:41:58.935569+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:41:58.935569+0000","last_undegraded":"2024-03-30T12:41:58.935569+0000","last_fullsized":"2024-03-30T12:41:58.935569+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:48.940828+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:42:48.940828+0000","last_peered":"2024-03-30T12:42:48.940828+0000","last_clean":"2024-03-30T12:42:48.940828+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:42:48.940828+0000","last_undegraded":"2024-03-30T12:42:48.940828+0000","last_fullsized":"2024-03-30T12:42:48.940828+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.407376+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:41:58.407376+0000","last_peered":"2024-03-30T12:41:58.407376+0000","last_clean":"2024-03-30T12:41:58.407376+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:41:58.407376+0000","last_undegraded":"2024-03-30T12:41:58.407376+0000","last_fullsized":"2024-03-30T12:41:58.407376+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4578,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:44.153464+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:40:44.153464+0000","last_peered":"2024-03-30T12:40:44.153464+0000","last_clean":"2024-03-30T12:40:44.153464+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:40:44.153464+0000","last_undegraded":"2024-03-30T12:40:44.153464+0000","last_fullsized":"2024-03-30T12:40:44.153464+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1177,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:09.584340+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:42:09.584340+0000","last_peered":"2024-03-30T12:42:09.584340+0000","last_clean":"2024-03-30T12:42:09.584340+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:42:09.584340+0000","last_undegraded":"2024-03-30T12:42:09.584340+0000","last_fullsized":"2024-03-30T12:42:09.584340+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:32.676053+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:42:32.676053+0000","last_peered":"2024-03-30T12:42:32.676053+0000","last_clean":"2024-03-30T12:42:32.676053+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:42:32.676053+0000","last_undegraded":"2024-03-30T12:42:32.676053+0000","last_fullsized":"2024-03-30T12:42:32.676053+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1202,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326500+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:41:30.326500+0000","last_peered":"2024-03-30T12:41:30.326500+0000","last_clean":"2024-03-30T12:41:30.326500+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:41:30.326500+0000","last_undegraded":"2024-03-30T12:41:30.326500+0000","last_fullsized":"2024-03-30T12:41:30.326500+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1719,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:19.165060+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:42:19.165060+0000","last_peered":"2024-03-30T12:42:19.165060+0000","last_clean":"2024-03-30T12:42:19.165060+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:42:19.165060+0000","last_undegraded":"2024-03-30T12:42:19.165060+0000","last_fullsized":"2024-03-30T12:42:19.165060+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24716,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:00.329951+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:42:00.329951+0000","last_peered":"2024-03-30T12:42:00.329951+0000","last_clean":"2024-03-30T12:42:00.329951+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:42:00.329951+0000","last_undegraded":"2024-03-30T12:42:00.329951+0000","last_fullsized":"2024-03-30T12:42:00.329951+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:25.764684+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:41:25.764684+0000","last_peered":"2024-03-30T12:41:25.764684+0000","last_clean":"2024-03-30T12:41:25.764684+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:41:25.764684+0000","last_undegraded":"2024-03-30T12:41:25.764684+0000","last_fullsized":"2024-03-30T12:41:25.764684+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889177+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:40:50.889177+0000","last_peered":"2024-03-30T12:40:50.889177+0000","last_clean":"2024-03-30T12:40:50.889177+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:40:50.889177+0000","last_undegraded":"2024-03-30T12:40:50.889177+0000","last_fullsized":"2024-03-30T12:40:50.889177+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:19.165034+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:42:19.165034+0000","last_peered":"2024-03-30T12:42:19.165034+0000","last_clean":"2024-03-30T12:42:19.165034+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:42:19.165034+0000","last_undegraded":"2024-03-30T12:42:19.165034+0000","last_fullsized":"2024-03-30T12:42:19.165034+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16483,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:09.584304+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:42:09.584304+0000","last_peered":"2024-03-30T12:42:09.584304+0000","last_clean":"2024-03-30T12:42:09.584304+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:42:09.584304+0000","last_undegraded":"2024-03-30T12:42:09.584304+0000","last_fullsized":"2024-03-30T12:42:09.584304+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889228+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:40:50.889228+0000","last_peered":"2024-03-30T12:40:50.889228+0000","last_clean":"2024-03-30T12:40:50.889228+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:40:50.889228+0000","last_undegraded":"2024-03-30T12:40:50.889228+0000","last_fullsized":"2024-03-30T12:40:50.889228+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1165,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:44.153535+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:40:44.153535+0000","last_peered":"2024-03-30T12:40:44.153535+0000","last_clean":"2024-03-30T12:40:44.153535+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:40:44.153535+0000","last_undegraded":"2024-03-30T12:40:44.153535+0000","last_fullsized":"2024-03-30T12:40:44.153535+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931449+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:41:23.931449+0000","last_peered":"2024-03-30T12:41:23.931449+0000","last_clean":"2024-03-30T12:41:23.931449+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:41:23.931449+0000","last_undegraded":"2024-03-30T12:41:23.931449+0000","last_fullsized":"2024-03-30T12:41:23.931449+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31271,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:41:02.302474+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:41:02.302474+0000","last_peered":"2024-03-30T12:41:02.302474+0000","last_clean":"2024-03-30T12:41:02.302474+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:41:02.302474+0000","last_undegraded":"2024-03-30T12:41:02.302474+0000","last_fullsized":"2024-03-30T12:41:02.302474+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672495+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:41:57.672495+0000","last_peered":"2024-03-30T12:41:57.672495+0000","last_clean":"2024-03-30T12:41:57.672495+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:41:57.672495+0000","last_undegraded":"2024-03-30T12:41:57.672495+0000","last_fullsized":"2024-03-30T12:41:57.672495+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1356,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935556+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:41:58.935556+0000","last_peered":"2024-03-30T12:41:58.935556+0000","last_clean":"2024-03-30T12:41:58.935556+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:41:58.935556+0000","last_undegraded":"2024-03-30T12:41:58.935556+0000","last_fullsized":"2024-03-30T12:41:58.935556+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666291+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:40:57.666291+0000","last_peered":"2024-03-30T12:40:57.666291+0000","last_clean":"2024-03-30T12:40:57.666291+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:40:57.666291+0000","last_undegraded":"2024-03-30T12:40:57.666291+0000","last_fullsized":"2024-03-30T12:40:57.666291+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3767,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672462+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:41:57.672462+0000","last_peered":"2024-03-30T12:41:57.672462+0000","last_clean":"2024-03-30T12:41:57.672462+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:41:57.672462+0000","last_undegraded":"2024-03-30T12:41:57.672462+0000","last_fullsized":"2024-03-30T12:41:57.672462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302452+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:41:02.302452+0000","last_peered":"2024-03-30T12:41:02.302452+0000","last_clean":"2024-03-30T12:41:02.302452+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:41:02.302452+0000","last_undegraded":"2024-03-30T12:41:02.302452+0000","last_fullsized":"2024-03-30T12:41:02.302452+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1158,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:39.587408+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:42:39.587408+0000","last_peered":"2024-03-30T12:42:39.587408+0000","last_clean":"2024-03-30T12:42:39.587408+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:42:39.587408+0000","last_undegraded":"2024-03-30T12:42:39.587408+0000","last_fullsized":"2024-03-30T12:42:39.587408+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:25.764656+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:41:25.764656+0000","last_peered":"2024-03-30T12:41:25.764656+0000","last_clean":"2024-03-30T12:41:25.764656+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:41:25.764656+0000","last_undegraded":"2024-03-30T12:41:25.764656+0000","last_fullsized":"2024-03-30T12:41:25.764656+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15596,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:30.333267+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:42:30.333267+0000","last_peered":"2024-03-30T12:42:30.333267+0000","last_clean":"2024-03-30T12:42:30.333267+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:42:30.333267+0000","last_undegraded":"2024-03-30T12:42:30.333267+0000","last_fullsized":"2024-03-30T12:42:30.333267+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:09.156570+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:41:09.156570+0000","last_peered":"2024-03-30T12:41:09.156570+0000","last_clean":"2024-03-30T12:41:09.156570+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:41:09.156570+0000","last_undegraded":"2024-03-30T12:41:09.156570+0000","last_fullsized":"2024-03-30T12:41:09.156570+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:32.306064+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:41:32.306064+0000","last_peered":"2024-03-30T12:41:32.306064+0000","last_clean":"2024-03-30T12:41:32.306064+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:41:32.306064+0000","last_undegraded":"2024-03-30T12:41:32.306064+0000","last_fullsized":"2024-03-30T12:41:32.306064+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29022,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:02.309140+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:42:02.309140+0000","last_peered":"2024-03-30T12:42:02.309140+0000","last_clean":"2024-03-30T12:42:02.309140+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:42:02.309140+0000","last_undegraded":"2024-03-30T12:42:02.309140+0000","last_fullsized":"2024-03-30T12:42:02.309140+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935491+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:41:58.935491+0000","last_peered":"2024-03-30T12:41:58.935491+0000","last_clean":"2024-03-30T12:41:58.935491+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:41:58.935491+0000","last_undegraded":"2024-03-30T12:41:58.935491+0000","last_fullsized":"2024-03-30T12:41:58.935491+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666241+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:40:57.666241+0000","last_peered":"2024-03-30T12:40:57.666241+0000","last_clean":"2024-03-30T12:40:57.666241+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:40:57.666241+0000","last_undegraded":"2024-03-30T12:40:57.666241+0000","last_fullsized":"2024-03-30T12:40:57.666241+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5612,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:53.400722+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:40:53.400722+0000","last_peered":"2024-03-30T12:40:53.400722+0000","last_clean":"2024-03-30T12:40:53.400722+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:40:53.400722+0000","last_undegraded":"2024-03-30T12:40:53.400722+0000","last_fullsized":"2024-03-30T12:40:53.400722+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1367,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935518+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:41:58.935518+0000","last_peered":"2024-03-30T12:41:58.935518+0000","last_clean":"2024-03-30T12:41:58.935518+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:41:58.935518+0000","last_undegraded":"2024-03-30T12:41:58.935518+0000","last_fullsized":"2024-03-30T12:41:58.935518+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:27.669397+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:41:27.669397+0000","last_peered":"2024-03-30T12:41:27.669397+0000","last_clean":"2024-03-30T12:41:27.669397+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:41:27.669397+0000","last_undegraded":"2024-03-30T12:41:27.669397+0000","last_fullsized":"2024-03-30T12:41:27.669397+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4277,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:33.939063+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:42:33.939063+0000","last_peered":"2024-03-30T12:42:33.939063+0000","last_clean":"2024-03-30T12:42:33.939063+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:42:33.939063+0000","last_undegraded":"2024-03-30T12:42:33.939063+0000","last_fullsized":"2024-03-30T12:42:33.939063+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1156,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159584+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:41:34.159584+0000","last_peered":"2024-03-30T12:41:34.159584+0000","last_clean":"2024-03-30T12:41:34.159584+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:41:34.159584+0000","last_undegraded":"2024-03-30T12:41:34.159584+0000","last_fullsized":"2024-03-30T12:41:34.159584+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1186,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:39.587344+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:42:39.587344+0000","last_peered":"2024-03-30T12:42:39.587344+0000","last_clean":"2024-03-30T12:42:39.587344+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:42:39.587344+0000","last_undegraded":"2024-03-30T12:42:39.587344+0000","last_fullsized":"2024-03-30T12:42:39.587344+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5255,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:53.400674+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:40:53.400674+0000","last_peered":"2024-03-30T12:40:53.400674+0000","last_clean":"2024-03-30T12:40:53.400674+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:40:53.400674+0000","last_undegraded":"2024-03-30T12:40:53.400674+0000","last_fullsized":"2024-03-30T12:40:53.400674+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:53.400708+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:40:53.400708+0000","last_peered":"2024-03-30T12:40:53.400708+0000","last_clean":"2024-03-30T12:40:53.400708+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:40:53.400708+0000","last_undegraded":"2024-03-30T12:40:53.400708+0000","last_fullsized":"2024-03-30T12:40:53.400708+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159619+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:41:34.159619+0000","last_peered":"2024-03-30T12:41:34.159619+0000","last_clean":"2024-03-30T12:41:34.159619+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:41:34.159619+0000","last_undegraded":"2024-03-30T12:41:34.159619+0000","last_fullsized":"2024-03-30T12:41:34.159619+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4813,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:33.411213+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:42:33.411213+0000","last_peered":"2024-03-30T12:42:33.411213+0000","last_clean":"2024-03-30T12:42:33.411213+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:42:33.411213+0000","last_undegraded":"2024-03-30T12:42:33.411213+0000","last_fullsized":"2024-03-30T12:42:33.411213+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:33.939095+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:42:33.939095+0000","last_peered":"2024-03-30T12:42:33.939095+0000","last_clean":"2024-03-30T12:42:33.939095+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:42:33.939095+0000","last_undegraded":"2024-03-30T12:42:33.939095+0000","last_fullsized":"2024-03-30T12:42:33.939095+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:30.333244+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:42:30.333244+0000","last_peered":"2024-03-30T12:42:30.333244+0000","last_clean":"2024-03-30T12:42:30.333244+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:42:30.333244+0000","last_undegraded":"2024-03-30T12:42:30.333244+0000","last_fullsized":"2024-03-30T12:42:30.333244+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6745,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:41:09.156602+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:41:09.156602+0000","last_peered":"2024-03-30T12:41:09.156602+0000","last_clean":"2024-03-30T12:41:09.156602+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:41:09.156602+0000","last_undegraded":"2024-03-30T12:41:09.156602+0000","last_fullsized":"2024-03-30T12:41:09.156602+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1339,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:53.400753+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:40:53.400753+0000","last_peered":"2024-03-30T12:40:53.400753+0000","last_clean":"2024-03-30T12:40:53.400753+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:40:53.400753+0000","last_undegraded":"2024-03-30T12:40:53.400753+0000","last_fullsized":"2024-03-30T12:40:53.400753+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159657+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:41:34.159657+0000","last_peered":"2024-03-30T12:41:34.159657+0000","last_clean":"2024-03-30T12:41:34.159657+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:41:34.159657+0000","last_undegraded":"2024-03-30T12:41:34.159657+0000","last_fullsized":"2024-03-30T12:41:34.159657+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1172,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:09.584262+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:42:09.584262+0000","last_peered":"2024-03-30T12:42:09.584262+0000","last_clean":"2024-03-30T12:42:09.584262+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:42:09.584262+0000","last_undegraded":"2024-03-30T12:42:09.584262+0000","last_fullsized":"2024-03-30T12:42:09.584262+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1335,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.407397+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:41:58.407397+0000","last_peered":"2024-03-30T12:41:58.407397+0000","last_clean":"2024-03-30T12:41:58.407397+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:41:58.407397+0000","last_undegraded":"2024-03-30T12:41:58.407397+0000","last_fullsized":"2024-03-30T12:41:58.407397+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326484+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:41:30.326484+0000","last_peered":"2024-03-30T12:41:30.326484+0000","last_clean":"2024-03-30T12:41:30.326484+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:41:30.326484+0000","last_undegraded":"2024-03-30T12:41:30.326484+0000","last_fullsized":"2024-03-30T12:41:30.326484+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:50.889204+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:40:50.889204+0000","last_peered":"2024-03-30T12:40:50.889204+0000","last_clean":"2024-03-30T12:40:50.889204+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:40:50.889204+0000","last_undegraded":"2024-03-30T12:40:50.889204+0000","last_fullsized":"2024-03-30T12:40:50.889204+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666276+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:40:57.666276+0000","last_peered":"2024-03-30T12:40:57.666276+0000","last_clean":"2024-03-30T12:40:57.666276+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:40:57.666276+0000","last_undegraded":"2024-03-30T12:40:57.666276+0000","last_fullsized":"2024-03-30T12:40:57.666276+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935541+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:41:58.935541+0000","last_peered":"2024-03-30T12:41:58.935541+0000","last_clean":"2024-03-30T12:41:58.935541+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:41:58.935541+0000","last_undegraded":"2024-03-30T12:41:58.935541+0000","last_fullsized":"2024-03-30T12:41:58.935541+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1180,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:39.587396+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:42:39.587396+0000","last_peered":"2024-03-30T12:42:39.587396+0000","last_clean":"2024-03-30T12:42:39.587396+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:42:39.587396+0000","last_undegraded":"2024-03-30T12:42:39.587396+0000","last_fullsized":"2024-03-30T12:42:39.587396+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1283,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666301+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:40:57.666301+0000","last_peered":"2024-03-30T12:40:57.666301+0000","last_clean":"2024-03-30T12:40:57.666301+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:40:57.666301+0000","last_undegraded":"2024-03-30T12:40:57.666301+0000","last_fullsized":"2024-03-30T12:40:57.666301+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:00.329894+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:42:00.329894+0000","last_peered":"2024-03-30T12:42:00.329894+0000","last_clean":"2024-03-30T12:42:00.329894+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:42:00.329894+0000","last_undegraded":"2024-03-30T12:42:00.329894+0000","last_fullsized":"2024-03-30T12:42:00.329894+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:27.669378+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:41:27.669378+0000","last_peered":"2024-03-30T12:41:27.669378+0000","last_clean":"2024-03-30T12:41:27.669378+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:41:27.669378+0000","last_undegraded":"2024-03-30T12:41:27.669378+0000","last_fullsized":"2024-03-30T12:41:27.669378+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1218,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:30.333212+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:42:30.333212+0000","last_peered":"2024-03-30T12:42:30.333212+0000","last_clean":"2024-03-30T12:42:30.333212+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:42:30.333212+0000","last_undegraded":"2024-03-30T12:42:30.333212+0000","last_fullsized":"2024-03-30T12:42:30.333212+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:00.768614+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:42:00.768614+0000","last_peered":"2024-03-30T12:42:00.768614+0000","last_clean":"2024-03-30T12:42:00.768614+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:42:00.768614+0000","last_undegraded":"2024-03-30T12:42:00.768614+0000","last_fullsized":"2024-03-30T12:42:00.768614+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:54.576179+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:40:54.576179+0000","last_peered":"2024-03-30T12:40:54.576179+0000","last_clean":"2024-03-30T12:40:54.576179+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:40:54.576179+0000","last_undegraded":"2024-03-30T12:40:54.576179+0000","last_fullsized":"2024-03-30T12:40:54.576179+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438127,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648183,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175193,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254432,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063250,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951308,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839365,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923647,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:44:55.359 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:55.359 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:55.359 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:55.359 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:55.359 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:55.359 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:55.359 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:55.359 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:55.359 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:55.359 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:55.359 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:55.359 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:55.359 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:44:55.359 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:44:55.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:55 smithi162 ceph-mon[83709]: from='client.34758 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:44:56.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:56 smithi084 ceph-mon[91810]: pgmap v1256: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:56.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:56 smithi084 ceph-mon[89279]: pgmap v1256: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:56.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:56 smithi162 ceph-mon[83709]: pgmap v1256: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:58.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:44:58 smithi084 ceph-mon[91810]: pgmap v1257: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:58.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:44:58 smithi084 ceph-mon[89279]: pgmap v1257: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:58.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:44:58 smithi162 ceph-mon[83709]: pgmap v1257: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:44:59.756 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:44:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:44:59] "GET /metrics HTTP/1.1" 200 36324 "" "Prometheus/2.43.0" 2024-03-30T12:45:00.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:00 smithi084 ceph-mon[89279]: pgmap v1258: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:00.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:00 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:45:00.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:00 smithi084 ceph-mon[91810]: pgmap v1258: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:00.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:00 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:45:00.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:00 smithi162 ceph-mon[83709]: pgmap v1258: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:00.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:00 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:45:02.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:02 smithi084 ceph-mon[91810]: pgmap v1259: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:02.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:02 smithi084 ceph-mon[89279]: pgmap v1259: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:02.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:02 smithi162 ceph-mon[83709]: pgmap v1259: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:04.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:04 smithi084 ceph-mon[91810]: pgmap v1260: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:04.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:04 smithi084 ceph-mon[89279]: pgmap v1260: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:04.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:04 smithi162 ceph-mon[83709]: pgmap v1260: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:05.361 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:45:05.582 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:45:06.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:06 smithi084 ceph-mon[91810]: pgmap v1261: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:06.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:06 smithi084 ceph-mon[89279]: pgmap v1261: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:06.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:06 smithi162 ceph-mon[83709]: pgmap v1261: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:07.602 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:45:07.604 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:45:08.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:08 smithi084 ceph-mon[89279]: pgmap v1262: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:08.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:08 smithi084 ceph-mon[89279]: from='client.34764 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:45:08.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:08 smithi084 ceph-mon[91810]: pgmap v1262: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:08.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:08 smithi084 ceph-mon[91810]: from='client.34764 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:45:08.334 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1262,"stamp":"2024-03-30T12:45:06.973999+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004017"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:49.168735+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:42:49.168735+0000","last_peered":"2024-03-30T12:42:49.168735+0000","last_clean":"2024-03-30T12:42:49.168735+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:42:49.168735+0000","last_undegraded":"2024-03-30T12:42:49.168735+0000","last_fullsized":"2024-03-30T12:42:49.168735+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1366,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931469+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:41:23.931469+0000","last_peered":"2024-03-30T12:41:23.931469+0000","last_clean":"2024-03-30T12:41:23.931469+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:41:23.931469+0000","last_undegraded":"2024-03-30T12:41:23.931469+0000","last_fullsized":"2024-03-30T12:41:23.931469+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:55.774228+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:42:55.774228+0000","last_peered":"2024-03-30T12:42:55.774228+0000","last_clean":"2024-03-30T12:42:55.774228+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:42:55.774228+0000","last_undegraded":"2024-03-30T12:42:55.774228+0000","last_fullsized":"2024-03-30T12:42:55.774228+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1236,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:00.336746+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:43:00.336746+0000","last_peered":"2024-03-30T12:43:00.336746+0000","last_clean":"2024-03-30T12:43:00.336746+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:43:00.336746+0000","last_undegraded":"2024-03-30T12:43:00.336746+0000","last_fullsized":"2024-03-30T12:43:00.336746+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150593+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:40:19.150593+0000","last_peered":"2024-03-30T12:40:19.150593+0000","last_clean":"2024-03-30T12:40:19.150593+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:40:19.150593+0000","last_undegraded":"2024-03-30T12:40:19.150593+0000","last_fullsized":"2024-03-30T12:40:19.150593+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326493+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:41:30.326493+0000","last_peered":"2024-03-30T12:41:30.326493+0000","last_clean":"2024-03-30T12:41:30.326493+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:41:30.326493+0000","last_undegraded":"2024-03-30T12:41:30.326493+0000","last_fullsized":"2024-03-30T12:41:30.326493+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150576+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:40:19.150576+0000","last_peered":"2024-03-30T12:40:19.150576+0000","last_clean":"2024-03-30T12:40:19.150576+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:40:19.150576+0000","last_undegraded":"2024-03-30T12:40:19.150576+0000","last_fullsized":"2024-03-30T12:40:19.150576+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662744+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:40:27.662744+0000","last_peered":"2024-03-30T12:40:27.662744+0000","last_clean":"2024-03-30T12:40:27.662744+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:40:27.662744+0000","last_undegraded":"2024-03-30T12:40:27.662744+0000","last_fullsized":"2024-03-30T12:40:27.662744+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1151,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:24.165680+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:42:24.165680+0000","last_peered":"2024-03-30T12:42:24.165680+0000","last_clean":"2024-03-30T12:42:24.165680+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:42:24.165680+0000","last_undegraded":"2024-03-30T12:42:24.165680+0000","last_fullsized":"2024-03-30T12:42:24.165680+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581772+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:41:44.581772+0000","last_peered":"2024-03-30T12:41:44.581772+0000","last_clean":"2024-03-30T12:41:44.581772+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:41:44.581772+0000","last_undegraded":"2024-03-30T12:41:44.581772+0000","last_fullsized":"2024-03-30T12:41:44.581772+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581745+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:41:44.581745+0000","last_peered":"2024-03-30T12:41:44.581745+0000","last_clean":"2024-03-30T12:41:44.581745+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:41:44.581745+0000","last_undegraded":"2024-03-30T12:41:44.581745+0000","last_fullsized":"2024-03-30T12:41:44.581745+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1272,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:37.299828+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:40:37.299828+0000","last_peered":"2024-03-30T12:40:37.299828+0000","last_clean":"2024-03-30T12:40:37.299828+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:40:37.299828+0000","last_undegraded":"2024-03-30T12:40:37.299828+0000","last_fullsized":"2024-03-30T12:40:37.299828+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:27.675670+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:42:27.675670+0000","last_peered":"2024-03-30T12:42:27.675670+0000","last_clean":"2024-03-30T12:42:27.675670+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:42:27.675670+0000","last_undegraded":"2024-03-30T12:42:27.675670+0000","last_fullsized":"2024-03-30T12:42:27.675670+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:40.772652+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:42:40.772652+0000","last_peered":"2024-03-30T12:42:40.772652+0000","last_clean":"2024-03-30T12:42:40.772652+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:42:40.772652+0000","last_undegraded":"2024-03-30T12:42:40.772652+0000","last_fullsized":"2024-03-30T12:42:40.772652+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:48.927583+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:40:48.927583+0000","last_peered":"2024-03-30T12:40:48.927583+0000","last_clean":"2024-03-30T12:40:48.927583+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:40:48.927583+0000","last_undegraded":"2024-03-30T12:40:48.927583+0000","last_fullsized":"2024-03-30T12:40:48.927583+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320117+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:40:40.320117+0000","last_peered":"2024-03-30T12:40:40.320117+0000","last_clean":"2024-03-30T12:40:40.320117+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:40:40.320117+0000","last_undegraded":"2024-03-30T12:40:40.320117+0000","last_fullsized":"2024-03-30T12:40:40.320117+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1226,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320196+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:40:40.320196+0000","last_peered":"2024-03-30T12:40:40.320196+0000","last_clean":"2024-03-30T12:40:40.320196+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:40:40.320196+0000","last_undegraded":"2024-03-30T12:40:40.320196+0000","last_fullsized":"2024-03-30T12:40:40.320196+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.403697+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:41:23.403697+0000","last_peered":"2024-03-30T12:41:23.403697+0000","last_clean":"2024-03-30T12:41:23.403697+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:41:23.403697+0000","last_undegraded":"2024-03-30T12:41:23.403697+0000","last_fullsized":"2024-03-30T12:41:23.403697+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159632+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:41:34.159632+0000","last_peered":"2024-03-30T12:41:34.159632+0000","last_clean":"2024-03-30T12:41:34.159632+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:41:34.159632+0000","last_undegraded":"2024-03-30T12:41:34.159632+0000","last_fullsized":"2024-03-30T12:41:34.159632+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1391,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:55.774255+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:42:55.774255+0000","last_peered":"2024-03-30T12:42:55.774255+0000","last_clean":"2024-03-30T12:42:55.774255+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:42:55.774255+0000","last_undegraded":"2024-03-30T12:42:55.774255+0000","last_fullsized":"2024-03-30T12:42:55.774255+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1285,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672522+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:41:57.672522+0000","last_peered":"2024-03-30T12:41:57.672522+0000","last_clean":"2024-03-30T12:41:57.672522+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:41:57.672522+0000","last_undegraded":"2024-03-30T12:41:57.672522+0000","last_fullsized":"2024-03-30T12:41:57.672522+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1304,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672534+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:41:57.672534+0000","last_peered":"2024-03-30T12:41:57.672534+0000","last_clean":"2024-03-30T12:41:57.672534+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:41:57.672534+0000","last_undegraded":"2024-03-30T12:41:57.672534+0000","last_fullsized":"2024-03-30T12:41:57.672534+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:55.774245+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:42:55.774245+0000","last_peered":"2024-03-30T12:42:55.774245+0000","last_clean":"2024-03-30T12:42:55.774245+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:42:55.774245+0000","last_undegraded":"2024-03-30T12:42:55.774245+0000","last_fullsized":"2024-03-30T12:42:55.774245+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150628+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:40:19.150628+0000","last_peered":"2024-03-30T12:40:19.150628+0000","last_clean":"2024-03-30T12:40:19.150628+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:40:19.150628+0000","last_undegraded":"2024-03-30T12:40:19.150628+0000","last_fullsized":"2024-03-30T12:40:19.150628+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326512+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:41:30.326512+0000","last_peered":"2024-03-30T12:41:30.326512+0000","last_clean":"2024-03-30T12:41:30.326512+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:41:30.326512+0000","last_undegraded":"2024-03-30T12:41:30.326512+0000","last_fullsized":"2024-03-30T12:41:30.326512+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150608+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:40:19.150608+0000","last_peered":"2024-03-30T12:40:19.150608+0000","last_clean":"2024-03-30T12:40:19.150608+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:40:19.150608+0000","last_undegraded":"2024-03-30T12:40:19.150608+0000","last_fullsized":"2024-03-30T12:40:19.150608+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326527+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:41:30.326527+0000","last_peered":"2024-03-30T12:41:30.326527+0000","last_clean":"2024-03-30T12:41:30.326527+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:41:30.326527+0000","last_undegraded":"2024-03-30T12:41:30.326527+0000","last_fullsized":"2024-03-30T12:41:30.326527+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1263,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662819+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:40:27.662819+0000","last_peered":"2024-03-30T12:40:27.662819+0000","last_clean":"2024-03-30T12:40:27.662819+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:40:27.662819+0000","last_undegraded":"2024-03-30T12:40:27.662819+0000","last_fullsized":"2024-03-30T12:40:27.662819+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1264,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302503+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:41:02.302503+0000","last_peered":"2024-03-30T12:41:02.302503+0000","last_clean":"2024-03-30T12:41:02.302503+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:41:02.302503+0000","last_undegraded":"2024-03-30T12:41:02.302503+0000","last_fullsized":"2024-03-30T12:41:02.302503+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:09.584292+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:42:09.584292+0000","last_peered":"2024-03-30T12:42:09.584292+0000","last_clean":"2024-03-30T12:42:09.584292+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:42:09.584292+0000","last_undegraded":"2024-03-30T12:42:09.584292+0000","last_fullsized":"2024-03-30T12:42:09.584292+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:15.763333+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:41:15.763333+0000","last_peered":"2024-03-30T12:41:15.763333+0000","last_clean":"2024-03-30T12:41:15.763333+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:41:15.763333+0000","last_undegraded":"2024-03-30T12:41:15.763333+0000","last_fullsized":"2024-03-30T12:41:15.763333+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1300,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:27.675651+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:42:27.675651+0000","last_peered":"2024-03-30T12:42:27.675651+0000","last_clean":"2024-03-30T12:42:27.675651+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:42:27.675651+0000","last_undegraded":"2024-03-30T12:42:27.675651+0000","last_fullsized":"2024-03-30T12:42:27.675651+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:27.675619+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:42:27.675619+0000","last_peered":"2024-03-30T12:42:27.675619+0000","last_clean":"2024-03-30T12:42:27.675619+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:42:27.675619+0000","last_undegraded":"2024-03-30T12:42:27.675619+0000","last_fullsized":"2024-03-30T12:42:27.675619+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1226,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323325+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:41:05.323325+0000","last_peered":"2024-03-30T12:41:05.323325+0000","last_clean":"2024-03-30T12:41:05.323325+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:41:05.323325+0000","last_undegraded":"2024-03-30T12:41:05.323325+0000","last_fullsized":"2024-03-30T12:41:05.323325+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:18.930743+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:41:18.930743+0000","last_peered":"2024-03-30T12:41:18.930743+0000","last_clean":"2024-03-30T12:41:18.930743+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:41:18.930743+0000","last_undegraded":"2024-03-30T12:41:18.930743+0000","last_fullsized":"2024-03-30T12:41:18.930743+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1172,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581788+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:41:44.581788+0000","last_peered":"2024-03-30T12:41:44.581788+0000","last_clean":"2024-03-30T12:41:44.581788+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:41:44.581788+0000","last_undegraded":"2024-03-30T12:41:44.581788+0000","last_fullsized":"2024-03-30T12:41:44.581788+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323382+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:41:05.323382+0000","last_peered":"2024-03-30T12:41:05.323382+0000","last_clean":"2024-03-30T12:41:05.323382+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:41:05.323382+0000","last_undegraded":"2024-03-30T12:41:05.323382+0000","last_fullsized":"2024-03-30T12:41:05.323382+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1200,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323370+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:41:05.323370+0000","last_peered":"2024-03-30T12:41:05.323370+0000","last_clean":"2024-03-30T12:41:05.323370+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:41:05.323370+0000","last_undegraded":"2024-03-30T12:41:05.323370+0000","last_fullsized":"2024-03-30T12:41:05.323370+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1293,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:53.406703+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:41:53.406703+0000","last_peered":"2024-03-30T12:41:53.406703+0000","last_clean":"2024-03-30T12:41:53.406703+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:41:53.406703+0000","last_undegraded":"2024-03-30T12:41:53.406703+0000","last_fullsized":"2024-03-30T12:41:53.406703+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:18.930787+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:41:18.930787+0000","last_peered":"2024-03-30T12:41:18.930787+0000","last_clean":"2024-03-30T12:41:18.930787+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:41:18.930787+0000","last_undegraded":"2024-03-30T12:41:18.930787+0000","last_fullsized":"2024-03-30T12:41:18.930787+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:32.312127+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:42:32.312127+0000","last_peered":"2024-03-30T12:42:32.312127+0000","last_clean":"2024-03-30T12:42:32.312127+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:42:32.312127+0000","last_undegraded":"2024-03-30T12:42:32.312127+0000","last_fullsized":"2024-03-30T12:42:32.312127+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1207,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579099+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:41:19.579099+0000","last_peered":"2024-03-30T12:41:19.579099+0000","last_clean":"2024-03-30T12:41:19.579099+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:41:19.579099+0000","last_undegraded":"2024-03-30T12:41:19.579099+0000","last_fullsized":"2024-03-30T12:41:19.579099+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:24.165645+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:42:24.165645+0000","last_peered":"2024-03-30T12:42:24.165645+0000","last_clean":"2024-03-30T12:42:24.165645+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:42:24.165645+0000","last_undegraded":"2024-03-30T12:42:24.165645+0000","last_fullsized":"2024-03-30T12:42:24.165645+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1386,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:35.772053+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:42:35.772053+0000","last_peered":"2024-03-30T12:42:35.772053+0000","last_clean":"2024-03-30T12:42:35.772053+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:42:35.772053+0000","last_undegraded":"2024-03-30T12:42:35.772053+0000","last_fullsized":"2024-03-30T12:42:35.772053+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:35.772026+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:42:35.772026+0000","last_peered":"2024-03-30T12:42:35.772026+0000","last_clean":"2024-03-30T12:42:35.772026+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:42:35.772026+0000","last_undegraded":"2024-03-30T12:42:35.772026+0000","last_fullsized":"2024-03-30T12:42:35.772026+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320162+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:40:40.320162+0000","last_peered":"2024-03-30T12:40:40.320162+0000","last_clean":"2024-03-30T12:40:40.320162+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:40:40.320162+0000","last_undegraded":"2024-03-30T12:40:40.320162+0000","last_fullsized":"2024-03-30T12:40:40.320162+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:59.162782+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:41:59.162782+0000","last_peered":"2024-03-30T12:41:59.162782+0000","last_clean":"2024-03-30T12:41:59.162782+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:41:59.162782+0000","last_undegraded":"2024-03-30T12:41:59.162782+0000","last_fullsized":"2024-03-30T12:41:59.162782+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1186,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579076+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:41:19.579076+0000","last_peered":"2024-03-30T12:41:19.579076+0000","last_clean":"2024-03-30T12:41:19.579076+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:41:19.579076+0000","last_undegraded":"2024-03-30T12:41:19.579076+0000","last_fullsized":"2024-03-30T12:41:19.579076+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579050+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:41:19.579050+0000","last_peered":"2024-03-30T12:41:19.579050+0000","last_clean":"2024-03-30T12:41:19.579050+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:41:19.579050+0000","last_undegraded":"2024-03-30T12:41:19.579050+0000","last_fullsized":"2024-03-30T12:41:19.579050+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1346,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.403657+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:41:23.403657+0000","last_peered":"2024-03-30T12:41:23.403657+0000","last_clean":"2024-03-30T12:41:23.403657+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:41:23.403657+0000","last_undegraded":"2024-03-30T12:41:23.403657+0000","last_fullsized":"2024-03-30T12:41:23.403657+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:59.162732+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:41:59.162732+0000","last_peered":"2024-03-30T12:41:59.162732+0000","last_clean":"2024-03-30T12:41:59.162732+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:41:59.162732+0000","last_undegraded":"2024-03-30T12:41:59.162732+0000","last_fullsized":"2024-03-30T12:41:59.162732+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5755,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:33.411173+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:42:33.411173+0000","last_peered":"2024-03-30T12:42:33.411173+0000","last_clean":"2024-03-30T12:42:33.411173+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:42:33.411173+0000","last_undegraded":"2024-03-30T12:42:33.411173+0000","last_fullsized":"2024-03-30T12:42:33.411173+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1277,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:02.309177+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:42:02.309177+0000","last_peered":"2024-03-30T12:42:02.309177+0000","last_clean":"2024-03-30T12:42:02.309177+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:42:02.309177+0000","last_undegraded":"2024-03-30T12:42:02.309177+0000","last_fullsized":"2024-03-30T12:42:02.309177+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159642+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:41:34.159642+0000","last_peered":"2024-03-30T12:41:34.159642+0000","last_clean":"2024-03-30T12:41:34.159642+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:41:34.159642+0000","last_undegraded":"2024-03-30T12:41:34.159642+0000","last_fullsized":"2024-03-30T12:41:34.159642+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5516,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:55.774198+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:42:55.774198+0000","last_peered":"2024-03-30T12:42:55.774198+0000","last_clean":"2024-03-30T12:42:55.774198+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:42:55.774198+0000","last_undegraded":"2024-03-30T12:42:55.774198+0000","last_fullsized":"2024-03-30T12:42:55.774198+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931401+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:41:23.931401+0000","last_peered":"2024-03-30T12:41:23.931401+0000","last_clean":"2024-03-30T12:41:23.931401+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:41:23.931401+0000","last_undegraded":"2024-03-30T12:41:23.931401+0000","last_fullsized":"2024-03-30T12:41:23.931401+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931427+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:41:23.931427+0000","last_peered":"2024-03-30T12:41:23.931427+0000","last_clean":"2024-03-30T12:41:23.931427+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:41:23.931427+0000","last_undegraded":"2024-03-30T12:41:23.931427+0000","last_fullsized":"2024-03-30T12:41:23.931427+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326520+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:41:30.326520+0000","last_peered":"2024-03-30T12:41:30.326520+0000","last_clean":"2024-03-30T12:41:30.326520+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:41:30.326520+0000","last_undegraded":"2024-03-30T12:41:30.326520+0000","last_fullsized":"2024-03-30T12:41:30.326520+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5461,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:43:00.774816+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:43:00.774816+0000","last_peered":"2024-03-30T12:43:00.774816+0000","last_clean":"2024-03-30T12:43:00.774816+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:43:00.774816+0000","last_undegraded":"2024-03-30T12:43:00.774816+0000","last_fullsized":"2024-03-30T12:43:00.774816+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931438+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:41:23.931438+0000","last_peered":"2024-03-30T12:41:23.931438+0000","last_clean":"2024-03-30T12:41:23.931438+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:41:23.931438+0000","last_undegraded":"2024-03-30T12:41:23.931438+0000","last_fullsized":"2024-03-30T12:41:23.931438+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1209,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326461+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:41:30.326461+0000","last_peered":"2024-03-30T12:41:30.326461+0000","last_clean":"2024-03-30T12:41:30.326461+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:41:30.326461+0000","last_undegraded":"2024-03-30T12:41:30.326461+0000","last_fullsized":"2024-03-30T12:41:30.326461+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1274,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302515+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:41:02.302515+0000","last_peered":"2024-03-30T12:41:02.302515+0000","last_clean":"2024-03-30T12:41:02.302515+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:41:02.302515+0000","last_undegraded":"2024-03-30T12:41:02.302515+0000","last_fullsized":"2024-03-30T12:41:02.302515+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3806,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:33.411258+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:42:33.411258+0000","last_peered":"2024-03-30T12:42:33.411258+0000","last_clean":"2024-03-30T12:42:33.411258+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:42:33.411258+0000","last_undegraded":"2024-03-30T12:42:33.411258+0000","last_fullsized":"2024-03-30T12:42:33.411258+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935569+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:41:58.935569+0000","last_peered":"2024-03-30T12:41:58.935569+0000","last_clean":"2024-03-30T12:41:58.935569+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:41:58.935569+0000","last_undegraded":"2024-03-30T12:41:58.935569+0000","last_fullsized":"2024-03-30T12:41:58.935569+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:48.940828+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:42:48.940828+0000","last_peered":"2024-03-30T12:42:48.940828+0000","last_clean":"2024-03-30T12:42:48.940828+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:42:48.940828+0000","last_undegraded":"2024-03-30T12:42:48.940828+0000","last_fullsized":"2024-03-30T12:42:48.940828+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.407376+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:41:58.407376+0000","last_peered":"2024-03-30T12:41:58.407376+0000","last_clean":"2024-03-30T12:41:58.407376+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:41:58.407376+0000","last_undegraded":"2024-03-30T12:41:58.407376+0000","last_fullsized":"2024-03-30T12:41:58.407376+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4579,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:49.168681+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:42:49.168681+0000","last_peered":"2024-03-30T12:42:49.168681+0000","last_clean":"2024-03-30T12:42:49.168681+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:42:49.168681+0000","last_undegraded":"2024-03-30T12:42:49.168681+0000","last_fullsized":"2024-03-30T12:42:49.168681+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1177,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:09.584340+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:42:09.584340+0000","last_peered":"2024-03-30T12:42:09.584340+0000","last_clean":"2024-03-30T12:42:09.584340+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:42:09.584340+0000","last_undegraded":"2024-03-30T12:42:09.584340+0000","last_fullsized":"2024-03-30T12:42:09.584340+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:32.676053+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:42:32.676053+0000","last_peered":"2024-03-30T12:42:32.676053+0000","last_clean":"2024-03-30T12:42:32.676053+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:42:32.676053+0000","last_undegraded":"2024-03-30T12:42:32.676053+0000","last_fullsized":"2024-03-30T12:42:32.676053+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1202,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326500+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:41:30.326500+0000","last_peered":"2024-03-30T12:41:30.326500+0000","last_clean":"2024-03-30T12:41:30.326500+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:41:30.326500+0000","last_undegraded":"2024-03-30T12:41:30.326500+0000","last_fullsized":"2024-03-30T12:41:30.326500+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1719,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:19.165060+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:42:19.165060+0000","last_peered":"2024-03-30T12:42:19.165060+0000","last_clean":"2024-03-30T12:42:19.165060+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:42:19.165060+0000","last_undegraded":"2024-03-30T12:42:19.165060+0000","last_fullsized":"2024-03-30T12:42:19.165060+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24716,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:00.329951+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:42:00.329951+0000","last_peered":"2024-03-30T12:42:00.329951+0000","last_clean":"2024-03-30T12:42:00.329951+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:42:00.329951+0000","last_undegraded":"2024-03-30T12:42:00.329951+0000","last_fullsized":"2024-03-30T12:42:00.329951+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:25.764684+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:41:25.764684+0000","last_peered":"2024-03-30T12:41:25.764684+0000","last_clean":"2024-03-30T12:41:25.764684+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:41:25.764684+0000","last_undegraded":"2024-03-30T12:41:25.764684+0000","last_fullsized":"2024-03-30T12:41:25.764684+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:55.774169+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:42:55.774169+0000","last_peered":"2024-03-30T12:42:55.774169+0000","last_clean":"2024-03-30T12:42:55.774169+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:42:55.774169+0000","last_undegraded":"2024-03-30T12:42:55.774169+0000","last_fullsized":"2024-03-30T12:42:55.774169+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:19.165034+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:42:19.165034+0000","last_peered":"2024-03-30T12:42:19.165034+0000","last_clean":"2024-03-30T12:42:19.165034+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:42:19.165034+0000","last_undegraded":"2024-03-30T12:42:19.165034+0000","last_fullsized":"2024-03-30T12:42:19.165034+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16483,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:09.584304+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:42:09.584304+0000","last_peered":"2024-03-30T12:42:09.584304+0000","last_clean":"2024-03-30T12:42:09.584304+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:42:09.584304+0000","last_undegraded":"2024-03-30T12:42:09.584304+0000","last_fullsized":"2024-03-30T12:42:09.584304+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:55.774215+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:42:55.774215+0000","last_peered":"2024-03-30T12:42:55.774215+0000","last_clean":"2024-03-30T12:42:55.774215+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:42:55.774215+0000","last_undegraded":"2024-03-30T12:42:55.774215+0000","last_fullsized":"2024-03-30T12:42:55.774215+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1166,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:49.168709+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:42:49.168709+0000","last_peered":"2024-03-30T12:42:49.168709+0000","last_clean":"2024-03-30T12:42:49.168709+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:42:49.168709+0000","last_undegraded":"2024-03-30T12:42:49.168709+0000","last_fullsized":"2024-03-30T12:42:49.168709+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931449+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:41:23.931449+0000","last_peered":"2024-03-30T12:41:23.931449+0000","last_clean":"2024-03-30T12:41:23.931449+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:41:23.931449+0000","last_undegraded":"2024-03-30T12:41:23.931449+0000","last_fullsized":"2024-03-30T12:41:23.931449+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31271,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:41:02.302474+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:41:02.302474+0000","last_peered":"2024-03-30T12:41:02.302474+0000","last_clean":"2024-03-30T12:41:02.302474+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:41:02.302474+0000","last_undegraded":"2024-03-30T12:41:02.302474+0000","last_fullsized":"2024-03-30T12:41:02.302474+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672495+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:41:57.672495+0000","last_peered":"2024-03-30T12:41:57.672495+0000","last_clean":"2024-03-30T12:41:57.672495+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:41:57.672495+0000","last_undegraded":"2024-03-30T12:41:57.672495+0000","last_fullsized":"2024-03-30T12:41:57.672495+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1356,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935556+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:41:58.935556+0000","last_peered":"2024-03-30T12:41:58.935556+0000","last_clean":"2024-03-30T12:41:58.935556+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:41:58.935556+0000","last_undegraded":"2024-03-30T12:41:58.935556+0000","last_fullsized":"2024-03-30T12:41:58.935556+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666291+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:40:57.666291+0000","last_peered":"2024-03-30T12:40:57.666291+0000","last_clean":"2024-03-30T12:40:57.666291+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:40:57.666291+0000","last_undegraded":"2024-03-30T12:40:57.666291+0000","last_fullsized":"2024-03-30T12:40:57.666291+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3767,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672462+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:41:57.672462+0000","last_peered":"2024-03-30T12:41:57.672462+0000","last_clean":"2024-03-30T12:41:57.672462+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:41:57.672462+0000","last_undegraded":"2024-03-30T12:41:57.672462+0000","last_fullsized":"2024-03-30T12:41:57.672462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302452+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:41:02.302452+0000","last_peered":"2024-03-30T12:41:02.302452+0000","last_clean":"2024-03-30T12:41:02.302452+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:41:02.302452+0000","last_undegraded":"2024-03-30T12:41:02.302452+0000","last_fullsized":"2024-03-30T12:41:02.302452+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1158,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:39.587408+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:42:39.587408+0000","last_peered":"2024-03-30T12:42:39.587408+0000","last_clean":"2024-03-30T12:42:39.587408+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:42:39.587408+0000","last_undegraded":"2024-03-30T12:42:39.587408+0000","last_fullsized":"2024-03-30T12:42:39.587408+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:25.764656+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:41:25.764656+0000","last_peered":"2024-03-30T12:41:25.764656+0000","last_clean":"2024-03-30T12:41:25.764656+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:41:25.764656+0000","last_undegraded":"2024-03-30T12:41:25.764656+0000","last_fullsized":"2024-03-30T12:41:25.764656+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15596,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:30.333267+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:42:30.333267+0000","last_peered":"2024-03-30T12:42:30.333267+0000","last_clean":"2024-03-30T12:42:30.333267+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:42:30.333267+0000","last_undegraded":"2024-03-30T12:42:30.333267+0000","last_fullsized":"2024-03-30T12:42:30.333267+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:09.156570+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:41:09.156570+0000","last_peered":"2024-03-30T12:41:09.156570+0000","last_clean":"2024-03-30T12:41:09.156570+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:41:09.156570+0000","last_undegraded":"2024-03-30T12:41:09.156570+0000","last_fullsized":"2024-03-30T12:41:09.156570+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:32.306064+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:41:32.306064+0000","last_peered":"2024-03-30T12:41:32.306064+0000","last_clean":"2024-03-30T12:41:32.306064+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:41:32.306064+0000","last_undegraded":"2024-03-30T12:41:32.306064+0000","last_fullsized":"2024-03-30T12:41:32.306064+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29022,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:02.309140+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:42:02.309140+0000","last_peered":"2024-03-30T12:42:02.309140+0000","last_clean":"2024-03-30T12:42:02.309140+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:42:02.309140+0000","last_undegraded":"2024-03-30T12:42:02.309140+0000","last_fullsized":"2024-03-30T12:42:02.309140+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935491+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:41:58.935491+0000","last_peered":"2024-03-30T12:41:58.935491+0000","last_clean":"2024-03-30T12:41:58.935491+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:41:58.935491+0000","last_undegraded":"2024-03-30T12:41:58.935491+0000","last_fullsized":"2024-03-30T12:41:58.935491+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666241+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:40:57.666241+0000","last_peered":"2024-03-30T12:40:57.666241+0000","last_clean":"2024-03-30T12:40:57.666241+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:40:57.666241+0000","last_undegraded":"2024-03-30T12:40:57.666241+0000","last_fullsized":"2024-03-30T12:40:57.666241+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5612,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:53.400722+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:40:53.400722+0000","last_peered":"2024-03-30T12:40:53.400722+0000","last_clean":"2024-03-30T12:40:53.400722+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:40:53.400722+0000","last_undegraded":"2024-03-30T12:40:53.400722+0000","last_fullsized":"2024-03-30T12:40:53.400722+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1367,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935518+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:41:58.935518+0000","last_peered":"2024-03-30T12:41:58.935518+0000","last_clean":"2024-03-30T12:41:58.935518+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:41:58.935518+0000","last_undegraded":"2024-03-30T12:41:58.935518+0000","last_fullsized":"2024-03-30T12:41:58.935518+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:27.669397+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:41:27.669397+0000","last_peered":"2024-03-30T12:41:27.669397+0000","last_clean":"2024-03-30T12:41:27.669397+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:41:27.669397+0000","last_undegraded":"2024-03-30T12:41:27.669397+0000","last_fullsized":"2024-03-30T12:41:27.669397+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4277,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:33.939063+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:42:33.939063+0000","last_peered":"2024-03-30T12:42:33.939063+0000","last_clean":"2024-03-30T12:42:33.939063+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:42:33.939063+0000","last_undegraded":"2024-03-30T12:42:33.939063+0000","last_fullsized":"2024-03-30T12:42:33.939063+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1156,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159584+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:41:34.159584+0000","last_peered":"2024-03-30T12:41:34.159584+0000","last_clean":"2024-03-30T12:41:34.159584+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:41:34.159584+0000","last_undegraded":"2024-03-30T12:41:34.159584+0000","last_fullsized":"2024-03-30T12:41:34.159584+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1186,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:39.587344+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:42:39.587344+0000","last_peered":"2024-03-30T12:42:39.587344+0000","last_clean":"2024-03-30T12:42:39.587344+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:42:39.587344+0000","last_undegraded":"2024-03-30T12:42:39.587344+0000","last_fullsized":"2024-03-30T12:42:39.587344+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5255,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:53.400674+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:40:53.400674+0000","last_peered":"2024-03-30T12:40:53.400674+0000","last_clean":"2024-03-30T12:40:53.400674+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:40:53.400674+0000","last_undegraded":"2024-03-30T12:40:53.400674+0000","last_fullsized":"2024-03-30T12:40:53.400674+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:53.400708+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:40:53.400708+0000","last_peered":"2024-03-30T12:40:53.400708+0000","last_clean":"2024-03-30T12:40:53.400708+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:40:53.400708+0000","last_undegraded":"2024-03-30T12:40:53.400708+0000","last_fullsized":"2024-03-30T12:40:53.400708+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159619+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:41:34.159619+0000","last_peered":"2024-03-30T12:41:34.159619+0000","last_clean":"2024-03-30T12:41:34.159619+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:41:34.159619+0000","last_undegraded":"2024-03-30T12:41:34.159619+0000","last_fullsized":"2024-03-30T12:41:34.159619+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4813,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:33.411213+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:42:33.411213+0000","last_peered":"2024-03-30T12:42:33.411213+0000","last_clean":"2024-03-30T12:42:33.411213+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:42:33.411213+0000","last_undegraded":"2024-03-30T12:42:33.411213+0000","last_fullsized":"2024-03-30T12:42:33.411213+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:33.939095+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:42:33.939095+0000","last_peered":"2024-03-30T12:42:33.939095+0000","last_clean":"2024-03-30T12:42:33.939095+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:42:33.939095+0000","last_undegraded":"2024-03-30T12:42:33.939095+0000","last_fullsized":"2024-03-30T12:42:33.939095+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:30.333244+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:42:30.333244+0000","last_peered":"2024-03-30T12:42:30.333244+0000","last_clean":"2024-03-30T12:42:30.333244+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:42:30.333244+0000","last_undegraded":"2024-03-30T12:42:30.333244+0000","last_fullsized":"2024-03-30T12:42:30.333244+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6745,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:41:09.156602+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:41:09.156602+0000","last_peered":"2024-03-30T12:41:09.156602+0000","last_clean":"2024-03-30T12:41:09.156602+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:41:09.156602+0000","last_undegraded":"2024-03-30T12:41:09.156602+0000","last_fullsized":"2024-03-30T12:41:09.156602+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1339,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:53.400753+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:40:53.400753+0000","last_peered":"2024-03-30T12:40:53.400753+0000","last_clean":"2024-03-30T12:40:53.400753+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:40:53.400753+0000","last_undegraded":"2024-03-30T12:40:53.400753+0000","last_fullsized":"2024-03-30T12:40:53.400753+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159657+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:41:34.159657+0000","last_peered":"2024-03-30T12:41:34.159657+0000","last_clean":"2024-03-30T12:41:34.159657+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:41:34.159657+0000","last_undegraded":"2024-03-30T12:41:34.159657+0000","last_fullsized":"2024-03-30T12:41:34.159657+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1172,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:09.584262+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:42:09.584262+0000","last_peered":"2024-03-30T12:42:09.584262+0000","last_clean":"2024-03-30T12:42:09.584262+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:42:09.584262+0000","last_undegraded":"2024-03-30T12:42:09.584262+0000","last_fullsized":"2024-03-30T12:42:09.584262+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1335,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.407397+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:41:58.407397+0000","last_peered":"2024-03-30T12:41:58.407397+0000","last_clean":"2024-03-30T12:41:58.407397+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:41:58.407397+0000","last_undegraded":"2024-03-30T12:41:58.407397+0000","last_fullsized":"2024-03-30T12:41:58.407397+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326484+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:41:30.326484+0000","last_peered":"2024-03-30T12:41:30.326484+0000","last_clean":"2024-03-30T12:41:30.326484+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:41:30.326484+0000","last_undegraded":"2024-03-30T12:41:30.326484+0000","last_fullsized":"2024-03-30T12:41:30.326484+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:00.774774+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:43:00.774774+0000","last_peered":"2024-03-30T12:43:00.774774+0000","last_clean":"2024-03-30T12:43:00.774774+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:43:00.774774+0000","last_undegraded":"2024-03-30T12:43:00.774774+0000","last_fullsized":"2024-03-30T12:43:00.774774+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666276+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:40:57.666276+0000","last_peered":"2024-03-30T12:40:57.666276+0000","last_clean":"2024-03-30T12:40:57.666276+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:40:57.666276+0000","last_undegraded":"2024-03-30T12:40:57.666276+0000","last_fullsized":"2024-03-30T12:40:57.666276+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935541+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:41:58.935541+0000","last_peered":"2024-03-30T12:41:58.935541+0000","last_clean":"2024-03-30T12:41:58.935541+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:41:58.935541+0000","last_undegraded":"2024-03-30T12:41:58.935541+0000","last_fullsized":"2024-03-30T12:41:58.935541+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1180,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:39.587396+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:42:39.587396+0000","last_peered":"2024-03-30T12:42:39.587396+0000","last_clean":"2024-03-30T12:42:39.587396+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:42:39.587396+0000","last_undegraded":"2024-03-30T12:42:39.587396+0000","last_fullsized":"2024-03-30T12:42:39.587396+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1283,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:57.666301+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:40:57.666301+0000","last_peered":"2024-03-30T12:40:57.666301+0000","last_clean":"2024-03-30T12:40:57.666301+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:40:57.666301+0000","last_undegraded":"2024-03-30T12:40:57.666301+0000","last_fullsized":"2024-03-30T12:40:57.666301+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:00.329894+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:42:00.329894+0000","last_peered":"2024-03-30T12:42:00.329894+0000","last_clean":"2024-03-30T12:42:00.329894+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:42:00.329894+0000","last_undegraded":"2024-03-30T12:42:00.329894+0000","last_fullsized":"2024-03-30T12:42:00.329894+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:27.669378+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:41:27.669378+0000","last_peered":"2024-03-30T12:41:27.669378+0000","last_clean":"2024-03-30T12:41:27.669378+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:41:27.669378+0000","last_undegraded":"2024-03-30T12:41:27.669378+0000","last_fullsized":"2024-03-30T12:41:27.669378+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1218,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:30.333212+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:42:30.333212+0000","last_peered":"2024-03-30T12:42:30.333212+0000","last_clean":"2024-03-30T12:42:30.333212+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:42:30.333212+0000","last_undegraded":"2024-03-30T12:42:30.333212+0000","last_fullsized":"2024-03-30T12:42:30.333212+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:00.768614+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:42:00.768614+0000","last_peered":"2024-03-30T12:42:00.768614+0000","last_clean":"2024-03-30T12:42:00.768614+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:42:00.768614+0000","last_undegraded":"2024-03-30T12:42:00.768614+0000","last_fullsized":"2024-03-30T12:42:00.768614+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:54.576179+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:40:54.576179+0000","last_peered":"2024-03-30T12:40:54.576179+0000","last_clean":"2024-03-30T12:40:54.576179+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:40:54.576179+0000","last_undegraded":"2024-03-30T12:40:54.576179+0000","last_fullsized":"2024-03-30T12:40:54.576179+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438130,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648186,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175196,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254435,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063253,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951310,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839367,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923650,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:45:08.340 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:08.340 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:08.340 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:08.340 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:08.340 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:08.340 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:08.340 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:08.340 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:08.340 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:08.340 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:08.340 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:08.341 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:08.341 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:08.341 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:45:08.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:08 smithi162 ceph-mon[83709]: pgmap v1262: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:08.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:08 smithi162 ceph-mon[83709]: from='client.34764 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:45:09.756 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:45:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:45:09] "GET /metrics HTTP/1.1" 200 36325 "" "Prometheus/2.43.0" 2024-03-30T12:45:10.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:10 smithi084 ceph-mon[91810]: pgmap v1263: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:10.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:10 smithi084 ceph-mon[89279]: pgmap v1263: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:10.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:10 smithi162 ceph-mon[83709]: pgmap v1263: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:12.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:12 smithi084 ceph-mon[91810]: pgmap v1264: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:12.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:12 smithi084 ceph-mon[89279]: pgmap v1264: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:12.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:12 smithi162 ceph-mon[83709]: pgmap v1264: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:14.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:14 smithi084 ceph-mon[91810]: pgmap v1265: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:14.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:14 smithi084 ceph-mon[89279]: pgmap v1265: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:14.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:14 smithi162 ceph-mon[83709]: pgmap v1265: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:15.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:15 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:45:15.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:15 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:45:15.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:15 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:45:16.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:16 smithi084 ceph-mon[91810]: pgmap v1266: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:16.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:16 smithi084 ceph-mon[89279]: pgmap v1266: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:16.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:16 smithi162 ceph-mon[83709]: pgmap v1266: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:18.342 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:45:18.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:18 smithi084 ceph-mon[91810]: pgmap v1267: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:18.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:18 smithi084 ceph-mon[89279]: pgmap v1267: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:18.562 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:45:18.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:18 smithi162 ceph-mon[83709]: pgmap v1267: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:19.707 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:45:19 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:45:19] "GET /metrics HTTP/1.1" 200 36324 "" "Prometheus/2.43.0" 2024-03-30T12:45:20.338 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:20 smithi084 ceph-mon[91810]: pgmap v1268: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:20.339 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:20 smithi084 ceph-mon[89279]: pgmap v1268: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:20.563 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:45:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:45:20.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:20 smithi162 ceph-mon[83709]: pgmap v1268: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:21.221 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1268,"stamp":"2024-03-30T12:45:18.978120+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004121"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:49.168735+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:42:49.168735+0000","last_peered":"2024-03-30T12:42:49.168735+0000","last_clean":"2024-03-30T12:42:49.168735+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:42:49.168735+0000","last_undegraded":"2024-03-30T12:42:49.168735+0000","last_fullsized":"2024-03-30T12:42:49.168735+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1366,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931469+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:41:23.931469+0000","last_peered":"2024-03-30T12:41:23.931469+0000","last_clean":"2024-03-30T12:41:23.931469+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:41:23.931469+0000","last_undegraded":"2024-03-30T12:41:23.931469+0000","last_fullsized":"2024-03-30T12:41:23.931469+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:55.774228+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:42:55.774228+0000","last_peered":"2024-03-30T12:42:55.774228+0000","last_clean":"2024-03-30T12:42:55.774228+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:42:55.774228+0000","last_undegraded":"2024-03-30T12:42:55.774228+0000","last_fullsized":"2024-03-30T12:42:55.774228+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1236,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:00.336746+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:43:00.336746+0000","last_peered":"2024-03-30T12:43:00.336746+0000","last_clean":"2024-03-30T12:43:00.336746+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:43:00.336746+0000","last_undegraded":"2024-03-30T12:43:00.336746+0000","last_fullsized":"2024-03-30T12:43:00.336746+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150593+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:40:19.150593+0000","last_peered":"2024-03-30T12:40:19.150593+0000","last_clean":"2024-03-30T12:40:19.150593+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:40:19.150593+0000","last_undegraded":"2024-03-30T12:40:19.150593+0000","last_fullsized":"2024-03-30T12:40:19.150593+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326493+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:41:30.326493+0000","last_peered":"2024-03-30T12:41:30.326493+0000","last_clean":"2024-03-30T12:41:30.326493+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:41:30.326493+0000","last_undegraded":"2024-03-30T12:41:30.326493+0000","last_fullsized":"2024-03-30T12:41:30.326493+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1162,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150576+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:40:19.150576+0000","last_peered":"2024-03-30T12:40:19.150576+0000","last_clean":"2024-03-30T12:40:19.150576+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:40:19.150576+0000","last_undegraded":"2024-03-30T12:40:19.150576+0000","last_fullsized":"2024-03-30T12:40:19.150576+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662744+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:40:27.662744+0000","last_peered":"2024-03-30T12:40:27.662744+0000","last_clean":"2024-03-30T12:40:27.662744+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:40:27.662744+0000","last_undegraded":"2024-03-30T12:40:27.662744+0000","last_fullsized":"2024-03-30T12:40:27.662744+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1151,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:24.165680+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:42:24.165680+0000","last_peered":"2024-03-30T12:42:24.165680+0000","last_clean":"2024-03-30T12:42:24.165680+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:42:24.165680+0000","last_undegraded":"2024-03-30T12:42:24.165680+0000","last_fullsized":"2024-03-30T12:42:24.165680+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581772+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:41:44.581772+0000","last_peered":"2024-03-30T12:41:44.581772+0000","last_clean":"2024-03-30T12:41:44.581772+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:41:44.581772+0000","last_undegraded":"2024-03-30T12:41:44.581772+0000","last_fullsized":"2024-03-30T12:41:44.581772+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581745+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:41:44.581745+0000","last_peered":"2024-03-30T12:41:44.581745+0000","last_clean":"2024-03-30T12:41:44.581745+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:41:44.581745+0000","last_undegraded":"2024-03-30T12:41:44.581745+0000","last_fullsized":"2024-03-30T12:41:44.581745+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1272,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:37.299828+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:40:37.299828+0000","last_peered":"2024-03-30T12:40:37.299828+0000","last_clean":"2024-03-30T12:40:37.299828+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:40:37.299828+0000","last_undegraded":"2024-03-30T12:40:37.299828+0000","last_fullsized":"2024-03-30T12:40:37.299828+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:27.675670+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:42:27.675670+0000","last_peered":"2024-03-30T12:42:27.675670+0000","last_clean":"2024-03-30T12:42:27.675670+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:42:27.675670+0000","last_undegraded":"2024-03-30T12:42:27.675670+0000","last_fullsized":"2024-03-30T12:42:27.675670+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:40.772652+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:42:40.772652+0000","last_peered":"2024-03-30T12:42:40.772652+0000","last_clean":"2024-03-30T12:42:40.772652+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:42:40.772652+0000","last_undegraded":"2024-03-30T12:42:40.772652+0000","last_fullsized":"2024-03-30T12:42:40.772652+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:48.927583+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:40:48.927583+0000","last_peered":"2024-03-30T12:40:48.927583+0000","last_clean":"2024-03-30T12:40:48.927583+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:40:48.927583+0000","last_undegraded":"2024-03-30T12:40:48.927583+0000","last_fullsized":"2024-03-30T12:40:48.927583+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320117+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:40:40.320117+0000","last_peered":"2024-03-30T12:40:40.320117+0000","last_clean":"2024-03-30T12:40:40.320117+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:40:40.320117+0000","last_undegraded":"2024-03-30T12:40:40.320117+0000","last_fullsized":"2024-03-30T12:40:40.320117+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1226,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320196+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:40:40.320196+0000","last_peered":"2024-03-30T12:40:40.320196+0000","last_clean":"2024-03-30T12:40:40.320196+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:40:40.320196+0000","last_undegraded":"2024-03-30T12:40:40.320196+0000","last_fullsized":"2024-03-30T12:40:40.320196+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.403697+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:41:23.403697+0000","last_peered":"2024-03-30T12:41:23.403697+0000","last_clean":"2024-03-30T12:41:23.403697+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:41:23.403697+0000","last_undegraded":"2024-03-30T12:41:23.403697+0000","last_fullsized":"2024-03-30T12:41:23.403697+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159632+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:41:34.159632+0000","last_peered":"2024-03-30T12:41:34.159632+0000","last_clean":"2024-03-30T12:41:34.159632+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:41:34.159632+0000","last_undegraded":"2024-03-30T12:41:34.159632+0000","last_fullsized":"2024-03-30T12:41:34.159632+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1391,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:55.774255+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:42:55.774255+0000","last_peered":"2024-03-30T12:42:55.774255+0000","last_clean":"2024-03-30T12:42:55.774255+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:42:55.774255+0000","last_undegraded":"2024-03-30T12:42:55.774255+0000","last_fullsized":"2024-03-30T12:42:55.774255+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1285,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672522+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:41:57.672522+0000","last_peered":"2024-03-30T12:41:57.672522+0000","last_clean":"2024-03-30T12:41:57.672522+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:41:57.672522+0000","last_undegraded":"2024-03-30T12:41:57.672522+0000","last_fullsized":"2024-03-30T12:41:57.672522+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1304,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672534+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:41:57.672534+0000","last_peered":"2024-03-30T12:41:57.672534+0000","last_clean":"2024-03-30T12:41:57.672534+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:41:57.672534+0000","last_undegraded":"2024-03-30T12:41:57.672534+0000","last_fullsized":"2024-03-30T12:41:57.672534+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:55.774245+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:42:55.774245+0000","last_peered":"2024-03-30T12:42:55.774245+0000","last_clean":"2024-03-30T12:42:55.774245+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:42:55.774245+0000","last_undegraded":"2024-03-30T12:42:55.774245+0000","last_fullsized":"2024-03-30T12:42:55.774245+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1152,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150628+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:40:19.150628+0000","last_peered":"2024-03-30T12:40:19.150628+0000","last_clean":"2024-03-30T12:40:19.150628+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:40:19.150628+0000","last_undegraded":"2024-03-30T12:40:19.150628+0000","last_fullsized":"2024-03-30T12:40:19.150628+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326512+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:41:30.326512+0000","last_peered":"2024-03-30T12:41:30.326512+0000","last_clean":"2024-03-30T12:41:30.326512+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:41:30.326512+0000","last_undegraded":"2024-03-30T12:41:30.326512+0000","last_fullsized":"2024-03-30T12:41:30.326512+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1155,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:19.150608+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:40:19.150608+0000","last_peered":"2024-03-30T12:40:19.150608+0000","last_clean":"2024-03-30T12:40:19.150608+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:40:19.150608+0000","last_undegraded":"2024-03-30T12:40:19.150608+0000","last_fullsized":"2024-03-30T12:40:19.150608+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326527+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:41:30.326527+0000","last_peered":"2024-03-30T12:41:30.326527+0000","last_clean":"2024-03-30T12:41:30.326527+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:41:30.326527+0000","last_undegraded":"2024-03-30T12:41:30.326527+0000","last_fullsized":"2024-03-30T12:41:30.326527+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1263,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:27.662819+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:40:27.662819+0000","last_peered":"2024-03-30T12:40:27.662819+0000","last_clean":"2024-03-30T12:40:27.662819+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:40:27.662819+0000","last_undegraded":"2024-03-30T12:40:27.662819+0000","last_fullsized":"2024-03-30T12:40:27.662819+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1264,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302503+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:41:02.302503+0000","last_peered":"2024-03-30T12:41:02.302503+0000","last_clean":"2024-03-30T12:41:02.302503+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:41:02.302503+0000","last_undegraded":"2024-03-30T12:41:02.302503+0000","last_fullsized":"2024-03-30T12:41:02.302503+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:09.584292+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:42:09.584292+0000","last_peered":"2024-03-30T12:42:09.584292+0000","last_clean":"2024-03-30T12:42:09.584292+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:42:09.584292+0000","last_undegraded":"2024-03-30T12:42:09.584292+0000","last_fullsized":"2024-03-30T12:42:09.584292+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:15.763333+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:41:15.763333+0000","last_peered":"2024-03-30T12:41:15.763333+0000","last_clean":"2024-03-30T12:41:15.763333+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:41:15.763333+0000","last_undegraded":"2024-03-30T12:41:15.763333+0000","last_fullsized":"2024-03-30T12:41:15.763333+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1300,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:27.675651+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:42:27.675651+0000","last_peered":"2024-03-30T12:42:27.675651+0000","last_clean":"2024-03-30T12:42:27.675651+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:42:27.675651+0000","last_undegraded":"2024-03-30T12:42:27.675651+0000","last_fullsized":"2024-03-30T12:42:27.675651+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:27.675619+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:42:27.675619+0000","last_peered":"2024-03-30T12:42:27.675619+0000","last_clean":"2024-03-30T12:42:27.675619+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:42:27.675619+0000","last_undegraded":"2024-03-30T12:42:27.675619+0000","last_fullsized":"2024-03-30T12:42:27.675619+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1226,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323325+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:41:05.323325+0000","last_peered":"2024-03-30T12:41:05.323325+0000","last_clean":"2024-03-30T12:41:05.323325+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:41:05.323325+0000","last_undegraded":"2024-03-30T12:41:05.323325+0000","last_fullsized":"2024-03-30T12:41:05.323325+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:18.930743+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:41:18.930743+0000","last_peered":"2024-03-30T12:41:18.930743+0000","last_clean":"2024-03-30T12:41:18.930743+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:41:18.930743+0000","last_undegraded":"2024-03-30T12:41:18.930743+0000","last_fullsized":"2024-03-30T12:41:18.930743+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1172,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581788+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:41:44.581788+0000","last_peered":"2024-03-30T12:41:44.581788+0000","last_clean":"2024-03-30T12:41:44.581788+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:41:44.581788+0000","last_undegraded":"2024-03-30T12:41:44.581788+0000","last_fullsized":"2024-03-30T12:41:44.581788+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323382+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:41:05.323382+0000","last_peered":"2024-03-30T12:41:05.323382+0000","last_clean":"2024-03-30T12:41:05.323382+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:41:05.323382+0000","last_undegraded":"2024-03-30T12:41:05.323382+0000","last_fullsized":"2024-03-30T12:41:05.323382+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1200,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323370+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:41:05.323370+0000","last_peered":"2024-03-30T12:41:05.323370+0000","last_clean":"2024-03-30T12:41:05.323370+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:41:05.323370+0000","last_undegraded":"2024-03-30T12:41:05.323370+0000","last_fullsized":"2024-03-30T12:41:05.323370+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1293,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:53.406703+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:41:53.406703+0000","last_peered":"2024-03-30T12:41:53.406703+0000","last_clean":"2024-03-30T12:41:53.406703+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:41:53.406703+0000","last_undegraded":"2024-03-30T12:41:53.406703+0000","last_fullsized":"2024-03-30T12:41:53.406703+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:18.930787+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:41:18.930787+0000","last_peered":"2024-03-30T12:41:18.930787+0000","last_clean":"2024-03-30T12:41:18.930787+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:41:18.930787+0000","last_undegraded":"2024-03-30T12:41:18.930787+0000","last_fullsized":"2024-03-30T12:41:18.930787+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:32.312127+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:42:32.312127+0000","last_peered":"2024-03-30T12:42:32.312127+0000","last_clean":"2024-03-30T12:42:32.312127+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:42:32.312127+0000","last_undegraded":"2024-03-30T12:42:32.312127+0000","last_fullsized":"2024-03-30T12:42:32.312127+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1207,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579099+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:41:19.579099+0000","last_peered":"2024-03-30T12:41:19.579099+0000","last_clean":"2024-03-30T12:41:19.579099+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:41:19.579099+0000","last_undegraded":"2024-03-30T12:41:19.579099+0000","last_fullsized":"2024-03-30T12:41:19.579099+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:24.165645+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:42:24.165645+0000","last_peered":"2024-03-30T12:42:24.165645+0000","last_clean":"2024-03-30T12:42:24.165645+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:42:24.165645+0000","last_undegraded":"2024-03-30T12:42:24.165645+0000","last_fullsized":"2024-03-30T12:42:24.165645+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1386,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:35.772053+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:42:35.772053+0000","last_peered":"2024-03-30T12:42:35.772053+0000","last_clean":"2024-03-30T12:42:35.772053+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:42:35.772053+0000","last_undegraded":"2024-03-30T12:42:35.772053+0000","last_fullsized":"2024-03-30T12:42:35.772053+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:35.772026+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:42:35.772026+0000","last_peered":"2024-03-30T12:42:35.772026+0000","last_clean":"2024-03-30T12:42:35.772026+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:42:35.772026+0000","last_undegraded":"2024-03-30T12:42:35.772026+0000","last_fullsized":"2024-03-30T12:42:35.772026+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:40.320162+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:40:40.320162+0000","last_peered":"2024-03-30T12:40:40.320162+0000","last_clean":"2024-03-30T12:40:40.320162+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:40:40.320162+0000","last_undegraded":"2024-03-30T12:40:40.320162+0000","last_fullsized":"2024-03-30T12:40:40.320162+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:59.162782+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:41:59.162782+0000","last_peered":"2024-03-30T12:41:59.162782+0000","last_clean":"2024-03-30T12:41:59.162782+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:41:59.162782+0000","last_undegraded":"2024-03-30T12:41:59.162782+0000","last_fullsized":"2024-03-30T12:41:59.162782+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1186,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579076+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:41:19.579076+0000","last_peered":"2024-03-30T12:41:19.579076+0000","last_clean":"2024-03-30T12:41:19.579076+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:41:19.579076+0000","last_undegraded":"2024-03-30T12:41:19.579076+0000","last_fullsized":"2024-03-30T12:41:19.579076+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579050+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:41:19.579050+0000","last_peered":"2024-03-30T12:41:19.579050+0000","last_clean":"2024-03-30T12:41:19.579050+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:41:19.579050+0000","last_undegraded":"2024-03-30T12:41:19.579050+0000","last_fullsized":"2024-03-30T12:41:19.579050+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1346,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.403657+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:41:23.403657+0000","last_peered":"2024-03-30T12:41:23.403657+0000","last_clean":"2024-03-30T12:41:23.403657+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:41:23.403657+0000","last_undegraded":"2024-03-30T12:41:23.403657+0000","last_fullsized":"2024-03-30T12:41:23.403657+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:59.162732+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:41:59.162732+0000","last_peered":"2024-03-30T12:41:59.162732+0000","last_clean":"2024-03-30T12:41:59.162732+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:41:59.162732+0000","last_undegraded":"2024-03-30T12:41:59.162732+0000","last_fullsized":"2024-03-30T12:41:59.162732+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5755,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:33.411173+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:42:33.411173+0000","last_peered":"2024-03-30T12:42:33.411173+0000","last_clean":"2024-03-30T12:42:33.411173+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:42:33.411173+0000","last_undegraded":"2024-03-30T12:42:33.411173+0000","last_fullsized":"2024-03-30T12:42:33.411173+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1277,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:02.309177+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:42:02.309177+0000","last_peered":"2024-03-30T12:42:02.309177+0000","last_clean":"2024-03-30T12:42:02.309177+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:42:02.309177+0000","last_undegraded":"2024-03-30T12:42:02.309177+0000","last_fullsized":"2024-03-30T12:42:02.309177+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159642+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:41:34.159642+0000","last_peered":"2024-03-30T12:41:34.159642+0000","last_clean":"2024-03-30T12:41:34.159642+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:41:34.159642+0000","last_undegraded":"2024-03-30T12:41:34.159642+0000","last_fullsized":"2024-03-30T12:41:34.159642+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5516,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:55.774198+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:42:55.774198+0000","last_peered":"2024-03-30T12:42:55.774198+0000","last_clean":"2024-03-30T12:42:55.774198+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:42:55.774198+0000","last_undegraded":"2024-03-30T12:42:55.774198+0000","last_fullsized":"2024-03-30T12:42:55.774198+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931401+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:41:23.931401+0000","last_peered":"2024-03-30T12:41:23.931401+0000","last_clean":"2024-03-30T12:41:23.931401+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:41:23.931401+0000","last_undegraded":"2024-03-30T12:41:23.931401+0000","last_fullsized":"2024-03-30T12:41:23.931401+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931427+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:41:23.931427+0000","last_peered":"2024-03-30T12:41:23.931427+0000","last_clean":"2024-03-30T12:41:23.931427+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:41:23.931427+0000","last_undegraded":"2024-03-30T12:41:23.931427+0000","last_fullsized":"2024-03-30T12:41:23.931427+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326520+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:41:30.326520+0000","last_peered":"2024-03-30T12:41:30.326520+0000","last_clean":"2024-03-30T12:41:30.326520+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:41:30.326520+0000","last_undegraded":"2024-03-30T12:41:30.326520+0000","last_fullsized":"2024-03-30T12:41:30.326520+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5461,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:43:00.774816+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:43:00.774816+0000","last_peered":"2024-03-30T12:43:00.774816+0000","last_clean":"2024-03-30T12:43:00.774816+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:43:00.774816+0000","last_undegraded":"2024-03-30T12:43:00.774816+0000","last_fullsized":"2024-03-30T12:43:00.774816+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931438+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:41:23.931438+0000","last_peered":"2024-03-30T12:41:23.931438+0000","last_clean":"2024-03-30T12:41:23.931438+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:41:23.931438+0000","last_undegraded":"2024-03-30T12:41:23.931438+0000","last_fullsized":"2024-03-30T12:41:23.931438+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1209,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326461+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:41:30.326461+0000","last_peered":"2024-03-30T12:41:30.326461+0000","last_clean":"2024-03-30T12:41:30.326461+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:41:30.326461+0000","last_undegraded":"2024-03-30T12:41:30.326461+0000","last_fullsized":"2024-03-30T12:41:30.326461+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1275,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:07.315593+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:43:07.315593+0000","last_peered":"2024-03-30T12:43:07.315593+0000","last_clean":"2024-03-30T12:43:07.315593+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:43:07.315593+0000","last_undegraded":"2024-03-30T12:43:07.315593+0000","last_fullsized":"2024-03-30T12:43:07.315593+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3806,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:33.411258+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:42:33.411258+0000","last_peered":"2024-03-30T12:42:33.411258+0000","last_clean":"2024-03-30T12:42:33.411258+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:42:33.411258+0000","last_undegraded":"2024-03-30T12:42:33.411258+0000","last_fullsized":"2024-03-30T12:42:33.411258+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935569+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:41:58.935569+0000","last_peered":"2024-03-30T12:41:58.935569+0000","last_clean":"2024-03-30T12:41:58.935569+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:41:58.935569+0000","last_undegraded":"2024-03-30T12:41:58.935569+0000","last_fullsized":"2024-03-30T12:41:58.935569+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:48.940828+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:42:48.940828+0000","last_peered":"2024-03-30T12:42:48.940828+0000","last_clean":"2024-03-30T12:42:48.940828+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:42:48.940828+0000","last_undegraded":"2024-03-30T12:42:48.940828+0000","last_fullsized":"2024-03-30T12:42:48.940828+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.407376+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:41:58.407376+0000","last_peered":"2024-03-30T12:41:58.407376+0000","last_clean":"2024-03-30T12:41:58.407376+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:41:58.407376+0000","last_undegraded":"2024-03-30T12:41:58.407376+0000","last_fullsized":"2024-03-30T12:41:58.407376+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4579,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:49.168681+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:42:49.168681+0000","last_peered":"2024-03-30T12:42:49.168681+0000","last_clean":"2024-03-30T12:42:49.168681+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:42:49.168681+0000","last_undegraded":"2024-03-30T12:42:49.168681+0000","last_fullsized":"2024-03-30T12:42:49.168681+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1177,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:09.584340+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:42:09.584340+0000","last_peered":"2024-03-30T12:42:09.584340+0000","last_clean":"2024-03-30T12:42:09.584340+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:42:09.584340+0000","last_undegraded":"2024-03-30T12:42:09.584340+0000","last_fullsized":"2024-03-30T12:42:09.584340+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:32.676053+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:42:32.676053+0000","last_peered":"2024-03-30T12:42:32.676053+0000","last_clean":"2024-03-30T12:42:32.676053+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:42:32.676053+0000","last_undegraded":"2024-03-30T12:42:32.676053+0000","last_fullsized":"2024-03-30T12:42:32.676053+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1202,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326500+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:41:30.326500+0000","last_peered":"2024-03-30T12:41:30.326500+0000","last_clean":"2024-03-30T12:41:30.326500+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:41:30.326500+0000","last_undegraded":"2024-03-30T12:41:30.326500+0000","last_fullsized":"2024-03-30T12:41:30.326500+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1719,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:19.165060+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:42:19.165060+0000","last_peered":"2024-03-30T12:42:19.165060+0000","last_clean":"2024-03-30T12:42:19.165060+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:42:19.165060+0000","last_undegraded":"2024-03-30T12:42:19.165060+0000","last_fullsized":"2024-03-30T12:42:19.165060+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24716,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:00.329951+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:42:00.329951+0000","last_peered":"2024-03-30T12:42:00.329951+0000","last_clean":"2024-03-30T12:42:00.329951+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:42:00.329951+0000","last_undegraded":"2024-03-30T12:42:00.329951+0000","last_fullsized":"2024-03-30T12:42:00.329951+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:25.764684+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:41:25.764684+0000","last_peered":"2024-03-30T12:41:25.764684+0000","last_clean":"2024-03-30T12:41:25.764684+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:41:25.764684+0000","last_undegraded":"2024-03-30T12:41:25.764684+0000","last_fullsized":"2024-03-30T12:41:25.764684+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:55.774169+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:42:55.774169+0000","last_peered":"2024-03-30T12:42:55.774169+0000","last_clean":"2024-03-30T12:42:55.774169+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:42:55.774169+0000","last_undegraded":"2024-03-30T12:42:55.774169+0000","last_fullsized":"2024-03-30T12:42:55.774169+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:19.165034+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:42:19.165034+0000","last_peered":"2024-03-30T12:42:19.165034+0000","last_clean":"2024-03-30T12:42:19.165034+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:42:19.165034+0000","last_undegraded":"2024-03-30T12:42:19.165034+0000","last_fullsized":"2024-03-30T12:42:19.165034+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16483,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:09.584304+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:42:09.584304+0000","last_peered":"2024-03-30T12:42:09.584304+0000","last_clean":"2024-03-30T12:42:09.584304+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:42:09.584304+0000","last_undegraded":"2024-03-30T12:42:09.584304+0000","last_fullsized":"2024-03-30T12:42:09.584304+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:55.774215+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:42:55.774215+0000","last_peered":"2024-03-30T12:42:55.774215+0000","last_clean":"2024-03-30T12:42:55.774215+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:42:55.774215+0000","last_undegraded":"2024-03-30T12:42:55.774215+0000","last_fullsized":"2024-03-30T12:42:55.774215+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1166,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:49.168709+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:42:49.168709+0000","last_peered":"2024-03-30T12:42:49.168709+0000","last_clean":"2024-03-30T12:42:49.168709+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:42:49.168709+0000","last_undegraded":"2024-03-30T12:42:49.168709+0000","last_fullsized":"2024-03-30T12:42:49.168709+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931449+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:41:23.931449+0000","last_peered":"2024-03-30T12:41:23.931449+0000","last_clean":"2024-03-30T12:41:23.931449+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:41:23.931449+0000","last_undegraded":"2024-03-30T12:41:23.931449+0000","last_fullsized":"2024-03-30T12:41:23.931449+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31272,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:43:07.315551+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:43:07.315551+0000","last_peered":"2024-03-30T12:43:07.315551+0000","last_clean":"2024-03-30T12:43:07.315551+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:43:07.315551+0000","last_undegraded":"2024-03-30T12:43:07.315551+0000","last_fullsized":"2024-03-30T12:43:07.315551+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672495+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:41:57.672495+0000","last_peered":"2024-03-30T12:41:57.672495+0000","last_clean":"2024-03-30T12:41:57.672495+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:41:57.672495+0000","last_undegraded":"2024-03-30T12:41:57.672495+0000","last_fullsized":"2024-03-30T12:41:57.672495+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1356,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935556+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:41:58.935556+0000","last_peered":"2024-03-30T12:41:58.935556+0000","last_clean":"2024-03-30T12:41:58.935556+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:41:58.935556+0000","last_undegraded":"2024-03-30T12:41:58.935556+0000","last_fullsized":"2024-03-30T12:41:58.935556+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1300,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:07.679777+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:43:07.679777+0000","last_peered":"2024-03-30T12:43:07.679777+0000","last_clean":"2024-03-30T12:43:07.679777+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:43:07.679777+0000","last_undegraded":"2024-03-30T12:43:07.679777+0000","last_fullsized":"2024-03-30T12:43:07.679777+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3767,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672462+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:41:57.672462+0000","last_peered":"2024-03-30T12:41:57.672462+0000","last_clean":"2024-03-30T12:41:57.672462+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:41:57.672462+0000","last_undegraded":"2024-03-30T12:41:57.672462+0000","last_fullsized":"2024-03-30T12:41:57.672462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1236,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:07.315509+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:43:07.315509+0000","last_peered":"2024-03-30T12:43:07.315509+0000","last_clean":"2024-03-30T12:43:07.315509+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:43:07.315509+0000","last_undegraded":"2024-03-30T12:43:07.315509+0000","last_fullsized":"2024-03-30T12:43:07.315509+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1158,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:39.587408+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:42:39.587408+0000","last_peered":"2024-03-30T12:42:39.587408+0000","last_clean":"2024-03-30T12:42:39.587408+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:42:39.587408+0000","last_undegraded":"2024-03-30T12:42:39.587408+0000","last_fullsized":"2024-03-30T12:42:39.587408+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:25.764656+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:41:25.764656+0000","last_peered":"2024-03-30T12:41:25.764656+0000","last_clean":"2024-03-30T12:41:25.764656+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:41:25.764656+0000","last_undegraded":"2024-03-30T12:41:25.764656+0000","last_fullsized":"2024-03-30T12:41:25.764656+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15596,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:30.333267+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:42:30.333267+0000","last_peered":"2024-03-30T12:42:30.333267+0000","last_clean":"2024-03-30T12:42:30.333267+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:42:30.333267+0000","last_undegraded":"2024-03-30T12:42:30.333267+0000","last_fullsized":"2024-03-30T12:42:30.333267+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1145,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:09.156570+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:41:09.156570+0000","last_peered":"2024-03-30T12:41:09.156570+0000","last_clean":"2024-03-30T12:41:09.156570+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:41:09.156570+0000","last_undegraded":"2024-03-30T12:41:09.156570+0000","last_fullsized":"2024-03-30T12:41:09.156570+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:32.306064+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:41:32.306064+0000","last_peered":"2024-03-30T12:41:32.306064+0000","last_clean":"2024-03-30T12:41:32.306064+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:41:32.306064+0000","last_undegraded":"2024-03-30T12:41:32.306064+0000","last_fullsized":"2024-03-30T12:41:32.306064+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29022,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:02.309140+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:42:02.309140+0000","last_peered":"2024-03-30T12:42:02.309140+0000","last_clean":"2024-03-30T12:42:02.309140+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:42:02.309140+0000","last_undegraded":"2024-03-30T12:42:02.309140+0000","last_fullsized":"2024-03-30T12:42:02.309140+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935491+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:41:58.935491+0000","last_peered":"2024-03-30T12:41:58.935491+0000","last_clean":"2024-03-30T12:41:58.935491+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:41:58.935491+0000","last_undegraded":"2024-03-30T12:41:58.935491+0000","last_fullsized":"2024-03-30T12:41:58.935491+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1292,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:07.679723+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:43:07.679723+0000","last_peered":"2024-03-30T12:43:07.679723+0000","last_clean":"2024-03-30T12:43:07.679723+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:43:07.679723+0000","last_undegraded":"2024-03-30T12:43:07.679723+0000","last_fullsized":"2024-03-30T12:43:07.679723+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5612,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:53.400722+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:40:53.400722+0000","last_peered":"2024-03-30T12:40:53.400722+0000","last_clean":"2024-03-30T12:40:53.400722+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:40:53.400722+0000","last_undegraded":"2024-03-30T12:40:53.400722+0000","last_fullsized":"2024-03-30T12:40:53.400722+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1367,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935518+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:41:58.935518+0000","last_peered":"2024-03-30T12:41:58.935518+0000","last_clean":"2024-03-30T12:41:58.935518+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:41:58.935518+0000","last_undegraded":"2024-03-30T12:41:58.935518+0000","last_fullsized":"2024-03-30T12:41:58.935518+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:27.669397+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:41:27.669397+0000","last_peered":"2024-03-30T12:41:27.669397+0000","last_clean":"2024-03-30T12:41:27.669397+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:41:27.669397+0000","last_undegraded":"2024-03-30T12:41:27.669397+0000","last_fullsized":"2024-03-30T12:41:27.669397+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4277,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:33.939063+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:42:33.939063+0000","last_peered":"2024-03-30T12:42:33.939063+0000","last_clean":"2024-03-30T12:42:33.939063+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:42:33.939063+0000","last_undegraded":"2024-03-30T12:42:33.939063+0000","last_fullsized":"2024-03-30T12:42:33.939063+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1156,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159584+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:41:34.159584+0000","last_peered":"2024-03-30T12:41:34.159584+0000","last_clean":"2024-03-30T12:41:34.159584+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:41:34.159584+0000","last_undegraded":"2024-03-30T12:41:34.159584+0000","last_fullsized":"2024-03-30T12:41:34.159584+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1186,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:39.587344+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:42:39.587344+0000","last_peered":"2024-03-30T12:42:39.587344+0000","last_clean":"2024-03-30T12:42:39.587344+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:42:39.587344+0000","last_undegraded":"2024-03-30T12:42:39.587344+0000","last_fullsized":"2024-03-30T12:42:39.587344+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5255,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:40:53.400674+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:40:53.400674+0000","last_peered":"2024-03-30T12:40:53.400674+0000","last_clean":"2024-03-30T12:40:53.400674+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:40:53.400674+0000","last_undegraded":"2024-03-30T12:40:53.400674+0000","last_fullsized":"2024-03-30T12:40:53.400674+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1333,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:53.400708+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:40:53.400708+0000","last_peered":"2024-03-30T12:40:53.400708+0000","last_clean":"2024-03-30T12:40:53.400708+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:40:53.400708+0000","last_undegraded":"2024-03-30T12:40:53.400708+0000","last_fullsized":"2024-03-30T12:40:53.400708+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159619+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:41:34.159619+0000","last_peered":"2024-03-30T12:41:34.159619+0000","last_clean":"2024-03-30T12:41:34.159619+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:41:34.159619+0000","last_undegraded":"2024-03-30T12:41:34.159619+0000","last_fullsized":"2024-03-30T12:41:34.159619+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4813,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:33.411213+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:42:33.411213+0000","last_peered":"2024-03-30T12:42:33.411213+0000","last_clean":"2024-03-30T12:42:33.411213+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:42:33.411213+0000","last_undegraded":"2024-03-30T12:42:33.411213+0000","last_fullsized":"2024-03-30T12:42:33.411213+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:33.939095+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:42:33.939095+0000","last_peered":"2024-03-30T12:42:33.939095+0000","last_clean":"2024-03-30T12:42:33.939095+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:42:33.939095+0000","last_undegraded":"2024-03-30T12:42:33.939095+0000","last_fullsized":"2024-03-30T12:42:33.939095+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:30.333244+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:42:30.333244+0000","last_peered":"2024-03-30T12:42:30.333244+0000","last_clean":"2024-03-30T12:42:30.333244+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:42:30.333244+0000","last_undegraded":"2024-03-30T12:42:30.333244+0000","last_fullsized":"2024-03-30T12:42:30.333244+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6745,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:41:09.156602+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:41:09.156602+0000","last_peered":"2024-03-30T12:41:09.156602+0000","last_clean":"2024-03-30T12:41:09.156602+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:41:09.156602+0000","last_undegraded":"2024-03-30T12:41:09.156602+0000","last_fullsized":"2024-03-30T12:41:09.156602+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1339,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:53.400753+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:40:53.400753+0000","last_peered":"2024-03-30T12:40:53.400753+0000","last_clean":"2024-03-30T12:40:53.400753+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:40:53.400753+0000","last_undegraded":"2024-03-30T12:40:53.400753+0000","last_fullsized":"2024-03-30T12:40:53.400753+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159657+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:41:34.159657+0000","last_peered":"2024-03-30T12:41:34.159657+0000","last_clean":"2024-03-30T12:41:34.159657+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:41:34.159657+0000","last_undegraded":"2024-03-30T12:41:34.159657+0000","last_fullsized":"2024-03-30T12:41:34.159657+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1172,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:09.584262+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:42:09.584262+0000","last_peered":"2024-03-30T12:42:09.584262+0000","last_clean":"2024-03-30T12:42:09.584262+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:42:09.584262+0000","last_undegraded":"2024-03-30T12:42:09.584262+0000","last_fullsized":"2024-03-30T12:42:09.584262+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1335,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.407397+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:41:58.407397+0000","last_peered":"2024-03-30T12:41:58.407397+0000","last_clean":"2024-03-30T12:41:58.407397+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:41:58.407397+0000","last_undegraded":"2024-03-30T12:41:58.407397+0000","last_fullsized":"2024-03-30T12:41:58.407397+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326484+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:41:30.326484+0000","last_peered":"2024-03-30T12:41:30.326484+0000","last_clean":"2024-03-30T12:41:30.326484+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:41:30.326484+0000","last_undegraded":"2024-03-30T12:41:30.326484+0000","last_fullsized":"2024-03-30T12:41:30.326484+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:00.774774+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:43:00.774774+0000","last_peered":"2024-03-30T12:43:00.774774+0000","last_clean":"2024-03-30T12:43:00.774774+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:43:00.774774+0000","last_undegraded":"2024-03-30T12:43:00.774774+0000","last_fullsized":"2024-03-30T12:43:00.774774+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:07.679762+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:43:07.679762+0000","last_peered":"2024-03-30T12:43:07.679762+0000","last_clean":"2024-03-30T12:43:07.679762+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:43:07.679762+0000","last_undegraded":"2024-03-30T12:43:07.679762+0000","last_fullsized":"2024-03-30T12:43:07.679762+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935541+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:41:58.935541+0000","last_peered":"2024-03-30T12:41:58.935541+0000","last_clean":"2024-03-30T12:41:58.935541+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:41:58.935541+0000","last_undegraded":"2024-03-30T12:41:58.935541+0000","last_fullsized":"2024-03-30T12:41:58.935541+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1180,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:39.587396+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:42:39.587396+0000","last_peered":"2024-03-30T12:42:39.587396+0000","last_clean":"2024-03-30T12:42:39.587396+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:42:39.587396+0000","last_undegraded":"2024-03-30T12:42:39.587396+0000","last_fullsized":"2024-03-30T12:42:39.587396+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1284,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:07.679788+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:43:07.679788+0000","last_peered":"2024-03-30T12:43:07.679788+0000","last_clean":"2024-03-30T12:43:07.679788+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:43:07.679788+0000","last_undegraded":"2024-03-30T12:43:07.679788+0000","last_fullsized":"2024-03-30T12:43:07.679788+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:00.329894+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:42:00.329894+0000","last_peered":"2024-03-30T12:42:00.329894+0000","last_clean":"2024-03-30T12:42:00.329894+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:42:00.329894+0000","last_undegraded":"2024-03-30T12:42:00.329894+0000","last_fullsized":"2024-03-30T12:42:00.329894+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:27.669378+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:41:27.669378+0000","last_peered":"2024-03-30T12:41:27.669378+0000","last_clean":"2024-03-30T12:41:27.669378+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:41:27.669378+0000","last_undegraded":"2024-03-30T12:41:27.669378+0000","last_fullsized":"2024-03-30T12:41:27.669378+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1218,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:30.333212+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:42:30.333212+0000","last_peered":"2024-03-30T12:42:30.333212+0000","last_clean":"2024-03-30T12:42:30.333212+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:42:30.333212+0000","last_undegraded":"2024-03-30T12:42:30.333212+0000","last_fullsized":"2024-03-30T12:42:30.333212+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:00.768614+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:42:00.768614+0000","last_peered":"2024-03-30T12:42:00.768614+0000","last_clean":"2024-03-30T12:42:00.768614+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:42:00.768614+0000","last_undegraded":"2024-03-30T12:42:00.768614+0000","last_fullsized":"2024-03-30T12:42:00.768614+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1185,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:40:54.576179+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:40:54.576179+0000","last_peered":"2024-03-30T12:40:54.576179+0000","last_clean":"2024-03-30T12:40:54.576179+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:40:54.576179+0000","last_undegraded":"2024-03-30T12:40:54.576179+0000","last_fullsized":"2024-03-30T12:40:54.576179+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438132,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648188,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175199,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254437,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063256,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951313,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839370,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923652,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:45:21.226 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:21.226 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:21.226 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:21.227 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:21.227 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:21.227 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:21.227 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:21.227 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:21.227 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:21.227 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:21.227 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:21.227 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:21.227 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:21.227 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:45:21.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:21 smithi084 ceph-mon[91810]: from='client.34770 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:45:21.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:21 smithi084 ceph-mon[89279]: from='client.34770 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:45:21.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:21 smithi162 ceph-mon[83709]: from='client.34770 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:45:22.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:22 smithi084 ceph-mon[91810]: pgmap v1269: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:22.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:22 smithi084 ceph-mon[89279]: pgmap v1269: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:22.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:22 smithi162 ceph-mon[83709]: pgmap v1269: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:24.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:24 smithi084 ceph-mon[91810]: pgmap v1270: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:24.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:24 smithi084 ceph-mon[89279]: pgmap v1270: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:24.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:24 smithi162 ceph-mon[83709]: pgmap v1270: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:26.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:26 smithi084 ceph-mon[91810]: pgmap v1271: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:26.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:26 smithi084 ceph-mon[89279]: pgmap v1271: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:26.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:26 smithi162 ceph-mon[83709]: pgmap v1271: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:28.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:28 smithi084 ceph-mon[91810]: pgmap v1272: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:28.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:28 smithi084 ceph-mon[89279]: pgmap v1272: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:28.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:28 smithi162 ceph-mon[83709]: pgmap v1272: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:29.757 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:45:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:45:29] "GET /metrics HTTP/1.1" 200 36324 "" "Prometheus/2.43.0" 2024-03-30T12:45:30.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:30 smithi084 ceph-mon[89279]: pgmap v1273: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:30.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:30 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:45:30.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:30 smithi084 ceph-mon[91810]: pgmap v1273: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:30.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:30 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:45:30.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:30 smithi162 ceph-mon[83709]: pgmap v1273: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:30.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:30 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:45:31.228 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:45:31.447 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:45:32.506 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:32 smithi084 ceph-mon[91810]: pgmap v1274: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:32.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:32 smithi084 ceph-mon[89279]: pgmap v1274: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:32.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:32 smithi162 ceph-mon[83709]: pgmap v1274: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:33.480 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:45:33.483 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:45:34.207 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1275,"stamp":"2024-03-30T12:45:32.983183+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004277"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:49.168735+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:42:49.168735+0000","last_peered":"2024-03-30T12:42:49.168735+0000","last_clean":"2024-03-30T12:42:49.168735+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:42:49.168735+0000","last_undegraded":"2024-03-30T12:42:49.168735+0000","last_fullsized":"2024-03-30T12:42:49.168735+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1366,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931469+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:41:23.931469+0000","last_peered":"2024-03-30T12:41:23.931469+0000","last_clean":"2024-03-30T12:41:23.931469+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:41:23.931469+0000","last_undegraded":"2024-03-30T12:41:23.931469+0000","last_fullsized":"2024-03-30T12:41:23.931469+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:55.774228+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:42:55.774228+0000","last_peered":"2024-03-30T12:42:55.774228+0000","last_clean":"2024-03-30T12:42:55.774228+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:42:55.774228+0000","last_undegraded":"2024-03-30T12:42:55.774228+0000","last_fullsized":"2024-03-30T12:42:55.774228+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1236,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:00.336746+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:43:00.336746+0000","last_peered":"2024-03-30T12:43:00.336746+0000","last_clean":"2024-03-30T12:43:00.336746+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:43:00.336746+0000","last_undegraded":"2024-03-30T12:43:00.336746+0000","last_fullsized":"2024-03-30T12:43:00.336746+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:49.168654+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:42:49.168654+0000","last_peered":"2024-03-30T12:42:49.168654+0000","last_clean":"2024-03-30T12:42:49.168654+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:42:49.168654+0000","last_undegraded":"2024-03-30T12:42:49.168654+0000","last_fullsized":"2024-03-30T12:42:49.168654+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326493+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:41:30.326493+0000","last_peered":"2024-03-30T12:41:30.326493+0000","last_clean":"2024-03-30T12:41:30.326493+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:41:30.326493+0000","last_undegraded":"2024-03-30T12:41:30.326493+0000","last_fullsized":"2024-03-30T12:41:30.326493+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:49.168621+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:42:49.168621+0000","last_peered":"2024-03-30T12:42:49.168621+0000","last_clean":"2024-03-30T12:42:49.168621+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:42:49.168621+0000","last_undegraded":"2024-03-30T12:42:49.168621+0000","last_fullsized":"2024-03-30T12:42:49.168621+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:57.678742+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:42:57.678742+0000","last_peered":"2024-03-30T12:42:57.678742+0000","last_clean":"2024-03-30T12:42:57.678742+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:42:57.678742+0000","last_undegraded":"2024-03-30T12:42:57.678742+0000","last_fullsized":"2024-03-30T12:42:57.678742+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1151,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:24.165680+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:42:24.165680+0000","last_peered":"2024-03-30T12:42:24.165680+0000","last_clean":"2024-03-30T12:42:24.165680+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:42:24.165680+0000","last_undegraded":"2024-03-30T12:42:24.165680+0000","last_fullsized":"2024-03-30T12:42:24.165680+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581772+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:41:44.581772+0000","last_peered":"2024-03-30T12:41:44.581772+0000","last_clean":"2024-03-30T12:41:44.581772+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:41:44.581772+0000","last_undegraded":"2024-03-30T12:41:44.581772+0000","last_fullsized":"2024-03-30T12:41:44.581772+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581745+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:41:44.581745+0000","last_peered":"2024-03-30T12:41:44.581745+0000","last_clean":"2024-03-30T12:41:44.581745+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:41:44.581745+0000","last_undegraded":"2024-03-30T12:41:44.581745+0000","last_fullsized":"2024-03-30T12:41:44.581745+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:02.314952+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:43:02.314952+0000","last_peered":"2024-03-30T12:43:02.314952+0000","last_clean":"2024-03-30T12:43:02.314952+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:43:02.314952+0000","last_undegraded":"2024-03-30T12:43:02.314952+0000","last_fullsized":"2024-03-30T12:43:02.314952+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:27.675670+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:42:27.675670+0000","last_peered":"2024-03-30T12:42:27.675670+0000","last_clean":"2024-03-30T12:42:27.675670+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:42:27.675670+0000","last_undegraded":"2024-03-30T12:42:27.675670+0000","last_fullsized":"2024-03-30T12:42:27.675670+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:40.772652+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:42:40.772652+0000","last_peered":"2024-03-30T12:42:40.772652+0000","last_clean":"2024-03-30T12:42:40.772652+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:42:40.772652+0000","last_undegraded":"2024-03-30T12:42:40.772652+0000","last_fullsized":"2024-03-30T12:42:40.772652+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:08.942886+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:43:08.942886+0000","last_peered":"2024-03-30T12:43:08.942886+0000","last_clean":"2024-03-30T12:43:08.942886+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:43:08.942886+0000","last_undegraded":"2024-03-30T12:43:08.942886+0000","last_fullsized":"2024-03-30T12:43:08.942886+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1216,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:00.336693+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:43:00.336693+0000","last_peered":"2024-03-30T12:43:00.336693+0000","last_clean":"2024-03-30T12:43:00.336693+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:43:00.336693+0000","last_undegraded":"2024-03-30T12:43:00.336693+0000","last_fullsized":"2024-03-30T12:43:00.336693+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1227,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:00.336772+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:43:00.336772+0000","last_peered":"2024-03-30T12:43:00.336772+0000","last_clean":"2024-03-30T12:43:00.336772+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:43:00.336772+0000","last_undegraded":"2024-03-30T12:43:00.336772+0000","last_fullsized":"2024-03-30T12:43:00.336772+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.403697+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:41:23.403697+0000","last_peered":"2024-03-30T12:41:23.403697+0000","last_clean":"2024-03-30T12:41:23.403697+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:41:23.403697+0000","last_undegraded":"2024-03-30T12:41:23.403697+0000","last_fullsized":"2024-03-30T12:41:23.403697+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159632+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:41:34.159632+0000","last_peered":"2024-03-30T12:41:34.159632+0000","last_clean":"2024-03-30T12:41:34.159632+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:41:34.159632+0000","last_undegraded":"2024-03-30T12:41:34.159632+0000","last_fullsized":"2024-03-30T12:41:34.159632+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1391,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:55.774255+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:42:55.774255+0000","last_peered":"2024-03-30T12:42:55.774255+0000","last_clean":"2024-03-30T12:42:55.774255+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:42:55.774255+0000","last_undegraded":"2024-03-30T12:42:55.774255+0000","last_fullsized":"2024-03-30T12:42:55.774255+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1285,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672522+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:41:57.672522+0000","last_peered":"2024-03-30T12:41:57.672522+0000","last_clean":"2024-03-30T12:41:57.672522+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:41:57.672522+0000","last_undegraded":"2024-03-30T12:41:57.672522+0000","last_fullsized":"2024-03-30T12:41:57.672522+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1304,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672534+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:41:57.672534+0000","last_peered":"2024-03-30T12:41:57.672534+0000","last_clean":"2024-03-30T12:41:57.672534+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:41:57.672534+0000","last_undegraded":"2024-03-30T12:41:57.672534+0000","last_fullsized":"2024-03-30T12:41:57.672534+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:55.774245+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:42:55.774245+0000","last_peered":"2024-03-30T12:42:55.774245+0000","last_clean":"2024-03-30T12:42:55.774245+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:42:55.774245+0000","last_undegraded":"2024-03-30T12:42:55.774245+0000","last_fullsized":"2024-03-30T12:42:55.774245+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:49.168720+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:42:49.168720+0000","last_peered":"2024-03-30T12:42:49.168720+0000","last_clean":"2024-03-30T12:42:49.168720+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:42:49.168720+0000","last_undegraded":"2024-03-30T12:42:49.168720+0000","last_fullsized":"2024-03-30T12:42:49.168720+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326512+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:41:30.326512+0000","last_peered":"2024-03-30T12:41:30.326512+0000","last_clean":"2024-03-30T12:41:30.326512+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:41:30.326512+0000","last_undegraded":"2024-03-30T12:41:30.326512+0000","last_fullsized":"2024-03-30T12:41:30.326512+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1156,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:49.168669+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:42:49.168669+0000","last_peered":"2024-03-30T12:42:49.168669+0000","last_clean":"2024-03-30T12:42:49.168669+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:42:49.168669+0000","last_undegraded":"2024-03-30T12:42:49.168669+0000","last_fullsized":"2024-03-30T12:42:49.168669+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326527+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:41:30.326527+0000","last_peered":"2024-03-30T12:41:30.326527+0000","last_clean":"2024-03-30T12:41:30.326527+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:41:30.326527+0000","last_undegraded":"2024-03-30T12:41:30.326527+0000","last_fullsized":"2024-03-30T12:41:30.326527+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1264,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:57.678781+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:42:57.678781+0000","last_peered":"2024-03-30T12:42:57.678781+0000","last_clean":"2024-03-30T12:42:57.678781+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:42:57.678781+0000","last_undegraded":"2024-03-30T12:42:57.678781+0000","last_fullsized":"2024-03-30T12:42:57.678781+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1264,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302503+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:41:02.302503+0000","last_peered":"2024-03-30T12:41:02.302503+0000","last_clean":"2024-03-30T12:41:02.302503+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:41:02.302503+0000","last_undegraded":"2024-03-30T12:41:02.302503+0000","last_fullsized":"2024-03-30T12:41:02.302503+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:09.584292+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:42:09.584292+0000","last_peered":"2024-03-30T12:42:09.584292+0000","last_clean":"2024-03-30T12:42:09.584292+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:42:09.584292+0000","last_undegraded":"2024-03-30T12:42:09.584292+0000","last_fullsized":"2024-03-30T12:42:09.584292+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:15.763333+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:41:15.763333+0000","last_peered":"2024-03-30T12:41:15.763333+0000","last_clean":"2024-03-30T12:41:15.763333+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:41:15.763333+0000","last_undegraded":"2024-03-30T12:41:15.763333+0000","last_fullsized":"2024-03-30T12:41:15.763333+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1300,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:27.675651+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:42:27.675651+0000","last_peered":"2024-03-30T12:42:27.675651+0000","last_clean":"2024-03-30T12:42:27.675651+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:42:27.675651+0000","last_undegraded":"2024-03-30T12:42:27.675651+0000","last_fullsized":"2024-03-30T12:42:27.675651+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:27.675619+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:42:27.675619+0000","last_peered":"2024-03-30T12:42:27.675619+0000","last_clean":"2024-03-30T12:42:27.675619+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:42:27.675619+0000","last_undegraded":"2024-03-30T12:42:27.675619+0000","last_fullsized":"2024-03-30T12:42:27.675619+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1226,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323325+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:41:05.323325+0000","last_peered":"2024-03-30T12:41:05.323325+0000","last_clean":"2024-03-30T12:41:05.323325+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:41:05.323325+0000","last_undegraded":"2024-03-30T12:41:05.323325+0000","last_fullsized":"2024-03-30T12:41:05.323325+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:18.930743+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:41:18.930743+0000","last_peered":"2024-03-30T12:41:18.930743+0000","last_clean":"2024-03-30T12:41:18.930743+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:41:18.930743+0000","last_undegraded":"2024-03-30T12:41:18.930743+0000","last_fullsized":"2024-03-30T12:41:18.930743+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1172,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581788+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:41:44.581788+0000","last_peered":"2024-03-30T12:41:44.581788+0000","last_clean":"2024-03-30T12:41:44.581788+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:41:44.581788+0000","last_undegraded":"2024-03-30T12:41:44.581788+0000","last_fullsized":"2024-03-30T12:41:44.581788+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323382+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:41:05.323382+0000","last_peered":"2024-03-30T12:41:05.323382+0000","last_clean":"2024-03-30T12:41:05.323382+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:41:05.323382+0000","last_undegraded":"2024-03-30T12:41:05.323382+0000","last_fullsized":"2024-03-30T12:41:05.323382+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1200,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323370+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:41:05.323370+0000","last_peered":"2024-03-30T12:41:05.323370+0000","last_clean":"2024-03-30T12:41:05.323370+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:41:05.323370+0000","last_undegraded":"2024-03-30T12:41:05.323370+0000","last_fullsized":"2024-03-30T12:41:05.323370+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1293,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:53.406703+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:41:53.406703+0000","last_peered":"2024-03-30T12:41:53.406703+0000","last_clean":"2024-03-30T12:41:53.406703+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:41:53.406703+0000","last_undegraded":"2024-03-30T12:41:53.406703+0000","last_fullsized":"2024-03-30T12:41:53.406703+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:18.930787+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:41:18.930787+0000","last_peered":"2024-03-30T12:41:18.930787+0000","last_clean":"2024-03-30T12:41:18.930787+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:41:18.930787+0000","last_undegraded":"2024-03-30T12:41:18.930787+0000","last_fullsized":"2024-03-30T12:41:18.930787+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:32.312127+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:42:32.312127+0000","last_peered":"2024-03-30T12:42:32.312127+0000","last_clean":"2024-03-30T12:42:32.312127+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:42:32.312127+0000","last_undegraded":"2024-03-30T12:42:32.312127+0000","last_fullsized":"2024-03-30T12:42:32.312127+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1207,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579099+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:41:19.579099+0000","last_peered":"2024-03-30T12:41:19.579099+0000","last_clean":"2024-03-30T12:41:19.579099+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:41:19.579099+0000","last_undegraded":"2024-03-30T12:41:19.579099+0000","last_fullsized":"2024-03-30T12:41:19.579099+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:24.165645+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:42:24.165645+0000","last_peered":"2024-03-30T12:42:24.165645+0000","last_clean":"2024-03-30T12:42:24.165645+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:42:24.165645+0000","last_undegraded":"2024-03-30T12:42:24.165645+0000","last_fullsized":"2024-03-30T12:42:24.165645+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1386,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:35.772053+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:42:35.772053+0000","last_peered":"2024-03-30T12:42:35.772053+0000","last_clean":"2024-03-30T12:42:35.772053+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:42:35.772053+0000","last_undegraded":"2024-03-30T12:42:35.772053+0000","last_fullsized":"2024-03-30T12:42:35.772053+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:35.772026+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:42:35.772026+0000","last_peered":"2024-03-30T12:42:35.772026+0000","last_clean":"2024-03-30T12:42:35.772026+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:42:35.772026+0000","last_undegraded":"2024-03-30T12:42:35.772026+0000","last_fullsized":"2024-03-30T12:42:35.772026+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1236,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:00.336730+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:43:00.336730+0000","last_peered":"2024-03-30T12:43:00.336730+0000","last_clean":"2024-03-30T12:43:00.336730+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:43:00.336730+0000","last_undegraded":"2024-03-30T12:43:00.336730+0000","last_fullsized":"2024-03-30T12:43:00.336730+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:59.162782+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:41:59.162782+0000","last_peered":"2024-03-30T12:41:59.162782+0000","last_clean":"2024-03-30T12:41:59.162782+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:41:59.162782+0000","last_undegraded":"2024-03-30T12:41:59.162782+0000","last_fullsized":"2024-03-30T12:41:59.162782+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1186,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579076+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:41:19.579076+0000","last_peered":"2024-03-30T12:41:19.579076+0000","last_clean":"2024-03-30T12:41:19.579076+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:41:19.579076+0000","last_undegraded":"2024-03-30T12:41:19.579076+0000","last_fullsized":"2024-03-30T12:41:19.579076+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579050+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:41:19.579050+0000","last_peered":"2024-03-30T12:41:19.579050+0000","last_clean":"2024-03-30T12:41:19.579050+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:41:19.579050+0000","last_undegraded":"2024-03-30T12:41:19.579050+0000","last_fullsized":"2024-03-30T12:41:19.579050+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1346,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.403657+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:41:23.403657+0000","last_peered":"2024-03-30T12:41:23.403657+0000","last_clean":"2024-03-30T12:41:23.403657+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:41:23.403657+0000","last_undegraded":"2024-03-30T12:41:23.403657+0000","last_fullsized":"2024-03-30T12:41:23.403657+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:59.162732+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:41:59.162732+0000","last_peered":"2024-03-30T12:41:59.162732+0000","last_clean":"2024-03-30T12:41:59.162732+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:41:59.162732+0000","last_undegraded":"2024-03-30T12:41:59.162732+0000","last_fullsized":"2024-03-30T12:41:59.162732+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5755,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:33.411173+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:42:33.411173+0000","last_peered":"2024-03-30T12:42:33.411173+0000","last_clean":"2024-03-30T12:42:33.411173+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:42:33.411173+0000","last_undegraded":"2024-03-30T12:42:33.411173+0000","last_fullsized":"2024-03-30T12:42:33.411173+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1277,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:02.309177+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:42:02.309177+0000","last_peered":"2024-03-30T12:42:02.309177+0000","last_clean":"2024-03-30T12:42:02.309177+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:42:02.309177+0000","last_undegraded":"2024-03-30T12:42:02.309177+0000","last_fullsized":"2024-03-30T12:42:02.309177+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159642+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:41:34.159642+0000","last_peered":"2024-03-30T12:41:34.159642+0000","last_clean":"2024-03-30T12:41:34.159642+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:41:34.159642+0000","last_undegraded":"2024-03-30T12:41:34.159642+0000","last_fullsized":"2024-03-30T12:41:34.159642+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5516,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:55.774198+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:42:55.774198+0000","last_peered":"2024-03-30T12:42:55.774198+0000","last_clean":"2024-03-30T12:42:55.774198+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:42:55.774198+0000","last_undegraded":"2024-03-30T12:42:55.774198+0000","last_fullsized":"2024-03-30T12:42:55.774198+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931401+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:41:23.931401+0000","last_peered":"2024-03-30T12:41:23.931401+0000","last_clean":"2024-03-30T12:41:23.931401+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:41:23.931401+0000","last_undegraded":"2024-03-30T12:41:23.931401+0000","last_fullsized":"2024-03-30T12:41:23.931401+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1349,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931427+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:41:23.931427+0000","last_peered":"2024-03-30T12:41:23.931427+0000","last_clean":"2024-03-30T12:41:23.931427+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:41:23.931427+0000","last_undegraded":"2024-03-30T12:41:23.931427+0000","last_fullsized":"2024-03-30T12:41:23.931427+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326520+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:41:30.326520+0000","last_peered":"2024-03-30T12:41:30.326520+0000","last_clean":"2024-03-30T12:41:30.326520+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:41:30.326520+0000","last_undegraded":"2024-03-30T12:41:30.326520+0000","last_fullsized":"2024-03-30T12:41:30.326520+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5461,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:43:00.774816+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:43:00.774816+0000","last_peered":"2024-03-30T12:43:00.774816+0000","last_clean":"2024-03-30T12:43:00.774816+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:43:00.774816+0000","last_undegraded":"2024-03-30T12:43:00.774816+0000","last_fullsized":"2024-03-30T12:43:00.774816+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931438+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:41:23.931438+0000","last_peered":"2024-03-30T12:41:23.931438+0000","last_clean":"2024-03-30T12:41:23.931438+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:41:23.931438+0000","last_undegraded":"2024-03-30T12:41:23.931438+0000","last_fullsized":"2024-03-30T12:41:23.931438+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1209,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326461+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:41:30.326461+0000","last_peered":"2024-03-30T12:41:30.326461+0000","last_clean":"2024-03-30T12:41:30.326461+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:41:30.326461+0000","last_undegraded":"2024-03-30T12:41:30.326461+0000","last_fullsized":"2024-03-30T12:41:30.326461+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1275,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:07.315593+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:43:07.315593+0000","last_peered":"2024-03-30T12:43:07.315593+0000","last_clean":"2024-03-30T12:43:07.315593+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:43:07.315593+0000","last_undegraded":"2024-03-30T12:43:07.315593+0000","last_fullsized":"2024-03-30T12:43:07.315593+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3806,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:33.411258+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:42:33.411258+0000","last_peered":"2024-03-30T12:42:33.411258+0000","last_clean":"2024-03-30T12:42:33.411258+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:42:33.411258+0000","last_undegraded":"2024-03-30T12:42:33.411258+0000","last_fullsized":"2024-03-30T12:42:33.411258+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935569+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:41:58.935569+0000","last_peered":"2024-03-30T12:41:58.935569+0000","last_clean":"2024-03-30T12:41:58.935569+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:41:58.935569+0000","last_undegraded":"2024-03-30T12:41:58.935569+0000","last_fullsized":"2024-03-30T12:41:58.935569+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:48.940828+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:42:48.940828+0000","last_peered":"2024-03-30T12:42:48.940828+0000","last_clean":"2024-03-30T12:42:48.940828+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:42:48.940828+0000","last_undegraded":"2024-03-30T12:42:48.940828+0000","last_fullsized":"2024-03-30T12:42:48.940828+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.407376+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:41:58.407376+0000","last_peered":"2024-03-30T12:41:58.407376+0000","last_clean":"2024-03-30T12:41:58.407376+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:41:58.407376+0000","last_undegraded":"2024-03-30T12:41:58.407376+0000","last_fullsized":"2024-03-30T12:41:58.407376+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4579,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:49.168681+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:42:49.168681+0000","last_peered":"2024-03-30T12:42:49.168681+0000","last_clean":"2024-03-30T12:42:49.168681+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:42:49.168681+0000","last_undegraded":"2024-03-30T12:42:49.168681+0000","last_fullsized":"2024-03-30T12:42:49.168681+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1177,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:09.584340+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:42:09.584340+0000","last_peered":"2024-03-30T12:42:09.584340+0000","last_clean":"2024-03-30T12:42:09.584340+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:42:09.584340+0000","last_undegraded":"2024-03-30T12:42:09.584340+0000","last_fullsized":"2024-03-30T12:42:09.584340+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:32.676053+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:42:32.676053+0000","last_peered":"2024-03-30T12:42:32.676053+0000","last_clean":"2024-03-30T12:42:32.676053+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:42:32.676053+0000","last_undegraded":"2024-03-30T12:42:32.676053+0000","last_fullsized":"2024-03-30T12:42:32.676053+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1202,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326500+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:41:30.326500+0000","last_peered":"2024-03-30T12:41:30.326500+0000","last_clean":"2024-03-30T12:41:30.326500+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:41:30.326500+0000","last_undegraded":"2024-03-30T12:41:30.326500+0000","last_fullsized":"2024-03-30T12:41:30.326500+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1719,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:19.165060+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:42:19.165060+0000","last_peered":"2024-03-30T12:42:19.165060+0000","last_clean":"2024-03-30T12:42:19.165060+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:42:19.165060+0000","last_undegraded":"2024-03-30T12:42:19.165060+0000","last_fullsized":"2024-03-30T12:42:19.165060+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24716,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:00.329951+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:42:00.329951+0000","last_peered":"2024-03-30T12:42:00.329951+0000","last_clean":"2024-03-30T12:42:00.329951+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:42:00.329951+0000","last_undegraded":"2024-03-30T12:42:00.329951+0000","last_fullsized":"2024-03-30T12:42:00.329951+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:25.764684+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:41:25.764684+0000","last_peered":"2024-03-30T12:41:25.764684+0000","last_clean":"2024-03-30T12:41:25.764684+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:41:25.764684+0000","last_undegraded":"2024-03-30T12:41:25.764684+0000","last_fullsized":"2024-03-30T12:41:25.764684+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:55.774169+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:42:55.774169+0000","last_peered":"2024-03-30T12:42:55.774169+0000","last_clean":"2024-03-30T12:42:55.774169+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:42:55.774169+0000","last_undegraded":"2024-03-30T12:42:55.774169+0000","last_fullsized":"2024-03-30T12:42:55.774169+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:19.165034+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:42:19.165034+0000","last_peered":"2024-03-30T12:42:19.165034+0000","last_clean":"2024-03-30T12:42:19.165034+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:42:19.165034+0000","last_undegraded":"2024-03-30T12:42:19.165034+0000","last_fullsized":"2024-03-30T12:42:19.165034+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16483,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:09.584304+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:42:09.584304+0000","last_peered":"2024-03-30T12:42:09.584304+0000","last_clean":"2024-03-30T12:42:09.584304+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:42:09.584304+0000","last_undegraded":"2024-03-30T12:42:09.584304+0000","last_fullsized":"2024-03-30T12:42:09.584304+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:55.774215+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:42:55.774215+0000","last_peered":"2024-03-30T12:42:55.774215+0000","last_clean":"2024-03-30T12:42:55.774215+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:42:55.774215+0000","last_undegraded":"2024-03-30T12:42:55.774215+0000","last_fullsized":"2024-03-30T12:42:55.774215+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1166,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:49.168709+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:42:49.168709+0000","last_peered":"2024-03-30T12:42:49.168709+0000","last_clean":"2024-03-30T12:42:49.168709+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:42:49.168709+0000","last_undegraded":"2024-03-30T12:42:49.168709+0000","last_fullsized":"2024-03-30T12:42:49.168709+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.931449+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:41:23.931449+0000","last_peered":"2024-03-30T12:41:23.931449+0000","last_clean":"2024-03-30T12:41:23.931449+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:41:23.931449+0000","last_undegraded":"2024-03-30T12:41:23.931449+0000","last_fullsized":"2024-03-30T12:41:23.931449+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31272,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:43:07.315551+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:43:07.315551+0000","last_peered":"2024-03-30T12:43:07.315551+0000","last_clean":"2024-03-30T12:43:07.315551+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:43:07.315551+0000","last_undegraded":"2024-03-30T12:43:07.315551+0000","last_fullsized":"2024-03-30T12:43:07.315551+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672495+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:41:57.672495+0000","last_peered":"2024-03-30T12:41:57.672495+0000","last_clean":"2024-03-30T12:41:57.672495+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:41:57.672495+0000","last_undegraded":"2024-03-30T12:41:57.672495+0000","last_fullsized":"2024-03-30T12:41:57.672495+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1356,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935556+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:41:58.935556+0000","last_peered":"2024-03-30T12:41:58.935556+0000","last_clean":"2024-03-30T12:41:58.935556+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:41:58.935556+0000","last_undegraded":"2024-03-30T12:41:58.935556+0000","last_fullsized":"2024-03-30T12:41:58.935556+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1300,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:07.679777+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:43:07.679777+0000","last_peered":"2024-03-30T12:43:07.679777+0000","last_clean":"2024-03-30T12:43:07.679777+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:43:07.679777+0000","last_undegraded":"2024-03-30T12:43:07.679777+0000","last_fullsized":"2024-03-30T12:43:07.679777+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3767,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672462+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:41:57.672462+0000","last_peered":"2024-03-30T12:41:57.672462+0000","last_clean":"2024-03-30T12:41:57.672462+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:41:57.672462+0000","last_undegraded":"2024-03-30T12:41:57.672462+0000","last_fullsized":"2024-03-30T12:41:57.672462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1236,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:07.315509+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:43:07.315509+0000","last_peered":"2024-03-30T12:43:07.315509+0000","last_clean":"2024-03-30T12:43:07.315509+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:43:07.315509+0000","last_undegraded":"2024-03-30T12:43:07.315509+0000","last_fullsized":"2024-03-30T12:43:07.315509+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1158,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:39.587408+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:42:39.587408+0000","last_peered":"2024-03-30T12:42:39.587408+0000","last_clean":"2024-03-30T12:42:39.587408+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:42:39.587408+0000","last_undegraded":"2024-03-30T12:42:39.587408+0000","last_fullsized":"2024-03-30T12:42:39.587408+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:25.764656+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:41:25.764656+0000","last_peered":"2024-03-30T12:41:25.764656+0000","last_clean":"2024-03-30T12:41:25.764656+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:41:25.764656+0000","last_undegraded":"2024-03-30T12:41:25.764656+0000","last_fullsized":"2024-03-30T12:41:25.764656+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15596,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:30.333267+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:42:30.333267+0000","last_peered":"2024-03-30T12:42:30.333267+0000","last_clean":"2024-03-30T12:42:30.333267+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:42:30.333267+0000","last_undegraded":"2024-03-30T12:42:30.333267+0000","last_fullsized":"2024-03-30T12:42:30.333267+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:19.172145+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:43:19.172145+0000","last_peered":"2024-03-30T12:43:19.172145+0000","last_clean":"2024-03-30T12:43:19.172145+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:43:19.172145+0000","last_undegraded":"2024-03-30T12:43:19.172145+0000","last_fullsized":"2024-03-30T12:43:19.172145+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:32.306064+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:41:32.306064+0000","last_peered":"2024-03-30T12:41:32.306064+0000","last_clean":"2024-03-30T12:41:32.306064+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:41:32.306064+0000","last_undegraded":"2024-03-30T12:41:32.306064+0000","last_fullsized":"2024-03-30T12:41:32.306064+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29022,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:02.309140+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:42:02.309140+0000","last_peered":"2024-03-30T12:42:02.309140+0000","last_clean":"2024-03-30T12:42:02.309140+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:42:02.309140+0000","last_undegraded":"2024-03-30T12:42:02.309140+0000","last_fullsized":"2024-03-30T12:42:02.309140+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935491+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:41:58.935491+0000","last_peered":"2024-03-30T12:41:58.935491+0000","last_clean":"2024-03-30T12:41:58.935491+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:41:58.935491+0000","last_undegraded":"2024-03-30T12:41:58.935491+0000","last_fullsized":"2024-03-30T12:41:58.935491+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1292,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:07.679723+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:43:07.679723+0000","last_peered":"2024-03-30T12:43:07.679723+0000","last_clean":"2024-03-30T12:43:07.679723+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:43:07.679723+0000","last_undegraded":"2024-03-30T12:43:07.679723+0000","last_fullsized":"2024-03-30T12:43:07.679723+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5613,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:43:08.415054+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:43:08.415054+0000","last_peered":"2024-03-30T12:43:08.415054+0000","last_clean":"2024-03-30T12:43:08.415054+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:43:08.415054+0000","last_undegraded":"2024-03-30T12:43:08.415054+0000","last_fullsized":"2024-03-30T12:43:08.415054+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1367,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935518+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:41:58.935518+0000","last_peered":"2024-03-30T12:41:58.935518+0000","last_clean":"2024-03-30T12:41:58.935518+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:41:58.935518+0000","last_undegraded":"2024-03-30T12:41:58.935518+0000","last_fullsized":"2024-03-30T12:41:58.935518+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:27.669397+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:41:27.669397+0000","last_peered":"2024-03-30T12:41:27.669397+0000","last_clean":"2024-03-30T12:41:27.669397+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:41:27.669397+0000","last_undegraded":"2024-03-30T12:41:27.669397+0000","last_fullsized":"2024-03-30T12:41:27.669397+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4277,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:33.939063+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:42:33.939063+0000","last_peered":"2024-03-30T12:42:33.939063+0000","last_clean":"2024-03-30T12:42:33.939063+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:42:33.939063+0000","last_undegraded":"2024-03-30T12:42:33.939063+0000","last_fullsized":"2024-03-30T12:42:33.939063+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1156,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159584+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:41:34.159584+0000","last_peered":"2024-03-30T12:41:34.159584+0000","last_clean":"2024-03-30T12:41:34.159584+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:41:34.159584+0000","last_undegraded":"2024-03-30T12:41:34.159584+0000","last_fullsized":"2024-03-30T12:41:34.159584+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1186,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:39.587344+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:42:39.587344+0000","last_peered":"2024-03-30T12:42:39.587344+0000","last_clean":"2024-03-30T12:42:39.587344+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:42:39.587344+0000","last_undegraded":"2024-03-30T12:42:39.587344+0000","last_fullsized":"2024-03-30T12:42:39.587344+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5256,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:43:08.414974+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:43:08.414974+0000","last_peered":"2024-03-30T12:43:08.414974+0000","last_clean":"2024-03-30T12:43:08.414974+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:43:08.414974+0000","last_undegraded":"2024-03-30T12:43:08.414974+0000","last_fullsized":"2024-03-30T12:43:08.414974+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:08.415043+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:43:08.415043+0000","last_peered":"2024-03-30T12:43:08.415043+0000","last_clean":"2024-03-30T12:43:08.415043+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:43:08.415043+0000","last_undegraded":"2024-03-30T12:43:08.415043+0000","last_fullsized":"2024-03-30T12:43:08.415043+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159619+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:41:34.159619+0000","last_peered":"2024-03-30T12:41:34.159619+0000","last_clean":"2024-03-30T12:41:34.159619+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:41:34.159619+0000","last_undegraded":"2024-03-30T12:41:34.159619+0000","last_fullsized":"2024-03-30T12:41:34.159619+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4813,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:33.411213+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:42:33.411213+0000","last_peered":"2024-03-30T12:42:33.411213+0000","last_clean":"2024-03-30T12:42:33.411213+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:42:33.411213+0000","last_undegraded":"2024-03-30T12:42:33.411213+0000","last_fullsized":"2024-03-30T12:42:33.411213+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:33.939095+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:42:33.939095+0000","last_peered":"2024-03-30T12:42:33.939095+0000","last_clean":"2024-03-30T12:42:33.939095+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:42:33.939095+0000","last_undegraded":"2024-03-30T12:42:33.939095+0000","last_fullsized":"2024-03-30T12:42:33.939095+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:30.333244+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:42:30.333244+0000","last_peered":"2024-03-30T12:42:30.333244+0000","last_clean":"2024-03-30T12:42:30.333244+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:42:30.333244+0000","last_undegraded":"2024-03-30T12:42:30.333244+0000","last_fullsized":"2024-03-30T12:42:30.333244+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6746,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:43:19.172205+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:43:19.172205+0000","last_peered":"2024-03-30T12:43:19.172205+0000","last_clean":"2024-03-30T12:43:19.172205+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:43:19.172205+0000","last_undegraded":"2024-03-30T12:43:19.172205+0000","last_fullsized":"2024-03-30T12:43:19.172205+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1340,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:08.415089+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:43:08.415089+0000","last_peered":"2024-03-30T12:43:08.415089+0000","last_clean":"2024-03-30T12:43:08.415089+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:43:08.415089+0000","last_undegraded":"2024-03-30T12:43:08.415089+0000","last_fullsized":"2024-03-30T12:43:08.415089+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159657+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:41:34.159657+0000","last_peered":"2024-03-30T12:41:34.159657+0000","last_clean":"2024-03-30T12:41:34.159657+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:41:34.159657+0000","last_undegraded":"2024-03-30T12:41:34.159657+0000","last_fullsized":"2024-03-30T12:41:34.159657+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1172,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:09.584262+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:42:09.584262+0000","last_peered":"2024-03-30T12:42:09.584262+0000","last_clean":"2024-03-30T12:42:09.584262+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:42:09.584262+0000","last_undegraded":"2024-03-30T12:42:09.584262+0000","last_fullsized":"2024-03-30T12:42:09.584262+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1335,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.407397+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:41:58.407397+0000","last_peered":"2024-03-30T12:41:58.407397+0000","last_clean":"2024-03-30T12:41:58.407397+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:41:58.407397+0000","last_undegraded":"2024-03-30T12:41:58.407397+0000","last_fullsized":"2024-03-30T12:41:58.407397+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326484+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:41:30.326484+0000","last_peered":"2024-03-30T12:41:30.326484+0000","last_clean":"2024-03-30T12:41:30.326484+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:41:30.326484+0000","last_undegraded":"2024-03-30T12:41:30.326484+0000","last_fullsized":"2024-03-30T12:41:30.326484+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:00.774774+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:43:00.774774+0000","last_peered":"2024-03-30T12:43:00.774774+0000","last_clean":"2024-03-30T12:43:00.774774+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:43:00.774774+0000","last_undegraded":"2024-03-30T12:43:00.774774+0000","last_fullsized":"2024-03-30T12:43:00.774774+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:07.679762+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:43:07.679762+0000","last_peered":"2024-03-30T12:43:07.679762+0000","last_clean":"2024-03-30T12:43:07.679762+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:43:07.679762+0000","last_undegraded":"2024-03-30T12:43:07.679762+0000","last_fullsized":"2024-03-30T12:43:07.679762+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935541+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:41:58.935541+0000","last_peered":"2024-03-30T12:41:58.935541+0000","last_clean":"2024-03-30T12:41:58.935541+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:41:58.935541+0000","last_undegraded":"2024-03-30T12:41:58.935541+0000","last_fullsized":"2024-03-30T12:41:58.935541+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1180,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:39.587396+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:42:39.587396+0000","last_peered":"2024-03-30T12:42:39.587396+0000","last_clean":"2024-03-30T12:42:39.587396+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:42:39.587396+0000","last_undegraded":"2024-03-30T12:42:39.587396+0000","last_fullsized":"2024-03-30T12:42:39.587396+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1284,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:07.679788+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:43:07.679788+0000","last_peered":"2024-03-30T12:43:07.679788+0000","last_clean":"2024-03-30T12:43:07.679788+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:43:07.679788+0000","last_undegraded":"2024-03-30T12:43:07.679788+0000","last_fullsized":"2024-03-30T12:43:07.679788+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:00.329894+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:42:00.329894+0000","last_peered":"2024-03-30T12:42:00.329894+0000","last_clean":"2024-03-30T12:42:00.329894+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:42:00.329894+0000","last_undegraded":"2024-03-30T12:42:00.329894+0000","last_fullsized":"2024-03-30T12:42:00.329894+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:27.669378+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:41:27.669378+0000","last_peered":"2024-03-30T12:41:27.669378+0000","last_clean":"2024-03-30T12:41:27.669378+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:41:27.669378+0000","last_undegraded":"2024-03-30T12:41:27.669378+0000","last_fullsized":"2024-03-30T12:41:27.669378+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1218,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:30.333212+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:42:30.333212+0000","last_peered":"2024-03-30T12:42:30.333212+0000","last_clean":"2024-03-30T12:42:30.333212+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:42:30.333212+0000","last_undegraded":"2024-03-30T12:42:30.333212+0000","last_fullsized":"2024-03-30T12:42:30.333212+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:00.768614+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:42:00.768614+0000","last_peered":"2024-03-30T12:42:00.768614+0000","last_clean":"2024-03-30T12:42:00.768614+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:42:00.768614+0000","last_undegraded":"2024-03-30T12:42:00.768614+0000","last_fullsized":"2024-03-30T12:42:00.768614+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1186,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:09.590494+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:43:09.590494+0000","last_peered":"2024-03-30T12:43:09.590494+0000","last_clean":"2024-03-30T12:43:09.590494+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:43:09.590494+0000","last_undegraded":"2024-03-30T12:43:09.590494+0000","last_fullsized":"2024-03-30T12:43:09.590494+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438135,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648191,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175201,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254440,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063258,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951316,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839373,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923655,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:45:34.214 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:34.214 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:34.214 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:34.214 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:34.214 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:34.214 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:34.214 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:34.214 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:34.214 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:34.214 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:34.215 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:34.215 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:34.215 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:34.215 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:45:34.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:34 smithi084 ceph-mon[89279]: pgmap v1275: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:34.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:34 smithi084 ceph-mon[89279]: from='client.34776 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:45:34.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:34 smithi084 ceph-mon[91810]: pgmap v1275: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:34.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:34 smithi084 ceph-mon[91810]: from='client.34776 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:45:34.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:34 smithi162 ceph-mon[83709]: pgmap v1275: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:34.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:34 smithi162 ceph-mon[83709]: from='client.34776 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:45:36.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:36 smithi084 ceph-mon[89279]: pgmap v1276: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:36.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:36 smithi084 ceph-mon[91810]: pgmap v1276: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:36.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:36 smithi162 ceph-mon[83709]: pgmap v1276: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:38.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:38 smithi162 ceph-mon[83709]: pgmap v1277: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:38.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:38 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:45:38.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:38 smithi084 ceph-mon[89279]: pgmap v1277: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:38.757 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:38 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:45:38.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:38 smithi084 ceph-mon[91810]: pgmap v1277: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:38.757 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:38 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T12:45:39.638 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:45:39 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:45:39] "GET /metrics HTTP/1.1" 200 36327 "" "Prometheus/2.43.0" 2024-03-30T12:45:40.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:39 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:45:40.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:39 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:45:40.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:39 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:45:40.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:39 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:45:40.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:39 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:45:40.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:39 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:45:40.008 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:39 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:45:40.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:39 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:45:40.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:39 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:45:40.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:39 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:45:40.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:39 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:45:40.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:39 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:45:40.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:39 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:45:40.008 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:39 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:45:40.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:39 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:45:40.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:39 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:45:40.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:39 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:45:40.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:39 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:45:40.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:39 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T12:45:40.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:39 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T12:45:40.124 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:39 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' 2024-03-30T12:45:41.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:40 smithi084 ceph-mon[89279]: pgmap v1278: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:41.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:40 smithi084 ceph-mon[91810]: pgmap v1278: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:41.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:40 smithi162 ceph-mon[83709]: pgmap v1278: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:43.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:42 smithi084 ceph-mon[89279]: pgmap v1279: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:43.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:42 smithi084 ceph-mon[91810]: pgmap v1279: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:43.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:42 smithi162 ceph-mon[83709]: pgmap v1279: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:44.216 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:45:44.430 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:45:44.899 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:44 smithi084 ceph-mon[91810]: pgmap v1280: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:44.899 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:44 smithi084 ceph-mon[89279]: pgmap v1280: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:45.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:44 smithi162 ceph-mon[83709]: pgmap v1280: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:45.832 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:45 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:45:45.833 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:45 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:45:46.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:45 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:45:46.286 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:45:46.288 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:45:46.929 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1281,"stamp":"2024-03-30T12:45:44.986996+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003812"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:49.168735+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:42:49.168735+0000","last_peered":"2024-03-30T12:42:49.168735+0000","last_clean":"2024-03-30T12:42:49.168735+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:42:49.168735+0000","last_undegraded":"2024-03-30T12:42:49.168735+0000","last_fullsized":"2024-03-30T12:42:49.168735+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1367,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:28.945021+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:43:28.945021+0000","last_peered":"2024-03-30T12:43:28.945021+0000","last_clean":"2024-03-30T12:43:28.945021+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:43:28.945021+0000","last_undegraded":"2024-03-30T12:43:28.945021+0000","last_fullsized":"2024-03-30T12:43:28.945021+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:55.774228+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:42:55.774228+0000","last_peered":"2024-03-30T12:42:55.774228+0000","last_clean":"2024-03-30T12:42:55.774228+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:42:55.774228+0000","last_undegraded":"2024-03-30T12:42:55.774228+0000","last_fullsized":"2024-03-30T12:42:55.774228+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1236,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:00.336746+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:43:00.336746+0000","last_peered":"2024-03-30T12:43:00.336746+0000","last_clean":"2024-03-30T12:43:00.336746+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:43:00.336746+0000","last_undegraded":"2024-03-30T12:43:00.336746+0000","last_fullsized":"2024-03-30T12:43:00.336746+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:49.168654+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:42:49.168654+0000","last_peered":"2024-03-30T12:42:49.168654+0000","last_clean":"2024-03-30T12:42:49.168654+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:42:49.168654+0000","last_undegraded":"2024-03-30T12:42:49.168654+0000","last_fullsized":"2024-03-30T12:42:49.168654+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326493+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:41:30.326493+0000","last_peered":"2024-03-30T12:41:30.326493+0000","last_clean":"2024-03-30T12:41:30.326493+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:41:30.326493+0000","last_undegraded":"2024-03-30T12:41:30.326493+0000","last_fullsized":"2024-03-30T12:41:30.326493+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:49.168621+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:42:49.168621+0000","last_peered":"2024-03-30T12:42:49.168621+0000","last_clean":"2024-03-30T12:42:49.168621+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:42:49.168621+0000","last_undegraded":"2024-03-30T12:42:49.168621+0000","last_fullsized":"2024-03-30T12:42:49.168621+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:57.678742+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:42:57.678742+0000","last_peered":"2024-03-30T12:42:57.678742+0000","last_clean":"2024-03-30T12:42:57.678742+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:42:57.678742+0000","last_undegraded":"2024-03-30T12:42:57.678742+0000","last_fullsized":"2024-03-30T12:42:57.678742+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1151,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:24.165680+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:42:24.165680+0000","last_peered":"2024-03-30T12:42:24.165680+0000","last_clean":"2024-03-30T12:42:24.165680+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:42:24.165680+0000","last_undegraded":"2024-03-30T12:42:24.165680+0000","last_fullsized":"2024-03-30T12:42:24.165680+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581772+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:41:44.581772+0000","last_peered":"2024-03-30T12:41:44.581772+0000","last_clean":"2024-03-30T12:41:44.581772+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:41:44.581772+0000","last_undegraded":"2024-03-30T12:41:44.581772+0000","last_fullsized":"2024-03-30T12:41:44.581772+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581745+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:41:44.581745+0000","last_peered":"2024-03-30T12:41:44.581745+0000","last_clean":"2024-03-30T12:41:44.581745+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:41:44.581745+0000","last_undegraded":"2024-03-30T12:41:44.581745+0000","last_fullsized":"2024-03-30T12:41:44.581745+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:02.314952+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:43:02.314952+0000","last_peered":"2024-03-30T12:43:02.314952+0000","last_clean":"2024-03-30T12:43:02.314952+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:43:02.314952+0000","last_undegraded":"2024-03-30T12:43:02.314952+0000","last_fullsized":"2024-03-30T12:43:02.314952+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:27.675670+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:42:27.675670+0000","last_peered":"2024-03-30T12:42:27.675670+0000","last_clean":"2024-03-30T12:42:27.675670+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:42:27.675670+0000","last_undegraded":"2024-03-30T12:42:27.675670+0000","last_fullsized":"2024-03-30T12:42:27.675670+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:40.772652+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:42:40.772652+0000","last_peered":"2024-03-30T12:42:40.772652+0000","last_clean":"2024-03-30T12:42:40.772652+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:42:40.772652+0000","last_undegraded":"2024-03-30T12:42:40.772652+0000","last_fullsized":"2024-03-30T12:42:40.772652+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:08.942886+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:43:08.942886+0000","last_peered":"2024-03-30T12:43:08.942886+0000","last_clean":"2024-03-30T12:43:08.942886+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:43:08.942886+0000","last_undegraded":"2024-03-30T12:43:08.942886+0000","last_fullsized":"2024-03-30T12:43:08.942886+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1216,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:00.336693+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:43:00.336693+0000","last_peered":"2024-03-30T12:43:00.336693+0000","last_clean":"2024-03-30T12:43:00.336693+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:43:00.336693+0000","last_undegraded":"2024-03-30T12:43:00.336693+0000","last_fullsized":"2024-03-30T12:43:00.336693+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1227,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:00.336772+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:43:00.336772+0000","last_peered":"2024-03-30T12:43:00.336772+0000","last_clean":"2024-03-30T12:43:00.336772+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:43:00.336772+0000","last_undegraded":"2024-03-30T12:43:00.336772+0000","last_fullsized":"2024-03-30T12:43:00.336772+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.403697+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:41:23.403697+0000","last_peered":"2024-03-30T12:41:23.403697+0000","last_clean":"2024-03-30T12:41:23.403697+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:41:23.403697+0000","last_undegraded":"2024-03-30T12:41:23.403697+0000","last_fullsized":"2024-03-30T12:41:23.403697+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159632+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:41:34.159632+0000","last_peered":"2024-03-30T12:41:34.159632+0000","last_clean":"2024-03-30T12:41:34.159632+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:41:34.159632+0000","last_undegraded":"2024-03-30T12:41:34.159632+0000","last_fullsized":"2024-03-30T12:41:34.159632+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1391,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:55.774255+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:42:55.774255+0000","last_peered":"2024-03-30T12:42:55.774255+0000","last_clean":"2024-03-30T12:42:55.774255+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:42:55.774255+0000","last_undegraded":"2024-03-30T12:42:55.774255+0000","last_fullsized":"2024-03-30T12:42:55.774255+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1285,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672522+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:41:57.672522+0000","last_peered":"2024-03-30T12:41:57.672522+0000","last_clean":"2024-03-30T12:41:57.672522+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:41:57.672522+0000","last_undegraded":"2024-03-30T12:41:57.672522+0000","last_fullsized":"2024-03-30T12:41:57.672522+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1304,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672534+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:41:57.672534+0000","last_peered":"2024-03-30T12:41:57.672534+0000","last_clean":"2024-03-30T12:41:57.672534+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:41:57.672534+0000","last_undegraded":"2024-03-30T12:41:57.672534+0000","last_fullsized":"2024-03-30T12:41:57.672534+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:55.774245+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:42:55.774245+0000","last_peered":"2024-03-30T12:42:55.774245+0000","last_clean":"2024-03-30T12:42:55.774245+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:42:55.774245+0000","last_undegraded":"2024-03-30T12:42:55.774245+0000","last_fullsized":"2024-03-30T12:42:55.774245+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:49.168720+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:42:49.168720+0000","last_peered":"2024-03-30T12:42:49.168720+0000","last_clean":"2024-03-30T12:42:49.168720+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:42:49.168720+0000","last_undegraded":"2024-03-30T12:42:49.168720+0000","last_fullsized":"2024-03-30T12:42:49.168720+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326512+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:41:30.326512+0000","last_peered":"2024-03-30T12:41:30.326512+0000","last_clean":"2024-03-30T12:41:30.326512+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:41:30.326512+0000","last_undegraded":"2024-03-30T12:41:30.326512+0000","last_fullsized":"2024-03-30T12:41:30.326512+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1156,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:49.168669+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:42:49.168669+0000","last_peered":"2024-03-30T12:42:49.168669+0000","last_clean":"2024-03-30T12:42:49.168669+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:42:49.168669+0000","last_undegraded":"2024-03-30T12:42:49.168669+0000","last_fullsized":"2024-03-30T12:42:49.168669+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326527+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:41:30.326527+0000","last_peered":"2024-03-30T12:41:30.326527+0000","last_clean":"2024-03-30T12:41:30.326527+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:41:30.326527+0000","last_undegraded":"2024-03-30T12:41:30.326527+0000","last_fullsized":"2024-03-30T12:41:30.326527+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1264,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:57.678781+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:42:57.678781+0000","last_peered":"2024-03-30T12:42:57.678781+0000","last_clean":"2024-03-30T12:42:57.678781+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:42:57.678781+0000","last_undegraded":"2024-03-30T12:42:57.678781+0000","last_fullsized":"2024-03-30T12:42:57.678781+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1264,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302503+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:41:02.302503+0000","last_peered":"2024-03-30T12:41:02.302503+0000","last_clean":"2024-03-30T12:41:02.302503+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:41:02.302503+0000","last_undegraded":"2024-03-30T12:41:02.302503+0000","last_fullsized":"2024-03-30T12:41:02.302503+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:09.584292+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:42:09.584292+0000","last_peered":"2024-03-30T12:42:09.584292+0000","last_clean":"2024-03-30T12:42:09.584292+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:42:09.584292+0000","last_undegraded":"2024-03-30T12:42:09.584292+0000","last_fullsized":"2024-03-30T12:42:09.584292+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:15.763333+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:41:15.763333+0000","last_peered":"2024-03-30T12:41:15.763333+0000","last_clean":"2024-03-30T12:41:15.763333+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:41:15.763333+0000","last_undegraded":"2024-03-30T12:41:15.763333+0000","last_fullsized":"2024-03-30T12:41:15.763333+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1300,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:27.675651+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:42:27.675651+0000","last_peered":"2024-03-30T12:42:27.675651+0000","last_clean":"2024-03-30T12:42:27.675651+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:42:27.675651+0000","last_undegraded":"2024-03-30T12:42:27.675651+0000","last_fullsized":"2024-03-30T12:42:27.675651+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:27.675619+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:42:27.675619+0000","last_peered":"2024-03-30T12:42:27.675619+0000","last_clean":"2024-03-30T12:42:27.675619+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:42:27.675619+0000","last_undegraded":"2024-03-30T12:42:27.675619+0000","last_fullsized":"2024-03-30T12:42:27.675619+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1226,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323325+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:41:05.323325+0000","last_peered":"2024-03-30T12:41:05.323325+0000","last_clean":"2024-03-30T12:41:05.323325+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:41:05.323325+0000","last_undegraded":"2024-03-30T12:41:05.323325+0000","last_fullsized":"2024-03-30T12:41:05.323325+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:18.930743+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:41:18.930743+0000","last_peered":"2024-03-30T12:41:18.930743+0000","last_clean":"2024-03-30T12:41:18.930743+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:41:18.930743+0000","last_undegraded":"2024-03-30T12:41:18.930743+0000","last_fullsized":"2024-03-30T12:41:18.930743+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1172,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581788+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:41:44.581788+0000","last_peered":"2024-03-30T12:41:44.581788+0000","last_clean":"2024-03-30T12:41:44.581788+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:41:44.581788+0000","last_undegraded":"2024-03-30T12:41:44.581788+0000","last_fullsized":"2024-03-30T12:41:44.581788+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1206,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323382+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:41:05.323382+0000","last_peered":"2024-03-30T12:41:05.323382+0000","last_clean":"2024-03-30T12:41:05.323382+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:41:05.323382+0000","last_undegraded":"2024-03-30T12:41:05.323382+0000","last_fullsized":"2024-03-30T12:41:05.323382+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1200,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:05.323370+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:41:05.323370+0000","last_peered":"2024-03-30T12:41:05.323370+0000","last_clean":"2024-03-30T12:41:05.323370+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:41:05.323370+0000","last_undegraded":"2024-03-30T12:41:05.323370+0000","last_fullsized":"2024-03-30T12:41:05.323370+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1293,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:53.406703+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:41:53.406703+0000","last_peered":"2024-03-30T12:41:53.406703+0000","last_clean":"2024-03-30T12:41:53.406703+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:41:53.406703+0000","last_undegraded":"2024-03-30T12:41:53.406703+0000","last_fullsized":"2024-03-30T12:41:53.406703+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:18.930787+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:41:18.930787+0000","last_peered":"2024-03-30T12:41:18.930787+0000","last_clean":"2024-03-30T12:41:18.930787+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:41:18.930787+0000","last_undegraded":"2024-03-30T12:41:18.930787+0000","last_fullsized":"2024-03-30T12:41:18.930787+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:32.312127+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:42:32.312127+0000","last_peered":"2024-03-30T12:42:32.312127+0000","last_clean":"2024-03-30T12:42:32.312127+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:42:32.312127+0000","last_undegraded":"2024-03-30T12:42:32.312127+0000","last_fullsized":"2024-03-30T12:42:32.312127+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1207,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579099+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:41:19.579099+0000","last_peered":"2024-03-30T12:41:19.579099+0000","last_clean":"2024-03-30T12:41:19.579099+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:41:19.579099+0000","last_undegraded":"2024-03-30T12:41:19.579099+0000","last_fullsized":"2024-03-30T12:41:19.579099+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:24.165645+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:42:24.165645+0000","last_peered":"2024-03-30T12:42:24.165645+0000","last_clean":"2024-03-30T12:42:24.165645+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:42:24.165645+0000","last_undegraded":"2024-03-30T12:42:24.165645+0000","last_fullsized":"2024-03-30T12:42:24.165645+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1386,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:35.772053+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:42:35.772053+0000","last_peered":"2024-03-30T12:42:35.772053+0000","last_clean":"2024-03-30T12:42:35.772053+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:42:35.772053+0000","last_undegraded":"2024-03-30T12:42:35.772053+0000","last_fullsized":"2024-03-30T12:42:35.772053+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:35.772026+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:42:35.772026+0000","last_peered":"2024-03-30T12:42:35.772026+0000","last_clean":"2024-03-30T12:42:35.772026+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:42:35.772026+0000","last_undegraded":"2024-03-30T12:42:35.772026+0000","last_fullsized":"2024-03-30T12:42:35.772026+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1236,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:00.336730+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:43:00.336730+0000","last_peered":"2024-03-30T12:43:00.336730+0000","last_clean":"2024-03-30T12:43:00.336730+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:43:00.336730+0000","last_undegraded":"2024-03-30T12:43:00.336730+0000","last_fullsized":"2024-03-30T12:43:00.336730+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:59.162782+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:41:59.162782+0000","last_peered":"2024-03-30T12:41:59.162782+0000","last_clean":"2024-03-30T12:41:59.162782+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:41:59.162782+0000","last_undegraded":"2024-03-30T12:41:59.162782+0000","last_fullsized":"2024-03-30T12:41:59.162782+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1186,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579076+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:41:19.579076+0000","last_peered":"2024-03-30T12:41:19.579076+0000","last_clean":"2024-03-30T12:41:19.579076+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:41:19.579076+0000","last_undegraded":"2024-03-30T12:41:19.579076+0000","last_fullsized":"2024-03-30T12:41:19.579076+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579050+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:41:19.579050+0000","last_peered":"2024-03-30T12:41:19.579050+0000","last_clean":"2024-03-30T12:41:19.579050+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:41:19.579050+0000","last_undegraded":"2024-03-30T12:41:19.579050+0000","last_fullsized":"2024-03-30T12:41:19.579050+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1346,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.403657+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:41:23.403657+0000","last_peered":"2024-03-30T12:41:23.403657+0000","last_clean":"2024-03-30T12:41:23.403657+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:41:23.403657+0000","last_undegraded":"2024-03-30T12:41:23.403657+0000","last_fullsized":"2024-03-30T12:41:23.403657+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:59.162732+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:41:59.162732+0000","last_peered":"2024-03-30T12:41:59.162732+0000","last_clean":"2024-03-30T12:41:59.162732+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:41:59.162732+0000","last_undegraded":"2024-03-30T12:41:59.162732+0000","last_fullsized":"2024-03-30T12:41:59.162732+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5755,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:33.411173+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:42:33.411173+0000","last_peered":"2024-03-30T12:42:33.411173+0000","last_clean":"2024-03-30T12:42:33.411173+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:42:33.411173+0000","last_undegraded":"2024-03-30T12:42:33.411173+0000","last_fullsized":"2024-03-30T12:42:33.411173+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1277,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:02.309177+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:42:02.309177+0000","last_peered":"2024-03-30T12:42:02.309177+0000","last_clean":"2024-03-30T12:42:02.309177+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:42:02.309177+0000","last_undegraded":"2024-03-30T12:42:02.309177+0000","last_fullsized":"2024-03-30T12:42:02.309177+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159642+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:41:34.159642+0000","last_peered":"2024-03-30T12:41:34.159642+0000","last_clean":"2024-03-30T12:41:34.159642+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:41:34.159642+0000","last_undegraded":"2024-03-30T12:41:34.159642+0000","last_fullsized":"2024-03-30T12:41:34.159642+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5516,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:55.774198+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:42:55.774198+0000","last_peered":"2024-03-30T12:42:55.774198+0000","last_clean":"2024-03-30T12:42:55.774198+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:42:55.774198+0000","last_undegraded":"2024-03-30T12:42:55.774198+0000","last_fullsized":"2024-03-30T12:42:55.774198+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:28.944955+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:43:28.944955+0000","last_peered":"2024-03-30T12:43:28.944955+0000","last_clean":"2024-03-30T12:43:28.944955+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:43:28.944955+0000","last_undegraded":"2024-03-30T12:43:28.944955+0000","last_fullsized":"2024-03-30T12:43:28.944955+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:28.944980+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:43:28.944980+0000","last_peered":"2024-03-30T12:43:28.944980+0000","last_clean":"2024-03-30T12:43:28.944980+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:43:28.944980+0000","last_undegraded":"2024-03-30T12:43:28.944980+0000","last_fullsized":"2024-03-30T12:43:28.944980+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326520+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:41:30.326520+0000","last_peered":"2024-03-30T12:41:30.326520+0000","last_clean":"2024-03-30T12:41:30.326520+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:41:30.326520+0000","last_undegraded":"2024-03-30T12:41:30.326520+0000","last_fullsized":"2024-03-30T12:41:30.326520+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5461,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:43:00.774816+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:43:00.774816+0000","last_peered":"2024-03-30T12:43:00.774816+0000","last_clean":"2024-03-30T12:43:00.774816+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:43:00.774816+0000","last_undegraded":"2024-03-30T12:43:00.774816+0000","last_fullsized":"2024-03-30T12:43:00.774816+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:28.944991+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:43:28.944991+0000","last_peered":"2024-03-30T12:43:28.944991+0000","last_clean":"2024-03-30T12:43:28.944991+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:43:28.944991+0000","last_undegraded":"2024-03-30T12:43:28.944991+0000","last_fullsized":"2024-03-30T12:43:28.944991+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1210,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:35.340584+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:43:35.340584+0000","last_peered":"2024-03-30T12:43:35.340584+0000","last_clean":"2024-03-30T12:43:35.340584+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:43:35.340584+0000","last_undegraded":"2024-03-30T12:43:35.340584+0000","last_fullsized":"2024-03-30T12:43:35.340584+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1275,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:07.315593+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:43:07.315593+0000","last_peered":"2024-03-30T12:43:07.315593+0000","last_clean":"2024-03-30T12:43:07.315593+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:43:07.315593+0000","last_undegraded":"2024-03-30T12:43:07.315593+0000","last_fullsized":"2024-03-30T12:43:07.315593+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3806,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:33.411258+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:42:33.411258+0000","last_peered":"2024-03-30T12:42:33.411258+0000","last_clean":"2024-03-30T12:42:33.411258+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:42:33.411258+0000","last_undegraded":"2024-03-30T12:42:33.411258+0000","last_fullsized":"2024-03-30T12:42:33.411258+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935569+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:41:58.935569+0000","last_peered":"2024-03-30T12:41:58.935569+0000","last_clean":"2024-03-30T12:41:58.935569+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:41:58.935569+0000","last_undegraded":"2024-03-30T12:41:58.935569+0000","last_fullsized":"2024-03-30T12:41:58.935569+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:48.940828+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:42:48.940828+0000","last_peered":"2024-03-30T12:42:48.940828+0000","last_clean":"2024-03-30T12:42:48.940828+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:42:48.940828+0000","last_undegraded":"2024-03-30T12:42:48.940828+0000","last_fullsized":"2024-03-30T12:42:48.940828+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.407376+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:41:58.407376+0000","last_peered":"2024-03-30T12:41:58.407376+0000","last_clean":"2024-03-30T12:41:58.407376+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:41:58.407376+0000","last_undegraded":"2024-03-30T12:41:58.407376+0000","last_fullsized":"2024-03-30T12:41:58.407376+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4579,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:49.168681+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:42:49.168681+0000","last_peered":"2024-03-30T12:42:49.168681+0000","last_clean":"2024-03-30T12:42:49.168681+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:42:49.168681+0000","last_undegraded":"2024-03-30T12:42:49.168681+0000","last_fullsized":"2024-03-30T12:42:49.168681+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1177,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:09.584340+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:42:09.584340+0000","last_peered":"2024-03-30T12:42:09.584340+0000","last_clean":"2024-03-30T12:42:09.584340+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:42:09.584340+0000","last_undegraded":"2024-03-30T12:42:09.584340+0000","last_fullsized":"2024-03-30T12:42:09.584340+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:32.676053+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:42:32.676053+0000","last_peered":"2024-03-30T12:42:32.676053+0000","last_clean":"2024-03-30T12:42:32.676053+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:42:32.676053+0000","last_undegraded":"2024-03-30T12:42:32.676053+0000","last_fullsized":"2024-03-30T12:42:32.676053+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1203,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:35.340655+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:43:35.340655+0000","last_peered":"2024-03-30T12:43:35.340655+0000","last_clean":"2024-03-30T12:43:35.340655+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:43:35.340655+0000","last_undegraded":"2024-03-30T12:43:35.340655+0000","last_fullsized":"2024-03-30T12:43:35.340655+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1719,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:19.165060+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:42:19.165060+0000","last_peered":"2024-03-30T12:42:19.165060+0000","last_clean":"2024-03-30T12:42:19.165060+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:42:19.165060+0000","last_undegraded":"2024-03-30T12:42:19.165060+0000","last_fullsized":"2024-03-30T12:42:19.165060+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24716,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:00.329951+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:42:00.329951+0000","last_peered":"2024-03-30T12:42:00.329951+0000","last_clean":"2024-03-30T12:42:00.329951+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:42:00.329951+0000","last_undegraded":"2024-03-30T12:42:00.329951+0000","last_fullsized":"2024-03-30T12:42:00.329951+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:25.764684+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:41:25.764684+0000","last_peered":"2024-03-30T12:41:25.764684+0000","last_clean":"2024-03-30T12:41:25.764684+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:41:25.764684+0000","last_undegraded":"2024-03-30T12:41:25.764684+0000","last_fullsized":"2024-03-30T12:41:25.764684+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:55.774169+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:42:55.774169+0000","last_peered":"2024-03-30T12:42:55.774169+0000","last_clean":"2024-03-30T12:42:55.774169+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:42:55.774169+0000","last_undegraded":"2024-03-30T12:42:55.774169+0000","last_fullsized":"2024-03-30T12:42:55.774169+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:19.165034+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:42:19.165034+0000","last_peered":"2024-03-30T12:42:19.165034+0000","last_clean":"2024-03-30T12:42:19.165034+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:42:19.165034+0000","last_undegraded":"2024-03-30T12:42:19.165034+0000","last_fullsized":"2024-03-30T12:42:19.165034+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16483,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:09.584304+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:42:09.584304+0000","last_peered":"2024-03-30T12:42:09.584304+0000","last_clean":"2024-03-30T12:42:09.584304+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:42:09.584304+0000","last_undegraded":"2024-03-30T12:42:09.584304+0000","last_fullsized":"2024-03-30T12:42:09.584304+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:55.774215+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:42:55.774215+0000","last_peered":"2024-03-30T12:42:55.774215+0000","last_clean":"2024-03-30T12:42:55.774215+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:42:55.774215+0000","last_undegraded":"2024-03-30T12:42:55.774215+0000","last_fullsized":"2024-03-30T12:42:55.774215+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1166,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:49.168709+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:42:49.168709+0000","last_peered":"2024-03-30T12:42:49.168709+0000","last_clean":"2024-03-30T12:42:49.168709+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:42:49.168709+0000","last_undegraded":"2024-03-30T12:42:49.168709+0000","last_fullsized":"2024-03-30T12:42:49.168709+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:28.945001+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:43:28.945001+0000","last_peered":"2024-03-30T12:43:28.945001+0000","last_clean":"2024-03-30T12:43:28.945001+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:43:28.945001+0000","last_undegraded":"2024-03-30T12:43:28.945001+0000","last_fullsized":"2024-03-30T12:43:28.945001+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31272,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:43:07.315551+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:43:07.315551+0000","last_peered":"2024-03-30T12:43:07.315551+0000","last_clean":"2024-03-30T12:43:07.315551+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:43:07.315551+0000","last_undegraded":"2024-03-30T12:43:07.315551+0000","last_fullsized":"2024-03-30T12:43:07.315551+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672495+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:41:57.672495+0000","last_peered":"2024-03-30T12:41:57.672495+0000","last_clean":"2024-03-30T12:41:57.672495+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:41:57.672495+0000","last_undegraded":"2024-03-30T12:41:57.672495+0000","last_fullsized":"2024-03-30T12:41:57.672495+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1356,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935556+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:41:58.935556+0000","last_peered":"2024-03-30T12:41:58.935556+0000","last_clean":"2024-03-30T12:41:58.935556+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:41:58.935556+0000","last_undegraded":"2024-03-30T12:41:58.935556+0000","last_fullsized":"2024-03-30T12:41:58.935556+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1300,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:07.679777+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:43:07.679777+0000","last_peered":"2024-03-30T12:43:07.679777+0000","last_clean":"2024-03-30T12:43:07.679777+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:43:07.679777+0000","last_undegraded":"2024-03-30T12:43:07.679777+0000","last_fullsized":"2024-03-30T12:43:07.679777+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3767,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:57.672462+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:41:57.672462+0000","last_peered":"2024-03-30T12:41:57.672462+0000","last_clean":"2024-03-30T12:41:57.672462+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:41:57.672462+0000","last_undegraded":"2024-03-30T12:41:57.672462+0000","last_fullsized":"2024-03-30T12:41:57.672462+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1236,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:07.315509+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:43:07.315509+0000","last_peered":"2024-03-30T12:43:07.315509+0000","last_clean":"2024-03-30T12:43:07.315509+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:43:07.315509+0000","last_undegraded":"2024-03-30T12:43:07.315509+0000","last_fullsized":"2024-03-30T12:43:07.315509+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1158,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:39.587408+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:42:39.587408+0000","last_peered":"2024-03-30T12:42:39.587408+0000","last_clean":"2024-03-30T12:42:39.587408+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:42:39.587408+0000","last_undegraded":"2024-03-30T12:42:39.587408+0000","last_fullsized":"2024-03-30T12:42:39.587408+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:25.764656+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:41:25.764656+0000","last_peered":"2024-03-30T12:41:25.764656+0000","last_clean":"2024-03-30T12:41:25.764656+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:41:25.764656+0000","last_undegraded":"2024-03-30T12:41:25.764656+0000","last_fullsized":"2024-03-30T12:41:25.764656+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15596,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:30.333267+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:42:30.333267+0000","last_peered":"2024-03-30T12:42:30.333267+0000","last_clean":"2024-03-30T12:42:30.333267+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:42:30.333267+0000","last_undegraded":"2024-03-30T12:42:30.333267+0000","last_fullsized":"2024-03-30T12:42:30.333267+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:19.172145+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:43:19.172145+0000","last_peered":"2024-03-30T12:43:19.172145+0000","last_clean":"2024-03-30T12:43:19.172145+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:43:19.172145+0000","last_undegraded":"2024-03-30T12:43:19.172145+0000","last_fullsized":"2024-03-30T12:43:19.172145+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1260,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:32.306064+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:41:32.306064+0000","last_peered":"2024-03-30T12:41:32.306064+0000","last_clean":"2024-03-30T12:41:32.306064+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:41:32.306064+0000","last_undegraded":"2024-03-30T12:41:32.306064+0000","last_fullsized":"2024-03-30T12:41:32.306064+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29022,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:02.309140+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:42:02.309140+0000","last_peered":"2024-03-30T12:42:02.309140+0000","last_clean":"2024-03-30T12:42:02.309140+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:42:02.309140+0000","last_undegraded":"2024-03-30T12:42:02.309140+0000","last_fullsized":"2024-03-30T12:42:02.309140+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935491+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:41:58.935491+0000","last_peered":"2024-03-30T12:41:58.935491+0000","last_clean":"2024-03-30T12:41:58.935491+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:41:58.935491+0000","last_undegraded":"2024-03-30T12:41:58.935491+0000","last_fullsized":"2024-03-30T12:41:58.935491+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1292,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:07.679723+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:43:07.679723+0000","last_peered":"2024-03-30T12:43:07.679723+0000","last_clean":"2024-03-30T12:43:07.679723+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:43:07.679723+0000","last_undegraded":"2024-03-30T12:43:07.679723+0000","last_fullsized":"2024-03-30T12:43:07.679723+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5613,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:43:08.415054+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:43:08.415054+0000","last_peered":"2024-03-30T12:43:08.415054+0000","last_clean":"2024-03-30T12:43:08.415054+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:43:08.415054+0000","last_undegraded":"2024-03-30T12:43:08.415054+0000","last_fullsized":"2024-03-30T12:43:08.415054+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1367,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935518+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:41:58.935518+0000","last_peered":"2024-03-30T12:41:58.935518+0000","last_clean":"2024-03-30T12:41:58.935518+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:41:58.935518+0000","last_undegraded":"2024-03-30T12:41:58.935518+0000","last_fullsized":"2024-03-30T12:41:58.935518+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:27.669397+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:41:27.669397+0000","last_peered":"2024-03-30T12:41:27.669397+0000","last_clean":"2024-03-30T12:41:27.669397+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:41:27.669397+0000","last_undegraded":"2024-03-30T12:41:27.669397+0000","last_fullsized":"2024-03-30T12:41:27.669397+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4277,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:33.939063+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:42:33.939063+0000","last_peered":"2024-03-30T12:42:33.939063+0000","last_clean":"2024-03-30T12:42:33.939063+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:42:33.939063+0000","last_undegraded":"2024-03-30T12:42:33.939063+0000","last_fullsized":"2024-03-30T12:42:33.939063+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1156,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159584+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:41:34.159584+0000","last_peered":"2024-03-30T12:41:34.159584+0000","last_clean":"2024-03-30T12:41:34.159584+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:41:34.159584+0000","last_undegraded":"2024-03-30T12:41:34.159584+0000","last_fullsized":"2024-03-30T12:41:34.159584+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1186,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:39.587344+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:42:39.587344+0000","last_peered":"2024-03-30T12:42:39.587344+0000","last_clean":"2024-03-30T12:42:39.587344+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:42:39.587344+0000","last_undegraded":"2024-03-30T12:42:39.587344+0000","last_fullsized":"2024-03-30T12:42:39.587344+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5256,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:43:08.414974+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:43:08.414974+0000","last_peered":"2024-03-30T12:43:08.414974+0000","last_clean":"2024-03-30T12:43:08.414974+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:43:08.414974+0000","last_undegraded":"2024-03-30T12:43:08.414974+0000","last_fullsized":"2024-03-30T12:43:08.414974+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:08.415043+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:43:08.415043+0000","last_peered":"2024-03-30T12:43:08.415043+0000","last_clean":"2024-03-30T12:43:08.415043+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:43:08.415043+0000","last_undegraded":"2024-03-30T12:43:08.415043+0000","last_fullsized":"2024-03-30T12:43:08.415043+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159619+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:41:34.159619+0000","last_peered":"2024-03-30T12:41:34.159619+0000","last_clean":"2024-03-30T12:41:34.159619+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:41:34.159619+0000","last_undegraded":"2024-03-30T12:41:34.159619+0000","last_fullsized":"2024-03-30T12:41:34.159619+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4813,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:33.411213+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:42:33.411213+0000","last_peered":"2024-03-30T12:42:33.411213+0000","last_clean":"2024-03-30T12:42:33.411213+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:42:33.411213+0000","last_undegraded":"2024-03-30T12:42:33.411213+0000","last_fullsized":"2024-03-30T12:42:33.411213+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:33.939095+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:42:33.939095+0000","last_peered":"2024-03-30T12:42:33.939095+0000","last_clean":"2024-03-30T12:42:33.939095+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:42:33.939095+0000","last_undegraded":"2024-03-30T12:42:33.939095+0000","last_fullsized":"2024-03-30T12:42:33.939095+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:30.333244+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:42:30.333244+0000","last_peered":"2024-03-30T12:42:30.333244+0000","last_clean":"2024-03-30T12:42:30.333244+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:42:30.333244+0000","last_undegraded":"2024-03-30T12:42:30.333244+0000","last_fullsized":"2024-03-30T12:42:30.333244+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6746,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:43:19.172205+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:43:19.172205+0000","last_peered":"2024-03-30T12:43:19.172205+0000","last_clean":"2024-03-30T12:43:19.172205+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:43:19.172205+0000","last_undegraded":"2024-03-30T12:43:19.172205+0000","last_fullsized":"2024-03-30T12:43:19.172205+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1340,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:08.415089+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:43:08.415089+0000","last_peered":"2024-03-30T12:43:08.415089+0000","last_clean":"2024-03-30T12:43:08.415089+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:43:08.415089+0000","last_undegraded":"2024-03-30T12:43:08.415089+0000","last_fullsized":"2024-03-30T12:43:08.415089+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159657+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:41:34.159657+0000","last_peered":"2024-03-30T12:41:34.159657+0000","last_clean":"2024-03-30T12:41:34.159657+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:41:34.159657+0000","last_undegraded":"2024-03-30T12:41:34.159657+0000","last_fullsized":"2024-03-30T12:41:34.159657+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1172,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:09.584262+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:42:09.584262+0000","last_peered":"2024-03-30T12:42:09.584262+0000","last_clean":"2024-03-30T12:42:09.584262+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:42:09.584262+0000","last_undegraded":"2024-03-30T12:42:09.584262+0000","last_fullsized":"2024-03-30T12:42:09.584262+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1335,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.407397+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:41:58.407397+0000","last_peered":"2024-03-30T12:41:58.407397+0000","last_clean":"2024-03-30T12:41:58.407397+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:41:58.407397+0000","last_undegraded":"2024-03-30T12:41:58.407397+0000","last_fullsized":"2024-03-30T12:41:58.407397+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1242,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:35.340617+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:43:35.340617+0000","last_peered":"2024-03-30T12:43:35.340617+0000","last_clean":"2024-03-30T12:43:35.340617+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:43:35.340617+0000","last_undegraded":"2024-03-30T12:43:35.340617+0000","last_fullsized":"2024-03-30T12:43:35.340617+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:00.774774+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:43:00.774774+0000","last_peered":"2024-03-30T12:43:00.774774+0000","last_clean":"2024-03-30T12:43:00.774774+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:43:00.774774+0000","last_undegraded":"2024-03-30T12:43:00.774774+0000","last_fullsized":"2024-03-30T12:43:00.774774+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:07.679762+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:43:07.679762+0000","last_peered":"2024-03-30T12:43:07.679762+0000","last_clean":"2024-03-30T12:43:07.679762+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:43:07.679762+0000","last_undegraded":"2024-03-30T12:43:07.679762+0000","last_fullsized":"2024-03-30T12:43:07.679762+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935541+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:41:58.935541+0000","last_peered":"2024-03-30T12:41:58.935541+0000","last_clean":"2024-03-30T12:41:58.935541+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:41:58.935541+0000","last_undegraded":"2024-03-30T12:41:58.935541+0000","last_fullsized":"2024-03-30T12:41:58.935541+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1180,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:39.587396+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:42:39.587396+0000","last_peered":"2024-03-30T12:42:39.587396+0000","last_clean":"2024-03-30T12:42:39.587396+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:42:39.587396+0000","last_undegraded":"2024-03-30T12:42:39.587396+0000","last_fullsized":"2024-03-30T12:42:39.587396+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1284,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:07.679788+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:43:07.679788+0000","last_peered":"2024-03-30T12:43:07.679788+0000","last_clean":"2024-03-30T12:43:07.679788+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:43:07.679788+0000","last_undegraded":"2024-03-30T12:43:07.679788+0000","last_fullsized":"2024-03-30T12:43:07.679788+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:00.329894+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:42:00.329894+0000","last_peered":"2024-03-30T12:42:00.329894+0000","last_clean":"2024-03-30T12:42:00.329894+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:42:00.329894+0000","last_undegraded":"2024-03-30T12:42:00.329894+0000","last_fullsized":"2024-03-30T12:42:00.329894+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:27.669378+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:41:27.669378+0000","last_peered":"2024-03-30T12:41:27.669378+0000","last_clean":"2024-03-30T12:41:27.669378+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:41:27.669378+0000","last_undegraded":"2024-03-30T12:41:27.669378+0000","last_fullsized":"2024-03-30T12:41:27.669378+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1218,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:30.333212+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:42:30.333212+0000","last_peered":"2024-03-30T12:42:30.333212+0000","last_clean":"2024-03-30T12:42:30.333212+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:42:30.333212+0000","last_undegraded":"2024-03-30T12:42:30.333212+0000","last_fullsized":"2024-03-30T12:42:30.333212+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:00.768614+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:42:00.768614+0000","last_peered":"2024-03-30T12:42:00.768614+0000","last_clean":"2024-03-30T12:42:00.768614+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:42:00.768614+0000","last_undegraded":"2024-03-30T12:42:00.768614+0000","last_fullsized":"2024-03-30T12:42:00.768614+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1186,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:09.590494+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:43:09.590494+0000","last_peered":"2024-03-30T12:43:09.590494+0000","last_clean":"2024-03-30T12:43:09.590494+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:43:09.590494+0000","last_undegraded":"2024-03-30T12:43:09.590494+0000","last_fullsized":"2024-03-30T12:43:09.590494+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438138,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648194,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175204,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254442,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063261,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951318,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839375,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923657,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:45:46.935 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:46.935 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:46.935 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:46.935 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:46.936 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:46.936 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:46.936 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:46.936 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:46.936 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:46.936 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:46.936 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:46.936 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:46.936 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:46.936 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:45:47.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:46 smithi162 ceph-mon[83709]: pgmap v1281: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:47.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:46 smithi084 ceph-mon[89279]: pgmap v1281: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:47.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:46 smithi084 ceph-mon[91810]: pgmap v1281: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:48.123 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:47 smithi162 ceph-mon[83709]: from='client.44717 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:45:48.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:47 smithi084 ceph-mon[89279]: from='client.44717 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:45:48.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:47 smithi084 ceph-mon[91810]: from='client.44717 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:45:49.158 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:48 smithi084 ceph-mon[89279]: pgmap v1282: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:49.159 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:48 smithi084 ceph-mon[91810]: pgmap v1282: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:49.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:48 smithi162 ceph-mon[83709]: pgmap v1282: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:49.507 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:45:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:45:49] "GET /metrics HTTP/1.1" 200 36328 "" "Prometheus/2.43.0" 2024-03-30T12:45:51.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:50 smithi084 ceph-mon[91810]: pgmap v1283: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:51.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:50 smithi084 ceph-mon[89279]: pgmap v1283: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:51.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:50 smithi162 ceph-mon[83709]: pgmap v1283: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:53.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:52 smithi084 ceph-mon[91810]: pgmap v1284: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:53.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:52 smithi084 ceph-mon[89279]: pgmap v1284: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:53.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:52 smithi162 ceph-mon[83709]: pgmap v1284: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:55.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:54 smithi084 ceph-mon[91810]: pgmap v1285: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:55.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:54 smithi084 ceph-mon[89279]: pgmap v1285: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:55.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:54 smithi162 ceph-mon[83709]: pgmap v1285: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:56.937 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T12:45:57.158 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T12:45:57.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:56 smithi084 ceph-mon[91810]: pgmap v1286: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:57.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:56 smithi084 ceph-mon[89279]: pgmap v1286: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:57.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:56 smithi162 ceph-mon[83709]: pgmap v1286: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:59.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:58 smithi084 ceph-mon[91810]: pgmap v1287: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:59.007 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:58 smithi084 ceph-mon[89279]: pgmap v1287: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:59.102 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:45:59.104 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-03-30T12:45:59.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:58 smithi162 ceph-mon[83709]: pgmap v1287: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:45:59.474 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:45:59 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:45:59] "GET /metrics HTTP/1.1" 200 36328 "" "Prometheus/2.43.0" 2024-03-30T12:45:59.845 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":1288,"stamp":"2024-03-30T12:45:58.991342+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1344289790,"num_objects":920,"num_object_clones":846,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":12,"num_read":4721,"num_read_kb":4879886,"num_write":8757,"num_write_kb":1770020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":446948960,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44330,"ondisk_log_size":44330,"up":363,"acting":363,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":7693344,"kb_used_data":1955720,"kb_used_omap":455,"kb_used_meta":5737016,"kb_avail":742267872,"statfs":{"total":767960285184,"available":760082300928,"internally_reserved":0,"allocated":2002657280,"data_stored":4518737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":466848,"internal_metadata":5874704480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003823"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1150,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:49.168735+0000","last_change":"2024-03-30T12:30:21.091230+0000","last_active":"2024-03-30T12:42:49.168735+0000","last_peered":"2024-03-30T12:42:49.168735+0000","last_clean":"2024-03-30T12:42:49.168735+0000","last_became_active":"2024-03-30T12:30:21.089496+0000","last_became_peered":"2024-03-30T12:30:21.089496+0000","last_unstale":"2024-03-30T12:42:49.168735+0000","last_undegraded":"2024-03-30T12:42:49.168735+0000","last_fullsized":"2024-03-30T12:42:49.168735+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:55.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1367,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:28.945021+0000","last_change":"2024-03-30T12:29:41.390060+0000","last_active":"2024-03-30T12:43:28.945021+0000","last_peered":"2024-03-30T12:43:28.945021+0000","last_clean":"2024-03-30T12:43:28.945021+0000","last_became_active":"2024-03-30T12:29:41.389724+0000","last_became_peered":"2024-03-30T12:29:41.389724+0000","last_unstale":"2024-03-30T12:43:28.945021+0000","last_undegraded":"2024-03-30T12:43:28.945021+0000","last_fullsized":"2024-03-30T12:43:28.945021+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:07.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:55.774228+0000","last_change":"2024-03-30T12:27:25.325528+0000","last_active":"2024-03-30T12:42:55.774228+0000","last_peered":"2024-03-30T12:42:55.774228+0000","last_clean":"2024-03-30T12:42:55.774228+0000","last_became_active":"2024-03-30T12:27:25.325198+0000","last_became_peered":"2024-03-30T12:27:25.325198+0000","last_unstale":"2024-03-30T12:42:55.774228+0000","last_undegraded":"2024-03-30T12:42:55.774228+0000","last_fullsized":"2024-03-30T12:42:55.774228+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:22.062490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1236,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:00.336746+0000","last_change":"2024-03-30T12:30:21.081772+0000","last_active":"2024-03-30T12:43:00.336746+0000","last_peered":"2024-03-30T12:43:00.336746+0000","last_clean":"2024-03-30T12:43:00.336746+0000","last_became_active":"2024-03-30T12:30:21.080937+0000","last_became_peered":"2024-03-30T12:30:21.080937+0000","last_unstale":"2024-03-30T12:43:00.336746+0000","last_undegraded":"2024-03-30T12:43:00.336746+0000","last_fullsized":"2024-03-30T12:43:00.336746+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:36:23.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:49.168654+0000","last_change":"2024-03-30T12:30:21.093420+0000","last_active":"2024-03-30T12:42:49.168654+0000","last_peered":"2024-03-30T12:42:49.168654+0000","last_clean":"2024-03-30T12:42:49.168654+0000","last_became_active":"2024-03-30T12:30:21.093023+0000","last_became_peered":"2024-03-30T12:30:21.093023+0000","last_unstale":"2024-03-30T12:42:49.168654+0000","last_undegraded":"2024-03-30T12:42:49.168654+0000","last_fullsized":"2024-03-30T12:42:49.168654+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:37:21.526461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1212,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326493+0000","last_change":"2024-03-30T12:29:02.029836+0000","last_active":"2024-03-30T12:41:30.326493+0000","last_peered":"2024-03-30T12:41:30.326493+0000","last_clean":"2024-03-30T12:41:30.326493+0000","last_became_active":"2024-03-30T12:29:02.029513+0000","last_became_peered":"2024-03-30T12:29:02.029513+0000","last_unstale":"2024-03-30T12:41:30.326493+0000","last_undegraded":"2024-03-30T12:41:30.326493+0000","last_fullsized":"2024-03-30T12:41:30.326493+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:02:52.979477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:49.168621+0000","last_change":"2024-03-30T12:30:21.093058+0000","last_active":"2024-03-30T12:42:49.168621+0000","last_peered":"2024-03-30T12:42:49.168621+0000","last_clean":"2024-03-30T12:42:49.168621+0000","last_became_active":"2024-03-30T12:30:21.090012+0000","last_became_peered":"2024-03-30T12:30:21.090012+0000","last_unstale":"2024-03-30T12:42:49.168621+0000","last_undegraded":"2024-03-30T12:42:49.168621+0000","last_fullsized":"2024-03-30T12:42:49.168621+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:22.718037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:57.678742+0000","last_change":"2024-03-30T12:29:41.385926+0000","last_active":"2024-03-30T12:42:57.678742+0000","last_peered":"2024-03-30T12:42:57.678742+0000","last_clean":"2024-03-30T12:42:57.678742+0000","last_became_active":"2024-03-30T12:29:41.385593+0000","last_became_peered":"2024-03-30T12:29:41.385593+0000","last_unstale":"2024-03-30T12:42:57.678742+0000","last_undegraded":"2024-03-30T12:42:57.678742+0000","last_fullsized":"2024-03-30T12:42:57.678742+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:21:53.448230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1151,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:24.165680+0000","last_change":"2024-03-30T12:30:21.095762+0000","last_active":"2024-03-30T12:42:24.165680+0000","last_peered":"2024-03-30T12:42:24.165680+0000","last_clean":"2024-03-30T12:42:24.165680+0000","last_became_active":"2024-03-30T12:30:21.095132+0000","last_became_peered":"2024-03-30T12:30:21.095132+0000","last_unstale":"2024-03-30T12:42:24.165680+0000","last_undegraded":"2024-03-30T12:42:24.165680+0000","last_fullsized":"2024-03-30T12:42:24.165680+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:21:51.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581772+0000","last_change":"2024-03-30T12:29:41.401118+0000","last_active":"2024-03-30T12:41:44.581772+0000","last_peered":"2024-03-30T12:41:44.581772+0000","last_clean":"2024-03-30T12:41:44.581772+0000","last_became_active":"2024-03-30T12:29:41.400831+0000","last_became_peered":"2024-03-30T12:29:41.400831+0000","last_unstale":"2024-03-30T12:41:44.581772+0000","last_undegraded":"2024-03-30T12:41:44.581772+0000","last_fullsized":"2024-03-30T12:41:44.581772+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:14:31.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581745+0000","last_change":"2024-03-30T12:29:41.398536+0000","last_active":"2024-03-30T12:41:44.581745+0000","last_peered":"2024-03-30T12:41:44.581745+0000","last_clean":"2024-03-30T12:41:44.581745+0000","last_became_active":"2024-03-30T12:29:41.398238+0000","last_became_peered":"2024-03-30T12:29:41.398238+0000","last_unstale":"2024-03-30T12:41:44.581745+0000","last_undegraded":"2024-03-30T12:41:44.581745+0000","last_fullsized":"2024-03-30T12:41:44.581745+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:44:47.004573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1273,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:02.314952+0000","last_change":"2024-03-30T12:29:41.392669+0000","last_active":"2024-03-30T12:43:02.314952+0000","last_peered":"2024-03-30T12:43:02.314952+0000","last_clean":"2024-03-30T12:43:02.314952+0000","last_became_active":"2024-03-30T12:29:41.392328+0000","last_became_peered":"2024-03-30T12:29:41.392328+0000","last_unstale":"2024-03-30T12:43:02.314952+0000","last_undegraded":"2024-03-30T12:43:02.314952+0000","last_fullsized":"2024-03-30T12:43:02.314952+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:29.059386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0],"acting":[4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1291,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:27.675670+0000","last_change":"2024-03-30T12:29:41.403166+0000","last_active":"2024-03-30T12:42:27.675670+0000","last_peered":"2024-03-30T12:42:27.675670+0000","last_clean":"2024-03-30T12:42:27.675670+0000","last_became_active":"2024-03-30T12:29:41.402848+0000","last_became_peered":"2024-03-30T12:29:41.402848+0000","last_unstale":"2024-03-30T12:42:27.675670+0000","last_undegraded":"2024-03-30T12:42:27.675670+0000","last_fullsized":"2024-03-30T12:42:27.675670+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:37:22.516826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:40.772652+0000","last_change":"2024-03-30T12:29:02.024592+0000","last_active":"2024-03-30T12:42:40.772652+0000","last_peered":"2024-03-30T12:42:40.772652+0000","last_clean":"2024-03-30T12:42:40.772652+0000","last_became_active":"2024-03-30T12:29:02.024233+0000","last_became_peered":"2024-03-30T12:29:02.024233+0000","last_unstale":"2024-03-30T12:42:40.772652+0000","last_undegraded":"2024-03-30T12:42:40.772652+0000","last_fullsized":"2024-03-30T12:42:40.772652+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:08:55.730432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,5],"acting":[0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:08.942886+0000","last_change":"2024-03-30T12:29:02.029450+0000","last_active":"2024-03-30T12:43:08.942886+0000","last_peered":"2024-03-30T12:43:08.942886+0000","last_clean":"2024-03-30T12:43:08.942886+0000","last_became_active":"2024-03-30T12:29:02.029118+0000","last_became_peered":"2024-03-30T12:29:02.029118+0000","last_unstale":"2024-03-30T12:43:08.942886+0000","last_undegraded":"2024-03-30T12:43:08.942886+0000","last_fullsized":"2024-03-30T12:43:08.942886+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:02:42.201977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1216,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:00.336693+0000","last_change":"2024-03-30T12:30:21.073705+0000","last_active":"2024-03-30T12:43:00.336693+0000","last_peered":"2024-03-30T12:43:00.336693+0000","last_clean":"2024-03-30T12:43:00.336693+0000","last_became_active":"2024-03-30T12:30:21.073242+0000","last_became_peered":"2024-03-30T12:30:21.073242+0000","last_unstale":"2024-03-30T12:43:00.336693+0000","last_undegraded":"2024-03-30T12:43:00.336693+0000","last_fullsized":"2024-03-30T12:43:00.336693+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:27.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1227,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:00.336772+0000","last_change":"2024-03-30T12:30:21.093439+0000","last_active":"2024-03-30T12:43:00.336772+0000","last_peered":"2024-03-30T12:43:00.336772+0000","last_clean":"2024-03-30T12:43:00.336772+0000","last_became_active":"2024-03-30T12:30:21.093140+0000","last_became_peered":"2024-03-30T12:30:21.093140+0000","last_unstale":"2024-03-30T12:43:00.336772+0000","last_undegraded":"2024-03-30T12:43:00.336772+0000","last_fullsized":"2024-03-30T12:43:00.336772+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:21.344174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.403697+0000","last_change":"2024-03-30T12:30:21.067374+0000","last_active":"2024-03-30T12:41:23.403697+0000","last_peered":"2024-03-30T12:41:23.403697+0000","last_clean":"2024-03-30T12:41:23.403697+0000","last_became_active":"2024-03-30T12:30:21.066921+0000","last_became_peered":"2024-03-30T12:30:21.066921+0000","last_unstale":"2024-03-30T12:41:23.403697+0000","last_undegraded":"2024-03-30T12:41:23.403697+0000","last_fullsized":"2024-03-30T12:41:23.403697+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:53:16.411059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,7],"acting":[2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159632+0000","last_change":"2024-03-30T12:30:21.099412+0000","last_active":"2024-03-30T12:41:34.159632+0000","last_peered":"2024-03-30T12:41:34.159632+0000","last_clean":"2024-03-30T12:41:34.159632+0000","last_became_active":"2024-03-30T12:30:21.092489+0000","last_became_peered":"2024-03-30T12:30:21.092489+0000","last_unstale":"2024-03-30T12:41:34.159632+0000","last_undegraded":"2024-03-30T12:41:34.159632+0000","last_fullsized":"2024-03-30T12:41:34.159632+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:04:52.193390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"562'5","reported_seq":1391,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:55.774255+0000","last_change":"2024-03-30T12:30:21.070344+0000","last_active":"2024-03-30T12:42:55.774255+0000","last_peered":"2024-03-30T12:42:55.774255+0000","last_clean":"2024-03-30T12:42:55.774255+0000","last_became_active":"2024-03-30T12:30:21.069513+0000","last_became_peered":"2024-03-30T12:30:21.069513+0000","last_unstale":"2024-03-30T12:42:55.774255+0000","last_undegraded":"2024-03-30T12:42:55.774255+0000","last_fullsized":"2024-03-30T12:42:55.774255+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:28.247292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1286,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:57.685582+0000","last_change":"2024-03-30T12:29:41.403169+0000","last_active":"2024-03-30T12:43:57.685582+0000","last_peered":"2024-03-30T12:43:57.685582+0000","last_clean":"2024-03-30T12:43:57.685582+0000","last_became_active":"2024-03-30T12:29:41.402858+0000","last_became_peered":"2024-03-30T12:29:41.402858+0000","last_unstale":"2024-03-30T12:43:57.685582+0000","last_undegraded":"2024-03-30T12:43:57.685582+0000","last_fullsized":"2024-03-30T12:43:57.685582+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:19.783041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"562'2","reported_seq":1305,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:57.685593+0000","last_change":"2024-03-30T12:29:02.021133+0000","last_active":"2024-03-30T12:43:57.685593+0000","last_peered":"2024-03-30T12:43:57.685593+0000","last_clean":"2024-03-30T12:43:57.685593+0000","last_became_active":"2024-03-30T12:29:02.020799+0000","last_became_peered":"2024-03-30T12:29:02.020799+0000","last_unstale":"2024-03-30T12:43:57.685593+0000","last_undegraded":"2024-03-30T12:43:57.685593+0000","last_fullsized":"2024-03-30T12:43:57.685593+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:48:37.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:55.774245+0000","last_change":"2024-03-30T12:29:02.024676+0000","last_active":"2024-03-30T12:42:55.774245+0000","last_peered":"2024-03-30T12:42:55.774245+0000","last_clean":"2024-03-30T12:42:55.774245+0000","last_became_active":"2024-03-30T12:29:02.024229+0000","last_became_peered":"2024-03-30T12:29:02.024229+0000","last_unstale":"2024-03-30T12:42:55.774245+0000","last_undegraded":"2024-03-30T12:42:55.774245+0000","last_fullsized":"2024-03-30T12:42:55.774245+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:42.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"61'2","reported_seq":1153,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:49.168720+0000","last_change":"2024-03-30T12:30:21.094275+0000","last_active":"2024-03-30T12:42:49.168720+0000","last_peered":"2024-03-30T12:42:49.168720+0000","last_clean":"2024-03-30T12:42:49.168720+0000","last_became_active":"2024-03-30T12:30:21.091152+0000","last_became_peered":"2024-03-30T12:30:21.091152+0000","last_unstale":"2024-03-30T12:42:49.168720+0000","last_undegraded":"2024-03-30T12:42:49.168720+0000","last_fullsized":"2024-03-30T12:42:49.168720+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:23:20.887356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1231,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326512+0000","last_change":"2024-03-30T12:29:02.034502+0000","last_active":"2024-03-30T12:41:30.326512+0000","last_peered":"2024-03-30T12:41:30.326512+0000","last_clean":"2024-03-30T12:41:30.326512+0000","last_became_active":"2024-03-30T12:29:02.033005+0000","last_became_peered":"2024-03-30T12:29:02.033005+0000","last_unstale":"2024-03-30T12:41:30.326512+0000","last_undegraded":"2024-03-30T12:41:30.326512+0000","last_fullsized":"2024-03-30T12:41:30.326512+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:02.350461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"61'2","reported_seq":1156,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:49.168669+0000","last_change":"2024-03-30T12:30:21.078379+0000","last_active":"2024-03-30T12:42:49.168669+0000","last_peered":"2024-03-30T12:42:49.168669+0000","last_clean":"2024-03-30T12:42:49.168669+0000","last_became_active":"2024-03-30T12:30:21.077770+0000","last_became_peered":"2024-03-30T12:30:21.077770+0000","last_unstale":"2024-03-30T12:42:49.168669+0000","last_undegraded":"2024-03-30T12:42:49.168669+0000","last_fullsized":"2024-03-30T12:42:49.168669+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:18.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1215,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:30.326527+0000","last_change":"2024-03-30T12:29:41.406568+0000","last_active":"2024-03-30T12:41:30.326527+0000","last_peered":"2024-03-30T12:41:30.326527+0000","last_clean":"2024-03-30T12:41:30.326527+0000","last_became_active":"2024-03-30T12:29:41.406205+0000","last_became_peered":"2024-03-30T12:29:41.406205+0000","last_unstale":"2024-03-30T12:41:30.326527+0000","last_undegraded":"2024-03-30T12:41:30.326527+0000","last_fullsized":"2024-03-30T12:41:30.326527+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:54.338314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"562'2","reported_seq":1264,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:57.678781+0000","last_change":"2024-03-30T12:30:21.065448+0000","last_active":"2024-03-30T12:42:57.678781+0000","last_peered":"2024-03-30T12:42:57.678781+0000","last_clean":"2024-03-30T12:42:57.678781+0000","last_became_active":"2024-03-30T12:30:21.065051+0000","last_became_peered":"2024-03-30T12:30:21.065051+0000","last_unstale":"2024-03-30T12:42:57.678781+0000","last_undegraded":"2024-03-30T12:42:57.678781+0000","last_fullsized":"2024-03-30T12:42:57.678781+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:38:46.697226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1264,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:02.302503+0000","last_change":"2024-03-30T12:28:33.801978+0000","last_active":"2024-03-30T12:41:02.302503+0000","last_peered":"2024-03-30T12:41:02.302503+0000","last_clean":"2024-03-30T12:41:02.302503+0000","last_became_active":"2024-03-30T12:28:33.801645+0000","last_became_peered":"2024-03-30T12:28:33.801645+0000","last_unstale":"2024-03-30T12:41:02.302503+0000","last_undegraded":"2024-03-30T12:41:02.302503+0000","last_fullsized":"2024-03-30T12:41:02.302503+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:41:34.093407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"562'2","reported_seq":1182,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:09.584292+0000","last_change":"2024-03-30T12:30:21.073570+0000","last_active":"2024-03-30T12:42:09.584292+0000","last_peered":"2024-03-30T12:42:09.584292+0000","last_clean":"2024-03-30T12:42:09.584292+0000","last_became_active":"2024-03-30T12:30:21.073154+0000","last_became_peered":"2024-03-30T12:30:21.073154+0000","last_unstale":"2024-03-30T12:42:09.584292+0000","last_undegraded":"2024-03-30T12:42:09.584292+0000","last_fullsized":"2024-03-30T12:42:09.584292+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:03.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1380,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:15.763333+0000","last_change":"2024-03-30T12:30:21.071215+0000","last_active":"2024-03-30T12:41:15.763333+0000","last_peered":"2024-03-30T12:41:15.763333+0000","last_clean":"2024-03-30T12:41:15.763333+0000","last_became_active":"2024-03-30T12:30:21.070789+0000","last_became_peered":"2024-03-30T12:30:21.070789+0000","last_unstale":"2024-03-30T12:41:15.763333+0000","last_undegraded":"2024-03-30T12:41:15.763333+0000","last_fullsized":"2024-03-30T12:41:15.763333+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:00:47.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1300,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:27.675651+0000","last_change":"2024-03-30T12:29:41.385826+0000","last_active":"2024-03-30T12:42:27.675651+0000","last_peered":"2024-03-30T12:42:27.675651+0000","last_clean":"2024-03-30T12:42:27.675651+0000","last_became_active":"2024-03-30T12:29:41.385497+0000","last_became_peered":"2024-03-30T12:29:41.385497+0000","last_unstale":"2024-03-30T12:42:27.675651+0000","last_undegraded":"2024-03-30T12:42:27.675651+0000","last_fullsized":"2024-03-30T12:42:27.675651+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:00.004630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1297,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:27.675619+0000","last_change":"2024-03-30T12:27:59.582707+0000","last_active":"2024-03-30T12:42:27.675619+0000","last_peered":"2024-03-30T12:42:27.675619+0000","last_clean":"2024-03-30T12:42:27.675619+0000","last_became_active":"2024-03-30T12:27:59.580102+0000","last_became_peered":"2024-03-30T12:27:59.580102+0000","last_unstale":"2024-03-30T12:42:27.675619+0000","last_undegraded":"2024-03-30T12:42:27.675619+0000","last_fullsized":"2024-03-30T12:42:27.675619+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:42:38.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1227,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:30.339983+0000","last_change":"2024-03-30T12:30:21.065028+0000","last_active":"2024-03-30T12:43:30.339983+0000","last_peered":"2024-03-30T12:43:30.339983+0000","last_clean":"2024-03-30T12:43:30.339983+0000","last_became_active":"2024-03-30T12:30:21.064696+0000","last_became_peered":"2024-03-30T12:30:21.064696+0000","last_unstale":"2024-03-30T12:43:30.339983+0000","last_undegraded":"2024-03-30T12:43:30.339983+0000","last_fullsized":"2024-03-30T12:43:30.339983+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:35:14.219673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:18.930743+0000","last_change":"2024-03-30T12:28:33.813356+0000","last_active":"2024-03-30T12:41:18.930743+0000","last_peered":"2024-03-30T12:41:18.930743+0000","last_clean":"2024-03-30T12:41:18.930743+0000","last_became_active":"2024-03-30T12:28:33.812882+0000","last_became_peered":"2024-03-30T12:28:33.812882+0000","last_unstale":"2024-03-30T12:41:18.930743+0000","last_undegraded":"2024-03-30T12:41:18.930743+0000","last_fullsized":"2024-03-30T12:41:18.930743+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:44:52.778744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1172,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:44.581788+0000","last_change":"2024-03-30T12:29:41.418366+0000","last_active":"2024-03-30T12:41:44.581788+0000","last_peered":"2024-03-30T12:41:44.581788+0000","last_clean":"2024-03-30T12:41:44.581788+0000","last_became_active":"2024-03-30T12:29:41.418032+0000","last_became_peered":"2024-03-30T12:29:41.418032+0000","last_unstale":"2024-03-30T12:41:44.581788+0000","last_undegraded":"2024-03-30T12:41:44.581788+0000","last_fullsized":"2024-03-30T12:41:44.581788+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:33:33.316466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1207,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:30.340041+0000","last_change":"2024-03-30T12:30:21.085945+0000","last_active":"2024-03-30T12:43:30.340041+0000","last_peered":"2024-03-30T12:43:30.340041+0000","last_clean":"2024-03-30T12:43:30.340041+0000","last_became_active":"2024-03-30T12:30:21.081320+0000","last_became_peered":"2024-03-30T12:30:21.081320+0000","last_unstale":"2024-03-30T12:43:30.340041+0000","last_undegraded":"2024-03-30T12:43:30.340041+0000","last_fullsized":"2024-03-30T12:43:30.340041+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:16:54.762364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1201,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:30.340029+0000","last_change":"2024-03-30T12:29:41.405313+0000","last_active":"2024-03-30T12:43:30.340029+0000","last_peered":"2024-03-30T12:43:30.340029+0000","last_clean":"2024-03-30T12:43:30.340029+0000","last_became_active":"2024-03-30T12:29:41.405021+0000","last_became_peered":"2024-03-30T12:29:41.405021+0000","last_unstale":"2024-03-30T12:43:30.340029+0000","last_undegraded":"2024-03-30T12:43:30.340029+0000","last_fullsized":"2024-03-30T12:43:30.340029+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:36:59.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1293,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:53.406703+0000","last_change":"2024-03-30T12:29:02.021099+0000","last_active":"2024-03-30T12:41:53.406703+0000","last_peered":"2024-03-30T12:41:53.406703+0000","last_clean":"2024-03-30T12:41:53.406703+0000","last_became_active":"2024-03-30T12:29:02.020702+0000","last_became_peered":"2024-03-30T12:29:02.020702+0000","last_unstale":"2024-03-30T12:41:53.406703+0000","last_undegraded":"2024-03-30T12:41:53.406703+0000","last_fullsized":"2024-03-30T12:41:53.406703+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:49:13.810172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"61'3","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:18.930787+0000","last_change":"2024-03-30T12:29:02.021301+0000","last_active":"2024-03-30T12:41:18.930787+0000","last_peered":"2024-03-30T12:41:18.930787+0000","last_clean":"2024-03-30T12:41:18.930787+0000","last_became_active":"2024-03-30T12:29:02.020925+0000","last_became_peered":"2024-03-30T12:29:02.020925+0000","last_unstale":"2024-03-30T12:41:18.930787+0000","last_undegraded":"2024-03-30T12:41:18.930787+0000","last_fullsized":"2024-03-30T12:41:18.930787+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:10:40.698022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:32.312127+0000","last_change":"2024-03-30T12:30:21.072586+0000","last_active":"2024-03-30T12:42:32.312127+0000","last_peered":"2024-03-30T12:42:32.312127+0000","last_clean":"2024-03-30T12:42:32.312127+0000","last_became_active":"2024-03-30T12:30:21.072293+0000","last_became_peered":"2024-03-30T12:30:21.072293+0000","last_unstale":"2024-03-30T12:42:32.312127+0000","last_undegraded":"2024-03-30T12:42:32.312127+0000","last_fullsized":"2024-03-30T12:42:32.312127+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:30:09.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"562'29","reported_seq":1207,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579099+0000","last_change":"2024-03-30T12:29:41.411212+0000","last_active":"2024-03-30T12:41:19.579099+0000","last_peered":"2024-03-30T12:41:19.579099+0000","last_clean":"2024-03-30T12:41:19.579099+0000","last_became_active":"2024-03-30T12:29:41.410846+0000","last_became_peered":"2024-03-30T12:29:41.410846+0000","last_unstale":"2024-03-30T12:41:19.579099+0000","last_undegraded":"2024-03-30T12:41:19.579099+0000","last_fullsized":"2024-03-30T12:41:19.579099+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:46:05.268012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:24.165645+0000","last_change":"2024-03-30T12:30:21.099617+0000","last_active":"2024-03-30T12:42:24.165645+0000","last_peered":"2024-03-30T12:42:24.165645+0000","last_clean":"2024-03-30T12:42:24.165645+0000","last_became_active":"2024-03-30T12:30:21.093761+0000","last_became_peered":"2024-03-30T12:30:21.093761+0000","last_unstale":"2024-03-30T12:42:24.165645+0000","last_undegraded":"2024-03-30T12:42:24.165645+0000","last_fullsized":"2024-03-30T12:42:24.165645+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:26.597183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"61'2","reported_seq":1386,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:35.772053+0000","last_change":"2024-03-30T12:28:33.812695+0000","last_active":"2024-03-30T12:42:35.772053+0000","last_peered":"2024-03-30T12:42:35.772053+0000","last_clean":"2024-03-30T12:42:35.772053+0000","last_became_active":"2024-03-30T12:28:33.811627+0000","last_became_peered":"2024-03-30T12:28:33.811627+0000","last_unstale":"2024-03-30T12:42:35.772053+0000","last_undegraded":"2024-03-30T12:42:35.772053+0000","last_fullsized":"2024-03-30T12:42:35.772053+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:41:16.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:35.772026+0000","last_change":"2024-03-30T12:30:21.069906+0000","last_active":"2024-03-30T12:42:35.772026+0000","last_peered":"2024-03-30T12:42:35.772026+0000","last_clean":"2024-03-30T12:42:35.772026+0000","last_became_active":"2024-03-30T12:30:21.069063+0000","last_became_peered":"2024-03-30T12:30:21.069063+0000","last_unstale":"2024-03-30T12:42:35.772026+0000","last_undegraded":"2024-03-30T12:42:35.772026+0000","last_fullsized":"2024-03-30T12:42:35.772026+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:41:16.184511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1236,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:00.336730+0000","last_change":"2024-03-30T12:30:21.080813+0000","last_active":"2024-03-30T12:43:00.336730+0000","last_peered":"2024-03-30T12:43:00.336730+0000","last_clean":"2024-03-30T12:43:00.336730+0000","last_became_active":"2024-03-30T12:30:21.080440+0000","last_became_peered":"2024-03-30T12:30:21.080440+0000","last_unstale":"2024-03-30T12:43:00.336730+0000","last_undegraded":"2024-03-30T12:43:00.336730+0000","last_fullsized":"2024-03-30T12:43:00.336730+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:00:00.458785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:59.162782+0000","last_change":"2024-03-30T12:30:21.092177+0000","last_active":"2024-03-30T12:41:59.162782+0000","last_peered":"2024-03-30T12:41:59.162782+0000","last_clean":"2024-03-30T12:41:59.162782+0000","last_became_active":"2024-03-30T12:30:21.091307+0000","last_became_peered":"2024-03-30T12:30:21.091307+0000","last_unstale":"2024-03-30T12:41:59.162782+0000","last_undegraded":"2024-03-30T12:41:59.162782+0000","last_fullsized":"2024-03-30T12:41:59.162782+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:35.848627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1186,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579076+0000","last_change":"2024-03-30T12:29:41.390871+0000","last_active":"2024-03-30T12:41:19.579076+0000","last_peered":"2024-03-30T12:41:19.579076+0000","last_clean":"2024-03-30T12:41:19.579076+0000","last_became_active":"2024-03-30T12:29:41.390564+0000","last_became_peered":"2024-03-30T12:29:41.390564+0000","last_unstale":"2024-03-30T12:41:19.579076+0000","last_undegraded":"2024-03-30T12:41:19.579076+0000","last_fullsized":"2024-03-30T12:41:19.579076+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:46:59.138622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1171,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:19.579050+0000","last_change":"2024-03-30T12:29:41.400681+0000","last_active":"2024-03-30T12:41:19.579050+0000","last_peered":"2024-03-30T12:41:19.579050+0000","last_clean":"2024-03-30T12:41:19.579050+0000","last_became_active":"2024-03-30T12:29:41.400333+0000","last_became_peered":"2024-03-30T12:29:41.400333+0000","last_unstale":"2024-03-30T12:41:19.579050+0000","last_undegraded":"2024-03-30T12:41:19.579050+0000","last_fullsized":"2024-03-30T12:41:19.579050+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:38:48.819485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"61'8","reported_seq":1346,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:23.403657+0000","last_change":"2024-03-30T12:27:25.312685+0000","last_active":"2024-03-30T12:41:23.403657+0000","last_peered":"2024-03-30T12:41:23.403657+0000","last_clean":"2024-03-30T12:41:23.403657+0000","last_became_active":"2024-03-30T12:27:25.312180+0000","last_became_peered":"2024-03-30T12:27:25.312180+0000","last_unstale":"2024-03-30T12:41:23.403657+0000","last_undegraded":"2024-03-30T12:41:23.403657+0000","last_fullsized":"2024-03-30T12:41:23.403657+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:44.090155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:59.162732+0000","last_change":"2024-03-30T12:30:21.094100+0000","last_active":"2024-03-30T12:41:59.162732+0000","last_peered":"2024-03-30T12:41:59.162732+0000","last_clean":"2024-03-30T12:41:59.162732+0000","last_became_active":"2024-03-30T12:30:21.092628+0000","last_became_peered":"2024-03-30T12:30:21.092628+0000","last_unstale":"2024-03-30T12:41:59.162732+0000","last_undegraded":"2024-03-30T12:41:59.162732+0000","last_fullsized":"2024-03-30T12:41:59.162732+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:57:06.496194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"859'1284","reported_seq":5755,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:33.411173+0000","last_change":"2024-03-30T12:36:03.016013+0000","last_active":"2024-03-30T12:42:33.411173+0000","last_peered":"2024-03-30T12:42:33.411173+0000","last_clean":"2024-03-30T12:42:33.411173+0000","last_became_active":"2024-03-30T12:27:25.312454+0000","last_became_peered":"2024-03-30T12:27:25.312454+0000","last_unstale":"2024-03-30T12:42:33.411173+0000","last_undegraded":"2024-03-30T12:42:33.411173+0000","last_fullsized":"2024-03-30T12:42:33.411173+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:30.189060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056118019999999999,"stat_sum":{"num_bytes":170188800,"num_objects":105,"num_object_clones":100,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":372,"num_read_kb":565470,"num_write":1002,"num_write_kb":189312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":26861568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.f","version":"61'1","reported_seq":1277,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:02.309177+0000","last_change":"2024-03-30T12:30:21.073962+0000","last_active":"2024-03-30T12:42:02.309177+0000","last_peered":"2024-03-30T12:42:02.309177+0000","last_clean":"2024-03-30T12:42:02.309177+0000","last_became_active":"2024-03-30T12:30:21.073499+0000","last_became_peered":"2024-03-30T12:30:21.073499+0000","last_unstale":"2024-03-30T12:42:02.309177+0000","last_undegraded":"2024-03-30T12:42:02.309177+0000","last_fullsized":"2024-03-30T12:42:02.309177+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:53:48.299722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159642+0000","last_change":"2024-03-30T12:30:21.090507+0000","last_active":"2024-03-30T12:41:34.159642+0000","last_peered":"2024-03-30T12:41:34.159642+0000","last_clean":"2024-03-30T12:41:34.159642+0000","last_became_active":"2024-03-30T12:30:21.090194+0000","last_became_peered":"2024-03-30T12:30:21.090194+0000","last_unstale":"2024-03-30T12:41:34.159642+0000","last_undegraded":"2024-03-30T12:41:34.159642+0000","last_fullsized":"2024-03-30T12:41:34.159642+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:47.552618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"865'860","reported_seq":5516,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:55.774198+0000","last_change":"2024-03-30T12:36:03.222067+0000","last_active":"2024-03-30T12:42:55.774198+0000","last_peered":"2024-03-30T12:42:55.774198+0000","last_clean":"2024-03-30T12:42:55.774198+0000","last_became_active":"2024-03-30T12:29:41.392474+0000","last_became_peered":"2024-03-30T12:29:41.392474+0000","last_unstale":"2024-03-30T12:42:55.774198+0000","last_undegraded":"2024-03-30T12:42:55.774198+0000","last_fullsized":"2024-03-30T12:42:55.774198+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:53:06.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004951385,"stat_sum":{"num_bytes":128327680,"num_objects":92,"num_object_clones":88,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":1,"num_read":338,"num_read_kb":510591,"num_write":654,"num_write_kb":142712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30932992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:28.944955+0000","last_change":"2024-03-30T12:29:02.030352+0000","last_active":"2024-03-30T12:43:28.944955+0000","last_peered":"2024-03-30T12:43:28.944955+0000","last_clean":"2024-03-30T12:43:28.944955+0000","last_became_active":"2024-03-30T12:29:02.030123+0000","last_became_peered":"2024-03-30T12:29:02.030123+0000","last_unstale":"2024-03-30T12:43:28.944955+0000","last_undegraded":"2024-03-30T12:43:28.944955+0000","last_fullsized":"2024-03-30T12:43:28.944955+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:43.327850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1350,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:28.944980+0000","last_change":"2024-03-30T12:30:21.057131+0000","last_active":"2024-03-30T12:43:28.944980+0000","last_peered":"2024-03-30T12:43:28.944980+0000","last_clean":"2024-03-30T12:43:28.944980+0000","last_became_active":"2024-03-30T12:30:21.056827+0000","last_became_peered":"2024-03-30T12:30:21.056827+0000","last_unstale":"2024-03-30T12:43:28.944980+0000","last_undegraded":"2024-03-30T12:43:28.944980+0000","last_fullsized":"2024-03-30T12:43:28.944980+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:40.233572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1242,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:35.340682+0000","last_change":"2024-03-30T12:29:02.020724+0000","last_active":"2024-03-30T12:43:35.340682+0000","last_peered":"2024-03-30T12:43:35.340682+0000","last_clean":"2024-03-30T12:43:35.340682+0000","last_became_active":"2024-03-30T12:29:02.020418+0000","last_became_peered":"2024-03-30T12:29:02.020418+0000","last_unstale":"2024-03-30T12:43:35.340682+0000","last_undegraded":"2024-03-30T12:43:35.340682+0000","last_fullsized":"2024-03-30T12:43:35.340682+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:45.622076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"865'868","reported_seq":5461,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:43:00.774816+0000","last_change":"2024-03-30T12:36:03.222052+0000","last_active":"2024-03-30T12:43:00.774816+0000","last_peered":"2024-03-30T12:43:00.774816+0000","last_clean":"2024-03-30T12:43:00.774816+0000","last_became_active":"2024-03-30T12:28:33.811244+0000","last_became_peered":"2024-03-30T12:28:33.811244+0000","last_unstale":"2024-03-30T12:43:00.774816+0000","last_undegraded":"2024-03-30T12:43:00.774816+0000","last_fullsized":"2024-03-30T12:43:00.774816+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":284,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:16.350003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068599910000000002,"stat_sum":{"num_bytes":132816896,"num_objects":96,"num_object_clones":92,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":1,"num_read":277,"num_read_kb":384872,"num_write":721,"num_write_kb":145512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":49029120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:28.944991+0000","last_change":"2024-03-30T12:27:59.579418+0000","last_active":"2024-03-30T12:43:28.944991+0000","last_peered":"2024-03-30T12:43:28.944991+0000","last_clean":"2024-03-30T12:43:28.944991+0000","last_became_active":"2024-03-30T12:27:59.579099+0000","last_became_peered":"2024-03-30T12:27:59.579099+0000","last_unstale":"2024-03-30T12:43:28.944991+0000","last_undegraded":"2024-03-30T12:43:28.944991+0000","last_fullsized":"2024-03-30T12:43:28.944991+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:13.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1210,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:35.340584+0000","last_change":"2024-03-30T12:29:41.405671+0000","last_active":"2024-03-30T12:43:35.340584+0000","last_peered":"2024-03-30T12:43:35.340584+0000","last_clean":"2024-03-30T12:43:35.340584+0000","last_became_active":"2024-03-30T12:29:41.404966+0000","last_became_peered":"2024-03-30T12:29:41.404966+0000","last_unstale":"2024-03-30T12:43:35.340584+0000","last_undegraded":"2024-03-30T12:43:35.340584+0000","last_fullsized":"2024-03-30T12:43:35.340584+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:03:01.044228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1275,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:07.315593+0000","last_change":"2024-03-30T12:29:41.393399+0000","last_active":"2024-03-30T12:43:07.315593+0000","last_peered":"2024-03-30T12:43:07.315593+0000","last_clean":"2024-03-30T12:43:07.315593+0000","last_became_active":"2024-03-30T12:29:41.393066+0000","last_became_peered":"2024-03-30T12:29:41.393066+0000","last_unstale":"2024-03-30T12:43:07.315593+0000","last_undegraded":"2024-03-30T12:43:07.315593+0000","last_fullsized":"2024-03-30T12:43:07.315593+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:49.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.6","version":"859'391","reported_seq":3806,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:33.411258+0000","last_change":"2024-03-30T12:36:01.007107+0000","last_active":"2024-03-30T12:42:33.411258+0000","last_peered":"2024-03-30T12:42:33.411258+0000","last_clean":"2024-03-30T12:42:33.411258+0000","last_became_active":"2024-03-30T12:29:02.019555+0000","last_became_peered":"2024-03-30T12:29:02.019555+0000","last_unstale":"2024-03-30T12:42:33.411258+0000","last_undegraded":"2024-03-30T12:42:33.411258+0000","last_fullsized":"2024-03-30T12:42:33.411258+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:11:54.050423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060340100000000005,"stat_sum":{"num_bytes":2809856,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":37451,"num_write":166,"num_write_kb":19704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":1345,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935569+0000","last_change":"2024-03-30T12:29:02.021786+0000","last_active":"2024-03-30T12:41:58.935569+0000","last_peered":"2024-03-30T12:41:58.935569+0000","last_clean":"2024-03-30T12:41:58.935569+0000","last_became_active":"2024-03-30T12:29:02.021492+0000","last_became_peered":"2024-03-30T12:29:02.021492+0000","last_unstale":"2024-03-30T12:41:58.935569+0000","last_undegraded":"2024-03-30T12:41:58.935569+0000","last_fullsized":"2024-03-30T12:41:58.935569+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:44.319614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:48.940828+0000","last_change":"2024-03-30T12:29:41.384646+0000","last_active":"2024-03-30T12:42:48.940828+0000","last_peered":"2024-03-30T12:42:48.940828+0000","last_clean":"2024-03-30T12:42:48.940828+0000","last_became_active":"2024-03-30T12:29:41.384328+0000","last_became_peered":"2024-03-30T12:29:41.384328+0000","last_unstale":"2024-03-30T12:42:48.940828+0000","last_undegraded":"2024-03-30T12:42:48.940828+0000","last_fullsized":"2024-03-30T12:42:48.940828+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:27.564574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.407376+0000","last_change":"2024-03-30T12:27:59.575150+0000","last_active":"2024-03-30T12:41:58.407376+0000","last_peered":"2024-03-30T12:41:58.407376+0000","last_clean":"2024-03-30T12:41:58.407376+0000","last_became_active":"2024-03-30T12:27:59.574855+0000","last_became_peered":"2024-03-30T12:27:59.574855+0000","last_unstale":"2024-03-30T12:41:58.407376+0000","last_undegraded":"2024-03-30T12:41:58.407376+0000","last_fullsized":"2024-03-30T12:41:58.407376+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:24.610899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"853'847","reported_seq":4579,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:49.168681+0000","last_change":"2024-03-30T12:36:03.019196+0000","last_active":"2024-03-30T12:42:49.168681+0000","last_peered":"2024-03-30T12:42:49.168681+0000","last_clean":"2024-03-30T12:42:49.168681+0000","last_became_active":"2024-03-30T12:30:21.075750+0000","last_became_peered":"2024-03-30T12:30:21.075750+0000","last_unstale":"2024-03-30T12:42:49.168681+0000","last_undegraded":"2024-03-30T12:42:49.168681+0000","last_fullsized":"2024-03-30T12:42:49.168681+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":171,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:03:08.457644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013296611,"stat_sum":{"num_bytes":63250432,"num_objects":42,"num_object_clones":39,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":216,"num_read_kb":383443,"num_write":491,"num_write_kb":110008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":104292352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"23"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"4.5","version":"0'0","reported_seq":1177,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:09.584340+0000","last_change":"2024-03-30T12:30:21.071951+0000","last_active":"2024-03-30T12:42:09.584340+0000","last_peered":"2024-03-30T12:42:09.584340+0000","last_clean":"2024-03-30T12:42:09.584340+0000","last_became_active":"2024-03-30T12:30:21.071565+0000","last_became_peered":"2024-03-30T12:30:21.071565+0000","last_unstale":"2024-03-30T12:42:09.584340+0000","last_undegraded":"2024-03-30T12:42:09.584340+0000","last_fullsized":"2024-03-30T12:42:09.584340+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:23:16.843515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1262,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:32.676053+0000","last_change":"2024-03-30T12:29:41.385917+0000","last_active":"2024-03-30T12:42:32.676053+0000","last_peered":"2024-03-30T12:42:32.676053+0000","last_clean":"2024-03-30T12:42:32.676053+0000","last_became_active":"2024-03-30T12:29:41.385586+0000","last_became_peered":"2024-03-30T12:29:41.385586+0000","last_unstale":"2024-03-30T12:42:32.676053+0000","last_undegraded":"2024-03-30T12:42:32.676053+0000","last_fullsized":"2024-03-30T12:42:32.676053+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:13.241566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1203,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:35.340655+0000","last_change":"2024-03-30T12:30:21.072391+0000","last_active":"2024-03-30T12:43:35.340655+0000","last_peered":"2024-03-30T12:43:35.340655+0000","last_clean":"2024-03-30T12:43:35.340655+0000","last_became_active":"2024-03-30T12:30:21.071883+0000","last_became_peered":"2024-03-30T12:30:21.071883+0000","last_unstale":"2024-03-30T12:43:35.340655+0000","last_undegraded":"2024-03-30T12:43:35.340655+0000","last_fullsized":"2024-03-30T12:43:35.340655+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:13:11.812880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"228'217","reported_seq":1719,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:19.165060+0000","last_change":"2024-03-30T12:30:21.068004+0000","last_active":"2024-03-30T12:42:19.165060+0000","last_peered":"2024-03-30T12:42:19.165060+0000","last_clean":"2024-03-30T12:42:19.165060+0000","last_became_active":"2024-03-30T12:30:21.067606+0000","last_became_peered":"2024-03-30T12:30:21.067606+0000","last_unstale":"2024-03-30T12:42:19.165060+0000","last_undegraded":"2024-03-30T12:42:19.165060+0000","last_fullsized":"2024-03-30T12:42:19.165060+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:16:43.434559+0000","last_clean_scrub_stamp":"2024-03-30T12:16:43.434559+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:16:30.466055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"865'27518","reported_seq":24716,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:00.329951+0000","last_change":"2024-03-30T12:36:03.223744+0000","last_active":"2024-03-30T12:42:00.329951+0000","last_peered":"2024-03-30T12:42:00.329951+0000","last_clean":"2024-03-30T12:42:00.329951+0000","last_became_active":"2024-03-30T12:29:02.028568+0000","last_became_peered":"2024-03-30T12:29:02.028568+0000","last_unstale":"2024-03-30T12:42:00.329951+0000","last_undegraded":"2024-03-30T12:42:00.329951+0000","last_fullsized":"2024-03-30T12:42:00.329951+0000","mapping_epoch":461,"log_start":"528'21508","ondisk_log_start":"528'21508","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6010,"log_dups_size":0,"ondisk_log_size":6010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:03:06.901891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065155569999999999,"stat_sum":{"num_bytes":137289728,"num_objects":105,"num_object_clones":99,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":1,"num_read":451,"num_read_kb":780472,"num_write":933,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":86179840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"4.6","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:35.778685+0000","last_change":"2024-03-30T12:27:25.323436+0000","last_active":"2024-03-30T12:43:35.778685+0000","last_peered":"2024-03-30T12:43:35.778685+0000","last_clean":"2024-03-30T12:43:35.778685+0000","last_became_active":"2024-03-30T12:27:25.323069+0000","last_became_peered":"2024-03-30T12:27:25.323069+0000","last_unstale":"2024-03-30T12:43:35.778685+0000","last_undegraded":"2024-03-30T12:43:35.778685+0000","last_fullsized":"2024-03-30T12:43:35.778685+0000","mapping_epoch":365,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":366,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:15:51.657265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:55.774169+0000","last_change":"2024-03-30T12:28:33.817796+0000","last_active":"2024-03-30T12:42:55.774169+0000","last_peered":"2024-03-30T12:42:55.774169+0000","last_clean":"2024-03-30T12:42:55.774169+0000","last_became_active":"2024-03-30T12:28:33.817421+0000","last_became_peered":"2024-03-30T12:28:33.817421+0000","last_unstale":"2024-03-30T12:42:55.774169+0000","last_undegraded":"2024-03-30T12:42:55.774169+0000","last_fullsized":"2024-03-30T12:42:55.774169+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:59:32.534269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1147,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:19.165034+0000","last_change":"2024-03-30T12:30:21.065876+0000","last_active":"2024-03-30T12:42:19.165034+0000","last_peered":"2024-03-30T12:42:19.165034+0000","last_clean":"2024-03-30T12:42:19.165034+0000","last_became_active":"2024-03-30T12:30:21.065408+0000","last_became_peered":"2024-03-30T12:30:21.065408+0000","last_unstale":"2024-03-30T12:42:19.165034+0000","last_undegraded":"2024-03-30T12:42:19.165034+0000","last_fullsized":"2024-03-30T12:42:19.165034+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:05:39.588289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"864'16835","reported_seq":16483,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:09.584304+0000","last_change":"2024-03-30T12:36:03.221717+0000","last_active":"2024-03-30T12:42:09.584304+0000","last_peered":"2024-03-30T12:42:09.584304+0000","last_clean":"2024-03-30T12:42:09.584304+0000","last_became_active":"2024-03-30T12:29:41.401778+0000","last_became_peered":"2024-03-30T12:29:41.401778+0000","last_unstale":"2024-03-30T12:42:09.584304+0000","last_undegraded":"2024-03-30T12:42:09.584304+0000","last_fullsized":"2024-03-30T12:42:09.584304+0000","mapping_epoch":500,"log_start":"527'9806","ondisk_log_start":"527'9806","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":7029,"log_dups_size":0,"ondisk_log_size":7029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":182,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:39:59.922132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092308930000000004,"stat_sum":{"num_bytes":62070784,"num_objects":51,"num_object_clones":48,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":248,"num_read_kb":171069,"num_write":602,"num_write_kb":104624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":11354112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"3"},{"start":"ec","length":"f"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10d","length":"1"},{"start":"111","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1382,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:55.774215+0000","last_change":"2024-03-30T12:30:21.070920+0000","last_active":"2024-03-30T12:42:55.774215+0000","last_peered":"2024-03-30T12:42:55.774215+0000","last_clean":"2024-03-30T12:42:55.774215+0000","last_became_active":"2024-03-30T12:30:21.070111+0000","last_became_peered":"2024-03-30T12:30:21.070111+0000","last_unstale":"2024-03-30T12:42:55.774215+0000","last_undegraded":"2024-03-30T12:42:55.774215+0000","last_fullsized":"2024-03-30T12:42:55.774215+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:10:36.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1166,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:49.168709+0000","last_change":"2024-03-30T12:30:21.099811+0000","last_active":"2024-03-30T12:42:49.168709+0000","last_peered":"2024-03-30T12:42:49.168709+0000","last_clean":"2024-03-30T12:42:49.168709+0000","last_became_active":"2024-03-30T12:30:21.093983+0000","last_became_peered":"2024-03-30T12:30:21.093983+0000","last_unstale":"2024-03-30T12:42:49.168709+0000","last_undegraded":"2024-03-30T12:42:49.168709+0000","last_fullsized":"2024-03-30T12:42:49.168709+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:25:40.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1352,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:28.945001+0000","last_change":"2024-03-30T12:29:02.021951+0000","last_active":"2024-03-30T12:43:28.945001+0000","last_peered":"2024-03-30T12:43:28.945001+0000","last_clean":"2024-03-30T12:43:28.945001+0000","last_became_active":"2024-03-30T12:29:02.021664+0000","last_became_peered":"2024-03-30T12:29:02.021664+0000","last_unstale":"2024-03-30T12:43:28.945001+0000","last_undegraded":"2024-03-30T12:43:28.945001+0000","last_fullsized":"2024-03-30T12:43:28.945001+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:12:35.773550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"864'36436","reported_seq":31272,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:43:07.315551+0000","last_change":"2024-03-30T12:36:03.021096+0000","last_active":"2024-03-30T12:43:07.315551+0000","last_peered":"2024-03-30T12:43:07.315551+0000","last_clean":"2024-03-30T12:43:07.315551+0000","last_became_active":"2024-03-30T12:30:21.088534+0000","last_became_peered":"2024-03-30T12:30:21.088534+0000","last_unstale":"2024-03-30T12:43:07.315551+0000","last_undegraded":"2024-03-30T12:43:07.315551+0000","last_fullsized":"2024-03-30T12:43:07.315551+0000","mapping_epoch":537,"log_start":"508'29913","ondisk_log_start":"508'29913","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6523,"log_dups_size":0,"ondisk_log_size":6523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":218,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:13:55.377457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068495919999999998,"stat_sum":{"num_bytes":132374528,"num_objects":80,"num_object_clones":76,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":298,"num_read_kb":322557,"num_write":641,"num_write_kb":146584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10256384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"36"},{"start":"e0","length":"3"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1298,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:57.685557+0000","last_change":"2024-03-30T12:30:21.058977+0000","last_active":"2024-03-30T12:43:57.685557+0000","last_peered":"2024-03-30T12:43:57.685557+0000","last_clean":"2024-03-30T12:43:57.685557+0000","last_became_active":"2024-03-30T12:30:21.058653+0000","last_became_peered":"2024-03-30T12:30:21.058653+0000","last_unstale":"2024-03-30T12:43:57.685557+0000","last_undegraded":"2024-03-30T12:43:57.685557+0000","last_fullsized":"2024-03-30T12:43:57.685557+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:50.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"565'2","reported_seq":1356,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935556+0000","last_change":"2024-03-30T12:29:41.390282+0000","last_active":"2024-03-30T12:41:58.935556+0000","last_peered":"2024-03-30T12:41:58.935556+0000","last_clean":"2024-03-30T12:41:58.935556+0000","last_became_active":"2024-03-30T12:29:41.389810+0000","last_became_peered":"2024-03-30T12:29:41.389810+0000","last_unstale":"2024-03-30T12:41:58.935556+0000","last_undegraded":"2024-03-30T12:41:58.935556+0000","last_fullsized":"2024-03-30T12:41:58.935556+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:10.216678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1300,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:07.679777+0000","last_change":"2024-03-30T12:30:21.055916+0000","last_active":"2024-03-30T12:43:07.679777+0000","last_peered":"2024-03-30T12:43:07.679777+0000","last_clean":"2024-03-30T12:43:07.679777+0000","last_became_active":"2024-03-30T12:30:21.055621+0000","last_became_peered":"2024-03-30T12:30:21.055621+0000","last_unstale":"2024-03-30T12:43:07.679777+0000","last_undegraded":"2024-03-30T12:43:07.679777+0000","last_fullsized":"2024-03-30T12:43:07.679777+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:22:09.403062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"864'405","reported_seq":3768,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:57.685524+0000","last_change":"2024-03-30T12:36:01.033814+0000","last_active":"2024-03-30T12:43:57.685524+0000","last_peered":"2024-03-30T12:43:57.685524+0000","last_clean":"2024-03-30T12:43:57.685524+0000","last_became_active":"2024-03-30T12:28:33.810478+0000","last_became_peered":"2024-03-30T12:28:33.810478+0000","last_unstale":"2024-03-30T12:43:57.685524+0000","last_undegraded":"2024-03-30T12:43:57.685524+0000","last_fullsized":"2024-03-30T12:43:57.685524+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:09:15.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039623760000000001,"stat_sum":{"num_bytes":3883008,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":60,"num_read_kb":81193,"num_write":165,"num_write_kb":30968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1622016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1236,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:07.315509+0000","last_change":"2024-03-30T12:29:41.392620+0000","last_active":"2024-03-30T12:43:07.315509+0000","last_peered":"2024-03-30T12:43:07.315509+0000","last_clean":"2024-03-30T12:43:07.315509+0000","last_became_active":"2024-03-30T12:29:41.392152+0000","last_became_peered":"2024-03-30T12:29:41.392152+0000","last_unstale":"2024-03-30T12:43:07.315509+0000","last_undegraded":"2024-03-30T12:43:07.315509+0000","last_fullsized":"2024-03-30T12:43:07.315509+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:34.039736+0000","last_clean_scrub_stamp":"2024-03-30T12:19:34.039736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:33:43.100859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"61'2","reported_seq":1158,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:39.587408+0000","last_change":"2024-03-30T12:30:21.088207+0000","last_active":"2024-03-30T12:42:39.587408+0000","last_peered":"2024-03-30T12:42:39.587408+0000","last_clean":"2024-03-30T12:42:39.587408+0000","last_became_active":"2024-03-30T12:30:21.087718+0000","last_became_peered":"2024-03-30T12:30:21.087718+0000","last_unstale":"2024-03-30T12:42:39.587408+0000","last_undegraded":"2024-03-30T12:42:39.587408+0000","last_fullsized":"2024-03-30T12:42:39.587408+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:21:32.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:35.778656+0000","last_change":"2024-03-30T12:28:33.812650+0000","last_active":"2024-03-30T12:43:35.778656+0000","last_peered":"2024-03-30T12:43:35.778656+0000","last_clean":"2024-03-30T12:43:35.778656+0000","last_became_active":"2024-03-30T12:28:33.811949+0000","last_became_peered":"2024-03-30T12:28:33.811949+0000","last_unstale":"2024-03-30T12:43:35.778656+0000","last_undegraded":"2024-03-30T12:43:35.778656+0000","last_fullsized":"2024-03-30T12:43:35.778656+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:32:12.023509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"858'11953","reported_seq":15596,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:30.333267+0000","last_change":"2024-03-30T12:36:03.223541+0000","last_active":"2024-03-30T12:42:30.333267+0000","last_peered":"2024-03-30T12:42:30.333267+0000","last_clean":"2024-03-30T12:42:30.333267+0000","last_became_active":"2024-03-30T12:29:41.416829+0000","last_became_peered":"2024-03-30T12:29:41.416829+0000","last_unstale":"2024-03-30T12:42:30.333267+0000","last_undegraded":"2024-03-30T12:42:30.333267+0000","last_fullsized":"2024-03-30T12:42:30.333267+0000","mapping_epoch":500,"log_start":"504'5904","ondisk_log_start":"504'5904","created":71,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":206,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:28.389833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010826496,"stat_sum":{"num_bytes":60743680,"num_objects":37,"num_object_clones":35,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":127,"num_read_kb":286044,"num_write":284,"num_write_kb":85336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":15892480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3d"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ea","length":"1"},{"start":"ec","length":"1"},{"start":"ee","length":"2"},{"start":"f1","length":"3"},{"start":"f5","length":"2"},{"start":"f8","length":"1"}]},{"pgid":"2.8","version":"0'0","reported_seq":1146,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:19.172145+0000","last_change":"2024-03-30T12:30:21.066274+0000","last_active":"2024-03-30T12:43:19.172145+0000","last_peered":"2024-03-30T12:43:19.172145+0000","last_clean":"2024-03-30T12:43:19.172145+0000","last_became_active":"2024-03-30T12:30:21.063863+0000","last_became_peered":"2024-03-30T12:30:21.063863+0000","last_unstale":"2024-03-30T12:43:19.172145+0000","last_undegraded":"2024-03-30T12:43:19.172145+0000","last_fullsized":"2024-03-30T12:43:19.172145+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:12.322597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1261,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:42.319486+0000","last_change":"2024-03-30T12:30:21.075785+0000","last_active":"2024-03-30T12:43:42.319486+0000","last_peered":"2024-03-30T12:43:42.319486+0000","last_clean":"2024-03-30T12:43:42.319486+0000","last_became_active":"2024-03-30T12:30:21.075471+0000","last_became_peered":"2024-03-30T12:30:21.075471+0000","last_unstale":"2024-03-30T12:43:42.319486+0000","last_undegraded":"2024-03-30T12:43:42.319486+0000","last_fullsized":"2024-03-30T12:43:42.319486+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:57:09.470856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"848'25338","reported_seq":29022,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:02.309140+0000","last_change":"2024-03-30T12:36:03.020881+0000","last_active":"2024-03-30T12:42:02.309140+0000","last_peered":"2024-03-30T12:42:02.309140+0000","last_clean":"2024-03-30T12:42:02.309140+0000","last_became_active":"2024-03-30T12:29:02.052512+0000","last_became_peered":"2024-03-30T12:29:02.052512+0000","last_unstale":"2024-03-30T12:42:02.309140+0000","last_undegraded":"2024-03-30T12:42:02.309140+0000","last_fullsized":"2024-03-30T12:42:02.309140+0000","mapping_epoch":461,"log_start":"520'18806","ondisk_log_start":"520'18806","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":6532,"log_dups_size":0,"ondisk_log_size":6532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":216,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:39:02.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055376050000000001,"stat_sum":{"num_bytes":27049984,"num_objects":23,"num_object_clones":22,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":69,"num_read_kb":41313,"num_write":246,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8101888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3b"},{"start":"e4","length":"1"},{"start":"e6","length":"1"},{"start":"e8","length":"1"},{"start":"ec","length":"1"}]},{"pgid":"2.9","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935491+0000","last_change":"2024-03-30T12:30:21.056039+0000","last_active":"2024-03-30T12:41:58.935491+0000","last_peered":"2024-03-30T12:41:58.935491+0000","last_clean":"2024-03-30T12:41:58.935491+0000","last_became_active":"2024-03-30T12:30:21.055748+0000","last_became_peered":"2024-03-30T12:30:21.055748+0000","last_unstale":"2024-03-30T12:41:58.935491+0000","last_undegraded":"2024-03-30T12:41:58.935491+0000","last_fullsized":"2024-03-30T12:41:58.935491+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:34:24.332442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1292,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:07.679723+0000","last_change":"2024-03-30T12:30:21.058253+0000","last_active":"2024-03-30T12:43:07.679723+0000","last_peered":"2024-03-30T12:43:07.679723+0000","last_clean":"2024-03-30T12:43:07.679723+0000","last_became_active":"2024-03-30T12:30:21.056632+0000","last_became_peered":"2024-03-30T12:30:21.056632+0000","last_unstale":"2024-03-30T12:43:07.679723+0000","last_undegraded":"2024-03-30T12:43:07.679723+0000","last_fullsized":"2024-03-30T12:43:07.679723+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:10:39.974234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"864'1238","reported_seq":5613,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:43:08.415054+0000","last_change":"2024-03-30T12:36:03.017229+0000","last_active":"2024-03-30T12:43:08.415054+0000","last_peered":"2024-03-30T12:43:08.415054+0000","last_clean":"2024-03-30T12:43:08.415054+0000","last_became_active":"2024-03-30T12:30:21.073659+0000","last_became_peered":"2024-03-30T12:30:21.073659+0000","last_unstale":"2024-03-30T12:43:08.415054+0000","last_undegraded":"2024-03-30T12:43:08.415054+0000","last_fullsized":"2024-03-30T12:43:08.415054+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:34:16.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016867571000000001,"stat_sum":{"num_bytes":133767168,"num_objects":98,"num_object_clones":93,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":533741,"num_write":789,"num_write_kb":163112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67960832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.a","version":"0'0","reported_seq":1367,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935518+0000","last_change":"2024-03-30T12:27:59.578748+0000","last_active":"2024-03-30T12:41:58.935518+0000","last_peered":"2024-03-30T12:41:58.935518+0000","last_clean":"2024-03-30T12:41:58.935518+0000","last_became_active":"2024-03-30T12:27:59.578379+0000","last_became_peered":"2024-03-30T12:27:59.578379+0000","last_unstale":"2024-03-30T12:41:58.935518+0000","last_undegraded":"2024-03-30T12:41:58.935518+0000","last_fullsized":"2024-03-30T12:41:58.935518+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:35:03.887928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1300,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:42.683883+0000","last_change":"2024-03-30T12:28:33.810786+0000","last_active":"2024-03-30T12:43:42.683883+0000","last_peered":"2024-03-30T12:43:42.683883+0000","last_clean":"2024-03-30T12:43:42.683883+0000","last_became_active":"2024-03-30T12:28:33.810385+0000","last_became_peered":"2024-03-30T12:28:33.810385+0000","last_unstale":"2024-03-30T12:43:42.683883+0000","last_undegraded":"2024-03-30T12:43:42.683883+0000","last_fullsized":"2024-03-30T12:43:42.683883+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:56:30.741552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"864'826","reported_seq":4277,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:33.939063+0000","last_change":"2024-03-30T12:36:01.010622+0000","last_active":"2024-03-30T12:42:33.939063+0000","last_peered":"2024-03-30T12:42:33.939063+0000","last_clean":"2024-03-30T12:42:33.939063+0000","last_became_active":"2024-03-30T12:28:33.809366+0000","last_became_peered":"2024-03-30T12:28:33.809366+0000","last_unstale":"2024-03-30T12:42:33.939063+0000","last_undegraded":"2024-03-30T12:42:33.939063+0000","last_fullsized":"2024-03-30T12:42:33.939063+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:22.607153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039850759999999997,"stat_sum":{"num_bytes":18423808,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":144,"num_read_kb":127994,"num_write":261,"num_write_kb":90792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19488768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"106"},{"start":"1af","length":"1"},{"start":"1b1","length":"2"},{"start":"1b4","length":"a"},{"start":"1c0","length":"2"},{"start":"1c5","length":"1"},{"start":"1cb","length":"1"}]},{"pgid":"2.b","version":"562'3","reported_seq":1156,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159584+0000","last_change":"2024-03-30T12:30:21.091928+0000","last_active":"2024-03-30T12:41:34.159584+0000","last_peered":"2024-03-30T12:41:34.159584+0000","last_clean":"2024-03-30T12:41:34.159584+0000","last_became_active":"2024-03-30T12:30:21.090716+0000","last_became_peered":"2024-03-30T12:30:21.090716+0000","last_unstale":"2024-03-30T12:41:34.159584+0000","last_undegraded":"2024-03-30T12:41:34.159584+0000","last_fullsized":"2024-03-30T12:41:34.159584+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:18:31.836565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1186,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:39.587344+0000","last_change":"2024-03-30T12:29:41.391148+0000","last_active":"2024-03-30T12:42:39.587344+0000","last_peered":"2024-03-30T12:42:39.587344+0000","last_clean":"2024-03-30T12:42:39.587344+0000","last_became_active":"2024-03-30T12:29:41.390073+0000","last_became_peered":"2024-03-30T12:29:41.390073+0000","last_unstale":"2024-03-30T12:42:39.587344+0000","last_undegraded":"2024-03-30T12:42:39.587344+0000","last_fullsized":"2024-03-30T12:42:39.587344+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:02:39.523460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"858'844","reported_seq":5256,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:43:08.414974+0000","last_change":"2024-03-30T12:36:03.017068+0000","last_active":"2024-03-30T12:43:08.414974+0000","last_peered":"2024-03-30T12:43:08.414974+0000","last_clean":"2024-03-30T12:43:08.414974+0000","last_became_active":"2024-03-30T12:29:02.019686+0000","last_became_peered":"2024-03-30T12:29:02.019686+0000","last_unstale":"2024-03-30T12:43:08.414974+0000","last_undegraded":"2024-03-30T12:43:08.414974+0000","last_fullsized":"2024-03-30T12:43:08.414974+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:26:12.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040474969999999997,"stat_sum":{"num_bytes":109379584,"num_objects":73,"num_object_clones":69,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":248,"num_read_kb":229104,"num_write":675,"num_write_kb":119472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7045120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.c","version":"0'0","reported_seq":1334,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:08.415043+0000","last_change":"2024-03-30T12:29:02.015267+0000","last_active":"2024-03-30T12:43:08.415043+0000","last_peered":"2024-03-30T12:43:08.415043+0000","last_clean":"2024-03-30T12:43:08.415043+0000","last_became_active":"2024-03-30T12:29:02.015003+0000","last_became_peered":"2024-03-30T12:29:02.015003+0000","last_unstale":"2024-03-30T12:43:08.415043+0000","last_undegraded":"2024-03-30T12:43:08.415043+0000","last_fullsized":"2024-03-30T12:43:08.415043+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:15.341056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1148,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159619+0000","last_change":"2024-03-30T12:30:21.094047+0000","last_active":"2024-03-30T12:41:34.159619+0000","last_peered":"2024-03-30T12:41:34.159619+0000","last_clean":"2024-03-30T12:41:34.159619+0000","last_became_active":"2024-03-30T12:30:21.090566+0000","last_became_peered":"2024-03-30T12:30:21.090566+0000","last_unstale":"2024-03-30T12:41:34.159619+0000","last_undegraded":"2024-03-30T12:41:34.159619+0000","last_fullsized":"2024-03-30T12:41:34.159619+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:41.459781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"851'456","reported_seq":4813,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:42:33.411213+0000","last_change":"2024-03-30T12:36:03.016990+0000","last_active":"2024-03-30T12:42:33.411213+0000","last_peered":"2024-03-30T12:42:33.411213+0000","last_clean":"2024-03-30T12:42:33.411213+0000","last_became_active":"2024-03-30T12:28:33.801936+0000","last_became_peered":"2024-03-30T12:28:33.801936+0000","last_unstale":"2024-03-30T12:42:33.411213+0000","last_undegraded":"2024-03-30T12:42:33.411213+0000","last_fullsized":"2024-03-30T12:42:33.411213+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":247,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:06:40.591178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055305899999999995,"stat_sum":{"num_bytes":92274688,"num_objects":36,"num_object_clones":34,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":2,"num_read":128,"num_read_kb":221008,"num_write":317,"num_write_kb":93456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"1f"},{"start":"ca","length":"1"}]},{"pgid":"2.d","version":"61'1","reported_seq":1354,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:33.939095+0000","last_change":"2024-03-30T12:28:33.809491+0000","last_active":"2024-03-30T12:42:33.939095+0000","last_peered":"2024-03-30T12:42:33.939095+0000","last_clean":"2024-03-30T12:42:33.939095+0000","last_became_active":"2024-03-30T12:28:33.809162+0000","last_became_peered":"2024-03-30T12:28:33.809162+0000","last_unstale":"2024-03-30T12:42:33.939095+0000","last_undegraded":"2024-03-30T12:42:33.939095+0000","last_fullsized":"2024-03-30T12:42:33.939095+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:04.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1235,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:30.333244+0000","last_change":"2024-03-30T12:29:41.404603+0000","last_active":"2024-03-30T12:42:30.333244+0000","last_peered":"2024-03-30T12:42:30.333244+0000","last_clean":"2024-03-30T12:42:30.333244+0000","last_became_active":"2024-03-30T12:29:41.404290+0000","last_became_peered":"2024-03-30T12:29:41.404290+0000","last_unstale":"2024-03-30T12:42:30.333244+0000","last_undegraded":"2024-03-30T12:42:30.333244+0000","last_fullsized":"2024-03-30T12:42:30.333244+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:28.038159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"864'3883","reported_seq":6746,"reported_epoch":866,"state":"active+clean+snaptrim_error","last_fresh":"2024-03-30T12:43:19.172205+0000","last_change":"2024-03-30T12:36:03.018791+0000","last_active":"2024-03-30T12:43:19.172205+0000","last_peered":"2024-03-30T12:43:19.172205+0000","last_clean":"2024-03-30T12:43:19.172205+0000","last_became_active":"2024-03-30T12:30:21.090476+0000","last_became_peered":"2024-03-30T12:30:21.090476+0000","last_unstale":"2024-03-30T12:43:19.172205+0000","last_undegraded":"2024-03-30T12:43:19.172205+0000","last_fullsized":"2024-03-30T12:43:19.172205+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:22:12.023191+0000","last_clean_scrub_stamp":"2024-03-30T12:22:12.023191+0000","objects_scrubbed":0,"log_size":3883,"log_dups_size":0,"ondisk_log_size":3883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":173,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:01.072450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013797738,"stat_sum":{"num_bytes":69042176,"num_objects":47,"num_object_clones":44,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":205,"num_read_kb":201633,"num_write":391,"num_write_kb":90984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"97","length":"1"},{"start":"99","length":"1"},{"start":"9d","length":"1"},{"start":"a0","length":"2"},{"start":"a8","length":"3f"},{"start":"e8","length":"13"},{"start":"fc","length":"b"},{"start":"108","length":"3"},{"start":"10c","length":"2"},{"start":"10f","length":"4"},{"start":"117","length":"2"},{"start":"11b","length":"2"}]},{"pgid":"2.e","version":"61'2","reported_seq":1340,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:08.415089+0000","last_change":"2024-03-30T12:30:21.055902+0000","last_active":"2024-03-30T12:43:08.415089+0000","last_peered":"2024-03-30T12:43:08.415089+0000","last_clean":"2024-03-30T12:43:08.415089+0000","last_became_active":"2024-03-30T12:30:21.055456+0000","last_became_peered":"2024-03-30T12:30:21.055456+0000","last_unstale":"2024-03-30T12:43:08.415089+0000","last_undegraded":"2024-03-30T12:43:08.415089+0000","last_fullsized":"2024-03-30T12:43:08.415089+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:18:59.433312+0000","last_clean_scrub_stamp":"2024-03-30T12:18:59.433312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:23:49.628536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1163,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:34.159657+0000","last_change":"2024-03-30T12:30:21.091318+0000","last_active":"2024-03-30T12:41:34.159657+0000","last_peered":"2024-03-30T12:41:34.159657+0000","last_clean":"2024-03-30T12:41:34.159657+0000","last_became_active":"2024-03-30T12:30:21.090131+0000","last_became_peered":"2024-03-30T12:30:21.090131+0000","last_unstale":"2024-03-30T12:41:34.159657+0000","last_undegraded":"2024-03-30T12:41:34.159657+0000","last_fullsized":"2024-03-30T12:41:34.159657+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:49:09.641813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1172,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:09.584262+0000","last_change":"2024-03-30T12:29:41.397746+0000","last_active":"2024-03-30T12:42:09.584262+0000","last_peered":"2024-03-30T12:42:09.584262+0000","last_clean":"2024-03-30T12:42:09.584262+0000","last_became_active":"2024-03-30T12:29:41.393809+0000","last_became_peered":"2024-03-30T12:29:41.393809+0000","last_unstale":"2024-03-30T12:42:09.584262+0000","last_undegraded":"2024-03-30T12:42:09.584262+0000","last_fullsized":"2024-03-30T12:42:09.584262+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:34:52.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1335,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.407397+0000","last_change":"2024-03-30T12:29:41.385884+0000","last_active":"2024-03-30T12:41:58.407397+0000","last_peered":"2024-03-30T12:41:58.407397+0000","last_clean":"2024-03-30T12:41:58.407397+0000","last_became_active":"2024-03-30T12:29:41.385559+0000","last_became_peered":"2024-03-30T12:29:41.385559+0000","last_unstale":"2024-03-30T12:41:58.407397+0000","last_undegraded":"2024-03-30T12:41:58.407397+0000","last_fullsized":"2024-03-30T12:41:58.407397+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:05.580770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1242,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:35.340617+0000","last_change":"2024-03-30T12:29:02.024896+0000","last_active":"2024-03-30T12:43:35.340617+0000","last_peered":"2024-03-30T12:43:35.340617+0000","last_clean":"2024-03-30T12:43:35.340617+0000","last_became_active":"2024-03-30T12:29:02.024444+0000","last_became_peered":"2024-03-30T12:29:02.024444+0000","last_unstale":"2024-03-30T12:43:35.340617+0000","last_undegraded":"2024-03-30T12:43:35.340617+0000","last_fullsized":"2024-03-30T12:43:35.340617+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:28:25.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1383,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:00.774774+0000","last_change":"2024-03-30T12:28:33.812299+0000","last_active":"2024-03-30T12:43:00.774774+0000","last_peered":"2024-03-30T12:43:00.774774+0000","last_clean":"2024-03-30T12:43:00.774774+0000","last_became_active":"2024-03-30T12:28:33.811133+0000","last_became_peered":"2024-03-30T12:28:33.811133+0000","last_unstale":"2024-03-30T12:43:00.774774+0000","last_undegraded":"2024-03-30T12:43:00.774774+0000","last_fullsized":"2024-03-30T12:43:00.774774+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:47:47.148770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1299,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:07.679762+0000","last_change":"2024-03-30T12:27:59.580285+0000","last_active":"2024-03-30T12:43:07.679762+0000","last_peered":"2024-03-30T12:43:07.679762+0000","last_clean":"2024-03-30T12:43:07.679762+0000","last_became_active":"2024-03-30T12:27:59.577725+0000","last_became_peered":"2024-03-30T12:27:59.577725+0000","last_unstale":"2024-03-30T12:43:07.679762+0000","last_undegraded":"2024-03-30T12:43:07.679762+0000","last_fullsized":"2024-03-30T12:43:07.679762+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:32:04.596877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1351,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:41:58.935541+0000","last_change":"2024-03-30T12:27:59.574334+0000","last_active":"2024-03-30T12:41:58.935541+0000","last_peered":"2024-03-30T12:41:58.935541+0000","last_clean":"2024-03-30T12:41:58.935541+0000","last_became_active":"2024-03-30T12:27:59.573598+0000","last_became_peered":"2024-03-30T12:27:59.573598+0000","last_unstale":"2024-03-30T12:41:58.935541+0000","last_undegraded":"2024-03-30T12:41:58.935541+0000","last_fullsized":"2024-03-30T12:41:58.935541+0000","mapping_epoch":399,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":400,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:31:38.545836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1180,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:39.587396+0000","last_change":"2024-03-30T12:30:21.082720+0000","last_active":"2024-03-30T12:42:39.587396+0000","last_peered":"2024-03-30T12:42:39.587396+0000","last_clean":"2024-03-30T12:42:39.587396+0000","last_became_active":"2024-03-30T12:30:21.082435+0000","last_became_peered":"2024-03-30T12:30:21.082435+0000","last_unstale":"2024-03-30T12:42:39.587396+0000","last_undegraded":"2024-03-30T12:42:39.587396+0000","last_fullsized":"2024-03-30T12:42:39.587396+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:57:20.993390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1284,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:07.679788+0000","last_change":"2024-03-30T12:28:33.802143+0000","last_active":"2024-03-30T12:43:07.679788+0000","last_peered":"2024-03-30T12:43:07.679788+0000","last_clean":"2024-03-30T12:43:07.679788+0000","last_became_active":"2024-03-30T12:28:33.801796+0000","last_became_peered":"2024-03-30T12:28:33.801796+0000","last_unstale":"2024-03-30T12:43:07.679788+0000","last_undegraded":"2024-03-30T12:43:07.679788+0000","last_fullsized":"2024-03-30T12:43:07.679788+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T12:20:12.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1241,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:00.329894+0000","last_change":"2024-03-30T12:29:02.020881+0000","last_active":"2024-03-30T12:42:00.329894+0000","last_peered":"2024-03-30T12:42:00.329894+0000","last_clean":"2024-03-30T12:42:00.329894+0000","last_became_active":"2024-03-30T12:29:02.020600+0000","last_became_peered":"2024-03-30T12:29:02.020600+0000","last_unstale":"2024-03-30T12:42:00.329894+0000","last_undegraded":"2024-03-30T12:42:00.329894+0000","last_fullsized":"2024-03-30T12:42:00.329894+0000","mapping_epoch":461,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":462,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:28:45.542541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1292,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:42.683856+0000","last_change":"2024-03-30T12:28:33.818027+0000","last_active":"2024-03-30T12:43:42.683856+0000","last_peered":"2024-03-30T12:43:42.683856+0000","last_clean":"2024-03-30T12:43:42.683856+0000","last_became_active":"2024-03-30T12:28:33.817537+0000","last_became_peered":"2024-03-30T12:28:33.817537+0000","last_unstale":"2024-03-30T12:43:42.683856+0000","last_undegraded":"2024-03-30T12:43:42.683856+0000","last_fullsized":"2024-03-30T12:43:42.683856+0000","mapping_epoch":433,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":434,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:18:25.839261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1218,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:30.333212+0000","last_change":"2024-03-30T12:30:21.085006+0000","last_active":"2024-03-30T12:42:30.333212+0000","last_peered":"2024-03-30T12:42:30.333212+0000","last_clean":"2024-03-30T12:42:30.333212+0000","last_became_active":"2024-03-30T12:30:21.081012+0000","last_became_peered":"2024-03-30T12:30:21.081012+0000","last_unstale":"2024-03-30T12:42:30.333212+0000","last_undegraded":"2024-03-30T12:42:30.333212+0000","last_fullsized":"2024-03-30T12:42:30.333212+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:55.453189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1381,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:42:00.768614+0000","last_change":"2024-03-30T12:30:21.071434+0000","last_active":"2024-03-30T12:42:00.768614+0000","last_peered":"2024-03-30T12:42:00.768614+0000","last_clean":"2024-03-30T12:42:00.768614+0000","last_became_active":"2024-03-30T12:30:21.070533+0000","last_became_peered":"2024-03-30T12:30:21.070533+0000","last_unstale":"2024-03-30T12:42:00.768614+0000","last_undegraded":"2024-03-30T12:42:00.768614+0000","last_fullsized":"2024-03-30T12:42:00.768614+0000","mapping_epoch":537,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":538,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:28:13.283904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1186,"reported_epoch":866,"state":"active+clean","last_fresh":"2024-03-30T12:43:09.590494+0000","last_change":"2024-03-30T12:29:41.390777+0000","last_active":"2024-03-30T12:43:09.590494+0000","last_peered":"2024-03-30T12:43:09.590494+0000","last_clean":"2024-03-30T12:43:09.590494+0000","last_became_active":"2024-03-30T12:29:41.390463+0000","last_became_peered":"2024-03-30T12:29:41.390463+0000","last_unstale":"2024-03-30T12:43:09.590494+0000","last_undegraded":"2024-03-30T12:43:09.590494+0000","last_fullsized":"2024-03-30T12:43:09.590494+0000","mapping_epoch":500,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":501,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T12:19:00.437665+0000","last_clean_scrub_stamp":"2024-03-30T12:19:00.437665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:26:57.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1343692800,"num_objects":896,"num_object_clones":846,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":12,"num_read":3644,"num_read_kb":4877955,"num_write":8338,"num_write_kb":1767568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":445177856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1920221184,"data_stored":4470288384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44045,"ondisk_log_size":44045,"up":48,"acting":48,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":998,"num_read_kb":1844,"num_write":351,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6622,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":79,"num_read_kb":87,"num_write":68,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":19866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40874,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":537,"seq":2306397438140,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":411032,"kb_used_data":215428,"kb_used_omap":40,"kb_used_meta":195543,"kb_avail":93334120,"statfs":{"total":95995035648,"available":95574138880,"internally_reserved":0,"allocated":220598272,"data_stored":420881106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41143,"internal_metadata":200236873},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":500,"seq":2147483648196,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":574248,"kb_used_data":168536,"kb_used_omap":30,"kb_used_meta":405665,"kb_avail":93170904,"statfs":{"total":95995035648,"available":95407005696,"internally_reserved":0,"allocated":172580864,"data_stored":355239734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30805,"internal_metadata":415401899},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":331,"seq":1421634175207,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1349648,"kb_used_data":250752,"kb_used_omap":61,"kb_used_meta":1098818,"kb_avail":92395504,"statfs":{"total":95995035648,"available":94612996096,"internally_reserved":0,"allocated":256770048,"data_stored":625934070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62918,"internal_metadata":1125190202},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":298,"seq":1279900254445,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910928,"kb_used_data":363136,"kb_used_omap":137,"kb_used_meta":547638,"kb_avail":92834224,"statfs":{"total":95995035648,"available":95062245376,"internally_reserved":0,"allocated":371851264,"data_stored":914375502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":140443,"internal_metadata":560782181},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":365,"seq":1567663063264,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":454048,"kb_used_data":258952,"kb_used_omap":31,"kb_used_meta":195040,"kb_avail":93291104,"statfs":{"total":95995035648,"available":95530090496,"internally_reserved":0,"allocated":265166848,"data_stored":597487190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31780,"internal_metadata":199721948},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":399,"seq":1713691951321,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1335436,"kb_used_data":165432,"kb_used_omap":22,"kb_used_meta":1169961,"kb_avail":92409716,"statfs":{"total":95995035648,"available":94627549184,"internally_reserved":0,"allocated":169402368,"data_stored":388941182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":1198040942},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":433,"seq":1859720839378,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1380124,"kb_used_data":229256,"kb_used_omap":57,"kb_used_meta":1150790,"kb_avail":92365028,"statfs":{"total":95995035648,"available":94581788672,"internally_reserved":0,"allocated":234758144,"data_stored":497082650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58462,"internal_metadata":1178409890},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":461,"seq":1979979923660,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1277880,"kb_used_data":304228,"kb_used_omap":76,"kb_used_meta":973555,"kb_avail":92467272,"statfs":{"total":95995035648,"available":94686486528,"internally_reserved":0,"allocated":311529472,"data_stored":718796144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78623,"internal_metadata":996920545},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5599,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4248,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4614,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5717,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5756,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4554,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5188,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5198,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361172992,"data_stored":907952128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":246693888,"data_stored":620101632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":255098880,"data_stored":591654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159309824,"data_stored":383102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":224673792,"data_stored":491249664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":301441024,"data_stored":712957952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161902592,"data_stored":348811264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209928192,"data_stored":414457856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T12:45:59.851 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.8 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:59.851 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.3 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:59.851 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.5 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:59.851 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.4 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:59.851 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.7 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:59.851 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.2 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:59.851 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.1 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:59.851 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.f in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:59.851 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.e in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:59.851 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.d in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:59.851 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.b in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:59.851 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.a in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:59.851 INFO:tasks.cephadm.ceph_manager.ceph:pg 5.9 in trimming, state: active+clean+snaptrim_error 2024-03-30T12:45:59.851 INFO:tasks.cephadm.ceph_manager.ceph:unique_pool_0 still trimming, waiting 2024-03-30T12:46:00.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:45:59 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:46:00.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:45:59 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:46:00.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:45:59 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T12:46:01.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:00 smithi084 ceph-mon[91810]: pgmap v1288: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:46:01.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:00 smithi084 ceph-mon[91810]: from='client.34788 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:46:01.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:00 smithi084 ceph-mon[89279]: pgmap v1288: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:46:01.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:00 smithi084 ceph-mon[89279]: from='client.34788 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:46:01.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:00 smithi162 ceph-mon[83709]: pgmap v1288: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:46:01.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:00 smithi162 ceph-mon[83709]: from='client.34788 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T12:46:03.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:02 smithi084 ceph-mon[91810]: pgmap v1289: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:46:03.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:02 smithi084 ceph-mon[89279]: pgmap v1289: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:46:03.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:02 smithi162 ceph-mon[83709]: pgmap v1289: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:46:05.257 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:04 smithi084 ceph-mon[91810]: pgmap v1290: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:46:05.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:04 smithi084 ceph-mon[89279]: pgmap v1290: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:46:05.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:04 smithi162 ceph-mon[83709]: pgmap v1290: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:46:06.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:05 smithi084 ceph-mon[89279]: pgmap v1291: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:46:06.258 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:05 smithi084 ceph-mon[91810]: pgmap v1291: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:46:06.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:05 smithi162 ceph-mon[83709]: pgmap v1291: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:46:08.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:08 smithi162 ceph-mon[83709]: pgmap v1292: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:46:08.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:08 smithi084 ceph-mon[89279]: pgmap v1292: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:46:08.507 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:08 smithi084 ceph-mon[91810]: pgmap v1292: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:46:09.757 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:46:09 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: ::ffff:172.21.15.162 - - [30/Mar/2024:12:46:09] "GET /metrics HTTP/1.1" 200 36328 "" "Prometheus/2.43.0" 2024-03-30T12:46:09.852 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph-c_5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc/qa/tasks/rados.py", line 290, in thread manager.wait_snap_trimming_complete(pool); File "/home/teuthworker/src/github.com_ceph_ceph-c_5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc/qa/tasks/ceph_manager.py", line 2506, in wait_snap_trimming_complete assert (now - start) < FATAL_TIMEOUT, \ AssertionError: failed to complete snap trimming before timeout 2024-03-30T12:46:09.855 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/full_sequential.py", line 37, in task mgr.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc/qa/tasks/rados.py", line 299, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph-c_5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc/qa/tasks/rados.py", line 290, in thread manager.wait_snap_trimming_complete(pool); File "/home/teuthworker/src/github.com_ceph_ceph-c_5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc/qa/tasks/ceph_manager.py", line 2506, in wait_snap_trimming_complete assert (now - start) < FATAL_TIMEOUT, \ AssertionError: failed to complete snap trimming before timeout 2024-03-30T12:46:10.074 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=9106ba89c194425288004af05718eccf Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/full_sequential.py", line 37, in task mgr.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc/qa/tasks/rados.py", line 299, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph-c_5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc/qa/tasks/rados.py", line 290, in thread manager.wait_snap_trimming_complete(pool); File "/home/teuthworker/src/github.com_ceph_ceph-c_5dc2ea3016dcf8ef9e88b80203119d1d5e6f94cc/qa/tasks/ceph_manager.py", line 2506, in wait_snap_trimming_complete assert (now - start) < FATAL_TIMEOUT, \ AssertionError: failed to complete snap trimming before timeout 2024-03-30T12:46:10.078 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-03-30T12:46:10.088 INFO:tasks.cephadm:Teardown begin 2024-03-30T12:46:10.089 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-30T12:46:10.089 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T12:46:10.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:10 smithi162 ceph-mon[83709]: pgmap v1293: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:46:10.433 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:46:10.433 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":54295,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/2413526060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":2413526060},{"type":"v1","addr":"172.21.15.162:6833","nonce":2413526060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T12:19:00.832494+0000","modified":"2024-03-30T12:30:50.087223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":562,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34410":{"gid":34410,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":7,"addr":"172.21.15.84:6835/3803840215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3803840215},{"type":"v1","addr":"172.21.15.84:6835","nonce":3803840215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-30T12:46:10.434 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 14 2024-03-30T12:46:10.445 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:10 smithi084 ceph-mon[91810]: pgmap v1293: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:46:10.445 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:10 smithi084 ceph-mon[89279]: pgmap v1293: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:46:10.446 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T12:46:10.767 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:46:10.767 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":54295,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/2413526060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":2413526060},{"type":"v1","addr":"172.21.15.162:6833","nonce":2413526060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T12:19:00.832494+0000","modified":"2024-03-30T12:30:50.087223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":562,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34410":{"gid":34410,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":7,"addr":"172.21.15.84:6835/3803840215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3803840215},{"type":"v1","addr":"172.21.15.84:6835","nonce":3803840215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-30T12:46:10.767 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 14 2024-03-30T12:46:10.779 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T12:46:11.067 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-03-30T12:46:11.067 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":866,"fsid":"d3450b00-ee8e-11ee-b647-cb9ed24678a4","created":"2024-03-30T12:13:37.956825+0000","modified":"2024-03-30T12:36:03.008662+0000","last_up_change":"2024-03-30T12:30:20.038583+0000","last_in_change":"2024-03-30T12:18:24.854304+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T12:16:43.434051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T12:18:59.012249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T12:18:59.975381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"rbd","create_time":"2024-03-30T12:19:33.989566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"unique_pool_0","create_time":"2024-03-30T12:22:11.282343+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"866","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":466,"snap_epoch":866,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"teuthologyprofile","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"0a5734fa-c269-449c-805f-0a42d3d90120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":286,"up_from":298,"up_thru":537,"down_at":287,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1465604312},{"type":"v1","addr":"172.21.15.84:6803","nonce":1465604312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1465604312},{"type":"v1","addr":"172.21.15.84:6805","nonce":1465604312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1465604312},{"type":"v1","addr":"172.21.15.84:6809","nonce":1465604312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1465604312},{"type":"v1","addr":"172.21.15.84:6807","nonce":1465604312}]},"public_addr":"172.21.15.84:6803/1465604312","cluster_addr":"172.21.15.84:6805/1465604312","heartbeat_back_addr":"172.21.15.84:6809/1465604312","heartbeat_front_addr":"172.21.15.84:6807/1465604312","state":["exists","up"]},{"osd":1,"uuid":"3ffe676e-9055-44f7-8b04-87974b854b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":320,"up_from":331,"up_thru":537,"down_at":321,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3267314044},{"type":"v1","addr":"172.21.15.84:6811","nonce":3267314044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3267314044},{"type":"v1","addr":"172.21.15.84:6813","nonce":3267314044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3267314044},{"type":"v1","addr":"172.21.15.84:6817","nonce":3267314044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3267314044},{"type":"v1","addr":"172.21.15.84:6815","nonce":3267314044}]},"public_addr":"172.21.15.84:6811/3267314044","cluster_addr":"172.21.15.84:6813/3267314044","heartbeat_back_addr":"172.21.15.84:6817/3267314044","heartbeat_front_addr":"172.21.15.84:6815/3267314044","state":["exists","up"]},{"osd":2,"uuid":"c21b4cb6-9ade-44d2-a7ba-33fe9b5dd3fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":18,"last_clean_end":354,"up_from":365,"up_thru":537,"down_at":355,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3020788159},{"type":"v1","addr":"172.21.15.84:6819","nonce":3020788159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3020788159},{"type":"v1","addr":"172.21.15.84:6821","nonce":3020788159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3020788159},{"type":"v1","addr":"172.21.15.84:6825","nonce":3020788159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3020788159},{"type":"v1","addr":"172.21.15.84:6823","nonce":3020788159}]},"public_addr":"172.21.15.84:6819/3020788159","cluster_addr":"172.21.15.84:6821/3020788159","heartbeat_back_addr":"172.21.15.84:6825/3020788159","heartbeat_front_addr":"172.21.15.84:6823/3020788159","state":["exists","up"]},{"osd":3,"uuid":"d60cb7da-fc49-4cbf-855a-2957dcbf66b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":25,"last_clean_end":388,"up_from":399,"up_thru":537,"down_at":389,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":2970863287},{"type":"v1","addr":"172.21.15.84:6827","nonce":2970863287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2970863287},{"type":"v1","addr":"172.21.15.84:6829","nonce":2970863287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":2970863287},{"type":"v1","addr":"172.21.15.84:6833","nonce":2970863287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":2970863287},{"type":"v1","addr":"172.21.15.84:6831","nonce":2970863287}]},"public_addr":"172.21.15.84:6827/2970863287","cluster_addr":"172.21.15.84:6829/2970863287","heartbeat_back_addr":"172.21.15.84:6833/2970863287","heartbeat_front_addr":"172.21.15.84:6831/2970863287","state":["exists","up"]},{"osd":4,"uuid":"46a5087f-cf7c-4bb2-bace-6e04d57496ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":30,"last_clean_end":422,"up_from":433,"up_thru":537,"down_at":423,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2186427236},{"type":"v1","addr":"172.21.15.162:6801","nonce":2186427236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2186427236},{"type":"v1","addr":"172.21.15.162:6803","nonce":2186427236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2186427236},{"type":"v1","addr":"172.21.15.162:6807","nonce":2186427236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2186427236},{"type":"v1","addr":"172.21.15.162:6805","nonce":2186427236}]},"public_addr":"172.21.15.162:6801/2186427236","cluster_addr":"172.21.15.162:6803/2186427236","heartbeat_back_addr":"172.21.15.162:6807/2186427236","heartbeat_front_addr":"172.21.15.162:6805/2186427236","state":["exists","up"]},{"osd":5,"uuid":"2408494e-0472-4cde-aac6-e87d919b6d2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":38,"last_clean_end":445,"up_from":461,"up_thru":537,"down_at":446,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":360140107},{"type":"v1","addr":"172.21.15.162:6809","nonce":360140107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":360140107},{"type":"v1","addr":"172.21.15.162:6811","nonce":360140107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":360140107},{"type":"v1","addr":"172.21.15.162:6815","nonce":360140107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":360140107},{"type":"v1","addr":"172.21.15.162:6813","nonce":360140107}]},"public_addr":"172.21.15.162:6809/360140107","cluster_addr":"172.21.15.162:6811/360140107","heartbeat_back_addr":"172.21.15.162:6815/360140107","heartbeat_front_addr":"172.21.15.162:6813/360140107","state":["exists","up"]},{"osd":6,"uuid":"f86781fa-6cb4-4abd-b759-84ff6d7b36d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":46,"last_clean_end":487,"up_from":500,"up_thru":537,"down_at":488,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1765787761},{"type":"v1","addr":"172.21.15.162:6817","nonce":1765787761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1765787761},{"type":"v1","addr":"172.21.15.162:6819","nonce":1765787761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1765787761},{"type":"v1","addr":"172.21.15.162:6823","nonce":1765787761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1765787761},{"type":"v1","addr":"172.21.15.162:6821","nonce":1765787761}]},"public_addr":"172.21.15.162:6817/1765787761","cluster_addr":"172.21.15.162:6819/1765787761","heartbeat_back_addr":"172.21.15.162:6823/1765787761","heartbeat_front_addr":"172.21.15.162:6821/1765787761","state":["exists","up"]},{"osd":7,"uuid":"49a38087-ec6c-4ae8-b932-9c59ff7d4321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":54,"last_clean_end":516,"up_from":537,"up_thru":537,"down_at":517,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1236604326},{"type":"v1","addr":"172.21.15.162:6825","nonce":1236604326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1236604326},{"type":"v1","addr":"172.21.15.162:6827","nonce":1236604326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1236604326},{"type":"v1","addr":"172.21.15.162:6831","nonce":1236604326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1236604326},{"type":"v1","addr":"172.21.15.162:6829","nonce":1236604326}]},"public_addr":"172.21.15.162:6825/1236604326","cluster_addr":"172.21.15.162:6827/1236604326","heartbeat_back_addr":"172.21.15.162:6831/1236604326","heartbeat_front_addr":"172.21.15.162:6829/1236604326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:15:49.285912+0000","dead_epoch":286},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:14.234967+0000","dead_epoch":320},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:16:39.383506+0000","dead_epoch":354},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:03.790574+0000","dead_epoch":388},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:26.131317+0000","dead_epoch":421},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:17:50.385373+0000","dead_epoch":445},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:14.909835+0000","dead_epoch":487},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T12:18:40.707128+0000","dead_epoch":516}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.1d","mappings":[{"from":4,"to":1}]},{"pgid":"3.24","mappings":[{"from":4,"to":2}]},{"pgid":"3.3e","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.162:6833/1272121665":"2024-03-31T12:30:48.073411+0000","172.21.15.84:0/3399313659":"2024-03-31T12:24:44.608044+0000","172.21.15.84:6801/767773944":"2024-03-31T12:24:44.608044+0000","172.21.15.84:0/1137676737":"2024-03-31T12:24:44.608044+0000","172.21.15.84:0/707854941":"2024-03-31T12:23:24.048347+0000","172.21.15.84:0/2743767955":"2024-03-31T12:19:35.808765+0000","172.21.15.162:0/3370752832":"2024-03-31T12:23:58.950046+0000","172.21.15.162:6834/1232377246":"2024-03-31T12:23:58.950046+0000","172.21.15.84:0/4071895056":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3191408930":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/681092589":"2024-03-31T12:23:24.048347+0000","172.21.15.84:6800/767773944":"2024-03-31T12:24:44.608044+0000","172.21.15.84:6800/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.84:6800/1623350439":"2024-03-31T12:23:24.048347+0000","172.21.15.162:6835/1232377246":"2024-03-31T12:23:58.950046+0000","172.21.15.84:6800/2648486638":"2024-03-31T12:19:35.808765+0000","172.21.15.84:0/2147212239":"2024-03-31T12:19:35.808765+0000","172.21.15.84:6801/3618508568":"2024-03-31T12:14:06.678373+0000","172.21.15.162:0/1545453187":"2024-03-31T12:23:58.950046+0000","172.21.15.162:0/31592453":"2024-03-31T12:23:58.950046+0000","172.21.15.162:0/42775605":"2024-03-31T12:23:58.950046+0000","172.21.15.84:0/2856311587":"2024-03-31T12:23:24.048347+0000","172.21.15.84:0/3135527830":"2024-03-31T12:14:31.125768+0000","172.21.15.162:6832/1272121665":"2024-03-31T12:30:48.073411+0000","172.21.15.84:0/576481138":"2024-03-31T12:23:24.048347+0000","172.21.15.84:6801/1623350439":"2024-03-31T12:23:24.048347+0000","172.21.15.84:0/1433254333":"2024-03-31T12:14:31.125768+0000","172.21.15.84:0/1374515169":"2024-03-31T12:14:31.125768+0000","172.21.15.84:6800/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.84:0/3488008307":"2024-03-31T12:24:44.608044+0000","172.21.15.84:0/1692747755":"2024-03-31T12:19:35.808765+0000","172.21.15.84:0/1390761199":"2024-03-31T12:14:06.678373+0000","172.21.15.84:0/3672833890":"2024-03-31T12:19:35.808765+0000","172.21.15.84:6801/2648486638":"2024-03-31T12:19:35.808765+0000","172.21.15.162:0/839605232":"2024-03-31T12:23:58.950046+0000","172.21.15.84:0/411728501":"2024-03-31T12:24:44.608044+0000","172.21.15.84:0/1700950603":"2024-03-31T12:23:24.048347+0000","172.21.15.84:0/3429332545":"2024-03-31T12:24:44.608044+0000","172.21.15.84:6801/1442696147":"2024-03-31T12:14:31.125768+0000","172.21.15.162:0/3169470970":"2024-03-31T12:23:58.950046+0000","172.21.15.162:0/2095961342":"2024-03-31T12:23:58.950046+0000","172.21.15.84:0/4263306021":"2024-03-31T12:24:44.608044+0000","172.21.15.84:0/729999192":"2024-03-31T12:24:44.608044+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"teuthologyprofile":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":151,"length":1},{"begin":153,"length":1},{"begin":157,"length":1},{"begin":160,"length":2},{"begin":168,"length":262},{"begin":431,"length":1},{"begin":433,"length":2},{"begin":436,"length":10},{"begin":448,"length":2},{"begin":453,"length":1},{"begin":459,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T12:46:11.079 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-30T12:46:11.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:11 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/1050482458' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:46:11.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:11 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/1621748565' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:46:11.401 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:11 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/1050482458' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:46:11.401 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:11 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/1621748565' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:46:11.401 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:11 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/1050482458' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:46:11.401 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:11 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/1621748565' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-30T12:46:11.402 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-30T12:46:11.419 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-30T12:46:11.679 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:46:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:46:11.412+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:46:11.680 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:46:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:46:11.413+0000 7f5d8679f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:46:11.680 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:46:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-a[117098]: -5327> 2024-03-30T12:30:51.171+0000 7fd5c7d38700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-30T12:46:11.680 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:46:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-a[117098]: ignoring --setuser ceph since I am not root 2024-03-30T12:46:11.680 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:46:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-a[117098]: ignoring --setgroup ceph since I am not root 2024-03-30T12:46:11.680 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:46:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-a[117098]: starting mds.a at 2024-03-30T12:46:11.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:46:11.405+0000 7f10ffcf7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-30T12:46:11.681 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:46:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:46:11.413+0000 7f5be48db700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:46:11.682 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:46:11.413+0000 7f9e4a0b1700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:46:11.682 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:46:11.414+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1d0=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be],1d0=[1d0,1cf,1ce,1cd,1cc,1ca,1c9,1c8,1c7,1c6,1c4,1c3,1c2]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:46:11.682 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:46:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:46:11.413+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:46:11.682 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:46:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:46:11.414+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:46:12.007 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:46:11.684+0000 7f1346a3c700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:46:12.008 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:46:11.684+0000 7f1346a3c700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:46:12.008 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:46:11.684+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:46:12.008 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:46:11.684+0000 7f1341a32700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:46:12.008 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:46:11.685+0000 7f1341a32700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:46:12.008 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:11 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:46:11.685+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:46:12.053 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:46:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:46:11.683+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:46:12.053 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:46:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:46:11.683+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:46:12.053 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:46:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:46:11.684+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:46:12.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:12 smithi162 ceph-mon[83709]: pgmap v1294: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:46:12.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:12 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/2219009385' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:46:12.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:12 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/3845625353' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-30T12:46:12.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:12 smithi162 ceph-mon[83709]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-30T12:46:12.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:12 smithi162 ceph-mon[83709]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-30T12:46:12.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:12 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/3845625353' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-03-30T12:46:12.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:12 smithi162 ceph-mon[83709]: osdmap e867: 8 total, 8 up, 8 in 2024-03-30T12:46:12.375 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:12 smithi162 ceph-mon[83709]: fsmap cephfs:0/1 1 up:standby, 1 failed 2024-03-30T12:46:12.375 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:46:12.375 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:12 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:46:12.375 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:46:12.375 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:46:12.375 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:46:12.375 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1d0=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be],1d0=[1d0,1cf,1ce,1cd,1cc,1ca,1c9,1c8,1c7,1c6,1c4,1c3,1c2]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:46:12.376 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:12 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:46:12.376 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:12 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/1149510581' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T12:46:12.418 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[91810]: pgmap v1294: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:46:12.418 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/2219009385' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:46:12.418 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/3845625353' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-30T12:46:12.418 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[91810]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-30T12:46:12.418 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[91810]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-30T12:46:12.418 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/3845625353' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-03-30T12:46:12.419 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[91810]: osdmap e867: 8 total, 8 up, 8 in 2024-03-30T12:46:12.419 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[91810]: fsmap cephfs:0/1 1 up:standby, 1 failed 2024-03-30T12:46:12.419 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:46:12.419 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:46:12.419 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:46:12.419 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:46:12.419 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:46:12.419 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1d0=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be],1d0=[1d0,1cf,1ce,1cd,1cc,1ca,1c9,1c8,1c7,1c6,1c4,1c3,1c2]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:46:12.420 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:46:12.420 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/1149510581' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T12:46:12.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[89279]: pgmap v1294: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:46:12.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/2219009385' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T12:46:12.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/3845625353' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-30T12:46:12.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[89279]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-30T12:46:12.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[89279]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-30T12:46:12.421 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/3845625353' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-03-30T12:46:12.421 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[89279]: osdmap e867: 8 total, 8 up, 8 in 2024-03-30T12:46:12.421 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[89279]: fsmap cephfs:0/1 1 up:standby, 1 failed 2024-03-30T12:46:12.421 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:46:12.421 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:46:12.421 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:46:12.421 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:46:12.421 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:46:12.422 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1d0=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be],1d0=[1d0,1cf,1ce,1cd,1cc,1ca,1c9,1c8,1c7,1c6,1c4,1c3,1c2]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:46:12.422 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:46:12.422 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:12 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/1149510581' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T12:46:12.423 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-30T12:46:13.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:46:13.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:46:13.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:46:13.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:13 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:46:13.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:46:13.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:13 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:46:13.374 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:13 smithi162 ceph-mon[83709]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-30T12:46:13.375 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:13 smithi162 ceph-mon[83709]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-30T12:46:13.375 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:13 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/1149510581' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-03-30T12:46:13.375 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:13 smithi162 ceph-mon[83709]: mds.? [v2:172.21.15.84:6834/742252382,v1:172.21.15.84:6835/742252382] up:boot 2024-03-30T12:46:13.375 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:13 smithi162 ceph-mon[83709]: fsmap 2 up:standby 2024-03-30T12:46:13.375 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:13 smithi162 ceph-mon[83709]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-30T12:46:13.375 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:13 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/1998364137' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T12:46:13.375 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:13 smithi162 ceph-mon[83709]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T12:46:13.412 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2024-03-30T12:46:13.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:46:13.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:46:13.427 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:46:13.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:46:13.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:46:13.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:46:13.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[91810]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-30T12:46:13.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[91810]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-30T12:46:13.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/1149510581' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-03-30T12:46:13.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[91810]: mds.? [v2:172.21.15.84:6834/742252382,v1:172.21.15.84:6835/742252382] up:boot 2024-03-30T12:46:13.428 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[91810]: fsmap 2 up:standby 2024-03-30T12:46:13.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[91810]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-30T12:46:13.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/1998364137' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T12:46:13.429 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[91810]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T12:46:13.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:46:13.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:46:13.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:46:13.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:46:13.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:46:13.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:46:13.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[89279]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-30T12:46:13.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[89279]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-30T12:46:13.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/1149510581' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-03-30T12:46:13.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[89279]: mds.? [v2:172.21.15.84:6834/742252382,v1:172.21.15.84:6835/742252382] up:boot 2024-03-30T12:46:13.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[89279]: fsmap 2 up:standby 2024-03-30T12:46:13.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[89279]: from='mgr.34101 172.21.15.84:0/3124811017' entity='mgr.y' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-30T12:46:13.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/1998364137' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T12:46:13.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-mon[89279]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T12:46:13.432 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-30T12:46:13.713 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:46:13.415+0000 7f9e4c8b6700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1d0=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be],1d0=[1d0,1cf,1ce,1cd,1cc,1ca,1c9,1c8,1c7,1c6,1c4,1c3,1c2]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:46:13.713 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:46:13.415+0000 7f9e4e0b9700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e3 after trimming was started 2024-03-30T12:46:13.713 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:46:13.416+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:46:13.714 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:46:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:46:13.419+0000 7f9dcce65700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:46:13.714 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:46:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:46:13.422+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:46:13.757 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:46:13.597+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:46:13.757 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:46:13.597+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:46:13.758 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:46:13.598+0000 7f1341231700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:46:13.758 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:46:13.598+0000 7f1344237700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:46:13.758 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:46:13.598+0000 7f1344237700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:46:14.123 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:46:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:46:13.715+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:46:14.124 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:46:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:46:13.861+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:46:14.124 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:46:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:46:13.863+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:46:14.257 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:46:13.864+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:46:14.257 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:46:13 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:46:13.864+0000 7f5d83799700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:46:14.424 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2024-03-30T12:46:14.433 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:46:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:46:14.426+0000 7f5be08d3700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:46:14.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:14 smithi162 ceph-mon[83709]: pgmap v1296: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:46:14.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:14 smithi162 ceph-mon[83709]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-03-30T12:46:14.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:14 smithi162 ceph-mon[83709]: osdmap e868: 8 total, 8 up, 8 in 2024-03-30T12:46:14.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1d0=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be],1d0=[1d0,1cf,1ce,1cd,1cc,1ca,1c9,1c8,1c7,1c6,1c4,1c3,1c2]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:46:14.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:46:14.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:46:14.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:46:14.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:46:14.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:46:14.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:46:14.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:46:14.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:14 smithi162 ceph-mon[83709]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:46:14.436 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:14 smithi162 ceph-mon[83709]: from='client.? 172.21.15.84:0/2299257871' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T12:46:14.436 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:14 smithi162 ceph-mon[83709]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T12:46:14.436 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:46:14.436 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:14 smithi162 ceph-mon[83709]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:46:14.439 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-30T12:46:14.468 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-30T12:46:14.500 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-03-30T12:46:14.500 DEBUG:teuthology.orchestra.run.smithi084:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-30T12:46:14.523 DEBUG:teuthology.orchestra.run.smithi162:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-30T12:46:14.556 INFO:tasks.cephadm:Stopping all daemons... 2024-03-30T12:46:14.556 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-03-30T12:46:14.556 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mon.a 2024-03-30T12:46:14.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[91810]: pgmap v1296: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:46:14.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[91810]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-03-30T12:46:14.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[91810]: osdmap e868: 8 total, 8 up, 8 in 2024-03-30T12:46:14.758 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1d0=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be],1d0=[1d0,1cf,1ce,1cd,1cc,1ca,1c9,1c8,1c7,1c6,1c4,1c3,1c2]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:46:14.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:46:14.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:46:14.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:46:14.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:46:14.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:46:14.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:46:14.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:46:14.759 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[91810]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:46:14.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[89279]: pgmap v1296: 121 pgs: 108 active+clean, 13 active+clean+snaptrim_error; 1.3 GiB data, 7.3 GiB used, 708 GiB / 715 GiB avail 2024-03-30T12:46:14.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[89279]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-03-30T12:46:14.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[89279]: osdmap e868: 8 total, 8 up, 8 in 2024-03-30T12:46:14.760 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1d0=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be],1d0=[1d0,1cf,1ce,1cd,1cc,1ca,1c9,1c8,1c7,1c6,1c4,1c3,1c2]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:46:14.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:46:14.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:46:14.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:46:14.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:46:14.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:46:14.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:46:14.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:46:14.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[89279]: No clone_snaps in snapset 1c7=[]:{100=[fb],110=[110,10f,10e],12a=[12a,129,128],12e=[12e,12d,12c],132=[132],144=[144,143,141,140,13f,13e,13d],147=[147,146,145],14b=[14b,14a],169=[169,168,167,166,163],177=[177,176,175,174,172,170,16e,16b,16a],17f=[17f,17e,17a,179,178],183=[183],185=[185,184],18f=[18f,18e,18d,18c,188,187],190=[190],1b7=[1b7,1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0,19c,193],1ba=[1ba,1b9,1b8],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:40a828f9:::smithi08477944-10:f6 2024-03-30T12:46:14.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[89279]: from='client.? 172.21.15.84:0/2299257871' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T12:46:14.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[89279]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T12:46:14.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:46:14.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[89279]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:46:14.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:14 smithi084 systemd[1]: Stopping Ceph mon.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:46:14.762 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[91810]: from='client.? 172.21.15.84:0/2299257871' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T12:46:14.763 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[91810]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T12:46:14.763 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:46:14.763 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-mon[91810]: trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:46:14.873 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:46:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:46:14.433+0000 7f9dc8e5d700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{111=[10e,10b],11f=[11f,11e,11d,11a,119,116,115,114,113],120=[120],12b=[12b,12a,129,128,127,126,125,122],12d=[12d,12c],12f=[12f,12e],135=[135],137=[137],13b=[13b,13a,138],14a=[14a,149,148,147,145,144,143,141,140,13d],14f=[14f,14e,14d,14c],152=[152,151,150],154=[154],161=[161],16d=[16d,16b,16a,169,163],18a=[18a,189,188,187,186,185,184,183,180,178,177],193=[193,192,191,190,18f,18e,18d],195=[195,194]} for object 5:92aec2e7:::smithi08477944-12:ee 2024-03-30T12:46:14.873 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:46:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:46:14.434+0000 7f9dc765a700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c9=[]:{116=[10e],124=[124,123,122,121,11f,11e,11d,11a],126=[126,125],132=[12f,12b],144=[144,143,141,140,13f,13e,13d],14b=[14b,14a,149,148,147,145],14f=[14f,14e,14d,14c],152=[152,151,150],157=[157,156,155,154,153],159=[159,158],16a=[16a,169,168,167,166,163,162],16d=[16d,16b],188=[188,187,186,185,184,183,180,17f,17e,178,177,172,16e],192=[192,191,190,18f,18e,18d,18c],19c=[19c,19b,19a,199,198,196,194,193],1a2=[1a2,1a0,19e],1c9=[1c9,1c8,1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:20369991:::smithi08477944-5:f9 2024-03-30T12:46:15.182 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:46:14] ENGINE Bus STOPPING 2024-03-30T12:46:15.183 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:46:14] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T12:46:15.183 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:46:14] ENGINE Bus STOPPED 2024-03-30T12:46:15.183 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:46:14] ENGINE Bus STARTING 2024-03-30T12:46:15.183 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:46:14] ENGINE Serving on http://:::9283 2024-03-30T12:46:15.183 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:46:14] ENGINE Bus STARTED 2024-03-30T12:46:15.183 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:46:14.873+0000 7f1105502700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:46:15.184 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a[89275]: 2024-03-30T12:46:14.873+0000 7f1105502700 -1 mon.a@0(leader) e4 *** Got Signal Terminated *** 2024-03-30T12:46:15.184 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:14 smithi084 podman[139696]: 2024-03-30 12:46:14.934269191 +0000 UTC m=+0.184819584 container died a0811f2ae47df6b863f8534b406e5853d9c81b6e3cdf859cb5bffd684a8776ff (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, ceph=True) 2024-03-30T12:46:15.373 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:46:15.184+0000 7f9e4e0b9700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c5=[]:{fb=[fb,fa,f9,f7,f5,f4,f0,ed],fc=[fc],ff=[ff,fe,fd],103=[103,102,101],105=[105,104],10c=[10c,10b,109,108,107,106],118=[118,117],119=[119],12d=[12d,12c,12b],15b=[15b,15a,158,156,155,153,150],15d=[15d,15c],165=[163,162],17e=[17e,17d],17f=[17f],183=[183],1a2=[1a2],1ac=[1ac,1aa,1a9,1a8,1a6,1a4],1ad=[1ad],1b2=[1b2,1b1,1b0,1af,1ae],1b5=[1b3],1bc=[1bc,1bb,1ba,1b9,1b8,1b6],1c5=[1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:75e7add2:::smithi08477944-21:eb 2024-03-30T12:46:15.374 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:46:15.186+0000 7f9e508be700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1d0=[]:{f7=[f7,f6,f5,f4,f3,f2,f1,f0,ed,eb,ea],109=[109,108,107,106,105,103,101,ff,fe,fb],132=[12f,125,11e],13b=[13b,13a,138,137],154=[154,153,151,150],186=[186,185,184,183,180,17f,17e,178,177,172,16e,16b,163],19c=[19c,19b,199,198,196,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2,1a0],1b5=[1b3,1b2,1b0,1af,1ae],1c1=[1c1,1c0,1bf,1be],1d0=[1d0,1cf,1ce,1cd,1cc,1ca,1c9,1c8,1c7,1c6,1c4,1c3,1c2]} for object 5:82d285e4:::smithi08477944-6:e9 2024-03-30T12:46:15.374 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:46:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:46:14.946+0000 7f830334b700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap e5 after trimming was started 2024-03-30T12:46:15.374 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:46:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:46:14.946+0000 7f830334b700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c2=[]:{101=[101,ff,fe,fd,fc,fb,fa,f9,f7,f4,ed],11c=[11c,11b,11a,119,118,117,116,115,114,113,112,110,10f,10e,10c,10b,107],124=[124,123,122,121,11f,11e,11d],13b=[13b,13a,138,137],14b=[14b,14a,148,147,145,144],14f=[14f,14e],151=[151,150],15d=[15d,15c,15b,156,153],161=[161],164=[164,163,162],16f=[16f,16e,16b],17a=[17a,179,178,177,176,174,172,170],184=[184,183,180,17f,17e],185=[185],19c=[19c,19b,19a,199,198,196,194,193,18d],1b6=[1b6,1b3,1b2,1b0,1af,1ae,1a2,1a0],1bc=[1bc,1bb,1ba,1b9,1b8],1c2=[1c2,1c1,1c0,1bf,1be]} for object 5:f0048c79:::smithi08477944-13:ec 2024-03-30T12:46:15.374 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:46:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:46:14.946+0000 7f8307353700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1bd=[]:{10c=[10c,10b,109,108,107,106,105,103,101,ff,fe,fb,f7,f4],11f=[11f,11e,11d,11b,11a,119,117,116,115,114,113,10f,10e],132=[132,131],146=[146,145,144,143,141,140,13f,13e,13d],148=[148,147],14b=[14b,14a,149],14d=[14d,14c],15d=[15d,15c,15b],18c=[18c,188,187],199=[199,198,196,195,194,193,18d],1ac=[1ac,1aa,1a9,1a8,1a6,1a4,1a2],1b1=[1b1,1b0,1af,1ae,1ad],1bd=[1bd,1bc,1ba,1b8,1b6,1b3]} for object 5:e405912d:::smithi08477944-3:ed 2024-03-30T12:46:15.507 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:46:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:46:15.191+0000 7f5d877a1700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:c4ecc257:::smithi08477944-17:9a repair needed (no obc) 2024-03-30T12:46:15.507 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:46:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:46:15.193+0000 7f5d82797700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:a6b30f34:::smithi08477944-36:a0 repair needed (no obc) 2024-03-30T12:46:15.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:15 smithi084 podman[139696]: 2024-03-30 12:46:15.389684059 +0000 UTC m=+0.640234484 container cleanup a0811f2ae47df6b863f8534b406e5853d9c81b6e3cdf859cb5bffd684a8776ff (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T12:46:15.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Mar 30 12:46:15 smithi084 bash[139696]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-a 2024-03-30T12:46:15.508 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:46:15.187+0000 7f1342a34700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:46:15.508 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:46:15.187+0000 7f1342a34700 -1 log_channel(cluster) log [ERR] : No clone_snaps in snapset 1c7=[]:{cb=[cb],d4=[d4,d3,d2,d0,ce,cd,cc],103=[103,102,101],116=[116,115,114,113,112],126=[126,125,124,122,121,11f,11e,11a],12e=[12e,12d,12c,12b,12a,129,128,127],132=[132,12f],136=[136,135],13d=[13d],147=[147,146,145,144,143,141,140,13f,13e],14b=[14b,14a,148],159=[159,158,157],15c=[15c,15b],18a=[189,188,187,186,185],19f=[19f,19e,19c,19b],1b1=[1b1,1b0,1af,1ae,1ad,1ac,1a8,1a4,1a2,1a0],1bb=[1bb,1ba,1b9,1b8,1b6,1b3,1b2],1c7=[1c7,1c6,1c5,1c4,1c3,1c2,1c0,1bf,1be]} for object 5:1f1ce0b4:::smithi08477944-7:ca 2024-03-30T12:46:15.508 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:46:15.187+0000 7f1345239700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:d602921a:::smithi08477944-28:ca repair needed (no obc) 2024-03-30T12:46:15.509 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:46:15.188+0000 7f134022f700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:ba8bf6d7:::smithi08477944-18:ca repair needed (no obc) 2024-03-30T12:46:15.509 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:46:15.188+0000 7f1345a3a700 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap c7 after trimming was started 2024-03-30T12:46:15.509 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:15 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:46:15.188+0000 7f1345a3a700 -1 log_channel(cluster) log [ERR] : trim_object: Can not trim 5:54568f59:::smithi08477944-30:c7 repair needed (no obc) 2024-03-30T12:46:16.064 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mon.a.service' 2024-03-30T12:46:16.111 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T12:46:16.111 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-03-30T12:46:16.112 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-03-30T12:46:16.112 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mon.c 2024-03-30T12:46:16.423 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:16 smithi084 systemd[1]: Stopping Ceph mon.c for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:46:16.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-c[91806]: 2024-03-30T12:46:16.428+0000 7f8712044700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:46:16.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-c[91806]: 2024-03-30T12:46:16.428+0000 7f8712044700 -1 mon.c@2(peon) e4 *** Got Signal Terminated *** 2024-03-30T12:46:16.756 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:16 smithi084 podman[139832]: 2024-03-30 12:46:16.489311137 +0000 UTC m=+0.193515852 container died f79eca93cddd9abe90ae55c3022e5d05a733f3e02d80e1b088a09f3c6b20ae85 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:46:16.757 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:46:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:46:16] ENGINE Bus STOPPING 2024-03-30T12:46:16.757 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:46:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:46:16] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T12:46:16.757 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:46:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:46:16] ENGINE Bus STOPPED 2024-03-30T12:46:16.757 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:46:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:46:16] ENGINE Bus STARTING 2024-03-30T12:46:16.757 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:46:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:46:16] ENGINE Serving on http://:::9283 2024-03-30T12:46:16.757 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:46:16 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: [30/Mar/2024:12:46:16] ENGINE Bus STARTED 2024-03-30T12:46:17.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:16 smithi084 podman[139832]: 2024-03-30 12:46:16.8693451 +0000 UTC m=+0.573549811 container cleanup f79eca93cddd9abe90ae55c3022e5d05a733f3e02d80e1b088a09f3c6b20ae85 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-c, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-03-30T12:46:17.007 INFO:journalctl@ceph.mon.c.smithi084.stdout:Mar 30 12:46:16 smithi084 bash[139832]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-c 2024-03-30T12:46:17.242 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mon.c.service' 2024-03-30T12:46:17.278 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T12:46:17.278 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-03-30T12:46:17.278 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-03-30T12:46:17.279 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mon.b 2024-03-30T12:46:17.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:17 smithi162 systemd[1]: Stopping Ceph mon.b for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:46:18.055 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-b[83705]: 2024-03-30T12:46:17.659+0000 7f59ec782700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:46:18.056 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-b[83705]: 2024-03-30T12:46:17.659+0000 7f59ec782700 -1 mon.b@1(peon) e4 *** Got Signal Terminated *** 2024-03-30T12:46:18.056 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:17 smithi162 podman[125766]: 2024-03-30 12:46:17.772266531 +0000 UTC m=+0.297584761 container died 149ae6649e0c574a1f1db7826e9c70277f61a3d34a743ad4a10dcc252a8ad511 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-b, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-03-30T12:46:18.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:18 smithi162 podman[125766]: 2024-03-30 12:46:18.251572051 +0000 UTC m=+0.776890262 container cleanup 149ae6649e0c574a1f1db7826e9c70277f61a3d34a743ad4a10dcc252a8ad511 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-03-30T12:46:18.373 INFO:journalctl@ceph.mon.b.smithi162.stdout:Mar 30 12:46:18 smithi162 bash[125766]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mon-b 2024-03-30T12:46:18.609 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mon.b.service' 2024-03-30T12:46:18.659 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T12:46:18.660 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-03-30T12:46:18.660 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-03-30T12:46:18.660 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mgr.y 2024-03-30T12:46:18.968 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:46:18 smithi084 systemd[1]: Stopping Ceph mgr.y for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:46:19.252 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:46:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:46:18.973+0000 7f1f94b51700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:46:19.252 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:46:18 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y[80702]: 2024-03-30T12:46:18.973+0000 7f1f94b51700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-03-30T12:46:19.252 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:46:19 smithi084 podman[139964]: 2024-03-30 12:46:19.004738952 +0000 UTC m=+0.147448350 container died 9a2aba19dffcdf4dfd9b047d4513c92d321ee672d0a261227650944062c61c58 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux ) 2024-03-30T12:46:19.507 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:46:19 smithi084 podman[139964]: 2024-03-30 12:46:19.331676986 +0000 UTC m=+0.474386382 container cleanup 9a2aba19dffcdf4dfd9b047d4513c92d321ee672d0a261227650944062c61c58 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3) 2024-03-30T12:46:19.507 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Mar 30 12:46:19 smithi084 bash[139964]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-y 2024-03-30T12:46:19.745 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mgr.y.service' 2024-03-30T12:46:19.781 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T12:46:19.781 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-03-30T12:46:19.781 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-03-30T12:46:19.781 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mgr.x 2024-03-30T12:46:20.099 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:46:19 smithi162 systemd[1]: Stopping Ceph mgr.x for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:46:20.360 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:46:20 smithi162 podman[125889]: 2024-03-30 12:46:20.104227399 +0000 UTC m=+0.132148504 container died eec968f3fcc609a858442d5cf320c1f3925b2448b868d2f76a308c2f3b37fcd8 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-03-30T12:46:20.507 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:46:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:46:20.178Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused" 2024-03-30T12:46:20.507 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:46:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:46:20.178Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:46:20.623 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:46:20 smithi162 podman[125889]: 2024-03-30 12:46:20.43951279 +0000 UTC m=+0.467433889 container cleanup eec968f3fcc609a858442d5cf320c1f3925b2448b868d2f76a308c2f3b37fcd8 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x, GIT_CLEAN=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T12:46:20.624 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Mar 30 12:46:20 smithi162 bash[125889]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mgr-x 2024-03-30T12:46:20.853 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mgr.x.service' 2024-03-30T12:46:20.892 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T12:46:20.892 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-03-30T12:46:20.892 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-03-30T12:46:20.892 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.0 2024-03-30T12:46:21.196 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:46:20 smithi084 systemd[1]: Stopping Ceph osd.0 for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:46:21.507 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:46:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:46:21.202+0000 7f5da01d7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:46:21.508 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:46:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:46:21.202+0000 7f5da01d7700 -1 osd.0 869 *** Got signal Terminated *** 2024-03-30T12:46:21.508 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:46:21 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0[97220]: 2024-03-30T12:46:21.202+0000 7f5da01d7700 -1 osd.0 869 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T12:46:24.757 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:46:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:46:24.494Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused" 2024-03-30T12:46:24.758 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:46:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:46:24.495Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:46:27.222 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:46:26 smithi084 podman[140084]: 2024-03-30 12:46:26.934543882 +0000 UTC m=+5.849688732 container died c91eea4f8484a882462e101dfbee98de22970be73fb19f046a4b0074b175a355 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-03-30T12:46:27.482 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:46:27 smithi084 podman[140084]: 2024-03-30 12:46:27.467450602 +0000 UTC m=+6.382595474 container cleanup c91eea4f8484a882462e101dfbee98de22970be73fb19f046a4b0074b175a355 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-03-30T12:46:27.482 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:46:27 smithi084 bash[140084]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0 2024-03-30T12:46:28.007 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:46:27 smithi084 podman[140113]: 2024-03-30 12:46:27.669840996 +0000 UTC m=+0.736134625 container remove c91eea4f8484a882462e101dfbee98de22970be73fb19f046a4b0074b175a355 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T12:46:28.325 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:46:28 smithi084 podman[140205]: 2024-03-30 12:46:27.982744516 +0000 UTC m=+0.017669299 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:46:28.326 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:46:28 smithi084 podman[140205]: 2024-03-30 12:46:28.112349979 +0000 UTC m=+0.147274738 container create e637eeca2018a9f6c8cbe6462515f57f56da488dcf2f224109015bb8465ddbbe (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-03-30T12:46:28.618 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:46:28 smithi084 podman[140205]: 2024-03-30 12:46:28.331305293 +0000 UTC m=+0.366230057 container init e637eeca2018a9f6c8cbe6462515f57f56da488dcf2f224109015bb8465ddbbe (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-03-30T12:46:28.619 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:46:28 smithi084 podman[140205]: 2024-03-30 12:46:28.334369159 +0000 UTC m=+0.369293920 container start e637eeca2018a9f6c8cbe6462515f57f56da488dcf2f224109015bb8465ddbbe (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.build-date=20240326) 2024-03-30T12:46:28.619 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:46:28 smithi084 podman[140205]: 2024-03-30 12:46:28.44850534 +0000 UTC m=+0.483430115 container attach e637eeca2018a9f6c8cbe6462515f57f56da488dcf2f224109015bb8465ddbbe (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:46:28.962 INFO:journalctl@ceph.osd.0.smithi084.stdout:Mar 30 12:46:28 smithi084 podman[140205]: 2024-03-30 12:46:28.623814188 +0000 UTC m=+0.658738957 container died e637eeca2018a9f6c8cbe6462515f57f56da488dcf2f224109015bb8465ddbbe (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326) 2024-03-30T12:46:29.353 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.0.service' 2024-03-30T12:46:29.393 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T12:46:29.393 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-03-30T12:46:29.393 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-03-30T12:46:29.393 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.1 2024-03-30T12:46:29.708 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:46:29 smithi084 systemd[1]: Stopping Ceph osd.1 for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:46:30.007 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:46:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1[101951]: 2024-03-30T12:46:29.712+0000 7f4981888700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:46:30.008 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:46:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1[101951]: 2024-03-30T12:46:29.712+0000 7f4981888700 -1 osd.1 869 *** Got signal Terminated *** 2024-03-30T12:46:30.008 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:46:29 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1[101951]: 2024-03-30T12:46:29.712+0000 7f4981888700 -1 osd.1 869 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T12:46:30.507 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:46:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:46:30.177Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:46:30.508 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:46:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:46:30.178Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused" 2024-03-30T12:46:30.508 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:46:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:46:30.178Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:46:32.374 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:46:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:46:32.061Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.84:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.84:8765: connect: connection refused" 2024-03-30T12:46:32.374 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:46:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:46:32.066Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=nvmeof msg="Unable to refresh target groups" err="Get \"http://172.21.15.84:8765/sd/prometheus/sd-config?service=nvmeof\": dial tcp 172.21.15.84:8765: connect: connection refused" 2024-03-30T12:46:32.374 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:46:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:46:32.066Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.84:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.84:8765: connect: connection refused" 2024-03-30T12:46:32.374 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:46:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:46:32.066Z caller=refresh.go:99 level=error component="discovery manager notify" discovery=http config=config-0 msg="Unable to refresh target groups" err="Get \"http://172.21.15.84:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.84:8765: connect: connection refused" 2024-03-30T12:46:32.375 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:46:32 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:46:32.066Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=node msg="Unable to refresh target groups" err="Get \"http://172.21.15.84:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.84:8765: connect: connection refused" 2024-03-30T12:46:34.758 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:46:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:46:34.495Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:46:34.758 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:46:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:46:34.496Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused" 2024-03-30T12:46:34.758 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:46:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:46:34.496Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:46:35.500 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:46:35 smithi084 podman[140314]: 2024-03-30 12:46:35.218789517 +0000 UTC m=+5.605721794 container died 7518832f6b4a391e2435e2e75922ddfc415518e90fe1f1ea857527acb77b0499 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True) 2024-03-30T12:46:35.757 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:46:35 smithi084 podman[140314]: 2024-03-30 12:46:35.613379117 +0000 UTC m=+6.000311392 container cleanup 7518832f6b4a391e2435e2e75922ddfc415518e90fe1f1ea857527acb77b0499 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326) 2024-03-30T12:46:35.758 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:46:35 smithi084 bash[140314]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1 2024-03-30T12:46:36.215 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:46:35 smithi084 podman[140331]: 2024-03-30 12:46:35.880376016 +0000 UTC m=+0.654793277 container remove 7518832f6b4a391e2435e2e75922ddfc415518e90fe1f1ea857527acb77b0499 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326) 2024-03-30T12:46:36.470 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:46:36 smithi084 podman[140423]: 2024-03-30 12:46:36.123660723 +0000 UTC m=+0.018035823 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:46:36.471 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:46:36 smithi084 podman[140423]: 2024-03-30 12:46:36.240594699 +0000 UTC m=+0.134969800 container create 83d68dabb906051a16a94a3c4836dc1713c328a4a6957a409c593667d7237356 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1-deactivate, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:46:36.755 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:46:36 smithi084 podman[140423]: 2024-03-30 12:46:36.476069179 +0000 UTC m=+0.370444280 container init 83d68dabb906051a16a94a3c4836dc1713c328a4a6957a409c593667d7237356 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1-deactivate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-03-30T12:46:36.755 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:46:36 smithi084 podman[140423]: 2024-03-30 12:46:36.479202138 +0000 UTC m=+0.373577242 container start 83d68dabb906051a16a94a3c4836dc1713c328a4a6957a409c593667d7237356 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1-deactivate, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T12:46:36.755 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:46:36 smithi084 podman[140423]: 2024-03-30 12:46:36.551153839 +0000 UTC m=+0.445528940 container attach 83d68dabb906051a16a94a3c4836dc1713c328a4a6957a409c593667d7237356 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1-deactivate, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326) 2024-03-30T12:46:37.007 INFO:journalctl@ceph.osd.1.smithi084.stdout:Mar 30 12:46:36 smithi084 podman[140423]: 2024-03-30 12:46:36.761225854 +0000 UTC m=+0.655600958 container died 83d68dabb906051a16a94a3c4836dc1713c328a4a6957a409c593667d7237356 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3) 2024-03-30T12:46:37.347 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.1.service' 2024-03-30T12:46:37.388 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T12:46:37.388 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-03-30T12:46:37.388 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-03-30T12:46:37.388 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.2 2024-03-30T12:46:37.719 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:37 smithi084 systemd[1]: Stopping Ceph osd.2 for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:46:38.007 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:46:37.722+0000 7f135dc6f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:46:38.008 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:46:37.722+0000 7f135dc6f700 -1 osd.2 869 *** Got signal Terminated *** 2024-03-30T12:46:38.008 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:37 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2[106984]: 2024-03-30T12:46:37.722+0000 7f135dc6f700 -1 osd.2 869 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T12:46:40.508 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:46:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:46:40.178Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:46:40.508 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:46:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:46:40.179Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused" 2024-03-30T12:46:40.508 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:46:40 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:46:40.179Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:46:43.509 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:43 smithi084 podman[140531]: 2024-03-30 12:46:43.219220692 +0000 UTC m=+5.609093672 container died 647dd862762d15ac87205b69aafe05003cc671720aa4bd6a7f511cc71402646f (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T12:46:43.920 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:43 smithi084 podman[140531]: 2024-03-30 12:46:43.640225718 +0000 UTC m=+6.030098743 container cleanup 647dd862762d15ac87205b69aafe05003cc671720aa4bd6a7f511cc71402646f (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-03-30T12:46:43.920 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:43 smithi084 bash[140531]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2 2024-03-30T12:46:44.257 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:43 smithi084 podman[140548]: 2024-03-30 12:46:43.924889622 +0000 UTC m=+0.699788355 container remove 647dd862762d15ac87205b69aafe05003cc671720aa4bd6a7f511cc71402646f (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-03-30T12:46:44.731 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:46:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:46:44.496Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:46:44.731 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:46:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:46:44.497Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused" 2024-03-30T12:46:44.731 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:46:44 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:46:44.498Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:46:44.732 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:44 smithi084 podman[140638]: 2024-03-30 12:46:44.312093882 +0000 UTC m=+0.017961897 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:46:44.732 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:44 smithi084 podman[140638]: 2024-03-30 12:46:44.41729471 +0000 UTC m=+0.123162722 container create 3ac117856023a67e3423f6cef67682fac9c34d109e615b03db4f48703afa21a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, io.buildah.version=1.33.5) 2024-03-30T12:46:44.732 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:44 smithi084 podman[140638]: 2024-03-30 12:46:44.653052842 +0000 UTC m=+0.358920854 container init 3ac117856023a67e3423f6cef67682fac9c34d109e615b03db4f48703afa21a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240326, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-03-30T12:46:44.732 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:44 smithi084 podman[140638]: 2024-03-30 12:46:44.656025966 +0000 UTC m=+0.361893980 container start 3ac117856023a67e3423f6cef67682fac9c34d109e615b03db4f48703afa21a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2-deactivate, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-03-30T12:46:44.732 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:44 smithi084 podman[140638]: 2024-03-30 12:46:44.736284399 +0000 UTC m=+0.442152430 container attach 3ac117856023a67e3423f6cef67682fac9c34d109e615b03db4f48703afa21a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-03-30T12:46:45.008 INFO:journalctl@ceph.osd.2.smithi084.stdout:Mar 30 12:46:44 smithi084 podman[140638]: 2024-03-30 12:46:44.945720586 +0000 UTC m=+0.651588590 container died 3ac117856023a67e3423f6cef67682fac9c34d109e615b03db4f48703afa21a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, CEPH_POINT_RELEASE=) 2024-03-30T12:46:45.513 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.2.service' 2024-03-30T12:46:45.555 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T12:46:45.555 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-03-30T12:46:45.556 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-03-30T12:46:45.556 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.3 2024-03-30T12:46:45.758 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:46:45 smithi084 systemd[1]: Stopping Ceph osd.3 for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:46:46.257 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:46:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3[111861]: 2024-03-30T12:46:45.874+0000 7fa71637a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:46:46.258 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:46:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3[111861]: 2024-03-30T12:46:45.874+0000 7fa71637a700 -1 osd.3 869 *** Got signal Terminated *** 2024-03-30T12:46:46.258 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:46:45 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3[111861]: 2024-03-30T12:46:45.874+0000 7fa71637a700 -1 osd.3 869 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T12:46:47.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:46:47 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:46:47.611+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:46:48.374 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:46:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:46:48.061+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:21.944085+0000 front 2024-03-30T12:46:21.943970+0000 (oldest deadline 2024-03-30T12:46:47.244060+0000) 2024-03-30T12:46:48.873 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:46:48 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:46:48.571+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:46:49.373 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:46:49.000+0000 7f9e648e6700 -1 osd.4 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.913826+0000 front 2024-03-30T12:46:24.913932+0000 (oldest deadline 2024-03-30T12:46:48.413800+0000) 2024-03-30T12:46:49.374 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:46:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:46:49.071+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:21.944085+0000 front 2024-03-30T12:46:21.943970+0000 (oldest deadline 2024-03-30T12:46:47.244060+0000) 2024-03-30T12:46:49.873 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:46:49 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:46:49.543+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:46:50.258 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:46:49 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3[111861]: 2024-03-30T12:46:49.964+0000 7fa71296e700 -1 osd.3 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:23.983159+0000 front 2024-03-30T12:46:23.982976+0000 (oldest deadline 2024-03-30T12:46:49.883152+0000) 2024-03-30T12:46:50.258 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:46:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:46:50.178Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused" 2024-03-30T12:46:50.258 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:46:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:46:50.179Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused" 2024-03-30T12:46:50.258 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:46:50 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:46:50.180Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:46:50.374 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:46:50.003+0000 7f9e648e6700 -1 osd.4 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.913826+0000 front 2024-03-30T12:46:24.913932+0000 (oldest deadline 2024-03-30T12:46:48.413800+0000) 2024-03-30T12:46:50.374 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:46:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:46:50.106+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:21.944085+0000 front 2024-03-30T12:46:21.943970+0000 (oldest deadline 2024-03-30T12:46:47.244060+0000) 2024-03-30T12:46:50.374 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:46:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:46:50.140+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:46:50.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:46:50 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:46:50.534+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:46:51.374 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:46:51.038+0000 7f9e648e6700 -1 osd.4 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.913826+0000 front 2024-03-30T12:46:24.913932+0000 (oldest deadline 2024-03-30T12:46:48.413800+0000) 2024-03-30T12:46:51.374 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:46:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:46:51.069+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:21.944085+0000 front 2024-03-30T12:46:21.943970+0000 (oldest deadline 2024-03-30T12:46:47.244060+0000) 2024-03-30T12:46:51.374 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:46:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:46:51.136+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:46:51.539 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:46:51 smithi084 podman[140743]: 2024-03-30 12:46:51.507501471 +0000 UTC m=+5.728321528 container died c088a701b71bfcc7ffe508390740b4c1bb16069f20b1e37bd52e58a1987824ae (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-03-30T12:46:51.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:46:51 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:46:51.519+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:46:52.088 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:46:51 smithi084 podman[140743]: 2024-03-30 12:46:51.92522245 +0000 UTC m=+6.146042512 container cleanup c088a701b71bfcc7ffe508390740b4c1bb16069f20b1e37bd52e58a1987824ae (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.build-date=20240326, GIT_CLEAN=True) 2024-03-30T12:46:52.088 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:46:51 smithi084 bash[140743]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3 2024-03-30T12:46:52.374 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:46:52.015+0000 7f9e648e6700 -1 osd.4 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.913826+0000 front 2024-03-30T12:46:24.913932+0000 (oldest deadline 2024-03-30T12:46:48.413800+0000) 2024-03-30T12:46:52.374 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:46:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:46:52.114+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:21.944085+0000 front 2024-03-30T12:46:21.943970+0000 (oldest deadline 2024-03-30T12:46:47.244060+0000) 2024-03-30T12:46:52.374 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:46:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:46:52.101+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:46:52.502 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:46:52 smithi084 podman[140761]: 2024-03-30 12:46:52.092974055 +0000 UTC m=+0.582487655 container remove c088a701b71bfcc7ffe508390740b4c1bb16069f20b1e37bd52e58a1987824ae (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326) 2024-03-30T12:46:52.758 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:46:52 smithi084 podman[140861]: 2024-03-30 12:46:52.413518517 +0000 UTC m=+0.018235759 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:46:52.758 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:46:52 smithi084 podman[140861]: 2024-03-30 12:46:52.544188468 +0000 UTC m=+0.148905752 container create 9ad729d69d48e2bb1ef0b46cfe2ea3ccacfadd991696e80c41b28389ebe46fb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-03-30T12:46:52.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:46:52 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:46:52.517+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:46:53.050 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:46:52 smithi084 podman[140861]: 2024-03-30 12:46:52.763179342 +0000 UTC m=+0.367896582 container init 9ad729d69d48e2bb1ef0b46cfe2ea3ccacfadd991696e80c41b28389ebe46fb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3-deactivate, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, ceph=True) 2024-03-30T12:46:53.050 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:46:52 smithi084 podman[140861]: 2024-03-30 12:46:52.766975966 +0000 UTC m=+0.371693206 container start 9ad729d69d48e2bb1ef0b46cfe2ea3ccacfadd991696e80c41b28389ebe46fb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3-deactivate, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2) 2024-03-30T12:46:53.050 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:46:52 smithi084 podman[140861]: 2024-03-30 12:46:52.838036738 +0000 UTC m=+0.442753999 container attach 9ad729d69d48e2bb1ef0b46cfe2ea3ccacfadd991696e80c41b28389ebe46fb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-03-30T12:46:53.344 INFO:journalctl@ceph.osd.3.smithi084.stdout:Mar 30 12:46:53 smithi084 podman[140861]: 2024-03-30 12:46:53.055231548 +0000 UTC m=+0.659948794 container died 9ad729d69d48e2bb1ef0b46cfe2ea3ccacfadd991696e80c41b28389ebe46fb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-3-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_CLEAN=True, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326) 2024-03-30T12:46:53.374 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:46:53.023+0000 7f9e648e6700 -1 osd.4 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.913826+0000 front 2024-03-30T12:46:24.913932+0000 (oldest deadline 2024-03-30T12:46:48.413800+0000) 2024-03-30T12:46:53.374 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:46:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:46:53.079+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:46:53.374 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:46:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:46:53.124+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:21.944085+0000 front 2024-03-30T12:46:21.943970+0000 (oldest deadline 2024-03-30T12:46:47.244060+0000) 2024-03-30T12:46:53.715 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.3.service' 2024-03-30T12:46:53.758 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T12:46:53.758 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-03-30T12:46:53.759 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-03-30T12:46:53.759 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.4 2024-03-30T12:46:53.815 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:46:53 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:46:53.550+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:46:54.067 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:53 smithi162 systemd[1]: Stopping Ceph osd.4 for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:46:54.067 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:46:54.063+0000 7f9e682f2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:46:54.067 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:46:54.063+0000 7f9e682f2700 -1 osd.4 869 *** Got signal Terminated *** 2024-03-30T12:46:54.067 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:46:54.063+0000 7f9e682f2700 -1 osd.4 869 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T12:46:54.067 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:46:54.070+0000 7f9e648e6700 -1 osd.4 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.913826+0000 front 2024-03-30T12:46:24.913932+0000 (oldest deadline 2024-03-30T12:46:48.413800+0000) 2024-03-30T12:46:54.068 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:46:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:46:54.054+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:46:54.374 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:46:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:46:54.129+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:21.944085+0000 front 2024-03-30T12:46:21.943970+0000 (oldest deadline 2024-03-30T12:46:47.244060+0000) 2024-03-30T12:46:54.758 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:46:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:46:54.498Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:46:54.758 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:46:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:46:54.499Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused" 2024-03-30T12:46:54.758 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:46:54 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:46:54.499Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:46:54.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:46:54 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:46:54.528+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:46:55.374 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:46:55.067+0000 7f9e648e6700 -1 osd.4 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.913826+0000 front 2024-03-30T12:46:24.913932+0000 (oldest deadline 2024-03-30T12:46:48.413800+0000) 2024-03-30T12:46:55.374 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:46:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:46:55.099+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:46:55.375 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:46:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:46:55.111+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:21.944085+0000 front 2024-03-30T12:46:21.943970+0000 (oldest deadline 2024-03-30T12:46:47.244060+0000) 2024-03-30T12:46:55.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:46:55 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:46:55.488+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:46:56.374 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:46:56.075+0000 7f9e648e6700 -1 osd.4 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.913826+0000 front 2024-03-30T12:46:24.913932+0000 (oldest deadline 2024-03-30T12:46:48.413800+0000) 2024-03-30T12:46:56.374 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:46:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:46:56.060+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:46:56.375 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:46:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:46:56.142+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:21.944085+0000 front 2024-03-30T12:46:21.943970+0000 (oldest deadline 2024-03-30T12:46:47.244060+0000) 2024-03-30T12:46:56.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:46:56 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:46:56.480+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:46:57.374 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:46:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:46:57.107+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:46:57.375 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:46:57.030+0000 7f9e648e6700 -1 osd.4 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.913826+0000 front 2024-03-30T12:46:24.913932+0000 (oldest deadline 2024-03-30T12:46:48.413800+0000) 2024-03-30T12:46:57.375 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:46:57.030+0000 7f9e648e6700 -1 osd.4 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:34.215434+0000 front 2024-03-30T12:46:34.215544+0000 (oldest deadline 2024-03-30T12:46:56.515271+0000) 2024-03-30T12:46:57.375 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:46:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:46:57.142+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:21.944085+0000 front 2024-03-30T12:46:21.943970+0000 (oldest deadline 2024-03-30T12:46:47.244060+0000) 2024-03-30T12:46:57.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:46:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:46:57.501+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:46:57.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:46:57 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:46:57.501+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:46:58.374 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:46:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:46:58.150+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:46:58.374 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:46:58.019+0000 7f9e648e6700 -1 osd.4 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.913826+0000 front 2024-03-30T12:46:24.913932+0000 (oldest deadline 2024-03-30T12:46:48.413800+0000) 2024-03-30T12:46:58.374 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:46:58.019+0000 7f9e648e6700 -1 osd.4 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:34.215434+0000 front 2024-03-30T12:46:34.215544+0000 (oldest deadline 2024-03-30T12:46:56.515271+0000) 2024-03-30T12:46:58.375 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:46:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:46:58.143+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:21.944085+0000 front 2024-03-30T12:46:21.943970+0000 (oldest deadline 2024-03-30T12:46:47.244060+0000) 2024-03-30T12:46:58.375 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:46:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:46:58.143+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:32.445444+0000 front 2024-03-30T12:46:32.445377+0000 (oldest deadline 2024-03-30T12:46:57.745276+0000) 2024-03-30T12:46:58.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:46:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:46:58.534+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:46:58.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:46:58 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:46:58.534+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:46:59.374 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:46:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:46:59.195+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:46:59.374 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:46:59.034+0000 7f9e648e6700 -1 osd.4 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.913826+0000 front 2024-03-30T12:46:24.913932+0000 (oldest deadline 2024-03-30T12:46:48.413800+0000) 2024-03-30T12:46:59.375 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4[89379]: 2024-03-30T12:46:59.034+0000 7f9e648e6700 -1 osd.4 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:34.215434+0000 front 2024-03-30T12:46:34.215544+0000 (oldest deadline 2024-03-30T12:46:56.515271+0000) 2024-03-30T12:46:59.375 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:46:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:46:59.149+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:21.944085+0000 front 2024-03-30T12:46:21.943970+0000 (oldest deadline 2024-03-30T12:46:47.244060+0000) 2024-03-30T12:46:59.375 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:46:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:46:59.149+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:32.445444+0000 front 2024-03-30T12:46:32.445377+0000 (oldest deadline 2024-03-30T12:46:57.745276+0000) 2024-03-30T12:46:59.662 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:46:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:46:59.573+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:46:59.662 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:46:59 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:46:59.573+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:46:59.918 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:46:59 smithi162 podman[126026]: 2024-03-30 12:46:59.667096422 +0000 UTC m=+5.706267231 container died 4197b37d2bb891d688a8c001724b66d9a7db20d74ec7a4aa2b2d0caf7e6378fb (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_BRANCH=HEAD) 2024-03-30T12:47:00.174 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:47:00 smithi162 podman[126026]: 2024-03-30 12:47:00.022030549 +0000 UTC m=+6.061201341 container cleanup 4197b37d2bb891d688a8c001724b66d9a7db20d74ec7a4aa2b2d0caf7e6378fb (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:47:00.174 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:47:00 smithi162 bash[126026]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4 2024-03-30T12:47:00.508 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:00.179Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:47:00.508 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:00.179Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused" 2024-03-30T12:47:00.508 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:00 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:00.180Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:47:00.558 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:47:00 smithi162 podman[126043]: 2024-03-30 12:47:00.331822092 +0000 UTC m=+0.663193536 container remove 4197b37d2bb891d688a8c001724b66d9a7db20d74ec7a4aa2b2d0caf7e6378fb (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-03-30T12:47:00.559 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:00.177+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:47:00.559 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:00.178+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:33.918505+0000 front 2024-03-30T12:46:33.918695+0000 (oldest deadline 2024-03-30T12:46:59.218316+0000) 2024-03-30T12:47:00.559 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:47:00.198+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:21.944085+0000 front 2024-03-30T12:46:21.943970+0000 (oldest deadline 2024-03-30T12:46:47.244060+0000) 2024-03-30T12:47:00.559 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:47:00.198+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:32.445444+0000 front 2024-03-30T12:46:32.445377+0000 (oldest deadline 2024-03-30T12:46:57.745276+0000) 2024-03-30T12:47:00.826 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:47:00 smithi162 podman[126140]: 2024-03-30 12:47:00.591176074 +0000 UTC m=+0.017615102 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:47:00.826 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:47:00 smithi162 podman[126140]: 2024-03-30 12:47:00.724417858 +0000 UTC m=+0.150856885 container create f6c43a11e8ce3ca847803afc0ab48f6fd156ed9d2eecd3fcb789797e9d2f2aa7 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240326) 2024-03-30T12:47:00.827 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:00.561+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:47:00.827 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:00 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:00.561+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:47:01.124 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:47:00 smithi162 podman[126140]: 2024-03-30 12:47:00.943993234 +0000 UTC m=+0.370432275 container init f6c43a11e8ce3ca847803afc0ab48f6fd156ed9d2eecd3fcb789797e9d2f2aa7 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.build-date=20240326, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-03-30T12:47:01.124 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:47:00 smithi162 podman[126140]: 2024-03-30 12:47:00.947224192 +0000 UTC m=+0.373663223 container start f6c43a11e8ce3ca847803afc0ab48f6fd156ed9d2eecd3fcb789797e9d2f2aa7 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T12:47:01.124 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:47:01 smithi162 podman[126140]: 2024-03-30 12:47:01.026815182 +0000 UTC m=+0.453254225 container attach f6c43a11e8ce3ca847803afc0ab48f6fd156ed9d2eecd3fcb789797e9d2f2aa7 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_CLEAN=True, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, org.label-schema.license=GPLv2) 2024-03-30T12:47:01.394 INFO:journalctl@ceph.osd.4.smithi162.stdout:Mar 30 12:47:01 smithi162 podman[126140]: 2024-03-30 12:47:01.262774489 +0000 UTC m=+0.689213519 container died f6c43a11e8ce3ca847803afc0ab48f6fd156ed9d2eecd3fcb789797e9d2f2aa7 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-4-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-03-30T12:47:01.395 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:01.171+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:47:01.395 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:01.171+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:33.918505+0000 front 2024-03-30T12:46:33.918695+0000 (oldest deadline 2024-03-30T12:46:59.218316+0000) 2024-03-30T12:47:01.395 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:47:01.190+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:21.944085+0000 front 2024-03-30T12:46:21.943970+0000 (oldest deadline 2024-03-30T12:46:47.244060+0000) 2024-03-30T12:47:01.395 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:47:01.191+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:32.445444+0000 front 2024-03-30T12:46:32.445377+0000 (oldest deadline 2024-03-30T12:46:57.745276+0000) 2024-03-30T12:47:01.859 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:01.552+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:47:01.860 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:01 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:01.552+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:47:01.886 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.4.service' 2024-03-30T12:47:01.928 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T12:47:01.928 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-03-30T12:47:01.929 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-03-30T12:47:01.929 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.5 2024-03-30T12:47:02.124 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:02 smithi162 systemd[1]: Stopping Ceph osd.5 for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:47:02.525 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:02.207+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:47:02.525 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:02.207+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:33.918505+0000 front 2024-03-30T12:46:33.918695+0000 (oldest deadline 2024-03-30T12:46:59.218316+0000) 2024-03-30T12:47:02.525 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:47:02.154+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:21.944085+0000 front 2024-03-30T12:46:21.943970+0000 (oldest deadline 2024-03-30T12:46:47.244060+0000) 2024-03-30T12:47:02.526 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:47:02.154+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:32.445444+0000 front 2024-03-30T12:46:32.445377+0000 (oldest deadline 2024-03-30T12:46:57.745276+0000) 2024-03-30T12:47:02.526 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:47:02.266+0000 7f8321d8d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:47:02.526 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:47:02.266+0000 7f8321d8d700 -1 osd.5 869 *** Got signal Terminated *** 2024-03-30T12:47:02.526 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:47:02.266+0000 7f8321d8d700 -1 osd.5 869 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T12:47:02.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:02.529+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:47:02.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:02 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:02.529+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:47:03.526 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:47:03.128+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:21.944085+0000 front 2024-03-30T12:46:21.943970+0000 (oldest deadline 2024-03-30T12:46:47.244060+0000) 2024-03-30T12:47:03.526 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:47:03.128+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:32.445444+0000 front 2024-03-30T12:46:32.445377+0000 (oldest deadline 2024-03-30T12:46:57.745276+0000) 2024-03-30T12:47:03.526 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:03.179+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:47:03.526 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:03.179+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:33.918505+0000 front 2024-03-30T12:46:33.918695+0000 (oldest deadline 2024-03-30T12:46:59.218316+0000) 2024-03-30T12:47:03.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:03.529+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:47:03.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:03 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:03.529+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:47:04.374 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:47:04.091+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:21.944085+0000 front 2024-03-30T12:46:21.943970+0000 (oldest deadline 2024-03-30T12:46:47.244060+0000) 2024-03-30T12:47:04.374 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:47:04.091+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:32.445444+0000 front 2024-03-30T12:46:32.445377+0000 (oldest deadline 2024-03-30T12:46:57.745276+0000) 2024-03-30T12:47:04.375 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:04.182+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:47:04.375 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:04.182+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:33.918505+0000 front 2024-03-30T12:46:33.918695+0000 (oldest deadline 2024-03-30T12:46:59.218316+0000) 2024-03-30T12:47:04.758 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:04.499Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused" 2024-03-30T12:47:04.758 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:04.500Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused" 2024-03-30T12:47:04.758 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:04 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:04.500Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:47:04.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:04.538+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:47:04.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:04.538+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:47:04.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:04 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:04.538+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:37.291010+0000 front 2024-03-30T12:46:37.291028+0000 (oldest deadline 2024-03-30T12:47:03.691369+0000) 2024-03-30T12:47:05.374 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:47:05.096+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:21.944085+0000 front 2024-03-30T12:46:21.943970+0000 (oldest deadline 2024-03-30T12:46:47.244060+0000) 2024-03-30T12:47:05.374 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:47:05.096+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:32.445444+0000 front 2024-03-30T12:46:32.445377+0000 (oldest deadline 2024-03-30T12:46:57.745276+0000) 2024-03-30T12:47:05.375 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:05.140+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:47:05.375 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:05.140+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:33.918505+0000 front 2024-03-30T12:46:33.918695+0000 (oldest deadline 2024-03-30T12:46:59.218316+0000) 2024-03-30T12:47:05.375 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:05.140+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:42.719309+0000 front 2024-03-30T12:46:42.719330+0000 (oldest deadline 2024-03-30T12:47:05.019268+0000) 2024-03-30T12:47:05.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:05.505+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:47:05.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:05.505+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:47:05.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:05 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:05.505+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:37.291010+0000 front 2024-03-30T12:46:37.291028+0000 (oldest deadline 2024-03-30T12:47:03.691369+0000) 2024-03-30T12:47:06.512 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:47:06.133+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:21.944085+0000 front 2024-03-30T12:46:21.943970+0000 (oldest deadline 2024-03-30T12:46:47.244060+0000) 2024-03-30T12:47:06.513 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:47:06.133+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:32.445444+0000 front 2024-03-30T12:46:32.445377+0000 (oldest deadline 2024-03-30T12:46:57.745276+0000) 2024-03-30T12:47:06.513 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:47:06.133+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:40.646491+0000 front 2024-03-30T12:46:40.646564+0000 (oldest deadline 2024-03-30T12:47:05.946471+0000) 2024-03-30T12:47:06.513 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:06.166+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:47:06.513 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:06.166+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:33.918505+0000 front 2024-03-30T12:46:33.918695+0000 (oldest deadline 2024-03-30T12:46:59.218316+0000) 2024-03-30T12:47:06.513 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:06.166+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:42.719309+0000 front 2024-03-30T12:46:42.719330+0000 (oldest deadline 2024-03-30T12:47:05.019268+0000) 2024-03-30T12:47:06.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:06.516+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:47:06.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:06.516+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:47:06.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:06 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:06.516+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:37.291010+0000 front 2024-03-30T12:46:37.291028+0000 (oldest deadline 2024-03-30T12:47:03.691369+0000) 2024-03-30T12:47:07.471 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:07.205+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:47:07.472 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:07.205+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:33.918505+0000 front 2024-03-30T12:46:33.918695+0000 (oldest deadline 2024-03-30T12:46:59.218316+0000) 2024-03-30T12:47:07.472 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:07.205+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:42.719309+0000 front 2024-03-30T12:46:42.719330+0000 (oldest deadline 2024-03-30T12:47:05.019268+0000) 2024-03-30T12:47:07.472 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:47:07.179+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:21.944085+0000 front 2024-03-30T12:46:21.943970+0000 (oldest deadline 2024-03-30T12:46:47.244060+0000) 2024-03-30T12:47:07.472 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:47:07.179+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:32.445444+0000 front 2024-03-30T12:46:32.445377+0000 (oldest deadline 2024-03-30T12:46:57.745276+0000) 2024-03-30T12:47:07.472 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5[94330]: 2024-03-30T12:47:07.179+0000 7f831e381700 -1 osd.5 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:40.646491+0000 front 2024-03-30T12:46:40.646564+0000 (oldest deadline 2024-03-30T12:47:05.946471+0000) 2024-03-30T12:47:07.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:07.475+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:47:07.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:07.475+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:47:07.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:07 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:07.475+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:37.291010+0000 front 2024-03-30T12:46:37.291028+0000 (oldest deadline 2024-03-30T12:47:03.691369+0000) 2024-03-30T12:47:08.313 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:08 smithi162 podman[126255]: 2024-03-30 12:47:08.034832813 +0000 UTC m=+5.871009132 container died cd8795ac188ad1b560f666ebb382734ac15f32f34ade9745ef500522a5f471ac (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, ceph=True, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2) 2024-03-30T12:47:08.313 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:08.234+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:47:08.313 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:08.234+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:33.918505+0000 front 2024-03-30T12:46:33.918695+0000 (oldest deadline 2024-03-30T12:46:59.218316+0000) 2024-03-30T12:47:08.313 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:08.234+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:42.719309+0000 front 2024-03-30T12:46:42.719330+0000 (oldest deadline 2024-03-30T12:47:05.019268+0000) 2024-03-30T12:47:08.624 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:08 smithi162 podman[126255]: 2024-03-30 12:47:08.408586422 +0000 UTC m=+6.244762727 container cleanup cd8795ac188ad1b560f666ebb382734ac15f32f34ade9745ef500522a5f471ac (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-03-30T12:47:08.624 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:08 smithi162 bash[126255]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5 2024-03-30T12:47:08.624 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:08.509+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:47:08.624 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:08.509+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:47:08.625 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:08 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:08.509+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:37.291010+0000 front 2024-03-30T12:46:37.291028+0000 (oldest deadline 2024-03-30T12:47:03.691369+0000) 2024-03-30T12:47:09.026 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:08 smithi162 podman[126273]: 2024-03-30 12:47:08.685523181 +0000 UTC m=+0.655568277 container remove cd8795ac188ad1b560f666ebb382734ac15f32f34ade9745ef500522a5f471ac (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, ceph=True) 2024-03-30T12:47:09.317 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:09.207+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:47:09.317 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:09.207+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:33.918505+0000 front 2024-03-30T12:46:33.918695+0000 (oldest deadline 2024-03-30T12:46:59.218316+0000) 2024-03-30T12:47:09.317 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:09.207+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:42.719309+0000 front 2024-03-30T12:46:42.719330+0000 (oldest deadline 2024-03-30T12:47:05.019268+0000) 2024-03-30T12:47:09.318 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:09 smithi162 podman[126364]: 2024-03-30 12:47:08.931109741 +0000 UTC m=+0.017945016 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:47:09.318 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:09 smithi162 podman[126364]: 2024-03-30 12:47:09.036226138 +0000 UTC m=+0.123061392 container create 429a9b86e42443548070eb753cde21e1bc31b2bd4070a7a07b5e051b2fbf3ec3 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-03-30T12:47:09.318 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:09 smithi162 podman[126364]: 2024-03-30 12:47:09.239180954 +0000 UTC m=+0.326016218 container init 429a9b86e42443548070eb753cde21e1bc31b2bd4070a7a07b5e051b2fbf3ec3 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5-deactivate, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:47:09.318 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:09 smithi162 podman[126364]: 2024-03-30 12:47:09.242453178 +0000 UTC m=+0.329288433 container start 429a9b86e42443548070eb753cde21e1bc31b2bd4070a7a07b5e051b2fbf3ec3 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T12:47:09.318 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:09 smithi162 podman[126364]: 2024-03-30 12:47:09.321982545 +0000 UTC m=+0.408817818 container attach 429a9b86e42443548070eb753cde21e1bc31b2bd4070a7a07b5e051b2fbf3ec3 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5-deactivate, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-03-30T12:47:09.624 INFO:journalctl@ceph.osd.5.smithi162.stdout:Mar 30 12:47:09 smithi162 podman[126364]: 2024-03-30 12:47:09.536328108 +0000 UTC m=+0.623163363 container died 429a9b86e42443548070eb753cde21e1bc31b2bd4070a7a07b5e051b2fbf3ec3 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-5-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-03-30T12:47:09.624 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:09.532+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:47:09.624 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:09.532+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:47:09.625 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:09 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:09.532+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:37.291010+0000 front 2024-03-30T12:46:37.291028+0000 (oldest deadline 2024-03-30T12:47:03.691369+0000) 2024-03-30T12:47:10.105 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.5.service' 2024-03-30T12:47:10.145 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T12:47:10.145 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-03-30T12:47:10.146 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-03-30T12:47:10.146 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.6 2024-03-30T12:47:10.374 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:10.175+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:47:10.374 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:10.175+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:33.918505+0000 front 2024-03-30T12:46:33.918695+0000 (oldest deadline 2024-03-30T12:46:59.218316+0000) 2024-03-30T12:47:10.374 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:10.175+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:42.719309+0000 front 2024-03-30T12:46:42.719330+0000 (oldest deadline 2024-03-30T12:47:05.019268+0000) 2024-03-30T12:47:10.374 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:10 smithi162 systemd[1]: Stopping Ceph osd.6 for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:47:10.508 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:10.180Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused" 2024-03-30T12:47:10.508 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:10.180Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused" 2024-03-30T12:47:10.508 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:10 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:10.181Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:47:10.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:10.491+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:47:10.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:10.491+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:47:10.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:10.491+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:37.291010+0000 front 2024-03-30T12:46:37.291028+0000 (oldest deadline 2024-03-30T12:47:03.691369+0000) 2024-03-30T12:47:10.875 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:10.461+0000 7f5c00b18700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:47:10.875 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:10.461+0000 7f5c00b18700 -1 osd.6 869 *** Got signal Terminated *** 2024-03-30T12:47:10.875 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:10 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:10.461+0000 7f5c00b18700 -1 osd.6 869 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T12:47:11.449 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:11.155+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:47:11.449 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:11.155+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:33.918505+0000 front 2024-03-30T12:46:33.918695+0000 (oldest deadline 2024-03-30T12:46:59.218316+0000) 2024-03-30T12:47:11.449 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:11.155+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:42.719309+0000 front 2024-03-30T12:46:42.719330+0000 (oldest deadline 2024-03-30T12:47:05.019268+0000) 2024-03-30T12:47:11.839 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:11.452+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:47:11.840 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:11.452+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:47:11.840 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:11 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:11.452+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:37.291010+0000 front 2024-03-30T12:46:37.291028+0000 (oldest deadline 2024-03-30T12:47:03.691369+0000) 2024-03-30T12:47:12.374 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:12.124+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:47:12.374 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:12.124+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:33.918505+0000 front 2024-03-30T12:46:33.918695+0000 (oldest deadline 2024-03-30T12:46:59.218316+0000) 2024-03-30T12:47:12.374 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:12.124+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:42.719309+0000 front 2024-03-30T12:46:42.719330+0000 (oldest deadline 2024-03-30T12:47:05.019268+0000) 2024-03-30T12:47:12.374 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:12.124+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6830 osd.3 since back 2024-03-30T12:46:50.121071+0000 front 2024-03-30T12:46:50.121083+0000 (oldest deadline 2024-03-30T12:47:11.821015+0000) 2024-03-30T12:47:12.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:12.435+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:47:12.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:12.435+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:47:12.875 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:12.435+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:37.291010+0000 front 2024-03-30T12:46:37.291028+0000 (oldest deadline 2024-03-30T12:47:03.691369+0000) 2024-03-30T12:47:12.875 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:12 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:12.435+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6830 osd.3 since back 2024-03-30T12:46:49.592165+0000 front 2024-03-30T12:46:49.592062+0000 (oldest deadline 2024-03-30T12:47:11.892050+0000) 2024-03-30T12:47:13.425 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:13.150+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:47:13.425 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:13.150+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:33.918505+0000 front 2024-03-30T12:46:33.918695+0000 (oldest deadline 2024-03-30T12:46:59.218316+0000) 2024-03-30T12:47:13.425 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:13.150+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:42.719309+0000 front 2024-03-30T12:46:42.719330+0000 (oldest deadline 2024-03-30T12:47:05.019268+0000) 2024-03-30T12:47:13.425 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:13.150+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6830 osd.3 since back 2024-03-30T12:46:50.121071+0000 front 2024-03-30T12:46:50.121083+0000 (oldest deadline 2024-03-30T12:47:11.821015+0000) 2024-03-30T12:47:13.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:13.429+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:47:13.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:13.429+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:47:13.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:13.429+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:37.291010+0000 front 2024-03-30T12:46:37.291028+0000 (oldest deadline 2024-03-30T12:47:03.691369+0000) 2024-03-30T12:47:13.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:13 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:13.429+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6830 osd.3 since back 2024-03-30T12:46:49.592165+0000 front 2024-03-30T12:46:49.592062+0000 (oldest deadline 2024-03-30T12:47:11.892050+0000) 2024-03-30T12:47:14.433 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:14.140+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:47:14.434 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:14.140+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:33.918505+0000 front 2024-03-30T12:46:33.918695+0000 (oldest deadline 2024-03-30T12:46:59.218316+0000) 2024-03-30T12:47:14.434 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:14.140+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:42.719309+0000 front 2024-03-30T12:46:42.719330+0000 (oldest deadline 2024-03-30T12:47:05.019268+0000) 2024-03-30T12:47:14.434 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:14.140+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6830 osd.3 since back 2024-03-30T12:46:50.121071+0000 front 2024-03-30T12:46:50.121083+0000 (oldest deadline 2024-03-30T12:47:11.821015+0000) 2024-03-30T12:47:14.758 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:14.500Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:47:14.758 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:14.501Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused" 2024-03-30T12:47:14.758 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:14 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:14.501Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:47:14.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:14.435+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:47:14.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:14.435+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:47:14.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:14.435+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:37.291010+0000 front 2024-03-30T12:46:37.291028+0000 (oldest deadline 2024-03-30T12:47:03.691369+0000) 2024-03-30T12:47:14.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:14 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:14.435+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6830 osd.3 since back 2024-03-30T12:46:49.592165+0000 front 2024-03-30T12:46:49.592062+0000 (oldest deadline 2024-03-30T12:47:11.892050+0000) 2024-03-30T12:47:15.374 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:47:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a[120008]: logger=sqlstore.transactions t=2024-03-30T12:47:15.058428364Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-03-30T12:47:15.375 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:15.170+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:24.017229+0000 front 2024-03-30T12:46:24.017263+0000 (oldest deadline 2024-03-30T12:46:49.317123+0000) 2024-03-30T12:47:15.375 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:15.170+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:33.918505+0000 front 2024-03-30T12:46:33.918695+0000 (oldest deadline 2024-03-30T12:46:59.218316+0000) 2024-03-30T12:47:15.375 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:15.170+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:42.719309+0000 front 2024-03-30T12:46:42.719330+0000 (oldest deadline 2024-03-30T12:47:05.019268+0000) 2024-03-30T12:47:15.375 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6[99207]: 2024-03-30T12:47:15.170+0000 7f5bf9104700 -1 osd.6 869 heartbeat_check: no reply from 172.21.15.84:6830 osd.3 since back 2024-03-30T12:46:50.121071+0000 front 2024-03-30T12:46:50.121083+0000 (oldest deadline 2024-03-30T12:47:11.821015+0000) 2024-03-30T12:47:15.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:15.386+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:47:15.875 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:15.386+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:47:15.875 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:15.386+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:37.291010+0000 front 2024-03-30T12:46:37.291028+0000 (oldest deadline 2024-03-30T12:47:03.691369+0000) 2024-03-30T12:47:15.875 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:15 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:15.386+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6830 osd.3 since back 2024-03-30T12:46:49.592165+0000 front 2024-03-30T12:46:49.592062+0000 (oldest deadline 2024-03-30T12:47:11.892050+0000) 2024-03-30T12:47:16.250 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:16 smithi162 podman[126469]: 2024-03-30 12:47:16.002239339 +0000 UTC m=+5.628301522 container died 40ed6df811943a51095d3bdc149c040a773bf5fef5a35541bcd55d8bacabd790 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.build-date=20240326, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-03-30T12:47:16.624 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:16 smithi162 podman[126469]: 2024-03-30 12:47:16.36937872 +0000 UTC m=+5.995440892 container cleanup 40ed6df811943a51095d3bdc149c040a773bf5fef5a35541bcd55d8bacabd790 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.build-date=20240326, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-03-30T12:47:16.625 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:16 smithi162 bash[126469]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6 2024-03-30T12:47:16.625 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:16.376+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:47:16.625 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:16.376+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:47:16.625 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:16.376+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:37.291010+0000 front 2024-03-30T12:46:37.291028+0000 (oldest deadline 2024-03-30T12:47:03.691369+0000) 2024-03-30T12:47:16.625 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:16 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:16.376+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6830 osd.3 since back 2024-03-30T12:46:49.592165+0000 front 2024-03-30T12:46:49.592062+0000 (oldest deadline 2024-03-30T12:47:11.892050+0000) 2024-03-30T12:47:16.956 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:16 smithi162 podman[126486]: 2024-03-30 12:47:16.629094357 +0000 UTC m=+0.622250138 container remove 40ed6df811943a51095d3bdc149c040a773bf5fef5a35541bcd55d8bacabd790 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-03-30T12:47:17.261 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:16 smithi162 podman[126575]: 2024-03-30 12:47:16.863431863 +0000 UTC m=+0.018283222 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:47:17.261 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:16 smithi162 podman[126575]: 2024-03-30 12:47:16.963234159 +0000 UTC m=+0.118085531 container create bdbce128676f037c927ddd2a583138831777718ecd79810ba51db3fcfdf1d4dc (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux ) 2024-03-30T12:47:17.261 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:17 smithi162 podman[126575]: 2024-03-30 12:47:17.190707049 +0000 UTC m=+0.345558386 container init bdbce128676f037c927ddd2a583138831777718ecd79810ba51db3fcfdf1d4dc (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6-deactivate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240326, ceph=True) 2024-03-30T12:47:17.261 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:17 smithi162 podman[126575]: 2024-03-30 12:47:17.19373627 +0000 UTC m=+0.348587599 container start bdbce128676f037c927ddd2a583138831777718ecd79810ba51db3fcfdf1d4dc (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3) 2024-03-30T12:47:17.624 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:17.423+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:47:17.625 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:17.423+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:47:17.625 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:17.423+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:37.291010+0000 front 2024-03-30T12:46:37.291028+0000 (oldest deadline 2024-03-30T12:47:03.691369+0000) 2024-03-30T12:47:17.625 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:17 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:17.423+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6830 osd.3 since back 2024-03-30T12:46:49.592165+0000 front 2024-03-30T12:46:49.592062+0000 (oldest deadline 2024-03-30T12:47:11.892050+0000) 2024-03-30T12:47:17.625 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:17 smithi162 podman[126575]: 2024-03-30 12:47:17.265606487 +0000 UTC m=+0.420457836 container attach bdbce128676f037c927ddd2a583138831777718ecd79810ba51db3fcfdf1d4dc (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6-deactivate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-03-30T12:47:17.625 INFO:journalctl@ceph.osd.6.smithi162.stdout:Mar 30 12:47:17 smithi162 podman[126575]: 2024-03-30 12:47:17.485389496 +0000 UTC m=+0.640240839 container died bdbce128676f037c927ddd2a583138831777718ecd79810ba51db3fcfdf1d4dc (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-6-deactivate, org.label-schema.build-date=20240326, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-03-30T12:47:18.057 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.6.service' 2024-03-30T12:47:18.099 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T12:47:18.099 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-03-30T12:47:18.100 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-03-30T12:47:18.100 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.7 2024-03-30T12:47:18.328 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:18 smithi162 systemd[1]: Stopping Ceph osd.7 for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:47:18.624 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:18.406+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:47:18.625 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:18.406+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:47:18.625 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:18.406+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:37.291010+0000 front 2024-03-30T12:46:37.291028+0000 (oldest deadline 2024-03-30T12:47:03.691369+0000) 2024-03-30T12:47:18.625 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:18.406+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6830 osd.3 since back 2024-03-30T12:46:49.592165+0000 front 2024-03-30T12:46:49.592062+0000 (oldest deadline 2024-03-30T12:47:11.892050+0000) 2024-03-30T12:47:18.625 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:18.455+0000 7f9de4899700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:47:18.625 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:18.455+0000 7f9de4899700 -1 osd.7 869 *** Got signal Terminated *** 2024-03-30T12:47:18.625 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:18 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:18.455+0000 7f9de4899700 -1 osd.7 869 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T12:47:19.624 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:19.445+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:47:19.624 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:19.445+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:47:19.625 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:19.445+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:37.291010+0000 front 2024-03-30T12:46:37.291028+0000 (oldest deadline 2024-03-30T12:47:03.691369+0000) 2024-03-30T12:47:19.625 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:19 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:19.445+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6830 osd.3 since back 2024-03-30T12:46:49.592165+0000 front 2024-03-30T12:46:49.592062+0000 (oldest deadline 2024-03-30T12:47:11.892050+0000) 2024-03-30T12:47:20.508 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:20.181Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:47:20.508 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:20.181Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused" 2024-03-30T12:47:20.508 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:20 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:20.182Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:47:20.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:20.406+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:47:20.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:20.406+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:47:20.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:20.406+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:37.291010+0000 front 2024-03-30T12:46:37.291028+0000 (oldest deadline 2024-03-30T12:47:03.691369+0000) 2024-03-30T12:47:20.875 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:20 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:20.406+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6830 osd.3 since back 2024-03-30T12:46:49.592165+0000 front 2024-03-30T12:46:49.592062+0000 (oldest deadline 2024-03-30T12:47:11.892050+0000) 2024-03-30T12:47:21.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:21.407+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:47:21.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:21.407+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:47:21.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:21.407+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:37.291010+0000 front 2024-03-30T12:46:37.291028+0000 (oldest deadline 2024-03-30T12:47:03.691369+0000) 2024-03-30T12:47:21.875 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:21 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:21.407+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6830 osd.3 since back 2024-03-30T12:46:49.592165+0000 front 2024-03-30T12:46:49.592062+0000 (oldest deadline 2024-03-30T12:47:11.892050+0000) 2024-03-30T12:47:22.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:22.422+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:47:22.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:22.422+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:47:22.874 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:22.422+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:37.291010+0000 front 2024-03-30T12:46:37.291028+0000 (oldest deadline 2024-03-30T12:47:03.691369+0000) 2024-03-30T12:47:22.875 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:22.422+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6830 osd.3 since back 2024-03-30T12:46:49.592165+0000 front 2024-03-30T12:46:49.592062+0000 (oldest deadline 2024-03-30T12:47:11.892050+0000) 2024-03-30T12:47:22.875 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:22 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:22.422+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.162:6804 osd.4 since back 2024-03-30T12:46:57.093436+0000 front 2024-03-30T12:46:57.093464+0000 (oldest deadline 2024-03-30T12:47:21.793442+0000) 2024-03-30T12:47:23.626 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:23.373+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-03-30T12:46:26.189687+0000 front 2024-03-30T12:46:26.189617+0000 (oldest deadline 2024-03-30T12:46:47.289502+0000) 2024-03-30T12:47:23.626 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:23.373+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-03-30T12:46:31.990462+0000 front 2024-03-30T12:46:31.990483+0000 (oldest deadline 2024-03-30T12:46:57.290360+0000) 2024-03-30T12:47:23.626 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:23.373+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6822 osd.2 since back 2024-03-30T12:46:37.291010+0000 front 2024-03-30T12:46:37.291028+0000 (oldest deadline 2024-03-30T12:47:03.691369+0000) 2024-03-30T12:47:23.626 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:23.373+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.84:6830 osd.3 since back 2024-03-30T12:46:49.592165+0000 front 2024-03-30T12:46:49.592062+0000 (oldest deadline 2024-03-30T12:47:11.892050+0000) 2024-03-30T12:47:23.627 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:23 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7[103889]: 2024-03-30T12:47:23.373+0000 7f9de0e8d700 -1 osd.7 869 heartbeat_check: no reply from 172.21.15.162:6804 osd.4 since back 2024-03-30T12:46:57.093436+0000 front 2024-03-30T12:46:57.093464+0000 (oldest deadline 2024-03-30T12:47:21.793442+0000) 2024-03-30T12:47:24.310 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:24 smithi162 podman[126680]: 2024-03-30 12:47:24.044985169 +0000 UTC m=+5.705786800 container died b83812c70d9a3f246b4cb567843ce422d155fbd2bc2c16180c08687979c5c371 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T12:47:24.624 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:24 smithi162 podman[126680]: 2024-03-30 12:47:24.430152701 +0000 UTC m=+6.090954341 container cleanup b83812c70d9a3f246b4cb567843ce422d155fbd2bc2c16180c08687979c5c371 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD) 2024-03-30T12:47:24.624 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:24 smithi162 bash[126680]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7 2024-03-30T12:47:24.758 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:24.501Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused" 2024-03-30T12:47:24.759 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:24.502Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused" 2024-03-30T12:47:24.759 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:24 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:24.502Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:47:24.985 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:24 smithi162 podman[126708]: 2024-03-30 12:47:24.665220947 +0000 UTC m=+0.616014422 container remove b83812c70d9a3f246b4cb567843ce422d155fbd2bc2c16180c08687979c5c371 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-03-30T12:47:25.263 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:24 smithi162 podman[126798]: 2024-03-30 12:47:24.892553637 +0000 UTC m=+0.017316325 image pull 548196a1a838ff1a7c79622040c8bfbfc780949b6e45af704dc66eb0fd7070e7 quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8 2024-03-30T12:47:25.264 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:24 smithi162 podman[126798]: 2024-03-30 12:47:24.990883698 +0000 UTC m=+0.115646387 container create 8137810b28c5758f2fbd46f627f86cb49b4e88792aec1d90d8b1fbc9083d8699 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, io.buildah.version=1.33.5) 2024-03-30T12:47:25.264 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:25 smithi162 podman[126798]: 2024-03-30 12:47:25.185285549 +0000 UTC m=+0.310048260 container init 8137810b28c5758f2fbd46f627f86cb49b4e88792aec1d90d8b1fbc9083d8699 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7-deactivate, GIT_CLEAN=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T12:47:25.264 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:25 smithi162 podman[126798]: 2024-03-30 12:47:25.188553208 +0000 UTC m=+0.313315898 container start 8137810b28c5758f2fbd46f627f86cb49b4e88792aec1d90d8b1fbc9083d8699 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T12:47:25.264 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:25 smithi162 podman[126798]: 2024-03-30 12:47:25.268263472 +0000 UTC m=+0.393026163 container attach 8137810b28c5758f2fbd46f627f86cb49b4e88792aec1d90d8b1fbc9083d8699 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-03-30T12:47:25.625 INFO:journalctl@ceph.osd.7.smithi162.stdout:Mar 30 12:47:25 smithi162 podman[126798]: 2024-03-30 12:47:25.48173616 +0000 UTC m=+0.606498849 container died 8137810b28c5758f2fbd46f627f86cb49b4e88792aec1d90d8b1fbc9083d8699 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-osd-7-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240326) 2024-03-30T12:47:26.102 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@osd.7.service' 2024-03-30T12:47:26.143 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T12:47:26.144 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-03-30T12:47:26.144 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-03-30T12:47:26.144 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mds.a 2024-03-30T12:47:26.443 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:47:26 smithi084 systemd[1]: Stopping Ceph mds.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:47:26.758 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:47:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-a[117098]: 2024-03-30T12:47:26.446+0000 7f569748a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:47:26.758 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:47:26 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-a[117098]: 2024-03-30T12:47:26.446+0000 7f569748a700 -1 mds.a *** got signal Terminated *** 2024-03-30T12:47:27.718 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:47:27 smithi084 podman[140980]: 2024-03-30 12:47:27.457595006 +0000 UTC m=+1.114971641 container died 74abe81e0b10ede0186a602aa16aa5937e0b31d3deae3dd16af129d928974fad (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-a, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-03-30T12:47:28.008 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:47:27 smithi084 podman[140980]: 2024-03-30 12:47:27.871720597 +0000 UTC m=+1.529097239 container cleanup 74abe81e0b10ede0186a602aa16aa5937e0b31d3deae3dd16af129d928974fad (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-03-30T12:47:28.008 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:47:27 smithi084 bash[140980]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-a 2024-03-30T12:47:28.341 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mds.a.service' 2024-03-30T12:47:28.366 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:47:28 smithi084 podman[140994]: 2024-03-30 12:47:28.097901689 +0000 UTC m=+0.633239608 container remove 74abe81e0b10ede0186a602aa16aa5937e0b31d3deae3dd16af129d928974fad (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326) 2024-03-30T12:47:28.366 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:47:28 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mds.a.service: Deactivated successfully. 2024-03-30T12:47:28.366 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:47:28 smithi084 systemd[1]: Stopped Ceph mds.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:47:28.366 INFO:journalctl@ceph.mds.a.smithi084.stdout:Mar 30 12:47:28 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mds.a.service: Consumed 1.652s CPU time. 2024-03-30T12:47:28.379 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T12:47:28.379 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-03-30T12:47:28.380 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-03-30T12:47:28.380 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mds.b 2024-03-30T12:47:28.752 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:47:28 smithi162 systemd[1]: Stopping Ceph mds.b for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:47:29.124 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:47:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-b[108476]: 2024-03-30T12:47:28.757+0000 7f4fff39a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T12:47:29.124 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:47:28 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-b[108476]: 2024-03-30T12:47:28.757+0000 7f4fff39a700 -1 mds.b *** got signal Terminated *** 2024-03-30T12:47:30.508 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:30.182Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:47:30.508 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:30.182Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused" 2024-03-30T12:47:30.508 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:30 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:30.183Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:47:31.111 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:47:30 smithi162 podman[126905]: 2024-03-30 12:47:30.804143043 +0000 UTC m=+2.225532696 container died 38620aa52c540d17217108594a33a441b9464275450bcc7d29e4e7ea1b8d3e43 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-b, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T12:47:31.111 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:47:31 smithi162 podman[126905]: 2024-03-30 12:47:31.115418286 +0000 UTC m=+2.536807945 container cleanup 38620aa52c540d17217108594a33a441b9464275450bcc7d29e4e7ea1b8d3e43 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5) 2024-03-30T12:47:31.374 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:47:31 smithi162 bash[126905]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-b 2024-03-30T12:47:31.374 INFO:journalctl@ceph.mds.b.smithi162.stdout:Mar 30 12:47:31 smithi162 podman[126920]: 2024-03-30 12:47:31.299903194 +0000 UTC m=+0.494826857 container remove 38620aa52c540d17217108594a33a441b9464275450bcc7d29e4e7ea1b8d3e43 (image=quay.ceph.io/ceph-ci/ceph@sha256:356f822a31207555cf47a649d3b8393d9542ce8e3fb3a4acaa4b4d4945be4dc8, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-mds-b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-ceph_test_rados-partial-reads-5dc2ea3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5) 2024-03-30T12:47:31.529 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@mds.b.service' 2024-03-30T12:47:31.566 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T12:47:31.566 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-03-30T12:47:31.567 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-03-30T12:47:31.567 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@prometheus.a 2024-03-30T12:47:31.874 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:47:31 smithi162 systemd[1]: Stopping Ceph prometheus.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:47:32.008 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:31.624Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused" 2024-03-30T12:47:32.008 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:31 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:31.624Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:47:32.191 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:47:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:47:31.902Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-03-30T12:47:32.191 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:47:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:47:31.902Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-03-30T12:47:32.191 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:47:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:47:31.902Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-03-30T12:47:32.191 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:47:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:47:31.902Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-03-30T12:47:32.191 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:47:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:47:31.902Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-03-30T12:47:32.191 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:47:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:47:31.902Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-03-30T12:47:32.192 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:47:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:47:31.902Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-03-30T12:47:32.192 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:47:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:47:31.902Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-03-30T12:47:32.192 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:47:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:47:31.903Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-03-30T12:47:32.192 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:47:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:47:31.903Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-03-30T12:47:32.192 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:47:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:47:31.903Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-03-30T12:47:32.192 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:47:31 smithi162 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a[116256]: ts=2024-03-30T12:47:31.903Z caller=main.go:1147 level=info msg="See you next time!" 2024-03-30T12:47:32.192 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:47:31 smithi162 podman[127027]: 2024-03-30 12:47:31.913107986 +0000 UTC m=+0.128775740 container died bdbe25c7dd8b5ba6c7b2884e6a0527af953d7804ade51022f419c5da503e4773 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:47:32.574 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:47:32 smithi162 podman[127027]: 2024-03-30 12:47:32.302739933 +0000 UTC m=+0.518407693 container cleanup bdbe25c7dd8b5ba6c7b2884e6a0527af953d7804ade51022f419c5da503e4773 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T12:47:32.574 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Mar 30 12:47:32 smithi162 bash[127027]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-prometheus-a 2024-03-30T12:47:32.723 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@prometheus.a.service' 2024-03-30T12:47:32.758 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T12:47:32.758 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-03-30T12:47:32.759 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 --force --keep-logs 2024-03-30T12:47:32.916 INFO:teuthology.orchestra.run.smithi084.stdout:Deleting cluster with fsid: d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:47:34.498 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:34 smithi084 systemd[1]: Stopping Ceph alertmanager.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:47:34.758 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:34.502Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:47:34.758 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:34.502Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi084.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.84:8443: connect: connection refused" 2024-03-30T12:47:34.759 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:34.503Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi162.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.162:8443: connect: connection refused" 2024-03-30T12:47:34.759 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:34 smithi084 ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a[125008]: ts=2024-03-30T12:47:34.643Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-03-30T12:47:34.759 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:34 smithi084 podman[141426]: 2024-03-30 12:47:34.683806417 +0000 UTC m=+0.194715613 container died d373ca331553e865c582de611c7fb0754a3752d1220313046191d868ad2456ee (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T12:47:35.258 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:35 smithi084 podman[141426]: 2024-03-30 12:47:35.126500402 +0000 UTC m=+0.637409596 container cleanup d373ca331553e865c582de611c7fb0754a3752d1220313046191d868ad2456ee (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T12:47:35.258 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:35 smithi084 bash[141426]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a 2024-03-30T12:47:35.567 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:35 smithi084 podman[141440]: 2024-03-30 12:47:35.302874397 +0000 UTC m=+0.614646472 container remove d373ca331553e865c582de611c7fb0754a3752d1220313046191d868ad2456ee (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T12:47:35.567 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:35 smithi084 podman[141440]: 2024-03-30 12:47:35.378556787 +0000 UTC m=+0.690328856 volume remove 9346ee16342f86f5e3272b5376cc2de14f766ae756352697426bc0a38b2e5551 2024-03-30T12:47:35.986 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:47:35 smithi084 systemd[1]: Stopping Ceph node-exporter.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:47:35.987 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:35 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@alertmanager.a.service: Deactivated successfully. 2024-03-30T12:47:35.987 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:35 smithi084 systemd[1]: Stopped Ceph alertmanager.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:47:35.987 INFO:journalctl@ceph.alertmanager.a.smithi084.stdout:Mar 30 12:47:35 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@alertmanager.a.service: Consumed 1.590s CPU time. 2024-03-30T12:47:36.258 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:47:35 smithi084 podman[141545]: 2024-03-30 12:47:35.99151426 +0000 UTC m=+0.088301084 container died c19e5ff6fa838037c45c72008e45fb93dc19a0de74081a9fd47192b5615e3a33 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T12:47:36.690 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:47:36 smithi084 podman[141545]: 2024-03-30 12:47:36.305757691 +0000 UTC m=+0.402544523 container cleanup c19e5ff6fa838037c45c72008e45fb93dc19a0de74081a9fd47192b5615e3a33 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T12:47:36.690 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:47:36 smithi084 bash[141545]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a 2024-03-30T12:47:36.691 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:47:36 smithi084 podman[141559]: 2024-03-30 12:47:36.490205108 +0000 UTC m=+0.501884093 container remove c19e5ff6fa838037c45c72008e45fb93dc19a0de74081a9fd47192b5615e3a33 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T12:47:36.691 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:47:36 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-03-30T12:47:36.964 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:47:36 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@node-exporter.a.service: Failed with result 'exit-code'. 2024-03-30T12:47:36.964 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:47:36 smithi084 systemd[1]: Stopped Ceph node-exporter.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:47:36.965 INFO:journalctl@ceph.node-exporter.a.smithi084.stdout:Mar 30 12:47:36 smithi084 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@node-exporter.a.service: Consumed 2.263s CPU time. 2024-03-30T12:47:37.339 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 --force --keep-logs 2024-03-30T12:47:37.495 INFO:teuthology.orchestra.run.smithi162.stdout:Deleting cluster with fsid: d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:47:39.374 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:47:39 smithi162 systemd[1]: Stopping Ceph grafana.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:47:39.727 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:47:39 smithi162 podman[127471]: 2024-03-30 12:47:39.409306572 +0000 UTC m=+0.114470687 container died 8cc7d12810a612fc13d34fdc9922a14ea7b8e836aa00bb27392d7291fb1d356f (image=quay.io/ceph/ceph-grafana:9.4.12, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a, summary=Grafana Container configured for Ceph mgr/dashboard integration, com.redhat.component=ubi8-container, name=ubi8, io.openshift.expose-services=, release=239.1651231664, vcs-type=git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., build-date=2022-04-29T11:48:11.055897, io.buildah.version=1.32.0, maintainer=Paul Cuzner , url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, io.k8s.display-name=Red Hat Universal Base Image 8, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, distribution-scope=public, vendor=Red Hat, Inc., description=Ceph Grafana Container, architecture=x86_64, io.openshift.tags=base rhel8, version=8.5) 2024-03-30T12:47:40.124 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:47:39 smithi162 podman[127471]: 2024-03-30 12:47:39.731770576 +0000 UTC m=+0.436934688 container cleanup 8cc7d12810a612fc13d34fdc9922a14ea7b8e836aa00bb27392d7291fb1d356f (image=quay.io/ceph/ceph-grafana:9.4.12, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, io.buildah.version=1.32.0, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, vcs-type=git, io.openshift.tags=base rhel8, build-date=2022-04-29T11:48:11.055897, com.redhat.component=ubi8-container, architecture=x86_64, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, version=8.5, vendor=Red Hat, Inc., distribution-scope=public, description=Ceph Grafana Container, io.k8s.display-name=Red Hat Universal Base Image 8, maintainer=Paul Cuzner , summary=Grafana Container configured for Ceph mgr/dashboard integration, name=ubi8, io.openshift.expose-services=, release=239.1651231664) 2024-03-30T12:47:40.124 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:47:39 smithi162 bash[127471]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a 2024-03-30T12:47:40.125 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:47:39 smithi162 podman[127485]: 2024-03-30 12:47:39.933034823 +0000 UTC m=+0.526694352 container remove 8cc7d12810a612fc13d34fdc9922a14ea7b8e836aa00bb27392d7291fb1d356f (image=quay.io/ceph/ceph-grafana:9.4.12, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-grafana-a, architecture=x86_64, description=Ceph Grafana Container, maintainer=Paul Cuzner , build-date=2022-04-29T11:48:11.055897, version=8.5, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.buildah.version=1.32.0, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., release=239.1651231664, name=ubi8, io.openshift.tags=base rhel8, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, com.redhat.component=ubi8-container, io.openshift.expose-services=, vendor=Red Hat, Inc., distribution-scope=public, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, io.k8s.display-name=Red Hat Universal Base Image 8, vcs-type=git) 2024-03-30T12:47:40.125 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:47:39 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@grafana.a.service: Main process exited, code=exited, status=143/n/a 2024-03-30T12:47:40.608 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:47:40 smithi162 systemd[1]: Stopping Ceph node-exporter.b for d3450b00-ee8e-11ee-b647-cb9ed24678a4... 2024-03-30T12:47:40.609 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:47:40 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@grafana.a.service: Failed with result 'exit-code'. 2024-03-30T12:47:40.609 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:47:40 smithi162 systemd[1]: Stopped Ceph grafana.a for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:47:40.609 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Mar 30 12:47:40 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@grafana.a.service: Consumed 8.579s CPU time. 2024-03-30T12:47:40.874 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:47:40 smithi162 podman[127591]: 2024-03-30 12:47:40.613030848 +0000 UTC m=+0.152312009 container died fcd914fcfd7830d9ddd22f575d738fcfb5d946cef1651083c567099d1797f992 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T12:47:41.124 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:47:40 smithi162 podman[127591]: 2024-03-30 12:47:40.969270742 +0000 UTC m=+0.508551901 container cleanup fcd914fcfd7830d9ddd22f575d738fcfb5d946cef1651083c567099d1797f992 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T12:47:41.124 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:47:40 smithi162 bash[127591]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b 2024-03-30T12:47:41.508 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:47:41 smithi162 podman[127605]: 2024-03-30 12:47:41.228951775 +0000 UTC m=+0.619083086 container remove fcd914fcfd7830d9ddd22f575d738fcfb5d946cef1651083c567099d1797f992 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T12:47:41.508 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:47:41 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-03-30T12:47:41.508 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:47:41 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@node-exporter.b.service: Failed with result 'exit-code'. 2024-03-30T12:47:41.508 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:47:41 smithi162 systemd[1]: Stopped Ceph node-exporter.b for d3450b00-ee8e-11ee-b647-cb9ed24678a4. 2024-03-30T12:47:41.508 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Mar 30 12:47:41 smithi162 systemd[1]: ceph-d3450b00-ee8e-11ee-b647-cb9ed24678a4@node-exporter.b.service: Consumed 2.227s CPU time. 2024-03-30T12:47:41.984 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-30T12:47:42.019 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-30T12:47:42.049 INFO:tasks.cephadm:Archiving crash dumps... 2024-03-30T12:47:42.051 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/crash to /home/teuthworker/archive/yuriw-2024-03-30_00:41:04-rados-wip-ceph_test_rados-partial-reads-distro-default-smithi/7630653/remote/smithi084/crash 2024-03-30T12:47:42.051 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/crash -- . 2024-03-30T12:47:42.112 INFO:teuthology.orchestra.run.smithi084.stderr:tar: /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/crash: Cannot open: No such file or directory 2024-03-30T12:47:42.112 INFO:teuthology.orchestra.run.smithi084.stderr:tar: Error is not recoverable: exiting now 2024-03-30T12:47:42.114 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/crash to /home/teuthworker/archive/yuriw-2024-03-30_00:41:04-rados-wip-ceph_test_rados-partial-reads-distro-default-smithi/7630653/remote/smithi162/crash 2024-03-30T12:47:42.115 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/crash -- . 2024-03-30T12:47:42.156 INFO:teuthology.orchestra.run.smithi162.stderr:tar: /var/lib/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/crash: Cannot open: No such file or directory 2024-03-30T12:47:42.156 INFO:teuthology.orchestra.run.smithi162.stderr:tar: Error is not recoverable: exiting now 2024-03-30T12:47:42.158 INFO:tasks.cephadm:Checking cluster log for badness... 2024-03-30T12:47:42.158 DEBUG:teuthology.orchestra.run.smithi084:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-03-30T12:47:42.191 INFO:teuthology.orchestra.run.smithi084.stdout:2024-03-30T12:30:00.000147+0000 mon.a (mon.0) 842 : cluster 4 [WRN] OSD_DOWN: 1 osds down 2024-03-30T12:47:42.191 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-03-30T12:47:42.192 INFO:tasks.cephadm:Compressing logs... 2024-03-30T12:47:42.192 DEBUG:teuthology.orchestra.run.smithi084:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-30T12:47:42.235 DEBUG:teuthology.orchestra.run.smithi162:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-30T12:47:42.263 INFO:teuthology.orchestra.run.smithi162.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-30T12:47:42.263 INFO:teuthology.orchestra.run.smithi162.stderr:: No such file or directory 2024-03-30T12:47:42.264 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-osd.6.log 2024-03-30T12:47:42.264 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph.audit.log 2024-03-30T12:47:42.264 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-mds.b.log 2024-03-30T12:47:42.264 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-osd.4.log 2024-03-30T12:47:42.264 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-osd.7.log 2024-03-30T12:47:42.264 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-mds.b.log: /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-osd.5.log 2024-03-30T12:47:42.264 INFO:teuthology.orchestra.run.smithi162.stderr: 84.1% -- replaced with /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-mds.b.log.gz 2024-03-30T12:47:42.264 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-mgr.x.log 2024-03-30T12:47:42.272 INFO:teuthology.orchestra.run.smithi084.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-30T12:47:42.272 INFO:teuthology.orchestra.run.smithi084.stderr:: No such file or directory 2024-03-30T12:47:42.273 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-mon.a.log 2024-03-30T12:47:42.273 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph.audit.log 2024-03-30T12:47:42.273 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-osd.1.log 2024-03-30T12:47:42.273 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-osd.3.log 2024-03-30T12:47:42.273 INFO:teuthology.orchestra.run.smithi084.stderr:gzip/var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-osd.1.log: -5 --verbose -- /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-mgr.y.log 2024-03-30T12:47:42.273 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-osd.0.log 2024-03-30T12:47:42.273 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph.cephadm.log 2024-03-30T12:47:42.274 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph.log 2024-03-30T12:47:42.274 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph.cephadm.log: 90.7% -- replaced with /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph.cephadm.log.gz 2024-03-30T12:47:42.274 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-osd.2.log 2024-03-30T12:47:42.274 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph.log: 92.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-30T12:47:42.274 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-volume.log 2024-03-30T12:47:42.274 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-osd.2.log: 94.3% -- replaced with /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph.audit.log.gz 2024-03-30T12:47:42.275 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph.cephadm.log 2024-03-30T12:47:42.275 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph.log 2024-03-30T12:47:42.275 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph.cephadm.log: 84.0% -- replaced with /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph.cephadm.log.gz 2024-03-30T12:47:42.275 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-volume.log 2024-03-30T12:47:42.275 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph.log: 90.8% -- replaced with /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph.audit.log.gz 2024-03-30T12:47:42.275 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-mon.b.log 2024-03-30T12:47:42.275 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-volume.log: 82.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-30T12:47:42.278 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-mds.a.log 2024-03-30T12:47:42.289 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-mon.b.log: 93.4% -- replaced with /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph.log.gz 2024-03-30T12:47:42.291 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-mon.c.log 2024-03-30T12:47:42.293 INFO:teuthology.orchestra.run.smithi162.stderr: 91.1% -- replaced with /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-volume.log.gz 2024-03-30T12:47:42.303 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-mds.a.log: /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-mon.c.log: 91.1% -- replaced with /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-volume.log.gz 2024-03-30T12:47:42.307 INFO:teuthology.orchestra.run.smithi084.stderr: 91.6% -- replaced with /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-mds.a.log.gz 2024-03-30T12:47:42.307 INFO:teuthology.orchestra.run.smithi162.stderr: 89.3% -- replaced with /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-mgr.x.log.gz 2024-03-30T12:47:42.312 INFO:teuthology.orchestra.run.smithi084.stderr: 96.0% -- replaced with /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph.log.gz 2024-03-30T12:47:42.646 INFO:teuthology.orchestra.run.smithi084.stderr: 89.2% -- replaced with /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-mgr.y.log.gz 2024-03-30T12:47:43.112 INFO:teuthology.orchestra.run.smithi162.stderr: 91.5% -- replaced with /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-mon.b.log.gz 2024-03-30T12:47:43.288 INFO:teuthology.orchestra.run.smithi084.stderr: 91.3% -- replaced with /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-mon.c.log.gz 2024-03-30T12:47:43.930 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-mon.a.log.gz 2024-03-30T12:47:46.946 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-osd.2.log.gz 2024-03-30T12:47:47.036 INFO:teuthology.orchestra.run.smithi084.stderr: 94.9% -- replaced with /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-osd.3.log.gz 2024-03-30T12:47:47.115 INFO:teuthology.orchestra.run.smithi084.stderr: 94.6% -- replaced with /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-osd.1.log.gz 2024-03-30T12:47:48.370 INFO:teuthology.orchestra.run.smithi162.stderr: 94.8% -- replaced with /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-osd.7.log.gz 2024-03-30T12:47:49.588 INFO:teuthology.orchestra.run.smithi162.stderr: 94.4% -- replaced with /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-osd.6.log.gz 2024-03-30T12:47:50.839 INFO:teuthology.orchestra.run.smithi084.stderr: 94.6% -- replaced with /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-osd.0.log.gz 2024-03-30T12:47:50.840 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-03-30T12:47:50.840 INFO:teuthology.orchestra.run.smithi084.stderr:real 0m8.592s 2024-03-30T12:47:50.841 INFO:teuthology.orchestra.run.smithi084.stderr:user 0m24.988s 2024-03-30T12:47:50.841 INFO:teuthology.orchestra.run.smithi084.stderr:sys 0m0.984s 2024-03-30T12:47:59.323 INFO:teuthology.orchestra.run.smithi162.stderr: 94.0% -- replaced with /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-osd.5.log.gz 2024-03-30T12:48:01.210 INFO:teuthology.orchestra.run.smithi162.stderr: 94.2% -- replaced with /var/log/ceph/d3450b00-ee8e-11ee-b647-cb9ed24678a4/ceph-osd.4.log.gz 2024-03-30T12:48:01.212 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-03-30T12:48:01.212 INFO:teuthology.orchestra.run.smithi162.stderr:real 0m18.962s 2024-03-30T12:48:01.212 INFO:teuthology.orchestra.run.smithi162.stderr:user 0m48.439s 2024-03-30T12:48:01.212 INFO:teuthology.orchestra.run.smithi162.stderr:sys 0m1.868s 2024-03-30T12:48:01.213 INFO:tasks.cephadm:Archiving logs... 2024-03-30T12:48:01.213 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-03-30_00:41:04-rados-wip-ceph_test_rados-partial-reads-distro-default-smithi/7630653/remote/smithi084/log 2024-03-30T12:48:01.214 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-30T12:48:04.570 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-03-30_00:41:04-rados-wip-ceph_test_rados-partial-reads-distro-default-smithi/7630653/remote/smithi162/log 2024-03-30T12:48:04.572 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-30T12:48:11.396 INFO:tasks.cephadm:Removing cluster... 2024-03-30T12:48:11.396 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 --force 2024-03-30T12:48:11.551 INFO:teuthology.orchestra.run.smithi084.stdout:Deleting cluster with fsid: d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:48:11.841 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d3450b00-ee8e-11ee-b647-cb9ed24678a4 --force 2024-03-30T12:48:12.001 INFO:teuthology.orchestra.run.smithi162.stdout:Deleting cluster with fsid: d3450b00-ee8e-11ee-b647-cb9ed24678a4 2024-03-30T12:48:12.479 INFO:tasks.cephadm:Removing cephadm ... 2024-03-30T12:48:12.479 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-30T12:48:12.495 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-30T12:48:12.510 INFO:tasks.cephadm:Teardown complete 2024-03-30T12:48:12.511 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-30T12:48:12.521 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-30T12:48:12.522 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-30T12:48:12.538 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-30T12:48:12.628 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-30T12:48:12.644 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-30T12:48:12.645 DEBUG:teuthology.orchestra.run.smithi084:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T12:48:12.647 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T12:48:12.659 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: ntpq: command not found 2024-03-30T12:48:12.661 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-03-30T12:48:12.663 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-30T12:48:12.664 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-03-30T12:48:12.664 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 11 +60us[ +60us] +/- 93ms 2024-03-30T12:48:12.664 INFO:teuthology.orchestra.run.smithi084.stdout:^* hv02.front.sepia.ceph.com 3 7 377 76 -205us[ -108us] +/- 59ms 2024-03-30T12:48:12.664 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 +280us[ +280us] +/- 70ms 2024-03-30T12:48:12.664 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T12:48:12.666 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-30T12:48:12.666 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-03-30T12:48:12.666 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 15 +8050ns[ +13us] +/- 93ms 2024-03-30T12:48:12.666 INFO:teuthology.orchestra.run.smithi162.stdout:^* hv02.front.sepia.ceph.com 3 6 377 13 -235us[ -230us] +/- 60ms 2024-03-30T12:48:12.666 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 +247us[ +247us] +/- 70ms 2024-03-30T12:48:12.666 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T12:48:12.667 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-30T12:48:13.005 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-30T12:48:13.006 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-30T12:48:13.127 DEBUG:teuthology.orchestra.run.smithi084:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-30T12:48:13.214 DEBUG:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-30T12:48:13.299 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-30T12:48:13.330 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T12:48:13.330 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-30T12:48:13.362 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T12:48:13.362 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-30T12:48:13.377 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-30T12:48:13.477 INFO:teuthology.task.internal:Duration was 2476.180652 seconds 2024-03-30T12:48:13.477 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-30T12:48:13.627 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-30T12:48:13.627 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-30T12:48:13.630 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-30T12:48:13.671 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-30T12:48:13.676 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-30T12:48:14.168 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-30T12:48:14.169 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi084.front.sepia.ceph.com 2024-03-30T12:48:14.169 DEBUG:teuthology.orchestra.run.smithi084:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-30T12:48:14.190 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2024-03-30T12:48:14.191 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-30T12:48:14.219 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-30T12:48:14.219 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-30T12:48:14.233 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-30T12:48:14.289 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-30T12:48:14.289 DEBUG:teuthology.orchestra.run.smithi084:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-30T12:48:14.301 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-30T12:48:15.225 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-30T12:48:15.512 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-30T12:48:15.513 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-30T12:48:15.544 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-30T12:48:15.576 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-30T12:48:15.593 DEBUG:teuthology.orchestra.run.smithi084:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-30T12:48:15.596 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-30T12:48:15.619 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = core 2024-03-30T12:48:15.645 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2024-03-30T12:48:15.676 DEBUG:teuthology.orchestra.run.smithi084:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-30T12:48:15.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T12:48:15.689 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-30T12:48:15.730 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T12:48:15.731 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-30T12:48:15.744 INFO:teuthology.task.internal:Transferring archived files... 2024-03-30T12:48:15.745 DEBUG:teuthology.misc:Transferring archived files from smithi084:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-03-30_00:41:04-rados-wip-ceph_test_rados-partial-reads-distro-default-smithi/7630653/remote/smithi084 2024-03-30T12:48:15.745 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-30T12:48:15.814 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-03-30_00:41:04-rados-wip-ceph_test_rados-partial-reads-distro-default-smithi/7630653/remote/smithi162 2024-03-30T12:48:15.814 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-30T12:48:15.858 INFO:teuthology.task.internal:Removing archive directory... 2024-03-30T12:48:15.858 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-30T12:48:15.860 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-30T12:48:15.906 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-30T12:48:15.921 INFO:teuthology.task.internal:Not uploading archives. 2024-03-30T12:48:15.921 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-30T12:48:16.132 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-30T12:48:16.132 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-30T12:48:16.135 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-30T12:48:16.147 INFO:teuthology.orchestra.run.smithi084.stdout: 265594 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 30 12:48 /home/ubuntu/cephtest 2024-03-30T12:48:16.150 INFO:teuthology.orchestra.run.smithi162.stdout: 265305 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 30 12:48 /home/ubuntu/cephtest 2024-03-30T12:48:16.152 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-30T12:48:16.221 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-30T12:48:16.397 INFO:teuthology.nuke:Checking targets against current locks 2024-03-30T12:48:16.425 DEBUG:teuthology.nuke:shortname: smithi084 2024-03-30T12:48:16.425 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-30T12:48:16.451 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-03-30_00:41:04-rados-wip-ceph_test_rados-partial-reads-distro-default-smithi/7630653', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 11:58:35.080767', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEIugBWdrP3T2RUWloFGQbMi8/5P42qD6z3vdLDF2OIEtGBkBLy+EAQE3Z5Vw3PfOu5qRM62r1lyJ1L70LvQdBo='} 2024-03-30T12:48:16.455 DEBUG:teuthology.nuke:shortname: smithi162 2024-03-30T12:48:16.455 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-30T12:48:16.479 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-03-30_00:41:04-rados-wip-ceph_test_rados-partial-reads-distro-default-smithi/7630653', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 11:58:35.079059', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEpiQC+FKBOtIuEegw3sZZs1yM/SelTMCr7pZdUg3ibhZyycMQJMMp97y7/jwtRpFt3N5v9t81qXqLHXNgw1FbE='} 2024-03-30T12:48:16.512 INFO:teuthology.orchestra.console.smithi084:Power off 2024-03-30T12:48:16.513 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-30T12:48:16.536 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2024-03-30T12:48:16.536 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T12:48:16.553 INFO:teuthology.orchestra.console.smithi162:Power off 2024-03-30T12:48:16.554 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-30T12:48:16.562 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-03-30T12:48:16.575 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off 2024-03-30T12:48:16.575 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T12:48:16.600 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-03-30T12:48:20.564 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T12:48:20.601 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T12:48:20.674 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-03-30T12:48:20.712 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-03-30T12:48:24.678 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T12:48:24.713 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T12:48:24.789 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-03-30T12:48:24.824 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2024-03-30T12:48:24.891 INFO:teuthology.orchestra.console.smithi084:Power off completed 2024-03-30T12:48:24.925 INFO:teuthology.orchestra.console.smithi162:Power off completed 2024-03-30T12:48:25.029 INFO:teuthology.run:Summary data: description: rados/upgrade/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} duration: 2476.180651664734 failure_reason: failed to complete snap trimming before timeout flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=9106ba89c194425288004af05718eccf status: fail success: false 2024-03-30T12:48:25.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T12:48:25.116 INFO:teuthology.run:FAIL